==================================================Ascend ============================= test session starts ============================== platform linux -- Python 3.9.19, pytest-6.2.5, py-1.11.0, pluggy-1.5.0 rootdir: /home/jenkins/mindspore/testcases/testcases/tests/st/ops/allcases_onecard, configfile: ../../../../../../../sault/virtual_test/virtualenv_005/sault/config/pytest.ini plugins: mock-3.14.0, hydra-core-1.3.2, forked-1.6.0, anyio-4.9.0, xdist-1.32.0 collected 1 item test_ops_group_cases.py platform: ascend910b, max workers: 2147483647, memory threshold: 51200M level: level0, group_name: reduction_op Start group testing... ops group_cases_0 with 44 cases start to running, all cases are below: case: (, 'pynative', 'mint.mean') case: (, 'pynative', 'mint.argmax') case: (, 'pynative', 'mint.argmin') case: (, 'pynative', 'mint.count_nonzero') case: (, 'pynative', 'Tensor.mean') case: (, 'pynative', 'Tensor.sum') case: (, 'pynative', 'Tensor.argmax') case: (, 'pynative', 'Tensor.argmin') case: (, 'pynative', 'mint.sum') case: (, 'pynative', 'mint.max') case: (, 'pynative', 'mint.min') case: (, 'pynative', 'mint.prod') case: (, 'pynative', 'Tensor.max') case: (, 'pynative', 'mint.all') case: (, 'pynative', 'mint.mean') case: (, 'pynative', 'mint.argmax') case: (, 'pynative', 'mint.argmin') case: (, 'pynative', 'mint.count_nonzero') case: (, 'pynative', 'Tensor.mean') case: (, 'pynative', 'Tensor.sum') case: (, 'pynative', 'Tensor.argmax') case: (, 'pynative', 'Tensor.argmin') case: (, 'pynative', 'mint.sum') case: (, 'pynative', 'mint.max') case: (, 'pynative', 'mint.min') case: (, 'pynative', 'mint.prod') case: (, 'pynative', 'Tensor.max') case: (, 'pynative', 'mint.all') case: (, 'kbk', 'mint.mean') case: (, 'kbk', 'mint.argmax') case: (, 'kbk', 'mint.count_nonzero') case: (, 'kbk', 'Tensor.sum') case: (, 'kbk', 'Tensor.argmin') case: (, 'kbk', 'mint.min') case: (, 'kbk', 'Tensor.max') case: (, 'kbk', 'mint.all') case: (, 'kbk', 'mint.mean') case: (, 'kbk', 'mint.argmax') case: (, 'kbk', 'mint.count_nonzero') case: (, 'kbk', 'Tensor.sum') case: (, 'kbk', 'Tensor.argmin') case: (, 'kbk', 'mint.min') case: (, 'kbk', 'Tensor.max') case: (, 'kbk', 'mint.all') ops group_cases_0 total running memory: 704M, memory threshold: 51200M op_name: Tensor.argmax, mode:pynative, test_op_reference... op_name: mint.argmax, mode:pynative, test_op_reference... op_name: Tensor.argmin, mode:pynative, test_op_reference... op_name: mint.count_nonzero, mode:pynative, test_op_reference... op_name: mint.argmin, mode:pynative, test_op_reference... op_name: Tensor.sum, mode:pynative, test_op_reference... op_name: mint.max, mode:pynative, test_op_reference... op_name: mint.min, mode:pynative, test_op_reference... op_name: mint.prod, mode:pynative, test_op_reference... op_name: Tensor.mean, mode:pynative, test_op_reference... op_name: mint.sum, mode:pynative, test_op_reference... op_name: Tensor.max, mode:pynative, test_op_reference... op_name: mint.all, mode:pynative, test_op_reference... .[LOG_WARNING] can not open file, file: /home/jenkins/ascend/log/debug/plog/plog-169622_20260129173656805.log, possible reason: Permission denied....... TotalTime = 0.14395, [30] [bootstrap]: 0.00052968 [type_inference]: 0.0947004 [event_method]: 2.856e-05 [auto_monad]: 0.00025072 [graph_reusing]: 6.75002e-06 [pre_auto_parallel]: 1.19e-05 [py_interpret_to_execute]: 0.00012755 [rewriter_before_opt_a]: 0.0123802 [expand_dump_flag]: 9.57001e-06 [jit_opt_a]: 0.0329251, [2] [Cycle 1]: 0.00247325, [27] [switch_simplify]: 0.00020735 [loop_unroll]: 3.403e-05 [a_1]: 0.00076506 [with_stream_mark]: 2.355e-05 [recompute_prepare]: 8.38999e-06 [updatestate_depend_eliminate]: 1.624e-05 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 6.70998e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.884e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.094e-05 [inline_without_move]: 5.99999e-06 [renormalize]: 0.0009025 [add_forward_monad_depend]: 0.00010428 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 2.736e-05 [cse]: 5.393e-05 [replace_applicator]: 1.426e-05 [Cycle 2]: 0.00033476, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.21998e-06 [a_1]: 9.162e-05 [with_stream_mark]: 1.039e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 1.86998e-06 [replace_old_param]: 7.94002e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.44001e-06 [cse]: 1.554e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.348e-05 [rewriter_after_opt_a]: 5.015e-05 [convert_after_rewriter]: 0.00012124 [order_py_execute_after_rewriter]: 6.94001e-06 [mutable_eliminate]: 0.00072967 [jit_opt_b]: 5.263e-05, [1] [Cycle 1]: 4.493e-05, [2] [frontend_op_eliminate]: 1.68e-05 [inline_after_opt_a]: 1.64e-05 [cconv]: 3.038e-05 [loop_unroll]: 0.00044653 [jit_opt_after_cconv]: 0.00016986, [1] [Cycle 1]: 0.00016212, [11] [c_1]: 2.101e-05 [parameter_eliminate]: 4.50001e-06 [updatestate_depend_eliminate]: 7.58001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 3.518e-05 [call_graph_tuple_transform]: 2.097e-05 [tuple_list_get_item_eliminator]: 5.89999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 4.422e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 2.837e-05 [add_recomputation]: 7.493e-05 [cse_after_recomputation]: 2.907e-05, [1] [Cycle 1]: 2.252e-05, [1] [cse]: 1.529e-05 [auto_monad_reorder]: 2.807e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00050162 [symbol_engine_optimizer]: 7.743e-05, [1] [Cycle 1]: 7.074e-05, [6] [build]: 4.47998e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.393e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 7.40023e-07 [validate]: 0.00026913 Sums bootstrap : 0.000530s : 0.47% type_inference : 0.094700s : 83.74% event_method : 0.000029s : 0.03% auto_monad : 0.000251s : 0.22% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000012s : 0.01% py_interpret_to_execute : 0.000128s : 0.11% rewriter_before_opt_a : 0.012380s : 10.95% expand_dump_flag : 0.000010s : 0.01% jit_opt_a.switch_simplify : 0.000214s : 0.19% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000857s : 0.76% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.000903s : 0.80% jit_opt_a.add_forward_monad_depend : 0.000105s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.03% jit_opt_a.cse : 0.000069s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000050s : 0.04% convert_after_rewriter : 0.000121s : 0.11% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000730s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000030s : 0.03% loop_unroll : 0.000447s : 0.39% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000044s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000028s : 0.03% add_recomputation : 0.000075s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000028s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000502s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000269s : 0.24% Time group info: ------[substitution.] 0.000351 24 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.56% : 0.000005s : 3: substitution.graph_param_transform 86.53% : 0.000303s : 5: substitution.inline 1.28% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.90% : 0.000014s : 4: substitution.remove_not_recompute_node 1.50% : 0.000005s : 2: substitution.replace_old_param 4.09% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.094582 2 95.88% : 0.090683s : 1: type_inference.infer 4.12% : 0.003899s : 1: type_inference.specialize ------[replace.] 0.000111 7 70.25% : 0.000078s : 5: replace.inline 29.75% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000313 7 95.79% : 0.000300s : 5: match.inline 4.21% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.18% : 0.000001s : 11: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.19% : 0.000001s : 11: predicate.addn_zero_filter 2.09% : 0.000003s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.19% : 0.000001s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000001s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000008s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 2.26% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.67% : 0.000002s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 2.20% : 0.000003s : 19: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.76% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.58% : 0.000011s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000001s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001332 16 41.56% : 0.000554s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.60% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.83% : 0.000677s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.145786 72 0.05% : 0.000078s : 1: add_recomputation 0.18% : 0.000260s : 1: auto_monad 0.02% : 0.000031s : 1: auto_monad_reorder 0.39% : 0.000565s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.09% : 0.000131s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000031s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.01% : 0.000016s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.59% : 0.032929s : 1: jit_opt_a 0.12% : 0.000173s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.31% : 0.000455s : 1: loop_unroll 0.51% : 0.000741s : 1: mutable_eliminate 0.78% : 0.001138s : 26: opt.transform.jit_opt_a 0.03% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000512s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000014s : 1: pre_auto_parallel 0.09% : 0.000133s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000047s : 1: remove_dup_value 0.36% : 0.000524s : 1: renormalize.infer 0.25% : 0.000368s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000054s : 1: rewriter_after_opt_a 8.51% : 0.012411s : 1: rewriter_before_opt_a 0.05% : 0.000080s : 1: symbol_engine_optimizer 64.98% : 0.094725s : 1: type_inference TotalTime = 0.0835915, [30] [bootstrap]: 0.00058259 [type_inference]: 0.0665412 [event_method]: 2.245e-05 [auto_monad]: 0.00013546 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 1.098e-05 [py_interpret_to_execute]: 5.542e-05 [rewriter_before_opt_a]: 0.00011374 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.0128937, [2] [Cycle 1]: 0.00203178, [27] [switch_simplify]: 9.751e-05 [loop_unroll]: 3.594e-05 [a_1]: 0.00062411 [with_stream_mark]: 2.936e-05 [recompute_prepare]: 8.89998e-06 [updatestate_depend_eliminate]: 1.705e-05 [updatestate_assign_eliminate]: 3.87998e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.72001e-06 [get_grad_eliminate_]: 6.00002e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.782e-05 [j_node_and_user_rematch]: 1.276e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 1.104e-05 [inline_without_move]: 5.66998e-06 [renormalize]: 0.00079651 [add_forward_monad_depend]: 1.331e-05 [auto_monad_grad]: 3.60998e-06 [auto_monad_eliminator]: 2.882e-05 [cse]: 4.011e-05 [replace_applicator]: 1.494e-05 [Cycle 2]: 0.00034925, [27] [switch_simplify]: 5.87001e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.093e-05 [with_stream_mark]: 1.249e-05 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.78002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 8.36002e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.20999e-06 [inline_without_move]: 4.72e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 6.82002e-06 [cse]: 1.308e-05 [replace_applicator]: 5.11002e-06 [py_interpret_to_execute_after_opt_a]: 1.492e-05 [rewriter_after_opt_a]: 0.00016563 [convert_after_rewriter]: 1.914e-05 [order_py_execute_after_rewriter]: 6.63998e-06 [mutable_eliminate]: 0.00074589 [jit_opt_b]: 0.00011514, [1] [Cycle 1]: 0.00010613, [2] [frontend_op_eliminate]: 1.766e-05 [inline_after_opt_a]: 7.406e-05 [cconv]: 3.665e-05 [loop_unroll]: 0.0006025 [jit_opt_after_cconv]: 0.00017499, [1] [Cycle 1]: 0.00016842, [11] [c_1]: 2.136e-05 [parameter_eliminate]: 4.55999e-06 [updatestate_depend_eliminate]: 1.052e-05 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.814e-05 [call_graph_tuple_transform]: 2.3e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 1.02e-06 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.661e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 3.171e-05 [add_recomputation]: 6.714e-05 [cse_after_recomputation]: 2.553e-05, [1] [Cycle 1]: 1.992e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 2.737e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 0.00012653 [opt_after_jit_grad]: 0.00063431 [symbol_engine_optimizer]: 7.874e-05, [1] [Cycle 1]: 7.122e-05, [6] [build]: 4.42998e-06 [elim_shapecalc]: 8.55001e-06 [elim_not_effective]: 1.427e-05 [opt_reshape]: 6.16998e-06 [fold_const_symbol]: 8.96002e-06 [renormalize]: 8.80013e-07 [validate]: 7.654e-05 Sums bootstrap : 0.000583s : 0.81% type_inference : 0.066541s : 91.97% event_method : 0.000022s : 0.03% auto_monad : 0.000135s : 0.19% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000011s : 0.02% py_interpret_to_execute : 0.000055s : 0.08% rewriter_before_opt_a : 0.000114s : 0.16% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000103s : 0.14% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000715s : 0.99% jit_opt_a.with_stream_mark : 0.000042s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000797s : 1.10% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.05% jit_opt_a.cse : 0.000053s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000166s : 0.23% convert_after_rewriter : 0.000019s : 0.03% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000746s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000074s : 0.10% cconv : 0.000037s : 0.05% loop_unroll : 0.000603s : 0.83% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000032s : 0.04% add_recomputation : 0.000067s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000027s : 0.04% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000127s : 0.17% opt_after_jit_grad : 0.000634s : 0.88% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000077s : 0.11% Time group info: ------[substitution.] 0.000280 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 3: substitution.graph_param_transform 83.99% : 0.000235s : 4: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.43% : 0.000012s : 4: substitution.remove_not_recompute_node 2.40% : 0.000007s : 2: substitution.replace_old_param 4.52% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066450 2 97.96% : 0.065094s : 1: type_inference.infer 2.04% : 0.001356s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.78% : 0.000054s : 4: replace.inline 32.22% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 95.31% : 0.000233s : 4: match.inline 4.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.76% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.18% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.21% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.08% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 6.29% : 0.000008s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 2.30% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.66% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.15% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.45% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 1.09% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000010s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.94% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.11% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000954 13 46.81% : 0.000447s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.72% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.47% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.085455 72 0.08% : 0.000070s : 1: add_recomputation 0.16% : 0.000140s : 1: auto_monad 0.04% : 0.000030s : 1: auto_monad_reorder 0.73% : 0.000623s : 1: bootstrap 0.05% : 0.000040s : 1: cconv 0.03% : 0.000022s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000035s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 15.09% : 0.012897s : 1: jit_opt_a 0.21% : 0.000178s : 1: jit_opt_after_cconv 0.14% : 0.000118s : 1: jit_opt_b 0.72% : 0.000615s : 1: loop_unroll 0.89% : 0.000761s : 1: mutable_eliminate 1.15% : 0.000986s : 26: opt.transform.jit_opt_a 0.06% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000085s : 4: opt.transform.jit_opt_b 0.02% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000647s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000013s : 1: pre_auto_parallel 0.07% : 0.000059s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.50% : 0.000429s : 1: renormalize.infer 0.42% : 0.000357s : 1: renormalize.specialize 0.15% : 0.000130s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000172s : 1: rewriter_after_opt_a 0.14% : 0.000117s : 1: rewriter_before_opt_a 0.10% : 0.000081s : 1: symbol_engine_optimizer 77.90% : 0.066570s : 1: type_inference . TotalTime = 0.0421767, [30] [bootstrap]: 0.00035234 [type_inference]: 0.031538 [event_method]: 2.553e-05 [auto_monad]: 7.967e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 5.918e-05 [rewriter_before_opt_a]: 9.589e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00756137, [2] [Cycle 1]: 0.00272363, [27] [switch_simplify]: 7.066e-05 [loop_unroll]: 3.355e-05 [a_1]: 0.00112234 [with_stream_mark]: 2.719e-05 [recompute_prepare]: 1.023e-05 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.85998e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 3.43e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 9.23002e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00107467 [add_forward_monad_depend]: 1.532e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.784e-05 [cse]: 4.243e-05 [replace_applicator]: 1.486e-05 [Cycle 2]: 0.000325, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.20999e-06 [a_1]: 8.825e-05 [with_stream_mark]: 1.126e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 4.79002e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 8.15999e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 7.51001e-06 [inline_without_move]: 4.91997e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.493e-05 [replace_applicator]: 5.53002e-06 [py_interpret_to_execute_after_opt_a]: 1.694e-05 [rewriter_after_opt_a]: 4.297e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 5.50001e-06 [mutable_eliminate]: 0.00072086 [jit_opt_b]: 5.267e-05, [1] [Cycle 1]: 4.446e-05, [2] [frontend_op_eliminate]: 1.667e-05 [inline_after_opt_a]: 1.664e-05 [cconv]: 3.164e-05 [loop_unroll]: 0.00045441 [jit_opt_after_cconv]: 0.0001606, [1] [Cycle 1]: 0.00015319, [11] [c_1]: 2.142e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 6.26998e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.68003e-06 [cse]: 3.238e-05 [call_graph_tuple_transform]: 2.053e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.89999e-06 [remove_dup_value]: 4.479e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 8.31002e-06 [add_recomputation]: 5.558e-05 [cse_after_recomputation]: 2.439e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.212e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 6.61999e-06 [opt_after_jit_grad]: 0.00047211 [symbol_engine_optimizer]: 7.487e-05, [1] [Cycle 1]: 6.86e-05, [6] [build]: 4.85999e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 6.19001e-06 [fold_const_symbol]: 9.03002e-06 [renormalize]: 3.09985e-07 [validate]: 4.909e-05 Sums bootstrap : 0.000352s : 0.95% type_inference : 0.031538s : 85.17% event_method : 0.000026s : 0.07% auto_monad : 0.000080s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000059s : 0.16% rewriter_before_opt_a : 0.000096s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.21% jit_opt_a.loop_unroll : 0.000039s : 0.10% jit_opt_a.a_1 : 0.001211s : 3.27% jit_opt_a.with_stream_mark : 0.000038s : 0.10% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001075s : 2.90% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000057s : 0.15% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000043s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000721s : 1.95% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000032s : 0.09% loop_unroll : 0.000454s : 1.23% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000045s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000056s : 0.15% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000472s : 1.28% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.13% Time group info: ------[substitution.] 0.000343 24 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000007s : 3: substitution.graph_param_transform 88.17% : 0.000302s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.56% : 0.000005s : 4: substitution.remove_not_recompute_node 1.63% : 0.000006s : 2: substitution.replace_old_param 4.55% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031439 2 30.33% : 0.009536s : 1: type_inference.infer 69.67% : 0.021903s : 1: type_inference.specialize ------[replace.] 0.000110 7 70.81% : 0.000078s : 5: replace.inline 29.19% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000314 7 95.44% : 0.000299s : 5: match.inline 4.56% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000441 747 0.37% : 0.000002s : 11: predicate.accumulaten_eliminater 0.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.31% : 0.000001s : 11: predicate.addn_check_dump 0.36% : 0.000002s : 11: predicate.addn_zero_filter 0.54% : 0.000002s : 11: predicate.arithmetic_simplify 0.42% : 0.000002s : 11: predicate.cast_eliminate 0.13% : 0.000001s : 3: predicate.check_bprop_eliminate 0.32% : 0.000001s : 11: predicate.compare_switch_simplify 0.40% : 0.000002s : 11: predicate.depend_value_elim 0.30% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 0.38% : 0.000002s : 11: predicate.dict_get_item_eliminator 0.34% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 3: predicate.elim_not_effective 0.14% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.33% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.31% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.31% : 0.000001s : 11: predicate.environ_get_depend_swap 0.40% : 0.000002s : 11: predicate.environ_get_eliminate 0.31% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.07% : 0.000000s : 3: predicate.fold_const_symbol 0.31% : 0.000001s : 6: predicate.get_grad_eliminate 0.07% : 0.000000s : 3: predicate.graph_param_transform 2.04% : 0.000009s : 24: predicate.inline 0.23% : 0.000001s : 6: predicate.inline_without_move 0.10% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.39% : 0.000002s : 6: predicate.less_batch_normalization 0.42% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 0.56% : 0.000002s : 16: predicate.load_eliminater 0.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 1.18% : 0.000005s : 38: predicate.loop_unroll_before_grad 0.55% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.34% : 0.000002s : 11: predicate.merge_addn 0.33% : 0.000001s : 11: predicate.minmaximum_grad 0.38% : 0.000002s : 3: predicate.mutable_eliminate 0.14% : 0.000001s : 3: predicate.opt_reshape 0.65% : 0.000003s : 16: predicate.partial_eliminate 0.36% : 0.000002s : 11: predicate.print_const_string_wrapper 0.50% : 0.000002s : 11: predicate.reduce_eliminate 0.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.15% : 0.000001s : 6: predicate.remove_not_recompute_node 0.52% : 0.000002s : 19: predicate.replace_applicator 0.18% : 0.000001s : 6: predicate.replace_old_param 0.08% : 0.000000s : 3: predicate.reset_defer_inline 0.35% : 0.000002s : 11: predicate.reshape_eliminate 0.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 3: predicate.row_tensor_eliminate 0.38% : 0.000002s : 11: predicate.same_eliminate 0.16% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 6: predicate.special_op_eliminate 0.27% : 0.000001s : 6: predicate.specialize_transform 0.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 0.35% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.12% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.89% : 0.000004s : 18: predicate.switch_defer_inline 0.63% : 0.000003s : 18: predicate.switch_layer_defer_inline 73.35% : 0.000323s : 59: predicate.switch_simplify 0.40% : 0.000002s : 11: predicate.tile_eliminate 0.34% : 0.000002s : 11: predicate.transpose_eliminate 0.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 0.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 1.30% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 0.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 0.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 0.47% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 0.80% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 0.44% : 0.000002s : 11: predicate.value_based_eliminate 0.10% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001141 16 46.87% : 0.000535s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.66% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.47% : 0.000519s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044742 72 0.13% : 0.000058s : 1: add_recomputation 0.19% : 0.000084s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.83% : 0.000371s : 1: bootstrap 0.08% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 16.91% : 0.007565s : 1: jit_opt_a 0.37% : 0.000163s : 1: jit_opt_after_cconv 0.12% : 0.000055s : 1: jit_opt_b 1.03% : 0.000463s : 1: loop_unroll 1.63% : 0.000731s : 1: mutable_eliminate 3.24% : 0.001451s : 26: opt.transform.jit_opt_a 0.11% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.07% : 0.000481s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000063s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000048s : 1: remove_dup_value 1.46% : 0.000655s : 1: renormalize.infer 0.91% : 0.000409s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000046s : 1: rewriter_after_opt_a 0.22% : 0.000100s : 1: rewriter_before_opt_a 0.17% : 0.000077s : 1: symbol_engine_optimizer 70.56% : 0.031568s : 1: type_inference TotalTime = 0.654541, [30] [bootstrap]: 0.00035902 [type_inference]: 0.577069 [event_method]: 2.485e-05 [auto_monad]: 7.813e-05 [graph_reusing]: 6.27001e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00047593 [rewriter_before_opt_a]: 0.00010554 [expand_dump_flag]: 4.13001e-06 [jit_opt_a]: 0.0733275, [2] [Cycle 1]: 0.0692845, [27] [switch_simplify]: 7.144e-05 [loop_unroll]: 3.521e-05 [a_1]: 0.00077355 [with_stream_mark]: 2.709e-05 [recompute_prepare]: 9.81e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 7.22002e-06 [updatestate_useless_node_eliminater]: 6.78998e-06 [accelerated_algorithm]: 7.1e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 7.17002e-06 [merge_forward]: 4.90001e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.822e-05 [j_node_and_user_rematch]: 1.225e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.256e-05 [inline_without_move]: 7.01001e-06 [renormalize]: 0.0679186 [add_forward_monad_depend]: 1.101e-05 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 4.303e-05 [cse]: 4.24e-05 [replace_applicator]: 2.66e-05 [Cycle 2]: 0.00045316, [27] [switch_simplify]: 8.31002e-06 [loop_unroll]: 6.89999e-06 [a_1]: 0.00013821 [with_stream_mark]: 1.966e-05 [recompute_prepare]: 6.89001e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 6.29999e-06 [cell_reuse_recompute_pass]: 3.25998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.164e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 3.26999e-06 [replace_old_param]: 1.128e-05 [inline_without_move]: 5.99e-06 [renormalize]: 3.10014e-07 [add_forward_monad_depend]: 1.98002e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 9.86e-06 [cse]: 2.208e-05 [replace_applicator]: 9.08002e-06 [py_interpret_to_execute_after_opt_a]: 1.821e-05 [rewriter_after_opt_a]: 4.876e-05 [convert_after_rewriter]: 3.776e-05 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00083788 [jit_opt_b]: 6.51e-05, [1] [Cycle 1]: 5.595e-05, [2] [frontend_op_eliminate]: 2.139e-05 [inline_after_opt_a]: 2.188e-05 [cconv]: 0.00012509 [loop_unroll]: 0.00054498 [jit_opt_after_cconv]: 0.00019693, [1] [Cycle 1]: 0.00018853, [11] [c_1]: 2.697e-05 [parameter_eliminate]: 4.28999e-06 [updatestate_depend_eliminate]: 9.55001e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.88e-06 [cse]: 3.995e-05 [call_graph_tuple_transform]: 2.717e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 0.00010982 [partial_unused_args_eliminate]: 3.01001e-06 [environ_conv]: 1.352e-05 [add_recomputation]: 6.093e-05 [cse_after_recomputation]: 3.759e-05, [1] [Cycle 1]: 3.049e-05, [1] [cse]: 2.149e-05 [auto_monad_reorder]: 2.142e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 6.41e-06 [opt_after_jit_grad]: 0.00057185 [symbol_engine_optimizer]: 8.445e-05, [1] [Cycle 1]: 7.728e-05, [6] [build]: 4.85999e-06 [elim_shapecalc]: 9.36e-06 [elim_not_effective]: 1.608e-05 [opt_reshape]: 7.02002e-06 [fold_const_symbol]: 1.048e-05 [renormalize]: 6.00005e-07 [validate]: 6.16e-05 Sums bootstrap : 0.000359s : 0.06% type_inference : 0.577069s : 88.75% event_method : 0.000025s : 0.00% auto_monad : 0.000078s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000476s : 0.07% rewriter_before_opt_a : 0.000106s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.01% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000912s : 0.14% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.067919s : 10.45% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000053s : 0.01% jit_opt_a.cse : 0.000064s : 0.01% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.00% rewriter_after_opt_a : 0.000049s : 0.01% convert_after_rewriter : 0.000038s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000838s : 0.13% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000022s : 0.00% cconv : 0.000125s : 0.02% loop_unroll : 0.000545s : 0.08% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000110s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000061s : 0.01% cse_after_recomputation.cse : 0.000021s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000572s : 0.09% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.01% Time group info: ------[substitution.] 0.000321 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 4: substitution.graph_param_transform 86.10% : 0.000276s : 5: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000007s : 4: substitution.remove_not_recompute_node 2.20% : 0.000007s : 2: substitution.replace_old_param 4.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.576982 2 99.33% : 0.573115s : 1: type_inference.infer 0.67% : 0.003867s : 1: type_inference.specialize ------[replace.] 0.000124 7 65.84% : 0.000082s : 5: replace.inline 34.16% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000286 7 95.51% : 0.000273s : 5: match.inline 4.49% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 1.75% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.53% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.39% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.84% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.11% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 2.16% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 2.31% : 0.000004s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.38% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.50% : 0.000004s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 20: predicate.switch_defer_inline 1.89% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000011s : 64: predicate.switch_simplify 1.11% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002961 25 67.30% : 0.001993s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.13% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.56% : 0.000875s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.723732 72 0.01% : 0.000065s : 1: add_recomputation 0.01% : 0.000082s : 1: auto_monad 0.00% : 0.000025s : 1: auto_monad_reorder 0.05% : 0.000381s : 1: bootstrap 0.02% : 0.000131s : 1: cconv 0.01% : 0.000041s : 1: convert_after_rewriter 0.01% : 0.000040s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.00% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 10.13% : 0.073331s : 1: jit_opt_a 0.03% : 0.000200s : 1: jit_opt_after_cconv 0.01% : 0.000068s : 1: jit_opt_b 0.08% : 0.000557s : 1: loop_unroll 0.12% : 0.000853s : 1: mutable_eliminate 0.17% : 0.001202s : 26: opt.transform.jit_opt_a 0.01% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000024s : 1: opt.transform.mutable_eliminate 0.00% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000585s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000483s : 1: py_interpret_to_execute 0.00% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000114s : 1: remove_dup_value 9.25% : 0.066935s : 1: renormalize.infer 0.13% : 0.000968s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000052s : 1: rewriter_after_opt_a 0.02% : 0.000111s : 1: rewriter_before_opt_a 0.01% : 0.000087s : 1: symbol_engine_optimizer 79.74% : 0.577092s : 1: type_inference TotalTime = 0.154523, [30] [bootstrap]: 0.0004199 [type_inference]: 0.145331 [event_method]: 2.28e-05 [auto_monad]: 7.104e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 9.756e-05 [rewriter_before_opt_a]: 8.367e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.00632792, [2] [Cycle 1]: 0.0019437, [27] [switch_simplify]: 5.797e-05 [loop_unroll]: 2.989e-05 [a_1]: 0.00055802 [with_stream_mark]: 2.014e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.10998e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 4.17003e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.489e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.16998e-06 [renormalize]: 0.00092606 [add_forward_monad_depend]: 1.466e-05 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 1.636e-05 [cse]: 3.738e-05 [replace_applicator]: 1.403e-05 [Cycle 2]: 0.0003233, [27] [switch_simplify]: 6.35002e-06 [loop_unroll]: 5.85002e-06 [a_1]: 9.035e-05 [with_stream_mark]: 9.34998e-06 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 2.95998e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 7.95e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 7.46999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.72999e-06 [cse]: 1.275e-05 [replace_applicator]: 5.94999e-06 [py_interpret_to_execute_after_opt_a]: 1.421e-05 [rewriter_after_opt_a]: 3.827e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00052892 [jit_opt_b]: 6.164e-05, [1] [Cycle 1]: 4.266e-05, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00042407 [jit_opt_after_cconv]: 0.00014762, [1] [Cycle 1]: 0.00014126, [11] [c_1]: 2.151e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 6.86999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.214e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 5.82001e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 1.662e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 5.71e-06 [add_recomputation]: 5.738e-05 [cse_after_recomputation]: 2.65e-05, [1] [Cycle 1]: 2.053e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 1.826e-05 [get_jit_bprop_graph]: 2.08002e-06 [rewriter_after_jit_bprop_graph]: 4.59002e-06 [opt_after_jit_grad]: 0.00046582 [symbol_engine_optimizer]: 7.321e-05, [1] [Cycle 1]: 6.637e-05, [6] [build]: 3.37002e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.26002e-06 [renormalize]: 3.4002e-07 [validate]: 4.219e-05 Sums bootstrap : 0.000420s : 0.28% type_inference : 0.145331s : 96.98% event_method : 0.000023s : 0.02% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000098s : 0.07% rewriter_before_opt_a : 0.000084s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000648s : 0.43% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000926s : 0.62% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000529s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000424s : 0.28% jit_opt_after_cconv.c_1 : 0.000022s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000057s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000466s : 0.31% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000218 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 3: substitution.graph_param_transform 84.64% : 0.000185s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.45% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.145250 2 98.93% : 0.143699s : 1: type_inference.infer 1.07% : 0.001551s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.76% : 0.000048s : 4: replace.inline 32.24% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 94.42% : 0.000182s : 4: match.inline 5.58% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.71% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.75% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.64% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.26% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.07% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.74% : 0.000003s : 16: predicate.switch_defer_inline 2.45% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000865 13 48.25% : 0.000417s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.83% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.92% : 0.000397s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156362 72 0.04% : 0.000061s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.28% : 0.000440s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.05% : 0.006331s : 1: jit_opt_a 0.10% : 0.000150s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.28% : 0.000432s : 1: loop_unroll 0.34% : 0.000537s : 1: mutable_eliminate 0.55% : 0.000867s : 26: opt.transform.jit_opt_a 0.03% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000474s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000101s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.30% : 0.000474s : 1: renormalize.infer 0.28% : 0.000445s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000088s : 1: rewriter_before_opt_a 0.05% : 0.000076s : 1: symbol_engine_optimizer 92.96% : 0.145351s : 1: type_inference TotalTime = 0.0456991, [30] [bootstrap]: 0.00036179 [type_inference]: 0.036773 [event_method]: 2.459e-05 [auto_monad]: 7.359e-05 [graph_reusing]: 5.57999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00010072 [rewriter_before_opt_a]: 8.803e-05 [expand_dump_flag]: 3.30003e-06 [jit_opt_a]: 0.00600004, [2] [Cycle 1]: 0.0019929, [27] [switch_simplify]: 5.999e-05 [loop_unroll]: 3.329e-05 [a_1]: 0.00057821 [with_stream_mark]: 2.018e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.427e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 9.51998e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 0.00094997 [add_forward_monad_depend]: 6.09001e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.425e-05 [cse]: 3.554e-05 [replace_applicator]: 1.239e-05 [Cycle 2]: 0.00032996, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.36998e-06 [a_1]: 9.296e-05 [with_stream_mark]: 1.032e-05 [recompute_prepare]: 5.08002e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.391e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.472e-05 [replace_applicator]: 5.38002e-06 [py_interpret_to_execute_after_opt_a]: 1.251e-05 [rewriter_after_opt_a]: 4.153e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00060674 [jit_opt_b]: 6.848e-05, [1] [Cycle 1]: 6.103e-05, [2] [frontend_op_eliminate]: 3.118e-05 [inline_after_opt_a]: 1.767e-05 [cconv]: 2.824e-05 [loop_unroll]: 0.0004466 [jit_opt_after_cconv]: 0.00014604, [1] [Cycle 1]: 0.00013971, [11] [c_1]: 2.04e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 2.383e-05 [call_graph_tuple_transform]: 1.921e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.744e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 6.40002e-06 [add_recomputation]: 5.269e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.825e-05, [1] [cse]: 1.249e-05 [auto_monad_reorder]: 1.871e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 5.81e-06 [opt_after_jit_grad]: 0.00047056 [symbol_engine_optimizer]: 7.186e-05, [1] [Cycle 1]: 6.507e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 7.94002e-06 [elim_not_effective]: 1.272e-05 [opt_reshape]: 5.71998e-06 [fold_const_symbol]: 8.38999e-06 [renormalize]: 2.99973e-07 [validate]: 4.274e-05 Sums bootstrap : 0.000362s : 0.87% type_inference : 0.036773s : 88.79% event_method : 0.000025s : 0.06% auto_monad : 0.000074s : 0.18% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000101s : 0.24% rewriter_before_opt_a : 0.000088s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.16% jit_opt_a.loop_unroll : 0.000039s : 0.09% jit_opt_a.a_1 : 0.000671s : 1.62% jit_opt_a.with_stream_mark : 0.000031s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000950s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000050s : 0.12% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000042s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000607s : 1.46% jit_opt_b.frontend_op_eliminate : 0.000031s : 0.08% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000028s : 0.07% loop_unroll : 0.000447s : 1.08% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000471s : 1.14% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.10% Time group info: ------[substitution.] 0.000223 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000006s : 3: substitution.graph_param_transform 84.85% : 0.000189s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 5.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036686 2 95.59% : 0.035069s : 1: type_inference.infer 4.41% : 0.001617s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.46% : 0.000050s : 4: replace.inline 32.54% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.11% : 0.000187s : 4: match.inline 5.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.80% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.57% : 0.000002s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.61% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.03% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000989 13 47.89% : 0.000474s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.83% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.28% : 0.000468s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047610 72 0.12% : 0.000056s : 1: add_recomputation 0.16% : 0.000077s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.81% : 0.000386s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.61% : 0.006003s : 1: jit_opt_a 0.31% : 0.000149s : 1: jit_opt_after_cconv 0.15% : 0.000071s : 1: jit_opt_b 0.95% : 0.000454s : 1: loop_unroll 1.29% : 0.000615s : 1: mutable_eliminate 1.88% : 0.000897s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000042s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.00% : 0.000478s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000104s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.05% : 0.000498s : 1: renormalize.infer 0.93% : 0.000444s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000044s : 1: rewriter_after_opt_a 0.19% : 0.000091s : 1: rewriter_before_opt_a 0.16% : 0.000074s : 1: symbol_engine_optimizer 77.29% : 0.036797s : 1: type_inference TotalTime = 0.404685, [30] [bootstrap]: 0.00037261 [type_inference]: 0.352464 [event_method]: 2.818e-05 [auto_monad]: 7.769e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00054859 [rewriter_before_opt_a]: 0.00010957 [expand_dump_flag]: 4.90001e-06 [jit_opt_a]: 0.0246448, [2] [Cycle 1]: 0.0128325, [27] [switch_simplify]: 7.945e-05 [loop_unroll]: 3.471e-05 [a_1]: 0.00077663 [with_stream_mark]: 2.745e-05 [recompute_prepare]: 1.01e-05 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 3.74002e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 8.12e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 7.31999e-06 [merge_forward]: 4.90999e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.831e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 1.127e-05 [inline_without_move]: 7.24001e-06 [renormalize]: 0.0114621 [add_forward_monad_depend]: 1.321e-05 [auto_monad_grad]: 3.08e-06 [auto_monad_eliminator]: 2.552e-05 [cse]: 4.425e-05 [replace_applicator]: 2.896e-05 [Cycle 2]: 0.00041581, [27] [switch_simplify]: 8.22e-06 [loop_unroll]: 7.41001e-06 [a_1]: 0.00013471 [with_stream_mark]: 1.631e-05 [recompute_prepare]: 6.53e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.62998e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.96998e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 2.90002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.939e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 3.06999e-06 [replace_old_param]: 1.104e-05 [inline_without_move]: 5.94999e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.65002e-06 [cse]: 1.61e-05 [replace_applicator]: 6.43998e-06 [py_interpret_to_execute_after_opt_a]: 1.958e-05 [rewriter_after_opt_a]: 4.441e-05 [convert_after_rewriter]: 7.45998e-06 [order_py_execute_after_rewriter]: 5.76998e-06 [mutable_eliminate]: 0.00081156 [jit_opt_b]: 6.046e-05, [1] [Cycle 1]: 5.324e-05, [2] [frontend_op_eliminate]: 2.179e-05 [inline_after_opt_a]: 1.97e-05 [cconv]: 3.217e-05 [loop_unroll]: 0.00050487 [jit_opt_after_cconv]: 0.00026775, [1] [Cycle 1]: 0.00026036, [11] [c_1]: 2.736e-05 [parameter_eliminate]: 4.19997e-06 [updatestate_depend_eliminate]: 9.87001e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.19001e-06 [cse]: 3.578e-05 [call_graph_tuple_transform]: 2.721e-05 [tuple_list_get_item_eliminator]: 7.46999e-06 [none_parameter_eliminate]: 2.59999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.76e-06 [remove_dup_value]: 1.913e-05 [partial_unused_args_eliminate]: 2.65002e-06 [environ_conv]: 1.238e-05 [add_recomputation]: 5.968e-05 [cse_after_recomputation]: 2.834e-05, [1] [Cycle 1]: 2.192e-05, [1] [cse]: 1.448e-05 [auto_monad_reorder]: 2.001e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 7.68001e-06 [opt_after_jit_grad]: 0.0241358 [symbol_engine_optimizer]: 9.828e-05, [1] [Cycle 1]: 8.951e-05, [6] [build]: 6.81001e-06 [elim_shapecalc]: 1.071e-05 [elim_not_effective]: 1.924e-05 [opt_reshape]: 7.88999e-06 [fold_const_symbol]: 1.191e-05 [renormalize]: 8.2e-07 [validate]: 5.894e-05 Sums bootstrap : 0.000373s : 0.09% type_inference : 0.352464s : 89.80% event_method : 0.000028s : 0.01% auto_monad : 0.000078s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000549s : 0.14% rewriter_before_opt_a : 0.000110s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000911s : 0.23% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.011462s : 2.92% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000060s : 0.02% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000812s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000505s : 0.13% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000060s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.024136s : 6.15% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.02% Time group info: ------[substitution.] 0.000327 25 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.21% : 0.000007s : 4: substitution.graph_param_transform 87.06% : 0.000285s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000007s : 4: substitution.remove_not_recompute_node 1.77% : 0.000006s : 2: substitution.replace_old_param 4.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.352359 2 98.94% : 0.348615s : 1: type_inference.infer 1.06% : 0.003744s : 1: type_inference.specialize ------[replace.] 0.000117 7 68.09% : 0.000080s : 5: replace.inline 31.91% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 7 95.92% : 0.000282s : 5: match.inline 4.08% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 2.11% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 13: predicate.addn_check_dump 1.63% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 5.49% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 2.04% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.63% : 0.000001s : 4: predicate.reset_defer_inline 1.54% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000002s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.19% : 0.000011s : 64: predicate.switch_simplify 1.42% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003311 25 54.21% : 0.001795s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.83% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.96% : 0.001422s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.417412 72 0.02% : 0.000063s : 1: add_recomputation 0.02% : 0.000081s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.09% : 0.000394s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.90% : 0.024648s : 1: jit_opt_a 0.06% : 0.000271s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.12% : 0.000513s : 1: loop_unroll 0.20% : 0.000825s : 1: mutable_eliminate 0.29% : 0.001204s : 26: opt.transform.jit_opt_a 0.02% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000045s : 4: opt.transform.symbol_engine_opt 5.79% : 0.024152s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000556s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.37% : 0.009913s : 1: renormalize.infer 0.36% : 0.001514s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.03% : 0.000115s : 1: rewriter_before_opt_a 0.02% : 0.000101s : 1: symbol_engine_optimizer 84.45% : 0.352489s : 1: type_inference TotalTime = 0.0344525, [30] [bootstrap]: 0.00033473 [type_inference]: 0.0254271 [event_method]: 2.286e-05 [auto_monad]: 6.807e-05 [graph_reusing]: 6.18002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.04e-05 [rewriter_before_opt_a]: 7.597e-05 [expand_dump_flag]: 3.25998e-06 [jit_opt_a]: 0.00559344, [2] [Cycle 1]: 0.0016849, [27] [switch_simplify]: 5.715e-05 [loop_unroll]: 2.981e-05 [a_1]: 0.00053383 [with_stream_mark]: 2.341e-05 [recompute_prepare]: 7.55998e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.88998e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 5.54998e-06 [renormalize]: 0.00069839 [add_forward_monad_depend]: 5.02e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.358e-05 [cse]: 3.739e-05 [replace_applicator]: 1.346e-05 [Cycle 2]: 0.00031217, [27] [switch_simplify]: 5.72999e-06 [loop_unroll]: 4.92e-06 [a_1]: 8.602e-05 [with_stream_mark]: 9.50001e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.99998e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.258e-05 [j_node_and_user_rematch]: 7.63001e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.08998e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 5.52001e-06 [cse]: 1.245e-05 [replace_applicator]: 5.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.288e-05 [rewriter_after_opt_a]: 4.132e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00056423 [jit_opt_b]: 5.67e-05, [1] [Cycle 1]: 4.888e-05, [2] [frontend_op_eliminate]: 1.47e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 2.797e-05 [loop_unroll]: 0.00042304 [jit_opt_after_cconv]: 0.0001476, [1] [Cycle 1]: 0.0001408, [11] [c_1]: 2.023e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.617e-05 [call_graph_tuple_transform]: 1.822e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.44998e-06 [remove_dup_value]: 1.808e-05 [partial_unused_args_eliminate]: 6.87002e-06 [environ_conv]: 1.072e-05 [add_recomputation]: 5.874e-05 [cse_after_recomputation]: 3.566e-05, [1] [Cycle 1]: 2.804e-05, [1] [cse]: 1.86e-05 [auto_monad_reorder]: 1.982e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 6.58e-06 [opt_after_jit_grad]: 0.00050359 [symbol_engine_optimizer]: 6.976e-05, [1] [Cycle 1]: 6.374e-05, [6] [build]: 2.32999e-06 [elim_shapecalc]: 7.98001e-06 [elim_not_effective]: 1.266e-05 [opt_reshape]: 5.72999e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.4002e-07 [validate]: 3.443e-05 Sums bootstrap : 0.000335s : 1.13% type_inference : 0.025427s : 85.86% event_method : 0.000023s : 0.08% auto_monad : 0.000068s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000040s : 0.14% rewriter_before_opt_a : 0.000076s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000620s : 2.09% jit_opt_a.with_stream_mark : 0.000033s : 0.11% jit_opt_a.recompute_prepare : 0.000012s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000698s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.06% jit_opt_a.cse : 0.000050s : 0.17% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000041s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000564s : 1.91% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.09% loop_unroll : 0.000423s : 1.43% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000007s : 0.02% environ_conv : 0.000011s : 0.04% add_recomputation : 0.000059s : 0.20% cse_after_recomputation.cse : 0.000019s : 0.06% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000504s : 1.70% symbol_engine_optimizer.build : 0.000002s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.12% Time group info: ------[substitution.] 0.000215 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000005s : 3: substitution.graph_param_transform 84.95% : 0.000183s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025349 2 96.06% : 0.024350s : 1: type_inference.infer 3.94% : 0.000999s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.26% : 0.000045s : 4: replace.inline 32.74% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 94.76% : 0.000180s : 4: match.inline 5.24% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.22% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.06% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000685 13 48.73% : 0.000334s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.52% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.75% : 0.000306s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036039 72 0.17% : 0.000062s : 1: add_recomputation 0.20% : 0.000072s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.98% : 0.000353s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000038s : 1: cse_after_recomputation 0.04% : 0.000013s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.53% : 0.005597s : 1: jit_opt_a 0.42% : 0.000150s : 1: jit_opt_after_cconv 0.16% : 0.000059s : 1: jit_opt_b 1.19% : 0.000431s : 1: loop_unroll 1.59% : 0.000572s : 1: mutable_eliminate 2.32% : 0.000836s : 26: opt.transform.jit_opt_a 0.13% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.42% : 0.000511s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000016s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000043s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 1.81% : 0.000654s : 1: remove_dup_value 1.10% : 0.000396s : 1: renormalize.infer 0.81% : 0.000294s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.22% : 0.000079s : 1: rewriter_before_opt_a 0.20% : 0.000072s : 1: symbol_engine_optimizer 70.62% : 0.025451s : 1: type_inference TotalTime = 0.0512068, [30] [bootstrap]: 0.00033088 [type_inference]: 0.0419365 [event_method]: 2.366e-05 [auto_monad]: 7.403e-05 [graph_reusing]: 6.85998e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00010699 [rewriter_before_opt_a]: 9.009e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.00641071, [2] [Cycle 1]: 0.0019823, [27] [switch_simplify]: 5.991e-05 [loop_unroll]: 3.156e-05 [a_1]: 0.00056841 [with_stream_mark]: 2.279e-05 [recompute_prepare]: 7.76001e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.40003e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 3.59002e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.548e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00095579 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 3.845e-05 [replace_applicator]: 1.241e-05 [Cycle 2]: 0.00031606, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.26998e-06 [a_1]: 8.87e-05 [with_stream_mark]: 9.82999e-06 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.18002e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.204e-05 [j_node_and_user_rematch]: 7.98001e-06 [meta_fg_expand]: 1.47999e-06 [replace_old_param]: 7.31999e-06 [inline_without_move]: 4.67998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.255e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.235e-05 [rewriter_after_opt_a]: 3.892e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.94e-06 [mutable_eliminate]: 0.00057139 [jit_opt_b]: 4.892e-05, [1] [Cycle 1]: 4.251e-05, [2] [frontend_op_eliminate]: 1.615e-05 [inline_after_opt_a]: 1.554e-05 [cconv]: 2.671e-05 [loop_unroll]: 0.00044821 [jit_opt_after_cconv]: 0.0001591, [1] [Cycle 1]: 0.00015292, [11] [c_1]: 2.08e-05 [parameter_eliminate]: 3.09001e-06 [updatestate_depend_eliminate]: 6.41998e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.407e-05 [call_graph_tuple_transform]: 1.91e-05 [tuple_list_get_item_eliminator]: 5.73997e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.722e-05 [partial_unused_args_eliminate]: 2.43002e-06 [environ_conv]: 7.26001e-06 [add_recomputation]: 5.248e-05 [cse_after_recomputation]: 2.269e-05, [1] [Cycle 1]: 1.712e-05, [1] [cse]: 1.148e-05 [auto_monad_reorder]: 1.772e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00047349 [symbol_engine_optimizer]: 7.268e-05, [1] [Cycle 1]: 6.583e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 7.31999e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 9.15999e-06 [renormalize]: 6.90023e-07 [validate]: 4.004e-05 Sums bootstrap : 0.000331s : 0.71% type_inference : 0.041936s : 90.21% event_method : 0.000024s : 0.05% auto_monad : 0.000074s : 0.16% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.23% rewriter_before_opt_a : 0.000090s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.14% jit_opt_a.loop_unroll : 0.000037s : 0.08% jit_opt_a.a_1 : 0.000657s : 1.41% jit_opt_a.with_stream_mark : 0.000033s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000956s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000051s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000039s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000571s : 1.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000027s : 0.06% loop_unroll : 0.000448s : 0.96% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000473s : 1.02% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.09% Time group info: ------[substitution.] 0.000237 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000006s : 3: substitution.graph_param_transform 84.90% : 0.000201s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041843 2 95.85% : 0.040105s : 1: type_inference.infer 4.15% : 0.001738s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.66% : 0.000050s : 4: replace.inline 30.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.35% : 0.000199s : 4: match.inline 5.65% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.52% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.94% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 10: predicate.value_based_eliminate 0.44% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000902 13 45.31% : 0.000409s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.07% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.62% : 0.000439s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053089 72 0.10% : 0.000055s : 1: add_recomputation 0.15% : 0.000077s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.66% : 0.000352s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.08% : 0.006414s : 1: jit_opt_a 0.30% : 0.000162s : 1: jit_opt_after_cconv 0.10% : 0.000051s : 1: jit_opt_b 0.86% : 0.000457s : 1: loop_unroll 1.09% : 0.000580s : 1: mutable_eliminate 1.65% : 0.000877s : 26: opt.transform.jit_opt_a 0.09% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000482s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000111s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.05% : 0.000558s : 1: renormalize.infer 0.73% : 0.000389s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.18% : 0.000094s : 1: rewriter_before_opt_a 0.14% : 0.000075s : 1: symbol_engine_optimizer 79.04% : 0.041960s : 1: type_inference TotalTime = 0.262125, [30] [bootstrap]: 0.00034723 [type_inference]: 0.190312 [event_method]: 2.712e-05 [auto_monad]: 8.647e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00030696 [rewriter_before_opt_a]: 0.00011332 [expand_dump_flag]: 4.16001e-06 [jit_opt_a]: 0.0683251, [2] [Cycle 1]: 0.0639424, [27] [switch_simplify]: 8.253e-05 [loop_unroll]: 3.687e-05 [a_1]: 0.0610829 [with_stream_mark]: 2.991e-05 [recompute_prepare]: 1.488e-05 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.66e-06 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 6.23998e-06 [accelerated_algorithm]: 8.3e-06 [meta_shard_fg_expand]: 3.63e-06 [get_grad_eliminate_]: 6.76999e-06 [merge_forward]: 4.82e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 1.233e-05 [meta_fg_expand]: 3.21001e-06 [replace_old_param]: 1.403e-05 [inline_without_move]: 7.06999e-06 [renormalize]: 0.00224477 [add_forward_monad_depend]: 9.41e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 2.137e-05 [cse]: 4.099e-05 [replace_applicator]: 1.926e-05 [Cycle 2]: 0.00041417, [27] [switch_simplify]: 7.71999e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00012727 [with_stream_mark]: 1.415e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 6.74999e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 2.66999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.712e-05 [j_node_and_user_rematch]: 2.577e-05 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 6.15002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.712e-05 [replace_applicator]: 6.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.612e-05 [rewriter_after_opt_a]: 4.449e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00080967 [jit_opt_b]: 5.93e-05, [1] [Cycle 1]: 5.12e-05, [2] [frontend_op_eliminate]: 2.011e-05 [inline_after_opt_a]: 1.939e-05 [cconv]: 3.03e-05 [loop_unroll]: 0.00045078 [jit_opt_after_cconv]: 0.00016592, [1] [Cycle 1]: 0.0001593, [11] [c_1]: 2.687e-05 [parameter_eliminate]: 3.30998e-06 [updatestate_depend_eliminate]: 6.68998e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 2.782e-05 [call_graph_tuple_transform]: 2.219e-05 [tuple_list_get_item_eliminator]: 6.81001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.74001e-06 [remove_dup_value]: 2.057e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.55999e-06 [add_recomputation]: 5.93e-05 [cse_after_recomputation]: 2.898e-05, [1] [Cycle 1]: 2.264e-05, [1] [cse]: 1.606e-05 [auto_monad_reorder]: 2.065e-05 [get_jit_bprop_graph]: 2.33002e-06 [rewriter_after_jit_bprop_graph]: 5.77001e-06 [opt_after_jit_grad]: 0.00048806 [symbol_engine_optimizer]: 8.218e-05, [1] [Cycle 1]: 7.488e-05, [6] [build]: 4.90001e-06 [elim_shapecalc]: 9.34e-06 [elim_not_effective]: 1.486e-05 [opt_reshape]: 7.87e-06 [fold_const_symbol]: 1.027e-05 [renormalize]: 4.19997e-07 [validate]: 5.403e-05 Sums bootstrap : 0.000347s : 0.13% type_inference : 0.190312s : 73.93% event_method : 0.000027s : 0.01% auto_monad : 0.000086s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000307s : 0.12% rewriter_before_opt_a : 0.000113s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.061210s : 23.78% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000038s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002245s : 0.87% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000058s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000810s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000451s : 0.18% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000059s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000488s : 0.19% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.02% Time group info: ------[substitution.] 0.060532 25 0.00% : 0.000002s : 2: substitution.elim_not_effective 0.00% : 0.000002s : 2: substitution.fold_const_symbol 0.01% : 0.000006s : 4: substitution.graph_param_transform 99.90% : 0.060473s : 5: substitution.inline 0.03% : 0.000019s : 4: substitution.j_node_and_user_rematch 0.01% : 0.000006s : 4: substitution.remove_not_recompute_node 0.01% : 0.000007s : 2: substitution.replace_old_param 0.03% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.190197 2 98.63% : 0.187586s : 1: type_inference.infer 1.37% : 0.002611s : 1: type_inference.specialize ------[replace.] 0.000151 7 70.39% : 0.000106s : 5: replace.inline 29.61% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.060481 7 99.97% : 0.060466s : 5: match.inline 0.03% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 888 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000003s : 13: predicate.addn_zero_filter 2.09% : 0.000004s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.30% : 0.000002s : 13: predicate.compare_switch_simplify 1.95% : 0.000003s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.02% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.87% : 0.000001s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 6.34% : 0.000011s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000003s : 8: predicate.less_batch_normalization 1.49% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.18% : 0.000002s : 4: predicate.mutable_eliminate 0.39% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000004s : 19: predicate.partial_eliminate 1.04% : 0.000002s : 13: predicate.print_const_string_wrapper 2.39% : 0.000004s : 13: predicate.reduce_eliminate 1.53% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.70% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.70% : 0.000003s : 13: predicate.reshape_eliminate 1.40% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000002s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.20% : 0.000005s : 20: predicate.switch_defer_inline 2.18% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000013s : 65: predicate.switch_simplify 1.07% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.89% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.54% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.10% : 0.000004s : 13: predicate.value_based_eliminate 0.30% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002326 21 65.73% : 0.001529s : 12: func_graph_cloner_run.FuncGraphClonerGraph 4.73% : 0.000110s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.54% : 0.000687s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.325944 72 0.02% : 0.000063s : 1: add_recomputation 0.03% : 0.000090s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.11% : 0.000367s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000028s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 20.96% : 0.068329s : 1: jit_opt_a 0.05% : 0.000169s : 1: jit_opt_after_cconv 0.02% : 0.000062s : 1: jit_opt_b 0.14% : 0.000459s : 1: loop_unroll 0.25% : 0.000820s : 1: mutable_eliminate 18.87% : 0.061516s : 26: opt.transform.jit_opt_a 0.02% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000497s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000314s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.46% : 0.001492s : 1: renormalize.infer 0.23% : 0.000740s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.04% : 0.000120s : 1: rewriter_before_opt_a 0.03% : 0.000085s : 1: symbol_engine_optimizer 58.40% : 0.190338s : 1: type_inference TotalTime = 0.0769602, [30] [bootstrap]: 0.00031525 [type_inference]: 0.0227424 [event_method]: 3.117e-05 [auto_monad]: 7.019e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.000103 [rewriter_before_opt_a]: 8.16e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.0510654, [2] [Cycle 1]: 0.00232786, [27] [switch_simplify]: 6.838e-05 [loop_unroll]: 3.136e-05 [a_1]: 0.00064263 [with_stream_mark]: 2.867e-05 [recompute_prepare]: 1.048e-05 [updatestate_depend_eliminate]: 5.49998e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 2.89999e-06 [specialize_transform]: 6.60002e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.51002e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.812e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00115454 [add_forward_monad_depend]: 8.1e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.845e-05 [cse]: 3.952e-05 [replace_applicator]: 1.691e-05 [Cycle 2]: 0.0003413, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 4.85001e-06 [a_1]: 8.914e-05 [with_stream_mark]: 1.589e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 4.95999e-06 [updatestate_useless_node_eliminater]: 4.86002e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.649e-05 [j_node_and_user_rematch]: 8.47998e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 4.71997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 8.13999e-06 [cse]: 1.469e-05 [replace_applicator]: 6.38e-06 [py_interpret_to_execute_after_opt_a]: 1.733e-05 [rewriter_after_opt_a]: 4.219e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00071013 [jit_opt_b]: 4.878e-05, [1] [Cycle 1]: 4.137e-05, [2] [frontend_op_eliminate]: 1.478e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 3.402e-05 [loop_unroll]: 0.00050062 [jit_opt_after_cconv]: 0.00016983, [1] [Cycle 1]: 0.00016242, [11] [c_1]: 2.172e-05 [parameter_eliminate]: 5.46e-06 [updatestate_depend_eliminate]: 9.46003e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.616e-05 [call_graph_tuple_transform]: 2.185e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 1.30001e-06 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.869e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 7.06001e-06 [add_recomputation]: 5.546e-05 [cse_after_recomputation]: 2.351e-05, [1] [Cycle 1]: 1.741e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 2.58003e-06 [rewriter_after_jit_bprop_graph]: 8.45999e-06 [opt_after_jit_grad]: 0.00054488 [symbol_engine_optimizer]: 7.681e-05, [1] [Cycle 1]: 6.857e-05, [6] [build]: 4.48001e-06 [elim_shapecalc]: 7.87e-06 TotalTime = 0.0646317, [30] [bootstrap]: 0.00035633 [type_inference]: 0.0106455 [event_method]: 1.973e-05 [auto_monad]: 4.81e-05 [graph_reusing]: 4.48001e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 5.457e-05 [rewriter_before_opt_a]: 7.649e-05 [expand_dump_flag]: 1.99e-06 [jit_opt_a]: 0.0509604, [2] [Cycle 1]: 0.0470998, [27] [switch_simplify]: 6.778e-05 [loop_unroll]: 3.32e-05 [a_1]: 0.00071274 [with_stream_mark]: 2.323e-05 [recompute_prepare]: 8.52998e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.091e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 0.0458882 [add_forward_monad_depend]: 7.36999e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 1.684e-05 [cse]: 2.799e-05 [replace_applicator]: 1.85e-05 [Cycle 2]: 0.00039075, [27] [switch_simplify]: 7.78001e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00011411 [with_stream_mark]: 1.117e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 7.99002e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 5.11002e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 2.05002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.70997e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 5.44e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 7.6e-06 [cse]: 1.788e-05 [replace_applicator]: 7.15998e-06 [py_interpret_to_execute_after_opt_a]: 1.575e-05 [rewriter_after_opt_a]: 3.381e-05 [convert_after_rewriter]: 6.02001e-06 [order_py_execute_after_rewriter]: 4.48999e-06 [mutable_eliminate]: 0.00065449 [jit_opt_b]: 5.445e-05, [1] [Cycle 1]: 4.768e-05, [2] [frontend_op_eliminate]: 1.79e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 2.72e-05 [loop_unroll]: 0.00050971 [jit_opt_after_cconv]: 0.00017894, [1] [Cycle 1]: 0.00017195, [11] [c_1]: 2.451e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 6.77002e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.952e-05 [call_graph_tuple_transform]: 1.905e-05 [tuple_list_get_item_eliminator]: 6.25002e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.87999e-06 [remove_dup_value]: 3.935e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 5.42001e-06 [add_recomputation]: 3.754e-05 [cse_after_recomputation]: 2.595e-05, [1] [Cycle 1]: 1.994e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.093e-05 [get_jit_bprop_graph]: 1.80001e-06 [rewriter_after_jit_bprop_graph]: 6.21e-06 [opt_after_jit_grad]: 0.00053197 [symbol_engine_optimizer]: 8.009e-05, [1] [Cycle 1]: 7.284e-05, [6] [build]: 4.42998e-06 [elim_shapecalc]: 8.29002e-06 [elim_not_effective]: 1.469e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 8.59e-06 [renormalize]: 3.89991e-07 [validate]: 4.722e-05 Sums bootstrap : 0.000315s : 1.13% type_inference : 0.022742s : 81.45% event_method : 0.000031s : 0.11% auto_monad : 0.000070s : 0.25% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.37% rewriter_before_opt_a : 0.000082s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.27% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000732s : 2.62% jit_opt_a.with_stream_mark : 0.000045s : 0.16% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001155s : 4.14% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.10% jit_opt_a.cse : 0.000054s : 0.19% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000710s : 2.54% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000034s : 0.12% loop_unroll : 0.000501s : 1.79% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% [elim_not_effective]: 1.503e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 8.68001e-06 [renormalize]: 2.89991e-07 [validate]: 4.291e-05 Sums bootstrap : 0.000356s : 0.59% type_inference : 0.010646s : 17.60% event_method : 0.000020s : 0.03% auto_monad : 0.000048s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000055s : 0.09% rewriter_before_opt_a : 0.000076s : 0.13% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.12% jit_opt_a.loop_unroll : 0.000040s : 0.07% jit_opt_a.a_1 : 0.000827s : 1.37% jit_opt_a.with_stream_mark : 0.000034s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000010s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.045888s : 75.85% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000046s : 0.08% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000654s : 1.08% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000510s : 0.84% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000039s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000038s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000532s : 0.88% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000302 24 0.54% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.50% : 0.000005s : 3: substitution.graph_param_transform 88.34% : 0.000267s : 5: substitution.inline 1.55% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000006s : 2: substitution.replace_old_param 4.20% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010583 2 90.25% : 0.009551s : 1: type_inference.infer 9.75% : 0.001032s : 1: type_inference.specialize ------[replace.] 0.000109 7 68.80% : 0.000075s : 5: replace.inline 31.20% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 7 95.83% : 0.000264s : 5: match.inline 4.17% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.70% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.73% : 0.000003s : 11: predicate.arithmetic_simplify 1.38% : 0.000002s : 11: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 11: predicate.compare_switch_simplify 1.13% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 11: predicate.environ_get_depend_swap 1.55% : 0.000002s : 11: predicate.environ_get_eliminate 0.97% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000009s : 24: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 16: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 11: predicate.merge_addn 1.02% : 0.000001s : 11: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 16: predicate.partial_eliminate 1.10% : 0.000002s : 11: predicate.print_const_string_wrapper 1.98% : 0.000003s : 11: predicate.reduce_eliminate 1.59% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000003s : 19: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 11: predicate.reshape_eliminate 1.68% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000011s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.47% : 0.000002s : 11: predicate.transpose_eliminate 1.66% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.54% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.89% : 0.000003s : 13: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.46% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001146 16 46.35% : 0.000531s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.75% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.90% : 0.000526s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111660 72 0.04% : 0.000040s : 1: add_recomputation 0.05% : 0.000052s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.34% : 0.000381s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 45.64% : 0.050964s : 1: jit_opt_a 0.16% : 0.000183s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.47% : 0.000520s : 1: loop_unroll 0.60% : 0.000665s : 1: mutable_eliminate 0.97% : 0.001079s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000542s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.05% : 0.000057s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000042s : 1: remove_dup_value 40.53% : 0.045256s : 1: renormalize.infer 0.55% : 0.000617s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000079s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 9.54% : 0.010658s : 1: type_inference environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000545s : 1.95% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.17% Time group info: ------[substitution.] 0.000286 23 0.91% : 0.000003s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 3: substitution.graph_param_transform 86.76% : 0.000248s : 4: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000005s : 2: substitution.replace_old_param 4.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022670 2 93.66% : 0.021232s : 1: type_inference.infer 6.34% : 0.001438s : 1: type_inference.specialize ------[replace.] 0.000088 6 67.07% : 0.000059s : 4: replace.inline 32.93% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 6 95.18% : 0.000244s : 4: match.inline 4.82% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.55% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.13% : 0.000003s : 10: predicate.arithmetic_simplify 1.11% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.63% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.22% : 0.000008s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.26% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 15: predicate.load_eliminater 2.42% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.67% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.82% : 0.000004s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.34% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.66% : 0.000001s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000009s : 53: predicate.switch_simplify 1.10% : 0.000001s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.23% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.69% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000931 13 50.43% : 0.000470s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.61% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.95% : 0.000400s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079150 72 0.07% : 0.000059s : 1: add_recomputation 0.09% : 0.000073s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.42% : 0.000336s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.05% : 0.000036s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 64.52% : 0.051070s : 1: jit_opt_a 0.22% : 0.000173s : 1: jit_opt_after_cconv 0.07% : 0.000052s : 1: jit_opt_b 0.65% : 0.000513s : 1: loop_unroll 0.91% : 0.000724s : 1: mutable_eliminate 1.23% : 0.000973s : 26: opt.transform.jit_opt_a 0.07% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000106s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.88% : 0.000695s : 1: renormalize.infer 0.57% : 0.000451s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.11% : 0.000085s : 1: rewriter_before_opt_a 0.10% : 0.000079s : 1: symbol_engine_optimizer 28.76% : 0.022762s : 1: type_inference TotalTime = 0.0387399, [30] [bootstrap]: 0.00039646 [type_inference]: 0.00533047 [event_method]: 2.017e-05 [auto_monad]: 6.756e-05 [graph_reusing]: 6.13998e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 3.964e-05 [rewriter_before_opt_a]: 7.562e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00595048, [2] [Cycle 1]: 0.00187297, [27] [switch_simplify]: 6.761e-05 [loop_unroll]: 2.99e-05 [a_1]: 0.00060013 [with_stream_mark]: 2.478e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 4.83001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.01002e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 9.43002e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 5.61e-06 [renormalize]: 0.00077763 [add_forward_monad_depend]: 7.81001e-06 [auto_monad_grad]: 2.18002e-06 [auto_monad_eliminator]: 1.817e-05 [cse]: 3.848e-05 [replace_applicator]: 1.426e-05 [Cycle 2]: 0.00034125, [27] [switch_simplify]: 6.02001e-06 [loop_unroll]: 5.03002e-06 [a_1]: 8.786e-05 [with_stream_mark]: 1.317e-05 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 4.37998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.72998e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.708e-05 [j_node_and_user_rematch]: 7.51999e-06 [meta_fg_expand]: 1.71998e-06 [replace_old_param]: 7.42002e-06 [inline_without_move]: 5.11997e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 8.02e-06 [cse]: 1.551e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 1.631e-05 [rewriter_after_opt_a]: 4.652e-05 [convert_after_rewriter]: 6.70998e-06 [order_py_execute_after_rewriter]: 5.91e-06 [mutable_eliminate]: 0.0249693 [jit_opt_b]: 8.617e-05, [1] [Cycle 1]: 7.455e-05, [2] [frontend_op_eliminate]: 1.799e-05 [inline_after_opt_a]: 2.206e-05 [cconv]: 4.423e-05 [loop_unroll]: 0.00047565 [jit_opt_after_cconv]: 0.00020286, [1] [Cycle 1]: 0.00019467, [11] [c_1]: 2.187e-05 [parameter_eliminate]: 7.1e-06 [updatestate_depend_eliminate]: 1.207e-05 [updatestate_assign_eliminate]: 3.69002e-06 [updatestate_loads_eliminate]: 3.55998e-06 [cse]: 5.239e-05 [call_graph_tuple_transform]: 2.716e-05 [tuple_list_get_item_eliminator]: 5.56998e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 1.13001e-06 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 2.008e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 7.98001e-06 [add_recomputation]: 6.467e-05 [cse_after_recomputation]: 2.755e-05, [1] [Cycle 1]: 2.073e-05, [1] [cse]: 1.407e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 2.74001e-06 [rewriter_after_jit_bprop_graph]: 1.12e-05 [opt_after_jit_grad]: 0.00050963 [symbol_engine_optimizer]: 7.55e-05, [1] [Cycle 1]: 6.849e-05, [6] [build]: 5.08002e-06 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 7.50006e-07 [validate]: 4.873e-05 Sums bootstrap : 0.000396s : 1.15% type_inference : 0.005330s : 15.53% event_method : 0.000020s : 0.06% auto_monad : 0.000068s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000040s : 0.12% rewriter_before_opt_a : 0.000076s : 0.22% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000688s : 2.00% jit_opt_a.with_stream_mark : 0.000038s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000778s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000054s : 0.16% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000047s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.024969s : 72.72% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000022s : 0.06% cconv : 0.000044s : 0.13% loop_unroll : 0.000476s : 1.39% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000052s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000065s : 0.19% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.03% opt_after_jit_grad : 0.000510s : 1.48% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.14% Time group info: ------[substitution.] 0.000253 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000007s : 3: substitution.graph_param_transform 85.91% : 0.000218s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 4.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005259 2 82.32% : 0.004329s : 1: type_inference.infer 17.68% : 0.000930s : 1: type_inference.specialize ------[replace.] 0.000077 6 66.13% : 0.000051s : 4: replace.inline 33.87% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 95.15% : 0.000214s : 4: match.inline 4.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.10% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.09% : 0.000001s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.07% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.20% : 0.000003s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 4.03% : 0.000005s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 1.44% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.62% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.32% : 0.000002s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.86% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.15% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.09% : 0.000010s : 53: predicate.switch_simplify 1.47% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.24% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.85% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000728 13 53.00% : 0.000386s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.28% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.71% : 0.000289s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040515 72 0.17% : 0.000068s : 1: add_recomputation 0.18% : 0.000071s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 1.03% : 0.000416s : 1: bootstrap 0.12% : 0.000047s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.70% : 0.005954s : 1: jit_opt_a 0.51% : 0.000206s : 1: jit_opt_after_cconv 0.22% : 0.000090s : 1: jit_opt_b 1.20% : 0.000486s : 1: loop_unroll 61.68% : 0.024990s : 1: mutable_eliminate 2.28% : 0.000922s : 26: opt.transform.jit_opt_a 0.14% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000035s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.28% : 0.000519s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000043s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000022s : 1: remove_dup_value 1.07% : 0.000432s : 1: renormalize.infer 0.83% : 0.000335s : 1: renormalize.specialize 0.03% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000050s : 1: rewriter_after_opt_a 0.19% : 0.000079s : 1: rewriter_before_opt_a 0.19% : 0.000078s : 1: symbol_engine_optimizer 13.20% : 0.005350s : 1: type_inference TotalTime = 0.0369801, [30] [bootstrap]: 0.00031069 [type_inference]: 0.0129503 [event_method]: 2.557e-05 [auto_monad]: 7.748e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 6.617e-05 [rewriter_before_opt_a]: 9.503e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.0205228, [2] [Cycle 1]: 0.0164831, [27] [switch_simplify]: 6.342e-05 [loop_unroll]: 3.385e-05 [a_1]: 0.00130935 [with_stream_mark]: 2.651e-05 [recompute_prepare]: 9.59999e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.57997e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.094e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 0.0145953 [add_forward_monad_depend]: 1.481e-05 [auto_monad_grad]: 2.51998e-06 [auto_monad_eliminator]: 2.735e-05 [cse]: 5.131e-05 [replace_applicator]: 2.799e-05 [Cycle 2]: 0.00039602, [27] [switch_simplify]: 6.83998e-06 [loop_unroll]: 5.92001e-06 [a_1]: 0.00011058 [with_stream_mark]: 1.846e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 4.86002e-06 [cell_reuse_recompute_pass]: 4.18999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.969e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 3.65e-06 [replace_old_param]: 1.065e-05 [inline_without_move]: 5.25001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 6.70998e-06 [cse]: 1.822e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 2.292e-05 [rewriter_after_opt_a]: 4.911e-05 [convert_after_rewriter]: 7.80998e-06 [order_py_execute_after_rewriter]: 5.60001e-06 [mutable_eliminate]: 0.00086131 [jit_opt_b]: 6.05e-05, [1] [Cycle 1]: 5.068e-05, [2] [frontend_op_eliminate]: 1.777e-05 [inline_after_opt_a]: 1.9e-05 [cconv]: 3.692e-05 [loop_unroll]: 0.00051798 [jit_opt_after_cconv]: 0.00018176, [1] [Cycle 1]: 0.00017387, [11] [c_1]: 2.452e-05 [parameter_eliminate]: 4.08999e-06 [updatestate_depend_eliminate]: 1.044e-05 [updatestate_assign_eliminate]: 2.95998e-06 [updatestate_loads_eliminate]: 3.23998e-06 [cse]: 3.93e-05 [call_graph_tuple_transform]: 2.297e-05 [tuple_list_get_item_eliminator]: 6.28002e-06 [none_parameter_eliminate]: 2.07999e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 5.097e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 8.05e-06 [add_recomputation]: 5.973e-05 [cse_after_recomputation]: 2.735e-05, [1] [Cycle 1]: 2.067e-05, [1] [cse]: 1.38e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 7.08e-06 [opt_after_jit_grad]: 0.00060588 [symbol_engine_optimizer]: 0.0001168, [1] [Cycle 1]: 0.0001083, [6] [build]: 5.35999e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 4.251e-05 [opt_reshape]: 8.22e-06 [fold_const_symbol]: 1.166e-05 [renormalize]: 7.29982e-07 [validate]: 5.704e-05 Sums bootstrap : 0.000311s : 0.95% type_inference : 0.012950s : 39.69% event_method : 0.000026s : 0.08% auto_monad : 0.000077s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000066s : 0.20% rewriter_before_opt_a : 0.000095s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.22% jit_opt_a.loop_unroll : 0.000040s : 0.12% jit_opt_a.a_1 : 0.001420s : 4.35% jit_opt_a.with_stream_mark : 0.000045s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000007s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.014595s : 44.73% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.10% jit_opt_a.cse : 0.000070s : 0.21% jit_opt_a.replace_applicator : 0.000034s : 0.10% py_interpret_to_execute_after_opt_a : 0.000023s : 0.07% rewriter_after_opt_a : 0.000049s : 0.15% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000861s : 2.64% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.06% cconv : 0.000037s : 0.11% loop_unroll : 0.000518s : 1.59% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000051s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000060s : 0.18% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000606s : 1.86% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000043s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.17% Time group info: ------[substitution.] 0.000318 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 1.94% : 0.000006s : 3: substitution.graph_param_transform 87.08% : 0.000277s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 2.42% : 0.000008s : 2: substitution.replace_old_param 4.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012839 2 85.81% : 0.011017s : 1: type_inference.infer 14.19% : 0.001822s : 1: type_inference.specialize ------[replace.] 0.000117 7 68.89% : 0.000080s : 5: replace.inline 31.11% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000285 7 95.86% : 0.000273s : 5: match.inline 4.14% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000167 747 1.09% : 0.000002s : 11: predicate.accumulaten_eliminater 13.27% : 0.000022s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 11: predicate.addn_check_dump 1.22% : 0.000002s : 11: predicate.addn_zero_filter 1.64% : 0.000003s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.30% : 0.000001s : 3: predicate.check_bprop_eliminate 0.87% : 0.000001s : 11: predicate.compare_switch_simplify 0.93% : 0.000002s : 11: predicate.depend_value_elim 1.03% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 0.93% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.02% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.88% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.94% : 0.000002s : 11: predicate.environ_get_depend_swap 1.08% : 0.000002s : 11: predicate.environ_get_eliminate 0.87% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.69% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 6.56% : 0.000011s : 24: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.45% : 0.000002s : 16: predicate.load_eliminater 1.68% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.22% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.84% : 0.000001s : 11: predicate.merge_addn 0.84% : 0.000001s : 11: predicate.minmaximum_grad 2.26% : 0.000004s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.81% : 0.000003s : 16: predicate.partial_eliminate 0.94% : 0.000002s : 11: predicate.print_const_string_wrapper 1.26% : 0.000002s : 11: predicate.reduce_eliminate 1.27% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000003s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 11: predicate.reshape_eliminate 1.09% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 0.97% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.13% : 0.000004s : 18: predicate.switch_defer_inline 2.81% : 0.000005s : 18: predicate.switch_layer_defer_inline 6.07% : 0.000010s : 59: predicate.switch_simplify 0.91% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.27% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.02% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.30% : 0.000002s : 11: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001478 16 42.29% : 0.000625s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.88% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 51.83% : 0.000766s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053346 72 0.12% : 0.000063s : 1: add_recomputation 0.15% : 0.000081s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.62% : 0.000329s : 1: bootstrap 0.07% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 38.48% : 0.020526s : 1: jit_opt_a 0.35% : 0.000186s : 1: jit_opt_after_cconv 0.12% : 0.000063s : 1: jit_opt_b 1.00% : 0.000532s : 1: loop_unroll 1.64% : 0.000877s : 1: mutable_eliminate 3.14% : 0.001677s : 26: opt.transform.jit_opt_a 0.10% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000024s : 1: opt.transform.mutable_eliminate 0.09% : 0.000048s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000067s : 4: opt.transform.symbol_engine_opt 1.16% : 0.000617s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000069s : 1: py_interpret_to_execute 0.05% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000054s : 1: remove_dup_value 25.78% : 0.013751s : 1: renormalize.infer 1.55% : 0.000824s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000053s : 1: rewriter_after_opt_a 0.18% : 0.000098s : 1: rewriter_before_opt_a 0.22% : 0.000119s : 1: symbol_engine_optimizer 24.32% : 0.012976s : 1: type_inference TotalTime = 0.0720583, [30] [bootstrap]: 0.00035627 [type_inference]: 0.0385224 [event_method]: 2.128e-05 [auto_monad]: 7.285e-05 [graph_reusing]: 6.02001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00010109 [rewriter_before_opt_a]: 8.281e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00618395, [2] [Cycle 1]: 0.00219086, [27] [switch_simplify]: 6.679e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00067903 [with_stream_mark]: 2.466e-05 [recompute_prepare]: 9.02e-06 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.025e-05 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00102896 [add_forward_monad_depend]: 6.07001e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 3.833e-05 [replace_applicator]: 1.353e-05 [Cycle 2]: 0.00031661, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 5.15999e-06 [a_1]: 8.812e-05 [with_stream_mark]: 1.027e-05 [recompute_prepare]: 4.75999e-06 [updatestate_depend_eliminate]: 2.72001e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.07999e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.322e-05 [j_node_and_user_rematch]: 7.55e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 7.10998e-06 [inline_without_move]: 5.04e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.253e-05 [replace_applicator]: 5.21002e-06 [py_interpret_to_execute_after_opt_a]: 1.297e-05 [rewriter_after_opt_a]: 3.992e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.00061141 [jit_opt_b]: 4.916e-05, [1] [Cycle 1]: 4.23e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.578e-05 [cconv]: 2.724e-05 [loop_unroll]: 0.00041794 [jit_opt_after_cconv]: 0.0001512, [1] [Cycle 1]: 0.00014485, [11] [c_1]: 1.992e-05 [parameter_eliminate]: 2.63998e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 2.128e-05 [call_graph_tuple_transform]: 1.961e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.588e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 6.00002e-06 [add_recomputation]: 5.561e-05 [cse_after_recomputation]: 2.368e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.277e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 5.35001e-06 [opt_after_jit_grad]: 0.000483 [symbol_engine_optimizer]: 0.0244932, [1] [Cycle 1]: 0.0244819, [6] [build]: 3.63e-06 [elim_shapecalc]: 7.21001e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 0.0243431 [fold_const_symbol]: 3.42e-05 [renormalize]: 1.62999e-06 [validate]: 7.967e-05 Sums bootstrap : 0.000356s : 0.53% type_inference : 0.038522s : 56.90% event_method : 0.000021s : 0.03% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000101s : 0.15% rewriter_before_opt_a : 0.000083s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000767s : 1.13% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001029s : 1.52% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000051s : 0.08% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000611s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000418s : 0.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000483s : 0.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.024343s : 35.96% symbol_engine_optimizer.fold_const_symbol : 0.000034s : 0.05% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000080s : 0.12% Time group info: ------[substitution.] 0.000264 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 1.17% : 0.000003s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 85.67% : 0.000226s : 4: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000005s : 2: substitution.replace_old_param 5.04% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038445 2 96.14% : 0.036962s : 1: type_inference.infer 3.86% : 0.001483s : 1: type_inference.specialize ------[replace.] 0.000148 6 83.35% : 0.000124s : 4: replace.inline 16.65% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.83% : 0.000223s : 4: match.inline 5.17% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.05% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 1.65% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.41% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.02% : 0.000001s : 10: predicate.environ_get_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.67% : 0.000001s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.45% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.25% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.54% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.64% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.60% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.26% : 0.000002s : 3: predicate.mutable_eliminate 12.59% : 0.000017s : 3: predicate.opt_reshape 2.00% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.21% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.05% : 0.000001s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 1.82% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.88% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.03% : 0.000001s : 10: predicate.transpose_eliminate 1.09% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.00% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.43% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000912 13 49.37% : 0.000450s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.00% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.63% : 0.000407s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.098432 72 0.06% : 0.000058s : 1: add_recomputation 0.08% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.38% : 0.000377s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.29% : 0.006188s : 1: jit_opt_a 0.16% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000051s : 1: jit_opt_b 0.43% : 0.000425s : 1: loop_unroll 0.63% : 0.000620s : 1: mutable_eliminate 1.01% : 0.000995s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 24.77% : 0.024386s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000105s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.61% : 0.000599s : 1: renormalize.infer 0.43% : 0.000421s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000087s : 1: rewriter_before_opt_a 24.89% : 0.024499s : 1: symbol_engine_optimizer 39.16% : 0.038542s : 1: type_inference [LOG_WARNING] can not open file, file: /home/jenkins/ascend/log/debug/plog/plog-169622_20260129173656805.log, possible reason: Permission denied. TotalTime = 0.100117, [30] [bootstrap]: 0.00077048 [type_inference]: 0.0431028 [event_method]: 2.285e-05 [auto_monad]: 0.00013258 [graph_reusing]: 6.02001e-06 [pre_auto_parallel]: 1.048e-05 [py_interpret_to_execute]: 5.617e-05 [rewriter_before_opt_a]: 0.00029982 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0525553, [2] [Cycle 1]: 0.00218474, [27] [switch_simplify]: 0.00010094 [loop_unroll]: 3.092e-05 [a_1]: 0.00063302 [with_stream_mark]: 2.544e-05 [recompute_prepare]: 7.53e-06 [updatestate_depend_eliminate]: 1.485e-05 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.524e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.136e-05 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00093864 [add_forward_monad_depend]: 2.403e-05 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 2.559e-05 [cse]: 4.364e-05 [replace_applicator]: 1.299e-05 [Cycle 2]: 0.00033435, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.74e-06 [a_1]: 9.066e-05 [with_stream_mark]: 1.081e-05 [recompute_prepare]: 4.68999e-06 [updatestate_depend_eliminate]: 8.07e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.41998e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.32002e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.391e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 4.65001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 6.43e-06 [cse]: 1.263e-05 [replace_applicator]: 5.44998e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 0.00022546 [convert_after_rewriter]: 2.11e-05 [order_py_execute_after_rewriter]: 5.72999e-06 [mutable_eliminate]: 0.00070801 [jit_opt_b]: 5.53e-05, [1] [Cycle 1]: 4.655e-05, [2] [frontend_op_eliminate]: 1.772e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 3.541e-05 [loop_unroll]: 0.00047277 [jit_opt_after_cconv]: 0.00017328, [1] [Cycle 1]: 0.00016437, [11] [c_1]: 2.183e-05 [parameter_eliminate]: 4.97999e-06 [updatestate_depend_eliminate]: 1.029e-05 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.199e-05 [call_graph_tuple_transform]: 2.19e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 2.03002e-06 [renormalize]: 1.04003e-06 [switch_simplify]: 5.63002e-06 [remove_dup_value]: 1.801e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 3.26e-05 [add_recomputation]: 6.7e-05 [cse_after_recomputation]: 2.933e-05, [1] [Cycle 1]: 2.281e-05, [1] [cse]: 1.31e-05 [auto_monad_reorder]: 2.567e-05 [get_jit_bprop_graph]: 2.54999e-06 [rewriter_after_jit_bprop_graph]: 0.00018796 [opt_after_jit_grad]: 0.00060074 [symbol_engine_optimizer]: 8.424e-05, [1] [Cycle 1]: 7.716e-05, [6] [build]: 5.19e-06 [elim_shapecalc]: 9.34998e-06 [elim_not_effective]: 1.585e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 9.71003e-06 [renormalize]: 1.00001e-06 [validate]: 7.188e-05 Sums bootstrap : 0.000770s : 1.56% type_inference : 0.043103s : 87.47% event_method : 0.000023s : 0.05% auto_monad : 0.000133s : 0.27% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000010s : 0.02% py_interpret_to_execute : 0.000056s : 0.11% rewriter_before_opt_a : 0.000300s : 0.61% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000107s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000724s : 1.47% jit_opt_a.with_stream_mark : 0.000036s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000023s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000939s : 1.91% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.06% jit_opt_a.cse : 0.000056s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000225s : 0.46% convert_after_rewriter : 0.000021s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000708s : 1.44% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000035s : 0.07% loop_unroll : 0.000473s : 0.96% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000033s : 0.07% add_recomputation : 0.000067s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000026s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000188s : 0.38% opt_after_jit_grad : 0.000601s : 1.22% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000072s : 0.15% Time group info: ------[substitution.] 0.000300 23 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 1.81% : 0.000005s : 3: substitution.graph_param_transform 84.47% : 0.000253s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.03% : 0.000012s : 4: substitution.remove_not_recompute_node 2.17% : 0.000007s : 2: substitution.replace_old_param 4.80% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042980 2 23.77% : 0.010216s : 1: type_inference.infer 76.23% : 0.032764s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.83% : 0.000053s : 4: replace.inline 30.17% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 6 94.95% : 0.000250s : 4: match.inline 5.05% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 2.55% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 2.08% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.67% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.38% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.48% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.71% : 0.000001s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.94% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000933 13 49.09% : 0.000458s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.67% : 0.000072s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.24% : 0.000403s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.101978 72 0.07% : 0.000071s : 1: add_recomputation 0.13% : 0.000138s : 1: auto_monad 0.03% : 0.000029s : 1: auto_monad_reorder 0.78% : 0.000795s : 1: bootstrap 0.04% : 0.000039s : 1: cconv 0.02% : 0.000024s : 1: convert_after_rewriter 0.03% : 0.000032s : 1: cse_after_recomputation 0.04% : 0.000037s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 51.54% : 0.052559s : 1: jit_opt_a 0.17% : 0.000176s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.47% : 0.000484s : 1: loop_unroll 0.71% : 0.000722s : 1: mutable_eliminate 0.96% : 0.000983s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000616s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000012s : 1: pre_auto_parallel 0.06% : 0.000059s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.54% : 0.000546s : 1: renormalize.infer 0.38% : 0.000384s : 1: renormalize.specialize 0.19% : 0.000193s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000230s : 1: rewriter_after_opt_a 0.30% : 0.000305s : 1: rewriter_before_opt_a 0.09% : 0.000087s : 1: symbol_engine_optimizer 42.29% : 0.043130s : 1: type_inference TotalTime = 0.101707, [30] [bootstrap]: 0.00032655 [type_inference]: 0.0212317 [event_method]: 2.28e-05 [auto_monad]: 7.321e-05 [graph_reusing]: 6.77002e-06 [pre_auto_parallel]: 2.95002e-06 [py_interpret_to_execute]: 9.678e-05 [rewriter_before_opt_a]: 8.644e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.0772623, [2] [Cycle 1]: 0.00229636, [27] [switch_simplify]: 6.683e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00061213 [with_stream_mark]: 2.599e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.67998e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 1.134e-05 [inline_without_move]: 5.99e-06 [renormalize]: 0.00116629 [add_forward_monad_depend]: 8.79e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.899e-05 [cse]: 4.083e-05 [replace_applicator]: 1.664e-05 [Cycle 2]: 0.00037153, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.42999e-06 [a_1]: 9.57e-05 [with_stream_mark]: 1.433e-05 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 2.163e-05 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 8.52e-06 [cse]: 1.475e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.677e-05 [rewriter_after_opt_a]: 4.272e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.00075273 [jit_opt_b]: 5.475e-05, [1] [Cycle 1]: 4.518e-05, [2] [frontend_op_eliminate]: 1.63e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 3.673e-05 [loop_unroll]: 0.00049138 [jit_opt_after_cconv]: 0.00020783, [1] [Cycle 1]: 0.00015711, [11] [c_1]: 2.134e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 9.37001e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 3.114e-05 [call_graph_tuple_transform]: 2.136e-05 [tuple_list_get_item_eliminator]: 5.92001e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 1.922e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 7.71999e-06 [add_recomputation]: 5.918e-05 [cse_after_recomputation]: 2.688e-05, [1] [Cycle 1]: 2.014e-05, [1] [cse]: 1.36e-05 [auto_monad_reorder]: 2.006e-05 [get_jit_bprop_graph]: 2.88e-06 [rewriter_after_jit_bprop_graph]: 8.23999e-06 [opt_after_jit_grad]: 0.00050614 [symbol_engine_optimizer]: 7.983e-05, [1] [Cycle 1]: 7.195e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 9.35001e-06 [elim_not_effective]: 1.442e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 6.30011e-07 [validate]: 4.891e-05 Sums bootstrap : 0.000327s : 1.24% type_inference : 0.021232s : 80.36% event_method : 0.000023s : 0.09% auto_monad : 0.000073s : 0.28% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000097s : 0.37% rewriter_before_opt_a : 0.000086s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000708s : 2.68% jit_opt_a.with_stream_mark : 0.000040s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.08% jit_opt_a.inline_without_move : 0.000028s : 0.10% jit_opt_a.renormalize : 0.001166s : 4.41% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.10% jit_opt_a.cse : 0.000056s : 0.21% jit_opt_a.replace_applicator : 0.000022s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000043s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000753s : 2.85% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000037s : 0.14% loop_unroll : 0.000491s : 1.86% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000059s : 0.22% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000020s : 0.08% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000506s : 1.92% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.19% Time group info: ------[substitution.] 0.000270 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 3: substitution.graph_param_transform 85.83% : 0.000232s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000007s : 2: substitution.replace_old_param 4.88% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021152 2 92.64% : 0.019595s : 1: type_inference.infer 7.36% : 0.001558s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.72% : 0.000054s : 4: replace.inline 31.28% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 94.95% : 0.000230s : 4: match.inline 5.05% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.64% : 0.000002s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 2.17% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.78% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.89% : 0.000009s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.55% : 0.000002s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.92% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000010s : 53: predicate.switch_simplify 1.21% : 0.000002s : 10: predicate.tile_eliminate 1.10% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.46% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000918 13 45.11% : 0.000414s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.61% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.28% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.103889 72 0.06% : 0.000062s : 1: add_recomputation 0.07% : 0.000077s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.33% : 0.000345s : 1: bootstrap 0.04% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 74.37% : 0.077267s : 1: jit_opt_a 0.20% : 0.000211s : 1: jit_opt_after_cconv 0.06% : 0.000057s : 1: jit_opt_b 0.48% : 0.000500s : 1: loop_unroll 0.74% : 0.000764s : 1: mutable_eliminate 0.93% : 0.000965s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000100s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 0.65% : 0.000672s : 1: renormalize.infer 0.47% : 0.000484s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000082s : 1: symbol_engine_optimizer 20.46% : 0.021255s : 1: type_inference TotalTime = 0.0277901, [30] [bootstrap]: 0.00030663 [type_inference]: 0.00541335 [event_method]: 2.226e-05 [auto_monad]: 0.00012821 [graph_reusing]: 7.03e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 3.937e-05 [rewriter_before_opt_a]: 8.025e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.0190852, [2] [Cycle 1]: 0.0133724, [27] [switch_simplify]: 6.496e-05 [loop_unroll]: 2.857e-05 [a_1]: 0.00057981 [with_stream_mark]: 2.534e-05 [recompute_prepare]: 1.056e-05 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 2.00002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 0.0122238 [add_forward_monad_depend]: 1.328e-05 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 2.563e-05 [cse]: 4.311e-05 [replace_applicator]: 2.939e-05 [Cycle 2]: 0.00038433, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 5.44e-06 [a_1]: 0.00010341 [with_stream_mark]: 1.745e-05 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.10001e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 3.56999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.077e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.89999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.529e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.846e-05 [rewriter_after_opt_a]: 4.455e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.31002e-06 [mutable_eliminate]: 0.00084247 [jit_opt_b]: 5.419e-05, [1] [Cycle 1]: 4.582e-05, [2] [frontend_op_eliminate]: 1.623e-05 [inline_after_opt_a]: 1.735e-05 [cconv]: 4.442e-05 [loop_unroll]: 0.00045921 [jit_opt_after_cconv]: 0.00016192, [1] [Cycle 1]: 0.00015467, [11] [c_1]: 2.165e-05 [parameter_eliminate]: 3.76001e-06 [updatestate_depend_eliminate]: 8.18001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 3.098e-05 [call_graph_tuple_transform]: 2.117e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.871e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 7.08e-06 [add_recomputation]: 5.825e-05 [cse_after_recomputation]: 2.707e-05, [1] [Cycle 1]: 2.151e-05, [1] [cse]: 1.393e-05 [auto_monad_reorder]: 1.847e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 6.74999e-06 [opt_after_jit_grad]: 0.00052659 [symbol_engine_optimizer]: 7.595e-05, [1] [Cycle 1]: 6.913e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.448e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 6.09987e-07 [validate]: 4.579e-05 Sums bootstrap : 0.000307s : 1.41% type_inference : 0.005413s : 24.94% event_method : 0.000022s : 0.10% auto_monad : 0.000128s : 0.59% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000039s : 0.18% rewriter_before_opt_a : 0.000080s : 0.37% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.33% jit_opt_a.loop_unroll : 0.000034s : 0.16% jit_opt_a.a_1 : 0.000683s : 3.15% jit_opt_a.with_stream_mark : 0.000043s : 0.20% jit_opt_a.recompute_prepare : 0.000016s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000009s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.012224s : 56.32% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.15% jit_opt_a.cse : 0.000058s : 0.27% jit_opt_a.replace_applicator : 0.000035s : 0.16% py_interpret_to_execute_after_opt_a : 0.000018s : 0.09% rewriter_after_opt_a : 0.000045s : 0.21% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000842s : 3.88% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.08% cconv : 0.000044s : 0.20% loop_unroll : 0.000459s : 2.12% jit_opt_after_cconv.c_1 : 0.000022s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000019s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000058s : 0.27% cse_after_recomputation.cse : 0.000014s : 0.06% auto_monad_reorder : 0.000018s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000527s : 2.43% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.21% Time group info: ------[substitution.] 0.000256 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 3: substitution.graph_param_transform 83.87% : 0.000215s : 4: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000006s : 4: substitution.remove_not_recompute_node 2.87% : 0.000007s : 2: substitution.replace_old_param 5.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005321 2 82.44% : 0.004387s : 1: type_inference.infer 17.56% : 0.000934s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.75% : 0.000048s : 4: replace.inline 34.25% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.63% : 0.000212s : 4: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 1.67% : 0.000002s : 10: predicate.arithmetic_simplify 1.81% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.55% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.66% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000008s : 22: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.70% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.57% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.18% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.10% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000010s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.21% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.00% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000802 13 47.39% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.14% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.47% : 0.000365s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040935 72 0.15% : 0.000062s : 1: add_recomputation 0.33% : 0.000133s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.80% : 0.000329s : 1: bootstrap 0.12% : 0.000048s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 46.63% : 0.019089s : 1: jit_opt_a 0.40% : 0.000165s : 1: jit_opt_after_cconv 0.14% : 0.000057s : 1: jit_opt_b 1.15% : 0.000470s : 1: loop_unroll 2.09% : 0.000856s : 1: mutable_eliminate 2.29% : 0.000938s : 26: opt.transform.jit_opt_a 0.12% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000019s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.31% : 0.000538s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000043s : 1: py_interpret_to_execute 0.05% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 28.55% : 0.011685s : 1: renormalize.infer 1.28% : 0.000524s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000048s : 1: rewriter_after_opt_a 0.21% : 0.000086s : 1: rewriter_before_opt_a 0.19% : 0.000078s : 1: symbol_engine_optimizer 13.28% : 0.005435s : 1: type_inference TotalTime = 0.157238, [30] [bootstrap]: 0.00036671 [type_inference]: 0.0923524 [event_method]: 2.235e-05 [auto_monad]: 7.036e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 3.12002e-06 [py_interpret_to_execute]: 0.00063543 [rewriter_before_opt_a]: 9.762e-05 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.00638407, [2] [Cycle 1]: 0.00215437, [27] [switch_simplify]: 6.549e-05 [loop_unroll]: 3.195e-05 [a_1]: 0.00058538 [with_stream_mark]: 2.581e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00106798 [add_forward_monad_depend]: 7.12002e-06 [auto_monad_grad]: 3.63999e-06 [auto_monad_eliminator]: 1.965e-05 [cse]: 3.938e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.00032791, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.61e-06 [a_1]: 8.98e-05 [with_stream_mark]: 1.169e-05 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.44003e-06 [specialize_transform]: 4.97999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.49999e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 4.79e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.86998e-06 [cse]: 1.437e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.532e-05 [rewriter_after_opt_a]: 4.016e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00064897 [jit_opt_b]: 5.369e-05, [1] [Cycle 1]: 4.557e-05, [2] [frontend_op_eliminate]: 1.647e-05 [inline_after_opt_a]: 1.788e-05 [cconv]: 3.097e-05 [loop_unroll]: 0.0551812 [jit_opt_after_cconv]: 0.00025623, [1] [Cycle 1]: 0.00019916, [11] [c_1]: 2.682e-05 [parameter_eliminate]: 8.21002e-06 [updatestate_depend_eliminate]: 1.182e-05 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 5.227e-05 [call_graph_tuple_transform]: 2.68e-05 [tuple_list_get_item_eliminator]: 6.49001e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 2.064e-05 [partial_unused_args_eliminate]: 2.65002e-06 [environ_conv]: 8.27998e-06 [add_recomputation]: 6.338e-05 [cse_after_recomputation]: 2.535e-05, [1] [Cycle 1]: 1.977e-05, [1] [cse]: 1.364e-05 [auto_monad_reorder]: 1.839e-05 [get_jit_bprop_graph]: 2.75002e-06 [rewriter_after_jit_bprop_graph]: 1.059e-05 [opt_after_jit_grad]: 0.00054057 [symbol_engine_optimizer]: 7.64e-05, [1] [Cycle 1]: 6.896e-05, [6] [build]: 4.94998e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 8.81002e-06 [renormalize]: 4.20026e-07 [validate]: 4.894e-05 Sums bootstrap : 0.000367s : 0.24% type_inference : 0.092352s : 60.51% event_method : 0.000022s : 0.01% auto_monad : 0.000070s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000635s : 0.42% rewriter_before_opt_a : 0.000098s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000675s : 0.44% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001068s : 0.70% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000649s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.055181s : 36.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000052s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000063s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000541s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.03% Time group info: ------[substitution.] 0.000250 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 3: substitution.graph_param_transform 85.17% : 0.000213s : 4: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000006s : 2: substitution.replace_old_param 5.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.092264 2 98.33% : 0.090721s : 1: type_inference.infer 1.67% : 0.001543s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.17% : 0.000052s : 4: replace.inline 31.83% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.65% : 0.000210s : 4: match.inline 5.35% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000002s : 10: predicate.addn_zero_filter 1.68% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.73% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 0.98% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.68% : 0.000008s : 22: predicate.inline 1.11% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 4.93% : 0.000006s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.63% : 0.000001s : 3: predicate.opt_reshape 1.98% : 0.000002s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.55% : 0.000001s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000009s : 53: predicate.switch_simplify 1.45% : 0.000002s : 10: predicate.tile_eliminate 1.11% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000923 13 48.47% : 0.000447s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.02% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.51% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.159300 72 0.04% : 0.000066s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000394s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.01% : 0.006388s : 1: jit_opt_a 0.16% : 0.000261s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 34.66% : 0.055211s : 1: loop_unroll 0.41% : 0.000660s : 1: mutable_eliminate 0.57% : 0.000910s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000043s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000549s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000650s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.39% : 0.000627s : 1: renormalize.infer 0.27% : 0.000432s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000102s : 1: rewriter_before_opt_a 0.05% : 0.000079s : 1: symbol_engine_optimizer 57.99% : 0.092373s : 1: type_inference TotalTime = 0.550105, [30] [bootstrap]: 0.055007 [type_inference]: 0.456279 [event_method]: 2.422e-05 [auto_monad]: 8.731e-05 [graph_reusing]: 6.68003e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.00075685 [rewriter_before_opt_a]: 0.00012328 [expand_dump_flag]: 4.18999e-06 [jit_opt_a]: 0.034775, [2] [Cycle 1]: 0.03021, [27] [switch_simplify]: 7.153e-05 [loop_unroll]: 3.447e-05 [a_1]: 0.02593 [with_stream_mark]: 2.974e-05 [recompute_prepare]: 1.449e-05 [updatestate_depend_eliminate]: 4.99e-06 [updatestate_assign_eliminate]: 3.86001e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 8.35001e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 7.94002e-06 [meta_shard_fg_expand]: 4.48999e-06 [get_grad_eliminate_]: 7.73999e-06 [merge_forward]: 5.61e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [j_node_and_user_rematch]: 1.108e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.361e-05 [inline_without_move]: 6.95002e-06 [renormalize]: 0.00368356 [add_forward_monad_depend]: 9.36e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.134e-05 [cse]: 4.269e-05 [replace_applicator]: 2.663e-05 [Cycle 2]: 0.00042839, [27] [switch_simplify]: 7.9e-06 [loop_unroll]: 6.78998e-06 [a_1]: 0.00013625 [with_stream_mark]: 1.77e-05 [recompute_prepare]: 6.69999e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.58003e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 2.98e-06 [get_grad_eliminate_]: 6.47001e-06 [merge_forward]: 5.12e-06 [cell_reuse_recompute_pass]: 4.26001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.099e-05 [j_node_and_user_rematch]: 1.054e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.066e-05 [inline_without_move]: 6.26998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.52001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.89001e-06 [cse]: 1.675e-05 [replace_applicator]: 6.76e-06 [py_interpret_to_execute_after_opt_a]: 1.689e-05 [rewriter_after_opt_a]: 4.07e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00092313 [jit_opt_b]: 6.055e-05, [1] [Cycle 1]: 5.297e-05, [2] [frontend_op_eliminate]: 2.14e-05 [inline_after_opt_a]: 2.063e-05 [cconv]: 3.149e-05 [loop_unroll]: 0.00047761 [jit_opt_after_cconv]: 0.00017433, [1] [Cycle 1]: 0.00016756, [11] [c_1]: 2.888e-05 [parameter_eliminate]: 3.63999e-06 [updatestate_depend_eliminate]: 7.14001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 3.149e-05 [call_graph_tuple_transform]: 2.406e-05 [tuple_list_get_item_eliminator]: 6.33998e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 7.18e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 9.64e-06 [add_recomputation]: 5.205e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.036e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 1.71e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 7.94002e-06 [opt_after_jit_grad]: 0.00059593 [symbol_engine_optimizer]: 0.00018234, [1] [Cycle 1]: 0.00017524, [6] [build]: 4.35e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 0.0001055 [fold_const_symbol]: 1.146e-05 [renormalize]: 5.50004e-07 [validate]: 9.826e-05 Sums bootstrap : 0.055007s : 10.09% type_inference : 0.456279s : 83.69% event_method : 0.000024s : 0.00% auto_monad : 0.000087s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000757s : 0.14% rewriter_before_opt_a : 0.000123s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.026066s : 4.78% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003684s : 0.68% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000059s : 0.01% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000923s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000031s : 0.01% loop_unroll : 0.000478s : 0.09% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000052s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000596s : 0.11% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000106s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000098s : 0.02% Time group info: ------[substitution.] 0.000469 25 0.44% : 0.000002s : 2: substitution.elim_not_effective 0.28% : 0.000001s : 2: substitution.fold_const_symbol 1.35% : 0.000006s : 4: substitution.graph_param_transform 90.57% : 0.000425s : 5: substitution.inline 0.91% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.61% : 0.000008s : 4: substitution.remove_not_recompute_node 1.50% : 0.000007s : 2: substitution.replace_old_param 3.33% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.456151 2 92.69% : 0.422803s : 1: type_inference.infer 7.31% : 0.033348s : 1: type_inference.specialize ------[replace.] 0.000150 7 73.80% : 0.000111s : 5: replace.inline 26.20% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000434 7 96.73% : 0.000419s : 5: match.inline 3.27% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000184 886 1.37% : 0.000003s : 13: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000004s : 13: predicate.arithmetic_simplify 1.50% : 0.000003s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.86% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000003s : 13: predicate.environ_get_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000001s : 4: predicate.graph_param_transform 6.75% : 0.000012s : 28: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000003s : 8: predicate.less_batch_normalization 1.65% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.28% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.17% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.98% : 0.000002s : 13: predicate.merge_addn 0.95% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000004s : 19: predicate.partial_eliminate 1.53% : 0.000003s : 13: predicate.print_const_string_wrapper 2.19% : 0.000004s : 13: predicate.reduce_eliminate 1.44% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 6.00% : 0.000011s : 20: predicate.switch_defer_inline 2.03% : 0.000004s : 20: predicate.switch_layer_defer_inline 5.97% : 0.000011s : 64: predicate.switch_simplify 1.17% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.48% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.96% : 0.000004s : 13: predicate.value_based_eliminate 0.28% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003078 25 66.18% : 0.002037s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.27% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.55% : 0.000940s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.580258 72 0.01% : 0.000055s : 1: add_recomputation 0.02% : 0.000091s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 9.49% : 0.055041s : 1: bootstrap 0.01% : 0.000084s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.99% : 0.034779s : 1: jit_opt_a 0.03% : 0.000177s : 1: jit_opt_after_cconv 0.01% : 0.000063s : 1: jit_opt_b 0.08% : 0.000488s : 1: loop_unroll 0.16% : 0.000933s : 1: mutable_eliminate 4.54% : 0.026357s : 26: opt.transform.jit_opt_a 0.01% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000020s : 1: opt.transform.mutable_eliminate 0.00% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000137s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000606s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000771s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.46% : 0.002659s : 1: renormalize.infer 0.17% : 0.001011s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000044s : 1: rewriter_after_opt_a 0.02% : 0.000129s : 1: rewriter_before_opt_a 0.03% : 0.000185s : 1: symbol_engine_optimizer 78.64% : 0.456305s : 1: type_inference TotalTime = 0.153961, [30] [bootstrap]: 0.00031875 [type_inference]: 0.112562 [event_method]: 2.041e-05 [auto_monad]: 6.735e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 9.715e-05 [rewriter_before_opt_a]: 8.123e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.0381109, [2] [Cycle 1]: 0.00228291, [27] [switch_simplify]: 6.618e-05 [loop_unroll]: 3.062e-05 [a_1]: 0.00060403 [with_stream_mark]: 9.383e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.096e-05 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00110013 [add_forward_monad_depend]: 7.47002e-06 [auto_monad_grad]: 3.11999e-06 [auto_monad_eliminator]: 1.758e-05 [cse]: 3.913e-05 [replace_applicator]: 1.658e-05 [Cycle 2]: 0.00033331, [27] [switch_simplify]: 6.00002e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.017e-05 [with_stream_mark]: 1.356e-05 [recompute_prepare]: 6.13998e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.36998e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.06997e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.10002e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.58e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.20999e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 6.31998e-06 [cse]: 1.334e-05 [replace_applicator]: 5.40001e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 3.899e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00066851 [jit_opt_b]: 4.99e-05, [1] [Cycle 1]: 4.159e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.597e-05 [cconv]: 3.062e-05 [loop_unroll]: 0.00043333 [jit_opt_after_cconv]: 0.00014549, [1] [Cycle 1]: 0.00013949, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 6.68e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.568e-05 [call_graph_tuple_transform]: 1.829e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.19998e-06 [remove_dup_value]: 1.584e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 6.33002e-06 [add_recomputation]: 5.353e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00046335 [symbol_engine_optimizer]: 0.00046433, [1] [Cycle 1]: 0.00045548, [6] [build]: 3.40998e-06 [elim_shapecalc]: 7.40998e-06 [elim_not_effective]: 1.244e-05 [opt_reshape]: 5.42999e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 4.69998e-07 [validate]: 4.712e-05 Sums bootstrap : 0.000319s : 0.27% type_inference : 0.112562s : 95.84% event_method : 0.000020s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000097s : 0.08% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000694s : 0.59% jit_opt_a.with_stream_mark : 0.000107s : 0.09% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001100s : 0.94% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000669s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000031s : 0.03% loop_unroll : 0.000433s : 0.37% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000463s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000266 23 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000005s : 3: substitution.graph_param_transform 86.25% : 0.000229s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000006s : 2: substitution.replace_old_param 4.84% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112486 2 98.72% : 0.111046s : 1: type_inference.infer 1.28% : 0.001439s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.07% : 0.000055s : 4: replace.inline 29.93% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.17% : 0.000226s : 4: match.inline 4.83% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.51% : 0.000002s : 10: predicate.addn_zero_filter 2.08% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.43% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.96% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.49% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000002s : 18: predicate.replace_applicator 1.14% : 0.000001s : 6: predicate.replace_old_param 0.56% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.12% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.88% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000906 13 47.37% : 0.000429s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.73% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.90% : 0.000416s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156016 72 0.04% : 0.000056s : 1: add_recomputation 0.05% : 0.000071s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000338s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 24.43% : 0.038114s : 1: jit_opt_a 0.09% : 0.000148s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.28% : 0.000442s : 1: loop_unroll 0.44% : 0.000680s : 1: mutable_eliminate 0.60% : 0.000931s : 26: opt.transform.jit_opt_a 0.03% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000471s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000100s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.40% : 0.000628s : 1: renormalize.infer 0.30% : 0.000462s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000085s : 1: rewriter_before_opt_a 0.30% : 0.000467s : 1: symbol_engine_optimizer 72.16% : 0.112578s : 1: type_inference [LOG_WARNING] can not open file, file: /home/jenkins/ascend/log/debug/plog/plog-169622_20260129173656805.log, possible reason: Permission denied.. TotalTime = 0.0906949, [30] [bootstrap]: 0.00032357 [type_inference]: 0.0818782 [event_method]: 2.136e-05 [auto_monad]: 6.937e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 0.00010459 [rewriter_before_opt_a]: 8.331e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00600698, [2] [Cycle 1]: 0.00207281, [27] [switch_simplify]: 6.4e-05 [loop_unroll]: 2.928e-05 [a_1]: 0.00058963 [with_stream_mark]: 2.578e-05 [recompute_prepare]: 7.79002e-06 [updatestate_depend_eliminate]: 4.82998e-06 [updatestate_assign_eliminate]: 4.27e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 5.64998e-06 [renormalize]: 0.00100255 [add_forward_monad_depend]: 6.74999e-06 [auto_monad_grad]: 3.14999e-06 [auto_monad_eliminator]: 1.634e-05 [cse]: 3.757e-05 [replace_applicator]: 1.291e-05 [Cycle 2]: 0.00032221, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.018e-05 [with_stream_mark]: 1.012e-05 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.22998e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 4.74e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.263e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 3.857e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.0005708 [jit_opt_b]: 4.958e-05, [1] [Cycle 1]: 4.19e-05, [2] [frontend_op_eliminate]: 1.509e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 2.739e-05 [loop_unroll]: 0.00043737 [jit_opt_after_cconv]: 0.00014486, [1] [Cycle 1]: 0.00013794, [11] [c_1]: 2.005e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.426e-05 [call_graph_tuple_transform]: 1.829e-05 [tuple_list_get_item_eliminator]: 5.76998e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.828e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 6.35002e-06 [add_recomputation]: 5.516e-05 [cse_after_recomputation]: 2.558e-05, [1] [Cycle 1]: 1.978e-05, [1] [cse]: 1.335e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 6.17999e-06 [opt_after_jit_grad]: 0.0004622 [symbol_engine_optimizer]: 7.192e-05, [1] [Cycle 1]: 6.514e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 5.53002e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 6.30011e-07 [validate]: 3.819e-05 Sums bootstrap : 0.000324s : 0.37% type_inference : 0.081878s : 94.69% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000105s : 0.12% rewriter_before_opt_a : 0.000083s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.08% jit_opt_a.loop_unroll : 0.000034s : 0.04% jit_opt_a.a_1 : 0.000680s : 0.79% jit_opt_a.with_stream_mark : 0.000036s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001003s : 1.16% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000050s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000571s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000437s : 0.51% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000462s : 0.53% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000256 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000005s : 3: substitution.graph_param_transform 85.51% : 0.000219s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000006s : 2: substitution.replace_old_param 5.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.081801 2 97.88% : 0.080063s : 1: type_inference.infer 2.12% : 0.001738s : 1: type_inference.specialize ------[replace.] 0.000076 6 70.44% : 0.000054s : 4: replace.inline 29.56% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.72% : 0.000216s : 4: match.inline 5.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.79% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.13% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.00% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.65% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.97% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.56% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.87% : 0.000010s : 53: predicate.switch_simplify 1.68% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.93% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000897 13 49.12% : 0.000441s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.34% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.55% : 0.000400s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.092634 72 0.06% : 0.000059s : 1: add_recomputation 0.08% : 0.000072s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.37% : 0.000342s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.49% : 0.006010s : 1: jit_opt_a 0.16% : 0.000148s : 1: jit_opt_after_cconv 0.06% : 0.000052s : 1: jit_opt_b 0.48% : 0.000445s : 1: loop_unroll 0.63% : 0.000580s : 1: mutable_eliminate 0.98% : 0.000904s : 26: opt.transform.jit_opt_a 0.05% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000470s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000108s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.63% : 0.000584s : 1: renormalize.infer 0.44% : 0.000409s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.09% : 0.000087s : 1: rewriter_before_opt_a 0.08% : 0.000074s : 1: symbol_engine_optimizer 88.41% : 0.081897s : 1: type_inference TotalTime = 0.01507, [30] [bootstrap]: 0.00033984 [type_inference]: 0.00547722 [event_method]: 1.93e-05 [auto_monad]: 6.675e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 3.626e-05 [rewriter_before_opt_a]: 7.485e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00639266, [2] [Cycle 1]: 0.00211045, [27] [switch_simplify]: 6.779e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00069747 [with_stream_mark]: 2.704e-05 [recompute_prepare]: 1.094e-05 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.80998e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.679e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 5.02999e-06 [renormalize]: 0.00086007 [add_forward_monad_depend]: 8.78001e-06 [auto_monad_grad]: 3.28998e-06 [auto_monad_eliminator]: 2.289e-05 [cse]: 4.061e-05 [replace_applicator]: 1.75e-05 [Cycle 2]: 0.0003839, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 4.80001e-06 [a_1]: 8.998e-05 [with_stream_mark]: 1.495e-05 [recompute_prepare]: 5.51998e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.83001e-06 [merge_forward]: 3.62002e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.848e-05 [j_node_and_user_rematch]: 8.26002e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.56e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.22001e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 8.89e-06 [cse]: 1.751e-05 [replace_applicator]: 2.326e-05 [py_interpret_to_execute_after_opt_a]: 1.775e-05 [rewriter_after_opt_a]: 4.624e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00073392 [jit_opt_b]: 5.916e-05, [1] [Cycle 1]: 4.829e-05, [2] [frontend_op_eliminate]: 1.818e-05 [inline_after_opt_a]: 1.73e-05 [cconv]: 3.537e-05 [loop_unroll]: 0.00059888 [jit_opt_after_cconv]: 0.00019241, [1] [Cycle 1]: 0.00018441, [11] [c_1]: 2.615e-05 [parameter_eliminate]: 5.30999e-06 [updatestate_depend_eliminate]: 1.823e-05 [updatestate_assign_eliminate]: 3.42997e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 4.153e-05 [call_graph_tuple_transform]: 2.329e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.932e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 7.67002e-06 [add_recomputation]: 5.789e-05 [cse_after_recomputation]: 2.552e-05, [1] [Cycle 1]: 1.886e-05, [1] [cse]: 1.295e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 6.91001e-06 [opt_after_jit_grad]: 0.00049112 [symbol_engine_optimizer]: 7.248e-05, [1] [Cycle 1]: 6.61e-05, [6] [build]: 5.12e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.31002e-06 [fold_const_symbol]: 8.18001e-06 [renormalize]: 3.60014e-07 [validate]: 4.971e-05 Sums bootstrap : 0.000340s : 3.24% type_inference : 0.005477s : 52.24% event_method : 0.000019s : 0.18% auto_monad : 0.000067s : 0.64% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.35% rewriter_before_opt_a : 0.000075s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000074s : 0.70% jit_opt_a.loop_unroll : 0.000034s : 0.33% jit_opt_a.a_1 : 0.000787s : 7.51% jit_opt_a.with_stream_mark : 0.000042s : 0.40% jit_opt_a.recompute_prepare : 0.000016s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000860s : 8.20% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.10% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.30% jit_opt_a.cse : 0.000058s : 0.55% jit_opt_a.replace_applicator : 0.000041s : 0.39% py_interpret_to_execute_after_opt_a : 0.000018s : 0.17% rewriter_after_opt_a : 0.000046s : 0.44% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000734s : 7.00% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.17% cconv : 0.000035s : 0.34% loop_unroll : 0.000599s : 5.71% jit_opt_after_cconv.c_1 : 0.000026s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000018s : 0.17% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000042s : 0.40% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.07% add_recomputation : 0.000058s : 0.55% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000019s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000491s : 4.68% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.47% Time group info: ------[substitution.] 0.000337 23 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000006s : 3: substitution.graph_param_transform 88.73% : 0.000299s : 4: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.55% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000006s : 2: substitution.replace_old_param 3.97% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005406 2 83.65% : 0.004522s : 1: type_inference.infer 16.35% : 0.000884s : 1: type_inference.specialize ------[replace.] 0.000086 6 67.60% : 0.000058s : 4: replace.inline 32.40% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000308 6 96.06% : 0.000296s : 4: match.inline 3.94% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.06% : 0.000001s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.67% : 0.000002s : 10: predicate.arithmetic_simplify 1.62% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000002s : 10: predicate.depend_value_elim 1.71% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 7.50% : 0.000010s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.96% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.58% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.69% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 2.83% : 0.000004s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 1.05% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.71% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.42% : 0.000010s : 53: predicate.switch_simplify 1.08% : 0.000001s : 10: predicate.tile_eliminate 1.08% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.03% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.96% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000716 13 53.06% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.58% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.36% : 0.000282s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017035 72 0.36% : 0.000061s : 1: add_recomputation 0.41% : 0.000070s : 1: auto_monad 0.13% : 0.000022s : 1: auto_monad_reorder 2.12% : 0.000360s : 1: bootstrap 0.22% : 0.000038s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000028s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 37.55% : 0.006397s : 1: jit_opt_a 1.15% : 0.000195s : 1: jit_opt_after_cconv 0.37% : 0.000062s : 1: jit_opt_b 3.60% : 0.000613s : 1: loop_unroll 4.38% : 0.000747s : 1: mutable_eliminate 6.17% : 0.001050s : 26: opt.transform.jit_opt_a 0.33% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000028s : 4: opt.transform.jit_opt_b 0.10% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000019s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.94% : 0.000500s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000039s : 1: py_interpret_to_execute 0.12% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000022s : 1: remove_dup_value 2.77% : 0.000472s : 1: renormalize.infer 2.22% : 0.000378s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000051s : 1: rewriter_after_opt_a 0.46% : 0.000078s : 1: rewriter_before_opt_a 0.44% : 0.000075s : 1: symbol_engine_optimizer 32.27% : 0.005497s : 1: type_inference TotalTime = 0.146034, [30] [bootstrap]: 0.00039698 [type_inference]: 0.136549 [event_method]: 2.632e-05 [auto_monad]: 8.033e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00013546 [rewriter_before_opt_a]: 8.878e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00651784, [2] [Cycle 1]: 0.00213018, [27] [switch_simplify]: 6.122e-05 [loop_unroll]: 2.88e-05 [a_1]: 0.00057343 [with_stream_mark]: 2.34e-05 [recompute_prepare]: 7.41999e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.54998e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.21002e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 0.00098961 [add_forward_monad_depend]: 6.27001e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 0.0001393 [replace_applicator]: 1.309e-05 [Cycle 2]: 0.00033745, [27] [switch_simplify]: 6.12001e-06 [loop_unroll]: 5.03002e-06 [a_1]: 9.964e-05 [with_stream_mark]: 1.116e-05 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 3.63999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 4.90999e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.309e-05 [j_node_and_user_rematch]: 7.86001e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 7.54002e-06 [inline_without_move]: 4.72998e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 1.35999e-06 [auto_monad_eliminator]: 7.73999e-06 [cse]: 1.388e-05 [replace_applicator]: 4.90001e-06 [py_interpret_to_execute_after_opt_a]: 1.436e-05 [rewriter_after_opt_a]: 4.104e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00058047 [jit_opt_b]: 4.913e-05, [1] [Cycle 1]: 4.109e-05, [2] [frontend_op_eliminate]: 1.466e-05 [inline_after_opt_a]: 1.521e-05 [cconv]: 2.775e-05 [loop_unroll]: 0.00043267 [jit_opt_after_cconv]: 0.00014484, [1] [Cycle 1]: 0.00013823, [11] [c_1]: 2.1e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 6.57002e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.309e-05 [call_graph_tuple_transform]: 1.841e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.32999e-06 [remove_dup_value]: 1.7e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 6.22001e-06 [add_recomputation]: 5.468e-05 [cse_after_recomputation]: 2.511e-05, [1] [Cycle 1]: 1.943e-05, [1] [cse]: 1.324e-05 [auto_monad_reorder]: 1.865e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.45001e-06 [opt_after_jit_grad]: 0.00046132 [symbol_engine_optimizer]: 7.248e-05, [1] [Cycle 1]: 6.629e-05, [6] [build]: 4.25999e-06 [elim_shapecalc]: 7.41001e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 5.62999e-06 [fold_const_symbol]: 8.98002e-06 [renormalize]: 7.39994e-07 [validate]: 4.339e-05 Sums bootstrap : 0.000397s : 0.28% type_inference : 0.136549s : 96.60% event_method : 0.000026s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000135s : 0.10% rewriter_before_opt_a : 0.000089s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000034s : 0.02% jit_opt_a.a_1 : 0.000673s : 0.48% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000990s : 0.70% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000153s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000580s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000433s : 0.31% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000461s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000244 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 3: substitution.graph_param_transform 85.88% : 0.000210s : 4: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.25% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.136443 2 98.59% : 0.134518s : 1: type_inference.infer 1.41% : 0.001925s : 1: type_inference.specialize ------[replace.] 0.000074 6 70.10% : 0.000052s : 4: replace.inline 29.90% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.65% : 0.000207s : 4: match.inline 5.35% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.27% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.40% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.01% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.59% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001048 13 47.06% : 0.000493s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.34% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.60% : 0.000499s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147947 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000084s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.29% : 0.000422s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.41% : 0.006521s : 1: jit_opt_a 0.10% : 0.000148s : 1: jit_opt_after_cconv 0.04% : 0.000052s : 1: jit_opt_b 0.30% : 0.000441s : 1: loop_unroll 0.40% : 0.000589s : 1: mutable_eliminate 0.60% : 0.000891s : 26: opt.transform.jit_opt_a 0.03% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000469s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000141s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.39% : 0.000579s : 1: renormalize.infer 0.27% : 0.000402s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.06% : 0.000093s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 92.32% : 0.136582s : 1: type_inference TotalTime = 0.902763, [30] [bootstrap]: 0.00042806 [type_inference]: 0.786187 [event_method]: 3.355e-05 [auto_monad]: 9.914e-05 [graph_reusing]: 7.36999e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00104346 [rewriter_before_opt_a]: 0.000156 [expand_dump_flag]: 6.12001e-06 [jit_opt_a]: 0.0699104, [2] [Cycle 1]: 0.00737363, [27] [switch_simplify]: 0.00010547 [loop_unroll]: 3.464e-05 [a_1]: 0.00092675 [with_stream_mark]: 2.297e-05 [recompute_prepare]: 1.191e-05 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.94002e-06 [updatestate_useless_node_eliminater]: 6.76999e-06 [accelerated_algorithm]: 7.59002e-06 [meta_shard_fg_expand]: 3.64002e-06 [get_grad_eliminate_]: 7.6e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.89e-05 [j_node_and_user_rematch]: 1.176e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.171e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00578096 [add_forward_monad_depend]: 1.092e-05 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 2.543e-05 [cse]: 4.983e-05 [replace_applicator]: 3.022e-05 [Cycle 2]: 0.00051764, [27] [switch_simplify]: 8.57e-06 [loop_unroll]: 7.65e-06 [a_1]: 0.00015507 [with_stream_mark]: 1.852e-05 [recompute_prepare]: 8.00999e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 4.1e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 3.13e-06 [specialize_transform]: 7.63001e-06 [updatestate_useless_node_eliminater]: 8.12998e-06 [accelerated_algorithm]: 8.57e-06 [meta_shard_fg_expand]: 3.34001e-06 [get_grad_eliminate_]: 6.74001e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 5.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.278e-05 [j_node_and_user_rematch]: 1.222e-05 [meta_fg_expand]: 3.99002e-06 [replace_old_param]: 1.19e-05 [inline_without_move]: 6.98e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 1.45999e-06 [auto_monad_eliminator]: 9.79e-06 [cse]: 2.949e-05 [replace_applicator]: 8.73001e-06 [py_interpret_to_execute_after_opt_a]: 2.449e-05 [rewriter_after_opt_a]: 5.486e-05 [convert_after_rewriter]: 9.46e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00129167 [jit_opt_b]: 8.227e-05, [1] [Cycle 1]: 6.963e-05, [2] [frontend_op_eliminate]: 2.824e-05 [inline_after_opt_a]: 2.529e-05 [cconv]: 3.898e-05 [loop_unroll]: 0.0411187 [jit_opt_after_cconv]: 0.00028473, [1] [Cycle 1]: 0.00027202, [11] [c_1]: 4.494e-05 [parameter_eliminate]: 9.48002e-06 [updatestate_depend_eliminate]: 1.59e-05 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 3.89002e-06 [cse]: 6.698e-05 [call_graph_tuple_transform]: 3.945e-05 [tuple_list_get_item_eliminator]: 1.096e-05 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 8.25999e-06 [remove_dup_value]: 2.649e-05 [partial_unused_args_eliminate]: 5.48002e-06 [environ_conv]: 1.39e-05 [add_recomputation]: 7.191e-05 [cse_after_recomputation]: 3.153e-05, [1] [Cycle 1]: 2.439e-05, [1] [cse]: 1.715e-05 [auto_monad_reorder]: 1.993e-05 [get_jit_bprop_graph]: 2.86e-06 [rewriter_after_jit_bprop_graph]: 1.352e-05 [opt_after_jit_grad]: 0.00098411 [symbol_engine_optimizer]: 0.00011021, [1] [Cycle 1]: 9.884e-05, [6] [build]: 7.87998e-06 [elim_shapecalc]: 1.147e-05 [elim_not_effective]: 2.321e-05 [opt_reshape]: 1.054e-05 [fold_const_symbol]: 1.204e-05 [renormalize]: 4.30009e-07 [validate]: 0.00033457 Sums bootstrap : 0.000428s : 0.05% type_inference : 0.786187s : 93.62% event_method : 0.000034s : 0.00% auto_monad : 0.000099s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001043s : 0.12% rewriter_before_opt_a : 0.000156s : 0.02% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000114s : 0.01% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001082s : 0.13% jit_opt_a.with_stream_mark : 0.000041s : 0.00% jit_opt_a.recompute_prepare : 0.000020s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.00% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.005781s : 0.69% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.00% jit_opt_a.cse : 0.000079s : 0.01% jit_opt_a.replace_applicator : 0.000039s : 0.00% py_interpret_to_execute_after_opt_a : 0.000024s : 0.00% rewriter_after_opt_a : 0.000055s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001292s : 0.15% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.00% jit_opt_b.inline_after_opt_a : 0.000025s : 0.00% cconv : 0.000039s : 0.00% loop_unroll : 0.041119s : 4.90% jit_opt_after_cconv.c_1 : 0.000045s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000067s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000039s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000011s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000026s : 0.00% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000072s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000020s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.00% opt_after_jit_grad : 0.000984s : 0.12% symbol_engine_optimizer.build : 0.000008s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000335s : 0.04% Time group info: ------[substitution.] 0.000414 25 0.69% : 0.000003s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 2.59% : 0.000011s : 4: substitution.graph_param_transform 87.28% : 0.000361s : 5: substitution.inline 1.08% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000008s : 4: substitution.remove_not_recompute_node 1.60% : 0.000007s : 2: substitution.replace_old_param 4.40% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.786015 2 99.19% : 0.779664s : 1: type_inference.infer 0.81% : 0.006351s : 1: type_inference.specialize ------[replace.] 0.000149 7 68.23% : 0.000101s : 5: replace.inline 31.77% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000375 7 95.50% : 0.000358s : 5: match.inline 4.50% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.67% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000002s : 13: predicate.addn_check_dump 1.75% : 0.000003s : 13: predicate.addn_zero_filter 2.44% : 0.000005s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 0.88% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.32% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 6.08% : 0.000011s : 28: predicate.inline 0.68% : 0.000001s : 8: predicate.inline_without_move 0.33% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000003s : 8: predicate.less_batch_normalization 1.54% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 4.28% : 0.000008s : 4: predicate.loop_unroll_after_grad 3.38% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.30% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.85% : 0.000002s : 13: predicate.merge_addn 0.85% : 0.000002s : 13: predicate.minmaximum_grad 2.29% : 0.000004s : 4: predicate.mutable_eliminate 0.36% : 0.000001s : 4: predicate.opt_reshape 1.93% : 0.000004s : 19: predicate.partial_eliminate 1.39% : 0.000003s : 13: predicate.print_const_string_wrapper 1.75% : 0.000003s : 13: predicate.reduce_eliminate 1.20% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.74% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000003s : 13: predicate.reshape_eliminate 1.15% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000002s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000002s : 8: predicate.special_op_eliminate 0.76% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.11% : 0.000004s : 20: predicate.switch_defer_inline 1.76% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.39% : 0.000012s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.14% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.65% : 0.000009s : 23: predicate.tuple_list_get_item_eliminator 1.81% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.43% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.39% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004203 25 57.59% : 0.002420s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000111s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.77% : 0.001671s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.909824 72 0.01% : 0.000078s : 1: add_recomputation 0.01% : 0.000103s : 1: auto_monad 0.00% : 0.000023s : 1: auto_monad_reorder 0.05% : 0.000455s : 1: bootstrap 0.00% : 0.000043s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.00% : 0.000034s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.00% : 0.000042s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 7.68% : 0.069917s : 1: jit_opt_a 0.03% : 0.000289s : 1: jit_opt_after_cconv 0.01% : 0.000086s : 1: jit_opt_b 4.52% : 0.041155s : 1: loop_unroll 0.14% : 0.001313s : 1: mutable_eliminate 0.16% : 0.001413s : 26: opt.transform.jit_opt_a 0.01% : 0.000098s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000059s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000034s : 1: opt.transform.mutable_eliminate 0.00% : 0.000044s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.11% : 0.001000s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000008s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.001065s : 1: py_interpret_to_execute 0.00% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000029s : 1: remove_dup_value 0.44% : 0.004024s : 1: renormalize.infer 0.19% : 0.001740s : 1: renormalize.specialize 0.00% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000061s : 1: rewriter_after_opt_a 0.02% : 0.000163s : 1: rewriter_before_opt_a 0.01% : 0.000113s : 1: symbol_engine_optimizer 86.42% : 0.786231s : 1: type_inference TotalTime = 0.0708526, [30] [bootstrap]: 0.00036419 [type_inference]: 0.0486525 [event_method]: 2.467e-05 [auto_monad]: 7.939e-05 [graph_reusing]: 7.55e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.00011651 [rewriter_before_opt_a]: 9.559e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00628649, [2] [Cycle 1]: 0.00209607, [27] [switch_simplify]: 6.396e-05 [loop_unroll]: 2.943e-05 [a_1]: 0.00058565 [with_stream_mark]: 2.52e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.22997e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.58998e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.28002e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.061e-05 [inline_without_move]: 5.30001e-06 [renormalize]: 0.00103016 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 3.662e-05 [replace_applicator]: 1.526e-05 [Cycle 2]: 0.00034071, [27] [switch_simplify]: 5.81e-06 [loop_unroll]: 5.00001e-06 [a_1]: 8.98e-05 [with_stream_mark]: 1.346e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.09e-06 [meta_shard_fg_expand]: 1.31998e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 2.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 8.63001e-06 [cse]: 1.518e-05 [replace_applicator]: 5.71003e-06 [py_interpret_to_execute_after_opt_a]: 1.627e-05 [rewriter_after_opt_a]: 0.0122364 [convert_after_rewriter]: 1.137e-05 [order_py_execute_after_rewriter]: 6.11e-06 [mutable_eliminate]: 0.00087782 [jit_opt_b]: 6.442e-05, [1] [Cycle 1]: 5.295e-05, [2] [frontend_op_eliminate]: 1.787e-05 [inline_after_opt_a]: 2.133e-05 [cconv]: 4.158e-05 [loop_unroll]: 0.00054193 [jit_opt_after_cconv]: 0.0002036, [1] [Cycle 1]: 0.00019388, [11] [c_1]: 2.22e-05 [parameter_eliminate]: 5.84e-06 [updatestate_depend_eliminate]: 1.112e-05 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 3.26999e-06 [cse]: 4.842e-05 [call_graph_tuple_transform]: 2.798e-05 [tuple_list_get_item_eliminator]: 6.55002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 2.225e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 9.04998e-06 [add_recomputation]: 6.408e-05 [cse_after_recomputation]: 2.983e-05, [1] [Cycle 1]: 2.215e-05, [1] [cse]: 1.52e-05 [auto_monad_reorder]: 1.946e-05 [get_jit_bprop_graph]: 2.77002e-06 [rewriter_after_jit_bprop_graph]: 8.90999e-06 [opt_after_jit_grad]: 0.00058943 [symbol_engine_optimizer]: 0.00014226, [1] [Cycle 1]: 0.00013248, [6] [build]: 5.07999e-06 [elim_shapecalc]: 7.06001e-06 [elim_not_effective]: 6.932e-05 [opt_reshape]: 6.88e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 7.39994e-07 [validate]: 5.306e-05 Sums bootstrap : 0.000364s : 0.55% type_inference : 0.048653s : 73.41% event_method : 0.000025s : 0.04% auto_monad : 0.000079s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000117s : 0.18% rewriter_before_opt_a : 0.000096s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.11% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000675s : 1.02% jit_opt_a.with_stream_mark : 0.000039s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001030s : 1.55% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.04% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.012236s : 18.46% convert_after_rewriter : 0.000011s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000878s : 1.32% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000042s : 0.06% loop_unroll : 0.000542s : 0.82% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000022s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000064s : 0.10% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000589s : 0.89% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000069s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.08% Time group info: ------[substitution.] 0.000258 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000007s : 3: substitution.graph_param_transform 84.82% : 0.000219s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.28% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048550 2 96.12% : 0.046664s : 1: type_inference.infer 3.88% : 0.001886s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.62% : 0.000051s : 4: replace.inline 30.38% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.52% : 0.000216s : 4: match.inline 5.48% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 1.57% : 0.000002s : 10: predicate.arithmetic_simplify 1.07% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.83% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.44% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.26% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 3.50% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 3.14% : 0.000004s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.75% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.37% : 0.000002s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.10% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.16% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.10% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001036 13 48.37% : 0.000501s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.25% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.39% : 0.000481s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072856 72 0.09% : 0.000068s : 1: add_recomputation 0.12% : 0.000086s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.54% : 0.000390s : 1: bootstrap 0.06% : 0.000044s : 1: cconv 0.02% : 0.000017s : 1: convert_after_rewriter 0.04% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000032s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 8.63% : 0.006290s : 1: jit_opt_a 0.28% : 0.000207s : 1: jit_opt_after_cconv 0.09% : 0.000068s : 1: jit_opt_b 0.76% : 0.000554s : 1: loop_unroll 1.23% : 0.000893s : 1: mutable_eliminate 1.24% : 0.000904s : 26: opt.transform.jit_opt_a 0.08% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000027s : 1: opt.transform.mutable_eliminate 0.04% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000601s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000123s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000025s : 1: remove_dup_value 0.82% : 0.000594s : 1: renormalize.infer 0.59% : 0.000427s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 16.83% : 0.012260s : 1: rewriter_after_opt_a 0.14% : 0.000102s : 1: rewriter_before_opt_a 0.20% : 0.000146s : 1: symbol_engine_optimizer 66.82% : 0.048683s : 1: type_inference TotalTime = 0.0507202, [30] [bootstrap]: 0.0003507 [type_inference]: 0.0209579 [event_method]: 2.249e-05 [auto_monad]: 7.185e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00011511 [rewriter_before_opt_a]: 8.455e-05 [expand_dump_flag]: 3.59002e-06 [jit_opt_a]: 0.026756, [2] [Cycle 1]: 0.00221864, [27] [switch_simplify]: 6.922e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00060495 [with_stream_mark]: 2.531e-05 [recompute_prepare]: 8.35001e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00107935 [add_forward_monad_depend]: 7.16001e-06 [auto_monad_grad]: 3.4e-06 [auto_monad_eliminator]: 1.943e-05 [cse]: 3.6e-05 [replace_applicator]: 1.743e-05 [Cycle 2]: 0.00034451, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 5.40001e-06 [a_1]: 9.702e-05 [with_stream_mark]: 1.372e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 2.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 8.30999e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.89e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.367e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.626e-05 [rewriter_after_opt_a]: 4.221e-05 [convert_after_rewriter]: 7.29001e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.00065496 [jit_opt_b]: 5.127e-05, [1] [Cycle 1]: 4.325e-05, [2] [frontend_op_eliminate]: 1.529e-05 [inline_after_opt_a]: 1.659e-05 [cconv]: 3.084e-05 [loop_unroll]: 0.0004268 [jit_opt_after_cconv]: 0.00015848, [1] [Cycle 1]: 0.000151, [11] [c_1]: 2.147e-05 [parameter_eliminate]: 3.80998e-06 [updatestate_depend_eliminate]: 7.55e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.43002e-06 [cse]: 2.885e-05 [call_graph_tuple_transform]: 2.071e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 6.64999e-06 [add_recomputation]: 5.531e-05 [cse_after_recomputation]: 3.584e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 7.17002e-06 [opt_after_jit_grad]: 0.00047293 [symbol_engine_optimizer]: 7.574e-05, [1] [Cycle 1]: 6.864e-05, [6] [build]: 4.22e-06 [elim_shapecalc]: 7.98001e-06 [elim_not_effective]: 1.382e-05 [opt_reshape]: 6.08998e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 5.69999e-07 [validate]: 4.365e-05 Sums bootstrap : 0.000351s : 1.36% type_inference : 0.020958s : 81.11% event_method : 0.000022s : 0.09% auto_monad : 0.000072s : 0.28% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000115s : 0.45% rewriter_before_opt_a : 0.000085s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.29% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000702s : 2.72% jit_opt_a.with_stream_mark : 0.000039s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001079s : 4.18% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000005s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000023s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000042s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000655s : 2.53% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000031s : 0.12% loop_unroll : 0.000427s : 1.65% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000473s : 1.83% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.17% Time group info: ------[substitution.] 0.000263 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.06% : 0.000005s : 3: substitution.graph_param_transform 86.43% : 0.000228s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020868 2 92.45% : 0.019293s : 1: type_inference.infer 7.55% : 0.001575s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.44% : 0.000055s : 4: replace.inline 29.56% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 94.80% : 0.000225s : 4: match.inline 5.20% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.63% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.85% : 0.000002s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.76% : 0.000001s : 3: predicate.opt_reshape 2.49% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.12% : 0.000010s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.90% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000882 13 45.23% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.66% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.12% : 0.000424s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052782 72 0.11% : 0.000059s : 1: add_recomputation 0.14% : 0.000075s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.71% : 0.000372s : 1: bootstrap 0.06% : 0.000033s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000038s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 50.70% : 0.026760s : 1: jit_opt_a 0.31% : 0.000161s : 1: jit_opt_after_cconv 0.10% : 0.000054s : 1: jit_opt_b 0.82% : 0.000435s : 1: loop_unroll 1.27% : 0.000669s : 1: mutable_eliminate 1.79% : 0.000945s : 26: opt.transform.jit_opt_a 0.10% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000119s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.19% : 0.000626s : 1: renormalize.infer 0.84% : 0.000443s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.17% : 0.000088s : 1: rewriter_before_opt_a 0.15% : 0.000078s : 1: symbol_engine_optimizer 39.76% : 0.020985s : 1: type_inference TotalTime = 0.288191, [30] [bootstrap]: 0.00075225 [type_inference]: 0.246373 [event_method]: 3.294e-05 [auto_monad]: 9.618e-05 [graph_reusing]: 7.55998e-06 [pre_auto_parallel]: 3.2e-06 [py_interpret_to_execute]: 0.00051027 [rewriter_before_opt_a]: 0.00012489 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.0340447, [2] [Cycle 1]: 0.0258161, [27] [switch_simplify]: 0.00010328 [loop_unroll]: 3.824e-05 [a_1]: 0.00204279 [with_stream_mark]: 3.739e-05 [recompute_prepare]: 1.988e-05 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.94001e-06 [specialize_transform]: 1.005e-05 [updatestate_useless_node_eliminater]: 7.74002e-06 [accelerated_algorithm]: 1.023e-05 [meta_shard_fg_expand]: 6.73998e-06 [get_grad_eliminate_]: 1.109e-05 [merge_forward]: 5.05999e-06 [cell_reuse_recompute_pass]: 2.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.422e-05 [j_node_and_user_rematch]: 1.754e-05 [meta_fg_expand]: 4.03999e-06 [replace_old_param]: 1.75e-05 [inline_without_move]: 9.74999e-06 [renormalize]: 0.0219283 [add_forward_monad_depend]: 1.702e-05 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 0.00092838 [cse]: 0.00012692 [replace_applicator]: 4.701e-05 [Cycle 2]: 0.00084513, [27] [switch_simplify]: 1.097e-05 [loop_unroll]: 1.224e-05 [a_1]: 0.0002965 [with_stream_mark]: 3.333e-05 [recompute_prepare]: 1.422e-05 [updatestate_depend_eliminate]: 7.08998e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.35998e-06 [parameter_eliminate]: 4.07e-06 [specialize_transform]: 9.86998e-06 [updatestate_useless_node_eliminater]: 8.37e-06 [accelerated_algorithm]: 1.44e-05 [meta_shard_fg_expand]: 5.64998e-06 [get_grad_eliminate_]: 1.239e-05 [merge_forward]: 6.36998e-06 [cell_reuse_recompute_pass]: 6.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.791e-05 [j_node_and_user_rematch]: 1.703e-05 [meta_fg_expand]: 5.97001e-06 [replace_old_param]: 1.594e-05 [inline_without_move]: 9.09998e-06 [renormalize]: 5.10016e-07 [add_forward_monad_depend]: 7.29001e-06 [auto_monad_grad]: 3.78999e-06 [auto_monad_eliminator]: 1.688e-05 [cse]: 4.307e-05 [replace_applicator]: 1.53e-05 [py_interpret_to_execute_after_opt_a]: 5.335e-05 [rewriter_after_opt_a]: 8.936e-05 [convert_after_rewriter]: 1.608e-05 [order_py_execute_after_rewriter]: 5.81e-06 [mutable_eliminate]: 0.00248156 [jit_opt_b]: 9.149e-05, [1] [Cycle 1]: 7.887e-05, [2] [frontend_op_eliminate]: 3.23e-05 [inline_after_opt_a]: 2.99e-05 [cconv]: 4.902e-05 [loop_unroll]: 0.00103994 [jit_opt_after_cconv]: 0.00029582, [1] [Cycle 1]: 0.00028364, [11] [c_1]: 3.997e-05 [parameter_eliminate]: 8.85999e-06 [updatestate_depend_eliminate]: 1.484e-05 [updatestate_assign_eliminate]: 4.70999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [cse]: 6.909e-05 [call_graph_tuple_transform]: 4.052e-05 [tuple_list_get_item_eliminator]: 1.162e-05 [none_parameter_eliminate]: 2.34001e-06 [renormalize]: 1.40001e-06 [switch_simplify]: 9.25999e-06 [remove_dup_value]: 3.025e-05 [partial_unused_args_eliminate]: 3.58999e-06 [environ_conv]: 1.668e-05 [add_recomputation]: 8.424e-05 [cse_after_recomputation]: 4.802e-05, [1] [Cycle 1]: 3.709e-05, [1] [cse]: 2.53e-05 [auto_monad_reorder]: 2.35e-05 [get_jit_bprop_graph]: 2.71999e-06 [rewriter_after_jit_bprop_graph]: 1.368e-05 [opt_after_jit_grad]: 0.00107407 [symbol_engine_optimizer]: 0.00012038, [1] [Cycle 1]: 0.00010949, [6] [build]: 9.05999e-06 [elim_shapecalc]: 1.485e-05 [elim_not_effective]: 2.695e-05 [opt_reshape]: 8.13999e-06 [fold_const_symbol]: 1.273e-05 [renormalize]: 1.29e-06 [validate]: 0.00010436 Sums bootstrap : 0.000752s : 0.27% type_inference : 0.246373s : 88.17% event_method : 0.000033s : 0.01% auto_monad : 0.000096s : 0.03% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000510s : 0.18% rewriter_before_opt_a : 0.000125s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000114s : 0.04% jit_opt_a.loop_unroll : 0.000050s : 0.02% jit_opt_a.a_1 : 0.002339s : 0.84% jit_opt_a.with_stream_mark : 0.000071s : 0.03% jit_opt_a.recompute_prepare : 0.000034s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000020s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.01% jit_opt_a.accelerated_algorithm : 0.000025s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000012s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000009s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000062s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000035s : 0.01% jit_opt_a.meta_fg_expand : 0.000010s : 0.00% jit_opt_a.replace_old_param : 0.000033s : 0.01% jit_opt_a.inline_without_move : 0.000019s : 0.01% jit_opt_a.renormalize : 0.021929s : 7.85% jit_opt_a.add_forward_monad_depend : 0.000024s : 0.01% jit_opt_a.auto_monad_grad : 0.000007s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000945s : 0.34% jit_opt_a.cse : 0.000170s : 0.06% jit_opt_a.replace_applicator : 0.000062s : 0.02% py_interpret_to_execute_after_opt_a : 0.000053s : 0.02% rewriter_after_opt_a : 0.000089s : 0.03% convert_after_rewriter : 0.000016s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.002482s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000032s : 0.01% jit_opt_b.inline_after_opt_a : 0.000030s : 0.01% cconv : 0.000049s : 0.02% loop_unroll : 0.001040s : 0.37% jit_opt_after_cconv.c_1 : 0.000040s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000069s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000041s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000012s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000030s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000017s : 0.01% add_recomputation : 0.000084s : 0.03% cse_after_recomputation.cse : 0.000025s : 0.01% auto_monad_reorder : 0.000024s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.00% opt_after_jit_grad : 0.001074s : 0.38% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000015s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000104s : 0.04% Time group info: ------[substitution.] 0.001365 25 0.21% : 0.000003s : 2: substitution.elim_not_effective 0.22% : 0.000003s : 2: substitution.fold_const_symbol 0.60% : 0.000008s : 4: substitution.graph_param_transform 95.28% : 0.001300s : 5: substitution.inline 0.69% : 0.000009s : 4: substitution.j_node_and_user_rematch 0.59% : 0.000008s : 4: substitution.remove_not_recompute_node 0.86% : 0.000012s : 2: substitution.replace_old_param 1.56% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.246207 2 98.10% : 0.241536s : 1: type_inference.infer 1.90% : 0.004671s : 1: type_inference.specialize ------[replace.] 0.000211 7 69.17% : 0.000146s : 5: replace.inline 30.83% : 0.000065s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000452 7 95.75% : 0.000433s : 5: match.inline 4.25% : 0.000019s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000328 888 1.35% : 0.000004s : 13: predicate.accumulaten_eliminater 1.38% : 0.000005s : 4: predicate.ad_related_special_op_eliminate 0.72% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000005s : 13: predicate.addn_zero_filter 18.37% : 0.000060s : 13: predicate.arithmetic_simplify 1.34% : 0.000004s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 0.64% : 0.000002s : 13: predicate.compare_switch_simplify 0.89% : 0.000003s : 13: predicate.depend_value_elim 0.56% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.85% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.04% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.19% : 0.000001s : 4: predicate.elim_not_effective 0.40% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000004s : 13: predicate.environ_add_const_eliminate 0.62% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.72% : 0.000002s : 13: predicate.environ_get_depend_swap 0.76% : 0.000003s : 13: predicate.environ_get_eliminate 0.70% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000001s : 4: predicate.fold_const_symbol 1.29% : 0.000004s : 8: predicate.get_grad_eliminate 0.12% : 0.000000s : 4: predicate.graph_param_transform 4.37% : 0.000014s : 28: predicate.inline 0.58% : 0.000002s : 8: predicate.inline_without_move 0.18% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.31% : 0.000008s : 8: predicate.less_batch_normalization 1.40% : 0.000005s : 15: predicate.list_to_tuple_eliminator_ 1.54% : 0.000005s : 19: predicate.load_eliminater 1.53% : 0.000005s : 4: predicate.loop_unroll_after_grad 2.55% : 0.000008s : 41: predicate.loop_unroll_before_grad 1.55% : 0.000005s : 17: predicate.make_slice_get_slice_eliminator 0.67% : 0.000002s : 13: predicate.merge_addn 0.61% : 0.000002s : 13: predicate.minmaximum_grad 2.43% : 0.000008s : 4: predicate.mutable_eliminate 0.27% : 0.000001s : 4: predicate.opt_reshape 1.30% : 0.000004s : 19: predicate.partial_eliminate 0.88% : 0.000003s : 13: predicate.print_const_string_wrapper 3.14% : 0.000010s : 13: predicate.reduce_eliminate 1.20% : 0.000004s : 15: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 8: predicate.remove_not_recompute_node 1.28% : 0.000004s : 23: predicate.replace_applicator 0.45% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000004s : 13: predicate.reshape_eliminate 1.36% : 0.000004s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000002s : 4: predicate.row_tensor_eliminate 1.35% : 0.000004s : 13: predicate.same_eliminate 0.40% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000003s : 8: predicate.special_op_eliminate 0.72% : 0.000002s : 8: predicate.specialize_transform 1.17% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 2.02% : 0.000007s : 13: predicate.stack_unstack_eliminate 0.25% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.64% : 0.000009s : 20: predicate.switch_defer_inline 1.21% : 0.000004s : 20: predicate.switch_layer_defer_inline 4.65% : 0.000015s : 65: predicate.switch_simplify 1.29% : 0.000004s : 13: predicate.tile_eliminate 1.24% : 0.000004s : 13: predicate.transpose_eliminate 1.01% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 0.74% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000011s : 23: predicate.tuple_list_get_item_eliminator 1.86% : 0.000006s : 13: predicate.tuple_list_set_item_eliminator 1.25% : 0.000004s : 15: predicate.tuple_to_list_eliminator_ 1.29% : 0.000004s : 19: predicate.updatestate_pure_node_eliminater 1.43% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 2.60% : 0.000009s : 13: predicate.value_based_eliminate 0.14% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.019898 25 12.67% : 0.002520s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.66% : 0.000131s : 2: func_graph_cloner_run.FuncGraphClonerNode 86.68% : 0.017247s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.312772 72 0.03% : 0.000090s : 1: add_recomputation 0.03% : 0.000100s : 1: auto_monad 0.01% : 0.000027s : 1: auto_monad_reorder 0.25% : 0.000787s : 1: bootstrap 0.02% : 0.000052s : 1: cconv 0.01% : 0.000020s : 1: convert_after_rewriter 0.02% : 0.000051s : 1: cse_after_recomputation 0.01% : 0.000020s : 1: environ_conv 0.01% : 0.000039s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 10.89% : 0.034053s : 1: jit_opt_a 0.10% : 0.000301s : 1: jit_opt_after_cconv 0.03% : 0.000096s : 1: jit_opt_b 0.34% : 0.001064s : 1: loop_unroll 0.80% : 0.002511s : 1: mutable_eliminate 0.89% : 0.002769s : 26: opt.transform.jit_opt_a 0.03% : 0.000095s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000052s : 4: opt.transform.jit_opt_b 0.01% : 0.000037s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000048s : 1: opt.transform.mutable_eliminate 0.02% : 0.000060s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000059s : 4: opt.transform.symbol_engine_opt 0.35% : 0.001097s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000518s : 1: py_interpret_to_execute 0.02% : 0.000061s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000034s : 1: remove_dup_value 0.94% : 0.002953s : 1: renormalize.infer 6.06% : 0.018951s : 1: renormalize.specialize 0.01% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000100s : 1: rewriter_after_opt_a 0.04% : 0.000131s : 1: rewriter_before_opt_a 0.04% : 0.000125s : 1: symbol_engine_optimizer 78.78% : 0.246410s : 1: type_inference TotalTime = 0.0450651, [30] [bootstrap]: 0.00033501 [type_inference]: 0.0352204 [event_method]: 2.124e-05 [auto_monad]: 7.087e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 9.995e-05 [rewriter_before_opt_a]: 8.416e-05 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.00683639, [2] [Cycle 1]: 0.00212425, [27] [switch_simplify]: 6.319e-05 [loop_unroll]: 3.116e-05 [a_1]: 0.00058742 [with_stream_mark]: 2.349e-05 [recompute_prepare]: 7.23e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.018e-05 [j_node_and_user_rematch]: 9.29998e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00104376 [add_forward_monad_depend]: 6.55997e-06 [auto_monad_grad]: 3.19001e-06 [auto_monad_eliminator]: 1.652e-05 [cse]: 3.649e-05 [replace_applicator]: 1.344e-05 [Cycle 2]: 0.00033637, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 5.40999e-06 [a_1]: 9.004e-05 [with_stream_mark]: 1.226e-05 [recompute_prepare]: 5.79999e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.37999e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 6.08998e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.09998e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.16999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 7.91001e-06 [cse]: 1.484e-05 [replace_applicator]: 5.93002e-06 [py_interpret_to_execute_after_opt_a]: 1.404e-05 [rewriter_after_opt_a]: 4.325e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00068758 [jit_opt_b]: 5.111e-05, [1] [Cycle 1]: 4.284e-05, [2] [frontend_op_eliminate]: 1.547e-05 [inline_after_opt_a]: 1.686e-05 [cconv]: 3.235e-05 [loop_unroll]: 0.00044262 [jit_opt_after_cconv]: 0.00015588, [1] [Cycle 1]: 0.00014875, [11] [c_1]: 2.025e-05 [parameter_eliminate]: 3.6e-06 [updatestate_depend_eliminate]: 8.65001e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.968e-05 [call_graph_tuple_transform]: 2.027e-05 [tuple_list_get_item_eliminator]: 5.51998e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 7.40023e-07 [switch_simplify]: 5.51002e-06 [remove_dup_value]: 1.915e-05 [partial_unused_args_eliminate]: 2.94001e-06 [environ_conv]: 7.46001e-06 [add_recomputation]: 5.325e-05 [cse_after_recomputation]: 4.014e-05, [1] [Cycle 1]: 1.749e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.904e-05 [get_jit_bprop_graph]: 2.74001e-06 [rewriter_after_jit_bprop_graph]: 5.97001e-06 [opt_after_jit_grad]: 0.00047727 [symbol_engine_optimizer]: 7.429e-05, [1] [Cycle 1]: 6.685e-05, [6] [build]: 3.43999e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 5.89999e-06 [fold_const_symbol]: 9.27999e-06 [renormalize]: 3.30008e-07 [validate]: 4.928e-05 Sums bootstrap : 0.000335s : 0.84% type_inference : 0.035220s : 87.92% event_method : 0.000021s : 0.05% auto_monad : 0.000071s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000100s : 0.25% rewriter_before_opt_a : 0.000084s : 0.21% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.17% jit_opt_a.loop_unroll : 0.000037s : 0.09% jit_opt_a.a_1 : 0.000677s : 1.69% jit_opt_a.with_stream_mark : 0.000036s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001044s : 2.61% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000051s : 0.13% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000043s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000688s : 1.72% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000032s : 0.08% loop_unroll : 0.000443s : 1.10% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000477s : 1.19% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.12% Time group info: ------[substitution.] 0.000273 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 3: substitution.graph_param_transform 81.36% : 0.000222s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 7.02% : 0.000019s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 4.72% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035136 2 95.53% : 0.033565s : 1: type_inference.infer 4.47% : 0.001571s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.66% : 0.000051s : 4: replace.inline 30.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.93% : 0.000220s : 4: match.inline 5.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.37% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.56% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.38% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.30% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.64% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.27% : 0.000010s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000937 13 49.75% : 0.000466s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.03% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.22% : 0.000414s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047074 72 0.12% : 0.000057s : 1: add_recomputation 0.16% : 0.000074s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.76% : 0.000357s : 1: bootstrap 0.07% : 0.000035s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000042s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.53% : 0.006839s : 1: jit_opt_a 0.34% : 0.000158s : 1: jit_opt_after_cconv 0.11% : 0.000054s : 1: jit_opt_b 0.96% : 0.000452s : 1: loop_unroll 1.48% : 0.000699s : 1: mutable_eliminate 1.95% : 0.000920s : 26: opt.transform.jit_opt_a 0.10% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.03% : 0.000486s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000104s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000022s : 1: remove_dup_value 1.28% : 0.000603s : 1: renormalize.infer 0.92% : 0.000431s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000046s : 1: rewriter_after_opt_a 0.19% : 0.000089s : 1: rewriter_before_opt_a 0.16% : 0.000077s : 1: symbol_engine_optimizer 74.86% : 0.035242s : 1: type_inference TotalTime = 0.0148063, [30] [bootstrap]: 0.00035108 [type_inference]: 0.005268 [event_method]: 1.866e-05 [auto_monad]: 6.52e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.726e-05 [rewriter_before_opt_a]: 7.295e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00538702, [2] [Cycle 1]: 0.00174613, [27] [switch_simplify]: 5.303e-05 [loop_unroll]: 0.00013084 [a_1]: 0.0005311 [with_stream_mark]: 1.974e-05 [recompute_prepare]: 7.75e-06 [updatestate_depend_eliminate]: 3.92998e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.45001e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00068265 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 1.403e-05 [cse]: 3.494e-05 [replace_applicator]: 1.23e-05 [Cycle 2]: 0.00030871, [27] [switch_simplify]: 5.49e-06 [loop_unroll]: 4.79e-06 [a_1]: 8.644e-05 [with_stream_mark]: 8.42e-06 [recompute_prepare]: 4.86002e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.12999e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.50001e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.16e-05 [j_node_and_user_rematch]: 7.55e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.56002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.27001e-06 [cse]: 1.189e-05 [replace_applicator]: 4.80999e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 3.998e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00055779 [jit_opt_b]: 4.772e-05, [1] [Cycle 1]: 4.096e-05, [2] [frontend_op_eliminate]: 1.437e-05 [inline_after_opt_a]: 1.541e-05 [cconv]: 2.747e-05 [loop_unroll]: 0.00041334 [jit_opt_after_cconv]: 0.000149, [1] [Cycle 1]: 0.0001428, [11] [c_1]: 1.968e-05 [parameter_eliminate]: 3.09001e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.212e-05 [call_graph_tuple_transform]: 1.809e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 5.61e-06 [add_recomputation]: 5.076e-05 [cse_after_recomputation]: 2.299e-05, [1] [Cycle 1]: 1.767e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 2.06003e-06 [rewriter_after_jit_bprop_graph]: 4.28001e-06 [opt_after_jit_grad]: 0.00189526 [symbol_engine_optimizer]: 8.002e-05, [1] [Cycle 1]: 7.117e-05, [6] [build]: 4.79e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.513e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 8.82999e-06 [renormalize]: 6.09987e-07 [validate]: 4.645e-05 Sums bootstrap : 0.000351s : 3.23% type_inference : 0.005268s : 48.44% event_method : 0.000019s : 0.17% auto_monad : 0.000065s : 0.60% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.34% rewriter_before_opt_a : 0.000073s : 0.67% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.54% jit_opt_a.loop_unroll : 0.000136s : 1.25% jit_opt_a.a_1 : 0.000618s : 5.68% jit_opt_a.with_stream_mark : 0.000028s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000683s : 6.28% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.18% jit_opt_a.cse : 0.000047s : 0.43% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000040s : 0.37% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000558s : 5.13% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000027s : 0.25% loop_unroll : 0.000413s : 3.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000051s : 0.47% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.001895s : 17.43% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000046s : 0.43% Time group info: ------[substitution.] 0.000210 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 3: substitution.graph_param_transform 84.48% : 0.000177s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 5.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005195 2 82.50% : 0.004286s : 1: type_inference.infer 17.50% : 0.000909s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.60% : 0.000045s : 4: replace.inline 32.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 6 94.20% : 0.000175s : 4: match.inline 5.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.74% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.88% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 2.02% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.80% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000685 13 55.16% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.18% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.66% : 0.000265s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016364 72 0.33% : 0.000054s : 1: add_recomputation 0.42% : 0.000068s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 2.29% : 0.000375s : 1: bootstrap 0.18% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 32.94% : 0.005390s : 1: jit_opt_a 0.93% : 0.000151s : 1: jit_opt_after_cconv 0.31% : 0.000050s : 1: jit_opt_b 2.57% : 0.000420s : 1: loop_unroll 3.46% : 0.000567s : 1: mutable_eliminate 5.06% : 0.000827s : 26: opt.transform.jit_opt_a 0.28% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.19% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000034s : 4: opt.transform.symbol_engine_opt 11.67% : 0.001910s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.33% : 0.000381s : 1: renormalize.infer 1.79% : 0.000294s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000043s : 1: rewriter_after_opt_a 0.46% : 0.000076s : 1: rewriter_before_opt_a 0.51% : 0.000083s : 1: symbol_engine_optimizer 32.30% : 0.005286s : 1: type_inference TotalTime = 0.0335495, [30] [bootstrap]: 0.00033824 [type_inference]: 0.0246893 [event_method]: 2.401e-05 [auto_monad]: 7.628e-05 [graph_reusing]: 6.05002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00010616 [rewriter_before_opt_a]: 8.203e-05 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.00588737, [2] [Cycle 1]: 0.0020278, [27] [switch_simplify]: 7.525e-05 [loop_unroll]: 2.943e-05 [a_1]: 0.00057198 [with_stream_mark]: 2.615e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.97e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 8.76997e-06 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 1.023e-05 [inline_without_move]: 5.39e-06 [renormalize]: 0.00097248 [add_forward_monad_depend]: 5.97001e-06 [auto_monad_grad]: 3.28998e-06 [auto_monad_eliminator]: 1.506e-05 [cse]: 3.863e-05 [replace_applicator]: 1.336e-05 [Cycle 2]: 0.00032042, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.45001e-06 [a_1]: 8.918e-05 [with_stream_mark]: 9.79e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 2.63998e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.304e-05 [j_node_and_user_rematch]: 8.08999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.73001e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 6.28998e-06 [cse]: 1.343e-05 [replace_applicator]: 5.29998e-06 [py_interpret_to_execute_after_opt_a]: 1.301e-05 [rewriter_after_opt_a]: 4.152e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00060061 [jit_opt_b]: 5.275e-05, [1] [Cycle 1]: 4.468e-05, [2] [frontend_op_eliminate]: 1.539e-05 [inline_after_opt_a]: 1.777e-05 [cconv]: 2.77e-05 [loop_unroll]: 0.00044941 [jit_opt_after_cconv]: 0.00015914, [1] [Cycle 1]: 0.00014422, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 6.89001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.586e-05 [call_graph_tuple_transform]: 2.039e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.639e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.67002e-06 [add_recomputation]: 5.43e-05 [cse_after_recomputation]: 2.462e-05, [1] [Cycle 1]: 1.888e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.759e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00053964 [symbol_engine_optimizer]: 7.486e-05, [1] [Cycle 1]: 6.803e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.44e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 4.09986e-07 [validate]: 4.508e-05 Sums bootstrap : 0.000338s : 1.15% type_inference : 0.024689s : 83.97% event_method : 0.000024s : 0.08% auto_monad : 0.000076s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.36% rewriter_before_opt_a : 0.000082s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000661s : 2.25% jit_opt_a.with_stream_mark : 0.000036s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000973s : 3.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000601s : 2.04% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000028s : 0.09% loop_unroll : 0.000449s : 1.53% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000054s : 0.18% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000540s : 1.84% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.15% Time group info: ------[substitution.] 0.000248 23 1.23% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 85.39% : 0.000212s : 4: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 5.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024548 2 93.75% : 0.023014s : 1: type_inference.infer 6.25% : 0.001534s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.08% : 0.000047s : 4: replace.inline 32.92% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.59% : 0.000209s : 4: match.inline 5.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.40% : 0.000002s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.23% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.83% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.06% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.54% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000869 13 48.05% : 0.000417s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.18% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.77% : 0.000398s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035466 72 0.16% : 0.000057s : 1: add_recomputation 0.22% : 0.000080s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.01% : 0.000360s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.61% : 0.005891s : 1: jit_opt_a 0.46% : 0.000162s : 1: jit_opt_after_cconv 0.16% : 0.000056s : 1: jit_opt_b 1.29% : 0.000458s : 1: loop_unroll 1.72% : 0.000609s : 1: mutable_eliminate 2.53% : 0.000896s : 26: opt.transform.jit_opt_a 0.14% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000548s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000110s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.63% : 0.000577s : 1: renormalize.infer 1.09% : 0.000387s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000045s : 1: rewriter_after_opt_a 0.24% : 0.000086s : 1: rewriter_before_opt_a 0.22% : 0.000078s : 1: symbol_engine_optimizer 69.67% : 0.024710s : 1: type_inference TotalTime = 0.0147903, [30] [bootstrap]: 0.00036838 [type_inference]: 0.00564384 [event_method]: 1.916e-05 [auto_monad]: 7.226e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 3.943e-05 [rewriter_before_opt_a]: 7.676e-05 [expand_dump_flag]: 3.00998e-06 [jit_opt_a]: 0.00619093, [2] [Cycle 1]: 0.00191826, [27] [switch_simplify]: 6.387e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00059384 [with_stream_mark]: 9.034e-05 [recompute_prepare]: 9.15999e-06 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 8.81002e-06 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.54999e-06 [inline_without_move]: 5.24e-06 [renormalize]: 0.00078419 [add_forward_monad_depend]: 6.57002e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.528e-05 [cse]: 3.669e-05 [replace_applicator]: 1.265e-05 [Cycle 2]: 0.0003201, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 5.07e-06 [a_1]: 8.63e-05 [with_stream_mark]: 9.55001e-06 [recompute_prepare]: 5.26998e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 4.63999e-06 [accelerated_algorithm]: 5.11002e-06 [meta_shard_fg_expand]: 1.04e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.44e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.16999e-06 [inline_without_move]: 4.72e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.66999e-06 [cse]: 1.304e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 1.501e-05 [rewriter_after_opt_a]: 4.008e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00068458 [jit_opt_b]: 5.293e-05, [1] [Cycle 1]: 4.422e-05, [2] [frontend_op_eliminate]: 1.584e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 3.039e-05 [loop_unroll]: 0.0004514 [jit_opt_after_cconv]: 0.00017146, [1] [Cycle 1]: 0.00016491, [11] [c_1]: 2.204e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 2.059e-05 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 2.775e-05 [call_graph_tuple_transform]: 2.056e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 2.15002e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 5.45001e-06 [remove_dup_value]: 1.703e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 7.13998e-06 [add_recomputation]: 5.374e-05 [cse_after_recomputation]: 2.35e-05, [1] [Cycle 1]: 1.8e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.812e-05 [get_jit_bprop_graph]: 2.23998e-06 [rewriter_after_jit_bprop_graph]: 5.65001e-06 [opt_after_jit_grad]: 0.00047503 [symbol_engine_optimizer]: 7.272e-05, [1] [Cycle 1]: 6.621e-05, [6] [build]: 4.50999e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.255e-05 [opt_reshape]: 5.62999e-06 [fold_const_symbol]: 8.51002e-06 [renormalize]: 4.19997e-07 [validate]: 4.424e-05 Sums bootstrap : 0.000368s : 3.60% type_inference : 0.005644s : 55.16% event_method : 0.000019s : 0.19% auto_monad : 0.000072s : 0.71% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.39% rewriter_before_opt_a : 0.000077s : 0.75% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.68% jit_opt_a.loop_unroll : 0.000034s : 0.34% jit_opt_a.a_1 : 0.000680s : 6.65% jit_opt_a.with_stream_mark : 0.000100s : 0.98% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000784s : 7.66% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.21% jit_opt_a.cse : 0.000050s : 0.49% jit_opt_a.replace_applicator : 0.000018s : 0.17% py_interpret_to_execute_after_opt_a : 0.000015s : 0.15% rewriter_after_opt_a : 0.000040s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000685s : 6.69% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000030s : 0.30% loop_unroll : 0.000451s : 4.41% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000021s : 0.20% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000028s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000054s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000018s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000475s : 4.64% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.43% Time group info: ------[substitution.] 0.000254 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 86.16% : 0.000219s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005568 2 83.25% : 0.004635s : 1: type_inference.infer 16.75% : 0.000933s : 1: type_inference.specialize ------[replace.] 0.000074 6 65.86% : 0.000048s : 4: replace.inline 34.14% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.75% : 0.000216s : 4: match.inline 5.25% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.26% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.92% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.26% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.47% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.22% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.11% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000745 13 54.75% : 0.000408s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.83% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.42% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016528 72 0.34% : 0.000057s : 1: add_recomputation 0.46% : 0.000075s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 2.36% : 0.000390s : 1: bootstrap 0.20% : 0.000033s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.48% : 0.006194s : 1: jit_opt_a 1.05% : 0.000174s : 1: jit_opt_after_cconv 0.34% : 0.000056s : 1: jit_opt_b 2.78% : 0.000460s : 1: loop_unroll 4.21% : 0.000696s : 1: mutable_eliminate 5.48% : 0.000906s : 26: opt.transform.jit_opt_a 0.31% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.92% : 0.000483s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000042s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.64% : 0.000436s : 1: renormalize.infer 2.06% : 0.000341s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000043s : 1: rewriter_after_opt_a 0.49% : 0.000080s : 1: rewriter_before_opt_a 0.45% : 0.000075s : 1: symbol_engine_optimizer 34.27% : 0.005664s : 1: type_inference TotalTime = 0.0996621, [30] [bootstrap]: 0.0004101 [type_inference]: 0.0893346 [event_method]: 2.657e-05 [auto_monad]: 8.279e-05 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 6.391e-05 [rewriter_before_opt_a]: 9.453e-05 [expand_dump_flag]: 4.1e-06 [jit_opt_a]: 0.00719896, [2] [Cycle 1]: 0.00227309, [27] [switch_simplify]: 6.952e-05 [loop_unroll]: 3.534e-05 [a_1]: 0.00071746 [with_stream_mark]: 2.522e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.68997e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00105072 [add_forward_monad_depend]: 1.171e-05 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.652e-05 [cse]: 4.372e-05 [replace_applicator]: 1.519e-05 [Cycle 2]: 0.00033257, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.54e-06 [a_1]: 9.336e-05 [with_stream_mark]: 9.84999e-06 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.31999e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.429e-05 [replace_applicator]: 5.47999e-06 [py_interpret_to_execute_after_opt_a]: 1.579e-05 [rewriter_after_opt_a]: 4.207e-05 [convert_after_rewriter]: 7.5e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00068584 [jit_opt_b]: 5.525e-05, [1] [Cycle 1]: 4.706e-05, [2] [frontend_op_eliminate]: 1.784e-05 [inline_after_opt_a]: 1.707e-05 [cconv]: 3.137e-05 [loop_unroll]: 0.00044222 [jit_opt_after_cconv]: 0.00017098, [1] [Cycle 1]: 0.00016454, [11] [c_1]: 2.065e-05 [parameter_eliminate]: 3.26001e-06 [updatestate_depend_eliminate]: 7.98001e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 3.135e-05 [call_graph_tuple_transform]: 1.949e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 4.556e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 5.583e-05 [cse_after_recomputation]: 2.591e-05, [1] [Cycle 1]: 1.987e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 1.898e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 6.14999e-06 [opt_after_jit_grad]: 0.00047103 [symbol_engine_optimizer]: 7.594e-05, [1] [Cycle 1]: 6.939e-05, [6] [build]: 4.35999e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 4.00003e-07 [validate]: 4.717e-05 Sums bootstrap : 0.000410s : 0.43% type_inference : 0.089335s : 94.63% event_method : 0.000027s : 0.03% auto_monad : 0.000083s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000064s : 0.07% rewriter_before_opt_a : 0.000095s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.08% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000811s : 0.86% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001051s : 1.11% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000058s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000686s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000442s : 0.47% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000046s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000471s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.05% Time group info: ------[substitution.] 0.000308 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.86% : 0.000006s : 3: substitution.graph_param_transform 88.34% : 0.000272s : 5: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.46% : 0.000004s : 2: substitution.replace_old_param 4.55% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.089224 2 98.39% : 0.087787s : 1: type_inference.infer 1.61% : 0.001437s : 1: type_inference.specialize ------[replace.] 0.000105 7 66.88% : 0.000070s : 5: replace.inline 33.12% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000282 7 95.42% : 0.000269s : 5: match.inline 4.58% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.17% : 0.000001s : 11: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 2.28% : 0.000003s : 11: predicate.arithmetic_simplify 1.66% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 11: predicate.environ_get_depend_swap 1.15% : 0.000001s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.44% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 2.23% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.85% : 0.000002s : 11: predicate.reduce_eliminate 1.70% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 11: predicate.reshape_eliminate 1.38% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.23% : 0.000002s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.08% : 0.000010s : 59: predicate.switch_simplify 1.23% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.31% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001028 16 45.19% : 0.000465s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.50% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.31% : 0.000476s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.101807 72 0.06% : 0.000059s : 1: add_recomputation 0.08% : 0.000086s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.43% : 0.000442s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000032s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.07% : 0.007203s : 1: jit_opt_a 0.17% : 0.000174s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.44% : 0.000451s : 1: loop_unroll 0.69% : 0.000697s : 1: mutable_eliminate 1.03% : 0.001050s : 26: opt.transform.jit_opt_a 0.05% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000067s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000049s : 1: remove_dup_value 0.62% : 0.000635s : 1: renormalize.infer 0.40% : 0.000406s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.10% : 0.000098s : 1: rewriter_before_opt_a 0.08% : 0.000078s : 1: symbol_engine_optimizer 87.78% : 0.089368s : 1: type_inference TotalTime = 0.05006, [30] [bootstrap]: 0.00120688 [type_inference]: 0.0403683 [event_method]: 2.159e-05 [auto_monad]: 7.39e-05 [graph_reusing]: 6.48003e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00030915 [rewriter_before_opt_a]: 9.081e-05 [expand_dump_flag]: 4.39998e-06 [jit_opt_a]: 0.00569981, [2] [Cycle 1]: 0.00211848, [27] [switch_simplify]: 5.583e-05 [loop_unroll]: 2.932e-05 [a_1]: 0.00081588 [with_stream_mark]: 2.196e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.63e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.48002e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00085879 [add_forward_monad_depend]: 5.31998e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.426e-05 [cse]: 3.581e-05 [replace_applicator]: 1.211e-05 [Cycle 2]: 0.00030878, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.25999e-06 [a_1]: 8.811e-05 [with_stream_mark]: 8.57e-06 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.162e-05 [j_node_and_user_rematch]: 7.77002e-06 [meta_fg_expand]: 1.56998e-06 [replace_old_param]: 6.91001e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.175e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.063e-05 [rewriter_after_opt_a]: 3.854e-05 [convert_after_rewriter]: 6.68998e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00054572 [jit_opt_b]: 5.05e-05, [1] [Cycle 1]: 4.218e-05, [2] [frontend_op_eliminate]: 1.557e-05 [inline_after_opt_a]: 1.588e-05 [cconv]: 2.735e-05 [loop_unroll]: 0.00045842 [jit_opt_after_cconv]: 0.00015547, [1] [Cycle 1]: 0.00014889, [11] [c_1]: 2.07e-05 [parameter_eliminate]: 3.83001e-06 [updatestate_depend_eliminate]: 6.97002e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 3.014e-05 [call_graph_tuple_transform]: 1.968e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.70025e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.701e-05 [partial_unused_args_eliminate]: 2.48002e-06 [environ_conv]: 6.48998e-06 [add_recomputation]: 5.51e-05 [cse_after_recomputation]: 2.214e-05, [1] [Cycle 1]: 1.7e-05, [1] [cse]: 1.15e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 7.26001e-06 [opt_after_jit_grad]: 0.00052126 [symbol_engine_optimizer]: 7.173e-05, [1] [Cycle 1]: 6.558e-05, [6] [build]: 2.99001e-06 [elim_shapecalc]: 7.38e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 9.08002e-06 [renormalize]: 3.59985e-07 [validate]: 4.201e-05 Sums bootstrap : 0.001207s : 2.61% type_inference : 0.040368s : 87.42% event_method : 0.000022s : 0.05% auto_monad : 0.000074s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000309s : 0.67% rewriter_before_opt_a : 0.000091s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.13% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000904s : 1.96% jit_opt_a.with_stream_mark : 0.000031s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000859s : 1.86% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000048s : 0.10% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000039s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000546s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000027s : 0.06% loop_unroll : 0.000458s : 0.99% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000521s : 1.13% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.09% Time group info: ------[substitution.] 0.000481 23 0.44% : 0.000002s : 2: substitution.elim_not_effective 0.30% : 0.000001s : 2: substitution.fold_const_symbol 1.22% : 0.000006s : 3: substitution.graph_param_transform 92.95% : 0.000447s : 4: substitution.inline 0.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.86% : 0.000004s : 4: substitution.remove_not_recompute_node 0.91% : 0.000004s : 2: substitution.replace_old_param 2.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040278 2 96.06% : 0.038692s : 1: type_inference.infer 3.94% : 0.001586s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.47% : 0.000053s : 4: replace.inline 30.53% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000456 6 97.47% : 0.000444s : 4: match.inline 2.53% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.00% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.72% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000008s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001067 13 35.60% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 27.94% : 0.000298s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.46% : 0.000389s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052074 72 0.11% : 0.000058s : 1: add_recomputation 0.15% : 0.000079s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 2.36% : 0.001230s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.95% : 0.005703s : 1: jit_opt_a 0.30% : 0.000158s : 1: jit_opt_after_cconv 0.10% : 0.000053s : 1: jit_opt_b 0.89% : 0.000466s : 1: loop_unroll 1.07% : 0.000555s : 1: mutable_eliminate 2.14% : 0.001114s : 26: opt.transform.jit_opt_a 0.09% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.02% : 0.000530s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.62% : 0.000323s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 0.98% : 0.000511s : 1: renormalize.infer 0.65% : 0.000340s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000041s : 1: rewriter_after_opt_a 0.19% : 0.000097s : 1: rewriter_before_opt_a 0.14% : 0.000074s : 1: symbol_engine_optimizer 77.57% : 0.040393s : 1: type_inference TotalTime = 0.0329591, [30] [bootstrap]: 0.00036789 [type_inference]: 0.0171755 [event_method]: 2.649e-05 [auto_monad]: 7.428e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 6.805e-05 [rewriter_before_opt_a]: 9.609e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.0125232, [2] [Cycle 1]: 0.00295202, [27] [switch_simplify]: 7.818e-05 [loop_unroll]: 3.72e-05 [a_1]: 0.00075116 [with_stream_mark]: 2.625e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.71998e-06 [renormalize]: 0.00166841 [add_forward_monad_depend]: 6.82002e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 2.072e-05 [cse]: 4.527e-05 [replace_applicator]: 1.719e-05 [Cycle 2]: 0.0003456, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 5.66e-06 [a_1]: 9.422e-05 [with_stream_mark]: 1.481e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.06002e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 9.06998e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 7.87998e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.518e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 1.498e-05 [rewriter_after_opt_a]: 4.487e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00083048 [jit_opt_b]: 5.547e-05, [1] [Cycle 1]: 4.699e-05, [2] [frontend_op_eliminate]: 1.901e-05 [inline_after_opt_a]: 1.62e-05 [cconv]: 3.406e-05 [loop_unroll]: 0.00045867 [jit_opt_after_cconv]: 0.00016512, [1] [Cycle 1]: 0.00015721, [11] [c_1]: 2.258e-05 [parameter_eliminate]: 3.39001e-06 [updatestate_depend_eliminate]: 8.43001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.448e-05 [call_graph_tuple_transform]: 2.218e-05 [tuple_list_get_item_eliminator]: 5.67001e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.48997e-06 [remove_dup_value]: 4.439e-05 [partial_unused_args_eliminate]: 3.15998e-06 [environ_conv]: 6.19999e-06 [add_recomputation]: 5.857e-05 [cse_after_recomputation]: 2.499e-05, [1] [Cycle 1]: 1.979e-05, [1] [cse]: 1.353e-05 [auto_monad_reorder]: 1.963e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 5.47999e-06 [opt_after_jit_grad]: 0.00049288 [symbol_engine_optimizer]: 7.785e-05, [1] [Cycle 1]: 7.205e-05, [6] [build]: 4.94998e-06 [elim_shapecalc]: 8.02998e-06 [elim_not_effective]: 1.373e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 5.00004e-07 [validate]: 5.184e-05 Sums bootstrap : 0.000368s : 1.59% type_inference : 0.017175s : 74.39% event_method : 0.000026s : 0.11% auto_monad : 0.000074s : 0.32% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000068s : 0.29% rewriter_before_opt_a : 0.000096s : 0.42% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000085s : 0.37% jit_opt_a.loop_unroll : 0.000043s : 0.19% jit_opt_a.a_1 : 0.000845s : 3.66% jit_opt_a.with_stream_mark : 0.000041s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.001668s : 7.23% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.12% jit_opt_a.cse : 0.000060s : 0.26% jit_opt_a.replace_applicator : 0.000022s : 0.10% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000045s : 0.19% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000830s : 3.60% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000034s : 0.15% loop_unroll : 0.000459s : 1.99% jit_opt_after_cconv.c_1 : 0.000023s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000044s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000059s : 0.25% cse_after_recomputation.cse : 0.000014s : 0.06% auto_monad_reorder : 0.000020s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000493s : 2.13% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.22% Time group info: ------[substitution.] 0.000332 24 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000006s : 3: substitution.graph_param_transform 88.41% : 0.000294s : 5: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000006s : 2: substitution.replace_old_param 4.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017087 2 90.86% : 0.015526s : 1: type_inference.infer 9.14% : 0.001562s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.62% : 0.000077s : 5: replace.inline 31.38% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000303 7 95.98% : 0.000291s : 5: match.inline 4.02% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 747 1.19% : 0.000002s : 11: predicate.accumulaten_eliminater 1.17% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.49% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.36% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_depend_swap 1.15% : 0.000001s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.30% : 0.000008s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 16: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.07% : 0.000001s : 11: predicate.minmaximum_grad 2.10% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000002s : 11: predicate.print_const_string_wrapper 1.46% : 0.000002s : 11: predicate.reduce_eliminate 1.39% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 2.05% : 0.000003s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.54% : 0.000002s : 11: predicate.reshape_eliminate 1.21% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.10% : 0.000010s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.13% : 0.000001s : 11: predicate.transpose_eliminate 1.33% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.90% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001215 16 48.97% : 0.000595s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.08% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.96% : 0.000522s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035767 72 0.17% : 0.000062s : 1: add_recomputation 0.22% : 0.000078s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.10% : 0.000393s : 1: bootstrap 0.10% : 0.000037s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.09% : 0.000032s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 35.03% : 0.012529s : 1: jit_opt_a 0.47% : 0.000168s : 1: jit_opt_after_cconv 0.16% : 0.000059s : 1: jit_opt_b 1.31% : 0.000468s : 1: loop_unroll 2.36% : 0.000843s : 1: mutable_eliminate 3.08% : 0.001100s : 26: opt.transform.jit_opt_a 0.15% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000071s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000047s : 1: remove_dup_value 2.28% : 0.000817s : 1: renormalize.infer 2.35% : 0.000839s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000048s : 1: rewriter_after_opt_a 0.28% : 0.000099s : 1: rewriter_before_opt_a 0.23% : 0.000080s : 1: symbol_engine_optimizer 48.09% : 0.017198s : 1: type_inference TotalTime = 0.0170442, [30] [bootstrap]: 0.00048602 [type_inference]: 0.00614285 [event_method]: 2.026e-05 [auto_monad]: 7.024e-05 [graph_reusing]: 5.39e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 3.863e-05 [rewriter_before_opt_a]: 8.018e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.00776767, [2] [Cycle 1]: 0.0031878, [27] [switch_simplify]: 6.668e-05 [loop_unroll]: 2.964e-05 [a_1]: 0.00052694 [with_stream_mark]: 1.827e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.13002e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 8.64e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.00217717 [add_forward_monad_depend]: 1.463e-05 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.875e-05 [cse]: 3.199e-05 [replace_applicator]: 2.341e-05 [Cycle 2]: 0.00034709, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 4.68999e-06 [a_1]: 9.029e-05 [with_stream_mark]: 1.27e-05 [recompute_prepare]: 6.19999e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 4.65001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 2.53003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.794e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 8.68001e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.26e-05 [replace_applicator]: 7.03e-06 [py_interpret_to_execute_after_opt_a]: 1.429e-05 [rewriter_after_opt_a]: 4.042e-05 [convert_after_rewriter]: 8.11002e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00074599 [jit_opt_b]: 5.398e-05, [1] [Cycle 1]: 4.635e-05, [2] [frontend_op_eliminate]: 1.639e-05 [inline_after_opt_a]: 1.696e-05 [cconv]: 3.313e-05 [loop_unroll]: 0.00043637 [jit_opt_after_cconv]: 0.0001617, [1] [Cycle 1]: 0.00015485, [11] [c_1]: 2.186e-05 [parameter_eliminate]: 5.35999e-06 [updatestate_depend_eliminate]: 7.98001e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.999e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 6.24001e-06 [add_recomputation]: 5.194e-05 [cse_after_recomputation]: 2.305e-05, [1] [Cycle 1]: 1.745e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.675e-05 [get_jit_bprop_graph]: 2.26003e-06 [rewriter_after_jit_bprop_graph]: 5.78002e-06 [opt_after_jit_grad]: 0.0004934 [symbol_engine_optimizer]: 7.43e-05, [1] [Cycle 1]: 6.811e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 7.74002e-06 [elim_not_effective]: 1.475e-05 [opt_reshape]: 5.46998e-06 [fold_const_symbol]: 8.31002e-06 [renormalize]: 4.89992e-07 [validate]: 4.461e-05 Sums bootstrap : 0.000486s : 3.99% type_inference : 0.006143s : 50.37% event_method : 0.000020s : 0.17% auto_monad : 0.000070s : 0.58% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000039s : 0.32% rewriter_before_opt_a : 0.000080s : 0.66% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.59% jit_opt_a.loop_unroll : 0.000034s : 0.28% jit_opt_a.a_1 : 0.000617s : 5.06% jit_opt_a.with_stream_mark : 0.000031s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000005s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.002177s : 17.85% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.13% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.21% jit_opt_a.cse : 0.000045s : 0.37% jit_opt_a.replace_applicator : 0.000030s : 0.25% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000040s : 0.33% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000746s : 6.12% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000033s : 0.27% loop_unroll : 0.000436s : 3.58% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000052s : 0.43% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000493s : 4.05% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.37% Time group info: ------[substitution.] 0.000206 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000006s : 3: substitution.graph_param_transform 81.92% : 0.000168s : 4: substitution.inline 2.34% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.62% : 0.000005s : 2: substitution.replace_old_param 6.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006060 2 83.26% : 0.005046s : 1: type_inference.infer 16.74% : 0.001014s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.18% : 0.000047s : 4: replace.inline 31.82% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.53% : 0.000166s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.27% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.07% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 2.32% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 2.15% : 0.000003s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.57% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000775 13 56.18% : 0.000436s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.02% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.80% : 0.000309s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020127 72 0.27% : 0.000055s : 1: add_recomputation 0.37% : 0.000074s : 1: auto_monad 0.09% : 0.000019s : 1: auto_monad_reorder 2.54% : 0.000510s : 1: bootstrap 0.18% : 0.000036s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 38.61% : 0.007772s : 1: jit_opt_a 0.82% : 0.000164s : 1: jit_opt_after_cconv 0.28% : 0.000057s : 1: jit_opt_b 2.21% : 0.000445s : 1: loop_unroll 3.77% : 0.000758s : 1: mutable_eliminate 4.23% : 0.000850s : 26: opt.transform.jit_opt_a 0.24% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000018s : 1: opt.transform.mutable_eliminate 0.12% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.50% : 0.000503s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000041s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000019s : 1: remove_dup_value 9.00% : 0.001812s : 1: renormalize.infer 1.76% : 0.000353s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000044s : 1: rewriter_after_opt_a 0.42% : 0.000084s : 1: rewriter_before_opt_a 0.38% : 0.000077s : 1: symbol_engine_optimizer 30.62% : 0.006163s : 1: type_inference TotalTime = 0.0759746, [30] [bootstrap]: 0.00032266 [type_inference]: 0.0466244 [event_method]: 1.965e-05 [auto_monad]: 7.377e-05 [graph_reusing]: 7.07002e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 0.00010736 [rewriter_before_opt_a]: 8.324e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.0261872, [2] [Cycle 1]: 0.0222315, [27] [switch_simplify]: 6.14e-05 [loop_unroll]: 2.905e-05 [a_1]: 0.00057016 [with_stream_mark]: 2.357e-05 [recompute_prepare]: 7.70998e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 9.46003e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.87999e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00097482 [add_forward_monad_depend]: 1.947e-05 [auto_monad_grad]: 3.33998e-06 [auto_monad_eliminator]: 4.651e-05 [cse]: 5.209e-05 [replace_applicator]: 3.28e-05 [Cycle 2]: 0.00040189, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.86e-06 [a_1]: 0.00011053 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.60002e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 3.54002e-06 [get_grad_eliminate_]: 5.03002e-06 [merge_forward]: 5.14998e-06 [cell_reuse_recompute_pass]: 3.25e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.213e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.12999e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 8.24002e-06 [cse]: 1.592e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 2.493e-05 [rewriter_after_opt_a]: 4.585e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.0007611 [jit_opt_b]: 5.503e-05, [1] [Cycle 1]: 4.614e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.821e-05 [cconv]: 3.561e-05 [loop_unroll]: 0.00047584 [jit_opt_after_cconv]: 0.00019124, [1] [Cycle 1]: 0.0001551, [11] [c_1]: 2.231e-05 [parameter_eliminate]: 3.10002e-06 [updatestate_depend_eliminate]: 7.46001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.88e-06 [cse]: 3.363e-05 [call_graph_tuple_transform]: 2.201e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.905e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 6.69001e-06 [add_recomputation]: 5.96e-05 [cse_after_recomputation]: 2.589e-05, [1] [Cycle 1]: 1.974e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 2.58e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.0004891 [symbol_engine_optimizer]: 7.509e-05, [1] [Cycle 1]: 6.849e-05, [6] [build]: 3.20002e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 2.89991e-07 [validate]: 4.115e-05 Sums bootstrap : 0.000323s : 0.63% type_inference : 0.046624s : 90.32% event_method : 0.000020s : 0.04% auto_monad : 0.000074s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.21% rewriter_before_opt_a : 0.000083s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.13% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000681s : 1.32% jit_opt_a.with_stream_mark : 0.000043s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000975s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.04% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000055s : 0.11% jit_opt_a.cse : 0.000068s : 0.13% jit_opt_a.replace_applicator : 0.000038s : 0.07% py_interpret_to_execute_after_opt_a : 0.000025s : 0.05% rewriter_after_opt_a : 0.000046s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000761s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000036s : 0.07% loop_unroll : 0.000476s : 0.92% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000060s : 0.12% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000489s : 0.95% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.08% Time group info: ------[substitution.] 0.000248 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000007s : 3: substitution.graph_param_transform 83.21% : 0.000206s : 4: substitution.inline 2.15% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000006s : 4: substitution.remove_not_recompute_node 2.87% : 0.000007s : 2: substitution.replace_old_param 5.32% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046546 2 97.09% : 0.045193s : 1: type_inference.infer 2.91% : 0.001353s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.37% : 0.000050s : 4: replace.inline 31.63% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.41% : 0.000204s : 4: match.inline 5.59% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.38% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 2.15% : 0.000003s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.99% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.54% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 2.15% : 0.000003s : 10: predicate.reduce_eliminate 1.81% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 2.41% : 0.000003s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.78% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000806 13 47.82% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.86% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.32% : 0.000365s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077939 72 0.08% : 0.000063s : 1: add_recomputation 0.10% : 0.000078s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.44% : 0.000343s : 1: bootstrap 0.05% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 33.60% : 0.026191s : 1: jit_opt_a 0.25% : 0.000194s : 1: jit_opt_after_cconv 0.07% : 0.000058s : 1: jit_opt_b 0.62% : 0.000483s : 1: loop_unroll 0.99% : 0.000774s : 1: mutable_eliminate 1.19% : 0.000931s : 26: opt.transform.jit_opt_a 0.07% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.64% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000111s : 1: py_interpret_to_execute 0.04% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 0.73% : 0.000572s : 1: renormalize.infer 0.51% : 0.000394s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000050s : 1: rewriter_after_opt_a 0.11% : 0.000087s : 1: rewriter_before_opt_a 0.10% : 0.000078s : 1: symbol_engine_optimizer 59.85% : 0.046645s : 1: type_inference TotalTime = 0.014953, [30] [bootstrap]: 0.00033281 [type_inference]: 0.00496536 [event_method]: 1.923e-05 [auto_monad]: 6.575e-05 [graph_reusing]: 5.37999e-06 [pre_auto_parallel]: 2.85002e-06 [py_interpret_to_execute]: 3.474e-05 [rewriter_before_opt_a]: 7.49e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00715706, [2] [Cycle 1]: 0.0018943, [27] [switch_simplify]: 5.884e-05 [loop_unroll]: 2.957e-05 [a_1]: 0.00063037 [with_stream_mark]: 2.432e-05 [recompute_prepare]: 9.27001e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.58e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.64999e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00078887 [add_forward_monad_depend]: 6.89999e-06 [auto_monad_grad]: 3.53999e-06 [auto_monad_eliminator]: 1.682e-05 [cse]: 3.69e-05 [replace_applicator]: 1.38e-05 [Cycle 2]: 0.0003283, [27] [switch_simplify]: 6.05002e-06 [loop_unroll]: 4.90001e-06 [a_1]: 8.913e-05 [with_stream_mark]: 1.235e-05 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 8.2e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 8.99978e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.27999e-06 [cse]: 1.378e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.414e-05 [rewriter_after_opt_a]: 3.758e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00061892 [jit_opt_b]: 5.005e-05, [1] [Cycle 1]: 4.293e-05, [2] [frontend_op_eliminate]: 1.611e-05 [inline_after_opt_a]: 1.609e-05 [cconv]: 2.664e-05 [loop_unroll]: 0.00042521 [jit_opt_after_cconv]: 0.0001533, [1] [Cycle 1]: 0.00014605, [11] [c_1]: 1.962e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.99e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.28998e-06 [cse]: 2.329e-05 [call_graph_tuple_transform]: 2.795e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.716e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 5.102e-05 [cse_after_recomputation]: 2.338e-05, [1] [Cycle 1]: 1.809e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.87e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 4.85999e-06 [opt_after_jit_grad]: 0.00045899 [symbol_engine_optimizer]: 7.309e-05, [1] [Cycle 1]: 6.597e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 7.80998e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 5.91003e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 3.19997e-07 [validate]: 9.842e-05 Sums bootstrap : 0.000333s : 3.54% type_inference : 0.004965s : 52.81% event_method : 0.000019s : 0.20% auto_monad : 0.000066s : 0.70% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.37% rewriter_before_opt_a : 0.000075s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000719s : 7.65% jit_opt_a.with_stream_mark : 0.000037s : 0.39% jit_opt_a.recompute_prepare : 0.000015s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000789s : 8.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000051s : 0.54% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000038s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000619s : 6.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000027s : 0.28% loop_unroll : 0.000425s : 4.52% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.30% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000051s : 0.54% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000019s : 0.20% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000459s : 4.88% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000098s : 1.05% Time group info: ------[substitution.] 0.000299 23 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.85% : 0.000006s : 3: substitution.graph_param_transform 88.25% : 0.000264s : 4: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.51% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.24% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004899 2 83.03% : 0.004068s : 1: type_inference.infer 16.97% : 0.000831s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.21% : 0.000049s : 4: replace.inline 31.79% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 6 95.74% : 0.000261s : 4: match.inline 4.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.89% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.69% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.39% : 0.000002s : 10: predicate.print_const_string_wrapper 2.14% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.19% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000669 13 53.55% : 0.000358s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.75% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.70% : 0.000259s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016683 72 0.32% : 0.000054s : 1: add_recomputation 0.41% : 0.000069s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 2.23% : 0.000372s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 42.92% : 0.007160s : 1: jit_opt_a 0.93% : 0.000156s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.60% : 0.000434s : 1: loop_unroll 3.76% : 0.000627s : 1: mutable_eliminate 5.65% : 0.000942s : 26: opt.transform.jit_opt_a 0.33% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.80% : 0.000467s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000037s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 2.62% : 0.000437s : 1: renormalize.infer 2.06% : 0.000343s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000040s : 1: rewriter_after_opt_a 0.47% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000075s : 1: symbol_engine_optimizer 29.87% : 0.004982s : 1: type_inference TotalTime = 0.539076, [30] [bootstrap]: 0.00033022 [type_inference]: 0.524506 [event_method]: 2.908e-05 [auto_monad]: 8.835e-05 [graph_reusing]: 7.04001e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00055522 [rewriter_before_opt_a]: 0.00011591 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.00999068, [2] [Cycle 1]: 0.00486387, [27] [switch_simplify]: 0.00010736 [loop_unroll]: 3.442e-05 [a_1]: 0.00081025 [with_stream_mark]: 2.932e-05 [recompute_prepare]: 1.135e-05 [updatestate_depend_eliminate]: 5.26002e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 7.78999e-06 [updatestate_useless_node_eliminater]: 6.33002e-06 [accelerated_algorithm]: 8.43001e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 7.40998e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.917e-05 [j_node_and_user_rematch]: 1.322e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.207e-05 [inline_without_move]: 7.15998e-06 [renormalize]: 0.00340396 [add_forward_monad_depend]: 1.242e-05 [auto_monad_grad]: 3.14001e-06 [auto_monad_eliminator]: 2.226e-05 [cse]: 4.459e-05 [replace_applicator]: 2.727e-05 [Cycle 2]: 0.00044053, [27] [switch_simplify]: 7.22002e-06 [loop_unroll]: 6.84999e-06 [a_1]: 0.00013411 [with_stream_mark]: 1.765e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 4.10998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.155e-05 [j_node_and_user_rematch]: 1.154e-05 [meta_fg_expand]: 3.18e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 6.14999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.81998e-06 [auto_monad_grad]: 1.55001e-06 [auto_monad_eliminator]: 9.46e-06 [cse]: 2.145e-05 [replace_applicator]: 7.63001e-06 [py_interpret_to_execute_after_opt_a]: 1.818e-05 [rewriter_after_opt_a]: 4.875e-05 [convert_after_rewriter]: 8.02e-06 [order_py_execute_after_rewriter]: 5.76e-06 [mutable_eliminate]: 0.00111955 [jit_opt_b]: 7.255e-05, [1] [Cycle 1]: 6.204e-05, [2] [frontend_op_eliminate]: 2.356e-05 [inline_after_opt_a]: 2.455e-05 [cconv]: 3.865e-05 [loop_unroll]: 0.00063477 [jit_opt_after_cconv]: 0.00022307, [1] [Cycle 1]: 0.0002138, [11] [c_1]: 2.967e-05 [parameter_eliminate]: 5.96998e-06 [updatestate_depend_eliminate]: 8.80999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.36999e-06 [cse]: 5.153e-05 [call_graph_tuple_transform]: 3.17e-05 [tuple_list_get_item_eliminator]: 7.97e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 8.59e-06 [remove_dup_value]: 2.121e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 1.232e-05 [add_recomputation]: 6.707e-05 [cse_after_recomputation]: 3.279e-05, [1] [Cycle 1]: 2.6e-05, [1] [cse]: 1.728e-05 [auto_monad_reorder]: 2.117e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 8.92999e-06 [opt_after_jit_grad]: 0.00068106 [symbol_engine_optimizer]: 9.719e-05, [1] [Cycle 1]: 8.726e-05, [6] [build]: 5.62999e-06 [elim_shapecalc]: 9.40001e-06 [elim_not_effective]: 1.634e-05 [opt_reshape]: 1.043e-05 [fold_const_symbol]: 1.171e-05 [renormalize]: 1.02e-06 [validate]: 6.765e-05 Sums bootstrap : 0.000330s : 0.06% type_inference : 0.524506s : 98.30% event_method : 0.000029s : 0.01% auto_monad : 0.000088s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000555s : 0.10% rewriter_before_opt_a : 0.000116s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000115s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000944s : 0.18% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003404s : 0.64% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000066s : 0.01% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.00% rewriter_after_opt_a : 0.000049s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001120s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.00% jit_opt_b.inline_after_opt_a : 0.000025s : 0.00% cconv : 0.000039s : 0.01% loop_unroll : 0.000635s : 0.12% jit_opt_after_cconv.c_1 : 0.000030s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000052s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000021s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000067s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000681s : 0.13% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.01% Time group info: ------[substitution.] 0.000344 25 0.78% : 0.000003s : 2: substitution.elim_not_effective 0.78% : 0.000003s : 2: substitution.fold_const_symbol 2.31% : 0.000008s : 4: substitution.graph_param_transform 85.57% : 0.000295s : 5: substitution.inline 1.74% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000008s : 4: substitution.remove_not_recompute_node 2.14% : 0.000007s : 2: substitution.replace_old_param 4.45% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.524376 2 99.31% : 0.520769s : 1: type_inference.infer 0.69% : 0.003607s : 1: type_inference.specialize ------[replace.] 0.000121 7 69.96% : 0.000085s : 5: replace.inline 30.04% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000305 7 95.57% : 0.000291s : 5: match.inline 4.43% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 886 1.79% : 0.000003s : 13: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 1.77% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000002s : 13: predicate.compare_switch_simplify 1.03% : 0.000002s : 13: predicate.depend_value_elim 1.40% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.10% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.41% : 0.000002s : 13: predicate.environ_get_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.68% : 0.000009s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.24% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 2.27% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.22% : 0.000002s : 13: predicate.minmaximum_grad 2.03% : 0.000003s : 4: predicate.mutable_eliminate 0.83% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000004s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000004s : 13: predicate.reduce_eliminate 1.65% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.95% : 0.000002s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.87% : 0.000005s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.34% : 0.000010s : 64: predicate.switch_simplify 1.10% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.69% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.56% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000003s : 13: predicate.value_based_eliminate 0.48% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002929 25 61.97% : 0.001815s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.31% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.72% : 0.001017s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.543854 72 0.01% : 0.000071s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000025s : 1: auto_monad_reorder 0.06% : 0.000342s : 1: bootstrap 0.01% : 0.000042s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000036s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 1.84% : 0.009996s : 1: jit_opt_a 0.04% : 0.000226s : 1: jit_opt_after_cconv 0.01% : 0.000076s : 1: jit_opt_b 0.12% : 0.000648s : 1: loop_unroll 0.21% : 0.001147s : 1: mutable_eliminate 0.23% : 0.001275s : 26: opt.transform.jit_opt_a 0.01% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000039s : 4: opt.transform.jit_opt_b 0.00% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000035s : 1: opt.transform.mutable_eliminate 0.01% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000695s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000566s : 1: py_interpret_to_execute 0.00% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000024s : 1: remove_dup_value 0.43% : 0.002348s : 1: renormalize.infer 0.19% : 0.001041s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000053s : 1: rewriter_after_opt_a 0.02% : 0.000125s : 1: rewriter_before_opt_a 0.02% : 0.000100s : 1: symbol_engine_optimizer 96.45% : 0.524541s : 1: type_inference TotalTime = 0.0298826, [30] [bootstrap]: 0.00031915 [type_inference]: 0.0204979 [event_method]: 2.319e-05 [auto_monad]: 7.639e-05 [graph_reusing]: 6.02001e-06 [pre_auto_parallel]: 2.98998e-06 [py_interpret_to_execute]: 0.00010278 [rewriter_before_opt_a]: 8.273e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.00636995, [2] [Cycle 1]: 0.00214598, [27] [switch_simplify]: 6.261e-05 [loop_unroll]: 2.883e-05 [a_1]: 0.00055213 [with_stream_mark]: 2.478e-05 [recompute_prepare]: 7.59002e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.21003e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 5.35001e-06 [renormalize]: 0.00110743 [add_forward_monad_depend]: 8.64003e-06 [auto_monad_grad]: 3.76999e-06 [auto_monad_eliminator]: 1.853e-05 [cse]: 3.797e-05 [replace_applicator]: 1.643e-05 [Cycle 2]: 0.00052928, [27] [switch_simplify]: 6.35002e-06 [loop_unroll]: 5.05999e-06 [a_1]: 8.994e-05 [with_stream_mark]: 1.178e-05 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 9.52001e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 2.22001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.05999e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.89999e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.83999e-06 [cse]: 1.838e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.663e-05 [rewriter_after_opt_a]: 3.876e-05 [convert_after_rewriter]: 7.92e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.00069346 [jit_opt_b]: 5.398e-05, [1] [Cycle 1]: 4.487e-05, [2] [frontend_op_eliminate]: 1.633e-05 [inline_after_opt_a]: 1.706e-05 [cconv]: 3.147e-05 [loop_unroll]: 0.00045547 [jit_opt_after_cconv]: 0.00016317, [1] [Cycle 1]: 0.0001568, [11] [c_1]: 2.128e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 1.605e-05 [cse]: 2.611e-05 [call_graph_tuple_transform]: 1.933e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 2.06e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.63e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 5.3e-05 [cse_after_recomputation]: 2.346e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.18e-05 [auto_monad_reorder]: 1.859e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 5.82001e-06 [opt_after_jit_grad]: 0.00045752 [symbol_engine_optimizer]: 7.241e-05, [1] [Cycle 1]: 6.642e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 7.41001e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 8.84998e-06 [renormalize]: 3.70026e-07 [validate]: 4.104e-05 Sums bootstrap : 0.000319s : 1.26% type_inference : 0.020498s : 80.86% event_method : 0.000023s : 0.09% auto_monad : 0.000076s : 0.30% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.41% rewriter_before_opt_a : 0.000083s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.27% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000642s : 2.53% jit_opt_a.with_stream_mark : 0.000037s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000016s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001108s : 4.37% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000005s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000056s : 0.22% jit_opt_a.replace_applicator : 0.000022s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.07% rewriter_after_opt_a : 0.000039s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000693s : 2.74% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000031s : 0.12% loop_unroll : 0.000455s : 1.80% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000016s : 0.06% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000458s : 1.80% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.16% Time group info: ------[substitution.] 0.000231 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 3: substitution.graph_param_transform 83.65% : 0.000193s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 2.67% : 0.000006s : 2: substitution.replace_old_param 6.12% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020412 2 92.89% : 0.018962s : 1: type_inference.infer 7.11% : 0.001451s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.52% : 0.000047s : 4: replace.inline 31.48% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 93.65% : 0.000191s : 4: match.inline 6.35% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.00% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.01% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.65% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.95% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000764 13 47.78% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.04% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.18% : 0.000353s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031878 72 0.17% : 0.000056s : 1: add_recomputation 0.25% : 0.000080s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.07% : 0.000340s : 1: bootstrap 0.11% : 0.000034s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 20.00% : 0.006374s : 1: jit_opt_a 0.52% : 0.000166s : 1: jit_opt_after_cconv 0.18% : 0.000057s : 1: jit_opt_b 1.45% : 0.000464s : 1: loop_unroll 2.21% : 0.000704s : 1: mutable_eliminate 2.75% : 0.000875s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000466s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000107s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.67% : 0.000532s : 1: renormalize.infer 1.77% : 0.000566s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000042s : 1: rewriter_after_opt_a 0.27% : 0.000087s : 1: rewriter_before_opt_a 0.23% : 0.000075s : 1: symbol_engine_optimizer 64.38% : 0.020523s : 1: type_inference TotalTime = 0.568909, [30] [bootstrap]: 0.0003492 [type_inference]: 0.545331 [event_method]: 2.387e-05 [auto_monad]: 8.173e-05 [graph_reusing]: 7.33e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00045543 [rewriter_before_opt_a]: 0.00010002 [expand_dump_flag]: 4.25e-06 [jit_opt_a]: 0.0192672, [2] [Cycle 1]: 0.00446779, [27] [switch_simplify]: 7.148e-05 [loop_unroll]: 3.174e-05 [a_1]: 0.0006789 [with_stream_mark]: 3.161e-05 [recompute_prepare]: 1.133e-05 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.45998e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 7.07002e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.55002e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.82e-05 [j_node_and_user_rematch]: 1.053e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.219e-05 [inline_without_move]: 6.63e-06 [renormalize]: 0.00316726 [add_forward_monad_depend]: 1.266e-05 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 2.353e-05 [cse]: 3.656e-05 [replace_applicator]: 2.64e-05 [Cycle 2]: 0.00042269, [27] [switch_simplify]: 7.21999e-06 [loop_unroll]: 6.35002e-06 [a_1]: 0.00013169 [with_stream_mark]: 1.857e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.74998e-06 [cell_reuse_recompute_pass]: 3.95e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.237e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 5.67999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 1.77001e-06 [auto_monad_eliminator]: 7.73001e-06 [cse]: 1.503e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.854e-05 [rewriter_after_opt_a]: 4.601e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 6.02999e-06 [mutable_eliminate]: 0.00103639 [jit_opt_b]: 6.806e-05, [1] [Cycle 1]: 5.841e-05, [2] [frontend_op_eliminate]: 2.213e-05 [inline_after_opt_a]: 2.3e-05 [cconv]: 3.455e-05 [loop_unroll]: 0.00056632 [jit_opt_after_cconv]: 0.00031768, [1] [Cycle 1]: 0.00030883, [11] [c_1]: 2.765e-05 [parameter_eliminate]: 4.07e-06 [updatestate_depend_eliminate]: 8.67998e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 2.78003e-06 [cse]: 4.264e-05 [call_graph_tuple_transform]: 2.83e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.819e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 9.82999e-06 [add_recomputation]: 6.778e-05 [cse_after_recomputation]: 2.71e-05, [1] [Cycle 1]: 2.022e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 1.741e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 9.92001e-06 [opt_after_jit_grad]: 0.00058403 [symbol_engine_optimizer]: 8.121e-05, [1] [Cycle 1]: 7.374e-05, [6] [build]: 5.41002e-06 [elim_shapecalc]: 8.84003e-06 [elim_not_effective]: 1.468e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 5.79981e-07 [validate]: 5.386e-05 Sums bootstrap : 0.000349s : 0.06% type_inference : 0.545331s : 98.51% event_method : 0.000024s : 0.00% auto_monad : 0.000082s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000455s : 0.08% rewriter_before_opt_a : 0.000100s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.01% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000811s : 0.15% jit_opt_a.with_stream_mark : 0.000050s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003167s : 0.57% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000052s : 0.01% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000046s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001036s : 0.19% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.00% jit_opt_b.inline_after_opt_a : 0.000023s : 0.00% cconv : 0.000035s : 0.01% loop_unroll : 0.000566s : 0.10% jit_opt_after_cconv.c_1 : 0.000028s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000068s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000584s : 0.11% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.01% Time group info: ------[substitution.] 0.000287 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000007s : 4: substitution.graph_param_transform 85.00% : 0.000244s : 4: substitution.inline 1.75% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000007s : 4: substitution.remove_not_recompute_node 2.20% : 0.000006s : 2: substitution.replace_old_param 4.77% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.545224 2 99.51% : 0.542538s : 1: type_inference.infer 0.49% : 0.002686s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.45% : 0.000055s : 4: replace.inline 32.55% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 95.15% : 0.000241s : 4: match.inline 4.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.56% : 0.000002s : 12: predicate.addn_zero_filter 2.36% : 0.000004s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 12: predicate.compare_switch_simplify 1.01% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.07% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.78% : 0.000009s : 26: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.63% : 0.000003s : 18: predicate.load_eliminater 1.69% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.44% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 0.99% : 0.000002s : 12: predicate.minmaximum_grad 2.25% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 18: predicate.partial_eliminate 1.50% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.58% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 1.02% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 18: predicate.switch_defer_inline 1.75% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000011s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.77% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002556 22 65.31% : 0.001669s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.31% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.38% : 0.000828s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.573165 72 0.01% : 0.000071s : 1: add_recomputation 0.01% : 0.000085s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.06% : 0.000370s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.36% : 0.019271s : 1: jit_opt_a 0.06% : 0.000321s : 1: jit_opt_after_cconv 0.01% : 0.000071s : 1: jit_opt_b 0.10% : 0.000576s : 1: loop_unroll 0.18% : 0.001053s : 1: mutable_eliminate 0.19% : 0.001088s : 26: opt.transform.jit_opt_a 0.01% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000026s : 1: opt.transform.mutable_eliminate 0.00% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000594s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000467s : 1: py_interpret_to_execute 0.00% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 0.38% : 0.002157s : 1: renormalize.infer 0.17% : 0.000997s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000049s : 1: rewriter_after_opt_a 0.02% : 0.000108s : 1: rewriter_before_opt_a 0.01% : 0.000084s : 1: symbol_engine_optimizer 95.15% : 0.545363s : 1: type_inference TotalTime = 0.0926949, [30] [bootstrap]: 0.00033424 [type_inference]: 0.0334752 [event_method]: 2.559e-05 [auto_monad]: 8.089e-05 [graph_reusing]: 6.53998e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 0.00011515 [rewriter_before_opt_a]: 8.534e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.0558534, [2] [Cycle 1]: 0.0515765, [27] [switch_simplify]: 6.629e-05 [loop_unroll]: 2.895e-05 [a_1]: 0.049828 [with_stream_mark]: 3.908e-05 [recompute_prepare]: 1.554e-05 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 3.27002e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.45002e-06 [meta_shard_fg_expand]: 3.48e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 5.15001e-06 [cell_reuse_recompute_pass]: 3.45e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.24e-05 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00117442 [add_forward_monad_depend]: 8.77e-06 [auto_monad_grad]: 3.08e-06 [auto_monad_eliminator]: 2.028e-05 [cse]: 3.763e-05 [replace_applicator]: 1.774e-05 [Cycle 2]: 0.00035027, [27] [switch_simplify]: 6.28e-06 [loop_unroll]: 5.80002e-06 [a_1]: 9.491e-05 [with_stream_mark]: 1.444e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.571e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 4.84998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.99e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 7.48999e-06 [cse]: 1.343e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.554e-05 [rewriter_after_opt_a]: 4.022e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00083177 [jit_opt_b]: 5.864e-05, [1] [Cycle 1]: 4.724e-05, [2] [frontend_op_eliminate]: 1.71e-05 [inline_after_opt_a]: 1.779e-05 [cconv]: 3.453e-05 [loop_unroll]: 0.00053095 [jit_opt_after_cconv]: 0.00017428, [1] [Cycle 1]: 0.00016653, [11] [c_1]: 2.282e-05 [parameter_eliminate]: 4.67998e-06 [updatestate_depend_eliminate]: 9.57001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 3.434e-05 [call_graph_tuple_transform]: 2.326e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.684e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 6.59001e-06 [add_recomputation]: 5.966e-05 [cse_after_recomputation]: 2.418e-05, [1] [Cycle 1]: 1.784e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 2.66999e-06 [rewriter_after_jit_bprop_graph]: 8.12e-06 [opt_after_jit_grad]: 0.00052088 [symbol_engine_optimizer]: 7.753e-05, [1] [Cycle 1]: 7.077e-05, [6] [build]: 4.57998e-06 [elim_shapecalc]: 8.55999e-06 [elim_not_effective]: 1.416e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 5.60016e-07 [validate]: 4.929e-05 Sums bootstrap : 0.000334s : 0.38% type_inference : 0.033475s : 38.01% event_method : 0.000026s : 0.03% auto_monad : 0.000081s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000115s : 0.13% rewriter_before_opt_a : 0.000085s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.049923s : 56.69% jit_opt_a.with_stream_mark : 0.000054s : 0.06% jit_opt_a.recompute_prepare : 0.000021s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001175s : 1.33% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.03% jit_opt_a.cse : 0.000051s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000832s : 0.94% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000035s : 0.04% loop_unroll : 0.000531s : 0.60% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000060s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000521s : 0.59% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.06% Time group info: ------[substitution.] 0.049327 23 0.00% : 0.000002s : 2: substitution.elim_not_effective 0.00% : 0.000001s : 2: substitution.fold_const_symbol 0.01% : 0.000007s : 3: substitution.graph_param_transform 0.58% : 0.000287s : 4: substitution.inline 0.01% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.01% : 0.000005s : 4: substitution.remove_not_recompute_node 0.02% : 0.000008s : 2: substitution.replace_old_param 99.36% : 0.049012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033373 2 95.01% : 0.031707s : 1: type_inference.infer 4.99% : 0.001665s : 1: type_inference.specialize ------[replace.] 0.000163 6 35.22% : 0.000057s : 4: replace.inline 64.78% : 0.000105s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.049288 6 0.58% : 0.000284s : 4: match.inline 99.42% : 0.049004s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 691 1.23% : 0.000002s : 10: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 2.49% : 0.000004s : 10: predicate.arithmetic_simplify 1.61% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 1.65% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 6.56% : 0.000010s : 22: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.76% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 0.92% : 0.000001s : 10: predicate.minmaximum_grad 2.38% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000002s : 10: predicate.print_const_string_wrapper 2.62% : 0.000004s : 10: predicate.reduce_eliminate 1.62% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000001s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.11% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000002s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.21% : 0.000005s : 16: predicate.switch_defer_inline 2.23% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.43% : 0.000009s : 53: predicate.switch_simplify 1.08% : 0.000002s : 10: predicate.tile_eliminate 1.82% : 0.000003s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.47% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.41% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000985 13 39.03% : 0.000384s : 6: func_graph_cloner_run.FuncGraphClonerGraph 10.94% : 0.000108s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.03% : 0.000493s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144095 72 0.04% : 0.000064s : 1: add_recomputation 0.06% : 0.000085s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.25% : 0.000354s : 1: bootstrap 0.03% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 38.76% : 0.055857s : 1: jit_opt_a 0.12% : 0.000177s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.38% : 0.000544s : 1: loop_unroll 0.59% : 0.000847s : 1: mutable_eliminate 34.82% : 0.050167s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000532s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000120s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.46% : 0.000667s : 1: renormalize.infer 0.34% : 0.000494s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 23.26% : 0.033510s : 1: type_inference TotalTime = 0.471076, [30] [bootstrap]: 0.0003125 [type_inference]: 0.383742 [event_method]: 4.023e-05 [auto_monad]: 0.00010242 [graph_reusing]: 7.30998e-06 [pre_auto_parallel]: 3.25002e-06 [py_interpret_to_execute]: 0.0009497 [rewriter_before_opt_a]: 0.00013926 [expand_dump_flag]: 5.24e-06 [jit_opt_a]: 0.0565198, [2] [Cycle 1]: 0.0508846, [27] [switch_simplify]: 0.0391082 [loop_unroll]: 7.309e-05 [a_1]: 0.00107734 [with_stream_mark]: 3.095e-05 [recompute_prepare]: 1.237e-05 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.35998e-06 [parameter_eliminate]: 3.28e-06 [specialize_transform]: 9.70002e-06 [updatestate_useless_node_eliminater]: 7.13e-06 [accelerated_algorithm]: 9.76e-06 [meta_shard_fg_expand]: 5.17999e-06 [get_grad_eliminate_]: 8.65001e-06 [merge_forward]: 4.66002e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.066e-05 [j_node_and_user_rematch]: 1.293e-05 [meta_fg_expand]: 4.58999e-06 [replace_old_param]: 1.465e-05 [inline_without_move]: 8.80999e-06 [renormalize]: 0.00618476 [add_forward_monad_depend]: 1.392e-05 [auto_monad_grad]: 2.95002e-06 [auto_monad_eliminator]: 3.127e-05 [cse]: 4.922e-05 [replace_applicator]: 3.512e-05 [Cycle 2]: 0.00047906, [27] [switch_simplify]: 9.77999e-06 [loop_unroll]: 6.90998e-06 [a_1]: 0.00015054 [with_stream_mark]: 2.135e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.53998e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 8.28999e-06 [meta_shard_fg_expand]: 2.86e-06 [get_grad_eliminate_]: 6.93e-06 [merge_forward]: 5.69999e-06 [cell_reuse_recompute_pass]: 4.05998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.189e-05 [j_node_and_user_rematch]: 1.171e-05 [meta_fg_expand]: 3.91999e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 6.43e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.10002e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 1.009e-05 [cse]: 2.164e-05 [replace_applicator]: 8.15999e-06 [py_interpret_to_execute_after_opt_a]: 2.58e-05 [rewriter_after_opt_a]: 5.159e-05 [convert_after_rewriter]: 8.10999e-06 [order_py_execute_after_rewriter]: 5.83002e-06 [mutable_eliminate]: 0.0260381 [jit_opt_b]: 0.00011122, [1] [Cycle 1]: 9.647e-05, [2] [frontend_op_eliminate]: 4.076e-05 [inline_after_opt_a]: 3.702e-05 [cconv]: 4.921e-05 [loop_unroll]: 0.00091428 [jit_opt_after_cconv]: 0.00025872, [1] [Cycle 1]: 0.00024973, [11] [c_1]: 3.357e-05 [parameter_eliminate]: 8.70001e-06 [updatestate_depend_eliminate]: 1.393e-05 [updatestate_assign_eliminate]: 4.05e-06 [updatestate_loads_eliminate]: 3.27002e-06 [cse]: 6.501e-05 [call_graph_tuple_transform]: 3.742e-05 [tuple_list_get_item_eliminator]: 8.92999e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 7.90023e-07 [switch_simplify]: 1.04e-05 [remove_dup_value]: 2.489e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 1.434e-05 [add_recomputation]: 7.77e-05 [cse_after_recomputation]: 3.476e-05, [1] [Cycle 1]: 2.808e-05, [1] [cse]: 1.958e-05 [auto_monad_reorder]: 1.999e-05 [get_jit_bprop_graph]: 3.16999e-06 [rewriter_after_jit_bprop_graph]: 1.489e-05 [opt_after_jit_grad]: 0.00065944 [symbol_engine_optimizer]: 0.00010054, [1] [Cycle 1]: 9.299e-05, [6] [build]: 6.74001e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 1.662e-05 [opt_reshape]: 1.113e-05 [fold_const_symbol]: 1.318e-05 [renormalize]: 3.89991e-07 [validate]: 0.00046612 Sums bootstrap : 0.000312s : 0.07% type_inference : 0.383742s : 83.22% event_method : 0.000040s : 0.01% auto_monad : 0.000102s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000950s : 0.21% rewriter_before_opt_a : 0.000139s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.039118s : 8.48% jit_opt_a.loop_unroll : 0.000080s : 0.02% jit_opt_a.a_1 : 0.001228s : 0.27% jit_opt_a.with_stream_mark : 0.000052s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000018s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.01% jit_opt_a.meta_fg_expand : 0.000009s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.006185s : 1.34% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000041s : 0.01% jit_opt_a.cse : 0.000071s : 0.02% jit_opt_a.replace_applicator : 0.000043s : 0.01% py_interpret_to_execute_after_opt_a : 0.000026s : 0.01% rewriter_after_opt_a : 0.000052s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.026038s : 5.65% jit_opt_b.frontend_op_eliminate : 0.000041s : 0.01% jit_opt_b.inline_after_opt_a : 0.000037s : 0.01% cconv : 0.000049s : 0.01% loop_unroll : 0.000914s : 0.20% jit_opt_after_cconv.c_1 : 0.000034s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000065s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000037s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.00% remove_dup_value : 0.000025s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000078s : 0.02% cse_after_recomputation.cse : 0.000020s : 0.00% auto_monad_reorder : 0.000020s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000015s : 0.00% opt_after_jit_grad : 0.000659s : 0.14% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000466s : 0.10% Time group info: ------[substitution.] 0.000465 25 0.44% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000004s : 2: substitution.fold_const_symbol 1.65% : 0.000008s : 4: substitution.graph_param_transform 85.97% : 0.000400s : 5: substitution.inline 1.20% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.45% : 0.000007s : 4: substitution.remove_not_recompute_node 1.82% : 0.000008s : 2: substitution.replace_old_param 6.71% : 0.000031s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.383585 2 98.58% : 0.378129s : 1: type_inference.infer 1.42% : 0.005456s : 1: type_inference.specialize ------[replace.] 0.000173 7 66.58% : 0.000115s : 5: replace.inline 33.42% : 0.000058s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000427 7 92.98% : 0.000397s : 5: match.inline 7.02% : 0.000030s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000240 886 1.22% : 0.000003s : 13: predicate.accumulaten_eliminater 0.94% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.81% : 0.000002s : 13: predicate.addn_check_dump 1.18% : 0.000003s : 13: predicate.addn_zero_filter 1.96% : 0.000005s : 13: predicate.arithmetic_simplify 1.32% : 0.000003s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 0.73% : 0.000002s : 13: predicate.compare_switch_simplify 1.04% : 0.000003s : 13: predicate.depend_value_elim 0.73% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.06% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.64% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000003s : 13: predicate.environ_add_const_eliminate 0.76% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.71% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000003s : 13: predicate.environ_get_eliminate 0.62% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000002s : 8: predicate.get_grad_eliminate 0.15% : 0.000000s : 4: predicate.graph_param_transform 4.36% : 0.000010s : 28: predicate.inline 0.65% : 0.000002s : 8: predicate.inline_without_move 0.26% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000003s : 8: predicate.less_batch_normalization 1.41% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.62% : 0.000004s : 19: predicate.load_eliminater 1.65% : 0.000004s : 4: predicate.loop_unroll_after_grad 6.35% : 0.000015s : 40: predicate.loop_unroll_before_grad 1.75% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.83% : 0.000002s : 13: predicate.merge_addn 0.95% : 0.000002s : 13: predicate.minmaximum_grad 3.95% : 0.000009s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 1.40% : 0.000003s : 19: predicate.partial_eliminate 1.04% : 0.000002s : 13: predicate.print_const_string_wrapper 1.92% : 0.000005s : 13: predicate.reduce_eliminate 1.53% : 0.000004s : 15: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 8: predicate.remove_not_recompute_node 1.32% : 0.000003s : 23: predicate.replace_applicator 0.45% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000003s : 13: predicate.reshape_eliminate 1.16% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 1.16% : 0.000003s : 4: predicate.row_tensor_eliminate 1.02% : 0.000002s : 13: predicate.same_eliminate 0.38% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.54% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.92% : 0.000005s : 20: predicate.switch_defer_inline 1.63% : 0.000004s : 20: predicate.switch_layer_defer_inline 15.70% : 0.000038s : 64: predicate.switch_simplify 1.06% : 0.000003s : 13: predicate.tile_eliminate 1.07% : 0.000003s : 13: predicate.transpose_eliminate 1.28% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000009s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000004s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.14% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.16% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.39% : 0.000003s : 13: predicate.value_based_eliminate 0.20% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004459 25 60.09% : 0.002679s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000118s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.27% : 0.001662s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.517606 72 0.02% : 0.000082s : 1: add_recomputation 0.02% : 0.000107s : 1: auto_monad 0.00% : 0.000023s : 1: auto_monad_reorder 0.06% : 0.000335s : 1: bootstrap 0.01% : 0.000053s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000039s : 1: cse_after_recomputation 0.00% : 0.000017s : 1: environ_conv 0.02% : 0.000102s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 10.92% : 0.056525s : 1: jit_opt_a 0.05% : 0.000262s : 1: jit_opt_after_cconv 0.02% : 0.000116s : 1: jit_opt_b 0.18% : 0.000929s : 1: loop_unroll 5.04% : 0.026077s : 1: mutable_eliminate 7.85% : 0.040608s : 26: opt.transform.jit_opt_a 0.02% : 0.000086s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000065s : 4: opt.transform.jit_opt_b 0.00% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000061s : 1: opt.transform.mutable_eliminate 0.01% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000673s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000962s : 1: py_interpret_to_execute 0.01% : 0.000030s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000027s : 1: remove_dup_value 0.86% : 0.004438s : 1: renormalize.infer 0.33% : 0.001728s : 1: renormalize.specialize 0.00% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000056s : 1: rewriter_after_opt_a 0.03% : 0.000147s : 1: rewriter_before_opt_a 0.02% : 0.000103s : 1: symbol_engine_optimizer 74.15% : 0.383780s : 1: type_inference TotalTime = 0.0414212, [30] [bootstrap]: 0.00037934 [type_inference]: 0.0314513 [event_method]: 2.37e-05 [auto_monad]: 7.369e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00010591 [rewriter_before_opt_a]: 8.149e-05 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.00705568, [2] [Cycle 1]: 0.00201297, [27] [switch_simplify]: 5.952e-05 [loop_unroll]: 2.821e-05 [a_1]: 0.00057296 [with_stream_mark]: 2.296e-05 [recompute_prepare]: 7.48e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.91999e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 5.24e-06 [renormalize]: 0.00097652 [add_forward_monad_depend]: 5.44e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.702e-05 [cse]: 3.517e-05 [replace_applicator]: 1.453e-05 [Cycle 2]: 0.00032183, [27] [switch_simplify]: 6.08002e-06 [loop_unroll]: 5.14e-06 [a_1]: 8.953e-05 [with_stream_mark]: 9.97999e-06 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 8.43001e-06 [meta_fg_expand]: 1.91998e-06 [replace_old_param]: 7.78999e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.05002e-06 [cse]: 1.318e-05 [replace_applicator]: 5.49998e-06 [py_interpret_to_execute_after_opt_a]: 1.397e-05 [rewriter_after_opt_a]: 3.863e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00060993 [jit_opt_b]: 5.021e-05, [1] [Cycle 1]: 4.209e-05, [2] [frontend_op_eliminate]: 1.52e-05 [inline_after_opt_a]: 1.588e-05 [cconv]: 2.703e-05 [loop_unroll]: 0.000426 [jit_opt_after_cconv]: 0.00014423, [1] [Cycle 1]: 0.00013787, [11] [c_1]: 2.102e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.70001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.477e-05 [call_graph_tuple_transform]: 1.794e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.693e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 6.08002e-06 [add_recomputation]: 5.022e-05 [cse_after_recomputation]: 4.048e-05, [1] [Cycle 1]: 1.592e-05, [1] [cse]: 1.069e-05 [auto_monad_reorder]: 1.848e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.96e-06 [opt_after_jit_grad]: 0.00046739 [symbol_engine_optimizer]: 7.079e-05, [1] [Cycle 1]: 6.476e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 7.67002e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.29979e-07 [validate]: 4.178e-05 Sums bootstrap : 0.000379s : 1.05% type_inference : 0.031451s : 87.17% event_method : 0.000024s : 0.07% auto_monad : 0.000074s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.29% rewriter_before_opt_a : 0.000081s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.18% jit_opt_a.loop_unroll : 0.000033s : 0.09% jit_opt_a.a_1 : 0.000662s : 1.84% jit_opt_a.with_stream_mark : 0.000033s : 0.09% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000977s : 2.71% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000048s : 0.13% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000039s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000610s : 1.69% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.000426s : 1.18% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.14% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000467s : 1.30% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.12% Time group info: ------[substitution.] 0.000240 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000005s : 3: substitution.graph_param_transform 85.29% : 0.000205s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000006s : 2: substitution.replace_old_param 5.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031366 2 95.12% : 0.029835s : 1: type_inference.infer 4.88% : 0.001531s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.52% : 0.000053s : 4: replace.inline 30.48% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.40% : 0.000202s : 4: match.inline 5.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.50% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.69% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 2.17% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.02% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000821 13 46.18% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.15% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.68% : 0.000391s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043329 72 0.12% : 0.000053s : 1: add_recomputation 0.18% : 0.000077s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.93% : 0.000401s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000043s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.29% : 0.007059s : 1: jit_opt_a 0.34% : 0.000147s : 1: jit_opt_after_cconv 0.12% : 0.000053s : 1: jit_opt_b 1.00% : 0.000434s : 1: loop_unroll 1.43% : 0.000619s : 1: mutable_eliminate 2.04% : 0.000884s : 26: opt.transform.jit_opt_a 0.11% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.10% : 0.000475s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000109s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.33% : 0.000574s : 1: renormalize.infer 0.91% : 0.000393s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000041s : 1: rewriter_after_opt_a 0.20% : 0.000085s : 1: rewriter_before_opt_a 0.17% : 0.000073s : 1: symbol_engine_optimizer 72.66% : 0.031482s : 1: type_inference TotalTime = 0.0400477, [30] [bootstrap]: 0.00037367 [type_inference]: 0.027717 [event_method]: 2.69e-05 [auto_monad]: 7.742e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 0.00011274 [rewriter_before_opt_a]: 8.604e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00898895, [2] [Cycle 1]: 0.00223193, [27] [switch_simplify]: 6.493e-05 [loop_unroll]: 2.908e-05 [a_1]: 0.00059077 [with_stream_mark]: 2.32e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.662e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00104446 [add_forward_monad_depend]: 1.013e-05 [auto_monad_grad]: 3.6e-06 [auto_monad_eliminator]: 2.221e-05 [cse]: 4.154e-05 [replace_applicator]: 2.091e-05 [Cycle 2]: 0.00034762, [27] [switch_simplify]: 6.56999e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.059e-05 [with_stream_mark]: 1.56e-05 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 2.01003e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 2.40002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.808e-05 [j_node_and_user_rematch]: 8.94998e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.33999e-06 [inline_without_move]: 4.99e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 6.83e-06 [cse]: 1.437e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.511e-05 [rewriter_after_opt_a]: 4.31e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00080848 [jit_opt_b]: 5.551e-05, [1] [Cycle 1]: 4.443e-05, [2] [frontend_op_eliminate]: 1.613e-05 [inline_after_opt_a]: 1.67e-05 [cconv]: 3.408e-05 [loop_unroll]: 0.00048899 [jit_opt_after_cconv]: 0.00016596, [1] [Cycle 1]: 0.00015949, [11] [c_1]: 2.114e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 8.00999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.79999e-06 [cse]: 3.617e-05 [call_graph_tuple_transform]: 2.028e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 7.7e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 1.794e-05 [partial_unused_args_eliminate]: 3.11001e-06 [environ_conv]: 6.54001e-06 [add_recomputation]: 5.243e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.843e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 7.7e-06 [opt_after_jit_grad]: 0.00051713 [symbol_engine_optimizer]: 8.151e-05, [1] [Cycle 1]: 7.277e-05, [6] [build]: 5.08002e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.471e-05 [opt_reshape]: 6.08002e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 5.89993e-07 [validate]: 4.947e-05 Sums bootstrap : 0.000374s : 1.14% type_inference : 0.027717s : 84.33% event_method : 0.000027s : 0.08% auto_monad : 0.000077s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000113s : 0.34% rewriter_before_opt_a : 0.000086s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.22% jit_opt_a.loop_unroll : 0.000034s : 0.10% jit_opt_a.a_1 : 0.000681s : 2.07% jit_opt_a.with_stream_mark : 0.000039s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001045s : 3.18% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.04% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.09% jit_opt_a.cse : 0.000056s : 0.17% jit_opt_a.replace_applicator : 0.000026s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000043s : 0.13% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000808s : 2.46% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000034s : 0.10% loop_unroll : 0.000489s : 1.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000517s : 1.57% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.15% Time group info: ------[substitution.] 0.000258 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000007s : 3: substitution.graph_param_transform 84.82% : 0.000219s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000006s : 4: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_old_param 5.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027619 2 93.73% : 0.025888s : 1: type_inference.infer 6.27% : 0.001731s : 1: type_inference.specialize ------[replace.] 0.000080 6 70.37% : 0.000056s : 4: replace.inline 29.63% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.63% : 0.000216s : 4: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.55% : 0.000002s : 10: predicate.addn_zero_filter 2.40% : 0.000003s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.45% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 22: predicate.inline 1.33% : 0.000002s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.11% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.28% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.91% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.12% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.11% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 53: predicate.switch_simplify 1.05% : 0.000001s : 10: predicate.tile_eliminate 1.08% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001029 13 49.54% : 0.000510s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.60% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.85% : 0.000472s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042062 72 0.13% : 0.000056s : 1: add_recomputation 0.19% : 0.000082s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.95% : 0.000399s : 1: bootstrap 0.09% : 0.000037s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.06% : 0.000024s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 21.38% : 0.008993s : 1: jit_opt_a 0.40% : 0.000169s : 1: jit_opt_after_cconv 0.14% : 0.000059s : 1: jit_opt_b 1.19% : 0.000499s : 1: loop_unroll 1.96% : 0.000824s : 1: mutable_eliminate 2.19% : 0.000923s : 26: opt.transform.jit_opt_a 0.12% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000022s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000528s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000117s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.33% : 0.000559s : 1: renormalize.infer 1.13% : 0.000475s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000046s : 1: rewriter_after_opt_a 0.21% : 0.000090s : 1: rewriter_before_opt_a 0.20% : 0.000084s : 1: symbol_engine_optimizer 65.97% : 0.027750s : 1: type_inference TotalTime = 0.355742, [30] [bootstrap]: 0.00034316 [type_inference]: 0.342696 [event_method]: 2.526e-05 [auto_monad]: 8.761e-05 [graph_reusing]: 7.48e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 0.00061676 [rewriter_before_opt_a]: 0.00011 [expand_dump_flag]: 4.74e-06 [jit_opt_a]: 0.00927318, [2] [Cycle 1]: 0.00443035, [27] [switch_simplify]: 7.21e-05 [loop_unroll]: 3.24e-05 [a_1]: 0.00070278 [with_stream_mark]: 2.728e-05 [recompute_prepare]: 1.155e-05 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 3.38999e-06 [specialize_transform]: 8.45001e-06 [updatestate_useless_node_eliminater]: 6.73e-06 [accelerated_algorithm]: 7.42998e-06 [meta_shard_fg_expand]: 2.98e-06 [get_grad_eliminate_]: 6.76999e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.71e-05 [j_node_and_user_rematch]: 1.098e-05 [meta_fg_expand]: 2.71999e-06 [replace_old_param]: 1.284e-05 [inline_without_move]: 7.15003e-06 [renormalize]: 0.00314669 [add_forward_monad_depend]: 1.515e-05 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 2.097e-05 [cse]: 3.603e-05 [replace_applicator]: 2.296e-05 [Cycle 2]: 0.00039324, [27] [switch_simplify]: 6.92002e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00012413 [with_stream_mark]: 1.386e-05 [recompute_prepare]: 5.85002e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 2.45002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.884e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.54e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 7.45998e-06 [cse]: 1.316e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.594e-05 [rewriter_after_opt_a]: 3.918e-05 [convert_after_rewriter]: 8.37998e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00073391 [jit_opt_b]: 6.199e-05, [1] [Cycle 1]: 5.312e-05, [2] [frontend_op_eliminate]: 2.124e-05 [inline_after_opt_a]: 1.997e-05 [cconv]: 3.232e-05 [loop_unroll]: 0.00047795 [jit_opt_after_cconv]: 0.0001703, [1] [Cycle 1]: 0.000163, [11] [c_1]: 2.658e-05 [parameter_eliminate]: 4.03001e-06 [updatestate_depend_eliminate]: 8.41002e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.962e-05 [call_graph_tuple_transform]: 2.363e-05 [tuple_list_get_item_eliminator]: 6.27001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.59999e-06 [remove_dup_value]: 1.567e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 1.005e-05 [add_recomputation]: 5.448e-05 [cse_after_recomputation]: 2.229e-05, [1] [Cycle 1]: 1.628e-05, [1] [cse]: 1.061e-05 [auto_monad_reorder]: 1.628e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 7.57002e-06 [opt_after_jit_grad]: 0.00048782 [symbol_engine_optimizer]: 7.596e-05, [1] [Cycle 1]: 6.977e-05, [6] [build]: 4.52998e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.44e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 3.09985e-07 [validate]: 5.182e-05 Sums bootstrap : 0.000343s : 0.10% type_inference : 0.342696s : 97.77% event_method : 0.000025s : 0.01% auto_monad : 0.000088s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000617s : 0.18% rewriter_before_opt_a : 0.000110s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.02% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000827s : 0.24% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003147s : 0.90% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000049s : 0.01% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000734s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000478s : 0.14% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000488s : 0.14% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.01% Time group info: ------[substitution.] 0.000304 24 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000007s : 4: substitution.graph_param_transform 86.00% : 0.000261s : 4: substitution.inline 1.90% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000006s : 4: substitution.remove_not_recompute_node 2.04% : 0.000006s : 2: substitution.replace_old_param 4.65% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.342578 2 99.14% : 0.339637s : 1: type_inference.infer 0.86% : 0.002941s : 1: type_inference.specialize ------[replace.] 0.000091 6 68.62% : 0.000062s : 4: replace.inline 31.38% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000271 6 95.25% : 0.000258s : 4: match.inline 4.75% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 830 1.92% : 0.000003s : 12: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_depend_swap 1.07% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 6.84% : 0.000010s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 18: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 0.98% : 0.000001s : 12: predicate.minmaximum_grad 1.77% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.10% : 0.000002s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 1.82% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.75% : 0.000011s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.38% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002661 22 68.88% : 0.001833s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.42% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.70% : 0.000764s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.359988 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000092s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.10% : 0.000363s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 2.58% : 0.009276s : 1: jit_opt_a 0.05% : 0.000173s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.14% : 0.000488s : 1: loop_unroll 0.21% : 0.000746s : 1: mutable_eliminate 0.30% : 0.001096s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000631s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000018s : 1: remove_dup_value 0.64% : 0.002291s : 1: renormalize.infer 0.23% : 0.000841s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.03% : 0.000118s : 1: rewriter_before_opt_a 0.02% : 0.000078s : 1: symbol_engine_optimizer 95.21% : 0.342731s : 1: type_inference TotalTime = 0.417937, [30] [bootstrap]: 0.00044345 [type_inference]: 0.37052 [event_method]: 3.453e-05 [auto_monad]: 9.992e-05 [graph_reusing]: 7.32002e-06 [pre_auto_parallel]: 3.66001e-06 [py_interpret_to_execute]: 0.00077272 [rewriter_before_opt_a]: 0.00015996 [expand_dump_flag]: 5.40001e-06 [jit_opt_a]: 0.0421241, [2] [Cycle 1]: 0.0350492, [27] [switch_simplify]: 9.573e-05 [loop_unroll]: 4.104e-05 [a_1]: 0.00117711 [with_stream_mark]: 3.394e-05 [recompute_prepare]: 1.837e-05 [updatestate_depend_eliminate]: 8.74998e-06 [updatestate_assign_eliminate]: 4.23001e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 3.25e-06 [specialize_transform]: 1.179e-05 [updatestate_useless_node_eliminater]: 8.13001e-06 [accelerated_algorithm]: 1.073e-05 [meta_shard_fg_expand]: 5.30001e-06 [get_grad_eliminate_]: 8.92e-06 [merge_forward]: 5.72999e-06 [cell_reuse_recompute_pass]: 3.31001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.48e-05 [j_node_and_user_rematch]: 1.471e-05 [meta_fg_expand]: 2.87002e-06 [replace_old_param]: 1.548e-05 [inline_without_move]: 7.77e-06 [renormalize]: 0.033044 [add_forward_monad_depend]: 1.211e-05 [auto_monad_grad]: 2.80002e-06 [auto_monad_eliminator]: 2.628e-05 [cse]: 4.912e-05 [replace_applicator]: 5.186e-05 [Cycle 2]: 0.00052391, [27] [switch_simplify]: 1.096e-05 [loop_unroll]: 7.87998e-06 [a_1]: 0.00015537 [with_stream_mark]: 2.348e-05 [recompute_prepare]: 9.39998e-06 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 4.00998e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.88999e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 7.53999e-06 [meta_shard_fg_expand]: 3.41001e-06 [get_grad_eliminate_]: 8.28001e-06 [merge_forward]: 5.67001e-06 [cell_reuse_recompute_pass]: 5.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.689e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 3.48999e-06 [replace_old_param]: 1.285e-05 [inline_without_move]: 6.51e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 3.41001e-06 [auto_monad_grad]: 1.39e-06 [auto_monad_eliminator]: 1.038e-05 [cse]: 2.779e-05 [replace_applicator]: 9.54999e-06 [py_interpret_to_execute_after_opt_a]: 2.46e-05 [rewriter_after_opt_a]: 5.555e-05 [convert_after_rewriter]: 9.29e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00106081 [jit_opt_b]: 7.317e-05, [1] [Cycle 1]: 6.439e-05, [2] [frontend_op_eliminate]: 2.474e-05 [inline_after_opt_a]: 2.377e-05 [cconv]: 3.759e-05 [loop_unroll]: 0.00071153 [jit_opt_after_cconv]: 0.00022745, [1] [Cycle 1]: 0.00021808, [11] [c_1]: 3.415e-05 [parameter_eliminate]: 5.24e-06 [updatestate_depend_eliminate]: 1.071e-05 [updatestate_assign_eliminate]: 3.83999e-06 [updatestate_loads_eliminate]: 4.68001e-06 [cse]: 4.928e-05 [call_graph_tuple_transform]: 3.041e-05 [tuple_list_get_item_eliminator]: 7.95e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 7.7e-07 [switch_simplify]: 6.87002e-06 [remove_dup_value]: 2.442e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 1.371e-05 [add_recomputation]: 6.025e-05 [cse_after_recomputation]: 3.735e-05, [1] [Cycle 1]: 2.995e-05, [1] [cse]: 1.992e-05 [auto_monad_reorder]: 2.075e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 1.127e-05 [opt_after_jit_grad]: 0.0007796 [symbol_engine_optimizer]: 9.412e-05, [1] [Cycle 1]: 8.642e-05, [6] [build]: 6.36998e-06 [elim_shapecalc]: 1.169e-05 [elim_not_effective]: 1.82e-05 [opt_reshape]: 7.88999e-06 [fold_const_symbol]: 1.269e-05 [renormalize]: 4.10015e-07 [validate]: 8.303e-05 Sums bootstrap : 0.000443s : 0.11% type_inference : 0.370520s : 90.30% event_method : 0.000035s : 0.01% auto_monad : 0.000100s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000773s : 0.19% rewriter_before_opt_a : 0.000160s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000107s : 0.03% jit_opt_a.loop_unroll : 0.000049s : 0.01% jit_opt_a.a_1 : 0.001332s : 0.32% jit_opt_a.with_stream_mark : 0.000057s : 0.01% jit_opt_a.recompute_prepare : 0.000028s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000020s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000018s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000009s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000052s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000028s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.033044s : 8.05% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000077s : 0.02% jit_opt_a.replace_applicator : 0.000061s : 0.01% py_interpret_to_execute_after_opt_a : 0.000025s : 0.01% rewriter_after_opt_a : 0.000056s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001061s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000038s : 0.01% loop_unroll : 0.000712s : 0.17% jit_opt_after_cconv.c_1 : 0.000034s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000024s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000060s : 0.01% cse_after_recomputation.cse : 0.000020s : 0.00% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000780s : 0.19% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000083s : 0.02% Time group info: ------[substitution.] 0.000503 25 0.52% : 0.000003s : 2: substitution.elim_not_effective 0.34% : 0.000002s : 2: substitution.fold_const_symbol 1.73% : 0.000009s : 4: substitution.graph_param_transform 89.15% : 0.000449s : 5: substitution.inline 1.25% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.38% : 0.000007s : 4: substitution.remove_not_recompute_node 1.58% : 0.000008s : 2: substitution.replace_old_param 4.06% : 0.000020s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.370322 2 98.61% : 0.365187s : 1: type_inference.infer 1.39% : 0.005135s : 1: type_inference.specialize ------[replace.] 0.000190 7 66.29% : 0.000126s : 5: replace.inline 33.71% : 0.000064s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000461 7 96.14% : 0.000443s : 5: match.inline 3.86% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000208 888 0.93% : 0.000002s : 13: predicate.accumulaten_eliminater 1.44% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.38% : 0.000003s : 13: predicate.addn_check_dump 1.62% : 0.000003s : 13: predicate.addn_zero_filter 2.48% : 0.000005s : 13: predicate.arithmetic_simplify 1.36% : 0.000003s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.89% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 0.88% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.80% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.07% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000003s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.87% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000003s : 13: predicate.environ_get_eliminate 0.76% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 5.64% : 0.000012s : 28: predicate.inline 0.93% : 0.000002s : 8: predicate.inline_without_move 0.30% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.80% : 0.000004s : 8: predicate.less_batch_normalization 2.29% : 0.000005s : 15: predicate.list_to_tuple_eliminator_ 1.40% : 0.000003s : 19: predicate.load_eliminater 1.89% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000008s : 41: predicate.loop_unroll_before_grad 1.85% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.85% : 0.000002s : 13: predicate.merge_addn 0.99% : 0.000002s : 13: predicate.minmaximum_grad 2.48% : 0.000005s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 1.83% : 0.000004s : 19: predicate.partial_eliminate 1.46% : 0.000003s : 13: predicate.print_const_string_wrapper 2.11% : 0.000004s : 13: predicate.reduce_eliminate 1.69% : 0.000004s : 15: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000002s : 8: predicate.remove_not_recompute_node 1.88% : 0.000004s : 23: predicate.replace_applicator 0.75% : 0.000002s : 8: predicate.replace_old_param 0.22% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000003s : 13: predicate.reshape_eliminate 1.90% : 0.000004s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 0.99% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000002s : 8: predicate.special_op_eliminate 0.78% : 0.000002s : 8: predicate.specialize_transform 1.35% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 4.30% : 0.000009s : 20: predicate.switch_defer_inline 1.47% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.42% : 0.000015s : 65: predicate.switch_simplify 1.12% : 0.000002s : 13: predicate.tile_eliminate 1.07% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 0.94% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.36% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.44% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.30% : 0.000007s : 27: predicate.updatestate_useless_node_eliminater 1.84% : 0.000004s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004995 29 58.44% : 0.002919s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.60% : 0.000180s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.95% : 0.001896s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.452620 72 0.01% : 0.000064s : 1: add_recomputation 0.02% : 0.000105s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.10% : 0.000470s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000040s : 1: cse_after_recomputation 0.00% : 0.000017s : 1: environ_conv 0.01% : 0.000041s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 9.31% : 0.042130s : 1: jit_opt_a 0.05% : 0.000232s : 1: jit_opt_after_cconv 0.02% : 0.000076s : 1: jit_opt_b 0.16% : 0.000726s : 1: loop_unroll 0.24% : 0.001075s : 1: mutable_eliminate 0.38% : 0.001720s : 26: opt.transform.jit_opt_a 0.02% : 0.000075s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000792s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.17% : 0.000791s : 1: py_interpret_to_execute 0.01% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000027s : 1: remove_dup_value 6.85% : 0.030992s : 1: renormalize.infer 0.45% : 0.002032s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000060s : 1: rewriter_after_opt_a 0.04% : 0.000168s : 1: rewriter_before_opt_a 0.02% : 0.000097s : 1: symbol_engine_optimizer 81.87% : 0.370555s : 1: type_inference TotalTime = 0.0162256, [30] [bootstrap]: 0.00033024 [type_inference]: 0.00728518 [event_method]: 2.257e-05 [auto_monad]: 7.64e-05 [graph_reusing]: 6.82002e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 4.689e-05 [rewriter_before_opt_a]: 8.211e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00601749, [2] [Cycle 1]: 0.00207895, [27] [switch_simplify]: 6.379e-05 [loop_unroll]: 3.048e-05 [a_1]: 0.00078187 [with_stream_mark]: 2.832e-05 [recompute_prepare]: 1.023e-05 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.668e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 5.11997e-06 [renormalize]: 0.00080044 [add_forward_monad_depend]: 5.22999e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.499e-05 [cse]: 4.175e-05 [replace_applicator]: 1.201e-05 [Cycle 2]: 0.000315, [27] [switch_simplify]: 5.62999e-06 [loop_unroll]: 4.74998e-06 [a_1]: 8.867e-05 [with_stream_mark]: 9.64999e-06 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.202e-05 [j_node_and_user_rematch]: 7.95998e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.44002e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.247e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.33e-05 [rewriter_after_opt_a]: 3.954e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00069841 [jit_opt_b]: 5.014e-05, [1] [Cycle 1]: 4.266e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.533e-05 [cconv]: 2.991e-05 [loop_unroll]: 0.00043131 [jit_opt_after_cconv]: 0.00016285, [1] [Cycle 1]: 0.00015598, [11] [c_1]: 2.099e-05 [parameter_eliminate]: 3.40998e-06 [updatestate_depend_eliminate]: 8.64e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.826e-05 [call_graph_tuple_transform]: 2.01e-05 [tuple_list_get_item_eliminator]: 5.09e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 1.257e-05 [remove_dup_value]: 1.768e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 7.01001e-06 [add_recomputation]: 5.484e-05 [cse_after_recomputation]: 2.585e-05, [1] [Cycle 1]: 1.943e-05, [1] [cse]: 1.304e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 2.58998e-06 [rewriter_after_jit_bprop_graph]: 5.81e-06 [opt_after_jit_grad]: 0.00046942 [symbol_engine_optimizer]: 7.73e-05, [1] [Cycle 1]: 6.931e-05, [6] [build]: 4.60001e-06 [elim_shapecalc]: 7.75998e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 5.39992e-07 [validate]: 4.718e-05 Sums bootstrap : 0.000330s : 2.76% type_inference : 0.007285s : 60.78% event_method : 0.000023s : 0.19% auto_monad : 0.000076s : 0.64% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.39% rewriter_before_opt_a : 0.000082s : 0.69% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.58% jit_opt_a.loop_unroll : 0.000035s : 0.29% jit_opt_a.a_1 : 0.000871s : 7.26% jit_opt_a.with_stream_mark : 0.000038s : 0.32% jit_opt_a.recompute_prepare : 0.000015s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000801s : 6.68% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.18% jit_opt_a.cse : 0.000054s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000040s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000698s : 5.83% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000030s : 0.25% loop_unroll : 0.000431s : 3.60% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000013s : 0.10% remove_dup_value : 0.000018s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000055s : 0.46% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000469s : 3.92% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.39% Time group info: ------[substitution.] 0.000247 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 85.38% : 0.000211s : 4: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 2.46% : 0.000006s : 2: substitution.replace_old_param 5.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007203 2 73.09% : 0.005265s : 1: type_inference.infer 26.91% : 0.001939s : 1: type_inference.specialize ------[replace.] 0.000071 6 70.69% : 0.000050s : 4: replace.inline 29.31% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.61% : 0.000209s : 4: match.inline 5.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.52% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.47% : 0.000001s : 3: predicate.graph_param_transform 6.41% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.39% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.25% : 0.000003s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.56% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.64% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000672 13 50.45% : 0.000339s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.92% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.63% : 0.000280s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018174 72 0.32% : 0.000058s : 1: add_recomputation 0.44% : 0.000079s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.93% : 0.000350s : 1: bootstrap 0.18% : 0.000032s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.15% : 0.000028s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 33.13% : 0.006021s : 1: jit_opt_a 0.91% : 0.000166s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.42% : 0.000440s : 1: loop_unroll 3.90% : 0.000708s : 1: mutable_eliminate 6.03% : 0.001097s : 26: opt.transform.jit_opt_a 0.31% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.63% : 0.000479s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000049s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.53% : 0.000460s : 1: renormalize.infer 1.82% : 0.000331s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000043s : 1: rewriter_after_opt_a 0.47% : 0.000085s : 1: rewriter_before_opt_a 0.44% : 0.000080s : 1: symbol_engine_optimizer 40.20% : 0.007307s : 1: type_inference TotalTime = 0.0378418, [30] [bootstrap]: 0.00038285 [type_inference]: 0.0268297 [event_method]: 2.146e-05 [auto_monad]: 7.011e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 9.833e-05 [rewriter_before_opt_a]: 8.306e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00789894, [2] [Cycle 1]: 0.00274527, [27] [switch_simplify]: 6.466e-05 [loop_unroll]: 2.875e-05 [a_1]: 0.00061004 [with_stream_mark]: 2.421e-05 [recompute_prepare]: 7.48e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.57001e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00162951 [add_forward_monad_depend]: 9.35001e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.882e-05 [cse]: 3.957e-05 [replace_applicator]: 1.827e-05 [Cycle 2]: 0.00033962, [27] [switch_simplify]: 5.89999e-06 [loop_unroll]: 5.50001e-06 [a_1]: 9.267e-05 [with_stream_mark]: 1.524e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.47997e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 4.84998e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 3.9e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 8.21002e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.81001e-06 [inline_without_move]: 5.03002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.03002e-06 [cse]: 1.24e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.707e-05 [rewriter_after_opt_a]: 4.099e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.0007213 [jit_opt_b]: 5.275e-05, [1] [Cycle 1]: 4.448e-05, [2] [frontend_op_eliminate]: 1.616e-05 [inline_after_opt_a]: 1.736e-05 [cconv]: 3.101e-05 [loop_unroll]: 0.00044513 [jit_opt_after_cconv]: 0.00015819, [1] [Cycle 1]: 0.00015146, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 4.87e-06 [updatestate_depend_eliminate]: 8.97e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.991e-05 [call_graph_tuple_transform]: 2.077e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.784e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 6.24999e-06 [add_recomputation]: 5.721e-05 [cse_after_recomputation]: 2.618e-05, [1] [Cycle 1]: 2.017e-05, [1] [cse]: 1.375e-05 [auto_monad_reorder]: 1.842e-05 [get_jit_bprop_graph]: 3.11001e-06 [rewriter_after_jit_bprop_graph]: 7.72002e-06 [opt_after_jit_grad]: 0.00047421 [symbol_engine_optimizer]: 7.459e-05, [1] [Cycle 1]: 6.766e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.238e-05 [opt_reshape]: 6.16998e-06 [fold_const_symbol]: 1.008e-05 [renormalize]: 6.19999e-07 [validate]: 4.676e-05 Sums bootstrap : 0.000383s : 1.18% type_inference : 0.026830s : 82.91% event_method : 0.000021s : 0.07% auto_monad : 0.000070s : 0.22% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000098s : 0.30% rewriter_before_opt_a : 0.000083s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.22% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000703s : 2.17% jit_opt_a.with_stream_mark : 0.000039s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001630s : 5.04% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.08% jit_opt_a.cse : 0.000052s : 0.16% jit_opt_a.replace_applicator : 0.000023s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000041s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000721s : 2.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000031s : 0.10% loop_unroll : 0.000445s : 1.38% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000057s : 0.18% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000474s : 1.47% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.14% Time group info: ------[substitution.] 0.000266 23 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 85.26% : 0.000227s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000006s : 2: substitution.replace_old_param 5.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026749 2 94.17% : 0.025190s : 1: type_inference.infer 5.83% : 0.001559s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.18% : 0.000055s : 4: replace.inline 29.82% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 94.49% : 0.000224s : 4: match.inline 5.51% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.20% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.01% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.65% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.16% : 0.000001s : 6: predicate.specialize_transform 1.22% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.56% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.95% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000986 13 49.60% : 0.000489s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.83% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.58% : 0.000439s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040423 72 0.15% : 0.000061s : 1: add_recomputation 0.18% : 0.000074s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.02% : 0.000411s : 1: bootstrap 0.08% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.55% : 0.007903s : 1: jit_opt_a 0.40% : 0.000161s : 1: jit_opt_after_cconv 0.14% : 0.000055s : 1: jit_opt_b 1.12% : 0.000454s : 1: loop_unroll 1.81% : 0.000733s : 1: mutable_eliminate 2.31% : 0.000935s : 26: opt.transform.jit_opt_a 0.12% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000483s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000101s : 1: py_interpret_to_execute 0.05% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.76% : 0.001117s : 1: renormalize.infer 1.24% : 0.000500s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000044s : 1: rewriter_after_opt_a 0.22% : 0.000087s : 1: rewriter_before_opt_a 0.19% : 0.000077s : 1: symbol_engine_optimizer 66.43% : 0.026853s : 1: type_inference TotalTime = 0.307322, [30] [bootstrap]: 0.00050923 [type_inference]: 0.210343 [event_method]: 2.496e-05 [auto_monad]: 8.762e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.80997e-06 [py_interpret_to_execute]: 0.00046735 [rewriter_before_opt_a]: 0.00010753 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.0393454, [2] [Cycle 1]: 0.0200125, [27] [switch_simplify]: 9.405e-05 [loop_unroll]: 3.542e-05 [a_1]: 0.00101873 [with_stream_mark]: 2.921e-05 [recompute_prepare]: 1.703e-05 [updatestate_depend_eliminate]: 6.06998e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 9.74e-06 [updatestate_useless_node_eliminater]: 8.13999e-06 [accelerated_algorithm]: 9.31e-06 [meta_shard_fg_expand]: 4.07998e-06 [get_grad_eliminate_]: 8.12e-06 [merge_forward]: 4.83001e-06 [cell_reuse_recompute_pass]: 2.79001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.127e-05 [j_node_and_user_rematch]: 1.353e-05 [meta_fg_expand]: 4.37e-06 [replace_old_param]: 1.362e-05 [inline_without_move]: 7.66999e-06 [renormalize]: 0.00290427 [add_forward_monad_depend]: 2.276e-05 [auto_monad_grad]: 3.70998e-06 [auto_monad_eliminator]: 5.664e-05 [cse]: 5.538e-05 [replace_applicator]: 4.083e-05 [Cycle 2]: 0.00062858, [27] [switch_simplify]: 1.009e-05 [loop_unroll]: 8.18999e-06 [a_1]: 0.00017497 [with_stream_mark]: 2.293e-05 [recompute_prepare]: 9.34e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.79999e-06 [accelerated_algorithm]: 8.75001e-06 [meta_shard_fg_expand]: 3.9e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 5.92999e-06 [cell_reuse_recompute_pass]: 4.78001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.271e-05 [j_node_and_user_rematch]: 9.574e-05 [meta_fg_expand]: 4.92e-06 [replace_old_param]: 1.461e-05 [inline_without_move]: 7.14001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.44999e-06 [auto_monad_grad]: 1.15999e-06 [auto_monad_eliminator]: 1.291e-05 [cse]: 1.871e-05 [replace_applicator]: 7.5e-06 [py_interpret_to_execute_after_opt_a]: 7.216e-05 [rewriter_after_opt_a]: 0.00010422 [convert_after_rewriter]: 1.075e-05 [order_py_execute_after_rewriter]: 9.30001e-06 [mutable_eliminate]: 0.00155413 [jit_opt_b]: 0.00010891, [1] [Cycle 1]: 9.2e-05, [2] [frontend_op_eliminate]: 4.163e-05 [inline_after_opt_a]: 3.481e-05 [cconv]: 4.726e-05 [loop_unroll]: 0.018292 [jit_opt_after_cconv]: 0.0003418, [1] [Cycle 1]: 0.00032683, [11] [c_1]: 4.205e-05 [parameter_eliminate]: 8.35001e-06 [updatestate_depend_eliminate]: 1.572e-05 [updatestate_assign_eliminate]: 3.72002e-06 [updatestate_loads_eliminate]: 3.25e-06 [cse]: 4.95e-05 [call_graph_tuple_transform]: 3.568e-05 [tuple_list_get_item_eliminator]: 1.011e-05 [none_parameter_eliminate]: 2.14999e-06 [renormalize]: 7.2e-07 [switch_simplify]: 9.55001e-06 [remove_dup_value]: 1.899e-05 [partial_unused_args_eliminate]: 3.16001e-06 [environ_conv]: 1.21e-05 [add_recomputation]: 7.182e-05 [cse_after_recomputation]: 3.101e-05, [1] [Cycle 1]: 2.313e-05, [1] [cse]: 1.577e-05 [auto_monad_reorder]: 1.838e-05 [get_jit_bprop_graph]: 3.73001e-06 [rewriter_after_jit_bprop_graph]: 1.259e-05 [opt_after_jit_grad]: 0.00088552 [symbol_engine_optimizer]: 0.00010765, [1] [Cycle 1]: 9.85e-05, [6] [build]: 6.02001e-06 [elim_shapecalc]: 1.202e-05 [elim_not_effective]: 2.044e-05 [opt_reshape]: 9.79e-06 [fold_const_symbol]: 1.435e-05 [renormalize]: 8.50006e-07 [validate]: 6.257e-05 Sums bootstrap : 0.000509s : 0.21% type_inference : 0.210343s : 88.40% event_method : 0.000025s : 0.01% auto_monad : 0.000088s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000467s : 0.20% rewriter_before_opt_a : 0.000108s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000104s : 0.04% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.001194s : 0.50% jit_opt_a.with_stream_mark : 0.000052s : 0.02% jit_opt_a.recompute_prepare : 0.000026s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000109s : 0.05% jit_opt_a.meta_fg_expand : 0.000009s : 0.00% jit_opt_a.replace_old_param : 0.000028s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.002904s : 1.22% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000070s : 0.03% jit_opt_a.cse : 0.000074s : 0.03% jit_opt_a.replace_applicator : 0.000048s : 0.02% py_interpret_to_execute_after_opt_a : 0.000072s : 0.03% rewriter_after_opt_a : 0.000104s : 0.04% convert_after_rewriter : 0.000011s : 0.00% order_py_execute_after_rewriter : 0.000009s : 0.00% mutable_eliminate : 0.001554s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000042s : 0.02% jit_opt_b.inline_after_opt_a : 0.000035s : 0.01% cconv : 0.000047s : 0.02% loop_unroll : 0.018292s : 7.69% jit_opt_after_cconv.c_1 : 0.000042s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000072s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.01% opt_after_jit_grad : 0.000886s : 0.37% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.03% Time group info: ------[substitution.] 0.000552 24 0.56% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000003s : 2: substitution.fold_const_symbol 1.62% : 0.000009s : 4: substitution.graph_param_transform 74.18% : 0.000409s : 4: substitution.inline 15.82% : 0.000087s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000010s : 4: substitution.remove_not_recompute_node 1.96% : 0.000011s : 2: substitution.replace_old_param 3.44% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.210176 2 91.66% : 0.192644s : 1: type_inference.infer 8.34% : 0.017532s : 1: type_inference.specialize ------[replace.] 0.000147 6 67.13% : 0.000099s : 4: replace.inline 32.87% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000422 6 95.96% : 0.000405s : 4: match.inline 4.04% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000223 830 1.04% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000002s : 12: predicate.addn_check_dump 1.23% : 0.000003s : 12: predicate.addn_zero_filter 2.48% : 0.000006s : 12: predicate.arithmetic_simplify 1.35% : 0.000003s : 12: predicate.cast_eliminate 0.82% : 0.000002s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 12: predicate.compare_switch_simplify 1.03% : 0.000002s : 12: predicate.depend_value_elim 0.98% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.96% : 0.000004s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.73% : 0.000004s : 12: predicate.environ_add_const_eliminate 0.87% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 0.86% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.17% : 0.000000s : 4: predicate.graph_param_transform 4.92% : 0.000011s : 26: predicate.inline 0.54% : 0.000001s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.96% : 0.000004s : 8: predicate.less_batch_normalization 1.41% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.61% : 0.000004s : 18: predicate.load_eliminater 4.12% : 0.000009s : 4: predicate.loop_unroll_after_grad 2.52% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.91% : 0.000006s : 16: predicate.make_slice_get_slice_eliminator 1.29% : 0.000003s : 12: predicate.merge_addn 0.75% : 0.000002s : 12: predicate.minmaximum_grad 3.09% : 0.000007s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 1.45% : 0.000003s : 18: predicate.partial_eliminate 1.01% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000004s : 12: predicate.reduce_eliminate 1.29% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 8: predicate.remove_not_recompute_node 1.71% : 0.000004s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.56% : 0.000001s : 4: predicate.reset_defer_inline 0.99% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 1.13% : 0.000003s : 4: predicate.row_tensor_eliminate 0.90% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000003s : 8: predicate.special_op_eliminate 0.64% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.46% : 0.000008s : 18: predicate.switch_defer_inline 1.44% : 0.000003s : 18: predicate.switch_layer_defer_inline 5.45% : 0.000012s : 58: predicate.switch_simplify 1.13% : 0.000003s : 12: predicate.tile_eliminate 1.38% : 0.000003s : 12: predicate.transpose_eliminate 1.28% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 4.43% : 0.000010s : 22: predicate.tuple_list_get_item_eliminator 2.48% : 0.000006s : 12: predicate.tuple_list_set_item_eliminator 1.70% : 0.000004s : 14: predicate.tuple_to_list_eliminator_ 1.38% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.50% : 0.000006s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000004s : 12: predicate.value_based_eliminate 0.22% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.21% : 0.000003s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003529 18 73.58% : 0.002597s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.76% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.66% : 0.000870s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.312005 72 0.02% : 0.000075s : 1: add_recomputation 0.03% : 0.000091s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.17% : 0.000536s : 1: bootstrap 0.02% : 0.000051s : 1: cconv 0.00% : 0.000013s : 1: convert_after_rewriter 0.01% : 0.000033s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 23.61% : 0.073654s : 1: jit_opt_a 0.11% : 0.000347s : 1: jit_opt_after_cconv 0.04% : 0.000113s : 1: jit_opt_b 5.87% : 0.018324s : 1: loop_unroll 0.50% : 0.001575s : 1: mutable_eliminate 0.53% : 0.001642s : 26: opt.transform.jit_opt_a 0.03% : 0.000092s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000063s : 4: opt.transform.jit_opt_b 0.02% : 0.000049s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000039s : 1: opt.transform.mutable_eliminate 0.01% : 0.000044s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000899s : 1: opt_after_jit_grad 0.00% : 0.000011s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000481s : 1: py_interpret_to_execute 0.03% : 0.000084s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.58% : 0.001796s : 1: renormalize.infer 0.35% : 0.001090s : 1: renormalize.specialize 0.00% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000111s : 1: rewriter_after_opt_a 0.04% : 0.000114s : 1: rewriter_before_opt_a 0.04% : 0.000111s : 1: symbol_engine_optimizer 67.43% : 0.210376s : 1: type_inference . TotalTime = 0.0449737, [30] [bootstrap]: 0.00034662 [type_inference]: 0.0317452 [event_method]: 2.375e-05 [auto_monad]: 7.634e-05 [graph_reusing]: 7.36001e-06 [pre_auto_parallel]: 3.00002e-06 [py_interpret_to_execute]: 0.00011952 [rewriter_before_opt_a]: 8.894e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0100688, [2] [Cycle 1]: 0.00591584, [27] [switch_simplify]: 5.808e-05 [loop_unroll]: 2.896e-05 [a_1]: 0.00055052 [with_stream_mark]: 2.192e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.14003e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00485745 [add_forward_monad_depend]: 1.426e-05 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 2.63e-05 [cse]: 4.026e-05 [replace_applicator]: 2.412e-05 [Cycle 2]: 0.00036376, [27] [switch_simplify]: 6.23e-06 [loop_unroll]: 5.60001e-06 [a_1]: 0.00010182 [with_stream_mark]: 1.725e-05 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 5.11002e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 4.97999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 3.61001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.94e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 5.12e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.418e-05 [replace_applicator]: 5.47001e-06 [py_interpret_to_execute_after_opt_a]: 3.515e-05 [rewriter_after_opt_a]: 4.42e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00079653 [jit_opt_b]: 5.211e-05, [1] [Cycle 1]: 4.294e-05, [2] [frontend_op_eliminate]: 1.524e-05 [inline_after_opt_a]: 1.614e-05 [cconv]: 3.186e-05 [loop_unroll]: 0.00043371 [jit_opt_after_cconv]: 0.00014766, [1] [Cycle 1]: 0.00014101, [11] [c_1]: 2.168e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 6.47001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.378e-05 [call_graph_tuple_transform]: 1.948e-05 [tuple_list_get_item_eliminator]: 5.46002e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.911e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 6.68e-06 [add_recomputation]: 5.335e-05 [cse_after_recomputation]: 2.353e-05, [1] [Cycle 1]: 1.775e-05, [1] [cse]: 1.171e-05 [auto_monad_reorder]: 1.8e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 7.25e-06 [opt_after_jit_grad]: 0.00048781 [symbol_engine_optimizer]: 7.211e-05, [1] [Cycle 1]: 6.584e-05, [6] [build]: 4.55999e-06 [elim_shapecalc]: 7.1e-06 [elim_not_effective]: 1.292e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.62e-06 [renormalize]: 2.79979e-07 [validate]: 4.411e-05 Sums bootstrap : 0.000347s : 0.85% type_inference : 0.031745s : 78.29% event_method : 0.000024s : 0.06% auto_monad : 0.000076s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000120s : 0.29% rewriter_before_opt_a : 0.000089s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000652s : 1.61% jit_opt_a.with_stream_mark : 0.000039s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.004858s : 11.98% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.08% jit_opt_a.cse : 0.000054s : 0.13% jit_opt_a.replace_applicator : 0.000030s : 0.07% py_interpret_to_execute_after_opt_a : 0.000035s : 0.09% rewriter_after_opt_a : 0.000044s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000797s : 1.96% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000032s : 0.08% loop_unroll : 0.000434s : 1.07% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000488s : 1.20% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.11% Time group info: ------[substitution.] 0.000227 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 83.47% : 0.000190s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.94% : 0.000007s : 2: substitution.replace_old_param 5.43% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031651 2 94.53% : 0.029920s : 1: type_inference.infer 5.47% : 0.001730s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.99% : 0.000049s : 4: replace.inline 32.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.34% : 0.000187s : 4: match.inline 5.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.85% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.53% : 0.000002s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.39% : 0.000002s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000006s : 22: predicate.inline 1.13% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.95% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 2.18% : 0.000003s : 10: predicate.reshape_eliminate 1.54% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000997 13 40.97% : 0.000409s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.51% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.52% : 0.000544s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050762 72 0.11% : 0.000056s : 1: add_recomputation 0.16% : 0.000080s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.73% : 0.000370s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 19.84% : 0.010072s : 1: jit_opt_a 0.30% : 0.000150s : 1: jit_opt_after_cconv 0.11% : 0.000055s : 1: jit_opt_b 0.87% : 0.000442s : 1: loop_unroll 1.59% : 0.000807s : 1: mutable_eliminate 1.74% : 0.000886s : 26: opt.transform.jit_opt_a 0.10% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.98% : 0.000497s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000123s : 1: py_interpret_to_execute 0.08% : 0.000038s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.03% : 0.000524s : 1: renormalize.infer 8.51% : 0.004321s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000047s : 1: rewriter_after_opt_a 0.19% : 0.000094s : 1: rewriter_before_opt_a 0.15% : 0.000075s : 1: symbol_engine_optimizer 62.59% : 0.031774s : 1: type_inference TotalTime = 0.0146042, [30] [bootstrap]: 0.00032803 [type_inference]: 0.00527817 [event_method]: 2.143e-05 [auto_monad]: 7.242e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 4.015e-05 [rewriter_before_opt_a]: 7.896e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00627122, [2] [Cycle 1]: 0.0022185, [27] [switch_simplify]: 6.502e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.00092798 [with_stream_mark]: 2.596e-05 [recompute_prepare]: 9.33002e-06 [updatestate_depend_eliminate]: 4.34997e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.78997e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.101e-05 [inline_without_move]: 5.51e-06 [renormalize]: 0.00078952 [add_forward_monad_depend]: 5.77001e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.891e-05 [cse]: 3.773e-05 [replace_applicator]: 1.37e-05 [Cycle 2]: 0.00032977, [27] [switch_simplify]: 6.23e-06 [loop_unroll]: 5.13002e-06 [a_1]: 9.099e-05 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 4.92999e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 5.24003e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.12998e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 8.22998e-06 [inline_without_move]: 5.24e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.292e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.463e-05 [rewriter_after_opt_a]: 4.087e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00070385 [jit_opt_b]: 5.413e-05, [1] [Cycle 1]: 4.628e-05, [2] [frontend_op_eliminate]: 1.678e-05 [inline_after_opt_a]: 1.81e-05 [cconv]: 2.925e-05 [loop_unroll]: 0.00045199 [jit_opt_after_cconv]: 0.00017054, [1] [Cycle 1]: 0.00016303, [11] [c_1]: 2.124e-05 [parameter_eliminate]: 3.41001e-06 [updatestate_depend_eliminate]: 1.847e-05 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.989e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.773e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.4e-06 [add_recomputation]: 5.692e-05 [cse_after_recomputation]: 2.458e-05, [1] [Cycle 1]: 1.867e-05, [1] [cse]: 1.254e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 6.60002e-06 [opt_after_jit_grad]: 0.00055896 [symbol_engine_optimizer]: 7.922e-05, [1] [Cycle 1]: 7.163e-05, [6] [build]: 4.77998e-06 [elim_shapecalc]: 7.51001e-06 [elim_not_effective]: 1.497e-05 [opt_reshape]: 5.65001e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 3.89991e-07 [validate]: 4.89e-05 Sums bootstrap : 0.000328s : 3.20% type_inference : 0.005278s : 51.56% event_method : 0.000021s : 0.21% auto_monad : 0.000072s : 0.71% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000040s : 0.39% rewriter_before_opt_a : 0.000079s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000071s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.34% jit_opt_a.a_1 : 0.001019s : 9.95% jit_opt_a.with_stream_mark : 0.000038s : 0.37% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000790s : 7.71% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.25% jit_opt_a.cse : 0.000051s : 0.49% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000015s : 0.14% rewriter_after_opt_a : 0.000041s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000704s : 6.88% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.16% jit_opt_b.inline_after_opt_a : 0.000018s : 0.18% cconv : 0.000029s : 0.29% loop_unroll : 0.000452s : 4.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000018s : 0.18% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000030s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000057s : 0.56% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000019s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000559s : 5.46% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.48% Time group info: ------[substitution.] 0.000558 23 0.38% : 0.000002s : 2: substitution.elim_not_effective 0.25% : 0.000001s : 2: substitution.fold_const_symbol 1.05% : 0.000006s : 3: substitution.graph_param_transform 92.91% : 0.000519s : 4: substitution.inline 0.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.12% : 0.000006s : 2: substitution.replace_old_param 2.66% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005199 2 82.33% : 0.004280s : 1: type_inference.infer 17.67% : 0.000919s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.10% : 0.000060s : 4: replace.inline 30.90% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000529 6 97.44% : 0.000516s : 4: match.inline 2.56% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.88% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.62% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000008s : 22: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 2.05% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.92% : 0.000004s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 2.03% : 0.000003s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.55% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.16% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.90% : 0.000004s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.07% : 0.000010s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.52% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000707 13 52.89% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.27% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.83% : 0.000274s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016691 72 0.36% : 0.000060s : 1: add_recomputation 0.45% : 0.000076s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 2.10% : 0.000350s : 1: bootstrap 0.19% : 0.000032s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.16% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.59% : 0.006275s : 1: jit_opt_a 1.04% : 0.000173s : 1: jit_opt_after_cconv 0.34% : 0.000057s : 1: jit_opt_b 2.77% : 0.000462s : 1: loop_unroll 4.29% : 0.000716s : 1: mutable_eliminate 7.49% : 0.001250s : 26: opt.transform.jit_opt_a 0.29% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000017s : 1: opt.transform.mutable_eliminate 0.15% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.41% : 0.000570s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000044s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 2.61% : 0.000436s : 1: renormalize.infer 2.06% : 0.000344s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000044s : 1: rewriter_after_opt_a 0.50% : 0.000083s : 1: rewriter_before_opt_a 0.49% : 0.000082s : 1: symbol_engine_optimizer 31.76% : 0.005301s : 1: type_inference TotalTime = 0.042019, [30] [bootstrap]: 0.00033319 [type_inference]: 0.0327503 [event_method]: 1.959e-05 [auto_monad]: 6.675e-05 [graph_reusing]: 5.98002e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 9.789e-05 [rewriter_before_opt_a]: 8.33e-05 [expand_dump_flag]: 3.62002e-06 [jit_opt_a]: 0.00644852, [2] [Cycle 1]: 0.00186094, [27] [switch_simplify]: 6.152e-05 [loop_unroll]: 2.91e-05 [a_1]: 0.00052725 [with_stream_mark]: 1.833e-05 [recompute_prepare]: 7.11999e-06 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00088514 [add_forward_monad_depend]: 5.96e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.577e-05 [cse]: 3.247e-05 [replace_applicator]: 1.378e-05 [Cycle 2]: 0.00031673, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 5.07e-06 [a_1]: 8.846e-05 [with_stream_mark]: 9.61998e-06 [recompute_prepare]: 5.14998e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.383e-05 [j_node_and_user_rematch]: 7.46999e-06 [meta_fg_expand]: 1.81998e-06 [replace_old_param]: 7.18e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.45999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 1.333e-05 [replace_applicator]: 5.04003e-06 [py_interpret_to_execute_after_opt_a]: 1.277e-05 [rewriter_after_opt_a]: 3.751e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00062497 [jit_opt_b]: 4.878e-05, [1] [Cycle 1]: 4.175e-05, [2] [frontend_op_eliminate]: 1.536e-05 [inline_after_opt_a]: 1.543e-05 [cconv]: 2.731e-05 [loop_unroll]: 0.00042215 [jit_opt_after_cconv]: 0.00013925, [1] [Cycle 1]: 0.00013243, [11] [c_1]: 2.064e-05 [parameter_eliminate]: 2.53998e-06 [updatestate_depend_eliminate]: 5.99999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.054e-05 [call_graph_tuple_transform]: 1.891e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.21002e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.74001e-06 [environ_conv]: 6.43998e-06 [add_recomputation]: 4.928e-05 [cse_after_recomputation]: 2.186e-05, [1] [Cycle 1]: 1.698e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.00045684 [symbol_engine_optimizer]: 7.336e-05, [1] [Cycle 1]: 6.638e-05, [6] [build]: 4.25e-06 [elim_shapecalc]: 7.78001e-06 [elim_not_effective]: 1.344e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 3.69997e-07 [validate]: 3.761e-05 Sums bootstrap : 0.000333s : 0.90% type_inference : 0.032750s : 88.14% event_method : 0.000020s : 0.05% auto_monad : 0.000067s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000098s : 0.26% rewriter_before_opt_a : 0.000083s : 0.22% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.18% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000616s : 1.66% jit_opt_a.with_stream_mark : 0.000028s : 0.08% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000885s : 2.38% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000046s : 0.12% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000625s : 1.68% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.000422s : 1.14% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000457s : 1.23% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.10% Time group info: ------[substitution.] 0.000200 23 1.34% : 0.000003s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000005s : 3: substitution.graph_param_transform 83.08% : 0.000166s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 6.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.032655 2 95.31% : 0.031124s : 1: type_inference.infer 4.69% : 0.001531s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.63% : 0.000049s : 4: replace.inline 32.37% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.69% : 0.000164s : 4: match.inline 6.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.62% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.94% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.86% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.02% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000855 13 48.57% : 0.000415s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.58% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.85% : 0.000409s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043791 72 0.12% : 0.000052s : 1: add_recomputation 0.16% : 0.000070s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.81% : 0.000354s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000039s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 14.73% : 0.006452s : 1: jit_opt_a 0.32% : 0.000142s : 1: jit_opt_after_cconv 0.12% : 0.000051s : 1: jit_opt_b 0.98% : 0.000430s : 1: loop_unroll 1.45% : 0.000633s : 1: mutable_eliminate 1.91% : 0.000835s : 26: opt.transform.jit_opt_a 0.11% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.06% : 0.000465s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000101s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.11% : 0.000487s : 1: renormalize.infer 0.89% : 0.000390s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000041s : 1: rewriter_after_opt_a 0.20% : 0.000087s : 1: rewriter_before_opt_a 0.17% : 0.000076s : 1: symbol_engine_optimizer 74.83% : 0.032769s : 1: type_inference TotalTime = 0.362118, [30] [bootstrap]: 0.00038849 [type_inference]: 0.258737 [event_method]: 2.127e-05 [auto_monad]: 7.385e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.0002615 [rewriter_before_opt_a]: 9.119e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.100007, [2] [Cycle 1]: 0.0962445, [27] [switch_simplify]: 5.939e-05 [loop_unroll]: 3.478e-05 [a_1]: 0.00068369 [with_stream_mark]: 2.112e-05 [recompute_prepare]: 9.51998e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 1.079e-05 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.98002e-06 [inline_without_move]: 6.53e-06 [renormalize]: 0.0950138 [add_forward_monad_depend]: 1.334e-05 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.761e-05 [cse]: 4.162e-05 [replace_applicator]: 2.69e-05 [Cycle 2]: 0.00041437, [27] [switch_simplify]: 8.18999e-06 [loop_unroll]: 7.06001e-06 [a_1]: 0.00013361 [with_stream_mark]: 1.744e-05 [recompute_prepare]: 7e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.13998e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.72001e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.54998e-06 [cell_reuse_recompute_pass]: 3.13998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.863e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 5.94e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 7.35e-06 [cse]: 1.699e-05 [replace_applicator]: 5.93002e-06 [py_interpret_to_execute_after_opt_a]: 1.641e-05 [rewriter_after_opt_a]: 4.402e-05 [convert_after_rewriter]: 7.73999e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00076857 [jit_opt_b]: 5.84e-05, [1] [Cycle 1]: 5.061e-05, [2] [frontend_op_eliminate]: 2.008e-05 [inline_after_opt_a]: 1.857e-05 [cconv]: 2.998e-05 [loop_unroll]: 0.00042831 [jit_opt_after_cconv]: 0.000171, [1] [Cycle 1]: 0.00016365, [11] [c_1]: 2.719e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 8.42e-06 [updatestate_assign_eliminate]: 2.90002e-06 [updatestate_loads_eliminate]: 2.38998e-06 [cse]: 2.916e-05 [call_graph_tuple_transform]: 2.317e-05 [tuple_list_get_item_eliminator]: 7e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 2.097e-05 [partial_unused_args_eliminate]: 2.65002e-06 [environ_conv]: 1.065e-05 [add_recomputation]: 5.443e-05 [cse_after_recomputation]: 2.508e-05, [1] [Cycle 1]: 1.964e-05, [1] [cse]: 1.356e-05 [auto_monad_reorder]: 1.968e-05 [get_jit_bprop_graph]: 2.20002e-06 [rewriter_after_jit_bprop_graph]: 6.05002e-06 [opt_after_jit_grad]: 0.00052946 [symbol_engine_optimizer]: 8.031e-05, [1] [Cycle 1]: 7.266e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.93002e-06 [elim_not_effective]: 1.474e-05 [opt_reshape]: 7.23999e-06 [fold_const_symbol]: 9.71003e-06 [renormalize]: 4.69998e-07 [validate]: 5.449e-05 Sums bootstrap : 0.000388s : 0.11% type_inference : 0.258737s : 72.25% event_method : 0.000021s : 0.01% auto_monad : 0.000074s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000262s : 0.07% rewriter_before_opt_a : 0.000091s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000817s : 0.23% jit_opt_a.with_stream_mark : 0.000039s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.095014s : 26.53% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.01% jit_opt_a.cse : 0.000059s : 0.02% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000769s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000428s : 0.12% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000529s : 0.15% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.02% Time group info: ------[substitution.] 0.000269 25 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000007s : 4: substitution.graph_param_transform 85.37% : 0.000230s : 5: substitution.inline 1.69% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000006s : 4: substitution.remove_not_recompute_node 2.25% : 0.000006s : 2: substitution.replace_old_param 4.59% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.258658 2 99.15% : 0.256471s : 1: type_inference.infer 0.85% : 0.002186s : 1: type_inference.specialize ------[replace.] 0.000095 7 70.00% : 0.000067s : 5: replace.inline 30.00% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 7 95.31% : 0.000227s : 5: match.inline 4.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 888 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 13: predicate.addn_check_dump 1.51% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.36% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000001s : 13: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000001s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.75% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.47% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.13% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 2.03% : 0.000003s : 13: predicate.reduce_eliminate 1.30% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.55% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.66% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.24% : 0.000010s : 65: predicate.switch_simplify 1.17% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.30% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.98% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003149 29 64.37% : 0.002027s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.18% : 0.001045s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.458269 72 0.01% : 0.000058s : 1: add_recomputation 0.02% : 0.000077s : 1: auto_monad 0.00% : 0.000022s : 1: auto_monad_reorder 0.09% : 0.000413s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 21.82% : 0.100011s : 1: jit_opt_a 0.04% : 0.000173s : 1: jit_opt_after_cconv 0.01% : 0.000061s : 1: jit_opt_b 0.10% : 0.000436s : 1: loop_unroll 0.17% : 0.000778s : 1: mutable_eliminate 0.24% : 0.001083s : 26: opt.transform.jit_opt_a 0.01% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000539s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000267s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 20.46% : 0.093772s : 1: renormalize.infer 0.27% : 0.001226s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.02% : 0.000097s : 1: rewriter_before_opt_a 0.02% : 0.000083s : 1: symbol_engine_optimizer 56.46% : 0.258750s : 1: type_inference TotalTime = 0.0311541, [30] [bootstrap]: 0.000293 [type_inference]: 0.0215327 [event_method]: 2.266e-05 [auto_monad]: 7.316e-05 [graph_reusing]: 7.11999e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00010608 [rewriter_before_opt_a]: 8.315e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00590446, [2] [Cycle 1]: 0.00201565, [27] [switch_simplify]: 5.945e-05 [loop_unroll]: 2.95e-05 [a_1]: 0.0005782 [with_stream_mark]: 2.409e-05 [recompute_prepare]: 7.48e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.446e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.00098183 [add_forward_monad_depend]: 6.17001e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 3.663e-05 [replace_applicator]: 1.302e-05 [Cycle 2]: 0.00031333, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.32999e-06 [a_1]: 8.894e-05 [with_stream_mark]: 9.01002e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.34001e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.328e-05 [j_node_and_user_rematch]: 8.57998e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 6.96999e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.04003e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 5.35999e-06 [cse]: 1.258e-05 [replace_applicator]: 5.09003e-06 [py_interpret_to_execute_after_opt_a]: 1.221e-05 [rewriter_after_opt_a]: 4.046e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00058684 [jit_opt_b]: 7.088e-05, [1] [Cycle 1]: 4.454e-05, [2] [frontend_op_eliminate]: 1.647e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 2.748e-05 [loop_unroll]: 0.00125562 [jit_opt_after_cconv]: 0.0001624, [1] [Cycle 1]: 0.00015422, [11] [c_1]: 2.091e-05 [parameter_eliminate]: 5.09998e-06 [updatestate_depend_eliminate]: 8.07e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.954e-05 [call_graph_tuple_transform]: 2.117e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 1.04e-06 [switch_simplify]: 5.54998e-06 [remove_dup_value]: 1.808e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 6.62002e-06 [add_recomputation]: 5.485e-05 [cse_after_recomputation]: 2.337e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.702e-05 [get_jit_bprop_graph]: 2.44999e-06 [rewriter_after_jit_bprop_graph]: 7.53999e-06 [opt_after_jit_grad]: 0.00051372 [symbol_engine_optimizer]: 7.659e-05, [1] [Cycle 1]: 6.915e-05, [6] [build]: 4.33999e-06 [elim_shapecalc]: 8.49002e-06 [elim_not_effective]: 1.359e-05 [opt_reshape]: 6.13998e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 5.10016e-07 [validate]: 4.57e-05 Sums bootstrap : 0.000293s : 1.09% type_inference : 0.021533s : 79.86% event_method : 0.000023s : 0.08% auto_monad : 0.000073s : 0.27% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.39% rewriter_before_opt_a : 0.000083s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000667s : 2.47% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000982s : 3.64% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000049s : 0.18% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000587s : 2.18% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.001256s : 4.66% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000514s : 1.91% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.17% Time group info: ------[substitution.] 0.000244 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000006s : 3: substitution.graph_param_transform 84.95% : 0.000208s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 5.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021451 2 92.25% : 0.019787s : 1: type_inference.infer 7.75% : 0.001663s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.72% : 0.000052s : 4: replace.inline 30.28% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.43% : 0.000205s : 4: match.inline 5.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.70% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 2.23% : 0.000003s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.45% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.68% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.55% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.06% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.12% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000863 13 43.87% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.31% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.82% : 0.000430s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033104 72 0.18% : 0.000059s : 1: add_recomputation 0.23% : 0.000077s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000308s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 17.85% : 0.005907s : 1: jit_opt_a 0.50% : 0.000165s : 1: jit_opt_after_cconv 0.22% : 0.000074s : 1: jit_opt_b 3.82% : 0.001265s : 1: loop_unroll 1.80% : 0.000596s : 1: mutable_eliminate 2.67% : 0.000883s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000054s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000524s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000110s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.71% : 0.000565s : 1: renormalize.infer 1.24% : 0.000409s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.26% : 0.000087s : 1: rewriter_before_opt_a 0.24% : 0.000079s : 1: symbol_engine_optimizer 65.12% : 0.021558s : 1: type_inference TotalTime = 0.155908, [30] [bootstrap]: 0.00041548 [type_inference]: 0.0771642 [event_method]: 2.76e-05 [auto_monad]: 9.375e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 8.402e-05 [rewriter_before_opt_a]: 9.285e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0115942, [2] [Cycle 1]: 0.00248392, [27] [switch_simplify]: 7.595e-05 [loop_unroll]: 3.107e-05 [a_1]: 0.00070962 [with_stream_mark]: 2.627e-05 [recompute_prepare]: 9.17001e-06 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 4.01001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.85002e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 3.09001e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.682e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.106e-05 [inline_without_move]: 5.22e-06 [renormalize]: 0.00124891 [add_forward_monad_depend]: 7.63999e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.979e-05 [cse]: 3.742e-05 [replace_applicator]: 1.698e-05 [Cycle 2]: 0.00035388, [27] [switch_simplify]: 6.81001e-06 [loop_unroll]: 5.35999e-06 [a_1]: 0.00010109 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 4.50001e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.00999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 8.40999e-06 [cse]: 1.314e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.576e-05 [rewriter_after_opt_a]: 4.117e-05 [convert_after_rewriter]: 8.38999e-06 [order_py_execute_after_rewriter]: 1.67e-05 [mutable_eliminate]: 0.0637685 [jit_opt_b]: 8.654e-05, [1] [Cycle 1]: 7.225e-05, [2] [frontend_op_eliminate]: 2.97e-05 [inline_after_opt_a]: 2.598e-05 [cconv]: 5.272e-05 [loop_unroll]: 0.00086185 [jit_opt_after_cconv]: 0.00024027, [1] [Cycle 1]: 0.00023016, [11] [c_1]: 3.153e-05 [parameter_eliminate]: 7.98999e-06 [updatestate_depend_eliminate]: 1.582e-05 [updatestate_assign_eliminate]: 4.38999e-06 [updatestate_loads_eliminate]: 3.61999e-06 [cse]: 5.33e-05 [call_graph_tuple_transform]: 3.261e-05 [tuple_list_get_item_eliminator]: 7.9e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 1.09e-06 [switch_simplify]: 8.1e-06 [remove_dup_value]: 2.192e-05 [partial_unused_args_eliminate]: 2.93998e-06 [environ_conv]: 1.107e-05 [add_recomputation]: 7.349e-05 [cse_after_recomputation]: 2.75e-05, [1] [Cycle 1]: 2.014e-05, [1] [cse]: 1.324e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 3.08e-06 [rewriter_after_jit_bprop_graph]: 1.423e-05 [opt_after_jit_grad]: 0.00070952 [symbol_engine_optimizer]: 0.00010602, [1] [Cycle 1]: 9.796e-05, [6] [build]: 7.45003e-06 [elim_shapecalc]: 1.219e-05 [elim_not_effective]: 2.128e-05 [opt_reshape]: 8.72e-06 [fold_const_symbol]: 1.273e-05 [renormalize]: 5.8001e-07 [validate]: 6.083e-05 Sums bootstrap : 0.000415s : 0.28% type_inference : 0.077164s : 52.71% event_method : 0.000028s : 0.02% auto_monad : 0.000094s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000084s : 0.06% rewriter_before_opt_a : 0.000093s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000811s : 0.55% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001249s : 0.85% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000017s : 0.01% mutable_eliminate : 0.063768s : 43.56% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.02% jit_opt_b.inline_after_opt_a : 0.000026s : 0.02% cconv : 0.000053s : 0.04% loop_unroll : 0.000862s : 0.59% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000053s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000073s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.01% opt_after_jit_grad : 0.000710s : 0.48% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.04% Time group info: ------[substitution.] 0.000340 23 0.81% : 0.000003s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000008s : 3: substitution.graph_param_transform 87.21% : 0.000297s : 4: substitution.inline 1.35% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000006s : 4: substitution.remove_not_recompute_node 1.84% : 0.000006s : 2: substitution.replace_old_param 4.27% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.077013 2 53.34% : 0.041079s : 1: type_inference.infer 46.66% : 0.035934s : 1: type_inference.specialize ------[replace.] 0.000095 6 68.40% : 0.000065s : 4: replace.inline 31.60% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000307 6 95.63% : 0.000294s : 4: match.inline 4.37% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 691 0.97% : 0.000001s : 10: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.81% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.05% : 0.000003s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 0.85% : 0.000001s : 10: predicate.compare_switch_simplify 1.03% : 0.000002s : 10: predicate.depend_value_elim 0.85% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.96% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.92% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.90% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.81% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.87% : 0.000001s : 10: predicate.environ_get_depend_swap 1.01% : 0.000002s : 10: predicate.environ_get_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000008s : 22: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.77% : 0.000003s : 6: predicate.less_batch_normalization 1.07% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 15: predicate.load_eliminater 2.27% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.55% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 7.28% : 0.000011s : 3: predicate.mutable_eliminate 0.33% : 0.000001s : 3: predicate.opt_reshape 1.82% : 0.000003s : 15: predicate.partial_eliminate 0.90% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000003s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 6: predicate.remove_not_recompute_node 1.48% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.69% : 0.000001s : 3: predicate.reset_defer_inline 0.85% : 0.000001s : 10: predicate.reshape_eliminate 1.42% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.75% : 0.000003s : 3: predicate.row_tensor_eliminate 1.07% : 0.000002s : 10: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.76% : 0.000003s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.68% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.83% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.08% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.91% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.28% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.29% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 1.21% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.021037 13 49.83% : 0.010482s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.33% : 0.000070s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.84% : 0.010485s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158343 72 0.05% : 0.000077s : 1: add_recomputation 0.06% : 0.000098s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.28% : 0.000440s : 1: bootstrap 0.04% : 0.000056s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.33% : 0.011599s : 1: jit_opt_a 0.15% : 0.000245s : 1: jit_opt_after_cconv 0.06% : 0.000091s : 1: jit_opt_b 0.55% : 0.000875s : 1: loop_unroll 40.29% : 0.063802s : 1: mutable_eliminate 0.67% : 0.001061s : 26: opt.transform.jit_opt_a 0.05% : 0.000075s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000053s : 1: opt.transform.mutable_eliminate 0.02% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000724s : 1: opt_after_jit_grad 0.01% : 0.000019s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000087s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000025s : 1: remove_dup_value 0.47% : 0.000741s : 1: renormalize.infer 0.31% : 0.000496s : 1: renormalize.specialize 0.01% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.06% : 0.000096s : 1: rewriter_before_opt_a 0.07% : 0.000110s : 1: symbol_engine_optimizer 48.76% : 0.077203s : 1: type_inference TotalTime = 0.0166415, [30] [bootstrap]: 0.00030626 [type_inference]: 0.00799414 [event_method]: 2.279e-05 [auto_monad]: 6.924e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 4.39e-05 [rewriter_before_opt_a]: 7.557e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.0058505, [2] [Cycle 1]: 0.00181423, [27] [switch_simplify]: 5.935e-05 [loop_unroll]: 2.961e-05 [a_1]: 0.00059238 [with_stream_mark]: 2.42e-05 [recompute_prepare]: 7.86001e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.95998e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.67002e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 1.19003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 2.18998e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00074614 [add_forward_monad_depend]: 7.10998e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 1.5e-05 [cse]: 3.699e-05 [replace_applicator]: 1.431e-05 [Cycle 2]: 0.0003225, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.44e-06 [a_1]: 8.917e-05 [with_stream_mark]: 1.134e-05 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.67998e-06 [accelerated_algorithm]: 5.01002e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.47e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.368e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 1.49998e-06 [replace_old_param]: 8e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.265e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.594e-05 [rewriter_after_opt_a]: 3.942e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.0006133 [jit_opt_b]: 5.165e-05, [1] [Cycle 1]: 4.351e-05, [2] [frontend_op_eliminate]: 1.564e-05 [inline_after_opt_a]: 1.643e-05 [cconv]: 2.996e-05 [loop_unroll]: 0.00042346 [jit_opt_after_cconv]: 0.00016356, [1] [Cycle 1]: 0.00015693, [11] [c_1]: 2.009e-05 [parameter_eliminate]: 3.40998e-06 [updatestate_depend_eliminate]: 8.32e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.76e-05 [call_graph_tuple_transform]: 2.892e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.882e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.448e-05 [cse_after_recomputation]: 2.348e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.775e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 6.03998e-06 [opt_after_jit_grad]: 0.00047144 [symbol_engine_optimizer]: 7.549e-05, [1] [Cycle 1]: 6.921e-05, [6] [build]: 3.72998e-06 [elim_shapecalc]: 7.48e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.55999e-06 [renormalize]: 8.30012e-07 [validate]: 4.696e-05 Sums bootstrap : 0.000306s : 2.49% type_inference : 0.007994s : 64.93% event_method : 0.000023s : 0.19% auto_monad : 0.000069s : 0.56% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.36% rewriter_before_opt_a : 0.000076s : 0.61% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.53% jit_opt_a.loop_unroll : 0.000035s : 0.28% jit_opt_a.a_1 : 0.000682s : 5.54% jit_opt_a.with_stream_mark : 0.000036s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000746s : 6.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000050s : 0.40% jit_opt_a.replace_applicator : 0.000019s : 0.16% py_interpret_to_execute_after_opt_a : 0.000016s : 0.13% rewriter_after_opt_a : 0.000039s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000613s : 4.98% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000030s : 0.24% loop_unroll : 0.000423s : 3.44% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000054s : 0.44% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000471s : 3.83% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000047s : 0.38% Time group info: ------[substitution.] 0.000262 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 3: substitution.graph_param_transform 86.42% : 0.000226s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 4.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007918 2 86.88% : 0.006879s : 1: type_inference.infer 13.12% : 0.001039s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.28% : 0.000048s : 4: replace.inline 33.72% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.97% : 0.000223s : 4: match.inline 5.03% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.68% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.26% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.74% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.58% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.43% : 0.000002s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 2.43% : 0.000003s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.55% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000762 13 47.97% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.60% : 0.000073s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.43% : 0.000323s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018347 72 0.32% : 0.000058s : 1: add_recomputation 0.40% : 0.000072s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.78% : 0.000327s : 1: bootstrap 0.18% : 0.000033s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.15% : 0.000028s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.91% : 0.005854s : 1: jit_opt_a 0.91% : 0.000167s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.36% : 0.000433s : 1: loop_unroll 3.41% : 0.000626s : 1: mutable_eliminate 4.92% : 0.000902s : 26: opt.transform.jit_opt_a 0.31% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.62% : 0.000481s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000047s : 1: py_interpret_to_execute 0.10% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.26% : 0.000415s : 1: renormalize.infer 1.76% : 0.000324s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.43% : 0.000078s : 1: rewriter_before_opt_a 0.43% : 0.000079s : 1: symbol_engine_optimizer 43.69% : 0.008015s : 1: type_inference TotalTime = 0.0195569, [30] [bootstrap]: 0.00034548 [type_inference]: 0.00929179 [event_method]: 2.22e-05 [auto_monad]: 7.272e-05 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 5.302e-05 [rewriter_before_opt_a]: 8.723e-05 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.0073564, [2] [Cycle 1]: 0.0034469, [27] [switch_simplify]: 6.453e-05 [loop_unroll]: 3.366e-05 [a_1]: 0.00068854 [with_stream_mark]: 2.411e-05 [recompute_prepare]: 7.56999e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 1.102e-05 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00224823 [add_forward_monad_depend]: 8.77e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.979e-05 [cse]: 4.437e-05 [replace_applicator]: 1.925e-05 [Cycle 2]: 0.00034437, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 5.17999e-06 [a_1]: 9.291e-05 [with_stream_mark]: 1.254e-05 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.79002e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 4.97999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 4.61002e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 2.08998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.559e-05 [j_node_and_user_rematch]: 8.43999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 6.96999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.33998e-06 [cse]: 1.644e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.55e-05 [rewriter_after_opt_a]: 4.202e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00062221 [jit_opt_b]: 5.25e-05, [1] [Cycle 1]: 4.471e-05, [2] [frontend_op_eliminate]: 1.659e-05 [inline_after_opt_a]: 1.666e-05 [cconv]: 2.975e-05 [loop_unroll]: 0.00046998 [jit_opt_after_cconv]: 0.00015117, [1] [Cycle 1]: 0.00014403, [11] [c_1]: 2.062e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 6.43998e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.732e-05 [call_graph_tuple_transform]: 1.924e-05 [tuple_list_get_item_eliminator]: 5.54998e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 4.172e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5.518e-05 [cse_after_recomputation]: 2.622e-05, [1] [Cycle 1]: 2.082e-05, [1] [cse]: 1.42e-05 [auto_monad_reorder]: 1.939e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.00045576 [symbol_engine_optimizer]: 7.337e-05, [1] [Cycle 1]: 6.766e-05, [6] [build]: 3.82002e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 9.35001e-06 [renormalize]: 4.2998e-07 [validate]: 4.431e-05 Sums bootstrap : 0.000345s : 2.25% type_inference : 0.009292s : 60.45% event_method : 0.000022s : 0.14% auto_monad : 0.000073s : 0.47% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.34% rewriter_before_opt_a : 0.000087s : 0.57% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.46% jit_opt_a.loop_unroll : 0.000039s : 0.25% jit_opt_a.a_1 : 0.000781s : 5.08% jit_opt_a.with_stream_mark : 0.000037s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.002248s : 14.63% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.17% jit_opt_a.cse : 0.000061s : 0.40% jit_opt_a.replace_applicator : 0.000025s : 0.16% py_interpret_to_execute_after_opt_a : 0.000016s : 0.10% rewriter_after_opt_a : 0.000042s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000622s : 4.05% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000030s : 0.19% loop_unroll : 0.000470s : 3.06% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000042s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000055s : 0.36% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000456s : 2.96% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.29% Time group info: ------[substitution.] 0.000290 24 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 1.84% : 0.000005s : 3: substitution.graph_param_transform 87.45% : 0.000253s : 5: substitution.inline 1.64% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 1.55% : 0.000004s : 2: substitution.replace_old_param 4.40% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009215 2 88.19% : 0.008127s : 1: type_inference.infer 11.81% : 0.001088s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.98% : 0.000068s : 5: replace.inline 31.02% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 95.56% : 0.000250s : 5: match.inline 4.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.37% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.64% : 0.000002s : 11: predicate.addn_zero_filter 2.29% : 0.000003s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.53% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 6.58% : 0.000008s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.93% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.69% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.54% : 0.000002s : 11: predicate.print_const_string_wrapper 1.61% : 0.000002s : 11: predicate.reduce_eliminate 1.51% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.48% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 18: predicate.switch_defer_inline 2.39% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.11% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.40% : 0.000002s : 11: predicate.transpose_eliminate 1.35% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000919 16 50.24% : 0.000462s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.47% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.29% : 0.000370s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022868 72 0.25% : 0.000058s : 1: add_recomputation 0.33% : 0.000076s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.60% : 0.000365s : 1: bootstrap 0.14% : 0.000032s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.12% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.19% : 0.007360s : 1: jit_opt_a 0.67% : 0.000154s : 1: jit_opt_after_cconv 0.24% : 0.000055s : 1: jit_opt_b 2.09% : 0.000478s : 1: loop_unroll 2.76% : 0.000632s : 1: mutable_eliminate 4.46% : 0.001020s : 26: opt.transform.jit_opt_a 0.21% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.03% : 0.000464s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000056s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000045s : 1: remove_dup_value 7.88% : 0.001801s : 1: renormalize.infer 1.90% : 0.000435s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000045s : 1: rewriter_after_opt_a 0.39% : 0.000090s : 1: rewriter_before_opt_a 0.33% : 0.000076s : 1: symbol_engine_optimizer 40.73% : 0.009313s : 1: type_inference TotalTime = 0.033819, [30] [bootstrap]: 0.00044598 [type_inference]: 0.021438 [event_method]: 2.77e-05 [auto_monad]: 0.00011579 [graph_reusing]: 6.54999e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 7.313e-05 [rewriter_before_opt_a]: 9.181e-05 [expand_dump_flag]: 4.38999e-06 [jit_opt_a]: 0.00837628, [2] [Cycle 1]: 0.00261011, [27] [switch_simplify]: 8.526e-05 [loop_unroll]: 3.174e-05 [a_1]: 0.00074731 [with_stream_mark]: 2.876e-05 [recompute_prepare]: 1.029e-05 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 4.21001e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.29002e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.675e-05 [j_node_and_user_rematch]: 1.158e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.411e-05 [inline_without_move]: 5.49998e-06 [renormalize]: 0.00129807 [add_forward_monad_depend]: 1.027e-05 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 1.929e-05 [cse]: 3.554e-05 [replace_applicator]: 2.145e-05 [Cycle 2]: 0.00035745, [27] [switch_simplify]: 6.24999e-06 [loop_unroll]: 6.00002e-06 [a_1]: 0.00010387 [with_stream_mark]: 1.551e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.38002e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.03002e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 3.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.21997e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.207e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.645e-05 [rewriter_after_opt_a]: 4.278e-05 [convert_after_rewriter]: 7.68001e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00104271 [jit_opt_b]: 0.00011454, [1] [Cycle 1]: 0.00010377, [2] [frontend_op_eliminate]: 2.591e-05 [inline_after_opt_a]: 6.319e-05 [cconv]: 4.135e-05 [loop_unroll]: 0.00063368 [jit_opt_after_cconv]: 0.00018421, [1] [Cycle 1]: 0.00017621, [11] [c_1]: 2.524e-05 [parameter_eliminate]: 3.8e-06 [updatestate_depend_eliminate]: 7.46001e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.35e-06 [cse]: 3.739e-05 [call_graph_tuple_transform]: 2.788e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.83997e-06 [renormalize]: 1.22e-06 [switch_simplify]: 5.62001e-06 [remove_dup_value]: 1.829e-05 [partial_unused_args_eliminate]: 2.77002e-06 [environ_conv]: 7.31999e-06 [add_recomputation]: 6.161e-05 [cse_after_recomputation]: 2.584e-05, [1] [Cycle 1]: 1.902e-05, [1] [cse]: 1.304e-05 [auto_monad_reorder]: 1.875e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 1.023e-05 [opt_after_jit_grad]: 0.00061575 [symbol_engine_optimizer]: 8.962e-05, [1] [Cycle 1]: 8.155e-05, [6] [build]: 5.22999e-06 [elim_shapecalc]: 1.057e-05 [elim_not_effective]: 1.81e-05 [opt_reshape]: 6.63998e-06 [fold_const_symbol]: 1.115e-05 [renormalize]: 4.30009e-07 [validate]: 5.103e-05 Sums bootstrap : 0.000446s : 1.61% type_inference : 0.021438s : 77.41% event_method : 0.000028s : 0.10% auto_monad : 0.000116s : 0.42% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000073s : 0.26% rewriter_before_opt_a : 0.000092s : 0.33% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000092s : 0.33% jit_opt_a.loop_unroll : 0.000038s : 0.14% jit_opt_a.a_1 : 0.000851s : 3.07% jit_opt_a.with_stream_mark : 0.000044s : 0.16% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001298s : 4.69% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000048s : 0.17% jit_opt_a.replace_applicator : 0.000027s : 0.10% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000043s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001043s : 3.77% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.09% jit_opt_b.inline_after_opt_a : 0.000063s : 0.23% cconv : 0.000041s : 0.15% loop_unroll : 0.000634s : 2.29% jit_opt_after_cconv.c_1 : 0.000025s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000062s : 0.22% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.04% opt_after_jit_grad : 0.000616s : 2.22% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.18% Time group info: ------[substitution.] 0.000353 23 1.04% : 0.000004s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000007s : 3: substitution.graph_param_transform 87.01% : 0.000307s : 4: substitution.inline 1.43% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000007s : 2: substitution.replace_old_param 4.56% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021319 2 92.05% : 0.019625s : 1: type_inference.infer 7.95% : 0.001694s : 1: type_inference.specialize ------[replace.] 0.000099 6 69.53% : 0.000069s : 4: replace.inline 30.47% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000319 6 95.28% : 0.000304s : 4: match.inline 4.72% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 691 1.61% : 0.000002s : 10: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.86% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.65% : 0.000004s : 10: predicate.arithmetic_simplify 1.19% : 0.000002s : 10: predicate.cast_eliminate 0.87% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 0.88% : 0.000001s : 10: predicate.depend_value_elim 0.93% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000002s : 10: predicate.environ_get_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000002s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000008s : 22: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 6: predicate.less_batch_normalization 1.83% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.86% : 0.000001s : 10: predicate.merge_addn 0.92% : 0.000001s : 10: predicate.minmaximum_grad 3.11% : 0.000005s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 2.49% : 0.000004s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000003s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 0.95% : 0.000001s : 10: predicate.reshape_eliminate 1.45% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.18% : 0.000002s : 3: predicate.row_tensor_eliminate 1.57% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.69% : 0.000003s : 6: predicate.special_op_eliminate 0.75% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.04% : 0.000003s : 16: predicate.switch_defer_inline 2.35% : 0.000004s : 16: predicate.switch_layer_defer_inline 7.04% : 0.000011s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.88% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.16% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.10% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001322 13 51.43% : 0.000680s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.13% : 0.000068s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.44% : 0.000574s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036357 72 0.18% : 0.000065s : 1: add_recomputation 0.33% : 0.000121s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.30% : 0.000473s : 1: bootstrap 0.12% : 0.000045s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.09% : 0.000033s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 23.05% : 0.008382s : 1: jit_opt_a 0.52% : 0.000188s : 1: jit_opt_after_cconv 0.32% : 0.000118s : 1: jit_opt_b 1.77% : 0.000644s : 1: loop_unroll 2.91% : 0.001059s : 1: mutable_eliminate 3.08% : 0.001120s : 26: opt.transform.jit_opt_a 0.17% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.22% : 0.000079s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000025s : 1: opt.transform.mutable_eliminate 0.08% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.73% : 0.000629s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000076s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.91% : 0.000694s : 1: renormalize.infer 1.63% : 0.000593s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000046s : 1: rewriter_after_opt_a 0.26% : 0.000096s : 1: rewriter_before_opt_a 0.25% : 0.000093s : 1: symbol_engine_optimizer 59.05% : 0.021470s : 1: type_inference TotalTime = 0.0389989, [30] [bootstrap]: 0.00030952 [type_inference]: 0.0288857 [event_method]: 2.096e-05 [auto_monad]: 6.965e-05 [graph_reusing]: 7e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00011614 [rewriter_before_opt_a]: 8.313e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00583807, [2] [Cycle 1]: 0.00202111, [27] [switch_simplify]: 6.186e-05 [loop_unroll]: 2.939e-05 [a_1]: 0.00055965 [with_stream_mark]: 2.241e-05 [recompute_prepare]: 7.67998e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.36998e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00098953 [add_forward_monad_depend]: 8.02e-06 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.708e-05 [cse]: 3.6e-05 [replace_applicator]: 1.308e-05 [Cycle 2]: 0.00032136, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 4.84e-06 [a_1]: 9.01e-05 [with_stream_mark]: 1.023e-05 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.34002e-06 [inline_without_move]: 4.87998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.192e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 1.514e-05 [rewriter_after_opt_a]: 4.16e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.00067212 [jit_opt_b]: 5.026e-05, [1] [Cycle 1]: 4.263e-05, [2] [frontend_op_eliminate]: 1.55e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.69e-05 [loop_unroll]: 0.00162911 [jit_opt_after_cconv]: 0.00017005, [1] [Cycle 1]: 0.00016076, [11] [c_1]: 2.258e-05 [parameter_eliminate]: 4.73001e-06 [updatestate_depend_eliminate]: 7.29001e-06 [updatestate_assign_eliminate]: 3.90998e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 3.795e-05 [call_graph_tuple_transform]: 2.078e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 6.20028e-07 [switch_simplify]: 5.46e-06 [remove_dup_value]: 1.756e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 8.28999e-06 [add_recomputation]: 5.416e-05 [cse_after_recomputation]: 2.3e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.844e-05 [get_jit_bprop_graph]: 2.96001e-06 [rewriter_after_jit_bprop_graph]: 8.60001e-06 [opt_after_jit_grad]: 0.00055618 [symbol_engine_optimizer]: 7.554e-05, [1] [Cycle 1]: 6.824e-05, [6] [build]: 4.45e-06 [elim_shapecalc]: 7.93999e-06 [elim_not_effective]: 1.399e-05 [opt_reshape]: 5.75001e-06 [fold_const_symbol]: 8.88002e-06 [renormalize]: 6.39993e-07 [validate]: 4.572e-05 Sums bootstrap : 0.000310s : 0.89% type_inference : 0.028886s : 82.88% event_method : 0.000021s : 0.06% auto_monad : 0.000070s : 0.20% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000116s : 0.33% rewriter_before_opt_a : 0.000083s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.19% jit_opt_a.loop_unroll : 0.000034s : 0.10% jit_opt_a.a_1 : 0.000650s : 1.86% jit_opt_a.with_stream_mark : 0.000033s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000990s : 2.84% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000048s : 0.14% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000042s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000672s : 1.93% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000027s : 0.08% loop_unroll : 0.001629s : 4.67% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000054s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000556s : 1.60% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.13% Time group info: ------[substitution.] 0.000232 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 84.62% : 0.000197s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000004s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 5.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028793 2 94.58% : 0.027232s : 1: type_inference.infer 5.42% : 0.001561s : 1: type_inference.specialize ------[replace.] 0.000074 6 70.57% : 0.000052s : 4: replace.inline 29.43% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.30% : 0.000194s : 4: match.inline 5.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.20% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.11% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.54% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 2.98% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.70% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.18% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.67% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.89% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 2.06% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000867 13 48.07% : 0.000417s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.45% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.48% : 0.000403s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040914 72 0.14% : 0.000057s : 1: add_recomputation 0.18% : 0.000073s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.80% : 0.000327s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.11% : 0.000045s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.28% : 0.005842s : 1: jit_opt_a 0.42% : 0.000173s : 1: jit_opt_after_cconv 0.13% : 0.000053s : 1: jit_opt_b 4.02% : 0.001643s : 1: loop_unroll 1.67% : 0.000681s : 1: mutable_eliminate 2.13% : 0.000871s : 26: opt.transform.jit_opt_a 0.12% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.38% : 0.000565s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000120s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.36% : 0.000557s : 1: renormalize.infer 1.03% : 0.000423s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000045s : 1: rewriter_after_opt_a 0.21% : 0.000086s : 1: rewriter_before_opt_a 0.19% : 0.000078s : 1: symbol_engine_optimizer 70.65% : 0.028907s : 1: type_inference TotalTime = 0.0365413, [30] [bootstrap]: 0.00035488 [type_inference]: 0.0271585 [event_method]: 2.413e-05 [auto_monad]: 7.69e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00011469 [rewriter_before_opt_a]: 8.531e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00625877, [2] [Cycle 1]: 0.00215239, [27] [switch_simplify]: 6.072e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00057514 [with_stream_mark]: 2.296e-05 [recompute_prepare]: 8.77999e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.654e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00105171 [add_forward_monad_depend]: 7.68999e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.942e-05 [cse]: 3.674e-05 [replace_applicator]: 1.678e-05 [Cycle 2]: 0.00032958, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.22999e-06 [a_1]: 8.941e-05 [with_stream_mark]: 1.163e-05 [recompute_prepare]: 4.99e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.443e-05 [j_node_and_user_rematch]: 8.2e-06 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 7.50003e-06 [inline_without_move]: 5.18002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 6.61e-06 [cse]: 1.406e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 4.075e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00076298 [jit_opt_b]: 5.043e-05, [1] [Cycle 1]: 4.244e-05, [2] [frontend_op_eliminate]: 1.642e-05 [inline_after_opt_a]: 1.559e-05 [cconv]: 3.25e-05 [loop_unroll]: 0.00044951 [jit_opt_after_cconv]: 0.00015027, [1] [Cycle 1]: 0.00014398, [11] [c_1]: 2.056e-05 [parameter_eliminate]: 3.73001e-06 [updatestate_depend_eliminate]: 6.81001e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.7e-05 [call_graph_tuple_transform]: 1.908e-05 [tuple_list_get_item_eliminator]: 5.19998e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.676e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 6.18998e-06 [add_recomputation]: 5.089e-05 [cse_after_recomputation]: 2.381e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 1.872e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 4.67e-06 [opt_after_jit_grad]: 0.00047713 [symbol_engine_optimizer]: 8.464e-05, [1] [Cycle 1]: 7.774e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.76001e-06 [elim_not_effective]: 1.359e-05 [opt_reshape]: 5.75001e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 5.00004e-07 [validate]: 5.877e-05 Sums bootstrap : 0.000355s : 1.11% type_inference : 0.027158s : 84.61% event_method : 0.000024s : 0.08% auto_monad : 0.000077s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000115s : 0.36% rewriter_before_opt_a : 0.000085s : 0.27% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000665s : 2.07% jit_opt_a.with_stream_mark : 0.000035s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001052s : 3.28% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000051s : 0.16% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000041s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000763s : 2.38% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000032s : 0.10% loop_unroll : 0.000450s : 1.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000477s : 1.49% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.18% Time group info: ------[substitution.] 0.000247 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000005s : 3: substitution.graph_param_transform 85.22% : 0.000210s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000004s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027072 2 94.42% : 0.025561s : 1: type_inference.infer 5.58% : 0.001511s : 1: type_inference.specialize ------[replace.] 0.000075 6 70.06% : 0.000052s : 4: replace.inline 29.94% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.57% : 0.000208s : 4: match.inline 5.43% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 2.56% : 0.000003s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.83% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.46% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.50% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.95% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.11% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000993 13 52.33% : 0.000520s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.37% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.30% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038520 72 0.14% : 0.000054s : 1: add_recomputation 0.21% : 0.000081s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.97% : 0.000374s : 1: bootstrap 0.09% : 0.000035s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 16.26% : 0.006262s : 1: jit_opt_a 0.40% : 0.000153s : 1: jit_opt_after_cconv 0.14% : 0.000053s : 1: jit_opt_b 1.19% : 0.000458s : 1: loop_unroll 2.01% : 0.000776s : 1: mutable_eliminate 2.32% : 0.000892s : 26: opt.transform.jit_opt_a 0.12% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000487s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000118s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.52% : 0.000585s : 1: renormalize.infer 1.19% : 0.000458s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.23% : 0.000089s : 1: rewriter_before_opt_a 0.23% : 0.000087s : 1: symbol_engine_optimizer 70.57% : 0.027184s : 1: type_inference TotalTime = 0.357485, [30] [bootstrap]: 0.0339359 [type_inference]: 0.223249 [event_method]: 7.727e-05 [auto_monad]: 0.00018174 [graph_reusing]: 8.77e-06 [pre_auto_parallel]: 1.217e-05 [py_interpret_to_execute]: 5.558e-05 [rewriter_before_opt_a]: 0.00017402 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.0966701, [2] [Cycle 1]: 0.00386648, [27] [switch_simplify]: 0.00023192 [loop_unroll]: 5.596e-05 [a_1]: 0.00131391 [with_stream_mark]: 2.556e-05 [recompute_prepare]: 1.206e-05 [updatestate_depend_eliminate]: 1.675e-05 [updatestate_assign_eliminate]: 3.81001e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.76997e-06 [cell_reuse_recompute_pass]: 1.14003e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.291e-05 [j_node_and_user_rematch]: 1.112e-05 [meta_fg_expand]: 3.02002e-06 [replace_old_param]: 1.309e-05 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00168492 [add_forward_monad_depend]: 3.668e-05 [auto_monad_grad]: 2.93998e-06 [auto_monad_eliminator]: 3.736e-05 [cse]: 6.176e-05 [replace_applicator]: 2.257e-05 [Cycle 2]: 0.00039311, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 5.31002e-06 [a_1]: 9.502e-05 [with_stream_mark]: 2.05e-05 [recompute_prepare]: 6.54999e-06 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 4.82e-06 [cell_reuse_recompute_pass]: 2.97002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.997e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 2.21003e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 5.20001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.78998e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 9.05001e-06 [cse]: 2.211e-05 [replace_applicator]: 7.16999e-06 [py_interpret_to_execute_after_opt_a]: 2.011e-05 [rewriter_after_opt_a]: 5.553e-05 [convert_after_rewriter]: 2.316e-05 [order_py_execute_after_rewriter]: 5.66003e-06 [mutable_eliminate]: 0.0008317 [jit_opt_b]: 7.068e-05, [1] [Cycle 1]: 6.031e-05, [2] [frontend_op_eliminate]: 2.589e-05 [inline_after_opt_a]: 1.94e-05 [cconv]: 3.782e-05 [loop_unroll]: 0.00055416 [jit_opt_after_cconv]: 0.00022082, [1] [Cycle 1]: 0.00021224, [11] [c_1]: 2.359e-05 [parameter_eliminate]: 5.54998e-06 [updatestate_depend_eliminate]: 1.004e-05 [updatestate_assign_eliminate]: 3.87998e-06 [updatestate_loads_eliminate]: 3.54002e-06 [cse]: 6.619e-05 [call_graph_tuple_transform]: 2.649e-05 [tuple_list_get_item_eliminator]: 6.33e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 9.50007e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 4.857e-05 [partial_unused_args_eliminate]: 2.70002e-06 [environ_conv]: 3.757e-05 [add_recomputation]: 7.788e-05 [cse_after_recomputation]: 3.154e-05, [1] [Cycle 1]: 2.435e-05, [1] [cse]: 1.652e-05 [auto_monad_reorder]: 2.995e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 5.66e-06 [opt_after_jit_grad]: 0.00060007 [symbol_engine_optimizer]: 8.674e-05, [1] [Cycle 1]: 7.905e-05, [6] [build]: 4.87e-06 [elim_shapecalc]: 9.49999e-06 [elim_not_effective]: 1.692e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 5.59987e-07 [validate]: 0.00011536 Sums bootstrap : 0.033936s : 12.84% type_inference : 0.223249s : 84.47% event_method : 0.000077s : 0.03% auto_monad : 0.000182s : 0.07% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000012s : 0.00% py_interpret_to_execute : 0.000056s : 0.02% rewriter_before_opt_a : 0.000174s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000239s : 0.09% jit_opt_a.loop_unroll : 0.000061s : 0.02% jit_opt_a.a_1 : 0.001409s : 0.53% jit_opt_a.with_stream_mark : 0.000046s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000022s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000011s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000053s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.001685s : 0.64% jit_opt_a.add_forward_monad_depend : 0.000039s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000046s : 0.02% jit_opt_a.cse : 0.000084s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000056s : 0.02% convert_after_rewriter : 0.000023s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000832s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000038s : 0.01% loop_unroll : 0.000554s : 0.21% jit_opt_after_cconv.c_1 : 0.000024s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000066s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000049s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000038s : 0.01% add_recomputation : 0.000078s : 0.03% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000030s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000600s : 0.23% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000115s : 0.04% Time group info: ------[substitution.] 0.000552 33 0.42% : 0.000002s : 2: substitution.elim_not_effective 0.26% : 0.000001s : 2: substitution.fold_const_symbol 1.16% : 0.000006s : 3: substitution.graph_param_transform 86.23% : 0.000476s : 11: substitution.inline 0.85% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.78% : 0.000015s : 4: substitution.remove_not_recompute_node 1.43% : 0.000008s : 2: substitution.replace_old_param 3.61% : 0.000020s : 2: substitution.switch_simplify 3.25% : 0.000018s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.223145 2 98.95% : 0.220796s : 1: type_inference.infer 1.05% : 0.002349s : 1: type_inference.specialize ------[replace.] 0.000317 16 52.32% : 0.000166s : 11: replace.inline 18.89% : 0.000060s : 2: replace.switch_simplify 28.79% : 0.000091s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000506 16 93.09% : 0.000471s : 11: match.inline 3.68% : 0.000019s : 2: match.switch_simplify 3.23% : 0.000016s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000222 1148 1.20% : 0.000003s : 18: predicate.accumulaten_eliminater 0.97% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 18: predicate.addn_check_dump 1.22% : 0.000003s : 18: predicate.addn_zero_filter 1.78% : 0.000004s : 18: predicate.arithmetic_simplify 1.26% : 0.000003s : 18: predicate.cast_eliminate 0.28% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000002s : 18: predicate.compare_switch_simplify 1.11% : 0.000002s : 18: predicate.depend_value_elim 1.08% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 18: predicate.dict_get_item_eliminator 1.14% : 0.000003s : 18: predicate.dict_set_item_eliminator 1.24% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 3: predicate.elim_not_effective 0.33% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 18: predicate.environ_get_depend_swap 1.11% : 0.000002s : 18: predicate.environ_get_eliminate 1.08% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.64% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000001s : 3: predicate.graph_param_transform 5.14% : 0.000011s : 38: predicate.inline 0.47% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.81% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.45% : 0.000003s : 24: predicate.load_eliminater 11.79% : 0.000026s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.56% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 18: predicate.merge_addn 1.08% : 0.000002s : 18: predicate.minmaximum_grad 1.75% : 0.000004s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000005s : 24: predicate.partial_eliminate 1.43% : 0.000003s : 18: predicate.print_const_string_wrapper 1.67% : 0.000004s : 18: predicate.reduce_eliminate 1.38% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000003s : 27: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.15% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000003s : 18: predicate.reshape_eliminate 1.13% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000003s : 18: predicate.same_eliminate 0.37% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.61% : 0.000001s : 6: predicate.special_op_eliminate 0.50% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000006s : 32: predicate.switch_defer_inline 2.17% : 0.000005s : 32: predicate.switch_layer_defer_inline 7.81% : 0.000017s : 103: predicate.switch_simplify 1.25% : 0.000003s : 18: predicate.tile_eliminate 1.13% : 0.000003s : 18: predicate.transpose_eliminate 1.35% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 18: predicate.tuple_list_get_item_depend_reorder 2.95% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.40% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.39% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.43% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.45% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.38% : 0.000003s : 18: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002127 28 50.63% : 0.001077s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.02% : 0.000234s : 6: func_graph_cloner_run.FuncGraphClonerNode 38.36% : 0.000816s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.361044 72 0.02% : 0.000082s : 1: add_recomputation 0.05% : 0.000188s : 1: auto_monad 0.01% : 0.000033s : 1: auto_monad_reorder 9.41% : 0.033956s : 1: bootstrap 0.01% : 0.000042s : 1: cconv 0.01% : 0.000027s : 1: convert_after_rewriter 0.01% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000041s : 1: environ_conv 0.02% : 0.000084s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000012s : 1: graph_reusing 26.78% : 0.096674s : 1: jit_opt_a 0.06% : 0.000224s : 1: jit_opt_after_cconv 0.02% : 0.000074s : 1: jit_opt_b 0.16% : 0.000568s : 1: loop_unroll 0.24% : 0.000850s : 1: mutable_eliminate 0.51% : 0.001855s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000043s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000616s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000014s : 1: pre_auto_parallel 0.02% : 0.000058s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000052s : 1: remove_dup_value 0.25% : 0.000909s : 1: renormalize.infer 0.21% : 0.000763s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000061s : 1: rewriter_after_opt_a 0.05% : 0.000177s : 1: rewriter_before_opt_a 0.02% : 0.000089s : 1: symbol_engine_optimizer 61.84% : 0.223274s : 1: type_inference TotalTime = 0.0512757, [30] [bootstrap]: 0.00034116 [type_inference]: 0.0118556 [event_method]: 2.638e-05 [auto_monad]: 8.015e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 7.4e-05 [rewriter_before_opt_a]: 0.00010322 [expand_dump_flag]: 3.98001e-06 [jit_opt_a]: 0.0359456, [2] [Cycle 1]: 0.00269082, [27] [switch_simplify]: 7.815e-05 [loop_unroll]: 3.317e-05 [a_1]: 0.00070714 [with_stream_mark]: 2.309e-05 [recompute_prepare]: 9.31e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.60997e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.00143471 [add_forward_monad_depend]: 1.096e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.104e-05 [cse]: 4.586e-05 [replace_applicator]: 2.076e-05 [Cycle 2]: 0.00037904, [27] [switch_simplify]: 6.70002e-06 [loop_unroll]: 5.64e-06 [a_1]: 9.353e-05 [with_stream_mark]: 1.743e-05 [recompute_prepare]: 6.05002e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 5.12e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.84e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.58998e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 9.24e-06 [cse]: 2.116e-05 [replace_applicator]: 5.86998e-06 [py_interpret_to_execute_after_opt_a]: 1.628e-05 [rewriter_after_opt_a]: 4.61e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.77001e-06 [mutable_eliminate]: 0.00076868 [jit_opt_b]: 5.652e-05, [1] [Cycle 1]: 4.785e-05, [2] [frontend_op_eliminate]: 1.716e-05 [inline_after_opt_a]: 1.829e-05 [cconv]: 3.726e-05 [loop_unroll]: 0.00049937 [jit_opt_after_cconv]: 0.00018872, [1] [Cycle 1]: 0.00018148, [11] [c_1]: 2.231e-05 [parameter_eliminate]: 6.44001e-06 [updatestate_depend_eliminate]: 1.112e-05 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.98001e-06 [cse]: 4.3e-05 [call_graph_tuple_transform]: 2.565e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 5.352e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 9.09e-06 [add_recomputation]: 6.144e-05 [cse_after_recomputation]: 5.709e-05, [1] [Cycle 1]: 2.726e-05, [1] [cse]: 1.772e-05 [auto_monad_reorder]: 2.249e-05 [get_jit_bprop_graph]: 2.88e-06 [rewriter_after_jit_bprop_graph]: 7.99997e-06 [opt_after_jit_grad]: 0.00062721 [symbol_engine_optimizer]: 8.709e-05, [1] [Cycle 1]: 7.909e-05, [6] [build]: 6.47001e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 1.865e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 9.85002e-06 [renormalize]: 7.30011e-07 [validate]: 5.357e-05 Sums bootstrap : 0.000341s : 1.93% type_inference : 0.011856s : 67.05% event_method : 0.000026s : 0.15% auto_monad : 0.000080s : 0.45% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000074s : 0.42% rewriter_before_opt_a : 0.000103s : 0.58% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000085s : 0.48% jit_opt_a.loop_unroll : 0.000039s : 0.22% jit_opt_a.a_1 : 0.000801s : 4.53% jit_opt_a.with_stream_mark : 0.000041s : 0.23% jit_opt_a.recompute_prepare : 0.000015s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000010s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000010s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001435s : 8.11% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.17% jit_opt_a.cse : 0.000067s : 0.38% jit_opt_a.replace_applicator : 0.000027s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.09% rewriter_after_opt_a : 0.000046s : 0.26% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000769s : 4.35% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000037s : 0.21% loop_unroll : 0.000499s : 2.82% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.cse : 0.000043s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000054s : 0.30% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000009s : 0.05% add_recomputation : 0.000061s : 0.35% cse_after_recomputation.cse : 0.000018s : 0.10% auto_monad_reorder : 0.000022s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.05% opt_after_jit_grad : 0.000627s : 3.55% symbol_engine_optimizer.build : 0.000006s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.30% Time group info: ------[substitution.] 0.000305 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.02% : 0.000006s : 3: substitution.graph_param_transform 82.83% : 0.000253s : 5: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 1.69% : 0.000005s : 2: substitution.replace_old_param 8.83% : 0.000027s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011758 2 85.68% : 0.010074s : 1: type_inference.infer 14.32% : 0.001684s : 1: type_inference.specialize ------[replace.] 0.000110 7 67.69% : 0.000074s : 5: replace.inline 32.31% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 95.29% : 0.000250s : 5: match.inline 4.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 747 1.21% : 0.000002s : 11: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.71% : 0.000002s : 11: predicate.arithmetic_simplify 1.08% : 0.000001s : 11: predicate.cast_eliminate 0.33% : 0.000000s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.00% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 11: predicate.environ_get_depend_swap 1.01% : 0.000001s : 11: predicate.environ_get_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.16% : 0.000002s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 6.05% : 0.000008s : 24: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 16: predicate.load_eliminater 1.99% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 11: predicate.merge_addn 0.97% : 0.000001s : 11: predicate.minmaximum_grad 3.52% : 0.000005s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 16: predicate.partial_eliminate 1.03% : 0.000001s : 11: predicate.print_const_string_wrapper 1.41% : 0.000002s : 11: predicate.reduce_eliminate 1.29% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000003s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.59% : 0.000001s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.07% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.10% : 0.000004s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.44% : 0.000010s : 59: predicate.switch_simplify 1.14% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.36% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001267 16 49.01% : 0.000621s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.08% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.91% : 0.000569s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053829 72 0.12% : 0.000065s : 1: add_recomputation 0.16% : 0.000084s : 1: auto_monad 0.05% : 0.000026s : 1: auto_monad_reorder 0.67% : 0.000363s : 1: bootstrap 0.07% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000060s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.06% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 66.79% : 0.035950s : 1: jit_opt_a 0.36% : 0.000192s : 1: jit_opt_after_cconv 0.11% : 0.000059s : 1: jit_opt_b 0.95% : 0.000510s : 1: loop_unroll 1.45% : 0.000783s : 1: mutable_eliminate 1.96% : 0.001055s : 26: opt.transform.jit_opt_a 0.10% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000025s : 1: opt.transform.mutable_eliminate 0.06% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.19% : 0.000641s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000077s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000057s : 1: remove_dup_value 1.60% : 0.000863s : 1: renormalize.infer 1.04% : 0.000558s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000049s : 1: rewriter_after_opt_a 0.20% : 0.000107s : 1: rewriter_before_opt_a 0.17% : 0.000090s : 1: symbol_engine_optimizer 22.08% : 0.011883s : 1: type_inference TotalTime = 0.534811, [30] [bootstrap]: 0.00043579 [type_inference]: 0.489709 [event_method]: 2.372e-05 [auto_monad]: 8.318e-05 [graph_reusing]: 6.79001e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.0005152 [rewriter_before_opt_a]: 0.00010177 [expand_dump_flag]: 3.64002e-06 [jit_opt_a]: 0.0415769, [2] [Cycle 1]: 0.00355215, [27] [switch_simplify]: 6.417e-05 [loop_unroll]: 3.138e-05 [a_1]: 0.00064395 [with_stream_mark]: 2.149e-05 [recompute_prepare]: 9.82999e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 6.11998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.584e-05 [j_node_and_user_rematch]: 9.38002e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00242703 [add_forward_monad_depend]: 6.28e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 1.794e-05 [cse]: 3.345e-05 [replace_applicator]: 1.763e-05 [Cycle 2]: 0.00035795, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.56e-06 [a_1]: 0.0001177 [with_stream_mark]: 1.086e-05 [recompute_prepare]: 5.67001e-06 [updatestate_depend_eliminate]: 3.00002e-06 [updatestate_assign_eliminate]: 2.50997e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.71002e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.63001e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.147e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.2e-05 [rewriter_after_opt_a]: 4.62e-05 [convert_after_rewriter]: 6.39001e-06 [order_py_execute_after_rewriter]: 5.06997e-06 [mutable_eliminate]: 0.00062823 [jit_opt_b]: 7.237e-05, [1] [Cycle 1]: 6.374e-05, [2] [frontend_op_eliminate]: 3.32e-05 [inline_after_opt_a]: 1.71e-05 [cconv]: 2.759e-05 [loop_unroll]: 0.00042683 [jit_opt_after_cconv]: 0.00015485, [1] [Cycle 1]: 0.00014795, [11] [c_1]: 2.417e-05 [parameter_eliminate]: 3.06999e-06 [updatestate_depend_eliminate]: 7.83999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.13998e-06 [cse]: 2.325e-05 [call_graph_tuple_transform]: 2.1e-05 [tuple_list_get_item_eliminator]: 5.96998e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.6e-05 [partial_unused_args_eliminate]: 3.28998e-06 [environ_conv]: 8.92e-06 [add_recomputation]: 5.358e-05 [cse_after_recomputation]: 2.162e-05, [1] [Cycle 1]: 1.632e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.607e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 5.64998e-06 [opt_after_jit_grad]: 0.00051351 [symbol_engine_optimizer]: 7.961e-05, [1] [Cycle 1]: 7.301e-05, [6] [build]: 4.13999e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.47e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 9.73002e-06 [renormalize]: 4.00003e-07 [validate]: 4.582e-05 Sums bootstrap : 0.000436s : 0.09% type_inference : 0.489709s : 98.63% event_method : 0.000024s : 0.00% auto_monad : 0.000083s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000515s : 0.10% rewriter_before_opt_a : 0.000102s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.01% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000762s : 0.15% jit_opt_a.with_stream_mark : 0.000032s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000011s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002427s : 0.49% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.00% jit_opt_a.cse : 0.000045s : 0.01% jit_opt_a.replace_applicator : 0.000023s : 0.00% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000046s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000628s : 0.13% jit_opt_b.frontend_op_eliminate : 0.000033s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.00% cconv : 0.000028s : 0.01% loop_unroll : 0.000427s : 0.09% jit_opt_after_cconv.c_1 : 0.000024s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000054s : 0.01% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000514s : 0.10% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.01% Time group info: ------[substitution.] 0.000249 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000007s : 4: substitution.graph_param_transform 84.74% : 0.000211s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.60% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.489603 2 99.42% : 0.486753s : 1: type_inference.infer 0.58% : 0.002850s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.84% : 0.000053s : 4: replace.inline 32.16% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.20% : 0.000209s : 4: match.inline 5.80% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.21% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.71% : 0.000004s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.50% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002568 22 72.05% : 0.001851s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.27% : 0.000675s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.538361 72 0.01% : 0.000057s : 1: add_recomputation 0.02% : 0.000087s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 0.09% : 0.000461s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.72% : 0.041581s : 1: jit_opt_a 0.03% : 0.000157s : 1: jit_opt_after_cconv 0.01% : 0.000075s : 1: jit_opt_b 0.08% : 0.000434s : 1: loop_unroll 0.12% : 0.000637s : 1: mutable_eliminate 0.19% : 0.001002s : 26: opt.transform.jit_opt_a 0.01% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000044s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000073s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000525s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000523s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000018s : 1: remove_dup_value 0.32% : 0.001710s : 1: renormalize.infer 0.13% : 0.000707s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000049s : 1: rewriter_after_opt_a 0.02% : 0.000108s : 1: rewriter_before_opt_a 0.02% : 0.000082s : 1: symbol_engine_optimizer 90.97% : 0.489734s : 1: type_inference TotalTime = 0.0161874, [30] [bootstrap]: 0.00034176 [type_inference]: 0.00579536 [event_method]: 1.917e-05 [auto_monad]: 6.55e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 3.836e-05 [rewriter_before_opt_a]: 7.483e-05 [expand_dump_flag]: 4.05998e-06 [jit_opt_a]: 0.00559036, [2] [Cycle 1]: 0.00179624, [27] [switch_simplify]: 6.23e-05 [loop_unroll]: 2.898e-05 [a_1]: 0.00059092 [with_stream_mark]: 2.286e-05 [recompute_prepare]: 9.29998e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.50002e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.643e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 6.08002e-06 [renormalize]: 0.00070522 [add_forward_monad_depend]: 7.21001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.783e-05 [cse]: 3.844e-05 [replace_applicator]: 1.774e-05 [Cycle 2]: 0.00034616, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 5.02e-06 [a_1]: 8.883e-05 [with_stream_mark]: 1.3e-05 [recompute_prepare]: 5.24998e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 5.28002e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 1.39989e-07 [add_forward_monad_depend]: 2.19001e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 7.81001e-06 [cse]: 1.689e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 1.413e-05 [rewriter_after_opt_a]: 3.991e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.0021786 [jit_opt_b]: 6.27e-05, [1] [Cycle 1]: 5.164e-05, [2] [frontend_op_eliminate]: 1.81e-05 [inline_after_opt_a]: 1.955e-05 [cconv]: 3.992e-05 [loop_unroll]: 0.00065762 [jit_opt_after_cconv]: 0.00018976, [1] [Cycle 1]: 0.00018173, [11] [c_1]: 2.229e-05 [parameter_eliminate]: 6.84001e-06 [updatestate_depend_eliminate]: 1.081e-05 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 4.446e-05 [call_graph_tuple_transform]: 2.497e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 2.122e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 7.43999e-06 [add_recomputation]: 5.953e-05 [cse_after_recomputation]: 3.037e-05, [1] [Cycle 1]: 2.272e-05, [1] [cse]: 1.451e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 3.01999e-06 [rewriter_after_jit_bprop_graph]: 6.04999e-06 [opt_after_jit_grad]: 0.00053991 [symbol_engine_optimizer]: 7.836e-05, [1] [Cycle 1]: 7.02e-05, [6] [build]: 3.98999e-06 [elim_shapecalc]: 7.97998e-06 [elim_not_effective]: 1.444e-05 [opt_reshape]: 5.82001e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 5.69999e-07 [validate]: 4.789e-05 Sums bootstrap : 0.000342s : 2.84% type_inference : 0.005795s : 48.13% event_method : 0.000019s : 0.16% auto_monad : 0.000066s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000038s : 0.32% rewriter_before_opt_a : 0.000075s : 0.62% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.57% jit_opt_a.loop_unroll : 0.000034s : 0.28% jit_opt_a.a_1 : 0.000680s : 5.65% jit_opt_a.with_stream_mark : 0.000036s : 0.30% jit_opt_a.recompute_prepare : 0.000015s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000705s : 5.86% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.21% jit_opt_a.cse : 0.000055s : 0.46% jit_opt_a.replace_applicator : 0.000023s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000040s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.002179s : 18.09% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.15% jit_opt_b.inline_after_opt_a : 0.000020s : 0.16% cconv : 0.000040s : 0.33% loop_unroll : 0.000658s : 5.46% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000044s : 0.37% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000021s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000060s : 0.49% cse_after_recomputation.cse : 0.000015s : 0.12% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000540s : 4.48% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.40% Time group info: ------[substitution.] 0.000251 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 84.42% : 0.000212s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000006s : 2: substitution.replace_old_param 5.56% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005722 2 85.21% : 0.004876s : 1: type_inference.infer 14.79% : 0.000846s : 1: type_inference.specialize ------[replace.] 0.000082 6 65.21% : 0.000053s : 4: replace.inline 34.79% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.19% : 0.000209s : 4: match.inline 5.81% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.79% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000003s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.38% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 2.00% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 2.77% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.38% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 1.05% : 0.000001s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.29% : 0.000002s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.21% : 0.000002s : 6: predicate.specialize_transform 1.25% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.75% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000009s : 53: predicate.switch_simplify 1.73% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000658 13 53.92% : 0.000355s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.13% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.95% : 0.000250s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017863 72 0.35% : 0.000063s : 1: add_recomputation 0.38% : 0.000069s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 2.05% : 0.000366s : 1: bootstrap 0.24% : 0.000042s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000032s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 31.31% : 0.005594s : 1: jit_opt_a 1.08% : 0.000194s : 1: jit_opt_after_cconv 0.37% : 0.000066s : 1: jit_opt_b 3.75% : 0.000671s : 1: loop_unroll 12.35% : 0.002207s : 1: mutable_eliminate 5.10% : 0.000912s : 26: opt.transform.jit_opt_a 0.31% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000030s : 4: opt.transform.jit_opt_b 0.11% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.17% : 0.000031s : 1: opt.transform.mutable_eliminate 0.14% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.09% : 0.000553s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000041s : 1: py_interpret_to_execute 0.09% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000024s : 1: remove_dup_value 2.09% : 0.000373s : 1: renormalize.infer 1.81% : 0.000323s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000044s : 1: rewriter_after_opt_a 0.44% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000081s : 1: symbol_engine_optimizer 32.55% : 0.005815s : 1: type_inference TotalTime = 0.0317241, [30] [bootstrap]: 0.00032146 [type_inference]: 0.0223169 [event_method]: 2.264e-05 [auto_monad]: 7.139e-05 [graph_reusing]: 6.89999e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 0.00011192 [rewriter_before_opt_a]: 8.763e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00626724, [2] [Cycle 1]: 0.00214267, [27] [switch_simplify]: 6.198e-05 [loop_unroll]: 2.926e-05 [a_1]: 0.00059331 [with_stream_mark]: 2.654e-05 [recompute_prepare]: 7.83001e-06 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 9.19998e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 5.27999e-06 [renormalize]: 0.00106499 [add_forward_monad_depend]: 7.33e-06 [auto_monad_grad]: 3.09999e-06 [auto_monad_eliminator]: 1.723e-05 [cse]: 3.544e-05 [replace_applicator]: 1.473e-05 [Cycle 2]: 0.00033085, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.942e-05 [with_stream_mark]: 1.235e-05 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.89001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.43002e-06 [auto_monad_grad]: 1.15999e-06 [auto_monad_eliminator]: 6.13998e-06 [cse]: 1.366e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 1.479e-05 [rewriter_after_opt_a]: 4.195e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00069511 [jit_opt_b]: 4.993e-05, [1] [Cycle 1]: 4.168e-05, [2] [frontend_op_eliminate]: 1.514e-05 [inline_after_opt_a]: 1.595e-05 [cconv]: 3.141e-05 [loop_unroll]: 0.00043631 [jit_opt_after_cconv]: 0.00015116, [1] [Cycle 1]: 0.00014439, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 7.06001e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 2.563e-05 [call_graph_tuple_transform]: 2.007e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 5.49998e-06 [remove_dup_value]: 1.814e-05 [partial_unused_args_eliminate]: 2.18998e-06 [environ_conv]: 7.75e-06 [add_recomputation]: 5.234e-05 [cse_after_recomputation]: 2.417e-05, [1] [Cycle 1]: 1.876e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.83e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 5.45001e-06 [opt_after_jit_grad]: 0.00053678 [symbol_engine_optimizer]: 7.497e-05, [1] [Cycle 1]: 6.764e-05, [6] [build]: 3.98999e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.327e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 6.89994e-07 [validate]: 4.37e-05 Sums bootstrap : 0.000321s : 1.18% type_inference : 0.022317s : 82.00% event_method : 0.000023s : 0.08% auto_monad : 0.000071s : 0.26% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000112s : 0.41% rewriter_before_opt_a : 0.000088s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.25% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000683s : 2.51% jit_opt_a.with_stream_mark : 0.000039s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001065s : 3.91% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000049s : 0.18% jit_opt_a.replace_applicator : 0.000020s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000695s : 2.55% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000031s : 0.12% loop_unroll : 0.000436s : 1.60% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000052s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000537s : 1.97% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.16% Time group info: ------[substitution.] 0.000244 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 84.52% : 0.000207s : 4: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.84% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022231 2 93.17% : 0.020712s : 1: type_inference.infer 6.83% : 0.001519s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.84% : 0.000052s : 4: replace.inline 32.16% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 93.93% : 0.000204s : 4: match.inline 6.07% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.37% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.45% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.42% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.00% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.73% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.16% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.22% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000919 13 49.95% : 0.000459s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.79% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.27% : 0.000407s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033649 72 0.16% : 0.000055s : 1: add_recomputation 0.22% : 0.000075s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.02% : 0.000342s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.64% : 0.006271s : 1: jit_opt_a 0.46% : 0.000154s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.32% : 0.000445s : 1: loop_unroll 2.10% : 0.000705s : 1: mutable_eliminate 2.71% : 0.000910s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.63% : 0.000547s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000115s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.82% : 0.000613s : 1: renormalize.infer 1.32% : 0.000443s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000045s : 1: rewriter_after_opt_a 0.27% : 0.000091s : 1: rewriter_before_opt_a 0.23% : 0.000077s : 1: symbol_engine_optimizer 66.40% : 0.022343s : 1: type_inference TotalTime = 0.391271, [30] [bootstrap]: 0.0003377 [type_inference]: 0.362766 [event_method]: 2.79e-05 [auto_monad]: 8.484e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00044842 [rewriter_before_opt_a]: 0.00011053 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.0088654, [2] [Cycle 1]: 0.00442926, [27] [switch_simplify]: 6.955e-05 [loop_unroll]: 3.348e-05 [a_1]: 0.00076688 [with_stream_mark]: 2.809e-05 [recompute_prepare]: 1.377e-05 [updatestate_depend_eliminate]: 5.03002e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.53999e-06 [updatestate_useless_node_eliminater]: 6.53998e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.805e-05 [j_node_and_user_rematch]: 1.061e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.131e-05 [inline_without_move]: 6.75002e-06 [renormalize]: 0.00308914 [add_forward_monad_depend]: 1.006e-05 [auto_monad_grad]: 2.89999e-06 [auto_monad_eliminator]: 2.075e-05 [cse]: 4.287e-05 [replace_applicator]: 2.438e-05 [Cycle 2]: 0.00041291, [27] [switch_simplify]: 8.62e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00012792 [with_stream_mark]: 1.686e-05 [recompute_prepare]: 6.55002e-06 [updatestate_depend_eliminate]: 3.87002e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 2.89001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.885e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.55997e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 8.25999e-06 [cse]: 1.932e-05 [replace_applicator]: 8.68001e-06 [py_interpret_to_execute_after_opt_a]: 1.864e-05 [rewriter_after_opt_a]: 4.436e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00078492 [jit_opt_b]: 6.228e-05, [1] [Cycle 1]: 5.267e-05, [2] [frontend_op_eliminate]: 1.96e-05 [inline_after_opt_a]: 2.035e-05 [cconv]: 3.684e-05 [loop_unroll]: 0.00047632 [jit_opt_after_cconv]: 0.00018852, [1] [Cycle 1]: 0.00018127, [11] [c_1]: 2.773e-05 [parameter_eliminate]: 3.95e-06 [updatestate_depend_eliminate]: 9.34e-06 [updatestate_assign_eliminate]: 4.37003e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 4.04e-05 [call_graph_tuple_transform]: 2.366e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.76e-06 [remove_dup_value]: 1.988e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 1.098e-05 [add_recomputation]: 5.549e-05 [cse_after_recomputation]: 2.903e-05, [1] [Cycle 1]: 2.287e-05, [1] [cse]: 1.706e-05 [auto_monad_reorder]: 1.94e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 6.80998e-06 [opt_after_jit_grad]: 0.0161903 [symbol_engine_optimizer]: 0.00034904, [1] [Cycle 1]: 0.00033748, [6] [build]: 7.36001e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 2.531e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 0.00024873 [renormalize]: 1.47999e-06 [validate]: 7.368e-05 Sums bootstrap : 0.000338s : 0.09% type_inference : 0.362766s : 93.85% event_method : 0.000028s : 0.01% auto_monad : 0.000085s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000448s : 0.12% rewriter_before_opt_a : 0.000111s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.02% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000895s : 0.23% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003089s : 0.80% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000062s : 0.02% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000785s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000037s : 0.01% loop_unroll : 0.000476s : 0.12% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000055s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.016190s : 4.19% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000249s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000074s : 0.02% Time group info: ------[substitution.] 0.000365 25 0.70% : 0.000003s : 2: substitution.elim_not_effective 11.66% : 0.000043s : 2: substitution.fold_const_symbol 2.06% : 0.000008s : 4: substitution.graph_param_transform 76.83% : 0.000280s : 5: substitution.inline 1.37% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.47% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000007s : 2: substitution.replace_old_param 4.09% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.362634 2 92.03% : 0.333727s : 1: type_inference.infer 7.97% : 0.028907s : 1: type_inference.specialize ------[replace.] 0.000113 7 67.71% : 0.000076s : 5: replace.inline 32.29% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 7 95.41% : 0.000278s : 5: match.inline 4.59% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 2.48% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.06% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.62% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.68% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.51% : 0.000001s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.76% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.52% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.72% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 1.55% : 0.000002s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.34% : 0.000004s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.12% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.87% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.78% : 0.000012s : 64: predicate.switch_simplify 1.10% : 0.000002s : 13: predicate.tile_eliminate 1.47% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002716 25 65.48% : 0.001779s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.49% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.02% : 0.000843s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.395849 72 0.01% : 0.000058s : 1: add_recomputation 0.02% : 0.000089s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.09% : 0.000355s : 1: bootstrap 0.01% : 0.000039s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.24% : 0.008870s : 1: jit_opt_a 0.05% : 0.000191s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.12% : 0.000486s : 1: loop_unroll 0.20% : 0.000798s : 1: mutable_eliminate 0.30% : 0.001174s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000054s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000288s : 4: opt.transform.symbol_engine_opt 4.10% : 0.016212s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000455s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.55% : 0.002174s : 1: renormalize.infer 0.23% : 0.000901s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.03% : 0.000117s : 1: rewriter_before_opt_a 0.09% : 0.000353s : 1: symbol_engine_optimizer 91.65% : 0.362793s : 1: type_inference TotalTime = 0.0316105, [30] [bootstrap]: 0.00037151 [type_inference]: 0.0222113 [event_method]: 2.005e-05 [auto_monad]: 7.2e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.63998e-06 [py_interpret_to_execute]: 0.00010072 [rewriter_before_opt_a]: 8.268e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.006254, [2] [Cycle 1]: 0.00228367, [27] [switch_simplify]: 6.456e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00059641 [with_stream_mark]: 2.455e-05 [recompute_prepare]: 9.77999e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.40002e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.714e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.54e-06 [renormalize]: 0.00117403 [add_forward_monad_depend]: 8.17e-06 [auto_monad_grad]: 3.08998e-06 [auto_monad_eliminator]: 2.027e-05 [cse]: 3.812e-05 [replace_applicator]: 1.977e-05 [Cycle 2]: 0.00034973, [27] [switch_simplify]: 6.71999e-06 [loop_unroll]: 5.47999e-06 [a_1]: 9.181e-05 [with_stream_mark]: 1.52e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 4.34997e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 2.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.885e-05 [j_node_and_user_rematch]: 9.58997e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.08001e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.534e-05 [replace_applicator]: 6.31998e-06 [py_interpret_to_execute_after_opt_a]: 1.793e-05 [rewriter_after_opt_a]: 4.461e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00073762 [jit_opt_b]: 5.251e-05, [1] [Cycle 1]: 4.417e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 3.444e-05 [loop_unroll]: 0.00044443 [jit_opt_after_cconv]: 0.0001609, [1] [Cycle 1]: 0.00015426, [11] [c_1]: 2.07e-05 [parameter_eliminate]: 3.93999e-06 [updatestate_depend_eliminate]: 8.90999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.38998e-06 [cse]: 3.043e-05 [call_graph_tuple_transform]: 2.21e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 6.56e-06 [add_recomputation]: 5.304e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.769e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.692e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 7.13e-06 [opt_after_jit_grad]: 0.00052258 [symbol_engine_optimizer]: 9.687e-05, [1] [Cycle 1]: 9.03e-05, [6] [build]: 4.07003e-06 [elim_shapecalc]: 2.855e-05 [elim_not_effective]: 1.398e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 9.06002e-06 [renormalize]: 7.7e-07 [validate]: 4.515e-05 Sums bootstrap : 0.000372s : 1.36% type_inference : 0.022211s : 81.17% event_method : 0.000020s : 0.07% auto_monad : 0.000072s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000101s : 0.37% rewriter_before_opt_a : 0.000083s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000688s : 2.51% jit_opt_a.with_stream_mark : 0.000040s : 0.15% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001174s : 4.29% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000026s : 0.10% py_interpret_to_execute_after_opt_a : 0.000018s : 0.07% rewriter_after_opt_a : 0.000045s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000738s : 2.70% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000034s : 0.13% loop_unroll : 0.000444s : 1.62% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000523s : 1.91% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000029s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000261 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 3: substitution.graph_param_transform 84.86% : 0.000221s : 4: substitution.inline 2.00% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.21% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022129 2 93.03% : 0.020587s : 1: type_inference.infer 6.97% : 0.001542s : 1: type_inference.specialize ------[replace.] 0.000080 6 68.32% : 0.000055s : 4: replace.inline 31.68% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.74% : 0.000219s : 4: match.inline 5.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.37% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.36% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.47% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.22% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000002s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.19% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.47% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000983 13 42.85% : 0.000421s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.28% : 0.000504s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033791 72 0.17% : 0.000056s : 1: add_recomputation 0.22% : 0.000075s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.16% : 0.000391s : 1: bootstrap 0.11% : 0.000037s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.52% : 0.006257s : 1: jit_opt_a 0.48% : 0.000163s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.34% : 0.000453s : 1: loop_unroll 2.22% : 0.000751s : 1: mutable_eliminate 2.76% : 0.000932s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000054s : 4: opt.transform.symbol_engine_opt 1.57% : 0.000531s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000104s : 1: py_interpret_to_execute 0.06% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.84% : 0.000623s : 1: renormalize.infer 1.60% : 0.000542s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000048s : 1: rewriter_after_opt_a 0.25% : 0.000086s : 1: rewriter_before_opt_a 0.29% : 0.000099s : 1: symbol_engine_optimizer 65.79% : 0.022230s : 1: type_inference TotalTime = 0.0420085, [30] [bootstrap]: 0.00035234 [type_inference]: 0.0329224 [event_method]: 2.425e-05 [auto_monad]: 7.03e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00011224 [rewriter_before_opt_a]: 8.672e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00611352, [2] [Cycle 1]: 0.00216865, [27] [switch_simplify]: 5.815e-05 [loop_unroll]: 2.877e-05 [a_1]: 0.0005472 [with_stream_mark]: 2.181e-05 [recompute_prepare]: 6.93998e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.628e-05 [j_node_and_user_rematch]: 9.01998e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.41998e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 0.00116145 [add_forward_monad_depend]: 6.95998e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 1.677e-05 [cse]: 3.736e-05 [replace_applicator]: 1.65e-05 [Cycle 2]: 0.00032798, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.24e-06 [a_1]: 8.986e-05 [with_stream_mark]: 1.396e-05 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.58e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.46002e-06 [cse]: 1.307e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.498e-05 [rewriter_after_opt_a]: 3.838e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00067289 [jit_opt_b]: 5.041e-05, [1] [Cycle 1]: 4.209e-05, [2] [frontend_op_eliminate]: 1.568e-05 [inline_after_opt_a]: 1.626e-05 [cconv]: 2.894e-05 [loop_unroll]: 0.00042566 [jit_opt_after_cconv]: 0.00014758, [1] [Cycle 1]: 0.00014116, [11] [c_1]: 2.057e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 5.88998e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.435e-05 [call_graph_tuple_transform]: 1.957e-05 [tuple_list_get_item_eliminator]: 5.53002e-06 [none_parameter_eliminate]: 2.06e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.659e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 6.39001e-06 [add_recomputation]: 5.133e-05 [cse_after_recomputation]: 2.342e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.64e-06 [opt_after_jit_grad]: 0.0004714 [symbol_engine_optimizer]: 8.851e-05, [1] [Cycle 1]: 8.115e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 2.238e-05 [elim_not_effective]: 1.312e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.73001e-06 [renormalize]: 4.7998e-07 [validate]: 4.61e-05 Sums bootstrap : 0.000352s : 0.93% type_inference : 0.032922s : 87.11% event_method : 0.000024s : 0.06% auto_monad : 0.000070s : 0.19% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000112s : 0.30% rewriter_before_opt_a : 0.000087s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.17% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000637s : 1.69% jit_opt_a.with_stream_mark : 0.000036s : 0.09% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001162s : 3.07% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000050s : 0.13% jit_opt_a.replace_applicator : 0.000022s : 0.06% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000038s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000673s : 1.78% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.08% loop_unroll : 0.000426s : 1.13% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.14% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000471s : 1.25% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000022s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.12% Time group info: ------[substitution.] 0.000224 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000006s : 3: substitution.graph_param_transform 84.17% : 0.000188s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000005s : 2: substitution.replace_old_param 5.21% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.032830 2 94.62% : 0.031065s : 1: type_inference.infer 5.38% : 0.001765s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.15% : 0.000050s : 4: replace.inline 30.85% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.65% : 0.000186s : 4: match.inline 5.35% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.39% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.08% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 1.93% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.97% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.87% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000958 13 47.27% : 0.000453s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.01% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.72% : 0.000457s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044086 72 0.12% : 0.000054s : 1: add_recomputation 0.17% : 0.000074s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.85% : 0.000375s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.88% : 0.006117s : 1: jit_opt_a 0.34% : 0.000150s : 1: jit_opt_after_cconv 0.12% : 0.000053s : 1: jit_opt_b 0.98% : 0.000434s : 1: loop_unroll 1.55% : 0.000683s : 1: mutable_eliminate 1.95% : 0.000858s : 26: opt.transform.jit_opt_a 0.11% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000047s : 4: opt.transform.symbol_engine_opt 1.09% : 0.000480s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000115s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.39% : 0.000612s : 1: renormalize.infer 1.22% : 0.000540s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000041s : 1: rewriter_after_opt_a 0.21% : 0.000091s : 1: rewriter_before_opt_a 0.21% : 0.000091s : 1: symbol_engine_optimizer 74.73% : 0.032947s : 1: type_inference TotalTime = 0.625758, [30] [bootstrap]: 0.00040584 [type_inference]: 0.543118 [event_method]: 2.969e-05 [auto_monad]: 9.237e-05 [graph_reusing]: 6.83e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00102058 [rewriter_before_opt_a]: 0.00010867 [expand_dump_flag]: 4.1e-06 [jit_opt_a]: 0.0774959, [2] [Cycle 1]: 0.0067477, [27] [switch_simplify]: 8.452e-05 [loop_unroll]: 3.307e-05 [a_1]: 0.00076829 [with_stream_mark]: 2.828e-05 [recompute_prepare]: 1.111e-05 [updatestate_depend_eliminate]: 4.68001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 7.16001e-06 [meta_shard_fg_expand]: 3.83999e-06 [get_grad_eliminate_]: 7.69002e-06 [merge_forward]: 4.97e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.897e-05 [j_node_and_user_rematch]: 1.301e-05 [meta_fg_expand]: 3.68e-06 [replace_old_param]: 1.484e-05 [inline_without_move]: 7.46001e-06 [renormalize]: 0.00536477 [add_forward_monad_depend]: 1.122e-05 [auto_monad_grad]: 3.01001e-06 [auto_monad_eliminator]: 2.131e-05 [cse]: 4.036e-05 [replace_applicator]: 2.92e-05 [Cycle 2]: 0.0655953, [27] [switch_simplify]: 7.47002e-06 [loop_unroll]: 6.41998e-06 [a_1]: 0.00014244 [with_stream_mark]: 1.751e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 3.98001e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.70998e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 4.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.0649434 [j_node_and_user_rematch]: 6.698e-05 [meta_fg_expand]: 9.62999e-06 [replace_old_param]: 2.058e-05 [inline_without_move]: 7.97e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.151e-05 [auto_monad_grad]: 4.20999e-06 [auto_monad_eliminator]: 2.712e-05 [cse]: 4.76e-05 [replace_applicator]: 9.38002e-06 [py_interpret_to_execute_after_opt_a]: 2.449e-05 [rewriter_after_opt_a]: 4.882e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00104324 [jit_opt_b]: 8.174e-05, [1] [Cycle 1]: 6.878e-05, [2] [frontend_op_eliminate]: 3.021e-05 [inline_after_opt_a]: 2.514e-05 [cconv]: 3.476e-05 [loop_unroll]: 0.00055592 [jit_opt_after_cconv]: 0.00020397, [1] [Cycle 1]: 0.00019614, [11] [c_1]: 3.024e-05 [parameter_eliminate]: 5.02999e-06 [updatestate_depend_eliminate]: 7.06999e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 4.154e-05 [call_graph_tuple_transform]: 3.04e-05 [tuple_list_get_item_eliminator]: 8.69998e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 7.7e-07 [switch_simplify]: 7.61999e-06 [remove_dup_value]: 1.769e-05 [partial_unused_args_eliminate]: 3.93001e-06 [environ_conv]: 1.136e-05 [add_recomputation]: 6.256e-05 [cse_after_recomputation]: 0.00028139, [1] [Cycle 1]: 0.00027312, [1] [cse]: 0.00026374 [auto_monad_reorder]: 1.973e-05 [get_jit_bprop_graph]: 2.94999e-06 [rewriter_after_jit_bprop_graph]: 1.088e-05 [opt_after_jit_grad]: 0.00065326 [symbol_engine_optimizer]: 0.00010033, [1] [Cycle 1]: 9.194e-05, [6] [build]: 5.96e-06 [elim_shapecalc]: 1.104e-05 [elim_not_effective]: 1.966e-05 [opt_reshape]: 9.22001e-06 [fold_const_symbol]: 1.255e-05 [renormalize]: 6.19999e-07 [validate]: 5.786e-05 Sums bootstrap : 0.000406s : 0.07% type_inference : 0.543118s : 87.64% event_method : 0.000030s : 0.00% auto_monad : 0.000092s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001021s : 0.16% rewriter_before_opt_a : 0.000109s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.01% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000911s : 0.15% jit_opt_a.with_stream_mark : 0.000046s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.064962s : 10.48% jit_opt_a.j_node_and_user_rematch : 0.000080s : 0.01% jit_opt_a.meta_fg_expand : 0.000013s : 0.00% jit_opt_a.replace_old_param : 0.000035s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.005365s : 0.87% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.00% jit_opt_a.auto_monad_grad : 0.000007s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000048s : 0.01% jit_opt_a.cse : 0.000088s : 0.01% jit_opt_a.replace_applicator : 0.000039s : 0.01% py_interpret_to_execute_after_opt_a : 0.000024s : 0.00% rewriter_after_opt_a : 0.000049s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001043s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.00% jit_opt_b.inline_after_opt_a : 0.000025s : 0.00% cconv : 0.000035s : 0.01% loop_unroll : 0.000556s : 0.09% jit_opt_after_cconv.c_1 : 0.000030s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000063s : 0.01% cse_after_recomputation.cse : 0.000264s : 0.04% auto_monad_reorder : 0.000020s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000653s : 0.11% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.01% Time group info: ------[substitution.] 0.000324 24 0.91% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 3.12% : 0.000010s : 4: substitution.graph_param_transform 81.90% : 0.000266s : 4: substitution.inline 2.76% : 0.000009s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000006s : 4: substitution.remove_not_recompute_node 3.93% : 0.000013s : 2: substitution.replace_old_param 4.79% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.542965 2 95.88% : 0.520572s : 1: type_inference.infer 4.12% : 0.022392s : 1: type_inference.specialize ------[replace.] 0.000115 6 63.65% : 0.000073s : 4: replace.inline 36.35% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000277 6 94.89% : 0.000263s : 4: match.inline 5.11% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 1.42% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000001s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000004s : 12: predicate.arithmetic_simplify 1.55% : 0.000003s : 12: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.38% : 0.000002s : 12: predicate.compare_switch_simplify 0.92% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.63% : 0.000003s : 12: predicate.dict_get_item_eliminator 0.98% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.88% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.42% : 0.000002s : 12: predicate.environ_get_eliminate 1.26% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.39% : 0.000001s : 4: predicate.fold_const_symbol 0.84% : 0.000001s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 4.30% : 0.000007s : 26: predicate.inline 1.24% : 0.000002s : 8: predicate.inline_without_move 1.13% : 0.000002s : 8: predicate.j_node_and_user_rematch 1.76% : 0.000003s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 18: predicate.load_eliminater 1.54% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 1.01% : 0.000002s : 12: predicate.minmaximum_grad 1.57% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 2.90% : 0.000005s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000001s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.18% : 0.000002s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.69% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 18: predicate.switch_defer_inline 1.85% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.60% : 0.000011s : 58: predicate.switch_simplify 1.55% : 0.000003s : 12: predicate.tile_eliminate 1.07% : 0.000002s : 12: predicate.transpose_eliminate 1.66% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 4.64% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.44% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 12: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003557 22 57.69% : 0.002052s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.97% : 0.001457s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.632483 72 0.01% : 0.000065s : 1: add_recomputation 0.02% : 0.000095s : 1: auto_monad 0.00% : 0.000023s : 1: auto_monad_reorder 0.07% : 0.000429s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000284s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.25% : 0.077503s : 1: jit_opt_a 0.03% : 0.000207s : 1: jit_opt_after_cconv 0.01% : 0.000085s : 1: jit_opt_b 0.09% : 0.000565s : 1: loop_unroll 0.17% : 0.001056s : 1: mutable_eliminate 0.20% : 0.001271s : 26: opt.transform.jit_opt_a 0.01% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000045s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000664s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.001032s : 1: py_interpret_to_execute 0.00% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 0.61% : 0.003887s : 1: renormalize.infer 0.23% : 0.001460s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000053s : 1: rewriter_after_opt_a 0.02% : 0.000113s : 1: rewriter_before_opt_a 0.02% : 0.000103s : 1: symbol_engine_optimizer 85.88% : 0.543148s : 1: type_inference TotalTime = 0.0619316, [30] [bootstrap]: 0.00030786 [type_inference]: 0.00485718 [event_method]: 1.866e-05 [auto_monad]: 6.772e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 3.714e-05 [rewriter_before_opt_a]: 7.69e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.0540731, [2] [Cycle 1]: 0.00178537, [27] [switch_simplify]: 6.347e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.00056609 [with_stream_mark]: 2.333e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 3.40003e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.35002e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 4.74e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.54e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 0.00074906 [add_forward_monad_depend]: 5.90002e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.518e-05 [cse]: 3.606e-05 [replace_applicator]: 1.326e-05 [Cycle 2]: 0.0487039, [27] [switch_simplify]: 5.74999e-06 [loop_unroll]: 4.80999e-06 [a_1]: 9.375e-05 [with_stream_mark]: 1.027e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 4.95999e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.344e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 0.048264 [cse]: 4.927e-05 [replace_applicator]: 2.997e-05 [py_interpret_to_execute_after_opt_a]: 2.094e-05 [rewriter_after_opt_a]: 5.114e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00075189 [jit_opt_b]: 5.859e-05, [1] [Cycle 1]: 5.024e-05, [2] [frontend_op_eliminate]: 1.784e-05 [inline_after_opt_a]: 2.028e-05 [cconv]: 3.711e-05 [loop_unroll]: 0.00044405 [jit_opt_after_cconv]: 0.00018615, [1] [Cycle 1]: 0.00017894, [11] [c_1]: 2.327e-05 [parameter_eliminate]: 3.61999e-06 [updatestate_depend_eliminate]: 8.27e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.90002e-06 [cse]: 3.101e-05 [call_graph_tuple_transform]: 2.086e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.798e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 7.08e-06 [add_recomputation]: 5.284e-05 [cse_after_recomputation]: 2.58e-05, [1] [Cycle 1]: 2.007e-05, [1] [cse]: 1.37e-05 [auto_monad_reorder]: 1.828e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 6.68e-06 [opt_after_jit_grad]: 0.00048003 [symbol_engine_optimizer]: 7.706e-05, [1] [Cycle 1]: 7.053e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.42e-05 [opt_reshape]: 5.97999e-06 [fold_const_symbol]: 9.30001e-06 [renormalize]: 5.49975e-07 [validate]: 4.377e-05 Sums bootstrap : 0.000308s : 0.53% type_inference : 0.004857s : 8.42% event_method : 0.000019s : 0.03% auto_monad : 0.000068s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.06% rewriter_before_opt_a : 0.000077s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000660s : 1.14% jit_opt_a.with_stream_mark : 0.000034s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000749s : 1.30% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.048279s : 83.73% jit_opt_a.cse : 0.000085s : 0.15% jit_opt_a.replace_applicator : 0.000043s : 0.07% py_interpret_to_execute_after_opt_a : 0.000021s : 0.04% rewriter_after_opt_a : 0.000051s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000752s : 1.30% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.04% cconv : 0.000037s : 0.06% loop_unroll : 0.000444s : 0.77% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000480s : 0.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.08% Time group info: ------[substitution.] 0.000239 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000002s : 2: substitution.fold_const_symbol 2.84% : 0.000007s : 3: substitution.graph_param_transform 84.84% : 0.000203s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004784 2 81.96% : 0.003921s : 1: type_inference.infer 18.04% : 0.000863s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.43% : 0.000049s : 4: replace.inline 31.57% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.80% : 0.000200s : 4: match.inline 5.20% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.07% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 2.47% : 0.000003s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.14% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.00% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.11% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000645 13 51.73% : 0.000333s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.60% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.67% : 0.000262s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063645 72 0.09% : 0.000056s : 1: add_recomputation 0.11% : 0.000072s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.51% : 0.000327s : 1: bootstrap 0.06% : 0.000040s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 84.97% : 0.054077s : 1: jit_opt_a 0.30% : 0.000189s : 1: jit_opt_after_cconv 0.10% : 0.000061s : 1: jit_opt_b 0.71% : 0.000452s : 1: loop_unroll 1.20% : 0.000761s : 1: mutable_eliminate 1.42% : 0.000902s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000040s : 1: py_interpret_to_execute 0.04% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.64% : 0.000408s : 1: renormalize.infer 0.52% : 0.000333s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000054s : 1: rewriter_after_opt_a 0.13% : 0.000080s : 1: rewriter_before_opt_a 0.12% : 0.000079s : 1: symbol_engine_optimizer 7.66% : 0.004876s : 1: type_inference TotalTime = 0.286723, [30] [bootstrap]: 0.00032693 [type_inference]: 0.232089 [event_method]: 2.404e-05 [auto_monad]: 7.486e-05 [graph_reusing]: 6.57002e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00027207 [rewriter_before_opt_a]: 8.748e-05 [expand_dump_flag]: 3.20998e-06 [jit_opt_a]: 0.00687627, [2] [Cycle 1]: 0.00292949, [27] [switch_simplify]: 5.61e-05 [loop_unroll]: 3.006e-05 [a_1]: 0.0005949 [with_stream_mark]: 2.428e-05 [recompute_prepare]: 9.16998e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.89001e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.095e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00185453 [add_forward_monad_depend]: 7.3e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.841e-05 [cse]: 3.322e-05 [replace_applicator]: 1.882e-05 [Cycle 2]: 0.00038311, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.56e-06 [a_1]: 0.00011946 [with_stream_mark]: 1.445e-05 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 2.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.691e-05 [j_node_and_user_rematch]: 1.009e-05 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.196e-05 [replace_applicator]: 1.455e-05 [py_interpret_to_execute_after_opt_a]: 1.308e-05 [rewriter_after_opt_a]: 4.031e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00066675 [jit_opt_b]: 5.616e-05, [1] [Cycle 1]: 4.724e-05, [2] [frontend_op_eliminate]: 1.787e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 3.105e-05 [loop_unroll]: 0.00043769 [jit_opt_after_cconv]: 0.00016215, [1] [Cycle 1]: 0.00015411, [11] [c_1]: 2.471e-05 [parameter_eliminate]: 3.49001e-06 [updatestate_depend_eliminate]: 8.77999e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.617e-05 [call_graph_tuple_transform]: 2.117e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.86003e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.53e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 4.567e-05 [add_recomputation]: 5.688e-05 [cse_after_recomputation]: 2.784e-05, [1] [Cycle 1]: 2.132e-05, [1] [cse]: 1.379e-05 [auto_monad_reorder]: 1.678e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 7.11999e-06 [opt_after_jit_grad]: 0.0449853 [symbol_engine_optimizer]: 9.98e-05, [1] [Cycle 1]: 8.871e-05, [6] [build]: 7.43e-06 [elim_shapecalc]: 9.62001e-06 [elim_not_effective]: 2.378e-05 [opt_reshape]: 6.94999e-06 [fold_const_symbol]: 1.035e-05 [renormalize]: 1.04e-06 [validate]: 5.936e-05 Sums bootstrap : 0.000327s : 0.12% type_inference : 0.232089s : 82.15% event_method : 0.000024s : 0.01% auto_monad : 0.000075s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000272s : 0.10% rewriter_before_opt_a : 0.000087s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.02% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000714s : 0.25% jit_opt_a.with_stream_mark : 0.000039s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.001855s : 0.66% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000667s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000438s : 0.15% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000046s : 0.02% add_recomputation : 0.000057s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.044985s : 15.92% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.02% Time group info: ------[substitution.] 0.000242 24 1.44% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 4: substitution.graph_param_transform 84.07% : 0.000204s : 4: substitution.inline 1.74% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000006s : 2: substitution.replace_old_param 5.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.231984 2 99.12% : 0.229935s : 1: type_inference.infer 0.88% : 0.002049s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.70% : 0.000050s : 4: replace.inline 30.30% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.73% : 0.000201s : 4: match.inline 5.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 3.48% : 0.000005s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 12: predicate.dict_set_item_eliminator 2.08% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.70% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.09% : 0.000001s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.48% : 0.000001s : 4: predicate.graph_param_transform 6.53% : 0.000009s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.73% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.01% : 0.000001s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.41% : 0.000002s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.25% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.82% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.26% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002128 22 72.04% : 0.001533s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.58% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.39% : 0.000540s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.289619 72 0.02% : 0.000060s : 1: add_recomputation 0.03% : 0.000078s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.12% : 0.000347s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000048s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.38% : 0.006880s : 1: jit_opt_a 0.06% : 0.000165s : 1: jit_opt_after_cconv 0.02% : 0.000059s : 1: jit_opt_b 0.15% : 0.000447s : 1: loop_unroll 0.23% : 0.000675s : 1: mutable_eliminate 0.33% : 0.000961s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000051s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000047s : 4: opt.transform.symbol_engine_opt 15.54% : 0.045004s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000278s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.44% : 0.001274s : 1: renormalize.infer 0.20% : 0.000570s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000093s : 1: rewriter_before_opt_a 0.04% : 0.000103s : 1: symbol_engine_optimizer 80.15% : 0.232121s : 1: type_inference TotalTime = 0.017505, [30] [bootstrap]: 0.00040175 [type_inference]: 0.0064699 [event_method]: 2.171e-05 [auto_monad]: 7.493e-05 [graph_reusing]: 5.57001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 4.717e-05 [rewriter_before_opt_a]: 7.69e-05 [expand_dump_flag]: 3.20998e-06 [jit_opt_a]: 0.00714509, [2] [Cycle 1]: 0.00219356, [27] [switch_simplify]: 7.473e-05 [loop_unroll]: 3.407e-05 [a_1]: 0.00068659 [with_stream_mark]: 2.941e-05 [recompute_prepare]: 9.94001e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 2.88998e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 5.34e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.668e-05 [j_node_and_user_rematch]: 9.85002e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.177e-05 [inline_without_move]: 5.84e-06 [renormalize]: 0.0009519 [add_forward_monad_depend]: 8.3e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.027e-05 [cse]: 3.691e-05 [replace_applicator]: 1.819e-05 [Cycle 2]: 0.00047917, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.42001e-06 [a_1]: 0.00010626 [with_stream_mark]: 1.5e-05 [recompute_prepare]: 6.38e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 2.33998e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.712e-05 [j_node_and_user_rematch]: 1.175e-05 [meta_fg_expand]: 3.01999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.71998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.02001e-06 [auto_monad_grad]: 1.67999e-06 [auto_monad_eliminator]: 1.05e-05 [cse]: 1.779e-05 [replace_applicator]: 6.03998e-06 [py_interpret_to_execute_after_opt_a]: 1.822e-05 [rewriter_after_opt_a]: 4.523e-05 [convert_after_rewriter]: 9.87001e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00089509 [jit_opt_b]: 6.654e-05, [1] [Cycle 1]: 5.475e-05, [2] [frontend_op_eliminate]: 2.007e-05 [inline_after_opt_a]: 2.105e-05 [cconv]: 3.778e-05 [loop_unroll]: 0.00071184 [jit_opt_after_cconv]: 0.00022793, [1] [Cycle 1]: 0.00021898, [11] [c_1]: 2.465e-05 [parameter_eliminate]: 6.91999e-06 [updatestate_depend_eliminate]: 1.303e-05 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 3.87e-05 [call_graph_tuple_transform]: 5.868e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.05002e-06 [remove_dup_value]: 2.008e-05 [partial_unused_args_eliminate]: 3.26999e-06 [environ_conv]: 7.75e-06 [add_recomputation]: 6.369e-05 [cse_after_recomputation]: 2.69e-05, [1] [Cycle 1]: 1.999e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.728e-05 [get_jit_bprop_graph]: 2.84999e-06 [rewriter_after_jit_bprop_graph]: 1.094e-05 [opt_after_jit_grad]: 0.00069967 [symbol_engine_optimizer]: 8.991e-05, [1] [Cycle 1]: 8.154e-05, [6] [build]: 6.11998e-06 [elim_shapecalc]: 9.24998e-06 [elim_not_effective]: 1.802e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 1.032e-05 [renormalize]: 9.20001e-07 [validate]: 5.276e-05 Sums bootstrap : 0.000402s : 3.27% type_inference : 0.006470s : 52.65% event_method : 0.000022s : 0.18% auto_monad : 0.000075s : 0.61% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.38% rewriter_before_opt_a : 0.000077s : 0.63% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000081s : 0.66% jit_opt_a.loop_unroll : 0.000039s : 0.32% jit_opt_a.a_1 : 0.000793s : 6.45% jit_opt_a.with_stream_mark : 0.000044s : 0.36% jit_opt_a.recompute_prepare : 0.000016s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000013s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000010s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000114s : 0.93% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.18% jit_opt_a.meta_fg_expand : 0.000006s : 0.05% jit_opt_a.replace_old_param : 0.000022s : 0.18% jit_opt_a.inline_without_move : 0.000012s : 0.09% jit_opt_a.renormalize : 0.000952s : 7.75% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.25% jit_opt_a.cse : 0.000055s : 0.45% jit_opt_a.replace_applicator : 0.000024s : 0.20% py_interpret_to_execute_after_opt_a : 0.000018s : 0.15% rewriter_after_opt_a : 0.000045s : 0.37% convert_after_rewriter : 0.000010s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000895s : 7.28% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.16% jit_opt_b.inline_after_opt_a : 0.000021s : 0.17% cconv : 0.000038s : 0.31% loop_unroll : 0.000712s : 5.79% jit_opt_after_cconv.c_1 : 0.000025s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.11% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000039s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000059s : 0.48% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000020s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000008s : 0.06% add_recomputation : 0.000064s : 0.52% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000011s : 0.09% opt_after_jit_grad : 0.000700s : 5.69% symbol_engine_optimizer.build : 0.000006s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000053s : 0.43% Time group info: ------[substitution.] 0.000348 23 0.86% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 10.73% : 0.000037s : 3: substitution.graph_param_transform 78.21% : 0.000272s : 4: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000007s : 4: substitution.remove_not_recompute_node 2.12% : 0.000007s : 2: substitution.replace_old_param 4.23% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006382 2 84.79% : 0.005412s : 1: type_inference.infer 15.21% : 0.000971s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.17% : 0.000056s : 4: replace.inline 30.83% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 6 95.19% : 0.000270s : 4: match.inline 4.81% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.35% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.10% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000002s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.42% : 0.000002s : 10: predicate.environ_get_depend_swap 1.00% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 5.89% : 0.000009s : 22: predicate.inline 1.11% : 0.000002s : 6: predicate.inline_without_move 0.37% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 15: predicate.load_eliminater 1.92% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.76% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.81% : 0.000004s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.64% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 3: predicate.row_tensor_eliminate 1.01% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.58% : 0.000002s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.11% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.92% : 0.000013s : 53: predicate.switch_simplify 1.18% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000002s : 10: predicate.transpose_eliminate 1.21% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.47% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000826 13 53.62% : 0.000443s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.38% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.00% : 0.000322s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019698 72 0.34% : 0.000067s : 1: add_recomputation 0.40% : 0.000078s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 2.19% : 0.000431s : 1: bootstrap 0.21% : 0.000041s : 1: cconv 0.06% : 0.000012s : 1: convert_after_rewriter 0.15% : 0.000029s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 36.29% : 0.007149s : 1: jit_opt_a 1.17% : 0.000231s : 1: jit_opt_after_cconv 0.35% : 0.000070s : 1: jit_opt_b 3.69% : 0.000727s : 1: loop_unroll 4.64% : 0.000913s : 1: mutable_eliminate 5.76% : 0.001134s : 26: opt.transform.jit_opt_a 0.46% : 0.000092s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000032s : 4: opt.transform.jit_opt_b 0.10% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000024s : 1: opt.transform.mutable_eliminate 0.15% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000041s : 4: opt.transform.symbol_engine_opt 3.62% : 0.000714s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000051s : 1: py_interpret_to_execute 0.10% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000023s : 1: remove_dup_value 2.66% : 0.000525s : 1: renormalize.infer 2.12% : 0.000417s : 1: renormalize.specialize 0.07% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000049s : 1: rewriter_after_opt_a 0.41% : 0.000081s : 1: rewriter_before_opt_a 0.47% : 0.000093s : 1: symbol_engine_optimizer 32.99% : 0.006498s : 1: type_inference TotalTime = 0.602693, [30] [bootstrap]: 0.00037132 [type_inference]: 0.483332 [event_method]: 2.552e-05 [auto_monad]: 7.984e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00050737 [rewriter_before_opt_a]: 0.0001078 [expand_dump_flag]: 3.64002e-06 [jit_opt_a]: 0.115343, [2] [Cycle 1]: 0.110808, [27] [switch_simplify]: 7.685e-05 [loop_unroll]: 3.387e-05 [a_1]: 0.00084035 [with_stream_mark]: 2.717e-05 [recompute_prepare]: 1.021e-05 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 8.23001e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 7.26999e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 7.26001e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.913e-05 [j_node_and_user_rematch]: 1.194e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.138e-05 [inline_without_move]: 6.49001e-06 [renormalize]: 0.109362 [add_forward_monad_depend]: 1.18e-05 [auto_monad_grad]: 3.65e-06 [auto_monad_eliminator]: 2.358e-05 [cse]: 4.487e-05 [replace_applicator]: 2.769e-05 [Cycle 2]: 0.0004216, [27] [switch_simplify]: 7.99002e-06 [loop_unroll]: 6.49001e-06 [a_1]: 0.00013155 [with_stream_mark]: 1.701e-05 [recompute_prepare]: 6.98e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 6.28002e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.094e-05 [j_node_and_user_rematch]: 1.178e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 5.61e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 1.41998e-06 [auto_monad_grad]: 1.14998e-06 [auto_monad_eliminator]: 8.45001e-06 [cse]: 1.86e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.726e-05 [rewriter_after_opt_a]: 4.971e-05 [convert_after_rewriter]: 7.61999e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00081211 [jit_opt_b]: 0.00016669, [1] [Cycle 1]: 0.00015622, [2] [frontend_op_eliminate]: 5.188e-05 [inline_after_opt_a]: 2.094e-05 [cconv]: 3.478e-05 [loop_unroll]: 0.00049292 [jit_opt_after_cconv]: 0.00018816, [1] [Cycle 1]: 0.00018051, [11] [c_1]: 2.729e-05 [parameter_eliminate]: 3.78999e-06 [updatestate_depend_eliminate]: 8.48999e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 5.29e-06 [cse]: 3.784e-05 [call_graph_tuple_transform]: 2.295e-05 [tuple_list_get_item_eliminator]: 7.55e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.76999e-06 [remove_dup_value]: 1.941e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 1.143e-05 [add_recomputation]: 6.643e-05 [cse_after_recomputation]: 2.786e-05, [1] [Cycle 1]: 2.226e-05, [1] [cse]: 1.597e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 6.49001e-06 [opt_after_jit_grad]: 0.00052396 [symbol_engine_optimizer]: 8.565e-05, [1] [Cycle 1]: 7.956e-05, [6] [build]: 4.80999e-06 [elim_shapecalc]: 1.018e-05 [elim_not_effective]: 1.78e-05 [opt_reshape]: 7.43e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 5.69999e-07 [validate]: 0.00014439 Sums bootstrap : 0.000371s : 0.06% type_inference : 0.483332s : 80.85% event_method : 0.000026s : 0.00% auto_monad : 0.000080s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000507s : 0.08% rewriter_before_opt_a : 0.000108s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000085s : 0.01% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000972s : 0.16% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.109363s : 18.29% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000063s : 0.01% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000050s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000812s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000052s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000035s : 0.01% loop_unroll : 0.000493s : 0.08% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000066s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000524s : 0.09% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000144s : 0.02% Time group info: ------[substitution.] 0.000369 25 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000007s : 4: substitution.graph_param_transform 88.69% : 0.000327s : 5: substitution.inline 1.30% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000006s : 4: substitution.remove_not_recompute_node 1.87% : 0.000007s : 2: substitution.replace_old_param 3.71% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.483212 2 99.29% : 0.479797s : 1: type_inference.infer 0.71% : 0.003415s : 1: type_inference.specialize ------[replace.] 0.000121 7 69.31% : 0.000084s : 5: replace.inline 30.69% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000337 7 96.32% : 0.000324s : 5: match.inline 3.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 2.19% : 0.000003s : 13: predicate.arithmetic_simplify 1.17% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.06% : 0.000002s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 6.26% : 0.000010s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.30% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.67% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.73% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.88% : 0.000003s : 13: predicate.print_const_string_wrapper 1.78% : 0.000003s : 13: predicate.reduce_eliminate 1.73% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.35% : 0.000004s : 23: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.93% : 0.000005s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.24% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 2.05% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 2.04% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003124 25 64.12% : 0.002003s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.62% : 0.001019s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.713324 72 0.01% : 0.000070s : 1: add_recomputation 0.01% : 0.000083s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.06% : 0.000395s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.00% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.00% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 16.17% : 0.115347s : 1: jit_opt_a 0.03% : 0.000193s : 1: jit_opt_after_cconv 0.02% : 0.000170s : 1: jit_opt_b 0.07% : 0.000503s : 1: loop_unroll 0.12% : 0.000827s : 1: mutable_eliminate 0.18% : 0.001264s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000065s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.00% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.07% : 0.000534s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000517s : 1: py_interpret_to_execute 0.00% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 15.18% : 0.108262s : 1: renormalize.infer 0.15% : 0.001085s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000053s : 1: rewriter_after_opt_a 0.02% : 0.000113s : 1: rewriter_before_opt_a 0.01% : 0.000089s : 1: symbol_engine_optimizer 67.76% : 0.483357s : 1: type_inference TotalTime = 0.096609, [30] [bootstrap]: 0.00036729 [type_inference]: 0.0374687 [event_method]: 1.982e-05 [auto_monad]: 7.171e-05 [graph_reusing]: 6.35002e-06 [pre_auto_parallel]: 3.21001e-06 [py_interpret_to_execute]: 0.00010787 [rewriter_before_opt_a]: 8.253e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.055613, [2] [Cycle 1]: 0.0515434, [27] [switch_simplify]: 6.469e-05 [loop_unroll]: 2.949e-05 [a_1]: 0.0497594 [with_stream_mark]: 3.17e-05 [recompute_prepare]: 1.666e-05 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 4.12998e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.90002e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 3.56999e-06 [get_grad_eliminate_]: 6.94001e-06 [merge_forward]: 4.81002e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.796e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 3.11999e-06 [replace_old_param]: 1.222e-05 [inline_without_move]: 5.79999e-06 [renormalize]: 0.00120115 [add_forward_monad_depend]: 1.044e-05 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 1.99e-05 [cse]: 4.155e-05 [replace_applicator]: 2.148e-05 [Cycle 2]: 0.00036695, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.46e-05 [with_stream_mark]: 1.531e-05 [recompute_prepare]: 6.51e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.929e-05 [j_node_and_user_rematch]: 8.91997e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 9.27999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 7.19001e-06 [cse]: 1.653e-05 [replace_applicator]: 6.64001e-06 [py_interpret_to_execute_after_opt_a]: 1.736e-05 [rewriter_after_opt_a]: 6.395e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.00083215 [jit_opt_b]: 6.072e-05, [1] [Cycle 1]: 4.947e-05, [2] [frontend_op_eliminate]: 1.791e-05 [inline_after_opt_a]: 1.932e-05 [cconv]: 3.901e-05 [loop_unroll]: 0.00057994 [jit_opt_after_cconv]: 0.00017553, [1] [Cycle 1]: 0.00016701, [11] [c_1]: 2.101e-05 [parameter_eliminate]: 6.12001e-06 [updatestate_depend_eliminate]: 7.7e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 3.81e-05 [call_graph_tuple_transform]: 2.424e-05 [tuple_list_get_item_eliminator]: 6.00002e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 1.956e-05 [partial_unused_args_eliminate]: 3.29001e-06 [environ_conv]: 7.20998e-06 [add_recomputation]: 5.411e-05 [cse_after_recomputation]: 2.594e-05, [1] [Cycle 1]: 1.925e-05, [1] [cse]: 1.305e-05 [auto_monad_reorder]: 1.956e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 8.07e-06 [opt_after_jit_grad]: 0.00059887 [symbol_engine_optimizer]: 7.87e-05, [1] [Cycle 1]: 7.096e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 8.51002e-06 [elim_not_effective]: 1.508e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 8.85999e-06 [renormalize]: 3.69997e-07 [validate]: 4.665e-05 Sums bootstrap : 0.000367s : 0.40% type_inference : 0.037469s : 40.64% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000108s : 0.12% rewriter_before_opt_a : 0.000083s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.049854s : 54.08% jit_opt_a.with_stream_mark : 0.000047s : 0.05% jit_opt_a.recompute_prepare : 0.000023s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001201s : 1.30% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000058s : 0.06% jit_opt_a.replace_applicator : 0.000028s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000064s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000832s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000039s : 0.04% loop_unroll : 0.000580s : 0.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000599s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.05% Time group info: ------[substitution.] 0.000374 23 0.56% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000007s : 3: substitution.graph_param_transform 87.79% : 0.000328s : 4: substitution.inline 1.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.50% : 0.000006s : 4: substitution.remove_not_recompute_node 2.06% : 0.000008s : 2: substitution.replace_old_param 4.66% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037397 2 95.98% : 0.035892s : 1: type_inference.infer 4.02% : 0.001505s : 1: type_inference.specialize ------[replace.] 0.049046 6 99.93% : 0.049011s : 4: replace.inline 0.07% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000341 6 95.27% : 0.000325s : 4: match.inline 4.73% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 691 0.99% : 0.000001s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.68% : 0.000002s : 10: predicate.addn_zero_filter 2.26% : 0.000003s : 10: predicate.arithmetic_simplify 1.53% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000002s : 10: predicate.compare_switch_simplify 1.61% : 0.000002s : 10: predicate.depend_value_elim 0.93% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.99% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000002s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 6.36% : 0.000009s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 15: predicate.load_eliminater 1.22% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.90% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.71% : 0.000003s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000002s : 10: predicate.print_const_string_wrapper 2.18% : 0.000003s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.53% : 0.000002s : 10: predicate.reshape_eliminate 0.95% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000002s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.75% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 5.41% : 0.000008s : 16: predicate.switch_defer_inline 1.86% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.20% : 0.000011s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.46% : 0.000002s : 10: predicate.transpose_eliminate 1.13% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.32% : 0.000008s : 18: predicate.tuple_list_get_item_eliminator 1.81% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.41% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.31% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000994 13 48.45% : 0.000481s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.15% : 0.000071s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.40% : 0.000441s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147987 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.26% : 0.000390s : 1: bootstrap 0.03% : 0.000043s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 37.58% : 0.055617s : 1: jit_opt_a 0.12% : 0.000178s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.40% : 0.000592s : 1: loop_unroll 0.58% : 0.000852s : 1: mutable_eliminate 33.86% : 0.050109s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000608s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000111s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.47% : 0.000694s : 1: renormalize.infer 0.34% : 0.000496s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000069s : 1: rewriter_after_opt_a 0.06% : 0.000086s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 25.34% : 0.037498s : 1: type_inference TotalTime = 0.0366666, [30] [bootstrap]: 0.00035225 [type_inference]: 0.00577213 [event_method]: 1.983e-05 [auto_monad]: 6.827e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 3.958e-05 [rewriter_before_opt_a]: 7.721e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.0263036, [2] [Cycle 1]: 0.0225148, [27] [switch_simplify]: 6.028e-05 [loop_unroll]: 3.02e-05 [a_1]: 0.0005509 [with_stream_mark]: 2.091e-05 [recompute_prepare]: 8.26002e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.91001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.07999e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.30001e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 0.0214236 [add_forward_monad_depend]: 1.378e-05 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 2.464e-05 [cse]: 3.984e-05 [replace_applicator]: 2.97e-05 [Cycle 2]: 0.00038954, [27] [switch_simplify]: 7.51001e-06 [loop_unroll]: 5.00999e-06 [a_1]: 0.00010615 [with_stream_mark]: 1.991e-05 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.67001e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 3.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.123e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.02001e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 9.89001e-06 [cse]: 1.525e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 2.135e-05 [rewriter_after_opt_a]: 4.306e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00087967 [jit_opt_b]: 6.121e-05, [1] [Cycle 1]: 5.063e-05, [2] [frontend_op_eliminate]: 2.003e-05 [inline_after_opt_a]: 1.757e-05 [cconv]: 4.172e-05 [loop_unroll]: 0.00054206 [jit_opt_after_cconv]: 0.00022278, [1] [Cycle 1]: 0.00021543, [11] [c_1]: 2.331e-05 [parameter_eliminate]: 7.03e-06 [updatestate_depend_eliminate]: 1.099e-05 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 4e-05 [call_graph_tuple_transform]: 2.672e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 2.07999e-06 [renormalize]: 1.51002e-06 [switch_simplify]: 7.16001e-06 [remove_dup_value]: 1.986e-05 [partial_unused_args_eliminate]: 3.3e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 6.463e-05 [cse_after_recomputation]: 2.877e-05, [1] [Cycle 1]: 2.145e-05, [1] [cse]: 1.457e-05 [auto_monad_reorder]: 1.876e-05 [get_jit_bprop_graph]: 2.64999e-06 [rewriter_after_jit_bprop_graph]: 1.261e-05 [opt_after_jit_grad]: 0.00166248 [symbol_engine_optimizer]: 9.359e-05, [1] [Cycle 1]: 8.37e-05, [6] [build]: 8.06001e-06 [elim_shapecalc]: 8.25999e-06 [elim_not_effective]: 2.094e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 1.27999e-06 [validate]: 5.268e-05 Sums bootstrap : 0.000352s : 1.08% type_inference : 0.005772s : 17.75% event_method : 0.000020s : 0.06% auto_monad : 0.000068s : 0.21% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000040s : 0.12% rewriter_before_opt_a : 0.000077s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000657s : 2.02% jit_opt_a.with_stream_mark : 0.000041s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.021424s : 65.88% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.11% jit_opt_a.cse : 0.000055s : 0.17% jit_opt_a.replace_applicator : 0.000035s : 0.11% py_interpret_to_execute_after_opt_a : 0.000021s : 0.07% rewriter_after_opt_a : 0.000043s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000880s : 2.70% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000042s : 0.13% loop_unroll : 0.000542s : 1.67% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000040s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000002s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000020s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000065s : 0.20% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000013s : 0.04% opt_after_jit_grad : 0.001662s : 5.11% symbol_engine_optimizer.build : 0.000008s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.16% Time group info: ------[substitution.] 0.000232 23 1.17% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.77% : 0.000006s : 3: substitution.graph_param_transform 81.81% : 0.000190s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.78% : 0.000006s : 4: substitution.remove_not_recompute_node 3.28% : 0.000008s : 2: substitution.replace_old_param 5.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005694 2 82.78% : 0.004714s : 1: type_inference.infer 17.22% : 0.000980s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.84% : 0.000048s : 4: replace.inline 31.16% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 93.83% : 0.000188s : 4: match.inline 6.17% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.16% : 0.000002s : 10: predicate.accumulaten_eliminater 2.24% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.92% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.58% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 10: predicate.dict_set_item_eliminator 2.24% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 15: predicate.load_eliminater 2.01% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.43% : 0.000003s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 1.87% : 0.000003s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000003s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.12% : 0.000002s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 16: predicate.switch_defer_inline 1.85% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000011s : 53: predicate.switch_simplify 1.13% : 0.000002s : 10: predicate.tile_eliminate 1.03% : 0.000001s : 10: predicate.transpose_eliminate 1.24% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.97% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.36% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000874 13 47.23% : 0.000413s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.37% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.40% : 0.000414s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059072 72 0.12% : 0.000070s : 1: add_recomputation 0.12% : 0.000072s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.64% : 0.000376s : 1: bootstrap 0.08% : 0.000044s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 44.53% : 0.026307s : 1: jit_opt_a 0.38% : 0.000226s : 1: jit_opt_after_cconv 0.11% : 0.000065s : 1: jit_opt_b 0.94% : 0.000554s : 1: loop_unroll 1.52% : 0.000900s : 1: mutable_eliminate 1.53% : 0.000902s : 26: opt.transform.jit_opt_a 0.10% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000024s : 1: opt.transform.mutable_eliminate 0.08% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000041s : 4: opt.transform.symbol_engine_opt 2.85% : 0.001684s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000043s : 1: py_interpret_to_execute 0.04% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000023s : 1: remove_dup_value 35.24% : 0.020817s : 1: renormalize.infer 1.00% : 0.000591s : 1: renormalize.specialize 0.03% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000047s : 1: rewriter_after_opt_a 0.14% : 0.000080s : 1: rewriter_before_opt_a 0.16% : 0.000097s : 1: symbol_engine_optimizer 9.80% : 0.005790s : 1: type_inference TotalTime = 0.109524, [30] [bootstrap]: 0.00037261 [type_inference]: 0.0242405 [event_method]: 2.155e-05 [auto_monad]: 7.128e-05 [graph_reusing]: 6.49999e-06 [pre_auto_parallel]: 2.73003e-06 [py_interpret_to_execute]: 0.00011052 [rewriter_before_opt_a]: 8.512e-05 [expand_dump_flag]: 3.15002e-06 [jit_opt_a]: 0.0818635, [2] [Cycle 1]: 0.00234148, [27] [switch_simplify]: 7.007e-05 [loop_unroll]: 2.958e-05 [a_1]: 0.00064166 [with_stream_mark]: 2.569e-05 [recompute_prepare]: 1.1e-05 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.38002e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 3.07002e-06 [get_grad_eliminate_]: 6.35002e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.816e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 1.182e-05 [inline_without_move]: 5.86998e-06 [renormalize]: 0.0011486 [add_forward_monad_depend]: 9.03002e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 2.133e-05 [cse]: 4.157e-05 [replace_applicator]: 2.133e-05 [Cycle 2]: 0.00036323, [27] [switch_simplify]: 6.26998e-06 [loop_unroll]: 5.36998e-06 [a_1]: 9.369e-05 [with_stream_mark]: 1.674e-05 [recompute_prepare]: 7.01999e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 5.78997e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.775e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 2.13998e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.41e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.08e-06 [cse]: 1.653e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.787e-05 [rewriter_after_opt_a]: 4.578e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00088831 [jit_opt_b]: 6.057e-05, [1] [Cycle 1]: 5.039e-05, [2] [frontend_op_eliminate]: 1.714e-05 [inline_after_opt_a]: 2.052e-05 [cconv]: 3.979e-05 [loop_unroll]: 0.00049009 [jit_opt_after_cconv]: 0.00018292, [1] [Cycle 1]: 0.00017461, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 6.04999e-06 [updatestate_depend_eliminate]: 9.69e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 3.28e-06 [cse]: 4.04e-05 [call_graph_tuple_transform]: 2.486e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 7.79983e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 2.001e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 6.64999e-06 [add_recomputation]: 5.586e-05 [cse_after_recomputation]: 4.946e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 8.65001e-06 [opt_after_jit_grad]: 0.0005044 [symbol_engine_optimizer]: 7.668e-05, [1] [Cycle 1]: 6.922e-05, [6] [build]: 4.90999e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.4e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 4.40021e-07 [validate]: 4.806e-05 Sums bootstrap : 0.000373s : 1.26% type_inference : 0.024241s : 81.73% event_method : 0.000022s : 0.07% auto_monad : 0.000071s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000111s : 0.37% rewriter_before_opt_a : 0.000085s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000735s : 2.48% jit_opt_a.with_stream_mark : 0.000042s : 0.14% jit_opt_a.recompute_prepare : 0.000018s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001149s : 3.87% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.10% jit_opt_a.cse : 0.000058s : 0.20% jit_opt_a.replace_applicator : 0.000027s : 0.09% py_interpret_to_execute_after_opt_a : 0.000018s : 0.06% rewriter_after_opt_a : 0.000046s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000888s : 3.00% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.07% cconv : 0.000040s : 0.13% loop_unroll : 0.000490s : 1.65% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000040s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000504s : 1.70% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.16% Time group info: ------[substitution.] 0.000292 23 0.89% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 3: substitution.graph_param_transform 85.24% : 0.000249s : 4: substitution.inline 1.83% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000006s : 4: substitution.remove_not_recompute_node 2.66% : 0.000008s : 2: substitution.replace_old_param 4.80% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024150 2 93.04% : 0.022469s : 1: type_inference.infer 6.96% : 0.001681s : 1: type_inference.specialize ------[replace.] 0.000086 6 68.67% : 0.000059s : 4: replace.inline 31.33% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 6 95.00% : 0.000247s : 4: match.inline 5.00% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.60% : 0.000002s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.58% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000007s : 22: predicate.inline 1.20% : 0.000002s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 2.47% : 0.000003s : 3: predicate.mutable_eliminate 0.68% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.64% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 1.16% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.90% : 0.000004s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000010s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.64% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001032 13 50.58% : 0.000522s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.46% : 0.000067s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.96% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111717 72 0.05% : 0.000059s : 1: add_recomputation 0.07% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.36% : 0.000399s : 1: bootstrap 0.04% : 0.000043s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000052s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 73.28% : 0.081867s : 1: jit_opt_a 0.17% : 0.000186s : 1: jit_opt_after_cconv 0.06% : 0.000064s : 1: jit_opt_b 0.45% : 0.000499s : 1: loop_unroll 0.81% : 0.000907s : 1: mutable_eliminate 0.89% : 0.000992s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000114s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 0.59% : 0.000661s : 1: renormalize.infer 0.43% : 0.000475s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.08% : 0.000089s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 21.72% : 0.024261s : 1: type_inference TotalTime = 0.0987238, [30] [bootstrap]: 0.00046873 [type_inference]: 0.0367329 [event_method]: 2.753e-05 [auto_monad]: 8.011e-05 [graph_reusing]: 7.72002e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.00011021 [rewriter_before_opt_a]: 0.00010275 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.0586799, [2] [Cycle 1]: 0.0455642, [27] [switch_simplify]: 8.037e-05 [loop_unroll]: 3.15e-05 [a_1]: 0.00069045 [with_stream_mark]: 2.97e-05 [recompute_prepare]: 1.27e-05 [updatestate_depend_eliminate]: 5.03002e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 5.59998e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 5.07e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.751e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 1.316e-05 [inline_without_move]: 6.36998e-06 [renormalize]: 0.044238 [add_forward_monad_depend]: 1.376e-05 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 2.733e-05 [cse]: 4.495e-05 [replace_applicator]: 2.533e-05 [Cycle 2]: 0.00036584, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.68002e-06 [a_1]: 0.00010017 [with_stream_mark]: 1.865e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.74001e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 3.78999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.913e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.86999e-06 [cse]: 1.361e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 2.28e-05 [rewriter_after_opt_a]: 4.197e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.0007936 [jit_opt_b]: 5.472e-05, [1] [Cycle 1]: 4.489e-05, [2] [frontend_op_eliminate]: 1.637e-05 [inline_after_opt_a]: 1.721e-05 [cconv]: 3.234e-05 [loop_unroll]: 0.00043495 [jit_opt_after_cconv]: 0.00015574, [1] [Cycle 1]: 0.00014882, [11] [c_1]: 2.113e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 8.37998e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.854e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.33002e-06 [remove_dup_value]: 1.792e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 7.33e-06 [add_recomputation]: 5.768e-05 [cse_after_recomputation]: 2.294e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.215e-05 [auto_monad_reorder]: 1.884e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 8.23001e-06 [opt_after_jit_grad]: 0.00045582 [symbol_engine_optimizer]: 7.523e-05, [1] [Cycle 1]: 6.844e-05, [6] [build]: 4.92999e-06 [elim_shapecalc]: 8.43999e-06 [elim_not_effective]: 1.244e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.74998e-06 [renormalize]: 6.39993e-07 [validate]: 4.773e-05 Sums bootstrap : 0.000469s : 0.55% type_inference : 0.036733s : 43.10% event_method : 0.000028s : 0.03% auto_monad : 0.000080s : 0.09% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000110s : 0.13% rewriter_before_opt_a : 0.000103s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000791s : 0.93% jit_opt_a.with_stream_mark : 0.000048s : 0.06% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.044238s : 51.91% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.04% jit_opt_a.cse : 0.000059s : 0.07% jit_opt_a.replace_applicator : 0.000031s : 0.04% py_interpret_to_execute_after_opt_a : 0.000023s : 0.03% rewriter_after_opt_a : 0.000042s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000794s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000032s : 0.04% loop_unroll : 0.000435s : 0.51% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000058s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000456s : 0.53% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.06% Time group info: ------[substitution.] 0.000325 23 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.71% : 0.000006s : 3: substitution.graph_param_transform 87.21% : 0.000284s : 4: substitution.inline 1.45% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 2.70% : 0.000009s : 2: substitution.replace_old_param 4.21% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036626 2 94.62% : 0.034655s : 1: type_inference.infer 5.38% : 0.001971s : 1: type_inference.specialize ------[replace.] 0.000083 6 68.08% : 0.000057s : 4: replace.inline 31.92% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000293 6 95.79% : 0.000281s : 4: match.inline 4.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.57% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000003s : 10: predicate.arithmetic_simplify 1.63% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000002s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 6.28% : 0.000008s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000000s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.63% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.82% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001289 13 42.11% : 0.000543s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.16% : 0.000105s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.72% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144029 72 0.04% : 0.000061s : 1: add_recomputation 0.06% : 0.000084s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.34% : 0.000496s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 40.74% : 0.058683s : 1: jit_opt_a 0.11% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.31% : 0.000443s : 1: loop_unroll 0.56% : 0.000806s : 1: mutable_eliminate 0.73% : 0.001057s : 26: opt.transform.jit_opt_a 0.03% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000114s : 1: py_interpret_to_execute 0.02% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 30.23% : 0.043538s : 1: renormalize.infer 0.47% : 0.000680s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000108s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 25.53% : 0.036768s : 1: type_inference TotalTime = 0.383158, [30] [bootstrap]: 0.00035795 [type_inference]: 0.346762 [event_method]: 2.448e-05 [auto_monad]: 8.579e-05 [graph_reusing]: 7.29001e-06 [pre_auto_parallel]: 3.46999e-06 [py_interpret_to_execute]: 0.00051268 [rewriter_before_opt_a]: 0.00010131 [expand_dump_flag]: 4.2e-06 [jit_opt_a]: 0.0328012, [2] [Cycle 1]: 0.0283263, [27] [switch_simplify]: 6.874e-05 [loop_unroll]: 3.112e-05 [a_1]: 0.0248429 [with_stream_mark]: 3.839e-05 [recompute_prepare]: 1.756e-05 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 3.22002e-06 [specialize_transform]: 7.28999e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 7.63001e-06 [meta_shard_fg_expand]: 4.00998e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 3.75998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.491e-05 [j_node_and_user_rematch]: 1.144e-05 [meta_fg_expand]: 3.48e-06 [replace_old_param]: 1.237e-05 [inline_without_move]: 6.79999e-06 [renormalize]: 0.00285232 [add_forward_monad_depend]: 9.87001e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 2.054e-05 [cse]: 3.443e-05 [replace_applicator]: 2.36e-05 [Cycle 2]: 0.0003844, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 6.01e-06 [a_1]: 0.00012436 [with_stream_mark]: 1.37e-05 [recompute_prepare]: 5.88002e-06 [updatestate_depend_eliminate]: 4.04997e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.75002e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 3.04999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.938e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 5.26998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 7.18e-06 [cse]: 1.162e-05 [replace_applicator]: 6.30002e-06 [py_interpret_to_execute_after_opt_a]: 1.569e-05 [rewriter_after_opt_a]: 5.883e-05 [convert_after_rewriter]: 8.32e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00076281 [jit_opt_b]: 5.353e-05, [1] [Cycle 1]: 4.59e-05, [2] [frontend_op_eliminate]: 1.713e-05 [inline_after_opt_a]: 1.771e-05 [cconv]: 3.25e-05 [loop_unroll]: 0.00042812 [jit_opt_after_cconv]: 0.00015965, [1] [Cycle 1]: 0.00015322, [11] [c_1]: 2.524e-05 [parameter_eliminate]: 3.33e-06 [updatestate_depend_eliminate]: 8.25999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 2.898e-05 [call_graph_tuple_transform]: 2.111e-05 [tuple_list_get_item_eliminator]: 5.82001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.656e-05 [partial_unused_args_eliminate]: 2.48002e-06 [environ_conv]: 1.065e-05 [add_recomputation]: 5.323e-05 [cse_after_recomputation]: 2.32e-05, [1] [Cycle 1]: 1.769e-05, [1] [cse]: 1.215e-05 [auto_monad_reorder]: 1.576e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 6.49999e-06 [opt_after_jit_grad]: 0.00046011 [symbol_engine_optimizer]: 7.425e-05, [1] [Cycle 1]: 6.842e-05, [6] [build]: 4.74e-06 [elim_shapecalc]: 8.12003e-06 [elim_not_effective]: 1.375e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.86997e-06 [renormalize]: 4.30009e-07 [validate]: 5.062e-05 Sums bootstrap : 0.000358s : 0.09% type_inference : 0.346762s : 91.66% event_method : 0.000024s : 0.01% auto_monad : 0.000086s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000513s : 0.14% rewriter_before_opt_a : 0.000101s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.024967s : 6.60% jit_opt_a.with_stream_mark : 0.000052s : 0.01% jit_opt_a.recompute_prepare : 0.000023s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002852s : 0.75% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000046s : 0.01% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000059s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000763s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000032s : 0.01% loop_unroll : 0.000428s : 0.11% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000053s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000460s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.01% Time group info: ------[substitution.] 0.000294 24 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 4: substitution.graph_param_transform 84.13% : 0.000247s : 4: substitution.inline 2.10% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000007s : 4: substitution.remove_not_recompute_node 2.92% : 0.000009s : 2: substitution.replace_old_param 5.03% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.346652 2 99.19% : 0.343854s : 1: type_inference.infer 0.81% : 0.002798s : 1: type_inference.specialize ------[replace.] 0.000083 6 69.67% : 0.000058s : 4: replace.inline 30.33% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 6 94.92% : 0.000245s : 4: match.inline 5.08% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.53% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.91% : 0.000003s : 12: predicate.addn_zero_filter 2.42% : 0.000004s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.27% : 0.000002s : 12: predicate.compare_switch_simplify 1.52% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.86% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 6.70% : 0.000011s : 26: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.55% : 0.000002s : 18: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.15% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.88% : 0.000005s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 0.94% : 0.000001s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.02% : 0.000002s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000004s : 18: predicate.switch_defer_inline 1.75% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.56% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.50% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 5.86% : 0.000009s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.79% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002472 22 68.57% : 0.001695s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.41% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.02% : 0.000717s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.411268 72 0.01% : 0.000056s : 1: add_recomputation 0.02% : 0.000089s : 1: auto_monad 0.00% : 0.000018s : 1: auto_monad_reorder 0.09% : 0.000383s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.98% : 0.032804s : 1: jit_opt_a 0.04% : 0.000162s : 1: jit_opt_after_cconv 0.01% : 0.000056s : 1: jit_opt_b 0.11% : 0.000437s : 1: loop_unroll 0.19% : 0.000774s : 1: mutable_eliminate 6.14% : 0.025246s : 26: opt.transform.jit_opt_a 0.01% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000028s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000468s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000524s : 1: py_interpret_to_execute 0.00% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.50% : 0.002046s : 1: renormalize.infer 0.19% : 0.000792s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000063s : 1: rewriter_after_opt_a 0.03% : 0.000108s : 1: rewriter_before_opt_a 0.02% : 0.000077s : 1: symbol_engine_optimizer 84.32% : 0.346796s : 1: type_inference TotalTime = 0.474855, [30] [bootstrap]: 0.00037543 [type_inference]: 0.461239 [event_method]: 2.591e-05 [auto_monad]: 8.544e-05 [graph_reusing]: 7.46001e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00048733 [rewriter_before_opt_a]: 0.00011044 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00942537, [2] [Cycle 1]: 0.0048598, [27] [switch_simplify]: 7.058e-05 [loop_unroll]: 3.447e-05 [a_1]: 0.00082368 [with_stream_mark]: 2.675e-05 [recompute_prepare]: 1.093e-05 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 8.05e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.84e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 1.165e-05 [inline_without_move]: 6.38e-06 [renormalize]: 0.00344155 [add_forward_monad_depend]: 1.76e-05 [auto_monad_grad]: 3.37002e-06 [auto_monad_eliminator]: 2.475e-05 [cse]: 4.371e-05 [replace_applicator]: 2.906e-05 [Cycle 2]: 0.00055249, [27] [switch_simplify]: 7.66999e-06 [loop_unroll]: 6.22001e-06 [a_1]: 0.00023163 [with_stream_mark]: 2.057e-05 [recompute_prepare]: 9.86e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.66e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 3.31001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.062e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.158e-05 [inline_without_move]: 5.81e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.61e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 1.092e-05 [cse]: 2.274e-05 [replace_applicator]: 7.02002e-06 [py_interpret_to_execute_after_opt_a]: 2.218e-05 [rewriter_after_opt_a]: 4.713e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00083639 [jit_opt_b]: 9.258e-05, [1] [Cycle 1]: 8.098e-05, [2] [frontend_op_eliminate]: 2.1e-05 [inline_after_opt_a]: 2.022e-05 [cconv]: 3.954e-05 [loop_unroll]: 0.00050712 [jit_opt_after_cconv]: 0.00020369, [1] [Cycle 1]: 0.00019392, [11] [c_1]: 2.744e-05 [parameter_eliminate]: 4.68999e-06 [updatestate_depend_eliminate]: 1.106e-05 [updatestate_assign_eliminate]: 6.16998e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 4.403e-05 [call_graph_tuple_transform]: 2.741e-05 [tuple_list_get_item_eliminator]: 6.30002e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.939e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 1.283e-05 [add_recomputation]: 6.184e-05 [cse_after_recomputation]: 2.954e-05, [1] [Cycle 1]: 2.053e-05, [1] [cse]: 1.417e-05 [auto_monad_reorder]: 1.947e-05 [get_jit_bprop_graph]: 2.43998e-06 [rewriter_after_jit_bprop_graph]: 9.17999e-06 [opt_after_jit_grad]: 0.00051937 [symbol_engine_optimizer]: 9.617e-05, [1] [Cycle 1]: 8.913e-05, [6] [build]: 5.64e-06 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 1.657e-05 [opt_reshape]: 6.69001e-06 [fold_const_symbol]: 1.479e-05 [renormalize]: 8.00006e-07 [validate]: 0.00030319 Sums bootstrap : 0.000375s : 0.08% type_inference : 0.461239s : 98.13% event_method : 0.000026s : 0.01% auto_monad : 0.000085s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000487s : 0.10% rewriter_before_opt_a : 0.000110s : 0.02% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.001055s : 0.22% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003442s : 0.73% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.01% jit_opt_a.cse : 0.000066s : 0.01% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.00% rewriter_after_opt_a : 0.000047s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000836s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000040s : 0.01% loop_unroll : 0.000507s : 0.11% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000062s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000519s : 0.11% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000303s : 0.06% Time group info: ------[substitution.] 0.000341 25 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 4: substitution.graph_param_transform 87.38% : 0.000298s : 5: substitution.inline 1.42% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000007s : 4: substitution.remove_not_recompute_node 2.28% : 0.000008s : 2: substitution.replace_old_param 4.05% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.461128 2 99.28% : 0.457825s : 1: type_inference.infer 0.72% : 0.003303s : 1: type_inference.specialize ------[replace.] 0.000114 7 70.54% : 0.000080s : 5: replace.inline 29.46% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000308 7 95.89% : 0.000296s : 5: match.inline 4.11% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000245 886 0.74% : 0.000002s : 13: predicate.accumulaten_eliminater 0.69% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.66% : 0.000002s : 13: predicate.addn_check_dump 0.90% : 0.000002s : 13: predicate.addn_zero_filter 1.17% : 0.000003s : 13: predicate.arithmetic_simplify 0.86% : 0.000002s : 13: predicate.cast_eliminate 0.25% : 0.000001s : 4: predicate.check_bprop_eliminate 0.73% : 0.000002s : 13: predicate.compare_switch_simplify 0.73% : 0.000002s : 13: predicate.depend_value_elim 0.69% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.67% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.75% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.58% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 4: predicate.elim_not_effective 0.30% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.72% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.63% : 0.000002s : 13: predicate.environ_get_depend_swap 0.75% : 0.000002s : 13: predicate.environ_get_eliminate 0.75% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 4: predicate.fold_const_symbol 0.71% : 0.000002s : 8: predicate.get_grad_eliminate 0.16% : 0.000000s : 4: predicate.graph_param_transform 3.96% : 0.000010s : 28: predicate.inline 0.53% : 0.000001s : 8: predicate.inline_without_move 0.25% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.90% : 0.000002s : 8: predicate.less_batch_normalization 0.85% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.19% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000003s : 4: predicate.loop_unroll_after_grad 2.22% : 0.000005s : 40: predicate.loop_unroll_before_grad 40.27% : 0.000099s : 17: predicate.make_slice_get_slice_eliminator 0.63% : 0.000002s : 13: predicate.merge_addn 0.67% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000003s : 4: predicate.mutable_eliminate 0.24% : 0.000001s : 4: predicate.opt_reshape 1.30% : 0.000003s : 19: predicate.partial_eliminate 0.70% : 0.000002s : 13: predicate.print_const_string_wrapper 1.03% : 0.000003s : 13: predicate.reduce_eliminate 0.84% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 8: predicate.remove_not_recompute_node 1.37% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 0.78% : 0.000002s : 13: predicate.reshape_eliminate 0.82% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.46% : 0.000001s : 4: predicate.row_tensor_eliminate 0.75% : 0.000002s : 13: predicate.same_eliminate 0.39% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.53% : 0.000001s : 8: predicate.special_op_eliminate 0.54% : 0.000001s : 8: predicate.specialize_transform 0.98% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.70% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.24% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.67% : 0.000004s : 20: predicate.switch_defer_inline 1.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 4.19% : 0.000010s : 64: predicate.switch_simplify 0.68% : 0.000002s : 13: predicate.tile_eliminate 0.74% : 0.000002s : 13: predicate.transpose_eliminate 0.75% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.77% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.45% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 0.84% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 0.87% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.97% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 1.63% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 0.91% : 0.000002s : 13: predicate.value_based_eliminate 0.20% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003024 25 65.41% : 0.001978s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.33% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.26% : 0.000945s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.479453 72 0.01% : 0.000065s : 1: add_recomputation 0.02% : 0.000089s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.08% : 0.000400s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 1.97% : 0.009430s : 1: jit_opt_a 0.04% : 0.000207s : 1: jit_opt_after_cconv 0.02% : 0.000095s : 1: jit_opt_b 0.11% : 0.000519s : 1: loop_unroll 0.18% : 0.000854s : 1: mutable_eliminate 0.28% : 0.001345s : 26: opt.transform.jit_opt_a 0.01% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000530s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000497s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 0.51% : 0.002423s : 1: renormalize.infer 0.21% : 0.001005s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000051s : 1: rewriter_after_opt_a 0.02% : 0.000118s : 1: rewriter_before_opt_a 0.02% : 0.000101s : 1: symbol_engine_optimizer 96.21% : 0.461265s : 1: type_inference TotalTime = 0.115668, [30] [bootstrap]: 0.00032142 [type_inference]: 0.104721 [event_method]: 2.621e-05 [auto_monad]: 7.643e-05 [graph_reusing]: 7.45e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00012729 [rewriter_before_opt_a]: 9.042e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00732194, [2] [Cycle 1]: 0.00257925, [27] [switch_simplify]: 7.014e-05 [loop_unroll]: 2.926e-05 [a_1]: 0.00066568 [with_stream_mark]: 2.76e-05 [recompute_prepare]: 1.165e-05 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.94001e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 5.20999e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.679e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.296e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00132729 [add_forward_monad_depend]: 1.004e-05 [auto_monad_grad]: 3.27002e-06 [auto_monad_eliminator]: 2.403e-05 [cse]: 4.355e-05 [replace_applicator]: 2.086e-05 [Cycle 2]: 0.00038999, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 6.07999e-06 [a_1]: 9.733e-05 [with_stream_mark]: 1.933e-05 [recompute_prepare]: 6.56999e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 5.71998e-06 [updatestate_useless_node_eliminater]: 5.06997e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 3.66001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.004e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 4.87998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.44999e-06 [auto_monad_grad]: 1.65001e-06 [auto_monad_eliminator]: 8.85001e-06 [cse]: 1.777e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 2.153e-05 [rewriter_after_opt_a]: 5.142e-05 [convert_after_rewriter]: 8.92e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.00088636 [jit_opt_b]: 6.399e-05, [1] [Cycle 1]: 5.227e-05, [2] [frontend_op_eliminate]: 1.869e-05 [inline_after_opt_a]: 2.059e-05 [cconv]: 4.234e-05 [loop_unroll]: 0.00054095 [jit_opt_after_cconv]: 0.00018723, [1] [Cycle 1]: 0.00017871, [11] [c_1]: 2.103e-05 [parameter_eliminate]: 6.04001e-06 [updatestate_depend_eliminate]: 1.205e-05 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 4.08e-05 [call_graph_tuple_transform]: 2.603e-05 [tuple_list_get_item_eliminator]: 5.97999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 2.026e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 7.61999e-06 [add_recomputation]: 6.123e-05 [cse_after_recomputation]: 2.821e-05, [1] [Cycle 1]: 2.053e-05, [1] [cse]: 1.356e-05 [auto_monad_reorder]: 2.041e-05 [get_jit_bprop_graph]: 3.04001e-06 [rewriter_after_jit_bprop_graph]: 8.65999e-06 [opt_after_jit_grad]: 0.00063149 [symbol_engine_optimizer]: 8.357e-05, [1] [Cycle 1]: 7.499e-05, [6] [build]: 5.39e-06 [elim_shapecalc]: 9.02999e-06 [elim_not_effective]: 1.649e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 9.04998e-06 [renormalize]: 1.19e-06 [validate]: 5.575e-05 Sums bootstrap : 0.000321s : 0.29% type_inference : 0.104721s : 94.71% event_method : 0.000026s : 0.02% auto_monad : 0.000076s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000127s : 0.12% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000763s : 0.69% jit_opt_a.with_stream_mark : 0.000047s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001327s : 1.20% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.03% jit_opt_a.cse : 0.000061s : 0.06% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.02% rewriter_after_opt_a : 0.000051s : 0.05% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000886s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000042s : 0.04% loop_unroll : 0.000541s : 0.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000061s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000631s : 0.57% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.05% Time group info: ------[substitution.] 0.000303 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 3: substitution.graph_param_transform 85.44% : 0.000259s : 4: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000006s : 4: substitution.remove_not_recompute_node 2.79% : 0.000008s : 2: substitution.replace_old_param 4.58% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104623 2 98.32% : 0.102869s : 1: type_inference.infer 1.68% : 0.001754s : 1: type_inference.specialize ------[replace.] 0.000091 6 68.87% : 0.000063s : 4: replace.inline 31.13% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000269 6 95.34% : 0.000257s : 4: match.inline 4.66% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 691 1.73% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.08% : 0.000001s : 10: predicate.cast_eliminate 0.32% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.46% : 0.000002s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.03% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 10: predicate.environ_get_depend_swap 1.22% : 0.000002s : 10: predicate.environ_get_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000002s : 6: predicate.get_grad_eliminate 0.49% : 0.000001s : 3: predicate.graph_param_transform 6.42% : 0.000009s : 22: predicate.inline 1.03% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 6: predicate.less_batch_normalization 1.80% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 3.39% : 0.000005s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000002s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.25% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000003s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.57% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.20% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000004s : 16: predicate.switch_defer_inline 1.79% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000010s : 53: predicate.switch_simplify 1.10% : 0.000001s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.08% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.55% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.05% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.050528 13 98.84% : 0.049940s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.12% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 1.04% : 0.000526s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118101 72 0.05% : 0.000065s : 1: add_recomputation 0.07% : 0.000081s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.29% : 0.000344s : 1: bootstrap 0.04% : 0.000045s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.20% : 0.007326s : 1: jit_opt_a 0.16% : 0.000190s : 1: jit_opt_after_cconv 0.06% : 0.000067s : 1: jit_opt_b 0.47% : 0.000553s : 1: loop_unroll 0.77% : 0.000911s : 1: mutable_eliminate 0.87% : 0.001024s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000043s : 1: opt.transform.mutable_eliminate 0.03% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000648s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000132s : 1: py_interpret_to_execute 0.02% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 0.64% : 0.000756s : 1: renormalize.infer 0.47% : 0.000558s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000055s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 88.70% : 0.104750s : 1: type_inference TotalTime = 0.0315543, [30] [bootstrap]: 0.00044076 [type_inference]: 0.0223726 [event_method]: 2.264e-05 [auto_monad]: 6.868e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 4.33e-05 [rewriter_before_opt_a]: 8.083e-05 [expand_dump_flag]: 2.98998e-06 [jit_opt_a]: 0.00634174, [2] [Cycle 1]: 0.00193446, [27] [switch_simplify]: 5.82e-05 [loop_unroll]: 2.928e-05 [a_1]: 0.00055427 [with_stream_mark]: 2.314e-05 [recompute_prepare]: 7.57998e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.22999e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00091252 [add_forward_monad_depend]: 1.167e-05 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 4.232e-05 [replace_applicator]: 1.275e-05 [Cycle 2]: 0.00032767, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.27999e-06 [a_1]: 8.758e-05 [with_stream_mark]: 1.046e-05 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 4.75001e-06 [meta_shard_fg_expand]: 1.36998e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 7.92998e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 6.96999e-06 [inline_without_move]: 5.11002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.514e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.398e-05 [rewriter_after_opt_a]: 3.959e-05 [convert_after_rewriter]: 7.12002e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00057125 [jit_opt_b]: 5.03e-05, [1] [Cycle 1]: 4.252e-05, [2] [frontend_op_eliminate]: 1.555e-05 [inline_after_opt_a]: 1.598e-05 [cconv]: 2.844e-05 [loop_unroll]: 0.0004034 [jit_opt_after_cconv]: 0.00014494, [1] [Cycle 1]: 0.00013879, [11] [c_1]: 2.015e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 6.28998e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 2.613e-05 [call_graph_tuple_transform]: 1.807e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 3.835e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 5.249e-05 [cse_after_recomputation]: 2.287e-05, [1] [Cycle 1]: 1.772e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 4.85001e-06 [opt_after_jit_grad]: 0.0004591 [symbol_engine_optimizer]: 7.232e-05, [1] [Cycle 1]: 6.591e-05, [6] [build]: 3.81001e-06 [elim_shapecalc]: 7.75998e-06 [elim_not_effective]: 1.292e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.99e-06 [renormalize]: 3.30008e-07 [validate]: 4.079e-05 Sums bootstrap : 0.000441s : 1.64% type_inference : 0.022373s : 83.25% event_method : 0.000023s : 0.08% auto_monad : 0.000069s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000043s : 0.16% rewriter_before_opt_a : 0.000081s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000642s : 2.39% jit_opt_a.with_stream_mark : 0.000034s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000913s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000057s : 0.21% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000571s : 2.13% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.11% loop_unroll : 0.000403s : 1.50% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000038s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000459s : 1.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.15% Time group info: ------[substitution.] 0.000231 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000005s : 3: substitution.graph_param_transform 85.64% : 0.000198s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 5.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022294 2 93.73% : 0.020897s : 1: type_inference.infer 6.27% : 0.001397s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.06% : 0.000049s : 4: replace.inline 30.94% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 94.70% : 0.000196s : 4: match.inline 5.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.58% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.48% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 2.14% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.35% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000931 13 47.89% : 0.000446s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.52% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.59% : 0.000434s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033373 72 0.17% : 0.000055s : 1: add_recomputation 0.22% : 0.000072s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.39% : 0.000464s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.01% : 0.006345s : 1: jit_opt_a 0.44% : 0.000148s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.23% : 0.000411s : 1: loop_unroll 1.74% : 0.000580s : 1: mutable_eliminate 2.57% : 0.000858s : 26: opt.transform.jit_opt_a 0.14% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000468s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000046s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000041s : 1: remove_dup_value 1.49% : 0.000496s : 1: renormalize.infer 1.23% : 0.000409s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000084s : 1: rewriter_before_opt_a 0.22% : 0.000075s : 1: symbol_engine_optimizer 67.10% : 0.022394s : 1: type_inference TotalTime = 0.0331987, [30] [bootstrap]: 0.00059508 [type_inference]: 0.00851266 [event_method]: 2.623e-05 [auto_monad]: 8.089e-05 [graph_reusing]: 7.38999e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 7.096e-05 [rewriter_before_opt_a]: 8.873e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.020555, [2] [Cycle 1]: 0.0152936, [27] [switch_simplify]: 6.971e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.00064392 [with_stream_mark]: 2.566e-05 [recompute_prepare]: 9.29e-06 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 6.87002e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.48998e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.691e-05 [j_node_and_user_rematch]: 9.53002e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.066e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 0.0140647 [add_forward_monad_depend]: 1.396e-05 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 2.656e-05 [cse]: 4.696e-05 [replace_applicator]: 3.176e-05 [Cycle 2]: 0.00041373, [27] [switch_simplify]: 7.35998e-06 [loop_unroll]: 6.84999e-06 [a_1]: 0.00012299 [with_stream_mark]: 1.876e-05 [recompute_prepare]: 6.59999e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 3.45e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 4.53999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.898e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 3.46001e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.29999e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 7.36001e-06 [cse]: 1.544e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 2.513e-05 [rewriter_after_opt_a]: 4.942e-05 [convert_after_rewriter]: 8.18001e-06 [order_py_execute_after_rewriter]: 6.46999e-06 [mutable_eliminate]: 0.00099386 [jit_opt_b]: 6.539e-05, [1] [Cycle 1]: 5.475e-05, [2] [frontend_op_eliminate]: 2.04e-05 [inline_after_opt_a]: 2.037e-05 [cconv]: 3.779e-05 [loop_unroll]: 0.00055836 [jit_opt_after_cconv]: 0.0002382, [1] [Cycle 1]: 0.00022845, [11] [c_1]: 2.575e-05 [parameter_eliminate]: 5.32999e-06 [updatestate_depend_eliminate]: 1.051e-05 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 4.191e-05 [call_graph_tuple_transform]: 2.706e-05 [tuple_list_get_item_eliminator]: 6.06998e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.054e-05 [remove_dup_value]: 2.19e-05 [partial_unused_args_eliminate]: 3.03e-06 [environ_conv]: 7.75998e-06 [add_recomputation]: 6.294e-05 [cse_after_recomputation]: 3.005e-05, [1] [Cycle 1]: 2.219e-05, [1] [cse]: 1.454e-05 [auto_monad_reorder]: 1.997e-05 [get_jit_bprop_graph]: 3.23e-06 [rewriter_after_jit_bprop_graph]: 1.055e-05 [opt_after_jit_grad]: 0.00069215 [symbol_engine_optimizer]: 9.884e-05, [1] [Cycle 1]: 9.006e-05, [6] [build]: 6.17001e-06 [elim_shapecalc]: 1.131e-05 [elim_not_effective]: 1.951e-05 [opt_reshape]: 7.65e-06 [fold_const_symbol]: 1.061e-05 [renormalize]: 7.59988e-07 [validate]: 5.792e-05 Sums bootstrap : 0.000595s : 2.16% type_inference : 0.008513s : 30.87% event_method : 0.000026s : 0.10% auto_monad : 0.000081s : 0.29% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000071s : 0.26% rewriter_before_opt_a : 0.000089s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.28% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000767s : 2.78% jit_opt_a.with_stream_mark : 0.000044s : 0.16% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000014s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.014065s : 51.00% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.12% jit_opt_a.cse : 0.000062s : 0.23% jit_opt_a.replace_applicator : 0.000037s : 0.14% py_interpret_to_execute_after_opt_a : 0.000025s : 0.09% rewriter_after_opt_a : 0.000049s : 0.18% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000994s : 3.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.07% jit_opt_b.inline_after_opt_a : 0.000020s : 0.07% cconv : 0.000038s : 0.14% loop_unroll : 0.000558s : 2.02% jit_opt_after_cconv.c_1 : 0.000026s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000051s : 0.18% remove_dup_value : 0.000022s : 0.08% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000063s : 0.23% cse_after_recomputation.cse : 0.000015s : 0.05% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.04% opt_after_jit_grad : 0.000692s : 2.51% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.21% Time group info: ------[substitution.] 0.000292 23 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.29% : 0.000007s : 3: substitution.graph_param_transform 85.18% : 0.000249s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000006s : 4: substitution.remove_not_recompute_node 2.66% : 0.000008s : 2: substitution.replace_old_param 4.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008390 2 81.21% : 0.006813s : 1: type_inference.infer 18.79% : 0.001576s : 1: type_inference.specialize ------[replace.] 0.000086 6 67.61% : 0.000058s : 4: replace.inline 32.39% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 6 95.31% : 0.000246s : 4: match.inline 4.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.87% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.21% : 0.000003s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 0.88% : 0.000001s : 10: predicate.compare_switch_simplify 0.94% : 0.000001s : 10: predicate.depend_value_elim 0.90% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.54% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.01% : 0.000007s : 22: predicate.inline 1.12% : 0.000002s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.04% : 0.000003s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.51% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.88% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 3.01% : 0.000004s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 1.92% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000002s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.71% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 2.21% : 0.000003s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.09% : 0.000002s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.94% : 0.000003s : 16: predicate.switch_defer_inline 1.89% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.98% : 0.000010s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.16% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001373 13 43.30% : 0.000595s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.29% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.41% : 0.000720s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048391 72 0.14% : 0.000067s : 1: add_recomputation 0.18% : 0.000085s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 1.30% : 0.000629s : 1: bootstrap 0.08% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000033s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 42.49% : 0.020560s : 1: jit_opt_a 0.50% : 0.000241s : 1: jit_opt_after_cconv 0.14% : 0.000068s : 1: jit_opt_b 1.18% : 0.000571s : 1: loop_unroll 2.09% : 0.001012s : 1: mutable_eliminate 2.14% : 0.001034s : 26: opt.transform.jit_opt_a 0.22% : 0.000106s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000032s : 4: opt.transform.jit_opt_b 0.04% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000027s : 1: opt.transform.mutable_eliminate 0.07% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000708s : 1: opt_after_jit_grad 0.02% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000074s : 1: py_interpret_to_execute 0.06% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000025s : 1: remove_dup_value 27.21% : 0.013168s : 1: renormalize.infer 1.80% : 0.000870s : 1: renormalize.specialize 0.03% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000054s : 1: rewriter_after_opt_a 0.19% : 0.000093s : 1: rewriter_before_opt_a 0.21% : 0.000102s : 1: symbol_engine_optimizer 17.65% : 0.008541s : 1: type_inference TotalTime = 0.344564, [30] [bootstrap]: 0.00034135 [type_inference]: 0.319469 [event_method]: 2.414e-05 [auto_monad]: 7.792e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00042567 [rewriter_before_opt_a]: 8.768e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0213186, [2] [Cycle 1]: 0.0172667, [27] [switch_simplify]: 6.193e-05 [loop_unroll]: 3.079e-05 [a_1]: 0.0006291 [with_stream_mark]: 2.396e-05 [recompute_prepare]: 8.87999e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 6.01998e-06 [merge_forward]: 4.19002e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 6.14001e-06 [renormalize]: 0.0160914 [add_forward_monad_depend]: 1.03e-05 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 2.403e-05 [cse]: 3.759e-05 [replace_applicator]: 2.724e-05 [Cycle 2]: 0.00041001, [27] [switch_simplify]: 7.9e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00013077 [with_stream_mark]: 1.813e-05 [recompute_prepare]: 6.08998e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.03998e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 4.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.978e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.121e-05 [inline_without_move]: 5.34e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 7.16001e-06 [cse]: 1.439e-05 [replace_applicator]: 6.44999e-06 [py_interpret_to_execute_after_opt_a]: 1.827e-05 [rewriter_after_opt_a]: 4.27e-05 [convert_after_rewriter]: 8.60001e-06 [order_py_execute_after_rewriter]: 8.22e-06 [mutable_eliminate]: 0.00080816 [jit_opt_b]: 6.304e-05, [1] [Cycle 1]: 5.313e-05, [2] [frontend_op_eliminate]: 2.131e-05 [inline_after_opt_a]: 1.971e-05 [cconv]: 3.157e-05 [loop_unroll]: 0.00046823 [jit_opt_after_cconv]: 0.00017113, [1] [Cycle 1]: 0.00016478, [11] [c_1]: 2.6e-05 [parameter_eliminate]: 3.83001e-06 [updatestate_depend_eliminate]: 7.67002e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 3.208e-05 [call_graph_tuple_transform]: 2.467e-05 [tuple_list_get_item_eliminator]: 5.96003e-06 [none_parameter_eliminate]: 1.51002e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 7.61001e-06 [remove_dup_value]: 1.578e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 9.44e-06 [add_recomputation]: 5.363e-05 [cse_after_recomputation]: 2.315e-05, [1] [Cycle 1]: 1.776e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.602e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 1.024e-05 [opt_after_jit_grad]: 0.00053347 [symbol_engine_optimizer]: 0.00022723, [1] [Cycle 1]: 0.00022057, [6] [build]: 4.57e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.531e-05 [opt_reshape]: 7.48999e-06 [fold_const_symbol]: 1.067e-05 [renormalize]: 6.30011e-07 [validate]: 5.04e-05 Sums bootstrap : 0.000341s : 0.10% type_inference : 0.319469s : 93.94% event_method : 0.000024s : 0.01% auto_monad : 0.000078s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000426s : 0.13% rewriter_before_opt_a : 0.000088s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000760s : 0.22% jit_opt_a.with_stream_mark : 0.000042s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.016092s : 4.73% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000052s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000008s : 0.00% mutable_eliminate : 0.000808s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000468s : 0.14% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000533s : 0.16% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.01% Time group info: ------[substitution.] 0.000264 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000007s : 4: substitution.graph_param_transform 83.57% : 0.000220s : 4: substitution.inline 1.80% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000007s : 4: substitution.remove_not_recompute_node 2.78% : 0.000007s : 2: substitution.replace_old_param 5.21% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.319374 2 99.19% : 0.316798s : 1: type_inference.infer 0.81% : 0.002576s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.11% : 0.000050s : 4: replace.inline 32.89% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.54% : 0.000218s : 4: match.inline 5.46% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.08% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.43% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.44% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 18: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.87% : 0.000003s : 4: predicate.mutable_eliminate 0.74% : 0.000001s : 4: predicate.opt_reshape 2.47% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.39% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.17% : 0.000002s : 8: predicate.specialize_transform 1.60% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.04% : 0.000003s : 18: predicate.switch_defer_inline 1.80% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.91% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002886 22 60.79% : 0.001754s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.83% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.38% : 0.001079s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.361728 72 0.02% : 0.000056s : 1: add_recomputation 0.02% : 0.000082s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.10% : 0.000364s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.89% : 0.021323s : 1: jit_opt_a 0.05% : 0.000175s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.13% : 0.000478s : 1: loop_unroll 0.23% : 0.000825s : 1: mutable_eliminate 0.28% : 0.001019s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000545s : 1: opt_after_jit_grad 0.00% : 0.000011s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000433s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000018s : 1: remove_dup_value 4.11% : 0.014850s : 1: renormalize.infer 0.34% : 0.001225s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.03% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000230s : 1: symbol_engine_optimizer 88.33% : 0.319497s : 1: type_inference TotalTime = 0.230354, [30] [bootstrap]: 0.00034067 [type_inference]: 0.215712 [event_method]: 2.696e-05 [auto_monad]: 9.332e-05 [graph_reusing]: 7.53e-06 [pre_auto_parallel]: 2.38002e-06 [py_interpret_to_execute]: 0.00038985 [rewriter_before_opt_a]: 0.00011481 [expand_dump_flag]: 3.99002e-06 [jit_opt_a]: 0.0106378, [2] [Cycle 1]: 0.00586344, [27] [switch_simplify]: 8.279e-05 [loop_unroll]: 3.621e-05 [a_1]: 0.00200672 [with_stream_mark]: 3.721e-05 [recompute_prepare]: 1.528e-05 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 2.99999e-06 [specialize_transform]: 7.60998e-06 [updatestate_useless_node_eliminater]: 6.99001e-06 [accelerated_algorithm]: 6.93998e-06 [meta_shard_fg_expand]: 3.25e-06 [get_grad_eliminate_]: 7.53e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 2.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.973e-05 [j_node_and_user_rematch]: 1.305e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1.327e-05 [inline_without_move]: 7.31001e-06 [renormalize]: 0.00319599 [add_forward_monad_depend]: 1.358e-05 [auto_monad_grad]: 3.41999e-06 [auto_monad_eliminator]: 2.565e-05 [cse]: 4.606e-05 [replace_applicator]: 2.824e-05 [Cycle 2]: 0.00044911, [27] [switch_simplify]: 8.69e-06 [loop_unroll]: 8e-06 [a_1]: 0.00013293 [with_stream_mark]: 2.097e-05 [recompute_prepare]: 7.75e-06 [updatestate_depend_eliminate]: 5.28002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 6.46999e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 3.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.168e-05 [j_node_and_user_rematch]: 1.115e-05 [meta_fg_expand]: 2.58003e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 6.63e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.96e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 7.28e-06 [cse]: 2.126e-05 [replace_applicator]: 8.57e-06 [py_interpret_to_execute_after_opt_a]: 2.235e-05 [rewriter_after_opt_a]: 5.568e-05 [convert_after_rewriter]: 8.92e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00088364 [jit_opt_b]: 7.011e-05, [1] [Cycle 1]: 5.983e-05, [2] [frontend_op_eliminate]: 2.282e-05 [inline_after_opt_a]: 2.22e-05 [cconv]: 4.19e-05 [loop_unroll]: 0.00059466 [jit_opt_after_cconv]: 0.00020584, [1] [Cycle 1]: 0.00019711, [11] [c_1]: 2.656e-05 [parameter_eliminate]: 6.56e-06 [updatestate_depend_eliminate]: 1.134e-05 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 3.21001e-06 [cse]: 4.877e-05 [call_graph_tuple_transform]: 2.881e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 1.10999e-06 [switch_simplify]: 6.56999e-06 [remove_dup_value]: 2.28e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 1.212e-05 [add_recomputation]: 7.483e-05 [cse_after_recomputation]: 2.929e-05, [1] [Cycle 1]: 2.27e-05, [1] [cse]: 1.61e-05 [auto_monad_reorder]: 2.134e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 1.053e-05 [opt_after_jit_grad]: 0.00055993 [symbol_engine_optimizer]: 8.374e-05, [1] [Cycle 1]: 7.714e-05, [6] [build]: 4.82e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 1.665e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.93998e-06 [renormalize]: 9.30013e-07 [validate]: 6.912e-05 Sums bootstrap : 0.000341s : 0.15% type_inference : 0.215712s : 95.76% event_method : 0.000027s : 0.01% auto_monad : 0.000093s : 0.04% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000390s : 0.17% rewriter_before_opt_a : 0.000115s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.04% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.002140s : 0.95% jit_opt_a.with_stream_mark : 0.000058s : 0.03% jit_opt_a.recompute_prepare : 0.000023s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003196s : 1.42% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000067s : 0.03% jit_opt_a.replace_applicator : 0.000037s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000056s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000884s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000042s : 0.02% loop_unroll : 0.000595s : 0.26% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000075s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000560s : 0.25% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000069s : 0.03% Time group info: ------[substitution.] 0.000362 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000007s : 4: substitution.graph_param_transform 85.46% : 0.000309s : 5: substitution.inline 1.66% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000007s : 4: substitution.remove_not_recompute_node 2.43% : 0.000009s : 2: substitution.replace_old_param 5.47% : 0.000020s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.215583 2 98.32% : 0.211953s : 1: type_inference.infer 1.68% : 0.003630s : 1: type_inference.specialize ------[replace.] 0.000162 7 51.24% : 0.000083s : 5: replace.inline 48.76% : 0.000079s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000324 7 94.36% : 0.000306s : 5: match.inline 5.64% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 888 1.15% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.86% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 2.52% : 0.000004s : 13: predicate.arithmetic_simplify 1.17% : 0.000002s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 0.90% : 0.000002s : 13: predicate.compare_switch_simplify 1.47% : 0.000003s : 13: predicate.depend_value_elim 0.95% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.83% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.00% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000002s : 13: predicate.environ_get_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 0.82% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 7.20% : 0.000013s : 28: predicate.inline 1.17% : 0.000002s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.62% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 0.92% : 0.000002s : 13: predicate.minmaximum_grad 2.44% : 0.000004s : 4: predicate.mutable_eliminate 0.35% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000004s : 19: predicate.partial_eliminate 1.06% : 0.000002s : 13: predicate.print_const_string_wrapper 1.70% : 0.000003s : 13: predicate.reduce_eliminate 1.28% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000004s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.01% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000002s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.19% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.17% : 0.000006s : 20: predicate.switch_defer_inline 2.07% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.86% : 0.000012s : 65: predicate.switch_simplify 4.02% : 0.000007s : 13: predicate.tile_eliminate 0.96% : 0.000002s : 13: predicate.transpose_eliminate 1.18% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.16% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.38% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.25% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.041039 33 97.53% : 0.040024s : 24: func_graph_cloner_run.FuncGraphClonerGraph 0.24% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 2.23% : 0.000917s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.236067 72 0.03% : 0.000079s : 1: add_recomputation 0.04% : 0.000098s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.15% : 0.000361s : 1: bootstrap 0.02% : 0.000045s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 4.51% : 0.010643s : 1: jit_opt_a 0.09% : 0.000209s : 1: jit_opt_after_cconv 0.03% : 0.000073s : 1: jit_opt_b 0.26% : 0.000607s : 1: loop_unroll 0.38% : 0.000903s : 1: mutable_eliminate 1.04% : 0.002451s : 26: opt.transform.jit_opt_a 0.03% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000030s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000572s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000402s : 1: py_interpret_to_execute 0.01% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 0.93% : 0.002205s : 1: renormalize.infer 0.41% : 0.000975s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000059s : 1: rewriter_after_opt_a 0.05% : 0.000121s : 1: rewriter_before_opt_a 0.04% : 0.000087s : 1: symbol_engine_optimizer 91.39% : 0.215743s : 1: type_inference TotalTime = 0.527584, [30] [bootstrap]: 0.00033091 [type_inference]: 0.504435 [event_method]: 2.278e-05 [auto_monad]: 7.529e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00057608 [rewriter_before_opt_a]: 0.00010474 [expand_dump_flag]: 4.65001e-06 [jit_opt_a]: 0.0192349, [2] [Cycle 1]: 0.0150365, [27] [switch_simplify]: 6.786e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00066564 [with_stream_mark]: 2.686e-05 [recompute_prepare]: 9.77001e-06 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.63001e-06 [updatestate_useless_node_eliminater]: 6.79001e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 5.79e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.772e-05 [j_node_and_user_rematch]: 1.109e-05 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 1.147e-05 [inline_without_move]: 6.86999e-06 [renormalize]: 0.0137783 [add_forward_monad_depend]: 1.345e-05 [auto_monad_grad]: 3.37002e-06 [auto_monad_eliminator]: 2.69e-05 [cse]: 5.076e-05 [replace_applicator]: 2.908e-05 [Cycle 2]: 0.00041467, [27] [switch_simplify]: 7.71001e-06 [loop_unroll]: 6.49999e-06 [a_1]: 0.00012806 [with_stream_mark]: 1.985e-05 [recompute_prepare]: 7.42002e-06 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 3.9e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.13998e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.08002e-06 [merge_forward]: 4.82e-06 [cell_reuse_recompute_pass]: 3.33e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.983e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.159e-05 [inline_without_move]: 6.01e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.81998e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 6.70002e-06 [cse]: 1.746e-05 [replace_applicator]: 6.75998e-06 [py_interpret_to_execute_after_opt_a]: 2.215e-05 [rewriter_after_opt_a]: 4.375e-05 [convert_after_rewriter]: 8.84e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00083197 [jit_opt_b]: 5.998e-05, [1] [Cycle 1]: 5.21e-05, [2] [frontend_op_eliminate]: 1.978e-05 [inline_after_opt_a]: 2.022e-05 [cconv]: 3.461e-05 [loop_unroll]: 0.00046309 [jit_opt_after_cconv]: 0.00018321, [1] [Cycle 1]: 0.00017609, [11] [c_1]: 2.521e-05 [parameter_eliminate]: 4.92e-06 [updatestate_depend_eliminate]: 9.22999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.83998e-06 [cse]: 4.115e-05 [call_graph_tuple_transform]: 2.45e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.86001e-06 [remove_dup_value]: 1.904e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 1.074e-05 [add_recomputation]: 6.031e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.063e-05, [1] [cse]: 1.359e-05 [auto_monad_reorder]: 1.915e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 5.769e-05 [opt_after_jit_grad]: 0.0005863 [symbol_engine_optimizer]: 8.075e-05, [1] [Cycle 1]: 7.373e-05, [6] [build]: 4.66002e-06 [elim_shapecalc]: 8.82e-06 [elim_not_effective]: 1.457e-05 [opt_reshape]: 6.60002e-06 [fold_const_symbol]: 1.053e-05 [renormalize]: 3.59985e-07 [validate]: 5.324e-05 Sums bootstrap : 0.000331s : 0.06% type_inference : 0.504435s : 96.43% event_method : 0.000023s : 0.00% auto_monad : 0.000075s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000576s : 0.11% rewriter_before_opt_a : 0.000105s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.01% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000794s : 0.15% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.013778s : 2.63% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.01% jit_opt_a.cse : 0.000068s : 0.01% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000832s : 0.16% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000035s : 0.01% loop_unroll : 0.000463s : 0.09% jit_opt_after_cconv.c_1 : 0.000025s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000060s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000058s : 0.01% opt_after_jit_grad : 0.000586s : 0.11% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.01% Time group info: ------[substitution.] 0.000279 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 4: substitution.graph_param_transform 84.83% : 0.000237s : 4: substitution.inline 1.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000006s : 4: substitution.remove_not_recompute_node 2.85% : 0.000008s : 2: substitution.replace_old_param 4.99% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.504340 2 99.37% : 0.501182s : 1: type_inference.infer 0.63% : 0.003158s : 1: type_inference.specialize ------[replace.] 0.000086 6 70.22% : 0.000060s : 4: replace.inline 29.78% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 6 94.81% : 0.000234s : 4: match.inline 5.19% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.61% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.60% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.57% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.98% : 0.000009s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 18: predicate.load_eliminater 1.57% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.52% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 2.77% : 0.000004s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.57% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.66% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000004s : 18: predicate.switch_defer_inline 1.83% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000010s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002887 22 59.24% : 0.001710s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.00% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.76% : 0.001119s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.542493 72 0.01% : 0.000064s : 1: add_recomputation 0.01% : 0.000079s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.06% : 0.000351s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.00% : 0.000027s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.55% : 0.019239s : 1: jit_opt_a 0.03% : 0.000186s : 1: jit_opt_after_cconv 0.01% : 0.000063s : 1: jit_opt_b 0.09% : 0.000474s : 1: loop_unroll 0.16% : 0.000845s : 1: mutable_eliminate 0.20% : 0.001071s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000598s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000590s : 1: py_interpret_to_execute 0.00% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 2.30% : 0.012478s : 1: renormalize.infer 0.24% : 0.001280s : 1: renormalize.specialize 0.01% : 0.000061s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.02% : 0.000110s : 1: rewriter_before_opt_a 0.02% : 0.000083s : 1: symbol_engine_optimizer 92.99% : 0.504454s : 1: type_inference TotalTime = 0.093919, [30] [bootstrap]: 0.00043629 [type_inference]: 0.0808307 [event_method]: 2.268e-05 [auto_monad]: 7.516e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00013493 [rewriter_before_opt_a]: 8.344e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00879363, [2] [Cycle 1]: 0.00350274, [27] [switch_simplify]: 8.216e-05 [loop_unroll]: 3.317e-05 [a_1]: 0.00079205 [with_stream_mark]: 2.957e-05 [recompute_prepare]: 1.343e-05 [updatestate_depend_eliminate]: 5.84999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 8.99e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 7.77998e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 8.57e-06 [merge_forward]: 5.54e-06 [cell_reuse_recompute_pass]: 2.93e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.179e-05 [j_node_and_user_rematch]: 1.135e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.197e-05 [inline_without_move]: 7.33999e-06 [renormalize]: 0.00196712 [add_forward_monad_depend]: 1.395e-05 [auto_monad_grad]: 3.65e-06 [auto_monad_eliminator]: 2.777e-05 [cse]: 0.00012918 [replace_applicator]: 2.594e-05 [Cycle 2]: 0.00044561, [27] [switch_simplify]: 8.22998e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00011869 [with_stream_mark]: 2.156e-05 [recompute_prepare]: 7.00998e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 2.21998e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.98998e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 5.82999e-06 [cell_reuse_recompute_pass]: 4.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.132e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.94001e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.01e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 3.16001e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.353e-05 [cse]: 2.029e-05 [replace_applicator]: 8.28999e-06 [py_interpret_to_execute_after_opt_a]: 2.128e-05 [rewriter_after_opt_a]: 5.792e-05 [convert_after_rewriter]: 8.70999e-06 [order_py_execute_after_rewriter]: 5.74e-06 [mutable_eliminate]: 0.00099863 [jit_opt_b]: 6.819e-05, [1] [Cycle 1]: 5.679e-05, [2] [frontend_op_eliminate]: 2.298e-05 [inline_after_opt_a]: 1.949e-05 [cconv]: 4.028e-05 [loop_unroll]: 0.00067894 [jit_opt_after_cconv]: 0.00025717, [1] [Cycle 1]: 0.00019945, [11] [c_1]: 2.617e-05 [parameter_eliminate]: 6.51e-06 [updatestate_depend_eliminate]: 1.308e-05 [updatestate_assign_eliminate]: 4.82e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 4.604e-05 [call_graph_tuple_transform]: 2.98e-05 [tuple_list_get_item_eliminator]: 6.43003e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 2.114e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 7.883e-05 [cse_after_recomputation]: 3.689e-05, [1] [Cycle 1]: 2.62e-05, [1] [cse]: 1.548e-05 [auto_monad_reorder]: 2.159e-05 [get_jit_bprop_graph]: 3.38e-06 [rewriter_after_jit_bprop_graph]: 1.049e-05 [opt_after_jit_grad]: 0.00076605 [symbol_engine_optimizer]: 9.261e-05, [1] [Cycle 1]: 8.338e-05, [6] [build]: 5.73997e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 1.855e-05 [opt_reshape]: 8.26002e-06 [fold_const_symbol]: 1.044e-05 [renormalize]: 8.2e-07 [validate]: 7.961e-05 Sums bootstrap : 0.000436s : 0.49% type_inference : 0.080831s : 91.65% event_method : 0.000023s : 0.03% auto_monad : 0.000075s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000135s : 0.15% rewriter_before_opt_a : 0.000083s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.10% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000911s : 1.03% jit_opt_a.with_stream_mark : 0.000051s : 0.06% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.02% jit_opt_a.merge_forward : 0.000011s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.001967s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.02% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000041s : 0.05% jit_opt_a.cse : 0.000149s : 0.17% jit_opt_a.replace_applicator : 0.000034s : 0.04% py_interpret_to_execute_after_opt_a : 0.000021s : 0.02% rewriter_after_opt_a : 0.000058s : 0.07% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000999s : 1.13% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000040s : 0.05% loop_unroll : 0.000679s : 0.77% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000079s : 0.09% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000022s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000766s : 0.87% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000080s : 0.09% Time group info: ------[substitution.] 0.000332 23 0.77% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.86% : 0.000006s : 3: substitution.graph_param_transform 85.81% : 0.000285s : 4: substitution.inline 1.74% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000007s : 4: substitution.remove_not_recompute_node 2.19% : 0.000007s : 2: substitution.replace_old_param 5.11% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.080718 2 97.09% : 0.078372s : 1: type_inference.infer 2.91% : 0.002346s : 1: type_inference.specialize ------[replace.] 0.000132 6 58.44% : 0.000077s : 4: replace.inline 41.56% : 0.000055s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000297 6 94.73% : 0.000281s : 4: match.inline 5.27% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 691 1.06% : 0.000002s : 10: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.81% : 0.000001s : 10: predicate.addn_check_dump 1.62% : 0.000003s : 10: predicate.addn_zero_filter 2.29% : 0.000004s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 10: predicate.compare_switch_simplify 0.97% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 0.99% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.76% : 0.000003s : 10: predicate.dict_set_item_eliminator 1.32% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.72% : 0.000003s : 10: predicate.environ_add_const_eliminate 0.84% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000002s : 10: predicate.environ_get_eliminate 0.78% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000002s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000009s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000003s : 15: predicate.load_eliminater 2.35% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.45% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.26% : 0.000002s : 10: predicate.merge_addn 0.93% : 0.000002s : 10: predicate.minmaximum_grad 3.32% : 0.000006s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.00% : 0.000003s : 15: predicate.partial_eliminate 1.03% : 0.000002s : 10: predicate.print_const_string_wrapper 2.13% : 0.000004s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000003s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000001s : 3: predicate.reset_defer_inline 0.98% : 0.000002s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.10% : 0.000002s : 3: predicate.row_tensor_eliminate 0.97% : 0.000002s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000002s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.70% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.80% : 0.000005s : 16: predicate.switch_defer_inline 1.88% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.33% : 0.000012s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.09% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.89% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 2.38% : 0.000004s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.24% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.36% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 2.10% : 0.000004s : 10: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.97% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.010224 13 91.78% : 0.009383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.65% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 7.57% : 0.000774s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.097144 72 0.09% : 0.000084s : 1: add_recomputation 0.08% : 0.000079s : 1: auto_monad 0.03% : 0.000025s : 1: auto_monad_reorder 0.48% : 0.000463s : 1: bootstrap 0.04% : 0.000044s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000040s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.06% : 0.008799s : 1: jit_opt_a 0.27% : 0.000262s : 1: jit_opt_after_cconv 0.07% : 0.000071s : 1: jit_opt_b 0.72% : 0.000696s : 1: loop_unroll 1.05% : 0.001022s : 1: mutable_eliminate 1.25% : 0.001211s : 26: opt.transform.jit_opt_a 0.07% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000030s : 1: opt.transform.mutable_eliminate 0.04% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000782s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000141s : 1: py_interpret_to_execute 0.03% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000025s : 1: remove_dup_value 1.15% : 0.001120s : 1: renormalize.infer 0.85% : 0.000829s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000064s : 1: rewriter_after_opt_a 0.09% : 0.000087s : 1: rewriter_before_opt_a 0.10% : 0.000096s : 1: symbol_engine_optimizer 83.23% : 0.080852s : 1: type_inference TotalTime = 0.196677, [30] [bootstrap]: 0.00036331 [type_inference]: 0.175184 [event_method]: 2.068e-05 [auto_monad]: 7.037e-05 [graph_reusing]: 6.33998e-06 [pre_auto_parallel]: 2.31998e-06 [py_interpret_to_execute]: 0.00023833 [rewriter_before_opt_a]: 8.335e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0179611, [2] [Cycle 1]: 0.0140507, [27] [switch_simplify]: 5.669e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00061715 [with_stream_mark]: 2.059e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 0.0128833 [add_forward_monad_depend]: 1.479e-05 [auto_monad_grad]: 3.04999e-06 [auto_monad_eliminator]: 2.887e-05 [cse]: 4.225e-05 [replace_applicator]: 2.888e-05 [Cycle 2]: 0.00042265, [27] [switch_simplify]: 7.71999e-06 [loop_unroll]: 6.64001e-06 [a_1]: 0.00013647 [with_stream_mark]: 1.709e-05 [recompute_prepare]: 7.45e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 2.63003e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 3.59002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.164e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 5.62001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.11002e-06 [auto_monad_eliminator]: 7.28e-06 [cse]: 1.337e-05 [replace_applicator]: 6.24999e-06 [py_interpret_to_execute_after_opt_a]: 2.09e-05 [rewriter_after_opt_a]: 4.4e-05 [convert_after_rewriter]: 7.57002e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00080044 [jit_opt_b]: 5.904e-05, [1] [Cycle 1]: 5.011e-05, [2] [frontend_op_eliminate]: 1.868e-05 [inline_after_opt_a]: 1.866e-05 [cconv]: 3.431e-05 [loop_unroll]: 0.00047457 [jit_opt_after_cconv]: 0.0001843, [1] [Cycle 1]: 0.00017654, [11] [c_1]: 2.855e-05 [parameter_eliminate]: 5.99999e-06 [updatestate_depend_eliminate]: 9.29e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.551e-05 [call_graph_tuple_transform]: 2.451e-05 [tuple_list_get_item_eliminator]: 6.33002e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 1.053e-05 [add_recomputation]: 5.663e-05 [cse_after_recomputation]: 3.893e-05, [1] [Cycle 1]: 3.237e-05, [1] [cse]: 2.551e-05 [auto_monad_reorder]: 1.746e-05 [get_jit_bprop_graph]: 2.70002e-06 [rewriter_after_jit_bprop_graph]: 8.02e-06 [opt_after_jit_grad]: 0.00061719 [symbol_engine_optimizer]: 8.283e-05, [1] [Cycle 1]: 7.571e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.572e-05 [opt_reshape]: 7.24001e-06 [fold_const_symbol]: 1.035e-05 [renormalize]: 7.90023e-07 [validate]: 5.283e-05 Sums bootstrap : 0.000363s : 0.19% type_inference : 0.175184s : 91.00% event_method : 0.000021s : 0.01% auto_monad : 0.000070s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000238s : 0.12% rewriter_before_opt_a : 0.000083s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000754s : 0.39% jit_opt_a.with_stream_mark : 0.000038s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.012883s : 6.69% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.02% jit_opt_a.cse : 0.000056s : 0.03% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000800s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000475s : 0.25% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000057s : 0.03% cse_after_recomputation.cse : 0.000026s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000617s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.03% Time group info: ------[substitution.] 0.000223 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 4: substitution.graph_param_transform 81.91% : 0.000183s : 4: substitution.inline 2.06% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.86% : 0.000006s : 4: substitution.remove_not_recompute_node 3.05% : 0.000007s : 2: substitution.replace_old_param 5.70% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.175101 2 98.97% : 0.173302s : 1: type_inference.infer 1.03% : 0.001799s : 1: type_inference.specialize ------[replace.] 0.000075 6 66.63% : 0.000050s : 4: replace.inline 33.37% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 93.95% : 0.000180s : 4: match.inline 6.05% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.59% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 2.32% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.38% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.63% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.52% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 2.12% : 0.000003s : 4: predicate.mutable_eliminate 0.76% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.57% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.35% : 0.000010s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.27% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004670 26 80.28% : 0.003749s : 19: func_graph_cloner_run.FuncGraphClonerGraph 0.97% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 18.75% : 0.000876s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.210632 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000074s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.18% : 0.000386s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000041s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 8.53% : 0.017966s : 1: jit_opt_a 0.09% : 0.000187s : 1: jit_opt_after_cconv 0.03% : 0.000062s : 1: jit_opt_b 0.23% : 0.000483s : 1: loop_unroll 0.39% : 0.000814s : 1: mutable_eliminate 0.48% : 0.001009s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000630s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000244s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 5.60% : 0.011788s : 1: renormalize.infer 0.51% : 0.001077s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.04% : 0.000089s : 1: rewriter_before_opt_a 0.04% : 0.000085s : 1: symbol_engine_optimizer 83.18% : 0.175204s : 1: type_inference TotalTime = 0.154264, [30] [bootstrap]: 0.00031601 [type_inference]: 0.127665 [event_method]: 2.915e-05 [auto_monad]: 8.795e-05 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 0.00031947 [rewriter_before_opt_a]: 0.00011727 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.00945195, [2] [Cycle 1]: 0.00479426, [27] [switch_simplify]: 8.069e-05 [loop_unroll]: 3.579e-05 [a_1]: 0.00145184 [with_stream_mark]: 3.678e-05 [recompute_prepare]: 1.439e-05 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.70998e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 3.31999e-06 [specialize_transform]: 8.1e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 7.09001e-06 [meta_shard_fg_expand]: 3.22002e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 5.49e-06 [cell_reuse_recompute_pass]: 2.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.968e-05 [j_node_and_user_rematch]: 1.25e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 1.432e-05 [inline_without_move]: 8.12e-06 [renormalize]: 0.0026875 [add_forward_monad_depend]: 1.04e-05 [auto_monad_grad]: 3.14001e-06 [auto_monad_eliminator]: 2.179e-05 [cse]: 4.559e-05 [replace_applicator]: 2.418e-05 [Cycle 2]: 0.0003955, [27] [switch_simplify]: 7.38e-06 [loop_unroll]: 6.21998e-06 [a_1]: 0.00012414 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 6.34999e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.86003e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 2.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.924e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.35002e-06 [cse]: 1.568e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.683e-05 [rewriter_after_opt_a]: 4.362e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 5.54998e-06 [mutable_eliminate]: 0.00078805 [jit_opt_b]: 5.733e-05, [1] [Cycle 1]: 4.893e-05, [2] [frontend_op_eliminate]: 1.855e-05 [inline_after_opt_a]: 1.915e-05 [cconv]: 3.15e-05 [loop_unroll]: 0.0137786 [jit_opt_after_cconv]: 0.00024738, [1] [Cycle 1]: 0.00023426, [11] [c_1]: 3.427e-05 [parameter_eliminate]: 9.21998e-06 [updatestate_depend_eliminate]: 1.452e-05 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.36001e-06 [cse]: 6.01e-05 [call_graph_tuple_transform]: 3.265e-05 [tuple_list_get_item_eliminator]: 6.86001e-06 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 1.05001e-06 [switch_simplify]: 8.06001e-06 [remove_dup_value]: 2.504e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 1.322e-05 [add_recomputation]: 6.562e-05 [cse_after_recomputation]: 3.326e-05, [1] [Cycle 1]: 2.47e-05, [1] [cse]: 1.654e-05 [auto_monad_reorder]: 2.016e-05 [get_jit_bprop_graph]: 2.64001e-06 [rewriter_after_jit_bprop_graph]: 1.014e-05 [opt_after_jit_grad]: 0.00064341 [symbol_engine_optimizer]: 9.266e-05, [1] [Cycle 1]: 8.486e-05, [6] [build]: 6.93998e-06 [elim_shapecalc]: 1.153e-05 [elim_not_effective]: 1.904e-05 [opt_reshape]: 7.31001e-06 [fold_const_symbol]: 1.088e-05 [renormalize]: 5.99975e-07 [validate]: 0.00012896 Sums bootstrap : 0.000316s : 0.21% type_inference : 0.127665s : 85.55% event_method : 0.000029s : 0.02% auto_monad : 0.000088s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000319s : 0.21% rewriter_before_opt_a : 0.000117s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.001576s : 1.06% jit_opt_a.with_stream_mark : 0.000054s : 0.04% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.002688s : 1.80% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000061s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000788s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.013779s : 9.23% jit_opt_after_cconv.c_1 : 0.000034s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000060s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000025s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000066s : 0.04% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000643s : 0.43% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000129s : 0.09% Time group info: ------[substitution.] 0.000877 25 0.29% : 0.000003s : 2: substitution.elim_not_effective 0.26% : 0.000002s : 2: substitution.fold_const_symbol 0.92% : 0.000008s : 4: substitution.graph_param_transform 94.52% : 0.000829s : 5: substitution.inline 0.65% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.72% : 0.000006s : 4: substitution.remove_not_recompute_node 0.77% : 0.000007s : 2: substitution.replace_old_param 1.88% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127531 2 97.81% : 0.124743s : 1: type_inference.infer 2.19% : 0.002788s : 1: type_inference.specialize ------[replace.] 0.000173 7 70.20% : 0.000122s : 5: replace.inline 29.80% : 0.000052s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000838 7 98.32% : 0.000824s : 5: match.inline 1.68% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 888 1.15% : 0.000002s : 13: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.96% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 0.94% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000002s : 13: predicate.environ_get_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.83% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 7.33% : 0.000012s : 28: predicate.inline 1.08% : 0.000002s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.99% : 0.000002s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 19: predicate.load_eliminater 3.82% : 0.000006s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000007s : 41: predicate.loop_unroll_before_grad 2.17% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.90% : 0.000002s : 13: predicate.merge_addn 0.94% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000004s : 19: predicate.partial_eliminate 1.56% : 0.000003s : 13: predicate.print_const_string_wrapper 1.56% : 0.000003s : 13: predicate.reduce_eliminate 1.30% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.63% : 0.000003s : 13: predicate.reshape_eliminate 1.68% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 4: predicate.row_tensor_eliminate 1.00% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.68% : 0.000001s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.89% : 0.000005s : 20: predicate.switch_defer_inline 2.46% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.31% : 0.000012s : 65: predicate.switch_simplify 1.06% : 0.000002s : 13: predicate.tile_eliminate 1.06% : 0.000002s : 13: predicate.transpose_eliminate 1.15% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.45% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.48% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003085 29 70.10% : 0.002162s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.30% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.60% : 0.000821s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158853 72 0.04% : 0.000069s : 1: add_recomputation 0.06% : 0.000092s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.21% : 0.000335s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000035s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.95% : 0.009455s : 1: jit_opt_a 0.16% : 0.000251s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 8.69% : 0.013808s : 1: loop_unroll 0.50% : 0.000800s : 1: mutable_eliminate 1.18% : 0.001869s : 26: opt.transform.jit_opt_a 0.05% : 0.000078s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000042s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000657s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000329s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000028s : 1: remove_dup_value 1.18% : 0.001867s : 1: renormalize.infer 0.51% : 0.000805s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000126s : 1: rewriter_before_opt_a 0.06% : 0.000095s : 1: symbol_engine_optimizer 80.38% : 0.127690s : 1: type_inference TotalTime = 0.0395001, [30] [bootstrap]: 0.00041412 [type_inference]: 0.026984 [event_method]: 2.547e-05 [auto_monad]: 7.921e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 7.203e-05 [rewriter_before_opt_a]: 8.445e-05 [expand_dump_flag]: 2.90002e-06 [jit_opt_a]: 0.00856695, [2] [Cycle 1]: 0.00253661, [27] [switch_simplify]: 8.135e-05 [loop_unroll]: 3.131e-05 [a_1]: 0.00074935 [with_stream_mark]: 2.961e-05 [recompute_prepare]: 1.122e-05 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 7.52002e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 7.11999e-06 [meta_shard_fg_expand]: 3.33998e-06 [get_grad_eliminate_]: 6.32001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.948e-05 [j_node_and_user_rematch]: 1.181e-05 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.22e-05 [inline_without_move]: 7.21999e-06 [renormalize]: 0.00114705 [add_forward_monad_depend]: 1.026e-05 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 2.144e-05 [cse]: 4.384e-05 [replace_applicator]: 2.071e-05 [Cycle 2]: 0.00059306, [27] [switch_simplify]: 7.56999e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.00010853 [with_stream_mark]: 1.622e-05 [recompute_prepare]: 6.61999e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.57999e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 3.28e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00015638 [j_node_and_user_rematch]: 1.42e-05 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 1.142e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 5.72999e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.494e-05 [cse]: 2.772e-05 [replace_applicator]: 8.13999e-06 [py_interpret_to_execute_after_opt_a]: 2.153e-05 [rewriter_after_opt_a]: 5.476e-05 [convert_after_rewriter]: 7.61999e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00117133 [jit_opt_b]: 6.213e-05, [1] [Cycle 1]: 5.273e-05, [2] [frontend_op_eliminate]: 1.989e-05 [inline_after_opt_a]: 1.828e-05 [cconv]: 3.655e-05 [loop_unroll]: 0.00056684 [jit_opt_after_cconv]: 0.00022156, [1] [Cycle 1]: 0.00021367, [11] [c_1]: 2.343e-05 [parameter_eliminate]: 6.03002e-06 [updatestate_depend_eliminate]: 1.012e-05 [updatestate_assign_eliminate]: 5.22999e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.936e-05 [call_graph_tuple_transform]: 2.521e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.80001e-06 [renormalize]: 8.80013e-07 [switch_simplify]: 7.30998e-06 [remove_dup_value]: 2.097e-05 [partial_unused_args_eliminate]: 3.09001e-06 [environ_conv]: 7.97e-06 [add_recomputation]: 5.887e-05 [cse_after_recomputation]: 2.907e-05, [1] [Cycle 1]: 2.246e-05, [1] [cse]: 1.459e-05 [auto_monad_reorder]: 1.999e-05 [get_jit_bprop_graph]: 3.16001e-06 [rewriter_after_jit_bprop_graph]: 1.02e-05 [opt_after_jit_grad]: 0.00058579 [symbol_engine_optimizer]: 8.231e-05, [1] [Cycle 1]: 7.483e-05, [6] [build]: 4.68999e-06 [elim_shapecalc]: 8.14997e-06 [elim_not_effective]: 1.624e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 1.009e-05 [renormalize]: 5.39992e-07 [validate]: 4.893e-05 Sums bootstrap : 0.000414s : 1.25% type_inference : 0.026984s : 81.24% event_method : 0.000025s : 0.08% auto_monad : 0.000079s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000072s : 0.22% rewriter_before_opt_a : 0.000084s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000089s : 0.27% jit_opt_a.loop_unroll : 0.000037s : 0.11% jit_opt_a.a_1 : 0.000858s : 2.58% jit_opt_a.with_stream_mark : 0.000046s : 0.14% jit_opt_a.recompute_prepare : 0.000018s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000176s : 0.53% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.08% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000024s : 0.07% jit_opt_a.inline_without_move : 0.000013s : 0.04% jit_opt_a.renormalize : 0.001147s : 3.45% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.05% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.11% jit_opt_a.cse : 0.000072s : 0.22% jit_opt_a.replace_applicator : 0.000029s : 0.09% py_interpret_to_execute_after_opt_a : 0.000022s : 0.06% rewriter_after_opt_a : 0.000055s : 0.16% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001171s : 3.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000037s : 0.11% loop_unroll : 0.000567s : 1.71% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000021s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000059s : 0.18% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000586s : 1.76% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.15% Time group info: ------[substitution.] 0.000337 23 0.76% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.81% : 0.000006s : 3: substitution.graph_param_transform 85.18% : 0.000287s : 4: substitution.inline 1.88% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000009s : 4: substitution.remove_not_recompute_node 2.61% : 0.000009s : 2: substitution.replace_old_param 4.56% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026865 2 93.53% : 0.025127s : 1: type_inference.infer 6.47% : 0.001737s : 1: type_inference.specialize ------[replace.] 0.000109 6 61.76% : 0.000067s : 4: replace.inline 38.24% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000297 6 95.29% : 0.000283s : 4: match.inline 4.71% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000281 691 0.57% : 0.000002s : 10: predicate.accumulaten_eliminater 0.71% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.46% : 0.000001s : 10: predicate.addn_check_dump 0.63% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000005s : 10: predicate.arithmetic_simplify 0.54% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 0.52% : 0.000001s : 10: predicate.compare_switch_simplify 0.70% : 0.000002s : 10: predicate.depend_value_elim 0.46% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.54% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.66% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.53% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.15% : 0.000000s : 3: predicate.elim_not_effective 0.27% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.79% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.53% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.53% : 0.000001s : 10: predicate.environ_get_depend_swap 0.53% : 0.000001s : 10: predicate.environ_get_eliminate 0.54% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.10% : 0.000000s : 3: predicate.fold_const_symbol 0.49% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000001s : 3: predicate.graph_param_transform 2.73% : 0.000008s : 22: predicate.inline 0.69% : 0.000002s : 6: predicate.inline_without_move 0.17% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000003s : 6: predicate.less_batch_normalization 0.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.83% : 0.000002s : 15: predicate.load_eliminater 0.82% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.41% : 0.000007s : 34: predicate.loop_unroll_before_grad 0.91% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.67% : 0.000002s : 10: predicate.merge_addn 0.60% : 0.000002s : 10: predicate.minmaximum_grad 1.91% : 0.000005s : 3: predicate.mutable_eliminate 0.28% : 0.000001s : 3: predicate.opt_reshape 0.97% : 0.000003s : 15: predicate.partial_eliminate 0.57% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000004s : 10: predicate.reduce_eliminate 0.77% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 45.16% : 0.000127s : 6: predicate.remove_not_recompute_node 0.95% : 0.000003s : 18: predicate.replace_applicator 0.27% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000001s : 3: predicate.reset_defer_inline 0.47% : 0.000001s : 10: predicate.reshape_eliminate 0.86% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 3: predicate.row_tensor_eliminate 0.70% : 0.000002s : 10: predicate.same_eliminate 0.22% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.42% : 0.000001s : 6: predicate.special_op_eliminate 0.41% : 0.000001s : 6: predicate.specialize_transform 0.77% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.85% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.22% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.51% : 0.000004s : 16: predicate.switch_defer_inline 1.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 4.12% : 0.000012s : 53: predicate.switch_simplify 0.64% : 0.000002s : 10: predicate.tile_eliminate 1.06% : 0.000003s : 10: predicate.transpose_eliminate 0.69% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.86% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 2.23% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 0.95% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 0.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 1.47% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 0.88% : 0.000002s : 10: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.34% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001135 13 40.83% : 0.000463s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.68% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.49% : 0.000607s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041992 72 0.15% : 0.000062s : 1: add_recomputation 0.20% : 0.000084s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 1.04% : 0.000438s : 1: bootstrap 0.09% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 20.42% : 0.008574s : 1: jit_opt_a 0.54% : 0.000226s : 1: jit_opt_after_cconv 0.16% : 0.000065s : 1: jit_opt_b 1.37% : 0.000576s : 1: loop_unroll 2.83% : 0.001190s : 1: mutable_eliminate 3.05% : 0.001282s : 26: opt.transform.jit_opt_a 0.14% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000026s : 1: opt.transform.mutable_eliminate 0.06% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.42% : 0.000598s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000075s : 1: py_interpret_to_execute 0.06% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000024s : 1: remove_dup_value 1.49% : 0.000625s : 1: renormalize.infer 1.21% : 0.000509s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000060s : 1: rewriter_after_opt_a 0.21% : 0.000089s : 1: rewriter_before_opt_a 0.20% : 0.000085s : 1: symbol_engine_optimizer 64.33% : 0.027012s : 1: type_inference TotalTime = 0.0484238, [30] [bootstrap]: 0.0004529 [type_inference]: 0.0351205 [event_method]: 2.325e-05 [auto_monad]: 7.864e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00014527 [rewriter_before_opt_a]: 8.703e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00878543, [2] [Cycle 1]: 0.00297581, [27] [switch_simplify]: 7.023e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00067278 [with_stream_mark]: 2.838e-05 [recompute_prepare]: 9.94001e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 7.31001e-06 [meta_shard_fg_expand]: 3.44001e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.41999e-06 [cell_reuse_recompute_pass]: 1.86003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.753e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 1.198e-05 [inline_without_move]: 5.80002e-06 [renormalize]: 0.00173753 [add_forward_monad_depend]: 1.236e-05 [auto_monad_grad]: 3.37002e-06 [auto_monad_eliminator]: 2.253e-05 [cse]: 4.44e-05 [replace_applicator]: 2.289e-05 [Cycle 2]: 0.00042983, [27] [switch_simplify]: 7.08998e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00010844 [with_stream_mark]: 1.479e-05 [recompute_prepare]: 7.11999e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 7.56999e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 6.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.02e-05 [j_node_and_user_rematch]: 9.95997e-06 [meta_fg_expand]: 3.80998e-06 [replace_old_param]: 9.76998e-06 [inline_without_move]: 6.69999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.48e-06 [auto_monad_grad]: 2.17001e-06 [auto_monad_eliminator]: 1.067e-05 [cse]: 2.225e-05 [replace_applicator]: 8.02e-06 [py_interpret_to_execute_after_opt_a]: 1.931e-05 [rewriter_after_opt_a]: 5.052e-05 [convert_after_rewriter]: 8.21002e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00111279 [jit_opt_b]: 6.76e-05, [1] [Cycle 1]: 5.773e-05, [2] [frontend_op_eliminate]: 2.312e-05 [inline_after_opt_a]: 2.087e-05 [cconv]: 3.646e-05 [loop_unroll]: 0.00070488 [jit_opt_after_cconv]: 0.00021109, [1] [Cycle 1]: 0.00020111, [11] [c_1]: 2.934e-05 [parameter_eliminate]: 4.87e-06 [updatestate_depend_eliminate]: 1.174e-05 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 4.242e-05 [call_graph_tuple_transform]: 3.059e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 7.06999e-06 [remove_dup_value]: 1.965e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 7.73001e-06 [add_recomputation]: 0.00017897 [cse_after_recomputation]: 4.053e-05, [1] [Cycle 1]: 3.286e-05, [1] [cse]: 1.869e-05 [auto_monad_reorder]: 2.133e-05 [get_jit_bprop_graph]: 2.64999e-06 [rewriter_after_jit_bprop_graph]: 9.42999e-06 [opt_after_jit_grad]: 0.00082257 [symbol_engine_optimizer]: 8.934e-05, [1] [Cycle 1]: 8.055e-05, [6] [build]: 4.75999e-06 [elim_shapecalc]: 9.15001e-06 [elim_not_effective]: 1.765e-05 [opt_reshape]: 7.58001e-06 [fold_const_symbol]: 1.052e-05 [renormalize]: 8.2e-07 [validate]: 5.445e-05 Sums bootstrap : 0.000453s : 1.07% type_inference : 0.035121s : 83.08% event_method : 0.000023s : 0.06% auto_monad : 0.000079s : 0.19% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000145s : 0.34% rewriter_before_opt_a : 0.000087s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.18% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000781s : 1.85% jit_opt_a.with_stream_mark : 0.000043s : 0.10% jit_opt_a.recompute_prepare : 0.000017s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.05% jit_opt_a.meta_fg_expand : 0.000007s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.05% jit_opt_a.inline_without_move : 0.000013s : 0.03% jit_opt_a.renormalize : 0.001738s : 4.11% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.04% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.08% jit_opt_a.cse : 0.000067s : 0.16% jit_opt_a.replace_applicator : 0.000031s : 0.07% py_interpret_to_execute_after_opt_a : 0.000019s : 0.05% rewriter_after_opt_a : 0.000051s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001113s : 2.63% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.05% jit_opt_b.inline_after_opt_a : 0.000021s : 0.05% cconv : 0.000036s : 0.09% loop_unroll : 0.000705s : 1.67% jit_opt_after_cconv.c_1 : 0.000029s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000179s : 0.42% cse_after_recomputation.cse : 0.000019s : 0.04% auto_monad_reorder : 0.000021s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000823s : 1.95% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.13% Time group info: ------[substitution.] 0.000299 23 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.54% : 0.000008s : 3: substitution.graph_param_transform 85.12% : 0.000255s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000006s : 4: substitution.remove_not_recompute_node 2.59% : 0.000008s : 2: substitution.replace_old_param 4.63% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035015 2 74.06% : 0.025932s : 1: type_inference.infer 25.94% : 0.009083s : 1: type_inference.specialize ------[replace.] 0.000093 6 67.04% : 0.000063s : 4: replace.inline 32.96% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 6 95.18% : 0.000252s : 4: match.inline 4.82% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 691 0.96% : 0.000001s : 10: predicate.accumulaten_eliminater 1.60% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000002s : 10: predicate.addn_zero_filter 2.40% : 0.000003s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.78% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000002s : 10: predicate.depend_value_elim 0.90% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.94% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.65% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_depend_swap 1.05% : 0.000002s : 10: predicate.environ_get_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.52% : 0.000008s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 15: predicate.load_eliminater 1.73% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.96% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.93% : 0.000001s : 10: predicate.minmaximum_grad 2.39% : 0.000003s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 1.91% : 0.000003s : 15: predicate.partial_eliminate 0.92% : 0.000001s : 10: predicate.print_const_string_wrapper 1.98% : 0.000003s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 2.36% : 0.000003s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.12% : 0.000002s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.45% : 0.000002s : 3: predicate.row_tensor_eliminate 1.09% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 16: predicate.switch_defer_inline 1.73% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.95% : 0.000010s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.85% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.02% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.17% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007837 13 6.83% : 0.000536s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.79% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 92.38% : 0.007240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051292 72 0.37% : 0.000188s : 1: add_recomputation 0.16% : 0.000083s : 1: auto_monad 0.05% : 0.000025s : 1: auto_monad_reorder 0.93% : 0.000477s : 1: bootstrap 0.08% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000044s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.14% : 0.008792s : 1: jit_opt_a 0.42% : 0.000215s : 1: jit_opt_after_cconv 0.14% : 0.000071s : 1: jit_opt_b 1.40% : 0.000719s : 1: loop_unroll 2.20% : 0.001129s : 1: mutable_eliminate 2.05% : 0.001050s : 26: opt.transform.jit_opt_a 0.13% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000036s : 4: opt.transform.jit_opt_b 0.04% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000026s : 1: opt.transform.mutable_eliminate 0.07% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.63% : 0.000838s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000149s : 1: py_interpret_to_execute 0.04% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 2.00% : 0.001025s : 1: renormalize.infer 1.36% : 0.000699s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000055s : 1: rewriter_after_opt_a 0.18% : 0.000090s : 1: rewriter_before_opt_a 0.18% : 0.000092s : 1: symbol_engine_optimizer 68.53% : 0.035148s : 1: type_inference TotalTime = 0.234941, [30] [bootstrap]: 0.00038821 [type_inference]: 0.224255 [event_method]: 2.116e-05 [auto_monad]: 7.027e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 0.00023681 [rewriter_before_opt_a]: 8.682e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00725515, [2] [Cycle 1]: 0.00324141, [27] [switch_simplify]: 6.415e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00061933 [with_stream_mark]: 2.391e-05 [recompute_prepare]: 9.17999e-06 [updatestate_depend_eliminate]: 5.65001e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 9.88002e-06 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00210718 [add_forward_monad_depend]: 9.66e-06 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 2.019e-05 [cse]: 3.423e-05 [replace_applicator]: 2.188e-05 [Cycle 2]: 0.00037661, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.0001175 [with_stream_mark]: 1.318e-05 [recompute_prepare]: 5.81998e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 2.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.844e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.40024e-07 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 7.12002e-06 [cse]: 1.289e-05 [replace_applicator]: 6.25002e-06 [py_interpret_to_execute_after_opt_a]: 1.651e-05 [rewriter_after_opt_a]: 3.917e-05 [convert_after_rewriter]: 8.63001e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00072443 [jit_opt_b]: 5.672e-05, [1] [Cycle 1]: 4.894e-05, [2] [frontend_op_eliminate]: 1.885e-05 [inline_after_opt_a]: 1.811e-05 [cconv]: 3.521e-05 [loop_unroll]: 0.00046435 [jit_opt_after_cconv]: 0.00017736, [1] [Cycle 1]: 0.00017056, [11] [c_1]: 2.489e-05 [parameter_eliminate]: 5.77999e-06 [updatestate_depend_eliminate]: 9.42001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 3.441e-05 [call_graph_tuple_transform]: 2.538e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 6.38998e-06 [remove_dup_value]: 1.691e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 1.049e-05 [add_recomputation]: 5.969e-05 [cse_after_recomputation]: 2.367e-05, [1] [Cycle 1]: 1.849e-05, [1] [cse]: 1.227e-05 [auto_monad_reorder]: 1.732e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 7.61001e-06 [opt_after_jit_grad]: 0.00053068 [symbol_engine_optimizer]: 0.00012772, [1] [Cycle 1]: 0.00012007, [6] [build]: 6.09999e-06 [elim_shapecalc]: 8.62998e-06 [elim_not_effective]: 1.799e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 9.75002e-06 [renormalize]: 7.50006e-07 [validate]: 5.87e-05 Sums bootstrap : 0.000388s : 0.17% type_inference : 0.224255s : 97.25% event_method : 0.000021s : 0.01% auto_monad : 0.000070s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000237s : 0.10% rewriter_before_opt_a : 0.000087s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.03% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000737s : 0.32% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000011s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002107s : 0.91% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000047s : 0.02% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000724s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000464s : 0.20% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000531s : 0.23% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.03% Time group info: ------[substitution.] 0.000256 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000007s : 4: substitution.graph_param_transform 84.65% : 0.000217s : 4: substitution.inline 1.79% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000006s : 4: substitution.remove_not_recompute_node 2.44% : 0.000006s : 2: substitution.replace_old_param 5.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.224156 2 99.14% : 0.222219s : 1: type_inference.infer 0.86% : 0.001937s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.16% : 0.000052s : 4: replace.inline 32.84% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.76% : 0.000215s : 4: match.inline 5.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.12% : 0.000002s : 12: predicate.accumulaten_eliminater 1.38% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 2.20% : 0.000003s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000001s : 12: predicate.depend_value_elim 0.99% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.71% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.60% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 12: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.05% : 0.000001s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.84% : 0.000008s : 26: predicate.inline 1.08% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 2.27% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.55% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 2.72% : 0.000004s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.04% : 0.000001s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.99% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.03% : 0.000001s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.22% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.58% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.24% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 12: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.042803 26 98.57% : 0.042192s : 19: func_graph_cloner_run.FuncGraphClonerGraph 0.13% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 1.30% : 0.000555s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.238083 72 0.03% : 0.000063s : 1: add_recomputation 0.03% : 0.000074s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.17% : 0.000416s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.05% : 0.007259s : 1: jit_opt_a 0.08% : 0.000180s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.20% : 0.000475s : 1: loop_unroll 0.31% : 0.000736s : 1: mutable_eliminate 0.41% : 0.000980s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000542s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000244s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.61% : 0.001443s : 1: renormalize.infer 0.27% : 0.000653s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000092s : 1: rewriter_before_opt_a 0.06% : 0.000131s : 1: symbol_engine_optimizer 94.20% : 0.224279s : 1: type_inference TotalTime = 0.0617314, [30] [bootstrap]: 0.00033632 [type_inference]: 0.00955758 [event_method]: 2.367e-05 [auto_monad]: 7.731e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 5.571e-05 [rewriter_before_opt_a]: 8.686e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0488703, [2] [Cycle 1]: 0.0446004, [27] [switch_simplify]: 7.058e-05 [loop_unroll]: 3.35e-05 [a_1]: 0.00074941 [with_stream_mark]: 2.898e-05 [recompute_prepare]: 9.74999e-06 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.84002e-06 [parameter_eliminate]: 2.43998e-06 [specialize_transform]: 7.60998e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 5.52001e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.813e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 5.72999e-06 [renormalize]: 0.0432367 [add_forward_monad_depend]: 1.516e-05 [auto_monad_grad]: 5.30001e-06 [auto_monad_eliminator]: 2.845e-05 [cse]: 4.735e-05 [replace_applicator]: 2.795e-05 [Cycle 2]: 0.00039328, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 5.59998e-06 [a_1]: 0.00011047 [with_stream_mark]: 1.806e-05 [recompute_prepare]: 6.50002e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 4.83001e-06 [cell_reuse_recompute_pass]: 3.41999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.037e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.88002e-06 [inline_without_move]: 5.18002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 7.66999e-06 [cse]: 1.673e-05 [replace_applicator]: 5.88002e-06 [py_interpret_to_execute_after_opt_a]: 2.471e-05 [rewriter_after_opt_a]: 4.539e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00082852 [jit_opt_b]: 5.724e-05, [1] [Cycle 1]: 4.811e-05, [2] [frontend_op_eliminate]: 1.748e-05 [inline_after_opt_a]: 1.719e-05 [cconv]: 3.784e-05 [loop_unroll]: 0.00044648 [jit_opt_after_cconv]: 0.00017751, [1] [Cycle 1]: 0.0001704, [11] [c_1]: 2.282e-05 [parameter_eliminate]: 4.3e-06 [updatestate_depend_eliminate]: 9.05999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.65002e-06 [cse]: 4.026e-05 [call_graph_tuple_transform]: 2.318e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 2.19001e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 5.229e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.7e-06 [add_recomputation]: 6.203e-05 [cse_after_recomputation]: 3.002e-05, [1] [Cycle 1]: 2.368e-05, [1] [cse]: 1.588e-05 [auto_monad_reorder]: 1.921e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 8.54998e-06 [opt_after_jit_grad]: 0.00054275 [symbol_engine_optimizer]: 8.137e-05, [1] [Cycle 1]: 7.417e-05, [6] [build]: 5.48997e-06 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.485e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 5.50004e-07 [validate]: 5.003e-05 Sums bootstrap : 0.000336s : 0.59% type_inference : 0.009558s : 16.73% event_method : 0.000024s : 0.04% auto_monad : 0.000077s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000056s : 0.10% rewriter_before_opt_a : 0.000087s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.14% jit_opt_a.loop_unroll : 0.000039s : 0.07% jit_opt_a.a_1 : 0.000860s : 1.51% jit_opt_a.with_stream_mark : 0.000047s : 0.08% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000010s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.043237s : 75.68% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.03% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.06% jit_opt_a.cse : 0.000064s : 0.11% jit_opt_a.replace_applicator : 0.000034s : 0.06% py_interpret_to_execute_after_opt_a : 0.000025s : 0.04% rewriter_after_opt_a : 0.000045s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000829s : 1.45% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000038s : 0.07% loop_unroll : 0.000446s : 0.78% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000052s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000062s : 0.11% cse_after_recomputation.cse : 0.000016s : 0.03% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000543s : 0.95% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.09% Time group info: ------[substitution.] 0.000329 24 0.76% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 1.99% : 0.000007s : 3: substitution.graph_param_transform 86.70% : 0.000285s : 5: substitution.inline 1.52% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000008s : 2: substitution.replace_old_param 4.38% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009477 2 87.40% : 0.008283s : 1: type_inference.infer 12.60% : 0.001194s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.71% : 0.000073s : 5: replace.inline 31.29% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000295 7 95.70% : 0.000282s : 5: match.inline 4.30% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 747 1.47% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 11: predicate.addn_check_dump 1.84% : 0.000003s : 11: predicate.addn_zero_filter 1.83% : 0.000003s : 11: predicate.arithmetic_simplify 1.51% : 0.000002s : 11: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000002s : 11: predicate.compare_switch_simplify 1.12% : 0.000002s : 11: predicate.depend_value_elim 1.01% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.37% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000001s : 3: predicate.graph_param_transform 6.32% : 0.000009s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.65% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.28% : 0.000003s : 16: predicate.load_eliminater 1.21% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 2.07% : 0.000003s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 16: predicate.partial_eliminate 1.39% : 0.000002s : 11: predicate.print_const_string_wrapper 2.00% : 0.000003s : 11: predicate.reduce_eliminate 1.71% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000003s : 19: predicate.replace_applicator 0.40% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 11: predicate.reshape_eliminate 1.26% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.90% : 0.000004s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.35% : 0.000011s : 59: predicate.switch_simplify 1.15% : 0.000002s : 11: predicate.tile_eliminate 1.68% : 0.000002s : 11: predicate.transpose_eliminate 1.24% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 2.14% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001041 16 45.21% : 0.000471s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.42% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.37% : 0.000472s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.106130 72 0.06% : 0.000066s : 1: add_recomputation 0.08% : 0.000081s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.34% : 0.000357s : 1: bootstrap 0.04% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 46.05% : 0.048874s : 1: jit_opt_a 0.17% : 0.000181s : 1: jit_opt_after_cconv 0.06% : 0.000060s : 1: jit_opt_b 0.43% : 0.000456s : 1: loop_unroll 0.79% : 0.000842s : 1: mutable_eliminate 1.06% : 0.001128s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.52% : 0.000557s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000059s : 1: py_interpret_to_execute 0.03% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000055s : 1: remove_dup_value 40.14% : 0.042597s : 1: renormalize.infer 0.58% : 0.000620s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000049s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000084s : 1: symbol_engine_optimizer 9.03% : 0.009580s : 1: type_inference TotalTime = 0.0443564, [30] [bootstrap]: 0.0003473 [type_inference]: 0.0352536 [event_method]: 2.241e-05 [auto_monad]: 7.271e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 4.619e-05 [rewriter_before_opt_a]: 7.578e-05 [expand_dump_flag]: 2.91999e-06 [jit_opt_a]: 0.00615537, [2] [Cycle 1]: 0.00193535, [27] [switch_simplify]: 6.26e-05 [loop_unroll]: 2.922e-05 [a_1]: 0.00060442 [with_stream_mark]: 2.377e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 5.71003e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.25001e-06 [renormalize]: 0.0008456 [add_forward_monad_depend]: 7.28e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.796e-05 [cse]: 3.184e-05 [replace_applicator]: 1.653e-05 [Cycle 2]: 0.00033521, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 4.66002e-06 [a_1]: 8.902e-05 [with_stream_mark]: 1.17e-05 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.92999e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 9.16002e-06 [meta_fg_expand]: 1.81998e-06 [replace_old_param]: 8.35999e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.84e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.92003e-06 [cse]: 1.223e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.363e-05 [rewriter_after_opt_a]: 4.102e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00074635 [jit_opt_b]: 5.06e-05, [1] [Cycle 1]: 4.351e-05, [2] [frontend_op_eliminate]: 1.531e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 3.417e-05 [loop_unroll]: 0.000421 [jit_opt_after_cconv]: 0.00015436, [1] [Cycle 1]: 0.00014806, [11] [c_1]: 2.019e-05 [parameter_eliminate]: 4.72998e-06 [updatestate_depend_eliminate]: 7.83001e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.883e-05 [call_graph_tuple_transform]: 2.107e-05 [tuple_list_get_item_eliminator]: 5.07e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 6.90023e-07 [switch_simplify]: 5.44998e-06 [remove_dup_value]: 1.642e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 5.427e-05 [cse_after_recomputation]: 2.328e-05, [1] [Cycle 1]: 1.772e-05, [1] [cse]: 1.146e-05 [auto_monad_reorder]: 1.678e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 6.28998e-06 [opt_after_jit_grad]: 0.00044818 [symbol_engine_optimizer]: 7.282e-05, [1] [Cycle 1]: 6.656e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.68001e-06 [renormalize]: 3.19997e-07 [validate]: 4.033e-05 Sums bootstrap : 0.000347s : 0.87% type_inference : 0.035254s : 88.51% event_method : 0.000022s : 0.06% auto_monad : 0.000073s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000046s : 0.12% rewriter_before_opt_a : 0.000076s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.17% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000693s : 1.74% jit_opt_a.with_stream_mark : 0.000035s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000846s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.06% jit_opt_a.cse : 0.000044s : 0.11% jit_opt_a.replace_applicator : 0.000022s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000041s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000746s : 1.87% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000034s : 0.09% loop_unroll : 0.000421s : 1.06% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.14% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000448s : 1.13% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.10% Time group info: ------[substitution.] 0.000255 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 84.78% : 0.000216s : 4: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000006s : 2: substitution.replace_old_param 5.72% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035160 2 96.67% : 0.033988s : 1: type_inference.infer 3.33% : 0.001172s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.78% : 0.000050s : 4: replace.inline 32.22% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.09% : 0.000214s : 4: match.inline 5.91% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.67% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.89% : 0.000003s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 1.14% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.46% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.30% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.95% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 13 46.03% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.55% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.42% : 0.000381s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046174 72 0.12% : 0.000057s : 1: add_recomputation 0.16% : 0.000076s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.80% : 0.000370s : 1: bootstrap 0.08% : 0.000037s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000019s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.34% : 0.006158s : 1: jit_opt_a 0.34% : 0.000157s : 1: jit_opt_after_cconv 0.11% : 0.000053s : 1: jit_opt_b 0.93% : 0.000429s : 1: loop_unroll 1.64% : 0.000758s : 1: mutable_eliminate 1.99% : 0.000920s : 26: opt.transform.jit_opt_a 0.11% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.99% : 0.000456s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000049s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.06% : 0.000488s : 1: renormalize.infer 0.75% : 0.000347s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000044s : 1: rewriter_after_opt_a 0.17% : 0.000080s : 1: rewriter_before_opt_a 0.16% : 0.000075s : 1: symbol_engine_optimizer 76.42% : 0.035284s : 1: type_inference TotalTime = 0.064266, [30] [bootstrap]: 0.00047729 [type_inference]: 0.0516258 [event_method]: 2.696e-05 [auto_monad]: 8.46e-05 [graph_reusing]: 6.36998e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 0.00022221 [rewriter_before_opt_a]: 0.00010572 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00843623, [2] [Cycle 1]: 0.00275896, [27] [switch_simplify]: 7.797e-05 [loop_unroll]: 3.441e-05 [a_1]: 0.00073607 [with_stream_mark]: 2.435e-05 [recompute_prepare]: 8.06001e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.562e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.129e-05 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00148043 [add_forward_monad_depend]: 1.075e-05 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 2.114e-05 [cse]: 4.318e-05 [replace_applicator]: 1.774e-05 [Cycle 2]: 0.00039173, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00010291 [with_stream_mark]: 1.364e-05 [recompute_prepare]: 5.83002e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 8.89003e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 3.45e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.794e-05 [j_node_and_user_rematch]: 9.74999e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.45002e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 1.12e-05 [cse]: 1.854e-05 [replace_applicator]: 7.31999e-06 [py_interpret_to_execute_after_opt_a]: 1.663e-05 [rewriter_after_opt_a]: 5.148e-05 [convert_after_rewriter]: 8.06001e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00099217 [jit_opt_b]: 0.00011827, [1] [Cycle 1]: 0.00010769, [2] [frontend_op_eliminate]: 7.354e-05 [inline_after_opt_a]: 1.933e-05 [cconv]: 3.522e-05 [loop_unroll]: 0.00061619 [jit_opt_after_cconv]: 0.00019311, [1] [Cycle 1]: 0.0001846, [11] [c_1]: 2.409e-05 [parameter_eliminate]: 5.70001e-06 [updatestate_depend_eliminate]: 1.048e-05 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.978e-05 [call_graph_tuple_transform]: 2.829e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.88998e-06 [remove_dup_value]: 2.002e-05 [partial_unused_args_eliminate]: 4.42998e-06 [environ_conv]: 7.34002e-06 [add_recomputation]: 5.908e-05 [cse_after_recomputation]: 2.76e-05, [1] [Cycle 1]: 2.119e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 2.028e-05 [get_jit_bprop_graph]: 3.969e-05 [rewriter_after_jit_bprop_graph]: 9.14e-06 [opt_after_jit_grad]: 0.00065422 [symbol_engine_optimizer]: 9.365e-05, [1] [Cycle 1]: 8.579e-05, [6] [build]: 4.98001e-06 [elim_shapecalc]: 1.057e-05 [elim_not_effective]: 1.862e-05 [opt_reshape]: 7.23e-06 [fold_const_symbol]: 1.135e-05 [renormalize]: 4.50003e-07 [validate]: 5.624e-05 Sums bootstrap : 0.000477s : 0.82% type_inference : 0.051626s : 88.62% event_method : 0.000027s : 0.05% auto_monad : 0.000085s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000222s : 0.38% rewriter_before_opt_a : 0.000106s : 0.18% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000085s : 0.15% jit_opt_a.loop_unroll : 0.000041s : 0.07% jit_opt_a.a_1 : 0.000839s : 1.44% jit_opt_a.with_stream_mark : 0.000038s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001481s : 2.54% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.06% jit_opt_a.cse : 0.000062s : 0.11% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000051s : 0.09% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000992s : 1.70% jit_opt_b.frontend_op_eliminate : 0.000074s : 0.13% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000035s : 0.06% loop_unroll : 0.000616s : 1.06% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000004s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000059s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000040s : 0.07% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000654s : 1.12% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.10% Time group info: ------[substitution.] 0.000358 23 0.81% : 0.000003s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.39% : 0.000009s : 3: substitution.graph_param_transform 87.84% : 0.000314s : 4: substitution.inline 0.94% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000006s : 4: substitution.remove_not_recompute_node 1.69% : 0.000006s : 2: substitution.replace_old_param 4.02% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051503 2 95.48% : 0.049177s : 1: type_inference.infer 4.52% : 0.002326s : 1: type_inference.specialize ------[replace.] 0.000091 6 71.75% : 0.000065s : 4: replace.inline 28.25% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000324 6 95.89% : 0.000311s : 4: match.inline 4.11% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 691 1.17% : 0.000002s : 10: predicate.accumulaten_eliminater 1.65% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000002s : 10: predicate.addn_zero_filter 2.16% : 0.000003s : 10: predicate.arithmetic_simplify 1.15% : 0.000002s : 10: predicate.cast_eliminate 0.81% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000002s : 10: predicate.compare_switch_simplify 1.01% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.68% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.79% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 2.14% : 0.000003s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.65% : 0.000002s : 10: predicate.environ_get_eliminate 0.90% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000002s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.02% : 0.000007s : 22: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.18% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.46% : 0.000002s : 15: predicate.load_eliminater 2.30% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.90% : 0.000001s : 10: predicate.merge_addn 0.90% : 0.000001s : 10: predicate.minmaximum_grad 2.87% : 0.000004s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 1.91% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000003s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000003s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000001s : 3: predicate.reset_defer_inline 1.09% : 0.000002s : 10: predicate.reshape_eliminate 1.09% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000002s : 10: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.96% : 0.000003s : 6: predicate.special_op_eliminate 0.75% : 0.000001s : 6: predicate.specialize_transform 1.09% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.85% : 0.000004s : 16: predicate.switch_defer_inline 1.77% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.70% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000002s : 10: predicate.transpose_eliminate 1.06% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.35% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.36% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.04% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001132 13 43.38% : 0.000491s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.09% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.54% : 0.000583s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066969 72 0.10% : 0.000064s : 1: add_recomputation 0.13% : 0.000089s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.74% : 0.000497s : 1: bootstrap 0.06% : 0.000038s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.05% : 0.000034s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.06% : 0.000043s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 12.61% : 0.008442s : 1: jit_opt_a 0.29% : 0.000197s : 1: jit_opt_after_cconv 0.18% : 0.000122s : 1: jit_opt_b 0.94% : 0.000628s : 1: loop_unroll 1.50% : 0.001007s : 1: mutable_eliminate 1.65% : 0.001102s : 26: opt.transform.jit_opt_a 0.09% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000084s : 4: opt.transform.jit_opt_b 0.03% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000023s : 1: opt.transform.mutable_eliminate 0.05% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.00% : 0.000666s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000007s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000228s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 1.23% : 0.000823s : 1: renormalize.infer 0.96% : 0.000645s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000055s : 1: rewriter_after_opt_a 0.17% : 0.000111s : 1: rewriter_before_opt_a 0.14% : 0.000096s : 1: symbol_engine_optimizer 77.14% : 0.051656s : 1: type_inference TotalTime = 0.0148329, [30] [bootstrap]: 0.0003622 [type_inference]: 0.00600044 [event_method]: 2.206e-05 [auto_monad]: 7.081e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.68003e-06 [py_interpret_to_execute]: 4.337e-05 [rewriter_before_opt_a]: 7.718e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00594329, [2] [Cycle 1]: 0.00190468, [27] [switch_simplify]: 6.101e-05 [loop_unroll]: 2.962e-05 [a_1]: 0.00059573 [with_stream_mark]: 2.369e-05 [recompute_prepare]: 7.94002e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.35002e-06 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.03002e-06 [renormalize]: 0.00083666 [add_forward_monad_depend]: 7.1e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.643e-05 [cse]: 3.121e-05 [replace_applicator]: 1.653e-05 [Cycle 2]: 0.00031905, [27] [switch_simplify]: 5.37001e-06 [loop_unroll]: 4.74002e-06 [a_1]: 8.829e-05 [with_stream_mark]: 1.102e-05 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 4.74002e-06 [accelerated_algorithm]: 4.82e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 4.46002e-06 [merge_forward]: 3.35998e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.399e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 3.01001e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 4.58001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.046e-05 [replace_applicator]: 4.82998e-06 [py_interpret_to_execute_after_opt_a]: 1.41e-05 [rewriter_after_opt_a]: 3.729e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00062226 [jit_opt_b]: 4.952e-05, [1] [Cycle 1]: 4.182e-05, [2] [frontend_op_eliminate]: 1.466e-05 [inline_after_opt_a]: 1.58e-05 [cconv]: 5.483e-05 [loop_unroll]: 0.00044182 [jit_opt_after_cconv]: 0.00015411, [1] [Cycle 1]: 0.00014741, [11] [c_1]: 2.046e-05 [parameter_eliminate]: 3.56999e-06 [updatestate_depend_eliminate]: 8.52e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.725e-05 [call_graph_tuple_transform]: 2.128e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.639e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 6.56e-06 [add_recomputation]: 6.6e-05 [cse_after_recomputation]: 2.145e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.071e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 7.26999e-06 [opt_after_jit_grad]: 0.00046683 [symbol_engine_optimizer]: 7.255e-05, [1] [Cycle 1]: 6.635e-05, [6] [build]: 4.70001e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.83002e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 5.10016e-07 [validate]: 4.079e-05 Sums bootstrap : 0.000362s : 3.45% type_inference : 0.006000s : 57.15% event_method : 0.000022s : 0.21% auto_monad : 0.000071s : 0.67% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000043s : 0.41% rewriter_before_opt_a : 0.000077s : 0.74% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.63% jit_opt_a.loop_unroll : 0.000034s : 0.33% jit_opt_a.a_1 : 0.000684s : 6.51% jit_opt_a.with_stream_mark : 0.000035s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000837s : 7.97% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.21% jit_opt_a.cse : 0.000042s : 0.40% jit_opt_a.replace_applicator : 0.000021s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.13% rewriter_after_opt_a : 0.000037s : 0.36% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000622s : 5.93% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000055s : 0.52% loop_unroll : 0.000442s : 4.21% jit_opt_after_cconv.c_1 : 0.000020s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000066s : 0.63% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000467s : 4.45% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.39% Time group info: ------[substitution.] 0.000254 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000007s : 3: substitution.graph_param_transform 84.62% : 0.000215s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.51% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005921 2 81.70% : 0.004837s : 1: type_inference.infer 18.30% : 0.001083s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.84% : 0.000052s : 4: replace.inline 30.16% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.33% : 0.000213s : 4: match.inline 5.67% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.05% : 0.000001s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.07% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.76% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 9.39% : 0.000012s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.03% : 0.000001s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000802 13 52.93% : 0.000425s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.59% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.48% : 0.000325s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016628 72 0.42% : 0.000069s : 1: add_recomputation 0.45% : 0.000075s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.31% : 0.000384s : 1: bootstrap 0.35% : 0.000059s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.16% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.76% : 0.005947s : 1: jit_opt_a 0.94% : 0.000157s : 1: jit_opt_after_cconv 0.32% : 0.000052s : 1: jit_opt_b 2.71% : 0.000451s : 1: loop_unroll 3.81% : 0.000634s : 1: mutable_eliminate 5.44% : 0.000905s : 26: opt.transform.jit_opt_a 0.29% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.86% : 0.000476s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000046s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.80% : 0.000466s : 1: renormalize.infer 2.18% : 0.000362s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000040s : 1: rewriter_after_opt_a 0.49% : 0.000081s : 1: rewriter_before_opt_a 0.45% : 0.000075s : 1: symbol_engine_optimizer 36.24% : 0.006026s : 1: type_inference TotalTime = 0.0561285, [30] [bootstrap]: 0.00037262 [type_inference]: 0.0250359 [event_method]: 2.272e-05 [auto_monad]: 7.351e-05 [graph_reusing]: 7.48e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 5.752e-05 [rewriter_before_opt_a]: 9.394e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0273776, [2] [Cycle 1]: 0.0231406, [27] [switch_simplify]: 7.429e-05 [loop_unroll]: 3.63e-05 [a_1]: 0.00070582 [with_stream_mark]: 2.478e-05 [recompute_prepare]: 7.63999e-06 [updatestate_depend_eliminate]: 4.34002e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.56003e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 0.021854 [add_forward_monad_depend]: 1.56e-05 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 2.504e-05 [cse]: 4.427e-05 [replace_applicator]: 2.92e-05 [Cycle 2]: 0.00041978, [27] [switch_simplify]: 8.08001e-06 [loop_unroll]: 6.24999e-06 [a_1]: 0.00011075 [with_stream_mark]: 1.814e-05 [recompute_prepare]: 6.80002e-06 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 3.91001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.58998e-06 [meta_shard_fg_expand]: 2.93998e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 5.15001e-06 [cell_reuse_recompute_pass]: 3.92002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.243e-05 [j_node_and_user_rematch]: 9.96998e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 5.87001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 9.52999e-06 [cse]: 1.945e-05 [replace_applicator]: 6.53e-06 [py_interpret_to_execute_after_opt_a]: 2.137e-05 [rewriter_after_opt_a]: 5.019e-05 [convert_after_rewriter]: 7.46001e-06 [order_py_execute_after_rewriter]: 5.54998e-06 [mutable_eliminate]: 0.00088658 [jit_opt_b]: 6.254e-05, [1] [Cycle 1]: 5.225e-05, [2] [frontend_op_eliminate]: 2.045e-05 [inline_after_opt_a]: 1.892e-05 [cconv]: 4.282e-05 [loop_unroll]: 0.00051947 [jit_opt_after_cconv]: 0.00020658, [1] [Cycle 1]: 0.00019918, [11] [c_1]: 2.41e-05 [parameter_eliminate]: 6.28998e-06 [updatestate_depend_eliminate]: 1.283e-05 [updatestate_assign_eliminate]: 3.69002e-06 [updatestate_loads_eliminate]: 3.45e-06 [cse]: 5.379e-05 [call_graph_tuple_transform]: 2.857e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 5.85002e-06 [remove_dup_value]: 0.00013105 [partial_unused_args_eliminate]: 3.06001e-06 [environ_conv]: 8.43999e-06 [add_recomputation]: 6.134e-05 [cse_after_recomputation]: 3.191e-05, [1] [Cycle 1]: 2.423e-05, [1] [cse]: 1.675e-05 [auto_monad_reorder]: 2.071e-05 [get_jit_bprop_graph]: 2.98e-06 [rewriter_after_jit_bprop_graph]: 9.89001e-06 [opt_after_jit_grad]: 0.0006145 [symbol_engine_optimizer]: 0.00010897, [1] [Cycle 1]: 0.00010201, [6] [build]: 5.32999e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.493e-05 [opt_reshape]: 5.42001e-06 [fold_const_symbol]: 4.076e-05 [renormalize]: 5.50004e-07 [validate]: 5.307e-05 Sums bootstrap : 0.000373s : 0.72% type_inference : 0.025036s : 48.54% event_method : 0.000023s : 0.04% auto_monad : 0.000074s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000058s : 0.11% rewriter_before_opt_a : 0.000094s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000082s : 0.16% jit_opt_a.loop_unroll : 0.000043s : 0.08% jit_opt_a.a_1 : 0.000817s : 1.58% jit_opt_a.with_stream_mark : 0.000043s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.021854s : 42.37% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.07% jit_opt_a.cse : 0.000064s : 0.12% jit_opt_a.replace_applicator : 0.000036s : 0.07% py_interpret_to_execute_after_opt_a : 0.000021s : 0.04% rewriter_after_opt_a : 0.000050s : 0.10% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000887s : 1.72% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000043s : 0.08% loop_unroll : 0.000519s : 1.01% jit_opt_after_cconv.c_1 : 0.000024s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000054s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000131s : 0.25% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000061s : 0.12% cse_after_recomputation.cse : 0.000017s : 0.03% auto_monad_reorder : 0.000021s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000614s : 1.19% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000041s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.10% Time group info: ------[substitution.] 0.000308 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.23% : 0.000007s : 3: substitution.graph_param_transform 86.27% : 0.000266s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000006s : 4: substitution.remove_not_recompute_node 2.37% : 0.000007s : 2: substitution.replace_old_param 4.36% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024951 2 94.34% : 0.023538s : 1: type_inference.infer 5.66% : 0.001413s : 1: type_inference.specialize ------[replace.] 0.000102 7 69.58% : 0.000071s : 5: replace.inline 30.42% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 7 95.56% : 0.000263s : 5: match.inline 4.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 747 1.41% : 0.000002s : 11: predicate.accumulaten_eliminater 1.29% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.96% : 0.000003s : 11: predicate.arithmetic_simplify 1.41% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000002s : 11: predicate.compare_switch_simplify 1.12% : 0.000002s : 11: predicate.depend_value_elim 0.96% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.34% : 0.000000s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_depend_swap 1.10% : 0.000002s : 11: predicate.environ_get_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.94% : 0.000008s : 24: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.76% : 0.000003s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 16: predicate.load_eliminater 1.82% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.62% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000002s : 11: predicate.minmaximum_grad 3.24% : 0.000005s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.08% : 0.000002s : 11: predicate.print_const_string_wrapper 1.72% : 0.000002s : 11: predicate.reduce_eliminate 1.39% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000003s : 19: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.24% : 0.000002s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 11: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.73% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.99% : 0.000011s : 59: predicate.switch_simplify 1.02% : 0.000001s : 11: predicate.tile_eliminate 1.06% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.96% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 11: predicate.value_based_eliminate 0.41% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001297 16 49.43% : 0.000641s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.84% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.73% : 0.000567s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079172 72 0.08% : 0.000065s : 1: add_recomputation 0.10% : 0.000077s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.51% : 0.000400s : 1: bootstrap 0.06% : 0.000046s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 34.58% : 0.027381s : 1: jit_opt_a 0.26% : 0.000209s : 1: jit_opt_after_cconv 0.08% : 0.000066s : 1: jit_opt_b 0.67% : 0.000533s : 1: loop_unroll 1.15% : 0.000907s : 1: mutable_eliminate 1.38% : 0.001092s : 26: opt.transform.jit_opt_a 0.08% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000031s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000065s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000628s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000060s : 1: py_interpret_to_execute 0.03% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000135s : 1: remove_dup_value 26.70% : 0.021143s : 1: renormalize.infer 0.88% : 0.000694s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000055s : 1: rewriter_after_opt_a 0.12% : 0.000097s : 1: rewriter_before_opt_a 0.14% : 0.000112s : 1: symbol_engine_optimizer 31.65% : 0.025057s : 1: type_inference TotalTime = 0.0658421, [30] [bootstrap]: 0.00049923 [type_inference]: 0.00825293 [event_method]: 2.355e-05 [auto_monad]: 7.668e-05 [graph_reusing]: 6.56999e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 6.402e-05 [rewriter_before_opt_a]: 8.564e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.0536189, [2] [Cycle 1]: 0.047755, [27] [switch_simplify]: 8.08e-05 [loop_unroll]: 3.392e-05 [a_1]: 0.00082384 [with_stream_mark]: 3.086e-05 [recompute_prepare]: 1.509e-05 [updatestate_depend_eliminate]: 4.73001e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 2.42001e-06 [specialize_transform]: 8.69e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 3.23e-06 [get_grad_eliminate_]: 6.46999e-06 [merge_forward]: 4.95001e-06 [cell_reuse_recompute_pass]: 4.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.06e-05 [j_node_and_user_rematch]: 1.086e-05 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 1.359e-05 [inline_without_move]: 6.46999e-06 [renormalize]: 0.0462043 [add_forward_monad_depend]: 2.353e-05 [auto_monad_grad]: 2.88998e-06 [auto_monad_eliminator]: 3.176e-05 [cse]: 5.402e-05 [replace_applicator]: 3.942e-05 [Cycle 2]: 0.00058263, [27] [switch_simplify]: 1.159e-05 [loop_unroll]: 7.06001e-06 [a_1]: 0.00014568 [with_stream_mark]: 2.168e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 3.96001e-06 [updatestate_loads_eliminate]: 3.46999e-06 [parameter_eliminate]: 2.38998e-06 [specialize_transform]: 7.61999e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 8.12e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 6.29999e-06 [cell_reuse_recompute_pass]: 7.66001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.442e-05 [j_node_and_user_rematch]: 1.105e-05 [meta_fg_expand]: 3.83001e-06 [replace_old_param]: 1.109e-05 [inline_without_move]: 6.93998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 4.01001e-06 [auto_monad_grad]: 1.17999e-06 [auto_monad_eliminator]: 7.521e-05 [cse]: 2.371e-05 [replace_applicator]: 1.068e-05 [py_interpret_to_execute_after_opt_a]: 2.897e-05 [rewriter_after_opt_a]: 5.257e-05 [convert_after_rewriter]: 9.49999e-06 [order_py_execute_after_rewriter]: 5.60001e-06 [mutable_eliminate]: 0.0011375 [jit_opt_b]: 6.782e-05, [1] [Cycle 1]: 5.736e-05, [2] [frontend_op_eliminate]: 2.167e-05 [inline_after_opt_a]: 2.031e-05 [cconv]: 4.202e-05 [loop_unroll]: 0.00054966 [jit_opt_after_cconv]: 0.00022511, [1] [Cycle 1]: 0.00021686, [11] [c_1]: 2.504e-05 [parameter_eliminate]: 5.08002e-06 [updatestate_depend_eliminate]: 9.94001e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 4.493e-05 [call_graph_tuple_transform]: 5.592e-05 [tuple_list_get_item_eliminator]: 6.32001e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 7.5e-06 [remove_dup_value]: 2.153e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 8.12e-06 [add_recomputation]: 6.227e-05 [cse_after_recomputation]: 2.908e-05, [1] [Cycle 1]: 2.248e-05, [1] [cse]: 1.461e-05 [auto_monad_reorder]: 1.848e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 1.076e-05 [opt_after_jit_grad]: 0.00054435 [symbol_engine_optimizer]: 8.447e-05, [1] [Cycle 1]: 7.678e-05, [6] [build]: 6.28e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.593e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 6.00005e-07 [validate]: 5.338e-05 Sums bootstrap : 0.000499s : 0.84% type_inference : 0.008253s : 13.82% event_method : 0.000024s : 0.04% auto_monad : 0.000077s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000064s : 0.11% rewriter_before_opt_a : 0.000086s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.15% jit_opt_a.loop_unroll : 0.000041s : 0.07% jit_opt_a.a_1 : 0.000970s : 1.62% jit_opt_a.with_stream_mark : 0.000053s : 0.09% jit_opt_a.recompute_prepare : 0.000023s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000016s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000011s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000012s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000025s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.046204s : 77.39% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000107s : 0.18% jit_opt_a.cse : 0.000078s : 0.13% jit_opt_a.replace_applicator : 0.000050s : 0.08% py_interpret_to_execute_after_opt_a : 0.000029s : 0.05% rewriter_after_opt_a : 0.000053s : 0.09% convert_after_rewriter : 0.000009s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.001138s : 1.91% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000042s : 0.07% loop_unroll : 0.000550s : 0.92% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000056s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000022s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000062s : 0.10% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.02% opt_after_jit_grad : 0.000544s : 0.91% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.09% Time group info: ------[substitution.] 0.000340 23 0.75% : 0.000003s : 2: substitution.elim_not_effective 0.49% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000008s : 3: substitution.graph_param_transform 84.85% : 0.000289s : 4: substitution.inline 1.64% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000007s : 4: substitution.remove_not_recompute_node 2.56% : 0.000009s : 2: substitution.replace_old_param 5.35% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008150 2 84.26% : 0.006867s : 1: type_inference.infer 15.74% : 0.001283s : 1: type_inference.specialize ------[replace.] 0.000112 6 62.79% : 0.000070s : 4: replace.inline 37.21% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000301 6 94.39% : 0.000284s : 4: match.inline 5.61% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000180 691 1.54% : 0.000003s : 10: predicate.accumulaten_eliminater 0.97% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 10: predicate.addn_check_dump 1.47% : 0.000003s : 10: predicate.addn_zero_filter 2.84% : 0.000005s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 0.88% : 0.000002s : 10: predicate.compare_switch_simplify 1.18% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 10: predicate.dict_get_item_eliminator 2.03% : 0.000004s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000001s : 3: predicate.elim_not_effective 0.33% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.84% : 0.000003s : 10: predicate.environ_add_const_eliminate 0.82% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 10: predicate.environ_get_depend_swap 0.99% : 0.000002s : 10: predicate.environ_get_eliminate 0.89% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 1.25% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.13% : 0.000009s : 22: predicate.inline 0.86% : 0.000002s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.51% : 0.000003s : 6: predicate.less_batch_normalization 1.56% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.36% : 0.000002s : 15: predicate.load_eliminater 2.05% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.63% : 0.000007s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 10: predicate.merge_addn 1.00% : 0.000002s : 10: predicate.minmaximum_grad 2.68% : 0.000005s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 1.81% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000002s : 10: predicate.print_const_string_wrapper 2.22% : 0.000004s : 10: predicate.reduce_eliminate 1.71% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000002s : 6: predicate.remove_not_recompute_node 1.86% : 0.000003s : 18: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 3: predicate.row_tensor_eliminate 1.06% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 6: predicate.special_op_eliminate 0.85% : 0.000002s : 6: predicate.specialize_transform 1.10% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.88% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000004s : 16: predicate.switch_defer_inline 1.88% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.14% : 0.000013s : 53: predicate.switch_simplify 1.52% : 0.000003s : 10: predicate.tile_eliminate 1.53% : 0.000003s : 10: predicate.transpose_eliminate 1.64% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 2.19% : 0.000004s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.22% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000003s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001204 13 46.78% : 0.000563s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.73% : 0.000069s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.50% : 0.000572s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113417 72 0.06% : 0.000066s : 1: add_recomputation 0.07% : 0.000080s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.47% : 0.000531s : 1: bootstrap 0.04% : 0.000045s : 1: cconv 0.01% : 0.000013s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 47.28% : 0.053626s : 1: jit_opt_a 0.20% : 0.000228s : 1: jit_opt_after_cconv 0.06% : 0.000071s : 1: jit_opt_b 0.49% : 0.000560s : 1: loop_unroll 1.02% : 0.001156s : 1: mutable_eliminate 1.14% : 0.001290s : 26: opt.transform.jit_opt_a 0.08% : 0.000091s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000027s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000067s : 1: py_interpret_to_execute 0.03% : 0.000032s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 39.93% : 0.045286s : 1: renormalize.infer 0.79% : 0.000891s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000057s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000088s : 1: symbol_engine_optimizer 7.30% : 0.008282s : 1: type_inference TotalTime = 0.696761, [30] [bootstrap]: 0.00036763 [type_inference]: 0.636964 [event_method]: 2.972e-05 [auto_monad]: 9.137e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 0.00071423 [rewriter_before_opt_a]: 0.00014859 [expand_dump_flag]: 4.77e-06 [jit_opt_a]: 0.054403, [2] [Cycle 1]: 0.0484681, [27] [switch_simplify]: 0.00012118 [loop_unroll]: 3.201e-05 [a_1]: 0.0412311 [with_stream_mark]: 3.745e-05 [recompute_prepare]: 2.17e-05 [updatestate_depend_eliminate]: 7.3e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 3.68999e-06 [parameter_eliminate]: 3.43e-06 [specialize_transform]: 1.416e-05 [updatestate_useless_node_eliminater]: 1.11e-05 [accelerated_algorithm]: 1.162e-05 [meta_shard_fg_expand]: 6.81999e-06 [get_grad_eliminate_]: 9.96e-06 [merge_forward]: 6.28002e-06 [cell_reuse_recompute_pass]: 5.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.094e-05 [j_node_and_user_rematch]: 1.535e-05 [meta_fg_expand]: 6.30002e-06 [replace_old_param]: 1.738e-05 [inline_without_move]: 1.04e-05 [renormalize]: 0.00642817 [add_forward_monad_depend]: 1.387e-05 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.9e-05 [cse]: 4.999e-05 [replace_applicator]: 3.148e-05 [Cycle 2]: 0.00079371, [27] [switch_simplify]: 9.37001e-06 [loop_unroll]: 8.17e-06 [a_1]: 0.00014555 [with_stream_mark]: 2.178e-05 [recompute_prepare]: 9.41e-06 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.63e-06 [parameter_eliminate]: 2.71e-06 [specialize_transform]: 7.31999e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 6.83998e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 4.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.411e-05 [j_node_and_user_rematch]: 1.355e-05 [meta_fg_expand]: 3.51999e-06 [replace_old_param]: 0.00022887 [inline_without_move]: 1.269e-05 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 4.12e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 1.899e-05 [cse]: 3.215e-05 [replace_applicator]: 7.66999e-06 [py_interpret_to_execute_after_opt_a]: 2.575e-05 [rewriter_after_opt_a]: 5.454e-05 [convert_after_rewriter]: 8.33999e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00103079 [jit_opt_b]: 7.37e-05, [1] [Cycle 1]: 6.312e-05, [2] [frontend_op_eliminate]: 2.533e-05 [inline_after_opt_a]: 2.438e-05 [cconv]: 4.029e-05 [loop_unroll]: 0.00053656 [jit_opt_after_cconv]: 0.00022419, [1] [Cycle 1]: 0.00021745, [11] [c_1]: 2.977e-05 [parameter_eliminate]: 6.02001e-06 [updatestate_depend_eliminate]: 1.006e-05 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 4.537e-05 [call_graph_tuple_transform]: 3.01e-05 [tuple_list_get_item_eliminator]: 7.55e-06 [none_parameter_eliminate]: 1.92999e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 9.12001e-06 [remove_dup_value]: 2.522e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 1.415e-05 [add_recomputation]: 7.133e-05 [cse_after_recomputation]: 0.00047449, [1] [Cycle 1]: 2.582e-05, [1] [cse]: 1.801e-05 [auto_monad_reorder]: 2.385e-05 [get_jit_bprop_graph]: 3.26999e-06 [rewriter_after_jit_bprop_graph]: 1.204e-05 [opt_after_jit_grad]: 0.00088397 [symbol_engine_optimizer]: 0.00010873, [1] [Cycle 1]: 9.826e-05, [6] [build]: 8.65001e-06 [elim_shapecalc]: 1.074e-05 [elim_not_effective]: 2.315e-05 [opt_reshape]: 8.99998e-06 [fold_const_symbol]: 1.14e-05 [renormalize]: 1.20001e-06 [validate]: 8.042e-05 Sums bootstrap : 0.000368s : 0.05% type_inference : 0.636964s : 92.29% event_method : 0.000030s : 0.00% auto_monad : 0.000091s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000714s : 0.10% rewriter_before_opt_a : 0.000149s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000131s : 0.02% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.041377s : 6.00% jit_opt_a.with_stream_mark : 0.000059s : 0.01% jit_opt_a.recompute_prepare : 0.000031s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000021s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.00% jit_opt_a.accelerated_algorithm : 0.000018s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000010s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000029s : 0.00% jit_opt_a.meta_fg_expand : 0.000010s : 0.00% jit_opt_a.replace_old_param : 0.000246s : 0.04% jit_opt_a.inline_without_move : 0.000023s : 0.00% jit_opt_a.renormalize : 0.006428s : 0.93% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000048s : 0.01% jit_opt_a.cse : 0.000082s : 0.01% jit_opt_a.replace_applicator : 0.000039s : 0.01% py_interpret_to_execute_after_opt_a : 0.000026s : 0.00% rewriter_after_opt_a : 0.000055s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001031s : 0.15% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.00% jit_opt_b.inline_after_opt_a : 0.000024s : 0.00% cconv : 0.000040s : 0.01% loop_unroll : 0.000537s : 0.08% jit_opt_after_cconv.c_1 : 0.000030s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000025s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000071s : 0.01% cse_after_recomputation.cse : 0.000018s : 0.00% auto_monad_reorder : 0.000024s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.00% opt_after_jit_grad : 0.000884s : 0.13% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000080s : 0.01% Time group info: ------[substitution.] 0.040574 24 0.01% : 0.000003s : 2: substitution.elim_not_effective 0.00% : 0.000002s : 2: substitution.fold_const_symbol 0.02% : 0.000008s : 4: substitution.graph_param_transform 99.85% : 0.040512s : 4: substitution.inline 0.02% : 0.000007s : 4: substitution.j_node_and_user_rematch 0.02% : 0.000007s : 4: substitution.remove_not_recompute_node 0.03% : 0.000011s : 2: substitution.replace_old_param 0.06% : 0.000025s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.636814 2 94.01% : 0.598639s : 1: type_inference.infer 5.99% : 0.038175s : 1: type_inference.specialize ------[replace.] 0.000211 6 65.97% : 0.000139s : 4: replace.inline 34.03% : 0.000072s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.040529 6 99.94% : 0.040506s : 4: match.inline 0.06% : 0.000023s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000196 830 1.35% : 0.000003s : 12: predicate.accumulaten_eliminater 1.63% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.44% : 0.000003s : 12: predicate.addn_zero_filter 2.56% : 0.000005s : 12: predicate.arithmetic_simplify 1.82% : 0.000004s : 12: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.52% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.98% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.88% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.94% : 0.000002s : 12: predicate.environ_get_depend_swap 1.85% : 0.000004s : 12: predicate.environ_get_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000010s : 26: predicate.inline 1.41% : 0.000003s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.79% : 0.000004s : 8: predicate.less_batch_normalization 1.95% : 0.000004s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.84% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 12: predicate.merge_addn 0.97% : 0.000002s : 12: predicate.minmaximum_grad 1.62% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 1.77% : 0.000003s : 18: predicate.partial_eliminate 1.50% : 0.000003s : 12: predicate.print_const_string_wrapper 2.59% : 0.000005s : 12: predicate.reduce_eliminate 1.74% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.60% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000002s : 8: predicate.replace_old_param 0.28% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.08% : 0.000002s : 4: predicate.row_tensor_eliminate 1.29% : 0.000003s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 1.37% : 0.000003s : 8: predicate.specialize_transform 1.77% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.69% : 0.000005s : 18: predicate.switch_defer_inline 1.72% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.00% : 0.000012s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.36% : 0.000003s : 12: predicate.transpose_eliminate 1.60% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 2.21% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.12% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.25% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.42% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.044124 22 4.95% : 0.002185s : 15: func_graph_cloner_run.FuncGraphClonerGraph 91.28% : 0.040276s : 1: func_graph_cloner_run.FuncGraphClonerNode 3.77% : 0.001663s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.745155 72 0.01% : 0.000075s : 1: add_recomputation 0.01% : 0.000096s : 1: auto_monad 0.00% : 0.000029s : 1: auto_monad_reorder 0.05% : 0.000389s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.06% : 0.000477s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000038s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.30% : 0.054408s : 1: jit_opt_a 0.03% : 0.000227s : 1: jit_opt_after_cconv 0.01% : 0.000077s : 1: jit_opt_b 0.07% : 0.000546s : 1: loop_unroll 0.14% : 0.001050s : 1: mutable_eliminate 5.63% : 0.041949s : 26: opt.transform.jit_opt_a 0.01% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000041s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000028s : 1: opt.transform.mutable_eliminate 0.01% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000901s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000723s : 1: py_interpret_to_execute 0.00% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000028s : 1: remove_dup_value 0.63% : 0.004682s : 1: renormalize.infer 0.23% : 0.001722s : 1: renormalize.specialize 0.00% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000059s : 1: rewriter_after_opt_a 0.02% : 0.000158s : 1: rewriter_before_opt_a 0.02% : 0.000112s : 1: symbol_engine_optimizer 85.49% : 0.637001s : 1: type_inference TotalTime = 0.526849, [30] [bootstrap]: 0.00032879 [type_inference]: 0.490994 [event_method]: 2.539e-05 [auto_monad]: 8.338e-05 [graph_reusing]: 6.83e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00055276 [rewriter_before_opt_a]: 9.501e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.0319177, [2] [Cycle 1]: 0.00869227, [27] [switch_simplify]: 8.837e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00067999 [with_stream_mark]: 2.509e-05 [recompute_prepare]: 1.117e-05 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.67002e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.92002e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.89e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.793e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.117e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00739605 [add_forward_monad_depend]: 1.221e-05 [auto_monad_grad]: 3.01001e-06 [auto_monad_eliminator]: 2.71e-05 [cse]: 3.907e-05 [replace_applicator]: 2.92e-05 [Cycle 2]: 0.00041966, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.31998e-06 [a_1]: 0.0001324 [with_stream_mark]: 1.835e-05 [recompute_prepare]: 6.64001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 4.1e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.959e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.241e-05 [inline_without_move]: 5.51998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.76e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 8.23001e-06 [cse]: 1.464e-05 [replace_applicator]: 6.57002e-06 [py_interpret_to_execute_after_opt_a]: 2.041e-05 [rewriter_after_opt_a]: 4.342e-05 [convert_after_rewriter]: 8.95999e-06 [order_py_execute_after_rewriter]: 6.59999e-06 [mutable_eliminate]: 0.00090359 [jit_opt_b]: 5.955e-05, [1] [Cycle 1]: 5.042e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.953e-05 [cconv]: 3.823e-05 [loop_unroll]: 0.00046771 [jit_opt_after_cconv]: 0.00018372, [1] [Cycle 1]: 0.00017642, [11] [c_1]: 2.545e-05 [parameter_eliminate]: 6.32001e-06 [updatestate_depend_eliminate]: 9.97001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 3.21999e-06 [cse]: 3.458e-05 [call_graph_tuple_transform]: 2.687e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 1.14998e-06 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.869e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 9.79999e-06 [add_recomputation]: 5.846e-05 [cse_after_recomputation]: 2.416e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.568e-05 [get_jit_bprop_graph]: 2.63998e-06 [rewriter_after_jit_bprop_graph]: 8.69e-06 [opt_after_jit_grad]: 0.00051278 [symbol_engine_optimizer]: 7.942e-05, [1] [Cycle 1]: 7.199e-05, [6] [build]: 4.90001e-06 [elim_shapecalc]: 8.34998e-06 [elim_not_effective]: 1.528e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 5.8001e-07 [validate]: 0.00015364 Sums bootstrap : 0.000329s : 0.07% type_inference : 0.490994s : 97.55% event_method : 0.000025s : 0.01% auto_monad : 0.000083s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000553s : 0.11% rewriter_before_opt_a : 0.000095s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000095s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000812s : 0.16% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.007396s : 1.47% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.01% jit_opt_a.cse : 0.000054s : 0.01% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.000904s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000038s : 0.01% loop_unroll : 0.000468s : 0.09% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000058s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000513s : 0.10% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000154s : 0.03% Time group info: ------[substitution.] 0.000290 24 0.90% : 0.000003s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000007s : 4: substitution.graph_param_transform 84.05% : 0.000244s : 4: substitution.inline 1.90% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000007s : 4: substitution.remove_not_recompute_node 3.20% : 0.000009s : 2: substitution.replace_old_param 4.76% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.490874 2 96.54% : 0.473876s : 1: type_inference.infer 3.46% : 0.016998s : 1: type_inference.specialize ------[replace.] 0.000087 6 68.68% : 0.000060s : 4: replace.inline 31.32% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 6 95.00% : 0.000241s : 4: match.inline 5.00% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 12: predicate.addn_check_dump 1.61% : 0.000003s : 12: predicate.addn_zero_filter 1.82% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 0.99% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_depend_swap 1.45% : 0.000002s : 12: predicate.environ_get_eliminate 0.91% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.07% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.84% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.47% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.92% : 0.000001s : 12: predicate.merge_addn 0.96% : 0.000001s : 12: predicate.minmaximum_grad 2.37% : 0.000004s : 4: predicate.mutable_eliminate 0.36% : 0.000001s : 4: predicate.opt_reshape 2.02% : 0.000003s : 18: predicate.partial_eliminate 1.00% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000003s : 12: predicate.reduce_eliminate 1.22% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000004s : 18: predicate.switch_defer_inline 1.81% : 0.000003s : 18: predicate.switch_layer_defer_inline 12.19% : 0.000019s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.12% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.54% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.020010 22 95.19% : 0.019048s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.26% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 4.55% : 0.000911s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.535313 72 0.01% : 0.000062s : 1: add_recomputation 0.02% : 0.000087s : 1: auto_monad 0.00% : 0.000018s : 1: auto_monad_reorder 0.07% : 0.000349s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.00% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 5.96% : 0.031922s : 1: jit_opt_a 0.03% : 0.000187s : 1: jit_opt_after_cconv 0.01% : 0.000062s : 1: jit_opt_b 0.09% : 0.000477s : 1: loop_unroll 0.17% : 0.000922s : 1: mutable_eliminate 0.21% : 0.001107s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000523s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000562s : 1: py_interpret_to_execute 0.00% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 1.18% : 0.006324s : 1: renormalize.infer 0.20% : 0.001057s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.02% : 0.000099s : 1: rewriter_before_opt_a 0.02% : 0.000082s : 1: symbol_engine_optimizer 91.73% : 0.491016s : 1: type_inference TotalTime = 0.132253, [30] [bootstrap]: 0.00033183 [type_inference]: 0.118999 [event_method]: 1.959e-05 [auto_monad]: 7.316e-05 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 9.612e-05 [rewriter_before_opt_a]: 8.248e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00985196, [2] [Cycle 1]: 0.00216945, [27] [switch_simplify]: 7.544e-05 [loop_unroll]: 2.898e-05 [a_1]: 0.00063968 [with_stream_mark]: 2.437e-05 [recompute_prepare]: 8.88002e-06 [updatestate_depend_eliminate]: 4.27998e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.60001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00101782 [add_forward_monad_depend]: 6.98998e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.873e-05 [cse]: 3.648e-05 [replace_applicator]: 1.69e-05 [Cycle 2]: 0.00033688, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 4.95999e-06 [a_1]: 9.132e-05 [with_stream_mark]: 1.234e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.53999e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.72e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.11997e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 1.01002e-06 [auto_monad_eliminator]: 7.16001e-06 [cse]: 1.205e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.569e-05 [rewriter_after_opt_a]: 4.566e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 5.74e-06 [mutable_eliminate]: 0.00089301 [jit_opt_b]: 5.734e-05, [1] [Cycle 1]: 4.726e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.805e-05 [cconv]: 3.804e-05 [loop_unroll]: 0.00051047 [jit_opt_after_cconv]: 0.00018035, [1] [Cycle 1]: 0.00017277, [11] [c_1]: 2.096e-05 [parameter_eliminate]: 5.82001e-06 [updatestate_depend_eliminate]: 1.082e-05 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [cse]: 4.102e-05 [call_graph_tuple_transform]: 2.411e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 2.06e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.39998e-06 [remove_dup_value]: 1.7e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.86001e-06 [add_recomputation]: 6.263e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.885e-05, [1] [cse]: 1.277e-05 [auto_monad_reorder]: 1.889e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 8.94e-06 [opt_after_jit_grad]: 0.00052489 [symbol_engine_optimizer]: 7.859e-05, [1] [Cycle 1]: 7.152e-05, [6] [build]: 5.96e-06 [elim_shapecalc]: 7.56999e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 8.74e-06 [renormalize]: 6.19999e-07 [validate]: 5.782e-05 Sums bootstrap : 0.000332s : 0.27% type_inference : 0.118999s : 95.78% event_method : 0.000020s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000096s : 0.08% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.07% jit_opt_a.loop_unroll : 0.000034s : 0.03% jit_opt_a.a_1 : 0.000731s : 0.59% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001018s : 0.82% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000893s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000038s : 0.03% loop_unroll : 0.000510s : 0.41% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000063s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000525s : 0.42% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.05% Time group info: ------[substitution.] 0.000291 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000007s : 3: substitution.graph_param_transform 85.93% : 0.000250s : 4: substitution.inline 1.63% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 2.45% : 0.000007s : 2: substitution.replace_old_param 4.86% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118919 2 98.82% : 0.117512s : 1: type_inference.infer 1.18% : 0.001408s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.27% : 0.000053s : 4: replace.inline 30.73% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 6 94.99% : 0.000248s : 4: match.inline 5.01% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.29% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.75% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.66% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.07% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.84% : 0.000009s : 22: predicate.inline 1.10% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 2.31% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.68% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.45% : 0.000003s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.00% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 10: predicate.same_eliminate 0.68% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 1.87% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.60% : 0.000011s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.54% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000903 13 52.48% : 0.000474s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.69% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.83% : 0.000369s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134283 72 0.05% : 0.000067s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.27% : 0.000357s : 1: bootstrap 0.03% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.34% : 0.009856s : 1: jit_opt_a 0.14% : 0.000183s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.39% : 0.000523s : 1: loop_unroll 0.68% : 0.000908s : 1: mutable_eliminate 0.73% : 0.000977s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000537s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000099s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.45% : 0.000603s : 1: renormalize.infer 0.30% : 0.000406s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.06% : 0.000086s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 88.63% : 0.119018s : 1: type_inference TotalTime = 0.602904, [30] [bootstrap]: 0.0003157 [type_inference]: 0.483918 [event_method]: 3.163e-05 [auto_monad]: 8.86e-05 [graph_reusing]: 7.98999e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.00056078 [rewriter_before_opt_a]: 0.00012613 [expand_dump_flag]: 4.67e-06 [jit_opt_a]: 0.114827, [2] [Cycle 1]: 0.110253, [27] [switch_simplify]: 8.054e-05 [loop_unroll]: 3.758e-05 [a_1]: 0.00084713 [with_stream_mark]: 2.581e-05 [recompute_prepare]: 1.027e-05 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 2.38998e-06 [specialize_transform]: 8.64998e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 4.81002e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.171e-05 [inline_without_move]: 7.05e-06 [renormalize]: 0.108805 [add_forward_monad_depend]: 1.165e-05 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 2.163e-05 [cse]: 4.085e-05 [replace_applicator]: 2.58e-05 [Cycle 2]: 0.00041767, [27] [switch_simplify]: 7.89002e-06 [loop_unroll]: 8.07e-06 [a_1]: 0.00013131 [with_stream_mark]: 1.63e-05 [recompute_prepare]: 6.98e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 5.14e-06 [cell_reuse_recompute_pass]: 3.01001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.943e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.165e-05 [inline_without_move]: 6.01998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.54998e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.74999e-06 [cse]: 1.738e-05 [replace_applicator]: 7.80998e-06 [py_interpret_to_execute_after_opt_a]: 1.484e-05 [rewriter_after_opt_a]: 4.419e-05 [convert_after_rewriter]: 7.62002e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00084404 [jit_opt_b]: 6.384e-05, [1] [Cycle 1]: 5.488e-05, [2] [frontend_op_eliminate]: 2.196e-05 [inline_after_opt_a]: 2.056e-05 [cconv]: 3.741e-05 [loop_unroll]: 0.00052439 [jit_opt_after_cconv]: 0.00019492, [1] [Cycle 1]: 0.00018753, [11] [c_1]: 2.707e-05 [parameter_eliminate]: 5.81003e-06 [updatestate_depend_eliminate]: 1.071e-05 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 4.155e-05 [call_graph_tuple_transform]: 2.828e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 1.01997e-06 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.987e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 1.189e-05 [add_recomputation]: 5.782e-05 [cse_after_recomputation]: 3.009e-05, [1] [Cycle 1]: 2.281e-05, [1] [cse]: 1.638e-05 [auto_monad_reorder]: 2.094e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.47001e-06 [opt_after_jit_grad]: 0.0005289 [symbol_engine_optimizer]: 9.593e-05, [1] [Cycle 1]: 8.852e-05, [6] [build]: 5.04998e-06 [elim_shapecalc]: 1.33e-05 [elim_not_effective]: 1.61e-05 [opt_reshape]: 7.36001e-06 [fold_const_symbol]: 1.043e-05 [renormalize]: 2.79979e-07 [validate]: 0.00018566 Sums bootstrap : 0.000316s : 0.05% type_inference : 0.483918s : 80.93% event_method : 0.000032s : 0.01% auto_monad : 0.000089s : 0.01% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000561s : 0.09% rewriter_before_opt_a : 0.000126s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.01% jit_opt_a.loop_unroll : 0.000046s : 0.01% jit_opt_a.a_1 : 0.000978s : 0.16% jit_opt_a.with_stream_mark : 0.000042s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.108805s : 18.20% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.00% jit_opt_a.cse : 0.000058s : 0.01% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000844s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.00% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000037s : 0.01% loop_unroll : 0.000524s : 0.09% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000058s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000529s : 0.09% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000186s : 0.03% Time group info: ------[substitution.] 0.000359 25 0.73% : 0.000003s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 4: substitution.graph_param_transform 88.57% : 0.000318s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.57% : 0.000006s : 4: substitution.remove_not_recompute_node 2.08% : 0.000007s : 2: substitution.replace_old_param 3.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.483804 2 99.25% : 0.480199s : 1: type_inference.infer 0.75% : 0.003605s : 1: type_inference.specialize ------[replace.] 0.000135 7 67.25% : 0.000091s : 5: replace.inline 32.75% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000327 7 96.49% : 0.000315s : 5: match.inline 3.51% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.13% : 0.000002s : 13: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.82% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.60% : 0.000009s : 28: predicate.inline 1.19% : 0.000002s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.23% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 0.98% : 0.000002s : 13: predicate.minmaximum_grad 2.38% : 0.000004s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.80% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.21% : 0.000005s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.90% : 0.000011s : 64: predicate.switch_simplify 1.16% : 0.000002s : 13: predicate.tile_eliminate 1.13% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.52% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003246 25 62.03% : 0.002014s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.12% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.84% : 0.001131s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.608175 72 0.01% : 0.000061s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000024s : 1: auto_monad_reorder 0.06% : 0.000336s : 1: bootstrap 0.01% : 0.000040s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 18.88% : 0.114830s : 1: jit_opt_a 0.03% : 0.000198s : 1: jit_opt_after_cconv 0.01% : 0.000067s : 1: jit_opt_b 0.09% : 0.000534s : 1: loop_unroll 0.14% : 0.000860s : 1: mutable_eliminate 0.21% : 0.001273s : 26: opt.transform.jit_opt_a 0.01% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000027s : 1: opt.transform.mutable_eliminate 0.00% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000628s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000571s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000023s : 1: remove_dup_value 0.48% : 0.002935s : 1: renormalize.infer 0.18% : 0.001100s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.02% : 0.000134s : 1: rewriter_before_opt_a 0.02% : 0.000099s : 1: symbol_engine_optimizer 79.57% : 0.483950s : 1: type_inference TotalTime = 0.217455, [30] [bootstrap]: 0.00069038 [type_inference]: 0.201762 [event_method]: 2.932e-05 [auto_monad]: 0.00010066 [graph_reusing]: 7.08998e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00074429 [rewriter_before_opt_a]: 0.00013801 [expand_dump_flag]: 4.97e-06 [jit_opt_a]: 0.0106515, [2] [Cycle 1]: 0.00434818, [27] [switch_simplify]: 8.794e-05 [loop_unroll]: 3.291e-05 [a_1]: 0.0008057 [with_stream_mark]: 2.924e-05 [recompute_prepare]: 1.068e-05 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 3.71001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 7.68001e-06 [accelerated_algorithm]: 7.21999e-06 [meta_shard_fg_expand]: 3.23998e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.822e-05 [j_node_and_user_rematch]: 1.139e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.32e-05 [inline_without_move]: 7.69002e-06 [renormalize]: 0.00293372 [add_forward_monad_depend]: 1.106e-05 [auto_monad_grad]: 2.73998e-06 [auto_monad_eliminator]: 2.319e-05 [cse]: 4.455e-05 [replace_applicator]: 2.798e-05 [Cycle 2]: 0.00052923, [27] [switch_simplify]: 8.60999e-06 [loop_unroll]: 6.76e-06 [a_1]: 0.00014495 [with_stream_mark]: 1.856e-05 [recompute_prepare]: 7.40998e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 8.03999e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 7e-06 [merge_forward]: 4.99e-06 [cell_reuse_recompute_pass]: 3.47002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.373e-05 [j_node_and_user_rematch]: 1.117e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.108e-05 [inline_without_move]: 6.29999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.51e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 8.69e-06 [cse]: 8.871e-05 [replace_applicator]: 9.66e-06 [py_interpret_to_execute_after_opt_a]: 2.475e-05 [rewriter_after_opt_a]: 5.419e-05 [convert_after_rewriter]: 8.54998e-06 [order_py_execute_after_rewriter]: 6.21998e-06 [mutable_eliminate]: 0.0010224 [jit_opt_b]: 7.378e-05, [1] [Cycle 1]: 6.292e-05, [2] [frontend_op_eliminate]: 2.471e-05 [inline_after_opt_a]: 2.385e-05 [cconv]: 4.444e-05 [loop_unroll]: 0.00059617 [jit_opt_after_cconv]: 0.00022924, [1] [Cycle 1]: 0.00021956, [11] [c_1]: 3.096e-05 [parameter_eliminate]: 6.39999e-06 [updatestate_depend_eliminate]: 1.113e-05 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.35998e-06 [cse]: 5.601e-05 [call_graph_tuple_transform]: 3.017e-05 [tuple_list_get_item_eliminator]: 7.68001e-06 [none_parameter_eliminate]: 1.83002e-06 [renormalize]: 1.37999e-06 [switch_simplify]: 7.55e-06 [remove_dup_value]: 2.261e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 1.082e-05 [add_recomputation]: 6.284e-05 [cse_after_recomputation]: 3.125e-05, [1] [Cycle 1]: 2.443e-05, [1] [cse]: 1.611e-05 [auto_monad_reorder]: 2.099e-05 [get_jit_bprop_graph]: 3.45e-06 [rewriter_after_jit_bprop_graph]: 1.021e-05 [opt_after_jit_grad]: 0.00067568 [symbol_engine_optimizer]: 9.935e-05, [1] [Cycle 1]: 9.162e-05, [6] [build]: 6.28002e-06 [elim_shapecalc]: 1.097e-05 [elim_not_effective]: 2.137e-05 [opt_reshape]: 9.24e-06 [fold_const_symbol]: 1.203e-05 [renormalize]: 1.04998e-06 [validate]: 5.666e-05 Sums bootstrap : 0.000690s : 0.33% type_inference : 0.201762s : 95.66% event_method : 0.000029s : 0.01% auto_monad : 0.000101s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000744s : 0.35% rewriter_before_opt_a : 0.000138s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000097s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.02% jit_opt_a.a_1 : 0.000951s : 0.45% jit_opt_a.with_stream_mark : 0.000048s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.002934s : 1.39% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000133s : 0.06% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000025s : 0.01% rewriter_after_opt_a : 0.000054s : 0.03% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001022s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000044s : 0.02% loop_unroll : 0.000596s : 0.28% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000056s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000063s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000676s : 0.32% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.03% TotalTime = 0.0932687, [30] [bootstrap]: 0.000281 [type_inference]: 0.082938 [event_method]: 2.341e-05 [auto_monad]: 7.782e-05 [graph_reusing]: 7.73001e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00010416 [rewriter_before_opt_a]: 8.531e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00739365, [2] [Cycle 1]: 0.00209089, [27] [switch_simplify]: 6.644e-05 [loop_unroll]: 2.954e-05 [a_1]: 0.00061622 [with_stream_mark]: 2.602e-05 [recompute_prepare]: 7.93999e-06 [updatestate_depend_eliminate]: 4.74998e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.81998e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.1e-05 [inline_without_move]: 5.34e-06 [renormalize]: 0.0009821 [add_forward_monad_depend]: 5.92999e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.582e-05 [cse]: 4.103e-05 [replace_applicator]: 1.43e-05 [Cycle 2]: 0.0003198, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.03002e-06 [a_1]: 8.961e-05 [with_stream_mark]: 1.025e-05 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.11002e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.347e-05 [j_node_and_user_rematch]: 8.51002e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.47002e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.373e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.4e-05 [rewriter_after_opt_a]: 3.911e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00068713 [jit_opt_b]: 4.979e-05, [1] [Cycle 1]: 4.217e-05, [2] [frontend_op_eliminate]: 1.556e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 2.922e-05 [loop_unroll]: 0.00042281 [jit_opt_after_cconv]: 0.00014891, [1] [Cycle 1]: 0.00014305, [11] [c_1]: 1.964e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.844e-05 [call_graph_tuple_transform]: 1.981e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.29998e-06 [remove_dup_value]: 1.711e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.68e-06 [add_recomputation]: 5.591e-05 [cse_after_recomputation]: 2.407e-05, [1] [Cycle 1]: 1.882e-05, [1] [cse]: 1.299e-05 [auto_monad_reorder]: 1.812e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.38998e-06 [opt_after_jit_grad]: 0.00048021 [symbol_engine_optimizer]: 7.49e-05, [1] [Cycle 1]: 6.856e-05, [6] [build]: 5.14e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.358e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 8.72e-06 [renormalize]: 3.30008e-07 [validate]: 4.598e-05 Sums bootstrap : 0.000281s : 0.32% type_inference : 0.082938s : 94.62% event_method : 0.000023s : 0.03% auto_monad : 0.000078s : 0.09% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000104s : 0.12% rewriter_before_opt_a : 0.000085s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000706s : 0.81% jit_opt_a.with_stream_mark : 0.000036s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000982s : 1.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000055s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000687s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000423s : 0.48% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000480s : 0.55% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.05% Time group info: ------[substitution.] 0.000275 23 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 3: substitution.graph_param_transform 86.27% : 0.000237s : 4: substitution.inline 1.64% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 4.90% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.082845 2 98.22% : 0.081373s : 1: type_inference.infer 1.78% : 0.001472s : 1: type_inference.specialize ------[replace.] 0.000077 6 70.21% : 0.000054s : 4: replace.inline 29.79% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 6 94.98% : 0.000235s : 4: match.inline 5.02% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.67% : 0.000001s : 3: predicate.graph_param_transform 5.87% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 2.05% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.15% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000823 13 46.96% : 0.000387s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.69% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.36% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.095221 72 0.06% : 0.000059s : 1: add_recomputation 0.09% : 0.000082s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.32% : 0.000303s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.77% : 0.007397s : 1: jit_opt_a 0.16% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000052s : 1: jit_opt_b 0.45% : 0.000430s : 1: loop_unroll 0.73% : 0.000697s : 1: mutable_eliminate 0.98% : 0.000934s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.52% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000108s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.62% : 0.000586s : 1: renormalize.infer 0.41% : 0.000387s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000077s : 1: symbol_engine_optimizer 87.13% : 0.082971s : 1: type_inference Time group info: ------[substitution.] 0.000332 24 1.03% : 0.000003s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000008s : 4: substitution.graph_param_transform 85.24% : 0.000283s : 4: substitution.inline 1.74% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000007s : 4: substitution.remove_not_recompute_node 2.34% : 0.000008s : 2: substitution.replace_old_param 4.52% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.201601 2 87.86% : 0.177118s : 1: type_inference.infer 12.14% : 0.024483s : 1: type_inference.specialize ------[replace.] 0.000161 6 45.83% : 0.000074s : 4: replace.inline 54.17% : 0.000087s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 6 95.31% : 0.000281s : 4: match.inline 4.69% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.18% : 0.000004s : 12: predicate.arithmetic_simplify 1.60% : 0.000003s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 0.86% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 0.91% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.61% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.19% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.86% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.86% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.18% : 0.000008s : 26: predicate.inline 0.95% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.69% : 0.000003s : 8: predicate.less_batch_normalization 1.71% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 18: predicate.load_eliminater 1.98% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.58% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.41% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.30% : 0.000002s : 12: predicate.merge_addn 0.88% : 0.000001s : 12: predicate.minmaximum_grad 3.26% : 0.000005s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 18: predicate.partial_eliminate 1.51% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000003s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.78% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.14% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.10% : 0.000002s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 0.77% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 18: predicate.switch_defer_inline 1.66% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000012s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.57% : 0.000003s : 12: predicate.transpose_eliminate 1.19% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.21% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.38% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.10% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002687 18 61.29% : 0.001647s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.28% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.42% : 0.000979s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.221750 72 0.03% : 0.000066s : 1: add_recomputation 0.05% : 0.000106s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.32% : 0.000717s : 1: bootstrap 0.02% : 0.000047s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.81% : 0.010657s : 1: jit_opt_a 0.10% : 0.000232s : 1: jit_opt_after_cconv 0.03% : 0.000077s : 1: jit_opt_b 0.27% : 0.000609s : 1: loop_unroll 0.47% : 0.001043s : 1: mutable_eliminate 0.57% : 0.001262s : 26: opt.transform.jit_opt_a 0.03% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000031s : 1: opt.transform.mutable_eliminate 0.02% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000688s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000755s : 1: py_interpret_to_execute 0.01% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 0.88% : 0.001953s : 1: renormalize.infer 0.44% : 0.000967s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000058s : 1: rewriter_after_opt_a 0.07% : 0.000146s : 1: rewriter_before_opt_a 0.05% : 0.000102s : 1: symbol_engine_optimizer 91.00% : 0.201794s : 1: type_inference TotalTime = 0.325307, [30] [bootstrap]: 0.00033876 [type_inference]: 0.311366 [event_method]: 2.723e-05 [auto_monad]: 8.784e-05 [graph_reusing]: 6.86001e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00052589 [rewriter_before_opt_a]: 9.659e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.0100119, [2] [Cycle 1]: 0.00545785, [27] [switch_simplify]: 7.381e-05 [loop_unroll]: 3.11e-05 [a_1]: 0.00075837 [with_stream_mark]: 2.824e-05 [recompute_prepare]: 1.092e-05 [updatestate_depend_eliminate]: 4.66002e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 2.50002e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.55002e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.64001e-06 [merge_forward]: 4.27998e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.903e-05 [j_node_and_user_rematch]: 1.252e-05 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 1.206e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.0041026 [add_forward_monad_depend]: 1.3e-05 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.763e-05 [cse]: 4.327e-05 [replace_applicator]: 2.827e-05 [Cycle 2]: 0.0004092, [27] [switch_simplify]: 7.25003e-06 [loop_unroll]: 6.22001e-06 [a_1]: 0.00012998 [with_stream_mark]: 1.868e-05 [recompute_prepare]: 6.27001e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 4.37998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.096e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 5.39998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.51998e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 8.62998e-06 [cse]: 1.241e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 2.078e-05 [rewriter_after_opt_a]: 4.248e-05 [convert_after_rewriter]: 7.9e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00082789 [jit_opt_b]: 6.128e-05, [1] [Cycle 1]: 5.241e-05, [2] [frontend_op_eliminate]: 2.107e-05 [inline_after_opt_a]: 2.031e-05 [cconv]: 3.511e-05 [loop_unroll]: 0.00047576 [jit_opt_after_cconv]: 0.0001824, [1] [Cycle 1]: 0.00017566, [11] [c_1]: 2.655e-05 [parameter_eliminate]: 5.91998e-06 [updatestate_depend_eliminate]: 9.96e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.442e-05 [call_graph_tuple_transform]: 2.398e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.76003e-06 [renormalize]: 1.02e-06 [switch_simplify]: 6.59001e-06 [remove_dup_value]: 1.982e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.089e-05 [add_recomputation]: 6.327e-05 [cse_after_recomputation]: 2.681e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.2e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 7.89002e-06 [opt_after_jit_grad]: 0.00050995 [symbol_engine_optimizer]: 0.00021495, [1] [Cycle 1]: 0.00020747, [6] [build]: 5.62001e-06 [elim_shapecalc]: 1.359e-05 [elim_not_effective]: 0.00013597 [opt_reshape]: 7.53e-06 [fold_const_symbol]: 1.201e-05 [renormalize]: 8.29983e-07 [validate]: 6.177e-05 Sums bootstrap : 0.000339s : 0.11% type_inference : 0.311366s : 97.17% event_method : 0.000027s : 0.01% auto_monad : 0.000088s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000526s : 0.16% rewriter_before_opt_a : 0.000097s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000888s : 0.28% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004103s : 1.28% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000828s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000035s : 0.01% loop_unroll : 0.000476s : 0.15% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000063s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000510s : 0.16% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000136s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.02% Time group info: ------[substitution.] 0.000297 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.32% : 0.000007s : 4: substitution.graph_param_transform 83.82% : 0.000249s : 4: substitution.inline 1.94% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000007s : 4: substitution.remove_not_recompute_node 2.83% : 0.000008s : 2: substitution.replace_old_param 5.41% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.311248 2 91.08% : 0.283469s : 1: type_inference.infer 8.92% : 0.027778s : 1: type_inference.specialize ------[replace.] 0.000092 6 66.77% : 0.000061s : 4: replace.inline 33.23% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 6 94.28% : 0.000246s : 4: match.inline 5.72% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.86% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 7.11% : 0.000010s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 18: predicate.load_eliminater 1.64% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.43% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 2.53% : 0.000004s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000003s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.94% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.61% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.06% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000011s : 58: predicate.switch_simplify 1.47% : 0.000002s : 12: predicate.tile_eliminate 1.08% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002910 22 64.86% : 0.001887s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.09% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.05% : 0.000962s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.330742 72 0.02% : 0.000067s : 1: add_recomputation 0.03% : 0.000091s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.11% : 0.000359s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.03% : 0.010017s : 1: jit_opt_a 0.06% : 0.000185s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.15% : 0.000484s : 1: loop_unroll 0.25% : 0.000841s : 1: mutable_eliminate 0.35% : 0.001170s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000165s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000520s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000536s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.90% : 0.002965s : 1: renormalize.infer 0.34% : 0.001119s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.03% : 0.000101s : 1: rewriter_before_opt_a 0.07% : 0.000218s : 1: symbol_engine_optimizer 94.15% : 0.311400s : 1: type_inference TotalTime = 0.071198, [30] [bootstrap]: 0.00050839 [type_inference]: 0.0553391 [event_method]: 0.00016616 [auto_monad]: 0.00016757 [graph_reusing]: 9.44998e-06 [pre_auto_parallel]: 4.36002e-06 [py_interpret_to_execute]: 5.383e-05 [rewriter_before_opt_a]: 0.00017002 [expand_dump_flag]: 4.14997e-06 [jit_opt_a]: 0.0112183, [2] [Cycle 1]: 0.00449351, [27] [switch_simplify]: 0.00023409 [loop_unroll]: 6.15e-05 [a_1]: 0.00149583 [with_stream_mark]: 2.675e-05 [recompute_prepare]: 1.326e-05 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 7.95e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 7.34002e-06 [meta_shard_fg_expand]: 3.35e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 4.85999e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.803e-05 [j_node_and_user_rematch]: 1.183e-05 [meta_fg_expand]: 3.18e-06 [replace_old_param]: 1.121e-05 [inline_without_move]: 7.18e-06 [renormalize]: 0.00218117 [add_forward_monad_depend]: 9.39e-06 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 2.267e-05 [cse]: 5.269e-05 [replace_applicator]: 3.206e-05 [Cycle 2]: 0.00043593, [27] [switch_simplify]: 9.37001e-06 [loop_unroll]: 8.1e-06 [a_1]: 0.00013655 [with_stream_mark]: 1.899e-05 [recompute_prepare]: 7.34002e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 4.54998e-06 [cell_reuse_recompute_pass]: 3.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.036e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.77999e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 8.35001e-06 [cse]: 1.769e-05 [replace_applicator]: 7.26001e-06 [py_interpret_to_execute_after_opt_a]: 2.158e-05 [rewriter_after_opt_a]: 5.57e-05 [convert_after_rewriter]: 8.02e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.001027 [jit_opt_b]: 7.063e-05, [1] [Cycle 1]: 5.827e-05, [2] [frontend_op_eliminate]: 2.216e-05 [inline_after_opt_a]: 2.095e-05 [cconv]: 3.363e-05 [loop_unroll]: 0.00058145 [jit_opt_after_cconv]: 0.00029467, [1] [Cycle 1]: 0.00028529, [11] [c_1]: 2.818e-05 [parameter_eliminate]: 5.52999e-06 [updatestate_depend_eliminate]: 1.109e-05 [updatestate_assign_eliminate]: 4.23999e-06 [updatestate_loads_eliminate]: 2.89001e-06 [cse]: 0.0001234 [call_graph_tuple_transform]: 3.165e-05 [tuple_list_get_item_eliminator]: 7.66999e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 1.015e-05 [remove_dup_value]: 5.643e-05 [partial_unused_args_eliminate]: 3.10998e-06 [environ_conv]: 8.70999e-06 [add_recomputation]: 0.00011537 [cse_after_recomputation]: 3.425e-05, [1] [Cycle 1]: 2.641e-05, [1] [cse]: 1.811e-05 [auto_monad_reorder]: 2e-05 [get_jit_bprop_graph]: 2.94999e-06 [rewriter_after_jit_bprop_graph]: 1.181e-05 [opt_after_jit_grad]: 0.00077331 [symbol_engine_optimizer]: 0.00010611, [1] [Cycle 1]: 9.56e-05, [6] [build]: 6.69001e-06 [elim_shapecalc]: 1.14e-05 [elim_not_effective]: 1.99e-05 [opt_reshape]: 9.33997e-06 [fold_const_symbol]: 1.287e-05 [renormalize]: 2.19996e-07 [validate]: 6.172e-05 Sums bootstrap : 0.000508s : 0.79% type_inference : 0.055339s : 86.32% event_method : 0.000166s : 0.26% auto_monad : 0.000168s : 0.26% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000054s : 0.08% rewriter_before_opt_a : 0.000170s : 0.27% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000243s : 0.38% jit_opt_a.loop_unroll : 0.000070s : 0.11% jit_opt_a.a_1 : 0.001632s : 2.55% jit_opt_a.with_stream_mark : 0.000046s : 0.07% jit_opt_a.recompute_prepare : 0.000021s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002181s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.05% jit_opt_a.cse : 0.000070s : 0.11% jit_opt_a.replace_applicator : 0.000039s : 0.06% py_interpret_to_execute_after_opt_a : 0.000022s : 0.03% rewriter_after_opt_a : 0.000056s : 0.09% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001027s : 1.60% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000034s : 0.05% loop_unroll : 0.000581s : 0.91% jit_opt_after_cconv.c_1 : 0.000028s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000123s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.02% remove_dup_value : 0.000056s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000115s : 0.18% cse_after_recomputation.cse : 0.000018s : 0.03% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.02% opt_after_jit_grad : 0.000773s : 1.21% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.10% Time group info: ------[substitution.] 0.000624 33 0.68% : 0.000004s : 2: substitution.elim_not_effective 0.35% : 0.000002s : 2: substitution.fold_const_symbol 1.51% : 0.000009s : 3: substitution.graph_param_transform 89.03% : 0.000556s : 11: substitution.inline 0.86% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.98% : 0.000006s : 4: substitution.remove_not_recompute_node 1.19% : 0.000007s : 2: substitution.replace_old_param 2.32% : 0.000014s : 2: substitution.switch_simplify 3.09% : 0.000019s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055104 2 93.71% : 0.051635s : 1: type_inference.infer 6.29% : 0.003469s : 1: type_inference.specialize ------[replace.] 0.000371 16 45.78% : 0.000170s : 11: replace.inline 18.87% : 0.000070s : 2: replace.switch_simplify 35.36% : 0.000131s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000581 16 94.79% : 0.000551s : 11: match.inline 2.26% : 0.000013s : 2: match.switch_simplify 2.95% : 0.000017s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000224 1148 1.75% : 0.000004s : 18: predicate.accumulaten_eliminater 0.99% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000003s : 18: predicate.addn_check_dump 1.41% : 0.000003s : 18: predicate.addn_zero_filter 1.98% : 0.000004s : 18: predicate.arithmetic_simplify 1.90% : 0.000004s : 18: predicate.cast_eliminate 0.34% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000002s : 18: predicate.compare_switch_simplify 1.40% : 0.000003s : 18: predicate.depend_value_elim 1.07% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.12% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.11% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.57% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.24% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.59% : 0.000004s : 18: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 18: predicate.environ_get_depend_swap 1.60% : 0.000004s : 18: predicate.environ_get_eliminate 1.64% : 0.000004s : 18: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.63% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000001s : 3: predicate.graph_param_transform 4.55% : 0.000010s : 38: predicate.inline 0.49% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000004s : 21: predicate.list_to_tuple_eliminator_ 1.98% : 0.000004s : 24: predicate.load_eliminater 0.85% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.95% : 0.000011s : 64: predicate.loop_unroll_before_grad 1.92% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.39% : 0.000003s : 18: predicate.merge_addn 1.24% : 0.000003s : 18: predicate.minmaximum_grad 1.34% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000005s : 24: predicate.partial_eliminate 1.36% : 0.000003s : 18: predicate.print_const_string_wrapper 2.28% : 0.000005s : 18: predicate.reduce_eliminate 1.87% : 0.000004s : 21: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.44% : 0.000003s : 27: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000003s : 18: predicate.reshape_eliminate 1.20% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000003s : 18: predicate.same_eliminate 0.40% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.55% : 0.000001s : 6: predicate.special_op_eliminate 0.51% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000004s : 18: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.21% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.19% : 0.000007s : 32: predicate.switch_defer_inline 2.41% : 0.000005s : 32: predicate.switch_layer_defer_inline 9.15% : 0.000021s : 103: predicate.switch_simplify 1.23% : 0.000003s : 18: predicate.tile_eliminate 1.40% : 0.000003s : 18: predicate.transpose_eliminate 1.66% : 0.000004s : 18: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000004s : 18: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.71% : 0.000004s : 18: predicate.tuple_list_set_item_eliminator 1.77% : 0.000004s : 21: predicate.tuple_to_list_eliminator_ 1.45% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.62% : 0.000006s : 30: predicate.updatestate_useless_node_eliminater 1.68% : 0.000004s : 18: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002928 28 51.61% : 0.001511s : 9: func_graph_cloner_run.FuncGraphClonerGraph 9.62% : 0.000282s : 6: func_graph_cloner_run.FuncGraphClonerNode 38.77% : 0.001135s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075567 72 0.16% : 0.000119s : 1: add_recomputation 0.23% : 0.000175s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.71% : 0.000538s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000037s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.23% : 0.000174s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 14.85% : 0.011224s : 1: jit_opt_a 0.39% : 0.000298s : 1: jit_opt_after_cconv 0.10% : 0.000074s : 1: jit_opt_b 0.78% : 0.000592s : 1: loop_unroll 1.39% : 0.001048s : 1: mutable_eliminate 2.79% : 0.002111s : 26: opt.transform.jit_opt_a 0.10% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000027s : 1: opt.transform.mutable_eliminate 0.05% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000048s : 4: opt.transform.symbol_engine_opt 1.04% : 0.000786s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.08% : 0.000057s : 1: py_interpret_to_execute 0.03% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000060s : 1: remove_dup_value 1.66% : 0.001251s : 1: renormalize.infer 1.21% : 0.000917s : 1: renormalize.specialize 0.02% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000060s : 1: rewriter_after_opt_a 0.23% : 0.000175s : 1: rewriter_before_opt_a 0.15% : 0.000110s : 1: symbol_engine_optimizer 73.26% : 0.055362s : 1: type_inference TotalTime = 0.0410432, [30] [bootstrap]: 0.00046572 [type_inference]: 0.00833386 [event_method]: 2.165e-05 [auto_monad]: 7.652e-05 [graph_reusing]: 6.26998e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.0203346 [rewriter_before_opt_a]: 0.00017945 [expand_dump_flag]: 7.56001e-06 [jit_opt_a]: 0.00834394, [2] [Cycle 1]: 0.00312534, [27] [switch_simplify]: 9.647e-05 [loop_unroll]: 3.35e-05 [a_1]: 0.00070284 [with_stream_mark]: 2.913e-05 [recompute_prepare]: 1.018e-05 [updatestate_depend_eliminate]: 4.99e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 3.2e-06 [specialize_transform]: 7.37002e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 7e-06 [meta_shard_fg_expand]: 3.4e-06 [get_grad_eliminate_]: 6.47001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.007e-05 [j_node_and_user_rematch]: 1.218e-05 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.217e-05 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00177262 [add_forward_monad_depend]: 1.006e-05 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 3.028e-05 [cse]: 4.899e-05 [replace_applicator]: 2.455e-05 [Cycle 2]: 0.00038748, [27] [switch_simplify]: 7.97998e-06 [loop_unroll]: 6.59999e-06 [a_1]: 0.00011026 [with_stream_mark]: 1.607e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.68998e-06 [parameter_eliminate]: 1.45001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.49998e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 4.95999e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 3.61001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.99e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.17e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.84001e-06 [cse]: 1.745e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 2.1e-05 [rewriter_after_opt_a]: 5.016e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 6.31e-06 [mutable_eliminate]: 0.00100238 [jit_opt_b]: 7.479e-05, [1] [Cycle 1]: 6.12e-05, [2] [frontend_op_eliminate]: 2.626e-05 [inline_after_opt_a]: 2.016e-05 [cconv]: 3.823e-05 [loop_unroll]: 0.00054579 [jit_opt_after_cconv]: 0.00020176, [1] [Cycle 1]: 0.00019399, [11] [c_1]: 2.561e-05 [parameter_eliminate]: 5.27999e-06 [updatestate_depend_eliminate]: 1.099e-05 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 4.799e-05 [call_graph_tuple_transform]: 2.716e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 2.30002e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.99001e-06 [remove_dup_value]: 5.231e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 7.35e-06 [add_recomputation]: 6.225e-05 [cse_after_recomputation]: 2.737e-05, [1] [Cycle 1]: 2.072e-05, [1] [cse]: 1.406e-05 [auto_monad_reorder]: 1.904e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 1.155e-05 [opt_after_jit_grad]: 0.00060397 [symbol_engine_optimizer]: 0.00017155, [1] [Cycle 1]: 0.000162, [6] [build]: 6.36e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 9.49e-05 [opt_reshape]: 8.22998e-06 [fold_const_symbol]: 1.214e-05 [renormalize]: 7.7e-07 [validate]: 5.87e-05 Sums bootstrap : 0.000466s : 1.32% type_inference : 0.008334s : 23.55% event_method : 0.000022s : 0.06% auto_monad : 0.000077s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.020335s : 57.47% rewriter_before_opt_a : 0.000179s : 0.51% expand_dump_flag : 0.000008s : 0.02% jit_opt_a.switch_simplify : 0.000104s : 0.30% jit_opt_a.loop_unroll : 0.000040s : 0.11% jit_opt_a.a_1 : 0.000813s : 2.30% jit_opt_a.with_stream_mark : 0.000045s : 0.13% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001773s : 5.01% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.10% jit_opt_a.cse : 0.000066s : 0.19% jit_opt_a.replace_applicator : 0.000031s : 0.09% py_interpret_to_execute_after_opt_a : 0.000021s : 0.06% rewriter_after_opt_a : 0.000050s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.001002s : 2.83% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.07% jit_opt_b.inline_after_opt_a : 0.000020s : 0.06% cconv : 0.000038s : 0.11% loop_unroll : 0.000546s : 1.54% jit_opt_after_cconv.c_1 : 0.000026s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000052s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000062s : 0.18% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.03% opt_after_jit_grad : 0.000604s : 1.71% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000095s : 0.27% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.17% Time group info: ------[substitution.] 0.000324 23 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000008s : 3: substitution.graph_param_transform 85.17% : 0.000276s : 4: substitution.inline 1.85% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000006s : 4: substitution.remove_not_recompute_node 2.54% : 0.000008s : 2: substitution.replace_old_param 4.49% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008232 2 77.66% : 0.006393s : 1: type_inference.infer 22.34% : 0.001839s : 1: type_inference.specialize ------[replace.] 0.000104 6 66.94% : 0.000070s : 4: replace.inline 33.06% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 6 95.29% : 0.000274s : 4: match.inline 4.71% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.59% : 0.000002s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000003s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.49% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.00% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.02% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000008s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.82% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.92% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 4.41% : 0.000006s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000003s : 10: predicate.reduce_eliminate 1.18% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.26% : 0.000002s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.37% : 0.000002s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.01% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000011s : 53: predicate.switch_simplify 1.18% : 0.000002s : 10: predicate.tile_eliminate 0.96% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001212 13 44.77% : 0.000542s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.40% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.83% : 0.000604s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043988 72 0.15% : 0.000065s : 1: add_recomputation 0.18% : 0.000080s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 1.14% : 0.000500s : 1: bootstrap 0.09% : 0.000041s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.02% : 0.000010s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.98% : 0.008350s : 1: jit_opt_a 0.46% : 0.000204s : 1: jit_opt_after_cconv 0.18% : 0.000078s : 1: jit_opt_b 1.27% : 0.000558s : 1: loop_unroll 2.32% : 0.001023s : 1: mutable_eliminate 2.52% : 0.001110s : 26: opt.transform.jit_opt_a 0.14% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000037s : 4: opt.transform.jit_opt_b 0.04% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000031s : 1: opt.transform.mutable_eliminate 0.07% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000045s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000616s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 46.33% : 0.020378s : 1: py_interpret_to_execute 0.05% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000056s : 1: remove_dup_value 2.24% : 0.000986s : 1: renormalize.infer 1.76% : 0.000773s : 1: renormalize.specialize 0.03% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000053s : 1: rewriter_after_opt_a 0.43% : 0.000189s : 1: rewriter_before_opt_a 0.40% : 0.000175s : 1: symbol_engine_optimizer 18.99% : 0.008353s : 1: type_inference TotalTime = 0.340446, [30] [bootstrap]: 0.00037602 [type_inference]: 0.251435 [event_method]: 2.138e-05 [auto_monad]: 7.477e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 0.00063431 [rewriter_before_opt_a]: 9.609e-05 [expand_dump_flag]: 4.23001e-06 [jit_opt_a]: 0.0848699, [2] [Cycle 1]: 0.00437129, [27] [switch_simplify]: 6.658e-05 [loop_unroll]: 3.217e-05 [a_1]: 0.00066337 [with_stream_mark]: 2.553e-05 [recompute_prepare]: 1.3e-05 [updatestate_depend_eliminate]: 5.24998e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.93999e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 7.89997e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 7.64002e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.879e-05 [j_node_and_user_rematch]: 1.101e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.243e-05 [inline_without_move]: 7.9e-06 [renormalize]: 0.00314379 [add_forward_monad_depend]: 1.11e-05 [auto_monad_grad]: 2.89999e-06 [auto_monad_eliminator]: 2.512e-05 [cse]: 3.868e-05 [replace_applicator]: 1.506e-05 [Cycle 2]: 0.000426, [27] [switch_simplify]: 6.42001e-06 [loop_unroll]: 6.17999e-06 [a_1]: 0.00013288 [with_stream_mark]: 1.756e-05 [recompute_prepare]: 6.84999e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.06e-06 [auto_monad_grad]: 1.57001e-06 [auto_monad_eliminator]: 1.204e-05 [cse]: 1.777e-05 [replace_applicator]: 9.02e-06 [py_interpret_to_execute_after_opt_a]: 1.698e-05 [rewriter_after_opt_a]: 4.551e-05 [convert_after_rewriter]: 8.13001e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00087248 [jit_opt_b]: 6.213e-05, [1] [Cycle 1]: 5.248e-05, [2] [frontend_op_eliminate]: 2.012e-05 [inline_after_opt_a]: 1.963e-05 [cconv]: 3.612e-05 [loop_unroll]: 0.0005223 [jit_opt_after_cconv]: 0.000179, [1] [Cycle 1]: 0.00017132, [11] [c_1]: 2.657e-05 [parameter_eliminate]: 3.92002e-06 [updatestate_depend_eliminate]: 8.25e-06 [updatestate_assign_eliminate]: 4.21001e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 3.588e-05 [call_graph_tuple_transform]: 2.412e-05 [tuple_list_get_item_eliminator]: 6.99001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 6.42001e-06 [remove_dup_value]: 1.702e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 9.40001e-06 [add_recomputation]: 5.701e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 1.614e-05 [get_jit_bprop_graph]: 2.58e-06 [rewriter_after_jit_bprop_graph]: 7.40998e-06 [opt_after_jit_grad]: 0.00066555 [symbol_engine_optimizer]: 9.143e-05, [1] [Cycle 1]: 8.287e-05, [6] [build]: 5.34e-06 [elim_shapecalc]: 9.62001e-06 [elim_not_effective]: 1.718e-05 [opt_reshape]: 7.33999e-06 [fold_const_symbol]: 1.089e-05 [renormalize]: 9.10019e-07 [validate]: 5.555e-05 Sums bootstrap : 0.000376s : 0.14% type_inference : 0.251435s : 96.83% event_method : 0.000021s : 0.01% auto_monad : 0.000075s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000634s : 0.24% rewriter_before_opt_a : 0.000096s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000796s : 0.31% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003144s : 1.21% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000046s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000872s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000036s : 0.01% loop_unroll : 0.000522s : 0.20% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000057s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000666s : 0.26% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.02% Time group info: ------[substitution.] 0.000267 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 4: substitution.graph_param_transform 83.94% : 0.000224s : 4: substitution.inline 1.71% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000006s : 4: substitution.remove_not_recompute_node 3.06% : 0.000008s : 2: substitution.replace_old_param 5.23% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.251334 2 98.47% : 0.247476s : 1: type_inference.infer 1.53% : 0.003857s : 1: type_inference.specialize ------[replace.] 0.000087 6 68.40% : 0.000059s : 4: replace.inline 31.60% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.55% : 0.000222s : 4: match.inline 5.45% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 1.40% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000001s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 0.96% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.93% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000009s : 26: predicate.inline 1.51% : 0.000002s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.32% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.73% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 2.55% : 0.000004s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 1.27% : 0.000002s : 8: predicate.specialize_transform 1.69% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000004s : 18: predicate.switch_defer_inline 1.92% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.79% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.79% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.83% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002558 22 66.84% : 0.001710s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.07% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.09% : 0.000795s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.344722 72 0.02% : 0.000060s : 1: add_recomputation 0.02% : 0.000078s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.12% : 0.000402s : 1: bootstrap 0.01% : 0.000039s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 24.62% : 0.084875s : 1: jit_opt_a 0.05% : 0.000182s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.16% : 0.000535s : 1: loop_unroll 0.26% : 0.000885s : 1: mutable_eliminate 0.31% : 0.001062s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000680s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000643s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.64% : 0.002221s : 1: renormalize.infer 0.26% : 0.000908s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000050s : 1: rewriter_after_opt_a 0.03% : 0.000102s : 1: rewriter_before_opt_a 0.03% : 0.000095s : 1: symbol_engine_optimizer 72.94% : 0.251455s : 1: type_inference TotalTime = 0.109392, [30] [bootstrap]: 0.00033918 [type_inference]: 0.0995436 [event_method]: 2.338e-05 [auto_monad]: 7.544e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 0.0001134 [rewriter_before_opt_a]: 8.316e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.0068839, [2] [Cycle 1]: 0.0022794, [27] [switch_simplify]: 5.89e-05 [loop_unroll]: 2.915e-05 [a_1]: 0.00058227 [with_stream_mark]: 1.985e-05 [recompute_prepare]: 1.118e-05 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.70998e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 6.42001e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 2.11e-06 [cell_reuse_handle_not_recompute_node_pass]: 6.904e-05 [j_node_and_user_rematch]: 1.404e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.271e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00117216 [add_forward_monad_depend]: 6.32001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.755e-05 [cse]: 1.948e-05 [replace_applicator]: 1.058e-05 [Cycle 2]: 0.00033631, [27] [switch_simplify]: 5.47001e-06 [loop_unroll]: 5.40001e-06 [a_1]: 8.976e-05 [with_stream_mark]: 1.219e-05 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 3.10002e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 8.39002e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 1.18001e-06 [auto_monad_eliminator]: 6.69999e-06 [cse]: 1.39e-05 [replace_applicator]: 6.46999e-06 [py_interpret_to_execute_after_opt_a]: 1.421e-05 [rewriter_after_opt_a]: 4.353e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00055003 [jit_opt_b]: 4.789e-05, [1] [Cycle 1]: 4.225e-05, [2] [frontend_op_eliminate]: 1.497e-05 [inline_after_opt_a]: 1.647e-05 [cconv]: 3.254e-05 [loop_unroll]: 0.00047508 [jit_opt_after_cconv]: 0.00017125, [1] [Cycle 1]: 0.00016497, [11] [c_1]: 2.107e-05 [parameter_eliminate]: 5.09e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 3.712e-05 [call_graph_tuple_transform]: 2.427e-05 [tuple_list_get_item_eliminator]: 5.70001e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.599e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.71999e-06 [add_recomputation]: 5.277e-05 [cse_after_recomputation]: 2.659e-05, [1] [Cycle 1]: 2.048e-05, [1] [cse]: 1.387e-05 [auto_monad_reorder]: 1.682e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.31e-06 [opt_after_jit_grad]: 0.00051854 [symbol_engine_optimizer]: 7.416e-05, [1] [Cycle 1]: 6.735e-05, [6] [build]: 2.90998e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.409e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 9.02999e-06 [renormalize]: 4.7998e-07 [validate]: 3.873e-05 Sums bootstrap : 0.000339s : 0.32% type_inference : 0.099544s : 95.27% event_method : 0.000023s : 0.02% auto_monad : 0.000075s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000113s : 0.11% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000672s : 0.64% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000083s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001172s : 1.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000550s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000475s : 0.45% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000519s : 0.50% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000246 23 1.20% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 3: substitution.graph_param_transform 83.27% : 0.000205s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000005s : 4: substitution.remove_not_recompute_node 2.73% : 0.000007s : 2: substitution.replace_old_param 5.63% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099453 2 98.57% : 0.098031s : 1: type_inference.infer 1.43% : 0.001422s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.30% : 0.000054s : 4: replace.inline 33.70% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.28% : 0.000203s : 4: match.inline 5.72% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.66% : 0.000002s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.60% : 0.000001s : 3: predicate.graph_param_transform 5.15% : 0.000006s : 22: predicate.inline 1.87% : 0.000002s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.15% : 0.000002s : 6: predicate.less_batch_normalization 1.73% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 2.11% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.09% : 0.000001s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000002s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 1.37% : 0.000002s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.02% : 0.000004s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.21% : 0.000008s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 2.87% : 0.000003s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.22% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000911 13 50.28% : 0.000458s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.18% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.54% : 0.000406s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111573 72 0.05% : 0.000057s : 1: add_recomputation 0.07% : 0.000079s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.33% : 0.000363s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.17% : 0.006887s : 1: jit_opt_a 0.16% : 0.000174s : 1: jit_opt_after_cconv 0.05% : 0.000050s : 1: jit_opt_b 0.44% : 0.000486s : 1: loop_unroll 0.50% : 0.000557s : 1: mutable_eliminate 0.86% : 0.000960s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000530s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000117s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.64% : 0.000719s : 1: renormalize.infer 0.40% : 0.000442s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 89.24% : 0.099566s : 1: type_inference TotalTime = 0.656662, [30] [bootstrap]: 0.00037537 [type_inference]: 0.582709 [event_method]: 3.222e-05 [auto_monad]: 8.992e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 0.00065586 [rewriter_before_opt_a]: 0.00013599 [expand_dump_flag]: 4.69002e-06 [jit_opt_a]: 0.0572727, [2] [Cycle 1]: 0.00589917, [27] [switch_simplify]: 8.263e-05 [loop_unroll]: 3.525e-05 [a_1]: 0.0008321 [with_stream_mark]: 2.554e-05 [recompute_prepare]: 1.027e-05 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 7.9e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 8.33999e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 7.41999e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.781e-05 [j_node_and_user_rematch]: 3.144e-05 [meta_fg_expand]: 3.46001e-06 [replace_old_param]: 1.238e-05 [inline_without_move]: 7.15998e-06 [renormalize]: 0.00443843 [add_forward_monad_depend]: 1.331e-05 [auto_monad_grad]: 3.38e-06 [auto_monad_eliminator]: 2.365e-05 [cse]: 4.79e-05 [replace_applicator]: 2.843e-05 [Cycle 2]: 0.00045771, [27] [switch_simplify]: 7.85998e-06 [loop_unroll]: 7.15003e-06 [a_1]: 0.00014401 [with_stream_mark]: 1.951e-05 [recompute_prepare]: 7.76001e-06 [updatestate_depend_eliminate]: 5.08002e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 6.49001e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 3.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.404e-05 [j_node_and_user_rematch]: 1.159e-05 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.143e-05 [inline_without_move]: 6.21e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.45999e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 8.70001e-06 [cse]: 1.996e-05 [replace_applicator]: 6.79001e-06 [py_interpret_to_execute_after_opt_a]: 1.852e-05 [rewriter_after_opt_a]: 4.657e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00085823 [jit_opt_b]: 7.011e-05, [1] [Cycle 1]: 6.113e-05, [2] [frontend_op_eliminate]: 2.321e-05 [inline_after_opt_a]: 2.449e-05 [cconv]: 3.348e-05 [loop_unroll]: 0.00047467 [jit_opt_after_cconv]: 0.00019915, [1] [Cycle 1]: 0.00019218, [11] [c_1]: 2.888e-05 [parameter_eliminate]: 5.26002e-06 [updatestate_depend_eliminate]: 9.06002e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.89001e-06 [cse]: 4.552e-05 [call_graph_tuple_transform]: 2.54e-05 [tuple_list_get_item_eliminator]: 6.70998e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.40002e-06 [remove_dup_value]: 2.045e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 1.157e-05 [add_recomputation]: 5.766e-05 [cse_after_recomputation]: 3.027e-05, [1] [Cycle 1]: 2.198e-05, [1] [cse]: 1.494e-05 [auto_monad_reorder]: 1.79e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 6.73998e-06 [opt_after_jit_grad]: 0.00051673 [symbol_engine_optimizer]: 9.885e-05, [1] [Cycle 1]: 9.177e-05, [6] [build]: 5.03002e-06 [elim_shapecalc]: 1.581e-05 [elim_not_effective]: 2.277e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 1.19e-05 [renormalize]: 3.30008e-07 [validate]: 0.0126201 Sums bootstrap : 0.000375s : 0.06% type_inference : 0.582709s : 96.32% event_method : 0.000032s : 0.01% auto_monad : 0.000090s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000656s : 0.11% rewriter_before_opt_a : 0.000136s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.01% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000976s : 0.16% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004439s : 0.73% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000068s : 0.01% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000047s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000858s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.00% jit_opt_b.inline_after_opt_a : 0.000024s : 0.00% cconv : 0.000033s : 0.01% loop_unroll : 0.000475s : 0.08% jit_opt_after_cconv.c_1 : 0.000029s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000058s : 0.01% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000517s : 0.09% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000016s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.012620s : 2.09% Time group info: ------[substitution.] 0.000350 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.89% : 0.000003s : 2: substitution.fold_const_symbol 1.91% : 0.000007s : 4: substitution.graph_param_transform 86.63% : 0.000303s : 5: substitution.inline 1.44% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000007s : 4: substitution.remove_not_recompute_node 1.98% : 0.000007s : 2: substitution.replace_old_param 4.44% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.582575 2 99.33% : 0.578663s : 1: type_inference.infer 0.67% : 0.003912s : 1: type_inference.specialize ------[replace.] 0.000135 7 65.58% : 0.000088s : 5: replace.inline 34.42% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000314 7 95.51% : 0.000300s : 5: match.inline 4.49% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_depend_swap 1.39% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 6.21% : 0.000010s : 28: predicate.inline 1.12% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000003s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000004s : 13: predicate.reduce_eliminate 1.28% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.97% : 0.000002s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.67% : 0.000004s : 20: predicate.switch_defer_inline 1.94% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.20% : 0.000011s : 64: predicate.switch_simplify 1.49% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.88% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.82% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.067374 25 98.05% : 0.066061s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.15% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 1.80% : 0.001212s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.649881 72 0.01% : 0.000061s : 1: add_recomputation 0.01% : 0.000094s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.06% : 0.000397s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.00% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000039s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 8.81% : 0.057277s : 1: jit_opt_a 0.03% : 0.000202s : 1: jit_opt_after_cconv 0.01% : 0.000074s : 1: jit_opt_b 0.07% : 0.000484s : 1: loop_unroll 0.13% : 0.000873s : 1: mutable_eliminate 0.20% : 0.001304s : 26: opt.transform.jit_opt_a 0.01% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000040s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000021s : 1: opt.transform.mutable_eliminate 0.00% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000054s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000529s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000669s : 1: py_interpret_to_execute 0.00% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000023s : 1: remove_dup_value 0.47% : 0.003085s : 1: renormalize.infer 0.21% : 0.001337s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000050s : 1: rewriter_after_opt_a 0.02% : 0.000141s : 1: rewriter_before_opt_a 0.02% : 0.000102s : 1: symbol_engine_optimizer 89.67% : 0.582737s : 1: type_inference TotalTime = 0.285127, [30] [bootstrap]: 0.0004572 [type_inference]: 0.252979 [event_method]: 3.323e-05 [auto_monad]: 0.00010422 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 3.48999e-06 [py_interpret_to_execute]: 0.0019994 [rewriter_before_opt_a]: 0.00015771 [expand_dump_flag]: 7.19001e-06 [jit_opt_a]: 0.0259557, [2] [Cycle 1]: 0.0203505, [27] [switch_simplify]: 0.00010159 [loop_unroll]: 3.359e-05 [a_1]: 0.00090208 [with_stream_mark]: 2.951e-05 [recompute_prepare]: 1.213e-05 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 3.62998e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 8.68001e-06 [updatestate_useless_node_eliminater]: 6.78e-06 [accelerated_algorithm]: 8.23001e-06 [meta_shard_fg_expand]: 3.34001e-06 [get_grad_eliminate_]: 7.72998e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.931e-05 [j_node_and_user_rematch]: 1.369e-05 [meta_fg_expand]: 2.93998e-06 [replace_old_param]: 1.249e-05 [inline_without_move]: 7.58001e-06 [renormalize]: 0.0187844 [add_forward_monad_depend]: 1.191e-05 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.196e-05 [cse]: 4.405e-05 [replace_applicator]: 3.011e-05 [Cycle 2]: 0.0004525, [27] [switch_simplify]: 8.54e-06 [loop_unroll]: 7.83001e-06 [a_1]: 0.00015056 [with_stream_mark]: 1.879e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 7.05002e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 5.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.212e-05 [j_node_and_user_rematch]: 1.158e-05 [meta_fg_expand]: 3.13e-06 [replace_old_param]: 1.086e-05 [inline_without_move]: 6.11e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 7.25e-06 [cse]: 1.911e-05 [replace_applicator]: 8.07998e-06 [py_interpret_to_execute_after_opt_a]: 2.006e-05 [rewriter_after_opt_a]: 4.598e-05 [convert_after_rewriter]: 7.73999e-06 [order_py_execute_after_rewriter]: 5.38002e-06 [mutable_eliminate]: 0.00105082 [jit_opt_b]: 0.00012855, [1] [Cycle 1]: 7.009e-05, [2] [frontend_op_eliminate]: 2.991e-05 [inline_after_opt_a]: 2.47e-05 [cconv]: 4.043e-05 [loop_unroll]: 0.00060921 [jit_opt_after_cconv]: 0.00021677, [1] [Cycle 1]: 0.00020827, [11] [c_1]: 3.117e-05 [parameter_eliminate]: 6.12001e-06 [updatestate_depend_eliminate]: 1.072e-05 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 5.211e-05 [call_graph_tuple_transform]: 3.077e-05 [tuple_list_get_item_eliminator]: 6.93e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 1.07998e-06 [switch_simplify]: 8.47e-06 [remove_dup_value]: 2.129e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 1.266e-05 [add_recomputation]: 6.432e-05 [cse_after_recomputation]: 2.934e-05, [1] [Cycle 1]: 2.3e-05, [1] [cse]: 1.662e-05 [auto_monad_reorder]: 1.878e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 1.164e-05 [opt_after_jit_grad]: 0.00065144 [symbol_engine_optimizer]: 9.818e-05, [1] [Cycle 1]: 8.964e-05, [6] [build]: 7.23999e-06 [elim_shapecalc]: 1.056e-05 [elim_not_effective]: 1.592e-05 [opt_reshape]: 9.22001e-06 [fold_const_symbol]: 1.181e-05 [renormalize]: 7.39994e-07 [validate]: 6.677e-05 Sums bootstrap : 0.000457s : 0.16% type_inference : 0.252979s : 90.65% event_method : 0.000033s : 0.01% auto_monad : 0.000104s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001999s : 0.72% rewriter_before_opt_a : 0.000158s : 0.06% expand_dump_flag : 0.000007s : 0.00% jit_opt_a.switch_simplify : 0.000110s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.001053s : 0.38% jit_opt_a.with_stream_mark : 0.000048s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.018785s : 6.73% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000063s : 0.02% jit_opt_a.replace_applicator : 0.000038s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000046s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001051s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.01% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000040s : 0.01% loop_unroll : 0.000609s : 0.22% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000052s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000064s : 0.02% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.00% opt_after_jit_grad : 0.000651s : 0.23% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000067s : 0.02% Time group info: ------[substitution.] 0.000387 24 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000003s : 2: substitution.fold_const_symbol 1.83% : 0.000007s : 4: substitution.graph_param_transform 87.22% : 0.000338s : 4: substitution.inline 1.54% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000007s : 4: substitution.remove_not_recompute_node 1.85% : 0.000007s : 2: substitution.replace_old_param 4.28% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.252826 2 97.45% : 0.246380s : 1: type_inference.infer 2.55% : 0.006446s : 1: type_inference.specialize ------[replace.] 0.000144 6 64.46% : 0.000093s : 4: replace.inline 35.54% : 0.000051s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000350 6 95.64% : 0.000335s : 4: match.inline 4.36% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.36% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 12: predicate.addn_check_dump 1.20% : 0.000002s : 12: predicate.addn_zero_filter 2.47% : 0.000004s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.83% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.52% : 0.000003s : 12: predicate.depend_value_elim 0.98% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.98% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.96% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.70% : 0.000003s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_depend_swap 1.03% : 0.000002s : 12: predicate.environ_get_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 4.93% : 0.000008s : 26: predicate.inline 0.72% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.51% : 0.000003s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000007s : 36: predicate.loop_unroll_before_grad 2.27% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.88% : 0.000001s : 12: predicate.merge_addn 0.86% : 0.000001s : 12: predicate.minmaximum_grad 2.80% : 0.000005s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 1.93% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.51% : 0.000003s : 12: predicate.reduce_eliminate 1.66% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 22: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.08% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.97% : 0.000002s : 4: predicate.row_tensor_eliminate 0.98% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000002s : 8: predicate.specialize_transform 1.20% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.79% : 0.000005s : 18: predicate.switch_defer_inline 1.57% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.16% : 0.000012s : 58: predicate.switch_simplify 1.89% : 0.000003s : 12: predicate.tile_eliminate 1.48% : 0.000003s : 12: predicate.transpose_eliminate 2.44% : 0.000004s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.90% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.27% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.32% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.17% : 0.000004s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004062 22 55.03% : 0.002235s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.90% : 0.000077s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.07% : 0.001750s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.305376 72 0.02% : 0.000067s : 1: add_recomputation 0.04% : 0.000109s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.16% : 0.000487s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000033s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000040s : 1: event_method 0.00% : 0.000009s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 8.50% : 0.025963s : 1: jit_opt_a 0.07% : 0.000220s : 1: jit_opt_after_cconv 0.04% : 0.000132s : 1: jit_opt_b 0.20% : 0.000620s : 1: loop_unroll 0.35% : 0.001068s : 1: mutable_eliminate 0.45% : 0.001385s : 26: opt.transform.jit_opt_a 0.02% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000028s : 1: opt.transform.mutable_eliminate 0.01% : 0.000039s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000667s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.67% : 0.002036s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 5.66% : 0.017297s : 1: renormalize.infer 0.48% : 0.001472s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000049s : 1: rewriter_after_opt_a 0.05% : 0.000166s : 1: rewriter_before_opt_a 0.03% : 0.000101s : 1: symbol_engine_optimizer 82.86% : 0.253021s : 1: type_inference TotalTime = 0.106226, [30] [bootstrap]: 0.00028303 [type_inference]: 0.0965071 [event_method]: 2.575e-05 [auto_monad]: 7.866e-05 [graph_reusing]: 7.78001e-06 [pre_auto_parallel]: 3.16001e-06 [py_interpret_to_execute]: 0.00010605 [rewriter_before_opt_a]: 9.039e-05 [expand_dump_flag]: 3.13998e-06 [jit_opt_a]: 0.00649338, [2] [Cycle 1]: 0.00230971, [27] [switch_simplify]: 6.418e-05 [loop_unroll]: 2.904e-05 [a_1]: 0.00062246 [with_stream_mark]: 2.95e-05 [recompute_prepare]: 1.176e-05 [updatestate_depend_eliminate]: 5.49998e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 5.09003e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.75999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.729e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 5.87999e-06 [renormalize]: 0.0011349 [add_forward_monad_depend]: 8.54998e-06 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 2.205e-05 [cse]: 3.967e-05 [replace_applicator]: 1.898e-05 [Cycle 2]: 0.00036993, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 4.92e-06 [a_1]: 8.89e-05 [with_stream_mark]: 1.391e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 5.23002e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.66998e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.314e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.64e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.51e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 7.75998e-06 [cse]: 1.733e-05 [replace_applicator]: 6.89001e-06 [py_interpret_to_execute_after_opt_a]: 1.97e-05 [rewriter_after_opt_a]: 4.296e-05 [convert_after_rewriter]: 1.008e-05 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00079703 [jit_opt_b]: 5.81e-05, [1] [Cycle 1]: 4.755e-05, [2] [frontend_op_eliminate]: 1.662e-05 [inline_after_opt_a]: 1.807e-05 [cconv]: 3.696e-05 [loop_unroll]: 0.00046336 [jit_opt_after_cconv]: 0.00017363, [1] [Cycle 1]: 0.00016644, [11] [c_1]: 2.053e-05 [parameter_eliminate]: 4.67998e-06 [updatestate_depend_eliminate]: 1.014e-05 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.92e-05 [call_graph_tuple_transform]: 2.262e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.767e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 6.31e-06 [add_recomputation]: 6.034e-05 [cse_after_recomputation]: 2.51e-05, [1] [Cycle 1]: 1.886e-05, [1] [cse]: 1.25e-05 [auto_monad_reorder]: 1.922e-05 [get_jit_bprop_graph]: 2.83e-06 [rewriter_after_jit_bprop_graph]: 8.08001e-06 [opt_after_jit_grad]: 0.00051635 [symbol_engine_optimizer]: 7.552e-05, [1] [Cycle 1]: 6.849e-05, [6] [build]: 4.66002e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.361e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 6.39993e-07 [validate]: 4.969e-05 Sums bootstrap : 0.000283s : 0.28% type_inference : 0.096507s : 94.89% event_method : 0.000026s : 0.03% auto_monad : 0.000079s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000106s : 0.10% rewriter_before_opt_a : 0.000090s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.07% jit_opt_a.loop_unroll : 0.000034s : 0.03% jit_opt_a.a_1 : 0.000711s : 0.70% jit_opt_a.with_stream_mark : 0.000043s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000050s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001135s : 1.12% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.03% jit_opt_a.cse : 0.000057s : 0.06% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000010s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000797s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000037s : 0.04% loop_unroll : 0.000463s : 0.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000060s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000516s : 0.51% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.05% Time group info: ------[substitution.] 0.000281 23 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 85.33% : 0.000240s : 4: substitution.inline 1.76% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000007s : 2: substitution.replace_old_param 4.92% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.096412 2 98.22% : 0.094696s : 1: type_inference.infer 1.78% : 0.001716s : 1: type_inference.specialize ------[replace.] 0.000080 6 69.20% : 0.000055s : 4: replace.inline 30.80% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 6 94.95% : 0.000237s : 4: match.inline 5.05% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.08% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 7.02% : 0.000009s : 22: predicate.inline 1.47% : 0.000002s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.59% : 0.000003s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.17% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.36% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.76% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000864 13 40.38% : 0.000349s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.32% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.29% : 0.000452s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108357 72 0.06% : 0.000063s : 1: add_recomputation 0.08% : 0.000083s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.28% : 0.000303s : 1: bootstrap 0.04% : 0.000040s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.00% : 0.006497s : 1: jit_opt_a 0.16% : 0.000177s : 1: jit_opt_after_cconv 0.06% : 0.000061s : 1: jit_opt_b 0.44% : 0.000475s : 1: loop_unroll 0.75% : 0.000814s : 1: mutable_eliminate 0.88% : 0.000955s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000024s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000528s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000110s : 1: py_interpret_to_execute 0.02% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.61% : 0.000661s : 1: renormalize.infer 0.43% : 0.000463s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.09% : 0.000094s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 89.10% : 0.096541s : 1: type_inference TotalTime = 0.39364, [30] [bootstrap]: 0.00033318 [type_inference]: 0.381279 [event_method]: 2.232e-05 [auto_monad]: 7.325e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00030467 [rewriter_before_opt_a]: 8.726e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00854939, [2] [Cycle 1]: 0.00458717, [27] [switch_simplify]: 5.947e-05 [loop_unroll]: 3.045e-05 [a_1]: 0.00161971 [with_stream_mark]: 2.965e-05 [recompute_prepare]: 1.28e-05 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.45002e-06 [specialize_transform]: 8.15999e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.52001e-06 [merge_forward]: 5.42999e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.845e-05 [j_node_and_user_rematch]: 1.151e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.312e-05 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00240807 [add_forward_monad_depend]: 1.126e-05 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 2.173e-05 [cse]: 3.596e-05 [replace_applicator]: 2.34e-05 [Cycle 2]: 0.00039742, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 6.25002e-06 [a_1]: 0.00012163 [with_stream_mark]: 1.55e-05 [recompute_prepare]: 6.46e-06 [updatestate_depend_eliminate]: 3.87002e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.118e-05 [j_node_and_user_rematch]: 1.092e-05 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 1.079e-05 [inline_without_move]: 5.77999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 8.45001e-06 [cse]: 1.491e-05 [replace_applicator]: 6.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.899e-05 [rewriter_after_opt_a]: 4.373e-05 [convert_after_rewriter]: 8.28001e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00089261 [jit_opt_b]: 6.555e-05, [1] [Cycle 1]: 5.49e-05, [2] [frontend_op_eliminate]: 2.094e-05 [inline_after_opt_a]: 1.951e-05 [cconv]: 4.344e-05 [loop_unroll]: 0.00053922 [jit_opt_after_cconv]: 0.00020563, [1] [Cycle 1]: 0.00019743, [11] [c_1]: 2.588e-05 [parameter_eliminate]: 5.87001e-06 [updatestate_depend_eliminate]: 1.205e-05 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.85998e-06 [cse]: 4.465e-05 [call_graph_tuple_transform]: 3.064e-05 [tuple_list_get_item_eliminator]: 6.79999e-06 [none_parameter_eliminate]: 2.11003e-06 [renormalize]: 1.64e-06 [switch_simplify]: 7.01001e-06 [remove_dup_value]: 1.976e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 1.276e-05 [add_recomputation]: 6.282e-05 [cse_after_recomputation]: 2.63e-05, [1] [Cycle 1]: 2.01e-05, [1] [cse]: 1.399e-05 [auto_monad_reorder]: 1.851e-05 [get_jit_bprop_graph]: 2.58e-06 [rewriter_after_jit_bprop_graph]: 8.96002e-06 [opt_after_jit_grad]: 0.00058354 [symbol_engine_optimizer]: 0.00011801, [1] [Cycle 1]: 0.00010961, [6] [build]: 5.87999e-06 [elim_shapecalc]: 8.94003e-06 [elim_not_effective]: 1.72e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 3.954e-05 [renormalize]: 8.49977e-07 [validate]: 6.168e-05 Sums bootstrap : 0.000333s : 0.09% type_inference : 0.381279s : 97.93% event_method : 0.000022s : 0.01% auto_monad : 0.000073s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000305s : 0.08% rewriter_before_opt_a : 0.000087s : 0.02% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.001741s : 0.45% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002408s : 0.62% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000051s : 0.01% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000893s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000043s : 0.01% loop_unroll : 0.000539s : 0.14% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000002s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000063s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000584s : 0.15% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000040s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.02% Time group info: ------[substitution.] 0.000289 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 10.65% : 0.000031s : 2: substitution.fold_const_symbol 2.48% : 0.000007s : 4: substitution.graph_param_transform 72.78% : 0.000210s : 4: substitution.inline 2.25% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000006s : 4: substitution.remove_not_recompute_node 3.23% : 0.000009s : 2: substitution.replace_old_param 5.64% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.381179 2 99.42% : 0.378971s : 1: type_inference.infer 0.58% : 0.002209s : 1: type_inference.specialize ------[replace.] 0.001049 6 95.44% : 0.001002s : 4: replace.inline 4.56% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 93.39% : 0.000208s : 4: match.inline 6.61% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.75% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 0.92% : 0.000001s : 12: predicate.compare_switch_simplify 0.98% : 0.000001s : 12: predicate.depend_value_elim 0.98% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.01% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.03% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.40% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.72% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.90% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 7.36% : 0.000011s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.21% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 18: predicate.load_eliminater 2.47% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.64% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.89% : 0.000001s : 12: predicate.merge_addn 0.93% : 0.000001s : 12: predicate.minmaximum_grad 2.93% : 0.000004s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000002s : 12: predicate.print_const_string_wrapper 1.97% : 0.000003s : 12: predicate.reduce_eliminate 1.17% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.02% : 0.000002s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.07% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.32% : 0.000002s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.12% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 4.54% : 0.000007s : 18: predicate.switch_defer_inline 1.83% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.72% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.02% : 0.000002s : 12: predicate.transpose_eliminate 1.11% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.45% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.075875 30 99.10% : 0.075190s : 23: func_graph_cloner_run.FuncGraphClonerGraph 0.07% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 0.83% : 0.000629s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.398161 72 0.02% : 0.000066s : 1: add_recomputation 0.02% : 0.000076s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.09% : 0.000357s : 1: bootstrap 0.01% : 0.000046s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 2.15% : 0.008555s : 1: jit_opt_a 0.05% : 0.000209s : 1: jit_opt_after_cconv 0.02% : 0.000069s : 1: jit_opt_b 0.14% : 0.000554s : 1: loop_unroll 0.23% : 0.000916s : 1: mutable_eliminate 0.50% : 0.002005s : 26: opt.transform.jit_opt_a 0.02% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000028s : 1: opt.transform.mutable_eliminate 0.01% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000069s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000598s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000312s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.40% : 0.001592s : 1: renormalize.infer 0.20% : 0.000801s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.02% : 0.000092s : 1: rewriter_before_opt_a 0.03% : 0.000121s : 1: symbol_engine_optimizer 95.77% : 0.381301s : 1: type_inference TotalTime = 0.0145535, [30] [bootstrap]: 0.00033264 [type_inference]: 0.0049905 [event_method]: 1.86e-05 [auto_monad]: 6.567e-05 [graph_reusing]: 6.33998e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 3.147e-05 [rewriter_before_opt_a]: 7.244e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00682846, [2] [Cycle 1]: 0.00171226, [27] [switch_simplify]: 6.162e-05 [loop_unroll]: 2.871e-05 [a_1]: 0.00055558 [with_stream_mark]: 2.34e-05 [recompute_prepare]: 7.11001e-06 [updatestate_depend_eliminate]: 4.47003e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 5.16998e-06 [renormalize]: 0.00069422 [add_forward_monad_depend]: 5.51e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.707e-05 [cse]: 3.53e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00031103, [27] [switch_simplify]: 5.62999e-06 [loop_unroll]: 4.95001e-06 [a_1]: 8.58e-05 [with_stream_mark]: 9.94001e-06 [recompute_prepare]: 4.84e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 4.81002e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.203e-05 [j_node_and_user_rematch]: 7.83999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.18e-06 [inline_without_move]: 4.53001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.144e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.43e-05 [rewriter_after_opt_a]: 3.893e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00056948 [jit_opt_b]: 4.854e-05, [1] [Cycle 1]: 4.043e-05, [2] [frontend_op_eliminate]: 1.41e-05 [inline_after_opt_a]: 1.483e-05 [cconv]: 2.899e-05 [loop_unroll]: 0.00045248 [jit_opt_after_cconv]: 0.00015986, [1] [Cycle 1]: 0.0001535, [11] [c_1]: 2e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 7.38e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 8.3e-06 [cse]: 2.867e-05 [call_graph_tuple_transform]: 1.992e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 5.30001e-06 [remove_dup_value]: 1.654e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.00002e-06 [add_recomputation]: 5.346e-05 [cse_after_recomputation]: 2.226e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.165e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.63998e-06 [rewriter_after_jit_bprop_graph]: 5.83002e-06 [opt_after_jit_grad]: 0.00045279 [symbol_engine_optimizer]: 7.066e-05, [1] [Cycle 1]: 6.451e-05, [6] [build]: 3.98999e-06 [elim_shapecalc]: 7.3e-06 [elim_not_effective]: 1.23e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 8.31002e-06 [renormalize]: 5.50004e-07 [validate]: 4.106e-05 Sums bootstrap : 0.000333s : 3.64% type_inference : 0.004991s : 54.56% event_method : 0.000019s : 0.20% auto_monad : 0.000066s : 0.72% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000031s : 0.34% rewriter_before_opt_a : 0.000072s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000067s : 0.74% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000641s : 7.01% jit_opt_a.with_stream_mark : 0.000033s : 0.36% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000694s : 7.59% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.25% jit_opt_a.cse : 0.000047s : 0.51% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000014s : 0.16% rewriter_after_opt_a : 0.000039s : 0.43% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000569s : 6.23% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000029s : 0.32% loop_unroll : 0.000452s : 4.95% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000008s : 0.09% jit_opt_after_cconv.cse : 0.000029s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000053s : 0.58% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000453s : 4.95% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.45% Time group info: ------[substitution.] 0.000239 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 85.15% : 0.000204s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004922 2 83.47% : 0.004108s : 1: type_inference.infer 16.53% : 0.000814s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.82% : 0.000045s : 4: replace.inline 31.18% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.50% : 0.000201s : 4: match.inline 5.50% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.29% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000000s : 3: predicate.graph_param_transform 5.83% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 2.39% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.10% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.57% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000646 13 54.29% : 0.000351s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.43% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.29% : 0.000241s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016151 72 0.35% : 0.000057s : 1: add_recomputation 0.43% : 0.000069s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.22% : 0.000358s : 1: bootstrap 0.20% : 0.000032s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 42.30% : 0.006831s : 1: jit_opt_a 1.01% : 0.000163s : 1: jit_opt_after_cconv 0.32% : 0.000051s : 1: jit_opt_b 2.85% : 0.000461s : 1: loop_unroll 3.59% : 0.000579s : 1: mutable_eliminate 5.29% : 0.000855s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000023s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.85% : 0.000461s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000034s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.39% : 0.000386s : 1: renormalize.infer 1.86% : 0.000300s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000043s : 1: rewriter_after_opt_a 0.47% : 0.000075s : 1: rewriter_before_opt_a 0.45% : 0.000073s : 1: symbol_engine_optimizer 31.02% : 0.005010s : 1: type_inference TotalTime = 0.566409, [30] [bootstrap]: 0.00040145 [type_inference]: 0.513124 [event_method]: 3.296e-05 [auto_monad]: 9.717e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00072924 [rewriter_before_opt_a]: 0.00013582 [expand_dump_flag]: 4.21001e-06 [jit_opt_a]: 0.048343, [2] [Cycle 1]: 0.0436362, [27] [switch_simplify]: 9.72e-05 [loop_unroll]: 3.678e-05 [a_1]: 0.00090243 [with_stream_mark]: 2.823e-05 [recompute_prepare]: 1.033e-05 [updatestate_depend_eliminate]: 4.90999e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.90998e-06 [parameter_eliminate]: 2.59001e-06 [specialize_transform]: 1.002e-05 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 8.68001e-06 [meta_shard_fg_expand]: 3.43e-06 [get_grad_eliminate_]: 7.11001e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.863e-05 [j_node_and_user_rematch]: 1.281e-05 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 1.43e-05 [inline_without_move]: 7.3e-06 [renormalize]: 0.0420651 [add_forward_monad_depend]: 1.413e-05 [auto_monad_grad]: 3.72002e-06 [auto_monad_eliminator]: 2.762e-05 [cse]: 4.681e-05 [replace_applicator]: 3.225e-05 [Cycle 2]: 0.00046856, [27] [switch_simplify]: 8.70999e-06 [loop_unroll]: 8.17e-06 [a_1]: 0.00015315 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 8.39998e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 7.36001e-06 [updatestate_useless_node_eliminater]: 6.54001e-06 [accelerated_algorithm]: 8.01001e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 3.67002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.348e-05 [j_node_and_user_rematch]: 1.191e-05 [meta_fg_expand]: 3.73001e-06 [replace_old_param]: 1.147e-05 [inline_without_move]: 6.64001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.99e-06 [auto_monad_grad]: 1.10999e-06 [auto_monad_eliminator]: 6.64001e-06 [cse]: 1.789e-05 [replace_applicator]: 7.83999e-06 [py_interpret_to_execute_after_opt_a]: 2.238e-05 [rewriter_after_opt_a]: 5.14e-05 [convert_after_rewriter]: 8.99998e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00093822 [jit_opt_b]: 0.00011418, [1] [Cycle 1]: 0.0001026, [2] [frontend_op_eliminate]: 2.483e-05 [inline_after_opt_a]: 2.364e-05 [cconv]: 4.037e-05 [loop_unroll]: 0.00057647 [jit_opt_after_cconv]: 0.00022535, [1] [Cycle 1]: 0.00021441, [11] [c_1]: 3.385e-05 [parameter_eliminate]: 6.02999e-06 [updatestate_depend_eliminate]: 1.362e-05 [updatestate_assign_eliminate]: 5.09e-06 [updatestate_loads_eliminate]: 3.01999e-06 [cse]: 4.889e-05 [call_graph_tuple_transform]: 3.064e-05 [tuple_list_get_item_eliminator]: 7.25e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 7.57002e-06 [remove_dup_value]: 2.086e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 1.652e-05 [add_recomputation]: 6.546e-05 [cse_after_recomputation]: 3.219e-05, [1] [Cycle 1]: 2.507e-05, [1] [cse]: 1.667e-05 [auto_monad_reorder]: 1.986e-05 [get_jit_bprop_graph]: 2.62001e-06 [rewriter_after_jit_bprop_graph]: 9.66e-06 [opt_after_jit_grad]: 0.00067161 [symbol_engine_optimizer]: 0.00010641, [1] [Cycle 1]: 9.92e-05, [6] [build]: 4.97e-06 [elim_shapecalc]: 1.042e-05 [elim_not_effective]: 2.126e-05 [opt_reshape]: 8.08001e-06 [fold_const_symbol]: 1.494e-05 [renormalize]: 7.2e-07 [validate]: 0.00032522 Sums bootstrap : 0.000401s : 0.07% type_inference : 0.513124s : 91.41% event_method : 0.000033s : 0.01% auto_monad : 0.000097s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000729s : 0.13% rewriter_before_opt_a : 0.000136s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000106s : 0.02% jit_opt_a.loop_unroll : 0.000045s : 0.01% jit_opt_a.a_1 : 0.001056s : 0.19% jit_opt_a.with_stream_mark : 0.000048s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000017s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.00% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.00% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.042065s : 7.49% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.01% jit_opt_a.cse : 0.000065s : 0.01% jit_opt_a.replace_applicator : 0.000040s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.00% rewriter_after_opt_a : 0.000051s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000938s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.00% jit_opt_b.inline_after_opt_a : 0.000024s : 0.00% cconv : 0.000040s : 0.01% loop_unroll : 0.000576s : 0.10% jit_opt_after_cconv.c_1 : 0.000034s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000021s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000017s : 0.00% add_recomputation : 0.000065s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000020s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000672s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000325s : 0.06% Time group info: ------[substitution.] 0.000388 25 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.75% : 0.000007s : 4: substitution.graph_param_transform 87.44% : 0.000339s : 5: substitution.inline 1.33% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000007s : 4: substitution.remove_not_recompute_node 2.22% : 0.000009s : 2: substitution.replace_old_param 4.51% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.512984 2 91.28% : 0.468277s : 1: type_inference.infer 8.72% : 0.044707s : 1: type_inference.specialize ------[replace.] 0.000156 7 63.59% : 0.000099s : 5: replace.inline 36.41% : 0.000057s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000352 7 95.45% : 0.000336s : 5: match.inline 4.55% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 886 1.56% : 0.000003s : 13: predicate.accumulaten_eliminater 1.36% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000003s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.08% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_depend_swap 1.16% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.75% : 0.000010s : 28: predicate.inline 0.74% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.76% : 0.000003s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000004s : 19: predicate.load_eliminater 1.78% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.26% : 0.000002s : 13: predicate.minmaximum_grad 1.82% : 0.000003s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.06% : 0.000002s : 13: predicate.print_const_string_wrapper 1.61% : 0.000003s : 13: predicate.reduce_eliminate 1.28% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000004s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.17% : 0.000002s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000002s : 8: predicate.specialize_transform 1.50% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 1.91% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000012s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.13% : 0.000002s : 13: predicate.transpose_eliminate 1.29% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 5.00% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.15% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.043867 25 4.81% : 0.002110s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.24% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 94.95% : 0.041651s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.609752 72 0.01% : 0.000068s : 1: add_recomputation 0.02% : 0.000101s : 1: auto_monad 0.00% : 0.000026s : 1: auto_monad_reorder 0.07% : 0.000429s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000035s : 1: cse_after_recomputation 0.00% : 0.000019s : 1: environ_conv 0.01% : 0.000038s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.93% : 0.048348s : 1: jit_opt_a 0.04% : 0.000228s : 1: jit_opt_after_cconv 0.02% : 0.000117s : 1: jit_opt_b 0.10% : 0.000589s : 1: loop_unroll 0.16% : 0.000954s : 1: mutable_eliminate 0.23% : 0.001393s : 26: opt.transform.jit_opt_a 0.01% : 0.000075s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000040s : 4: opt.transform.jit_opt_b 0.00% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000097s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000683s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000746s : 1: py_interpret_to_execute 0.00% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000024s : 1: remove_dup_value 6.63% : 0.040449s : 1: renormalize.infer 0.26% : 0.001597s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000055s : 1: rewriter_after_opt_a 0.02% : 0.000142s : 1: rewriter_before_opt_a 0.02% : 0.000114s : 1: symbol_engine_optimizer 84.16% : 0.513160s : 1: type_inference TotalTime = 0.110047, [30] [bootstrap]: 0.00029942 [type_inference]: 0.0298242 [event_method]: 2.5e-05 [auto_monad]: 8.263e-05 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00010309 [rewriter_before_opt_a]: 9.035e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.00645026, [2] [Cycle 1]: 0.00228032, [27] [switch_simplify]: 6.428e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00063418 [with_stream_mark]: 2.551e-05 [recompute_prepare]: 1.058e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.584e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 5.51998e-06 [renormalize]: 0.00112988 [add_forward_monad_depend]: 8.12e-06 [auto_monad_grad]: 3.38999e-06 [auto_monad_eliminator]: 2.044e-05 [cse]: 3.853e-05 [replace_applicator]: 1.848e-05 [Cycle 2]: 0.00040707, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.06002e-06 [a_1]: 9.534e-05 [with_stream_mark]: 1.361e-05 [recompute_prepare]: 4.838e-05 [updatestate_depend_eliminate]: 5.26002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 2.38998e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 2.83e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.762e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.84998e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 7.88999e-06 [cse]: 1.646e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.636e-05 [rewriter_after_opt_a]: 4.198e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00071963 [jit_opt_b]: 0.0697602, [1] [Cycle 1]: 0.0697474, [2] [frontend_op_eliminate]: 1.617e-05 [inline_after_opt_a]: 6.765e-05 [cconv]: 4.843e-05 [loop_unroll]: 0.00091146 [jit_opt_after_cconv]: 0.00031278, [1] [Cycle 1]: 0.00030204, [11] [c_1]: 2.549e-05 [parameter_eliminate]: 7.75e-06 [updatestate_depend_eliminate]: 1.323e-05 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.02002e-06 [cse]: 5.135e-05 [call_graph_tuple_transform]: 0.00011836 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 2.69001e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 6.94999e-06 [remove_dup_value]: 2.247e-05 [partial_unused_args_eliminate]: 3.06001e-06 [environ_conv]: 8.99998e-06 [add_recomputation]: 6.767e-05 [cse_after_recomputation]: 3.345e-05, [1] [Cycle 1]: 2.486e-05, [1] [cse]: 1.631e-05 [auto_monad_reorder]: 1.967e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 1.111e-05 [opt_after_jit_grad]: 0.00076577 [symbol_engine_optimizer]: 9.596e-05, [1] [Cycle 1]: 8.701e-05, [6] [build]: 6.61999e-06 [elim_shapecalc]: 1.026e-05 [elim_not_effective]: 1.973e-05 [opt_reshape]: 8.23999e-06 [fold_const_symbol]: 9.53002e-06 [renormalize]: 1.03001e-06 [validate]: 5.781e-05 Sums bootstrap : 0.000299s : 0.83% type_inference : 0.029824s : 83.06% event_method : 0.000025s : 0.07% auto_monad : 0.000083s : 0.23% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.29% rewriter_before_opt_a : 0.000090s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.20% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000730s : 2.03% jit_opt_a.with_stream_mark : 0.000039s : 0.11% jit_opt_a.recompute_prepare : 0.000059s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001130s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.08% jit_opt_a.cse : 0.000055s : 0.15% jit_opt_a.replace_applicator : 0.000025s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000042s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000720s : 2.00% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000068s : 0.19% cconv : 0.000048s : 0.13% loop_unroll : 0.000911s : 2.54% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000051s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000118s : 0.33% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000022s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.03% add_recomputation : 0.000068s : 0.19% cse_after_recomputation.cse : 0.000016s : 0.05% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.03% opt_after_jit_grad : 0.000766s : 2.13% symbol_engine_optimizer.build : 0.000007s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.16% Time group info: ------[substitution.] 0.000278 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.47% : 0.000007s : 3: substitution.graph_param_transform 85.04% : 0.000237s : 4: substitution.inline 1.74% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.37% : 0.000007s : 2: substitution.replace_old_param 5.10% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029717 2 91.64% : 0.027232s : 1: type_inference.infer 8.36% : 0.002486s : 1: type_inference.specialize ------[replace.] 0.000085 6 67.64% : 0.000058s : 4: replace.inline 32.36% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 6 94.71% : 0.000234s : 4: match.inline 5.29% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000001s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.10% : 0.000001s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.05% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.41% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000002s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 7.41% : 0.000010s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.20% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 15: predicate.load_eliminater 2.41% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.61% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.82% : 0.000001s : 3: predicate.opt_reshape 1.98% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.21% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.82% : 0.000001s : 3: predicate.reset_defer_inline 1.07% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.79% : 0.000001s : 6: predicate.specialize_transform 1.08% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 1.80% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000011s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000002s : 10: predicate.transpose_eliminate 1.15% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.03% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 6.36% : 0.000009s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.35% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000940 13 46.68% : 0.000439s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.26% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.06% : 0.000442s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112389 72 0.06% : 0.000072s : 1: add_recomputation 0.08% : 0.000087s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.28% : 0.000319s : 1: bootstrap 0.05% : 0.000051s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000031s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.74% : 0.006454s : 1: jit_opt_a 0.28% : 0.000316s : 1: jit_opt_after_cconv 62.08% : 0.069766s : 1: jit_opt_b 0.83% : 0.000929s : 1: loop_unroll 0.65% : 0.000733s : 1: mutable_eliminate 0.90% : 0.001017s : 26: opt.transform.jit_opt_a 0.14% : 0.000153s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000055s : 4: opt.transform.jit_opt_b 0.02% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000784s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000108s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000026s : 1: remove_dup_value 0.57% : 0.000637s : 1: renormalize.infer 0.43% : 0.000482s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000094s : 1: rewriter_before_opt_a 0.09% : 0.000099s : 1: symbol_engine_optimizer 26.56% : 0.029855s : 1: type_inference TotalTime = 0.664383, [30] [bootstrap]: 0.00036777 [type_inference]: 0.590418 [event_method]: 3.137e-05 [auto_monad]: 0.00012284 [graph_reusing]: 7.58001e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 0.00147947 [rewriter_before_opt_a]: 0.00014374 [expand_dump_flag]: 5.35001e-06 [jit_opt_a]: 0.0379272, [2] [Cycle 1]: 0.0316637, [27] [switch_simplify]: 8.186e-05 [loop_unroll]: 3.169e-05 [a_1]: 0.00076116 [with_stream_mark]: 2.618e-05 [recompute_prepare]: 1.242e-05 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 4.33001e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 8.75001e-06 [updatestate_useless_node_eliminater]: 7.83001e-06 [accelerated_algorithm]: 7.67998e-06 [meta_shard_fg_expand]: 4.95999e-06 [get_grad_eliminate_]: 7.88999e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.042e-05 [j_node_and_user_rematch]: 1.372e-05 [meta_fg_expand]: 3.03e-06 [replace_old_param]: 1.279e-05 [inline_without_move]: 6.98e-06 [renormalize]: 0.0302086 [add_forward_monad_depend]: 5.384e-05 [auto_monad_grad]: 3.10998e-06 [auto_monad_eliminator]: 2.912e-05 [cse]: 5.113e-05 [replace_applicator]: 3.513e-05 [Cycle 2]: 0.0004961, [27] [switch_simplify]: 9.65002e-06 [loop_unroll]: 9.52999e-06 [a_1]: 0.0001625 [with_stream_mark]: 2.059e-05 [recompute_prepare]: 7.13e-06 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.66999e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.47001e-06 [accelerated_algorithm]: 8.25e-06 [meta_shard_fg_expand]: 2.91e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 4.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.157e-05 [j_node_and_user_rematch]: 1.198e-05 [meta_fg_expand]: 3.56999e-06 [replace_old_param]: 1.156e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.17001e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 9.73002e-06 [cse]: 2.389e-05 [replace_applicator]: 7.6e-06 [py_interpret_to_execute_after_opt_a]: 2.476e-05 [rewriter_after_opt_a]: 5.792e-05 [convert_after_rewriter]: 8.69e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00106358 [jit_opt_b]: 7.844e-05, [1] [Cycle 1]: 6.635e-05, [2] [frontend_op_eliminate]: 2.554e-05 [inline_after_opt_a]: 2.402e-05 [cconv]: 3.444e-05 [loop_unroll]: 0.00056098 [jit_opt_after_cconv]: 0.00021332, [1] [Cycle 1]: 0.00020352, [11] [c_1]: 3.327e-05 [parameter_eliminate]: 5.03002e-06 [updatestate_depend_eliminate]: 8.51002e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 3.72998e-06 [cse]: 4.838e-05 [call_graph_tuple_transform]: 2.885e-05 [tuple_list_get_item_eliminator]: 7.97e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 7.92e-06 [remove_dup_value]: 1.98e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 1.19e-05 [add_recomputation]: 0.00012289 [cse_after_recomputation]: 3.24e-05, [1] [Cycle 1]: 2.568e-05, [1] [cse]: 1.831e-05 [auto_monad_reorder]: 2.148e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 3.33e-05 [opt_after_jit_grad]: 0.00277059 [symbol_engine_optimizer]: 0.00011845, [1] [Cycle 1]: 0.0001038, [6] [build]: 8.50001e-06 [elim_shapecalc]: 1.152e-05 [elim_not_effective]: 2.627e-05 [opt_reshape]: 1.065e-05 [fold_const_symbol]: 1.09e-05 [renormalize]: 9.99979e-07 [validate]: 7.099e-05 Sums bootstrap : 0.000368s : 0.06% type_inference : 0.590418s : 93.80% event_method : 0.000031s : 0.00% auto_monad : 0.000123s : 0.02% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001479s : 0.24% rewriter_before_opt_a : 0.000144s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000924s : 0.15% jit_opt_a.with_stream_mark : 0.000047s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.00% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.030209s : 4.80% jit_opt_a.add_forward_monad_depend : 0.000056s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.01% jit_opt_a.cse : 0.000075s : 0.01% jit_opt_a.replace_applicator : 0.000043s : 0.01% py_interpret_to_execute_after_opt_a : 0.000025s : 0.00% rewriter_after_opt_a : 0.000058s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001064s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.00% jit_opt_b.inline_after_opt_a : 0.000024s : 0.00% cconv : 0.000034s : 0.01% loop_unroll : 0.000561s : 0.09% jit_opt_after_cconv.c_1 : 0.000033s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000020s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000123s : 0.02% cse_after_recomputation.cse : 0.000018s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000033s : 0.01% opt_after_jit_grad : 0.002771s : 0.44% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000071s : 0.01% Time group info: ------[substitution.] 0.000324 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 4: substitution.graph_param_transform 85.31% : 0.000277s : 4: substitution.inline 1.99% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000007s : 2: substitution.replace_old_param 5.22% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.590186 2 92.54% : 0.546137s : 1: type_inference.infer 7.46% : 0.044048s : 1: type_inference.specialize ------[replace.] 0.000111 6 63.49% : 0.000071s : 4: replace.inline 36.51% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 6 94.69% : 0.000274s : 4: match.inline 5.31% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 2.75% : 0.000005s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000002s : 12: predicate.addn_check_dump 1.99% : 0.000003s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.56% : 0.000003s : 12: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 0.99% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.01% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.53% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.92% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 0.93% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.38% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_depend_swap 1.03% : 0.000002s : 12: predicate.environ_get_eliminate 1.45% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 4.81% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.24% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 3.05% : 0.000005s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.83% : 0.000001s : 12: predicate.merge_addn 0.86% : 0.000001s : 12: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 2.48% : 0.000004s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.05% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.93% : 0.000002s : 4: predicate.row_tensor_eliminate 0.98% : 0.000002s : 12: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 18: predicate.switch_defer_inline 1.62% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.70% : 0.000011s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.02% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.04% : 0.000003s : 12: predicate.value_based_eliminate 0.30% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004198 22 54.91% : 0.002305s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.45% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.64% : 0.001832s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.695918 72 0.02% : 0.000128s : 1: add_recomputation 0.02% : 0.000131s : 1: auto_monad 0.00% : 0.000024s : 1: auto_monad_reorder 0.06% : 0.000393s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.00% : 0.000035s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 4.06% : 0.028279s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 5.45% : 0.037934s : 1: jit_opt_a 0.03% : 0.000216s : 1: jit_opt_after_cconv 0.01% : 0.000081s : 1: jit_opt_b 0.08% : 0.000573s : 1: loop_unroll 0.15% : 0.001078s : 1: mutable_eliminate 0.18% : 0.001244s : 26: opt.transform.jit_opt_a 0.01% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000041s : 4: opt.transform.jit_opt_b 0.00% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000065s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000055s : 4: opt.transform.symbol_engine_opt 0.40% : 0.002796s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.001500s : 1: py_interpret_to_execute 0.00% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 4.06% : 0.028252s : 1: renormalize.infer 0.28% : 0.001938s : 1: renormalize.specialize 0.01% : 0.000060s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000063s : 1: rewriter_after_opt_a 0.02% : 0.000150s : 1: rewriter_before_opt_a 0.02% : 0.000122s : 1: symbol_engine_optimizer 84.85% : 0.590453s : 1: type_inference TotalTime = 0.355369, [30] [bootstrap]: 0.00069458 [type_inference]: 0.304411 [event_method]: 2.811e-05 [auto_monad]: 8.935e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 3.61999e-06 [py_interpret_to_execute]: 0.00065482 [rewriter_before_opt_a]: 0.00011035 [expand_dump_flag]: 4.68999e-06 [jit_opt_a]: 0.0158755, [2] [Cycle 1]: 0.00905336, [27] [switch_simplify]: 8.031e-05 [loop_unroll]: 3.269e-05 [a_1]: 0.00188437 [with_stream_mark]: 4.03e-05 [recompute_prepare]: 1.928e-05 [updatestate_depend_eliminate]: 5.24998e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.92002e-06 [parameter_eliminate]: 3.38e-06 [specialize_transform]: 1.026e-05 [updatestate_useless_node_eliminater]: 7.08e-06 [accelerated_algorithm]: 9.52001e-06 [meta_shard_fg_expand]: 5.39e-06 [get_grad_eliminate_]: 8.52e-06 [merge_forward]: 5.57999e-06 [cell_reuse_recompute_pass]: 5.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.498e-05 [j_node_and_user_rematch]: 1.758e-05 [meta_fg_expand]: 5.69e-06 [replace_old_param]: 1.667e-05 [inline_without_move]: 1.372e-05 [renormalize]: 0.00633626 [add_forward_monad_depend]: 1.077e-05 [auto_monad_grad]: 3.26999e-06 [auto_monad_eliminator]: 2.518e-05 [cse]: 4.112e-05 [replace_applicator]: 3.247e-05 [Cycle 2]: 0.00051533, [27] [switch_simplify]: 1.001e-05 [loop_unroll]: 7.17002e-06 [a_1]: 0.00016856 [with_stream_mark]: 1.921e-05 [recompute_prepare]: 7.25e-06 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.88998e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 8.35001e-06 [meta_shard_fg_expand]: 2.72001e-06 [get_grad_eliminate_]: 6.52001e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 5.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.528e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 4.35e-06 [replace_old_param]: 1.344e-05 [inline_without_move]: 8.03999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.88997e-06 [auto_monad_grad]: 1.40001e-06 [auto_monad_eliminator]: 1.2e-05 [cse]: 2.03e-05 [replace_applicator]: 8.37e-06 [py_interpret_to_execute_after_opt_a]: 2.591e-05 [rewriter_after_opt_a]: 5.281e-05 [convert_after_rewriter]: 9.92001e-06 [order_py_execute_after_rewriter]: 8.01001e-06 [mutable_eliminate]: 0.00137325 [jit_opt_b]: 7.467e-05, [1] [Cycle 1]: 6.355e-05, [2] [frontend_op_eliminate]: 2.652e-05 [inline_after_opt_a]: 2.352e-05 [cconv]: 3.574e-05 [loop_unroll]: 0.00215591 [jit_opt_after_cconv]: 0.00023951, [1] [Cycle 1]: 0.00022974, [11] [c_1]: 4.639e-05 [parameter_eliminate]: 5.04e-06 [updatestate_depend_eliminate]: 7.8e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.88998e-06 [cse]: 4.383e-05 [call_graph_tuple_transform]: 3.278e-05 [tuple_list_get_item_eliminator]: 7.93999e-06 [none_parameter_eliminate]: 2.09e-06 [renormalize]: 1.10999e-06 [switch_simplify]: 8.90001e-06 [remove_dup_value]: 1.883e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 1.345e-05 [add_recomputation]: 6.628e-05 [cse_after_recomputation]: 2.899e-05, [1] [Cycle 1]: 2.227e-05, [1] [cse]: 1.371e-05 [auto_monad_reorder]: 1.969e-05 [get_jit_bprop_graph]: 2.33002e-06 [rewriter_after_jit_bprop_graph]: 1.27e-05 [opt_after_jit_grad]: 0.0286055 [symbol_engine_optimizer]: 0.00032336, [1] [Cycle 1]: 0.0003086, [6] [build]: 9.66e-06 [elim_shapecalc]: 1.36e-05 [elim_not_effective]: 0.00020271 [opt_reshape]: 1.408e-05 [fold_const_symbol]: 2.105e-05 [renormalize]: 1.49e-06 [validate]: 8.256e-05 Sums bootstrap : 0.000695s : 0.20% type_inference : 0.304411s : 87.47% event_method : 0.000028s : 0.01% auto_monad : 0.000089s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000655s : 0.19% rewriter_before_opt_a : 0.000110s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.002053s : 0.59% jit_opt_a.with_stream_mark : 0.000060s : 0.02% jit_opt_a.recompute_prepare : 0.000027s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000010s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000050s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000028s : 0.01% jit_opt_a.meta_fg_expand : 0.000010s : 0.00% jit_opt_a.replace_old_param : 0.000030s : 0.01% jit_opt_a.inline_without_move : 0.000022s : 0.01% jit_opt_a.renormalize : 0.006336s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000061s : 0.02% jit_opt_a.replace_applicator : 0.000041s : 0.01% py_interpret_to_execute_after_opt_a : 0.000026s : 0.01% rewriter_after_opt_a : 0.000053s : 0.02% convert_after_rewriter : 0.000010s : 0.00% order_py_execute_after_rewriter : 0.000008s : 0.00% mutable_eliminate : 0.001373s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000036s : 0.01% loop_unroll : 0.002156s : 0.62% jit_opt_after_cconv.c_1 : 0.000046s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000066s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.00% opt_after_jit_grad : 0.028606s : 8.22% symbol_engine_optimizer.build : 0.000010s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000203s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000014s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000021s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000083s : 0.02% Time group info: ------[substitution.] 0.000353 24 1.13% : 0.000004s : 2: substitution.elim_not_effective 1.08% : 0.000004s : 2: substitution.fold_const_symbol 2.36% : 0.000008s : 4: substitution.graph_param_transform 81.84% : 0.000289s : 4: substitution.inline 1.77% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000008s : 4: substitution.remove_not_recompute_node 2.69% : 0.000010s : 2: substitution.replace_old_param 6.93% : 0.000024s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.304256 2 77.75% : 0.236563s : 1: type_inference.infer 22.25% : 0.067693s : 1: type_inference.specialize ------[replace.] 0.001112 6 93.62% : 0.001041s : 4: replace.inline 6.38% : 0.000071s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000307 6 92.94% : 0.000285s : 4: match.inline 7.06% : 0.000022s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000215 830 1.72% : 0.000004s : 12: predicate.accumulaten_eliminater 2.91% : 0.000006s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.43% : 0.000003s : 12: predicate.addn_zero_filter 2.34% : 0.000005s : 12: predicate.arithmetic_simplify 1.57% : 0.000003s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 0.73% : 0.000002s : 12: predicate.compare_switch_simplify 1.23% : 0.000003s : 12: predicate.depend_value_elim 0.99% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 2.06% : 0.000004s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.91% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.60% : 0.000003s : 12: predicate.environ_add_const_eliminate 0.90% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.65% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000003s : 12: predicate.environ_get_eliminate 0.77% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000003s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 5.22% : 0.000011s : 26: predicate.inline 0.83% : 0.000002s : 8: predicate.inline_without_move 0.28% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.91% : 0.000004s : 8: predicate.less_batch_normalization 1.29% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000004s : 18: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.02% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.68% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.48% : 0.000003s : 12: predicate.merge_addn 0.93% : 0.000002s : 12: predicate.minmaximum_grad 1.36% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 1.52% : 0.000003s : 18: predicate.partial_eliminate 0.98% : 0.000002s : 12: predicate.print_const_string_wrapper 2.80% : 0.000006s : 12: predicate.reduce_eliminate 1.64% : 0.000004s : 14: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000002s : 8: predicate.remove_not_recompute_node 1.37% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000002s : 8: predicate.replace_old_param 0.23% : 0.000001s : 4: predicate.reset_defer_inline 0.99% : 0.000002s : 12: predicate.reshape_eliminate 1.60% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000002s : 4: predicate.row_tensor_eliminate 1.49% : 0.000003s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.45% : 0.000003s : 8: predicate.special_op_eliminate 0.71% : 0.000002s : 8: predicate.specialize_transform 1.60% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.80% : 0.000004s : 12: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.35% : 0.000007s : 18: predicate.switch_defer_inline 2.00% : 0.000004s : 18: predicate.switch_layer_defer_inline 5.92% : 0.000013s : 58: predicate.switch_simplify 1.54% : 0.000003s : 12: predicate.tile_eliminate 1.33% : 0.000003s : 12: predicate.transpose_eliminate 1.52% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 0.97% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.89% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.52% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.20% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.80% : 0.000004s : 12: predicate.value_based_eliminate 0.22% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003936 26 63.66% : 0.002505s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000069s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.60% : 0.001362s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.364401 72 0.02% : 0.000070s : 1: add_recomputation 0.03% : 0.000093s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.20% : 0.000730s : 1: bootstrap 0.01% : 0.000039s : 1: cconv 0.00% : 0.000014s : 1: convert_after_rewriter 0.01% : 0.000033s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.36% : 0.015883s : 1: jit_opt_a 0.07% : 0.000244s : 1: jit_opt_after_cconv 0.02% : 0.000079s : 1: jit_opt_b 0.60% : 0.002185s : 1: loop_unroll 0.38% : 0.001396s : 1: mutable_eliminate 0.66% : 0.002394s : 26: opt.transform.jit_opt_a 0.02% : 0.000089s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000031s : 1: opt.transform.mutable_eliminate 0.02% : 0.000078s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000245s : 4: opt.transform.symbol_engine_opt 7.86% : 0.028633s : 1: opt_after_jit_grad 0.00% : 0.000011s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.18% : 0.000666s : 1: py_interpret_to_execute 0.01% : 0.000030s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.86% : 0.003128s : 1: renormalize.infer 0.87% : 0.003185s : 1: renormalize.specialize 0.00% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000058s : 1: rewriter_after_opt_a 0.03% : 0.000117s : 1: rewriter_before_opt_a 0.09% : 0.000328s : 1: symbol_engine_optimizer 83.55% : 0.304442s : 1: type_inference TotalTime = 0.0434647, [30] [bootstrap]: 0.00066192 [type_inference]: 0.00926214 [event_method]: 2.401e-05 [auto_monad]: 8.325e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 6.628e-05 [rewriter_before_opt_a]: 8.524e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0293617, [2] [Cycle 1]: 0.0236316, [27] [switch_simplify]: 8.537e-05 [loop_unroll]: 3.187e-05 [a_1]: 0.0216077 [with_stream_mark]: 3.388e-05 [recompute_prepare]: 1.512e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 3.2e-06 [specialize_transform]: 8.90001e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 8.11002e-06 [meta_shard_fg_expand]: 5.47001e-06 [get_grad_eliminate_]: 7.78999e-06 [merge_forward]: 5.40001e-06 [cell_reuse_recompute_pass]: 3.61001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.939e-05 [j_node_and_user_rematch]: 1.28e-05 [meta_fg_expand]: 3.49001e-06 [replace_old_param]: 1.235e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00134632 [add_forward_monad_depend]: 9.91e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 2.335e-05 [cse]: 3.806e-05 [replace_applicator]: 2.278e-05 [Cycle 2]: 0.00040256, [27] [switch_simplify]: 7.40998e-06 [loop_unroll]: 6.70002e-06 [a_1]: 0.0001146 [with_stream_mark]: 1.403e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 2.88998e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 3.02002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.059e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.67001e-06 [inline_without_move]: 5.76e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.52001e-06 [auto_monad_grad]: 1.16002e-06 [auto_monad_eliminator]: 1.083e-05 [cse]: 1.519e-05 [replace_applicator]: 6.84999e-06 [py_interpret_to_execute_after_opt_a]: 2.175e-05 [rewriter_after_opt_a]: 4.856e-05 [convert_after_rewriter]: 1.01e-05 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00142681 [jit_opt_b]: 7.631e-05, [1] [Cycle 1]: 6.442e-05, [2] [frontend_op_eliminate]: 2.841e-05 [inline_after_opt_a]: 2.145e-05 [cconv]: 4.318e-05 [loop_unroll]: 0.00067654 [jit_opt_after_cconv]: 0.00020949, [1] [Cycle 1]: 0.00020013, [11] [c_1]: 2.712e-05 [parameter_eliminate]: 6.41e-06 [updatestate_depend_eliminate]: 1.189e-05 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 4.318e-05 [call_graph_tuple_transform]: 3.256e-05 [tuple_list_get_item_eliminator]: 6.84001e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 6.57002e-06 [remove_dup_value]: 2.157e-05 [partial_unused_args_eliminate]: 2.89001e-06 [environ_conv]: 8.64e-06 [add_recomputation]: 6.92e-05 [cse_after_recomputation]: 3.237e-05, [1] [Cycle 1]: 2.354e-05, [1] [cse]: 1.448e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 2.72001e-06 [rewriter_after_jit_bprop_graph]: 1.269e-05 [opt_after_jit_grad]: 0.00073026 [symbol_engine_optimizer]: 9.631e-05, [1] [Cycle 1]: 8.681e-05, [6] [build]: 6.53e-06 [elim_shapecalc]: 9.72001e-06 [elim_not_effective]: 1.934e-05 [opt_reshape]: 8.32e-06 [fold_const_symbol]: 1.066e-05 [renormalize]: 8.79983e-07 [validate]: 5.638e-05 Sums bootstrap : 0.000662s : 1.78% type_inference : 0.009262s : 24.88% event_method : 0.000024s : 0.06% auto_monad : 0.000083s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000066s : 0.18% rewriter_before_opt_a : 0.000085s : 0.23% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000093s : 0.25% jit_opt_a.loop_unroll : 0.000039s : 0.10% jit_opt_a.a_1 : 0.021722s : 58.36% jit_opt_a.with_stream_mark : 0.000048s : 0.13% jit_opt_a.recompute_prepare : 0.000021s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000015s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001346s : 3.62% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.09% jit_opt_a.cse : 0.000053s : 0.14% jit_opt_a.replace_applicator : 0.000030s : 0.08% py_interpret_to_execute_after_opt_a : 0.000022s : 0.06% rewriter_after_opt_a : 0.000049s : 0.13% convert_after_rewriter : 0.000010s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.001427s : 3.83% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.08% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000043s : 0.12% loop_unroll : 0.000677s : 1.82% jit_opt_after_cconv.c_1 : 0.000027s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000043s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000022s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000069s : 0.19% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000013s : 0.03% opt_after_jit_grad : 0.000730s : 1.96% symbol_engine_optimizer.build : 0.000007s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.15% Time group info: ------[substitution.] 0.000463 23 0.82% : 0.000004s : 2: substitution.elim_not_effective 0.39% : 0.000002s : 2: substitution.fold_const_symbol 1.59% : 0.000007s : 3: substitution.graph_param_transform 87.26% : 0.000404s : 4: substitution.inline 1.13% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.45% : 0.000007s : 4: substitution.remove_not_recompute_node 1.76% : 0.000008s : 2: substitution.replace_old_param 5.61% : 0.000026s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009150 2 84.11% : 0.007695s : 1: type_inference.infer 15.89% : 0.001454s : 1: type_inference.specialize ------[replace.] 0.000184 6 63.05% : 0.000116s : 4: replace.inline 36.95% : 0.000068s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000423 6 94.34% : 0.000399s : 4: match.inline 5.66% : 0.000024s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000228 691 1.22% : 0.000003s : 10: predicate.accumulaten_eliminater 1.13% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.36% : 0.000003s : 10: predicate.addn_check_dump 1.46% : 0.000003s : 10: predicate.addn_zero_filter 3.15% : 0.000007s : 10: predicate.arithmetic_simplify 1.38% : 0.000003s : 10: predicate.cast_eliminate 0.92% : 0.000002s : 3: predicate.check_bprop_eliminate 1.66% : 0.000004s : 10: predicate.compare_switch_simplify 1.37% : 0.000003s : 10: predicate.depend_value_elim 0.83% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 2.87% : 0.000007s : 10: predicate.dict_get_item_eliminator 1.88% : 0.000004s : 10: predicate.dict_set_item_eliminator 0.76% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.16% : 0.000000s : 3: predicate.elim_not_effective 0.36% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000003s : 10: predicate.environ_add_const_eliminate 0.82% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.81% : 0.000002s : 10: predicate.environ_get_depend_swap 1.25% : 0.000003s : 10: predicate.environ_get_eliminate 0.87% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000003s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 4.59% : 0.000010s : 22: predicate.inline 0.44% : 0.000001s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000003s : 6: predicate.less_batch_normalization 1.13% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 2.28% : 0.000005s : 15: predicate.load_eliminater 1.72% : 0.000004s : 3: predicate.loop_unroll_after_grad 2.61% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.67% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 10: predicate.merge_addn 1.06% : 0.000002s : 10: predicate.minmaximum_grad 2.70% : 0.000006s : 3: predicate.mutable_eliminate 0.26% : 0.000001s : 3: predicate.opt_reshape 1.26% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000003s : 10: predicate.print_const_string_wrapper 3.21% : 0.000007s : 10: predicate.reduce_eliminate 1.66% : 0.000004s : 12: predicate.redundant_stop_gradient_eliminater 0.32% : 0.000001s : 6: predicate.remove_not_recompute_node 1.04% : 0.000002s : 18: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.08% : 0.000002s : 10: predicate.reshape_eliminate 1.74% : 0.000004s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000002s : 3: predicate.row_tensor_eliminate 1.23% : 0.000003s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 6: predicate.special_op_eliminate 0.47% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000004s : 10: predicate.stack_unstack_eliminate 0.29% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.22% : 0.000007s : 16: predicate.switch_defer_inline 1.77% : 0.000004s : 16: predicate.switch_layer_defer_inline 4.87% : 0.000011s : 53: predicate.switch_simplify 1.42% : 0.000003s : 10: predicate.tile_eliminate 1.41% : 0.000003s : 10: predicate.transpose_eliminate 2.27% : 0.000005s : 10: predicate.tuple_list_convert_item_index_to_positive 4.39% : 0.000010s : 10: predicate.tuple_list_get_item_depend_reorder 2.76% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.03% : 0.000005s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000004s : 15: predicate.updatestate_pure_node_eliminater 2.30% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 2.27% : 0.000005s : 10: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001249 13 47.13% : 0.000589s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.19% : 0.000115s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.68% : 0.000546s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066918 72 0.11% : 0.000074s : 1: add_recomputation 0.13% : 0.000087s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 1.05% : 0.000700s : 1: bootstrap 0.07% : 0.000047s : 1: cconv 0.02% : 0.000013s : 1: convert_after_rewriter 0.05% : 0.000035s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 43.88% : 0.029366s : 1: jit_opt_a 0.39% : 0.000263s : 1: jit_opt_after_cconv 0.12% : 0.000080s : 1: jit_opt_b 1.03% : 0.000692s : 1: loop_unroll 2.17% : 0.001450s : 1: mutable_eliminate 32.89% : 0.022010s : 26: opt.transform.jit_opt_a 0.10% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000040s : 4: opt.transform.jit_opt_b 0.03% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000037s : 1: opt.transform.mutable_eliminate 0.05% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.12% : 0.000747s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000070s : 1: py_interpret_to_execute 0.04% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000025s : 1: remove_dup_value 1.06% : 0.000712s : 1: renormalize.infer 0.93% : 0.000621s : 1: renormalize.specialize 0.02% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000055s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.15% : 0.000100s : 1: symbol_engine_optimizer 13.89% : 0.009296s : 1: type_inference TotalTime = 0.334084, [30] [bootstrap]: 0.00039507 [type_inference]: 0.31749 [event_method]: 3.244e-05 [auto_monad]: 9.393e-05 [graph_reusing]: 6.74001e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00085857 [rewriter_before_opt_a]: 0.0001323 [expand_dump_flag]: 5.02e-06 [jit_opt_a]: 0.0121441, [2] [Cycle 1]: 0.00780632, [27] [switch_simplify]: 7.829e-05 [loop_unroll]: 3.726e-05 [a_1]: 0.0018225 [with_stream_mark]: 2.643e-05 [recompute_prepare]: 1.16e-05 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 4.08001e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 8.37998e-06 [updatestate_useless_node_eliminater]: 7.30998e-06 [accelerated_algorithm]: 7.68001e-06 [meta_shard_fg_expand]: 3.47002e-06 [get_grad_eliminate_]: 7.83999e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 1.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.883e-05 [j_node_and_user_rematch]: 1.221e-05 [meta_fg_expand]: 3.27002e-06 [replace_old_param]: 1.436e-05 [inline_without_move]: 7.40998e-06 [renormalize]: 0.00536198 [add_forward_monad_depend]: 1.144e-05 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 2.233e-05 [cse]: 4.341e-05 [replace_applicator]: 2.667e-05 [Cycle 2]: 0.00050217, [27] [switch_simplify]: 8.52e-06 [loop_unroll]: 6.56999e-06 [a_1]: 0.00019325 [with_stream_mark]: 1.996e-05 [recompute_prepare]: 7.77e-06 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.57001e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.74002e-06 [cell_reuse_recompute_pass]: 3.08e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.005e-05 [j_node_and_user_rematch]: 1.128e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.174e-05 [inline_without_move]: 6.96001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.45001e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 7.91001e-06 [cse]: 1.98e-05 [replace_applicator]: 6.61999e-06 [py_interpret_to_execute_after_opt_a]: 1.842e-05 [rewriter_after_opt_a]: 4.541e-05 [convert_after_rewriter]: 8.66002e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00084333 [jit_opt_b]: 6.283e-05, [1] [Cycle 1]: 5.361e-05, [2] [frontend_op_eliminate]: 2.101e-05 [inline_after_opt_a]: 2.007e-05 [cconv]: 3.52e-05 [loop_unroll]: 0.00049998 [jit_opt_after_cconv]: 0.00019135, [1] [Cycle 1]: 0.00018411, [11] [c_1]: 2.703e-05 [parameter_eliminate]: 4.53001e-06 [updatestate_depend_eliminate]: 9.29e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 3.915e-05 [call_graph_tuple_transform]: 2.702e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.71999e-06 [remove_dup_value]: 2.145e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.155e-05 [add_recomputation]: 6.246e-05 [cse_after_recomputation]: 2.926e-05, [1] [Cycle 1]: 2.198e-05, [1] [cse]: 1.556e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.93003e-06 [rewriter_after_jit_bprop_graph]: 7.81001e-06 [opt_after_jit_grad]: 0.0005522 [symbol_engine_optimizer]: 0.00017604, [1] [Cycle 1]: 8.037e-05, [6] [build]: 5.07e-06 [elim_shapecalc]: 1.071e-05 [elim_not_effective]: 1.713e-05 [opt_reshape]: 6.66999e-06 [fold_const_symbol]: 1.024e-05 [renormalize]: 9.10019e-07 [validate]: 7.083e-05 Sums bootstrap : 0.000395s : 0.12% type_inference : 0.317490s : 96.39% event_method : 0.000032s : 0.01% auto_monad : 0.000094s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000859s : 0.26% rewriter_before_opt_a : 0.000132s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.03% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.002016s : 0.61% jit_opt_a.with_stream_mark : 0.000046s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.005362s : 1.63% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000063s : 0.02% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000045s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000843s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000035s : 0.01% loop_unroll : 0.000500s : 0.15% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000062s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000552s : 0.17% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000071s : 0.02% Time group info: ------[substitution.] 0.000384 25 0.89% : 0.000003s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.78% : 0.000007s : 4: substitution.graph_param_transform 86.91% : 0.000333s : 5: substitution.inline 1.51% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000006s : 4: substitution.remove_not_recompute_node 2.14% : 0.000008s : 2: substitution.replace_old_param 4.78% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.317357 2 94.31% : 0.299313s : 1: type_inference.infer 5.69% : 0.018044s : 1: type_inference.specialize ------[replace.] 0.000133 7 68.83% : 0.000091s : 5: replace.inline 31.17% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000347 7 95.13% : 0.000330s : 5: match.inline 4.87% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000162 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 2.37% : 0.000004s : 13: predicate.arithmetic_simplify 1.56% : 0.000003s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.72% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 6.23% : 0.000010s : 28: predicate.inline 1.03% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000003s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 1.65% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.14% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.64% : 0.000006s : 20: predicate.switch_defer_inline 2.47% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.71% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003407 25 57.64% : 0.001964s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.46% : 0.001345s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.341817 72 0.02% : 0.000066s : 1: add_recomputation 0.03% : 0.000099s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.12% : 0.000419s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000039s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.55% : 0.012148s : 1: jit_opt_a 0.06% : 0.000194s : 1: jit_opt_after_cconv 0.02% : 0.000066s : 1: jit_opt_b 0.15% : 0.000510s : 1: loop_unroll 0.25% : 0.000858s : 1: mutable_eliminate 0.68% : 0.002319s : 26: opt.transform.jit_opt_a 0.02% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000564s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000874s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 1.17% : 0.004002s : 1: renormalize.infer 0.39% : 0.001346s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.04% : 0.000138s : 1: rewriter_before_opt_a 0.05% : 0.000180s : 1: symbol_engine_optimizer 92.89% : 0.317527s : 1: type_inference TotalTime = 0.148023, [30] [bootstrap]: 0.00031109 [type_inference]: 0.137972 [event_method]: 2.685e-05 [auto_monad]: 7.693e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 3.43e-06 [py_interpret_to_execute]: 0.00012805 [rewriter_before_opt_a]: 0.00010383 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00696052, [2] [Cycle 1]: 0.00222046, [27] [switch_simplify]: 7.141e-05 [loop_unroll]: 3.049e-05 [a_1]: 0.00061373 [with_stream_mark]: 2.528e-05 [recompute_prepare]: 8.45999e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 4.03001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.78e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.071e-05 [inline_without_move]: 5.81e-06 [renormalize]: 0.00109312 [add_forward_monad_depend]: 7.9e-06 [auto_monad_grad]: 2.76999e-06 [auto_monad_eliminator]: 1.745e-05 [cse]: 3.927e-05 [replace_applicator]: 1.619e-05 [Cycle 2]: 0.00069349, [27] [switch_simplify]: 5.98998e-06 [loop_unroll]: 5.32999e-06 [a_1]: 0.00011079 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 6.69001e-06 [cell_reuse_recompute_pass]: 4.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.634e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.54999e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 3.45e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 1.056e-05 [cse]: 2.054e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.738e-05 [rewriter_after_opt_a]: 4.181e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00072378 [jit_opt_b]: 5.253e-05, [1] [Cycle 1]: 4.385e-05, [2] [frontend_op_eliminate]: 1.636e-05 [inline_after_opt_a]: 1.706e-05 [cconv]: 3.199e-05 [loop_unroll]: 0.00043456 [jit_opt_after_cconv]: 0.00015795, [1] [Cycle 1]: 0.00015031, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 8.26002e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.90002e-06 [cse]: 2.684e-05 [call_graph_tuple_transform]: 2.185e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.806e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 7.20998e-06 [add_recomputation]: 5.547e-05 [cse_after_recomputation]: 2.482e-05, [1] [Cycle 1]: 1.858e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 2.21003e-06 [rewriter_after_jit_bprop_graph]: 6.02999e-06 [opt_after_jit_grad]: 0.00049618 [symbol_engine_optimizer]: 7.653e-05, [1] [Cycle 1]: 6.922e-05, [6] [build]: 3.76001e-06 [elim_shapecalc]: 8.49998e-06 [elim_not_effective]: 1.409e-05 [opt_reshape]: 6.13002e-06 [fold_const_symbol]: 9.37001e-06 [renormalize]: 4.19997e-07 [validate]: 4.797e-05 Sums bootstrap : 0.000311s : 0.22% type_inference : 0.137972s : 96.46% event_method : 0.000027s : 0.02% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000128s : 0.09% rewriter_before_opt_a : 0.000104s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000725s : 0.51% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001093s : 0.76% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000060s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000724s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000435s : 0.30% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000496s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.03% Time group info: ------[substitution.] 0.000267 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 3: substitution.graph_param_transform 85.18% : 0.000228s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000006s : 4: substitution.remove_not_recompute_node 2.70% : 0.000007s : 2: substitution.replace_old_param 4.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.137879 2 75.37% : 0.103917s : 1: type_inference.infer 24.63% : 0.033962s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.37% : 0.000058s : 4: replace.inline 31.63% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000236 6 95.08% : 0.000225s : 4: match.inline 4.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.09% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.00% : 0.000001s : 10: predicate.depend_value_elim 0.90% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 13.88% : 0.000019s : 10: predicate.dict_get_item_eliminator 0.99% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.82% : 0.000001s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 0.99% : 0.000001s : 10: predicate.environ_get_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.35% : 0.000000s : 3: predicate.fold_const_symbol 0.76% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000008s : 22: predicate.inline 1.08% : 0.000002s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.23% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.36% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.60% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 1.83% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.47% : 0.000002s : 10: predicate.reduce_eliminate 1.19% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 18: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.01% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.01% : 0.000001s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.21% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.98% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 1.76% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.53% : 0.000009s : 53: predicate.switch_simplify 1.06% : 0.000001s : 10: predicate.tile_eliminate 1.01% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.41% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.39% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000942 13 43.97% : 0.000414s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.21% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.82% : 0.000469s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.150143 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000330s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.64% : 0.006964s : 1: jit_opt_a 0.11% : 0.000161s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.30% : 0.000443s : 1: loop_unroll 0.49% : 0.000736s : 1: mutable_eliminate 0.65% : 0.000974s : 26: opt.transform.jit_opt_a 0.03% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000505s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000132s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.42% : 0.000625s : 1: renormalize.infer 0.31% : 0.000458s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000108s : 1: rewriter_before_opt_a 0.05% : 0.000079s : 1: symbol_engine_optimizer 91.91% : 0.138001s : 1: type_inference TotalTime = 0.361599, [30] [bootstrap]: 0.00049682 [type_inference]: 0.321336 [event_method]: 4.229e-05 [auto_monad]: 0.00010155 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 3.10998e-06 [py_interpret_to_execute]: 0.00088473 [rewriter_before_opt_a]: 0.00013714 [expand_dump_flag]: 4.22003e-06 [jit_opt_a]: 0.0311993, [2] [Cycle 1]: 0.0254485, [27] [switch_simplify]: 0.00010028 [loop_unroll]: 3.476e-05 [a_1]: 0.00100661 [with_stream_mark]: 3.575e-05 [recompute_prepare]: 1.465e-05 [updatestate_depend_eliminate]: 6.11998e-06 [updatestate_assign_eliminate]: 5.02e-06 [updatestate_loads_eliminate]: 4.3e-06 [parameter_eliminate]: 2.76999e-06 [specialize_transform]: 1.043e-05 [updatestate_useless_node_eliminater]: 9.24e-06 [accelerated_algorithm]: 7.41001e-06 [meta_shard_fg_expand]: 4.80001e-06 [get_grad_eliminate_]: 1.162e-05 [merge_forward]: 6.20997e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.542e-05 [j_node_and_user_rematch]: 1.409e-05 [meta_fg_expand]: 4.07e-06 [replace_old_param]: 1.583e-05 [inline_without_move]: 8.33999e-06 [renormalize]: 0.0236956 [add_forward_monad_depend]: 1.5e-05 [auto_monad_grad]: 3.15002e-06 [auto_monad_eliminator]: 2.729e-05 [cse]: 4.903e-05 [replace_applicator]: 3.092e-05 [Cycle 2]: 0.00045205, [27] [switch_simplify]: 8.05e-06 [loop_unroll]: 7.73001e-06 [a_1]: 0.00014935 [with_stream_mark]: 1.888e-05 [recompute_prepare]: 7.43e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 2.70997e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 6.62002e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 4.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.289e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.266e-05 [inline_without_move]: 6.50002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.13998e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 7.33e-06 [cse]: 1.675e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 2.61e-05 [rewriter_after_opt_a]: 4.902e-05 [convert_after_rewriter]: 7.98999e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00446188 [jit_opt_b]: 9.452e-05, [1] [Cycle 1]: 8.18e-05, [2] [frontend_op_eliminate]: 3.511e-05 [inline_after_opt_a]: 3.22e-05 [cconv]: 4.615e-05 [loop_unroll]: 0.00070535 [jit_opt_after_cconv]: 0.00025648, [1] [Cycle 1]: 0.00024738, [11] [c_1]: 3.783e-05 [parameter_eliminate]: 8.51002e-06 [updatestate_depend_eliminate]: 1.228e-05 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.06001e-06 [cse]: 5.923e-05 [call_graph_tuple_transform]: 3.791e-05 [tuple_list_get_item_eliminator]: 8.54e-06 [none_parameter_eliminate]: 2.18998e-06 [renormalize]: 9.89996e-07 [switch_simplify]: 8.59e-06 [remove_dup_value]: 2.098e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 1.432e-05 [add_recomputation]: 6.409e-05 [cse_after_recomputation]: 3.471e-05, [1] [Cycle 1]: 2.613e-05, [1] [cse]: 1.703e-05 [auto_monad_reorder]: 2.042e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 1.564e-05 [opt_after_jit_grad]: 0.0006763 [symbol_engine_optimizer]: 0.00049587, [1] [Cycle 1]: 9.384e-05, [6] [build]: 8.09002e-06 [elim_shapecalc]: 1.164e-05 [elim_not_effective]: 2.049e-05 [opt_reshape]: 8.42e-06 [fold_const_symbol]: 1.199e-05 [renormalize]: 1.00001e-06 [validate]: 8.342e-05 Sums bootstrap : 0.000497s : 0.14% type_inference : 0.321336s : 90.51% event_method : 0.000042s : 0.01% auto_monad : 0.000102s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000885s : 0.25% rewriter_before_opt_a : 0.000137s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000108s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001156s : 0.33% jit_opt_a.with_stream_mark : 0.000055s : 0.02% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000008s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000028s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.023696s : 6.67% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.01% jit_opt_a.cse : 0.000066s : 0.02% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000026s : 0.01% rewriter_after_opt_a : 0.000049s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.004462s : 1.26% jit_opt_b.frontend_op_eliminate : 0.000035s : 0.01% jit_opt_b.inline_after_opt_a : 0.000032s : 0.01% cconv : 0.000046s : 0.01% loop_unroll : 0.000705s : 0.20% jit_opt_after_cconv.c_1 : 0.000038s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000059s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000064s : 0.02% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000016s : 0.00% opt_after_jit_grad : 0.000676s : 0.19% symbol_engine_optimizer.build : 0.000008s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000083s : 0.02% Time group info: ------[substitution.] 0.000416 24 1.22% : 0.000005s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000009s : 4: substitution.graph_param_transform 85.72% : 0.000356s : 4: substitution.inline 1.15% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000008s : 4: substitution.remove_not_recompute_node 2.41% : 0.000010s : 2: substitution.replace_old_param 4.95% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.321101 2 93.76% : 0.301068s : 1: type_inference.infer 6.24% : 0.020033s : 1: type_inference.specialize ------[replace.] 0.000158 6 61.03% : 0.000096s : 4: replace.inline 38.97% : 0.000062s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000371 6 94.83% : 0.000352s : 4: match.inline 5.17% : 0.000019s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000183 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.58% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.76% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000004s : 12: predicate.arithmetic_simplify 1.54% : 0.000003s : 12: predicate.cast_eliminate 0.61% : 0.000001s : 4: predicate.check_bprop_eliminate 0.89% : 0.000002s : 12: predicate.compare_switch_simplify 0.85% : 0.000002s : 12: predicate.depend_value_elim 0.80% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.78% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 4.98% : 0.000009s : 26: predicate.inline 0.91% : 0.000002s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000003s : 18: predicate.load_eliminater 1.47% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.07% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.41% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 2.36% : 0.000004s : 12: predicate.merge_addn 0.89% : 0.000002s : 12: predicate.minmaximum_grad 3.80% : 0.000007s : 4: predicate.mutable_eliminate 0.79% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000004s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 1.49% : 0.000003s : 12: predicate.reduce_eliminate 1.20% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000002s : 8: predicate.remove_not_recompute_node 1.95% : 0.000004s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 2.24% : 0.000004s : 12: predicate.reshape_eliminate 0.95% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.28% : 0.000002s : 4: predicate.row_tensor_eliminate 1.75% : 0.000003s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000002s : 8: predicate.specialize_transform 1.13% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.67% : 0.000005s : 18: predicate.switch_defer_inline 1.56% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.16% : 0.000013s : 58: predicate.switch_simplify 0.93% : 0.000002s : 12: predicate.tile_eliminate 1.96% : 0.000004s : 12: predicate.transpose_eliminate 1.48% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 0.96% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.78% : 0.000009s : 22: predicate.tuple_list_get_item_eliminator 1.22% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.43% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.72% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.023118 22 10.29% : 0.002379s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.33% : 0.000075s : 1: func_graph_cloner_run.FuncGraphClonerNode 89.38% : 0.020664s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.386913 72 0.02% : 0.000068s : 1: add_recomputation 0.03% : 0.000106s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.13% : 0.000522s : 1: bootstrap 0.01% : 0.000049s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000037s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000048s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 8.06% : 0.031204s : 1: jit_opt_a 0.07% : 0.000260s : 1: jit_opt_after_cconv 0.03% : 0.000098s : 1: jit_opt_b 0.19% : 0.000719s : 1: loop_unroll 1.16% : 0.004494s : 1: mutable_eliminate 0.39% : 0.001504s : 26: opt.transform.jit_opt_a 0.02% : 0.000087s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000056s : 4: opt.transform.jit_opt_b 0.01% : 0.000028s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000053s : 1: opt.transform.mutable_eliminate 0.01% : 0.000040s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000691s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000895s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 0.74% : 0.002848s : 1: renormalize.infer 5.38% : 0.020826s : 1: renormalize.specialize 0.00% : 0.000018s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000053s : 1: rewriter_after_opt_a 0.04% : 0.000146s : 1: rewriter_before_opt_a 0.13% : 0.000500s : 1: symbol_engine_optimizer 83.06% : 0.321374s : 1: type_inference TotalTime = 0.0589069, [30] [bootstrap]: 0.00063754 [type_inference]: 0.0327683 [event_method]: 2.444e-05 [auto_monad]: 8.513e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 7.135e-05 [rewriter_before_opt_a]: 8.735e-05 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.00869725, [2] [Cycle 1]: 0.00284715, [27] [switch_simplify]: 0.00011838 [loop_unroll]: 3.388e-05 [a_1]: 0.00082409 [with_stream_mark]: 3.17e-05 [recompute_prepare]: 1.443e-05 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 4.43999e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.84999e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 7.85e-06 [meta_shard_fg_expand]: 5.97999e-06 [get_grad_eliminate_]: 7.28e-06 [merge_forward]: 4.77998e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.985e-05 [j_node_and_user_rematch]: 1.285e-05 [meta_fg_expand]: 3.71999e-06 [replace_old_param]: 1.19e-05 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00136835 [add_forward_monad_depend]: 1.174e-05 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 2.277e-05 [cse]: 3.819e-05 [replace_applicator]: 2.245e-05 [Cycle 2]: 0.0003849, [27] [switch_simplify]: 8.06001e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00011201 [with_stream_mark]: 1.629e-05 [recompute_prepare]: 5.63002e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 3.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.865e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 8.23001e-06 [cse]: 1.276e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.709e-05 [rewriter_after_opt_a]: 4.327e-05 [convert_after_rewriter]: 8.48001e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00092254 [jit_opt_b]: 6.136e-05, [1] [Cycle 1]: 5.072e-05, [2] [frontend_op_eliminate]: 2.036e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 3.317e-05 [loop_unroll]: 0.0135745 [jit_opt_after_cconv]: 0.00032468, [1] [Cycle 1]: 0.00030974, [11] [c_1]: 3.587e-05 [parameter_eliminate]: 8.17e-06 [updatestate_depend_eliminate]: 1.674e-05 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 4.82e-05 [call_graph_tuple_transform]: 3.105e-05 [tuple_list_get_item_eliminator]: 7.72002e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 9.14998e-06 [remove_dup_value]: 2.069e-05 [partial_unused_args_eliminate]: 3.6e-06 [environ_conv]: 1.035e-05 [add_recomputation]: 6.679e-05 [cse_after_recomputation]: 3.597e-05, [1] [Cycle 1]: 2.608e-05, [1] [cse]: 1.707e-05 [auto_monad_reorder]: 1.859e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 1.03e-05 [opt_after_jit_grad]: 0.00091641 [symbol_engine_optimizer]: 9.825e-05, [1] [Cycle 1]: 8.853e-05, [6] [build]: 6.07001e-06 [elim_shapecalc]: 9.20001e-06 [elim_not_effective]: 1.924e-05 [opt_reshape]: 8.73001e-06 [fold_const_symbol]: 1.182e-05 [renormalize]: 1.10999e-06 [validate]: 5.476e-05 Sums bootstrap : 0.000638s : 1.21% type_inference : 0.032768s : 62.38% event_method : 0.000024s : 0.05% auto_monad : 0.000085s : 0.16% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000071s : 0.14% rewriter_before_opt_a : 0.000087s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000126s : 0.24% jit_opt_a.loop_unroll : 0.000040s : 0.08% jit_opt_a.a_1 : 0.000936s : 1.78% jit_opt_a.with_stream_mark : 0.000048s : 0.09% jit_opt_a.recompute_prepare : 0.000020s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001368s : 2.60% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.06% jit_opt_a.cse : 0.000051s : 0.10% jit_opt_a.replace_applicator : 0.000028s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000043s : 0.08% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000923s : 1.76% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000033s : 0.06% loop_unroll : 0.013574s : 25.84% jit_opt_after_cconv.c_1 : 0.000036s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000017s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.02% remove_dup_value : 0.000021s : 0.04% partial_unused_args_eliminate : 0.000004s : 0.01% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000067s : 0.13% cse_after_recomputation.cse : 0.000017s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000916s : 1.74% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.10% Time group info: ------[substitution.] 0.000311 23 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 2.50% : 0.000008s : 3: substitution.graph_param_transform 83.87% : 0.000261s : 4: substitution.inline 1.50% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000007s : 4: substitution.remove_not_recompute_node 2.41% : 0.000008s : 2: substitution.replace_old_param 5.74% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.032646 2 20.38% : 0.006652s : 1: type_inference.infer 79.62% : 0.025994s : 1: type_inference.specialize ------[replace.] 0.000112 6 68.77% : 0.000077s : 4: replace.inline 31.23% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 6 93.96% : 0.000258s : 4: match.inline 6.04% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000253 691 0.77% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000003s : 10: predicate.addn_check_dump 0.96% : 0.000002s : 10: predicate.addn_zero_filter 1.26% : 0.000003s : 10: predicate.arithmetic_simplify 0.77% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 0.52% : 0.000001s : 10: predicate.compare_switch_simplify 0.59% : 0.000001s : 10: predicate.depend_value_elim 0.50% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.67% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.88% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.55% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.29% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.88% : 0.000002s : 10: predicate.environ_add_const_eliminate 32.19% : 0.000082s : 10: predicate.environ_get_add_eliminate 0.71% : 0.000002s : 10: predicate.environ_get_depend_swap 1.08% : 0.000003s : 10: predicate.environ_get_eliminate 0.61% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.11% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000001s : 3: predicate.graph_param_transform 3.78% : 0.000010s : 22: predicate.inline 0.42% : 0.000001s : 6: predicate.inline_without_move 0.18% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000004s : 6: predicate.less_batch_normalization 1.29% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.14% : 0.000003s : 15: predicate.load_eliminater 3.43% : 0.000009s : 3: predicate.loop_unroll_after_grad 2.33% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.67% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.53% : 0.000001s : 10: predicate.merge_addn 0.84% : 0.000002s : 10: predicate.minmaximum_grad 1.02% : 0.000003s : 3: predicate.mutable_eliminate 0.28% : 0.000001s : 3: predicate.opt_reshape 1.08% : 0.000003s : 15: predicate.partial_eliminate 0.71% : 0.000002s : 10: predicate.print_const_string_wrapper 1.40% : 0.000004s : 10: predicate.reduce_eliminate 0.90% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 6: predicate.remove_not_recompute_node 1.04% : 0.000003s : 18: predicate.replace_applicator 0.32% : 0.000001s : 6: predicate.replace_old_param 0.16% : 0.000000s : 3: predicate.reset_defer_inline 0.62% : 0.000002s : 10: predicate.reshape_eliminate 0.80% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000003s : 10: predicate.same_eliminate 0.35% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000002s : 6: predicate.special_op_eliminate 0.69% : 0.000002s : 6: predicate.specialize_transform 1.16% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.86% : 0.000005s : 16: predicate.switch_defer_inline 1.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 4.83% : 0.000012s : 53: predicate.switch_simplify 0.70% : 0.000002s : 10: predicate.tile_eliminate 0.67% : 0.000002s : 10: predicate.transpose_eliminate 1.14% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 0.60% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 2.54% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.25% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.02% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 0.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 1.60% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.22% : 0.000003s : 10: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001260 13 45.42% : 0.000572s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.94% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.65% : 0.000638s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061645 72 0.12% : 0.000073s : 1: add_recomputation 0.14% : 0.000089s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 1.09% : 0.000673s : 1: bootstrap 0.06% : 0.000036s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.06% : 0.000039s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 14.12% : 0.008702s : 1: jit_opt_a 0.53% : 0.000330s : 1: jit_opt_after_cconv 0.10% : 0.000064s : 1: jit_opt_b 22.08% : 0.013608s : 1: loop_unroll 1.52% : 0.000935s : 1: mutable_eliminate 2.04% : 0.001255s : 26: opt.transform.jit_opt_a 0.13% : 0.000080s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.08% : 0.000050s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000042s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000045s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000937s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000075s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000024s : 1: remove_dup_value 1.18% : 0.000729s : 1: renormalize.infer 1.01% : 0.000625s : 1: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000047s : 1: rewriter_after_opt_a 0.15% : 0.000091s : 1: rewriter_before_opt_a 0.17% : 0.000102s : 1: symbol_engine_optimizer 53.21% : 0.032800s : 1: type_inference TotalTime = 0.091077, [30] [bootstrap]: 0.00046562 [type_inference]: 0.0645698 [event_method]: 0.00017532 [auto_monad]: 0.00014558 [graph_reusing]: 9.36998e-06 [pre_auto_parallel]: 3.85e-06 [py_interpret_to_execute]: 7.906e-05 [rewriter_before_opt_a]: 0.00019944 [expand_dump_flag]: 5.72001e-06 [jit_opt_a]: 0.021788, [2] [Cycle 1]: 0.0157704, [27] [switch_simplify]: 0.00029545 [loop_unroll]: 6.936e-05 [a_1]: 0.0125222 [with_stream_mark]: 3.704e-05 [recompute_prepare]: 1.645e-05 [updatestate_depend_eliminate]: 5.57999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.30998e-06 [parameter_eliminate]: 3.36999e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 8.38001e-06 [meta_shard_fg_expand]: 4.70999e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.172e-05 [j_node_and_user_rematch]: 1.316e-05 [meta_fg_expand]: 3.85998e-06 [replace_old_param]: 1.419e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00226418 [add_forward_monad_depend]: 1.197e-05 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 2.526e-05 [cse]: 4.945e-05 [replace_applicator]: 2.9e-05 [Cycle 2]: 0.00043631, [27] [switch_simplify]: 8.27e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00011974 [with_stream_mark]: 2.026e-05 [recompute_prepare]: 6.34001e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 7.93999e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 5.58002e-06 [cell_reuse_recompute_pass]: 3.9e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.364e-05 [j_node_and_user_rematch]: 1.146e-05 [meta_fg_expand]: 3.88001e-06 [replace_old_param]: 1.203e-05 [inline_without_move]: 5.92999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.38998e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 1.145e-05 [cse]: 1.896e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 2.535e-05 [rewriter_after_opt_a]: 5.361e-05 [convert_after_rewriter]: 8.92999e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00111774 [jit_opt_b]: 6.882e-05, [1] [Cycle 1]: 5.707e-05, [2] [frontend_op_eliminate]: 2.152e-05 [inline_after_opt_a]: 2.049e-05 [cconv]: 4.236e-05 [loop_unroll]: 0.00062519 [jit_opt_after_cconv]: 0.00022224, [1] [Cycle 1]: 0.0002123, [11] [c_1]: 2.785e-05 [parameter_eliminate]: 6.41e-06 [updatestate_depend_eliminate]: 1.327e-05 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.06001e-06 [cse]: 5.608e-05 [call_graph_tuple_transform]: 2.908e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 7.85e-06 [remove_dup_value]: 0.00010432 [partial_unused_args_eliminate]: 2.99999e-06 [environ_conv]: 9.32999e-06 [add_recomputation]: 7.056e-05 [cse_after_recomputation]: 3.55e-05, [1] [Cycle 1]: 2.778e-05, [1] [cse]: 1.747e-05 [auto_monad_reorder]: 2.244e-05 [get_jit_bprop_graph]: 2.81e-06 [rewriter_after_jit_bprop_graph]: 1.357e-05 [opt_after_jit_grad]: 0.00074528 [symbol_engine_optimizer]: 0.00010007, [1] [Cycle 1]: 9.141e-05, [6] [build]: 7.51999e-06 [elim_shapecalc]: 1.015e-05 [elim_not_effective]: 1.902e-05 [opt_reshape]: 8.30999e-06 [fold_const_symbol]: 1.175e-05 [renormalize]: 9.10019e-07 [validate]: 6.066e-05 Sums bootstrap : 0.000466s : 0.55% type_inference : 0.064570s : 76.34% event_method : 0.000175s : 0.21% auto_monad : 0.000146s : 0.17% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000079s : 0.09% rewriter_before_opt_a : 0.000199s : 0.24% expand_dump_flag : 0.000006s : 0.01% jit_opt_a.switch_simplify : 0.000304s : 0.36% jit_opt_a.loop_unroll : 0.000076s : 0.09% jit_opt_a.a_1 : 0.012642s : 14.95% jit_opt_a.with_stream_mark : 0.000057s : 0.07% jit_opt_a.recompute_prepare : 0.000023s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.03% jit_opt_a.meta_fg_expand : 0.000008s : 0.01% jit_opt_a.replace_old_param : 0.000026s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002264s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.04% jit_opt_a.cse : 0.000068s : 0.08% jit_opt_a.replace_applicator : 0.000035s : 0.04% py_interpret_to_execute_after_opt_a : 0.000025s : 0.03% rewriter_after_opt_a : 0.000054s : 0.06% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.001118s : 1.32% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000042s : 0.05% loop_unroll : 0.000625s : 0.74% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000056s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000104s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000071s : 0.08% cse_after_recomputation.cse : 0.000017s : 0.02% auto_monad_reorder : 0.000022s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.02% opt_after_jit_grad : 0.000745s : 0.88% symbol_engine_optimizer.build : 0.000008s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.07% Time group info: ------[substitution.] 0.001008 33 0.29% : 0.000003s : 2: substitution.elim_not_effective 0.22% : 0.000002s : 2: substitution.fold_const_symbol 0.67% : 0.000007s : 3: substitution.graph_param_transform 92.41% : 0.000932s : 11: substitution.inline 0.57% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.70% : 0.000007s : 4: substitution.remove_not_recompute_node 0.96% : 0.000010s : 2: substitution.replace_old_param 1.88% : 0.000019s : 2: substitution.switch_simplify 2.31% : 0.000023s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.064416 2 76.67% : 0.049391s : 1: type_inference.infer 23.33% : 0.015025s : 1: type_inference.specialize ------[replace.] 0.000533 16 52.95% : 0.000282s : 11: replace.inline 17.26% : 0.000092s : 2: replace.switch_simplify 29.79% : 0.000159s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000960 16 96.06% : 0.000922s : 11: match.inline 1.82% : 0.000017s : 2: match.switch_simplify 2.12% : 0.000020s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000272 1148 1.71% : 0.000005s : 18: predicate.accumulaten_eliminater 0.74% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000003s : 18: predicate.addn_check_dump 1.69% : 0.000005s : 18: predicate.addn_zero_filter 2.17% : 0.000006s : 18: predicate.arithmetic_simplify 1.64% : 0.000004s : 18: predicate.cast_eliminate 0.28% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000003s : 18: predicate.compare_switch_simplify 1.08% : 0.000003s : 18: predicate.depend_value_elim 0.86% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.08% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.11% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.48% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.16% : 0.000000s : 3: predicate.elim_not_effective 0.26% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.05% : 0.000003s : 18: predicate.environ_get_add_eliminate 1.11% : 0.000003s : 18: predicate.environ_get_depend_swap 1.51% : 0.000004s : 18: predicate.environ_get_eliminate 1.15% : 0.000003s : 18: predicate.environ_get_set_eliminate 0.10% : 0.000000s : 3: predicate.fold_const_symbol 0.46% : 0.000001s : 6: predicate.get_grad_eliminate 0.12% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000014s : 38: predicate.inline 0.42% : 0.000001s : 6: predicate.inline_without_move 0.18% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000004s : 6: predicate.less_batch_normalization 1.70% : 0.000005s : 21: predicate.list_to_tuple_eliminator_ 1.90% : 0.000005s : 24: predicate.load_eliminater 1.18% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.72% : 0.000013s : 64: predicate.loop_unroll_before_grad 1.85% : 0.000005s : 21: predicate.make_slice_get_slice_eliminator 1.15% : 0.000003s : 18: predicate.merge_addn 1.00% : 0.000003s : 18: predicate.minmaximum_grad 1.72% : 0.000005s : 3: predicate.mutable_eliminate 0.25% : 0.000001s : 3: predicate.opt_reshape 2.70% : 0.000007s : 24: predicate.partial_eliminate 1.19% : 0.000003s : 18: predicate.print_const_string_wrapper 2.06% : 0.000006s : 18: predicate.reduce_eliminate 1.37% : 0.000004s : 21: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000004s : 27: predicate.replace_applicator 0.29% : 0.000001s : 6: predicate.replace_old_param 0.14% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000004s : 18: predicate.reshape_eliminate 1.21% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.47% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000003s : 18: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.66% : 0.000002s : 6: predicate.special_op_eliminate 0.42% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000004s : 18: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000004s : 18: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.91% : 0.000011s : 32: predicate.switch_defer_inline 2.29% : 0.000006s : 32: predicate.switch_layer_defer_inline 7.09% : 0.000019s : 103: predicate.switch_simplify 1.90% : 0.000005s : 18: predicate.tile_eliminate 1.10% : 0.000003s : 18: predicate.transpose_eliminate 1.68% : 0.000005s : 18: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000004s : 18: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000011s : 27: predicate.tuple_list_get_item_eliminator 2.21% : 0.000006s : 18: predicate.tuple_list_set_item_eliminator 1.87% : 0.000005s : 21: predicate.tuple_to_list_eliminator_ 1.72% : 0.000005s : 24: predicate.updatestate_pure_node_eliminater 5.16% : 0.000014s : 30: predicate.updatestate_useless_node_eliminater 1.66% : 0.000005s : 18: predicate.value_based_eliminate 0.13% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.014131 28 13.14% : 0.001857s : 9: func_graph_cloner_run.FuncGraphClonerGraph 3.28% : 0.000464s : 6: func_graph_cloner_run.FuncGraphClonerNode 83.58% : 0.011810s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.106607 72 0.07% : 0.000074s : 1: add_recomputation 0.14% : 0.000153s : 1: auto_monad 0.02% : 0.000025s : 1: auto_monad_reorder 0.47% : 0.000496s : 1: bootstrap 0.04% : 0.000046s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.04% : 0.000039s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.17% : 0.000185s : 1: event_method 0.01% : 0.000009s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 20.44% : 0.021795s : 1: jit_opt_a 0.21% : 0.000225s : 1: jit_opt_after_cconv 0.07% : 0.000072s : 1: jit_opt_b 0.60% : 0.000641s : 1: loop_unroll 1.06% : 0.001135s : 1: mutable_eliminate 12.38% : 0.013196s : 26: opt.transform.jit_opt_a 0.06% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000031s : 1: opt.transform.mutable_eliminate 0.04% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000763s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.08% : 0.000082s : 1: py_interpret_to_execute 0.03% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000109s : 1: remove_dup_value 1.31% : 0.001391s : 1: renormalize.infer 0.80% : 0.000854s : 1: renormalize.specialize 0.02% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000059s : 1: rewriter_after_opt_a 0.19% : 0.000205s : 1: rewriter_before_opt_a 0.10% : 0.000104s : 1: symbol_engine_optimizer 60.60% : 0.064604s : 1: type_inference TotalTime = 0.0749502, [30] [bootstrap]: 0.00031193 [type_inference]: 0.00536079 [event_method]: 2.026e-05 [auto_monad]: 6.709e-05 [graph_reusing]: 6.49001e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 3.961e-05 [rewriter_before_opt_a]: 7.473e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.0666949, [2] [Cycle 1]: 0.0624611, [27] [switch_simplify]: 6.958e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00061735 [with_stream_mark]: 0.0603455 [recompute_prepare]: 4.393e-05 [updatestate_depend_eliminate]: 7.22002e-06 [updatestate_assign_eliminate]: 3.72002e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 3.09001e-06 [specialize_transform]: 8.01001e-06 [updatestate_useless_node_eliminater]: 7.23999e-06 [accelerated_algorithm]: 8.47998e-06 [meta_shard_fg_expand]: 4.91002e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 5.35999e-06 [cell_reuse_recompute_pass]: 3.65e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.863e-05 [j_node_and_user_rematch]: 1.206e-05 [meta_fg_expand]: 3.77002e-06 [replace_old_param]: 1.211e-05 [inline_without_move]: 5.61998e-06 [renormalize]: 0.0008808 [add_forward_monad_depend]: 7.36001e-06 [auto_monad_grad]: 3.2e-06 [auto_monad_eliminator]: 1.701e-05 [cse]: 3.542e-05 [replace_applicator]: 1.412e-05 [Cycle 2]: 0.0003384, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.959e-05 [with_stream_mark]: 1.2e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.08998e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.35998e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.452e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 8e-06 [inline_without_move]: 4.87e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.263e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.493e-05 [rewriter_after_opt_a]: 4.046e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00071315 [jit_opt_b]: 5.151e-05, [1] [Cycle 1]: 4.327e-05, [2] [frontend_op_eliminate]: 1.62e-05 [inline_after_opt_a]: 1.581e-05 [cconv]: 2.735e-05 [loop_unroll]: 0.00043795 [jit_opt_after_cconv]: 0.00014938, [1] [Cycle 1]: 0.00014288, [11] [c_1]: 2.03e-05 [parameter_eliminate]: 2.90998e-06 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.84999e-06 [cse]: 2.509e-05 [call_graph_tuple_transform]: 1.973e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 1.756e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 7.33e-06 [add_recomputation]: 5.304e-05 [cse_after_recomputation]: 2.335e-05, [1] [Cycle 1]: 1.783e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.702e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00049175 [symbol_engine_optimizer]: 7.297e-05, [1] [Cycle 1]: 6.615e-05, [6] [build]: 3.25998e-06 [elim_shapecalc]: 7.6e-06 [elim_not_effective]: 1.292e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.58001e-06 [renormalize]: 4.19997e-07 [validate]: 3.921e-05 Sums bootstrap : 0.000312s : 0.44% type_inference : 0.005361s : 7.62% event_method : 0.000020s : 0.03% auto_monad : 0.000067s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.06% rewriter_before_opt_a : 0.000075s : 0.11% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000717s : 1.02% jit_opt_a.with_stream_mark : 0.060358s : 85.78% jit_opt_a.recompute_prepare : 0.000049s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000881s : 1.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000048s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000713s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000438s : 0.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000492s : 0.70% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.06% Time group info: ------[substitution.] 0.000276 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000006s : 3: substitution.graph_param_transform 84.71% : 0.000234s : 4: substitution.inline 1.98% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000006s : 4: substitution.remove_not_recompute_node 2.76% : 0.000008s : 2: substitution.replace_old_param 4.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005279 2 83.24% : 0.004394s : 1: type_inference.infer 16.76% : 0.000885s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.09% : 0.000055s : 4: replace.inline 29.91% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 94.96% : 0.000231s : 4: match.inline 5.04% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.74% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.72% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.99% : 0.000008s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.98% : 0.000004s : 6: predicate.less_batch_normalization 1.74% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.65% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 1.46% : 0.000002s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 1.54% : 0.000002s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.52% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000734 13 51.56% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.33% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.11% : 0.000294s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076884 72 0.07% : 0.000056s : 1: add_recomputation 0.09% : 0.000071s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.44% : 0.000336s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 86.75% : 0.066698s : 1: jit_opt_a 0.20% : 0.000152s : 1: jit_opt_after_cconv 0.07% : 0.000054s : 1: jit_opt_b 0.58% : 0.000446s : 1: loop_unroll 0.94% : 0.000722s : 1: mutable_eliminate 1.30% : 0.001003s : 26: opt.transform.jit_opt_a 0.06% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000501s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000042s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.62% : 0.000473s : 1: renormalize.infer 0.51% : 0.000396s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.10% : 0.000078s : 1: rewriter_before_opt_a 0.10% : 0.000075s : 1: symbol_engine_optimizer 7.00% : 0.005384s : 1: type_inference TotalTime = 0.0454019, [30] [bootstrap]: 0.00043159 [type_inference]: 0.00986399 [event_method]: 3.448e-05 [auto_monad]: 0.0125763 [graph_reusing]: 1.387e-05 [pre_auto_parallel]: 5.11002e-06 [py_interpret_to_execute]: 0.00019113 [rewriter_before_opt_a]: 0.00013535 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00820711, [2] [Cycle 1]: 0.00306747, [27] [switch_simplify]: 8.572e-05 [loop_unroll]: 3.207e-05 [a_1]: 0.00069593 [with_stream_mark]: 2.247e-05 [recompute_prepare]: 8.75999e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.26999e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 1.077e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.119e-05 [inline_without_move]: 6.28e-06 [renormalize]: 0.00184117 [add_forward_monad_depend]: 7.10998e-06 [auto_monad_grad]: 1.59998e-06 [auto_monad_eliminator]: 1.506e-05 [cse]: 3.698e-05 [replace_applicator]: 1.653e-05 [Cycle 2]: 0.00035499, [27] [switch_simplify]: 6.49999e-06 [loop_unroll]: 5.57001e-06 [a_1]: 0.00010685 [with_stream_mark]: 1.1e-05 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.25999e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.378e-05 [j_node_and_user_rematch]: 8.38001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.646e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.442e-05 [rewriter_after_opt_a]: 3.449e-05 [convert_after_rewriter]: 6.23e-06 [order_py_execute_after_rewriter]: 4.70999e-06 [mutable_eliminate]: 0.00071406 [jit_opt_b]: 5.498e-05, [1] [Cycle 1]: 4.816e-05, [2] [frontend_op_eliminate]: 1.899e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 2.87e-05 [loop_unroll]: 0.00047194 [jit_opt_after_cconv]: 0.0106901, [1] [Cycle 1]: 0.0106795, [11] [c_1]: 8.493e-05 [parameter_eliminate]: 6.71e-06 [updatestate_depend_eliminate]: 1.527e-05 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.28e-06 [cse]: 6.072e-05 [call_graph_tuple_transform]: 3.795e-05 [tuple_list_get_item_eliminator]: 8.27998e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 1.04e-06 [switch_simplify]: 7.24001e-06 [remove_dup_value]: 6.052e-05 [partial_unused_args_eliminate]: 3.53e-06 [environ_conv]: 7.95e-06 [add_recomputation]: 6.774e-05 [cse_after_recomputation]: 3.464e-05, [1] [Cycle 1]: 2.403e-05, [1] [cse]: 1.303e-05 [auto_monad_reorder]: 2.056e-05 [get_jit_bprop_graph]: 4.76997e-06 [rewriter_after_jit_bprop_graph]: 1.358e-05 [opt_after_jit_grad]: 0.00107052 [symbol_engine_optimizer]: 0.00027311, [1] [Cycle 1]: 0.000264, [6] [build]: 7.71999e-06 [elim_shapecalc]: 9.56e-06 [elim_not_effective]: 2.486e-05 [opt_reshape]: 1.048e-05 [fold_const_symbol]: 1.567e-05 [renormalize]: 1.06002e-06 [validate]: 6.816e-05 Sums bootstrap : 0.000432s : 1.47% type_inference : 0.009864s : 33.67% event_method : 0.000034s : 0.12% auto_monad : 0.012576s : 42.93% graph_reusing : 0.000014s : 0.05% pre_auto_parallel : 0.000005s : 0.02% py_interpret_to_execute : 0.000191s : 0.65% rewriter_before_opt_a : 0.000135s : 0.46% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.31% jit_opt_a.loop_unroll : 0.000038s : 0.13% jit_opt_a.a_1 : 0.000803s : 2.74% jit_opt_a.with_stream_mark : 0.000033s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001841s : 6.29% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000053s : 0.18% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000034s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000714s : 2.44% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.000472s : 1.61% jit_opt_after_cconv.c_1 : 0.000085s : 0.29% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000061s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000061s : 0.21% partial_unused_args_eliminate : 0.000004s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000068s : 0.23% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000021s : 0.07% get_jit_bprop_graph : 0.000005s : 0.02% rewriter_after_jit_bprop_graph : 0.000014s : 0.05% opt_after_jit_grad : 0.001071s : 3.65% symbol_engine_optimizer.build : 0.000008s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000016s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.23% Time group info: ------[substitution.] 0.000316 23 1.14% : 0.000004s : 2: substitution.elim_not_effective 0.95% : 0.000003s : 2: substitution.fold_const_symbol 2.66% : 0.000008s : 3: substitution.graph_param_transform 85.97% : 0.000272s : 4: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000006s : 2: substitution.replace_old_param 4.48% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009724 2 74.98% : 0.007291s : 1: type_inference.infer 25.02% : 0.002434s : 1: type_inference.specialize ------[replace.] 0.000100 6 69.44% : 0.000069s : 4: replace.inline 30.56% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000282 6 95.38% : 0.000269s : 4: match.inline 4.62% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 691 1.14% : 0.000002s : 10: predicate.accumulaten_eliminater 1.46% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.03% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000002s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.96% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000002s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 10.39% : 0.000015s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.57% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.51% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 0.87% : 0.000001s : 10: predicate.minmaximum_grad 1.44% : 0.000002s : 3: predicate.mutable_eliminate 0.88% : 0.000001s : 3: predicate.opt_reshape 1.93% : 0.000003s : 15: predicate.partial_eliminate 1.01% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.21% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.51% : 0.000002s : 18: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000002s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.99% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 1.84% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.93% : 0.000010s : 53: predicate.switch_simplify 1.03% : 0.000001s : 10: predicate.tile_eliminate 1.05% : 0.000001s : 10: predicate.transpose_eliminate 1.96% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.73% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001415 13 42.70% : 0.000604s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.23% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.07% : 0.000751s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048409 72 0.15% : 0.000071s : 1: add_recomputation 26.04% : 0.012605s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 0.95% : 0.000461s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000037s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.08% : 0.000041s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.04% : 0.000019s : 1: graph_reusing 16.96% : 0.008212s : 1: jit_opt_a 22.10% : 0.010698s : 1: jit_opt_after_cconv 0.12% : 0.000058s : 1: jit_opt_b 1.00% : 0.000482s : 1: loop_unroll 1.50% : 0.000724s : 1: mutable_eliminate 2.20% : 0.001066s : 26: opt.transform.jit_opt_a 0.25% : 0.000123s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.08% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000054s : 4: opt.transform.symbol_engine_opt 2.24% : 0.001082s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000008s : 1: pre_auto_parallel 0.40% : 0.000196s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000064s : 1: remove_dup_value 1.94% : 0.000941s : 1: renormalize.infer 1.84% : 0.000889s : 1: renormalize.specialize 0.03% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000038s : 1: rewriter_after_opt_a 0.29% : 0.000140s : 1: rewriter_before_opt_a 0.57% : 0.000276s : 1: symbol_engine_optimizer 20.45% : 0.009899s : 1: type_inference TotalTime = 0.144301, [30] [bootstrap]: 0.00034413 [type_inference]: 0.0663643 [event_method]: 2.332e-05 [auto_monad]: 7.321e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00010956 [rewriter_before_opt_a]: 8.608e-05 [expand_dump_flag]: 3.60998e-06 [jit_opt_a]: 0.00607988, [2] [Cycle 1]: 0.0021656, [27] [switch_simplify]: 6.354e-05 [loop_unroll]: 3.179e-05 [a_1]: 0.00060261 [with_stream_mark]: 2.562e-05 [recompute_prepare]: 8.29998e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.79001e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.047e-05 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.025e-05 [inline_without_move]: 5.42001e-06 [renormalize]: 0.00107484 [add_forward_monad_depend]: 6.80002e-06 [auto_monad_grad]: 3.38e-06 [auto_monad_eliminator]: 1.726e-05 [cse]: 3.882e-05 [replace_applicator]: 1.455e-05 [Cycle 2]: 0.00033116, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.022e-05 [with_stream_mark]: 1.359e-05 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 4.90001e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.90998e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 7.79002e-06 [inline_without_move]: 5.09e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.52999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.414e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 1.459e-05 [rewriter_after_opt_a]: 4.012e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00069764 [jit_opt_b]: 5.035e-05, [1] [Cycle 1]: 4.265e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.59e-05 [cconv]: 2.941e-05 [loop_unroll]: 0.0689512 [jit_opt_after_cconv]: 0.00022578, [1] [Cycle 1]: 0.00021217, [11] [c_1]: 2.725e-05 [parameter_eliminate]: 8.16002e-06 [updatestate_depend_eliminate]: 1.514e-05 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.01001e-06 [cse]: 5.672e-05 [call_graph_tuple_transform]: 2.974e-05 [tuple_list_get_item_eliminator]: 6.26998e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.899e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 8.47e-06 [add_recomputation]: 6.362e-05 [cse_after_recomputation]: 9.007e-05, [1] [Cycle 1]: 1.923e-05, [1] [cse]: 1.3e-05 [auto_monad_reorder]: 2.08e-05 [get_jit_bprop_graph]: 2.83998e-06 [rewriter_after_jit_bprop_graph]: 1.204e-05 [opt_after_jit_grad]: 0.00060292 [symbol_engine_optimizer]: 8.24e-05, [1] [Cycle 1]: 7.377e-05, [6] [build]: 5.49998e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.491e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.62001e-06 [renormalize]: 5.39992e-07 [validate]: 5.093e-05 Sums bootstrap : 0.000344s : 0.25% type_inference : 0.066364s : 47.41% event_method : 0.000023s : 0.02% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000110s : 0.08% rewriter_before_opt_a : 0.000086s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000693s : 0.49% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001075s : 0.77% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000698s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.068951s : 49.25% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000057s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000064s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000603s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000259 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.87% : 0.000007s : 3: substitution.graph_param_transform 84.60% : 0.000219s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000006s : 2: substitution.replace_old_param 5.21% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066281 2 97.61% : 0.064697s : 1: type_inference.infer 2.39% : 0.001583s : 1: type_inference.specialize ------[replace.] 0.000080 6 68.41% : 0.000054s : 4: replace.inline 31.59% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.58% : 0.000216s : 4: match.inline 5.42% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.23% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.58% : 0.000002s : 10: predicate.arithmetic_simplify 1.05% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.05% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.71% : 0.000009s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 5.08% : 0.000007s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.45% : 0.000010s : 53: predicate.switch_simplify 1.08% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000002s : 10: predicate.transpose_eliminate 1.19% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000941 13 48.24% : 0.000454s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.16% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.60% : 0.000429s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146381 72 0.05% : 0.000067s : 1: add_recomputation 0.05% : 0.000076s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.25% : 0.000370s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000093s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.16% : 0.006083s : 1: jit_opt_a 0.16% : 0.000230s : 1: jit_opt_after_cconv 0.04% : 0.000053s : 1: jit_opt_b 47.13% : 0.068982s : 1: loop_unroll 0.48% : 0.000708s : 1: mutable_eliminate 0.63% : 0.000924s : 26: opt.transform.jit_opt_a 0.04% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000039s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000615s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000113s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 0.43% : 0.000626s : 1: renormalize.infer 0.30% : 0.000439s : 1: renormalize.specialize 0.01% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000090s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 45.35% : 0.066384s : 1: type_inference TotalTime = 0.301735, [30] [bootstrap]: 0.00036171 [type_inference]: 0.288169 [event_method]: 3.082e-05 [auto_monad]: 8.622e-05 [graph_reusing]: 7.04001e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00040518 [rewriter_before_opt_a]: 0.00011907 [expand_dump_flag]: 4.3e-06 [jit_opt_a]: 0.00971403, [2] [Cycle 1]: 0.00504882, [27] [switch_simplify]: 7.988e-05 [loop_unroll]: 3.616e-05 [a_1]: 0.0008777 [with_stream_mark]: 2.737e-05 [recompute_prepare]: 1.03e-05 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 8.70999e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 6.77002e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.869e-05 [j_node_and_user_rematch]: 1.316e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.359e-05 [inline_without_move]: 7.02002e-06 [renormalize]: 0.00358743 [add_forward_monad_depend]: 9.39e-06 [auto_monad_grad]: 3.00998e-06 [auto_monad_eliminator]: 2.05e-05 [cse]: 4.321e-05 [replace_applicator]: 2.423e-05 [Cycle 2]: 0.00040147, [27] [switch_simplify]: 7.76001e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00012953 [with_stream_mark]: 1.599e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 6.45002e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.834e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 3.00998e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 6.34999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.64999e-06 [cse]: 1.651e-05 [replace_applicator]: 6.79001e-06 [py_interpret_to_execute_after_opt_a]: 1.85e-05 [rewriter_after_opt_a]: 4.271e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00081691 [jit_opt_b]: 6.046e-05, [1] [Cycle 1]: 5.249e-05, [2] [frontend_op_eliminate]: 2.014e-05 [inline_after_opt_a]: 2.021e-05 [cconv]: 3.34e-05 [loop_unroll]: 0.00057997 [jit_opt_after_cconv]: 0.00018926, [1] [Cycle 1]: 0.00018188, [11] [c_1]: 2.847e-05 [parameter_eliminate]: 5.11997e-06 [updatestate_depend_eliminate]: 9.12999e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.45e-06 [cse]: 3.676e-05 [call_graph_tuple_transform]: 2.701e-05 [tuple_list_get_item_eliminator]: 8.08001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 6.42001e-06 [remove_dup_value]: 2.098e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 1.091e-05 [add_recomputation]: 5.614e-05 [cse_after_recomputation]: 2.755e-05, [1] [Cycle 1]: 2.156e-05, [1] [cse]: 1.554e-05 [auto_monad_reorder]: 1.848e-05 [get_jit_bprop_graph]: 2.45002e-06 [rewriter_after_jit_bprop_graph]: 8.55001e-06 [opt_after_jit_grad]: 0.00050987 [symbol_engine_optimizer]: 8.372e-05, [1] [Cycle 1]: 7.668e-05, [6] [build]: 4.85001e-06 [elim_shapecalc]: 1.013e-05 [elim_not_effective]: 1.6e-05 [opt_reshape]: 7.33e-06 [fold_const_symbol]: 1.042e-05 [renormalize]: 5.60016e-07 [validate]: 0.00012003 Sums bootstrap : 0.000362s : 0.12% type_inference : 0.288169s : 97.09% event_method : 0.000031s : 0.01% auto_monad : 0.000086s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000405s : 0.14% rewriter_before_opt_a : 0.000119s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.001007s : 0.34% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003587s : 1.21% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000060s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000817s : 0.28% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000033s : 0.01% loop_unroll : 0.000580s : 0.20% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000510s : 0.17% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000120s : 0.04% Time group info: ------[substitution.] 0.000343 25 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000008s : 4: substitution.graph_param_transform 86.80% : 0.000298s : 5: substitution.inline 1.56% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000007s : 2: substitution.replace_old_param 4.51% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.288038 2 98.94% : 0.284990s : 1: type_inference.infer 1.06% : 0.003048s : 1: type_inference.specialize ------[replace.] 0.000126 7 68.32% : 0.000086s : 5: replace.inline 31.68% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000308 7 95.48% : 0.000294s : 5: match.inline 4.52% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 888 1.42% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.17% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.91% : 0.000009s : 28: predicate.inline 1.12% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.57% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000003s : 13: predicate.reduce_eliminate 1.65% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 1.97% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.85% : 0.000012s : 65: predicate.switch_simplify 1.66% : 0.000003s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.72% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.043974 37 97.50% : 0.042875s : 28: func_graph_cloner_run.FuncGraphClonerGraph 0.23% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 2.27% : 0.001000s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.306630 72 0.02% : 0.000059s : 1: add_recomputation 0.03% : 0.000090s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000374s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.17% : 0.009718s : 1: jit_opt_a 0.06% : 0.000193s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.19% : 0.000591s : 1: loop_unroll 0.27% : 0.000828s : 1: mutable_eliminate 0.42% : 0.001302s : 26: opt.transform.jit_opt_a 0.02% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000520s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000413s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.81% : 0.002489s : 1: renormalize.infer 0.35% : 0.001086s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.04% : 0.000126s : 1: rewriter_before_opt_a 0.03% : 0.000086s : 1: symbol_engine_optimizer 93.99% : 0.288202s : 1: type_inference TotalTime = 0.307588, [30] [bootstrap]: 0.00086273 [type_inference]: 0.228373 [event_method]: 2.717e-05 [auto_monad]: 0.00031921 [graph_reusing]: 8.07e-06 [pre_auto_parallel]: 1.559e-05 [py_interpret_to_execute]: 0.00014968 [rewriter_before_opt_a]: 0.0001378 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.070184, [2] [Cycle 1]: 0.0306283, [27] [switch_simplify]: 0.00013553 [loop_unroll]: 3.242e-05 [a_1]: 0.00071324 [with_stream_mark]: 0.0157454 [recompute_prepare]: 4.799e-05 [updatestate_depend_eliminate]: 2.45e-05 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 3.2e-06 [specialize_transform]: 8.85001e-06 [updatestate_useless_node_eliminater]: 7.23e-06 [accelerated_algorithm]: 8.27e-06 [meta_shard_fg_expand]: 5.04e-06 [get_grad_eliminate_]: 6.74001e-06 [merge_forward]: 5.23002e-06 [cell_reuse_recompute_pass]: 4.43001e-06 [cell_reuse_handle_not_recompute_node_pass]: 5.128e-05 [j_node_and_user_rematch]: 1.16e-05 [meta_fg_expand]: 3.83001e-06 [replace_old_param]: 1.34e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 0.0121325 [add_forward_monad_depend]: 7.275e-05 [auto_monad_grad]: 3.45003e-06 [auto_monad_eliminator]: 4.995e-05 [cse]: 5.359e-05 [replace_applicator]: 3.631e-05 [Cycle 2]: 0.00043722, [27] [switch_simplify]: 7.55e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.0001147 [with_stream_mark]: 2.257e-05 [recompute_prepare]: 8.74e-06 [updatestate_depend_eliminate]: 5.93002e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 4.13999e-06 [get_grad_eliminate_]: 5.86998e-06 [merge_forward]: 5.65001e-06 [cell_reuse_recompute_pass]: 5.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.414e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 1.12e-05 [inline_without_move]: 5.66e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 3.11001e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 1.072e-05 [cse]: 1.996e-05 [replace_applicator]: 6.73998e-06 [py_interpret_to_execute_after_opt_a]: 2.901e-05 [rewriter_after_opt_a]: 6.607e-05 [convert_after_rewriter]: 2.297e-05 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00102992 [jit_opt_b]: 6.236e-05, [1] [Cycle 1]: 5.23e-05, [2] [frontend_op_eliminate]: 1.988e-05 [inline_after_opt_a]: 1.927e-05 [cconv]: 4.118e-05 [loop_unroll]: 0.00068078 [jit_opt_after_cconv]: 0.00020859, [1] [Cycle 1]: 0.00019878, [11] [c_1]: 2.57e-05 [parameter_eliminate]: 8.12e-06 [updatestate_depend_eliminate]: 1.184e-05 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.72002e-06 [cse]: 4.681e-05 [call_graph_tuple_transform]: 2.769e-05 [tuple_list_get_item_eliminator]: 6.83e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 6.39001e-06 [remove_dup_value]: 2.08e-05 [partial_unused_args_eliminate]: 2.93e-06 [environ_conv]: 6.843e-05 [add_recomputation]: 8.944e-05 [cse_after_recomputation]: 3.319e-05, [1] [Cycle 1]: 2.642e-05, [1] [cse]: 1.636e-05 [auto_monad_reorder]: 0.0033955 [get_jit_bprop_graph]: 4.41002e-06 [rewriter_after_jit_bprop_graph]: 1.217e-05 [opt_after_jit_grad]: 0.00108284 [symbol_engine_optimizer]: 0.00010268, [1] [Cycle 1]: 9.046e-05, [6] [build]: 9.19e-06 [elim_shapecalc]: 9.88998e-06 [elim_not_effective]: 2.128e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 1.065e-05 [renormalize]: 1.41998e-06 [validate]: 0.00017057 Sums bootstrap : 0.000863s : 0.32% type_inference : 0.228373s : 85.73% event_method : 0.000027s : 0.01% auto_monad : 0.000319s : 0.12% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000016s : 0.01% py_interpret_to_execute : 0.000150s : 0.06% rewriter_before_opt_a : 0.000138s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000143s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000828s : 0.31% jit_opt_a.with_stream_mark : 0.015768s : 5.92% jit_opt_a.recompute_prepare : 0.000057s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000030s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000010s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000075s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.012133s : 4.55% jit_opt_a.add_forward_monad_depend : 0.000076s : 0.03% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000061s : 0.02% jit_opt_a.cse : 0.000074s : 0.03% jit_opt_a.replace_applicator : 0.000043s : 0.02% py_interpret_to_execute_after_opt_a : 0.000029s : 0.01% rewriter_after_opt_a : 0.000066s : 0.02% convert_after_rewriter : 0.000023s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001030s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000041s : 0.02% loop_unroll : 0.000681s : 0.26% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000068s : 0.03% add_recomputation : 0.000089s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.003395s : 1.27% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.00% opt_after_jit_grad : 0.001083s : 0.41% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000171s : 0.06% Time group info: ------[substitution.] 0.000355 23 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000007s : 3: substitution.graph_param_transform 83.19% : 0.000296s : 4: substitution.inline 1.70% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.86% : 0.000017s : 4: substitution.remove_not_recompute_node 2.84% : 0.000010s : 2: substitution.replace_old_param 4.35% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.228232 2 99.02% : 0.225991s : 1: type_inference.infer 0.98% : 0.002241s : 1: type_inference.specialize ------[replace.] 0.000096 6 66.92% : 0.000064s : 4: replace.inline 33.08% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000306 6 95.54% : 0.000293s : 4: match.inline 4.46% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 691 1.10% : 0.000002s : 10: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.84% : 0.000001s : 10: predicate.addn_check_dump 1.62% : 0.000003s : 10: predicate.addn_zero_filter 2.26% : 0.000004s : 10: predicate.arithmetic_simplify 1.68% : 0.000003s : 10: predicate.cast_eliminate 0.34% : 0.000001s : 3: predicate.check_bprop_eliminate 0.85% : 0.000001s : 10: predicate.compare_switch_simplify 1.77% : 0.000003s : 10: predicate.depend_value_elim 1.05% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 0.86% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.98% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.84% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.91% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.84% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_depend_swap 0.98% : 0.000002s : 10: predicate.environ_get_eliminate 0.86% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.50% : 0.000002s : 6: predicate.get_grad_eliminate 0.53% : 0.000001s : 3: predicate.graph_param_transform 5.72% : 0.000009s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.24% : 0.000004s : 6: predicate.less_batch_normalization 1.91% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.41% : 0.000002s : 15: predicate.load_eliminater 2.86% : 0.000005s : 3: predicate.loop_unroll_after_grad 3.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.65% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.85% : 0.000001s : 10: predicate.merge_addn 0.84% : 0.000001s : 10: predicate.minmaximum_grad 2.75% : 0.000004s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000004s : 15: predicate.partial_eliminate 1.45% : 0.000002s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.18% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 2.35% : 0.000004s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.63% : 0.000003s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.19% : 0.000002s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 10: predicate.same_eliminate 1.69% : 0.000003s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 6: predicate.special_op_eliminate 1.56% : 0.000002s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.74% : 0.000003s : 16: predicate.switch_defer_inline 1.60% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.29% : 0.000010s : 53: predicate.switch_simplify 1.10% : 0.000002s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.14% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.99% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.29% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.32% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.011905 13 4.86% : 0.000579s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.56% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 94.58% : 0.011260s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.320834 72 0.03% : 0.000095s : 1: add_recomputation 0.10% : 0.000329s : 1: auto_monad 1.07% : 0.003425s : 1: auto_monad_reorder 0.28% : 0.000906s : 1: bootstrap 0.01% : 0.000045s : 1: cconv 0.01% : 0.000026s : 1: convert_after_rewriter 0.01% : 0.000036s : 1: cse_after_recomputation 0.02% : 0.000073s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000011s : 1: get_jit_bprop_graph 0.00% : 0.000011s : 1: graph_reusing 21.88% : 0.070189s : 1: jit_opt_a 0.07% : 0.000213s : 1: jit_opt_after_cconv 0.02% : 0.000066s : 1: jit_opt_b 0.22% : 0.000697s : 1: loop_unroll 0.33% : 0.001048s : 1: mutable_eliminate 0.38% : 0.001206s : 26: opt.transform.jit_opt_a 0.02% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000043s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.34% : 0.001100s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000018s : 1: pre_auto_parallel 0.05% : 0.000156s : 1: py_interpret_to_execute 0.01% : 0.000031s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.24% : 0.000758s : 1: renormalize.infer 3.54% : 0.011357s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000070s : 1: rewriter_after_opt_a 0.04% : 0.000143s : 1: rewriter_before_opt_a 0.03% : 0.000106s : 1: symbol_engine_optimizer 71.19% : 0.228400s : 1: type_inference TotalTime = 0.136704, [30] [bootstrap]: 0.0002976 [type_inference]: 0.0353847 [event_method]: 2.358e-05 [auto_monad]: 7.467e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 0.00010845 [rewriter_before_opt_a]: 8.624e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.0171184, [2] [Cycle 1]: 0.013077, [27] [switch_simplify]: 6.298e-05 [loop_unroll]: 2.986e-05 [a_1]: 0.0112344 [with_stream_mark]: 3.833e-05 [recompute_prepare]: 1.518e-05 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.32997e-06 [parameter_eliminate]: 3.09001e-06 [specialize_transform]: 7.52998e-06 [updatestate_useless_node_eliminater]: 6.03998e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 3.35e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4.87998e-06 [cell_reuse_recompute_pass]: 2.74001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.172e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.402e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 0.00123575 [add_forward_monad_depend]: 8.62e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 2.308e-05 [cse]: 3.895e-05 [replace_applicator]: 2.034e-05 [Cycle 2]: 0.00036824, [27] [switch_simplify]: 7e-06 [loop_unroll]: 5.29e-06 [a_1]: 9.088e-05 [with_stream_mark]: 1.79e-05 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 4.61002e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.41002e-06 [meta_shard_fg_expand]: 1.74998e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.893e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.89e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 1.005e-05 [cse]: 1.58e-05 [replace_applicator]: 6.90002e-06 [py_interpret_to_execute_after_opt_a]: 2.005e-05 [rewriter_after_opt_a]: 4.309e-05 [convert_after_rewriter]: 7.78999e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00087846 [jit_opt_b]: 6.171e-05, [1] [Cycle 1]: 5.172e-05, [2] [frontend_op_eliminate]: 1.762e-05 [inline_after_opt_a]: 1.996e-05 [cconv]: 3.958e-05 [loop_unroll]: 0.00058987 [jit_opt_after_cconv]: 0.00019144, [1] [Cycle 1]: 0.00018255, [11] [c_1]: 2.295e-05 [parameter_eliminate]: 5.86e-06 [updatestate_depend_eliminate]: 1.142e-05 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.18998e-06 [cse]: 4.231e-05 [call_graph_tuple_transform]: 2.725e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.921e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 2.809e-05 [add_recomputation]: 6.233e-05 [cse_after_recomputation]: 2.923e-05, [1] [Cycle 1]: 2.205e-05, [1] [cse]: 1.509e-05 [auto_monad_reorder]: 1.968e-05 [get_jit_bprop_graph]: 2.90002e-06 [rewriter_after_jit_bprop_graph]: 1.045e-05 [opt_after_jit_grad]: 0.0812079 [symbol_engine_optimizer]: 9.162e-05, [1] [Cycle 1]: 7.987e-05, [6] [build]: 4.69998e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.734e-05 [opt_reshape]: 6.85998e-06 [fold_const_symbol]: 1.065e-05 [renormalize]: 1.64e-06 [validate]: 5.249e-05 Sums bootstrap : 0.000298s : 0.22% type_inference : 0.035385s : 26.75% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000108s : 0.08% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.011325s : 8.56% jit_opt_a.with_stream_mark : 0.000056s : 0.04% jit_opt_a.recompute_prepare : 0.000021s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001236s : 0.93% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.03% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000878s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000040s : 0.03% loop_unroll : 0.000590s : 0.45% jit_opt_after_cconv.c_1 : 0.000023s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000028s : 0.02% add_recomputation : 0.000062s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.081208s : 61.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000298 23 1.05% : 0.000003s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.04% : 0.000006s : 3: substitution.graph_param_transform 74.86% : 0.000223s : 4: substitution.inline 1.86% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 3.18% : 0.000009s : 2: substitution.replace_old_param 14.67% : 0.000044s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035294 2 95.18% : 0.033593s : 1: type_inference.infer 4.82% : 0.001701s : 1: type_inference.specialize ------[replace.] 0.000167 6 31.99% : 0.000053s : 4: replace.inline 68.01% : 0.000113s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 87.12% : 0.000220s : 4: match.inline 12.88% : 0.000033s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.94% : 0.000003s : 10: predicate.accumulaten_eliminater 2.24% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.11% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_depend_swap 1.18% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 6.59% : 0.000009s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 15: predicate.load_eliminater 1.93% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.91% : 0.000001s : 10: predicate.minmaximum_grad 3.02% : 0.000004s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 0.91% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.20% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 2.16% : 0.000003s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.48% : 0.000002s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.11% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.23% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 0.97% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000950 13 42.22% : 0.000401s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.01% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.77% : 0.000492s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149674 72 0.04% : 0.000066s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.21% : 0.000317s : 1: bootstrap 0.03% : 0.000043s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000031s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.44% : 0.017122s : 1: jit_opt_a 0.13% : 0.000195s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.40% : 0.000604s : 1: loop_unroll 0.60% : 0.000900s : 1: mutable_eliminate 7.74% : 0.011585s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000079s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000028s : 1: opt.transform.mutable_eliminate 0.03% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 54.27% : 0.081226s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000112s : 1: py_interpret_to_execute 0.02% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.48% : 0.000716s : 1: renormalize.infer 0.34% : 0.000506s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.06% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000095s : 1: symbol_engine_optimizer 23.66% : 0.035414s : 1: type_inference TotalTime = 0.530313, [30] [bootstrap]: 0.00050727 [type_inference]: 0.459068 [event_method]: 3.954e-05 [auto_monad]: 0.00011139 [graph_reusing]: 7.4e-06 [pre_auto_parallel]: 3.45e-06 [py_interpret_to_execute]: 0.00122077 [rewriter_before_opt_a]: 0.00012665 [expand_dump_flag]: 4.89e-06 [jit_opt_a]: 0.0541185, [2] [Cycle 1]: 0.00741666, [27] [switch_simplify]: 9.088e-05 [loop_unroll]: 3.37e-05 [a_1]: 0.00084736 [with_stream_mark]: 2.981e-05 [recompute_prepare]: 1.311e-05 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 3.21001e-06 [specialize_transform]: 8.72e-06 [updatestate_useless_node_eliminater]: 7.40998e-06 [accelerated_algorithm]: 8.13999e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 6.98998e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.951e-05 [j_node_and_user_rematch]: 1.325e-05 [meta_fg_expand]: 3.33998e-06 [replace_old_param]: 1.381e-05 [inline_without_move]: 8.17e-06 [renormalize]: 0.00588473 [add_forward_monad_depend]: 1.402e-05 [auto_monad_grad]: 3.06001e-06 [auto_monad_eliminator]: 2.894e-05 [cse]: 4.093e-05 [replace_applicator]: 3.303e-05 [Cycle 2]: 0.00057477, [27] [switch_simplify]: 1.195e-05 [loop_unroll]: 8.32e-06 [a_1]: 0.00018507 [with_stream_mark]: 2.544e-05 [recompute_prepare]: 9.67999e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 9.09e-06 [updatestate_useless_node_eliminater]: 8.22998e-06 [accelerated_algorithm]: 7.8e-06 [meta_shard_fg_expand]: 3.43999e-06 [get_grad_eliminate_]: 7.56999e-06 [merge_forward]: 5.21002e-06 [cell_reuse_recompute_pass]: 4.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.623e-05 [j_node_and_user_rematch]: 1.377e-05 [meta_fg_expand]: 3.43999e-06 [replace_old_param]: 1.18e-05 [inline_without_move]: 6.89999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 3.36001e-06 [auto_monad_grad]: 1.54e-06 [auto_monad_eliminator]: 1.247e-05 [cse]: 1.957e-05 [replace_applicator]: 9.00001e-06 [py_interpret_to_execute_after_opt_a]: 2.409e-05 [rewriter_after_opt_a]: 5e-05 [convert_after_rewriter]: 8.49998e-06 [order_py_execute_after_rewriter]: 1.975e-05 [mutable_eliminate]: 0.00108825 [jit_opt_b]: 7.741e-05, [1] [Cycle 1]: 6.556e-05, [2] [frontend_op_eliminate]: 2.631e-05 [inline_after_opt_a]: 2.241e-05 [cconv]: 3.815e-05 [loop_unroll]: 0.0115805 [jit_opt_after_cconv]: 0.00027116, [1] [Cycle 1]: 0.00025628, [11] [c_1]: 4.196e-05 [parameter_eliminate]: 8.11002e-06 [updatestate_depend_eliminate]: 1.535e-05 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 5.208e-05 [call_graph_tuple_transform]: 4.013e-05 [tuple_list_get_item_eliminator]: 1.047e-05 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 9.70002e-06 [remove_dup_value]: 2.215e-05 [partial_unused_args_eliminate]: 2.38998e-06 [environ_conv]: 1.452e-05 [add_recomputation]: 6.541e-05 [cse_after_recomputation]: 3.688e-05, [1] [Cycle 1]: 2.683e-05, [1] [cse]: 1.748e-05 [auto_monad_reorder]: 2.114e-05 [get_jit_bprop_graph]: 2.81e-06 [rewriter_after_jit_bprop_graph]: 1.386e-05 [opt_after_jit_grad]: 0.00107508 [symbol_engine_optimizer]: 0.0002471, [1] [Cycle 1]: 0.00023529, [6] [build]: 8.61997e-06 [elim_shapecalc]: 1.178e-05 [elim_not_effective]: 2.363e-05 [opt_reshape]: 9.16002e-06 [fold_const_symbol]: 0.00014442 [renormalize]: 1.40001e-06 [validate]: 8.777e-05 Sums bootstrap : 0.000507s : 0.10% type_inference : 0.459068s : 95.01% event_method : 0.000040s : 0.01% auto_monad : 0.000111s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001221s : 0.25% rewriter_before_opt_a : 0.000127s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000103s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001032s : 0.21% jit_opt_a.with_stream_mark : 0.000055s : 0.01% jit_opt_a.recompute_prepare : 0.000023s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.005885s : 1.22% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000041s : 0.01% jit_opt_a.cse : 0.000060s : 0.01% jit_opt_a.replace_applicator : 0.000042s : 0.01% py_interpret_to_execute_after_opt_a : 0.000024s : 0.00% rewriter_after_opt_a : 0.000050s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000020s : 0.00% mutable_eliminate : 0.001088s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.00% cconv : 0.000038s : 0.01% loop_unroll : 0.011581s : 2.40% jit_opt_after_cconv.c_1 : 0.000042s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000052s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000040s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.00% remove_dup_value : 0.000022s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000015s : 0.00% add_recomputation : 0.000065s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.00% opt_after_jit_grad : 0.001075s : 0.22% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000144s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000088s : 0.02% Time group info: ------[substitution.] 0.000491 24 0.50% : 0.000002s : 2: substitution.elim_not_effective 27.40% : 0.000135s : 2: substitution.fold_const_symbol 1.53% : 0.000008s : 4: substitution.graph_param_transform 62.90% : 0.000309s : 4: substitution.inline 1.03% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.50% : 0.000007s : 4: substitution.remove_not_recompute_node 1.62% : 0.000008s : 2: substitution.replace_old_param 3.52% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.458860 2 98.58% : 0.452363s : 1: type_inference.infer 1.42% : 0.006497s : 1: type_inference.specialize ------[replace.] 0.000123 6 65.07% : 0.000080s : 4: replace.inline 34.93% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000321 6 95.08% : 0.000305s : 4: match.inline 4.92% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000203 830 1.04% : 0.000002s : 12: predicate.accumulaten_eliminater 1.91% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 12: predicate.addn_check_dump 1.62% : 0.000003s : 12: predicate.addn_zero_filter 2.79% : 0.000006s : 12: predicate.arithmetic_simplify 1.54% : 0.000003s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 0.72% : 0.000001s : 12: predicate.compare_switch_simplify 0.86% : 0.000002s : 12: predicate.depend_value_elim 0.83% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.71% : 0.000003s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.88% : 0.000002s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000003s : 8: predicate.get_grad_eliminate 0.28% : 0.000001s : 4: predicate.graph_param_transform 5.23% : 0.000011s : 26: predicate.inline 0.72% : 0.000001s : 8: predicate.inline_without_move 0.32% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000003s : 8: predicate.less_batch_normalization 1.72% : 0.000004s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 18: predicate.load_eliminater 4.18% : 0.000008s : 4: predicate.loop_unroll_after_grad 3.07% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.15% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.70% : 0.000001s : 12: predicate.merge_addn 0.92% : 0.000002s : 12: predicate.minmaximum_grad 2.59% : 0.000005s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 1.71% : 0.000003s : 18: predicate.partial_eliminate 1.39% : 0.000003s : 12: predicate.print_const_string_wrapper 1.80% : 0.000004s : 12: predicate.reduce_eliminate 1.48% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.52% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000003s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000002s : 4: predicate.row_tensor_eliminate 1.42% : 0.000003s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 8: predicate.special_op_eliminate 0.83% : 0.000002s : 8: predicate.specialize_transform 1.07% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000005s : 18: predicate.switch_defer_inline 1.56% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.95% : 0.000016s : 58: predicate.switch_simplify 1.31% : 0.000003s : 12: predicate.tile_eliminate 0.99% : 0.000002s : 12: predicate.transpose_eliminate 1.22% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.84% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.41% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000003s : 12: predicate.value_based_eliminate 0.23% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.05% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003870 22 57.53% : 0.002226s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.82% : 0.000070s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.65% : 0.001573s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.537823 72 0.01% : 0.000071s : 1: add_recomputation 0.02% : 0.000117s : 1: auto_monad 0.00% : 0.000024s : 1: auto_monad_reorder 0.10% : 0.000540s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000039s : 1: cse_after_recomputation 0.00% : 0.000018s : 1: environ_conv 0.01% : 0.000045s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 10.06% : 0.054124s : 1: jit_opt_a 0.05% : 0.000277s : 1: jit_opt_after_cconv 0.02% : 0.000081s : 1: jit_opt_b 2.16% : 0.011618s : 1: loop_unroll 0.21% : 0.001107s : 1: mutable_eliminate 0.26% : 0.001373s : 26: opt.transform.jit_opt_a 0.02% : 0.000097s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000046s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000069s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000185s : 4: opt.transform.symbol_engine_opt 0.20% : 0.001096s : 1: opt_after_jit_grad 0.00% : 0.000023s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.23% : 0.001238s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000026s : 1: remove_dup_value 0.77% : 0.004149s : 1: renormalize.infer 0.32% : 0.001717s : 1: renormalize.specialize 0.00% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000055s : 1: rewriter_after_opt_a 0.02% : 0.000133s : 1: rewriter_before_opt_a 0.05% : 0.000251s : 1: symbol_engine_optimizer 85.36% : 0.459108s : 1: type_inference TotalTime = 0.606232, [30] [bootstrap]: 0.00048622 [type_inference]: 0.523948 [event_method]: 2.806e-05 [auto_monad]: 8.892e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 3.45e-06 [py_interpret_to_execute]: 0.00115448 [rewriter_before_opt_a]: 0.00013684 [expand_dump_flag]: 3.97998e-06 [jit_opt_a]: 0.0773127, [2] [Cycle 1]: 0.00639422, [27] [switch_simplify]: 9.251e-05 [loop_unroll]: 3.38e-05 [a_1]: 0.00080725 [with_stream_mark]: 2.53e-05 [recompute_prepare]: 1.137e-05 [updatestate_depend_eliminate]: 5.67999e-06 [updatestate_assign_eliminate]: 4.20999e-06 [updatestate_loads_eliminate]: 4.06001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 8.26002e-06 [updatestate_useless_node_eliminater]: 7.61999e-06 [accelerated_algorithm]: 7.83999e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 7.26999e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.683e-05 [j_node_and_user_rematch]: 1.143e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.329e-05 [inline_without_move]: 7.77e-06 [renormalize]: 0.00495395 [add_forward_monad_depend]: 9.98002e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 2.267e-05 [cse]: 4.201e-05 [replace_applicator]: 2.832e-05 [Cycle 2]: 0.00043037, [27] [switch_simplify]: 8.06001e-06 [loop_unroll]: 7.05e-06 [a_1]: 0.00013957 [with_stream_mark]: 1.809e-05 [recompute_prepare]: 6.54999e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.87002e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.27998e-06 [cell_reuse_recompute_pass]: 4.21001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.02e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 3.33e-06 [replace_old_param]: 1.105e-05 [inline_without_move]: 6.38e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 8.17e-06 [cse]: 1.619e-05 [replace_applicator]: 6.77002e-06 [py_interpret_to_execute_after_opt_a]: 1.923e-05 [rewriter_after_opt_a]: 4.787e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.72001e-06 [mutable_eliminate]: 0.00090495 [jit_opt_b]: 6.859e-05, [1] [Cycle 1]: 5.962e-05, [2] [frontend_op_eliminate]: 2.406e-05 [inline_after_opt_a]: 2.082e-05 [cconv]: 3.568e-05 [loop_unroll]: 0.00049722 [jit_opt_after_cconv]: 0.00020304, [1] [Cycle 1]: 0.00019488, [11] [c_1]: 2.966e-05 [parameter_eliminate]: 5.38002e-06 [updatestate_depend_eliminate]: 8.54002e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 4.289e-05 [call_graph_tuple_transform]: 2.725e-05 [tuple_list_get_item_eliminator]: 6.91001e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 7.63001e-06 [remove_dup_value]: 2.266e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.096e-05 [add_recomputation]: 5.51e-05 [cse_after_recomputation]: 3.083e-05, [1] [Cycle 1]: 2.436e-05, [1] [cse]: 1.641e-05 [auto_monad_reorder]: 2.061e-05 [get_jit_bprop_graph]: 3.74002e-06 [rewriter_after_jit_bprop_graph]: 9.32001e-06 [opt_after_jit_grad]: 0.00052701 [symbol_engine_optimizer]: 8.423e-05, [1] [Cycle 1]: 7.747e-05, [6] [build]: 5.39e-06 [elim_shapecalc]: 1.021e-05 [elim_not_effective]: 1.499e-05 [opt_reshape]: 7.02002e-06 [fold_const_symbol]: 1.072e-05 [renormalize]: 3.20026e-07 [validate]: 6.201e-05 Sums bootstrap : 0.000486s : 0.09% type_inference : 0.523948s : 97.97% event_method : 0.000028s : 0.01% auto_monad : 0.000089s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001154s : 0.22% rewriter_before_opt_a : 0.000137s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000101s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000947s : 0.18% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000008s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.004954s : 0.93% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000058s : 0.01% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000048s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000905s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.00% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000036s : 0.01% loop_unroll : 0.000497s : 0.09% jit_opt_after_cconv.c_1 : 0.000030s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000055s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000527s : 0.10% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.01% Time group info: ------[substitution.] 0.000335 24 0.80% : 0.000003s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000009s : 4: substitution.graph_param_transform 86.28% : 0.000289s : 4: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000006s : 4: substitution.remove_not_recompute_node 2.36% : 0.000008s : 2: substitution.replace_old_param 4.51% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.523805 2 98.64% : 0.516671s : 1: type_inference.infer 1.36% : 0.007133s : 1: type_inference.specialize ------[replace.] 0.000114 6 66.41% : 0.000076s : 4: replace.inline 33.59% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000300 6 95.39% : 0.000286s : 4: match.inline 4.61% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.51% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 12: predicate.addn_check_dump 1.73% : 0.000003s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 1.52% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.03% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000002s : 8: predicate.get_grad_eliminate 0.53% : 0.000001s : 4: predicate.graph_param_transform 5.18% : 0.000008s : 26: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.22% : 0.000007s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.38% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000002s : 12: predicate.minmaximum_grad 1.96% : 0.000003s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 1.95% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000003s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.79% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.49% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 0.97% : 0.000002s : 8: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.64% : 0.000004s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.94% : 0.000011s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.47% : 0.000002s : 12: predicate.transpose_eliminate 1.69% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.58% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.54% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004489 22 57.63% : 0.002587s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.51% : 0.000068s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.86% : 0.001834s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.612332 72 0.01% : 0.000060s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000023s : 1: auto_monad_reorder 0.08% : 0.000517s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000033s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.63% : 0.077318s : 1: jit_opt_a 0.03% : 0.000206s : 1: jit_opt_after_cconv 0.01% : 0.000072s : 1: jit_opt_b 0.08% : 0.000506s : 1: loop_unroll 0.15% : 0.000916s : 1: mutable_eliminate 0.21% : 0.001258s : 26: opt.transform.jit_opt_a 0.01% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.09% : 0.000537s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.001174s : 1: py_interpret_to_execute 0.00% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000025s : 1: remove_dup_value 0.61% : 0.003708s : 1: renormalize.infer 0.20% : 0.001230s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000051s : 1: rewriter_after_opt_a 0.02% : 0.000145s : 1: rewriter_before_opt_a 0.01% : 0.000087s : 1: symbol_engine_optimizer 85.57% : 0.523988s : 1: type_inference TotalTime = 0.404081, [30] [bootstrap]: 0.00034001 [type_inference]: 0.290914 [event_method]: 3.017e-05 [auto_monad]: 8.784e-05 [graph_reusing]: 7e-06 [pre_auto_parallel]: 3.34001e-06 [py_interpret_to_execute]: 0.00046826 [rewriter_before_opt_a]: 0.00012494 [expand_dump_flag]: 4.57e-06 [jit_opt_a]: 0.108463, [2] [Cycle 1]: 0.00659652, [27] [switch_simplify]: 0.00010034 [loop_unroll]: 3.9e-05 [a_1]: 0.00103199 [with_stream_mark]: 2.991e-05 [recompute_prepare]: 1.436e-05 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 3.92998e-06 [updatestate_loads_eliminate]: 4.12998e-06 [parameter_eliminate]: 2.56998e-06 [specialize_transform]: 9.46998e-06 [updatestate_useless_node_eliminater]: 6.77002e-06 [accelerated_algorithm]: 9.25001e-06 [meta_shard_fg_expand]: 4.22e-06 [get_grad_eliminate_]: 9.07001e-06 [merge_forward]: 4.83001e-06 [cell_reuse_recompute_pass]: 2.29999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.24e-05 [j_node_and_user_rematch]: 1.497e-05 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 1.444e-05 [inline_without_move]: 8.73001e-06 [renormalize]: 0.0048675 [add_forward_monad_depend]: 1.285e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 2.761e-05 [cse]: 4.427e-05 [replace_applicator]: 3.35e-05 [Cycle 2]: 0.00052013, [27] [switch_simplify]: 8.94e-06 [loop_unroll]: 8.15e-06 [a_1]: 0.00015755 [with_stream_mark]: 1.903e-05 [recompute_prepare]: 1.116e-05 [updatestate_depend_eliminate]: 5.05999e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 8.28001e-06 [updatestate_useless_node_eliminater]: 7.97998e-06 [accelerated_algorithm]: 8.87e-06 [meta_shard_fg_expand]: 3.08998e-06 [get_grad_eliminate_]: 7.55998e-06 [merge_forward]: 6.05002e-06 [cell_reuse_recompute_pass]: 3.74002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.584e-05 [j_node_and_user_rematch]: 1.244e-05 [meta_fg_expand]: 4.12e-06 [replace_old_param]: 1.216e-05 [inline_without_move]: 6.53e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.61e-06 [auto_monad_grad]: 1.50001e-06 [auto_monad_eliminator]: 1.142e-05 [cse]: 2.54e-05 [replace_applicator]: 8.80999e-06 [py_interpret_to_execute_after_opt_a]: 2.389e-05 [rewriter_after_opt_a]: 5.223e-05 [convert_after_rewriter]: 8.46002e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00108821 [jit_opt_b]: 7.996e-05, [1] [Cycle 1]: 6.905e-05, [2] [frontend_op_eliminate]: 2.808e-05 [inline_after_opt_a]: 2.575e-05 [cconv]: 3.608e-05 [loop_unroll]: 0.00065891 [jit_opt_after_cconv]: 0.00022953, [1] [Cycle 1]: 0.00022058, [11] [c_1]: 3.251e-05 [parameter_eliminate]: 6.19001e-06 [updatestate_depend_eliminate]: 1.098e-05 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 4.857e-05 [call_graph_tuple_transform]: 3.424e-05 [tuple_list_get_item_eliminator]: 8.18999e-06 [none_parameter_eliminate]: 2.08002e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 8.79998e-06 [remove_dup_value]: 2.48e-05 [partial_unused_args_eliminate]: 5.37001e-06 [environ_conv]: 1.272e-05 [add_recomputation]: 6.306e-05 [cse_after_recomputation]: 3.578e-05, [1] [Cycle 1]: 2.659e-05, [1] [cse]: 1.737e-05 [auto_monad_reorder]: 2.092e-05 [get_jit_bprop_graph]: 2.45002e-06 [rewriter_after_jit_bprop_graph]: 1.125e-05 [opt_after_jit_grad]: 0.00080806 [symbol_engine_optimizer]: 0.00011158, [1] [Cycle 1]: 0.00010101, [6] [build]: 7.1e-06 [elim_shapecalc]: 1.125e-05 [elim_not_effective]: 2.263e-05 [opt_reshape]: 1.234e-05 [fold_const_symbol]: 1.068e-05 [renormalize]: 5.49975e-07 [validate]: 7.829e-05 Sums bootstrap : 0.000340s : 0.11% type_inference : 0.290914s : 96.37% event_method : 0.000030s : 0.01% auto_monad : 0.000088s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000468s : 0.16% rewriter_before_opt_a : 0.000125s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000109s : 0.04% jit_opt_a.loop_unroll : 0.000047s : 0.02% jit_opt_a.a_1 : 0.001190s : 0.39% jit_opt_a.with_stream_mark : 0.000049s : 0.02% jit_opt_a.recompute_prepare : 0.000026s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000027s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.004868s : 1.61% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.01% jit_opt_a.cse : 0.000070s : 0.02% jit_opt_a.replace_applicator : 0.000042s : 0.01% py_interpret_to_execute_after_opt_a : 0.000024s : 0.01% rewriter_after_opt_a : 0.000052s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001088s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.01% jit_opt_b.inline_after_opt_a : 0.000026s : 0.01% cconv : 0.000036s : 0.01% loop_unroll : 0.000659s : 0.22% jit_opt_after_cconv.c_1 : 0.000033s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000034s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000025s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000063s : 0.02% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000808s : 0.27% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000078s : 0.03% Time group info: ------[substitution.] 0.000423 25 0.63% : 0.000003s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000010s : 4: substitution.graph_param_transform 88.02% : 0.000372s : 5: substitution.inline 1.44% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.71% : 0.000007s : 4: substitution.remove_not_recompute_node 1.97% : 0.000008s : 2: substitution.replace_old_param 3.65% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.290773 2 98.96% : 0.287761s : 1: type_inference.infer 1.04% : 0.003012s : 1: type_inference.specialize ------[replace.] 0.000175 7 67.55% : 0.000118s : 5: replace.inline 32.45% : 0.000057s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000381 7 96.49% : 0.000368s : 5: match.inline 3.51% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000193 888 1.37% : 0.000003s : 13: predicate.accumulaten_eliminater 1.39% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.67% : 0.000003s : 13: predicate.addn_zero_filter 2.74% : 0.000005s : 13: predicate.arithmetic_simplify 1.13% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 0.87% : 0.000002s : 13: predicate.compare_switch_simplify 1.40% : 0.000003s : 13: predicate.depend_value_elim 1.25% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.98% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.80% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.84% : 0.000002s : 13: predicate.environ_get_depend_swap 1.09% : 0.000002s : 13: predicate.environ_get_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.36% : 0.000003s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 4.87% : 0.000009s : 28: predicate.inline 0.89% : 0.000002s : 8: predicate.inline_without_move 0.32% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.15% : 0.000004s : 8: predicate.less_batch_normalization 1.23% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 2.02% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000007s : 41: predicate.loop_unroll_before_grad 1.88% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.87% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 2.71% : 0.000005s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 1.79% : 0.000003s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 2.26% : 0.000004s : 13: predicate.reduce_eliminate 1.37% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000004s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.09% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.90% : 0.000002s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 13: predicate.same_eliminate 1.16% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000002s : 8: predicate.specialize_transform 1.19% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000005s : 20: predicate.switch_defer_inline 1.56% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.30% : 0.000016s : 65: predicate.switch_simplify 1.49% : 0.000003s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.01% : 0.000006s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000003s : 13: predicate.value_based_eliminate 0.24% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003672 29 62.05% : 0.002278s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.08% : 0.000113s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.86% : 0.001280s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.410635 72 0.02% : 0.000068s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.09% : 0.000364s : 1: bootstrap 0.01% : 0.000040s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000038s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 26.41% : 0.108468s : 1: jit_opt_a 0.06% : 0.000233s : 1: jit_opt_after_cconv 0.02% : 0.000083s : 1: jit_opt_b 0.16% : 0.000671s : 1: loop_unroll 0.27% : 0.001109s : 1: mutable_eliminate 0.38% : 0.001548s : 26: opt.transform.jit_opt_a 0.02% : 0.000079s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000086s : 1: opt.transform.mutable_eliminate 0.01% : 0.000042s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000825s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000027s : 1: remove_dup_value 0.80% : 0.003290s : 1: renormalize.infer 0.38% : 0.001558s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000057s : 1: rewriter_after_opt_a 0.03% : 0.000132s : 1: rewriter_before_opt_a 0.03% : 0.000114s : 1: symbol_engine_optimizer 70.85% : 0.290948s : 1: type_inference TotalTime = 0.079803, [30] [bootstrap]: 0.00032651 [type_inference]: 0.00570026 [event_method]: 1.944e-05 [auto_monad]: 7.038e-05 [graph_reusing]: 7.278e-05 [pre_auto_parallel]: 3.5e-06 [py_interpret_to_execute]: 4.582e-05 [rewriter_before_opt_a]: 7.783e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.0062848, [2] [Cycle 1]: 0.0019087, [27] [switch_simplify]: 7.03e-05 [loop_unroll]: 3.06e-05 [a_1]: 0.00061191 [with_stream_mark]: 2.637e-05 [recompute_prepare]: 8.13001e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.647e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.76e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 0.00080331 [add_forward_monad_depend]: 5.63997e-06 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 1.584e-05 [cse]: 3.366e-05 [replace_applicator]: 1.24e-05 [Cycle 2]: 0.00032697, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.20001e-06 [a_1]: 9.003e-05 [with_stream_mark]: 1.142e-05 [recompute_prepare]: 5.35001e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 7.71999e-06 [meta_fg_expand]: 1.47001e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.82998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.46999e-06 [cse]: 1.322e-05 [replace_applicator]: 5.44998e-06 [py_interpret_to_execute_after_opt_a]: 1.405e-05 [rewriter_after_opt_a]: 4.022e-05 [convert_after_rewriter]: 6.75998e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00071657 [jit_opt_b]: 5.469e-05, [1] [Cycle 1]: 4.693e-05, [2] [frontend_op_eliminate]: 1.809e-05 [inline_after_opt_a]: 1.695e-05 [cconv]: 3.068e-05 [loop_unroll]: 0.00047056 [jit_opt_after_cconv]: 0.0643749, [1] [Cycle 1]: 0.0643641, [11] [c_1]: 2.267e-05 [parameter_eliminate]: 3.63e-06 [updatestate_depend_eliminate]: 2.476e-05 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 0.064071 [call_graph_tuple_transform]: 7.938e-05 [tuple_list_get_item_eliminator]: 9.07999e-06 [none_parameter_eliminate]: 5.91998e-06 [renormalize]: 1.39e-06 [switch_simplify]: 6.66999e-06 [remove_dup_value]: 3.276e-05 [partial_unused_args_eliminate]: 3.18e-06 [environ_conv]: 1.105e-05 [add_recomputation]: 7.469e-05 [cse_after_recomputation]: 4.888e-05, [1] [Cycle 1]: 3.744e-05, [1] [cse]: 3.053e-05 [auto_monad_reorder]: 2.031e-05 [get_jit_bprop_graph]: 2.96999e-06 [rewriter_after_jit_bprop_graph]: 1.322e-05 [opt_after_jit_grad]: 0.00092801 [symbol_engine_optimizer]: 8.747e-05, [1] [Cycle 1]: 7.772e-05, [6] [build]: 6.17999e-06 [elim_shapecalc]: 8.59998e-06 [elim_not_effective]: 1.692e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 9.53002e-06 [renormalize]: 6.09987e-07 [validate]: 5e-05 Sums bootstrap : 0.000327s : 0.44% type_inference : 0.005700s : 7.60% event_method : 0.000019s : 0.03% auto_monad : 0.000070s : 0.09% graph_reusing : 0.000073s : 0.10% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000046s : 0.06% rewriter_before_opt_a : 0.000078s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000702s : 0.94% jit_opt_a.with_stream_mark : 0.000038s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000803s : 1.07% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000047s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000717s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000031s : 0.04% loop_unroll : 0.000471s : 0.63% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000025s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.064071s : 85.42% jit_opt_after_cconv.call_graph_tuple_transform : 0.000079s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000033s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000075s : 0.10% cse_after_recomputation.cse : 0.000031s : 0.04% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.02% opt_after_jit_grad : 0.000928s : 1.24% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.07% Time group info: ------[substitution.] 0.000275 23 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 5.52% : 0.000015s : 3: substitution.graph_param_transform 83.58% : 0.000230s : 4: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.52% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005619 2 82.65% : 0.004644s : 1: type_inference.infer 17.35% : 0.000975s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.12% : 0.000053s : 4: replace.inline 30.88% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.22% : 0.000227s : 4: match.inline 4.78% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.72% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.50% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.99% : 0.000001s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.08% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.69% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.12% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.20% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.33% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.24% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.59% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000751 13 52.93% : 0.000398s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.75% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.32% : 0.000295s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.081652 72 0.10% : 0.000078s : 1: add_recomputation 0.09% : 0.000074s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.43% : 0.000348s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000051s : 1: cse_after_recomputation 0.02% : 0.000014s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.09% : 0.000076s : 1: graph_reusing 7.70% : 0.006288s : 1: jit_opt_a 78.85% : 0.064381s : 1: jit_opt_after_cconv 0.07% : 0.000057s : 1: jit_opt_b 0.59% : 0.000479s : 1: loop_unroll 0.89% : 0.000726s : 1: mutable_eliminate 1.14% : 0.000933s : 26: opt.transform.jit_opt_a 0.13% : 0.000106s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.15% : 0.000941s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000049s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000036s : 1: remove_dup_value 0.55% : 0.000453s : 1: renormalize.infer 0.42% : 0.000342s : 1: renormalize.specialize 0.02% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.10% : 0.000081s : 1: rewriter_before_opt_a 0.11% : 0.000090s : 1: symbol_engine_optimizer 7.01% : 0.005725s : 1: type_inference TotalTime = 0.103194, [30] [bootstrap]: 0.00034565 [type_inference]: 0.0817049 [event_method]: 2.423e-05 [auto_monad]: 6.993e-05 [graph_reusing]: 5.69999e-06 [pre_auto_parallel]: 2.45002e-06 [py_interpret_to_execute]: 0.00011527 [rewriter_before_opt_a]: 8.804e-05 [expand_dump_flag]: 3.57002e-06 [jit_opt_a]: 0.0183889, [2] [Cycle 1]: 0.00219277, [27] [switch_simplify]: 6.592e-05 [loop_unroll]: 2.947e-05 [a_1]: 0.00064223 [with_stream_mark]: 2.686e-05 [recompute_prepare]: 8.13001e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00106702 [add_forward_monad_depend]: 8.05999e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.683e-05 [cse]: 3.316e-05 [replace_applicator]: 1.473e-05 [Cycle 2]: 0.00032362, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 5.07e-06 [a_1]: 8.831e-05 [with_stream_mark]: 1.218e-05 [recompute_prepare]: 5.47999e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.31002e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 7.99002e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 7.85e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.54998e-06 [cse]: 1.258e-05 [replace_applicator]: 4.95001e-06 [py_interpret_to_execute_after_opt_a]: 1.347e-05 [rewriter_after_opt_a]: 3.928e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.76002e-06 [mutable_eliminate]: 0.00066627 [jit_opt_b]: 4.952e-05, [1] [Cycle 1]: 4.212e-05, [2] [frontend_op_eliminate]: 1.512e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 2.91e-05 [loop_unroll]: 0.00041586 [jit_opt_after_cconv]: 0.00014423, [1] [Cycle 1]: 0.00013761, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.385e-05 [call_graph_tuple_transform]: 1.874e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.83002e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.54998e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 6.51e-06 [add_recomputation]: 5.385e-05 [cse_after_recomputation]: 2.579e-05, [1] [Cycle 1]: 1.922e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.737e-05 [get_jit_bprop_graph]: 3.03998e-06 [rewriter_after_jit_bprop_graph]: 5.99999e-06 [opt_after_jit_grad]: 0.00050788 [symbol_engine_optimizer]: 8.453e-05, [1] [Cycle 1]: 7.625e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 1.137e-05 [elim_not_effective]: 1.345e-05 [opt_reshape]: 6.55002e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 4.89992e-07 [validate]: 4.533e-05 Sums bootstrap : 0.000346s : 0.40% type_inference : 0.081705s : 94.36% event_method : 0.000024s : 0.03% auto_monad : 0.000070s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000115s : 0.13% rewriter_before_opt_a : 0.000088s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000731s : 0.84% jit_opt_a.with_stream_mark : 0.000039s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001067s : 1.23% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000046s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000666s : 0.77% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000416s : 0.48% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000508s : 0.59% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.05% Time group info: ------[substitution.] 0.000250 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 85.85% : 0.000215s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.081613 2 97.93% : 0.079924s : 1: type_inference.infer 2.07% : 0.001690s : 1: type_inference.specialize ------[replace.] 0.000132 6 80.15% : 0.000106s : 4: replace.inline 19.85% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.79% : 0.000213s : 4: match.inline 5.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.50% : 0.000002s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 1.62% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.84% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.65% : 0.000008s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.39% : 0.000003s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.26% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000987 13 48.54% : 0.000479s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.31% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.15% : 0.000455s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.105304 72 0.05% : 0.000057s : 1: add_recomputation 0.07% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.35% : 0.000367s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 17.47% : 0.018393s : 1: jit_opt_a 0.14% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000052s : 1: jit_opt_b 0.40% : 0.000424s : 1: loop_unroll 0.64% : 0.000676s : 1: mutable_eliminate 0.91% : 0.000960s : 26: opt.transform.jit_opt_a 0.05% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000071s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000620s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000119s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.59% : 0.000618s : 1: renormalize.infer 0.42% : 0.000440s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000092s : 1: rewriter_before_opt_a 0.08% : 0.000087s : 1: symbol_engine_optimizer 77.61% : 0.081727s : 1: type_inference TotalTime = 0.202498, [30] [bootstrap]: 0.00040233 [type_inference]: 0.172262 [event_method]: 2.9e-05 [auto_monad]: 8.591e-05 [graph_reusing]: 6.65002e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.0169981 [rewriter_before_opt_a]: 0.00016185 [expand_dump_flag]: 6.06e-06 [jit_opt_a]: 0.00980132, [2] [Cycle 1]: 0.00482616, [27] [switch_simplify]: 7.795e-05 [loop_unroll]: 3.673e-05 [a_1]: 0.00084586 [with_stream_mark]: 2.848e-05 [recompute_prepare]: 1.17e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.73001e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 8.29998e-06 [updatestate_useless_node_eliminater]: 7.21999e-06 [accelerated_algorithm]: 7.6e-06 [meta_shard_fg_expand]: 2.74999e-06 [get_grad_eliminate_]: 7.28e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.943e-05 [j_node_and_user_rematch]: 1.126e-05 [meta_fg_expand]: 3.08998e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 7.63001e-06 [renormalize]: 0.00340547 [add_forward_monad_depend]: 9.46e-06 [auto_monad_grad]: 2.40002e-06 [auto_monad_eliminator]: 2.167e-05 [cse]: 3.79e-05 [replace_applicator]: 2.418e-05 [Cycle 2]: 0.00044498, [27] [switch_simplify]: 8.89998e-06 [loop_unroll]: 7.43e-06 [a_1]: 0.00013588 [with_stream_mark]: 1.743e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.49001e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.986e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 3.17002e-06 [replace_old_param]: 1.095e-05 [inline_without_move]: 6.71e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 1.55999e-06 [auto_monad_eliminator]: 1.111e-05 [cse]: 1.976e-05 [replace_applicator]: 8.00999e-06 [py_interpret_to_execute_after_opt_a]: 1.79e-05 [rewriter_after_opt_a]: 4.283e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.0007845 [jit_opt_b]: 6.47e-05, [1] [Cycle 1]: 5.575e-05, [2] [frontend_op_eliminate]: 2.218e-05 [inline_after_opt_a]: 2.067e-05 [cconv]: 3.303e-05 [loop_unroll]: 0.000521 [jit_opt_after_cconv]: 0.00018041, [1] [Cycle 1]: 0.0001734, [11] [c_1]: 2.922e-05 [parameter_eliminate]: 4.08999e-06 [updatestate_depend_eliminate]: 9.35001e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.18e-06 [cse]: 3.211e-05 [call_graph_tuple_transform]: 2.323e-05 [tuple_list_get_item_eliminator]: 6.76e-06 [none_parameter_eliminate]: 1.95001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.61e-06 [remove_dup_value]: 2.148e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 1.068e-05 [add_recomputation]: 5.97e-05 [cse_after_recomputation]: 2.767e-05, [1] [Cycle 1]: 2.267e-05, [1] [cse]: 1.545e-05 [auto_monad_reorder]: 1.847e-05 [get_jit_bprop_graph]: 3.27997e-06 [rewriter_after_jit_bprop_graph]: 6.89999e-06 [opt_after_jit_grad]: 0.00049943 [symbol_engine_optimizer]: 0.0001457, [1] [Cycle 1]: 0.00013895, [6] [build]: 4.44002e-06 [elim_shapecalc]: 9.56e-06 [elim_not_effective]: 1.539e-05 [opt_reshape]: 7.05e-06 [fold_const_symbol]: 7.249e-05 [renormalize]: 5.39992e-07 [validate]: 6.228e-05 Sums bootstrap : 0.000402s : 0.20% type_inference : 0.172262s : 87.33% event_method : 0.000029s : 0.01% auto_monad : 0.000086s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.016998s : 8.62% rewriter_before_opt_a : 0.000162s : 0.08% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.04% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.000982s : 0.50% jit_opt_a.with_stream_mark : 0.000046s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003406s : 1.73% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000058s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000785s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000521s : 0.26% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000499s : 0.25% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000072s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.03% Time group info: ------[substitution.] 0.000342 25 0.93% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 4: substitution.graph_param_transform 88.50% : 0.000302s : 5: substitution.inline 1.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 3.96% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.172115 2 97.95% : 0.168587s : 1: type_inference.infer 2.05% : 0.003528s : 1: type_inference.specialize ------[replace.] 0.000133 7 67.19% : 0.000090s : 5: replace.inline 32.81% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000311 7 96.04% : 0.000299s : 5: match.inline 3.96% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000163 888 1.72% : 0.000003s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000004s : 13: predicate.arithmetic_simplify 1.08% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 13: predicate.compare_switch_simplify 1.65% : 0.000003s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.55% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.20% : 0.000009s : 28: predicate.inline 1.35% : 0.000002s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.90% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.48% : 0.000002s : 19: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.21% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 13: predicate.merge_addn 0.93% : 0.000002s : 13: predicate.minmaximum_grad 1.99% : 0.000003s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 1.90% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000003s : 13: predicate.reduce_eliminate 1.16% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.44% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 13: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 20: predicate.switch_defer_inline 1.93% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.63% : 0.000012s : 65: predicate.switch_simplify 1.55% : 0.000003s : 13: predicate.tile_eliminate 1.83% : 0.000003s : 13: predicate.transpose_eliminate 1.87% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.48% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003818 29 69.71% : 0.002662s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.63% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.67% : 0.001057s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.207302 72 0.03% : 0.000062s : 1: add_recomputation 0.04% : 0.000091s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.20% : 0.000420s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.73% : 0.009806s : 1: jit_opt_a 0.09% : 0.000183s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.26% : 0.000529s : 1: loop_unroll 0.38% : 0.000795s : 1: mutable_eliminate 0.62% : 0.001282s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000101s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000507s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 8.21% : 0.017020s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 1.15% : 0.002378s : 1: renormalize.infer 0.49% : 0.001014s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000169s : 1: rewriter_before_opt_a 0.07% : 0.000149s : 1: symbol_engine_optimizer 83.11% : 0.172281s : 1: type_inference . TotalTime = 0.386116, [30] [bootstrap]: 0.00049517 [type_inference]: 0.353486 [event_method]: 3.081e-05 [auto_monad]: 0.0001867 [graph_reusing]: 7.53999e-06 [pre_auto_parallel]: 3.72002e-06 [py_interpret_to_execute]: 0.00142809 [rewriter_before_opt_a]: 0.00019046 [expand_dump_flag]: 5.79e-06 [jit_opt_a]: 0.0258641, [2] [Cycle 1]: 0.0193831, [27] [switch_simplify]: 9.976e-05 [loop_unroll]: 3.419e-05 [a_1]: 0.00096072 [with_stream_mark]: 3.159e-05 [recompute_prepare]: 1.596e-05 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.87002e-06 [specialize_transform]: 8.74e-06 [updatestate_useless_node_eliminater]: 8.06001e-06 [accelerated_algorithm]: 9.11998e-06 [meta_shard_fg_expand]: 3.87002e-06 [get_grad_eliminate_]: 7.71001e-06 [merge_forward]: 5.74e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.32e-05 [j_node_and_user_rematch]: 1.543e-05 [meta_fg_expand]: 3.25998e-06 [replace_old_param]: 1.386e-05 [inline_without_move]: 7.71999e-06 [renormalize]: 0.0176965 [add_forward_monad_depend]: 1.687e-05 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.917e-05 [cse]: 4.393e-05 [replace_applicator]: 3.294e-05 [Cycle 2]: 0.00051559, [27] [switch_simplify]: 9.03002e-06 [loop_unroll]: 8.12e-06 [a_1]: 0.00015637 [with_stream_mark]: 2.282e-05 [recompute_prepare]: 9.07999e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 7.26999e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 7.02002e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 6.71999e-06 [merge_forward]: 4.82e-06 [cell_reuse_recompute_pass]: 4.09002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.732e-05 [j_node_and_user_rematch]: 1.237e-05 [meta_fg_expand]: 3.33998e-06 [replace_old_param]: 1.398e-05 [inline_without_move]: 5.89999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 3.3e-06 [auto_monad_grad]: 1.75001e-06 [auto_monad_eliminator]: 1.269e-05 [cse]: 2.048e-05 [replace_applicator]: 9.56998e-06 [py_interpret_to_execute_after_opt_a]: 2.559e-05 [rewriter_after_opt_a]: 5.264e-05 [convert_after_rewriter]: 9.42999e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00119729 [jit_opt_b]: 0.00016925, [1] [Cycle 1]: 0.00015207, [2] [frontend_op_eliminate]: 0.00010826 [inline_after_opt_a]: 2.532e-05 [cconv]: 4.37e-05 [loop_unroll]: 0.0008629 [jit_opt_after_cconv]: 0.00025258, [1] [Cycle 1]: 0.00024198, [11] [c_1]: 3.703e-05 [parameter_eliminate]: 6.59001e-06 [updatestate_depend_eliminate]: 1.144e-05 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.76999e-06 [cse]: 4.849e-05 [call_graph_tuple_transform]: 3.976e-05 [tuple_list_get_item_eliminator]: 8.38001e-06 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 8.40001e-06 [remove_dup_value]: 2.278e-05 [partial_unused_args_eliminate]: 5.07999e-06 [environ_conv]: 1.552e-05 [add_recomputation]: 7.218e-05 [cse_after_recomputation]: 3.538e-05, [1] [Cycle 1]: 2.712e-05, [1] [cse]: 1.496e-05 [auto_monad_reorder]: 1.896e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 1.111e-05 [opt_after_jit_grad]: 0.00078119 [symbol_engine_optimizer]: 0.00011808, [1] [Cycle 1]: 0.00010129, [6] [build]: 7.4e-06 [elim_shapecalc]: 1.108e-05 [elim_not_effective]: 2.628e-05 [opt_reshape]: 1.21e-05 [fold_const_symbol]: 9.70002e-06 [renormalize]: 4.80009e-07 [validate]: 0.00039038 Sums bootstrap : 0.000495s : 0.13% type_inference : 0.353486s : 93.22% event_method : 0.000031s : 0.01% auto_monad : 0.000187s : 0.05% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.001428s : 0.38% rewriter_before_opt_a : 0.000190s : 0.05% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000109s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001117s : 0.29% jit_opt_a.with_stream_mark : 0.000054s : 0.01% jit_opt_a.recompute_prepare : 0.000025s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000051s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000028s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000028s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.017697s : 4.67% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000042s : 0.01% jit_opt_a.cse : 0.000064s : 0.02% jit_opt_a.replace_applicator : 0.000043s : 0.01% py_interpret_to_execute_after_opt_a : 0.000026s : 0.01% rewriter_after_opt_a : 0.000053s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001197s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000108s : 0.03% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000044s : 0.01% loop_unroll : 0.000863s : 0.23% jit_opt_after_cconv.c_1 : 0.000037s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000040s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000016s : 0.00% add_recomputation : 0.000072s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000781s : 0.21% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000390s : 0.10% Time group info: ------[substitution.] 0.000375 24 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000002s : 2: substitution.fold_const_symbol 3.44% : 0.000013s : 4: substitution.graph_param_transform 84.54% : 0.000317s : 4: substitution.inline 1.84% : 0.000007s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000009s : 4: substitution.remove_not_recompute_node 2.46% : 0.000009s : 2: substitution.replace_old_param 4.24% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.353318 2 98.34% : 0.347449s : 1: type_inference.infer 1.66% : 0.005868s : 1: type_inference.specialize ------[replace.] 0.000126 6 61.57% : 0.000078s : 4: replace.inline 38.43% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000327 6 95.64% : 0.000313s : 4: match.inline 4.36% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000200 830 1.28% : 0.000003s : 12: predicate.accumulaten_eliminater 1.44% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000002s : 12: predicate.addn_check_dump 1.10% : 0.000002s : 12: predicate.addn_zero_filter 2.58% : 0.000005s : 12: predicate.arithmetic_simplify 1.27% : 0.000003s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 0.84% : 0.000002s : 12: predicate.compare_switch_simplify 1.66% : 0.000003s : 12: predicate.depend_value_elim 0.87% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.81% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.54% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 0.94% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.83% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_depend_swap 1.01% : 0.000002s : 12: predicate.environ_get_eliminate 0.80% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.41% : 0.000003s : 8: predicate.get_grad_eliminate 0.30% : 0.000001s : 4: predicate.graph_param_transform 4.73% : 0.000009s : 26: predicate.inline 1.01% : 0.000002s : 8: predicate.inline_without_move 0.33% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000003s : 8: predicate.less_batch_normalization 1.97% : 0.000004s : 14: predicate.list_to_tuple_eliminator_ 1.56% : 0.000003s : 18: predicate.load_eliminater 2.45% : 0.000005s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000007s : 36: predicate.loop_unroll_before_grad 2.21% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 12: predicate.merge_addn 0.94% : 0.000002s : 12: predicate.minmaximum_grad 2.29% : 0.000005s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 1.74% : 0.000003s : 18: predicate.partial_eliminate 0.93% : 0.000002s : 12: predicate.print_const_string_wrapper 2.45% : 0.000005s : 12: predicate.reduce_eliminate 1.28% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.82% : 0.000004s : 22: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.64% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000003s : 12: predicate.reshape_eliminate 1.33% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 1.14% : 0.000002s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.78% : 0.000002s : 8: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 8: predicate.special_op_eliminate 0.72% : 0.000001s : 8: predicate.specialize_transform 1.25% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.79% : 0.000006s : 18: predicate.switch_defer_inline 1.75% : 0.000004s : 18: predicate.switch_layer_defer_inline 7.47% : 0.000015s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.05% : 0.000002s : 12: predicate.transpose_eliminate 1.26% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 0.85% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 2.01% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.55% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000006s : 26: predicate.updatestate_useless_node_eliminater 1.94% : 0.000004s : 12: predicate.value_based_eliminate 0.26% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.10% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016308 22 85.17% : 0.013889s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.43% : 0.000070s : 1: func_graph_cloner_run.FuncGraphClonerNode 14.41% : 0.002349s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.405115 72 0.02% : 0.000077s : 1: add_recomputation 0.05% : 0.000192s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.13% : 0.000526s : 1: bootstrap 0.01% : 0.000047s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000038s : 1: cse_after_recomputation 0.00% : 0.000018s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000010s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 6.39% : 0.025870s : 1: jit_opt_a 0.06% : 0.000256s : 1: jit_opt_after_cconv 0.04% : 0.000173s : 1: jit_opt_b 0.22% : 0.000881s : 1: loop_unroll 0.30% : 0.001218s : 1: mutable_eliminate 0.36% : 0.001471s : 26: opt.transform.jit_opt_a 0.02% : 0.000088s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000122s : 4: opt.transform.jit_opt_b 0.01% : 0.000025s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000030s : 1: opt.transform.mutable_eliminate 0.01% : 0.000046s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000798s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.36% : 0.001441s : 1: py_interpret_to_execute 0.01% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000026s : 1: remove_dup_value 3.69% : 0.014944s : 1: renormalize.infer 0.67% : 0.002721s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000058s : 1: rewriter_after_opt_a 0.05% : 0.000204s : 1: rewriter_before_opt_a 0.03% : 0.000121s : 1: symbol_engine_optimizer 87.26% : 0.353517s : 1: type_inference TotalTime = 0.628935, [30] [bootstrap]: 0.00033805 [type_inference]: 0.535859 [event_method]: 3.03e-05 [auto_monad]: 9.099e-05 [graph_reusing]: 6.60002e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 0.00112609 [rewriter_before_opt_a]: 0.000122 [expand_dump_flag]: 4.52e-06 [jit_opt_a]: 0.0884788, [2] [Cycle 1]: 0.00837242, [27] [switch_simplify]: 8.241e-05 [loop_unroll]: 3.136e-05 [a_1]: 0.00073978 [with_stream_mark]: 2.727e-05 [recompute_prepare]: 9.37001e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 7.87003e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 7.95e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 7.55e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.662e-05 [j_node_and_user_rematch]: 1.242e-05 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 1.132e-05 [inline_without_move]: 7.09001e-06 [renormalize]: 0.00704044 [add_forward_monad_depend]: 1.301e-05 [auto_monad_grad]: 3.65998e-06 [auto_monad_eliminator]: 2.303e-05 [cse]: 4.372e-05 [replace_applicator]: 3.03e-05 [Cycle 2]: 0.00045851, [27] [switch_simplify]: 7.7e-06 [loop_unroll]: 8.05999e-06 [a_1]: 0.00015658 [with_stream_mark]: 2.042e-05 [recompute_prepare]: 7.01001e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.98998e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 4.99998e-06 [cell_reuse_recompute_pass]: 3.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.165e-05 [j_node_and_user_rematch]: 1.297e-05 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.087e-05 [inline_without_move]: 7.01001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.67001e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 7.35998e-06 [cse]: 1.751e-05 [replace_applicator]: 6.53e-06 [py_interpret_to_execute_after_opt_a]: 2.118e-05 [rewriter_after_opt_a]: 5.064e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.000965 [jit_opt_b]: 8.482e-05, [1] [Cycle 1]: 7.659e-05, [2] [frontend_op_eliminate]: 2.093e-05 [inline_after_opt_a]: 4.344e-05 [cconv]: 3.554e-05 [loop_unroll]: 0.00048137 [jit_opt_after_cconv]: 0.00017896, [1] [Cycle 1]: 0.00017206, [11] [c_1]: 2.896e-05 [parameter_eliminate]: 4.48999e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.032e-05 [call_graph_tuple_transform]: 2.598e-05 [tuple_list_get_item_eliminator]: 7.03e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.51e-06 [remove_dup_value]: 1.883e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 1.153e-05 [add_recomputation]: 5.58e-05 [cse_after_recomputation]: 2.779e-05, [1] [Cycle 1]: 2.038e-05, [1] [cse]: 1.488e-05 [auto_monad_reorder]: 1.882e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.0005126 [symbol_engine_optimizer]: 9.33e-05, [1] [Cycle 1]: 8.688e-05, [6] [build]: 4.68999e-06 [elim_shapecalc]: 1.012e-05 [elim_not_effective]: 1.826e-05 [opt_reshape]: 6.88e-06 [fold_const_symbol]: 1.289e-05 [renormalize]: 4.10015e-07 [validate]: 5.888e-05 Sums bootstrap : 0.000338s : 0.06% type_inference : 0.535859s : 97.68% event_method : 0.000030s : 0.01% auto_monad : 0.000091s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001126s : 0.21% rewriter_before_opt_a : 0.000122s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.02% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000896s : 0.16% jit_opt_a.with_stream_mark : 0.000048s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.00% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.007041s : 1.28% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000061s : 0.01% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.00% rewriter_after_opt_a : 0.000051s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000965s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000043s : 0.01% cconv : 0.000036s : 0.01% loop_unroll : 0.000481s : 0.09% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000056s : 0.01% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000513s : 0.09% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.01% Time group info: ------[substitution.] 0.000331 24 1.83% : 0.000006s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000007s : 4: substitution.graph_param_transform 85.58% : 0.000284s : 4: substitution.inline 1.84% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000007s : 4: substitution.remove_not_recompute_node 1.96% : 0.000006s : 2: substitution.replace_old_param 4.00% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.535699 2 91.25% : 0.488807s : 1: type_inference.infer 8.75% : 0.046892s : 1: type_inference.specialize ------[replace.] 0.000105 6 69.66% : 0.000073s : 4: replace.inline 30.34% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000293 6 95.88% : 0.000281s : 4: match.inline 4.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.71% : 0.000003s : 12: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 12: predicate.addn_check_dump 1.61% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000001s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.91% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_depend_swap 1.08% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.62% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 8: predicate.less_batch_normalization 1.73% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.30% : 0.000002s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.34% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.48% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.27% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000010s : 58: predicate.switch_simplify 1.15% : 0.000002s : 12: predicate.tile_eliminate 1.38% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003430 22 62.66% : 0.002149s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.47% : 0.001217s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.637283 72 0.01% : 0.000059s : 1: add_recomputation 0.01% : 0.000095s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.06% : 0.000359s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.00% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 13.88% : 0.088483s : 1: jit_opt_a 0.03% : 0.000181s : 1: jit_opt_after_cconv 0.01% : 0.000088s : 1: jit_opt_b 0.08% : 0.000490s : 1: loop_unroll 0.15% : 0.000977s : 1: mutable_eliminate 0.19% : 0.001197s : 26: opt.transform.jit_opt_a 0.01% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000057s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000052s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.001139s : 1: py_interpret_to_execute 0.00% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000023s : 1: remove_dup_value 0.90% : 0.005717s : 1: renormalize.infer 0.21% : 0.001309s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000054s : 1: rewriter_after_opt_a 0.02% : 0.000128s : 1: rewriter_before_opt_a 0.02% : 0.000096s : 1: symbol_engine_optimizer 84.09% : 0.535893s : 1: type_inference TotalTime = 0.0755923, [30] [bootstrap]: 0.00031071 [type_inference]: 0.0668101 [event_method]: 2.139e-05 [auto_monad]: 6.653e-05 [graph_reusing]: 5.73002e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00011716 [rewriter_before_opt_a]: 8.251e-05 [expand_dump_flag]: 2.95002e-06 [jit_opt_a]: 0.00597247, [2] [Cycle 1]: 0.0020844, [27] [switch_simplify]: 6.197e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00056372 [with_stream_mark]: 2.111e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.41998e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 4.889e-05 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.798e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 0.00102206 [add_forward_monad_depend]: 6.48998e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.455e-05 [cse]: 3.481e-05 [replace_applicator]: 1.203e-05 [Cycle 2]: 0.00032281, [27] [switch_simplify]: 6.10002e-06 [loop_unroll]: 5.00999e-06 [a_1]: 9.17e-05 [with_stream_mark]: 1.025e-05 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.09e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.91999e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.351e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 6.70002e-06 [inline_without_move]: 5.03002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.16997e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.235e-05 [replace_applicator]: 5.33002e-06 [py_interpret_to_execute_after_opt_a]: 1.136e-05 [rewriter_after_opt_a]: 3.698e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.84003e-06 [mutable_eliminate]: 0.00061935 [jit_opt_b]: 4.805e-05, [1] [Cycle 1]: 4.125e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.506e-05 [cconv]: 2.607e-05 [loop_unroll]: 0.00041763 [jit_opt_after_cconv]: 0.00014227, [1] [Cycle 1]: 0.00013604, [11] [c_1]: 2.073e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.81999e-06 [cse]: 2.27e-05 [call_graph_tuple_transform]: 1.835e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.32999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 6.51999e-06 [add_recomputation]: 4.879e-05 [cse_after_recomputation]: 2.254e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.199e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.00045806 [symbol_engine_optimizer]: 7.535e-05, [1] [Cycle 1]: 6.777e-05, [6] [build]: 3.21001e-06 [elim_shapecalc]: 7.75998e-06 [elim_not_effective]: 1.363e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 9.59e-06 [renormalize]: 3.00002e-07 [validate]: 3.912e-05 Sums bootstrap : 0.000311s : 0.43% type_inference : 0.066810s : 93.53% event_method : 0.000021s : 0.03% auto_monad : 0.000067s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000117s : 0.16% rewriter_before_opt_a : 0.000083s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000655s : 0.92% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000054s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001022s : 1.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000047s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000037s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000619s : 0.87% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.000418s : 0.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000458s : 0.64% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.05% Time group info: ------[substitution.] 0.000231 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.32% : 0.000005s : 3: substitution.graph_param_transform 85.05% : 0.000197s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.74% : 0.000006s : 4: substitution.remove_not_recompute_node 1.65% : 0.000004s : 2: substitution.replace_old_param 5.19% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066732 2 97.66% : 0.065170s : 1: type_inference.infer 2.34% : 0.001562s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.91% : 0.000051s : 4: replace.inline 32.09% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.69% : 0.000194s : 4: match.inline 5.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.56% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000002s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.22% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.17% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000866 13 46.44% : 0.000402s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.37% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.20% : 0.000418s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077572 72 0.07% : 0.000052s : 1: add_recomputation 0.09% : 0.000070s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.42% : 0.000329s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.70% : 0.005976s : 1: jit_opt_a 0.19% : 0.000145s : 1: jit_opt_after_cconv 0.07% : 0.000051s : 1: jit_opt_b 0.55% : 0.000425s : 1: loop_unroll 0.81% : 0.000628s : 1: mutable_eliminate 1.19% : 0.000923s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000120s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.76% : 0.000588s : 1: renormalize.infer 0.55% : 0.000425s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.11% : 0.000086s : 1: rewriter_before_opt_a 0.10% : 0.000078s : 1: symbol_engine_optimizer 86.15% : 0.066829s : 1: type_inference TotalTime = 0.178478, [30] [bootstrap]: 0.00041577 [type_inference]: 0.151774 [event_method]: 3.031e-05 [auto_monad]: 8.763e-05 [graph_reusing]: 7.33999e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.0005631 [rewriter_before_opt_a]: 0.00011913 [expand_dump_flag]: 4.36002e-06 [jit_opt_a]: 0.0223641, [2] [Cycle 1]: 0.0173152, [27] [switch_simplify]: 8.085e-05 [loop_unroll]: 3.72e-05 [a_1]: 0.00082134 [with_stream_mark]: 2.558e-05 [recompute_prepare]: 1.011e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 8.72e-06 [updatestate_useless_node_eliminater]: 6.57002e-06 [accelerated_algorithm]: 7.64002e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 4.52998e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.816e-05 [j_node_and_user_rematch]: 0.0121292 [meta_fg_expand]: 7.49002e-06 [replace_old_param]: 2.399e-05 [inline_without_move]: 1.009e-05 [renormalize]: 0.00369934 [add_forward_monad_depend]: 1.188e-05 [auto_monad_grad]: 1.498e-05 [auto_monad_eliminator]: 2.538e-05 [cse]: 4.252e-05 [replace_applicator]: 2.801e-05 [Cycle 2]: 0.00046989, [27] [switch_simplify]: 8.63001e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.0001478 [with_stream_mark]: 1.897e-05 [recompute_prepare]: 8.46997e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 6.91001e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 3.68999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.141e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 1.212e-05 [inline_without_move]: 6.86001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.92002e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 1.062e-05 [cse]: 2.153e-05 [replace_applicator]: 8.27e-06 [py_interpret_to_execute_after_opt_a]: 2.155e-05 [rewriter_after_opt_a]: 4.772e-05 [convert_after_rewriter]: 8.55001e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00092709 [jit_opt_b]: 7.412e-05, [1] [Cycle 1]: 6.459e-05, [2] [frontend_op_eliminate]: 2.44e-05 [inline_after_opt_a]: 2.496e-05 [cconv]: 3.642e-05 [loop_unroll]: 0.00058819 [jit_opt_after_cconv]: 0.00020507, [1] [Cycle 1]: 0.00019754, [11] [c_1]: 3.177e-05 [parameter_eliminate]: 5.37999e-06 [updatestate_depend_eliminate]: 1.041e-05 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.96001e-06 [cse]: 3.908e-05 [call_graph_tuple_transform]: 2.905e-05 [tuple_list_get_item_eliminator]: 7.33e-06 [none_parameter_eliminate]: 2.12001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 7.26001e-06 [remove_dup_value]: 2.051e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.246e-05 [add_recomputation]: 6.519e-05 [cse_after_recomputation]: 3.512e-05, [1] [Cycle 1]: 2.714e-05, [1] [cse]: 1.795e-05 [auto_monad_reorder]: 1.828e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 9.44e-06 [opt_after_jit_grad]: 0.00064595 [symbol_engine_optimizer]: 9.52e-05, [1] [Cycle 1]: 8.848e-05, [6] [build]: 6.19001e-06 [elim_shapecalc]: 1.02e-05 [elim_not_effective]: 2.055e-05 [opt_reshape]: 7.54002e-06 [fold_const_symbol]: 1.135e-05 [renormalize]: 7.80012e-07 [validate]: 6.315e-05 Sums bootstrap : 0.000416s : 0.24% type_inference : 0.151774s : 87.67% event_method : 0.000030s : 0.02% auto_monad : 0.000088s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000563s : 0.33% rewriter_before_opt_a : 0.000119s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000089s : 0.05% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.000969s : 0.56% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.012140s : 7.01% jit_opt_a.meta_fg_expand : 0.000011s : 0.01% jit_opt_a.replace_old_param : 0.000036s : 0.02% jit_opt_a.inline_without_move : 0.000017s : 0.01% jit_opt_a.renormalize : 0.003699s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000016s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.02% jit_opt_a.cse : 0.000064s : 0.04% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000927s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000036s : 0.02% loop_unroll : 0.000588s : 0.34% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000065s : 0.04% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000646s : 0.37% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.04% Time group info: ------[substitution.] 0.000345 25 1.31% : 0.000005s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000007s : 4: substitution.graph_param_transform 84.55% : 0.000292s : 5: substitution.inline 3.71% : 0.000013s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000008s : 2: substitution.replace_old_param 3.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151632 2 97.40% : 0.147690s : 1: type_inference.infer 2.60% : 0.003943s : 1: type_inference.specialize ------[replace.] 0.000126 7 68.16% : 0.000086s : 5: replace.inline 31.84% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000300 7 95.97% : 0.000288s : 5: match.inline 4.03% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 888 1.10% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.28% : 0.000004s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 2.04% : 0.000004s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.72% : 0.000003s : 13: predicate.environ_add_const_eliminate 0.89% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.74% : 0.000010s : 28: predicate.inline 1.89% : 0.000003s : 8: predicate.inline_without_move 0.67% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.43% : 0.000002s : 19: predicate.load_eliminater 1.83% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.87% : 0.000002s : 13: predicate.merge_addn 0.92% : 0.000002s : 13: predicate.minmaximum_grad 2.05% : 0.000004s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 1.96% : 0.000003s : 19: predicate.partial_eliminate 1.06% : 0.000002s : 13: predicate.print_const_string_wrapper 1.57% : 0.000003s : 13: predicate.reduce_eliminate 1.31% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.80% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.14% : 0.000002s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.98% : 0.000002s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.51% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000002s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000004s : 20: predicate.switch_defer_inline 1.87% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.99% : 0.000012s : 65: predicate.switch_simplify 1.56% : 0.000003s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.18% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.91% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.34% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003868 29 65.60% : 0.002537s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.95% : 0.001236s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.195664 72 0.03% : 0.000068s : 1: add_recomputation 0.05% : 0.000091s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000433s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000037s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 11.43% : 0.022369s : 1: jit_opt_a 0.11% : 0.000208s : 1: jit_opt_after_cconv 0.04% : 0.000077s : 1: jit_opt_b 0.31% : 0.000597s : 1: loop_unroll 0.48% : 0.000937s : 1: mutable_eliminate 6.85% : 0.013403s : 26: opt.transform.jit_opt_a 0.04% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.02% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000656s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000573s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 1.27% : 0.002476s : 1: renormalize.infer 0.62% : 0.001204s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.06% : 0.000125s : 1: rewriter_before_opt_a 0.05% : 0.000098s : 1: symbol_engine_optimizer 77.58% : 0.151794s : 1: type_inference TotalTime = 0.0675154, [30] [bootstrap]: 0.0003564 [type_inference]: 0.00586373 [event_method]: 2.191e-05 [auto_monad]: 6.716e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 4.366e-05 [rewriter_before_opt_a]: 7.669e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.0586368, [2] [Cycle 1]: 0.0542554, [27] [switch_simplify]: 7.165e-05 [loop_unroll]: 3.031e-05 [a_1]: 0.052844 [with_stream_mark]: 3.004e-05 [recompute_prepare]: 1.268e-05 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.83e-06 [specialize_transform]: 6.54999e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 3.76999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 1.038e-05 [meta_fg_expand]: 3.35e-06 [replace_old_param]: 1.168e-05 [inline_without_move]: 5.48997e-06 [renormalize]: 0.00085859 [add_forward_monad_depend]: 6.57002e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.701e-05 [cse]: 3.578e-05 [replace_applicator]: 1.41e-05 [Cycle 2]: 0.0003312, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.84e-06 [a_1]: 9.272e-05 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 5.42999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.54002e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 5.02e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.40024e-07 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.328e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.589e-05 [rewriter_after_opt_a]: 4.044e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00080175 [jit_opt_b]: 5.41e-05, [1] [Cycle 1]: 4.477e-05, [2] [frontend_op_eliminate]: 1.721e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.933e-05 [loop_unroll]: 0.00042573 [jit_opt_after_cconv]: 0.00015824, [1] [Cycle 1]: 0.0001517, [11] [c_1]: 2.154e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 1.499e-05 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.49e-05 [call_graph_tuple_transform]: 1.861e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.99999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 1.626e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.19001e-06 [add_recomputation]: 5.37e-05 [cse_after_recomputation]: 2.333e-05, [1] [Cycle 1]: 1.776e-05, [1] [cse]: 1.203e-05 [auto_monad_reorder]: 1.685e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 4.3e-06 [opt_after_jit_grad]: 0.00047302 [symbol_engine_optimizer]: 7.275e-05, [1] [Cycle 1]: 6.601e-05, [6] [build]: 4.00998e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.235e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 3.59985e-07 [validate]: 4.304e-05 Sums bootstrap : 0.000356s : 0.57% type_inference : 0.005864s : 9.34% event_method : 0.000022s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000044s : 0.07% rewriter_before_opt_a : 0.000077s : 0.12% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.052937s : 84.28% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000859s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000049s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000802s : 1.28% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000426s : 0.68% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000473s : 0.75% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.052359 23 0.00% : 0.000002s : 2: substitution.elim_not_effective 0.00% : 0.000001s : 2: substitution.fold_const_symbol 0.01% : 0.000005s : 3: substitution.graph_param_transform 99.92% : 0.052318s : 4: substitution.inline 0.01% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.01% : 0.000006s : 4: substitution.remove_not_recompute_node 0.01% : 0.000007s : 2: substitution.replace_old_param 0.03% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005779 2 83.12% : 0.004804s : 1: type_inference.infer 16.88% : 0.000975s : 1: type_inference.specialize ------[replace.] 0.000147 6 70.33% : 0.000103s : 4: replace.inline 29.67% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.052327 6 99.97% : 0.052313s : 4: match.inline 0.03% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 691 1.67% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.85% : 0.000001s : 10: predicate.addn_check_dump 1.82% : 0.000003s : 10: predicate.addn_zero_filter 2.92% : 0.000004s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.34% : 0.000000s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.59% : 0.000002s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.54% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.31% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.92% : 0.000010s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.74% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 15: predicate.load_eliminater 1.06% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.63% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 1.94% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000003s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.42% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 3: predicate.row_tensor_eliminate 1.08% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.50% : 0.000005s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.89% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000002s : 10: predicate.transpose_eliminate 1.23% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.15% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.052904 13 0.89% : 0.000473s : 6: func_graph_cloner_run.FuncGraphClonerGraph 98.53% : 0.052123s : 1: func_graph_cloner_run.FuncGraphClonerNode 0.58% : 0.000307s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121599 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.31% : 0.000380s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 48.22% : 0.058640s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.36% : 0.000434s : 1: loop_unroll 0.67% : 0.000811s : 1: mutable_eliminate 43.73% : 0.053178s : 26: opt.transform.jit_opt_a 0.04% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.04% : 0.000046s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.39% : 0.000471s : 1: renormalize.infer 0.31% : 0.000379s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 4.84% : 0.005884s : 1: type_inference TotalTime = 0.0222451, [30] [bootstrap]: 0.00041861 [type_inference]: 0.0122771 [event_method]: 2.349e-05 [auto_monad]: 7.494e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 6.079e-05 [rewriter_before_opt_a]: 8.88e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00676971, [2] [Cycle 1]: 0.00234478, [27] [switch_simplify]: 6.896e-05 [loop_unroll]: 3.409e-05 [a_1]: 0.00073677 [with_stream_mark]: 2.564e-05 [recompute_prepare]: 9.91e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 6.27001e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 6.26998e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.36998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.628e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00109065 [add_forward_monad_depend]: 7.87e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 4.235e-05 [replace_applicator]: 1.871e-05 [Cycle 2]: 0.00036696, [27] [switch_simplify]: 7.44002e-06 [loop_unroll]: 5.97001e-06 [a_1]: 0.00010236 [with_stream_mark]: 1.361e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 2.63998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.616e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.46e-05 [replace_applicator]: 6.64001e-06 [py_interpret_to_execute_after_opt_a]: 1.561e-05 [rewriter_after_opt_a]: 4.308e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00072908 [jit_opt_b]: 5.638e-05, [1] [Cycle 1]: 4.844e-05, [2] [frontend_op_eliminate]: 1.808e-05 [inline_after_opt_a]: 1.715e-05 [cconv]: 3.134e-05 [loop_unroll]: 0.00045538 [jit_opt_after_cconv]: 0.00016984, [1] [Cycle 1]: 0.00016304, [11] [c_1]: 2.245e-05 [parameter_eliminate]: 4.21001e-06 [updatestate_depend_eliminate]: 1.066e-05 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.327e-05 [call_graph_tuple_transform]: 2.272e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 4.309e-05 [partial_unused_args_eliminate]: 3.76001e-06 [environ_conv]: 6.31998e-06 [add_recomputation]: 5.564e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.933e-05, [1] [cse]: 1.296e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.57001e-06 [rewriter_after_jit_bprop_graph]: 5.44e-06 [opt_after_jit_grad]: 0.00053206 [symbol_engine_optimizer]: 8.398e-05, [1] [Cycle 1]: 7.746e-05, [6] [build]: 4.21001e-06 [elim_shapecalc]: 9.61998e-06 [elim_not_effective]: 1.576e-05 [opt_reshape]: 7.66001e-06 [fold_const_symbol]: 9.74999e-06 [renormalize]: 3.89991e-07 [validate]: 4.728e-05 Sums bootstrap : 0.000419s : 2.38% type_inference : 0.012277s : 69.91% event_method : 0.000023s : 0.13% auto_monad : 0.000075s : 0.43% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000061s : 0.35% rewriter_before_opt_a : 0.000089s : 0.51% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.44% jit_opt_a.loop_unroll : 0.000040s : 0.23% jit_opt_a.a_1 : 0.000839s : 4.78% jit_opt_a.with_stream_mark : 0.000039s : 0.22% jit_opt_a.recompute_prepare : 0.000016s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001091s : 6.21% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.14% jit_opt_a.cse : 0.000057s : 0.32% jit_opt_a.replace_applicator : 0.000025s : 0.14% py_interpret_to_execute_after_opt_a : 0.000016s : 0.09% rewriter_after_opt_a : 0.000043s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000729s : 4.15% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000031s : 0.18% loop_unroll : 0.000455s : 2.59% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000043s : 0.25% partial_unused_args_eliminate : 0.000004s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000056s : 0.32% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000532s : 3.03% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.27% Time group info: ------[substitution.] 0.000317 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 1.78% : 0.000006s : 3: substitution.graph_param_transform 88.35% : 0.000280s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.56% : 0.000005s : 4: substitution.remove_not_recompute_node 1.31% : 0.000004s : 2: substitution.replace_old_param 4.51% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012181 2 88.64% : 0.010797s : 1: type_inference.infer 11.36% : 0.001383s : 1: type_inference.specialize ------[replace.] 0.000109 7 67.58% : 0.000073s : 5: replace.inline 32.42% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 7 95.54% : 0.000276s : 5: match.inline 4.46% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 747 1.12% : 0.000002s : 11: predicate.accumulaten_eliminater 1.15% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 11: predicate.addn_check_dump 1.20% : 0.000002s : 11: predicate.addn_zero_filter 1.85% : 0.000003s : 11: predicate.arithmetic_simplify 1.18% : 0.000002s : 11: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 11: predicate.environ_get_depend_swap 1.46% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.62% : 0.000001s : 3: predicate.graph_param_transform 5.76% : 0.000008s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 16: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.69% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 11: predicate.merge_addn 1.01% : 0.000001s : 11: predicate.minmaximum_grad 2.52% : 0.000004s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.03% : 0.000001s : 11: predicate.print_const_string_wrapper 1.76% : 0.000002s : 11: predicate.reduce_eliminate 1.55% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.49% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.35% : 0.000012s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001129 16 49.62% : 0.000560s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.43% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.95% : 0.000474s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024488 72 0.24% : 0.000059s : 1: add_recomputation 0.32% : 0.000079s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.78% : 0.000437s : 1: bootstrap 0.14% : 0.000034s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.12% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 27.66% : 0.006774s : 1: jit_opt_a 0.71% : 0.000173s : 1: jit_opt_after_cconv 0.24% : 0.000059s : 1: jit_opt_b 1.89% : 0.000462s : 1: loop_unroll 3.01% : 0.000737s : 1: mutable_eliminate 4.47% : 0.001094s : 26: opt.transform.jit_opt_a 0.22% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000018s : 1: opt.transform.mutable_eliminate 0.10% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.20% : 0.000540s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000064s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000046s : 1: remove_dup_value 2.54% : 0.000621s : 1: renormalize.infer 1.87% : 0.000459s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000046s : 1: rewriter_after_opt_a 0.38% : 0.000092s : 1: rewriter_before_opt_a 0.35% : 0.000087s : 1: symbol_engine_optimizer 50.20% : 0.012293s : 1: type_inference TotalTime = 0.401137, [30] [bootstrap]: 0.00038173 [type_inference]: 0.372466 [event_method]: 4.499e-05 [auto_monad]: 9.147e-05 [graph_reusing]: 7.33999e-06 [pre_auto_parallel]: 3.55e-06 [py_interpret_to_execute]: 0.00054582 [rewriter_before_opt_a]: 0.00011621 [expand_dump_flag]: 4.38001e-06 [jit_opt_a]: 0.0103743, [2] [Cycle 1]: 0.00518926, [27] [switch_simplify]: 7.612e-05 [loop_unroll]: 3.09e-05 [a_1]: 0.00073832 [with_stream_mark]: 2.677e-05 [recompute_prepare]: 1.066e-05 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.49001e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 8.28999e-06 [updatestate_useless_node_eliminater]: 7.61999e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 3.62998e-06 [get_grad_eliminate_]: 8.15e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.794e-05 [j_node_and_user_rematch]: 1.181e-05 [meta_fg_expand]: 3.04001e-06 [replace_old_param]: 1.194e-05 [inline_without_move]: 8.16002e-06 [renormalize]: 0.0038427 [add_forward_monad_depend]: 1.063e-05 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.56e-05 [cse]: 4.746e-05 [replace_applicator]: 3.311e-05 [Cycle 2]: 0.00044809, [27] [switch_simplify]: 9.54e-06 [loop_unroll]: 6.24999e-06 [a_1]: 0.0001412 [with_stream_mark]: 1.828e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 4.74998e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 7.06999e-06 [accelerated_algorithm]: 7.33e-06 [meta_shard_fg_expand]: 3.22997e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 3.25998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.244e-05 [j_node_and_user_rematch]: 1.213e-05 [meta_fg_expand]: 2.71999e-06 [replace_old_param]: 1.177e-05 [inline_without_move]: 6.26998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.73997e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 6.93e-06 [cse]: 1.938e-05 [replace_applicator]: 7.06001e-06 [py_interpret_to_execute_after_opt_a]: 2.125e-05 [rewriter_after_opt_a]: 4.939e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.0139326 [jit_opt_b]: 9.887e-05, [1] [Cycle 1]: 8.566e-05, [2] [frontend_op_eliminate]: 3.18e-05 [inline_after_opt_a]: 2.718e-05 [cconv]: 5.853e-05 [loop_unroll]: 0.00073358 [jit_opt_after_cconv]: 0.00027505, [1] [Cycle 1]: 0.00026466, [11] [c_1]: 3.774e-05 [parameter_eliminate]: 7.53999e-06 [updatestate_depend_eliminate]: 1.473e-05 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.19001e-06 [cse]: 6.699e-05 [call_graph_tuple_transform]: 3.86e-05 [tuple_list_get_item_eliminator]: 9.56e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 1.49e-06 [switch_simplify]: 8.88002e-06 [remove_dup_value]: 2.89e-05 [partial_unused_args_eliminate]: 2.95002e-06 [environ_conv]: 1.573e-05 [add_recomputation]: 6.654e-05 [cse_after_recomputation]: 3.962e-05, [1] [Cycle 1]: 3.264e-05, [1] [cse]: 1.836e-05 [auto_monad_reorder]: 2.045e-05 [get_jit_bprop_graph]: 1.687e-05 [rewriter_after_jit_bprop_graph]: 1.31e-05 [opt_after_jit_grad]: 0.0007506 [symbol_engine_optimizer]: 0.00057734, [1] [Cycle 1]: 0.00056639, [6] [build]: 9.52001e-06 [elim_shapecalc]: 1.583e-05 [elim_not_effective]: 0.00046906 [opt_reshape]: 1.173e-05 [fold_const_symbol]: 1.416e-05 [renormalize]: 1.02e-06 [validate]: 7.946e-05 Sums bootstrap : 0.000382s : 0.10% type_inference : 0.372466s : 94.17% event_method : 0.000045s : 0.01% auto_monad : 0.000091s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000546s : 0.14% rewriter_before_opt_a : 0.000116s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000880s : 0.22% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.003843s : 0.97% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000067s : 0.02% jit_opt_a.replace_applicator : 0.000040s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000049s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.013933s : 3.52% jit_opt_b.frontend_op_eliminate : 0.000032s : 0.01% jit_opt_b.inline_after_opt_a : 0.000027s : 0.01% cconv : 0.000059s : 0.01% loop_unroll : 0.000734s : 0.19% jit_opt_after_cconv.c_1 : 0.000038s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000067s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000039s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000029s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000016s : 0.00% add_recomputation : 0.000067s : 0.02% cse_after_recomputation.cse : 0.000018s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000017s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.00% opt_after_jit_grad : 0.000751s : 0.19% symbol_engine_optimizer.build : 0.000010s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000016s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000469s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000079s : 0.02% Time group info: ------[substitution.] 0.000754 24 58.66% : 0.000443s : 2: substitution.elim_not_effective 0.23% : 0.000002s : 2: substitution.fold_const_symbol 1.15% : 0.000009s : 4: substitution.graph_param_transform 35.44% : 0.000267s : 4: substitution.inline 0.78% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.76% : 0.000006s : 4: substitution.remove_not_recompute_node 1.03% : 0.000008s : 2: substitution.replace_old_param 1.97% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.372316 2 98.93% : 0.368348s : 1: type_inference.infer 1.07% : 0.003969s : 1: type_inference.specialize ------[replace.] 0.000108 6 69.22% : 0.000075s : 4: replace.inline 30.78% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 6 95.23% : 0.000265s : 4: match.inline 4.77% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.48% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.89% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.07% : 0.000002s : 12: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 0.92% : 0.000001s : 12: predicate.compare_switch_simplify 0.94% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.88% : 0.000001s : 12: predicate.dict_get_item_eliminator 0.96% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.89% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.58% : 0.000003s : 12: predicate.environ_get_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.74% : 0.000009s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.30% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 18: predicate.load_eliminater 1.76% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.27% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.41% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 0.87% : 0.000001s : 12: predicate.minmaximum_grad 4.81% : 0.000008s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 0.96% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.17% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.71% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 12: predicate.reshape_eliminate 0.99% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.51% : 0.000002s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.89% : 0.000003s : 18: predicate.switch_defer_inline 1.84% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000011s : 58: predicate.switch_simplify 1.47% : 0.000002s : 12: predicate.tile_eliminate 1.08% : 0.000002s : 12: predicate.transpose_eliminate 1.12% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.22% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.17% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.17% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003933 26 72.42% : 0.002848s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.64% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.95% : 0.001020s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.406745 72 0.02% : 0.000070s : 1: add_recomputation 0.02% : 0.000097s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.10% : 0.000407s : 1: bootstrap 0.02% : 0.000062s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000042s : 1: cse_after_recomputation 0.00% : 0.000018s : 1: environ_conv 0.01% : 0.000052s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000019s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 2.55% : 0.010380s : 1: jit_opt_a 0.07% : 0.000279s : 1: jit_opt_after_cconv 0.03% : 0.000103s : 1: jit_opt_b 0.18% : 0.000748s : 1: loop_unroll 3.43% : 0.013969s : 1: mutable_eliminate 0.29% : 0.001183s : 26: opt.transform.jit_opt_a 0.02% : 0.000090s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000049s : 4: opt.transform.jit_opt_b 0.01% : 0.000027s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000056s : 1: opt.transform.mutable_eliminate 0.01% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000506s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000767s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000556s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000032s : 1: remove_dup_value 0.67% : 0.002711s : 1: renormalize.infer 0.27% : 0.001116s : 1: renormalize.specialize 0.00% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000052s : 1: rewriter_after_opt_a 0.03% : 0.000126s : 1: rewriter_before_opt_a 0.14% : 0.000582s : 1: symbol_engine_optimizer 91.58% : 0.372496s : 1: type_inference TotalTime = 0.500429, [30] [bootstrap]: 0.00053131 [type_inference]: 0.445119 [event_method]: 2.889e-05 [auto_monad]: 9.026e-05 [graph_reusing]: 6.18002e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00130217 [rewriter_before_opt_a]: 0.0001206 [expand_dump_flag]: 5.36998e-06 [jit_opt_a]: 0.049264, [2] [Cycle 1]: 0.0434468, [27] [switch_simplify]: 8.406e-05 [loop_unroll]: 3.398e-05 [a_1]: 0.00087701 [with_stream_mark]: 3.5e-05 [recompute_prepare]: 1.508e-05 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 3.70998e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 2.89999e-06 [specialize_transform]: 1.104e-05 [updatestate_useless_node_eliminater]: 7.94002e-06 [accelerated_algorithm]: 9.39e-06 [meta_shard_fg_expand]: 4.33999e-06 [get_grad_eliminate_]: 8.92999e-06 [merge_forward]: 4.54002e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.375e-05 [j_node_and_user_rematch]: 1.378e-05 [meta_fg_expand]: 3.76001e-06 [replace_old_param]: 1.376e-05 [inline_without_move]: 8.45001e-06 [renormalize]: 0.0418921 [add_forward_monad_depend]: 1.298e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 2.67e-05 [cse]: 3.888e-05 [replace_applicator]: 3.032e-05 [Cycle 2]: 0.00053128, [27] [switch_simplify]: 8.67e-06 [loop_unroll]: 7.56999e-06 [a_1]: 0.00016283 [with_stream_mark]: 4.453e-05 [recompute_prepare]: 8.63001e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 2.81999e-06 [specialize_transform]: 8.51002e-06 [updatestate_useless_node_eliminater]: 7.3e-06 [accelerated_algorithm]: 7.31999e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 5.62999e-06 [cell_reuse_recompute_pass]: 4.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.359e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 1.342e-05 [inline_without_move]: 7.63001e-06 [renormalize]: 2.9002e-07 [add_forward_monad_depend]: 2.99999e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 1.273e-05 [cse]: 2.266e-05 [replace_applicator]: 8.44998e-06 [py_interpret_to_execute_after_opt_a]: 2.139e-05 [rewriter_after_opt_a]: 4.719e-05 [convert_after_rewriter]: 8.55999e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00116102 [jit_opt_b]: 8.849e-05, [1] [Cycle 1]: 7.44e-05, [2] [frontend_op_eliminate]: 3.31e-05 [inline_after_opt_a]: 2.559e-05 [cconv]: 4.058e-05 [loop_unroll]: 0.0006998 [jit_opt_after_cconv]: 0.00021026, [1] [Cycle 1]: 0.00020149, [11] [c_1]: 3.134e-05 [parameter_eliminate]: 6.26998e-06 [updatestate_depend_eliminate]: 1.019e-05 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 4.355e-05 [call_graph_tuple_transform]: 2.963e-05 [tuple_list_get_item_eliminator]: 7.33999e-06 [none_parameter_eliminate]: 2.09e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 7.21999e-06 [remove_dup_value]: 1.741e-05 [partial_unused_args_eliminate]: 3.6e-06 [environ_conv]: 1.269e-05 [add_recomputation]: 5.894e-05 [cse_after_recomputation]: 3.029e-05, [1] [Cycle 1]: 2.359e-05, [1] [cse]: 1.566e-05 [auto_monad_reorder]: 1.824e-05 [get_jit_bprop_graph]: 2.89999e-06 [rewriter_after_jit_bprop_graph]: 1.145e-05 [opt_after_jit_grad]: 0.00073578 [symbol_engine_optimizer]: 0.00041692, [1] [Cycle 1]: 0.0004064, [6] [build]: 6.26e-06 [elim_shapecalc]: 9.84999e-06 [elim_not_effective]: 1.853e-05 [opt_reshape]: 9.72999e-06 [fold_const_symbol]: 0.00032012 [renormalize]: 8.09989e-07 [validate]: 8.039e-05 Sums bootstrap : 0.000531s : 0.11% type_inference : 0.445119s : 90.05% event_method : 0.000029s : 0.01% auto_monad : 0.000090s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001302s : 0.26% rewriter_before_opt_a : 0.000121s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001040s : 0.21% jit_opt_a.with_stream_mark : 0.000080s : 0.02% jit_opt_a.recompute_prepare : 0.000024s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000020s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000017s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000047s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000027s : 0.01% jit_opt_a.inline_without_move : 0.000016s : 0.00% jit_opt_a.renormalize : 0.041892s : 8.48% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.01% jit_opt_a.cse : 0.000062s : 0.01% jit_opt_a.replace_applicator : 0.000039s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.00% rewriter_after_opt_a : 0.000047s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001161s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000033s : 0.01% jit_opt_b.inline_after_opt_a : 0.000026s : 0.01% cconv : 0.000041s : 0.01% loop_unroll : 0.000700s : 0.14% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000059s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000736s : 0.15% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000320s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000080s : 0.02% Time group info: ------[substitution.] 0.000664 24 0.35% : 0.000002s : 2: substitution.elim_not_effective 46.17% : 0.000307s : 2: substitution.fold_const_symbol 1.32% : 0.000009s : 4: substitution.graph_param_transform 46.06% : 0.000306s : 4: substitution.inline 0.89% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.19% : 0.000008s : 4: substitution.remove_not_recompute_node 1.29% : 0.000009s : 2: substitution.replace_old_param 2.74% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.444978 2 94.64% : 0.421120s : 1: type_inference.infer 5.36% : 0.023859s : 1: type_inference.specialize ------[replace.] 0.000159 6 65.13% : 0.000104s : 4: replace.inline 34.87% : 0.000055s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000319 6 94.80% : 0.000302s : 4: match.inline 5.20% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000187 830 1.08% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.76% : 0.000003s : 12: predicate.addn_check_dump 2.19% : 0.000004s : 12: predicate.addn_zero_filter 2.79% : 0.000005s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 0.87% : 0.000002s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 0.79% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.80% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.42% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.86% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 0.91% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000001s : 4: predicate.graph_param_transform 4.70% : 0.000009s : 26: predicate.inline 0.96% : 0.000002s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.92% : 0.000004s : 8: predicate.less_batch_normalization 1.76% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.30% : 0.000004s : 18: predicate.load_eliminater 2.27% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.33% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.49% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.32% : 0.000002s : 12: predicate.merge_addn 0.86% : 0.000002s : 12: predicate.minmaximum_grad 2.34% : 0.000004s : 4: predicate.mutable_eliminate 0.33% : 0.000001s : 4: predicate.opt_reshape 1.81% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000003s : 12: predicate.reduce_eliminate 1.93% : 0.000004s : 14: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000002s : 8: predicate.remove_not_recompute_node 2.11% : 0.000004s : 22: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.26% : 0.000000s : 4: predicate.reset_defer_inline 1.60% : 0.000003s : 12: predicate.reshape_eliminate 1.53% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 1.13% : 0.000002s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.67% : 0.000003s : 8: predicate.special_op_eliminate 1.20% : 0.000002s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000005s : 18: predicate.switch_defer_inline 1.41% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.83% : 0.000013s : 58: predicate.switch_simplify 1.07% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.14% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.27% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.51% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000003s : 12: predicate.value_based_eliminate 0.27% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.99% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003819 22 59.29% : 0.002264s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000070s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.87% : 0.001484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.544063 72 0.01% : 0.000062s : 1: add_recomputation 0.02% : 0.000095s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.10% : 0.000563s : 1: bootstrap 0.01% : 0.000044s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000033s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 9.06% : 0.049269s : 1: jit_opt_a 0.04% : 0.000214s : 1: jit_opt_after_cconv 0.02% : 0.000092s : 1: jit_opt_b 0.13% : 0.000714s : 1: loop_unroll 0.22% : 0.001180s : 1: mutable_eliminate 0.25% : 0.001370s : 26: opt.transform.jit_opt_a 0.01% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000048s : 4: opt.transform.jit_opt_b 0.00% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000351s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000749s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.001316s : 1: py_interpret_to_execute 0.00% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 7.41% : 0.040298s : 1: renormalize.infer 0.29% : 0.001574s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000052s : 1: rewriter_after_opt_a 0.02% : 0.000128s : 1: rewriter_before_opt_a 0.08% : 0.000422s : 1: symbol_engine_optimizer 81.82% : 0.445145s : 1: type_inference TotalTime = 0.104795, [30] [bootstrap]: 0.00035076 [type_inference]: 0.0344016 [event_method]: 2.361e-05 [auto_monad]: 0.0601561 [graph_reusing]: 8.95999e-06 [pre_auto_parallel]: 4.44002e-06 [py_interpret_to_execute]: 0.00023746 [rewriter_before_opt_a]: 0.00011851 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00667269, [2] [Cycle 1]: 0.0023209, [27] [switch_simplify]: 6.781e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00062398 [with_stream_mark]: 2.878e-05 [recompute_prepare]: 9.54999e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.681e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 5.76003e-06 [renormalize]: 0.00117428 [add_forward_monad_depend]: 9.49999e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.93e-05 [cse]: 4.16e-05 [replace_applicator]: 1.717e-05 [Cycle 2]: 0.00033844, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 5.64e-06 [a_1]: 8.897e-05 [with_stream_mark]: 1.309e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 5.67999e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.64e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 1.06997e-06 [auto_monad_eliminator]: 6.15002e-06 [cse]: 1.373e-05 [replace_applicator]: 4.87998e-06 [py_interpret_to_execute_after_opt_a]: 1.714e-05 [rewriter_after_opt_a]: 4.001e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00083422 [jit_opt_b]: 5.647e-05, [1] [Cycle 1]: 4.731e-05, [2] [frontend_op_eliminate]: 1.765e-05 [inline_after_opt_a]: 1.767e-05 [cconv]: 3.442e-05 [loop_unroll]: 0.00054599 [jit_opt_after_cconv]: 0.0001969, [1] [Cycle 1]: 0.00016553, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 5.62001e-06 [updatestate_depend_eliminate]: 9.79999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.33998e-06 [cse]: 3.736e-05 [call_graph_tuple_transform]: 2.41e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.959e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 7.06001e-06 [add_recomputation]: 6.117e-05 [cse_after_recomputation]: 2.672e-05, [1] [Cycle 1]: 2.023e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.888e-05 [get_jit_bprop_graph]: 2.73e-06 [rewriter_after_jit_bprop_graph]: 8.55999e-06 [opt_after_jit_grad]: 0.00052828 [symbol_engine_optimizer]: 8.092e-05, [1] [Cycle 1]: 7.313e-05, [6] [build]: 5.44998e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.502e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 1.002e-05 [renormalize]: 3.19997e-07 [validate]: 5.21e-05 Sums bootstrap : 0.000351s : 0.35% type_inference : 0.034402s : 34.39% event_method : 0.000024s : 0.02% auto_monad : 0.060156s : 60.13% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000237s : 0.24% rewriter_before_opt_a : 0.000119s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.07% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000713s : 0.71% jit_opt_a.with_stream_mark : 0.000042s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001174s : 1.17% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000055s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000834s : 0.83% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000546s : 0.55% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000061s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000528s : 0.53% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.05% Time group info: ------[substitution.] 0.000278 23 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 3: substitution.graph_param_transform 85.85% : 0.000239s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000006s : 4: substitution.remove_not_recompute_node 2.48% : 0.000007s : 2: substitution.replace_old_param 4.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034311 2 95.05% : 0.032613s : 1: type_inference.infer 4.95% : 0.001698s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.82% : 0.000056s : 4: replace.inline 31.18% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 6 95.29% : 0.000236s : 4: match.inline 4.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 2.12% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.38% : 0.000008s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.27% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.69% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.31% : 0.000003s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.97% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.73% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.28% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.42% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.10% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001029 13 49.06% : 0.000505s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.74% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.20% : 0.000465s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.106966 72 0.06% : 0.000064s : 1: add_recomputation 56.27% : 0.060193s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.35% : 0.000373s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000016s : 1: graph_reusing 6.24% : 0.006677s : 1: jit_opt_a 0.19% : 0.000200s : 1: jit_opt_after_cconv 0.06% : 0.000059s : 1: jit_opt_b 0.52% : 0.000557s : 1: loop_unroll 0.79% : 0.000848s : 1: mutable_eliminate 0.89% : 0.000954s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000539s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.23% : 0.000244s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 0.64% : 0.000682s : 1: renormalize.infer 0.45% : 0.000483s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.12% : 0.000125s : 1: rewriter_before_opt_a 0.08% : 0.000083s : 1: symbol_engine_optimizer 32.19% : 0.034430s : 1: type_inference TotalTime = 0.101677, [30] [bootstrap]: 0.00037679 [type_inference]: 0.0594539 [event_method]: 2.267e-05 [auto_monad]: 6.943e-05 [graph_reusing]: 6.26998e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00011237 [rewriter_before_opt_a]: 8.718e-05 [expand_dump_flag]: 2.91999e-06 [jit_opt_a]: 0.038862, [2] [Cycle 1]: 0.00224931, [27] [switch_simplify]: 7.052e-05 [loop_unroll]: 3.05e-05 [a_1]: 0.00062218 [with_stream_mark]: 2.579e-05 [recompute_prepare]: 8.75001e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.73002e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.75002e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00112355 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.855e-05 [cse]: 3.942e-05 [replace_applicator]: 1.522e-05 [Cycle 2]: 0.00039899, [27] [switch_simplify]: 6.23002e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.006e-05 [with_stream_mark]: 1.33e-05 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 6.076e-05 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 8.08001e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.65e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 1.58002e-06 [auto_monad_eliminator]: 7.13e-06 [cse]: 1.531e-05 [replace_applicator]: 6.24001e-06 [py_interpret_to_execute_after_opt_a]: 1.555e-05 [rewriter_after_opt_a]: 4.254e-05 [convert_after_rewriter]: 6.60002e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00078698 [jit_opt_b]: 5.493e-05, [1] [Cycle 1]: 4.652e-05, [2] [frontend_op_eliminate]: 1.683e-05 [inline_after_opt_a]: 1.863e-05 [cconv]: 3.452e-05 [loop_unroll]: 0.00049509 [jit_opt_after_cconv]: 0.00017183, [1] [Cycle 1]: 0.00016526, [11] [c_1]: 2.16e-05 [parameter_eliminate]: 4.62998e-06 [updatestate_depend_eliminate]: 9.24e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 3.635e-05 [call_graph_tuple_transform]: 2.307e-05 [tuple_list_get_item_eliminator]: 5.54998e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.51999e-06 [remove_dup_value]: 1.77e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 7.79997e-06 [add_recomputation]: 5.948e-05 [cse_after_recomputation]: 2.307e-05, [1] [Cycle 1]: 1.73e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.978e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 7.11001e-06 [opt_after_jit_grad]: 0.00054959 [symbol_engine_optimizer]: 8.318e-05, [1] [Cycle 1]: 7.46e-05, [6] [build]: 4.80999e-06 [elim_shapecalc]: 8.97e-06 [elim_not_effective]: 1.654e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 9.29e-06 [renormalize]: 3.69997e-07 [validate]: 5.012e-05 Sums bootstrap : 0.000377s : 0.58% type_inference : 0.059454s : 91.78% event_method : 0.000023s : 0.03% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000112s : 0.17% rewriter_before_opt_a : 0.000087s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000712s : 1.10% jit_opt_a.with_stream_mark : 0.000039s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000065s : 0.10% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001124s : 1.73% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000055s : 0.08% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000043s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000787s : 1.21% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000035s : 0.05% loop_unroll : 0.000495s : 0.76% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000059s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000550s : 0.85% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.08% Time group info: ------[substitution.] 0.000273 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.20% : 0.000006s : 3: substitution.graph_param_transform 86.21% : 0.000235s : 4: substitution.inline 1.35% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000006s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.059369 2 97.13% : 0.057667s : 1: type_inference.infer 2.87% : 0.001702s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.27% : 0.000056s : 4: replace.inline 31.73% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 95.07% : 0.000232s : 4: match.inline 4.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.49% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.10% : 0.000001s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.12% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.05% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 6: predicate.less_batch_normalization 1.26% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.93% : 0.000004s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.28% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.93% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.33% : 0.000010s : 53: predicate.switch_simplify 1.21% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000986 13 47.85% : 0.000472s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.83% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.32% : 0.000457s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.103767 72 0.06% : 0.000062s : 1: add_recomputation 0.07% : 0.000073s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.39% : 0.000400s : 1: bootstrap 0.04% : 0.000038s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 37.46% : 0.038866s : 1: jit_opt_a 0.17% : 0.000174s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.49% : 0.000504s : 1: loop_unroll 0.77% : 0.000801s : 1: mutable_eliminate 0.91% : 0.000947s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000559s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000116s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.63% : 0.000651s : 1: renormalize.infer 0.45% : 0.000463s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000091s : 1: rewriter_before_opt_a 0.08% : 0.000086s : 1: symbol_engine_optimizer 57.31% : 0.059474s : 1: type_inference TotalTime = 0.38594, [30] [bootstrap]: 0.00043658 [type_inference]: 0.29652 [event_method]: 2.92e-05 [auto_monad]: 9.404e-05 [graph_reusing]: 7.66001e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00064663 [rewriter_before_opt_a]: 0.00012451 [expand_dump_flag]: 5.44e-06 [jit_opt_a]: 0.0819178, [2] [Cycle 1]: 0.00625711, [27] [switch_simplify]: 0.0001079 [loop_unroll]: 3.385e-05 [a_1]: 0.00092221 [with_stream_mark]: 3.548e-05 [recompute_prepare]: 1.794e-05 [updatestate_depend_eliminate]: 5.11002e-06 [updatestate_assign_eliminate]: 4.23001e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 3.42002e-06 [specialize_transform]: 9.89001e-06 [updatestate_useless_node_eliminater]: 7.66001e-06 [accelerated_algorithm]: 8.59e-06 [meta_shard_fg_expand]: 4e-06 [get_grad_eliminate_]: 7.61999e-06 [merge_forward]: 6.26e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.412e-05 [j_node_and_user_rematch]: 1.467e-05 [meta_fg_expand]: 3.34001e-06 [replace_old_param]: 1.594e-05 [inline_without_move]: 8.03001e-06 [renormalize]: 0.00459098 [add_forward_monad_depend]: 1.46e-05 [auto_monad_grad]: 3.9e-06 [auto_monad_eliminator]: 2.696e-05 [cse]: 5.277e-05 [replace_applicator]: 3.298e-05 [Cycle 2]: 0.00053976, [27] [switch_simplify]: 1.003e-05 [loop_unroll]: 8.2e-06 [a_1]: 0.00015417 [with_stream_mark]: 2.329e-05 [recompute_prepare]: 9.62999e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 3.77002e-06 [parameter_eliminate]: 2.79001e-06 [specialize_transform]: 9.20999e-06 [updatestate_useless_node_eliminater]: 6.94001e-06 [accelerated_algorithm]: 7.80998e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 7.6e-06 [merge_forward]: 5.49e-06 [cell_reuse_recompute_pass]: 4.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.48e-05 [j_node_and_user_rematch]: 1.272e-05 [meta_fg_expand]: 2.75002e-06 [replace_old_param]: 1.175e-05 [inline_without_move]: 6.73e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 3.88001e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 1.328e-05 [cse]: 3.121e-05 [replace_applicator]: 1.019e-05 [py_interpret_to_execute_after_opt_a]: 2.998e-05 [rewriter_after_opt_a]: 6.569e-05 [convert_after_rewriter]: 1.011e-05 [order_py_execute_after_rewriter]: 6.58e-06 [mutable_eliminate]: 0.00129239 [jit_opt_b]: 9.431e-05, [1] [Cycle 1]: 8.126e-05, [2] [frontend_op_eliminate]: 3.411e-05 [inline_after_opt_a]: 2.867e-05 [cconv]: 4.47e-05 [loop_unroll]: 0.00279971 [jit_opt_after_cconv]: 0.00026289, [1] [Cycle 1]: 0.00025082, [11] [c_1]: 3.767e-05 [parameter_eliminate]: 8.06001e-06 [updatestate_depend_eliminate]: 1.213e-05 [updatestate_assign_eliminate]: 3.83999e-06 [updatestate_loads_eliminate]: 4.12e-06 [cse]: 6.067e-05 [call_graph_tuple_transform]: 3.599e-05 [tuple_list_get_item_eliminator]: 9.69e-06 [none_parameter_eliminate]: 2.16e-06 [renormalize]: 8.2e-07 [switch_simplify]: 9.79999e-06 [remove_dup_value]: 2.992e-05 [partial_unused_args_eliminate]: 3.88999e-06 [environ_conv]: 1.533e-05 [add_recomputation]: 0.0001183 [cse_after_recomputation]: 3.779e-05, [1] [Cycle 1]: 3.062e-05, [1] [cse]: 2.034e-05 [auto_monad_reorder]: 2.148e-05 [get_jit_bprop_graph]: 2.62001e-06 [rewriter_after_jit_bprop_graph]: 1.189e-05 [opt_after_jit_grad]: 0.00079306 [symbol_engine_optimizer]: 0.00010501, [1] [Cycle 1]: 9.418e-05, [6] [build]: 6.49001e-06 [elim_shapecalc]: 1.096e-05 [elim_not_effective]: 1.872e-05 [opt_reshape]: 9.86e-06 [fold_const_symbol]: 1.227e-05 [renormalize]: 1.74e-06 [validate]: 8.093e-05 Sums bootstrap : 0.000437s : 0.14% type_inference : 0.296520s : 95.69% event_method : 0.000029s : 0.01% auto_monad : 0.000094s : 0.03% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000647s : 0.21% rewriter_before_opt_a : 0.000125s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000118s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001076s : 0.35% jit_opt_a.with_stream_mark : 0.000059s : 0.02% jit_opt_a.recompute_prepare : 0.000028s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000019s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000012s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000049s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000028s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.004591s : 1.48% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000040s : 0.01% jit_opt_a.cse : 0.000084s : 0.03% jit_opt_a.replace_applicator : 0.000043s : 0.01% py_interpret_to_execute_after_opt_a : 0.000030s : 0.01% rewriter_after_opt_a : 0.000066s : 0.02% convert_after_rewriter : 0.000010s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.001292s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000034s : 0.01% jit_opt_b.inline_after_opt_a : 0.000029s : 0.01% cconv : 0.000045s : 0.01% loop_unroll : 0.002800s : 0.90% jit_opt_after_cconv.c_1 : 0.000038s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000061s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.00% remove_dup_value : 0.000030s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000015s : 0.00% add_recomputation : 0.000118s : 0.04% cse_after_recomputation.cse : 0.000020s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.00% opt_after_jit_grad : 0.000793s : 0.26% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000081s : 0.03% Time group info: ------[substitution.] 0.000403 24 0.79% : 0.000003s : 2: substitution.elim_not_effective 0.72% : 0.000003s : 2: substitution.fold_const_symbol 2.20% : 0.000009s : 4: substitution.graph_param_transform 85.72% : 0.000345s : 4: substitution.inline 1.44% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000008s : 4: substitution.remove_not_recompute_node 2.08% : 0.000008s : 2: substitution.replace_old_param 5.08% : 0.000020s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.296345 2 98.53% : 0.292002s : 1: type_inference.infer 1.47% : 0.004343s : 1: type_inference.specialize ------[replace.] 0.000144 6 64.17% : 0.000092s : 4: replace.inline 35.83% : 0.000051s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000360 6 94.71% : 0.000341s : 4: match.inline 5.29% : 0.000019s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000178 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.81% : 0.000001s : 12: predicate.addn_check_dump 1.08% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.74% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 12: predicate.compare_switch_simplify 1.41% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.03% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.92% : 0.000002s : 12: predicate.environ_get_depend_swap 1.03% : 0.000002s : 12: predicate.environ_get_eliminate 0.79% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.53% : 0.000003s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 5.91% : 0.000010s : 26: predicate.inline 0.75% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 18: predicate.load_eliminater 3.20% : 0.000006s : 4: predicate.loop_unroll_after_grad 3.28% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.30% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000002s : 12: predicate.minmaximum_grad 2.29% : 0.000004s : 4: predicate.mutable_eliminate 0.39% : 0.000001s : 4: predicate.opt_reshape 1.81% : 0.000003s : 18: predicate.partial_eliminate 0.89% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000003s : 12: predicate.reduce_eliminate 1.46% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000002s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000001s : 4: predicate.reset_defer_inline 0.92% : 0.000002s : 12: predicate.reshape_eliminate 0.96% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.06% : 0.000002s : 4: predicate.row_tensor_eliminate 0.97% : 0.000002s : 12: predicate.same_eliminate 0.90% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000002s : 8: predicate.special_op_eliminate 0.73% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.93% : 0.000005s : 18: predicate.switch_defer_inline 1.66% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.79% : 0.000016s : 58: predicate.switch_simplify 1.01% : 0.000002s : 12: predicate.tile_eliminate 2.04% : 0.000004s : 12: predicate.transpose_eliminate 1.26% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.72% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.21% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.74% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.61% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.21% : 0.000002s : 12: predicate.value_based_eliminate 0.56% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.00% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004509 26 69.20% : 0.003120s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.67% : 0.000075s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.14% : 0.001314s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.392097 72 0.03% : 0.000126s : 1: add_recomputation 0.03% : 0.000098s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.12% : 0.000462s : 1: bootstrap 0.01% : 0.000049s : 1: cconv 0.00% : 0.000014s : 1: convert_after_rewriter 0.01% : 0.000042s : 1: cse_after_recomputation 0.00% : 0.000018s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 20.89% : 0.081925s : 1: jit_opt_a 0.07% : 0.000267s : 1: jit_opt_after_cconv 0.02% : 0.000098s : 1: jit_opt_b 0.72% : 0.002827s : 1: loop_unroll 0.34% : 0.001319s : 1: mutable_eliminate 0.37% : 0.001444s : 26: opt.transform.jit_opt_a 0.02% : 0.000088s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000052s : 4: opt.transform.jit_opt_b 0.01% : 0.000044s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000041s : 1: opt.transform.mutable_eliminate 0.01% : 0.000046s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000812s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000657s : 1: py_interpret_to_execute 0.01% : 0.000034s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000034s : 1: remove_dup_value 0.81% : 0.003174s : 1: renormalize.infer 0.36% : 0.001397s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000071s : 1: rewriter_after_opt_a 0.03% : 0.000132s : 1: rewriter_before_opt_a 0.03% : 0.000108s : 1: symbol_engine_optimizer 75.63% : 0.296554s : 1: type_inference TotalTime = 0.0757085, [30] [bootstrap]: 0.00034201 [type_inference]: 0.0665754 [event_method]: 2.599e-05 [auto_monad]: 7.295e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.00011321 [rewriter_before_opt_a]: 8.568e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00613466, [2] [Cycle 1]: 0.0020812, [27] [switch_simplify]: 6.058e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00057117 [with_stream_mark]: 2.418e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.435e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.65002e-06 [inline_without_move]: 5.63002e-06 [renormalize]: 0.00103997 [add_forward_monad_depend]: 6.21e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.646e-05 [cse]: 3.485e-05 [replace_applicator]: 1.447e-05 [Cycle 2]: 0.00031966, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 4.97e-06 [a_1]: 8.711e-05 [with_stream_mark]: 1.151e-05 [recompute_prepare]: 5.11002e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.26002e-06 [specialize_transform]: 5.23002e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.33998e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.41002e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 7.43999e-06 [inline_without_move]: 4.74002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.188e-05 [replace_applicator]: 4.98001e-06 [py_interpret_to_execute_after_opt_a]: 1.33e-05 [rewriter_after_opt_a]: 3.829e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00070379 [jit_opt_b]: 5.272e-05, [1] [Cycle 1]: 4.545e-05, [2] [frontend_op_eliminate]: 1.596e-05 [inline_after_opt_a]: 1.873e-05 [cconv]: 3.028e-05 [loop_unroll]: 0.00042993 [jit_opt_after_cconv]: 0.0001506, [1] [Cycle 1]: 0.00014343, [11] [c_1]: 1.975e-05 [parameter_eliminate]: 3.63999e-06 [updatestate_depend_eliminate]: 7.95998e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.675e-05 [call_graph_tuple_transform]: 1.982e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.29998e-06 [remove_dup_value]: 1.644e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.33002e-06 [add_recomputation]: 5.177e-05 [cse_after_recomputation]: 2.177e-05, [1] [Cycle 1]: 1.66e-05, [1] [cse]: 1.126e-05 [auto_monad_reorder]: 1.7e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 6.83e-06 [opt_after_jit_grad]: 0.00046877 [symbol_engine_optimizer]: 8.139e-05, [1] [Cycle 1]: 7.452e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.368e-05 [opt_reshape]: 5.59998e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 5.79981e-07 [validate]: 4.297e-05 Sums bootstrap : 0.000342s : 0.48% type_inference : 0.066575s : 93.30% event_method : 0.000026s : 0.04% auto_monad : 0.000073s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000113s : 0.16% rewriter_before_opt_a : 0.000086s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000658s : 0.92% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001040s : 1.46% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000047s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000704s : 0.99% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000430s : 0.60% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000469s : 0.66% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.06% Time group info: ------[substitution.] 0.000242 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000005s : 3: substitution.graph_param_transform 86.35% : 0.000209s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 4.88% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066481 2 66.93% : 0.044495s : 1: type_inference.infer 33.07% : 0.021986s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.07% : 0.000049s : 4: replace.inline 30.93% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 6 95.06% : 0.000207s : 4: match.inline 4.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.55% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.75% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.77% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.65% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.37% : 0.000002s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000965 13 43.92% : 0.000424s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.46% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.61% : 0.000488s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077683 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000077s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.47% : 0.000363s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.90% : 0.006138s : 1: jit_opt_a 0.20% : 0.000153s : 1: jit_opt_after_cconv 0.07% : 0.000055s : 1: jit_opt_b 0.56% : 0.000438s : 1: loop_unroll 0.92% : 0.000714s : 1: mutable_eliminate 1.13% : 0.000881s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000118s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.77% : 0.000602s : 1: renormalize.infer 0.55% : 0.000428s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.12% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000084s : 1: symbol_engine_optimizer 85.74% : 0.066606s : 1: type_inference TotalTime = 0.672794, [30] [bootstrap]: 0.00033241 [type_inference]: 0.598812 [event_method]: 3.083e-05 [auto_monad]: 0.00010076 [graph_reusing]: 6.71e-06 [pre_auto_parallel]: 3.90998e-06 [py_interpret_to_execute]: 0.00124467 [rewriter_before_opt_a]: 0.00014221 [expand_dump_flag]: 6.43998e-06 [jit_opt_a]: 0.054905, [2] [Cycle 1]: 0.0485211, [27] [switch_simplify]: 0.00011746 [loop_unroll]: 3.942e-05 [a_1]: 0.0411985 [with_stream_mark]: 3.107e-05 [recompute_prepare]: 1.708e-05 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.85e-06 [parameter_eliminate]: 2.89001e-06 [specialize_transform]: 1.066e-05 [updatestate_useless_node_eliminater]: 9.10001e-06 [accelerated_algorithm]: 1.258e-05 [meta_shard_fg_expand]: 4.87998e-06 [get_grad_eliminate_]: 1.047e-05 [merge_forward]: 5.51e-06 [cell_reuse_recompute_pass]: 2.76999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.316e-05 [j_node_and_user_rematch]: 1.386e-05 [meta_fg_expand]: 5.04e-06 [replace_old_param]: 1.511e-05 [inline_without_move]: 8.47998e-06 [renormalize]: 0.0064713 [add_forward_monad_depend]: 1.404e-05 [auto_monad_grad]: 2.43998e-06 [auto_monad_eliminator]: 2.955e-05 [cse]: 4.817e-05 [replace_applicator]: 4.358e-05 [Cycle 2]: 0.00052582, [27] [switch_simplify]: 8.93002e-06 [loop_unroll]: 9.65002e-06 [a_1]: 0.00016122 [with_stream_mark]: 2.016e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 3.39001e-06 [specialize_transform]: 7.71001e-06 [updatestate_useless_node_eliminater]: 7.03e-06 [accelerated_algorithm]: 7.33999e-06 [meta_shard_fg_expand]: 3.07002e-06 [get_grad_eliminate_]: 7.01999e-06 [merge_forward]: 5.14003e-06 [cell_reuse_recompute_pass]: 4.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.368e-05 [j_node_and_user_rematch]: 1.13e-05 [meta_fg_expand]: 5.08002e-06 [replace_old_param]: 1.169e-05 [inline_without_move]: 7.05e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.89999e-06 [auto_monad_grad]: 1.44e-06 [auto_monad_eliminator]: 1.261e-05 [cse]: 2.565e-05 [replace_applicator]: 1.017e-05 [py_interpret_to_execute_after_opt_a]: 2.331e-05 [rewriter_after_opt_a]: 5.256e-05 [convert_after_rewriter]: 8.53001e-06 [order_py_execute_after_rewriter]: 5.66e-06 [mutable_eliminate]: 0.00106776 [jit_opt_b]: 8.269e-05, [1] [Cycle 1]: 7.053e-05, [2] [frontend_op_eliminate]: 3.02e-05 [inline_after_opt_a]: 2.341e-05 [cconv]: 3.934e-05 [loop_unroll]: 0.00067955 [jit_opt_after_cconv]: 0.0002313, [1] [Cycle 1]: 0.00022, [11] [c_1]: 3.196e-05 [parameter_eliminate]: 5.47001e-06 [updatestate_depend_eliminate]: 1.207e-05 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 3.20998e-06 [cse]: 5.308e-05 [call_graph_tuple_transform]: 3.171e-05 [tuple_list_get_item_eliminator]: 9.32999e-06 [none_parameter_eliminate]: 2.41e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 8.25e-06 [remove_dup_value]: 2.62e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 1.296e-05 [add_recomputation]: 6.466e-05 [cse_after_recomputation]: 3.733e-05, [1] [Cycle 1]: 2.998e-05, [1] [cse]: 1.972e-05 [auto_monad_reorder]: 2.188e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 1.052e-05 [opt_after_jit_grad]: 0.0139369 [symbol_engine_optimizer]: 0.00014552, [1] [Cycle 1]: 0.00012877, [6] [build]: 9.89999e-06 [elim_shapecalc]: 2.133e-05 [elim_not_effective]: 3.096e-05 [opt_reshape]: 1.276e-05 [fold_const_symbol]: 1.206e-05 [renormalize]: 1.44e-06 [validate]: 0.0004364 Sums bootstrap : 0.000332s : 0.05% type_inference : 0.598812s : 89.92% event_method : 0.000031s : 0.00% auto_monad : 0.000101s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.001245s : 0.19% rewriter_before_opt_a : 0.000142s : 0.02% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.02% jit_opt_a.loop_unroll : 0.000049s : 0.01% jit_opt_a.a_1 : 0.041360s : 6.21% jit_opt_a.with_stream_mark : 0.000051s : 0.01% jit_opt_a.recompute_prepare : 0.000026s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000008s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.00% jit_opt_a.accelerated_algorithm : 0.000020s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000047s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.00% jit_opt_a.meta_fg_expand : 0.000010s : 0.00% jit_opt_a.replace_old_param : 0.000027s : 0.00% jit_opt_a.inline_without_move : 0.000016s : 0.00% jit_opt_a.renormalize : 0.006471s : 0.97% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000042s : 0.01% jit_opt_a.cse : 0.000074s : 0.01% jit_opt_a.replace_applicator : 0.000054s : 0.01% py_interpret_to_execute_after_opt_a : 0.000023s : 0.00% rewriter_after_opt_a : 0.000053s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001068s : 0.16% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.00% jit_opt_b.inline_after_opt_a : 0.000023s : 0.00% cconv : 0.000039s : 0.01% loop_unroll : 0.000680s : 0.10% jit_opt_after_cconv.c_1 : 0.000032s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000053s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000026s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000065s : 0.01% cse_after_recomputation.cse : 0.000020s : 0.00% auto_monad_reorder : 0.000022s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.013937s : 2.09% symbol_engine_optimizer.build : 0.000010s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000021s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000031s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000013s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000436s : 0.07% Time group info: ------[substitution.] 0.000462 25 0.60% : 0.000003s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.62% : 0.000007s : 4: substitution.graph_param_transform 88.76% : 0.000410s : 5: substitution.inline 0.99% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000008s : 4: substitution.remove_not_recompute_node 1.87% : 0.000009s : 2: substitution.replace_old_param 4.04% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.598662 2 98.88% : 0.591983s : 1: type_inference.infer 1.12% : 0.006679s : 1: type_inference.specialize ------[replace.] 0.000193 7 62.79% : 0.000121s : 5: replace.inline 37.21% : 0.000072s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000422 7 95.92% : 0.000405s : 5: match.inline 4.08% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000239 886 1.59% : 0.000004s : 13: predicate.accumulaten_eliminater 4.64% : 0.000011s : 4: predicate.ad_related_special_op_eliminate 0.87% : 0.000002s : 13: predicate.addn_check_dump 1.19% : 0.000003s : 13: predicate.addn_zero_filter 2.50% : 0.000006s : 13: predicate.arithmetic_simplify 1.34% : 0.000003s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000003s : 13: predicate.depend_value_elim 0.87% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000003s : 13: predicate.dict_get_item_eliminator 0.93% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.88% : 0.000004s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.94% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.57% : 0.000004s : 13: predicate.environ_add_const_eliminate 0.75% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.84% : 0.000002s : 13: predicate.environ_get_depend_swap 1.00% : 0.000002s : 13: predicate.environ_get_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000001s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.16% : 0.000000s : 4: predicate.graph_param_transform 4.85% : 0.000012s : 28: predicate.inline 0.55% : 0.000001s : 8: predicate.inline_without_move 0.28% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000003s : 8: predicate.less_batch_normalization 1.41% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.61% : 0.000004s : 19: predicate.load_eliminater 1.28% : 0.000003s : 4: predicate.loop_unroll_after_grad 2.98% : 0.000007s : 40: predicate.loop_unroll_before_grad 4.75% : 0.000011s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000003s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000004s : 4: predicate.mutable_eliminate 0.65% : 0.000002s : 4: predicate.opt_reshape 1.42% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000003s : 13: predicate.print_const_string_wrapper 2.10% : 0.000005s : 13: predicate.reduce_eliminate 1.38% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.36% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000002s : 8: predicate.replace_old_param 0.21% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000003s : 13: predicate.reshape_eliminate 1.09% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000002s : 4: predicate.row_tensor_eliminate 1.05% : 0.000003s : 13: predicate.same_eliminate 0.39% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.59% : 0.000004s : 8: predicate.special_op_eliminate 0.74% : 0.000002s : 8: predicate.specialize_transform 1.51% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.25% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.33% : 0.000008s : 20: predicate.switch_defer_inline 1.80% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.02% : 0.000014s : 64: predicate.switch_simplify 1.12% : 0.000003s : 13: predicate.tile_eliminate 1.03% : 0.000002s : 13: predicate.transpose_eliminate 2.08% : 0.000005s : 13: predicate.tuple_list_convert_item_index_to_positive 2.05% : 0.000005s : 13: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 2.48% : 0.000006s : 13: predicate.tuple_list_set_item_eliminator 1.21% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.09% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.09% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.88% : 0.000004s : 13: predicate.value_based_eliminate 0.61% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004343 25 58.00% : 0.002519s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.71% : 0.000118s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.29% : 0.001707s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.733819 72 0.01% : 0.000070s : 1: add_recomputation 0.01% : 0.000105s : 1: auto_monad 0.00% : 0.000025s : 1: auto_monad_reorder 0.05% : 0.000350s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000040s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000009s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 7.48% : 0.054911s : 1: jit_opt_a 0.03% : 0.000235s : 1: jit_opt_after_cconv 0.01% : 0.000087s : 1: jit_opt_b 0.09% : 0.000692s : 1: loop_unroll 0.15% : 0.001087s : 1: mutable_eliminate 5.69% : 0.041755s : 26: opt.transform.jit_opt_a 0.01% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000045s : 4: opt.transform.jit_opt_b 0.00% : 0.000025s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000031s : 1: opt.transform.mutable_eliminate 1.79% : 0.013119s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000069s : 4: opt.transform.symbol_engine_opt 1.90% : 0.013973s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.17% : 0.001260s : 1: py_interpret_to_execute 0.00% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000029s : 1: remove_dup_value 0.65% : 0.004759s : 1: renormalize.infer 0.23% : 0.001691s : 1: renormalize.specialize 0.00% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000059s : 1: rewriter_after_opt_a 0.02% : 0.000151s : 1: rewriter_before_opt_a 0.02% : 0.000150s : 1: symbol_engine_optimizer 81.61% : 0.598839s : 1: type_inference TotalTime = 0.121844, [30] [bootstrap]: 0.00036786 [type_inference]: 0.0722562 [event_method]: 0.00014117 [auto_monad]: 0.00012557 [graph_reusing]: 8.27e-06 [pre_auto_parallel]: 3.60998e-06 [py_interpret_to_execute]: 5.296e-05 [rewriter_before_opt_a]: 0.00016634 [expand_dump_flag]: 4.85001e-06 [jit_opt_a]: 0.0458264, [2] [Cycle 1]: 0.0397777, [27] [switch_simplify]: 0.00020739 [loop_unroll]: 5.6e-05 [a_1]: 0.0370107 [with_stream_mark]: 3.118e-05 [recompute_prepare]: 1.486e-05 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 6.63998e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 4.63001e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 4.72e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.828e-05 [j_node_and_user_rematch]: 1.307e-05 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.334e-05 [inline_without_move]: 6.74999e-06 [renormalize]: 0.00200015 [add_forward_monad_depend]: 8.50999e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 2.014e-05 [cse]: 4.731e-05 [replace_applicator]: 1.832e-05 [Cycle 2]: 0.00036466, [27] [switch_simplify]: 7.68999e-06 [loop_unroll]: 6.50997e-06 [a_1]: 0.00011047 [with_stream_mark]: 1.238e-05 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 6.14999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.51002e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.395e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.664e-05 [rewriter_after_opt_a]: 4.734e-05 [convert_after_rewriter]: 8.13999e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00092054 [jit_opt_b]: 6.004e-05, [1] [Cycle 1]: 5.018e-05, [2] [frontend_op_eliminate]: 1.943e-05 [inline_after_opt_a]: 1.928e-05 [cconv]: 3.143e-05 [loop_unroll]: 0.0004775 [jit_opt_after_cconv]: 0.00018965, [1] [Cycle 1]: 0.00018157, [11] [c_1]: 2.541e-05 [parameter_eliminate]: 3.78999e-06 [updatestate_depend_eliminate]: 8.05e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 3.956e-05 [call_graph_tuple_transform]: 2.859e-05 [tuple_list_get_item_eliminator]: 5.83002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 4.764e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 7.03998e-06 [add_recomputation]: 6.013e-05 [cse_after_recomputation]: 3.043e-05, [1] [Cycle 1]: 2.241e-05, [1] [cse]: 1.455e-05 [auto_monad_reorder]: 2.07e-05 [get_jit_bprop_graph]: 2.58998e-06 [rewriter_after_jit_bprop_graph]: 7.85e-06 [opt_after_jit_grad]: 0.00055301 [symbol_engine_optimizer]: 0.00012182, [1] [Cycle 1]: 0.00011415, [6] [build]: 6.39001e-06 [elim_shapecalc]: 1.073e-05 [elim_not_effective]: 4.417e-05 [opt_reshape]: 8.28999e-06 [fold_const_symbol]: 1.107e-05 [renormalize]: 4.70027e-07 [validate]: 5.325e-05 Sums bootstrap : 0.000368s : 0.32% type_inference : 0.072256s : 62.60% event_method : 0.000141s : 0.12% auto_monad : 0.000126s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000053s : 0.05% rewriter_before_opt_a : 0.000166s : 0.14% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000215s : 0.19% jit_opt_a.loop_unroll : 0.000063s : 0.05% jit_opt_a.a_1 : 0.037121s : 32.16% jit_opt_a.with_stream_mark : 0.000044s : 0.04% jit_opt_a.recompute_prepare : 0.000021s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002000s : 1.73% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000061s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000047s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000921s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000477s : 0.41% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000048s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000060s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000021s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000553s : 0.48% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000044s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.05% Time group info: ------[substitution.] 0.036040 33 0.01% : 0.000003s : 2: substitution.elim_not_effective 0.00% : 0.000002s : 2: substitution.fold_const_symbol 0.03% : 0.000009s : 3: substitution.graph_param_transform 99.82% : 0.035975s : 11: substitution.inline 0.02% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.02% : 0.000006s : 4: substitution.remove_not_recompute_node 0.02% : 0.000007s : 2: substitution.replace_old_param 0.04% : 0.000013s : 2: substitution.switch_simplify 0.05% : 0.000019s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072133 2 94.87% : 0.068431s : 1: type_inference.infer 5.13% : 0.003701s : 1: type_inference.specialize ------[replace.] 0.000415 16 52.09% : 0.000216s : 11: replace.inline 15.05% : 0.000062s : 2: replace.switch_simplify 32.86% : 0.000136s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.035992 16 99.92% : 0.035964s : 11: match.inline 0.03% : 0.000012s : 2: match.switch_simplify 0.05% : 0.000017s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000221 1148 1.65% : 0.000004s : 18: predicate.accumulaten_eliminater 0.87% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 18: predicate.addn_check_dump 1.57% : 0.000003s : 18: predicate.addn_zero_filter 2.34% : 0.000005s : 18: predicate.arithmetic_simplify 1.62% : 0.000004s : 18: predicate.cast_eliminate 0.29% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000003s : 18: predicate.compare_switch_simplify 1.52% : 0.000003s : 18: predicate.depend_value_elim 1.15% : 0.000003s : 18: predicate.dict_get_item_const_eliminator 1.35% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.35% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.92% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.21% : 0.000000s : 3: predicate.elim_not_effective 0.34% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.13% : 0.000003s : 18: predicate.environ_get_add_eliminate 1.26% : 0.000003s : 18: predicate.environ_get_depend_swap 1.28% : 0.000003s : 18: predicate.environ_get_eliminate 1.18% : 0.000003s : 18: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.55% : 0.000001s : 6: predicate.get_grad_eliminate 0.13% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000012s : 38: predicate.inline 0.58% : 0.000001s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.77% : 0.000002s : 6: predicate.less_batch_normalization 1.93% : 0.000004s : 21: predicate.list_to_tuple_eliminator_ 1.88% : 0.000004s : 24: predicate.load_eliminater 1.06% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.69% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.40% : 0.000003s : 18: predicate.merge_addn 1.26% : 0.000003s : 18: predicate.minmaximum_grad 1.21% : 0.000003s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000004s : 24: predicate.partial_eliminate 1.24% : 0.000003s : 18: predicate.print_const_string_wrapper 2.04% : 0.000005s : 18: predicate.reduce_eliminate 1.55% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 6: predicate.remove_not_recompute_node 1.40% : 0.000003s : 27: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.68% : 0.000004s : 18: predicate.reshape_eliminate 1.32% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.53% : 0.000003s : 18: predicate.same_eliminate 0.29% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000002s : 6: predicate.special_op_eliminate 0.52% : 0.000001s : 6: predicate.specialize_transform 1.71% : 0.000004s : 18: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.23% : 0.000001s : 3: predicate.switch_call_monad_eliminater 4.23% : 0.000009s : 32: predicate.switch_defer_inline 2.71% : 0.000006s : 32: predicate.switch_layer_defer_inline 8.17% : 0.000018s : 103: predicate.switch_simplify 1.54% : 0.000003s : 18: predicate.tile_eliminate 1.34% : 0.000003s : 18: predicate.transpose_eliminate 1.57% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.54% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000008s : 27: predicate.tuple_list_get_item_eliminator 2.15% : 0.000005s : 18: predicate.tuple_list_set_item_eliminator 1.69% : 0.000004s : 21: predicate.tuple_to_list_eliminator_ 1.79% : 0.000004s : 24: predicate.updatestate_pure_node_eliminater 2.09% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.79% : 0.000004s : 18: predicate.value_based_eliminate 0.16% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.38% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.029902 28 95.13% : 0.028447s : 9: func_graph_cloner_run.FuncGraphClonerGraph 1.03% : 0.000308s : 6: func_graph_cloner_run.FuncGraphClonerNode 3.84% : 0.001147s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.161474 72 0.04% : 0.000063s : 1: add_recomputation 0.08% : 0.000132s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.24% : 0.000389s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.09% : 0.000150s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 28.38% : 0.045834s : 1: jit_opt_a 0.12% : 0.000193s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.30% : 0.000487s : 1: loop_unroll 0.58% : 0.000931s : 1: mutable_eliminate 23.25% : 0.037545s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000070s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000564s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000056s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000051s : 1: remove_dup_value 0.86% : 0.001392s : 1: renormalize.infer 0.37% : 0.000597s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.11% : 0.000171s : 1: rewriter_before_opt_a 0.08% : 0.000125s : 1: symbol_engine_optimizer 44.76% : 0.072280s : 1: type_inference TotalTime = 0.618125, [30] [bootstrap]: 0.00048761 [type_inference]: 0.534014 [event_method]: 2.561e-05 [auto_monad]: 8.921e-05 [graph_reusing]: 5.70001e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00085741 [rewriter_before_opt_a]: 0.00012223 [expand_dump_flag]: 5.64e-06 [jit_opt_a]: 0.0775325, [2] [Cycle 1]: 0.00862602, [27] [switch_simplify]: 0.00011437 [loop_unroll]: 3.079e-05 [a_1]: 0.00086244 [with_stream_mark]: 3.764e-05 [recompute_prepare]: 1.278e-05 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 4.03999e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 9.72999e-06 [updatestate_useless_node_eliminater]: 8.75001e-06 [accelerated_algorithm]: 9.40001e-06 [meta_shard_fg_expand]: 6.66999e-06 [get_grad_eliminate_]: 9.18002e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.469e-05 [j_node_and_user_rematch]: 1.47e-05 [meta_fg_expand]: 4.89e-06 [replace_old_param]: 1.635e-05 [inline_without_move]: 8.31002e-06 [renormalize]: 0.00702433 [add_forward_monad_depend]: 1.488e-05 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 3e-05 [cse]: 4.286e-05 [replace_applicator]: 3.13e-05 [Cycle 2]: 0.00048714, [27] [switch_simplify]: 8.57e-06 [loop_unroll]: 7.11001e-06 [a_1]: 0.00015464 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 7.86001e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 7.7e-06 [accelerated_algorithm]: 7.75e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 6.43003e-06 [merge_forward]: 5.33002e-06 [cell_reuse_recompute_pass]: 4.05e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.529e-05 [j_node_and_user_rematch]: 1.243e-05 [meta_fg_expand]: 4.13001e-06 [replace_old_param]: 1.307e-05 [inline_without_move]: 6.49999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.73998e-06 [auto_monad_grad]: 1.10999e-06 [auto_monad_eliminator]: 9.79999e-06 [cse]: 1.905e-05 [replace_applicator]: 8.52e-06 [py_interpret_to_execute_after_opt_a]: 2.364e-05 [rewriter_after_opt_a]: 5.034e-05 [convert_after_rewriter]: 7.89002e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00149896 [jit_opt_b]: 0.00010253, [1] [Cycle 1]: 8.529e-05, [2] [frontend_op_eliminate]: 3.82e-05 [inline_after_opt_a]: 2.915e-05 [cconv]: 4.394e-05 [loop_unroll]: 0.00085096 [jit_opt_after_cconv]: 0.00023731, [1] [Cycle 1]: 0.00022576, [11] [c_1]: 3.587e-05 [parameter_eliminate]: 7.63001e-06 [updatestate_depend_eliminate]: 1.457e-05 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 4.734e-05 [call_graph_tuple_transform]: 3.788e-05 [tuple_list_get_item_eliminator]: 8.08001e-06 [none_parameter_eliminate]: 2.52001e-06 [renormalize]: 7.79983e-07 [switch_simplify]: 7.51001e-06 [remove_dup_value]: 1.939e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 1.366e-05 [add_recomputation]: 7.104e-05 [cse_after_recomputation]: 3.471e-05, [1] [Cycle 1]: 2.653e-05, [1] [cse]: 1.716e-05 [auto_monad_reorder]: 2.127e-05 [get_jit_bprop_graph]: 2.50997e-06 [rewriter_after_jit_bprop_graph]: 1.293e-05 [opt_after_jit_grad]: 0.00145209 [symbol_engine_optimizer]: 0.00012855, [1] [Cycle 1]: 0.00011621, [6] [build]: 9.29e-06 [elim_shapecalc]: 1.287e-05 [elim_not_effective]: 2.914e-05 [opt_reshape]: 9.84999e-06 [fold_const_symbol]: 1.518e-05 [renormalize]: 1.74e-06 [validate]: 8.02e-05 Sums bootstrap : 0.000488s : 0.09% type_inference : 0.534014s : 97.31% event_method : 0.000026s : 0.00% auto_monad : 0.000089s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000857s : 0.16% rewriter_before_opt_a : 0.000122s : 0.02% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000123s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.001017s : 0.19% jit_opt_a.with_stream_mark : 0.000058s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.00% jit_opt_a.accelerated_algorithm : 0.000017s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000050s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.00% jit_opt_a.meta_fg_expand : 0.000009s : 0.00% jit_opt_a.replace_old_param : 0.000029s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.007024s : 1.28% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000040s : 0.01% jit_opt_a.cse : 0.000062s : 0.01% jit_opt_a.replace_applicator : 0.000040s : 0.01% py_interpret_to_execute_after_opt_a : 0.000024s : 0.00% rewriter_after_opt_a : 0.000050s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001499s : 0.27% jit_opt_b.frontend_op_eliminate : 0.000038s : 0.01% jit_opt_b.inline_after_opt_a : 0.000029s : 0.01% cconv : 0.000044s : 0.01% loop_unroll : 0.000851s : 0.16% jit_opt_after_cconv.c_1 : 0.000036s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000071s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.00% opt_after_jit_grad : 0.001452s : 0.26% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000029s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.00% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000080s : 0.01% Time group info: ------[substitution.] 0.000380 24 0.81% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000003s : 2: substitution.fold_const_symbol 2.38% : 0.000009s : 4: substitution.graph_param_transform 84.43% : 0.000321s : 4: substitution.inline 1.67% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000009s : 4: substitution.remove_not_recompute_node 2.61% : 0.000010s : 2: substitution.replace_old_param 5.07% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.533882 2 98.98% : 0.528422s : 1: type_inference.infer 1.02% : 0.005461s : 1: type_inference.specialize ------[replace.] 0.000127 6 64.75% : 0.000082s : 4: replace.inline 35.25% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000336 6 94.63% : 0.000318s : 4: match.inline 5.37% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000210 830 1.48% : 0.000003s : 12: predicate.accumulaten_eliminater 1.80% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 0.87% : 0.000002s : 12: predicate.addn_check_dump 1.12% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000004s : 12: predicate.arithmetic_simplify 1.73% : 0.000004s : 12: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 0.83% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000003s : 12: predicate.environ_add_const_eliminate 0.87% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.68% : 0.000001s : 12: predicate.environ_get_depend_swap 1.08% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000003s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 5.10% : 0.000011s : 26: predicate.inline 0.75% : 0.000002s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000003s : 8: predicate.less_batch_normalization 1.36% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.21% : 0.000005s : 18: predicate.load_eliminater 2.09% : 0.000004s : 4: predicate.loop_unroll_after_grad 2.58% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.22% : 0.000005s : 16: predicate.make_slice_get_slice_eliminator 0.80% : 0.000002s : 12: predicate.merge_addn 0.86% : 0.000002s : 12: predicate.minmaximum_grad 3.45% : 0.000007s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 1.68% : 0.000004s : 18: predicate.partial_eliminate 1.00% : 0.000002s : 12: predicate.print_const_string_wrapper 2.25% : 0.000005s : 12: predicate.reduce_eliminate 1.37% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 8: predicate.remove_not_recompute_node 1.45% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.59% : 0.000001s : 4: predicate.reset_defer_inline 1.02% : 0.000002s : 12: predicate.reshape_eliminate 1.04% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000002s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 12: predicate.same_eliminate 0.45% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.46% : 0.000003s : 8: predicate.special_op_eliminate 0.96% : 0.000002s : 8: predicate.specialize_transform 1.41% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.75% : 0.000004s : 18: predicate.switch_defer_inline 1.72% : 0.000004s : 18: predicate.switch_layer_defer_inline 12.11% : 0.000025s : 58: predicate.switch_simplify 1.20% : 0.000003s : 12: predicate.tile_eliminate 1.27% : 0.000003s : 12: predicate.transpose_eliminate 1.05% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.99% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.54% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.76% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.36% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.40% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.60% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000003s : 12: predicate.value_based_eliminate 0.23% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004303 22 54.40% : 0.002341s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.71% : 0.000074s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.89% : 0.001889s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.626656 72 0.01% : 0.000077s : 1: add_recomputation 0.01% : 0.000094s : 1: auto_monad 0.00% : 0.000025s : 1: auto_monad_reorder 0.08% : 0.000512s : 1: bootstrap 0.01% : 0.000048s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000037s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.00% : 0.000031s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.37% : 0.077538s : 1: jit_opt_a 0.04% : 0.000241s : 1: jit_opt_after_cconv 0.02% : 0.000108s : 1: jit_opt_b 0.14% : 0.000871s : 1: loop_unroll 0.24% : 0.001529s : 1: mutable_eliminate 0.22% : 0.001379s : 26: opt.transform.jit_opt_a 0.01% : 0.000084s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000056s : 4: opt.transform.jit_opt_b 0.00% : 0.000027s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000043s : 1: opt.transform.mutable_eliminate 0.01% : 0.000057s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000061s : 4: opt.transform.symbol_engine_opt 0.24% : 0.001478s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000869s : 1: py_interpret_to_execute 0.00% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 0.80% : 0.005020s : 1: renormalize.infer 0.32% : 0.001980s : 1: renormalize.specialize 0.00% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000055s : 1: rewriter_after_opt_a 0.02% : 0.000128s : 1: rewriter_before_opt_a 0.02% : 0.000134s : 1: symbol_engine_optimizer 85.22% : 0.534046s : 1: type_inference TotalTime = 0.0743348, [30] [bootstrap]: 0.0003947 [type_inference]: 0.00812617 [event_method]: 2.38e-05 [auto_monad]: 8.408e-05 [graph_reusing]: 6.43998e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 8.694e-05 [rewriter_before_opt_a]: 0.00010117 [expand_dump_flag]: 3.89002e-06 [jit_opt_a]: 0.00851635, [2] [Cycle 1]: 0.00322593, [27] [switch_simplify]: 9.07e-05 [loop_unroll]: 3.49e-05 [a_1]: 0.00077347 [with_stream_mark]: 2.908e-05 [recompute_prepare]: 1.187e-05 [updatestate_depend_eliminate]: 5.64998e-06 [updatestate_assign_eliminate]: 3.91999e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.85002e-06 [specialize_transform]: 8.11002e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 8.72e-06 [meta_shard_fg_expand]: 3.25e-06 [get_grad_eliminate_]: 6.94001e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.182e-05 [j_node_and_user_rematch]: 1.302e-05 [meta_fg_expand]: 3.46001e-06 [replace_old_param]: 1.273e-05 [inline_without_move]: 6.88e-06 [renormalize]: 0.00181291 [add_forward_monad_depend]: 1.156e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.214e-05 [cse]: 4.874e-05 [replace_applicator]: 2.732e-05 [Cycle 2]: 0.00041269, [27] [switch_simplify]: 8.2e-06 [loop_unroll]: 5.62999e-06 [a_1]: 0.00010668 [with_stream_mark]: 1.761e-05 [recompute_prepare]: 7.35998e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 3.13e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 3.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.056e-05 [j_node_and_user_rematch]: 1.201e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.112e-05 [inline_without_move]: 6.34001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.32001e-06 [auto_monad_grad]: 1.34998e-06 [auto_monad_eliminator]: 9.32001e-06 [cse]: 1.934e-05 [replace_applicator]: 7.31001e-06 [py_interpret_to_execute_after_opt_a]: 2.218e-05 [rewriter_after_opt_a]: 5.455e-05 [convert_after_rewriter]: 8.05999e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.0451573 [jit_opt_b]: 8.242e-05, [1] [Cycle 1]: 6.791e-05, [2] [frontend_op_eliminate]: 2.467e-05 [inline_after_opt_a]: 2.659e-05 [cconv]: 7.1e-05 [loop_unroll]: 0.00099764 [jit_opt_after_cconv]: 0.00023748, [1] [Cycle 1]: 0.00022543, [11] [c_1]: 3.276e-05 [parameter_eliminate]: 7.43e-06 [updatestate_depend_eliminate]: 1.432e-05 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [cse]: 5.665e-05 [call_graph_tuple_transform]: 3.17e-05 [tuple_list_get_item_eliminator]: 6.86999e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 8.64003e-06 [remove_dup_value]: 5.824e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.07001e-06 [add_recomputation]: 6.465e-05 [cse_after_recomputation]: 3.38e-05, [1] [Cycle 1]: 2.71e-05, [1] [cse]: 1.559e-05 [auto_monad_reorder]: 2.253e-05 [get_jit_bprop_graph]: 7.15e-06 [rewriter_after_jit_bprop_graph]: 1.451e-05 [opt_after_jit_grad]: 0.00087878 [symbol_engine_optimizer]: 0.00024182, [1] [Cycle 1]: 0.00023229, [6] [build]: 6.77002e-06 [elim_shapecalc]: 1.288e-05 [elim_not_effective]: 1.933e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 0.0001534 [renormalize]: 1.44e-06 [validate]: 6.886e-05 Sums bootstrap : 0.000395s : 0.66% type_inference : 0.008126s : 13.55% event_method : 0.000024s : 0.04% auto_monad : 0.000084s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000087s : 0.14% rewriter_before_opt_a : 0.000101s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000099s : 0.16% jit_opt_a.loop_unroll : 0.000041s : 0.07% jit_opt_a.a_1 : 0.000880s : 1.47% jit_opt_a.with_stream_mark : 0.000047s : 0.08% jit_opt_a.recompute_prepare : 0.000019s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000024s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.001813s : 3.02% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.05% jit_opt_a.cse : 0.000068s : 0.11% jit_opt_a.replace_applicator : 0.000035s : 0.06% py_interpret_to_execute_after_opt_a : 0.000022s : 0.04% rewriter_after_opt_a : 0.000055s : 0.09% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.045157s : 75.30% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.04% jit_opt_b.inline_after_opt_a : 0.000027s : 0.04% cconv : 0.000071s : 0.12% loop_unroll : 0.000998s : 1.66% jit_opt_after_cconv.c_1 : 0.000033s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000057s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000058s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000065s : 0.11% cse_after_recomputation.cse : 0.000016s : 0.03% auto_monad_reorder : 0.000023s : 0.04% get_jit_bprop_graph : 0.000007s : 0.01% rewriter_after_jit_bprop_graph : 0.000015s : 0.02% opt_after_jit_grad : 0.000879s : 1.47% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000153s : 0.26% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000069s : 0.11% Time group info: ------[substitution.] 0.000361 23 1.31% : 0.000005s : 2: substitution.elim_not_effective 0.42% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 3: substitution.graph_param_transform 85.07% : 0.000307s : 4: substitution.inline 1.79% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000007s : 4: substitution.remove_not_recompute_node 2.41% : 0.000009s : 2: substitution.replace_old_param 5.01% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008016 2 72.50% : 0.005812s : 1: type_inference.infer 27.50% : 0.002204s : 1: type_inference.specialize ------[replace.] 0.000116 6 64.97% : 0.000075s : 4: replace.inline 35.03% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000321 6 94.90% : 0.000304s : 4: match.inline 5.10% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 691 1.52% : 0.000002s : 10: predicate.accumulaten_eliminater 1.49% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 0.94% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.09% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.79% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000002s : 10: predicate.depend_value_elim 1.78% : 0.000003s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.87% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.90% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.77% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.57% : 0.000003s : 10: predicate.environ_get_depend_swap 1.02% : 0.000002s : 10: predicate.environ_get_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.31% : 0.000001s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 6.44% : 0.000010s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.87% : 0.000003s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 15: predicate.load_eliminater 2.30% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.80% : 0.000001s : 10: predicate.merge_addn 0.78% : 0.000001s : 10: predicate.minmaximum_grad 5.40% : 0.000009s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 1.78% : 0.000003s : 15: predicate.partial_eliminate 0.90% : 0.000001s : 10: predicate.print_const_string_wrapper 2.20% : 0.000003s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000003s : 18: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.65% : 0.000001s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 10: predicate.reshape_eliminate 0.89% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000002s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.36% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.14% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 16: predicate.switch_defer_inline 1.66% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.19% : 0.000011s : 53: predicate.switch_simplify 0.90% : 0.000001s : 10: predicate.tile_eliminate 0.88% : 0.000001s : 10: predicate.transpose_eliminate 1.17% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000003s : 10: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.15% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.32% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.50% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001225 13 41.37% : 0.000507s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.16% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.47% : 0.000655s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077583 72 0.09% : 0.000069s : 1: add_recomputation 0.12% : 0.000089s : 1: auto_monad 0.03% : 0.000026s : 1: auto_monad_reorder 0.54% : 0.000422s : 1: bootstrap 0.10% : 0.000080s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000010s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.98% : 0.008522s : 1: jit_opt_a 0.31% : 0.000241s : 1: jit_opt_after_cconv 11.25% : 0.008726s : 1: jit_opt_b 1.31% : 0.001015s : 1: loop_unroll 58.26% : 0.045197s : 1: mutable_eliminate 1.54% : 0.001192s : 26: opt.transform.jit_opt_a 0.10% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000042s : 4: opt.transform.jit_opt_b 0.04% : 0.000031s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000058s : 1: opt.transform.mutable_eliminate 0.05% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000188s : 4: opt.transform.symbol_engine_opt 1.15% : 0.000893s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000091s : 1: py_interpret_to_execute 0.03% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000062s : 1: remove_dup_value 1.36% : 0.001059s : 1: renormalize.infer 0.95% : 0.000741s : 1: renormalize.specialize 0.02% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000059s : 1: rewriter_after_opt_a 0.14% : 0.000106s : 1: rewriter_before_opt_a 0.32% : 0.000245s : 1: symbol_engine_optimizer 10.50% : 0.008147s : 1: type_inference TotalTime = 0.034368, [30] [bootstrap]: 0.00036709 [type_inference]: 0.00512454 [event_method]: 2.064e-05 [auto_monad]: 6.958e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 3.775e-05 [rewriter_before_opt_a]: 7.625e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.0261655, [2] [Cycle 1]: 0.0221309, [27] [switch_simplify]: 6.377e-05 [loop_unroll]: 2.939e-05 [a_1]: 0.00056493 [with_stream_mark]: 2.702e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 5.46002e-06 [renormalize]: 0.020998 [add_forward_monad_depend]: 1.479e-05 [auto_monad_grad]: 3.55998e-06 [auto_monad_eliminator]: 3.026e-05 [cse]: 4.352e-05 [replace_applicator]: 2.91e-05 [Cycle 2]: 0.00038531, [27] [switch_simplify]: 7.68001e-06 [loop_unroll]: 5.74e-06 [a_1]: 0.0001096 [with_stream_mark]: 1.881e-05 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.94001e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 3.95998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.258e-05 [j_node_and_user_rematch]: 9.29998e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 4.99e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.00002e-06 [cse]: 1.462e-05 [replace_applicator]: 4.80001e-06 [py_interpret_to_execute_after_opt_a]: 2.34e-05 [rewriter_after_opt_a]: 5.058e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00081162 [jit_opt_b]: 5.293e-05, [1] [Cycle 1]: 4.595e-05, [2] [frontend_op_eliminate]: 1.773e-05 [inline_after_opt_a]: 1.72e-05 [cconv]: 3.433e-05 [loop_unroll]: 0.0004386 [jit_opt_after_cconv]: 0.00016778, [1] [Cycle 1]: 0.00016097, [11] [c_1]: 2.133e-05 [parameter_eliminate]: 3.75e-06 [updatestate_depend_eliminate]: 6.51e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.649e-05 [call_graph_tuple_transform]: 2.051e-05 [tuple_list_get_item_eliminator]: 5.59998e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 8.80013e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.942e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.29999e-06 [add_recomputation]: 5.76e-05 [cse_after_recomputation]: 2.625e-05, [1] [Cycle 1]: 2.023e-05, [1] [cse]: 1.404e-05 [auto_monad_reorder]: 1.741e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 6.61e-06 [opt_after_jit_grad]: 0.00046273 [symbol_engine_optimizer]: 7.364e-05, [1] [Cycle 1]: 6.743e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 2.30008e-07 [validate]: 4.224e-05 Sums bootstrap : 0.000367s : 1.22% type_inference : 0.005125s : 17.05% event_method : 0.000021s : 0.07% auto_monad : 0.000070s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000038s : 0.13% rewriter_before_opt_a : 0.000076s : 0.25% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000675s : 2.24% jit_opt_a.with_stream_mark : 0.000046s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.020998s : 69.87% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.12% jit_opt_a.cse : 0.000058s : 0.19% jit_opt_a.replace_applicator : 0.000034s : 0.11% py_interpret_to_execute_after_opt_a : 0.000023s : 0.08% rewriter_after_opt_a : 0.000051s : 0.17% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000812s : 2.70% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000034s : 0.11% loop_unroll : 0.000439s : 1.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000058s : 0.19% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000463s : 1.54% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.14% Time group info: ------[substitution.] 0.000240 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000005s : 3: substitution.graph_param_transform 84.18% : 0.000202s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000006s : 4: substitution.remove_not_recompute_node 3.14% : 0.000008s : 2: substitution.replace_old_param 4.64% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005050 2 83.02% : 0.004193s : 1: type_inference.infer 16.98% : 0.000857s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.10% : 0.000048s : 4: replace.inline 31.90% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 6 95.22% : 0.000199s : 4: match.inline 4.78% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.52% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.01% : 0.000008s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.80% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.64% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 6: predicate.remove_not_recompute_node 2.08% : 0.000003s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.55% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 16: predicate.switch_defer_inline 1.82% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.02% : 0.000010s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000693 13 55.00% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.33% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.67% : 0.000261s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056344 72 0.11% : 0.000061s : 1: add_recomputation 0.13% : 0.000073s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.69% : 0.000387s : 1: bootstrap 0.07% : 0.000037s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 46.45% : 0.026169s : 1: jit_opt_a 0.30% : 0.000170s : 1: jit_opt_after_cconv 0.10% : 0.000055s : 1: jit_opt_b 0.79% : 0.000447s : 1: loop_unroll 1.46% : 0.000822s : 1: mutable_eliminate 1.65% : 0.000927s : 26: opt.transform.jit_opt_a 0.09% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000040s : 1: py_interpret_to_execute 0.05% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 0.78% : 0.000440s : 1: renormalize.infer 36.46% : 0.020544s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000054s : 1: rewriter_after_opt_a 0.14% : 0.000079s : 1: rewriter_before_opt_a 0.14% : 0.000076s : 1: symbol_engine_optimizer 9.13% : 0.005143s : 1: type_inference TotalTime = 0.25922, [30] [bootstrap]: 0.00050631 [type_inference]: 0.217227 [event_method]: 3.436e-05 [auto_monad]: 0.00010927 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 3.33998e-06 [py_interpret_to_execute]: 0.00081569 [rewriter_before_opt_a]: 0.00015252 [expand_dump_flag]: 5.97001e-06 [jit_opt_a]: 0.0366038, [2] [Cycle 1]: 0.0296123, [27] [switch_simplify]: 9.875e-05 [loop_unroll]: 3.837e-05 [a_1]: 0.00099426 [with_stream_mark]: 2.741e-05 [recompute_prepare]: 1.379e-05 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 3.60998e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 9.52999e-06 [updatestate_useless_node_eliminater]: 7.83999e-06 [accelerated_algorithm]: 8.52998e-06 [meta_shard_fg_expand]: 3.71999e-06 [get_grad_eliminate_]: 8.59002e-06 [merge_forward]: 5.20999e-06 [cell_reuse_recompute_pass]: 1.88002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.995e-05 [j_node_and_user_rematch]: 1.607e-05 [meta_fg_expand]: 4.1e-06 [replace_old_param]: 1.492e-05 [inline_without_move]: 9.77001e-06 [renormalize]: 0.0279209 [add_forward_monad_depend]: 1.366e-05 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.617e-05 [cse]: 4.586e-05 [replace_applicator]: 3.627e-05 [Cycle 2]: 0.00055912, [27] [switch_simplify]: 1.061e-05 [loop_unroll]: 9.40001e-06 [a_1]: 0.0001861 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 5.68002e-06 [updatestate_assign_eliminate]: 3.95998e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 7.93001e-06 [updatestate_useless_node_eliminater]: 7.4e-06 [accelerated_algorithm]: 9.51e-06 [meta_shard_fg_expand]: 3.35e-06 [get_grad_eliminate_]: 7.72998e-06 [merge_forward]: 6.44999e-06 [cell_reuse_recompute_pass]: 5.93998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.386e-05 [j_node_and_user_rematch]: 1.248e-05 [meta_fg_expand]: 4.71002e-06 [replace_old_param]: 1.36e-05 [inline_without_move]: 7.01999e-06 [renormalize]: 2.69996e-07 [add_forward_monad_depend]: 3.38999e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 1.241e-05 [cse]: 2.77e-05 [replace_applicator]: 8.67998e-06 [py_interpret_to_execute_after_opt_a]: 2.353e-05 [rewriter_after_opt_a]: 5.53e-05 [convert_after_rewriter]: 1.062e-05 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00104953 [jit_opt_b]: 8.236e-05, [1] [Cycle 1]: 7.209e-05, [2] [frontend_op_eliminate]: 2.989e-05 [inline_after_opt_a]: 2.608e-05 [cconv]: 3.857e-05 [loop_unroll]: 0.00078791 [jit_opt_after_cconv]: 0.00025255, [1] [Cycle 1]: 0.00024182, [11] [c_1]: 3.657e-05 [parameter_eliminate]: 6.61e-06 [updatestate_depend_eliminate]: 1.286e-05 [updatestate_assign_eliminate]: 3.98001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [cse]: 5.325e-05 [call_graph_tuple_transform]: 3.756e-05 [tuple_list_get_item_eliminator]: 8.95001e-06 [none_parameter_eliminate]: 2.71999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 9.94999e-06 [remove_dup_value]: 2.678e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 1.404e-05 [add_recomputation]: 6.19e-05 [cse_after_recomputation]: 3.935e-05, [1] [Cycle 1]: 2.938e-05, [1] [cse]: 1.852e-05 [auto_monad_reorder]: 2.031e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 1.021e-05 [opt_after_jit_grad]: 0.00080869 [symbol_engine_optimizer]: 0.00010573, [1] [Cycle 1]: 9.663e-05, [6] [build]: 5.34e-06 [elim_shapecalc]: 1.116e-05 [elim_not_effective]: 2.208e-05 [opt_reshape]: 8.75999e-06 [fold_const_symbol]: 1.336e-05 [renormalize]: 8.39995e-07 [validate]: 6.736e-05 Sums bootstrap : 0.000506s : 0.20% type_inference : 0.217227s : 86.23% event_method : 0.000034s : 0.01% auto_monad : 0.000109s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000816s : 0.32% rewriter_before_opt_a : 0.000153s : 0.06% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000109s : 0.04% jit_opt_a.loop_unroll : 0.000048s : 0.02% jit_opt_a.a_1 : 0.001180s : 0.47% jit_opt_a.with_stream_mark : 0.000048s : 0.02% jit_opt_a.recompute_prepare : 0.000023s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.01% jit_opt_a.merge_forward : 0.000012s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000029s : 0.01% jit_opt_a.meta_fg_expand : 0.000009s : 0.00% jit_opt_a.replace_old_param : 0.000029s : 0.01% jit_opt_a.inline_without_move : 0.000017s : 0.01% jit_opt_a.renormalize : 0.027921s : 11.08% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.02% jit_opt_a.cse : 0.000074s : 0.03% jit_opt_a.replace_applicator : 0.000045s : 0.02% py_interpret_to_execute_after_opt_a : 0.000024s : 0.01% rewriter_after_opt_a : 0.000055s : 0.02% convert_after_rewriter : 0.000011s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001050s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.01% jit_opt_b.inline_after_opt_a : 0.000026s : 0.01% cconv : 0.000039s : 0.02% loop_unroll : 0.000788s : 0.31% jit_opt_after_cconv.c_1 : 0.000037s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000053s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.00% remove_dup_value : 0.000027s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.01% add_recomputation : 0.000062s : 0.02% cse_after_recomputation.cse : 0.000019s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000809s : 0.32% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000067s : 0.03% Time group info: ------[substitution.] 0.000411 25 1.03% : 0.000004s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 1.91% : 0.000008s : 4: substitution.graph_param_transform 87.29% : 0.000359s : 5: substitution.inline 1.66% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000007s : 4: substitution.remove_not_recompute_node 1.84% : 0.000008s : 2: substitution.replace_old_param 3.95% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.217050 2 97.90% : 0.212489s : 1: type_inference.infer 2.10% : 0.004560s : 1: type_inference.specialize ------[replace.] 0.000165 7 68.32% : 0.000113s : 5: replace.inline 31.68% : 0.000052s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000369 7 96.05% : 0.000355s : 5: match.inline 3.95% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000217 888 1.62% : 0.000003s : 13: predicate.accumulaten_eliminater 1.02% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000003s : 13: predicate.addn_zero_filter 2.22% : 0.000005s : 13: predicate.arithmetic_simplify 1.98% : 0.000004s : 13: predicate.cast_eliminate 0.33% : 0.000001s : 4: predicate.check_bprop_eliminate 1.71% : 0.000004s : 13: predicate.compare_switch_simplify 1.43% : 0.000003s : 13: predicate.depend_value_elim 1.01% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.90% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.96% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.77% : 0.000002s : 13: predicate.environ_get_depend_swap 1.00% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000003s : 8: predicate.get_grad_eliminate 0.26% : 0.000001s : 4: predicate.graph_param_transform 4.70% : 0.000010s : 28: predicate.inline 0.78% : 0.000002s : 8: predicate.inline_without_move 0.30% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000003s : 8: predicate.less_batch_normalization 1.42% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.40% : 0.000003s : 19: predicate.load_eliminater 2.49% : 0.000005s : 4: predicate.loop_unroll_after_grad 3.25% : 0.000007s : 41: predicate.loop_unroll_before_grad 1.96% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000003s : 13: predicate.minmaximum_grad 2.21% : 0.000005s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 1.78% : 0.000004s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000005s : 13: predicate.reduce_eliminate 1.28% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 8: predicate.remove_not_recompute_node 1.55% : 0.000003s : 23: predicate.replace_applicator 0.49% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.52% : 0.000003s : 13: predicate.reshape_eliminate 1.25% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.77% : 0.000004s : 13: predicate.same_eliminate 0.42% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 0.75% : 0.000002s : 8: predicate.specialize_transform 1.69% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.90% : 0.000006s : 20: predicate.switch_defer_inline 1.60% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.76% : 0.000017s : 65: predicate.switch_simplify 1.40% : 0.000003s : 13: predicate.tile_eliminate 1.21% : 0.000003s : 13: predicate.transpose_eliminate 1.72% : 0.000004s : 13: predicate.tuple_list_convert_item_index_to_positive 1.58% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000009s : 23: predicate.tuple_list_get_item_eliminator 1.98% : 0.000004s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.34% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000006s : 27: predicate.updatestate_useless_node_eliminater 2.22% : 0.000005s : 13: predicate.value_based_eliminate 0.24% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005159 29 65.83% : 0.003396s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.16% : 0.000111s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.01% : 0.001651s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.288792 72 0.02% : 0.000066s : 1: add_recomputation 0.04% : 0.000114s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.18% : 0.000528s : 1: bootstrap 0.01% : 0.000042s : 1: cconv 0.00% : 0.000013s : 1: convert_after_rewriter 0.01% : 0.000042s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.01% : 0.000042s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.68% : 0.036611s : 1: jit_opt_a 0.09% : 0.000256s : 1: jit_opt_after_cconv 0.03% : 0.000086s : 1: jit_opt_b 0.28% : 0.000804s : 1: loop_unroll 0.37% : 0.001067s : 1: mutable_eliminate 0.53% : 0.001544s : 26: opt.transform.jit_opt_a 0.03% : 0.000088s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000046s : 4: opt.transform.jit_opt_b 0.01% : 0.000030s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000031s : 1: opt.transform.mutable_eliminate 0.01% : 0.000042s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000822s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000827s : 1: py_interpret_to_execute 0.01% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000031s : 1: remove_dup_value 9.05% : 0.026125s : 1: renormalize.infer 0.61% : 0.001776s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000059s : 1: rewriter_after_opt_a 0.06% : 0.000160s : 1: rewriter_before_opt_a 0.04% : 0.000109s : 1: symbol_engine_optimizer 75.23% : 0.217260s : 1: type_inference TotalTime = 0.0720104, [30] [bootstrap]: 0.00059736 [type_inference]: 0.0585044 [event_method]: 2.124e-05 [auto_monad]: 0.00107634 [graph_reusing]: 8.18001e-06 [pre_auto_parallel]: 3.55e-06 [py_interpret_to_execute]: 0.00015553 [rewriter_before_opt_a]: 9.762e-05 [expand_dump_flag]: 3.47997e-06 [jit_opt_a]: 0.00871397, [2] [Cycle 1]: 0.00275394, [27] [switch_simplify]: 7.092e-05 [loop_unroll]: 3.013e-05 [a_1]: 0.00064656 [with_stream_mark]: 2.737e-05 [recompute_prepare]: 9.47999e-06 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 3.67002e-06 [updatestate_loads_eliminate]: 3.45998e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 6.45997e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.584e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.71e-06 [renormalize]: 0.00157224 [add_forward_monad_depend]: 1.638e-05 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 3.906e-05 [replace_applicator]: 2.142e-05 [Cycle 2]: 0.00034442, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.46e-06 [a_1]: 9.442e-05 [with_stream_mark]: 1.304e-05 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.444e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.671e-05 [rewriter_after_opt_a]: 9.241e-05 [convert_after_rewriter]: 8.58001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00088675 [jit_opt_b]: 5.487e-05, [1] [Cycle 1]: 4.689e-05, [2] [frontend_op_eliminate]: 1.743e-05 [inline_after_opt_a]: 1.734e-05 [cconv]: 3.198e-05 [loop_unroll]: 0.00050869 [jit_opt_after_cconv]: 0.00016836, [1] [Cycle 1]: 0.0001616, [11] [c_1]: 2.137e-05 [parameter_eliminate]: 3.41999e-06 [updatestate_depend_eliminate]: 7.38999e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.428e-05 [call_graph_tuple_transform]: 2.245e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.775e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 6.732e-05 [cse_after_recomputation]: 4.147e-05, [1] [Cycle 1]: 3.6e-05, [1] [cse]: 1.511e-05 [auto_monad_reorder]: 1.979e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 8.52e-06 [opt_after_jit_grad]: 0.00051311 [symbol_engine_optimizer]: 7.92e-05, [1] [Cycle 1]: 7.235e-05, [6] [build]: 5.39998e-06 [elim_shapecalc]: 9.21998e-06 [elim_not_effective]: 1.319e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 6.09987e-07 [validate]: 5.213e-05 Sums bootstrap : 0.000597s : 0.91% type_inference : 0.058504s : 89.06% event_method : 0.000021s : 0.03% auto_monad : 0.001076s : 1.64% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000156s : 0.24% rewriter_before_opt_a : 0.000098s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000741s : 1.13% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001572s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000054s : 0.08% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000092s : 0.14% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000887s : 1.35% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000032s : 0.05% loop_unroll : 0.000509s : 0.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000067s : 0.10% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000513s : 0.78% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.08% Time group info: ------[substitution.] 0.000290 23 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 3: substitution.graph_param_transform 86.10% : 0.000250s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000006s : 4: substitution.remove_not_recompute_node 2.48% : 0.000007s : 2: substitution.replace_old_param 4.63% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058400 2 96.78% : 0.056518s : 1: type_inference.infer 3.22% : 0.001882s : 1: type_inference.specialize ------[replace.] 0.000082 6 71.16% : 0.000059s : 4: replace.inline 28.84% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 6 95.25% : 0.000247s : 4: match.inline 4.75% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.07% : 0.000001s : 10: predicate.accumulaten_eliminater 1.22% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.60% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.16% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.24% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.13% : 0.000003s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.32% : 0.000002s : 10: predicate.print_const_string_wrapper 1.49% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.90% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.10% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 1.89% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.44% : 0.000002s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.69% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.09% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001027 13 46.81% : 0.000481s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.94% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.25% : 0.000485s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.074611 72 0.10% : 0.000071s : 1: add_recomputation 1.47% : 0.001094s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.84% : 0.000627s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.06% : 0.000044s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 11.69% : 0.008718s : 1: jit_opt_a 0.23% : 0.000171s : 1: jit_opt_after_cconv 0.08% : 0.000058s : 1: jit_opt_b 0.70% : 0.000519s : 1: loop_unroll 1.21% : 0.000901s : 1: mutable_eliminate 1.32% : 0.000988s : 26: opt.transform.jit_opt_a 0.07% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000523s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.21% : 0.000160s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.42% : 0.001060s : 1: renormalize.infer 0.67% : 0.000501s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000096s : 1: rewriter_after_opt_a 0.14% : 0.000103s : 1: rewriter_before_opt_a 0.11% : 0.000082s : 1: symbol_engine_optimizer 78.44% : 0.058527s : 1: type_inference TotalTime = 0.0649883, [30] [bootstrap]: 0.0003096 [type_inference]: 0.0436062 [event_method]: 2.139e-05 [auto_monad]: 6.709e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00010525 [rewriter_before_opt_a]: 8.594e-05 [expand_dump_flag]: 3.30003e-06 [jit_opt_a]: 0.0180411, [2] [Cycle 1]: 0.0137021, [27] [switch_simplify]: 6.517e-05 [loop_unroll]: 2.905e-05 [a_1]: 0.00060049 [with_stream_mark]: 2.504e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.90002e-06 [renormalize]: 0.0125414 [add_forward_monad_depend]: 1.829e-05 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 2.61e-05 [cse]: 4.385e-05 [replace_applicator]: 2.797e-05 [Cycle 2]: 0.00038305, [27] [switch_simplify]: 7.36001e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00011228 [with_stream_mark]: 1.781e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 4.39002e-06 [cell_reuse_recompute_pass]: 3.93001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.925e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 5.54e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 6.50002e-06 [cse]: 1.423e-05 [replace_applicator]: 5.81998e-06 [py_interpret_to_execute_after_opt_a]: 2.358e-05 [rewriter_after_opt_a]: 4.216e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00081421 [jit_opt_b]: 5.165e-05, [1] [Cycle 1]: 4.359e-05, [2] [frontend_op_eliminate]: 1.57e-05 [inline_after_opt_a]: 1.683e-05 [cconv]: 3.248e-05 [loop_unroll]: 0.00044834 [jit_opt_after_cconv]: 0.00016785, [1] [Cycle 1]: 0.00016081, [11] [c_1]: 1.999e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 9.07001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 3.029e-05 [call_graph_tuple_transform]: 2.085e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.615e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 6.19999e-06 [add_recomputation]: 5.437e-05 [cse_after_recomputation]: 2.585e-05, [1] [Cycle 1]: 1.898e-05, [1] [cse]: 1.287e-05 [auto_monad_reorder]: 1.721e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 7.65998e-06 [opt_after_jit_grad]: 0.00065886 [symbol_engine_optimizer]: 8.065e-05, [1] [Cycle 1]: 7.251e-05, [6] [build]: 5.52001e-06 [elim_shapecalc]: 8.13001e-06 [elim_not_effective]: 1.506e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 9.00001e-06 [renormalize]: 1.09e-06 [validate]: 6.739e-05 Sums bootstrap : 0.000310s : 0.51% type_inference : 0.043606s : 72.26% event_method : 0.000021s : 0.04% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000105s : 0.17% rewriter_before_opt_a : 0.000086s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000713s : 1.18% jit_opt_a.with_stream_mark : 0.000043s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.012541s : 20.78% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.05% jit_opt_a.cse : 0.000058s : 0.10% jit_opt_a.replace_applicator : 0.000034s : 0.06% py_interpret_to_execute_after_opt_a : 0.000024s : 0.04% rewriter_after_opt_a : 0.000042s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000814s : 1.35% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000032s : 0.05% loop_unroll : 0.000448s : 0.74% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000659s : 1.09% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000067s : 0.11% Time group info: ------[substitution.] 0.000253 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 85.21% : 0.000216s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000006s : 4: substitution.remove_not_recompute_node 2.65% : 0.000007s : 2: substitution.replace_old_param 4.63% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043519 2 96.24% : 0.041883s : 1: type_inference.infer 3.76% : 0.001636s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.65% : 0.000053s : 4: replace.inline 31.35% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 95.21% : 0.000213s : 4: match.inline 4.79% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 2.13% : 0.000003s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.00% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.35% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.87% : 0.000008s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000002s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000003s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.55% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001082 13 40.33% : 0.000436s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.00% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.67% : 0.000592s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.078516 72 0.07% : 0.000058s : 1: add_recomputation 0.09% : 0.000071s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.42% : 0.000329s : 1: bootstrap 0.04% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 22.98% : 0.018046s : 1: jit_opt_a 0.22% : 0.000171s : 1: jit_opt_after_cconv 0.07% : 0.000054s : 1: jit_opt_b 0.58% : 0.000457s : 1: loop_unroll 1.05% : 0.000827s : 1: mutable_eliminate 1.23% : 0.000964s : 26: opt.transform.jit_opt_a 0.06% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.86% : 0.000672s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000109s : 1: py_interpret_to_execute 0.03% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 15.05% : 0.011813s : 1: renormalize.infer 0.90% : 0.000709s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000046s : 1: rewriter_after_opt_a 0.11% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000084s : 1: symbol_engine_optimizer 55.57% : 0.043630s : 1: type_inference TotalTime = 0.343389, [30] [bootstrap]: 0.00057752 [type_inference]: 0.290901 [event_method]: 2.377e-05 [auto_monad]: 8.105e-05 [graph_reusing]: 7.14001e-06 [pre_auto_parallel]: 3.61999e-06 [py_interpret_to_execute]: 0.0006813 [rewriter_before_opt_a]: 0.00010962 [expand_dump_flag]: 4.28001e-06 [jit_opt_a]: 0.0476351, [2] [Cycle 1]: 0.0423409, [27] [switch_simplify]: 8.562e-05 [loop_unroll]: 3.151e-05 [a_1]: 0.00082051 [with_stream_mark]: 2.515e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.74002e-06 [parameter_eliminate]: 2.42001e-06 [specialize_transform]: 8.89e-06 [updatestate_useless_node_eliminater]: 6.71999e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 7.77e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.636e-05 [j_node_and_user_rematch]: 1.16e-05 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.215e-05 [inline_without_move]: 6.07001e-06 [renormalize]: 0.0408962 [add_forward_monad_depend]: 1.732e-05 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.632e-05 [cse]: 3.95e-05 [replace_applicator]: 3.1e-05 [Cycle 2]: 0.00044316, [27] [switch_simplify]: 7.71001e-06 [loop_unroll]: 7.58999e-06 [a_1]: 0.00014877 [with_stream_mark]: 1.884e-05 [recompute_prepare]: 6.78e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 4.93001e-06 [cell_reuse_recompute_pass]: 3.91999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.14e-05 [j_node_and_user_rematch]: 1.171e-05 [meta_fg_expand]: 3.18998e-06 [replace_old_param]: 1.23e-05 [inline_without_move]: 6.32001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 1.66998e-06 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.604e-05 [replace_applicator]: 7.21001e-06 [py_interpret_to_execute_after_opt_a]: 2.366e-05 [rewriter_after_opt_a]: 4.439e-05 [convert_after_rewriter]: 7.44002e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.0010077 [jit_opt_b]: 6.774e-05, [1] [Cycle 1]: 5.719e-05, [2] [frontend_op_eliminate]: 2.456e-05 [inline_after_opt_a]: 2.015e-05 [cconv]: 3.819e-05 [loop_unroll]: 0.00059757 [jit_opt_after_cconv]: 0.0001968, [1] [Cycle 1]: 0.00018818, [11] [c_1]: 2.997e-05 [parameter_eliminate]: 5.79e-06 [updatestate_depend_eliminate]: 9.76e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 3.751e-05 [call_graph_tuple_transform]: 2.861e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 7.7e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.645e-05 [partial_unused_args_eliminate]: 3.88001e-06 [environ_conv]: 1.304e-05 [add_recomputation]: 5.87e-05 [cse_after_recomputation]: 2.658e-05, [1] [Cycle 1]: 2.031e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.666e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 1.048e-05 [opt_after_jit_grad]: 0.00065545 [symbol_engine_optimizer]: 0.0002402, [1] [Cycle 1]: 0.00023187, [6] [build]: 5.76998e-06 [elim_shapecalc]: 9.62999e-06 [elim_not_effective]: 1.85e-05 [opt_reshape]: 8.17e-06 [fold_const_symbol]: 0.00015558 [renormalize]: 5.79981e-07 [validate]: 7.254e-05 Sums bootstrap : 0.000578s : 0.17% type_inference : 0.290901s : 86.13% event_method : 0.000024s : 0.01% auto_monad : 0.000081s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000681s : 0.20% rewriter_before_opt_a : 0.000110s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.03% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000969s : 0.29% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.040896s : 12.11% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000038s : 0.01% py_interpret_to_execute_after_opt_a : 0.000024s : 0.01% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001008s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000038s : 0.01% loop_unroll : 0.000598s : 0.18% jit_opt_after_cconv.c_1 : 0.000030s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000059s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000655s : 0.19% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000156s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000073s : 0.02% Time group info: ------[substitution.] 0.000335 24 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000008s : 4: substitution.graph_param_transform 85.41% : 0.000286s : 4: substitution.inline 1.91% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000007s : 4: substitution.remove_not_recompute_node 2.66% : 0.000009s : 2: substitution.replace_old_param 4.46% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.290760 2 98.82% : 0.287328s : 1: type_inference.infer 1.18% : 0.003431s : 1: type_inference.specialize ------[replace.] 0.000116 6 66.10% : 0.000077s : 4: replace.inline 33.90% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 6 95.48% : 0.000283s : 4: match.inline 4.52% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 2.31% : 0.000004s : 12: predicate.arithmetic_simplify 1.55% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 0.87% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.49% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.83% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.00% : 0.000008s : 26: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.93% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 18: predicate.load_eliminater 1.86% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.23% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.45% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 12: predicate.merge_addn 1.01% : 0.000002s : 12: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 1.98% : 0.000003s : 18: predicate.partial_eliminate 1.08% : 0.000002s : 12: predicate.print_const_string_wrapper 2.15% : 0.000003s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.68% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.98% : 0.000002s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000002s : 8: predicate.specialize_transform 1.58% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.01% : 0.000010s : 58: predicate.switch_simplify 1.51% : 0.000002s : 12: predicate.tile_eliminate 1.57% : 0.000003s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.97% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.45% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000003s : 12: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005654 34 61.51% : 0.003478s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.09% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.40% : 0.002115s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.385748 72 0.02% : 0.000062s : 1: add_recomputation 0.02% : 0.000085s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 0.16% : 0.000609s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.35% : 0.047640s : 1: jit_opt_a 0.05% : 0.000200s : 1: jit_opt_after_cconv 0.02% : 0.000071s : 1: jit_opt_b 0.16% : 0.000611s : 1: loop_unroll 0.26% : 0.001022s : 1: mutable_eliminate 0.33% : 0.001271s : 26: opt.transform.jit_opt_a 0.02% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000187s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000668s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000690s : 1: py_interpret_to_execute 0.01% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 9.99% : 0.038525s : 1: renormalize.infer 0.61% : 0.002351s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.03% : 0.000117s : 1: rewriter_before_opt_a 0.06% : 0.000244s : 1: symbol_engine_optimizer 75.42% : 0.290930s : 1: type_inference TotalTime = 0.114696, [30] [bootstrap]: 0.00047351 [type_inference]: 0.103806 [event_method]: 3.311e-05 [auto_monad]: 0.00010276 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 0.00025016 [rewriter_before_opt_a]: 0.00010734 [expand_dump_flag]: 4.73001e-06 [jit_opt_a]: 0.00731786, [2] [Cycle 1]: 0.00233212, [27] [switch_simplify]: 6.736e-05 [loop_unroll]: 3.485e-05 [a_1]: 0.00059947 [with_stream_mark]: 2.616e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.81998e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.698e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 9.54999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00117193 [add_forward_monad_depend]: 5.555e-05 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.876e-05 [cse]: 4.084e-05 [replace_applicator]: 1.596e-05 [Cycle 2]: 0.00034418, [27] [switch_simplify]: 7e-06 [loop_unroll]: 5.67001e-06 [a_1]: 9.661e-05 [with_stream_mark]: 1.107e-05 [recompute_prepare]: 5.69999e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.19999e-06 [cse]: 1.457e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.653e-05 [rewriter_after_opt_a]: 4.422e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00079917 [jit_opt_b]: 5.47e-05, [1] [Cycle 1]: 4.605e-05, [2] [frontend_op_eliminate]: 1.723e-05 [inline_after_opt_a]: 1.698e-05 [cconv]: 3.274e-05 [loop_unroll]: 0.00050596 [jit_opt_after_cconv]: 0.00015904, [1] [Cycle 1]: 0.00015149, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 3.2e-06 [updatestate_depend_eliminate]: 6.79999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 2.988e-05 [call_graph_tuple_transform]: 2.093e-05 [tuple_list_get_item_eliminator]: 5.56998e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 7.49977e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.87e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 7.28e-06 [add_recomputation]: 5.502e-05 [cse_after_recomputation]: 2.375e-05, [1] [Cycle 1]: 1.792e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.86999e-06 [rewriter_after_jit_bprop_graph]: 6.91999e-06 [opt_after_jit_grad]: 0.00049647 [symbol_engine_optimizer]: 7.634e-05, [1] [Cycle 1]: 6.962e-05, [6] [build]: 4.60999e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.10002e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.59985e-07 [validate]: 4.548e-05 Sums bootstrap : 0.000474s : 0.43% type_inference : 0.103806s : 94.89% event_method : 0.000033s : 0.03% auto_monad : 0.000103s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000250s : 0.23% rewriter_before_opt_a : 0.000107s : 0.10% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000696s : 0.64% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001172s : 1.07% jit_opt_a.add_forward_monad_depend : 0.000057s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000055s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000799s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000506s : 0.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000496s : 0.45% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000256 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 85.37% : 0.000218s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000006s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 4.70% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103603 2 20.60% : 0.021341s : 1: type_inference.infer 79.40% : 0.082262s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.65% : 0.000054s : 4: replace.inline 30.35% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 95.20% : 0.000216s : 4: match.inline 4.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.60% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 2.01% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 2.33% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.57% : 0.000011s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000920 13 46.17% : 0.000425s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.89% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.93% : 0.000441s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116855 72 0.05% : 0.000058s : 1: add_recomputation 0.09% : 0.000107s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.42% : 0.000493s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000040s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.27% : 0.007322s : 1: jit_opt_a 0.14% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.44% : 0.000516s : 1: loop_unroll 0.69% : 0.000811s : 1: mutable_eliminate 0.81% : 0.000941s : 26: opt.transform.jit_opt_a 0.04% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000505s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000255s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.60% : 0.000701s : 1: renormalize.infer 0.39% : 0.000461s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000048s : 1: rewriter_after_opt_a 0.10% : 0.000112s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.86% : 0.103833s : 1: type_inference TotalTime = 0.190367, [30] [bootstrap]: 0.00042735 [type_inference]: 0.0123563 [event_method]: 2.883e-05 [auto_monad]: 8.979e-05 [graph_reusing]: 6.76999e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 9.419e-05 [rewriter_before_opt_a]: 0.0001149 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.174021, [2] [Cycle 1]: 0.136278, [27] [switch_simplify]: 0.00015094 [loop_unroll]: 3.57e-05 [a_1]: 0.00102032 [with_stream_mark]: 3.122e-05 [recompute_prepare]: 1.481e-05 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 3.91001e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 3.04999e-06 [specialize_transform]: 9.09998e-06 [updatestate_useless_node_eliminater]: 9.27999e-06 [accelerated_algorithm]: 8.88002e-06 [meta_shard_fg_expand]: 3.93001e-06 [get_grad_eliminate_]: 9.23002e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 2.48998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.093e-05 [j_node_and_user_rematch]: 1.504e-05 [meta_fg_expand]: 4.15e-06 [replace_old_param]: 1.655e-05 [inline_without_move]: 8.94003e-06 [renormalize]: 0.134486 [add_forward_monad_depend]: 1.294e-05 [auto_monad_grad]: 3.06001e-06 [auto_monad_eliminator]: 2.396e-05 [cse]: 4.935e-05 [replace_applicator]: 3.194e-05 [Cycle 2]: 0.00043901, [27] [switch_simplify]: 9.28002e-06 [loop_unroll]: 7.66999e-06 [a_1]: 0.00013534 [with_stream_mark]: 1.85e-05 [recompute_prepare]: 6.42001e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.86999e-06 [updatestate_loads_eliminate]: 3.63999e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 3.18e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.69998e-06 [cell_reuse_recompute_pass]: 4.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.177e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 3.35e-06 [replace_old_param]: 1.172e-05 [inline_without_move]: 5.69e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.63001e-06 [cse]: 1.804e-05 [replace_applicator]: 6.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.946e-05 [rewriter_after_opt_a]: 4.822e-05 [convert_after_rewriter]: 8.59e-06 [order_py_execute_after_rewriter]: 5.65001e-06 [mutable_eliminate]: 0.00106162 [jit_opt_b]: 7.682e-05, [1] [Cycle 1]: 6.35e-05, [2] [frontend_op_eliminate]: 2.666e-05 [inline_after_opt_a]: 2.107e-05 [cconv]: 3.864e-05 [loop_unroll]: 0.00061046 [jit_opt_after_cconv]: 0.00018999, [1] [Cycle 1]: 0.00018129, [11] [c_1]: 2.529e-05 [parameter_eliminate]: 4.53001e-06 [updatestate_depend_eliminate]: 1.054e-05 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 4.024e-05 [call_graph_tuple_transform]: 2.756e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.46999e-06 [remove_dup_value]: 5.47e-05 [partial_unused_args_eliminate]: 4.28001e-06 [environ_conv]: 7.18e-06 [add_recomputation]: 6.132e-05 [cse_after_recomputation]: 2.825e-05, [1] [Cycle 1]: 2.188e-05, [1] [cse]: 1.549e-05 [auto_monad_reorder]: 2.154e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 1.182e-05 [opt_after_jit_grad]: 0.00054366 [symbol_engine_optimizer]: 9.142e-05, [1] [Cycle 1]: 8.362e-05, [6] [build]: 5.94e-06 [elim_shapecalc]: 9.32001e-06 [elim_not_effective]: 1.688e-05 [opt_reshape]: 8.05e-06 [fold_const_symbol]: 1.284e-05 [renormalize]: 5.00004e-07 [validate]: 5.505e-05 Sums bootstrap : 0.000427s : 0.28% type_inference : 0.012356s : 8.12% event_method : 0.000029s : 0.02% auto_monad : 0.000090s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000094s : 0.06% rewriter_before_opt_a : 0.000115s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000160s : 0.11% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001156s : 0.76% jit_opt_a.with_stream_mark : 0.000050s : 0.03% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000028s : 0.02% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.134486s : 88.34% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000067s : 0.04% jit_opt_a.replace_applicator : 0.000038s : 0.03% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001062s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000039s : 0.03% loop_unroll : 0.000610s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000055s : 0.04% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000061s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000022s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000544s : 0.36% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.04% Time group info: ------[substitution.] 0.000449 24 0.59% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.76% : 0.000008s : 3: substitution.graph_param_transform 88.29% : 0.000396s : 5: substitution.inline 1.52% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.57% : 0.000007s : 4: substitution.remove_not_recompute_node 1.95% : 0.000009s : 2: substitution.replace_old_param 3.77% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012177 2 86.09% : 0.010483s : 1: type_inference.infer 13.91% : 0.001694s : 1: type_inference.specialize ------[replace.] 0.000162 7 64.60% : 0.000105s : 5: replace.inline 35.40% : 0.000057s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000407 7 96.15% : 0.000392s : 5: match.inline 3.85% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000221 747 1.50% : 0.000003s : 11: predicate.accumulaten_eliminater 0.67% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.83% : 0.000002s : 11: predicate.addn_check_dump 1.21% : 0.000003s : 11: predicate.addn_zero_filter 2.27% : 0.000005s : 11: predicate.arithmetic_simplify 1.37% : 0.000003s : 11: predicate.cast_eliminate 0.65% : 0.000001s : 3: predicate.check_bprop_eliminate 0.84% : 0.000002s : 11: predicate.compare_switch_simplify 0.97% : 0.000002s : 11: predicate.depend_value_elim 0.87% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000003s : 11: predicate.dict_get_item_eliminator 1.62% : 0.000004s : 11: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000001s : 3: predicate.elim_not_effective 0.40% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000003s : 11: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 11: predicate.environ_get_depend_swap 1.36% : 0.000003s : 11: predicate.environ_get_eliminate 1.03% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000003s : 6: predicate.get_grad_eliminate 0.11% : 0.000000s : 3: predicate.graph_param_transform 4.12% : 0.000009s : 24: predicate.inline 0.49% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000003s : 6: predicate.less_batch_normalization 1.55% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.97% : 0.000004s : 16: predicate.load_eliminater 0.98% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.96% : 0.000007s : 38: predicate.loop_unroll_before_grad 1.74% : 0.000004s : 14: predicate.make_slice_get_slice_eliminator 0.94% : 0.000002s : 11: predicate.merge_addn 1.13% : 0.000002s : 11: predicate.minmaximum_grad 2.00% : 0.000004s : 3: predicate.mutable_eliminate 0.34% : 0.000001s : 3: predicate.opt_reshape 1.39% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000003s : 11: predicate.print_const_string_wrapper 2.88% : 0.000006s : 11: predicate.reduce_eliminate 1.49% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.22% : 0.000003s : 19: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000003s : 11: predicate.reshape_eliminate 1.28% : 0.000003s : 11: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 3: predicate.row_tensor_eliminate 1.08% : 0.000002s : 11: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 6: predicate.special_op_eliminate 0.53% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 1.02% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.24% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000005s : 18: predicate.switch_defer_inline 1.55% : 0.000003s : 18: predicate.switch_layer_defer_inline 15.93% : 0.000035s : 59: predicate.switch_simplify 1.15% : 0.000003s : 11: predicate.tile_eliminate 1.30% : 0.000003s : 11: predicate.transpose_eliminate 1.30% : 0.000003s : 11: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000003s : 11: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000008s : 19: predicate.tuple_list_get_item_eliminator 2.14% : 0.000005s : 11: predicate.tuple_list_set_item_eliminator 1.63% : 0.000004s : 13: predicate.tuple_to_list_eliminator_ 1.23% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 2.58% : 0.000006s : 22: predicate.updatestate_useless_node_eliminater 1.96% : 0.000004s : 11: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001490 16 41.80% : 0.000623s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.08% : 0.000120s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.12% : 0.000747s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.326450 72 0.02% : 0.000065s : 1: add_recomputation 0.03% : 0.000095s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.14% : 0.000445s : 1: bootstrap 0.01% : 0.000042s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000074s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 53.31% : 0.174027s : 1: jit_opt_a 0.06% : 0.000193s : 1: jit_opt_after_cconv 0.02% : 0.000080s : 1: jit_opt_b 0.19% : 0.000621s : 1: loop_unroll 0.33% : 0.001078s : 1: mutable_eliminate 0.47% : 0.001533s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000554s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000098s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000058s : 1: remove_dup_value 40.92% : 0.133578s : 1: renormalize.infer 0.27% : 0.000886s : 1: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000051s : 1: rewriter_after_opt_a 0.04% : 0.000121s : 1: rewriter_before_opt_a 0.03% : 0.000094s : 1: symbol_engine_optimizer 3.79% : 0.012387s : 1: type_inference TotalTime = 0.464533, [30] [bootstrap]: 0.00038947 [type_inference]: 0.399026 [event_method]: 3.738e-05 [auto_monad]: 9.865e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 3.84002e-06 [py_interpret_to_execute]: 0.00130092 [rewriter_before_opt_a]: 0.0001332 [expand_dump_flag]: 4.41002e-06 [jit_opt_a]: 0.060568, [2] [Cycle 1]: 0.00739492, [27] [switch_simplify]: 0.00010127 [loop_unroll]: 3.192e-05 [a_1]: 0.00075263 [with_stream_mark]: 2.539e-05 [recompute_prepare]: 1.29e-05 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 8.32e-06 [updatestate_useless_node_eliminater]: 8.64e-06 [accelerated_algorithm]: 8.94e-06 [meta_shard_fg_expand]: 3.95e-06 [get_grad_eliminate_]: 7.68001e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.007e-05 [j_node_and_user_rematch]: 1.223e-05 [meta_fg_expand]: 3.06999e-06 [replace_old_param]: 1.259e-05 [inline_without_move]: 7.86001e-06 [renormalize]: 0.00600791 [add_forward_monad_depend]: 8.72e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 2.342e-05 [cse]: 4.842e-05 [replace_applicator]: 2.383e-05 [Cycle 2]: 0.00043899, [27] [switch_simplify]: 8.44002e-06 [loop_unroll]: 8.67e-06 [a_1]: 0.00015546 [with_stream_mark]: 1.218e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 7.16999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 6.68998e-06 [merge_forward]: 3.34001e-06 [cell_reuse_recompute_pass]: 3.85e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.686e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 3.26999e-06 [replace_old_param]: 1.061e-05 [inline_without_move]: 6.36e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 6.80002e-06 [cse]: 1.829e-05 [replace_applicator]: 6.79999e-06 [py_interpret_to_execute_after_opt_a]: 2.276e-05 [rewriter_after_opt_a]: 5.207e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.76e-06 [mutable_eliminate]: 0.00088395 [jit_opt_b]: 6.623e-05, [1] [Cycle 1]: 5.782e-05, [2] [frontend_op_eliminate]: 2.318e-05 [inline_after_opt_a]: 2.1e-05 [cconv]: 2.962e-05 [loop_unroll]: 0.00050659 [jit_opt_after_cconv]: 0.0001842, [1] [Cycle 1]: 0.00017706, [11] [c_1]: 2.937e-05 [parameter_eliminate]: 3.38e-06 [updatestate_depend_eliminate]: 8.1e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 3.346e-05 [call_graph_tuple_transform]: 2.578e-05 [tuple_list_get_item_eliminator]: 7.71999e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 8.45999e-06 [remove_dup_value]: 2.108e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 1.092e-05 [add_recomputation]: 5.698e-05 [cse_after_recomputation]: 2.819e-05, [1] [Cycle 1]: 2.184e-05, [1] [cse]: 1.609e-05 [auto_monad_reorder]: 1.961e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 8.59998e-06 [opt_after_jit_grad]: 0.00058557 [symbol_engine_optimizer]: 8.611e-05, [1] [Cycle 1]: 7.964e-05, [6] [build]: 5.69e-06 [elim_shapecalc]: 9.29998e-06 [elim_not_effective]: 1.44e-05 [opt_reshape]: 8.32e-06 [fold_const_symbol]: 1.149e-05 [renormalize]: 3.39991e-07 [validate]: 0.0001262 Sums bootstrap : 0.000389s : 0.09% type_inference : 0.399026s : 97.08% event_method : 0.000037s : 0.01% auto_monad : 0.000099s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.001301s : 0.32% rewriter_before_opt_a : 0.000133s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000110s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000908s : 0.22% jit_opt_a.with_stream_mark : 0.000038s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.006008s : 1.46% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000067s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000023s : 0.01% rewriter_after_opt_a : 0.000052s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000884s : 0.22% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000507s : 0.12% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000020s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000586s : 0.14% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000126s : 0.03% Time group info: ------[substitution.] 0.000310 24 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000007s : 4: substitution.graph_param_transform 85.45% : 0.000265s : 4: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000008s : 4: substitution.remove_not_recompute_node 2.08% : 0.000006s : 2: substitution.replace_old_param 5.01% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.398874 2 98.53% : 0.393019s : 1: type_inference.infer 1.47% : 0.005855s : 1: type_inference.specialize ------[replace.] 0.000114 6 68.23% : 0.000078s : 4: replace.inline 31.77% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000276 6 94.90% : 0.000262s : 4: match.inline 5.10% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 830 1.67% : 0.000003s : 12: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.92% : 0.000001s : 12: predicate.addn_check_dump 1.90% : 0.000003s : 12: predicate.addn_zero_filter 2.11% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.29% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_depend_swap 1.64% : 0.000003s : 12: predicate.environ_get_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.48% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000008s : 26: predicate.inline 1.06% : 0.000002s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.63% : 0.000003s : 8: predicate.less_batch_normalization 1.70% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 18: predicate.load_eliminater 1.63% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.93% : 0.000003s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.22% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 12: predicate.reshape_eliminate 1.08% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.98% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.74% : 0.000004s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.39% : 0.000010s : 58: predicate.switch_simplify 1.56% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.96% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.36% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003765 22 55.82% : 0.002102s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.86% : 0.001614s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.471742 72 0.01% : 0.000061s : 1: add_recomputation 0.02% : 0.000104s : 1: auto_monad 0.00% : 0.000022s : 1: auto_monad_reorder 0.09% : 0.000414s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000045s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.84% : 0.060572s : 1: jit_opt_a 0.04% : 0.000187s : 1: jit_opt_after_cconv 0.01% : 0.000069s : 1: jit_opt_b 0.11% : 0.000515s : 1: loop_unroll 0.19% : 0.000894s : 1: mutable_eliminate 0.26% : 0.001221s : 26: opt.transform.jit_opt_a 0.01% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000595s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.28% : 0.001315s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000023s : 1: remove_dup_value 0.90% : 0.004224s : 1: renormalize.infer 0.37% : 0.001766s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000055s : 1: rewriter_after_opt_a 0.03% : 0.000139s : 1: rewriter_before_opt_a 0.02% : 0.000089s : 1: symbol_engine_optimizer 84.59% : 0.399059s : 1: type_inference TotalTime = 0.0575689, [30] [bootstrap]: 0.00034988 [type_inference]: 0.0467112 [event_method]: 2.192e-05 [auto_monad]: 8.208e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 3.58e-06 [py_interpret_to_execute]: 0.00012975 [rewriter_before_opt_a]: 8.744e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.00769329, [2] [Cycle 1]: 0.00231338, [27] [switch_simplify]: 6.785e-05 [loop_unroll]: 3.114e-05 [a_1]: 0.00062476 [with_stream_mark]: 2.489e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 6.08998e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.71e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00120327 [add_forward_monad_depend]: 6.51999e-06 [auto_monad_grad]: 2.09999e-06 [auto_monad_eliminator]: 1.642e-05 [cse]: 2.799e-05 [replace_applicator]: 1.48e-05 [Cycle 2]: 0.00034319, [27] [switch_simplify]: 5.89999e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.636e-05 [with_stream_mark]: 1.308e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 3.27002e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.342e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.51998e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.452e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.274e-05 [rewriter_after_opt_a]: 3.661e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 4.35e-06 [mutable_eliminate]: 0.00079857 [jit_opt_b]: 5.401e-05, [1] [Cycle 1]: 4.721e-05, [2] [frontend_op_eliminate]: 1.743e-05 [inline_after_opt_a]: 1.757e-05 [cconv]: 2.148e-05 [loop_unroll]: 0.00046016 [jit_opt_after_cconv]: 0.00017076, [1] [Cycle 1]: 0.00016391, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.513e-05 [call_graph_tuple_transform]: 1.811e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.64001e-06 [remove_dup_value]: 1.158e-05 [partial_unused_args_eliminate]: 1.76e-06 [environ_conv]: 5.42001e-06 [add_recomputation]: 3.951e-05 [cse_after_recomputation]: 2.552e-05, [1] [Cycle 1]: 1.943e-05, [1] [cse]: 1.347e-05 [auto_monad_reorder]: 1.337e-05 [get_jit_bprop_graph]: 1.63002e-06 [rewriter_after_jit_bprop_graph]: 7.16001e-06 [opt_after_jit_grad]: 0.00049805 [symbol_engine_optimizer]: 7.867e-05, [1] [Cycle 1]: 7.242e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 8.09002e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 4.09986e-07 [validate]: 3.823e-05 Sums bootstrap : 0.000350s : 0.67% type_inference : 0.046711s : 90.02% event_method : 0.000022s : 0.04% auto_monad : 0.000082s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000130s : 0.25% rewriter_before_opt_a : 0.000087s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.14% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000721s : 1.39% jit_opt_a.with_stream_mark : 0.000038s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001203s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000043s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000799s : 1.54% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000021s : 0.04% loop_unroll : 0.000460s : 0.89% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000040s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000498s : 0.96% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.07% Time group info: ------[substitution.] 0.000255 23 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 1.75% : 0.000004s : 3: substitution.graph_param_transform 86.08% : 0.000220s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_old_param 5.04% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046611 2 95.84% : 0.044670s : 1: type_inference.infer 4.16% : 0.001941s : 1: type_inference.specialize ------[replace.] 0.000093 6 68.83% : 0.000064s : 4: replace.inline 31.17% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.86% : 0.000217s : 4: match.inline 5.14% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.70% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.58% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.41% : 0.000003s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.78% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.44% : 0.000002s : 10: predicate.print_const_string_wrapper 2.24% : 0.000003s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.60% : 0.000002s : 10: predicate.reshape_eliminate 1.05% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.51% : 0.000002s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.49% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001075 13 47.92% : 0.000515s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.87% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.20% : 0.000518s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059796 72 0.07% : 0.000042s : 1: add_recomputation 0.14% : 0.000086s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.63% : 0.000376s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 12.87% : 0.007697s : 1: jit_opt_a 0.29% : 0.000173s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.78% : 0.000468s : 1: loop_unroll 1.35% : 0.000809s : 1: mutable_eliminate 1.61% : 0.000961s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.85% : 0.000507s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.22% : 0.000134s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 1.23% : 0.000738s : 1: renormalize.infer 0.76% : 0.000457s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.15% : 0.000092s : 1: rewriter_before_opt_a 0.14% : 0.000082s : 1: symbol_engine_optimizer 78.14% : 0.046727s : 1: type_inference TotalTime = 0.102767, [30] [bootstrap]: 0.00034459 [type_inference]: 0.0223967 [event_method]: 2.096e-05 [auto_monad]: 6.443e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00014869 [rewriter_before_opt_a]: 8.52e-05 [expand_dump_flag]: 3.32002e-06 [jit_opt_a]: 0.0771959, [2] [Cycle 1]: 0.0731166, [27] [switch_simplify]: 6.49e-05 [loop_unroll]: 8.211e-05 [a_1]: 0.00058932 [with_stream_mark]: 2.255e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.46002e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.78002e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.58002e-06 [inline_without_move]: 5.78002e-06 [renormalize]: 0.0719266 [add_forward_monad_depend]: 1.274e-05 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 2.599e-05 [cse]: 4.298e-05 [replace_applicator]: 2.735e-05 [Cycle 2]: 0.00037057, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.86998e-06 [a_1]: 0.00010656 [with_stream_mark]: 1.866e-05 [recompute_prepare]: 5.67001e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.72002e-06 [cell_reuse_recompute_pass]: 3.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.818e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.47999e-06 [inline_without_move]: 5.12e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.70998e-06 [cse]: 1.347e-05 [replace_applicator]: 5.40001e-06 [py_interpret_to_execute_after_opt_a]: 2.066e-05 [rewriter_after_opt_a]: 3.968e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.68997e-06 [mutable_eliminate]: 0.00081763 [jit_opt_b]: 5.337e-05, [1] [Cycle 1]: 4.416e-05, [2] [frontend_op_eliminate]: 1.617e-05 [inline_after_opt_a]: 1.613e-05 [cconv]: 3.34e-05 [loop_unroll]: 0.00043324 [jit_opt_after_cconv]: 0.00015563, [1] [Cycle 1]: 0.00014858, [11] [c_1]: 2.039e-05 [parameter_eliminate]: 3.6e-06 [updatestate_depend_eliminate]: 7.94002e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 2.767e-05 [call_graph_tuple_transform]: 2.058e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 1.719e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 6.44001e-06 [add_recomputation]: 7.905e-05 [cse_after_recomputation]: 2.627e-05, [1] [Cycle 1]: 2.047e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.83e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 7.91001e-06 [opt_after_jit_grad]: 0.00046337 [symbol_engine_optimizer]: 7.33e-05, [1] [Cycle 1]: 6.644e-05, [6] [build]: 4.29002e-06 [elim_shapecalc]: 7.31999e-06 [elim_not_effective]: 1.292e-05 [opt_reshape]: 6.05002e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 4.60015e-07 [validate]: 4.602e-05 Sums bootstrap : 0.000345s : 0.35% type_inference : 0.022397s : 22.76% event_method : 0.000021s : 0.02% auto_monad : 0.000064s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000149s : 0.15% rewriter_before_opt_a : 0.000085s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.07% jit_opt_a.loop_unroll : 0.000088s : 0.09% jit_opt_a.a_1 : 0.000696s : 0.71% jit_opt_a.with_stream_mark : 0.000041s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.071927s : 73.09% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.03% jit_opt_a.cse : 0.000056s : 0.06% jit_opt_a.replace_applicator : 0.000033s : 0.03% py_interpret_to_execute_after_opt_a : 0.000021s : 0.02% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000818s : 0.83% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000433s : 0.44% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000079s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000463s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.05% Time group info: ------[substitution.] 0.000252 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 3: substitution.graph_param_transform 84.58% : 0.000213s : 4: substitution.inline 1.86% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 2.64% : 0.000007s : 2: substitution.replace_old_param 5.03% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022328 2 92.54% : 0.020663s : 1: type_inference.infer 7.46% : 0.001665s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.14% : 0.000053s : 4: replace.inline 31.86% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.81% : 0.000211s : 4: match.inline 5.19% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.53% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.94% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.52% : 0.000002s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.02% : 0.000001s : 10: predicate.depend_value_elim 1.35% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.57% : 0.000001s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.33% : 0.000002s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.94% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.64% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.79% : 0.000009s : 53: predicate.switch_simplify 1.46% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001030 13 39.35% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.16% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.49% : 0.000571s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.175725 72 0.05% : 0.000083s : 1: add_recomputation 0.04% : 0.000068s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000364s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 43.93% : 0.077200s : 1: jit_opt_a 0.09% : 0.000158s : 1: jit_opt_after_cconv 0.03% : 0.000056s : 1: jit_opt_b 0.25% : 0.000442s : 1: loop_unroll 0.47% : 0.000832s : 1: mutable_eliminate 0.57% : 0.000995s : 26: opt.transform.jit_opt_a 0.03% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000472s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000153s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 40.52% : 0.071208s : 1: renormalize.infer 0.40% : 0.000699s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000089s : 1: rewriter_before_opt_a 0.04% : 0.000076s : 1: symbol_engine_optimizer 12.76% : 0.022414s : 1: type_inference TotalTime = 0.139188, [30] [bootstrap]: 0.00054213 [type_inference]: 0.0929829 [event_method]: 2.809e-05 [auto_monad]: 9.472e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 3.25e-06 [py_interpret_to_execute]: 0.00055146 [rewriter_before_opt_a]: 0.00016407 [expand_dump_flag]: 4.3e-06 [jit_opt_a]: 0.0413734, [2] [Cycle 1]: 0.0316342, [27] [switch_simplify]: 8.505e-05 [loop_unroll]: 3.276e-05 [a_1]: 0.00079549 [with_stream_mark]: 2.918e-05 [recompute_prepare]: 1.069e-05 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 4.07e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.33998e-06 [specialize_transform]: 7.46001e-06 [updatestate_useless_node_eliminater]: 7.18e-06 [accelerated_algorithm]: 7.49002e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 7.13e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 1.76998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.835e-05 [j_node_and_user_rematch]: 1.202e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.272e-05 [inline_without_move]: 6.91001e-06 [renormalize]: 0.0302095 [add_forward_monad_depend]: 1.337e-05 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 2.717e-05 [cse]: 3.814e-05 [replace_applicator]: 2.809e-05 [Cycle 2]: 0.0004462, [27] [switch_simplify]: 8.10999e-06 [loop_unroll]: 7.28e-06 [a_1]: 0.00014563 [with_stream_mark]: 1.991e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 2.54999e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 6.40002e-06 [accelerated_algorithm]: 7.51001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 4.18999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.274e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 3.04999e-06 [replace_old_param]: 1.161e-05 [inline_without_move]: 5.76003e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.83002e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 9.81e-06 [cse]: 1.421e-05 [replace_applicator]: 7.01001e-06 [py_interpret_to_execute_after_opt_a]: 1.948e-05 [rewriter_after_opt_a]: 4.617e-05 [convert_after_rewriter]: 8.00999e-06 [order_py_execute_after_rewriter]: 5.46002e-06 [mutable_eliminate]: 0.00104278 [jit_opt_b]: 7.403e-05, [1] [Cycle 1]: 6.279e-05, [2] [frontend_op_eliminate]: 2.746e-05 [inline_after_opt_a]: 2.206e-05 [cconv]: 3.797e-05 [loop_unroll]: 0.00059853 [jit_opt_after_cconv]: 0.0002022, [1] [Cycle 1]: 0.00019372, [11] [c_1]: 3.236e-05 [parameter_eliminate]: 4.97e-06 [updatestate_depend_eliminate]: 9.84999e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 3.623e-05 [call_graph_tuple_transform]: 2.989e-05 [tuple_list_get_item_eliminator]: 7.85998e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.7e-06 [remove_dup_value]: 1.642e-05 [partial_unused_args_eliminate]: 3.97e-06 [environ_conv]: 1.083e-05 [add_recomputation]: 6.166e-05 [cse_after_recomputation]: 2.652e-05, [1] [Cycle 1]: 2.09e-05, [1] [cse]: 1.329e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 1.088e-05 [opt_after_jit_grad]: 0.00075083 [symbol_engine_optimizer]: 0.00015661, [1] [Cycle 1]: 0.00014818, [6] [build]: 6.73e-06 [elim_shapecalc]: 8.65001e-06 [elim_not_effective]: 7.321e-05 [opt_reshape]: 1.075e-05 [fold_const_symbol]: 1.378e-05 [renormalize]: 8.70001e-07 [validate]: 7.018e-05 Sums bootstrap : 0.000542s : 0.42% type_inference : 0.092983s : 72.03% event_method : 0.000028s : 0.02% auto_monad : 0.000095s : 0.07% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000551s : 0.43% rewriter_before_opt_a : 0.000164s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.07% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000941s : 0.73% jit_opt_a.with_stream_mark : 0.000049s : 0.04% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.030210s : 23.40% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.03% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000035s : 0.03% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001043s : 0.81% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000038s : 0.03% loop_unroll : 0.000599s : 0.46% jit_opt_after_cconv.c_1 : 0.000032s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000062s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000751s : 0.58% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000073s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000070s : 0.05% Time group info: ------[substitution.] 0.000401 24 14.23% : 0.000057s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 2.19% : 0.000009s : 4: substitution.graph_param_transform 73.61% : 0.000295s : 4: substitution.inline 1.27% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000007s : 4: substitution.remove_not_recompute_node 2.15% : 0.000009s : 2: substitution.replace_old_param 4.33% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.092823 2 94.73% : 0.087930s : 1: type_inference.infer 5.27% : 0.004893s : 1: type_inference.specialize ------[replace.] 0.000108 6 65.43% : 0.000071s : 4: replace.inline 34.57% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000307 6 94.95% : 0.000292s : 4: match.inline 5.05% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 830 1.65% : 0.000003s : 12: predicate.accumulaten_eliminater 1.42% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.54% : 0.000003s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 12: predicate.compare_switch_simplify 1.04% : 0.000002s : 12: predicate.depend_value_elim 0.99% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.98% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.28% : 0.000002s : 12: predicate.environ_get_depend_swap 1.11% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 4.87% : 0.000008s : 26: predicate.inline 0.70% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000003s : 8: predicate.less_batch_normalization 1.52% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.76% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.28% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.61% : 0.000005s : 16: predicate.make_slice_get_slice_eliminator 0.82% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000002s : 12: predicate.minmaximum_grad 2.70% : 0.000005s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 1.82% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.72% : 0.000003s : 12: predicate.reduce_eliminate 1.72% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.76% : 0.000003s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.12% : 0.000002s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.60% : 0.000003s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000012s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.11% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.54% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 2.11% : 0.000004s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004177 26 66.99% : 0.002799s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.42% : 0.001313s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.170768 72 0.04% : 0.000065s : 1: add_recomputation 0.06% : 0.000099s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.34% : 0.000578s : 1: bootstrap 0.02% : 0.000041s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 24.23% : 0.041379s : 1: jit_opt_a 0.12% : 0.000205s : 1: jit_opt_after_cconv 0.05% : 0.000077s : 1: jit_opt_b 0.36% : 0.000612s : 1: loop_unroll 0.62% : 0.001062s : 1: mutable_eliminate 0.73% : 0.001244s : 26: opt.transform.jit_opt_a 0.04% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000027s : 1: opt.transform.mutable_eliminate 0.02% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000101s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000763s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000561s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 16.83% : 0.028738s : 1: renormalize.infer 0.85% : 0.001451s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.10% : 0.000173s : 1: rewriter_before_opt_a 0.09% : 0.000159s : 1: symbol_engine_optimizer 54.47% : 0.093018s : 1: type_inference TotalTime = 0.0577088, [30] [bootstrap]: 0.00042556 [type_inference]: 0.0461178 [event_method]: 2.36e-05 [auto_monad]: 7.51e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 0.00012361 [rewriter_before_opt_a]: 8.697e-05 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.0074609, [2] [Cycle 1]: 0.0024444, [27] [switch_simplify]: 6.747e-05 [loop_unroll]: 3.253e-05 [a_1]: 0.00070437 [with_stream_mark]: 2.583e-05 [recompute_prepare]: 8.77e-06 [updatestate_depend_eliminate]: 4.99003e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.94999e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.711e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 5.54e-06 [renormalize]: 0.00123059 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 3.12002e-06 [auto_monad_eliminator]: 1.689e-05 [cse]: 3.904e-05 [replace_applicator]: 1.609e-05 [Cycle 2]: 0.00034044, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.35001e-06 [a_1]: 9.521e-05 [with_stream_mark]: 1.261e-05 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.474e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.76998e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 6.77002e-06 [cse]: 1.441e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 1.625e-05 [rewriter_after_opt_a]: 4.308e-05 [convert_after_rewriter]: 8.19998e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00092756 [jit_opt_b]: 5.949e-05, [1] [Cycle 1]: 4.922e-05, [2] [frontend_op_eliminate]: 1.879e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 3.513e-05 [loop_unroll]: 0.00072318 [jit_opt_after_cconv]: 0.00020257, [1] [Cycle 1]: 0.0001931, [11] [c_1]: 2.489e-05 [parameter_eliminate]: 5.72999e-06 [updatestate_depend_eliminate]: 1.056e-05 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.84999e-06 [cse]: 4.349e-05 [call_graph_tuple_transform]: 2.94e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 1.08001e-06 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 2.009e-05 [partial_unused_args_eliminate]: 2.89999e-06 [environ_conv]: 8.28999e-06 [add_recomputation]: 6.622e-05 [cse_after_recomputation]: 7.774e-05, [1] [Cycle 1]: 2.463e-05, [1] [cse]: 1.54e-05 [auto_monad_reorder]: 2.396e-05 [get_jit_bprop_graph]: 2.72001e-06 [rewriter_after_jit_bprop_graph]: 1.175e-05 [opt_after_jit_grad]: 0.00077242 [symbol_engine_optimizer]: 8.958e-05, [1] [Cycle 1]: 8.027e-05, [6] [build]: 6.41e-06 [elim_shapecalc]: 9.63002e-06 [elim_not_effective]: 1.775e-05 [opt_reshape]: 6.93998e-06 [fold_const_symbol]: 9.82001e-06 [renormalize]: 9.09989e-07 [validate]: 5.487e-05 Sums bootstrap : 0.000426s : 0.81% type_inference : 0.046118s : 88.18% event_method : 0.000024s : 0.05% auto_monad : 0.000075s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000124s : 0.24% rewriter_before_opt_a : 0.000087s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.14% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000800s : 1.53% jit_opt_a.with_stream_mark : 0.000038s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001231s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000053s : 0.10% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000043s : 0.08% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000928s : 1.77% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000035s : 0.07% loop_unroll : 0.000723s : 1.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000043s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000066s : 0.13% cse_after_recomputation.cse : 0.000015s : 0.03% auto_monad_reorder : 0.000024s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.02% opt_after_jit_grad : 0.000772s : 1.48% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.10% Time group info: ------[substitution.] 0.000288 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 3.02% : 0.000009s : 3: substitution.graph_param_transform 83.19% : 0.000239s : 4: substitution.inline 1.60% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_old_param 6.70% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046028 2 95.87% : 0.044128s : 1: type_inference.infer 4.13% : 0.001900s : 1: type_inference.specialize ------[replace.] 0.000087 6 67.90% : 0.000059s : 4: replace.inline 32.10% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 6 92.98% : 0.000236s : 4: match.inline 7.02% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.65% : 0.000002s : 10: predicate.accumulaten_eliminater 1.54% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.25% : 0.000003s : 10: predicate.arithmetic_simplify 1.96% : 0.000003s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 0.95% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.93% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.61% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 5.91% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.95% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 15: predicate.load_eliminater 1.90% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.17% : 0.000003s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.03% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 10: predicate.reshape_eliminate 1.07% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.95% : 0.000004s : 16: predicate.switch_defer_inline 1.80% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.79% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.03% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001046 13 45.77% : 0.000479s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.46% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.77% : 0.000510s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060056 72 0.12% : 0.000071s : 1: add_recomputation 0.13% : 0.000079s : 1: auto_monad 0.05% : 0.000028s : 1: auto_monad_reorder 0.75% : 0.000448s : 1: bootstrap 0.06% : 0.000038s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.13% : 0.000081s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 12.43% : 0.007465s : 1: jit_opt_a 0.34% : 0.000206s : 1: jit_opt_after_cconv 0.10% : 0.000062s : 1: jit_opt_b 1.23% : 0.000738s : 1: loop_unroll 1.57% : 0.000943s : 1: mutable_eliminate 1.73% : 0.001041s : 26: opt.transform.jit_opt_a 0.10% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000023s : 1: opt.transform.mutable_eliminate 0.06% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.31% : 0.000786s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000128s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000023s : 1: remove_dup_value 1.21% : 0.000728s : 1: renormalize.infer 0.82% : 0.000492s : 1: renormalize.specialize 0.02% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000046s : 1: rewriter_after_opt_a 0.15% : 0.000091s : 1: rewriter_before_opt_a 0.15% : 0.000093s : 1: symbol_engine_optimizer 76.83% : 0.046139s : 1: type_inference TotalTime = 0.0826982, [30] [bootstrap]: 0.00053388 [type_inference]: 0.0388715 [event_method]: 2.345e-05 [auto_monad]: 7.825e-05 [graph_reusing]: 6.47001e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00012275 [rewriter_before_opt_a]: 8.907e-05 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.0399586, [2] [Cycle 1]: 0.00264766, [27] [switch_simplify]: 7.254e-05 [loop_unroll]: 3.233e-05 [a_1]: 0.0006743 [with_stream_mark]: 2.942e-05 [recompute_prepare]: 1.368e-05 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 3.39001e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 4.24002e-06 [cell_reuse_recompute_pass]: 2.60002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.719e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.171e-05 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00137108 [add_forward_monad_depend]: 1.134e-05 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 2.515e-05 [cse]: 4.328e-05 [replace_applicator]: 2.336e-05 [Cycle 2]: 0.00040008, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.47999e-06 [a_1]: 9.911e-05 [with_stream_mark]: 1.862e-05 [recompute_prepare]: 6.98e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 2.43002e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 4e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.203e-05 [j_node_and_user_rematch]: 1.05e-05 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 1.04e-05 [inline_without_move]: 5.19e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.73e-06 [auto_monad_grad]: 1.62999e-06 [auto_monad_eliminator]: 9.20999e-06 [cse]: 1.982e-05 [replace_applicator]: 6.40002e-06 [py_interpret_to_execute_after_opt_a]: 2.091e-05 [rewriter_after_opt_a]: 0.00010039 [convert_after_rewriter]: 1.082e-05 [order_py_execute_after_rewriter]: 5.76998e-06 [mutable_eliminate]: 0.00097241 [jit_opt_b]: 6.308e-05, [1] [Cycle 1]: 5.129e-05, [2] [frontend_op_eliminate]: 1.894e-05 [inline_after_opt_a]: 1.94e-05 [cconv]: 4.231e-05 [loop_unroll]: 0.00056069 [jit_opt_after_cconv]: 0.00018342, [1] [Cycle 1]: 0.00017594, [11] [c_1]: 2.259e-05 [parameter_eliminate]: 5.94999e-06 [updatestate_depend_eliminate]: 1.034e-05 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.90998e-06 [cse]: 4.054e-05 [call_graph_tuple_transform]: 2.524e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 4.99975e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.907e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 7.5e-06 [add_recomputation]: 5.675e-05 [cse_after_recomputation]: 5.611e-05, [1] [Cycle 1]: 1.737e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 3.22002e-06 [rewriter_after_jit_bprop_graph]: 9.50001e-06 [opt_after_jit_grad]: 0.00050889 [symbol_engine_optimizer]: 7.837e-05, [1] [Cycle 1]: 7.08e-05, [6] [build]: 4.93001e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.453e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 4.99975e-07 [validate]: 4.969e-05 Sums bootstrap : 0.000534s : 1.19% type_inference : 0.038872s : 86.36% event_method : 0.000023s : 0.05% auto_monad : 0.000078s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000123s : 0.27% rewriter_before_opt_a : 0.000089s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.17% jit_opt_a.loop_unroll : 0.000038s : 0.08% jit_opt_a.a_1 : 0.000773s : 1.72% jit_opt_a.with_stream_mark : 0.000048s : 0.11% jit_opt_a.recompute_prepare : 0.000021s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001371s : 3.05% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.08% jit_opt_a.cse : 0.000063s : 0.14% jit_opt_a.replace_applicator : 0.000030s : 0.07% py_interpret_to_execute_after_opt_a : 0.000021s : 0.05% rewriter_after_opt_a : 0.000100s : 0.22% convert_after_rewriter : 0.000011s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000972s : 2.16% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000042s : 0.09% loop_unroll : 0.000561s : 1.25% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000041s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000057s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000509s : 1.13% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.11% Time group info: ------[substitution.] 0.000293 23 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 3: substitution.graph_param_transform 84.72% : 0.000249s : 4: substitution.inline 1.97% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000006s : 4: substitution.remove_not_recompute_node 2.85% : 0.000008s : 2: substitution.replace_old_param 4.91% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038767 2 95.00% : 0.036830s : 1: type_inference.infer 5.00% : 0.001938s : 1: type_inference.specialize ------[replace.] 0.000090 6 65.50% : 0.000059s : 4: replace.inline 34.50% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 6 95.13% : 0.000245s : 4: match.inline 4.87% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.89% : 0.000003s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 10: predicate.compare_switch_simplify 1.62% : 0.000002s : 10: predicate.depend_value_elim 0.90% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.00% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.00% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.07% : 0.000001s : 10: predicate.environ_get_eliminate 0.90% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000008s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.51% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 15: predicate.load_eliminater 1.15% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.90% : 0.000001s : 10: predicate.minmaximum_grad 2.53% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000003s : 15: predicate.partial_eliminate 1.71% : 0.000002s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000003s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.59% : 0.000001s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 10: predicate.reshape_eliminate 1.04% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 10: predicate.same_eliminate 0.79% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 6: predicate.special_op_eliminate 1.24% : 0.000002s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 16: predicate.switch_defer_inline 2.69% : 0.000004s : 16: predicate.switch_layer_defer_inline 7.55% : 0.000010s : 53: predicate.switch_simplify 1.16% : 0.000002s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.93% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.54% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001119 13 46.55% : 0.000521s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.78% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.67% : 0.000533s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.085169 72 0.07% : 0.000060s : 1: add_recomputation 0.10% : 0.000082s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.66% : 0.000564s : 1: bootstrap 0.05% : 0.000045s : 1: cconv 0.02% : 0.000014s : 1: convert_after_rewriter 0.07% : 0.000059s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 46.92% : 0.039964s : 1: jit_opt_a 0.22% : 0.000186s : 1: jit_opt_after_cconv 0.08% : 0.000066s : 1: jit_opt_b 0.67% : 0.000572s : 1: loop_unroll 1.16% : 0.000992s : 1: mutable_eliminate 1.23% : 0.001046s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000025s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000518s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000127s : 1: py_interpret_to_execute 0.03% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.93% : 0.000793s : 1: renormalize.infer 0.66% : 0.000563s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000108s : 1: rewriter_after_opt_a 0.11% : 0.000093s : 1: rewriter_before_opt_a 0.10% : 0.000081s : 1: symbol_engine_optimizer 45.67% : 0.038895s : 1: type_inference TotalTime = 0.0986585, [30] [bootstrap]: 0.00035134 [type_inference]: 0.0762927 [event_method]: 2.115e-05 [auto_monad]: 6.732e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.53998e-06 [py_interpret_to_execute]: 0.0001012 [rewriter_before_opt_a]: 7.989e-05 [expand_dump_flag]: 1.771e-05 [jit_opt_a]: 0.00691164, [2] [Cycle 1]: 0.00218207, [27] [switch_simplify]: 6.52e-05 [loop_unroll]: 2.958e-05 [a_1]: 0.00059178 [with_stream_mark]: 2.474e-05 [recompute_prepare]: 7.3e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 1.06997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 5.14998e-06 [renormalize]: 0.00111091 [add_forward_monad_depend]: 5.82999e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.689e-05 [cse]: 3.679e-05 [replace_applicator]: 1.554e-05 [Cycle 2]: 0.00032114, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.54e-06 [a_1]: 8.708e-05 [with_stream_mark]: 1.228e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.55998e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 5.36998e-06 [accelerated_algorithm]: 4.97999e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 3.37997e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.427e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 4.72e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.32001e-06 [cse]: 1.265e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 1.509e-05 [rewriter_after_opt_a]: 4.338e-05 [convert_after_rewriter]: 6.39999e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.0006425 [jit_opt_b]: 7.597e-05, [1] [Cycle 1]: 6.866e-05, [2] [frontend_op_eliminate]: 1.672e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 3.1e-05 [loop_unroll]: 0.00046703 [jit_opt_after_cconv]: 0.00018867, [1] [Cycle 1]: 0.00018189, [11] [c_1]: 2.026e-05 [parameter_eliminate]: 4.02998e-06 [updatestate_depend_eliminate]: 7.49002e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.542e-05 [cse]: 2.931e-05 [call_graph_tuple_transform]: 1.936e-05 [tuple_list_get_item_eliminator]: 5.58002e-06 [none_parameter_eliminate]: 2.19999e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.626e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 8.25999e-06 [add_recomputation]: 6.347e-05 [cse_after_recomputation]: 2.677e-05, [1] [Cycle 1]: 1.969e-05, [1] [cse]: 1.398e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 6.43e-06 [opt_after_jit_grad]: 0.00046867 [symbol_engine_optimizer]: 7.539e-05, [1] [Cycle 1]: 6.796e-05, [6] [build]: 4.15e-06 [elim_shapecalc]: 7.75e-06 [elim_not_effective]: 1.404e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.29e-06 [renormalize]: 4.69998e-07 [validate]: 4.697e-05 Sums bootstrap : 0.000351s : 0.43% type_inference : 0.076293s : 93.96% event_method : 0.000021s : 0.03% auto_monad : 0.000067s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000101s : 0.12% rewriter_before_opt_a : 0.000080s : 0.10% expand_dump_flag : 0.000018s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000679s : 0.84% jit_opt_a.with_stream_mark : 0.000037s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001111s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000049s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000043s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000643s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000031s : 0.04% loop_unroll : 0.000467s : 0.58% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000025s : 0.03% jit_opt_after_cconv.cse : 0.000029s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000063s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000469s : 0.58% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.06% Time group info: ------[substitution.] 0.000252 23 1.03% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.16% : 0.000005s : 3: substitution.graph_param_transform 85.36% : 0.000215s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 2.39% : 0.000006s : 2: substitution.replace_old_param 4.91% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076214 2 98.02% : 0.074702s : 1: type_inference.infer 1.98% : 0.001511s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.19% : 0.000055s : 4: replace.inline 31.81% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.94% : 0.000213s : 4: match.inline 5.06% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.62% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.52% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 6.79% : 0.000008s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.91% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.15% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001005 13 51.74% : 0.000520s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.47% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.79% : 0.000430s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.088375 72 0.11% : 0.000099s : 1: add_recomputation 0.08% : 0.000071s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.42% : 0.000376s : 1: bootstrap 0.04% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.06% : 0.000051s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.82% : 0.006915s : 1: jit_opt_a 0.22% : 0.000191s : 1: jit_opt_after_cconv 0.09% : 0.000078s : 1: jit_opt_b 0.54% : 0.000475s : 1: loop_unroll 0.74% : 0.000652s : 1: mutable_eliminate 1.03% : 0.000907s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000104s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.73% : 0.000642s : 1: renormalize.infer 0.52% : 0.000458s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000083s : 1: rewriter_before_opt_a 0.09% : 0.000078s : 1: symbol_engine_optimizer 86.35% : 0.076313s : 1: type_inference TotalTime = 0.271404, [30] [bootstrap]: 0.00051718 [type_inference]: 0.23002 [event_method]: 2.53e-05 [auto_monad]: 9.034e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.0268444 [rewriter_before_opt_a]: 0.00017791 [expand_dump_flag]: 7.06001e-06 [jit_opt_a]: 0.0109136, [2] [Cycle 1]: 0.00506156, [27] [switch_simplify]: 7.582e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00071433 [with_stream_mark]: 2.724e-05 [recompute_prepare]: 9.89001e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 7.83999e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 7.30998e-06 [meta_shard_fg_expand]: 2.74999e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 1.256e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 6.95002e-06 [renormalize]: 0.00376827 [add_forward_monad_depend]: 1.095e-05 [auto_monad_grad]: 3.54002e-06 [auto_monad_eliminator]: 2.413e-05 [cse]: 3.675e-05 [replace_applicator]: 2.486e-05 [Cycle 2]: 0.0004278, [27] [switch_simplify]: 8.02003e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00014843 [with_stream_mark]: 1.561e-05 [recompute_prepare]: 6.28998e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 2.95998e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 5.83002e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.991e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.73998e-06 [replace_old_param]: 1.197e-05 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 7.86001e-06 [cse]: 1.341e-05 [replace_applicator]: 6.53998e-06 [py_interpret_to_execute_after_opt_a]: 1.796e-05 [rewriter_after_opt_a]: 4.213e-05 [convert_after_rewriter]: 7.91001e-06 [order_py_execute_after_rewriter]: 5.92001e-06 [mutable_eliminate]: 0.00091211 [jit_opt_b]: 6.217e-05, [1] [Cycle 1]: 5.369e-05, [2] [frontend_op_eliminate]: 2.262e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 2.954e-05 [loop_unroll]: 0.00046473 [jit_opt_after_cconv]: 0.00016727, [1] [Cycle 1]: 0.00016062, [11] [c_1]: 2.679e-05 [parameter_eliminate]: 4.17e-06 [updatestate_depend_eliminate]: 7.36999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.632e-05 [call_graph_tuple_transform]: 2.333e-05 [tuple_list_get_item_eliminator]: 6.77002e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 7.05e-06 [remove_dup_value]: 1.713e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 1.035e-05 [add_recomputation]: 6.023e-05 [cse_after_recomputation]: 2.442e-05, [1] [Cycle 1]: 1.91e-05, [1] [cse]: 1.298e-05 [auto_monad_reorder]: 1.497e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 6.88e-06 [opt_after_jit_grad]: 0.00054237 [symbol_engine_optimizer]: 8.398e-05, [1] [Cycle 1]: 7.718e-05, [6] [build]: 4.33999e-06 [elim_shapecalc]: 8.72e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 7.09001e-06 [fold_const_symbol]: 1.113e-05 [renormalize]: 5.39992e-07 [validate]: 5.213e-05 Sums bootstrap : 0.000517s : 0.19% type_inference : 0.230020s : 86.73% event_method : 0.000025s : 0.01% auto_monad : 0.000090s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.026844s : 10.12% rewriter_before_opt_a : 0.000178s : 0.07% expand_dump_flag : 0.000007s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.03% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000863s : 0.33% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003768s : 1.42% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000912s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000465s : 0.18% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000060s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000542s : 0.20% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.02% Time group info: ------[substitution.] 0.000296 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 84.69% : 0.000251s : 4: substitution.inline 1.36% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000007s : 4: substitution.remove_not_recompute_node 2.86% : 0.000008s : 2: substitution.replace_old_param 5.09% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.229810 2 98.51% : 0.226394s : 1: type_inference.infer 1.49% : 0.003415s : 1: type_inference.specialize ------[replace.] 0.000093 6 65.47% : 0.000061s : 4: replace.inline 34.53% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 6 94.68% : 0.000248s : 4: match.inline 5.32% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.59% : 0.000002s : 12: predicate.addn_zero_filter 2.27% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.10% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.07% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 8: predicate.less_batch_normalization 1.89% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 18: predicate.load_eliminater 1.04% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.35% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000002s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 2.01% : 0.000003s : 12: predicate.reduce_eliminate 1.72% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.60% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.18% : 0.000002s : 4: predicate.row_tensor_eliminate 1.62% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.42% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000003s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.020801 26 94.58% : 0.019674s : 19: func_graph_cloner_run.FuncGraphClonerGraph 0.31% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 5.11% : 0.001063s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.276391 72 0.02% : 0.000063s : 1: add_recomputation 0.03% : 0.000095s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.20% : 0.000541s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000009s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.95% : 0.010917s : 1: jit_opt_a 0.06% : 0.000170s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.17% : 0.000474s : 1: loop_unroll 0.33% : 0.000924s : 1: mutable_eliminate 0.41% : 0.001144s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000061s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000552s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 9.73% : 0.026883s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.93% : 0.002584s : 1: renormalize.infer 0.42% : 0.001170s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000188s : 1: rewriter_before_opt_a 0.03% : 0.000087s : 1: symbol_engine_optimizer 83.23% : 0.230047s : 1: type_inference TotalTime = 0.0354744, [30] [bootstrap]: 0.00044021 [type_inference]: 0.0240789 [event_method]: 2.485e-05 [auto_monad]: 8.103e-05 [graph_reusing]: 6.36998e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00013818 [rewriter_before_opt_a]: 9.092e-05 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.00801073, [2] [Cycle 1]: 0.00258201, [27] [switch_simplify]: 7.285e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.00063303 [with_stream_mark]: 2.799e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.54999e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.80002e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.92002e-06 [replace_old_param]: 9.87001e-06 [inline_without_move]: 6.41998e-06 [renormalize]: 0.00142868 [add_forward_monad_depend]: 8.37e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.83e-05 [cse]: 4.171e-05 [replace_applicator]: 1.713e-05 [Cycle 2]: 0.00034638, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.46002e-06 [a_1]: 9.793e-05 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.37002e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.621e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 7.82002e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.392e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.613e-05 [rewriter_after_opt_a]: 4.247e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 5.51998e-06 [mutable_eliminate]: 0.00083176 [jit_opt_b]: 5.5e-05, [1] [Cycle 1]: 4.665e-05, [2] [frontend_op_eliminate]: 1.723e-05 [inline_after_opt_a]: 1.79e-05 [cconv]: 3.058e-05 [loop_unroll]: 0.00047344 [jit_opt_after_cconv]: 0.00015786, [1] [Cycle 1]: 0.0001506, [11] [c_1]: 2.167e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 7.19001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.874e-05 [call_graph_tuple_transform]: 2.103e-05 [tuple_list_get_item_eliminator]: 5.71998e-06 [none_parameter_eliminate]: 1.99999e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 7.38e-06 [add_recomputation]: 5.645e-05 [cse_after_recomputation]: 2.344e-05, [1] [Cycle 1]: 1.783e-05, [1] [cse]: 1.212e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 6.92002e-06 [opt_after_jit_grad]: 0.00050414 [symbol_engine_optimizer]: 7.587e-05, [1] [Cycle 1]: 6.919e-05, [6] [build]: 5.00999e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.271e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 3.7998e-07 [validate]: 4.558e-05 Sums bootstrap : 0.000440s : 1.48% type_inference : 0.024079s : 80.96% event_method : 0.000025s : 0.08% auto_monad : 0.000081s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000138s : 0.46% rewriter_before_opt_a : 0.000091s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000731s : 2.46% jit_opt_a.with_stream_mark : 0.000041s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001429s : 4.80% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.08% jit_opt_a.cse : 0.000056s : 0.19% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000832s : 2.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000031s : 0.10% loop_unroll : 0.000473s : 1.59% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000504s : 1.70% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.15% Time group info: ------[substitution.] 0.000278 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 3: substitution.graph_param_transform 85.85% : 0.000239s : 4: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000006s : 4: substitution.remove_not_recompute_node 1.88% : 0.000005s : 2: substitution.replace_old_param 5.14% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023982 2 91.80% : 0.022015s : 1: type_inference.infer 8.20% : 0.001966s : 1: type_inference.specialize ------[replace.] 0.000082 6 70.23% : 0.000058s : 4: replace.inline 29.77% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 6 94.77% : 0.000236s : 4: match.inline 5.23% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.06% : 0.000001s : 10: predicate.addn_zero_filter 2.86% : 0.000004s : 10: predicate.arithmetic_simplify 1.60% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.40% : 0.000002s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 2.00% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 2.20% : 0.000003s : 15: predicate.load_eliminater 1.86% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.10% : 0.000001s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.46% : 0.000002s : 10: predicate.transpose_eliminate 1.65% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.91% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.32% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001016 13 42.31% : 0.000430s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.81% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.89% : 0.000527s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037913 72 0.16% : 0.000059s : 1: add_recomputation 0.22% : 0.000085s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.21% : 0.000459s : 1: bootstrap 0.09% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000030s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 21.14% : 0.008015s : 1: jit_opt_a 0.43% : 0.000161s : 1: jit_opt_after_cconv 0.15% : 0.000058s : 1: jit_opt_b 1.27% : 0.000483s : 1: loop_unroll 2.22% : 0.000842s : 1: mutable_eliminate 2.58% : 0.000977s : 26: opt.transform.jit_opt_a 0.13% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.35% : 0.000513s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000143s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.41% : 0.000915s : 1: renormalize.infer 1.33% : 0.000505s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000046s : 1: rewriter_after_opt_a 0.25% : 0.000095s : 1: rewriter_before_opt_a 0.21% : 0.000079s : 1: symbol_engine_optimizer 63.58% : 0.024104s : 1: type_inference TotalTime = 0.0831071, [30] [bootstrap]: 0.00032781 [type_inference]: 0.0590939 [event_method]: 2.132e-05 [auto_monad]: 6.808e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.23998e-06 [py_interpret_to_execute]: 0.00011763 [rewriter_before_opt_a]: 8.406e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0190786, [2] [Cycle 1]: 0.0144246, [27] [switch_simplify]: 7.308e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00065108 [with_stream_mark]: 2.801e-05 [recompute_prepare]: 9.17001e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 1.081e-05 [inline_without_move]: 5.46998e-06 [renormalize]: 0.0132208 [add_forward_monad_depend]: 9.81998e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 2.13e-05 [cse]: 4.062e-05 [replace_applicator]: 2.438e-05 [Cycle 2]: 0.00036186, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.27001e-06 [a_1]: 0.00010081 [with_stream_mark]: 1.748e-05 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 3.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.046e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 9.02999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 7.2e-06 [cse]: 1.291e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.781e-05 [rewriter_after_opt_a]: 4.193e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00081556 [jit_opt_b]: 5.249e-05, [1] [Cycle 1]: 4.348e-05, [2] [frontend_op_eliminate]: 1.676e-05 [inline_after_opt_a]: 1.55e-05 [cconv]: 3.065e-05 [loop_unroll]: 0.00042673 [jit_opt_after_cconv]: 0.000167, [1] [Cycle 1]: 0.00016023, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 7.36999e-06 [updatestate_assign_eliminate]: 2.65997e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 4.225e-05 [call_graph_tuple_transform]: 2.086e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.723e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.11e-06 [add_recomputation]: 0.0015153 [cse_after_recomputation]: 5.975e-05, [1] [Cycle 1]: 3.232e-05, [1] [cse]: 2.222e-05 [auto_monad_reorder]: 2.14e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 9.57001e-06 [opt_after_jit_grad]: 0.00073787 [symbol_engine_optimizer]: 7.738e-05, [1] [Cycle 1]: 6.999e-05, [6] [build]: 4.68001e-06 [elim_shapecalc]: 7.33e-06 [elim_not_effective]: 1.549e-05 [opt_reshape]: 5.72999e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 5.8001e-07 [validate]: 4.68e-05 Sums bootstrap : 0.000328s : 0.42% type_inference : 0.059094s : 75.68% event_method : 0.000021s : 0.03% auto_monad : 0.000068s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000118s : 0.15% rewriter_before_opt_a : 0.000084s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000752s : 0.96% jit_opt_a.with_stream_mark : 0.000045s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.013221s : 16.93% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.04% jit_opt_a.cse : 0.000054s : 0.07% jit_opt_a.replace_applicator : 0.000030s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000042s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000816s : 1.04% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000031s : 0.04% loop_unroll : 0.000427s : 0.55% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.001515s : 1.94% cse_after_recomputation.cse : 0.000022s : 0.03% auto_monad_reorder : 0.000021s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000738s : 0.94% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.06% Time group info: ------[substitution.] 0.000296 23 0.90% : 0.000003s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 1.88% : 0.000006s : 3: substitution.graph_param_transform 85.89% : 0.000254s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000006s : 4: substitution.remove_not_recompute_node 2.65% : 0.000008s : 2: substitution.replace_old_param 4.66% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.059014 2 97.04% : 0.057268s : 1: type_inference.infer 2.96% : 0.001746s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.75% : 0.000061s : 4: replace.inline 30.25% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 6 95.20% : 0.000252s : 4: match.inline 4.80% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000002s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.56% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.27% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.32% : 0.000002s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 1.96% : 0.000003s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.66% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.60% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001216 13 47.25% : 0.000575s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.09% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.66% : 0.000580s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.097339 72 1.57% : 0.001524s : 1: add_recomputation 0.07% : 0.000072s : 1: auto_monad 0.03% : 0.000024s : 1: auto_monad_reorder 0.36% : 0.000351s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000063s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 19.60% : 0.019083s : 1: jit_opt_a 0.17% : 0.000169s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.45% : 0.000435s : 1: loop_unroll 0.85% : 0.000827s : 1: mutable_eliminate 1.04% : 0.001008s : 26: opt.transform.jit_opt_a 0.05% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000749s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000121s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 12.92% : 0.012578s : 1: renormalize.infer 0.65% : 0.000629s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000088s : 1: rewriter_before_opt_a 0.08% : 0.000080s : 1: symbol_engine_optimizer 60.73% : 0.059113s : 1: type_inference TotalTime = 0.488173, [30] [bootstrap]: 0.00038348 [type_inference]: 0.399478 [event_method]: 2.73e-05 [auto_monad]: 9.166e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 0.00066807 [rewriter_before_opt_a]: 0.00011357 [expand_dump_flag]: 4.65001e-06 [jit_opt_a]: 0.0271917, [2] [Cycle 1]: 0.00780339, [27] [switch_simplify]: 8.648e-05 [loop_unroll]: 3.517e-05 [a_1]: 0.00084048 [with_stream_mark]: 3.39e-05 [recompute_prepare]: 1.278e-05 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.57001e-06 [specialize_transform]: 1.12e-05 [updatestate_useless_node_eliminater]: 7.00002e-06 [accelerated_algorithm]: 8.83001e-06 [meta_shard_fg_expand]: 4.30999e-06 [get_grad_eliminate_]: 9.12999e-06 [merge_forward]: 4.99e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.009e-05 [j_node_and_user_rematch]: 1.382e-05 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.322e-05 [inline_without_move]: 7.7e-06 [renormalize]: 0.00626841 [add_forward_monad_depend]: 1.497e-05 [auto_monad_grad]: 2.84999e-06 [auto_monad_eliminator]: 2.86e-05 [cse]: 4.85e-05 [replace_applicator]: 3.25e-05 [Cycle 2]: 0.00045892, [27] [switch_simplify]: 9.17001e-06 [loop_unroll]: 7.55998e-06 [a_1]: 0.00014971 [with_stream_mark]: 1.953e-05 [recompute_prepare]: 7.03e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.13002e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 6.51999e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 4.01001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.324e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.212e-05 [inline_without_move]: 6.66999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.43e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 8.54e-06 [cse]: 1.73e-05 [replace_applicator]: 7.21999e-06 [py_interpret_to_execute_after_opt_a]: 2.342e-05 [rewriter_after_opt_a]: 0.00010499 [convert_after_rewriter]: 8.75001e-06 [order_py_execute_after_rewriter]: 5.96998e-06 [mutable_eliminate]: 0.00093163 [jit_opt_b]: 0.00015648, [1] [Cycle 1]: 0.00014365, [2] [frontend_op_eliminate]: 0.00010586 [inline_after_opt_a]: 2.173e-05 [cconv]: 4.061e-05 [loop_unroll]: 0.0566602 [jit_opt_after_cconv]: 0.0003086, [1] [Cycle 1]: 0.00028688, [11] [c_1]: 4.851e-05 [parameter_eliminate]: 9.46e-06 [updatestate_depend_eliminate]: 2.032e-05 [updatestate_assign_eliminate]: 3.91999e-06 [updatestate_loads_eliminate]: 3.23e-06 [cse]: 6.557e-05 [call_graph_tuple_transform]: 4.551e-05 [tuple_list_get_item_eliminator]: 9.04e-06 [none_parameter_eliminate]: 2.21998e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 8.40001e-06 [remove_dup_value]: 2.479e-05 [partial_unused_args_eliminate]: 2.73998e-06 [environ_conv]: 1.408e-05 [add_recomputation]: 7.415e-05 [cse_after_recomputation]: 2.952e-05, [1] [Cycle 1]: 2.319e-05, [1] [cse]: 1.584e-05 [auto_monad_reorder]: 2.494e-05 [get_jit_bprop_graph]: 2.50002e-06 [rewriter_after_jit_bprop_graph]: 1.301e-05 [opt_after_jit_grad]: 0.00093978 [symbol_engine_optimizer]: 0.0001016, [1] [Cycle 1]: 9.197e-05, [6] [build]: 5.66003e-06 [elim_shapecalc]: 1.013e-05 [elim_not_effective]: 2.196e-05 [opt_reshape]: 1.311e-05 [fold_const_symbol]: 1.04e-05 [renormalize]: 2.59985e-07 [validate]: 0.00044456 Sums bootstrap : 0.000383s : 0.08% type_inference : 0.399478s : 85.29% event_method : 0.000027s : 0.01% auto_monad : 0.000092s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000668s : 0.14% rewriter_before_opt_a : 0.000114s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000096s : 0.02% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.000990s : 0.21% jit_opt_a.with_stream_mark : 0.000053s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.006268s : 1.34% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000066s : 0.01% jit_opt_a.replace_applicator : 0.000040s : 0.01% py_interpret_to_execute_after_opt_a : 0.000023s : 0.01% rewriter_after_opt_a : 0.000105s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000932s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000106s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.00% cconv : 0.000041s : 0.01% loop_unroll : 0.056660s : 12.10% jit_opt_after_cconv.c_1 : 0.000049s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000020s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000066s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000046s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000025s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000074s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000025s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.00% opt_after_jit_grad : 0.000940s : 0.20% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000013s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000445s : 0.09% Time group info: ------[substitution.] 0.000361 24 0.71% : 0.000003s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 2.95% : 0.000011s : 4: substitution.graph_param_transform 85.49% : 0.000309s : 4: substitution.inline 1.57% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000007s : 4: substitution.remove_not_recompute_node 2.30% : 0.000008s : 2: substitution.replace_old_param 4.53% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.399354 2 98.75% : 0.394363s : 1: type_inference.infer 1.25% : 0.004991s : 1: type_inference.specialize ------[replace.] 0.000117 6 67.30% : 0.000078s : 4: replace.inline 32.70% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000321 6 95.24% : 0.000306s : 4: match.inline 4.76% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.056207 830 0.00% : 0.000002s : 12: predicate.accumulaten_eliminater 0.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.00% : 0.000002s : 12: predicate.addn_check_dump 0.00% : 0.000002s : 12: predicate.addn_zero_filter 0.01% : 0.000003s : 12: predicate.arithmetic_simplify 0.00% : 0.000002s : 12: predicate.cast_eliminate 0.00% : 0.000001s : 4: predicate.check_bprop_eliminate 0.00% : 0.000002s : 12: predicate.compare_switch_simplify 0.00% : 0.000002s : 12: predicate.depend_value_elim 0.00% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.00% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.00% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.00% : 0.000001s : 4: predicate.elim_not_effective 0.00% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.00% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.00% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.00% : 0.000002s : 12: predicate.environ_get_depend_swap 0.00% : 0.000003s : 12: predicate.environ_get_eliminate 0.00% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 4: predicate.fold_const_symbol 0.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.00% : 0.000001s : 4: predicate.graph_param_transform 0.02% : 0.000011s : 26: predicate.inline 0.00% : 0.000002s : 8: predicate.inline_without_move 0.00% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.00% : 0.000002s : 8: predicate.less_batch_normalization 0.01% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 0.01% : 0.000003s : 18: predicate.load_eliminater 99.69% : 0.056033s : 4: predicate.loop_unroll_after_grad 0.01% : 0.000006s : 36: predicate.loop_unroll_before_grad 0.01% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.00% : 0.000002s : 12: predicate.merge_addn 0.00% : 0.000002s : 12: predicate.minmaximum_grad 0.01% : 0.000005s : 4: predicate.mutable_eliminate 0.00% : 0.000001s : 4: predicate.opt_reshape 0.01% : 0.000004s : 18: predicate.partial_eliminate 0.00% : 0.000002s : 12: predicate.print_const_string_wrapper 0.01% : 0.000004s : 12: predicate.reduce_eliminate 0.01% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.00% : 0.000002s : 8: predicate.remove_not_recompute_node 0.01% : 0.000004s : 22: predicate.replace_applicator 0.00% : 0.000001s : 8: predicate.replace_old_param 0.00% : 0.000001s : 4: predicate.reset_defer_inline 0.00% : 0.000002s : 12: predicate.reshape_eliminate 0.00% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.00% : 0.000001s : 4: predicate.row_tensor_eliminate 0.01% : 0.000003s : 12: predicate.same_eliminate 0.00% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.00% : 0.000002s : 8: predicate.special_op_eliminate 0.00% : 0.000002s : 8: predicate.specialize_transform 0.01% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 0.00% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.00% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.01% : 0.000003s : 18: predicate.switch_defer_inline 0.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 0.02% : 0.000012s : 58: predicate.switch_simplify 0.00% : 0.000003s : 12: predicate.tile_eliminate 0.00% : 0.000002s : 12: predicate.transpose_eliminate 0.00% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 0.00% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 0.01% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 0.01% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 0.00% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 0.00% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 0.01% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 0.00% : 0.000003s : 12: predicate.value_based_eliminate 0.00% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.00% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003676 22 51.39% : 0.001889s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.95% : 0.000072s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.66% : 0.001715s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.551619 72 0.01% : 0.000077s : 1: add_recomputation 0.02% : 0.000096s : 1: auto_monad 0.01% : 0.000028s : 1: auto_monad_reorder 0.07% : 0.000401s : 1: bootstrap 0.01% : 0.000044s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.93% : 0.027197s : 1: jit_opt_a 0.06% : 0.000314s : 1: jit_opt_after_cconv 0.03% : 0.000160s : 1: jit_opt_b 10.28% : 0.056701s : 1: loop_unroll 0.17% : 0.000946s : 1: mutable_eliminate 0.24% : 0.001318s : 26: opt.transform.jit_opt_a 0.02% : 0.000103s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000119s : 4: opt.transform.jit_opt_b 10.17% : 0.056082s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000952s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000676s : 1: py_interpret_to_execute 0.00% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000028s : 1: remove_dup_value 0.79% : 0.004339s : 1: renormalize.infer 0.35% : 0.001910s : 1: renormalize.specialize 0.00% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000111s : 1: rewriter_after_opt_a 0.02% : 0.000119s : 1: rewriter_before_opt_a 0.02% : 0.000104s : 1: symbol_engine_optimizer 72.43% : 0.399511s : 1: type_inference TotalTime = 0.644835, [30] [bootstrap]: 0.000455 [type_inference]: 0.568788 [event_method]: 2.711e-05 [auto_monad]: 8.366e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 0.0365684 [rewriter_before_opt_a]: 0.00013649 [expand_dump_flag]: 5.27999e-06 [jit_opt_a]: 0.0361269, [2] [Cycle 1]: 0.00723475, [27] [switch_simplify]: 0.00013208 [loop_unroll]: 3.508e-05 [a_1]: 0.00081453 [with_stream_mark]: 2.738e-05 [recompute_prepare]: 1.07e-05 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.42997e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.57002e-06 [accelerated_algorithm]: 7.34002e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 6.84999e-06 [merge_forward]: 4.24002e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.836e-05 [j_node_and_user_rematch]: 1.159e-05 [meta_fg_expand]: 3.06001e-06 [replace_old_param]: 1.179e-05 [inline_without_move]: 7.16999e-06 [renormalize]: 0.0057931 [add_forward_monad_depend]: 1.05e-05 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.984e-05 [cse]: 4.144e-05 [replace_applicator]: 2.653e-05 [Cycle 2]: 0.00043233, [27] [switch_simplify]: 7.94997e-06 [loop_unroll]: 7.32002e-06 [a_1]: 0.00014199 [with_stream_mark]: 1.807e-05 [recompute_prepare]: 6.69001e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 5.91998e-06 [accelerated_algorithm]: 7.02002e-06 [meta_shard_fg_expand]: 3.65998e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 3.35998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.985e-05 [j_node_and_user_rematch]: 1.187e-05 [meta_fg_expand]: 3.33998e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.46002e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.53e-06 [cse]: 1.561e-05 [replace_applicator]: 6.71e-06 [py_interpret_to_execute_after_opt_a]: 1.817e-05 [rewriter_after_opt_a]: 5.265e-05 [convert_after_rewriter]: 7.97e-06 [order_py_execute_after_rewriter]: 5.82999e-06 [mutable_eliminate]: 0.00072759 [jit_opt_b]: 6.361e-05, [1] [Cycle 1]: 5.598e-05, [2] [frontend_op_eliminate]: 2.186e-05 [inline_after_opt_a]: 2.035e-05 [cconv]: 3.182e-05 [loop_unroll]: 0.00046598 [jit_opt_after_cconv]: 0.00018177, [1] [Cycle 1]: 0.00017442, [11] [c_1]: 2.798e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 8.70001e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 3.31999e-06 [cse]: 3.084e-05 [call_graph_tuple_transform]: 2.601e-05 [tuple_list_get_item_eliminator]: 8.80001e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 7.33999e-06 [remove_dup_value]: 2.221e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.018e-05 [add_recomputation]: 6.189e-05 [cse_after_recomputation]: 2.734e-05, [1] [Cycle 1]: 2.207e-05, [1] [cse]: 1.584e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 6.41e-06 [opt_after_jit_grad]: 0.00050378 [symbol_engine_optimizer]: 8.435e-05, [1] [Cycle 1]: 7.753e-05, [6] [build]: 4.97e-06 [elim_shapecalc]: 9.94001e-06 [elim_not_effective]: 1.492e-05 [opt_reshape]: 7.23e-06 [fold_const_symbol]: 1.054e-05 [renormalize]: 4.09986e-07 [validate]: 8.641e-05 Sums bootstrap : 0.000455s : 0.07% type_inference : 0.568788s : 92.39% event_method : 0.000027s : 0.00% auto_monad : 0.000084s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.036568s : 5.94% rewriter_before_opt_a : 0.000136s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000140s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000957s : 0.16% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.005793s : 0.94% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.00% jit_opt_a.cse : 0.000057s : 0.01% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.00% rewriter_after_opt_a : 0.000053s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000728s : 0.12% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000032s : 0.01% loop_unroll : 0.000466s : 0.08% jit_opt_after_cconv.c_1 : 0.000028s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000062s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000504s : 0.08% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000086s : 0.01% Time group info: ------[substitution.] 0.000342 25 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000007s : 4: substitution.graph_param_transform 87.29% : 0.000299s : 5: substitution.inline 1.59% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000007s : 2: substitution.replace_old_param 4.43% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.568669 2 99.37% : 0.565069s : 1: type_inference.infer 0.63% : 0.003600s : 1: type_inference.specialize ------[replace.] 0.000118 7 67.37% : 0.000079s : 5: replace.inline 32.63% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000310 7 95.54% : 0.000296s : 5: match.inline 4.46% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000208 886 0.93% : 0.000002s : 13: predicate.accumulaten_eliminater 0.67% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.75% : 0.000002s : 13: predicate.addn_check_dump 1.09% : 0.000002s : 13: predicate.addn_zero_filter 1.54% : 0.000003s : 13: predicate.arithmetic_simplify 0.99% : 0.000002s : 13: predicate.cast_eliminate 0.31% : 0.000001s : 4: predicate.check_bprop_eliminate 0.76% : 0.000002s : 13: predicate.compare_switch_simplify 0.94% : 0.000002s : 13: predicate.depend_value_elim 0.94% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.83% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.96% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.26% : 0.000001s : 4: predicate.elim_not_effective 0.33% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.90% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.75% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.79% : 0.000002s : 13: predicate.environ_get_depend_swap 0.99% : 0.000002s : 13: predicate.environ_get_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 4.18% : 0.000009s : 28: predicate.inline 0.62% : 0.000001s : 8: predicate.inline_without_move 0.33% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.88% : 0.000002s : 8: predicate.less_batch_normalization 1.11% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.44% : 0.000003s : 19: predicate.load_eliminater 0.81% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.70% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.37% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.82% : 0.000002s : 13: predicate.merge_addn 0.83% : 0.000002s : 13: predicate.minmaximum_grad 1.10% : 0.000002s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 1.56% : 0.000003s : 19: predicate.partial_eliminate 0.96% : 0.000002s : 13: predicate.print_const_string_wrapper 1.61% : 0.000003s : 13: predicate.reduce_eliminate 1.06% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.73% : 0.000004s : 23: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.27% : 0.000001s : 4: predicate.reset_defer_inline 0.97% : 0.000002s : 13: predicate.reshape_eliminate 0.92% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.47% : 0.000001s : 4: predicate.row_tensor_eliminate 1.00% : 0.000002s : 13: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 8: predicate.special_op_eliminate 0.63% : 0.000001s : 8: predicate.specialize_transform 1.10% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.90% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.85% : 0.000004s : 20: predicate.switch_defer_inline 1.51% : 0.000003s : 20: predicate.switch_layer_defer_inline 31.24% : 0.000065s : 64: predicate.switch_simplify 0.97% : 0.000002s : 13: predicate.tile_eliminate 1.07% : 0.000002s : 13: predicate.transpose_eliminate 1.09% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.94% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.16% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.25% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.20% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.35% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.11% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.009662 25 87.50% : 0.008455s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.04% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 11.45% : 0.001106s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.651961 72 0.01% : 0.000065s : 1: add_recomputation 0.01% : 0.000087s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.07% : 0.000476s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.00% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.00% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 5.54% : 0.036131s : 1: jit_opt_a 0.03% : 0.000185s : 1: jit_opt_after_cconv 0.01% : 0.000067s : 1: jit_opt_b 0.07% : 0.000474s : 1: loop_unroll 0.11% : 0.000740s : 1: mutable_eliminate 0.20% : 0.001305s : 26: opt.transform.jit_opt_a 0.01% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000021s : 1: opt.transform.mutable_eliminate 0.00% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000513s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 5.61% : 0.036598s : 1: py_interpret_to_execute 0.00% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000025s : 1: remove_dup_value 0.70% : 0.004595s : 1: renormalize.infer 0.18% : 0.001184s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000056s : 1: rewriter_after_opt_a 0.02% : 0.000144s : 1: rewriter_before_opt_a 0.01% : 0.000087s : 1: symbol_engine_optimizer 87.25% : 0.568815s : 1: type_inference TotalTime = 0.242848, [30] [bootstrap]: 0.00057307 [type_inference]: 0.184542 [event_method]: 2.703e-05 [auto_monad]: 9.211e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00053994 [rewriter_before_opt_a]: 0.00011223 [expand_dump_flag]: 4.07e-06 [jit_opt_a]: 0.0167038, [2] [Cycle 1]: 0.0100823, [27] [switch_simplify]: 8.55e-05 [loop_unroll]: 3.493e-05 [a_1]: 0.00523838 [with_stream_mark]: 3.886e-05 [recompute_prepare]: 1.851e-05 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 3.69002e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 2.63998e-06 [specialize_transform]: 9.70002e-06 [updatestate_useless_node_eliminater]: 8.05999e-06 [accelerated_algorithm]: 9.07001e-06 [meta_shard_fg_expand]: 4.82998e-06 [get_grad_eliminate_]: 7.83001e-06 [merge_forward]: 5.81998e-06 [cell_reuse_recompute_pass]: 3.93001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.914e-05 [j_node_and_user_rematch]: 1.506e-05 [meta_fg_expand]: 3.86999e-06 [replace_old_param]: 1.405e-05 [inline_without_move]: 8.15e-06 [renormalize]: 0.00412802 [add_forward_monad_depend]: 1.366e-05 [auto_monad_grad]: 3.36999e-06 [auto_monad_eliminator]: 2.516e-05 [cse]: 4.064e-05 [replace_applicator]: 2.619e-05 [Cycle 2]: 0.00049312, [27] [switch_simplify]: 8.28001e-06 [loop_unroll]: 7.73999e-06 [a_1]: 0.00015439 [with_stream_mark]: 2.198e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 3.08998e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 7.71999e-06 [meta_shard_fg_expand]: 3.48e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 5.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.248e-05 [j_node_and_user_rematch]: 1.284e-05 [meta_fg_expand]: 3.66999e-06 [replace_old_param]: 1.337e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 1.96003e-06 [auto_monad_eliminator]: 1.083e-05 [cse]: 2.184e-05 [replace_applicator]: 7.78001e-06 [py_interpret_to_execute_after_opt_a]: 2.392e-05 [rewriter_after_opt_a]: 4.745e-05 [convert_after_rewriter]: 1.117e-05 [order_py_execute_after_rewriter]: 6.29999e-06 [mutable_eliminate]: 0.00107799 [jit_opt_b]: 7.575e-05, [1] [Cycle 1]: 6.556e-05, [2] [frontend_op_eliminate]: 2.734e-05 [inline_after_opt_a]: 2.307e-05 [cconv]: 3.901e-05 [loop_unroll]: 0.00065714 [jit_opt_after_cconv]: 0.00026598, [1] [Cycle 1]: 0.00025679, [11] [c_1]: 3.116e-05 [parameter_eliminate]: 6.31e-06 [updatestate_depend_eliminate]: 1.088e-05 [updatestate_assign_eliminate]: 4.62e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 4.562e-05 [call_graph_tuple_transform]: 7.853e-05 [tuple_list_get_item_eliminator]: 9.10001e-06 [none_parameter_eliminate]: 2.22999e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 6.94001e-06 [remove_dup_value]: 2e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 1.377e-05 [add_recomputation]: 0.0361755 [cse_after_recomputation]: 9.89e-05, [1] [Cycle 1]: 8.278e-05, [1] [cse]: 5.201e-05 [auto_monad_reorder]: 2.777e-05 [get_jit_bprop_graph]: 2.44999e-06 [rewriter_after_jit_bprop_graph]: 1.472e-05 [opt_after_jit_grad]: 0.00114621 [symbol_engine_optimizer]: 0.00010982, [1] [Cycle 1]: 0.00010125, [6] [build]: 6.93e-06 [elim_shapecalc]: 1.356e-05 [elim_not_effective]: 2.428e-05 [opt_reshape]: 8.69998e-06 [fold_const_symbol]: 1.254e-05 [renormalize]: 1.39998e-06 [validate]: 7.409e-05 Sums bootstrap : 0.000573s : 0.24% type_inference : 0.184542s : 78.28% event_method : 0.000027s : 0.01% auto_monad : 0.000092s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000540s : 0.23% rewriter_before_opt_a : 0.000112s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000094s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.005393s : 2.29% jit_opt_a.with_stream_mark : 0.000061s : 0.03% jit_opt_a.recompute_prepare : 0.000027s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000009s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000028s : 0.01% jit_opt_a.meta_fg_expand : 0.000008s : 0.00% jit_opt_a.replace_old_param : 0.000027s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.004128s : 1.75% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.02% jit_opt_a.cse : 0.000062s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000024s : 0.01% rewriter_after_opt_a : 0.000047s : 0.02% convert_after_rewriter : 0.000011s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001078s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.01% jit_opt_b.inline_after_opt_a : 0.000023s : 0.01% cconv : 0.000039s : 0.02% loop_unroll : 0.000657s : 0.28% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000079s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.01% add_recomputation : 0.036175s : 15.35% cse_after_recomputation.cse : 0.000052s : 0.02% auto_monad_reorder : 0.000028s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000015s : 0.01% opt_after_jit_grad : 0.001146s : 0.49% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000074s : 0.03% Time group info: ------[substitution.] 0.000355 24 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 2.28% : 0.000008s : 4: substitution.graph_param_transform 82.24% : 0.000292s : 4: substitution.inline 1.85% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000007s : 4: substitution.remove_not_recompute_node 2.84% : 0.000010s : 2: substitution.replace_old_param 7.67% : 0.000027s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.184391 2 97.87% : 0.180460s : 1: type_inference.infer 2.13% : 0.003930s : 1: type_inference.specialize ------[replace.] 0.000195 6 38.95% : 0.000076s : 4: replace.inline 61.05% : 0.000119s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000312 6 92.80% : 0.000289s : 4: match.inline 7.20% : 0.000022s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000220 830 1.75% : 0.000004s : 12: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.74% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000003s : 12: predicate.addn_zero_filter 2.25% : 0.000005s : 12: predicate.arithmetic_simplify 1.88% : 0.000004s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 12: predicate.compare_switch_simplify 1.23% : 0.000003s : 12: predicate.depend_value_elim 0.96% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.68% : 0.000004s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.77% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000003s : 12: predicate.environ_add_const_eliminate 0.81% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000003s : 12: predicate.environ_get_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 5.71% : 0.000013s : 26: predicate.inline 0.77% : 0.000002s : 8: predicate.inline_without_move 0.30% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000003s : 8: predicate.less_batch_normalization 1.49% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.67% : 0.000004s : 18: predicate.load_eliminater 2.01% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.12% : 0.000007s : 36: predicate.loop_unroll_before_grad 1.45% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.81% : 0.000002s : 12: predicate.merge_addn 0.67% : 0.000001s : 12: predicate.minmaximum_grad 2.69% : 0.000006s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 1.57% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000003s : 12: predicate.print_const_string_wrapper 2.12% : 0.000005s : 12: predicate.reduce_eliminate 2.14% : 0.000005s : 14: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.40% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000002s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.55% : 0.000003s : 12: predicate.reshape_eliminate 1.32% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000002s : 4: predicate.row_tensor_eliminate 1.45% : 0.000003s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000002s : 8: predicate.special_op_eliminate 0.64% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 6.05% : 0.000013s : 18: predicate.switch_defer_inline 1.72% : 0.000004s : 18: predicate.switch_layer_defer_inline 5.98% : 0.000013s : 58: predicate.switch_simplify 1.14% : 0.000003s : 12: predicate.tile_eliminate 1.28% : 0.000003s : 12: predicate.transpose_eliminate 1.34% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000009s : 22: predicate.tuple_list_get_item_eliminator 1.88% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.16% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.34% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000004s : 12: predicate.value_based_eliminate 0.25% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003985 26 67.45% : 0.002688s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.66% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.89% : 0.001231s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.252817 72 14.33% : 0.036218s : 1: add_recomputation 0.04% : 0.000097s : 1: auto_monad 0.01% : 0.000031s : 1: auto_monad_reorder 0.24% : 0.000613s : 1: bootstrap 0.02% : 0.000042s : 1: cconv 0.01% : 0.000014s : 1: convert_after_rewriter 0.04% : 0.000105s : 1: cse_after_recomputation 0.01% : 0.000018s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.61% : 0.016708s : 1: jit_opt_a 0.11% : 0.000271s : 1: jit_opt_after_cconv 0.03% : 0.000079s : 1: jit_opt_b 0.27% : 0.000670s : 1: loop_unroll 0.43% : 0.001099s : 1: mutable_eliminate 2.26% : 0.005718s : 26: opt.transform.jit_opt_a 0.05% : 0.000121s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000029s : 1: opt.transform.mutable_eliminate 0.02% : 0.000050s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000053s : 4: opt.transform.symbol_engine_opt 0.46% : 0.001162s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000549s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.09% : 0.002758s : 1: renormalize.infer 0.53% : 0.001352s : 1: renormalize.specialize 0.01% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000052s : 1: rewriter_after_opt_a 0.05% : 0.000120s : 1: rewriter_before_opt_a 0.04% : 0.000112s : 1: symbol_engine_optimizer 73.01% : 0.184574s : 1: type_inference TotalTime = 0.0563408, [30] [bootstrap]: 0.00045248 [type_inference]: 0.0453736 [event_method]: 2.352e-05 [auto_monad]: 7.691e-05 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 2.53998e-06 [py_interpret_to_execute]: 0.0001415 [rewriter_before_opt_a]: 9.337e-05 [expand_dump_flag]: 3.78999e-06 [jit_opt_a]: 0.00751171, [2] [Cycle 1]: 0.0023285, [27] [switch_simplify]: 7.053e-05 [loop_unroll]: 3.279e-05 [a_1]: 0.00064077 [with_stream_mark]: 2.723e-05 [recompute_prepare]: 8.18001e-06 [updatestate_depend_eliminate]: 4.00998e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.52001e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 6.10002e-06 [merge_forward]: 4.91002e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.025e-05 [inline_without_move]: 5.78002e-06 [renormalize]: 0.00118293 [add_forward_monad_depend]: 6.14001e-06 [auto_monad_grad]: 3.11001e-06 [auto_monad_eliminator]: 1.816e-05 [cse]: 4.019e-05 [replace_applicator]: 1.467e-05 [Cycle 2]: 0.00060015, [27] [switch_simplify]: 5.72001e-06 [loop_unroll]: 1.348e-05 [a_1]: 9.757e-05 [with_stream_mark]: 1.306e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.31002e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.17001e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 8.94998e-06 [cse]: 2.024e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.624e-05 [rewriter_after_opt_a]: 4.33e-05 [convert_after_rewriter]: 7.13998e-06 [order_py_execute_after_rewriter]: 5.55001e-06 [mutable_eliminate]: 0.00081334 [jit_opt_b]: 5.585e-05, [1] [Cycle 1]: 4.639e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.671e-05 [cconv]: 3.303e-05 [loop_unroll]: 0.00049669 [jit_opt_after_cconv]: 0.00016032, [1] [Cycle 1]: 0.00015284, [11] [c_1]: 2.159e-05 [parameter_eliminate]: 3.12002e-06 [updatestate_depend_eliminate]: 7.23e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.71999e-06 [cse]: 2.88e-05 [call_graph_tuple_transform]: 2.185e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 2.073e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 6.78998e-06 [add_recomputation]: 5.805e-05 [cse_after_recomputation]: 2.557e-05, [1] [Cycle 1]: 1.965e-05, [1] [cse]: 1.284e-05 [auto_monad_reorder]: 2.004e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 3.555e-05 [opt_after_jit_grad]: 0.0005124 [symbol_engine_optimizer]: 7.973e-05, [1] [Cycle 1]: 7.282e-05, [6] [build]: 5.02999e-06 [elim_shapecalc]: 8.87e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 3.9002e-07 [validate]: 4.775e-05 Sums bootstrap : 0.000452s : 0.89% type_inference : 0.045374s : 89.19% event_method : 0.000024s : 0.05% auto_monad : 0.000077s : 0.15% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000142s : 0.28% rewriter_before_opt_a : 0.000093s : 0.18% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.15% jit_opt_a.loop_unroll : 0.000046s : 0.09% jit_opt_a.a_1 : 0.000738s : 1.45% jit_opt_a.with_stream_mark : 0.000040s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001183s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.05% jit_opt_a.cse : 0.000060s : 0.12% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000043s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000813s : 1.60% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000033s : 0.06% loop_unroll : 0.000497s : 0.98% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000058s : 0.11% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000020s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000036s : 0.07% opt_after_jit_grad : 0.000512s : 1.01% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.09% Time group info: ------[substitution.] 0.000279 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 3: substitution.graph_param_transform 86.41% : 0.000241s : 4: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000006s : 2: substitution.replace_old_param 4.99% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045274 2 95.59% : 0.043278s : 1: type_inference.infer 4.41% : 0.001996s : 1: type_inference.specialize ------[replace.] 0.000085 6 69.51% : 0.000059s : 4: replace.inline 30.49% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 6 94.99% : 0.000239s : 4: match.inline 5.01% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.17% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.66% : 0.000002s : 10: predicate.addn_zero_filter 2.42% : 0.000003s : 10: predicate.arithmetic_simplify 1.65% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.04% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.39% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.87% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.89% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.69% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.80% : 0.000004s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.03% : 0.000001s : 10: predicate.print_const_string_wrapper 2.28% : 0.000003s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.69% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001023 13 42.98% : 0.000440s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.80% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.22% : 0.000524s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058560 72 0.10% : 0.000061s : 1: add_recomputation 0.14% : 0.000081s : 1: auto_monad 0.04% : 0.000023s : 1: auto_monad_reorder 0.81% : 0.000475s : 1: bootstrap 0.06% : 0.000036s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.84% : 0.007516s : 1: jit_opt_a 0.28% : 0.000163s : 1: jit_opt_after_cconv 0.10% : 0.000059s : 1: jit_opt_b 0.86% : 0.000506s : 1: loop_unroll 1.41% : 0.000825s : 1: mutable_eliminate 1.68% : 0.000985s : 26: opt.transform.jit_opt_a 0.09% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000521s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000147s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000023s : 1: remove_dup_value 1.21% : 0.000709s : 1: renormalize.infer 0.79% : 0.000465s : 1: renormalize.specialize 0.06% : 0.000038s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000046s : 1: rewriter_after_opt_a 0.17% : 0.000097s : 1: rewriter_before_opt_a 0.14% : 0.000082s : 1: symbol_engine_optimizer 77.53% : 0.045401s : 1: type_inference TotalTime = 0.0150142, [30] [bootstrap]: 0.00031491 [type_inference]: 0.0049122 [event_method]: 1.959e-05 [auto_monad]: 6.631e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 3.388e-05 [rewriter_before_opt_a]: 7.461e-05 [expand_dump_flag]: 3.00002e-06 [jit_opt_a]: 0.0073921, [2] [Cycle 1]: 0.00169695, [27] [switch_simplify]: 6.194e-05 [loop_unroll]: 2.932e-05 [a_1]: 0.00055297 [with_stream_mark]: 2.437e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.44998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.31998e-06 [updatestate_useless_node_eliminater]: 5.46002e-06 [accelerated_algorithm]: 5.78002e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 8.64e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00068885 [add_forward_monad_depend]: 5.17999e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.446e-05 [cse]: 3.651e-05 [replace_applicator]: 1.234e-05 [Cycle 2]: 0.00031574, [27] [switch_simplify]: 5.56002e-06 [loop_unroll]: 4.94e-06 [a_1]: 8.777e-05 [with_stream_mark]: 9.20999e-06 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.69998e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.09003e-06 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.23e-05 [j_node_and_user_rematch]: 8.16002e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.89998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.34e-06 [cse]: 1.224e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.431e-05 [rewriter_after_opt_a]: 3.625e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 5.67001e-06 [mutable_eliminate]: 0.00058691 [jit_opt_b]: 5.409e-05, [1] [Cycle 1]: 4.672e-05, [2] [frontend_op_eliminate]: 1.468e-05 [inline_after_opt_a]: 2.153e-05 [cconv]: 2.8e-05 [loop_unroll]: 0.00041825 [jit_opt_after_cconv]: 0.00014492, [1] [Cycle 1]: 0.00013827, [11] [c_1]: 2.036e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 2.463e-05 [call_graph_tuple_transform]: 1.832e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 1.568e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 5.155e-05 [cse_after_recomputation]: 2.311e-05, [1] [Cycle 1]: 1.775e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.806e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 5.05999e-06 [opt_after_jit_grad]: 0.00048078 [symbol_engine_optimizer]: 7.2e-05, [1] [Cycle 1]: 6.532e-05, [6] [build]: 4.79998e-06 [elim_shapecalc]: 7.6e-06 [elim_not_effective]: 1.213e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.06001e-06 [renormalize]: 3.80009e-07 [validate]: 4.025e-05 Sums bootstrap : 0.000315s : 3.48% type_inference : 0.004912s : 54.27% event_method : 0.000020s : 0.22% auto_monad : 0.000066s : 0.73% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000034s : 0.37% rewriter_before_opt_a : 0.000075s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.75% jit_opt_a.loop_unroll : 0.000034s : 0.38% jit_opt_a.a_1 : 0.000641s : 7.08% jit_opt_a.with_stream_mark : 0.000034s : 0.37% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000689s : 7.61% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000049s : 0.54% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.16% rewriter_after_opt_a : 0.000036s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000587s : 6.48% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000022s : 0.24% cconv : 0.000028s : 0.31% loop_unroll : 0.000418s : 4.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000025s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000052s : 0.57% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000481s : 5.31% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.44% Time group info: ------[substitution.] 0.000228 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.63% : 0.000006s : 3: substitution.graph_param_transform 85.20% : 0.000194s : 4: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 5.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004847 2 82.19% : 0.003984s : 1: type_inference.infer 17.81% : 0.000863s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.71% : 0.000049s : 4: replace.inline 31.29% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.47% : 0.000192s : 4: match.inline 5.53% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.28% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.83% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.72% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.28% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000630 13 53.60% : 0.000337s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.65% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.75% : 0.000244s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016617 72 0.33% : 0.000055s : 1: add_recomputation 0.42% : 0.000070s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 2.02% : 0.000335s : 1: bootstrap 0.18% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 44.51% : 0.007396s : 1: jit_opt_a 0.89% : 0.000148s : 1: jit_opt_after_cconv 0.34% : 0.000057s : 1: jit_opt_b 2.57% : 0.000427s : 1: loop_unroll 3.58% : 0.000595s : 1: mutable_eliminate 5.17% : 0.000859s : 26: opt.transform.jit_opt_a 0.28% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000030s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.94% : 0.000489s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000037s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.26% : 0.000375s : 1: renormalize.infer 1.84% : 0.000306s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000039s : 1: rewriter_after_opt_a 0.47% : 0.000077s : 1: rewriter_before_opt_a 0.45% : 0.000074s : 1: symbol_engine_optimizer 29.67% : 0.004930s : 1: type_inference TotalTime = 0.0782233, [30] [bootstrap]: 0.00042153 [type_inference]: 0.0659156 [event_method]: 2.711e-05 [auto_monad]: 8.805e-05 [graph_reusing]: 7.97e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 0.00015901 [rewriter_before_opt_a]: 9.884e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00834316, [2] [Cycle 1]: 0.00252857, [27] [switch_simplify]: 7.63e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00065578 [with_stream_mark]: 2.702e-05 [recompute_prepare]: 8.63001e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.80997e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 4.68001e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.714e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.96998e-06 [renormalize]: 0.00132002 [add_forward_monad_depend]: 8.57e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 2.014e-05 [cse]: 4.325e-05 [replace_applicator]: 1.903e-05 [Cycle 2]: 0.00035512, [27] [switch_simplify]: 7.08998e-06 [loop_unroll]: 5.59998e-06 [a_1]: 9.577e-05 [with_stream_mark]: 1.482e-05 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 3.50003e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.46998e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.91997e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 3.83001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.763e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.40001e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.66999e-06 [cse]: 1.451e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.806e-05 [rewriter_after_opt_a]: 8.968e-05 [convert_after_rewriter]: 8.85001e-06 [order_py_execute_after_rewriter]: 5.75001e-06 [mutable_eliminate]: 0.000937 [jit_opt_b]: 5.674e-05, [1] [Cycle 1]: 4.843e-05, [2] [frontend_op_eliminate]: 1.746e-05 [inline_after_opt_a]: 1.896e-05 [cconv]: 3.442e-05 [loop_unroll]: 0.00051951 [jit_opt_after_cconv]: 0.00019181, [1] [Cycle 1]: 0.00018264, [11] [c_1]: 2.286e-05 [parameter_eliminate]: 6.09001e-06 [updatestate_depend_eliminate]: 1.02e-05 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 4.395e-05 [call_graph_tuple_transform]: 2.623e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.76003e-06 [renormalize]: 1.02e-06 [switch_simplify]: 6.46999e-06 [remove_dup_value]: 2.046e-05 [partial_unused_args_eliminate]: 2.13002e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 6.46e-05 [cse_after_recomputation]: 2.474e-05, [1] [Cycle 1]: 1.861e-05, [1] [cse]: 1.29e-05 [auto_monad_reorder]: 1.989e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 7.585e-05 [opt_after_jit_grad]: 0.00063685 [symbol_engine_optimizer]: 0.00014155, [1] [Cycle 1]: 0.00013306, [6] [build]: 6.53e-06 [elim_shapecalc]: 5.349e-05 [elim_not_effective]: 1.772e-05 [opt_reshape]: 7.66999e-06 [fold_const_symbol]: 9.97999e-06 [renormalize]: 6.59988e-07 [validate]: 6.073e-05 Sums bootstrap : 0.000422s : 0.59% type_inference : 0.065916s : 91.48% event_method : 0.000027s : 0.04% auto_monad : 0.000088s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000159s : 0.22% rewriter_before_opt_a : 0.000099s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.12% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000752s : 1.04% jit_opt_a.with_stream_mark : 0.000042s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001320s : 1.83% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.04% jit_opt_a.cse : 0.000058s : 0.08% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.03% rewriter_after_opt_a : 0.000090s : 0.12% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000937s : 1.30% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000034s : 0.05% loop_unroll : 0.000520s : 0.72% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000065s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000076s : 0.11% opt_after_jit_grad : 0.000637s : 0.88% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000053s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.08% Time group info: ------[substitution.] 0.000291 23 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000008s : 3: substitution.graph_param_transform 86.00% : 0.000251s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000006s : 4: substitution.remove_not_recompute_node 2.06% : 0.000006s : 2: substitution.replace_old_param 4.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065795 2 96.74% : 0.063648s : 1: type_inference.infer 3.26% : 0.002146s : 1: type_inference.specialize ------[replace.] 0.000088 6 69.84% : 0.000061s : 4: replace.inline 30.16% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 6 95.48% : 0.000248s : 4: match.inline 4.52% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.16% : 0.000002s : 10: predicate.accumulaten_eliminater 1.18% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.92% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000002s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.93% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.52% : 0.000007s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 15: predicate.load_eliminater 2.49% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.44% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.68% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.34% : 0.000003s : 3: predicate.mutable_eliminate 0.82% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 0.97% : 0.000001s : 10: predicate.print_const_string_wrapper 1.98% : 0.000003s : 10: predicate.reduce_eliminate 1.65% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.64% : 0.000002s : 10: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.24% : 0.000011s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.49% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001046 13 40.03% : 0.000419s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.93% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.04% : 0.000565s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.080645 72 0.08% : 0.000067s : 1: add_recomputation 0.12% : 0.000093s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.55% : 0.000440s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000034s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 10.35% : 0.008348s : 1: jit_opt_a 0.24% : 0.000195s : 1: jit_opt_after_cconv 0.07% : 0.000060s : 1: jit_opt_b 0.66% : 0.000531s : 1: loop_unroll 1.18% : 0.000949s : 1: mutable_eliminate 1.25% : 0.001006s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.03% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000084s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000648s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000165s : 1: py_interpret_to_execute 0.03% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 0.98% : 0.000792s : 1: renormalize.infer 0.64% : 0.000517s : 1: renormalize.specialize 0.10% : 0.000078s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000094s : 1: rewriter_after_opt_a 0.13% : 0.000104s : 1: rewriter_before_opt_a 0.18% : 0.000145s : 1: symbol_engine_optimizer 81.78% : 0.065954s : 1: type_inference TotalTime = 0.312202, [30] [bootstrap]: 0.00045101 [type_inference]: 0.294204 [event_method]: 2.367e-05 [auto_monad]: 8.384e-05 [graph_reusing]: 7.18e-06 [pre_auto_parallel]: 3.56001e-06 [py_interpret_to_execute]: 0.00086854 [rewriter_before_opt_a]: 0.00010014 [expand_dump_flag]: 4.03001e-06 [jit_opt_a]: 0.0124088, [2] [Cycle 1]: 0.00651233, [27] [switch_simplify]: 7.826e-05 [loop_unroll]: 3.42e-05 [a_1]: 0.00096481 [with_stream_mark]: 3.427e-05 [recompute_prepare]: 1.88e-05 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 4.74e-06 [updatestate_loads_eliminate]: 3.54002e-06 [parameter_eliminate]: 2.93e-06 [specialize_transform]: 1.006e-05 [updatestate_useless_node_eliminater]: 8.17e-06 [accelerated_algorithm]: 8.50001e-06 [meta_shard_fg_expand]: 3.08e-06 [get_grad_eliminate_]: 9.18002e-06 [merge_forward]: 5.23002e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.471e-05 [j_node_and_user_rematch]: 1.5e-05 [meta_fg_expand]: 4.2e-06 [replace_old_param]: 1.55e-05 [inline_without_move]: 7.30998e-06 [renormalize]: 0.00480103 [add_forward_monad_depend]: 1.524e-05 [auto_monad_grad]: 3.57002e-06 [auto_monad_eliminator]: 3.125e-05 [cse]: 3.954e-05 [replace_applicator]: 3.091e-05 [Cycle 2]: 0.00065876, [27] [switch_simplify]: 9.39e-06 [loop_unroll]: 8.83001e-06 [a_1]: 0.00018411 [with_stream_mark]: 2.68e-05 [recompute_prepare]: 1.28e-05 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 8.30999e-06 [updatestate_useless_node_eliminater]: 8.35001e-06 [accelerated_algorithm]: 1.021e-05 [meta_shard_fg_expand]: 3.31001e-06 [get_grad_eliminate_]: 6.48e-06 [merge_forward]: 6.23e-06 [cell_reuse_recompute_pass]: 3.63999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.561e-05 [j_node_and_user_rematch]: 1.348e-05 [meta_fg_expand]: 3.9e-06 [replace_old_param]: 1.414e-05 [inline_without_move]: 7.6e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 5.07999e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.948e-05 [cse]: 2.744e-05 [replace_applicator]: 1.26e-05 [py_interpret_to_execute_after_opt_a]: 2.473e-05 [rewriter_after_opt_a]: 5.324e-05 [convert_after_rewriter]: 1.102e-05 [order_py_execute_after_rewriter]: 4.82e-05 [mutable_eliminate]: 0.00122447 [jit_opt_b]: 8.348e-05, [1] [Cycle 1]: 7.312e-05, [2] [frontend_op_eliminate]: 2.969e-05 [inline_after_opt_a]: 2.862e-05 [cconv]: 4.106e-05 [loop_unroll]: 0.00076025 [jit_opt_after_cconv]: 0.0002287, [1] [Cycle 1]: 0.00021893, [11] [c_1]: 3.169e-05 [parameter_eliminate]: 6.78998e-06 [updatestate_depend_eliminate]: 1.253e-05 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 4.704e-05 [call_graph_tuple_transform]: 3.187e-05 [tuple_list_get_item_eliminator]: 7.92e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 9.43002e-06 [remove_dup_value]: 1.893e-05 [partial_unused_args_eliminate]: 3.31999e-06 [environ_conv]: 1.282e-05 [add_recomputation]: 6.628e-05 [cse_after_recomputation]: 3.092e-05, [1] [Cycle 1]: 2.399e-05, [1] [cse]: 1.358e-05 [auto_monad_reorder]: 1.867e-05 [get_jit_bprop_graph]: 2.61e-06 [rewriter_after_jit_bprop_graph]: 1.518e-05 [opt_after_jit_grad]: 0.00089165 [symbol_engine_optimizer]: 0.00011267, [1] [Cycle 1]: 0.00010466, [6] [build]: 6.86999e-06 [elim_shapecalc]: 9.76e-06 [elim_not_effective]: 1.744e-05 [opt_reshape]: 1.278e-05 [fold_const_symbol]: 2.095e-05 [renormalize]: 8.39995e-07 [validate]: 7.268e-05 Sums bootstrap : 0.000451s : 0.15% type_inference : 0.294204s : 96.17% event_method : 0.000024s : 0.01% auto_monad : 0.000084s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000869s : 0.28% rewriter_before_opt_a : 0.000100s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.001149s : 0.38% jit_opt_a.with_stream_mark : 0.000061s : 0.02% jit_opt_a.recompute_prepare : 0.000032s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000017s : 0.01% jit_opt_a.accelerated_algorithm : 0.000019s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000050s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000028s : 0.01% jit_opt_a.meta_fg_expand : 0.000008s : 0.00% jit_opt_a.replace_old_param : 0.000030s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.004801s : 1.57% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000006s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000051s : 0.02% jit_opt_a.cse : 0.000067s : 0.02% jit_opt_a.replace_applicator : 0.000044s : 0.01% py_interpret_to_execute_after_opt_a : 0.000025s : 0.01% rewriter_after_opt_a : 0.000053s : 0.02% convert_after_rewriter : 0.000011s : 0.00% order_py_execute_after_rewriter : 0.000048s : 0.02% mutable_eliminate : 0.001224s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.01% jit_opt_b.inline_after_opt_a : 0.000029s : 0.01% cconv : 0.000041s : 0.01% loop_unroll : 0.000760s : 0.25% jit_opt_after_cconv.c_1 : 0.000032s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000066s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000015s : 0.00% opt_after_jit_grad : 0.000892s : 0.29% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000013s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000021s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000073s : 0.02% Time group info: ------[substitution.] 0.000423 24 0.54% : 0.000002s : 2: substitution.elim_not_effective 2.05% : 0.000009s : 2: substitution.fold_const_symbol 1.81% : 0.000008s : 4: substitution.graph_param_transform 84.78% : 0.000358s : 4: substitution.inline 1.53% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000008s : 4: substitution.remove_not_recompute_node 2.54% : 0.000011s : 2: substitution.replace_old_param 4.93% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.294082 2 98.28% : 0.289011s : 1: type_inference.infer 1.72% : 0.005071s : 1: type_inference.specialize ------[replace.] 0.000131 6 65.23% : 0.000086s : 4: replace.inline 34.77% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000370 6 94.92% : 0.000352s : 4: match.inline 5.08% : 0.000019s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000215 830 1.93% : 0.000004s : 12: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.77% : 0.000002s : 12: predicate.addn_check_dump 1.60% : 0.000003s : 12: predicate.addn_zero_filter 2.25% : 0.000005s : 12: predicate.arithmetic_simplify 1.00% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 0.64% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000003s : 12: predicate.depend_value_elim 1.18% : 0.000003s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.02% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.17% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.24% : 0.000003s : 12: predicate.environ_get_depend_swap 1.35% : 0.000003s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 4.97% : 0.000011s : 26: predicate.inline 1.25% : 0.000003s : 8: predicate.inline_without_move 0.28% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000003s : 8: predicate.less_batch_normalization 2.25% : 0.000005s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000004s : 18: predicate.load_eliminater 2.48% : 0.000005s : 4: predicate.loop_unroll_after_grad 3.20% : 0.000007s : 36: predicate.loop_unroll_before_grad 1.62% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000003s : 12: predicate.merge_addn 0.75% : 0.000002s : 12: predicate.minmaximum_grad 3.13% : 0.000007s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 1.68% : 0.000004s : 18: predicate.partial_eliminate 1.65% : 0.000004s : 12: predicate.print_const_string_wrapper 2.11% : 0.000005s : 12: predicate.reduce_eliminate 1.24% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000002s : 8: predicate.remove_not_recompute_node 2.23% : 0.000005s : 22: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.93% : 0.000004s : 12: predicate.reshape_eliminate 1.45% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000002s : 4: predicate.row_tensor_eliminate 1.70% : 0.000004s : 12: predicate.same_eliminate 0.73% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000002s : 8: predicate.specialize_transform 1.64% : 0.000004s : 12: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.76% : 0.000006s : 18: predicate.switch_defer_inline 1.39% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.00% : 0.000013s : 58: predicate.switch_simplify 1.38% : 0.000003s : 12: predicate.tile_eliminate 1.09% : 0.000002s : 12: predicate.transpose_eliminate 1.03% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.84% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.66% : 0.000004s : 14: predicate.tuple_to_list_eliminator_ 1.07% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.15% : 0.000007s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000004s : 12: predicate.value_based_eliminate 0.24% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004424 22 70.24% : 0.003107s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.61% : 0.000071s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.15% : 0.001246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.318603 72 0.02% : 0.000071s : 1: add_recomputation 0.03% : 0.000088s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.15% : 0.000472s : 1: bootstrap 0.01% : 0.000045s : 1: cconv 0.00% : 0.000014s : 1: convert_after_rewriter 0.01% : 0.000036s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000038s : 1: graph_reusing 3.90% : 0.012414s : 1: jit_opt_a 0.07% : 0.000232s : 1: jit_opt_after_cconv 0.03% : 0.000087s : 1: jit_opt_b 0.24% : 0.000779s : 1: loop_unroll 0.39% : 0.001250s : 1: mutable_eliminate 0.47% : 0.001497s : 26: opt.transform.jit_opt_a 0.02% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000047s : 4: opt.transform.jit_opt_b 0.01% : 0.000026s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000037s : 1: opt.transform.mutable_eliminate 0.01% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000056s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000906s : 1: opt_after_jit_grad 0.02% : 0.000053s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.28% : 0.000879s : 1: py_interpret_to_execute 0.01% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.02% : 0.003257s : 1: renormalize.infer 0.48% : 0.001523s : 1: renormalize.specialize 0.01% : 0.000018s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000059s : 1: rewriter_after_opt_a 0.03% : 0.000107s : 1: rewriter_before_opt_a 0.04% : 0.000116s : 1: symbol_engine_optimizer 92.35% : 0.294238s : 1: type_inference TotalTime = 0.150798, [30] [bootstrap]: 0.00030848 [type_inference]: 0.121046 [event_method]: 2.559e-05 [auto_monad]: 8.245e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 3.02002e-06 [py_interpret_to_execute]: 0.0001693 [rewriter_before_opt_a]: 9.569e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0257966, [2] [Cycle 1]: 0.00295376, [27] [switch_simplify]: 0.00013891 [loop_unroll]: 3.19e-05 [a_1]: 0.00072777 [with_stream_mark]: 2.497e-05 [recompute_prepare]: 9.62999e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 8.03001e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 7.16999e-06 [meta_shard_fg_expand]: 3.65e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 4.99998e-06 [cell_reuse_recompute_pass]: 2.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.718e-05 [j_node_and_user_rematch]: 9.78002e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.11e-05 [inline_without_move]: 5.93998e-06 [renormalize]: 0.00161854 [add_forward_monad_depend]: 1.013e-05 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 2.084e-05 [cse]: 3.928e-05 [replace_applicator]: 1.953e-05 [Cycle 2]: 0.00037745, [27] [switch_simplify]: 7.06999e-06 [loop_unroll]: 5.57999e-06 [a_1]: 0.00010096 [with_stream_mark]: 1.378e-05 [recompute_prepare]: 5.92001e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 3.68999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.14e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 2.12999e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 1.006e-05 [cse]: 1.607e-05 [replace_applicator]: 7.61999e-06 [py_interpret_to_execute_after_opt_a]: 1.705e-05 [rewriter_after_opt_a]: 4.555e-05 [convert_after_rewriter]: 7.45998e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00098481 [jit_opt_b]: 6.6e-05, [1] [Cycle 1]: 5.549e-05, [2] [frontend_op_eliminate]: 2.387e-05 [inline_after_opt_a]: 1.899e-05 [cconv]: 3.429e-05 [loop_unroll]: 0.00064916 [jit_opt_after_cconv]: 0.00022615, [1] [Cycle 1]: 0.00021718, [11] [c_1]: 2.469e-05 [parameter_eliminate]: 4.4e-06 [updatestate_depend_eliminate]: 1.032e-05 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 3.404e-05 [call_graph_tuple_transform]: 6.59e-05 [tuple_list_get_item_eliminator]: 6.51999e-06 [none_parameter_eliminate]: 2.01998e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.96001e-06 [remove_dup_value]: 1.872e-05 [partial_unused_args_eliminate]: 3.21001e-06 [environ_conv]: 7.58001e-06 [add_recomputation]: 6.412e-05 [cse_after_recomputation]: 3.329e-05, [1] [Cycle 1]: 2.531e-05, [1] [cse]: 1.663e-05 [auto_monad_reorder]: 1.996e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 8.77999e-06 [opt_after_jit_grad]: 0.00067924 [symbol_engine_optimizer]: 8.786e-05, [1] [Cycle 1]: 7.979e-05, [6] [build]: 4.72998e-06 [elim_shapecalc]: 9.22001e-06 [elim_not_effective]: 1.529e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 1.09e-05 [renormalize]: 6.19999e-07 [validate]: 5.419e-05 Sums bootstrap : 0.000308s : 0.24% type_inference : 0.121046s : 94.86% event_method : 0.000026s : 0.02% auto_monad : 0.000082s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000169s : 0.13% rewriter_before_opt_a : 0.000096s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000146s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000829s : 0.65% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001619s : 1.27% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000985s : 0.77% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.03% loop_unroll : 0.000649s : 0.51% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000066s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000064s : 0.05% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000679s : 0.53% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.04% Time group info: ------[substitution.] 0.000343 23 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 12.62% : 0.000043s : 3: substitution.graph_param_transform 76.96% : 0.000264s : 4: substitution.inline 1.19% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000006s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 4.53% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120933 2 98.10% : 0.118636s : 1: type_inference.infer 1.90% : 0.002297s : 1: type_inference.specialize ------[replace.] 0.000107 6 64.11% : 0.000069s : 4: replace.inline 35.89% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 6 94.71% : 0.000260s : 4: match.inline 5.29% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000180 691 1.07% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.68% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000002s : 10: predicate.addn_zero_filter 2.25% : 0.000004s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 0.79% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000002s : 10: predicate.depend_value_elim 0.69% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.91% : 0.000003s : 10: predicate.dict_set_item_eliminator 1.33% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.69% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.84% : 0.000002s : 10: predicate.environ_get_depend_swap 0.93% : 0.000002s : 10: predicate.environ_get_eliminate 0.80% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.76% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 4.42% : 0.000008s : 22: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000003s : 6: predicate.less_batch_normalization 1.22% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.46% : 0.000003s : 15: predicate.load_eliminater 1.49% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.14% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.69% : 0.000001s : 10: predicate.merge_addn 0.81% : 0.000001s : 10: predicate.minmaximum_grad 1.84% : 0.000003s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 1.69% : 0.000003s : 15: predicate.partial_eliminate 0.98% : 0.000002s : 10: predicate.print_const_string_wrapper 2.20% : 0.000004s : 10: predicate.reduce_eliminate 1.12% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.28% : 0.000002s : 18: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000001s : 3: predicate.reset_defer_inline 1.13% : 0.000002s : 10: predicate.reshape_eliminate 0.84% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.16% : 0.000002s : 3: predicate.row_tensor_eliminate 1.06% : 0.000002s : 10: predicate.same_eliminate 0.37% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.62% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.94% : 0.000004s : 16: predicate.switch_defer_inline 1.48% : 0.000003s : 16: predicate.switch_layer_defer_inline 21.16% : 0.000038s : 53: predicate.switch_simplify 1.09% : 0.000002s : 10: predicate.tile_eliminate 1.06% : 0.000002s : 10: predicate.transpose_eliminate 1.08% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.09% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.26% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.06% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 10: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001056 13 35.62% : 0.000376s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.98% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.40% : 0.000617s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153671 72 0.04% : 0.000068s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.22% : 0.000331s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 16.79% : 0.025802s : 1: jit_opt_a 0.15% : 0.000230s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.43% : 0.000661s : 1: loop_unroll 0.65% : 0.000998s : 1: mutable_eliminate 0.75% : 0.001153s : 26: opt.transform.jit_opt_a 0.06% : 0.000098s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000693s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000174s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.61% : 0.000935s : 1: renormalize.infer 0.44% : 0.000670s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.06% : 0.000099s : 1: rewriter_before_opt_a 0.06% : 0.000091s : 1: symbol_engine_optimizer 78.79% : 0.121080s : 1: type_inference TotalTime = 0.0617809, [30] [bootstrap]: 0.00040525 [type_inference]: 0.0512586 [event_method]: 2.247e-05 [auto_monad]: 7.56e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00012156 [rewriter_before_opt_a]: 8.677e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00692443, [2] [Cycle 1]: 0.00233825, [27] [switch_simplify]: 6.347e-05 [loop_unroll]: 3.131e-05 [a_1]: 0.00059483 [with_stream_mark]: 2.185e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 2.58003e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.87998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 3.06999e-06 [replace_old_param]: 9.92001e-06 [inline_without_move]: 6.84999e-06 [renormalize]: 0.00124167 [add_forward_monad_depend]: 8.07e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.946e-05 [cse]: 4.147e-05 [replace_applicator]: 1.682e-05 [Cycle 2]: 0.00037127, [27] [switch_simplify]: 7.2e-06 [loop_unroll]: 6.32001e-06 [a_1]: 0.00010638 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 6.08998e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.56002e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 2.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 3.08998e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.506e-05 [replace_applicator]: 6.68e-06 [py_interpret_to_execute_after_opt_a]: 1.754e-05 [rewriter_after_opt_a]: 4.265e-05 [convert_after_rewriter]: 8.25e-06 [order_py_execute_after_rewriter]: 5.62999e-06 [mutable_eliminate]: 0.00085137 [jit_opt_b]: 6.52e-05, [1] [Cycle 1]: 5.469e-05, [2] [frontend_op_eliminate]: 2.418e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 3.523e-05 [loop_unroll]: 0.00052194 [jit_opt_after_cconv]: 0.00017981, [1] [Cycle 1]: 0.00017186, [11] [c_1]: 2.403e-05 [parameter_eliminate]: 3.65998e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.92002e-06 [cse]: 3.81e-05 [call_graph_tuple_transform]: 2.309e-05 [tuple_list_get_item_eliminator]: 5.68997e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 1.833e-05 [partial_unused_args_eliminate]: 3.44001e-06 [environ_conv]: 6.74999e-06 [add_recomputation]: 5.688e-05 [cse_after_recomputation]: 2.37e-05, [1] [Cycle 1]: 1.81e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.889e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 8.03001e-06 [opt_after_jit_grad]: 0.00056687 [symbol_engine_optimizer]: 8.656e-05, [1] [Cycle 1]: 7.901e-05, [6] [build]: 5.25001e-06 [elim_shapecalc]: 7.83999e-06 [elim_not_effective]: 1.636e-05 [opt_reshape]: 7.46001e-06 [fold_const_symbol]: 1.128e-05 [renormalize]: 2.69996e-07 [validate]: 5.2e-05 Sums bootstrap : 0.000405s : 0.71% type_inference : 0.051259s : 90.23% event_method : 0.000022s : 0.04% auto_monad : 0.000076s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000122s : 0.21% rewriter_before_opt_a : 0.000087s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.12% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000701s : 1.23% jit_opt_a.with_stream_mark : 0.000035s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.001242s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.05% jit_opt_a.cse : 0.000057s : 0.10% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.03% rewriter_after_opt_a : 0.000043s : 0.08% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000851s : 1.50% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000035s : 0.06% loop_unroll : 0.000522s : 0.92% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000057s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000567s : 1.00% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.09% Time group info: ------[substitution.] 0.000244 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 2.97% : 0.000007s : 3: substitution.graph_param_transform 84.62% : 0.000206s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.08% : 0.000005s : 2: substitution.replace_old_param 5.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051164 2 96.50% : 0.049374s : 1: type_inference.infer 3.50% : 0.001790s : 1: type_inference.specialize ------[replace.] 0.000082 6 69.32% : 0.000057s : 4: replace.inline 30.68% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.72% : 0.000203s : 4: match.inline 5.28% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000002s : 10: predicate.addn_zero_filter 2.49% : 0.000003s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.05% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.16% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.25% : 0.000007s : 22: predicate.inline 1.08% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.96% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.22% : 0.000003s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 2.10% : 0.000003s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000010s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001050 13 44.39% : 0.000466s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.43% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.18% : 0.000537s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063951 72 0.10% : 0.000061s : 1: add_recomputation 0.12% : 0.000079s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.68% : 0.000435s : 1: bootstrap 0.06% : 0.000039s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.83% : 0.006928s : 1: jit_opt_a 0.29% : 0.000183s : 1: jit_opt_after_cconv 0.11% : 0.000068s : 1: jit_opt_b 0.83% : 0.000534s : 1: loop_unroll 1.35% : 0.000863s : 1: mutable_eliminate 1.48% : 0.000944s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000035s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.90% : 0.000577s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000126s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.93% : 0.000597s : 1: renormalize.infer 0.99% : 0.000635s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000046s : 1: rewriter_after_opt_a 0.14% : 0.000091s : 1: rewriter_before_opt_a 0.14% : 0.000090s : 1: symbol_engine_optimizer 80.19% : 0.051284s : 1: type_inference TotalTime = 0.427235, [30] [bootstrap]: 0.00036344 [type_inference]: 0.401491 [event_method]: 2.817e-05 [auto_monad]: 8.852e-05 [graph_reusing]: 6.71e-06 [pre_auto_parallel]: 2.63998e-06 [py_interpret_to_execute]: 0.0005912 [rewriter_before_opt_a]: 0.00011198 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.0217534, [2] [Cycle 1]: 0.0172779, [27] [switch_simplify]: 7.266e-05 [loop_unroll]: 3.376e-05 [a_1]: 0.00082192 [with_stream_mark]: 2.812e-05 [recompute_prepare]: 1.056e-05 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.9e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 3.11001e-06 [specialize_transform]: 8.59998e-06 [updatestate_useless_node_eliminater]: 0.0121596 [accelerated_algorithm]: 2.662e-05 [meta_shard_fg_expand]: 7.28999e-06 [get_grad_eliminate_]: 1.094e-05 [merge_forward]: 1.783e-05 [cell_reuse_recompute_pass]: 3.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.407e-05 [j_node_and_user_rematch]: 1.453e-05 [meta_fg_expand]: 4.00998e-06 [replace_old_param]: 1.616e-05 [inline_without_move]: 8.38999e-06 [renormalize]: 0.00359201 [add_forward_monad_depend]: 1.012e-05 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.235e-05 [cse]: 3.972e-05 [replace_applicator]: 2.577e-05 [Cycle 2]: 0.00043095, [27] [switch_simplify]: 8.14002e-06 [loop_unroll]: 6.93e-06 [a_1]: 0.00014314 [with_stream_mark]: 1.56e-05 [recompute_prepare]: 6.78e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 6.66999e-06 [accelerated_algorithm]: 6.84001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 2.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.96e-05 [j_node_and_user_rematch]: 1.146e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.032e-05 [inline_without_move]: 6.03998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 1.40001e-06 [auto_monad_eliminator]: 7.25e-06 [cse]: 1.617e-05 [replace_applicator]: 6.74999e-06 [py_interpret_to_execute_after_opt_a]: 1.643e-05 [rewriter_after_opt_a]: 4.406e-05 [convert_after_rewriter]: 6.83998e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00082187 [jit_opt_b]: 6.364e-05, [1] [Cycle 1]: 5.366e-05, [2] [frontend_op_eliminate]: 2.085e-05 [inline_after_opt_a]: 2.172e-05 [cconv]: 3.194e-05 [loop_unroll]: 0.00045846 [jit_opt_after_cconv]: 0.00017924, [1] [Cycle 1]: 0.00017193, [11] [c_1]: 2.744e-05 [parameter_eliminate]: 4.06001e-06 [updatestate_depend_eliminate]: 9.57001e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 3.207e-05 [call_graph_tuple_transform]: 2.551e-05 [tuple_list_get_item_eliminator]: 6.74001e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.78e-06 [remove_dup_value]: 2.041e-05 [partial_unused_args_eliminate]: 3.58999e-06 [environ_conv]: 1.088e-05 [add_recomputation]: 5.736e-05 [cse_after_recomputation]: 2.622e-05, [1] [Cycle 1]: 2.04e-05, [1] [cse]: 1.452e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 2.46998e-06 [rewriter_after_jit_bprop_graph]: 7.5e-06 [opt_after_jit_grad]: 0.00052142 [symbol_engine_optimizer]: 0.00013554, [1] [Cycle 1]: 0.00012859, [6] [build]: 5.15999e-06 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 1.567e-05 [opt_reshape]: 5.801e-05 [fold_const_symbol]: 1.108e-05 [renormalize]: 7.2e-07 [validate]: 0.00013024 Sums bootstrap : 0.000363s : 0.09% type_inference : 0.401491s : 95.05% event_method : 0.000028s : 0.01% auto_monad : 0.000089s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000591s : 0.14% rewriter_before_opt_a : 0.000112s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000965s : 0.23% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.012166s : 2.88% jit_opt_a.accelerated_algorithm : 0.000033s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.00% jit_opt_a.merge_forward : 0.000022s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.003592s : 0.85% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000056s : 0.01% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000822s : 0.19% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000458s : 0.11% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.00% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000521s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000058s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000130s : 0.03% Time group info: ------[substitution.] 0.000349 25 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000007s : 4: substitution.graph_param_transform 86.43% : 0.000302s : 5: substitution.inline 1.98% : 0.000007s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000007s : 4: substitution.remove_not_recompute_node 2.74% : 0.000010s : 2: substitution.replace_old_param 3.98% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.401374 2 99.08% : 0.397701s : 1: type_inference.infer 0.92% : 0.003673s : 1: type_inference.specialize ------[replace.] 0.000121 7 70.48% : 0.000085s : 5: replace.inline 29.52% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000311 7 95.94% : 0.000298s : 5: match.inline 4.06% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000004s : 13: predicate.arithmetic_simplify 1.14% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.42% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.90% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.46% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.55% : 0.000009s : 28: predicate.inline 1.24% : 0.000002s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.88% : 0.000005s : 8: predicate.less_batch_normalization 1.24% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.38% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 13: predicate.merge_addn 0.90% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000004s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 1.88% : 0.000003s : 13: predicate.reduce_eliminate 1.18% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.12% : 0.000002s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.14% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000004s : 20: predicate.switch_defer_inline 1.82% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.89% : 0.000012s : 64: predicate.switch_simplify 1.09% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.41% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 7.98% : 0.000013s : 27: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.045240 25 97.69% : 0.044196s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.22% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 2.08% : 0.000943s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.444293 72 0.01% : 0.000061s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.09% : 0.000383s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 4.90% : 0.021757s : 1: jit_opt_a 0.04% : 0.000182s : 1: jit_opt_after_cconv 0.01% : 0.000066s : 1: jit_opt_b 0.11% : 0.000469s : 1: loop_unroll 0.19% : 0.000832s : 1: mutable_eliminate 3.03% : 0.013442s : 26: opt.transform.jit_opt_a 0.01% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000090s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000531s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000603s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.58% : 0.002574s : 1: renormalize.infer 0.22% : 0.000987s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.03% : 0.000118s : 1: rewriter_before_opt_a 0.03% : 0.000138s : 1: symbol_engine_optimizer 90.37% : 0.401523s : 1: type_inference TotalTime = 0.0201641, [30] [bootstrap]: 0.00035948 [type_inference]: 0.00675798 [event_method]: 3.211e-05 [auto_monad]: 7.374e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 3.05998e-06 [py_interpret_to_execute]: 7.953e-05 [rewriter_before_opt_a]: 8.317e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00908709, [2] [Cycle 1]: 0.00269529, [27] [switch_simplify]: 7.831e-05 [loop_unroll]: 5.739e-05 [a_1]: 0.0007991 [with_stream_mark]: 2.628e-05 [recompute_prepare]: 1.08e-05 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 7.18998e-06 [updatestate_useless_node_eliminater]: 6.03002e-06 [accelerated_algorithm]: 6.18998e-06 [meta_shard_fg_expand]: 3.31999e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 2.64001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.97e-05 [j_node_and_user_rematch]: 1.094e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.382e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00125876 [add_forward_monad_depend]: 9.76998e-06 [auto_monad_grad]: 3.16001e-06 [auto_monad_eliminator]: 2.156e-05 [cse]: 4.199e-05 [replace_applicator]: 2.171e-05 [Cycle 2]: 0.00038245, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 5.34e-06 [a_1]: 0.00010603 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 6.59001e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 4.53001e-06 [cell_reuse_recompute_pass]: 2.96999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.799e-05 [j_node_and_user_rematch]: 9.89999e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 3.59985e-07 [add_forward_monad_depend]: 2.73e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 8.36002e-06 [cse]: 1.779e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.87e-05 [rewriter_after_opt_a]: 4.575e-05 [convert_after_rewriter]: 8.22e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00109492 [jit_opt_b]: 0.0003184, [1] [Cycle 1]: 0.00030758, [2] [frontend_op_eliminate]: 0.00026226 [inline_after_opt_a]: 2.078e-05 [cconv]: 3.544e-05 [loop_unroll]: 0.00067226 [jit_opt_after_cconv]: 0.0002273, [1] [Cycle 1]: 0.00021874, [11] [c_1]: 2.477e-05 [parameter_eliminate]: 5.35999e-06 [updatestate_depend_eliminate]: 1.023e-05 [updatestate_assign_eliminate]: 3.86999e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 3.948e-05 [call_graph_tuple_transform]: 5.733e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 7.28e-06 [remove_dup_value]: 2.322e-05 [partial_unused_args_eliminate]: 2.92002e-06 [environ_conv]: 7.83001e-06 [add_recomputation]: 6.518e-05 [cse_after_recomputation]: 3.528e-05, [1] [Cycle 1]: 2.831e-05, [1] [cse]: 1.78e-05 [auto_monad_reorder]: 1.919e-05 [get_jit_bprop_graph]: 3.08e-06 [rewriter_after_jit_bprop_graph]: 8.79e-06 [opt_after_jit_grad]: 0.00066142 [symbol_engine_optimizer]: 8.732e-05, [1] [Cycle 1]: 7.887e-05, [6] [build]: 4.50999e-06 [elim_shapecalc]: 8.92999e-06 [elim_not_effective]: 1.753e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 1.054e-05 [renormalize]: 5.00004e-07 [validate]: 5.388e-05 Sums bootstrap : 0.000359s : 2.70% type_inference : 0.006758s : 50.73% event_method : 0.000032s : 0.24% auto_monad : 0.000074s : 0.55% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000080s : 0.60% rewriter_before_opt_a : 0.000083s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000085s : 0.64% jit_opt_a.loop_unroll : 0.000063s : 0.47% jit_opt_a.a_1 : 0.000905s : 6.79% jit_opt_a.with_stream_mark : 0.000040s : 0.30% jit_opt_a.recompute_prepare : 0.000017s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000009s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000023s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001259s : 9.45% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.22% jit_opt_a.cse : 0.000060s : 0.45% jit_opt_a.replace_applicator : 0.000028s : 0.21% py_interpret_to_execute_after_opt_a : 0.000019s : 0.14% rewriter_after_opt_a : 0.000046s : 0.34% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.001095s : 8.22% jit_opt_b.frontend_op_eliminate : 0.000262s : 1.97% jit_opt_b.inline_after_opt_a : 0.000021s : 0.16% cconv : 0.000035s : 0.27% loop_unroll : 0.000672s : 5.05% jit_opt_after_cconv.c_1 : 0.000025s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000039s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000057s : 0.43% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.05% remove_dup_value : 0.000023s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.06% add_recomputation : 0.000065s : 0.49% cse_after_recomputation.cse : 0.000018s : 0.13% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000009s : 0.07% opt_after_jit_grad : 0.000661s : 4.96% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.40% Time group info: ------[substitution.] 0.000308 23 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.47% : 0.000008s : 3: substitution.graph_param_transform 85.25% : 0.000263s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000006s : 2: substitution.replace_old_param 5.30% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006649 2 78.37% : 0.005211s : 1: type_inference.infer 21.63% : 0.001438s : 1: type_inference.specialize ------[replace.] 0.000108 6 59.83% : 0.000065s : 4: replace.inline 40.17% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 6 94.66% : 0.000259s : 4: match.inline 5.34% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000185 691 0.95% : 0.000002s : 10: predicate.accumulaten_eliminater 1.52% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000002s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 2.19% : 0.000004s : 10: predicate.arithmetic_simplify 0.98% : 0.000002s : 10: predicate.cast_eliminate 0.81% : 0.000002s : 3: predicate.check_bprop_eliminate 0.68% : 0.000001s : 10: predicate.compare_switch_simplify 1.56% : 0.000003s : 10: predicate.depend_value_elim 1.35% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.51% : 0.000003s : 10: predicate.dict_get_item_eliminator 0.92% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.86% : 0.000002s : 10: predicate.environ_get_depend_swap 0.95% : 0.000002s : 10: predicate.environ_get_eliminate 0.70% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 4.44% : 0.000008s : 22: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 6: predicate.less_batch_normalization 1.23% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.29% : 0.000002s : 15: predicate.load_eliminater 1.78% : 0.000003s : 3: predicate.loop_unroll_after_grad 15.53% : 0.000029s : 34: predicate.loop_unroll_before_grad 1.50% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.89% : 0.000002s : 10: predicate.merge_addn 0.68% : 0.000001s : 10: predicate.minmaximum_grad 2.11% : 0.000004s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 1.46% : 0.000003s : 15: predicate.partial_eliminate 0.94% : 0.000002s : 10: predicate.print_const_string_wrapper 1.75% : 0.000003s : 10: predicate.reduce_eliminate 1.43% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000002s : 6: predicate.remove_not_recompute_node 1.59% : 0.000003s : 18: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 0.97% : 0.000002s : 10: predicate.reshape_eliminate 1.07% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000002s : 3: predicate.row_tensor_eliminate 1.18% : 0.000002s : 10: predicate.same_eliminate 0.35% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 6: predicate.special_op_eliminate 0.61% : 0.000001s : 6: predicate.specialize_transform 0.99% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.25% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000005s : 16: predicate.switch_defer_inline 1.81% : 0.000003s : 16: predicate.switch_layer_defer_inline 5.78% : 0.000011s : 53: predicate.switch_simplify 1.44% : 0.000003s : 10: predicate.tile_eliminate 1.39% : 0.000003s : 10: predicate.transpose_eliminate 0.93% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.82% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 2.05% : 0.000004s : 10: predicate.tuple_list_set_item_eliminator 0.95% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.06% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.12% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 10: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.58% : 0.000003s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001088 13 41.18% : 0.000448s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.62% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.19% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022691 72 0.31% : 0.000069s : 1: add_recomputation 0.34% : 0.000077s : 1: auto_monad 0.10% : 0.000023s : 1: auto_monad_reorder 1.68% : 0.000382s : 1: bootstrap 0.17% : 0.000038s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000037s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.16% : 0.000037s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 40.07% : 0.009092s : 1: jit_opt_a 1.02% : 0.000231s : 1: jit_opt_after_cconv 1.42% : 0.000322s : 1: jit_opt_b 3.02% : 0.000686s : 1: loop_unroll 4.90% : 0.001112s : 1: mutable_eliminate 5.30% : 0.001203s : 26: opt.transform.jit_opt_a 0.40% : 0.000091s : 4: opt.transform.jit_opt_after_cconv 0.22% : 0.000050s : 4: opt.transform.jit_opt_b 0.09% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000023s : 1: opt.transform.mutable_eliminate 0.14% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.97% : 0.000674s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000083s : 1: py_interpret_to_execute 0.09% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000028s : 1: remove_dup_value 3.19% : 0.000724s : 1: renormalize.infer 2.30% : 0.000521s : 1: renormalize.specialize 0.05% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000049s : 1: rewriter_after_opt_a 0.38% : 0.000086s : 1: rewriter_before_opt_a 0.40% : 0.000090s : 1: symbol_engine_optimizer 29.89% : 0.006782s : 1: type_inference TotalTime = 0.43992, [30] [bootstrap]: 0.0004645 [type_inference]: 0.399313 [event_method]: 2.591e-05 [auto_monad]: 8.915e-05 [graph_reusing]: 7.33e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 0.0133371 [rewriter_before_opt_a]: 0.00016119 [expand_dump_flag]: 6.02001e-06 [jit_opt_a]: 0.0233761, [2] [Cycle 1]: 0.00576182, [27] [switch_simplify]: 7.96e-05 [loop_unroll]: 3.113e-05 [a_1]: 0.00077208 [with_stream_mark]: 2.863e-05 [recompute_prepare]: 1.064e-05 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 9.11998e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 8.20999e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 7.16999e-06 [merge_forward]: 4.72e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.799e-05 [j_node_and_user_rematch]: 1.18e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.172e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00435961 [add_forward_monad_depend]: 1.755e-05 [auto_monad_grad]: 2.75997e-06 [auto_monad_eliminator]: 2.479e-05 [cse]: 4.419e-05 [replace_applicator]: 2.861e-05 [Cycle 2]: 0.00041528, [27] [switch_simplify]: 7.63999e-06 [loop_unroll]: 6.44999e-06 [a_1]: 0.00013138 [with_stream_mark]: 1.718e-05 [recompute_prepare]: 6.43e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 5.01997e-06 [cell_reuse_recompute_pass]: 3.51001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.145e-05 [j_node_and_user_rematch]: 1.061e-05 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 9.73998e-06 [inline_without_move]: 6.78998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.67002e-06 [cse]: 1.542e-05 [replace_applicator]: 6.75002e-06 [py_interpret_to_execute_after_opt_a]: 1.972e-05 [rewriter_after_opt_a]: 8.453e-05 [convert_after_rewriter]: 8.60001e-06 [order_py_execute_after_rewriter]: 5.60001e-06 [mutable_eliminate]: 0.0008476 [jit_opt_b]: 6.259e-05, [1] [Cycle 1]: 5.424e-05, [2] [frontend_op_eliminate]: 2.208e-05 [inline_after_opt_a]: 2.015e-05 [cconv]: 3.273e-05 [loop_unroll]: 0.0004826 [jit_opt_after_cconv]: 0.00018417, [1] [Cycle 1]: 0.00017763, [11] [c_1]: 2.878e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 3.665e-05 [call_graph_tuple_transform]: 2.641e-05 [tuple_list_get_item_eliminator]: 7.7e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.11999e-06 [remove_dup_value]: 2.081e-05 [partial_unused_args_eliminate]: 4.17e-06 [environ_conv]: 1.101e-05 [add_recomputation]: 7.253e-05 [cse_after_recomputation]: 2.775e-05, [1] [Cycle 1]: 2.17e-05, [1] [cse]: 1.549e-05 [auto_monad_reorder]: 1.881e-05 [get_jit_bprop_graph]: 2.38002e-06 [rewriter_after_jit_bprop_graph]: 7.28e-06 [opt_after_jit_grad]: 0.00051029 [symbol_engine_optimizer]: 0.00010296, [1] [Cycle 1]: 9.642e-05, [6] [build]: 5.02999e-06 [elim_shapecalc]: 1.033e-05 [elim_not_effective]: 2.541e-05 [opt_reshape]: 7.57998e-06 [fold_const_symbol]: 1.878e-05 [renormalize]: 5.69999e-07 [validate]: 0.00035224 Sums bootstrap : 0.000464s : 0.11% type_inference : 0.399313s : 94.64% event_method : 0.000026s : 0.01% auto_monad : 0.000089s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.013337s : 3.16% rewriter_before_opt_a : 0.000161s : 0.04% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000903s : 0.21% jit_opt_a.with_stream_mark : 0.000046s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004360s : 1.03% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000060s : 0.01% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.00% rewriter_after_opt_a : 0.000085s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000848s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000033s : 0.01% loop_unroll : 0.000483s : 0.11% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.00% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000073s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000510s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000019s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000352s : 0.08% Time group info: ------[substitution.] 0.000364 24 3.25% : 0.000012s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000009s : 4: substitution.graph_param_transform 85.34% : 0.000310s : 4: substitution.inline 1.36% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000006s : 4: substitution.remove_not_recompute_node 1.91% : 0.000007s : 2: substitution.replace_old_param 3.55% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.399155 2 98.68% : 0.393891s : 1: type_inference.infer 1.32% : 0.005264s : 1: type_inference.specialize ------[replace.] 0.000101 6 69.68% : 0.000070s : 4: replace.inline 30.32% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000319 6 96.32% : 0.000308s : 4: match.inline 3.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.44% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 1.09% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.66% : 0.000001s : 4: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.21% : 0.000002s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.41% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.94% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 22: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000002s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 1.89% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.92% : 0.000010s : 58: predicate.switch_simplify 1.14% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003911 22 68.96% : 0.002697s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.59% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.45% : 0.001152s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.445247 72 0.02% : 0.000077s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.11% : 0.000489s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 5.25% : 0.023380s : 1: jit_opt_a 0.04% : 0.000187s : 1: jit_opt_after_cconv 0.01% : 0.000065s : 1: jit_opt_b 0.11% : 0.000492s : 1: loop_unroll 0.19% : 0.000858s : 1: mutable_eliminate 0.27% : 0.001197s : 26: opt.transform.jit_opt_a 0.01% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000058s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000518s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 3.00% : 0.013377s : 1: py_interpret_to_execute 0.00% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.70% : 0.003100s : 1: renormalize.infer 0.28% : 0.001244s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000089s : 1: rewriter_after_opt_a 0.04% : 0.000169s : 1: rewriter_before_opt_a 0.02% : 0.000105s : 1: symbol_engine_optimizer 89.69% : 0.399346s : 1: type_inference TotalTime = 0.100018, [30] [bootstrap]: 0.00036753 [type_inference]: 0.0725738 [event_method]: 2.256e-05 [auto_monad]: 7.998e-05 [graph_reusing]: 5.93998e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00014029 [rewriter_before_opt_a]: 9.468e-05 [expand_dump_flag]: 3.20998e-06 [jit_opt_a]: 0.0237142, [2] [Cycle 1]: 0.0187217, [27] [switch_simplify]: 6.213e-05 [loop_unroll]: 3.295e-05 [a_1]: 0.00069709 [with_stream_mark]: 2.554e-05 [recompute_prepare]: 9.71998e-06 [updatestate_depend_eliminate]: 4.72998e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 3.6e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.90998e-06 [meta_shard_fg_expand]: 2.88003e-06 [get_grad_eliminate_]: 6.74001e-06 [merge_forward]: 4.89e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.816e-05 [j_node_and_user_rematch]: 1.111e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.0173954 [add_forward_monad_depend]: 1.6e-05 [auto_monad_grad]: 3.53e-06 [auto_monad_eliminator]: 3.543e-05 [cse]: 5.12e-05 [replace_applicator]: 3.357e-05 [Cycle 2]: 0.00041162, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.28998e-06 [a_1]: 0.00011275 [with_stream_mark]: 1.935e-05 [recompute_prepare]: 7.33e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.55003e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 3.18e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 5.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.517e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.59001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.73001e-06 [cse]: 1.783e-05 [replace_applicator]: 6.24999e-06 [py_interpret_to_execute_after_opt_a]: 2.451e-05 [rewriter_after_opt_a]: 5.095e-05 [convert_after_rewriter]: 8.13999e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00094745 [jit_opt_b]: 6.276e-05, [1] [Cycle 1]: 5.32e-05, [2] [frontend_op_eliminate]: 2.243e-05 [inline_after_opt_a]: 1.856e-05 [cconv]: 3.852e-05 [loop_unroll]: 0.0005619 [jit_opt_after_cconv]: 0.00017978, [1] [Cycle 1]: 0.0001728, [11] [c_1]: 2.248e-05 [parameter_eliminate]: 3.83001e-06 [updatestate_depend_eliminate]: 8.35999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.81999e-06 [cse]: 3.755e-05 [call_graph_tuple_transform]: 2.574e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 7.79983e-07 [switch_simplify]: 6.19001e-06 [remove_dup_value]: 1.944e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 7.27002e-06 [add_recomputation]: 5.8e-05 [cse_after_recomputation]: 8.784e-05, [1] [Cycle 1]: 1.935e-05, [1] [cse]: 1.297e-05 [auto_monad_reorder]: 1.891e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 8.54e-06 [opt_after_jit_grad]: 0.00058031 [symbol_engine_optimizer]: 8.124e-05, [1] [Cycle 1]: 7.33e-05, [6] [build]: 6.12999e-06 [elim_shapecalc]: 8.05999e-06 [elim_not_effective]: 1.534e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 9.33002e-06 [renormalize]: 5.10016e-07 [validate]: 4.946e-05 Sums bootstrap : 0.000368s : 0.39% type_inference : 0.072574s : 76.68% event_method : 0.000023s : 0.02% auto_monad : 0.000080s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000140s : 0.15% rewriter_before_opt_a : 0.000095s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.07% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000810s : 0.86% jit_opt_a.with_stream_mark : 0.000045s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.017395s : 18.38% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000043s : 0.05% jit_opt_a.cse : 0.000069s : 0.07% jit_opt_a.replace_applicator : 0.000040s : 0.04% py_interpret_to_execute_after_opt_a : 0.000025s : 0.03% rewriter_after_opt_a : 0.000051s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000947s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000039s : 0.04% loop_unroll : 0.000562s : 0.59% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000058s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000580s : 0.61% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.05% Time group info: ------[substitution.] 0.000331 23 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 3: substitution.graph_param_transform 86.73% : 0.000287s : 4: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000007s : 4: substitution.remove_not_recompute_node 2.55% : 0.000008s : 2: substitution.replace_old_param 4.05% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072438 2 97.12% : 0.070352s : 1: type_inference.infer 2.88% : 0.002086s : 1: type_inference.specialize ------[replace.] 0.000085 6 69.70% : 0.000059s : 4: replace.inline 30.30% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 6 95.91% : 0.000284s : 4: match.inline 4.09% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 2.46% : 0.000003s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.42% : 0.000002s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.29% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000008s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 6: predicate.less_batch_normalization 1.84% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 2.57% : 0.000004s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.59% : 0.000004s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 2.13% : 0.000003s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.60% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 1.84% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.03% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000002s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.46% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001068 13 41.44% : 0.000442s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.40% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.16% : 0.000568s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118555 72 0.05% : 0.000061s : 1: add_recomputation 0.07% : 0.000083s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.33% : 0.000389s : 1: bootstrap 0.03% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000090s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 20.01% : 0.023719s : 1: jit_opt_a 0.15% : 0.000182s : 1: jit_opt_after_cconv 0.06% : 0.000066s : 1: jit_opt_b 0.48% : 0.000573s : 1: loop_unroll 0.81% : 0.000963s : 1: mutable_eliminate 0.92% : 0.001086s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000592s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000146s : 1: py_interpret_to_execute 0.02% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 0.68% : 0.000810s : 1: renormalize.infer 13.97% : 0.016567s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000055s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 61.23% : 0.072596s : 1: type_inference TotalTime = 0.0190718, [30] [bootstrap]: 0.00036363 [type_inference]: 0.00977046 [event_method]: 2.44e-05 [auto_monad]: 7.609e-05 [graph_reusing]: 6.71e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 5.373e-05 [rewriter_before_opt_a]: 8.765e-05 [expand_dump_flag]: 3.37002e-06 [jit_opt_a]: 0.0062979, [2] [Cycle 1]: 0.0022506, [27] [switch_simplify]: 6.479e-05 [loop_unroll]: 3.439e-05 [a_1]: 0.00071967 [with_stream_mark]: 2.458e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.596e-05 [j_node_and_user_rematch]: 9.70002e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.60001e-06 [renormalize]: 0.0010323 [add_forward_monad_depend]: 6.60002e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.617e-05 [cse]: 4.456e-05 [replace_applicator]: 1.476e-05 [Cycle 2]: 0.00033813, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.25001e-06 [a_1]: 9.398e-05 [with_stream_mark]: 1.246e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.34998e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 4.87e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.545e-05 [j_node_and_user_rematch]: 8.14997e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.53999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.31998e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.90002e-06 [cse]: 1.523e-05 [replace_applicator]: 5.35001e-06 [py_interpret_to_execute_after_opt_a]: 1.475e-05 [rewriter_after_opt_a]: 4.103e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.21002e-06 [mutable_eliminate]: 0.00062587 [jit_opt_b]: 5.325e-05, [1] [Cycle 1]: 4.62e-05, [2] [frontend_op_eliminate]: 1.754e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 3.033e-05 [loop_unroll]: 0.00043273 [jit_opt_after_cconv]: 0.00017509, [1] [Cycle 1]: 0.00016864, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 3.05002e-06 [updatestate_depend_eliminate]: 8.22e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 3.189e-05 [call_graph_tuple_transform]: 3.39e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.78997e-06 [renormalize]: 7.59988e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 4.1e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 6.66e-06 [add_recomputation]: 5.653e-05 [cse_after_recomputation]: 2.52e-05, [1] [Cycle 1]: 1.953e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.866e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 5.29e-06 [opt_after_jit_grad]: 0.00047316 [symbol_engine_optimizer]: 7.667e-05, [1] [Cycle 1]: 7.041e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.48e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 9.00001e-06 [renormalize]: 3.30008e-07 [validate]: 8.989e-05 Sums bootstrap : 0.000364s : 2.47% type_inference : 0.009770s : 66.31% event_method : 0.000024s : 0.17% auto_monad : 0.000076s : 0.52% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000054s : 0.36% rewriter_before_opt_a : 0.000088s : 0.59% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.48% jit_opt_a.loop_unroll : 0.000040s : 0.27% jit_opt_a.a_1 : 0.000814s : 5.52% jit_opt_a.with_stream_mark : 0.000037s : 0.25% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001032s : 7.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.15% jit_opt_a.cse : 0.000060s : 0.41% jit_opt_a.replace_applicator : 0.000020s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000041s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000626s : 4.25% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000030s : 0.21% loop_unroll : 0.000433s : 2.94% jit_opt_after_cconv.c_1 : 0.000021s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000034s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000041s : 0.28% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000057s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000473s : 3.21% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000090s : 0.61% Time group info: ------[substitution.] 0.000306 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 6.50% : 0.000020s : 3: substitution.graph_param_transform 83.61% : 0.000256s : 5: substitution.inline 1.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000005s : 2: substitution.replace_old_param 4.13% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009690 2 87.04% : 0.008435s : 1: type_inference.infer 12.96% : 0.001256s : 1: type_inference.specialize ------[replace.] 0.000108 7 65.70% : 0.000071s : 5: replace.inline 34.30% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 7 95.70% : 0.000253s : 5: match.inline 4.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.61% : 0.000002s : 11: predicate.accumulaten_eliminater 1.25% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.35% : 0.000002s : 11: predicate.addn_check_dump 1.53% : 0.000002s : 11: predicate.addn_zero_filter 1.93% : 0.000002s : 11: predicate.arithmetic_simplify 1.52% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 11: predicate.compare_switch_simplify 1.21% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.15% : 0.000001s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.51% : 0.000001s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 16: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 16: predicate.partial_eliminate 1.33% : 0.000002s : 11: predicate.print_const_string_wrapper 1.78% : 0.000002s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000004s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.83% : 0.000010s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.18% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.92% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000994 16 49.86% : 0.000496s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.58% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.56% : 0.000413s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021171 72 0.28% : 0.000059s : 1: add_recomputation 0.37% : 0.000079s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.83% : 0.000388s : 1: bootstrap 0.15% : 0.000033s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.14% : 0.000030s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.76% : 0.006302s : 1: jit_opt_a 0.84% : 0.000178s : 1: jit_opt_after_cconv 0.26% : 0.000056s : 1: jit_opt_b 2.09% : 0.000442s : 1: loop_unroll 3.01% : 0.000636s : 1: mutable_eliminate 4.97% : 0.001051s : 26: opt.transform.jit_opt_a 0.30% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.27% : 0.000482s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000057s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000044s : 1: remove_dup_value 2.81% : 0.000594s : 1: renormalize.infer 2.03% : 0.000429s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000045s : 1: rewriter_after_opt_a 0.43% : 0.000091s : 1: rewriter_before_opt_a 0.37% : 0.000079s : 1: symbol_engine_optimizer 46.25% : 0.009792s : 1: type_inference TotalTime = 0.0739033, [30] [bootstrap]: 0.00045273 [type_inference]: 0.0386638 [event_method]: 2.083e-05 [auto_monad]: 7.228e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 0.00012816 [rewriter_before_opt_a]: 8.236e-05 [expand_dump_flag]: 1.49e-05 [jit_opt_a]: 0.00838536, [2] [Cycle 1]: 0.00285093, [27] [switch_simplify]: 7.547e-05 [loop_unroll]: 3.357e-05 [a_1]: 0.00068092 [with_stream_mark]: 2.696e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.43998e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 5.69e-06 [cell_reuse_recompute_pass]: 1.98997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.781e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.92002e-06 [replace_old_param]: 1.138e-05 [inline_without_move]: 5.88998e-06 [renormalize]: 0.0016007 [add_forward_monad_depend]: 9.37999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.29e-05 [cse]: 4.101e-05 [replace_applicator]: 2.163e-05 [Cycle 2]: 0.00041485, [27] [switch_simplify]: 7.43999e-06 [loop_unroll]: 5.88998e-06 [a_1]: 0.00010616 [with_stream_mark]: 1.745e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.65002e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 5.78002e-06 [cell_reuse_recompute_pass]: 3.95e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.06e-05 [j_node_and_user_rematch]: 1.101e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.97999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 1.066e-05 [cse]: 2.002e-05 [replace_applicator]: 8.05e-06 [py_interpret_to_execute_after_opt_a]: 2.083e-05 [rewriter_after_opt_a]: 4.598e-05 [convert_after_rewriter]: 1.044e-05 [order_py_execute_after_rewriter]: 6.49999e-06 [mutable_eliminate]: 0.00103362 [jit_opt_b]: 6.491e-05, [1] [Cycle 1]: 5.559e-05, [2] [frontend_op_eliminate]: 2.007e-05 [inline_after_opt_a]: 2.145e-05 [cconv]: 3.596e-05 [loop_unroll]: 0.00064646 [jit_opt_after_cconv]: 0.00032967, [1] [Cycle 1]: 0.00030978, [11] [c_1]: 7.286e-05 [parameter_eliminate]: 7.56001e-06 [updatestate_depend_eliminate]: 1.492e-05 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.88003e-06 [cse]: 6.012e-05 [call_graph_tuple_transform]: 3.761e-05 [tuple_list_get_item_eliminator]: 9.31998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 8.07e-06 [remove_dup_value]: 2.28e-05 [partial_unused_args_eliminate]: 2.82002e-06 [environ_conv]: 9.458e-05 [add_recomputation]: 7.218e-05 [cse_after_recomputation]: 3.96e-05, [1] [Cycle 1]: 2.79e-05, [1] [cse]: 1.826e-05 [auto_monad_reorder]: 2.3e-05 [get_jit_bprop_graph]: 2.67001e-06 [rewriter_after_jit_bprop_graph]: 1.243e-05 [opt_after_jit_grad]: 0.00132662 [symbol_engine_optimizer]: 0.00010819, [1] [Cycle 1]: 9.864e-05, [6] [build]: 6.69999e-06 [elim_shapecalc]: 1.311e-05 [elim_not_effective]: 2.2e-05 [opt_reshape]: 8.79e-06 [fold_const_symbol]: 1.269e-05 [renormalize]: 6.89994e-07 [validate]: 6.428e-05 Sums bootstrap : 0.000453s : 0.98% type_inference : 0.038664s : 83.85% event_method : 0.000021s : 0.05% auto_monad : 0.000072s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000128s : 0.28% rewriter_before_opt_a : 0.000082s : 0.18% expand_dump_flag : 0.000015s : 0.03% jit_opt_a.switch_simplify : 0.000083s : 0.18% jit_opt_a.loop_unroll : 0.000039s : 0.09% jit_opt_a.a_1 : 0.000787s : 1.71% jit_opt_a.with_stream_mark : 0.000044s : 0.10% jit_opt_a.recompute_prepare : 0.000018s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000011s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001601s : 3.47% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.07% jit_opt_a.cse : 0.000061s : 0.13% jit_opt_a.replace_applicator : 0.000030s : 0.06% py_interpret_to_execute_after_opt_a : 0.000021s : 0.05% rewriter_after_opt_a : 0.000046s : 0.10% convert_after_rewriter : 0.000010s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.001034s : 2.24% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000021s : 0.05% cconv : 0.000036s : 0.08% loop_unroll : 0.000646s : 1.40% jit_opt_after_cconv.c_1 : 0.000073s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000060s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.02% remove_dup_value : 0.000023s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000095s : 0.21% add_recomputation : 0.000072s : 0.16% cse_after_recomputation.cse : 0.000018s : 0.04% auto_monad_reorder : 0.000023s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.03% opt_after_jit_grad : 0.001327s : 2.88% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000064s : 0.14% Time group info: ------[substitution.] 0.000294 23 1.07% : 0.000003s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 3.14% : 0.000009s : 3: substitution.graph_param_transform 84.58% : 0.000249s : 4: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000006s : 4: substitution.remove_not_recompute_node 2.23% : 0.000007s : 2: substitution.replace_old_param 5.03% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038570 2 94.62% : 0.036494s : 1: type_inference.infer 5.38% : 0.002076s : 1: type_inference.specialize ------[replace.] 0.000102 6 64.52% : 0.000066s : 4: replace.inline 35.48% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 6 94.78% : 0.000246s : 4: match.inline 5.22% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000165 691 1.05% : 0.000002s : 10: predicate.accumulaten_eliminater 2.14% : 0.000004s : 3: predicate.ad_related_special_op_eliminate 0.74% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000002s : 10: predicate.addn_zero_filter 2.33% : 0.000004s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 0.73% : 0.000001s : 10: predicate.compare_switch_simplify 0.82% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 0.96% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 1.01% : 0.000002s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.76% : 0.000001s : 10: predicate.environ_get_depend_swap 0.93% : 0.000002s : 10: predicate.environ_get_eliminate 0.77% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.41% : 0.000001s : 3: predicate.fold_const_symbol 1.00% : 0.000002s : 6: predicate.get_grad_eliminate 0.31% : 0.000001s : 3: predicate.graph_param_transform 7.75% : 0.000013s : 22: predicate.inline 0.94% : 0.000002s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.91% : 0.000002s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 15: predicate.load_eliminater 2.65% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000007s : 34: predicate.loop_unroll_before_grad 2.54% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.88% : 0.000001s : 10: predicate.merge_addn 0.90% : 0.000001s : 10: predicate.minmaximum_grad 3.10% : 0.000005s : 3: predicate.mutable_eliminate 0.32% : 0.000001s : 3: predicate.opt_reshape 1.85% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000002s : 10: predicate.print_const_string_wrapper 1.88% : 0.000003s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000003s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 0.83% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 0.98% : 0.000002s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.00% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000004s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.00% : 0.000012s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.05% : 0.000002s : 10: predicate.transpose_eliminate 1.05% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.42% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.16% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 10: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001084 13 43.10% : 0.000467s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.53% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.37% : 0.000557s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076680 72 0.10% : 0.000078s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.04% : 0.000027s : 1: auto_monad_reorder 0.62% : 0.000477s : 1: bootstrap 0.05% : 0.000039s : 1: cconv 0.02% : 0.000013s : 1: convert_after_rewriter 0.06% : 0.000042s : 1: cse_after_recomputation 0.13% : 0.000099s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.02% : 0.000018s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.94% : 0.008390s : 1: jit_opt_a 0.44% : 0.000337s : 1: jit_opt_after_cconv 0.09% : 0.000068s : 1: jit_opt_b 27.16% : 0.020826s : 1: loop_unroll 1.37% : 0.001052s : 1: mutable_eliminate 1.38% : 0.001061s : 26: opt.transform.jit_opt_a 0.15% : 0.000116s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000034s : 4: opt.transform.jit_opt_b 0.03% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000028s : 1: opt.transform.mutable_eliminate 0.05% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000051s : 4: opt.transform.symbol_engine_opt 1.75% : 0.001344s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000132s : 1: py_interpret_to_execute 0.03% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000026s : 1: remove_dup_value 1.25% : 0.000955s : 1: renormalize.infer 0.82% : 0.000632s : 1: renormalize.specialize 0.02% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000051s : 1: rewriter_after_opt_a 2.29% : 0.001754s : 1: rewriter_before_opt_a 0.15% : 0.000111s : 1: symbol_engine_optimizer 50.46% : 0.038690s : 1: type_inference TotalTime = 0.0846815, [30] [bootstrap]: 0.00080094 [type_inference]: 0.0453066 [event_method]: 2.814e-05 [auto_monad]: 0.00019959 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 1.128e-05 [py_interpret_to_execute]: 4.55e-05 [rewriter_before_opt_a]: 0.00013627 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.0346075, [2] [Cycle 1]: 0.00358533, [27] [switch_simplify]: 0.00015371 [loop_unroll]: 4.778e-05 [a_1]: 0.00148574 [with_stream_mark]: 3.315e-05 [recompute_prepare]: 1.142e-05 [updatestate_depend_eliminate]: 2.092e-05 [updatestate_assign_eliminate]: 3.73001e-06 [updatestate_loads_eliminate]: 3.62002e-06 [parameter_eliminate]: 3.04999e-06 [specialize_transform]: 1.041e-05 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 3.73001e-06 [get_grad_eliminate_]: 7.82002e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.856e-05 [j_node_and_user_rematch]: 2.057e-05 [meta_fg_expand]: 3.31001e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.86001e-06 [renormalize]: 0.00125452 [add_forward_monad_depend]: 4.093e-05 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 3.22e-05 [cse]: 4.323e-05 [replace_applicator]: 1.977e-05 [Cycle 2]: 0.00041269, [27] [switch_simplify]: 7.11001e-06 [loop_unroll]: 5.65001e-06 [a_1]: 9.977e-05 [with_stream_mark]: 1.65e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 7.36999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 5.41002e-06 [cell_reuse_recompute_pass]: 2.16e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.175e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.33002e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 1.019e-05 [cse]: 2.089e-05 [replace_applicator]: 7.31001e-06 [py_interpret_to_execute_after_opt_a]: 1.942e-05 [rewriter_after_opt_a]: 5.682e-05 [convert_after_rewriter]: 2.038e-05 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00101282 [jit_opt_b]: 6.195e-05, [1] [Cycle 1]: 5.192e-05, [2] [frontend_op_eliminate]: 1.852e-05 [inline_after_opt_a]: 1.921e-05 [cconv]: 3.287e-05 [loop_unroll]: 0.00068448 [jit_opt_after_cconv]: 0.00019371, [1] [Cycle 1]: 0.00018515, [11] [c_1]: 2.562e-05 [parameter_eliminate]: 4.08999e-06 [updatestate_depend_eliminate]: 9.37001e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.14001e-06 [cse]: 4.064e-05 [call_graph_tuple_transform]: 2.705e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 6.79999e-06 [remove_dup_value]: 2.086e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 5.019e-05 [add_recomputation]: 8.395e-05 [cse_after_recomputation]: 4.011e-05, [1] [Cycle 1]: 3.229e-05, [1] [cse]: 1.985e-05 [auto_monad_reorder]: 3.062e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 4.53999e-06 [opt_after_jit_grad]: 0.00071249 [symbol_engine_optimizer]: 0.00012573, [1] [Cycle 1]: 0.00011733, [6] [build]: 3.627e-05 [elim_shapecalc]: 1.091e-05 [elim_not_effective]: 1.811e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 9.50001e-06 [renormalize]: 8.2e-07 [validate]: 9.876e-05 Sums bootstrap : 0.000801s : 1.51% type_inference : 0.045307s : 85.17% event_method : 0.000028s : 0.05% auto_monad : 0.000200s : 0.38% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000011s : 0.02% py_interpret_to_execute : 0.000046s : 0.09% rewriter_before_opt_a : 0.000136s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000161s : 0.30% jit_opt_a.loop_unroll : 0.000053s : 0.10% jit_opt_a.a_1 : 0.001586s : 2.98% jit_opt_a.with_stream_mark : 0.000050s : 0.09% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000025s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000016s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.03% jit_opt_a.merge_forward : 0.000010s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000030s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.001255s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000043s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000042s : 0.08% jit_opt_a.cse : 0.000064s : 0.12% jit_opt_a.replace_applicator : 0.000027s : 0.05% py_interpret_to_execute_after_opt_a : 0.000019s : 0.04% rewriter_after_opt_a : 0.000057s : 0.11% convert_after_rewriter : 0.000020s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001013s : 1.90% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000033s : 0.06% loop_unroll : 0.000684s : 1.29% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000041s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000050s : 0.09% add_recomputation : 0.000084s : 0.16% cse_after_recomputation.cse : 0.000020s : 0.04% auto_monad_reorder : 0.000031s : 0.06% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000712s : 1.34% symbol_engine_optimizer.build : 0.000036s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000099s : 0.19% Time group info: ------[substitution.] 0.000462 25 0.51% : 0.000002s : 2: substitution.elim_not_effective 0.27% : 0.000001s : 2: substitution.fold_const_symbol 1.62% : 0.000007s : 3: substitution.graph_param_transform 87.71% : 0.000405s : 5: substitution.inline 1.05% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.38% : 0.000016s : 4: substitution.remove_not_recompute_node 1.49% : 0.000007s : 2: substitution.replace_old_param 3.97% : 0.000018s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045195 2 95.41% : 0.043120s : 1: type_inference.infer 4.59% : 0.002075s : 1: type_inference.specialize ------[replace.] 0.000148 8 69.00% : 0.000102s : 5: replace.inline 31.00% : 0.000046s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000417 8 96.22% : 0.000401s : 5: match.inline 3.78% : 0.000016s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000175 810 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000003s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.48% : 0.000003s : 12: predicate.cast_eliminate 0.34% : 0.000001s : 3: predicate.check_bprop_eliminate 0.86% : 0.000001s : 12: predicate.compare_switch_simplify 1.47% : 0.000003s : 12: predicate.depend_value_elim 0.88% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.61% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.00% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.86% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.90% : 0.000002s : 12: predicate.environ_get_depend_swap 1.05% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000002s : 6: predicate.get_grad_eliminate 0.31% : 0.000001s : 3: predicate.graph_param_transform 5.44% : 0.000010s : 26: predicate.inline 0.58% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000002s : 6: predicate.less_batch_normalization 1.25% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.57% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.90% : 0.000009s : 41: predicate.loop_unroll_before_grad 1.62% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.89% : 0.000002s : 12: predicate.merge_addn 0.86% : 0.000002s : 12: predicate.minmaximum_grad 1.66% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000004s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.48% : 0.000003s : 12: predicate.reduce_eliminate 1.25% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000003s : 21: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000001s : 3: predicate.reset_defer_inline 0.98% : 0.000002s : 12: predicate.reshape_eliminate 1.05% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000002s : 3: predicate.row_tensor_eliminate 1.06% : 0.000002s : 12: predicate.same_eliminate 0.35% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.56% : 0.000001s : 6: predicate.special_op_eliminate 0.79% : 0.000001s : 6: predicate.specialize_transform 1.14% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.71% : 0.000006s : 20: predicate.switch_defer_inline 1.99% : 0.000003s : 20: predicate.switch_layer_defer_inline 10.69% : 0.000019s : 64: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.68% : 0.000003s : 12: predicate.transpose_eliminate 3.22% : 0.000006s : 12: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 2.00% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.37% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.44% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.51% : 0.000003s : 12: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.39% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001775 16 55.49% : 0.000985s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.45% : 0.000115s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.06% : 0.000676s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.087884 72 0.10% : 0.000091s : 1: add_recomputation 0.23% : 0.000206s : 1: auto_monad 0.04% : 0.000035s : 1: auto_monad_reorder 0.95% : 0.000831s : 1: bootstrap 0.04% : 0.000036s : 1: cconv 0.03% : 0.000023s : 1: convert_after_rewriter 0.05% : 0.000043s : 1: cse_after_recomputation 0.06% : 0.000054s : 1: environ_conv 0.04% : 0.000033s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 39.38% : 0.034612s : 1: jit_opt_a 0.22% : 0.000197s : 1: jit_opt_after_cconv 0.07% : 0.000065s : 1: jit_opt_b 0.79% : 0.000698s : 1: loop_unroll 1.17% : 0.001033s : 1: mutable_eliminate 2.21% : 0.001944s : 26: opt.transform.jit_opt_a 0.07% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000023s : 1: opt.transform.mutable_eliminate 0.04% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000728s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000013s : 1: pre_auto_parallel 0.06% : 0.000048s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000024s : 1: remove_dup_value 0.76% : 0.000666s : 1: renormalize.infer 0.65% : 0.000574s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000062s : 1: rewriter_after_opt_a 0.16% : 0.000141s : 1: rewriter_before_opt_a 0.15% : 0.000129s : 1: symbol_engine_optimizer 51.58% : 0.045335s : 1: type_inference TotalTime = 0.312997, [30] [bootstrap]: 0.00039829 [type_inference]: 0.284232 [event_method]: 2.528e-05 [auto_monad]: 8.681e-05 [graph_reusing]: 5.69999e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 0.00092351 [rewriter_before_opt_a]: 0.00010705 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.0235332, [2] [Cycle 1]: 0.00637475, [27] [switch_simplify]: 8.217e-05 [loop_unroll]: 3.346e-05 [a_1]: 0.00085746 [with_stream_mark]: 2.892e-05 [recompute_prepare]: 1.254e-05 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 8.08999e-06 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 7.64002e-06 [meta_shard_fg_expand]: 4.57e-06 [get_grad_eliminate_]: 1.007e-05 [merge_forward]: 5.78997e-06 [cell_reuse_recompute_pass]: 2.10002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.071e-05 [j_node_and_user_rematch]: 1.272e-05 [meta_fg_expand]: 3.81999e-06 [replace_old_param]: 1.434e-05 [inline_without_move]: 8.94e-06 [renormalize]: 0.00487297 [add_forward_monad_depend]: 1.102e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.374e-05 [cse]: 3.929e-05 [replace_applicator]: 2.679e-05 [Cycle 2]: 0.00045576, [27] [switch_simplify]: 8.23999e-06 [loop_unroll]: 6.91001e-06 [a_1]: 0.00014639 [with_stream_mark]: 1.759e-05 [recompute_prepare]: 7.41999e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 6.26998e-06 [accelerated_algorithm]: 6.80002e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 6.93998e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.209e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 5.87001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 3.11999e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 9.86e-06 [cse]: 1.716e-05 [replace_applicator]: 7.23e-06 [py_interpret_to_execute_after_opt_a]: 2.246e-05 [rewriter_after_opt_a]: 4.449e-05 [convert_after_rewriter]: 9.35001e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00130692 [jit_opt_b]: 6.921e-05, [1] [Cycle 1]: 5.948e-05, [2] [frontend_op_eliminate]: 2.55e-05 [inline_after_opt_a]: 1.961e-05 [cconv]: 3.673e-05 [loop_unroll]: 0.00062265 [jit_opt_after_cconv]: 0.00019808, [1] [Cycle 1]: 0.00019015, [11] [c_1]: 2.86e-05 [parameter_eliminate]: 4.82e-06 [updatestate_depend_eliminate]: 9.86e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 4.09002e-06 [cse]: 3.92e-05 [call_graph_tuple_transform]: 2.699e-05 [tuple_list_get_item_eliminator]: 7.25e-06 [none_parameter_eliminate]: 1.83997e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 7.26999e-06 [remove_dup_value]: 1.867e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 1.181e-05 [add_recomputation]: 5.808e-05 [cse_after_recomputation]: 2.815e-05, [1] [Cycle 1]: 2.15e-05, [1] [cse]: 1.364e-05 [auto_monad_reorder]: 1.582e-05 [get_jit_bprop_graph]: 3.5e-06 [rewriter_after_jit_bprop_graph]: 9.00999e-06 [opt_after_jit_grad]: 0.00064395 [symbol_engine_optimizer]: 9.637e-05, [1] [Cycle 1]: 8.817e-05, [6] [build]: 5.49e-06 [elim_shapecalc]: 1.168e-05 [elim_not_effective]: 1.853e-05 [opt_reshape]: 8.90001e-06 [fold_const_symbol]: 1.253e-05 [renormalize]: 6.19999e-07 [validate]: 0.0002126 Sums bootstrap : 0.000398s : 0.13% type_inference : 0.284232s : 96.19% event_method : 0.000025s : 0.01% auto_monad : 0.000087s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000924s : 0.31% rewriter_before_opt_a : 0.000107s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.001004s : 0.34% jit_opt_a.with_stream_mark : 0.000047s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.004873s : 1.65% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001307s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000037s : 0.01% loop_unroll : 0.000623s : 0.21% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000644s : 0.22% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000213s : 0.07% Time group info: ------[substitution.] 0.000359 24 1.15% : 0.000004s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.95% : 0.000007s : 4: substitution.graph_param_transform 85.89% : 0.000309s : 4: substitution.inline 1.39% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000008s : 4: substitution.remove_not_recompute_node 1.84% : 0.000007s : 2: substitution.replace_old_param 5.11% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.284101 2 97.59% : 0.277255s : 1: type_inference.infer 2.41% : 0.006846s : 1: type_inference.specialize ------[replace.] 0.000118 6 64.50% : 0.000076s : 4: replace.inline 35.50% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 6 94.76% : 0.000305s : 4: match.inline 5.24% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000185 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 2.26% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.49% : 0.000003s : 12: predicate.addn_zero_filter 3.61% : 0.000007s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 0.86% : 0.000002s : 12: predicate.compare_switch_simplify 2.10% : 0.000004s : 12: predicate.depend_value_elim 0.89% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.81% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.92% : 0.000002s : 12: predicate.environ_get_depend_swap 1.11% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.80% : 0.000003s : 8: predicate.get_grad_eliminate 0.30% : 0.000001s : 4: predicate.graph_param_transform 4.35% : 0.000008s : 26: predicate.inline 0.75% : 0.000001s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.61% : 0.000003s : 8: predicate.less_batch_normalization 1.54% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 18: predicate.load_eliminater 2.06% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.18% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.89% : 0.000002s : 12: predicate.merge_addn 0.78% : 0.000001s : 12: predicate.minmaximum_grad 2.21% : 0.000004s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 1.79% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000002s : 12: predicate.print_const_string_wrapper 2.06% : 0.000004s : 12: predicate.reduce_eliminate 1.29% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.67% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.25% : 0.000000s : 4: predicate.reset_defer_inline 1.54% : 0.000003s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000002s : 4: predicate.row_tensor_eliminate 1.85% : 0.000003s : 12: predicate.same_eliminate 1.12% : 0.000002s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.76% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000004s : 18: predicate.switch_defer_inline 1.61% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.75% : 0.000014s : 58: predicate.switch_simplify 1.50% : 0.000003s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.22% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.30% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.37% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.22% : 0.000002s : 12: predicate.value_based_eliminate 0.27% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.91% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003306 22 62.57% : 0.002069s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.24% : 0.000074s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.19% : 0.001163s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.319097 72 0.02% : 0.000062s : 1: add_recomputation 0.03% : 0.000091s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.13% : 0.000418s : 1: bootstrap 0.01% : 0.000040s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 7.38% : 0.023539s : 1: jit_opt_a 0.06% : 0.000201s : 1: jit_opt_after_cconv 0.02% : 0.000072s : 1: jit_opt_b 0.20% : 0.000634s : 1: loop_unroll 0.41% : 0.001321s : 1: mutable_eliminate 0.41% : 0.001313s : 26: opt.transform.jit_opt_a 0.02% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000656s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000934s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.13% : 0.003612s : 1: renormalize.infer 0.39% : 0.001243s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000049s : 1: rewriter_after_opt_a 0.04% : 0.000114s : 1: rewriter_before_opt_a 0.03% : 0.000100s : 1: symbol_engine_optimizer 89.08% : 0.284265s : 1: type_inference TotalTime = 0.0359551, [30] [bootstrap]: 0.00040802 [type_inference]: 0.023796 [event_method]: 2.92e-05 [auto_monad]: 8.87e-05 [graph_reusing]: 7.28e-06 [pre_auto_parallel]: 3.13998e-06 [py_interpret_to_execute]: 8.794e-05 [rewriter_before_opt_a]: 0.00010774 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00812768, [2] [Cycle 1]: 0.0028684, [27] [switch_simplify]: 8.505e-05 [loop_unroll]: 3.7e-05 [a_1]: 0.00092746 [with_stream_mark]: 2.977e-05 [recompute_prepare]: 1.197e-05 [updatestate_depend_eliminate]: 4.69002e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.71001e-06 [parameter_eliminate]: 3.02002e-06 [specialize_transform]: 8.22e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 3.07002e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.95001e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.858e-05 [j_node_and_user_rematch]: 1.079e-05 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 1.145e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00131947 [add_forward_monad_depend]: 1.047e-05 [auto_monad_grad]: 3.35998e-06 [auto_monad_eliminator]: 2.319e-05 [cse]: 4.878e-05 [replace_applicator]: 2.409e-05 [Cycle 2]: 0.00040994, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 5.66e-06 [a_1]: 0.00010429 [with_stream_mark]: 1.858e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.51998e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 3.8e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.967e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 8.95001e-06 [inline_without_move]: 5.83002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.97001e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.066e-05 [cse]: 2.043e-05 [replace_applicator]: 7.53999e-06 [py_interpret_to_execute_after_opt_a]: 2.141e-05 [rewriter_after_opt_a]: 4.899e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00097439 [jit_opt_b]: 7.248e-05, [1] [Cycle 1]: 5.952e-05, [2] [frontend_op_eliminate]: 2.381e-05 [inline_after_opt_a]: 2.056e-05 [cconv]: 4.799e-05 [loop_unroll]: 0.00061956 [jit_opt_after_cconv]: 0.00022113, [1] [Cycle 1]: 0.00021267, [11] [c_1]: 2.727e-05 [parameter_eliminate]: 7.21999e-06 [updatestate_depend_eliminate]: 1.446e-05 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.91999e-06 [cse]: 5.464e-05 [call_graph_tuple_transform]: 2.949e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 2.49999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.76998e-06 [remove_dup_value]: 5.753e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 8e-06 [add_recomputation]: 6.243e-05 [cse_after_recomputation]: 3.536e-05, [1] [Cycle 1]: 2.6e-05, [1] [cse]: 1.75e-05 [auto_monad_reorder]: 2.148e-05 [get_jit_bprop_graph]: 2.74999e-06 [rewriter_after_jit_bprop_graph]: 1.119e-05 [opt_after_jit_grad]: 0.00061821 [symbol_engine_optimizer]: 9.124e-05, [1] [Cycle 1]: 8.251e-05, [6] [build]: 5.79999e-06 [elim_shapecalc]: 9.46e-06 [elim_not_effective]: 1.779e-05 [opt_reshape]: 6.19999e-06 [fold_const_symbol]: 1.163e-05 [renormalize]: 6.29982e-07 [validate]: 5.519e-05 Sums bootstrap : 0.000408s : 1.35% type_inference : 0.023796s : 78.63% event_method : 0.000029s : 0.10% auto_monad : 0.000089s : 0.29% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000088s : 0.29% rewriter_before_opt_a : 0.000108s : 0.36% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.30% jit_opt_a.loop_unroll : 0.000043s : 0.14% jit_opt_a.a_1 : 0.001032s : 3.41% jit_opt_a.with_stream_mark : 0.000048s : 0.16% jit_opt_a.recompute_prepare : 0.000017s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.02% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001320s : 4.36% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.04% jit_opt_a.auto_monad_grad : 0.000006s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.11% jit_opt_a.cse : 0.000069s : 0.23% jit_opt_a.replace_applicator : 0.000032s : 0.10% py_interpret_to_execute_after_opt_a : 0.000021s : 0.07% rewriter_after_opt_a : 0.000049s : 0.16% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000974s : 3.22% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.08% jit_opt_b.inline_after_opt_a : 0.000021s : 0.07% cconv : 0.000048s : 0.16% loop_unroll : 0.000620s : 2.05% jit_opt_after_cconv.c_1 : 0.000027s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000055s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000058s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000062s : 0.21% cse_after_recomputation.cse : 0.000018s : 0.06% auto_monad_reorder : 0.000021s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.04% opt_after_jit_grad : 0.000618s : 2.04% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.18% Time group info: ------[substitution.] 0.000399 24 0.76% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 1.83% : 0.000007s : 3: substitution.graph_param_transform 88.48% : 0.000353s : 5: substitution.inline 1.45% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.47% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000008s : 2: substitution.replace_old_param 3.54% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023683 2 93.99% : 0.022259s : 1: type_inference.infer 6.01% : 0.001424s : 1: type_inference.specialize ------[replace.] 0.000188 7 78.14% : 0.000147s : 5: replace.inline 21.86% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000362 7 96.55% : 0.000350s : 5: match.inline 3.45% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 747 1.55% : 0.000002s : 11: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 11: predicate.addn_check_dump 2.06% : 0.000003s : 11: predicate.addn_zero_filter 1.95% : 0.000003s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000002s : 11: predicate.compare_switch_simplify 1.03% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.10% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.38% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.90% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 0.89% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.68% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.53% : 0.000010s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 16: predicate.load_eliminater 1.83% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 11: predicate.merge_addn 0.96% : 0.000002s : 11: predicate.minmaximum_grad 2.58% : 0.000004s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000003s : 16: predicate.partial_eliminate 1.14% : 0.000002s : 11: predicate.print_const_string_wrapper 1.76% : 0.000003s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000003s : 19: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.12% : 0.000002s : 3: predicate.row_tensor_eliminate 1.08% : 0.000002s : 11: predicate.same_eliminate 0.80% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 6: predicate.special_op_eliminate 1.14% : 0.000002s : 6: predicate.specialize_transform 1.80% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.96% : 0.000005s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000012s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.02% : 0.000002s : 11: predicate.transpose_eliminate 1.65% : 0.000003s : 11: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.88% : 0.000005s : 22: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001216 16 50.43% : 0.000613s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.63% : 0.000105s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.94% : 0.000498s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038658 72 0.17% : 0.000067s : 1: add_recomputation 0.24% : 0.000094s : 1: auto_monad 0.06% : 0.000024s : 1: auto_monad_reorder 1.13% : 0.000436s : 1: bootstrap 0.13% : 0.000051s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000038s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.09% : 0.000035s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 21.04% : 0.008133s : 1: jit_opt_a 0.58% : 0.000225s : 1: jit_opt_after_cconv 0.20% : 0.000076s : 1: jit_opt_b 1.64% : 0.000632s : 1: loop_unroll 2.58% : 0.000998s : 1: mutable_eliminate 3.40% : 0.001315s : 26: opt.transform.jit_opt_a 0.17% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000036s : 4: opt.transform.jit_opt_b 0.05% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.16% : 0.000061s : 1: opt.transform.mutable_eliminate 0.08% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000041s : 4: opt.transform.symbol_engine_opt 1.64% : 0.000632s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000092s : 1: py_interpret_to_execute 0.06% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.16% : 0.000061s : 1: remove_dup_value 2.05% : 0.000792s : 1: renormalize.infer 1.33% : 0.000515s : 1: renormalize.specialize 0.04% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000054s : 1: rewriter_after_opt_a 0.29% : 0.000113s : 1: rewriter_before_opt_a 0.24% : 0.000094s : 1: symbol_engine_optimizer 61.64% : 0.023831s : 1: type_inference TotalTime = 0.106123, [30] [bootstrap]: 0.00041541 [type_inference]: 0.0673253 [event_method]: 2.169e-05 [auto_monad]: 7.344e-05 [graph_reusing]: 6.55002e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.00012416 [rewriter_before_opt_a]: 8.659e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.0355639, [2] [Cycle 1]: 0.00237681, [27] [switch_simplify]: 6.774e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.00061669 [with_stream_mark]: 2.899e-05 [recompute_prepare]: 8.97e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.48998e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 3.03e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.97001e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00125743 [add_forward_monad_depend]: 6.96999e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.599e-05 [cse]: 3.868e-05 [replace_applicator]: 1.621e-05 [Cycle 2]: 0.00033328, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 5.19e-06 [a_1]: 9.168e-05 [with_stream_mark]: 1.183e-05 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.51002e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 4.95999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.462e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 1.56e-05 [rewriter_after_opt_a]: 4.399e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00078077 [jit_opt_b]: 5.255e-05, [1] [Cycle 1]: 4.433e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.633e-05 [cconv]: 2.63e-05 [loop_unroll]: 0.00045518 [jit_opt_after_cconv]: 0.00014785, [1] [Cycle 1]: 0.0001415, [11] [c_1]: 2.058e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 6.46999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.476e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 2.17001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.65e-05 [partial_unused_args_eliminate]: 2.93e-06 [environ_conv]: 6.68e-06 [add_recomputation]: 5.403e-05 [cse_after_recomputation]: 2.222e-05, [1] [Cycle 1]: 1.728e-05, [1] [cse]: 1.187e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 7.32002e-06 [opt_after_jit_grad]: 0.00049376 [symbol_engine_optimizer]: 7.596e-05, [1] [Cycle 1]: 7.005e-05, [6] [build]: 4.62998e-06 [elim_shapecalc]: 8.14002e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 4.19997e-07 [validate]: 4.315e-05 Sums bootstrap : 0.000415s : 0.57% type_inference : 0.067325s : 92.70% event_method : 0.000022s : 0.03% auto_monad : 0.000073s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000124s : 0.17% rewriter_before_opt_a : 0.000087s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000708s : 0.98% jit_opt_a.with_stream_mark : 0.000041s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001258s : 1.73% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000053s : 0.07% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000044s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000781s : 1.08% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.000455s : 0.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000494s : 0.68% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.06% Time group info: ------[substitution.] 0.000272 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 86.25% : 0.000234s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000006s : 2: substitution.replace_old_param 4.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067225 2 97.25% : 0.065379s : 1: type_inference.infer 2.75% : 0.001846s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.90% : 0.000054s : 4: replace.inline 31.10% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 95.31% : 0.000232s : 4: match.inline 4.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 2.47% : 0.000003s : 10: predicate.arithmetic_simplify 1.67% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.25% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.78% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.10% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.19% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.48% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000963 13 45.44% : 0.000438s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.16% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.40% : 0.000466s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108353 72 0.05% : 0.000057s : 1: add_recomputation 0.07% : 0.000077s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.41% : 0.000441s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 32.83% : 0.035568s : 1: jit_opt_a 0.14% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.43% : 0.000463s : 1: loop_unroll 0.73% : 0.000792s : 1: mutable_eliminate 0.87% : 0.000948s : 26: opt.transform.jit_opt_a 0.04% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000502s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000128s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.73% : 0.000788s : 1: renormalize.infer 0.42% : 0.000460s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 62.16% : 0.067347s : 1: type_inference TotalTime = 0.0333663, [30] [bootstrap]: 0.0004738 [type_inference]: 0.0155554 [event_method]: 2.183e-05 [auto_monad]: 7.651e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 6.427e-05 [rewriter_before_opt_a]: 8.084e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00980049, [2] [Cycle 1]: 0.00270956, [27] [switch_simplify]: 7.831e-05 [loop_unroll]: 3.309e-05 [a_1]: 0.00074948 [with_stream_mark]: 2.963e-05 [recompute_prepare]: 1.048e-05 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 7.28e-06 [meta_shard_fg_expand]: 2.84999e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.96997e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.816e-05 [j_node_and_user_rematch]: 1.053e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.259e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00136554 [add_forward_monad_depend]: 1.156e-05 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 2.234e-05 [cse]: 3.337e-05 [replace_applicator]: 2.249e-05 [Cycle 2]: 0.00041265, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.64998e-06 [a_1]: 0.00010762 [with_stream_mark]: 1.677e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 3.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.241e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 1.103e-05 [inline_without_move]: 5.93002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.56e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 1.066e-05 [cse]: 1.552e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 2.007e-05 [rewriter_after_opt_a]: 4.669e-05 [convert_after_rewriter]: 8.19998e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.00217931 [jit_opt_b]: 7.336e-05, [1] [Cycle 1]: 6.09e-05, [2] [frontend_op_eliminate]: 2.255e-05 [inline_after_opt_a]: 2.138e-05 [cconv]: 4.032e-05 [loop_unroll]: 0.00068766 [jit_opt_after_cconv]: 0.00024641, [1] [Cycle 1]: 0.00023672, [11] [c_1]: 2.693e-05 [parameter_eliminate]: 6.69001e-06 [updatestate_depend_eliminate]: 1.221e-05 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 3.643e-05 [call_graph_tuple_transform]: 2.823e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 2.02001e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 7.79002e-06 [remove_dup_value]: 1.799e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 8.80999e-06 [add_recomputation]: 6.196e-05 [cse_after_recomputation]: 2.966e-05, [1] [Cycle 1]: 2.15e-05, [1] [cse]: 1.261e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 3.16001e-06 [rewriter_after_jit_bprop_graph]: 1.325e-05 [opt_after_jit_grad]: 0.00152188 [symbol_engine_optimizer]: 0.001949, [1] [Cycle 1]: 0.00193527, [6] [build]: 6.64001e-06 [elim_shapecalc]: 9.54e-06 [elim_not_effective]: 2.091e-05 [opt_reshape]: 7.5e-06 [fold_const_symbol]: 0.00180838 [renormalize]: 1.61002e-06 [validate]: 7.881e-05 Sums bootstrap : 0.000474s : 1.84% type_inference : 0.015555s : 60.33% event_method : 0.000022s : 0.08% auto_monad : 0.000077s : 0.30% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000064s : 0.25% rewriter_before_opt_a : 0.000081s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000085s : 0.33% jit_opt_a.loop_unroll : 0.000039s : 0.15% jit_opt_a.a_1 : 0.000857s : 3.32% jit_opt_a.with_stream_mark : 0.000046s : 0.18% jit_opt_a.recompute_prepare : 0.000018s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000014s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000014s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.05% jit_opt_a.merge_forward : 0.000010s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.08% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000024s : 0.09% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.001366s : 5.30% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.13% jit_opt_a.cse : 0.000049s : 0.19% jit_opt_a.replace_applicator : 0.000029s : 0.11% py_interpret_to_execute_after_opt_a : 0.000020s : 0.08% rewriter_after_opt_a : 0.000047s : 0.18% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.002179s : 8.45% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.09% jit_opt_b.inline_after_opt_a : 0.000021s : 0.08% cconv : 0.000040s : 0.16% loop_unroll : 0.000688s : 2.67% jit_opt_after_cconv.c_1 : 0.000027s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.03% add_recomputation : 0.000062s : 0.24% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000013s : 0.05% opt_after_jit_grad : 0.001522s : 5.90% symbol_engine_optimizer.build : 0.000007s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.001808s : 7.01% symbol_engine_optimizer.renormalize : 0.000002s : 0.01% validate : 0.000079s : 0.31% Time group info: ------[substitution.] 0.000331 23 1.11% : 0.000004s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 3: substitution.graph_param_transform 85.87% : 0.000284s : 4: substitution.inline 1.38% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000008s : 2: substitution.replace_old_param 4.62% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015454 2 91.46% : 0.014135s : 1: type_inference.infer 8.54% : 0.001319s : 1: type_inference.specialize ------[replace.] 0.000106 6 63.25% : 0.000067s : 4: replace.inline 36.75% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 6 95.29% : 0.000280s : 4: match.inline 4.71% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000167 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 2.33% : 0.000004s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 10: predicate.addn_check_dump 1.01% : 0.000002s : 10: predicate.addn_zero_filter 2.40% : 0.000004s : 10: predicate.arithmetic_simplify 1.15% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000002s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.44% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.80% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.76% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 10: predicate.environ_get_depend_swap 1.09% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.31% : 0.000001s : 3: predicate.fold_const_symbol 1.03% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000009s : 22: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 2.00% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.44% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 0.92% : 0.000002s : 10: predicate.minmaximum_grad 3.72% : 0.000006s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 1.79% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000003s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 1.78% : 0.000003s : 10: predicate.reshape_eliminate 1.46% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000002s : 3: predicate.row_tensor_eliminate 1.71% : 0.000003s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 6: predicate.special_op_eliminate 0.72% : 0.000001s : 6: predicate.specialize_transform 1.88% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 0.81% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.03% : 0.000005s : 16: predicate.switch_defer_inline 1.55% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.00% : 0.000012s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.06% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.97% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.11% : 0.000004s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.33% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001243 13 56.11% : 0.000698s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.16% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.73% : 0.000482s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037720 72 0.18% : 0.000067s : 1: add_recomputation 0.21% : 0.000081s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.33% : 0.000500s : 1: bootstrap 0.11% : 0.000043s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000033s : 1: cse_after_recomputation 0.03% : 0.000012s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 26.00% : 0.009806s : 1: jit_opt_a 0.66% : 0.000250s : 1: jit_opt_after_cconv 0.20% : 0.000077s : 1: jit_opt_b 1.85% : 0.000699s : 1: loop_unroll 5.84% : 0.002203s : 1: mutable_eliminate 3.01% : 0.001135s : 26: opt.transform.jit_opt_a 0.17% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000035s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000032s : 1: opt.transform.mutable_eliminate 0.11% : 0.000043s : 1: opt.transform.opt_after_jit_grad 4.88% : 0.001839s : 4: opt.transform.symbol_engine_opt 4.08% : 0.001539s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000068s : 1: py_interpret_to_execute 0.06% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.99% : 0.000750s : 1: renormalize.infer 1.59% : 0.000602s : 1: renormalize.specialize 0.04% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000052s : 1: rewriter_after_opt_a 0.22% : 0.000085s : 1: rewriter_before_opt_a 5.18% : 0.001955s : 1: symbol_engine_optimizer 41.30% : 0.015578s : 1: type_inference TotalTime = 0.0594635, [30] [bootstrap]: 0.00043175 [type_inference]: 0.0111422 [event_method]: 2.34e-05 [auto_monad]: 7.837e-05 [graph_reusing]: 6.92002e-06 [pre_auto_parallel]: 3.36999e-06 [py_interpret_to_execute]: 7.025e-05 [rewriter_before_opt_a]: 9.543e-05 [expand_dump_flag]: 4.52e-06 [jit_opt_a]: 0.0437082, [2] [Cycle 1]: 0.00272803, [27] [switch_simplify]: 8.015e-05 [loop_unroll]: 3.476e-05 [a_1]: 0.00082992 [with_stream_mark]: 2.903e-05 [recompute_prepare]: 1.252e-05 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.74002e-06 [parameter_eliminate]: 2.92002e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.58e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 3.14999e-06 [get_grad_eliminate_]: 6.48e-06 [merge_forward]: 4.75999e-06 [cell_reuse_recompute_pass]: 1.61002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.882e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 1.186e-05 [inline_without_move]: 6.21998e-06 [renormalize]: 0.00127738 [add_forward_monad_depend]: 1.125e-05 [auto_monad_grad]: 3.01999e-06 [auto_monad_eliminator]: 2.373e-05 [cse]: 4.805e-05 [replace_applicator]: 2.771e-05 [Cycle 2]: 0.00043041, [27] [switch_simplify]: 7.66999e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00011086 [with_stream_mark]: 2.176e-05 [recompute_prepare]: 7.05e-06 [updatestate_depend_eliminate]: 5.16002e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.80997e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.21998e-06 [merge_forward]: 5.33002e-06 [cell_reuse_recompute_pass]: 2.60002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.207e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 1.50001e-07 [add_forward_monad_depend]: 2.41e-06 [auto_monad_grad]: 1.59998e-06 [auto_monad_eliminator]: 1.159e-05 [cse]: 2.282e-05 [replace_applicator]: 7.46001e-06 [py_interpret_to_execute_after_opt_a]: 2.035e-05 [rewriter_after_opt_a]: 5.178e-05 [convert_after_rewriter]: 7.44002e-06 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.00113294 [jit_opt_b]: 7.464e-05, [1] [Cycle 1]: 6.07e-05, [2] [frontend_op_eliminate]: 2.507e-05 [inline_after_opt_a]: 2.183e-05 [cconv]: 4.717e-05 [loop_unroll]: 0.00071169 [jit_opt_after_cconv]: 0.00023717, [1] [Cycle 1]: 0.00022822, [11] [c_1]: 3.024e-05 [parameter_eliminate]: 7.82e-06 [updatestate_depend_eliminate]: 1.483e-05 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.34001e-06 [cse]: 5.735e-05 [call_graph_tuple_transform]: 3.62e-05 [tuple_list_get_item_eliminator]: 7.01999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 6.41e-06 [remove_dup_value]: 6.188e-05 [partial_unused_args_eliminate]: 3.68999e-06 [environ_conv]: 9.03002e-06 [add_recomputation]: 6.832e-05 [cse_after_recomputation]: 3.636e-05, [1] [Cycle 1]: 2.746e-05, [1] [cse]: 1.887e-05 [auto_monad_reorder]: 1.996e-05 [get_jit_bprop_graph]: 2.64001e-06 [rewriter_after_jit_bprop_graph]: 1.188e-05 [opt_after_jit_grad]: 0.00080692 [symbol_engine_optimizer]: 0.00021068, [1] [Cycle 1]: 0.00019782, [6] [build]: 5.25999e-06 [elim_shapecalc]: 9.51e-06 [elim_not_effective]: 2.314e-05 [opt_reshape]: 8.89998e-06 [fold_const_symbol]: 1.883e-05 [renormalize]: 1.05001e-06 [validate]: 6.474e-05 Sums bootstrap : 0.000432s : 2.40% type_inference : 0.011142s : 62.04% event_method : 0.000023s : 0.13% auto_monad : 0.000078s : 0.44% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000070s : 0.39% rewriter_before_opt_a : 0.000095s : 0.53% expand_dump_flag : 0.000005s : 0.03% jit_opt_a.switch_simplify : 0.000088s : 0.49% jit_opt_a.loop_unroll : 0.000041s : 0.23% jit_opt_a.a_1 : 0.000941s : 5.24% jit_opt_a.with_stream_mark : 0.000051s : 0.28% jit_opt_a.recompute_prepare : 0.000020s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.07% jit_opt_a.merge_forward : 0.000010s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000022s : 0.12% jit_opt_a.inline_without_move : 0.000012s : 0.07% jit_opt_a.renormalize : 0.001278s : 7.11% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.08% jit_opt_a.auto_monad_grad : 0.000005s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.20% jit_opt_a.cse : 0.000071s : 0.39% jit_opt_a.replace_applicator : 0.000035s : 0.20% py_interpret_to_execute_after_opt_a : 0.000020s : 0.11% rewriter_after_opt_a : 0.000052s : 0.29% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.001133s : 6.31% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.14% jit_opt_b.inline_after_opt_a : 0.000022s : 0.12% cconv : 0.000047s : 0.26% loop_unroll : 0.000712s : 3.96% jit_opt_after_cconv.c_1 : 0.000030s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000057s : 0.32% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000062s : 0.34% partial_unused_args_eliminate : 0.000004s : 0.02% environ_conv : 0.000009s : 0.05% add_recomputation : 0.000068s : 0.38% cse_after_recomputation.cse : 0.000019s : 0.11% auto_monad_reorder : 0.000020s : 0.11% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.07% opt_after_jit_grad : 0.000807s : 4.49% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000019s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000065s : 0.36% Time group info: ------[substitution.] 0.000383 24 0.80% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.67% : 0.000010s : 3: substitution.graph_param_transform 86.89% : 0.000333s : 5: substitution.inline 1.63% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000008s : 2: substitution.replace_old_param 3.97% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011042 2 87.55% : 0.009667s : 1: type_inference.infer 12.45% : 0.001375s : 1: type_inference.specialize ------[replace.] 0.000124 7 68.40% : 0.000085s : 5: replace.inline 31.60% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000343 7 95.95% : 0.000329s : 5: match.inline 4.05% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 747 1.53% : 0.000002s : 11: predicate.accumulaten_eliminater 1.84% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000002s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 1.84% : 0.000003s : 11: predicate.arithmetic_simplify 1.58% : 0.000003s : 11: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000001s : 11: predicate.compare_switch_simplify 1.16% : 0.000002s : 11: predicate.depend_value_elim 0.98% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.94% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_depend_swap 1.09% : 0.000002s : 11: predicate.environ_get_eliminate 0.92% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.49% : 0.000002s : 6: predicate.get_grad_eliminate 0.47% : 0.000001s : 3: predicate.graph_param_transform 6.81% : 0.000011s : 24: predicate.inline 0.63% : 0.000001s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.78% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 16: predicate.load_eliminater 1.83% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.56% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 11: predicate.merge_addn 1.07% : 0.000002s : 11: predicate.minmaximum_grad 4.15% : 0.000007s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 1.94% : 0.000003s : 16: predicate.partial_eliminate 0.94% : 0.000002s : 11: predicate.print_const_string_wrapper 2.02% : 0.000003s : 11: predicate.reduce_eliminate 1.11% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000003s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.12% : 0.000002s : 3: predicate.row_tensor_eliminate 0.98% : 0.000002s : 11: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000002s : 6: predicate.special_op_eliminate 0.71% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 0.95% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 18: predicate.switch_defer_inline 1.81% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.40% : 0.000012s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.51% : 0.000002s : 11: predicate.transpose_eliminate 1.19% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.58% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 2.45% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 11: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001273 16 52.58% : 0.000669s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.35% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.07% : 0.000497s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062035 72 0.12% : 0.000072s : 1: add_recomputation 0.13% : 0.000082s : 1: auto_monad 0.04% : 0.000023s : 1: auto_monad_reorder 0.74% : 0.000457s : 1: bootstrap 0.08% : 0.000051s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000039s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 70.47% : 0.043713s : 1: jit_opt_a 0.39% : 0.000240s : 1: jit_opt_after_cconv 0.13% : 0.000078s : 1: jit_opt_b 1.17% : 0.000726s : 1: loop_unroll 1.87% : 0.001162s : 1: mutable_eliminate 1.98% : 0.001230s : 26: opt.transform.jit_opt_a 0.12% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000037s : 4: opt.transform.jit_opt_b 0.04% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000037s : 1: opt.transform.mutable_eliminate 0.06% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000056s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000824s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000073s : 1: py_interpret_to_execute 0.04% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000066s : 1: remove_dup_value 1.16% : 0.000720s : 1: renormalize.infer 0.88% : 0.000544s : 1: renormalize.specialize 0.02% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000056s : 1: rewriter_after_opt_a 0.16% : 0.000100s : 1: rewriter_before_opt_a 0.35% : 0.000215s : 1: symbol_engine_optimizer 18.00% : 0.011163s : 1: type_inference TotalTime = 0.25425, [30] [bootstrap]: 0.00033436 [type_inference]: 0.20416 [event_method]: 2.322e-05 [auto_monad]: 7.741e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00032673 [rewriter_before_opt_a]: 9.578e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.0098192, [2] [Cycle 1]: 0.00538078, [27] [switch_simplify]: 8.536e-05 [loop_unroll]: 3.26e-05 [a_1]: 0.00075754 [with_stream_mark]: 3.092e-05 [recompute_prepare]: 1.28e-05 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 7.84002e-06 [updatestate_useless_node_eliminater]: 7.10002e-06 [accelerated_algorithm]: 6.99001e-06 [meta_shard_fg_expand]: 2.73003e-06 [get_grad_eliminate_]: 7.35e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.87e-05 [j_node_and_user_rematch]: 1.227e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.485e-05 [inline_without_move]: 7.76001e-06 [renormalize]: 0.00396428 [add_forward_monad_depend]: 1.436e-05 [auto_monad_grad]: 3.20998e-06 [auto_monad_eliminator]: 2.659e-05 [cse]: 4.615e-05 [replace_applicator]: 2.912e-05 [Cycle 2]: 0.00045408, [27] [switch_simplify]: 8.70001e-06 [loop_unroll]: 6.47001e-06 [a_1]: 0.00013527 [with_stream_mark]: 2.016e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 2.72001e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 4.67998e-06 [cell_reuse_recompute_pass]: 3.63999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.236e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 5.76e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.32001e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 9.56003e-06 [cse]: 1.961e-05 [replace_applicator]: 9.27001e-06 [py_interpret_to_execute_after_opt_a]: 2.221e-05 [rewriter_after_opt_a]: 4.972e-05 [convert_after_rewriter]: 8.92999e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.0369907 [jit_opt_b]: 8.141e-05, [1] [Cycle 1]: 6.909e-05, [2] [frontend_op_eliminate]: 2.636e-05 [inline_after_opt_a]: 2.469e-05 [cconv]: 4.119e-05 [loop_unroll]: 0.00081396 [jit_opt_after_cconv]: 0.00022556, [1] [Cycle 1]: 0.00021815, [11] [c_1]: 3.208e-05 [parameter_eliminate]: 6.86001e-06 [updatestate_depend_eliminate]: 1.241e-05 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 4.44002e-06 [cse]: 5.296e-05 [call_graph_tuple_transform]: 3.358e-05 [tuple_list_get_item_eliminator]: 1.009e-05 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 7.18998e-06 [remove_dup_value]: 2.441e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 1.284e-05 [add_recomputation]: 6.086e-05 [cse_after_recomputation]: 3.044e-05, [1] [Cycle 1]: 2.439e-05, [1] [cse]: 1.725e-05 [auto_monad_reorder]: 1.985e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 1.002e-05 [opt_after_jit_grad]: 0.00059924 [symbol_engine_optimizer]: 8.699e-05, [1] [Cycle 1]: 7.894e-05, [6] [build]: 6.03002e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.612e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 1.098e-05 [renormalize]: 7.39994e-07 [validate]: 6.304e-05 Sums bootstrap : 0.000334s : 0.13% type_inference : 0.204160s : 81.84% event_method : 0.000023s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000327s : 0.13% rewriter_before_opt_a : 0.000096s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000094s : 0.04% jit_opt_a.loop_unroll : 0.000039s : 0.02% jit_opt_a.a_1 : 0.000893s : 0.36% jit_opt_a.with_stream_mark : 0.000051s : 0.02% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003964s : 1.59% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.01% jit_opt_a.cse : 0.000066s : 0.03% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000050s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.036991s : 14.83% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000041s : 0.02% loop_unroll : 0.000814s : 0.33% jit_opt_after_cconv.c_1 : 0.000032s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000053s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000034s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000024s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000061s : 0.02% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000599s : 0.24% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.03% Time group info: ------[substitution.] 0.000330 24 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 2.87% : 0.000009s : 4: substitution.graph_param_transform 84.83% : 0.000280s : 4: substitution.inline 1.68% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000007s : 4: substitution.remove_not_recompute_node 2.69% : 0.000009s : 2: substitution.replace_old_param 4.64% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.204053 2 98.66% : 0.201322s : 1: type_inference.infer 1.34% : 0.002731s : 1: type_inference.specialize ------[replace.] 0.000109 6 65.47% : 0.000071s : 4: replace.inline 34.53% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 6 95.12% : 0.000277s : 4: match.inline 4.88% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 830 1.02% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 12: predicate.addn_check_dump 1.16% : 0.000002s : 12: predicate.addn_zero_filter 2.19% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.89% : 0.000001s : 12: predicate.compare_switch_simplify 1.08% : 0.000002s : 12: predicate.depend_value_elim 1.41% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.05% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 12: predicate.environ_get_depend_swap 1.02% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.52% : 0.000009s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 18: predicate.load_eliminater 2.31% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.34% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 0.90% : 0.000001s : 12: predicate.minmaximum_grad 3.90% : 0.000006s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000004s : 18: predicate.partial_eliminate 1.00% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.24% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.66% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.69% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.40% : 0.000002s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 12: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000002s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 18: predicate.switch_defer_inline 1.83% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.09% : 0.000013s : 58: predicate.switch_simplify 1.11% : 0.000002s : 12: predicate.tile_eliminate 1.03% : 0.000002s : 12: predicate.transpose_eliminate 1.21% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.87% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.025881 30 95.38% : 0.024686s : 23: func_graph_cloner_run.FuncGraphClonerGraph 0.26% : 0.000067s : 1: func_graph_cloner_run.FuncGraphClonerNode 4.36% : 0.001128s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.259535 72 0.02% : 0.000064s : 1: add_recomputation 0.03% : 0.000081s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.14% : 0.000357s : 1: bootstrap 0.02% : 0.000044s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000017s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.79% : 0.009824s : 1: jit_opt_a 0.09% : 0.000230s : 1: jit_opt_after_cconv 0.03% : 0.000085s : 1: jit_opt_b 0.32% : 0.000827s : 1: loop_unroll 14.26% : 0.037022s : 1: mutable_eliminate 0.46% : 0.001205s : 26: opt.transform.jit_opt_a 0.03% : 0.000078s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000042s : 4: opt.transform.jit_opt_b 0.01% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000046s : 1: opt.transform.mutable_eliminate 0.01% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000610s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000333s : 1: py_interpret_to_execute 0.01% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000027s : 1: remove_dup_value 0.98% : 0.002545s : 1: renormalize.infer 0.54% : 0.001405s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000053s : 1: rewriter_after_opt_a 0.04% : 0.000101s : 1: rewriter_before_opt_a 0.03% : 0.000089s : 1: symbol_engine_optimizer 78.67% : 0.204185s : 1: type_inference TotalTime = 0.0790406, [30] [bootstrap]: 0.00035937 [type_inference]: 0.0227097 [event_method]: 2.202e-05 [auto_monad]: 6.342e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 8.94e-05 [rewriter_before_opt_a]: 7.864e-05 [expand_dump_flag]: 2.43002e-06 [jit_opt_a]: 0.0529182, [2] [Cycle 1]: 0.0488374, [27] [switch_simplify]: 6.365e-05 [loop_unroll]: 3.011e-05 [a_1]: 0.00061546 [with_stream_mark]: 2.822e-05 [recompute_prepare]: 1.201e-05 [updatestate_depend_eliminate]: 5.07999e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.617e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.314e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00428101 [add_forward_monad_depend]: 1.045e-05 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.157e-05 [cse]: 3.743e-05 [replace_applicator]: 0.0433664 [Cycle 2]: 0.00048396, [27] [switch_simplify]: 1.807e-05 [loop_unroll]: 7.00998e-06 [a_1]: 0.00010988 [with_stream_mark]: 3.08e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 2.88003e-06 [parameter_eliminate]: 3.29001e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 3.13e-06 [get_grad_eliminate_]: 4.91002e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 3.95e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.451e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.21e-05 [inline_without_move]: 5.57999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 5.95002e-06 [auto_monad_grad]: 3.83001e-06 [auto_monad_eliminator]: 1.791e-05 [cse]: 3.199e-05 [replace_applicator]: 7.61999e-06 [py_interpret_to_execute_after_opt_a]: 2.388e-05 [rewriter_after_opt_a]: 4.616e-05 [convert_after_rewriter]: 7.72998e-06 [order_py_execute_after_rewriter]: 6.11e-06 [mutable_eliminate]: 0.00088016 [jit_opt_b]: 6.023e-05, [1] [Cycle 1]: 4.907e-05, [2] [frontend_op_eliminate]: 1.764e-05 [inline_after_opt_a]: 1.901e-05 [cconv]: 3.926e-05 [loop_unroll]: 0.00053181 [jit_opt_after_cconv]: 0.00016486, [1] [Cycle 1]: 0.00015726, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 4.75001e-06 [updatestate_depend_eliminate]: 6.76999e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.95998e-06 [cse]: 3.255e-05 [call_graph_tuple_transform]: 2.382e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.48002e-06 [remove_dup_value]: 1.841e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 6.96001e-06 [add_recomputation]: 4.864e-05 [cse_after_recomputation]: 5.283e-05, [1] [Cycle 1]: 4.619e-05, [1] [cse]: 3.954e-05 [auto_monad_reorder]: 2.083e-05 [get_jit_bprop_graph]: 2.71999e-06 [rewriter_after_jit_bprop_graph]: 6.98998e-06 [opt_after_jit_grad]: 0.00054065 [symbol_engine_optimizer]: 7.738e-05, [1] [Cycle 1]: 6.986e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 7.70998e-06 [elim_not_effective]: 1.537e-05 [opt_reshape]: 6.37001e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 9.89996e-07 [validate]: 4.451e-05 Sums bootstrap : 0.000359s : 0.48% type_inference : 0.022710s : 30.40% event_method : 0.000022s : 0.03% auto_monad : 0.000063s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000089s : 0.12% rewriter_before_opt_a : 0.000079s : 0.11% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000725s : 0.97% jit_opt_a.with_stream_mark : 0.000059s : 0.08% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000025s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.004281s : 5.73% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.02% jit_opt_a.auto_monad_grad : 0.000007s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.05% jit_opt_a.cse : 0.000069s : 0.09% jit_opt_a.replace_applicator : 0.043374s : 58.07% py_interpret_to_execute_after_opt_a : 0.000024s : 0.03% rewriter_after_opt_a : 0.000046s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000880s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000039s : 0.05% loop_unroll : 0.000532s : 0.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000040s : 0.05% auto_monad_reorder : 0.000021s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000541s : 0.72% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.06% Time group info: ------[substitution.] 0.000276 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000006s : 3: substitution.graph_param_transform 83.85% : 0.000232s : 4: substitution.inline 1.60% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000007s : 4: substitution.remove_not_recompute_node 3.93% : 0.000011s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022627 2 93.71% : 0.021205s : 1: type_inference.infer 6.29% : 0.001423s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.27% : 0.000056s : 4: replace.inline 31.73% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 94.93% : 0.000230s : 4: match.inline 5.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.80% : 0.000002s : 10: predicate.addn_zero_filter 1.84% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.72% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 10: predicate.compare_switch_simplify 1.74% : 0.000002s : 10: predicate.depend_value_elim 0.92% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000002s : 10: predicate.environ_get_eliminate 0.90% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.21% : 0.000009s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000003s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 3.40% : 0.000005s : 18: predicate.replace_applicator 1.01% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.11% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000002s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.56% : 0.000012s : 53: predicate.switch_simplify 1.10% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.44% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 2.24% : 0.000003s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000917 13 47.10% : 0.000432s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.51% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.38% : 0.000425s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127714 72 0.04% : 0.000052s : 1: add_recomputation 0.05% : 0.000067s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.30% : 0.000381s : 1: bootstrap 0.03% : 0.000043s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000055s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 41.44% : 0.052923s : 1: jit_opt_a 0.13% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.42% : 0.000542s : 1: loop_unroll 0.70% : 0.000895s : 1: mutable_eliminate 34.72% : 0.044336s : 26: opt.transform.jit_opt_a 0.04% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000549s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000093s : 1: py_interpret_to_execute 0.02% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 2.95% : 0.003774s : 1: renormalize.infer 0.39% : 0.000493s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.06% : 0.000082s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 17.80% : 0.022734s : 1: type_inference TotalTime = 0.0187564, [30] [bootstrap]: 0.0003701 [type_inference]: 0.00904474 [event_method]: 2.271e-05 [auto_monad]: 6.988e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 5.038e-05 [rewriter_before_opt_a]: 8.499e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0063747, [2] [Cycle 1]: 0.00244662, [27] [switch_simplify]: 6.639e-05 [loop_unroll]: 3.457e-05 [a_1]: 0.00079744 [with_stream_mark]: 2.808e-05 [recompute_prepare]: 1.044e-05 [updatestate_depend_eliminate]: 5.05999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 3.13e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.876e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.83e-06 [renormalize]: 0.00110664 [add_forward_monad_depend]: 8.62e-06 [auto_monad_grad]: 3.06001e-06 [auto_monad_eliminator]: 1.833e-05 [cse]: 4.268e-05 [replace_applicator]: 1.742e-05 [Cycle 2]: 0.0003699, [27] [switch_simplify]: 6.71999e-06 [loop_unroll]: 5.24998e-06 [a_1]: 9.856e-05 [with_stream_mark]: 1.502e-05 [recompute_prepare]: 6.58e-06 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 5.38002e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 2.11e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [j_node_and_user_rematch]: 9.99001e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 8.67998e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 9.58002e-06 [cse]: 1.758e-05 [replace_applicator]: 6.59001e-06 [py_interpret_to_execute_after_opt_a]: 1.614e-05 [rewriter_after_opt_a]: 4.511e-05 [convert_after_rewriter]: 8.17e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00075762 [jit_opt_b]: 5.783e-05, [1] [Cycle 1]: 4.919e-05, [2] [frontend_op_eliminate]: 1.847e-05 [inline_after_opt_a]: 1.939e-05 [cconv]: 3.568e-05 [loop_unroll]: 0.00050042 [jit_opt_after_cconv]: 0.00017484, [1] [Cycle 1]: 0.00016808, [11] [c_1]: 2.332e-05 [parameter_eliminate]: 4.68999e-06 [updatestate_depend_eliminate]: 8.69e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [cse]: 3.426e-05 [call_graph_tuple_transform]: 2.424e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 1.09e-06 [switch_simplify]: 5.59e-06 [remove_dup_value]: 4.752e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.46001e-06 [add_recomputation]: 6.088e-05 [cse_after_recomputation]: 2.814e-05, [1] [Cycle 1]: 2.117e-05, [1] [cse]: 1.453e-05 [auto_monad_reorder]: 1.972e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 7.25e-06 [opt_after_jit_grad]: 0.00059035 [symbol_engine_optimizer]: 8.806e-05, [1] [Cycle 1]: 8.053e-05, [6] [build]: 5.74e-06 [elim_shapecalc]: 9.39e-06 [elim_not_effective]: 1.63e-05 [opt_reshape]: 7.53e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 4.89992e-07 [validate]: 4.993e-05 Sums bootstrap : 0.000370s : 2.55% type_inference : 0.009045s : 62.33% event_method : 0.000023s : 0.16% auto_monad : 0.000070s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.35% rewriter_before_opt_a : 0.000085s : 0.59% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.50% jit_opt_a.loop_unroll : 0.000040s : 0.27% jit_opt_a.a_1 : 0.000896s : 6.17% jit_opt_a.with_stream_mark : 0.000043s : 0.30% jit_opt_a.recompute_prepare : 0.000017s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.14% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.13% jit_opt_a.inline_without_move : 0.000012s : 0.08% jit_opt_a.renormalize : 0.001107s : 7.63% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.19% jit_opt_a.cse : 0.000060s : 0.42% jit_opt_a.replace_applicator : 0.000024s : 0.17% py_interpret_to_execute_after_opt_a : 0.000016s : 0.11% rewriter_after_opt_a : 0.000045s : 0.31% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000758s : 5.22% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000019s : 0.13% cconv : 0.000036s : 0.25% loop_unroll : 0.000500s : 3.45% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000034s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000048s : 0.33% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000061s : 0.42% cse_after_recomputation.cse : 0.000015s : 0.10% auto_monad_reorder : 0.000020s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000590s : 4.07% symbol_engine_optimizer.build : 0.000006s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.34% Time group info: ------[substitution.] 0.000317 24 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 3: substitution.graph_param_transform 86.44% : 0.000274s : 5: substitution.inline 1.59% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000007s : 4: substitution.remove_not_recompute_node 1.91% : 0.000006s : 2: substitution.replace_old_param 4.84% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008968 2 87.97% : 0.007889s : 1: type_inference.infer 12.03% : 0.001079s : 1: type_inference.specialize ------[replace.] 0.000114 7 62.61% : 0.000071s : 5: replace.inline 37.39% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000285 7 95.05% : 0.000271s : 5: match.inline 4.95% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.56% : 0.000004s : 11: predicate.arithmetic_simplify 1.16% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 11: predicate.compare_switch_simplify 1.13% : 0.000002s : 11: predicate.depend_value_elim 1.46% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.42% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000008s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 16: predicate.load_eliminater 1.87% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 2.37% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.35% : 0.000002s : 11: predicate.print_const_string_wrapper 1.79% : 0.000002s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000003s : 19: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 11: predicate.reshape_eliminate 1.32% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.36% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.94% : 0.000004s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000010s : 59: predicate.switch_simplify 1.50% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000936 16 49.70% : 0.000465s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.86% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.44% : 0.000379s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021076 72 0.30% : 0.000064s : 1: add_recomputation 0.35% : 0.000073s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 1.86% : 0.000391s : 1: bootstrap 0.18% : 0.000038s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000031s : 1: cse_after_recomputation 0.12% : 0.000025s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.27% : 0.006379s : 1: jit_opt_a 0.84% : 0.000177s : 1: jit_opt_after_cconv 0.29% : 0.000060s : 1: jit_opt_b 2.42% : 0.000510s : 1: loop_unroll 3.66% : 0.000772s : 1: mutable_eliminate 5.46% : 0.001152s : 26: opt.transform.jit_opt_a 0.26% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000029s : 4: opt.transform.jit_opt_b 0.08% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000020s : 1: opt.transform.mutable_eliminate 0.13% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.86% : 0.000603s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000053s : 1: py_interpret_to_execute 0.09% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.24% : 0.000051s : 1: remove_dup_value 3.06% : 0.000644s : 1: renormalize.infer 2.15% : 0.000452s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000048s : 1: rewriter_after_opt_a 0.42% : 0.000088s : 1: rewriter_before_opt_a 0.43% : 0.000091s : 1: symbol_engine_optimizer 42.99% : 0.009062s : 1: type_inference TotalTime = 0.0803442, [30] [bootstrap]: 0.00038785 [type_inference]: 0.0681808 [event_method]: 2.341e-05 [auto_monad]: 7.78e-05 [graph_reusing]: 7.15e-06 [pre_auto_parallel]: 3.21001e-06 [py_interpret_to_execute]: 0.00013379 [rewriter_before_opt_a]: 9.096e-05 [expand_dump_flag]: 4.55001e-06 [jit_opt_a]: 0.00818834, [2] [Cycle 1]: 0.00274502, [27] [switch_simplify]: 7.59e-05 [loop_unroll]: 3.098e-05 [a_1]: 0.00075865 [with_stream_mark]: 3.243e-05 [recompute_prepare]: 1.333e-05 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 7.51001e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 5.22999e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.895e-05 [j_node_and_user_rematch]: 1.177e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.259e-05 [inline_without_move]: 6.58003e-06 [renormalize]: 0.00135648 [add_forward_monad_depend]: 1.041e-05 [auto_monad_grad]: 3.18998e-06 [auto_monad_eliminator]: 2.433e-05 [cse]: 4.672e-05 [replace_applicator]: 2.704e-05 [Cycle 2]: 0.00038325, [27] [switch_simplify]: 7.33999e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00010021 [with_stream_mark]: 1.762e-05 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 4.81002e-06 [merge_forward]: 4.70999e-06 [cell_reuse_recompute_pass]: 4.37003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.869e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 9.46003e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 1.74998e-06 [auto_monad_eliminator]: 8.08999e-06 [cse]: 1.981e-05 [replace_applicator]: 6.45997e-06 [py_interpret_to_execute_after_opt_a]: 1.976e-05 [rewriter_after_opt_a]: 4.832e-05 [convert_after_rewriter]: 8.22998e-06 [order_py_execute_after_rewriter]: 5.43002e-06 [mutable_eliminate]: 0.00097707 [jit_opt_b]: 5.919e-05, [1] [Cycle 1]: 4.892e-05, [2] [frontend_op_eliminate]: 1.697e-05 [inline_after_opt_a]: 1.858e-05 [cconv]: 3.976e-05 [loop_unroll]: 0.00066494 [jit_opt_after_cconv]: 0.00019651, [1] [Cycle 1]: 0.00018814, [11] [c_1]: 2.245e-05 [parameter_eliminate]: 6.54001e-06 [updatestate_depend_eliminate]: 1.143e-05 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 4.767e-05 [call_graph_tuple_transform]: 2.543e-05 [tuple_list_get_item_eliminator]: 5.46998e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 1.12999e-06 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.959e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 7.02002e-06 [add_recomputation]: 6.268e-05 [cse_after_recomputation]: 2.801e-05, [1] [Cycle 1]: 2.121e-05, [1] [cse]: 1.375e-05 [auto_monad_reorder]: 1.977e-05 [get_jit_bprop_graph]: 2.85002e-06 [rewriter_after_jit_bprop_graph]: 9.29e-06 [opt_after_jit_grad]: 0.00069249 [symbol_engine_optimizer]: 8.803e-05, [1] [Cycle 1]: 7.787e-05, [6] [build]: 6.86001e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 1.741e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 9.43002e-06 [renormalize]: 9.89996e-07 [validate]: 5.37e-05 Sums bootstrap : 0.000388s : 0.52% type_inference : 0.068181s : 91.49% event_method : 0.000023s : 0.03% auto_monad : 0.000078s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000134s : 0.18% rewriter_before_opt_a : 0.000091s : 0.12% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000083s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000859s : 1.15% jit_opt_a.with_stream_mark : 0.000050s : 0.07% jit_opt_a.recompute_prepare : 0.000020s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001357s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.04% jit_opt_a.cse : 0.000067s : 0.09% jit_opt_a.replace_applicator : 0.000033s : 0.04% py_interpret_to_execute_after_opt_a : 0.000020s : 0.03% rewriter_after_opt_a : 0.000048s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000977s : 1.31% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000040s : 0.05% loop_unroll : 0.000665s : 0.89% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000063s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000692s : 0.93% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.07% Time group info: ------[substitution.] 0.000378 23 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000002s : 2: substitution.fold_const_symbol 1.54% : 0.000006s : 3: substitution.graph_param_transform 88.79% : 0.000336s : 4: substitution.inline 1.28% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.55% : 0.000006s : 4: substitution.remove_not_recompute_node 1.94% : 0.000007s : 2: substitution.replace_old_param 3.85% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068068 2 97.15% : 0.066129s : 1: type_inference.infer 2.85% : 0.001939s : 1: type_inference.specialize ------[replace.] 0.000092 6 70.04% : 0.000065s : 4: replace.inline 29.96% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000346 6 96.17% : 0.000333s : 4: match.inline 3.83% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 691 1.04% : 0.000002s : 10: predicate.accumulaten_eliminater 1.59% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.80% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 2.67% : 0.000004s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.32% : 0.000000s : 3: predicate.check_bprop_eliminate 0.82% : 0.000001s : 10: predicate.compare_switch_simplify 1.48% : 0.000002s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.99% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.96% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.94% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.96% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.84% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.80% : 0.000001s : 10: predicate.environ_get_depend_swap 0.93% : 0.000001s : 10: predicate.environ_get_eliminate 0.81% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000008s : 22: predicate.inline 1.02% : 0.000002s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 15: predicate.load_eliminater 2.55% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.71% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.51% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.83% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000002s : 10: predicate.minmaximum_grad 4.15% : 0.000006s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000002s : 10: predicate.print_const_string_wrapper 1.47% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000003s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.45% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 0.92% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000002s : 3: predicate.row_tensor_eliminate 1.56% : 0.000002s : 10: predicate.same_eliminate 0.80% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.67% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.88% : 0.000004s : 16: predicate.switch_defer_inline 1.85% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.21% : 0.000013s : 53: predicate.switch_simplify 0.92% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.15% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.26% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.25% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001000 13 40.73% : 0.000407s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.52% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.74% : 0.000527s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.082910 72 0.08% : 0.000066s : 1: add_recomputation 0.10% : 0.000082s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.50% : 0.000411s : 1: bootstrap 0.05% : 0.000043s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 9.88% : 0.008192s : 1: jit_opt_a 0.24% : 0.000200s : 1: jit_opt_after_cconv 0.08% : 0.000063s : 1: jit_opt_b 0.82% : 0.000679s : 1: loop_unroll 1.20% : 0.000998s : 1: mutable_eliminate 1.37% : 0.001137s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000030s : 1: opt.transform.mutable_eliminate 0.04% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.85% : 0.000708s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.17% : 0.000138s : 1: py_interpret_to_execute 0.03% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 0.97% : 0.000802s : 1: renormalize.infer 0.65% : 0.000540s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000053s : 1: rewriter_after_opt_a 0.12% : 0.000096s : 1: rewriter_before_opt_a 0.11% : 0.000091s : 1: symbol_engine_optimizer 82.27% : 0.068207s : 1: type_inference TotalTime = 0.179751, [30] [bootstrap]: 0.00054608 [type_inference]: 0.16314 [event_method]: 2.454e-05 [auto_monad]: 8.621e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 0.00083566 [rewriter_before_opt_a]: 0.0001072 [expand_dump_flag]: 4.42e-06 [jit_opt_a]: 0.0118404, [2] [Cycle 1]: 0.00593116, [27] [switch_simplify]: 7.274e-05 [loop_unroll]: 3.156e-05 [a_1]: 0.00075286 [with_stream_mark]: 3.153e-05 [recompute_prepare]: 1.195e-05 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 8.13999e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 7.72998e-06 [meta_shard_fg_expand]: 3.14001e-06 [get_grad_eliminate_]: 8.89998e-06 [merge_forward]: 4.84e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.945e-05 [j_node_and_user_rematch]: 1.221e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.278e-05 [inline_without_move]: 7.13e-06 [renormalize]: 0.00457808 [add_forward_monad_depend]: 1.178e-05 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 2.39e-05 [cse]: 3.563e-05 [replace_applicator]: 2.477e-05 [Cycle 2]: 0.00050049, [27] [switch_simplify]: 8.43999e-06 [loop_unroll]: 7.29001e-06 [a_1]: 0.0001874 [with_stream_mark]: 2.011e-05 [recompute_prepare]: 8.02e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 7.17002e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 2.98e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.101e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 1.188e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.00002e-06 [auto_monad_grad]: 1.40999e-06 [auto_monad_eliminator]: 9.20999e-06 [cse]: 1.861e-05 [replace_applicator]: 8.23001e-06 [py_interpret_to_execute_after_opt_a]: 1.886e-05 [rewriter_after_opt_a]: 4.527e-05 [convert_after_rewriter]: 8.12e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00094363 [jit_opt_b]: 6.966e-05, [1] [Cycle 1]: 6.041e-05, [2] [frontend_op_eliminate]: 2.378e-05 [inline_after_opt_a]: 2.084e-05 [cconv]: 3.273e-05 [loop_unroll]: 0.00057564 [jit_opt_after_cconv]: 0.00018297, [1] [Cycle 1]: 0.00017551, [11] [c_1]: 2.853e-05 [parameter_eliminate]: 5.12999e-06 [updatestate_depend_eliminate]: 8.12e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 3.95e-06 [cse]: 3.107e-05 [call_graph_tuple_transform]: 2.66e-05 [tuple_list_get_item_eliminator]: 6.39001e-06 [none_parameter_eliminate]: 1.83997e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.00002e-06 [remove_dup_value]: 1.724e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 1.098e-05 [add_recomputation]: 5.759e-05 [cse_after_recomputation]: 2.682e-05, [1] [Cycle 1]: 2.103e-05, [1] [cse]: 1.381e-05 [auto_monad_reorder]: 1.725e-05 [get_jit_bprop_graph]: 7.585e-05 [rewriter_after_jit_bprop_graph]: 8.90001e-06 [opt_after_jit_grad]: 0.00064314 [symbol_engine_optimizer]: 9.454e-05, [1] [Cycle 1]: 8.653e-05, [6] [build]: 5.52999e-06 [elim_shapecalc]: 9.74e-06 [elim_not_effective]: 1.826e-05 [opt_reshape]: 8.45999e-06 [fold_const_symbol]: 1.212e-05 [renormalize]: 4.19997e-07 [validate]: 6.058e-05 Sums bootstrap : 0.000546s : 0.31% type_inference : 0.163140s : 93.99% event_method : 0.000025s : 0.01% auto_monad : 0.000086s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000836s : 0.48% rewriter_before_opt_a : 0.000107s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.02% jit_opt_a.a_1 : 0.000940s : 0.54% jit_opt_a.with_stream_mark : 0.000052s : 0.03% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004578s : 2.64% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000944s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000576s : 0.33% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000058s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000076s : 0.04% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000643s : 0.37% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.03% Time group info: ------[substitution.] 0.000316 24 0.88% : 0.000003s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000007s : 4: substitution.graph_param_transform 83.26% : 0.000263s : 4: substitution.inline 1.56% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000007s : 4: substitution.remove_not_recompute_node 2.55% : 0.000008s : 2: substitution.replace_old_param 6.57% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.163011 2 96.60% : 0.157466s : 1: type_inference.infer 3.40% : 0.005545s : 1: type_inference.specialize ------[replace.] 0.000100 6 62.88% : 0.000063s : 4: replace.inline 37.12% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 6 93.34% : 0.000260s : 4: match.inline 6.66% : 0.000019s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 830 1.66% : 0.000003s : 12: predicate.accumulaten_eliminater 1.33% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 12: predicate.addn_check_dump 1.55% : 0.000003s : 12: predicate.addn_zero_filter 2.61% : 0.000004s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 12: predicate.compare_switch_simplify 0.99% : 0.000002s : 12: predicate.depend_value_elim 1.31% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.51% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.94% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.07% : 0.000008s : 26: predicate.inline 1.13% : 0.000002s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 18: predicate.load_eliminater 2.15% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.57% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000002s : 12: predicate.merge_addn 1.01% : 0.000002s : 12: predicate.minmaximum_grad 2.58% : 0.000004s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 1.99% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000003s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 22: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.73% : 0.000003s : 12: predicate.same_eliminate 0.87% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.76% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 18: predicate.switch_defer_inline 2.19% : 0.000004s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000012s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.06% : 0.000002s : 12: predicate.transpose_eliminate 1.15% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.24% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.35% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.40% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003071 22 64.29% : 0.001975s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.26% : 0.000069s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.45% : 0.001027s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.185623 72 0.03% : 0.000061s : 1: add_recomputation 0.05% : 0.000090s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000568s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.04% : 0.000080s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.38% : 0.011845s : 1: jit_opt_a 0.10% : 0.000186s : 1: jit_opt_after_cconv 0.04% : 0.000073s : 1: jit_opt_b 0.32% : 0.000587s : 1: loop_unroll 0.52% : 0.000958s : 1: mutable_eliminate 0.66% : 0.001232s : 26: opt.transform.jit_opt_a 0.03% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000655s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.46% : 0.000849s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.86% : 0.003462s : 1: renormalize.infer 0.59% : 0.001097s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.06% : 0.000115s : 1: rewriter_before_opt_a 0.05% : 0.000097s : 1: symbol_engine_optimizer 87.91% : 0.163174s : 1: type_inference TotalTime = 0.0249181, [30] [bootstrap]: 0.00034468 [type_inference]: 0.00452662 [event_method]: 1.88e-05 [auto_monad]: 6.975e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 2.229e-05 [rewriter_before_opt_a]: 7.637e-05 [expand_dump_flag]: 3.15002e-06 [jit_opt_a]: 0.0174628, [2] [Cycle 1]: 0.0136645, [27] [switch_simplify]: 6.462e-05 [loop_unroll]: 2.857e-05 [a_1]: 0.00057535 [with_stream_mark]: 2.578e-05 [recompute_prepare]: 1.048e-05 [updatestate_depend_eliminate]: 5.01997e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.13002e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.14998e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 9.56998e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.79999e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.0125642 [add_forward_monad_depend]: 9.22001e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.974e-05 [cse]: 3.944e-05 [replace_applicator]: 2.349e-05 [Cycle 2]: 0.00036322, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.68997e-06 [a_1]: 9.875e-05 [with_stream_mark]: 1.62e-05 [recompute_prepare]: 4.99e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.21998e-06 [specialize_transform]: 5.44998e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 3.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.872e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.08002e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.51e-06 [cse]: 1.297e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.562e-05 [rewriter_after_opt_a]: 4.119e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00075194 [jit_opt_b]: 5.212e-05, [1] [Cycle 1]: 4.351e-05, [2] [frontend_op_eliminate]: 1.638e-05 [inline_after_opt_a]: 1.647e-05 [cconv]: 3.31e-05 [loop_unroll]: 0.00044296 [jit_opt_after_cconv]: 0.0001655, [1] [Cycle 1]: 0.00015895, [11] [c_1]: 2.069e-05 [parameter_eliminate]: 3.68e-06 [updatestate_depend_eliminate]: 7.45e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.88e-05 [call_graph_tuple_transform]: 2.819e-05 [tuple_list_get_item_eliminator]: 5.99999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 1.715e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 7.09001e-06 [add_recomputation]: 5.529e-05 [cse_after_recomputation]: 2.372e-05, [1] [Cycle 1]: 1.826e-05, [1] [cse]: 1.242e-05 [auto_monad_reorder]: 1.734e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 6.73998e-06 [opt_after_jit_grad]: 0.0004527 [symbol_engine_optimizer]: 7.047e-05, [1] [Cycle 1]: 6.427e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 7.18e-06 [elim_not_effective]: 1.246e-05 [opt_reshape]: 5.46e-06 [fold_const_symbol]: 8.25e-06 [renormalize]: 3.89991e-07 [validate]: 4.222e-05 Sums bootstrap : 0.000345s : 1.65% type_inference : 0.004527s : 21.70% event_method : 0.000019s : 0.09% auto_monad : 0.000070s : 0.33% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000022s : 0.11% rewriter_before_opt_a : 0.000076s : 0.37% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.34% jit_opt_a.loop_unroll : 0.000034s : 0.16% jit_opt_a.a_1 : 0.000674s : 3.23% jit_opt_a.with_stream_mark : 0.000042s : 0.20% jit_opt_a.recompute_prepare : 0.000015s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.09% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.09% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.012564s : 60.24% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.13% jit_opt_a.cse : 0.000052s : 0.25% jit_opt_a.replace_applicator : 0.000029s : 0.14% py_interpret_to_execute_after_opt_a : 0.000016s : 0.07% rewriter_after_opt_a : 0.000041s : 0.20% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000752s : 3.60% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000033s : 0.16% loop_unroll : 0.000443s : 2.12% jit_opt_after_cconv.c_1 : 0.000021s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.08% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.27% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000017s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000453s : 2.17% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.20% Time group info: ------[substitution.] 0.000247 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 3: substitution.graph_param_transform 84.12% : 0.000208s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.76% : 0.000007s : 2: substitution.replace_old_param 5.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004466 2 82.16% : 0.003669s : 1: type_inference.infer 17.84% : 0.000797s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.57% : 0.000050s : 4: replace.inline 33.43% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.51% : 0.000205s : 4: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 0.82% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 2.06% : 0.000003s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.41% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.99% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.83% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 2.43% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 2.39% : 0.000003s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.46% : 0.000002s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.27% : 0.000009s : 53: predicate.switch_simplify 1.04% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.63% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.84% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.81% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000646 13 46.33% : 0.000299s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.95% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.72% : 0.000295s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038453 72 0.15% : 0.000058s : 1: add_recomputation 0.19% : 0.000073s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.94% : 0.000360s : 1: bootstrap 0.09% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 45.42% : 0.017466s : 1: jit_opt_a 0.44% : 0.000168s : 1: jit_opt_after_cconv 0.14% : 0.000055s : 1: jit_opt_b 1.17% : 0.000452s : 1: loop_unroll 1.99% : 0.000766s : 1: mutable_eliminate 2.37% : 0.000911s : 26: opt.transform.jit_opt_a 0.15% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000025s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 31.55% : 0.012131s : 1: renormalize.infer 1.09% : 0.000419s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000044s : 1: rewriter_after_opt_a 0.21% : 0.000079s : 1: rewriter_before_opt_a 0.19% : 0.000073s : 1: symbol_engine_optimizer 11.81% : 0.004543s : 1: type_inference TotalTime = 0.0522464, [30] [bootstrap]: 0.00040847 [type_inference]: 0.0391975 [event_method]: 2.643e-05 [auto_monad]: 8.126e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 0.00021027 [rewriter_before_opt_a]: 0.00010375 [expand_dump_flag]: 4.18001e-06 [jit_opt_a]: 0.00859754, [2] [Cycle 1]: 0.00341566, [27] [switch_simplify]: 8.419e-05 [loop_unroll]: 3.169e-05 [a_1]: 0.00080405 [with_stream_mark]: 3.109e-05 [recompute_prepare]: 1.672e-05 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.56999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 8.48999e-06 [updatestate_useless_node_eliminater]: 7.4e-06 [accelerated_algorithm]: 7.77998e-06 [meta_shard_fg_expand]: 3.26001e-06 [get_grad_eliminate_]: 7.92e-06 [merge_forward]: 5.09e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.168e-05 [j_node_and_user_rematch]: 1.336e-05 [meta_fg_expand]: 3.18e-06 [replace_old_param]: 1.436e-05 [inline_without_move]: 8.59e-06 [renormalize]: 0.00194493 [add_forward_monad_depend]: 1.242e-05 [auto_monad_grad]: 3.00002e-06 [auto_monad_eliminator]: 2.409e-05 [cse]: 4.296e-05 [replace_applicator]: 2.632e-05 [Cycle 2]: 0.00042168, [27] [switch_simplify]: 7.98999e-06 [loop_unroll]: 5.89e-06 [a_1]: 0.0001165 [with_stream_mark]: 1.658e-05 [recompute_prepare]: 7.51001e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 2.16e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.176e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.151e-05 [inline_without_move]: 5.79999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.78998e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 8.77e-06 [cse]: 1.867e-05 [replace_applicator]: 7.15998e-06 [py_interpret_to_execute_after_opt_a]: 2.231e-05 [rewriter_after_opt_a]: 5.013e-05 [convert_after_rewriter]: 8.55001e-06 [order_py_execute_after_rewriter]: 5.87001e-06 [mutable_eliminate]: 0.00096365 [jit_opt_b]: 6.806e-05, [1] [Cycle 1]: 5.658e-05, [2] [frontend_op_eliminate]: 2.228e-05 [inline_after_opt_a]: 1.957e-05 [cconv]: 4.374e-05 [loop_unroll]: 0.00067918 [jit_opt_after_cconv]: 0.00023026, [1] [Cycle 1]: 0.00022166, [11] [c_1]: 2.93e-05 [parameter_eliminate]: 7.31001e-06 [updatestate_depend_eliminate]: 1.269e-05 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.02002e-06 [cse]: 4.815e-05 [call_graph_tuple_transform]: 3.38e-05 [tuple_list_get_item_eliminator]: 8.27998e-06 [none_parameter_eliminate]: 2.11e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 8.13001e-06 [remove_dup_value]: 2.083e-05 [partial_unused_args_eliminate]: 3.21001e-06 [environ_conv]: 1.01e-05 [add_recomputation]: 0.00012838 [cse_after_recomputation]: 4.392e-05, [1] [Cycle 1]: 3.518e-05, [1] [cse]: 2.21e-05 [auto_monad_reorder]: 2.248e-05 [get_jit_bprop_graph]: 6.122e-05 [rewriter_after_jit_bprop_graph]: 1.306e-05 [opt_after_jit_grad]: 0.0007833 [symbol_engine_optimizer]: 0.00010315, [1] [Cycle 1]: 9.262e-05, [6] [build]: 6.21e-06 [elim_shapecalc]: 1.08e-05 [elim_not_effective]: 2.316e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 1.164e-05 [renormalize]: 1.39e-06 [validate]: 5.743e-05 Sums bootstrap : 0.000408s : 0.88% type_inference : 0.039198s : 84.07% event_method : 0.000026s : 0.06% auto_monad : 0.000081s : 0.17% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000210s : 0.45% rewriter_before_opt_a : 0.000104s : 0.22% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.20% jit_opt_a.loop_unroll : 0.000038s : 0.08% jit_opt_a.a_1 : 0.000921s : 1.97% jit_opt_a.with_stream_mark : 0.000048s : 0.10% jit_opt_a.recompute_prepare : 0.000024s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000026s : 0.06% jit_opt_a.inline_without_move : 0.000014s : 0.03% jit_opt_a.renormalize : 0.001945s : 4.17% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.07% jit_opt_a.cse : 0.000062s : 0.13% jit_opt_a.replace_applicator : 0.000033s : 0.07% py_interpret_to_execute_after_opt_a : 0.000022s : 0.05% rewriter_after_opt_a : 0.000050s : 0.11% convert_after_rewriter : 0.000009s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000964s : 2.07% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.05% jit_opt_b.inline_after_opt_a : 0.000020s : 0.04% cconv : 0.000044s : 0.09% loop_unroll : 0.000679s : 1.46% jit_opt_after_cconv.c_1 : 0.000029s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000034s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.02% remove_dup_value : 0.000021s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000128s : 0.28% cse_after_recomputation.cse : 0.000022s : 0.05% auto_monad_reorder : 0.000022s : 0.05% get_jit_bprop_graph : 0.000061s : 0.13% rewriter_after_jit_bprop_graph : 0.000013s : 0.03% opt_after_jit_grad : 0.000783s : 1.68% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.12% Time group info: ------[substitution.] 0.000357 23 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.51% : 0.000009s : 3: substitution.graph_param_transform 84.60% : 0.000302s : 4: substitution.inline 2.03% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000006s : 4: substitution.remove_not_recompute_node 2.70% : 0.000010s : 2: substitution.replace_old_param 4.92% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039089 2 93.68% : 0.036617s : 1: type_inference.infer 6.32% : 0.002472s : 1: type_inference.specialize ------[replace.] 0.000122 6 64.97% : 0.000079s : 4: replace.inline 35.03% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000314 6 94.91% : 0.000298s : 4: match.inline 5.09% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000170 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.48% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 10: predicate.addn_check_dump 1.00% : 0.000002s : 10: predicate.addn_zero_filter 2.68% : 0.000005s : 10: predicate.arithmetic_simplify 1.10% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 10: predicate.compare_switch_simplify 1.05% : 0.000002s : 10: predicate.depend_value_elim 0.91% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.63% : 0.000003s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.69% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.87% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.84% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.74% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000002s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.96% : 0.000010s : 22: predicate.inline 1.27% : 0.000002s : 6: predicate.inline_without_move 0.30% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.80% : 0.000003s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.27% : 0.000004s : 15: predicate.load_eliminater 1.86% : 0.000003s : 3: predicate.loop_unroll_after_grad 2.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 1.45% : 0.000002s : 10: predicate.minmaximum_grad 2.02% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 1.54% : 0.000003s : 15: predicate.partial_eliminate 1.38% : 0.000002s : 10: predicate.print_const_string_wrapper 1.54% : 0.000003s : 10: predicate.reduce_eliminate 1.74% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.42% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000001s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.73% : 0.000003s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000002s : 3: predicate.row_tensor_eliminate 0.80% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000002s : 6: predicate.special_op_eliminate 0.70% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.94% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.25% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.32% : 0.000006s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.80% : 0.000012s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.00% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000008s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.78% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 2.23% : 0.000004s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001310 13 39.49% : 0.000517s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.63% : 0.000074s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.87% : 0.000719s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055509 72 0.25% : 0.000137s : 1: add_recomputation 0.15% : 0.000085s : 1: auto_monad 0.05% : 0.000026s : 1: auto_monad_reorder 0.79% : 0.000440s : 1: bootstrap 0.08% : 0.000047s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.09% : 0.000048s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.06% : 0.000033s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.12% : 0.000066s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.50% : 0.008603s : 1: jit_opt_a 0.42% : 0.000235s : 1: jit_opt_after_cconv 0.13% : 0.000071s : 1: jit_opt_b 1.25% : 0.000696s : 1: loop_unroll 1.76% : 0.000979s : 1: mutable_eliminate 2.21% : 0.001228s : 26: opt.transform.jit_opt_a 0.13% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000034s : 4: opt.transform.jit_opt_b 0.04% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000028s : 1: opt.transform.mutable_eliminate 0.07% : 0.000040s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000048s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000801s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000215s : 1: py_interpret_to_execute 0.05% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000024s : 1: remove_dup_value 2.06% : 0.001145s : 1: renormalize.infer 1.41% : 0.000785s : 1: renormalize.specialize 0.03% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000054s : 1: rewriter_after_opt_a 0.20% : 0.000109s : 1: rewriter_before_opt_a 0.19% : 0.000106s : 1: symbol_engine_optimizer 70.67% : 0.039231s : 1: type_inference TotalTime = 0.0550046, [30] [bootstrap]: 0.00039752 [type_inference]: 0.0436954 [event_method]: 3.665e-05 [auto_monad]: 9.527e-05 [graph_reusing]: 7.41999e-06 [pre_auto_parallel]: 4.03001e-06 [py_interpret_to_execute]: 0.00011652 [rewriter_before_opt_a]: 0.00011351 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.00759832, [2] [Cycle 1]: 0.00258997, [27] [switch_simplify]: 8.356e-05 [loop_unroll]: 3.541e-05 [a_1]: 0.00080896 [with_stream_mark]: 2.822e-05 [recompute_prepare]: 1.008e-05 [updatestate_depend_eliminate]: 5.01997e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 3.18e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.804e-05 [j_node_and_user_rematch]: 9.73002e-06 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 1.14e-05 [inline_without_move]: 5.87999e-06 [renormalize]: 0.00119341 [add_forward_monad_depend]: 7.87e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.003e-05 [cse]: 4.476e-05 [replace_applicator]: 2.098e-05 [Cycle 2]: 0.00047987, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00012783 [with_stream_mark]: 1.468e-05 [recompute_prepare]: 6.61999e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 7.062e-05 [j_node_and_user_rematch]: 1.212e-05 [meta_fg_expand]: 2.65997e-06 [replace_old_param]: 9.93002e-06 [inline_without_move]: 5.53002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 3.35e-06 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 1.025e-05 [cse]: 2.181e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 1.835e-05 [rewriter_after_opt_a]: 4.656e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.74e-06 [mutable_eliminate]: 0.00086462 [jit_opt_b]: 6.515e-05, [1] [Cycle 1]: 5.261e-05, [2] [frontend_op_eliminate]: 2e-05 [inline_after_opt_a]: 1.885e-05 [cconv]: 3.677e-05 [loop_unroll]: 0.00054695 [jit_opt_after_cconv]: 0.00019104, [1] [Cycle 1]: 0.0001815, [11] [c_1]: 2.348e-05 [parameter_eliminate]: 5.67001e-06 [updatestate_depend_eliminate]: 9.95002e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 2.75002e-06 [cse]: 4.568e-05 [call_graph_tuple_transform]: 2.469e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 5.44998e-06 [remove_dup_value]: 5.104e-05 [partial_unused_args_eliminate]: 2.863e-05 [environ_conv]: 8.26002e-06 [add_recomputation]: 6.468e-05 [cse_after_recomputation]: 3.039e-05, [1] [Cycle 1]: 2.235e-05, [1] [cse]: 1.469e-05 [auto_monad_reorder]: 2.086e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 8.60001e-06 [opt_after_jit_grad]: 0.00055597 [symbol_engine_optimizer]: 8.884e-05, [1] [Cycle 1]: 8.107e-05, [6] [build]: 6.02001e-06 [elim_shapecalc]: 8.80001e-06 [elim_not_effective]: 1.621e-05 [opt_reshape]: 7.93001e-06 [fold_const_symbol]: 1.062e-05 [renormalize]: 3.19997e-07 [validate]: 5.38e-05 Sums bootstrap : 0.000398s : 0.80% type_inference : 0.043695s : 87.88% event_method : 0.000037s : 0.07% auto_monad : 0.000095s : 0.19% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000117s : 0.23% rewriter_before_opt_a : 0.000114s : 0.23% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000090s : 0.18% jit_opt_a.loop_unroll : 0.000041s : 0.08% jit_opt_a.a_1 : 0.000937s : 1.88% jit_opt_a.with_stream_mark : 0.000043s : 0.09% jit_opt_a.recompute_prepare : 0.000017s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000089s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001193s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.06% jit_opt_a.cse : 0.000067s : 0.13% jit_opt_a.replace_applicator : 0.000027s : 0.06% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000047s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000865s : 1.74% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000037s : 0.07% loop_unroll : 0.000547s : 1.10% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000046s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000051s : 0.10% partial_unused_args_eliminate : 0.000029s : 0.06% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000065s : 0.13% cse_after_recomputation.cse : 0.000015s : 0.03% auto_monad_reorder : 0.000021s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000556s : 1.12% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.11% Time group info: ------[substitution.] 0.000364 24 0.72% : 0.000003s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.86% : 0.000007s : 3: substitution.graph_param_transform 87.72% : 0.000319s : 5: substitution.inline 1.36% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000007s : 2: substitution.replace_old_param 4.27% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043527 2 22.76% : 0.009906s : 1: type_inference.infer 77.24% : 0.033621s : 1: type_inference.specialize ------[replace.] 0.000122 7 69.63% : 0.000085s : 5: replace.inline 30.37% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000329 7 95.81% : 0.000316s : 5: match.inline 4.19% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 747 1.10% : 0.000002s : 11: predicate.accumulaten_eliminater 1.34% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 11: predicate.addn_check_dump 1.61% : 0.000002s : 11: predicate.addn_zero_filter 2.64% : 0.000004s : 11: predicate.arithmetic_simplify 1.11% : 0.000002s : 11: predicate.cast_eliminate 0.30% : 0.000000s : 3: predicate.check_bprop_eliminate 1.03% : 0.000002s : 11: predicate.compare_switch_simplify 1.02% : 0.000002s : 11: predicate.depend_value_elim 1.01% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.01% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 11: predicate.environ_get_depend_swap 1.33% : 0.000002s : 11: predicate.environ_get_eliminate 0.99% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 6.12% : 0.000009s : 24: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000002s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 16: predicate.load_eliminater 1.94% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 11: predicate.merge_addn 1.03% : 0.000002s : 11: predicate.minmaximum_grad 2.77% : 0.000004s : 3: predicate.mutable_eliminate 0.84% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 16: predicate.partial_eliminate 1.03% : 0.000002s : 11: predicate.print_const_string_wrapper 2.09% : 0.000003s : 11: predicate.reduce_eliminate 1.29% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000003s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 11: predicate.reshape_eliminate 1.09% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.21% : 0.000002s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.44% : 0.000012s : 59: predicate.switch_simplify 1.15% : 0.000002s : 11: predicate.tile_eliminate 1.40% : 0.000002s : 11: predicate.transpose_eliminate 1.64% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.41% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.97% : 0.000003s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001176 16 49.57% : 0.000583s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.89% : 0.000105s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.54% : 0.000489s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057525 72 0.12% : 0.000068s : 1: add_recomputation 0.17% : 0.000099s : 1: auto_monad 0.04% : 0.000024s : 1: auto_monad_reorder 0.73% : 0.000421s : 1: bootstrap 0.07% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.07% : 0.000043s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 13.22% : 0.007603s : 1: jit_opt_a 0.34% : 0.000194s : 1: jit_opt_after_cconv 0.12% : 0.000068s : 1: jit_opt_b 0.97% : 0.000559s : 1: loop_unroll 1.54% : 0.000884s : 1: mutable_eliminate 2.20% : 0.001268s : 26: opt.transform.jit_opt_a 0.10% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000023s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.99% : 0.000567s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.05% : 0.000031s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.21% : 0.000120s : 1: py_interpret_to_execute 0.04% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000055s : 1: remove_dup_value 1.22% : 0.000703s : 1: renormalize.infer 0.83% : 0.000478s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000050s : 1: rewriter_after_opt_a 0.21% : 0.000119s : 1: rewriter_before_opt_a 0.16% : 0.000092s : 1: symbol_engine_optimizer 76.00% : 0.043722s : 1: type_inference TotalTime = 0.244672, [30] [bootstrap]: 0.00040127 [type_inference]: 0.185768 [event_method]: 2.932e-05 [auto_monad]: 8.798e-05 [graph_reusing]: 6.76e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00049769 [rewriter_before_opt_a]: 0.00012528 [expand_dump_flag]: 3.97e-06 [jit_opt_a]: 0.0546798, [2] [Cycle 1]: 0.00525478, [27] [switch_simplify]: 9.822e-05 [loop_unroll]: 3.485e-05 [a_1]: 0.00086139 [with_stream_mark]: 3.429e-05 [recompute_prepare]: 1.617e-05 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 3.86999e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 3.51001e-06 [specialize_transform]: 1.113e-05 [updatestate_useless_node_eliminater]: 6.69001e-06 [accelerated_algorithm]: 1.116e-05 [meta_shard_fg_expand]: 3.14999e-06 [get_grad_eliminate_]: 1.059e-05 [merge_forward]: 4.85001e-06 [cell_reuse_recompute_pass]: 2.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.552e-05 [j_node_and_user_rematch]: 1.367e-05 [meta_fg_expand]: 4.15e-06 [replace_old_param]: 1.436e-05 [inline_without_move]: 7.58001e-06 [renormalize]: 0.00368215 [add_forward_monad_depend]: 1.22e-05 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 2.275e-05 [cse]: 4.449e-05 [replace_applicator]: 2.887e-05 [Cycle 2]: 0.00042258, [27] [switch_simplify]: 8.05999e-06 [loop_unroll]: 6.29999e-06 [a_1]: 0.00013206 [with_stream_mark]: 1.904e-05 [recompute_prepare]: 6.69999e-06 [updatestate_depend_eliminate]: 5.19003e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.93998e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.19999e-06 [merge_forward]: 4.70999e-06 [cell_reuse_recompute_pass]: 2.92002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.035e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.1e-05 [inline_without_move]: 5.66003e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 8.38999e-06 [cse]: 1.768e-05 [replace_applicator]: 6.07999e-06 [py_interpret_to_execute_after_opt_a]: 2.053e-05 [rewriter_after_opt_a]: 5.137e-05 [convert_after_rewriter]: 7.98001e-06 [order_py_execute_after_rewriter]: 5.71998e-06 [mutable_eliminate]: 0.0008923 [jit_opt_b]: 6.268e-05, [1] [Cycle 1]: 5.319e-05, [2] [frontend_op_eliminate]: 1.994e-05 [inline_after_opt_a]: 2.039e-05 [cconv]: 4.117e-05 [loop_unroll]: 0.00061715 [jit_opt_after_cconv]: 0.00020861, [1] [Cycle 1]: 0.00019948, [11] [c_1]: 3.026e-05 [parameter_eliminate]: 6.77002e-06 [updatestate_depend_eliminate]: 1.127e-05 [updatestate_assign_eliminate]: 3.72002e-06 [updatestate_loads_eliminate]: 2.81999e-06 [cse]: 4.875e-05 [call_graph_tuple_transform]: 2.844e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.83002e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 7.13e-06 [remove_dup_value]: 2.315e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 1.234e-05 [add_recomputation]: 6.028e-05 [cse_after_recomputation]: 2.98e-05, [1] [Cycle 1]: 2.281e-05, [1] [cse]: 1.559e-05 [auto_monad_reorder]: 2.103e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 9.84001e-06 [opt_after_jit_grad]: 0.00059151 [symbol_engine_optimizer]: 8.947e-05, [1] [Cycle 1]: 8.091e-05, [6] [build]: 6.26e-06 [elim_shapecalc]: 9.67999e-06 [elim_not_effective]: 1.646e-05 [opt_reshape]: 7.70998e-06 [fold_const_symbol]: 1.166e-05 [renormalize]: 3.49974e-07 [validate]: 6.629e-05 Sums bootstrap : 0.000401s : 0.21% type_inference : 0.185768s : 95.32% event_method : 0.000029s : 0.02% auto_monad : 0.000088s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000498s : 0.26% rewriter_before_opt_a : 0.000125s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000106s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000993s : 0.51% jit_opt_a.with_stream_mark : 0.000053s : 0.03% jit_opt_a.recompute_prepare : 0.000023s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003682s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000062s : 0.03% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000051s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000892s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000041s : 0.02% loop_unroll : 0.000617s : 0.32% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000592s : 0.30% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000066s : 0.03% Time group info: ------[substitution.] 0.000376 24 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000002s : 2: substitution.fold_const_symbol 2.06% : 0.000008s : 4: substitution.graph_param_transform 86.28% : 0.000325s : 4: substitution.inline 1.57% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000008s : 4: substitution.remove_not_recompute_node 2.60% : 0.000010s : 2: substitution.replace_old_param 4.36% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.185621 2 98.07% : 0.182044s : 1: type_inference.infer 1.93% : 0.003577s : 1: type_inference.specialize ------[replace.] 0.000128 6 67.55% : 0.000086s : 4: replace.inline 32.45% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000336 6 95.67% : 0.000322s : 4: match.inline 4.33% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 830 1.05% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.87% : 0.000001s : 12: predicate.addn_check_dump 1.09% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000003s : 12: predicate.arithmetic_simplify 1.52% : 0.000003s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 0.91% : 0.000002s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 2.01% : 0.000003s : 12: predicate.dict_get_item_eliminator 0.85% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.91% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.87% : 0.000001s : 12: predicate.environ_get_depend_swap 0.92% : 0.000002s : 12: predicate.environ_get_eliminate 0.91% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 1.60% : 0.000003s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.91% : 0.000010s : 26: predicate.inline 1.01% : 0.000002s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.87% : 0.000003s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.43% : 0.000002s : 18: predicate.load_eliminater 2.20% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.32% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 12: predicate.merge_addn 0.85% : 0.000001s : 12: predicate.minmaximum_grad 2.15% : 0.000004s : 4: predicate.mutable_eliminate 0.75% : 0.000001s : 4: predicate.opt_reshape 1.93% : 0.000003s : 18: predicate.partial_eliminate 0.93% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.02% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.69% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 0.97% : 0.000002s : 12: predicate.reshape_eliminate 0.93% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 0.89% : 0.000002s : 12: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000002s : 8: predicate.specialize_transform 2.14% : 0.000004s : 12: predicate.split_environ_get_set_with_tuple_value 1.91% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 18: predicate.switch_defer_inline 2.41% : 0.000004s : 18: predicate.switch_layer_defer_inline 7.74% : 0.000013s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.83% : 0.000003s : 12: predicate.transpose_eliminate 1.14% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.95% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.82% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.53% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003669 26 70.26% : 0.002578s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.04% : 0.000075s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.69% : 0.001016s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.249755 72 0.03% : 0.000064s : 1: add_recomputation 0.04% : 0.000093s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.17% : 0.000422s : 1: bootstrap 0.02% : 0.000044s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 21.89% : 0.054683s : 1: jit_opt_a 0.08% : 0.000212s : 1: jit_opt_after_cconv 0.03% : 0.000066s : 1: jit_opt_b 0.25% : 0.000631s : 1: loop_unroll 0.36% : 0.000910s : 1: mutable_eliminate 0.53% : 0.001331s : 26: opt.transform.jit_opt_a 0.03% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000604s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000508s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000026s : 1: remove_dup_value 1.05% : 0.002619s : 1: renormalize.infer 0.42% : 0.001043s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000056s : 1: rewriter_after_opt_a 0.05% : 0.000133s : 1: rewriter_before_opt_a 0.04% : 0.000093s : 1: symbol_engine_optimizer 74.39% : 0.185804s : 1: type_inference TotalTime = 0.0560705, [30] [bootstrap]: 0.00041316 [type_inference]: 0.0426481 [event_method]: 2.765e-05 [auto_monad]: 9.203e-05 [graph_reusing]: 7.08e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 0.00020731 [rewriter_before_opt_a]: 0.00010312 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00944726, [2] [Cycle 1]: 0.00336157, [27] [switch_simplify]: 8.289e-05 [loop_unroll]: 3.184e-05 [a_1]: 0.00073789 [with_stream_mark]: 2.878e-05 [recompute_prepare]: 1.192e-05 [updatestate_depend_eliminate]: 5.09998e-06 [updatestate_assign_eliminate]: 3.91999e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.952e-05 [j_node_and_user_rematch]: 1.174e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.331e-05 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00203525 [add_forward_monad_depend]: 1.08e-05 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 2.203e-05 [cse]: 4.019e-05 [replace_applicator]: 2.408e-05 [Cycle 2]: 0.00037299, [27] [switch_simplify]: 6.91001e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00010875 [with_stream_mark]: 1.445e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.83e-05 [j_node_and_user_rematch]: 9.93002e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 4.88001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 6.99001e-06 [cse]: 1.409e-05 [replace_applicator]: 5.27999e-06 [py_interpret_to_execute_after_opt_a]: 2.013e-05 [rewriter_after_opt_a]: 4.333e-05 [convert_after_rewriter]: 7.47998e-06 [order_py_execute_after_rewriter]: 6.26e-06 [mutable_eliminate]: 0.00093665 [jit_opt_b]: 6.301e-05, [1] [Cycle 1]: 5.268e-05, [2] [frontend_op_eliminate]: 2.06e-05 [inline_after_opt_a]: 2.041e-05 [cconv]: 3.866e-05 [loop_unroll]: 0.00056578 [jit_opt_after_cconv]: 0.00019711, [1] [Cycle 1]: 0.00018942, [11] [c_1]: 2.585e-05 [parameter_eliminate]: 5.32001e-06 [updatestate_depend_eliminate]: 1.097e-05 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.41999e-06 [cse]: 4.241e-05 [call_graph_tuple_transform]: 2.699e-05 [tuple_list_get_item_eliminator]: 6.43998e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 9.70002e-07 [switch_simplify]: 6.30002e-06 [remove_dup_value]: 1.915e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 7.44002e-06 [add_recomputation]: 6.54e-05 [cse_after_recomputation]: 3.102e-05, [1] [Cycle 1]: 2.383e-05, [1] [cse]: 1.635e-05 [auto_monad_reorder]: 2.14e-05 [get_jit_bprop_graph]: 2.99999e-06 [rewriter_after_jit_bprop_graph]: 1.141e-05 [opt_after_jit_grad]: 0.00062434 [symbol_engine_optimizer]: 9.6e-05, [1] [Cycle 1]: 8.739e-05, [6] [build]: 5.80002e-06 [elim_shapecalc]: 1.118e-05 [elim_not_effective]: 1.812e-05 [opt_reshape]: 7.48e-06 [fold_const_symbol]: 1.194e-05 [renormalize]: 4.80009e-07 [validate]: 5.597e-05 Sums bootstrap : 0.000413s : 0.83% type_inference : 0.042648s : 86.04% event_method : 0.000028s : 0.06% auto_monad : 0.000092s : 0.19% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000207s : 0.42% rewriter_before_opt_a : 0.000103s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000090s : 0.18% jit_opt_a.loop_unroll : 0.000038s : 0.08% jit_opt_a.a_1 : 0.000847s : 1.71% jit_opt_a.with_stream_mark : 0.000043s : 0.09% jit_opt_a.recompute_prepare : 0.000018s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000024s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002035s : 4.11% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.06% jit_opt_a.cse : 0.000054s : 0.11% jit_opt_a.replace_applicator : 0.000029s : 0.06% py_interpret_to_execute_after_opt_a : 0.000020s : 0.04% rewriter_after_opt_a : 0.000043s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000937s : 1.89% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.04% cconv : 0.000039s : 0.08% loop_unroll : 0.000566s : 1.14% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000065s : 0.13% cse_after_recomputation.cse : 0.000016s : 0.03% auto_monad_reorder : 0.000021s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.02% opt_after_jit_grad : 0.000624s : 1.26% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.11% Time group info: ------[substitution.] 0.000332 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 1.96% : 0.000007s : 3: substitution.graph_param_transform 85.83% : 0.000285s : 4: substitution.inline 1.71% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000006s : 4: substitution.remove_not_recompute_node 2.66% : 0.000009s : 2: substitution.replace_old_param 4.44% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042519 2 94.13% : 0.040024s : 1: type_inference.infer 5.87% : 0.002495s : 1: type_inference.specialize ------[replace.] 0.000105 6 67.07% : 0.000070s : 4: replace.inline 32.93% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000295 6 95.38% : 0.000282s : 4: match.inline 4.62% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 691 1.04% : 0.000002s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 2.35% : 0.000004s : 10: predicate.arithmetic_simplify 1.01% : 0.000002s : 10: predicate.cast_eliminate 0.78% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000002s : 10: predicate.compare_switch_simplify 0.93% : 0.000001s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.70% : 0.000003s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 1.11% : 0.000002s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.83% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 10: predicate.environ_get_depend_swap 1.14% : 0.000002s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000002s : 6: predicate.get_grad_eliminate 0.17% : 0.000000s : 3: predicate.graph_param_transform 6.11% : 0.000009s : 22: predicate.inline 0.68% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.17% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.85% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000002s : 10: predicate.minmaximum_grad 2.17% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 1.91% : 0.000003s : 15: predicate.partial_eliminate 1.52% : 0.000002s : 10: predicate.print_const_string_wrapper 2.44% : 0.000004s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 0.97% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000002s : 6: predicate.specialize_transform 1.88% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.32% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 2.29% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.16% : 0.000011s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 2.22% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 2.01% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.21% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001268 13 41.13% : 0.000522s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.26% : 0.000067s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.62% : 0.000680s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059249 72 0.12% : 0.000070s : 1: add_recomputation 0.16% : 0.000097s : 1: auto_monad 0.04% : 0.000025s : 1: auto_monad_reorder 0.74% : 0.000440s : 1: bootstrap 0.07% : 0.000041s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000034s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000034s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 15.95% : 0.009452s : 1: jit_opt_a 0.34% : 0.000201s : 1: jit_opt_after_cconv 0.11% : 0.000066s : 1: jit_opt_b 0.97% : 0.000577s : 1: loop_unroll 1.60% : 0.000950s : 1: mutable_eliminate 1.90% : 0.001123s : 26: opt.transform.jit_opt_a 0.10% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000033s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000025s : 1: opt.transform.mutable_eliminate 0.05% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.07% : 0.000636s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000213s : 1: py_interpret_to_execute 0.04% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000023s : 1: remove_dup_value 2.17% : 0.001284s : 1: renormalize.infer 1.25% : 0.000738s : 1: renormalize.specialize 0.02% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000047s : 1: rewriter_after_opt_a 0.18% : 0.000109s : 1: rewriter_before_opt_a 0.17% : 0.000099s : 1: symbol_engine_optimizer 72.04% : 0.042685s : 1: type_inference TotalTime = 0.153892, [30] [bootstrap]: 0.0004356 [type_inference]: 0.126562 [event_method]: 3.008e-05 [auto_monad]: 8.912e-05 [graph_reusing]: 7.46001e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00052615 [rewriter_before_opt_a]: 0.00010685 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.0220646, [2] [Cycle 1]: 0.0160685, [27] [switch_simplify]: 8.656e-05 [loop_unroll]: 3.114e-05 [a_1]: 0.00077693 [with_stream_mark]: 3.054e-05 [recompute_prepare]: 1.063e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 8.10999e-06 [updatestate_useless_node_eliminater]: 6.69999e-06 [accelerated_algorithm]: 7.12002e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 7.01001e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.784e-05 [j_node_and_user_rematch]: 1.199e-05 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 1.196e-05 [inline_without_move]: 6.54001e-06 [renormalize]: 0.0146094 [add_forward_monad_depend]: 1.46e-05 [auto_monad_grad]: 3.75e-06 [auto_monad_eliminator]: 3.248e-05 [cse]: 4.754e-05 [replace_applicator]: 3.647e-05 [Cycle 2]: 0.00050658, [27] [switch_simplify]: 9.75002e-06 [loop_unroll]: 8.32e-06 [a_1]: 0.00017028 [with_stream_mark]: 2.175e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 3.13998e-06 [specialize_transform]: 7.20998e-06 [updatestate_useless_node_eliminater]: 6.35002e-06 [accelerated_algorithm]: 8.49002e-06 [meta_shard_fg_expand]: 3.09999e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 6.23e-06 [cell_reuse_recompute_pass]: 4.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.579e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 4.39998e-06 [replace_old_param]: 1.096e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.53e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 1.145e-05 [cse]: 1.512e-05 [replace_applicator]: 6.98e-06 [py_interpret_to_execute_after_opt_a]: 2.674e-05 [rewriter_after_opt_a]: 4.803e-05 [convert_after_rewriter]: 9.51998e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00118758 [jit_opt_b]: 7.918e-05, [1] [Cycle 1]: 6.839e-05, [2] [frontend_op_eliminate]: 2.738e-05 [inline_after_opt_a]: 2.386e-05 [cconv]: 4.936e-05 [loop_unroll]: 0.00064058 [jit_opt_after_cconv]: 0.00022188, [1] [Cycle 1]: 0.0002141, [11] [c_1]: 3.224e-05 [parameter_eliminate]: 6.11e-06 [updatestate_depend_eliminate]: 8.79998e-06 [updatestate_assign_eliminate]: 7.82e-06 [updatestate_loads_eliminate]: 2.96999e-06 [cse]: 4.253e-05 [call_graph_tuple_transform]: 3.108e-05 [tuple_list_get_item_eliminator]: 1.547e-05 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 7.85e-06 [remove_dup_value]: 1.903e-05 [partial_unused_args_eliminate]: 2.30002e-06 [environ_conv]: 1.296e-05 [add_recomputation]: 6.048e-05 [cse_after_recomputation]: 3.555e-05, [1] [Cycle 1]: 3.029e-05, [1] [cse]: 2.089e-05 [auto_monad_reorder]: 1.706e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 1.288e-05 [opt_after_jit_grad]: 0.00119225 [symbol_engine_optimizer]: 9.652e-05, [1] [Cycle 1]: 8.87e-05, [6] [build]: 5.24003e-06 [elim_shapecalc]: 9.79e-06 [elim_not_effective]: 1.712e-05 [opt_reshape]: 9.41998e-06 [fold_const_symbol]: 1.236e-05 [renormalize]: 9.20001e-07 [validate]: 5.944e-05 Sums bootstrap : 0.000436s : 0.30% type_inference : 0.126562s : 85.78% event_method : 0.000030s : 0.02% auto_monad : 0.000089s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000526s : 0.36% rewriter_before_opt_a : 0.000107s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000096s : 0.07% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000947s : 0.64% jit_opt_a.with_stream_mark : 0.000052s : 0.04% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.014609s : 9.90% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000044s : 0.03% jit_opt_a.cse : 0.000063s : 0.04% jit_opt_a.replace_applicator : 0.000043s : 0.03% py_interpret_to_execute_after_opt_a : 0.000027s : 0.02% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000010s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001188s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000024s : 0.02% cconv : 0.000049s : 0.03% loop_unroll : 0.000641s : 0.43% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000015s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000060s : 0.04% cse_after_recomputation.cse : 0.000021s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.01% opt_after_jit_grad : 0.001192s : 0.81% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.04% Time group info: ------[substitution.] 0.000331 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 4: substitution.graph_param_transform 85.27% : 0.000282s : 4: substitution.inline 1.62% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000007s : 4: substitution.remove_not_recompute_node 2.44% : 0.000008s : 2: substitution.replace_old_param 4.79% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126408 2 97.30% : 0.122995s : 1: type_inference.infer 2.70% : 0.003413s : 1: type_inference.specialize ------[replace.] 0.000097 6 70.71% : 0.000069s : 4: replace.inline 29.29% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 6 94.98% : 0.000279s : 4: match.inline 5.02% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000176 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 12: predicate.addn_check_dump 1.73% : 0.000003s : 12: predicate.addn_zero_filter 3.03% : 0.000005s : 12: predicate.arithmetic_simplify 1.79% : 0.000003s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 0.78% : 0.000001s : 12: predicate.compare_switch_simplify 1.86% : 0.000003s : 12: predicate.depend_value_elim 0.80% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.89% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.80% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.37% : 0.000002s : 12: predicate.environ_get_eliminate 0.83% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.36% : 0.000009s : 26: predicate.inline 0.69% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.59% : 0.000003s : 8: predicate.less_batch_normalization 1.66% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000004s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.31% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.83% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000002s : 12: predicate.minmaximum_grad 1.65% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000004s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.53% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.73% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.58% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.68% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000002s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.76% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.92% : 0.000003s : 18: predicate.switch_defer_inline 1.83% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.53% : 0.000013s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.52% : 0.000003s : 12: predicate.transpose_eliminate 1.54% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.02% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.97% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.29% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.11% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004061 26 60.93% : 0.002475s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.62% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.44% : 0.001521s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.169845 72 0.04% : 0.000064s : 1: add_recomputation 0.06% : 0.000094s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.27% : 0.000459s : 1: bootstrap 0.03% : 0.000053s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.02% : 0.000038s : 1: cse_after_recomputation 0.01% : 0.000023s : 1: environ_conv 0.02% : 0.000038s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 12.99% : 0.022071s : 1: jit_opt_a 0.14% : 0.000233s : 1: jit_opt_after_cconv 0.05% : 0.000083s : 1: jit_opt_b 0.38% : 0.000652s : 1: loop_unroll 0.71% : 0.001204s : 1: mutable_eliminate 0.74% : 0.001262s : 26: opt.transform.jit_opt_a 0.05% : 0.000081s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000043s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000039s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.71% : 0.001203s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000538s : 1: py_interpret_to_execute 0.02% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 7.66% : 0.013006s : 1: renormalize.infer 0.93% : 0.001577s : 1: renormalize.specialize 0.01% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.07% : 0.000112s : 1: rewriter_before_opt_a 0.06% : 0.000099s : 1: symbol_engine_optimizer 74.54% : 0.126599s : 1: type_inference TotalTime = 0.0870646, [30] [bootstrap]: 0.00031805 [type_inference]: 0.0601371 [event_method]: 0.00028598 [auto_monad]: 0.00013289 [graph_reusing]: 8.72e-06 [pre_auto_parallel]: 3.59002e-06 [py_interpret_to_execute]: 4.834e-05 [rewriter_before_opt_a]: 0.00015503 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.00839869, [2] [Cycle 1]: 0.00385867, [27] [switch_simplify]: 0.00021576 [loop_unroll]: 5.542e-05 [a_1]: 0.00139029 [with_stream_mark]: 2.912e-05 [recompute_prepare]: 1.158e-05 [updatestate_depend_eliminate]: 5.33002e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 3.03e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.28002e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.891e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 3.04999e-06 [replace_old_param]: 1.3e-05 [inline_without_move]: 6.26998e-06 [renormalize]: 0.00167158 [add_forward_monad_depend]: 1.143e-05 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 2.509e-05 [cse]: 5.036e-05 [replace_applicator]: 2.565e-05 [Cycle 2]: 0.00039015, [27] [switch_simplify]: 8.08001e-06 [loop_unroll]: 6.46e-06 [a_1]: 0.00010298 [with_stream_mark]: 1.796e-05 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 4.82998e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 2.80997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.124e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 3.68999e-06 [replace_old_param]: 1.072e-05 [inline_without_move]: 5.40999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.02001e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 8.37e-06 [cse]: 1.841e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 2.162e-05 [rewriter_after_opt_a]: 4.585e-05 [convert_after_rewriter]: 7.97e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00086811 [jit_opt_b]: 6.104e-05, [1] [Cycle 1]: 4.918e-05, [2] [frontend_op_eliminate]: 1.772e-05 [inline_after_opt_a]: 1.9e-05 [cconv]: 0.013957 [loop_unroll]: 0.0009613 [jit_opt_after_cconv]: 0.00023997, [1] [Cycle 1]: 0.00022867, [11] [c_1]: 2.883e-05 [parameter_eliminate]: 7.97e-06 [updatestate_depend_eliminate]: 1.486e-05 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.99001e-06 [cse]: 6.123e-05 [call_graph_tuple_transform]: 3.048e-05 [tuple_list_get_item_eliminator]: 5.89999e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 7.90998e-06 [remove_dup_value]: 5.802e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 7.95e-06 [add_recomputation]: 6.608e-05 [cse_after_recomputation]: 2.957e-05, [1] [Cycle 1]: 2.219e-05, [1] [cse]: 1.439e-05 [auto_monad_reorder]: 1.913e-05 [get_jit_bprop_graph]: 3.00002e-06 [rewriter_after_jit_bprop_graph]: 1.208e-05 [opt_after_jit_grad]: 0.00070406 [symbol_engine_optimizer]: 0.0001392, [1] [Cycle 1]: 0.00013038, [6] [build]: 6.51999e-06 [elim_shapecalc]: 9.61e-06 [elim_not_effective]: 5.909e-05 [opt_reshape]: 9.00999e-06 [fold_const_symbol]: 1.09e-05 [renormalize]: 1.72999e-06 [validate]: 5.987e-05 Sums bootstrap : 0.000318s : 0.39% type_inference : 0.060137s : 73.27% event_method : 0.000286s : 0.35% auto_monad : 0.000133s : 0.16% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000048s : 0.06% rewriter_before_opt_a : 0.000155s : 0.19% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000224s : 0.27% jit_opt_a.loop_unroll : 0.000062s : 0.08% jit_opt_a.a_1 : 0.001493s : 1.82% jit_opt_a.with_stream_mark : 0.000047s : 0.06% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000024s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001672s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.04% jit_opt_a.cse : 0.000069s : 0.08% jit_opt_a.replace_applicator : 0.000031s : 0.04% py_interpret_to_execute_after_opt_a : 0.000022s : 0.03% rewriter_after_opt_a : 0.000046s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000868s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.013957s : 17.01% loop_unroll : 0.000961s : 1.17% jit_opt_after_cconv.c_1 : 0.000029s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000061s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000058s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000066s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000704s : 0.86% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000059s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000060s : 0.07% Time group info: ------[substitution.] 0.000582 33 0.44% : 0.000003s : 2: substitution.elim_not_effective 0.29% : 0.000002s : 2: substitution.fold_const_symbol 1.29% : 0.000008s : 3: substitution.graph_param_transform 89.26% : 0.000519s : 11: substitution.inline 0.85% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.18% : 0.000007s : 4: substitution.remove_not_recompute_node 1.41% : 0.000008s : 2: substitution.replace_old_param 2.27% : 0.000013s : 2: substitution.switch_simplify 3.01% : 0.000017s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060034 2 95.78% : 0.057501s : 1: type_inference.infer 4.22% : 0.002533s : 1: type_inference.specialize ------[replace.] 0.000343 16 49.13% : 0.000168s : 11: replace.inline 20.50% : 0.000070s : 2: replace.switch_simplify 30.37% : 0.000104s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000541 16 94.90% : 0.000513s : 11: match.inline 2.22% : 0.000012s : 2: match.switch_simplify 2.88% : 0.000016s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000214 1148 1.17% : 0.000002s : 18: predicate.accumulaten_eliminater 1.14% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000003s : 18: predicate.addn_check_dump 1.19% : 0.000003s : 18: predicate.addn_zero_filter 2.02% : 0.000004s : 18: predicate.arithmetic_simplify 1.33% : 0.000003s : 18: predicate.cast_eliminate 0.25% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000002s : 18: predicate.compare_switch_simplify 1.18% : 0.000003s : 18: predicate.depend_value_elim 1.21% : 0.000003s : 18: predicate.dict_get_item_const_eliminator 1.31% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.21% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.86% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 18: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 18: predicate.environ_get_depend_swap 1.13% : 0.000002s : 18: predicate.environ_get_eliminate 1.11% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.50% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000001s : 3: predicate.graph_param_transform 6.05% : 0.000013s : 38: predicate.inline 0.50% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000003s : 6: predicate.less_batch_normalization 1.50% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.73% : 0.000004s : 24: predicate.load_eliminater 2.90% : 0.000006s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000009s : 64: predicate.loop_unroll_before_grad 2.02% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.32% : 0.000003s : 18: predicate.merge_addn 1.58% : 0.000003s : 18: predicate.minmaximum_grad 2.42% : 0.000005s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000004s : 24: predicate.partial_eliminate 1.27% : 0.000003s : 18: predicate.print_const_string_wrapper 2.01% : 0.000004s : 18: predicate.reduce_eliminate 1.62% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000003s : 27: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000001s : 3: predicate.reset_defer_inline 1.20% : 0.000003s : 18: predicate.reshape_eliminate 1.19% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.40% : 0.000003s : 18: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.51% : 0.000001s : 6: predicate.special_op_eliminate 0.55% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.23% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.87% : 0.000006s : 32: predicate.switch_defer_inline 2.38% : 0.000005s : 32: predicate.switch_layer_defer_inline 8.79% : 0.000019s : 103: predicate.switch_simplify 1.20% : 0.000003s : 18: predicate.tile_eliminate 1.33% : 0.000003s : 18: predicate.transpose_eliminate 1.59% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000009s : 27: predicate.tuple_list_get_item_eliminator 1.57% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.44% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.52% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.36% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.49% : 0.000003s : 18: predicate.value_based_eliminate 0.35% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002315 28 49.84% : 0.001154s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.42% : 0.000264s : 6: func_graph_cloner_run.FuncGraphClonerNode 38.73% : 0.000897s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.090798 72 0.08% : 0.000070s : 1: add_recomputation 0.15% : 0.000139s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.37% : 0.000338s : 1: bootstrap 15.41% : 0.013988s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.33% : 0.000301s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 9.26% : 0.008404s : 1: jit_opt_a 0.27% : 0.000244s : 1: jit_opt_after_cconv 0.07% : 0.000064s : 1: jit_opt_b 1.08% : 0.000984s : 1: loop_unroll 0.98% : 0.000887s : 1: mutable_eliminate 2.13% : 0.001935s : 26: opt.transform.jit_opt_a 0.08% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000037s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000026s : 1: opt.transform.mutable_eliminate 0.04% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000724s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000051s : 1: py_interpret_to_execute 0.03% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000063s : 1: remove_dup_value 1.12% : 0.001017s : 1: renormalize.infer 0.71% : 0.000641s : 1: renormalize.specialize 0.02% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000050s : 1: rewriter_after_opt_a 0.17% : 0.000159s : 1: rewriter_before_opt_a 0.16% : 0.000143s : 1: symbol_engine_optimizer 66.26% : 0.060160s : 1: type_inference TotalTime = 0.0198538, [30] [bootstrap]: 0.00033378 [type_inference]: 0.00991296 [event_method]: 2.488e-05 [auto_monad]: 7.83e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 5.58e-05 [rewriter_before_opt_a]: 8.911e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.00645244, [2] [Cycle 1]: 0.00246065, [27] [switch_simplify]: 6.91e-05 [loop_unroll]: 3.433e-05 [a_1]: 0.00073853 [with_stream_mark]: 2.575e-05 [recompute_prepare]: 1.227e-05 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.52001e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 3.36001e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.69e-05 [j_node_and_user_rematch]: 1.255e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.103e-05 [inline_without_move]: 6.43e-06 [renormalize]: 0.00115936 [add_forward_monad_depend]: 9.35001e-06 [auto_monad_grad]: 2.89999e-06 [auto_monad_eliminator]: 2.208e-05 [cse]: 4.531e-05 [replace_applicator]: 2.352e-05 [Cycle 2]: 0.00041239, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00010132 [with_stream_mark]: 1.85e-05 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 6.33998e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.003e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.00999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.51998e-06 [auto_monad_grad]: 1.51002e-06 [auto_monad_eliminator]: 1.123e-05 [cse]: 2.289e-05 [replace_applicator]: 7.6e-06 [py_interpret_to_execute_after_opt_a]: 2.029e-05 [rewriter_after_opt_a]: 4.929e-05 [convert_after_rewriter]: 9.36e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00078133 [jit_opt_b]: 6.099e-05, [1] [Cycle 1]: 5.222e-05, [2] [frontend_op_eliminate]: 1.995e-05 [inline_after_opt_a]: 1.827e-05 [cconv]: 4.033e-05 [loop_unroll]: 0.00055297 [jit_opt_after_cconv]: 0.00021232, [1] [Cycle 1]: 0.00018626, [11] [c_1]: 2.231e-05 [parameter_eliminate]: 6.48003e-06 [updatestate_depend_eliminate]: 1.089e-05 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.31001e-06 [cse]: 4.177e-05 [call_graph_tuple_transform]: 2.796e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 2.05002e-06 [renormalize]: 9.80013e-07 [switch_simplify]: 6.62002e-06 [remove_dup_value]: 5.119e-05 [partial_unused_args_eliminate]: 3.16999e-06 [environ_conv]: 7.29001e-06 [add_recomputation]: 6.113e-05 [cse_after_recomputation]: 3.219e-05, [1] [Cycle 1]: 2.587e-05, [1] [cse]: 1.544e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 2.73998e-06 [rewriter_after_jit_bprop_graph]: 6.99001e-06 [opt_after_jit_grad]: 0.0006116 [symbol_engine_optimizer]: 8.37e-05, [1] [Cycle 1]: 7.642e-05, [6] [build]: 5.08002e-06 [elim_shapecalc]: 9.18002e-06 [elim_not_effective]: 1.648e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 7.09988e-07 [validate]: 5.142e-05 Sums bootstrap : 0.000334s : 2.15% type_inference : 0.009913s : 63.83% event_method : 0.000025s : 0.16% auto_monad : 0.000078s : 0.50% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000056s : 0.36% rewriter_before_opt_a : 0.000089s : 0.57% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.49% jit_opt_a.loop_unroll : 0.000040s : 0.26% jit_opt_a.a_1 : 0.000840s : 5.41% jit_opt_a.with_stream_mark : 0.000044s : 0.28% jit_opt_a.recompute_prepare : 0.000019s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000005s : 0.03% jit_opt_a.specialize_transform : 0.000014s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.07% jit_opt_a.merge_forward : 0.000009s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001159s : 7.47% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.21% jit_opt_a.cse : 0.000068s : 0.44% jit_opt_a.replace_applicator : 0.000031s : 0.20% py_interpret_to_execute_after_opt_a : 0.000020s : 0.13% rewriter_after_opt_a : 0.000049s : 0.32% convert_after_rewriter : 0.000009s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000781s : 5.03% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000040s : 0.26% loop_unroll : 0.000553s : 3.56% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000042s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.04% remove_dup_value : 0.000051s : 0.33% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000061s : 0.39% cse_after_recomputation.cse : 0.000015s : 0.10% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000612s : 3.94% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.33% Time group info: ------[substitution.] 0.000307 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000008s : 3: substitution.graph_param_transform 85.26% : 0.000262s : 5: substitution.inline 1.92% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000007s : 2: substitution.replace_old_param 5.02% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009825 2 88.11% : 0.008657s : 1: type_inference.infer 11.89% : 0.001168s : 1: type_inference.specialize ------[replace.] 0.000111 7 64.57% : 0.000072s : 5: replace.inline 35.43% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000272 7 94.99% : 0.000258s : 5: match.inline 5.01% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 747 1.11% : 0.000002s : 11: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 11: predicate.addn_check_dump 1.28% : 0.000002s : 11: predicate.addn_zero_filter 2.09% : 0.000003s : 11: predicate.arithmetic_simplify 1.58% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 11: predicate.compare_switch_simplify 1.09% : 0.000002s : 11: predicate.depend_value_elim 1.16% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.53% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.91% : 0.000003s : 11: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 11: predicate.environ_get_depend_swap 1.08% : 0.000002s : 11: predicate.environ_get_eliminate 0.97% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.76% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000008s : 24: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 16: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 2.98% : 0.000004s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.25% : 0.000003s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000003s : 19: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.09% : 0.000002s : 11: predicate.reshape_eliminate 1.13% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.48% : 0.000002s : 3: predicate.row_tensor_eliminate 1.01% : 0.000001s : 11: predicate.same_eliminate 0.86% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.91% : 0.000004s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 59: predicate.switch_simplify 1.48% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000002s : 11: predicate.transpose_eliminate 1.26% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.26% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.51% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001069 16 53.41% : 0.000571s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.37% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.22% : 0.000409s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022188 72 0.29% : 0.000065s : 1: add_recomputation 0.37% : 0.000082s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.59% : 0.000353s : 1: bootstrap 0.20% : 0.000044s : 1: cconv 0.05% : 0.000012s : 1: convert_after_rewriter 0.16% : 0.000035s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.13% : 0.000030s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.10% : 0.006457s : 1: jit_opt_a 0.97% : 0.000216s : 1: jit_opt_after_cconv 0.29% : 0.000065s : 1: jit_opt_b 2.55% : 0.000566s : 1: loop_unroll 3.60% : 0.000799s : 1: mutable_eliminate 4.99% : 0.001106s : 26: opt.transform.jit_opt_a 0.27% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000030s : 4: opt.transform.jit_opt_b 0.08% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000025s : 1: opt.transform.mutable_eliminate 0.14% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.82% : 0.000626s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000059s : 1: py_interpret_to_execute 0.11% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.25% : 0.000056s : 1: remove_dup_value 3.06% : 0.000680s : 1: renormalize.infer 2.11% : 0.000467s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000054s : 1: rewriter_after_opt_a 0.41% : 0.000092s : 1: rewriter_before_opt_a 0.39% : 0.000088s : 1: symbol_engine_optimizer 44.78% : 0.009935s : 1: type_inference TotalTime = 0.0707311, [30] [bootstrap]: 0.00047695 [type_inference]: 0.0366726 [event_method]: 2.028e-05 [auto_monad]: 7.019e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.78998e-06 [py_interpret_to_execute]: 0.00010216 [rewriter_before_opt_a]: 8.243e-05 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.00603564, [2] [Cycle 1]: 0.0020748, [27] [switch_simplify]: 6.153e-05 [loop_unroll]: 2.85e-05 [a_1]: 0.00058232 [with_stream_mark]: 2.32e-05 [recompute_prepare]: 8.88002e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 3.77998e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00101232 [add_forward_monad_depend]: 7.32002e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.776e-05 [replace_applicator]: 1.506e-05 [Cycle 2]: 0.00033067, [27] [switch_simplify]: 5.83997e-06 [loop_unroll]: 5.07e-06 [a_1]: 9.056e-05 [with_stream_mark]: 1.263e-05 [recompute_prepare]: 5.31998e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 4.67998e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.5e-06 [inline_without_move]: 4.88001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 5.99975e-07 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.436e-05 [replace_applicator]: 5.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.349e-05 [rewriter_after_opt_a]: 3.835e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.89999e-06 [mutable_eliminate]: 0.0006823 [jit_opt_b]: 5.097e-05, [1] [Cycle 1]: 4.31e-05, [2] [frontend_op_eliminate]: 1.547e-05 [inline_after_opt_a]: 1.695e-05 [cconv]: 7.456e-05 [loop_unroll]: 0.00049145 [jit_opt_after_cconv]: 0.00017954, [1] [Cycle 1]: 0.00017229, [11] [c_1]: 2.31e-05 [parameter_eliminate]: 3.96001e-06 [updatestate_depend_eliminate]: 8.05e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.91e-06 [cse]: 3.092e-05 [call_graph_tuple_transform]: 2.192e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 5.54998e-06 [remove_dup_value]: 1.736e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 6.84001e-06 [add_recomputation]: 5.323e-05 [cse_after_recomputation]: 2.427e-05, [1] [Cycle 1]: 1.85e-05, [1] [cse]: 1.215e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.51e-06 [opt_after_jit_grad]: 0.0252433 [symbol_engine_optimizer]: 8.409e-05, [1] [Cycle 1]: 7.56e-05, [6] [build]: 5.27999e-06 [elim_shapecalc]: 7.72998e-06 [elim_not_effective]: 1.722e-05 [opt_reshape]: 6.79001e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 8.39995e-07 [validate]: 4.922e-05 Sums bootstrap : 0.000477s : 0.72% type_inference : 0.036673s : 55.18% event_method : 0.000020s : 0.03% auto_monad : 0.000070s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000102s : 0.15% rewriter_before_opt_a : 0.000082s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.10% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000673s : 1.01% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001012s : 1.52% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000682s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000075s : 0.11% loop_unroll : 0.000491s : 0.74% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.025243s : 37.99% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000250 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 3: substitution.graph_param_transform 85.54% : 0.000214s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 5.16% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036598 2 96.28% : 0.035237s : 1: type_inference.infer 3.72% : 0.001361s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.53% : 0.000051s : 4: replace.inline 31.47% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.73% : 0.000211s : 4: match.inline 5.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 2.48% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.48% : 0.000001s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.60% : 0.000002s : 10: predicate.reshape_eliminate 1.07% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.94% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000847 13 49.58% : 0.000420s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.37% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.05% : 0.000373s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072699 72 0.08% : 0.000057s : 1: add_recomputation 0.10% : 0.000074s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.69% : 0.000501s : 1: bootstrap 0.11% : 0.000077s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.31% : 0.006039s : 1: jit_opt_a 0.25% : 0.000182s : 1: jit_opt_after_cconv 0.07% : 0.000053s : 1: jit_opt_b 0.69% : 0.000501s : 1: loop_unroll 0.95% : 0.000694s : 1: mutable_eliminate 1.23% : 0.000896s : 26: opt.transform.jit_opt_a 0.07% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 34.75% : 0.025259s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000106s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.82% : 0.000594s : 1: renormalize.infer 0.56% : 0.000407s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000086s : 1: rewriter_before_opt_a 0.12% : 0.000087s : 1: symbol_engine_optimizer 50.47% : 0.036692s : 1: type_inference TotalTime = 0.09987, [30] [bootstrap]: 0.00038813 [type_inference]: 0.0560981 [event_method]: 2.238e-05 [auto_monad]: 7.405e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.0001427 [rewriter_before_opt_a]: 8.25e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00729022, [2] [Cycle 1]: 0.00285751, [27] [switch_simplify]: 7.028e-05 [loop_unroll]: 3.212e-05 [a_1]: 0.00066974 [with_stream_mark]: 2.454e-05 [recompute_prepare]: 1.064e-05 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.73001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.89002e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 3.06001e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 4.545e-05 [meta_fg_expand]: 3.24001e-06 [replace_old_param]: 1.343e-05 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00160862 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 2.77002e-06 [auto_monad_eliminator]: 1.823e-05 [cse]: 3.416e-05 [replace_applicator]: 1.958e-05 [Cycle 2]: 0.00037339, [27] [switch_simplify]: 6.44001e-06 [loop_unroll]: 6.04999e-06 [a_1]: 0.0001048 [with_stream_mark]: 1.322e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.754e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.33998e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.08e-06 [cse]: 1.543e-05 [replace_applicator]: 7.63001e-06 [py_interpret_to_execute_after_opt_a]: 1.867e-05 [rewriter_after_opt_a]: 4.126e-05 [convert_after_rewriter]: 7.84002e-06 [order_py_execute_after_rewriter]: 5.55001e-06 [mutable_eliminate]: 0.0008163 [jit_opt_b]: 5.929e-05, [1] [Cycle 1]: 5.055e-05, [2] [frontend_op_eliminate]: 1.903e-05 [inline_after_opt_a]: 1.787e-05 [cconv]: 3.191e-05 [loop_unroll]: 0.00055129 [jit_opt_after_cconv]: 0.00017267, [1] [Cycle 1]: 0.00016454, [11] [c_1]: 2.441e-05 [parameter_eliminate]: 4.75001e-06 [updatestate_depend_eliminate]: 8.02e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 3.475e-05 [call_graph_tuple_transform]: 2.261e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 8.89995e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 0.0321851 [partial_unused_args_eliminate]: 1.155e-05 [environ_conv]: 9.896e-05 [add_recomputation]: 9.683e-05 [cse_after_recomputation]: 8.476e-05, [1] [Cycle 1]: 6.835e-05, [1] [cse]: 4.268e-05 [auto_monad_reorder]: 2.615e-05 [get_jit_bprop_graph]: 3.27002e-06 [rewriter_after_jit_bprop_graph]: 1.45e-05 [opt_after_jit_grad]: 0.00106783 [symbol_engine_optimizer]: 0.00011015, [1] [Cycle 1]: 0.00010018, [6] [build]: 7.24001e-06 [elim_shapecalc]: 1.05e-05 [elim_not_effective]: 2.496e-05 [opt_reshape]: 8.45001e-06 [fold_const_symbol]: 1.299e-05 [renormalize]: 1.12e-06 [validate]: 6.034e-05 Sums bootstrap : 0.000388s : 0.41% type_inference : 0.056098s : 59.05% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000143s : 0.15% rewriter_before_opt_a : 0.000082s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.08% jit_opt_a.loop_unroll : 0.000038s : 0.04% jit_opt_a.a_1 : 0.000775s : 0.82% jit_opt_a.with_stream_mark : 0.000038s : 0.04% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000055s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001609s : 1.69% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000050s : 0.05% jit_opt_a.replace_applicator : 0.000027s : 0.03% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000816s : 0.86% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000551s : 0.58% jit_opt_after_cconv.c_1 : 0.000024s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.032185s : 33.88% partial_unused_args_eliminate : 0.000012s : 0.01% environ_conv : 0.000099s : 0.10% add_recomputation : 0.000097s : 0.10% cse_after_recomputation.cse : 0.000043s : 0.04% auto_monad_reorder : 0.000026s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.02% opt_after_jit_grad : 0.001068s : 1.12% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000060s : 0.06% Time group info: ------[substitution.] 0.000288 23 1.10% : 0.000003s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 3: substitution.graph_param_transform 85.10% : 0.000245s : 4: substitution.inline 1.35% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000006s : 4: substitution.remove_not_recompute_node 2.41% : 0.000007s : 2: substitution.replace_old_param 5.27% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056008 2 95.90% : 0.053709s : 1: type_inference.infer 4.10% : 0.002298s : 1: type_inference.specialize ------[replace.] 0.000100 6 65.67% : 0.000066s : 4: replace.inline 34.33% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 94.77% : 0.000242s : 4: match.inline 5.23% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.17% : 0.000002s : 10: predicate.accumulaten_eliminater 1.83% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.02% : 0.000001s : 10: predicate.addn_zero_filter 2.45% : 0.000003s : 10: predicate.arithmetic_simplify 1.55% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.65% : 0.000001s : 3: predicate.elim_not_effective 1.10% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000009s : 22: predicate.inline 1.24% : 0.000002s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.76% : 0.000002s : 6: predicate.less_batch_normalization 1.27% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.56% : 0.000002s : 15: predicate.load_eliminater 1.81% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 0.94% : 0.000001s : 10: predicate.minmaximum_grad 2.02% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.84% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 2.02% : 0.000003s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000003s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.10% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 16: predicate.switch_defer_inline 2.33% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.52% : 0.000010s : 53: predicate.switch_simplify 1.00% : 0.000001s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.17% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.66% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001194 13 41.69% : 0.000498s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.88% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.43% : 0.000638s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.102593 72 0.10% : 0.000101s : 1: add_recomputation 0.08% : 0.000078s : 1: auto_monad 0.03% : 0.000030s : 1: auto_monad_reorder 0.40% : 0.000410s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.09% : 0.000088s : 1: cse_after_recomputation 0.10% : 0.000103s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.11% : 0.007295s : 1: jit_opt_a 0.17% : 0.000176s : 1: jit_opt_after_cconv 0.06% : 0.000063s : 1: jit_opt_b 0.55% : 0.000562s : 1: loop_unroll 0.81% : 0.000829s : 1: mutable_eliminate 1.04% : 0.001068s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000052s : 4: opt.transform.symbol_engine_opt 1.06% : 0.001084s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000017s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000146s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 31.41% : 0.032225s : 1: remove_dup_value 0.93% : 0.000955s : 1: renormalize.infer 0.62% : 0.000640s : 1: renormalize.specialize 0.02% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000086s : 1: rewriter_before_opt_a 0.11% : 0.000113s : 1: symbol_engine_optimizer 54.70% : 0.056121s : 1: type_inference TotalTime = 0.0260062, [30] [bootstrap]: 0.00029543 [type_inference]: 0.0174979 [event_method]: 2.406e-05 [auto_monad]: 7.286e-05 [graph_reusing]: 7.38999e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 4.293e-05 [rewriter_before_opt_a]: 7.698e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00591903, [2] [Cycle 1]: 0.00174144, [27] [switch_simplify]: 5.558e-05 [loop_unroll]: 2.946e-05 [a_1]: 0.00055023 [with_stream_mark]: 2.143e-05 [recompute_prepare]: 7.21001e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.91003e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.13002e-06 [merge_forward]: 3.94997e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.97999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00075734 [add_forward_monad_depend]: 5.24e-06 [auto_monad_grad]: 2.43002e-06 [auto_monad_eliminator]: 1.565e-05 [cse]: 2.992e-05 [replace_applicator]: 1.171e-05 [Cycle 2]: 0.000334, [27] [switch_simplify]: 5.79999e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.006e-05 [with_stream_mark]: 8.40001e-06 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 2.73998e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.00001e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.66002e-06 [meta_shard_fg_expand]: 1.11002e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.274e-05 [j_node_and_user_rematch]: 7.74002e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 7.03998e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 1.755e-05 [auto_monad_eliminator]: 6.54999e-06 [cse]: 1.135e-05 [replace_applicator]: 5.71998e-06 [py_interpret_to_execute_after_opt_a]: 1.126e-05 [rewriter_after_opt_a]: 3.699e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00051435 [jit_opt_b]: 4.77e-05, [1] [Cycle 1]: 4.095e-05, [2] [frontend_op_eliminate]: 1.496e-05 [inline_after_opt_a]: 1.547e-05 [cconv]: 2.636e-05 [loop_unroll]: 0.00041182 [jit_opt_after_cconv]: 0.00013932, [1] [Cycle 1]: 0.00013228, [11] [c_1]: 2.074e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.90002e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.962e-05 [call_graph_tuple_transform]: 1.818e-05 [tuple_list_get_item_eliminator]: 5.02e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 5.00999e-06 [remove_dup_value]: 1.573e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 1.543e-05 [add_recomputation]: 5.294e-05 [cse_after_recomputation]: 2.263e-05, [1] [Cycle 1]: 1.722e-05, [1] [cse]: 1.179e-05 [auto_monad_reorder]: 1.551e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00044178 [symbol_engine_optimizer]: 7.262e-05, [1] [Cycle 1]: 6.658e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.55998e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 5.91998e-06 [fold_const_symbol]: 9.14998e-06 [renormalize]: 3.59985e-07 [validate]: 3.634e-05 Sums bootstrap : 0.000295s : 1.37% type_inference : 0.017498s : 81.09% event_method : 0.000024s : 0.11% auto_monad : 0.000073s : 0.34% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000043s : 0.20% rewriter_before_opt_a : 0.000077s : 0.36% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000061s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.16% jit_opt_a.a_1 : 0.000640s : 2.97% jit_opt_a.with_stream_mark : 0.000030s : 0.14% jit_opt_a.recompute_prepare : 0.000012s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000010s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000757s : 3.51% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000020s : 0.09% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.10% jit_opt_a.cse : 0.000041s : 0.19% jit_opt_a.replace_applicator : 0.000017s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000037s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000514s : 2.38% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.07% jit_opt_b.inline_after_opt_a : 0.000015s : 0.07% cconv : 0.000026s : 0.12% loop_unroll : 0.000412s : 1.91% jit_opt_after_cconv.c_1 : 0.000021s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000015s : 0.07% add_recomputation : 0.000053s : 0.25% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000016s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000442s : 2.05% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.17% Time group info: ------[substitution.] 0.000225 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.35% : 0.000005s : 3: substitution.graph_param_transform 85.24% : 0.000192s : 4: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 5.41% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017407 2 93.51% : 0.016278s : 1: type_inference.infer 6.49% : 0.001129s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.85% : 0.000044s : 4: replace.inline 33.15% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.49% : 0.000189s : 4: match.inline 5.51% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.83% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.54% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.94% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.93% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000757 13 46.97% : 0.000355s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.29% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.74% : 0.000354s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027661 72 0.20% : 0.000056s : 1: add_recomputation 0.28% : 0.000077s : 1: auto_monad 0.06% : 0.000018s : 1: auto_monad_reorder 1.13% : 0.000313s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000018s : 1: environ_conv 0.10% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 21.41% : 0.005922s : 1: jit_opt_a 0.51% : 0.000142s : 1: jit_opt_after_cconv 0.18% : 0.000050s : 1: jit_opt_b 1.52% : 0.000419s : 1: loop_unroll 1.89% : 0.000523s : 1: mutable_eliminate 3.07% : 0.000848s : 26: opt.transform.jit_opt_a 0.17% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000012s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.63% : 0.000450s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000046s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.54% : 0.000425s : 1: renormalize.infer 1.17% : 0.000324s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000040s : 1: rewriter_after_opt_a 0.29% : 0.000081s : 1: rewriter_before_opt_a 0.27% : 0.000075s : 1: symbol_engine_optimizer 63.34% : 0.017521s : 1: type_inference TotalTime = 0.0310281, [30] [bootstrap]: 0.00033897 [type_inference]: 0.0196528 [event_method]: 2.746e-05 [auto_monad]: 7.625e-05 [graph_reusing]: 7.12002e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 6.884e-05 [rewriter_before_opt_a]: 9.402e-05 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.00750396, [2] [Cycle 1]: 0.00256074, [27] [switch_simplify]: 7.005e-05 [loop_unroll]: 3.082e-05 [a_1]: 0.00063891 [with_stream_mark]: 2.989e-05 [recompute_prepare]: 8.82e-06 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 7.53999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 1.173e-05 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.174e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00137076 [add_forward_monad_depend]: 9.88002e-06 [auto_monad_grad]: 3.13e-06 [auto_monad_eliminator]: 1.899e-05 [cse]: 4.294e-05 [replace_applicator]: 2.165e-05 [Cycle 2]: 0.00036406, [27] [switch_simplify]: 6.91001e-06 [loop_unroll]: 5.62999e-06 [a_1]: 9.974e-05 [with_stream_mark]: 1.436e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 4.81002e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.692e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 7.13e-06 [cse]: 1.644e-05 [replace_applicator]: 6.73998e-06 [py_interpret_to_execute_after_opt_a]: 1.635e-05 [rewriter_after_opt_a]: 0.00027924 [convert_after_rewriter]: 1.29e-05 [order_py_execute_after_rewriter]: 5.97001e-06 [mutable_eliminate]: 0.00081274 [jit_opt_b]: 6.052e-05, [1] [Cycle 1]: 5.149e-05, [2] [frontend_op_eliminate]: 1.974e-05 [inline_after_opt_a]: 1.932e-05 [cconv]: 3.484e-05 [loop_unroll]: 0.00051324 [jit_opt_after_cconv]: 0.00018288, [1] [Cycle 1]: 0.00017479, [11] [c_1]: 2.278e-05 [parameter_eliminate]: 4.58999e-06 [updatestate_depend_eliminate]: 8.46002e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.2e-06 [cse]: 4.021e-05 [call_graph_tuple_transform]: 2.553e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 1.15999e-06 [switch_simplify]: 5.71e-06 [remove_dup_value]: 4.574e-05 [partial_unused_args_eliminate]: 3.08e-06 [environ_conv]: 8.37e-06 [add_recomputation]: 6.101e-05 [cse_after_recomputation]: 2.995e-05, [1] [Cycle 1]: 2.251e-05, [1] [cse]: 1.54e-05 [auto_monad_reorder]: 1.979e-05 [get_jit_bprop_graph]: 2.49001e-06 [rewriter_after_jit_bprop_graph]: 8.01001e-06 [opt_after_jit_grad]: 0.000747 [symbol_engine_optimizer]: 9.748e-05, [1] [Cycle 1]: 8.812e-05, [6] [build]: 6.79999e-06 [elim_shapecalc]: 1.054e-05 [elim_not_effective]: 1.973e-05 [opt_reshape]: 8.38001e-06 [fold_const_symbol]: 1.017e-05 [renormalize]: 1.04003e-06 [validate]: 5.757e-05 Sums bootstrap : 0.000339s : 1.32% type_inference : 0.019653s : 76.41% event_method : 0.000027s : 0.11% auto_monad : 0.000076s : 0.30% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000069s : 0.27% rewriter_before_opt_a : 0.000094s : 0.37% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.30% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000739s : 2.87% jit_opt_a.with_stream_mark : 0.000044s : 0.17% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001371s : 5.33% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000059s : 0.23% jit_opt_a.replace_applicator : 0.000028s : 0.11% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000279s : 1.09% convert_after_rewriter : 0.000013s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000813s : 3.16% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.08% jit_opt_b.inline_after_opt_a : 0.000019s : 0.08% cconv : 0.000035s : 0.14% loop_unroll : 0.000513s : 2.00% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000040s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000046s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000061s : 0.24% cse_after_recomputation.cse : 0.000015s : 0.06% auto_monad_reorder : 0.000020s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000747s : 2.90% symbol_engine_optimizer.build : 0.000007s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.22% Time group info: ------[substitution.] 0.000283 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000008s : 3: substitution.graph_param_transform 85.29% : 0.000241s : 4: substitution.inline 1.65% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000005s : 2: substitution.replace_old_param 5.23% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019543 2 28.82% : 0.005633s : 1: type_inference.infer 71.18% : 0.013910s : 1: type_inference.specialize ------[replace.] 0.000087 6 65.80% : 0.000057s : 4: replace.inline 34.20% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000252 6 94.70% : 0.000239s : 4: match.inline 5.30% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.87% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.11% : 0.000001s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 10: predicate.dict_set_item_eliminator 2.04% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 1.10% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.71% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 15: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.34% : 0.000002s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 2.61% : 0.000003s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.22% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.06% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.35% : 0.000002s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000010s : 53: predicate.switch_simplify 1.08% : 0.000001s : 10: predicate.tile_eliminate 1.02% : 0.000001s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.58% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.24% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.43% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001079 13 41.82% : 0.000451s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.54% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.64% : 0.000568s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033454 72 0.20% : 0.000066s : 1: add_recomputation 0.24% : 0.000080s : 1: auto_monad 0.07% : 0.000023s : 1: auto_monad_reorder 1.08% : 0.000362s : 1: bootstrap 0.11% : 0.000038s : 1: cconv 0.05% : 0.000017s : 1: convert_after_rewriter 0.10% : 0.000032s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.10% : 0.000033s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 22.45% : 0.007509s : 1: jit_opt_a 0.56% : 0.000186s : 1: jit_opt_after_cconv 0.19% : 0.000064s : 1: jit_opt_b 1.56% : 0.000523s : 1: loop_unroll 2.46% : 0.000824s : 1: mutable_eliminate 2.97% : 0.000994s : 26: opt.transform.jit_opt_a 0.17% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000032s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000021s : 1: opt.transform.mutable_eliminate 0.10% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000045s : 4: opt.transform.symbol_engine_opt 2.29% : 0.000764s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000072s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.15% : 0.000049s : 1: remove_dup_value 2.39% : 0.000800s : 1: renormalize.infer 1.67% : 0.000559s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.87% : 0.000291s : 1: rewriter_after_opt_a 0.29% : 0.000097s : 1: rewriter_before_opt_a 0.30% : 0.000102s : 1: symbol_engine_optimizer 58.84% : 0.019684s : 1: type_inference TotalTime = 0.0969443, [30] [bootstrap]: 0.00030976 [type_inference]: 0.0882689 [event_method]: 2.164e-05 [auto_monad]: 6.991e-05 [graph_reusing]: 6.19999e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00010171 [rewriter_before_opt_a]: 8.037e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.00571989, [2] [Cycle 1]: 0.00190873, [27] [switch_simplify]: 5.429e-05 [loop_unroll]: 2.86e-05 [a_1]: 0.00052604 [with_stream_mark]: 1.973e-05 [recompute_prepare]: 7.78999e-06 [updatestate_depend_eliminate]: 3.85998e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.395e-05 [j_node_and_user_rematch]: 8.54998e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 8.60999e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 0.0008684 [add_forward_monad_depend]: 5.22e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.45e-05 [cse]: 0.00011459 [replace_applicator]: 1.234e-05 [Cycle 2]: 0.00056746, [27] [switch_simplify]: 5.73002e-06 [loop_unroll]: 4.87e-06 [a_1]: 8.92e-05 [with_stream_mark]: 1.015e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.00001e-06 [updatestate_useless_node_eliminater]: 4.76997e-06 [accelerated_algorithm]: 4.93001e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.70997e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.60001e-06 [replace_old_param]: 7.10998e-06 [inline_without_move]: 4.71997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.13e-06 [cse]: 0.0002574 [replace_applicator]: 6.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.336e-05 [rewriter_after_opt_a]: 3.939e-05 [convert_after_rewriter]: 6.46999e-06 [order_py_execute_after_rewriter]: 5.54998e-06 [mutable_eliminate]: 0.0006937 [jit_opt_b]: 5.204e-05, [1] [Cycle 1]: 4.393e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.62e-05 [cconv]: 2.816e-05 [loop_unroll]: 0.00044852 [jit_opt_after_cconv]: 0.00017299, [1] [Cycle 1]: 0.00016637, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 3.73001e-06 [updatestate_depend_eliminate]: 8.40999e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.714e-05 [call_graph_tuple_transform]: 2.079e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 7.02002e-06 [add_recomputation]: 5.54e-05 [cse_after_recomputation]: 2.331e-05, [1] [Cycle 1]: 1.792e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.695e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.72001e-06 [opt_after_jit_grad]: 0.00047732 [symbol_engine_optimizer]: 7.098e-05, [1] [Cycle 1]: 6.483e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 7.71999e-06 [elim_not_effective]: 1.242e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 3.10014e-07 [validate]: 4.286e-05 Sums bootstrap : 0.000310s : 0.33% type_inference : 0.088269s : 94.81% event_method : 0.000022s : 0.02% auto_monad : 0.000070s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000102s : 0.11% rewriter_before_opt_a : 0.000080s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.06% jit_opt_a.loop_unroll : 0.000033s : 0.04% jit_opt_a.a_1 : 0.000615s : 0.66% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000868s : 0.93% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000372s : 0.40% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000694s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000449s : 0.48% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000477s : 0.51% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.05% Time group info: ------[substitution.] 0.000208 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 84.15% : 0.000175s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000004s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 5.96% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.088194 2 98.43% : 0.086806s : 1: type_inference.infer 1.57% : 0.001388s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.54% : 0.000046s : 4: replace.inline 33.46% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 93.85% : 0.000173s : 4: match.inline 6.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.19% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.64% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000771 13 48.08% : 0.000371s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.25% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.67% : 0.000360s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.098692 72 0.06% : 0.000059s : 1: add_recomputation 0.07% : 0.000074s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.33% : 0.000328s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.80% : 0.005723s : 1: jit_opt_a 0.18% : 0.000176s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.46% : 0.000457s : 1: loop_unroll 0.71% : 0.000705s : 1: mutable_eliminate 0.83% : 0.000824s : 26: opt.transform.jit_opt_a 0.05% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000106s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.52% : 0.000516s : 1: renormalize.infer 0.35% : 0.000345s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000083s : 1: rewriter_before_opt_a 0.07% : 0.000073s : 1: symbol_engine_optimizer 89.46% : 0.088286s : 1: type_inference TotalTime = 0.339422, [30] [bootstrap]: 0.00064524 [type_inference]: 0.298595 [event_method]: 2.202e-05 [auto_monad]: 8.159e-05 [graph_reusing]: 7.2e-06 [pre_auto_parallel]: 2.87002e-06 [py_interpret_to_execute]: 0.00057946 [rewriter_before_opt_a]: 0.00010887 [expand_dump_flag]: 4.42e-06 [jit_opt_a]: 0.036907, [2] [Cycle 1]: 0.00628542, [27] [switch_simplify]: 8.583e-05 [loop_unroll]: 3.124e-05 [a_1]: 0.00074463 [with_stream_mark]: 2.915e-05 [recompute_prepare]: 1.11e-05 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.28e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 8.05e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 6.78998e-06 [merge_forward]: 6.07001e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.915e-05 [j_node_and_user_rematch]: 1.159e-05 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.237e-05 [inline_without_move]: 6.61e-06 [renormalize]: 0.00496412 [add_forward_monad_depend]: 8.57e-06 [auto_monad_grad]: 2.51998e-06 [auto_monad_eliminator]: 1.895e-05 [cse]: 3.445e-05 [replace_applicator]: 2.538e-05 [Cycle 2]: 0.0003897, [27] [switch_simplify]: 7.18998e-06 [loop_unroll]: 5.76e-06 [a_1]: 0.0001283 [with_stream_mark]: 1.478e-05 [recompute_prepare]: 6.59001e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 4.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.943e-05 [j_node_and_user_rematch]: 9.70002e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.28002e-06 [inline_without_move]: 6.38e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.192e-05 [replace_applicator]: 5.70001e-06 [py_interpret_to_execute_after_opt_a]: 1.239e-05 [rewriter_after_opt_a]: 3.692e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.0007337 [jit_opt_b]: 5.586e-05, [1] [Cycle 1]: 4.782e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 1.752e-05 [cconv]: 2.807e-05 [loop_unroll]: 0.00041683 [jit_opt_after_cconv]: 0.00015023, [1] [Cycle 1]: 0.00014391, [11] [c_1]: 2.486e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.133e-05 [call_graph_tuple_transform]: 2.058e-05 [tuple_list_get_item_eliminator]: 7.05e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.60002e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 9.71e-06 [add_recomputation]: 5.595e-05 [cse_after_recomputation]: 2.297e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.159e-05 [auto_monad_reorder]: 1.606e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 5.30001e-06 [opt_after_jit_grad]: 0.00046147 [symbol_engine_optimizer]: 7.881e-05, [1] [Cycle 1]: 7.278e-05, [6] [build]: 4.47998e-06 [elim_shapecalc]: 1.038e-05 [elim_not_effective]: 1.427e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 3.60014e-07 [validate]: 0.00012221 Sums bootstrap : 0.000645s : 0.21% type_inference : 0.298595s : 96.79% event_method : 0.000022s : 0.01% auto_monad : 0.000082s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000579s : 0.19% rewriter_before_opt_a : 0.000109s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000873s : 0.28% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004964s : 1.61% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000046s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000037s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000734s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000417s : 0.14% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000015s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000461s : 0.15% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000122s : 0.04% Time group info: ------[substitution.] 0.000325 24 0.56% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 4: substitution.graph_param_transform 87.00% : 0.000283s : 4: substitution.inline 1.52% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000007s : 4: substitution.remove_not_recompute_node 2.09% : 0.000007s : 2: substitution.replace_old_param 4.59% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.298478 2 98.67% : 0.294502s : 1: type_inference.infer 1.33% : 0.003975s : 1: type_inference.specialize ------[replace.] 0.000104 6 68.35% : 0.000071s : 4: replace.inline 31.65% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 6 95.33% : 0.000280s : 4: match.inline 4.67% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.53% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.72% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.36% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.73% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.32% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.80% : 0.000004s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.74% : 0.000011s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.023111 22 95.70% : 0.022117s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.29% : 0.000067s : 1: func_graph_cloner_run.FuncGraphClonerNode 4.01% : 0.000927s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.345508 72 0.02% : 0.000059s : 1: add_recomputation 0.02% : 0.000085s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.20% : 0.000678s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 10.68% : 0.036911s : 1: jit_opt_a 0.04% : 0.000154s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.12% : 0.000425s : 1: loop_unroll 0.22% : 0.000743s : 1: mutable_eliminate 0.33% : 0.001154s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000470s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000587s : 1: py_interpret_to_execute 0.00% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.14% : 0.003944s : 1: renormalize.infer 0.29% : 0.001007s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000040s : 1: rewriter_after_opt_a 0.03% : 0.000115s : 1: rewriter_before_opt_a 0.02% : 0.000081s : 1: symbol_engine_optimizer 86.43% : 0.298623s : 1: type_inference TotalTime = 0.369246, [30] [bootstrap]: 0.00037184 [type_inference]: 0.325058 [event_method]: 2.481e-05 [auto_monad]: 7.579e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.0004346 [rewriter_before_opt_a]: 9.72e-05 [expand_dump_flag]: 3.67002e-06 [jit_opt_a]: 0.0406256, [2] [Cycle 1]: 0.00425774, [27] [switch_simplify]: 7.942e-05 [loop_unroll]: 3.724e-05 [a_1]: 0.00078779 [with_stream_mark]: 2.636e-05 [recompute_prepare]: 1.006e-05 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 8.2e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.774e-05 [j_node_and_user_rematch]: 1.111e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 6.58e-06 [renormalize]: 0.00291518 [add_forward_monad_depend]: 6.37001e-06 [auto_monad_grad]: 2.58998e-06 [auto_monad_eliminator]: 1.872e-05 [cse]: 4.169e-05 [replace_applicator]: 2.331e-05 [Cycle 2]: 0.00039969, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.0001292 [with_stream_mark]: 1.417e-05 [recompute_prepare]: 6.77002e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 4.57998e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.722e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 1.106e-05 [inline_without_move]: 6.06e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.479e-05 [replace_applicator]: 6.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.436e-05 [rewriter_after_opt_a]: 4.117e-05 [convert_after_rewriter]: 7.12002e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00071472 [jit_opt_b]: 5.991e-05, [1] [Cycle 1]: 5.153e-05, [2] [frontend_op_eliminate]: 1.961e-05 [inline_after_opt_a]: 1.988e-05 [cconv]: 2.868e-05 [loop_unroll]: 0.00045414 [jit_opt_after_cconv]: 0.0001768, [1] [Cycle 1]: 0.00016965, [11] [c_1]: 2.711e-05 [parameter_eliminate]: 3.04001e-06 [updatestate_depend_eliminate]: 7.05998e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 3.099e-05 [call_graph_tuple_transform]: 2.476e-05 [tuple_list_get_item_eliminator]: 7.21999e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 7.3e-06 [remove_dup_value]: 1.983e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 9.32001e-06 [add_recomputation]: 5.511e-05 [cse_after_recomputation]: 2.569e-05, [1] [Cycle 1]: 1.987e-05, [1] [cse]: 1.324e-05 [auto_monad_reorder]: 2.045e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00051849 [symbol_engine_optimizer]: 8.303e-05, [1] [Cycle 1]: 7.669e-05, [6] [build]: 3.79002e-06 [elim_shapecalc]: 9.89001e-06 [elim_not_effective]: 1.551e-05 [opt_reshape]: 7.48999e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 6.00005e-07 [validate]: 9.481e-05 Sums bootstrap : 0.000372s : 0.11% type_inference : 0.325058s : 97.73% event_method : 0.000025s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000435s : 0.13% rewriter_before_opt_a : 0.000097s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.03% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.000917s : 0.28% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.002915s : 0.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000715s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000454s : 0.14% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000518s : 0.16% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000095s : 0.03% Time group info: ------[substitution.] 0.000329 25 0.91% : 0.000003s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000007s : 4: substitution.graph_param_transform 87.79% : 0.000288s : 5: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000006s : 2: substitution.replace_old_param 4.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.324973 2 99.12% : 0.322115s : 1: type_inference.infer 0.88% : 0.002858s : 1: type_inference.specialize ------[replace.] 0.000108 7 70.08% : 0.000076s : 5: replace.inline 29.92% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000297 7 95.93% : 0.000285s : 5: match.inline 4.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.66% : 0.000003s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.47% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.41% : 0.000002s : 13: predicate.environ_get_depend_swap 1.09% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.69% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.06% : 0.000002s : 13: predicate.print_const_string_wrapper 2.06% : 0.000003s : 13: predicate.reduce_eliminate 1.32% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.62% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 13: predicate.same_eliminate 0.92% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.72% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.64% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000011s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.04% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002603 25 68.23% : 0.001776s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.63% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.14% : 0.000732s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.373393 72 0.02% : 0.000058s : 1: add_recomputation 0.02% : 0.000079s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.11% : 0.000396s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 10.88% : 0.040629s : 1: jit_opt_a 0.05% : 0.000179s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.12% : 0.000463s : 1: loop_unroll 0.19% : 0.000724s : 1: mutable_eliminate 0.32% : 0.001204s : 26: opt.transform.jit_opt_a 0.02% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000527s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000441s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.57% : 0.002129s : 1: renormalize.infer 0.21% : 0.000774s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000044s : 1: rewriter_after_opt_a 0.03% : 0.000103s : 1: rewriter_before_opt_a 0.02% : 0.000086s : 1: symbol_engine_optimizer 87.06% : 0.325081s : 1: type_inference TotalTime = 0.0820373, [30] [bootstrap]: 0.00031882 [type_inference]: 0.0212861 [event_method]: 1.989e-05 [auto_monad]: 6.918e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 9.887e-05 [rewriter_before_opt_a]: 8.441e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.0577101, [2] [Cycle 1]: 0.00211357, [27] [switch_simplify]: 6.684e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00058883 [with_stream_mark]: 2.608e-05 [recompute_prepare]: 8.67998e-06 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.66e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.87998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.07e-05 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00103734 [add_forward_monad_depend]: 6.76999e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.587e-05 [cse]: 3.952e-05 [replace_applicator]: 1.443e-05 [Cycle 2]: 0.00033338, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.81998e-06 [a_1]: 9.418e-05 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.392e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 8.11002e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.13998e-06 [cse]: 1.33e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.441e-05 [rewriter_after_opt_a]: 3.949e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00070183 [jit_opt_b]: 5.157e-05, [1] [Cycle 1]: 4.338e-05, [2] [frontend_op_eliminate]: 1.626e-05 [inline_after_opt_a]: 1.579e-05 [cconv]: 3.037e-05 [loop_unroll]: 0.00045321 [jit_opt_after_cconv]: 0.00015585, [1] [Cycle 1]: 0.00014926, [11] [c_1]: 2.111e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 7.55998e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 3.02002e-06 [cse]: 2.896e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 6.23002e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.868e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.66e-06 [add_recomputation]: 5.732e-05 [cse_after_recomputation]: 4.577e-05, [1] [Cycle 1]: 4.003e-05, [1] [cse]: 1.336e-05 [auto_monad_reorder]: 1.917e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 7.61001e-06 [opt_after_jit_grad]: 0.00050772 [symbol_engine_optimizer]: 7.709e-05, [1] [Cycle 1]: 7.015e-05, [6] [build]: 4.80999e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.368e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 9.31998e-06 [renormalize]: 4.00003e-07 [validate]: 5.148e-05 Sums bootstrap : 0.000319s : 1.22% type_inference : 0.021286s : 81.40% event_method : 0.000020s : 0.08% auto_monad : 0.000069s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000099s : 0.38% rewriter_before_opt_a : 0.000084s : 0.32% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000683s : 2.61% jit_opt_a.with_stream_mark : 0.000038s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001037s : 3.97% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000039s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000702s : 2.68% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000030s : 0.12% loop_unroll : 0.000453s : 1.73% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000057s : 0.22% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000508s : 1.94% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.20% Time group info: ------[substitution.] 0.000257 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 3: substitution.graph_param_transform 85.29% : 0.000219s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000005s : 4: substitution.remove_not_recompute_node 2.55% : 0.000007s : 2: substitution.replace_old_param 4.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021205 2 93.53% : 0.019834s : 1: type_inference.infer 6.47% : 0.001372s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.73% : 0.000051s : 4: replace.inline 31.27% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.87% : 0.000217s : 4: match.inline 5.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.38% : 0.000002s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.42% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.29% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 15: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000001s : 10: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000002s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.40% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.70% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000811 13 44.35% : 0.000360s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.24% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.41% : 0.000392s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084036 72 0.07% : 0.000060s : 1: add_recomputation 0.09% : 0.000073s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.40% : 0.000332s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000048s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 68.68% : 0.057714s : 1: jit_opt_a 0.19% : 0.000159s : 1: jit_opt_after_cconv 0.06% : 0.000054s : 1: jit_opt_b 0.55% : 0.000462s : 1: loop_unroll 0.85% : 0.000712s : 1: mutable_eliminate 1.09% : 0.000916s : 26: opt.transform.jit_opt_a 0.06% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000103s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.74% : 0.000620s : 1: renormalize.infer 0.49% : 0.000408s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.10% : 0.000088s : 1: rewriter_before_opt_a 0.10% : 0.000080s : 1: symbol_engine_optimizer 25.35% : 0.021307s : 1: type_inference TotalTime = 0.511815, [30] [bootstrap]: 0.00034826 [type_inference]: 0.481529 [event_method]: 0.00049674 [auto_monad]: 0.00013755 [graph_reusing]: 8.78001e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 4.597e-05 [rewriter_before_opt_a]: 0.00015227 [expand_dump_flag]: 4.51002e-06 [jit_opt_a]: 0.0257359, [2] [Cycle 1]: 0.021291, [27] [switch_simplify]: 0.00027007 [loop_unroll]: 8.098e-05 [a_1]: 0.00167863 [with_stream_mark]: 2.6e-05 [recompute_prepare]: 1.325e-05 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.78e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 8.15999e-06 [meta_shard_fg_expand]: 2.75002e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 4.39002e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.969e-05 [j_node_and_user_rematch]: 1.109e-05 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 1.134e-05 [inline_without_move]: 7.40998e-06 [renormalize]: 0.0187366 [add_forward_monad_depend]: 1.488e-05 [auto_monad_grad]: 2.28002e-06 [auto_monad_eliminator]: 2.552e-05 [cse]: 4.094e-05 [replace_applicator]: 3.058e-05 [Cycle 2]: 0.00043004, [27] [switch_simplify]: 7.68001e-06 [loop_unroll]: 8.52998e-06 [a_1]: 0.00013739 [with_stream_mark]: 1.752e-05 [recompute_prepare]: 6.40002e-06 [updatestate_depend_eliminate]: 3.87998e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.96003e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 3.09999e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 4.69002e-06 [cell_reuse_recompute_pass]: 2.93e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.122e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 3.41001e-06 [replace_old_param]: 1.23e-05 [inline_without_move]: 6.65002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.11997e-06 [auto_monad_eliminator]: 7.04001e-06 [cse]: 1.543e-05 [replace_applicator]: 5.51e-06 [py_interpret_to_execute_after_opt_a]: 2.523e-05 [rewriter_after_opt_a]: 4.361e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00093754 [jit_opt_b]: 6.309e-05, [1] [Cycle 1]: 5.464e-05, [2] [frontend_op_eliminate]: 2.129e-05 [inline_after_opt_a]: 2.037e-05 [cconv]: 3.659e-05 [loop_unroll]: 0.00051743 [jit_opt_after_cconv]: 0.00019288, [1] [Cycle 1]: 0.00018517, [11] [c_1]: 2.856e-05 [parameter_eliminate]: 5.24998e-06 [updatestate_depend_eliminate]: 8.99e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.48002e-06 [cse]: 3.894e-05 [call_graph_tuple_transform]: 2.623e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 1.953e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 6.212e-05 [cse_after_recomputation]: 2.911e-05, [1] [Cycle 1]: 2.393e-05, [1] [cse]: 1.508e-05 [auto_monad_reorder]: 1.936e-05 [get_jit_bprop_graph]: 3.89997e-06 [rewriter_after_jit_bprop_graph]: 1.006e-05 [opt_after_jit_grad]: 0.00066037 [symbol_engine_optimizer]: 9.915e-05, [1] [Cycle 1]: 9.065e-05, [6] [build]: 5.92999e-06 [elim_shapecalc]: 1.331e-05 [elim_not_effective]: 1.718e-05 [opt_reshape]: 9.03002e-06 [fold_const_symbol]: 1.06e-05 [renormalize]: 3.4002e-07 [validate]: 0.00033684 Sums bootstrap : 0.000348s : 0.07% type_inference : 0.481529s : 94.98% event_method : 0.000497s : 0.10% auto_monad : 0.000138s : 0.03% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000046s : 0.01% rewriter_before_opt_a : 0.000152s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000278s : 0.05% jit_opt_a.loop_unroll : 0.000090s : 0.02% jit_opt_a.a_1 : 0.001816s : 0.36% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.00% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.018737s : 3.70% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000056s : 0.01% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000025s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000938s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000037s : 0.01% loop_unroll : 0.000517s : 0.10% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000062s : 0.01% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000660s : 0.13% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000337s : 0.07% Time group info: ------[substitution.] 0.000738 35 0.47% : 0.000003s : 2: substitution.elim_not_effective 0.20% : 0.000001s : 2: substitution.fold_const_symbol 0.84% : 0.000006s : 3: substitution.graph_param_transform 90.61% : 0.000669s : 12: substitution.inline 0.70% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.87% : 0.000006s : 4: substitution.remove_not_recompute_node 1.05% : 0.000008s : 2: substitution.replace_old_param 1.56% : 0.000012s : 1: substitution.reshape_eliminate 1.94% : 0.000014s : 3: substitution.switch_simplify 1.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.481413 2 98.93% : 0.476261s : 1: type_inference.infer 1.07% : 0.005151s : 1: type_inference.specialize ------[replace.] 0.000386 18 48.93% : 0.000189s : 12: replace.inline 1.61% : 0.000006s : 1: replace.reshape_eliminate 20.37% : 0.000079s : 3: replace.switch_simplify 29.09% : 0.000112s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000696 18 95.06% : 0.000662s : 12: match.inline 1.47% : 0.000010s : 1: match.reshape_eliminate 1.80% : 0.000012s : 3: match.switch_simplify 1.67% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000237 1212 1.43% : 0.000003s : 19: predicate.accumulaten_eliminater 1.04% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.29% : 0.000003s : 19: predicate.addn_check_dump 1.23% : 0.000003s : 19: predicate.addn_zero_filter 2.17% : 0.000005s : 19: predicate.arithmetic_simplify 1.49% : 0.000004s : 20: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.55% : 0.000004s : 19: predicate.compare_switch_simplify 1.18% : 0.000003s : 19: predicate.depend_value_elim 1.38% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.33% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.55% : 0.000004s : 20: predicate.dict_set_item_eliminator 1.09% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.19% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.29% : 0.000003s : 20: predicate.environ_get_depend_swap 1.65% : 0.000004s : 20: predicate.environ_get_eliminate 1.12% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.11% : 0.000000s : 3: predicate.fold_const_symbol 0.79% : 0.000002s : 6: predicate.get_grad_eliminate 0.12% : 0.000000s : 3: predicate.graph_param_transform 5.11% : 0.000012s : 40: predicate.inline 0.58% : 0.000001s : 6: predicate.inline_without_move 0.29% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000003s : 6: predicate.less_batch_normalization 1.50% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.56% : 0.000004s : 25: predicate.load_eliminater 1.10% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000011s : 64: predicate.loop_unroll_before_grad 2.10% : 0.000005s : 23: predicate.make_slice_get_slice_eliminator 1.33% : 0.000003s : 19: predicate.merge_addn 1.17% : 0.000003s : 19: predicate.minmaximum_grad 1.79% : 0.000004s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 1.79% : 0.000004s : 25: predicate.partial_eliminate 1.38% : 0.000003s : 19: predicate.print_const_string_wrapper 2.22% : 0.000005s : 19: predicate.reduce_eliminate 1.70% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.39% : 0.000003s : 28: predicate.replace_applicator 0.37% : 0.000001s : 6: predicate.replace_old_param 0.16% : 0.000000s : 3: predicate.reset_defer_inline 1.71% : 0.000004s : 20: predicate.reshape_eliminate 1.38% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.49% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000003s : 19: predicate.same_eliminate 0.26% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000002s : 6: predicate.special_op_eliminate 0.48% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.22% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.25% : 0.000008s : 34: predicate.switch_defer_inline 2.59% : 0.000006s : 34: predicate.switch_layer_defer_inline 7.75% : 0.000018s : 107: predicate.switch_simplify 1.42% : 0.000003s : 19: predicate.tile_eliminate 1.39% : 0.000003s : 19: predicate.transpose_eliminate 1.68% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 2.04% : 0.000005s : 20: predicate.tuple_list_set_item_eliminator 1.46% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.45% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.15% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.95% : 0.000005s : 19: predicate.value_based_eliminate 0.16% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.019496 40 14.66% : 0.002858s : 21: func_graph_cloner_run.FuncGraphClonerGraph 1.93% : 0.000376s : 5: func_graph_cloner_run.FuncGraphClonerNode 83.41% : 0.016262s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.532682 72 0.01% : 0.000065s : 1: add_recomputation 0.03% : 0.000145s : 1: auto_monad 0.00% : 0.000022s : 1: auto_monad_reorder 0.07% : 0.000368s : 1: bootstrap 0.01% : 0.000039s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.10% : 0.000506s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000011s : 1: graph_reusing 4.83% : 0.025741s : 1: jit_opt_a 0.04% : 0.000196s : 1: jit_opt_after_cconv 0.01% : 0.000067s : 1: jit_opt_b 0.10% : 0.000526s : 1: loop_unroll 0.18% : 0.000950s : 1: mutable_eliminate 0.44% : 0.002347s : 26: opt.transform.jit_opt_a 0.01% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000716s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.01% : 0.000049s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000023s : 1: remove_dup_value 0.59% : 0.003166s : 1: renormalize.infer 2.92% : 0.015552s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.03% : 0.000156s : 1: rewriter_before_opt_a 0.02% : 0.000102s : 1: symbol_engine_optimizer 90.40% : 0.481550s : 1: type_inference TotalTime = 0.468213, [30] [bootstrap]: 0.00036792 [type_inference]: 0.447788 [event_method]: 3.042e-05 [auto_monad]: 8.548e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00091735 [rewriter_before_opt_a]: 0.00014996 [expand_dump_flag]: 4.63999e-06 [jit_opt_a]: 0.0157423, [2] [Cycle 1]: 0.00973872, [27] [switch_simplify]: 0.00010447 [loop_unroll]: 3.1e-05 [a_1]: 0.00075757 [with_stream_mark]: 2.508e-05 [recompute_prepare]: 9.82999e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 7.83999e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.33002e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.186e-05 [inline_without_move]: 7.70998e-06 [renormalize]: 0.00836746 [add_forward_monad_depend]: 1.211e-05 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 2.442e-05 [cse]: 4.481e-05 [replace_applicator]: 2.979e-05 [Cycle 2]: 0.00066829, [27] [switch_simplify]: 7.92998e-06 [loop_unroll]: 8.62e-06 [a_1]: 0.0001458 [with_stream_mark]: 2.128e-05 [recompute_prepare]: 9.92999e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 4.15e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.73e-06 [specialize_transform]: 7.49002e-06 [updatestate_useless_node_eliminater]: 6.13998e-06 [accelerated_algorithm]: 7.2e-06 [meta_shard_fg_expand]: 0.00013756 [get_grad_eliminate_]: 1.719e-05 [merge_forward]: 9.31e-06 [cell_reuse_recompute_pass]: 3.88999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.33e-05 [j_node_and_user_rematch]: 1.198e-05 [meta_fg_expand]: 2.78998e-06 [replace_old_param]: 1.214e-05 [inline_without_move]: 6.94999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 3.17002e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.252e-05 [cse]: 2.684e-05 [replace_applicator]: 7.30998e-06 [py_interpret_to_execute_after_opt_a]: 2.273e-05 [rewriter_after_opt_a]: 5.622e-05 [convert_after_rewriter]: 8.19002e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00090958 [jit_opt_b]: 6.67e-05, [1] [Cycle 1]: 5.728e-05, [2] [frontend_op_eliminate]: 2.217e-05 [inline_after_opt_a]: 2.129e-05 [cconv]: 3.501e-05 [loop_unroll]: 0.00056467 [jit_opt_after_cconv]: 0.0002054, [1] [Cycle 1]: 0.00019766, [11] [c_1]: 2.929e-05 [parameter_eliminate]: 4.67e-06 [updatestate_depend_eliminate]: 1.012e-05 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.93e-06 [cse]: 3.805e-05 [call_graph_tuple_transform]: 3.007e-05 [tuple_list_get_item_eliminator]: 7.39002e-06 [none_parameter_eliminate]: 2.32001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.46999e-06 [remove_dup_value]: 2.059e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 1.125e-05 [add_recomputation]: 6.302e-05 [cse_after_recomputation]: 3.448e-05, [1] [Cycle 1]: 2.662e-05, [1] [cse]: 1.706e-05 [auto_monad_reorder]: 1.948e-05 [get_jit_bprop_graph]: 3.03e-06 [rewriter_after_jit_bprop_graph]: 7.9e-06 [opt_after_jit_grad]: 0.00061814 [symbol_engine_optimizer]: 9.742e-05, [1] [Cycle 1]: 8.956e-05, [6] [build]: 6.51e-06 [elim_shapecalc]: 1.045e-05 [elim_not_effective]: 1.831e-05 [opt_reshape]: 7.3e-06 [fold_const_symbol]: 1.289e-05 [renormalize]: 3.19997e-07 [validate]: 6.436e-05 Sums bootstrap : 0.000368s : 0.08% type_inference : 0.447788s : 96.92% event_method : 0.000030s : 0.01% auto_monad : 0.000085s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000917s : 0.20% rewriter_before_opt_a : 0.000150s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000112s : 0.02% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000903s : 0.20% jit_opt_a.with_stream_mark : 0.000046s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000140s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.01% jit_opt_a.merge_forward : 0.000013s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.00% jit_opt_a.renormalize : 0.008368s : 1.81% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000072s : 0.02% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000023s : 0.00% rewriter_after_opt_a : 0.000056s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000910s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.00% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000035s : 0.01% loop_unroll : 0.000565s : 0.12% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000021s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000063s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000618s : 0.13% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000064s : 0.01% Time group info: ------[substitution.] 0.000334 24 0.93% : 0.000003s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.16% : 0.000007s : 4: substitution.graph_param_transform 86.93% : 0.000291s : 4: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000006s : 4: substitution.remove_not_recompute_node 2.24% : 0.000007s : 2: substitution.replace_old_param 4.19% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.447655 2 98.62% : 0.441488s : 1: type_inference.infer 1.38% : 0.006167s : 1: type_inference.specialize ------[replace.] 0.000114 6 71.48% : 0.000082s : 4: replace.inline 28.52% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000301 6 95.70% : 0.000288s : 4: match.inline 4.30% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.50% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000002s : 12: predicate.addn_check_dump 2.07% : 0.000003s : 12: predicate.addn_zero_filter 1.72% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 0.94% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.02% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.73% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.91% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_depend_swap 1.00% : 0.000002s : 12: predicate.environ_get_eliminate 0.92% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.35% : 0.000001s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000008s : 26: predicate.inline 1.14% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.67% : 0.000003s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 18: predicate.load_eliminater 2.12% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 0.98% : 0.000002s : 12: predicate.minmaximum_grad 2.12% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 1.90% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.59% : 0.000001s : 4: predicate.reset_defer_inline 1.14% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000002s : 8: predicate.specialize_transform 1.25% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.99% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.45% : 0.000012s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.04% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.12% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003358 22 59.47% : 0.001997s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.75% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.78% : 0.001302s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.477877 72 0.01% : 0.000068s : 1: add_recomputation 0.02% : 0.000091s : 1: auto_monad 0.00% : 0.000023s : 1: auto_monad_reorder 0.08% : 0.000398s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000037s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.30% : 0.015765s : 1: jit_opt_a 0.04% : 0.000209s : 1: jit_opt_after_cconv 0.01% : 0.000070s : 1: jit_opt_b 0.12% : 0.000578s : 1: loop_unroll 0.19% : 0.000924s : 1: mutable_eliminate 0.26% : 0.001235s : 26: opt.transform.jit_opt_a 0.01% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000631s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000928s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 1.47% : 0.007013s : 1: renormalize.infer 0.28% : 0.001339s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000061s : 1: rewriter_after_opt_a 0.03% : 0.000159s : 1: rewriter_before_opt_a 0.02% : 0.000101s : 1: symbol_engine_optimizer 93.71% : 0.447821s : 1: type_inference TotalTime = 0.0275692, [30] [bootstrap]: 0.00031548 [type_inference]: 0.0191434 [event_method]: 2.195e-05 [auto_monad]: 6.818e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 8.922e-05 [rewriter_before_opt_a]: 8.174e-05 [expand_dump_flag]: 3.37002e-06 [jit_opt_a]: 0.00546486, [2] [Cycle 1]: 0.00192037, [27] [switch_simplify]: 5.68e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00054167 [with_stream_mark]: 2.275e-05 [recompute_prepare]: 7.56001e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.10002e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.12999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.61003e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.00091706 [add_forward_monad_depend]: 6.71999e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.632e-05 [cse]: 3.636e-05 [replace_applicator]: 1.513e-05 [Cycle 2]: 0.00032476, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 4.88001e-06 [a_1]: 8.754e-05 [with_stream_mark]: 1.243e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 4.79998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.362e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.325e-05 [rewriter_after_opt_a]: 4.19e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.38002e-06 [mutable_eliminate]: 0.00065541 [jit_opt_b]: 5.149e-05, [1] [Cycle 1]: 4.441e-05, [2] [frontend_op_eliminate]: 1.636e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 3.229e-05 [loop_unroll]: 0.0004272 [jit_opt_after_cconv]: 0.00021913, [1] [Cycle 1]: 0.00021242, [11] [c_1]: 1.999e-05 [parameter_eliminate]: 4.53999e-06 [updatestate_depend_eliminate]: 8.11002e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 5.233e-05 [cse]: 3.443e-05 [call_graph_tuple_transform]: 2.286e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.586e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.29999e-06 [add_recomputation]: 5.388e-05 [cse_after_recomputation]: 2.206e-05, [1] [Cycle 1]: 1.658e-05, [1] [cse]: 1.072e-05 [auto_monad_reorder]: 1.762e-05 [get_jit_bprop_graph]: 1.292e-05 [rewriter_after_jit_bprop_graph]: 5.57001e-06 [opt_after_jit_grad]: 0.00048609 [symbol_engine_optimizer]: 7.189e-05, [1] [Cycle 1]: 6.546e-05, [6] [build]: 3.96001e-06 [elim_shapecalc]: 7.70998e-06 [elim_not_effective]: 1.288e-05 [opt_reshape]: 5.43002e-06 [fold_const_symbol]: 8.35001e-06 [renormalize]: 5.60016e-07 [validate]: 4.251e-05 Sums bootstrap : 0.000315s : 1.33% type_inference : 0.019143s : 80.59% event_method : 0.000022s : 0.09% auto_monad : 0.000068s : 0.29% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000089s : 0.38% rewriter_before_opt_a : 0.000082s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.15% jit_opt_a.a_1 : 0.000629s : 2.65% jit_opt_a.with_stream_mark : 0.000035s : 0.15% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000917s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.10% jit_opt_a.cse : 0.000050s : 0.21% jit_opt_a.replace_applicator : 0.000020s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000042s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000655s : 2.76% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000032s : 0.14% loop_unroll : 0.000427s : 1.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000052s : 0.22% jit_opt_after_cconv.cse : 0.000034s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000054s : 0.23% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000013s : 0.05% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000486s : 2.05% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.18% Time group info: ------[substitution.] 0.000226 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 84.46% : 0.000191s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 5.68% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019070 2 92.80% : 0.017698s : 1: type_inference.infer 7.20% : 0.001373s : 1: type_inference.specialize ------[replace.] 0.000067 6 69.09% : 0.000046s : 4: replace.inline 30.91% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.14% : 0.000189s : 4: match.inline 5.86% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.40% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.61% : 0.000002s : 10: predicate.arithmetic_simplify 1.12% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 7.09% : 0.000008s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.25% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000002s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.03% : 0.000001s : 6: predicate.remove_not_recompute_node 2.04% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.15% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.25% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000814 13 47.00% : 0.000383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.13% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.87% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029395 72 0.19% : 0.000056s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.15% : 0.000338s : 1: bootstrap 0.12% : 0.000035s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.05% : 0.000015s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.60% : 0.005468s : 1: jit_opt_a 0.76% : 0.000222s : 1: jit_opt_after_cconv 0.18% : 0.000054s : 1: jit_opt_b 1.48% : 0.000436s : 1: loop_unroll 2.27% : 0.000666s : 1: mutable_eliminate 2.89% : 0.000849s : 26: opt.transform.jit_opt_a 0.17% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.68% : 0.000495s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000093s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.81% : 0.000531s : 1: renormalize.infer 1.28% : 0.000378s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000045s : 1: rewriter_after_opt_a 0.29% : 0.000085s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 65.19% : 0.019162s : 1: type_inference TotalTime = 0.421745, [30] [bootstrap]: 0.00028986 [type_inference]: 0.368487 [event_method]: 2.448e-05 [auto_monad]: 7.249e-05 [graph_reusing]: 6.05002e-06 [pre_auto_parallel]: 2.35997e-06 [py_interpret_to_execute]: 0.00051419 [rewriter_before_opt_a]: 9.304e-05 [expand_dump_flag]: 3.97e-06 [jit_opt_a]: 0.0496865, [2] [Cycle 1]: 0.0454034, [27] [switch_simplify]: 6.197e-05 [loop_unroll]: 2.956e-05 [a_1]: 0.00066428 [with_stream_mark]: 2.624e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.91001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.674e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.46e-06 [renormalize]: 0.0441979 [add_forward_monad_depend]: 1.367e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.606e-05 [cse]: 3.759e-05 [replace_applicator]: 3.039e-05 [Cycle 2]: 0.00040811, [27] [switch_simplify]: 7.48e-06 [loop_unroll]: 6.81999e-06 [a_1]: 0.0001394 [with_stream_mark]: 1.477e-05 [recompute_prepare]: 5.71003e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.56002e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 5.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.033e-05 [j_node_and_user_rematch]: 1.031e-05 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 1.186e-05 [inline_without_move]: 5.47999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.201e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.787e-05 [rewriter_after_opt_a]: 3.781e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 4.887e-05 [mutable_eliminate]: 0.00077471 [jit_opt_b]: 5.791e-05, [1] [Cycle 1]: 5.094e-05, [2] [frontend_op_eliminate]: 2.026e-05 [inline_after_opt_a]: 2.003e-05 [cconv]: 2.989e-05 [loop_unroll]: 0.00041852 [jit_opt_after_cconv]: 0.000152, [1] [Cycle 1]: 0.00014579, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 2.128e-05 [call_graph_tuple_transform]: 2.115e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.566e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 8.55001e-06 [add_recomputation]: 5.603e-05 [cse_after_recomputation]: 2.749e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.199e-05 [auto_monad_reorder]: 1.527e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.75999e-06 [opt_after_jit_grad]: 0.00047085 [symbol_engine_optimizer]: 0.00017497, [1] [Cycle 1]: 0.00016863, [6] [build]: 4.38001e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.508e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 0.00010007 [renormalize]: 4.2998e-07 [validate]: 4.703e-05 Sums bootstrap : 0.000290s : 0.07% type_inference : 0.368487s : 88.32% event_method : 0.000024s : 0.01% auto_monad : 0.000072s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000514s : 0.12% rewriter_before_opt_a : 0.000093s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.02% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000804s : 0.19% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.044198s : 10.59% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000050s : 0.01% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.00% rewriter_after_opt_a : 0.000038s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000049s : 0.01% mutable_eliminate : 0.000775s : 0.19% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000030s : 0.01% loop_unroll : 0.000419s : 0.10% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000056s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000015s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000471s : 0.11% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000100s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.01% Time group info: ------[substitution.] 0.000273 24 1.45% : 0.000004s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 84.22% : 0.000230s : 4: substitution.inline 1.80% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000007s : 4: substitution.remove_not_recompute_node 2.59% : 0.000007s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.368395 2 98.97% : 0.364602s : 1: type_inference.infer 1.03% : 0.003793s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.28% : 0.000060s : 4: replace.inline 30.72% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 6 94.99% : 0.000227s : 4: match.inline 5.01% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 2.25% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 12: predicate.compare_switch_simplify 1.06% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.42% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000002s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 2.18% : 0.000003s : 12: predicate.reduce_eliminate 1.72% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 1.11% : 0.000002s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.65% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.90% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.043079 22 3.69% : 0.001589s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.13% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 96.18% : 0.041435s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.467161 72 0.01% : 0.000059s : 1: add_recomputation 0.02% : 0.000076s : 1: auto_monad 0.00% : 0.000018s : 1: auto_monad_reorder 0.07% : 0.000308s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 10.64% : 0.049690s : 1: jit_opt_a 0.03% : 0.000155s : 1: jit_opt_after_cconv 0.01% : 0.000060s : 1: jit_opt_b 0.09% : 0.000426s : 1: loop_unroll 0.17% : 0.000783s : 1: mutable_eliminate 0.23% : 0.001070s : 26: opt.transform.jit_opt_a 0.01% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000127s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000051s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000523s : 1: py_interpret_to_execute 0.00% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.55% : 0.002575s : 1: renormalize.infer 8.91% : 0.041610s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000041s : 1: rewriter_after_opt_a 0.02% : 0.000098s : 1: rewriter_before_opt_a 0.04% : 0.000177s : 1: symbol_engine_optimizer 78.88% : 0.368511s : 1: type_inference TotalTime = 0.142393, [30] [bootstrap]: 0.00036419 [type_inference]: 0.126739 [event_method]: 2.69e-05 [auto_monad]: 8.905e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 0.0009537 [rewriter_before_opt_a]: 0.00011752 [expand_dump_flag]: 4.15999e-06 [jit_opt_a]: 0.0113479, [2] [Cycle 1]: 0.00689981, [27] [switch_simplify]: 7.309e-05 [loop_unroll]: 3.15e-05 [a_1]: 0.00072083 [with_stream_mark]: 2.403e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.98001e-06 [updatestate_useless_node_eliminater]: 7.26001e-06 [accelerated_algorithm]: 8.75001e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 8.01001e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.854e-05 [j_node_and_user_rematch]: 1.181e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.162e-05 [inline_without_move]: 6.93e-06 [renormalize]: 0.00559677 [add_forward_monad_depend]: 1.129e-05 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 2.278e-05 [cse]: 4.3e-05 [replace_applicator]: 2.782e-05 [Cycle 2]: 0.00044307, [27] [switch_simplify]: 9.04998e-06 [loop_unroll]: 7.48999e-06 [a_1]: 0.00014795 [with_stream_mark]: 1.699e-05 [recompute_prepare]: 6.95998e-06 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.10002e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 5.17999e-06 [cell_reuse_recompute_pass]: 3.59002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.132e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.87002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.646e-05 [replace_applicator]: 6.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.894e-05 [rewriter_after_opt_a]: 4.534e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00083263 [jit_opt_b]: 0.00013131, [1] [Cycle 1]: 0.00012194, [2] [frontend_op_eliminate]: 8.633e-05 [inline_after_opt_a]: 1.967e-05 [cconv]: 3.104e-05 [loop_unroll]: 0.00048315 [jit_opt_after_cconv]: 0.00017453, [1] [Cycle 1]: 0.00016609, [11] [c_1]: 2.708e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 6.94001e-06 [updatestate_assign_eliminate]: 4.65001e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.077e-05 [call_graph_tuple_transform]: 2.422e-05 [tuple_list_get_item_eliminator]: 6.91001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.59001e-06 [remove_dup_value]: 1.768e-05 [partial_unused_args_eliminate]: 2.08002e-06 [environ_conv]: 1.103e-05 [add_recomputation]: 5.224e-05 [cse_after_recomputation]: 2.643e-05, [1] [Cycle 1]: 1.922e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 6.83e-06 [opt_after_jit_grad]: 0.00049018 [symbol_engine_optimizer]: 9.059e-05, [1] [Cycle 1]: 8.419e-05, [6] [build]: 3.99002e-06 [elim_shapecalc]: 9.07001e-06 [elim_not_effective]: 1.746e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 1.503e-05 [renormalize]: 4.39992e-07 [validate]: 6.041e-05 Sums bootstrap : 0.000364s : 0.26% type_inference : 0.126739s : 92.06% event_method : 0.000027s : 0.02% auto_monad : 0.000089s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000954s : 0.69% rewriter_before_opt_a : 0.000118s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000869s : 0.63% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.005597s : 4.07% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000059s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000833s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000086s : 0.06% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000483s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000490s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.04% Time group info: ------[substitution.] 0.000303 24 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000007s : 4: substitution.graph_param_transform 85.83% : 0.000260s : 4: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000008s : 4: substitution.remove_not_recompute_node 2.12% : 0.000006s : 2: substitution.replace_old_param 4.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126560 2 96.05% : 0.121557s : 1: type_inference.infer 3.95% : 0.005003s : 1: type_inference.specialize ------[replace.] 0.000116 6 69.62% : 0.000081s : 4: replace.inline 30.38% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000270 6 95.21% : 0.000257s : 4: match.inline 4.79% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 0.79% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.31% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.50% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.85% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 18: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.38% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.49% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.64% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.61% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003312 22 55.71% : 0.001845s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.83% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.47% : 0.001406s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149276 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000092s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.26% : 0.000389s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.61% : 0.011353s : 1: jit_opt_a 0.12% : 0.000177s : 1: jit_opt_after_cconv 0.09% : 0.000134s : 1: jit_opt_b 0.33% : 0.000492s : 1: loop_unroll 0.56% : 0.000843s : 1: mutable_eliminate 0.78% : 0.001164s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000098s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.65% : 0.000964s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.65% : 0.003957s : 1: renormalize.infer 1.09% : 0.001625s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000125s : 1: rewriter_before_opt_a 0.06% : 0.000096s : 1: symbol_engine_optimizer 84.92% : 0.126772s : 1: type_inference TotalTime = 0.0125963, [30] [bootstrap]: 0.00026449 [type_inference]: 0.00437612 [event_method]: 1.814e-05 [auto_monad]: 6.446e-05 [graph_reusing]: 6.16998e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 3.463e-05 [rewriter_before_opt_a]: 7.547e-05 [expand_dump_flag]: 2.98998e-06 [jit_opt_a]: 0.00535634, [2] [Cycle 1]: 0.00171535, [27] [switch_simplify]: 5.975e-05 [loop_unroll]: 2.948e-05 [a_1]: 0.0005445 [with_stream_mark]: 2.378e-05 [recompute_prepare]: 1.044e-05 [updatestate_depend_eliminate]: 4.44998e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 9.21002e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.75002e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.00068998 [add_forward_monad_depend]: 6.24001e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.649e-05 [cse]: 3.547e-05 [replace_applicator]: 1.481e-05 [Cycle 2]: 0.00032322, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 4.84e-06 [a_1]: 8.73e-05 [with_stream_mark]: 1.146e-05 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.49998e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 5.86998e-06 [cse]: 1.322e-05 [replace_applicator]: 5.51e-06 [py_interpret_to_execute_after_opt_a]: 1.228e-05 [rewriter_after_opt_a]: 4.05e-05 [convert_after_rewriter]: 0.00016615 [order_py_execute_after_rewriter]: 7.39002e-06 [mutable_eliminate]: 0.00058013 [jit_opt_b]: 4.963e-05, [1] [Cycle 1]: 4.221e-05, [2] [frontend_op_eliminate]: 1.539e-05 [inline_after_opt_a]: 1.577e-05 [cconv]: 3.089e-05 [loop_unroll]: 0.00041992 [jit_opt_after_cconv]: 0.00015125, [1] [Cycle 1]: 0.00014455, [11] [c_1]: 1.981e-05 [parameter_eliminate]: 3.2e-06 [updatestate_depend_eliminate]: 7.38999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.877e-05 [call_graph_tuple_transform]: 1.926e-05 [tuple_list_get_item_eliminator]: 5.20999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 5.05001e-06 [remove_dup_value]: 1.635e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 6.20002e-06 [add_recomputation]: 5.651e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 1.936e-05, [1] [cse]: 1.326e-05 [auto_monad_reorder]: 1.912e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 6.14999e-06 [opt_after_jit_grad]: 0.00049154 [symbol_engine_optimizer]: 7.565e-05, [1] [Cycle 1]: 6.792e-05, [6] [build]: 5.30999e-06 [elim_shapecalc]: 7.57002e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 5.63002e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 3.49974e-07 [validate]: 4.612e-05 Sums bootstrap : 0.000264s : 3.05% type_inference : 0.004376s : 50.52% event_method : 0.000018s : 0.21% auto_monad : 0.000064s : 0.74% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.40% rewriter_before_opt_a : 0.000075s : 0.87% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.76% jit_opt_a.loop_unroll : 0.000034s : 0.40% jit_opt_a.a_1 : 0.000632s : 7.29% jit_opt_a.with_stream_mark : 0.000035s : 0.41% jit_opt_a.recompute_prepare : 0.000015s : 0.18% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000012s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000690s : 7.97% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.26% jit_opt_a.cse : 0.000049s : 0.56% jit_opt_a.replace_applicator : 0.000020s : 0.23% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000041s : 0.47% convert_after_rewriter : 0.000166s : 1.92% order_py_execute_after_rewriter : 0.000007s : 0.09% mutable_eliminate : 0.000580s : 6.70% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000031s : 0.36% loop_unroll : 0.000420s : 4.85% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000029s : 0.33% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000057s : 0.65% cse_after_recomputation.cse : 0.000013s : 0.15% auto_monad_reorder : 0.000019s : 0.22% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000492s : 5.67% symbol_engine_optimizer.build : 0.000005s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.53% Time group info: ------[substitution.] 0.000222 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.47% : 0.000005s : 3: substitution.graph_param_transform 84.43% : 0.000187s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.95% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004316 2 82.18% : 0.003547s : 1: type_inference.infer 17.82% : 0.000769s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.29% : 0.000046s : 4: replace.inline 31.71% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.82% : 0.000185s : 4: match.inline 6.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.23% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 6.10% : 0.000007s : 22: predicate.inline 1.23% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.98% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.52% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.91% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.31% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.08% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000616 13 53.27% : 0.000328s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.53% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.20% : 0.000242s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014185 72 0.42% : 0.000060s : 1: add_recomputation 0.48% : 0.000067s : 1: auto_monad 0.15% : 0.000022s : 1: auto_monad_reorder 2.00% : 0.000284s : 1: bootstrap 0.24% : 0.000033s : 1: cconv 1.22% : 0.000173s : 1: convert_after_rewriter 0.20% : 0.000028s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.78% : 0.005359s : 1: jit_opt_a 1.09% : 0.000154s : 1: jit_opt_after_cconv 0.37% : 0.000052s : 1: jit_opt_b 3.02% : 0.000428s : 1: loop_unroll 4.16% : 0.000590s : 1: mutable_eliminate 6.02% : 0.000854s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000015s : 1: opt.transform.mutable_eliminate 0.18% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000504s : 1: opt_after_jit_grad 0.07% : 0.000010s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000037s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.70% : 0.000384s : 1: renormalize.infer 2.10% : 0.000298s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.31% : 0.000044s : 1: rewriter_after_opt_a 0.55% : 0.000078s : 1: rewriter_before_opt_a 0.55% : 0.000078s : 1: symbol_engine_optimizer 30.95% : 0.004391s : 1: type_inference TotalTime = 0.428591, [30] [bootstrap]: 0.00039032 [type_inference]: 0.384225 [event_method]: 2.26e-05 [auto_monad]: 7.148e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00046425 [rewriter_before_opt_a]: 9.77e-05 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.0406142, [2] [Cycle 1]: 0.00420158, [27] [switch_simplify]: 7.49e-05 [loop_unroll]: 3.529e-05 [a_1]: 0.00077688 [with_stream_mark]: 2.439e-05 [recompute_prepare]: 9.81998e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.25002e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 8.06001e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.85002e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 7.35998e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00291313 [add_forward_monad_depend]: 7.38e-06 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 1.778e-05 [cse]: 3.674e-05 [replace_applicator]: 1.688e-05 [Cycle 2]: 0.00038845, [27] [switch_simplify]: 7.1e-06 [loop_unroll]: 6.86001e-06 [a_1]: 0.00013263 [with_stream_mark]: 1.275e-05 [recompute_prepare]: 6.34001e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 8.58001e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.355e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.684e-05 [rewriter_after_opt_a]: 4.17e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00077989 [jit_opt_b]: 6.414e-05, [1] [Cycle 1]: 5.471e-05, [2] [frontend_op_eliminate]: 2.185e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 3.363e-05 [loop_unroll]: 0.00046353 [jit_opt_after_cconv]: 0.00017195, [1] [Cycle 1]: 0.00016478, [11] [c_1]: 2.646e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 9.78998e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 3.025e-05 [call_graph_tuple_transform]: 2.55e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 2.16e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.71e-06 [remove_dup_value]: 1.898e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 9.94001e-06 [add_recomputation]: 5.231e-05 [cse_after_recomputation]: 2.535e-05, [1] [Cycle 1]: 2.01e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 2.017e-05 [get_jit_bprop_graph]: 2.38002e-06 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.00051278 [symbol_engine_optimizer]: 0.00019766, [1] [Cycle 1]: 7.692e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 9.34e-06 [elim_not_effective]: 1.728e-05 [opt_reshape]: 8.67998e-06 [fold_const_symbol]: 9.49999e-06 [renormalize]: 4.00003e-07 [validate]: 5.481e-05 Sums bootstrap : 0.000390s : 0.10% type_inference : 0.384225s : 98.06% event_method : 0.000023s : 0.01% auto_monad : 0.000071s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000464s : 0.12% rewriter_before_opt_a : 0.000098s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000910s : 0.23% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002913s : 0.74% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000050s : 0.01% jit_opt_a.replace_applicator : 0.000023s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000780s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000034s : 0.01% loop_unroll : 0.000464s : 0.12% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000052s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000513s : 0.13% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.01% Time group info: ------[substitution.] 0.000316 25 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000007s : 4: substitution.graph_param_transform 88.12% : 0.000279s : 5: substitution.inline 1.44% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.25% : 0.000004s : 2: substitution.replace_old_param 4.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.384143 2 99.25% : 0.381259s : 1: type_inference.infer 0.75% : 0.002884s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.64% : 0.000074s : 5: replace.inline 31.36% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000288 7 95.73% : 0.000276s : 5: match.inline 4.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.45% : 0.000002s : 13: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.32% : 0.000002s : 13: predicate.addn_check_dump 1.51% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.58% : 0.000009s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.28% : 0.000002s : 13: predicate.merge_addn 1.28% : 0.000002s : 13: predicate.minmaximum_grad 1.78% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.72% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 20: predicate.switch_defer_inline 1.90% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.45% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.91% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002690 25 69.60% : 0.001872s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.54% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.86% : 0.000723s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.432748 72 0.01% : 0.000055s : 1: add_recomputation 0.02% : 0.000075s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.10% : 0.000412s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 9.39% : 0.040618s : 1: jit_opt_a 0.04% : 0.000175s : 1: jit_opt_after_cconv 0.02% : 0.000067s : 1: jit_opt_b 0.11% : 0.000472s : 1: loop_unroll 0.18% : 0.000790s : 1: mutable_eliminate 0.27% : 0.001179s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000471s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.49% : 0.002123s : 1: renormalize.infer 0.18% : 0.000780s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000045s : 1: rewriter_after_opt_a 0.02% : 0.000102s : 1: rewriter_before_opt_a 0.05% : 0.000201s : 1: symbol_engine_optimizer 88.79% : 0.384245s : 1: type_inference TotalTime = 0.0409443, [30] [bootstrap]: 0.0002992 [type_inference]: 0.0087429 [event_method]: 1.828e-05 [auto_monad]: 6.467e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 3.71e-05 [rewriter_before_opt_a]: 7.257e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00523417, [2] [Cycle 1]: 0.00165135, [27] [switch_simplify]: 5.191e-05 [loop_unroll]: 2.955e-05 [a_1]: 0.00052518 [with_stream_mark]: 1.794e-05 [recompute_prepare]: 8.38999e-06 [updatestate_depend_eliminate]: 3.87998e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.0007061 [add_forward_monad_depend]: 5.07999e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.538e-05 [cse]: 2.668e-05 [replace_applicator]: 1.31e-05 [Cycle 2]: 0.00031365, [27] [switch_simplify]: 6.00002e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.089e-05 [with_stream_mark]: 8.94e-06 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 2.51e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 8.18001e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 7.43999e-06 [inline_without_move]: 4.67998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 5.39e-06 [cse]: 1.02e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.029e-05 [rewriter_after_opt_a]: 3.276e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.0005317 [jit_opt_b]: 4.844e-05, [1] [Cycle 1]: 4.144e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.536e-05 [cconv]: 2.555e-05 [loop_unroll]: 0.00041471 [jit_opt_after_cconv]: 0.00015281, [1] [Cycle 1]: 0.00014614, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 1.687e-05 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 1.841e-05 [call_graph_tuple_transform]: 1.952e-05 [tuple_list_get_item_eliminator]: 5.51998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.478e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 5.82999e-06 [add_recomputation]: 4.797e-05 [cse_after_recomputation]: 2.203e-05, [1] [Cycle 1]: 1.588e-05, [1] [cse]: 9.86e-06 [auto_monad_reorder]: 1.558e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 4.70001e-06 [opt_after_jit_grad]: 0.0247628 [symbol_engine_optimizer]: 0.00010038, [1] [Cycle 1]: 8.928e-05, [6] [build]: 8.00999e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 2.331e-05 [opt_reshape]: 7.55e-06 [fold_const_symbol]: 9.64999e-06 [renormalize]: 1.16002e-06 [validate]: 5.343e-05 Sums bootstrap : 0.000299s : 0.81% type_inference : 0.008743s : 23.59% event_method : 0.000018s : 0.05% auto_monad : 0.000065s : 0.17% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000037s : 0.10% rewriter_before_opt_a : 0.000073s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000616s : 1.66% jit_opt_a.with_stream_mark : 0.000027s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000706s : 1.91% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000037s : 0.10% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000033s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000532s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000026s : 0.07% loop_unroll : 0.000415s : 1.12% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000017s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000018s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.13% cse_after_recomputation.cse : 0.000010s : 0.03% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.024763s : 66.80% symbol_engine_optimizer.build : 0.000008s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.14% Time group info: ------[substitution.] 0.000198 23 1.43% : 0.000003s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 3: substitution.graph_param_transform 82.64% : 0.000163s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000004s : 2: substitution.replace_old_param 5.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008682 2 90.12% : 0.007825s : 1: type_inference.infer 9.88% : 0.000858s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.42% : 0.000042s : 4: replace.inline 33.58% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.79% : 0.000161s : 4: match.inline 6.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 3.85% : 0.000005s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.46% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 2.65% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.70% : 0.000001s : 3: predicate.elim_not_effective 0.85% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.88% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.28% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.78% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000685 13 54.66% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.22% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.12% : 0.000275s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042554 72 0.12% : 0.000051s : 1: add_recomputation 0.16% : 0.000069s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.75% : 0.000318s : 1: bootstrap 0.07% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.31% : 0.005238s : 1: jit_opt_a 0.37% : 0.000155s : 1: jit_opt_after_cconv 0.12% : 0.000051s : 1: jit_opt_b 0.99% : 0.000422s : 1: loop_unroll 1.27% : 0.000541s : 1: mutable_eliminate 1.94% : 0.000825s : 26: opt.transform.jit_opt_a 0.11% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000059s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000046s : 4: opt.transform.symbol_engine_opt 58.26% : 0.024790s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000040s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 0.88% : 0.000376s : 1: renormalize.infer 0.76% : 0.000322s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000036s : 1: rewriter_after_opt_a 0.18% : 0.000075s : 1: rewriter_before_opt_a 0.25% : 0.000104s : 1: symbol_engine_optimizer 20.58% : 0.008759s : 1: type_inference TotalTime = 0.0760027, [30] [bootstrap]: 0.00089947 [type_inference]: 0.0128882 [event_method]: 2.516e-05 [auto_monad]: 7.297e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.45002e-06 [py_interpret_to_execute]: 0.00012057 [rewriter_before_opt_a]: 0.00010102 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.0595707, [2] [Cycle 1]: 0.00233959, [27] [switch_simplify]: 7.458e-05 [loop_unroll]: 3.642e-05 [a_1]: 0.00075532 [with_stream_mark]: 2.192e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.415e-05 [j_node_and_user_rematch]: 9.03002e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 5.57999e-06 [renormalize]: 0.00109623 [add_forward_monad_depend]: 1.088e-05 [auto_monad_grad]: 2.48002e-06 [auto_monad_eliminator]: 1.437e-05 [cse]: 3.537e-05 [replace_applicator]: 1.282e-05 [Cycle 2]: 0.00032142, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.048e-05 [with_stream_mark]: 1.04e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.3e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.4e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.282e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.387e-05 [rewriter_after_opt_a]: 3.835e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.0006294 [jit_opt_b]: 5.276e-05, [1] [Cycle 1]: 4.59e-05, [2] [frontend_op_eliminate]: 1.732e-05 [inline_after_opt_a]: 1.845e-05 [cconv]: 2.68e-05 [loop_unroll]: 0.00042669 [jit_opt_after_cconv]: 0.00017018, [1] [Cycle 1]: 0.00016356, [11] [c_1]: 2.1e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 7.36001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 2.676e-05 [call_graph_tuple_transform]: 1.927e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.32999e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.757e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 9.22999e-06 [add_recomputation]: 5.339e-05 [cse_after_recomputation]: 2.404e-05, [1] [Cycle 1]: 1.88e-05, [1] [cse]: 1.281e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 7.30003e-06 [opt_after_jit_grad]: 0.00047972 [symbol_engine_optimizer]: 8.249e-05, [1] [Cycle 1]: 7.63e-05, [6] [build]: 9.31e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.475e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 9.69e-06 [renormalize]: 4.10015e-07 [validate]: 4.795e-05 Sums bootstrap : 0.000899s : 4.87% type_inference : 0.012888s : 69.81% event_method : 0.000025s : 0.14% auto_monad : 0.000073s : 0.40% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000121s : 0.65% rewriter_before_opt_a : 0.000101s : 0.55% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000080s : 0.44% jit_opt_a.loop_unroll : 0.000042s : 0.22% jit_opt_a.a_1 : 0.000846s : 4.58% jit_opt_a.with_stream_mark : 0.000032s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.09% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001096s : 5.94% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.11% jit_opt_a.cse : 0.000048s : 0.26% jit_opt_a.replace_applicator : 0.000018s : 0.10% py_interpret_to_execute_after_opt_a : 0.000014s : 0.08% rewriter_after_opt_a : 0.000038s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000629s : 3.41% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.09% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000027s : 0.15% loop_unroll : 0.000427s : 2.31% jit_opt_after_cconv.c_1 : 0.000021s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000018s : 0.10% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.05% add_recomputation : 0.000053s : 0.29% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000480s : 2.60% symbol_engine_optimizer.build : 0.000009s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.26% Time group info: ------[substitution.] 0.000311 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 1.70% : 0.000005s : 3: substitution.graph_param_transform 88.40% : 0.000275s : 5: substitution.inline 0.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.34% : 0.000004s : 4: substitution.remove_not_recompute_node 1.72% : 0.000005s : 2: substitution.replace_old_param 4.82% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012798 2 87.69% : 0.011222s : 1: type_inference.infer 12.31% : 0.001575s : 1: type_inference.specialize ------[replace.] 0.000115 8 65.07% : 0.000075s : 5: replace.inline 34.93% : 0.000040s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000285 8 95.33% : 0.000272s : 5: match.inline 4.67% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 810 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.47% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000008s : 26: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.18% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 15: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 21: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 20: predicate.switch_defer_inline 2.30% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.03% : 0.000011s : 64: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.58% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001163 16 51.42% : 0.000598s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.57% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.01% : 0.000477s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.078228 72 0.07% : 0.000057s : 1: add_recomputation 0.10% : 0.000077s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 1.18% : 0.000921s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 76.15% : 0.059574s : 1: jit_opt_a 0.22% : 0.000173s : 1: jit_opt_after_cconv 0.07% : 0.000055s : 1: jit_opt_b 0.56% : 0.000435s : 1: loop_unroll 0.82% : 0.000639s : 1: mutable_eliminate 1.39% : 0.001086s : 26: opt.transform.jit_opt_a 0.06% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000125s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.81% : 0.000636s : 1: renormalize.infer 0.58% : 0.000451s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000105s : 1: rewriter_before_opt_a 0.11% : 0.000085s : 1: symbol_engine_optimizer 16.50% : 0.012911s : 1: type_inference TotalTime = 0.0626621, [30] [bootstrap]: 0.00035851 [type_inference]: 0.0533135 [event_method]: 2.186e-05 [auto_monad]: 8.18e-05 [graph_reusing]: 6.68998e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 9.475e-05 [rewriter_before_opt_a]: 8.347e-05 [expand_dump_flag]: 3.35003e-06 [jit_opt_a]: 0.0061296, [2] [Cycle 1]: 0.00240116, [27] [switch_simplify]: 6.123e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00088914 [with_stream_mark]: 2.553e-05 [recompute_prepare]: 9.59999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.54e-06 [renormalize]: 0.00101389 [add_forward_monad_depend]: 6.88e-06 [auto_monad_grad]: 2.58998e-06 [auto_monad_eliminator]: 1.747e-05 [cse]: 3.8e-05 [replace_applicator]: 1.561e-05 [Cycle 2]: 0.00033178, [27] [switch_simplify]: 5.78002e-06 [loop_unroll]: 4.84e-06 [a_1]: 8.767e-05 [with_stream_mark]: 1.182e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 3.14001e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 4.97999e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 5.54e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 7.65e-06 [cse]: 1.556e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 1.558e-05 [rewriter_after_opt_a]: 4.198e-05 [convert_after_rewriter]: 8.06001e-06 [order_py_execute_after_rewriter]: 6.00002e-06 [mutable_eliminate]: 0.0006575 [jit_opt_b]: 8.273e-05, [1] [Cycle 1]: 7.176e-05, [2] [frontend_op_eliminate]: 1.614e-05 [inline_after_opt_a]: 1.593e-05 [cconv]: 2.955e-05 [loop_unroll]: 0.00049953 [jit_opt_after_cconv]: 0.00015707, [1] [Cycle 1]: 0.00014861, [11] [c_1]: 2.154e-05 [parameter_eliminate]: 2.74999e-06 [updatestate_depend_eliminate]: 7.51999e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.788e-05 [call_graph_tuple_transform]: 1.948e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 2.14e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.676e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 6.64999e-06 [add_recomputation]: 0.00010948 [cse_after_recomputation]: 2.53e-05, [1] [Cycle 1]: 2.01e-05, [1] [cse]: 1.322e-05 [auto_monad_reorder]: 1.937e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 8.05e-06 [opt_after_jit_grad]: 0.00053821 [symbol_engine_optimizer]: 8.006e-05, [1] [Cycle 1]: 7.175e-05, [6] [build]: 5.12999e-06 [elim_shapecalc]: 7.26001e-06 [elim_not_effective]: 1.487e-05 [opt_reshape]: 6.30002e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 3.39991e-07 [validate]: 4.487e-05 Sums bootstrap : 0.000359s : 0.61% type_inference : 0.053313s : 91.02% event_method : 0.000022s : 0.04% auto_monad : 0.000082s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000095s : 0.16% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000977s : 1.67% jit_opt_a.with_stream_mark : 0.000037s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001014s : 1.73% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000054s : 0.09% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000042s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000658s : 1.12% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000030s : 0.05% loop_unroll : 0.000500s : 0.85% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000109s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000538s : 0.92% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.000266 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 3: substitution.graph_param_transform 86.34% : 0.000230s : 4: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 5.20% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053237 2 97.19% : 0.051743s : 1: type_inference.infer 2.81% : 0.001494s : 1: type_inference.specialize ------[replace.] 0.000084 6 69.53% : 0.000058s : 4: replace.inline 30.47% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 94.70% : 0.000227s : 4: match.inline 5.30% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.00% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.53% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000008s : 22: predicate.inline 1.11% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.24% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.29% : 0.000003s : 15: predicate.load_eliminater 2.53% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.51% : 0.000003s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.91% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.10% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 0.99% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.22% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.16% : 0.000004s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000010s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.03% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.77% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.30% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000869 13 46.89% : 0.000407s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.26% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.85% : 0.000407s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064935 72 0.17% : 0.000113s : 1: add_recomputation 0.13% : 0.000085s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.58% : 0.000377s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000017s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.44% : 0.006133s : 1: jit_opt_a 0.25% : 0.000160s : 1: jit_opt_after_cconv 0.13% : 0.000086s : 1: jit_opt_b 0.79% : 0.000513s : 1: loop_unroll 1.03% : 0.000669s : 1: mutable_eliminate 1.85% : 0.001203s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.85% : 0.000550s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000098s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.92% : 0.000597s : 1: renormalize.infer 0.63% : 0.000408s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000046s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.13% : 0.000083s : 1: symbol_engine_optimizer 82.13% : 0.053332s : 1: type_inference TotalTime = 0.281187, [30] [bootstrap]: 0.00040615 [type_inference]: 0.26516 [event_method]: 2.786e-05 [auto_monad]: 8.88e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.0006496 [rewriter_before_opt_a]: 0.00011124 [expand_dump_flag]: 5.39e-06 [jit_opt_a]: 0.0116646, [2] [Cycle 1]: 0.00677191, [27] [switch_simplify]: 7.803e-05 [loop_unroll]: 3.386e-05 [a_1]: 0.00072579 [with_stream_mark]: 3.132e-05 [recompute_prepare]: 1.121e-05 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.55997e-06 [specialize_transform]: 8.12e-06 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 7.52002e-06 [meta_shard_fg_expand]: 3.97e-06 [get_grad_eliminate_]: 6.73998e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.864e-05 [j_node_and_user_rematch]: 1.185e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.133e-05 [inline_without_move]: 2.042e-05 [renormalize]: 0.00542283 [add_forward_monad_depend]: 1.181e-05 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 2.255e-05 [cse]: 4.36e-05 [replace_applicator]: 2.54e-05 [Cycle 2]: 0.00044224, [27] [switch_simplify]: 8.15999e-06 [loop_unroll]: 6.60997e-06 [a_1]: 0.00013076 [with_stream_mark]: 1.659e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 3.38999e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 4.98001e-06 [cell_reuse_recompute_pass]: 2.59999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.032e-05 [j_node_and_user_rematch]: 1.071e-05 [meta_fg_expand]: 3.12002e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 6.60002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.53e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 1.128e-05 [cse]: 2.075e-05 [replace_applicator]: 8.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.805e-05 [rewriter_after_opt_a]: 5.209e-05 [convert_after_rewriter]: 7.85e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00081095 [jit_opt_b]: 6.102e-05, [1] [Cycle 1]: 5.314e-05, [2] [frontend_op_eliminate]: 2.124e-05 [inline_after_opt_a]: 2.053e-05 [cconv]: 3.177e-05 [loop_unroll]: 0.00055595 [jit_opt_after_cconv]: 0.00018151, [1] [Cycle 1]: 0.00017463, [11] [c_1]: 2.85e-05 [parameter_eliminate]: 4.14002e-06 [updatestate_depend_eliminate]: 8.26002e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 3.355e-05 [call_graph_tuple_transform]: 2.497e-05 [tuple_list_get_item_eliminator]: 7.76001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.96999e-06 [remove_dup_value]: 1.973e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.054e-05 [add_recomputation]: 6.112e-05 [cse_after_recomputation]: 4.589e-05, [1] [Cycle 1]: 3.799e-05, [1] [cse]: 1.487e-05 [auto_monad_reorder]: 2.06e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 7.48e-06 [opt_after_jit_grad]: 0.00057197 [symbol_engine_optimizer]: 0.00028437, [1] [Cycle 1]: 0.00012199, [6] [build]: 5.15001e-06 [elim_shapecalc]: 1.236e-05 [elim_not_effective]: 1.649e-05 [opt_reshape]: 8.87999e-06 [fold_const_symbol]: 1.036e-05 [renormalize]: 3.624e-05 [validate]: 7.03e-05 Sums bootstrap : 0.000406s : 0.15% type_inference : 0.265160s : 96.14% event_method : 0.000028s : 0.01% auto_monad : 0.000089s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000650s : 0.24% rewriter_before_opt_a : 0.000111s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000857s : 0.31% jit_opt_a.with_stream_mark : 0.000048s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000027s : 0.01% jit_opt_a.renormalize : 0.005423s : 1.97% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.01% jit_opt_a.cse : 0.000064s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000052s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000811s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000556s : 0.20% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000061s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000572s : 0.21% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000036s : 0.01% validate : 0.000070s : 0.03% Time group info: ------[substitution.] 0.000299 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000007s : 4: substitution.graph_param_transform 85.11% : 0.000255s : 4: substitution.inline 1.74% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000006s : 4: substitution.remove_not_recompute_node 2.03% : 0.000006s : 2: substitution.replace_old_param 5.14% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.265030 2 98.30% : 0.260534s : 1: type_inference.infer 1.70% : 0.004496s : 1: type_inference.specialize ------[replace.] 0.000116 6 62.13% : 0.000072s : 4: replace.inline 37.87% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 6 94.71% : 0.000251s : 4: match.inline 5.29% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.07% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000003s : 12: predicate.arithmetic_simplify 1.09% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.35% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.08% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 4.94% : 0.000007s : 26: predicate.inline 1.26% : 0.000002s : 8: predicate.inline_without_move 0.57% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 18: predicate.load_eliminater 2.45% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 2.31% : 0.000003s : 4: predicate.mutable_eliminate 1.07% : 0.000002s : 4: predicate.opt_reshape 2.58% : 0.000004s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 22: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.04% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.00% : 0.000001s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 18: predicate.switch_defer_inline 1.77% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.22% : 0.000012s : 58: predicate.switch_simplify 1.05% : 0.000002s : 12: predicate.tile_eliminate 1.11% : 0.000002s : 12: predicate.transpose_eliminate 1.25% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003547 22 59.16% : 0.002098s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.70% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.14% : 0.001388s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.287829 72 0.02% : 0.000065s : 1: add_recomputation 0.03% : 0.000092s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.15% : 0.000429s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000048s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.05% : 0.011669s : 1: jit_opt_a 0.06% : 0.000184s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.20% : 0.000568s : 1: loop_unroll 0.29% : 0.000825s : 1: mutable_eliminate 0.40% : 0.001164s : 26: opt.transform.jit_opt_a 0.02% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000584s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000658s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.37% : 0.003950s : 1: renormalize.infer 0.51% : 0.001457s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000056s : 1: rewriter_after_opt_a 0.04% : 0.000119s : 1: rewriter_before_opt_a 0.10% : 0.000289s : 1: symbol_engine_optimizer 92.13% : 0.265187s : 1: type_inference TotalTime = 0.0264762, [30] [bootstrap]: 0.00036013 [type_inference]: 0.00653709 [event_method]: 2.256e-05 [auto_monad]: 7.005e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.99999e-06 [py_interpret_to_execute]: 5.148e-05 [rewriter_before_opt_a]: 9.311e-05 [expand_dump_flag]: 2.88998e-06 [jit_opt_a]: 0.0171704, [2] [Cycle 1]: 0.00226081, [27] [switch_simplify]: 7.445e-05 [loop_unroll]: 3.688e-05 [a_1]: 0.00074773 [with_stream_mark]: 2.447e-05 [recompute_prepare]: 8.27e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.41998e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00103958 [add_forward_monad_depend]: 5.42001e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.405e-05 [cse]: 3.268e-05 [replace_applicator]: 1.121e-05 [Cycle 2]: 0.00032052, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 5.20001e-06 [a_1]: 8.991e-05 [with_stream_mark]: 8.55001e-06 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.29003e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.185e-05 [j_node_and_user_rematch]: 7.89002e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.63999e-06 [inline_without_move]: 5.49e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.216e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.423e-05 [rewriter_after_opt_a]: 3.728e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00056454 [jit_opt_b]: 4.861e-05, [1] [Cycle 1]: 4.189e-05, [2] [frontend_op_eliminate]: 1.596e-05 [inline_after_opt_a]: 1.511e-05 [cconv]: 2.315e-05 [loop_unroll]: 0.00043289 [jit_opt_after_cconv]: 0.00014563, [1] [Cycle 1]: 0.00013931, [11] [c_1]: 2.129e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.31e-05 [call_graph_tuple_transform]: 1.827e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.625e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 8.07e-06 [add_recomputation]: 4.879e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.777e-05, [1] [cse]: 1.207e-05 [auto_monad_reorder]: 1.81e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 4.73001e-06 [opt_after_jit_grad]: 0.00045726 [symbol_engine_optimizer]: 7.722e-05, [1] [Cycle 1]: 7.098e-05, [6] [build]: 7.19001e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.297e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 8.73001e-06 [renormalize]: 3.89991e-07 [validate]: 4.144e-05 Sums bootstrap : 0.000360s : 3.19% type_inference : 0.006537s : 57.86% event_method : 0.000023s : 0.20% auto_monad : 0.000070s : 0.62% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000051s : 0.46% rewriter_before_opt_a : 0.000093s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000080s : 0.71% jit_opt_a.loop_unroll : 0.000042s : 0.37% jit_opt_a.a_1 : 0.000838s : 7.41% jit_opt_a.with_stream_mark : 0.000033s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.001040s : 9.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.18% jit_opt_a.cse : 0.000045s : 0.40% jit_opt_a.replace_applicator : 0.000016s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.13% rewriter_after_opt_a : 0.000037s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000565s : 5.00% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000023s : 0.20% loop_unroll : 0.000433s : 3.83% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.07% add_recomputation : 0.000049s : 0.43% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000457s : 4.05% symbol_engine_optimizer.build : 0.000007s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.37% Time group info: ------[substitution.] 0.000297 25 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.70% : 0.000005s : 3: substitution.graph_param_transform 88.33% : 0.000262s : 5: substitution.inline 1.10% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.42% : 0.000004s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 4.81% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006463 2 78.14% : 0.005050s : 1: type_inference.infer 21.86% : 0.001413s : 1: type_inference.specialize ------[replace.] 0.000113 8 66.03% : 0.000075s : 5: replace.inline 33.97% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000272 8 95.30% : 0.000259s : 5: match.inline 4.70% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 810 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.39% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 15: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.57% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 21: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 20: predicate.switch_defer_inline 2.27% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.88% : 0.000011s : 64: predicate.switch_simplify 1.49% : 0.000002s : 12: predicate.tile_eliminate 1.39% : 0.000002s : 12: predicate.transpose_eliminate 1.57% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.94% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000981 16 48.79% : 0.000479s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.78% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.42% : 0.000416s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028640 72 0.18% : 0.000052s : 1: add_recomputation 0.26% : 0.000074s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.33% : 0.000380s : 1: bootstrap 0.09% : 0.000026s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.09% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 59.97% : 0.017175s : 1: jit_opt_a 0.52% : 0.000148s : 1: jit_opt_after_cconv 0.18% : 0.000051s : 1: jit_opt_b 1.54% : 0.000441s : 1: loop_unroll 2.00% : 0.000574s : 1: mutable_eliminate 3.76% : 0.001078s : 26: opt.transform.jit_opt_a 0.17% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.63% : 0.000466s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000054s : 1: py_interpret_to_execute 0.06% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 2.09% : 0.000600s : 1: renormalize.infer 1.51% : 0.000431s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000041s : 1: rewriter_after_opt_a 0.34% : 0.000096s : 1: rewriter_before_opt_a 0.28% : 0.000080s : 1: symbol_engine_optimizer 22.88% : 0.006553s : 1: type_inference TotalTime = 0.0292538, [30] [bootstrap]: 0.00029711 [type_inference]: 0.0205864 [event_method]: 2.145e-05 [auto_monad]: 7.049e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 9.744e-05 [rewriter_before_opt_a]: 8.265e-05 [expand_dump_flag]: 3.08998e-06 [jit_opt_a]: 0.00588035, [2] [Cycle 1]: 0.00203653, [27] [switch_simplify]: 6.152e-05 [loop_unroll]: 2.925e-05 [a_1]: 0.00057735 [with_stream_mark]: 2.772e-05 [recompute_prepare]: 7.52002e-06 [updatestate_depend_eliminate]: 4.67998e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.68002e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 1.036e-05 [inline_without_move]: 5.57999e-06 [renormalize]: 0.00097633 [add_forward_monad_depend]: 6.16e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.634e-05 [cse]: 3.694e-05 [replace_applicator]: 1.489e-05 [Cycle 2]: 0.0003235, [27] [switch_simplify]: 5.67999e-06 [loop_unroll]: 4.92e-06 [a_1]: 9.036e-05 [with_stream_mark]: 1.005e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.562e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 8.49998e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.323e-05 [replace_applicator]: 5.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.279e-05 [rewriter_after_opt_a]: 3.838e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00059728 [jit_opt_b]: 4.847e-05, [1] [Cycle 1]: 4.066e-05, [2] [frontend_op_eliminate]: 1.464e-05 [inline_after_opt_a]: 1.534e-05 [cconv]: 2.501e-05 [loop_unroll]: 0.00046128 [jit_opt_after_cconv]: 0.00013942, [1] [Cycle 1]: 0.00013259, [11] [c_1]: 1.99e-05 [parameter_eliminate]: 2.09999e-06 [updatestate_depend_eliminate]: 6.44001e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.34e-05 [call_graph_tuple_transform]: 1.793e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.00001e-06 [remove_dup_value]: 1.681e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.12999e-06 [add_recomputation]: 4.982e-05 [cse_after_recomputation]: 2.232e-05, [1] [Cycle 1]: 1.661e-05, [1] [cse]: 1.123e-05 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.00046161 [symbol_engine_optimizer]: 7.502e-05, [1] [Cycle 1]: 6.841e-05, [6] [build]: 3.53999e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.334e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.13002e-06 [renormalize]: 3.19997e-07 [validate]: 3.955e-05 Sums bootstrap : 0.000297s : 1.18% type_inference : 0.020586s : 81.88% event_method : 0.000021s : 0.09% auto_monad : 0.000070s : 0.28% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000097s : 0.39% rewriter_before_opt_a : 0.000083s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.27% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000668s : 2.66% jit_opt_a.with_stream_mark : 0.000038s : 0.15% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000976s : 3.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000050s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000597s : 2.38% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000025s : 0.10% loop_unroll : 0.000461s : 1.83% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000462s : 1.84% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.16% Time group info: ------[substitution.] 0.000249 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 3: substitution.graph_param_transform 85.61% : 0.000214s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 2.46% : 0.000006s : 2: substitution.replace_old_param 5.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020512 2 92.44% : 0.018962s : 1: type_inference.infer 7.56% : 0.001551s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.72% : 0.000051s : 4: replace.inline 31.28% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.74% : 0.000211s : 4: match.inline 5.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.93% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.53% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.59% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.13% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.83% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.46% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000815 13 44.65% : 0.000364s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.81% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.53% : 0.000396s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031174 72 0.17% : 0.000052s : 1: add_recomputation 0.24% : 0.000074s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.01% : 0.000314s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.87% : 0.005883s : 1: jit_opt_a 0.46% : 0.000142s : 1: jit_opt_after_cconv 0.16% : 0.000051s : 1: jit_opt_b 1.51% : 0.000469s : 1: loop_unroll 1.94% : 0.000606s : 1: mutable_eliminate 2.86% : 0.000892s : 26: opt.transform.jit_opt_a 0.14% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000470s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000101s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.74% : 0.000541s : 1: renormalize.infer 1.37% : 0.000426s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000086s : 1: rewriter_before_opt_a 0.25% : 0.000078s : 1: symbol_engine_optimizer 66.10% : 0.020606s : 1: type_inference TotalTime = 0.396586, [30] [bootstrap]: 0.00035437 [type_inference]: 0.338598 [event_method]: 2.369e-05 [auto_monad]: 7.282e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00057574 [rewriter_before_opt_a]: 0.00010644 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.0535565, [2] [Cycle 1]: 0.0490025, [27] [switch_simplify]: 0.00014241 [loop_unroll]: 5.556e-05 [a_1]: 0.00078206 [with_stream_mark]: 2.16e-05 [recompute_prepare]: 8.95001e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.61998e-06 [specialize_transform]: 7.28e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 6.32001e-06 [renormalize]: 0.0475651 [add_forward_monad_depend]: 1.225e-05 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 2.324e-05 [cse]: 3.92e-05 [replace_applicator]: 2.731e-05 [Cycle 2]: 0.00040554, [27] [switch_simplify]: 8.70999e-06 [loop_unroll]: 8.01001e-06 [a_1]: 0.00013339 [with_stream_mark]: 1.598e-05 [recompute_prepare]: 6.56e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 2.80997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.848e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.84e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.412e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.486e-05 [rewriter_after_opt_a]: 4.093e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00077026 [jit_opt_b]: 5.929e-05, [1] [Cycle 1]: 5.139e-05, [2] [frontend_op_eliminate]: 2.037e-05 [inline_after_opt_a]: 1.892e-05 [cconv]: 2.597e-05 [loop_unroll]: 0.00041579 [jit_opt_after_cconv]: 0.00015746, [1] [Cycle 1]: 0.00015091, [11] [c_1]: 2.749e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.79999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 3.35e-06 [cse]: 2.303e-05 [call_graph_tuple_transform]: 2.037e-05 [tuple_list_get_item_eliminator]: 8.47e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 1.828e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 8.43001e-06 [add_recomputation]: 4.966e-05 [cse_after_recomputation]: 2.628e-05, [1] [Cycle 1]: 2.075e-05, [1] [cse]: 1.486e-05 [auto_monad_reorder]: 1.727e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 4.36002e-06 [opt_after_jit_grad]: 0.00126059 [symbol_engine_optimizer]: 8.242e-05, [1] [Cycle 1]: 7.604e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 1.182e-05 [elim_not_effective]: 1.437e-05 [opt_reshape]: 7.25998e-06 [fold_const_symbol]: 1.113e-05 [renormalize]: 4.19997e-07 [validate]: 0.00011355 Sums bootstrap : 0.000354s : 0.09% type_inference : 0.338598s : 86.43% event_method : 0.000024s : 0.01% auto_monad : 0.000073s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000576s : 0.15% rewriter_before_opt_a : 0.000106s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000151s : 0.04% jit_opt_a.loop_unroll : 0.000064s : 0.02% jit_opt_a.a_1 : 0.000915s : 0.23% jit_opt_a.with_stream_mark : 0.000038s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.047565s : 12.14% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000053s : 0.01% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000770s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000026s : 0.01% loop_unroll : 0.000416s : 0.11% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.01% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.001261s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000114s : 0.03% Time group info: ------[substitution.] 0.000309 25 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 4: substitution.graph_param_transform 88.22% : 0.000273s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000006s : 4: substitution.remove_not_recompute_node 1.91% : 0.000006s : 2: substitution.replace_old_param 3.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.338506 2 99.01% : 0.335141s : 1: type_inference.infer 0.99% : 0.003365s : 1: type_inference.specialize ------[replace.] 0.000106 7 69.17% : 0.000073s : 5: replace.inline 30.83% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 7 96.28% : 0.000270s : 5: match.inline 3.72% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000167 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.89% : 0.000001s : 13: predicate.addn_check_dump 1.52% : 0.000003s : 13: predicate.addn_zero_filter 1.64% : 0.000003s : 13: predicate.arithmetic_simplify 1.11% : 0.000002s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 0.90% : 0.000001s : 13: predicate.compare_switch_simplify 1.09% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_depend_swap 1.40% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000009s : 28: predicate.inline 0.75% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.56% : 0.000003s : 19: predicate.load_eliminater 0.99% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.94% : 0.000002s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 1.02% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000004s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 1.78% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000001s : 4: predicate.reset_defer_inline 11.11% : 0.000019s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000004s : 20: predicate.switch_defer_inline 1.91% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.74% : 0.000011s : 64: predicate.switch_simplify 1.14% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.36% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003143 25 53.42% : 0.001679s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.62% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.96% : 0.001382s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.445429 72 0.01% : 0.000053s : 1: add_recomputation 0.02% : 0.000076s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.08% : 0.000374s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.02% : 0.053560s : 1: jit_opt_a 0.04% : 0.000161s : 1: jit_opt_after_cconv 0.01% : 0.000062s : 1: jit_opt_b 0.10% : 0.000423s : 1: loop_unroll 0.17% : 0.000779s : 1: mutable_eliminate 0.29% : 0.001285s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.29% : 0.001270s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000586s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 10.37% : 0.046210s : 1: renormalize.infer 0.30% : 0.001341s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000044s : 1: rewriter_after_opt_a 0.02% : 0.000111s : 1: rewriter_before_opt_a 0.02% : 0.000085s : 1: symbol_engine_optimizer 76.02% : 0.338619s : 1: type_inference TotalTime = 0.305446, [30] [bootstrap]: 0.00034927 [type_inference]: 0.289119 [event_method]: 2.685e-05 [auto_monad]: 8.084e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00065207 [rewriter_before_opt_a]: 9.962e-05 [expand_dump_flag]: 4.01001e-06 [jit_opt_a]: 0.0118472, [2] [Cycle 1]: 0.00618148, [27] [switch_simplify]: 6.75e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.00067303 [with_stream_mark]: 2.392e-05 [recompute_prepare]: 9.09e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 3.86999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 6.13998e-06 [renormalize]: 0.00499736 [add_forward_monad_depend]: 1.469e-05 [auto_monad_grad]: 3.16001e-06 [auto_monad_eliminator]: 2.178e-05 [cse]: 3.528e-05 [replace_applicator]: 2.117e-05 [Cycle 2]: 0.00038176, [27] [switch_simplify]: 7.40998e-06 [loop_unroll]: 6.06998e-06 [a_1]: 0.0001292 [with_stream_mark]: 1.372e-05 [recompute_prepare]: 6.04999e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 5.71998e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.661e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.187e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.424e-05 [rewriter_after_opt_a]: 3.989e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00070942 [jit_opt_b]: 5.603e-05, [1] [Cycle 1]: 4.909e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 3.142e-05 [loop_unroll]: 0.00042087 [jit_opt_after_cconv]: 0.00015105, [1] [Cycle 1]: 0.00014466, [11] [c_1]: 2.541e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 2.138e-05 [call_graph_tuple_transform]: 2.116e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.93998e-06 [remove_dup_value]: 1.646e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 9.77001e-06 [add_recomputation]: 8.374e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.729e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.548e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00047287 [symbol_engine_optimizer]: 0.00016161, [1] [Cycle 1]: 0.0001552, [6] [build]: 4.25e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 9.497e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 1.113e-05 [renormalize]: 4.50003e-07 [validate]: 5.277e-05 Sums bootstrap : 0.000349s : 0.12% type_inference : 0.289119s : 96.77% event_method : 0.000027s : 0.01% auto_monad : 0.000081s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000652s : 0.22% rewriter_before_opt_a : 0.000100s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000802s : 0.27% jit_opt_a.with_stream_mark : 0.000038s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004997s : 1.67% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000047s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000709s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000421s : 0.14% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000084s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000473s : 0.16% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000095s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.02% Time group info: ------[substitution.] 0.000352 24 23.39% : 0.000082s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.71% : 0.000006s : 4: substitution.graph_param_transform 66.23% : 0.000233s : 4: substitution.inline 1.08% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.60% : 0.000006s : 2: substitution.replace_old_param 4.00% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.289009 2 97.87% : 0.282854s : 1: type_inference.infer 2.13% : 0.006155s : 1: type_inference.specialize ------[replace.] 0.000088 6 67.73% : 0.000059s : 4: replace.inline 32.27% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 94.69% : 0.000231s : 4: match.inline 5.31% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.57% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000008s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.21% : 0.000002s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.07% : 0.000001s : 12: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.60% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004233 22 76.91% : 0.003255s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 21.66% : 0.000917s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.310853 72 0.03% : 0.000087s : 1: add_recomputation 0.03% : 0.000085s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.12% : 0.000370s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.81% : 0.011851s : 1: jit_opt_a 0.05% : 0.000154s : 1: jit_opt_after_cconv 0.02% : 0.000059s : 1: jit_opt_b 0.14% : 0.000430s : 1: loop_unroll 0.23% : 0.000719s : 1: mutable_eliminate 0.34% : 0.001053s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000118s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000481s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000661s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.83% : 0.002575s : 1: renormalize.infer 0.78% : 0.002411s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000105s : 1: rewriter_before_opt_a 0.05% : 0.000164s : 1: symbol_engine_optimizer 93.02% : 0.289141s : 1: type_inference TotalTime = 0.0163724, [30] [bootstrap]: 0.00028914 [type_inference]: 0.00645972 [event_method]: 2.203e-05 [auto_monad]: 6.954e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 5.625e-05 [rewriter_before_opt_a]: 0.00026447 [expand_dump_flag]: 4.3e-06 [jit_opt_a]: 0.00716131, [2] [Cycle 1]: 0.0020949, [27] [switch_simplify]: 6.691e-05 [loop_unroll]: 3.619e-05 [a_1]: 0.00074248 [with_stream_mark]: 1.846e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 4.57998e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00089881 [add_forward_monad_depend]: 5.15001e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.418e-05 [cse]: 3.367e-05 [replace_applicator]: 1.179e-05 [Cycle 2]: 0.0003188, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.35999e-06 [a_1]: 8.941e-05 [with_stream_mark]: 8.87999e-06 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.39002e-06 [inline_without_move]: 4.82998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.06998e-06 [cse]: 1.24e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.091e-05 [rewriter_after_opt_a]: 3.62e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00047792 [jit_opt_b]: 5.041e-05, [1] [Cycle 1]: 4.419e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 2.517e-05 [loop_unroll]: 0.00040998 [jit_opt_after_cconv]: 0.00015003, [1] [Cycle 1]: 0.00014394, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 2.38998e-06 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 1.976e-05 [call_graph_tuple_transform]: 1.756e-05 [tuple_list_get_item_eliminator]: 1.67e-05 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.65e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 7.99002e-06 [add_recomputation]: 4.885e-05 [cse_after_recomputation]: 2.358e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.732e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 4.47998e-06 [opt_after_jit_grad]: 0.00044462 [symbol_engine_optimizer]: 7.896e-05, [1] [Cycle 1]: 7.272e-05, [6] [build]: 8.41002e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.34e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 3.4002e-07 [validate]: 3.974e-05 Sums bootstrap : 0.000289s : 2.62% type_inference : 0.006460s : 58.48% event_method : 0.000022s : 0.20% auto_monad : 0.000070s : 0.63% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000056s : 0.51% rewriter_before_opt_a : 0.000264s : 2.39% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000073s : 0.66% jit_opt_a.loop_unroll : 0.000042s : 0.38% jit_opt_a.a_1 : 0.000832s : 7.53% jit_opt_a.with_stream_mark : 0.000027s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000899s : 8.14% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.18% jit_opt_a.cse : 0.000046s : 0.42% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000036s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000478s : 4.33% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000025s : 0.23% loop_unroll : 0.000410s : 3.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000017s : 0.15% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.07% add_recomputation : 0.000049s : 0.44% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.16% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000445s : 4.03% symbol_engine_optimizer.build : 0.000008s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.36% Time group info: ------[substitution.] 0.000292 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 1.59% : 0.000005s : 3: substitution.graph_param_transform 88.36% : 0.000258s : 5: substitution.inline 0.99% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.50% : 0.000004s : 4: substitution.remove_not_recompute_node 1.39% : 0.000004s : 2: substitution.replace_old_param 4.84% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006388 2 76.25% : 0.004871s : 1: type_inference.infer 23.75% : 0.001517s : 1: type_inference.specialize ------[replace.] 0.000112 8 65.28% : 0.000073s : 5: replace.inline 34.72% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000268 8 95.33% : 0.000256s : 5: match.inline 4.67% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 810 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 2.22% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 12: predicate.compare_switch_simplify 1.35% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_depend_swap 1.54% : 0.000002s : 12: predicate.environ_get_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 18: predicate.load_eliminater 1.00% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.24% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 21: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.67% : 0.000004s : 20: predicate.switch_defer_inline 2.34% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 64: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.75% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.88% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001046 16 45.55% : 0.000477s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.77% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.69% : 0.000468s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018398 72 0.28% : 0.000052s : 1: add_recomputation 0.40% : 0.000074s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.66% : 0.000306s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.04% : 0.000007s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 38.94% : 0.007164s : 1: jit_opt_a 0.83% : 0.000153s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.27% : 0.000418s : 1: loop_unroll 2.65% : 0.000487s : 1: mutable_eliminate 5.78% : 0.001063s : 26: opt.transform.jit_opt_a 0.32% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.46% : 0.000452s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000059s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.75% : 0.000506s : 1: renormalize.infer 2.09% : 0.000385s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 1.47% : 0.000271s : 1: rewriter_before_opt_a 0.44% : 0.000081s : 1: symbol_engine_optimizer 35.20% : 0.006477s : 1: type_inference TotalTime = 0.0216256, [30] [bootstrap]: 0.00033907 [type_inference]: 0.00473843 [event_method]: 1.7e-05 [auto_monad]: 6.353e-05 [graph_reusing]: 5.47999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 3.479e-05 [rewriter_before_opt_a]: 7.167e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00499663, [2] [Cycle 1]: 0.00149576, [27] [switch_simplify]: 5.404e-05 [loop_unroll]: 3.038e-05 [a_1]: 0.00050765 [with_stream_mark]: 1.695e-05 [recompute_prepare]: 6.87002e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 4.15e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 8.87999e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.00056057 [add_forward_monad_depend]: 5.34998e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.431e-05 [cse]: 3.299e-05 [replace_applicator]: 1.154e-05 [Cycle 2]: 0.00031324, [27] [switch_simplify]: 5.67999e-06 [loop_unroll]: 4.98001e-06 [a_1]: 8.846e-05 [with_stream_mark]: 8.70999e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.176e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.92e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.256e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 4.262e-05 [rewriter_after_opt_a]: 7.548e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00075325 [jit_opt_b]: 5.854e-05, [1] [Cycle 1]: 4.916e-05, [2] [frontend_op_eliminate]: 1.749e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 3.519e-05 [loop_unroll]: 0.00043221 [jit_opt_after_cconv]: 0.00018635, [1] [Cycle 1]: 0.0001798, [11] [c_1]: 2.098e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 6.72002e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 4.373e-05 [call_graph_tuple_transform]: 3.582e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.828e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 6.62002e-06 [add_recomputation]: 5.41e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.209e-05 [auto_monad_reorder]: 1.913e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.91998e-06 [opt_after_jit_grad]: 0.00046664 [symbol_engine_optimizer]: 7.648e-05, [1] [Cycle 1]: 7.012e-05, [6] [build]: 3.83999e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.336e-05 [opt_reshape]: 6.89999e-06 [fold_const_symbol]: 8.98002e-06 [renormalize]: 3.89991e-07 [validate]: 4.126e-05 Sums bootstrap : 0.000339s : 3.77% type_inference : 0.004738s : 52.69% event_method : 0.000017s : 0.19% auto_monad : 0.000064s : 0.71% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.39% rewriter_before_opt_a : 0.000072s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000060s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.39% jit_opt_a.a_1 : 0.000596s : 6.63% jit_opt_a.with_stream_mark : 0.000026s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000561s : 6.23% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000046s : 0.51% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000043s : 0.47% rewriter_after_opt_a : 0.000075s : 0.84% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000753s : 8.38% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000020s : 0.22% cconv : 0.000035s : 0.39% loop_unroll : 0.000432s : 4.81% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000044s : 0.49% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.40% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000018s : 0.20% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000054s : 0.60% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000019s : 0.21% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000467s : 5.19% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.46% Time group info: ------[substitution.] 0.000191 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 3.41% : 0.000007s : 3: substitution.graph_param_transform 82.54% : 0.000158s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000004s : 2: substitution.replace_old_param 6.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004680 2 83.35% : 0.003900s : 1: type_inference.infer 16.65% : 0.000779s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.59% : 0.000044s : 4: replace.inline 33.41% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.38% : 0.000156s : 4: match.inline 6.62% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.55% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.86% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.71% : 0.000001s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.14% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000602 13 56.14% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.85% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.00% : 0.000235s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023060 72 0.25% : 0.000057s : 1: add_recomputation 0.29% : 0.000067s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.56% : 0.000359s : 1: bootstrap 0.16% : 0.000038s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.09% : 0.000021s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 60.01% : 0.013838s : 1: jit_opt_a 0.82% : 0.000189s : 1: jit_opt_after_cconv 0.26% : 0.000061s : 1: jit_opt_b 1.91% : 0.000440s : 1: loop_unroll 3.31% : 0.000762s : 1: mutable_eliminate 3.48% : 0.000803s : 26: opt.transform.jit_opt_a 0.28% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000018s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.06% : 0.000475s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000037s : 1: py_interpret_to_execute 0.29% : 0.000066s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000021s : 1: remove_dup_value 1.24% : 0.000287s : 1: renormalize.infer 1.16% : 0.000267s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.34% : 0.000079s : 1: rewriter_after_opt_a 0.32% : 0.000074s : 1: rewriter_before_opt_a 0.34% : 0.000079s : 1: symbol_engine_optimizer 20.61% : 0.004752s : 1: type_inference TotalTime = 0.190712, [30] [bootstrap]: 0.00038469 [type_inference]: 0.173966 [event_method]: 2.61e-05 [auto_monad]: 8.542e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00121632 [rewriter_before_opt_a]: 0.00013186 [expand_dump_flag]: 5.15999e-06 [jit_opt_a]: 0.0114945, [2] [Cycle 1]: 0.00643299, [27] [switch_simplify]: 7.182e-05 [loop_unroll]: 3.143e-05 [a_1]: 0.00099371 [with_stream_mark]: 2.836e-05 [recompute_prepare]: 1.074e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 7.37002e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 7.98001e-06 [meta_shard_fg_expand]: 3.11999e-06 [get_grad_eliminate_]: 7.88001e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 1.125e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.148e-05 [inline_without_move]: 6.88998e-06 [renormalize]: 0.00486323 [add_forward_monad_depend]: 9.89001e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 2.026e-05 [cse]: 4.497e-05 [replace_applicator]: 2.421e-05 [Cycle 2]: 0.0008598, [27] [switch_simplify]: 7.75e-06 [loop_unroll]: 0.00038819 [a_1]: 0.00014487 [with_stream_mark]: 2.211e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.50002e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.86998e-06 [merge_forward]: 4.89e-06 [cell_reuse_recompute_pass]: 3.46999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.953e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.109e-05 [inline_without_move]: 6.38e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.79999e-06 [auto_monad_grad]: 1.69998e-06 [auto_monad_eliminator]: 1.032e-05 [cse]: 2.739e-05 [replace_applicator]: 6.41998e-06 [py_interpret_to_execute_after_opt_a]: 1.911e-05 [rewriter_after_opt_a]: 4.752e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.61003e-06 [mutable_eliminate]: 0.00090398 [jit_opt_b]: 7.258e-05, [1] [Cycle 1]: 6.445e-05, [2] [frontend_op_eliminate]: 2.602e-05 [inline_after_opt_a]: 2.559e-05 [cconv]: 3.422e-05 [loop_unroll]: 0.0005751 [jit_opt_after_cconv]: 0.00019846, [1] [Cycle 1]: 0.00019128, [11] [c_1]: 3.542e-05 [parameter_eliminate]: 3.71999e-06 [updatestate_depend_eliminate]: 7.8e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 3.488e-05 [call_graph_tuple_transform]: 3.128e-05 [tuple_list_get_item_eliminator]: 6.68003e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 1.104e-05 [remove_dup_value]: 1.893e-05 [partial_unused_args_eliminate]: 1.93002e-06 [environ_conv]: 1.076e-05 [add_recomputation]: 5.919e-05 [cse_after_recomputation]: 2.566e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.421e-05 [auto_monad_reorder]: 1.851e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 1.111e-05 [opt_after_jit_grad]: 0.00068231 [symbol_engine_optimizer]: 9.452e-05, [1] [Cycle 1]: 8.757e-05, [6] [build]: 5.12e-06 [elim_shapecalc]: 9.02999e-06 [elim_not_effective]: 1.572e-05 [opt_reshape]: 1.122e-05 [fold_const_symbol]: 1.209e-05 [renormalize]: 3.89991e-07 [validate]: 0.00035357 Sums bootstrap : 0.000385s : 0.21% type_inference : 0.173966s : 93.65% event_method : 0.000026s : 0.01% auto_monad : 0.000085s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001216s : 0.65% rewriter_before_opt_a : 0.000132s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.04% jit_opt_a.loop_unroll : 0.000420s : 0.23% jit_opt_a.a_1 : 0.001139s : 0.61% jit_opt_a.with_stream_mark : 0.000050s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004863s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000072s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000904s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000026s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000575s : 0.31% jit_opt_after_cconv.c_1 : 0.000035s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000011s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000059s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000682s : 0.37% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000354s : 0.19% Time group info: ------[substitution.] 0.000285 24 0.69% : 0.000002s : 2: substitution.elim_not_effective 1.35% : 0.000004s : 2: substitution.fold_const_symbol 2.60% : 0.000007s : 4: substitution.graph_param_transform 83.24% : 0.000237s : 4: substitution.inline 1.58% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 2.42% : 0.000007s : 2: substitution.replace_old_param 6.10% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.173831 2 94.61% : 0.164464s : 1: type_inference.infer 5.39% : 0.009366s : 1: type_inference.specialize ------[replace.] 0.000119 6 58.53% : 0.000070s : 4: replace.inline 41.47% : 0.000050s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 6 93.72% : 0.000234s : 4: match.inline 6.28% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.49% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.01% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.25% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_depend_swap 1.41% : 0.000002s : 12: predicate.environ_get_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.92% : 0.000009s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 18: predicate.load_eliminater 1.61% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.20% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 2.17% : 0.000003s : 4: predicate.mutable_eliminate 0.74% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000003s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.75% : 0.000004s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.34% : 0.000010s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.22% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.69% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 4.06% : 0.000006s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003363 22 61.12% : 0.002055s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.69% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.19% : 0.001251s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.197181 72 0.03% : 0.000062s : 1: add_recomputation 0.05% : 0.000090s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000409s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.83% : 0.011499s : 1: jit_opt_a 0.10% : 0.000202s : 1: jit_opt_after_cconv 0.04% : 0.000076s : 1: jit_opt_b 0.30% : 0.000586s : 1: loop_unroll 0.46% : 0.000916s : 1: mutable_eliminate 0.91% : 0.001799s : 26: opt.transform.jit_opt_a 0.04% : 0.000080s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000043s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000036s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000694s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.62% : 0.001230s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.80% : 0.003550s : 1: renormalize.infer 0.66% : 0.001298s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.07% : 0.000138s : 1: rewriter_before_opt_a 0.05% : 0.000097s : 1: symbol_engine_optimizer 88.24% : 0.173994s : 1: type_inference TotalTime = 0.019163, [30] [bootstrap]: 0.00027618 [type_inference]: 0.00821847 [event_method]: 3.379e-05 [auto_monad]: 6.699e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 5.096e-05 [rewriter_before_opt_a]: 9.547e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00794494, [2] [Cycle 1]: 0.00254993, [27] [switch_simplify]: 7.251e-05 [loop_unroll]: 3.7e-05 [a_1]: 0.00077559 [with_stream_mark]: 2.163e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.765e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00126908 [add_forward_monad_depend]: 6.36e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.669e-05 [cse]: 3.694e-05 [replace_applicator]: 1.352e-05 [Cycle 2]: 0.00033185, [27] [switch_simplify]: 6.25002e-06 [loop_unroll]: 5.07999e-06 [a_1]: 9.41e-05 [with_stream_mark]: 1.053e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.299e-05 [j_node_and_user_rematch]: 8.43001e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.71999e-06 [inline_without_move]: 4.79e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.31998e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.39e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 3.74e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00067814 [jit_opt_b]: 5.261e-05, [1] [Cycle 1]: 4.552e-05, [2] [frontend_op_eliminate]: 1.739e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 2.811e-05 [loop_unroll]: 0.00043566 [jit_opt_after_cconv]: 0.00025486, [1] [Cycle 1]: 0.0001425, [11] [c_1]: 2.119e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 6.21998e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.472e-05 [call_graph_tuple_transform]: 1.914e-05 [tuple_list_get_item_eliminator]: 5.96998e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 1.848e-05 [partial_unused_args_eliminate]: 2.76999e-06 [environ_conv]: 2.546e-05 [add_recomputation]: 5.653e-05 [cse_after_recomputation]: 3.092e-05, [1] [Cycle 1]: 2.501e-05, [1] [cse]: 1.709e-05 [auto_monad_reorder]: 1.889e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.92999e-06 [opt_after_jit_grad]: 0.00048658 [symbol_engine_optimizer]: 8.152e-05, [1] [Cycle 1]: 7.549e-05, [6] [build]: 1.128e-05 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 5.88998e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 3.00002e-07 [validate]: 4.557e-05 Sums bootstrap : 0.000276s : 2.06% type_inference : 0.008218s : 61.39% event_method : 0.000034s : 0.25% auto_monad : 0.000067s : 0.50% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000051s : 0.38% rewriter_before_opt_a : 0.000095s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000079s : 0.59% jit_opt_a.loop_unroll : 0.000042s : 0.31% jit_opt_a.a_1 : 0.000870s : 6.50% jit_opt_a.with_stream_mark : 0.000032s : 0.24% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.14% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.001269s : 9.48% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.17% jit_opt_a.cse : 0.000051s : 0.38% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000037s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000678s : 5.07% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.13% cconv : 0.000028s : 0.21% loop_unroll : 0.000436s : 3.25% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000018s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000025s : 0.19% add_recomputation : 0.000057s : 0.42% cse_after_recomputation.cse : 0.000017s : 0.13% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000487s : 3.63% symbol_engine_optimizer.build : 0.000011s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.34% Time group info: ------[substitution.] 0.000296 25 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 1.66% : 0.000005s : 3: substitution.graph_param_transform 87.21% : 0.000258s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.51% : 0.000004s : 4: substitution.remove_not_recompute_node 1.65% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008151 2 56.34% : 0.004592s : 1: type_inference.infer 43.66% : 0.003559s : 1: type_inference.specialize ------[replace.] 0.000119 8 65.68% : 0.000078s : 5: replace.inline 34.32% : 0.000041s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000269 8 94.55% : 0.000255s : 5: match.inline 5.45% : 0.000015s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 810 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 12: predicate.addn_check_dump 1.67% : 0.000002s : 12: predicate.addn_zero_filter 2.42% : 0.000004s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.45% : 0.000002s : 12: predicate.compare_switch_simplify 1.47% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.79% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000001s : 3: predicate.graph_param_transform 5.42% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000002s : 12: predicate.minmaximum_grad 1.88% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.74% : 0.000003s : 12: predicate.reduce_eliminate 1.84% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 21: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.53% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.88% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.96% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001032 16 45.39% : 0.000468s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.99% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.62% : 0.000481s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021600 72 0.28% : 0.000060s : 1: add_recomputation 0.33% : 0.000070s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.36% : 0.000293s : 1: bootstrap 0.14% : 0.000031s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000033s : 1: cse_after_recomputation 0.13% : 0.000028s : 1: environ_conv 0.18% : 0.000038s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 36.80% : 0.007949s : 1: jit_opt_a 1.20% : 0.000259s : 1: jit_opt_after_cconv 0.26% : 0.000055s : 1: jit_opt_b 2.06% : 0.000444s : 1: loop_unroll 3.18% : 0.000688s : 1: mutable_eliminate 5.18% : 0.001118s : 26: opt.transform.jit_opt_a 0.22% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000017s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.29% : 0.000495s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000054s : 1: py_interpret_to_execute 0.07% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000022s : 1: remove_dup_value 3.52% : 0.000759s : 1: renormalize.infer 2.31% : 0.000500s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000040s : 1: rewriter_after_opt_a 0.46% : 0.000098s : 1: rewriter_before_opt_a 0.39% : 0.000084s : 1: symbol_engine_optimizer 38.11% : 0.008232s : 1: type_inference TotalTime = 0.0343355, [30] [bootstrap]: 0.00035758 [type_inference]: 0.00891961 [event_method]: 2.065e-05 [auto_monad]: 6.997e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 4.988e-05 [rewriter_before_opt_a]: 8.501e-05 [expand_dump_flag]: 3.17002e-06 [jit_opt_a]: 0.0225724, [2] [Cycle 1]: 0.00214314, [27] [switch_simplify]: 6.717e-05 [loop_unroll]: 3.344e-05 [a_1]: 0.00070574 [with_stream_mark]: 2.497e-05 [recompute_prepare]: 8.14997e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00094799 [add_forward_monad_depend]: 1.022e-05 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.592e-05 [cse]: 3.979e-05 [replace_applicator]: 1.19e-05 [Cycle 2]: 0.00034786, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.195e-05 [with_stream_mark]: 9.48002e-06 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.297e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 7.45003e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 6.00002e-06 [cse]: 3.434e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 1.267e-05 [rewriter_after_opt_a]: 5.301e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00058663 [jit_opt_b]: 5.096e-05, [1] [Cycle 1]: 4.404e-05, [2] [frontend_op_eliminate]: 1.665e-05 [inline_after_opt_a]: 1.591e-05 [cconv]: 2.502e-05 [loop_unroll]: 0.00042542 [jit_opt_after_cconv]: 0.00014779, [1] [Cycle 1]: 0.00014136, [11] [c_1]: 2.153e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.78002e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.543e-05 [call_graph_tuple_transform]: 1.881e-05 [tuple_list_get_item_eliminator]: 5.53002e-06 [none_parameter_eliminate]: 1.99999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 3.325e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 5.66e-06 [add_recomputation]: 5.336e-05 [cse_after_recomputation]: 2.478e-05, [1] [Cycle 1]: 1.891e-05, [1] [cse]: 1.257e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 4.84003e-06 [opt_after_jit_grad]: 0.00047495 [symbol_engine_optimizer]: 7.321e-05, [1] [Cycle 1]: 6.672e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 8.21002e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 3.89991e-07 [validate]: 3.829e-05 Sums bootstrap : 0.000358s : 2.62% type_inference : 0.008920s : 65.45% event_method : 0.000021s : 0.15% auto_monad : 0.000070s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.37% rewriter_before_opt_a : 0.000085s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.54% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000798s : 5.85% jit_opt_a.with_stream_mark : 0.000034s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000948s : 6.96% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000074s : 0.54% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000053s : 0.39% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000587s : 4.30% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.18% loop_unroll : 0.000425s : 3.12% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000033s : 0.24% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000053s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000475s : 3.48% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.28% Time group info: ------[substitution.] 0.000299 24 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 1.82% : 0.000005s : 3: substitution.graph_param_transform 88.66% : 0.000265s : 5: substitution.inline 0.95% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.58% : 0.000005s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 4.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008849 2 88.33% : 0.007817s : 1: type_inference.infer 11.67% : 0.001033s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.02% : 0.000069s : 5: replace.inline 31.98% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 95.73% : 0.000262s : 5: match.inline 4.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 11: predicate.addn_check_dump 1.42% : 0.000002s : 11: predicate.addn_zero_filter 2.28% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.21% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.38% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.01% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 16: predicate.partial_eliminate 1.38% : 0.000002s : 11: predicate.print_const_string_wrapper 1.63% : 0.000002s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.63% : 0.000002s : 11: predicate.reshape_eliminate 1.20% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.95% : 0.000010s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000001s : 11: predicate.transpose_eliminate 1.65% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000874 16 50.70% : 0.000443s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.25% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.04% : 0.000341s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036342 72 0.15% : 0.000056s : 1: add_recomputation 0.20% : 0.000073s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.04% : 0.000378s : 1: bootstrap 0.08% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 62.12% : 0.022576s : 1: jit_opt_a 0.41% : 0.000151s : 1: jit_opt_after_cconv 0.15% : 0.000053s : 1: jit_opt_b 1.19% : 0.000433s : 1: loop_unroll 1.64% : 0.000595s : 1: mutable_eliminate 2.83% : 0.001027s : 26: opt.transform.jit_opt_a 0.13% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000483s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000053s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000037s : 1: remove_dup_value 1.57% : 0.000569s : 1: renormalize.infer 1.02% : 0.000371s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000056s : 1: rewriter_after_opt_a 0.24% : 0.000088s : 1: rewriter_before_opt_a 0.21% : 0.000076s : 1: symbol_engine_optimizer 24.59% : 0.008935s : 1: type_inference TotalTime = 0.0439121, [30] [bootstrap]: 0.00026647 [type_inference]: 0.0357854 [event_method]: 2.152e-05 [auto_monad]: 7.117e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 9.207e-05 [rewriter_before_opt_a]: 8.221e-05 [expand_dump_flag]: 3.00002e-06 [jit_opt_a]: 0.0054807, [2] [Cycle 1]: 0.00188193, [27] [switch_simplify]: 5.845e-05 [loop_unroll]: 2.942e-05 [a_1]: 0.00054396 [with_stream_mark]: 2.248e-05 [recompute_prepare]: 7.41001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.391e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00090364 [add_forward_monad_depend]: 5.14e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.44e-05 [cse]: 3.268e-05 [replace_applicator]: 1.195e-05 [Cycle 2]: 0.00031214, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 4.98001e-06 [a_1]: 8.765e-05 [with_stream_mark]: 9.20001e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.00001e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.21e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.76998e-06 [replace_old_param]: 6.93e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 5.47001e-06 [cse]: 1.202e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.187e-05 [rewriter_after_opt_a]: 3.797e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00050414 [jit_opt_b]: 4.737e-05, [1] [Cycle 1]: 4.024e-05, [2] [frontend_op_eliminate]: 1.457e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 2.743e-05 [loop_unroll]: 0.00043614 [jit_opt_after_cconv]: 0.00013772, [1] [Cycle 1]: 0.00013119, [11] [c_1]: 1.975e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.88002e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.133e-05 [call_graph_tuple_transform]: 1.735e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 4.99e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.43998e-06 [add_recomputation]: 5.035e-05 [cse_after_recomputation]: 3.423e-05, [1] [Cycle 1]: 1.915e-05, [1] [cse]: 1.268e-05 [auto_monad_reorder]: 1.83e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00047283 [symbol_engine_optimizer]: 7.218e-05, [1] [Cycle 1]: 6.545e-05, [6] [build]: 4.60999e-06 [elim_shapecalc]: 7.25998e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 5.37001e-06 [fold_const_symbol]: 8.2e-06 [renormalize]: 3.30008e-07 [validate]: 3.873e-05 Sums bootstrap : 0.000266s : 0.67% type_inference : 0.035785s : 89.34% event_method : 0.000022s : 0.05% auto_monad : 0.000071s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000092s : 0.23% rewriter_before_opt_a : 0.000082s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.16% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000632s : 1.58% jit_opt_a.with_stream_mark : 0.000032s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000904s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000045s : 0.11% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000038s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000504s : 1.26% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.000436s : 1.09% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000473s : 1.18% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.10% Time group info: ------[substitution.] 0.000220 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000005s : 3: substitution.graph_param_transform 85.44% : 0.000188s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000004s : 4: substitution.remove_not_recompute_node 1.91% : 0.000004s : 2: substitution.replace_old_param 5.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035709 2 95.51% : 0.034106s : 1: type_inference.infer 4.49% : 0.001603s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.60% : 0.000050s : 4: replace.inline 30.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.23% : 0.000185s : 4: match.inline 5.77% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.28% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.25% : 0.000007s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.40% : 0.000002s : 10: predicate.same_eliminate 0.79% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.26% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000795 13 44.94% : 0.000357s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.06% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.00% : 0.000389s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045711 72 0.12% : 0.000054s : 1: add_recomputation 0.16% : 0.000075s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.61% : 0.000278s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000036s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.00% : 0.005484s : 1: jit_opt_a 0.31% : 0.000140s : 1: jit_opt_after_cconv 0.11% : 0.000050s : 1: jit_opt_b 0.97% : 0.000444s : 1: loop_unroll 1.12% : 0.000512s : 1: mutable_eliminate 1.85% : 0.000844s : 26: opt.transform.jit_opt_a 0.10% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000024s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.05% : 0.000481s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000096s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.14% : 0.000523s : 1: renormalize.infer 0.82% : 0.000373s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000041s : 1: rewriter_after_opt_a 0.19% : 0.000086s : 1: rewriter_before_opt_a 0.16% : 0.000075s : 1: symbol_engine_optimizer 78.33% : 0.035807s : 1: type_inference TotalTime = 0.139055, [30] [bootstrap]: 0.0004064 [type_inference]: 0.121292 [event_method]: 2.774e-05 [auto_monad]: 8.5e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.0006719 [rewriter_before_opt_a]: 0.00012251 [expand_dump_flag]: 4.84e-06 [jit_opt_a]: 0.0132407, [2] [Cycle 1]: 0.00740864, [27] [switch_simplify]: 8.594e-05 [loop_unroll]: 3.285e-05 [a_1]: 0.0008309 [with_stream_mark]: 3.061e-05 [recompute_prepare]: 1.262e-05 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.42997e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 2.51998e-06 [specialize_transform]: 8.94998e-06 [updatestate_useless_node_eliminater]: 7.49002e-06 [accelerated_algorithm]: 8.45001e-06 [meta_shard_fg_expand]: 4.58001e-06 [get_grad_eliminate_]: 8.27998e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.06e-05 [j_node_and_user_rematch]: 1.374e-05 [meta_fg_expand]: 3.12002e-06 [replace_old_param]: 1.43e-05 [inline_without_move]: 8.95001e-06 [renormalize]: 0.00589365 [add_forward_monad_depend]: 1.309e-05 [auto_monad_grad]: 3.25002e-06 [auto_monad_eliminator]: 2.641e-05 [cse]: 6.131e-05 [replace_applicator]: 3.059e-05 [Cycle 2]: 0.00055236, [27] [switch_simplify]: 8.49002e-06 [loop_unroll]: 7.86001e-06 [a_1]: 0.00014711 [with_stream_mark]: 2.318e-05 [recompute_prepare]: 7.56001e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.56998e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 6.72002e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 3.21001e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 5.66e-06 [cell_reuse_recompute_pass]: 3.46999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.419e-05 [j_node_and_user_rematch]: 1.094e-05 [meta_fg_expand]: 5.43e-05 [replace_old_param]: 1.246e-05 [inline_without_move]: 8.55999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 1.50001e-06 [auto_monad_eliminator]: 1.227e-05 [cse]: 2.78e-05 [replace_applicator]: 7.13e-06 [py_interpret_to_execute_after_opt_a]: 2.583e-05 [rewriter_after_opt_a]: 5.487e-05 [convert_after_rewriter]: 8.60001e-06 [order_py_execute_after_rewriter]: 6.12001e-06 [mutable_eliminate]: 0.00092733 [jit_opt_b]: 6.869e-05, [1] [Cycle 1]: 5.798e-05, [2] [frontend_op_eliminate]: 2.244e-05 [inline_after_opt_a]: 2.14e-05 [cconv]: 3.727e-05 [loop_unroll]: 0.00059674 [jit_opt_after_cconv]: 0.00021595, [1] [Cycle 1]: 0.00020617, [11] [c_1]: 2.901e-05 [parameter_eliminate]: 5.99999e-06 [updatestate_depend_eliminate]: 1.292e-05 [updatestate_assign_eliminate]: 3.57997e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 4.866e-05 [call_graph_tuple_transform]: 3.191e-05 [tuple_list_get_item_eliminator]: 6.93e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 2.165e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 1.353e-05 [add_recomputation]: 6.05e-05 [cse_after_recomputation]: 2.83e-05, [1] [Cycle 1]: 2.231e-05, [1] [cse]: 1.47e-05 [auto_monad_reorder]: 2.166e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 1.071e-05 [opt_after_jit_grad]: 0.0006811 [symbol_engine_optimizer]: 9.334e-05, [1] [Cycle 1]: 8.412e-05, [6] [build]: 6.16e-06 [elim_shapecalc]: 9.78998e-06 [elim_not_effective]: 1.761e-05 [opt_reshape]: 9.31e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 7.2e-07 [validate]: 7.111e-05 Sums bootstrap : 0.000406s : 0.31% type_inference : 0.121292s : 91.22% event_method : 0.000028s : 0.02% auto_monad : 0.000085s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000672s : 0.51% rewriter_before_opt_a : 0.000123s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000094s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000978s : 0.74% jit_opt_a.with_stream_mark : 0.000054s : 0.04% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000011s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.02% jit_opt_a.meta_fg_expand : 0.000057s : 0.04% jit_opt_a.replace_old_param : 0.000027s : 0.02% jit_opt_a.inline_without_move : 0.000018s : 0.01% jit_opt_a.renormalize : 0.005894s : 4.43% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.03% jit_opt_a.cse : 0.000089s : 0.07% jit_opt_a.replace_applicator : 0.000038s : 0.03% py_interpret_to_execute_after_opt_a : 0.000026s : 0.02% rewriter_after_opt_a : 0.000055s : 0.04% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000927s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000037s : 0.03% loop_unroll : 0.000597s : 0.45% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000022s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000014s : 0.01% add_recomputation : 0.000060s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000022s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000681s : 0.51% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000071s : 0.05% Time group info: ------[substitution.] 0.000370 24 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000007s : 4: substitution.graph_param_transform 85.95% : 0.000318s : 4: substitution.inline 1.64% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000008s : 4: substitution.remove_not_recompute_node 2.46% : 0.000009s : 2: substitution.replace_old_param 4.84% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121151 2 96.65% : 0.117090s : 1: type_inference.infer 3.35% : 0.004061s : 1: type_inference.specialize ------[replace.] 0.000125 6 68.41% : 0.000086s : 4: replace.inline 31.59% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000332 6 94.95% : 0.000315s : 4: match.inline 5.05% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.36% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 12: predicate.addn_check_dump 1.57% : 0.000002s : 12: predicate.addn_zero_filter 2.51% : 0.000004s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.20% : 0.000008s : 26: predicate.inline 1.08% : 0.000002s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.74% : 0.000003s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.54% : 0.000002s : 18: predicate.load_eliminater 1.68% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.39% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.31% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.40% : 0.000002s : 12: predicate.minmaximum_grad 2.22% : 0.000004s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.02% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000003s : 12: predicate.reduce_eliminate 1.69% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.81% : 0.000003s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000004s : 18: predicate.switch_defer_inline 1.75% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000011s : 58: predicate.switch_simplify 1.44% : 0.000002s : 12: predicate.tile_eliminate 1.35% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005167 34 66.50% : 0.003436s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.39% : 0.000072s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.11% : 0.001659s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146322 72 0.04% : 0.000064s : 1: add_recomputation 0.06% : 0.000089s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.29% : 0.000431s : 1: bootstrap 0.03% : 0.000040s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.05% : 0.013246s : 1: jit_opt_a 0.15% : 0.000219s : 1: jit_opt_after_cconv 0.05% : 0.000072s : 1: jit_opt_b 0.42% : 0.000608s : 1: loop_unroll 0.64% : 0.000943s : 1: mutable_eliminate 0.89% : 0.001305s : 26: opt.transform.jit_opt_a 0.05% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.02% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000026s : 1: opt.transform.mutable_eliminate 0.03% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000693s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000681s : 1: py_interpret_to_execute 0.02% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 2.66% : 0.003890s : 1: renormalize.infer 1.36% : 0.001984s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000059s : 1: rewriter_after_opt_a 0.09% : 0.000130s : 1: rewriter_before_opt_a 0.07% : 0.000096s : 1: symbol_engine_optimizer 82.91% : 0.121318s : 1: type_inference TotalTime = 0.139066, [30] [bootstrap]: 0.00039818 [type_inference]: 0.126711 [event_method]: 1.865e-05 [auto_monad]: 7.652e-05 [graph_reusing]: 5.83997e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.00050768 [rewriter_before_opt_a]: 8.171e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.00897681, [2] [Cycle 1]: 0.00383027, [27] [switch_simplify]: 5.38e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00055679 [with_stream_mark]: 1.597e-05 [recompute_prepare]: 8.27e-06 [updatestate_depend_eliminate]: 3.56001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.75003e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.91998e-06 [renormalize]: 0.0028478 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 2.944e-05 [replace_applicator]: 1.31e-05 [Cycle 2]: 0.00188213, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 0.00144561 [a_1]: 0.0001306 [with_stream_mark]: 1.432e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.603e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 1.71002e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.06e-06 [auto_monad_grad]: 1.40001e-06 [auto_monad_eliminator]: 9.32999e-06 [cse]: 1.791e-05 [replace_applicator]: 6.33e-06 [py_interpret_to_execute_after_opt_a]: 1.081e-05 [rewriter_after_opt_a]: 3.609e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 3.116e-05 [mutable_eliminate]: 0.00052458 [jit_opt_b]: 5.56e-05, [1] [Cycle 1]: 4.833e-05, [2] [frontend_op_eliminate]: 1.869e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 2.458e-05 [loop_unroll]: 0.00045845 [jit_opt_after_cconv]: 0.00015004, [1] [Cycle 1]: 0.00014368, [11] [c_1]: 2.565e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.069e-05 [call_graph_tuple_transform]: 2.039e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.82999e-06 [remove_dup_value]: 1.561e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 7.53e-06 [add_recomputation]: 5.031e-05 [cse_after_recomputation]: 2.302e-05, [1] [Cycle 1]: 1.605e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.477e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 4.72e-06 [opt_after_jit_grad]: 0.00045929 [symbol_engine_optimizer]: 0.00018042, [1] [Cycle 1]: 0.00017417, [6] [build]: 3.46999e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 2.404e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 9.69e-06 [renormalize]: 3.9002e-07 [validate]: 4.215e-05 Sums bootstrap : 0.000398s : 0.29% type_inference : 0.126711s : 93.81% event_method : 0.000019s : 0.01% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000508s : 0.38% rewriter_before_opt_a : 0.000082s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.04% jit_opt_a.loop_unroll : 0.001476s : 1.09% jit_opt_a.a_1 : 0.000687s : 0.51% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002848s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000031s : 0.02% mutable_eliminate : 0.000525s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000458s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000459s : 0.34% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000200 24 1.21% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000002s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 4: substitution.graph_param_transform 82.06% : 0.000164s : 4: substitution.inline 1.78% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.44% : 0.000005s : 2: substitution.replace_old_param 6.40% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126637 2 97.12% : 0.122985s : 1: type_inference.infer 2.88% : 0.003651s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.28% : 0.000048s : 4: replace.inline 32.72% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.24% : 0.000161s : 4: match.inline 6.76% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.68% : 0.000001s : 4: predicate.graph_param_transform 5.75% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.90% : 0.000004s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002372 22 69.55% : 0.001650s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.37% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.08% : 0.000690s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144343 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.29% : 0.000421s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.22% : 0.008980s : 1: jit_opt_a 0.11% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.32% : 0.000467s : 1: loop_unroll 0.37% : 0.000533s : 1: mutable_eliminate 1.63% : 0.002353s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000467s : 1: opt_after_jit_grad 0.02% : 0.000033s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000515s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.52% : 0.002192s : 1: renormalize.infer 0.45% : 0.000648s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.06% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000183s : 1: symbol_engine_optimizer 87.79% : 0.126725s : 1: type_inference TotalTime = 0.0272188, [30] [bootstrap]: 0.0002788 [type_inference]: 0.0180864 [event_method]: 1.858e-05 [auto_monad]: 6.507e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.27001e-06 [py_interpret_to_execute]: 9.227e-05 [rewriter_before_opt_a]: 7.612e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00638152, [2] [Cycle 1]: 0.00189697, [27] [switch_simplify]: 5.253e-05 [loop_unroll]: 2.862e-05 [a_1]: 0.00051937 [with_stream_mark]: 1.931e-05 [recompute_prepare]: 7.65998e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.394e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00088159 [add_forward_monad_depend]: 5.14e-06 [auto_monad_grad]: 7.696e-05 [auto_monad_eliminator]: 1.726e-05 [cse]: 3.101e-05 [replace_applicator]: 1.228e-05 [Cycle 2]: 0.00031593, [27] [switch_simplify]: 5.72999e-06 [loop_unroll]: 5.00001e-06 [a_1]: 8.796e-05 [with_stream_mark]: 8.73001e-06 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.41998e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.299e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.47002e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 9.99979e-07 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.265e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.342e-05 [rewriter_after_opt_a]: 3.803e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.47999e-06 [mutable_eliminate]: 0.00061008 [jit_opt_b]: 5.022e-05, [1] [Cycle 1]: 4.321e-05, [2] [frontend_op_eliminate]: 1.602e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 2.763e-05 [loop_unroll]: 0.0004295 [jit_opt_after_cconv]: 0.00014452, [1] [Cycle 1]: 0.00013823, [11] [c_1]: 1.99e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 6.74999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.529e-05 [call_graph_tuple_transform]: 1.866e-05 [tuple_list_get_item_eliminator]: 5.07e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.6e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 4.887e-05 [cse_after_recomputation]: 4.065e-05, [1] [Cycle 1]: 3.536e-05, [1] [cse]: 1.159e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.74e-06 [opt_after_jit_grad]: 0.0004687 [symbol_engine_optimizer]: 7.197e-05, [1] [Cycle 1]: 6.466e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 7.31999e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 5.60016e-07 [validate]: 3.892e-05 Sums bootstrap : 0.000279s : 1.24% type_inference : 0.018086s : 80.45% event_method : 0.000019s : 0.08% auto_monad : 0.000065s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000092s : 0.41% rewriter_before_opt_a : 0.000076s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.26% jit_opt_a.loop_unroll : 0.000034s : 0.15% jit_opt_a.a_1 : 0.000607s : 2.70% jit_opt_a.with_stream_mark : 0.000028s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000882s : 3.92% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000078s : 0.35% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.11% jit_opt_a.cse : 0.000044s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000038s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000610s : 2.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000028s : 0.12% loop_unroll : 0.000430s : 1.91% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000049s : 0.22% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000469s : 2.08% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.17% Time group info: ------[substitution.] 0.000207 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.00% : 0.000006s : 3: substitution.graph_param_transform 83.55% : 0.000173s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 5.84% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018024 2 92.89% : 0.016742s : 1: type_inference.infer 7.11% : 0.001282s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.32% : 0.000044s : 4: replace.inline 32.68% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.97% : 0.000170s : 4: match.inline 6.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.55% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.54% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.45% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.74% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000748 13 45.21% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.01% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.78% : 0.000365s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028970 72 0.18% : 0.000052s : 1: add_recomputation 0.24% : 0.000068s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.02% : 0.000296s : 1: bootstrap 0.10% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000043s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 22.04% : 0.006385s : 1: jit_opt_a 0.51% : 0.000147s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 1.51% : 0.000438s : 1: loop_unroll 2.14% : 0.000619s : 1: mutable_eliminate 2.82% : 0.000816s : 26: opt.transform.jit_opt_a 0.16% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000477s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000095s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.73% : 0.000501s : 1: renormalize.infer 1.29% : 0.000372s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000041s : 1: rewriter_after_opt_a 0.27% : 0.000080s : 1: rewriter_before_opt_a 0.26% : 0.000074s : 1: symbol_engine_optimizer 62.47% : 0.018098s : 1: type_inference TotalTime = 0.25829, [30] [bootstrap]: 0.00029952 [type_inference]: 0.230628 [event_method]: 2.188e-05 [auto_monad]: 7.344e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00045145 [rewriter_before_opt_a]: 9.991e-05 [expand_dump_flag]: 4.68999e-06 [jit_opt_a]: 0.0244497, [2] [Cycle 1]: 0.00432861, [27] [switch_simplify]: 7.108e-05 [loop_unroll]: 3.374e-05 [a_1]: 0.000791 [with_stream_mark]: 2.273e-05 [recompute_prepare]: 9.74e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.86003e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 6.33998e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00303258 [add_forward_monad_depend]: 8.12e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.822e-05 [cse]: 4.028e-05 [replace_applicator]: 1.574e-05 [Cycle 2]: 0.0004367, [27] [switch_simplify]: 7.82e-06 [loop_unroll]: 6.02001e-06 [a_1]: 0.00017675 [with_stream_mark]: 1.2e-05 [recompute_prepare]: 6.48003e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.33002e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.68998e-06 [cse]: 1.655e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.365e-05 [rewriter_after_opt_a]: 4.013e-05 [convert_after_rewriter]: 7.12997e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00063347 [jit_opt_b]: 5.682e-05, [1] [Cycle 1]: 4.983e-05, [2] [frontend_op_eliminate]: 1.953e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00042127 [jit_opt_after_cconv]: 0.00015379, [1] [Cycle 1]: 0.00014717, [11] [c_1]: 2.56e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.96001e-06 [cse]: 2.302e-05 [call_graph_tuple_transform]: 2.035e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.13002e-06 [remove_dup_value]: 1.722e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.1e-06 [add_recomputation]: 5.035e-05 [cse_after_recomputation]: 2.56e-05, [1] [Cycle 1]: 2.016e-05, [1] [cse]: 1.436e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.00046532 [symbol_engine_optimizer]: 7.525e-05, [1] [Cycle 1]: 6.913e-05, [6] [build]: 3.61001e-06 [elim_shapecalc]: 8.74003e-06 [elim_not_effective]: 1.359e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 4.60015e-07 [validate]: 4.649e-05 Sums bootstrap : 0.000300s : 0.13% type_inference : 0.230628s : 96.90% event_method : 0.000022s : 0.01% auto_monad : 0.000073s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000451s : 0.19% rewriter_before_opt_a : 0.000100s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.02% jit_opt_a.a_1 : 0.000968s : 0.41% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003033s : 1.27% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000057s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000633s : 0.27% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000421s : 0.18% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000465s : 0.20% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.02% Time group info: ------[substitution.] 0.000318 25 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 4: substitution.graph_param_transform 88.71% : 0.000282s : 5: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000006s : 4: substitution.remove_not_recompute_node 1.51% : 0.000005s : 2: substitution.replace_old_param 3.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.230554 2 98.71% : 0.227589s : 1: type_inference.infer 1.29% : 0.002964s : 1: type_inference.specialize ------[replace.] 0.000110 7 69.54% : 0.000077s : 5: replace.inline 30.46% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 7 96.10% : 0.000279s : 5: match.inline 3.90% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000221 886 0.78% : 0.000002s : 13: predicate.accumulaten_eliminater 0.76% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.70% : 0.000002s : 13: predicate.addn_check_dump 0.88% : 0.000002s : 13: predicate.addn_zero_filter 1.19% : 0.000003s : 13: predicate.arithmetic_simplify 0.89% : 0.000002s : 13: predicate.cast_eliminate 0.27% : 0.000001s : 4: predicate.check_bprop_eliminate 0.85% : 0.000002s : 13: predicate.compare_switch_simplify 0.79% : 0.000002s : 13: predicate.depend_value_elim 0.87% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.77% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.85% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.50% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.24% : 0.000001s : 4: predicate.elim_not_effective 0.33% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 14.02% : 0.000031s : 13: predicate.environ_add_const_eliminate 0.79% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.72% : 0.000002s : 13: predicate.environ_get_depend_swap 0.84% : 0.000002s : 13: predicate.environ_get_eliminate 0.76% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 4: predicate.fold_const_symbol 0.79% : 0.000002s : 8: predicate.get_grad_eliminate 0.18% : 0.000000s : 4: predicate.graph_param_transform 3.30% : 0.000007s : 28: predicate.inline 0.56% : 0.000001s : 8: predicate.inline_without_move 0.30% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.63% : 0.000001s : 8: predicate.less_batch_normalization 0.93% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.14% : 0.000003s : 19: predicate.load_eliminater 0.80% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.47% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.30% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.68% : 0.000002s : 13: predicate.merge_addn 0.71% : 0.000002s : 13: predicate.minmaximum_grad 1.16% : 0.000003s : 4: predicate.mutable_eliminate 0.34% : 0.000001s : 4: predicate.opt_reshape 1.48% : 0.000003s : 19: predicate.partial_eliminate 0.96% : 0.000002s : 13: predicate.print_const_string_wrapper 1.06% : 0.000002s : 13: predicate.reduce_eliminate 0.90% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 8: predicate.remove_not_recompute_node 1.21% : 0.000003s : 23: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.19% : 0.000000s : 4: predicate.reset_defer_inline 0.87% : 0.000002s : 13: predicate.reshape_eliminate 0.89% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.45% : 0.000001s : 4: predicate.row_tensor_eliminate 0.81% : 0.000002s : 13: predicate.same_eliminate 0.41% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.61% : 0.000001s : 8: predicate.special_op_eliminate 0.60% : 0.000001s : 8: predicate.specialize_transform 24.23% : 0.000053s : 13: predicate.split_environ_get_set_with_tuple_value 0.82% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.27% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.55% : 0.000003s : 20: predicate.switch_defer_inline 1.38% : 0.000003s : 20: predicate.switch_layer_defer_inline 4.83% : 0.000011s : 64: predicate.switch_simplify 0.86% : 0.000002s : 13: predicate.tile_eliminate 0.77% : 0.000002s : 13: predicate.transpose_eliminate 1.07% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.83% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.46% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 0.93% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 0.95% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.06% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 1.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.06% : 0.000002s : 13: predicate.value_based_eliminate 0.21% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.35% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002459 25 62.58% : 0.001539s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.71% : 0.000116s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.71% : 0.000804s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.262616 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000077s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000313s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 9.31% : 0.024454s : 1: jit_opt_a 0.06% : 0.000157s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.16% : 0.000429s : 1: loop_unroll 0.24% : 0.000642s : 1: mutable_eliminate 0.47% : 0.001228s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000473s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000458s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.76% : 0.002004s : 1: renormalize.infer 0.39% : 0.001018s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000106s : 1: rewriter_before_opt_a 0.03% : 0.000078s : 1: symbol_engine_optimizer 87.83% : 0.230647s : 1: type_inference TotalTime = 0.103516, [30] [bootstrap]: 0.00039016 [type_inference]: 0.0873829 [event_method]: 3.091e-05 [auto_monad]: 9.267e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00062181 [rewriter_before_opt_a]: 0.00012513 [expand_dump_flag]: 5.14e-06 [jit_opt_a]: 0.0115676, [2] [Cycle 1]: 0.00631574, [27] [switch_simplify]: 0.00010945 [loop_unroll]: 3.383e-05 [a_1]: 0.00088865 [with_stream_mark]: 3.193e-05 [recompute_prepare]: 1.611e-05 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 2.88e-06 [specialize_transform]: 9.79e-06 [updatestate_useless_node_eliminater]: 7.5e-06 [accelerated_algorithm]: 8.10999e-06 [meta_shard_fg_expand]: 4.15e-06 [get_grad_eliminate_]: 9.39e-06 [merge_forward]: 5.52999e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.082e-05 [j_node_and_user_rematch]: 1.391e-05 [meta_fg_expand]: 3.46999e-06 [replace_old_param]: 1.355e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00467871 [add_forward_monad_depend]: 1.523e-05 [auto_monad_grad]: 3.58999e-06 [auto_monad_eliminator]: 2.988e-05 [cse]: 5.136e-05 [replace_applicator]: 3.43e-05 [Cycle 2]: 0.00052477, [27] [switch_simplify]: 9.10999e-06 [loop_unroll]: 8.28001e-06 [a_1]: 0.00015451 [with_stream_mark]: 2.311e-05 [recompute_prepare]: 1.04e-05 [updatestate_depend_eliminate]: 5.41998e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.78998e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 6.91001e-06 [accelerated_algorithm]: 7.43e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 7.46001e-06 [merge_forward]: 5.94e-06 [cell_reuse_recompute_pass]: 3.91001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.495e-05 [j_node_and_user_rematch]: 1.238e-05 [meta_fg_expand]: 3.61999e-06 [replace_old_param]: 1.332e-05 [inline_without_move]: 7.13998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.69999e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 1.31e-05 [cse]: 2.546e-05 [replace_applicator]: 9.20001e-06 [py_interpret_to_execute_after_opt_a]: 2.439e-05 [rewriter_after_opt_a]: 5.737e-05 [convert_after_rewriter]: 9.67999e-06 [order_py_execute_after_rewriter]: 6.04001e-06 [mutable_eliminate]: 0.00100699 [jit_opt_b]: 7.781e-05, [1] [Cycle 1]: 6.674e-05, [2] [frontend_op_eliminate]: 2.456e-05 [inline_after_opt_a]: 2.571e-05 [cconv]: 4.127e-05 [loop_unroll]: 0.00060055 [jit_opt_after_cconv]: 0.00027991, [1] [Cycle 1]: 0.00027083, [11] [c_1]: 3.026e-05 [parameter_eliminate]: 6.93998e-06 [updatestate_depend_eliminate]: 6.053e-05 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 2.84999e-06 [cse]: 5.928e-05 [call_graph_tuple_transform]: 3.215e-05 [tuple_list_get_item_eliminator]: 7.5e-06 [none_parameter_eliminate]: 2.14999e-06 [renormalize]: 9.50007e-07 [switch_simplify]: 7.08e-06 [remove_dup_value]: 2.472e-05 [partial_unused_args_eliminate]: 3.38e-06 [environ_conv]: 1.267e-05 [add_recomputation]: 5.99e-05 [cse_after_recomputation]: 3.081e-05, [1] [Cycle 1]: 2.451e-05, [1] [cse]: 1.54e-05 [auto_monad_reorder]: 2.279e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 1.058e-05 [opt_after_jit_grad]: 0.00059172 [symbol_engine_optimizer]: 9.247e-05, [1] [Cycle 1]: 8.313e-05, [6] [build]: 4.82998e-06 [elim_shapecalc]: 9.79999e-06 [elim_not_effective]: 1.735e-05 [opt_reshape]: 9.62999e-06 [fold_const_symbol]: 1.011e-05 [renormalize]: 4.19997e-07 [validate]: 6.491e-05 Sums bootstrap : 0.000390s : 0.40% type_inference : 0.087383s : 89.24% event_method : 0.000031s : 0.03% auto_monad : 0.000093s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000622s : 0.64% rewriter_before_opt_a : 0.000125s : 0.13% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000119s : 0.12% jit_opt_a.loop_unroll : 0.000042s : 0.04% jit_opt_a.a_1 : 0.001043s : 1.07% jit_opt_a.with_stream_mark : 0.000055s : 0.06% jit_opt_a.recompute_prepare : 0.000027s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000018s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.02% jit_opt_a.merge_forward : 0.000011s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.03% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000027s : 0.03% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004679s : 4.78% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000043s : 0.04% jit_opt_a.cse : 0.000077s : 0.08% jit_opt_a.replace_applicator : 0.000044s : 0.04% py_interpret_to_execute_after_opt_a : 0.000024s : 0.02% rewriter_after_opt_a : 0.000057s : 0.06% convert_after_rewriter : 0.000010s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.001007s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.03% jit_opt_b.inline_after_opt_a : 0.000026s : 0.03% cconv : 0.000041s : 0.04% loop_unroll : 0.000601s : 0.61% jit_opt_after_cconv.c_1 : 0.000030s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000061s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000059s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000025s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000060s : 0.06% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000023s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000592s : 0.60% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000065s : 0.07% Time group info: ------[substitution.] 0.000350 24 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000009s : 4: substitution.graph_param_transform 85.49% : 0.000299s : 4: substitution.inline 1.82% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000007s : 4: substitution.remove_not_recompute_node 2.37% : 0.000008s : 2: substitution.replace_old_param 4.88% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.087219 2 94.48% : 0.082401s : 1: type_inference.infer 5.52% : 0.004818s : 1: type_inference.specialize ------[replace.] 0.000127 6 61.57% : 0.000078s : 4: replace.inline 38.43% : 0.000049s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000311 6 95.01% : 0.000296s : 4: match.inline 4.99% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000235 830 1.02% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.82% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000003s : 12: predicate.addn_zero_filter 1.49% : 0.000004s : 12: predicate.arithmetic_simplify 1.05% : 0.000002s : 12: predicate.cast_eliminate 0.26% : 0.000001s : 4: predicate.check_bprop_eliminate 0.78% : 0.000002s : 12: predicate.compare_switch_simplify 1.03% : 0.000002s : 12: predicate.depend_value_elim 0.75% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.72% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.80% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.24% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.98% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.70% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.91% : 0.000002s : 12: predicate.environ_get_depend_swap 0.97% : 0.000002s : 12: predicate.environ_get_eliminate 0.64% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000003s : 8: predicate.get_grad_eliminate 0.26% : 0.000001s : 4: predicate.graph_param_transform 3.76% : 0.000009s : 26: predicate.inline 0.62% : 0.000001s : 8: predicate.inline_without_move 0.34% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000003s : 8: predicate.less_batch_normalization 0.92% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.21% : 0.000003s : 18: predicate.load_eliminater 1.75% : 0.000004s : 4: predicate.loop_unroll_after_grad 2.87% : 0.000007s : 36: predicate.loop_unroll_before_grad 1.44% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.71% : 0.000002s : 12: predicate.merge_addn 0.68% : 0.000002s : 12: predicate.minmaximum_grad 1.81% : 0.000004s : 4: predicate.mutable_eliminate 0.33% : 0.000001s : 4: predicate.opt_reshape 1.41% : 0.000003s : 18: predicate.partial_eliminate 26.43% : 0.000062s : 12: predicate.print_const_string_wrapper 1.31% : 0.000003s : 12: predicate.reduce_eliminate 0.95% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.52% : 0.000004s : 22: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000001s : 4: predicate.reset_defer_inline 0.79% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 4: predicate.row_tensor_eliminate 0.75% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000002s : 8: predicate.special_op_eliminate 0.64% : 0.000002s : 8: predicate.specialize_transform 0.95% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.02% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.08% : 0.000005s : 18: predicate.switch_defer_inline 1.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.10% : 0.000014s : 58: predicate.switch_simplify 0.97% : 0.000002s : 12: predicate.tile_eliminate 0.81% : 0.000002s : 12: predicate.transpose_eliminate 0.82% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.76% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.21% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.36% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.02% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.28% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 0.93% : 0.000002s : 12: predicate.value_based_eliminate 0.24% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004393 26 60.65% : 0.002664s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000068s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.81% : 0.001661s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109685 72 0.06% : 0.000064s : 1: add_recomputation 0.09% : 0.000098s : 1: auto_monad 0.02% : 0.000027s : 1: auto_monad_reorder 0.38% : 0.000412s : 1: bootstrap 0.04% : 0.000045s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.03% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.03% : 0.000038s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.55% : 0.011574s : 1: jit_opt_a 0.26% : 0.000283s : 1: jit_opt_after_cconv 0.07% : 0.000081s : 1: jit_opt_b 0.56% : 0.000616s : 1: loop_unroll 0.94% : 0.001029s : 1: mutable_eliminate 1.28% : 0.001408s : 26: opt.transform.jit_opt_a 0.07% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000041s : 4: opt.transform.jit_opt_b 0.02% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000032s : 1: opt.transform.mutable_eliminate 0.03% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000604s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.57% : 0.000631s : 1: py_interpret_to_execute 0.03% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000027s : 1: remove_dup_value 2.61% : 0.002858s : 1: renormalize.infer 1.64% : 0.001800s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000061s : 1: rewriter_after_opt_a 0.12% : 0.000134s : 1: rewriter_before_opt_a 0.09% : 0.000095s : 1: symbol_engine_optimizer 79.69% : 0.087411s : 1: type_inference TotalTime = 0.0208607, [30] [bootstrap]: 0.00062858 [type_inference]: 0.00862113 [event_method]: 2.395e-05 [auto_monad]: 6.827e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 5.568e-05 [rewriter_before_opt_a]: 0.0001038 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.00831791, [2] [Cycle 1]: 0.00399714, [27] [switch_simplify]: 6.704e-05 [loop_unroll]: 3.667e-05 [a_1]: 0.00069364 [with_stream_mark]: 1.683e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.48998e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.91003e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 6.33002e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 0.00090002 [add_forward_monad_depend]: 5.04e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.533e-05 [cse]: 3.342e-05 [replace_applicator]: 1.183e-05 [Cycle 2]: 0.00045971, [27] [switch_simplify]: 2.595e-05 [loop_unroll]: 6.88e-06 [a_1]: 0.00010854 [with_stream_mark]: 2.194e-05 [recompute_prepare]: 6.43e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.68998e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.88002e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.80998e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 3.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.962e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1e-05 [inline_without_move]: 5.37999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.99001e-06 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.471e-05 [cse]: 3.26e-05 [replace_applicator]: 6.78e-06 [py_interpret_to_execute_after_opt_a]: 1.84e-05 [rewriter_after_opt_a]: 4.379e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 5.42999e-06 [mutable_eliminate]: 0.00115762 [jit_opt_b]: 5.915e-05, [1] [Cycle 1]: 4.984e-05, [2] [frontend_op_eliminate]: 1.937e-05 [inline_after_opt_a]: 1.859e-05 [cconv]: 3.56e-05 [loop_unroll]: 0.00047804 [jit_opt_after_cconv]: 0.00016085, [1] [Cycle 1]: 0.00015312, [11] [c_1]: 2.213e-05 [parameter_eliminate]: 3.80998e-06 [updatestate_depend_eliminate]: 7.29001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.928e-05 [call_graph_tuple_transform]: 2.077e-05 [tuple_list_get_item_eliminator]: 5.46998e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.855e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 1.015e-05 [add_recomputation]: 5.498e-05 [cse_after_recomputation]: 5.261e-05, [1] [Cycle 1]: 4.715e-05, [1] [cse]: 3.95e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 5.84e-06 [opt_after_jit_grad]: 0.00056245 [symbol_engine_optimizer]: 8.92e-05, [1] [Cycle 1]: 8.172e-05, [6] [build]: 1.105e-05 [elim_shapecalc]: 8.55001e-06 [elim_not_effective]: 1.59e-05 [opt_reshape]: 6.74001e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 5.50004e-07 [validate]: 5.26e-05 Sums bootstrap : 0.000629s : 4.36% type_inference : 0.008621s : 59.80% event_method : 0.000024s : 0.17% auto_monad : 0.000068s : 0.47% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000056s : 0.39% rewriter_before_opt_a : 0.000104s : 0.72% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000093s : 0.65% jit_opt_a.loop_unroll : 0.000044s : 0.30% jit_opt_a.a_1 : 0.000802s : 5.56% jit_opt_a.with_stream_mark : 0.000039s : 0.27% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000013s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000900s : 6.24% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000006s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.21% jit_opt_a.cse : 0.000066s : 0.46% jit_opt_a.replace_applicator : 0.000019s : 0.13% py_interpret_to_execute_after_opt_a : 0.000018s : 0.13% rewriter_after_opt_a : 0.000044s : 0.30% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.001158s : 8.03% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.13% jit_opt_b.inline_after_opt_a : 0.000019s : 0.13% cconv : 0.000036s : 0.25% loop_unroll : 0.000478s : 3.32% jit_opt_after_cconv.c_1 : 0.000022s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000019s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.07% add_recomputation : 0.000055s : 0.38% cse_after_recomputation.cse : 0.000040s : 0.27% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000562s : 3.90% symbol_engine_optimizer.build : 0.000011s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.36% Time group info: ------[substitution.] 0.000259 25 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 3: substitution.graph_param_transform 84.30% : 0.000218s : 5: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000006s : 4: substitution.remove_not_recompute_node 2.44% : 0.000006s : 2: substitution.replace_old_param 5.88% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008553 2 83.67% : 0.007157s : 1: type_inference.infer 16.33% : 0.001397s : 1: type_inference.specialize ------[replace.] 0.000105 8 64.83% : 0.000068s : 5: replace.inline 35.17% : 0.000037s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 8 94.17% : 0.000215s : 5: match.inline 5.83% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 810 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 2.57% : 0.000004s : 12: predicate.arithmetic_simplify 1.73% : 0.000003s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000002s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.08% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.30% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000008s : 26: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.73% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 12: predicate.merge_addn 1.06% : 0.000002s : 12: predicate.minmaximum_grad 1.80% : 0.000003s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 2.10% : 0.000003s : 12: predicate.reduce_eliminate 1.68% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000002s : 21: predicate.replace_applicator 0.38% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.91% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 20: predicate.switch_defer_inline 1.98% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.67% : 0.000013s : 64: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 2.01% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000997 16 50.37% : 0.000502s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.78% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.85% : 0.000427s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022886 72 0.25% : 0.000058s : 1: add_recomputation 0.31% : 0.000072s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 2.82% : 0.000646s : 1: bootstrap 0.17% : 0.000038s : 1: cconv 0.05% : 0.000011s : 1: convert_after_rewriter 0.24% : 0.000055s : 1: cse_after_recomputation 0.05% : 0.000012s : 1: environ_conv 0.12% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 36.36% : 0.008322s : 1: jit_opt_a 0.71% : 0.000163s : 1: jit_opt_after_cconv 0.27% : 0.000062s : 1: jit_opt_b 2.13% : 0.000487s : 1: loop_unroll 5.13% : 0.001173s : 1: mutable_eliminate 4.66% : 0.001066s : 26: opt.transform.jit_opt_a 0.22% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000030s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000022s : 1: opt.transform.mutable_eliminate 0.12% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.50% : 0.000573s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000058s : 1: py_interpret_to_execute 0.09% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000021s : 1: remove_dup_value 2.15% : 0.000492s : 1: renormalize.infer 1.75% : 0.000400s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000048s : 1: rewriter_after_opt_a 0.47% : 0.000107s : 1: rewriter_before_opt_a 0.40% : 0.000092s : 1: symbol_engine_optimizer 37.73% : 0.008635s : 1: type_inference TotalTime = 0.0580007, [30] [bootstrap]: 0.00031887 [type_inference]: 0.0229279 [event_method]: 2.142e-05 [auto_monad]: 7.141e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00016257 [rewriter_before_opt_a]: 8.599e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00570776, [2] [Cycle 1]: 0.00196409, [27] [switch_simplify]: 5.202e-05 [loop_unroll]: 3.001e-05 [a_1]: 0.00052528 [with_stream_mark]: 1.648e-05 [recompute_prepare]: 7.60998e-06 [updatestate_depend_eliminate]: 3.67002e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 8.70001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 8.87e-06 [inline_without_move]: 5.63002e-06 [renormalize]: 0.00101722 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.479e-05 [cse]: 3.35e-05 [replace_applicator]: 1.17e-05 [Cycle 2]: 0.00031473, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.26002e-06 [a_1]: 9.013e-05 [with_stream_mark]: 7.81001e-06 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.229e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 6.87002e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.40001e-06 [cse]: 1.209e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 9.61e-06 [rewriter_after_opt_a]: 3.693e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00049052 [jit_opt_b]: 5.042e-05, [1] [Cycle 1]: 4.39e-05, [2] [frontend_op_eliminate]: 1.683e-05 [inline_after_opt_a]: 1.62e-05 [cconv]: 2.653e-05 [loop_unroll]: 0.0264535 [jit_opt_after_cconv]: 0.00023353, [1] [Cycle 1]: 0.00022175, [11] [c_1]: 3.489e-05 [parameter_eliminate]: 7.58999e-06 [updatestate_depend_eliminate]: 1.315e-05 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.87002e-06 [cse]: 5.118e-05 [call_graph_tuple_transform]: 3.194e-05 [tuple_list_get_item_eliminator]: 7.23e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 6.86999e-06 [remove_dup_value]: 1.954e-05 [partial_unused_args_eliminate]: 5.19998e-06 [environ_conv]: 8.78001e-06 [add_recomputation]: 6.204e-05 [cse_after_recomputation]: 2.621e-05, [1] [Cycle 1]: 1.934e-05, [1] [cse]: 1.319e-05 [auto_monad_reorder]: 1.953e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 1.125e-05 [opt_after_jit_grad]: 0.00078577 [symbol_engine_optimizer]: 8.815e-05, [1] [Cycle 1]: 8.126e-05, [6] [build]: 4.95999e-06 [elim_shapecalc]: 9.11998e-06 [elim_not_effective]: 1.602e-05 [opt_reshape]: 8.1e-06 [fold_const_symbol]: 1.036e-05 [renormalize]: 8.30012e-07 [validate]: 0.00012922 Sums bootstrap : 0.000319s : 0.59% type_inference : 0.022928s : 42.51% event_method : 0.000021s : 0.04% auto_monad : 0.000071s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000163s : 0.30% rewriter_before_opt_a : 0.000086s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000615s : 1.14% jit_opt_a.with_stream_mark : 0.000024s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001017s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000046s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000037s : 0.07% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000491s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.026453s : 49.05% jit_opt_after_cconv.c_1 : 0.000035s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000051s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.04% partial_unused_args_eliminate : 0.000005s : 0.01% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000062s : 0.12% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000020s : 0.04% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.02% opt_after_jit_grad : 0.000786s : 1.46% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000129s : 0.24% Time group info: ------[substitution.] 0.000204 23 1.26% : 0.000003s : 2: substitution.elim_not_effective 1.21% : 0.000002s : 2: substitution.fold_const_symbol 4.80% : 0.000010s : 3: substitution.graph_param_transform 81.70% : 0.000167s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000004s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 5.78% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022844 2 91.29% : 0.020854s : 1: type_inference.infer 8.71% : 0.001990s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.60% : 0.000044s : 4: replace.inline 33.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.86% : 0.000165s : 4: match.inline 6.14% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.59% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.21% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 15: predicate.load_eliminater 5.58% : 0.000007s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.45% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.01% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.06% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001011 13 43.81% : 0.000443s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.49% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.70% : 0.000533s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059864 72 0.11% : 0.000065s : 1: add_recomputation 0.13% : 0.000075s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.57% : 0.000339s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.54% : 0.005710s : 1: jit_opt_a 0.40% : 0.000237s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 44.23% : 0.026476s : 1: loop_unroll 0.83% : 0.000499s : 1: mutable_eliminate 1.38% : 0.000824s : 26: opt.transform.jit_opt_a 0.13% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000044s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000797s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000007s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000167s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 1.00% : 0.000601s : 1: renormalize.infer 0.68% : 0.000408s : 1: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000040s : 1: rewriter_after_opt_a 0.15% : 0.000090s : 1: rewriter_before_opt_a 0.15% : 0.000090s : 1: symbol_engine_optimizer 38.33% : 0.022948s : 1: type_inference TotalTime = 0.266949, [30] [bootstrap]: 0.00034263 [type_inference]: 0.226054 [event_method]: 2.234e-05 [auto_monad]: 7.448e-05 [graph_reusing]: 6.86001e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00053435 [rewriter_before_opt_a]: 9.211e-05 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.00883839, [2] [Cycle 1]: 0.00484371, [27] [switch_simplify]: 6.128e-05 [loop_unroll]: 3.155e-05 [a_1]: 0.00061412 [with_stream_mark]: 1.898e-05 [recompute_prepare]: 9.15001e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.88997e-06 [specialize_transform]: 7.53e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 6.61999e-06 [merge_forward]: 3.99997e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 1.073e-05 [meta_fg_expand]: 2.68003e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 6.71e-06 [renormalize]: 0.00375356 [add_forward_monad_depend]: 6.74001e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.867e-05 [cse]: 3.164e-05 [replace_applicator]: 1.854e-05 [Cycle 2]: 0.0003787, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00012641 [with_stream_mark]: 1.197e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.23998e-06 [cell_reuse_recompute_pass]: 3.06001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 9.85002e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 8.54998e-06 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.199e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 1.325e-05 [rewriter_after_opt_a]: 3.881e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.00067469 [jit_opt_b]: 5.557e-05, [1] [Cycle 1]: 4.822e-05, [2] [frontend_op_eliminate]: 1.915e-05 [inline_after_opt_a]: 1.789e-05 [cconv]: 2.677e-05 [loop_unroll]: 0.00041646 [jit_opt_after_cconv]: 0.0001529, [1] [Cycle 1]: 0.0001461, [11] [c_1]: 2.579e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 5.93998e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 2.07e-05 [call_graph_tuple_transform]: 2.117e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 1.90019e-07 [switch_simplify]: 7.08e-06 [remove_dup_value]: 1.699e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 8.37998e-06 [add_recomputation]: 5.038e-05 [cse_after_recomputation]: 2.171e-05, [1] [Cycle 1]: 1.649e-05, [1] [cse]: 1.041e-05 [auto_monad_reorder]: 1.621e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 5.24998e-06 [opt_after_jit_grad]: 0.0290046 [symbol_engine_optimizer]: 0.00018325, [1] [Cycle 1]: 0.00017325, [6] [build]: 6.17001e-06 [elim_shapecalc]: 9.14998e-06 [elim_not_effective]: 2.229e-05 [opt_reshape]: 8.49998e-06 [fold_const_symbol]: 1.333e-05 [renormalize]: 5.8001e-07 [validate]: 5.305e-05 Sums bootstrap : 0.000343s : 0.13% type_inference : 0.226054s : 86.08% event_method : 0.000022s : 0.01% auto_monad : 0.000074s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000534s : 0.20% rewriter_before_opt_a : 0.000092s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000741s : 0.28% jit_opt_a.with_stream_mark : 0.000031s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003754s : 1.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000675s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000416s : 0.16% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.029005s : 11.04% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.02% Time group info: ------[substitution.] 0.000239 24 1.14% : 0.000003s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 4: substitution.graph_param_transform 83.20% : 0.000199s : 4: substitution.inline 2.02% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000006s : 4: substitution.remove_not_recompute_node 2.25% : 0.000005s : 2: substitution.replace_old_param 5.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.225964 2 98.44% : 0.222449s : 1: type_inference.infer 1.56% : 0.003515s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.99% : 0.000054s : 4: replace.inline 32.01% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.18% : 0.000196s : 4: match.inline 5.82% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 2.62% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.07% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.48% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 4: predicate.elim_not_effective 0.82% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.87% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.55% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.34% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.35% : 0.000010s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.30% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.51% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002687 22 64.40% : 0.001730s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.06% : 0.000915s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.271803 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000078s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.13% : 0.000360s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.25% : 0.008842s : 1: jit_opt_a 0.06% : 0.000156s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.16% : 0.000424s : 1: loop_unroll 0.25% : 0.000683s : 1: mutable_eliminate 0.36% : 0.000988s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000074s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000049s : 4: opt.transform.symbol_engine_opt 10.68% : 0.029036s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000541s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.03% : 0.002788s : 1: renormalize.infer 0.35% : 0.000956s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.04% : 0.000098s : 1: rewriter_before_opt_a 0.07% : 0.000187s : 1: symbol_engine_optimizer 83.18% : 0.226078s : 1: type_inference TotalTime = 0.033548, [30] [bootstrap]: 0.00037679 [type_inference]: 0.0235134 [event_method]: 2.161e-05 [auto_monad]: 7.198e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00015559 [rewriter_before_opt_a]: 8.546e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00695442, [2] [Cycle 1]: 0.00250147, [27] [switch_simplify]: 6.748e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00061176 [with_stream_mark]: 1.946e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00142721 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.76999e-06 [auto_monad_eliminator]: 1.531e-05 [cse]: 3.285e-05 [replace_applicator]: 1.281e-05 [Cycle 2]: 0.00032603, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.64998e-06 [a_1]: 9.422e-05 [with_stream_mark]: 1.022e-05 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.85002e-06 [cell_reuse_recompute_pass]: 1.14003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.314e-05 [j_node_and_user_rematch]: 7.93001e-06 [meta_fg_expand]: 1.76998e-06 [replace_old_param]: 6.88e-06 [inline_without_move]: 5.61e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.257e-05 [replace_applicator]: 5.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.44e-05 [rewriter_after_opt_a]: 4.017e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00059595 [jit_opt_b]: 5.247e-05, [1] [Cycle 1]: 4.534e-05, [2] [frontend_op_eliminate]: 1.792e-05 [inline_after_opt_a]: 1.653e-05 [cconv]: 3.131e-05 [loop_unroll]: 0.00045283 [jit_opt_after_cconv]: 0.00015443, [1] [Cycle 1]: 0.00014721, [11] [c_1]: 2.174e-05 [parameter_eliminate]: 3.5e-06 [updatestate_depend_eliminate]: 7.68999e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.665e-05 [call_graph_tuple_transform]: 2.083e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.86003e-06 [remove_dup_value]: 1.792e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 5.417e-05 [cse_after_recomputation]: 2.487e-05, [1] [Cycle 1]: 1.901e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.782e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.12999e-06 [opt_after_jit_grad]: 0.00053745 [symbol_engine_optimizer]: 8.023e-05, [1] [Cycle 1]: 7.324e-05, [6] [build]: 4.17998e-06 [elim_shapecalc]: 8.27998e-06 [elim_not_effective]: 1.438e-05 [opt_reshape]: 6.48e-06 [fold_const_symbol]: 1.003e-05 [renormalize]: 1.31002e-06 [validate]: 4.434e-05 Sums bootstrap : 0.000377s : 1.31% type_inference : 0.023513s : 81.64% event_method : 0.000022s : 0.08% auto_monad : 0.000072s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000156s : 0.54% rewriter_before_opt_a : 0.000085s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000706s : 2.45% jit_opt_a.with_stream_mark : 0.000030s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001427s : 4.96% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000045s : 0.16% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000596s : 2.07% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000031s : 0.11% loop_unroll : 0.000453s : 1.57% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000054s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000537s : 1.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.15% Time group info: ------[substitution.] 0.000259 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 2.03% : 0.000005s : 3: substitution.graph_param_transform 86.71% : 0.000225s : 4: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 5.13% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023421 2 90.87% : 0.021283s : 1: type_inference.infer 9.13% : 0.002139s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.52% : 0.000053s : 4: replace.inline 31.48% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.79% : 0.000223s : 4: match.inline 5.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.08% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 2.37% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.82% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.32% : 0.000002s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.75% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.94% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.66% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.24% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.28% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000009s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001050 13 40.56% : 0.000426s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.19% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.25% : 0.000569s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035963 72 0.16% : 0.000057s : 1: add_recomputation 0.21% : 0.000076s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.12% : 0.000402s : 1: bootstrap 0.09% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.35% : 0.006958s : 1: jit_opt_a 0.44% : 0.000157s : 1: jit_opt_after_cconv 0.15% : 0.000055s : 1: jit_opt_b 1.28% : 0.000462s : 1: loop_unroll 1.69% : 0.000606s : 1: mutable_eliminate 2.60% : 0.000935s : 26: opt.transform.jit_opt_a 0.14% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000548s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000160s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.29% : 0.000824s : 1: renormalize.infer 1.65% : 0.000593s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000090s : 1: rewriter_before_opt_a 0.23% : 0.000083s : 1: symbol_engine_optimizer 65.44% : 0.023535s : 1: type_inference TotalTime = 0.0612886, [30] [bootstrap]: 0.00033229 [type_inference]: 0.0516923 [event_method]: 1.78e-05 [auto_monad]: 0.00012043 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 3.582e-05 [rewriter_before_opt_a]: 8.657e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00683662, [2] [Cycle 1]: 0.00184453, [27] [switch_simplify]: 5.622e-05 [loop_unroll]: 2.859e-05 [a_1]: 0.0005159 [with_stream_mark]: 2.018e-05 [recompute_prepare]: 7.36001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 4.89003e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.354e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.00089743 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.455e-05 [cse]: 3.421e-05 [replace_applicator]: 1.217e-05 [Cycle 2]: 0.00042352, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 5.08002e-06 [a_1]: 0.00011737 [with_stream_mark]: 9.46003e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.77998e-06 [accelerated_algorithm]: 4.97e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.283e-05 [j_node_and_user_rematch]: 7.49002e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.25998e-06 [inline_without_move]: 2.354e-05 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.368e-05 [replace_applicator]: 5.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.158e-05 [rewriter_after_opt_a]: 9.477e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00056695 [jit_opt_b]: 4.736e-05, [1] [Cycle 1]: 4.054e-05, [2] [frontend_op_eliminate]: 1.534e-05 [inline_after_opt_a]: 1.474e-05 [cconv]: 2.521e-05 [loop_unroll]: 0.00040037 [jit_opt_after_cconv]: 0.00014165, [1] [Cycle 1]: 0.00013571, [11] [c_1]: 1.995e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 1.961e-05 [call_graph_tuple_transform]: 2.254e-05 [tuple_list_get_item_eliminator]: 5.20001e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.614e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 7.951e-05 [cse_after_recomputation]: 2.42e-05, [1] [Cycle 1]: 1.871e-05, [1] [cse]: 1.285e-05 [auto_monad_reorder]: 1.673e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 4.65999e-06 [opt_after_jit_grad]: 0.00043394 [symbol_engine_optimizer]: 6.922e-05, [1] [Cycle 1]: 6.317e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 7.56999e-06 [elim_not_effective]: 1.224e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.18999e-06 [renormalize]: 4.09986e-07 [validate]: 3.613e-05 Sums bootstrap : 0.000332s : 0.59% type_inference : 0.051692s : 92.14% event_method : 0.000018s : 0.03% auto_monad : 0.000120s : 0.21% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000036s : 0.06% rewriter_before_opt_a : 0.000087s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.11% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000633s : 1.13% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000029s : 0.05% jit_opt_a.renormalize : 0.000898s : 1.60% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000048s : 0.09% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000095s : 0.17% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000567s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000400s : 0.71% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000080s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000434s : 0.77% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.06% Time group info: ------[substitution.] 0.000206 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 4.89% : 0.000010s : 3: substitution.graph_param_transform 82.45% : 0.000169s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000004s : 2: substitution.replace_old_param 5.32% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051575 2 98.28% : 0.050687s : 1: type_inference.infer 1.72% : 0.000888s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.74% : 0.000043s : 4: replace.inline 33.26% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 94.43% : 0.000167s : 4: match.inline 5.57% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000001s : 10: predicate.addn_zero_filter 2.23% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.52% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000006s : 22: predicate.inline 1.03% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000002s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.18% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000768 13 60.18% : 0.000462s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.89% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.93% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063101 72 0.13% : 0.000083s : 1: add_recomputation 0.20% : 0.000125s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.55% : 0.000345s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.84% : 0.006840s : 1: jit_opt_a 0.23% : 0.000144s : 1: jit_opt_after_cconv 0.08% : 0.000050s : 1: jit_opt_b 0.65% : 0.000408s : 1: loop_unroll 0.91% : 0.000575s : 1: mutable_eliminate 1.36% : 0.000860s : 26: opt.transform.jit_opt_a 0.08% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000442s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000038s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.92% : 0.000578s : 1: renormalize.infer 0.49% : 0.000311s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000099s : 1: rewriter_after_opt_a 0.14% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000071s : 1: symbol_engine_optimizer 81.94% : 0.051708s : 1: type_inference TotalTime = 0.0151016, [30] [bootstrap]: 0.00029682 [type_inference]: 0.00634216 [event_method]: 2.215e-05 [auto_monad]: 6.74e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 5.268e-05 [rewriter_before_opt_a]: 9.411e-05 [expand_dump_flag]: 2.84999e-06 [jit_opt_a]: 0.0060964, [2] [Cycle 1]: 0.0019568, [27] [switch_simplify]: 6.081e-05 [loop_unroll]: 3.741e-05 [a_1]: 0.0007314 [with_stream_mark]: 1.67e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.429e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00077592 [add_forward_monad_depend]: 5.52001e-06 [auto_monad_grad]: 2.08002e-06 [auto_monad_eliminator]: 1.582e-05 [cse]: 3.182e-05 [replace_applicator]: 1.219e-05 [Cycle 2]: 0.00031991, [27] [switch_simplify]: 5.66998e-06 [loop_unroll]: 5.24e-06 [a_1]: 8.991e-05 [with_stream_mark]: 8.51002e-06 [recompute_prepare]: 5.06002e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.46002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.243e-05 [j_node_and_user_rematch]: 8.1e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 5.09e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.303e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.008e-05 [rewriter_after_opt_a]: 3.49e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00049235 [jit_opt_b]: 5.084e-05, [1] [Cycle 1]: 4.435e-05, [2] [frontend_op_eliminate]: 1.672e-05 [inline_after_opt_a]: 1.65e-05 [cconv]: 2.388e-05 [loop_unroll]: 0.00046647 [jit_opt_after_cconv]: 0.00014169, [1] [Cycle 1]: 0.0001353, [11] [c_1]: 2.113e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.088e-05 [call_graph_tuple_transform]: 1.839e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.49998e-06 [remove_dup_value]: 1.538e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 7.9e-06 [add_recomputation]: 4.784e-05 [cse_after_recomputation]: 2.45e-05, [1] [Cycle 1]: 1.856e-05, [1] [cse]: 1.279e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.49002e-06 [opt_after_jit_grad]: 0.0004622 [symbol_engine_optimizer]: 7.694e-05, [1] [Cycle 1]: 7.08e-05, [6] [build]: 7.22002e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 9.04e-06 [renormalize]: 3.60014e-07 [validate]: 4.055e-05 Sums bootstrap : 0.000297s : 2.78% type_inference : 0.006342s : 59.30% event_method : 0.000022s : 0.21% auto_monad : 0.000067s : 0.63% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000053s : 0.49% rewriter_before_opt_a : 0.000094s : 0.88% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.62% jit_opt_a.loop_unroll : 0.000043s : 0.40% jit_opt_a.a_1 : 0.000821s : 7.68% jit_opt_a.with_stream_mark : 0.000025s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000776s : 7.26% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.20% jit_opt_a.cse : 0.000045s : 0.42% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000035s : 0.33% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000492s : 4.60% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.16% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000024s : 0.22% loop_unroll : 0.000466s : 4.36% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.07% add_recomputation : 0.000048s : 0.45% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000462s : 4.32% symbol_engine_optimizer.build : 0.000007s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.38% Time group info: ------[substitution.] 0.000239 25 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.12% : 0.000005s : 3: substitution.graph_param_transform 85.09% : 0.000204s : 5: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000004s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 6.40% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006276 2 77.41% : 0.004858s : 1: type_inference.infer 22.59% : 0.001418s : 1: type_inference.specialize ------[replace.] 0.000105 8 62.96% : 0.000066s : 5: replace.inline 37.04% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 8 93.64% : 0.000201s : 5: match.inline 6.36% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 810 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.35% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.18% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.39% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000008s : 26: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 15: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.34% : 0.000000s : 3: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 21: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.55% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.75% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.66% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000990 16 50.06% : 0.000496s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.12% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.82% : 0.000434s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016985 72 0.37% : 0.000063s : 1: add_recomputation 0.42% : 0.000071s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.85% : 0.000314s : 1: bootstrap 0.16% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.15% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 35.91% : 0.006100s : 1: jit_opt_a 0.85% : 0.000144s : 1: jit_opt_after_cconv 0.31% : 0.000053s : 1: jit_opt_b 2.80% : 0.000475s : 1: loop_unroll 2.95% : 0.000501s : 1: mutable_eliminate 6.19% : 0.001051s : 26: opt.transform.jit_opt_a 0.28% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000471s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000056s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.35% : 0.000399s : 1: renormalize.infer 2.17% : 0.000369s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000038s : 1: rewriter_after_opt_a 0.57% : 0.000097s : 1: rewriter_before_opt_a 0.47% : 0.000080s : 1: symbol_engine_optimizer 37.42% : 0.006355s : 1: type_inference TotalTime = 0.0149932, [30] [bootstrap]: 0.00032285 [type_inference]: 0.00656331 [event_method]: 2.289e-05 [auto_monad]: 6.914e-05 [graph_reusing]: 5.50001e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 5.473e-05 [rewriter_before_opt_a]: 9.292e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00577716, [2] [Cycle 1]: 0.00197693, [27] [switch_simplify]: 5.87e-05 [loop_unroll]: 3.742e-05 [a_1]: 0.00068609 [with_stream_mark]: 1.664e-05 [recompute_prepare]: 8.15e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.344e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00086345 [add_forward_monad_depend]: 5.20999e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 1.483e-05 [cse]: 2.547e-05 [replace_applicator]: 1.312e-05 [Cycle 2]: 0.00032365, [27] [switch_simplify]: 6.09999e-06 [loop_unroll]: 5.24998e-06 [a_1]: 9.055e-05 [with_stream_mark]: 8.63001e-06 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.24e-05 [j_node_and_user_rematch]: 7.93999e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 5.04e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.342e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.071e-05 [rewriter_after_opt_a]: 3.249e-05 [convert_after_rewriter]: 5.88002e-06 [order_py_execute_after_rewriter]: 4.69998e-06 [mutable_eliminate]: 0.0005013 [jit_opt_b]: 5.599e-05, [1] [Cycle 1]: 4.436e-05, [2] [frontend_op_eliminate]: 1.644e-05 [inline_after_opt_a]: 1.593e-05 [cconv]: 1.977e-05 [loop_unroll]: 0.0004296 [jit_opt_after_cconv]: 0.00014324, [1] [Cycle 1]: 0.00013691, [11] [c_1]: 2.18e-05 [parameter_eliminate]: 2.31998e-06 [updatestate_depend_eliminate]: 5.67999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.004e-05 [call_graph_tuple_transform]: 1.764e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.31998e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.329e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 7.00998e-06 [add_recomputation]: 4.06e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.84e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.453e-05 [get_jit_bprop_graph]: 1.59998e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00048392 [symbol_engine_optimizer]: 7.849e-05, [1] [Cycle 1]: 7.257e-05, [6] [build]: 7.2e-06 [elim_shapecalc]: 8.48001e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.79998e-06 [renormalize]: 3.59985e-07 [validate]: 3.942e-05 Sums bootstrap : 0.000323s : 2.95% type_inference : 0.006563s : 59.95% event_method : 0.000023s : 0.21% auto_monad : 0.000069s : 0.63% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000055s : 0.50% rewriter_before_opt_a : 0.000093s : 0.85% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.59% jit_opt_a.loop_unroll : 0.000043s : 0.39% jit_opt_a.a_1 : 0.000777s : 7.09% jit_opt_a.with_stream_mark : 0.000025s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000864s : 7.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.19% jit_opt_a.cse : 0.000039s : 0.36% jit_opt_a.replace_applicator : 0.000018s : 0.17% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000032s : 0.30% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000501s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000020s : 0.18% loop_unroll : 0.000430s : 3.92% jit_opt_after_cconv.c_1 : 0.000022s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000013s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000041s : 0.37% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000015s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000484s : 4.42% symbol_engine_optimizer.build : 0.000007s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.36% Time group info: ------[substitution.] 0.000243 25 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 1.78% : 0.000004s : 3: substitution.graph_param_transform 86.39% : 0.000210s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 5.93% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006499 2 76.98% : 0.005003s : 1: type_inference.infer 23.02% : 0.001496s : 1: type_inference.specialize ------[replace.] 0.000107 8 64.35% : 0.000069s : 5: replace.inline 35.65% : 0.000038s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 8 94.21% : 0.000207s : 5: match.inline 5.79% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 810 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.34% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.45% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.28% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000007s : 26: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.22% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.35% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.70% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 21: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.67% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 20: predicate.switch_defer_inline 2.35% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.61% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001025 16 47.69% : 0.000489s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.49% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.82% : 0.000470s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016919 72 0.26% : 0.000043s : 1: add_recomputation 0.43% : 0.000073s : 1: auto_monad 0.10% : 0.000017s : 1: auto_monad_reorder 2.00% : 0.000338s : 1: bootstrap 0.13% : 0.000022s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.16% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 34.16% : 0.005780s : 1: jit_opt_a 0.86% : 0.000146s : 1: jit_opt_after_cconv 0.35% : 0.000059s : 1: jit_opt_b 2.58% : 0.000437s : 1: loop_unroll 3.01% : 0.000510s : 1: mutable_eliminate 5.95% : 0.001006s : 26: opt.transform.jit_opt_a 0.28% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.91% : 0.000492s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000058s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000016s : 1: remove_dup_value 2.70% : 0.000458s : 1: renormalize.infer 2.35% : 0.000398s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000035s : 1: rewriter_after_opt_a 0.57% : 0.000096s : 1: rewriter_before_opt_a 0.48% : 0.000081s : 1: symbol_engine_optimizer 38.86% : 0.006576s : 1: type_inference TotalTime = 0.20407, [30] [bootstrap]: 0.00034343 [type_inference]: 0.157139 [event_method]: 2.246e-05 [auto_monad]: 6.814e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00029056 [rewriter_before_opt_a]: 8.458e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.00766874, [2] [Cycle 1]: 0.00353745, [27] [switch_simplify]: 5.777e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00057026 [with_stream_mark]: 1.826e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 6.91999e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 6.37001e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 1.048e-05 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 6.27001e-06 [renormalize]: 0.00250903 [add_forward_monad_depend]: 6.01998e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 3.526e-05 [replace_applicator]: 1.627e-05 [Cycle 2]: 0.00036762, [27] [switch_simplify]: 7.17002e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.0001191 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 6.47001e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.74999e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.458e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.272e-05 [rewriter_after_opt_a]: 3.809e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00064621 [jit_opt_b]: 5.786e-05, [1] [Cycle 1]: 5.058e-05, [2] [frontend_op_eliminate]: 2.001e-05 [inline_after_opt_a]: 1.911e-05 [cconv]: 2.416e-05 [loop_unroll]: 0.00042388 [jit_opt_after_cconv]: 0.00015187, [1] [Cycle 1]: 0.00014528, [11] [c_1]: 2.592e-05 [parameter_eliminate]: 2.17001e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.306e-05 [call_graph_tuple_transform]: 2.054e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.697e-05 [partial_unused_args_eliminate]: 1.86e-06 [environ_conv]: 7.92e-06 [add_recomputation]: 4.678e-05 [cse_after_recomputation]: 2.376e-05, [1] [Cycle 1]: 1.882e-05, [1] [cse]: 1.309e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.0365084 [symbol_engine_optimizer]: 0.00014626, [1] [Cycle 1]: 0.00013311, [6] [build]: 8.88002e-06 [elim_shapecalc]: 3.446e-05 [elim_not_effective]: 2.504e-05 [opt_reshape]: 7.63001e-06 [fold_const_symbol]: 1.115e-05 [renormalize]: 4.80009e-07 [validate]: 7.622e-05 Sums bootstrap : 0.000343s : 0.17% type_inference : 0.157139s : 78.71% event_method : 0.000022s : 0.01% auto_monad : 0.000068s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000291s : 0.15% rewriter_before_opt_a : 0.000085s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000689s : 0.35% jit_opt_a.with_stream_mark : 0.000029s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002509s : 1.26% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000646s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000424s : 0.21% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000047s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.036508s : 18.29% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000034s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000076s : 0.04% Time group info: ------[substitution.] 0.000206 24 2.09% : 0.000004s : 2: substitution.elim_not_effective 0.79% : 0.000002s : 2: substitution.fold_const_symbol 3.04% : 0.000006s : 4: substitution.graph_param_transform 81.91% : 0.000169s : 4: substitution.inline 1.78% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000005s : 2: substitution.replace_old_param 5.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.157044 2 98.33% : 0.154424s : 1: type_inference.infer 1.67% : 0.002620s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.02% : 0.000055s : 4: replace.inline 30.98% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.92% : 0.000166s : 4: match.inline 6.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 2.01% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.07% : 0.000001s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.65% : 0.000001s : 4: predicate.elim_not_effective 2.32% : 0.000003s : 4: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.09% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.79% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000001s : 12: predicate.print_const_string_wrapper 1.74% : 0.000002s : 12: predicate.reduce_eliminate 1.29% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.52% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.24% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.80% : 0.000009s : 58: predicate.switch_simplify 1.42% : 0.000002s : 12: predicate.tile_eliminate 1.45% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002478 26 67.64% : 0.001676s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.19% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.17% : 0.000772s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.207564 72 0.02% : 0.000049s : 1: add_recomputation 0.03% : 0.000071s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.18% : 0.000364s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.70% : 0.007672s : 1: jit_opt_a 0.07% : 0.000155s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.21% : 0.000431s : 1: loop_unroll 0.32% : 0.000655s : 1: mutable_eliminate 0.45% : 0.000930s : 26: opt.transform.jit_opt_a 0.03% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000072s : 4: opt.transform.symbol_engine_opt 17.60% : 0.036538s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000296s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.84% : 0.001746s : 1: renormalize.infer 0.36% : 0.000754s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000150s : 1: symbol_engine_optimizer 75.72% : 0.157158s : 1: type_inference TotalTime = 0.0131156, [30] [bootstrap]: 0.00032362 [type_inference]: 0.00483909 [event_method]: 1.823e-05 [auto_monad]: 6.848e-05 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 3.655e-05 [rewriter_before_opt_a]: 7.174e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00565626, [2] [Cycle 1]: 0.00184691, [27] [switch_simplify]: 5.852e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00055813 [with_stream_mark]: 2.138e-05 [recompute_prepare]: 7.14001e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.04998e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00084381 [add_forward_monad_depend]: 5.80002e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.729e-05 [cse]: 3.098e-05 [replace_applicator]: 1.243e-05 [Cycle 2]: 0.00031688, [27] [switch_simplify]: 5.55001e-06 [loop_unroll]: 4.78001e-06 [a_1]: 9.111e-05 [with_stream_mark]: 1.021e-05 [recompute_prepare]: 4.77998e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.90001e-06 [updatestate_useless_node_eliminater]: 4.67998e-06 [accelerated_algorithm]: 4.56002e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 3.03998e-06 [cell_reuse_recompute_pass]: 2.50997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.392e-05 [j_node_and_user_rematch]: 7.80998e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.23999e-06 [inline_without_move]: 4.59002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.025e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.146e-05 [rewriter_after_opt_a]: 3.802e-05 [convert_after_rewriter]: 7.07997e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00055891 [jit_opt_b]: 5.144e-05, [1] [Cycle 1]: 4.32e-05, [2] [frontend_op_eliminate]: 1.638e-05 [inline_after_opt_a]: 1.532e-05 [cconv]: 2.693e-05 [loop_unroll]: 0.00040685 [jit_opt_after_cconv]: 0.00013905, [1] [Cycle 1]: 0.00013245, [11] [c_1]: 2.026e-05 [parameter_eliminate]: 2.51998e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.937e-05 [call_graph_tuple_transform]: 1.837e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 1.81003e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.517e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 5.76e-06 [add_recomputation]: 5.281e-05 [cse_after_recomputation]: 2.083e-05, [1] [Cycle 1]: 1.574e-05, [1] [cse]: 1.007e-05 [auto_monad_reorder]: 1.576e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 4.28999e-06 [opt_after_jit_grad]: 0.0004392 [symbol_engine_optimizer]: 7.423e-05, [1] [Cycle 1]: 6.765e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.279e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 4.40021e-07 [validate]: 4.112e-05 Sums bootstrap : 0.000324s : 3.58% type_inference : 0.004839s : 53.48% event_method : 0.000018s : 0.20% auto_monad : 0.000068s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.40% rewriter_before_opt_a : 0.000072s : 0.79% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000064s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.39% jit_opt_a.a_1 : 0.000649s : 7.18% jit_opt_a.with_stream_mark : 0.000032s : 0.35% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000844s : 9.33% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.25% jit_opt_a.cse : 0.000041s : 0.46% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000038s : 0.42% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000559s : 6.18% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000027s : 0.30% loop_unroll : 0.000407s : 4.50% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.58% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000439s : 4.85% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.45% Time group info: ------[substitution.] 0.000229 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000005s : 3: substitution.graph_param_transform 84.87% : 0.000194s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000004s : 2: substitution.replace_old_param 5.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004771 2 81.24% : 0.003876s : 1: type_inference.infer 18.76% : 0.000895s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.51% : 0.000049s : 4: replace.inline 31.49% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.27% : 0.000192s : 4: match.inline 5.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.49% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.90% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.05% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.78% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000756 13 54.26% : 0.000410s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.38% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.36% : 0.000297s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014870 72 0.37% : 0.000056s : 1: add_recomputation 0.48% : 0.000072s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.32% : 0.000345s : 1: bootstrap 0.20% : 0.000030s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.06% : 0.005660s : 1: jit_opt_a 0.95% : 0.000142s : 1: jit_opt_after_cconv 0.36% : 0.000054s : 1: jit_opt_b 2.79% : 0.000414s : 1: loop_unroll 3.81% : 0.000567s : 1: mutable_eliminate 5.80% : 0.000863s : 26: opt.transform.jit_opt_a 0.31% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.01% : 0.000447s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 3.07% : 0.000457s : 1: renormalize.infer 2.55% : 0.000379s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000041s : 1: rewriter_after_opt_a 0.50% : 0.000074s : 1: rewriter_before_opt_a 0.52% : 0.000077s : 1: symbol_engine_optimizer 32.63% : 0.004853s : 1: type_inference TotalTime = 0.0357633, [30] [bootstrap]: 0.00038515 [type_inference]: 0.0259663 [event_method]: 2.023e-05 [auto_monad]: 7.403e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00015199 [rewriter_before_opt_a]: 8.184e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00675696, [2] [Cycle 1]: 0.00288317, [27] [switch_simplify]: 6.387e-05 [loop_unroll]: 2.995e-05 [a_1]: 0.00064243 [with_stream_mark]: 4.04e-05 [recompute_prepare]: 9.08002e-06 [updatestate_depend_eliminate]: 5.08002e-06 [updatestate_assign_eliminate]: 1.008e-05 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 9.38002e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00172562 [add_forward_monad_depend]: 7.51001e-06 [auto_monad_grad]: 3.09999e-06 [auto_monad_eliminator]: 1.853e-05 [cse]: 3.652e-05 [replace_applicator]: 1.512e-05 [Cycle 2]: 0.0003304, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.61998e-06 [a_1]: 9.484e-05 [with_stream_mark]: 1.161e-05 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.534e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.267e-05 [replace_applicator]: 5.04998e-06 [py_interpret_to_execute_after_opt_a]: 1.434e-05 [rewriter_after_opt_a]: 3.926e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00066287 [jit_opt_b]: 5.294e-05, [1] [Cycle 1]: 4.562e-05, [2] [frontend_op_eliminate]: 1.831e-05 [inline_after_opt_a]: 1.588e-05 [cconv]: 2.737e-05 [loop_unroll]: 0.00043376 [jit_opt_after_cconv]: 0.00014839, [1] [Cycle 1]: 0.00014166, [11] [c_1]: 2.127e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.96003e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 3.24001e-06 [cse]: 2.396e-05 [call_graph_tuple_transform]: 1.978e-05 [tuple_list_get_item_eliminator]: 5.99e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.584e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 7.19001e-06 [add_recomputation]: 5.166e-05 [cse_after_recomputation]: 2.347e-05, [1] [Cycle 1]: 1.821e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.866e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00048586 [symbol_engine_optimizer]: 7.768e-05, [1] [Cycle 1]: 7.109e-05, [6] [build]: 3.99002e-06 [elim_shapecalc]: 8.87999e-06 [elim_not_effective]: 1.408e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 3.69997e-07 [validate]: 4.183e-05 Sums bootstrap : 0.000385s : 1.22% type_inference : 0.025966s : 82.15% event_method : 0.000020s : 0.06% auto_monad : 0.000074s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000152s : 0.48% rewriter_before_opt_a : 0.000082s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000737s : 2.33% jit_opt_a.with_stream_mark : 0.000052s : 0.16% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001726s : 5.46% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000049s : 0.16% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000663s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000027s : 0.09% loop_unroll : 0.000434s : 1.37% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000486s : 1.54% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.13% Time group info: ------[substitution.] 0.000239 23 1.08% : 0.000003s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 3: substitution.graph_param_transform 83.74% : 0.000200s : 4: substitution.inline 1.92% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000005s : 2: substitution.replace_old_param 5.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025887 2 92.76% : 0.024013s : 1: type_inference.infer 7.24% : 0.001874s : 1: type_inference.specialize ------[replace.] 0.000085 6 66.36% : 0.000056s : 4: replace.inline 33.64% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.30% : 0.000198s : 4: match.inline 5.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.15% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.92% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000003s : 10: predicate.arithmetic_simplify 1.05% : 0.000001s : 10: predicate.cast_eliminate 0.72% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 0.96% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.55% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.76% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.08% : 0.000007s : 22: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.56% : 0.000002s : 15: predicate.load_eliminater 1.05% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 0.94% : 0.000001s : 10: predicate.minmaximum_grad 1.16% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 1.96% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.20% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.78% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 0.99% : 0.000001s : 10: predicate.transpose_eliminate 1.16% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.02% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.23% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 13.01% : 0.000018s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001179 13 51.26% : 0.000604s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.66% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.08% : 0.000531s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038506 72 0.14% : 0.000055s : 1: add_recomputation 0.20% : 0.000078s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.05% : 0.000406s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.56% : 0.006761s : 1: jit_opt_a 0.39% : 0.000152s : 1: jit_opt_after_cconv 0.14% : 0.000055s : 1: jit_opt_b 1.15% : 0.000442s : 1: loop_unroll 1.75% : 0.000672s : 1: mutable_eliminate 2.52% : 0.000971s : 26: opt.transform.jit_opt_a 0.13% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.29% : 0.000495s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000156s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.13% : 0.000821s : 1: renormalize.infer 2.32% : 0.000894s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.22% : 0.000086s : 1: rewriter_before_opt_a 0.21% : 0.000080s : 1: symbol_engine_optimizer 67.48% : 0.025983s : 1: type_inference TotalTime = 0.0995295, [30] [bootstrap]: 0.00043921 [type_inference]: 0.0746912 [event_method]: 1.97e-05 [auto_monad]: 6.55e-05 [graph_reusing]: 5.26998e-06 [pre_auto_parallel]: 2.09e-06 [py_interpret_to_execute]: 0.00026065 [rewriter_before_opt_a]: 8.339e-05 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.0217458, [2] [Cycle 1]: 0.00367244, [27] [switch_simplify]: 6.393e-05 [loop_unroll]: 3.105e-05 [a_1]: 0.00064468 [with_stream_mark]: 2.271e-05 [recompute_prepare]: 9.53997e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 1.63002e-06 [specialize_transform]: 7.61001e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.76e-06 [meta_shard_fg_expand]: 1.96998e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 9.71998e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 6.49001e-06 [renormalize]: 0.0025488 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.58e-05 [cse]: 3.375e-05 [replace_applicator]: 1.48e-05 [Cycle 2]: 0.0003623, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00011819 [with_stream_mark]: 1.015e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.98998e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.394e-05 [j_node_and_user_rematch]: 8.42998e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.56e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.89995e-07 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 5.80002e-06 [cse]: 1.493e-05 [replace_applicator]: 6.08998e-06 [py_interpret_to_execute_after_opt_a]: 1.269e-05 [rewriter_after_opt_a]: 3.821e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 4.77998e-06 [mutable_eliminate]: 0.00060437 [jit_opt_b]: 5.358e-05, [1] [Cycle 1]: 4.713e-05, [2] [frontend_op_eliminate]: 1.849e-05 [inline_after_opt_a]: 1.756e-05 [cconv]: 2.375e-05 [loop_unroll]: 0.0004219 [jit_opt_after_cconv]: 0.00016547, [1] [Cycle 1]: 0.00015898, [11] [c_1]: 2.583e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 1.983e-05 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.258e-05 [call_graph_tuple_transform]: 1.998e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.678e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 7.87e-06 [add_recomputation]: 4.695e-05 [cse_after_recomputation]: 2.459e-05, [1] [Cycle 1]: 1.939e-05, [1] [cse]: 1.368e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00046075 [symbol_engine_optimizer]: 7.455e-05, [1] [Cycle 1]: 6.737e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 8.67e-06 [elim_not_effective]: 1.266e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 8.60999e-06 [renormalize]: 3.10014e-07 [validate]: 4.243e-05 Sums bootstrap : 0.000439s : 0.54% type_inference : 0.074691s : 91.96% event_method : 0.000020s : 0.02% auto_monad : 0.000066s : 0.08% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000261s : 0.32% rewriter_before_opt_a : 0.000083s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000763s : 0.94% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002549s : 3.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000049s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000604s : 0.74% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.03% loop_unroll : 0.000422s : 0.52% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000020s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000461s : 0.57% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.05% Time group info: ------[substitution.] 0.000243 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 86.80% : 0.000211s : 4: substitution.inline 1.10% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.58% : 0.000004s : 2: substitution.replace_old_param 5.12% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.074612 2 96.80% : 0.072227s : 1: type_inference.infer 3.20% : 0.002384s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.85% : 0.000054s : 4: replace.inline 33.15% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.93% : 0.000208s : 4: match.inline 5.07% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.19% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000001s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.57% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.72% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.45% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002423 26 68.40% : 0.001658s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.19% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.41% : 0.000713s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.103149 72 0.05% : 0.000050s : 1: add_recomputation 0.07% : 0.000069s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.45% : 0.000460s : 1: bootstrap 0.03% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 21.09% : 0.021750s : 1: jit_opt_a 0.16% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.42% : 0.000429s : 1: loop_unroll 0.59% : 0.000613s : 1: mutable_eliminate 0.98% : 0.001006s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000266s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.71% : 0.001765s : 1: renormalize.infer 0.75% : 0.000774s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.09% : 0.000088s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 72.43% : 0.074707s : 1: type_inference TotalTime = 0.0227461, [30] [bootstrap]: 0.00032062 [type_inference]: 0.0119603 [event_method]: 2.306e-05 [auto_monad]: 9.047e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 5.907e-05 [rewriter_before_opt_a]: 9.659e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.00809007, [2] [Cycle 1]: 0.00242708, [27] [switch_simplify]: 6.411e-05 [loop_unroll]: 3.77e-05 [a_1]: 0.00069827 [with_stream_mark]: 1.678e-05 [recompute_prepare]: 7.62002e-06 [updatestate_depend_eliminate]: 1.624e-05 [updatestate_assign_eliminate]: 3.81999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 2.22001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.135e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 3.71001e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 6.27001e-06 [renormalize]: 0.00092704 [add_forward_monad_depend]: 5.40001e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.476e-05 [cse]: 3.287e-05 [replace_applicator]: 1.235e-05 [Cycle 2]: 0.00033186, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.29998e-06 [a_1]: 9.709e-05 [with_stream_mark]: 9.67999e-06 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.58997e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 7.78999e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 7.32997e-06 [inline_without_move]: 5.07999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.341e-05 [replace_applicator]: 5.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.088e-05 [rewriter_after_opt_a]: 4.161e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00050808 [jit_opt_b]: 4.953e-05, [1] [Cycle 1]: 4.33e-05, [2] [frontend_op_eliminate]: 1.637e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.458e-05 [loop_unroll]: 0.00041987 [jit_opt_after_cconv]: 0.00014037, [1] [Cycle 1]: 0.00013428, [11] [c_1]: 2.115e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.02e-05 [call_graph_tuple_transform]: 1.817e-05 [tuple_list_get_item_eliminator]: 5.70001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.542e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 8.68001e-06 [add_recomputation]: 5.049e-05 [cse_after_recomputation]: 2.427e-05, [1] [Cycle 1]: 1.862e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.22003e-06 [opt_after_jit_grad]: 0.00047639 [symbol_engine_optimizer]: 7.992e-05, [1] [Cycle 1]: 7.363e-05, [6] [build]: 7.88001e-06 [elim_shapecalc]: 8.93002e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 6.07999e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 3.9002e-07 [validate]: 4.081e-05 Sums bootstrap : 0.000321s : 1.94% type_inference : 0.011960s : 72.38% event_method : 0.000023s : 0.14% auto_monad : 0.000090s : 0.55% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000059s : 0.36% rewriter_before_opt_a : 0.000097s : 0.58% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.43% jit_opt_a.loop_unroll : 0.000043s : 0.26% jit_opt_a.a_1 : 0.000795s : 4.81% jit_opt_a.with_stream_mark : 0.000026s : 0.16% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.12% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000927s : 5.61% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.13% jit_opt_a.cse : 0.000046s : 0.28% jit_opt_a.replace_applicator : 0.000018s : 0.11% py_interpret_to_execute_after_opt_a : 0.000011s : 0.07% rewriter_after_opt_a : 0.000042s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000508s : 3.07% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000025s : 0.15% loop_unroll : 0.000420s : 2.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000015s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000009s : 0.05% add_recomputation : 0.000050s : 0.31% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000017s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000476s : 2.88% symbol_engine_optimizer.build : 0.000008s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.25% Time group info: ------[substitution.] 0.000252 25 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 1.87% : 0.000005s : 3: substitution.graph_param_transform 86.29% : 0.000218s : 5: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000004s : 2: substitution.replace_old_param 5.35% : 0.000013s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011812 2 86.46% : 0.010213s : 1: type_inference.infer 13.54% : 0.001599s : 1: type_inference.specialize ------[replace.] 0.000107 8 62.23% : 0.000067s : 5: replace.inline 37.77% : 0.000041s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 8 94.74% : 0.000214s : 5: match.inline 5.26% : 0.000012s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 810 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.14% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 15: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.34% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 21: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.73% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.40% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.75% : 0.000011s : 64: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.67% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001123 16 49.81% : 0.000559s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.02% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.17% : 0.000496s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024764 72 0.22% : 0.000053s : 1: add_recomputation 0.38% : 0.000094s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.34% : 0.000333s : 1: bootstrap 0.11% : 0.000027s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.11% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 32.68% : 0.008093s : 1: jit_opt_a 0.58% : 0.000143s : 1: jit_opt_after_cconv 0.21% : 0.000052s : 1: jit_opt_b 1.73% : 0.000428s : 1: loop_unroll 2.09% : 0.000516s : 1: mutable_eliminate 4.19% : 0.001037s : 26: opt.transform.jit_opt_a 0.19% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000013s : 1: opt.transform.mutable_eliminate 0.09% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.96% : 0.000485s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000062s : 1: py_interpret_to_execute 0.05% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000018s : 1: remove_dup_value 2.07% : 0.000513s : 1: renormalize.infer 1.64% : 0.000405s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000045s : 1: rewriter_after_opt_a 0.40% : 0.000100s : 1: rewriter_before_opt_a 0.33% : 0.000083s : 1: symbol_engine_optimizer 48.36% : 0.011976s : 1: type_inference TotalTime = 0.224924, [30] [bootstrap]: 0.00027195 [type_inference]: 0.209914 [event_method]: 2.505e-05 [auto_monad]: 7.834e-05 [graph_reusing]: 6.18998e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00035799 [rewriter_before_opt_a]: 0.00010879 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0099843, [2] [Cycle 1]: 0.00551038, [27] [switch_simplify]: 7.477e-05 [loop_unroll]: 3.556e-05 [a_1]: 0.00076115 [with_stream_mark]: 2.661e-05 [recompute_prepare]: 1.21e-05 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 8.16002e-06 [updatestate_useless_node_eliminater]: 6.53e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.859e-05 [j_node_and_user_rematch]: 1.117e-05 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 6.71999e-06 [renormalize]: 0.00413809 [add_forward_monad_depend]: 1.073e-05 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 2.355e-05 [cse]: 4.507e-05 [replace_applicator]: 2.845e-05 [Cycle 2]: 0.00046182, [27] [switch_simplify]: 9.03002e-06 [loop_unroll]: 7.31001e-06 [a_1]: 0.00014099 [with_stream_mark]: 1.78e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 3.14999e-06 [get_grad_eliminate_]: 6.28998e-06 [merge_forward]: 4.84e-06 [cell_reuse_recompute_pass]: 2.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.083e-05 [j_node_and_user_rematch]: 1.191e-05 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 1.168e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.69999e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 1.265e-05 [cse]: 2.21e-05 [replace_applicator]: 9.29e-06 [py_interpret_to_execute_after_opt_a]: 2.013e-05 [rewriter_after_opt_a]: 4.975e-05 [convert_after_rewriter]: 8.08999e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00116947 [jit_opt_b]: 7.484e-05, [1] [Cycle 1]: 6.438e-05, [2] [frontend_op_eliminate]: 2.557e-05 [inline_after_opt_a]: 2.367e-05 [cconv]: 3.615e-05 [loop_unroll]: 0.00067981 [jit_opt_after_cconv]: 0.00020465, [1] [Cycle 1]: 0.00019614, [11] [c_1]: 3.14e-05 [parameter_eliminate]: 4.32e-06 [updatestate_depend_eliminate]: 9.84001e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 4.634e-05 [call_graph_tuple_transform]: 2.657e-05 [tuple_list_get_item_eliminator]: 7.04001e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 8.2e-06 [remove_dup_value]: 2.254e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 1.186e-05 [add_recomputation]: 6.336e-05 [cse_after_recomputation]: 3.23e-05, [1] [Cycle 1]: 2.518e-05, [1] [cse]: 1.667e-05 [auto_monad_reorder]: 1.981e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 1.013e-05 [opt_after_jit_grad]: 0.00069325 [symbol_engine_optimizer]: 9.356e-05, [1] [Cycle 1]: 8.422e-05, [6] [build]: 7.02002e-06 [elim_shapecalc]: 9.24e-06 [elim_not_effective]: 1.698e-05 [opt_reshape]: 8.77e-06 [fold_const_symbol]: 1.216e-05 [renormalize]: 7.79983e-07 [validate]: 0.00071369 Sums bootstrap : 0.000272s : 0.12% type_inference : 0.209914s : 95.36% event_method : 0.000025s : 0.01% auto_monad : 0.000078s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000358s : 0.16% rewriter_before_opt_a : 0.000109s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.000902s : 0.41% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004138s : 1.88% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.02% jit_opt_a.cse : 0.000067s : 0.03% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000050s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001169s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000036s : 0.02% loop_unroll : 0.000680s : 0.31% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000063s : 0.03% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000693s : 0.31% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000714s : 0.32% Time group info: ------[substitution.] 0.000300 25 0.88% : 0.000003s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000007s : 4: substitution.graph_param_transform 85.08% : 0.000255s : 5: substitution.inline 1.65% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000008s : 4: substitution.remove_not_recompute_node 2.20% : 0.000007s : 2: substitution.replace_old_param 4.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.209816 2 98.82% : 0.207338s : 1: type_inference.infer 1.18% : 0.002478s : 1: type_inference.specialize ------[replace.] 0.000113 7 66.36% : 0.000075s : 5: replace.inline 33.64% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000263 7 95.63% : 0.000252s : 5: match.inline 4.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 888 1.43% : 0.000002s : 13: predicate.accumulaten_eliminater 1.90% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 1.78% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.73% : 0.000009s : 28: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.36% : 0.000004s : 19: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.48% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 2.36% : 0.000004s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 1.97% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.14% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.38% : 0.000002s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.65% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.29% : 0.000012s : 65: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.59% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.91% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004116 29 46.57% : 0.001917s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.30% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 51.13% : 0.002104s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.229695 72 0.03% : 0.000068s : 1: add_recomputation 0.04% : 0.000082s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.12% : 0.000284s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000035s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.35% : 0.009989s : 1: jit_opt_a 0.09% : 0.000208s : 1: jit_opt_after_cconv 0.03% : 0.000079s : 1: jit_opt_b 0.30% : 0.000689s : 1: loop_unroll 0.52% : 0.001194s : 1: mutable_eliminate 0.52% : 0.001197s : 26: opt.transform.jit_opt_a 0.03% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000034s : 1: opt.transform.mutable_eliminate 0.02% : 0.000043s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000712s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000364s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000026s : 1: remove_dup_value 0.85% : 0.001943s : 1: renormalize.infer 0.95% : 0.002182s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000055s : 1: rewriter_after_opt_a 0.05% : 0.000114s : 1: rewriter_before_opt_a 0.04% : 0.000097s : 1: symbol_engine_optimizer 91.40% : 0.209939s : 1: type_inference TotalTime = 0.0530682, [30] [bootstrap]: 0.00041017 [type_inference]: 0.0452444 [event_method]: 1.915e-05 [auto_monad]: 6.262e-05 [graph_reusing]: 4.90001e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 8.922e-05 [rewriter_before_opt_a]: 7.416e-05 [expand_dump_flag]: 3.78999e-06 [jit_opt_a]: 0.00525141, [2] [Cycle 1]: 0.00161387, [27] [switch_simplify]: 4.703e-05 [loop_unroll]: 3.045e-05 [a_1]: 0.00047695 [with_stream_mark]: 1.353e-05 [recompute_prepare]: 6.87002e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.95002e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 6.06998e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.61002e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.351e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.00072624 [add_forward_monad_depend]: 2.911e-05 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.301e-05 [cse]: 2.141e-05 [replace_applicator]: 1.043e-05 [Cycle 2]: 0.00030473, [27] [switch_simplify]: 5.22999e-06 [loop_unroll]: 4.92999e-06 [a_1]: 8.591e-05 [with_stream_mark]: 7.88001e-06 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.08002e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.08002e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 4.92999e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.50002e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.203e-05 [j_node_and_user_rematch]: 7.38999e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 6.78998e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 1.182e-05 [replace_applicator]: 5.29998e-06 [py_interpret_to_execute_after_opt_a]: 9.15999e-06 [rewriter_after_opt_a]: 2.991e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00045328 [jit_opt_b]: 4.568e-05, [1] [Cycle 1]: 4.001e-05, [2] [frontend_op_eliminate]: 1.467e-05 [inline_after_opt_a]: 1.524e-05 [cconv]: 2.242e-05 [loop_unroll]: 0.00039778 [jit_opt_after_cconv]: 0.0001321, [1] [Cycle 1]: 0.00012643, [11] [c_1]: 1.971e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 1.913e-05 [call_graph_tuple_transform]: 1.617e-05 [tuple_list_get_item_eliminator]: 5.15001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.13002e-06 [remove_dup_value]: 1.339e-05 [partial_unused_args_eliminate]: 1.80001e-06 [environ_conv]: 4.86002e-06 [add_recomputation]: 4.11e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.913e-05, [1] [cse]: 1.329e-05 [auto_monad_reorder]: 1.528e-05 [get_jit_bprop_graph]: 1.46998e-06 [rewriter_after_jit_bprop_graph]: 3.98001e-06 [opt_after_jit_grad]: 0.00043736 [symbol_engine_optimizer]: 6.802e-05, [1] [Cycle 1]: 6.216e-05, [6] [build]: 2.51e-06 [elim_shapecalc]: 7.21001e-06 [elim_not_effective]: 1.237e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.49998e-06 [renormalize]: 3.50003e-07 [validate]: 3.117e-05 Sums bootstrap : 0.000410s : 0.83% type_inference : 0.045244s : 91.97% event_method : 0.000019s : 0.04% auto_monad : 0.000063s : 0.13% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000089s : 0.18% rewriter_before_opt_a : 0.000074s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000052s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000563s : 1.14% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000726s : 1.48% jit_opt_a.add_forward_monad_depend : 0.000030s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.04% jit_opt_a.cse : 0.000033s : 0.07% jit_opt_a.replace_applicator : 0.000016s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000453s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000022s : 0.05% loop_unroll : 0.000398s : 0.81% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000013s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000041s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000437s : 0.89% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.06% Time group info: ------[substitution.] 0.000167 23 1.21% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000004s : 3: substitution.graph_param_transform 83.91% : 0.000140s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000004s : 4: substitution.remove_not_recompute_node 1.94% : 0.000003s : 2: substitution.replace_old_param 5.71% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045184 2 96.86% : 0.043764s : 1: type_inference.infer 3.14% : 0.001420s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.37% : 0.000042s : 4: replace.inline 32.63% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 94.27% : 0.000138s : 4: match.inline 5.73% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000106 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.49% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.57% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000002s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.88% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000008s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.29% : 0.000003s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.08% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000765 13 48.44% : 0.000371s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.98% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.58% : 0.000364s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054608 72 0.08% : 0.000044s : 1: add_recomputation 0.12% : 0.000066s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.78% : 0.000424s : 1: bootstrap 0.05% : 0.000025s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.62% : 0.005254s : 1: jit_opt_a 0.25% : 0.000134s : 1: jit_opt_after_cconv 0.09% : 0.000048s : 1: jit_opt_b 0.74% : 0.000405s : 1: loop_unroll 0.85% : 0.000461s : 1: mutable_eliminate 1.40% : 0.000762s : 26: opt.transform.jit_opt_a 0.08% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000445s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000092s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 0.73% : 0.000399s : 1: renormalize.infer 0.59% : 0.000320s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000033s : 1: rewriter_after_opt_a 0.14% : 0.000078s : 1: rewriter_before_opt_a 0.13% : 0.000070s : 1: symbol_engine_optimizer 82.88% : 0.045258s : 1: type_inference TotalTime = 0.0672657, [30] [bootstrap]: 0.000326 [type_inference]: 0.0306465 [event_method]: 2.635e-05 [auto_monad]: 8.605e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 0.0002274 [rewriter_before_opt_a]: 9.764e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.032389, [2] [Cycle 1]: 0.00313825, [27] [switch_simplify]: 8.126e-05 [loop_unroll]: 3.128e-05 [a_1]: 0.00069385 [with_stream_mark]: 2.575e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.79999e-06 [specialize_transform]: 7.4e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.51999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.801e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.96001e-06 [replace_old_param]: 1.151e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00187642 [add_forward_monad_depend]: 9.74e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 2.143e-05 [cse]: 4.223e-05 [replace_applicator]: 2.259e-05 [Cycle 2]: 0.00038045, [27] [switch_simplify]: 6.66999e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00010989 [with_stream_mark]: 1.52e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 5.29998e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 6.98998e-06 [meta_shard_fg_expand]: 1.78002e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 2.36998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.777e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 8.89998e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 7.19001e-06 [cse]: 1.509e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.958e-05 [rewriter_after_opt_a]: 4.411e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00091122 [jit_opt_b]: 6.18e-05, [1] [Cycle 1]: 5.202e-05, [2] [frontend_op_eliminate]: 2.003e-05 [inline_after_opt_a]: 1.834e-05 [cconv]: 3.546e-05 [loop_unroll]: 0.00051566 [jit_opt_after_cconv]: 0.00017929, [1] [Cycle 1]: 0.00017112, [11] [c_1]: 2.325e-05 [parameter_eliminate]: 4.67e-06 [updatestate_depend_eliminate]: 8.48001e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 4.35999e-06 [cse]: 3.785e-05 [call_graph_tuple_transform]: 2.453e-05 [tuple_list_get_item_eliminator]: 6.74001e-06 [none_parameter_eliminate]: 2.02001e-06 [renormalize]: 1.07e-06 [switch_simplify]: 5.30999e-06 [remove_dup_value]: 1.807e-05 [partial_unused_args_eliminate]: 2.73003e-06 [environ_conv]: 7.80998e-06 [add_recomputation]: 5.955e-05 [cse_after_recomputation]: 2.48e-05, [1] [Cycle 1]: 1.923e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.873e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 9.89999e-06 [opt_after_jit_grad]: 0.00107584 [symbol_engine_optimizer]: 9.597e-05, [1] [Cycle 1]: 8.612e-05, [6] [build]: 7.47002e-06 [elim_shapecalc]: 1.361e-05 [elim_not_effective]: 1.741e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 1.103e-05 [renormalize]: 3.7998e-07 [validate]: 0.00013296 Sums bootstrap : 0.000326s : 0.86% type_inference : 0.030647s : 81.31% event_method : 0.000026s : 0.07% auto_monad : 0.000086s : 0.23% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000227s : 0.60% rewriter_before_opt_a : 0.000098s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000088s : 0.23% jit_opt_a.loop_unroll : 0.000037s : 0.10% jit_opt_a.a_1 : 0.000804s : 2.13% jit_opt_a.with_stream_mark : 0.000041s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001876s : 4.98% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.08% jit_opt_a.cse : 0.000057s : 0.15% jit_opt_a.replace_applicator : 0.000028s : 0.07% py_interpret_to_execute_after_opt_a : 0.000020s : 0.05% rewriter_after_opt_a : 0.000044s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000911s : 2.42% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000035s : 0.09% loop_unroll : 0.000516s : 1.37% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000060s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.001076s : 2.85% symbol_engine_optimizer.build : 0.000007s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000133s : 0.35% Time group info: ------[substitution.] 0.000322 23 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000002s : 2: substitution.fold_const_symbol 2.47% : 0.000008s : 3: substitution.graph_param_transform 86.33% : 0.000278s : 4: substitution.inline 1.43% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000006s : 4: substitution.remove_not_recompute_node 1.87% : 0.000006s : 2: substitution.replace_old_param 4.51% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.030540 2 90.60% : 0.027670s : 1: type_inference.infer 9.40% : 0.002870s : 1: type_inference.specialize ------[replace.] 0.000095 6 68.62% : 0.000065s : 4: replace.inline 31.38% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000288 6 95.36% : 0.000275s : 4: match.inline 4.64% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 1.72% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 10: predicate.addn_check_dump 1.54% : 0.000002s : 10: predicate.addn_zero_filter 2.47% : 0.000003s : 10: predicate.arithmetic_simplify 1.01% : 0.000001s : 10: predicate.cast_eliminate 0.68% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 10: predicate.compare_switch_simplify 1.14% : 0.000002s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.99% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.05% : 0.000008s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.32% : 0.000003s : 6: predicate.less_batch_normalization 1.27% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.37% : 0.000003s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.34% : 0.000002s : 10: predicate.print_const_string_wrapper 2.12% : 0.000003s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000011s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.48% : 0.000002s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.98% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.27% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.33% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001277 13 34.59% : 0.000442s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.97% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 60.44% : 0.000772s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070191 72 0.09% : 0.000063s : 1: add_recomputation 0.13% : 0.000091s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.49% : 0.000347s : 1: bootstrap 0.05% : 0.000038s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 46.15% : 0.032393s : 1: jit_opt_a 0.26% : 0.000184s : 1: jit_opt_after_cconv 0.09% : 0.000065s : 1: jit_opt_b 0.75% : 0.000524s : 1: loop_unroll 1.32% : 0.000926s : 1: mutable_eliminate 1.53% : 0.001074s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000022s : 1: opt.transform.mutable_eliminate 0.05% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.56% : 0.001092s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000235s : 1: py_interpret_to_execute 0.03% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.60% : 0.001126s : 1: renormalize.infer 1.05% : 0.000737s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000048s : 1: rewriter_after_opt_a 0.15% : 0.000103s : 1: rewriter_before_opt_a 0.14% : 0.000100s : 1: symbol_engine_optimizer 43.68% : 0.030660s : 1: type_inference TotalTime = 0.0200709, [30] [bootstrap]: 0.00039738 [type_inference]: 0.0105327 [event_method]: 2.335e-05 [auto_monad]: 7.414e-05 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 5.748e-05 [rewriter_before_opt_a]: 8.871e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.0064334, [2] [Cycle 1]: 0.00245061, [27] [switch_simplify]: 6.245e-05 [loop_unroll]: 3.364e-05 [a_1]: 0.00070527 [with_stream_mark]: 2.371e-05 [recompute_prepare]: 7.73001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.03e-05 [inline_without_move]: 8.20999e-06 [renormalize]: 0.00116449 [add_forward_monad_depend]: 7.4e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.918e-05 [cse]: 4.495e-05 [replace_applicator]: 1.597e-05 [Cycle 2]: 0.00035104, [27] [switch_simplify]: 6.14001e-06 [loop_unroll]: 5.66e-06 [a_1]: 9.89e-05 [with_stream_mark]: 1.267e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.58003e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.57999e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.696e-05 [j_node_and_user_rematch]: 8.60999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.04e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 1.33002e-06 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.609e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 1.562e-05 [rewriter_after_opt_a]: 4.431e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 6.671e-05 [mutable_eliminate]: 0.00069619 [jit_opt_b]: 5.305e-05, [1] [Cycle 1]: 4.558e-05, [2] [frontend_op_eliminate]: 1.693e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 2.919e-05 [loop_unroll]: 0.00043336 [jit_opt_after_cconv]: 0.00015233, [1] [Cycle 1]: 0.00014575, [11] [c_1]: 2.108e-05 [parameter_eliminate]: 2.99001e-06 [updatestate_depend_eliminate]: 5.86998e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.694e-05 [call_graph_tuple_transform]: 2.024e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 4.189e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 6.17999e-06 [add_recomputation]: 5.17e-05 [cse_after_recomputation]: 2.591e-05, [1] [Cycle 1]: 1.988e-05, [1] [cse]: 1.394e-05 [auto_monad_reorder]: 3.818e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.79999e-06 [opt_after_jit_grad]: 0.00046903 [symbol_engine_optimizer]: 7.434e-05, [1] [Cycle 1]: 6.78e-05, [6] [build]: 3.73999e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.302e-05 [opt_reshape]: 6.24999e-06 [fold_const_symbol]: 9.04e-06 [renormalize]: 3.39991e-07 [validate]: 4.276e-05 Sums bootstrap : 0.000397s : 2.51% type_inference : 0.010533s : 66.57% event_method : 0.000023s : 0.15% auto_monad : 0.000074s : 0.47% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.36% rewriter_before_opt_a : 0.000089s : 0.56% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.43% jit_opt_a.loop_unroll : 0.000039s : 0.25% jit_opt_a.a_1 : 0.000804s : 5.08% jit_opt_a.with_stream_mark : 0.000036s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000099s : 0.63% jit_opt_a.inline_without_move : 0.000013s : 0.08% jit_opt_a.renormalize : 0.001165s : 7.36% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.16% jit_opt_a.cse : 0.000061s : 0.39% jit_opt_a.replace_applicator : 0.000022s : 0.14% py_interpret_to_execute_after_opt_a : 0.000016s : 0.10% rewriter_after_opt_a : 0.000044s : 0.28% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000067s : 0.42% mutable_eliminate : 0.000696s : 4.40% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000029s : 0.18% loop_unroll : 0.000433s : 2.74% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000042s : 0.26% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000052s : 0.33% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000038s : 0.24% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000469s : 2.96% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.27% Time group info: ------[substitution.] 0.000359 24 0.53% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.47% : 0.000005s : 3: substitution.graph_param_transform 68.21% : 0.000245s : 5: substitution.inline 1.06% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.38% : 0.000005s : 4: substitution.remove_not_recompute_node 22.88% : 0.000082s : 2: substitution.replace_old_param 4.07% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010454 2 86.98% : 0.009092s : 1: type_inference.infer 13.02% : 0.001362s : 1: type_inference.specialize ------[replace.] 0.000124 7 52.23% : 0.000065s : 5: replace.inline 47.77% : 0.000059s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 94.76% : 0.000241s : 5: match.inline 5.24% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.32% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.56% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000003s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 11: predicate.compare_switch_simplify 1.21% : 0.000002s : 11: predicate.depend_value_elim 1.08% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.60% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000002s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000008s : 24: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.07% : 0.000001s : 11: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000002s : 11: predicate.print_const_string_wrapper 1.67% : 0.000002s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 19: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 59: predicate.switch_simplify 1.38% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.81% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001009 16 54.04% : 0.000545s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.25% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.72% : 0.000381s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022405 72 0.24% : 0.000054s : 1: add_recomputation 0.35% : 0.000078s : 1: auto_monad 0.18% : 0.000041s : 1: auto_monad_reorder 1.86% : 0.000417s : 1: bootstrap 0.14% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000029s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 28.73% : 0.006437s : 1: jit_opt_a 0.69% : 0.000155s : 1: jit_opt_after_cconv 0.25% : 0.000056s : 1: jit_opt_b 1.97% : 0.000442s : 1: loop_unroll 3.15% : 0.000705s : 1: mutable_eliminate 5.00% : 0.001121s : 26: opt.transform.jit_opt_a 0.22% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.13% : 0.000477s : 1: opt_after_jit_grad 0.31% : 0.000070s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000060s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000045s : 1: remove_dup_value 2.63% : 0.000590s : 1: renormalize.infer 2.52% : 0.000564s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000047s : 1: rewriter_after_opt_a 0.41% : 0.000092s : 1: rewriter_before_opt_a 0.34% : 0.000077s : 1: symbol_engine_optimizer 47.10% : 0.010553s : 1: type_inference TotalTime = 0.0525585, [30] [bootstrap]: 0.00038112 [type_inference]: 0.0443547 [event_method]: 1.867e-05 [auto_monad]: 6.318e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 9.42e-05 [rewriter_before_opt_a]: 7.872e-05 [expand_dump_flag]: 3.07002e-06 [jit_opt_a]: 0.0055221, [2] [Cycle 1]: 0.00224115, [27] [switch_simplify]: 5.172e-05 [loop_unroll]: 2.913e-05 [a_1]: 0.00049256 [with_stream_mark]: 1.659e-05 [recompute_prepare]: 7.52002e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.0013364 [add_forward_monad_depend]: 4.99e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.323e-05 [cse]: 3.092e-05 [replace_applicator]: 1.178e-05 [Cycle 2]: 0.00030892, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 4.92999e-06 [a_1]: 8.654e-05 [with_stream_mark]: 8.50001e-06 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.31998e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.05001e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 7.87e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 4.87e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.43002e-06 [cse]: 1.225e-05 [replace_applicator]: 4.89998e-06 [py_interpret_to_execute_after_opt_a]: 9.39e-06 [rewriter_after_opt_a]: 3.386e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00049688 [jit_opt_b]: 4.696e-05, [1] [Cycle 1]: 4.065e-05, [2] [frontend_op_eliminate]: 1.502e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 2.49e-05 [loop_unroll]: 0.00039203 [jit_opt_after_cconv]: 0.0001326, [1] [Cycle 1]: 0.0001268, [11] [c_1]: 1.982e-05 [parameter_eliminate]: 2.18998e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 1.814e-05 [call_graph_tuple_transform]: 1.788e-05 [tuple_list_get_item_eliminator]: 5.15001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.634e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 5.76003e-06 [add_recomputation]: 7.769e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.827e-05, [1] [cse]: 1.227e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00046522 [symbol_engine_optimizer]: 6.915e-05, [1] [Cycle 1]: 6.311e-05, [6] [build]: 2.84999e-06 [elim_shapecalc]: 7.13e-06 [elim_not_effective]: 1.225e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.78001e-06 [renormalize]: 4.30009e-07 [validate]: 3.268e-05 Sums bootstrap : 0.000381s : 0.78% type_inference : 0.044355s : 90.45% event_method : 0.000019s : 0.04% auto_monad : 0.000063s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000094s : 0.19% rewriter_before_opt_a : 0.000079s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.12% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000579s : 1.18% jit_opt_a.with_stream_mark : 0.000025s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001336s : 2.73% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.04% jit_opt_a.cse : 0.000043s : 0.09% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000034s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000497s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000392s : 0.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000078s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000465s : 0.95% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.07% Time group info: ------[substitution.] 0.000177 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.98% : 0.000005s : 3: substitution.graph_param_transform 81.96% : 0.000145s : 4: substitution.inline 1.77% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000004s : 4: substitution.remove_not_recompute_node 2.31% : 0.000004s : 2: substitution.replace_old_param 6.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.044291 2 96.77% : 0.042859s : 1: type_inference.infer 3.23% : 0.001431s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.00% : 0.000045s : 4: replace.inline 32.00% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 92.85% : 0.000143s : 4: match.inline 7.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000108 691 1.31% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000001s : 10: predicate.addn_zero_filter 2.18% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.42% : 0.000002s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.34% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.67% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.19% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000001s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.27% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.98% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000826 13 50.20% : 0.000415s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.55% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.25% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054736 72 0.15% : 0.000081s : 1: add_recomputation 0.12% : 0.000067s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.74% : 0.000403s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.09% : 0.005525s : 1: jit_opt_a 0.25% : 0.000135s : 1: jit_opt_after_cconv 0.09% : 0.000050s : 1: jit_opt_b 0.73% : 0.000399s : 1: loop_unroll 0.92% : 0.000505s : 1: mutable_eliminate 1.43% : 0.000785s : 26: opt.transform.jit_opt_a 0.08% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000097s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.75% : 0.000955s : 1: renormalize.infer 0.68% : 0.000373s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000037s : 1: rewriter_after_opt_a 0.15% : 0.000082s : 1: rewriter_before_opt_a 0.13% : 0.000072s : 1: symbol_engine_optimizer 81.06% : 0.044368s : 1: type_inference TotalTime = 0.182459, [30] [bootstrap]: 0.00037245 [type_inference]: 0.166465 [event_method]: 2.223e-05 [auto_monad]: 7.219e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00366197 [rewriter_before_opt_a]: 0.0001202 [expand_dump_flag]: 5.06997e-06 [jit_opt_a]: 0.00925896, [2] [Cycle 1]: 0.00476021, [27] [switch_simplify]: 6.206e-05 [loop_unroll]: 8.514e-05 [a_1]: 0.00065198 [with_stream_mark]: 2.48e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 7.06999e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 1.097e-05 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 6.53998e-06 [renormalize]: 0.00356113 [add_forward_monad_depend]: 7.47002e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 2.015e-05 [cse]: 3.473e-05 [replace_applicator]: 1.904e-05 [Cycle 2]: 0.00037578, [27] [switch_simplify]: 7.11001e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012618 [with_stream_mark]: 1.197e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 8.90999e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 8.82999e-06 [inline_without_move]: 5.66e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 1.38002e-06 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.178e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 2.126e-05 [rewriter_after_opt_a]: 3.996e-05 [convert_after_rewriter]: 7.81001e-06 [order_py_execute_after_rewriter]: 5.58002e-06 [mutable_eliminate]: 0.00071292 [jit_opt_b]: 5.769e-05, [1] [Cycle 1]: 5.076e-05, [2] [frontend_op_eliminate]: 2.063e-05 [inline_after_opt_a]: 1.886e-05 [cconv]: 2.822e-05 [loop_unroll]: 0.00042523 [jit_opt_after_cconv]: 0.00015648, [1] [Cycle 1]: 0.00015033, [11] [c_1]: 2.577e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.312e-05 [call_graph_tuple_transform]: 2.157e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.678e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 9.00999e-06 [add_recomputation]: 5.505e-05 [cse_after_recomputation]: 2.403e-05, [1] [Cycle 1]: 1.684e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.63e-05 [get_jit_bprop_graph]: 2.03997e-06 [rewriter_after_jit_bprop_graph]: 4.85999e-06 [opt_after_jit_grad]: 0.00045739 [symbol_engine_optimizer]: 0.00016541, [1] [Cycle 1]: 0.00015849, [6] [build]: 3.93001e-06 [elim_shapecalc]: 8.34002e-06 [elim_not_effective]: 1.534e-05 [opt_reshape]: 6.68998e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 5.69999e-07 [validate]: 5.042e-05 Sums bootstrap : 0.000372s : 0.21% type_inference : 0.166465s : 93.72% event_method : 0.000022s : 0.01% auto_monad : 0.000072s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.003662s : 2.06% rewriter_before_opt_a : 0.000120s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.04% jit_opt_a.loop_unroll : 0.000091s : 0.05% jit_opt_a.a_1 : 0.000778s : 0.44% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003561s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000047s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000713s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000425s : 0.24% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000055s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000457s : 0.26% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000273 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 4: substitution.graph_param_transform 85.76% : 0.000234s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_old_param 4.91% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.166375 2 97.94% : 0.162945s : 1: type_inference.infer 2.06% : 0.003430s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.78% : 0.000057s : 4: replace.inline 30.22% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 94.97% : 0.000232s : 4: match.inline 5.03% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.15% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.42% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.67% : 0.000001s : 4: predicate.graph_param_transform 5.67% : 0.000008s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.28% : 0.000002s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000001s : 12: predicate.print_const_string_wrapper 1.72% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 58: predicate.switch_simplify 1.14% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.95% : 0.000003s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002476 22 65.60% : 0.001624s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.28% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.11% : 0.000795s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.187155 72 0.03% : 0.000058s : 1: add_recomputation 0.04% : 0.000076s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.21% : 0.000393s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.95% : 0.009263s : 1: jit_opt_a 0.08% : 0.000159s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.23% : 0.000433s : 1: loop_unroll 0.39% : 0.000721s : 1: mutable_eliminate 0.58% : 0.001080s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000465s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 1.97% : 0.003684s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.43% : 0.002674s : 1: renormalize.infer 0.47% : 0.000877s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000127s : 1: rewriter_before_opt_a 0.09% : 0.000168s : 1: symbol_engine_optimizer 88.96% : 0.166486s : 1: type_inference TotalTime = 0.0651555, [30] [bootstrap]: 0.00029435 [type_inference]: 0.0150978 [event_method]: 2.272e-05 [auto_monad]: 7.432e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 5.99e-05 [rewriter_before_opt_a]: 9.37e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00575723, [2] [Cycle 1]: 0.00206918, [27] [switch_simplify]: 6.007e-05 [loop_unroll]: 3.351e-05 [a_1]: 0.00067597 [with_stream_mark]: 1.983e-05 [recompute_prepare]: 7.03998e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.62998e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00093519 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.551e-05 [cse]: 4.183e-05 [replace_applicator]: 1.273e-05 [Cycle 2]: 0.00031835, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 4.98001e-06 [a_1]: 8.85e-05 [with_stream_mark]: 8.87e-06 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.96997e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.324e-05 [j_node_and_user_rematch]: 7.98999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.74002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 5.47999e-06 [cse]: 1.459e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.117e-05 [rewriter_after_opt_a]: 3.703e-05 [convert_after_rewriter]: 6.41e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00051592 [jit_opt_b]: 4.824e-05, [1] [Cycle 1]: 4.177e-05, [2] [frontend_op_eliminate]: 1.575e-05 [inline_after_opt_a]: 1.55e-05 [cconv]: 2.554e-05 [loop_unroll]: 0.00040756 [jit_opt_after_cconv]: 0.00014236, [1] [Cycle 1]: 0.00013631, [11] [c_1]: 2.101e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 2.242e-05 [call_graph_tuple_transform]: 1.839e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 3.235e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 5.61e-06 [add_recomputation]: 5.065e-05 [cse_after_recomputation]: 2.334e-05, [1] [Cycle 1]: 1.821e-05, [1] [cse]: 1.248e-05 [auto_monad_reorder]: 1.765e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 4.15999e-06 [opt_after_jit_grad]: 0.0420627 [symbol_engine_optimizer]: 9.783e-05, [1] [Cycle 1]: 8.806e-05, [6] [build]: 5.70001e-06 [elim_shapecalc]: 1.37e-05 [elim_not_effective]: 2.03e-05 [opt_reshape]: 7.73001e-06 [fold_const_symbol]: 1.042e-05 [renormalize]: 2.69996e-07 [validate]: 4.965e-05 Sums bootstrap : 0.000294s : 0.48% type_inference : 0.015098s : 24.68% event_method : 0.000023s : 0.04% auto_monad : 0.000074s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000060s : 0.10% rewriter_before_opt_a : 0.000094s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.11% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000764s : 1.25% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000935s : 1.53% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000056s : 0.09% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000516s : 0.84% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000408s : 0.67% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000032s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.042063s : 68.75% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.08% Time group info: ------[substitution.] 0.000292 24 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 3: substitution.graph_param_transform 87.92% : 0.000257s : 5: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.65% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000005s : 2: substitution.replace_old_param 4.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015017 2 90.78% : 0.013631s : 1: type_inference.infer 9.22% : 0.001385s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.10% : 0.000065s : 5: replace.inline 31.90% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 95.70% : 0.000254s : 5: match.inline 4.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.17% : 0.000002s : 11: predicate.accumulaten_eliminater 2.46% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 1.79% : 0.000002s : 11: predicate.arithmetic_simplify 1.17% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.16% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.60% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.87% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000007s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.11% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.34% : 0.000002s : 3: predicate.mutable_eliminate 0.77% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 16: predicate.partial_eliminate 1.09% : 0.000001s : 11: predicate.print_const_string_wrapper 2.12% : 0.000003s : 11: predicate.reduce_eliminate 1.39% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.14% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 3.95% : 0.000005s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.45% : 0.000010s : 59: predicate.switch_simplify 1.31% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.31% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 11: predicate.value_based_eliminate 0.38% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001072 16 53.25% : 0.000571s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.50% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.25% : 0.000431s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108679 72 0.05% : 0.000053s : 1: add_recomputation 0.07% : 0.000078s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.29% : 0.000315s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.30% : 0.005760s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000051s : 1: jit_opt_b 0.38% : 0.000416s : 1: loop_unroll 0.48% : 0.000524s : 1: mutable_eliminate 0.91% : 0.000985s : 26: opt.transform.jit_opt_a 0.04% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 38.26% : 0.041580s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000047s : 4: opt.transform.symbol_engine_opt 38.72% : 0.042078s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000063s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000035s : 1: remove_dup_value 0.48% : 0.000526s : 1: renormalize.infer 0.37% : 0.000401s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000097s : 1: rewriter_before_opt_a 0.09% : 0.000101s : 1: symbol_engine_optimizer 13.91% : 0.015117s : 1: type_inference TotalTime = 0.117472, [30] [bootstrap]: 0.00030932 [type_inference]: 0.10621 [event_method]: 2.947e-05 [auto_monad]: 9.165e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00037008 [rewriter_before_opt_a]: 0.00010193 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00805061, [2] [Cycle 1]: 0.00264948, [27] [switch_simplify]: 6.812e-05 [loop_unroll]: 3.048e-05 [a_1]: 0.00061089 [with_stream_mark]: 2.292e-05 [recompute_prepare]: 7.8e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.63002e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 6.32001e-06 [renormalize]: 0.00156803 [add_forward_monad_depend]: 6.29999e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.649e-05 [cse]: 3.72e-05 [replace_applicator]: 1.442e-05 [Cycle 2]: 0.00032356, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 5.09003e-06 [a_1]: 9.249e-05 [with_stream_mark]: 1.006e-05 [recompute_prepare]: 5.56998e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.61003e-06 [meta_shard_fg_expand]: 1.02998e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 2.91999e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 1.283e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 4.126e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00063652 [jit_opt_b]: 4.961e-05, [1] [Cycle 1]: 4.295e-05, [2] [frontend_op_eliminate]: 1.612e-05 [inline_after_opt_a]: 1.646e-05 [cconv]: 2.738e-05 [loop_unroll]: 0.00044172 [jit_opt_after_cconv]: 0.00014547, [1] [Cycle 1]: 0.00013892, [11] [c_1]: 2.154e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 6.16998e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.269e-05 [call_graph_tuple_transform]: 1.829e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.36998e-06 [remove_dup_value]: 1.586e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 6.54001e-06 [add_recomputation]: 4.826e-05 [cse_after_recomputation]: 2.239e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.19e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 5.85002e-06 [opt_after_jit_grad]: 0.00047788 [symbol_engine_optimizer]: 0.00010038, [1] [Cycle 1]: 9.43e-05, [6] [build]: 2.83998e-06 [elim_shapecalc]: 7.52002e-06 [elim_not_effective]: 1.424e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 1.022e-05 [renormalize]: 3.69997e-07 [validate]: 3.315e-05 Sums bootstrap : 0.000309s : 0.28% type_inference : 0.106210s : 95.03% event_method : 0.000029s : 0.03% auto_monad : 0.000092s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000370s : 0.33% rewriter_before_opt_a : 0.000102s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.07% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000703s : 0.63% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001568s : 1.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000637s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000442s : 0.40% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000478s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000262 23 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000005s : 3: substitution.graph_param_transform 87.21% : 0.000228s : 4: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 4.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106062 2 33.11% : 0.035115s : 1: type_inference.infer 66.89% : 0.070947s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.87% : 0.000055s : 4: replace.inline 32.13% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 95.26% : 0.000226s : 4: match.inline 4.74% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.28% : 0.000002s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.97% : 0.000004s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000009s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001162 13 38.21% : 0.000444s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.80% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.99% : 0.000662s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120033 72 0.04% : 0.000051s : 1: add_recomputation 0.08% : 0.000095s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000330s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000036s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.71% : 0.008055s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.04% : 0.000052s : 1: jit_opt_b 0.37% : 0.000449s : 1: loop_unroll 0.54% : 0.000645s : 1: mutable_eliminate 0.78% : 0.000936s : 26: opt.transform.jit_opt_a 0.04% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000374s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.80% : 0.000959s : 1: renormalize.infer 0.50% : 0.000599s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.09% : 0.000106s : 1: rewriter_before_opt_a 0.09% : 0.000103s : 1: symbol_engine_optimizer 88.51% : 0.106237s : 1: type_inference TotalTime = 0.0130876, [30] [bootstrap]: 0.00029099 [type_inference]: 0.00443846 [event_method]: 1.631e-05 [auto_monad]: 5.912e-05 [graph_reusing]: 5.35001e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 3.076e-05 [rewriter_before_opt_a]: 7.134e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.00483115, [2] [Cycle 1]: 0.00136815, [27] [switch_simplify]: 5.012e-05 [loop_unroll]: 2.846e-05 [a_1]: 0.00047834 [with_stream_mark]: 1.41e-05 [recompute_prepare]: 6.94999e-06 [updatestate_depend_eliminate]: 3.55998e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00048947 [add_forward_monad_depend]: 4.57e-06 [auto_monad_grad]: 1.79e-06 [auto_monad_eliminator]: 1.382e-05 [cse]: 3.145e-05 [replace_applicator]: 1.133e-05 [Cycle 2]: 0.00031022, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 4.77998e-06 [a_1]: 8.663e-05 [with_stream_mark]: 8.52998e-06 [recompute_prepare]: 4.70999e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 9.69972e-07 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.127e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 6.69999e-06 [inline_without_move]: 4.82e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.229e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 7.88999e-06 [rewriter_after_opt_a]: 3.143e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00045285 [jit_opt_b]: 4.577e-05, [1] [Cycle 1]: 3.962e-05, [2] [frontend_op_eliminate]: 1.426e-05 [inline_after_opt_a]: 1.514e-05 [cconv]: 2.235e-05 [loop_unroll]: 0.00042682 [jit_opt_after_cconv]: 0.0001408, [1] [Cycle 1]: 0.00013481, [11] [c_1]: 2.005e-05 [parameter_eliminate]: 2.21e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 1.863e-05 [call_graph_tuple_transform]: 2.245e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.22999e-06 [remove_dup_value]: 0.0013403 [partial_unused_args_eliminate]: 4.25e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 5.062e-05 [cse_after_recomputation]: 3.554e-05, [1] [Cycle 1]: 2.814e-05, [1] [cse]: 1.745e-05 [auto_monad_reorder]: 1.847e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 4.57e-06 [opt_after_jit_grad]: 0.00047075 [symbol_engine_optimizer]: 7.006e-05, [1] [Cycle 1]: 6.426e-05, [6] [build]: 2.79999e-06 [elim_shapecalc]: 7.57998e-06 [elim_not_effective]: 1.258e-05 [opt_reshape]: 5.42999e-06 [fold_const_symbol]: 8.15999e-06 [renormalize]: 6.89994e-07 [validate]: 3.363e-05 Sums bootstrap : 0.000291s : 3.10% type_inference : 0.004438s : 47.31% event_method : 0.000016s : 0.17% auto_monad : 0.000059s : 0.63% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000031s : 0.33% rewriter_before_opt_a : 0.000071s : 0.76% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000056s : 0.60% jit_opt_a.loop_unroll : 0.000033s : 0.35% jit_opt_a.a_1 : 0.000565s : 6.02% jit_opt_a.with_stream_mark : 0.000023s : 0.24% jit_opt_a.recompute_prepare : 0.000012s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000490s : 5.22% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.21% jit_opt_a.cse : 0.000044s : 0.47% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000008s : 0.08% rewriter_after_opt_a : 0.000031s : 0.34% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000453s : 4.83% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000022s : 0.24% loop_unroll : 0.000427s : 4.55% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.001340s : 14.29% partial_unused_args_eliminate : 0.000004s : 0.05% environ_conv : 0.000008s : 0.08% add_recomputation : 0.000051s : 0.54% cse_after_recomputation.cse : 0.000017s : 0.19% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000471s : 5.02% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000034s : 0.36% Time group info: ------[substitution.] 0.000169 23 1.13% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.03% : 0.000005s : 3: substitution.graph_param_transform 82.27% : 0.000139s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000004s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 6.61% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004382 2 81.46% : 0.003570s : 1: type_inference.infer 18.54% : 0.000813s : 1: type_inference.specialize ------[replace.] 0.000059 6 65.58% : 0.000039s : 4: replace.inline 34.42% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 93.08% : 0.000137s : 4: match.inline 6.92% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000107 691 1.58% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.38% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.33% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.36% : 0.000001s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000002s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.46% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.55% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.27% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000583 13 56.13% : 0.000327s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.73% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.14% : 0.000228s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014403 72 0.37% : 0.000054s : 1: add_recomputation 0.43% : 0.000062s : 1: auto_monad 0.15% : 0.000021s : 1: auto_monad_reorder 2.11% : 0.000304s : 1: bootstrap 0.17% : 0.000025s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.26% : 0.000038s : 1: cse_after_recomputation 0.07% : 0.000010s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 33.56% : 0.004834s : 1: jit_opt_a 1.00% : 0.000143s : 1: jit_opt_after_cconv 0.33% : 0.000048s : 1: jit_opt_b 3.02% : 0.000434s : 1: loop_unroll 3.20% : 0.000461s : 1: mutable_eliminate 5.30% : 0.000764s : 26: opt.transform.jit_opt_a 0.35% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000479s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.05% : 0.000007s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000033s : 1: py_interpret_to_execute 0.07% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 9.38% : 0.001350s : 1: remove_dup_value 1.81% : 0.000261s : 1: renormalize.infer 1.54% : 0.000221s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000034s : 1: rewriter_after_opt_a 0.51% : 0.000074s : 1: rewriter_before_opt_a 0.50% : 0.000072s : 1: symbol_engine_optimizer 30.89% : 0.004450s : 1: type_inference TotalTime = 0.0164343, [30] [bootstrap]: 0.00038843 [type_inference]: 0.00822728 [event_method]: 2.084e-05 [auto_monad]: 4.656e-05 [graph_reusing]: 3.98001e-06 [pre_auto_parallel]: 1.92999e-06 [py_interpret_to_execute]: 5.445e-05 [rewriter_before_opt_a]: 8.484e-05 [expand_dump_flag]: 1.98997e-06 [jit_opt_a]: 0.00556973, [2] [Cycle 1]: 0.0018991, [27] [switch_simplify]: 5.32e-05 [loop_unroll]: 3.697e-05 [a_1]: 0.00063566 [with_stream_mark]: 1.183e-05 [recompute_prepare]: 7.31001e-06 [updatestate_depend_eliminate]: 3.54002e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 2.56998e-06 [cell_reuse_recompute_pass]: 8.39995e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.117e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.22e-06 [inline_without_move]: 6.00002e-06 [renormalize]: 0.00086547 [add_forward_monad_depend]: 7.7e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 1.138e-05 [cse]: 2.05e-05 [replace_applicator]: 1.225e-05 [Cycle 2]: 0.00032699, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.191e-05 [with_stream_mark]: 9.09998e-06 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.33e-05 [j_node_and_user_rematch]: 8.20999e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.335e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 9.20999e-06 [rewriter_after_opt_a]: 2.751e-05 [convert_after_rewriter]: 5.30001e-06 [order_py_execute_after_rewriter]: 4.07e-06 [mutable_eliminate]: 0.00050803 [jit_opt_b]: 5.855e-05, [1] [Cycle 1]: 5.158e-05, [2] [frontend_op_eliminate]: 2.288e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 1.652e-05 [loop_unroll]: 0.00043037 [jit_opt_after_cconv]: 0.00014273, [1] [Cycle 1]: 0.00013604, [11] [c_1]: 2.232e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 6.14999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.047e-05 [call_graph_tuple_transform]: 1.663e-05 [tuple_list_get_item_eliminator]: 5.98002e-06 [none_parameter_eliminate]: 9.09989e-07 [renormalize]: 2.69996e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 8.56002e-06 [partial_unused_args_eliminate]: 1.58002e-06 [environ_conv]: 6.88998e-06 [add_recomputation]: 3.076e-05 [cse_after_recomputation]: 2.29e-05, [1] [Cycle 1]: 1.777e-05, [1] [cse]: 1.213e-05 [auto_monad_reorder]: 1.12e-05 [get_jit_bprop_graph]: 1.61998e-06 [rewriter_after_jit_bprop_graph]: 4.15e-06 [opt_after_jit_grad]: 0.00046908 [symbol_engine_optimizer]: 7.735e-05, [1] [Cycle 1]: 7.136e-05, [6] [build]: 7.98999e-06 [elim_shapecalc]: 8.52998e-06 [elim_not_effective]: 1.219e-05 [opt_reshape]: 5.96998e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 4.2998e-07 [validate]: 3.336e-05 Sums bootstrap : 0.000388s : 3.10% type_inference : 0.008227s : 65.64% event_method : 0.000021s : 0.17% auto_monad : 0.000047s : 0.37% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000054s : 0.43% rewriter_before_opt_a : 0.000085s : 0.68% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000059s : 0.47% jit_opt_a.loop_unroll : 0.000042s : 0.34% jit_opt_a.a_1 : 0.000728s : 5.81% jit_opt_a.with_stream_mark : 0.000021s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000005s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000866s : 6.91% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.14% jit_opt_a.cse : 0.000034s : 0.27% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000009s : 0.07% rewriter_after_opt_a : 0.000028s : 0.22% convert_after_rewriter : 0.000005s : 0.04% order_py_execute_after_rewriter : 0.000004s : 0.03% mutable_eliminate : 0.000508s : 4.05% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.18% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000017s : 0.13% loop_unroll : 0.000430s : 3.43% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000009s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000031s : 0.25% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000011s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000469s : 3.74% symbol_engine_optimizer.build : 0.000008s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.27% Time group info: ------[substitution.] 0.000201 25 0.67% : 0.000001s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.79% : 0.000004s : 3: substitution.graph_param_transform 86.66% : 0.000174s : 5: substitution.inline 1.23% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000004s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 5.23% : 0.000011s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008171 2 82.27% : 0.006722s : 1: type_inference.infer 17.73% : 0.001449s : 1: type_inference.specialize ------[replace.] 0.000100 8 63.04% : 0.000063s : 5: replace.inline 36.96% : 0.000037s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 8 95.04% : 0.000171s : 5: match.inline 4.96% : 0.000009s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 810 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.44% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.14% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.41% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000007s : 26: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.52% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 15: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.22% : 0.000002s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000003s : 21: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.52% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001115 16 53.83% : 0.000600s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.02% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.15% : 0.000459s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018321 72 0.18% : 0.000034s : 1: add_recomputation 0.27% : 0.000050s : 1: auto_monad 0.08% : 0.000014s : 1: auto_monad_reorder 2.23% : 0.000408s : 1: bootstrap 0.11% : 0.000019s : 1: cconv 0.04% : 0.000008s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000006s : 1: graph_reusing 30.42% : 0.005572s : 1: jit_opt_a 0.79% : 0.000145s : 1: jit_opt_after_cconv 0.33% : 0.000061s : 1: jit_opt_b 2.39% : 0.000438s : 1: loop_unroll 2.81% : 0.000515s : 1: mutable_eliminate 5.18% : 0.000948s : 26: opt.transform.jit_opt_a 0.26% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000034s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.61% : 0.000478s : 1: opt_after_jit_grad 0.03% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000057s : 1: py_interpret_to_execute 0.06% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000011s : 1: remove_dup_value 1.92% : 0.000352s : 1: renormalize.infer 2.76% : 0.000506s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000031s : 1: rewriter_after_opt_a 0.48% : 0.000088s : 1: rewriter_before_opt_a 0.44% : 0.000080s : 1: symbol_engine_optimizer 44.96% : 0.008237s : 1: type_inference TotalTime = 0.071528, [30] [bootstrap]: 0.00034971 [type_inference]: 0.0592314 [event_method]: 3.784e-05 [auto_monad]: 0.00011567 [graph_reusing]: 6.50002e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00047296 [rewriter_before_opt_a]: 0.00011027 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00816414, [2] [Cycle 1]: 0.00371381, [27] [switch_simplify]: 0.00012105 [loop_unroll]: 3.027e-05 [a_1]: 0.00146315 [with_stream_mark]: 2.468e-05 [recompute_prepare]: 1.037e-05 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 2.76e-06 [specialize_transform]: 6.23002e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 2.74999e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 1.086e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.095e-05 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00167565 [add_forward_monad_depend]: 7.77e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 1.8e-05 [cse]: 3.991e-05 [replace_applicator]: 1.822e-05 [Cycle 2]: 0.00038917, [27] [switch_simplify]: 6.61e-06 [loop_unroll]: 6.23e-06 [a_1]: 9.587e-05 [with_stream_mark]: 1.21e-05 [recompute_prepare]: 5.51998e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 5.54e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.61998e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.51999e-06 [cse]: 6.03e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 1.715e-05 [rewriter_after_opt_a]: 4.285e-05 [convert_after_rewriter]: 7.87998e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00086139 [jit_opt_b]: 6.437e-05, [1] [Cycle 1]: 5.376e-05, [2] [frontend_op_eliminate]: 1.926e-05 [inline_after_opt_a]: 1.972e-05 [cconv]: 3.661e-05 [loop_unroll]: 0.00060411 [jit_opt_after_cconv]: 0.00019776, [1] [Cycle 1]: 0.00018994, [11] [c_1]: 2.671e-05 [parameter_eliminate]: 5.69e-06 [updatestate_depend_eliminate]: 1.146e-05 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 4.418e-05 [call_graph_tuple_transform]: 2.605e-05 [tuple_list_get_item_eliminator]: 5.78002e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 2.00002e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.909e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 7.43999e-06 [add_recomputation]: 6.077e-05 [cse_after_recomputation]: 2.477e-05, [1] [Cycle 1]: 1.873e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.834e-05 [get_jit_bprop_graph]: 3.78001e-06 [rewriter_after_jit_bprop_graph]: 1.009e-05 [opt_after_jit_grad]: 0.00058216 [symbol_engine_optimizer]: 0.00016342, [1] [Cycle 1]: 0.00015512, [6] [build]: 5.69e-06 [elim_shapecalc]: 1.033e-05 [elim_not_effective]: 1.58e-05 [opt_reshape]: 8.065e-05 [fold_const_symbol]: 1.247e-05 [renormalize]: 5.09986e-07 [validate]: 5.963e-05 Sums bootstrap : 0.000350s : 0.52% type_inference : 0.059231s : 88.72% event_method : 0.000038s : 0.06% auto_monad : 0.000116s : 0.17% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000473s : 0.71% rewriter_before_opt_a : 0.000110s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000128s : 0.19% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.001559s : 2.34% jit_opt_a.with_stream_mark : 0.000037s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001676s : 2.51% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000100s : 0.15% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000043s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000861s : 1.29% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000037s : 0.05% loop_unroll : 0.000604s : 0.90% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000061s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000004s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000582s : 0.87% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000081s : 0.12% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000060s : 0.09% Time group info: ------[substitution.] 0.000322 23 1.07% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 3: substitution.graph_param_transform 87.33% : 0.000281s : 4: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.47% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 4.46% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.044382 2 94.33% : 0.041864s : 1: type_inference.infer 5.67% : 0.002518s : 1: type_inference.specialize ------[replace.] 0.000097 6 72.69% : 0.000071s : 4: replace.inline 27.31% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 6 95.46% : 0.000278s : 4: match.inline 4.54% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.04% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000003s : 10: predicate.arithmetic_simplify 1.20% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 0.91% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.22% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.85% : 0.000009s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.23% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 15: predicate.load_eliminater 2.94% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.56% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.93% : 0.000001s : 10: predicate.minmaximum_grad 2.96% : 0.000004s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.45% : 0.000005s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.81% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.23% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.90% : 0.000003s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001477 13 49.06% : 0.000725s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.26% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.68% : 0.000690s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075184 72 0.08% : 0.000064s : 1: add_recomputation 0.16% : 0.000120s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.49% : 0.000368s : 1: bootstrap 0.05% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.06% : 0.000043s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 10.86% : 0.008169s : 1: jit_opt_a 0.27% : 0.000201s : 1: jit_opt_after_cconv 0.09% : 0.000067s : 1: jit_opt_b 0.82% : 0.000618s : 1: loop_unroll 1.16% : 0.000875s : 1: mutable_eliminate 2.46% : 0.001853s : 26: opt.transform.jit_opt_a 0.08% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000022s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000116s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000594s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.64% : 0.000479s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 1.35% : 0.001012s : 1: renormalize.infer 0.87% : 0.000653s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000046s : 1: rewriter_after_opt_a 0.15% : 0.000116s : 1: rewriter_before_opt_a 0.22% : 0.000167s : 1: symbol_engine_optimizer 78.82% : 0.059261s : 1: type_inference TotalTime = 0.0684338, [30] [bootstrap]: 0.00027727 [type_inference]: 0.0602356 [event_method]: 2.324e-05 [auto_monad]: 6.945e-05 [graph_reusing]: 5.57001e-06 [pre_auto_parallel]: 2.21e-06 [py_interpret_to_execute]: 9.585e-05 [rewriter_before_opt_a]: 8.082e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00550054, [2] [Cycle 1]: 0.00185071, [27] [switch_simplify]: 5.347e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00052857 [with_stream_mark]: 2.05e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 4.27e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.13002e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 0.00088416 [add_forward_monad_depend]: 4.70001e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.445e-05 [cse]: 3.58e-05 [replace_applicator]: 1.149e-05 [Cycle 2]: 0.00032013, [27] [switch_simplify]: 5.61998e-06 [loop_unroll]: 5.37001e-06 [a_1]: 8.876e-05 [with_stream_mark]: 9.54999e-06 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 7.7e-07 [specialize_transform]: 4.97999e-06 [updatestate_useless_node_eliminater]: 4.99998e-06 [accelerated_algorithm]: 4.98001e-06 [meta_shard_fg_expand]: 9.99979e-07 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 2.85998e-06 [cell_reuse_recompute_pass]: 1.85001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 4.65001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.278e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 1.128e-05 [rewriter_after_opt_a]: 3.801e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 4.84998e-06 [mutable_eliminate]: 0.00054763 [jit_opt_b]: 5.113e-05, [1] [Cycle 1]: 4.304e-05, [2] [frontend_op_eliminate]: 1.587e-05 [inline_after_opt_a]: 1.648e-05 [cconv]: 2.91e-05 [loop_unroll]: 0.00042389 [jit_opt_after_cconv]: 0.00014747, [1] [Cycle 1]: 0.0001411, [11] [c_1]: 1.981e-05 [parameter_eliminate]: 3.09999e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.514e-05 [call_graph_tuple_transform]: 1.843e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 7.00002e-06 [add_recomputation]: 5.616e-05 [cse_after_recomputation]: 2.513e-05, [1] [Cycle 1]: 1.942e-05, [1] [cse]: 1.324e-05 [auto_monad_reorder]: 1.836e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.92999e-06 [opt_after_jit_grad]: 0.00044989 [symbol_engine_optimizer]: 6.982e-05, [1] [Cycle 1]: 6.36e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 7.71999e-06 [elim_not_effective]: 1.186e-05 [opt_reshape]: 5.47999e-06 [fold_const_symbol]: 8.13999e-06 [renormalize]: 3.60014e-07 [validate]: 3.864e-05 Sums bootstrap : 0.000277s : 0.43% type_inference : 0.060236s : 93.37% event_method : 0.000023s : 0.04% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000096s : 0.15% rewriter_before_opt_a : 0.000081s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000617s : 0.96% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000884s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000049s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000548s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000424s : 0.66% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000450s : 0.70% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.06% Time group info: ------[substitution.] 0.000206 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 84.51% : 0.000174s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 5.74% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060076 2 97.48% : 0.058565s : 1: type_inference.infer 2.52% : 0.001512s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.97% : 0.000044s : 4: replace.inline 32.03% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 94.14% : 0.000172s : 4: match.inline 5.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.94% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.99% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.06% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 3.17% : 0.000004s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.04% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000830 13 45.35% : 0.000376s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.32% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.33% : 0.000409s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070201 72 0.10% : 0.000067s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.42% : 0.000296s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.84% : 0.005504s : 1: jit_opt_a 0.21% : 0.000150s : 1: jit_opt_after_cconv 0.08% : 0.000054s : 1: jit_opt_b 0.62% : 0.000432s : 1: loop_unroll 0.80% : 0.000559s : 1: mutable_eliminate 1.18% : 0.000829s : 26: opt.transform.jit_opt_a 0.07% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000099s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.73% : 0.000510s : 1: renormalize.infer 0.52% : 0.000366s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000084s : 1: rewriter_before_opt_a 0.10% : 0.000072s : 1: symbol_engine_optimizer 85.83% : 0.060256s : 1: type_inference TotalTime = 0.486877, [30] [bootstrap]: 0.00029367 [type_inference]: 0.466854 [event_method]: 2.697e-05 [auto_monad]: 8.491e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 3.07002e-06 [py_interpret_to_execute]: 0.00092428 [rewriter_before_opt_a]: 0.00011528 [expand_dump_flag]: 5.00001e-06 [jit_opt_a]: 0.0155585, [2] [Cycle 1]: 0.0101347, [27] [switch_simplify]: 8.257e-05 [loop_unroll]: 3.286e-05 [a_1]: 0.00081065 [with_stream_mark]: 2.997e-05 [recompute_prepare]: 1.242e-05 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 3.08e-06 [specialize_transform]: 8.66002e-06 [updatestate_useless_node_eliminater]: 7.35e-06 [accelerated_algorithm]: 8.12e-06 [meta_shard_fg_expand]: 3.33e-06 [get_grad_eliminate_]: 9.27999e-06 [merge_forward]: 5.86e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.08e-05 [j_node_and_user_rematch]: 1.35e-05 [meta_fg_expand]: 3.65e-06 [replace_old_param]: 1.391e-05 [inline_without_move]: 7.63001e-06 [renormalize]: 0.00868434 [add_forward_monad_depend]: 1.348e-05 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.479e-05 [cse]: 4.247e-05 [replace_applicator]: 2.639e-05 [Cycle 2]: 0.00046737, [27] [switch_simplify]: 9.08002e-06 [loop_unroll]: 7.38e-06 [a_1]: 0.00014087 [with_stream_mark]: 1.968e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 2.71999e-06 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 7.11999e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 5.76e-06 [cell_reuse_recompute_pass]: 3.03e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.146e-05 [j_node_and_user_rematch]: 1.047e-05 [meta_fg_expand]: 3.31999e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 6.74001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.74999e-06 [auto_monad_grad]: 1.36002e-06 [auto_monad_eliminator]: 8.28001e-06 [cse]: 1.983e-05 [replace_applicator]: 7.87e-06 [py_interpret_to_execute_after_opt_a]: 1.964e-05 [rewriter_after_opt_a]: 5.097e-05 [convert_after_rewriter]: 9.64e-06 [order_py_execute_after_rewriter]: 6.06e-06 [mutable_eliminate]: 0.00097333 [jit_opt_b]: 6.54e-05, [1] [Cycle 1]: 5.745e-05, [2] [frontend_op_eliminate]: 2.479e-05 [inline_after_opt_a]: 2.067e-05 [cconv]: 3.253e-05 [loop_unroll]: 0.00054 [jit_opt_after_cconv]: 0.00019091, [1] [Cycle 1]: 0.00018312, [11] [c_1]: 2.923e-05 [parameter_eliminate]: 4.22e-06 [updatestate_depend_eliminate]: 9.39e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 3.443e-05 [call_graph_tuple_transform]: 2.841e-05 [tuple_list_get_item_eliminator]: 6.64999e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 9.07001e-06 [remove_dup_value]: 1.811e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 1.26e-05 [add_recomputation]: 5.853e-05 [cse_after_recomputation]: 3.167e-05, [1] [Cycle 1]: 2.513e-05, [1] [cse]: 1.653e-05 [auto_monad_reorder]: 2.079e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 8.48001e-06 [opt_after_jit_grad]: 0.00056986 [symbol_engine_optimizer]: 8.808e-05, [1] [Cycle 1]: 8.134e-05, [6] [build]: 4.90999e-06 [elim_shapecalc]: 9.52001e-06 [elim_not_effective]: 1.597e-05 [opt_reshape]: 7.66001e-06 [fold_const_symbol]: 1.203e-05 [renormalize]: 3.69997e-07 [validate]: 6.658e-05 Sums bootstrap : 0.000294s : 0.06% type_inference : 0.466854s : 97.03% event_method : 0.000027s : 0.01% auto_monad : 0.000085s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000924s : 0.19% rewriter_before_opt_a : 0.000115s : 0.02% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.02% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000952s : 0.20% jit_opt_a.with_stream_mark : 0.000050s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.00% jit_opt_a.merge_forward : 0.000012s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.00% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.008684s : 1.80% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000062s : 0.01% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.00% rewriter_after_opt_a : 0.000051s : 0.01% convert_after_rewriter : 0.000010s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000973s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000033s : 0.01% loop_unroll : 0.000540s : 0.11% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000059s : 0.01% cse_after_recomputation.cse : 0.000017s : 0.00% auto_monad_reorder : 0.000021s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000570s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000067s : 0.01% Time group info: ------[substitution.] 0.000334 24 0.64% : 0.000002s : 2: substitution.elim_not_effective 1.02% : 0.000003s : 2: substitution.fold_const_symbol 2.35% : 0.000008s : 4: substitution.graph_param_transform 85.53% : 0.000286s : 4: substitution.inline 1.66% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000006s : 4: substitution.remove_not_recompute_node 2.41% : 0.000008s : 2: substitution.replace_old_param 4.49% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.466735 2 98.92% : 0.461693s : 1: type_inference.infer 1.08% : 0.005042s : 1: type_inference.specialize ------[replace.] 0.000129 6 63.41% : 0.000082s : 4: replace.inline 36.59% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 6 95.36% : 0.000282s : 4: match.inline 4.64% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000165 830 1.07% : 0.000002s : 12: predicate.accumulaten_eliminater 1.73% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.15% : 0.000002s : 12: predicate.addn_zero_filter 2.16% : 0.000004s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.35% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.97% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.61% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.81% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.99% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.90% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.90% : 0.000001s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000001s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.47% : 0.000009s : 26: predicate.inline 1.16% : 0.000002s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.26% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.36% : 0.000004s : 18: predicate.load_eliminater 2.05% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.50% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.33% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 2.15% : 0.000004s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000004s : 18: predicate.partial_eliminate 0.96% : 0.000002s : 12: predicate.print_const_string_wrapper 1.45% : 0.000002s : 12: predicate.reduce_eliminate 1.22% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.04% : 0.000002s : 12: predicate.same_eliminate 0.79% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.25% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.21% : 0.000005s : 18: predicate.switch_defer_inline 2.87% : 0.000005s : 18: predicate.switch_layer_defer_inline 7.62% : 0.000013s : 58: predicate.switch_simplify 1.08% : 0.000002s : 12: predicate.tile_eliminate 1.00% : 0.000002s : 12: predicate.transpose_eliminate 1.19% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.30% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.53% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003297 22 60.18% : 0.001985s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.00% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.82% : 0.001247s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.496954 72 0.01% : 0.000063s : 1: add_recomputation 0.02% : 0.000089s : 1: auto_monad 0.00% : 0.000024s : 1: auto_monad_reorder 0.06% : 0.000311s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000036s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.13% : 0.015563s : 1: jit_opt_a 0.04% : 0.000195s : 1: jit_opt_after_cconv 0.01% : 0.000068s : 1: jit_opt_b 0.11% : 0.000552s : 1: loop_unroll 0.20% : 0.000989s : 1: mutable_eliminate 0.25% : 0.001266s : 26: opt.transform.jit_opt_a 0.01% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000038s : 4: opt.transform.jit_opt_b 0.00% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000076s : 1: opt.transform.mutable_eliminate 0.01% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000582s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.19% : 0.000934s : 1: py_interpret_to_execute 0.00% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 1.48% : 0.007359s : 1: renormalize.infer 0.26% : 0.001309s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000055s : 1: rewriter_after_opt_a 0.02% : 0.000122s : 1: rewriter_before_opt_a 0.02% : 0.000090s : 1: symbol_engine_optimizer 93.95% : 0.466880s : 1: type_inference TotalTime = 0.249315, [30] [bootstrap]: 0.00037529 [type_inference]: 0.237339 [event_method]: 2.765e-05 [auto_monad]: 8.454e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 0.00056033 [rewriter_before_opt_a]: 0.00011624 [expand_dump_flag]: 4.70999e-06 [jit_opt_a]: 0.00848129, [2] [Cycle 1]: 0.0042275, [27] [switch_simplify]: 7.421e-05 [loop_unroll]: 3.536e-05 [a_1]: 0.00081244 [with_stream_mark]: 2.466e-05 [recompute_prepare]: 9.52001e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 4.00998e-06 [updatestate_loads_eliminate]: 3.71999e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 7.87e-06 [updatestate_useless_node_eliminater]: 6.56999e-06 [accelerated_algorithm]: 7.25e-06 [meta_shard_fg_expand]: 2.91e-06 [get_grad_eliminate_]: 7.61999e-06 [merge_forward]: 4.84003e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.124e-05 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00287444 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.705e-05 [replace_applicator]: 3.532e-05 [Cycle 2]: 0.0003745, [27] [switch_simplify]: 7.97e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.00012129 [with_stream_mark]: 1.165e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.61e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.573e-05 [replace_applicator]: 6.41e-06 [py_interpret_to_execute_after_opt_a]: 1.375e-05 [rewriter_after_opt_a]: 3.952e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00063431 [jit_opt_b]: 5.599e-05, [1] [Cycle 1]: 4.927e-05, [2] [frontend_op_eliminate]: 1.967e-05 [inline_after_opt_a]: 1.848e-05 [cconv]: 2.723e-05 [loop_unroll]: 0.0004417 [jit_opt_after_cconv]: 0.00015326, [1] [Cycle 1]: 0.00014725, [11] [c_1]: 2.678e-05 [parameter_eliminate]: 2.48998e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.45997e-06 [cse]: 2.25e-05 [call_graph_tuple_transform]: 2.02e-05 [tuple_list_get_item_eliminator]: 6.69999e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.874e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 8.32e-06 [add_recomputation]: 4.901e-05 [cse_after_recomputation]: 2.517e-05, [1] [Cycle 1]: 2.033e-05, [1] [cse]: 1.386e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 4.75999e-06 [opt_after_jit_grad]: 0.00047152 [symbol_engine_optimizer]: 7.743e-05, [1] [Cycle 1]: 7.119e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 9.64e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 3.50003e-07 [validate]: 4.708e-05 Sums bootstrap : 0.000375s : 0.15% type_inference : 0.237339s : 96.95% event_method : 0.000028s : 0.01% auto_monad : 0.000085s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000560s : 0.23% rewriter_before_opt_a : 0.000116s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000934s : 0.38% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002875s : 1.17% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000053s : 0.02% jit_opt_a.replace_applicator : 0.000042s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000634s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000442s : 0.18% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000472s : 0.19% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.02% Time group info: ------[substitution.] 0.000317 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.80% : 0.000006s : 4: substitution.graph_param_transform 88.22% : 0.000280s : 5: substitution.inline 1.11% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 4.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.237232 2 98.52% : 0.233732s : 1: type_inference.infer 1.48% : 0.003499s : 1: type_inference.specialize ------[replace.] 0.000119 7 69.78% : 0.000083s : 5: replace.inline 30.22% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 7 95.84% : 0.000277s : 5: match.inline 4.16% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.62% : 0.000002s : 13: predicate.addn_zero_filter 1.96% : 0.000003s : 13: predicate.arithmetic_simplify 1.15% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.22% : 0.000002s : 13: predicate.compare_switch_simplify 1.35% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.53% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.56% : 0.000002s : 13: predicate.print_const_string_wrapper 1.60% : 0.000002s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.79% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003003 25 59.10% : 0.001775s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.08% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.82% : 0.001136s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.253468 72 0.02% : 0.000052s : 1: add_recomputation 0.03% : 0.000088s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.16% : 0.000399s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.35% : 0.008486s : 1: jit_opt_a 0.06% : 0.000156s : 1: jit_opt_after_cconv 0.02% : 0.000059s : 1: jit_opt_b 0.18% : 0.000450s : 1: loop_unroll 0.25% : 0.000643s : 1: mutable_eliminate 0.48% : 0.001220s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000481s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000568s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.80% : 0.002027s : 1: renormalize.infer 0.33% : 0.000837s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000122s : 1: rewriter_before_opt_a 0.03% : 0.000080s : 1: symbol_engine_optimizer 93.65% : 0.237369s : 1: type_inference TotalTime = 0.316932, [30] [bootstrap]: 0.00036767 [type_inference]: 0.260381 [event_method]: 1.944e-05 [auto_monad]: 6.692e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 0.00027824 [rewriter_before_opt_a]: 8.145e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.0529527, [2] [Cycle 1]: 0.0489639, [27] [switch_simplify]: 6.207e-05 [loop_unroll]: 3.079e-05 [a_1]: 0.00061149 [with_stream_mark]: 2.062e-05 [recompute_prepare]: 9.10999e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 7.17002e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 6.41998e-06 [renormalize]: 0.0478445 [add_forward_monad_depend]: 9.92001e-06 [auto_monad_grad]: 3.26999e-06 [auto_monad_eliminator]: 2.323e-05 [cse]: 3.439e-05 [replace_applicator]: 2.565e-05 [Cycle 2]: 0.00042119, [27] [switch_simplify]: 9.02999e-06 [loop_unroll]: 7.15e-06 [a_1]: 0.00014039 [with_stream_mark]: 1.558e-05 [recompute_prepare]: 5.83002e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 7.53e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 5.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.001e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.12e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 9.04e-06 [cse]: 1.253e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.733e-05 [rewriter_after_opt_a]: 4.195e-05 [convert_after_rewriter]: 7.76001e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00088114 [jit_opt_b]: 6.173e-05, [1] [Cycle 1]: 5.269e-05, [2] [frontend_op_eliminate]: 2.151e-05 [inline_after_opt_a]: 1.918e-05 [cconv]: 3.458e-05 [loop_unroll]: 0.00047314 [jit_opt_after_cconv]: 0.00017449, [1] [Cycle 1]: 0.00016668, [11] [c_1]: 2.767e-05 [parameter_eliminate]: 3.72998e-06 [updatestate_depend_eliminate]: 9.20999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 3.215e-05 [call_graph_tuple_transform]: 2.381e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.714e-05 [partial_unused_args_eliminate]: 2.60002e-06 [environ_conv]: 9.99001e-06 [add_recomputation]: 5.301e-05 [cse_after_recomputation]: 2.221e-05, [1] [Cycle 1]: 1.703e-05, [1] [cse]: 1.126e-05 [auto_monad_reorder]: 1.71e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 7.36999e-06 [opt_after_jit_grad]: 0.0005985 [symbol_engine_optimizer]: 8.839e-05, [1] [Cycle 1]: 8.106e-05, [6] [build]: 4.53999e-06 [elim_shapecalc]: 9.76e-06 [elim_not_effective]: 1.638e-05 [opt_reshape]: 8.28001e-06 [fold_const_symbol]: 1.093e-05 [renormalize]: 4.19997e-07 [validate]: 5.588e-05 Sums bootstrap : 0.000368s : 0.12% type_inference : 0.260381s : 83.26% event_method : 0.000019s : 0.01% auto_monad : 0.000067s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000278s : 0.09% rewriter_before_opt_a : 0.000081s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000752s : 0.24% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.047845s : 15.30% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000047s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000881s : 0.28% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000035s : 0.01% loop_unroll : 0.000473s : 0.15% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000598s : 0.19% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.02% Time group info: ------[substitution.] 0.000232 24 1.11% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 4: substitution.graph_param_transform 81.93% : 0.000190s : 4: substitution.inline 1.75% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000007s : 4: substitution.remove_not_recompute_node 2.84% : 0.000007s : 2: substitution.replace_old_param 6.11% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.260304 2 99.11% : 0.257995s : 1: type_inference.infer 0.89% : 0.002309s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.28% : 0.000053s : 4: replace.inline 33.72% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 93.51% : 0.000188s : 4: match.inline 6.49% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 830 1.09% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.60% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.21% : 0.000002s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.52% : 0.000008s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.85% : 0.000003s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.70% : 0.000003s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.41% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.83% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 18: predicate.switch_defer_inline 1.79% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.58% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.98% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002946 26 68.08% : 0.002005s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.18% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.74% : 0.000906s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.365946 72 0.02% : 0.000056s : 1: add_recomputation 0.02% : 0.000071s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.11% : 0.000387s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 14.47% : 0.052957s : 1: jit_opt_a 0.05% : 0.000177s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.13% : 0.000483s : 1: loop_unroll 0.24% : 0.000895s : 1: mutable_eliminate 0.28% : 0.001014s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000114s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000610s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000283s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 12.78% : 0.046763s : 1: renormalize.infer 0.29% : 0.001069s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.02% : 0.000086s : 1: rewriter_before_opt_a 0.02% : 0.000091s : 1: symbol_engine_optimizer 71.16% : 0.260398s : 1: type_inference TotalTime = 0.0250648, [30] [bootstrap]: 0.000571 [type_inference]: 0.00903244 [event_method]: 3.227e-05 [auto_monad]: 8.48e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 3.26001e-06 [py_interpret_to_execute]: 8.064e-05 [rewriter_before_opt_a]: 0.00010497 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0116746, [2] [Cycle 1]: 0.0035217, [27] [switch_simplify]: 8.702e-05 [loop_unroll]: 3.799e-05 [a_1]: 0.00125397 [with_stream_mark]: 2.992e-05 [recompute_prepare]: 1.12e-05 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 3.09999e-06 [get_grad_eliminate_]: 5.85002e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.744e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 5.35001e-06 [renormalize]: 0.00166365 [add_forward_monad_depend]: 1.047e-05 [auto_monad_grad]: 3.21999e-06 [auto_monad_eliminator]: 2.342e-05 [cse]: 4.379e-05 [replace_applicator]: 2.18e-05 [Cycle 2]: 0.00069796, [27] [switch_simplify]: 7.59002e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00011419 [with_stream_mark]: 1.76e-05 [recompute_prepare]: 5.46998e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 2.18998e-06 [get_grad_eliminate_]: 4.97999e-06 [merge_forward]: 4.47998e-06 [cell_reuse_recompute_pass]: 3.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.075e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 1.067e-05 [inline_without_move]: 5.22e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 8e-06 [cse]: 1.626e-05 [replace_applicator]: 1.5e-05 [py_interpret_to_execute_after_opt_a]: 2.837e-05 [rewriter_after_opt_a]: 6.721e-05 [convert_after_rewriter]: 8.67e-06 [order_py_execute_after_rewriter]: 5.26998e-06 [mutable_eliminate]: 0.00105168 [jit_opt_b]: 0.00010176, [1] [Cycle 1]: 5.84e-05, [2] [frontend_op_eliminate]: 2.226e-05 [inline_after_opt_a]: 2.102e-05 [cconv]: 4.024e-05 [loop_unroll]: 0.00067399 [jit_opt_after_cconv]: 0.00020472, [1] [Cycle 1]: 0.00019527, [11] [c_1]: 2.489e-05 [parameter_eliminate]: 6.54999e-06 [updatestate_depend_eliminate]: 1.25e-05 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 4.754e-05 [call_graph_tuple_transform]: 3.087e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 2.10002e-06 [renormalize]: 7.60017e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 2.144e-05 [partial_unused_args_eliminate]: 2.88998e-06 [environ_conv]: 1.573e-05 [add_recomputation]: 8.024e-05 [cse_after_recomputation]: 3.04e-05, [1] [Cycle 1]: 2.365e-05, [1] [cse]: 1.682e-05 [auto_monad_reorder]: 2.257e-05 [get_jit_bprop_graph]: 2.48998e-06 [rewriter_after_jit_bprop_graph]: 1.194e-05 [opt_after_jit_grad]: 0.00066503 [symbol_engine_optimizer]: 0.0001071, [1] [Cycle 1]: 9.974e-05, [6] [build]: 1.668e-05 [elim_shapecalc]: 9.00999e-06 [elim_not_effective]: 1.819e-05 [opt_reshape]: 9.51e-06 [fold_const_symbol]: 1.243e-05 [renormalize]: 6.69999e-07 [validate]: 6.913e-05 Sums bootstrap : 0.000571s : 3.46% type_inference : 0.009032s : 54.68% event_method : 0.000032s : 0.20% auto_monad : 0.000085s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000081s : 0.49% rewriter_before_opt_a : 0.000105s : 0.64% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000095s : 0.57% jit_opt_a.loop_unroll : 0.000044s : 0.27% jit_opt_a.a_1 : 0.001368s : 8.28% jit_opt_a.with_stream_mark : 0.000048s : 0.29% jit_opt_a.recompute_prepare : 0.000017s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000021s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001664s : 10.07% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.19% jit_opt_a.cse : 0.000060s : 0.36% jit_opt_a.replace_applicator : 0.000037s : 0.22% py_interpret_to_execute_after_opt_a : 0.000028s : 0.17% rewriter_after_opt_a : 0.000067s : 0.41% convert_after_rewriter : 0.000009s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.001052s : 6.37% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.13% jit_opt_b.inline_after_opt_a : 0.000021s : 0.13% cconv : 0.000040s : 0.24% loop_unroll : 0.000674s : 4.08% jit_opt_after_cconv.c_1 : 0.000025s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000021s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000016s : 0.10% add_recomputation : 0.000080s : 0.49% cse_after_recomputation.cse : 0.000017s : 0.10% auto_monad_reorder : 0.000023s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000012s : 0.07% opt_after_jit_grad : 0.000665s : 4.03% symbol_engine_optimizer.build : 0.000017s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000069s : 0.42% Time group info: ------[substitution.] 0.000735 25 0.29% : 0.000002s : 2: substitution.elim_not_effective 0.34% : 0.000002s : 2: substitution.fold_const_symbol 1.01% : 0.000007s : 3: substitution.graph_param_transform 93.23% : 0.000686s : 5: substitution.inline 0.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.94% : 0.000007s : 4: substitution.remove_not_recompute_node 0.91% : 0.000007s : 2: substitution.replace_old_param 2.72% : 0.000020s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008905 2 79.86% : 0.007112s : 1: type_inference.infer 20.14% : 0.001793s : 1: type_inference.specialize ------[replace.] 0.000147 8 68.98% : 0.000101s : 5: replace.inline 31.02% : 0.000046s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000699 8 97.44% : 0.000681s : 5: match.inline 2.56% : 0.000018s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000167 810 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 2.21% : 0.000004s : 12: predicate.arithmetic_simplify 1.58% : 0.000003s : 12: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.23% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.84% : 0.000010s : 26: predicate.inline 0.60% : 0.000001s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 18: predicate.load_eliminater 2.07% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000007s : 41: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.94% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000002s : 12: predicate.minmaximum_grad 2.48% : 0.000004s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000004s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000003s : 21: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.96% : 0.000002s : 3: predicate.row_tensor_eliminate 1.04% : 0.000002s : 12: predicate.same_eliminate 0.38% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000002s : 6: predicate.special_op_eliminate 0.69% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 20: predicate.switch_defer_inline 2.28% : 0.000004s : 20: predicate.switch_layer_defer_inline 8.04% : 0.000013s : 64: predicate.switch_simplify 1.09% : 0.000002s : 12: predicate.tile_eliminate 1.73% : 0.000003s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 2.06% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.74% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.50% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001410 16 43.21% : 0.000609s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.54% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 49.25% : 0.000695s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028432 72 0.29% : 0.000083s : 1: add_recomputation 0.31% : 0.000089s : 1: auto_monad 0.09% : 0.000025s : 1: auto_monad_reorder 2.10% : 0.000598s : 1: bootstrap 0.15% : 0.000043s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.12% : 0.000033s : 1: cse_after_recomputation 0.06% : 0.000018s : 1: environ_conv 0.13% : 0.000037s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 41.08% : 0.011679s : 1: jit_opt_a 0.73% : 0.000208s : 1: jit_opt_after_cconv 0.37% : 0.000105s : 1: jit_opt_b 2.41% : 0.000686s : 1: loop_unroll 3.75% : 0.001066s : 1: mutable_eliminate 5.84% : 0.001660s : 26: opt.transform.jit_opt_a 0.23% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000034s : 4: opt.transform.jit_opt_b 0.07% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000026s : 1: opt.transform.mutable_eliminate 0.10% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000044s : 4: opt.transform.symbol_engine_opt 2.39% : 0.000679s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000085s : 1: py_interpret_to_execute 0.11% : 0.000031s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000025s : 1: remove_dup_value 2.91% : 0.000827s : 1: renormalize.infer 2.90% : 0.000825s : 1: renormalize.specialize 0.05% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000071s : 1: rewriter_after_opt_a 0.38% : 0.000108s : 1: rewriter_before_opt_a 0.39% : 0.000110s : 1: symbol_engine_optimizer 31.86% : 0.009060s : 1: type_inference TotalTime = 0.0413603, [30] [bootstrap]: 0.00042074 [type_inference]: 0.0310103 [event_method]: 2.153e-05 [auto_monad]: 7.034e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00015424 [rewriter_before_opt_a]: 8.857e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00695967, [2] [Cycle 1]: 0.00242, [27] [switch_simplify]: 5.582e-05 [loop_unroll]: 2.989e-05 [a_1]: 0.00055452 [with_stream_mark]: 1.995e-05 [recompute_prepare]: 9.44998e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.93997e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 8.99978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.534e-05 [j_node_and_user_rematch]: 9.21998e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 8.94998e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.001415 [add_forward_monad_depend]: 6.06998e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.543e-05 [cse]: 3.563e-05 [replace_applicator]: 1.465e-05 [Cycle 2]: 0.0003383, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 5.59998e-06 [a_1]: 9.421e-05 [with_stream_mark]: 1.102e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 1.71998e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 7.94002e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 7.51001e-06 [inline_without_move]: 6.40002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.52001e-06 [cse]: 1.471e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.376e-05 [rewriter_after_opt_a]: 3.735e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00075204 [jit_opt_b]: 5.531e-05, [1] [Cycle 1]: 4.692e-05, [2] [frontend_op_eliminate]: 1.774e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 2.636e-05 [loop_unroll]: 0.00048165 [jit_opt_after_cconv]: 0.00016153, [1] [Cycle 1]: 0.00015317, [11] [c_1]: 2.419e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.017e-05 [call_graph_tuple_transform]: 2.012e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 1.90019e-07 [switch_simplify]: 5.35001e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 1.89999e-06 [environ_conv]: 6.33e-06 [add_recomputation]: 5.336e-05 [cse_after_recomputation]: 2.46e-05, [1] [Cycle 1]: 1.889e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.836e-05 [get_jit_bprop_graph]: 3.2e-06 [rewriter_after_jit_bprop_graph]: 6.63e-06 [opt_after_jit_grad]: 0.00053418 [symbol_engine_optimizer]: 0.00017344, [1] [Cycle 1]: 0.00016593, [6] [build]: 3.98001e-06 [elim_shapecalc]: 0.00010141 [elim_not_effective]: 1.464e-05 [opt_reshape]: 6.02999e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 3.29979e-07 [validate]: 4.596e-05 Sums bootstrap : 0.000421s : 1.15% type_inference : 0.031010s : 84.86% event_method : 0.000022s : 0.06% auto_monad : 0.000070s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000154s : 0.42% rewriter_before_opt_a : 0.000089s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.17% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000649s : 1.78% jit_opt_a.with_stream_mark : 0.000031s : 0.08% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001415s : 3.87% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000050s : 0.14% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000752s : 2.06% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000026s : 0.07% loop_unroll : 0.000482s : 1.32% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.15% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000534s : 1.46% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000101s : 0.28% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.13% Time group info: ------[substitution.] 0.000215 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 84.24% : 0.000181s : 4: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 6.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.030930 2 92.26% : 0.028538s : 1: type_inference.infer 7.74% : 0.002392s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.38% : 0.000053s : 4: replace.inline 33.62% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.66% : 0.000179s : 4: match.inline 6.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.34% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.19% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 1.22% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.08% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.99% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.11% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.68% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.27% : 0.000002s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.29% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.06% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001117 13 42.72% : 0.000477s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.03% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.25% : 0.000606s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043791 72 0.13% : 0.000057s : 1: add_recomputation 0.17% : 0.000074s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 1.00% : 0.000440s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.90% : 0.006964s : 1: jit_opt_a 0.37% : 0.000164s : 1: jit_opt_after_cconv 0.13% : 0.000058s : 1: jit_opt_b 1.12% : 0.000490s : 1: loop_unroll 1.74% : 0.000763s : 1: mutable_eliminate 1.99% : 0.000871s : 26: opt.transform.jit_opt_a 0.12% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.29% : 0.000127s : 4: opt.transform.symbol_engine_opt 1.24% : 0.000543s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000158s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.90% : 0.000832s : 1: renormalize.infer 1.31% : 0.000574s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.21% : 0.000093s : 1: rewriter_before_opt_a 0.40% : 0.000176s : 1: symbol_engine_optimizer 70.86% : 0.031028s : 1: type_inference TotalTime = 0.0151607, [30] [bootstrap]: 0.00028909 [type_inference]: 0.00517586 [event_method]: 1.9e-05 [auto_monad]: 5.599e-05 [graph_reusing]: 4.40999e-06 [pre_auto_parallel]: 1.86998e-06 [py_interpret_to_execute]: 4.377e-05 [rewriter_before_opt_a]: 6.796e-05 [expand_dump_flag]: 2.01998e-06 [jit_opt_a]: 0.007216, [2] [Cycle 1]: 0.00368918, [27] [switch_simplify]: 4.792e-05 [loop_unroll]: 2.96e-05 [a_1]: 0.00242268 [with_stream_mark]: 1.523e-05 [recompute_prepare]: 9.34e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 6.63e-06 [renormalize]: 0.0008454 [add_forward_monad_depend]: 5.85002e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.449e-05 [cse]: 1.912e-05 [replace_applicator]: 1.387e-05 [Cycle 2]: 0.00032267, [27] [switch_simplify]: 5.95002e-06 [loop_unroll]: 4.99e-06 [a_1]: 9.304e-05 [with_stream_mark]: 1.017e-05 [recompute_prepare]: 4.89003e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.08998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.31998e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 2.07001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.82e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.111e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.136e-05 [rewriter_after_opt_a]: 3.011e-05 [convert_after_rewriter]: 6.28e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00063041 [jit_opt_b]: 5.173e-05, [1] [Cycle 1]: 4.515e-05, [2] [frontend_op_eliminate]: 1.761e-05 [inline_after_opt_a]: 1.586e-05 [cconv]: 2.362e-05 [loop_unroll]: 0.00043833 [jit_opt_after_cconv]: 0.00015362, [1] [Cycle 1]: 0.00014749, [11] [c_1]: 2.251e-05 [parameter_eliminate]: 3.20998e-06 [updatestate_depend_eliminate]: 5.82001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 3.23998e-06 [cse]: 2.266e-05 [call_graph_tuple_transform]: 2.162e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.186e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.89e-06 [add_recomputation]: 4.235e-05 [cse_after_recomputation]: 2.33e-05, [1] [Cycle 1]: 1.792e-05, [1] [cse]: 1.106e-05 [auto_monad_reorder]: 1.281e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00052589 [symbol_engine_optimizer]: 7.686e-05, [1] [Cycle 1]: 7.02e-05, [6] [build]: 2.99999e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 1.017e-05 [renormalize]: 3.80009e-07 [validate]: 3.344e-05 Sums bootstrap : 0.000289s : 2.55% type_inference : 0.005176s : 45.60% event_method : 0.000019s : 0.17% auto_monad : 0.000056s : 0.49% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000044s : 0.39% rewriter_before_opt_a : 0.000068s : 0.60% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000054s : 0.47% jit_opt_a.loop_unroll : 0.000035s : 0.30% jit_opt_a.a_1 : 0.002516s : 22.16% jit_opt_a.with_stream_mark : 0.000025s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000845s : 7.45% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.18% jit_opt_a.cse : 0.000030s : 0.27% jit_opt_a.replace_applicator : 0.000019s : 0.17% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000030s : 0.27% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000630s : 5.55% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000024s : 0.21% loop_unroll : 0.000438s : 3.86% jit_opt_after_cconv.c_1 : 0.000023s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000012s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000042s : 0.37% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000013s : 0.11% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000526s : 4.63% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.29% Time group info: ------[substitution.] 0.000225 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.81% : 0.000006s : 3: substitution.graph_param_transform 84.21% : 0.000189s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.69% : 0.000006s : 4: substitution.remove_not_recompute_node 1.50% : 0.000003s : 2: substitution.replace_old_param 5.62% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005115 2 82.03% : 0.004196s : 1: type_inference.infer 17.97% : 0.000919s : 1: type_inference.specialize ------[replace.] 0.000080 6 65.31% : 0.000052s : 4: replace.inline 34.69% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.22% : 0.000187s : 4: match.inline 5.78% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.001955 691 0.09% : 0.000002s : 10: predicate.accumulaten_eliminater 0.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.07% : 0.000001s : 10: predicate.addn_check_dump 0.07% : 0.000001s : 10: predicate.addn_zero_filter 0.17% : 0.000003s : 10: predicate.arithmetic_simplify 0.10% : 0.000002s : 10: predicate.cast_eliminate 0.03% : 0.000001s : 3: predicate.check_bprop_eliminate 0.08% : 0.000002s : 10: predicate.compare_switch_simplify 0.09% : 0.000002s : 10: predicate.depend_value_elim 0.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.02% : 0.000000s : 3: predicate.elim_not_effective 0.04% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.07% : 0.000001s : 10: predicate.environ_get_depend_swap 0.10% : 0.000002s : 10: predicate.environ_get_eliminate 0.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.01% : 0.000000s : 3: predicate.fold_const_symbol 0.08% : 0.000002s : 6: predicate.get_grad_eliminate 0.01% : 0.000000s : 3: predicate.graph_param_transform 0.38% : 0.000007s : 22: predicate.inline 0.06% : 0.000001s : 6: predicate.inline_without_move 0.02% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.10% : 0.000002s : 6: predicate.less_batch_normalization 0.09% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.12% : 0.000002s : 15: predicate.load_eliminater 0.08% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.12% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.07% : 0.000001s : 10: predicate.merge_addn 0.07% : 0.000001s : 10: predicate.minmaximum_grad 0.10% : 0.000002s : 3: predicate.mutable_eliminate 0.04% : 0.000001s : 3: predicate.opt_reshape 0.13% : 0.000002s : 15: predicate.partial_eliminate 0.09% : 0.000002s : 10: predicate.print_const_string_wrapper 93.65% : 0.001831s : 10: predicate.reduce_eliminate 0.10% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.06% : 0.000001s : 6: predicate.remove_not_recompute_node 0.12% : 0.000002s : 18: predicate.replace_applicator 0.03% : 0.000001s : 6: predicate.replace_old_param 0.02% : 0.000000s : 3: predicate.reset_defer_inline 0.12% : 0.000002s : 10: predicate.reshape_eliminate 0.11% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.04% : 0.000001s : 3: predicate.row_tensor_eliminate 0.09% : 0.000002s : 10: predicate.same_eliminate 0.03% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.06% : 0.000001s : 6: predicate.special_op_eliminate 0.06% : 0.000001s : 6: predicate.specialize_transform 0.09% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.08% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.03% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.17% : 0.000003s : 16: predicate.switch_defer_inline 0.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 0.45% : 0.000009s : 53: predicate.switch_simplify 0.17% : 0.000003s : 10: predicate.tile_eliminate 0.08% : 0.000002s : 10: predicate.transpose_eliminate 0.08% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 0.21% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 0.12% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.09% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.10% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.19% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 0.10% : 0.000002s : 10: predicate.value_based_eliminate 0.02% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.04% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000715 13 51.68% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.00% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.32% : 0.000310s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018806 72 0.24% : 0.000045s : 1: add_recomputation 0.31% : 0.000059s : 1: auto_monad 0.08% : 0.000015s : 1: auto_monad_reorder 1.64% : 0.000308s : 1: bootstrap 0.14% : 0.000026s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 38.39% : 0.007219s : 1: jit_opt_a 0.92% : 0.000173s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.38% : 0.000447s : 1: loop_unroll 3.40% : 0.000640s : 1: mutable_eliminate 14.51% : 0.002729s : 26: opt.transform.jit_opt_a 0.28% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.85% : 0.000535s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000046s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000015s : 1: remove_dup_value 2.40% : 0.000451s : 1: renormalize.infer 2.06% : 0.000387s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000033s : 1: rewriter_after_opt_a 0.38% : 0.000071s : 1: rewriter_before_opt_a 0.42% : 0.000079s : 1: symbol_engine_optimizer 27.60% : 0.005191s : 1: type_inference TotalTime = 0.0187446, [30] [bootstrap]: 0.00032221 [type_inference]: 0.00716104 [event_method]: 2.114e-05 [auto_monad]: 7.006e-05 [graph_reusing]: 5.84999e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 5.385e-05 [rewriter_before_opt_a]: 8.036e-05 [expand_dump_flag]: 2.78e-06 [jit_opt_a]: 0.00579408, [2] [Cycle 1]: 0.00190593, [27] [switch_simplify]: 6.711e-05 [loop_unroll]: 3.286e-05 [a_1]: 0.00055817 [with_stream_mark]: 2.277e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.51002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00087825 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.824e-05 [cse]: 3.217e-05 [replace_applicator]: 1.273e-05 [Cycle 2]: 0.00032717, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.372e-05 [with_stream_mark]: 1.084e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 4.72998e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 8.28001e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 8.18001e-06 [inline_without_move]: 4.87e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 6.73e-06 [cse]: 1.058e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.233e-05 [rewriter_after_opt_a]: 3.656e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00062272 [jit_opt_b]: 5.445e-05, [1] [Cycle 1]: 4.678e-05, [2] [frontend_op_eliminate]: 1.798e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 2.972e-05 [loop_unroll]: 0.00319112 [jit_opt_after_cconv]: 0.00018705, [1] [Cycle 1]: 0.00017746, [11] [c_1]: 2.75e-05 [parameter_eliminate]: 6.17999e-06 [updatestate_depend_eliminate]: 1.095e-05 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 3.673e-05 [call_graph_tuple_transform]: 2.258e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 1.04e-06 [switch_simplify]: 6.63003e-06 [remove_dup_value]: 1.492e-05 [partial_unused_args_eliminate]: 2.91999e-06 [environ_conv]: 6.81999e-06 [add_recomputation]: 5.584e-05 [cse_after_recomputation]: 2.292e-05, [1] [Cycle 1]: 1.742e-05, [1] [cse]: 1.084e-05 [auto_monad_reorder]: 1.58e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 8.97e-06 [opt_after_jit_grad]: 0.00059217 [symbol_engine_optimizer]: 8.5e-05, [1] [Cycle 1]: 7.816e-05, [6] [build]: 5.40999e-06 [elim_shapecalc]: 9.50001e-06 [elim_not_effective]: 1.656e-05 [opt_reshape]: 6.34999e-06 [fold_const_symbol]: 1.039e-05 [renormalize]: 5.09986e-07 [validate]: 4.446e-05 Sums bootstrap : 0.000322s : 2.22% type_inference : 0.007161s : 49.28% event_method : 0.000021s : 0.15% auto_monad : 0.000070s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000054s : 0.37% rewriter_before_opt_a : 0.000080s : 0.55% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.26% jit_opt_a.a_1 : 0.000652s : 4.49% jit_opt_a.with_stream_mark : 0.000034s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000878s : 6.04% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.17% jit_opt_a.cse : 0.000043s : 0.29% jit_opt_a.replace_applicator : 0.000018s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.08% rewriter_after_opt_a : 0.000037s : 0.25% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000623s : 4.29% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000030s : 0.20% loop_unroll : 0.003191s : 21.96% jit_opt_after_cconv.c_1 : 0.000028s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000037s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.05% remove_dup_value : 0.000015s : 0.10% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000056s : 0.38% cse_after_recomputation.cse : 0.000011s : 0.07% auto_monad_reorder : 0.000016s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.06% opt_after_jit_grad : 0.000592s : 4.08% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.31% Time group info: ------[substitution.] 0.000219 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.96% : 0.000002s : 2: substitution.fold_const_symbol 2.85% : 0.000006s : 3: substitution.graph_param_transform 82.59% : 0.000181s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000005s : 2: substitution.replace_old_param 6.26% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007075 2 62.16% : 0.004398s : 1: type_inference.infer 37.84% : 0.002677s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.49% : 0.000052s : 4: replace.inline 32.51% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.41% : 0.000178s : 4: match.inline 6.59% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 3.50% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.41% : 0.000002s : 10: predicate.print_const_string_wrapper 1.42% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.95% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.09% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.61% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.51% : 0.000002s : 10: predicate.transpose_eliminate 1.53% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.24% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000791 13 51.44% : 0.000407s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.02% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.54% : 0.000352s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020584 72 0.28% : 0.000058s : 1: add_recomputation 0.36% : 0.000073s : 1: auto_monad 0.09% : 0.000018s : 1: auto_monad_reorder 1.67% : 0.000343s : 1: bootstrap 0.16% : 0.000032s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.17% : 0.000036s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 28.17% : 0.005798s : 1: jit_opt_a 0.92% : 0.000190s : 1: jit_opt_after_cconv 0.28% : 0.000057s : 1: jit_opt_b 15.59% : 0.003209s : 1: loop_unroll 3.08% : 0.000633s : 1: mutable_eliminate 4.28% : 0.000882s : 26: opt.transform.jit_opt_a 0.28% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.13% : 0.000027s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.92% : 0.000601s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000057s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000017s : 1: remove_dup_value 2.19% : 0.000450s : 1: renormalize.infer 2.04% : 0.000419s : 1: renormalize.specialize 0.05% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000040s : 1: rewriter_after_opt_a 0.41% : 0.000083s : 1: rewriter_before_opt_a 0.43% : 0.000088s : 1: symbol_engine_optimizer 34.88% : 0.007181s : 1: type_inference TotalTime = 0.0928555, [30] [bootstrap]: 0.00038136 [type_inference]: 0.084089 [event_method]: 2.049e-05 [auto_monad]: 7.273e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 3.08998e-06 [py_interpret_to_execute]: 9.501e-05 [rewriter_before_opt_a]: 8.017e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00582674, [2] [Cycle 1]: 0.00178692, [27] [switch_simplify]: 5.649e-05 [loop_unroll]: 2.969e-05 [a_1]: 0.00052234 [with_stream_mark]: 1.939e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.00081226 [add_forward_monad_depend]: 6.16e-06 [auto_monad_grad]: 2.99001e-06 [auto_monad_eliminator]: 1.641e-05 [cse]: 3.476e-05 [replace_applicator]: 1.473e-05 [Cycle 2]: 0.00031647, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 4.84998e-06 [a_1]: 8.628e-05 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 5.01997e-06 [meta_shard_fg_expand]: 1.41002e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.78998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.419e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 7.43999e-06 [inline_without_move]: 4.87e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.83002e-06 [cse]: 1.309e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.465e-05 [rewriter_after_opt_a]: 4.163e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00058722 [jit_opt_b]: 4.835e-05, [1] [Cycle 1]: 4.106e-05, [2] [frontend_op_eliminate]: 1.46e-05 [inline_after_opt_a]: 1.54e-05 [cconv]: 2.929e-05 [loop_unroll]: 0.00046276 [jit_opt_after_cconv]: 0.00014285, [1] [Cycle 1]: 0.00013563, [11] [c_1]: 1.944e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.408e-05 [call_graph_tuple_transform]: 1.852e-05 [tuple_list_get_item_eliminator]: 5.59998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.12e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.86e-06 [add_recomputation]: 5.304e-05 [cse_after_recomputation]: 2.307e-05, [1] [Cycle 1]: 1.743e-05, [1] [cse]: 1.183e-05 [auto_monad_reorder]: 1.897e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00049329 [symbol_engine_optimizer]: 7.301e-05, [1] [Cycle 1]: 6.655e-05, [6] [build]: 4.08999e-06 [elim_shapecalc]: 7.49002e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 6.29001e-06 [fold_const_symbol]: 8.59e-06 [renormalize]: 3.80009e-07 [validate]: 4.793e-05 Sums bootstrap : 0.000381s : 0.43% type_inference : 0.084089s : 94.98% event_method : 0.000020s : 0.02% auto_monad : 0.000073s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000095s : 0.11% rewriter_before_opt_a : 0.000080s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000609s : 0.69% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.000812s : 0.92% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000048s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000042s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000587s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000463s : 0.52% jit_opt_after_cconv.c_1 : 0.000019s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000493s : 0.56% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.05% Time group info: ------[substitution.] 0.000201 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 3: substitution.graph_param_transform 83.26% : 0.000167s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000005s : 2: substitution.replace_old_param 6.11% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.084012 2 98.27% : 0.082559s : 1: type_inference.infer 1.73% : 0.001453s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.52% : 0.000048s : 4: replace.inline 30.48% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.63% : 0.000165s : 4: match.inline 6.37% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.31% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.55% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000006s : 22: predicate.inline 1.11% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.39% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.60% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000840 13 51.52% : 0.000433s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.60% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.88% : 0.000377s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.094534 72 0.06% : 0.000056s : 1: add_recomputation 0.08% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.44% : 0.000416s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.17% : 0.005830s : 1: jit_opt_a 0.15% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000051s : 1: jit_opt_b 0.50% : 0.000471s : 1: loop_unroll 0.63% : 0.000597s : 1: mutable_eliminate 0.87% : 0.000825s : 26: opt.transform.jit_opt_a 0.05% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.53% : 0.000501s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000098s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.49% : 0.000466s : 1: renormalize.infer 0.36% : 0.000338s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000084s : 1: rewriter_before_opt_a 0.08% : 0.000075s : 1: symbol_engine_optimizer 88.97% : 0.084108s : 1: type_inference TotalTime = 0.132449, [30] [bootstrap]: 0.00030141 [type_inference]: 0.12027 [event_method]: 2.372e-05 [auto_monad]: 7.545e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00048153 [rewriter_before_opt_a]: 9.949e-05 [expand_dump_flag]: 4.52e-06 [jit_opt_a]: 0.0085418, [2] [Cycle 1]: 0.00435356, [27] [switch_simplify]: 6.713e-05 [loop_unroll]: 3.497e-05 [a_1]: 0.00076167 [with_stream_mark]: 2.077e-05 [recompute_prepare]: 9.81e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.70998e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.82002e-06 [renormalize]: 0.00308709 [add_forward_monad_depend]: 8.70001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.782e-05 [cse]: 2.864e-05 [replace_applicator]: 2.265e-05 [Cycle 2]: 0.00039587, [27] [switch_simplify]: 7.43999e-06 [loop_unroll]: 6.17001e-06 [a_1]: 0.00012746 [with_stream_mark]: 1.409e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.89001e-06 [inline_without_move]: 6.21e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.99999e-06 [cse]: 1.617e-05 [replace_applicator]: 6.88e-06 [py_interpret_to_execute_after_opt_a]: 1.477e-05 [rewriter_after_opt_a]: 4.197e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.0007502 [jit_opt_b]: 7.081e-05, [1] [Cycle 1]: 6.212e-05, [2] [frontend_op_eliminate]: 1.896e-05 [inline_after_opt_a]: 1.951e-05 [cconv]: 2.963e-05 [loop_unroll]: 0.00045574 [jit_opt_after_cconv]: 0.00017322, [1] [Cycle 1]: 0.00016563, [11] [c_1]: 2.74e-05 [parameter_eliminate]: 3.53999e-06 [updatestate_depend_eliminate]: 8.67998e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 3.043e-05 [call_graph_tuple_transform]: 2.386e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.953e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 9.59e-06 [add_recomputation]: 5.097e-05 [cse_after_recomputation]: 2.561e-05, [1] [Cycle 1]: 2.027e-05, [1] [cse]: 1.42e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 5.17999e-06 [opt_after_jit_grad]: 0.00050027 [symbol_engine_optimizer]: 0.00013539, [1] [Cycle 1]: 0.00012722, [6] [build]: 3.93001e-06 [elim_shapecalc]: 9.36002e-06 [elim_not_effective]: 1.651e-05 [opt_reshape]: 5.677e-05 [fold_const_symbol]: 1.068e-05 [renormalize]: 6.19999e-07 [validate]: 0.0001405 Sums bootstrap : 0.000301s : 0.24% type_inference : 0.120270s : 93.95% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000482s : 0.38% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000889s : 0.69% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003087s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000750s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000456s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000500s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000057s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000140s : 0.11% Time group info: ------[substitution.] 0.000307 25 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000007s : 4: substitution.graph_param_transform 87.87% : 0.000270s : 5: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 4.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120191 2 97.41% : 0.117073s : 1: type_inference.infer 2.59% : 0.003117s : 1: type_inference.specialize ------[replace.] 0.000115 7 68.66% : 0.000079s : 5: replace.inline 31.34% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 95.99% : 0.000267s : 5: match.inline 4.01% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.76% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.75% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.85% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.57% : 0.000002s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.06% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.69% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.12% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 2.14% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002595 25 63.87% : 0.001657s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.43% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.70% : 0.000849s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136680 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000314s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.25% : 0.008546s : 1: jit_opt_a 0.13% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000074s : 1: jit_opt_b 0.34% : 0.000464s : 1: loop_unroll 0.56% : 0.000759s : 1: mutable_eliminate 0.85% : 0.001159s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000510s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.59% : 0.002176s : 1: renormalize.infer 0.66% : 0.000898s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.10% : 0.000138s : 1: symbol_engine_optimizer 88.00% : 0.120284s : 1: type_inference TotalTime = 0.0389061, [30] [bootstrap]: 0.00038149 [type_inference]: 0.0272417 [event_method]: 2.521e-05 [auto_monad]: 7.354e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00018721 [rewriter_before_opt_a]: 9.36e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00821435, [2] [Cycle 1]: 0.00285053, [27] [switch_simplify]: 8.998e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00065942 [with_stream_mark]: 2.407e-05 [recompute_prepare]: 9.37999e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 2.76999e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00164434 [add_forward_monad_depend]: 6.79001e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 2.005e-05 [cse]: 3.929e-05 [replace_applicator]: 1.808e-05 [Cycle 2]: 0.00035263, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.78002e-06 [a_1]: 9.819e-05 [with_stream_mark]: 1.164e-05 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.54e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 1.61998e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 4.87e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.661e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.524e-05 [rewriter_after_opt_a]: 4.257e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00075855 [jit_opt_b]: 5.813e-05, [1] [Cycle 1]: 4.875e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.664e-05 [cconv]: 3.105e-05 [loop_unroll]: 0.00051229 [jit_opt_after_cconv]: 0.00016737, [1] [Cycle 1]: 0.00016023, [11] [c_1]: 2.348e-05 [parameter_eliminate]: 3.30998e-06 [updatestate_depend_eliminate]: 8.89998e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 3.12e-05 [call_graph_tuple_transform]: 2.207e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.844e-05 [partial_unused_args_eliminate]: 2.78998e-06 [environ_conv]: 6.12999e-06 [add_recomputation]: 5.426e-05 [cse_after_recomputation]: 2.502e-05, [1] [Cycle 1]: 1.964e-05, [1] [cse]: 1.345e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 6.23002e-06 [opt_after_jit_grad]: 0.00054928 [symbol_engine_optimizer]: 0.00012641, [1] [Cycle 1]: 0.00011861, [6] [build]: 5.97001e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 5.659e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 1.038e-05 [renormalize]: 4.69998e-07 [validate]: 5.242e-05 Sums bootstrap : 0.000381s : 1.15% type_inference : 0.027242s : 82.01% event_method : 0.000025s : 0.08% auto_monad : 0.000074s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000187s : 0.56% rewriter_before_opt_a : 0.000094s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000096s : 0.29% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000758s : 2.28% jit_opt_a.with_stream_mark : 0.000036s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001644s : 4.95% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.08% jit_opt_a.cse : 0.000056s : 0.17% jit_opt_a.replace_applicator : 0.000023s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000043s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000759s : 2.28% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000031s : 0.09% loop_unroll : 0.000512s : 1.54% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000549s : 1.65% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000057s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.16% Time group info: ------[substitution.] 0.000327 23 13.40% : 0.000044s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 3: substitution.graph_param_transform 74.41% : 0.000243s : 4: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 1.79% : 0.000006s : 2: substitution.replace_old_param 4.78% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027144 2 90.78% : 0.024641s : 1: type_inference.infer 9.22% : 0.002502s : 1: type_inference.specialize ------[replace.] 0.000092 6 68.74% : 0.000063s : 4: replace.inline 31.26% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 94.39% : 0.000241s : 4: match.inline 5.61% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.39% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000003s : 10: predicate.arithmetic_simplify 1.04% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000001s : 10: predicate.depend_value_elim 1.26% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.97% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.28% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000008s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.07% : 0.000003s : 15: predicate.load_eliminater 1.72% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.63% : 0.000004s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.87% : 0.000002s : 15: predicate.partial_eliminate 0.96% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.07% : 0.000001s : 10: predicate.reshape_eliminate 1.09% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.01% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.71% : 0.000004s : 16: predicate.switch_defer_inline 1.92% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.94% : 0.000012s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.94% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.40% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001266 13 42.50% : 0.000538s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.10% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.41% : 0.000676s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041670 72 0.14% : 0.000058s : 1: add_recomputation 0.19% : 0.000077s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.97% : 0.000402s : 1: bootstrap 0.08% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.72% : 0.008219s : 1: jit_opt_a 0.41% : 0.000170s : 1: jit_opt_after_cconv 0.15% : 0.000061s : 1: jit_opt_b 1.25% : 0.000523s : 1: loop_unroll 1.85% : 0.000772s : 1: mutable_eliminate 2.46% : 0.001025s : 26: opt.transform.jit_opt_a 0.13% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000078s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000560s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.46% : 0.000192s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 2.35% : 0.000981s : 1: renormalize.infer 1.57% : 0.000654s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000046s : 1: rewriter_after_opt_a 0.24% : 0.000098s : 1: rewriter_before_opt_a 0.31% : 0.000130s : 1: symbol_engine_optimizer 65.43% : 0.027267s : 1: type_inference TotalTime = 0.0507907, [30] [bootstrap]: 0.0003268 [type_inference]: 0.041817 [event_method]: 2.123e-05 [auto_monad]: 6.626e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 9.947e-05 [rewriter_before_opt_a]: 8.372e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00601371, [2] [Cycle 1]: 0.00229, [27] [switch_simplify]: 5.439e-05 [loop_unroll]: 2.921e-05 [a_1]: 0.00051661 [with_stream_mark]: 2.104e-05 [recompute_prepare]: 7.09001e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 4.96002e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.31998e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.67001e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00132369 [add_forward_monad_depend]: 7.15e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.766e-05 [cse]: 3.651e-05 [replace_applicator]: 1.333e-05 [Cycle 2]: 0.00032199, [27] [switch_simplify]: 6.22001e-06 [loop_unroll]: 5.07e-06 [a_1]: 9.167e-05 [with_stream_mark]: 1.063e-05 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.388e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.31e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.361e-05 [rewriter_after_opt_a]: 0.00011825 [convert_after_rewriter]: 9.19e-06 [order_py_execute_after_rewriter]: 5.69999e-06 [mutable_eliminate]: 0.00061416 [jit_opt_b]: 5.152e-05, [1] [Cycle 1]: 4.468e-05, [2] [frontend_op_eliminate]: 1.482e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.635e-05 [loop_unroll]: 0.00047683 [jit_opt_after_cconv]: 0.00013778, [1] [Cycle 1]: 0.00013143, [11] [c_1]: 2.006e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.47999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.136e-05 [call_graph_tuple_transform]: 1.81e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.565e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.96e-06 [add_recomputation]: 5.017e-05 [cse_after_recomputation]: 2.265e-05, [1] [Cycle 1]: 1.707e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.727e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.0004604 [symbol_engine_optimizer]: 7.18e-05, [1] [Cycle 1]: 6.568e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 7.31999e-06 [elim_not_effective]: 1.242e-05 [opt_reshape]: 6.50002e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 4.59986e-07 [validate]: 3.77e-05 Sums bootstrap : 0.000327s : 0.70% type_inference : 0.041817s : 89.38% event_method : 0.000021s : 0.05% auto_monad : 0.000066s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000099s : 0.21% rewriter_before_opt_a : 0.000084s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000608s : 1.30% jit_opt_a.with_stream_mark : 0.000032s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001324s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000050s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000118s : 0.25% convert_after_rewriter : 0.000009s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000614s : 1.31% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000026s : 0.06% loop_unroll : 0.000477s : 1.02% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000460s : 0.98% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.08% Time group info: ------[substitution.] 0.000204 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000006s : 3: substitution.graph_param_transform 82.73% : 0.000169s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.72% : 0.000006s : 2: substitution.replace_old_param 6.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041747 2 96.88% : 0.040445s : 1: type_inference.infer 3.12% : 0.001302s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.32% : 0.000045s : 4: replace.inline 31.68% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 93.38% : 0.000166s : 4: match.inline 6.62% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.71% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.10% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.91% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.13% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.41% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000833 13 51.30% : 0.000427s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.69% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.02% : 0.000358s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052970 72 0.10% : 0.000053s : 1: add_recomputation 0.13% : 0.000070s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.66% : 0.000349s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000012s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.36% : 0.006017s : 1: jit_opt_a 0.26% : 0.000140s : 1: jit_opt_after_cconv 0.10% : 0.000054s : 1: jit_opt_b 0.92% : 0.000487s : 1: loop_unroll 1.18% : 0.000623s : 1: mutable_eliminate 1.55% : 0.000821s : 26: opt.transform.jit_opt_a 0.09% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.88% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000103s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.89% : 0.000474s : 1: renormalize.infer 1.59% : 0.000841s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000123s : 1: rewriter_after_opt_a 0.16% : 0.000087s : 1: rewriter_before_opt_a 0.14% : 0.000074s : 1: symbol_engine_optimizer 78.98% : 0.041836s : 1: type_inference TotalTime = 0.0317545, [30] [bootstrap]: 0.00059491 [type_inference]: 0.0118448 [event_method]: 2.922e-05 [auto_monad]: 8.706e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 4.07003e-06 [py_interpret_to_execute]: 8.177e-05 [rewriter_before_opt_a]: 0.00011001 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.0149678, [2] [Cycle 1]: 0.00599158, [27] [switch_simplify]: 8.598e-05 [loop_unroll]: 3.779e-05 [a_1]: 0.00104823 [with_stream_mark]: 3.264e-05 [recompute_prepare]: 1.07e-05 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.74002e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 2.79999e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 7.20998e-06 [meta_shard_fg_expand]: 3.11999e-06 [get_grad_eliminate_]: 5.76003e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 3.16999e-06 [replace_old_param]: 1.107e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00421898 [add_forward_monad_depend]: 1.202e-05 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.338e-05 [cse]: 8.604e-05 [replace_applicator]: 7.333e-05 [Cycle 2]: 0.00041026, [27] [switch_simplify]: 7.36999e-06 [loop_unroll]: 6.51999e-06 [a_1]: 0.00011543 [with_stream_mark]: 1.957e-05 [recompute_prepare]: 5.93998e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 5.15999e-06 [cell_reuse_recompute_pass]: 3.73001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.163e-05 [j_node_and_user_rematch]: 1.056e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.05999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 1.04998e-06 [auto_monad_eliminator]: 8.94998e-06 [cse]: 1.731e-05 [replace_applicator]: 5.90002e-06 [py_interpret_to_execute_after_opt_a]: 2.14e-05 [rewriter_after_opt_a]: 4.827e-05 [convert_after_rewriter]: 8.30999e-06 [order_py_execute_after_rewriter]: 5.81e-06 [mutable_eliminate]: 0.00107548 [jit_opt_b]: 6.558e-05, [1] [Cycle 1]: 5.567e-05, [2] [frontend_op_eliminate]: 2.157e-05 [inline_after_opt_a]: 2.085e-05 [cconv]: 4.784e-05 [loop_unroll]: 0.00063639 [jit_opt_after_cconv]: 0.00020548, [1] [Cycle 1]: 0.00019774, [11] [c_1]: 2.565e-05 [parameter_eliminate]: 6.02999e-06 [updatestate_depend_eliminate]: 1.188e-05 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 4.819e-05 [call_graph_tuple_transform]: 2.632e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 7.48e-06 [remove_dup_value]: 1.889e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 1.446e-05 [add_recomputation]: 6.672e-05 [cse_after_recomputation]: 2.968e-05, [1] [Cycle 1]: 2.266e-05, [1] [cse]: 1.477e-05 [auto_monad_reorder]: 2.103e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 1.178e-05 [opt_after_jit_grad]: 0.00103305 [symbol_engine_optimizer]: 0.00021426, [1] [Cycle 1]: 0.0002044, [6] [build]: 1.765e-05 [elim_shapecalc]: 1.057e-05 [elim_not_effective]: 0.00011802 [opt_reshape]: 8.62998e-06 [fold_const_symbol]: 1.15e-05 [renormalize]: 6.69999e-07 [validate]: 6.54e-05 Sums bootstrap : 0.000595s : 2.68% type_inference : 0.011845s : 53.30% event_method : 0.000029s : 0.13% auto_monad : 0.000087s : 0.39% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000004s : 0.02% py_interpret_to_execute : 0.000082s : 0.37% rewriter_before_opt_a : 0.000110s : 0.50% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000093s : 0.42% jit_opt_a.loop_unroll : 0.000044s : 0.20% jit_opt_a.a_1 : 0.001164s : 5.24% jit_opt_a.with_stream_mark : 0.000052s : 0.23% jit_opt_a.recompute_prepare : 0.000017s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.03% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.05% jit_opt_a.accelerated_algorithm : 0.000013s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000009s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.09% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.10% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.004219s : 18.99% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.15% jit_opt_a.cse : 0.000103s : 0.47% jit_opt_a.replace_applicator : 0.000079s : 0.36% py_interpret_to_execute_after_opt_a : 0.000021s : 0.10% rewriter_after_opt_a : 0.000048s : 0.22% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.001075s : 4.84% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.10% jit_opt_b.inline_after_opt_a : 0.000021s : 0.09% cconv : 0.000048s : 0.22% loop_unroll : 0.000636s : 2.86% jit_opt_after_cconv.c_1 : 0.000026s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.03% remove_dup_value : 0.000019s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000014s : 0.07% add_recomputation : 0.000067s : 0.30% cse_after_recomputation.cse : 0.000015s : 0.07% auto_monad_reorder : 0.000021s : 0.09% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.05% opt_after_jit_grad : 0.001033s : 4.65% symbol_engine_optimizer.build : 0.000018s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000118s : 0.53% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000065s : 0.29% Time group info: ------[substitution.] 0.000457 25 0.63% : 0.000003s : 2: substitution.elim_not_effective 0.35% : 0.000002s : 2: substitution.fold_const_symbol 1.44% : 0.000007s : 3: substitution.graph_param_transform 89.43% : 0.000409s : 5: substitution.inline 1.27% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.51% : 0.000007s : 4: substitution.remove_not_recompute_node 1.69% : 0.000008s : 2: substitution.replace_old_param 3.69% : 0.000017s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011726 2 83.52% : 0.009793s : 1: type_inference.infer 16.48% : 0.001932s : 1: type_inference.specialize ------[replace.] 0.000141 8 66.85% : 0.000094s : 5: replace.inline 33.15% : 0.000047s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000420 8 96.48% : 0.000406s : 5: match.inline 3.52% : 0.000015s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000664 810 0.36% : 0.000002s : 12: predicate.accumulaten_eliminater 54.74% : 0.000364s : 3: predicate.ad_related_special_op_eliminate 0.26% : 0.000002s : 12: predicate.addn_check_dump 0.42% : 0.000003s : 12: predicate.addn_zero_filter 0.52% : 0.000003s : 12: predicate.arithmetic_simplify 0.47% : 0.000003s : 12: predicate.cast_eliminate 0.15% : 0.000001s : 3: predicate.check_bprop_eliminate 0.27% : 0.000002s : 12: predicate.compare_switch_simplify 0.25% : 0.000002s : 12: predicate.depend_value_elim 0.26% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.33% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.40% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.11% : 0.000001s : 3: predicate.elim_not_effective 0.17% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.32% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.27% : 0.000002s : 12: predicate.environ_get_depend_swap 0.28% : 0.000002s : 12: predicate.environ_get_eliminate 0.30% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 3: predicate.fold_const_symbol 0.27% : 0.000002s : 6: predicate.get_grad_eliminate 0.09% : 0.000001s : 3: predicate.graph_param_transform 14.09% : 0.000094s : 26: predicate.inline 0.15% : 0.000001s : 6: predicate.inline_without_move 0.07% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.50% : 0.000003s : 6: predicate.less_batch_normalization 0.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 0.44% : 0.000003s : 18: predicate.load_eliminater 0.62% : 0.000004s : 3: predicate.loop_unroll_after_grad 0.98% : 0.000006s : 41: predicate.loop_unroll_before_grad 0.51% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.28% : 0.000002s : 12: predicate.merge_addn 0.30% : 0.000002s : 12: predicate.minmaximum_grad 0.75% : 0.000005s : 3: predicate.mutable_eliminate 0.18% : 0.000001s : 3: predicate.opt_reshape 0.56% : 0.000004s : 18: predicate.partial_eliminate 0.26% : 0.000002s : 12: predicate.print_const_string_wrapper 0.64% : 0.000004s : 12: predicate.reduce_eliminate 0.42% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.13% : 0.000001s : 6: predicate.remove_not_recompute_node 6.92% : 0.000046s : 21: predicate.replace_applicator 0.15% : 0.000001s : 6: predicate.replace_old_param 0.09% : 0.000001s : 3: predicate.reset_defer_inline 0.40% : 0.000003s : 12: predicate.reshape_eliminate 0.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.30% : 0.000002s : 3: predicate.row_tensor_eliminate 0.32% : 0.000002s : 12: predicate.same_eliminate 0.10% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.34% : 0.000002s : 6: predicate.special_op_eliminate 0.16% : 0.000001s : 6: predicate.specialize_transform 0.47% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 0.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.09% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.65% : 0.000004s : 20: predicate.switch_defer_inline 0.46% : 0.000003s : 20: predicate.switch_layer_defer_inline 1.85% : 0.000012s : 64: predicate.switch_simplify 0.32% : 0.000002s : 12: predicate.tile_eliminate 0.36% : 0.000002s : 12: predicate.transpose_eliminate 0.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 0.99% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 0.50% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 0.35% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.41% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 0.67% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 0.51% : 0.000003s : 12: predicate.value_based_eliminate 0.06% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001547 16 46.55% : 0.000720s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.96% : 0.000169s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.49% : 0.000657s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037849 72 0.18% : 0.000070s : 1: add_recomputation 0.24% : 0.000091s : 1: auto_monad 0.06% : 0.000024s : 1: auto_monad_reorder 1.67% : 0.000631s : 1: bootstrap 0.13% : 0.000051s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.09% : 0.000033s : 1: cse_after_recomputation 0.04% : 0.000017s : 1: environ_conv 0.09% : 0.000035s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 39.56% : 0.014973s : 1: jit_opt_a 0.55% : 0.000209s : 1: jit_opt_after_cconv 0.18% : 0.000070s : 1: jit_opt_b 1.72% : 0.000649s : 1: loop_unroll 2.90% : 0.001096s : 1: mutable_eliminate 3.96% : 0.001499s : 26: opt.transform.jit_opt_a 0.16% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000034s : 4: opt.transform.jit_opt_b 0.05% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000029s : 1: opt.transform.mutable_eliminate 1.06% : 0.000400s : 1: opt.transform.opt_after_jit_grad 0.38% : 0.000144s : 4: opt.transform.symbol_engine_opt 2.78% : 0.001053s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000006s : 1: pre_auto_parallel 0.23% : 0.000085s : 1: py_interpret_to_execute 0.06% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 9.24% : 0.003497s : 1: renormalize.infer 1.87% : 0.000707s : 1: renormalize.specialize 0.04% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000051s : 1: rewriter_after_opt_a 0.30% : 0.000114s : 1: rewriter_before_opt_a 0.58% : 0.000218s : 1: symbol_engine_optimizer 31.38% : 0.011878s : 1: type_inference TotalTime = 0.156727, [30] [bootstrap]: 0.00031755 [type_inference]: 0.112456 [event_method]: 1.996e-05 [auto_monad]: 5.095e-05 [graph_reusing]: 3.98999e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 0.0002425 [rewriter_before_opt_a]: 8.719e-05 [expand_dump_flag]: 2.17001e-06 [jit_opt_a]: 0.00692913, [2] [Cycle 1]: 0.00324879, [27] [switch_simplify]: 5.384e-05 [loop_unroll]: 3.569e-05 [a_1]: 0.00062051 [with_stream_mark]: 1.465e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 3.57997e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.79999e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 6.58998e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.262e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 6.28e-06 [renormalize]: 0.00219069 [add_forward_monad_depend]: 6.55002e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.266e-05 [cse]: 2.452e-05 [replace_applicator]: 1.455e-05 [Cycle 2]: 0.00045487, [27] [switch_simplify]: 6.94999e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00012716 [with_stream_mark]: 9.93002e-06 [recompute_prepare]: 6.59001e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.63002e-06 [specialize_transform]: 6.01998e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.29999e-06 [cse]: 1.424e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.252e-05 [rewriter_after_opt_a]: 3.532e-05 [convert_after_rewriter]: 6.39001e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00057221 [jit_opt_b]: 5.517e-05, [1] [Cycle 1]: 4.895e-05, [2] [frontend_op_eliminate]: 1.882e-05 [inline_after_opt_a]: 1.94e-05 [cconv]: 1.991e-05 [loop_unroll]: 0.00042424 [jit_opt_after_cconv]: 0.00017388, [1] [Cycle 1]: 0.00016654, [11] [c_1]: 2.598e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 3.993e-05 [call_graph_tuple_transform]: 2.049e-05 [tuple_list_get_item_eliminator]: 6.94999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.23002e-06 [remove_dup_value]: 1.363e-05 [partial_unused_args_eliminate]: 1.82999e-06 [environ_conv]: 6.16998e-06 [add_recomputation]: 3.693e-05 [cse_after_recomputation]: 2.41e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.188e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.0347671 [symbol_engine_optimizer]: 0.00017899, [1] [Cycle 1]: 0.00016789, [6] [build]: 6.25002e-06 [elim_shapecalc]: 9.84001e-06 [elim_not_effective]: 9.379e-05 [opt_reshape]: 1.074e-05 [fold_const_symbol]: 1.243e-05 [renormalize]: 1.37999e-06 [validate]: 5.656e-05 Sums bootstrap : 0.000318s : 0.21% type_inference : 0.112456s : 73.60% event_method : 0.000020s : 0.01% auto_monad : 0.000051s : 0.03% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000243s : 0.16% rewriter_before_opt_a : 0.000087s : 0.06% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000748s : 0.49% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002191s : 1.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000572s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000020s : 0.01% loop_unroll : 0.000424s : 0.28% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000037s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.034767s : 22.75% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000094s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000202 25 1.59% : 0.000003s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.44% : 0.000005s : 4: substitution.graph_param_transform 85.46% : 0.000172s : 5: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000003s : 2: substitution.replace_old_param 4.16% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112378 2 98.10% : 0.110247s : 1: type_inference.infer 1.90% : 0.002131s : 1: type_inference.specialize ------[replace.] 0.000094 7 67.26% : 0.000063s : 5: replace.inline 32.74% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 7 96.02% : 0.000169s : 5: match.inline 3.98% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 888 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 2.61% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.72% : 0.000002s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.72% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.07% : 0.000007s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.29% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 20: predicate.switch_defer_inline 2.28% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.96% : 0.000010s : 65: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 2.14% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001975 21 65.86% : 0.001301s : 12: func_graph_cloner_run.FuncGraphClonerGraph 2.87% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.27% : 0.000618s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160014 72 0.02% : 0.000040s : 1: add_recomputation 0.03% : 0.000054s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.21% : 0.000341s : 1: bootstrap 0.01% : 0.000022s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 4.33% : 0.006933s : 1: jit_opt_a 0.11% : 0.000176s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.27% : 0.000432s : 1: loop_unroll 0.36% : 0.000580s : 1: mutable_eliminate 0.62% : 0.000989s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000053s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000068s : 4: opt.transform.symbol_engine_opt 21.74% : 0.034791s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000248s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 0.97% : 0.001556s : 1: renormalize.infer 0.39% : 0.000625s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.06% : 0.000092s : 1: rewriter_before_opt_a 0.11% : 0.000182s : 1: symbol_engine_optimizer 70.29% : 0.112469s : 1: type_inference TotalTime = 0.0777655, [30] [bootstrap]: 0.0003761 [type_inference]: 0.0227023 [event_method]: 2.061e-05 [auto_monad]: 7.299e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00015171 [rewriter_before_opt_a]: 8.62e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00698485, [2] [Cycle 1]: 0.00278264, [27] [switch_simplify]: 6.759e-05 [loop_unroll]: 3.015e-05 [a_1]: 0.00061923 [with_stream_mark]: 2.487e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 3.43999e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 9.59999e-06 [inline_without_move]: 6.61e-06 [renormalize]: 0.00165523 [add_forward_monad_depend]: 9.37001e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 2.168e-05 [cse]: 3.798e-05 [replace_applicator]: 1.897e-05 [Cycle 2]: 0.00038769, [27] [switch_simplify]: 7.5e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00010959 [with_stream_mark]: 1.3e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.90002e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.51002e-06 [meta_shard_fg_expand]: 2.03997e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.744e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 9.77999e-06 [cse]: 1.882e-05 [replace_applicator]: 7e-06 [py_interpret_to_execute_after_opt_a]: 1.573e-05 [rewriter_after_opt_a]: 4.734e-05 [convert_after_rewriter]: 7.93999e-06 [order_py_execute_after_rewriter]: 6.06e-06 [mutable_eliminate]: 0.0451219 [jit_opt_b]: 8.221e-05, [1] [Cycle 1]: 6.921e-05, [2] [frontend_op_eliminate]: 2.68e-05 [inline_after_opt_a]: 2.54e-05 [cconv]: 4.044e-05 [loop_unroll]: 0.00055975 [jit_opt_after_cconv]: 0.00019837, [1] [Cycle 1]: 0.0001897, [11] [c_1]: 2.641e-05 [parameter_eliminate]: 5.13002e-06 [updatestate_depend_eliminate]: 8.37998e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [cse]: 4.637e-05 [call_graph_tuple_transform]: 2.799e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 1.13001e-06 [switch_simplify]: 7.68999e-06 [remove_dup_value]: 1.662e-05 [partial_unused_args_eliminate]: 2.94001e-06 [environ_conv]: 7.13e-06 [add_recomputation]: 6.268e-05 [cse_after_recomputation]: 2.6e-05, [1] [Cycle 1]: 1.985e-05, [1] [cse]: 1.314e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 1.065e-05 [opt_after_jit_grad]: 0.00076878 [symbol_engine_optimizer]: 8.967e-05, [1] [Cycle 1]: 8.042e-05, [6] [build]: 6.61e-06 [elim_shapecalc]: 8.41002e-06 [elim_not_effective]: 1.694e-05 [opt_reshape]: 8.07e-06 [fold_const_symbol]: 1.067e-05 [renormalize]: 1.29998e-06 [validate]: 4.966e-05 Sums bootstrap : 0.000376s : 0.51% type_inference : 0.022702s : 30.99% event_method : 0.000021s : 0.03% auto_monad : 0.000073s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000152s : 0.21% rewriter_before_opt_a : 0.000086s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000729s : 0.99% jit_opt_a.with_stream_mark : 0.000038s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001655s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.04% jit_opt_a.cse : 0.000057s : 0.08% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000047s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.045122s : 61.59% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.04% jit_opt_b.inline_after_opt_a : 0.000025s : 0.03% cconv : 0.000040s : 0.06% loop_unroll : 0.000560s : 0.76% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000063s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000769s : 1.05% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.07% Time group info: ------[substitution.] 0.000273 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.47% : 0.000007s : 3: substitution.graph_param_transform 85.44% : 0.000233s : 4: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000007s : 4: substitution.remove_not_recompute_node 1.73% : 0.000005s : 2: substitution.replace_old_param 4.84% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022620 2 89.76% : 0.020303s : 1: type_inference.infer 10.24% : 0.002317s : 1: type_inference.specialize ------[replace.] 0.000083 6 67.22% : 0.000055s : 4: replace.inline 32.78% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 94.96% : 0.000230s : 4: match.inline 5.04% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.21% : 0.000002s : 10: predicate.accumulaten_eliminater 1.62% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.27% : 0.000002s : 10: predicate.cast_eliminate 0.86% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.50% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 3.50% : 0.000005s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 1.92% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.53% : 0.000002s : 18: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.20% : 0.000002s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.23% : 0.000010s : 53: predicate.switch_simplify 1.13% : 0.000002s : 10: predicate.tile_eliminate 1.52% : 0.000002s : 10: predicate.transpose_eliminate 1.23% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.01% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 10: predicate.value_based_eliminate 0.45% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 1.10% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001170 13 40.03% : 0.000468s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.23% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.73% : 0.000640s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.080495 72 0.08% : 0.000067s : 1: add_recomputation 0.09% : 0.000076s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.49% : 0.000396s : 1: bootstrap 0.05% : 0.000044s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.68% : 0.006990s : 1: jit_opt_a 0.25% : 0.000202s : 1: jit_opt_after_cconv 0.11% : 0.000086s : 1: jit_opt_b 0.71% : 0.000569s : 1: loop_unroll 56.08% : 0.045143s : 1: mutable_eliminate 1.21% : 0.000976s : 26: opt.transform.jit_opt_a 0.08% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000040s : 4: opt.transform.jit_opt_b 0.02% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000036s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000781s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000156s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.22% : 0.000983s : 1: renormalize.infer 0.82% : 0.000662s : 1: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000052s : 1: rewriter_after_opt_a 0.11% : 0.000090s : 1: rewriter_before_opt_a 0.12% : 0.000093s : 1: symbol_engine_optimizer 28.22% : 0.022720s : 1: type_inference TotalTime = 0.0129314, [30] [bootstrap]: 0.00029608 [type_inference]: 0.00504442 [event_method]: 1.718e-05 [auto_monad]: 4.922e-05 [graph_reusing]: 4.45e-06 [pre_auto_parallel]: 2.09999e-06 [py_interpret_to_execute]: 3.242e-05 [rewriter_before_opt_a]: 6.561e-05 [expand_dump_flag]: 2.17001e-06 [jit_opt_a]: 0.0052869, [2] [Cycle 1]: 0.00174431, [27] [switch_simplify]: 5.987e-05 [loop_unroll]: 2.977e-05 [a_1]: 0.00055189 [with_stream_mark]: 2.101e-05 [recompute_prepare]: 7.29001e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.42997e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 8.27998e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.94003e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00074409 [add_forward_monad_depend]: 5.84999e-06 [auto_monad_grad]: 2.75002e-06 [auto_monad_eliminator]: 1.527e-05 [cse]: 3.474e-05 [replace_applicator]: 1.205e-05 [Cycle 2]: 0.00031719, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 4.80999e-06 [a_1]: 8.807e-05 [with_stream_mark]: 9.14e-06 [recompute_prepare]: 4.78001e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 4.72998e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.221e-05 [j_node_and_user_rematch]: 7.73001e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 6.94999e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.50006e-07 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.384e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.238e-05 [rewriter_after_opt_a]: 3.803e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00055474 [jit_opt_b]: 4.812e-05, [1] [Cycle 1]: 4.143e-05, [2] [frontend_op_eliminate]: 1.49e-05 [inline_after_opt_a]: 1.543e-05 [cconv]: 2.688e-05 [loop_unroll]: 0.00043479 [jit_opt_after_cconv]: 0.00015215, [1] [Cycle 1]: 0.00014435, [11] [c_1]: 1.97e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.323e-05 [call_graph_tuple_transform]: 2.599e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.61003e-06 [remove_dup_value]: 1.73e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 5.89e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 2.321e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.215e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00044555 [symbol_engine_optimizer]: 7.062e-05, [1] [Cycle 1]: 6.484e-05, [6] [build]: 3.87998e-06 [elim_shapecalc]: 7.53e-06 [elim_not_effective]: 1.245e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.54002e-06 [renormalize]: 4.90021e-07 [validate]: 3.932e-05 Sums bootstrap : 0.000296s : 3.24% type_inference : 0.005044s : 55.26% event_method : 0.000017s : 0.19% auto_monad : 0.000049s : 0.54% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000032s : 0.36% rewriter_before_opt_a : 0.000066s : 0.72% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.72% jit_opt_a.loop_unroll : 0.000035s : 0.38% jit_opt_a.a_1 : 0.000640s : 7.01% jit_opt_a.with_stream_mark : 0.000030s : 0.33% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000744s : 8.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000049s : 0.53% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000038s : 0.42% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000555s : 6.08% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000027s : 0.29% loop_unroll : 0.000435s : 4.76% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.28% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000050s : 0.54% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000446s : 4.88% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000039s : 0.43% Time group info: ------[substitution.] 0.000236 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 5.55% : 0.000013s : 3: substitution.graph_param_transform 83.17% : 0.000196s : 4: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 5.17% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004988 2 84.25% : 0.004202s : 1: type_inference.infer 15.75% : 0.000786s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.33% : 0.000046s : 4: replace.inline 32.67% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.57% : 0.000194s : 4: match.inline 5.43% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.45% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.86% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000001s : 10: predicate.print_const_string_wrapper 1.41% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.48% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.27% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000631 13 50.98% : 0.000322s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.76% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.25% : 0.000260s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014591 72 0.36% : 0.000053s : 1: add_recomputation 0.36% : 0.000053s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.18% : 0.000318s : 1: bootstrap 0.20% : 0.000029s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.25% : 0.005290s : 1: jit_opt_a 1.06% : 0.000155s : 1: jit_opt_after_cconv 0.35% : 0.000051s : 1: jit_opt_b 3.04% : 0.000443s : 1: loop_unroll 3.86% : 0.000564s : 1: mutable_eliminate 5.85% : 0.000853s : 26: opt.transform.jit_opt_a 0.37% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.11% : 0.000454s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000035s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000020s : 1: remove_dup_value 2.95% : 0.000430s : 1: renormalize.infer 2.10% : 0.000306s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000042s : 1: rewriter_after_opt_a 0.47% : 0.000069s : 1: rewriter_before_opt_a 0.50% : 0.000073s : 1: symbol_engine_optimizer 34.68% : 0.005060s : 1: type_inference TotalTime = 0.028072, [30] [bootstrap]: 0.00032159 [type_inference]: 0.0163236 [event_method]: 2.097e-05 [auto_monad]: 7.051e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.70997e-06 [py_interpret_to_execute]: 5.425e-05 [rewriter_before_opt_a]: 8.692e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00762891, [2] [Cycle 1]: 0.00189755, [27] [switch_simplify]: 5.517e-05 [loop_unroll]: 3.492e-05 [a_1]: 0.00065802 [with_stream_mark]: 1.587e-05 [recompute_prepare]: 1.65e-05 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.86998e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 9.33997e-06 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.74999e-06 [renormalize]: 0.00079192 [add_forward_monad_depend]: 6.11e-06 [auto_monad_grad]: 1.40999e-06 [auto_monad_eliminator]: 1.235e-05 [cse]: 2.875e-05 [replace_applicator]: 1.419e-05 [Cycle 2]: 0.00033913, [27] [switch_simplify]: 7.06001e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.061e-05 [with_stream_mark]: 1.067e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.97999e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.365e-05 [j_node_and_user_rematch]: 8.14002e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 8.22998e-06 [inline_without_move]: 4.87e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.592e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.14e-05 [rewriter_after_opt_a]: 3.27e-05 [convert_after_rewriter]: 5.91e-06 [order_py_execute_after_rewriter]: 4.47998e-06 [mutable_eliminate]: 0.00051862 [jit_opt_b]: 4.989e-05, [1] [Cycle 1]: 4.361e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.608e-05 [cconv]: 1.962e-05 [loop_unroll]: 0.00043493 [jit_opt_after_cconv]: 0.00015134, [1] [Cycle 1]: 0.00014507, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 2.94999e-06 [updatestate_depend_eliminate]: 6.68e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 2.682e-05 [call_graph_tuple_transform]: 1.872e-05 [tuple_list_get_item_eliminator]: 5.75001e-06 [none_parameter_eliminate]: 9.89996e-07 [renormalize]: 3.59985e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 3.45e-05 [partial_unused_args_eliminate]: 1.52001e-06 [environ_conv]: 4.60001e-06 [add_recomputation]: 0.00131674 [cse_after_recomputation]: 4.857e-05, [1] [Cycle 1]: 3.889e-05, [1] [cse]: 2.519e-05 [auto_monad_reorder]: 1.929e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 6.23998e-06 [opt_after_jit_grad]: 0.0005589 [symbol_engine_optimizer]: 7.724e-05, [1] [Cycle 1]: 6.996e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 8.59998e-06 [elim_not_effective]: 1.534e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 5.8001e-07 [validate]: 3.808e-05 Sums bootstrap : 0.000322s : 1.46% type_inference : 0.016324s : 74.09% event_method : 0.000021s : 0.10% auto_monad : 0.000071s : 0.32% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000054s : 0.25% rewriter_before_opt_a : 0.000087s : 0.39% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.28% jit_opt_a.loop_unroll : 0.000040s : 0.18% jit_opt_a.a_1 : 0.000749s : 3.40% jit_opt_a.with_stream_mark : 0.000027s : 0.12% jit_opt_a.recompute_prepare : 0.000022s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.000792s : 3.59% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.09% jit_opt_a.cse : 0.000045s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.09% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000033s : 0.15% convert_after_rewriter : 0.000006s : 0.03% order_py_execute_after_rewriter : 0.000004s : 0.02% mutable_eliminate : 0.000519s : 2.35% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000020s : 0.09% loop_unroll : 0.000435s : 1.97% jit_opt_after_cconv.c_1 : 0.000021s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000035s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.001317s : 5.98% cse_after_recomputation.cse : 0.000025s : 0.11% auto_monad_reorder : 0.000019s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000559s : 2.54% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.17% Time group info: ------[substitution.] 0.000227 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.09% : 0.000005s : 3: substitution.graph_param_transform 86.70% : 0.000197s : 5: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 4.58% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016240 2 92.64% : 0.015045s : 1: type_inference.infer 7.36% : 0.001195s : 1: type_inference.specialize ------[replace.] 0.000100 7 64.37% : 0.000064s : 5: replace.inline 35.63% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 7 95.54% : 0.000194s : 5: match.inline 4.46% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.37% : 0.000002s : 11: predicate.addn_zero_filter 1.89% : 0.000002s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.19% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.18% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000001s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 2.16% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 1.49% : 0.000002s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.59% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.73% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.90% : 0.000004s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.90% : 0.000010s : 59: predicate.switch_simplify 1.20% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.94% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000882 16 47.34% : 0.000418s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.53% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.13% : 0.000398s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029893 72 4.45% : 0.001330s : 1: add_recomputation 0.25% : 0.000074s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.14% : 0.000341s : 1: bootstrap 0.07% : 0.000022s : 1: cconv 0.03% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000052s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 25.53% : 0.007633s : 1: jit_opt_a 0.51% : 0.000154s : 1: jit_opt_after_cconv 0.18% : 0.000052s : 1: jit_opt_b 1.49% : 0.000444s : 1: loop_unroll 1.76% : 0.000528s : 1: mutable_eliminate 3.29% : 0.000984s : 26: opt.transform.jit_opt_a 0.16% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.09% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.90% : 0.000569s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000057s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000037s : 1: remove_dup_value 1.49% : 0.000444s : 1: renormalize.infer 1.13% : 0.000339s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000035s : 1: rewriter_after_opt_a 0.30% : 0.000090s : 1: rewriter_before_opt_a 0.27% : 0.000080s : 1: symbol_engine_optimizer 54.67% : 0.016342s : 1: type_inference TotalTime = 0.202819, [30] [bootstrap]: 0.0003894 [type_inference]: 0.184629 [event_method]: 1.814e-05 [auto_monad]: 6.794e-05 [graph_reusing]: 7e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00053921 [rewriter_before_opt_a]: 8.252e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0143425, [2] [Cycle 1]: 0.00743404, [27] [switch_simplify]: 7.494e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00068906 [with_stream_mark]: 2.716e-05 [recompute_prepare]: 1.001e-05 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.53e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 3.20998e-06 [get_grad_eliminate_]: 6.74001e-06 [merge_forward]: 4.89998e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.644e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.067e-05 [inline_without_move]: 6.66999e-06 [renormalize]: 0.00618387 [add_forward_monad_depend]: 1.243e-05 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 2.386e-05 [cse]: 3.599e-05 [replace_applicator]: 2.508e-05 [Cycle 2]: 0.00042246, [27] [switch_simplify]: 8.87e-06 [loop_unroll]: 6.91999e-06 [a_1]: 0.00013908 [with_stream_mark]: 1.792e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.84e-06 [cell_reuse_recompute_pass]: 4.38001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.92e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 5.76998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.91998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 8.45001e-06 [cse]: 1.501e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 1.642e-05 [rewriter_after_opt_a]: 6.969e-05 [convert_after_rewriter]: 8.02e-06 [order_py_execute_after_rewriter]: 5.70001e-06 [mutable_eliminate]: 0.00079661 [jit_opt_b]: 6.482e-05, [1] [Cycle 1]: 5.589e-05, [2] [frontend_op_eliminate]: 2.364e-05 [inline_after_opt_a]: 1.944e-05 [cconv]: 3.234e-05 [loop_unroll]: 0.0004712 [jit_opt_after_cconv]: 0.00017044, [1] [Cycle 1]: 0.00016194, [11] [c_1]: 2.837e-05 [parameter_eliminate]: 3.45e-06 [updatestate_depend_eliminate]: 8.55001e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.694e-05 [call_graph_tuple_transform]: 2.362e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.562e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 1.119e-05 [add_recomputation]: 5.406e-05 [cse_after_recomputation]: 2.628e-05, [1] [Cycle 1]: 1.954e-05, [1] [cse]: 1.228e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 6.39999e-06 [opt_after_jit_grad]: 0.00051117 [symbol_engine_optimizer]: 8.519e-05, [1] [Cycle 1]: 7.836e-05, [6] [build]: 5.95002e-06 [elim_shapecalc]: 8.79003e-06 [elim_not_effective]: 1.865e-05 [opt_reshape]: 6.25002e-06 [fold_const_symbol]: 1.177e-05 [renormalize]: 2.50002e-07 [validate]: 0.00016028 Sums bootstrap : 0.000389s : 0.20% type_inference : 0.184629s : 94.36% event_method : 0.000018s : 0.01% auto_monad : 0.000068s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000539s : 0.28% rewriter_before_opt_a : 0.000083s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.04% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000828s : 0.42% jit_opt_a.with_stream_mark : 0.000045s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.006184s : 3.16% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000070s : 0.04% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000797s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000471s : 0.24% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000511s : 0.26% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000160s : 0.08% Time group info: ------[substitution.] 0.000290 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000007s : 4: substitution.graph_param_transform 85.93% : 0.000250s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000006s : 4: substitution.remove_not_recompute_node 2.18% : 0.000006s : 2: substitution.replace_old_param 5.03% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.184551 2 98.11% : 0.181067s : 1: type_inference.infer 1.89% : 0.003484s : 1: type_inference.specialize ------[replace.] 0.000088 6 68.92% : 0.000061s : 4: replace.inline 31.08% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 6 94.83% : 0.000247s : 4: match.inline 5.17% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.33% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.24% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.08% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.41% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 2.24% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 2.46% : 0.000004s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.66% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.69% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.14% : 0.000011s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.10% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 2.06% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 2.03% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002672 22 59.20% : 0.001582s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.18% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.62% : 0.001032s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.210062 72 0.03% : 0.000057s : 1: add_recomputation 0.03% : 0.000071s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000417s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.83% : 0.014346s : 1: jit_opt_a 0.08% : 0.000173s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.23% : 0.000481s : 1: loop_unroll 0.39% : 0.000809s : 1: mutable_eliminate 0.52% : 0.001097s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000546s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.38% : 0.004993s : 1: renormalize.infer 0.56% : 0.001175s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000074s : 1: rewriter_after_opt_a 0.04% : 0.000089s : 1: rewriter_before_opt_a 0.04% : 0.000089s : 1: symbol_engine_optimizer 87.90% : 0.184646s : 1: type_inference TotalTime = 0.480275, [30] [bootstrap]: 0.00031458 [type_inference]: 0.421928 [event_method]: 2.726e-05 [auto_monad]: 8.934e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.00094586 [rewriter_before_opt_a]: 0.00011532 [expand_dump_flag]: 4.30999e-06 [jit_opt_a]: 0.0537835, [2] [Cycle 1]: 0.0464509, [27] [switch_simplify]: 7.55e-05 [loop_unroll]: 3.31e-05 [a_1]: 0.00144021 [with_stream_mark]: 2.502e-05 [recompute_prepare]: 1.091e-05 [updatestate_depend_eliminate]: 1.948e-05 [updatestate_assign_eliminate]: 1.357e-05 [updatestate_loads_eliminate]: 1.721e-05 [parameter_eliminate]: 1.309e-05 [specialize_transform]: 3.488e-05 [updatestate_useless_node_eliminater]: 3.456e-05 [accelerated_algorithm]: 7.97998e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 7.61999e-06 [merge_forward]: 5.86e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.759e-05 [j_node_and_user_rematch]: 1.281e-05 [meta_fg_expand]: 3.09999e-06 [replace_old_param]: 1.173e-05 [inline_without_move]: 7.32002e-06 [renormalize]: 0.00360691 [add_forward_monad_depend]: 1.995e-05 [auto_monad_grad]: 3.35e-06 [auto_monad_eliminator]: 4.754e-05 [cse]: 6.566e-05 [replace_applicator]: 3.911e-05 [Cycle 2]: 0.00046758, [27] [switch_simplify]: 8.62e-06 [loop_unroll]: 8.57e-06 [a_1]: 0.00014944 [with_stream_mark]: 1.991e-05 [recompute_prepare]: 6.53e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.78998e-06 [specialize_transform]: 6.80002e-06 [updatestate_useless_node_eliminater]: 6.61999e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 3.08e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 5.29998e-06 [cell_reuse_recompute_pass]: 5.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.712e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 3.75e-06 [replace_old_param]: 1.251e-05 [inline_without_move]: 5.87999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.66998e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 7.8e-06 [cse]: 1.833e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 2.626e-05 [rewriter_after_opt_a]: 4.911e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00098432 [jit_opt_b]: 7.879e-05, [1] [Cycle 1]: 6.724e-05, [2] [frontend_op_eliminate]: 3.122e-05 [inline_after_opt_a]: 2.221e-05 [cconv]: 3.971e-05 [loop_unroll]: 0.0005276 [jit_opt_after_cconv]: 0.00022141, [1] [Cycle 1]: 0.0002123, [11] [c_1]: 2.857e-05 [parameter_eliminate]: 4.03999e-06 [updatestate_depend_eliminate]: 1.006e-05 [updatestate_assign_eliminate]: 5.09e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 3.298e-05 [call_graph_tuple_transform]: 2.583e-05 [tuple_list_get_item_eliminator]: 6.89999e-06 [none_parameter_eliminate]: 2.37999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.54001e-06 [remove_dup_value]: 2.033e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 1.324e-05 [add_recomputation]: 5.679e-05 [cse_after_recomputation]: 2.983e-05, [1] [Cycle 1]: 2.19e-05, [1] [cse]: 1.572e-05 [auto_monad_reorder]: 1.86e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 8.01001e-06 [opt_after_jit_grad]: 0.00057874 [symbol_engine_optimizer]: 8.853e-05, [1] [Cycle 1]: 8.169e-05, [6] [build]: 4.62e-06 [elim_shapecalc]: 9.17001e-06 [elim_not_effective]: 1.882e-05 [opt_reshape]: 7.01001e-06 [fold_const_symbol]: 1.152e-05 [renormalize]: 6.00005e-07 [validate]: 6.899e-05 Sums bootstrap : 0.000315s : 0.07% type_inference : 0.421928s : 97.67% event_method : 0.000027s : 0.01% auto_monad : 0.000089s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000946s : 0.22% rewriter_before_opt_a : 0.000115s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001590s : 0.37% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000024s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000017s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000020s : 0.00% jit_opt_a.parameter_eliminate : 0.000016s : 0.00% jit_opt_a.specialize_transform : 0.000042s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000041s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003607s : 0.83% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000055s : 0.01% jit_opt_a.cse : 0.000084s : 0.02% jit_opt_a.replace_applicator : 0.000045s : 0.01% py_interpret_to_execute_after_opt_a : 0.000026s : 0.01% rewriter_after_opt_a : 0.000049s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000984s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000031s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000040s : 0.01% loop_unroll : 0.000528s : 0.12% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000579s : 0.13% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000069s : 0.02% Time group info: ------[substitution.] 0.000871 24 0.22% : 0.000002s : 2: substitution.elim_not_effective 0.16% : 0.000001s : 2: substitution.fold_const_symbol 0.78% : 0.000007s : 4: substitution.graph_param_transform 94.68% : 0.000824s : 4: substitution.inline 0.60% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.73% : 0.000006s : 4: substitution.remove_not_recompute_node 0.98% : 0.000009s : 2: substitution.replace_old_param 1.85% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.421782 2 93.86% : 0.395868s : 1: type_inference.infer 6.14% : 0.025915s : 1: type_inference.specialize ------[replace.] 0.000176 6 82.22% : 0.000145s : 4: replace.inline 17.78% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000832 6 98.21% : 0.000817s : 4: match.inline 1.79% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000188 830 1.15% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.78% : 0.000001s : 12: predicate.addn_check_dump 1.74% : 0.000003s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000003s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 0.77% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 0.80% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.81% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 0.78% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 6.49% : 0.000012s : 26: predicate.inline 0.67% : 0.000001s : 8: predicate.inline_without_move 0.56% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.75% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 18: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000007s : 36: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.82% : 0.000002s : 12: predicate.merge_addn 0.82% : 0.000002s : 12: predicate.minmaximum_grad 1.40% : 0.000003s : 4: predicate.mutable_eliminate 0.35% : 0.000001s : 4: predicate.opt_reshape 1.64% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000003s : 12: predicate.reduce_eliminate 4.89% : 0.000009s : 14: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000003s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.97% : 0.000002s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.50% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 8: predicate.special_op_eliminate 2.23% : 0.000004s : 8: predicate.specialize_transform 1.25% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000004s : 18: predicate.switch_defer_inline 1.63% : 0.000003s : 18: predicate.switch_layer_defer_inline 5.98% : 0.000011s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000002s : 12: predicate.transpose_eliminate 1.06% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.15% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.55% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 6.83% : 0.000013s : 26: predicate.updatestate_useless_node_eliminater 1.40% : 0.000003s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002467 22 62.18% : 0.001534s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.61% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.21% : 0.000869s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.485899 72 0.01% : 0.000060s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000023s : 1: auto_monad_reorder 0.07% : 0.000333s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 11.07% : 0.053789s : 1: jit_opt_a 0.05% : 0.000224s : 1: jit_opt_after_cconv 0.02% : 0.000081s : 1: jit_opt_b 0.11% : 0.000537s : 1: loop_unroll 0.20% : 0.000996s : 1: mutable_eliminate 0.40% : 0.001949s : 26: opt.transform.jit_opt_a 0.01% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000045s : 4: opt.transform.jit_opt_b 0.00% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000588s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.20% : 0.000960s : 1: py_interpret_to_execute 0.01% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000023s : 1: remove_dup_value 0.54% : 0.002612s : 1: renormalize.infer 0.20% : 0.000981s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000052s : 1: rewriter_after_opt_a 0.03% : 0.000123s : 1: rewriter_before_opt_a 0.02% : 0.000095s : 1: symbol_engine_optimizer 86.84% : 0.421947s : 1: type_inference TotalTime = 0.0432827, [30] [bootstrap]: 0.00039814 [type_inference]: 0.0311777 [event_method]: 2.811e-05 [auto_monad]: 8.389e-05 [graph_reusing]: 6.76e-06 [pre_auto_parallel]: 3.54002e-06 [py_interpret_to_execute]: 0.00011923 [rewriter_before_opt_a]: 0.00011317 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00832954, [2] [Cycle 1]: 0.00364932, [27] [switch_simplify]: 7.52e-05 [loop_unroll]: 3.663e-05 [a_1]: 0.00080077 [with_stream_mark]: 2.189e-05 [recompute_prepare]: 9.25001e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.05002e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 3.08998e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 5.80002e-06 [renormalize]: 0.00231507 [add_forward_monad_depend]: 8.67e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.866e-05 [cse]: 3.694e-05 [replace_applicator]: 2.033e-05 [Cycle 2]: 0.0003691, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.17e-06 [a_1]: 0.00010383 [with_stream_mark]: 1.258e-05 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 3.60998e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.41998e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 3.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.29002e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 9.09998e-06 [cse]: 1.601e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 1.602e-05 [rewriter_after_opt_a]: 4.172e-05 [convert_after_rewriter]: 7.68999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00081478 [jit_opt_b]: 5.728e-05, [1] [Cycle 1]: 4.959e-05, [2] [frontend_op_eliminate]: 1.958e-05 [inline_after_opt_a]: 1.904e-05 [cconv]: 3.061e-05 [loop_unroll]: 0.00054545 [jit_opt_after_cconv]: 0.00018757, [1] [Cycle 1]: 0.00017828, [11] [c_1]: 2.479e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 9.20999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.916e-05 [call_graph_tuple_transform]: 2.351e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.83002e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.86999e-06 [remove_dup_value]: 2.047e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 1.275e-05 [add_recomputation]: 5.719e-05 [cse_after_recomputation]: 3.014e-05, [1] [Cycle 1]: 2.264e-05, [1] [cse]: 1.428e-05 [auto_monad_reorder]: 2.012e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 9.67001e-06 [opt_after_jit_grad]: 0.00070906 [symbol_engine_optimizer]: 0.00010649, [1] [Cycle 1]: 9.744e-05, [6] [build]: 1.768e-05 [elim_shapecalc]: 1.014e-05 [elim_not_effective]: 1.886e-05 [opt_reshape]: 7.15998e-06 [fold_const_symbol]: 1.161e-05 [renormalize]: 2.79979e-07 [validate]: 6.622e-05 Sums bootstrap : 0.000398s : 1.04% type_inference : 0.031178s : 81.57% event_method : 0.000028s : 0.07% auto_monad : 0.000084s : 0.22% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000119s : 0.31% rewriter_before_opt_a : 0.000113s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000082s : 0.21% jit_opt_a.loop_unroll : 0.000042s : 0.11% jit_opt_a.a_1 : 0.000905s : 2.37% jit_opt_a.with_stream_mark : 0.000034s : 0.09% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.002315s : 6.06% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.07% jit_opt_a.cse : 0.000053s : 0.14% jit_opt_a.replace_applicator : 0.000026s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.04% rewriter_after_opt_a : 0.000042s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000815s : 2.13% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.05% cconv : 0.000031s : 0.08% loop_unroll : 0.000545s : 1.43% jit_opt_after_cconv.c_1 : 0.000025s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000013s : 0.03% add_recomputation : 0.000057s : 0.15% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000709s : 1.86% symbol_engine_optimizer.build : 0.000018s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000066s : 0.17% Time group info: ------[substitution.] 0.000310 25 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 1.74% : 0.000005s : 3: substitution.graph_param_transform 86.97% : 0.000269s : 5: substitution.inline 1.02% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 5.21% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031067 2 19.93% : 0.006192s : 1: type_inference.infer 80.07% : 0.024875s : 1: type_inference.specialize ------[replace.] 0.000142 8 55.60% : 0.000079s : 5: replace.inline 44.40% : 0.000063s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 8 94.88% : 0.000266s : 5: match.inline 5.12% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 810 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.65% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 12: predicate.addn_check_dump 1.68% : 0.000003s : 12: predicate.addn_zero_filter 2.51% : 0.000004s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.19% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.10% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 5.66% : 0.000009s : 26: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.72% : 0.000003s : 6: predicate.less_batch_normalization 1.88% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 18: predicate.load_eliminater 1.68% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.58% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 2.17% : 0.000003s : 12: predicate.reduce_eliminate 1.81% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.55% : 0.000002s : 21: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000002s : 3: predicate.row_tensor_eliminate 1.04% : 0.000002s : 12: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.09% : 0.000005s : 20: predicate.switch_defer_inline 2.25% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.12% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.51% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.70% : 0.000003s : 12: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002685 16 25.46% : 0.000684s : 7: func_graph_cloner_run.FuncGraphClonerGraph 3.13% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 71.41% : 0.001917s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046780 72 0.13% : 0.000062s : 1: add_recomputation 0.19% : 0.000088s : 1: auto_monad 0.05% : 0.000024s : 1: auto_monad_reorder 0.89% : 0.000417s : 1: bootstrap 0.07% : 0.000033s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000032s : 1: cse_after_recomputation 0.03% : 0.000015s : 1: environ_conv 0.07% : 0.000033s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.82% : 0.008334s : 1: jit_opt_a 0.41% : 0.000191s : 1: jit_opt_after_cconv 0.13% : 0.000061s : 1: jit_opt_b 1.19% : 0.000558s : 1: loop_unroll 1.77% : 0.000827s : 1: mutable_eliminate 2.49% : 0.001164s : 26: opt.transform.jit_opt_a 0.12% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000031s : 4: opt.transform.jit_opt_b 0.04% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.08% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000727s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000124s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000024s : 1: remove_dup_value 1.52% : 0.000709s : 1: renormalize.infer 3.41% : 0.001595s : 1: renormalize.specialize 0.03% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000045s : 1: rewriter_after_opt_a 0.25% : 0.000119s : 1: rewriter_before_opt_a 0.24% : 0.000111s : 1: symbol_engine_optimizer 66.71% : 0.031206s : 1: type_inference TotalTime = 0.0707912, [30] [bootstrap]: 0.00031579 [type_inference]: 0.0614704 [event_method]: 2.416e-05 [auto_monad]: 7.248e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00010908 [rewriter_before_opt_a]: 8.434e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00627123, [2] [Cycle 1]: 0.00218422, [27] [switch_simplify]: 6.385e-05 [loop_unroll]: 2.928e-05 [a_1]: 0.00057734 [with_stream_mark]: 2.324e-05 [recompute_prepare]: 9.37999e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.45003e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.065e-05 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00105422 [add_forward_monad_depend]: 6.092e-05 [auto_monad_grad]: 2.95002e-06 [auto_monad_eliminator]: 2.038e-05 [cse]: 3.973e-05 [replace_applicator]: 1.673e-05 [Cycle 2]: 0.00035271, [27] [switch_simplify]: 6.15002e-06 [loop_unroll]: 5.04e-06 [a_1]: 8.998e-05 [with_stream_mark]: 1.175e-05 [recompute_prepare]: 4.95001e-06 [updatestate_depend_eliminate]: 3.25002e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.71998e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.92998e-06 [inline_without_move]: 5.12e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.341e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 1.63e-05 [rewriter_after_opt_a]: 3.959e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00072448 [jit_opt_b]: 5.197e-05, [1] [Cycle 1]: 4.37e-05, [2] [frontend_op_eliminate]: 1.569e-05 [inline_after_opt_a]: 1.646e-05 [cconv]: 3.036e-05 [loop_unroll]: 0.00045031 [jit_opt_after_cconv]: 0.00014819, [1] [Cycle 1]: 0.00014119, [11] [c_1]: 1.977e-05 [parameter_eliminate]: 2.88998e-06 [updatestate_depend_eliminate]: 6.63e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.527e-05 [call_graph_tuple_transform]: 1.969e-05 [tuple_list_get_item_eliminator]: 5.26998e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 5.20001e-06 [remove_dup_value]: 1.72e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 5.53e-05 [cse_after_recomputation]: 2.548e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.291e-05 [auto_monad_reorder]: 1.818e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 6.03998e-06 [opt_after_jit_grad]: 0.00049801 [symbol_engine_optimizer]: 7.262e-05, [1] [Cycle 1]: 6.561e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.362e-05 [opt_reshape]: 5.64e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 5.89993e-07 [validate]: 4.388e-05 Sums bootstrap : 0.000316s : 0.48% type_inference : 0.061470s : 92.58% event_method : 0.000024s : 0.04% auto_monad : 0.000072s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000109s : 0.16% rewriter_before_opt_a : 0.000084s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.11% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000667s : 1.01% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001054s : 1.59% jit_opt_a.add_forward_monad_depend : 0.000062s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.04% jit_opt_a.cse : 0.000053s : 0.08% jit_opt_a.replace_applicator : 0.000023s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000724s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000030s : 0.05% loop_unroll : 0.000450s : 0.68% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000498s : 0.75% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000248 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 3: substitution.graph_param_transform 85.06% : 0.000211s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061389 2 97.41% : 0.059799s : 1: type_inference.infer 2.59% : 0.001590s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.94% : 0.000052s : 4: replace.inline 31.06% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.22% : 0.000209s : 4: match.inline 5.78% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.50% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.50% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.31% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 2.13% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.69% : 0.000007s : 22: predicate.inline 1.14% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.99% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.56% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.24% : 0.000010s : 53: predicate.switch_simplify 1.09% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.66% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.06% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000901 13 46.07% : 0.000415s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.99% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.93% : 0.000432s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072785 72 0.08% : 0.000059s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.46% : 0.000335s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.62% : 0.006275s : 1: jit_opt_a 0.21% : 0.000151s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.63% : 0.000459s : 1: loop_unroll 1.01% : 0.000734s : 1: mutable_eliminate 1.24% : 0.000899s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000508s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000113s : 1: py_interpret_to_execute 0.03% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.83% : 0.000603s : 1: renormalize.infer 0.61% : 0.000442s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.12% : 0.000088s : 1: rewriter_before_opt_a 0.10% : 0.000076s : 1: symbol_engine_optimizer 84.49% : 0.061499s : 1: type_inference TotalTime = 0.0733254, [30] [bootstrap]: 0.00035785 [type_inference]: 0.0252422 [event_method]: 2.148e-05 [auto_monad]: 7.491e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.00016559 [rewriter_before_opt_a]: 8.679e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0317248, [2] [Cycle 1]: 0.00287071, [27] [switch_simplify]: 7.028e-05 [loop_unroll]: 3.047e-05 [a_1]: 0.00070177 [with_stream_mark]: 2.615e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.65998e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.49002e-06 [updatestate_useless_node_eliminater]: 5.73002e-06 [accelerated_algorithm]: 6.28002e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 7.45e-06 [renormalize]: 0.0016393 [add_forward_monad_depend]: 6.78e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.769e-05 [cse]: 3.678e-05 [replace_applicator]: 1.899e-05 [Cycle 2]: 0.00035239, [27] [switch_simplify]: 6.56e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.00010098 [with_stream_mark]: 1.25e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 5.56002e-06 [updatestate_useless_node_eliminater]: 4.85999e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.71997e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 7.99002e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.531e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.693e-05 [rewriter_after_opt_a]: 4.235e-05 [convert_after_rewriter]: 7.85998e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00075666 [jit_opt_b]: 5.67e-05, [1] [Cycle 1]: 4.776e-05, [2] [frontend_op_eliminate]: 1.901e-05 [inline_after_opt_a]: 1.642e-05 [cconv]: 3.128e-05 [loop_unroll]: 0.013193 [jit_opt_after_cconv]: 0.00022136, [1] [Cycle 1]: 0.00020928, [11] [c_1]: 3.325e-05 [parameter_eliminate]: 6.24001e-06 [updatestate_depend_eliminate]: 1.267e-05 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 2.93e-06 [cse]: 4.899e-05 [call_graph_tuple_transform]: 2.729e-05 [tuple_list_get_item_eliminator]: 8.40001e-06 [none_parameter_eliminate]: 2.22999e-06 [renormalize]: 1.8999e-07 [switch_simplify]: 6.81999e-06 [remove_dup_value]: 1.994e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 9.44e-06 [add_recomputation]: 6.004e-05 [cse_after_recomputation]: 2.739e-05, [1] [Cycle 1]: 2.035e-05, [1] [cse]: 1.263e-05 [auto_monad_reorder]: 2.321e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 1.063e-05 [opt_after_jit_grad]: 0.00070562 [symbol_engine_optimizer]: 8.779e-05, [1] [Cycle 1]: 7.713e-05, [6] [build]: 5.62001e-06 [elim_shapecalc]: 8.89998e-06 [elim_not_effective]: 1.61e-05 [opt_reshape]: 8.55999e-06 [fold_const_symbol]: 8.81002e-06 [renormalize]: 5.29981e-07 [validate]: 0.00013105 Sums bootstrap : 0.000358s : 0.81% type_inference : 0.025242s : 57.21% event_method : 0.000021s : 0.05% auto_monad : 0.000075s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000166s : 0.38% rewriter_before_opt_a : 0.000087s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.17% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000803s : 1.82% jit_opt_a.with_stream_mark : 0.000039s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.03% jit_opt_a.renormalize : 0.001639s : 3.72% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000052s : 0.12% jit_opt_a.replace_applicator : 0.000025s : 0.06% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000042s : 0.10% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000757s : 1.72% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000031s : 0.07% loop_unroll : 0.013193s : 29.90% jit_opt_after_cconv.c_1 : 0.000033s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000049s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000060s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000023s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.02% opt_after_jit_grad : 0.000706s : 1.60% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000131s : 0.30% Time group info: ------[substitution.] 0.000330 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000007s : 3: substitution.graph_param_transform 87.57% : 0.000289s : 4: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.51% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 4.59% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025156 2 90.84% : 0.022851s : 1: type_inference.infer 9.16% : 0.002304s : 1: type_inference.specialize ------[replace.] 0.000090 6 67.66% : 0.000061s : 4: replace.inline 32.34% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000300 6 95.41% : 0.000286s : 4: match.inline 4.59% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.63% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.72% : 0.000002s : 10: predicate.addn_check_dump 0.97% : 0.000001s : 10: predicate.addn_zero_filter 2.01% : 0.000003s : 10: predicate.arithmetic_simplify 0.97% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 1.52% : 0.000002s : 10: predicate.depend_value_elim 0.87% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.95% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.41% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 3: predicate.elim_not_effective 0.79% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.86% : 0.000001s : 10: predicate.environ_get_depend_swap 1.61% : 0.000002s : 10: predicate.environ_get_eliminate 0.83% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.78% : 0.000001s : 6: predicate.get_grad_eliminate 0.18% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000009s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.75% : 0.000002s : 6: predicate.less_batch_normalization 2.04% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 3.86% : 0.000006s : 3: predicate.loop_unroll_after_grad 3.48% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.66% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.86% : 0.000001s : 10: predicate.merge_addn 0.93% : 0.000001s : 10: predicate.minmaximum_grad 2.53% : 0.000004s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 15: predicate.partial_eliminate 0.94% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.47% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 0.99% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.40% : 0.000002s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.77% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.02% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001151 13 39.73% : 0.000457s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.28% : 0.000636s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076024 72 0.08% : 0.000063s : 1: add_recomputation 0.10% : 0.000078s : 1: auto_monad 0.03% : 0.000026s : 1: auto_monad_reorder 0.50% : 0.000377s : 1: bootstrap 0.04% : 0.000034s : 1: cconv 0.02% : 0.000012s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 41.74% : 0.031729s : 1: jit_opt_a 0.30% : 0.000226s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 17.38% : 0.013213s : 1: loop_unroll 1.01% : 0.000768s : 1: mutable_eliminate 1.38% : 0.001050s : 26: opt.transform.jit_opt_a 0.09% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000036s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000719s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000169s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 1.32% : 0.001001s : 1: renormalize.infer 0.83% : 0.000628s : 1: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.12% : 0.000091s : 1: rewriter_before_opt_a 0.12% : 0.000091s : 1: symbol_engine_optimizer 33.23% : 0.025261s : 1: type_inference TotalTime = 0.0212575, [30] [bootstrap]: 0.00032911 [type_inference]: 0.00972806 [event_method]: 2.339e-05 [auto_monad]: 7.297e-05 [graph_reusing]: 6.60002e-06 [pre_auto_parallel]: 2.60997e-06 [py_interpret_to_execute]: 5.992e-05 [rewriter_before_opt_a]: 9.176e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.00815406, [2] [Cycle 1]: 0.00238161, [27] [switch_simplify]: 6.498e-05 [loop_unroll]: 3.548e-05 [a_1]: 0.00070883 [with_stream_mark]: 2.272e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00117091 [add_forward_monad_depend]: 8.69998e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.829e-05 [cse]: 4.342e-05 [replace_applicator]: 1.633e-05 [Cycle 2]: 0.00034826, [27] [switch_simplify]: 6.51999e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.331e-05 [with_stream_mark]: 1.502e-05 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 4.80999e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.73001e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.43002e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.793e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.645e-05 [rewriter_after_opt_a]: 4.41e-05 [convert_after_rewriter]: 8.03001e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.0007767 [jit_opt_b]: 5.638e-05, [1] [Cycle 1]: 4.766e-05, [2] [frontend_op_eliminate]: 1.789e-05 [inline_after_opt_a]: 1.757e-05 [cconv]: 0.00010763 [loop_unroll]: 0.0005251 [jit_opt_after_cconv]: 0.00017801, [1] [Cycle 1]: 0.0001705, [11] [c_1]: 2.337e-05 [parameter_eliminate]: 5.10999e-06 [updatestate_depend_eliminate]: 7.51001e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 4.23001e-06 [cse]: 3.803e-05 [call_graph_tuple_transform]: 2.275e-05 [tuple_list_get_item_eliminator]: 7.7e-06 [none_parameter_eliminate]: 2.54001e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 4.951e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 8.15e-06 [add_recomputation]: 5.541e-05 [cse_after_recomputation]: 2.545e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.913e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 6.93e-06 [opt_after_jit_grad]: 0.00055585 [symbol_engine_optimizer]: 7.705e-05, [1] [Cycle 1]: 6.931e-05, [6] [build]: 4.08999e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.415e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 8.89995e-07 [validate]: 7.132e-05 Sums bootstrap : 0.000329s : 2.16% type_inference : 0.009728s : 63.97% event_method : 0.000023s : 0.15% auto_monad : 0.000073s : 0.48% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000060s : 0.39% rewriter_before_opt_a : 0.000092s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.47% jit_opt_a.loop_unroll : 0.000041s : 0.27% jit_opt_a.a_1 : 0.000802s : 5.27% jit_opt_a.with_stream_mark : 0.000038s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000009s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.001171s : 7.70% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000061s : 0.40% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.11% rewriter_after_opt_a : 0.000044s : 0.29% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000777s : 5.11% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000108s : 0.71% loop_unroll : 0.000525s : 3.45% jit_opt_after_cconv.c_1 : 0.000023s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.cse : 0.000038s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000050s : 0.33% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000055s : 0.36% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000556s : 3.66% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000071s : 0.47% Time group info: ------[substitution.] 0.000298 24 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000007s : 3: substitution.graph_param_transform 86.79% : 0.000258s : 5: substitution.inline 1.82% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.59% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 4.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009650 2 86.02% : 0.008301s : 1: type_inference.infer 13.98% : 0.001349s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.18% : 0.000074s : 5: replace.inline 31.82% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000268 7 95.47% : 0.000256s : 5: match.inline 4.53% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 1.23% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 11: predicate.addn_check_dump 1.66% : 0.000002s : 11: predicate.addn_zero_filter 2.15% : 0.000003s : 11: predicate.arithmetic_simplify 1.19% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.40% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.26% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000008s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.69% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 1.67% : 0.000002s : 11: predicate.reduce_eliminate 1.36% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.15% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 11: predicate.same_eliminate 0.68% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.45% : 0.000002s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 59: predicate.switch_simplify 1.23% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.46% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001008 16 48.28% : 0.000487s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.10% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.62% : 0.000440s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023516 72 0.25% : 0.000058s : 1: add_recomputation 0.33% : 0.000076s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.46% : 0.000344s : 1: bootstrap 0.47% : 0.000111s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000011s : 1: environ_conv 0.12% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 34.69% : 0.008158s : 1: jit_opt_a 0.77% : 0.000182s : 1: jit_opt_after_cconv 0.25% : 0.000060s : 1: jit_opt_b 2.28% : 0.000536s : 1: loop_unroll 3.36% : 0.000790s : 1: mutable_eliminate 4.44% : 0.001043s : 26: opt.transform.jit_opt_a 0.24% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000019s : 1: opt.transform.mutable_eliminate 0.11% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.41% : 0.000567s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000063s : 1: py_interpret_to_execute 0.08% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000052s : 1: remove_dup_value 2.88% : 0.000678s : 1: renormalize.infer 2.05% : 0.000483s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000048s : 1: rewriter_after_opt_a 0.40% : 0.000095s : 1: rewriter_before_opt_a 0.34% : 0.000080s : 1: symbol_engine_optimizer 41.45% : 0.009748s : 1: type_inference TotalTime = 0.221396, [30] [bootstrap]: 0.00035741 [type_inference]: 0.205163 [event_method]: 2.496e-05 [auto_monad]: 8.147e-05 [graph_reusing]: 6.92002e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 0.0034905 [rewriter_before_opt_a]: 0.00011266 [expand_dump_flag]: 4.72e-06 [jit_opt_a]: 0.00899092, [2] [Cycle 1]: 0.00469214, [27] [switch_simplify]: 6.361e-05 [loop_unroll]: 3.114e-05 [a_1]: 0.0006578 [with_stream_mark]: 2.25e-05 [recompute_prepare]: 1.006e-05 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.65002e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.851e-05 [j_node_and_user_rematch]: 1.089e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 8.84e-06 [renormalize]: 0.0034459 [add_forward_monad_depend]: 1.136e-05 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 2.644e-05 [cse]: 3.515e-05 [replace_applicator]: 2.438e-05 [Cycle 2]: 0.00049439, [27] [switch_simplify]: 8.1e-06 [loop_unroll]: 6.00002e-06 [a_1]: 0.00013172 [with_stream_mark]: 1.825e-05 [recompute_prepare]: 6.79999e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 7.03998e-06 [merge_forward]: 5.59998e-06 [cell_reuse_recompute_pass]: 4.38001e-06 [cell_reuse_handle_not_recompute_node_pass]: 6.735e-05 [j_node_and_user_rematch]: 1.143e-05 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 6.38e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.71999e-06 [auto_monad_grad]: 1.48002e-06 [auto_monad_eliminator]: 1.215e-05 [cse]: 1.757e-05 [replace_applicator]: 7.8e-06 [py_interpret_to_execute_after_opt_a]: 1.551e-05 [rewriter_after_opt_a]: 4.33e-05 [convert_after_rewriter]: 8.36002e-06 [order_py_execute_after_rewriter]: 6.26998e-06 [mutable_eliminate]: 0.00088996 [jit_opt_b]: 8.971e-05, [1] [Cycle 1]: 7.718e-05, [2] [frontend_op_eliminate]: 4.373e-05 [inline_after_opt_a]: 1.998e-05 [cconv]: 3.772e-05 [loop_unroll]: 0.00057705 [jit_opt_after_cconv]: 0.00020312, [1] [Cycle 1]: 0.00019381, [11] [c_1]: 2.953e-05 [parameter_eliminate]: 5.54e-06 [updatestate_depend_eliminate]: 1.151e-05 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 4e-05 [call_graph_tuple_transform]: 2.854e-05 [tuple_list_get_item_eliminator]: 6.74001e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 1.07e-06 [switch_simplify]: 7.02002e-06 [remove_dup_value]: 1.657e-05 [partial_unused_args_eliminate]: 4.87e-06 [environ_conv]: 1.116e-05 [add_recomputation]: 5.989e-05 [cse_after_recomputation]: 2.91e-05, [1] [Cycle 1]: 2.26e-05, [1] [cse]: 1.581e-05 [auto_monad_reorder]: 1.672e-05 [get_jit_bprop_graph]: 2.72001e-06 [rewriter_after_jit_bprop_graph]: 8.17e-06 [opt_after_jit_grad]: 0.00069269 [symbol_engine_optimizer]: 0.00010707, [1] [Cycle 1]: 9.359e-05, [6] [build]: 7.15e-06 [elim_shapecalc]: 1.205e-05 [elim_not_effective]: 1.896e-05 [opt_reshape]: 1.22e-05 [fold_const_symbol]: 1.021e-05 [renormalize]: 8.00006e-07 [validate]: 6.347e-05 Sums bootstrap : 0.000357s : 0.16% type_inference : 0.205163s : 94.65% event_method : 0.000025s : 0.01% auto_monad : 0.000081s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.003491s : 1.61% rewriter_before_opt_a : 0.000113s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000790s : 0.36% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000086s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.003446s : 1.59% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.02% jit_opt_a.cse : 0.000053s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000890s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000044s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000038s : 0.02% loop_unroll : 0.000577s : 0.27% jit_opt_after_cconv.c_1 : 0.000030s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000693s : 0.32% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.03% Time group info: ------[substitution.] 0.000274 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000007s : 4: substitution.graph_param_transform 83.43% : 0.000229s : 4: substitution.inline 1.96% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000007s : 4: substitution.remove_not_recompute_node 2.29% : 0.000006s : 2: substitution.replace_old_param 5.73% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.205053 2 98.17% : 0.201297s : 1: type_inference.infer 1.83% : 0.003756s : 1: type_inference.specialize ------[replace.] 0.000091 6 65.86% : 0.000060s : 4: replace.inline 34.14% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 6 94.09% : 0.000226s : 4: match.inline 5.91% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 830 1.07% : 0.000002s : 12: predicate.accumulaten_eliminater 2.00% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 12: predicate.addn_check_dump 1.03% : 0.000002s : 12: predicate.addn_zero_filter 2.24% : 0.000003s : 12: predicate.arithmetic_simplify 1.03% : 0.000002s : 12: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000001s : 12: predicate.compare_switch_simplify 0.96% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.03% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.79% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 1.09% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_depend_swap 0.99% : 0.000001s : 12: predicate.environ_get_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.85% : 0.000009s : 26: predicate.inline 1.20% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.30% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.50% : 0.000002s : 18: predicate.load_eliminater 2.62% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.36% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 12: predicate.merge_addn 0.94% : 0.000001s : 12: predicate.minmaximum_grad 3.30% : 0.000005s : 4: predicate.mutable_eliminate 0.88% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 18: predicate.partial_eliminate 1.00% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000003s : 12: predicate.reduce_eliminate 1.19% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.04% : 0.000002s : 4: predicate.row_tensor_eliminate 1.52% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.81% : 0.000010s : 58: predicate.switch_simplify 1.17% : 0.000002s : 12: predicate.tile_eliminate 1.08% : 0.000002s : 12: predicate.transpose_eliminate 1.13% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.44% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002726 22 65.63% : 0.001789s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.90% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.47% : 0.000885s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.226061 72 0.03% : 0.000065s : 1: add_recomputation 0.04% : 0.000086s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.17% : 0.000383s : 1: bootstrap 0.02% : 0.000042s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.98% : 0.008995s : 1: jit_opt_a 0.09% : 0.000207s : 1: jit_opt_after_cconv 0.04% : 0.000093s : 1: jit_opt_b 0.26% : 0.000594s : 1: loop_unroll 0.40% : 0.000912s : 1: mutable_eliminate 0.49% : 0.001110s : 26: opt.transform.jit_opt_a 0.03% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000056s : 4: opt.transform.jit_opt_b 0.01% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000028s : 1: opt.transform.mutable_eliminate 0.02% : 0.000040s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000710s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 1.55% : 0.003512s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.08% : 0.002436s : 1: renormalize.infer 0.44% : 0.000996s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.05% : 0.000118s : 1: rewriter_before_opt_a 0.05% : 0.000111s : 1: symbol_engine_optimizer 90.77% : 0.205185s : 1: type_inference TotalTime = 0.0704911, [30] [bootstrap]: 0.00031682 [type_inference]: 0.0229506 [event_method]: 2.077e-05 [auto_monad]: 6.919e-05 [graph_reusing]: 5.47001e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 9.602e-05 [rewriter_before_opt_a]: 8.182e-05 [expand_dump_flag]: 2.69999e-06 [jit_opt_a]: 0.0423353, [2] [Cycle 1]: 0.0022417, [27] [switch_simplify]: 6.756e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00061318 [with_stream_mark]: 2.78e-05 [recompute_prepare]: 9.36e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.66999e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.074e-05 [inline_without_move]: 5.49e-06 [renormalize]: 0.00110479 [add_forward_monad_depend]: 8.05e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.849e-05 [cse]: 3.762e-05 [replace_applicator]: 1.947e-05 [Cycle 2]: 0.0004025, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 5.27001e-06 [a_1]: 9.149e-05 [with_stream_mark]: 1.545e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.85999e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 2.90002e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.77999e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 7.70998e-06 [cse]: 1.427e-05 [replace_applicator]: 4.996e-05 [py_interpret_to_execute_after_opt_a]: 0.00185974 [rewriter_after_opt_a]: 7.25e-05 [convert_after_rewriter]: 7.59002e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00078873 [jit_opt_b]: 5.765e-05, [1] [Cycle 1]: 4.797e-05, [2] [frontend_op_eliminate]: 1.769e-05 [inline_after_opt_a]: 1.829e-05 [cconv]: 2.909e-05 [loop_unroll]: 0.00049382 [jit_opt_after_cconv]: 0.00017679, [1] [Cycle 1]: 0.00016991, [11] [c_1]: 2.315e-05 [parameter_eliminate]: 4.05998e-06 [updatestate_depend_eliminate]: 7.53999e-06 [updatestate_assign_eliminate]: 4.46002e-06 [updatestate_loads_eliminate]: 3.19001e-06 [cse]: 4.079e-05 [call_graph_tuple_transform]: 2.183e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 2.16e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.78002e-06 [remove_dup_value]: 1.822e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 7.74002e-06 [add_recomputation]: 5.561e-05 [cse_after_recomputation]: 2.723e-05, [1] [Cycle 1]: 2.041e-05, [1] [cse]: 1.345e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 6.39001e-06 [opt_after_jit_grad]: 0.00060252 [symbol_engine_optimizer]: 8.433e-05, [1] [Cycle 1]: 7.542e-05, [6] [build]: 5.42001e-06 [elim_shapecalc]: 8.85001e-06 [elim_not_effective]: 1.583e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 9.55001e-06 [renormalize]: 7.7e-07 [validate]: 5.087e-05 Sums bootstrap : 0.000317s : 1.05% type_inference : 0.022951s : 76.26% event_method : 0.000021s : 0.07% auto_monad : 0.000069s : 0.23% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000096s : 0.32% rewriter_before_opt_a : 0.000082s : 0.27% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000705s : 2.34% jit_opt_a.with_stream_mark : 0.000043s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001105s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000052s : 0.17% jit_opt_a.replace_applicator : 0.000069s : 0.23% py_interpret_to_execute_after_opt_a : 0.001860s : 6.18% rewriter_after_opt_a : 0.000072s : 0.24% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000789s : 2.62% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.000494s : 1.64% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000041s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000056s : 0.18% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000603s : 2.00% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.17% Time group info: ------[substitution.] 0.000270 23 0.98% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 3: substitution.graph_param_transform 84.99% : 0.000230s : 4: substitution.inline 1.41% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000006s : 2: substitution.replace_old_param 5.25% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022880 2 93.29% : 0.021344s : 1: type_inference.infer 6.71% : 0.001536s : 1: type_inference.specialize ------[replace.] 0.000079 6 66.82% : 0.000053s : 4: replace.inline 33.18% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 94.78% : 0.000227s : 4: match.inline 5.22% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.54% : 0.000002s : 10: predicate.accumulaten_eliminater 1.38% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.60% : 0.000002s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.02% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.28% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.80% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.47% : 0.000001s : 3: predicate.graph_param_transform 6.28% : 0.000008s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.63% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.27% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 1.10% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.10% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.42% : 0.000004s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.10% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.10% : 0.000001s : 10: predicate.transpose_eliminate 1.18% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.62% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.27% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.97% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000873 13 44.36% : 0.000387s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.60% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.04% : 0.000428s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072651 72 0.08% : 0.000058s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.07% : 0.000048s : 1: auto_monad_reorder 0.47% : 0.000341s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 58.28% : 0.042339s : 1: jit_opt_a 0.25% : 0.000180s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.69% : 0.000503s : 1: loop_unroll 1.10% : 0.000798s : 1: mutable_eliminate 1.37% : 0.000995s : 26: opt.transform.jit_opt_a 0.07% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.85% : 0.000615s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000100s : 1: py_interpret_to_execute 2.59% : 0.001878s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.88% : 0.000641s : 1: renormalize.infer 0.62% : 0.000453s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000078s : 1: rewriter_after_opt_a 0.12% : 0.000086s : 1: rewriter_before_opt_a 0.12% : 0.000087s : 1: symbol_engine_optimizer 31.61% : 0.022968s : 1: type_inference TotalTime = 0.0365516, [30] [bootstrap]: 0.00039674 [type_inference]: 0.00733439 [event_method]: 2.366e-05 [auto_monad]: 7.65e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 5.339e-05 [rewriter_before_opt_a]: 9.338e-05 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.0260425, [2] [Cycle 1]: 0.00268878, [27] [switch_simplify]: 8.18e-05 [loop_unroll]: 3.805e-05 [a_1]: 0.0009282 [with_stream_mark]: 3.238e-05 [recompute_prepare]: 1.405e-05 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 2.84001e-06 [specialize_transform]: 7.51999e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 7.3e-06 [meta_shard_fg_expand]: 4.07003e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 4.94e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.147e-05 [j_node_and_user_rematch]: 1.158e-05 [meta_fg_expand]: 3.06999e-06 [replace_old_param]: 1.196e-05 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00117414 [add_forward_monad_depend]: 8.90001e-06 [auto_monad_grad]: 2.63003e-06 [auto_monad_eliminator]: 1.734e-05 [cse]: 3.106e-05 [replace_applicator]: 2.067e-05 [Cycle 2]: 0.00039842, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.17999e-06 [a_1]: 0.00010158 [with_stream_mark]: 1.194e-05 [recompute_prepare]: 4.80999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 4.64998e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 1.51002e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.802e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.56002e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.28998e-06 [cse]: 1.133e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.382e-05 [rewriter_after_opt_a]: 3.771e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 4.89003e-06 [mutable_eliminate]: 0.00079793 [jit_opt_b]: 6.056e-05, [1] [Cycle 1]: 5.222e-05, [2] [frontend_op_eliminate]: 2.306e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 3.036e-05 [loop_unroll]: 0.00045324 [jit_opt_after_cconv]: 0.00014768, [1] [Cycle 1]: 0.0001407, [11] [c_1]: 2.093e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 6.34001e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.054e-05 [call_graph_tuple_transform]: 2.114e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.528e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 5.39998e-06 [add_recomputation]: 5.428e-05 [cse_after_recomputation]: 2.048e-05, [1] [Cycle 1]: 1.495e-05, [1] [cse]: 9.26998e-06 [auto_monad_reorder]: 1.581e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.00051116 [symbol_engine_optimizer]: 7.794e-05, [1] [Cycle 1]: 7.04e-05, [6] [build]: 5.82001e-06 [elim_shapecalc]: 8.29002e-06 [elim_not_effective]: 1.353e-05 [opt_reshape]: 5.41998e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 6.59988e-07 [validate]: 5.253e-05 Sums bootstrap : 0.000397s : 3.08% type_inference : 0.007334s : 56.98% event_method : 0.000024s : 0.18% auto_monad : 0.000077s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.41% rewriter_before_opt_a : 0.000093s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000088s : 0.68% jit_opt_a.loop_unroll : 0.000043s : 0.34% jit_opt_a.a_1 : 0.001030s : 8.00% jit_opt_a.with_stream_mark : 0.000044s : 0.34% jit_opt_a.recompute_prepare : 0.000019s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000013s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000009s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.16% jit_opt_a.meta_fg_expand : 0.000006s : 0.05% jit_opt_a.replace_old_param : 0.000021s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001174s : 9.12% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.18% jit_opt_a.cse : 0.000042s : 0.33% jit_opt_a.replace_applicator : 0.000026s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000038s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000798s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.18% jit_opt_b.inline_after_opt_a : 0.000017s : 0.13% cconv : 0.000030s : 0.24% loop_unroll : 0.000453s : 3.52% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000015s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000054s : 0.42% cse_after_recomputation.cse : 0.000009s : 0.07% auto_monad_reorder : 0.000016s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000511s : 3.97% symbol_engine_optimizer.build : 0.000006s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000053s : 0.41% Time group info: ------[substitution.] 0.000386 25 0.66% : 0.000003s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.70% : 0.000007s : 3: substitution.graph_param_transform 87.41% : 0.000338s : 5: substitution.inline 1.29% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000007s : 4: substitution.remove_not_recompute_node 2.03% : 0.000008s : 2: substitution.replace_old_param 4.74% : 0.000018s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007252 2 81.90% : 0.005939s : 1: type_inference.infer 18.10% : 0.001312s : 1: type_inference.specialize ------[replace.] 0.000155 8 61.86% : 0.000096s : 5: replace.inline 38.14% : 0.000059s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000349 8 95.32% : 0.000333s : 5: match.inline 4.68% : 0.000016s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000165 810 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.65% : 0.000003s : 12: predicate.addn_zero_filter 2.50% : 0.000004s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.33% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000002s : 12: predicate.compare_switch_simplify 1.40% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.50% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.23% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_depend_swap 1.55% : 0.000003s : 12: predicate.environ_get_eliminate 0.92% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000002s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000009s : 26: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.55% : 0.000003s : 6: predicate.less_batch_normalization 1.62% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 18: predicate.load_eliminater 1.07% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.64% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.36% : 0.000004s : 15: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000002s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 1.98% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 2.92% : 0.000005s : 12: predicate.reduce_eliminate 1.79% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.47% : 0.000002s : 21: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.20% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.54% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.00% : 0.000002s : 12: predicate.same_eliminate 0.40% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.70% : 0.000001s : 6: predicate.specialize_transform 1.15% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.94% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.86% : 0.000005s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.97% : 0.000011s : 64: predicate.switch_simplify 1.07% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.19% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 1.92% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 2.18% : 0.000004s : 15: predicate.tuple_to_list_eliminator_ 1.88% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.76% : 0.000005s : 24: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001088 16 46.41% : 0.000505s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.36% : 0.000113s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.23% : 0.000471s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039067 72 0.15% : 0.000058s : 1: add_recomputation 0.21% : 0.000080s : 1: auto_monad 0.05% : 0.000018s : 1: auto_monad_reorder 1.06% : 0.000413s : 1: bootstrap 0.08% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 66.67% : 0.026046s : 1: jit_opt_a 0.39% : 0.000151s : 1: jit_opt_after_cconv 0.16% : 0.000063s : 1: jit_opt_b 1.18% : 0.000462s : 1: loop_unroll 2.07% : 0.000808s : 1: mutable_eliminate 3.35% : 0.001309s : 26: opt.transform.jit_opt_a 0.13% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000033s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000522s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000056s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.73% : 0.000675s : 1: renormalize.infer 1.25% : 0.000487s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000041s : 1: rewriter_after_opt_a 0.25% : 0.000097s : 1: rewriter_before_opt_a 0.21% : 0.000082s : 1: symbol_engine_optimizer 18.82% : 0.007352s : 1: type_inference TotalTime = 0.0416871, [30] [bootstrap]: 0.00040218 [type_inference]: 0.0235369 [event_method]: 2.007e-05 [auto_monad]: 6.885e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00014254 [rewriter_before_opt_a]: 8.256e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0147674, [2] [Cycle 1]: 0.0104516, [27] [switch_simplify]: 5.745e-05 [loop_unroll]: 3.226e-05 [a_1]: 0.00056747 [with_stream_mark]: 2.013e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 4.37998e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.85998e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 4.24002e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 9.52999e-06 [meta_fg_expand]: 2.55997e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 5.92999e-06 [renormalize]: 0.0093556 [add_forward_monad_depend]: 1.16e-05 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 2.244e-05 [cse]: 4.08e-05 [replace_applicator]: 2.589e-05 [Cycle 2]: 0.00039982, [27] [switch_simplify]: 8.11002e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00011861 [with_stream_mark]: 1.569e-05 [recompute_prepare]: 6.47001e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.36998e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 3.06999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.994e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 3.44001e-06 [replace_old_param]: 1.067e-05 [inline_without_move]: 5.55001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.30003e-06 [cse]: 1.607e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.726e-05 [rewriter_after_opt_a]: 4.477e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00085605 [jit_opt_b]: 5.696e-05, [1] [Cycle 1]: 4.883e-05, [2] [frontend_op_eliminate]: 1.988e-05 [inline_after_opt_a]: 1.707e-05 [cconv]: 3.095e-05 [loop_unroll]: 0.00047171 [jit_opt_after_cconv]: 0.00016011, [1] [Cycle 1]: 0.00015223, [11] [c_1]: 2.306e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.901e-05 [call_graph_tuple_transform]: 2.061e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 7.21999e-06 [add_recomputation]: 5.739e-05 [cse_after_recomputation]: 2.397e-05, [1] [Cycle 1]: 1.838e-05, [1] [cse]: 1.17e-05 [auto_monad_reorder]: 1.774e-05 [get_jit_bprop_graph]: 3.38e-06 [rewriter_after_jit_bprop_graph]: 6.44999e-06 [opt_after_jit_grad]: 0.00053965 [symbol_engine_optimizer]: 8.124e-05, [1] [Cycle 1]: 7.377e-05, [6] [build]: 5.09e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.479e-05 [opt_reshape]: 6.71e-06 [fold_const_symbol]: 9.17999e-06 [renormalize]: 6.60017e-07 [validate]: 4.546e-05 Sums bootstrap : 0.000402s : 1.08% type_inference : 0.023537s : 63.43% event_method : 0.000020s : 0.05% auto_monad : 0.000069s : 0.19% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000143s : 0.38% rewriter_before_opt_a : 0.000083s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.18% jit_opt_a.loop_unroll : 0.000038s : 0.10% jit_opt_a.a_1 : 0.000686s : 1.85% jit_opt_a.with_stream_mark : 0.000036s : 0.10% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.009356s : 25.21% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.08% jit_opt_a.cse : 0.000057s : 0.15% jit_opt_a.replace_applicator : 0.000031s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000045s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000856s : 2.31% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000031s : 0.08% loop_unroll : 0.000472s : 1.27% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000057s : 0.15% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000540s : 1.45% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.12% Time group info: ------[substitution.] 0.000218 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000002s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 81.31% : 0.000177s : 4: substitution.inline 1.98% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000006s : 4: substitution.remove_not_recompute_node 3.13% : 0.000007s : 2: substitution.replace_old_param 6.31% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023461 2 90.99% : 0.021348s : 1: type_inference.infer 9.01% : 0.002113s : 1: type_inference.specialize ------[replace.] 0.000079 6 66.58% : 0.000053s : 4: replace.inline 33.42% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 93.26% : 0.000174s : 4: match.inline 6.74% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.54% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 2.27% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000002s : 10: predicate.compare_switch_simplify 1.45% : 0.000002s : 10: predicate.depend_value_elim 0.91% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000007s : 22: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 2.30% : 0.000003s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 2.13% : 0.000003s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.02% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.07% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.54% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.86% : 0.000003s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001317 13 34.73% : 0.000458s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 62.79% : 0.000827s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052027 72 0.12% : 0.000060s : 1: add_recomputation 0.14% : 0.000072s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.82% : 0.000426s : 1: bootstrap 0.06% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 28.39% : 0.014773s : 1: jit_opt_a 0.31% : 0.000163s : 1: jit_opt_after_cconv 0.11% : 0.000060s : 1: jit_opt_b 0.92% : 0.000481s : 1: loop_unroll 1.67% : 0.000867s : 1: mutable_eliminate 1.80% : 0.000937s : 26: opt.transform.jit_opt_a 0.10% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.06% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000147s : 1: py_interpret_to_execute 0.04% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 16.23% : 0.008442s : 1: renormalize.infer 1.73% : 0.000898s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000048s : 1: rewriter_after_opt_a 0.17% : 0.000086s : 1: rewriter_before_opt_a 0.16% : 0.000084s : 1: symbol_engine_optimizer 45.27% : 0.023554s : 1: type_inference TotalTime = 0.0260005, [30] [bootstrap]: 0.00037338 [type_inference]: 0.0164023 [event_method]: 2.532e-05 [auto_monad]: 8.214e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 9.895e-05 [rewriter_before_opt_a]: 0.00010018 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00636162, [2] [Cycle 1]: 0.00215634, [27] [switch_simplify]: 6.579e-05 [loop_unroll]: 3.63e-05 [a_1]: 0.00072702 [with_stream_mark]: 1.952e-05 [recompute_prepare]: 1.005e-05 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 3.27997e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 0.00094886 [add_forward_monad_depend]: 6.66e-06 [auto_monad_grad]: 2.38002e-06 [auto_monad_eliminator]: 1.633e-05 [cse]: 3.598e-05 [replace_applicator]: 1.509e-05 [Cycle 2]: 0.00033735, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 5.05001e-06 [a_1]: 9.669e-05 [with_stream_mark]: 9.81e-06 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.411e-05 [j_node_and_user_rematch]: 8.45001e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 5.14998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 6.54999e-06 [cse]: 1.418e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 1.411e-05 [rewriter_after_opt_a]: 3.826e-05 [convert_after_rewriter]: 7.40998e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00065682 [jit_opt_b]: 5.496e-05, [1] [Cycle 1]: 4.633e-05, [2] [frontend_op_eliminate]: 1.895e-05 [inline_after_opt_a]: 1.672e-05 [cconv]: 2.723e-05 [loop_unroll]: 0.00047607 [jit_opt_after_cconv]: 0.00016744, [1] [Cycle 1]: 0.00015966, [11] [c_1]: 2.275e-05 [parameter_eliminate]: 3.44001e-06 [updatestate_depend_eliminate]: 6.74999e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.53003e-06 [cse]: 3.128e-05 [call_graph_tuple_transform]: 2.202e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.91003e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.76998e-06 [remove_dup_value]: 1.952e-05 [partial_unused_args_eliminate]: 3.08998e-06 [environ_conv]: 8.90999e-06 [add_recomputation]: 5.569e-05 [cse_after_recomputation]: 2.88e-05, [1] [Cycle 1]: 2.246e-05, [1] [cse]: 1.539e-05 [auto_monad_reorder]: 2.009e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 7.32997e-06 [opt_after_jit_grad]: 0.00060489 [symbol_engine_optimizer]: 9.048e-05, [1] [Cycle 1]: 8.313e-05, [6] [build]: 1.167e-05 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.689e-05 [opt_reshape]: 6.38998e-06 [fold_const_symbol]: 9.08002e-06 [renormalize]: 7.89994e-07 [validate]: 5.64e-05 Sums bootstrap : 0.000373s : 1.74% type_inference : 0.016402s : 76.28% event_method : 0.000025s : 0.12% auto_monad : 0.000082s : 0.38% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000099s : 0.46% rewriter_before_opt_a : 0.000100s : 0.47% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.34% jit_opt_a.loop_unroll : 0.000041s : 0.19% jit_opt_a.a_1 : 0.000824s : 3.83% jit_opt_a.with_stream_mark : 0.000029s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.000949s : 4.41% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.11% jit_opt_a.cse : 0.000050s : 0.23% jit_opt_a.replace_applicator : 0.000020s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.07% rewriter_after_opt_a : 0.000038s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000657s : 3.05% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.09% jit_opt_b.inline_after_opt_a : 0.000017s : 0.08% cconv : 0.000027s : 0.13% loop_unroll : 0.000476s : 2.21% jit_opt_after_cconv.c_1 : 0.000023s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000020s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.04% add_recomputation : 0.000056s : 0.26% cse_after_recomputation.cse : 0.000015s : 0.07% auto_monad_reorder : 0.000020s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000605s : 2.81% symbol_engine_optimizer.build : 0.000012s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.26% TotalTime = 0.130199, [30] [bootstrap]: 0.00030233 [type_inference]: 0.117743 [event_method]: 2.002e-05 [auto_monad]: 5.244e-05 [graph_reusing]: 3.83999e-06 [pre_auto_parallel]: 1.77001e-06 [py_interpret_to_execute]: 0.00045305 [rewriter_before_opt_a]: 9.593e-05 [expand_dump_flag]: 2.84999e-06 [jit_opt_a]: 0.00807358, [2] [Cycle 1]: 0.00413723, [27] [switch_simplify]: 6.977e-05 [loop_unroll]: 3.388e-05 [a_1]: 0.00074592 [with_stream_mark]: 2.386e-05 [recompute_prepare]: 9.40001e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.73999e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 7.87e-06 [updatestate_useless_node_eliminater]: 6.93998e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 7.09001e-06 [merge_forward]: 4.60999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.813e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 6.28002e-06 [renormalize]: 0.00284603 [add_forward_monad_depend]: 9.34998e-06 [auto_monad_grad]: 3.36001e-06 [auto_monad_eliminator]: 2.109e-05 [cse]: 4.207e-05 [replace_applicator]: 1.962e-05 [Cycle 2]: 0.00040453, [27] [switch_simplify]: 7.61999e-06 [loop_unroll]: 6.53e-06 [a_1]: 0.00013282 [with_stream_mark]: 1.228e-05 [recompute_prepare]: 6.33e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 2.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.30002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 1.45999e-06 [auto_monad_eliminator]: 7.57998e-06 [cse]: 1.788e-05 [replace_applicator]: 6.61e-06 [py_interpret_to_execute_after_opt_a]: 1.603e-05 [rewriter_after_opt_a]: 4.645e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.99999e-06 [mutable_eliminate]: 0.00078661 [jit_opt_b]: 6.066e-05, [1] [Cycle 1]: 5.221e-05, [2] [frontend_op_eliminate]: 2.042e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 3.026e-05 [loop_unroll]: 0.0005235 [jit_opt_after_cconv]: 0.00017989, [1] [Cycle 1]: 0.00017269, [11] [c_1]: 2.782e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 8.92e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.96001e-06 [cse]: 3.348e-05 [call_graph_tuple_transform]: 2.365e-05 [tuple_list_get_item_eliminator]: 7.46001e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.98e-06 [remove_dup_value]: 1.881e-05 [partial_unused_args_eliminate]: 2.96999e-06 [environ_conv]: 1.137e-05 [add_recomputation]: 5.917e-05 [cse_after_recomputation]: 2.799e-05, [1] [Cycle 1]: 2.192e-05, [1] [cse]: 1.509e-05 [auto_monad_reorder]: 1.89e-05 [get_jit_bprop_graph]: 2.49001e-06 [rewriter_after_jit_bprop_graph]: 6.21998e-06 [opt_after_jit_grad]: 0.00119492 [symbol_engine_optimizer]: 8.948e-05, [1] [Cycle 1]: 8.221e-05, [6] [build]: 5.17e-06 [elim_shapecalc]: 1.003e-05 [elim_not_effective]: 1.951e-05 [opt_reshape]: 7.52998e-06 [fold_const_symbol]: 1.044e-05 [renormalize]: 3.7998e-07 [validate]: 0.0001579 Sums bootstrap : 0.000302s : 0.24% type_inference : 0.117743s : 93.45% event_method : 0.000020s : 0.02% auto_monad : 0.000052s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000453s : 0.36% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000879s : 0.70% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002846s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000060s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000787s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000523s : 0.42% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000059s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.001195s : 0.95% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000158s : 0.13% Time group info: ------[substitution.] 0.000302 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 4: substitution.graph_param_transform 87.21% : 0.000263s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.52% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117669 2 97.43% : 0.114640s : 1: type_inference.infer 2.57% : 0.003030s : 1: type_inference.specialize ------[replace.] 0.000111 7 68.43% : 0.000076s : 5: replace.inline 31.57% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000272 7 95.49% : 0.000260s : 5: match.inline 4.51% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.36% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000002s : 13: predicate.addn_zero_filter 1.75% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.86% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.79% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 19: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.57% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 1.72% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.91% : 0.000004s : 20: predicate.switch_defer_inline 1.99% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.95% : 0.000012s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.79% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.30% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002501 25 65.55% : 0.001640s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.42% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.03% : 0.000776s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134160 72 0.05% : 0.000063s : 1: add_recomputation 0.04% : 0.000056s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.24% : 0.000320s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.02% : 0.008077s : 1: jit_opt_a 0.14% : 0.000184s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.40% : 0.000533s : 1: loop_unroll 0.59% : 0.000798s : 1: mutable_eliminate 0.86% : 0.001147s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.90% : 0.001207s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000460s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.48% : 0.001991s : 1: renormalize.infer 0.63% : 0.000843s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.07% : 0.000092s : 1: symbol_engine_optimizer 87.77% : 0.117756s : 1: type_inference TotalTime = 0.101836, [30] [bootstrap]: 0.00043053 [type_inference]: 0.0867539 [event_method]: 0.00019686 [auto_monad]: 0.00013246 [graph_reusing]: 8.78001e-06 [pre_auto_parallel]: 3.58e-06 [py_interpret_to_execute]: 4.236e-05 [rewriter_before_opt_a]: 0.00016894 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.00946453, [2] [Cycle 1]: 0.00357122, [27] [switch_simplify]: 0.00016322 [loop_unroll]: 5.433e-05 [a_1]: 0.00130933 [with_stream_mark]: 2.063e-05 [recompute_prepare]: 1.239e-05 [updatestate_depend_eliminate]: 6.58e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.38999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 9.46998e-06 [updatestate_useless_node_eliminater]: 6.58e-06 [accelerated_algorithm]: 7.88001e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 6.55002e-06 [merge_forward]: 6.00002e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.053e-05 [j_node_and_user_rematch]: 1.187e-05 [meta_fg_expand]: 2.93998e-06 [replace_old_param]: 1.147e-05 [inline_without_move]: 6.38998e-06 [renormalize]: 0.00155045 [add_forward_monad_depend]: 9.36e-06 [auto_monad_grad]: 1.80001e-06 [auto_monad_eliminator]: 1.706e-05 [cse]: 3.277e-05 [replace_applicator]: 2.07e-05 [Cycle 2]: 0.000385, [27] [switch_simplify]: 7.32002e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00011309 [with_stream_mark]: 1.393e-05 [recompute_prepare]: 6.07001e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 7.17002e-06 [meta_shard_fg_expand]: 1.66998e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.55998e-06 [cell_reuse_recompute_pass]: 2.98998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.732e-05 [j_node_and_user_rematch]: 9.83998e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.09998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 7.65998e-06 [cse]: 1.654e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.702e-05 [rewriter_after_opt_a]: 6.539e-05 [convert_after_rewriter]: 8.37e-06 [order_py_execute_after_rewriter]: 5.94e-06 [mutable_eliminate]: 0.00089965 [jit_opt_b]: 6.647e-05, [1] [Cycle 1]: 5.701e-05, [2] [frontend_op_eliminate]: 2.254e-05 [inline_after_opt_a]: 2.065e-05 [cconv]: 3.065e-05 [loop_unroll]: 0.00115818 [jit_opt_after_cconv]: 0.00019249, [1] [Cycle 1]: 0.00018402, [11] [c_1]: 2.488e-05 [parameter_eliminate]: 4.88001e-06 [updatestate_depend_eliminate]: 7.31001e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 4.38001e-06 [cse]: 4.686e-05 [call_graph_tuple_transform]: 2.33e-05 [tuple_list_get_item_eliminator]: 7.45e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 3.571e-05 [partial_unused_args_eliminate]: 2.94001e-06 [environ_conv]: 7.95e-06 [add_recomputation]: 5.704e-05 [cse_after_recomputation]: 2.793e-05, [1] [Cycle 1]: 2.024e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.613e-05 [get_jit_bprop_graph]: 2.78998e-06 [rewriter_after_jit_bprop_graph]: 8.40999e-06 [opt_after_jit_grad]: 0.00074737 [symbol_engine_optimizer]: 0.00013102, [1] [Cycle 1]: 0.0001232, [6] [build]: 3.71001e-06 [elim_shapecalc]: 8.82e-06 [elim_not_effective]: 5.638e-05 [opt_reshape]: 7.61999e-06 [fold_const_symbol]: 1.202e-05 [renormalize]: 9.39996e-07 [validate]: 4.995e-05 Sums bootstrap : 0.000431s : 0.45% type_inference : 0.086754s : 91.61% event_method : 0.000197s : 0.21% auto_monad : 0.000132s : 0.14% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000042s : 0.04% rewriter_before_opt_a : 0.000169s : 0.18% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000171s : 0.18% jit_opt_a.loop_unroll : 0.000061s : 0.06% jit_opt_a.a_1 : 0.001422s : 1.50% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001551s : 1.64% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000049s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000065s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000900s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.001158s : 1.22% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000036s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000057s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000747s : 0.79% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000056s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.05% Time group info: ------[substitution.] 0.000555 33 7.29% : 0.000040s : 2: substitution.elim_not_effective 0.33% : 0.000002s : 2: substitution.fold_const_symbol 1.02% : 0.000006s : 3: substitution.graph_param_transform 82.87% : 0.000460s : 11: substitution.inline 1.12% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.20% : 0.000007s : 4: substitution.remove_not_recompute_node 1.11% : 0.000006s : 2: substitution.replace_old_param 2.11% : 0.000012s : 2: substitution.switch_simplify 2.94% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.086600 2 23.40% : 0.020267s : 1: type_inference.infer 76.60% : 0.066333s : 1: type_inference.specialize ------[replace.] 0.000288 16 51.26% : 0.000148s : 11: replace.inline 15.17% : 0.000044s : 2: replace.switch_simplify 33.57% : 0.000097s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000479 16 94.78% : 0.000454s : 11: match.inline 2.20% : 0.000011s : 2: match.switch_simplify 3.02% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000226 1148 1.21% : 0.000003s : 18: predicate.accumulaten_eliminater 0.90% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 18: predicate.addn_check_dump 1.62% : 0.000004s : 18: predicate.addn_zero_filter 2.03% : 0.000005s : 18: predicate.arithmetic_simplify 1.37% : 0.000003s : 18: predicate.cast_eliminate 0.32% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000002s : 18: predicate.compare_switch_simplify 1.32% : 0.000003s : 18: predicate.depend_value_elim 1.06% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.17% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.25% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.54% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.15% : 0.000003s : 18: predicate.environ_get_add_eliminate 1.22% : 0.000003s : 18: predicate.environ_get_depend_swap 1.49% : 0.000003s : 18: predicate.environ_get_eliminate 1.05% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000002s : 6: predicate.get_grad_eliminate 0.13% : 0.000000s : 3: predicate.graph_param_transform 11.67% : 0.000026s : 38: predicate.inline 0.51% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000003s : 6: predicate.less_batch_normalization 1.39% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.50% : 0.000003s : 24: predicate.load_eliminater 1.62% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.71% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 18: predicate.merge_addn 1.22% : 0.000003s : 18: predicate.minmaximum_grad 1.31% : 0.000003s : 3: predicate.mutable_eliminate 0.26% : 0.000001s : 3: predicate.opt_reshape 1.80% : 0.000004s : 24: predicate.partial_eliminate 1.26% : 0.000003s : 18: predicate.print_const_string_wrapper 1.78% : 0.000004s : 18: predicate.reduce_eliminate 1.54% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.30% : 0.000001s : 6: predicate.remove_not_recompute_node 1.44% : 0.000003s : 27: predicate.replace_applicator 0.27% : 0.000001s : 6: predicate.replace_old_param 0.16% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000003s : 18: predicate.reshape_eliminate 1.33% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.42% : 0.000001s : 3: predicate.row_tensor_eliminate 1.50% : 0.000003s : 18: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 6: predicate.special_op_eliminate 0.71% : 0.000002s : 6: predicate.specialize_transform 1.47% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.22% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000006s : 32: predicate.switch_defer_inline 2.26% : 0.000005s : 32: predicate.switch_layer_defer_inline 7.69% : 0.000017s : 103: predicate.switch_simplify 1.39% : 0.000003s : 18: predicate.tile_eliminate 1.51% : 0.000003s : 18: predicate.transpose_eliminate 1.46% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.66% : 0.000004s : 18: predicate.tuple_list_set_item_eliminator 1.43% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.67% : 0.000004s : 24: predicate.updatestate_pure_node_eliminater 2.16% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.69% : 0.000004s : 18: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002120 28 52.04% : 0.001104s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.27% : 0.000239s : 6: func_graph_cloner_run.FuncGraphClonerNode 36.68% : 0.000778s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.104440 72 0.06% : 0.000061s : 1: add_recomputation 0.13% : 0.000138s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.43% : 0.000451s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.19% : 0.000203s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 9.07% : 0.009468s : 1: jit_opt_a 0.19% : 0.000196s : 1: jit_opt_after_cconv 0.07% : 0.000069s : 1: jit_opt_b 1.12% : 0.001171s : 1: loop_unroll 0.87% : 0.000913s : 1: mutable_eliminate 1.73% : 0.001812s : 26: opt.transform.jit_opt_a 0.06% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000759s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000045s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000039s : 1: remove_dup_value 0.92% : 0.000958s : 1: renormalize.infer 0.56% : 0.000581s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000074s : 1: rewriter_after_opt_a 0.16% : 0.000172s : 1: rewriter_before_opt_a 0.13% : 0.000134s : 1: symbol_engine_optimizer 83.08% : 0.086771s : 1: type_inference Time group info: ------[substitution.] 0.000268 25 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000007s : 3: substitution.graph_param_transform 86.43% : 0.000231s : 5: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000004s : 4: substitution.remove_not_recompute_node 1.35% : 0.000004s : 2: substitution.replace_old_param 5.57% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016290 2 30.79% : 0.005016s : 1: type_inference.infer 69.21% : 0.011274s : 1: type_inference.specialize ------[replace.] 0.000113 8 65.07% : 0.000074s : 5: replace.inline 34.93% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 8 94.50% : 0.000228s : 5: match.inline 5.50% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 810 1.11% : 0.000002s : 12: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.61% : 0.000002s : 12: predicate.addn_zero_filter 2.14% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 12: predicate.compare_switch_simplify 1.71% : 0.000003s : 12: predicate.depend_value_elim 1.06% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000008s : 26: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.57% : 0.000004s : 15: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 1.01% : 0.000002s : 12: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 2.04% : 0.000003s : 12: predicate.reduce_eliminate 1.81% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 21: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000002s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.19% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.92% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.49% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.68% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000882 16 52.13% : 0.000460s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.93% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.94% : 0.000361s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028066 72 0.21% : 0.000060s : 1: add_recomputation 0.30% : 0.000086s : 1: auto_monad 0.08% : 0.000023s : 1: auto_monad_reorder 1.40% : 0.000393s : 1: bootstrap 0.11% : 0.000030s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000031s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.11% : 0.000030s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 22.68% : 0.006366s : 1: jit_opt_a 0.61% : 0.000171s : 1: jit_opt_after_cconv 0.21% : 0.000058s : 1: jit_opt_b 1.73% : 0.000487s : 1: loop_unroll 2.37% : 0.000666s : 1: mutable_eliminate 3.79% : 0.001063s : 26: opt.transform.jit_opt_a 0.19% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.20% : 0.000616s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000102s : 1: py_interpret_to_execute 0.06% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000022s : 1: remove_dup_value 1.88% : 0.000527s : 1: renormalize.infer 1.47% : 0.000413s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000041s : 1: rewriter_after_opt_a 0.37% : 0.000104s : 1: rewriter_before_opt_a 0.33% : 0.000093s : 1: symbol_engine_optimizer 58.52% : 0.016423s : 1: type_inference . TotalTime = 0.0323506, [30] [bootstrap]: 0.00031442 [type_inference]: 0.023393 [event_method]: 2.31e-05 [auto_monad]: 6.958e-05 [graph_reusing]: 7.3e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 9.894e-05 [rewriter_before_opt_a]: 8.559e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.0056894, [2] [Cycle 1]: 0.00192749, [27] [switch_simplify]: 5.616e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00054079 [with_stream_mark]: 2.189e-05 [recompute_prepare]: 7.78001e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.496e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 8.60999e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 0.00093769 [add_forward_monad_depend]: 6.68998e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.598e-05 [cse]: 3.696e-05 [replace_applicator]: 1.375e-05 [Cycle 2]: 0.00032471, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.10001e-06 [a_1]: 8.877e-05 [with_stream_mark]: 1.078e-05 [recompute_prepare]: 5.19998e-06 [updatestate_depend_eliminate]: 3.60998e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.61002e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 7.88001e-06 [meta_fg_expand]: 1.56002e-06 [replace_old_param]: 7.63999e-06 [inline_without_move]: 5.11002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.43998e-06 [cse]: 1.325e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.473e-05 [rewriter_after_opt_a]: 3.951e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00067795 [jit_opt_b]: 5.249e-05, [1] [Cycle 1]: 4.386e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.655e-05 [cconv]: 3.092e-05 [loop_unroll]: 0.00046105 [jit_opt_after_cconv]: 0.00038962, [1] [Cycle 1]: 0.0003811, [11] [c_1]: 2.044e-05 [parameter_eliminate]: 3.02002e-06 [updatestate_depend_eliminate]: 7.09001e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.865e-05 [call_graph_tuple_transform]: 0.00024562 [tuple_list_get_item_eliminator]: 7.11001e-06 [none_parameter_eliminate]: 2.26998e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.955e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.728e-05 [cse_after_recomputation]: 2.856e-05, [1] [Cycle 1]: 2.207e-05, [1] [cse]: 1.586e-05 [auto_monad_reorder]: 1.932e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.00051962 [symbol_engine_optimizer]: 7.453e-05, [1] [Cycle 1]: 6.779e-05, [6] [build]: 3.91001e-06 [elim_shapecalc]: 8.54002e-06 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.43e-06 [fold_const_symbol]: 9.33002e-06 [renormalize]: 4.30009e-07 [validate]: 4.488e-05 Sums bootstrap : 0.000314s : 1.11% type_inference : 0.023393s : 82.67% event_method : 0.000023s : 0.08% auto_monad : 0.000070s : 0.25% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000099s : 0.35% rewriter_before_opt_a : 0.000086s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.22% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000630s : 2.22% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000938s : 3.31% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000050s : 0.18% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000678s : 2.40% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000031s : 0.11% loop_unroll : 0.000461s : 1.63% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000246s : 0.87% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000020s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000057s : 0.20% cse_after_recomputation.cse : 0.000016s : 0.06% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000520s : 1.84% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000226 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.84% : 0.000006s : 3: substitution.graph_param_transform 84.50% : 0.000191s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023317 2 93.59% : 0.021822s : 1: type_inference.infer 6.41% : 0.001496s : 1: type_inference.specialize ------[replace.] 0.000067 6 69.13% : 0.000047s : 4: replace.inline 30.87% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.32% : 0.000189s : 4: match.inline 5.68% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.39% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.60% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.31% : 0.000003s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.05% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.64% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000840 13 46.95% : 0.000394s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.00% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.04% : 0.000395s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034411 72 0.18% : 0.000060s : 1: add_recomputation 0.21% : 0.000073s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.96% : 0.000332s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000031s : 1: cse_after_recomputation 0.09% : 0.000029s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 16.54% : 0.005693s : 1: jit_opt_a 1.14% : 0.000393s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.36% : 0.000470s : 1: loop_unroll 2.01% : 0.000691s : 1: mutable_eliminate 2.45% : 0.000844s : 26: opt.transform.jit_opt_a 0.80% : 0.000275s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000527s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000102s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000022s : 1: remove_dup_value 1.58% : 0.000544s : 1: renormalize.infer 1.12% : 0.000385s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.26% : 0.000089s : 1: rewriter_before_opt_a 0.22% : 0.000077s : 1: symbol_engine_optimizer 68.04% : 0.023413s : 1: type_inference TotalTime = 0.0881542, [30] [bootstrap]: 0.000361 [type_inference]: 0.0751835 [event_method]: 2.097e-05 [auto_monad]: 7.154e-05 [graph_reusing]: 6.53998e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 0.00028717 [rewriter_before_opt_a]: 0.00056189 [expand_dump_flag]: 5.19e-06 [jit_opt_a]: 0.00915047, [2] [Cycle 1]: 0.00498538, [27] [switch_simplify]: 6.216e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.00063315 [with_stream_mark]: 1.949e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 7.04001e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.88998e-06 [inline_without_move]: 6.32001e-06 [renormalize]: 0.0038635 [add_forward_monad_depend]: 9.92999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.165e-05 [cse]: 3.1e-05 [replace_applicator]: 2.431e-05 [Cycle 2]: 0.00040724, [27] [switch_simplify]: 7.7e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00013665 [with_stream_mark]: 1.581e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.43002e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 4.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.916e-05 [j_node_and_user_rematch]: 1.055e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.19e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.692e-05 [rewriter_after_opt_a]: 3.902e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.0007735 [jit_opt_b]: 5.639e-05, [1] [Cycle 1]: 4.876e-05, [2] [frontend_op_eliminate]: 1.871e-05 [inline_after_opt_a]: 1.876e-05 [cconv]: 2.967e-05 [loop_unroll]: 0.00042365 [jit_opt_after_cconv]: 0.00015776, [1] [Cycle 1]: 0.00015107, [11] [c_1]: 2.61e-05 [parameter_eliminate]: 2.94999e-06 [updatestate_depend_eliminate]: 7.68001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 2.35e-05 [call_graph_tuple_transform]: 2.281e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 6.44999e-06 [add_recomputation]: 5.186e-05 [cse_after_recomputation]: 2.193e-05, [1] [Cycle 1]: 1.625e-05, [1] [cse]: 9.72999e-06 [auto_monad_reorder]: 8.563e-05 [get_jit_bprop_graph]: 2.23998e-06 [rewriter_after_jit_bprop_graph]: 5.79e-06 [opt_after_jit_grad]: 0.00045619 [symbol_engine_optimizer]: 0.00011895, [1] [Cycle 1]: 0.00011286, [6] [build]: 3.82998e-06 [elim_shapecalc]: 7.82998e-06 [elim_not_effective]: 5.372e-05 [opt_reshape]: 7.30998e-06 [fold_const_symbol]: 1.011e-05 [renormalize]: 5.69999e-07 [validate]: 4.04e-05 Sums bootstrap : 0.000361s : 0.43% type_inference : 0.075184s : 89.73% event_method : 0.000021s : 0.03% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000287s : 0.34% rewriter_before_opt_a : 0.000562s : 0.67% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.08% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000770s : 0.92% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003864s : 4.61% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.03% jit_opt_a.cse : 0.000043s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000774s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.04% loop_unroll : 0.000424s : 0.51% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000086s : 0.10% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000456s : 0.54% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000054s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.05% Time group info: ------[substitution.] 0.000253 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 83.66% : 0.000211s : 4: substitution.inline 1.91% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000006s : 2: substitution.replace_old_param 5.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.075098 2 96.72% : 0.072633s : 1: type_inference.infer 3.28% : 0.002464s : 1: type_inference.specialize ------[replace.] 0.000088 6 67.87% : 0.000060s : 4: replace.inline 32.13% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.09% : 0.000209s : 4: match.inline 5.91% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.10% : 0.000001s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 2.05% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.10% : 0.000001s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.48% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.73% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.39% : 0.000002s : 12: predicate.print_const_string_wrapper 1.85% : 0.000002s : 12: predicate.reduce_eliminate 1.26% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 58: predicate.switch_simplify 1.49% : 0.000002s : 12: predicate.tile_eliminate 1.36% : 0.000002s : 12: predicate.transpose_eliminate 1.71% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.53% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.89% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002025 18 61.89% : 0.001253s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.23% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.88% : 0.000727s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.093152 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.10% : 0.000089s : 1: auto_monad_reorder 0.40% : 0.000376s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.83% : 0.009155s : 1: jit_opt_a 0.17% : 0.000160s : 1: jit_opt_after_cconv 0.06% : 0.000059s : 1: jit_opt_b 0.46% : 0.000432s : 1: loop_unroll 0.84% : 0.000784s : 1: mutable_eliminate 1.10% : 0.001028s : 26: opt.transform.jit_opt_a 0.06% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000075s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000293s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 3.22% : 0.003001s : 1: renormalize.infer 0.91% : 0.000847s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.61% : 0.000572s : 1: rewriter_before_opt_a 0.13% : 0.000122s : 1: symbol_engine_optimizer 80.72% : 0.075197s : 1: type_inference TotalTime = 0.0186625, [30] [bootstrap]: 0.00031176 [type_inference]: 0.00627449 [event_method]: 2.177e-05 [auto_monad]: 7.096e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 0.00087046 [rewriter_before_opt_a]: 9.621e-05 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.00864877, [2] [Cycle 1]: 0.00230873, [27] [switch_simplify]: 7.357e-05 [loop_unroll]: 3.651e-05 [a_1]: 0.00076583 [with_stream_mark]: 2.353e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 4.24997e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.75002e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 5.74999e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.04998e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.559e-05 [j_node_and_user_rematch]: 9.90002e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.46e-06 [renormalize]: 0.00104801 [add_forward_monad_depend]: 7.13e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.529e-05 [cse]: 2.785e-05 [replace_applicator]: 1.546e-05 [Cycle 2]: 0.0003273, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.33002e-06 [a_1]: 9.524e-05 [with_stream_mark]: 8.99e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 4.75001e-06 [accelerated_algorithm]: 4.87998e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.35999e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 2.01998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 1.45001e-06 [replace_old_param]: 7.67002e-06 [inline_without_move]: 5.06997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.66002e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 5.09e-06 [cse]: 1.095e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.274e-05 [rewriter_after_opt_a]: 3.715e-05 [convert_after_rewriter]: 6.43e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00070154 [jit_opt_b]: 5.053e-05, [1] [Cycle 1]: 4.289e-05, [2] [frontend_op_eliminate]: 1.612e-05 [inline_after_opt_a]: 1.487e-05 [cconv]: 2.958e-05 [loop_unroll]: 0.00043233 [jit_opt_after_cconv]: 0.0001539, [1] [Cycle 1]: 0.00014656, [11] [c_1]: 2.105e-05 [parameter_eliminate]: 3.04001e-06 [updatestate_depend_eliminate]: 6.84999e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.181e-05 [call_graph_tuple_transform]: 1.958e-05 [tuple_list_get_item_eliminator]: 5.12999e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 7.59988e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.42e-05 [partial_unused_args_eliminate]: 2.36998e-06 [environ_conv]: 5.40999e-06 [add_recomputation]: 5.181e-05 [cse_after_recomputation]: 2.242e-05, [1] [Cycle 1]: 1.676e-05, [1] [cse]: 1.106e-05 [auto_monad_reorder]: 1.511e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00048186 [symbol_engine_optimizer]: 7.401e-05, [1] [Cycle 1]: 6.726e-05, [6] [build]: 4.13001e-06 [elim_shapecalc]: 7.42002e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 8.70001e-07 [validate]: 4.078e-05 Sums bootstrap : 0.000312s : 2.60% type_inference : 0.006274s : 52.29% event_method : 0.000022s : 0.18% auto_monad : 0.000071s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000870s : 7.25% rewriter_before_opt_a : 0.000096s : 0.80% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000080s : 0.67% jit_opt_a.loop_unroll : 0.000042s : 0.35% jit_opt_a.a_1 : 0.000861s : 7.18% jit_opt_a.with_stream_mark : 0.000033s : 0.27% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001048s : 8.73% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.17% jit_opt_a.cse : 0.000039s : 0.32% jit_opt_a.replace_applicator : 0.000021s : 0.17% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000037s : 0.31% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000702s : 5.85% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.12% cconv : 0.000030s : 0.25% loop_unroll : 0.000432s : 3.60% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000014s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000052s : 0.43% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000015s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000482s : 4.02% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.34% Time group info: ------[substitution.] 0.000313 25 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.78% : 0.000006s : 3: substitution.graph_param_transform 87.30% : 0.000273s : 5: substitution.inline 1.44% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.53% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000006s : 2: substitution.replace_old_param 4.87% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006200 2 83.45% : 0.005174s : 1: type_inference.infer 16.55% : 0.001026s : 1: type_inference.specialize ------[replace.] 0.000113 8 65.50% : 0.000074s : 5: replace.inline 34.50% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000284 8 95.15% : 0.000270s : 5: match.inline 4.85% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 810 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.50% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.45% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.56% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 5.38% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 18: predicate.load_eliminater 1.11% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 2.20% : 0.000003s : 12: predicate.reduce_eliminate 1.90% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000003s : 21: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.78% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 2.23% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.78% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.85% : 0.000011s : 64: predicate.switch_simplify 1.46% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000892 16 52.28% : 0.000466s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.35% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.37% : 0.000333s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020852 72 0.26% : 0.000055s : 1: add_recomputation 0.36% : 0.000075s : 1: auto_monad 0.08% : 0.000018s : 1: auto_monad_reorder 1.61% : 0.000335s : 1: bootstrap 0.15% : 0.000032s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 41.50% : 0.008653s : 1: jit_opt_a 0.75% : 0.000157s : 1: jit_opt_after_cconv 0.26% : 0.000054s : 1: jit_opt_b 2.11% : 0.000441s : 1: loop_unroll 3.41% : 0.000711s : 1: mutable_eliminate 5.28% : 0.001102s : 26: opt.transform.jit_opt_a 0.23% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.35% : 0.000491s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 4.23% : 0.000882s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000017s : 1: remove_dup_value 3.26% : 0.000680s : 1: renormalize.infer 1.72% : 0.000358s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000040s : 1: rewriter_after_opt_a 0.49% : 0.000102s : 1: rewriter_before_opt_a 0.37% : 0.000077s : 1: symbol_engine_optimizer 30.18% : 0.006294s : 1: type_inference TotalTime = 0.0324852, [30] [bootstrap]: 0.00038381 [type_inference]: 0.0230326 [event_method]: 2.296e-05 [auto_monad]: 7.373e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 0.0001137 [rewriter_before_opt_a]: 8.378e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00619835, [2] [Cycle 1]: 0.0021872, [27] [switch_simplify]: 6.533e-05 [loop_unroll]: 3.167e-05 [a_1]: 0.00060188 [with_stream_mark]: 2.598e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 3.60998e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.17999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.676e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.233e-05 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00106734 [add_forward_monad_depend]: 8.84998e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.882e-05 [cse]: 4.003e-05 [replace_applicator]: 1.498e-05 [Cycle 2]: 0.00033628, [27] [switch_simplify]: 6.04001e-06 [loop_unroll]: 5.09e-06 [a_1]: 8.987e-05 [with_stream_mark]: 1.321e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.42001e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 2.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.67002e-06 [cse]: 1.566e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.548e-05 [rewriter_after_opt_a]: 3.95e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00076333 [jit_opt_b]: 5.107e-05, [1] [Cycle 1]: 4.316e-05, [2] [frontend_op_eliminate]: 1.571e-05 [inline_after_opt_a]: 1.642e-05 [cconv]: 3.108e-05 [loop_unroll]: 0.00050457 [jit_opt_after_cconv]: 0.00015836, [1] [Cycle 1]: 0.00015119, [11] [c_1]: 2.108e-05 [parameter_eliminate]: 3.8e-06 [updatestate_depend_eliminate]: 7.29001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.60002e-06 [cse]: 3.165e-05 [call_graph_tuple_transform]: 1.976e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.739e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 6.47001e-06 [add_recomputation]: 5.514e-05 [cse_after_recomputation]: 2.497e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.333e-05 [auto_monad_reorder]: 1.818e-05 [get_jit_bprop_graph]: 2.36998e-06 [rewriter_after_jit_bprop_graph]: 6.98998e-06 [opt_after_jit_grad]: 0.00051234 [symbol_engine_optimizer]: 7.693e-05, [1] [Cycle 1]: 6.984e-05, [6] [build]: 4.17998e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.412e-05 [opt_reshape]: 6.03002e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 6.00005e-07 [validate]: 4.39e-05 Sums bootstrap : 0.000384s : 1.36% type_inference : 0.023033s : 81.82% event_method : 0.000023s : 0.08% auto_monad : 0.000074s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000114s : 0.40% rewriter_before_opt_a : 0.000084s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.25% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000692s : 2.46% jit_opt_a.with_stream_mark : 0.000039s : 0.14% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001067s : 3.79% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000056s : 0.20% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000763s : 2.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000031s : 0.11% loop_unroll : 0.000505s : 1.79% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000512s : 1.82% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.16% Time group info: ------[substitution.] 0.000261 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 3: substitution.graph_param_transform 84.15% : 0.000220s : 4: substitution.inline 1.82% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000006s : 4: substitution.remove_not_recompute_node 2.70% : 0.000007s : 2: substitution.replace_old_param 5.39% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022950 2 93.00% : 0.021342s : 1: type_inference.infer 7.00% : 0.001607s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.89% : 0.000054s : 4: replace.inline 31.11% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.45% : 0.000217s : 4: match.inline 5.55% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.37% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.59% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.73% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.40% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 1.05% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.77% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.44% : 0.000011s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000896 13 47.75% : 0.000428s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.24% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.01% : 0.000412s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034540 72 0.17% : 0.000058s : 1: add_recomputation 0.22% : 0.000078s : 1: auto_monad 0.15% : 0.000050s : 1: auto_monad_reorder 1.18% : 0.000407s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.95% : 0.006201s : 1: jit_opt_a 0.47% : 0.000161s : 1: jit_opt_after_cconv 0.16% : 0.000054s : 1: jit_opt_b 1.49% : 0.000514s : 1: loop_unroll 2.25% : 0.000776s : 1: mutable_eliminate 2.70% : 0.000932s : 26: opt.transform.jit_opt_a 0.14% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000521s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000117s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.78% : 0.000614s : 1: renormalize.infer 1.28% : 0.000443s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000042s : 1: rewriter_after_opt_a 0.25% : 0.000087s : 1: rewriter_before_opt_a 0.23% : 0.000080s : 1: symbol_engine_optimizer 66.73% : 0.023050s : 1: type_inference TotalTime = 0.0510146, [30] [bootstrap]: 0.00033316 [type_inference]: 0.0412694 [event_method]: 2.129e-05 [auto_monad]: 7.008e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.43002e-06 [py_interpret_to_execute]: 0.00015304 [rewriter_before_opt_a]: 8.782e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.00649785, [2] [Cycle 1]: 0.00258286, [27] [switch_simplify]: 6.33e-05 [loop_unroll]: 2.98e-05 [a_1]: 0.0005944 [with_stream_mark]: 2.328e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00149531 [add_forward_monad_depend]: 7.95e-06 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 1.887e-05 [cse]: 3.731e-05 [replace_applicator]: 1.694e-05 [Cycle 2]: 0.00034806, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.72999e-06 [a_1]: 9.834e-05 [with_stream_mark]: 1.063e-05 [recompute_prepare]: 5.55001e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 6.96999e-06 [cse]: 1.536e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.811e-05 [rewriter_after_opt_a]: 4.397e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.99999e-06 [mutable_eliminate]: 0.00073742 [jit_opt_b]: 5.457e-05, [1] [Cycle 1]: 4.605e-05, [2] [frontend_op_eliminate]: 1.741e-05 [inline_after_opt_a]: 1.715e-05 [cconv]: 3.153e-05 [loop_unroll]: 0.00047501 [jit_opt_after_cconv]: 0.00017071, [1] [Cycle 1]: 0.00016307, [11] [c_1]: 2.208e-05 [parameter_eliminate]: 4.53999e-06 [updatestate_depend_eliminate]: 7.95e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 3.724e-05 [call_graph_tuple_transform]: 2.07e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 8.90024e-07 [switch_simplify]: 5.79999e-06 [remove_dup_value]: 1.951e-05 [partial_unused_args_eliminate]: 2.68998e-06 [environ_conv]: 7.63001e-06 [add_recomputation]: 5.741e-05 [cse_after_recomputation]: 2.405e-05, [1] [Cycle 1]: 1.793e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 1.93002e-06 [rewriter_after_jit_bprop_graph]: 7.26001e-06 [opt_after_jit_grad]: 0.00051243 [symbol_engine_optimizer]: 0.00012129, [1] [Cycle 1]: 0.00011309, [6] [build]: 5.39e-06 [elim_shapecalc]: 9.40001e-06 [elim_not_effective]: 4.86e-05 [opt_reshape]: 7.85e-06 [fold_const_symbol]: 1.219e-05 [renormalize]: 3.80009e-07 [validate]: 5.025e-05 Sums bootstrap : 0.000333s : 0.71% type_inference : 0.041269s : 88.18% event_method : 0.000021s : 0.05% auto_monad : 0.000070s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000153s : 0.33% rewriter_before_opt_a : 0.000088s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.15% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000693s : 1.48% jit_opt_a.with_stream_mark : 0.000034s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001495s : 3.20% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.06% jit_opt_a.cse : 0.000053s : 0.11% jit_opt_a.replace_applicator : 0.000023s : 0.05% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000044s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000737s : 1.58% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000032s : 0.07% loop_unroll : 0.000475s : 1.01% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000057s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000512s : 1.09% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000049s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.11% Time group info: ------[substitution.] 0.000288 23 12.75% : 0.000037s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 1.90% : 0.000005s : 3: substitution.graph_param_transform 75.00% : 0.000216s : 4: substitution.inline 1.80% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000005s : 2: substitution.replace_old_param 4.61% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041179 2 94.94% : 0.039097s : 1: type_inference.infer 5.06% : 0.002082s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.73% : 0.000056s : 4: replace.inline 30.27% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.66% : 0.000213s : 4: match.inline 5.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.06% : 0.000001s : 10: predicate.addn_zero_filter 2.40% : 0.000003s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.44% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.75% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 15: predicate.load_eliminater 2.16% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.77% : 0.000004s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.85% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.00% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.49% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.87% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001106 13 41.31% : 0.000457s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.76% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.92% : 0.000596s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053518 72 0.11% : 0.000060s : 1: add_recomputation 0.14% : 0.000074s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.66% : 0.000354s : 1: bootstrap 0.06% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.15% : 0.006502s : 1: jit_opt_a 0.32% : 0.000173s : 1: jit_opt_after_cconv 0.11% : 0.000057s : 1: jit_opt_b 0.90% : 0.000484s : 1: loop_unroll 1.40% : 0.000749s : 1: mutable_eliminate 1.73% : 0.000924s : 26: opt.transform.jit_opt_a 0.10% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000074s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000157s : 1: py_interpret_to_execute 0.04% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 1.64% : 0.000877s : 1: renormalize.infer 1.14% : 0.000608s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000047s : 1: rewriter_after_opt_a 0.17% : 0.000092s : 1: rewriter_before_opt_a 0.23% : 0.000124s : 1: symbol_engine_optimizer 77.15% : 0.041288s : 1: type_inference TotalTime = 0.0163801, [30] [bootstrap]: 0.00036178 [type_inference]: 0.00531476 [event_method]: 1.997e-05 [auto_monad]: 7.037e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 4.181e-05 [rewriter_before_opt_a]: 9.563e-05 [expand_dump_flag]: 3.87002e-06 [jit_opt_a]: 0.00702364, [2] [Cycle 1]: 0.00282575, [27] [switch_simplify]: 6.509e-05 [loop_unroll]: 3.128e-05 [a_1]: 0.00057531 [with_stream_mark]: 1.887e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 5.76003e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.707e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.55997e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00174487 [add_forward_monad_depend]: 9.29e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 2.198e-05 [cse]: 3.267e-05 [replace_applicator]: 2.151e-05 [Cycle 2]: 0.00038198, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.39e-06 [a_1]: 0.00012421 [with_stream_mark]: 1.439e-05 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 4.87e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 3.31001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1e-05 [inline_without_move]: 4.65001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 7.87e-06 [cse]: 1.285e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.733e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 8.43999e-06 [order_py_execute_after_rewriter]: 4.81997e-06 [mutable_eliminate]: 0.00070525 [jit_opt_b]: 5.284e-05, [1] [Cycle 1]: 4.426e-05, [2] [frontend_op_eliminate]: 1.755e-05 [inline_after_opt_a]: 1.514e-05 [cconv]: 2.971e-05 [loop_unroll]: 0.00043727 [jit_opt_after_cconv]: 0.00014813, [1] [Cycle 1]: 0.00014162, [11] [c_1]: 2.161e-05 [parameter_eliminate]: 3.24001e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 2.294e-05 [call_graph_tuple_transform]: 2.037e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.53e-05 [partial_unused_args_eliminate]: 3.09999e-06 [environ_conv]: 5.35001e-06 [add_recomputation]: 5.071e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.132e-05 [auto_monad_reorder]: 1.51e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 6.19001e-06 [opt_after_jit_grad]: 0.00057454 [symbol_engine_optimizer]: 7.828e-05, [1] [Cycle 1]: 7.144e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 1.482e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 9.52999e-06 [renormalize]: 3.30008e-07 [validate]: 3.988e-05 Sums bootstrap : 0.000362s : 3.31% type_inference : 0.005315s : 48.59% event_method : 0.000020s : 0.18% auto_monad : 0.000070s : 0.64% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000042s : 0.38% rewriter_before_opt_a : 0.000096s : 0.87% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000071s : 0.65% jit_opt_a.loop_unroll : 0.000037s : 0.34% jit_opt_a.a_1 : 0.000700s : 6.40% jit_opt_a.with_stream_mark : 0.000033s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000013s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000020s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001745s : 15.95% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.27% jit_opt_a.cse : 0.000046s : 0.42% jit_opt_a.replace_applicator : 0.000027s : 0.25% py_interpret_to_execute_after_opt_a : 0.000017s : 0.16% rewriter_after_opt_a : 0.000039s : 0.36% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000705s : 6.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000030s : 0.27% loop_unroll : 0.000437s : 4.00% jit_opt_after_cconv.c_1 : 0.000022s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000051s : 0.46% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000015s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000575s : 5.25% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.36% Time group info: ------[substitution.] 0.000237 23 1.07% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 3.01% : 0.000007s : 3: substitution.graph_param_transform 82.46% : 0.000195s : 4: substitution.inline 1.72% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.76% : 0.000007s : 4: substitution.remove_not_recompute_node 2.57% : 0.000006s : 2: substitution.replace_old_param 5.82% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005234 2 82.42% : 0.004313s : 1: type_inference.infer 17.58% : 0.000920s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.98% : 0.000049s : 4: replace.inline 33.02% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 93.85% : 0.000193s : 4: match.inline 6.15% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.62% : 0.000002s : 10: predicate.accumulaten_eliminater 1.29% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.35% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.64% : 0.000002s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.46% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.98% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.36% : 0.000002s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.58% : 0.000002s : 10: predicate.transpose_eliminate 1.67% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.89% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000762 13 50.06% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.88% : 0.000342s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018139 72 0.30% : 0.000054s : 1: add_recomputation 0.41% : 0.000074s : 1: auto_monad 0.10% : 0.000018s : 1: auto_monad_reorder 2.09% : 0.000380s : 1: bootstrap 0.18% : 0.000032s : 1: cconv 0.06% : 0.000011s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.12% : 0.000022s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 38.75% : 0.007029s : 1: jit_opt_a 0.83% : 0.000150s : 1: jit_opt_after_cconv 0.30% : 0.000055s : 1: jit_opt_b 2.45% : 0.000445s : 1: loop_unroll 3.93% : 0.000714s : 1: mutable_eliminate 5.19% : 0.000941s : 26: opt.transform.jit_opt_a 0.27% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.22% : 0.000584s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000045s : 1: py_interpret_to_execute 0.11% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 6.87% : 0.001247s : 1: renormalize.infer 2.68% : 0.000485s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.60% : 0.000109s : 1: rewriter_before_opt_a 0.45% : 0.000081s : 1: symbol_engine_optimizer 29.38% : 0.005330s : 1: type_inference TotalTime = 0.029039, [30] [bootstrap]: 0.0003774 [type_inference]: 0.0133218 [event_method]: 2.17e-05 [auto_monad]: 8.596e-05 [graph_reusing]: 5.30001e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 5.646e-05 [rewriter_before_opt_a]: 9.087e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.0100344, [2] [Cycle 1]: 0.00354537, [27] [switch_simplify]: 7.373e-05 [loop_unroll]: 3.741e-05 [a_1]: 0.00198448 [with_stream_mark]: 2.925e-05 [recompute_prepare]: 1.035e-05 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.66999e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 2.43002e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.705e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00103751 [add_forward_monad_depend]: 6.51e-06 [auto_monad_grad]: 2.91999e-06 [auto_monad_eliminator]: 1.783e-05 [cse]: 3.573e-05 [replace_applicator]: 1.356e-05 [Cycle 2]: 0.00034243, [27] [switch_simplify]: 6.56e-06 [loop_unroll]: 5.56e-06 [a_1]: 9.232e-05 [with_stream_mark]: 1.018e-05 [recompute_prepare]: 5.53002e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 3.47997e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.557e-05 [replace_applicator]: 5.90002e-06 [py_interpret_to_execute_after_opt_a]: 6.91e-05 [rewriter_after_opt_a]: 5.193e-05 [convert_after_rewriter]: 8.16002e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00078336 [jit_opt_b]: 6.741e-05, [1] [Cycle 1]: 5.805e-05, [2] [frontend_op_eliminate]: 2.665e-05 [inline_after_opt_a]: 1.931e-05 [cconv]: 2.943e-05 [loop_unroll]: 0.00045855 [jit_opt_after_cconv]: 0.00015293, [1] [Cycle 1]: 0.00014552, [11] [c_1]: 2.241e-05 [parameter_eliminate]: 3.11001e-06 [updatestate_depend_eliminate]: 7.59002e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 2.436e-05 [call_graph_tuple_transform]: 2.049e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.639e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 9.97999e-06 [add_recomputation]: 5.329e-05 [cse_after_recomputation]: 2.338e-05, [1] [Cycle 1]: 1.798e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.841e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.00294307 [symbol_engine_optimizer]: 9.348e-05, [1] [Cycle 1]: 8.479e-05, [6] [build]: 1.122e-05 [elim_shapecalc]: 1.029e-05 [elim_not_effective]: 1.757e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 1.09003e-06 [validate]: 5.372e-05 Sums bootstrap : 0.000377s : 1.70% type_inference : 0.013322s : 59.86% event_method : 0.000022s : 0.10% auto_monad : 0.000086s : 0.39% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000056s : 0.25% rewriter_before_opt_a : 0.000091s : 0.41% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000080s : 0.36% jit_opt_a.loop_unroll : 0.000043s : 0.19% jit_opt_a.a_1 : 0.002077s : 9.33% jit_opt_a.with_stream_mark : 0.000039s : 0.18% jit_opt_a.recompute_prepare : 0.000016s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.09% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.09% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.001038s : 4.66% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.11% jit_opt_a.cse : 0.000051s : 0.23% jit_opt_a.replace_applicator : 0.000019s : 0.09% py_interpret_to_execute_after_opt_a : 0.000069s : 0.31% rewriter_after_opt_a : 0.000052s : 0.23% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000783s : 3.52% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.09% cconv : 0.000029s : 0.13% loop_unroll : 0.000459s : 2.06% jit_opt_after_cconv.c_1 : 0.000022s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.04% add_recomputation : 0.000053s : 0.24% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.002943s : 13.22% symbol_engine_optimizer.build : 0.000011s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.24% Time group info: ------[substitution.] 0.000316 25 0.90% : 0.000003s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000006s : 3: substitution.graph_param_transform 85.76% : 0.000271s : 5: substitution.inline 1.19% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.53% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_old_param 6.55% : 0.000021s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013247 2 90.53% : 0.011992s : 1: type_inference.infer 9.47% : 0.001255s : 1: type_inference.specialize ------[replace.] 0.000149 8 49.39% : 0.000074s : 5: replace.inline 50.61% : 0.000075s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 8 93.35% : 0.000267s : 5: match.inline 6.65% : 0.000019s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.001282 810 0.15% : 0.000002s : 12: predicate.accumulaten_eliminater 0.18% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.13% : 0.000002s : 12: predicate.addn_check_dump 0.22% : 0.000003s : 12: predicate.addn_zero_filter 0.28% : 0.000004s : 12: predicate.arithmetic_simplify 0.15% : 0.000002s : 12: predicate.cast_eliminate 0.06% : 0.000001s : 3: predicate.check_bprop_eliminate 0.13% : 0.000002s : 12: predicate.compare_switch_simplify 0.19% : 0.000002s : 12: predicate.depend_value_elim 0.31% : 0.000004s : 12: predicate.dict_get_item_const_eliminator 87.59% : 0.001123s : 12: predicate.dict_get_item_eliminator 0.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.12% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.05% : 0.000001s : 3: predicate.elim_not_effective 0.09% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.15% : 0.000002s : 12: predicate.environ_get_depend_swap 0.20% : 0.000003s : 12: predicate.environ_get_eliminate 0.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 3: predicate.fold_const_symbol 0.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.02% : 0.000000s : 3: predicate.graph_param_transform 0.72% : 0.000009s : 26: predicate.inline 0.09% : 0.000001s : 6: predicate.inline_without_move 0.04% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.15% : 0.000002s : 6: predicate.less_batch_normalization 0.28% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 0.20% : 0.000002s : 18: predicate.load_eliminater 0.13% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.47% : 0.000006s : 41: predicate.loop_unroll_before_grad 0.24% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.12% : 0.000002s : 12: predicate.merge_addn 0.14% : 0.000002s : 12: predicate.minmaximum_grad 0.29% : 0.000004s : 3: predicate.mutable_eliminate 0.05% : 0.000001s : 3: predicate.opt_reshape 0.27% : 0.000003s : 18: predicate.partial_eliminate 0.13% : 0.000002s : 12: predicate.print_const_string_wrapper 0.31% : 0.000004s : 12: predicate.reduce_eliminate 0.22% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.05% : 0.000001s : 6: predicate.remove_not_recompute_node 0.19% : 0.000002s : 21: predicate.replace_applicator 0.09% : 0.000001s : 6: predicate.replace_old_param 0.03% : 0.000000s : 3: predicate.reset_defer_inline 0.16% : 0.000002s : 12: predicate.reshape_eliminate 0.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.09% : 0.000001s : 3: predicate.row_tensor_eliminate 0.14% : 0.000002s : 12: predicate.same_eliminate 0.05% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.16% : 0.000002s : 6: predicate.special_op_eliminate 0.09% : 0.000001s : 6: predicate.specialize_transform 0.17% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.20% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.04% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.34% : 0.000004s : 20: predicate.switch_defer_inline 0.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 0.89% : 0.000011s : 64: predicate.switch_simplify 0.18% : 0.000002s : 12: predicate.tile_eliminate 0.17% : 0.000002s : 12: predicate.transpose_eliminate 0.20% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 0.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 0.43% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 0.19% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 0.18% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.19% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 0.32% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 0.23% : 0.000003s : 12: predicate.value_based_eliminate 0.03% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.09% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001002 16 52.00% : 0.000521s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.60% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.40% : 0.000395s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032481 72 0.17% : 0.000057s : 1: add_recomputation 0.28% : 0.000090s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.20% : 0.000391s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000012s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000007s : 1: graph_reusing 30.91% : 0.010039s : 1: jit_opt_a 0.48% : 0.000156s : 1: jit_opt_after_cconv 0.22% : 0.000071s : 1: jit_opt_b 1.44% : 0.000467s : 1: loop_unroll 2.45% : 0.000796s : 1: mutable_eliminate 7.18% : 0.002332s : 26: opt.transform.jit_opt_a 0.16% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000037s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.11% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000040s : 4: opt.transform.symbol_engine_opt 9.11% : 0.002960s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000060s : 1: py_interpret_to_execute 0.22% : 0.000072s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.76% : 0.000570s : 1: renormalize.infer 1.41% : 0.000457s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000055s : 1: rewriter_after_opt_a 0.29% : 0.000094s : 1: rewriter_before_opt_a 0.30% : 0.000097s : 1: symbol_engine_optimizer 41.06% : 0.013337s : 1: type_inference TotalTime = 0.0243897, [30] [bootstrap]: 0.0003082 [type_inference]: 0.0108303 [event_method]: 2.603e-05 [auto_monad]: 7.672e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 5.462e-05 [rewriter_before_opt_a]: 9.355e-05 [expand_dump_flag]: 2.98998e-06 [jit_opt_a]: 0.0103852, [2] [Cycle 1]: 0.00601102, [27] [switch_simplify]: 7.052e-05 [loop_unroll]: 3.508e-05 [a_1]: 0.00073502 [with_stream_mark]: 2.32e-05 [recompute_prepare]: 8.30999e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.548e-05 [j_node_and_user_rematch]: 9.37999e-06 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00473525 [add_forward_monad_depend]: 8.00999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 2.245e-05 [cse]: 3.947e-05 [replace_applicator]: 2.329e-05 [Cycle 2]: 0.00036505, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00010399 [with_stream_mark]: 1.471e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.29997e-06 [cell_reuse_recompute_pass]: 3.95e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.68997e-06 [cse]: 1.431e-05 [replace_applicator]: 5.86998e-06 [py_interpret_to_execute_after_opt_a]: 1.622e-05 [rewriter_after_opt_a]: 4.285e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00081097 [jit_opt_b]: 5.623e-05, [1] [Cycle 1]: 4.632e-05, [2] [frontend_op_eliminate]: 1.826e-05 [inline_after_opt_a]: 1.572e-05 [cconv]: 2.941e-05 [loop_unroll]: 0.00047451 [jit_opt_after_cconv]: 0.00015944, [1] [Cycle 1]: 0.0001511, [11] [c_1]: 2.353e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 8.07998e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.722e-05 [call_graph_tuple_transform]: 2.108e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.45001e-06 [remove_dup_value]: 1.792e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 9.83002e-06 [add_recomputation]: 5.149e-05 [cse_after_recomputation]: 2.472e-05, [1] [Cycle 1]: 1.879e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.883e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.79e-06 [opt_after_jit_grad]: 0.00052192 [symbol_engine_optimizer]: 8.527e-05, [1] [Cycle 1]: 7.812e-05, [6] [build]: 1.132e-05 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 1.378e-05 [opt_reshape]: 5.96998e-06 [fold_const_symbol]: 9.56e-06 [renormalize]: 6.00005e-07 [validate]: 4.69e-05 Sums bootstrap : 0.000308s : 1.56% type_inference : 0.010830s : 54.96% event_method : 0.000026s : 0.13% auto_monad : 0.000077s : 0.39% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000055s : 0.28% rewriter_before_opt_a : 0.000094s : 0.47% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.39% jit_opt_a.loop_unroll : 0.000041s : 0.21% jit_opt_a.a_1 : 0.000839s : 4.26% jit_opt_a.with_stream_mark : 0.000038s : 0.19% jit_opt_a.recompute_prepare : 0.000014s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000013s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.09% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.004735s : 24.03% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.14% jit_opt_a.cse : 0.000054s : 0.27% jit_opt_a.replace_applicator : 0.000029s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.08% rewriter_after_opt_a : 0.000043s : 0.22% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000811s : 4.12% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.09% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000029s : 0.15% loop_unroll : 0.000475s : 2.41% jit_opt_after_cconv.c_1 : 0.000024s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000018s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.05% add_recomputation : 0.000051s : 0.26% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000019s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000522s : 2.65% symbol_engine_optimizer.build : 0.000011s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.24% Time group info: ------[substitution.] 0.000303 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.75% : 0.000005s : 3: substitution.graph_param_transform 86.53% : 0.000262s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000006s : 2: substitution.replace_old_param 5.29% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010740 2 87.61% : 0.009410s : 1: type_inference.infer 12.39% : 0.001331s : 1: type_inference.specialize ------[replace.] 0.000101 8 64.98% : 0.000066s : 5: replace.inline 35.02% : 0.000035s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 8 94.78% : 0.000259s : 5: match.inline 5.22% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 810 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.47% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.24% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000008s : 26: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.83% : 0.000003s : 6: predicate.less_batch_normalization 1.67% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000002s : 12: predicate.minmaximum_grad 1.92% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 2.07% : 0.000003s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000003s : 21: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.54% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.21% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.35% : 0.000011s : 64: predicate.switch_simplify 1.59% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.65% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.56% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001108 16 54.96% : 0.000609s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.78% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.26% : 0.000413s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030274 72 0.18% : 0.000054s : 1: add_recomputation 0.27% : 0.000081s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.09% : 0.000329s : 1: bootstrap 0.11% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000012s : 1: environ_conv 0.10% : 0.000031s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.06% : 0.000017s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 34.32% : 0.010390s : 1: jit_opt_a 0.54% : 0.000162s : 1: jit_opt_after_cconv 0.20% : 0.000059s : 1: jit_opt_b 1.60% : 0.000485s : 1: loop_unroll 2.72% : 0.000822s : 1: mutable_eliminate 3.62% : 0.001097s : 26: opt.transform.jit_opt_a 0.17% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000019s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.76% : 0.000532s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000058s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 1.85% : 0.000561s : 1: renormalize.infer 13.75% : 0.004162s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000046s : 1: rewriter_after_opt_a 0.32% : 0.000097s : 1: rewriter_before_opt_a 0.29% : 0.000088s : 1: symbol_engine_optimizer 35.85% : 0.010852s : 1: type_inference TotalTime = 0.314268, [30] [bootstrap]: 0.00043146 [type_inference]: 0.28947 [event_method]: 2.382e-05 [auto_monad]: 7.649e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00044378 [rewriter_before_opt_a]: 9.05e-05 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.0209262, [2] [Cycle 1]: 0.0145694, [27] [switch_simplify]: 6.386e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00062307 [with_stream_mark]: 2.337e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 4.37998e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 7.57998e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 4.17003e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.10002e-06 [renormalize]: 0.013377 [add_forward_monad_depend]: 1.51e-05 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 2.026e-05 [cse]: 3.377e-05 [replace_applicator]: 2.743e-05 [Cycle 2]: 0.00042113, [27] [switch_simplify]: 7.59002e-06 [loop_unroll]: 7.3e-06 [a_1]: 0.00013848 [with_stream_mark]: 1.738e-05 [recompute_prepare]: 6.88e-06 [updatestate_depend_eliminate]: 3.90998e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.83998e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.77002e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.91002e-06 [cell_reuse_recompute_pass]: 4.26001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.991e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.93e-06 [cse]: 1.414e-05 [replace_applicator]: 6.93e-06 [py_interpret_to_execute_after_opt_a]: 1.69e-05 [rewriter_after_opt_a]: 4.017e-05 [convert_after_rewriter]: 8.00999e-06 [order_py_execute_after_rewriter]: 5.48002e-06 [mutable_eliminate]: 0.00091235 [jit_opt_b]: 6.196e-05, [1] [Cycle 1]: 5.301e-05, [2] [frontend_op_eliminate]: 2.102e-05 [inline_after_opt_a]: 2.13e-05 [cconv]: 3.116e-05 [loop_unroll]: 0.00049705 [jit_opt_after_cconv]: 0.00017937, [1] [Cycle 1]: 0.00017239, [11] [c_1]: 2.669e-05 [parameter_eliminate]: 4.07e-06 [updatestate_depend_eliminate]: 6.79001e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.78998e-06 [cse]: 3.39e-05 [call_graph_tuple_transform]: 2.394e-05 [tuple_list_get_item_eliminator]: 7.15e-06 [none_parameter_eliminate]: 2.42001e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 9.16002e-06 [remove_dup_value]: 1.711e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 9.20001e-06 [add_recomputation]: 5.494e-05 [cse_after_recomputation]: 2.785e-05, [1] [Cycle 1]: 2.205e-05, [1] [cse]: 1.52e-05 [auto_monad_reorder]: 1.919e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 8.30999e-06 [opt_after_jit_grad]: 0.0005553 [symbol_engine_optimizer]: 8.298e-05, [1] [Cycle 1]: 7.687e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.492e-05 [opt_reshape]: 7.96001e-06 [fold_const_symbol]: 1.109e-05 [renormalize]: 5.90022e-07 [validate]: 5.635e-05 Sums bootstrap : 0.000431s : 0.14% type_inference : 0.289470s : 94.09% event_method : 0.000024s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000444s : 0.14% rewriter_before_opt_a : 0.000091s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000762s : 0.25% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.013377s : 4.35% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000048s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000912s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000497s : 0.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000555s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.02% Time group info: ------[substitution.] 0.000255 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 1.20% : 0.000003s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 4: substitution.graph_param_transform 83.90% : 0.000214s : 4: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 5.32% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.289368 2 98.93% : 0.286267s : 1: type_inference.infer 1.07% : 0.003101s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.89% : 0.000052s : 4: replace.inline 32.11% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.45% : 0.000212s : 4: match.inline 5.55% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.47% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 2.14% : 0.000003s : 12: predicate.arithmetic_simplify 1.64% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 0.93% : 0.000001s : 12: predicate.compare_switch_simplify 0.99% : 0.000001s : 12: predicate.depend_value_elim 1.29% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_depend_swap 1.52% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.43% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.43% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.56% : 0.000002s : 18: predicate.load_eliminater 0.95% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.46% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 0.97% : 0.000001s : 12: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000010s : 58: predicate.switch_simplify 1.54% : 0.000002s : 12: predicate.tile_eliminate 1.38% : 0.000002s : 12: predicate.transpose_eliminate 1.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.73% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.61% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002503 22 65.27% : 0.001633s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.60% : 0.000816s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.328744 72 0.02% : 0.000059s : 1: add_recomputation 0.02% : 0.000080s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.14% : 0.000454s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 6.37% : 0.020929s : 1: jit_opt_a 0.06% : 0.000182s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.15% : 0.000506s : 1: loop_unroll 0.28% : 0.000922s : 1: mutable_eliminate 0.31% : 0.001029s : 26: opt.transform.jit_opt_a 0.02% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000566s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000451s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 3.79% : 0.012456s : 1: renormalize.infer 0.28% : 0.000907s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000096s : 1: rewriter_before_opt_a 0.03% : 0.000085s : 1: symbol_engine_optimizer 88.06% : 0.289494s : 1: type_inference TotalTime = 0.0194721, [30] [bootstrap]: 0.00031243 [type_inference]: 0.00876239 [event_method]: 2.216e-05 [auto_monad]: 7.126e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 5.892e-05 [rewriter_before_opt_a]: 0.00012488 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00737613, [2] [Cycle 1]: 0.00295905, [27] [switch_simplify]: 6.609e-05 [loop_unroll]: 3.024e-05 [a_1]: 0.00057082 [with_stream_mark]: 1.616e-05 [recompute_prepare]: 1.039e-05 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.56999e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 5.46998e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 4.57998e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.51e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.00188435 [add_forward_monad_depend]: 8.31002e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 2.071e-05 [cse]: 3.462e-05 [replace_applicator]: 2.439e-05 [Cycle 2]: 0.00037004, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 4.79e-06 [a_1]: 0.00010141 [with_stream_mark]: 1.29e-05 [recompute_prepare]: 6.54001e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.01002e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 4.08999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.894e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 4.74998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.12999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.408e-05 [replace_applicator]: 6.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.382e-05 [rewriter_after_opt_a]: 3.842e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00084318 [jit_opt_b]: 6.008e-05, [1] [Cycle 1]: 5.024e-05, [2] [frontend_op_eliminate]: 1.851e-05 [inline_after_opt_a]: 1.922e-05 [cconv]: 3.337e-05 [loop_unroll]: 0.00046967 [jit_opt_after_cconv]: 0.00017338, [1] [Cycle 1]: 0.00016581, [11] [c_1]: 2.161e-05 [parameter_eliminate]: 4.88001e-06 [updatestate_depend_eliminate]: 9.47001e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.03998e-06 [cse]: 3.7e-05 [call_graph_tuple_transform]: 2.26e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 2.10002e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.671e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 6.53e-06 [add_recomputation]: 5.957e-05 [cse_after_recomputation]: 6.376e-05, [1] [Cycle 1]: 5.777e-05, [1] [cse]: 4.952e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 2.94999e-06 [rewriter_after_jit_bprop_graph]: 9.97001e-06 [opt_after_jit_grad]: 0.00056008 [symbol_engine_optimizer]: 8.643e-05, [1] [Cycle 1]: 7.865e-05, [6] [build]: 5.86e-06 [elim_shapecalc]: 1.001e-05 [elim_not_effective]: 1.573e-05 [opt_reshape]: 6.97002e-06 [fold_const_symbol]: 1.022e-05 [renormalize]: 8.00006e-07 [validate]: 4.914e-05 Sums bootstrap : 0.000312s : 2.12% type_inference : 0.008762s : 59.36% event_method : 0.000022s : 0.15% auto_monad : 0.000071s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000059s : 0.40% rewriter_before_opt_a : 0.000125s : 0.85% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.49% jit_opt_a.loop_unroll : 0.000035s : 0.24% jit_opt_a.a_1 : 0.000672s : 4.55% jit_opt_a.with_stream_mark : 0.000029s : 0.20% jit_opt_a.recompute_prepare : 0.000017s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.001884s : 12.77% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.18% jit_opt_a.cse : 0.000049s : 0.33% jit_opt_a.replace_applicator : 0.000031s : 0.21% py_interpret_to_execute_after_opt_a : 0.000014s : 0.09% rewriter_after_opt_a : 0.000038s : 0.26% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000843s : 5.71% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.13% jit_opt_b.inline_after_opt_a : 0.000019s : 0.13% cconv : 0.000033s : 0.23% loop_unroll : 0.000470s : 3.18% jit_opt_after_cconv.c_1 : 0.000022s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000037s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000060s : 0.40% cse_after_recomputation.cse : 0.000050s : 0.34% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000010s : 0.07% opt_after_jit_grad : 0.000560s : 3.79% symbol_engine_optimizer.build : 0.000006s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000049s : 0.33% TotalTime = 0.0951057, [30] [bootstrap]: 0.00038736 [type_inference]: 0.0523469 [event_method]: 1.958e-05 [auto_monad]: 7.078e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00014245 [rewriter_before_opt_a]: 0.00015245 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.0386751, [2] [Cycle 1]: 0.0337125, [27] [switch_simplify]: 0.00012301 [loop_unroll]: 3.301e-05 [a_1]: 0.00065045 [with_stream_mark]: 2.353e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 6.33998e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 3.28e-06 [get_grad_eliminate_]: 5.98002e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.744e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00148515 [add_forward_monad_depend]: 7.88999e-06 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 1.903e-05 [cse]: 3.409e-05 [replace_applicator]: 0.0309786 [Cycle 2]: 0.00055338, [27] [switch_simplify]: 3.509e-05 [loop_unroll]: 8.3e-06 [a_1]: 0.00013299 [with_stream_mark]: 3.143e-05 [recompute_prepare]: 7.00998e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.10002e-06 [specialize_transform]: 5.59998e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 8.80999e-06 [meta_shard_fg_expand]: 4.1e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 5.27999e-06 [cell_reuse_recompute_pass]: 2.73003e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.556e-05 [j_node_and_user_rematch]: 1.118e-05 [meta_fg_expand]: 4.33001e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 5.63002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 5.64998e-06 [auto_monad_grad]: 3.26999e-06 [auto_monad_eliminator]: 2.02e-05 [cse]: 4.665e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 2.276e-05 [rewriter_after_opt_a]: 4.702e-05 [convert_after_rewriter]: 7.74002e-06 [order_py_execute_after_rewriter]: 5.43002e-06 [mutable_eliminate]: 0.00102365 [jit_opt_b]: 7.114e-05, [1] [Cycle 1]: 6.011e-05, [2] [frontend_op_eliminate]: 2.336e-05 [inline_after_opt_a]: 2.259e-05 [cconv]: 3.873e-05 [loop_unroll]: 0.00068169 [jit_opt_after_cconv]: 0.00021777, [1] [Cycle 1]: 0.00020907, [11] [c_1]: 2.687e-05 [parameter_eliminate]: 7.68999e-06 [updatestate_depend_eliminate]: 1.245e-05 [updatestate_assign_eliminate]: 4.22998e-06 [updatestate_loads_eliminate]: 5.72001e-06 [cse]: 4.936e-05 [call_graph_tuple_transform]: 2.801e-05 [tuple_list_get_item_eliminator]: 8.32e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 9.70002e-07 [switch_simplify]: 6.56e-06 [remove_dup_value]: 1.857e-05 [partial_unused_args_eliminate]: 2.84001e-06 [environ_conv]: 8.64e-06 [add_recomputation]: 6.367e-05 [cse_after_recomputation]: 2.899e-05, [1] [Cycle 1]: 2.289e-05, [1] [cse]: 1.466e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 3.13e-06 [rewriter_after_jit_bprop_graph]: 1.24e-05 [opt_after_jit_grad]: 0.00058885 [symbol_engine_optimizer]: 0.00015347, [1] [Cycle 1]: 0.00014492, [6] [build]: 5.68997e-06 [elim_shapecalc]: 1.072e-05 [elim_not_effective]: 1.691e-05 [opt_reshape]: 6.43e-06 [fold_const_symbol]: 7.478e-05 [renormalize]: 9.09989e-07 [validate]: 5.54e-05 Sums bootstrap : 0.000387s : 0.43% type_inference : 0.052347s : 58.21% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000142s : 0.16% rewriter_before_opt_a : 0.000152s : 0.17% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000158s : 0.18% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000783s : 0.87% jit_opt_a.with_stream_mark : 0.000055s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001485s : 1.65% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.04% jit_opt_a.cse : 0.000081s : 0.09% jit_opt_a.replace_applicator : 0.030985s : 34.46% py_interpret_to_execute_after_opt_a : 0.000023s : 0.03% rewriter_after_opt_a : 0.000047s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001024s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.03% jit_opt_b.inline_after_opt_a : 0.000023s : 0.03% cconv : 0.000039s : 0.04% loop_unroll : 0.000682s : 0.76% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.cse : 0.000049s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000064s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000589s : 0.65% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000075s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.06% Time group info: ------[substitution.] 0.000278 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.46% : 0.000007s : 3: substitution.graph_param_transform 83.87% : 0.000234s : 4: substitution.inline 1.95% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000006s : 4: substitution.remove_not_recompute_node 2.69% : 0.000007s : 2: substitution.replace_old_param 5.10% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052263 2 95.86% : 0.050097s : 1: type_inference.infer 4.14% : 0.002166s : 1: type_inference.specialize ------[replace.] 0.000084 6 68.46% : 0.000057s : 4: replace.inline 31.54% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 94.74% : 0.000231s : 4: match.inline 5.26% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 1.47% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.84% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000003s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 0.81% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.16% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.82% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_depend_swap 0.91% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.30% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000009s : 22: predicate.inline 0.61% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.56% : 0.000003s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000003s : 15: predicate.load_eliminater 2.19% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000007s : 34: predicate.loop_unroll_before_grad 2.65% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 10: predicate.merge_addn 0.82% : 0.000001s : 10: predicate.minmaximum_grad 2.79% : 0.000005s : 3: predicate.mutable_eliminate 0.34% : 0.000001s : 3: predicate.opt_reshape 1.60% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 1.77% : 0.000003s : 10: predicate.reduce_eliminate 1.75% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000001s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.20% : 0.000002s : 3: predicate.row_tensor_eliminate 0.85% : 0.000001s : 10: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 6: predicate.special_op_eliminate 0.69% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.99% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000004s : 16: predicate.switch_layer_defer_inline 8.95% : 0.000015s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000003s : 10: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.94% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001085 13 40.47% : 0.000439s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.23% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.30% : 0.000589s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128764 72 0.05% : 0.000067s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.32% : 0.000408s : 1: bootstrap 0.03% : 0.000042s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 30.04% : 0.038680s : 1: jit_opt_a 0.17% : 0.000223s : 1: jit_opt_after_cconv 0.06% : 0.000074s : 1: jit_opt_b 0.54% : 0.000694s : 1: loop_unroll 0.81% : 0.001042s : 1: mutable_eliminate 24.87% : 0.032028s : 26: opt.transform.jit_opt_a 0.05% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000037s : 4: opt.transform.jit_opt_b 0.02% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000030s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000104s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000600s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000146s : 1: py_interpret_to_execute 0.02% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.69% : 0.000887s : 1: renormalize.infer 0.46% : 0.000589s : 1: renormalize.specialize 0.01% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.12% : 0.000158s : 1: rewriter_before_opt_a 0.12% : 0.000156s : 1: symbol_engine_optimizer 40.67% : 0.052363s : 1: type_inference Time group info: ------[substitution.] 0.000224 23 1.13% : 0.000003s : 2: substitution.elim_not_effective 0.92% : 0.000002s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 3: substitution.graph_param_transform 81.88% : 0.000184s : 4: substitution.inline 1.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000006s : 4: substitution.remove_not_recompute_node 2.78% : 0.000006s : 2: substitution.replace_old_param 6.12% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008673 2 51.47% : 0.004464s : 1: type_inference.infer 48.53% : 0.004209s : 1: type_inference.specialize ------[replace.] 0.000079 6 65.34% : 0.000052s : 4: replace.inline 34.66% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 93.69% : 0.000181s : 4: match.inline 6.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.48% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.65% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.20% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000002s : 10: predicate.print_const_string_wrapper 1.47% : 0.000002s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.64% : 0.000001s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.59% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.50% : 0.000002s : 10: predicate.same_eliminate 0.75% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000010s : 53: predicate.switch_simplify 1.21% : 0.000002s : 10: predicate.tile_eliminate 1.06% : 0.000001s : 10: predicate.transpose_eliminate 1.75% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.91% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000895 13 44.42% : 0.000397s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.63% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.95% : 0.000465s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022336 72 0.28% : 0.000063s : 1: add_recomputation 0.34% : 0.000075s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.50% : 0.000335s : 1: bootstrap 0.16% : 0.000036s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.29% : 0.000066s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 33.04% : 0.007381s : 1: jit_opt_a 0.79% : 0.000176s : 1: jit_opt_after_cconv 0.28% : 0.000063s : 1: jit_opt_b 2.14% : 0.000479s : 1: loop_unroll 3.82% : 0.000854s : 1: mutable_eliminate 4.13% : 0.000924s : 26: opt.transform.jit_opt_a 0.23% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000029s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000021s : 1: opt.transform.mutable_eliminate 0.13% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.57% : 0.000575s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000062s : 1: py_interpret_to_execute 0.07% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000019s : 1: remove_dup_value 6.01% : 0.001343s : 1: renormalize.infer 2.37% : 0.000529s : 1: renormalize.specialize 0.05% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000041s : 1: rewriter_after_opt_a 0.58% : 0.000129s : 1: rewriter_before_opt_a 0.40% : 0.000090s : 1: symbol_engine_optimizer 39.32% : 0.008783s : 1: type_inference TotalTime = 0.0186537, [30] [bootstrap]: 0.00030546 [type_inference]: 0.00555098 [event_method]: 2.222e-05 [auto_monad]: 6.966e-05 [graph_reusing]: 5.75001e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 4.834e-05 [rewriter_before_opt_a]: 8.248e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.00990687, [2] [Cycle 1]: 0.00217849, [27] [switch_simplify]: 6.417e-05 [loop_unroll]: 3.736e-05 [a_1]: 0.00079136 [with_stream_mark]: 2.056e-05 [recompute_prepare]: 8.52e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 4.325e-05 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 9.04e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00088138 [add_forward_monad_depend]: 6.98e-06 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 1.498e-05 [cse]: 2.54e-05 [replace_applicator]: 1.492e-05 [Cycle 2]: 0.00033514, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.36002e-06 [a_1]: 9.516e-05 [with_stream_mark]: 1.088e-05 [recompute_prepare]: 4.76002e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.14003e-06 [specialize_transform]: 4.68999e-06 [updatestate_useless_node_eliminater]: 4.56002e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 7.88999e-06 [meta_fg_expand]: 1.66998e-06 [replace_old_param]: 7.13998e-06 [inline_without_move]: 4.4e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 1.53002e-06 [auto_monad_eliminator]: 5.59998e-06 [cse]: 1.109e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.137e-05 [rewriter_after_opt_a]: 3.535e-05 [convert_after_rewriter]: 6.65002e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00074229 [jit_opt_b]: 5.716e-05, [1] [Cycle 1]: 4.716e-05, [2] [frontend_op_eliminate]: 1.803e-05 [inline_after_opt_a]: 1.678e-05 [cconv]: 3.415e-05 [loop_unroll]: 0.00052829 [jit_opt_after_cconv]: 0.00016905, [1] [Cycle 1]: 0.0001597, [11] [c_1]: 2.261e-05 [parameter_eliminate]: 4.48999e-06 [updatestate_depend_eliminate]: 6.51e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 2.704e-05 [call_graph_tuple_transform]: 2.086e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 2.11e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.94001e-06 [environ_conv]: 6.66999e-06 [add_recomputation]: 5.432e-05 [cse_after_recomputation]: 2.167e-05, [1] [Cycle 1]: 1.524e-05, [1] [cse]: 9.22001e-06 [auto_monad_reorder]: 1.518e-05 [get_jit_bprop_graph]: 3.02002e-06 [rewriter_after_jit_bprop_graph]: 8.72e-06 [opt_after_jit_grad]: 0.00058138 [symbol_engine_optimizer]: 7.963e-05, [1] [Cycle 1]: 7.146e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.551e-05 [opt_reshape]: 5.60001e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 5.69999e-07 [validate]: 8.46e-05 Sums bootstrap : 0.000305s : 2.88% type_inference : 0.005551s : 52.26% event_method : 0.000022s : 0.21% auto_monad : 0.000070s : 0.66% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000048s : 0.46% rewriter_before_opt_a : 0.000082s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.66% jit_opt_a.loop_unroll : 0.000043s : 0.40% jit_opt_a.a_1 : 0.000887s : 8.35% jit_opt_a.with_stream_mark : 0.000031s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000048s : 0.45% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000881s : 8.30% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.19% jit_opt_a.cse : 0.000036s : 0.34% jit_opt_a.replace_applicator : 0.000020s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000035s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000742s : 6.99% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000034s : 0.32% loop_unroll : 0.000528s : 4.97% jit_opt_after_cconv.c_1 : 0.000023s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000015s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000054s : 0.51% cse_after_recomputation.cse : 0.000009s : 0.09% auto_monad_reorder : 0.000015s : 0.14% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000009s : 0.08% opt_after_jit_grad : 0.000581s : 5.47% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000085s : 0.80% Time group info: ------[substitution.] 0.000316 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000006s : 3: substitution.graph_param_transform 88.38% : 0.000279s : 5: substitution.inline 1.23% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.42% : 0.000004s : 4: substitution.remove_not_recompute_node 1.42% : 0.000004s : 2: substitution.replace_old_param 4.60% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005475 2 81.28% : 0.004450s : 1: type_inference.infer 18.72% : 0.001025s : 1: type_inference.specialize ------[replace.] 0.000117 8 63.92% : 0.000075s : 5: replace.inline 36.08% : 0.000042s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 8 95.49% : 0.000276s : 5: match.inline 4.51% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 810 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.16% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000002s : 12: predicate.compare_switch_simplify 1.39% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.65% : 0.000003s : 12: predicate.environ_get_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000001s : 3: predicate.graph_param_transform 5.27% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.78% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 18: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000002s : 12: predicate.minmaximum_grad 1.85% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 2.20% : 0.000003s : 12: predicate.reduce_eliminate 1.65% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000003s : 21: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000001s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.12% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.15% : 0.000002s : 3: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000002s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.20% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.29% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.70% : 0.000012s : 64: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.36% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000817 16 49.24% : 0.000402s : 7: func_graph_cloner_run.FuncGraphClonerGraph 11.52% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.24% : 0.000320s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020712 72 0.28% : 0.000057s : 1: add_recomputation 0.36% : 0.000074s : 1: auto_monad 0.09% : 0.000018s : 1: auto_monad_reorder 1.56% : 0.000324s : 1: bootstrap 0.18% : 0.000037s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 47.85% : 0.009911s : 1: jit_opt_a 0.83% : 0.000172s : 1: jit_opt_after_cconv 0.29% : 0.000061s : 1: jit_opt_b 2.60% : 0.000539s : 1: loop_unroll 3.64% : 0.000754s : 1: mutable_eliminate 5.59% : 0.001158s : 26: opt.transform.jit_opt_a 0.25% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000018s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.86% : 0.000593s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000051s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.44% : 0.000506s : 1: renormalize.infer 1.77% : 0.000367s : 1: renormalize.specialize 0.05% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000038s : 1: rewriter_after_opt_a 0.41% : 0.000085s : 1: rewriter_before_opt_a 0.40% : 0.000083s : 1: symbol_engine_optimizer 26.87% : 0.005565s : 1: type_inference TotalTime = 0.0268861, [30] [bootstrap]: 0.00030935 [type_inference]: 0.00490236 [event_method]: 1.763e-05 [auto_monad]: 4.983e-05 [graph_reusing]: 4.48999e-06 [pre_auto_parallel]: 1.97999e-06 [py_interpret_to_execute]: 3.913e-05 [rewriter_before_opt_a]: 6.847e-05 [expand_dump_flag]: 1.94999e-06 [jit_opt_a]: 0.0190309, [2] [Cycle 1]: 0.0152315, [27] [switch_simplify]: 5.417e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.0139003 [with_stream_mark]: 3.483e-05 [recompute_prepare]: 1.504e-05 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 6.97002e-06 [meta_shard_fg_expand]: 3.60998e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 3.43999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.131e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 3.01999e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 5.44e-06 [renormalize]: 0.00081586 [add_forward_monad_depend]: 6.96999e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.56e-05 [cse]: 3.298e-05 [replace_applicator]: 1.412e-05 [Cycle 2]: 0.00033387, [27] [switch_simplify]: 6.14001e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.209e-05 [with_stream_mark]: 1.082e-05 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 4.89003e-06 [updatestate_useless_node_eliminater]: 4.76002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 4.45e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 2.07001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.61999e-06 [cse]: 1.426e-05 [replace_applicator]: 5.00999e-06 [py_interpret_to_execute_after_opt_a]: 1.506e-05 [rewriter_after_opt_a]: 3.793e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.0007684 [jit_opt_b]: 5.137e-05, [1] [Cycle 1]: 4.322e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.635e-05 [cconv]: 2.635e-05 [loop_unroll]: 0.00049027 [jit_opt_after_cconv]: 0.00015747, [1] [Cycle 1]: 0.00015022, [11] [c_1]: 2.263e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.041e-05 [call_graph_tuple_transform]: 1.955e-05 [tuple_list_get_item_eliminator]: 5.12e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.688e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.42001e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.498e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.89e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.54998e-06 [opt_after_jit_grad]: 0.00048344 [symbol_engine_optimizer]: 7.431e-05, [1] [Cycle 1]: 6.742e-05, [6] [build]: 4.28001e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 5.73002e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 3.89991e-07 [validate]: 4.367e-05 Sums bootstrap : 0.000309s : 1.36% type_inference : 0.004902s : 21.50% event_method : 0.000018s : 0.08% auto_monad : 0.000050s : 0.22% graph_reusing : 0.000004s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000039s : 0.17% rewriter_before_opt_a : 0.000068s : 0.30% expand_dump_flag : 0.000002s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.16% jit_opt_a.a_1 : 0.013992s : 61.36% jit_opt_a.with_stream_mark : 0.000046s : 0.20% jit_opt_a.recompute_prepare : 0.000021s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000816s : 3.58% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.10% jit_opt_a.cse : 0.000047s : 0.21% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.07% rewriter_after_opt_a : 0.000038s : 0.17% convert_after_rewriter : 0.000006s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000768s : 3.37% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000026s : 0.12% loop_unroll : 0.000490s : 2.15% jit_opt_after_cconv.c_1 : 0.000023s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000051s : 0.22% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000483s : 2.12% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.19% Time group info: ------[substitution.] 0.000259 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 3: substitution.graph_param_transform 85.24% : 0.000221s : 4: substitution.inline 1.80% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.01% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004839 2 81.94% : 0.003965s : 1: type_inference.infer 18.06% : 0.000874s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.99% : 0.000053s : 4: replace.inline 32.01% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.82% : 0.000219s : 4: match.inline 5.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.013395 691 0.01% : 0.000001s : 10: predicate.accumulaten_eliminater 0.01% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.01% : 0.000001s : 10: predicate.addn_check_dump 0.02% : 0.000002s : 10: predicate.addn_zero_filter 0.02% : 0.000003s : 10: predicate.arithmetic_simplify 0.01% : 0.000002s : 10: predicate.cast_eliminate 0.00% : 0.000000s : 3: predicate.check_bprop_eliminate 0.01% : 0.000001s : 10: predicate.compare_switch_simplify 99.06% : 0.013269s : 10: predicate.depend_value_elim 0.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.01% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.00% : 0.000000s : 3: predicate.elim_not_effective 0.00% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.01% : 0.000001s : 10: predicate.environ_get_depend_swap 0.01% : 0.000001s : 10: predicate.environ_get_eliminate 0.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 3: predicate.fold_const_symbol 0.01% : 0.000002s : 6: predicate.get_grad_eliminate 0.00% : 0.000000s : 3: predicate.graph_param_transform 0.05% : 0.000006s : 22: predicate.inline 0.01% : 0.000001s : 6: predicate.inline_without_move 0.00% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.02% : 0.000002s : 6: predicate.less_batch_normalization 0.01% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.02% : 0.000003s : 15: predicate.load_eliminater 0.02% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.02% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.01% : 0.000001s : 10: predicate.merge_addn 0.01% : 0.000001s : 10: predicate.minmaximum_grad 0.02% : 0.000002s : 3: predicate.mutable_eliminate 0.00% : 0.000001s : 3: predicate.opt_reshape 0.02% : 0.000003s : 15: predicate.partial_eliminate 0.01% : 0.000002s : 10: predicate.print_const_string_wrapper 0.02% : 0.000002s : 10: predicate.reduce_eliminate 0.01% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.01% : 0.000001s : 6: predicate.remove_not_recompute_node 0.02% : 0.000002s : 18: predicate.replace_applicator 0.01% : 0.000001s : 6: predicate.replace_old_param 0.00% : 0.000000s : 3: predicate.reset_defer_inline 0.01% : 0.000002s : 10: predicate.reshape_eliminate 0.01% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.01% : 0.000001s : 3: predicate.row_tensor_eliminate 0.03% : 0.000004s : 10: predicate.same_eliminate 0.01% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.01% : 0.000001s : 6: predicate.special_op_eliminate 0.01% : 0.000001s : 6: predicate.specialize_transform 0.02% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 0.01% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.00% : 0.000000s : 3: predicate.switch_call_monad_eliminater 0.02% : 0.000003s : 16: predicate.switch_defer_inline 0.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 0.07% : 0.000009s : 53: predicate.switch_simplify 0.01% : 0.000001s : 10: predicate.tile_eliminate 0.01% : 0.000001s : 10: predicate.transpose_eliminate 0.01% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.01% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 0.03% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 0.01% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.01% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.02% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.03% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 0.02% : 0.000003s : 10: predicate.value_based_eliminate 0.00% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.01% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000682 13 47.16% : 0.000321s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.08% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.77% : 0.000305s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041984 72 0.13% : 0.000054s : 1: add_recomputation 0.13% : 0.000053s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.78% : 0.000327s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000021s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000007s : 1: graph_reusing 45.34% : 0.019034s : 1: jit_opt_a 0.38% : 0.000161s : 1: jit_opt_after_cconv 0.13% : 0.000054s : 1: jit_opt_b 1.19% : 0.000501s : 1: loop_unroll 1.85% : 0.000779s : 1: mutable_eliminate 33.88% : 0.014224s : 26: opt.transform.jit_opt_a 0.12% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.17% : 0.000492s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000042s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.04% : 0.000438s : 1: renormalize.infer 0.88% : 0.000369s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000041s : 1: rewriter_after_opt_a 0.17% : 0.000071s : 1: rewriter_before_opt_a 0.18% : 0.000077s : 1: symbol_engine_optimizer 11.71% : 0.004917s : 1: type_inference TotalTime = 0.232221, [30] [bootstrap]: 0.00031448 [type_inference]: 0.198575 [event_method]: 2.636e-05 [auto_monad]: 8.186e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.99999e-06 [py_interpret_to_execute]: 0.00046381 [rewriter_before_opt_a]: 0.00010984 [expand_dump_flag]: 4.72998e-06 [jit_opt_a]: 0.0301888, [2] [Cycle 1]: 0.0258452, [27] [switch_simplify]: 7.477e-05 [loop_unroll]: 3.559e-05 [a_1]: 0.022114 [with_stream_mark]: 3.517e-05 [recompute_prepare]: 1.399e-05 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 7.95e-06 [updatestate_useless_node_eliminater]: 7.47998e-06 [accelerated_algorithm]: 7.68001e-06 [meta_shard_fg_expand]: 3.68e-06 [get_grad_eliminate_]: 7.21999e-06 [merge_forward]: 5.10001e-06 [cell_reuse_recompute_pass]: 3.01999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.763e-05 [j_node_and_user_rematch]: 1.182e-05 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.358e-05 [inline_without_move]: 7.26999e-06 [renormalize]: 0.00312117 [add_forward_monad_depend]: 9.67999e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 2.293e-05 [cse]: 3.944e-05 [replace_applicator]: 2.425e-05 [Cycle 2]: 0.00040289, [27] [switch_simplify]: 7.92e-06 [loop_unroll]: 6.49001e-06 [a_1]: 0.00012882 [with_stream_mark]: 1.635e-05 [recompute_prepare]: 6.75002e-06 [updatestate_depend_eliminate]: 4.29002e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 2.76999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.929e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.58e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.592e-05 [replace_applicator]: 6.24999e-06 [py_interpret_to_execute_after_opt_a]: 1.56e-05 [rewriter_after_opt_a]: 4.135e-05 [convert_after_rewriter]: 7.59002e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.0007332 [jit_opt_b]: 6.1e-05, [1] [Cycle 1]: 5.244e-05, [2] [frontend_op_eliminate]: 2.05e-05 [inline_after_opt_a]: 2.052e-05 [cconv]: 2.949e-05 [loop_unroll]: 0.00043588 [jit_opt_after_cconv]: 0.00017255, [1] [Cycle 1]: 0.00016526, [11] [c_1]: 2.657e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 7.95998e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 3.133e-05 [call_graph_tuple_transform]: 2.396e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 7.15e-06 [remove_dup_value]: 1.867e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 9.78998e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.64e-05, [1] [Cycle 1]: 2.065e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.76e-06 [opt_after_jit_grad]: 0.00046737 [symbol_engine_optimizer]: 8.139e-05, [1] [Cycle 1]: 7.465e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 8.55001e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 7.46001e-06 [fold_const_symbol]: 1.145e-05 [renormalize]: 3.59985e-07 [validate]: 4.676e-05 Sums bootstrap : 0.000314s : 0.14% type_inference : 0.198575s : 87.25% event_method : 0.000026s : 0.01% auto_monad : 0.000082s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000464s : 0.20% rewriter_before_opt_a : 0.000110s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.022243s : 9.77% jit_opt_a.with_stream_mark : 0.000052s : 0.02% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003121s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000055s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000733s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000436s : 0.19% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000051s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000467s : 0.21% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.02% Time group info: ------[substitution.] 0.021491 25 0.01% : 0.000002s : 2: substitution.elim_not_effective 0.02% : 0.000003s : 2: substitution.fold_const_symbol 0.03% : 0.000007s : 4: substitution.graph_param_transform 99.76% : 0.021440s : 5: substitution.inline 0.03% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.03% : 0.000006s : 4: substitution.remove_not_recompute_node 0.04% : 0.000008s : 2: substitution.replace_old_param 0.09% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.198469 2 98.42% : 0.195326s : 1: type_inference.infer 1.58% : 0.003143s : 1: type_inference.specialize ------[replace.] 0.000201 7 70.90% : 0.000143s : 5: replace.inline 29.10% : 0.000059s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.021451 7 99.93% : 0.021435s : 5: match.inline 0.07% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000003s : 13: predicate.addn_zero_filter 2.28% : 0.000004s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.53% : 0.000003s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000002s : 8: predicate.get_grad_eliminate 0.58% : 0.000001s : 4: predicate.graph_param_transform 7.11% : 0.000012s : 28: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.76% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000004s : 19: predicate.partial_eliminate 1.07% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000004s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.77% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.68% : 0.000006s : 20: predicate.switch_defer_inline 2.25% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.53% : 0.000011s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 2.24% : 0.000004s : 13: predicate.tuple_list_set_item_eliminator 1.76% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.44% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.023649 25 6.61% : 0.001564s : 16: func_graph_cloner_run.FuncGraphClonerGraph 89.76% : 0.021228s : 2: func_graph_cloner_run.FuncGraphClonerNode 3.63% : 0.000857s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.257950 72 0.02% : 0.000054s : 1: add_recomputation 0.03% : 0.000086s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.13% : 0.000346s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 11.70% : 0.030192s : 1: jit_opt_a 0.07% : 0.000175s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.17% : 0.000444s : 1: loop_unroll 0.29% : 0.000743s : 1: mutable_eliminate 8.74% : 0.022532s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000477s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000472s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.86% : 0.002208s : 1: renormalize.infer 0.35% : 0.000898s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.05% : 0.000117s : 1: rewriter_before_opt_a 0.03% : 0.000084s : 1: symbol_engine_optimizer 76.99% : 0.198600s : 1: type_inference TotalTime = 0.0294194, [30] [bootstrap]: 0.00027777 [type_inference]: 0.00479677 [event_method]: 2.162e-05 [auto_monad]: 6.883e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 3.868e-05 [rewriter_before_opt_a]: 8.209e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.0213018, [2] [Cycle 1]: 0.00234638, [27] [switch_simplify]: 8.311e-05 [loop_unroll]: 3.536e-05 [a_1]: 0.0008394 [with_stream_mark]: 2.592e-05 [recompute_prepare]: 9.92001e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 6.23998e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.778e-05 [j_node_and_user_rematch]: 1.192e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 5.46002e-06 [renormalize]: 0.00094904 [add_forward_monad_depend]: 9.02999e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.852e-05 [cse]: 3.131e-05 [replace_applicator]: 2.154e-05 [Cycle 2]: 0.0003692, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.836e-05 [with_stream_mark]: 1.427e-05 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 4.70001e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.77998e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 3.83001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.779e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.53001e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.83998e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 7.49002e-06 [cse]: 1.472e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 1.554e-05 [rewriter_after_opt_a]: 4.228e-05 [convert_after_rewriter]: 8.2e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00089908 [jit_opt_b]: 6.423e-05, [1] [Cycle 1]: 5.493e-05, [2] [frontend_op_eliminate]: 2.262e-05 [inline_after_opt_a]: 1.81e-05 [cconv]: 3.716e-05 [loop_unroll]: 0.0005241 [jit_opt_after_cconv]: 0.0001621, [1] [Cycle 1]: 0.00015469, [11] [c_1]: 2.038e-05 [parameter_eliminate]: 5.39e-06 [updatestate_depend_eliminate]: 6.71999e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 2.70002e-06 [cse]: 2.709e-05 [call_graph_tuple_transform]: 2.395e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 2.41998e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.49e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 9.471e-05 [cse_after_recomputation]: 2.416e-05, [1] [Cycle 1]: 1.739e-05, [1] [cse]: 1.084e-05 [auto_monad_reorder]: 1.502e-05 [get_jit_bprop_graph]: 2.84999e-06 [rewriter_after_jit_bprop_graph]: 6.81999e-06 [opt_after_jit_grad]: 0.00059175 [symbol_engine_optimizer]: 7.825e-05, [1] [Cycle 1]: 7.135e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 1.466e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 8.43001e-06 [renormalize]: 9.39996e-07 [validate]: 4.103e-05 Sums bootstrap : 0.000278s : 2.73% type_inference : 0.004797s : 47.19% event_method : 0.000022s : 0.21% auto_monad : 0.000069s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.38% rewriter_before_opt_a : 0.000082s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000090s : 0.88% jit_opt_a.loop_unroll : 0.000040s : 0.40% jit_opt_a.a_1 : 0.000938s : 9.23% jit_opt_a.with_stream_mark : 0.000040s : 0.40% jit_opt_a.recompute_prepare : 0.000015s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.35% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000949s : 9.34% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.12% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.26% jit_opt_a.cse : 0.000046s : 0.45% jit_opt_a.replace_applicator : 0.000027s : 0.27% py_interpret_to_execute_after_opt_a : 0.000016s : 0.15% rewriter_after_opt_a : 0.000042s : 0.42% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000899s : 8.85% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.22% jit_opt_b.inline_after_opt_a : 0.000018s : 0.18% cconv : 0.000037s : 0.37% loop_unroll : 0.000524s : 5.16% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000027s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000095s : 0.93% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000592s : 5.82% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.40% Time group info: ------[substitution.] 0.000358 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.82% : 0.000007s : 3: substitution.graph_param_transform 86.68% : 0.000311s : 5: substitution.inline 1.93% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.59% : 0.000006s : 4: substitution.remove_not_recompute_node 1.75% : 0.000006s : 2: substitution.replace_old_param 5.20% : 0.000019s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004738 2 80.21% : 0.003800s : 1: type_inference.infer 19.79% : 0.000938s : 1: type_inference.specialize ------[replace.] 0.000123 8 65.26% : 0.000080s : 5: replace.inline 34.74% : 0.000043s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000325 8 94.77% : 0.000308s : 5: match.inline 5.23% : 0.000017s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 810 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 2.53% : 0.000004s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000002s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.85% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.41% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.39% : 0.000002s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.59% : 0.000009s : 26: predicate.inline 0.63% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.90% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000002s : 12: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.02% : 0.000002s : 12: predicate.print_const_string_wrapper 2.18% : 0.000003s : 12: predicate.reduce_eliminate 1.61% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.37% : 0.000001s : 6: predicate.remove_not_recompute_node 1.53% : 0.000002s : 21: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000002s : 12: predicate.same_eliminate 0.38% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.66% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.69% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.30% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000011s : 64: predicate.switch_simplify 1.70% : 0.000003s : 12: predicate.tile_eliminate 1.81% : 0.000003s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.76% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.31% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.97% : 0.000003s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000764 16 46.73% : 0.000357s : 7: func_graph_cloner_run.FuncGraphClonerGraph 14.66% : 0.000112s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.61% : 0.000295s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031642 72 0.31% : 0.000098s : 1: add_recomputation 0.23% : 0.000072s : 1: auto_monad 0.06% : 0.000018s : 1: auto_monad_reorder 0.91% : 0.000289s : 1: bootstrap 0.13% : 0.000040s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 67.34% : 0.021306s : 1: jit_opt_a 0.52% : 0.000165s : 1: jit_opt_after_cconv 0.21% : 0.000067s : 1: jit_opt_b 1.69% : 0.000534s : 1: loop_unroll 2.88% : 0.000912s : 1: mutable_eliminate 3.81% : 0.001206s : 26: opt.transform.jit_opt_a 0.16% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000033s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000020s : 1: opt.transform.mutable_eliminate 0.08% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.90% : 0.000601s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000041s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.78% : 0.000563s : 1: renormalize.infer 1.18% : 0.000375s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000046s : 1: rewriter_after_opt_a 0.27% : 0.000085s : 1: rewriter_before_opt_a 0.26% : 0.000081s : 1: symbol_engine_optimizer 15.21% : 0.004813s : 1: type_inference TotalTime = 0.0697787, [30] [bootstrap]: 0.00030769 [type_inference]: 0.0363985 [event_method]: 1.968e-05 [auto_monad]: 7.091e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 9.689e-05 [rewriter_before_opt_a]: 8.01e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00560163, [2] [Cycle 1]: 0.00187546, [27] [switch_simplify]: 5.579e-05 [loop_unroll]: 2.922e-05 [a_1]: 0.00054815 [with_stream_mark]: 2.237e-05 [recompute_prepare]: 7.18998e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00088269 [add_forward_monad_depend]: 6.76999e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 3.368e-05 [replace_applicator]: 1.301e-05 [Cycle 2]: 0.00031824, [27] [switch_simplify]: 6.08998e-06 [loop_unroll]: 4.99e-06 [a_1]: 8.864e-05 [with_stream_mark]: 9.98998e-06 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.42001e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.54002e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.261e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.89002e-06 [inline_without_move]: 4.79998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.53e-06 [cse]: 1.232e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.281e-05 [rewriter_after_opt_a]: 3.755e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00063129 [jit_opt_b]: 0.0241989, [1] [Cycle 1]: 0.0241862, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 0.0241237 [cconv]: 4.28e-05 [loop_unroll]: 0.00082639 [jit_opt_after_cconv]: 0.00024973, [1] [Cycle 1]: 0.00023779, [11] [c_1]: 2.399e-05 [parameter_eliminate]: 7.25e-06 [updatestate_depend_eliminate]: 1.249e-05 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [cse]: 5.17e-05 [call_graph_tuple_transform]: 2.884e-05 [tuple_list_get_item_eliminator]: 6.76e-06 [none_parameter_eliminate]: 2.06998e-06 [renormalize]: 8.40024e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 2.189e-05 [partial_unused_args_eliminate]: 2.70002e-06 [environ_conv]: 8.08999e-06 [add_recomputation]: 6.164e-05 [cse_after_recomputation]: 2.535e-05, [1] [Cycle 1]: 1.904e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.878e-05 [get_jit_bprop_graph]: 3.35e-06 [rewriter_after_jit_bprop_graph]: 1.116e-05 [opt_after_jit_grad]: 0.0006905 [symbol_engine_optimizer]: 8.17e-05, [1] [Cycle 1]: 7.432e-05, [6] [build]: 5.25001e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.654e-05 [opt_reshape]: 6.32001e-06 [fold_const_symbol]: 9.76e-06 [renormalize]: 5.29981e-07 [validate]: 5.373e-05 Sums bootstrap : 0.000308s : 0.47% type_inference : 0.036399s : 55.42% event_method : 0.000020s : 0.03% auto_monad : 0.000071s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000097s : 0.15% rewriter_before_opt_a : 0.000080s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.09% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000637s : 0.97% jit_opt_a.with_stream_mark : 0.000032s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000883s : 1.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000046s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000631s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.024124s : 36.73% cconv : 0.000043s : 0.07% loop_unroll : 0.000826s : 1.26% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000052s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000022s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000062s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.02% opt_after_jit_grad : 0.000691s : 1.05% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.08% Time group info: ------[substitution.] 0.000229 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 3.00% : 0.000007s : 3: substitution.graph_param_transform 84.68% : 0.000194s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 5.42% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036328 2 96.24% : 0.034961s : 1: type_inference.infer 3.76% : 0.001366s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.70% : 0.000046s : 4: replace.inline 31.30% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.40% : 0.000191s : 4: match.inline 5.60% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.75% : 0.000008s : 22: predicate.inline 1.08% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.27% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000002s : 15: predicate.load_eliminater 2.03% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.37% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 4.58% : 0.000005s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.04% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000753 13 44.91% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.78% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.31% : 0.000364s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.095666 72 0.07% : 0.000066s : 1: add_recomputation 0.08% : 0.000074s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.34% : 0.000326s : 1: bootstrap 0.05% : 0.000047s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.86% : 0.005605s : 1: jit_opt_a 0.26% : 0.000253s : 1: jit_opt_after_cconv 25.30% : 0.024204s : 1: jit_opt_b 0.88% : 0.000841s : 1: loop_unroll 0.67% : 0.000640s : 1: mutable_eliminate 0.89% : 0.000848s : 26: opt.transform.jit_opt_a 0.06% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 25.21% : 0.024117s : 4: opt.transform.jit_opt_b 0.02% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000704s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000100s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000025s : 1: remove_dup_value 0.53% : 0.000503s : 1: renormalize.infer 0.39% : 0.000369s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000083s : 1: rewriter_before_opt_a 0.09% : 0.000084s : 1: symbol_engine_optimizer 38.06% : 0.036415s : 1: type_inference TotalTime = 0.0365609, [30] [bootstrap]: 0.00041473 [type_inference]: 0.00620462 [event_method]: 2.242e-05 [auto_monad]: 7.214e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 4.675e-05 [rewriter_before_opt_a]: 9.406e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.0271819, [2] [Cycle 1]: 0.00218422, [27] [switch_simplify]: 8.098e-05 [loop_unroll]: 3.606e-05 [a_1]: 0.00076643 [with_stream_mark]: 2.108e-05 [recompute_prepare]: 9.76e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.73002e-06 [accelerated_algorithm]: 5.98002e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.68002e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.07e-05 [inline_without_move]: 5.04e-06 [renormalize]: 0.00089515 [add_forward_monad_depend]: 7.71999e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.583e-05 [cse]: 3.272e-05 [replace_applicator]: 1.687e-05 [Cycle 2]: 0.00035015, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 5.40999e-06 [a_1]: 9.412e-05 [with_stream_mark]: 1.231e-05 [recompute_prepare]: 5.53002e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 4.62e-06 [updatestate_useless_node_eliminater]: 4.52998e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 2.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 7.93999e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 8.29002e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.26002e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.43998e-06 [cse]: 1.296e-05 [replace_applicator]: 5.88002e-06 [py_interpret_to_execute_after_opt_a]: 1.282e-05 [rewriter_after_opt_a]: 3.789e-05 [convert_after_rewriter]: 7.32002e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.0007577 [jit_opt_b]: 5.344e-05, [1] [Cycle 1]: 4.431e-05, [2] [frontend_op_eliminate]: 1.644e-05 [inline_after_opt_a]: 1.587e-05 [cconv]: 3.795e-05 [loop_unroll]: 0.00049112 [jit_opt_after_cconv]: 0.00015645, [1] [Cycle 1]: 0.00014916, [11] [c_1]: 1.962e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 5.86998e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.894e-05 [call_graph_tuple_transform]: 2.2e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 4.99e-06 [remove_dup_value]: 1.434e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 5.98998e-06 [add_recomputation]: 5.571e-05 [cse_after_recomputation]: 2.308e-05, [1] [Cycle 1]: 1.732e-05, [1] [cse]: 9.90002e-06 [auto_monad_reorder]: 1.59e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 7.08e-06 [opt_after_jit_grad]: 0.00051337 [symbol_engine_optimizer]: 7.331e-05, [1] [Cycle 1]: 6.604e-05, [6] [build]: 4.3e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.288e-05 [opt_reshape]: 5.00999e-06 [fold_const_symbol]: 8.64e-06 [renormalize]: 5.19998e-07 [validate]: 3.888e-05 Sums bootstrap : 0.000415s : 3.69% type_inference : 0.006205s : 55.15% event_method : 0.000022s : 0.20% auto_monad : 0.000072s : 0.64% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.42% rewriter_before_opt_a : 0.000094s : 0.84% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000087s : 0.77% jit_opt_a.loop_unroll : 0.000041s : 0.37% jit_opt_a.a_1 : 0.000861s : 7.65% jit_opt_a.with_stream_mark : 0.000033s : 0.30% jit_opt_a.recompute_prepare : 0.000015s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000010s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000895s : 7.96% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.20% jit_opt_a.cse : 0.000046s : 0.41% jit_opt_a.replace_applicator : 0.000023s : 0.20% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000038s : 0.34% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000758s : 6.73% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000038s : 0.34% loop_unroll : 0.000491s : 4.37% jit_opt_after_cconv.c_1 : 0.000020s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000014s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000056s : 0.50% cse_after_recomputation.cse : 0.000010s : 0.09% auto_monad_reorder : 0.000016s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000513s : 4.56% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.35% Time group info: ------[substitution.] 0.000314 25 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 3: substitution.graph_param_transform 86.91% : 0.000272s : 5: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.42% : 0.000004s : 4: substitution.remove_not_recompute_node 2.05% : 0.000006s : 2: substitution.replace_old_param 5.16% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006125 2 83.24% : 0.005099s : 1: type_inference.infer 16.76% : 0.001026s : 1: type_inference.specialize ------[replace.] 0.000111 8 66.68% : 0.000074s : 5: replace.inline 33.32% : 0.000037s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 8 95.07% : 0.000269s : 5: match.inline 4.93% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 810 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 0.74% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.25% : 0.000002s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.85% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.52% : 0.000004s : 15: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 2.15% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.89% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 21: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000002s : 12: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.72% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.02% : 0.000004s : 20: predicate.switch_defer_inline 2.41% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.96% : 0.000012s : 64: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.26% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 2.42% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.32% : 0.000003s : 24: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000851 16 55.51% : 0.000473s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.24% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.26% : 0.000292s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038617 72 0.15% : 0.000059s : 1: add_recomputation 0.20% : 0.000076s : 1: auto_monad 0.05% : 0.000019s : 1: auto_monad_reorder 1.14% : 0.000438s : 1: bootstrap 0.11% : 0.000041s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 70.40% : 0.027185s : 1: jit_opt_a 0.41% : 0.000159s : 1: jit_opt_after_cconv 0.15% : 0.000056s : 1: jit_opt_b 1.30% : 0.000501s : 1: loop_unroll 1.99% : 0.000770s : 1: mutable_eliminate 2.86% : 0.001106s : 26: opt.transform.jit_opt_a 0.13% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.35% : 0.000522s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000050s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.23% : 0.000476s : 1: renormalize.infer 1.06% : 0.000410s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000041s : 1: rewriter_after_opt_a 0.25% : 0.000097s : 1: rewriter_before_opt_a 0.20% : 0.000076s : 1: symbol_engine_optimizer 16.12% : 0.006226s : 1: type_inference TotalTime = 0.047808, [30] [bootstrap]: 0.00039276 [type_inference]: 0.0232427 [event_method]: 2.213e-05 [auto_monad]: 7.097e-05 [graph_reusing]: 5.57999e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00012829 [rewriter_before_opt_a]: 8.766e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.0212477, [2] [Cycle 1]: 0.00252423, [27] [switch_simplify]: 6.754e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00060099 [with_stream_mark]: 1.961e-05 [recompute_prepare]: 1.075e-05 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 4.25e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.536e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00137878 [add_forward_monad_depend]: 5.70001e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 1.758e-05 [cse]: 3.866e-05 [replace_applicator]: 1.493e-05 [Cycle 2]: 0.00034614, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 5.09e-06 [a_1]: 0.0001002 [with_stream_mark]: 1.334e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 5.07999e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.23001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 7.66001e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.48e-05 [replace_applicator]: 5.71003e-06 [py_interpret_to_execute_after_opt_a]: 1.527e-05 [rewriter_after_opt_a]: 3.977e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.0008517 [jit_opt_b]: 5.372e-05, [1] [Cycle 1]: 4.634e-05, [2] [frontend_op_eliminate]: 1.711e-05 [inline_after_opt_a]: 1.791e-05 [cconv]: 3.048e-05 [loop_unroll]: 0.00047247 [jit_opt_after_cconv]: 0.00016379, [1] [Cycle 1]: 0.00015701, [11] [c_1]: 2.175e-05 [parameter_eliminate]: 3.73001e-06 [updatestate_depend_eliminate]: 6.61e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.242e-05 [call_graph_tuple_transform]: 2.167e-05 [tuple_list_get_item_eliminator]: 6.03998e-06 [none_parameter_eliminate]: 2.14e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 7.6e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 5.94e-06 [add_recomputation]: 5.741e-05 [cse_after_recomputation]: 2.444e-05, [1] [Cycle 1]: 1.867e-05, [1] [cse]: 1.277e-05 [auto_monad_reorder]: 1.858e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 6.56999e-06 [opt_after_jit_grad]: 0.00051367 [symbol_engine_optimizer]: 7.675e-05, [1] [Cycle 1]: 7.018e-05, [6] [build]: 4.43001e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.422e-05 [opt_reshape]: 6.07001e-06 [fold_const_symbol]: 9.61998e-06 [renormalize]: 4.69998e-07 [validate]: 4.477e-05 Sums bootstrap : 0.000393s : 1.37% type_inference : 0.023243s : 80.82% event_method : 0.000022s : 0.08% auto_monad : 0.000071s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000128s : 0.45% rewriter_before_opt_a : 0.000088s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000701s : 2.44% jit_opt_a.with_stream_mark : 0.000033s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001379s : 4.79% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000053s : 0.19% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000852s : 2.96% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000030s : 0.11% loop_unroll : 0.000472s : 1.64% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000057s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000514s : 1.79% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000229 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 3: substitution.graph_param_transform 83.00% : 0.000190s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000006s : 2: substitution.replace_old_param 6.53% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023158 2 91.38% : 0.021162s : 1: type_inference.infer 8.62% : 0.001996s : 1: type_inference.specialize ------[replace.] 0.000083 6 68.15% : 0.000056s : 4: replace.inline 31.85% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 93.16% : 0.000188s : 4: match.inline 6.84% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.92% : 0.000001s : 10: predicate.addn_check_dump 1.01% : 0.000001s : 10: predicate.addn_zero_filter 2.48% : 0.000004s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000002s : 10: predicate.compare_switch_simplify 1.45% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.54% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.61% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.71% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.66% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.49% : 0.000002s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.29% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 4.97% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.70% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.37% : 0.000002s : 15: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.46% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 10: predicate.merge_addn 1.09% : 0.000002s : 10: predicate.minmaximum_grad 2.80% : 0.000004s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 1.87% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000002s : 10: predicate.print_const_string_wrapper 2.59% : 0.000004s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 18: predicate.replace_applicator 0.38% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 0.99% : 0.000001s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 16: predicate.switch_defer_inline 2.76% : 0.000004s : 16: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 53: predicate.switch_simplify 1.10% : 0.000002s : 10: predicate.tile_eliminate 1.01% : 0.000001s : 10: predicate.transpose_eliminate 1.87% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.05% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.01% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001021 13 42.33% : 0.000432s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.55% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.12% : 0.000553s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050189 72 0.12% : 0.000060s : 1: add_recomputation 0.15% : 0.000075s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.81% : 0.000408s : 1: bootstrap 0.07% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 42.34% : 0.021252s : 1: jit_opt_a 0.33% : 0.000167s : 1: jit_opt_after_cconv 0.11% : 0.000057s : 1: jit_opt_b 0.96% : 0.000480s : 1: loop_unroll 1.72% : 0.000865s : 1: mutable_eliminate 1.87% : 0.000940s : 26: opt.transform.jit_opt_a 0.11% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000024s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.04% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000132s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.71% : 0.000857s : 1: renormalize.infer 1.02% : 0.000513s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000043s : 1: rewriter_after_opt_a 0.18% : 0.000091s : 1: rewriter_before_opt_a 0.16% : 0.000079s : 1: symbol_engine_optimizer 46.36% : 0.023269s : 1: type_inference TotalTime = 0.0346476, [30] [bootstrap]: 0.00028757 [type_inference]: 0.00505464 [event_method]: 2.037e-05 [auto_monad]: 6.918e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 3.968e-05 [rewriter_before_opt_a]: 8.293e-05 [expand_dump_flag]: 2.78003e-06 [jit_opt_a]: 0.0266561, [2] [Cycle 1]: 0.0224177, [27] [switch_simplify]: 5.952e-05 [loop_unroll]: 3.611e-05 [a_1]: 0.0209777 [with_stream_mark]: 3.172e-05 [recompute_prepare]: 1.281e-05 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 3.28998e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 4.58999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.654e-05 [j_node_and_user_rematch]: 1.012e-05 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.081e-05 [inline_without_move]: 5.24998e-06 [renormalize]: 0.00091587 [add_forward_monad_depend]: 7.7e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.483e-05 [cse]: 2.866e-05 [replace_applicator]: 1.287e-05 [Cycle 2]: 0.00033727, [27] [switch_simplify]: 5.50001e-06 [loop_unroll]: 5.09998e-06 [a_1]: 9.294e-05 [with_stream_mark]: 9.71998e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 4.77e-06 [updatestate_useless_node_eliminater]: 4.55999e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.85998e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.01997e-06 [auto_monad_eliminator]: 5.35999e-06 [cse]: 1.193e-05 [replace_applicator]: 9.31e-06 [py_interpret_to_execute_after_opt_a]: 1.235e-05 [rewriter_after_opt_a]: 3.804e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00073555 [jit_opt_b]: 5.432e-05, [1] [Cycle 1]: 4.578e-05, [2] [frontend_op_eliminate]: 1.858e-05 [inline_after_opt_a]: 1.524e-05 [cconv]: 3.064e-05 [loop_unroll]: 0.00045333 [jit_opt_after_cconv]: 0.00014849, [1] [Cycle 1]: 0.00014181, [11] [c_1]: 2.148e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.554e-05 [call_graph_tuple_transform]: 1.967e-05 [tuple_list_get_item_eliminator]: 5.10001e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.428e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 5.333e-05 [cse_after_recomputation]: 2.091e-05, [1] [Cycle 1]: 1.538e-05, [1] [cse]: 9.39998e-06 [auto_monad_reorder]: 1.569e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.00052651 [symbol_engine_optimizer]: 7.192e-05, [1] [Cycle 1]: 6.504e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 7.02002e-06 [elim_not_effective]: 1.26e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 7.00005e-07 [validate]: 3.888e-05 Sums bootstrap : 0.000288s : 0.96% type_inference : 0.005055s : 16.79% event_method : 0.000020s : 0.07% auto_monad : 0.000069s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000040s : 0.13% rewriter_before_opt_a : 0.000083s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.22% jit_opt_a.loop_unroll : 0.000041s : 0.14% jit_opt_a.a_1 : 0.021071s : 70.01% jit_opt_a.with_stream_mark : 0.000041s : 0.14% jit_opt_a.recompute_prepare : 0.000018s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000916s : 3.04% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000041s : 0.13% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000038s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000736s : 2.44% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000031s : 0.10% loop_unroll : 0.000453s : 1.51% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000014s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.18% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000016s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000527s : 1.75% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.13% Time group info: ------[substitution.] 0.000238 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 3: substitution.graph_param_transform 78.51% : 0.000187s : 5: substitution.inline 1.78% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.58% : 0.000006s : 2: substitution.replace_old_param 11.01% : 0.000026s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004984 2 81.55% : 0.004064s : 1: type_inference.infer 18.45% : 0.000920s : 1: type_inference.specialize ------[replace.] 0.000161 8 37.56% : 0.000060s : 5: replace.inline 62.44% : 0.000100s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 8 88.61% : 0.000184s : 5: match.inline 11.39% : 0.000024s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 810 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 0.79% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 12: predicate.addn_check_dump 1.58% : 0.000003s : 12: predicate.addn_zero_filter 2.20% : 0.000004s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 12: predicate.compare_switch_simplify 1.81% : 0.000003s : 12: predicate.depend_value_elim 0.97% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_depend_swap 1.69% : 0.000003s : 12: predicate.environ_get_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.16% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000009s : 26: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.26% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.89% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 18: predicate.load_eliminater 1.09% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.65% : 0.000004s : 15: predicate.make_slice_get_slice_eliminator 0.97% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000002s : 12: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 1.95% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 2.59% : 0.000004s : 12: predicate.reduce_eliminate 1.58% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000003s : 21: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 4.09% : 0.000007s : 12: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.35% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.72% : 0.000001s : 6: predicate.specialize_transform 2.08% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.29% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.37% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.93% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.45% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.21% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 2.41% : 0.000004s : 12: predicate.value_based_eliminate 0.35% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000737 16 50.41% : 0.000371s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.52% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.07% : 0.000310s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056915 72 0.10% : 0.000057s : 1: add_recomputation 0.13% : 0.000072s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.54% : 0.000307s : 1: bootstrap 0.06% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 46.84% : 0.026660s : 1: jit_opt_a 0.27% : 0.000152s : 1: jit_opt_after_cconv 0.10% : 0.000057s : 1: jit_opt_b 0.81% : 0.000462s : 1: loop_unroll 1.31% : 0.000746s : 1: mutable_eliminate 37.43% : 0.021304s : 26: opt.transform.jit_opt_a 0.08% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000535s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000042s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 0.92% : 0.000525s : 1: renormalize.infer 0.67% : 0.000383s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.15% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000075s : 1: symbol_engine_optimizer 8.91% : 0.005070s : 1: type_inference TotalTime = 0.0137193, [30] [bootstrap]: 0.00028559 [type_inference]: 0.0049762 [event_method]: 1.782e-05 [auto_monad]: 6.642e-05 [graph_reusing]: 6.15002e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.641e-05 [rewriter_before_opt_a]: 7.326e-05 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.00577342, [2] [Cycle 1]: 0.00181951, [27] [switch_simplify]: 5.992e-05 [loop_unroll]: 2.954e-05 [a_1]: 0.00056613 [with_stream_mark]: 2.696e-05 [recompute_prepare]: 1.024e-05 [updatestate_depend_eliminate]: 4.83001e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 0.00077481 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.697e-05 [cse]: 3.658e-05 [replace_applicator]: 1.567e-05 [Cycle 2]: 0.00035431, [27] [switch_simplify]: 5.64998e-06 [loop_unroll]: 4.98001e-06 [a_1]: 0.00010075 [with_stream_mark]: 1.288e-05 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 2.93998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.12999e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.576e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 7.77e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 9.99717e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 7.90023e-07 [auto_monad_eliminator]: 8.60001e-06 [cse]: 1.587e-05 [replace_applicator]: 5.94999e-06 [py_interpret_to_execute_after_opt_a]: 1.643e-05 [rewriter_after_opt_a]: 4.437e-05 [convert_after_rewriter]: 8.04002e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00075408 [jit_opt_b]: 5.363e-05, [1] [Cycle 1]: 4.474e-05, [2] [frontend_op_eliminate]: 1.616e-05 [inline_after_opt_a]: 1.626e-05 [cconv]: 3.114e-05 [loop_unroll]: 0.00045593 [jit_opt_after_cconv]: 0.00017787, [1] [Cycle 1]: 0.00017051, [11] [c_1]: 2.01e-05 [parameter_eliminate]: 4.03001e-06 [updatestate_depend_eliminate]: 9.02999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 1.086e-05 [cse]: 3.655e-05 [call_graph_tuple_transform]: 2.245e-05 [tuple_list_get_item_eliminator]: 5.74999e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 1.693e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 7.16001e-06 [add_recomputation]: 5.607e-05 [cse_after_recomputation]: 2.384e-05, [1] [Cycle 1]: 1.858e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.905e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 7.88999e-06 [opt_after_jit_grad]: 0.00050406 [symbol_engine_optimizer]: 7.471e-05, [1] [Cycle 1]: 6.688e-05, [6] [build]: 3.66999e-06 [elim_shapecalc]: 7.70998e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 7.39994e-07 [validate]: 4.238e-05 Sums bootstrap : 0.000286s : 3.00% type_inference : 0.004976s : 52.29% event_method : 0.000018s : 0.19% auto_monad : 0.000066s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.38% rewriter_before_opt_a : 0.000073s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.69% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000667s : 7.01% jit_opt_a.with_stream_mark : 0.000040s : 0.42% jit_opt_a.recompute_prepare : 0.000016s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000775s : 8.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.27% jit_opt_a.cse : 0.000052s : 0.55% jit_opt_a.replace_applicator : 0.000022s : 0.23% py_interpret_to_execute_after_opt_a : 0.000016s : 0.17% rewriter_after_opt_a : 0.000044s : 0.47% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000754s : 7.92% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000031s : 0.33% loop_unroll : 0.000456s : 4.79% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000011s : 0.11% jit_opt_after_cconv.cse : 0.000037s : 0.38% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000007s : 0.08% add_recomputation : 0.000056s : 0.59% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000019s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.08% opt_after_jit_grad : 0.000504s : 5.30% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000042s : 0.45% Time group info: ------[substitution.] 0.000235 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 84.53% : 0.000199s : 4: substitution.inline 1.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000004s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 5.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004909 2 82.91% : 0.004070s : 1: type_inference.infer 17.09% : 0.000839s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.41% : 0.000048s : 4: replace.inline 34.59% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.42% : 0.000196s : 4: match.inline 5.58% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000002s : 10: predicate.addn_zero_filter 2.30% : 0.000003s : 10: predicate.arithmetic_simplify 1.49% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.64% : 0.000001s : 3: predicate.graph_param_transform 6.27% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.15% : 0.000002s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.34% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.81% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.25% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000672 13 52.94% : 0.000356s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.74% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.32% : 0.000264s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015451 72 0.38% : 0.000059s : 1: add_recomputation 0.45% : 0.000070s : 1: auto_monad 0.14% : 0.000022s : 1: auto_monad_reorder 1.94% : 0.000300s : 1: bootstrap 0.22% : 0.000034s : 1: cconv 0.07% : 0.000011s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.39% : 0.005778s : 1: jit_opt_a 1.17% : 0.000181s : 1: jit_opt_after_cconv 0.37% : 0.000057s : 1: jit_opt_b 3.00% : 0.000464s : 1: loop_unroll 4.96% : 0.000767s : 1: mutable_eliminate 5.78% : 0.000894s : 26: opt.transform.jit_opt_a 0.32% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000019s : 1: opt.transform.mutable_eliminate 0.15% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000513s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000039s : 1: py_interpret_to_execute 0.12% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.83% : 0.000437s : 1: renormalize.infer 2.13% : 0.000328s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.31% : 0.000048s : 1: rewriter_after_opt_a 0.49% : 0.000076s : 1: rewriter_before_opt_a 0.50% : 0.000077s : 1: symbol_engine_optimizer 32.32% : 0.004993s : 1: type_inference TotalTime = 0.265743, [30] [bootstrap]: 0.00045128 [type_inference]: 0.228513 [event_method]: 2.242e-05 [auto_monad]: 7.659e-05 [graph_reusing]: 5.52001e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 0.00039724 [rewriter_before_opt_a]: 0.00010021 [expand_dump_flag]: 4.12998e-06 [jit_opt_a]: 0.00963165, [2] [Cycle 1]: 0.00380832, [27] [switch_simplify]: 6.124e-05 [loop_unroll]: 3.158e-05 [a_1]: 0.00062394 [with_stream_mark]: 1.426e-05 [recompute_prepare]: 9.17999e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 8.37e-06 [updatestate_useless_node_eliminater]: 6.88998e-06 [accelerated_algorithm]: 7.26001e-06 [meta_shard_fg_expand]: 1.68002e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.321e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 6.14001e-06 [renormalize]: 0.00271469 [add_forward_monad_depend]: 9.61003e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.793e-05 [cse]: 2.848e-05 [replace_applicator]: 1.584e-05 [Cycle 2]: 0.0004042, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.89001e-06 [a_1]: 0.00013872 [with_stream_mark]: 1.52e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.96998e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.03998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 2.94001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.71e-05 [j_node_and_user_rematch]: 1.012e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.30002e-06 [cse]: 1.483e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 1.723e-05 [rewriter_after_opt_a]: 4.06e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00083358 [jit_opt_b]: 6.026e-05, [1] [Cycle 1]: 5.268e-05, [2] [frontend_op_eliminate]: 2.103e-05 [inline_after_opt_a]: 1.959e-05 [cconv]: 2.845e-05 [loop_unroll]: 0.00048618 [jit_opt_after_cconv]: 0.0001668, [1] [Cycle 1]: 0.0001597, [11] [c_1]: 2.788e-05 [parameter_eliminate]: 3.97002e-06 [updatestate_depend_eliminate]: 7.10998e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.58003e-06 [cse]: 2.915e-05 [call_graph_tuple_transform]: 2.227e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 2.70025e-07 [switch_simplify]: 6.56e-06 [remove_dup_value]: 2.059e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 2.458e-05, [1] [Cycle 1]: 1.926e-05, [1] [cse]: 1.326e-05 [auto_monad_reorder]: 1.819e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.36998e-06 [opt_after_jit_grad]: 0.024369 [symbol_engine_optimizer]: 9.908e-05, [1] [Cycle 1]: 8.692e-05, [6] [build]: 7.34002e-06 [elim_shapecalc]: 9.74e-06 [elim_not_effective]: 2.033e-05 [opt_reshape]: 8.67e-06 [fold_const_symbol]: 1.041e-05 [renormalize]: 9.00007e-07 [validate]: 7.008e-05 Sums bootstrap : 0.000451s : 0.17% type_inference : 0.228513s : 88.00% event_method : 0.000022s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000397s : 0.15% rewriter_before_opt_a : 0.000100s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.03% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000763s : 0.29% jit_opt_a.with_stream_mark : 0.000029s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002715s : 1.05% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000043s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000834s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000486s : 0.19% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.024369s : 9.38% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000070s : 0.03% Time group info: ------[substitution.] 0.000221 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 4: substitution.graph_param_transform 84.93% : 0.000188s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 4.92% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.228396 2 92.64% : 0.211576s : 1: type_inference.infer 7.36% : 0.016820s : 1: type_inference.specialize ------[replace.] 0.000088 6 67.99% : 0.000060s : 4: replace.inline 32.01% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 95.00% : 0.000185s : 4: match.inline 5.00% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 2.47% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 12: predicate.addn_check_dump 1.81% : 0.000003s : 12: predicate.addn_zero_filter 2.05% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.09% : 0.000002s : 12: predicate.depend_value_elim 0.96% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.33% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.78% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.25% : 0.000003s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 0.95% : 0.000001s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 2.23% : 0.000003s : 12: predicate.reduce_eliminate 1.73% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.63% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000010s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.35% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.15% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002800 26 70.69% : 0.001979s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.99% : 0.000784s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.269550 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000080s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.17% : 0.000472s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.57% : 0.009636s : 1: jit_opt_a 0.06% : 0.000170s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.18% : 0.000494s : 1: loop_unroll 0.31% : 0.000844s : 1: mutable_eliminate 0.38% : 0.001016s : 26: opt.transform.jit_opt_a 0.02% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000056s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000046s : 4: opt.transform.symbol_engine_opt 9.05% : 0.024391s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000403s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.68% : 0.001835s : 1: renormalize.infer 0.32% : 0.000870s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000105s : 1: rewriter_before_opt_a 0.04% : 0.000102s : 1: symbol_engine_optimizer 84.78% : 0.228532s : 1: type_inference TotalTime = 0.155579, [30] [bootstrap]: 0.00038666 [type_inference]: 0.144479 [event_method]: 2.608e-05 [auto_monad]: 8.166e-05 [graph_reusing]: 6.30002e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00026949 [rewriter_before_opt_a]: 0.0001072 [expand_dump_flag]: 4.70999e-06 [jit_opt_a]: 0.00775998, [2] [Cycle 1]: 0.00331293, [27] [switch_simplify]: 6.575e-05 [loop_unroll]: 3.462e-05 [a_1]: 0.00073194 [with_stream_mark]: 2.038e-05 [recompute_prepare]: 8.52998e-06 [updatestate_depend_eliminate]: 4.39002e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 7.37997e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.84001e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.64001e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 1.077e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 9.50001e-06 [inline_without_move]: 6.56e-06 [renormalize]: 0.00208117 [add_forward_monad_depend]: 8.33001e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.737e-05 [cse]: 3.819e-05 [replace_applicator]: 1.98e-05 [Cycle 2]: 0.00038013, [27] [switch_simplify]: 7.28e-06 [loop_unroll]: 6.24001e-06 [a_1]: 0.00012054 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 6.43e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.689e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.21998e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 1.18001e-06 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.521e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.542e-05 [rewriter_after_opt_a]: 4.266e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00069975 [jit_opt_b]: 5.94e-05, [1] [Cycle 1]: 5.079e-05, [2] [frontend_op_eliminate]: 1.944e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 3.018e-05 [loop_unroll]: 0.00044484 [jit_opt_after_cconv]: 0.00016773, [1] [Cycle 1]: 0.00016067, [11] [c_1]: 2.674e-05 [parameter_eliminate]: 3.74002e-06 [updatestate_depend_eliminate]: 6.28e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.968e-05 [call_graph_tuple_transform]: 2.327e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 7.2e-07 [switch_simplify]: 6.18002e-06 [remove_dup_value]: 1.856e-05 [partial_unused_args_eliminate]: 3.43e-06 [environ_conv]: 9.02e-06 [add_recomputation]: 5.311e-05 [cse_after_recomputation]: 2.473e-05, [1] [Cycle 1]: 1.945e-05, [1] [cse]: 1.373e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.48002e-06 [opt_after_jit_grad]: 0.00048246 [symbol_engine_optimizer]: 7.661e-05, [1] [Cycle 1]: 7.022e-05, [6] [build]: 3.90998e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 7.23e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 4.39992e-07 [validate]: 8.136e-05 Sums bootstrap : 0.000387s : 0.26% type_inference : 0.144479s : 95.76% event_method : 0.000026s : 0.02% auto_monad : 0.000082s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000269s : 0.18% rewriter_before_opt_a : 0.000107s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000852s : 0.57% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002081s : 1.38% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000700s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000445s : 0.29% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000482s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000081s : 0.05% Time group info: ------[substitution.] 0.000284 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000008s : 4: substitution.graph_param_transform 86.29% : 0.000245s : 5: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000006s : 4: substitution.remove_not_recompute_node 1.49% : 0.000004s : 2: substitution.replace_old_param 5.06% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.144359 2 98.37% : 0.142005s : 1: type_inference.infer 1.63% : 0.002354s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.76% : 0.000069s : 5: replace.inline 31.24% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 94.84% : 0.000242s : 5: match.inline 5.16% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 888 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 1.83% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.53% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 2.23% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.55% : 0.000002s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.52% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000011s : 65: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.23% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002374 25 68.71% : 0.001631s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.49% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.79% : 0.000660s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158804 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000085s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000409s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.89% : 0.007763s : 1: jit_opt_a 0.11% : 0.000171s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.29% : 0.000453s : 1: loop_unroll 0.45% : 0.000710s : 1: mutable_eliminate 0.70% : 0.001112s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000491s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000277s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.89% : 0.001406s : 1: renormalize.infer 0.42% : 0.000664s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.07% : 0.000115s : 1: rewriter_before_opt_a 0.05% : 0.000079s : 1: symbol_engine_optimizer 90.99% : 0.144501s : 1: type_inference TotalTime = 0.0167022, [30] [bootstrap]: 0.00028834 [type_inference]: 0.00458494 [event_method]: 2.126e-05 [auto_monad]: 6.689e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 3.889e-05 [rewriter_before_opt_a]: 8.128e-05 [expand_dump_flag]: 2.99999e-06 [jit_opt_a]: 0.00909782, [2] [Cycle 1]: 0.00288026, [27] [switch_simplify]: 6.884e-05 [loop_unroll]: 3.485e-05 [a_1]: 0.00071899 [with_stream_mark]: 2.418e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 0.00089281 [meta_fg_expand]: 3.2e-06 [replace_old_param]: 1.302e-05 [inline_without_move]: 5.96003e-06 [renormalize]: 0.00078146 [add_forward_monad_depend]: 6.99001e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 2.913e-05 [replace_applicator]: 1.687e-05 [Cycle 2]: 0.00033313, [27] [switch_simplify]: 5.40001e-06 [loop_unroll]: 4.60001e-06 [a_1]: 9.165e-05 [with_stream_mark]: 1.294e-05 [recompute_prepare]: 4.85001e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 2.68998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 4.32e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.12001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 4.92e-06 [cse]: 1.037e-05 [replace_applicator]: 1.061e-05 [py_interpret_to_execute_after_opt_a]: 1.17e-05 [rewriter_after_opt_a]: 3.758e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 4.67e-06 [mutable_eliminate]: 0.00074773 [jit_opt_b]: 5.324e-05, [1] [Cycle 1]: 4.524e-05, [2] [frontend_op_eliminate]: 1.856e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 2.726e-05 [loop_unroll]: 0.00044293 [jit_opt_after_cconv]: 0.00014154, [1] [Cycle 1]: 0.00013504, [11] [c_1]: 1.993e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.139e-05 [call_graph_tuple_transform]: 1.946e-05 [tuple_list_get_item_eliminator]: 5.17e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 4.87e-06 [remove_dup_value]: 1.822e-05 [partial_unused_args_eliminate]: 2.94001e-06 [environ_conv]: 6.06998e-06 [add_recomputation]: 5.239e-05 [cse_after_recomputation]: 2.615e-05, [1] [Cycle 1]: 2.004e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.523e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 5.40999e-06 [opt_after_jit_grad]: 0.00050873 [symbol_engine_optimizer]: 7.197e-05, [1] [Cycle 1]: 6.509e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 7.45003e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 8.1e-06 [renormalize]: 4.69998e-07 [validate]: 3.877e-05 Sums bootstrap : 0.000288s : 2.86% type_inference : 0.004585s : 45.44% event_method : 0.000021s : 0.21% auto_monad : 0.000067s : 0.66% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.39% rewriter_before_opt_a : 0.000081s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000074s : 0.74% jit_opt_a.loop_unroll : 0.000039s : 0.39% jit_opt_a.a_1 : 0.000811s : 8.03% jit_opt_a.with_stream_mark : 0.000037s : 0.37% jit_opt_a.recompute_prepare : 0.000012s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000900s : 8.92% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000020s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000782s : 7.75% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000040s : 0.39% jit_opt_a.replace_applicator : 0.000027s : 0.27% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000038s : 0.37% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000748s : 7.41% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000027s : 0.27% loop_unroll : 0.000443s : 4.39% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.52% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000509s : 5.04% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.38% Time group info: ------[substitution.] 0.000298 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 1.86% : 0.000006s : 3: substitution.graph_param_transform 85.30% : 0.000254s : 5: substitution.inline 3.05% : 0.000009s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 5.14% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004520 2 79.03% : 0.003572s : 1: type_inference.infer 20.97% : 0.000948s : 1: type_inference.specialize ------[replace.] 0.000103 8 64.72% : 0.000066s : 5: replace.inline 35.28% : 0.000036s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 8 94.78% : 0.000251s : 5: match.inline 5.22% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 810 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.44% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.24% : 0.000002s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.82% : 0.000008s : 26: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.79% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000002s : 12: predicate.minmaximum_grad 1.26% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.88% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 21: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.85% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 20: predicate.switch_defer_inline 2.27% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.64% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000737 16 44.64% : 0.000329s : 7: func_graph_cloner_run.FuncGraphClonerGraph 11.92% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.45% : 0.000320s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019357 72 0.28% : 0.000055s : 1: add_recomputation 0.36% : 0.000071s : 1: auto_monad 0.09% : 0.000018s : 1: auto_monad_reorder 1.58% : 0.000305s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 47.02% : 0.009101s : 1: jit_opt_a 0.74% : 0.000144s : 1: jit_opt_after_cconv 0.29% : 0.000056s : 1: jit_opt_b 2.33% : 0.000450s : 1: loop_unroll 3.92% : 0.000758s : 1: mutable_eliminate 9.99% : 0.001934s : 26: opt.transform.jit_opt_a 0.24% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.68% : 0.000518s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000042s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000024s : 1: remove_dup_value 2.27% : 0.000439s : 1: renormalize.infer 1.72% : 0.000333s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000040s : 1: rewriter_after_opt_a 0.43% : 0.000084s : 1: rewriter_before_opt_a 0.39% : 0.000075s : 1: symbol_engine_optimizer 23.77% : 0.004601s : 1: type_inference TotalTime = 0.0443727, [30] [bootstrap]: 0.00028381 [type_inference]: 0.0355709 [event_method]: 2.224e-05 [auto_monad]: 7.219e-05 [graph_reusing]: 5.63997e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.00014244 [rewriter_before_opt_a]: 8.916e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00594717, [2] [Cycle 1]: 0.00211763, [27] [switch_simplify]: 5.47e-05 [loop_unroll]: 2.915e-05 [a_1]: 0.00052593 [with_stream_mark]: 1.787e-05 [recompute_prepare]: 7.11999e-06 [updatestate_depend_eliminate]: 3.92998e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 5.41998e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 9.01002e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.20001e-06 [renormalize]: 0.00115627 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 2.58003e-06 [auto_monad_eliminator]: 1.527e-05 [cse]: 3.358e-05 [replace_applicator]: 1.229e-05 [Cycle 2]: 0.00031522, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.01002e-06 [a_1]: 9.002e-05 [with_stream_mark]: 8.86002e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 9.70002e-07 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.243e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 8.16002e-06 [inline_without_move]: 4.67998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.238e-05 [replace_applicator]: 4.90999e-06 [py_interpret_to_execute_after_opt_a]: 1.194e-05 [rewriter_after_opt_a]: 3.933e-05 [convert_after_rewriter]: 6.49999e-06 [order_py_execute_after_rewriter]: 4.74998e-06 [mutable_eliminate]: 0.00054985 [jit_opt_b]: 4.822e-05, [1] [Cycle 1]: 4.104e-05, [2] [frontend_op_eliminate]: 1.56e-05 [inline_after_opt_a]: 1.546e-05 [cconv]: 2.561e-05 [loop_unroll]: 0.00048205 [jit_opt_after_cconv]: 0.00014875, [1] [Cycle 1]: 0.0001422, [11] [c_1]: 2.193e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.48e-05 [call_graph_tuple_transform]: 1.792e-05 [tuple_list_get_item_eliminator]: 5.36002e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.93e-06 [environ_conv]: 5.91e-06 [add_recomputation]: 5.041e-05 [cse_after_recomputation]: 2.308e-05, [1] [Cycle 1]: 1.763e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.856e-05 [get_jit_bprop_graph]: 2.01003e-06 [rewriter_after_jit_bprop_graph]: 5.20999e-06 [opt_after_jit_grad]: 0.00046879 [symbol_engine_optimizer]: 7.282e-05, [1] [Cycle 1]: 6.672e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 1.267e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.77999e-06 [renormalize]: 6.30011e-07 [validate]: 3.988e-05 Sums bootstrap : 0.000284s : 0.71% type_inference : 0.035571s : 88.38% event_method : 0.000022s : 0.06% auto_monad : 0.000072s : 0.18% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000142s : 0.35% rewriter_before_opt_a : 0.000089s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.15% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000616s : 1.53% jit_opt_a.with_stream_mark : 0.000027s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001156s : 2.87% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000046s : 0.11% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000039s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000550s : 1.37% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000026s : 0.06% loop_unroll : 0.000482s : 1.20% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000469s : 1.16% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.10% Time group info: ------[substitution.] 0.000198 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000006s : 3: substitution.graph_param_transform 83.14% : 0.000165s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000004s : 4: substitution.remove_not_recompute_node 2.66% : 0.000005s : 2: substitution.replace_old_param 5.98% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035478 2 90.46% : 0.032093s : 1: type_inference.infer 9.54% : 0.003385s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.50% : 0.000049s : 4: replace.inline 31.50% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.79% : 0.000162s : 4: match.inline 6.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.87% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 2.71% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.02% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000922 13 46.51% : 0.000429s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.20% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.29% : 0.000464s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046386 72 0.12% : 0.000054s : 1: add_recomputation 0.16% : 0.000076s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.66% : 0.000304s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.83% : 0.005951s : 1: jit_opt_a 0.33% : 0.000151s : 1: jit_opt_after_cconv 0.11% : 0.000051s : 1: jit_opt_b 1.06% : 0.000491s : 1: loop_unroll 1.21% : 0.000559s : 1: mutable_eliminate 1.79% : 0.000828s : 26: opt.transform.jit_opt_a 0.10% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.03% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000146s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.51% : 0.000701s : 1: renormalize.infer 0.96% : 0.000447s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000042s : 1: rewriter_after_opt_a 0.20% : 0.000093s : 1: rewriter_before_opt_a 0.16% : 0.000076s : 1: symbol_engine_optimizer 76.73% : 0.035590s : 1: type_inference TotalTime = 0.0426564, [30] [bootstrap]: 0.00030307 [type_inference]: 0.0335118 [event_method]: 2.019e-05 [auto_monad]: 7.414e-05 [graph_reusing]: 6.73e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00010265 [rewriter_before_opt_a]: 8.217e-05 [expand_dump_flag]: 3.27002e-06 [jit_opt_a]: 0.00615854, [2] [Cycle 1]: 0.00208287, [27] [switch_simplify]: 6.4e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00058138 [with_stream_mark]: 2.366e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 4.86002e-06 [updatestate_assign_eliminate]: 3.93999e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 5.51002e-06 [renormalize]: 0.00101119 [add_forward_monad_depend]: 6.59001e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.776e-05 [cse]: 3.799e-05 [replace_applicator]: 1.623e-05 [Cycle 2]: 0.00037224, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 5.33002e-06 [a_1]: 8.964e-05 [with_stream_mark]: 4.648e-05 [recompute_prepare]: 6.07001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.24003e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 5.01997e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 2.01003e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.31998e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 8.13999e-06 [cse]: 1.433e-05 [replace_applicator]: 5.08002e-06 [py_interpret_to_execute_after_opt_a]: 1.383e-05 [rewriter_after_opt_a]: 3.976e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00067468 [jit_opt_b]: 5.329e-05, [1] [Cycle 1]: 4.577e-05, [2] [frontend_op_eliminate]: 1.743e-05 [inline_after_opt_a]: 1.659e-05 [cconv]: 3.187e-05 [loop_unroll]: 0.00044293 [jit_opt_after_cconv]: 0.00016221, [1] [Cycle 1]: 0.00015505, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 3.91001e-06 [updatestate_depend_eliminate]: 8.03999e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.233e-05 [call_graph_tuple_transform]: 2.236e-05 [tuple_list_get_item_eliminator]: 5.64998e-06 [none_parameter_eliminate]: 1.99999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.71998e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 6.47001e-06 [add_recomputation]: 5.436e-05 [cse_after_recomputation]: 2.583e-05, [1] [Cycle 1]: 2.038e-05, [1] [cse]: 1.357e-05 [auto_monad_reorder]: 1.92e-05 [get_jit_bprop_graph]: 2.43002e-06 [rewriter_after_jit_bprop_graph]: 7.45e-06 [opt_after_jit_grad]: 0.00050685 [symbol_engine_optimizer]: 7.618e-05, [1] [Cycle 1]: 6.919e-05, [6] [build]: 5.07999e-06 [elim_shapecalc]: 7.59002e-06 [elim_not_effective]: 1.334e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 9.80002e-06 [renormalize]: 2.59985e-07 [validate]: 4.709e-05 Sums bootstrap : 0.000303s : 0.79% type_inference : 0.033512s : 87.43% event_method : 0.000020s : 0.05% auto_monad : 0.000074s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.27% rewriter_before_opt_a : 0.000082s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.18% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000671s : 1.75% jit_opt_a.with_stream_mark : 0.000070s : 0.18% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001011s : 2.64% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.07% jit_opt_a.cse : 0.000052s : 0.14% jit_opt_a.replace_applicator : 0.000021s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000675s : 1.76% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000032s : 0.08% loop_unroll : 0.000443s : 1.16% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.14% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000507s : 1.32% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.12% Time group info: ------[substitution.] 0.000249 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.69% : 0.000007s : 3: substitution.graph_param_transform 84.98% : 0.000212s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033430 2 95.43% : 0.031902s : 1: type_inference.infer 4.57% : 0.001528s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.64% : 0.000051s : 4: replace.inline 32.36% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.85% : 0.000209s : 4: match.inline 5.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 1.63% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.66% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.73% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.53% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.68% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.15% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.02% : 0.000001s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.78% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.69% : 0.000011s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000800 13 42.37% : 0.000339s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.16% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.47% : 0.000404s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044618 72 0.13% : 0.000058s : 1: add_recomputation 0.18% : 0.000078s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.71% : 0.000316s : 1: bootstrap 0.08% : 0.000035s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.81% : 0.006162s : 1: jit_opt_a 0.37% : 0.000165s : 1: jit_opt_after_cconv 0.13% : 0.000056s : 1: jit_opt_b 1.01% : 0.000452s : 1: loop_unroll 1.54% : 0.000685s : 1: mutable_eliminate 2.03% : 0.000904s : 26: opt.transform.jit_opt_a 0.11% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.16% : 0.000519s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000106s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.34% : 0.000598s : 1: renormalize.infer 0.90% : 0.000404s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000043s : 1: rewriter_after_opt_a 0.19% : 0.000086s : 1: rewriter_before_opt_a 0.18% : 0.000079s : 1: symbol_engine_optimizer 75.15% : 0.033531s : 1: type_inference TotalTime = 0.0346198, [30] [bootstrap]: 0.00042696 [type_inference]: 0.0156022 [event_method]: 2.654e-05 [auto_monad]: 0.00015003 [graph_reusing]: 7.26001e-06 [pre_auto_parallel]: 1.281e-05 [py_interpret_to_execute]: 6.404e-05 [rewriter_before_opt_a]: 0.00012643 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.0144248, [2] [Cycle 1]: 0.00194944, [27] [switch_simplify]: 9.297e-05 [loop_unroll]: 3.107e-05 [a_1]: 0.00055829 [with_stream_mark]: 1.9e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 1.428e-05 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.714e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.327e-05 [inline_without_move]: 5.66003e-06 [renormalize]: 0.00083217 [add_forward_monad_depend]: 2.542e-05 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.544e-05 [cse]: 3.61e-05 [replace_applicator]: 1.344e-05 [Cycle 2]: 0.00032829, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 5.07e-06 [a_1]: 9.036e-05 [with_stream_mark]: 9.91998e-06 [recompute_prepare]: 5.42999e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.61999e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 8.22e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 7.64002e-06 [inline_without_move]: 4.92e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.71998e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.472e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.219e-05 [rewriter_after_opt_a]: 4.745e-05 [convert_after_rewriter]: 2.01e-05 [order_py_execute_after_rewriter]: 5.62001e-06 [mutable_eliminate]: 0.00186421 [jit_opt_b]: 5.197e-05, [1] [Cycle 1]: 4.396e-05, [2] [frontend_op_eliminate]: 1.656e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 2.884e-05 [loop_unroll]: 0.00051565 [jit_opt_after_cconv]: 0.00016506, [1] [Cycle 1]: 0.00015772, [11] [c_1]: 2.035e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 8.55999e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.79999e-06 [cse]: 3.824e-05 [call_graph_tuple_transform]: 1.882e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.785e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 3.545e-05 [add_recomputation]: 6.812e-05 [cse_after_recomputation]: 2.811e-05, [1] [Cycle 1]: 2.189e-05, [1] [cse]: 1.491e-05 [auto_monad_reorder]: 2.642e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 3.48999e-06 [opt_after_jit_grad]: 0.00049706 [symbol_engine_optimizer]: 0.00010348, [1] [Cycle 1]: 9.655e-05, [6] [build]: 2.996e-05 [elim_shapecalc]: 8.87999e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 4.00003e-07 [validate]: 7.336e-05 Sums bootstrap : 0.000427s : 1.96% type_inference : 0.015602s : 71.44% event_method : 0.000027s : 0.12% auto_monad : 0.000150s : 0.69% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000013s : 0.06% py_interpret_to_execute : 0.000064s : 0.29% rewriter_before_opt_a : 0.000126s : 0.58% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000099s : 0.45% jit_opt_a.loop_unroll : 0.000036s : 0.17% jit_opt_a.a_1 : 0.000649s : 2.97% jit_opt_a.with_stream_mark : 0.000029s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.000832s : 3.81% jit_opt_a.add_forward_monad_depend : 0.000027s : 0.12% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.14% jit_opt_a.cse : 0.000051s : 0.23% jit_opt_a.replace_applicator : 0.000019s : 0.09% py_interpret_to_execute_after_opt_a : 0.000012s : 0.06% rewriter_after_opt_a : 0.000047s : 0.22% convert_after_rewriter : 0.000020s : 0.09% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.001864s : 8.54% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.08% jit_opt_b.inline_after_opt_a : 0.000017s : 0.08% cconv : 0.000029s : 0.13% loop_unroll : 0.000516s : 2.36% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000018s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000035s : 0.16% add_recomputation : 0.000068s : 0.31% cse_after_recomputation.cse : 0.000015s : 0.07% auto_monad_reorder : 0.000026s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000003s : 0.02% opt_after_jit_grad : 0.000497s : 2.28% symbol_engine_optimizer.build : 0.000030s : 0.14% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000073s : 0.34% Time group info: ------[substitution.] 0.000231 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000005s : 3: substitution.graph_param_transform 80.77% : 0.000187s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 6.21% : 0.000014s : 4: substitution.remove_not_recompute_node 2.05% : 0.000005s : 2: substitution.replace_old_param 5.84% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015505 2 89.09% : 0.013814s : 1: type_inference.infer 10.91% : 0.001691s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.10% : 0.000050s : 4: replace.inline 31.90% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.69% : 0.000184s : 4: match.inline 6.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.06% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.47% : 0.000001s : 3: predicate.graph_param_transform 5.96% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.68% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.39% : 0.000003s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.93% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.79% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.12% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.06% : 0.000010s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.04% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000980 13 44.13% : 0.000433s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.60% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.27% : 0.000512s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036373 72 0.20% : 0.000072s : 1: add_recomputation 0.43% : 0.000155s : 1: auto_monad 0.08% : 0.000029s : 1: auto_monad_reorder 1.24% : 0.000450s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.06% : 0.000023s : 1: convert_after_rewriter 0.08% : 0.000030s : 1: cse_after_recomputation 0.11% : 0.000038s : 1: environ_conv 0.09% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 39.67% : 0.014428s : 1: jit_opt_a 0.46% : 0.000168s : 1: jit_opt_after_cconv 0.15% : 0.000056s : 1: jit_opt_b 1.44% : 0.000524s : 1: loop_unroll 5.16% : 0.001877s : 1: mutable_eliminate 2.49% : 0.000905s : 26: opt.transform.jit_opt_a 0.13% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000022s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.39% : 0.000505s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.04% : 0.000015s : 1: pre_auto_parallel 0.18% : 0.000067s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.22% : 0.000445s : 1: renormalize.infer 1.04% : 0.000378s : 1: renormalize.specialize 0.02% : 0.000005s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000051s : 1: rewriter_after_opt_a 0.36% : 0.000130s : 1: rewriter_before_opt_a 0.29% : 0.000106s : 1: symbol_engine_optimizer 42.95% : 0.015622s : 1: type_inference TotalTime = 0.268368, [30] [bootstrap]: 0.00033366 [type_inference]: 0.22942 [event_method]: 2.127e-05 [auto_monad]: 7.484e-05 [graph_reusing]: 6.71e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00058012 [rewriter_before_opt_a]: 9.764e-05 [expand_dump_flag]: 4.04002e-06 [jit_opt_a]: 0.0349447, [2] [Cycle 1]: 0.0308613, [27] [switch_simplify]: 6.306e-05 [loop_unroll]: 3.119e-05 [a_1]: 0.00064296 [with_stream_mark]: 2.314e-05 [recompute_prepare]: 0.0263711 [updatestate_depend_eliminate]: 1.815e-05 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.80997e-06 [parameter_eliminate]: 4.62e-06 [specialize_transform]: 2.517e-05 [updatestate_useless_node_eliminater]: 1.002e-05 [accelerated_algorithm]: 1.021e-05 [meta_shard_fg_expand]: 4.20999e-06 [get_grad_eliminate_]: 7.82e-06 [merge_forward]: 4.55999e-06 [cell_reuse_recompute_pass]: 3.88999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.151e-05 [j_node_and_user_rematch]: 1.293e-05 [meta_fg_expand]: 3.48e-06 [replace_old_param]: 1.178e-05 [inline_without_move]: 6.88e-06 [renormalize]: 0.00327089 [add_forward_monad_depend]: 7.13998e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.751e-05 [cse]: 2.843e-05 [replace_applicator]: 2.034e-05 [Cycle 2]: 0.0003839, [27] [switch_simplify]: 7.75998e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00013154 [with_stream_mark]: 1.243e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 3.02002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.734e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.03997e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.224e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 9.55001e-06 [rewriter_after_opt_a]: 3.452e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00067875 [jit_opt_b]: 6.077e-05, [1] [Cycle 1]: 5.354e-05, [2] [frontend_op_eliminate]: 2.059e-05 [inline_after_opt_a]: 2.041e-05 [cconv]: 2.955e-05 [loop_unroll]: 0.00046428 [jit_opt_after_cconv]: 0.0001659, [1] [Cycle 1]: 0.0001593, [11] [c_1]: 2.874e-05 [parameter_eliminate]: 3.19001e-06 [updatestate_depend_eliminate]: 6.78e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 3.14001e-06 [cse]: 2.661e-05 [call_graph_tuple_transform]: 2.083e-05 [tuple_list_get_item_eliminator]: 6.64999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 8.50999e-06 [add_recomputation]: 6.719e-05 [cse_after_recomputation]: 2.461e-05, [1] [Cycle 1]: 1.933e-05, [1] [cse]: 1.357e-05 [auto_monad_reorder]: 1.468e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.54999e-06 [opt_after_jit_grad]: 0.00081569 [symbol_engine_optimizer]: 9.195e-05, [1] [Cycle 1]: 8.448e-05, [6] [build]: 4.30999e-06 [elim_shapecalc]: 1.148e-05 [elim_not_effective]: 2.04e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 1.267e-05 [renormalize]: 7.00005e-07 [validate]: 0.00017957 Sums bootstrap : 0.000334s : 0.13% type_inference : 0.229420s : 86.90% event_method : 0.000021s : 0.01% auto_monad : 0.000075s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000580s : 0.22% rewriter_before_opt_a : 0.000098s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000774s : 0.29% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.026377s : 9.99% jit_opt_a.updatestate_depend_eliminate : 0.000021s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000031s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003271s : 1.24% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000041s : 0.02% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000010s : 0.00% rewriter_after_opt_a : 0.000035s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000679s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000464s : 0.18% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000067s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000816s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000180s : 0.07% Time group info: ------[substitution.] 0.000267 24 2.47% : 0.000007s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000006s : 4: substitution.graph_param_transform 83.92% : 0.000224s : 4: substitution.inline 1.79% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000006s : 4: substitution.remove_not_recompute_node 2.18% : 0.000006s : 2: substitution.replace_old_param 4.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.229337 2 98.53% : 0.225975s : 1: type_inference.infer 1.47% : 0.003362s : 1: type_inference.specialize ------[replace.] 0.000085 6 67.37% : 0.000057s : 4: replace.inline 32.63% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 6 94.83% : 0.000221s : 4: match.inline 5.17% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.02% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.28% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.26% : 0.000003s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 1.89% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000003s : 12: predicate.reduce_eliminate 1.26% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.52% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.79% : 0.000003s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.63% : 0.000011s : 58: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.43% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.60% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002532 22 66.64% : 0.001687s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.25% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.10% : 0.000788s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.272650 72 0.03% : 0.000070s : 1: add_recomputation 0.03% : 0.000078s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.13% : 0.000349s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.82% : 0.034949s : 1: jit_opt_a 0.06% : 0.000169s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.17% : 0.000474s : 1: loop_unroll 0.25% : 0.000688s : 1: mutable_eliminate 0.39% : 0.001057s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000830s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000588s : 1: py_interpret_to_execute 0.00% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.90% : 0.002453s : 1: renormalize.infer 0.30% : 0.000807s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000037s : 1: rewriter_after_opt_a 0.04% : 0.000104s : 1: rewriter_before_opt_a 0.03% : 0.000095s : 1: symbol_engine_optimizer 84.15% : 0.229436s : 1: type_inference TotalTime = 0.0354992, [30] [bootstrap]: 0.00030747 [type_inference]: 0.00856738 [event_method]: 1.957e-05 [auto_monad]: 6.814e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.12999e-06 [py_interpret_to_execute]: 4.458e-05 [rewriter_before_opt_a]: 8.347e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0235701, [2] [Cycle 1]: 0.00227255, [27] [switch_simplify]: 7.399e-05 [loop_unroll]: 3.591e-05 [a_1]: 0.00080197 [with_stream_mark]: 2.505e-05 [recompute_prepare]: 1.22e-05 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.55003e-06 [parameter_eliminate]: 2.69001e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.96999e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.76998e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.613e-05 [j_node_and_user_rematch]: 1.162e-05 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 1.066e-05 [inline_without_move]: 5.94e-06 [renormalize]: 0.00088967 [add_forward_monad_depend]: 8.58001e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 2.05e-05 [cse]: 4.413e-05 [replace_applicator]: 2.082e-05 [Cycle 2]: 0.00037233, [27] [switch_simplify]: 6.41e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.504e-05 [with_stream_mark]: 1.515e-05 [recompute_prepare]: 6.01998e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 4.58001e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.725e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 8.64e-06 [inline_without_move]: 5.29e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.08998e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 8.65001e-06 [cse]: 1.711e-05 [replace_applicator]: 7.35998e-06 [py_interpret_to_execute_after_opt_a]: 1.855e-05 [rewriter_after_opt_a]: 4.677e-05 [convert_after_rewriter]: 9.39e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00081917 [jit_opt_b]: 5.979e-05, [1] [Cycle 1]: 5.054e-05, [2] [frontend_op_eliminate]: 1.985e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 3.394e-05 [loop_unroll]: 0.0005318 [jit_opt_after_cconv]: 0.00018569, [1] [Cycle 1]: 0.00017747, [11] [c_1]: 2.279e-05 [parameter_eliminate]: 5.71e-06 [updatestate_depend_eliminate]: 8.42e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.25002e-06 [cse]: 4.529e-05 [call_graph_tuple_transform]: 2.201e-05 [tuple_list_get_item_eliminator]: 5.80002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 1.22e-06 [switch_simplify]: 5.57999e-06 [remove_dup_value]: 4.777e-05 [partial_unused_args_eliminate]: 2.83e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 5.653e-05 [cse_after_recomputation]: 2.909e-05, [1] [Cycle 1]: 2.258e-05, [1] [cse]: 1.41e-05 [auto_monad_reorder]: 2.015e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 6.63e-06 [opt_after_jit_grad]: 0.00061197 [symbol_engine_optimizer]: 8.16e-05, [1] [Cycle 1]: 7.371e-05, [6] [build]: 5.23002e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.531e-05 [opt_reshape]: 6.38998e-06 [fold_const_symbol]: 9.27999e-06 [renormalize]: 5.99975e-07 [validate]: 4.805e-05 Sums bootstrap : 0.000307s : 2.22% type_inference : 0.008567s : 61.74% event_method : 0.000020s : 0.14% auto_monad : 0.000068s : 0.49% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.32% rewriter_before_opt_a : 0.000083s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000080s : 0.58% jit_opt_a.loop_unroll : 0.000041s : 0.30% jit_opt_a.a_1 : 0.000897s : 6.46% jit_opt_a.with_stream_mark : 0.000040s : 0.29% jit_opt_a.recompute_prepare : 0.000018s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000005s : 0.04% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000009s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000890s : 6.41% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.08% jit_opt_a.auto_monad_grad : 0.000005s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.21% jit_opt_a.cse : 0.000061s : 0.44% jit_opt_a.replace_applicator : 0.000028s : 0.20% py_interpret_to_execute_after_opt_a : 0.000019s : 0.13% rewriter_after_opt_a : 0.000047s : 0.34% convert_after_rewriter : 0.000009s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000819s : 5.90% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.14% jit_opt_b.inline_after_opt_a : 0.000018s : 0.13% cconv : 0.000034s : 0.24% loop_unroll : 0.000532s : 3.83% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000045s : 0.33% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000048s : 0.34% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000057s : 0.41% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000020s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000612s : 4.41% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.35% Time group info: ------[substitution.] 0.000354 24 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.72% : 0.000006s : 3: substitution.graph_param_transform 73.19% : 0.000259s : 5: substitution.inline 1.63% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000006s : 4: substitution.remove_not_recompute_node 1.38% : 0.000005s : 2: substitution.replace_old_param 19.40% : 0.000069s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008502 2 88.31% : 0.007508s : 1: type_inference.infer 11.69% : 0.000994s : 1: type_inference.specialize ------[replace.] 0.000122 7 63.23% : 0.000077s : 5: replace.inline 36.77% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 7 79.18% : 0.000255s : 5: match.inline 20.82% : 0.000067s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 747 1.47% : 0.000002s : 11: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 1.96% : 0.000003s : 11: predicate.arithmetic_simplify 1.14% : 0.000002s : 11: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.32% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.58% : 0.000001s : 3: predicate.graph_param_transform 5.79% : 0.000008s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.56% : 0.000002s : 16: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 1.92% : 0.000003s : 16: predicate.partial_eliminate 1.03% : 0.000001s : 11: predicate.print_const_string_wrapper 2.05% : 0.000003s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000003s : 19: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 11: predicate.reshape_eliminate 1.21% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 11: predicate.same_eliminate 0.80% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.73% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.93% : 0.000004s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 59: predicate.switch_simplify 1.12% : 0.000002s : 11: predicate.tile_eliminate 1.06% : 0.000002s : 11: predicate.transpose_eliminate 1.49% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 2.66% : 0.000004s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.95% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000832 16 50.62% : 0.000421s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.00% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.37% : 0.000328s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037614 72 0.16% : 0.000060s : 1: add_recomputation 0.19% : 0.000072s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.85% : 0.000321s : 1: bootstrap 0.10% : 0.000037s : 1: cconv 0.03% : 0.000012s : 1: convert_after_rewriter 0.08% : 0.000031s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.06% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 62.68% : 0.023575s : 1: jit_opt_a 0.50% : 0.000189s : 1: jit_opt_after_cconv 0.17% : 0.000063s : 1: jit_opt_b 1.44% : 0.000543s : 1: loop_unroll 2.21% : 0.000831s : 1: mutable_eliminate 3.09% : 0.001163s : 26: opt.transform.jit_opt_a 0.14% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000022s : 1: opt.transform.mutable_eliminate 0.09% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.66% : 0.000624s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000048s : 1: py_interpret_to_execute 0.06% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000051s : 1: remove_dup_value 1.34% : 0.000505s : 1: renormalize.infer 1.00% : 0.000375s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000052s : 1: rewriter_after_opt_a 0.23% : 0.000086s : 1: rewriter_before_opt_a 0.23% : 0.000085s : 1: symbol_engine_optimizer 22.81% : 0.008580s : 1: type_inference TotalTime = 0.0504419, [30] [bootstrap]: 0.0003136 [type_inference]: 0.0393901 [event_method]: 2.335e-05 [auto_monad]: 7.431e-05 [graph_reusing]: 5.46002e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 0.00013092 [rewriter_before_opt_a]: 8.225e-05 [expand_dump_flag]: 3.73999e-06 [jit_opt_a]: 0.00706873, [2] [Cycle 1]: 0.00272979, [27] [switch_simplify]: 6.142e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.0006423 [with_stream_mark]: 2.553e-05 [recompute_prepare]: 1.053e-05 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.76999e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 4.95001e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.641e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 6.13998e-06 [renormalize]: 0.00153111 [add_forward_monad_depend]: 1.022e-05 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 2.208e-05 [cse]: 4.17e-05 [replace_applicator]: 2.503e-05 [Cycle 2]: 0.000397, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 6.43998e-06 [a_1]: 0.00011084 [with_stream_mark]: 1.78e-05 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.736e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 8.72e-06 [cse]: 1.69e-05 [replace_applicator]: 7.26999e-06 [py_interpret_to_execute_after_opt_a]: 1.886e-05 [rewriter_after_opt_a]: 4.801e-05 [convert_after_rewriter]: 8.45999e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00093165 [jit_opt_b]: 6.416e-05, [1] [Cycle 1]: 5.295e-05, [2] [frontend_op_eliminate]: 2.113e-05 [inline_after_opt_a]: 1.879e-05 [cconv]: 3.854e-05 [loop_unroll]: 0.00065357 [jit_opt_after_cconv]: 0.00019518, [1] [Cycle 1]: 0.00018725, [11] [c_1]: 2.553e-05 [parameter_eliminate]: 5.58002e-06 [updatestate_depend_eliminate]: 8.87e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 2.94999e-06 [cse]: 4.445e-05 [call_graph_tuple_transform]: 2.616e-05 [tuple_list_get_item_eliminator]: 5.96998e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 1.04998e-06 [switch_simplify]: 7.06001e-06 [remove_dup_value]: 1.763e-05 [partial_unused_args_eliminate]: 3.51999e-06 [environ_conv]: 8.03001e-06 [add_recomputation]: 0.00010481 [cse_after_recomputation]: 2.91e-05, [1] [Cycle 1]: 2.279e-05, [1] [cse]: 1.445e-05 [auto_monad_reorder]: 1.837e-05 [get_jit_bprop_graph]: 2.72001e-06 [rewriter_after_jit_bprop_graph]: 1.044e-05 [opt_after_jit_grad]: 0.00076199 [symbol_engine_optimizer]: 8.925e-05, [1] [Cycle 1]: 8.022e-05, [6] [build]: 5.74e-06 [elim_shapecalc]: 1.03e-05 [elim_not_effective]: 1.633e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 1.081e-05 [renormalize]: 1.10001e-06 [validate]: 5.606e-05 Sums bootstrap : 0.000314s : 0.69% type_inference : 0.039390s : 86.15% event_method : 0.000023s : 0.05% auto_monad : 0.000074s : 0.16% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000131s : 0.29% rewriter_before_opt_a : 0.000082s : 0.18% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.15% jit_opt_a.loop_unroll : 0.000037s : 0.08% jit_opt_a.a_1 : 0.000753s : 1.65% jit_opt_a.with_stream_mark : 0.000043s : 0.09% jit_opt_a.recompute_prepare : 0.000017s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001531s : 3.35% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.07% jit_opt_a.cse : 0.000059s : 0.13% jit_opt_a.replace_applicator : 0.000032s : 0.07% py_interpret_to_execute_after_opt_a : 0.000019s : 0.04% rewriter_after_opt_a : 0.000048s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000932s : 2.04% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000039s : 0.08% loop_unroll : 0.000654s : 1.43% jit_opt_after_cconv.c_1 : 0.000026s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000044s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000004s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000105s : 0.23% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000762s : 1.67% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.12% Time group info: ------[substitution.] 0.000278 23 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.82% : 0.000008s : 3: substitution.graph_param_transform 84.57% : 0.000235s : 4: substitution.inline 1.70% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 4.84% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039300 2 94.85% : 0.037275s : 1: type_inference.infer 5.15% : 0.002026s : 1: type_inference.specialize ------[replace.] 0.000088 6 65.27% : 0.000057s : 4: replace.inline 34.73% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 95.06% : 0.000232s : 4: match.inline 4.94% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.44% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.89% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 2.27% : 0.000003s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 1.10% : 0.000002s : 3: predicate.check_bprop_eliminate 1.21% : 0.000002s : 10: predicate.compare_switch_simplify 1.08% : 0.000002s : 10: predicate.depend_value_elim 1.33% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.68% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.37% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.85% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.86% : 0.000001s : 10: predicate.environ_get_depend_swap 1.03% : 0.000002s : 10: predicate.environ_get_eliminate 0.87% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.78% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000009s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.54% : 0.000002s : 15: predicate.load_eliminater 1.72% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.52% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 10: predicate.merge_addn 1.72% : 0.000003s : 10: predicate.minmaximum_grad 2.22% : 0.000003s : 3: predicate.mutable_eliminate 0.66% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.39% : 0.000002s : 10: predicate.print_const_string_wrapper 1.81% : 0.000003s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000003s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.09% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.19% : 0.000002s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.59% : 0.000010s : 53: predicate.switch_simplify 1.05% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.13% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.73% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.34% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.30% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001084 13 43.10% : 0.000467s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.45% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.45% : 0.000558s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053000 72 0.21% : 0.000109s : 1: add_recomputation 0.15% : 0.000078s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.63% : 0.000333s : 1: bootstrap 0.08% : 0.000042s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.06% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 13.35% : 0.007073s : 1: jit_opt_a 0.37% : 0.000198s : 1: jit_opt_after_cconv 0.13% : 0.000067s : 1: jit_opt_b 1.26% : 0.000666s : 1: loop_unroll 1.79% : 0.000948s : 1: mutable_eliminate 1.90% : 0.001006s : 26: opt.transform.jit_opt_a 0.11% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000025s : 1: opt.transform.mutable_eliminate 0.07% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000041s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000776s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000136s : 1: py_interpret_to_execute 0.04% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.75% : 0.000928s : 1: renormalize.infer 1.11% : 0.000591s : 1: renormalize.specialize 0.03% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000052s : 1: rewriter_after_opt_a 0.16% : 0.000087s : 1: rewriter_before_opt_a 0.18% : 0.000094s : 1: symbol_engine_optimizer 74.36% : 0.039412s : 1: type_inference TotalTime = 0.0233581, [30] [bootstrap]: 0.00040154 [type_inference]: 0.00659915 [event_method]: 2.485e-05 [auto_monad]: 7.896e-05 [graph_reusing]: 7.01999e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 5.18e-05 [rewriter_before_opt_a]: 9.663e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.0135128, [2] [Cycle 1]: 0.00427308, [27] [switch_simplify]: 7.586e-05 [loop_unroll]: 3.577e-05 [a_1]: 0.00075127 [with_stream_mark]: 2.637e-05 [recompute_prepare]: 3.481e-05 [updatestate_depend_eliminate]: 8.99e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 4.72e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.86999e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 3.42002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.069e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.97002e-06 [replace_old_param]: 9.61003e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 0.00081318 [add_forward_monad_depend]: 8.28999e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.381e-05 [cse]: 2.781e-05 [replace_applicator]: 1.513e-05 [Cycle 2]: 0.00035713, [27] [switch_simplify]: 5.89999e-06 [loop_unroll]: 4.87998e-06 [a_1]: 0.00010572 [with_stream_mark]: 1.659e-05 [recompute_prepare]: 4.87998e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.54998e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.70999e-06 [accelerated_algorithm]: 4.93001e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 4.72e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 5.43002e-06 [cse]: 1.086e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.642e-05 [rewriter_after_opt_a]: 3.601e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00085447 [jit_opt_b]: 5.205e-05, [1] [Cycle 1]: 4.363e-05, [2] [frontend_op_eliminate]: 1.698e-05 [inline_after_opt_a]: 1.544e-05 [cconv]: 3.139e-05 [loop_unroll]: 0.00048632 [jit_opt_after_cconv]: 0.00015115, [1] [Cycle 1]: 0.00014382, [11] [c_1]: 2.105e-05 [parameter_eliminate]: 3.91001e-06 [updatestate_depend_eliminate]: 5.64e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 2.456e-05 [call_graph_tuple_transform]: 1.961e-05 [tuple_list_get_item_eliminator]: 5.05001e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 5.15001e-06 [remove_dup_value]: 1.445e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 5.37001e-06 [add_recomputation]: 4.717e-05 [cse_after_recomputation]: 2.121e-05, [1] [Cycle 1]: 1.601e-05, [1] [cse]: 8.87999e-06 [auto_monad_reorder]: 1.629e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 7.48999e-06 [opt_after_jit_grad]: 0.00052237 [symbol_engine_optimizer]: 7.349e-05, [1] [Cycle 1]: 6.679e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.419e-05 [opt_reshape]: 5.33002e-06 [fold_const_symbol]: 7.9e-06 [renormalize]: 9.80013e-07 [validate]: 3.759e-05 Sums bootstrap : 0.000402s : 3.44% type_inference : 0.006599s : 56.52% event_method : 0.000025s : 0.21% auto_monad : 0.000079s : 0.68% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000052s : 0.44% rewriter_before_opt_a : 0.000097s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000082s : 0.70% jit_opt_a.loop_unroll : 0.000041s : 0.35% jit_opt_a.a_1 : 0.000857s : 7.34% jit_opt_a.with_stream_mark : 0.000043s : 0.37% jit_opt_a.recompute_prepare : 0.000040s : 0.34% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.10% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.05% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000813s : 6.97% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.16% jit_opt_a.cse : 0.000039s : 0.33% jit_opt_a.replace_applicator : 0.000020s : 0.17% py_interpret_to_execute_after_opt_a : 0.000016s : 0.14% rewriter_after_opt_a : 0.000036s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000854s : 7.32% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000031s : 0.27% loop_unroll : 0.000486s : 4.17% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000014s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000047s : 0.40% cse_after_recomputation.cse : 0.000009s : 0.08% auto_monad_reorder : 0.000016s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000522s : 4.47% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000038s : 0.32% Time group info: ------[substitution.] 0.000316 25 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.65% : 0.000005s : 3: substitution.graph_param_transform 87.26% : 0.000276s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000006s : 4: substitution.remove_not_recompute_node 1.84% : 0.000006s : 2: substitution.replace_old_param 5.04% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006513 2 82.64% : 0.005382s : 1: type_inference.infer 17.36% : 0.001130s : 1: type_inference.specialize ------[replace.] 0.000102 8 64.64% : 0.000066s : 5: replace.inline 35.36% : 0.000036s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000286 8 94.96% : 0.000272s : 5: match.inline 5.04% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 810 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 12: predicate.addn_check_dump 7.49% : 0.000012s : 12: predicate.addn_zero_filter 1.64% : 0.000003s : 12: predicate.arithmetic_simplify 1.14% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 12: predicate.compare_switch_simplify 1.31% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.23% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.45% : 0.000002s : 12: predicate.environ_get_eliminate 1.25% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000001s : 3: predicate.graph_param_transform 6.44% : 0.000010s : 26: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.26% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.82% : 0.000003s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 18: predicate.load_eliminater 1.01% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 0.97% : 0.000002s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.72% : 0.000003s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 21: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 0.98% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.29% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.78% : 0.000011s : 64: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.06% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.00% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.61% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000889 16 50.84% : 0.000452s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.49% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.67% : 0.000344s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025351 72 0.20% : 0.000050s : 1: add_recomputation 0.33% : 0.000083s : 1: auto_monad 0.07% : 0.000019s : 1: auto_monad_reorder 1.65% : 0.000418s : 1: bootstrap 0.13% : 0.000034s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.12% : 0.000030s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 53.32% : 0.013517s : 1: jit_opt_a 0.61% : 0.000154s : 1: jit_opt_after_cconv 0.22% : 0.000055s : 1: jit_opt_b 1.96% : 0.000496s : 1: loop_unroll 3.41% : 0.000864s : 1: mutable_eliminate 4.44% : 0.001126s : 26: opt.transform.jit_opt_a 0.18% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000017s : 1: opt.transform.mutable_eliminate 0.10% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.10% : 0.000531s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000055s : 1: py_interpret_to_execute 0.07% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000017s : 1: remove_dup_value 1.71% : 0.000433s : 1: renormalize.infer 1.45% : 0.000369s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000039s : 1: rewriter_after_opt_a 0.40% : 0.000100s : 1: rewriter_before_opt_a 0.30% : 0.000076s : 1: symbol_engine_optimizer 26.12% : 0.006621s : 1: type_inference TotalTime = 0.0720951, [30] [bootstrap]: 0.00035181 [type_inference]: 0.0386071 [event_method]: 1.919e-05 [auto_monad]: 7.031e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.00010329 [rewriter_before_opt_a]: 7.483e-05 [expand_dump_flag]: 3.22002e-06 [jit_opt_a]: 0.00585142, [2] [Cycle 1]: 0.00203479, [27] [switch_simplify]: 6.13e-05 [loop_unroll]: 2.997e-05 [a_1]: 0.00058335 [with_stream_mark]: 2.489e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.388e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00096981 [add_forward_monad_depend]: 7.3e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.868e-05 [cse]: 3.74e-05 [replace_applicator]: 1.698e-05 [Cycle 2]: 0.00034612, [27] [switch_simplify]: 6.36998e-06 [loop_unroll]: 5.27001e-06 [a_1]: 9.035e-05 [with_stream_mark]: 1.499e-05 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.78003e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.62002e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.14e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 7.78001e-06 [cse]: 1.69e-05 [replace_applicator]: 6.93e-06 [py_interpret_to_execute_after_opt_a]: 1.705e-05 [rewriter_after_opt_a]: 4.464e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 4.72998e-06 [mutable_eliminate]: 0.00073994 [jit_opt_b]: 5.652e-05, [1] [Cycle 1]: 4.669e-05, [2] [frontend_op_eliminate]: 1.604e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 3.446e-05 [loop_unroll]: 0.0245677 [jit_opt_after_cconv]: 0.00020214, [1] [Cycle 1]: 0.00019186, [11] [c_1]: 2.747e-05 [parameter_eliminate]: 5.36002e-06 [updatestate_depend_eliminate]: 1.15e-05 [updatestate_assign_eliminate]: 4.13999e-06 [updatestate_loads_eliminate]: 3.2e-06 [cse]: 4.604e-05 [call_graph_tuple_transform]: 2.66e-05 [tuple_list_get_item_eliminator]: 6.39001e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 1.05001e-06 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.899e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 8.32998e-06 [add_recomputation]: 5.961e-05 [cse_after_recomputation]: 3.141e-05, [1] [Cycle 1]: 2.485e-05, [1] [cse]: 1.593e-05 [auto_monad_reorder]: 1.968e-05 [get_jit_bprop_graph]: 2.76e-06 [rewriter_after_jit_bprop_graph]: 9.69999e-06 [opt_after_jit_grad]: 0.00079494 [symbol_engine_optimizer]: 8.758e-05, [1] [Cycle 1]: 7.707e-05, [6] [build]: 5.05001e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 1.639e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 9.08002e-06 [renormalize]: 5.60016e-07 [validate]: 4.853e-05 Sums bootstrap : 0.000352s : 0.52% type_inference : 0.038607s : 56.83% event_method : 0.000019s : 0.03% auto_monad : 0.000070s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000103s : 0.15% rewriter_before_opt_a : 0.000075s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000674s : 0.99% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000970s : 1.43% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000054s : 0.08% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000045s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000740s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000034s : 0.05% loop_unroll : 0.024568s : 36.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000060s : 0.09% cse_after_recomputation.cse : 0.000016s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000795s : 1.17% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000250 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000007s : 3: substitution.graph_param_transform 84.57% : 0.000211s : 4: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000006s : 2: substitution.replace_old_param 5.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038535 2 96.40% : 0.037147s : 1: type_inference.infer 3.60% : 0.001388s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.42% : 0.000050s : 4: replace.inline 33.58% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.15% : 0.000208s : 4: match.inline 5.85% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.25% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.10% : 0.000001s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.87% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 1.13% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 6.41% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 15: predicate.load_eliminater 3.09% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 0.98% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.26% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 1.15% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.04% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 0.95% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.39% : 0.000011s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000869 13 52.45% : 0.000456s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.58% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.97% : 0.000356s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.074056 72 0.09% : 0.000064s : 1: add_recomputation 0.10% : 0.000074s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.51% : 0.000374s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.91% : 0.005855s : 1: jit_opt_a 0.28% : 0.000205s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 33.19% : 0.024582s : 1: loop_unroll 1.02% : 0.000756s : 1: mutable_eliminate 1.22% : 0.000903s : 26: opt.transform.jit_opt_a 0.09% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000029s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.09% : 0.000809s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000107s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000056s : 1: remove_dup_value 0.75% : 0.000558s : 1: renormalize.infer 0.54% : 0.000403s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000048s : 1: rewriter_after_opt_a 0.11% : 0.000078s : 1: rewriter_before_opt_a 0.12% : 0.000092s : 1: symbol_engine_optimizer 52.15% : 0.038622s : 1: type_inference TotalTime = 0.0606646, [30] [bootstrap]: 0.00033289 [type_inference]: 0.0384595 [event_method]: 2.153e-05 [auto_monad]: 6.888e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00011881 [rewriter_before_opt_a]: 8.305e-05 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.0186963, [2] [Cycle 1]: 0.0147138, [27] [switch_simplify]: 5.719e-05 [loop_unroll]: 3.002e-05 [a_1]: 0.00059002 [with_stream_mark]: 2.248e-05 [recompute_prepare]: 8.49002e-06 [updatestate_depend_eliminate]: 4.61002e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.0135937 [add_forward_monad_depend]: 1.138e-05 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 2.528e-05 [cse]: 4.213e-05 [replace_applicator]: 2.691e-05 [Cycle 2]: 0.0004146, [27] [switch_simplify]: 7.90998e-06 [loop_unroll]: 6.91999e-06 [a_1]: 0.00012167 [with_stream_mark]: 1.892e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.93998e-06 [meta_shard_fg_expand]: 2.58003e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 5.39e-06 [cell_reuse_recompute_pass]: 2.93998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.99e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.81e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 6.84999e-06 [cse]: 1.824e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.83e-05 [rewriter_after_opt_a]: 4.411e-05 [convert_after_rewriter]: 7.93001e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00086123 [jit_opt_b]: 5.936e-05, [1] [Cycle 1]: 4.982e-05, [2] [frontend_op_eliminate]: 1.918e-05 [inline_after_opt_a]: 1.821e-05 [cconv]: 3.37e-05 [loop_unroll]: 0.00053142 [jit_opt_after_cconv]: 0.0001683, [1] [Cycle 1]: 0.00015926, [11] [c_1]: 2.363e-05 [parameter_eliminate]: 3.58999e-06 [updatestate_depend_eliminate]: 7.51999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 3.08e-05 [call_graph_tuple_transform]: 2.281e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 8.80013e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.878e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 6.51999e-06 [add_recomputation]: 5.825e-05 [cse_after_recomputation]: 7.72e-05, [1] [Cycle 1]: 2.155e-05, [1] [cse]: 1.417e-05 [auto_monad_reorder]: 1.96e-05 [get_jit_bprop_graph]: 2.52001e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.00060828 [symbol_engine_optimizer]: 8.045e-05, [1] [Cycle 1]: 7.175e-05, [6] [build]: 4.99e-06 [elim_shapecalc]: 8.61002e-06 [elim_not_effective]: 1.455e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 9.11002e-06 [renormalize]: 1.04e-06 [validate]: 4.651e-05 Sums bootstrap : 0.000333s : 0.59% type_inference : 0.038459s : 68.24% event_method : 0.000022s : 0.04% auto_monad : 0.000069s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000119s : 0.21% rewriter_before_opt_a : 0.000083s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.12% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000712s : 1.26% jit_opt_a.with_stream_mark : 0.000041s : 0.07% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.013594s : 24.12% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.06% jit_opt_a.cse : 0.000060s : 0.11% jit_opt_a.replace_applicator : 0.000033s : 0.06% py_interpret_to_execute_after_opt_a : 0.000018s : 0.03% rewriter_after_opt_a : 0.000044s : 0.08% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000861s : 1.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000034s : 0.06% loop_unroll : 0.000531s : 0.94% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000058s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000608s : 1.08% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.08% Time group info: ------[substitution.] 0.000258 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 84.39% : 0.000218s : 4: substitution.inline 1.84% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000006s : 4: substitution.remove_not_recompute_node 2.41% : 0.000006s : 2: substitution.replace_old_param 5.13% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038379 2 95.41% : 0.036618s : 1: type_inference.infer 4.59% : 0.001761s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.78% : 0.000054s : 4: replace.inline 31.22% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.66% : 0.000215s : 4: match.inline 5.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 691 1.11% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.09% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000002s : 10: predicate.cast_eliminate 0.62% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.04% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000002s : 10: predicate.environ_get_eliminate 1.25% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000002s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000007s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.95% : 0.000003s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 10: predicate.merge_addn 1.27% : 0.000002s : 10: predicate.minmaximum_grad 2.67% : 0.000004s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 2.18% : 0.000003s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.26% : 0.000002s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.11% : 0.000003s : 16: predicate.switch_defer_inline 1.85% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.72% : 0.000009s : 53: predicate.switch_simplify 1.47% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000002s : 10: predicate.transpose_eliminate 1.17% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 2.05% : 0.000003s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001164 13 41.36% : 0.000481s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.71% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.93% : 0.000628s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075280 72 0.08% : 0.000062s : 1: add_recomputation 0.10% : 0.000072s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.47% : 0.000356s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000080s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 24.84% : 0.018701s : 1: jit_opt_a 0.23% : 0.000172s : 1: jit_opt_after_cconv 0.08% : 0.000062s : 1: jit_opt_b 0.72% : 0.000544s : 1: loop_unroll 1.16% : 0.000875s : 1: mutable_eliminate 1.28% : 0.000962s : 26: opt.transform.jit_opt_a 0.07% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000623s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000123s : 1: py_interpret_to_execute 0.03% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 17.07% : 0.012847s : 1: renormalize.infer 0.97% : 0.000731s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000048s : 1: rewriter_after_opt_a 0.12% : 0.000087s : 1: rewriter_before_opt_a 0.11% : 0.000083s : 1: symbol_engine_optimizer 51.12% : 0.038480s : 1: type_inference TotalTime = 0.127283, [30] [bootstrap]: 0.00034257 [type_inference]: 0.074936 [event_method]: 0.0001236 [auto_monad]: 0.00017988 [graph_reusing]: 8.1e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 3.82e-05 [rewriter_before_opt_a]: 0.00015592 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0491498, [2] [Cycle 1]: 0.00336734, [27] [switch_simplify]: 0.00019878 [loop_unroll]: 5.421e-05 [a_1]: 0.00127292 [with_stream_mark]: 2.162e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.31998e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.37999e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00145499 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.655e-05 [cse]: 3.724e-05 [replace_applicator]: 1.416e-05 [Cycle 2]: 0.00032755, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 5.34998e-06 [a_1]: 9.096e-05 [with_stream_mark]: 9.90002e-06 [recompute_prepare]: 5.23002e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.14003e-06 [updatestate_useless_node_eliminater]: 5.01002e-06 [accelerated_algorithm]: 4.89e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.328e-05 [j_node_and_user_rematch]: 7.96001e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.312e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 1.337e-05 [rewriter_after_opt_a]: 4.533e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.0005786 [jit_opt_b]: 5.014e-05, [1] [Cycle 1]: 4.3e-05, [2] [frontend_op_eliminate]: 1.575e-05 [inline_after_opt_a]: 1.604e-05 [cconv]: 2.666e-05 [loop_unroll]: 0.00047902 [jit_opt_after_cconv]: 0.00014888, [1] [Cycle 1]: 0.00014262, [11] [c_1]: 2.213e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.406e-05 [call_graph_tuple_transform]: 1.915e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 3.055e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 5.39e-06 [add_recomputation]: 0.00010396 [cse_after_recomputation]: 2.587e-05, [1] [Cycle 1]: 1.997e-05, [1] [cse]: 1.376e-05 [auto_monad_reorder]: 1.742e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.57998e-06 [opt_after_jit_grad]: 0.00048416 [symbol_engine_optimizer]: 7.362e-05, [1] [Cycle 1]: 6.715e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 8.06001e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 5.94999e-06 [fold_const_symbol]: 8.93002e-06 [renormalize]: 3.80009e-07 [validate]: 3.815e-05 Sums bootstrap : 0.000343s : 0.42% type_inference : 0.074936s : 92.28% event_method : 0.000124s : 0.15% auto_monad : 0.000180s : 0.22% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.05% rewriter_before_opt_a : 0.000156s : 0.19% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000205s : 0.25% jit_opt_a.loop_unroll : 0.000060s : 0.07% jit_opt_a.a_1 : 0.001364s : 1.68% jit_opt_a.with_stream_mark : 0.000032s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001455s : 1.79% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000050s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000045s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000579s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000479s : 0.59% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000031s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000104s : 0.13% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000484s : 0.60% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.05% Time group info: ------[substitution.] 0.000515 33 0.42% : 0.000002s : 2: substitution.elim_not_effective 0.31% : 0.000002s : 2: substitution.fold_const_symbol 0.95% : 0.000005s : 3: substitution.graph_param_transform 90.89% : 0.000468s : 11: substitution.inline 0.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.82% : 0.000004s : 4: substitution.remove_not_recompute_node 0.98% : 0.000005s : 2: substitution.replace_old_param 2.22% : 0.000011s : 2: substitution.switch_simplify 2.73% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.074837 2 96.71% : 0.072375s : 1: type_inference.infer 3.29% : 0.002462s : 1: type_inference.specialize ------[replace.] 0.000290 16 51.12% : 0.000148s : 11: replace.inline 21.42% : 0.000062s : 2: replace.switch_simplify 27.46% : 0.000080s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000486 16 95.27% : 0.000463s : 11: match.inline 2.12% : 0.000010s : 2: match.switch_simplify 2.60% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000187 1148 1.50% : 0.000003s : 18: predicate.accumulaten_eliminater 0.75% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 18: predicate.addn_check_dump 1.51% : 0.000003s : 18: predicate.addn_zero_filter 2.18% : 0.000004s : 18: predicate.arithmetic_simplify 1.50% : 0.000003s : 18: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 18: predicate.compare_switch_simplify 1.32% : 0.000002s : 18: predicate.depend_value_elim 1.21% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.52% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.48% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.53% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.21% : 0.000000s : 3: predicate.elim_not_effective 0.40% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 18: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 18: predicate.environ_get_depend_swap 1.44% : 0.000003s : 18: predicate.environ_get_eliminate 1.29% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000002s : 6: predicate.get_grad_eliminate 0.28% : 0.000001s : 3: predicate.graph_param_transform 5.53% : 0.000010s : 38: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.25% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.67% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 24: predicate.load_eliminater 0.88% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.94% : 0.000009s : 64: predicate.loop_unroll_before_grad 2.06% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.27% : 0.000002s : 18: predicate.merge_addn 1.24% : 0.000002s : 18: predicate.minmaximum_grad 1.16% : 0.000002s : 3: predicate.mutable_eliminate 0.26% : 0.000000s : 3: predicate.opt_reshape 2.25% : 0.000004s : 24: predicate.partial_eliminate 1.30% : 0.000002s : 18: predicate.print_const_string_wrapper 1.77% : 0.000003s : 18: predicate.reduce_eliminate 1.53% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000003s : 27: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000001s : 3: predicate.reset_defer_inline 1.46% : 0.000003s : 18: predicate.reshape_eliminate 1.40% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.45% : 0.000001s : 3: predicate.row_tensor_eliminate 1.43% : 0.000003s : 18: predicate.same_eliminate 0.34% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.67% : 0.000001s : 6: predicate.special_op_eliminate 0.61% : 0.000001s : 6: predicate.specialize_transform 1.72% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 18: predicate.stack_unstack_eliminate 0.28% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.92% : 0.000005s : 32: predicate.switch_defer_inline 2.61% : 0.000005s : 32: predicate.switch_layer_defer_inline 9.34% : 0.000018s : 103: predicate.switch_simplify 1.43% : 0.000003s : 18: predicate.tile_eliminate 1.55% : 0.000003s : 18: predicate.transpose_eliminate 1.69% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000006s : 27: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.51% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.35% : 0.000004s : 30: predicate.updatestate_useless_node_eliminater 1.65% : 0.000003s : 18: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.36% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002099 28 50.98% : 0.001070s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.43% : 0.000240s : 6: func_graph_cloner_run.FuncGraphClonerNode 37.59% : 0.000789s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130540 72 0.08% : 0.000107s : 1: add_recomputation 0.14% : 0.000187s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.28% : 0.000363s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.10% : 0.000133s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 37.65% : 0.049154s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.04% : 0.000053s : 1: jit_opt_b 0.37% : 0.000488s : 1: loop_unroll 0.45% : 0.000588s : 1: mutable_eliminate 1.34% : 0.001750s : 26: opt.transform.jit_opt_a 0.04% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000034s : 1: remove_dup_value 0.75% : 0.000983s : 1: renormalize.infer 0.35% : 0.000461s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000048s : 1: rewriter_after_opt_a 0.12% : 0.000159s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 57.42% : 0.074959s : 1: type_inference TotalTime = 0.0211479, [30] [bootstrap]: 0.00036316 [type_inference]: 0.0110612 [event_method]: 2.279e-05 [auto_monad]: 7.47e-05 [graph_reusing]: 7.13e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 6.243e-05 [rewriter_before_opt_a]: 9.205e-05 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00690257, [2] [Cycle 1]: 0.00258194, [27] [switch_simplify]: 7.086e-05 [loop_unroll]: 3.468e-05 [a_1]: 0.00073018 [with_stream_mark]: 2.854e-05 [recompute_prepare]: 1.189e-05 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.65002e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.94001e-06 [get_grad_eliminate_]: 5.85002e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.877e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.07e-05 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00126928 [add_forward_monad_depend]: 9.64e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 2.371e-05 [cse]: 4.724e-05 [replace_applicator]: 2.357e-05 [Cycle 2]: 0.00039068, [27] [switch_simplify]: 6.56e-06 [loop_unroll]: 5.40999e-06 [a_1]: 9.412e-05 [with_stream_mark]: 1.636e-05 [recompute_prepare]: 6.38e-06 [updatestate_depend_eliminate]: 4.45999e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 4.82e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.038e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.97001e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 9.69e-06 [cse]: 2.035e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.822e-05 [rewriter_after_opt_a]: 4.679e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00076387 [jit_opt_b]: 5.328e-05, [1] [Cycle 1]: 4.513e-05, [2] [frontend_op_eliminate]: 1.687e-05 [inline_after_opt_a]: 1.647e-05 [cconv]: 3.601e-05 [loop_unroll]: 0.00045327 [jit_opt_after_cconv]: 0.00016759, [1] [Cycle 1]: 0.00015969, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 4.09002e-06 [updatestate_depend_eliminate]: 8.74003e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 3.46001e-06 [cse]: 3.563e-05 [call_graph_tuple_transform]: 2.05e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.57999e-06 [remove_dup_value]: 4.527e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 7.15998e-06 [add_recomputation]: 5.952e-05 [cse_after_recomputation]: 2.59e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.295e-05 [auto_monad_reorder]: 1.745e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 7.28e-06 [opt_after_jit_grad]: 0.0005059 [symbol_engine_optimizer]: 7.705e-05, [1] [Cycle 1]: 6.998e-05, [6] [build]: 5.37999e-06 [elim_shapecalc]: 8.69e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 5.76998e-06 [fold_const_symbol]: 8.78001e-06 [renormalize]: 4.59986e-07 [validate]: 4.6e-05 Sums bootstrap : 0.000363s : 2.20% type_inference : 0.011061s : 66.96% event_method : 0.000023s : 0.14% auto_monad : 0.000075s : 0.45% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000062s : 0.38% rewriter_before_opt_a : 0.000092s : 0.56% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.47% jit_opt_a.loop_unroll : 0.000040s : 0.24% jit_opt_a.a_1 : 0.000824s : 4.99% jit_opt_a.with_stream_mark : 0.000045s : 0.27% jit_opt_a.recompute_prepare : 0.000018s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000005s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001269s : 7.68% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.20% jit_opt_a.cse : 0.000068s : 0.41% jit_opt_a.replace_applicator : 0.000030s : 0.18% py_interpret_to_execute_after_opt_a : 0.000018s : 0.11% rewriter_after_opt_a : 0.000047s : 0.28% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000764s : 4.62% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000036s : 0.22% loop_unroll : 0.000453s : 2.74% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000045s : 0.27% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000060s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000017s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000506s : 3.06% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.28% Time group info: ------[substitution.] 0.000315 24 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 3: substitution.graph_param_transform 87.39% : 0.000276s : 5: substitution.inline 1.73% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 4.41% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010974 2 86.18% : 0.009457s : 1: type_inference.infer 13.82% : 0.001517s : 1: type_inference.specialize ------[replace.] 0.000107 7 67.57% : 0.000072s : 5: replace.inline 32.43% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000285 7 95.58% : 0.000272s : 5: match.inline 4.42% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 747 1.13% : 0.000002s : 11: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 1.85% : 0.000002s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.02% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.31% : 0.000002s : 11: predicate.environ_get_depend_swap 1.11% : 0.000001s : 11: predicate.environ_get_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 7.05% : 0.000009s : 24: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 1.77% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.02% : 0.000001s : 11: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 16: predicate.partial_eliminate 1.02% : 0.000001s : 11: predicate.print_const_string_wrapper 1.59% : 0.000002s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000003s : 19: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 11: predicate.reshape_eliminate 1.18% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.83% : 0.000004s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.13% : 0.000011s : 59: predicate.switch_simplify 1.16% : 0.000002s : 11: predicate.tile_eliminate 1.11% : 0.000001s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.49% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001255 16 47.75% : 0.000599s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.20% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.04% : 0.000565s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023551 72 0.27% : 0.000063s : 1: add_recomputation 0.33% : 0.000078s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.65% : 0.000388s : 1: bootstrap 0.16% : 0.000039s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.33% : 0.006907s : 1: jit_opt_a 0.73% : 0.000171s : 1: jit_opt_after_cconv 0.24% : 0.000056s : 1: jit_opt_b 1.97% : 0.000463s : 1: loop_unroll 3.30% : 0.000778s : 1: mutable_eliminate 4.62% : 0.001087s : 26: opt.transform.jit_opt_a 0.22% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000019s : 1: opt.transform.mutable_eliminate 0.10% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.19% : 0.000517s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000065s : 1: py_interpret_to_execute 0.09% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000048s : 1: remove_dup_value 3.11% : 0.000733s : 1: renormalize.infer 2.22% : 0.000523s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000050s : 1: rewriter_after_opt_a 0.41% : 0.000095s : 1: rewriter_before_opt_a 0.34% : 0.000080s : 1: symbol_engine_optimizer 47.05% : 0.011080s : 1: type_inference TotalTime = 0.0260068, [30] [bootstrap]: 0.00039399 [type_inference]: 0.00623959 [event_method]: 2.53e-05 [auto_monad]: 7.223e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 5.458e-05 [rewriter_before_opt_a]: 9.155e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.0167085, [2] [Cycle 1]: 0.00200308, [27] [switch_simplify]: 7.198e-05 [loop_unroll]: 3.524e-05 [a_1]: 0.00069588 [with_stream_mark]: 2.03e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 8.82999e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00083363 [add_forward_monad_depend]: 5.79999e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.69e-05 [cse]: 3.21e-05 [replace_applicator]: 1.409e-05 [Cycle 2]: 0.00032418, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.01e-05 [with_stream_mark]: 1.037e-05 [recompute_prepare]: 5.19998e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.55997e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.41998e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.3e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.11002e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.71e-06 [cse]: 1.237e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.315e-05 [rewriter_after_opt_a]: 3.626e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00063302 [jit_opt_b]: 5.566e-05, [1] [Cycle 1]: 4.811e-05, [2] [frontend_op_eliminate]: 1.884e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 2.672e-05 [loop_unroll]: 0.00048915 [jit_opt_after_cconv]: 0.00015319, [1] [Cycle 1]: 0.00014611, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.63998e-06 [cse]: 2.738e-05 [call_graph_tuple_transform]: 2.051e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.713e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 9.54e-06 [add_recomputation]: 5.222e-05 [cse_after_recomputation]: 2.591e-05, [1] [Cycle 1]: 2.02e-05, [1] [cse]: 1.32e-05 [auto_monad_reorder]: 1.945e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.00052187 [symbol_engine_optimizer]: 8.472e-05, [1] [Cycle 1]: 7.702e-05, [6] [build]: 1.166e-05 [elim_shapecalc]: 8.92e-06 [elim_not_effective]: 1.266e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.88002e-06 [renormalize]: 4.10015e-07 [validate]: 4.437e-05 Sums bootstrap : 0.000394s : 3.58% type_inference : 0.006240s : 56.70% event_method : 0.000025s : 0.23% auto_monad : 0.000072s : 0.66% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000055s : 0.50% rewriter_before_opt_a : 0.000092s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000078s : 0.71% jit_opt_a.loop_unroll : 0.000041s : 0.37% jit_opt_a.a_1 : 0.000786s : 7.14% jit_opt_a.with_stream_mark : 0.000031s : 0.28% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000834s : 7.58% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.21% jit_opt_a.cse : 0.000044s : 0.40% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.12% rewriter_after_opt_a : 0.000036s : 0.33% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000633s : 5.75% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000027s : 0.24% loop_unroll : 0.000489s : 4.45% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000010s : 0.09% add_recomputation : 0.000052s : 0.47% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000019s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000522s : 4.74% symbol_engine_optimizer.build : 0.000012s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.40% Time group info: ------[substitution.] 0.000264 25 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 85.95% : 0.000227s : 5: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.57% : 0.000004s : 4: substitution.remove_not_recompute_node 1.76% : 0.000005s : 2: substitution.replace_old_param 6.01% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006147 2 78.59% : 0.004831s : 1: type_inference.infer 21.41% : 0.001316s : 1: type_inference.specialize ------[replace.] 0.000103 8 66.52% : 0.000069s : 5: replace.inline 33.48% : 0.000035s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 8 94.00% : 0.000224s : 5: match.inline 6.00% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 810 1.46% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.60% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.43% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.37% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.38% : 0.000002s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000007s : 26: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.30% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.72% : 0.000002s : 12: predicate.reduce_eliminate 1.82% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 21: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.31% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.37% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.56% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000854 16 50.09% : 0.000428s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.27% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.63% : 0.000364s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027917 72 0.20% : 0.000055s : 1: add_recomputation 0.27% : 0.000076s : 1: auto_monad 0.08% : 0.000023s : 1: auto_monad_reorder 1.49% : 0.000417s : 1: bootstrap 0.11% : 0.000030s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000012s : 1: environ_conv 0.11% : 0.000030s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 59.86% : 0.016712s : 1: jit_opt_a 0.56% : 0.000157s : 1: jit_opt_after_cconv 0.21% : 0.000058s : 1: jit_opt_b 1.79% : 0.000500s : 1: loop_unroll 2.30% : 0.000642s : 1: mutable_eliminate 3.68% : 0.001027s : 26: opt.transform.jit_opt_a 0.17% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.90% : 0.000532s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000058s : 1: py_interpret_to_execute 0.06% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 1.61% : 0.000448s : 1: renormalize.infer 1.35% : 0.000377s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000039s : 1: rewriter_after_opt_a 0.34% : 0.000095s : 1: rewriter_before_opt_a 0.31% : 0.000088s : 1: symbol_engine_optimizer 22.44% : 0.006265s : 1: type_inference TotalTime = 0.0467239, [30] [bootstrap]: 0.00034762 [type_inference]: 0.0374103 [event_method]: 1.932e-05 [auto_monad]: 6.989e-05 [graph_reusing]: 6.54001e-06 [pre_auto_parallel]: 2.24001e-06 [py_interpret_to_execute]: 0.00011105 [rewriter_before_opt_a]: 7.895e-05 [expand_dump_flag]: 2.91999e-06 [jit_opt_a]: 0.00620375, [2] [Cycle 1]: 0.00216745, [27] [switch_simplify]: 6.093e-05 [loop_unroll]: 2.86e-05 [a_1]: 0.00055465 [with_stream_mark]: 1.978e-05 [recompute_prepare]: 7.57998e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 6.76e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 5.64e-06 [renormalize]: 0.00113724 [add_forward_monad_depend]: 7.9e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.671e-05 [cse]: 3.673e-05 [replace_applicator]: 1.601e-05 [Cycle 2]: 0.00033486, [27] [switch_simplify]: 6.03998e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.436e-05 [with_stream_mark]: 1.253e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.39998e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 4.77998e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 1.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.30997e-06 [cse]: 1.263e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.499e-05 [rewriter_after_opt_a]: 4.567e-05 [convert_after_rewriter]: 7.05002e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.000715 [jit_opt_b]: 5.221e-05, [1] [Cycle 1]: 4.379e-05, [2] [frontend_op_eliminate]: 1.656e-05 [inline_after_opt_a]: 1.565e-05 [cconv]: 2.924e-05 [loop_unroll]: 0.00045816 [jit_opt_after_cconv]: 0.00015741, [1] [Cycle 1]: 0.00015015, [11] [c_1]: 2.272e-05 [parameter_eliminate]: 3.76999e-06 [updatestate_depend_eliminate]: 6.61999e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.773e-05 [call_graph_tuple_transform]: 2.122e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.791e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 7.26001e-06 [add_recomputation]: 5.569e-05 [cse_after_recomputation]: 3.873e-05, [1] [Cycle 1]: 3.281e-05, [1] [cse]: 1.32e-05 [auto_monad_reorder]: 1.958e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 6.93e-06 [opt_after_jit_grad]: 0.00052707 [symbol_engine_optimizer]: 7.833e-05, [1] [Cycle 1]: 7.047e-05, [6] [build]: 4.95001e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.322e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.35001e-06 [renormalize]: 7.89994e-07 [validate]: 4.391e-05 Sums bootstrap : 0.000348s : 0.82% type_inference : 0.037410s : 88.24% event_method : 0.000019s : 0.05% auto_monad : 0.000070s : 0.16% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000111s : 0.26% rewriter_before_opt_a : 0.000079s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.16% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000649s : 1.53% jit_opt_a.with_stream_mark : 0.000032s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001137s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000049s : 0.12% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000046s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000715s : 1.69% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000458s : 1.08% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000527s : 1.24% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.10% Time group info: ------[substitution.] 0.000229 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 3: substitution.graph_param_transform 84.34% : 0.000193s : 4: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.67% : 0.000006s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037330 2 95.60% : 0.035686s : 1: type_inference.infer 4.40% : 0.001643s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.55% : 0.000046s : 4: replace.inline 32.45% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.34% : 0.000190s : 4: match.inline 5.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.09% : 0.000001s : 10: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.76% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.21% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.10% : 0.000006s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.91% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.81% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.35% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.36% : 0.000002s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000003s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.65% : 0.000002s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.78% : 0.000003s : 16: predicate.switch_defer_inline 2.28% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.11% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000884 13 44.60% : 0.000394s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.33% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.07% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048794 72 0.12% : 0.000059s : 1: add_recomputation 0.15% : 0.000073s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.74% : 0.000361s : 1: bootstrap 0.07% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000041s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.72% : 0.006208s : 1: jit_opt_a 0.33% : 0.000160s : 1: jit_opt_after_cconv 0.11% : 0.000055s : 1: jit_opt_b 0.96% : 0.000469s : 1: loop_unroll 1.49% : 0.000727s : 1: mutable_eliminate 1.80% : 0.000876s : 26: opt.transform.jit_opt_a 0.11% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.10% : 0.000537s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000115s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.43% : 0.000698s : 1: renormalize.infer 0.88% : 0.000430s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000049s : 1: rewriter_after_opt_a 0.17% : 0.000083s : 1: rewriter_before_opt_a 0.17% : 0.000081s : 1: symbol_engine_optimizer 76.71% : 0.037429s : 1: type_inference TotalTime = 0.013255, [30] [bootstrap]: 0.00033008 [type_inference]: 0.005092 [event_method]: 2.037e-05 [auto_monad]: 6.57e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 3.71e-05 [rewriter_before_opt_a]: 7.497e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00547612, [2] [Cycle 1]: 0.00160974, [27] [switch_simplify]: 5.646e-05 [loop_unroll]: 2.939e-05 [a_1]: 0.00053536 [with_stream_mark]: 2.001e-05 [recompute_prepare]: 7.48e-06 [updatestate_depend_eliminate]: 5.24998e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.644e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 0.000612 [add_forward_monad_depend]: 6.24001e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.474e-05 [cse]: 3.494e-05 [replace_applicator]: 1.303e-05 [Cycle 2]: 0.00032261, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.937e-05 [with_stream_mark]: 1.093e-05 [recompute_prepare]: 5.06002e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.09998e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.324e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.32002e-06 [inline_without_move]: 4.81002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.227e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.367e-05 [rewriter_after_opt_a]: 3.782e-05 [convert_after_rewriter]: 6.54999e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00055521 [jit_opt_b]: 4.926e-05, [1] [Cycle 1]: 4.187e-05, [2] [frontend_op_eliminate]: 1.516e-05 [inline_after_opt_a]: 1.467e-05 [cconv]: 2.885e-05 [loop_unroll]: 0.00041109 [jit_opt_after_cconv]: 0.00016149, [1] [Cycle 1]: 0.00015475, [11] [c_1]: 2.012e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 7.21999e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 1.238e-05 [cse]: 2.689e-05 [call_graph_tuple_transform]: 1.918e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.782e-05 [partial_unused_args_eliminate]: 2.13002e-06 [environ_conv]: 6.64001e-06 [add_recomputation]: 5.108e-05 [cse_after_recomputation]: 2.338e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.748e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 5.71e-06 [opt_after_jit_grad]: 0.00046011 [symbol_engine_optimizer]: 7.228e-05, [1] [Cycle 1]: 6.566e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 7.35e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 6.00005e-07 [validate]: 4.093e-05 Sums bootstrap : 0.000330s : 3.62% type_inference : 0.005092s : 55.89% event_method : 0.000020s : 0.22% auto_monad : 0.000066s : 0.72% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.41% rewriter_before_opt_a : 0.000075s : 0.82% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000062s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.38% jit_opt_a.a_1 : 0.000625s : 6.86% jit_opt_a.with_stream_mark : 0.000031s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000612s : 6.72% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000047s : 0.52% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000038s : 0.42% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000555s : 6.09% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000029s : 0.32% loop_unroll : 0.000411s : 4.51% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000012s : 0.14% jit_opt_after_cconv.cse : 0.000027s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000018s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000051s : 0.56% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.19% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000460s : 5.05% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.45% Time group info: ------[substitution.] 0.000216 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000005s : 3: substitution.graph_param_transform 83.49% : 0.000180s : 4: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 2.37% : 0.000005s : 2: substitution.replace_old_param 6.05% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005015 2 83.01% : 0.004163s : 1: type_inference.infer 16.99% : 0.000852s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.01% : 0.000045s : 4: replace.inline 32.99% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.71% : 0.000177s : 4: match.inline 6.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.72% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.07% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.40% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.77% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000655 13 55.39% : 0.000363s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.05% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.56% : 0.000253s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014755 72 0.37% : 0.000054s : 1: add_recomputation 0.47% : 0.000069s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.37% : 0.000349s : 1: bootstrap 0.21% : 0.000032s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.17% : 0.000025s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.13% : 0.005479s : 1: jit_opt_a 1.11% : 0.000164s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.84% : 0.000419s : 1: loop_unroll 3.83% : 0.000565s : 1: mutable_eliminate 5.70% : 0.000841s : 26: opt.transform.jit_opt_a 0.32% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.18% : 0.000469s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000040s : 1: py_interpret_to_execute 0.11% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000020s : 1: remove_dup_value 2.14% : 0.000316s : 1: renormalize.infer 1.95% : 0.000287s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000041s : 1: rewriter_after_opt_a 0.53% : 0.000078s : 1: rewriter_before_opt_a 0.51% : 0.000075s : 1: symbol_engine_optimizer 34.62% : 0.005109s : 1: type_inference TotalTime = 0.31592, [30] [bootstrap]: 0.0004047 [type_inference]: 0.2869 [event_method]: 1.864e-05 [auto_monad]: 7.188e-05 [graph_reusing]: 5.71003e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.0005153 [rewriter_before_opt_a]: 8.822e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.0244023, [2] [Cycle 1]: 0.0203443, [27] [switch_simplify]: 5.883e-05 [loop_unroll]: 3.152e-05 [a_1]: 0.00064915 [with_stream_mark]: 2.077e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 3.92998e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 0.019087 [add_forward_monad_depend]: 1.345e-05 [auto_monad_grad]: 3.3e-06 [auto_monad_eliminator]: 2.974e-05 [cse]: 4.047e-05 [replace_applicator]: 3.119e-05 [Cycle 2]: 0.00044903, [27] [switch_simplify]: 8.85001e-06 [loop_unroll]: 6.71999e-06 [a_1]: 0.00013896 [with_stream_mark]: 2.017e-05 [recompute_prepare]: 6.73e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.45002e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 5.36002e-06 [cell_reuse_recompute_pass]: 5.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.184e-05 [j_node_and_user_rematch]: 1.092e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.233e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.11e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 9.89999e-06 [cse]: 1.667e-05 [replace_applicator]: 6.89001e-06 [py_interpret_to_execute_after_opt_a]: 2.518e-05 [rewriter_after_opt_a]: 4.87e-05 [convert_after_rewriter]: 8.72998e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.0009657 [jit_opt_b]: 6.603e-05, [1] [Cycle 1]: 5.672e-05, [2] [frontend_op_eliminate]: 2.281e-05 [inline_after_opt_a]: 1.971e-05 [cconv]: 3.788e-05 [loop_unroll]: 0.00056253 [jit_opt_after_cconv]: 0.00019771, [1] [Cycle 1]: 0.00018953, [11] [c_1]: 2.822e-05 [parameter_eliminate]: 6.64999e-06 [updatestate_depend_eliminate]: 1.041e-05 [updatestate_assign_eliminate]: 5.30999e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 3.967e-05 [call_graph_tuple_transform]: 2.58e-05 [tuple_list_get_item_eliminator]: 8.65999e-06 [none_parameter_eliminate]: 2.24001e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 1.752e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.225e-05 [add_recomputation]: 6.012e-05 [cse_after_recomputation]: 2.875e-05, [1] [Cycle 1]: 2.282e-05, [1] [cse]: 1.519e-05 [auto_monad_reorder]: 1.666e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 9.05999e-06 [opt_after_jit_grad]: 0.00078383 [symbol_engine_optimizer]: 9.181e-05, [1] [Cycle 1]: 8.423e-05, [6] [build]: 6.16e-06 [elim_shapecalc]: 1.351e-05 [elim_not_effective]: 1.781e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 1.164e-05 [renormalize]: 5.59987e-07 [validate]: 6.459e-05 Sums bootstrap : 0.000405s : 0.13% type_inference : 0.286900s : 92.17% event_method : 0.000019s : 0.01% auto_monad : 0.000072s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000515s : 0.17% rewriter_before_opt_a : 0.000088s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000788s : 0.25% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.019087s : 6.13% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000040s : 0.01% jit_opt_a.cse : 0.000057s : 0.02% jit_opt_a.replace_applicator : 0.000038s : 0.01% py_interpret_to_execute_after_opt_a : 0.000025s : 0.01% rewriter_after_opt_a : 0.000049s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000966s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000038s : 0.01% loop_unroll : 0.000563s : 0.18% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000060s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000784s : 0.25% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000065s : 0.02% Time group info: ------[substitution.] 0.000252 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000007s : 4: substitution.graph_param_transform 83.56% : 0.000211s : 4: substitution.inline 2.08% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000006s : 4: substitution.remove_not_recompute_node 2.68% : 0.000007s : 2: substitution.replace_old_param 5.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.286820 2 98.88% : 0.283602s : 1: type_inference.infer 1.12% : 0.003218s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.36% : 0.000053s : 4: replace.inline 30.64% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.71% : 0.000208s : 4: match.inline 5.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.28% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000001s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 0.99% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.34% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.81% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 12: predicate.environ_get_depend_swap 1.09% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 6.14% : 0.000009s : 26: predicate.inline 1.03% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.83% : 0.000003s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 18: predicate.load_eliminater 1.97% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.66% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 2.20% : 0.000003s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.21% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.65% : 0.000002s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000002s : 8: predicate.specialize_transform 1.25% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.60% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.30% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.43% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003055 22 55.19% : 0.001686s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.71% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.09% : 0.001317s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.335868 72 0.02% : 0.000064s : 1: add_recomputation 0.02% : 0.000075s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.13% : 0.000428s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000018s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 7.27% : 0.024407s : 1: jit_opt_a 0.06% : 0.000203s : 1: jit_opt_after_cconv 0.02% : 0.000070s : 1: jit_opt_b 0.17% : 0.000574s : 1: loop_unroll 0.29% : 0.000985s : 1: mutable_eliminate 0.32% : 0.001059s : 26: opt.transform.jit_opt_a 0.02% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000798s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000526s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 5.22% : 0.017544s : 1: renormalize.infer 0.45% : 0.001519s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000053s : 1: rewriter_after_opt_a 0.03% : 0.000093s : 1: rewriter_before_opt_a 0.03% : 0.000096s : 1: symbol_engine_optimizer 85.42% : 0.286914s : 1: type_inference TotalTime = 0.0603546, [30] [bootstrap]: 0.0002897 [type_inference]: 0.0381556 [event_method]: 2.331e-05 [auto_monad]: 7.771e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00012407 [rewriter_before_opt_a]: 8.705e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.0189228, [2] [Cycle 1]: 0.0146897, [27] [switch_simplify]: 6.146e-05 [loop_unroll]: 2.965e-05 [a_1]: 0.0129016 [with_stream_mark]: 2.934e-05 [recompute_prepare]: 1.215e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 3.11999e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.692e-05 [j_node_and_user_rematch]: 1.102e-05 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 1.179e-05 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00124844 [add_forward_monad_depend]: 6.46e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.752e-05 [cse]: 3.65e-05 [replace_applicator]: 1.716e-05 [Cycle 2]: 0.00032968, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.44e-06 [a_1]: 9.342e-05 [with_stream_mark]: 1.093e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.365e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.375e-05 [replace_applicator]: 4.90999e-06 [py_interpret_to_execute_after_opt_a]: 1.561e-05 [rewriter_after_opt_a]: 4.099e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 5.66998e-06 [mutable_eliminate]: 0.00085245 [jit_opt_b]: 5.353e-05, [1] [Cycle 1]: 4.485e-05, [2] [frontend_op_eliminate]: 1.783e-05 [inline_after_opt_a]: 1.628e-05 [cconv]: 3.037e-05 [loop_unroll]: 0.00051772 [jit_opt_after_cconv]: 0.00015962, [1] [Cycle 1]: 0.00015187, [11] [c_1]: 2.208e-05 [parameter_eliminate]: 3.53e-06 [updatestate_depend_eliminate]: 6.78998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.63998e-06 [cse]: 2.63e-05 [call_graph_tuple_transform]: 2.303e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.13002e-06 [remove_dup_value]: 1.681e-05 [partial_unused_args_eliminate]: 3.35e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 5.443e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.8e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 7.43e-06 [opt_after_jit_grad]: 0.00051479 [symbol_engine_optimizer]: 7.955e-05, [1] [Cycle 1]: 7.27e-05, [6] [build]: 4.56002e-06 [elim_shapecalc]: 8.61002e-06 [elim_not_effective]: 1.433e-05 [opt_reshape]: 6.38998e-06 [fold_const_symbol]: 9.29e-06 [renormalize]: 4.40021e-07 [validate]: 4.698e-05 Sums bootstrap : 0.000290s : 0.52% type_inference : 0.038156s : 68.40% event_method : 0.000023s : 0.04% auto_monad : 0.000078s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000124s : 0.22% rewriter_before_opt_a : 0.000087s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.012995s : 23.30% jit_opt_a.with_stream_mark : 0.000040s : 0.07% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001249s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000050s : 0.09% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000852s : 1.53% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000030s : 0.05% loop_unroll : 0.000518s : 0.93% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000515s : 0.92% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.08% Time group info: ------[substitution.] 0.000380 23 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.80% : 0.000007s : 3: substitution.graph_param_transform 88.76% : 0.000337s : 4: substitution.inline 1.23% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.23% : 0.000005s : 4: substitution.remove_not_recompute_node 1.61% : 0.000006s : 2: substitution.replace_old_param 4.50% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038060 2 95.55% : 0.036368s : 1: type_inference.infer 4.45% : 0.001692s : 1: type_inference.specialize ------[replace.] 0.000102 6 72.71% : 0.000074s : 4: replace.inline 27.29% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000350 6 95.45% : 0.000334s : 4: match.inline 4.55% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 691 1.09% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 10: predicate.compare_switch_simplify 0.98% : 0.000001s : 10: predicate.depend_value_elim 0.87% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 0.87% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.74% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.84% : 0.000010s : 22: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.65% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.54% : 0.000004s : 15: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 10: predicate.merge_addn 1.16% : 0.000002s : 10: predicate.minmaximum_grad 2.31% : 0.000003s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 1.87% : 0.000003s : 15: predicate.partial_eliminate 0.89% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000003s : 10: predicate.reduce_eliminate 2.22% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000000s : 3: predicate.reset_defer_inline 1.05% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.38% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 3: predicate.switch_call_monad_eliminater 6.16% : 0.000009s : 16: predicate.switch_defer_inline 1.79% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.55% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.06% : 0.000002s : 10: predicate.transpose_eliminate 1.12% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 5.14% : 0.000008s : 18: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.30% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.47% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000928 13 43.26% : 0.000401s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.33% : 0.000068s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.41% : 0.000458s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.074877 72 0.08% : 0.000057s : 1: add_recomputation 0.11% : 0.000081s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.40% : 0.000302s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 25.28% : 0.018927s : 1: jit_opt_a 0.22% : 0.000162s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.70% : 0.000527s : 1: loop_unroll 1.15% : 0.000863s : 1: mutable_eliminate 17.67% : 0.013231s : 26: opt.transform.jit_opt_a 0.07% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000524s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000127s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.03% : 0.000772s : 1: renormalize.infer 0.62% : 0.000466s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000091s : 1: rewriter_before_opt_a 0.11% : 0.000082s : 1: symbol_engine_optimizer 50.99% : 0.038183s : 1: type_inference TotalTime = 0.0313502, [30] [bootstrap]: 0.000323 [type_inference]: 0.0154846 [event_method]: 2.74e-05 [auto_monad]: 7.517e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 5.497e-05 [rewriter_before_opt_a]: 9.899e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.0102483, [2] [Cycle 1]: 0.00251601, [27] [switch_simplify]: 8.369e-05 [loop_unroll]: 3.58e-05 [a_1]: 0.00081248 [with_stream_mark]: 2.887e-05 [recompute_prepare]: 9.74e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 3.13e-06 [specialize_transform]: 6.92002e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.71998e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.681e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.129e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00113293 [add_forward_monad_depend]: 8.32e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 2.008e-05 [cse]: 4.204e-05 [replace_applicator]: 2.159e-05 [Cycle 2]: 0.00035167, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.76e-06 [a_1]: 9.319e-05 [with_stream_mark]: 1.38e-05 [recompute_prepare]: 5.45001e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 5.98998e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.98997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 7.85998e-06 [meta_fg_expand]: 2.98998e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 8.34002e-06 [cse]: 1.508e-05 [replace_applicator]: 1.154e-05 [py_interpret_to_execute_after_opt_a]: 1.864e-05 [rewriter_after_opt_a]: 4.353e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00089428 [jit_opt_b]: 6.721e-05, [1] [Cycle 1]: 5.727e-05, [2] [frontend_op_eliminate]: 2.355e-05 [inline_after_opt_a]: 1.909e-05 [cconv]: 4.261e-05 [loop_unroll]: 0.00057825 [jit_opt_after_cconv]: 0.00019844, [1] [Cycle 1]: 0.00018985, [11] [c_1]: 2.179e-05 [parameter_eliminate]: 6.45997e-06 [updatestate_depend_eliminate]: 1.195e-05 [updatestate_assign_eliminate]: 3.81001e-06 [updatestate_loads_eliminate]: 3.41001e-06 [cse]: 4.595e-05 [call_graph_tuple_transform]: 2.675e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 1.21002e-06 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.995e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 1.363e-05 [add_recomputation]: 6.27e-05 [cse_after_recomputation]: 2.876e-05, [1] [Cycle 1]: 2.256e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 1.033e-05 [opt_after_jit_grad]: 0.00261869 [symbol_engine_optimizer]: 0.00010351, [1] [Cycle 1]: 9.351e-05, [6] [build]: 1.591e-05 [elim_shapecalc]: 1.005e-05 [elim_not_effective]: 1.964e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 8.77999e-06 [renormalize]: 9.50007e-07 [validate]: 6.047e-05 Sums bootstrap : 0.000323s : 1.39% type_inference : 0.015485s : 66.57% event_method : 0.000027s : 0.12% auto_monad : 0.000075s : 0.32% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000055s : 0.24% rewriter_before_opt_a : 0.000099s : 0.43% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000090s : 0.39% jit_opt_a.loop_unroll : 0.000042s : 0.18% jit_opt_a.a_1 : 0.000906s : 3.89% jit_opt_a.with_stream_mark : 0.000043s : 0.18% jit_opt_a.recompute_prepare : 0.000015s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.09% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.001133s : 4.87% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.12% jit_opt_a.cse : 0.000057s : 0.25% jit_opt_a.replace_applicator : 0.000033s : 0.14% py_interpret_to_execute_after_opt_a : 0.000019s : 0.08% rewriter_after_opt_a : 0.000044s : 0.19% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000894s : 3.84% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.10% jit_opt_b.inline_after_opt_a : 0.000019s : 0.08% cconv : 0.000043s : 0.18% loop_unroll : 0.000578s : 2.49% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000046s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000020s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000014s : 0.06% add_recomputation : 0.000063s : 0.27% cse_after_recomputation.cse : 0.000014s : 0.06% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.04% opt_after_jit_grad : 0.002619s : 11.26% symbol_engine_optimizer.build : 0.000016s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000060s : 0.26% Time group info: ------[substitution.] 0.000354 25 0.74% : 0.000003s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.64% : 0.000006s : 3: substitution.graph_param_transform 87.48% : 0.000310s : 5: substitution.inline 0.99% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 2.30% : 0.000008s : 2: substitution.replace_old_param 4.84% : 0.000017s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015388 2 84.02% : 0.012929s : 1: type_inference.infer 15.98% : 0.002459s : 1: type_inference.specialize ------[replace.] 0.000117 8 66.55% : 0.000078s : 5: replace.inline 33.45% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 8 95.17% : 0.000306s : 5: match.inline 4.83% : 0.000016s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 810 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 2.16% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 12: predicate.addn_check_dump 1.56% : 0.000002s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 12: predicate.compare_switch_simplify 1.35% : 0.000002s : 12: predicate.depend_value_elim 0.98% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.86% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.43% : 0.000010s : 26: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.74% : 0.000003s : 6: predicate.less_batch_normalization 1.67% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 18: predicate.load_eliminater 2.10% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.65% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 0.98% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000002s : 12: predicate.minmaximum_grad 1.91% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 1.92% : 0.000003s : 18: predicate.partial_eliminate 1.02% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000003s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000002s : 21: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.20% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000002s : 3: predicate.row_tensor_eliminate 1.02% : 0.000002s : 12: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000002s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.63% : 0.000012s : 64: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.10% : 0.000002s : 12: predicate.transpose_eliminate 2.43% : 0.000004s : 12: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.37% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.71% : 0.000003s : 12: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000922 16 50.48% : 0.000465s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.67% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.85% : 0.000358s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033743 72 0.20% : 0.000066s : 1: add_recomputation 0.23% : 0.000078s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.01% : 0.000342s : 1: bootstrap 0.14% : 0.000046s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000031s : 1: cse_after_recomputation 0.05% : 0.000016s : 1: environ_conv 0.09% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 30.38% : 0.010252s : 1: jit_opt_a 0.60% : 0.000201s : 1: jit_opt_after_cconv 0.21% : 0.000071s : 1: jit_opt_b 1.75% : 0.000592s : 1: loop_unroll 2.71% : 0.000913s : 1: mutable_eliminate 3.49% : 0.001179s : 26: opt.transform.jit_opt_a 0.17% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000035s : 4: opt.transform.jit_opt_b 0.06% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000025s : 1: opt.transform.mutable_eliminate 0.12% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000041s : 4: opt.transform.symbol_engine_opt 7.82% : 0.002640s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000058s : 1: py_interpret_to_execute 0.06% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000022s : 1: remove_dup_value 1.98% : 0.000669s : 1: renormalize.infer 1.34% : 0.000453s : 1: renormalize.specialize 0.04% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000047s : 1: rewriter_after_opt_a 0.30% : 0.000102s : 1: rewriter_before_opt_a 0.32% : 0.000107s : 1: symbol_engine_optimizer 45.95% : 0.015505s : 1: type_inference TotalTime = 0.386789, [30] [bootstrap]: 0.00038964 [type_inference]: 0.36998 [event_method]: 2.451e-05 [auto_monad]: 7.3e-05 [graph_reusing]: 6.01998e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 0.00054185 [rewriter_before_opt_a]: 0.00010174 [expand_dump_flag]: 4.19002e-06 [jit_opt_a]: 0.0126089, [2] [Cycle 1]: 0.00711211, [27] [switch_simplify]: 6.015e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.00061417 [with_stream_mark]: 2.16e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 7.18998e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 6.59001e-06 [renormalize]: 0.00595369 [add_forward_monad_depend]: 9.81e-06 [auto_monad_grad]: 4.03001e-06 [auto_monad_eliminator]: 2.214e-05 [cse]: 4.298e-05 [replace_applicator]: 5.102e-05 [Cycle 2]: 0.00046849, [27] [switch_simplify]: 8.65999e-06 [loop_unroll]: 7.33e-06 [a_1]: 0.00013659 [with_stream_mark]: 1.73e-05 [recompute_prepare]: 6.74999e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.97002e-06 [updatestate_useless_node_eliminater]: 6.03998e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 4.29002e-06 [cell_reuse_recompute_pass]: 2.99001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.977e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.43998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.79998e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 9.25001e-06 [cse]: 2.074e-05 [replace_applicator]: 6.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.966e-05 [rewriter_after_opt_a]: 4.651e-05 [convert_after_rewriter]: 7.58001e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00092899 [jit_opt_b]: 6.955e-05, [1] [Cycle 1]: 5.97e-05, [2] [frontend_op_eliminate]: 2.371e-05 [inline_after_opt_a]: 2.073e-05 [cconv]: 3.143e-05 [loop_unroll]: 0.000575 [jit_opt_after_cconv]: 0.00021769, [1] [Cycle 1]: 0.00020801, [11] [c_1]: 2.931e-05 [parameter_eliminate]: 3.98999e-06 [updatestate_depend_eliminate]: 8.15e-06 [updatestate_assign_eliminate]: 5.24e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 6.106e-05 [call_graph_tuple_transform]: 2.677e-05 [tuple_list_get_item_eliminator]: 7.13998e-06 [none_parameter_eliminate]: 2.20002e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.908e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 1.076e-05 [add_recomputation]: 5.773e-05 [cse_after_recomputation]: 3.036e-05, [1] [Cycle 1]: 2.154e-05, [1] [cse]: 1.546e-05 [auto_monad_reorder]: 1.968e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 7.2e-06 [opt_after_jit_grad]: 0.00062455 [symbol_engine_optimizer]: 8.922e-05, [1] [Cycle 1]: 8.185e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 9.38002e-06 [elim_not_effective]: 1.956e-05 [opt_reshape]: 7.33999e-06 [fold_const_symbol]: 1.045e-05 [renormalize]: 7.60017e-07 [validate]: 6.125e-05 Sums bootstrap : 0.000390s : 0.10% type_inference : 0.369980s : 97.10% event_method : 0.000025s : 0.01% auto_monad : 0.000073s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000542s : 0.14% rewriter_before_opt_a : 0.000102s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000751s : 0.20% jit_opt_a.with_stream_mark : 0.000039s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.005954s : 1.56% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000064s : 0.02% jit_opt_a.replace_applicator : 0.000057s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000047s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000929s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000575s : 0.15% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000061s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000625s : 0.16% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.02% Time group info: ------[substitution.] 0.000228 24 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.95% : 0.000007s : 4: substitution.graph_param_transform 84.17% : 0.000192s : 4: substitution.inline 1.72% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000005s : 4: substitution.remove_not_recompute_node 2.33% : 0.000005s : 2: substitution.replace_old_param 5.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.369886 2 98.77% : 0.365320s : 1: type_inference.infer 1.23% : 0.004567s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.13% : 0.000053s : 4: replace.inline 33.87% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.79% : 0.000189s : 4: match.inline 5.21% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000001s : 12: predicate.compare_switch_simplify 1.04% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.71% : 0.000008s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 18: predicate.load_eliminater 1.66% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 12: predicate.merge_addn 0.97% : 0.000001s : 12: predicate.minmaximum_grad 2.34% : 0.000003s : 4: predicate.mutable_eliminate 1.02% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.33% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000003s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.21% : 0.000002s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.54% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003392 22 56.03% : 0.001900s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.66% : 0.001447s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.393855 72 0.02% : 0.000060s : 1: add_recomputation 0.02% : 0.000077s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.10% : 0.000412s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.20% : 0.012613s : 1: jit_opt_a 0.06% : 0.000221s : 1: jit_opt_after_cconv 0.02% : 0.000073s : 1: jit_opt_b 0.15% : 0.000587s : 1: loop_unroll 0.24% : 0.000942s : 1: mutable_eliminate 0.26% : 0.001039s : 26: opt.transform.jit_opt_a 0.02% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000636s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000552s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.16% : 0.004554s : 1: renormalize.infer 0.35% : 0.001385s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000050s : 1: rewriter_after_opt_a 0.03% : 0.000107s : 1: rewriter_before_opt_a 0.02% : 0.000094s : 1: symbol_engine_optimizer 93.94% : 0.370001s : 1: type_inference TotalTime = 0.0530294, [30] [bootstrap]: 0.00034795 [type_inference]: 0.020077 [event_method]: 1.977e-05 [auto_monad]: 6.693e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00010127 [rewriter_before_opt_a]: 7.968e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.0299013, [2] [Cycle 1]: 0.00200899, [27] [switch_simplify]: 6.287e-05 [loop_unroll]: 3.321e-05 [a_1]: 0.00056199 [with_stream_mark]: 1.927e-05 [recompute_prepare]: 7.72002e-06 [updatestate_depend_eliminate]: 4.24997e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.42001e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.451e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.76e-06 [renormalize]: 0.00096362 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.586e-05 [cse]: 3.798e-05 [replace_applicator]: 1.824e-05 [Cycle 2]: 0.00034905, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 5.96998e-06 [a_1]: 0.00010191 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 6.08998e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 7.48e-06 [inline_without_move]: 4.92999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 6.10002e-06 [cse]: 1.349e-05 [replace_applicator]: 5.35001e-06 [py_interpret_to_execute_after_opt_a]: 1.368e-05 [rewriter_after_opt_a]: 3.959e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00076512 [jit_opt_b]: 5.323e-05, [1] [Cycle 1]: 4.518e-05, [2] [frontend_op_eliminate]: 1.691e-05 [inline_after_opt_a]: 1.665e-05 [cconv]: 2.894e-05 [loop_unroll]: 0.00044482 [jit_opt_after_cconv]: 0.00014997, [1] [Cycle 1]: 0.00014331, [11] [c_1]: 2.226e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 6.07999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.554e-05 [call_graph_tuple_transform]: 1.959e-05 [tuple_list_get_item_eliminator]: 5.80002e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.637e-05 [partial_unused_args_eliminate]: 1.92999e-06 [environ_conv]: 5.91998e-06 [add_recomputation]: 5.449e-05 [cse_after_recomputation]: 2.542e-05, [1] [Cycle 1]: 1.968e-05, [1] [cse]: 1.367e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00047046 [symbol_engine_optimizer]: 7.538e-05, [1] [Cycle 1]: 6.854e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 8.06001e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 9.37001e-06 [renormalize]: 3.9002e-07 [validate]: 4.14e-05 Sums bootstrap : 0.000348s : 1.40% type_inference : 0.020077s : 80.75% event_method : 0.000020s : 0.08% auto_monad : 0.000067s : 0.27% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000101s : 0.41% rewriter_before_opt_a : 0.000080s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.28% jit_opt_a.loop_unroll : 0.000039s : 0.16% jit_opt_a.a_1 : 0.000664s : 2.67% jit_opt_a.with_stream_mark : 0.000031s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000964s : 3.88% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000051s : 0.21% jit_opt_a.replace_applicator : 0.000024s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000765s : 3.08% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000029s : 0.12% loop_unroll : 0.000445s : 1.79% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.22% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000470s : 1.89% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.17% Time group info: ------[substitution.] 0.000208 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 3: substitution.graph_param_transform 82.57% : 0.000172s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000005s : 4: substitution.remove_not_recompute_node 2.38% : 0.000005s : 2: substitution.replace_old_param 6.50% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020007 2 92.98% : 0.018603s : 1: type_inference.infer 7.02% : 0.001404s : 1: type_inference.specialize ------[replace.] 0.000075 6 66.57% : 0.000050s : 4: replace.inline 33.43% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.22% : 0.000169s : 4: match.inline 6.78% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.53% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.72% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.72% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.56% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.96% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000782 13 45.95% : 0.000359s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.84% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.21% : 0.000393s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054938 72 0.10% : 0.000058s : 1: add_recomputation 0.13% : 0.000070s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.68% : 0.000371s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 54.43% : 0.029905s : 1: jit_opt_a 0.28% : 0.000153s : 1: jit_opt_after_cconv 0.10% : 0.000056s : 1: jit_opt_b 0.82% : 0.000453s : 1: loop_unroll 1.41% : 0.000775s : 1: mutable_eliminate 1.64% : 0.000901s : 26: opt.transform.jit_opt_a 0.09% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000105s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.96% : 0.000529s : 1: renormalize.infer 0.77% : 0.000425s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.15% : 0.000083s : 1: rewriter_before_opt_a 0.14% : 0.000078s : 1: symbol_engine_optimizer 36.58% : 0.020094s : 1: type_inference TotalTime = 0.0400399, [30] [bootstrap]: 0.00033997 [type_inference]: 0.0315909 [event_method]: 2.083e-05 [auto_monad]: 7.123e-05 [graph_reusing]: 6.54999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00010681 [rewriter_before_opt_a]: 7.873e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.00559151, [2] [Cycle 1]: 0.0018457, [27] [switch_simplify]: 5.338e-05 [loop_unroll]: 2.98e-05 [a_1]: 0.00050887 [with_stream_mark]: 1.945e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 4.12003e-06 [updatestate_assign_eliminate]: 3.45003e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.71003e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.00090228 [add_forward_monad_depend]: 5.69999e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.543e-05 [cse]: 3.556e-05 [replace_applicator]: 1.171e-05 [Cycle 2]: 0.00031132, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.06002e-06 [a_1]: 8.685e-05 [with_stream_mark]: 8.84998e-06 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.74002e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.321e-05 [j_node_and_user_rematch]: 7.67002e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.147e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.142e-05 [rewriter_after_opt_a]: 3.71e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00055738 [jit_opt_b]: 4.898e-05, [1] [Cycle 1]: 4.209e-05, [2] [frontend_op_eliminate]: 1.592e-05 [inline_after_opt_a]: 1.59e-05 [cconv]: 2.7e-05 [loop_unroll]: 0.00050429 [jit_opt_after_cconv]: 0.00014701, [1] [Cycle 1]: 0.00014044, [11] [c_1]: 2.065e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.574e-05 [call_graph_tuple_transform]: 1.888e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.39998e-06 [remove_dup_value]: 1.597e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5.3e-05 [cse_after_recomputation]: 2.167e-05, [1] [Cycle 1]: 1.669e-05, [1] [cse]: 1.124e-05 [auto_monad_reorder]: 1.812e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 5.44998e-06 [opt_after_jit_grad]: 0.00045566 [symbol_engine_optimizer]: 7.229e-05, [1] [Cycle 1]: 6.583e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 8.66997e-06 [renormalize]: 4.39992e-07 [validate]: 3.896e-05 Sums bootstrap : 0.000340s : 0.94% type_inference : 0.031591s : 87.70% event_method : 0.000021s : 0.06% auto_monad : 0.000071s : 0.20% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.30% rewriter_before_opt_a : 0.000079s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000596s : 1.65% jit_opt_a.with_stream_mark : 0.000028s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000902s : 2.51% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000047s : 0.13% jit_opt_a.replace_applicator : 0.000017s : 0.05% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000557s : 1.55% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.000504s : 1.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.15% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000456s : 1.26% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.11% Time group info: ------[substitution.] 0.000191 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 3.31% : 0.000006s : 3: substitution.graph_param_transform 82.99% : 0.000158s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000004s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 6.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031508 2 56.22% : 0.017714s : 1: type_inference.infer 43.78% : 0.013794s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.63% : 0.000044s : 4: replace.inline 32.37% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.37% : 0.000156s : 4: match.inline 6.63% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 2.00% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.47% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.95% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.87% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000824 13 44.82% : 0.000369s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.78% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.40% : 0.000415s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041789 72 0.13% : 0.000056s : 1: add_recomputation 0.18% : 0.000074s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.86% : 0.000359s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.39% : 0.005594s : 1: jit_opt_a 0.36% : 0.000150s : 1: jit_opt_after_cconv 0.12% : 0.000052s : 1: jit_opt_b 1.23% : 0.000514s : 1: loop_unroll 1.35% : 0.000566s : 1: mutable_eliminate 1.93% : 0.000805s : 26: opt.transform.jit_opt_a 0.11% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.11% : 0.000465s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000110s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.27% : 0.000529s : 1: renormalize.infer 0.87% : 0.000365s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000040s : 1: rewriter_after_opt_a 0.20% : 0.000082s : 1: rewriter_before_opt_a 0.18% : 0.000075s : 1: symbol_engine_optimizer 75.64% : 0.031611s : 1: type_inference TotalTime = 0.0625916, [30] [bootstrap]: 0.00030674 [type_inference]: 0.0444985 [event_method]: 2.256e-05 [auto_monad]: 7.083e-05 [graph_reusing]: 6.84999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 5.047e-05 [rewriter_before_opt_a]: 9.376e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.0146637, [2] [Cycle 1]: 0.00330678, [27] [switch_simplify]: 7.227e-05 [loop_unroll]: 3.494e-05 [a_1]: 0.00070594 [with_stream_mark]: 2.496e-05 [recompute_prepare]: 8.69998e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 1.031e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00206805 [add_forward_monad_depend]: 8.80999e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 2.327e-05 [cse]: 3.769e-05 [replace_applicator]: 2.143e-05 [Cycle 2]: 0.00036003, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.76e-06 [a_1]: 9.57e-05 [with_stream_mark]: 1.538e-05 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.13002e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 4.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.728e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 4.87e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.30002e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 6.38e-06 [cse]: 1.497e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.872e-05 [rewriter_after_opt_a]: 4.546e-05 [convert_after_rewriter]: 7.5e-06 [order_py_execute_after_rewriter]: 5.01997e-06 [mutable_eliminate]: 0.00073762 [jit_opt_b]: 5.854e-05, [1] [Cycle 1]: 4.779e-05, [2] [frontend_op_eliminate]: 1.832e-05 [inline_after_opt_a]: 1.707e-05 [cconv]: 3.319e-05 [loop_unroll]: 0.00051035 [jit_opt_after_cconv]: 0.00016867, [1] [Cycle 1]: 0.00016073, [11] [c_1]: 2.277e-05 [parameter_eliminate]: 4.33999e-06 [updatestate_depend_eliminate]: 7.95998e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.84999e-06 [cse]: 3.211e-05 [call_graph_tuple_transform]: 2.145e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 1.00001e-06 [switch_simplify]: 5.49998e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 9.92001e-06 [add_recomputation]: 6.055e-05 [cse_after_recomputation]: 2.561e-05, [1] [Cycle 1]: 1.986e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 1.834e-05 [get_jit_bprop_graph]: 3.04001e-06 [rewriter_after_jit_bprop_graph]: 7.2e-06 [opt_after_jit_grad]: 0.00074845 [symbol_engine_optimizer]: 0.00011633, [1] [Cycle 1]: 0.00010837, [6] [build]: 1.174e-05 [elim_shapecalc]: 1.106e-05 [elim_not_effective]: 3.492e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 9.94999e-06 [renormalize]: 7.30011e-07 [validate]: 5.042e-05 Sums bootstrap : 0.000307s : 0.60% type_inference : 0.044499s : 87.42% event_method : 0.000023s : 0.04% auto_monad : 0.000071s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000050s : 0.10% rewriter_before_opt_a : 0.000094s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.15% jit_opt_a.loop_unroll : 0.000041s : 0.08% jit_opt_a.a_1 : 0.000802s : 1.57% jit_opt_a.with_stream_mark : 0.000040s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.002068s : 4.06% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.06% jit_opt_a.cse : 0.000053s : 0.10% jit_opt_a.replace_applicator : 0.000027s : 0.05% py_interpret_to_execute_after_opt_a : 0.000019s : 0.04% rewriter_after_opt_a : 0.000045s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000738s : 1.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000033s : 0.07% loop_unroll : 0.000510s : 1.00% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000061s : 0.12% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000748s : 1.47% symbol_engine_optimizer.build : 0.000012s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000035s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.10% Time group info: ------[substitution.] 0.000269 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 85.28% : 0.000229s : 5: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000004s : 4: substitution.remove_not_recompute_node 1.98% : 0.000005s : 2: substitution.replace_old_param 5.86% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.044414 2 13.71% : 0.006091s : 1: type_inference.infer 86.29% : 0.038323s : 1: type_inference.specialize ------[replace.] 0.000108 8 65.03% : 0.000070s : 5: replace.inline 34.97% : 0.000038s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 8 94.19% : 0.000226s : 5: match.inline 5.81% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 810 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 12: predicate.addn_check_dump 1.65% : 0.000002s : 12: predicate.addn_zero_filter 2.23% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.18% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.85% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000008s : 26: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.83% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 18: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000002s : 12: predicate.minmaximum_grad 2.21% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000002s : 12: predicate.print_const_string_wrapper 1.99% : 0.000003s : 12: predicate.reduce_eliminate 1.64% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.98% : 0.000003s : 21: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000011s : 64: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.12% : 0.000002s : 12: predicate.transpose_eliminate 1.55% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.72% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.47% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 12: predicate.value_based_eliminate 0.53% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000913 16 45.78% : 0.000418s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.28% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.94% : 0.000429s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065857 72 0.10% : 0.000064s : 1: add_recomputation 0.11% : 0.000074s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.50% : 0.000326s : 1: bootstrap 0.05% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 22.27% : 0.014667s : 1: jit_opt_a 0.26% : 0.000172s : 1: jit_opt_after_cconv 0.09% : 0.000062s : 1: jit_opt_b 0.79% : 0.000520s : 1: loop_unroll 1.14% : 0.000750s : 1: mutable_eliminate 1.60% : 0.001056s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.14% : 0.000093s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000059s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000788s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000053s : 1: py_interpret_to_execute 0.03% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.40% : 0.001583s : 1: renormalize.infer 0.72% : 0.000472s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000049s : 1: rewriter_after_opt_a 0.15% : 0.000097s : 1: rewriter_before_opt_a 0.18% : 0.000120s : 1: symbol_engine_optimizer 67.60% : 0.044518s : 1: type_inference TotalTime = 0.224365, [30] [bootstrap]: 0.00038787 [type_inference]: 0.211318 [event_method]: 2.398e-05 [auto_monad]: 7.818e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00050189 [rewriter_before_opt_a]: 0.00010459 [expand_dump_flag]: 4.35e-06 [jit_opt_a]: 0.00931814, [2] [Cycle 1]: 0.00524936, [27] [switch_simplify]: 6.549e-05 [loop_unroll]: 3.424e-05 [a_1]: 0.00070472 [with_stream_mark]: 1.957e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.45999e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.41001e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.69001e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 7.03e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 9.99999e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00401916 [add_forward_monad_depend]: 8.93002e-06 [auto_monad_grad]: 3.04001e-06 [auto_monad_eliminator]: 2.145e-05 [cse]: 4.174e-05 [replace_applicator]: 2.417e-05 [Cycle 2]: 0.00052197, [27] [switch_simplify]: 7.71999e-06 [loop_unroll]: 7.2e-06 [a_1]: 0.00013084 [with_stream_mark]: 1.403e-05 [recompute_prepare]: 1.104e-05 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.73998e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 7.03998e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 3.11999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.945e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.079e-05 [inline_without_move]: 5.68002e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 2.04999e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 9.35001e-06 [cse]: 2.334e-05 [replace_applicator]: 9.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.762e-05 [rewriter_after_opt_a]: 4.412e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00081658 [jit_opt_b]: 6.105e-05, [1] [Cycle 1]: 5.3e-05, [2] [frontend_op_eliminate]: 2.083e-05 [inline_after_opt_a]: 2.019e-05 [cconv]: 3.142e-05 [loop_unroll]: 0.00048638 [jit_opt_after_cconv]: 0.00018865, [1] [Cycle 1]: 0.00018196, [11] [c_1]: 2.663e-05 [parameter_eliminate]: 2.99001e-06 [updatestate_depend_eliminate]: 6.99001e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 3.165e-05 [call_graph_tuple_transform]: 2.576e-05 [tuple_list_get_item_eliminator]: 7.15e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 1.04e-06 [switch_simplify]: 7.08e-06 [remove_dup_value]: 2.035e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.016e-05 [add_recomputation]: 5.773e-05 [cse_after_recomputation]: 2.572e-05, [1] [Cycle 1]: 1.961e-05, [1] [cse]: 1.368e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 7.35e-06 [opt_after_jit_grad]: 0.00049474 [symbol_engine_optimizer]: 7.777e-05, [1] [Cycle 1]: 7.162e-05, [6] [build]: 3.84002e-06 [elim_shapecalc]: 9.07001e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 7.79002e-06 [fold_const_symbol]: 9.84999e-06 [renormalize]: 4.00003e-07 [validate]: 5.175e-05 Sums bootstrap : 0.000388s : 0.18% type_inference : 0.211318s : 96.02% event_method : 0.000024s : 0.01% auto_monad : 0.000078s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000502s : 0.23% rewriter_before_opt_a : 0.000105s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000836s : 0.38% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004019s : 1.83% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000065s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000817s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000486s : 0.22% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000058s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000495s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.02% Time group info: ------[substitution.] 0.000272 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000007s : 4: substitution.graph_param_transform 85.48% : 0.000233s : 5: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_old_param 4.83% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.211225 2 98.50% : 0.208057s : 1: type_inference.infer 1.50% : 0.003167s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.52% : 0.000072s : 5: replace.inline 31.48% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 95.05% : 0.000230s : 5: match.inline 4.95% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.01% : 0.000007s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 19: predicate.load_eliminater 1.60% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 1.60% : 0.000002s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.39% : 0.000003s : 23: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.66% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.58% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002698 25 60.54% : 0.001634s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.62% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.84% : 0.000994s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.229569 72 0.03% : 0.000061s : 1: add_recomputation 0.04% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.18% : 0.000410s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.06% : 0.009322s : 1: jit_opt_a 0.08% : 0.000191s : 1: jit_opt_after_cconv 0.03% : 0.000064s : 1: jit_opt_b 0.22% : 0.000495s : 1: loop_unroll 0.36% : 0.000827s : 1: mutable_eliminate 0.48% : 0.001112s : 26: opt.transform.jit_opt_a 0.03% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000503s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000508s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.32% : 0.003026s : 1: renormalize.infer 0.43% : 0.000980s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.05% : 0.000110s : 1: rewriter_before_opt_a 0.03% : 0.000080s : 1: symbol_engine_optimizer 92.06% : 0.211334s : 1: type_inference TotalTime = 0.0413665, [30] [bootstrap]: 0.00028603 [type_inference]: 0.0217558 [event_method]: 1.964e-05 [auto_monad]: 7.276e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00011168 [rewriter_before_opt_a]: 8.285e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.0164689, [2] [Cycle 1]: 0.0125447, [27] [switch_simplify]: 5.891e-05 [loop_unroll]: 2.987e-05 [a_1]: 0.00054649 [with_stream_mark]: 1.962e-05 [recompute_prepare]: 7.99002e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.70998e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.71002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 9.48002e-06 [meta_fg_expand]: 2.63003e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 0.0114737 [add_forward_monad_depend]: 1.145e-05 [auto_monad_grad]: 3.66999e-06 [auto_monad_eliminator]: 2.524e-05 [cse]: 4.448e-05 [replace_applicator]: 2.325e-05 [Cycle 2]: 0.00037545, [27] [switch_simplify]: 7.6e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00010503 [with_stream_mark]: 1.617e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 5.71003e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.96001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.931e-05 [j_node_and_user_rematch]: 9.26998e-06 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 9.99999e-06 [inline_without_move]: 5.81998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.99001e-06 [cse]: 1.44e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 2.249e-05 [rewriter_after_opt_a]: 4.335e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00078161 [jit_opt_b]: 5.882e-05, [1] [Cycle 1]: 5.061e-05, [2] [frontend_op_eliminate]: 1.927e-05 [inline_after_opt_a]: 1.895e-05 [cconv]: 3.348e-05 [loop_unroll]: 0.00045952 [jit_opt_after_cconv]: 0.00019479, [1] [Cycle 1]: 0.00016568, [11] [c_1]: 2.58e-05 [parameter_eliminate]: 3.90998e-06 [updatestate_depend_eliminate]: 8.67998e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 3.426e-05 [call_graph_tuple_transform]: 2.163e-05 [tuple_list_get_item_eliminator]: 5.83997e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.59998e-06 [remove_dup_value]: 1.876e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.58998e-06 [add_recomputation]: 5.393e-05 [cse_after_recomputation]: 2.557e-05, [1] [Cycle 1]: 1.914e-05, [1] [cse]: 1.3e-05 [auto_monad_reorder]: 1.88e-05 [get_jit_bprop_graph]: 2.69001e-06 [rewriter_after_jit_bprop_graph]: 7.21001e-06 [opt_after_jit_grad]: 0.00049702 [symbol_engine_optimizer]: 8.095e-05, [1] [Cycle 1]: 7.359e-05, [6] [build]: 4.75001e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 1.401e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.048e-05 [renormalize]: 3.69997e-07 [validate]: 4.707e-05 Sums bootstrap : 0.000286s : 0.77% type_inference : 0.021756s : 58.56% event_method : 0.000020s : 0.05% auto_monad : 0.000073s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000112s : 0.30% rewriter_before_opt_a : 0.000083s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.18% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000652s : 1.75% jit_opt_a.with_stream_mark : 0.000036s : 0.10% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.011474s : 30.88% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.03% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.09% jit_opt_a.cse : 0.000059s : 0.16% jit_opt_a.replace_applicator : 0.000029s : 0.08% py_interpret_to_execute_after_opt_a : 0.000022s : 0.06% rewriter_after_opt_a : 0.000043s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000782s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.05% cconv : 0.000033s : 0.09% loop_unroll : 0.000460s : 1.24% jit_opt_after_cconv.c_1 : 0.000026s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000054s : 0.15% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000497s : 1.34% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.13% Time group info: ------[substitution.] 0.000209 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 1.01% : 0.000002s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 3: substitution.graph_param_transform 81.83% : 0.000171s : 4: substitution.inline 1.92% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000006s : 4: substitution.remove_not_recompute_node 2.81% : 0.000006s : 2: substitution.replace_old_param 6.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021685 2 93.26% : 0.020224s : 1: type_inference.infer 6.74% : 0.001462s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.13% : 0.000050s : 4: replace.inline 32.87% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.69% : 0.000168s : 4: match.inline 6.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.53% : 0.000002s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 10: predicate.environ_get_depend_swap 1.17% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 5.76% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.68% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.37% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 1.91% : 0.000003s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.59% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.12% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000868 13 41.05% : 0.000356s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.52% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.44% : 0.000481s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053790 72 0.11% : 0.000057s : 1: add_recomputation 0.14% : 0.000076s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.57% : 0.000307s : 1: bootstrap 0.07% : 0.000036s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 30.62% : 0.016472s : 1: jit_opt_a 0.37% : 0.000198s : 1: jit_opt_after_cconv 0.11% : 0.000061s : 1: jit_opt_b 0.87% : 0.000468s : 1: loop_unroll 1.47% : 0.000793s : 1: mutable_eliminate 1.66% : 0.000892s : 26: opt.transform.jit_opt_a 0.10% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000506s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000116s : 1: py_interpret_to_execute 0.05% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 20.20% : 0.010867s : 1: renormalize.infer 1.10% : 0.000591s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000046s : 1: rewriter_after_opt_a 0.16% : 0.000087s : 1: rewriter_before_opt_a 0.15% : 0.000083s : 1: symbol_engine_optimizer 40.48% : 0.021773s : 1: type_inference TotalTime = 0.197266, [30] [bootstrap]: 0.00033751 [type_inference]: 0.17018 [event_method]: 1.954e-05 [auto_monad]: 7.097e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.02999e-06 [py_interpret_to_execute]: 0.00027373 [rewriter_before_opt_a]: 8.284e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0239162, [2] [Cycle 1]: 0.0198389, [27] [switch_simplify]: 5.966e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.0168217 [with_stream_mark]: 2.845e-05 [recompute_prepare]: 1.42e-05 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.98999e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 8.03001e-06 [updatestate_useless_node_eliminater]: 6.81001e-06 [accelerated_algorithm]: 9.02e-06 [meta_shard_fg_expand]: 4.23001e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 4.86002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 1.323e-05 [meta_fg_expand]: 3.96001e-06 [replace_old_param]: 1.273e-05 [inline_without_move]: 7.21001e-06 [renormalize]: 0.00247836 [add_forward_monad_depend]: 7.91001e-06 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 1.877e-05 [cse]: 3.152e-05 [replace_applicator]: 1.918e-05 [Cycle 2]: 0.00037418, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 6.23e-06 [a_1]: 0.00012605 [with_stream_mark]: 1.229e-05 [recompute_prepare]: 6.44001e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 3.02002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.94e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.56e-06 [cse]: 1.225e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.357e-05 [rewriter_after_opt_a]: 3.779e-05 [convert_after_rewriter]: 7.60998e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00077669 [jit_opt_b]: 5.506e-05, [1] [Cycle 1]: 4.749e-05, [2] [frontend_op_eliminate]: 1.934e-05 [inline_after_opt_a]: 1.755e-05 [cconv]: 2.746e-05 [loop_unroll]: 0.00041807 [jit_opt_after_cconv]: 0.00014849, [1] [Cycle 1]: 0.0001423, [11] [c_1]: 2.558e-05 [parameter_eliminate]: 3.01001e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.03002e-06 [cse]: 1.979e-05 [call_graph_tuple_transform]: 1.992e-05 [tuple_list_get_item_eliminator]: 6.12999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.576e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 7.86001e-06 [add_recomputation]: 5.159e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.744e-05, [1] [cse]: 1.155e-05 [auto_monad_reorder]: 1.531e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 5.46e-06 [opt_after_jit_grad]: 0.0004482 [symbol_engine_optimizer]: 8.946e-05, [1] [Cycle 1]: 8.355e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 7.92e-06 [elim_not_effective]: 2.616e-05 [opt_reshape]: 7.10998e-06 [fold_const_symbol]: 9.97001e-06 [renormalize]: 4.19997e-07 [validate]: 4.531e-05 Sums bootstrap : 0.000338s : 0.17% type_inference : 0.170180s : 88.20% event_method : 0.000020s : 0.01% auto_monad : 0.000071s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000274s : 0.14% rewriter_before_opt_a : 0.000083s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.016948s : 8.78% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002478s : 1.28% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000777s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000418s : 0.22% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000448s : 0.23% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.02% Time group info: ------[substitution.] 0.016287 24 0.01% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000001s : 2: substitution.fold_const_symbol 0.04% : 0.000006s : 4: substitution.graph_param_transform 1.31% : 0.000213s : 4: substitution.inline 0.04% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.03% : 0.000005s : 4: substitution.remove_not_recompute_node 0.04% : 0.000006s : 2: substitution.replace_old_param 98.53% : 0.016047s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.170100 2 98.70% : 0.167887s : 1: type_inference.infer 1.30% : 0.002213s : 1: type_inference.specialize ------[replace.] 0.000155 6 33.93% : 0.000052s : 4: replace.inline 66.07% : 0.000102s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.016253 6 1.30% : 0.000211s : 4: match.inline 98.70% : 0.016042s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.63% : 0.000003s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.63% : 0.000003s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.41% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.70% : 0.000003s : 12: predicate.environ_get_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.37% : 0.000008s : 26: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.83% : 0.000003s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.35% : 0.000004s : 18: predicate.load_eliminater 0.97% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.19% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 2.19% : 0.000003s : 12: predicate.reduce_eliminate 1.55% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 12: predicate.reshape_eliminate 1.49% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.72% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.98% : 0.000005s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.65% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.60% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.60% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.34% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002230 22 67.72% : 0.001510s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.37% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.92% : 0.000667s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.217025 72 0.03% : 0.000054s : 1: add_recomputation 0.03% : 0.000074s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.16% : 0.000355s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 11.02% : 0.023920s : 1: jit_opt_a 0.07% : 0.000151s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.20% : 0.000426s : 1: loop_unroll 0.36% : 0.000786s : 1: mutable_eliminate 7.93% : 0.017204s : 26: opt.transform.jit_opt_a 0.03% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000456s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000279s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.78% : 0.001703s : 1: renormalize.infer 0.35% : 0.000764s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000089s : 1: rewriter_before_opt_a 0.04% : 0.000092s : 1: symbol_engine_optimizer 78.42% : 0.170197s : 1: type_inference TotalTime = 0.033448, [30] [bootstrap]: 0.00033661 [type_inference]: 0.00526269 [event_method]: 2.052e-05 [auto_monad]: 6.607e-05 [graph_reusing]: 5.83002e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 3.664e-05 [rewriter_before_opt_a]: 8.26e-05 [expand_dump_flag]: 3.25998e-06 [jit_opt_a]: 0.0254315, [2] [Cycle 1]: 0.00197555, [27] [switch_simplify]: 6.812e-05 [loop_unroll]: 3.477e-05 [a_1]: 0.00069937 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 8.64003e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 0.00079611 [add_forward_monad_depend]: 6.36998e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.463e-05 [cse]: 3.04e-05 [replace_applicator]: 1.343e-05 [Cycle 2]: 0.00031964, [27] [switch_simplify]: 5.34e-06 [loop_unroll]: 4.67e-06 [a_1]: 8.971e-05 [with_stream_mark]: 9.20999e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 4.72e-06 [updatestate_useless_node_eliminater]: 4.70001e-06 [accelerated_algorithm]: 5.02999e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 4.33999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 7.44002e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 7.42998e-06 [inline_without_move]: 4.48999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 4.94e-06 [cse]: 1.031e-05 [replace_applicator]: 4.79e-06 [py_interpret_to_execute_after_opt_a]: 1.154e-05 [rewriter_after_opt_a]: 3.508e-05 [convert_after_rewriter]: 6.54999e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00061706 [jit_opt_b]: 4.897e-05, [1] [Cycle 1]: 4.102e-05, [2] [frontend_op_eliminate]: 1.491e-05 [inline_after_opt_a]: 1.527e-05 [cconv]: 2.813e-05 [loop_unroll]: 0.00042128 [jit_opt_after_cconv]: 0.00014271, [1] [Cycle 1]: 0.00013628, [11] [c_1]: 2.095e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.155e-05 [call_graph_tuple_transform]: 1.818e-05 [tuple_list_get_item_eliminator]: 4.90001e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.38002e-06 [remove_dup_value]: 1.411e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 5.54998e-06 [add_recomputation]: 5.163e-05 [cse_after_recomputation]: 2.138e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.002e-05 [auto_monad_reorder]: 1.608e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00046327 [symbol_engine_optimizer]: 7.206e-05, [1] [Cycle 1]: 6.539e-05, [6] [build]: 4.08001e-06 [elim_shapecalc]: 7.01001e-06 [elim_not_effective]: 1.279e-05 [opt_reshape]: 5.30999e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 1.33002e-06 [validate]: 4.373e-05 Sums bootstrap : 0.000337s : 3.47% type_inference : 0.005263s : 54.32% event_method : 0.000021s : 0.21% auto_monad : 0.000066s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000037s : 0.38% rewriter_before_opt_a : 0.000083s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.76% jit_opt_a.loop_unroll : 0.000039s : 0.41% jit_opt_a.a_1 : 0.000789s : 8.14% jit_opt_a.with_stream_mark : 0.000029s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000009s : 0.10% jit_opt_a.renormalize : 0.000796s : 8.22% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.20% jit_opt_a.cse : 0.000041s : 0.42% jit_opt_a.replace_applicator : 0.000018s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000035s : 0.36% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000617s : 6.37% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000028s : 0.29% loop_unroll : 0.000421s : 4.35% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.53% cse_after_recomputation.cse : 0.000010s : 0.10% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000463s : 4.78% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.45% Time group info: ------[substitution.] 0.000268 25 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000006s : 3: substitution.graph_param_transform 86.50% : 0.000232s : 5: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000004s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.43% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005195 2 82.52% : 0.004287s : 1: type_inference.infer 17.48% : 0.000908s : 1: type_inference.specialize ------[replace.] 0.000106 8 65.87% : 0.000070s : 5: replace.inline 34.13% : 0.000036s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 8 94.57% : 0.000229s : 5: match.inline 5.43% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 810 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 26: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.98% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 2.09% : 0.000003s : 12: predicate.reduce_eliminate 1.79% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 21: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.31% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.80% : 0.000010s : 64: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000734 16 53.45% : 0.000392s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.59% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.97% : 0.000279s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035300 72 0.15% : 0.000054s : 1: add_recomputation 0.20% : 0.000070s : 1: auto_monad 0.05% : 0.000018s : 1: auto_monad_reorder 1.02% : 0.000359s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 72.05% : 0.025436s : 1: jit_opt_a 0.41% : 0.000146s : 1: jit_opt_after_cconv 0.15% : 0.000052s : 1: jit_opt_b 1.21% : 0.000429s : 1: loop_unroll 1.78% : 0.000629s : 1: mutable_eliminate 2.88% : 0.001016s : 26: opt.transform.jit_opt_a 0.13% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000024s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000472s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000039s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000016s : 1: remove_dup_value 1.27% : 0.000449s : 1: renormalize.infer 0.96% : 0.000338s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000085s : 1: rewriter_before_opt_a 0.21% : 0.000074s : 1: symbol_engine_optimizer 14.95% : 0.005276s : 1: type_inference TotalTime = 0.0138317, [30] [bootstrap]: 0.00033458 [type_inference]: 0.00516235 [event_method]: 1.997e-05 [auto_monad]: 7.433e-05 [graph_reusing]: 5.73002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.581e-05 [rewriter_before_opt_a]: 7.648e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00587052, [2] [Cycle 1]: 0.00196509, [27] [switch_simplify]: 5.955e-05 [loop_unroll]: 2.931e-05 [a_1]: 0.00058183 [with_stream_mark]: 2.188e-05 [recompute_prepare]: 7.94002e-06 [updatestate_depend_eliminate]: 4.29002e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.53999e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.33002e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00091608 [add_forward_monad_depend]: 6.51e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 3.451e-05 [replace_applicator]: 1.566e-05 [Cycle 2]: 0.000318, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 4.99998e-06 [a_1]: 9.035e-05 [with_stream_mark]: 9.52001e-06 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.62e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 7.58999e-06 [meta_fg_expand]: 1.56002e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 4.67e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.33998e-06 [cse]: 9.92999e-06 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.215e-05 [rewriter_after_opt_a]: 3.611e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.06997e-06 [mutable_eliminate]: 0.00054264 [jit_opt_b]: 4.873e-05, [1] [Cycle 1]: 4.185e-05, [2] [frontend_op_eliminate]: 1.576e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 2.676e-05 [loop_unroll]: 0.00051041 [jit_opt_after_cconv]: 0.00015534, [1] [Cycle 1]: 0.00014871, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 5.47999e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.176e-05 [call_graph_tuple_transform]: 1.87e-05 [tuple_list_get_item_eliminator]: 5.69999e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 1.739e-05 [remove_dup_value]: 1.43e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.04001e-06 [add_recomputation]: 5.334e-05 [cse_after_recomputation]: 2.269e-05, [1] [Cycle 1]: 1.697e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.646e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 5.59e-06 [opt_after_jit_grad]: 0.00045724 [symbol_engine_optimizer]: 7.834e-05, [1] [Cycle 1]: 7.173e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.556e-05 [opt_reshape]: 5.95002e-06 [fold_const_symbol]: 9.33002e-06 [renormalize]: 1.04e-06 [validate]: 4.39e-05 Sums bootstrap : 0.000335s : 3.47% type_inference : 0.005162s : 53.55% event_method : 0.000020s : 0.21% auto_monad : 0.000074s : 0.77% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000046s : 0.48% rewriter_before_opt_a : 0.000076s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.68% jit_opt_a.loop_unroll : 0.000034s : 0.36% jit_opt_a.a_1 : 0.000672s : 6.97% jit_opt_a.with_stream_mark : 0.000031s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000916s : 9.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.25% jit_opt_a.cse : 0.000044s : 0.46% jit_opt_a.replace_applicator : 0.000021s : 0.21% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000036s : 0.37% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000543s : 5.63% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000027s : 0.28% loop_unroll : 0.000510s : 5.29% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000017s : 0.18% remove_dup_value : 0.000014s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.55% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000457s : 4.74% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.46% Time group info: ------[substitution.] 0.000246 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.17% : 0.000005s : 3: substitution.graph_param_transform 85.35% : 0.000210s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005087 2 81.03% : 0.004122s : 1: type_inference.infer 18.97% : 0.000965s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.31% : 0.000050s : 4: replace.inline 32.69% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.65% : 0.000208s : 4: match.inline 5.35% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 2.46% : 0.000003s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.93% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.48% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.63% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000725 13 50.87% : 0.000369s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.72% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.41% : 0.000308s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015693 72 0.36% : 0.000056s : 1: add_recomputation 0.50% : 0.000078s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.26% : 0.000355s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.43% : 0.005874s : 1: jit_opt_a 1.01% : 0.000158s : 1: jit_opt_after_cconv 0.33% : 0.000052s : 1: jit_opt_b 3.31% : 0.000520s : 1: loop_unroll 3.51% : 0.000551s : 1: mutable_eliminate 5.67% : 0.000889s : 26: opt.transform.jit_opt_a 0.38% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.98% : 0.000467s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000049s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 3.08% : 0.000484s : 1: renormalize.infer 2.69% : 0.000423s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.50% : 0.000079s : 1: rewriter_before_opt_a 0.52% : 0.000081s : 1: symbol_engine_optimizer 33.02% : 0.005182s : 1: type_inference TotalTime = 0.0364342, [30] [bootstrap]: 0.00029641 [type_inference]: 0.0061266 [event_method]: 2.156e-05 [auto_monad]: 6.757e-05 [graph_reusing]: 6.91001e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 4.438e-05 [rewriter_before_opt_a]: 9.198e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.0275795, [2] [Cycle 1]: 0.00208934, [27] [switch_simplify]: 7.236e-05 [loop_unroll]: 3.478e-05 [a_1]: 0.00069428 [with_stream_mark]: 2.125e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.43002e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00092236 [add_forward_monad_depend]: 5.87999e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.593e-05 [cse]: 3.612e-05 [replace_applicator]: 1.292e-05 [Cycle 2]: 0.00031214, [27] [switch_simplify]: 5.86998e-06 [loop_unroll]: 4.98001e-06 [a_1]: 8.735e-05 [with_stream_mark]: 9.25001e-06 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.31002e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 7.73001e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 6.63e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.219e-05 [replace_applicator]: 5.13002e-06 [py_interpret_to_execute_after_opt_a]: 1.28e-05 [rewriter_after_opt_a]: 3.682e-05 [convert_after_rewriter]: 6.69999e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00055411 [jit_opt_b]: 4.88e-05, [1] [Cycle 1]: 4.151e-05, [2] [frontend_op_eliminate]: 1.512e-05 [inline_after_opt_a]: 1.542e-05 [cconv]: 2.548e-05 [loop_unroll]: 0.00041777 [jit_opt_after_cconv]: 0.00014019, [1] [Cycle 1]: 0.00013357, [11] [c_1]: 2.055e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 6.44999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.104e-05 [call_graph_tuple_transform]: 1.865e-05 [tuple_list_get_item_eliminator]: 5.15001e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 1.497e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 9.62999e-06 [add_recomputation]: 5.4e-05 [cse_after_recomputation]: 2.174e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.841e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 4.27e-06 [opt_after_jit_grad]: 0.00049551 [symbol_engine_optimizer]: 9.758e-05, [1] [Cycle 1]: 9.107e-05, [6] [build]: 1.137e-05 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 2.617e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 8.40024e-07 [validate]: 4.674e-05 Sums bootstrap : 0.000296s : 2.78% type_inference : 0.006127s : 57.40% event_method : 0.000022s : 0.20% auto_monad : 0.000068s : 0.63% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000044s : 0.42% rewriter_before_opt_a : 0.000092s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000078s : 0.73% jit_opt_a.loop_unroll : 0.000040s : 0.37% jit_opt_a.a_1 : 0.000782s : 7.32% jit_opt_a.with_stream_mark : 0.000031s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000922s : 8.64% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.20% jit_opt_a.cse : 0.000048s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.17% py_interpret_to_execute_after_opt_a : 0.000013s : 0.12% rewriter_after_opt_a : 0.000037s : 0.34% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000554s : 5.19% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000025s : 0.24% loop_unroll : 0.000418s : 3.91% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000010s : 0.09% add_recomputation : 0.000054s : 0.51% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000018s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000496s : 4.64% symbol_engine_optimizer.build : 0.000011s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.25% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000047s : 0.44% Time group info: ------[substitution.] 0.000260 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 3: substitution.graph_param_transform 86.26% : 0.000224s : 5: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000004s : 2: substitution.replace_old_param 5.74% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006059 2 78.99% : 0.004786s : 1: type_inference.infer 21.01% : 0.001273s : 1: type_inference.specialize ------[replace.] 0.000108 8 66.40% : 0.000072s : 5: replace.inline 33.60% : 0.000036s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 8 94.28% : 0.000222s : 5: match.inline 5.72% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 810 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.59% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 2.47% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.34% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.98% : 0.000008s : 26: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.11% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 15: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.47% : 0.000002s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.66% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 21: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 20: predicate.switch_defer_inline 2.28% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.07% : 0.000011s : 64: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000001s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 12: predicate.value_based_eliminate 0.57% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000939 16 52.69% : 0.000495s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.50% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.81% : 0.000383s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038429 72 0.15% : 0.000057s : 1: add_recomputation 0.18% : 0.000071s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.83% : 0.000320s : 1: bootstrap 0.07% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000012s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 71.78% : 0.027583s : 1: jit_opt_a 0.37% : 0.000143s : 1: jit_opt_after_cconv 0.13% : 0.000051s : 1: jit_opt_b 1.11% : 0.000426s : 1: loop_unroll 1.46% : 0.000563s : 1: mutable_eliminate 2.64% : 0.001016s : 26: opt.transform.jit_opt_a 0.12% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000047s : 4: opt.transform.symbol_engine_opt 1.31% : 0.000504s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000047s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.32% : 0.000508s : 1: renormalize.infer 1.06% : 0.000406s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000040s : 1: rewriter_after_opt_a 0.25% : 0.000095s : 1: rewriter_before_opt_a 0.26% : 0.000100s : 1: symbol_engine_optimizer 15.98% : 0.006142s : 1: type_inference TotalTime = 0.171548, [30] [bootstrap]: 0.0003439 [type_inference]: 0.157324 [event_method]: 2.265e-05 [auto_monad]: 7.522e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.0004769 [rewriter_before_opt_a]: 0.00010184 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0103924, [2] [Cycle 1]: 0.00595216, [27] [switch_simplify]: 7.708e-05 [loop_unroll]: 3.472e-05 [a_1]: 0.00077619 [with_stream_mark]: 2.549e-05 [recompute_prepare]: 1.078e-05 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.75002e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 3.28e-06 [get_grad_eliminate_]: 6.76999e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 1.137e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.097e-05 [inline_without_move]: 6.83e-06 [renormalize]: 0.00460884 [add_forward_monad_depend]: 1.095e-05 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 2.205e-05 [cse]: 4.303e-05 [replace_applicator]: 2.547e-05 [Cycle 2]: 0.00060001, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00015905 [with_stream_mark]: 1.939e-05 [recompute_prepare]: 1.033e-05 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.79001e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 3.04001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.166e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 5.74999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.11002e-06 [auto_monad_eliminator]: 8.72e-06 [cse]: 2.028e-05 [replace_applicator]: 6.46999e-06 [py_interpret_to_execute_after_opt_a]: 1.831e-05 [rewriter_after_opt_a]: 4.384e-05 [convert_after_rewriter]: 6.49001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00083019 [jit_opt_b]: 5.904e-05, [1] [Cycle 1]: 5.069e-05, [2] [frontend_op_eliminate]: 2.021e-05 [inline_after_opt_a]: 2.006e-05 [cconv]: 3.241e-05 [loop_unroll]: 0.00046225 [jit_opt_after_cconv]: 0.0001745, [1] [Cycle 1]: 0.00016758, [11] [c_1]: 2.736e-05 [parameter_eliminate]: 3.36999e-06 [updatestate_depend_eliminate]: 7.36999e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 3.289e-05 [call_graph_tuple_transform]: 2.473e-05 [tuple_list_get_item_eliminator]: 6.38003e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.52001e-06 [remove_dup_value]: 2.018e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 1.074e-05 [add_recomputation]: 5.456e-05 [cse_after_recomputation]: 2.619e-05, [1] [Cycle 1]: 2.033e-05, [1] [cse]: 1.442e-05 [auto_monad_reorder]: 1.836e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 7.46001e-06 [opt_after_jit_grad]: 0.00050199 [symbol_engine_optimizer]: 9.065e-05, [1] [Cycle 1]: 8.385e-05, [6] [build]: 4.96002e-06 [elim_shapecalc]: 9.48002e-06 [elim_not_effective]: 2.053e-05 [opt_reshape]: 7.06001e-06 [fold_const_symbol]: 1.312e-05 [renormalize]: 4.50003e-07 [validate]: 0.00019801 Sums bootstrap : 0.000344s : 0.21% type_inference : 0.157324s : 94.28% event_method : 0.000023s : 0.01% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000477s : 0.29% rewriter_before_opt_a : 0.000102s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000935s : 0.56% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004609s : 2.76% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000063s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000830s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000462s : 0.28% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000055s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000502s : 0.30% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000198s : 0.12% Time group info: ------[substitution.] 0.000326 25 0.72% : 0.000002s : 2: substitution.elim_not_effective 1.44% : 0.000005s : 2: substitution.fold_const_symbol 2.12% : 0.000007s : 4: substitution.graph_param_transform 86.08% : 0.000281s : 5: substitution.inline 1.52% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000006s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 4.37% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.157239 2 98.18% : 0.154374s : 1: type_inference.infer 1.82% : 0.002865s : 1: type_inference.specialize ------[replace.] 0.000112 7 69.89% : 0.000078s : 5: replace.inline 30.11% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 7 95.57% : 0.000278s : 5: match.inline 4.43% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 2.08% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.96% : 0.000009s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 19: predicate.load_eliminater 0.99% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.76% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.74% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.76% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.08% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.85% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002506 25 62.31% : 0.001561s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.82% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.87% : 0.000849s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.177299 72 0.03% : 0.000057s : 1: add_recomputation 0.04% : 0.000078s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000366s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000029s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 5.86% : 0.010396s : 1: jit_opt_a 0.10% : 0.000177s : 1: jit_opt_after_cconv 0.03% : 0.000062s : 1: jit_opt_b 0.27% : 0.000471s : 1: loop_unroll 0.47% : 0.000841s : 1: mutable_eliminate 0.69% : 0.001223s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000511s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000483s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.06% : 0.003658s : 1: renormalize.infer 0.53% : 0.000936s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.06% : 0.000107s : 1: rewriter_before_opt_a 0.05% : 0.000093s : 1: symbol_engine_optimizer 88.75% : 0.157346s : 1: type_inference TotalTime = 0.0138079, [30] [bootstrap]: 0.0003118 [type_inference]: 0.00528316 [event_method]: 1.893e-05 [auto_monad]: 6.756e-05 [graph_reusing]: 5.76998e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 4.635e-05 [rewriter_before_opt_a]: 7.621e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00589276, [2] [Cycle 1]: 0.00200418, [27] [switch_simplify]: 6.199e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00059078 [with_stream_mark]: 2.012e-05 [recompute_prepare]: 8.67998e-06 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.46999e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 9.46998e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 5.81e-06 [renormalize]: 0.00095641 [add_forward_monad_depend]: 5.31002e-06 [auto_monad_grad]: 2.50002e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 2.936e-05 [replace_applicator]: 1.27e-05 [Cycle 2]: 0.00031356, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 4.90001e-06 [a_1]: 8.884e-05 [with_stream_mark]: 9.74e-06 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 4.86002e-06 [accelerated_algorithm]: 4.57998e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.296e-05 [j_node_and_user_rematch]: 7.92003e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 5.72999e-06 [cse]: 9.65002e-06 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 1.094e-05 [rewriter_after_opt_a]: 3.693e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 4.99003e-06 [mutable_eliminate]: 0.00055706 [jit_opt_b]: 4.791e-05, [1] [Cycle 1]: 4.101e-05, [2] [frontend_op_eliminate]: 1.517e-05 [inline_after_opt_a]: 1.492e-05 [cconv]: 2.711e-05 [loop_unroll]: 0.00040606 [jit_opt_after_cconv]: 0.00014014, [1] [Cycle 1]: 0.00013394, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 3.01999e-06 [updatestate_depend_eliminate]: 5.84e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.166e-05 [call_graph_tuple_transform]: 1.82e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 4.95001e-06 [remove_dup_value]: 1.612e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 4.92e-06 [add_recomputation]: 5.052e-05 [cse_after_recomputation]: 3.398e-05, [1] [Cycle 1]: 2.903e-05, [1] [cse]: 2.307e-05 [auto_monad_reorder]: 1.587e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00044503 [symbol_engine_optimizer]: 7.324e-05, [1] [Cycle 1]: 6.72e-05, [6] [build]: 4.35999e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 5.90002e-06 [fold_const_symbol]: 9.63997e-06 [renormalize]: 4.40021e-07 [validate]: 3.794e-05 Sums bootstrap : 0.000312s : 3.23% type_inference : 0.005283s : 54.71% event_method : 0.000019s : 0.20% auto_monad : 0.000068s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.48% rewriter_before_opt_a : 0.000076s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.70% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000680s : 7.04% jit_opt_a.with_stream_mark : 0.000030s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000956s : 9.90% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.23% jit_opt_a.cse : 0.000039s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000037s : 0.38% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000557s : 5.77% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000027s : 0.28% loop_unroll : 0.000406s : 4.20% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000051s : 0.52% cse_after_recomputation.cse : 0.000023s : 0.24% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000445s : 4.61% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.39% Time group info: ------[substitution.] 0.000247 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.87% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000005s : 3: substitution.graph_param_transform 84.66% : 0.000209s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000006s : 2: substitution.replace_old_param 5.67% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005217 2 79.14% : 0.004129s : 1: type_inference.infer 20.86% : 0.001088s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.94% : 0.000051s : 4: replace.inline 31.06% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.13% : 0.000207s : 4: match.inline 5.87% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 2.30% : 0.000003s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.87% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.48% : 0.000002s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 2.00% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.46% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.18% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000782 13 48.70% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.58% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.72% : 0.000350s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015717 72 0.34% : 0.000053s : 1: add_recomputation 0.45% : 0.000071s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.10% : 0.000331s : 1: bootstrap 0.19% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.23% : 0.000036s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.52% : 0.005896s : 1: jit_opt_a 0.91% : 0.000143s : 1: jit_opt_after_cconv 0.32% : 0.000050s : 1: jit_opt_b 2.63% : 0.000414s : 1: loop_unroll 3.61% : 0.000567s : 1: mutable_eliminate 5.75% : 0.000903s : 26: opt.transform.jit_opt_a 0.29% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.88% : 0.000453s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000049s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 3.45% : 0.000542s : 1: renormalize.infer 2.59% : 0.000407s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000040s : 1: rewriter_after_opt_a 0.50% : 0.000079s : 1: rewriter_before_opt_a 0.48% : 0.000076s : 1: symbol_engine_optimizer 33.72% : 0.005300s : 1: type_inference TotalTime = 0.406717, [30] [bootstrap]: 0.0003366 [type_inference]: 0.395032 [event_method]: 2.252e-05 [auto_monad]: 7.109e-05 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00051581 [rewriter_before_opt_a]: 0.0001071 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00824381, [2] [Cycle 1]: 0.00396483, [27] [switch_simplify]: 6.305e-05 [loop_unroll]: 3.331e-05 [a_1]: 0.0006287 [with_stream_mark]: 2.166e-05 [recompute_prepare]: 9.93998e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 1.165e-05 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 6.02001e-06 [renormalize]: 0.00284849 [add_forward_monad_depend]: 6.75002e-06 [auto_monad_grad]: 2.80997e-06 [auto_monad_eliminator]: 1.72e-05 [cse]: 3.526e-05 [replace_applicator]: 1.541e-05 [Cycle 2]: 0.00038795, [27] [switch_simplify]: 7.43e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.00013207 [with_stream_mark]: 1.253e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.32001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 2.03002e-06 [replace_old_param]: 8.87999e-06 [inline_without_move]: 5.61003e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24998e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.53e-06 [cse]: 1.548e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.344e-05 [rewriter_after_opt_a]: 3.895e-05 [convert_after_rewriter]: 7.92998e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00065407 [jit_opt_b]: 5.561e-05, [1] [Cycle 1]: 4.851e-05, [2] [frontend_op_eliminate]: 1.874e-05 [inline_after_opt_a]: 1.859e-05 [cconv]: 2.691e-05 [loop_unroll]: 0.00043661 [jit_opt_after_cconv]: 0.00015801, [1] [Cycle 1]: 0.00015135, [11] [c_1]: 2.59e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 6.83e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.91e-06 [cse]: 2.494e-05 [call_graph_tuple_transform]: 2.135e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.58e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 8.11002e-06 [add_recomputation]: 5.175e-05 [cse_after_recomputation]: 2.421e-05, [1] [Cycle 1]: 1.924e-05, [1] [cse]: 1.287e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 5.81e-06 [opt_after_jit_grad]: 0.00047276 [symbol_engine_optimizer]: 7.477e-05, [1] [Cycle 1]: 6.853e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 9.24998e-06 [elim_not_effective]: 1.379e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 5.09986e-07 [validate]: 0.00010499 Sums bootstrap : 0.000337s : 0.08% type_inference : 0.395032s : 98.22% event_method : 0.000023s : 0.01% auto_monad : 0.000071s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000516s : 0.13% rewriter_before_opt_a : 0.000107s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.02% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000761s : 0.19% jit_opt_a.with_stream_mark : 0.000034s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002849s : 0.71% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000051s : 0.01% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000654s : 0.16% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.00% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000027s : 0.01% loop_unroll : 0.000437s : 0.11% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000052s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000473s : 0.12% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000105s : 0.03% Time group info: ------[substitution.] 0.000240 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 4: substitution.graph_param_transform 84.90% : 0.000204s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 6.06% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.394950 2 99.13% : 0.391531s : 1: type_inference.infer 0.87% : 0.003419s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.30% : 0.000054s : 4: replace.inline 32.70% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 93.77% : 0.000201s : 4: match.inline 6.23% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.19% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.97% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.42% : 0.000002s : 12: predicate.print_const_string_wrapper 1.86% : 0.000003s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000010s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.53% : 0.000002s : 12: predicate.transpose_eliminate 1.26% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002453 22 61.69% : 0.001513s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.93% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.37% : 0.000892s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.410581 72 0.01% : 0.000054s : 1: add_recomputation 0.02% : 0.000075s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.09% : 0.000356s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 2.01% : 0.008247s : 1: jit_opt_a 0.04% : 0.000161s : 1: jit_opt_after_cconv 0.01% : 0.000058s : 1: jit_opt_b 0.11% : 0.000444s : 1: loop_unroll 0.16% : 0.000664s : 1: mutable_eliminate 0.25% : 0.001012s : 26: opt.transform.jit_opt_a 0.01% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000481s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000526s : 1: py_interpret_to_execute 0.00% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.50% : 0.002057s : 1: renormalize.infer 0.19% : 0.000780s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.03% : 0.000113s : 1: rewriter_before_opt_a 0.02% : 0.000077s : 1: symbol_engine_optimizer 96.22% : 0.395050s : 1: type_inference TotalTime = 0.254775, [30] [bootstrap]: 0.00029461 [type_inference]: 0.239966 [event_method]: 0.00041477 [auto_monad]: 0.00022212 [graph_reusing]: 2.493e-05 [pre_auto_parallel]: 4.15e-06 [py_interpret_to_execute]: 4.816e-05 [rewriter_before_opt_a]: 0.00015642 [expand_dump_flag]: 4.32998e-06 [jit_opt_a]: 0.0110351, [2] [Cycle 1]: 0.00671149, [27] [switch_simplify]: 0.00019697 [loop_unroll]: 6.364e-05 [a_1]: 0.00348655 [with_stream_mark]: 2.087e-05 [recompute_prepare]: 1.199e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.35998e-06 [parameter_eliminate]: 2.58003e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.98e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.11997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.718e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.183e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00249962 [add_forward_monad_depend]: 9.03002e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.039e-05 [cse]: 3.858e-05 [replace_applicator]: 2.037e-05 [Cycle 2]: 0.00036378, [27] [switch_simplify]: 7.03998e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00010379 [with_stream_mark]: 1.565e-05 [recompute_prepare]: 5.46998e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.55002e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 6.50002e-06 [meta_shard_fg_expand]: 2.28998e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.816e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.33001e-06 [inline_without_move]: 4.81002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.312e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.539e-05 [rewriter_after_opt_a]: 4.055e-05 [convert_after_rewriter]: 7.20998e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00088195 [jit_opt_b]: 5.485e-05, [1] [Cycle 1]: 4.728e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 2.895e-05 [loop_unroll]: 0.00043194 [jit_opt_after_cconv]: 0.00015188, [1] [Cycle 1]: 0.00014502, [11] [c_1]: 2.271e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 6.57002e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.42e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 1.30007e-07 [switch_simplify]: 7e-06 [remove_dup_value]: 1.664e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.36998e-06 [add_recomputation]: 5.164e-05 [cse_after_recomputation]: 2.246e-05, [1] [Cycle 1]: 1.742e-05, [1] [cse]: 1.171e-05 [auto_monad_reorder]: 1.856e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 6.48998e-06 [opt_after_jit_grad]: 0.00045674 [symbol_engine_optimizer]: 0.00015878, [1] [Cycle 1]: 0.00015206, [6] [build]: 3.65998e-06 [elim_shapecalc]: 7.41001e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 8.933e-05 [renormalize]: 4.69998e-07 [validate]: 4.624e-05 Sums bootstrap : 0.000295s : 0.12% type_inference : 0.239966s : 95.94% event_method : 0.000415s : 0.17% auto_monad : 0.000222s : 0.09% graph_reusing : 0.000025s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000048s : 0.02% rewriter_before_opt_a : 0.000156s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000204s : 0.08% jit_opt_a.loop_unroll : 0.000070s : 0.03% jit_opt_a.a_1 : 0.003590s : 1.44% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002500s : 1.00% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000052s : 0.02% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000882s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000432s : 0.17% jit_opt_after_cconv.c_1 : 0.000023s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000052s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000457s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000089s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.02% Time group info: ------[substitution.] 0.001500 35 0.14% : 0.000002s : 2: substitution.elim_not_effective 0.11% : 0.000002s : 2: substitution.fold_const_symbol 0.37% : 0.000006s : 3: substitution.graph_param_transform 95.80% : 0.001437s : 12: substitution.inline 0.31% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.37% : 0.000006s : 4: substitution.remove_not_recompute_node 0.40% : 0.000006s : 2: substitution.replace_old_param 0.68% : 0.000010s : 1: substitution.reshape_eliminate 0.86% : 0.000013s : 3: substitution.switch_simplify 0.96% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.239856 2 86.77% : 0.208115s : 1: type_inference.infer 13.23% : 0.031741s : 1: type_inference.specialize ------[replace.] 0.001427 18 88.31% : 0.001261s : 12: replace.inline 0.41% : 0.000006s : 1: replace.reshape_eliminate 4.62% : 0.000066s : 3: replace.switch_simplify 6.66% : 0.000095s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001464 18 97.71% : 0.001431s : 12: match.inline 0.64% : 0.000009s : 1: match.reshape_eliminate 0.77% : 0.000011s : 3: match.switch_simplify 0.89% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000216 1212 1.49% : 0.000003s : 19: predicate.accumulaten_eliminater 0.52% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 19: predicate.addn_check_dump 1.62% : 0.000003s : 19: predicate.addn_zero_filter 2.78% : 0.000006s : 19: predicate.arithmetic_simplify 1.29% : 0.000003s : 20: predicate.cast_eliminate 0.29% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 19: predicate.compare_switch_simplify 1.69% : 0.000004s : 19: predicate.depend_value_elim 1.40% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.47% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.46% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.52% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.27% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.23% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.25% : 0.000003s : 20: predicate.environ_get_depend_swap 1.73% : 0.000004s : 20: predicate.environ_get_eliminate 1.22% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.73% : 0.000002s : 6: predicate.get_grad_eliminate 0.13% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000012s : 40: predicate.inline 0.45% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000003s : 6: predicate.less_batch_normalization 1.39% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.86% : 0.000004s : 25: predicate.load_eliminater 0.72% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000010s : 64: predicate.loop_unroll_before_grad 1.87% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.18% : 0.000003s : 19: predicate.merge_addn 1.13% : 0.000002s : 19: predicate.minmaximum_grad 1.05% : 0.000002s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000005s : 25: predicate.partial_eliminate 1.22% : 0.000003s : 19: predicate.print_const_string_wrapper 2.27% : 0.000005s : 19: predicate.reduce_eliminate 1.82% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.37% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000003s : 28: predicate.replace_applicator 0.28% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.57% : 0.000003s : 20: predicate.reshape_eliminate 1.34% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.54% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000003s : 19: predicate.same_eliminate 0.28% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.57% : 0.000001s : 6: predicate.special_op_eliminate 0.53% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.24% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.56% : 0.000008s : 34: predicate.switch_defer_inline 2.90% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.62% : 0.000019s : 107: predicate.switch_simplify 1.43% : 0.000003s : 19: predicate.tile_eliminate 1.29% : 0.000003s : 19: predicate.transpose_eliminate 1.70% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.83% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.78% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.55% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.22% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.80% : 0.000004s : 19: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.46% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004191 40 48.94% : 0.002051s : 21: func_graph_cloner_run.FuncGraphClonerGraph 27.88% : 0.001168s : 5: func_graph_cloner_run.FuncGraphClonerNode 23.18% : 0.000972s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.261410 72 0.02% : 0.000054s : 1: add_recomputation 0.09% : 0.000231s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000309s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.16% : 0.000425s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000029s : 1: graph_reusing 4.22% : 0.011039s : 1: jit_opt_a 0.06% : 0.000154s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.17% : 0.000441s : 1: loop_unroll 0.34% : 0.000892s : 1: mutable_eliminate 1.53% : 0.004006s : 26: opt.transform.jit_opt_a 0.02% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000113s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000465s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000051s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.65% : 0.001688s : 1: renormalize.infer 0.31% : 0.000802s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000160s : 1: rewriter_before_opt_a 0.06% : 0.000161s : 1: symbol_engine_optimizer 91.81% : 0.239989s : 1: type_inference TotalTime = 0.0483245, [30] [bootstrap]: 0.00032711 [type_inference]: 0.0403002 [event_method]: 2.009e-05 [auto_monad]: 6.966e-05 [graph_reusing]: 6.28998e-06 [pre_auto_parallel]: 2.63998e-06 [py_interpret_to_execute]: 0.00010928 [rewriter_before_opt_a]: 8.422e-05 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.0052619, [2] [Cycle 1]: 0.00182347, [27] [switch_simplify]: 5.991e-05 [loop_unroll]: 2.981e-05 [a_1]: 0.00057565 [with_stream_mark]: 1.979e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 2.33002e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.83002e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00079811 [add_forward_monad_depend]: 4.91997e-06 [auto_monad_grad]: 2.98998e-06 [auto_monad_eliminator]: 1.453e-05 [cse]: 3.406e-05 [replace_applicator]: 1.321e-05 [Cycle 2]: 0.00031988, [27] [switch_simplify]: 5.98002e-06 [loop_unroll]: 5.22999e-06 [a_1]: 9.07e-05 [with_stream_mark]: 9.39e-06 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 8.30012e-07 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 8.06001e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.36001e-06 [inline_without_move]: 5.04e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.77999e-06 [cse]: 1.193e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.405e-05 [rewriter_after_opt_a]: 3.759e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00056245 [jit_opt_b]: 4.999e-05, [1] [Cycle 1]: 4.279e-05, [2] [frontend_op_eliminate]: 1.547e-05 [inline_after_opt_a]: 1.562e-05 [cconv]: 2.503e-05 [loop_unroll]: 0.00042457 [jit_opt_after_cconv]: 0.00014301, [1] [Cycle 1]: 0.00013649, [11] [c_1]: 2.133e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 5.86998e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.173e-05 [call_graph_tuple_transform]: 1.853e-05 [tuple_list_get_item_eliminator]: 5.60001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 5.45001e-06 [add_recomputation]: 4.936e-05 [cse_after_recomputation]: 2.445e-05, [1] [Cycle 1]: 1.88e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.854e-05 [get_jit_bprop_graph]: 2.18998e-06 [rewriter_after_jit_bprop_graph]: 5.49998e-06 [opt_after_jit_grad]: 0.00045906 [symbol_engine_optimizer]: 7.24e-05, [1] [Cycle 1]: 6.627e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 7.83001e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 5.90002e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 3.89991e-07 [validate]: 3.665e-05 Sums bootstrap : 0.000327s : 0.73% type_inference : 0.040300s : 90.31% event_method : 0.000020s : 0.05% auto_monad : 0.000070s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000109s : 0.24% rewriter_before_opt_a : 0.000084s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.15% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000666s : 1.49% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000798s : 1.79% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000046s : 0.10% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000038s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000562s : 1.26% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000025s : 0.06% loop_unroll : 0.000425s : 0.95% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000049s : 0.11% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000459s : 1.03% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.08% Time group info: ------[substitution.] 0.000214 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000005s : 3: substitution.graph_param_transform 83.96% : 0.000179s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 6.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040227 2 96.57% : 0.038849s : 1: type_inference.infer 3.43% : 0.001378s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.61% : 0.000048s : 4: replace.inline 32.39% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.73% : 0.000177s : 4: match.inline 6.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.29% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.52% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.79% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.73% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000787 13 50.32% : 0.000396s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.63% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.05% : 0.000347s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050058 72 0.10% : 0.000052s : 1: add_recomputation 0.15% : 0.000073s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.68% : 0.000341s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.52% : 0.005265s : 1: jit_opt_a 0.29% : 0.000146s : 1: jit_opt_after_cconv 0.10% : 0.000053s : 1: jit_opt_b 0.86% : 0.000433s : 1: loop_unroll 1.14% : 0.000572s : 1: mutable_eliminate 1.77% : 0.000887s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.93% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000114s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 0.87% : 0.000434s : 1: renormalize.infer 0.71% : 0.000355s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.18% : 0.000088s : 1: rewriter_before_opt_a 0.15% : 0.000075s : 1: symbol_engine_optimizer 80.54% : 0.040316s : 1: type_inference TotalTime = 0.139429, [30] [bootstrap]: 0.00035112 [type_inference]: 0.113894 [event_method]: 2.753e-05 [auto_monad]: 9.403e-05 [graph_reusing]: 7.30998e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00048274 [rewriter_before_opt_a]: 0.00012808 [expand_dump_flag]: 4.05998e-06 [jit_opt_a]: 0.0213985, [2] [Cycle 1]: 0.0164678, [27] [switch_simplify]: 7.72e-05 [loop_unroll]: 3.516e-05 [a_1]: 0.00078135 [with_stream_mark]: 2.569e-05 [recompute_prepare]: 1.017e-05 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.75998e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 7.32002e-06 [meta_shard_fg_expand]: 3.06001e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.695e-05 [j_node_and_user_rematch]: 0.0122767 [meta_fg_expand]: 1.012e-05 [replace_old_param]: 2.833e-05 [inline_without_move]: 9.82001e-06 [renormalize]: 0.00276533 [add_forward_monad_depend]: 1.174e-05 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 2.147e-05 [cse]: 3.981e-05 [replace_applicator]: 2.393e-05 [Cycle 2]: 0.00041324, [27] [switch_simplify]: 8.32e-06 [loop_unroll]: 6.60997e-06 [a_1]: 0.00013627 [with_stream_mark]: 1.631e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.33002e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.98001e-06 [cell_reuse_recompute_pass]: 3.35998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.878e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.42999e-06 [inline_without_move]: 6.31e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 6.70002e-06 [cse]: 1.619e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.865e-05 [rewriter_after_opt_a]: 4.49e-05 [convert_after_rewriter]: 7.21999e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.0009131 [jit_opt_b]: 6.364e-05, [1] [Cycle 1]: 5.384e-05, [2] [frontend_op_eliminate]: 2.108e-05 [inline_after_opt_a]: 2.158e-05 [cconv]: 3.618e-05 [loop_unroll]: 0.00066202 [jit_opt_after_cconv]: 0.00018988, [1] [Cycle 1]: 0.00018267, [11] [c_1]: 2.85e-05 [parameter_eliminate]: 4.52e-06 [updatestate_depend_eliminate]: 9.59e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 4.025e-05 [call_graph_tuple_transform]: 2.617e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.89999e-06 [remove_dup_value]: 2.147e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 1.175e-05 [add_recomputation]: 5.49e-05 [cse_after_recomputation]: 2.703e-05, [1] [Cycle 1]: 2.074e-05, [1] [cse]: 1.44e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 8.95999e-06 [opt_after_jit_grad]: 0.00050786 [symbol_engine_optimizer]: 8.273e-05, [1] [Cycle 1]: 7.581e-05, [6] [build]: 4.32998e-06 [elim_shapecalc]: 9.63997e-06 [elim_not_effective]: 1.605e-05 [opt_reshape]: 7.06999e-06 [fold_const_symbol]: 1.03e-05 [renormalize]: 4.00003e-07 [validate]: 0.00012797 Sums bootstrap : 0.000351s : 0.26% type_inference : 0.113894s : 84.90% event_method : 0.000028s : 0.02% auto_monad : 0.000094s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000483s : 0.36% rewriter_before_opt_a : 0.000128s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000918s : 0.68% jit_opt_a.with_stream_mark : 0.000042s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.012287s : 9.16% jit_opt_a.meta_fg_expand : 0.000013s : 0.01% jit_opt_a.replace_old_param : 0.000038s : 0.03% jit_opt_a.inline_without_move : 0.000016s : 0.01% jit_opt_a.renormalize : 0.002765s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000913s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000662s : 0.49% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000508s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000128s : 0.10% Time group info: ------[substitution.] 0.000338 25 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 1.87% : 0.000006s : 4: substitution.graph_param_transform 85.60% : 0.000290s : 5: substitution.inline 2.94% : 0.000010s : 4: substitution.j_node_and_user_rematch 1.71% : 0.000006s : 4: substitution.remove_not_recompute_node 2.80% : 0.000009s : 2: substitution.replace_old_param 3.88% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113758 2 97.40% : 0.110798s : 1: type_inference.infer 2.60% : 0.002960s : 1: type_inference.specialize ------[replace.] 0.000110 7 68.29% : 0.000075s : 5: replace.inline 31.71% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000298 7 96.08% : 0.000286s : 5: match.inline 3.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 888 1.42% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.68% : 0.000003s : 13: predicate.addn_zero_filter 1.76% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.86% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 6.09% : 0.000009s : 28: predicate.inline 1.73% : 0.000003s : 8: predicate.inline_without_move 1.53% : 0.000002s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 19: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 2.09% : 0.000003s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.62% : 0.000003s : 13: predicate.print_const_string_wrapper 1.84% : 0.000003s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.15% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.99% : 0.000002s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000004s : 20: predicate.switch_defer_inline 1.91% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000011s : 65: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.68% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003263 29 68.83% : 0.002246s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.97% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.20% : 0.000920s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155663 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000098s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000372s : 1: bootstrap 0.03% : 0.000039s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 13.75% : 0.021402s : 1: jit_opt_a 0.12% : 0.000193s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.43% : 0.000673s : 1: loop_unroll 0.60% : 0.000926s : 1: mutable_eliminate 8.66% : 0.013477s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000492s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 1.16% : 0.001811s : 1: renormalize.infer 0.60% : 0.000936s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.09% : 0.000135s : 1: rewriter_before_opt_a 0.05% : 0.000085s : 1: symbol_engine_optimizer 73.19% : 0.113929s : 1: type_inference TotalTime = 0.0618056, [30] [bootstrap]: 0.00036061 [type_inference]: 0.0508063 [event_method]: 0.00010672 [auto_monad]: 0.00011461 [graph_reusing]: 7.78999e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 4.431e-05 [rewriter_before_opt_a]: 0.00014955 [expand_dump_flag]: 3.97e-06 [jit_opt_a]: 0.00771623, [2] [Cycle 1]: 0.00315825, [27] [switch_simplify]: 0.0001592 [loop_unroll]: 5.697e-05 [a_1]: 0.00119709 [with_stream_mark]: 2.012e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 5.11002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.68998e-06 [replace_old_param]: 9.62999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 0.00135821 [add_forward_monad_depend]: 6.54001e-06 [auto_monad_grad]: 2.55002e-06 [auto_monad_eliminator]: 1.801e-05 [cse]: 4.029e-05 [replace_applicator]: 1.602e-05 [Cycle 2]: 0.00033425, [27] [switch_simplify]: 6.26998e-06 [loop_unroll]: 5.71e-06 [a_1]: 9.248e-05 [with_stream_mark]: 1.13e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.75997e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.42999e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 7.82e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.09e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.526e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.159e-05 [rewriter_after_opt_a]: 3.87e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00064315 [jit_opt_b]: 5.34e-05, [1] [Cycle 1]: 4.539e-05, [2] [frontend_op_eliminate]: 1.645e-05 [inline_after_opt_a]: 1.671e-05 [cconv]: 2.895e-05 [loop_unroll]: 0.0005332 [jit_opt_after_cconv]: 0.00015932, [1] [Cycle 1]: 0.0001524, [11] [c_1]: 2.254e-05 [parameter_eliminate]: 2.87002e-06 [updatestate_depend_eliminate]: 7.83999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.60002e-06 [cse]: 2.862e-05 [call_graph_tuple_transform]: 1.958e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 2.06e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.59998e-06 [remove_dup_value]: 3.708e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.80002e-06 [add_recomputation]: 5.544e-05 [cse_after_recomputation]: 2.499e-05, [1] [Cycle 1]: 1.911e-05, [1] [cse]: 1.204e-05 [auto_monad_reorder]: 1.806e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 6.71999e-06 [opt_after_jit_grad]: 0.00052748 [symbol_engine_optimizer]: 7.734e-05, [1] [Cycle 1]: 7.044e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 8.30999e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 9.12999e-06 [renormalize]: 3.60014e-07 [validate]: 4.108e-05 Sums bootstrap : 0.000361s : 0.63% type_inference : 0.050806s : 89.23% event_method : 0.000107s : 0.19% auto_monad : 0.000115s : 0.20% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000044s : 0.08% rewriter_before_opt_a : 0.000150s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000165s : 0.29% jit_opt_a.loop_unroll : 0.000063s : 0.11% jit_opt_a.a_1 : 0.001290s : 2.26% jit_opt_a.with_stream_mark : 0.000031s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001358s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000056s : 0.10% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000039s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000643s : 1.13% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000533s : 0.94% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000037s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000527s : 0.93% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000439 33 0.44% : 0.000002s : 2: substitution.elim_not_effective 0.31% : 0.000001s : 2: substitution.fold_const_symbol 1.14% : 0.000005s : 3: substitution.graph_param_transform 89.87% : 0.000394s : 11: substitution.inline 0.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.14% : 0.000005s : 4: substitution.remove_not_recompute_node 1.12% : 0.000005s : 2: substitution.replace_old_param 2.22% : 0.000010s : 2: substitution.switch_simplify 3.17% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050706 2 61.61% : 0.031241s : 1: type_inference.infer 38.39% : 0.019465s : 1: type_inference.specialize ------[replace.] 0.000255 16 53.21% : 0.000136s : 11: replace.inline 17.12% : 0.000044s : 2: replace.switch_simplify 29.67% : 0.000076s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000410 16 94.87% : 0.000389s : 11: match.inline 2.10% : 0.000009s : 2: match.switch_simplify 3.03% : 0.000012s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000191 1148 1.28% : 0.000002s : 18: predicate.accumulaten_eliminater 0.76% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 18: predicate.addn_check_dump 1.64% : 0.000003s : 18: predicate.addn_zero_filter 2.08% : 0.000004s : 18: predicate.arithmetic_simplify 1.41% : 0.000003s : 18: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.24% : 0.000002s : 18: predicate.compare_switch_simplify 1.27% : 0.000002s : 18: predicate.depend_value_elim 1.24% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 18: predicate.dict_get_item_eliminator 1.35% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 18: predicate.environ_get_depend_swap 1.47% : 0.000003s : 18: predicate.environ_get_eliminate 1.22% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.65% : 0.000001s : 6: predicate.get_grad_eliminate 0.17% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000010s : 38: predicate.inline 0.53% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.80% : 0.000002s : 6: predicate.less_batch_normalization 1.97% : 0.000004s : 21: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 24: predicate.load_eliminater 1.60% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.85% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.70% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 18: predicate.merge_addn 1.22% : 0.000002s : 18: predicate.minmaximum_grad 1.13% : 0.000002s : 3: predicate.mutable_eliminate 0.27% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000004s : 24: predicate.partial_eliminate 1.31% : 0.000002s : 18: predicate.print_const_string_wrapper 1.89% : 0.000004s : 18: predicate.reduce_eliminate 1.54% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000003s : 27: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000001s : 3: predicate.reset_defer_inline 1.34% : 0.000003s : 18: predicate.reshape_eliminate 1.50% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.83% : 0.000002s : 3: predicate.row_tensor_eliminate 1.32% : 0.000003s : 18: predicate.same_eliminate 0.38% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.70% : 0.000001s : 6: predicate.special_op_eliminate 0.63% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 18: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.86% : 0.000005s : 32: predicate.switch_defer_inline 2.68% : 0.000005s : 32: predicate.switch_layer_defer_inline 8.64% : 0.000017s : 103: predicate.switch_simplify 1.41% : 0.000003s : 18: predicate.tile_eliminate 1.52% : 0.000003s : 18: predicate.transpose_eliminate 1.56% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.49% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.46% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 18: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.019029 28 5.68% : 0.001081s : 9: func_graph_cloner_run.FuncGraphClonerGraph 1.04% : 0.000198s : 6: func_graph_cloner_run.FuncGraphClonerNode 93.28% : 0.017750s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064859 72 0.09% : 0.000058s : 1: add_recomputation 0.18% : 0.000120s : 1: auto_monad 0.05% : 0.000032s : 1: auto_monad_reorder 0.59% : 0.000382s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.17% : 0.000113s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 11.90% : 0.007720s : 1: jit_opt_a 0.25% : 0.000162s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.84% : 0.000543s : 1: loop_unroll 1.01% : 0.000653s : 1: mutable_eliminate 2.53% : 0.001638s : 26: opt.transform.jit_opt_a 0.08% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000536s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000047s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000040s : 1: remove_dup_value 1.30% : 0.000843s : 1: renormalize.infer 0.78% : 0.000506s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000153s : 1: rewriter_before_opt_a 0.12% : 0.000080s : 1: symbol_engine_optimizer 78.37% : 0.050829s : 1: type_inference TotalTime = 0.0933077, [30] [bootstrap]: 0.00040829 [type_inference]: 0.0716876 [event_method]: 0.0110943 [auto_monad]: 0.0001403 [graph_reusing]: 8.57e-06 [pre_auto_parallel]: 3.55998e-06 [py_interpret_to_execute]: 4.941e-05 [rewriter_before_opt_a]: 0.00015725 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.00756109, [2] [Cycle 1]: 0.00308738, [27] [switch_simplify]: 0.00015952 [loop_unroll]: 5.566e-05 [a_1]: 0.00119884 [with_stream_mark]: 2.105e-05 [recompute_prepare]: 8.04997e-06 [updatestate_depend_eliminate]: 4.14997e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 6.58998e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.067e-05 [inline_without_move]: 5.49e-06 [renormalize]: 0.00130226 [add_forward_monad_depend]: 5.71998e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.562e-05 [cse]: 3.942e-05 [replace_applicator]: 1.172e-05 [Cycle 2]: 0.00032029, [27] [switch_simplify]: 6.05002e-06 [loop_unroll]: 5.52001e-06 [a_1]: 8.912e-05 [with_stream_mark]: 9.10999e-06 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 7.43999e-06 [inline_without_move]: 5.07e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 5.44e-06 [cse]: 1.328e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.076e-05 [rewriter_after_opt_a]: 3.906e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00053615 [jit_opt_b]: 4.962e-05, [1] [Cycle 1]: 4.297e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.617e-05 [cconv]: 2.467e-05 [loop_unroll]: 0.00043698 [jit_opt_after_cconv]: 0.000147, [1] [Cycle 1]: 0.00014062, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 2.55002e-06 [updatestate_depend_eliminate]: 7.03998e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.53998e-06 [cse]: 2.481e-05 [call_graph_tuple_transform]: 1.856e-05 [tuple_list_get_item_eliminator]: 5.19e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 3.402e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 5.69999e-06 [add_recomputation]: 4.892e-05 [cse_after_recomputation]: 2.352e-05, [1] [Cycle 1]: 1.827e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.00047909 [symbol_engine_optimizer]: 7.31e-05, [1] [Cycle 1]: 6.67e-05, [6] [build]: 3.03998e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 6.11e-06 [fold_const_symbol]: 8.37998e-06 [renormalize]: 3.19997e-07 [validate]: 3.85e-05 Sums bootstrap : 0.000408s : 0.46% type_inference : 0.071688s : 80.97% event_method : 0.011094s : 12.53% auto_monad : 0.000140s : 0.16% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000049s : 0.06% rewriter_before_opt_a : 0.000157s : 0.18% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000166s : 0.19% jit_opt_a.loop_unroll : 0.000061s : 0.07% jit_opt_a.a_1 : 0.001288s : 1.45% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001302s : 1.47% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000053s : 0.06% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000536s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000437s : 0.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000034s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000479s : 0.54% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000467 33 0.40% : 0.000002s : 2: substitution.elim_not_effective 0.27% : 0.000001s : 2: substitution.fold_const_symbol 1.18% : 0.000006s : 3: substitution.graph_param_transform 89.95% : 0.000420s : 11: substitution.inline 0.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.10% : 0.000005s : 2: substitution.replace_old_param 2.41% : 0.000011s : 2: substitution.switch_simplify 3.00% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071600 2 97.11% : 0.069532s : 1: type_inference.infer 2.89% : 0.002069s : 1: type_inference.specialize ------[replace.] 0.000268 16 53.12% : 0.000143s : 11: replace.inline 17.95% : 0.000048s : 2: replace.switch_simplify 28.93% : 0.000078s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000437 16 94.84% : 0.000415s : 11: match.inline 2.31% : 0.000010s : 2: match.switch_simplify 2.86% : 0.000012s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000184 1148 1.29% : 0.000002s : 18: predicate.accumulaten_eliminater 0.64% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 18: predicate.addn_check_dump 1.46% : 0.000003s : 18: predicate.addn_zero_filter 2.25% : 0.000004s : 18: predicate.arithmetic_simplify 1.38% : 0.000003s : 18: predicate.cast_eliminate 0.33% : 0.000001s : 3: predicate.check_bprop_eliminate 1.24% : 0.000002s : 18: predicate.compare_switch_simplify 1.36% : 0.000003s : 18: predicate.depend_value_elim 1.24% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 18: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 18: predicate.environ_get_depend_swap 1.42% : 0.000003s : 18: predicate.environ_get_eliminate 1.51% : 0.000003s : 18: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000010s : 38: predicate.inline 0.55% : 0.000001s : 6: predicate.inline_without_move 0.25% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 24: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.86% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 18: predicate.merge_addn 1.23% : 0.000002s : 18: predicate.minmaximum_grad 1.11% : 0.000002s : 3: predicate.mutable_eliminate 0.34% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000004s : 24: predicate.partial_eliminate 1.30% : 0.000002s : 18: predicate.print_const_string_wrapper 1.92% : 0.000004s : 18: predicate.reduce_eliminate 1.52% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000003s : 27: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000003s : 18: predicate.reshape_eliminate 1.43% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.46% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000003s : 18: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.59% : 0.000001s : 6: predicate.special_op_eliminate 0.61% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 18: predicate.stack_unstack_eliminate 0.28% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.95% : 0.000005s : 32: predicate.switch_defer_inline 2.71% : 0.000005s : 32: predicate.switch_layer_defer_inline 8.94% : 0.000016s : 103: predicate.switch_simplify 1.58% : 0.000003s : 18: predicate.tile_eliminate 1.45% : 0.000003s : 18: predicate.transpose_eliminate 1.54% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000006s : 27: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.61% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.65% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.54% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 18: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001936 28 54.92% : 0.001063s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.31% : 0.000219s : 6: func_graph_cloner_run.FuncGraphClonerNode 33.77% : 0.000654s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.096294 72 0.05% : 0.000052s : 1: add_recomputation 0.15% : 0.000148s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.45% : 0.000429s : 1: bootstrap 0.03% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 11.55% : 0.011120s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 7.85% : 0.007563s : 1: jit_opt_a 0.16% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000052s : 1: jit_opt_b 0.46% : 0.000446s : 1: loop_unroll 0.57% : 0.000544s : 1: mutable_eliminate 1.70% : 0.001634s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000052s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000037s : 1: remove_dup_value 0.91% : 0.000872s : 1: renormalize.infer 0.44% : 0.000421s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.17% : 0.000161s : 1: rewriter_before_opt_a 0.08% : 0.000076s : 1: symbol_engine_optimizer 74.46% : 0.071704s : 1: type_inference TotalTime = 0.338357, [30] [bootstrap]: 0.00035481 [type_inference]: 0.308291 [event_method]: 2.533e-05 [auto_monad]: 8.162e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.00064429 [rewriter_before_opt_a]: 0.00010637 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0260737, [2] [Cycle 1]: 0.0213092, [27] [switch_simplify]: 6.693e-05 [loop_unroll]: 3.242e-05 [a_1]: 0.00908045 [with_stream_mark]: 2.354e-05 [recompute_prepare]: 1.496e-05 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 4.4e-06 [updatestate_loads_eliminate]: 3.48e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 7.78999e-06 [meta_shard_fg_expand]: 3.38e-06 [get_grad_eliminate_]: 7.63999e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 4.80999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 1.251e-05 [meta_fg_expand]: 4.15e-06 [replace_old_param]: 1.128e-05 [inline_without_move]: 6.64001e-06 [renormalize]: 0.0116515 [add_forward_monad_depend]: 8.72e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 2.007e-05 [cse]: 3.371e-05 [replace_applicator]: 2.58e-05 [Cycle 2]: 0.00040752, [27] [switch_simplify]: 8.07998e-06 [loop_unroll]: 6.92002e-06 [a_1]: 0.00014133 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 6.12001e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.86998e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 4.35e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.887e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 3.46001e-06 [replace_old_param]: 9.73002e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.146e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 1.508e-05 [rewriter_after_opt_a]: 3.675e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00079118 [jit_opt_b]: 6.869e-05, [1] [Cycle 1]: 5.949e-05, [2] [frontend_op_eliminate]: 2.37e-05 [inline_after_opt_a]: 2.259e-05 [cconv]: 2.988e-05 [loop_unroll]: 0.00051417 [jit_opt_after_cconv]: 0.00017998, [1] [Cycle 1]: 0.00017296, [11] [c_1]: 2.677e-05 [parameter_eliminate]: 4.21001e-06 [updatestate_depend_eliminate]: 7.95998e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 3.141e-05 [call_graph_tuple_transform]: 2.49e-05 [tuple_list_get_item_eliminator]: 7.12002e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 6.54001e-06 [remove_dup_value]: 1.914e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 1.027e-05 [add_recomputation]: 5.84e-05 [cse_after_recomputation]: 3.175e-05, [1] [Cycle 1]: 2.247e-05, [1] [cse]: 1.299e-05 [auto_monad_reorder]: 1.804e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 8.03001e-06 [opt_after_jit_grad]: 0.00057938 [symbol_engine_optimizer]: 8.45e-05, [1] [Cycle 1]: 7.691e-05, [6] [build]: 4.80001e-06 [elim_shapecalc]: 1.094e-05 [elim_not_effective]: 1.714e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 1.01e-05 [renormalize]: 4.59986e-07 [validate]: 6.046e-05 Sums bootstrap : 0.000355s : 0.11% type_inference : 0.308291s : 92.51% event_method : 0.000025s : 0.01% auto_monad : 0.000082s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000644s : 0.19% rewriter_before_opt_a : 0.000106s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.02% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.009222s : 2.77% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000009s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000008s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.011652s : 3.50% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000045s : 0.01% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000037s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000791s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000023s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000514s : 0.15% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000579s : 0.17% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.02% Time group info: ------[substitution.] 0.000252 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 2.75% : 0.000007s : 4: substitution.graph_param_transform 80.64% : 0.000203s : 4: substitution.inline 1.93% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000006s : 4: substitution.remove_not_recompute_node 2.93% : 0.000007s : 2: substitution.replace_old_param 7.64% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.308176 2 98.90% : 0.304783s : 1: type_inference.infer 1.10% : 0.003393s : 1: type_inference.specialize ------[replace.] 0.000132 6 41.42% : 0.000055s : 4: replace.inline 58.58% : 0.000077s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 92.35% : 0.000200s : 4: match.inline 7.65% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.57% : 0.000004s : 12: predicate.arithmetic_simplify 1.50% : 0.000003s : 12: predicate.cast_eliminate 0.33% : 0.000001s : 4: predicate.check_bprop_eliminate 0.84% : 0.000001s : 12: predicate.compare_switch_simplify 3.60% : 0.000006s : 12: predicate.depend_value_elim 0.96% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 0.95% : 0.000002s : 12: predicate.environ_get_eliminate 0.86% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 6.06% : 0.000010s : 26: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.17% : 0.000004s : 18: predicate.load_eliminater 1.63% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.69% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.82% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.78% : 0.000003s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 1.90% : 0.000003s : 18: predicate.partial_eliminate 1.05% : 0.000002s : 12: predicate.print_const_string_wrapper 2.06% : 0.000003s : 12: predicate.reduce_eliminate 1.32% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.76% : 0.000003s : 22: predicate.replace_applicator 0.45% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 2.08% : 0.000004s : 12: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.16% : 0.000005s : 18: predicate.switch_defer_inline 2.13% : 0.000004s : 18: predicate.switch_layer_defer_inline 6.38% : 0.000011s : 58: predicate.switch_simplify 1.39% : 0.000002s : 12: predicate.tile_eliminate 1.06% : 0.000002s : 12: predicate.transpose_eliminate 2.02% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.34% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.011059 22 16.07% : 0.001777s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.38% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 83.55% : 0.009240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.359569 72 0.02% : 0.000062s : 1: add_recomputation 0.02% : 0.000085s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.10% : 0.000375s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000034s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.25% : 0.026079s : 1: jit_opt_a 0.05% : 0.000183s : 1: jit_opt_after_cconv 0.02% : 0.000071s : 1: jit_opt_b 0.15% : 0.000526s : 1: loop_unroll 0.22% : 0.000804s : 1: mutable_eliminate 2.64% : 0.009497s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000590s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000662s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.63% : 0.002251s : 1: renormalize.infer 2.61% : 0.009386s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000040s : 1: rewriter_after_opt_a 0.03% : 0.000113s : 1: rewriter_before_opt_a 0.02% : 0.000087s : 1: symbol_engine_optimizer 85.75% : 0.308319s : 1: type_inference TotalTime = 0.0582508, [30] [bootstrap]: 0.00032737 [type_inference]: 0.0494683 [event_method]: 2.205e-05 [auto_monad]: 6.933e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.0001286 [rewriter_before_opt_a]: 8.915e-05 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.00585491, [2] [Cycle 1]: 0.00203206, [27] [switch_simplify]: 5.857e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00053839 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 7.17997e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 6.43003e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.41002e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 8.79003e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00105577 [add_forward_monad_depend]: 5.60001e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.552e-05 [cse]: 3.4e-05 [replace_applicator]: 1.42e-05 [Cycle 2]: 0.00033141, [27] [switch_simplify]: 6.91001e-06 [loop_unroll]: 5.66998e-06 [a_1]: 9.557e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.94998e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 7.50998e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.357e-05 [replace_applicator]: 5.04998e-06 [py_interpret_to_execute_after_opt_a]: 1.233e-05 [rewriter_after_opt_a]: 3.609e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00057957 [jit_opt_b]: 5.002e-05, [1] [Cycle 1]: 4.308e-05, [2] [frontend_op_eliminate]: 1.63e-05 [inline_after_opt_a]: 1.607e-05 [cconv]: 2.674e-05 [loop_unroll]: 0.00046102 [jit_opt_after_cconv]: 0.00014813, [1] [Cycle 1]: 0.00014136, [11] [c_1]: 2.19e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 6.38998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.295e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 5.99e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.63e-05 [partial_unused_args_eliminate]: 2.13002e-06 [environ_conv]: 5.90002e-06 [add_recomputation]: 5.228e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.808e-05, [1] [cse]: 1.242e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 2.906e-05 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00049884 [symbol_engine_optimizer]: 8.069e-05, [1] [Cycle 1]: 7.307e-05, [6] [build]: 4.89e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.471e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 4.30009e-07 [validate]: 4.299e-05 Sums bootstrap : 0.000327s : 0.60% type_inference : 0.049468s : 91.31% event_method : 0.000022s : 0.04% auto_monad : 0.000069s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000129s : 0.24% rewriter_before_opt_a : 0.000089s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000634s : 1.17% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001056s : 1.95% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000048s : 0.09% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000580s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000461s : 0.85% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000029s : 0.05% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000499s : 0.92% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.08% Time group info: ------[substitution.] 0.000204 23 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 84.02% : 0.000171s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 5.54% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049391 2 96.79% : 0.047806s : 1: type_inference.infer 3.21% : 0.001586s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.82% : 0.000049s : 4: replace.inline 32.18% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 94.33% : 0.000169s : 4: match.inline 5.67% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.20% : 0.000006s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.76% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.73% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000968 13 41.10% : 0.000398s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.39% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.51% : 0.000528s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060214 72 0.09% : 0.000055s : 1: add_recomputation 0.12% : 0.000073s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.57% : 0.000346s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.05% : 0.000032s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.73% : 0.005858s : 1: jit_opt_a 0.25% : 0.000151s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 0.78% : 0.000470s : 1: loop_unroll 0.98% : 0.000588s : 1: mutable_eliminate 1.41% : 0.000850s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000508s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000132s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.91% : 0.000546s : 1: renormalize.infer 0.83% : 0.000502s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.15% : 0.000093s : 1: rewriter_before_opt_a 0.14% : 0.000083s : 1: symbol_engine_optimizer 82.18% : 0.049483s : 1: type_inference TotalTime = 0.093015, [30] [bootstrap]: 0.00049753 [type_inference]: 0.0526199 [event_method]: 2.117e-05 [auto_monad]: 7.942e-05 [graph_reusing]: 6.68998e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 6.308e-05 [rewriter_before_opt_a]: 8.626e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.0370805, [2] [Cycle 1]: 0.0314779, [27] [switch_simplify]: 7.137e-05 [loop_unroll]: 3.538e-05 [a_1]: 0.00066146 [with_stream_mark]: 1.978e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.63997e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.18001e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 0.0303229 [add_forward_monad_depend]: 1.497e-05 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.66e-05 [cse]: 3.005e-05 [replace_applicator]: 1.875e-05 [Cycle 2]: 0.00035625, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 6.04999e-06 [a_1]: 0.00011152 [with_stream_mark]: 1.065e-05 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 4.1e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.195e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 7.79997e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.28e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.334e-05 [rewriter_after_opt_a]: 3.727e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00074469 [jit_opt_b]: 5.599e-05, [1] [Cycle 1]: 4.8e-05, [2] [frontend_op_eliminate]: 1.966e-05 [inline_after_opt_a]: 1.697e-05 [cconv]: 2.644e-05 [loop_unroll]: 0.00052435 [jit_opt_after_cconv]: 0.00015242, [1] [Cycle 1]: 0.00014473, [11] [c_1]: 2.172e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.393e-05 [call_graph_tuple_transform]: 2.03e-05 [tuple_list_get_item_eliminator]: 5.64998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.678e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 1.077e-05 [add_recomputation]: 6.859e-05 [cse_after_recomputation]: 2.537e-05, [1] [Cycle 1]: 1.961e-05, [1] [cse]: 1.277e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 2.08998e-06 [rewriter_after_jit_bprop_graph]: 5.99e-06 [opt_after_jit_grad]: 0.00052174 [symbol_engine_optimizer]: 7.599e-05, [1] [Cycle 1]: 6.98e-05, [6] [build]: 4.23999e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.465e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 5.19998e-07 [validate]: 4.502e-05 Sums bootstrap : 0.000498s : 0.57% type_inference : 0.052620s : 60.39% event_method : 0.000021s : 0.02% auto_monad : 0.000079s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000063s : 0.07% rewriter_before_opt_a : 0.000086s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000773s : 0.89% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.030323s : 34.80% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000043s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000745s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000524s : 0.60% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000069s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000522s : 0.60% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.05% Time group info: ------[substitution.] 0.000263 27 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 82.74% : 0.000217s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.15% : 0.000014s : 3: substitution.reduce_eliminate 1.66% : 0.000004s : 4: substitution.remove_not_recompute_node 1.62% : 0.000004s : 2: substitution.replace_old_param 4.13% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052509 2 97.46% : 0.051175s : 1: type_inference.infer 2.54% : 0.001335s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.05% : 0.000064s : 5: replace.inline 31.95% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 7 95.66% : 0.000214s : 5: match.inline 4.34% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.22% : 0.000002s : 11: predicate.accumulaten_eliminater 1.12% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 11: predicate.addn_check_dump 1.35% : 0.000002s : 11: predicate.addn_zero_filter 2.29% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.35% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 11: predicate.environ_get_depend_swap 1.57% : 0.000002s : 11: predicate.environ_get_eliminate 1.27% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.37% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.80% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000002s : 11: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 2.67% : 0.000004s : 11: predicate.reduce_eliminate 1.82% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.48% : 0.000002s : 19: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 11: predicate.reshape_eliminate 1.44% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 6: predicate.special_op_eliminate 0.79% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.30% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 2.07% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.39% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001006 16 45.06% : 0.000454s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.07% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 48.86% : 0.000492s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124407 72 0.06% : 0.000072s : 1: add_recomputation 0.07% : 0.000083s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.42% : 0.000523s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 29.81% : 0.037085s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.43% : 0.000533s : 1: loop_unroll 0.61% : 0.000754s : 1: mutable_eliminate 0.81% : 0.001014s : 26: opt.transform.jit_opt_a 0.04% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.05% : 0.000066s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 24.04% : 0.029904s : 1: renormalize.infer 0.33% : 0.000409s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 42.31% : 0.052641s : 1: type_inference TotalTime = 0.149789, [30] [bootstrap]: 0.00034906 [type_inference]: 0.138392 [event_method]: 2.643e-05 [auto_monad]: 7.859e-05 [graph_reusing]: 6.88e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00029605 [rewriter_before_opt_a]: 0.00010281 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.00814246, [2] [Cycle 1]: 0.00369889, [27] [switch_simplify]: 7.182e-05 [loop_unroll]: 3.544e-05 [a_1]: 0.00086248 [with_stream_mark]: 2.344e-05 [recompute_prepare]: 1.181e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.85998e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 8.08001e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.90002e-06 [meta_shard_fg_expand]: 2.60997e-06 [get_grad_eliminate_]: 7.18998e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.836e-05 [j_node_and_user_rematch]: 1.071e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.107e-05 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00233335 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 1.302e-05 [cse]: 2.564e-05 [replace_applicator]: 1.636e-05 [Cycle 2]: 0.00037445, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.98e-06 [a_1]: 0.00012503 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 6.67002e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.98997e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 8.49998e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.474e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.277e-05 [rewriter_after_opt_a]: 3.338e-05 [convert_after_rewriter]: 5.52001e-06 [order_py_execute_after_rewriter]: 4.42e-06 [mutable_eliminate]: 0.00066798 [jit_opt_b]: 5.791e-05, [1] [Cycle 1]: 5.191e-05, [2] [frontend_op_eliminate]: 2.076e-05 [inline_after_opt_a]: 1.961e-05 [cconv]: 1.676e-05 [loop_unroll]: 0.00044866 [jit_opt_after_cconv]: 0.00016411, [1] [Cycle 1]: 0.00015764, [11] [c_1]: 2.708e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.93998e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.881e-05 [call_graph_tuple_transform]: 2.158e-05 [tuple_list_get_item_eliminator]: 7.41001e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.66999e-06 [remove_dup_value]: 1.336e-05 [partial_unused_args_eliminate]: 1.86e-06 [environ_conv]: 8.22998e-06 [add_recomputation]: 3.576e-05 [cse_after_recomputation]: 2.597e-05, [1] [Cycle 1]: 2.042e-05, [1] [cse]: 1.421e-05 [auto_monad_reorder]: 1.159e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 4.82998e-06 [opt_after_jit_grad]: 0.00051774 [symbol_engine_optimizer]: 0.00011344, [1] [Cycle 1]: 7.426e-05, [6] [build]: 2.98e-06 [elim_shapecalc]: 1.052e-05 [elim_not_effective]: 1.503e-05 [opt_reshape]: 6.69999e-06 [fold_const_symbol]: 9.59e-06 [renormalize]: 5.89993e-07 [validate]: 4.824e-05 Sums bootstrap : 0.000349s : 0.24% type_inference : 0.138392s : 95.40% event_method : 0.000026s : 0.02% auto_monad : 0.000079s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000296s : 0.20% rewriter_before_opt_a : 0.000103s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000988s : 0.68% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002333s : 1.61% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000033s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000668s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000017s : 0.01% loop_unroll : 0.000449s : 0.31% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000518s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.03% Time group info: ------[substitution.] 0.000304 25 0.45% : 0.000001s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.63% : 0.000005s : 4: substitution.graph_param_transform 87.74% : 0.000267s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.53% : 0.000005s : 2: substitution.replace_old_param 5.14% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.138283 2 98.22% : 0.135817s : 1: type_inference.infer 1.78% : 0.002466s : 1: type_inference.specialize ------[replace.] 0.000118 7 67.93% : 0.000080s : 5: replace.inline 32.07% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 94.84% : 0.000264s : 5: match.inline 5.16% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 888 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.13% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.40% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.36% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.74% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.57% : 0.000002s : 13: predicate.same_eliminate 0.83% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000011s : 65: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.72% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.98% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004112 29 78.33% : 0.003221s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.17% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 19.50% : 0.000802s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153452 72 0.03% : 0.000039s : 1: add_recomputation 0.05% : 0.000082s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.24% : 0.000371s : 1: bootstrap 0.01% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.31% : 0.008146s : 1: jit_opt_a 0.11% : 0.000167s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.30% : 0.000457s : 1: loop_unroll 0.44% : 0.000677s : 1: mutable_eliminate 0.82% : 0.001254s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000526s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000302s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.02% : 0.001560s : 1: renormalize.infer 0.50% : 0.000762s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000107s : 1: rewriter_before_opt_a 0.08% : 0.000116s : 1: symbol_engine_optimizer 90.20% : 0.138415s : 1: type_inference TotalTime = 0.137573, [30] [bootstrap]: 0.00030092 [type_inference]: 0.0865247 [event_method]: 0.00011099 [auto_monad]: 0.00011423 [graph_reusing]: 7.68001e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 4.603e-05 [rewriter_before_opt_a]: 0.00014467 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.0479488, [2] [Cycle 1]: 0.00478918, [27] [switch_simplify]: 0.00020349 [loop_unroll]: 5.425e-05 [a_1]: 0.00236467 [with_stream_mark]: 4.278e-05 [recompute_prepare]: 1.058e-05 [updatestate_depend_eliminate]: 6.09999e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.54999e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.801e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 5.96e-06 [renormalize]: 0.00172888 [add_forward_monad_depend]: 5.67999e-06 [auto_monad_grad]: 2.88003e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 4.277e-05 [replace_applicator]: 1.48e-05 [Cycle 2]: 0.00036505, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00011514 [with_stream_mark]: 1.053e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.83001e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 7.83999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 5.07e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 6.51999e-06 [cse]: 1.865e-05 [replace_applicator]: 5.70001e-06 [py_interpret_to_execute_after_opt_a]: 1.394e-05 [rewriter_after_opt_a]: 4.154e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.74999e-06 [mutable_eliminate]: 0.00068608 [jit_opt_b]: 5.371e-05, [1] [Cycle 1]: 4.649e-05, [2] [frontend_op_eliminate]: 1.801e-05 [inline_after_opt_a]: 1.588e-05 [cconv]: 2.613e-05 [loop_unroll]: 0.00042523 [jit_opt_after_cconv]: 0.00014813, [1] [Cycle 1]: 0.00014246, [11] [c_1]: 2.106e-05 [parameter_eliminate]: 2.33998e-06 [updatestate_depend_eliminate]: 6.11998e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.439e-05 [call_graph_tuple_transform]: 2.064e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 3.159e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.31002e-06 [add_recomputation]: 5.364e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.806e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.773e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.77998e-06 [opt_after_jit_grad]: 0.00050389 [symbol_engine_optimizer]: 9.117e-05, [1] [Cycle 1]: 8.496e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 1.08e-05 [renormalize]: 4.7998e-07 [validate]: 3.976e-05 Sums bootstrap : 0.000301s : 0.32% type_inference : 0.086525s : 91.91% event_method : 0.000111s : 0.12% auto_monad : 0.000114s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000046s : 0.05% rewriter_before_opt_a : 0.000145s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000210s : 0.22% jit_opt_a.loop_unroll : 0.000060s : 0.06% jit_opt_a.a_1 : 0.002480s : 2.63% jit_opt_a.with_stream_mark : 0.000053s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001729s : 1.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000061s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000686s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000425s : 0.45% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000032s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000054s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000504s : 0.54% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.001540 33 0.12% : 0.000002s : 2: substitution.elim_not_effective 0.11% : 0.000002s : 2: substitution.fold_const_symbol 0.41% : 0.000006s : 3: substitution.graph_param_transform 96.56% : 0.001487s : 11: substitution.inline 0.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.35% : 0.000005s : 4: substitution.remove_not_recompute_node 0.34% : 0.000005s : 2: substitution.replace_old_param 0.83% : 0.000013s : 2: substitution.switch_simplify 1.06% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.086424 2 96.68% : 0.083553s : 1: type_inference.infer 3.32% : 0.002871s : 1: type_inference.specialize ------[replace.] 0.000339 16 52.85% : 0.000179s : 11: replace.inline 18.28% : 0.000062s : 2: replace.switch_simplify 28.87% : 0.000098s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.001507 16 98.28% : 0.001481s : 11: match.inline 0.75% : 0.000011s : 2: match.switch_simplify 0.97% : 0.000015s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000194 1148 1.46% : 0.000003s : 18: predicate.accumulaten_eliminater 0.95% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 18: predicate.addn_check_dump 1.48% : 0.000003s : 18: predicate.addn_zero_filter 2.33% : 0.000005s : 18: predicate.arithmetic_simplify 1.68% : 0.000003s : 18: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000002s : 18: predicate.compare_switch_simplify 1.31% : 0.000003s : 18: predicate.depend_value_elim 1.22% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.44% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.37% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.52% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.35% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 18: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.34% : 0.000003s : 18: predicate.environ_get_depend_swap 1.43% : 0.000003s : 18: predicate.environ_get_eliminate 1.21% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.72% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000001s : 3: predicate.graph_param_transform 5.39% : 0.000010s : 38: predicate.inline 0.53% : 0.000001s : 6: predicate.inline_without_move 0.25% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.72% : 0.000001s : 6: predicate.less_batch_normalization 1.59% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.87% : 0.000004s : 24: predicate.load_eliminater 0.75% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.81% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.90% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 18: predicate.merge_addn 1.22% : 0.000002s : 18: predicate.minmaximum_grad 1.24% : 0.000002s : 3: predicate.mutable_eliminate 0.27% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000004s : 24: predicate.partial_eliminate 1.45% : 0.000003s : 18: predicate.print_const_string_wrapper 1.84% : 0.000004s : 18: predicate.reduce_eliminate 1.78% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.53% : 0.000003s : 27: predicate.replace_applicator 0.34% : 0.000001s : 6: predicate.replace_old_param 0.20% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000003s : 18: predicate.reshape_eliminate 1.47% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.50% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000003s : 18: predicate.same_eliminate 0.34% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.62% : 0.000001s : 6: predicate.special_op_eliminate 0.66% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.26% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.52% : 0.000007s : 32: predicate.switch_defer_inline 2.72% : 0.000005s : 32: predicate.switch_layer_defer_inline 8.70% : 0.000017s : 103: predicate.switch_simplify 1.54% : 0.000003s : 18: predicate.tile_eliminate 1.48% : 0.000003s : 18: predicate.transpose_eliminate 1.47% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000006s : 27: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.67% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.67% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.49% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.96% : 0.000004s : 18: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003644 28 41.22% : 0.001502s : 9: func_graph_cloner_run.FuncGraphClonerGraph 33.68% : 0.001227s : 6: func_graph_cloner_run.FuncGraphClonerNode 25.10% : 0.000915s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142256 72 0.04% : 0.000056s : 1: add_recomputation 0.08% : 0.000120s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000319s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.08% : 0.000118s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 33.71% : 0.047954s : 1: jit_opt_a 0.11% : 0.000151s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.30% : 0.000432s : 1: loop_unroll 0.49% : 0.000694s : 1: mutable_eliminate 2.02% : 0.002879s : 26: opt.transform.jit_opt_a 0.03% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000036s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000049s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000034s : 1: remove_dup_value 0.83% : 0.001175s : 1: renormalize.infer 0.38% : 0.000543s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.10% : 0.000148s : 1: rewriter_before_opt_a 0.07% : 0.000094s : 1: symbol_engine_optimizer 60.84% : 0.086544s : 1: type_inference TotalTime = 0.0355236, [30] [bootstrap]: 0.00038518 [type_inference]: 0.00565038 [event_method]: 1.981e-05 [auto_monad]: 6.622e-05 [graph_reusing]: 5.54e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 4.015e-05 [rewriter_before_opt_a]: 7.891e-05 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.0055709, [2] [Cycle 1]: 0.00154406, [27] [switch_simplify]: 5.178e-05 [loop_unroll]: 2.973e-05 [a_1]: 0.00050818 [with_stream_mark]: 1.617e-05 [recompute_prepare]: 7.33999e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.363e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00061849 [add_forward_monad_depend]: 9.49e-06 [auto_monad_grad]: 2.06998e-06 [auto_monad_eliminator]: 1.448e-05 [cse]: 3.138e-05 [replace_applicator]: 1.165e-05 [Cycle 2]: 0.00031004, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.805e-05 [with_stream_mark]: 8.52e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.75002e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.91997e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.22e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.216e-05 [replace_applicator]: 5.39998e-06 [py_interpret_to_execute_after_opt_a]: 1.013e-05 [rewriter_after_opt_a]: 3.454e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.0218302 [jit_opt_b]: 6.601e-05, [1] [Cycle 1]: 5.479e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 2.228e-05 [cconv]: 4.428e-05 [loop_unroll]: 0.00057642 [jit_opt_after_cconv]: 0.00019613, [1] [Cycle 1]: 0.00018871, [11] [c_1]: 2.244e-05 [parameter_eliminate]: 6.93998e-06 [updatestate_depend_eliminate]: 1.284e-05 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.50998e-06 [cse]: 4.715e-05 [call_graph_tuple_transform]: 2.692e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 7.59988e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 1.226e-05 [add_recomputation]: 5.763e-05 [cse_after_recomputation]: 2.247e-05, [1] [Cycle 1]: 1.725e-05, [1] [cse]: 1.159e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 2.61999e-06 [rewriter_after_jit_bprop_graph]: 1.18e-05 [opt_after_jit_grad]: 0.00045975 [symbol_engine_optimizer]: 8.352e-05, [1] [Cycle 1]: 7.703e-05, [6] [build]: 1.265e-05 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 6.58e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 3.69997e-07 [validate]: 5.634e-05 Sums bootstrap : 0.000385s : 1.23% type_inference : 0.005650s : 18.10% event_method : 0.000020s : 0.06% auto_monad : 0.000066s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000040s : 0.13% rewriter_before_opt_a : 0.000079s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.18% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000596s : 1.91% jit_opt_a.with_stream_mark : 0.000025s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000619s : 1.98% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.06% jit_opt_a.cse : 0.000044s : 0.14% jit_opt_a.replace_applicator : 0.000017s : 0.05% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000035s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.021830s : 69.91% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000022s : 0.07% cconv : 0.000044s : 0.14% loop_unroll : 0.000576s : 1.85% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000047s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000012s : 0.04% add_recomputation : 0.000058s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.04% opt_after_jit_grad : 0.000460s : 1.47% symbol_engine_optimizer.build : 0.000013s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.18% Time group info: ------[substitution.] 0.000190 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.90% : 0.000002s : 2: substitution.fold_const_symbol 3.43% : 0.000007s : 3: substitution.graph_param_transform 82.47% : 0.000157s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000004s : 4: substitution.remove_not_recompute_node 2.46% : 0.000005s : 2: substitution.replace_old_param 6.00% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005586 2 78.69% : 0.004396s : 1: type_inference.infer 21.31% : 0.001190s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.05% : 0.000047s : 4: replace.inline 31.95% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.74% : 0.000154s : 4: match.inline 6.26% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.27% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.82% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 4.22% : 0.000005s : 3: predicate.mutable_eliminate 0.77% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 1.07% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.22% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.72% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000695 13 47.71% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.87% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.42% : 0.000336s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037025 72 0.16% : 0.000061s : 1: add_recomputation 0.19% : 0.000070s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.07% : 0.000398s : 1: bootstrap 0.13% : 0.000047s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000015s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.05% : 0.005573s : 1: jit_opt_a 0.54% : 0.000199s : 1: jit_opt_after_cconv 0.19% : 0.000070s : 1: jit_opt_b 1.58% : 0.000586s : 1: loop_unroll 59.04% : 0.021858s : 1: mutable_eliminate 2.17% : 0.000803s : 26: opt.transform.jit_opt_a 0.16% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000032s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000038s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000468s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000043s : 1: py_interpret_to_execute 0.03% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 0.86% : 0.000318s : 1: renormalize.infer 0.79% : 0.000293s : 1: renormalize.specialize 0.04% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000037s : 1: rewriter_after_opt_a 0.22% : 0.000082s : 1: rewriter_before_opt_a 0.23% : 0.000086s : 1: symbol_engine_optimizer 15.30% : 0.005664s : 1: type_inference TotalTime = 0.0171187, [30] [bootstrap]: 0.00028025 [type_inference]: 0.00905304 [event_method]: 2.11e-05 [auto_monad]: 6.787e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 5.118e-05 [rewriter_before_opt_a]: 8.455e-05 [expand_dump_flag]: 3.00998e-06 [jit_opt_a]: 0.00540835, [2] [Cycle 1]: 0.00186653, [27] [switch_simplify]: 6.03e-05 [loop_unroll]: 3.333e-05 [a_1]: 0.00060896 [with_stream_mark]: 1.711e-05 [recompute_prepare]: 7.38999e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.94998e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00080189 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.662e-05 [cse]: 4.002e-05 [replace_applicator]: 1.329e-05 [Cycle 2]: 0.00035882, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.212e-05 [with_stream_mark]: 9.87001e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.58003e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 4.80001e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 8.05e-06 [meta_fg_expand]: 2.801e-05 [replace_old_param]: 8.22998e-06 [inline_without_move]: 5.34e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.593e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 1.248e-05 [rewriter_after_opt_a]: 3.773e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00054236 [jit_opt_b]: 5.096e-05, [1] [Cycle 1]: 4.337e-05, [2] [frontend_op_eliminate]: 1.665e-05 [inline_after_opt_a]: 1.624e-05 [cconv]: 2.787e-05 [loop_unroll]: 0.000412 [jit_opt_after_cconv]: 0.00015012, [1] [Cycle 1]: 0.00014384, [11] [c_1]: 1.985e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 7.05e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.677e-05 [call_graph_tuple_transform]: 1.931e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 3.623e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.19001e-06 [add_recomputation]: 5.159e-05 [cse_after_recomputation]: 3.397e-05, [1] [Cycle 1]: 1.836e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 5.02999e-06 [opt_after_jit_grad]: 0.00045108 [symbol_engine_optimizer]: 7.188e-05, [1] [Cycle 1]: 6.619e-05, [6] [build]: 3.53e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.283e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.59e-06 [renormalize]: 3.29979e-07 [validate]: 4.111e-05 Sums bootstrap : 0.000280s : 2.10% type_inference : 0.009053s : 67.84% event_method : 0.000021s : 0.16% auto_monad : 0.000068s : 0.51% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000051s : 0.38% rewriter_before_opt_a : 0.000085s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.29% jit_opt_a.a_1 : 0.000701s : 5.25% jit_opt_a.with_stream_mark : 0.000027s : 0.20% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000030s : 0.23% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000802s : 6.01% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.17% jit_opt_a.cse : 0.000056s : 0.42% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000038s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000542s : 4.06% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000028s : 0.21% loop_unroll : 0.000412s : 3.09% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000036s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000052s : 0.39% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000451s : 3.38% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.31% Time group info: ------[substitution.] 0.000223 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000006s : 3: substitution.graph_param_transform 84.97% : 0.000190s : 5: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000004s : 2: substitution.replace_old_param 5.45% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008983 2 88.61% : 0.007960s : 1: type_inference.infer 11.39% : 0.001023s : 1: type_inference.specialize ------[replace.] 0.000090 7 67.27% : 0.000061s : 5: replace.inline 32.73% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 7 94.48% : 0.000186s : 5: match.inline 5.52% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 11: predicate.addn_check_dump 1.35% : 0.000002s : 11: predicate.addn_zero_filter 1.77% : 0.000002s : 11: predicate.arithmetic_simplify 1.30% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.18% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.40% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000001s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 24: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.37% : 0.000002s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.28% : 0.000002s : 11: predicate.print_const_string_wrapper 1.66% : 0.000002s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.42% : 0.000002s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.80% : 0.000003s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.93% : 0.000010s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000001s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000814 16 51.76% : 0.000421s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.56% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.68% : 0.000331s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018899 72 0.29% : 0.000054s : 1: add_recomputation 0.38% : 0.000071s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.58% : 0.000299s : 1: bootstrap 0.16% : 0.000031s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000036s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 28.63% : 0.005411s : 1: jit_opt_a 0.81% : 0.000153s : 1: jit_opt_after_cconv 0.28% : 0.000054s : 1: jit_opt_b 2.22% : 0.000420s : 1: loop_unroll 2.91% : 0.000551s : 1: mutable_eliminate 4.90% : 0.000925s : 26: opt.transform.jit_opt_a 0.25% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000459s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000054s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000039s : 1: remove_dup_value 2.48% : 0.000469s : 1: renormalize.infer 1.72% : 0.000325s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000041s : 1: rewriter_after_opt_a 0.46% : 0.000088s : 1: rewriter_before_opt_a 0.39% : 0.000074s : 1: symbol_engine_optimizer 47.99% : 0.009070s : 1: type_inference TotalTime = 0.0413427, [30] [bootstrap]: 0.00031106 [type_inference]: 0.0055643 [event_method]: 2.081e-05 [auto_monad]: 6.723e-05 [graph_reusing]: 5.60001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 4.431e-05 [rewriter_before_opt_a]: 7.96e-05 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.0054541, [2] [Cycle 1]: 0.001823, [27] [switch_simplify]: 5.927e-05 [loop_unroll]: 3.11e-05 [a_1]: 0.00055563 [with_stream_mark]: 1.96e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 8.62e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00082601 [add_forward_monad_depend]: 5.79999e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 3.375e-05 [replace_applicator]: 1.349e-05 [Cycle 2]: 0.00031714, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 5.13002e-06 [a_1]: 8.884e-05 [with_stream_mark]: 9.19e-06 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 3.32002e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 2.56998e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 8.00999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.03998e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.52001e-06 [cse]: 1.326e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.137e-05 [rewriter_after_opt_a]: 3.617e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00055175 [jit_opt_b]: 4.864e-05, [1] [Cycle 1]: 4.16e-05, [2] [frontend_op_eliminate]: 1.591e-05 [inline_after_opt_a]: 1.542e-05 [cconv]: 2.693e-05 [loop_unroll]: 0.0279162 [jit_opt_after_cconv]: 0.00021244, [1] [Cycle 1]: 0.00020292, [11] [c_1]: 2.521e-05 [parameter_eliminate]: 4.21001e-06 [updatestate_depend_eliminate]: 8.58001e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.31999e-06 [cse]: 4.388e-05 [call_graph_tuple_transform]: 2.431e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.43998e-06 [remove_dup_value]: 1.981e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 1.034e-05 [add_recomputation]: 5.297e-05 [cse_after_recomputation]: 2.627e-05, [1] [Cycle 1]: 2.02e-05, [1] [cse]: 1.335e-05 [auto_monad_reorder]: 1.772e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 7.30998e-06 [opt_after_jit_grad]: 0.00053444 [symbol_engine_optimizer]: 8.389e-05, [1] [Cycle 1]: 7.754e-05, [6] [build]: 1.147e-05 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.422e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 3.69997e-07 [validate]: 4.609e-05 Sums bootstrap : 0.000311s : 0.83% type_inference : 0.005564s : 14.87% event_method : 0.000021s : 0.06% auto_monad : 0.000067s : 0.18% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000044s : 0.12% rewriter_before_opt_a : 0.000080s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.17% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000644s : 1.72% jit_opt_a.with_stream_mark : 0.000029s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000826s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000047s : 0.13% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000036s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000552s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.027916s : 74.58% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000044s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000010s : 0.03% add_recomputation : 0.000053s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000534s : 1.43% symbol_engine_optimizer.build : 0.000011s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.12% Time group info: ------[substitution.] 0.000228 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.63% : 0.000006s : 3: substitution.graph_param_transform 84.72% : 0.000193s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000004s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 6.03% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005501 2 78.58% : 0.004323s : 1: type_inference.infer 21.42% : 0.001178s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.49% : 0.000050s : 4: replace.inline 30.51% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 93.78% : 0.000190s : 4: match.inline 6.22% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.32% : 0.000008s : 22: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 2.89% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000793 13 51.08% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.19% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.73% : 0.000339s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043106 72 0.13% : 0.000056s : 1: add_recomputation 0.16% : 0.000070s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.75% : 0.000324s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000013s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.66% : 0.005458s : 1: jit_opt_a 0.50% : 0.000216s : 1: jit_opt_after_cconv 0.12% : 0.000051s : 1: jit_opt_b 64.79% : 0.027930s : 1: loop_unroll 1.30% : 0.000560s : 1: mutable_eliminate 2.00% : 0.000861s : 26: opt.transform.jit_opt_a 0.14% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000025s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000543s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000047s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000023s : 1: remove_dup_value 1.07% : 0.000461s : 1: renormalize.infer 0.83% : 0.000356s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.19% : 0.000082s : 1: rewriter_before_opt_a 0.20% : 0.000086s : 1: symbol_engine_optimizer 12.94% : 0.005580s : 1: type_inference TotalTime = 0.0140471, [30] [bootstrap]: 0.00030505 [type_inference]: 0.00653024 [event_method]: 1.962e-05 [auto_monad]: 6.654e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 3.23e-06 [py_interpret_to_execute]: 3.77e-05 [rewriter_before_opt_a]: 7.319e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.0047544, [2] [Cycle 1]: 0.0014261, [27] [switch_simplify]: 4.718e-05 [loop_unroll]: 3.133e-05 [a_1]: 0.00050756 [with_stream_mark]: 1.637e-05 [recompute_prepare]: 7.61001e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 5.96998e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 6.15002e-06 [renormalize]: 0.00051601 [add_forward_monad_depend]: 4.97999e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.378e-05 [cse]: 2.287e-05 [replace_applicator]: 1.112e-05 [Cycle 2]: 0.00036811, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 4.87e-06 [a_1]: 8.987e-05 [with_stream_mark]: 7.84002e-06 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.46002e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 3.999e-05 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 8.62998e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.56001e-06 [inline_without_move]: 4.99e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.333e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 9.28002e-06 [rewriter_after_opt_a]: 3.371e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.47999e-06 [mutable_eliminate]: 0.00048158 [jit_opt_b]: 5.111e-05, [1] [Cycle 1]: 4.408e-05, [2] [frontend_op_eliminate]: 1.626e-05 [inline_after_opt_a]: 1.611e-05 [cconv]: 2.619e-05 [loop_unroll]: 0.00061745 [jit_opt_after_cconv]: 0.00015911, [1] [Cycle 1]: 0.00014393, [11] [c_1]: 2.22e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 6.03002e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.269e-05 [call_graph_tuple_transform]: 1.793e-05 [tuple_list_get_item_eliminator]: 5.87001e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.432e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.19001e-06 [add_recomputation]: 4.465e-05 [cse_after_recomputation]: 2.422e-05, [1] [Cycle 1]: 1.871e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.00046367 [symbol_engine_optimizer]: 7.194e-05, [1] [Cycle 1]: 6.6e-05, [6] [build]: 2.62001e-06 [elim_shapecalc]: 7.86001e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 5.82001e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 3.30008e-07 [validate]: 3.54e-05 Sums bootstrap : 0.000305s : 2.90% type_inference : 0.006530s : 62.17% event_method : 0.000020s : 0.19% auto_monad : 0.000067s : 0.63% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000038s : 0.36% rewriter_before_opt_a : 0.000073s : 0.70% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000053s : 0.50% jit_opt_a.loop_unroll : 0.000036s : 0.34% jit_opt_a.a_1 : 0.000597s : 5.69% jit_opt_a.with_stream_mark : 0.000024s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000042s : 0.40% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000516s : 4.91% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.19% jit_opt_a.cse : 0.000036s : 0.34% jit_opt_a.replace_applicator : 0.000016s : 0.16% py_interpret_to_execute_after_opt_a : 0.000009s : 0.09% rewriter_after_opt_a : 0.000034s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000482s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000026s : 0.25% loop_unroll : 0.000617s : 5.88% jit_opt_after_cconv.c_1 : 0.000022s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000014s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000045s : 0.43% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000464s : 4.41% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.34% Time group info: ------[substitution.] 0.000174 23 1.19% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.80% : 0.000005s : 3: substitution.graph_param_transform 82.34% : 0.000143s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000004s : 4: substitution.remove_not_recompute_node 1.89% : 0.000003s : 2: substitution.replace_old_param 6.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006462 2 86.72% : 0.005604s : 1: type_inference.infer 13.28% : 0.000858s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.20% : 0.000044s : 4: replace.inline 33.80% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 92.83% : 0.000141s : 4: match.inline 7.17% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.62% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.63% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000617 13 54.35% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.36% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.30% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015431 72 0.31% : 0.000048s : 1: add_recomputation 0.45% : 0.000070s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.10% : 0.000324s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 30.83% : 0.004757s : 1: jit_opt_a 1.05% : 0.000162s : 1: jit_opt_after_cconv 0.35% : 0.000054s : 1: jit_opt_b 4.06% : 0.000627s : 1: loop_unroll 3.17% : 0.000489s : 1: mutable_eliminate 5.22% : 0.000805s : 26: opt.transform.jit_opt_a 0.31% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000012s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.06% : 0.000472s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 1.65% : 0.000254s : 1: renormalize.infer 1.66% : 0.000256s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000036s : 1: rewriter_after_opt_a 0.49% : 0.000076s : 1: rewriter_before_opt_a 0.48% : 0.000075s : 1: symbol_engine_optimizer 42.43% : 0.006547s : 1: type_inference TotalTime = 0.0178278, [30] [bootstrap]: 0.00027704 [type_inference]: 0.00937661 [event_method]: 2.155e-05 [auto_monad]: 6.934e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 5.677e-05 [rewriter_before_opt_a]: 8.823e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00569811, [2] [Cycle 1]: 0.00195882, [27] [switch_simplify]: 5.686e-05 [loop_unroll]: 3.293e-05 [a_1]: 0.00061584 [with_stream_mark]: 1.614e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.347e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 8.82e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00089644 [add_forward_monad_depend]: 6.09999e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.598e-05 [cse]: 4.186e-05 [replace_applicator]: 1.446e-05 [Cycle 2]: 0.00032959, [27] [switch_simplify]: 6.28e-06 [loop_unroll]: 5.20001e-06 [a_1]: 9.15e-05 [with_stream_mark]: 1.008e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 4.93001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.83001e-06 [merge_forward]: 2.73998e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.279e-05 [j_node_and_user_rematch]: 8.30999e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.48e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.49978e-07 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.93998e-06 [cse]: 1.551e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 1.212e-05 [rewriter_after_opt_a]: 3.789e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00055448 [jit_opt_b]: 5.082e-05, [1] [Cycle 1]: 4.34e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.579e-05 [cconv]: 2.568e-05 [loop_unroll]: 0.00049147 [jit_opt_after_cconv]: 0.00014771, [1] [Cycle 1]: 0.00014098, [11] [c_1]: 2.11e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.89e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.524e-05 [call_graph_tuple_transform]: 1.842e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.41002e-06 [remove_dup_value]: 3.62e-05 [partial_unused_args_eliminate]: 2.84001e-06 [environ_conv]: 6.11e-06 [add_recomputation]: 4.875e-05 [cse_after_recomputation]: 2.429e-05, [1] [Cycle 1]: 1.886e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.847e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00046167 [symbol_engine_optimizer]: 7.279e-05, [1] [Cycle 1]: 6.635e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 7.81001e-06 [elim_not_effective]: 1.28e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 4.09986e-07 [validate]: 4.051e-05 Sums bootstrap : 0.000277s : 2.00% type_inference : 0.009377s : 67.75% event_method : 0.000022s : 0.16% auto_monad : 0.000069s : 0.50% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.41% rewriter_before_opt_a : 0.000088s : 0.64% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.46% jit_opt_a.loop_unroll : 0.000038s : 0.28% jit_opt_a.a_1 : 0.000707s : 5.11% jit_opt_a.with_stream_mark : 0.000026s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000897s : 6.48% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000057s : 0.41% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000038s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000554s : 4.01% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000026s : 0.19% loop_unroll : 0.000491s : 3.55% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000036s : 0.26% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000049s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000462s : 3.34% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.29% Time group info: ------[substitution.] 0.000227 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000005s : 3: substitution.graph_param_transform 85.90% : 0.000195s : 5: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000004s : 2: substitution.replace_old_param 4.80% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009308 2 85.79% : 0.007985s : 1: type_inference.infer 14.21% : 0.001323s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.56% : 0.000063s : 5: replace.inline 32.44% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 95.22% : 0.000192s : 5: match.inline 4.78% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.40% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 1.81% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.76% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 16: predicate.load_eliminater 1.26% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.24% : 0.000002s : 11: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.88% : 0.000002s : 11: predicate.reduce_eliminate 1.52% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 19: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 11: predicate.reshape_eliminate 1.46% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.43% : 0.000002s : 11: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.65% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.73% : 0.000010s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.52% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000971 16 47.75% : 0.000464s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.13% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.12% : 0.000438s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019710 72 0.26% : 0.000052s : 1: add_recomputation 0.37% : 0.000072s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.47% : 0.000289s : 1: bootstrap 0.14% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.11% : 0.000023s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 28.92% : 0.005701s : 1: jit_opt_a 0.76% : 0.000150s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.53% : 0.000500s : 1: loop_unroll 2.86% : 0.000563s : 1: mutable_eliminate 4.72% : 0.000930s : 26: opt.transform.jit_opt_a 0.24% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.38% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000059s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000039s : 1: remove_dup_value 2.45% : 0.000482s : 1: renormalize.infer 2.06% : 0.000406s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000040s : 1: rewriter_after_opt_a 0.46% : 0.000091s : 1: rewriter_before_opt_a 0.38% : 0.000075s : 1: symbol_engine_optimizer 47.63% : 0.009388s : 1: type_inference TotalTime = 0.256326, [30] [bootstrap]: 0.00031243 [type_inference]: 0.227398 [event_method]: 2.323e-05 [auto_monad]: 7.03e-05 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00045826 [rewriter_before_opt_a]: 8.204e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.019013, [2] [Cycle 1]: 0.0103796, [27] [switch_simplify]: 5.916e-05 [loop_unroll]: 2.979e-05 [a_1]: 0.00060998 [with_stream_mark]: 1.897e-05 [recompute_prepare]: 9.56e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 7.98001e-06 [updatestate_useless_node_eliminater]: 6.38998e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.65999e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.667e-05 [j_node_and_user_rematch]: 1.071e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 9.25001e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00930635 [add_forward_monad_depend]: 7.16999e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.475e-05 [cse]: 2.126e-05 [replace_applicator]: 1.665e-05 [Cycle 2]: 0.00037141, [27] [switch_simplify]: 7.30003e-06 [loop_unroll]: 6.38e-06 [a_1]: 0.00012957 [with_stream_mark]: 1.029e-05 [recompute_prepare]: 5.83997e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.18998e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.01998e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.51002e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 3.35e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.326e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.49002e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.14e-05 [replace_applicator]: 5.68002e-06 [py_interpret_to_execute_after_opt_a]: 1.141e-05 [rewriter_after_opt_a]: 2.757e-05 [convert_after_rewriter]: 6.49001e-06 [order_py_execute_after_rewriter]: 4.45999e-06 [mutable_eliminate]: 0.00058291 [jit_opt_b]: 5.378e-05, [1] [Cycle 1]: 4.76e-05, [2] [frontend_op_eliminate]: 1.891e-05 [inline_after_opt_a]: 1.709e-05 [cconv]: 2.075e-05 [loop_unroll]: 0.00041732 [jit_opt_after_cconv]: 0.00015409, [1] [Cycle 1]: 0.00014752, [11] [c_1]: 2.551e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.177e-05 [call_graph_tuple_transform]: 2.041e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.04e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 1.04e-05 [partial_unused_args_eliminate]: 1.80001e-06 [environ_conv]: 7.68999e-06 [add_recomputation]: 3.959e-05 [cse_after_recomputation]: 2.283e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.125e-05 [auto_monad_reorder]: 1.141e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.00722571 [symbol_engine_optimizer]: 9.463e-05, [1] [Cycle 1]: 8.554e-05, [6] [build]: 4.92999e-06 [elim_shapecalc]: 1.109e-05 [elim_not_effective]: 2.157e-05 [opt_reshape]: 7.41999e-06 [fold_const_symbol]: 1.045e-05 [renormalize]: 1.11002e-06 [validate]: 5.654e-05 Sums bootstrap : 0.000312s : 0.13% type_inference : 0.227398s : 91.90% event_method : 0.000023s : 0.01% auto_monad : 0.000070s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000458s : 0.19% rewriter_before_opt_a : 0.000082s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000740s : 0.30% jit_opt_a.with_stream_mark : 0.000029s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.009306s : 3.76% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000033s : 0.01% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000028s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000583s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000021s : 0.01% loop_unroll : 0.000417s : 0.17% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000010s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000040s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000011s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.007226s : 2.92% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.02% Time group info: ------[substitution.] 0.000213 24 1.68% : 0.000004s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000005s : 4: substitution.graph_param_transform 83.06% : 0.000177s : 4: substitution.inline 1.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 6.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.227306 2 96.38% : 0.219076s : 1: type_inference.infer 3.62% : 0.008230s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.65% : 0.000050s : 4: replace.inline 33.35% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 6 93.72% : 0.000175s : 4: match.inline 6.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 2.30% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.32% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 4: predicate.elim_not_effective 1.28% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.89% : 0.000003s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.57% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.04% : 0.000010s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000002s : 12: predicate.transpose_eliminate 1.24% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 2.00% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002730 22 58.39% : 0.001594s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.17% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.44% : 0.001104s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.266687 72 0.02% : 0.000042s : 1: add_recomputation 0.03% : 0.000073s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.12% : 0.000332s : 1: bootstrap 0.01% : 0.000023s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 7.13% : 0.019016s : 1: jit_opt_a 0.06% : 0.000157s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.16% : 0.000425s : 1: loop_unroll 0.22% : 0.000591s : 1: mutable_eliminate 0.37% : 0.000979s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000047s : 4: opt.transform.symbol_engine_opt 2.72% : 0.007243s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000464s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000013s : 1: remove_dup_value 3.08% : 0.008225s : 1: renormalize.infer 0.40% : 0.001067s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000030s : 1: rewriter_after_opt_a 0.03% : 0.000087s : 1: rewriter_before_opt_a 0.04% : 0.000097s : 1: symbol_engine_optimizer 85.28% : 0.227420s : 1: type_inference TotalTime = 0.017476, [30] [bootstrap]: 0.00035116 [type_inference]: 0.00607565 [event_method]: 2.038e-05 [auto_monad]: 6.547e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.63003e-06 [py_interpret_to_execute]: 4.436e-05 [rewriter_before_opt_a]: 8.061e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00817761, [2] [Cycle 1]: 0.00224207, [27] [switch_simplify]: 6.646e-05 [loop_unroll]: 3.178e-05 [a_1]: 0.00060407 [with_stream_mark]: 2.312e-05 [recompute_prepare]: 9.92999e-06 [updatestate_depend_eliminate]: 5.23002e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.668e-05 [j_node_and_user_rematch]: 1.171e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00106124 [add_forward_monad_depend]: 9.72999e-06 [auto_monad_grad]: 3.01001e-06 [auto_monad_eliminator]: 2.045e-05 [cse]: 3.966e-05 [replace_applicator]: 2.001e-05 [Cycle 2]: 0.00038018, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.19e-06 [a_1]: 9.282e-05 [with_stream_mark]: 1.6e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 5.11002e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.394e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.07999e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 8.74003e-06 [cse]: 1.825e-05 [replace_applicator]: 7.44002e-06 [py_interpret_to_execute_after_opt_a]: 1.788e-05 [rewriter_after_opt_a]: 4.332e-05 [convert_after_rewriter]: 8.15e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00073328 [jit_opt_b]: 5.54e-05, [1] [Cycle 1]: 4.702e-05, [2] [frontend_op_eliminate]: 1.681e-05 [inline_after_opt_a]: 1.789e-05 [cconv]: 3.572e-05 [loop_unroll]: 0.00049397 [jit_opt_after_cconv]: 0.00017482, [1] [Cycle 1]: 0.00016768, [11] [c_1]: 2.262e-05 [parameter_eliminate]: 5.47001e-06 [updatestate_depend_eliminate]: 1.011e-05 [updatestate_assign_eliminate]: 2.88003e-06 [updatestate_loads_eliminate]: 3.05998e-06 [cse]: 3.64e-05 [call_graph_tuple_transform]: 2.138e-05 [tuple_list_get_item_eliminator]: 6.33e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 1.07998e-06 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.778e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 1.17e-05 [add_recomputation]: 5.479e-05 [cse_after_recomputation]: 2.552e-05, [1] [Cycle 1]: 2.03e-05, [1] [cse]: 1.449e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 7.24001e-06 [opt_after_jit_grad]: 0.00059545 [symbol_engine_optimizer]: 8.912e-05, [1] [Cycle 1]: 8.202e-05, [6] [build]: 1.27e-05 [elim_shapecalc]: 9.42999e-06 [elim_not_effective]: 1.583e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 7.7e-07 [validate]: 5.43e-05 Sums bootstrap : 0.000351s : 3.13% type_inference : 0.006076s : 54.20% event_method : 0.000020s : 0.18% auto_monad : 0.000065s : 0.58% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.40% rewriter_before_opt_a : 0.000081s : 0.72% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.65% jit_opt_a.loop_unroll : 0.000037s : 0.33% jit_opt_a.a_1 : 0.000697s : 6.22% jit_opt_a.with_stream_mark : 0.000039s : 0.35% jit_opt_a.recompute_prepare : 0.000016s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.36% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.20% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001061s : 9.47% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.11% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.26% jit_opt_a.cse : 0.000058s : 0.52% jit_opt_a.replace_applicator : 0.000027s : 0.24% py_interpret_to_execute_after_opt_a : 0.000018s : 0.16% rewriter_after_opt_a : 0.000043s : 0.39% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000733s : 6.54% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.16% cconv : 0.000036s : 0.32% loop_unroll : 0.000494s : 4.41% jit_opt_after_cconv.c_1 : 0.000023s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000036s : 0.32% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000012s : 0.10% add_recomputation : 0.000055s : 0.49% cse_after_recomputation.cse : 0.000014s : 0.13% auto_monad_reorder : 0.000019s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000595s : 5.31% symbol_engine_optimizer.build : 0.000013s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000054s : 0.48% Time group info: ------[substitution.] 0.000267 23 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 3: substitution.graph_param_transform 82.52% : 0.000220s : 4: substitution.inline 2.27% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000012s : 4: substitution.remove_not_recompute_node 2.33% : 0.000006s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006005 2 80.23% : 0.004818s : 1: type_inference.infer 19.77% : 0.001187s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.67% : 0.000054s : 4: replace.inline 33.33% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.87% : 0.000217s : 4: match.inline 5.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.39% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.20% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.09% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 1.09% : 0.000001s : 6: predicate.specialize_transform 1.88% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.82% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.23% : 0.000010s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.85% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.97% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000985 13 58.11% : 0.000572s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.10% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.79% : 0.000362s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019545 72 0.30% : 0.000058s : 1: add_recomputation 0.35% : 0.000069s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.90% : 0.000372s : 1: bootstrap 0.20% : 0.000038s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.07% : 0.000014s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 41.86% : 0.008181s : 1: jit_opt_a 0.91% : 0.000178s : 1: jit_opt_after_cconv 0.30% : 0.000059s : 1: jit_opt_b 2.58% : 0.000505s : 1: loop_unroll 3.82% : 0.000747s : 1: mutable_eliminate 4.88% : 0.000954s : 26: opt.transform.jit_opt_a 0.27% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000022s : 1: opt.transform.mutable_eliminate 0.13% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.11% : 0.000608s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000047s : 1: py_interpret_to_execute 0.11% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 2.92% : 0.000571s : 1: renormalize.infer 2.45% : 0.000478s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000049s : 1: rewriter_after_opt_a 0.43% : 0.000084s : 1: rewriter_before_opt_a 0.47% : 0.000092s : 1: symbol_engine_optimizer 31.16% : 0.006091s : 1: type_inference TotalTime = 0.0287208, [30] [bootstrap]: 0.00035224 [type_inference]: 0.0201377 [event_method]: 2.227e-05 [auto_monad]: 7.01e-05 [graph_reusing]: 6.18998e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00011167 [rewriter_before_opt_a]: 8.406e-05 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00581822, [2] [Cycle 1]: 0.00190424, [27] [switch_simplify]: 5.83e-05 [loop_unroll]: 3.102e-05 [a_1]: 0.0005319 [with_stream_mark]: 1.821e-05 [recompute_prepare]: 9.10001e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 2.66999e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 9.56998e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00092414 [add_forward_monad_depend]: 5.57001e-06 [auto_monad_grad]: 2.75002e-06 [auto_monad_eliminator]: 1.413e-05 [cse]: 3.431e-05 [replace_applicator]: 1.218e-05 [Cycle 2]: 0.0003223, [27] [switch_simplify]: 5.92001e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.156e-05 [with_stream_mark]: 8.68001e-06 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.56002e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.227e-05 [j_node_and_user_rematch]: 7.88999e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.41001e-06 [inline_without_move]: 5.02e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.284e-05 [replace_applicator]: 5.33002e-06 [py_interpret_to_execute_after_opt_a]: 1.231e-05 [rewriter_after_opt_a]: 3.809e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00053558 [jit_opt_b]: 5.159e-05, [1] [Cycle 1]: 4.455e-05, [2] [frontend_op_eliminate]: 1.704e-05 [inline_after_opt_a]: 1.607e-05 [cconv]: 2.549e-05 [loop_unroll]: 0.00041682 [jit_opt_after_cconv]: 0.00014209, [1] [Cycle 1]: 0.00013594, [11] [c_1]: 2.214e-05 [parameter_eliminate]: 3.26001e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.068e-05 [call_graph_tuple_transform]: 1.804e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.30999e-06 [remove_dup_value]: 1.57e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 6.63e-06 [add_recomputation]: 6.38e-05 [cse_after_recomputation]: 2.379e-05, [1] [Cycle 1]: 1.832e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.995e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 4.35999e-06 [opt_after_jit_grad]: 0.00045369 [symbol_engine_optimizer]: 7.277e-05, [1] [Cycle 1]: 6.656e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.262e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.72998e-06 [renormalize]: 3.30008e-07 [validate]: 3.761e-05 Sums bootstrap : 0.000352s : 1.43% type_inference : 0.020138s : 82.03% event_method : 0.000022s : 0.09% auto_monad : 0.000070s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000112s : 0.45% rewriter_before_opt_a : 0.000084s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.15% jit_opt_a.a_1 : 0.000623s : 2.54% jit_opt_a.with_stream_mark : 0.000027s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000924s : 3.76% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000047s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000536s : 2.18% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000025s : 0.10% loop_unroll : 0.000417s : 1.70% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000064s : 0.26% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000020s : 0.08% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000454s : 1.85% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.15% Time group info: ------[substitution.] 0.000194 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.80% : 0.000005s : 3: substitution.graph_param_transform 82.32% : 0.000160s : 4: substitution.inline 1.72% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 6.72% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020056 2 92.46% : 0.018545s : 1: type_inference.infer 7.54% : 0.001511s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.23% : 0.000050s : 4: replace.inline 32.77% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 92.99% : 0.000157s : 4: match.inline 7.01% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.14% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.19% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.13% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.83% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000822 13 45.90% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.04% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.06% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030548 72 0.22% : 0.000067s : 1: add_recomputation 0.24% : 0.000074s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.21% : 0.000370s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.06% : 0.005821s : 1: jit_opt_a 0.47% : 0.000145s : 1: jit_opt_after_cconv 0.18% : 0.000054s : 1: jit_opt_b 1.39% : 0.000425s : 1: loop_unroll 1.78% : 0.000545s : 1: mutable_eliminate 2.76% : 0.000843s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000116s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.66% : 0.000508s : 1: renormalize.infer 1.34% : 0.000408s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.29% : 0.000088s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 65.99% : 0.020158s : 1: type_inference TotalTime = 0.0155719, [30] [bootstrap]: 0.00030521 [type_inference]: 0.00594433 [event_method]: 2.074e-05 [auto_monad]: 7.122e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 4.74e-05 [rewriter_before_opt_a]: 8.203e-05 [expand_dump_flag]: 3.13998e-06 [jit_opt_a]: 0.00685044, [2] [Cycle 1]: 0.0020907, [27] [switch_simplify]: 4.909e-05 [loop_unroll]: 3.04e-05 [a_1]: 0.00064261 [with_stream_mark]: 2.289e-05 [recompute_prepare]: 7.97003e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.38002e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.483e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.87e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.0010081 [add_forward_monad_depend]: 5.82999e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.553e-05 [cse]: 3.775e-05 [replace_applicator]: 1.25e-05 [Cycle 2]: 0.00034157, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.087e-05 [with_stream_mark]: 9.39998e-06 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.16998e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 7.98999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.62998e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.76003e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 7.61001e-06 [cse]: 1.558e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.291e-05 [rewriter_after_opt_a]: 4.213e-05 [convert_after_rewriter]: 8.89e-06 [order_py_execute_after_rewriter]: 5.64998e-06 [mutable_eliminate]: 0.00058761 [jit_opt_b]: 5.117e-05, [1] [Cycle 1]: 4.359e-05, [2] [frontend_op_eliminate]: 1.634e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 3.038e-05 [loop_unroll]: 0.00044182 [jit_opt_after_cconv]: 0.00015186, [1] [Cycle 1]: 0.00014541, [11] [c_1]: 2.133e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 6.08002e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.494e-05 [call_graph_tuple_transform]: 2.209e-05 [tuple_list_get_item_eliminator]: 5.63002e-06 [none_parameter_eliminate]: 1.91003e-06 [renormalize]: 2.49973e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 1.734e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 8.73001e-06 [add_recomputation]: 5.382e-05 [cse_after_recomputation]: 2.347e-05, [1] [Cycle 1]: 1.801e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.00047813 [symbol_engine_optimizer]: 7.978e-05, [1] [Cycle 1]: 7.358e-05, [6] [build]: 1.061e-05 [elim_shapecalc]: 8.42998e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.98002e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 3.7998e-07 [validate]: 4.117e-05 Sums bootstrap : 0.000305s : 2.89% type_inference : 0.005944s : 56.26% event_method : 0.000021s : 0.20% auto_monad : 0.000071s : 0.67% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000047s : 0.45% rewriter_before_opt_a : 0.000082s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.52% jit_opt_a.loop_unroll : 0.000036s : 0.34% jit_opt_a.a_1 : 0.000733s : 6.94% jit_opt_a.with_stream_mark : 0.000032s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.001008s : 9.54% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.22% jit_opt_a.cse : 0.000053s : 0.50% jit_opt_a.replace_applicator : 0.000018s : 0.17% py_interpret_to_execute_after_opt_a : 0.000013s : 0.12% rewriter_after_opt_a : 0.000042s : 0.40% convert_after_rewriter : 0.000009s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000588s : 5.56% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000030s : 0.29% loop_unroll : 0.000442s : 4.18% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000054s : 0.51% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000019s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000478s : 4.53% symbol_engine_optimizer.build : 0.000011s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.39% Time group info: ------[substitution.] 0.000294 23 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 3: substitution.graph_param_transform 88.61% : 0.000260s : 4: substitution.inline 0.93% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.45% : 0.000004s : 4: substitution.remove_not_recompute_node 1.48% : 0.000004s : 2: substitution.replace_old_param 4.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005878 2 77.03% : 0.004528s : 1: type_inference.infer 22.97% : 0.001350s : 1: type_inference.specialize ------[replace.] 0.000081 6 71.49% : 0.000058s : 4: replace.inline 28.51% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000269 6 95.73% : 0.000258s : 4: match.inline 4.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.52% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 2.21% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.23% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.59% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000843 13 43.33% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.41% : 0.000450s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017585 72 0.32% : 0.000057s : 1: add_recomputation 0.42% : 0.000075s : 1: auto_monad 0.12% : 0.000022s : 1: auto_monad_reorder 1.82% : 0.000320s : 1: bootstrap 0.19% : 0.000033s : 1: cconv 0.07% : 0.000012s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000011s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 38.98% : 0.006854s : 1: jit_opt_a 0.88% : 0.000154s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.56% : 0.000450s : 1: loop_unroll 3.40% : 0.000597s : 1: mutable_eliminate 5.36% : 0.000943s : 26: opt.transform.jit_opt_a 0.29% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.76% : 0.000485s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000050s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.98% : 0.000523s : 1: renormalize.infer 2.71% : 0.000477s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000049s : 1: rewriter_after_opt_a 0.48% : 0.000085s : 1: rewriter_before_opt_a 0.47% : 0.000082s : 1: symbol_engine_optimizer 33.90% : 0.005961s : 1: type_inference TotalTime = 0.0279821, [30] [bootstrap]: 0.00038837 [type_inference]: 0.0198912 [event_method]: 1.925e-05 [auto_monad]: 6.648e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 0.00010731 [rewriter_before_opt_a]: 7.762e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00517703, [2] [Cycle 1]: 0.00185447, [27] [switch_simplify]: 4.696e-05 [loop_unroll]: 3.076e-05 [a_1]: 0.00054064 [with_stream_mark]: 1.591e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 3.07002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.267e-05 [j_node_and_user_rematch]: 8.71997e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.31998e-06 [inline_without_move]: 5.35001e-06 [renormalize]: 0.0008906 [add_forward_monad_depend]: 6.67002e-06 [auto_monad_grad]: 3.16999e-06 [auto_monad_eliminator]: 1.516e-05 [cse]: 2.964e-05 [replace_applicator]: 1.508e-05 [Cycle 2]: 0.0003369, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 5.40999e-06 [a_1]: 9.376e-05 [with_stream_mark]: 1.105e-05 [recompute_prepare]: 5.47999e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 2.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.12002e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.69999e-06 [cse]: 1.431e-05 [replace_applicator]: 5.70001e-06 [py_interpret_to_execute_after_opt_a]: 1.366e-05 [rewriter_after_opt_a]: 3.582e-05 [convert_after_rewriter]: 6.38998e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00059157 [jit_opt_b]: 5.083e-05, [1] [Cycle 1]: 4.321e-05, [2] [frontend_op_eliminate]: 1.593e-05 [inline_after_opt_a]: 1.623e-05 [cconv]: 2.569e-05 [loop_unroll]: 0.00044048 [jit_opt_after_cconv]: 0.00015231, [1] [Cycle 1]: 0.00014491, [11] [c_1]: 2.152e-05 [parameter_eliminate]: 3.58999e-06 [updatestate_depend_eliminate]: 6.76e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.599e-05 [call_graph_tuple_transform]: 1.942e-05 [tuple_list_get_item_eliminator]: 5.74999e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.60001e-06 [remove_dup_value]: 1.735e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 7.13e-06 [add_recomputation]: 5.055e-05 [cse_after_recomputation]: 3.823e-05, [1] [Cycle 1]: 2.048e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.892e-05 [get_jit_bprop_graph]: 2.35002e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00048102 [symbol_engine_optimizer]: 7.452e-05, [1] [Cycle 1]: 6.77e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 8.10999e-06 [elim_not_effective]: 1.305e-05 [opt_reshape]: 6.98998e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 3.89991e-07 [validate]: 4.111e-05 Sums bootstrap : 0.000388s : 1.59% type_inference : 0.019891s : 81.52% event_method : 0.000019s : 0.08% auto_monad : 0.000066s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.44% rewriter_before_opt_a : 0.000078s : 0.32% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.15% jit_opt_a.a_1 : 0.000634s : 2.60% jit_opt_a.with_stream_mark : 0.000027s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000891s : 3.65% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000044s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000036s : 0.15% convert_after_rewriter : 0.000006s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000592s : 2.42% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000026s : 0.11% loop_unroll : 0.000440s : 1.81% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000051s : 0.21% cse_after_recomputation.cse : 0.000014s : 0.06% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000481s : 1.97% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.17% Time group info: ------[substitution.] 0.000181 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 3.27% : 0.000006s : 3: substitution.graph_param_transform 82.52% : 0.000149s : 4: substitution.inline 2.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000004s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 5.87% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019832 2 92.76% : 0.018397s : 1: type_inference.infer 7.24% : 0.001435s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.30% : 0.000047s : 4: replace.inline 32.70% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 93.87% : 0.000147s : 4: match.inline 6.13% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.01% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 2.03% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 1.21% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.63% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.94% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000831 13 48.52% : 0.000403s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.41% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.07% : 0.000391s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029782 72 0.18% : 0.000053s : 1: add_recomputation 0.23% : 0.000070s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.40% : 0.000417s : 1: bootstrap 0.10% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000040s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000023s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.39% : 0.005180s : 1: jit_opt_a 0.52% : 0.000155s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 1.51% : 0.000449s : 1: loop_unroll 2.02% : 0.000600s : 1: mutable_eliminate 2.85% : 0.000850s : 26: opt.transform.jit_opt_a 0.16% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000490s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000111s : 1: py_interpret_to_execute 0.06% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 1.62% : 0.000483s : 1: renormalize.infer 1.34% : 0.000399s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000039s : 1: rewriter_after_opt_a 0.27% : 0.000081s : 1: rewriter_before_opt_a 0.26% : 0.000077s : 1: symbol_engine_optimizer 66.83% : 0.019902s : 1: type_inference TotalTime = 0.405947, [30] [bootstrap]: 0.000288 [type_inference]: 0.381674 [event_method]: 2.016e-05 [auto_monad]: 4.934e-05 [graph_reusing]: 3.88999e-06 [pre_auto_parallel]: 1.82999e-06 [py_interpret_to_execute]: 0.00039774 [rewriter_before_opt_a]: 8.661e-05 [expand_dump_flag]: 2.43e-06 [jit_opt_a]: 0.00872419, [2] [Cycle 1]: 0.00440339, [27] [switch_simplify]: 6.722e-05 [loop_unroll]: 3.312e-05 [a_1]: 0.00073364 [with_stream_mark]: 1.39e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 3.50998e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 7.03998e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 1.91003e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 0.00322558 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.262e-05 [cse]: 2.016e-05 [replace_applicator]: 1.472e-05 [Cycle 2]: 0.00037467, [27] [switch_simplify]: 7.22002e-06 [loop_unroll]: 6.56e-06 [a_1]: 0.00013084 [with_stream_mark]: 1.025e-05 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.26002e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.145e-05 [j_node_and_user_rematch]: 8.99003e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.59e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.241e-05 [replace_applicator]: 6.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.015e-05 [rewriter_after_opt_a]: 3.927e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00056523 [jit_opt_b]: 5.231e-05, [1] [Cycle 1]: 4.591e-05, [2] [frontend_op_eliminate]: 1.781e-05 [inline_after_opt_a]: 1.722e-05 [cconv]: 1.579e-05 [loop_unroll]: 0.00303435 [jit_opt_after_cconv]: 0.00026006, [1] [Cycle 1]: 0.00024427, [11] [c_1]: 3.898e-05 [parameter_eliminate]: 9.04e-06 [updatestate_depend_eliminate]: 1.361e-05 [updatestate_assign_eliminate]: 6.35997e-06 [updatestate_loads_eliminate]: 3.3e-06 [cse]: 5.542e-05 [call_graph_tuple_transform]: 3.612e-05 [tuple_list_get_item_eliminator]: 8.34002e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 1.51998e-06 [switch_simplify]: 7.66999e-06 [remove_dup_value]: 2.285e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 1.485e-05 [add_recomputation]: 0.00859821 [cse_after_recomputation]: 0.00012017, [1] [Cycle 1]: 9.783e-05, [1] [cse]: 6.5e-05 [auto_monad_reorder]: 3.411e-05 [get_jit_bprop_graph]: 3.46999e-06 [rewriter_after_jit_bprop_graph]: 1.83e-05 [opt_after_jit_grad]: 0.00131587 [symbol_engine_optimizer]: 0.00012195, [1] [Cycle 1]: 0.00011144, [6] [build]: 8.65999e-06 [elim_shapecalc]: 1.198e-05 [elim_not_effective]: 2.794e-05 [opt_reshape]: 9.76e-06 [fold_const_symbol]: 1.442e-05 [renormalize]: 2.07001e-06 [validate]: 0.00015234 Sums bootstrap : 0.000288s : 0.07% type_inference : 0.381674s : 95.13% event_method : 0.000020s : 0.01% auto_monad : 0.000049s : 0.01% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000398s : 0.10% rewriter_before_opt_a : 0.000087s : 0.02% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.02% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000864s : 0.22% jit_opt_a.with_stream_mark : 0.000024s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.00% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.003226s : 0.80% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.00% jit_opt_a.cse : 0.000033s : 0.01% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000010s : 0.00% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000565s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.00% jit_opt_b.inline_after_opt_a : 0.000017s : 0.00% cconv : 0.000016s : 0.00% loop_unroll : 0.003034s : 0.76% jit_opt_after_cconv.c_1 : 0.000039s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000055s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000002s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000015s : 0.00% add_recomputation : 0.008598s : 2.14% cse_after_recomputation.cse : 0.000065s : 0.02% auto_monad_reorder : 0.000034s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000018s : 0.00% opt_after_jit_grad : 0.001316s : 0.33% symbol_engine_optimizer.build : 0.000009s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000028s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.00% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000152s : 0.04% Time group info: ------[substitution.] 0.000317 28 0.85% : 0.000003s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000008s : 4: substitution.graph_param_transform 87.39% : 0.000277s : 5: substitution.inline 0.88% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.37% : 0.000011s : 3: substitution.reduce_eliminate 1.15% : 0.000004s : 4: substitution.remove_not_recompute_node 1.21% : 0.000004s : 2: substitution.replace_old_param 2.37% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.381511 2 99.19% : 0.378434s : 1: type_inference.infer 0.81% : 0.003078s : 1: type_inference.specialize ------[replace.] 0.000090 7 67.96% : 0.000061s : 5: replace.inline 32.04% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000281 7 97.69% : 0.000274s : 5: match.inline 2.31% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.10% : 0.000002s : 13: predicate.accumulaten_eliminater 2.08% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.15% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000001s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.60% : 0.000001s : 4: predicate.elim_not_effective 0.92% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.60% : 0.000001s : 4: predicate.graph_param_transform 6.32% : 0.000010s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.01% : 0.000003s : 19: predicate.load_eliminater 4.54% : 0.000007s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 0.90% : 0.000001s : 4: predicate.mutable_eliminate 0.75% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.35% : 0.000004s : 13: predicate.reduce_eliminate 1.23% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.27% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.06% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.16% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.26% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.45% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002406 25 67.21% : 0.001617s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.58% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.21% : 0.000703s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.410328 72 2.11% : 0.008639s : 1: add_recomputation 0.01% : 0.000052s : 1: auto_monad 0.01% : 0.000040s : 1: auto_monad_reorder 0.07% : 0.000307s : 1: bootstrap 0.00% : 0.000018s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000127s : 1: cse_after_recomputation 0.00% : 0.000017s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 2.13% : 0.008728s : 1: jit_opt_a 0.06% : 0.000263s : 1: jit_opt_after_cconv 0.01% : 0.000055s : 1: jit_opt_b 0.75% : 0.003068s : 1: loop_unroll 0.14% : 0.000574s : 1: mutable_eliminate 0.27% : 0.001107s : 26: opt.transform.jit_opt_a 0.02% : 0.000087s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000056s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000058s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000059s : 4: opt.transform.symbol_engine_opt 0.32% : 0.001331s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000405s : 1: py_interpret_to_execute 0.00% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000026s : 1: remove_dup_value 0.61% : 0.002506s : 1: renormalize.infer 0.17% : 0.000712s : 1: renormalize.specialize 0.00% : 0.000020s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.02% : 0.000092s : 1: rewriter_before_opt_a 0.03% : 0.000128s : 1: symbol_engine_optimizer 93.02% : 0.381688s : 1: type_inference TotalTime = 0.0446692, [30] [bootstrap]: 0.00034675 [type_inference]: 0.00902865 [event_method]: 2.35e-05 [auto_monad]: 7.126e-05 [graph_reusing]: 6.84999e-06 [pre_auto_parallel]: 3.12002e-06 [py_interpret_to_execute]: 5.026e-05 [rewriter_before_opt_a]: 8.644e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00658078, [2] [Cycle 1]: 0.00227067, [27] [switch_simplify]: 6.305e-05 [loop_unroll]: 3.221e-05 [a_1]: 0.000683 [with_stream_mark]: 2.658e-05 [recompute_prepare]: 1.102e-05 [updatestate_depend_eliminate]: 4.95999e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.81999e-06 [specialize_transform]: 7.05002e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.654e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.087e-05 [inline_without_move]: 5.50001e-06 [renormalize]: 0.0010388 [add_forward_monad_depend]: 1.043e-05 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.195e-05 [cse]: 4.262e-05 [replace_applicator]: 1.97e-05 [Cycle 2]: 0.00037364, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.094e-05 [with_stream_mark]: 1.556e-05 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.816e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 1.708e-05 [inline_without_move]: 5.72001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.87999e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 8.67998e-06 [cse]: 2.006e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.963e-05 [rewriter_after_opt_a]: 4.487e-05 [convert_after_rewriter]: 7.88999e-06 [order_py_execute_after_rewriter]: 6.42001e-06 [mutable_eliminate]: 0.0008054 [jit_opt_b]: 5.675e-05, [1] [Cycle 1]: 4.744e-05, [2] [frontend_op_eliminate]: 1.676e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 3.31e-05 [loop_unroll]: 0.00052208 [jit_opt_after_cconv]: 0.00017749, [1] [Cycle 1]: 0.00016845, [11] [c_1]: 2.179e-05 [parameter_eliminate]: 4.41002e-06 [updatestate_depend_eliminate]: 8.85001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [cse]: 3.67e-05 [call_graph_tuple_transform]: 2.393e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.833e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 1.205e-05 [add_recomputation]: 5.789e-05 [cse_after_recomputation]: 2.882e-05, [1] [Cycle 1]: 2.211e-05, [1] [cse]: 1.41e-05 [auto_monad_reorder]: 1.961e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 8.92999e-06 [opt_after_jit_grad]: 0.0262203 [symbol_engine_optimizer]: 0.00013422, [1] [Cycle 1]: 0.00012443, [6] [build]: 1.389e-05 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 4.163e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 1.981e-05 [renormalize]: 7.80012e-07 [validate]: 5.428e-05 Sums bootstrap : 0.000347s : 0.87% type_inference : 0.009029s : 22.56% event_method : 0.000024s : 0.06% auto_monad : 0.000071s : 0.18% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000050s : 0.13% rewriter_before_opt_a : 0.000086s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.17% jit_opt_a.loop_unroll : 0.000038s : 0.09% jit_opt_a.a_1 : 0.000774s : 1.93% jit_opt_a.with_stream_mark : 0.000042s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000028s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001039s : 2.60% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.08% jit_opt_a.cse : 0.000063s : 0.16% jit_opt_a.replace_applicator : 0.000026s : 0.06% py_interpret_to_execute_after_opt_a : 0.000020s : 0.05% rewriter_after_opt_a : 0.000045s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000805s : 2.01% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000033s : 0.08% loop_unroll : 0.000522s : 1.30% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000012s : 0.03% add_recomputation : 0.000058s : 0.14% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.026220s : 65.53% symbol_engine_optimizer.build : 0.000014s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000042s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000020s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.14% Time group info: ------[substitution.] 0.000273 23 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 82.07% : 0.000224s : 4: substitution.inline 1.96% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 5.31% : 0.000014s : 2: substitution.replace_old_param 4.95% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008939 2 84.64% : 0.007566s : 1: type_inference.infer 15.36% : 0.001373s : 1: type_inference.specialize ------[replace.] 0.000152 6 36.20% : 0.000055s : 4: replace.inline 63.80% : 0.000097s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000234 6 94.80% : 0.000222s : 4: match.inline 5.20% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 2.76% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.29% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.29% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.30% : 0.000003s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 2.38% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.25% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.38% : 0.000002s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.25% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.10% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.43% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000919 13 49.72% : 0.000457s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.14% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.14% : 0.000406s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046831 72 0.13% : 0.000061s : 1: add_recomputation 0.16% : 0.000075s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 0.79% : 0.000369s : 1: bootstrap 0.08% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000031s : 1: cse_after_recomputation 0.03% : 0.000014s : 1: environ_conv 0.06% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.06% : 0.006585s : 1: jit_opt_a 0.39% : 0.000181s : 1: jit_opt_after_cconv 0.13% : 0.000060s : 1: jit_opt_b 1.14% : 0.000532s : 1: loop_unroll 1.75% : 0.000821s : 1: mutable_eliminate 2.20% : 0.001029s : 26: opt.transform.jit_opt_a 0.12% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000023s : 1: opt.transform.mutable_eliminate 0.08% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000074s : 4: opt.transform.symbol_engine_opt 56.03% : 0.026238s : 1: opt_after_jit_grad 0.02% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000054s : 1: py_interpret_to_execute 0.05% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 1.19% : 0.000555s : 1: renormalize.infer 1.01% : 0.000472s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000049s : 1: rewriter_after_opt_a 0.19% : 0.000091s : 1: rewriter_before_opt_a 0.29% : 0.000137s : 1: symbol_engine_optimizer 19.33% : 0.009055s : 1: type_inference TotalTime = 0.133526, [30] [bootstrap]: 0.00043705 [type_inference]: 0.109648 [event_method]: 1.942e-05 [auto_monad]: 7.089e-05 [graph_reusing]: 6.49999e-06 [pre_auto_parallel]: 2.27001e-06 [py_interpret_to_execute]: 0.0002877 [rewriter_before_opt_a]: 9.298e-05 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.0203815, [2] [Cycle 1]: 0.0162516, [27] [switch_simplify]: 6.173e-05 [loop_unroll]: 3.14e-05 [a_1]: 0.00061433 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 1.031e-05 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.35002e-06 [specialize_transform]: 8.97e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.73e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.96999e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 6.01003e-06 [renormalize]: 0.0151088 [add_forward_monad_depend]: 9.24e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.93e-05 [cse]: 3.399e-05 [replace_applicator]: 2.71e-05 [Cycle 2]: 0.00040958, [27] [switch_simplify]: 7.3e-06 [loop_unroll]: 6.61999e-06 [a_1]: 0.00013374 [with_stream_mark]: 1.609e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 4.87e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.074e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.49e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 7.77e-06 [cse]: 1.374e-05 [replace_applicator]: 6.54999e-06 [py_interpret_to_execute_after_opt_a]: 1.386e-05 [rewriter_after_opt_a]: 3.645e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.00074619 [jit_opt_b]: 5.868e-05, [1] [Cycle 1]: 5.041e-05, [2] [frontend_op_eliminate]: 2.005e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 2.786e-05 [loop_unroll]: 0.00045689 [jit_opt_after_cconv]: 0.00016391, [1] [Cycle 1]: 0.00015642, [11] [c_1]: 2.658e-05 [parameter_eliminate]: 3.41999e-06 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.666e-05 [call_graph_tuple_transform]: 2.325e-05 [tuple_list_get_item_eliminator]: 6.20002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.784e-05 [partial_unused_args_eliminate]: 3.31999e-06 [environ_conv]: 8.37998e-06 [add_recomputation]: 5.571e-05 [cse_after_recomputation]: 2.455e-05, [1] [Cycle 1]: 1.861e-05, [1] [cse]: 1.204e-05 [auto_monad_reorder]: 1.609e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.89999e-06 [opt_after_jit_grad]: 0.0005191 [symbol_engine_optimizer]: 8.346e-05, [1] [Cycle 1]: 7.658e-05, [6] [build]: 3.62002e-06 [elim_shapecalc]: 9.49999e-06 [elim_not_effective]: 1.599e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.079e-05 [renormalize]: 4.20026e-07 [validate]: 5.173e-05 Sums bootstrap : 0.000437s : 0.34% type_inference : 0.109648s : 84.95% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000288s : 0.22% rewriter_before_opt_a : 0.000093s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000748s : 0.58% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.015109s : 11.71% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000746s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000457s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000519s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000238 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 3.22% : 0.000008s : 4: substitution.graph_param_transform 81.69% : 0.000195s : 4: substitution.inline 1.69% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000006s : 4: substitution.remove_not_recompute_node 2.91% : 0.000007s : 2: substitution.replace_old_param 6.08% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109561 2 97.97% : 0.107332s : 1: type_inference.infer 2.03% : 0.002229s : 1: type_inference.specialize ------[replace.] 0.000078 6 64.81% : 0.000050s : 4: replace.inline 35.19% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 93.53% : 0.000192s : 4: match.inline 6.47% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.67% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.09% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.05% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.27% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000008s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.79% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000002s : 12: predicate.minmaximum_grad 2.09% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 2.18% : 0.000003s : 12: predicate.reduce_eliminate 1.32% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 12: predicate.reshape_eliminate 1.47% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.93% : 0.000010s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.40% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002801 26 73.34% : 0.002054s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.28% : 0.000708s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149706 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.31% : 0.000463s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 13.62% : 0.020386s : 1: jit_opt_a 0.11% : 0.000167s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.31% : 0.000466s : 1: loop_unroll 0.51% : 0.000758s : 1: mutable_eliminate 0.67% : 0.001011s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000529s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000294s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 9.50% : 0.014216s : 1: renormalize.infer 0.59% : 0.000877s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 73.30% : 0.109730s : 1: type_inference TotalTime = 0.13474, [30] [bootstrap]: 0.00031336 [type_inference]: 0.120702 [event_method]: 2.76e-05 [auto_monad]: 8.622e-05 [graph_reusing]: 7.01999e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 0.00048067 [rewriter_before_opt_a]: 0.000114 [expand_dump_flag]: 3.99002e-06 [jit_opt_a]: 0.0101799, [2] [Cycle 1]: 0.00541944, [27] [switch_simplify]: 7.318e-05 [loop_unroll]: 3.564e-05 [a_1]: 0.00082034 [with_stream_mark]: 2.446e-05 [recompute_prepare]: 1.272e-05 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 4.03999e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.53e-06 [specialize_transform]: 7.62002e-06 [updatestate_useless_node_eliminater]: 6.44001e-06 [accelerated_algorithm]: 7.16999e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 7.17997e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.11e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.065e-05 [inline_without_move]: 6.82002e-06 [renormalize]: 0.004023 [add_forward_monad_depend]: 1.043e-05 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 2.206e-05 [cse]: 4.264e-05 [replace_applicator]: 2.609e-05 [Cycle 2]: 0.00042225, [27] [switch_simplify]: 8.1e-06 [loop_unroll]: 7.49002e-06 [a_1]: 0.00013559 [with_stream_mark]: 1.595e-05 [recompute_prepare]: 7.30998e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 3.56001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.994e-05 [j_node_and_user_rematch]: 1.134e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.052e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 7.05e-06 [cse]: 1.713e-05 [replace_applicator]: 7.1e-06 [py_interpret_to_execute_after_opt_a]: 1.682e-05 [rewriter_after_opt_a]: 4.359e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.00085221 [jit_opt_b]: 7.176e-05, [1] [Cycle 1]: 5.26e-05, [2] [frontend_op_eliminate]: 2.049e-05 [inline_after_opt_a]: 2.081e-05 [cconv]: 3.355e-05 [loop_unroll]: 0.00050199 [jit_opt_after_cconv]: 0.00018119, [1] [Cycle 1]: 0.00017391, [11] [c_1]: 2.644e-05 [parameter_eliminate]: 3.99002e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 3.229e-05 [call_graph_tuple_transform]: 2.615e-05 [tuple_list_get_item_eliminator]: 7.15e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 1.02998e-06 [switch_simplify]: 6.69001e-06 [remove_dup_value]: 2.134e-05 [partial_unused_args_eliminate]: 3.36999e-06 [environ_conv]: 9.89001e-06 [add_recomputation]: 5.569e-05 [cse_after_recomputation]: 2.638e-05, [1] [Cycle 1]: 2.116e-05, [1] [cse]: 1.496e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 6.83998e-06 [opt_after_jit_grad]: 0.00058855 [symbol_engine_optimizer]: 8.791e-05, [1] [Cycle 1]: 7.938e-05, [6] [build]: 3.58999e-06 [elim_shapecalc]: 9.03002e-06 [elim_not_effective]: 1.855e-05 [opt_reshape]: 9.72001e-06 [fold_const_symbol]: 9.89999e-06 [renormalize]: 6.39993e-07 [validate]: 5.866e-05 Sums bootstrap : 0.000313s : 0.24% type_inference : 0.120702s : 93.07% event_method : 0.000028s : 0.02% auto_monad : 0.000086s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000481s : 0.37% rewriter_before_opt_a : 0.000114s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000956s : 0.74% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004023s : 3.10% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000060s : 0.05% jit_opt_a.replace_applicator : 0.000033s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000852s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000502s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000589s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.05% Time group info: ------[substitution.] 0.000348 25 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000008s : 4: substitution.graph_param_transform 87.34% : 0.000304s : 5: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000006s : 2: substitution.replace_old_param 4.18% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120587 2 97.21% : 0.117219s : 1: type_inference.infer 2.79% : 0.003368s : 1: type_inference.specialize ------[replace.] 0.000118 7 68.85% : 0.000081s : 5: replace.inline 31.15% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000313 7 95.80% : 0.000300s : 5: match.inline 4.20% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.88% : 0.000003s : 13: predicate.addn_zero_filter 1.80% : 0.000003s : 13: predicate.arithmetic_simplify 1.16% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 6.41% : 0.000010s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.66% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.68% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.36% : 0.000004s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.14% : 0.000002s : 13: predicate.reshape_eliminate 1.44% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.57% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.35% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000011s : 64: predicate.switch_simplify 1.11% : 0.000002s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002825 25 58.97% : 0.001666s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.39% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.64% : 0.001063s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140075 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000090s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000335s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.27% : 0.010183s : 1: jit_opt_a 0.13% : 0.000184s : 1: jit_opt_after_cconv 0.05% : 0.000075s : 1: jit_opt_b 0.36% : 0.000511s : 1: loop_unroll 0.62% : 0.000863s : 1: mutable_eliminate 0.89% : 0.001243s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000599s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 2.12% : 0.002975s : 1: renormalize.infer 0.74% : 0.001034s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.09% : 0.000122s : 1: rewriter_before_opt_a 0.06% : 0.000090s : 1: symbol_engine_optimizer 86.19% : 0.120733s : 1: type_inference TotalTime = 0.013298, [30] [bootstrap]: 0.00033313 [type_inference]: 0.00494247 [event_method]: 1.968e-05 [auto_monad]: 6.923e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 3.786e-05 [rewriter_before_opt_a]: 7.529e-05 [expand_dump_flag]: 3.22002e-06 [jit_opt_a]: 0.00545269, [2] [Cycle 1]: 0.00173782, [27] [switch_simplify]: 5.755e-05 [loop_unroll]: 2.999e-05 [a_1]: 0.00062196 [with_stream_mark]: 2.19e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.8e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.54999e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.33002e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00064272 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.672e-05 [cse]: 3.159e-05 [replace_applicator]: 1.511e-05 [Cycle 2]: 0.00034513, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 5.10001e-06 [a_1]: 9.327e-05 [with_stream_mark]: 1.296e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.35003e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 5.28002e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.365e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.11001e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.29999e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.444e-05 [replace_applicator]: 5.96998e-06 [py_interpret_to_execute_after_opt_a]: 1.411e-05 [rewriter_after_opt_a]: 3.894e-05 [convert_after_rewriter]: 7.9e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00058499 [jit_opt_b]: 5.188e-05, [1] [Cycle 1]: 4.388e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.663e-05 [cconv]: 3.029e-05 [loop_unroll]: 0.00046725 [jit_opt_after_cconv]: 0.00015318, [1] [Cycle 1]: 0.00014613, [11] [c_1]: 2.105e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 7.29001e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.45002e-06 [cse]: 2.496e-05 [call_graph_tuple_transform]: 1.993e-05 [tuple_list_get_item_eliminator]: 5.53002e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.63997e-06 [remove_dup_value]: 1.733e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 6.91999e-06 [add_recomputation]: 5.223e-05 [cse_after_recomputation]: 2.712e-05, [1] [Cycle 1]: 2.107e-05, [1] [cse]: 1.389e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.77001e-06 [opt_after_jit_grad]: 0.0005093 [symbol_engine_optimizer]: 0.00011549, [1] [Cycle 1]: 0.00010733, [6] [build]: 3.45e-06 [elim_shapecalc]: 8.92e-06 [elim_not_effective]: 1.416e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 4.438e-05 [renormalize]: 1.00999e-06 [validate]: 4.466e-05 Sums bootstrap : 0.000333s : 3.59% type_inference : 0.004942s : 53.22% event_method : 0.000020s : 0.21% auto_monad : 0.000069s : 0.75% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000038s : 0.41% rewriter_before_opt_a : 0.000075s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.38% jit_opt_a.a_1 : 0.000715s : 7.70% jit_opt_a.with_stream_mark : 0.000035s : 0.38% jit_opt_a.recompute_prepare : 0.000015s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000012s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000643s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.25% jit_opt_a.cse : 0.000046s : 0.50% jit_opt_a.replace_applicator : 0.000021s : 0.23% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000039s : 0.42% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000585s : 6.30% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000030s : 0.33% loop_unroll : 0.000467s : 5.03% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000025s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000052s : 0.56% cse_after_recomputation.cse : 0.000014s : 0.15% auto_monad_reorder : 0.000019s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000509s : 5.48% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000044s : 0.48% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000045s : 0.48% Time group info: ------[substitution.] 0.000276 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.20% : 0.000006s : 3: substitution.graph_param_transform 87.08% : 0.000240s : 4: substitution.inline 1.73% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.38% : 0.000004s : 2: substitution.replace_old_param 4.45% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004875 2 82.86% : 0.004039s : 1: type_inference.infer 17.14% : 0.000836s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.70% : 0.000051s : 4: replace.inline 33.30% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 6 95.53% : 0.000237s : 4: match.inline 4.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.51% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.39% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.44% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.34% : 0.000008s : 22: predicate.inline 1.03% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.24% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.52% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.13% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000009s : 53: predicate.switch_simplify 1.09% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000657 13 54.71% : 0.000359s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.41% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.88% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014972 72 0.37% : 0.000056s : 1: add_recomputation 0.49% : 0.000073s : 1: auto_monad 0.15% : 0.000022s : 1: auto_monad_reorder 2.38% : 0.000356s : 1: bootstrap 0.22% : 0.000033s : 1: cconv 0.07% : 0.000011s : 1: convert_after_rewriter 0.19% : 0.000029s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.16% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.44% : 0.005456s : 1: jit_opt_a 1.04% : 0.000156s : 1: jit_opt_after_cconv 0.36% : 0.000055s : 1: jit_opt_b 3.19% : 0.000477s : 1: loop_unroll 3.98% : 0.000596s : 1: mutable_eliminate 6.26% : 0.000938s : 26: opt.transform.jit_opt_a 0.32% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.17% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.47% : 0.000070s : 4: opt.transform.symbol_engine_opt 3.48% : 0.000521s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000040s : 1: py_interpret_to_execute 0.11% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000027s : 1: remove_dup_value 2.32% : 0.000348s : 1: renormalize.infer 1.92% : 0.000287s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000043s : 1: rewriter_after_opt_a 0.52% : 0.000078s : 1: rewriter_before_opt_a 0.79% : 0.000118s : 1: symbol_engine_optimizer 33.13% : 0.004960s : 1: type_inference TotalTime = 0.0338615, [30] [bootstrap]: 0.00027304 [type_inference]: 0.0083662 [event_method]: 1.99e-05 [auto_monad]: 6.696e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 4.64e-05 [rewriter_before_opt_a]: 7.985e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.0225259, [2] [Cycle 1]: 0.0186757, [27] [switch_simplify]: 5.984e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.0005732 [with_stream_mark]: 2.063e-05 [recompute_prepare]: 9.37001e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.98002e-06 [renormalize]: 0.0175627 [add_forward_monad_depend]: 1.489e-05 [auto_monad_grad]: 3.36001e-06 [auto_monad_eliminator]: 2.877e-05 [cse]: 4.488e-05 [replace_applicator]: 2.69e-05 [Cycle 2]: 0.00039801, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 5.67999e-06 [a_1]: 0.00010408 [with_stream_mark]: 1.799e-05 [recompute_prepare]: 6.31998e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 3.12002e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 6.84001e-06 [meta_shard_fg_expand]: 2.92002e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 3.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.175e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 5.32001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 8.3e-06 [cse]: 1.77e-05 [replace_applicator]: 6.39999e-06 [py_interpret_to_execute_after_opt_a]: 1.822e-05 [rewriter_after_opt_a]: 4.298e-05 [convert_after_rewriter]: 7.37002e-06 [order_py_execute_after_rewriter]: 5.16998e-06 [mutable_eliminate]: 0.00078435 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.528e-05, [2] [frontend_op_eliminate]: 1.698e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 3.465e-05 [loop_unroll]: 0.00044373 [jit_opt_after_cconv]: 0.0001547, [1] [Cycle 1]: 0.00014788, [11] [c_1]: 2.172e-05 [parameter_eliminate]: 3.91001e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.709e-05 [call_graph_tuple_transform]: 2.029e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.8e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 1.033e-05 [add_recomputation]: 5.322e-05 [cse_after_recomputation]: 2.432e-05, [1] [Cycle 1]: 1.889e-05, [1] [cse]: 1.324e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.36002e-06 [opt_after_jit_grad]: 0.00047321 [symbol_engine_optimizer]: 8.505e-05, [1] [Cycle 1]: 7.815e-05, [6] [build]: 1.31e-05 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 6.29001e-06 [fold_const_symbol]: 8.62e-06 [renormalize]: 3.29979e-07 [validate]: 4.986e-05 Sums bootstrap : 0.000273s : 0.92% type_inference : 0.008366s : 28.11% event_method : 0.000020s : 0.07% auto_monad : 0.000067s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000046s : 0.16% rewriter_before_opt_a : 0.000080s : 0.27% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.23% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000677s : 2.28% jit_opt_a.with_stream_mark : 0.000039s : 0.13% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.017563s : 59.01% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.06% jit_opt_a.auto_monad_grad : 0.000005s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.12% jit_opt_a.cse : 0.000063s : 0.21% jit_opt_a.replace_applicator : 0.000033s : 0.11% py_interpret_to_execute_after_opt_a : 0.000018s : 0.06% rewriter_after_opt_a : 0.000043s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000784s : 2.64% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000035s : 0.12% loop_unroll : 0.000444s : 1.49% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.03% add_recomputation : 0.000053s : 0.18% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000473s : 1.59% symbol_engine_optimizer.build : 0.000013s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.17% Time group info: ------[substitution.] 0.000242 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 3: substitution.graph_param_transform 83.57% : 0.000202s : 4: substitution.inline 2.08% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 2.79% : 0.000007s : 2: substitution.replace_old_param 5.74% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008294 2 85.11% : 0.007059s : 1: type_inference.infer 14.89% : 0.001235s : 1: type_inference.specialize ------[replace.] 0.000078 6 69.23% : 0.000054s : 4: replace.inline 30.77% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.13% : 0.000199s : 4: match.inline 5.87% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.61% : 0.000002s : 10: predicate.accumulaten_eliminater 0.81% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.40% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.94% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.25% : 0.000002s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 2.45% : 0.000003s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.54% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.46% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000768 13 48.75% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.24% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.01% : 0.000345s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052392 72 0.11% : 0.000057s : 1: add_recomputation 0.13% : 0.000071s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.55% : 0.000288s : 1: bootstrap 0.07% : 0.000038s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 43.00% : 0.022530s : 1: jit_opt_a 0.30% : 0.000157s : 1: jit_opt_after_cconv 0.11% : 0.000057s : 1: jit_opt_b 0.86% : 0.000452s : 1: loop_unroll 1.52% : 0.000796s : 1: mutable_eliminate 1.77% : 0.000929s : 26: opt.transform.jit_opt_a 0.10% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000049s : 1: py_interpret_to_execute 0.04% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 0.79% : 0.000412s : 1: renormalize.infer 32.71% : 0.017136s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000046s : 1: rewriter_after_opt_a 0.16% : 0.000083s : 1: rewriter_before_opt_a 0.17% : 0.000088s : 1: symbol_engine_optimizer 16.00% : 0.008384s : 1: type_inference TotalTime = 0.0312516, [30] [bootstrap]: 0.00034278 [type_inference]: 0.0218335 [event_method]: 2.002e-05 [auto_monad]: 6.798e-05 [graph_reusing]: 5.88002e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00010761 [rewriter_before_opt_a]: 8.044e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00624155, [2] [Cycle 1]: 0.00229749, [27] [switch_simplify]: 6.105e-05 [loop_unroll]: 2.992e-05 [a_1]: 0.00061326 [with_stream_mark]: 2.63e-05 [recompute_prepare]: 8.90999e-06 [updatestate_depend_eliminate]: 4.73001e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 6.82002e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.40002e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.29997e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.637e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 4.481e-05 [inline_without_move]: 7.65e-06 [renormalize]: 0.00112307 [add_forward_monad_depend]: 7.93001e-06 [auto_monad_grad]: 3.38e-06 [auto_monad_eliminator]: 1.823e-05 [cse]: 3.831e-05 [replace_applicator]: 1.745e-05 [Cycle 2]: 0.00036652, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.43002e-06 [a_1]: 9.687e-05 [with_stream_mark]: 1.342e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.21998e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 2.70002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.756e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.08998e-06 [replace_old_param]: 9.25001e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 8.82e-06 [cse]: 1.633e-05 [replace_applicator]: 6.00002e-06 [py_interpret_to_execute_after_opt_a]: 1.629e-05 [rewriter_after_opt_a]: 4.466e-05 [convert_after_rewriter]: 7.61001e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00076866 [jit_opt_b]: 5.544e-05, [1] [Cycle 1]: 4.665e-05, [2] [frontend_op_eliminate]: 1.672e-05 [inline_after_opt_a]: 1.727e-05 [cconv]: 3.3e-05 [loop_unroll]: 0.00046388 [jit_opt_after_cconv]: 0.00018456, [1] [Cycle 1]: 0.00015327, [11] [c_1]: 2.342e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 8.35999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 2.886e-05 [call_graph_tuple_transform]: 2.117e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 1.50001e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.867e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 5.816e-05 [cse_after_recomputation]: 2.601e-05, [1] [Cycle 1]: 1.985e-05, [1] [cse]: 1.367e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 2.69999e-06 [rewriter_after_jit_bprop_graph]: 6.41998e-06 [opt_after_jit_grad]: 0.0005059 [symbol_engine_optimizer]: 7.732e-05, [1] [Cycle 1]: 7.011e-05, [6] [build]: 4.48001e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.96998e-06 [renormalize]: 3.80009e-07 [validate]: 4.699e-05 Sums bootstrap : 0.000343s : 1.27% type_inference : 0.021833s : 80.89% event_method : 0.000020s : 0.07% auto_monad : 0.000068s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000108s : 0.40% rewriter_before_opt_a : 0.000080s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000710s : 2.63% jit_opt_a.with_stream_mark : 0.000040s : 0.15% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000054s : 0.20% jit_opt_a.inline_without_move : 0.000014s : 0.05% jit_opt_a.renormalize : 0.001123s : 4.16% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000005s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.10% jit_opt_a.cse : 0.000055s : 0.20% jit_opt_a.replace_applicator : 0.000023s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000045s : 0.17% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000769s : 2.85% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000033s : 0.12% loop_unroll : 0.000464s : 1.72% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000058s : 0.22% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000506s : 1.87% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.17% Time group info: ------[substitution.] 0.000263 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000007s : 3: substitution.graph_param_transform 84.23% : 0.000221s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000005s : 4: substitution.remove_not_recompute_node 2.93% : 0.000008s : 2: substitution.replace_old_param 5.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021761 2 93.32% : 0.020307s : 1: type_inference.infer 6.68% : 0.001454s : 1: type_inference.specialize ------[replace.] 0.000079 6 66.92% : 0.000053s : 4: replace.inline 33.08% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.78% : 0.000217s : 4: match.inline 5.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.78% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.31% : 0.000002s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 2.37% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 10: predicate.compare_switch_simplify 1.19% : 0.000002s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000007s : 22: predicate.inline 1.36% : 0.000002s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.74% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.71% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.28% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.22% : 0.000002s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.67% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.59% : 0.000008s : 53: predicate.switch_simplify 1.00% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000002s : 10: predicate.transpose_eliminate 1.59% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.88% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.92% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000979 13 49.84% : 0.000488s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.98% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.18% : 0.000433s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033416 72 0.18% : 0.000061s : 1: add_recomputation 0.21% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.10% : 0.000368s : 1: bootstrap 0.11% : 0.000035s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.69% : 0.006245s : 1: jit_opt_a 0.56% : 0.000187s : 1: jit_opt_after_cconv 0.17% : 0.000058s : 1: jit_opt_b 1.42% : 0.000473s : 1: loop_unroll 2.34% : 0.000781s : 1: mutable_eliminate 2.95% : 0.000987s : 26: opt.transform.jit_opt_a 0.16% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.54% : 0.000516s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000111s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.88% : 0.000628s : 1: renormalize.infer 1.45% : 0.000485s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000048s : 1: rewriter_after_opt_a 0.25% : 0.000084s : 1: rewriter_before_opt_a 0.24% : 0.000080s : 1: symbol_engine_optimizer 65.39% : 0.021850s : 1: type_inference TotalTime = 0.28136, [30] [bootstrap]: 0.00039949 [type_inference]: 0.263589 [event_method]: 3.043e-05 [auto_monad]: 9.696e-05 [graph_reusing]: 7.00998e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00079876 [rewriter_before_opt_a]: 0.00012502 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.0127937, [2] [Cycle 1]: 0.00712567, [27] [switch_simplify]: 9.21e-05 [loop_unroll]: 3.48e-05 [a_1]: 0.00090269 [with_stream_mark]: 3.02e-05 [recompute_prepare]: 1.188e-05 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 7.95e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 7.75e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 7.77998e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.943e-05 [j_node_and_user_rematch]: 1.404e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.325e-05 [inline_without_move]: 7.03998e-06 [renormalize]: 0.00552752 [add_forward_monad_depend]: 2.71e-05 [auto_monad_grad]: 3.48999e-06 [auto_monad_eliminator]: 2.885e-05 [cse]: 4.475e-05 [replace_applicator]: 3.538e-05 [Cycle 2]: 0.00051459, [27] [switch_simplify]: 9.40001e-06 [loop_unroll]: 7.84997e-06 [a_1]: 0.00019555 [with_stream_mark]: 2.059e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.83998e-06 [accelerated_algorithm]: 6.78003e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 4.48999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 1.127e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 1.089e-05 [inline_without_move]: 6.53998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.88002e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 8.87999e-06 [cse]: 2.12e-05 [replace_applicator]: 7.65998e-06 [py_interpret_to_execute_after_opt_a]: 2.131e-05 [rewriter_after_opt_a]: 4.894e-05 [convert_after_rewriter]: 8.50999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00099825 [jit_opt_b]: 0.00010386, [1] [Cycle 1]: 8.898e-05, [2] [frontend_op_eliminate]: 2.539e-05 [inline_after_opt_a]: 2.147e-05 [cconv]: 4.189e-05 [loop_unroll]: 0.00061299 [jit_opt_after_cconv]: 0.00022804, [1] [Cycle 1]: 0.0002152, [11] [c_1]: 3.28e-05 [parameter_eliminate]: 7.13e-06 [updatestate_depend_eliminate]: 1.309e-05 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 3.8e-06 [cse]: 4.191e-05 [call_graph_tuple_transform]: 3.539e-05 [tuple_list_get_item_eliminator]: 8.38999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 7.26001e-06 [remove_dup_value]: 2.239e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 1.157e-05 [add_recomputation]: 6.539e-05 [cse_after_recomputation]: 2.936e-05, [1] [Cycle 1]: 2.355e-05, [1] [cse]: 1.495e-05 [auto_monad_reorder]: 2.29e-05 [get_jit_bprop_graph]: 2.79999e-06 [rewriter_after_jit_bprop_graph]: 1.02e-05 [opt_after_jit_grad]: 0.00060079 [symbol_engine_optimizer]: 0.0001002, [1] [Cycle 1]: 9.012e-05, [6] [build]: 4.67998e-06 [elim_shapecalc]: 1.013e-05 [elim_not_effective]: 2.185e-05 [opt_reshape]: 1.169e-05 [fold_const_symbol]: 1.124e-05 [renormalize]: 1.05001e-06 [validate]: 0.0003101 Sums bootstrap : 0.000399s : 0.15% type_inference : 0.263589s : 95.73% event_method : 0.000030s : 0.01% auto_monad : 0.000097s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000799s : 0.29% rewriter_before_opt_a : 0.000125s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000102s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.001098s : 0.40% jit_opt_a.with_stream_mark : 0.000051s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.005528s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.01% jit_opt_a.cse : 0.000066s : 0.02% jit_opt_a.replace_applicator : 0.000043s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000049s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000998s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000042s : 0.02% loop_unroll : 0.000613s : 0.22% jit_opt_after_cconv.c_1 : 0.000033s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000035s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000065s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000023s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000601s : 0.22% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000310s : 0.11% Time group info: ------[substitution.] 0.000410 28 0.49% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000008s : 4: substitution.graph_param_transform 83.38% : 0.000342s : 5: substitution.inline 1.46% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.29% : 0.000018s : 3: substitution.reduce_eliminate 1.66% : 0.000007s : 4: substitution.remove_not_recompute_node 2.01% : 0.000008s : 2: substitution.replace_old_param 4.35% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.263438 2 97.46% : 0.256749s : 1: type_inference.infer 2.54% : 0.006689s : 1: type_inference.specialize ------[replace.] 0.000138 7 64.96% : 0.000090s : 5: replace.inline 35.04% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000354 7 95.49% : 0.000338s : 5: match.inline 4.51% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 886 1.07% : 0.000002s : 13: predicate.accumulaten_eliminater 1.28% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000002s : 13: predicate.addn_check_dump 1.80% : 0.000003s : 13: predicate.addn_zero_filter 2.10% : 0.000004s : 13: predicate.arithmetic_simplify 1.63% : 0.000003s : 13: predicate.cast_eliminate 0.35% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.01% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.31% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000010s : 28: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.09% : 0.000004s : 19: predicate.load_eliminater 1.66% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.27% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.67% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000004s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.78% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.26% : 0.000000s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.98% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 1.10% : 0.000002s : 8: predicate.specialize_transform 1.52% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.89% : 0.000005s : 20: predicate.switch_defer_inline 2.14% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000012s : 64: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.75% : 0.000003s : 13: predicate.transpose_eliminate 1.88% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.02% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.22% : 0.000006s : 27: predicate.updatestate_useless_node_eliminater 1.35% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004015 25 56.85% : 0.002283s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.63% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.51% : 0.001627s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.288144 72 0.02% : 0.000069s : 1: add_recomputation 0.04% : 0.000102s : 1: auto_monad 0.01% : 0.000026s : 1: auto_monad_reorder 0.15% : 0.000420s : 1: bootstrap 0.02% : 0.000045s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.44% : 0.012798s : 1: jit_opt_a 0.08% : 0.000231s : 1: jit_opt_after_cconv 0.04% : 0.000107s : 1: jit_opt_b 0.22% : 0.000625s : 1: loop_unroll 0.35% : 0.001014s : 1: mutable_eliminate 0.49% : 0.001422s : 26: opt.transform.jit_opt_a 0.03% : 0.000079s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000029s : 1: opt.transform.mutable_eliminate 0.01% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000613s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000808s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 1.35% : 0.003887s : 1: renormalize.infer 0.56% : 0.001623s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000053s : 1: rewriter_after_opt_a 0.05% : 0.000133s : 1: rewriter_before_opt_a 0.04% : 0.000103s : 1: symbol_engine_optimizer 91.49% : 0.263625s : 1: type_inference TotalTime = 0.132987, [30] [bootstrap]: 0.00028436 [type_inference]: 0.120206 [event_method]: 2.294e-05 [auto_monad]: 7.522e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00042512 [rewriter_before_opt_a]: 0.00010328 [expand_dump_flag]: 4.36002e-06 [jit_opt_a]: 0.00893312, [2] [Cycle 1]: 0.00430584, [27] [switch_simplify]: 6.874e-05 [loop_unroll]: 3.455e-05 [a_1]: 0.00072664 [with_stream_mark]: 2.459e-05 [recompute_prepare]: 9.04998e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.50002e-06 [meta_shard_fg_expand]: 2.70002e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 6.46999e-06 [renormalize]: 0.00304606 [add_forward_monad_depend]: 9.72999e-06 [auto_monad_grad]: 3.65998e-06 [auto_monad_eliminator]: 2.192e-05 [cse]: 4.313e-05 [replace_applicator]: 2.147e-05 [Cycle 2]: 0.00039581, [27] [switch_simplify]: 7.56999e-06 [loop_unroll]: 6.09999e-06 [a_1]: 0.00012336 [with_stream_mark]: 1.633e-05 [recompute_prepare]: 5.97001e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.89e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.873e-05 [j_node_and_user_rematch]: 1.061e-05 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.38003e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 6.60997e-06 [cse]: 1.555e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.911e-05 [rewriter_after_opt_a]: 4.397e-05 [convert_after_rewriter]: 7.27002e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00086222 [jit_opt_b]: 6.312e-05, [1] [Cycle 1]: 5.338e-05, [2] [frontend_op_eliminate]: 2.11e-05 [inline_after_opt_a]: 2.072e-05 [cconv]: 3.874e-05 [loop_unroll]: 0.00053984 [jit_opt_after_cconv]: 0.00019378, [1] [Cycle 1]: 0.0001859, [11] [c_1]: 2.77e-05 [parameter_eliminate]: 5.52999e-06 [updatestate_depend_eliminate]: 1.137e-05 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 3.966e-05 [call_graph_tuple_transform]: 2.604e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 7.99977e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 2.017e-05 [partial_unused_args_eliminate]: 3.35e-06 [environ_conv]: 1.038e-05 [add_recomputation]: 6.039e-05 [cse_after_recomputation]: 2.796e-05, [1] [Cycle 1]: 2.243e-05, [1] [cse]: 1.503e-05 [auto_monad_reorder]: 1.888e-05 [get_jit_bprop_graph]: 2.82002e-06 [rewriter_after_jit_bprop_graph]: 8.84998e-06 [opt_after_jit_grad]: 0.00055485 [symbol_engine_optimizer]: 8.425e-05, [1] [Cycle 1]: 7.611e-05, [6] [build]: 5.14e-06 [elim_shapecalc]: 9.42001e-06 [elim_not_effective]: 1.616e-05 [opt_reshape]: 7.62002e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 3.89991e-07 [validate]: 0.00013924 Sums bootstrap : 0.000284s : 0.22% type_inference : 0.120206s : 93.85% event_method : 0.000023s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000425s : 0.33% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000850s : 0.66% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003046s : 2.38% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000059s : 0.05% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000862s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000039s : 0.03% loop_unroll : 0.000540s : 0.42% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000060s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000555s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000139s : 0.11% Time group info: ------[substitution.] 0.000299 25 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000007s : 4: substitution.graph_param_transform 86.79% : 0.000260s : 5: substitution.inline 1.53% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_old_param 4.19% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120115 2 97.43% : 0.117023s : 1: type_inference.infer 2.57% : 0.003091s : 1: type_inference.specialize ------[replace.] 0.000101 7 70.04% : 0.000071s : 5: replace.inline 29.96% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000268 7 95.76% : 0.000256s : 5: match.inline 4.24% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.18% : 0.000002s : 13: predicate.accumulaten_eliminater 1.38% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 1.66% : 0.000002s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.46% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 2.11% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.26% : 0.000002s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000010s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.12% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002805 25 66.13% : 0.001855s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.15% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.72% : 0.000862s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137140 72 0.05% : 0.000064s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000304s : 1: bootstrap 0.03% : 0.000042s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.52% : 0.008937s : 1: jit_opt_a 0.14% : 0.000197s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.40% : 0.000552s : 1: loop_unroll 0.64% : 0.000879s : 1: mutable_eliminate 0.81% : 0.001114s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000024s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000565s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000432s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.57% : 0.002150s : 1: renormalize.infer 0.64% : 0.000884s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 87.67% : 0.120228s : 1: type_inference TotalTime = 0.023547, [30] [bootstrap]: 0.00044994 [type_inference]: 0.0123511 [event_method]: 2.68e-05 [auto_monad]: 7.93e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 7.446e-05 [rewriter_before_opt_a]: 9.088e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.0076162, [2] [Cycle 1]: 0.00269921, [27] [switch_simplify]: 8.102e-05 [loop_unroll]: 3.331e-05 [a_1]: 0.00078324 [with_stream_mark]: 2.577e-05 [recompute_prepare]: 1.059e-05 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.35002e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 3.08998e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.721e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 1.217e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00130151 [add_forward_monad_depend]: 8.03001e-06 [auto_monad_grad]: 2.78998e-06 [auto_monad_eliminator]: 1.938e-05 [cse]: 4.224e-05 [replace_applicator]: 1.919e-05 [Cycle 2]: 0.00035973, [27] [switch_simplify]: 6.62002e-06 [loop_unroll]: 4.94e-06 [a_1]: 0.00010749 [with_stream_mark]: 1.323e-05 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 4.59998e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 3.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.94002e-06 [inline_without_move]: 5.02e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.554e-05 [replace_applicator]: 6.18998e-06 [py_interpret_to_execute_after_opt_a]: 1.68e-05 [rewriter_after_opt_a]: 4.438e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00082951 [jit_opt_b]: 5.662e-05, [1] [Cycle 1]: 4.806e-05, [2] [frontend_op_eliminate]: 1.856e-05 [inline_after_opt_a]: 1.776e-05 [cconv]: 3.612e-05 [loop_unroll]: 0.00050219 [jit_opt_after_cconv]: 0.00019045, [1] [Cycle 1]: 0.00018311, [11] [c_1]: 2.246e-05 [parameter_eliminate]: 3.93001e-06 [updatestate_depend_eliminate]: 7.32002e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 3.254e-05 [call_graph_tuple_transform]: 4.256e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 1.05001e-06 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.813e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 7.26999e-06 [add_recomputation]: 5.715e-05 [cse_after_recomputation]: 2.689e-05, [1] [Cycle 1]: 2.02e-05, [1] [cse]: 1.329e-05 [auto_monad_reorder]: 1.754e-05 [get_jit_bprop_graph]: 2.71e-06 [rewriter_after_jit_bprop_graph]: 6.94999e-06 [opt_after_jit_grad]: 0.00065736 [symbol_engine_optimizer]: 8.657e-05, [1] [Cycle 1]: 7.835e-05, [6] [build]: 5.55001e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.724e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 9.69999e-06 [renormalize]: 6.40022e-07 [validate]: 4.951e-05 Sums bootstrap : 0.000450s : 2.47% type_inference : 0.012351s : 67.71% event_method : 0.000027s : 0.15% auto_monad : 0.000079s : 0.43% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000074s : 0.41% rewriter_before_opt_a : 0.000091s : 0.50% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000088s : 0.48% jit_opt_a.loop_unroll : 0.000038s : 0.21% jit_opt_a.a_1 : 0.000891s : 4.88% jit_opt_a.with_stream_mark : 0.000039s : 0.21% jit_opt_a.recompute_prepare : 0.000016s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.10% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001302s : 7.14% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.14% jit_opt_a.cse : 0.000058s : 0.32% jit_opt_a.replace_applicator : 0.000025s : 0.14% py_interpret_to_execute_after_opt_a : 0.000017s : 0.09% rewriter_after_opt_a : 0.000044s : 0.24% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000830s : 4.55% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.10% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000036s : 0.20% loop_unroll : 0.000502s : 2.75% jit_opt_after_cconv.c_1 : 0.000022s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000043s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000018s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000057s : 0.31% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000657s : 3.60% symbol_engine_optimizer.build : 0.000006s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.27% Time group info: ------[substitution.] 0.000365 27 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 1.92% : 0.000007s : 3: substitution.graph_param_transform 84.98% : 0.000310s : 5: substitution.inline 1.18% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.41% : 0.000012s : 3: substitution.reduce_eliminate 1.53% : 0.000006s : 4: substitution.remove_not_recompute_node 1.91% : 0.000007s : 2: substitution.replace_old_param 3.87% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012237 2 79.83% : 0.009768s : 1: type_inference.infer 20.17% : 0.002469s : 1: type_inference.specialize ------[replace.] 0.000117 7 68.69% : 0.000080s : 5: replace.inline 31.31% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000320 7 96.07% : 0.000307s : 5: match.inline 3.93% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.28% : 0.000002s : 11: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 11: predicate.addn_check_dump 1.53% : 0.000002s : 11: predicate.addn_zero_filter 2.03% : 0.000003s : 11: predicate.arithmetic_simplify 1.67% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.12% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_depend_swap 1.13% : 0.000002s : 11: predicate.environ_get_eliminate 1.18% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000008s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.56% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 16: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.24% : 0.000002s : 11: predicate.minmaximum_grad 2.04% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000001s : 11: predicate.print_const_string_wrapper 2.09% : 0.000003s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000003s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000002s : 11: predicate.reshape_eliminate 1.15% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.73% : 0.000012s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.82% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 2.07% : 0.000003s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001233 16 42.07% : 0.000519s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.22% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 49.71% : 0.000613s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026074 72 0.23% : 0.000061s : 1: add_recomputation 0.32% : 0.000083s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.82% : 0.000473s : 1: bootstrap 0.15% : 0.000039s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000032s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 29.23% : 0.007621s : 1: jit_opt_a 0.74% : 0.000193s : 1: jit_opt_after_cconv 0.23% : 0.000059s : 1: jit_opt_b 1.96% : 0.000511s : 1: loop_unroll 3.23% : 0.000843s : 1: mutable_eliminate 4.42% : 0.001153s : 26: opt.transform.jit_opt_a 0.28% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000029s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000018s : 1: opt.transform.mutable_eliminate 0.10% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.57% : 0.000670s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000077s : 1: py_interpret_to_execute 0.08% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000021s : 1: remove_dup_value 3.01% : 0.000784s : 1: renormalize.infer 1.94% : 0.000505s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000048s : 1: rewriter_after_opt_a 0.36% : 0.000095s : 1: rewriter_before_opt_a 0.34% : 0.000090s : 1: symbol_engine_optimizer 47.49% : 0.012382s : 1: type_inference TotalTime = 0.0283483, [30] [bootstrap]: 0.00034824 [type_inference]: 0.00644771 [event_method]: 2.64e-05 [auto_monad]: 7.87e-05 [graph_reusing]: 7.75e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 6.215e-05 [rewriter_before_opt_a]: 9.107e-05 [expand_dump_flag]: 3.40003e-06 [jit_opt_a]: 0.0190298, [2] [Cycle 1]: 0.00214397, [27] [switch_simplify]: 5.485e-05 [loop_unroll]: 3.092e-05 [a_1]: 0.00059743 [with_stream_mark]: 1.957e-05 [recompute_prepare]: 1.024e-05 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.49998e-06 [accelerated_algorithm]: 5.78002e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.353e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.79999e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00109416 [add_forward_monad_depend]: 7.48999e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 2.755e-05 [replace_applicator]: 1.469e-05 [Cycle 2]: 0.00036305, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 5.56998e-06 [a_1]: 9.877e-05 [with_stream_mark]: 1.164e-05 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 3.10998e-06 [cell_reuse_recompute_pass]: 2.19999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 1.86998e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7e-06 [cse]: 1.584e-05 [replace_applicator]: 6.88e-06 [py_interpret_to_execute_after_opt_a]: 1.525e-05 [rewriter_after_opt_a]: 3.942e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 6.50002e-06 [mutable_eliminate]: 0.0005832 [jit_opt_b]: 5.372e-05, [1] [Cycle 1]: 4.625e-05, [2] [frontend_op_eliminate]: 1.714e-05 [inline_after_opt_a]: 1.719e-05 [cconv]: 2.671e-05 [loop_unroll]: 0.00046575 [jit_opt_after_cconv]: 0.00015278, [1] [Cycle 1]: 0.00014599, [11] [c_1]: 2.123e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 6.52001e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.716e-05 [call_graph_tuple_transform]: 1.911e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.25999e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.51998e-06 [remove_dup_value]: 1.452e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 8.95999e-06 [add_recomputation]: 4.316e-05 [cse_after_recomputation]: 2.463e-05, [1] [Cycle 1]: 1.917e-05, [1] [cse]: 1.304e-05 [auto_monad_reorder]: 1.388e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.00047209 [symbol_engine_optimizer]: 7.904e-05, [1] [Cycle 1]: 7.297e-05, [6] [build]: 1.016e-05 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.223e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 8.52998e-06 [renormalize]: 3.89991e-07 [validate]: 3.861e-05 Sums bootstrap : 0.000348s : 3.11% type_inference : 0.006448s : 57.57% event_method : 0.000026s : 0.24% auto_monad : 0.000079s : 0.70% graph_reusing : 0.000008s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000062s : 0.55% rewriter_before_opt_a : 0.000091s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.55% jit_opt_a.loop_unroll : 0.000036s : 0.33% jit_opt_a.a_1 : 0.000696s : 6.22% jit_opt_a.with_stream_mark : 0.000031s : 0.28% jit_opt_a.recompute_prepare : 0.000016s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.001094s : 9.77% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.22% jit_opt_a.cse : 0.000043s : 0.39% jit_opt_a.replace_applicator : 0.000022s : 0.19% py_interpret_to_execute_after_opt_a : 0.000015s : 0.14% rewriter_after_opt_a : 0.000039s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000007s : 0.06% mutable_eliminate : 0.000583s : 5.21% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000027s : 0.24% loop_unroll : 0.000466s : 4.16% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000043s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000014s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000472s : 4.22% symbol_engine_optimizer.build : 0.000010s : 0.09% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.34% Time group info: ------[substitution.] 0.000248 23 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000005s : 3: substitution.graph_param_transform 85.99% : 0.000214s : 4: substitution.inline 1.83% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006364 2 78.94% : 0.005024s : 1: type_inference.infer 21.06% : 0.001340s : 1: type_inference.specialize ------[replace.] 0.000084 6 67.55% : 0.000057s : 4: replace.inline 32.45% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.92% : 0.000211s : 4: match.inline 5.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.47% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.58% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.43% : 0.000008s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 2.29% : 0.000003s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.75% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000873 13 48.27% : 0.000421s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.98% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.75% : 0.000399s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030424 72 0.15% : 0.000046s : 1: add_recomputation 0.28% : 0.000084s : 1: auto_monad 0.05% : 0.000016s : 1: auto_monad_reorder 1.21% : 0.000369s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.04% : 0.000013s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.10% : 0.000031s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 62.56% : 0.019033s : 1: jit_opt_a 0.51% : 0.000156s : 1: jit_opt_after_cconv 0.19% : 0.000056s : 1: jit_opt_b 1.56% : 0.000474s : 1: loop_unroll 1.95% : 0.000594s : 1: mutable_eliminate 3.04% : 0.000925s : 26: opt.transform.jit_opt_a 0.16% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000481s : 1: opt_after_jit_grad 0.03% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000066s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000017s : 1: remove_dup_value 2.05% : 0.000624s : 1: renormalize.infer 1.51% : 0.000461s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.32% : 0.000096s : 1: rewriter_before_opt_a 0.27% : 0.000081s : 1: symbol_engine_optimizer 21.26% : 0.006468s : 1: type_inference TotalTime = 0.0701622, [30] [bootstrap]: 0.00031708 [type_inference]: 0.0532793 [event_method]: 2.157e-05 [auto_monad]: 6.97e-05 [graph_reusing]: 5.44998e-06 [pre_auto_parallel]: 1.86e-06 [py_interpret_to_execute]: 0.00018031 [rewriter_before_opt_a]: 8.697e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.0116896, [2] [Cycle 1]: 0.00631841, [27] [switch_simplify]: 6.853e-05 [loop_unroll]: 3.036e-05 [a_1]: 0.00253755 [with_stream_mark]: 3.093e-05 [recompute_prepare]: 1.41e-05 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 7.65e-06 [meta_shard_fg_expand]: 3.87998e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.59002e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.841e-05 [j_node_and_user_rematch]: 1.152e-05 [meta_fg_expand]: 3.11001e-06 [replace_old_param]: 1.23e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00316305 [add_forward_monad_depend]: 1.169e-05 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 2.495e-05 [cse]: 4.37e-05 [replace_applicator]: 2.212e-05 [Cycle 2]: 0.00040783, [27] [switch_simplify]: 6.92002e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00010839 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 6.69001e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.46998e-06 [specialize_transform]: 6.23002e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.35002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.028e-05 [j_node_and_user_rematch]: 1.12e-05 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.144e-05 [inline_without_move]: 5.34e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.46e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 9.08002e-06 [cse]: 1.595e-05 [replace_applicator]: 6.69001e-06 [py_interpret_to_execute_after_opt_a]: 2.218e-05 [rewriter_after_opt_a]: 4.788e-05 [convert_after_rewriter]: 8.77e-06 [order_py_execute_after_rewriter]: 5.47999e-06 [mutable_eliminate]: 0.00254905 [jit_opt_b]: 6.07e-05, [1] [Cycle 1]: 5.109e-05, [2] [frontend_op_eliminate]: 2.067e-05 [inline_after_opt_a]: 1.843e-05 [cconv]: 3.702e-05 [loop_unroll]: 0.00051084 [jit_opt_after_cconv]: 0.00017775, [1] [Cycle 1]: 0.0001701, [11] [c_1]: 2.282e-05 [parameter_eliminate]: 5.47001e-06 [updatestate_depend_eliminate]: 9.10001e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 4.15e-06 [cse]: 3.625e-05 [call_graph_tuple_transform]: 2.232e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 9.29984e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.811e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 7.28999e-06 [add_recomputation]: 5.626e-05 [cse_after_recomputation]: 2.559e-05, [1] [Cycle 1]: 1.95e-05, [1] [cse]: 1.291e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 2.52001e-06 [rewriter_after_jit_bprop_graph]: 8.54998e-06 [opt_after_jit_grad]: 0.00058525 [symbol_engine_optimizer]: 0.00010065, [1] [Cycle 1]: 9.298e-05, [6] [build]: 4.49002e-06 [elim_shapecalc]: 8.74e-06 [elim_not_effective]: 3.228e-05 [opt_reshape]: 6.14001e-06 [fold_const_symbol]: 1.049e-05 [renormalize]: 8.09989e-07 [validate]: 5.035e-05 Sums bootstrap : 0.000317s : 0.49% type_inference : 0.053279s : 82.66% event_method : 0.000022s : 0.03% auto_monad : 0.000070s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000180s : 0.28% rewriter_before_opt_a : 0.000087s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.002646s : 4.10% jit_opt_a.with_stream_mark : 0.000049s : 0.08% jit_opt_a.recompute_prepare : 0.000021s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000024s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.003163s : 4.91% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.05% jit_opt_a.cse : 0.000060s : 0.09% jit_opt_a.replace_applicator : 0.000029s : 0.04% py_interpret_to_execute_after_opt_a : 0.000022s : 0.03% rewriter_after_opt_a : 0.000048s : 0.07% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.002549s : 3.95% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000037s : 0.06% loop_unroll : 0.000511s : 0.79% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000585s : 0.91% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000032s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.08% Time group info: ------[substitution.] 0.000346 23 6.09% : 0.000021s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 3: substitution.graph_param_transform 80.52% : 0.000279s : 4: substitution.inline 1.89% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000006s : 4: substitution.remove_not_recompute_node 2.69% : 0.000009s : 2: substitution.replace_old_param 4.87% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053174 2 35.49% : 0.018872s : 1: type_inference.infer 64.51% : 0.034302s : 1: type_inference.specialize ------[replace.] 0.000098 6 66.96% : 0.000065s : 4: replace.inline 33.04% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 6 94.71% : 0.000276s : 4: match.inline 5.29% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 691 1.05% : 0.000002s : 10: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 10: predicate.addn_check_dump 1.14% : 0.000002s : 10: predicate.addn_zero_filter 2.61% : 0.000004s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.84% : 0.000001s : 3: predicate.check_bprop_eliminate 0.87% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000002s : 10: predicate.depend_value_elim 0.88% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 4.56% : 0.000007s : 10: predicate.dict_get_item_eliminator 1.03% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000002s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.54% : 0.000010s : 22: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.49% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000002s : 10: predicate.minmaximum_grad 2.49% : 0.000004s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 1.88% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000002s : 10: predicate.print_const_string_wrapper 2.56% : 0.000004s : 10: predicate.reduce_eliminate 2.07% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.58% : 0.000002s : 18: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.05% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 10: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.21% : 0.000005s : 16: predicate.switch_defer_inline 1.98% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.52% : 0.000010s : 53: predicate.switch_simplify 1.55% : 0.000002s : 10: predicate.tile_eliminate 1.06% : 0.000002s : 10: predicate.transpose_eliminate 1.20% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.89% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.32% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.34% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000926 13 36.57% : 0.000339s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.79% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.64% : 0.000525s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076318 72 0.08% : 0.000059s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.43% : 0.000331s : 1: bootstrap 0.05% : 0.000040s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 15.32% : 0.011694s : 1: jit_opt_a 0.24% : 0.000182s : 1: jit_opt_after_cconv 0.08% : 0.000064s : 1: jit_opt_b 0.68% : 0.000521s : 1: loop_unroll 3.36% : 0.002565s : 1: mutable_eliminate 3.82% : 0.002915s : 26: opt.transform.jit_opt_a 0.07% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000023s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000054s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000595s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000187s : 1: py_interpret_to_execute 0.03% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.13% : 0.000864s : 1: renormalize.infer 2.99% : 0.002286s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000053s : 1: rewriter_after_opt_a 0.12% : 0.000093s : 1: rewriter_before_opt_a 0.14% : 0.000104s : 1: symbol_engine_optimizer 69.85% : 0.053304s : 1: type_inference TotalTime = 0.174182, [30] [bootstrap]: 0.00041001 [type_inference]: 0.157121 [event_method]: 2.535e-05 [auto_monad]: 8.983e-05 [graph_reusing]: 7.18998e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 0.00043972 [rewriter_before_opt_a]: 0.00011148 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.0125845, [2] [Cycle 1]: 0.00407078, [27] [switch_simplify]: 7.546e-05 [loop_unroll]: 3.111e-05 [a_1]: 0.00070942 [with_stream_mark]: 2.657e-05 [recompute_prepare]: 1.1e-05 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.56999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.01999e-06 [updatestate_useless_node_eliminater]: 6.53998e-06 [accelerated_algorithm]: 7.22002e-06 [meta_shard_fg_expand]: 3.06999e-06 [get_grad_eliminate_]: 7.31001e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 1.244e-05 [meta_fg_expand]: 2.35997e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 5.99e-06 [renormalize]: 0.00279539 [add_forward_monad_depend]: 1.076e-05 [auto_monad_grad]: 3.55003e-06 [auto_monad_eliminator]: 2.488e-05 [cse]: 3.597e-05 [replace_applicator]: 2.508e-05 [Cycle 2]: 0.00040601, [27] [switch_simplify]: 7.18998e-06 [loop_unroll]: 6.22001e-06 [a_1]: 0.0001274 [with_stream_mark]: 1.655e-05 [recompute_prepare]: 6.22001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.70002e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 4.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.149e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 5.29e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 8.43999e-06 [cse]: 1.513e-05 [replace_applicator]: 6.61e-06 [py_interpret_to_execute_after_opt_a]: 1.774e-05 [rewriter_after_opt_a]: 4.396e-05 [convert_after_rewriter]: 8.20999e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00088963 [jit_opt_b]: 0.00010707, [1] [Cycle 1]: 9.497e-05, [2] [frontend_op_eliminate]: 5.579e-05 [inline_after_opt_a]: 2.225e-05 [cconv]: 4.516e-05 [loop_unroll]: 0.00065381 [jit_opt_after_cconv]: 0.00025185, [1] [Cycle 1]: 0.00024234, [11] [c_1]: 3.031e-05 [parameter_eliminate]: 6.88e-06 [updatestate_depend_eliminate]: 1.154e-05 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.95998e-06 [cse]: 4.736e-05 [call_graph_tuple_transform]: 3.062e-05 [tuple_list_get_item_eliminator]: 6.89999e-06 [none_parameter_eliminate]: 2.91999e-06 [renormalize]: 1.00999e-06 [switch_simplify]: 7.83999e-06 [remove_dup_value]: 2.012e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 1.343e-05 [add_recomputation]: 8.252e-05 [cse_after_recomputation]: 4.565e-05, [1] [Cycle 1]: 3.222e-05, [1] [cse]: 2.081e-05 [auto_monad_reorder]: 1.993e-05 [get_jit_bprop_graph]: 3.13998e-06 [rewriter_after_jit_bprop_graph]: 1.004e-05 [opt_after_jit_grad]: 0.00071235 [symbol_engine_optimizer]: 9.892e-05, [1] [Cycle 1]: 9.023e-05, [6] [build]: 6.55002e-06 [elim_shapecalc]: 1.227e-05 [elim_not_effective]: 2.159e-05 [opt_reshape]: 6.78998e-06 [fold_const_symbol]: 1.172e-05 [renormalize]: 1.07998e-06 [validate]: 6.71e-05 Sums bootstrap : 0.000410s : 0.25% type_inference : 0.157121s : 95.08% event_method : 0.000025s : 0.02% auto_monad : 0.000090s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000440s : 0.27% rewriter_before_opt_a : 0.000111s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000837s : 0.51% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002795s : 1.69% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000890s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000056s : 0.03% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000045s : 0.03% loop_unroll : 0.000654s : 0.40% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000083s : 0.05% cse_after_recomputation.cse : 0.000021s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000712s : 0.43% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000067s : 0.04% Time group info: ------[substitution.] 0.000311 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 1.16% : 0.000004s : 2: substitution.fold_const_symbol 2.45% : 0.000008s : 4: substitution.graph_param_transform 84.90% : 0.000264s : 4: substitution.inline 1.71% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.36% : 0.000007s : 2: substitution.replace_old_param 4.73% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.156987 2 98.48% : 0.154593s : 1: type_inference.infer 1.52% : 0.002394s : 1: type_inference.specialize ------[replace.] 0.000088 6 69.81% : 0.000061s : 4: replace.inline 30.19% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 6 95.06% : 0.000261s : 4: match.inline 4.94% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.15% : 0.000002s : 12: predicate.accumulaten_eliminater 1.71% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.69% : 0.000002s : 12: predicate.arithmetic_simplify 1.12% : 0.000002s : 12: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 0.91% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.99% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.05% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.76% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.68% : 0.000001s : 4: predicate.elim_not_effective 0.82% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_depend_swap 1.44% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.19% : 0.000009s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.77% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 18: predicate.load_eliminater 2.52% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.35% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 12: predicate.merge_addn 0.93% : 0.000001s : 12: predicate.minmaximum_grad 2.82% : 0.000004s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 18: predicate.partial_eliminate 1.04% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000003s : 12: predicate.reduce_eliminate 1.19% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.97% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.08% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.06% : 0.000002s : 4: predicate.row_tensor_eliminate 1.06% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.03% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.05% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.35% : 0.000002s : 12: predicate.transpose_eliminate 1.21% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.78% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.35% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002650 26 71.93% : 0.001906s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.43% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.64% : 0.000679s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178213 72 0.05% : 0.000090s : 1: add_recomputation 0.05% : 0.000096s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.24% : 0.000434s : 1: bootstrap 0.03% : 0.000050s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000048s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.06% : 0.012588s : 1: jit_opt_a 0.14% : 0.000256s : 1: jit_opt_after_cconv 0.06% : 0.000111s : 1: jit_opt_b 0.38% : 0.000674s : 1: loop_unroll 0.51% : 0.000909s : 1: mutable_eliminate 0.63% : 0.001114s : 26: opt.transform.jit_opt_a 0.04% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000070s : 4: opt.transform.jit_opt_b 0.01% : 0.000025s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000027s : 1: opt.transform.mutable_eliminate 0.02% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000728s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000451s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.08% : 0.001933s : 1: renormalize.infer 0.48% : 0.000850s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.07% : 0.000120s : 1: rewriter_before_opt_a 0.06% : 0.000102s : 1: symbol_engine_optimizer 88.18% : 0.157154s : 1: type_inference TotalTime = 0.0334456, [30] [bootstrap]: 0.00036812 [type_inference]: 0.0249169 [event_method]: 2.111e-05 [auto_monad]: 7.051e-05 [graph_reusing]: 6.49999e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00010788 [rewriter_before_opt_a]: 8.391e-05 [expand_dump_flag]: 3.32997e-06 [jit_opt_a]: 0.00567992, [2] [Cycle 1]: 0.00194822, [27] [switch_simplify]: 5.673e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00055845 [with_stream_mark]: 2.357e-05 [recompute_prepare]: 8.76002e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00092624 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.651e-05 [cse]: 3.763e-05 [replace_applicator]: 1.408e-05 [Cycle 2]: 0.00032046, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 5.40999e-06 [a_1]: 8.957e-05 [with_stream_mark]: 9.49999e-06 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.56002e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.293e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.28999e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.329e-05 [replace_applicator]: 5.14998e-06 [py_interpret_to_execute_after_opt_a]: 1.323e-05 [rewriter_after_opt_a]: 3.759e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00054093 [jit_opt_b]: 4.994e-05, [1] [Cycle 1]: 4.325e-05, [2] [frontend_op_eliminate]: 1.624e-05 [inline_after_opt_a]: 1.642e-05 [cconv]: 2.644e-05 [loop_unroll]: 0.00041419 [jit_opt_after_cconv]: 0.00014292, [1] [Cycle 1]: 0.0001361, [11] [c_1]: 2.062e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.286e-05 [call_graph_tuple_transform]: 1.841e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 2.891e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 5.98002e-06 [add_recomputation]: 5.414e-05 [cse_after_recomputation]: 2.522e-05, [1] [Cycle 1]: 1.88e-05, [1] [cse]: 1.288e-05 [auto_monad_reorder]: 1.768e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00050279 [symbol_engine_optimizer]: 7.742e-05, [1] [Cycle 1]: 7.021e-05, [6] [build]: 3.80998e-06 [elim_shapecalc]: 7.88999e-06 [elim_not_effective]: 1.415e-05 [opt_reshape]: 5.84999e-06 [fold_const_symbol]: 9.91998e-06 [renormalize]: 3.50003e-07 [validate]: 4.264e-05 Sums bootstrap : 0.000368s : 1.25% type_inference : 0.024917s : 84.63% event_method : 0.000021s : 0.07% auto_monad : 0.000071s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000108s : 0.37% rewriter_before_opt_a : 0.000084s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.21% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000648s : 2.20% jit_opt_a.with_stream_mark : 0.000033s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000926s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000051s : 0.17% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000038s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000541s : 1.84% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.09% loop_unroll : 0.000414s : 1.41% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000029s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.18% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000503s : 1.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.14% Time group info: ------[substitution.] 0.000229 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.17% : 0.000005s : 3: substitution.graph_param_transform 85.08% : 0.000195s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000004s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024833 2 93.75% : 0.023282s : 1: type_inference.infer 6.25% : 0.001551s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.60% : 0.000048s : 4: replace.inline 31.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.40% : 0.000192s : 4: match.inline 5.60% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.25% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.68% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000925 13 50.42% : 0.000466s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.75% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.83% : 0.000405s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035291 72 0.16% : 0.000057s : 1: add_recomputation 0.21% : 0.000074s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.09% : 0.000383s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 16.10% : 0.005683s : 1: jit_opt_a 0.41% : 0.000146s : 1: jit_opt_after_cconv 0.15% : 0.000053s : 1: jit_opt_b 1.20% : 0.000422s : 1: loop_unroll 1.56% : 0.000550s : 1: mutable_eliminate 2.46% : 0.000867s : 26: opt.transform.jit_opt_a 0.13% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000514s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000112s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000032s : 1: remove_dup_value 1.51% : 0.000532s : 1: renormalize.infer 1.09% : 0.000386s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000040s : 1: rewriter_after_opt_a 0.25% : 0.000088s : 1: rewriter_before_opt_a 0.23% : 0.000080s : 1: symbol_engine_optimizer 70.67% : 0.024939s : 1: type_inference TotalTime = 0.51323, [30] [bootstrap]: 0.00030676 [type_inference]: 0.261893 [event_method]: 0.00012175 [auto_monad]: 0.00012215 [graph_reusing]: 9.10001e-06 [pre_auto_parallel]: 3.48999e-06 [py_interpret_to_execute]: 4.696e-05 [rewriter_before_opt_a]: 0.00014675 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.247956, [2] [Cycle 1]: 0.242889, [27] [switch_simplify]: 0.00017189 [loop_unroll]: 5.428e-05 [a_1]: 0.0012485 [with_stream_mark]: 1.884e-05 [recompute_prepare]: 8.52e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.240962 [add_forward_monad_depend]: 1.177e-05 [auto_monad_grad]: 2.58998e-06 [auto_monad_eliminator]: 2.101e-05 [cse]: 4.428e-05 [replace_applicator]: 2.832e-05 [Cycle 2]: 0.00042218, [27] [switch_simplify]: 8.18001e-06 [loop_unroll]: 7.16001e-06 [a_1]: 0.00012928 [with_stream_mark]: 2.034e-05 [recompute_prepare]: 6.19999e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.60002e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 4.77998e-06 [cell_reuse_recompute_pass]: 4.68999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.032e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 3.6e-06 [replace_old_param]: 9.98998e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.435e-05 [replace_applicator]: 5.73002e-06 [py_interpret_to_execute_after_opt_a]: 1.702e-05 [rewriter_after_opt_a]: 5.082e-05 [convert_after_rewriter]: 8.32e-06 [order_py_execute_after_rewriter]: 5.81e-06 [mutable_eliminate]: 0.0009304 [jit_opt_b]: 5.769e-05, [1] [Cycle 1]: 5.005e-05, [2] [frontend_op_eliminate]: 2.013e-05 [inline_after_opt_a]: 1.793e-05 [cconv]: 2.8e-05 [loop_unroll]: 0.00041903 [jit_opt_after_cconv]: 0.00015418, [1] [Cycle 1]: 0.00014783, [11] [c_1]: 2.294e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.458e-05 [call_graph_tuple_transform]: 2.029e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 7.01001e-06 [remove_dup_value]: 4.442e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 6.055e-05 [cse_after_recomputation]: 2.425e-05, [1] [Cycle 1]: 1.813e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.812e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.65999e-06 [opt_after_jit_grad]: 0.00045424 [symbol_engine_optimizer]: 9.825e-05, [1] [Cycle 1]: 9.159e-05, [6] [build]: 3.96001e-06 [elim_shapecalc]: 2.549e-05 [elim_not_effective]: 1.428e-05 [opt_reshape]: 6.83e-06 [fold_const_symbol]: 9.62999e-06 [renormalize]: 7.00005e-07 [validate]: 4.319e-05 Sums bootstrap : 0.000307s : 0.06% type_inference : 0.261893s : 51.56% event_method : 0.000122s : 0.02% auto_monad : 0.000122s : 0.02% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000047s : 0.01% rewriter_before_opt_a : 0.000147s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000180s : 0.04% jit_opt_a.loop_unroll : 0.000061s : 0.01% jit_opt_a.a_1 : 0.001378s : 0.27% jit_opt_a.with_stream_mark : 0.000039s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.240962s : 47.44% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000059s : 0.01% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000051s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000930s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000028s : 0.01% loop_unroll : 0.000419s : 0.08% jit_opt_after_cconv.c_1 : 0.000023s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000044s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000061s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000454s : 0.09% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000025s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.01% Time group info: ------[substitution.] 0.000486 33 0.43% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000002s : 2: substitution.fold_const_symbol 1.28% : 0.000006s : 3: substitution.graph_param_transform 89.23% : 0.000434s : 11: substitution.inline 0.88% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.28% : 0.000006s : 4: substitution.remove_not_recompute_node 1.20% : 0.000006s : 2: substitution.replace_old_param 2.27% : 0.000011s : 2: substitution.switch_simplify 3.06% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.261766 2 98.99% : 0.259132s : 1: type_inference.infer 1.01% : 0.002634s : 1: type_inference.specialize ------[replace.] 0.000277 16 52.29% : 0.000145s : 11: replace.inline 17.87% : 0.000050s : 2: replace.switch_simplify 29.84% : 0.000083s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000451 16 94.89% : 0.000428s : 11: match.inline 2.18% : 0.000010s : 2: match.switch_simplify 2.93% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000206 1148 1.54% : 0.000003s : 18: predicate.accumulaten_eliminater 0.67% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.38% : 0.000003s : 18: predicate.addn_check_dump 1.76% : 0.000004s : 18: predicate.addn_zero_filter 2.25% : 0.000005s : 18: predicate.arithmetic_simplify 1.55% : 0.000003s : 18: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000002s : 18: predicate.compare_switch_simplify 1.30% : 0.000003s : 18: predicate.depend_value_elim 1.14% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.44% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.49% : 0.000003s : 18: predicate.dict_set_item_eliminator 0.48% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.20% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.34% : 0.000003s : 18: predicate.environ_get_add_eliminate 1.38% : 0.000003s : 18: predicate.environ_get_depend_swap 1.66% : 0.000003s : 18: predicate.environ_get_eliminate 1.36% : 0.000003s : 18: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000011s : 38: predicate.inline 0.53% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000002s : 6: predicate.less_batch_normalization 1.95% : 0.000004s : 21: predicate.list_to_tuple_eliminator_ 1.61% : 0.000003s : 24: predicate.load_eliminater 0.67% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.78% : 0.000010s : 64: predicate.loop_unroll_before_grad 1.98% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.24% : 0.000003s : 18: predicate.merge_addn 1.13% : 0.000002s : 18: predicate.minmaximum_grad 1.00% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000004s : 24: predicate.partial_eliminate 1.40% : 0.000003s : 18: predicate.print_const_string_wrapper 2.48% : 0.000005s : 18: predicate.reduce_eliminate 1.76% : 0.000004s : 21: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000003s : 27: predicate.replace_applicator 0.31% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.47% : 0.000003s : 18: predicate.reshape_eliminate 1.46% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.53% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000003s : 18: predicate.same_eliminate 0.32% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000002s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.21% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.74% : 0.000006s : 32: predicate.switch_defer_inline 2.57% : 0.000005s : 32: predicate.switch_layer_defer_inline 7.99% : 0.000016s : 103: predicate.switch_simplify 1.23% : 0.000003s : 18: predicate.tile_eliminate 1.43% : 0.000003s : 18: predicate.transpose_eliminate 1.77% : 0.000004s : 18: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.83% : 0.000004s : 18: predicate.tuple_list_set_item_eliminator 1.54% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.41% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.89% : 0.000004s : 18: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002428 28 51.28% : 0.001245s : 9: func_graph_cloner_run.FuncGraphClonerGraph 9.21% : 0.000224s : 6: func_graph_cloner_run.FuncGraphClonerNode 39.51% : 0.000959s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.756007 72 0.01% : 0.000063s : 1: add_recomputation 0.02% : 0.000128s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.04% : 0.000324s : 1: bootstrap 0.00% : 0.000031s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.00% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.02% : 0.000128s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000012s : 1: graph_reusing 32.80% : 0.247962s : 1: jit_opt_a 0.02% : 0.000157s : 1: jit_opt_after_cconv 0.01% : 0.000060s : 1: jit_opt_b 0.06% : 0.000426s : 1: loop_unroll 0.12% : 0.000938s : 1: mutable_eliminate 0.23% : 0.001766s : 26: opt.transform.jit_opt_a 0.01% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000030s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000017s : 1: opt.transform.mutable_eliminate 0.00% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.00% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.06% : 0.000461s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.01% : 0.000050s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000048s : 1: remove_dup_value 31.77% : 0.240194s : 1: renormalize.infer 0.10% : 0.000752s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000054s : 1: rewriter_after_opt_a 0.02% : 0.000150s : 1: rewriter_before_opt_a 0.01% : 0.000101s : 1: symbol_engine_optimizer 34.64% : 0.261915s : 1: type_inference TotalTime = 0.169517, [30] [bootstrap]: 0.00058174 [type_inference]: 0.151822 [event_method]: 2.7e-05 [auto_monad]: 8.664e-05 [graph_reusing]: 6.46999e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00060654 [rewriter_before_opt_a]: 0.00011245 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.0137353, [2] [Cycle 1]: 0.00901619, [27] [switch_simplify]: 7.289e-05 [loop_unroll]: 3.38e-05 [a_1]: 0.00187103 [with_stream_mark]: 3.01e-05 [recompute_prepare]: 1.063e-05 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 8.42998e-06 [updatestate_useless_node_eliminater]: 6.73e-06 [accelerated_algorithm]: 8.59e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 8.1e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 3.28e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.77e-05 [j_node_and_user_rematch]: 1.479e-05 [meta_fg_expand]: 3.94002e-06 [replace_old_param]: 1.286e-05 [inline_without_move]: 7e-06 [renormalize]: 0.00655451 [add_forward_monad_depend]: 1.189e-05 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 2.021e-05 [cse]: 3.352e-05 [replace_applicator]: 2.419e-05 [Cycle 2]: 0.00042196, [27] [switch_simplify]: 8.35001e-06 [loop_unroll]: 7.11001e-06 [a_1]: 0.00014889 [with_stream_mark]: 1.599e-05 [recompute_prepare]: 6.37001e-06 [updatestate_depend_eliminate]: 3.87998e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 7.3e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 3.73001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 6.03002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.18002e-06 [cse]: 1.347e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.565e-05 [rewriter_after_opt_a]: 3.845e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00079146 [jit_opt_b]: 6.638e-05, [1] [Cycle 1]: 5.896e-05, [2] [frontend_op_eliminate]: 2.837e-05 [inline_after_opt_a]: 1.892e-05 [cconv]: 2.73e-05 [loop_unroll]: 0.000422 [jit_opt_after_cconv]: 0.00015762, [1] [Cycle 1]: 0.00015071, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.404e-05 [call_graph_tuple_transform]: 2.055e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 7.1e-06 [remove_dup_value]: 1.718e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 8.29002e-06 [add_recomputation]: 5.115e-05 [cse_after_recomputation]: 2.392e-05, [1] [Cycle 1]: 1.856e-05, [1] [cse]: 1.2e-05 [auto_monad_reorder]: 1.726e-05 [get_jit_bprop_graph]: 2.70002e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.00047532 [symbol_engine_optimizer]: 0.00012354, [1] [Cycle 1]: 0.00011694, [6] [build]: 3.23998e-06 [elim_shapecalc]: 8.40001e-06 [elim_not_effective]: 1.296e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 5.484e-05 [renormalize]: 3.89991e-07 [validate]: 4.718e-05 Sums bootstrap : 0.000582s : 0.35% type_inference : 0.151822s : 92.29% event_method : 0.000027s : 0.02% auto_monad : 0.000087s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000607s : 0.37% rewriter_before_opt_a : 0.000112s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.002020s : 1.23% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.006555s : 3.98% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000047s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000791s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000422s : 0.26% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000475s : 0.29% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000055s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.03% Time group info: ------[substitution.] 0.000409 28 0.41% : 0.000002s : 2: substitution.elim_not_effective 11.38% : 0.000047s : 2: substitution.fold_const_symbol 1.32% : 0.000005s : 4: substitution.graph_param_transform 74.31% : 0.000304s : 5: substitution.inline 1.30% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.93% : 0.000016s : 3: substitution.reduce_eliminate 1.56% : 0.000006s : 4: substitution.remove_not_recompute_node 1.76% : 0.000007s : 2: substitution.replace_old_param 4.03% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151695 2 96.45% : 0.146311s : 1: type_inference.infer 3.55% : 0.005384s : 1: type_inference.specialize ------[replace.] 0.001158 7 7.15% : 0.000083s : 5: replace.inline 92.85% : 0.001075s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000315 7 95.31% : 0.000301s : 5: match.inline 4.69% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 0.71% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 1.78% : 0.000003s : 13: predicate.arithmetic_simplify 1.79% : 0.000003s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.30% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000008s : 28: predicate.inline 1.01% : 0.000002s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.52% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000004s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 2.95% : 0.000005s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.98% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.48% : 0.000005s : 20: predicate.switch_defer_inline 1.91% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.22% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.50% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003616 25 56.25% : 0.002034s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.70% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.05% : 0.001484s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178483 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000091s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.34% : 0.000613s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.70% : 0.013739s : 1: jit_opt_a 0.09% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.24% : 0.000430s : 1: loop_unroll 0.45% : 0.000802s : 1: mutable_eliminate 1.29% : 0.002305s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000080s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000483s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000615s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.89% : 0.005159s : 1: renormalize.infer 0.77% : 0.001379s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000117s : 1: rewriter_before_opt_a 0.07% : 0.000126s : 1: symbol_engine_optimizer 85.08% : 0.151856s : 1: type_inference TotalTime = 0.0282537, [30] [bootstrap]: 0.00036839 [type_inference]: 0.00652406 [event_method]: 2.086e-05 [auto_monad]: 7.189e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 5.222e-05 [rewriter_before_opt_a]: 8.111e-05 [expand_dump_flag]: 2.94001e-06 [jit_opt_a]: 0.0182751, [2] [Cycle 1]: 0.00222608, [27] [switch_simplify]: 7.135e-05 [loop_unroll]: 3.147e-05 [a_1]: 0.00070172 [with_stream_mark]: 2.542e-05 [recompute_prepare]: 1.056e-05 [updatestate_depend_eliminate]: 4.82998e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 2.65002e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 4.52998e-06 [cell_reuse_recompute_pass]: 1.89999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [j_node_and_user_rematch]: 1.154e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.163e-05 [inline_without_move]: 5.54998e-06 [renormalize]: 0.00100156 [add_forward_monad_depend]: 6.84999e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.899e-05 [cse]: 3.107e-05 [replace_applicator]: 1.742e-05 [Cycle 2]: 0.00035384, [27] [switch_simplify]: 6.04001e-06 [loop_unroll]: 4.80001e-06 [a_1]: 9.257e-05 [with_stream_mark]: 1.256e-05 [recompute_prepare]: 6.38998e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 4.84998e-06 [meta_shard_fg_expand]: 1.81998e-06 [get_grad_eliminate_]: 4.84998e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.655e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 1.24998e-06 [auto_monad_eliminator]: 9.54e-06 [cse]: 1.466e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.534e-05 [rewriter_after_opt_a]: 4.247e-05 [convert_after_rewriter]: 1.004e-05 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00078129 [jit_opt_b]: 5.664e-05, [1] [Cycle 1]: 4.787e-05, [2] [frontend_op_eliminate]: 1.736e-05 [inline_after_opt_a]: 1.811e-05 [cconv]: 3.689e-05 [loop_unroll]: 0.00055131 [jit_opt_after_cconv]: 0.0001809, [1] [Cycle 1]: 0.0001733, [11] [c_1]: 2.576e-05 [parameter_eliminate]: 4.94e-06 [updatestate_depend_eliminate]: 8.69e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 3.165e-05 [call_graph_tuple_transform]: 2.647e-05 [tuple_list_get_item_eliminator]: 6.92002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.79001e-06 [remove_dup_value]: 1.681e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 3.232e-05 [add_recomputation]: 6.238e-05 [cse_after_recomputation]: 2.758e-05, [1] [Cycle 1]: 2.079e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.64001e-06 [rewriter_after_jit_bprop_graph]: 8.20999e-06 [opt_after_jit_grad]: 0.00064476 [symbol_engine_optimizer]: 8.396e-05, [1] [Cycle 1]: 7.578e-05, [6] [build]: 4.42e-06 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 1.683e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 9.48002e-06 [renormalize]: 9.39996e-07 [validate]: 4.87e-05 Sums bootstrap : 0.000368s : 3.10% type_inference : 0.006524s : 54.95% event_method : 0.000021s : 0.18% auto_monad : 0.000072s : 0.61% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000052s : 0.44% rewriter_before_opt_a : 0.000081s : 0.68% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.31% jit_opt_a.a_1 : 0.000794s : 6.69% jit_opt_a.with_stream_mark : 0.000038s : 0.32% jit_opt_a.recompute_prepare : 0.000017s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001002s : 8.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.24% jit_opt_a.cse : 0.000046s : 0.39% jit_opt_a.replace_applicator : 0.000023s : 0.20% py_interpret_to_execute_after_opt_a : 0.000015s : 0.13% rewriter_after_opt_a : 0.000042s : 0.36% convert_after_rewriter : 0.000010s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000781s : 6.58% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.15% cconv : 0.000037s : 0.31% loop_unroll : 0.000551s : 4.64% jit_opt_after_cconv.c_1 : 0.000026s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.06% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000032s : 0.27% add_recomputation : 0.000062s : 0.53% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.07% opt_after_jit_grad : 0.000645s : 5.43% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000049s : 0.41% Time group info: ------[substitution.] 0.000332 23 0.81% : 0.000003s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000007s : 3: substitution.graph_param_transform 86.65% : 0.000287s : 4: substitution.inline 1.65% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000006s : 4: substitution.remove_not_recompute_node 2.06% : 0.000007s : 2: substitution.replace_old_param 4.63% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006432 2 81.95% : 0.005271s : 1: type_inference.infer 18.05% : 0.001161s : 1: type_inference.specialize ------[replace.] 0.000089 6 67.67% : 0.000061s : 4: replace.inline 32.33% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000299 6 95.31% : 0.000285s : 4: match.inline 4.69% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.64% : 0.000002s : 10: predicate.accumulaten_eliminater 1.89% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.10% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 0.92% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000002s : 10: predicate.depend_value_elim 0.95% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.57% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.99% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 7.00% : 0.000009s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 6: predicate.less_batch_normalization 1.15% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 15: predicate.load_eliminater 2.35% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.65% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.75% : 0.000002s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 2.92% : 0.000004s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.20% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.71% : 0.000002s : 10: predicate.reshape_eliminate 1.07% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.50% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 1.16% : 0.000002s : 6: predicate.set_cell_output_no_recompute 1.27% : 0.000002s : 6: predicate.special_op_eliminate 1.40% : 0.000002s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.01% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.71% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 16: predicate.switch_defer_inline 1.89% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.41% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000869 13 44.52% : 0.000387s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.14% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.34% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030368 72 0.22% : 0.000066s : 1: add_recomputation 0.25% : 0.000076s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.29% : 0.000392s : 1: bootstrap 0.13% : 0.000040s : 1: cconv 0.04% : 0.000012s : 1: convert_after_rewriter 0.10% : 0.000031s : 1: cse_after_recomputation 0.12% : 0.000035s : 1: environ_conv 0.09% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 60.19% : 0.018279s : 1: jit_opt_a 0.61% : 0.000184s : 1: jit_opt_after_cconv 0.20% : 0.000059s : 1: jit_opt_b 1.86% : 0.000564s : 1: loop_unroll 2.62% : 0.000794s : 1: mutable_eliminate 3.44% : 0.001043s : 26: opt.transform.jit_opt_a 0.20% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000021s : 1: opt.transform.mutable_eliminate 0.09% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.17% : 0.000658s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000055s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.81% : 0.000550s : 1: renormalize.infer 1.46% : 0.000442s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000046s : 1: rewriter_after_opt_a 0.28% : 0.000084s : 1: rewriter_before_opt_a 0.29% : 0.000087s : 1: symbol_engine_optimizer 21.55% : 0.006545s : 1: type_inference TotalTime = 0.0425179, [30] [bootstrap]: 0.00034016 [type_inference]: 0.0300896 [event_method]: 2.084e-05 [auto_monad]: 6.682e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 4.888e-05 [rewriter_before_opt_a]: 0.00023378 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.00782124, [2] [Cycle 1]: 0.00223351, [27] [switch_simplify]: 6.612e-05 [loop_unroll]: 3.312e-05 [a_1]: 0.0006339 [with_stream_mark]: 2.315e-05 [recompute_prepare]: 1.021e-05 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.36998e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 6.60997e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 1.117e-05 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00109118 [add_forward_monad_depend]: 8.03999e-06 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 1.75e-05 [cse]: 2.367e-05 [replace_applicator]: 1.629e-05 [Cycle 2]: 0.00035657, [27] [switch_simplify]: 7.9e-06 [loop_unroll]: 5.37999e-06 [a_1]: 9.161e-05 [with_stream_mark]: 1.403e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.98998e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.315e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 8.93002e-06 [inline_without_move]: 5.09e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.71002e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 7.14001e-06 [cse]: 1.767e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 1.992e-05 [rewriter_after_opt_a]: 4.041e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00156789 [jit_opt_b]: 7.032e-05, [1] [Cycle 1]: 5.284e-05, [2] [frontend_op_eliminate]: 2.04e-05 [inline_after_opt_a]: 1.896e-05 [cconv]: 3.286e-05 [loop_unroll]: 0.00065789 [jit_opt_after_cconv]: 0.00019686, [1] [Cycle 1]: 0.00018784, [11] [c_1]: 2.482e-05 [parameter_eliminate]: 4.97e-06 [updatestate_depend_eliminate]: 8.61002e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.83001e-06 [cse]: 4.105e-05 [call_graph_tuple_transform]: 2.331e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 1.12e-06 [switch_simplify]: 7.59002e-06 [remove_dup_value]: 2.082e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 1.068e-05 [add_recomputation]: 5.236e-05 [cse_after_recomputation]: 3.159e-05, [1] [Cycle 1]: 2.43e-05, [1] [cse]: 1.531e-05 [auto_monad_reorder]: 2.095e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 8.2e-06 [opt_after_jit_grad]: 0.00071338 [symbol_engine_optimizer]: 0.00014595, [1] [Cycle 1]: 0.00013769, [6] [build]: 1.421e-05 [elim_shapecalc]: 9.95002e-06 [elim_not_effective]: 5.773e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 9.48997e-06 [renormalize]: 1.04e-06 [validate]: 6.359e-05 Sums bootstrap : 0.000340s : 0.93% type_inference : 0.030090s : 82.27% event_method : 0.000021s : 0.06% auto_monad : 0.000067s : 0.18% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000049s : 0.13% rewriter_before_opt_a : 0.000234s : 0.64% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.20% jit_opt_a.loop_unroll : 0.000039s : 0.11% jit_opt_a.a_1 : 0.000726s : 1.98% jit_opt_a.with_stream_mark : 0.000037s : 0.10% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001091s : 2.98% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.07% jit_opt_a.cse : 0.000041s : 0.11% jit_opt_a.replace_applicator : 0.000023s : 0.06% py_interpret_to_execute_after_opt_a : 0.000020s : 0.05% rewriter_after_opt_a : 0.000040s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001568s : 4.29% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000019s : 0.05% cconv : 0.000033s : 0.09% loop_unroll : 0.000658s : 1.80% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000041s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.02% remove_dup_value : 0.000021s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000011s : 0.03% add_recomputation : 0.000052s : 0.14% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000021s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000713s : 1.95% symbol_engine_optimizer.build : 0.000014s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000058s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000064s : 0.17% Time group info: ------[substitution.] 0.000272 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.39% : 0.000007s : 3: substitution.graph_param_transform 84.95% : 0.000231s : 4: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.57% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.030007 2 95.63% : 0.028694s : 1: type_inference.infer 4.37% : 0.001313s : 1: type_inference.specialize ------[replace.] 0.000091 6 66.81% : 0.000061s : 4: replace.inline 33.19% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 94.63% : 0.000229s : 4: match.inline 5.37% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.84% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.08% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.05% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.62% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 6.27% : 0.000008s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.39% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.29% : 0.000003s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.79% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.23% : 0.000002s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000010s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.70% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.53% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000893 13 50.47% : 0.000451s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.09% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.44% : 0.000388s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044644 72 0.12% : 0.000056s : 1: add_recomputation 0.16% : 0.000070s : 1: auto_monad 0.05% : 0.000024s : 1: auto_monad_reorder 0.80% : 0.000355s : 1: bootstrap 0.08% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000034s : 1: cse_after_recomputation 0.03% : 0.000013s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.53% : 0.007825s : 1: jit_opt_a 0.45% : 0.000200s : 1: jit_opt_after_cconv 0.17% : 0.000074s : 1: jit_opt_b 1.50% : 0.000670s : 1: loop_unroll 3.55% : 0.001583s : 1: mutable_eliminate 2.17% : 0.000969s : 26: opt.transform.jit_opt_a 0.13% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000032s : 4: opt.transform.jit_opt_b 0.04% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000023s : 1: opt.transform.mutable_eliminate 0.07% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.63% : 0.000727s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000052s : 1: py_interpret_to_execute 0.05% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000024s : 1: remove_dup_value 1.34% : 0.000599s : 1: renormalize.infer 1.08% : 0.000484s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000044s : 1: rewriter_after_opt_a 0.54% : 0.000240s : 1: rewriter_before_opt_a 0.33% : 0.000149s : 1: symbol_engine_optimizer 67.44% : 0.030108s : 1: type_inference TotalTime = 0.183517, [30] [bootstrap]: 0.00040737 [type_inference]: 0.156854 [event_method]: 2.2e-05 [auto_monad]: 8.786e-05 [graph_reusing]: 6.99001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00052973 [rewriter_before_opt_a]: 0.00010411 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.0226357, [2] [Cycle 1]: 0.0182795, [27] [switch_simplify]: 6.938e-05 [loop_unroll]: 3.519e-05 [a_1]: 0.00073798 [with_stream_mark]: 1.993e-05 [recompute_prepare]: 1.1e-05 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 6.43003e-06 [accelerated_algorithm]: 7.21001e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.19997e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.888e-05 [j_node_and_user_rematch]: 1.124e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 7.03998e-06 [renormalize]: 0.0169436 [add_forward_monad_depend]: 1.147e-05 [auto_monad_grad]: 3.3e-06 [auto_monad_eliminator]: 2.204e-05 [cse]: 4.356e-05 [replace_applicator]: 2.744e-05 [Cycle 2]: 0.0004361, [27] [switch_simplify]: 8.44998e-06 [loop_unroll]: 7.16999e-06 [a_1]: 0.00013 [with_stream_mark]: 1.813e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.52002e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 3.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.084e-05 [j_node_and_user_rematch]: 1.052e-05 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 1.086e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.13002e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 8.59002e-06 [cse]: 1.936e-05 [replace_applicator]: 8.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.711e-05 [rewriter_after_opt_a]: 5.727e-05 [convert_after_rewriter]: 7.66001e-06 [order_py_execute_after_rewriter]: 5.92001e-06 [mutable_eliminate]: 0.00083908 [jit_opt_b]: 7.228e-05, [1] [Cycle 1]: 6.336e-05, [2] [frontend_op_eliminate]: 2.805e-05 [inline_after_opt_a]: 2.125e-05 [cconv]: 3.489e-05 [loop_unroll]: 0.0005136 [jit_opt_after_cconv]: 0.00018129, [1] [Cycle 1]: 0.00017376, [11] [c_1]: 2.712e-05 [parameter_eliminate]: 3.81999e-06 [updatestate_depend_eliminate]: 8.77e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.53998e-06 [cse]: 3.249e-05 [call_graph_tuple_transform]: 2.522e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.93e-06 [remove_dup_value]: 2.169e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 1.09e-05 [add_recomputation]: 6.769e-05 [cse_after_recomputation]: 3.136e-05, [1] [Cycle 1]: 2.405e-05, [1] [cse]: 1.57e-05 [auto_monad_reorder]: 2.011e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 6.29999e-06 [opt_after_jit_grad]: 0.00055705 [symbol_engine_optimizer]: 0.00014517, [1] [Cycle 1]: 0.00013753, [6] [build]: 4.03999e-06 [elim_shapecalc]: 9.79e-06 [elim_not_effective]: 1.608e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 6.828e-05 [renormalize]: 8.79983e-07 [validate]: 6.506e-05 Sums bootstrap : 0.000407s : 0.23% type_inference : 0.156854s : 87.69% event_method : 0.000022s : 0.01% auto_monad : 0.000088s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000530s : 0.30% rewriter_before_opt_a : 0.000104s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000868s : 0.49% jit_opt_a.with_stream_mark : 0.000038s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.016944s : 9.47% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000006s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000063s : 0.04% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000057s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000839s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000514s : 0.29% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000068s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000557s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000068s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000065s : 0.04% Time group info: ------[substitution.] 0.000338 25 0.55% : 0.000002s : 2: substitution.elim_not_effective 17.35% : 0.000059s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 4: substitution.graph_param_transform 70.73% : 0.000239s : 5: substitution.inline 1.46% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000006s : 4: substitution.remove_not_recompute_node 2.01% : 0.000007s : 2: substitution.replace_old_param 3.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.156759 2 97.83% : 0.153358s : 1: type_inference.infer 2.17% : 0.003400s : 1: type_inference.specialize ------[replace.] 0.000109 7 68.14% : 0.000074s : 5: replace.inline 31.86% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 7 95.29% : 0.000236s : 5: match.inline 4.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.51% : 0.000002s : 13: predicate.addn_zero_filter 1.70% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.30% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.67% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.26% : 0.000002s : 13: predicate.minmaximum_grad 1.79% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.05% : 0.000002s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.94% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.53% : 0.000011s : 64: predicate.switch_simplify 1.13% : 0.000002s : 13: predicate.tile_eliminate 1.36% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.78% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002933 25 66.55% : 0.001952s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.97% : 0.000909s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.201743 72 0.04% : 0.000071s : 1: add_recomputation 0.05% : 0.000093s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.21% : 0.000427s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.22% : 0.022639s : 1: jit_opt_a 0.09% : 0.000184s : 1: jit_opt_after_cconv 0.04% : 0.000075s : 1: jit_opt_b 0.26% : 0.000525s : 1: loop_unroll 0.42% : 0.000851s : 1: mutable_eliminate 0.57% : 0.001155s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000098s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000568s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000535s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 7.93% : 0.015992s : 1: renormalize.infer 0.47% : 0.000938s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000062s : 1: rewriter_after_opt_a 0.05% : 0.000108s : 1: rewriter_before_opt_a 0.07% : 0.000148s : 1: symbol_engine_optimizer 77.76% : 0.156867s : 1: type_inference TotalTime = 0.143239, [30] [bootstrap]: 0.00038729 [type_inference]: 0.132747 [event_method]: 2.14e-05 [auto_monad]: 7.594e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.26998e-06 [py_interpret_to_execute]: 0.00013236 [rewriter_before_opt_a]: 8.477e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00628127, [2] [Cycle 1]: 0.00215795, [27] [switch_simplify]: 5.585e-05 [loop_unroll]: 2.982e-05 [a_1]: 0.00052673 [with_stream_mark]: 2.067e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.71998e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 9.74999e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.92001e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00114659 [add_forward_monad_depend]: 8.33001e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.219e-05 [cse]: 4.291e-05 [replace_applicator]: 1.952e-05 [Cycle 2]: 0.00040355, [27] [switch_simplify]: 6.45002e-06 [loop_unroll]: 5.78002e-06 [a_1]: 0.00010352 [with_stream_mark]: 1.781e-05 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.06002e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 2.96001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.123e-05 [j_node_and_user_rematch]: 9.90002e-06 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 5.19e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.96e-06 [auto_monad_grad]: 1.62001e-06 [auto_monad_eliminator]: 1.113e-05 [cse]: 1.871e-05 [replace_applicator]: 8.09002e-06 [py_interpret_to_execute_after_opt_a]: 2.009e-05 [rewriter_after_opt_a]: 5.501e-05 [convert_after_rewriter]: 8.63001e-06 [order_py_execute_after_rewriter]: 6.09001e-06 [mutable_eliminate]: 0.00109311 [jit_opt_b]: 6.936e-05, [1] [Cycle 1]: 5.742e-05, [2] [frontend_op_eliminate]: 2.124e-05 [inline_after_opt_a]: 2.129e-05 [cconv]: 4.466e-05 [loop_unroll]: 0.00070986 [jit_opt_after_cconv]: 0.00020745, [1] [Cycle 1]: 0.00019735, [11] [c_1]: 2.727e-05 [parameter_eliminate]: 6.06e-06 [updatestate_depend_eliminate]: 1.275e-05 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 4.8e-05 [call_graph_tuple_transform]: 2.75e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 2.53998e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 2.127e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 7.75e-06 [add_recomputation]: 6.627e-05 [cse_after_recomputation]: 2.701e-05, [1] [Cycle 1]: 2.04e-05, [1] [cse]: 1.381e-05 [auto_monad_reorder]: 1.928e-05 [get_jit_bprop_graph]: 2.76e-06 [rewriter_after_jit_bprop_graph]: 1.052e-05 [opt_after_jit_grad]: 0.00072815 [symbol_engine_optimizer]: 9.539e-05, [1] [Cycle 1]: 8.588e-05, [6] [build]: 6.37001e-06 [elim_shapecalc]: 9.90002e-06 [elim_not_effective]: 1.775e-05 [opt_reshape]: 7.55e-06 [fold_const_symbol]: 1.086e-05 [renormalize]: 6.59988e-07 [validate]: 6.215e-05 Sums bootstrap : 0.000387s : 0.28% type_inference : 0.132747s : 95.63% event_method : 0.000021s : 0.02% auto_monad : 0.000076s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000132s : 0.10% rewriter_before_opt_a : 0.000085s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000630s : 0.45% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001147s : 0.83% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000062s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000055s : 0.04% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001093s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000045s : 0.03% loop_unroll : 0.000710s : 0.51% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000066s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000728s : 0.52% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.04% Time group info: ------[substitution.] 0.000213 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.96% : 0.000002s : 2: substitution.fold_const_symbol 3.34% : 0.000007s : 3: substitution.graph_param_transform 81.71% : 0.000174s : 4: substitution.inline 2.02% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000006s : 4: substitution.remove_not_recompute_node 2.85% : 0.000006s : 2: substitution.replace_old_param 5.35% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132661 2 98.74% : 0.130989s : 1: type_inference.infer 1.26% : 0.001672s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.26% : 0.000045s : 4: replace.inline 31.74% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 94.33% : 0.000171s : 4: match.inline 5.67% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 691 1.13% : 0.000002s : 10: predicate.accumulaten_eliminater 1.67% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.04% : 0.000001s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.12% : 0.000002s : 10: predicate.cast_eliminate 0.62% : 0.000001s : 3: predicate.check_bprop_eliminate 0.91% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.66% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.99% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.12% : 0.000008s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 15: predicate.load_eliminater 2.76% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.92% : 0.000001s : 10: predicate.minmaximum_grad 3.82% : 0.000005s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 1.93% : 0.000003s : 15: predicate.partial_eliminate 1.33% : 0.000002s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.10% : 0.000002s : 10: predicate.reshape_eliminate 1.45% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.24% : 0.000002s : 3: predicate.row_tensor_eliminate 1.14% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.01% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.94% : 0.000010s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.18% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000932 13 45.01% : 0.000419s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.35% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.64% : 0.000472s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.145340 72 0.05% : 0.000070s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.28% : 0.000401s : 1: bootstrap 0.03% : 0.000047s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.32% : 0.006286s : 1: jit_opt_a 0.15% : 0.000211s : 1: jit_opt_after_cconv 0.05% : 0.000073s : 1: jit_opt_b 0.50% : 0.000724s : 1: loop_unroll 0.77% : 0.001114s : 1: mutable_eliminate 0.60% : 0.000870s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000026s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000031s : 1: opt.transform.mutable_eliminate 0.02% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000744s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000136s : 1: py_interpret_to_execute 0.02% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 0.46% : 0.000674s : 1: renormalize.infer 0.32% : 0.000462s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000062s : 1: rewriter_after_opt_a 0.06% : 0.000089s : 1: rewriter_before_opt_a 0.07% : 0.000099s : 1: symbol_engine_optimizer 91.35% : 0.132770s : 1: type_inference TotalTime = 0.0354514, [30] [bootstrap]: 0.00037875 [type_inference]: 0.0250315 [event_method]: 2.158e-05 [auto_monad]: 7.311e-05 [graph_reusing]: 6.15002e-06 [pre_auto_parallel]: 2.16e-06 [py_interpret_to_execute]: 0.00016235 [rewriter_before_opt_a]: 8.636e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00700154, [2] [Cycle 1]: 0.00250533, [27] [switch_simplify]: 7.201e-05 [loop_unroll]: 2.989e-05 [a_1]: 0.00065649 [with_stream_mark]: 2.226e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.86003e-06 [renormalize]: 0.00135899 [add_forward_monad_depend]: 6.53003e-06 [auto_monad_grad]: 3.08e-06 [auto_monad_eliminator]: 1.661e-05 [cse]: 3.533e-05 [replace_applicator]: 1.475e-05 [Cycle 2]: 0.00033415, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.366e-05 [with_stream_mark]: 1.174e-05 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 2.07001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 8.1e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.08001e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 6.16998e-06 [cse]: 1.315e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 1.488e-05 [rewriter_after_opt_a]: 3.915e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00074357 [jit_opt_b]: 5.495e-05, [1] [Cycle 1]: 4.66e-05, [2] [frontend_op_eliminate]: 1.897e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 2.716e-05 [loop_unroll]: 0.00053454 [jit_opt_after_cconv]: 0.00017482, [1] [Cycle 1]: 0.00016631, [11] [c_1]: 2.557e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 9.22001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 3.448e-05 [call_graph_tuple_transform]: 2.407e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.02999e-06 [remove_dup_value]: 1.787e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.69001e-06 [add_recomputation]: 5.586e-05 [cse_after_recomputation]: 2.458e-05, [1] [Cycle 1]: 1.952e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.929e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 7.79997e-06 [opt_after_jit_grad]: 0.00060351 [symbol_engine_optimizer]: 8.895e-05, [1] [Cycle 1]: 8.233e-05, [6] [build]: 4.18999e-06 [elim_shapecalc]: 9.12999e-06 [elim_not_effective]: 1.806e-05 [opt_reshape]: 8.23999e-06 [fold_const_symbol]: 1.033e-05 [renormalize]: 1.00001e-06 [validate]: 5.27e-05 Sums bootstrap : 0.000379s : 1.24% type_inference : 0.025032s : 81.66% event_method : 0.000022s : 0.07% auto_monad : 0.000073s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000162s : 0.53% rewriter_before_opt_a : 0.000086s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000750s : 2.45% jit_opt_a.with_stream_mark : 0.000034s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001359s : 4.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000048s : 0.16% jit_opt_a.replace_applicator : 0.000020s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000744s : 2.43% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000027s : 0.09% loop_unroll : 0.000535s : 1.74% jit_opt_after_cconv.c_1 : 0.000026s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.18% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000604s : 1.97% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.17% Time group info: ------[substitution.] 0.000260 23 1.08% : 0.000003s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 3: substitution.graph_param_transform 85.83% : 0.000223s : 4: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000006s : 4: substitution.remove_not_recompute_node 1.84% : 0.000005s : 2: substitution.replace_old_param 4.48% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024942 2 91.65% : 0.022859s : 1: type_inference.infer 8.35% : 0.002082s : 1: type_inference.specialize ------[replace.] 0.000087 6 68.78% : 0.000060s : 4: replace.inline 31.22% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 95.46% : 0.000221s : 4: match.inline 4.54% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 2.26% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.44% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.79% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.86% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.28% : 0.000003s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.42% : 0.000002s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.46% : 0.000002s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 1.89% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001063 13 43.56% : 0.000463s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.37% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.07% : 0.000553s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037896 72 0.16% : 0.000059s : 1: add_recomputation 0.20% : 0.000077s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.06% : 0.000400s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.49% : 0.007006s : 1: jit_opt_a 0.47% : 0.000177s : 1: jit_opt_after_cconv 0.15% : 0.000058s : 1: jit_opt_b 1.44% : 0.000547s : 1: loop_unroll 1.99% : 0.000754s : 1: mutable_eliminate 2.61% : 0.000987s : 26: opt.transform.jit_opt_a 0.15% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.17% : 0.000065s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000041s : 4: opt.transform.symbol_engine_opt 1.62% : 0.000613s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000166s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.15% : 0.000814s : 1: renormalize.infer 1.41% : 0.000536s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.24% : 0.000090s : 1: rewriter_before_opt_a 0.24% : 0.000092s : 1: symbol_engine_optimizer 66.10% : 0.025051s : 1: type_inference TotalTime = 0.0154906, [30] [bootstrap]: 0.00034736 [type_inference]: 0.00661788 [event_method]: 2.397e-05 [auto_monad]: 7.723e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 6.028e-05 [rewriter_before_opt_a]: 8.095e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00616955, [2] [Cycle 1]: 0.00201351, [27] [switch_simplify]: 5.733e-05 [loop_unroll]: 2.966e-05 [a_1]: 0.0005937 [with_stream_mark]: 2.082e-05 [recompute_prepare]: 8.86002e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.85998e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00095896 [add_forward_monad_depend]: 7.09001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.664e-05 [cse]: 3.226e-05 [replace_applicator]: 1.435e-05 [Cycle 2]: 0.00032549, [27] [switch_simplify]: 5.71998e-06 [loop_unroll]: 4.94e-06 [a_1]: 8.983e-05 [with_stream_mark]: 1.026e-05 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.06002e-06 [updatestate_useless_node_eliminater]: 4.81997e-06 [accelerated_algorithm]: 4.60999e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.66002e-06 [meta_fg_expand]: 1.46998e-06 [replace_old_param]: 8.11002e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 6.98e-06 [cse]: 1.22e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.158e-05 [rewriter_after_opt_a]: 3.861e-05 [convert_after_rewriter]: 2.098e-05 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00053351 [jit_opt_b]: 4.88e-05, [1] [Cycle 1]: 4.146e-05, [2] [frontend_op_eliminate]: 1.514e-05 [inline_after_opt_a]: 1.497e-05 [cconv]: 2.758e-05 [loop_unroll]: 0.00040452 [jit_opt_after_cconv]: 0.00014194, [1] [Cycle 1]: 0.00013491, [11] [c_1]: 1.989e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 6.86999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.067e-05 [call_graph_tuple_transform]: 1.918e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.04998e-06 [remove_dup_value]: 1.654e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 5.80002e-06 [add_recomputation]: 5.342e-05 [cse_after_recomputation]: 2.151e-05, [1] [Cycle 1]: 1.617e-05, [1] [cse]: 1.029e-05 [auto_monad_reorder]: 1.515e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00044549 [symbol_engine_optimizer]: 7.054e-05, [1] [Cycle 1]: 6.427e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 7.29001e-06 [elim_not_effective]: 1.275e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 5.00004e-07 [validate]: 3.519e-05 Sums bootstrap : 0.000347s : 3.14% type_inference : 0.006618s : 59.87% event_method : 0.000024s : 0.22% auto_monad : 0.000077s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000060s : 0.55% rewriter_before_opt_a : 0.000081s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.57% jit_opt_a.loop_unroll : 0.000035s : 0.31% jit_opt_a.a_1 : 0.000684s : 6.18% jit_opt_a.with_stream_mark : 0.000031s : 0.28% jit_opt_a.recompute_prepare : 0.000014s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000959s : 8.68% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.21% jit_opt_a.cse : 0.000044s : 0.40% jit_opt_a.replace_applicator : 0.000020s : 0.18% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000039s : 0.35% convert_after_rewriter : 0.000021s : 0.19% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000534s : 4.83% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000028s : 0.25% loop_unroll : 0.000405s : 3.66% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.48% cse_after_recomputation.cse : 0.000010s : 0.09% auto_monad_reorder : 0.000015s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000445s : 4.03% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.32% Time group info: ------[substitution.] 0.000249 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 3: substitution.graph_param_transform 85.12% : 0.000212s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005472 2 79.08% : 0.004328s : 1: type_inference.infer 20.92% : 0.001145s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.50% : 0.000053s : 4: replace.inline 31.50% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.71% : 0.000209s : 4: match.inline 5.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.52% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 5.16% : 0.000006s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.73% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.68% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000793 13 48.65% : 0.000386s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.88% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.47% : 0.000353s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017383 72 0.32% : 0.000056s : 1: add_recomputation 0.46% : 0.000081s : 1: auto_monad 0.10% : 0.000017s : 1: auto_monad_reorder 2.11% : 0.000367s : 1: bootstrap 0.17% : 0.000030s : 1: cconv 0.14% : 0.000024s : 1: convert_after_rewriter 0.13% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.16% : 0.000029s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.51% : 0.006173s : 1: jit_opt_a 0.83% : 0.000145s : 1: jit_opt_after_cconv 0.29% : 0.000051s : 1: jit_opt_b 2.37% : 0.000412s : 1: loop_unroll 3.12% : 0.000543s : 1: mutable_eliminate 5.19% : 0.000903s : 26: opt.transform.jit_opt_a 0.27% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000024s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.60% : 0.000453s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000063s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 3.03% : 0.000527s : 1: renormalize.infer 2.43% : 0.000423s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000042s : 1: rewriter_after_opt_a 0.48% : 0.000084s : 1: rewriter_before_opt_a 0.42% : 0.000073s : 1: symbol_engine_optimizer 38.18% : 0.006637s : 1: type_inference TotalTime = 0.0578982, [30] [bootstrap]: 0.0003001 [type_inference]: 0.00685716 [event_method]: 2.378e-05 [auto_monad]: 7.273e-05 [graph_reusing]: 6.44999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 5.241e-05 [rewriter_before_opt_a]: 8.591e-05 [expand_dump_flag]: 3.92002e-06 [jit_opt_a]: 0.0481232, [2] [Cycle 1]: 0.00214476, [27] [switch_simplify]: 6.537e-05 [loop_unroll]: 3.134e-05 [a_1]: 0.000614 [with_stream_mark]: 2.472e-05 [recompute_prepare]: 1.042e-05 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00102748 [add_forward_monad_depend]: 7.61999e-06 [auto_monad_grad]: 3.29001e-06 [auto_monad_eliminator]: 1.793e-05 [cse]: 3.851e-05 [replace_applicator]: 1.564e-05 [Cycle 2]: 0.00036997, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 5.27999e-06 [a_1]: 8.878e-05 [with_stream_mark]: 1.198e-05 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.10999e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.599e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.55e-06 [inline_without_move]: 4.97e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 6.55002e-06 [cse]: 4.29e-05 [replace_applicator]: 7.26999e-06 [py_interpret_to_execute_after_opt_a]: 2.054e-05 [rewriter_after_opt_a]: 4.167e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 5.04998e-06 [mutable_eliminate]: 0.00064083 [jit_opt_b]: 5.18e-05, [1] [Cycle 1]: 4.418e-05, [2] [frontend_op_eliminate]: 1.657e-05 [inline_after_opt_a]: 1.681e-05 [cconv]: 3.162e-05 [loop_unroll]: 0.00046277 [jit_opt_after_cconv]: 0.00015738, [1] [Cycle 1]: 0.00015037, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 3.41999e-06 [updatestate_depend_eliminate]: 7.1e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 3.045e-05 [call_graph_tuple_transform]: 1.936e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 7.59988e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.796e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 9.15999e-06 [add_recomputation]: 5.401e-05 [cse_after_recomputation]: 2.308e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.855e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 5.07999e-06 [opt_after_jit_grad]: 0.00049154 [symbol_engine_optimizer]: 8.085e-05, [1] [Cycle 1]: 7.45e-05, [6] [build]: 9.79e-06 [elim_shapecalc]: 9.00999e-06 [elim_not_effective]: 1.309e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 6.59988e-07 [validate]: 4.531e-05 Sums bootstrap : 0.000300s : 2.57% type_inference : 0.006857s : 58.84% event_method : 0.000024s : 0.20% auto_monad : 0.000073s : 0.62% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000052s : 0.45% rewriter_before_opt_a : 0.000086s : 0.74% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000071s : 0.61% jit_opt_a.loop_unroll : 0.000037s : 0.31% jit_opt_a.a_1 : 0.000703s : 6.03% jit_opt_a.with_stream_mark : 0.000037s : 0.31% jit_opt_a.recompute_prepare : 0.000016s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001028s : 8.82% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.21% jit_opt_a.cse : 0.000081s : 0.70% jit_opt_a.replace_applicator : 0.000023s : 0.20% py_interpret_to_execute_after_opt_a : 0.000021s : 0.18% rewriter_after_opt_a : 0.000042s : 0.36% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000641s : 5.50% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000032s : 0.27% loop_unroll : 0.000463s : 3.97% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000054s : 0.46% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000019s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000492s : 4.22% symbol_engine_optimizer.build : 0.000010s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000045s : 0.39% Time group info: ------[substitution.] 0.000267 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000005s : 3: substitution.graph_param_transform 86.11% : 0.000230s : 4: substitution.inline 2.02% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000006s : 2: substitution.replace_old_param 4.75% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006760 2 79.06% : 0.005345s : 1: type_inference.infer 20.94% : 0.001416s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.44% : 0.000056s : 4: replace.inline 30.56% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.26% : 0.000227s : 4: match.inline 4.74% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.58% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.70% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.90% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.80% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.22% : 0.000001s : 6: predicate.special_op_eliminate 1.28% : 0.000002s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.93% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000935 13 49.82% : 0.000466s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.82% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.37% : 0.000415s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059918 72 0.09% : 0.000057s : 1: add_recomputation 0.13% : 0.000076s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.53% : 0.000320s : 1: bootstrap 0.06% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 80.32% : 0.048127s : 1: jit_opt_a 0.27% : 0.000160s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.79% : 0.000472s : 1: loop_unroll 1.09% : 0.000652s : 1: mutable_eliminate 1.57% : 0.000942s : 26: opt.transform.jit_opt_a 0.08% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000502s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000055s : 1: py_interpret_to_execute 0.04% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.94% : 0.000562s : 1: renormalize.infer 0.76% : 0.000457s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000046s : 1: rewriter_after_opt_a 0.15% : 0.000089s : 1: rewriter_before_opt_a 0.14% : 0.000083s : 1: symbol_engine_optimizer 11.49% : 0.006884s : 1: type_inference TotalTime = 0.063167, [30] [bootstrap]: 0.0003084 [type_inference]: 0.05155 [event_method]: 0.00011729 [auto_monad]: 0.00011898 [graph_reusing]: 7.88001e-06 [pre_auto_parallel]: 3.43e-06 [py_interpret_to_execute]: 4.871e-05 [rewriter_before_opt_a]: 0.00015207 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.00850984, [2] [Cycle 1]: 0.00398091, [27] [switch_simplify]: 0.00019579 [loop_unroll]: 5.463e-05 [a_1]: 0.00138477 [with_stream_mark]: 2.733e-05 [recompute_prepare]: 8.64998e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.734e-05 [j_node_and_user_rematch]: 9.76998e-06 [meta_fg_expand]: 3.61001e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00192978 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.667e-05 [cse]: 4.068e-05 [replace_applicator]: 1.492e-05 [Cycle 2]: 0.00035345, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 6.04999e-06 [a_1]: 9.752e-05 [with_stream_mark]: 1.177e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.33002e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.05998e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.335e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 8.54e-06 [inline_without_move]: 5.02e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.73998e-06 [cse]: 1.482e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.297e-05 [rewriter_after_opt_a]: 4.072e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00064755 [jit_opt_b]: 5.038e-05, [1] [Cycle 1]: 4.359e-05, [2] [frontend_op_eliminate]: 1.63e-05 [inline_after_opt_a]: 1.648e-05 [cconv]: 2.543e-05 [loop_unroll]: 0.00041523 [jit_opt_after_cconv]: 0.00014893, [1] [Cycle 1]: 0.00014261, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 2.79999e-06 [updatestate_depend_eliminate]: 6.23002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.461e-05 [call_graph_tuple_transform]: 1.908e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.58997e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 3.556e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 5.88002e-06 [add_recomputation]: 4.807e-05 [cse_after_recomputation]: 2.324e-05, [1] [Cycle 1]: 1.816e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 2.61e-06 [rewriter_after_jit_bprop_graph]: 5.23002e-06 [opt_after_jit_grad]: 0.00051558 [symbol_engine_optimizer]: 9.545e-05, [1] [Cycle 1]: 8.922e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 9.04e-06 [elim_not_effective]: 3.132e-05 [opt_reshape]: 6.24999e-06 [fold_const_symbol]: 1.022e-05 [renormalize]: 4.10015e-07 [validate]: 4.338e-05 Sums bootstrap : 0.000308s : 0.53% type_inference : 0.051550s : 88.34% event_method : 0.000117s : 0.20% auto_monad : 0.000119s : 0.20% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000049s : 0.08% rewriter_before_opt_a : 0.000152s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000202s : 0.35% jit_opt_a.loop_unroll : 0.000061s : 0.10% jit_opt_a.a_1 : 0.001482s : 2.54% jit_opt_a.with_stream_mark : 0.000039s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001930s : 3.31% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000056s : 0.10% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000648s : 1.11% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000415s : 0.71% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000036s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000516s : 0.88% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000031s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000576 33 3.49% : 0.000020s : 2: substitution.elim_not_effective 0.31% : 0.000002s : 2: substitution.fold_const_symbol 0.93% : 0.000005s : 3: substitution.graph_param_transform 88.12% : 0.000508s : 11: substitution.inline 0.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.80% : 0.000005s : 4: substitution.remove_not_recompute_node 0.99% : 0.000006s : 2: substitution.replace_old_param 2.06% : 0.000012s : 2: substitution.switch_simplify 2.65% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051437 2 72.98% : 0.037540s : 1: type_inference.infer 27.02% : 0.013897s : 1: type_inference.specialize ------[replace.] 0.000344 16 47.57% : 0.000164s : 11: replace.inline 17.35% : 0.000060s : 2: replace.switch_simplify 35.08% : 0.000121s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000526 16 95.40% : 0.000502s : 11: match.inline 2.03% : 0.000011s : 2: match.switch_simplify 2.57% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000197 1148 1.34% : 0.000003s : 18: predicate.accumulaten_eliminater 0.70% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 18: predicate.addn_check_dump 1.52% : 0.000003s : 18: predicate.addn_zero_filter 1.73% : 0.000003s : 18: predicate.arithmetic_simplify 1.28% : 0.000003s : 18: predicate.cast_eliminate 0.24% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 18: predicate.compare_switch_simplify 1.27% : 0.000002s : 18: predicate.depend_value_elim 1.15% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.38% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 18: predicate.dict_set_item_eliminator 0.59% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 18: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 18: predicate.environ_get_depend_swap 1.26% : 0.000002s : 18: predicate.environ_get_eliminate 1.19% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.74% : 0.000001s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000010s : 38: predicate.inline 0.50% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.93% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.66% : 0.000003s : 24: predicate.load_eliminater 0.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.43% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.62% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 18: predicate.merge_addn 1.17% : 0.000002s : 18: predicate.minmaximum_grad 1.05% : 0.000002s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000004s : 24: predicate.partial_eliminate 1.40% : 0.000003s : 18: predicate.print_const_string_wrapper 1.80% : 0.000004s : 18: predicate.reduce_eliminate 1.49% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 5.24% : 0.000010s : 6: predicate.remove_not_recompute_node 1.68% : 0.000003s : 27: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 18: predicate.reshape_eliminate 1.29% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.42% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 18: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.66% : 0.000001s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 18: predicate.stack_unstack_eliminate 0.24% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.39% : 0.000007s : 32: predicate.switch_defer_inline 2.54% : 0.000005s : 32: predicate.switch_layer_defer_inline 9.22% : 0.000018s : 103: predicate.switch_simplify 1.29% : 0.000003s : 18: predicate.tile_eliminate 1.27% : 0.000002s : 18: predicate.transpose_eliminate 1.53% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.94% : 0.000004s : 18: predicate.tuple_list_set_item_eliminator 1.51% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.62% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.30% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 18: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.013238 28 9.15% : 0.001211s : 9: func_graph_cloner_run.FuncGraphClonerGraph 2.00% : 0.000265s : 6: func_graph_cloner_run.FuncGraphClonerNode 88.85% : 0.011761s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067042 72 0.08% : 0.000051s : 1: add_recomputation 0.19% : 0.000125s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.49% : 0.000327s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.19% : 0.000125s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 12.70% : 0.008515s : 1: jit_opt_a 0.23% : 0.000151s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.63% : 0.000423s : 1: loop_unroll 0.98% : 0.000656s : 1: mutable_eliminate 2.81% : 0.001881s : 26: opt.transform.jit_opt_a 0.07% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000053s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000524s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.08% : 0.000052s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000038s : 1: remove_dup_value 1.92% : 0.001285s : 1: renormalize.infer 0.94% : 0.000633s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000044s : 1: rewriter_after_opt_a 0.23% : 0.000155s : 1: rewriter_before_opt_a 0.15% : 0.000098s : 1: symbol_engine_optimizer 76.93% : 0.051578s : 1: type_inference TotalTime = 0.0139385, [30] [bootstrap]: 0.00034811 [type_inference]: 0.00533373 [event_method]: 2.05e-05 [auto_monad]: 7.033e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 3.891e-05 [rewriter_before_opt_a]: 7.774e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00578288, [2] [Cycle 1]: 0.00177972, [27] [switch_simplify]: 5.978e-05 [loop_unroll]: 3.073e-05 [a_1]: 0.00057186 [with_stream_mark]: 2.309e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 6.03998e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.21998e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 5.49e-06 [renormalize]: 0.00073083 [add_forward_monad_depend]: 7.32997e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.639e-05 [cse]: 3.737e-05 [replace_applicator]: 1.498e-05 [Cycle 2]: 0.0003367, [27] [switch_simplify]: 5.96998e-06 [loop_unroll]: 5.21002e-06 [a_1]: 9.257e-05 [with_stream_mark]: 1.252e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 3.50998e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.65e-06 [inline_without_move]: 4.72e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.429e-05 [replace_applicator]: 5.01997e-06 [py_interpret_to_execute_after_opt_a]: 1.404e-05 [rewriter_after_opt_a]: 3.727e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00060083 [jit_opt_b]: 5.148e-05, [1] [Cycle 1]: 4.391e-05, [2] [frontend_op_eliminate]: 1.611e-05 [inline_after_opt_a]: 1.572e-05 [cconv]: 3.286e-05 [loop_unroll]: 0.00043295 [jit_opt_after_cconv]: 0.00016891, [1] [Cycle 1]: 0.00016229, [11] [c_1]: 2.022e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 7.55e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 2.982e-05 [call_graph_tuple_transform]: 2.932e-05 [tuple_list_get_item_eliminator]: 6.68998e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.59999e-06 [add_recomputation]: 5.223e-05 [cse_after_recomputation]: 2.465e-05, [1] [Cycle 1]: 1.95e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.716e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 6.51e-06 [opt_after_jit_grad]: 0.00047575 [symbol_engine_optimizer]: 7.171e-05, [1] [Cycle 1]: 6.492e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 5.42001e-06 [fold_const_symbol]: 8.58001e-06 [renormalize]: 3.89991e-07 [validate]: 4.167e-05 Sums bootstrap : 0.000348s : 3.60% type_inference : 0.005334s : 55.21% event_method : 0.000021s : 0.21% auto_monad : 0.000070s : 0.73% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.40% rewriter_before_opt_a : 0.000078s : 0.80% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000066s : 0.68% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000664s : 6.88% jit_opt_a.with_stream_mark : 0.000036s : 0.37% jit_opt_a.recompute_prepare : 0.000014s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000731s : 7.57% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.23% jit_opt_a.cse : 0.000052s : 0.53% jit_opt_a.replace_applicator : 0.000020s : 0.21% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000037s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000601s : 6.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000033s : 0.34% loop_unroll : 0.000433s : 4.48% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000030s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.30% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000052s : 0.54% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000476s : 4.92% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.43% Time group info: ------[substitution.] 0.000238 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 85.21% : 0.000203s : 4: substitution.inline 1.81% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 2.08% : 0.000005s : 2: substitution.replace_old_param 5.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005260 2 82.83% : 0.004357s : 1: type_inference.infer 17.17% : 0.000903s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.09% : 0.000048s : 4: replace.inline 31.91% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.66% : 0.000200s : 4: match.inline 5.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.48% : 0.000002s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.37% : 0.000006s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.43% : 0.000003s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.50% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.94% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.08% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000714 13 53.83% : 0.000384s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.04% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.13% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015623 72 0.35% : 0.000055s : 1: add_recomputation 0.47% : 0.000074s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.37% : 0.000370s : 1: bootstrap 0.23% : 0.000036s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.17% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.04% : 0.005786s : 1: jit_opt_a 1.10% : 0.000172s : 1: jit_opt_after_cconv 0.35% : 0.000054s : 1: jit_opt_b 2.82% : 0.000441s : 1: loop_unroll 3.92% : 0.000613s : 1: mutable_eliminate 5.70% : 0.000890s : 26: opt.transform.jit_opt_a 0.37% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.11% : 0.000485s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000042s : 1: py_interpret_to_execute 0.11% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.57% : 0.000402s : 1: renormalize.infer 2.05% : 0.000320s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000040s : 1: rewriter_after_opt_a 0.52% : 0.000081s : 1: rewriter_before_opt_a 0.47% : 0.000074s : 1: symbol_engine_optimizer 34.26% : 0.005353s : 1: type_inference TotalTime = 0.0307067, [30] [bootstrap]: 0.00029743 [type_inference]: 0.0205173 [event_method]: 0.00010416 [auto_monad]: 0.00011164 [graph_reusing]: 7.58999e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 4.088e-05 [rewriter_before_opt_a]: 0.00013706 [expand_dump_flag]: 3.63999e-06 [jit_opt_a]: 0.00724009, [2] [Cycle 1]: 0.00344337, [27] [switch_simplify]: 0.00016591 [loop_unroll]: 5.504e-05 [a_1]: 0.00128656 [with_stream_mark]: 1.728e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.35997e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 7.59988e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.18998e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.53002e-06 [renormalize]: 0.00156223 [add_forward_monad_depend]: 6.78e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.628e-05 [cse]: 3.746e-05 [replace_applicator]: 1.466e-05 [Cycle 2]: 0.00033188, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.292e-05 [with_stream_mark]: 1.004e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 4.93001e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 2.17001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 5.56998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.47e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 4.087e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.14003e-06 [mutable_eliminate]: 0.00065177 [jit_opt_b]: 5.094e-05, [1] [Cycle 1]: 4.383e-05, [2] [frontend_op_eliminate]: 1.691e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 2.489e-05 [loop_unroll]: 0.00041119 [jit_opt_after_cconv]: 0.00014632, [1] [Cycle 1]: 0.00014014, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.65001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.68998e-06 [cse]: 2.421e-05 [call_graph_tuple_transform]: 1.903e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.55001e-06 [remove_dup_value]: 3.31e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 4.777e-05 [cse_after_recomputation]: 2.406e-05, [1] [Cycle 1]: 1.815e-05, [1] [cse]: 1.212e-05 [auto_monad_reorder]: 1.708e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 4.27e-06 [opt_after_jit_grad]: 0.00044274 [symbol_engine_optimizer]: 9.041e-05, [1] [Cycle 1]: 8.45e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 2.677e-05 [opt_reshape]: 6.15002e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 4.19997e-07 [validate]: 4.14e-05 Sums bootstrap : 0.000297s : 1.12% type_inference : 0.020517s : 77.02% event_method : 0.000104s : 0.39% auto_monad : 0.000112s : 0.42% graph_reusing : 0.000008s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000041s : 0.15% rewriter_before_opt_a : 0.000137s : 0.51% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000172s : 0.65% jit_opt_a.loop_unroll : 0.000060s : 0.23% jit_opt_a.a_1 : 0.001379s : 5.18% jit_opt_a.with_stream_mark : 0.000027s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001562s : 5.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000052s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000652s : 2.45% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000025s : 0.09% loop_unroll : 0.000411s : 1.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000033s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000443s : 1.66% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.16% Time group info: ------[substitution.] 0.000530 33 3.04% : 0.000016s : 2: substitution.elim_not_effective 0.24% : 0.000001s : 2: substitution.fold_const_symbol 1.01% : 0.000005s : 3: substitution.graph_param_transform 87.95% : 0.000466s : 11: substitution.inline 0.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.94% : 0.000005s : 4: substitution.remove_not_recompute_node 0.69% : 0.000004s : 2: substitution.replace_old_param 2.38% : 0.000013s : 2: substitution.switch_simplify 3.08% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020435 2 88.11% : 0.018005s : 1: type_inference.infer 11.89% : 0.002430s : 1: type_inference.specialize ------[replace.] 0.000297 16 52.90% : 0.000157s : 11: replace.inline 15.78% : 0.000047s : 2: replace.switch_simplify 31.32% : 0.000093s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000486 16 94.68% : 0.000461s : 11: match.inline 2.33% : 0.000011s : 2: match.switch_simplify 3.00% : 0.000015s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000185 1148 1.33% : 0.000002s : 18: predicate.accumulaten_eliminater 0.82% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.27% : 0.000002s : 18: predicate.addn_check_dump 1.40% : 0.000003s : 18: predicate.addn_zero_filter 2.02% : 0.000004s : 18: predicate.arithmetic_simplify 1.35% : 0.000002s : 18: predicate.cast_eliminate 0.27% : 0.000000s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 18: predicate.compare_switch_simplify 1.39% : 0.000003s : 18: predicate.depend_value_elim 1.27% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 18: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 18: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 18: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.41% : 0.000003s : 18: predicate.environ_get_depend_swap 1.37% : 0.000003s : 18: predicate.environ_get_eliminate 1.27% : 0.000002s : 18: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.74% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.18% : 0.000010s : 38: predicate.inline 0.55% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.93% : 0.000004s : 24: predicate.load_eliminater 0.97% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.71% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.27% : 0.000002s : 18: predicate.merge_addn 1.26% : 0.000002s : 18: predicate.minmaximum_grad 1.19% : 0.000002s : 3: predicate.mutable_eliminate 0.29% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000004s : 24: predicate.partial_eliminate 1.29% : 0.000002s : 18: predicate.print_const_string_wrapper 1.86% : 0.000003s : 18: predicate.reduce_eliminate 1.67% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000003s : 27: predicate.replace_applicator 0.36% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000003s : 18: predicate.reshape_eliminate 1.54% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.43% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 18: predicate.same_eliminate 0.32% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.61% : 0.000001s : 6: predicate.specialize_transform 1.64% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.28% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.08% : 0.000006s : 32: predicate.switch_defer_inline 2.70% : 0.000005s : 32: predicate.switch_layer_defer_inline 8.85% : 0.000016s : 103: predicate.switch_simplify 1.42% : 0.000003s : 18: predicate.tile_eliminate 1.42% : 0.000003s : 18: predicate.transpose_eliminate 1.94% : 0.000004s : 18: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.22% : 0.000006s : 27: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.81% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 2.00% : 0.000004s : 24: predicate.updatestate_pure_node_eliminater 2.38% : 0.000004s : 30: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 18: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002223 28 50.66% : 0.001126s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.15% : 0.000248s : 6: func_graph_cloner_run.FuncGraphClonerNode 38.19% : 0.000849s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034072 72 0.15% : 0.000051s : 1: add_recomputation 0.34% : 0.000117s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000318s : 1: bootstrap 0.08% : 0.000027s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.32% : 0.000110s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 21.26% : 0.007244s : 1: jit_opt_a 0.44% : 0.000149s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.23% : 0.000419s : 1: loop_unroll 1.94% : 0.000661s : 1: mutable_eliminate 5.09% : 0.001736s : 26: opt.transform.jit_opt_a 0.14% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000048s : 4: opt.transform.symbol_engine_opt 1.32% : 0.000451s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000043s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000036s : 1: remove_dup_value 2.97% : 0.001013s : 1: renormalize.infer 1.59% : 0.000541s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.41% : 0.000140s : 1: rewriter_before_opt_a 0.27% : 0.000093s : 1: symbol_engine_optimizer 60.26% : 0.020531s : 1: type_inference TotalTime = 0.018168, [30] [bootstrap]: 0.00031848 [type_inference]: 0.00697585 [event_method]: 2.339e-05 [auto_monad]: 7.243e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 5.148e-05 [rewriter_before_opt_a]: 8.535e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.00787185, [2] [Cycle 1]: 0.00378675, [27] [switch_simplify]: 6.332e-05 [loop_unroll]: 3.078e-05 [a_1]: 0.00205653 [with_stream_mark]: 3.046e-05 [recompute_prepare]: 1.38e-05 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 3.56001e-06 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.99001e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 5.19998e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.685e-05 [j_node_and_user_rematch]: 1.148e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.198e-05 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00111511 [add_forward_monad_depend]: 9.63002e-06 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 2.158e-05 [cse]: 8.039e-05 [replace_applicator]: 1.793e-05 [Cycle 2]: 0.00038092, [27] [switch_simplify]: 5.88002e-06 [loop_unroll]: 5.12e-06 [a_1]: 8.996e-05 [with_stream_mark]: 1.627e-05 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 2.35002e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.691e-05 [j_node_and_user_rematch]: 9.58002e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 8.86002e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.05002e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 9.27999e-06 [cse]: 1.901e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 1.815e-05 [rewriter_after_opt_a]: 4.569e-05 [convert_after_rewriter]: 8.95999e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00079664 [jit_opt_b]: 5.844e-05, [1] [Cycle 1]: 4.898e-05, [2] [frontend_op_eliminate]: 1.708e-05 [inline_after_opt_a]: 1.918e-05 [cconv]: 3.581e-05 [loop_unroll]: 0.00052089 [jit_opt_after_cconv]: 0.00018527, [1] [Cycle 1]: 0.0001776, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 6.38e-06 [updatestate_depend_eliminate]: 9.72001e-06 [updatestate_assign_eliminate]: 3.85998e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.974e-05 [call_graph_tuple_transform]: 2.337e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 9.99979e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.911e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 1.065e-05 [add_recomputation]: 6.026e-05 [cse_after_recomputation]: 2.751e-05, [1] [Cycle 1]: 2.185e-05, [1] [cse]: 1.426e-05 [auto_monad_reorder]: 1.917e-05 [get_jit_bprop_graph]: 2.76e-06 [rewriter_after_jit_bprop_graph]: 9.52999e-06 [opt_after_jit_grad]: 0.00056712 [symbol_engine_optimizer]: 9.179e-05, [1] [Cycle 1]: 8.433e-05, [6] [build]: 1.303e-05 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 1.628e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 9.80013e-07 [validate]: 5.085e-05 Sums bootstrap : 0.000318s : 2.32% type_inference : 0.006976s : 50.83% event_method : 0.000023s : 0.17% auto_monad : 0.000072s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000051s : 0.38% rewriter_before_opt_a : 0.000085s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.50% jit_opt_a.loop_unroll : 0.000036s : 0.26% jit_opt_a.a_1 : 0.002146s : 15.64% jit_opt_a.with_stream_mark : 0.000047s : 0.34% jit_opt_a.recompute_prepare : 0.000019s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.04% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000009s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000021s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001115s : 8.13% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.22% jit_opt_a.cse : 0.000099s : 0.72% jit_opt_a.replace_applicator : 0.000024s : 0.17% py_interpret_to_execute_after_opt_a : 0.000018s : 0.13% rewriter_after_opt_a : 0.000046s : 0.33% convert_after_rewriter : 0.000009s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000797s : 5.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.14% cconv : 0.000036s : 0.26% loop_unroll : 0.000521s : 3.80% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000040s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000011s : 0.08% add_recomputation : 0.000060s : 0.44% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000010s : 0.07% opt_after_jit_grad : 0.000567s : 4.13% symbol_engine_optimizer.build : 0.000013s : 0.09% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000051s : 0.37% Time group info: ------[substitution.] 0.001664 23 0.13% : 0.000002s : 2: substitution.elim_not_effective 0.08% : 0.000001s : 2: substitution.fold_const_symbol 0.36% : 0.000006s : 3: substitution.graph_param_transform 97.48% : 0.001622s : 4: substitution.inline 0.36% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.25% : 0.000004s : 4: substitution.remove_not_recompute_node 0.44% : 0.000007s : 2: substitution.replace_old_param 0.90% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006884 2 79.65% : 0.005483s : 1: type_inference.infer 20.35% : 0.001401s : 1: type_inference.specialize ------[replace.] 0.000099 6 72.38% : 0.000072s : 4: replace.inline 27.62% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001632 6 99.17% : 0.001619s : 4: match.inline 0.83% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.58% : 0.000002s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000003s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.04% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.86% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 7.54% : 0.000010s : 22: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 2.20% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 0.91% : 0.000001s : 10: predicate.minmaximum_grad 2.83% : 0.000004s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.41% : 0.000002s : 10: predicate.print_const_string_wrapper 2.32% : 0.000003s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.93% : 0.000001s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.70% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.18% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.60% : 0.000005s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.69% : 0.000009s : 53: predicate.switch_simplify 1.07% : 0.000001s : 10: predicate.tile_eliminate 1.03% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.55% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001100 13 57.33% : 0.000631s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.69% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.98% : 0.000407s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021744 72 0.29% : 0.000064s : 1: add_recomputation 0.35% : 0.000076s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.59% : 0.000346s : 1: bootstrap 0.18% : 0.000038s : 1: cconv 0.05% : 0.000011s : 1: convert_after_rewriter 0.14% : 0.000030s : 1: cse_after_recomputation 0.06% : 0.000013s : 1: environ_conv 0.13% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 36.22% : 0.007875s : 1: jit_opt_a 0.87% : 0.000188s : 1: jit_opt_after_cconv 0.28% : 0.000061s : 1: jit_opt_b 2.46% : 0.000534s : 1: loop_unroll 3.74% : 0.000813s : 1: mutable_eliminate 11.00% : 0.002393s : 26: opt.transform.jit_opt_a 0.24% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.13% : 0.000028s : 1: opt.transform.mutable_eliminate 0.12% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.67% : 0.000580s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000054s : 1: py_interpret_to_execute 0.10% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000021s : 1: remove_dup_value 2.90% : 0.000631s : 1: renormalize.infer 2.18% : 0.000474s : 1: renormalize.specialize 0.05% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000049s : 1: rewriter_after_opt_a 0.41% : 0.000089s : 1: rewriter_before_opt_a 0.44% : 0.000095s : 1: symbol_engine_optimizer 32.19% : 0.007000s : 1: type_inference TotalTime = 0.0342474, [30] [bootstrap]: 0.00036042 [type_inference]: 0.023847 [event_method]: 2.41e-05 [auto_monad]: 7.586e-05 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 0.00015216 [rewriter_before_opt_a]: 0.00012409 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00732856, [2] [Cycle 1]: 0.00252038, [27] [switch_simplify]: 6.757e-05 [loop_unroll]: 3.001e-05 [a_1]: 0.00061725 [with_stream_mark]: 1.981e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.27e-05 [specialize_transform]: 6.80002e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.192e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00140119 [add_forward_monad_depend]: 6.36e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.601e-05 [cse]: 3.494e-05 [replace_applicator]: 1.367e-05 [Cycle 2]: 0.00035955, [27] [switch_simplify]: 5.95002e-06 [loop_unroll]: 5.47999e-06 [a_1]: 9.017e-05 [with_stream_mark]: 1.009e-05 [recompute_prepare]: 5.35001e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.51001e-06 [inline_without_move]: 4.92e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.33998e-06 [cse]: 1.559e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.191e-05 [rewriter_after_opt_a]: 4.226e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00065619 [jit_opt_b]: 4.89e-05, [1] [Cycle 1]: 4.167e-05, [2] [frontend_op_eliminate]: 1.549e-05 [inline_after_opt_a]: 1.496e-05 [cconv]: 2.536e-05 [loop_unroll]: 0.00044339 [jit_opt_after_cconv]: 0.00013983, [1] [Cycle 1]: 0.00013358, [11] [c_1]: 2.068e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 5.36002e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.224e-05 [call_graph_tuple_transform]: 1.806e-05 [tuple_list_get_item_eliminator]: 5.30999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.22999e-06 [remove_dup_value]: 1.472e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 6.58e-06 [add_recomputation]: 5.023e-05 [cse_after_recomputation]: 2.28e-05, [1] [Cycle 1]: 1.76e-05, [1] [cse]: 1.153e-05 [auto_monad_reorder]: 1.661e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 4.84998e-06 [opt_after_jit_grad]: 0.0004687 [symbol_engine_optimizer]: 0.00011859, [1] [Cycle 1]: 0.00011211, [6] [build]: 3.59002e-06 [elim_shapecalc]: 2.882e-05 [elim_not_effective]: 3.411e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 9.15999e-06 [renormalize]: 8.2e-07 [validate]: 4.314e-05 Sums bootstrap : 0.000360s : 1.24% type_inference : 0.023847s : 81.76% event_method : 0.000024s : 0.08% auto_monad : 0.000076s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000152s : 0.52% rewriter_before_opt_a : 0.000124s : 0.43% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000707s : 2.43% jit_opt_a.with_stream_mark : 0.000030s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000024s : 0.08% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000047s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001401s : 4.80% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000051s : 0.17% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000656s : 2.25% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000025s : 0.09% loop_unroll : 0.000443s : 1.52% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000050s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000469s : 1.61% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000029s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000034s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.15% Time group info: ------[substitution.] 0.000272 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.80% : 0.000005s : 3: substitution.graph_param_transform 88.15% : 0.000240s : 4: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.59% : 0.000004s : 2: substitution.replace_old_param 4.12% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023753 2 90.70% : 0.021545s : 1: type_inference.infer 9.30% : 0.002208s : 1: type_inference.specialize ------[replace.] 0.000083 6 67.71% : 0.000056s : 4: replace.inline 32.29% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 6 95.93% : 0.000238s : 4: match.inline 4.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.51% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.39% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.50% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.00% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 1.09% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.51% : 0.000002s : 10: predicate.transpose_eliminate 1.29% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001143 13 38.38% : 0.000439s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.07% : 0.000069s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.55% : 0.000635s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036726 72 0.14% : 0.000053s : 1: add_recomputation 0.22% : 0.000080s : 1: auto_monad 0.05% : 0.000019s : 1: auto_monad_reorder 1.04% : 0.000381s : 1: bootstrap 0.08% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000030s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.97% : 0.007332s : 1: jit_opt_a 0.39% : 0.000142s : 1: jit_opt_after_cconv 0.14% : 0.000051s : 1: jit_opt_b 1.23% : 0.000451s : 1: loop_unroll 1.81% : 0.000665s : 1: mutable_eliminate 2.61% : 0.000957s : 26: opt.transform.jit_opt_a 0.13% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.14% : 0.000051s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000075s : 4: opt.transform.symbol_engine_opt 1.30% : 0.000477s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000157s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 2.09% : 0.000768s : 1: renormalize.infer 1.70% : 0.000624s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.35% : 0.000129s : 1: rewriter_before_opt_a 0.33% : 0.000121s : 1: symbol_engine_optimizer 64.99% : 0.023867s : 1: type_inference TotalTime = 0.0454853, [30] [bootstrap]: 0.00041516 [type_inference]: 0.0363013 [event_method]: 2.336e-05 [auto_monad]: 7.162e-05 [graph_reusing]: 7.16001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00011727 [rewriter_before_opt_a]: 8.655e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.0061725, [2] [Cycle 1]: 0.00217478, [27] [switch_simplify]: 6.222e-05 [loop_unroll]: 2.956e-05 [a_1]: 0.00058384 [with_stream_mark]: 2.405e-05 [recompute_prepare]: 9.39e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 4.10998e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.38002e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 9.75002e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00110027 [add_forward_monad_depend]: 7.36999e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.843e-05 [cse]: 3.918e-05 [replace_applicator]: 1.404e-05 [Cycle 2]: 0.00032297, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.15999e-06 [a_1]: 8.81e-05 [with_stream_mark]: 1.136e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 4.54998e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.345e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.16999e-06 [inline_without_move]: 4.65999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.63997e-06 [cse]: 1.443e-05 [replace_applicator]: 4.95999e-06 [py_interpret_to_execute_after_opt_a]: 1.519e-05 [rewriter_after_opt_a]: 3.961e-05 [convert_after_rewriter]: 7.45003e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00062685 [jit_opt_b]: 4.91e-05, [1] [Cycle 1]: 4.197e-05, [2] [frontend_op_eliminate]: 1.55e-05 [inline_after_opt_a]: 1.563e-05 [cconv]: 2.873e-05 [loop_unroll]: 0.00042976 [jit_opt_after_cconv]: 0.00015107, [1] [Cycle 1]: 0.00014449, [11] [c_1]: 2.084e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 7.13e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.577e-05 [call_graph_tuple_transform]: 2.026e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 6.29982e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.38e-05 [cse_after_recomputation]: 2.341e-05, [1] [Cycle 1]: 1.834e-05, [1] [cse]: 1.23e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 6.81999e-06 [opt_after_jit_grad]: 0.00047627 [symbol_engine_optimizer]: 7.208e-05, [1] [Cycle 1]: 6.594e-05, [6] [build]: 3.84002e-06 [elim_shapecalc]: 7.88999e-06 [elim_not_effective]: 1.324e-05 [opt_reshape]: 5.47999e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 7.60017e-07 [validate]: 4.243e-05 Sums bootstrap : 0.000415s : 1.01% type_inference : 0.036301s : 88.16% event_method : 0.000023s : 0.06% auto_monad : 0.000072s : 0.17% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000117s : 0.28% rewriter_before_opt_a : 0.000087s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.17% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000672s : 1.63% jit_opt_a.with_stream_mark : 0.000035s : 0.09% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001100s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000054s : 0.13% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000627s : 1.52% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000430s : 1.04% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000476s : 1.16% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.10% Time group info: ------[substitution.] 0.000248 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 85.66% : 0.000213s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000004s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 5.36% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036213 2 94.83% : 0.034340s : 1: type_inference.infer 5.17% : 0.001873s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.81% : 0.000052s : 4: replace.inline 31.19% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.51% : 0.000210s : 4: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 2.25% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.81% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 6.13% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.83% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.48% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.14% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001007 13 44.14% : 0.000444s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.62% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.24% : 0.000506s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047518 72 0.12% : 0.000056s : 1: add_recomputation 0.16% : 0.000075s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.94% : 0.000444s : 1: bootstrap 0.07% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 13.00% : 0.006176s : 1: jit_opt_a 0.32% : 0.000154s : 1: jit_opt_after_cconv 0.11% : 0.000052s : 1: jit_opt_b 0.92% : 0.000438s : 1: loop_unroll 1.34% : 0.000637s : 1: mutable_eliminate 1.89% : 0.000897s : 26: opt.transform.jit_opt_a 0.10% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.02% : 0.000485s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000122s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.39% : 0.000661s : 1: renormalize.infer 0.91% : 0.000430s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000043s : 1: rewriter_after_opt_a 0.19% : 0.000092s : 1: rewriter_before_opt_a 0.16% : 0.000074s : 1: symbol_engine_optimizer 76.44% : 0.036323s : 1: type_inference TotalTime = 0.0157417, [30] [bootstrap]: 0.00030499 [type_inference]: 0.00625738 [event_method]: 1.966e-05 [auto_monad]: 6.818e-05 [graph_reusing]: 6.78998e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 4.522e-05 [rewriter_before_opt_a]: 8.141e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.00644585, [2] [Cycle 1]: 0.00207849, [27] [switch_simplify]: 6.221e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00059462 [with_stream_mark]: 2.449e-05 [recompute_prepare]: 1.099e-05 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 5.14998e-06 [renormalize]: 0.00098119 [add_forward_monad_depend]: 9.97999e-06 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 1.942e-05 [cse]: 3.804e-05 [replace_applicator]: 1.6e-05 [Cycle 2]: 0.0003588, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.71998e-06 [a_1]: 8.908e-05 [with_stream_mark]: 1.293e-05 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 2.55002e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.06003e-06 [get_grad_eliminate_]: 5.04003e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 3.13e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 5.17e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.89999e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 7.32997e-06 [cse]: 1.701e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.457e-05 [rewriter_after_opt_a]: 4.116e-05 [convert_after_rewriter]: 7.20998e-06 [order_py_execute_after_rewriter]: 5.86e-06 [mutable_eliminate]: 0.00069717 [jit_opt_b]: 5.839e-05, [1] [Cycle 1]: 5.038e-05, [2] [frontend_op_eliminate]: 1.71e-05 [inline_after_opt_a]: 2.155e-05 [cconv]: 3.196e-05 [loop_unroll]: 0.00049063 [jit_opt_after_cconv]: 0.00016297, [1] [Cycle 1]: 0.00015594, [11] [c_1]: 2.153e-05 [parameter_eliminate]: 4.02e-06 [updatestate_depend_eliminate]: 6.07999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.944e-05 [call_graph_tuple_transform]: 2.581e-05 [tuple_list_get_item_eliminator]: 5.98998e-06 [none_parameter_eliminate]: 1.80001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.81e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 1.011e-05 [add_recomputation]: 5.158e-05 [cse_after_recomputation]: 2.775e-05, [1] [Cycle 1]: 2.192e-05, [1] [cse]: 1.446e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.45001e-06 [opt_after_jit_grad]: 0.00053592 [symbol_engine_optimizer]: 8.673e-05, [1] [Cycle 1]: 7.915e-05, [6] [build]: 1.115e-05 [elim_shapecalc]: 8.95001e-06 [elim_not_effective]: 1.394e-05 [opt_reshape]: 6.01998e-06 [fold_const_symbol]: 9.41998e-06 [renormalize]: 4.19997e-07 [validate]: 4.866e-05 Sums bootstrap : 0.000305s : 2.75% type_inference : 0.006257s : 56.40% event_method : 0.000020s : 0.18% auto_monad : 0.000068s : 0.61% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000045s : 0.41% rewriter_before_opt_a : 0.000081s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.62% jit_opt_a.loop_unroll : 0.000036s : 0.33% jit_opt_a.a_1 : 0.000684s : 6.16% jit_opt_a.with_stream_mark : 0.000037s : 0.34% jit_opt_a.recompute_prepare : 0.000016s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000006s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000981s : 8.84% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.11% jit_opt_a.auto_monad_grad : 0.000006s : 0.05% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.24% jit_opt_a.cse : 0.000055s : 0.50% jit_opt_a.replace_applicator : 0.000022s : 0.20% py_interpret_to_execute_after_opt_a : 0.000015s : 0.13% rewriter_after_opt_a : 0.000041s : 0.37% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000697s : 6.28% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000022s : 0.19% cconv : 0.000032s : 0.29% loop_unroll : 0.000491s : 4.42% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000018s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000010s : 0.09% add_recomputation : 0.000052s : 0.46% cse_after_recomputation.cse : 0.000014s : 0.13% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000536s : 4.83% symbol_engine_optimizer.build : 0.000011s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.44% Time group info: ------[substitution.] 0.000247 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 3: substitution.graph_param_transform 84.56% : 0.000209s : 4: substitution.inline 2.06% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000004s : 4: substitution.remove_not_recompute_node 2.25% : 0.000006s : 2: substitution.replace_old_param 5.56% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006176 2 79.39% : 0.004903s : 1: type_inference.infer 20.61% : 0.001273s : 1: type_inference.specialize ------[replace.] 0.000082 6 65.89% : 0.000054s : 4: replace.inline 34.11% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 6 94.30% : 0.000206s : 4: match.inline 5.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.35% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.65% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.69% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.35% : 0.000002s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.55% : 0.000008s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.93% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.13% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.48% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 1.11% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.71% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.66% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.52% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000807 13 49.21% : 0.000397s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.80% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.98% : 0.000363s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017707 72 0.31% : 0.000055s : 1: add_recomputation 0.41% : 0.000072s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.81% : 0.000321s : 1: bootstrap 0.20% : 0.000035s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000030s : 1: cse_after_recomputation 0.07% : 0.000013s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.42% : 0.006450s : 1: jit_opt_a 0.94% : 0.000166s : 1: jit_opt_after_cconv 0.35% : 0.000061s : 1: jit_opt_b 2.82% : 0.000500s : 1: loop_unroll 4.00% : 0.000708s : 1: mutable_eliminate 5.20% : 0.000920s : 26: opt.transform.jit_opt_a 0.31% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000032s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000019s : 1: opt.transform.mutable_eliminate 0.13% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.09% : 0.000547s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000048s : 1: py_interpret_to_execute 0.10% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.94% : 0.000521s : 1: renormalize.infer 2.54% : 0.000450s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000045s : 1: rewriter_after_opt_a 0.48% : 0.000085s : 1: rewriter_before_opt_a 0.50% : 0.000089s : 1: symbol_engine_optimizer 35.44% : 0.006275s : 1: type_inference TotalTime = 0.136308, [30] [bootstrap]: 0.00032407 [type_inference]: 0.123173 [event_method]: 2.493e-05 [auto_monad]: 7.697e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00058252 [rewriter_before_opt_a]: 9.637e-05 [expand_dump_flag]: 4.15999e-06 [jit_opt_a]: 0.0095301, [2] [Cycle 1]: 0.00552747, [27] [switch_simplify]: 6.283e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00062292 [with_stream_mark]: 2.112e-05 [recompute_prepare]: 9.76003e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 7.34002e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.064e-05 [inline_without_move]: 8.35999e-06 [renormalize]: 0.00440173 [add_forward_monad_depend]: 9.31e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.859e-05 [cse]: 3.817e-05 [replace_applicator]: 1.98e-05 [Cycle 2]: 0.00038516, [27] [switch_simplify]: 7.42002e-06 [loop_unroll]: 6.71999e-06 [a_1]: 0.00012587 [with_stream_mark]: 1.406e-05 [recompute_prepare]: 6.38e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.23998e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 2.22001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.641e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.39002e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.435e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.596e-05 [rewriter_after_opt_a]: 4.006e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00069853 [jit_opt_b]: 7.896e-05, [1] [Cycle 1]: 7.083e-05, [2] [frontend_op_eliminate]: 3.939e-05 [inline_after_opt_a]: 1.952e-05 [cconv]: 2.836e-05 [loop_unroll]: 0.00047139 [jit_opt_after_cconv]: 0.00017653, [1] [Cycle 1]: 0.00016996, [11] [c_1]: 2.824e-05 [parameter_eliminate]: 3.09999e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.50997e-06 [cse]: 2.792e-05 [call_graph_tuple_transform]: 2.578e-05 [tuple_list_get_item_eliminator]: 7.68001e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.61999e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 9.22001e-06 [add_recomputation]: 5.036e-05 [cse_after_recomputation]: 2.586e-05, [1] [Cycle 1]: 2.005e-05, [1] [cse]: 1.449e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 6.53e-06 [opt_after_jit_grad]: 0.00048699 [symbol_engine_optimizer]: 8.786e-05, [1] [Cycle 1]: 7.698e-05, [6] [build]: 4.79e-06 [elim_shapecalc]: 9.57001e-06 [elim_not_effective]: 1.573e-05 [opt_reshape]: 8.99998e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 5.19998e-07 [validate]: 5.415e-05 Sums bootstrap : 0.000324s : 0.25% type_inference : 0.123173s : 93.28% event_method : 0.000025s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000583s : 0.44% rewriter_before_opt_a : 0.000096s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000749s : 0.57% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004402s : 3.33% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000699s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000039s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000471s : 0.36% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000487s : 0.37% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.04% Time group info: ------[substitution.] 0.000252 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 3.30% : 0.000008s : 4: substitution.graph_param_transform 84.40% : 0.000213s : 4: substitution.inline 1.72% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 5.03% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123066 2 96.26% : 0.118461s : 1: type_inference.infer 3.74% : 0.004605s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.60% : 0.000056s : 4: replace.inline 32.40% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.81% : 0.000210s : 4: match.inline 5.19% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.61% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.78% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 6.02% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.50% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000001s : 12: predicate.print_const_string_wrapper 1.83% : 0.000002s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.41% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.87% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.68% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002815 22 61.03% : 0.001718s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.83% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.14% : 0.001045s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141802 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000346s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.72% : 0.009534s : 1: jit_opt_a 0.13% : 0.000179s : 1: jit_opt_after_cconv 0.06% : 0.000082s : 1: jit_opt_b 0.34% : 0.000480s : 1: loop_unroll 0.50% : 0.000708s : 1: mutable_eliminate 0.71% : 0.001006s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000052s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000589s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.31% : 0.003281s : 1: renormalize.infer 0.78% : 0.001108s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000090s : 1: symbol_engine_optimizer 86.88% : 0.123197s : 1: type_inference TotalTime = 0.281114, [30] [bootstrap]: 0.00041032 [type_inference]: 0.229318 [event_method]: 2.322e-05 [auto_monad]: 7.386e-05 [graph_reusing]: 6.88998e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 0.00039255 [rewriter_before_opt_a]: 0.00010099 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.0474986, [2] [Cycle 1]: 0.0173714, [27] [switch_simplify]: 7.083e-05 [loop_unroll]: 3.479e-05 [a_1]: 0.00073741 [with_stream_mark]: 2.308e-05 [recompute_prepare]: 1.157e-05 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.89002e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 8.03999e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 3.06001e-06 [get_grad_eliminate_]: 6.71999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.154e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 6.38998e-06 [renormalize]: 0.0160579 [add_forward_monad_depend]: 1.326e-05 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.398e-05 [cse]: 4.444e-05 [replace_applicator]: 2.582e-05 [Cycle 2]: 0.00045156, [27] [switch_simplify]: 7.75e-06 [loop_unroll]: 7.41999e-06 [a_1]: 0.0001313 [with_stream_mark]: 1.807e-05 [recompute_prepare]: 6.46e-06 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.83e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 3.02002e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 3.23e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.294e-05 [j_node_and_user_rematch]: 1.221e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.192e-05 [inline_without_move]: 6.07001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.92002e-06 [auto_monad_grad]: 1.32999e-06 [auto_monad_eliminator]: 1.001e-05 [cse]: 2.212e-05 [replace_applicator]: 8.64e-06 [py_interpret_to_execute_after_opt_a]: 2.12e-05 [rewriter_after_opt_a]: 4.864e-05 [convert_after_rewriter]: 9.44e-06 [order_py_execute_after_rewriter]: 5.62001e-06 [mutable_eliminate]: 0.00108555 [jit_opt_b]: 6.788e-05, [1] [Cycle 1]: 5.661e-05, [2] [frontend_op_eliminate]: 2.21e-05 [inline_after_opt_a]: 2.194e-05 [cconv]: 4.198e-05 [loop_unroll]: 0.00060102 [jit_opt_after_cconv]: 0.00021326, [1] [Cycle 1]: 0.00020379, [11] [c_1]: 2.774e-05 [parameter_eliminate]: 6.69001e-06 [updatestate_depend_eliminate]: 1.306e-05 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 2.75997e-06 [cse]: 4.831e-05 [call_graph_tuple_transform]: 2.888e-05 [tuple_list_get_item_eliminator]: 7.73001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 1.02998e-06 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 2.14e-05 [partial_unused_args_eliminate]: 2.93998e-06 [environ_conv]: 1.152e-05 [add_recomputation]: 6.234e-05 [cse_after_recomputation]: 3.391e-05, [1] [Cycle 1]: 2.713e-05, [1] [cse]: 1.796e-05 [auto_monad_reorder]: 2.028e-05 [get_jit_bprop_graph]: 2.83998e-06 [rewriter_after_jit_bprop_graph]: 8.99e-06 [opt_after_jit_grad]: 0.00062327 [symbol_engine_optimizer]: 8.638e-05, [1] [Cycle 1]: 7.894e-05, [6] [build]: 5.97999e-06 [elim_shapecalc]: 1.078e-05 [elim_not_effective]: 1.72e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 8.80013e-07 [validate]: 6.423e-05 Sums bootstrap : 0.000410s : 0.16% type_inference : 0.229318s : 91.48% event_method : 0.000023s : 0.01% auto_monad : 0.000074s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000393s : 0.16% rewriter_before_opt_a : 0.000101s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000869s : 0.35% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.016058s : 6.41% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.01% jit_opt_a.cse : 0.000067s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000049s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001086s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000042s : 0.02% loop_unroll : 0.000601s : 0.24% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000062s : 0.02% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000623s : 0.25% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000064s : 0.03% Time group info: ------[substitution.] 0.000291 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000007s : 4: substitution.graph_param_transform 84.43% : 0.000245s : 5: substitution.inline 1.97% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 2.50% : 0.000007s : 2: substitution.replace_old_param 5.40% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.229226 2 99.05% : 0.227047s : 1: type_inference.infer 0.95% : 0.002178s : 1: type_inference.specialize ------[replace.] 0.000113 7 68.31% : 0.000077s : 5: replace.inline 31.69% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 94.64% : 0.000242s : 5: match.inline 5.36% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 888 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.53% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.09% : 0.000002s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 6.38% : 0.000010s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 2.02% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.69% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.64% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.23% : 0.000002s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 13: predicate.same_eliminate 0.80% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000004s : 20: predicate.switch_defer_inline 1.97% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 65: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.14% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.102200 33 98.94% : 0.101121s : 24: func_graph_cloner_run.FuncGraphClonerGraph 0.07% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 0.98% : 0.001005s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.298409 72 0.02% : 0.000068s : 1: add_recomputation 0.03% : 0.000077s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.15% : 0.000438s : 1: bootstrap 0.02% : 0.000045s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000036s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 15.92% : 0.047503s : 1: jit_opt_a 0.07% : 0.000216s : 1: jit_opt_after_cconv 0.02% : 0.000071s : 1: jit_opt_b 0.21% : 0.000615s : 1: loop_unroll 0.37% : 0.001109s : 1: mutable_eliminate 0.39% : 0.001154s : 26: opt.transform.jit_opt_a 0.02% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000030s : 1: opt.transform.mutable_eliminate 0.01% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000637s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000404s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 5.00% : 0.014917s : 1: renormalize.infer 0.38% : 0.001125s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000054s : 1: rewriter_after_opt_a 0.04% : 0.000106s : 1: rewriter_before_opt_a 0.03% : 0.000089s : 1: symbol_engine_optimizer 76.85% : 0.229338s : 1: type_inference TotalTime = 0.0627836, [30] [bootstrap]: 0.00033946 [type_inference]: 0.0336198 [event_method]: 2.037e-05 [auto_monad]: 7.306e-05 [graph_reusing]: 7.14001e-06 [pre_auto_parallel]: 3.27997e-06 [py_interpret_to_execute]: 0.00010173 [rewriter_before_opt_a]: 8.44e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.0262938, [2] [Cycle 1]: 0.00198996, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 2.968e-05 [a_1]: 0.00056175 [with_stream_mark]: 2.151e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00095937 [add_forward_monad_depend]: 6.66999e-06 [auto_monad_grad]: 3.31001e-06 [auto_monad_eliminator]: 1.66e-05 [cse]: 3.627e-05 [replace_applicator]: 1.559e-05 [Cycle 2]: 0.00033311, [27] [switch_simplify]: 5.98998e-06 [loop_unroll]: 5.22e-06 [a_1]: 8.952e-05 [with_stream_mark]: 1.094e-05 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.494e-05 [j_node_and_user_rematch]: 8.49998e-06 [meta_fg_expand]: 1.73997e-06 [replace_old_param]: 7.71001e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.73002e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.61999e-06 [cse]: 1.534e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.473e-05 [rewriter_after_opt_a]: 8.086e-05 [convert_after_rewriter]: 8.12e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00056237 [jit_opt_b]: 5.016e-05, [1] [Cycle 1]: 4.258e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.572e-05 [cconv]: 2.876e-05 [loop_unroll]: 0.00042327 [jit_opt_after_cconv]: 0.00014594, [1] [Cycle 1]: 0.00013828, [11] [c_1]: 1.996e-05 [parameter_eliminate]: 3.34001e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.51e-05 [call_graph_tuple_transform]: 1.806e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.19998e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 2.491e-05 [add_recomputation]: 5.391e-05 [cse_after_recomputation]: 2.577e-05, [1] [Cycle 1]: 2.001e-05, [1] [cse]: 1.331e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.40001e-06 [opt_after_jit_grad]: 0.00047766 [symbol_engine_optimizer]: 7.19e-05, [1] [Cycle 1]: 6.456e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 7.57998e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 8.60001e-06 [renormalize]: 4.39992e-07 [validate]: 3.753e-05 Sums bootstrap : 0.000339s : 0.89% type_inference : 0.033620s : 87.97% event_method : 0.000020s : 0.05% auto_monad : 0.000073s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.27% rewriter_before_opt_a : 0.000084s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.17% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000651s : 1.70% jit_opt_a.with_stream_mark : 0.000032s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000959s : 2.51% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000052s : 0.14% jit_opt_a.replace_applicator : 0.000021s : 0.06% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000081s : 0.21% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000562s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.08% loop_unroll : 0.000423s : 1.11% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000025s : 0.07% add_recomputation : 0.000054s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000478s : 1.25% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.10% Time group info: ------[substitution.] 0.000227 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000005s : 3: substitution.graph_param_transform 84.72% : 0.000192s : 4: substitution.inline 1.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 5.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033540 2 95.18% : 0.031922s : 1: type_inference.infer 4.82% : 0.001618s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.50% : 0.000054s : 4: replace.inline 30.50% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.28% : 0.000189s : 4: match.inline 5.72% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.81% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.24% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.47% : 0.000002s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 2.05% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000965 13 45.60% : 0.000440s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.27% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.13% : 0.000484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064673 72 0.09% : 0.000057s : 1: add_recomputation 0.12% : 0.000077s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.55% : 0.000354s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000027s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 40.66% : 0.026298s : 1: jit_opt_a 0.23% : 0.000148s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.67% : 0.000432s : 1: loop_unroll 0.89% : 0.000572s : 1: mutable_eliminate 1.36% : 0.000877s : 26: opt.transform.jit_opt_a 0.07% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000106s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.83% : 0.000536s : 1: renormalize.infer 0.64% : 0.000414s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000086s : 1: rewriter_after_opt_a 0.14% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000074s : 1: symbol_engine_optimizer 52.01% : 0.033638s : 1: type_inference TotalTime = 0.0150418, [30] [bootstrap]: 0.00038133 [type_inference]: 0.00621293 [event_method]: 2.086e-05 [auto_monad]: 5.548e-05 [graph_reusing]: 4.55999e-06 [pre_auto_parallel]: 1.73002e-06 [py_interpret_to_execute]: 4.574e-05 [rewriter_before_opt_a]: 0.00014227 [expand_dump_flag]: 8.40001e-06 [jit_opt_a]: 0.00556861, [2] [Cycle 1]: 0.0018704, [27] [switch_simplify]: 5.348e-05 [loop_unroll]: 2.993e-05 [a_1]: 0.00054289 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 9.16002e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.18002e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.301e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 1.91998e-06 [replace_old_param]: 7.86001e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00087913 [add_forward_monad_depend]: 8.36002e-06 [auto_monad_grad]: 2.85998e-06 [auto_monad_eliminator]: 1.927e-05 [cse]: 3.688e-05 [replace_applicator]: 1.655e-05 [Cycle 2]: 0.00034201, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.10001e-06 [a_1]: 8.948e-05 [with_stream_mark]: 1.264e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.68003e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 3.05998e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 7.18e-06 [cse]: 1.591e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.553e-05 [rewriter_after_opt_a]: 3.836e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.0006809 [jit_opt_b]: 6.017e-05, [1] [Cycle 1]: 5.167e-05, [2] [frontend_op_eliminate]: 1.761e-05 [inline_after_opt_a]: 1.75e-05 [cconv]: 2.935e-05 [loop_unroll]: 0.0004951 [jit_opt_after_cconv]: 0.00015741, [1] [Cycle 1]: 0.00015025, [11] [c_1]: 2.302e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 7.93001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.4e-05 [call_graph_tuple_transform]: 1.937e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.737e-05 [partial_unused_args_eliminate]: 2.84999e-06 [environ_conv]: 1.079e-05 [add_recomputation]: 0.00013314 [cse_after_recomputation]: 3.351e-05, [1] [Cycle 1]: 2.612e-05, [1] [cse]: 1.604e-05 [auto_monad_reorder]: 2.015e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 6.54999e-06 [opt_after_jit_grad]: 0.00049243 [symbol_engine_optimizer]: 0.00014204, [1] [Cycle 1]: 0.00013589, [6] [build]: 6.845e-05 [elim_shapecalc]: 9.14998e-06 [elim_not_effective]: 1.361e-05 [opt_reshape]: 5.56998e-06 [fold_const_symbol]: 8.91002e-06 [renormalize]: 8.39995e-07 [validate]: 5.292e-05 Sums bootstrap : 0.000381s : 3.45% type_inference : 0.006213s : 56.19% event_method : 0.000021s : 0.19% auto_monad : 0.000055s : 0.50% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.41% rewriter_before_opt_a : 0.000142s : 1.29% expand_dump_flag : 0.000008s : 0.08% jit_opt_a.switch_simplify : 0.000059s : 0.54% jit_opt_a.loop_unroll : 0.000035s : 0.32% jit_opt_a.a_1 : 0.000632s : 5.72% jit_opt_a.with_stream_mark : 0.000030s : 0.27% jit_opt_a.recompute_prepare : 0.000015s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000879s : 7.95% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.24% jit_opt_a.cse : 0.000053s : 0.48% jit_opt_a.replace_applicator : 0.000023s : 0.20% py_interpret_to_execute_after_opt_a : 0.000016s : 0.14% rewriter_after_opt_a : 0.000038s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000681s : 6.16% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.16% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000029s : 0.27% loop_unroll : 0.000495s : 4.48% jit_opt_after_cconv.c_1 : 0.000023s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000011s : 0.10% add_recomputation : 0.000133s : 1.20% cse_after_recomputation.cse : 0.000016s : 0.15% auto_monad_reorder : 0.000020s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000492s : 4.45% symbol_engine_optimizer.build : 0.000068s : 0.62% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000053s : 0.48% Time group info: ------[substitution.] 0.000179 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000002s : 2: substitution.fold_const_symbol 3.38% : 0.000006s : 3: substitution.graph_param_transform 83.10% : 0.000149s : 4: substitution.inline 1.94% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 5.49% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006133 2 79.51% : 0.004877s : 1: type_inference.infer 20.49% : 0.001257s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.00% : 0.000044s : 4: replace.inline 34.00% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 94.38% : 0.000147s : 4: match.inline 5.62% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.17% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.13% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.32% : 0.000002s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.61% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.10% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.73% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.10% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000820 13 50.68% : 0.000416s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.04% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.28% : 0.000371s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016809 72 0.83% : 0.000139s : 1: add_recomputation 0.35% : 0.000059s : 1: auto_monad 0.14% : 0.000023s : 1: auto_monad_reorder 2.40% : 0.000404s : 1: bootstrap 0.19% : 0.000032s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.21% : 0.000036s : 1: cse_after_recomputation 0.08% : 0.000013s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.06% : 0.000011s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 33.15% : 0.005572s : 1: jit_opt_a 0.95% : 0.000160s : 1: jit_opt_after_cconv 0.37% : 0.000063s : 1: jit_opt_b 3.00% : 0.000504s : 1: loop_unroll 4.12% : 0.000692s : 1: mutable_eliminate 5.03% : 0.000846s : 26: opt.transform.jit_opt_a 0.30% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000017s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.98% : 0.000500s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000049s : 1: py_interpret_to_execute 0.11% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 2.80% : 0.000470s : 1: renormalize.infer 2.38% : 0.000401s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000041s : 1: rewriter_after_opt_a 0.87% : 0.000147s : 1: rewriter_before_opt_a 0.86% : 0.000145s : 1: symbol_engine_optimizer 37.06% : 0.006230s : 1: type_inference TotalTime = 0.580427, [30] [bootstrap]: 0.00043801 [type_inference]: 0.568225 [event_method]: 2.241e-05 [auto_monad]: 7.825e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 0.00045784 [rewriter_before_opt_a]: 0.00010334 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00848364, [2] [Cycle 1]: 0.00409085, [27] [switch_simplify]: 6.63e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.00071566 [with_stream_mark]: 2.63e-05 [recompute_prepare]: 8.25999e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 7.00002e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.11998e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.40002e-06 [merge_forward]: 4.19002e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 1.056e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00288229 [add_forward_monad_depend]: 8.46002e-06 [auto_monad_grad]: 3.21001e-06 [auto_monad_eliminator]: 1.71e-05 [cse]: 2.77e-05 [replace_applicator]: 1.667e-05 [Cycle 2]: 0.00041176, [27] [switch_simplify]: 7.06999e-06 [loop_unroll]: 6.60997e-06 [a_1]: 0.0001392 [with_stream_mark]: 1.462e-05 [recompute_prepare]: 6.71999e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.66998e-06 [specialize_transform]: 6.33002e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.69001e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 2.73998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.16002e-06 [inline_without_move]: 5.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.17001e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.67e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 1.421e-05 [rewriter_after_opt_a]: 3.85e-05 [convert_after_rewriter]: 6.48e-06 [order_py_execute_after_rewriter]: 4.65999e-06 [mutable_eliminate]: 0.00071099 [jit_opt_b]: 5.768e-05, [1] [Cycle 1]: 4.999e-05, [2] [frontend_op_eliminate]: 1.944e-05 [inline_after_opt_a]: 1.954e-05 [cconv]: 8.42e-05 [loop_unroll]: 0.00047754 [jit_opt_after_cconv]: 0.00016516, [1] [Cycle 1]: 0.00015781, [11] [c_1]: 2.613e-05 [parameter_eliminate]: 3.58e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.917e-05 [call_graph_tuple_transform]: 2.151e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.10999e-06 [renormalize]: 4.70027e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 1.94999e-06 [environ_conv]: 7.53999e-06 [add_recomputation]: 4.175e-05 [cse_after_recomputation]: 2.559e-05, [1] [Cycle 1]: 2.012e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.303e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 7.03e-06 [opt_after_jit_grad]: 0.0004857 [symbol_engine_optimizer]: 7.717e-05, [1] [Cycle 1]: 7.095e-05, [6] [build]: 2.49999e-06 [elim_shapecalc]: 9.57999e-06 [elim_not_effective]: 1.477e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 1.023e-05 [renormalize]: 4.50003e-07 [validate]: 0.00011802 Sums bootstrap : 0.000438s : 0.08% type_inference : 0.568225s : 98.69% event_method : 0.000022s : 0.00% auto_monad : 0.000078s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000458s : 0.08% rewriter_before_opt_a : 0.000103s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000855s : 0.15% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002882s : 0.50% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.00% jit_opt_a.cse : 0.000044s : 0.01% jit_opt_a.replace_applicator : 0.000023s : 0.00% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000711s : 0.12% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000084s : 0.01% loop_unroll : 0.000478s : 0.08% jit_opt_after_cconv.c_1 : 0.000026s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000042s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000013s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000486s : 0.08% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000118s : 0.02% Time group info: ------[substitution.] 0.000300 28 1.04% : 0.000003s : 2: substitution.elim_not_effective 0.31% : 0.000001s : 2: substitution.fold_const_symbol 1.85% : 0.000006s : 4: substitution.graph_param_transform 82.94% : 0.000249s : 5: substitution.inline 1.74% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.39% : 0.000013s : 3: substitution.reduce_eliminate 1.83% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000005s : 2: substitution.replace_old_param 4.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.568079 2 91.65% : 0.520649s : 1: type_inference.infer 8.35% : 0.047430s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.29% : 0.000066s : 5: replace.inline 31.71% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 95.92% : 0.000246s : 5: match.inline 4.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 6.34% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 19: predicate.load_eliminater 0.99% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.46% : 0.000004s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.40% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 20: predicate.switch_defer_inline 2.50% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.42% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.86% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.039123 25 97.72% : 0.038229s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.23% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 2.06% : 0.000805s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.584366 72 0.01% : 0.000045s : 1: add_recomputation 0.01% : 0.000081s : 1: auto_monad 0.00% : 0.000015s : 1: auto_monad_reorder 0.08% : 0.000462s : 1: bootstrap 0.01% : 0.000087s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.00% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 1.45% : 0.008488s : 1: jit_opt_a 0.03% : 0.000168s : 1: jit_opt_after_cconv 0.01% : 0.000060s : 1: jit_opt_b 0.08% : 0.000486s : 1: loop_unroll 0.12% : 0.000721s : 1: mutable_eliminate 0.19% : 0.001108s : 26: opt.transform.jit_opt_a 0.01% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.00% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000495s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000466s : 1: py_interpret_to_execute 0.00% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000018s : 1: remove_dup_value 0.35% : 0.002064s : 1: renormalize.infer 0.14% : 0.000808s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.02% : 0.000109s : 1: rewriter_before_opt_a 0.01% : 0.000080s : 1: symbol_engine_optimizer 97.24% : 0.568243s : 1: type_inference TotalTime = 0.417823, [30] [bootstrap]: 0.00037836 [type_inference]: 0.351775 [event_method]: 2.204e-05 [auto_monad]: 8.201e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00065386 [rewriter_before_opt_a]: 0.00010169 [expand_dump_flag]: 3.81001e-06 [jit_opt_a]: 0.0619419, [2] [Cycle 1]: 0.0573163, [27] [switch_simplify]: 7.034e-05 [loop_unroll]: 3.144e-05 [a_1]: 0.00067875 [with_stream_mark]: 2.484e-05 [recompute_prepare]: 1.156e-05 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 4.62e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.672e-05 [j_node_and_user_rematch]: 1.137e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.203e-05 [inline_without_move]: 6.85002e-06 [renormalize]: 0.0559754 [add_forward_monad_depend]: 1.326e-05 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.715e-05 [cse]: 0.00012441 [replace_applicator]: 2.982e-05 [Cycle 2]: 0.0004525, [27] [switch_simplify]: 7.29001e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00013655 [with_stream_mark]: 2.019e-05 [recompute_prepare]: 7.03998e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.91003e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 4.86002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.301e-05 [j_node_and_user_rematch]: 1.109e-05 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 1.234e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.41e-06 [auto_monad_grad]: 1.49e-06 [auto_monad_eliminator]: 9.79999e-06 [cse]: 1.826e-05 [replace_applicator]: 7.58001e-06 [py_interpret_to_execute_after_opt_a]: 2.072e-05 [rewriter_after_opt_a]: 4.838e-05 [convert_after_rewriter]: 8.95999e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00083092 [jit_opt_b]: 6.432e-05, [1] [Cycle 1]: 5.42e-05, [2] [frontend_op_eliminate]: 2.083e-05 [inline_after_opt_a]: 1.947e-05 [cconv]: 3.267e-05 [loop_unroll]: 0.00051121 [jit_opt_after_cconv]: 0.00017455, [1] [Cycle 1]: 0.00016698, [11] [c_1]: 2.641e-05 [parameter_eliminate]: 4.68999e-06 [updatestate_depend_eliminate]: 1.101e-05 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 2.864e-05 [call_graph_tuple_transform]: 2.35e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 6.01998e-06 [remove_dup_value]: 1.706e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 1.051e-05 [add_recomputation]: 5.354e-05 [cse_after_recomputation]: 2.681e-05, [1] [Cycle 1]: 1.959e-05, [1] [cse]: 1.216e-05 [auto_monad_reorder]: 1.872e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 7.42998e-06 [opt_after_jit_grad]: 0.0005395 [symbol_engine_optimizer]: 8.198e-05, [1] [Cycle 1]: 7.561e-05, [6] [build]: 4.62998e-06 [elim_shapecalc]: 9.46e-06 [elim_not_effective]: 1.605e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 1.211e-05 [renormalize]: 7.09988e-07 [validate]: 0.00017104 Sums bootstrap : 0.000378s : 0.09% type_inference : 0.351775s : 85.19% event_method : 0.000022s : 0.01% auto_monad : 0.000082s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000654s : 0.16% rewriter_before_opt_a : 0.000102s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000815s : 0.20% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.055975s : 13.56% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000143s : 0.03% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000048s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000831s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000033s : 0.01% loop_unroll : 0.000511s : 0.12% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000054s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000540s : 0.13% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000171s : 0.04% Time group info: ------[substitution.] 0.000291 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000006s : 4: substitution.graph_param_transform 84.62% : 0.000246s : 4: substitution.inline 2.06% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000007s : 4: substitution.remove_not_recompute_node 2.72% : 0.000008s : 2: substitution.replace_old_param 4.98% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.351662 2 98.99% : 0.348098s : 1: type_inference.infer 1.01% : 0.003564s : 1: type_inference.specialize ------[replace.] 0.000085 6 67.63% : 0.000057s : 4: replace.inline 32.37% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 6 94.78% : 0.000243s : 4: match.inline 5.22% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.45% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 12: predicate.addn_check_dump 1.68% : 0.000002s : 12: predicate.addn_zero_filter 2.23% : 0.000003s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 0.92% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.62% : 0.000001s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 26: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.64% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 2.15% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.31% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.97% : 0.000003s : 18: predicate.switch_defer_inline 1.81% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.05% : 0.000010s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003078 22 60.63% : 0.001866s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.91% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.46% : 0.001153s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.474842 72 0.01% : 0.000057s : 1: add_recomputation 0.02% : 0.000086s : 1: auto_monad 0.00% : 0.000022s : 1: auto_monad_reorder 0.09% : 0.000405s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000012s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 13.05% : 0.061947s : 1: jit_opt_a 0.04% : 0.000177s : 1: jit_opt_after_cconv 0.01% : 0.000067s : 1: jit_opt_b 0.11% : 0.000522s : 1: loop_unroll 0.18% : 0.000842s : 1: mutable_eliminate 0.23% : 0.001100s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000550s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000662s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 11.51% : 0.054671s : 1: renormalize.infer 0.27% : 0.001285s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000052s : 1: rewriter_after_opt_a 0.02% : 0.000108s : 1: rewriter_before_opt_a 0.02% : 0.000088s : 1: symbol_engine_optimizer 74.09% : 0.351799s : 1: type_inference TotalTime = 0.132721, [30] [bootstrap]: 0.00031099 [type_inference]: 0.118597 [event_method]: 2.48e-05 [auto_monad]: 7.347e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 0.00058769 [rewriter_before_opt_a]: 9.445e-05 [expand_dump_flag]: 4.35e-06 [jit_opt_a]: 0.0105458, [2] [Cycle 1]: 0.00643925, [27] [switch_simplify]: 0.00132175 [loop_unroll]: 3.336e-05 [a_1]: 0.00065293 [with_stream_mark]: 2.19e-05 [recompute_prepare]: 1.036e-05 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 6.60002e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.678e-05 [j_node_and_user_rematch]: 1.077e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 1.144e-05 [inline_without_move]: 7.05e-06 [renormalize]: 0.00401531 [add_forward_monad_depend]: 1.268e-05 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.731e-05 [cse]: 3.683e-05 [replace_applicator]: 2.053e-05 [Cycle 2]: 0.00037608, [27] [switch_simplify]: 7.58001e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00012467 [with_stream_mark]: 1.235e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.645e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.03002e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.76e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.379e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.401e-05 [rewriter_after_opt_a]: 3.962e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00070024 [jit_opt_b]: 5.804e-05, [1] [Cycle 1]: 5.028e-05, [2] [frontend_op_eliminate]: 1.999e-05 [inline_after_opt_a]: 1.835e-05 [cconv]: 2.846e-05 [loop_unroll]: 0.00041572 [jit_opt_after_cconv]: 0.00015913, [1] [Cycle 1]: 0.00015263, [11] [c_1]: 2.797e-05 [parameter_eliminate]: 2.60002e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.473e-05 [call_graph_tuple_transform]: 2.201e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.65998e-06 [remove_dup_value]: 1.754e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 9.94999e-06 [add_recomputation]: 4.963e-05 [cse_after_recomputation]: 2.514e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.358e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 2.46998e-06 [rewriter_after_jit_bprop_graph]: 4.83001e-06 [opt_after_jit_grad]: 0.00048583 [symbol_engine_optimizer]: 7.795e-05, [1] [Cycle 1]: 7.152e-05, [6] [build]: 4.08001e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 9.92999e-06 [renormalize]: 3.80009e-07 [validate]: 9.192e-05 Sums bootstrap : 0.000311s : 0.24% type_inference : 0.118597s : 92.43% event_method : 0.000025s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000588s : 0.46% rewriter_before_opt_a : 0.000094s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.001329s : 1.04% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000778s : 0.61% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004015s : 3.13% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000700s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000416s : 0.32% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000486s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000092s : 0.07% Time group info: ------[substitution.] 0.000268 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000007s : 4: substitution.graph_param_transform 85.76% : 0.000229s : 4: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000006s : 4: substitution.remove_not_recompute_node 2.13% : 0.000006s : 2: substitution.replace_old_param 4.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118497 2 95.99% : 0.113745s : 1: type_inference.infer 4.01% : 0.004751s : 1: type_inference.specialize ------[replace.] 0.000086 6 67.57% : 0.000058s : 4: replace.inline 32.43% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.26% : 0.000227s : 4: match.inline 4.74% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000002s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 6.24% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.27% : 0.000003s : 18: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 2.19% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002791 22 61.84% : 0.001726s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.01% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.15% : 0.001009s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139049 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.28% : 0.000389s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.59% : 0.010550s : 1: jit_opt_a 0.12% : 0.000162s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.30% : 0.000424s : 1: loop_unroll 0.51% : 0.000710s : 1: mutable_eliminate 1.65% : 0.002294s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000595s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.16% : 0.003003s : 1: renormalize.infer 0.72% : 0.001002s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 85.31% : 0.118622s : 1: type_inference TotalTime = 0.0179101, [30] [bootstrap]: 0.00032653 [type_inference]: 0.0088213 [event_method]: 2.25e-05 [auto_monad]: 7.287e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 4.688e-05 [rewriter_before_opt_a]: 8.035e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.00614642, [2] [Cycle 1]: 0.00213043, [27] [switch_simplify]: 6.575e-05 [loop_unroll]: 3.204e-05 [a_1]: 0.00073167 [with_stream_mark]: 2.623e-05 [recompute_prepare]: 1.032e-05 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.0009014 [add_forward_monad_depend]: 7.1e-06 [auto_monad_grad]: 3.16001e-06 [auto_monad_eliminator]: 1.9e-05 [cse]: 3.602e-05 [replace_applicator]: 1.668e-05 [Cycle 2]: 0.00033581, [27] [switch_simplify]: 5.63002e-06 [loop_unroll]: 4.81997e-06 [a_1]: 9.683e-05 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 4.89998e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.171e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.75e-06 [inline_without_move]: 4.58999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.224e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 1.441e-05 [rewriter_after_opt_a]: 4.003e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.0006515 [jit_opt_b]: 5.083e-05, [1] [Cycle 1]: 4.321e-05, [2] [frontend_op_eliminate]: 1.629e-05 [inline_after_opt_a]: 1.539e-05 [cconv]: 3.093e-05 [loop_unroll]: 0.00045109 [jit_opt_after_cconv]: 0.00016421, [1] [Cycle 1]: 0.00015731, [11] [c_1]: 1.997e-05 [parameter_eliminate]: 4.36002e-06 [updatestate_depend_eliminate]: 7.53999e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.904e-05 [call_graph_tuple_transform]: 2.844e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.766e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 7.61001e-06 [add_recomputation]: 5.188e-05 [cse_after_recomputation]: 2.479e-05, [1] [Cycle 1]: 1.891e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 6.20002e-06 [opt_after_jit_grad]: 0.00052819 [symbol_engine_optimizer]: 7.406e-05, [1] [Cycle 1]: 6.773e-05, [6] [build]: 3.5e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 1.403e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 9.04998e-06 [renormalize]: 3.39991e-07 [validate]: 4.281e-05 Sums bootstrap : 0.000327s : 2.40% type_inference : 0.008821s : 64.81% event_method : 0.000022s : 0.17% auto_monad : 0.000073s : 0.54% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.34% rewriter_before_opt_a : 0.000080s : 0.59% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.52% jit_opt_a.loop_unroll : 0.000037s : 0.27% jit_opt_a.a_1 : 0.000829s : 6.09% jit_opt_a.with_stream_mark : 0.000039s : 0.28% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000901s : 6.62% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.18% jit_opt_a.cse : 0.000048s : 0.35% jit_opt_a.replace_applicator : 0.000022s : 0.16% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000040s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000651s : 4.79% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000031s : 0.23% loop_unroll : 0.000451s : 3.31% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.06% add_recomputation : 0.000052s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000528s : 3.88% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.31% Time group info: ------[substitution.] 0.000296 27 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000006s : 3: substitution.graph_param_transform 83.98% : 0.000248s : 5: substitution.inline 1.52% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.19% : 0.000012s : 3: substitution.reduce_eliminate 1.38% : 0.000004s : 4: substitution.remove_not_recompute_node 1.75% : 0.000005s : 2: substitution.replace_old_param 4.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008745 2 88.46% : 0.007736s : 1: type_inference.infer 11.54% : 0.001009s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.35% : 0.000066s : 5: replace.inline 31.65% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 95.74% : 0.000246s : 5: match.inline 4.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.35% : 0.000002s : 11: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 11: predicate.addn_check_dump 1.20% : 0.000002s : 11: predicate.addn_zero_filter 1.93% : 0.000002s : 11: predicate.arithmetic_simplify 1.17% : 0.000001s : 11: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.36% : 0.000002s : 11: predicate.depend_value_elim 1.35% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.50% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.51% : 0.000008s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.86% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.07% : 0.000001s : 11: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.23% : 0.000003s : 16: predicate.partial_eliminate 1.36% : 0.000002s : 11: predicate.print_const_string_wrapper 2.57% : 0.000003s : 11: predicate.reduce_eliminate 1.32% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 19: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.50% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.63% : 0.000010s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.35% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 11: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000861 16 50.86% : 0.000438s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.76% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.38% : 0.000339s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019925 72 0.28% : 0.000055s : 1: add_recomputation 0.38% : 0.000076s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.74% : 0.000347s : 1: bootstrap 0.17% : 0.000034s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.86% : 0.006150s : 1: jit_opt_a 0.84% : 0.000167s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.31% : 0.000459s : 1: loop_unroll 3.33% : 0.000664s : 1: mutable_eliminate 5.31% : 0.001058s : 26: opt.transform.jit_opt_a 0.28% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.69% : 0.000536s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000049s : 1: py_interpret_to_execute 0.09% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 2.63% : 0.000525s : 1: renormalize.infer 1.84% : 0.000367s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000043s : 1: rewriter_after_opt_a 0.42% : 0.000083s : 1: rewriter_before_opt_a 0.38% : 0.000076s : 1: symbol_engine_optimizer 44.38% : 0.008843s : 1: type_inference TotalTime = 0.0925353, [30] [bootstrap]: 0.00039963 [type_inference]: 0.0397441 [event_method]: 2.146e-05 [auto_monad]: 7.382e-05 [graph_reusing]: 6.70998e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00012088 [rewriter_before_opt_a]: 8.963e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.0493905, [2] [Cycle 1]: 0.0451149, [27] [switch_simplify]: 5.735e-05 [loop_unroll]: 2.923e-05 [a_1]: 0.0005636 [with_stream_mark]: 2.284e-05 [recompute_prepare]: 1.155e-05 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.50003e-06 [updatestate_loads_eliminate]: 3.48999e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.65998e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.662e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 1.056e-05 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00111107 [add_forward_monad_depend]: 8.03999e-06 [auto_monad_grad]: 2.73998e-06 [auto_monad_eliminator]: 1.805e-05 [cse]: 0.042931 [replace_applicator]: 3.195e-05 [Cycle 2]: 0.00044673, [27] [switch_simplify]: 8.49002e-06 [loop_unroll]: 7.07002e-06 [a_1]: 0.00011239 [with_stream_mark]: 2.742e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 5.44998e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 7.26001e-06 [meta_shard_fg_expand]: 3.45e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 4.68001e-06 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.209e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 3.21001e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 5.64e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 5.00001e-06 [auto_monad_grad]: 3.56999e-06 [auto_monad_eliminator]: 1.69e-05 [cse]: 3.385e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 2.003e-05 [rewriter_after_opt_a]: 4.242e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 5.67001e-06 [mutable_eliminate]: 0.00085463 [jit_opt_b]: 5.581e-05, [1] [Cycle 1]: 4.766e-05, [2] [frontend_op_eliminate]: 1.73e-05 [inline_after_opt_a]: 1.817e-05 [cconv]: 3.63e-05 [loop_unroll]: 0.00047769 [jit_opt_after_cconv]: 0.0001646, [1] [Cycle 1]: 0.0001573, [11] [c_1]: 2.129e-05 [parameter_eliminate]: 4.03001e-06 [updatestate_depend_eliminate]: 6.24999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.157e-05 [call_graph_tuple_transform]: 2.317e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 1.00999e-06 [switch_simplify]: 5.59998e-06 [remove_dup_value]: 1.804e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 6.37001e-06 [add_recomputation]: 5.473e-05 [cse_after_recomputation]: 2.564e-05, [1] [Cycle 1]: 1.873e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.777e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 6.43e-06 [opt_after_jit_grad]: 0.00051407 [symbol_engine_optimizer]: 0.00011081, [1] [Cycle 1]: 0.00010321, [6] [build]: 3.95e-06 [elim_shapecalc]: 4.163e-05 [elim_not_effective]: 1.456e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 8.89995e-07 [validate]: 4.594e-05 Sums bootstrap : 0.000400s : 0.45% type_inference : 0.039744s : 45.16% event_method : 0.000021s : 0.02% auto_monad : 0.000074s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000121s : 0.14% rewriter_before_opt_a : 0.000090s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.07% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000676s : 0.77% jit_opt_a.with_stream_mark : 0.000050s : 0.06% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001111s : 1.26% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.04% jit_opt_a.cse : 0.042965s : 48.82% jit_opt_a.replace_applicator : 0.000038s : 0.04% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000042s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000855s : 0.97% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000036s : 0.04% loop_unroll : 0.000478s : 0.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000514s : 0.58% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000042s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.05% Time group info: ------[substitution.] 0.000224 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 3: substitution.graph_param_transform 81.78% : 0.000183s : 4: substitution.inline 2.50% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 3.52% : 0.000008s : 2: substitution.replace_old_param 5.91% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039660 2 95.42% : 0.037846s : 1: type_inference.infer 4.58% : 0.001815s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.31% : 0.000054s : 4: replace.inline 31.69% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 93.71% : 0.000181s : 4: match.inline 6.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.55% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.82% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.61% : 0.000002s : 10: predicate.environ_get_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000008s : 22: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.80% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.80% : 0.000002s : 15: predicate.partial_eliminate 1.18% : 0.000002s : 10: predicate.print_const_string_wrapper 2.04% : 0.000003s : 10: predicate.reduce_eliminate 1.91% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000003s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 10: predicate.same_eliminate 0.93% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.11% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000011s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.80% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001001 13 48.09% : 0.000481s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.92% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.99% : 0.000480s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.094635 72 0.06% : 0.000058s : 1: add_recomputation 0.08% : 0.000078s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.45% : 0.000424s : 1: bootstrap 0.04% : 0.000039s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 52.19% : 0.049395s : 1: jit_opt_a 0.18% : 0.000168s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.52% : 0.000488s : 1: loop_unroll 0.92% : 0.000866s : 1: mutable_eliminate 0.99% : 0.000934s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000523s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000126s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000031s : 1: remove_dup_value 0.68% : 0.000645s : 1: renormalize.infer 0.48% : 0.000456s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000046s : 1: rewriter_after_opt_a 0.10% : 0.000094s : 1: rewriter_before_opt_a 0.12% : 0.000113s : 1: symbol_engine_optimizer 42.02% : 0.039762s : 1: type_inference TotalTime = 0.0890423, [30] [bootstrap]: 0.000358 [type_inference]: 0.0772667 [event_method]: 2.064e-05 [auto_monad]: 7.154e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 0.00011246 [rewriter_before_opt_a]: 8.172e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.00893546, [2] [Cycle 1]: 0.00192901, [27] [switch_simplify]: 6.198e-05 [loop_unroll]: 2.935e-05 [a_1]: 0.00053799 [with_stream_mark]: 1.992e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 5.73002e-06 [renormalize]: 0.00092822 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.665e-05 [cse]: 3.503e-05 [replace_applicator]: 1.45e-05 [Cycle 2]: 0.00032337, [27] [switch_simplify]: 5.96998e-06 [loop_unroll]: 5.10999e-06 [a_1]: 8.925e-05 [with_stream_mark]: 1.061e-05 [recompute_prepare]: 5.11002e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.31002e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.247e-05 [j_node_and_user_rematch]: 8.16002e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.82e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.368e-05 [replace_applicator]: 6.11998e-06 [py_interpret_to_execute_after_opt_a]: 1.29e-05 [rewriter_after_opt_a]: 4.408e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 5.31002e-06 [mutable_eliminate]: 0.00053633 [jit_opt_b]: 5.169e-05, [1] [Cycle 1]: 4.361e-05, [2] [frontend_op_eliminate]: 1.559e-05 [inline_after_opt_a]: 1.597e-05 [cconv]: 2.606e-05 [loop_unroll]: 0.00043837 [jit_opt_after_cconv]: 0.00015014, [1] [Cycle 1]: 0.00014352, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 6.75998e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 2.599e-05 [call_graph_tuple_transform]: 1.942e-05 [tuple_list_get_item_eliminator]: 5.41998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.57e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.21e-06 [add_recomputation]: 5.202e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.81e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.708e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.0004825 [symbol_engine_optimizer]: 7.311e-05, [1] [Cycle 1]: 6.635e-05, [6] [build]: 3.32002e-06 [elim_shapecalc]: 7.93001e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 8.68001e-06 [renormalize]: 5.19998e-07 [validate]: 3.621e-05 Sums bootstrap : 0.000358s : 0.44% type_inference : 0.077267s : 94.51% event_method : 0.000021s : 0.03% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000112s : 0.14% rewriter_before_opt_a : 0.000082s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.08% jit_opt_a.loop_unroll : 0.000034s : 0.04% jit_opt_a.a_1 : 0.000627s : 0.77% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.000928s : 1.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000049s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000044s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000536s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000438s : 0.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000483s : 0.59% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.04% Time group info: ------[substitution.] 0.000207 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 3: substitution.graph_param_transform 83.52% : 0.000173s : 4: substitution.inline 1.91% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.27% : 0.000005s : 2: substitution.replace_old_param 5.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.077183 2 97.93% : 0.075585s : 1: type_inference.infer 2.07% : 0.001598s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.51% : 0.000051s : 4: replace.inline 31.49% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 94.11% : 0.000170s : 4: match.inline 5.89% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.38% : 0.000002s : 10: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.51% : 0.000002s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.71% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 11.23% : 0.000013s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.012358 13 96.32% : 0.011904s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.29% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 3.39% : 0.000419s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.090863 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.42% : 0.000378s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.84% : 0.008939s : 1: jit_opt_a 0.17% : 0.000153s : 1: jit_opt_after_cconv 0.06% : 0.000054s : 1: jit_opt_b 0.49% : 0.000447s : 1: loop_unroll 0.60% : 0.000547s : 1: mutable_eliminate 0.94% : 0.000852s : 26: opt.transform.jit_opt_a 0.05% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000116s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.57% : 0.000513s : 1: renormalize.infer 0.45% : 0.000407s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000047s : 1: rewriter_after_opt_a 0.09% : 0.000085s : 1: rewriter_before_opt_a 0.08% : 0.000075s : 1: symbol_engine_optimizer 85.05% : 0.077282s : 1: type_inference TotalTime = 0.180613, [30] [bootstrap]: 0.00036822 [type_inference]: 0.145877 [event_method]: 2.33e-05 [auto_monad]: 7.309e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 3.81001e-06 [py_interpret_to_execute]: 0.00027162 [rewriter_before_opt_a]: 9.822e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0313191, [2] [Cycle 1]: 0.027584, [27] [switch_simplify]: 6.205e-05 [loop_unroll]: 3.526e-05 [a_1]: 0.00066722 [with_stream_mark]: 0.0240412 [recompute_prepare]: 4.021e-05 [updatestate_depend_eliminate]: 9.34e-06 [updatestate_assign_eliminate]: 4.52998e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 4.68999e-06 [specialize_transform]: 9.24e-06 [updatestate_useless_node_eliminater]: 8.45999e-06 [accelerated_algorithm]: 9.59999e-06 [meta_shard_fg_expand]: 4.58999e-06 [get_grad_eliminate_]: 7.66001e-06 [merge_forward]: 5.45001e-06 [cell_reuse_recompute_pass]: 3.51001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.413e-05 [j_node_and_user_rematch]: 1.219e-05 [meta_fg_expand]: 3.70998e-06 [replace_old_param]: 1.207e-05 [inline_without_move]: 6.68998e-06 [renormalize]: 0.00228961 [add_forward_monad_depend]: 8.25999e-06 [auto_monad_grad]: 3.04001e-06 [auto_monad_eliminator]: 1.827e-05 [cse]: 3.579e-05 [replace_applicator]: 1.916e-05 [Cycle 2]: 0.00039629, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 6.42001e-06 [a_1]: 0.00012939 [with_stream_mark]: 1.438e-05 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 5.78997e-06 [updatestate_useless_node_eliminater]: 6.45002e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.98002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.663e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 8.80013e-07 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 7.32002e-06 [cse]: 1.67e-05 [replace_applicator]: 6.76e-06 [py_interpret_to_execute_after_opt_a]: 1.772e-05 [rewriter_after_opt_a]: 3.854e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00072692 [jit_opt_b]: 0.00011322, [1] [Cycle 1]: 0.00010552, [2] [frontend_op_eliminate]: 5.925e-05 [inline_after_opt_a]: 3.238e-05 [cconv]: 2.894e-05 [loop_unroll]: 0.00045276 [jit_opt_after_cconv]: 0.00016387, [1] [Cycle 1]: 0.00015798, [11] [c_1]: 2.692e-05 [parameter_eliminate]: 2.97002e-06 [updatestate_depend_eliminate]: 6.34001e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 2.964e-05 [call_graph_tuple_transform]: 2.188e-05 [tuple_list_get_item_eliminator]: 6.18002e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.83e-06 [remove_dup_value]: 1.883e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.028e-05 [add_recomputation]: 4.897e-05 [cse_after_recomputation]: 2.642e-05, [1] [Cycle 1]: 2.135e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.829e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.01997e-06 [opt_after_jit_grad]: 0.00047717 [symbol_engine_optimizer]: 8.069e-05, [1] [Cycle 1]: 7.353e-05, [6] [build]: 3.18e-06 [elim_shapecalc]: 1.01e-05 [elim_not_effective]: 1.555e-05 [opt_reshape]: 6.88e-06 [fold_const_symbol]: 1.029e-05 [renormalize]: 5.60016e-07 [validate]: 5.22e-05 Sums bootstrap : 0.000368s : 0.21% type_inference : 0.145877s : 82.63% event_method : 0.000023s : 0.01% auto_monad : 0.000073s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000272s : 0.15% rewriter_before_opt_a : 0.000098s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000797s : 0.45% jit_opt_a.with_stream_mark : 0.024056s : 13.63% jit_opt_a.recompute_prepare : 0.000046s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002290s : 1.30% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000059s : 0.03% jit_opt_b.inline_after_opt_a : 0.000032s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000453s : 0.26% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000477s : 0.27% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.03% Time group info: ------[substitution.] 0.000245 25 1.16% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.56% : 0.000006s : 4: substitution.graph_param_transform 82.74% : 0.000202s : 5: substitution.inline 2.25% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000007s : 4: substitution.remove_not_recompute_node 2.51% : 0.000006s : 2: substitution.replace_old_param 5.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.145789 2 98.54% : 0.143654s : 1: type_inference.infer 1.46% : 0.002136s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.39% : 0.000068s : 5: replace.inline 31.61% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 94.29% : 0.000199s : 5: match.inline 5.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.62% : 0.000002s : 13: predicate.addn_zero_filter 1.78% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.51% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.46% : 0.000004s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.78% : 0.000003s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000004s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 1.88% : 0.000003s : 13: predicate.reduce_eliminate 1.60% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 1.37% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.32% : 0.000002s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 20: predicate.switch_defer_inline 1.95% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000011s : 65: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.47% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.22% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002748 29 73.32% : 0.002015s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.01% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 24.67% : 0.000678s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.184025 72 0.03% : 0.000052s : 1: add_recomputation 0.04% : 0.000077s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000387s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 17.02% : 0.031323s : 1: jit_opt_a 0.09% : 0.000166s : 1: jit_opt_after_cconv 0.06% : 0.000116s : 1: jit_opt_b 0.25% : 0.000460s : 1: loop_unroll 0.40% : 0.000737s : 1: mutable_eliminate 0.60% : 0.001098s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000073s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000485s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.15% : 0.000277s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.84% : 0.001543s : 1: renormalize.infer 0.40% : 0.000735s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000103s : 1: rewriter_before_opt_a 0.05% : 0.000083s : 1: symbol_engine_optimizer 79.28% : 0.145894s : 1: type_inference TotalTime = 0.0432541, [30] [bootstrap]: 0.0002904 [type_inference]: 0.0347237 [event_method]: 1.812e-05 [auto_monad]: 4.593e-05 [graph_reusing]: 4.28999e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00010571 [rewriter_before_opt_a]: 8.812e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00571501, [2] [Cycle 1]: 0.00194473, [27] [switch_simplify]: 5.612e-05 [loop_unroll]: 3.154e-05 [a_1]: 0.00053664 [with_stream_mark]: 1.719e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 3.80998e-06 [updatestate_assign_eliminate]: 4.48001e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.04003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.403e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.79e-06 [inline_without_move]: 5.24998e-06 [renormalize]: 0.00095677 [add_forward_monad_depend]: 6.77002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.632e-05 [cse]: 3.386e-05 [replace_applicator]: 1.513e-05 [Cycle 2]: 0.00034473, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 6.05002e-06 [a_1]: 9.858e-05 [with_stream_mark]: 1.258e-05 [recompute_prepare]: 5.83997e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.41998e-06 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 5.11997e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 2.52001e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 7.92e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.405e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.334e-05 [rewriter_after_opt_a]: 3.816e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.0005815 [jit_opt_b]: 4.936e-05, [1] [Cycle 1]: 4.267e-05, [2] [frontend_op_eliminate]: 1.615e-05 [inline_after_opt_a]: 1.596e-05 [cconv]: 2.842e-05 [loop_unroll]: 0.00046347 [jit_opt_after_cconv]: 0.00014533, [1] [Cycle 1]: 0.00013851, [11] [c_1]: 2.032e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.554e-05 [call_graph_tuple_transform]: 1.884e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.83997e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.655e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 6.06998e-06 [add_recomputation]: 4.81e-05 [cse_after_recomputation]: 2.19e-05, [1] [Cycle 1]: 1.689e-05, [1] [cse]: 1.113e-05 [auto_monad_reorder]: 1.78e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.99e-06 [opt_after_jit_grad]: 0.0004932 [symbol_engine_optimizer]: 9.174e-05, [1] [Cycle 1]: 8.432e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 2.163e-05 [fold_const_symbol]: 9.58002e-06 [renormalize]: 8.2e-07 [validate]: 4.025e-05 Sums bootstrap : 0.000290s : 0.74% type_inference : 0.034724s : 88.49% event_method : 0.000018s : 0.05% auto_monad : 0.000046s : 0.12% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000106s : 0.27% rewriter_before_opt_a : 0.000088s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.16% jit_opt_a.loop_unroll : 0.000038s : 0.10% jit_opt_a.a_1 : 0.000635s : 1.62% jit_opt_a.with_stream_mark : 0.000030s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000957s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000048s : 0.12% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000582s : 1.48% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000028s : 0.07% loop_unroll : 0.000463s : 1.18% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.12% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000493s : 1.26% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000022s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.10% Time group info: ------[substitution.] 0.000201 23 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 3: substitution.graph_param_transform 83.04% : 0.000167s : 4: substitution.inline 2.01% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000004s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.24% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034657 2 95.37% : 0.033052s : 1: type_inference.infer 4.63% : 0.001605s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.96% : 0.000048s : 4: replace.inline 32.04% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.48% : 0.000164s : 4: match.inline 6.52% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.64% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.71% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.98% : 0.000002s : 10: predicate.reduce_eliminate 1.81% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.40% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000806 13 45.27% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.64% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.09% : 0.000412s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045140 72 0.11% : 0.000051s : 1: add_recomputation 0.11% : 0.000050s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.68% : 0.000308s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 12.67% : 0.005719s : 1: jit_opt_a 0.33% : 0.000148s : 1: jit_opt_after_cconv 0.12% : 0.000052s : 1: jit_opt_b 1.05% : 0.000473s : 1: loop_unroll 1.31% : 0.000592s : 1: mutable_eliminate 1.90% : 0.000857s : 26: opt.transform.jit_opt_a 0.10% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000050s : 4: opt.transform.symbol_engine_opt 1.11% : 0.000503s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000110s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.18% : 0.000533s : 1: renormalize.infer 0.92% : 0.000415s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000042s : 1: rewriter_after_opt_a 0.20% : 0.000092s : 1: rewriter_before_opt_a 0.21% : 0.000094s : 1: symbol_engine_optimizer 76.96% : 0.034739s : 1: type_inference TotalTime = 0.0183698, [30] [bootstrap]: 0.00030235 [type_inference]: 0.0076237 [event_method]: 1.845e-05 [auto_monad]: 6.568e-05 [graph_reusing]: 6.03998e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 3.9e-05 [rewriter_before_opt_a]: 7.329e-05 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.00786523, [2] [Cycle 1]: 0.00402718, [27] [switch_simplify]: 5.856e-05 [loop_unroll]: 2.981e-05 [a_1]: 0.00279441 [with_stream_mark]: 2.554e-05 [recompute_prepare]: 9.22001e-06 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 1.086e-05 [inline_without_move]: 5.18002e-06 [renormalize]: 0.0007389 [add_forward_monad_depend]: 1.115e-05 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 3.489e-05 [replace_applicator]: 1.358e-05 [Cycle 2]: 0.00037186, [27] [switch_simplify]: 6.01998e-06 [loop_unroll]: 5.37001e-06 [a_1]: 8.885e-05 [with_stream_mark]: 9.47001e-06 [recompute_prepare]: 5.41002e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 4.725e-05 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.09998e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 8.2e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 6.79999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.38998e-06 [cse]: 1.518e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.454e-05 [rewriter_after_opt_a]: 3.945e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00066484 [jit_opt_b]: 5.571e-05, [1] [Cycle 1]: 4.714e-05, [2] [frontend_op_eliminate]: 1.757e-05 [inline_after_opt_a]: 1.726e-05 [cconv]: 2.822e-05 [loop_unroll]: 0.00044908 [jit_opt_after_cconv]: 0.00016128, [1] [Cycle 1]: 0.00015319, [11] [c_1]: 2.082e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 2.567e-05 [call_graph_tuple_transform]: 1.967e-05 [tuple_list_get_item_eliminator]: 5.92001e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.762e-05 [partial_unused_args_eliminate]: 3.3e-06 [environ_conv]: 6.89001e-06 [add_recomputation]: 4.923e-05 [cse_after_recomputation]: 2.507e-05, [1] [Cycle 1]: 1.888e-05, [1] [cse]: 1.223e-05 [auto_monad_reorder]: 1.75e-05 [get_jit_bprop_graph]: 2.71999e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00050765 [symbol_engine_optimizer]: 7.862e-05, [1] [Cycle 1]: 7.199e-05, [6] [build]: 3.86001e-06 [elim_shapecalc]: 8.24002e-06 [elim_not_effective]: 1.494e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 5.69999e-07 [validate]: 4.193e-05 Sums bootstrap : 0.000302s : 2.12% type_inference : 0.007624s : 53.45% event_method : 0.000018s : 0.13% auto_monad : 0.000066s : 0.46% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.27% rewriter_before_opt_a : 0.000073s : 0.51% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.45% jit_opt_a.loop_unroll : 0.000035s : 0.25% jit_opt_a.a_1 : 0.002883s : 20.21% jit_opt_a.with_stream_mark : 0.000035s : 0.25% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000053s : 0.37% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000739s : 5.18% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.16% jit_opt_a.cse : 0.000050s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000039s : 0.28% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000665s : 4.66% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000028s : 0.20% loop_unroll : 0.000449s : 3.15% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000049s : 0.35% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000508s : 3.56% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.29% Time group info: ------[substitution.] 0.002438 23 0.09% : 0.000002s : 2: substitution.elim_not_effective 0.06% : 0.000001s : 2: substitution.fold_const_symbol 0.22% : 0.000005s : 3: substitution.graph_param_transform 98.48% : 0.002401s : 4: substitution.inline 0.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.19% : 0.000005s : 4: substitution.remove_not_recompute_node 0.24% : 0.000006s : 2: substitution.replace_old_param 0.55% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007525 2 88.67% : 0.006672s : 1: type_inference.infer 11.33% : 0.000853s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.41% : 0.000053s : 4: replace.inline 30.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.002408 6 99.50% : 0.002396s : 4: match.inline 0.50% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.27% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000008s : 22: predicate.inline 1.24% : 0.000002s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.05% : 0.000004s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.28% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.08% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000685 13 53.06% : 0.000363s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.96% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.98% : 0.000267s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022311 72 0.23% : 0.000052s : 1: add_recomputation 0.31% : 0.000069s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.46% : 0.000325s : 1: bootstrap 0.14% : 0.000031s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.10% : 0.000023s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 35.27% : 0.007869s : 1: jit_opt_a 0.74% : 0.000164s : 1: jit_opt_after_cconv 0.26% : 0.000058s : 1: jit_opt_b 2.05% : 0.000457s : 1: loop_unroll 3.03% : 0.000676s : 1: mutable_eliminate 14.11% : 0.003148s : 26: opt.transform.jit_opt_a 0.22% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.32% : 0.000518s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000020s : 1: remove_dup_value 1.84% : 0.000411s : 1: renormalize.infer 1.43% : 0.000320s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000043s : 1: rewriter_after_opt_a 0.34% : 0.000076s : 1: rewriter_before_opt_a 0.36% : 0.000081s : 1: symbol_engine_optimizer 34.24% : 0.007640s : 1: type_inference TotalTime = 0.148931, [30] [bootstrap]: 0.00036076 [type_inference]: 0.133911 [event_method]: 2.397e-05 [auto_monad]: 7.542e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00166243 [rewriter_before_opt_a]: 0.00010392 [expand_dump_flag]: 4e-06 [jit_opt_a]: 0.00963193, [2] [Cycle 1]: 0.00532653, [27] [switch_simplify]: 6.374e-05 [loop_unroll]: 3.114e-05 [a_1]: 0.00066552 [with_stream_mark]: 2.447e-05 [recompute_prepare]: 9.78002e-06 [updatestate_depend_eliminate]: 4.57998e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 8.69e-06 [updatestate_useless_node_eliminater]: 6.71e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.84999e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.688e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.124e-05 [inline_without_move]: 6.05002e-06 [renormalize]: 0.00413882 [add_forward_monad_depend]: 9.04e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 2.048e-05 [cse]: 3.767e-05 [replace_applicator]: 2.458e-05 [Cycle 2]: 0.00042551, [27] [switch_simplify]: 7.53999e-06 [loop_unroll]: 6.49999e-06 [a_1]: 0.00014477 [with_stream_mark]: 1.468e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.867e-05 [j_node_and_user_rematch]: 9.48002e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 5.91e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 7.35e-06 [cse]: 1.642e-05 [replace_applicator]: 7.3e-06 [py_interpret_to_execute_after_opt_a]: 1.851e-05 [rewriter_after_opt_a]: 4.787e-05 [convert_after_rewriter]: 8.25999e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.0010161 [jit_opt_b]: 6.28e-05, [1] [Cycle 1]: 5.484e-05, [2] [frontend_op_eliminate]: 2.171e-05 [inline_after_opt_a]: 1.987e-05 [cconv]: 3.096e-05 [loop_unroll]: 0.00047024 [jit_opt_after_cconv]: 0.00017941, [1] [Cycle 1]: 0.00017269, [11] [c_1]: 3.015e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 7e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 3.14001e-06 [cse]: 3.145e-05 [call_graph_tuple_transform]: 2.477e-05 [tuple_list_get_item_eliminator]: 8.09997e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 7.79983e-07 [switch_simplify]: 6.53998e-06 [remove_dup_value]: 1.767e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 9.64e-06 [add_recomputation]: 9.644e-05 [cse_after_recomputation]: 2.745e-05, [1] [Cycle 1]: 2.177e-05, [1] [cse]: 1.433e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 2.06003e-06 [rewriter_after_jit_bprop_graph]: 7.82e-06 [opt_after_jit_grad]: 0.00073325 [symbol_engine_optimizer]: 9.34e-05, [1] [Cycle 1]: 8.618e-05, [6] [build]: 4.95999e-06 [elim_shapecalc]: 1.116e-05 [elim_not_effective]: 1.72e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 1.252e-05 [renormalize]: 8.30012e-07 [validate]: 6.124e-05 Sums bootstrap : 0.000361s : 0.25% type_inference : 0.133911s : 92.76% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001662s : 1.15% rewriter_before_opt_a : 0.000104s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000810s : 0.56% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004139s : 2.87% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001016s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000470s : 0.33% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000096s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000733s : 0.51% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.04% Time group info: ------[substitution.] 0.000273 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.69% : 0.000007s : 4: substitution.graph_param_transform 85.30% : 0.000233s : 4: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 4.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.133820 2 96.91% : 0.129679s : 1: type_inference.infer 3.09% : 0.004141s : 1: type_inference.specialize ------[replace.] 0.000091 6 67.02% : 0.000061s : 4: replace.inline 32.98% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 95.13% : 0.000230s : 4: match.inline 4.87% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.19% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.44% : 0.000001s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.58% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 2.15% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.39% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000010s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.10% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.98% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.40% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003357 22 68.60% : 0.002303s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.65% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.74% : 0.000999s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154212 72 0.07% : 0.000100s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000381s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.25% : 0.009636s : 1: jit_opt_a 0.12% : 0.000183s : 1: jit_opt_after_cconv 0.04% : 0.000066s : 1: jit_opt_b 0.31% : 0.000479s : 1: loop_unroll 0.67% : 0.001029s : 1: mutable_eliminate 0.70% : 0.001078s : 26: opt.transform.jit_opt_a 0.04% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000745s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 1.09% : 0.001678s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.99% : 0.003065s : 1: renormalize.infer 0.69% : 0.001062s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000051s : 1: rewriter_after_opt_a 0.07% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000096s : 1: symbol_engine_optimizer 86.85% : 0.133934s : 1: type_inference TotalTime = 0.0168474, [30] [bootstrap]: 0.00032077 [type_inference]: 0.00861983 [event_method]: 1.931e-05 [auto_monad]: 7.201e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 4.877e-05 [rewriter_before_opt_a]: 8.415e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00542164, [2] [Cycle 1]: 0.0018206, [27] [switch_simplify]: 6.104e-05 [loop_unroll]: 3.352e-05 [a_1]: 0.00062115 [with_stream_mark]: 1.841e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.81998e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 9.38002e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 0.00073319 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 4.214e-05 [replace_applicator]: 1.398e-05 [Cycle 2]: 0.00033291, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 5.35999e-06 [a_1]: 8.956e-05 [with_stream_mark]: 9.94999e-06 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.83002e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 3.30998e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.32998e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 4.87e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.596e-05 [replace_applicator]: 5.94999e-06 [py_interpret_to_execute_after_opt_a]: 1.415e-05 [rewriter_after_opt_a]: 3.947e-05 [convert_after_rewriter]: 7.55e-06 [order_py_execute_after_rewriter]: 5.72001e-06 [mutable_eliminate]: 0.00058133 [jit_opt_b]: 4.931e-05, [1] [Cycle 1]: 4.211e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.843e-05 [loop_unroll]: 0.00043999 [jit_opt_after_cconv]: 0.00016283, [1] [Cycle 1]: 0.00015575, [11] [c_1]: 2.036e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 7.11001e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 2.895e-05 [call_graph_tuple_transform]: 1.876e-05 [tuple_list_get_item_eliminator]: 5.34998e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 1.461e-05 [remove_dup_value]: 3.378e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 5.91e-06 [add_recomputation]: 5.257e-05 [cse_after_recomputation]: 2.678e-05, [1] [Cycle 1]: 2.076e-05, [1] [cse]: 1.362e-05 [auto_monad_reorder]: 1.83e-05 [get_jit_bprop_graph]: 1.84998e-06 [rewriter_after_jit_bprop_graph]: 4.75999e-06 [opt_after_jit_grad]: 0.00048574 [symbol_engine_optimizer]: 7.396e-05, [1] [Cycle 1]: 6.774e-05, [6] [build]: 3.74002e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.38e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 3.60014e-07 [validate]: 3.955e-05 Sums bootstrap : 0.000321s : 2.47% type_inference : 0.008620s : 66.35% event_method : 0.000019s : 0.15% auto_monad : 0.000072s : 0.55% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.38% rewriter_before_opt_a : 0.000084s : 0.65% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000067s : 0.51% jit_opt_a.loop_unroll : 0.000039s : 0.30% jit_opt_a.a_1 : 0.000711s : 5.47% jit_opt_a.with_stream_mark : 0.000028s : 0.22% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000733s : 5.64% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000058s : 0.45% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000039s : 0.30% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000581s : 4.47% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000028s : 0.22% loop_unroll : 0.000440s : 3.39% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000015s : 0.11% remove_dup_value : 0.000034s : 0.26% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.40% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000486s : 3.74% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.30% Time group info: ------[substitution.] 0.000229 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000005s : 3: substitution.graph_param_transform 85.37% : 0.000195s : 5: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000004s : 2: substitution.replace_old_param 5.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008554 2 88.80% : 0.007596s : 1: type_inference.infer 11.20% : 0.000958s : 1: type_inference.specialize ------[replace.] 0.000095 7 68.83% : 0.000065s : 5: replace.inline 31.17% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 7 94.36% : 0.000192s : 5: match.inline 5.64% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.97% : 0.000002s : 11: predicate.arithmetic_simplify 1.41% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000001s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 16: predicate.load_eliminater 1.19% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.24% : 0.000001s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000001s : 11: predicate.print_const_string_wrapper 1.65% : 0.000002s : 11: predicate.reduce_eliminate 1.56% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 6: predicate.special_op_eliminate 1.12% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000003s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.29% : 0.000010s : 59: predicate.switch_simplify 1.36% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000001s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000770 16 51.90% : 0.000400s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.12% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.98% : 0.000316s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018587 72 0.30% : 0.000055s : 1: add_recomputation 0.40% : 0.000075s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.83% : 0.000340s : 1: bootstrap 0.17% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 29.19% : 0.005425s : 1: jit_opt_a 0.89% : 0.000165s : 1: jit_opt_after_cconv 0.28% : 0.000052s : 1: jit_opt_b 2.41% : 0.000447s : 1: loop_unroll 3.18% : 0.000592s : 1: mutable_eliminate 5.05% : 0.000939s : 26: opt.transform.jit_opt_a 0.30% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000495s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000051s : 1: py_interpret_to_execute 0.10% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000037s : 1: remove_dup_value 2.30% : 0.000427s : 1: renormalize.infer 1.61% : 0.000299s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000043s : 1: rewriter_after_opt_a 0.47% : 0.000087s : 1: rewriter_before_opt_a 0.41% : 0.000076s : 1: symbol_engine_optimizer 46.44% : 0.008632s : 1: type_inference TotalTime = 0.0753958, [30] [bootstrap]: 0.00026815 [type_inference]: 0.0348442 [event_method]: 1.923e-05 [auto_monad]: 7.201e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.45002e-06 [py_interpret_to_execute]: 0.00010382 [rewriter_before_opt_a]: 7.9e-05 [expand_dump_flag]: 2.94001e-06 [jit_opt_a]: 0.005391, [2] [Cycle 1]: 0.00183347, [27] [switch_simplify]: 4.934e-05 [loop_unroll]: 2.965e-05 [a_1]: 0.00052623 [with_stream_mark]: 1.71e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.84998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.283e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00086932 [add_forward_monad_depend]: 6.47001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.663e-05 [cse]: 3.528e-05 [replace_applicator]: 1.521e-05 [Cycle 2]: 0.00032014, [27] [switch_simplify]: 5.67999e-06 [loop_unroll]: 5.27999e-06 [a_1]: 8.77e-05 [with_stream_mark]: 1.052e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.26002e-06 [meta_shard_fg_expand]: 1.51998e-06 [get_grad_eliminate_]: 4.69002e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.308e-05 [j_node_and_user_rematch]: 8.47998e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7.2e-06 [inline_without_move]: 4.88001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 6.77002e-06 [cse]: 1.285e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.301e-05 [rewriter_after_opt_a]: 3.6e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.0005367 [jit_opt_b]: 4.898e-05, [1] [Cycle 1]: 4.182e-05, [2] [frontend_op_eliminate]: 1.535e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.89e-05 [loop_unroll]: 0.00044233 [jit_opt_after_cconv]: 0.00014792, [1] [Cycle 1]: 0.00014058, [11] [c_1]: 2.023e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 6.63e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 2.6e-05 [call_graph_tuple_transform]: 1.881e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.17999e-06 [remove_dup_value]: 1.65e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.118e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.785e-05, [1] [cse]: 1.215e-05 [auto_monad_reorder]: 1.79e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 5.03002e-06 [opt_after_jit_grad]: 0.00050116 [symbol_engine_optimizer]: 0.0324561, [1] [Cycle 1]: 0.032446, [6] [build]: 1.211e-05 [elim_shapecalc]: 8.377e-05 [elim_not_effective]: 2.48e-05 [opt_reshape]: 7.18998e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 1.87001e-06 [validate]: 6.817e-05 Sums bootstrap : 0.000268s : 0.68% type_inference : 0.034844s : 88.71% event_method : 0.000019s : 0.05% auto_monad : 0.000072s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000104s : 0.26% rewriter_before_opt_a : 0.000079s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000055s : 0.14% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000614s : 1.56% jit_opt_a.with_stream_mark : 0.000028s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000869s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000048s : 0.12% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000036s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000537s : 1.37% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000442s : 1.13% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000501s : 1.28% symbol_engine_optimizer.build : 0.000012s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000084s : 0.21% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000068s : 0.17% Time group info: ------[substitution.] 0.000194 23 1.49% : 0.000003s : 2: substitution.elim_not_effective 0.88% : 0.000002s : 2: substitution.fold_const_symbol 2.90% : 0.000006s : 3: substitution.graph_param_transform 82.67% : 0.000160s : 4: substitution.inline 1.99% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000004s : 4: substitution.remove_not_recompute_node 1.82% : 0.000004s : 2: substitution.replace_old_param 6.17% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034774 2 95.46% : 0.033194s : 1: type_inference.infer 4.54% : 0.001579s : 1: type_inference.specialize ------[replace.] 0.000068 6 69.57% : 0.000047s : 4: replace.inline 30.43% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.53% : 0.000158s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.06% : 0.000001s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000001s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.07% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 0.95% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.00% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.71% : 0.000001s : 3: predicate.elim_not_effective 3.80% : 0.000005s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.79% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 4.72% : 0.000006s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.22% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.61% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.92% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.25% : 0.000002s : 3: predicate.mutable_eliminate 0.70% : 0.000001s : 3: predicate.opt_reshape 1.96% : 0.000003s : 15: predicate.partial_eliminate 1.03% : 0.000001s : 10: predicate.print_const_string_wrapper 10.17% : 0.000013s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.05% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.73% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.20% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.15% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.46% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.24% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000770 13 42.75% : 0.000329s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.23% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.02% : 0.000408s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077152 72 0.07% : 0.000054s : 1: add_recomputation 0.10% : 0.000075s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.37% : 0.000287s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.99% : 0.005394s : 1: jit_opt_a 0.20% : 0.000151s : 1: jit_opt_after_cconv 0.07% : 0.000052s : 1: jit_opt_b 0.59% : 0.000452s : 1: loop_unroll 0.71% : 0.000546s : 1: mutable_eliminate 1.07% : 0.000824s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000073s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000513s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000108s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.63% : 0.000486s : 1: renormalize.infer 0.49% : 0.000376s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000083s : 1: rewriter_before_opt_a 42.08% : 0.032463s : 1: symbol_engine_optimizer 45.18% : 0.034857s : 1: type_inference TotalTime = 0.275279, [30] [bootstrap]: 0.00038322 [type_inference]: 0.237066 [event_method]: 2.236e-05 [auto_monad]: 0.00012225 [graph_reusing]: 7.03998e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 0.00042065 [rewriter_before_opt_a]: 9.69e-05 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.0345192, [2] [Cycle 1]: 0.0295709, [27] [switch_simplify]: 6.606e-05 [loop_unroll]: 3.526e-05 [a_1]: 0.00072798 [with_stream_mark]: 2.067e-05 [recompute_prepare]: 1.057e-05 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.55002e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 6.92002e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.0283104 [add_forward_monad_depend]: 1.057e-05 [auto_monad_grad]: 3.06999e-06 [auto_monad_eliminator]: 1.798e-05 [cse]: 3.81e-05 [replace_applicator]: 2.549e-05 [Cycle 2]: 0.0004222, [27] [switch_simplify]: 7.26999e-06 [loop_unroll]: 7.00002e-06 [a_1]: 0.00015007 [with_stream_mark]: 1.604e-05 [recompute_prepare]: 6.97002e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 3.9e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.023e-05 [inline_without_move]: 5.56002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.59001e-06 [cse]: 1.499e-05 [replace_applicator]: 6.71e-06 [py_interpret_to_execute_after_opt_a]: 1.399e-05 [rewriter_after_opt_a]: 3.943e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00079188 [jit_opt_b]: 7.827e-05, [1] [Cycle 1]: 6.871e-05, [2] [frontend_op_eliminate]: 3.684e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 3.036e-05 [loop_unroll]: 0.00046458 [jit_opt_after_cconv]: 0.00016507, [1] [Cycle 1]: 0.00015675, [11] [c_1]: 2.534e-05 [parameter_eliminate]: 3.07002e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.885e-05 [call_graph_tuple_transform]: 2.061e-05 [tuple_list_get_item_eliminator]: 6.18998e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.931e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 1.182e-05 [add_recomputation]: 5.566e-05 [cse_after_recomputation]: 2.763e-05, [1] [Cycle 1]: 2.036e-05, [1] [cse]: 1.366e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.0005767 [symbol_engine_optimizer]: 8.028e-05, [1] [Cycle 1]: 7.288e-05, [6] [build]: 4.84e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.472e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 4.19997e-07 [validate]: 5.036e-05 Sums bootstrap : 0.000383s : 0.14% type_inference : 0.237066s : 87.77% event_method : 0.000022s : 0.01% auto_monad : 0.000122s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000421s : 0.16% rewriter_before_opt_a : 0.000097s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000878s : 0.33% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.028311s : 10.48% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000053s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000792s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000037s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000465s : 0.17% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000577s : 0.21% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.02% Time group info: ------[substitution.] 0.000290 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000006s : 4: substitution.graph_param_transform 81.80% : 0.000237s : 5: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.36% : 0.000016s : 3: substitution.reduce_eliminate 1.90% : 0.000006s : 4: substitution.remove_not_recompute_node 2.09% : 0.000006s : 2: substitution.replace_old_param 4.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.236980 2 92.57% : 0.219369s : 1: type_inference.infer 7.43% : 0.017611s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.76% : 0.000074s : 5: replace.inline 31.24% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 95.54% : 0.000234s : 5: match.inline 4.46% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 1.75% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.71% : 0.000003s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.83% : 0.000009s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.75% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 2.37% : 0.000004s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.60% : 0.000002s : 13: predicate.reshape_eliminate 1.61% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 1.93% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.76% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016710 25 9.23% : 0.001542s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.51% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 90.27% : 0.015084s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.304856 72 0.02% : 0.000059s : 1: add_recomputation 0.04% : 0.000126s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.13% : 0.000396s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.32% : 0.034523s : 1: jit_opt_a 0.05% : 0.000167s : 1: jit_opt_after_cconv 0.03% : 0.000081s : 1: jit_opt_b 0.16% : 0.000474s : 1: loop_unroll 0.26% : 0.000804s : 1: mutable_eliminate 0.38% : 0.001146s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000049s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000058s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000587s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000427s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 8.93% : 0.027230s : 1: renormalize.infer 0.35% : 0.001068s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000103s : 1: rewriter_before_opt_a 0.03% : 0.000083s : 1: symbol_engine_optimizer 77.77% : 0.237083s : 1: type_inference TotalTime = 0.0192781, [30] [bootstrap]: 0.00029555 [type_inference]: 0.0100799 [event_method]: 2.498e-05 [auto_monad]: 7.785e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 6.375e-05 [rewriter_before_opt_a]: 9.433e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00618935, [2] [Cycle 1]: 0.0022365, [27] [switch_simplify]: 6.448e-05 [loop_unroll]: 3.73e-05 [a_1]: 0.00069705 [with_stream_mark]: 2.186e-05 [recompute_prepare]: 9.54999e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.84999e-06 [get_grad_eliminate_]: 6.42001e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 8.46002e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00104053 [add_forward_monad_depend]: 8.45999e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.642e-05 [cse]: 4.098e-05 [replace_applicator]: 1.589e-05 [Cycle 2]: 0.00033343, [27] [switch_simplify]: 5.95002e-06 [loop_unroll]: 5.34e-06 [a_1]: 9.305e-05 [with_stream_mark]: 1.142e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.492e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7.11001e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.569e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.556e-05 [rewriter_after_opt_a]: 4.187e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00071781 [jit_opt_b]: 5.24e-05, [1] [Cycle 1]: 4.498e-05, [2] [frontend_op_eliminate]: 1.655e-05 [inline_after_opt_a]: 1.726e-05 [cconv]: 3.199e-05 [loop_unroll]: 0.00044006 [jit_opt_after_cconv]: 0.0001551, [1] [Cycle 1]: 0.00014845, [11] [c_1]: 2.022e-05 [parameter_eliminate]: 3.83999e-06 [updatestate_depend_eliminate]: 7.48e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.50002e-06 [cse]: 3.057e-05 [call_graph_tuple_transform]: 1.991e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 3.744e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 5.332e-05 [cse_after_recomputation]: 2.667e-05, [1] [Cycle 1]: 2.042e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 1.935e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.00049893 [symbol_engine_optimizer]: 7.502e-05, [1] [Cycle 1]: 6.843e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.336e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 8.55999e-06 [renormalize]: 8.50006e-07 [validate]: 4.029e-05 Sums bootstrap : 0.000296s : 1.97% type_inference : 0.010080s : 67.05% event_method : 0.000025s : 0.17% auto_monad : 0.000078s : 0.52% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000064s : 0.42% rewriter_before_opt_a : 0.000094s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.47% jit_opt_a.loop_unroll : 0.000043s : 0.28% jit_opt_a.a_1 : 0.000790s : 5.26% jit_opt_a.with_stream_mark : 0.000033s : 0.22% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001041s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.15% jit_opt_a.cse : 0.000057s : 0.38% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.10% rewriter_after_opt_a : 0.000042s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000718s : 4.77% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000032s : 0.21% loop_unroll : 0.000440s : 2.93% jit_opt_after_cconv.c_1 : 0.000020s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000037s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000053s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000499s : 3.32% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000040s : 0.27% Time group info: ------[substitution.] 0.000280 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 3: substitution.graph_param_transform 87.21% : 0.000244s : 5: substitution.inline 1.81% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.28% : 0.000004s : 2: substitution.replace_old_param 4.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009987 2 83.99% : 0.008388s : 1: type_inference.infer 16.01% : 0.001599s : 1: type_inference.specialize ------[replace.] 0.000108 7 66.64% : 0.000072s : 5: replace.inline 33.36% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 7 95.32% : 0.000241s : 5: match.inline 4.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.35% : 0.000002s : 11: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.31% : 0.000002s : 11: predicate.addn_zero_filter 2.27% : 0.000003s : 11: predicate.arithmetic_simplify 1.31% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.03% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.42% : 0.000002s : 11: predicate.environ_get_eliminate 1.25% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000007s : 24: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.88% : 0.000001s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.08% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.84% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.29% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 2.44% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 1.82% : 0.000002s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.40% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.98% : 0.000011s : 59: predicate.switch_simplify 1.31% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001077 16 47.70% : 0.000514s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.86% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.44% : 0.000490s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021406 72 0.26% : 0.000056s : 1: add_recomputation 0.38% : 0.000081s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.47% : 0.000315s : 1: bootstrap 0.16% : 0.000035s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.20% : 0.000042s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000030s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 28.93% : 0.006192s : 1: jit_opt_a 0.74% : 0.000158s : 1: jit_opt_after_cconv 0.26% : 0.000055s : 1: jit_opt_b 2.09% : 0.000448s : 1: loop_unroll 3.41% : 0.000730s : 1: mutable_eliminate 4.81% : 0.001030s : 26: opt.transform.jit_opt_a 0.23% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000019s : 1: opt.transform.mutable_eliminate 0.12% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.38% : 0.000510s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000067s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000041s : 1: remove_dup_value 2.67% : 0.000571s : 1: renormalize.infer 2.15% : 0.000459s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000045s : 1: rewriter_after_opt_a 0.45% : 0.000097s : 1: rewriter_before_opt_a 0.36% : 0.000077s : 1: symbol_engine_optimizer 47.18% : 0.010100s : 1: type_inference TotalTime = 0.432896, [30] [bootstrap]: 0.00034776 [type_inference]: 0.408888 [event_method]: 0.00033691 [auto_monad]: 0.0001541 [graph_reusing]: 1.048e-05 [pre_auto_parallel]: 3.98999e-06 [py_interpret_to_execute]: 5.011e-05 [rewriter_before_opt_a]: 0.0001786 [expand_dump_flag]: 4.96002e-06 [jit_opt_a]: 0.00814465, [2] [Cycle 1]: 0.00397049, [27] [switch_simplify]: 0.0002145 [loop_unroll]: 6.478e-05 [a_1]: 0.00172738 [with_stream_mark]: 1.814e-05 [recompute_prepare]: 9.34e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 2.40002e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.19998e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 0.0015777 [add_forward_monad_depend]: 7.53e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 2.986e-05 [replace_applicator]: 1.681e-05 [Cycle 2]: 0.00033136, [27] [switch_simplify]: 5.52001e-06 [loop_unroll]: 5.22e-06 [a_1]: 9.361e-05 [with_stream_mark]: 1.226e-05 [recompute_prepare]: 4.90001e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.65001e-06 [accelerated_algorithm]: 4.89998e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.40999e-06 [merge_forward]: 3.52002e-06 [cell_reuse_recompute_pass]: 2.17001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 8.81002e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.58001e-06 [inline_without_move]: 4.62e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 4.94003e-06 [cse]: 1.168e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 1.339e-05 [rewriter_after_opt_a]: 3.62e-05 [convert_after_rewriter]: 6.44999e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00071638 [jit_opt_b]: 4.971e-05, [1] [Cycle 1]: 4.279e-05, [2] [frontend_op_eliminate]: 1.499e-05 [inline_after_opt_a]: 1.594e-05 [cconv]: 2.814e-05 [loop_unroll]: 0.0124337 [jit_opt_after_cconv]: 0.00019323, [1] [Cycle 1]: 0.00018218, [11] [c_1]: 2.817e-05 [parameter_eliminate]: 6.53e-06 [updatestate_depend_eliminate]: 1.262e-05 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.43002e-06 [cse]: 3.649e-05 [call_graph_tuple_transform]: 2.299e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 6.59001e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 3.17002e-06 [environ_conv]: 6.54999e-06 [add_recomputation]: 5.716e-05 [cse_after_recomputation]: 2.207e-05, [1] [Cycle 1]: 1.673e-05, [1] [cse]: 9.66e-06 [auto_monad_reorder]: 1.72e-05 [get_jit_bprop_graph]: 3.03998e-06 [rewriter_after_jit_bprop_graph]: 7.7e-06 [opt_after_jit_grad]: 0.00063281 [symbol_engine_optimizer]: 7.473e-05, [1] [Cycle 1]: 6.85e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 8.22998e-06 [elim_not_effective]: 1.324e-05 [opt_reshape]: 5.71998e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 2.9002e-07 [validate]: 4.169e-05 Sums bootstrap : 0.000348s : 0.08% type_inference : 0.408888s : 95.49% event_method : 0.000337s : 0.08% auto_monad : 0.000154s : 0.04% graph_reusing : 0.000010s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000050s : 0.01% rewriter_before_opt_a : 0.000179s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000220s : 0.05% jit_opt_a.loop_unroll : 0.000070s : 0.02% jit_opt_a.a_1 : 0.001821s : 0.43% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.00% jit_opt_a.accelerated_algorithm : 0.000010s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.00% jit_opt_a.inline_without_move : 0.000010s : 0.00% jit_opt_a.renormalize : 0.001578s : 0.37% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.00% jit_opt_a.cse : 0.000042s : 0.01% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000036s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000716s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.00% jit_opt_b.inline_after_opt_a : 0.000016s : 0.00% cconv : 0.000028s : 0.01% loop_unroll : 0.012434s : 2.90% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000633s : 0.15% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.01% Time group info: ------[substitution.] 0.000748 56 0.37% : 0.000003s : 2: substitution.elim_not_effective 0.17% : 0.000001s : 2: substitution.fold_const_symbol 0.87% : 0.000007s : 3: substitution.graph_param_transform 87.55% : 0.000655s : 15: substitution.inline 0.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.98% : 0.000007s : 4: substitution.minmaximum_grad 0.63% : 0.000005s : 4: substitution.remove_not_recompute_node 0.59% : 0.000004s : 2: substitution.replace_old_param 1.92% : 0.000014s : 4: substitution.switch_simplify 1.74% : 0.000013s : 4: substitution.tuple_list_convert_item_index_to_positive 1.26% : 0.000009s : 4: substitution.tuple_list_get_item_depend_reorder 3.39% : 0.000025s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.408771 2 98.96% : 0.404532s : 1: type_inference.infer 1.04% : 0.004238s : 1: type_inference.specialize ------[replace.] 0.000367 23 52.75% : 0.000194s : 15: replace.inline 17.76% : 0.000065s : 4: replace.switch_simplify 29.49% : 0.000108s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000666 23 96.99% : 0.000646s : 15: match.inline 1.77% : 0.000012s : 4: match.switch_simplify 1.23% : 0.000008s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000219 1341 1.33% : 0.000003s : 21: predicate.accumulaten_eliminater 0.63% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000003s : 21: predicate.addn_check_dump 1.40% : 0.000003s : 21: predicate.addn_zero_filter 1.93% : 0.000004s : 21: predicate.arithmetic_simplify 1.59% : 0.000003s : 21: predicate.cast_eliminate 0.23% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000003s : 21: predicate.compare_switch_simplify 1.28% : 0.000003s : 21: predicate.depend_value_elim 1.24% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.34% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.26% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.47% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 3: predicate.elim_not_effective 0.30% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.31% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.26% : 0.000003s : 21: predicate.environ_get_depend_swap 1.31% : 0.000003s : 21: predicate.environ_get_eliminate 1.31% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.49% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000001s : 3: predicate.graph_param_transform 6.14% : 0.000013s : 46: predicate.inline 0.47% : 0.000001s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.63% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000003s : 25: predicate.list_to_tuple_eliminator_ 2.04% : 0.000004s : 28: predicate.load_eliminater 1.56% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.81% : 0.000011s : 78: predicate.loop_unroll_before_grad 2.09% : 0.000005s : 24: predicate.make_slice_get_slice_eliminator 1.28% : 0.000003s : 21: predicate.merge_addn 1.37% : 0.000003s : 21: predicate.minmaximum_grad 0.92% : 0.000002s : 3: predicate.mutable_eliminate 0.27% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000005s : 28: predicate.partial_eliminate 1.33% : 0.000003s : 21: predicate.print_const_string_wrapper 1.71% : 0.000004s : 21: predicate.reduce_eliminate 1.62% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.31% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000004s : 31: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000003s : 21: predicate.reshape_eliminate 1.34% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.35% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000003s : 21: predicate.same_eliminate 0.40% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000002s : 6: predicate.special_op_eliminate 0.55% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000003s : 21: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.22% : 0.000007s : 40: predicate.switch_defer_inline 2.75% : 0.000006s : 40: predicate.switch_layer_defer_inline 9.56% : 0.000021s : 129: predicate.switch_simplify 1.35% : 0.000003s : 21: predicate.tile_eliminate 1.30% : 0.000003s : 21: predicate.transpose_eliminate 1.77% : 0.000004s : 21: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000009s : 31: predicate.tuple_list_get_item_eliminator 1.52% : 0.000003s : 21: predicate.tuple_list_set_item_eliminator 1.60% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.77% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.35% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.65% : 0.000004s : 21: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.33% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003512 38 59.93% : 0.002105s : 15: func_graph_cloner_run.FuncGraphClonerGraph 9.33% : 0.000328s : 6: func_graph_cloner_run.FuncGraphClonerNode 30.74% : 0.001080s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.436598 72 0.01% : 0.000060s : 1: add_recomputation 0.04% : 0.000162s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.08% : 0.000368s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.08% : 0.000348s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000013s : 1: graph_reusing 1.87% : 0.008149s : 1: jit_opt_a 0.05% : 0.000197s : 1: jit_opt_after_cconv 0.01% : 0.000052s : 1: jit_opt_b 2.85% : 0.012452s : 1: loop_unroll 0.17% : 0.000727s : 1: mutable_eliminate 0.51% : 0.002230s : 26: opt.transform.jit_opt_a 0.01% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000032s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000643s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.01% : 0.000053s : 1: py_interpret_to_execute 0.00% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.25% : 0.001076s : 1: renormalize.infer 0.11% : 0.000492s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000039s : 1: rewriter_after_opt_a 0.04% : 0.000182s : 1: rewriter_before_opt_a 0.02% : 0.000077s : 1: symbol_engine_optimizer 93.66% : 0.408921s : 1: type_inference TotalTime = 0.346034, [30] [bootstrap]: 0.00030007 [type_inference]: 0.333932 [event_method]: 1.812e-05 [auto_monad]: 7.424e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.33998e-06 [py_interpret_to_execute]: 0.00063908 [rewriter_before_opt_a]: 9.805e-05 [expand_dump_flag]: 5.40001e-06 [jit_opt_a]: 0.00820187, [2] [Cycle 1]: 0.0040565, [27] [switch_simplify]: 6.31e-05 [loop_unroll]: 3.085e-05 [a_1]: 0.00066986 [with_stream_mark]: 2.451e-05 [recompute_prepare]: 1.077e-05 [updatestate_depend_eliminate]: 1.52e-05 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 8.72e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.53998e-06 [meta_shard_fg_expand]: 2.93998e-06 [get_grad_eliminate_]: 6.43003e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 1.245e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.114e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 0.0028701 [add_forward_monad_depend]: 7.75e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.852e-05 [cse]: 3.168e-05 [replace_applicator]: 2.203e-05 [Cycle 2]: 0.00038163, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012499 [with_stream_mark]: 1.23e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.63002e-06 [specialize_transform]: 5.68002e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 1.78002e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 3.85e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.876e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.196e-05 [replace_applicator]: 6.46e-06 [py_interpret_to_execute_after_opt_a]: 1.549e-05 [rewriter_after_opt_a]: 4.107e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 1.241e-05 [mutable_eliminate]: 0.00075685 [jit_opt_b]: 5.882e-05, [1] [Cycle 1]: 5.082e-05, [2] [frontend_op_eliminate]: 1.96e-05 [inline_after_opt_a]: 2.035e-05 [cconv]: 3.207e-05 [loop_unroll]: 0.00059718 [jit_opt_after_cconv]: 0.00016847, [1] [Cycle 1]: 0.00016183, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 4.25999e-06 [updatestate_depend_eliminate]: 7.51999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.786e-05 [call_graph_tuple_transform]: 2.377e-05 [tuple_list_get_item_eliminator]: 6.94999e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 9.55001e-06 [add_recomputation]: 5.094e-05 [cse_after_recomputation]: 2.305e-05, [1] [Cycle 1]: 1.678e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.514e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 6.93e-06 [opt_after_jit_grad]: 0.00051085 [symbol_engine_optimizer]: 8.292e-05, [1] [Cycle 1]: 7.624e-05, [6] [build]: 3.55998e-06 [elim_shapecalc]: 8.28001e-06 [elim_not_effective]: 1.552e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 1.165e-05 [renormalize]: 6.29982e-07 [validate]: 0.00014275 Sums bootstrap : 0.000300s : 0.09% type_inference : 0.333932s : 97.75% event_method : 0.000018s : 0.01% auto_monad : 0.000074s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000639s : 0.19% rewriter_before_opt_a : 0.000098s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000795s : 0.23% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002870s : 0.84% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000044s : 0.01% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000012s : 0.00% mutable_eliminate : 0.000757s : 0.22% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000597s : 0.17% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000051s : 0.01% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000015s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000511s : 0.15% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000143s : 0.04% Time group info: ------[substitution.] 0.000280 24 1.46% : 0.000004s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000007s : 4: substitution.graph_param_transform 84.53% : 0.000236s : 4: substitution.inline 2.00% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000006s : 4: substitution.remove_not_recompute_node 2.05% : 0.000006s : 2: substitution.replace_old_param 5.10% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.333848 2 99.05% : 0.330692s : 1: type_inference.infer 0.95% : 0.003156s : 1: type_inference.specialize ------[replace.] 0.000083 6 69.53% : 0.000058s : 4: replace.inline 30.47% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 6 94.88% : 0.000234s : 4: match.inline 5.12% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.89% : 0.000003s : 12: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.34% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 6.21% : 0.000009s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.83% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.93% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000001s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.12% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.64% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.14% : 0.000002s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000010s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.10% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.026505 22 97.06% : 0.025724s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.21% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 2.74% : 0.000725s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.349929 72 0.02% : 0.000054s : 1: add_recomputation 0.02% : 0.000077s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.09% : 0.000316s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.35% : 0.008207s : 1: jit_opt_a 0.05% : 0.000171s : 1: jit_opt_after_cconv 0.02% : 0.000061s : 1: jit_opt_b 0.17% : 0.000610s : 1: loop_unroll 0.22% : 0.000770s : 1: mutable_eliminate 0.30% : 0.001051s : 26: opt.transform.jit_opt_a 0.02% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000521s : 1: opt_after_jit_grad 0.00% : 0.000015s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000650s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.61% : 0.002124s : 1: renormalize.infer 0.21% : 0.000735s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000044s : 1: rewriter_after_opt_a 0.03% : 0.000104s : 1: rewriter_before_opt_a 0.02% : 0.000085s : 1: symbol_engine_optimizer 95.43% : 0.333949s : 1: type_inference TotalTime = 0.0402047, [30] [bootstrap]: 0.00031665 [type_inference]: 0.0279325 [event_method]: 0.00011426 [auto_monad]: 0.00011857 [graph_reusing]: 8.3e-06 [pre_auto_parallel]: 3.88999e-06 [py_interpret_to_execute]: 4.847e-05 [rewriter_before_opt_a]: 0.00014434 [expand_dump_flag]: 4.12003e-06 [jit_opt_a]: 0.00877345, [2] [Cycle 1]: 0.004301, [27] [switch_simplify]: 0.00020552 [loop_unroll]: 5.778e-05 [a_1]: 0.00146251 [with_stream_mark]: 2.267e-05 [recompute_prepare]: 9.00001e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.184e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00209847 [add_forward_monad_depend]: 8.67e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.812e-05 [cse]: 4.339e-05 [replace_applicator]: 1.947e-05 [Cycle 2]: 0.00039765, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 5.42999e-06 [a_1]: 0.00011042 [with_stream_mark]: 1.379e-05 [recompute_prepare]: 5.92001e-06 [updatestate_depend_eliminate]: 4.09997e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.31998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.699e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.59998e-06 [inline_without_move]: 2.824e-05 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 7.11999e-06 [cse]: 1.712e-05 [replace_applicator]: 5.72001e-06 [py_interpret_to_execute_after_opt_a]: 1.471e-05 [rewriter_after_opt_a]: 4.372e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00084022 [jit_opt_b]: 5.981e-05, [1] [Cycle 1]: 5.121e-05, [2] [frontend_op_eliminate]: 2.057e-05 [inline_after_opt_a]: 1.735e-05 [cconv]: 3.05e-05 [loop_unroll]: 0.0004632 [jit_opt_after_cconv]: 0.00019995, [1] [Cycle 1]: 0.00016918, [11] [c_1]: 2.361e-05 [parameter_eliminate]: 3.38e-06 [updatestate_depend_eliminate]: 7.49002e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.05002e-06 [cse]: 3.592e-05 [call_graph_tuple_transform]: 2.299e-05 [tuple_list_get_item_eliminator]: 6.10002e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 6.19999e-06 [remove_dup_value]: 4.459e-05 [partial_unused_args_eliminate]: 2.60002e-06 [environ_conv]: 7.77e-06 [add_recomputation]: 5.546e-05 [cse_after_recomputation]: 2.844e-05, [1] [Cycle 1]: 2.217e-05, [1] [cse]: 1.436e-05 [auto_monad_reorder]: 1.997e-05 [get_jit_bprop_graph]: 2.35002e-06 [rewriter_after_jit_bprop_graph]: 7.25e-06 [opt_after_jit_grad]: 0.00054779 [symbol_engine_optimizer]: 8.916e-05, [1] [Cycle 1]: 8.204e-05, [6] [build]: 5.04998e-06 [elim_shapecalc]: 9.56e-06 [elim_not_effective]: 1.644e-05 [opt_reshape]: 7.52998e-06 [fold_const_symbol]: 1.056e-05 [renormalize]: 2.00002e-07 [validate]: 5.105e-05 Sums bootstrap : 0.000317s : 0.90% type_inference : 0.027933s : 78.96% event_method : 0.000114s : 0.32% auto_monad : 0.000119s : 0.34% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000048s : 0.14% rewriter_before_opt_a : 0.000144s : 0.41% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000213s : 0.60% jit_opt_a.loop_unroll : 0.000063s : 0.18% jit_opt_a.a_1 : 0.001573s : 4.45% jit_opt_a.with_stream_mark : 0.000036s : 0.10% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000034s : 0.10% jit_opt_a.renormalize : 0.002099s : 5.93% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.07% jit_opt_a.cse : 0.000061s : 0.17% jit_opt_a.replace_applicator : 0.000025s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000044s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000840s : 2.38% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000030s : 0.09% loop_unroll : 0.000463s : 1.31% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000045s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000055s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000548s : 1.55% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.14% Time group info: ------[substitution.] 0.000612 33 0.40% : 0.000002s : 2: substitution.elim_not_effective 0.33% : 0.000002s : 2: substitution.fold_const_symbol 1.09% : 0.000007s : 3: substitution.graph_param_transform 90.75% : 0.000555s : 11: substitution.inline 0.76% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.97% : 0.000006s : 4: substitution.remove_not_recompute_node 1.09% : 0.000007s : 2: substitution.replace_old_param 2.12% : 0.000013s : 2: substitution.switch_simplify 2.50% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027828 2 89.81% : 0.024993s : 1: type_inference.infer 10.19% : 0.002835s : 1: type_inference.specialize ------[replace.] 0.000356 16 48.31% : 0.000172s : 11: replace.inline 17.86% : 0.000064s : 2: replace.switch_simplify 33.83% : 0.000120s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000573 16 95.70% : 0.000549s : 11: match.inline 2.05% : 0.000012s : 2: match.switch_simplify 2.25% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000199 1148 1.45% : 0.000003s : 18: predicate.accumulaten_eliminater 1.10% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 18: predicate.addn_check_dump 1.34% : 0.000003s : 18: predicate.addn_zero_filter 2.03% : 0.000004s : 18: predicate.arithmetic_simplify 1.34% : 0.000003s : 18: predicate.cast_eliminate 0.25% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 18: predicate.compare_switch_simplify 1.34% : 0.000003s : 18: predicate.depend_value_elim 1.68% : 0.000003s : 18: predicate.dict_get_item_const_eliminator 1.28% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 18: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 3: predicate.elim_not_effective 0.38% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.28% : 0.000003s : 18: predicate.environ_get_depend_swap 1.32% : 0.000003s : 18: predicate.environ_get_eliminate 1.28% : 0.000003s : 18: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.61% : 0.000001s : 6: predicate.get_grad_eliminate 0.18% : 0.000000s : 3: predicate.graph_param_transform 5.61% : 0.000011s : 38: predicate.inline 0.53% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.89% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.93% : 0.000004s : 24: predicate.load_eliminater 0.77% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.57% : 0.000009s : 64: predicate.loop_unroll_before_grad 2.23% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 18: predicate.merge_addn 1.20% : 0.000002s : 18: predicate.minmaximum_grad 1.26% : 0.000003s : 3: predicate.mutable_eliminate 0.31% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000004s : 24: predicate.partial_eliminate 1.30% : 0.000003s : 18: predicate.print_const_string_wrapper 2.16% : 0.000004s : 18: predicate.reduce_eliminate 1.54% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000003s : 27: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.20% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000003s : 18: predicate.reshape_eliminate 1.26% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000003s : 18: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.67% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000003s : 18: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.09% : 0.000006s : 32: predicate.switch_defer_inline 2.51% : 0.000005s : 32: predicate.switch_layer_defer_inline 9.16% : 0.000018s : 103: predicate.switch_simplify 1.33% : 0.000003s : 18: predicate.tile_eliminate 1.32% : 0.000003s : 18: predicate.transpose_eliminate 1.52% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000007s : 27: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.27% : 0.000005s : 30: predicate.updatestate_useless_node_eliminater 1.77% : 0.000004s : 18: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002633 28 49.78% : 0.001311s : 9: func_graph_cloner_run.FuncGraphClonerGraph 11.05% : 0.000291s : 6: func_graph_cloner_run.FuncGraphClonerNode 39.17% : 0.001031s : 13: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044362 72 0.13% : 0.000059s : 1: add_recomputation 0.28% : 0.000124s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 0.76% : 0.000335s : 1: bootstrap 0.07% : 0.000033s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.27% : 0.000121s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 19.79% : 0.008778s : 1: jit_opt_a 0.46% : 0.000203s : 1: jit_opt_after_cconv 0.14% : 0.000063s : 1: jit_opt_b 1.06% : 0.000472s : 1: loop_unroll 1.92% : 0.000850s : 1: mutable_eliminate 4.53% : 0.002009s : 26: opt.transform.jit_opt_a 0.12% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.06% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000559s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.12% : 0.000051s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000048s : 1: remove_dup_value 2.81% : 0.001245s : 1: renormalize.infer 1.89% : 0.000840s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000047s : 1: rewriter_after_opt_a 0.33% : 0.000148s : 1: rewriter_before_opt_a 0.21% : 0.000092s : 1: symbol_engine_optimizer 63.02% : 0.027958s : 1: type_inference TotalTime = 0.0632462, [30] [bootstrap]: 0.00033609 [type_inference]: 0.0355143 [event_method]: 2.052e-05 [auto_monad]: 0.016026 [graph_reusing]: 7.64002e-06 [pre_auto_parallel]: 4.35e-06 [py_interpret_to_execute]: 0.00021302 [rewriter_before_opt_a]: 0.00010089 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.00854677, [2] [Cycle 1]: 0.00450504, [27] [switch_simplify]: 6.514e-05 [loop_unroll]: 3.249e-05 [a_1]: 0.00058826 [with_stream_mark]: 2.427e-05 [recompute_prepare]: 8.05e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.73998e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.88998e-06 [inline_without_move]: 5.68002e-06 [renormalize]: 0.0034043 [add_forward_monad_depend]: 8.76002e-06 [auto_monad_grad]: 3.06999e-06 [auto_monad_eliminator]: 2.242e-05 [cse]: 3.804e-05 [replace_applicator]: 2.113e-05 [Cycle 2]: 0.00034572, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 5.57999e-06 [a_1]: 9.633e-05 [with_stream_mark]: 1.415e-05 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 1.81003e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 3.41999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.667e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.29003e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.46e-06 [cse]: 1.236e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.763e-05 [rewriter_after_opt_a]: 3.761e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00074066 [jit_opt_b]: 5.113e-05, [1] [Cycle 1]: 4.331e-05, [2] [frontend_op_eliminate]: 1.615e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 3.072e-05 [loop_unroll]: 0.00043221 [jit_opt_after_cconv]: 0.00020916, [1] [Cycle 1]: 0.00020229, [11] [c_1]: 2.137e-05 [parameter_eliminate]: 3.48e-06 [updatestate_depend_eliminate]: 6.78e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.566e-05 [call_graph_tuple_transform]: 2.083e-05 [tuple_list_get_item_eliminator]: 6.22001e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.741e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 6.68e-06 [add_recomputation]: 4.954e-05 [cse_after_recomputation]: 5.32e-05, [1] [Cycle 1]: 2.015e-05, [1] [cse]: 1.383e-05 [auto_monad_reorder]: 1.952e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 5.43002e-06 [opt_after_jit_grad]: 0.00046058 [symbol_engine_optimizer]: 7.197e-05, [1] [Cycle 1]: 6.558e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 7.84002e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 3.89991e-07 [validate]: 4.373e-05 Sums bootstrap : 0.000336s : 0.57% type_inference : 0.035514s : 60.37% event_method : 0.000021s : 0.03% auto_monad : 0.016026s : 27.24% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000213s : 0.36% rewriter_before_opt_a : 0.000101s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.12% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000685s : 1.16% jit_opt_a.with_stream_mark : 0.000038s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.003404s : 5.79% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.05% jit_opt_a.cse : 0.000050s : 0.09% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.03% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000741s : 1.26% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000031s : 0.05% loop_unroll : 0.000432s : 0.73% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 0.78% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000252 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 85.16% : 0.000215s : 4: substitution.inline 1.85% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.47% : 0.000006s : 2: substitution.replace_old_param 4.97% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035439 2 95.37% : 0.033800s : 1: type_inference.infer 4.63% : 0.001639s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.62% : 0.000051s : 4: replace.inline 32.38% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.97% : 0.000213s : 4: match.inline 5.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.45% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.87% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.06% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.54% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.85% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000940 13 42.89% : 0.000403s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.78% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.33% : 0.000483s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067614 72 0.08% : 0.000052s : 1: add_recomputation 23.73% : 0.016044s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.53% : 0.000358s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000056s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 12.65% : 0.008550s : 1: jit_opt_a 0.31% : 0.000212s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.65% : 0.000441s : 1: loop_unroll 1.11% : 0.000751s : 1: mutable_eliminate 1.37% : 0.000926s : 26: opt.transform.jit_opt_a 0.07% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000470s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.32% : 0.000218s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 4.22% : 0.002852s : 1: renormalize.infer 0.80% : 0.000538s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.16% : 0.000106s : 1: rewriter_before_opt_a 0.11% : 0.000074s : 1: symbol_engine_optimizer 52.55% : 0.035529s : 1: type_inference TotalTime = 0.0635325, [30] [bootstrap]: 0.00032104 [type_inference]: 0.0504708 [event_method]: 2.602e-05 [auto_monad]: 7.707e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00018068 [rewriter_before_opt_a]: 0.00014056 [expand_dump_flag]: 3.55998e-06 [jit_opt_a]: 0.00972693, [2] [Cycle 1]: 0.00280309, [27] [switch_simplify]: 8.502e-05 [loop_unroll]: 2.986e-05 [a_1]: 0.00062521 [with_stream_mark]: 2.329e-05 [recompute_prepare]: 8.05e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.27998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.617e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 5.56e-06 [renormalize]: 0.00165615 [add_forward_monad_depend]: 6.14001e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.86e-05 [cse]: 3.952e-05 [replace_applicator]: 1.479e-05 [Cycle 2]: 0.00033593, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 5.49e-06 [a_1]: 9.565e-05 [with_stream_mark]: 1.147e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.32002e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 3.03998e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.431e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 8.41002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.03002e-06 [cse]: 1.3e-05 [replace_applicator]: 5.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.379e-05 [rewriter_after_opt_a]: 4.126e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00081634 [jit_opt_b]: 5.383e-05, [1] [Cycle 1]: 4.559e-05, [2] [frontend_op_eliminate]: 1.704e-05 [inline_after_opt_a]: 1.734e-05 [cconv]: 2.536e-05 [loop_unroll]: 0.00045476 [jit_opt_after_cconv]: 0.00014993, [1] [Cycle 1]: 0.00014293, [11] [c_1]: 2.139e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.578e-05 [call_graph_tuple_transform]: 1.965e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.80002e-06 [remove_dup_value]: 1.71e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 5.204e-05 [cse_after_recomputation]: 2.291e-05, [1] [Cycle 1]: 1.671e-05, [1] [cse]: 1.124e-05 [auto_monad_reorder]: 1.726e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 5.98002e-06 [opt_after_jit_grad]: 0.00052132 [symbol_engine_optimizer]: 0.00010857, [1] [Cycle 1]: 0.00010097, [6] [build]: 4.62e-06 [elim_shapecalc]: 7.37997e-06 [elim_not_effective]: 1.553e-05 [opt_reshape]: 6.71e-06 [fold_const_symbol]: 1.114e-05 [renormalize]: 2.59985e-07 [validate]: 4.379e-05 Sums bootstrap : 0.000321s : 0.57% type_inference : 0.050471s : 89.69% event_method : 0.000026s : 0.05% auto_monad : 0.000077s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000181s : 0.32% rewriter_before_opt_a : 0.000141s : 0.25% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000721s : 1.28% jit_opt_a.with_stream_mark : 0.000035s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001656s : 2.94% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000053s : 0.09% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000816s : 1.45% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000455s : 0.81% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000521s : 0.93% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.08% Time group info: ------[substitution.] 0.000255 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.85% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 3: substitution.graph_param_transform 84.67% : 0.000216s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000006s : 4: substitution.remove_not_recompute_node 2.11% : 0.000005s : 2: substitution.replace_old_param 5.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050360 2 51.37% : 0.025869s : 1: type_inference.infer 48.63% : 0.024491s : 1: type_inference.specialize ------[replace.] 0.000092 6 70.10% : 0.000065s : 4: replace.inline 29.90% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.60% : 0.000214s : 4: match.inline 5.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 691 1.62% : 0.000002s : 10: predicate.accumulaten_eliminater 1.22% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000002s : 10: predicate.addn_zero_filter 2.65% : 0.000004s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000002s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.02% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 4.59% : 0.000006s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.52% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.69% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 10: predicate.merge_addn 0.93% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000002s : 10: predicate.print_const_string_wrapper 1.90% : 0.000003s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 1.76% : 0.000002s : 16: predicate.switch_layer_defer_inline 12.83% : 0.000017s : 53: predicate.switch_simplify 0.98% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.14% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001121 13 38.78% : 0.000435s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.35% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 57.87% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066213 72 0.08% : 0.000055s : 1: add_recomputation 0.12% : 0.000080s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.52% : 0.000343s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 14.70% : 0.009731s : 1: jit_opt_a 0.23% : 0.000153s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.70% : 0.000463s : 1: loop_unroll 1.25% : 0.000826s : 1: mutable_eliminate 1.47% : 0.000975s : 26: opt.transform.jit_opt_a 0.07% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000530s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000185s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.53% : 0.001015s : 1: renormalize.infer 0.95% : 0.000631s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000044s : 1: rewriter_after_opt_a 0.22% : 0.000147s : 1: rewriter_before_opt_a 0.17% : 0.000111s : 1: symbol_engine_optimizer 76.27% : 0.050503s : 1: type_inference TotalTime = 0.0754307, [30] [bootstrap]: 0.00034013 [type_inference]: 0.00840022 [event_method]: 1.949e-05 [auto_monad]: 7.373e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 6.845e-05 [rewriter_before_opt_a]: 8.64e-05 [expand_dump_flag]: 2.86999e-06 [jit_opt_a]: 0.0637255, [2] [Cycle 1]: 0.0587292, [27] [switch_simplify]: 6.701e-05 [loop_unroll]: 2.958e-05 [a_1]: 0.00060306 [with_stream_mark]: 2.257e-05 [recompute_prepare]: 8.66002e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.404e-05 [parameter_eliminate]: 6.41998e-06 [specialize_transform]: 3.541e-05 [updatestate_useless_node_eliminater]: 1.117e-05 [accelerated_algorithm]: 1.07e-05 [meta_shard_fg_expand]: 7.85e-06 [get_grad_eliminate_]: 8.94e-06 [merge_forward]: 5.59e-06 [cell_reuse_recompute_pass]: 4.96002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.856e-05 [j_node_and_user_rematch]: 1.312e-05 [meta_fg_expand]: 4.66002e-06 [replace_old_param]: 1.191e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00131001 [add_forward_monad_depend]: 7.81001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.655e-05 [cse]: 3.885e-05 [replace_applicator]: 1.507e-05 [Cycle 2]: 0.00036167, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 5.74e-06 [a_1]: 0.00011422 [with_stream_mark]: 1.608e-05 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.00002e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.06997e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 7.55e-06 [inline_without_move]: 4.74e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.405e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 1.521e-05 [rewriter_after_opt_a]: 4.146e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00090685 [jit_opt_b]: 5.512e-05, [1] [Cycle 1]: 4.726e-05, [2] [frontend_op_eliminate]: 1.962e-05 [inline_after_opt_a]: 1.681e-05 [cconv]: 2.574e-05 [loop_unroll]: 0.00046846 [jit_opt_after_cconv]: 0.00016801, [1] [Cycle 1]: 0.00016142, [11] [c_1]: 2.276e-05 [parameter_eliminate]: 2.97002e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 2.476e-05 [call_graph_tuple_transform]: 1.997e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 2.074e-05 [remove_dup_value]: 1.799e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 9.38002e-06 [add_recomputation]: 5.505e-05 [cse_after_recomputation]: 2.513e-05, [1] [Cycle 1]: 1.939e-05, [1] [cse]: 1.322e-05 [auto_monad_reorder]: 1.843e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 7.74997e-06 [opt_after_jit_grad]: 0.00050613 [symbol_engine_optimizer]: 8.561e-05, [1] [Cycle 1]: 7.931e-05, [6] [build]: 1.175e-05 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 7.65e-06 [fold_const_symbol]: 9.92001e-06 [renormalize]: 1.60013e-07 [validate]: 7.982e-05 Sums bootstrap : 0.000340s : 2.44% type_inference : 0.008400s : 60.25% event_method : 0.000019s : 0.14% auto_monad : 0.000074s : 0.53% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000068s : 0.49% rewriter_before_opt_a : 0.000086s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.53% jit_opt_a.loop_unroll : 0.000035s : 0.25% jit_opt_a.a_1 : 0.000717s : 5.15% jit_opt_a.with_stream_mark : 0.000039s : 0.28% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000026s : 0.19% jit_opt_a.parameter_eliminate : 0.000008s : 0.05% jit_opt_a.specialize_transform : 0.000041s : 0.29% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.12% jit_opt_a.accelerated_algorithm : 0.000016s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.07% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.10% jit_opt_a.merge_forward : 0.000009s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.16% jit_opt_a.meta_fg_expand : 0.000007s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001310s : 9.40% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.16% jit_opt_a.cse : 0.000053s : 0.38% jit_opt_a.replace_applicator : 0.000021s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000041s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000907s : 6.50% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000026s : 0.18% loop_unroll : 0.000468s : 3.36% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000021s : 0.15% remove_dup_value : 0.000018s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.07% add_recomputation : 0.000055s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.06% opt_after_jit_grad : 0.000506s : 3.63% symbol_engine_optimizer.build : 0.000012s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000080s : 0.57% Time group info: ------[substitution.] 0.000250 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.94% : 0.000002s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 84.20% : 0.000210s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000006s : 4: substitution.remove_not_recompute_node 2.42% : 0.000006s : 2: substitution.replace_old_param 5.19% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008303 2 82.30% : 0.006833s : 1: type_inference.infer 17.70% : 0.001470s : 1: type_inference.specialize ------[replace.] 0.000089 6 67.84% : 0.000060s : 4: replace.inline 32.16% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.62% : 0.000208s : 4: match.inline 5.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.18% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.75% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 0.91% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000002s : 10: predicate.depend_value_elim 1.53% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.90% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.48% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 4.76% : 0.000007s : 22: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.69% : 0.000004s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.42% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 10: predicate.merge_addn 0.90% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000002s : 10: predicate.print_const_string_wrapper 1.83% : 0.000003s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000003s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.19% : 0.000002s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 6: predicate.special_op_eliminate 2.16% : 0.000003s : 6: predicate.specialize_transform 1.18% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.93% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 2.09% : 0.000003s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.84% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002117 13 73.80% : 0.001562s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.73% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.46% : 0.000518s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077777 72 0.07% : 0.000058s : 1: add_recomputation 0.10% : 0.000078s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.46% : 0.000361s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 81.94% : 0.063731s : 1: jit_opt_a 0.22% : 0.000171s : 1: jit_opt_after_cconv 0.07% : 0.000058s : 1: jit_opt_b 0.61% : 0.000477s : 1: loop_unroll 1.18% : 0.000917s : 1: mutable_eliminate 1.29% : 0.001006s : 26: opt.transform.jit_opt_a 0.08% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000071s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.91% : 0.000711s : 1: renormalize.infer 0.76% : 0.000589s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000088s : 1: symbol_engine_optimizer 10.83% : 0.008423s : 1: type_inference TotalTime = 0.130369, [30] [bootstrap]: 0.00028252 [type_inference]: 0.118467 [event_method]: 2.008e-05 [auto_monad]: 6.651e-05 [graph_reusing]: 5.46e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 0.00055234 [rewriter_before_opt_a]: 8.904e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00842717, [2] [Cycle 1]: 0.0047826, [27] [switch_simplify]: 5.689e-05 [loop_unroll]: 3.083e-05 [a_1]: 0.00060419 [with_stream_mark]: 1.841e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 7.4e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 6.94999e-06 [renormalize]: 0.003709 [add_forward_monad_depend]: 7.71001e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.771e-05 [cse]: 3.755e-05 [replace_applicator]: 1.691e-05 [Cycle 2]: 0.00037423, [27] [switch_simplify]: 7.45e-06 [loop_unroll]: 6.25002e-06 [a_1]: 0.00012322 [with_stream_mark]: 1.165e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.21002e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.482e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 1.344e-05 [rewriter_after_opt_a]: 3.97e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00061456 [jit_opt_b]: 9.87e-05, [1] [Cycle 1]: 9.211e-05, [2] [frontend_op_eliminate]: 3.104e-05 [inline_after_opt_a]: 4.848e-05 [cconv]: 2.642e-05 [loop_unroll]: 0.00048918 [jit_opt_after_cconv]: 0.000159, [1] [Cycle 1]: 0.0001529, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.56e-05 [call_graph_tuple_transform]: 2.114e-05 [tuple_list_get_item_eliminator]: 6.51999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.51999e-06 [remove_dup_value]: 1.891e-05 [partial_unused_args_eliminate]: 1.94999e-06 [environ_conv]: 8.27e-06 [add_recomputation]: 5.031e-05 [cse_after_recomputation]: 2.574e-05, [1] [Cycle 1]: 1.954e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 1.661e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00045973 [symbol_engine_optimizer]: 8.522e-05, [1] [Cycle 1]: 7.919e-05, [6] [build]: 3.53999e-06 [elim_shapecalc]: 1.107e-05 [elim_not_effective]: 1.704e-05 [opt_reshape]: 6.97002e-06 [fold_const_symbol]: 1.211e-05 [renormalize]: 3.69997e-07 [validate]: 0.00014995 Sums bootstrap : 0.000283s : 0.22% type_inference : 0.118467s : 93.64% event_method : 0.000020s : 0.02% auto_monad : 0.000067s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000552s : 0.44% rewriter_before_opt_a : 0.000089s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000727s : 0.57% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003709s : 2.93% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000615s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000031s : 0.02% jit_opt_b.inline_after_opt_a : 0.000048s : 0.04% cconv : 0.000026s : 0.02% loop_unroll : 0.000489s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000460s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000150s : 0.12% Time group info: ------[substitution.] 0.000219 24 1.09% : 0.000002s : 2: substitution.elim_not_effective 1.85% : 0.000004s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 4: substitution.graph_param_transform 83.03% : 0.000182s : 4: substitution.inline 1.93% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000004s : 2: substitution.replace_old_param 5.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118351 2 96.25% : 0.113918s : 1: type_inference.infer 3.75% : 0.004433s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.88% : 0.000053s : 4: replace.inline 33.12% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 94.29% : 0.000179s : 4: match.inline 5.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.14% : 0.000001s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000002s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.12% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.36% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002615 22 62.25% : 0.001628s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.34% : 0.000950s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135061 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000070s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000297s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.24% : 0.008430s : 1: jit_opt_a 0.12% : 0.000162s : 1: jit_opt_after_cconv 0.08% : 0.000102s : 1: jit_opt_b 0.37% : 0.000498s : 1: loop_unroll 0.46% : 0.000623s : 1: mutable_eliminate 0.72% : 0.000968s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000073s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000559s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 2.04% : 0.002758s : 1: renormalize.infer 0.70% : 0.000941s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000094s : 1: rewriter_before_opt_a 0.07% : 0.000088s : 1: symbol_engine_optimizer 87.73% : 0.118482s : 1: type_inference TotalTime = 0.0311904, [30] [bootstrap]: 0.00031488 [type_inference]: 0.0215382 [event_method]: 2.112e-05 [auto_monad]: 6.777e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00013552 [rewriter_before_opt_a]: 8.4e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00679936, [2] [Cycle 1]: 0.00272028, [27] [switch_simplify]: 6.028e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00065998 [with_stream_mark]: 1.986e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.61002e-06 [specialize_transform]: 6.89001e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 9.43997e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.00160694 [add_forward_monad_depend]: 6.71e-06 [auto_monad_grad]: 3.03998e-06 [auto_monad_eliminator]: 1.646e-05 [cse]: 3.309e-05 [replace_applicator]: 1.375e-05 [Cycle 2]: 0.00031739, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.14998e-06 [a_1]: 9.033e-05 [with_stream_mark]: 9.23002e-06 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.345e-05 [j_node_and_user_rematch]: 8.05e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 6.99001e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.261e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.304e-05 [rewriter_after_opt_a]: 3.761e-05 [convert_after_rewriter]: 7.00002e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00059618 [jit_opt_b]: 4.87e-05, [1] [Cycle 1]: 4.238e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.549e-05 [cconv]: 2.451e-05 [loop_unroll]: 0.00042934 [jit_opt_after_cconv]: 0.00013917, [1] [Cycle 1]: 0.00013297, [11] [c_1]: 2.103e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.13002e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.013e-05 [call_graph_tuple_transform]: 1.919e-05 [tuple_list_get_item_eliminator]: 5.24998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 1.53e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 4.877e-05 [cse_after_recomputation]: 2.277e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.18e-05 [auto_monad_reorder]: 1.658e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00049184 [symbol_engine_optimizer]: 7.337e-05, [1] [Cycle 1]: 6.698e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 8.15999e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 5.76998e-06 [fold_const_symbol]: 9.05001e-06 [renormalize]: 4.69998e-07 [validate]: 4.164e-05 Sums bootstrap : 0.000315s : 1.17% type_inference : 0.021538s : 80.26% event_method : 0.000021s : 0.08% auto_monad : 0.000068s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000136s : 0.50% rewriter_before_opt_a : 0.000084s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000750s : 2.80% jit_opt_a.with_stream_mark : 0.000029s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001607s : 5.99% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000046s : 0.17% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000596s : 2.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000025s : 0.09% loop_unroll : 0.000429s : 1.60% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000492s : 1.83% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.16% Time group info: ------[substitution.] 0.000244 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 86.27% : 0.000211s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.48% : 0.000004s : 2: substitution.replace_old_param 5.29% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021457 2 90.12% : 0.019337s : 1: type_inference.infer 9.88% : 0.002120s : 1: type_inference.specialize ------[replace.] 0.000087 6 62.67% : 0.000055s : 4: replace.inline 37.33% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.72% : 0.000208s : 4: match.inline 5.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.37% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.53% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.25% : 0.000003s : 15: predicate.load_eliminater 1.27% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.81% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001055 13 37.40% : 0.000395s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.00% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 57.60% : 0.000608s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033821 72 0.15% : 0.000052s : 1: add_recomputation 0.21% : 0.000072s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 0.98% : 0.000331s : 1: bootstrap 0.08% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 20.12% : 0.006804s : 1: jit_opt_a 0.42% : 0.000142s : 1: jit_opt_after_cconv 0.15% : 0.000052s : 1: jit_opt_b 1.30% : 0.000438s : 1: loop_unroll 1.79% : 0.000605s : 1: mutable_eliminate 2.87% : 0.000971s : 26: opt.transform.jit_opt_a 0.14% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.48% : 0.000500s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000139s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.76% : 0.000932s : 1: renormalize.infer 1.97% : 0.000665s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000041s : 1: rewriter_after_opt_a 0.26% : 0.000088s : 1: rewriter_before_opt_a 0.22% : 0.000076s : 1: symbol_engine_optimizer 63.73% : 0.021554s : 1: type_inference TotalTime = 0.0329816, [30] [bootstrap]: 0.00027959 [type_inference]: 0.0221596 [event_method]: 1.963e-05 [auto_monad]: 6.743e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 9.659e-05 [rewriter_before_opt_a]: 7.98e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00524827, [2] [Cycle 1]: 0.00178898, [27] [switch_simplify]: 5.287e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00052329 [with_stream_mark]: 2.103e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.53e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.18998e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 0.00083149 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.481e-05 [cse]: 3.622e-05 [replace_applicator]: 1.243e-05 [Cycle 2]: 0.00031408, [27] [switch_simplify]: 6.01998e-06 [loop_unroll]: 5.16998e-06 [a_1]: 8.89e-05 [with_stream_mark]: 8.25e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.51998e-06 [replace_old_param]: 7.09001e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 5.70028e-07 [auto_monad_eliminator]: 5.46002e-06 [cse]: 1.21e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.065e-05 [rewriter_after_opt_a]: 3.561e-05 [convert_after_rewriter]: 6.44999e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00047698 [jit_opt_b]: 0.00294956, [1] [Cycle 1]: 0.00292512, [2] [frontend_op_eliminate]: 1.578e-05 [inline_after_opt_a]: 1.51e-05 [cconv]: 2.921e-05 [loop_unroll]: 0.00047878 [jit_opt_after_cconv]: 0.00014217, [1] [Cycle 1]: 0.00013589, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 2.92002e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.25e-05 [call_graph_tuple_transform]: 1.912e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 5.14e-06 [add_recomputation]: 5.04e-05 [cse_after_recomputation]: 3.829e-05, [1] [Cycle 1]: 1.846e-05, [1] [cse]: 1.257e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 5.40999e-06 [opt_after_jit_grad]: 0.0004593 [symbol_engine_optimizer]: 7.173e-05, [1] [Cycle 1]: 6.517e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 8.43001e-06 [elim_not_effective]: 1.268e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 8.51002e-06 [renormalize]: 4.2998e-07 [validate]: 3.826e-05 Sums bootstrap : 0.000280s : 1.06% type_inference : 0.022160s : 84.10% event_method : 0.000020s : 0.07% auto_monad : 0.000067s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000097s : 0.37% rewriter_before_opt_a : 0.000080s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.22% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000612s : 2.32% jit_opt_a.with_stream_mark : 0.000029s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000832s : 3.16% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000048s : 0.18% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000036s : 0.14% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000477s : 1.81% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000479s : 1.82% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000050s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000459s : 1.74% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.15% Time group info: ------[substitution.] 0.000204 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000006s : 3: substitution.graph_param_transform 84.26% : 0.000172s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000003s : 2: substitution.replace_old_param 6.25% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022086 2 93.86% : 0.020730s : 1: type_inference.infer 6.14% : 0.001355s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.78% : 0.000045s : 4: replace.inline 32.22% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.62% : 0.000169s : 4: match.inline 6.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.07% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.17% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.65% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000800 13 47.09% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.20% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.72% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034686 72 0.15% : 0.000053s : 1: add_recomputation 0.20% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.85% : 0.000296s : 1: bootstrap 0.10% : 0.000033s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000040s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.14% : 0.005251s : 1: jit_opt_a 0.42% : 0.000145s : 1: jit_opt_after_cconv 8.52% : 0.002954s : 1: jit_opt_b 1.40% : 0.000487s : 1: loop_unroll 1.40% : 0.000485s : 1: mutable_eliminate 2.37% : 0.000822s : 26: opt.transform.jit_opt_a 0.14% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.35% : 0.000468s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000100s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.35% : 0.000470s : 1: renormalize.infer 1.02% : 0.000354s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000038s : 1: rewriter_after_opt_a 0.24% : 0.000084s : 1: rewriter_before_opt_a 0.21% : 0.000074s : 1: symbol_engine_optimizer 63.93% : 0.022176s : 1: type_inference TotalTime = 0.252279, [30] [bootstrap]: 0.00034345 [type_inference]: 0.232576 [event_method]: 2.829e-05 [auto_monad]: 8.336e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 0.00103244 [py_interpret_to_execute]: 0.00079365 [rewriter_before_opt_a]: 0.0001242 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0139342, [2] [Cycle 1]: 0.00872744, [27] [switch_simplify]: 8.169e-05 [loop_unroll]: 3.517e-05 [a_1]: 0.00086475 [with_stream_mark]: 2.449e-05 [recompute_prepare]: 9.39998e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 8.16002e-06 [updatestate_useless_node_eliminater]: 6.50002e-06 [accelerated_algorithm]: 8.1e-06 [meta_shard_fg_expand]: 3.21001e-06 [get_grad_eliminate_]: 8.79e-06 [merge_forward]: 4.65999e-06 [cell_reuse_recompute_pass]: 1.93997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.878e-05 [j_node_and_user_rematch]: 1.281e-05 [meta_fg_expand]: 2.70002e-06 [replace_old_param]: 2.437e-05 [inline_without_move]: 8.3e-06 [renormalize]: 0.0072694 [add_forward_monad_depend]: 1.163e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.272e-05 [cse]: 4.062e-05 [replace_applicator]: 2.854e-05 [Cycle 2]: 0.00044353, [27] [switch_simplify]: 8.65001e-06 [loop_unroll]: 6.95998e-06 [a_1]: 0.00015118 [with_stream_mark]: 1.871e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 4.63001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.616e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 3.11999e-06 [replace_old_param]: 1.096e-05 [inline_without_move]: 5.74e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 7.18e-06 [cse]: 1.53e-05 [replace_applicator]: 7.14001e-06 [py_interpret_to_execute_after_opt_a]: 1.891e-05 [rewriter_after_opt_a]: 8.187e-05 [convert_after_rewriter]: 8.28999e-06 [order_py_execute_after_rewriter]: 6.34999e-06 [mutable_eliminate]: 0.00092606 [jit_opt_b]: 0.0001283, [1] [Cycle 1]: 0.00011817, [2] [frontend_op_eliminate]: 8.086e-05 [inline_after_opt_a]: 2.072e-05 [cconv]: 3.348e-05 [loop_unroll]: 0.00053887 [jit_opt_after_cconv]: 0.0001948, [1] [Cycle 1]: 0.00018294, [11] [c_1]: 2.728e-05 [parameter_eliminate]: 4.45999e-06 [updatestate_depend_eliminate]: 8.23999e-06 [updatestate_assign_eliminate]: 5.64e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 3.372e-05 [call_graph_tuple_transform]: 2.743e-05 [tuple_list_get_item_eliminator]: 7.58999e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 1.04e-06 [switch_simplify]: 7.21001e-06 [remove_dup_value]: 2.157e-05 [partial_unused_args_eliminate]: 2.73998e-06 [environ_conv]: 1.243e-05 [add_recomputation]: 5.792e-05 [cse_after_recomputation]: 3.419e-05, [1] [Cycle 1]: 2.256e-05, [1] [cse]: 1.501e-05 [auto_monad_reorder]: 1.993e-05 [get_jit_bprop_graph]: 2.75997e-06 [rewriter_after_jit_bprop_graph]: 8.37e-06 [opt_after_jit_grad]: 0.00062465 [symbol_engine_optimizer]: 0.00031187, [1] [Cycle 1]: 0.00030282, [6] [build]: 5.34998e-06 [elim_shapecalc]: 9.34e-06 [elim_not_effective]: 1.681e-05 [opt_reshape]: 7.11001e-06 [fold_const_symbol]: 0.00022514 [renormalize]: 4.40021e-07 [validate]: 6.218e-05 Sums bootstrap : 0.000343s : 0.14% type_inference : 0.232576s : 94.25% event_method : 0.000028s : 0.01% auto_monad : 0.000083s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.001032s : 0.42% py_interpret_to_execute : 0.000794s : 0.32% rewriter_before_opt_a : 0.000124s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.001016s : 0.41% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000035s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.007269s : 2.95% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000082s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000926s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000081s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.01% loop_unroll : 0.000539s : 0.22% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000625s : 0.25% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000225s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.03% Time group info: ------[substitution.] 0.000384 28 0.51% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000003s : 2: substitution.fold_const_symbol 2.28% : 0.000009s : 4: substitution.graph_param_transform 80.86% : 0.000310s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.27% : 0.000016s : 3: substitution.reduce_eliminate 2.06% : 0.000008s : 4: substitution.remove_not_recompute_node 5.05% : 0.000019s : 2: substitution.replace_old_param 3.17% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.232459 2 97.78% : 0.227294s : 1: type_inference.infer 2.22% : 0.005165s : 1: type_inference.specialize ------[replace.] 0.000146 7 62.99% : 0.000092s : 5: replace.inline 37.01% : 0.000054s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000317 7 96.79% : 0.000307s : 5: match.inline 3.21% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.13% : 0.000002s : 13: predicate.accumulaten_eliminater 0.77% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 2.16% : 0.000003s : 13: predicate.arithmetic_simplify 1.59% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.06% : 0.000002s : 13: predicate.depend_value_elim 1.24% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.18% : 0.000008s : 28: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.16% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.31% : 0.000004s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000011s : 64: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.46% : 0.000002s : 13: predicate.transpose_eliminate 1.64% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 2.14% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003392 25 54.05% : 0.001833s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.07% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.88% : 0.001455s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.261197 72 0.02% : 0.000061s : 1: add_recomputation 0.04% : 0.000100s : 1: auto_monad 0.01% : 0.000026s : 1: auto_monad_reorder 0.14% : 0.000362s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 5.34% : 0.013940s : 1: jit_opt_a 0.08% : 0.000198s : 1: jit_opt_after_cconv 0.05% : 0.000131s : 1: jit_opt_b 0.21% : 0.000549s : 1: loop_unroll 0.36% : 0.000938s : 1: mutable_eliminate 0.51% : 0.001325s : 26: opt.transform.jit_opt_a 0.03% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000094s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000255s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000636s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.40% : 0.001041s : 1: pre_auto_parallel 0.31% : 0.000803s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 2.19% : 0.005708s : 1: renormalize.infer 0.59% : 0.001545s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000086s : 1: rewriter_after_opt_a 0.05% : 0.000129s : 1: rewriter_before_opt_a 0.12% : 0.000315s : 1: symbol_engine_optimizer 89.05% : 0.232599s : 1: type_inference TotalTime = 0.212124, [30] [bootstrap]: 0.00027945 [type_inference]: 0.173757 [event_method]: 2.192e-05 [auto_monad]: 6.745e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00170649 [rewriter_before_opt_a]: 9.796e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0338323, [2] [Cycle 1]: 0.0302217, [27] [switch_simplify]: 5.934e-05 [loop_unroll]: 3.433e-05 [a_1]: 0.00065025 [with_stream_mark]: 1.622e-05 [recompute_prepare]: 9.04998e-06 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.39998e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.0290447 [add_forward_monad_depend]: 1.234e-05 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 2.596e-05 [cse]: 4.569e-05 [replace_applicator]: 2.985e-05 [Cycle 2]: 0.0004512, [27] [switch_simplify]: 5.136e-05 [loop_unroll]: 7.6e-06 [a_1]: 0.00012953 [with_stream_mark]: 1.566e-05 [recompute_prepare]: 6.17999e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.42001e-06 [updatestate_useless_node_eliminater]: 6.50997e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.82998e-06 [cell_reuse_recompute_pass]: 3.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.921e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.049e-05 [inline_without_move]: 5.60001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.643e-05 [replace_applicator]: 6.88e-06 [py_interpret_to_execute_after_opt_a]: 2.189e-05 [rewriter_after_opt_a]: 4.352e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00076557 [jit_opt_b]: 5.53e-05, [1] [Cycle 1]: 4.791e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.819e-05 [cconv]: 2.563e-05 [loop_unroll]: 0.00040228 [jit_opt_after_cconv]: 0.00015311, [1] [Cycle 1]: 0.00014646, [11] [c_1]: 2.593e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 3.11001e-06 [cse]: 2.234e-05 [call_graph_tuple_transform]: 2.023e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.877e-05 [partial_unused_args_eliminate]: 2.55997e-06 [environ_conv]: 9.04e-06 [add_recomputation]: 5.156e-05 [cse_after_recomputation]: 2.562e-05, [1] [Cycle 1]: 2.039e-05, [1] [cse]: 1.422e-05 [auto_monad_reorder]: 1.854e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.0004402 [symbol_engine_optimizer]: 7.429e-05, [1] [Cycle 1]: 6.829e-05, [6] [build]: 4.26001e-06 [elim_shapecalc]: 8.65999e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 9.04998e-06 [renormalize]: 3.60014e-07 [validate]: 4.709e-05 Sums bootstrap : 0.000279s : 0.13% type_inference : 0.173757s : 83.39% event_method : 0.000022s : 0.01% auto_monad : 0.000067s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.001706s : 0.82% rewriter_before_opt_a : 0.000098s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000111s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000780s : 0.37% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.029045s : 13.94% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000062s : 0.03% jit_opt_a.replace_applicator : 0.000037s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000766s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000402s : 0.19% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000052s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000440s : 0.21% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.02% Time group info: ------[substitution.] 0.000242 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 4: substitution.graph_param_transform 84.98% : 0.000206s : 5: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000006s : 2: substitution.replace_old_param 5.06% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.173683 2 98.44% : 0.170970s : 1: type_inference.infer 1.56% : 0.002713s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.45% : 0.000062s : 5: replace.inline 31.55% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 94.85% : 0.000203s : 5: match.inline 5.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.49% : 0.000002s : 13: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.67% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.26% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000011s : 64: predicate.switch_simplify 1.54% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002571 25 55.20% : 0.001419s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.42% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.38% : 0.001089s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.242315 72 0.02% : 0.000054s : 1: add_recomputation 0.03% : 0.000071s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000291s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 13.96% : 0.033836s : 1: jit_opt_a 0.06% : 0.000156s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.17% : 0.000410s : 1: loop_unroll 0.32% : 0.000774s : 1: mutable_eliminate 0.45% : 0.001087s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000448s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.71% : 0.001717s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 11.47% : 0.027795s : 1: renormalize.infer 0.51% : 0.001235s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.04% : 0.000102s : 1: rewriter_before_opt_a 0.03% : 0.000077s : 1: symbol_engine_optimizer 71.71% : 0.173774s : 1: type_inference TotalTime = 0.234145, [30] [bootstrap]: 0.00029479 [type_inference]: 0.222739 [event_method]: 2.09e-05 [auto_monad]: 7.202e-05 [graph_reusing]: 6.25002e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 0.0004924 [rewriter_before_opt_a]: 8.548e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.00813953, [2] [Cycle 1]: 0.003468, [27] [switch_simplify]: 5.158e-05 [loop_unroll]: 2.969e-05 [a_1]: 0.00056697 [with_stream_mark]: 1.743e-05 [recompute_prepare]: 8.22998e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.548e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.14998e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00247649 [add_forward_monad_depend]: 5.51002e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.562e-05 [cse]: 2.966e-05 [replace_applicator]: 1.281e-05 [Cycle 2]: 0.00034714, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.52001e-06 [a_1]: 0.0001185 [with_stream_mark]: 8.60999e-06 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 1.88002e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.323e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.71003e-06 [cse]: 1.032e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 1.047e-05 [rewriter_after_opt_a]: 3.401e-05 [convert_after_rewriter]: 8.50999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00051657 [jit_opt_b]: 5.533e-05, [1] [Cycle 1]: 4.845e-05, [2] [frontend_op_eliminate]: 1.896e-05 [inline_after_opt_a]: 1.776e-05 [cconv]: 2.714e-05 [loop_unroll]: 0.00042478 [jit_opt_after_cconv]: 0.00015565, [1] [Cycle 1]: 0.00014936, [11] [c_1]: 2.502e-05 [parameter_eliminate]: 3.79002e-06 [updatestate_depend_eliminate]: 6.28998e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 2.239e-05 [call_graph_tuple_transform]: 2.107e-05 [tuple_list_get_item_eliminator]: 7.42998e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.99999e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 9.22999e-06 [add_recomputation]: 4.814e-05 [cse_after_recomputation]: 2.332e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.253e-05 [auto_monad_reorder]: 1.519e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 6.05002e-06 [opt_after_jit_grad]: 0.00061754 [symbol_engine_optimizer]: 8.016e-05, [1] [Cycle 1]: 7.327e-05, [6] [build]: 3.11999e-06 [elim_shapecalc]: 9.10001e-06 [elim_not_effective]: 1.567e-05 [opt_reshape]: 6.86999e-06 [fold_const_symbol]: 9.86998e-06 [renormalize]: 9.80013e-07 [validate]: 4.547e-05 Sums bootstrap : 0.000295s : 0.13% type_inference : 0.222739s : 97.16% event_method : 0.000021s : 0.01% auto_monad : 0.000072s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000492s : 0.21% rewriter_before_opt_a : 0.000085s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.03% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000685s : 0.30% jit_opt_a.with_stream_mark : 0.000026s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002477s : 1.08% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000040s : 0.02% jit_opt_a.replace_applicator : 0.000018s : 0.01% py_interpret_to_execute_after_opt_a : 0.000010s : 0.00% rewriter_after_opt_a : 0.000034s : 0.01% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000517s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000425s : 0.19% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000048s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000618s : 0.27% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.02% Time group info: ------[substitution.] 0.000216 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 4: substitution.graph_param_transform 84.75% : 0.000183s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000004s : 2: substitution.replace_old_param 5.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.222662 2 98.68% : 0.219730s : 1: type_inference.infer 1.32% : 0.002932s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.13% : 0.000045s : 4: replace.inline 32.87% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 94.34% : 0.000181s : 4: match.inline 5.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 2.04% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000002s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.26% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002159 22 67.94% : 0.001467s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.02% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.03% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.237598 72 0.02% : 0.000051s : 1: add_recomputation 0.03% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.13% : 0.000314s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.43% : 0.008142s : 1: jit_opt_a 0.07% : 0.000160s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.18% : 0.000433s : 1: loop_unroll 0.22% : 0.000525s : 1: mutable_eliminate 0.38% : 0.000906s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000629s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000499s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.76% : 0.001803s : 1: renormalize.infer 0.28% : 0.000665s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.04% : 0.000090s : 1: rewriter_before_opt_a 0.03% : 0.000083s : 1: symbol_engine_optimizer 93.75% : 0.222752s : 1: type_inference TotalTime = 0.111739, [30] [bootstrap]: 0.00039397 [type_inference]: 0.0795611 [event_method]: 2.331e-05 [auto_monad]: 8.186e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 3.22002e-06 [py_interpret_to_execute]: 0.00017192 [rewriter_before_opt_a]: 9.282e-05 [expand_dump_flag]: 4.47e-06 [jit_opt_a]: 0.0286858, [2] [Cycle 1]: 0.0240051, [27] [switch_simplify]: 6.462e-05 [loop_unroll]: 3.195e-05 [a_1]: 0.00059392 [with_stream_mark]: 2.089e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.59001e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 1.012e-05 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.0228868 [add_forward_monad_depend]: 1.178e-05 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.859e-05 [cse]: 4.272e-05 [replace_applicator]: 2.869e-05 [Cycle 2]: 0.00040413, [27] [switch_simplify]: 7.57998e-06 [loop_unroll]: 6.64001e-06 [a_1]: 0.00012726 [with_stream_mark]: 1.543e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 4.97999e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 5.11002e-06 [merge_forward]: 4.80999e-06 [cell_reuse_recompute_pass]: 4.32998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.9e-05 [j_node_and_user_rematch]: 1.165e-05 [meta_fg_expand]: 3.16999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.96e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.316e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.594e-05 [rewriter_after_opt_a]: 4.401e-05 [convert_after_rewriter]: 8.05999e-06 [order_py_execute_after_rewriter]: 5.46002e-06 [mutable_eliminate]: 0.00097879 [jit_opt_b]: 5.549e-05, [1] [Cycle 1]: 4.76e-05, [2] [frontend_op_eliminate]: 1.786e-05 [inline_after_opt_a]: 1.755e-05 [cconv]: 2.819e-05 [loop_unroll]: 0.00046298 [jit_opt_after_cconv]: 0.0001518, [1] [Cycle 1]: 0.00014525, [11] [c_1]: 2.222e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.346e-05 [call_graph_tuple_transform]: 2.125e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.84999e-06 [environ_conv]: 5.81998e-06 [add_recomputation]: 5.515e-05 [cse_after_recomputation]: 2.322e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.158e-05 [auto_monad_reorder]: 1.87e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 5.82001e-06 [opt_after_jit_grad]: 0.00048327 [symbol_engine_optimizer]: 0.00010256, [1] [Cycle 1]: 9.588e-05, [6] [build]: 4.41002e-06 [elim_shapecalc]: 8.83001e-06 [elim_not_effective]: 3.622e-05 [opt_reshape]: 6.34999e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 3.20026e-07 [validate]: 4.603e-05 Sums bootstrap : 0.000394s : 0.37% type_inference : 0.079561s : 74.49% event_method : 0.000023s : 0.02% auto_monad : 0.000082s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000172s : 0.16% rewriter_before_opt_a : 0.000093s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.07% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000721s : 0.68% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.022887s : 21.43% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000056s : 0.05% jit_opt_a.replace_applicator : 0.000034s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000979s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000463s : 0.43% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000483s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000036s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000252 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.84% : 0.000007s : 3: substitution.graph_param_transform 83.48% : 0.000210s : 4: substitution.inline 2.09% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 2.66% : 0.000007s : 2: substitution.replace_old_param 5.43% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.079456 2 96.92% : 0.077008s : 1: type_inference.infer 3.08% : 0.002448s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.94% : 0.000057s : 4: replace.inline 31.06% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.39% : 0.000208s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.09% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 2.75% : 0.000004s : 10: predicate.arithmetic_simplify 1.76% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.00% : 0.000001s : 10: predicate.depend_value_elim 0.92% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.40% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.26% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.67% : 0.000008s : 22: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.56% : 0.000002s : 6: predicate.less_batch_normalization 1.89% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 10: predicate.merge_addn 1.19% : 0.000002s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 0.97% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 2.14% : 0.000003s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.47% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.22% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 53: predicate.switch_simplify 1.01% : 0.000001s : 10: predicate.tile_eliminate 1.70% : 0.000002s : 10: predicate.transpose_eliminate 1.23% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.59% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.98% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 2.13% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001358 13 36.98% : 0.000502s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.50% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 59.52% : 0.000808s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135645 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000413s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 21.15% : 0.028691s : 1: jit_opt_a 0.11% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.35% : 0.000471s : 1: loop_unroll 0.73% : 0.000988s : 1: mutable_eliminate 0.72% : 0.000979s : 26: opt.transform.jit_opt_a 0.04% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000176s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 16.17% : 0.021927s : 1: renormalize.infer 0.70% : 0.000945s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.07% : 0.000097s : 1: rewriter_before_opt_a 0.08% : 0.000105s : 1: symbol_engine_optimizer 58.67% : 0.079586s : 1: type_inference TotalTime = 0.0317843, [30] [bootstrap]: 0.00027054 [type_inference]: 0.0240929 [event_method]: 1.973e-05 [auto_monad]: 6.941e-05 [graph_reusing]: 5.97999e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00010091 [rewriter_before_opt_a]: 8.144e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00510626, [2] [Cycle 1]: 0.00172887, [27] [switch_simplify]: 5.191e-05 [loop_unroll]: 2.926e-05 [a_1]: 0.00052158 [with_stream_mark]: 1.841e-05 [recompute_prepare]: 7.58999e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.92998e-06 [updatestate_loads_eliminate]: 3.30998e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.42998e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00078412 [add_forward_monad_depend]: 4.98001e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.465e-05 [cse]: 3.346e-05 [replace_applicator]: 1.135e-05 [Cycle 2]: 0.0003064, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 4.87998e-06 [a_1]: 8.745e-05 [with_stream_mark]: 7.97e-06 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.21998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 4.89998e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.182e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.45999e-06 [replace_old_param]: 6.83998e-06 [inline_without_move]: 4.82e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.33002e-06 [cse]: 1.157e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 9.82001e-06 [rewriter_after_opt_a]: 4.091e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00045677 [jit_opt_b]: 4.651e-05, [1] [Cycle 1]: 4.015e-05, [2] [frontend_op_eliminate]: 1.465e-05 [inline_after_opt_a]: 1.546e-05 [cconv]: 2.492e-05 [loop_unroll]: 0.00039979 [jit_opt_after_cconv]: 0.00013724, [1] [Cycle 1]: 0.00013022, [11] [c_1]: 2.065e-05 [parameter_eliminate]: 2.14e-06 [updatestate_depend_eliminate]: 5.70001e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 1.925e-05 [call_graph_tuple_transform]: 1.842e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.16998e-06 [remove_dup_value]: 1.796e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 1.658e-05 [add_recomputation]: 6.148e-05 [cse_after_recomputation]: 3.471e-05, [1] [Cycle 1]: 1.86e-05, [1] [cse]: 1.254e-05 [auto_monad_reorder]: 2.085e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.47998e-06 [opt_after_jit_grad]: 0.00045753 [symbol_engine_optimizer]: 7.004e-05, [1] [Cycle 1]: 6.379e-05, [6] [build]: 3.00002e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 5.71998e-06 [fold_const_symbol]: 8.37e-06 [renormalize]: 3.60014e-07 [validate]: 4.231e-05 Sums bootstrap : 0.000271s : 0.96% type_inference : 0.024093s : 85.60% event_method : 0.000020s : 0.07% auto_monad : 0.000069s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000101s : 0.36% rewriter_before_opt_a : 0.000081s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.21% jit_opt_a.loop_unroll : 0.000034s : 0.12% jit_opt_a.a_1 : 0.000609s : 2.16% jit_opt_a.with_stream_mark : 0.000026s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000784s : 2.79% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000045s : 0.16% jit_opt_a.replace_applicator : 0.000016s : 0.06% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000457s : 1.62% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000025s : 0.09% loop_unroll : 0.000400s : 1.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000017s : 0.06% add_recomputation : 0.000061s : 0.22% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000021s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000458s : 1.63% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.15% Time group info: ------[substitution.] 0.000202 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000005s : 3: substitution.graph_param_transform 84.51% : 0.000171s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000004s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 6.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024025 2 94.25% : 0.022643s : 1: type_inference.infer 5.75% : 0.001382s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.06% : 0.000044s : 4: replace.inline 31.94% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.67% : 0.000168s : 4: match.inline 6.33% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.34% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.59% : 0.000002s : 10: predicate.addn_zero_filter 2.12% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.57% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.71% : 0.000008s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.00% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000000s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.72% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000771 13 45.40% : 0.000350s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.11% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.49% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033426 72 0.19% : 0.000065s : 1: add_recomputation 0.22% : 0.000073s : 1: auto_monad 0.07% : 0.000023s : 1: auto_monad_reorder 0.86% : 0.000289s : 1: bootstrap 0.08% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000037s : 1: cse_after_recomputation 0.06% : 0.000019s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.28% : 0.005109s : 1: jit_opt_a 0.42% : 0.000140s : 1: jit_opt_after_cconv 0.15% : 0.000049s : 1: jit_opt_b 1.22% : 0.000407s : 1: loop_unroll 1.39% : 0.000464s : 1: mutable_eliminate 2.43% : 0.000813s : 26: opt.transform.jit_opt_a 0.14% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.39% : 0.000466s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000104s : 1: py_interpret_to_execute 0.04% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.32% : 0.000441s : 1: renormalize.infer 1.00% : 0.000335s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.25% : 0.000085s : 1: rewriter_before_opt_a 0.22% : 0.000073s : 1: symbol_engine_optimizer 72.13% : 0.024109s : 1: type_inference TotalTime = 0.0854114, [30] [bootstrap]: 0.00034838 [type_inference]: 0.0703458 [event_method]: 2.648e-05 [auto_monad]: 7.994e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 0.00038533 [rewriter_before_opt_a]: 9.651e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.0107398, [2] [Cycle 1]: 0.0058801, [27] [switch_simplify]: 8.412e-05 [loop_unroll]: 3.249e-05 [a_1]: 0.00078427 [with_stream_mark]: 2.542e-05 [recompute_prepare]: 1.028e-05 [updatestate_depend_eliminate]: 5.14998e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 8.77e-06 [updatestate_useless_node_eliminater]: 7.42002e-06 [accelerated_algorithm]: 7.39002e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 8.1e-06 [merge_forward]: 4.59998e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.808e-05 [j_node_and_user_rematch]: 1.254e-05 [meta_fg_expand]: 3.45003e-06 [replace_old_param]: 1.226e-05 [inline_without_move]: 6.69001e-06 [renormalize]: 0.00447355 [add_forward_monad_depend]: 1.251e-05 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 2.507e-05 [cse]: 4.46e-05 [replace_applicator]: 2.797e-05 [Cycle 2]: 0.00045519, [27] [switch_simplify]: 8.50001e-06 [loop_unroll]: 6.91999e-06 [a_1]: 0.00014387 [with_stream_mark]: 1.662e-05 [recompute_prepare]: 6.28e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 6.69999e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.74999e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 3.3e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.111e-05 [j_node_and_user_rematch]: 2.276e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.213e-05 [inline_without_move]: 5.84999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.52001e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 8.37e-06 [cse]: 1.945e-05 [replace_applicator]: 6.41e-06 [py_interpret_to_execute_after_opt_a]: 2.215e-05 [rewriter_after_opt_a]: 4.637e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00092376 [jit_opt_b]: 0.00010935, [1] [Cycle 1]: 9.855e-05, [2] [frontend_op_eliminate]: 6.152e-05 [inline_after_opt_a]: 2.249e-05 [cconv]: 3.762e-05 [loop_unroll]: 0.00057571 [jit_opt_after_cconv]: 0.00021217, [1] [Cycle 1]: 0.0002037, [11] [c_1]: 3.136e-05 [parameter_eliminate]: 5.21002e-06 [updatestate_depend_eliminate]: 1.116e-05 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 4.465e-05 [call_graph_tuple_transform]: 2.974e-05 [tuple_list_get_item_eliminator]: 7.28e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 7.12002e-06 [remove_dup_value]: 2.346e-05 [partial_unused_args_eliminate]: 4.84998e-06 [environ_conv]: 1.127e-05 [add_recomputation]: 5.61e-05 [cse_after_recomputation]: 2.655e-05, [1] [Cycle 1]: 2.067e-05, [1] [cse]: 1.51e-05 [auto_monad_reorder]: 2.013e-05 [get_jit_bprop_graph]: 2.64999e-06 [rewriter_after_jit_bprop_graph]: 9.03002e-06 [opt_after_jit_grad]: 0.0005954 [symbol_engine_optimizer]: 9.455e-05, [1] [Cycle 1]: 8.549e-05, [6] [build]: 4.65999e-06 [elim_shapecalc]: 9.53997e-06 [elim_not_effective]: 1.851e-05 [opt_reshape]: 1.227e-05 [fold_const_symbol]: 1.012e-05 [renormalize]: 8.2e-07 [validate]: 0.00035232 Sums bootstrap : 0.000348s : 0.43% type_inference : 0.070346s : 87.65% event_method : 0.000026s : 0.03% auto_monad : 0.000080s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000385s : 0.48% rewriter_before_opt_a : 0.000097s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.12% jit_opt_a.loop_unroll : 0.000039s : 0.05% jit_opt_a.a_1 : 0.000928s : 1.16% jit_opt_a.with_stream_mark : 0.000042s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000035s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000024s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.004474s : 5.57% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.04% jit_opt_a.cse : 0.000064s : 0.08% jit_opt_a.replace_applicator : 0.000034s : 0.04% py_interpret_to_execute_after_opt_a : 0.000022s : 0.03% rewriter_after_opt_a : 0.000046s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000924s : 1.15% jit_opt_b.frontend_op_eliminate : 0.000062s : 0.08% jit_opt_b.inline_after_opt_a : 0.000022s : 0.03% cconv : 0.000038s : 0.05% loop_unroll : 0.000576s : 0.72% jit_opt_after_cconv.c_1 : 0.000031s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000023s : 0.03% partial_unused_args_eliminate : 0.000005s : 0.01% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000056s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000595s : 0.74% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000352s : 0.44% Time group info: ------[substitution.] 0.000345 24 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000010s : 4: substitution.graph_param_transform 82.59% : 0.000285s : 4: substitution.inline 4.83% : 0.000017s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000006s : 4: substitution.remove_not_recompute_node 2.33% : 0.000008s : 2: substitution.replace_old_param 4.60% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.070229 2 94.74% : 0.066535s : 1: type_inference.infer 5.26% : 0.003694s : 1: type_inference.specialize ------[replace.] 0.000115 6 68.84% : 0.000079s : 4: replace.inline 31.16% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000297 6 95.04% : 0.000282s : 4: match.inline 4.96% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.62% : 0.000003s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 0.92% : 0.000001s : 12: predicate.compare_switch_simplify 1.04% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.73% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.11% : 0.000002s : 12: predicate.environ_get_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 5.95% : 0.000009s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000003s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.36% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 1.06% : 0.000002s : 12: predicate.minmaximum_grad 2.39% : 0.000004s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.08% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 1.75% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000011s : 58: predicate.switch_simplify 1.10% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.59% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003577 26 65.81% : 0.002354s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.44% : 0.001160s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.090950 72 0.07% : 0.000061s : 1: add_recomputation 0.09% : 0.000084s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.41% : 0.000370s : 1: bootstrap 0.04% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.03% : 0.000032s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.81% : 0.010745s : 1: jit_opt_a 0.24% : 0.000215s : 1: jit_opt_after_cconv 0.12% : 0.000112s : 1: jit_opt_b 0.65% : 0.000587s : 1: loop_unroll 1.03% : 0.000941s : 1: mutable_eliminate 1.37% : 0.001242s : 26: opt.transform.jit_opt_a 0.08% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000075s : 4: opt.transform.jit_opt_b 0.02% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000027s : 1: opt.transform.mutable_eliminate 0.04% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000606s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000007s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000391s : 1: py_interpret_to_execute 0.03% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000026s : 1: remove_dup_value 3.48% : 0.003161s : 1: renormalize.infer 1.42% : 0.001295s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000050s : 1: rewriter_after_opt_a 0.11% : 0.000102s : 1: rewriter_before_opt_a 0.11% : 0.000097s : 1: symbol_engine_optimizer 77.37% : 0.070373s : 1: type_inference TotalTime = 0.0436867, [30] [bootstrap]: 0.00052748 [type_inference]: 0.0317923 [event_method]: 2.524e-05 [auto_monad]: 7.916e-05 [graph_reusing]: 6.71e-06 [pre_auto_parallel]: 3.34001e-06 [py_interpret_to_execute]: 7.393e-05 [rewriter_before_opt_a]: 9.63e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.0079174, [2] [Cycle 1]: 0.00268359, [27] [switch_simplify]: 6.575e-05 [loop_unroll]: 3.309e-05 [a_1]: 0.00072052 [with_stream_mark]: 1.728e-05 [recompute_prepare]: 9.12999e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.43002e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.267e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 2.03002e-06 [replace_old_param]: 9.31002e-06 [inline_without_move]: 6.49999e-06 [renormalize]: 0.00132599 [add_forward_monad_depend]: 8.57998e-06 [auto_monad_grad]: 2.48002e-06 [auto_monad_eliminator]: 2.127e-05 [cse]: 0.00015687 [replace_applicator]: 2.268e-05 [Cycle 2]: 0.00042363, [27] [switch_simplify]: 7.45e-06 [loop_unroll]: 6.01998e-06 [a_1]: 0.00011856 [with_stream_mark]: 1.92e-05 [recompute_prepare]: 7.44002e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.38998e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.68002e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.09e-06 [auto_monad_grad]: 1.81e-06 [auto_monad_eliminator]: 1.234e-05 [cse]: 2.117e-05 [replace_applicator]: 7.10998e-06 [py_interpret_to_execute_after_opt_a]: 2.644e-05 [rewriter_after_opt_a]: 5.409e-05 [convert_after_rewriter]: 8.73001e-06 [order_py_execute_after_rewriter]: 6.33e-06 [mutable_eliminate]: 0.00089325 [jit_opt_b]: 6.165e-05, [1] [Cycle 1]: 5.241e-05, [2] [frontend_op_eliminate]: 2e-05 [inline_after_opt_a]: 1.788e-05 [cconv]: 3.612e-05 [loop_unroll]: 0.00060764 [jit_opt_after_cconv]: 0.0002211, [1] [Cycle 1]: 0.00021131, [11] [c_1]: 2.27e-05 [parameter_eliminate]: 4.80999e-06 [updatestate_depend_eliminate]: 9.69999e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 6.246e-05 [call_graph_tuple_transform]: 2.911e-05 [tuple_list_get_item_eliminator]: 7.03e-06 [none_parameter_eliminate]: 2.09e-06 [renormalize]: 9.99979e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.968e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 8.95001e-06 [add_recomputation]: 6.135e-05 [cse_after_recomputation]: 3.578e-05, [1] [Cycle 1]: 2.723e-05, [1] [cse]: 1.711e-05 [auto_monad_reorder]: 2.084e-05 [get_jit_bprop_graph]: 3.45e-06 [rewriter_after_jit_bprop_graph]: 1.208e-05 [opt_after_jit_grad]: 0.00065978 [symbol_engine_optimizer]: 0.00010002, [1] [Cycle 1]: 9.048e-05, [6] [build]: 5.77999e-06 [elim_shapecalc]: 1.04e-05 [elim_not_effective]: 2.143e-05 [opt_reshape]: 7.5e-06 [fold_const_symbol]: 1.127e-05 [renormalize]: 6.39993e-07 [validate]: 5.491e-05 Sums bootstrap : 0.000527s : 1.38% type_inference : 0.031792s : 83.44% event_method : 0.000025s : 0.07% auto_monad : 0.000079s : 0.21% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000074s : 0.19% rewriter_before_opt_a : 0.000096s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.19% jit_opt_a.loop_unroll : 0.000039s : 0.10% jit_opt_a.a_1 : 0.000839s : 2.20% jit_opt_a.with_stream_mark : 0.000036s : 0.10% jit_opt_a.recompute_prepare : 0.000017s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001326s : 3.48% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.09% jit_opt_a.cse : 0.000178s : 0.47% jit_opt_a.replace_applicator : 0.000030s : 0.08% py_interpret_to_execute_after_opt_a : 0.000026s : 0.07% rewriter_after_opt_a : 0.000054s : 0.14% convert_after_rewriter : 0.000009s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000893s : 2.34% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000036s : 0.09% loop_unroll : 0.000608s : 1.59% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000062s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000061s : 0.16% cse_after_recomputation.cse : 0.000017s : 0.04% auto_monad_reorder : 0.000021s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.03% opt_after_jit_grad : 0.000660s : 1.73% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.14% Time group info: ------[substitution.] 0.000288 27 1.23% : 0.000004s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 3.13% : 0.000009s : 3: substitution.graph_param_transform 81.72% : 0.000235s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.79% : 0.000014s : 3: substitution.reduce_eliminate 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000005s : 2: substitution.replace_old_param 3.82% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031689 2 95.17% : 0.030159s : 1: type_inference.infer 4.83% : 0.001529s : 1: type_inference.specialize ------[replace.] 0.000128 7 62.44% : 0.000080s : 5: replace.inline 37.56% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 7 95.93% : 0.000231s : 5: match.inline 4.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 747 1.19% : 0.000002s : 11: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.42% : 0.000002s : 11: predicate.addn_zero_filter 1.70% : 0.000002s : 11: predicate.arithmetic_simplify 1.61% : 0.000002s : 11: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000002s : 11: predicate.compare_switch_simplify 1.04% : 0.000002s : 11: predicate.depend_value_elim 1.48% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 11: predicate.environ_get_depend_swap 1.03% : 0.000001s : 11: predicate.environ_get_eliminate 0.96% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 4.76% : 0.000007s : 24: predicate.inline 1.05% : 0.000002s : 6: predicate.inline_without_move 0.29% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 16: predicate.load_eliminater 2.31% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.92% : 0.000001s : 11: predicate.merge_addn 1.14% : 0.000002s : 11: predicate.minmaximum_grad 2.44% : 0.000004s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.39% : 0.000003s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 19: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000002s : 11: predicate.reshape_eliminate 1.38% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 11: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.75% : 0.000004s : 18: predicate.switch_defer_inline 1.87% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.17% : 0.000012s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.34% : 0.000002s : 11: predicate.transpose_eliminate 1.67% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.43% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 11: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001204 16 47.21% : 0.000569s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.59% : 0.000079s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.20% : 0.000556s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046175 72 0.14% : 0.000066s : 1: add_recomputation 0.18% : 0.000083s : 1: auto_monad 0.05% : 0.000025s : 1: auto_monad_reorder 1.20% : 0.000555s : 1: bootstrap 0.08% : 0.000039s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.08% : 0.000038s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.07% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.16% : 0.007924s : 1: jit_opt_a 0.49% : 0.000225s : 1: jit_opt_after_cconv 0.14% : 0.000065s : 1: jit_opt_b 1.35% : 0.000622s : 1: loop_unroll 1.98% : 0.000912s : 1: mutable_eliminate 2.36% : 0.001092s : 26: opt.transform.jit_opt_a 0.13% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000025s : 1: opt.transform.mutable_eliminate 0.08% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000046s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000675s : 1: opt_after_jit_grad 0.02% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000078s : 1: py_interpret_to_execute 0.07% : 0.000031s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000022s : 1: remove_dup_value 1.63% : 0.000752s : 1: renormalize.infer 1.22% : 0.000562s : 1: renormalize.specialize 0.03% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000059s : 1: rewriter_after_opt_a 0.22% : 0.000102s : 1: rewriter_before_opt_a 0.22% : 0.000104s : 1: symbol_engine_optimizer 68.90% : 0.031815s : 1: type_inference TotalTime = 0.173717, [30] [bootstrap]: 0.000299 [type_inference]: 0.161084 [event_method]: 2.918e-05 [auto_monad]: 8.858e-05 [graph_reusing]: 6.91999e-06 [pre_auto_parallel]: 2.98998e-06 [py_interpret_to_execute]: 0.0006483 [rewriter_before_opt_a]: 0.00010892 [expand_dump_flag]: 3.77002e-06 [jit_opt_a]: 0.00877053, [2] [Cycle 1]: 0.00502456, [27] [switch_simplify]: 6.439e-05 [loop_unroll]: 3.438e-05 [a_1]: 0.00071723 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 4.37003e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 7.48999e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.46998e-06 [get_grad_eliminate_]: 6.72002e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00380437 [add_forward_monad_depend]: 8.42e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 2.081e-05 [cse]: 3.791e-05 [replace_applicator]: 1.989e-05 [Cycle 2]: 0.00038514, [27] [switch_simplify]: 7.28e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00012663 [with_stream_mark]: 1.222e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 1.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.51e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.516e-05 [rewriter_after_opt_a]: 4.141e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00069727 [jit_opt_b]: 9.729e-05, [1] [Cycle 1]: 8.914e-05, [2] [frontend_op_eliminate]: 5.766e-05 [inline_after_opt_a]: 1.968e-05 [cconv]: 2.969e-05 [loop_unroll]: 0.00053817 [jit_opt_after_cconv]: 0.00016868, [1] [Cycle 1]: 0.00016194, [11] [c_1]: 2.741e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 7.72998e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.69999e-06 [cse]: 2.937e-05 [call_graph_tuple_transform]: 2.231e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 2.00002e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 1.819e-05 [partial_unused_args_eliminate]: 3.38e-06 [environ_conv]: 1.021e-05 [add_recomputation]: 5.024e-05 [cse_after_recomputation]: 2.461e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.794e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 6.01e-06 [opt_after_jit_grad]: 0.00049788 [symbol_engine_optimizer]: 8.139e-05, [1] [Cycle 1]: 7.361e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.589e-05 [opt_reshape]: 8.89998e-06 [fold_const_symbol]: 8.90999e-06 [renormalize]: 3.29979e-07 [validate]: 0.00016022 Sums bootstrap : 0.000299s : 0.18% type_inference : 0.161084s : 94.91% event_method : 0.000029s : 0.02% auto_monad : 0.000089s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000648s : 0.38% rewriter_before_opt_a : 0.000109s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000844s : 0.50% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003804s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000053s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000697s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000058s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000538s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000498s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000160s : 0.09% Time group info: ------[substitution.] 0.000283 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000007s : 4: substitution.graph_param_transform 86.63% : 0.000245s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000006s : 2: substitution.replace_old_param 4.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.159854 2 97.88% : 0.156463s : 1: type_inference.infer 2.12% : 0.003392s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.86% : 0.000073s : 5: replace.inline 31.14% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 7 95.39% : 0.000242s : 5: match.inline 4.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 13: predicate.addn_check_dump 1.65% : 0.000002s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.47% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 1.93% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.32% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.67% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000011s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002517 25 59.13% : 0.001488s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.21% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.66% : 0.000948s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178616 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000092s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.18% : 0.000316s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.91% : 0.008774s : 1: jit_opt_a 0.10% : 0.000171s : 1: jit_opt_after_cconv 0.06% : 0.000100s : 1: jit_opt_b 0.31% : 0.000547s : 1: loop_unroll 0.40% : 0.000707s : 1: mutable_eliminate 0.62% : 0.001101s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000070s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000506s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000655s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.57% : 0.002811s : 1: renormalize.infer 0.55% : 0.000983s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.06% : 0.000113s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 90.20% : 0.161112s : 1: type_inference TotalTime = 0.371225, [30] [bootstrap]: 0.00031539 [type_inference]: 0.319358 [event_method]: 0.00086889 [auto_monad]: 0.00018376 [graph_reusing]: 1.058e-05 [pre_auto_parallel]: 4.52e-06 [py_interpret_to_execute]: 6.805e-05 [rewriter_before_opt_a]: 0.00021913 [expand_dump_flag]: 5.41002e-06 [jit_opt_a]: 0.0465848, [2] [Cycle 1]: 0.0259078, [27] [switch_simplify]: 0.00029851 [loop_unroll]: 7.187e-05 [a_1]: 0.002438 [with_stream_mark]: 2.637e-05 [recompute_prepare]: 1.152e-05 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 7.36999e-06 [meta_shard_fg_expand]: 3.13e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 2.29999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.8e-05 [j_node_and_user_rematch]: 1.141e-05 [meta_fg_expand]: 3.09001e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.49001e-06 [renormalize]: 0.0225823 [add_forward_monad_depend]: 1.315e-05 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 2.395e-05 [cse]: 3.821e-05 [replace_applicator]: 3.07e-05 [Cycle 2]: 0.0004543, [27] [switch_simplify]: 8.88002e-06 [loop_unroll]: 7.34002e-06 [a_1]: 0.00013496 [with_stream_mark]: 2.123e-05 [recompute_prepare]: 7.75e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 6.93998e-06 [updatestate_useless_node_eliminater]: 6.91001e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 3.2e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 6.13002e-06 [cell_reuse_recompute_pass]: 4.58001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.319e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 3.86999e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 4.76002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.76999e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 7.41999e-06 [cse]: 1.618e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 2.037e-05 [rewriter_after_opt_a]: 4.722e-05 [convert_after_rewriter]: 7.97998e-06 [order_py_execute_after_rewriter]: 5.83997e-06 [mutable_eliminate]: 0.00109452 [jit_opt_b]: 7.042e-05, [1] [Cycle 1]: 6.143e-05, [2] [frontend_op_eliminate]: 2.524e-05 [inline_after_opt_a]: 2.201e-05 [cconv]: 3.99e-05 [loop_unroll]: 0.0006213 [jit_opt_after_cconv]: 0.00018113, [1] [Cycle 1]: 0.00017382, [11] [c_1]: 2.637e-05 [parameter_eliminate]: 5.16002e-06 [updatestate_depend_eliminate]: 9.32999e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 1.93002e-06 [cse]: 3.283e-05 [call_graph_tuple_transform]: 2.415e-05 [tuple_list_get_item_eliminator]: 5.41998e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 9.16998e-06 [remove_dup_value]: 1.697e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 5.72999e-06 [add_recomputation]: 6.192e-05 [cse_after_recomputation]: 2.322e-05, [1] [Cycle 1]: 1.772e-05, [1] [cse]: 1.102e-05 [auto_monad_reorder]: 1.664e-05 [get_jit_bprop_graph]: 2.89999e-06 [rewriter_after_jit_bprop_graph]: 1.054e-05 [opt_after_jit_grad]: 0.00061054 [symbol_engine_optimizer]: 8.685e-05, [1] [Cycle 1]: 7.991e-05, [6] [build]: 4.83001e-06 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 8.70001e-06 [fold_const_symbol]: 1.136e-05 [renormalize]: 3.00002e-07 [validate]: 0.00023756 Sums bootstrap : 0.000315s : 0.09% type_inference : 0.319358s : 91.24% event_method : 0.000869s : 0.25% auto_monad : 0.000184s : 0.05% graph_reusing : 0.000011s : 0.00% pre_auto_parallel : 0.000005s : 0.00% py_interpret_to_execute : 0.000068s : 0.02% rewriter_before_opt_a : 0.000219s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000307s : 0.09% jit_opt_a.loop_unroll : 0.000079s : 0.02% jit_opt_a.a_1 : 0.002573s : 0.74% jit_opt_a.with_stream_mark : 0.000048s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000011s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.022582s : 6.45% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000054s : 0.02% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000047s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001095s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000040s : 0.01% loop_unroll : 0.000621s : 0.18% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000062s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000611s : 0.17% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000238s : 0.07% Time group info: ------[substitution.] 0.001097 56 0.18% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000004s : 2: substitution.fold_const_symbol 0.54% : 0.000006s : 3: substitution.graph_param_transform 88.97% : 0.000976s : 15: substitution.inline 0.46% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.64% : 0.000007s : 4: substitution.minmaximum_grad 0.50% : 0.000005s : 4: substitution.remove_not_recompute_node 0.66% : 0.000007s : 2: substitution.replace_old_param 2.00% : 0.000022s : 4: substitution.switch_simplify 1.42% : 0.000016s : 4: substitution.tuple_list_convert_item_index_to_positive 1.19% : 0.000013s : 4: substitution.tuple_list_get_item_depend_reorder 3.07% : 0.000034s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.319183 2 89.41% : 0.285373s : 1: type_inference.infer 10.59% : 0.033810s : 1: type_inference.specialize ------[replace.] 0.000645 23 50.89% : 0.000328s : 15: replace.inline 15.28% : 0.000099s : 4: replace.switch_simplify 33.82% : 0.000218s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000994 23 97.09% : 0.000965s : 15: match.inline 1.77% : 0.000018s : 4: match.switch_simplify 1.15% : 0.000011s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000287 1341 1.74% : 0.000005s : 21: predicate.accumulaten_eliminater 0.54% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000003s : 21: predicate.addn_check_dump 1.63% : 0.000005s : 21: predicate.addn_zero_filter 2.50% : 0.000007s : 21: predicate.arithmetic_simplify 1.17% : 0.000003s : 21: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000003s : 21: predicate.compare_switch_simplify 1.26% : 0.000004s : 21: predicate.depend_value_elim 1.03% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.27% : 0.000004s : 21: predicate.dict_get_item_eliminator 1.40% : 0.000004s : 21: predicate.dict_set_item_eliminator 0.51% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.14% : 0.000000s : 3: predicate.elim_not_effective 0.31% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.26% : 0.000004s : 21: predicate.environ_get_add_eliminate 1.57% : 0.000005s : 21: predicate.environ_get_depend_swap 1.55% : 0.000004s : 21: predicate.environ_get_eliminate 1.13% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.10% : 0.000000s : 3: predicate.fold_const_symbol 0.75% : 0.000002s : 6: predicate.get_grad_eliminate 0.18% : 0.000001s : 3: predicate.graph_param_transform 4.79% : 0.000014s : 46: predicate.inline 0.38% : 0.000001s : 6: predicate.inline_without_move 0.16% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.95% : 0.000003s : 6: predicate.less_batch_normalization 1.37% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 2.24% : 0.000006s : 28: predicate.load_eliminater 1.09% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.78% : 0.000014s : 78: predicate.loop_unroll_before_grad 1.69% : 0.000005s : 24: predicate.make_slice_get_slice_eliminator 1.15% : 0.000003s : 21: predicate.merge_addn 1.35% : 0.000004s : 21: predicate.minmaximum_grad 1.60% : 0.000005s : 3: predicate.mutable_eliminate 0.21% : 0.000001s : 3: predicate.opt_reshape 1.80% : 0.000005s : 28: predicate.partial_eliminate 1.18% : 0.000003s : 21: predicate.print_const_string_wrapper 1.78% : 0.000005s : 21: predicate.reduce_eliminate 1.49% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 6: predicate.remove_not_recompute_node 1.34% : 0.000004s : 31: predicate.replace_applicator 0.31% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000001s : 3: predicate.reset_defer_inline 1.36% : 0.000004s : 21: predicate.reshape_eliminate 1.16% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.56% : 0.000002s : 3: predicate.row_tensor_eliminate 1.96% : 0.000006s : 21: predicate.same_eliminate 0.67% : 0.000002s : 6: predicate.set_cell_output_no_recompute 0.51% : 0.000001s : 6: predicate.special_op_eliminate 0.39% : 0.000001s : 6: predicate.specialize_transform 2.02% : 0.000006s : 21: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.24% : 0.000001s : 3: predicate.switch_call_monad_eliminater 4.15% : 0.000012s : 40: predicate.switch_defer_inline 2.73% : 0.000008s : 40: predicate.switch_layer_defer_inline 9.66% : 0.000028s : 129: predicate.switch_simplify 1.14% : 0.000003s : 21: predicate.tile_eliminate 1.37% : 0.000004s : 21: predicate.transpose_eliminate 1.58% : 0.000005s : 21: predicate.tuple_list_convert_item_index_to_positive 2.00% : 0.000006s : 21: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000010s : 31: predicate.tuple_list_get_item_eliminator 1.94% : 0.000006s : 21: predicate.tuple_list_set_item_eliminator 1.70% : 0.000005s : 25: predicate.tuple_to_list_eliminator_ 1.68% : 0.000005s : 28: predicate.updatestate_pure_node_eliminater 1.93% : 0.000006s : 34: predicate.updatestate_useless_node_eliminater 1.70% : 0.000005s : 21: predicate.value_based_eliminate 0.15% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005679 38 50.98% : 0.002895s : 15: func_graph_cloner_run.FuncGraphClonerGraph 10.07% : 0.000572s : 6: func_graph_cloner_run.FuncGraphClonerNode 38.95% : 0.002212s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.396598 72 0.02% : 0.000066s : 1: add_recomputation 0.05% : 0.000193s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 0.08% : 0.000335s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.22% : 0.000881s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000014s : 1: graph_reusing 11.75% : 0.046591s : 1: jit_opt_a 0.05% : 0.000184s : 1: jit_opt_after_cconv 0.02% : 0.000073s : 1: jit_opt_b 0.16% : 0.000631s : 1: loop_unroll 0.28% : 0.001110s : 1: mutable_eliminate 0.79% : 0.003118s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000038s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000620s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000007s : 1: pre_auto_parallel 0.02% : 0.000072s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 5.31% : 0.021074s : 1: renormalize.infer 0.37% : 0.001487s : 1: renormalize.specialize 0.00% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000051s : 1: rewriter_after_opt_a 0.06% : 0.000225s : 1: rewriter_before_opt_a 0.02% : 0.000089s : 1: symbol_engine_optimizer 80.53% : 0.319388s : 1: type_inference TotalTime = 0.0173965, [30] [bootstrap]: 0.00029324 [type_inference]: 0.00569543 [event_method]: 1.862e-05 [auto_monad]: 8.477e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 4.351e-05 [rewriter_before_opt_a]: 7.516e-05 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.00557502, [2] [Cycle 1]: 0.0018247, [27] [switch_simplify]: 6.201e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00061314 [with_stream_mark]: 2.216e-05 [recompute_prepare]: 7.90998e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.33002e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 6.40002e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 8.84003e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00074301 [add_forward_monad_depend]: 6.00002e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 1.601e-05 [cse]: 3.755e-05 [replace_applicator]: 1.378e-05 [Cycle 2]: 0.00032676, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 4.92e-06 [a_1]: 9.236e-05 [with_stream_mark]: 1.167e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 4.88001e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 6.90002e-06 [inline_without_move]: 4.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.236e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 1.368e-05 [rewriter_after_opt_a]: 4.064e-05 [convert_after_rewriter]: 7.30998e-06 [order_py_execute_after_rewriter]: 6.04999e-06 [mutable_eliminate]: 0.00386207 [jit_opt_b]: 6.569e-05, [1] [Cycle 1]: 5.567e-05, [2] [frontend_op_eliminate]: 1.9e-05 [inline_after_opt_a]: 2.394e-05 [cconv]: 3.634e-05 [loop_unroll]: 0.00045982 [jit_opt_after_cconv]: 0.00019791, [1] [Cycle 1]: 0.00019102, [11] [c_1]: 2.216e-05 [parameter_eliminate]: 4.84e-06 [updatestate_depend_eliminate]: 9.51e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.722e-05 [call_graph_tuple_transform]: 4.466e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.962e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.05e-06 [add_recomputation]: 5.31e-05 [cse_after_recomputation]: 2.642e-05, [1] [Cycle 1]: 2.056e-05, [1] [cse]: 1.408e-05 [auto_monad_reorder]: 1.896e-05 [get_jit_bprop_graph]: 2.68e-06 [rewriter_after_jit_bprop_graph]: 7.30003e-06 [opt_after_jit_grad]: 0.00046733 [symbol_engine_optimizer]: 7.335e-05, [1] [Cycle 1]: 6.633e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 7.87998e-06 [elim_not_effective]: 1.269e-05 [opt_reshape]: 6.07001e-06 [fold_const_symbol]: 8.46002e-06 [renormalize]: 3.89991e-07 [validate]: 4.27e-05 Sums bootstrap : 0.000293s : 2.19% type_inference : 0.005695s : 42.63% event_method : 0.000019s : 0.14% auto_monad : 0.000085s : 0.63% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.33% rewriter_before_opt_a : 0.000075s : 0.56% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.51% jit_opt_a.loop_unroll : 0.000035s : 0.26% jit_opt_a.a_1 : 0.000705s : 5.28% jit_opt_a.with_stream_mark : 0.000034s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000743s : 5.56% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000050s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000041s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.003862s : 28.91% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.14% jit_opt_b.inline_after_opt_a : 0.000024s : 0.18% cconv : 0.000036s : 0.27% loop_unroll : 0.000460s : 3.44% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000037s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000045s : 0.33% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000020s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000053s : 0.40% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000467s : 3.50% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.32% Time group info: ------[substitution.] 0.000241 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.84% : 0.000007s : 3: substitution.graph_param_transform 85.09% : 0.000205s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 5.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005625 2 83.63% : 0.004704s : 1: type_inference.infer 16.37% : 0.000921s : 1: type_inference.specialize ------[replace.] 0.000111 6 79.69% : 0.000089s : 4: replace.inline 20.31% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.78% : 0.000203s : 4: match.inline 5.22% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 3.31% : 0.000004s : 3: predicate.mutable_eliminate 0.75% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.45% : 0.000001s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.20% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.95% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000638 13 46.52% : 0.000297s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.72% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.76% : 0.000292s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019163 72 0.29% : 0.000056s : 1: add_recomputation 0.46% : 0.000089s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 1.62% : 0.000310s : 1: bootstrap 0.21% : 0.000039s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000029s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.12% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 29.11% : 0.005578s : 1: jit_opt_a 1.05% : 0.000201s : 1: jit_opt_after_cconv 0.36% : 0.000069s : 1: jit_opt_b 2.44% : 0.000468s : 1: loop_unroll 20.24% : 0.003880s : 1: mutable_eliminate 4.84% : 0.000927s : 26: opt.transform.jit_opt_a 0.39% : 0.000075s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000031s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.15% : 0.000028s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.48% : 0.000476s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000022s : 1: remove_dup_value 2.13% : 0.000408s : 1: renormalize.infer 1.71% : 0.000327s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000043s : 1: rewriter_after_opt_a 0.41% : 0.000078s : 1: rewriter_before_opt_a 0.40% : 0.000076s : 1: symbol_engine_optimizer 29.81% : 0.005712s : 1: type_inference TotalTime = 0.112833, [30] [bootstrap]: 0.0004507 [type_inference]: 0.102607 [event_method]: 2.375e-05 [auto_monad]: 7.109e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 2.53998e-06 [py_interpret_to_execute]: 0.00015722 [rewriter_before_opt_a]: 8.875e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00704135, [2] [Cycle 1]: 0.00264503, [27] [switch_simplify]: 6.082e-05 [loop_unroll]: 3.08e-05 [a_1]: 0.00058221 [with_stream_mark]: 2.22e-05 [recompute_prepare]: 8.06001e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.49002e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 3.16001e-06 [get_grad_eliminate_]: 7e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.046e-05 [inline_without_move]: 6.31e-06 [renormalize]: 0.0015902 [add_forward_monad_depend]: 5.90002e-06 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 1.583e-05 [cse]: 3.674e-05 [replace_applicator]: 1.398e-05 [Cycle 2]: 0.00032642, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.51e-06 [a_1]: 9.297e-05 [with_stream_mark]: 1.038e-05 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.357e-05 [j_node_and_user_rematch]: 8.21002e-06 [meta_fg_expand]: 1.66998e-06 [replace_old_param]: 7.04001e-06 [inline_without_move]: 5.03002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 1.287e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.248e-05 [rewriter_after_opt_a]: 3.888e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00062621 [jit_opt_b]: 5.088e-05, [1] [Cycle 1]: 4.339e-05, [2] [frontend_op_eliminate]: 1.579e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 2.585e-05 [loop_unroll]: 0.00043257 [jit_opt_after_cconv]: 0.00017571, [1] [Cycle 1]: 0.00013953, [11] [c_1]: 2.209e-05 [parameter_eliminate]: 2.85002e-06 [updatestate_depend_eliminate]: 6.42001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.259e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 5.58997e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.885e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 6.59001e-06 [add_recomputation]: 5.495e-05 [cse_after_recomputation]: 2.691e-05, [1] [Cycle 1]: 2.112e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.794e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 5.05999e-06 [opt_after_jit_grad]: 0.00054534 [symbol_engine_optimizer]: 7.488e-05, [1] [Cycle 1]: 6.846e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 7.72002e-06 [elim_not_effective]: 1.349e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 6.00005e-07 [validate]: 4.398e-05 Sums bootstrap : 0.000451s : 0.42% type_inference : 0.102607s : 94.91% event_method : 0.000024s : 0.02% auto_monad : 0.000071s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000157s : 0.15% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000675s : 0.62% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001590s : 1.47% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000050s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000626s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000433s : 0.40% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000545s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000222 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000006s : 3: substitution.graph_param_transform 84.18% : 0.000187s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000004s : 2: substitution.replace_old_param 6.22% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102510 2 97.65% : 0.100098s : 1: type_inference.infer 2.35% : 0.002412s : 1: type_inference.specialize ------[replace.] 0.000084 6 64.41% : 0.000054s : 4: replace.inline 35.59% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.59% : 0.000184s : 4: match.inline 6.41% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.21% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.02% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 10.73% : 0.000014s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.98% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.08% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.67% : 0.000006s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.64% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 1.11% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.54% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 1.87% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.35% : 0.000009s : 53: predicate.switch_simplify 1.09% : 0.000001s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001282 13 48.39% : 0.000620s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.66% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.95% : 0.000627s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115368 72 0.05% : 0.000058s : 1: add_recomputation 0.07% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.41% : 0.000471s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.11% : 0.007047s : 1: jit_opt_a 0.16% : 0.000179s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.38% : 0.000441s : 1: loop_unroll 0.55% : 0.000635s : 1: mutable_eliminate 0.78% : 0.000904s : 26: opt.transform.jit_opt_a 0.04% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000554s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000162s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.90% : 0.001036s : 1: renormalize.infer 0.47% : 0.000545s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 88.96% : 0.102633s : 1: type_inference TotalTime = 0.0881301, [30] [bootstrap]: 0.00034553 [type_inference]: 0.0770767 [event_method]: 1.983e-05 [auto_monad]: 6.925e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00027516 [rewriter_before_opt_a]: 8.225e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00795967, [2] [Cycle 1]: 0.00396327, [27] [switch_simplify]: 5.721e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00060203 [with_stream_mark]: 2.103e-05 [recompute_prepare]: 8.87e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 2.81999e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.95998e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 6.90002e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.60001e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00289693 [add_forward_monad_depend]: 7.92e-06 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 1.677e-05 [cse]: 3.192e-05 [replace_applicator]: 1.661e-05 [Cycle 2]: 0.0003707, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.62999e-06 [a_1]: 0.00012411 [with_stream_mark]: 1.209e-05 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.68998e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 2.82002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.585e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 8.73001e-06 [inline_without_move]: 5.84e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.211e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.168e-05 [rewriter_after_opt_a]: 3.658e-05 [convert_after_rewriter]: 7.30003e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00064069 [jit_opt_b]: 5.395e-05, [1] [Cycle 1]: 4.682e-05, [2] [frontend_op_eliminate]: 1.838e-05 [inline_after_opt_a]: 1.754e-05 [cconv]: 2.549e-05 [loop_unroll]: 0.00047021 [jit_opt_after_cconv]: 0.00015068, [1] [Cycle 1]: 0.00014436, [11] [c_1]: 2.604e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 2.04e-05 [call_graph_tuple_transform]: 2.172e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.503e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.55999e-06 [add_recomputation]: 4.777e-05 [cse_after_recomputation]: 2.225e-05, [1] [Cycle 1]: 1.694e-05, [1] [cse]: 1.109e-05 [auto_monad_reorder]: 1.536e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00044218 [symbol_engine_optimizer]: 7.438e-05, [1] [Cycle 1]: 6.868e-05, [6] [build]: 2.84001e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.384e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 3.39991e-07 [validate]: 4.571e-05 Sums bootstrap : 0.000346s : 0.41% type_inference : 0.077077s : 91.88% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000275s : 0.33% rewriter_before_opt_a : 0.000082s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000726s : 0.87% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002897s : 3.45% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000044s : 0.05% jit_opt_a.replace_applicator : 0.000023s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000641s : 0.76% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000470s : 0.56% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000442s : 0.53% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.05% Time group info: ------[substitution.] 0.000235 24 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 4: substitution.graph_param_transform 84.26% : 0.000198s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000005s : 2: substitution.replace_old_param 5.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076990 2 97.15% : 0.074794s : 1: type_inference.infer 2.85% : 0.002196s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.59% : 0.000051s : 4: replace.inline 32.41% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.55% : 0.000195s : 4: match.inline 5.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000001s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.71% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.73% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000001s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.70% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003052 30 74.58% : 0.002276s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.49% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.94% : 0.000731s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.092029 72 0.05% : 0.000050s : 1: add_recomputation 0.08% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.40% : 0.000367s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.65% : 0.007963s : 1: jit_opt_a 0.17% : 0.000153s : 1: jit_opt_after_cconv 0.06% : 0.000056s : 1: jit_opt_b 0.52% : 0.000478s : 1: loop_unroll 0.71% : 0.000649s : 1: mutable_eliminate 1.04% : 0.000961s : 26: opt.transform.jit_opt_a 0.06% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000450s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000281s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.29% : 0.002107s : 1: renormalize.infer 0.85% : 0.000780s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.10% : 0.000087s : 1: rewriter_before_opt_a 0.08% : 0.000077s : 1: symbol_engine_optimizer 83.77% : 0.077097s : 1: type_inference TotalTime = 0.0856267, [30] [bootstrap]: 0.00040207 [type_inference]: 0.0422307 [event_method]: 2.289e-05 [auto_monad]: 7.615e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00015349 [rewriter_before_opt_a]: 8.817e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00688555, [2] [Cycle 1]: 0.00270443, [27] [switch_simplify]: 6.023e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00059576 [with_stream_mark]: 2.055e-05 [recompute_prepare]: 7.68001e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.50003e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.93998e-06 [renormalize]: 0.00165559 [add_forward_monad_depend]: 6.09001e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.575e-05 [cse]: 3.77e-05 [replace_applicator]: 1.451e-05 [Cycle 2]: 0.00033418, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 5.36998e-06 [a_1]: 9.665e-05 [with_stream_mark]: 1.146e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 3.46001e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.22e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.31001e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.327e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.255e-05 [rewriter_after_opt_a]: 3.989e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.0336281 [jit_opt_b]: 7.27e-05, [1] [Cycle 1]: 6.188e-05, [2] [frontend_op_eliminate]: 2.434e-05 [inline_after_opt_a]: 2.303e-05 [cconv]: 4.365e-05 [loop_unroll]: 0.00057534 [jit_opt_after_cconv]: 0.00019773, [1] [Cycle 1]: 0.00019013, [11] [c_1]: 2.743e-05 [parameter_eliminate]: 5.20999e-06 [updatestate_depend_eliminate]: 9.69e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 3.54002e-06 [cse]: 4.83e-05 [call_graph_tuple_transform]: 2.465e-05 [tuple_list_get_item_eliminator]: 5.76998e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.76999e-06 [remove_dup_value]: 1.798e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 8.76997e-06 [add_recomputation]: 5.948e-05 [cse_after_recomputation]: 2.681e-05, [1] [Cycle 1]: 2.083e-05, [1] [cse]: 1.299e-05 [auto_monad_reorder]: 1.904e-05 [get_jit_bprop_graph]: 4.58001e-06 [rewriter_after_jit_bprop_graph]: 9.83002e-06 [opt_after_jit_grad]: 0.00066572 [symbol_engine_optimizer]: 8.72e-05, [1] [Cycle 1]: 8.043e-05, [6] [build]: 5.10001e-06 [elim_shapecalc]: 9.22999e-06 [elim_not_effective]: 1.61e-05 [opt_reshape]: 8.09002e-06 [fold_const_symbol]: 1.157e-05 [renormalize]: 5.00004e-07 [validate]: 4.921e-05 Sums bootstrap : 0.000402s : 0.50% type_inference : 0.042231s : 52.05% event_method : 0.000023s : 0.03% auto_monad : 0.000076s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000153s : 0.19% rewriter_before_opt_a : 0.000088s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000692s : 0.85% jit_opt_a.with_stream_mark : 0.000032s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001656s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000051s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.033628s : 41.45% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.03% jit_opt_b.inline_after_opt_a : 0.000023s : 0.03% cconv : 0.000044s : 0.05% loop_unroll : 0.000575s : 0.71% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000059s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000005s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000666s : 0.82% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.06% Time group info: ------[substitution.] 0.000252 23 1.10% : 0.000003s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.78% : 0.000007s : 3: substitution.graph_param_transform 85.48% : 0.000216s : 4: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.49% : 0.000004s : 2: substitution.replace_old_param 5.24% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042135 2 94.29% : 0.039731s : 1: type_inference.infer 5.71% : 0.002404s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.77% : 0.000054s : 4: replace.inline 32.23% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.64% : 0.000213s : 4: match.inline 5.36% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000001s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.56% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.01% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.52% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 4.09% : 0.000005s : 3: predicate.mutable_eliminate 0.79% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000002s : 10: predicate.print_const_string_wrapper 1.49% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.81% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 10: predicate.reshape_eliminate 1.09% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.27% : 0.000002s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 1.84% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000010s : 53: predicate.switch_simplify 1.59% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.26% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001212 13 41.09% : 0.000498s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.32% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.60% : 0.000662s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.088290 72 0.07% : 0.000062s : 1: add_recomputation 0.09% : 0.000079s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.48% : 0.000426s : 1: bootstrap 0.05% : 0.000046s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.80% : 0.006889s : 1: jit_opt_a 0.23% : 0.000201s : 1: jit_opt_after_cconv 0.09% : 0.000076s : 1: jit_opt_b 0.66% : 0.000584s : 1: loop_unroll 38.11% : 0.033650s : 1: mutable_eliminate 1.04% : 0.000917s : 26: opt.transform.jit_opt_a 0.07% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000038s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000042s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000674s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000158s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.03% : 0.000908s : 1: renormalize.infer 0.84% : 0.000739s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.10% : 0.000092s : 1: rewriter_before_opt_a 0.10% : 0.000090s : 1: symbol_engine_optimizer 47.86% : 0.042251s : 1: type_inference TotalTime = 0.0458673, [30] [bootstrap]: 0.00065305 [type_inference]: 0.0132464 [event_method]: 2.946e-05 [auto_monad]: 8.723e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00010728 [rewriter_before_opt_a]: 9.627e-05 [expand_dump_flag]: 2.71e-06 [jit_opt_a]: 0.0288038, [2] [Cycle 1]: 0.00580056, [27] [switch_simplify]: 6.845e-05 [loop_unroll]: 3.074e-05 [a_1]: 0.00068689 [with_stream_mark]: 2.198e-05 [recompute_prepare]: 7.48999e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.284e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 6.19001e-06 [renormalize]: 0.00461609 [add_forward_monad_depend]: 9.86998e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 2.108e-05 [cse]: 3.701e-05 [replace_applicator]: 2.543e-05 [Cycle 2]: 0.000407, [27] [switch_simplify]: 8.45001e-06 [loop_unroll]: 8.05e-06 [a_1]: 0.00013003 [with_stream_mark]: 1.564e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.58998e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 7.22002e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 7.41001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.10002e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 5.71998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.718e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 9.29998e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.34003e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 7.16001e-06 [cse]: 1.317e-05 [replace_applicator]: 5.02999e-06 [py_interpret_to_execute_after_opt_a]: 2.303e-05 [rewriter_after_opt_a]: 4.827e-05 [convert_after_rewriter]: 7.71001e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.00101921 [jit_opt_b]: 5.815e-05, [1] [Cycle 1]: 4.927e-05, [2] [frontend_op_eliminate]: 1.907e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 2.915e-05 [loop_unroll]: 0.00047935 [jit_opt_after_cconv]: 0.00015971, [1] [Cycle 1]: 0.00015196, [11] [c_1]: 2.356e-05 [parameter_eliminate]: 2.90002e-06 [updatestate_depend_eliminate]: 7.33999e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 2.544e-05 [call_graph_tuple_transform]: 2.288e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 8.60018e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.646e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 9.76e-06 [add_recomputation]: 5.132e-05 [cse_after_recomputation]: 2.41e-05, [1] [Cycle 1]: 1.865e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.946e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 7.33e-06 [opt_after_jit_grad]: 0.00050117 [symbol_engine_optimizer]: 0.00012608, [1] [Cycle 1]: 0.0001182, [6] [build]: 1.307e-05 [elim_shapecalc]: 9.19998e-06 [elim_not_effective]: 4.516e-05 [opt_reshape]: 7.26999e-06 [fold_const_symbol]: 1.131e-05 [renormalize]: 3.80009e-07 [validate]: 4.865e-05 Sums bootstrap : 0.000653s : 2.88% type_inference : 0.013246s : 58.51% event_method : 0.000029s : 0.13% auto_monad : 0.000087s : 0.39% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.47% rewriter_before_opt_a : 0.000096s : 0.43% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.34% jit_opt_a.loop_unroll : 0.000039s : 0.17% jit_opt_a.a_1 : 0.000817s : 3.61% jit_opt_a.with_stream_mark : 0.000038s : 0.17% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000014s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.08% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.004616s : 20.39% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.12% jit_opt_a.cse : 0.000050s : 0.22% jit_opt_a.replace_applicator : 0.000030s : 0.13% py_interpret_to_execute_after_opt_a : 0.000023s : 0.10% rewriter_after_opt_a : 0.000048s : 0.21% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001019s : 4.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.08% jit_opt_b.inline_after_opt_a : 0.000017s : 0.08% cconv : 0.000029s : 0.13% loop_unroll : 0.000479s : 2.12% jit_opt_after_cconv.c_1 : 0.000024s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.04% add_recomputation : 0.000051s : 0.23% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000019s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000501s : 2.21% symbol_engine_optimizer.build : 0.000013s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000045s : 0.20% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.21% Time group info: ------[substitution.] 0.000302 23 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000007s : 3: substitution.graph_param_transform 87.21% : 0.000264s : 4: substitution.inline 1.52% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000006s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 4.06% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013088 2 39.09% : 0.005116s : 1: type_inference.infer 60.91% : 0.007972s : 1: type_inference.specialize ------[replace.] 0.000091 6 68.78% : 0.000063s : 4: replace.inline 31.22% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000272 6 95.87% : 0.000261s : 4: match.inline 4.13% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000163 691 1.65% : 0.000003s : 10: predicate.accumulaten_eliminater 0.97% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 10: predicate.addn_check_dump 1.66% : 0.000003s : 10: predicate.addn_zero_filter 2.00% : 0.000003s : 10: predicate.arithmetic_simplify 1.77% : 0.000003s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000002s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 0.92% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.84% : 0.000003s : 10: predicate.dict_get_item_eliminator 1.60% : 0.000003s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.89% : 0.000003s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 0.90% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 1.38% : 0.000002s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 3.91% : 0.000006s : 22: predicate.inline 0.64% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.79% : 0.000003s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.54% : 0.000003s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.35% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 10: predicate.merge_addn 1.08% : 0.000002s : 10: predicate.minmaximum_grad 1.90% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 1.75% : 0.000003s : 15: predicate.partial_eliminate 1.68% : 0.000003s : 10: predicate.print_const_string_wrapper 2.52% : 0.000004s : 10: predicate.reduce_eliminate 1.56% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000003s : 18: predicate.replace_applicator 0.36% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.54% : 0.000003s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.38% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 6: predicate.special_op_eliminate 1.00% : 0.000002s : 6: predicate.specialize_transform 1.74% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.84% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.03% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.33% : 0.000010s : 53: predicate.switch_simplify 1.01% : 0.000002s : 10: predicate.tile_eliminate 1.85% : 0.000003s : 10: predicate.transpose_eliminate 1.68% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.45% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 2.84% : 0.000005s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000998 13 39.19% : 0.000391s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.72% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.09% : 0.000550s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051646 72 0.10% : 0.000054s : 1: add_recomputation 0.18% : 0.000091s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 1.29% : 0.000667s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.07% : 0.000034s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 55.79% : 0.028812s : 1: jit_opt_a 0.31% : 0.000162s : 1: jit_opt_after_cconv 0.12% : 0.000061s : 1: jit_opt_b 0.95% : 0.000489s : 1: loop_unroll 1.99% : 0.001030s : 1: mutable_eliminate 2.09% : 0.001078s : 26: opt.transform.jit_opt_a 0.11% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000070s : 4: opt.transform.symbol_engine_opt 0.99% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000111s : 1: py_interpret_to_execute 0.05% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 7.21% : 0.003722s : 1: renormalize.infer 1.71% : 0.000882s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000051s : 1: rewriter_after_opt_a 0.19% : 0.000099s : 1: rewriter_before_opt_a 0.25% : 0.000129s : 1: symbol_engine_optimizer 25.68% : 0.013265s : 1: type_inference TotalTime = 0.118729, [30] [bootstrap]: 0.00033962 [type_inference]: 0.108628 [event_method]: 2.28e-05 [auto_monad]: 7.139e-05 [graph_reusing]: 6.50002e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00042422 [rewriter_before_opt_a]: 9.89e-05 [expand_dump_flag]: 3.64002e-06 [jit_opt_a]: 0.00704737, [2] [Cycle 1]: 0.00356809, [27] [switch_simplify]: 6.227e-05 [loop_unroll]: 3.734e-05 [a_1]: 0.00067128 [with_stream_mark]: 1.631e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.46999e-06 [parameter_eliminate]: 1.71002e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.2e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.54001e-06 [renormalize]: 0.0024385 [add_forward_monad_depend]: 5.04998e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.557e-05 [cse]: 3.537e-05 [replace_applicator]: 1.361e-05 [Cycle 2]: 0.00036165, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00011852 [with_stream_mark]: 1.082e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 1.56002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.412e-05 [j_node_and_user_rematch]: 8.83001e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.91001e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.401e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.102e-05 [rewriter_after_opt_a]: 3.685e-05 [convert_after_rewriter]: 6.85998e-06 [order_py_execute_after_rewriter]: 4.82998e-06 [mutable_eliminate]: 0.00049564 [jit_opt_b]: 5.395e-05, [1] [Cycle 1]: 4.741e-05, [2] [frontend_op_eliminate]: 1.825e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 2.583e-05 [loop_unroll]: 0.00041236 [jit_opt_after_cconv]: 0.00014773, [1] [Cycle 1]: 0.00014132, [11] [c_1]: 2.525e-05 [parameter_eliminate]: 2.48998e-06 [updatestate_depend_eliminate]: 5.37999e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.147e-05 [call_graph_tuple_transform]: 1.916e-05 [tuple_list_get_item_eliminator]: 6.51999e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.775e-05 [partial_unused_args_eliminate]: 1.93002e-06 [environ_conv]: 7.91001e-06 [add_recomputation]: 4.835e-05 [cse_after_recomputation]: 2.361e-05, [1] [Cycle 1]: 1.873e-05, [1] [cse]: 1.306e-05 [auto_monad_reorder]: 1.759e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.35999e-06 [opt_after_jit_grad]: 0.00044843 [symbol_engine_optimizer]: 7.222e-05, [1] [Cycle 1]: 6.639e-05, [6] [build]: 3.45e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.283e-05 [opt_reshape]: 6.11998e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 4.00003e-07 [validate]: 6.561e-05 Sums bootstrap : 0.000340s : 0.30% type_inference : 0.108628s : 94.43% event_method : 0.000023s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000424s : 0.37% rewriter_before_opt_a : 0.000099s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.04% jit_opt_a.a_1 : 0.000790s : 0.69% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002439s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000496s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000412s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000448s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000066s : 0.06% Time group info: ------[substitution.] 0.000244 25 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 4: substitution.graph_param_transform 86.95% : 0.000212s : 5: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 1.41% : 0.000003s : 2: substitution.replace_old_param 4.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108556 2 97.35% : 0.105678s : 1: type_inference.infer 2.65% : 0.002877s : 1: type_inference.specialize ------[replace.] 0.000099 7 67.51% : 0.000067s : 5: replace.inline 32.49% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 7 95.25% : 0.000209s : 5: match.inline 4.75% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.18% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000002s : 13: predicate.compare_switch_simplify 1.35% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.34% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.76% : 0.000002s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 20: predicate.switch_defer_inline 2.30% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.75% : 0.000011s : 64: predicate.switch_simplify 1.16% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002316 25 62.90% : 0.001457s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.92% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.18% : 0.000792s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122249 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.29% : 0.000358s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.77% : 0.007050s : 1: jit_opt_a 0.12% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.34% : 0.000420s : 1: loop_unroll 0.41% : 0.000504s : 1: mutable_eliminate 0.85% : 0.001037s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000431s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.37% : 0.001670s : 1: renormalize.infer 0.62% : 0.000761s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.87% : 0.108647s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:21.733.583 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda01a6160> should be wrapped by jit only once. TotalTime = 0.0571858, [30] [bootstrap]: 0.00030519 [type_inference]: 0.0491912 [event_method]: 1.99e-05 [auto_monad]: 6.811e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 9.955e-05 [rewriter_before_opt_a]: 7.936e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00533491, [2] [Cycle 1]: 0.0017337, [27] [switch_simplify]: 5.011e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00050603 [with_stream_mark]: 1.591e-05 [recompute_prepare]: 7.58999e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.62998e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 0.0008119 [add_forward_monad_depend]: 5.46e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.522e-05 [cse]: 3.38e-05 [replace_applicator]: 1.214e-05 [Cycle 2]: 0.00031214, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 4.94e-06 [a_1]: 8.681e-05 [with_stream_mark]: 9.62001e-06 [recompute_prepare]: 5.16998e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.24e-05 [j_node_and_user_rematch]: 7.90998e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 6.88e-06 [inline_without_move]: 4.94003e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.207e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.072e-05 [rewriter_after_opt_a]: 3.577e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.0004935 [jit_opt_b]: 4.731e-05, [1] [Cycle 1]: 4.107e-05, [2] [frontend_op_eliminate]: 1.457e-05 [inline_after_opt_a]: 1.602e-05 [cconv]: 2.51e-05 [loop_unroll]: 0.00041857 [jit_opt_after_cconv]: 0.00014436, [1] [Cycle 1]: 0.00013712, [11] [c_1]: 2.12e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.254e-05 [call_graph_tuple_transform]: 1.891e-05 [tuple_list_get_item_eliminator]: 5.49998e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.727e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.96001e-06 [add_recomputation]: 5.099e-05 [cse_after_recomputation]: 2.396e-05, [1] [Cycle 1]: 1.807e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 2.796e-05 [opt_after_jit_grad]: 0.00046967 [symbol_engine_optimizer]: 7.115e-05, [1] [Cycle 1]: 6.48e-05, [6] [build]: 2.97002e-06 [elim_shapecalc]: 7.75e-06 [elim_not_effective]: 1.324e-05 [opt_reshape]: 5.65001e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 3.59985e-07 [validate]: 3.643e-05 Sums bootstrap : 0.000305s : 0.57% type_inference : 0.049191s : 92.21% event_method : 0.000020s : 0.04% auto_monad : 0.000068s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000100s : 0.19% rewriter_before_opt_a : 0.000079s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.10% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000593s : 1.11% jit_opt_a.with_stream_mark : 0.000026s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000812s : 1.52% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000046s : 0.09% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000494s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000419s : 0.78% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000051s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000028s : 0.05% opt_after_jit_grad : 0.000470s : 0.88% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.07% Time group info: ------[substitution.] 0.000186 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000005s : 3: substitution.graph_param_transform 82.83% : 0.000154s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000004s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 6.61% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049117 2 97.13% : 0.047706s : 1: type_inference.infer 2.87% : 0.001411s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.05% : 0.000046s : 4: replace.inline 31.95% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 93.14% : 0.000151s : 4: match.inline 6.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.50% : 0.000002s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.50% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.25% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.50% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.73% : 0.000008s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000785 13 46.58% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.22% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.20% : 0.000386s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058854 72 0.09% : 0.000054s : 1: add_recomputation 0.12% : 0.000071s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.54% : 0.000316s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.07% : 0.005338s : 1: jit_opt_a 0.25% : 0.000147s : 1: jit_opt_after_cconv 0.08% : 0.000050s : 1: jit_opt_b 0.73% : 0.000427s : 1: loop_unroll 0.85% : 0.000502s : 1: mutable_eliminate 1.36% : 0.000798s : 26: opt.transform.jit_opt_a 0.08% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000103s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.77% : 0.000454s : 1: renormalize.infer 0.60% : 0.000350s : 1: renormalize.specialize 0.05% : 0.000030s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.14% : 0.000083s : 1: rewriter_before_opt_a 0.13% : 0.000074s : 1: symbol_engine_optimizer 83.61% : 0.049207s : 1: type_inference TotalTime = 0.0696486, [30] [bootstrap]: 0.00045138 [type_inference]: 0.0496295 [event_method]: 8.396e-05 [auto_monad]: 0.00011784 [graph_reusing]: 7.25998e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 3.933e-05 [rewriter_before_opt_a]: 0.00012456 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.0167245, [2] [Cycle 1]: 0.0103094, [27] [switch_simplify]: 0.00010887 [loop_unroll]: 4.433e-05 [a_1]: 0.00112051 [with_stream_mark]: 3.615e-05 [recompute_prepare]: 2.211e-05 [updatestate_depend_eliminate]: 1.052e-05 [updatestate_assign_eliminate]: 6.78e-06 [updatestate_loads_eliminate]: 7.58001e-06 [parameter_eliminate]: 2.81e-06 [specialize_transform]: 1.509e-05 [updatestate_useless_node_eliminater]: 1.298e-05 [accelerated_algorithm]: 1.386e-05 [meta_shard_fg_expand]: 5.61e-06 [get_grad_eliminate_]: 1.399e-05 [merge_forward]: 1.034e-05 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.886e-05 [j_node_and_user_rematch]: 2.646e-05 [meta_fg_expand]: 0.00319669 [replace_old_param]: 9.825e-05 [inline_without_move]: 7.439e-05 [renormalize]: 0.00504953 [add_forward_monad_depend]: 1.341e-05 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.599e-05 [cse]: 2.946e-05 [replace_applicator]: 2.662e-05 [Cycle 2]: 0.00048787, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 5.84999e-06 [a_1]: 7.651e-05 [with_stream_mark]: 1.038e-05 [recompute_prepare]: 4.23001e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 4.07e-06 [updatestate_useless_node_eliminater]: 3.37002e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 3.43999e-06 [merge_forward]: 3.82002e-06 [cell_reuse_recompute_pass]: 4.47e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 7.65998e-06 [meta_fg_expand]: 0.00016836 [replace_old_param]: 5.64998e-06 [inline_without_move]: 3.98001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 5.05999e-06 [cse]: 1.004e-05 [replace_applicator]: 3.71999e-06 [py_interpret_to_execute_after_opt_a]: 1.281e-05 [rewriter_after_opt_a]: 3.694e-05 [convert_after_rewriter]: 6.83998e-06 [order_py_execute_after_rewriter]: 4.41002e-06 [mutable_eliminate]: 0.00078501 [jit_opt_b]: 4.569e-05, [1] [Cycle 1]: 3.745e-05, [2] [frontend_op_eliminate]: 1.293e-05 [inline_after_opt_a]: 1.195e-05 [cconv]: 2.839e-05 [loop_unroll]: 0.00044496 [jit_opt_after_cconv]: 0.00016828, [1] [Cycle 1]: 0.00016119, [11] [c_1]: 1.361e-05 [parameter_eliminate]: 3.33998e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 1.77999e-06 [updatestate_loads_eliminate]: 1.45999e-06 [cse]: 5.435e-05 [call_graph_tuple_transform]: 1.651e-05 [tuple_list_get_item_eliminator]: 4.14002e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 3.58999e-06 [remove_dup_value]: 1.523e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 5.28002e-06 [add_recomputation]: 4.52e-05 [cse_after_recomputation]: 1.974e-05, [1] [Cycle 1]: 1.435e-05, [1] [cse]: 8.22998e-06 [auto_monad_reorder]: 1.377e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 6.11e-06 [opt_after_jit_grad]: 0.00046556 [symbol_engine_optimizer]: 7.029e-05, [1] [Cycle 1]: 6.417e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 6.45997e-06 [elim_not_effective]: 1.15e-05 [opt_reshape]: 4.75001e-06 [fold_const_symbol]: 6.80998e-06 [renormalize]: 5.60016e-07 [validate]: 3.516e-05 Sums bootstrap : 0.000451s : 0.72% type_inference : 0.049629s : 78.90% event_method : 0.000084s : 0.13% auto_monad : 0.000118s : 0.19% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.06% rewriter_before_opt_a : 0.000125s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000115s : 0.18% jit_opt_a.loop_unroll : 0.000050s : 0.08% jit_opt_a.a_1 : 0.001197s : 1.90% jit_opt_a.with_stream_mark : 0.000047s : 0.07% jit_opt_a.recompute_prepare : 0.000026s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000010s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000019s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.03% jit_opt_a.accelerated_algorithm : 0.000019s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.03% jit_opt_a.merge_forward : 0.000014s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000034s : 0.05% jit_opt_a.meta_fg_expand : 0.003365s : 5.35% jit_opt_a.replace_old_param : 0.000104s : 0.17% jit_opt_a.inline_without_move : 0.000078s : 0.12% jit_opt_a.renormalize : 0.005050s : 8.03% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000039s : 0.06% jit_opt_a.replace_applicator : 0.000030s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000785s : 1.25% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.02% jit_opt_b.inline_after_opt_a : 0.000012s : 0.02% cconv : 0.000028s : 0.05% loop_unroll : 0.000445s : 0.71% jit_opt_after_cconv.c_1 : 0.000014s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000054s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000045s : 0.07% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000466s : 0.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000442 54 0.47% : 0.000002s : 1: substitution.elim_not_effective 0.27% : 0.000001s : 1: substitution.fold_const_symbol 1.21% : 0.000005s : 1: substitution.graph_param_transform 69.71% : 0.000308s : 7: substitution.inline 6.83% : 0.000030s : 2: substitution.inline_without_move 2.10% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.06% : 0.000005s : 2: substitution.minmaximum_grad 4.69% : 0.000021s : 3: substitution.partial_eliminate 1.75% : 0.000008s : 9: substitution.remove_not_recompute_node 1.50% : 0.000007s : 2: substitution.replace_applicator 1.91% : 0.000008s : 8: substitution.replace_old_param 0.85% : 0.000004s : 1: substitution.set_cell_output_no_recompute 1.90% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.41% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 4.34% : 0.000019s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049492 2 96.06% : 0.047544s : 1: type_inference.infer 3.94% : 0.001948s : 1: type_inference.specialize ------[replace.] 0.000092 9 79.54% : 0.000073s : 7: replace.inline 20.46% : 0.000019s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000317 9 95.68% : 0.000303s : 7: match.inline 4.32% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000207 1171 1.36% : 0.000003s : 19: predicate.accumulaten_eliminater 0.42% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.31% : 0.000003s : 19: predicate.addn_check_dump 1.39% : 0.000003s : 19: predicate.addn_zero_filter 1.94% : 0.000004s : 19: predicate.arithmetic_simplify 1.48% : 0.000003s : 19: predicate.cast_eliminate 0.23% : 0.000000s : 1: predicate.check_bprop_eliminate 1.38% : 0.000003s : 19: predicate.compare_switch_simplify 1.36% : 0.000003s : 19: predicate.depend_value_elim 1.28% : 0.000003s : 19: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 19: predicate.dict_get_item_eliminator 1.66% : 0.000003s : 19: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.26% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.30% : 0.000003s : 19: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 19: predicate.environ_get_depend_swap 1.56% : 0.000003s : 19: predicate.environ_get_eliminate 1.33% : 0.000003s : 19: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 0.97% : 0.000002s : 12: predicate.get_grad_eliminate 0.14% : 0.000000s : 1: predicate.graph_param_transform 4.95% : 0.000010s : 30: predicate.inline 3.51% : 0.000007s : 36: predicate.inline_without_move 0.43% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.43% : 0.000003s : 12: predicate.less_batch_normalization 1.77% : 0.000004s : 21: predicate.list_to_tuple_eliminator_ 1.66% : 0.000003s : 22: predicate.load_eliminater 0.63% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.50% : 0.000007s : 48: predicate.loop_unroll_before_grad 1.86% : 0.000004s : 20: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 19: predicate.merge_addn 1.16% : 0.000002s : 19: predicate.minmaximum_grad 0.77% : 0.000002s : 1: predicate.mutable_eliminate 0.32% : 0.000001s : 1: predicate.opt_reshape 1.78% : 0.000004s : 22: predicate.partial_eliminate 1.61% : 0.000003s : 19: predicate.print_const_string_wrapper 2.19% : 0.000005s : 19: predicate.reduce_eliminate 1.47% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 12: predicate.remove_not_recompute_node 1.52% : 0.000003s : 23: predicate.replace_applicator 1.82% : 0.000004s : 36: predicate.replace_old_param 0.15% : 0.000000s : 1: predicate.reset_defer_inline 1.50% : 0.000003s : 19: predicate.reshape_eliminate 1.41% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.47% : 0.000003s : 19: predicate.same_eliminate 0.53% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.48% : 0.000001s : 2: predicate.special_op_eliminate 1.04% : 0.000002s : 12: predicate.specialize_transform 1.70% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 19: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.37% : 0.000005s : 28: predicate.switch_defer_inline 2.28% : 0.000005s : 28: predicate.switch_layer_defer_inline 7.33% : 0.000015s : 77: predicate.switch_simplify 1.60% : 0.000003s : 19: predicate.tile_eliminate 1.41% : 0.000003s : 19: predicate.transpose_eliminate 2.18% : 0.000005s : 19: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.79% : 0.000004s : 19: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.53% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.75% : 0.000006s : 34: predicate.updatestate_useless_node_eliminater 2.61% : 0.000005s : 19: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.21% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002240 25 75.72% : 0.001696s : 15: func_graph_cloner_run.FuncGraphClonerGraph 24.28% : 0.000544s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076389 72 0.06% : 0.000049s : 1: add_recomputation 0.16% : 0.000123s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.63% : 0.000484s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000047s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.12% : 0.000090s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 21.90% : 0.016729s : 1: jit_opt_a 0.22% : 0.000171s : 1: jit_opt_after_cconv 0.06% : 0.000048s : 1: jit_opt_b 0.59% : 0.000454s : 1: loop_unroll 1.04% : 0.000795s : 1: mutable_eliminate 2.22% : 0.001699s : 26: opt.transform.jit_opt_a 0.04% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000042s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 5.63% : 0.004301s : 1: renormalize.infer 0.96% : 0.000731s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.17% : 0.000128s : 1: rewriter_before_opt_a 0.10% : 0.000073s : 1: symbol_engine_optimizer 65.00% : 0.049656s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:21.832.536 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d5e0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:21.833.314 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0767346, [30] [bootstrap]: 0.00045617 [type_inference]: 0.0402024 [event_method]: 2.316e-05 [auto_monad]: 8.133e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 0.00018284 [rewriter_before_opt_a]: 9.25e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0328255, [2] [Cycle 1]: 0.00424954, [27] [switch_simplify]: 8.911e-05 [loop_unroll]: 3.072e-05 [a_1]: 0.00068729 [with_stream_mark]: 2.633e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.55998e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00303441 [add_forward_monad_depend]: 7.26001e-06 [auto_monad_grad]: 2.14999e-06 [auto_monad_eliminator]: 1.793e-05 [cse]: 4.034e-05 [replace_applicator]: 1.964e-05 [Cycle 2]: 0.00035305, [27] [switch_simplify]: 7.25003e-06 [loop_unroll]: 5.29998e-06 [a_1]: 0.00010241 [with_stream_mark]: 1.442e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 2.93e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.596e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.52998e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.388e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.296e-05 [rewriter_after_opt_a]: 4.103e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00094842 [jit_opt_b]: 6.191e-05, [1] [Cycle 1]: 5.354e-05, [2] [frontend_op_eliminate]: 2.133e-05 [inline_after_opt_a]: 1.958e-05 [cconv]: 3.067e-05 [loop_unroll]: 0.00052169 [jit_opt_after_cconv]: 0.00017433, [1] [Cycle 1]: 0.00016724, [11] [c_1]: 2.493e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 8.33001e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 3.268e-05 [call_graph_tuple_transform]: 2.369e-05 [tuple_list_get_item_eliminator]: 6.00002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.49999e-06 [remove_dup_value]: 1.766e-05 [partial_unused_args_eliminate]: 3.28e-06 [environ_conv]: 7.69002e-06 [add_recomputation]: 6.025e-05 [cse_after_recomputation]: 2.638e-05, [1] [Cycle 1]: 1.946e-05, [1] [cse]: 1.228e-05 [auto_monad_reorder]: 1.967e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 7.63001e-06 [opt_after_jit_grad]: 0.00056514 [symbol_engine_optimizer]: 9.061e-05, [1] [Cycle 1]: 8.354e-05, [6] [build]: 5.18002e-06 [elim_shapecalc]: 9.42001e-06 [elim_not_effective]: 1.718e-05 [opt_reshape]: 7.25998e-06 [fold_const_symbol]: 1.205e-05 [renormalize]: 1.18001e-06 [validate]: 5.265e-05 Sums bootstrap : 0.000456s : 0.95% type_inference : 0.040202s : 83.99% event_method : 0.000023s : 0.05% auto_monad : 0.000081s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000183s : 0.38% rewriter_before_opt_a : 0.000093s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000096s : 0.20% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000790s : 1.65% jit_opt_a.with_stream_mark : 0.000041s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.003034s : 6.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000054s : 0.11% jit_opt_a.replace_applicator : 0.000025s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000041s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000948s : 1.98% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.04% cconv : 0.000031s : 0.06% loop_unroll : 0.000522s : 1.09% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000060s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000020s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000565s : 1.18% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.11% Time group info: ------[substitution.] 0.000310 23 0.97% : 0.000003s : 2: substitution.elim_not_effective 0.87% : 0.000003s : 2: substitution.fold_const_symbol 2.23% : 0.000007s : 3: substitution.graph_param_transform 86.90% : 0.000269s : 4: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000006s : 2: substitution.replace_old_param 4.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040101 2 93.89% : 0.037651s : 1: type_inference.infer 6.11% : 0.002449s : 1: type_inference.specialize ------[replace.] 0.000102 6 69.57% : 0.000071s : 4: replace.inline 30.43% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 6 95.73% : 0.000266s : 4: match.inline 4.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.28% : 0.000002s : 10: predicate.addn_check_dump 1.62% : 0.000002s : 10: predicate.addn_zero_filter 3.13% : 0.000004s : 10: predicate.arithmetic_simplify 1.65% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.04% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.07% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.31% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.28% : 0.000008s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.95% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000002s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.04% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.25% : 0.000002s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.62% : 0.000002s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001377 13 41.68% : 0.000574s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.40% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.92% : 0.000742s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.080877 72 0.08% : 0.000063s : 1: add_recomputation 0.11% : 0.000085s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.59% : 0.000480s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 40.59% : 0.032830s : 1: jit_opt_a 0.22% : 0.000177s : 1: jit_opt_after_cconv 0.08% : 0.000065s : 1: jit_opt_b 0.66% : 0.000530s : 1: loop_unroll 1.18% : 0.000958s : 1: mutable_eliminate 1.30% : 0.001053s : 26: opt.transform.jit_opt_a 0.07% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000574s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000187s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 2.67% : 0.002162s : 1: renormalize.infer 1.06% : 0.000860s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000097s : 1: rewriter_before_opt_a 0.12% : 0.000094s : 1: symbol_engine_optimizer 49.73% : 0.040218s : 1: type_inference TotalTime = 0.27869, [30] [bootstrap]: 0.00044307 [type_inference]: 0.258825 [event_method]: 2.725e-05 [auto_monad]: 9.175e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00084898 [rewriter_before_opt_a]: 0.0001031 [expand_dump_flag]: 4.40999e-06 [jit_opt_a]: 0.0113693, [2] [Cycle 1]: 0.00582741, [27] [switch_simplify]: 6.257e-05 [loop_unroll]: 3.413e-05 [a_1]: 0.00078221 [with_stream_mark]: 2.22e-05 [recompute_prepare]: 9.64999e-06 [updatestate_depend_eliminate]: 3.82998e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 8.25e-06 [updatestate_useless_node_eliminater]: 6.79999e-06 [accelerated_algorithm]: 7.7e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 1.152e-05 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 1.171e-05 [inline_without_move]: 7.21999e-06 [renormalize]: 0.00453162 [add_forward_monad_depend]: 9.56998e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.908e-05 [cse]: 3.619e-05 [replace_applicator]: 1.86e-05 [Cycle 2]: 0.0004064, [27] [switch_simplify]: 7.77e-06 [loop_unroll]: 7.04001e-06 [a_1]: 0.00014096 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.75002e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.99997e-06 [cell_reuse_recompute_pass]: 2.79999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 9.78998e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.36e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.644e-05 [rewriter_after_opt_a]: 4.839e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.54998e-06 [mutable_eliminate]: 0.00442867 [jit_opt_b]: 0.00012432, [1] [Cycle 1]: 0.00011228, [2] [frontend_op_eliminate]: 2.41e-05 [inline_after_opt_a]: 2.091e-05 [cconv]: 3.667e-05 [loop_unroll]: 0.00082127 [jit_opt_after_cconv]: 0.0001999, [1] [Cycle 1]: 0.00019012, [11] [c_1]: 2.945e-05 [parameter_eliminate]: 3.2e-06 [updatestate_depend_eliminate]: 1.184e-05 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 4.171e-05 [call_graph_tuple_transform]: 2.818e-05 [tuple_list_get_item_eliminator]: 6.96999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 9.50007e-07 [switch_simplify]: 6.90002e-06 [remove_dup_value]: 1.881e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 1.098e-05 [add_recomputation]: 6.239e-05 [cse_after_recomputation]: 2.587e-05, [1] [Cycle 1]: 2.01e-05, [1] [cse]: 1.41e-05 [auto_monad_reorder]: 2.264e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 7.65e-06 [opt_after_jit_grad]: 0.00053517 [symbol_engine_optimizer]: 0.00032147, [1] [Cycle 1]: 8.328e-05, [6] [build]: 4.94e-06 [elim_shapecalc]: 9.69999e-06 [elim_not_effective]: 1.995e-05 [opt_reshape]: 9.49e-06 [fold_const_symbol]: 9.62001e-06 [renormalize]: 2.3999e-07 [validate]: 5.556e-05 Sums bootstrap : 0.000443s : 0.16% type_inference : 0.258825s : 94.94% event_method : 0.000027s : 0.01% auto_monad : 0.000092s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000849s : 0.31% rewriter_before_opt_a : 0.000103s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000923s : 0.34% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004532s : 1.66% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000048s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.004429s : 1.62% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000037s : 0.01% loop_unroll : 0.000821s : 0.30% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000062s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000023s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000535s : 0.20% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.02% Time group info: ------[substitution.] 0.000322 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000002s : 2: substitution.fold_const_symbol 2.06% : 0.000007s : 4: substitution.graph_param_transform 84.17% : 0.000271s : 5: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.91% : 0.000013s : 3: substitution.reduce_eliminate 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000006s : 2: substitution.replace_old_param 3.87% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.258679 2 95.16% : 0.246167s : 1: type_inference.infer 4.84% : 0.012513s : 1: type_inference.specialize ------[replace.] 0.000119 7 66.66% : 0.000080s : 5: replace.inline 33.34% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 7 95.96% : 0.000267s : 5: match.inline 4.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.15% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.57% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.39% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.06% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.10% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 2.55% : 0.000004s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 1.99% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.31% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 23: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.56% : 0.000001s : 4: predicate.reset_defer_inline 1.69% : 0.000003s : 13: predicate.reshape_eliminate 1.44% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.67% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000011s : 64: predicate.switch_simplify 1.14% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.08% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003398 25 58.18% : 0.001977s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.63% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.19% : 0.001332s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.284494 72 0.02% : 0.000066s : 1: add_recomputation 0.03% : 0.000095s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.16% : 0.000460s : 1: bootstrap 0.01% : 0.000039s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.00% : 0.011374s : 1: jit_opt_a 0.07% : 0.000202s : 1: jit_opt_after_cconv 0.04% : 0.000127s : 1: jit_opt_b 0.29% : 0.000831s : 1: loop_unroll 1.56% : 0.004442s : 1: mutable_eliminate 0.42% : 0.001185s : 26: opt.transform.jit_opt_a 0.02% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000030s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000544s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000857s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.21% : 0.003453s : 1: renormalize.infer 0.37% : 0.001065s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000052s : 1: rewriter_after_opt_a 0.04% : 0.000108s : 1: rewriter_before_opt_a 0.11% : 0.000326s : 1: symbol_engine_optimizer 90.98% : 0.258845s : 1: type_inference TotalTime = 0.0465187, [30] [bootstrap]: 0.00030127 [type_inference]: 0.0199784 [event_method]: 7.174e-05 [auto_monad]: 0.00010714 [graph_reusing]: 7.87e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 3.587e-05 [rewriter_before_opt_a]: 0.00012447 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.0232505, [2] [Cycle 1]: 0.0184831, [27] [switch_simplify]: 9.577e-05 [loop_unroll]: 4.814e-05 [a_1]: 0.00113583 [with_stream_mark]: 4.37e-05 [recompute_prepare]: 2.582e-05 [updatestate_depend_eliminate]: 1.004e-05 [updatestate_assign_eliminate]: 7.16999e-06 [updatestate_loads_eliminate]: 7.16001e-06 [parameter_eliminate]: 3.54002e-06 [specialize_transform]: 1.541e-05 [updatestate_useless_node_eliminater]: 1.408e-05 [accelerated_algorithm]: 1.384e-05 [meta_shard_fg_expand]: 6.16e-06 [get_grad_eliminate_]: 1.4e-05 [merge_forward]: 9.87999e-06 [cell_reuse_recompute_pass]: 1.46002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.051e-05 [j_node_and_user_rematch]: 2.635e-05 [meta_fg_expand]: 0.00237069 [replace_old_param]: 8.206e-05 [inline_without_move]: 6.642e-05 [renormalize]: 0.014061 [add_forward_monad_depend]: 9.19e-06 [auto_monad_grad]: 2.97002e-06 [auto_monad_eliminator]: 1.588e-05 [cse]: 3.424e-05 [replace_applicator]: 2.535e-05 [Cycle 2]: 0.00052962, [27] [switch_simplify]: 6.89001e-06 [loop_unroll]: 4.73001e-06 [a_1]: 6.633e-05 [with_stream_mark]: 1.435e-05 [recompute_prepare]: 3.97998e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.73997e-06 [specialize_transform]: 3.88001e-06 [updatestate_useless_node_eliminater]: 3.82002e-06 [accelerated_algorithm]: 4.72e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 4.05e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 3.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.791e-05 [j_node_and_user_rematch]: 7.77e-06 [meta_fg_expand]: 0.00014694 [replace_old_param]: 6.51e-06 [inline_without_move]: 3.88001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 1.50999e-06 [auto_monad_eliminator]: 6.56e-06 [cse]: 1.427e-05 [replace_applicator]: 4.1e-06 [py_interpret_to_execute_after_opt_a]: 1.388e-05 [rewriter_after_opt_a]: 4.28e-05 [convert_after_rewriter]: 6.60997e-06 [order_py_execute_after_rewriter]: 4.3e-06 [mutable_eliminate]: 0.00085403 [jit_opt_b]: 4.836e-05, [1] [Cycle 1]: 4.013e-05, [2] [frontend_op_eliminate]: 1.265e-05 [inline_after_opt_a]: 1.372e-05 [cconv]: 3.343e-05 [loop_unroll]: 0.000469 [jit_opt_after_cconv]: 0.00014365, [1] [Cycle 1]: 0.0001355, [11] [c_1]: 1.473e-05 [parameter_eliminate]: 3.41001e-06 [updatestate_depend_eliminate]: 6.57002e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.54e-06 [cse]: 2.581e-05 [call_graph_tuple_transform]: 1.714e-05 [tuple_list_get_item_eliminator]: 4.13999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 1.02e-06 [switch_simplify]: 3.97e-06 [remove_dup_value]: 1.776e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 4.456e-05 [add_recomputation]: 4.109e-05 [cse_after_recomputation]: 2.338e-05, [1] [Cycle 1]: 1.705e-05, [1] [cse]: 1.001e-05 [auto_monad_reorder]: 1.357e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 6.48003e-06 [opt_after_jit_grad]: 0.00053066 [symbol_engine_optimizer]: 7.572e-05, [1] [Cycle 1]: 6.834e-05, [6] [build]: 4.3e-06 [elim_shapecalc]: 6.38e-06 [elim_not_effective]: 1.208e-05 [opt_reshape]: 5.39e-06 [fold_const_symbol]: 7.67998e-06 [renormalize]: 6.50005e-07 [validate]: 4.05e-05 Sums bootstrap : 0.000301s : 0.73% type_inference : 0.019978s : 48.22% event_method : 0.000072s : 0.17% auto_monad : 0.000107s : 0.26% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000036s : 0.09% rewriter_before_opt_a : 0.000124s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000103s : 0.25% jit_opt_a.loop_unroll : 0.000053s : 0.13% jit_opt_a.a_1 : 0.001202s : 2.90% jit_opt_a.with_stream_mark : 0.000058s : 0.14% jit_opt_a.recompute_prepare : 0.000030s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000019s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.04% jit_opt_a.accelerated_algorithm : 0.000019s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.04% jit_opt_a.merge_forward : 0.000014s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000034s : 0.08% jit_opt_a.meta_fg_expand : 0.002518s : 6.08% jit_opt_a.replace_old_param : 0.000089s : 0.21% jit_opt_a.inline_without_move : 0.000070s : 0.17% jit_opt_a.renormalize : 0.014061s : 33.94% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000049s : 0.12% jit_opt_a.replace_applicator : 0.000029s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000043s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000854s : 2.06% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.03% jit_opt_b.inline_after_opt_a : 0.000014s : 0.03% cconv : 0.000033s : 0.08% loop_unroll : 0.000469s : 1.13% jit_opt_after_cconv.c_1 : 0.000015s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000045s : 0.11% add_recomputation : 0.000041s : 0.10% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000531s : 1.28% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.10% Time group info: ------[substitution.] 0.000422 56 0.38% : 0.000002s : 1: substitution.elim_not_effective 0.38% : 0.000002s : 1: substitution.fold_const_symbol 1.17% : 0.000005s : 1: substitution.graph_param_transform 72.85% : 0.000307s : 7: substitution.inline 5.45% : 0.000023s : 2: substitution.inline_without_move 2.10% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.15% : 0.000005s : 2: substitution.minmaximum_grad 1.22% : 0.000005s : 3: substitution.partial_eliminate 1.96% : 0.000008s : 9: substitution.remove_not_recompute_node 2.11% : 0.000009s : 2: substitution.replace_applicator 1.94% : 0.000008s : 10: substitution.replace_old_param 0.96% : 0.000004s : 1: substitution.set_cell_output_no_recompute 2.10% : 0.000009s : 2: substitution.tuple_list_convert_item_index_to_positive 1.48% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 4.74% : 0.000020s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019876 2 90.75% : 0.018038s : 1: type_inference.infer 9.25% : 0.001838s : 1: type_inference.specialize ------[replace.] 0.000104 9 78.89% : 0.000082s : 7: replace.inline 21.11% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000316 9 95.57% : 0.000302s : 7: match.inline 4.43% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000214 1179 1.42% : 0.000003s : 19: predicate.accumulaten_eliminater 0.59% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.20% : 0.000003s : 19: predicate.addn_check_dump 1.33% : 0.000003s : 19: predicate.addn_zero_filter 2.13% : 0.000005s : 19: predicate.arithmetic_simplify 1.36% : 0.000003s : 19: predicate.cast_eliminate 0.37% : 0.000001s : 1: predicate.check_bprop_eliminate 1.43% : 0.000003s : 19: predicate.compare_switch_simplify 1.64% : 0.000004s : 19: predicate.depend_value_elim 1.15% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.20% : 0.000003s : 19: predicate.dict_get_item_eliminator 1.33% : 0.000003s : 19: predicate.dict_set_item_eliminator 0.47% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.14% : 0.000000s : 1: predicate.elim_not_effective 0.28% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.38% : 0.000003s : 19: predicate.environ_get_add_eliminate 1.53% : 0.000003s : 19: predicate.environ_get_depend_swap 1.40% : 0.000003s : 19: predicate.environ_get_eliminate 1.14% : 0.000002s : 19: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.32% : 0.000003s : 12: predicate.get_grad_eliminate 0.15% : 0.000000s : 1: predicate.graph_param_transform 4.88% : 0.000010s : 30: predicate.inline 3.30% : 0.000007s : 40: predicate.inline_without_move 0.43% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.33% : 0.000003s : 12: predicate.less_batch_normalization 1.71% : 0.000004s : 21: predicate.list_to_tuple_eliminator_ 1.74% : 0.000004s : 22: predicate.load_eliminater 0.75% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.79% : 0.000008s : 48: predicate.loop_unroll_before_grad 1.41% : 0.000003s : 20: predicate.make_slice_get_slice_eliminator 1.28% : 0.000003s : 19: predicate.merge_addn 1.28% : 0.000003s : 19: predicate.minmaximum_grad 0.96% : 0.000002s : 1: predicate.mutable_eliminate 0.26% : 0.000001s : 1: predicate.opt_reshape 1.77% : 0.000004s : 22: predicate.partial_eliminate 1.33% : 0.000003s : 19: predicate.print_const_string_wrapper 2.04% : 0.000004s : 19: predicate.reduce_eliminate 1.56% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 12: predicate.remove_not_recompute_node 1.42% : 0.000003s : 23: predicate.replace_applicator 1.78% : 0.000004s : 40: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.27% : 0.000003s : 19: predicate.reshape_eliminate 1.46% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.41% : 0.000001s : 1: predicate.row_tensor_eliminate 1.25% : 0.000003s : 19: predicate.same_eliminate 0.56% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.36% : 0.000001s : 2: predicate.special_op_eliminate 0.99% : 0.000002s : 12: predicate.specialize_transform 1.87% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.17% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.93% : 0.000006s : 28: predicate.switch_defer_inline 2.29% : 0.000005s : 28: predicate.switch_layer_defer_inline 7.02% : 0.000015s : 77: predicate.switch_simplify 1.38% : 0.000003s : 19: predicate.tile_eliminate 1.51% : 0.000003s : 19: predicate.transpose_eliminate 1.53% : 0.000003s : 19: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.32% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.81% : 0.000004s : 19: predicate.tuple_list_set_item_eliminator 1.68% : 0.000004s : 21: predicate.tuple_to_list_eliminator_ 1.57% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.76% : 0.000006s : 34: predicate.updatestate_useless_node_eliminater 2.35% : 0.000005s : 19: predicate.value_based_eliminate 0.32% : 0.000001s : 1: predicate.virtual_view_grad_eliminate 0.31% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002405 29 75.74% : 0.001822s : 19: func_graph_cloner_run.FuncGraphClonerGraph 24.26% : 0.000583s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062276 72 0.07% : 0.000044s : 1: add_recomputation 0.18% : 0.000111s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.53% : 0.000329s : 1: bootstrap 0.06% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.08% : 0.000047s : 1: environ_conv 0.13% : 0.000079s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 37.34% : 0.023255s : 1: jit_opt_a 0.23% : 0.000146s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.77% : 0.000478s : 1: loop_unroll 1.39% : 0.000867s : 1: mutable_eliminate 2.72% : 0.001691s : 26: opt.transform.jit_opt_a 0.06% : 0.000037s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000018s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000027s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000541s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000039s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 21.17% : 0.013186s : 1: renormalize.infer 1.38% : 0.000857s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000047s : 1: rewriter_after_opt_a 0.20% : 0.000127s : 1: rewriter_before_opt_a 0.13% : 0.000078s : 1: symbol_engine_optimizer 32.12% : 0.020002s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:21.904.262 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dc10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:21.904.916 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0341212, [30] [bootstrap]: 0.00041056 [type_inference]: 0.00698376 [event_method]: 2.182e-05 [auto_monad]: 0.00011484 [graph_reusing]: 5.96998e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 6.792e-05 [rewriter_before_opt_a]: 8.378e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00706543, [2] [Cycle 1]: 0.00241999, [27] [switch_simplify]: 6.679e-05 [loop_unroll]: 3.034e-05 [a_1]: 0.00063751 [with_stream_mark]: 2.337e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00129543 [add_forward_monad_depend]: 6.66e-06 [auto_monad_grad]: 2.73003e-06 [auto_monad_eliminator]: 1.679e-05 [cse]: 3.841e-05 [replace_applicator]: 1.568e-05 [Cycle 2]: 0.00033188, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.484e-05 [with_stream_mark]: 1.033e-05 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.344e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 1.412e-05 [rewriter_after_opt_a]: 4.124e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.0168702 [jit_opt_b]: 7.741e-05, [1] [Cycle 1]: 6.271e-05, [2] [frontend_op_eliminate]: 2.577e-05 [inline_after_opt_a]: 2.307e-05 [cconv]: 4.503e-05 [loop_unroll]: 0.00091661 [jit_opt_after_cconv]: 0.00028774, [1] [Cycle 1]: 0.00027894, [11] [c_1]: 2.54e-05 [parameter_eliminate]: 7.26999e-06 [updatestate_depend_eliminate]: 9.79999e-06 [updatestate_assign_eliminate]: 4.12e-06 [updatestate_loads_eliminate]: 3.98999e-06 [cse]: 5.204e-05 [call_graph_tuple_transform]: 3.151e-05 [tuple_list_get_item_eliminator]: 6.35002e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 7.76001e-06 [remove_dup_value]: 1.92e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 1.355e-05 [add_recomputation]: 6.077e-05 [cse_after_recomputation]: 2.678e-05, [1] [Cycle 1]: 2.018e-05, [1] [cse]: 1.373e-05 [auto_monad_reorder]: 1.97e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 1.162e-05 [opt_after_jit_grad]: 0.00055147 [symbol_engine_optimizer]: 0.00010462, [1] [Cycle 1]: 9.718e-05, [6] [build]: 1.604e-05 [elim_shapecalc]: 1.062e-05 [elim_not_effective]: 1.638e-05 [opt_reshape]: 8.47e-06 [fold_const_symbol]: 1.15e-05 [renormalize]: 3.19997e-07 [validate]: 5.864e-05 Sums bootstrap : 0.000411s : 1.41% type_inference : 0.006984s : 24.03% event_method : 0.000022s : 0.08% auto_monad : 0.000115s : 0.40% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000068s : 0.23% rewriter_before_opt_a : 0.000084s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000732s : 2.52% jit_opt_a.with_stream_mark : 0.000034s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001296s : 4.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000041s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.016870s : 58.05% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.09% jit_opt_b.inline_after_opt_a : 0.000023s : 0.08% cconv : 0.000045s : 0.15% loop_unroll : 0.000917s : 3.15% jit_opt_after_cconv.c_1 : 0.000025s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000052s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000014s : 0.05% add_recomputation : 0.000061s : 0.21% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.04% opt_after_jit_grad : 0.000551s : 1.90% symbol_engine_optimizer.build : 0.000016s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.20% Time group info: ------[substitution.] 0.000286 23 1.13% : 0.000003s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.70% : 0.000008s : 3: substitution.graph_param_transform 85.68% : 0.000245s : 4: substitution.inline 1.62% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000005s : 2: substitution.replace_old_param 4.55% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006894 2 79.66% : 0.005492s : 1: type_inference.infer 20.34% : 0.001402s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.89% : 0.000059s : 4: replace.inline 31.11% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 6 95.27% : 0.000242s : 4: match.inline 4.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 691 1.16% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000003s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.65% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.03% : 0.000001s : 10: predicate.depend_value_elim 0.93% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.98% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 1.03% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.00% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.13% : 0.000007s : 22: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.26% : 0.000003s : 15: predicate.load_eliminater 2.15% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 0.94% : 0.000001s : 10: predicate.minmaximum_grad 4.01% : 0.000005s : 3: predicate.mutable_eliminate 0.81% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000002s : 10: predicate.print_const_string_wrapper 1.94% : 0.000003s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 1.03% : 0.000001s : 3: predicate.reset_defer_inline 1.13% : 0.000002s : 10: predicate.reshape_eliminate 1.14% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.42% : 0.000002s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.95% : 0.000003s : 16: predicate.switch_defer_inline 1.67% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.37% : 0.000010s : 53: predicate.switch_simplify 1.03% : 0.000001s : 10: predicate.tile_eliminate 1.06% : 0.000001s : 10: predicate.transpose_eliminate 2.19% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.98% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000976 13 50.36% : 0.000492s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.64% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.00% : 0.000430s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036480 72 0.17% : 0.000064s : 1: add_recomputation 0.33% : 0.000119s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.19% : 0.000434s : 1: bootstrap 0.13% : 0.000047s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000016s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.38% : 0.007070s : 1: jit_opt_a 0.80% : 0.000292s : 1: jit_opt_after_cconv 0.22% : 0.000082s : 1: jit_opt_b 2.54% : 0.000927s : 1: loop_unroll 46.31% : 0.016896s : 1: mutable_eliminate 2.65% : 0.000967s : 26: opt.transform.jit_opt_a 0.19% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000040s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000041s : 1: opt.transform.mutable_eliminate 0.07% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000560s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000071s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000022s : 1: remove_dup_value 2.17% : 0.000793s : 1: renormalize.infer 1.35% : 0.000494s : 1: renormalize.specialize 0.04% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000044s : 1: rewriter_after_opt_a 0.24% : 0.000086s : 1: rewriter_before_opt_a 0.29% : 0.000107s : 1: symbol_engine_optimizer 19.19% : 0.007002s : 1: type_inference TotalTime = 0.118553, [30] [bootstrap]: 0.00030945 [type_inference]: 0.108205 [event_method]: 2.401e-05 [auto_monad]: 7.294e-05 [graph_reusing]: 6.77002e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00044061 [rewriter_before_opt_a]: 0.00010369 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00729047, [2] [Cycle 1]: 0.0035365, [27] [switch_simplify]: 5.836e-05 [loop_unroll]: 3.428e-05 [a_1]: 0.00066248 [with_stream_mark]: 1.876e-05 [recompute_prepare]: 8.44002e-06 [updatestate_depend_eliminate]: 4.39998e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.27001e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 6.36998e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.86999e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 6.28e-06 [renormalize]: 0.00241589 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.651e-05 [cse]: 3.738e-05 [replace_applicator]: 1.391e-05 [Cycle 2]: 0.00036462, [27] [switch_simplify]: 7.11999e-06 [loop_unroll]: 6.32001e-06 [a_1]: 0.00011922 [with_stream_mark]: 9.31e-06 [recompute_prepare]: 6.19999e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 8.74003e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.88002e-06 [cse]: 1.407e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.235e-05 [rewriter_after_opt_a]: 3.728e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00049371 [jit_opt_b]: 5.574e-05, [1] [Cycle 1]: 4.822e-05, [2] [frontend_op_eliminate]: 1.953e-05 [inline_after_opt_a]: 1.773e-05 [cconv]: 2.471e-05 [loop_unroll]: 0.00041361 [jit_opt_after_cconv]: 0.00015225, [1] [Cycle 1]: 0.00014556, [11] [c_1]: 2.533e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 6.39001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.192e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.35002e-06 [remove_dup_value]: 1.809e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 8.38001e-06 [add_recomputation]: 4.823e-05 [cse_after_recomputation]: 2.398e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.309e-05 [auto_monad_reorder]: 1.745e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.00045096 [symbol_engine_optimizer]: 7.556e-05, [1] [Cycle 1]: 6.899e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 9.18002e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.89999e-06 [fold_const_symbol]: 9.09998e-06 [renormalize]: 3.19997e-07 [validate]: 4.322e-05 Sums bootstrap : 0.000309s : 0.27% type_inference : 0.108205s : 94.45% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000441s : 0.38% rewriter_before_opt_a : 0.000104s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000782s : 0.68% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002416s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000494s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000414s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000451s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000242 25 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 4: substitution.graph_param_transform 86.62% : 0.000210s : 5: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108126 2 97.33% : 0.105240s : 1: type_inference.infer 2.67% : 0.002887s : 1: type_inference.specialize ------[replace.] 0.000098 7 68.68% : 0.000067s : 5: replace.inline 31.32% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.09% : 0.000207s : 5: match.inline 4.91% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 886 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 1.75% : 0.000002s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.93% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.21% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.52% : 0.000002s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.49% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.62% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002289 25 63.22% : 0.001447s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.77% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.01% : 0.000778s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122042 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000332s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.98% : 0.007293s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.34% : 0.000421s : 1: loop_unroll 0.41% : 0.000502s : 1: mutable_eliminate 0.84% : 0.001021s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000448s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.36% : 0.001659s : 1: renormalize.infer 0.61% : 0.000747s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000108s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.68% : 0.108223s : 1: type_inference TotalTime = 0.271877, [30] [bootstrap]: 0.00048047 [type_inference]: 0.225282 [event_method]: 2.517e-05 [auto_monad]: 8.421e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00048182 [rewriter_before_opt_a]: 9.799e-05 [expand_dump_flag]: 3.73999e-06 [jit_opt_a]: 0.0424159, [2] [Cycle 1]: 0.037249, [27] [switch_simplify]: 7.711e-05 [loop_unroll]: 3.153e-05 [a_1]: 0.0274745 [with_stream_mark]: 2.857e-05 [recompute_prepare]: 1.366e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.68e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 8.15e-06 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 8.80001e-06 [meta_shard_fg_expand]: 4.10998e-06 [get_grad_eliminate_]: 7.64002e-06 [merge_forward]: 4.58001e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 3.45003e-06 [replace_old_param]: 1.159e-05 [inline_without_move]: 7.13998e-06 [renormalize]: 0.00912678 [add_forward_monad_depend]: 1.475e-05 [auto_monad_grad]: 3.73001e-06 [auto_monad_eliminator]: 3.028e-05 [cse]: 4.106e-05 [replace_applicator]: 3.028e-05 [Cycle 2]: 0.0004574, [27] [switch_simplify]: 9.00999e-06 [loop_unroll]: 7.98001e-06 [a_1]: 0.00016268 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 6.49001e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.25002e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 6.63998e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 8.13999e-06 [meta_shard_fg_expand]: 2.84999e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 3.78999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.089e-05 [j_node_and_user_rematch]: 1.181e-05 [meta_fg_expand]: 3.07002e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.79998e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.25002e-06 [cse]: 1.471e-05 [replace_applicator]: 6.24001e-06 [py_interpret_to_execute_after_opt_a]: 2.341e-05 [rewriter_after_opt_a]: 4.519e-05 [convert_after_rewriter]: 8.56002e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00104427 [jit_opt_b]: 6.241e-05, [1] [Cycle 1]: 5.337e-05, [2] [frontend_op_eliminate]: 2.04e-05 [inline_after_opt_a]: 2.034e-05 [cconv]: 3.162e-05 [loop_unroll]: 0.00048852 [jit_opt_after_cconv]: 0.00018004, [1] [Cycle 1]: 0.00017155, [11] [c_1]: 2.713e-05 [parameter_eliminate]: 4.15e-06 [updatestate_depend_eliminate]: 8.72998e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.822e-05 [call_graph_tuple_transform]: 2.398e-05 [tuple_list_get_item_eliminator]: 6.99001e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 1.30001e-06 [switch_simplify]: 7.53e-06 [remove_dup_value]: 1.835e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 1.118e-05 [add_recomputation]: 5.784e-05 [cse_after_recomputation]: 2.516e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.27e-05 [auto_monad_reorder]: 1.697e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 7.85998e-06 [opt_after_jit_grad]: 0.00054702 [symbol_engine_optimizer]: 8.34e-05, [1] [Cycle 1]: 7.621e-05, [6] [build]: 5.09003e-06 [elim_shapecalc]: 9.18002e-06 [elim_not_effective]: 1.563e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.07e-05 [renormalize]: 5.60016e-07 [validate]: 6.107e-05 Sums bootstrap : 0.000480s : 0.18% type_inference : 0.225282s : 84.58% event_method : 0.000025s : 0.01% auto_monad : 0.000084s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000482s : 0.18% rewriter_before_opt_a : 0.000098s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.027637s : 10.38% jit_opt_a.with_stream_mark : 0.000046s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.009127s : 3.43% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000023s : 0.01% rewriter_after_opt_a : 0.000045s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001044s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000489s : 0.18% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000547s : 0.21% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.02% Time group info: ------[substitution.] 0.000421 24 0.47% : 0.000002s : 2: substitution.elim_not_effective 0.28% : 0.000001s : 2: substitution.fold_const_symbol 1.71% : 0.000007s : 4: substitution.graph_param_transform 88.19% : 0.000371s : 4: substitution.inline 1.39% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000007s : 4: substitution.remove_not_recompute_node 1.82% : 0.000008s : 2: substitution.replace_old_param 4.47% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.225150 2 98.38% : 0.221502s : 1: type_inference.infer 1.62% : 0.003648s : 1: type_inference.specialize ------[replace.] 0.000129 6 75.55% : 0.000097s : 4: replace.inline 24.45% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000385 6 95.45% : 0.000367s : 4: match.inline 4.55% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000213 830 1.50% : 0.000003s : 12: predicate.accumulaten_eliminater 0.91% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.86% : 0.000002s : 12: predicate.addn_check_dump 1.87% : 0.000004s : 12: predicate.addn_zero_filter 2.76% : 0.000006s : 12: predicate.arithmetic_simplify 1.84% : 0.000004s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.31% : 0.000003s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000003s : 12: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.82% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_depend_swap 1.26% : 0.000003s : 12: predicate.environ_get_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 4.96% : 0.000011s : 26: predicate.inline 0.59% : 0.000001s : 8: predicate.inline_without_move 0.28% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000003s : 8: predicate.less_batch_normalization 1.72% : 0.000004s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000004s : 18: predicate.load_eliminater 0.94% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.73% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.70% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000002s : 12: predicate.minmaximum_grad 1.47% : 0.000003s : 4: predicate.mutable_eliminate 0.31% : 0.000001s : 4: predicate.opt_reshape 1.70% : 0.000004s : 18: predicate.partial_eliminate 1.37% : 0.000003s : 12: predicate.print_const_string_wrapper 2.56% : 0.000005s : 12: predicate.reduce_eliminate 1.54% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.35% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.26% : 0.000001s : 4: predicate.reset_defer_inline 1.60% : 0.000003s : 12: predicate.reshape_eliminate 1.54% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000002s : 4: predicate.row_tensor_eliminate 5.80% : 0.000012s : 12: predicate.same_eliminate 0.40% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.76% : 0.000002s : 8: predicate.special_op_eliminate 0.63% : 0.000001s : 8: predicate.specialize_transform 2.05% : 0.000004s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 4.63% : 0.000010s : 18: predicate.switch_defer_inline 2.03% : 0.000004s : 18: predicate.switch_layer_defer_inline 4.91% : 0.000010s : 58: predicate.switch_simplify 1.65% : 0.000004s : 12: predicate.tile_eliminate 1.43% : 0.000003s : 12: predicate.transpose_eliminate 1.42% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 3.05% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 2.00% : 0.000004s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.87% : 0.000004s : 18: predicate.updatestate_pure_node_eliminater 2.28% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000004s : 12: predicate.value_based_eliminate 0.24% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003702 26 58.60% : 0.002169s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000072s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.46% : 0.001461s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.308980 72 0.02% : 0.000061s : 1: add_recomputation 0.03% : 0.000088s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.16% : 0.000509s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 13.73% : 0.042422s : 1: jit_opt_a 0.06% : 0.000183s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.16% : 0.000497s : 1: loop_unroll 0.34% : 0.001056s : 1: mutable_eliminate 9.04% : 0.027937s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000557s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 2.41% : 0.007461s : 1: renormalize.infer 0.53% : 0.001642s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000049s : 1: rewriter_after_opt_a 0.03% : 0.000103s : 1: rewriter_before_opt_a 0.04% : 0.000132s : 1: symbol_engine_optimizer 72.92% : 0.225308s : 1: type_inference TotalTime = 0.0489218, [30] [bootstrap]: 0.00030352 [type_inference]: 0.0416935 [event_method]: 1.842e-05 [auto_monad]: 5.958e-05 [graph_reusing]: 4.58999e-06 [pre_auto_parallel]: 1.92001e-06 [py_interpret_to_execute]: 9.345e-05 [rewriter_before_opt_a]: 7.443e-05 [expand_dump_flag]: 2.98998e-06 [jit_opt_a]: 0.00475106, [2] [Cycle 1]: 0.00163762, [27] [switch_simplify]: 4.445e-05 [loop_unroll]: 2.892e-05 [a_1]: 0.0004742 [with_stream_mark]: 1.238e-05 [recompute_prepare]: 7.24001e-06 [updatestate_depend_eliminate]: 3.08998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.991e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 8.33001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 0.0007378 [add_forward_monad_depend]: 5.15001e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 1.219e-05 [cse]: 1.992e-05 [replace_applicator]: 1.093e-05 [Cycle 2]: 0.00030863, [27] [switch_simplify]: 5.51002e-06 [loop_unroll]: 4.87e-06 [a_1]: 8.746e-05 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 2.55002e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.194e-05 [j_node_and_user_rematch]: 7.63999e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.51001e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.40001e-06 [cse]: 1.261e-05 [replace_applicator]: 5.13002e-06 [py_interpret_to_execute_after_opt_a]: 8.60999e-06 [rewriter_after_opt_a]: 2.895e-05 [convert_after_rewriter]: 5.66998e-06 [order_py_execute_after_rewriter]: 4.55001e-06 [mutable_eliminate]: 0.00048225 [jit_opt_b]: 4.725e-05, [1] [Cycle 1]: 4.119e-05, [2] [frontend_op_eliminate]: 1.511e-05 [inline_after_opt_a]: 1.519e-05 [cconv]: 1.875e-05 [loop_unroll]: 0.00039404 [jit_opt_after_cconv]: 0.00013443, [1] [Cycle 1]: 0.00012829, [11] [c_1]: 1.975e-05 [parameter_eliminate]: 2.06e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 1.914e-05 [call_graph_tuple_transform]: 1.72e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.17999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.32999e-06 [remove_dup_value]: 1.216e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 4.61002e-06 [add_recomputation]: 3.435e-05 [cse_after_recomputation]: 2.232e-05, [1] [Cycle 1]: 1.713e-05, [1] [cse]: 1.161e-05 [auto_monad_reorder]: 1.259e-05 [get_jit_bprop_graph]: 1.62001e-06 [rewriter_after_jit_bprop_graph]: 4.03999e-06 [opt_after_jit_grad]: 0.00043258 [symbol_engine_optimizer]: 7.888e-05, [1] [Cycle 1]: 7.289e-05, [6] [build]: 2.46e-06 [elim_shapecalc]: 1.707e-05 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 3.80009e-07 [validate]: 2.917e-05 Sums bootstrap : 0.000304s : 0.67% type_inference : 0.041693s : 91.51% event_method : 0.000018s : 0.04% auto_monad : 0.000060s : 0.13% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000093s : 0.21% rewriter_before_opt_a : 0.000074s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000050s : 0.11% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000562s : 1.23% jit_opt_a.with_stream_mark : 0.000021s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000052s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000738s : 1.62% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.04% jit_opt_a.cse : 0.000033s : 0.07% jit_opt_a.replace_applicator : 0.000016s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000029s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000482s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000019s : 0.04% loop_unroll : 0.000394s : 0.86% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000012s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000034s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000433s : 0.95% symbol_engine_optimizer.build : 0.000002s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000017s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.06% Time group info: ------[substitution.] 0.000163 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000004s : 3: substitution.graph_param_transform 82.63% : 0.000135s : 4: substitution.inline 2.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000003s : 2: substitution.replace_old_param 6.39% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041635 2 96.81% : 0.040309s : 1: type_inference.infer 3.19% : 0.001327s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.05% : 0.000043s : 4: replace.inline 32.95% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 93.42% : 0.000132s : 4: match.inline 6.58% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000108 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000001s : 10: predicate.depend_value_elim 1.23% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.28% : 0.000006s : 22: predicate.inline 1.07% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.96% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000002s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.42% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000008s : 53: predicate.switch_simplify 1.34% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000738 13 48.96% : 0.000361s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.91% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.13% : 0.000348s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050522 72 0.07% : 0.000037s : 1: add_recomputation 0.12% : 0.000063s : 1: auto_monad 0.03% : 0.000015s : 1: auto_monad_reorder 0.63% : 0.000320s : 1: bootstrap 0.04% : 0.000021s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.41% : 0.004753s : 1: jit_opt_a 0.27% : 0.000137s : 1: jit_opt_after_cconv 0.10% : 0.000050s : 1: jit_opt_b 0.80% : 0.000402s : 1: loop_unroll 0.97% : 0.000492s : 1: mutable_eliminate 1.56% : 0.000789s : 26: opt.transform.jit_opt_a 0.09% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000441s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000097s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000014s : 1: remove_dup_value 0.78% : 0.000395s : 1: renormalize.infer 0.66% : 0.000336s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000032s : 1: rewriter_after_opt_a 0.15% : 0.000078s : 1: rewriter_before_opt_a 0.16% : 0.000081s : 1: symbol_engine_optimizer 82.55% : 0.041705s : 1: type_inference TotalTime = 0.165656, [30] [bootstrap]: 0.00029252 [type_inference]: 0.137361 [event_method]: 0.00060095 [auto_monad]: 0.00012293 [graph_reusing]: 7.16999e-06 [pre_auto_parallel]: 3.38e-06 [py_interpret_to_execute]: 0.00010441 [rewriter_before_opt_a]: 0.00014116 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.0244408, [2] [Cycle 1]: 0.0195675, [27] [switch_simplify]: 8.519e-05 [loop_unroll]: 4.424e-05 [a_1]: 0.00113186 [with_stream_mark]: 3.85e-05 [recompute_prepare]: 2.238e-05 [updatestate_depend_eliminate]: 1.012e-05 [updatestate_assign_eliminate]: 6.93998e-06 [updatestate_loads_eliminate]: 7.51999e-06 [parameter_eliminate]: 3.41001e-06 [specialize_transform]: 1.599e-05 [updatestate_useless_node_eliminater]: 1.375e-05 [accelerated_algorithm]: 1.451e-05 [meta_shard_fg_expand]: 5.07e-06 [get_grad_eliminate_]: 1.457e-05 [merge_forward]: 9.71e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.938e-05 [j_node_and_user_rematch]: 2.545e-05 [meta_fg_expand]: 0.0023431 [replace_old_param]: 8.097e-05 [inline_without_move]: 6.67e-05 [renormalize]: 0.0152255 [add_forward_monad_depend]: 9.65002e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.597e-05 [cse]: 3.189e-05 [replace_applicator]: 3.038e-05 [Cycle 2]: 0.00054792, [27] [switch_simplify]: 6.34001e-06 [loop_unroll]: 6.00002e-06 [a_1]: 8.347e-05 [with_stream_mark]: 1.675e-05 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.43002e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 3.87998e-06 [updatestate_useless_node_eliminater]: 3.33e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.86e-06 [get_grad_eliminate_]: 4.2e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 4.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.85e-05 [j_node_and_user_rematch]: 7.63999e-06 [meta_fg_expand]: 0.00019193 [replace_old_param]: 6.94001e-06 [inline_without_move]: 4.00998e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.39001e-06 [auto_monad_grad]: 1.11002e-06 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.297e-05 [replace_applicator]: 3.99002e-06 [py_interpret_to_execute_after_opt_a]: 1.458e-05 [rewriter_after_opt_a]: 4.049e-05 [convert_after_rewriter]: 6.40002e-06 [order_py_execute_after_rewriter]: 4.42e-06 [mutable_eliminate]: 0.00084804 [jit_opt_b]: 6.447e-05, [1] [Cycle 1]: 5.55e-05, [2] [frontend_op_eliminate]: 2.734e-05 [inline_after_opt_a]: 1.337e-05 [cconv]: 3.274e-05 [loop_unroll]: 0.00049349 [jit_opt_after_cconv]: 0.00014987, [1] [Cycle 1]: 0.00014275, [11] [c_1]: 1.52e-05 [parameter_eliminate]: 3.52002e-06 [updatestate_depend_eliminate]: 6.79999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 1.79998e-06 [cse]: 2.518e-05 [call_graph_tuple_transform]: 1.886e-05 [tuple_list_get_item_eliminator]: 4.45999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 4.53999e-06 [remove_dup_value]: 1.745e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.86e-06 [add_recomputation]: 3.999e-05 [cse_after_recomputation]: 2.168e-05, [1] [Cycle 1]: 1.572e-05, [1] [cse]: 8.73001e-06 [auto_monad_reorder]: 1.386e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.59999e-06 [opt_after_jit_grad]: 0.00047136 [symbol_engine_optimizer]: 7.449e-05, [1] [Cycle 1]: 6.8e-05, [6] [build]: 4.97e-06 [elim_shapecalc]: 6.86999e-06 [elim_not_effective]: 1.157e-05 [opt_reshape]: 5.25999e-06 [fold_const_symbol]: 7.68001e-06 [renormalize]: 4.90021e-07 [validate]: 4.166e-05 Sums bootstrap : 0.000293s : 0.18% type_inference : 0.137361s : 85.56% event_method : 0.000601s : 0.37% auto_monad : 0.000123s : 0.08% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000104s : 0.07% rewriter_before_opt_a : 0.000141s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.06% jit_opt_a.loop_unroll : 0.000050s : 0.03% jit_opt_a.a_1 : 0.001215s : 0.76% jit_opt_a.with_stream_mark : 0.000055s : 0.03% jit_opt_a.recompute_prepare : 0.000027s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000010s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000020s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000017s : 0.01% jit_opt_a.accelerated_algorithm : 0.000020s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000019s : 0.01% jit_opt_a.merge_forward : 0.000014s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000033s : 0.02% jit_opt_a.meta_fg_expand : 0.002535s : 1.58% jit_opt_a.replace_old_param : 0.000088s : 0.05% jit_opt_a.inline_without_move : 0.000071s : 0.04% jit_opt_a.renormalize : 0.015226s : 9.48% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000848s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000493s : 0.31% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000040s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000471s : 0.29% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000383 56 0.49% : 0.000002s : 1: substitution.elim_not_effective 0.43% : 0.000002s : 1: substitution.fold_const_symbol 1.42% : 0.000005s : 1: substitution.graph_param_transform 70.83% : 0.000271s : 7: substitution.inline 5.85% : 0.000022s : 2: substitution.inline_without_move 2.08% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.05% : 0.000004s : 2: substitution.minmaximum_grad 1.16% : 0.000004s : 3: substitution.partial_eliminate 2.32% : 0.000009s : 9: substitution.remove_not_recompute_node 1.96% : 0.000008s : 2: substitution.replace_applicator 3.33% : 0.000013s : 10: substitution.replace_old_param 0.75% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.08% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.51% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 4.75% : 0.000018s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.137231 2 96.92% : 0.133002s : 1: type_inference.infer 3.08% : 0.004230s : 1: type_inference.specialize ------[replace.] 0.000096 9 79.54% : 0.000077s : 7: replace.inline 20.46% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 9 95.46% : 0.000267s : 7: match.inline 4.54% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000220 1234 1.28% : 0.000003s : 20: predicate.accumulaten_eliminater 0.44% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.22% : 0.000003s : 20: predicate.addn_check_dump 1.42% : 0.000003s : 20: predicate.addn_zero_filter 1.88% : 0.000004s : 20: predicate.arithmetic_simplify 1.42% : 0.000003s : 20: predicate.cast_eliminate 0.21% : 0.000000s : 1: predicate.check_bprop_eliminate 1.06% : 0.000002s : 20: predicate.compare_switch_simplify 1.16% : 0.000003s : 20: predicate.depend_value_elim 1.10% : 0.000002s : 20: predicate.dict_get_item_const_eliminator 1.32% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.21% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 1: predicate.elim_not_effective 0.21% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 20: predicate.environ_get_add_eliminate 1.21% : 0.000003s : 20: predicate.environ_get_depend_swap 1.40% : 0.000003s : 20: predicate.environ_get_eliminate 1.40% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.06% : 0.000000s : 1: predicate.fold_const_symbol 1.16% : 0.000003s : 13: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.34% : 0.000010s : 31: predicate.inline 3.07% : 0.000007s : 41: predicate.inline_without_move 0.43% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.60% : 0.000004s : 13: predicate.less_batch_normalization 1.47% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.73% : 0.000004s : 23: predicate.load_eliminater 0.59% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000008s : 49: predicate.loop_unroll_before_grad 1.59% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 20: predicate.merge_addn 1.28% : 0.000003s : 20: predicate.minmaximum_grad 0.85% : 0.000002s : 1: predicate.mutable_eliminate 0.33% : 0.000001s : 1: predicate.opt_reshape 1.84% : 0.000004s : 23: predicate.partial_eliminate 1.53% : 0.000003s : 20: predicate.print_const_string_wrapper 1.89% : 0.000004s : 20: predicate.reduce_eliminate 1.34% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000002s : 13: predicate.remove_not_recompute_node 1.61% : 0.000004s : 24: predicate.replace_applicator 1.77% : 0.000004s : 41: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.49% : 0.000003s : 20: predicate.reshape_eliminate 1.44% : 0.000003s : 20: predicate.row_tensor_add_zeros_like 6.32% : 0.000014s : 1: predicate.row_tensor_eliminate 1.31% : 0.000003s : 20: predicate.same_eliminate 0.53% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.40% : 0.000001s : 2: predicate.special_op_eliminate 1.05% : 0.000002s : 13: predicate.specialize_transform 1.52% : 0.000003s : 20: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000003s : 20: predicate.stack_unstack_eliminate 0.19% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.23% : 0.000005s : 29: predicate.switch_defer_inline 1.97% : 0.000004s : 29: predicate.switch_layer_defer_inline 6.15% : 0.000014s : 79: predicate.switch_simplify 1.43% : 0.000003s : 20: predicate.tile_eliminate 1.41% : 0.000003s : 20: predicate.transpose_eliminate 1.81% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000004s : 20: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000008s : 24: predicate.tuple_list_get_item_eliminator 1.62% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.46% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.44% : 0.000003s : 23: predicate.updatestate_pure_node_eliminater 2.46% : 0.000005s : 36: predicate.updatestate_useless_node_eliminater 1.53% : 0.000003s : 20: predicate.value_based_eliminate 0.12% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.36% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007884 38 93.89% : 0.007403s : 28: func_graph_cloner_run.FuncGraphClonerGraph 6.11% : 0.000482s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.182592 72 0.02% : 0.000043s : 1: add_recomputation 0.07% : 0.000130s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.18% : 0.000321s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.33% : 0.000611s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 13.39% : 0.024446s : 1: jit_opt_a 0.08% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.27% : 0.000502s : 1: loop_unroll 0.47% : 0.000860s : 1: mutable_eliminate 0.93% : 0.001694s : 26: opt.transform.jit_opt_a 0.02% : 0.000039s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000027s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000479s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000108s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 7.90% : 0.014425s : 1: renormalize.infer 0.43% : 0.000786s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000145s : 1: rewriter_before_opt_a 0.04% : 0.000077s : 1: symbol_engine_optimizer 75.24% : 0.137386s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.102.982 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00650d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.103.700 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0630652, [30] [bootstrap]: 0.00049828 [type_inference]: 0.0311608 [event_method]: 2.32e-05 [auto_monad]: 7.709e-05 [graph_reusing]: 6.42001e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 6.808e-05 [rewriter_before_opt_a]: 7.954e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0284108, [2] [Cycle 1]: 0.0233281, [27] [switch_simplify]: 6.354e-05 [loop_unroll]: 3.371e-05 [a_1]: 0.00062912 [with_stream_mark]: 2.457e-05 [recompute_prepare]: 7.53999e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 9.31998e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.025e-05 [inline_without_move]: 5.56e-06 [renormalize]: 0.0221456 [add_forward_monad_depend]: 1.188e-05 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 2.314e-05 [cse]: 3.888e-05 [replace_applicator]: 3.289e-05 [Cycle 2]: 0.00042531, [27] [switch_simplify]: 9.27001e-06 [loop_unroll]: 7.11999e-06 [a_1]: 0.00014163 [with_stream_mark]: 1.752e-05 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.60998e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 8e-06 [meta_shard_fg_expand]: 3.56001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 3.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.95e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 3.48e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.94e-06 [renormalize]: 1.20024e-07 [add_forward_monad_depend]: 1.61998e-06 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 6.31998e-06 [cse]: 1.282e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.921e-05 [rewriter_after_opt_a]: 4.137e-05 [convert_after_rewriter]: 8.54e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00098851 [jit_opt_b]: 5.527e-05, [1] [Cycle 1]: 4.687e-05, [2] [frontend_op_eliminate]: 1.895e-05 [inline_after_opt_a]: 1.599e-05 [cconv]: 2.714e-05 [loop_unroll]: 0.00044819 [jit_opt_after_cconv]: 0.00015367, [1] [Cycle 1]: 0.00014643, [11] [c_1]: 2.313e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 6.05002e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 1.97999e-06 [cse]: 2.378e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 6.61e-06 [remove_dup_value]: 1.536e-05 [partial_unused_args_eliminate]: 2.08002e-06 [environ_conv]: 5.62999e-06 [add_recomputation]: 5.615e-05 [cse_after_recomputation]: 4.451e-05, [1] [Cycle 1]: 3.879e-05, [1] [cse]: 3.224e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 7.16999e-06 [opt_after_jit_grad]: 0.00050334 [symbol_engine_optimizer]: 7.968e-05, [1] [Cycle 1]: 7.263e-05, [6] [build]: 4.19002e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 9.41998e-06 [renormalize]: 4.40021e-07 [validate]: 4.162e-05 Sums bootstrap : 0.000498s : 0.86% type_inference : 0.031161s : 53.98% event_method : 0.000023s : 0.04% auto_monad : 0.000077s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000068s : 0.12% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.13% jit_opt_a.loop_unroll : 0.000041s : 0.07% jit_opt_a.a_1 : 0.000771s : 1.34% jit_opt_a.with_stream_mark : 0.000042s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.022146s : 38.36% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.05% jit_opt_a.cse : 0.000052s : 0.09% jit_opt_a.replace_applicator : 0.000039s : 0.07% py_interpret_to_execute_after_opt_a : 0.000019s : 0.03% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000989s : 1.71% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000448s : 0.78% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.10% cse_after_recomputation.cse : 0.000032s : 0.06% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000503s : 0.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000274 23 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 84.92% : 0.000233s : 4: substitution.inline 1.68% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000006s : 4: substitution.remove_not_recompute_node 2.40% : 0.000007s : 2: substitution.replace_old_param 5.02% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031058 2 95.50% : 0.029662s : 1: type_inference.infer 4.50% : 0.001397s : 1: type_inference.specialize ------[replace.] 0.000084 6 67.47% : 0.000057s : 4: replace.inline 32.53% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 94.82% : 0.000230s : 4: match.inline 5.18% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 0.83% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.87% : 0.000001s : 10: predicate.addn_check_dump 1.60% : 0.000002s : 10: predicate.addn_zero_filter 2.46% : 0.000004s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000002s : 10: predicate.compare_switch_simplify 0.94% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.60% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.79% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000001s : 3: predicate.graph_param_transform 5.08% : 0.000008s : 22: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.91% : 0.000003s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.46% : 0.000002s : 15: predicate.load_eliminater 1.16% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000002s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000002s : 10: predicate.print_const_string_wrapper 2.42% : 0.000004s : 10: predicate.reduce_eliminate 1.95% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.95% : 0.000003s : 10: predicate.reshape_eliminate 1.58% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 10: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.78% : 0.000001s : 6: predicate.specialize_transform 1.88% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.63% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.81% : 0.000003s : 16: predicate.switch_defer_inline 1.77% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.73% : 0.000010s : 53: predicate.switch_simplify 1.61% : 0.000002s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.29% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.51% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001214 13 35.48% : 0.000431s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.59% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 59.94% : 0.000727s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.086284 72 0.07% : 0.000059s : 1: add_recomputation 0.09% : 0.000080s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.62% : 0.000533s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000046s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 32.93% : 0.028417s : 1: jit_opt_a 0.18% : 0.000156s : 1: jit_opt_after_cconv 0.07% : 0.000058s : 1: jit_opt_b 0.53% : 0.000456s : 1: loop_unroll 1.16% : 0.000998s : 1: mutable_eliminate 1.20% : 0.001035s : 26: opt.transform.jit_opt_a 0.06% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000512s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000072s : 1: py_interpret_to_execute 0.03% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 24.52% : 0.021155s : 1: renormalize.infer 1.12% : 0.000969s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.10% : 0.000083s : 1: rewriter_before_opt_a 0.10% : 0.000082s : 1: symbol_engine_optimizer 36.14% : 0.031182s : 1: type_inference TotalTime = 0.16981, [30] [bootstrap]: 0.0002823 [type_inference]: 0.141749 [event_method]: 0.00066471 [auto_monad]: 0.00028337 [graph_reusing]: 7.55e-06 [pre_auto_parallel]: 3.45e-06 [py_interpret_to_execute]: 7.661e-05 [rewriter_before_opt_a]: 0.00014422 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.0239573, [2] [Cycle 1]: 0.0189447, [27] [switch_simplify]: 8.518e-05 [loop_unroll]: 4.454e-05 [a_1]: 0.00106001 [with_stream_mark]: 6.668e-05 [recompute_prepare]: 2.446e-05 [updatestate_depend_eliminate]: 1.053e-05 [updatestate_assign_eliminate]: 6.93e-06 [updatestate_loads_eliminate]: 7.05e-06 [parameter_eliminate]: 3.21001e-06 [specialize_transform]: 1.511e-05 [updatestate_useless_node_eliminater]: 1.371e-05 [accelerated_algorithm]: 1.435e-05 [meta_shard_fg_expand]: 5.27001e-06 [get_grad_eliminate_]: 4.509e-05 [merge_forward]: 9.96998e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.262e-05 [j_node_and_user_rematch]: 2.642e-05 [meta_fg_expand]: 0.0021996 [replace_old_param]: 8.246e-05 [inline_without_move]: 6.622e-05 [renormalize]: 0.0147762 [add_forward_monad_depend]: 9.18002e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.702e-05 [cse]: 3.056e-05 [replace_applicator]: 2.414e-05 [Cycle 2]: 0.00048591, [27] [switch_simplify]: 5.61e-06 [loop_unroll]: 4.89e-06 [a_1]: 6.362e-05 [with_stream_mark]: 1.478e-05 [recompute_prepare]: 3.86001e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 3.88999e-06 [updatestate_useless_node_eliminater]: 3.41999e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 3.63e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 3.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.678e-05 [j_node_and_user_rematch]: 8.05999e-06 [meta_fg_expand]: 0.00016374 [replace_old_param]: 7.13e-06 [inline_without_move]: 5.17e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.18e-05 [replace_applicator]: 3.88999e-06 [py_interpret_to_execute_after_opt_a]: 1.505e-05 [rewriter_after_opt_a]: 4.627e-05 [convert_after_rewriter]: 6.01003e-06 [order_py_execute_after_rewriter]: 4.67e-06 [mutable_eliminate]: 0.00084799 [jit_opt_b]: 4.559e-05, [1] [Cycle 1]: 3.749e-05, [2] [frontend_op_eliminate]: 1.192e-05 [inline_after_opt_a]: 1.272e-05 [cconv]: 3.079e-05 [loop_unroll]: 0.00048055 [jit_opt_after_cconv]: 0.00013556, [1] [Cycle 1]: 0.00012897, [11] [c_1]: 1.399e-05 [parameter_eliminate]: 3.25e-06 [updatestate_depend_eliminate]: 6.54001e-06 [updatestate_assign_eliminate]: 1.87999e-06 [updatestate_loads_eliminate]: 1.81e-06 [cse]: 1.977e-05 [call_graph_tuple_transform]: 1.732e-05 [tuple_list_get_item_eliminator]: 3.95998e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 3.80998e-06 [remove_dup_value]: 1.576e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 5.69e-06 [add_recomputation]: 4.74e-05 [cse_after_recomputation]: 2.245e-05, [1] [Cycle 1]: 1.611e-05, [1] [cse]: 8.97e-06 [auto_monad_reorder]: 1.373e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 6.67002e-06 [opt_after_jit_grad]: 0.00056009 [symbol_engine_optimizer]: 7.57e-05, [1] [Cycle 1]: 6.859e-05, [6] [build]: 4.57998e-06 [elim_shapecalc]: 7.55998e-06 [elim_not_effective]: 1.169e-05 [opt_reshape]: 5.40001e-06 [fold_const_symbol]: 7.01999e-06 [renormalize]: 4.89992e-07 [validate]: 3.721e-05 Sums bootstrap : 0.000282s : 0.17% type_inference : 0.141749s : 86.16% event_method : 0.000665s : 0.40% auto_monad : 0.000283s : 0.17% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000077s : 0.05% rewriter_before_opt_a : 0.000144s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.06% jit_opt_a.loop_unroll : 0.000049s : 0.03% jit_opt_a.a_1 : 0.001124s : 0.68% jit_opt_a.with_stream_mark : 0.000081s : 0.05% jit_opt_a.recompute_prepare : 0.000028s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000019s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000017s : 0.01% jit_opt_a.accelerated_algorithm : 0.000019s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000049s : 0.03% jit_opt_a.merge_forward : 0.000013s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000049s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000034s : 0.02% jit_opt_a.meta_fg_expand : 0.002363s : 1.44% jit_opt_a.replace_old_param : 0.000090s : 0.05% jit_opt_a.inline_without_move : 0.000071s : 0.04% jit_opt_a.renormalize : 0.014776s : 8.98% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000046s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000848s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000481s : 0.29% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000047s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000560s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.02% Time group info: ------[substitution.] 0.000362 56 0.58% : 0.000002s : 1: substitution.elim_not_effective 0.25% : 0.000001s : 1: substitution.fold_const_symbol 1.29% : 0.000005s : 1: substitution.graph_param_transform 69.68% : 0.000252s : 7: substitution.inline 6.08% : 0.000022s : 2: substitution.inline_without_move 2.36% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.16% : 0.000004s : 2: substitution.minmaximum_grad 1.22% : 0.000004s : 3: substitution.partial_eliminate 2.55% : 0.000009s : 9: substitution.remove_not_recompute_node 1.91% : 0.000007s : 2: substitution.replace_applicator 3.29% : 0.000012s : 10: substitution.replace_old_param 1.00% : 0.000004s : 1: substitution.set_cell_output_no_recompute 2.46% : 0.000009s : 2: substitution.tuple_list_convert_item_index_to_positive 1.31% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 4.85% : 0.000018s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.141551 2 96.85% : 0.137092s : 1: type_inference.infer 3.15% : 0.004460s : 1: type_inference.specialize ------[replace.] 0.000095 9 79.81% : 0.000076s : 7: replace.inline 20.19% : 0.000019s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 9 95.12% : 0.000248s : 7: match.inline 4.88% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000200 1234 1.69% : 0.000003s : 20: predicate.accumulaten_eliminater 0.56% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.27% : 0.000003s : 20: predicate.addn_check_dump 1.50% : 0.000003s : 20: predicate.addn_zero_filter 1.92% : 0.000004s : 20: predicate.arithmetic_simplify 1.47% : 0.000003s : 20: predicate.cast_eliminate 0.13% : 0.000000s : 1: predicate.check_bprop_eliminate 1.25% : 0.000003s : 20: predicate.compare_switch_simplify 1.22% : 0.000002s : 20: predicate.depend_value_elim 1.31% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.29% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.37% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.32% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.27% : 0.000003s : 20: predicate.environ_get_depend_swap 1.30% : 0.000003s : 20: predicate.environ_get_eliminate 1.29% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.06% : 0.000000s : 1: predicate.fold_const_symbol 1.07% : 0.000002s : 13: predicate.get_grad_eliminate 0.17% : 0.000000s : 1: predicate.graph_param_transform 4.40% : 0.000009s : 31: predicate.inline 3.53% : 0.000007s : 41: predicate.inline_without_move 0.49% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.45% : 0.000003s : 13: predicate.less_batch_normalization 1.54% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.75% : 0.000004s : 23: predicate.load_eliminater 1.01% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.63% : 0.000007s : 49: predicate.loop_unroll_before_grad 1.64% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.25% : 0.000003s : 20: predicate.merge_addn 1.38% : 0.000003s : 20: predicate.minmaximum_grad 1.52% : 0.000003s : 1: predicate.mutable_eliminate 0.24% : 0.000000s : 1: predicate.opt_reshape 1.99% : 0.000004s : 23: predicate.partial_eliminate 1.39% : 0.000003s : 20: predicate.print_const_string_wrapper 1.93% : 0.000004s : 20: predicate.reduce_eliminate 1.55% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 13: predicate.remove_not_recompute_node 1.82% : 0.000004s : 24: predicate.replace_applicator 2.09% : 0.000004s : 41: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.39% : 0.000003s : 20: predicate.reshape_eliminate 1.34% : 0.000003s : 20: predicate.row_tensor_add_zeros_like 0.39% : 0.000001s : 1: predicate.row_tensor_eliminate 1.50% : 0.000003s : 20: predicate.same_eliminate 0.75% : 0.000002s : 13: predicate.set_cell_output_no_recompute 0.30% : 0.000001s : 2: predicate.special_op_eliminate 1.10% : 0.000002s : 13: predicate.specialize_transform 1.79% : 0.000004s : 20: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000003s : 20: predicate.stack_unstack_eliminate 0.20% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.34% : 0.000005s : 29: predicate.switch_defer_inline 2.33% : 0.000005s : 29: predicate.switch_layer_defer_inline 6.61% : 0.000013s : 79: predicate.switch_simplify 1.69% : 0.000003s : 20: predicate.tile_eliminate 1.55% : 0.000003s : 20: predicate.transpose_eliminate 1.78% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.18% : 0.000006s : 24: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.75% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.53% : 0.000003s : 23: predicate.updatestate_pure_node_eliminater 2.79% : 0.000006s : 36: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 20: predicate.value_based_eliminate 0.12% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.21% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003840 38 87.44% : 0.003358s : 28: func_graph_cloner_run.FuncGraphClonerGraph 12.56% : 0.000482s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.186214 72 0.03% : 0.000050s : 1: add_recomputation 0.16% : 0.000295s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.17% : 0.000308s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.36% : 0.000676s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 12.87% : 0.023962s : 1: jit_opt_a 0.07% : 0.000138s : 1: jit_opt_after_cconv 0.03% : 0.000048s : 1: jit_opt_b 0.26% : 0.000488s : 1: loop_unroll 0.46% : 0.000857s : 1: mutable_eliminate 0.87% : 0.001629s : 26: opt.transform.jit_opt_a 0.02% : 0.000036s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000027s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000569s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000080s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.51% : 0.013985s : 1: renormalize.infer 0.42% : 0.000774s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.08% : 0.000148s : 1: rewriter_before_opt_a 0.04% : 0.000078s : 1: symbol_engine_optimizer 76.14% : 0.141781s : 1: type_inference TotalTime = 0.0984237, [30] [bootstrap]: 0.00026262 [type_inference]: 0.0731407 [event_method]: 1.976e-05 [auto_monad]: 6.959e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00010962 [rewriter_before_opt_a]: 8.44e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.022172, [2] [Cycle 1]: 0.018344, [27] [switch_simplify]: 5.737e-05 [loop_unroll]: 2.928e-05 [a_1]: 0.00140582 [with_stream_mark]: 2.299e-05 [recompute_prepare]: 8.87999e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.23998e-06 [replace_old_param]: 9.58002e-06 [inline_without_move]: 5.46998e-06 [renormalize]: 0.0164263 [add_forward_monad_depend]: 8.92999e-06 [auto_monad_grad]: 3.90998e-06 [auto_monad_eliminator]: 2.157e-05 [cse]: 4.074e-05 [replace_applicator]: 2.682e-05 [Cycle 2]: 0.00039487, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.00010482 [with_stream_mark]: 1.665e-05 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 5.83002e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.54998e-06 [meta_shard_fg_expand]: 2.82002e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 4.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.085e-05 [j_node_and_user_rematch]: 9.51998e-06 [meta_fg_expand]: 2.68003e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 4.87e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.85001e-06 [auto_monad_grad]: 1.21002e-06 [auto_monad_eliminator]: 8.88002e-06 [cse]: 1.81e-05 [replace_applicator]: 6.91999e-06 [py_interpret_to_execute_after_opt_a]: 1.914e-05 [rewriter_after_opt_a]: 4.194e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00075379 [jit_opt_b]: 5.15e-05, [1] [Cycle 1]: 4.309e-05, [2] [frontend_op_eliminate]: 1.651e-05 [inline_after_opt_a]: 1.589e-05 [cconv]: 2.856e-05 [loop_unroll]: 0.00047502 [jit_opt_after_cconv]: 0.00017237, [1] [Cycle 1]: 0.00016417, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 3.45e-06 [updatestate_depend_eliminate]: 1.91e-05 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.763e-05 [call_graph_tuple_transform]: 2.094e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.71998e-06 [remove_dup_value]: 1.757e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 7.28999e-06 [add_recomputation]: 5.257e-05 [cse_after_recomputation]: 4.547e-05, [1] [Cycle 1]: 3.853e-05, [1] [cse]: 3.112e-05 [auto_monad_reorder]: 1.923e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 5.58002e-06 [opt_after_jit_grad]: 0.00049611 [symbol_engine_optimizer]: 7.483e-05, [1] [Cycle 1]: 6.71e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 7.92003e-06 [elim_not_effective]: 1.456e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.25999e-06 [renormalize]: 5.69999e-07 [validate]: 4.118e-05 Sums bootstrap : 0.000263s : 0.28% type_inference : 0.073141s : 77.57% event_method : 0.000020s : 0.02% auto_monad : 0.000070s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000110s : 0.12% rewriter_before_opt_a : 0.000084s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.001511s : 1.60% jit_opt_a.with_stream_mark : 0.000040s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.016426s : 17.42% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.03% jit_opt_a.cse : 0.000059s : 0.06% jit_opt_a.replace_applicator : 0.000034s : 0.04% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000754s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000475s : 0.50% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000031s : 0.03% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000496s : 0.53% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.001079 23 0.23% : 0.000002s : 2: substitution.elim_not_effective 0.12% : 0.000001s : 2: substitution.fold_const_symbol 0.51% : 0.000006s : 3: substitution.graph_param_transform 96.44% : 0.001040s : 4: substitution.inline 0.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.55% : 0.000006s : 4: substitution.remove_not_recompute_node 0.59% : 0.000006s : 2: substitution.replace_old_param 1.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.073065 2 97.88% : 0.071516s : 1: type_inference.infer 2.12% : 0.001548s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.99% : 0.000053s : 4: replace.inline 30.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001049 6 98.85% : 0.001037s : 4: match.inline 1.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.70% : 0.000002s : 10: predicate.addn_zero_filter 2.20% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.52% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.41% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.82% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.06% : 0.000003s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016187 13 2.44% : 0.000394s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.28% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 97.29% : 0.015748s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116615 72 0.05% : 0.000055s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.24% : 0.000280s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000047s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 19.02% : 0.022176s : 1: jit_opt_a 0.15% : 0.000175s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.42% : 0.000487s : 1: loop_unroll 0.66% : 0.000766s : 1: mutable_eliminate 1.50% : 0.001754s : 26: opt.transform.jit_opt_a 0.04% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000507s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000113s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.46% : 0.000532s : 1: renormalize.infer 13.62% : 0.015881s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000088s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 62.73% : 0.073158s : 1: type_inference TotalTime = 0.223397, [30] [bootstrap]: 0.00042168 [type_inference]: 0.195333 [event_method]: 0.00068882 [auto_monad]: 0.00019566 [graph_reusing]: 1.083e-05 [pre_auto_parallel]: 4.77e-06 [py_interpret_to_execute]: 6.397e-05 [rewriter_before_opt_a]: 0.00022959 [expand_dump_flag]: 4.46002e-06 [jit_opt_a]: 0.0216122, [2] [Cycle 1]: 0.00632957, [27] [switch_simplify]: 0.00029296 [loop_unroll]: 6.74e-05 [a_1]: 0.00229222 [with_stream_mark]: 2.793e-05 [recompute_prepare]: 1.276e-05 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 7.04001e-06 [meta_shard_fg_expand]: 3.18e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 4.60001e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 1.137e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 9.76e-06 [inline_without_move]: 6.66e-06 [renormalize]: 0.00320758 [add_forward_monad_depend]: 1.083e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.902e-05 [cse]: 3.484e-05 [replace_applicator]: 2.206e-05 [Cycle 2]: 0.00037984, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.0001181 [with_stream_mark]: 1.693e-05 [recompute_prepare]: 5.49998e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 5.31002e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 4.95999e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 4.53999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.811e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.112e-05 [replace_applicator]: 4.82e-06 [py_interpret_to_execute_after_opt_a]: 1.651e-05 [rewriter_after_opt_a]: 4.178e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.87001e-06 [mutable_eliminate]: 0.00245253 [jit_opt_b]: 7.513e-05, [1] [Cycle 1]: 6.421e-05, [2] [frontend_op_eliminate]: 2.775e-05 [inline_after_opt_a]: 2.237e-05 [cconv]: 3.997e-05 [loop_unroll]: 0.0005541 [jit_opt_after_cconv]: 0.00018559, [1] [Cycle 1]: 0.00017897, [11] [c_1]: 2.688e-05 [parameter_eliminate]: 6.12001e-06 [updatestate_depend_eliminate]: 9.78002e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 3.629e-05 [call_graph_tuple_transform]: 2.416e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 6.161e-05 [cse_after_recomputation]: 2.637e-05, [1] [Cycle 1]: 1.864e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.725e-05 [get_jit_bprop_graph]: 2.11998e-06 [rewriter_after_jit_bprop_graph]: 9.22999e-06 [opt_after_jit_grad]: 0.00052896 [symbol_engine_optimizer]: 0.00022483, [1] [Cycle 1]: 0.00021768, [6] [build]: 5.82001e-06 [elim_shapecalc]: 8.37e-06 [elim_not_effective]: 1.556e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 0.00014787 [renormalize]: 7.50006e-07 [validate]: 5.672e-05 Sums bootstrap : 0.000422s : 0.20% type_inference : 0.195333s : 94.14% event_method : 0.000689s : 0.33% auto_monad : 0.000196s : 0.09% graph_reusing : 0.000011s : 0.01% pre_auto_parallel : 0.000005s : 0.00% py_interpret_to_execute : 0.000064s : 0.03% rewriter_before_opt_a : 0.000230s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000300s : 0.14% jit_opt_a.loop_unroll : 0.000073s : 0.04% jit_opt_a.a_1 : 0.002410s : 1.16% jit_opt_a.with_stream_mark : 0.000045s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003208s : 1.55% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000046s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.002453s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000040s : 0.02% loop_unroll : 0.000554s : 0.27% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000062s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000529s : 0.25% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000148s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.03% Time group info: ------[substitution.] 0.001103 56 0.29% : 0.000003s : 2: substitution.elim_not_effective 0.14% : 0.000002s : 2: substitution.fold_const_symbol 0.59% : 0.000007s : 3: substitution.graph_param_transform 88.59% : 0.000977s : 15: substitution.inline 0.46% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.99% : 0.000011s : 4: substitution.minmaximum_grad 0.51% : 0.000006s : 4: substitution.remove_not_recompute_node 0.67% : 0.000007s : 2: substitution.replace_old_param 2.15% : 0.000024s : 4: substitution.switch_simplify 1.42% : 0.000016s : 4: substitution.tuple_list_convert_item_index_to_positive 1.13% : 0.000012s : 4: substitution.tuple_list_get_item_depend_reorder 3.08% : 0.000034s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.195176 2 96.64% : 0.188611s : 1: type_inference.infer 3.36% : 0.006565s : 1: type_inference.specialize ------[replace.] 0.000566 23 48.33% : 0.000274s : 15: replace.inline 16.62% : 0.000094s : 4: replace.switch_simplify 35.04% : 0.000198s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.001000 23 96.95% : 0.000969s : 15: match.inline 1.88% : 0.000019s : 4: match.switch_simplify 1.17% : 0.000012s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000255 1341 1.36% : 0.000003s : 21: predicate.accumulaten_eliminater 0.68% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000003s : 21: predicate.addn_check_dump 1.66% : 0.000004s : 21: predicate.addn_zero_filter 2.26% : 0.000006s : 21: predicate.arithmetic_simplify 1.40% : 0.000004s : 21: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000003s : 21: predicate.compare_switch_simplify 1.28% : 0.000003s : 21: predicate.depend_value_elim 1.06% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.61% : 0.000004s : 21: predicate.dict_get_item_eliminator 1.37% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.58% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.17% : 0.000000s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.19% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.14% : 0.000003s : 21: predicate.environ_get_depend_swap 1.52% : 0.000004s : 21: predicate.environ_get_eliminate 1.43% : 0.000004s : 21: predicate.environ_get_set_eliminate 0.11% : 0.000000s : 3: predicate.fold_const_symbol 0.67% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 5.29% : 0.000013s : 46: predicate.inline 0.40% : 0.000001s : 6: predicate.inline_without_move 0.18% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.83% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 1.76% : 0.000004s : 28: predicate.load_eliminater 1.03% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.46% : 0.000011s : 78: predicate.loop_unroll_before_grad 1.99% : 0.000005s : 24: predicate.make_slice_get_slice_eliminator 1.12% : 0.000003s : 21: predicate.merge_addn 1.18% : 0.000003s : 21: predicate.minmaximum_grad 1.62% : 0.000004s : 3: predicate.mutable_eliminate 0.20% : 0.000000s : 3: predicate.opt_reshape 2.10% : 0.000005s : 28: predicate.partial_eliminate 1.39% : 0.000004s : 21: predicate.print_const_string_wrapper 1.98% : 0.000005s : 21: predicate.reduce_eliminate 1.65% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000004s : 31: predicate.replace_applicator 0.22% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000001s : 3: predicate.reset_defer_inline 1.45% : 0.000004s : 21: predicate.reshape_eliminate 1.25% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.49% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000003s : 21: predicate.same_eliminate 0.36% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.56% : 0.000001s : 6: predicate.special_op_eliminate 0.47% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000004s : 21: predicate.split_environ_get_set_with_tuple_value 1.94% : 0.000005s : 21: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.39% : 0.000009s : 40: predicate.switch_defer_inline 2.56% : 0.000007s : 40: predicate.switch_layer_defer_inline 9.23% : 0.000024s : 129: predicate.switch_simplify 1.63% : 0.000004s : 21: predicate.tile_eliminate 1.35% : 0.000003s : 21: predicate.transpose_eliminate 1.61% : 0.000004s : 21: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000011s : 31: predicate.tuple_list_get_item_eliminator 1.92% : 0.000005s : 21: predicate.tuple_list_set_item_eliminator 1.75% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.43% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 1.99% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.94% : 0.000005s : 21: predicate.value_based_eliminate 0.15% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005732 38 56.84% : 0.003258s : 15: func_graph_cloner_run.FuncGraphClonerGraph 10.37% : 0.000594s : 6: func_graph_cloner_run.FuncGraphClonerNode 32.80% : 0.001880s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.229474 72 0.03% : 0.000065s : 1: add_recomputation 0.09% : 0.000204s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.19% : 0.000446s : 1: bootstrap 0.02% : 0.000043s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.31% : 0.000700s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000013s : 1: graph_reusing 9.42% : 0.021617s : 1: jit_opt_a 0.08% : 0.000189s : 1: jit_opt_after_cconv 0.03% : 0.000079s : 1: jit_opt_b 0.25% : 0.000562s : 1: loop_unroll 1.08% : 0.002475s : 1: mutable_eliminate 1.27% : 0.002923s : 26: opt.transform.jit_opt_a 0.03% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000174s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000539s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000007s : 1: pre_auto_parallel 0.03% : 0.000067s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.98% : 0.002250s : 1: renormalize.infer 0.41% : 0.000944s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.10% : 0.000234s : 1: rewriter_before_opt_a 0.10% : 0.000227s : 1: symbol_engine_optimizer 85.13% : 0.195360s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.312.239 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.313.194 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0788599, [30] [bootstrap]: 0.00029789 [type_inference]: 0.0674364 [event_method]: 2.539e-05 [auto_monad]: 7.7e-05 [graph_reusing]: 7.09001e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00027953 [rewriter_before_opt_a]: 0.00010177 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0081254, [2] [Cycle 1]: 0.00399044, [27] [switch_simplify]: 6.998e-05 [loop_unroll]: 3.489e-05 [a_1]: 0.0007394 [with_stream_mark]: 2.265e-05 [recompute_prepare]: 9.60001e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.27997e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.26998e-06 [merge_forward]: 4.59998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.256e-05 [inline_without_move]: 6.68e-06 [renormalize]: 0.00273554 [add_forward_monad_depend]: 6.98e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.751e-05 [cse]: 3.606e-05 [replace_applicator]: 1.951e-05 [Cycle 2]: 0.00037473, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00012156 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 6.56e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.476e-05 [replace_applicator]: 6.08998e-06 [py_interpret_to_execute_after_opt_a]: 1.301e-05 [rewriter_after_opt_a]: 3.941e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00065764 [jit_opt_b]: 5.609e-05, [1] [Cycle 1]: 4.809e-05, [2] [frontend_op_eliminate]: 1.89e-05 [inline_after_opt_a]: 1.854e-05 [cconv]: 2.93e-05 [loop_unroll]: 0.00046644 [jit_opt_after_cconv]: 0.00016878, [1] [Cycle 1]: 0.00016131, [11] [c_1]: 2.622e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 8.33999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 3.138e-05 [call_graph_tuple_transform]: 2.247e-05 [tuple_list_get_item_eliminator]: 6.86999e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 2.077e-05 [partial_unused_args_eliminate]: 2.93998e-06 [environ_conv]: 1.094e-05 [add_recomputation]: 5.288e-05 [cse_after_recomputation]: 2.835e-05, [1] [Cycle 1]: 2.246e-05, [1] [cse]: 1.558e-05 [auto_monad_reorder]: 1.91e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 6.12001e-06 [opt_after_jit_grad]: 0.00057411 [symbol_engine_optimizer]: 8.158e-05, [1] [Cycle 1]: 7.41e-05, [6] [build]: 4.77e-06 [elim_shapecalc]: 1.012e-05 [elim_not_effective]: 1.5e-05 [opt_reshape]: 6.73998e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 6.59988e-07 [validate]: 5.354e-05 Sums bootstrap : 0.000298s : 0.40% type_inference : 0.067436s : 90.57% event_method : 0.000025s : 0.03% auto_monad : 0.000077s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000280s : 0.38% rewriter_before_opt_a : 0.000102s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.10% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000861s : 1.16% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002736s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000051s : 0.07% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000658s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.04% loop_unroll : 0.000466s : 0.63% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000053s : 0.07% cse_after_recomputation.cse : 0.000016s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000574s : 0.77% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.07% Time group info: ------[substitution.] 0.000298 25 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 4: substitution.graph_param_transform 87.30% : 0.000260s : 5: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067339 2 96.63% : 0.065073s : 1: type_inference.infer 3.37% : 0.002266s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.95% : 0.000074s : 5: replace.inline 31.05% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000268 7 95.60% : 0.000256s : 5: match.inline 4.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 1.76% : 0.000002s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.36% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.32% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.87% : 0.000003s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 19: predicate.partial_eliminate 1.39% : 0.000002s : 13: predicate.print_const_string_wrapper 1.53% : 0.000002s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.55% : 0.000011s : 65: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.69% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003271 37 73.94% : 0.002419s : 28: func_graph_cloner_run.FuncGraphClonerGraph 2.76% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 23.30% : 0.000762s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.082835 72 0.07% : 0.000056s : 1: add_recomputation 0.10% : 0.000081s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.38% : 0.000316s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 9.81% : 0.008129s : 1: jit_opt_a 0.21% : 0.000172s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.58% : 0.000478s : 1: loop_unroll 0.81% : 0.000670s : 1: mutable_eliminate 1.36% : 0.001124s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.09% : 0.000074s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000587s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000286s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 2.33% : 0.001931s : 1: renormalize.infer 0.96% : 0.000794s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000109s : 1: rewriter_before_opt_a 0.10% : 0.000085s : 1: symbol_engine_optimizer 81.44% : 0.067459s : 1: type_inference TotalTime = 0.0635945, [30] [bootstrap]: 0.00047345 [type_inference]: 0.0510524 [event_method]: 2.601e-05 [auto_monad]: 6.545e-05 [graph_reusing]: 4.87e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 0.00018758 [rewriter_before_opt_a]: 9.177e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00884161, [2] [Cycle 1]: 0.00398669, [27] [switch_simplify]: 6.172e-05 [loop_unroll]: 3.17e-05 [a_1]: 0.00058279 [with_stream_mark]: 1.608e-05 [recompute_prepare]: 7.66001e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 8.59989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00291894 [add_forward_monad_depend]: 9.51998e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.163e-05 [cse]: 3.958e-05 [replace_applicator]: 2.375e-05 [Cycle 2]: 0.00040267, [27] [switch_simplify]: 8.21002e-06 [loop_unroll]: 6.80002e-06 [a_1]: 0.00012433 [with_stream_mark]: 1.659e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 3.91999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.941e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 5.96e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.35002e-06 [cse]: 1.476e-05 [replace_applicator]: 6.50002e-06 [py_interpret_to_execute_after_opt_a]: 1.72e-05 [rewriter_after_opt_a]: 4.368e-05 [convert_after_rewriter]: 8.2e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00102999 [jit_opt_b]: 5.633e-05, [1] [Cycle 1]: 4.774e-05, [2] [frontend_op_eliminate]: 1.848e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 2.831e-05 [loop_unroll]: 0.00051747 [jit_opt_after_cconv]: 0.00015272, [1] [Cycle 1]: 0.00014582, [11] [c_1]: 2.323e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.34999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.368e-05 [call_graph_tuple_transform]: 2.035e-05 [tuple_list_get_item_eliminator]: 6.23e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.686e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 5.96e-06 [add_recomputation]: 5.266e-05 [cse_after_recomputation]: 2.372e-05, [1] [Cycle 1]: 1.806e-05, [1] [cse]: 1.203e-05 [auto_monad_reorder]: 1.775e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.00054393 [symbol_engine_optimizer]: 7.983e-05, [1] [Cycle 1]: 7.243e-05, [6] [build]: 4.18999e-06 [elim_shapecalc]: 8.87e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 9.33002e-06 [renormalize]: 6.80011e-07 [validate]: 4.481e-05 Sums bootstrap : 0.000473s : 0.81% type_inference : 0.051052s : 87.24% event_method : 0.000026s : 0.04% auto_monad : 0.000065s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000188s : 0.32% rewriter_before_opt_a : 0.000092s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.12% jit_opt_a.loop_unroll : 0.000039s : 0.07% jit_opt_a.a_1 : 0.000707s : 1.21% jit_opt_a.with_stream_mark : 0.000033s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002919s : 4.99% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.05% jit_opt_a.cse : 0.000054s : 0.09% jit_opt_a.replace_applicator : 0.000030s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000044s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001030s : 1.76% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000517s : 0.88% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000544s : 0.93% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.000223 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 3: substitution.graph_param_transform 84.06% : 0.000188s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.76% : 0.000006s : 4: substitution.remove_not_recompute_node 2.38% : 0.000005s : 2: substitution.replace_old_param 4.89% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050945 2 63.27% : 0.032233s : 1: type_inference.infer 36.73% : 0.018712s : 1: type_inference.specialize ------[replace.] 0.000090 6 66.12% : 0.000059s : 4: replace.inline 33.88% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 95.04% : 0.000185s : 4: match.inline 4.96% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.29% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.00% : 0.000003s : 10: predicate.arithmetic_simplify 2.98% : 0.000004s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 10: predicate.compare_switch_simplify 1.17% : 0.000002s : 10: predicate.depend_value_elim 0.96% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.03% : 0.000001s : 10: predicate.environ_get_eliminate 1.50% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.47% : 0.000002s : 6: predicate.get_grad_eliminate 0.38% : 0.000001s : 3: predicate.graph_param_transform 4.99% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.81% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.92% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.53% : 0.000002s : 10: predicate.print_const_string_wrapper 2.50% : 0.000003s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000003s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.56% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.97% : 0.000003s : 16: predicate.switch_defer_inline 1.85% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.74% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.96% : 0.000003s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.26% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 2.12% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.34% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001223 13 40.73% : 0.000498s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.15% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.11% : 0.000686s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067525 72 0.08% : 0.000056s : 1: add_recomputation 0.10% : 0.000069s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.72% : 0.000489s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 13.10% : 0.008849s : 1: jit_opt_a 0.23% : 0.000155s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.78% : 0.000527s : 1: loop_unroll 1.54% : 0.001039s : 1: mutable_eliminate 1.42% : 0.000961s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.82% : 0.000552s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000191s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 3.02% : 0.002036s : 1: renormalize.infer 1.29% : 0.000869s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000047s : 1: rewriter_after_opt_a 0.14% : 0.000095s : 1: rewriter_before_opt_a 0.12% : 0.000083s : 1: symbol_engine_optimizer 75.64% : 0.051074s : 1: type_inference TotalTime = 0.0504879, [30] [bootstrap]: 0.00055616 [type_inference]: 0.0226157 [event_method]: 2.569e-05 [auto_monad]: 9.752e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 7.663e-05 [rewriter_before_opt_a]: 8.615e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.024239, [2] [Cycle 1]: 0.0190855, [27] [switch_simplify]: 7.527e-05 [loop_unroll]: 3.117e-05 [a_1]: 0.00064168 [with_stream_mark]: 2.62e-05 [recompute_prepare]: 7.68001e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.39998e-06 [renormalize]: 0.0178505 [add_forward_monad_depend]: 1.267e-05 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 2.649e-05 [cse]: 3.177e-05 [replace_applicator]: 3.138e-05 [Cycle 2]: 0.00040883, [27] [switch_simplify]: 9.22999e-06 [loop_unroll]: 6.78998e-06 [a_1]: 0.00012837 [with_stream_mark]: 1.913e-05 [recompute_prepare]: 6.39999e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 3.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.092e-05 [j_node_and_user_rematch]: 1.081e-05 [meta_fg_expand]: 3.00998e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.14998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.41002e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 7.57998e-06 [cse]: 1.175e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 2.07e-05 [rewriter_after_opt_a]: 4.016e-05 [convert_after_rewriter]: 8.33999e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00098475 [jit_opt_b]: 6.206e-05, [1] [Cycle 1]: 5.27e-05, [2] [frontend_op_eliminate]: 2.189e-05 [inline_after_opt_a]: 1.8e-05 [cconv]: 3.252e-05 [loop_unroll]: 0.00047257 [jit_opt_after_cconv]: 0.00016158, [1] [Cycle 1]: 0.00015387, [11] [c_1]: 2.54e-05 [parameter_eliminate]: 4.38999e-06 [updatestate_depend_eliminate]: 8.22e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 2.558e-05 [call_graph_tuple_transform]: 2.211e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 7.19001e-06 [remove_dup_value]: 1.641e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.55002e-06 [add_recomputation]: 5.569e-05 [cse_after_recomputation]: 2.597e-05, [1] [Cycle 1]: 1.876e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.639e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.44999e-06 [opt_after_jit_grad]: 0.00049545 [symbol_engine_optimizer]: 7.877e-05, [1] [Cycle 1]: 7.18e-05, [6] [build]: 4.87e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.336e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 7.59988e-07 [validate]: 4.605e-05 Sums bootstrap : 0.000556s : 1.24% type_inference : 0.022616s : 50.26% event_method : 0.000026s : 0.06% auto_monad : 0.000098s : 0.22% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000077s : 0.17% rewriter_before_opt_a : 0.000086s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000085s : 0.19% jit_opt_a.loop_unroll : 0.000038s : 0.08% jit_opt_a.a_1 : 0.000770s : 1.71% jit_opt_a.with_stream_mark : 0.000045s : 0.10% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.017851s : 39.67% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.08% jit_opt_a.cse : 0.000044s : 0.10% jit_opt_a.replace_applicator : 0.000037s : 0.08% py_interpret_to_execute_after_opt_a : 0.000021s : 0.05% rewriter_after_opt_a : 0.000040s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000985s : 2.19% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000033s : 0.07% loop_unroll : 0.000473s : 1.05% jit_opt_after_cconv.c_1 : 0.000025s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000495s : 1.10% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.10% Time group info: ------[substitution.] 0.000287 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000006s : 3: substitution.graph_param_transform 85.65% : 0.000246s : 4: substitution.inline 1.84% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000006s : 4: substitution.remove_not_recompute_node 2.37% : 0.000007s : 2: substitution.replace_old_param 4.67% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022494 2 92.36% : 0.020776s : 1: type_inference.infer 7.64% : 0.001718s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.31% : 0.000061s : 4: replace.inline 30.69% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 6 95.23% : 0.000243s : 4: match.inline 4.77% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 691 1.64% : 0.000002s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.64% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.79% : 0.000003s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 0.97% : 0.000001s : 10: predicate.depend_value_elim 0.96% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.02% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.29% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.24% : 0.000007s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000003s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 2.12% : 0.000003s : 10: predicate.reduce_eliminate 1.77% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 2.45% : 0.000003s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.58% : 0.000001s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.54% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.20% : 0.000002s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 16: predicate.switch_defer_inline 1.85% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.93% : 0.000010s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.19% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001399 13 35.33% : 0.000494s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.24% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 60.43% : 0.000845s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.069400 72 0.08% : 0.000059s : 1: add_recomputation 0.15% : 0.000102s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.83% : 0.000574s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.05% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 34.93% : 0.024244s : 1: jit_opt_a 0.24% : 0.000164s : 1: jit_opt_after_cconv 0.09% : 0.000065s : 1: jit_opt_b 0.69% : 0.000482s : 1: loop_unroll 1.44% : 0.000997s : 1: mutable_eliminate 1.50% : 0.001042s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000079s : 1: py_interpret_to_execute 0.03% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 24.17% : 0.016773s : 1: renormalize.infer 1.52% : 0.001055s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.12% : 0.000082s : 1: symbol_engine_optimizer 32.63% : 0.022648s : 1: type_inference TotalTime = 0.0927119, [30] [bootstrap]: 0.00033803 [type_inference]: 0.0717525 [event_method]: 0.00032757 [auto_monad]: 0.00011293 [graph_reusing]: 8.46002e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 4.15e-05 [rewriter_before_opt_a]: 0.00012798 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.0175547, [2] [Cycle 1]: 0.0132424, [27] [switch_simplify]: 9.05e-05 [loop_unroll]: 4.942e-05 [a_1]: 0.00109735 [with_stream_mark]: 3.814e-05 [recompute_prepare]: 2.612e-05 [updatestate_depend_eliminate]: 1.025e-05 [updatestate_assign_eliminate]: 8.09002e-06 [updatestate_loads_eliminate]: 7.16999e-06 [parameter_eliminate]: 3.01999e-06 [specialize_transform]: 1.627e-05 [updatestate_useless_node_eliminater]: 1.477e-05 [accelerated_algorithm]: 1.527e-05 [meta_shard_fg_expand]: 5.66e-06 [get_grad_eliminate_]: 1.503e-05 [merge_forward]: 9.67999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.203e-05 [j_node_and_user_rematch]: 2.677e-05 [meta_fg_expand]: 0.00217736 [replace_old_param]: 7.951e-05 [inline_without_move]: 6.72e-05 [renormalize]: 0.00909516 [add_forward_monad_depend]: 9.82999e-06 [auto_monad_grad]: 3.28e-06 [auto_monad_eliminator]: 1.665e-05 [cse]: 3.086e-05 [replace_applicator]: 2.399e-05 [Cycle 2]: 0.00046402, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 4.58999e-06 [a_1]: 6.151e-05 [with_stream_mark]: 1.483e-05 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 3.85e-06 [updatestate_useless_node_eliminater]: 3.3e-06 [accelerated_algorithm]: 4.42e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 3.57997e-06 [merge_forward]: 4.55999e-06 [cell_reuse_recompute_pass]: 3.76001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.638e-05 [j_node_and_user_rematch]: 7.82e-06 [meta_fg_expand]: 0.0001436 [replace_old_param]: 6.09001e-06 [inline_without_move]: 3.55e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 9.99979e-07 [auto_monad_eliminator]: 5.22e-06 [cse]: 1.289e-05 [replace_applicator]: 4.4e-06 [py_interpret_to_execute_after_opt_a]: 1.292e-05 [rewriter_after_opt_a]: 3.775e-05 [convert_after_rewriter]: 5.78997e-06 [order_py_execute_after_rewriter]: 4.02e-06 [mutable_eliminate]: 0.0007323 [jit_opt_b]: 4.761e-05, [1] [Cycle 1]: 3.951e-05, [2] [frontend_op_eliminate]: 1.179e-05 [inline_after_opt_a]: 1.501e-05 [cconv]: 2.958e-05 [loop_unroll]: 0.00043603 [jit_opt_after_cconv]: 0.00020339, [1] [Cycle 1]: 0.00019653, [11] [c_1]: 1.417e-05 [parameter_eliminate]: 3.63999e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.04e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 8.11e-05 [call_graph_tuple_transform]: 1.782e-05 [tuple_list_get_item_eliminator]: 4.36002e-06 [none_parameter_eliminate]: 1.86003e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 3.81001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 5.51e-06 [add_recomputation]: 4.174e-05 [cse_after_recomputation]: 2.056e-05, [1] [Cycle 1]: 1.394e-05, [1] [cse]: 7.60998e-06 [auto_monad_reorder]: 1.338e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.69999e-06 [opt_after_jit_grad]: 0.00050591 [symbol_engine_optimizer]: 7.109e-05, [1] [Cycle 1]: 6.479e-05, [6] [build]: 4.58999e-06 [elim_shapecalc]: 6.88998e-06 [elim_not_effective]: 1.097e-05 [opt_reshape]: 4.60001e-06 [fold_const_symbol]: 6.01e-06 [renormalize]: 4.30009e-07 [validate]: 3.76e-05 Sums bootstrap : 0.000338s : 0.38% type_inference : 0.071752s : 81.43% event_method : 0.000328s : 0.37% auto_monad : 0.000113s : 0.13% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000041s : 0.05% rewriter_before_opt_a : 0.000128s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000096s : 0.11% jit_opt_a.loop_unroll : 0.000054s : 0.06% jit_opt_a.a_1 : 0.001159s : 1.32% jit_opt_a.with_stream_mark : 0.000053s : 0.06% jit_opt_a.recompute_prepare : 0.000031s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000011s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000020s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.02% jit_opt_a.accelerated_algorithm : 0.000020s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000019s : 0.02% jit_opt_a.merge_forward : 0.000014s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000035s : 0.04% jit_opt_a.meta_fg_expand : 0.002321s : 2.63% jit_opt_a.replace_old_param : 0.000086s : 0.10% jit_opt_a.inline_without_move : 0.000071s : 0.08% jit_opt_a.renormalize : 0.009095s : 10.32% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000044s : 0.05% jit_opt_a.replace_applicator : 0.000028s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000732s : 0.83% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000436s : 0.49% jit_opt_after_cconv.c_1 : 0.000014s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000081s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000042s : 0.05% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000506s : 0.57% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000352 56 0.53% : 0.000002s : 1: substitution.elim_not_effective 0.28% : 0.000001s : 1: substitution.fold_const_symbol 1.58% : 0.000006s : 1: substitution.graph_param_transform 69.46% : 0.000244s : 7: substitution.inline 6.22% : 0.000022s : 2: substitution.inline_without_move 2.54% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.08% : 0.000004s : 2: substitution.minmaximum_grad 1.24% : 0.000004s : 3: substitution.partial_eliminate 2.41% : 0.000008s : 9: substitution.remove_not_recompute_node 2.14% : 0.000008s : 2: substitution.replace_applicator 2.06% : 0.000007s : 10: substitution.replace_old_param 1.00% : 0.000004s : 1: substitution.set_cell_output_no_recompute 2.65% : 0.000009s : 2: substitution.tuple_list_convert_item_index_to_positive 1.60% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 5.21% : 0.000018s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071627 2 95.38% : 0.068322s : 1: type_inference.infer 4.62% : 0.003306s : 1: type_inference.specialize ------[replace.] 0.000090 9 78.12% : 0.000070s : 7: replace.inline 21.88% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 9 94.99% : 0.000240s : 7: match.inline 5.01% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000207 1343 1.43% : 0.000003s : 22: predicate.accumulaten_eliminater 0.58% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.29% : 0.000003s : 22: predicate.addn_check_dump 1.37% : 0.000003s : 22: predicate.addn_zero_filter 2.03% : 0.000004s : 22: predicate.arithmetic_simplify 1.52% : 0.000003s : 22: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.35% : 0.000003s : 22: predicate.compare_switch_simplify 1.34% : 0.000003s : 22: predicate.depend_value_elim 1.23% : 0.000003s : 22: predicate.dict_get_item_const_eliminator 1.35% : 0.000003s : 22: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 22: predicate.dict_set_item_eliminator 0.38% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.25% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000003s : 22: predicate.environ_add_const_eliminate 1.46% : 0.000003s : 22: predicate.environ_get_add_eliminate 1.32% : 0.000003s : 22: predicate.environ_get_depend_swap 1.39% : 0.000003s : 22: predicate.environ_get_eliminate 1.23% : 0.000003s : 22: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 1.27% : 0.000003s : 14: predicate.get_grad_eliminate 0.18% : 0.000000s : 1: predicate.graph_param_transform 4.75% : 0.000010s : 33: predicate.inline 3.42% : 0.000007s : 42: predicate.inline_without_move 0.50% : 0.000001s : 14: predicate.j_node_and_user_rematch 1.39% : 0.000003s : 14: predicate.less_batch_normalization 1.50% : 0.000003s : 24: predicate.list_to_tuple_eliminator_ 1.71% : 0.000004s : 25: predicate.load_eliminater 0.89% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.74% : 0.000008s : 55: predicate.loop_unroll_before_grad 1.55% : 0.000003s : 23: predicate.make_slice_get_slice_eliminator 1.31% : 0.000003s : 22: predicate.merge_addn 1.31% : 0.000003s : 22: predicate.minmaximum_grad 0.85% : 0.000002s : 1: predicate.mutable_eliminate 0.26% : 0.000001s : 1: predicate.opt_reshape 2.12% : 0.000004s : 25: predicate.partial_eliminate 1.41% : 0.000003s : 22: predicate.print_const_string_wrapper 1.84% : 0.000004s : 22: predicate.reduce_eliminate 1.69% : 0.000004s : 24: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 14: predicate.remove_not_recompute_node 2.19% : 0.000005s : 26: predicate.replace_applicator 1.91% : 0.000004s : 42: predicate.replace_old_param 0.12% : 0.000000s : 1: predicate.reset_defer_inline 1.37% : 0.000003s : 22: predicate.reshape_eliminate 1.33% : 0.000003s : 22: predicate.row_tensor_add_zeros_like 0.30% : 0.000001s : 1: predicate.row_tensor_eliminate 1.37% : 0.000003s : 22: predicate.same_eliminate 0.63% : 0.000001s : 14: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 2: predicate.special_op_eliminate 1.09% : 0.000002s : 14: predicate.specialize_transform 1.82% : 0.000004s : 22: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000003s : 22: predicate.stack_unstack_eliminate 0.19% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.64% : 0.000005s : 31: predicate.switch_defer_inline 2.26% : 0.000005s : 31: predicate.switch_layer_defer_inline 7.10% : 0.000015s : 87: predicate.switch_simplify 1.36% : 0.000003s : 22: predicate.tile_eliminate 1.26% : 0.000003s : 22: predicate.transpose_eliminate 1.76% : 0.000004s : 22: predicate.tuple_list_convert_item_index_to_positive 1.54% : 0.000003s : 22: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000007s : 26: predicate.tuple_list_get_item_eliminator 1.69% : 0.000004s : 22: predicate.tuple_list_set_item_eliminator 1.44% : 0.000003s : 24: predicate.tuple_to_list_eliminator_ 1.46% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 3.03% : 0.000006s : 39: predicate.updatestate_useless_node_eliminater 1.83% : 0.000004s : 22: predicate.value_based_eliminate 0.08% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.006541 33 90.60% : 0.005926s : 23: func_graph_cloner_run.FuncGraphClonerGraph 9.40% : 0.000615s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.103458 72 0.04% : 0.000045s : 1: add_recomputation 0.12% : 0.000120s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.35% : 0.000362s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.33% : 0.000336s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 16.97% : 0.017559s : 1: jit_opt_a 0.20% : 0.000206s : 1: jit_opt_after_cconv 0.05% : 0.000050s : 1: jit_opt_b 0.43% : 0.000444s : 1: loop_unroll 0.72% : 0.000743s : 1: mutable_eliminate 1.59% : 0.001645s : 26: opt.transform.jit_opt_a 0.04% : 0.000036s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000044s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 8.00% : 0.008276s : 1: renormalize.infer 0.78% : 0.000803s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000131s : 1: rewriter_before_opt_a 0.07% : 0.000074s : 1: symbol_engine_optimizer 69.38% : 0.071779s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.418.255 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00659d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.418.889 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0404579, [30] [bootstrap]: 0.00033589 [type_inference]: 0.0318608 [event_method]: 2.012e-05 [auto_monad]: 6.788e-05 [graph_reusing]: 6.68998e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00010107 [rewriter_before_opt_a]: 8.334e-05 [expand_dump_flag]: 3.40998e-06 [jit_opt_a]: 0.00588001, [2] [Cycle 1]: 0.00222011, [27] [switch_simplify]: 5.448e-05 [loop_unroll]: 2.912e-05 [a_1]: 0.000519 [with_stream_mark]: 1.894e-05 [recompute_prepare]: 7.72998e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 2.10002e-06 [specialize_transform]: 6.06998e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.41002e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 2.096e-05 [meta_fg_expand]: 3.09001e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00088057 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.466e-05 [cse]: 3.582e-05 [replace_applicator]: 1.174e-05 [Cycle 2]: 0.0003153, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.044e-05 [with_stream_mark]: 8.89998e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.72001e-06 [updatestate_assign_eliminate]: 2.21003e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.272e-05 [j_node_and_user_rematch]: 7.70998e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 4.77e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.62001e-06 [cse]: 1.242e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 1.097e-05 [rewriter_after_opt_a]: 3.505e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.0005289 [jit_opt_b]: 4.844e-05, [1] [Cycle 1]: 4.155e-05, [2] [frontend_op_eliminate]: 1.508e-05 [inline_after_opt_a]: 1.628e-05 [cconv]: 2.598e-05 [loop_unroll]: 0.00041871 [jit_opt_after_cconv]: 0.00013659, [1] [Cycle 1]: 0.00013001, [11] [c_1]: 2.027e-05 [parameter_eliminate]: 2.28998e-06 [updatestate_depend_eliminate]: 5.23002e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 1.958e-05 [call_graph_tuple_transform]: 1.765e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.15001e-06 [remove_dup_value]: 1.707e-05 [partial_unused_args_eliminate]: 2.08998e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 4.846e-05 [cse_after_recomputation]: 2.209e-05, [1] [Cycle 1]: 1.689e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.704e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00047997 [symbol_engine_optimizer]: 7.13e-05, [1] [Cycle 1]: 6.491e-05, [6] [build]: 3.89002e-06 [elim_shapecalc]: 6.87002e-06 [elim_not_effective]: 1.276e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.75999e-06 [renormalize]: 4.19997e-07 [validate]: 3.625e-05 Sums bootstrap : 0.000336s : 0.93% type_inference : 0.031861s : 88.07% event_method : 0.000020s : 0.06% auto_monad : 0.000068s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000101s : 0.28% rewriter_before_opt_a : 0.000083s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.17% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000609s : 1.68% jit_opt_a.with_stream_mark : 0.000028s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000029s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000881s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.06% jit_opt_a.cse : 0.000048s : 0.13% jit_opt_a.replace_applicator : 0.000017s : 0.05% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000035s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000529s : 1.46% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000026s : 0.07% loop_unroll : 0.000419s : 1.16% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000480s : 1.33% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.10% Time group info: ------[substitution.] 0.000199 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000005s : 3: substitution.graph_param_transform 83.40% : 0.000166s : 4: substitution.inline 1.74% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 6.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031787 2 95.63% : 0.030397s : 1: type_inference.infer 4.37% : 0.001390s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.65% : 0.000047s : 4: replace.inline 31.35% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.69% : 0.000163s : 4: match.inline 6.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.52% : 0.000002s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000006s : 22: predicate.inline 1.15% : 0.000001s : 6: predicate.inline_without_move 0.53% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.42% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000810 13 47.85% : 0.000388s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.62% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.53% : 0.000385s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042222 72 0.12% : 0.000051s : 1: add_recomputation 0.17% : 0.000071s : 1: auto_monad 0.05% : 0.000019s : 1: auto_monad_reorder 0.84% : 0.000356s : 1: bootstrap 0.07% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.93% : 0.005883s : 1: jit_opt_a 0.33% : 0.000139s : 1: jit_opt_after_cconv 0.12% : 0.000051s : 1: jit_opt_b 1.01% : 0.000427s : 1: loop_unroll 1.27% : 0.000537s : 1: mutable_eliminate 1.97% : 0.000831s : 26: opt.transform.jit_opt_a 0.11% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.15% : 0.000488s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000105s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.17% : 0.000496s : 1: renormalize.infer 0.89% : 0.000377s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000038s : 1: rewriter_after_opt_a 0.21% : 0.000087s : 1: rewriter_before_opt_a 0.17% : 0.000074s : 1: symbol_engine_optimizer 75.50% : 0.031878s : 1: type_inference TotalTime = 0.0387736, [30] [bootstrap]: 0.00028272 [type_inference]: 0.0176744 [event_method]: 8.064e-05 [auto_monad]: 0.00013227 [graph_reusing]: 7.56001e-06 [pre_auto_parallel]: 3.23e-06 [py_interpret_to_execute]: 4.094e-05 [rewriter_before_opt_a]: 0.00011678 [expand_dump_flag]: 4.67e-06 [jit_opt_a]: 0.0177782, [3] [Cycle 1]: 0.00892461, [27] [switch_simplify]: 9.115e-05 [loop_unroll]: 4.565e-05 [a_1]: 0.00104024 [with_stream_mark]: 3.766e-05 [recompute_prepare]: 2.294e-05 [updatestate_depend_eliminate]: 9.32999e-06 [updatestate_assign_eliminate]: 7.21999e-06 [updatestate_loads_eliminate]: 6.91999e-06 [parameter_eliminate]: 3.91001e-06 [specialize_transform]: 1.476e-05 [updatestate_useless_node_eliminater]: 1.279e-05 [accelerated_algorithm]: 1.294e-05 [meta_shard_fg_expand]: 4.18001e-06 [get_grad_eliminate_]: 1.267e-05 [merge_forward]: 1.003e-05 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.861e-05 [j_node_and_user_rematch]: 2.489e-05 [meta_fg_expand]: 0.00193686 [replace_old_param]: 6.632e-05 [inline_without_move]: 5.787e-05 [renormalize]: 0.00410343 [add_forward_monad_depend]: 1.436e-05 [auto_monad_grad]: 1.579e-05 [auto_monad_eliminator]: 0.00068297 [cse]: 0.00026929 [replace_applicator]: 9.198e-05 [Cycle 2]: 0.0046998, [27] [switch_simplify]: 4.07e-05 [loop_unroll]: 3.99e-05 [a_1]: 0.00120688 [with_stream_mark]: 2.144e-05 [recompute_prepare]: 1.147e-05 [updatestate_depend_eliminate]: 6.13002e-06 [updatestate_assign_eliminate]: 4.48001e-06 [updatestate_loads_eliminate]: 3.91001e-06 [parameter_eliminate]: 2.91e-06 [specialize_transform]: 9.24e-06 [updatestate_useless_node_eliminater]: 8.54e-06 [accelerated_algorithm]: 9.22001e-06 [meta_shard_fg_expand]: 3.16001e-06 [get_grad_eliminate_]: 8.42e-06 [merge_forward]: 5.03002e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.936e-05 [j_node_and_user_rematch]: 1.379e-05 [meta_fg_expand]: 0.00015731 [replace_old_param]: 1.092e-05 [inline_without_move]: 8.94e-06 [renormalize]: 0.00283836 [add_forward_monad_depend]: 9.09e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.711e-05 [cse]: 2.834e-05 [replace_applicator]: 1.924e-05 [Cycle 3]: 0.00028592, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 3.92998e-06 [a_1]: 5.241e-05 [with_stream_mark]: 1.188e-05 [recompute_prepare]: 4.3e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 1.60001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 4.25999e-06 [updatestate_useless_node_eliminater]: 3.50998e-06 [accelerated_algorithm]: 4.80001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 3.61001e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 2.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 6.41e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 3.11999e-06 [inline_without_move]: 3.28998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 3.53999e-06 [cse]: 1.033e-05 [replace_applicator]: 3.68e-06 [py_interpret_to_execute_after_opt_a]: 1.447e-05 [rewriter_after_opt_a]: 3.869e-05 [convert_after_rewriter]: 7.18998e-06 [order_py_execute_after_rewriter]: 4.50999e-06 [mutable_eliminate]: 0.000813 [jit_opt_b]: 4.666e-05, [1] [Cycle 1]: 3.878e-05, [2] [frontend_op_eliminate]: 1.271e-05 [inline_after_opt_a]: 1.381e-05 [cconv]: 3.151e-05 [loop_unroll]: 0.00047211 [jit_opt_after_cconv]: 0.00015227, [1] [Cycle 1]: 0.00014553, [11] [c_1]: 1.506e-05 [parameter_eliminate]: 4.87998e-06 [updatestate_depend_eliminate]: 6.98e-06 [updatestate_assign_eliminate]: 2.00002e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 3.19e-05 [call_graph_tuple_transform]: 1.761e-05 [tuple_list_get_item_eliminator]: 5.10999e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 4.14002e-06 [remove_dup_value]: 1.579e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.74001e-06 [add_recomputation]: 4.215e-05 [cse_after_recomputation]: 2.136e-05, [1] [Cycle 1]: 1.582e-05, [1] [cse]: 8.22998e-06 [auto_monad_reorder]: 1.383e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 9.29e-06 [opt_after_jit_grad]: 0.0005742 [symbol_engine_optimizer]: 8.266e-05, [1] [Cycle 1]: 7.351e-05, [6] [build]: 5.29003e-06 [elim_shapecalc]: 6.87002e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 5.39998e-06 [fold_const_symbol]: 8.32998e-06 [renormalize]: 4.19997e-07 [validate]: 4.668e-05 Sums bootstrap : 0.000283s : 0.83% type_inference : 0.017674s : 52.14% event_method : 0.000081s : 0.24% auto_monad : 0.000132s : 0.39% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000041s : 0.12% rewriter_before_opt_a : 0.000117s : 0.34% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000138s : 0.41% jit_opt_a.loop_unroll : 0.000089s : 0.26% jit_opt_a.a_1 : 0.002300s : 6.78% jit_opt_a.with_stream_mark : 0.000071s : 0.21% jit_opt_a.recompute_prepare : 0.000039s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000008s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.07% jit_opt_a.accelerated_algorithm : 0.000027s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.07% jit_opt_a.merge_forward : 0.000019s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.13% jit_opt_a.meta_fg_expand : 0.002096s : 6.18% jit_opt_a.replace_old_param : 0.000080s : 0.24% jit_opt_a.inline_without_move : 0.000070s : 0.21% jit_opt_a.renormalize : 0.006942s : 20.48% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.07% jit_opt_a.auto_monad_grad : 0.000019s : 0.06% jit_opt_a.auto_monad_eliminator : 0.000704s : 2.08% jit_opt_a.cse : 0.000308s : 0.91% jit_opt_a.replace_applicator : 0.000115s : 0.34% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000039s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000813s : 2.40% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.04% jit_opt_b.inline_after_opt_a : 0.000014s : 0.04% cconv : 0.000032s : 0.09% loop_unroll : 0.000472s : 1.39% jit_opt_after_cconv.c_1 : 0.000015s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000042s : 0.12% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000014s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000574s : 1.69% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.14% Time group info: ------[substitution.] 0.000667 105 0.29% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.71% : 0.000005s : 1: substitution.graph_param_transform 68.42% : 0.000456s : 13: substitution.inline 2.91% : 0.000019s : 2: substitution.inline_without_move 1.50% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.71% : 0.000011s : 7: substitution.minmaximum_grad 1.20% : 0.000008s : 5: substitution.partial_eliminate 1.82% : 0.000012s : 13: substitution.remove_not_recompute_node 5.05% : 0.000034s : 10: substitution.replace_applicator 0.91% : 0.000006s : 8: substitution.replace_old_param 1.11% : 0.000007s : 1: substitution.reshape_eliminate 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.01% : 0.000007s : 1: substitution.tile_eliminate 3.32% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.37% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.96% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017563 2 90.32% : 0.015862s : 1: type_inference.infer 9.68% : 0.001700s : 1: type_inference.specialize ------[replace.] 0.000192 20 66.66% : 0.000128s : 13: replace.inline 33.34% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000470 20 95.14% : 0.000447s : 13: match.inline 4.86% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000392 2537 1.55% : 0.000006s : 44: predicate.accumulaten_eliminater 0.39% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.49% : 0.000006s : 44: predicate.addn_check_dump 1.47% : 0.000006s : 44: predicate.addn_zero_filter 2.23% : 0.000009s : 44: predicate.arithmetic_simplify 1.54% : 0.000006s : 44: predicate.cast_eliminate 0.13% : 0.000000s : 1: predicate.check_bprop_eliminate 1.37% : 0.000005s : 44: predicate.compare_switch_simplify 1.38% : 0.000005s : 44: predicate.depend_value_elim 1.43% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.60% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.54% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.30% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.21% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.34% : 0.000005s : 44: predicate.environ_get_depend_swap 1.46% : 0.000006s : 44: predicate.environ_get_eliminate 1.47% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.89% : 0.000004s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.87% : 0.000019s : 66: predicate.inline 1.85% : 0.000007s : 42: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.14% : 0.000004s : 18: predicate.less_batch_normalization 1.75% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 2.17% : 0.000009s : 52: predicate.load_eliminater 0.42% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.41% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.85% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.44% : 0.000006s : 44: predicate.merge_addn 1.46% : 0.000006s : 44: predicate.minmaximum_grad 0.51% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.29% : 0.000009s : 52: predicate.partial_eliminate 1.56% : 0.000006s : 44: predicate.print_const_string_wrapper 1.96% : 0.000008s : 44: predicate.reduce_eliminate 1.74% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000002s : 18: predicate.remove_not_recompute_node 2.55% : 0.000010s : 94: predicate.replace_applicator 1.04% : 0.000004s : 42: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.50% : 0.000006s : 44: predicate.reshape_eliminate 1.46% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.25% : 0.000001s : 1: predicate.row_tensor_eliminate 1.52% : 0.000006s : 44: predicate.same_eliminate 0.51% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.84% : 0.000003s : 18: predicate.specialize_transform 1.71% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.12% : 0.000012s : 64: predicate.switch_defer_inline 2.37% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.38% : 0.000025s : 154: predicate.switch_simplify 1.52% : 0.000006s : 44: predicate.tile_eliminate 1.49% : 0.000006s : 44: predicate.transpose_eliminate 2.02% : 0.000008s : 44: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.65% : 0.000014s : 53: predicate.tuple_list_get_item_eliminator 1.97% : 0.000008s : 44: predicate.tuple_list_set_item_eliminator 1.97% : 0.000008s : 51: predicate.tuple_to_list_eliminator_ 1.74% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.64% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 2.04% : 0.000008s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002426 32 58.59% : 0.001421s : 15: func_graph_cloner_run.FuncGraphClonerGraph 41.41% : 0.001005s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048673 87 0.09% : 0.000045s : 1: add_recomputation 0.29% : 0.000139s : 1: auto_monad 0.04% : 0.000017s : 1: auto_monad_reorder 0.63% : 0.000308s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.18% : 0.000087s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 36.53% : 0.017782s : 1: jit_opt_a 0.32% : 0.000156s : 1: jit_opt_after_cconv 0.10% : 0.000050s : 1: jit_opt_b 0.99% : 0.000481s : 1: loop_unroll 1.69% : 0.000825s : 1: mutable_eliminate 6.14% : 0.002988s : 39: opt.transform.jit_opt_a 0.08% : 0.000038s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000019s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000029s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000585s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000044s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 9.60% : 0.004670s : 2: renormalize.infer 4.62% : 0.002249s : 2: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000042s : 1: rewriter_after_opt_a 0.25% : 0.000121s : 1: rewriter_before_opt_a 0.18% : 0.000085s : 1: symbol_engine_optimizer 36.37% : 0.017703s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.476.103 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065e50> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.476.807 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0458854, [30] [bootstrap]: 0.00026738 [type_inference]: 0.019458 [event_method]: 7.014e-05 [auto_monad]: 0.000103 [graph_reusing]: 7.25e-06 [pre_auto_parallel]: 3.24001e-06 [py_interpret_to_execute]: 3.812e-05 [rewriter_before_opt_a]: 0.0001243 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0230717, [3] [Cycle 1]: 0.0147361, [27] [switch_simplify]: 9.486e-05 [loop_unroll]: 4.486e-05 [a_1]: 0.00114577 [with_stream_mark]: 4.151e-05 [recompute_prepare]: 2.235e-05 [updatestate_depend_eliminate]: 1.071e-05 [updatestate_assign_eliminate]: 7.67998e-06 [updatestate_loads_eliminate]: 7.03e-06 [parameter_eliminate]: 2.91e-06 [specialize_transform]: 1.512e-05 [updatestate_useless_node_eliminater]: 1.265e-05 [accelerated_algorithm]: 1.431e-05 [meta_shard_fg_expand]: 4.65999e-06 [get_grad_eliminate_]: 1.385e-05 [merge_forward]: 9.44998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.133e-05 [j_node_and_user_rematch]: 2.495e-05 [meta_fg_expand]: 0.00221902 [replace_old_param]: 7.736e-05 [inline_without_move]: 6.413e-05 [renormalize]: 0.0100541 [add_forward_monad_depend]: 1.958e-05 [auto_monad_grad]: 7.81001e-06 [auto_monad_eliminator]: 7.615e-05 [cse]: 0.00029841 [replace_applicator]: 0.00010375 [Cycle 2]: 0.00414624, [27] [switch_simplify]: 4.215e-05 [loop_unroll]: 4.133e-05 [a_1]: 0.0011958 [with_stream_mark]: 2.44e-05 [recompute_prepare]: 1.073e-05 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 4.03001e-06 [updatestate_loads_eliminate]: 4.28001e-06 [parameter_eliminate]: 2.98e-06 [specialize_transform]: 8.26002e-06 [updatestate_useless_node_eliminater]: 7.00002e-06 [accelerated_algorithm]: 7.82998e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 6.81999e-06 [merge_forward]: 5.20999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 5.627e-05 [j_node_and_user_rematch]: 1.226e-05 [meta_fg_expand]: 0.00015983 [replace_old_param]: 1.016e-05 [inline_without_move]: 7.38e-06 [renormalize]: 0.00223888 [add_forward_monad_depend]: 9.87001e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.592e-05 [cse]: 2.969e-05 [replace_applicator]: 1.907e-05 [Cycle 3]: 0.00031353, [27] [switch_simplify]: 6.71999e-06 [loop_unroll]: 5.00999e-06 [a_1]: 5.817e-05 [with_stream_mark]: 1.696e-05 [recompute_prepare]: 4.17e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 4.62e-06 [updatestate_useless_node_eliminater]: 3.51001e-06 [accelerated_algorithm]: 4.81002e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 3.86999e-06 [merge_forward]: 3.55998e-06 [cell_reuse_recompute_pass]: 3.85e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 1.78002e-06 [replace_old_param]: 4.68999e-06 [inline_without_move]: 3.68999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 4.29002e-06 [cse]: 1.16e-05 [replace_applicator]: 4.67e-06 [py_interpret_to_execute_after_opt_a]: 1.654e-05 [rewriter_after_opt_a]: 3.971e-05 [convert_after_rewriter]: 6.78998e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00085804 [jit_opt_b]: 6.406e-05, [1] [Cycle 1]: 5.436e-05, [2] [frontend_op_eliminate]: 1.318e-05 [inline_after_opt_a]: 1.412e-05 [cconv]: 3.537e-05 [loop_unroll]: 0.00049589 [jit_opt_after_cconv]: 0.00015764, [1] [Cycle 1]: 0.00014802, [11] [c_1]: 1.469e-05 [parameter_eliminate]: 4.23999e-06 [updatestate_depend_eliminate]: 8.64998e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.854e-05 [call_graph_tuple_transform]: 2.11e-05 [tuple_list_get_item_eliminator]: 4.12998e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 1.00999e-06 [switch_simplify]: 4.01001e-06 [remove_dup_value]: 1.516e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 5.69e-06 [add_recomputation]: 3.991e-05 [cse_after_recomputation]: 2.328e-05, [1] [Cycle 1]: 1.654e-05, [1] [cse]: 9.91998e-06 [auto_monad_reorder]: 1.33e-05 [get_jit_bprop_graph]: 2.43998e-06 [rewriter_after_jit_bprop_graph]: 7.37002e-06 [opt_after_jit_grad]: 0.00052573 [symbol_engine_optimizer]: 0.00012534, [1] [Cycle 1]: 0.00011679, [6] [build]: 4.92e-06 [elim_shapecalc]: 6.75002e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 4.23001e-06 [fold_const_symbol]: 5.145e-05 [renormalize]: 1.02e-06 [validate]: 4.812e-05 Sums bootstrap : 0.000267s : 0.65% type_inference : 0.019458s : 47.52% event_method : 0.000070s : 0.17% auto_monad : 0.000103s : 0.25% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000038s : 0.09% rewriter_before_opt_a : 0.000124s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000144s : 0.35% jit_opt_a.loop_unroll : 0.000091s : 0.22% jit_opt_a.a_1 : 0.002400s : 5.86% jit_opt_a.with_stream_mark : 0.000083s : 0.20% jit_opt_a.recompute_prepare : 0.000037s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000008s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.06% jit_opt_a.accelerated_algorithm : 0.000027s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.06% jit_opt_a.merge_forward : 0.000018s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000102s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.11% jit_opt_a.meta_fg_expand : 0.002381s : 5.81% jit_opt_a.replace_old_param : 0.000092s : 0.23% jit_opt_a.inline_without_move : 0.000075s : 0.18% jit_opt_a.renormalize : 0.012293s : 30.02% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.08% jit_opt_a.auto_monad_grad : 0.000011s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000096s : 0.24% jit_opt_a.cse : 0.000340s : 0.83% jit_opt_a.replace_applicator : 0.000127s : 0.31% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000858s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.03% jit_opt_b.inline_after_opt_a : 0.000014s : 0.03% cconv : 0.000035s : 0.09% loop_unroll : 0.000496s : 1.21% jit_opt_after_cconv.c_1 : 0.000015s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000040s : 0.10% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000526s : 1.28% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000051s : 0.13% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.12% Time group info: ------[substitution.] 0.000715 104 0.22% : 0.000002s : 1: substitution.elim_not_effective 0.31% : 0.000002s : 1: substitution.fold_const_symbol 0.76% : 0.000005s : 1: substitution.graph_param_transform 69.09% : 0.000494s : 13: substitution.inline 2.95% : 0.000021s : 2: substitution.inline_without_move 1.59% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.93% : 0.000014s : 7: substitution.minmaximum_grad 1.03% : 0.000007s : 5: substitution.partial_eliminate 1.80% : 0.000013s : 12: substitution.remove_not_recompute_node 5.60% : 0.000040s : 10: substitution.replace_applicator 1.14% : 0.000008s : 10: substitution.replace_old_param 0.36% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.80% : 0.000006s : 1: substitution.tile_eliminate 3.42% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.35% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.63% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019360 2 90.03% : 0.017430s : 1: type_inference.infer 9.97% : 0.001930s : 1: type_inference.specialize ------[replace.] 0.000208 20 65.80% : 0.000137s : 13: replace.inline 34.20% : 0.000071s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000509 20 95.47% : 0.000485s : 13: match.inline 4.53% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000388 2433 1.43% : 0.000006s : 42: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 42: predicate.addn_check_dump 1.68% : 0.000007s : 42: predicate.addn_zero_filter 2.19% : 0.000009s : 42: predicate.arithmetic_simplify 1.57% : 0.000006s : 42: predicate.cast_eliminate 0.10% : 0.000000s : 1: predicate.check_bprop_eliminate 1.35% : 0.000005s : 42: predicate.compare_switch_simplify 1.45% : 0.000006s : 42: predicate.depend_value_elim 1.46% : 0.000006s : 42: predicate.dict_get_item_const_eliminator 1.38% : 0.000005s : 42: predicate.dict_get_item_eliminator 1.57% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.34% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.27% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 42: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 42: predicate.environ_get_depend_swap 1.45% : 0.000006s : 42: predicate.environ_get_eliminate 1.40% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 16: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.36% : 0.000017s : 64: predicate.inline 2.02% : 0.000008s : 44: predicate.inline_without_move 0.32% : 0.000001s : 16: predicate.j_node_and_user_rematch 1.21% : 0.000005s : 16: predicate.less_batch_normalization 2.23% : 0.000009s : 49: predicate.list_to_tuple_eliminator_ 1.69% : 0.000007s : 50: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.30% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.81% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.38% : 0.000005s : 42: predicate.merge_addn 1.45% : 0.000006s : 42: predicate.minmaximum_grad 0.97% : 0.000004s : 1: predicate.mutable_eliminate 0.12% : 0.000000s : 1: predicate.opt_reshape 2.22% : 0.000009s : 50: predicate.partial_eliminate 1.63% : 0.000006s : 42: predicate.print_const_string_wrapper 2.26% : 0.000009s : 42: predicate.reduce_eliminate 1.67% : 0.000006s : 49: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000002s : 16: predicate.remove_not_recompute_node 2.58% : 0.000010s : 90: predicate.replace_applicator 1.22% : 0.000005s : 44: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.54% : 0.000006s : 42: predicate.reshape_eliminate 1.52% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.36% : 0.000001s : 1: predicate.row_tensor_eliminate 1.52% : 0.000006s : 42: predicate.same_eliminate 0.40% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.13% : 0.000000s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 16: predicate.specialize_transform 1.75% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000005s : 42: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.11% : 0.000012s : 62: predicate.switch_defer_inline 2.35% : 0.000009s : 62: predicate.switch_layer_defer_inline 6.55% : 0.000025s : 150: predicate.switch_simplify 1.70% : 0.000007s : 42: predicate.tile_eliminate 1.44% : 0.000006s : 42: predicate.transpose_eliminate 1.93% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000014s : 51: predicate.tuple_list_get_item_eliminator 1.88% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.78% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.88% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.56% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.87% : 0.000007s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003004 36 57.20% : 0.001718s : 19: func_graph_cloner_run.FuncGraphClonerGraph 42.80% : 0.001286s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061371 87 0.07% : 0.000043s : 1: add_recomputation 0.18% : 0.000108s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.53% : 0.000324s : 1: bootstrap 0.06% : 0.000038s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.12% : 0.000076s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 37.60% : 0.023076s : 1: jit_opt_a 0.26% : 0.000160s : 1: jit_opt_after_cconv 0.11% : 0.000067s : 1: jit_opt_b 0.82% : 0.000506s : 1: loop_unroll 1.42% : 0.000870s : 1: mutable_eliminate 5.14% : 0.003155s : 39: opt.transform.jit_opt_a 0.07% : 0.000040s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000019s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000072s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000536s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000041s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 15.20% : 0.009330s : 2: renormalize.infer 4.78% : 0.002934s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000045s : 1: rewriter_after_opt_a 0.21% : 0.000127s : 1: rewriter_before_opt_a 0.21% : 0.000129s : 1: symbol_engine_optimizer 31.75% : 0.019483s : 1: type_inference TotalTime = 0.0135262, [30] [bootstrap]: 0.00026574 [type_inference]: 0.00572307 [event_method]: 1.708e-05 [auto_monad]: 6.154e-05 [graph_reusing]: 7.00002e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 3.33e-05 [rewriter_before_opt_a]: 7.206e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00516822, [2] [Cycle 1]: 0.00169621, [27] [switch_simplify]: 5.201e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00057564 [with_stream_mark]: 1.887e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00067993 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.33998e-06 [auto_monad_eliminator]: 1.508e-05 [cse]: 3.587e-05 [replace_applicator]: 1.349e-05 [Cycle 2]: 0.00032755, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.498e-05 [with_stream_mark]: 1.07e-05 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 3.05002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 4.75001e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.85001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 7.98001e-06 [meta_fg_expand]: 2.01003e-06 [replace_old_param]: 7.36999e-06 [inline_without_move]: 4.79998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.299e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.243e-05 [rewriter_after_opt_a]: 3.996e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 5.98002e-06 [mutable_eliminate]: 0.00060907 [jit_opt_b]: 4.991e-05, [1] [Cycle 1]: 4.295e-05, [2] [frontend_op_eliminate]: 1.6e-05 [inline_after_opt_a]: 1.629e-05 [cconv]: 2.546e-05 [loop_unroll]: 0.00041257 [jit_opt_after_cconv]: 0.0001555, [1] [Cycle 1]: 0.00014791, [11] [c_1]: 2.043e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.166e-05 [call_graph_tuple_transform]: 1.892e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 1.706e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 5.96998e-06 [add_recomputation]: 5.174e-05 [cse_after_recomputation]: 2.348e-05, [1] [Cycle 1]: 1.777e-05, [1] [cse]: 1.225e-05 [auto_monad_reorder]: 1.719e-05 [get_jit_bprop_graph]: 1.79998e-06 [rewriter_after_jit_bprop_graph]: 5.08002e-06 [opt_after_jit_grad]: 0.00045446 [symbol_engine_optimizer]: 7.299e-05, [1] [Cycle 1]: 6.64e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.72e-06 [renormalize]: 3.89991e-07 [validate]: 3.856e-05 Sums bootstrap : 0.000266s : 2.71% type_inference : 0.005723s : 58.40% event_method : 0.000017s : 0.17% auto_monad : 0.000062s : 0.63% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000033s : 0.34% rewriter_before_opt_a : 0.000072s : 0.74% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.59% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000671s : 6.84% jit_opt_a.with_stream_mark : 0.000030s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000680s : 6.94% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000049s : 0.50% jit_opt_a.replace_applicator : 0.000019s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000040s : 0.41% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000609s : 6.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000025s : 0.26% loop_unroll : 0.000413s : 4.21% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000454s : 4.64% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.39% Time group info: ------[substitution.] 0.000203 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 3: substitution.graph_param_transform 83.23% : 0.000169s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000004s : 4: substitution.remove_not_recompute_node 2.14% : 0.000004s : 2: substitution.replace_old_param 6.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005665 2 85.31% : 0.004833s : 1: type_inference.infer 14.69% : 0.000832s : 1: type_inference.specialize ------[replace.] 0.000116 6 80.06% : 0.000093s : 4: replace.inline 19.94% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 93.12% : 0.000166s : 4: match.inline 6.88% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.27% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.07% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.02% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.55% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.17% : 0.000003s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000657 13 48.96% : 0.000322s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.24% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.79% : 0.000301s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015142 72 0.36% : 0.000054s : 1: add_recomputation 0.43% : 0.000065s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 1.87% : 0.000283s : 1: bootstrap 0.18% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 34.15% : 0.005172s : 1: jit_opt_a 1.04% : 0.000158s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.78% : 0.000420s : 1: loop_unroll 4.08% : 0.000618s : 1: mutable_eliminate 5.81% : 0.000880s : 26: opt.transform.jit_opt_a 0.31% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.05% : 0.000462s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000036s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000020s : 1: remove_dup_value 2.34% : 0.000354s : 1: renormalize.infer 2.10% : 0.000318s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000043s : 1: rewriter_after_opt_a 0.49% : 0.000075s : 1: rewriter_before_opt_a 0.50% : 0.000076s : 1: symbol_engine_optimizer 37.89% : 0.005737s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.561.667 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dc10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.562.402 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.413084, [30] [bootstrap]: 0.00044105 [type_inference]: 0.396049 [event_method]: 2.83e-05 [auto_monad]: 8.872e-05 [graph_reusing]: 6.70002e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 0.00073483 [rewriter_before_opt_a]: 0.00011653 [expand_dump_flag]: 4.32998e-06 [jit_opt_a]: 0.0129185, [2] [Cycle 1]: 0.00580721, [27] [switch_simplify]: 7.572e-05 [loop_unroll]: 3.497e-05 [a_1]: 0.00082174 [with_stream_mark]: 2.373e-05 [recompute_prepare]: 9.41e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 4.27998e-06 [updatestate_loads_eliminate]: 3.71001e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 2.88998e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 4.34002e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.648e-05 [j_node_and_user_rematch]: 1.055e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.177e-05 [inline_without_move]: 7.26999e-06 [renormalize]: 0.00439558 [add_forward_monad_depend]: 6.036e-05 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.962e-05 [cse]: 3.694e-05 [replace_applicator]: 1.691e-05 [Cycle 2]: 0.00044353, [27] [switch_simplify]: 7.00002e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00013136 [with_stream_mark]: 1.375e-05 [recompute_prepare]: 6.94999e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 2.64001e-06 [cell_reuse_handle_not_recompute_node_pass]: 6.559e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.427e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.557e-05 [rewriter_after_opt_a]: 4.351e-05 [convert_after_rewriter]: 7.48999e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00074145 [jit_opt_b]: 8.793e-05, [1] [Cycle 1]: 7.987e-05, [2] [frontend_op_eliminate]: 2.023e-05 [inline_after_opt_a]: 1.862e-05 [cconv]: 3.168e-05 [loop_unroll]: 0.0004713 [jit_opt_after_cconv]: 0.00017164, [1] [Cycle 1]: 0.0001645, [11] [c_1]: 2.654e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 7.70998e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 4.12998e-06 [cse]: 2.909e-05 [call_graph_tuple_transform]: 2.327e-05 [tuple_list_get_item_eliminator]: 8e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.64999e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 1.004e-05 [add_recomputation]: 5.403e-05 [cse_after_recomputation]: 2.52e-05, [1] [Cycle 1]: 1.991e-05, [1] [cse]: 1.4e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 2.76999e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00049389 [symbol_engine_optimizer]: 8.519e-05, [1] [Cycle 1]: 7.865e-05, [6] [build]: 4.63001e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 1.893e-05 [opt_reshape]: 6.71999e-06 [fold_const_symbol]: 1.059e-05 [renormalize]: 3.7998e-07 [validate]: 5.547e-05 Sums bootstrap : 0.000441s : 0.11% type_inference : 0.396049s : 97.65% event_method : 0.000028s : 0.01% auto_monad : 0.000089s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000735s : 0.18% rewriter_before_opt_a : 0.000117s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000953s : 0.23% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000082s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004396s : 1.08% jit_opt_a.add_forward_monad_depend : 0.000062s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000051s : 0.01% jit_opt_a.replace_applicator : 0.000023s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000741s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000032s : 0.01% loop_unroll : 0.000471s : 0.12% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000054s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000494s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.01% Time group info: ------[substitution.] 0.000362 28 0.49% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.74% : 0.000006s : 4: substitution.graph_param_transform 87.18% : 0.000316s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.12% : 0.000011s : 3: substitution.reduce_eliminate 1.47% : 0.000005s : 4: substitution.remove_not_recompute_node 1.40% : 0.000005s : 2: substitution.replace_old_param 3.07% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.395902 2 98.50% : 0.389959s : 1: type_inference.infer 1.50% : 0.005944s : 1: type_inference.specialize ------[replace.] 0.000118 7 68.91% : 0.000081s : 5: replace.inline 31.09% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 7 96.92% : 0.000313s : 5: match.inline 3.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.17% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.74% : 0.000002s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 2.13% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 2.37% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.57% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.17% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 2.35% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.88% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003367 25 58.48% : 0.001969s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.05% : 0.000103s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.46% : 0.001295s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.418699 72 0.01% : 0.000057s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.11% : 0.000462s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.09% : 0.012923s : 1: jit_opt_a 0.04% : 0.000177s : 1: jit_opt_after_cconv 0.02% : 0.000091s : 1: jit_opt_b 0.11% : 0.000480s : 1: loop_unroll 0.18% : 0.000752s : 1: mutable_eliminate 0.30% : 0.001274s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000503s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000744s : 1: py_interpret_to_execute 0.00% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 0.81% : 0.003397s : 1: renormalize.infer 0.24% : 0.000987s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.03% : 0.000123s : 1: rewriter_before_opt_a 0.02% : 0.000088s : 1: symbol_engine_optimizer 94.60% : 0.396085s : 1: type_inference TotalTime = 0.03858, [30] [bootstrap]: 0.00032992 [type_inference]: 0.0273299 [event_method]: 2.162e-05 [auto_monad]: 7.317e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 0.00016785 [rewriter_before_opt_a]: 9.54e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.00789189, [2] [Cycle 1]: 0.00305133, [27] [switch_simplify]: 8.236e-05 [loop_unroll]: 3.283e-05 [a_1]: 0.00080703 [with_stream_mark]: 2.761e-05 [recompute_prepare]: 9.20001e-06 [updatestate_depend_eliminate]: 4.91997e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 7.31999e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 8.03999e-06 [meta_shard_fg_expand]: 2.99001e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.693e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00170459 [add_forward_monad_depend]: 7.16999e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 2.068e-05 [cse]: 3.746e-05 [replace_applicator]: 1.672e-05 [Cycle 2]: 0.00035831, [27] [switch_simplify]: 6.50002e-06 [loop_unroll]: 5.54e-06 [a_1]: 9.947e-05 [with_stream_mark]: 1.251e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.77002e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.36002e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 2.22001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 8.62998e-06 [inline_without_move]: 5.24e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.458e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.583e-05 [rewriter_after_opt_a]: 3.907e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00080877 [jit_opt_b]: 5.766e-05, [1] [Cycle 1]: 5.015e-05, [2] [frontend_op_eliminate]: 1.938e-05 [inline_after_opt_a]: 1.809e-05 [cconv]: 2.834e-05 [loop_unroll]: 0.0004943 [jit_opt_after_cconv]: 0.00016284, [1] [Cycle 1]: 0.00015614, [11] [c_1]: 2.326e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 6.41998e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.84002e-06 [cse]: 2.927e-05 [call_graph_tuple_transform]: 2.154e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.549e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 6.51999e-06 [add_recomputation]: 5.592e-05 [cse_after_recomputation]: 7.366e-05, [1] [Cycle 1]: 6.754e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.943e-05 [get_jit_bprop_graph]: 2.18998e-06 [rewriter_after_jit_bprop_graph]: 6.62002e-06 [opt_after_jit_grad]: 0.0005296 [symbol_engine_optimizer]: 8.432e-05, [1] [Cycle 1]: 7.765e-05, [6] [build]: 5.17999e-06 [elim_shapecalc]: 8.37e-06 [elim_not_effective]: 1.528e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 1.058e-05 [renormalize]: 4.80009e-07 [validate]: 4.663e-05 Sums bootstrap : 0.000330s : 0.99% type_inference : 0.027330s : 81.84% event_method : 0.000022s : 0.06% auto_monad : 0.000073s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000168s : 0.50% rewriter_before_opt_a : 0.000095s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000089s : 0.27% jit_opt_a.loop_unroll : 0.000038s : 0.11% jit_opt_a.a_1 : 0.000907s : 2.71% jit_opt_a.with_stream_mark : 0.000040s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001705s : 5.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.08% jit_opt_a.cse : 0.000052s : 0.16% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000809s : 2.42% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000028s : 0.08% loop_unroll : 0.000494s : 1.48% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000530s : 1.59% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.14% Time group info: ------[substitution.] 0.000324 23 0.81% : 0.000003s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 3: substitution.graph_param_transform 87.27% : 0.000283s : 4: substitution.inline 1.10% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 1.78% : 0.000006s : 2: substitution.replace_old_param 4.81% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027237 2 90.74% : 0.024715s : 1: type_inference.infer 9.26% : 0.002522s : 1: type_inference.specialize ------[replace.] 0.000107 6 71.65% : 0.000077s : 4: replace.inline 28.35% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 6 95.10% : 0.000279s : 4: match.inline 4.90% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.18% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 2.17% : 0.000003s : 10: predicate.arithmetic_simplify 1.64% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.48% : 0.000002s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.16% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.05% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.34% : 0.000003s : 15: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 2.24% : 0.000003s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.62% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.85% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.10% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.91% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001167 13 42.27% : 0.000493s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.90% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.84% : 0.000617s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041509 72 0.14% : 0.000059s : 1: add_recomputation 0.18% : 0.000076s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.84% : 0.000349s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000076s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.02% : 0.007896s : 1: jit_opt_a 0.40% : 0.000167s : 1: jit_opt_after_cconv 0.15% : 0.000060s : 1: jit_opt_b 1.21% : 0.000503s : 1: loop_unroll 1.98% : 0.000820s : 1: mutable_eliminate 2.81% : 0.001168s : 26: opt.transform.jit_opt_a 0.13% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.29% : 0.000537s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000172s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 2.54% : 0.001056s : 1: renormalize.infer 1.54% : 0.000638s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000099s : 1: rewriter_before_opt_a 0.21% : 0.000087s : 1: symbol_engine_optimizer 65.89% : 0.027348s : 1: type_inference TotalTime = 0.162005, [30] [bootstrap]: 0.00026754 [type_inference]: 0.129666 [event_method]: 0.00063557 [auto_monad]: 0.00013866 [graph_reusing]: 7.48e-06 [pre_auto_parallel]: 3.16999e-06 [py_interpret_to_execute]: 3.973e-05 [rewriter_before_opt_a]: 0.00013954 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.0284238, [3] [Cycle 1]: 0.0195914, [27] [switch_simplify]: 8.785e-05 [loop_unroll]: 5.088e-05 [a_1]: 0.00111788 [with_stream_mark]: 3.074e-05 [recompute_prepare]: 2.344e-05 [updatestate_depend_eliminate]: 1.021e-05 [updatestate_assign_eliminate]: 7.32997e-06 [updatestate_loads_eliminate]: 7.10998e-06 [parameter_eliminate]: 3.03e-06 [specialize_transform]: 1.493e-05 [updatestate_useless_node_eliminater]: 1.379e-05 [accelerated_algorithm]: 1.446e-05 [meta_shard_fg_expand]: 4.44002e-06 [get_grad_eliminate_]: 1.436e-05 [merge_forward]: 9.97999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.086e-05 [j_node_and_user_rematch]: 2.545e-05 [meta_fg_expand]: 0.00205091 [replace_old_param]: 8.949e-05 [inline_without_move]: 6.909e-05 [renormalize]: 0.0150349 [add_forward_monad_depend]: 1.682e-05 [auto_monad_grad]: 7.13e-06 [auto_monad_eliminator]: 7.349e-05 [cse]: 0.00033402 [replace_applicator]: 0.00010868 [Cycle 2]: 0.0049553, [27] [switch_simplify]: 4.551e-05 [loop_unroll]: 4.339e-05 [a_1]: 0.00148906 [with_stream_mark]: 3.134e-05 [recompute_prepare]: 1.848e-05 [updatestate_depend_eliminate]: 6.71999e-06 [updatestate_assign_eliminate]: 4.07e-06 [updatestate_loads_eliminate]: 5.37001e-06 [parameter_eliminate]: 3.16999e-06 [specialize_transform]: 1.114e-05 [updatestate_useless_node_eliminater]: 7.48999e-06 [accelerated_algorithm]: 8.88002e-06 [meta_shard_fg_expand]: 5.60001e-06 [get_grad_eliminate_]: 7.16001e-06 [merge_forward]: 4.96997e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.563e-05 [j_node_and_user_rematch]: 1.55e-05 [meta_fg_expand]: 0.00026991 [replace_old_param]: 1.839e-05 [inline_without_move]: 8.64003e-06 [renormalize]: 0.00256327 [add_forward_monad_depend]: 1.102e-05 [auto_monad_grad]: 2.10002e-06 [auto_monad_eliminator]: 1.973e-05 [cse]: 3.088e-05 [replace_applicator]: 2.075e-05 [Cycle 3]: 0.00029715, [27] [switch_simplify]: 4.64002e-06 [loop_unroll]: 5.35999e-06 [a_1]: 5.475e-05 [with_stream_mark]: 1.483e-05 [recompute_prepare]: 4.13001e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 1.77999e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 3.97e-06 [updatestate_useless_node_eliminater]: 3.25e-06 [accelerated_algorithm]: 4.22e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 3.28e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 6.76e-06 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 3.67998e-06 [inline_without_move]: 3.70003e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 4.13001e-06 [cse]: 1.008e-05 [replace_applicator]: 3.78999e-06 [py_interpret_to_execute_after_opt_a]: 1.61e-05 [rewriter_after_opt_a]: 4.156e-05 [convert_after_rewriter]: 6.09999e-06 [order_py_execute_after_rewriter]: 4.30999e-06 [mutable_eliminate]: 0.00080834 [jit_opt_b]: 4.958e-05, [1] [Cycle 1]: 4.085e-05, [2] [frontend_op_eliminate]: 1.224e-05 [inline_after_opt_a]: 1.35e-05 [cconv]: 3.35e-05 [loop_unroll]: 0.00053244 [jit_opt_after_cconv]: 0.00015902, [1] [Cycle 1]: 0.00015163, [11] [c_1]: 1.654e-05 [parameter_eliminate]: 5.21998e-06 [updatestate_depend_eliminate]: 7.94002e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 2.875e-05 [call_graph_tuple_transform]: 1.964e-05 [tuple_list_get_item_eliminator]: 3.60998e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 3.61999e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 5.94999e-06 [add_recomputation]: 3.963e-05 [cse_after_recomputation]: 2.169e-05, [1] [Cycle 1]: 1.465e-05, [1] [cse]: 7.74002e-06 [auto_monad_reorder]: 1.395e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 6.93e-06 [opt_after_jit_grad]: 0.00051411 [symbol_engine_optimizer]: 7.723e-05, [1] [Cycle 1]: 6.891e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 7.95998e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 4.94e-06 [fold_const_symbol]: 8.03999e-06 [renormalize]: 2.80008e-07 [validate]: 9.181e-05 Sums bootstrap : 0.000268s : 0.17% type_inference : 0.129666s : 82.43% event_method : 0.000636s : 0.40% auto_monad : 0.000139s : 0.09% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000140s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000138s : 0.09% jit_opt_a.loop_unroll : 0.000100s : 0.06% jit_opt_a.a_1 : 0.002662s : 1.69% jit_opt_a.with_stream_mark : 0.000077s : 0.05% jit_opt_a.recompute_prepare : 0.000046s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.00% jit_opt_a.specialize_transform : 0.000030s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000012s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000073s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.002324s : 1.48% jit_opt_a.replace_old_param : 0.000112s : 0.07% jit_opt_a.inline_without_move : 0.000081s : 0.05% jit_opt_a.renormalize : 0.017598s : 11.19% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000097s : 0.06% jit_opt_a.cse : 0.000375s : 0.24% jit_opt_a.replace_applicator : 0.000133s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000808s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000532s : 0.34% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.00% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000514s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000092s : 0.06% Time group info: ------[substitution.] 0.000782 104 0.21% : 0.000002s : 1: substitution.elim_not_effective 0.33% : 0.000003s : 1: substitution.fold_const_symbol 0.63% : 0.000005s : 1: substitution.graph_param_transform 68.38% : 0.000534s : 13: substitution.inline 2.96% : 0.000023s : 2: substitution.inline_without_move 1.33% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.90% : 0.000015s : 7: substitution.minmaximum_grad 1.14% : 0.000009s : 5: substitution.partial_eliminate 1.55% : 0.000012s : 12: substitution.remove_not_recompute_node 5.65% : 0.000044s : 10: substitution.replace_applicator 1.69% : 0.000013s : 10: substitution.replace_old_param 0.38% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.94% : 0.000007s : 1: substitution.tile_eliminate 3.55% : 0.000028s : 7: substitution.tuple_list_convert_item_index_to_positive 2.28% : 0.000018s : 7: substitution.tuple_list_get_item_depend_reorder 7.07% : 0.000055s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129554 2 96.50% : 0.125020s : 1: type_inference.infer 3.50% : 0.004534s : 1: type_inference.specialize ------[replace.] 0.000239 20 66.05% : 0.000158s : 13: replace.inline 33.95% : 0.000081s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000554 20 94.69% : 0.000525s : 13: match.inline 5.31% : 0.000029s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000420 2544 1.37% : 0.000006s : 44: predicate.accumulaten_eliminater 0.37% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000006s : 44: predicate.addn_check_dump 1.69% : 0.000007s : 44: predicate.addn_zero_filter 1.91% : 0.000008s : 44: predicate.arithmetic_simplify 1.44% : 0.000006s : 44: predicate.cast_eliminate 0.13% : 0.000001s : 1: predicate.check_bprop_eliminate 1.44% : 0.000006s : 44: predicate.compare_switch_simplify 1.65% : 0.000007s : 44: predicate.depend_value_elim 1.33% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.37% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.32% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.31% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.25% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.28% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.32% : 0.000006s : 44: predicate.environ_get_depend_swap 1.79% : 0.000007s : 44: predicate.environ_get_eliminate 1.68% : 0.000007s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.70% : 0.000003s : 17: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.58% : 0.000019s : 66: predicate.inline 2.05% : 0.000009s : 45: predicate.inline_without_move 0.31% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.16% : 0.000005s : 17: predicate.less_batch_normalization 1.84% : 0.000008s : 51: predicate.list_to_tuple_eliminator_ 1.75% : 0.000007s : 52: predicate.load_eliminater 0.54% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.33% : 0.000014s : 92: predicate.loop_unroll_before_grad 2.13% : 0.000009s : 45: predicate.make_slice_get_slice_eliminator 1.44% : 0.000006s : 44: predicate.merge_addn 1.71% : 0.000007s : 44: predicate.minmaximum_grad 0.94% : 0.000004s : 1: predicate.mutable_eliminate 0.19% : 0.000001s : 1: predicate.opt_reshape 2.16% : 0.000009s : 52: predicate.partial_eliminate 1.39% : 0.000006s : 44: predicate.print_const_string_wrapper 2.15% : 0.000009s : 44: predicate.reduce_eliminate 2.06% : 0.000009s : 51: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000003s : 17: predicate.remove_not_recompute_node 2.73% : 0.000011s : 96: predicate.replace_applicator 1.23% : 0.000005s : 45: predicate.replace_old_param 0.13% : 0.000001s : 1: predicate.reset_defer_inline 1.45% : 0.000006s : 44: predicate.reshape_eliminate 1.43% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.41% : 0.000006s : 44: predicate.same_eliminate 0.40% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.68% : 0.000003s : 17: predicate.specialize_transform 1.70% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.63% : 0.000015s : 64: predicate.switch_defer_inline 2.34% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.15% : 0.000026s : 157: predicate.switch_simplify 1.60% : 0.000007s : 44: predicate.tile_eliminate 1.61% : 0.000007s : 44: predicate.transpose_eliminate 1.95% : 0.000008s : 44: predicate.tuple_list_convert_item_index_to_positive 1.82% : 0.000008s : 44: predicate.tuple_list_get_item_depend_reorder 3.16% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 2.06% : 0.000009s : 44: predicate.tuple_list_set_item_eliminator 1.68% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.60% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.66% : 0.000011s : 69: predicate.updatestate_useless_node_eliminater 1.73% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004500 45 68.49% : 0.003082s : 28: func_graph_cloner_run.FuncGraphClonerGraph 31.51% : 0.001418s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.182988 87 0.02% : 0.000043s : 1: add_recomputation 0.08% : 0.000149s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.16% : 0.000294s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.35% : 0.000646s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.54% : 0.028428s : 1: jit_opt_a 0.09% : 0.000162s : 1: jit_opt_after_cconv 0.03% : 0.000053s : 1: jit_opt_b 0.30% : 0.000546s : 1: loop_unroll 0.45% : 0.000825s : 1: mutable_eliminate 1.88% : 0.003432s : 39: opt.transform.jit_opt_a 0.02% : 0.000040s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000525s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.95% : 0.014541s : 2: renormalize.infer 1.65% : 0.003028s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000143s : 1: rewriter_before_opt_a 0.04% : 0.000080s : 1: symbol_engine_optimizer 70.87% : 0.129685s : 1: type_inference TotalTime = 0.333519, [30] [bootstrap]: 0.00045099 [type_inference]: 0.319242 [event_method]: 0.00048378 [auto_monad]: 0.00016414 [graph_reusing]: 1.151e-05 [pre_auto_parallel]: 4.15e-06 [py_interpret_to_execute]: 5.863e-05 [rewriter_before_opt_a]: 0.00019314 [expand_dump_flag]: 4.73001e-06 [jit_opt_a]: 0.0102075, [2] [Cycle 1]: 0.00532674, [27] [switch_simplify]: 0.00022988 [loop_unroll]: 6.607e-05 [a_1]: 0.00199193 [with_stream_mark]: 2.339e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 4.89998e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 9.68002e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00264534 [add_forward_monad_depend]: 6.87002e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.558e-05 [cse]: 3.148e-05 [replace_applicator]: 1.452e-05 [Cycle 2]: 0.00032459, [27] [switch_simplify]: 5.84999e-06 [loop_unroll]: 4.92e-06 [a_1]: 9.69e-05 [with_stream_mark]: 1.151e-05 [recompute_prepare]: 4.70999e-06 [updatestate_depend_eliminate]: 2.83998e-06 [updatestate_assign_eliminate]: 1.96e-06 [updatestate_loads_eliminate]: 1.85001e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 4.86002e-06 [accelerated_algorithm]: 4.96002e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.257e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 4.53999e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 4.75001e-06 [cse]: 9.63002e-06 [replace_applicator]: 4.77e-06 [py_interpret_to_execute_after_opt_a]: 1.289e-05 [rewriter_after_opt_a]: 4.276e-05 [convert_after_rewriter]: 7.76001e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.0007169 [jit_opt_b]: 5.128e-05, [1] [Cycle 1]: 4.389e-05, [2] [frontend_op_eliminate]: 1.749e-05 [inline_after_opt_a]: 1.542e-05 [cconv]: 2.559e-05 [loop_unroll]: 0.00044551 [jit_opt_after_cconv]: 0.00014934, [1] [Cycle 1]: 0.00014276, [11] [c_1]: 2.244e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.39998e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 1.89999e-06 [cse]: 1.931e-05 [call_graph_tuple_transform]: 2.111e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.452e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.42001e-06 [add_recomputation]: 5.164e-05 [cse_after_recomputation]: 2.069e-05, [1] [Cycle 1]: 1.491e-05, [1] [cse]: 8.97e-06 [auto_monad_reorder]: 1.496e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00047882 [symbol_engine_optimizer]: 0.00018254, [1] [Cycle 1]: 0.00014189, [6] [build]: 3.46999e-06 [elim_shapecalc]: 7.66001e-06 [elim_not_effective]: 1.219e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 8.289e-05 [renormalize]: 4.50003e-07 [validate]: 9.268e-05 Sums bootstrap : 0.000451s : 0.14% type_inference : 0.319242s : 97.30% event_method : 0.000484s : 0.15% auto_monad : 0.000164s : 0.05% graph_reusing : 0.000012s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000059s : 0.02% rewriter_before_opt_a : 0.000193s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000236s : 0.07% jit_opt_a.loop_unroll : 0.000071s : 0.02% jit_opt_a.a_1 : 0.002089s : 0.64% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000013s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.00% jit_opt_a.accelerated_algorithm : 0.000011s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.00% jit_opt_a.renormalize : 0.002645s : 0.81% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000041s : 0.01% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000717s : 0.22% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.00% cconv : 0.000026s : 0.01% loop_unroll : 0.000446s : 0.14% jit_opt_after_cconv.c_1 : 0.000022s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000052s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.00% auto_monad_reorder : 0.000015s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000479s : 0.15% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000083s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000093s : 0.03% Time group info: ------[substitution.] 0.000996 56 0.20% : 0.000002s : 2: substitution.elim_not_effective 7.53% : 0.000075s : 2: substitution.fold_const_symbol 0.54% : 0.000005s : 3: substitution.graph_param_transform 82.80% : 0.000825s : 15: substitution.inline 0.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.74% : 0.000007s : 4: substitution.minmaximum_grad 0.41% : 0.000004s : 4: substitution.remove_not_recompute_node 0.50% : 0.000005s : 2: substitution.replace_old_param 1.70% : 0.000017s : 4: substitution.switch_simplify 1.33% : 0.000013s : 4: substitution.tuple_list_convert_item_index_to_positive 1.02% : 0.000010s : 4: substitution.tuple_list_get_item_depend_reorder 2.85% : 0.000028s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.319109 2 88.21% : 0.281490s : 1: type_inference.infer 11.79% : 0.037619s : 1: type_inference.specialize ------[replace.] 0.000467 23 53.40% : 0.000250s : 15: replace.inline 16.27% : 0.000076s : 4: replace.switch_simplify 30.33% : 0.000142s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000840 23 97.38% : 0.000818s : 15: match.inline 1.68% : 0.000014s : 4: match.switch_simplify 0.95% : 0.000008s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000225 1341 1.34% : 0.000003s : 21: predicate.accumulaten_eliminater 0.73% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000003s : 21: predicate.addn_check_dump 1.47% : 0.000003s : 21: predicate.addn_zero_filter 1.99% : 0.000004s : 21: predicate.arithmetic_simplify 1.38% : 0.000003s : 21: predicate.cast_eliminate 0.29% : 0.000001s : 3: predicate.check_bprop_eliminate 1.29% : 0.000003s : 21: predicate.compare_switch_simplify 1.29% : 0.000003s : 21: predicate.depend_value_elim 1.34% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.35% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.51% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.49% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.41% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.22% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.25% : 0.000003s : 21: predicate.environ_get_depend_swap 1.33% : 0.000003s : 21: predicate.environ_get_eliminate 1.27% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000002s : 6: predicate.get_grad_eliminate 0.16% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000012s : 46: predicate.inline 0.47% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 1.74% : 0.000004s : 28: predicate.load_eliminater 0.87% : 0.000002s : 3: predicate.loop_unroll_after_grad 5.06% : 0.000011s : 78: predicate.loop_unroll_before_grad 1.99% : 0.000004s : 24: predicate.make_slice_get_slice_eliminator 1.20% : 0.000003s : 21: predicate.merge_addn 1.36% : 0.000003s : 21: predicate.minmaximum_grad 0.98% : 0.000002s : 3: predicate.mutable_eliminate 0.32% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000005s : 28: predicate.partial_eliminate 1.25% : 0.000003s : 21: predicate.print_const_string_wrapper 1.88% : 0.000004s : 21: predicate.reduce_eliminate 1.63% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.33% : 0.000001s : 6: predicate.remove_not_recompute_node 1.50% : 0.000003s : 31: predicate.replace_applicator 0.28% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000003s : 21: predicate.reshape_eliminate 1.52% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000003s : 21: predicate.same_eliminate 0.26% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.58% : 0.000001s : 6: predicate.special_op_eliminate 0.53% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000003s : 21: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.21% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.60% : 0.000008s : 40: predicate.switch_defer_inline 3.01% : 0.000007s : 40: predicate.switch_layer_defer_inline 9.61% : 0.000022s : 129: predicate.switch_simplify 1.36% : 0.000003s : 21: predicate.tile_eliminate 1.55% : 0.000003s : 21: predicate.transpose_eliminate 1.54% : 0.000003s : 21: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000008s : 31: predicate.tuple_list_get_item_eliminator 1.76% : 0.000004s : 21: predicate.tuple_list_set_item_eliminator 1.72% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.68% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.29% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.67% : 0.000004s : 21: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004880 38 56.52% : 0.002758s : 15: func_graph_cloner_run.FuncGraphClonerGraph 10.39% : 0.000507s : 6: func_graph_cloner_run.FuncGraphClonerNode 33.08% : 0.001614s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.338587 72 0.02% : 0.000054s : 1: add_recomputation 0.05% : 0.000172s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.14% : 0.000476s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.15% : 0.000493s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000014s : 1: graph_reusing 3.02% : 0.010213s : 1: jit_opt_a 0.04% : 0.000152s : 1: jit_opt_after_cconv 0.02% : 0.000054s : 1: jit_opt_b 0.13% : 0.000453s : 1: loop_unroll 0.21% : 0.000726s : 1: mutable_eliminate 0.74% : 0.002511s : 26: opt.transform.jit_opt_a 0.02% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000027s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000106s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000062s : 1: py_interpret_to_execute 0.00% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.57% : 0.001935s : 1: renormalize.infer 0.21% : 0.000700s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.06% : 0.000197s : 1: rewriter_before_opt_a 0.05% : 0.000186s : 1: symbol_engine_optimizer 94.29% : 0.319268s : 1: type_inference TotalTime = 0.108332, [30] [bootstrap]: 0.00030398 [type_inference]: 0.0781276 [event_method]: 2.152e-05 [auto_monad]: 7.485e-05 [graph_reusing]: 7.18e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 0.00047632 [rewriter_before_opt_a]: 0.00011269 [expand_dump_flag]: 3.79002e-06 [jit_opt_a]: 0.0270717, [2] [Cycle 1]: 0.00343809, [27] [switch_simplify]: 7.129e-05 [loop_unroll]: 3.481e-05 [a_1]: 0.00073754 [with_stream_mark]: 2.365e-05 [recompute_prepare]: 8.68001e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.46999e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.26998e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.40002e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.46e-06 [renormalize]: 0.00221312 [add_forward_monad_depend]: 6.39001e-06 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 1.575e-05 [cse]: 3.627e-05 [replace_applicator]: 1.325e-05 [Cycle 2]: 0.00036318, [27] [switch_simplify]: 6.59999e-06 [loop_unroll]: 6.02001e-06 [a_1]: 0.00011877 [with_stream_mark]: 9.44e-06 [recompute_prepare]: 5.95002e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.37997e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.56e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.35002e-06 [cse]: 1.455e-05 [replace_applicator]: 6.51999e-06 [py_interpret_to_execute_after_opt_a]: 1.276e-05 [rewriter_after_opt_a]: 4.112e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00052627 [jit_opt_b]: 5.287e-05, [1] [Cycle 1]: 4.593e-05, [2] [frontend_op_eliminate]: 1.793e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 2.439e-05 [loop_unroll]: 0.00042939 [jit_opt_after_cconv]: 0.00015054, [1] [Cycle 1]: 0.0001437, [11] [c_1]: 2.545e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.62001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.116e-05 [call_graph_tuple_transform]: 2.059e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.16998e-06 [remove_dup_value]: 1.73e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 8.22998e-06 [add_recomputation]: 5.057e-05 [cse_after_recomputation]: 2.42e-05, [1] [Cycle 1]: 1.898e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.866e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 4.18001e-06 [opt_after_jit_grad]: 0.00043873 [symbol_engine_optimizer]: 7.32e-05, [1] [Cycle 1]: 6.726e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 6.21998e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 4.00003e-07 [validate]: 5.392e-05 Sums bootstrap : 0.000304s : 0.36% type_inference : 0.078128s : 92.49% event_method : 0.000022s : 0.03% auto_monad : 0.000075s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000476s : 0.56% rewriter_before_opt_a : 0.000113s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000856s : 1.01% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002213s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000051s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000526s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.03% loop_unroll : 0.000429s : 0.51% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000439s : 0.52% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.06% Time group info: ------[substitution.] 0.000304 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000006s : 4: substitution.graph_param_transform 88.81% : 0.000270s : 5: substitution.inline 1.05% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000005s : 4: substitution.remove_not_recompute_node 1.29% : 0.000004s : 2: substitution.replace_old_param 4.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.078021 2 95.57% : 0.074562s : 1: type_inference.infer 4.43% : 0.003459s : 1: type_inference.specialize ------[replace.] 0.000105 7 70.84% : 0.000075s : 5: replace.inline 29.16% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 7 95.77% : 0.000267s : 5: match.inline 4.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 888 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 13: predicate.addn_check_dump 1.17% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000002s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.90% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.23% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 19: predicate.partial_eliminate 1.51% : 0.000002s : 13: predicate.print_const_string_wrapper 1.58% : 0.000002s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.40% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 65: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.15% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002875 29 67.43% : 0.001939s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.49% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.08% : 0.000836s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111705 72 0.05% : 0.000054s : 1: add_recomputation 0.07% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.29% : 0.000323s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 24.24% : 0.027075s : 1: jit_opt_a 0.14% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.39% : 0.000438s : 1: loop_unroll 0.48% : 0.000535s : 1: mutable_eliminate 0.99% : 0.001110s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000446s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000485s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.36% : 0.001522s : 1: renormalize.infer 0.61% : 0.000681s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.11% : 0.000117s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 69.96% : 0.078144s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.764.080 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00658b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.764.774 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0651543, [30] [bootstrap]: 0.00027489 [type_inference]: 0.057071 [event_method]: 2.456e-05 [auto_monad]: 7.487e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 0.00010378 [rewriter_before_opt_a]: 8.271e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.00548057, [2] [Cycle 1]: 0.0018016, [27] [switch_simplify]: 5.269e-05 [loop_unroll]: 2.807e-05 [a_1]: 0.00053194 [with_stream_mark]: 2.046e-05 [recompute_prepare]: 7.49002e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 0.00084902 [add_forward_monad_depend]: 5.47999e-06 [auto_monad_grad]: 1.82001e-06 [auto_monad_eliminator]: 1.415e-05 [cse]: 3.487e-05 [replace_applicator]: 1.156e-05 [Cycle 2]: 0.00031308, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.67999e-06 [a_1]: 9.107e-05 [with_stream_mark]: 8.63001e-06 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 2.65002e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.05001e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 3.10998e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 7.72998e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 6.96001e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.09989e-07 [auto_monad_grad]: 1.13001e-06 [auto_monad_eliminator]: 5.50001e-06 [cse]: 1.123e-05 [replace_applicator]: 4.95999e-06 [py_interpret_to_execute_after_opt_a]: 1.027e-05 [rewriter_after_opt_a]: 3.533e-05 [convert_after_rewriter]: 6.68998e-06 [order_py_execute_after_rewriter]: 5.59998e-06 [mutable_eliminate]: 0.00048087 [jit_opt_b]: 4.777e-05, [1] [Cycle 1]: 4.12e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.538e-05 [cconv]: 2.567e-05 [loop_unroll]: 0.00040703 [jit_opt_after_cconv]: 0.00014385, [1] [Cycle 1]: 0.00013744, [11] [c_1]: 2.059e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 6.63998e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.179e-05 [call_graph_tuple_transform]: 1.889e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.594e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 5.36998e-06 [add_recomputation]: 5.122e-05 [cse_after_recomputation]: 2.397e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.263e-05 [auto_monad_reorder]: 1.871e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 4.31002e-06 [opt_after_jit_grad]: 0.00044229 [symbol_engine_optimizer]: 7.015e-05, [1] [Cycle 1]: 6.418e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 7.10998e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.38002e-06 [fold_const_symbol]: 9.05999e-06 [renormalize]: 3.10014e-07 [validate]: 3.959e-05 Sums bootstrap : 0.000275s : 0.45% type_inference : 0.057071s : 93.24% event_method : 0.000025s : 0.04% auto_monad : 0.000075s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000104s : 0.17% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.10% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000623s : 1.02% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000849s : 1.39% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000046s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000481s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000407s : 0.66% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000442s : 0.72% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.06% Time group info: ------[substitution.] 0.000216 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 3: substitution.graph_param_transform 85.84% : 0.000185s : 4: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000004s : 4: substitution.remove_not_recompute_node 1.56% : 0.000003s : 2: substitution.replace_old_param 5.06% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056979 2 36.68% : 0.020901s : 1: type_inference.infer 63.32% : 0.036078s : 1: type_inference.specialize ------[replace.] 0.000067 6 69.63% : 0.000047s : 4: replace.inline 30.37% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 94.92% : 0.000183s : 4: match.inline 5.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.21% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.01% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000706 13 46.88% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.31% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.81% : 0.000324s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066867 72 0.08% : 0.000054s : 1: add_recomputation 0.12% : 0.000078s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.44% : 0.000292s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.20% : 0.005483s : 1: jit_opt_a 0.22% : 0.000147s : 1: jit_opt_after_cconv 0.08% : 0.000050s : 1: jit_opt_b 0.62% : 0.000415s : 1: loop_unroll 0.73% : 0.000489s : 1: mutable_eliminate 1.24% : 0.000827s : 26: opt.transform.jit_opt_a 0.07% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000450s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000107s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.77% : 0.000514s : 1: renormalize.infer 0.49% : 0.000328s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.11% : 0.000073s : 1: symbol_engine_optimizer 85.39% : 0.057097s : 1: type_inference TotalTime = 0.159573, [30] [bootstrap]: 0.00026549 [type_inference]: 0.126706 [event_method]: 0.00056329 [auto_monad]: 0.00011689 [graph_reusing]: 8.10999e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 3.967e-05 [rewriter_before_opt_a]: 0.00012663 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.0291199, [3] [Cycle 1]: 0.0198686, [27] [switch_simplify]: 9.678e-05 [loop_unroll]: 4.746e-05 [a_1]: 0.00120961 [with_stream_mark]: 3.805e-05 [recompute_prepare]: 2.358e-05 [updatestate_depend_eliminate]: 1.122e-05 [updatestate_assign_eliminate]: 7.1e-06 [updatestate_loads_eliminate]: 6.86001e-06 [parameter_eliminate]: 3.12002e-06 [specialize_transform]: 1.715e-05 [updatestate_useless_node_eliminater]: 1.463e-05 [accelerated_algorithm]: 1.391e-05 [meta_shard_fg_expand]: 3.68e-06 [get_grad_eliminate_]: 1.458e-05 [merge_forward]: 1.053e-05 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.876e-05 [j_node_and_user_rematch]: 2.603e-05 [meta_fg_expand]: 0.00221896 [replace_old_param]: 7.652e-05 [inline_without_move]: 6.77e-05 [renormalize]: 0.0151247 [add_forward_monad_depend]: 1.57e-05 [auto_monad_grad]: 7.83999e-06 [auto_monad_eliminator]: 7.052e-05 [cse]: 0.00031856 [replace_applicator]: 0.00010333 [Cycle 2]: 0.00514486, [27] [switch_simplify]: 4.527e-05 [loop_unroll]: 4.496e-05 [a_1]: 0.00141092 [with_stream_mark]: 2.581e-05 [recompute_prepare]: 1.276e-05 [updatestate_depend_eliminate]: 7.2e-06 [updatestate_assign_eliminate]: 4.20999e-06 [updatestate_loads_eliminate]: 3.98001e-06 [parameter_eliminate]: 2.60002e-06 [specialize_transform]: 9.33002e-06 [updatestate_useless_node_eliminater]: 9.40001e-06 [accelerated_algorithm]: 9.46e-06 [meta_shard_fg_expand]: 3.23e-06 [get_grad_eliminate_]: 8.47e-06 [merge_forward]: 6.41e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.212e-05 [j_node_and_user_rematch]: 1.538e-05 [meta_fg_expand]: 0.00022349 [replace_old_param]: 1.286e-05 [inline_without_move]: 9.59e-06 [renormalize]: 0.00295515 [add_forward_monad_depend]: 1.054e-05 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.666e-05 [cse]: 3.268e-05 [replace_applicator]: 2.127e-05 [Cycle 3]: 0.00031312, [27] [switch_simplify]: 5.02e-06 [loop_unroll]: 4.05998e-06 [a_1]: 6.128e-05 [with_stream_mark]: 1.594e-05 [recompute_prepare]: 4.70001e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 1.74e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 3.56999e-06 [updatestate_useless_node_eliminater]: 3.37002e-06 [accelerated_algorithm]: 4.79e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 3.83001e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.49999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 6.36e-06 [meta_fg_expand]: 3.00998e-06 [replace_old_param]: 3.97e-06 [inline_without_move]: 3.35003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.64001e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 4.85999e-06 [cse]: 9.64e-06 [replace_applicator]: 4.45e-06 [py_interpret_to_execute_after_opt_a]: 1.647e-05 [rewriter_after_opt_a]: 4.173e-05 [convert_after_rewriter]: 6.69999e-06 [order_py_execute_after_rewriter]: 4.21001e-06 [mutable_eliminate]: 0.00079343 [jit_opt_b]: 4.948e-05, [1] [Cycle 1]: 4.001e-05, [2] [frontend_op_eliminate]: 1.38e-05 [inline_after_opt_a]: 1.299e-05 [cconv]: 3.002e-05 [loop_unroll]: 0.0005109 [jit_opt_after_cconv]: 0.00015212, [1] [Cycle 1]: 0.00014523, [11] [c_1]: 1.472e-05 [parameter_eliminate]: 4.75999e-06 [updatestate_depend_eliminate]: 7.41001e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.68998e-06 [cse]: 2.662e-05 [call_graph_tuple_transform]: 1.741e-05 [tuple_list_get_item_eliminator]: 5.19e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 4.43001e-06 [remove_dup_value]: 1.712e-05 [partial_unused_args_eliminate]: 1.97999e-06 [environ_conv]: 5.55001e-06 [add_recomputation]: 4.417e-05 [cse_after_recomputation]: 2.263e-05, [1] [Cycle 1]: 1.708e-05, [1] [cse]: 8.75001e-06 [auto_monad_reorder]: 1.406e-05 [get_jit_bprop_graph]: 3.38999e-06 [rewriter_after_jit_bprop_graph]: 8.1e-06 [opt_after_jit_grad]: 0.00053411 [symbol_engine_optimizer]: 7.954e-05, [1] [Cycle 1]: 7.167e-05, [6] [build]: 4.71002e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.332e-05 [opt_reshape]: 5.05001e-06 [fold_const_symbol]: 7.58001e-06 [renormalize]: 9.39996e-07 [validate]: 4.311e-05 Sums bootstrap : 0.000265s : 0.17% type_inference : 0.126706s : 81.87% event_method : 0.000563s : 0.36% auto_monad : 0.000117s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000127s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000147s : 0.10% jit_opt_a.loop_unroll : 0.000096s : 0.06% jit_opt_a.a_1 : 0.002682s : 1.73% jit_opt_a.with_stream_mark : 0.000080s : 0.05% jit_opt_a.recompute_prepare : 0.000041s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000022s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000030s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000021s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.002445s : 1.58% jit_opt_a.replace_old_param : 0.000093s : 0.06% jit_opt_a.inline_without_move : 0.000081s : 0.05% jit_opt_a.renormalize : 0.018080s : 11.68% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000092s : 0.06% jit_opt_a.cse : 0.000361s : 0.23% jit_opt_a.replace_applicator : 0.000129s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000793s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000511s : 0.33% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000044s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000534s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000815 107 0.42% : 0.000003s : 1: substitution.elim_not_effective 0.11% : 0.000001s : 1: substitution.fold_const_symbol 0.67% : 0.000005s : 1: substitution.graph_param_transform 70.07% : 0.000571s : 13: substitution.inline 2.98% : 0.000024s : 2: substitution.inline_without_move 1.33% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.59% : 0.000013s : 7: substitution.minmaximum_grad 1.27% : 0.000010s : 5: substitution.partial_eliminate 1.36% : 0.000011s : 13: substitution.remove_not_recompute_node 5.21% : 0.000042s : 10: substitution.replace_applicator 0.90% : 0.000007s : 10: substitution.replace_old_param 0.96% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.78% : 0.000006s : 1: substitution.tile_eliminate 3.35% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.13% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.43% : 0.000052s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126592 2 96.81% : 0.122555s : 1: type_inference.infer 3.19% : 0.004037s : 1: type_inference.specialize ------[replace.] 0.000244 20 65.29% : 0.000159s : 13: replace.inline 34.71% : 0.000085s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000588 20 95.54% : 0.000562s : 13: match.inline 4.46% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000434 2656 1.53% : 0.000007s : 46: predicate.accumulaten_eliminater 0.29% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 46: predicate.addn_check_dump 1.54% : 0.000007s : 46: predicate.addn_zero_filter 1.77% : 0.000008s : 46: predicate.arithmetic_simplify 1.48% : 0.000006s : 46: predicate.cast_eliminate 0.13% : 0.000001s : 1: predicate.check_bprop_eliminate 1.36% : 0.000006s : 46: predicate.compare_switch_simplify 1.36% : 0.000006s : 46: predicate.depend_value_elim 1.29% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.54% : 0.000007s : 46: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.12% : 0.000001s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.28% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 46: predicate.environ_get_depend_swap 5.24% : 0.000023s : 46: predicate.environ_get_eliminate 1.35% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.86% : 0.000004s : 19: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.27% : 0.000019s : 68: predicate.inline 2.01% : 0.000009s : 47: predicate.inline_without_move 0.32% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.10% : 0.000005s : 19: predicate.less_batch_normalization 1.68% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.61% : 0.000007s : 54: predicate.load_eliminater 0.55% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.30% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.32% : 0.000006s : 46: predicate.merge_addn 1.41% : 0.000006s : 46: predicate.minmaximum_grad 0.63% : 0.000003s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.14% : 0.000009s : 54: predicate.partial_eliminate 1.45% : 0.000006s : 46: predicate.print_const_string_wrapper 1.87% : 0.000008s : 46: predicate.reduce_eliminate 1.71% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000002s : 19: predicate.remove_not_recompute_node 2.81% : 0.000012s : 100: predicate.replace_applicator 1.05% : 0.000005s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000007s : 46: predicate.reshape_eliminate 1.56% : 0.000007s : 46: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 1: predicate.row_tensor_eliminate 1.36% : 0.000006s : 46: predicate.same_eliminate 0.46% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 2: predicate.special_op_eliminate 0.72% : 0.000003s : 19: predicate.specialize_transform 1.75% : 0.000008s : 46: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000007s : 46: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.13% : 0.000014s : 66: predicate.switch_defer_inline 2.35% : 0.000010s : 66: predicate.switch_layer_defer_inline 5.76% : 0.000025s : 161: predicate.switch_simplify 1.61% : 0.000007s : 46: predicate.tile_eliminate 1.45% : 0.000006s : 46: predicate.transpose_eliminate 1.90% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.64% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000015s : 55: predicate.tuple_list_get_item_eliminator 1.80% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.67% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 2.20% : 0.000010s : 54: predicate.updatestate_pure_node_eliminater 2.54% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.87% : 0.000008s : 46: predicate.value_based_eliminate 0.03% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004495 45 71.91% : 0.003233s : 28: func_graph_cloner_run.FuncGraphClonerGraph 28.09% : 0.001263s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.181080 87 0.03% : 0.000048s : 1: add_recomputation 0.07% : 0.000123s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.16% : 0.000294s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.32% : 0.000572s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 16.08% : 0.029125s : 1: jit_opt_a 0.09% : 0.000156s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.29% : 0.000522s : 1: loop_unroll 0.45% : 0.000808s : 1: mutable_eliminate 1.90% : 0.003438s : 39: opt.transform.jit_opt_a 0.02% : 0.000038s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000544s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 8.17% : 0.014795s : 2: renormalize.infer 1.80% : 0.003257s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.07% : 0.000130s : 1: rewriter_before_opt_a 0.05% : 0.000082s : 1: symbol_engine_optimizer 69.99% : 0.126730s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.946.302 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00659d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:22.947.068 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0426172, [30] [bootstrap]: 0.00025784 [type_inference]: 0.0338193 [event_method]: 2.22e-05 [auto_monad]: 7.131e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00015535 [rewriter_before_opt_a]: 8.357e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.00598929, [2] [Cycle 1]: 0.00217976, [27] [switch_simplify]: 5.621e-05 [loop_unroll]: 3.025e-05 [a_1]: 0.00061448 [with_stream_mark]: 2.279e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 2.08998e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 8.95001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 0.00111315 [add_forward_monad_depend]: 6.13998e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.598e-05 [cse]: 3.421e-05 [replace_applicator]: 1.293e-05 [Cycle 2]: 0.00032326, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.107e-05 [with_stream_mark]: 9.46e-06 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 4.95999e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 8.07998e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 1.10999e-06 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.283e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 3.841e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00058792 [jit_opt_b]: 5.235e-05, [1] [Cycle 1]: 4.424e-05, [2] [frontend_op_eliminate]: 1.727e-05 [inline_after_opt_a]: 1.625e-05 [cconv]: 2.562e-05 [loop_unroll]: 0.00042123 [jit_opt_after_cconv]: 0.00014472, [1] [Cycle 1]: 0.00013871, [11] [c_1]: 2.114e-05 [parameter_eliminate]: 2.51998e-06 [updatestate_depend_eliminate]: 6.54999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.312e-05 [call_graph_tuple_transform]: 1.866e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 1.604e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 5.132e-05 [cse_after_recomputation]: 2.196e-05, [1] [Cycle 1]: 1.712e-05, [1] [cse]: 1.161e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 4.71002e-06 [opt_after_jit_grad]: 0.00048973 [symbol_engine_optimizer]: 7.437e-05, [1] [Cycle 1]: 6.769e-05, [6] [build]: 3.64002e-06 [elim_shapecalc]: 7.92003e-06 [elim_not_effective]: 1.314e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 4.59986e-07 [validate]: 4.101e-05 Sums bootstrap : 0.000258s : 0.67% type_inference : 0.033819s : 87.75% event_method : 0.000022s : 0.06% auto_monad : 0.000071s : 0.19% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000155s : 0.40% rewriter_before_opt_a : 0.000084s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000706s : 1.83% jit_opt_a.with_stream_mark : 0.000032s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001113s : 2.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000047s : 0.12% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000038s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000588s : 1.53% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.07% loop_unroll : 0.000421s : 1.09% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000490s : 1.27% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.11% Time group info: ------[substitution.] 0.000272 23 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000006s : 3: substitution.graph_param_transform 87.87% : 0.000239s : 4: substitution.inline 1.05% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.55% : 0.000004s : 2: substitution.replace_old_param 4.54% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033736 2 89.04% : 0.030037s : 1: type_inference.infer 10.96% : 0.003699s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.31% : 0.000052s : 4: replace.inline 30.69% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 6 95.47% : 0.000236s : 4: match.inline 4.53% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 2.05% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.76% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.98% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 2.02% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 2.26% : 0.000003s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.46% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000993 13 49.20% : 0.000488s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.55% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.25% : 0.000459s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044705 72 0.12% : 0.000054s : 1: add_recomputation 0.17% : 0.000075s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.62% : 0.000276s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.41% : 0.005993s : 1: jit_opt_a 0.33% : 0.000147s : 1: jit_opt_after_cconv 0.12% : 0.000055s : 1: jit_opt_b 0.96% : 0.000430s : 1: loop_unroll 1.34% : 0.000597s : 1: mutable_eliminate 2.07% : 0.000923s : 26: opt.transform.jit_opt_a 0.11% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.12% : 0.000498s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000160s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.49% : 0.000668s : 1: renormalize.infer 0.98% : 0.000437s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000041s : 1: rewriter_after_opt_a 0.20% : 0.000088s : 1: rewriter_before_opt_a 0.17% : 0.000077s : 1: symbol_engine_optimizer 75.69% : 0.033839s : 1: type_inference TotalTime = 0.301893, [30] [bootstrap]: 0.00036847 [type_inference]: 0.286085 [event_method]: 1.836e-05 [auto_monad]: 5.112e-05 [graph_reusing]: 4.25e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 0.0004433 [rewriter_before_opt_a]: 7.726e-05 [expand_dump_flag]: 2.51e-06 [jit_opt_a]: 0.00806471, [2] [Cycle 1]: 0.00398215, [27] [switch_simplify]: 6.015e-05 [loop_unroll]: 3.168e-05 [a_1]: 0.0006449 [with_stream_mark]: 2.546e-05 [recompute_prepare]: 1.159e-05 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 8.03001e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.656e-05 [j_node_and_user_rematch]: 1.14e-05 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 6.73998e-06 [renormalize]: 0.00280525 [add_forward_monad_depend]: 9.24e-06 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 2.082e-05 [cse]: 3.244e-05 [replace_applicator]: 2.348e-05 [Cycle 2]: 0.00041457, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00012605 [with_stream_mark]: 1.762e-05 [recompute_prepare]: 6.98e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 2.40002e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 6.05002e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 3.45e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.708e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.80997e-06 [replace_old_param]: 1.048e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 9.41998e-06 [cse]: 1.635e-05 [replace_applicator]: 7.44002e-06 [py_interpret_to_execute_after_opt_a]: 1.585e-05 [rewriter_after_opt_a]: 4.279e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00074434 [jit_opt_b]: 6.221e-05, [1] [Cycle 1]: 5.27e-05, [2] [frontend_op_eliminate]: 2.027e-05 [inline_after_opt_a]: 1.851e-05 [cconv]: 3.216e-05 [loop_unroll]: 0.00050719 [jit_opt_after_cconv]: 0.00017456, [1] [Cycle 1]: 0.0001664, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 8.25e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.923e-05 [call_graph_tuple_transform]: 2.617e-05 [tuple_list_get_item_eliminator]: 6.94001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.97002e-06 [remove_dup_value]: 1.66e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 9.64999e-06 [add_recomputation]: 0.00010323 [cse_after_recomputation]: 2.894e-05, [1] [Cycle 1]: 2.194e-05, [1] [cse]: 1.453e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 6.44999e-06 [opt_after_jit_grad]: 0.00448944 [symbol_engine_optimizer]: 0.00021941, [1] [Cycle 1]: 8.543e-05, [6] [build]: 6.40002e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.933e-05 [opt_reshape]: 1.061e-05 [fold_const_symbol]: 9.54e-06 [renormalize]: 1.15001e-06 [validate]: 5.807e-05 Sums bootstrap : 0.000368s : 0.12% type_inference : 0.286085s : 96.20% event_method : 0.000018s : 0.01% auto_monad : 0.000051s : 0.02% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000443s : 0.15% rewriter_before_opt_a : 0.000077s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000771s : 0.26% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002805s : 0.94% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000049s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000744s : 0.25% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000507s : 0.17% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000103s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.004489s : 1.51% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.02% Time group info: ------[substitution.] 0.000259 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 4: substitution.graph_param_transform 83.83% : 0.000217s : 4: substitution.inline 2.04% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000006s : 4: substitution.remove_not_recompute_node 2.81% : 0.000007s : 2: substitution.replace_old_param 5.30% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.286007 2 98.99% : 0.283120s : 1: type_inference.infer 1.01% : 0.002887s : 1: type_inference.specialize ------[replace.] 0.000079 6 65.73% : 0.000052s : 4: replace.inline 34.27% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.57% : 0.000215s : 4: match.inline 5.43% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 2.08% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.40% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.05% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.60% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 8: predicate.less_batch_normalization 1.16% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.89% : 0.000003s : 4: predicate.mutable_eliminate 0.77% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.04% : 0.000002s : 12: predicate.reshape_eliminate 1.06% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.81% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.03% : 0.000004s : 18: predicate.switch_defer_inline 2.38% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.11% : 0.000002s : 12: predicate.transpose_eliminate 1.25% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002236 22 66.26% : 0.001482s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.46% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.29% : 0.000700s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.305815 72 0.04% : 0.000109s : 1: add_recomputation 0.02% : 0.000054s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.13% : 0.000388s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 2.64% : 0.008069s : 1: jit_opt_a 0.06% : 0.000178s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.17% : 0.000519s : 1: loop_unroll 0.25% : 0.000759s : 1: mutable_eliminate 0.34% : 0.001033s : 26: opt.transform.jit_opt_a 0.02% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000045s : 4: opt.transform.symbol_engine_opt 1.47% : 0.004510s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000451s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.65% : 0.001979s : 1: renormalize.infer 0.27% : 0.000814s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.03% : 0.000084s : 1: rewriter_before_opt_a 0.07% : 0.000223s : 1: symbol_engine_optimizer 93.55% : 0.286101s : 1: type_inference TotalTime = 0.0367467, [30] [bootstrap]: 0.00033729 [type_inference]: 0.00464921 [event_method]: 1.938e-05 [auto_monad]: 6.859e-05 [graph_reusing]: 6.56999e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 3.667e-05 [rewriter_before_opt_a]: 7.554e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.0295114, [2] [Cycle 1]: 0.00162543, [27] [switch_simplify]: 5.654e-05 [loop_unroll]: 2.831e-05 [a_1]: 0.0005347 [with_stream_mark]: 2.146e-05 [recompute_prepare]: 7.68001e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 2.36998e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.62998e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00066099 [add_forward_monad_depend]: 5.20001e-06 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.453e-05 [cse]: 3.147e-05 [replace_applicator]: 1.124e-05 [Cycle 2]: 0.00031028, [27] [switch_simplify]: 5.81998e-06 [loop_unroll]: 4.81002e-06 [a_1]: 8.683e-05 [with_stream_mark]: 8.10999e-06 [recompute_prepare]: 4.85001e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.218e-05 [j_node_and_user_rematch]: 7.72998e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 6.73e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.212e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.162e-05 [rewriter_after_opt_a]: 3.725e-05 [convert_after_rewriter]: 6.87002e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00052839 [jit_opt_b]: 4.726e-05, [1] [Cycle 1]: 4.082e-05, [2] [frontend_op_eliminate]: 1.509e-05 [inline_after_opt_a]: 1.51e-05 [cconv]: 2.311e-05 [loop_unroll]: 0.00038897 [jit_opt_after_cconv]: 0.0001414, [1] [Cycle 1]: 0.00013531, [11] [c_1]: 1.967e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 1.941e-05 [call_graph_tuple_transform]: 1.689e-05 [tuple_list_get_item_eliminator]: 1.087e-05 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 3.991e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 5.61003e-06 [add_recomputation]: 4.847e-05 [cse_after_recomputation]: 2.343e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.231e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 4.08999e-06 [opt_after_jit_grad]: 0.00042823 [symbol_engine_optimizer]: 6.899e-05, [1] [Cycle 1]: 6.272e-05, [6] [build]: 3.26999e-06 [elim_shapecalc]: 7.61001e-06 [elim_not_effective]: 1.197e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 8.23001e-06 [renormalize]: 3.69997e-07 [validate]: 3.48e-05 Sums bootstrap : 0.000337s : 3.92% type_inference : 0.004649s : 53.99% event_method : 0.000019s : 0.23% auto_monad : 0.000069s : 0.80% graph_reusing : 0.000007s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.43% rewriter_before_opt_a : 0.000076s : 0.88% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000062s : 0.72% jit_opt_a.loop_unroll : 0.000033s : 0.38% jit_opt_a.a_1 : 0.000622s : 7.22% jit_opt_a.with_stream_mark : 0.000030s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000012s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000661s : 7.68% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000044s : 0.51% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000037s : 0.43% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000528s : 6.14% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000023s : 0.27% loop_unroll : 0.000389s : 4.52% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000011s : 0.13% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000040s : 0.46% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.56% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000018s : 0.21% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000428s : 4.97% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.40% Time group info: ------[substitution.] 0.000206 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000005s : 3: substitution.graph_param_transform 84.93% : 0.000175s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000003s : 2: substitution.replace_old_param 5.60% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004586 2 82.01% : 0.003761s : 1: type_inference.infer 17.99% : 0.000825s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.36% : 0.000044s : 4: replace.inline 32.64% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 94.26% : 0.000172s : 4: match.inline 5.74% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.49% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.77% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.47% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.78% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.87% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000612 13 51.69% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.25% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.06% : 0.000258s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038298 72 0.13% : 0.000051s : 1: add_recomputation 0.19% : 0.000072s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000357s : 1: bootstrap 0.07% : 0.000026s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 77.06% : 0.029514s : 1: jit_opt_a 0.38% : 0.000144s : 1: jit_opt_after_cconv 0.13% : 0.000050s : 1: jit_opt_b 1.04% : 0.000396s : 1: loop_unroll 1.40% : 0.000536s : 1: mutable_eliminate 2.17% : 0.000833s : 26: opt.transform.jit_opt_a 0.13% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.14% : 0.000436s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000039s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000043s : 1: remove_dup_value 0.91% : 0.000348s : 1: renormalize.infer 0.80% : 0.000306s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000040s : 1: rewriter_after_opt_a 0.21% : 0.000080s : 1: rewriter_before_opt_a 0.19% : 0.000072s : 1: symbol_engine_optimizer 12.19% : 0.004670s : 1: type_inference TotalTime = 0.101884, [30] [bootstrap]: 0.0002734 [type_inference]: 0.0692075 [event_method]: 0.00034422 [auto_monad]: 0.00019225 [graph_reusing]: 8.37998e-06 [pre_auto_parallel]: 4.25e-06 [py_interpret_to_execute]: 6.444e-05 [rewriter_before_opt_a]: 0.00014502 [expand_dump_flag]: 4.16001e-06 [jit_opt_a]: 0.0291582, [3] [Cycle 1]: 0.0198894, [27] [switch_simplify]: 9.345e-05 [loop_unroll]: 4.94e-05 [a_1]: 0.00116179 [with_stream_mark]: 4.038e-05 [recompute_prepare]: 2.297e-05 [updatestate_depend_eliminate]: 9.99001e-06 [updatestate_assign_eliminate]: 6.93e-06 [updatestate_loads_eliminate]: 6.74999e-06 [parameter_eliminate]: 3.18e-06 [specialize_transform]: 1.661e-05 [updatestate_useless_node_eliminater]: 1.409e-05 [accelerated_algorithm]: 1.518e-05 [meta_shard_fg_expand]: 4.82e-06 [get_grad_eliminate_]: 1.421e-05 [merge_forward]: 9.25999e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.999e-05 [j_node_and_user_rematch]: 2.565e-05 [meta_fg_expand]: 0.00204686 [replace_old_param]: 8.487e-05 [inline_without_move]: 6.771e-05 [renormalize]: 0.0152949 [add_forward_monad_depend]: 1.869e-05 [auto_monad_grad]: 8.13999e-06 [auto_monad_eliminator]: 7.568e-05 [cse]: 0.00036418 [replace_applicator]: 0.00010513 [Cycle 2]: 0.00489062, [27] [switch_simplify]: 4.812e-05 [loop_unroll]: 4.533e-05 [a_1]: 0.00138109 [with_stream_mark]: 2.427e-05 [recompute_prepare]: 1.368e-05 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 5.03002e-06 [updatestate_loads_eliminate]: 5.37001e-06 [parameter_eliminate]: 2.59001e-06 [specialize_transform]: 1.025e-05 [updatestate_useless_node_eliminater]: 8.97e-06 [accelerated_algorithm]: 9.20999e-06 [meta_shard_fg_expand]: 3.88999e-06 [get_grad_eliminate_]: 8.87999e-06 [merge_forward]: 5.31998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.22e-05 [j_node_and_user_rematch]: 1.316e-05 [meta_fg_expand]: 0.00015625 [replace_old_param]: 1.325e-05 [inline_without_move]: 9.42001e-06 [renormalize]: 0.00280403 [add_forward_monad_depend]: 1.017e-05 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.799e-05 [cse]: 3.083e-05 [replace_applicator]: 2.108e-05 [Cycle 3]: 0.00028796, [27] [switch_simplify]: 5.02e-06 [loop_unroll]: 3.79002e-06 [a_1]: 5.196e-05 [with_stream_mark]: 1.481e-05 [recompute_prepare]: 3.36999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.43998e-06 [updatestate_loads_eliminate]: 1.77999e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 3.53e-06 [updatestate_useless_node_eliminater]: 3.68999e-06 [accelerated_algorithm]: 4.17e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 3.67998e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 3.07997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.571e-05 [j_node_and_user_rematch]: 6.51e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 3.83001e-06 [inline_without_move]: 2.88998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 4.4e-06 [cse]: 9.62999e-06 [replace_applicator]: 3.76999e-06 [py_interpret_to_execute_after_opt_a]: 1.575e-05 [rewriter_after_opt_a]: 3.862e-05 [convert_after_rewriter]: 6.26998e-06 [order_py_execute_after_rewriter]: 4.58999e-06 [mutable_eliminate]: 0.00077825 [jit_opt_b]: 4.918e-05, [1] [Cycle 1]: 4.07e-05, [2] [frontend_op_eliminate]: 1.296e-05 [inline_after_opt_a]: 1.347e-05 [cconv]: 3.098e-05 [loop_unroll]: 0.00046815 [jit_opt_after_cconv]: 0.00014496, [1] [Cycle 1]: 0.00013864, [11] [c_1]: 1.283e-05 [parameter_eliminate]: 3.99002e-06 [updatestate_depend_eliminate]: 7.51999e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.93e-06 [cse]: 2.607e-05 [call_graph_tuple_transform]: 1.815e-05 [tuple_list_get_item_eliminator]: 4.33001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 4.05e-06 [remove_dup_value]: 1.62e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 5.56e-06 [add_recomputation]: 3.933e-05 [cse_after_recomputation]: 2.097e-05, [1] [Cycle 1]: 1.573e-05, [1] [cse]: 7.77e-06 [auto_monad_reorder]: 1.345e-05 [get_jit_bprop_graph]: 3.11001e-06 [rewriter_after_jit_bprop_graph]: 6.61999e-06 [opt_after_jit_grad]: 0.00050218 [symbol_engine_optimizer]: 7.226e-05, [1] [Cycle 1]: 6.536e-05, [6] [build]: 4.23001e-06 [elim_shapecalc]: 6.41e-06 [elim_not_effective]: 1.121e-05 [opt_reshape]: 4.3e-06 [fold_const_symbol]: 7.43999e-06 [renormalize]: 3.29979e-07 [validate]: 3.572e-05 Sums bootstrap : 0.000273s : 0.28% type_inference : 0.069208s : 71.50% event_method : 0.000344s : 0.36% auto_monad : 0.000192s : 0.20% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000064s : 0.07% rewriter_before_opt_a : 0.000145s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000147s : 0.15% jit_opt_a.loop_unroll : 0.000099s : 0.10% jit_opt_a.a_1 : 0.002595s : 2.68% jit_opt_a.with_stream_mark : 0.000079s : 0.08% jit_opt_a.recompute_prepare : 0.000040s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000030s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.03% jit_opt_a.accelerated_algorithm : 0.000029s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000068s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.05% jit_opt_a.meta_fg_expand : 0.002205s : 2.28% jit_opt_a.replace_old_param : 0.000102s : 0.11% jit_opt_a.inline_without_move : 0.000080s : 0.08% jit_opt_a.renormalize : 0.018099s : 18.70% jit_opt_a.add_forward_monad_depend : 0.000030s : 0.03% jit_opt_a.auto_monad_grad : 0.000012s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000098s : 0.10% jit_opt_a.cse : 0.000405s : 0.42% jit_opt_a.replace_applicator : 0.000130s : 0.13% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000778s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000031s : 0.03% loop_unroll : 0.000468s : 0.48% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000502s : 0.52% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.04% Time group info: ------[substitution.] 0.000750 107 0.35% : 0.000003s : 1: substitution.elim_not_effective 0.12% : 0.000001s : 1: substitution.fold_const_symbol 0.74% : 0.000006s : 1: substitution.graph_param_transform 69.10% : 0.000519s : 13: substitution.inline 2.81% : 0.000021s : 2: substitution.inline_without_move 1.26% : 0.000009s : 13: substitution.j_node_and_user_rematch 1.67% : 0.000013s : 7: substitution.minmaximum_grad 1.21% : 0.000009s : 5: substitution.partial_eliminate 1.45% : 0.000011s : 13: substitution.remove_not_recompute_node 5.11% : 0.000038s : 10: substitution.replace_applicator 1.24% : 0.000009s : 10: substitution.replace_old_param 1.06% : 0.000008s : 1: substitution.reshape_eliminate 0.41% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.89% : 0.000007s : 1: substitution.tile_eliminate 3.56% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.28% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.75% : 0.000051s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069073 2 95.21% : 0.065766s : 1: type_inference.infer 4.79% : 0.003307s : 1: type_inference.specialize ------[replace.] 0.000219 20 65.09% : 0.000143s : 13: replace.inline 34.91% : 0.000076s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000535 20 95.21% : 0.000509s : 13: match.inline 4.79% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000420 2768 1.63% : 0.000007s : 48: predicate.accumulaten_eliminater 0.30% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000006s : 48: predicate.addn_check_dump 1.60% : 0.000007s : 48: predicate.addn_zero_filter 2.06% : 0.000009s : 48: predicate.arithmetic_simplify 1.64% : 0.000007s : 48: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.36% : 0.000006s : 48: predicate.compare_switch_simplify 1.36% : 0.000006s : 48: predicate.depend_value_elim 1.43% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.47% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.54% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.07% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.59% : 0.000007s : 48: predicate.environ_get_depend_swap 1.58% : 0.000007s : 48: predicate.environ_get_eliminate 1.39% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.84% : 0.000004s : 20: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.03% : 0.000017s : 70: predicate.inline 1.94% : 0.000008s : 48: predicate.inline_without_move 0.35% : 0.000001s : 20: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 20: predicate.less_batch_normalization 1.75% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.88% : 0.000008s : 56: predicate.load_eliminater 0.37% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.50% : 0.000015s : 101: predicate.loop_unroll_before_grad 1.79% : 0.000008s : 49: predicate.make_slice_get_slice_eliminator 1.52% : 0.000006s : 48: predicate.merge_addn 1.44% : 0.000006s : 48: predicate.minmaximum_grad 0.54% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.33% : 0.000010s : 56: predicate.partial_eliminate 1.45% : 0.000006s : 48: predicate.print_const_string_wrapper 2.03% : 0.000009s : 48: predicate.reduce_eliminate 1.70% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000002s : 20: predicate.remove_not_recompute_node 2.88% : 0.000012s : 103: predicate.replace_applicator 1.20% : 0.000005s : 48: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000007s : 48: predicate.reshape_eliminate 1.45% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.32% : 0.000001s : 1: predicate.row_tensor_eliminate 1.38% : 0.000006s : 48: predicate.same_eliminate 0.55% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 2: predicate.special_op_eliminate 0.75% : 0.000003s : 20: predicate.specialize_transform 1.76% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000007s : 48: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.27% : 0.000014s : 68: predicate.switch_defer_inline 2.85% : 0.000012s : 68: predicate.switch_layer_defer_inline 6.27% : 0.000026s : 170: predicate.switch_simplify 1.49% : 0.000006s : 48: predicate.tile_eliminate 1.41% : 0.000006s : 48: predicate.transpose_eliminate 1.90% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000014s : 57: predicate.tuple_list_get_item_eliminator 1.94% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 1.91% : 0.000008s : 55: predicate.tuple_to_list_eliminator_ 1.73% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.85% : 0.000012s : 76: predicate.updatestate_useless_node_eliminater 1.97% : 0.000008s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.17% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004588 46 70.18% : 0.003220s : 29: func_graph_cloner_run.FuncGraphClonerGraph 29.82% : 0.001368s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123339 87 0.03% : 0.000042s : 1: add_recomputation 0.16% : 0.000201s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000303s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.29% : 0.000355s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 23.64% : 0.029163s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.04% : 0.000052s : 1: jit_opt_b 0.39% : 0.000477s : 1: loop_unroll 0.64% : 0.000789s : 1: mutable_eliminate 2.72% : 0.003360s : 39: opt.transform.jit_opt_a 0.03% : 0.000036s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.05% : 0.000068s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 11.92% : 0.014706s : 2: renormalize.infer 2.73% : 0.003364s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000149s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 56.13% : 0.069234s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.840.44 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00654c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.847.24 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0347911, [30] [bootstrap]: 0.00223597 [type_inference]: 0.0248359 [event_method]: 1.814e-05 [auto_monad]: 6.596e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 9.272e-05 [rewriter_before_opt_a]: 7.905e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00548355, [2] [Cycle 1]: 0.00163571, [27] [switch_simplify]: 5.066e-05 [loop_unroll]: 2.863e-05 [a_1]: 0.00050482 [with_stream_mark]: 1.711e-05 [recompute_prepare]: 7.21999e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.412e-05 [j_node_and_user_rematch]: 8.28001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.56002e-06 [inline_without_move]: 5.12e-06 [renormalize]: 0.00072039 [add_forward_monad_depend]: 4.97e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.479e-05 [cse]: 3.275e-05 [replace_applicator]: 1.122e-05 [Cycle 2]: 0.00077393, [27] [switch_simplify]: 5.93002e-06 [loop_unroll]: 4.89e-06 [a_1]: 0.0004953 [with_stream_mark]: 1.359e-05 [recompute_prepare]: 8.95999e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 1.743e-05 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.342e-05 [j_node_and_user_rematch]: 7.98999e-06 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 7.25998e-06 [inline_without_move]: 4.79998e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.92001e-06 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 8.02998e-06 [cse]: 1.792e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.142e-05 [rewriter_after_opt_a]: 3.691e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.0004726 [jit_opt_b]: 4.769e-05, [1] [Cycle 1]: 4.117e-05, [2] [frontend_op_eliminate]: 1.507e-05 [inline_after_opt_a]: 1.545e-05 [cconv]: 2.461e-05 [loop_unroll]: 0.00039693 [jit_opt_after_cconv]: 0.00013418, [1] [Cycle 1]: 0.00012782, [11] [c_1]: 1.957e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.47999e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 1.912e-05 [call_graph_tuple_transform]: 1.708e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 5.46e-06 [add_recomputation]: 5.479e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.767e-05, [1] [cse]: 1.197e-05 [auto_monad_reorder]: 1.747e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 4.08001e-06 [opt_after_jit_grad]: 0.00043242 [symbol_engine_optimizer]: 6.903e-05, [1] [Cycle 1]: 6.31e-05, [6] [build]: 2.93998e-06 [elim_shapecalc]: 7.39002e-06 [elim_not_effective]: 1.214e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 8.38999e-06 [renormalize]: 3.89991e-07 [validate]: 3.536e-05 Sums bootstrap : 0.002236s : 7.18% type_inference : 0.024836s : 79.74% event_method : 0.000018s : 0.06% auto_monad : 0.000066s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000093s : 0.30% rewriter_before_opt_a : 0.000079s : 0.25% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.18% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.001000s : 3.21% jit_opt_a.with_stream_mark : 0.000031s : 0.10% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000720s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000051s : 0.16% jit_opt_a.replace_applicator : 0.000017s : 0.05% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000473s : 1.52% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000025s : 0.08% loop_unroll : 0.000397s : 1.27% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000055s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000432s : 1.39% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.11% Time group info: ------[substitution.] 0.000190 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000005s : 3: substitution.graph_param_transform 84.03% : 0.000160s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000004s : 4: substitution.remove_not_recompute_node 1.96% : 0.000004s : 2: substitution.replace_old_param 5.91% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024770 2 95.21% : 0.023583s : 1: type_inference.infer 4.79% : 0.001187s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.33% : 0.000044s : 4: replace.inline 31.67% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.92% : 0.000158s : 4: match.inline 6.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.43% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.76% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.24% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000722 13 51.71% : 0.000373s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.75% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.54% : 0.000314s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036784 72 0.16% : 0.000058s : 1: add_recomputation 0.19% : 0.000070s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 6.13% : 0.002256s : 1: bootstrap 0.07% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000022s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 14.92% : 0.005487s : 1: jit_opt_a 0.37% : 0.000137s : 1: jit_opt_after_cconv 0.14% : 0.000050s : 1: jit_opt_b 1.10% : 0.000405s : 1: loop_unroll 1.31% : 0.000481s : 1: mutable_eliminate 3.32% : 0.001220s : 26: opt.transform.jit_opt_a 0.12% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000440s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000096s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.08% : 0.000396s : 1: renormalize.infer 0.86% : 0.000317s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000040s : 1: rewriter_after_opt_a 0.23% : 0.000083s : 1: rewriter_before_opt_a 0.19% : 0.000071s : 1: symbol_engine_optimizer 67.56% : 0.024851s : 1: type_inference TotalTime = 0.0375736, [30] [bootstrap]: 0.00025494 [type_inference]: 0.0168942 [event_method]: 7.332e-05 [auto_monad]: 0.00010688 [graph_reusing]: 7.37002e-06 [pre_auto_parallel]: 3.26999e-06 [py_interpret_to_execute]: 3.496e-05 [rewriter_before_opt_a]: 0.00011024 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0171298, [3] [Cycle 1]: 0.00850245, [27] [switch_simplify]: 8.251e-05 [loop_unroll]: 4.334e-05 [a_1]: 0.00101886 [with_stream_mark]: 3.903e-05 [recompute_prepare]: 2.359e-05 [updatestate_depend_eliminate]: 9.92001e-06 [updatestate_assign_eliminate]: 7.28999e-06 [updatestate_loads_eliminate]: 6.67002e-06 [parameter_eliminate]: 3.45e-06 [specialize_transform]: 1.471e-05 [updatestate_useless_node_eliminater]: 1.265e-05 [accelerated_algorithm]: 1.37e-05 [meta_shard_fg_expand]: 4.94003e-06 [get_grad_eliminate_]: 1.234e-05 [merge_forward]: 9.10001e-06 [cell_reuse_recompute_pass]: 9.19972e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.918e-05 [j_node_and_user_rematch]: 2.59e-05 [meta_fg_expand]: 0.00209467 [replace_old_param]: 7.741e-05 [inline_without_move]: 6.248e-05 [renormalize]: 0.00417459 [add_forward_monad_depend]: 1.677e-05 [auto_monad_grad]: 6.44001e-06 [auto_monad_eliminator]: 6.647e-05 [cse]: 0.00025364 [replace_applicator]: 9.152e-05 [Cycle 2]: 0.0045922, [27] [switch_simplify]: 4.064e-05 [loop_unroll]: 4.094e-05 [a_1]: 0.00137582 [with_stream_mark]: 3.093e-05 [recompute_prepare]: 1.723e-05 [updatestate_depend_eliminate]: 7.12002e-06 [updatestate_assign_eliminate]: 4.47e-06 [updatestate_loads_eliminate]: 4.00998e-06 [parameter_eliminate]: 3.30003e-06 [specialize_transform]: 1.074e-05 [updatestate_useless_node_eliminater]: 1.08e-05 [accelerated_algorithm]: 8.75001e-06 [meta_shard_fg_expand]: 4.53999e-06 [get_grad_eliminate_]: 8.43001e-06 [merge_forward]: 6.83e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.364e-05 [j_node_and_user_rematch]: 1.506e-05 [meta_fg_expand]: 0.00016012 [replace_old_param]: 1.41e-05 [inline_without_move]: 8.84e-06 [renormalize]: 0.00248499 [add_forward_monad_depend]: 1.247e-05 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 1.836e-05 [cse]: 3.144e-05 [replace_applicator]: 1.987e-05 [Cycle 3]: 0.0002911, [27] [switch_simplify]: 5.03002e-06 [loop_unroll]: 4.45e-06 [a_1]: 5.174e-05 [with_stream_mark]: 1.605e-05 [recompute_prepare]: 3.86999e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 3.83001e-06 [updatestate_useless_node_eliminater]: 3.18998e-06 [accelerated_algorithm]: 3.73001e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 3.63999e-06 [merge_forward]: 3.42002e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 7.05e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 3.35e-06 [inline_without_move]: 3.11999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.45999e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.041e-05 [replace_applicator]: 4.29002e-06 [py_interpret_to_execute_after_opt_a]: 1.64e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 4.68999e-06 [mutable_eliminate]: 0.0008869 [jit_opt_b]: 5.785e-05, [1] [Cycle 1]: 4.899e-05, [2] [frontend_op_eliminate]: 1.731e-05 [inline_after_opt_a]: 1.672e-05 [cconv]: 3.737e-05 [loop_unroll]: 0.00064507 [jit_opt_after_cconv]: 0.00023685, [1] [Cycle 1]: 0.0002281, [11] [c_1]: 1.863e-05 [parameter_eliminate]: 6.78e-06 [updatestate_depend_eliminate]: 1.079e-05 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 1.83997e-06 [cse]: 3.785e-05 [call_graph_tuple_transform]: 2.467e-05 [tuple_list_get_item_eliminator]: 4.883e-05 [none_parameter_eliminate]: 2.10002e-06 [renormalize]: 1.29e-06 [switch_simplify]: 5.87999e-06 [remove_dup_value]: 1.787e-05 [partial_unused_args_eliminate]: 3.65e-06 [environ_conv]: 7.53e-06 [add_recomputation]: 4.665e-05 [cse_after_recomputation]: 2.509e-05, [1] [Cycle 1]: 1.792e-05, [1] [cse]: 1.067e-05 [auto_monad_reorder]: 1.499e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 9.52001e-06 [opt_after_jit_grad]: 0.00054882 [symbol_engine_optimizer]: 8.038e-05, [1] [Cycle 1]: 7.269e-05, [6] [build]: 5.42001e-06 [elim_shapecalc]: 7.52002e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 6.16998e-06 [fold_const_symbol]: 8.03999e-06 [renormalize]: 7.39994e-07 [validate]: 4.108e-05 Sums bootstrap : 0.000255s : 0.78% type_inference : 0.016894s : 51.51% event_method : 0.000073s : 0.22% auto_monad : 0.000107s : 0.33% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000035s : 0.11% rewriter_before_opt_a : 0.000110s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000128s : 0.39% jit_opt_a.loop_unroll : 0.000089s : 0.27% jit_opt_a.a_1 : 0.002446s : 7.46% jit_opt_a.with_stream_mark : 0.000086s : 0.26% jit_opt_a.recompute_prepare : 0.000045s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.04% jit_opt_a.parameter_eliminate : 0.000008s : 0.03% jit_opt_a.specialize_transform : 0.000029s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.08% jit_opt_a.accelerated_algorithm : 0.000026s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000012s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.07% jit_opt_a.merge_forward : 0.000019s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000068s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.15% jit_opt_a.meta_fg_expand : 0.002257s : 6.88% jit_opt_a.replace_old_param : 0.000095s : 0.29% jit_opt_a.inline_without_move : 0.000074s : 0.23% jit_opt_a.renormalize : 0.006660s : 20.30% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.09% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000090s : 0.28% jit_opt_a.cse : 0.000295s : 0.90% jit_opt_a.replace_applicator : 0.000116s : 0.35% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000887s : 2.70% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000037s : 0.11% loop_unroll : 0.000645s : 1.97% jit_opt_after_cconv.c_1 : 0.000019s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000049s : 0.15% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000004s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000047s : 0.14% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000015s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000549s : 1.67% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.13% Time group info: ------[substitution.] 0.000743 105 0.35% : 0.000003s : 1: substitution.elim_not_effective 0.20% : 0.000001s : 1: substitution.fold_const_symbol 0.91% : 0.000007s : 1: substitution.graph_param_transform 68.57% : 0.000509s : 13: substitution.inline 2.98% : 0.000022s : 2: substitution.inline_without_move 1.69% : 0.000013s : 13: substitution.j_node_and_user_rematch 1.78% : 0.000013s : 7: substitution.minmaximum_grad 1.08% : 0.000008s : 5: substitution.partial_eliminate 1.60% : 0.000012s : 13: substitution.remove_not_recompute_node 4.70% : 0.000035s : 10: substitution.replace_applicator 0.88% : 0.000007s : 8: substitution.replace_old_param 1.36% : 0.000010s : 1: substitution.reshape_eliminate 0.51% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.88% : 0.000007s : 1: substitution.tile_eliminate 3.47% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.16% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.90% : 0.000051s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016796 2 89.37% : 0.015011s : 1: type_inference.infer 10.63% : 0.001785s : 1: type_inference.specialize ------[replace.] 0.000223 20 64.65% : 0.000144s : 13: replace.inline 35.35% : 0.000079s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000526 20 94.89% : 0.000499s : 13: match.inline 5.11% : 0.000027s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000399 2537 1.42% : 0.000006s : 44: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.33% : 0.000005s : 44: predicate.addn_check_dump 1.51% : 0.000006s : 44: predicate.addn_zero_filter 2.12% : 0.000008s : 44: predicate.arithmetic_simplify 1.76% : 0.000007s : 44: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.47% : 0.000006s : 44: predicate.compare_switch_simplify 1.47% : 0.000006s : 44: predicate.depend_value_elim 1.35% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.44% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.70% : 0.000007s : 44: predicate.environ_add_const_eliminate 1.41% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.32% : 0.000005s : 44: predicate.environ_get_depend_swap 1.42% : 0.000006s : 44: predicate.environ_get_eliminate 1.51% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.84% : 0.000003s : 18: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.65% : 0.000019s : 66: predicate.inline 2.15% : 0.000009s : 42: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.04% : 0.000004s : 18: predicate.less_batch_normalization 1.91% : 0.000008s : 51: predicate.list_to_tuple_eliminator_ 1.74% : 0.000007s : 52: predicate.load_eliminater 0.66% : 0.000003s : 1: predicate.loop_unroll_after_grad 3.33% : 0.000013s : 89: predicate.loop_unroll_before_grad 2.06% : 0.000008s : 45: predicate.make_slice_get_slice_eliminator 1.31% : 0.000005s : 44: predicate.merge_addn 1.40% : 0.000006s : 44: predicate.minmaximum_grad 1.04% : 0.000004s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.20% : 0.000009s : 52: predicate.partial_eliminate 1.34% : 0.000005s : 44: predicate.print_const_string_wrapper 1.93% : 0.000008s : 44: predicate.reduce_eliminate 1.66% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 18: predicate.remove_not_recompute_node 2.62% : 0.000010s : 94: predicate.replace_applicator 1.09% : 0.000004s : 42: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.68% : 0.000007s : 44: predicate.reshape_eliminate 1.48% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.39% : 0.000002s : 1: predicate.row_tensor_eliminate 1.32% : 0.000005s : 44: predicate.same_eliminate 0.47% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.29% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 18: predicate.specialize_transform 1.81% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.72% : 0.000007s : 44: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.51% : 0.000014s : 64: predicate.switch_defer_inline 2.31% : 0.000009s : 64: predicate.switch_layer_defer_inline 5.94% : 0.000024s : 154: predicate.switch_simplify 1.51% : 0.000006s : 44: predicate.tile_eliminate 1.63% : 0.000007s : 44: predicate.transpose_eliminate 2.16% : 0.000009s : 44: predicate.tuple_list_convert_item_index_to_positive 1.81% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000014s : 53: predicate.tuple_list_get_item_eliminator 1.82% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.75% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.51% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002586 32 53.16% : 0.001375s : 15: func_graph_cloner_run.FuncGraphClonerGraph 46.84% : 0.001211s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047459 87 0.10% : 0.000050s : 1: add_recomputation 0.23% : 0.000111s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.59% : 0.000281s : 1: bootstrap 0.08% : 0.000040s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.17% : 0.000079s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 36.10% : 0.017134s : 1: jit_opt_a 0.51% : 0.000241s : 1: jit_opt_after_cconv 0.13% : 0.000061s : 1: jit_opt_b 1.39% : 0.000658s : 1: loop_unroll 1.91% : 0.000906s : 1: mutable_eliminate 6.65% : 0.003154s : 39: opt.transform.jit_opt_a 0.20% : 0.000093s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000024s : 1: opt.transform.mutable_eliminate 0.04% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.18% : 0.000558s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000037s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 8.54% : 0.004054s : 2: renormalize.infer 5.43% : 0.002579s : 2: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000113s : 1: rewriter_before_opt_a 0.18% : 0.000084s : 1: symbol_engine_optimizer 35.64% : 0.016915s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.168.408 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d040> should be wrapped by jit only once. TotalTime = 0.10581, [30] [bootstrap]: 0.00028016 [type_inference]: 0.0955723 [event_method]: 2.206e-05 [auto_monad]: 7.059e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 0.0002834 [rewriter_before_opt_a]: 9.918e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.00725697, [2] [Cycle 1]: 0.00361805, [27] [switch_simplify]: 5.928e-05 [loop_unroll]: 3.558e-05 [a_1]: 0.00066831 [with_stream_mark]: 1.861e-05 [recompute_prepare]: 8.81002e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 6.60997e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 6.46999e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.074e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.00204607 [add_forward_monad_depend]: 5.66e-06 [auto_monad_grad]: 2.84999e-06 [auto_monad_eliminator]: 5.611e-05 [cse]: 0.00042378 [replace_applicator]: 1.689e-05 [Cycle 2]: 0.0003824, [27] [switch_simplify]: 7.61001e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00012283 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 6.37001e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.69e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 7.75e-06 [cse]: 1.816e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.22e-05 [rewriter_after_opt_a]: 3.795e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00055752 [jit_opt_b]: 5.599e-05, [1] [Cycle 1]: 4.913e-05, [2] [frontend_op_eliminate]: 1.85e-05 [inline_after_opt_a]: 1.857e-05 [cconv]: 2.56e-05 [loop_unroll]: 0.00043709 [jit_opt_after_cconv]: 0.0001525, [1] [Cycle 1]: 0.0001461, [11] [c_1]: 2.655e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.295e-05 [call_graph_tuple_transform]: 2.098e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.21998e-06 [remove_dup_value]: 1.953e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 8.59e-06 [add_recomputation]: 5.038e-05 [cse_after_recomputation]: 2.442e-05, [1] [Cycle 1]: 1.918e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.839e-05 [get_jit_bprop_graph]: 2.06003e-06 [rewriter_after_jit_bprop_graph]: 5.05999e-06 [opt_after_jit_grad]: 0.00046651 [symbol_engine_optimizer]: 7.426e-05, [1] [Cycle 1]: 6.826e-05, [6] [build]: 3.18998e-06 [elim_shapecalc]: 8.77999e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 6.58e-06 [fold_const_symbol]: 9.57999e-06 [renormalize]: 4.39992e-07 [validate]: 7.75e-05 Sums bootstrap : 0.000280s : 0.27% type_inference : 0.095572s : 93.73% event_method : 0.000022s : 0.02% auto_monad : 0.000071s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000283s : 0.28% rewriter_before_opt_a : 0.000099s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.07% jit_opt_a.loop_unroll : 0.000042s : 0.04% jit_opt_a.a_1 : 0.000791s : 0.78% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002046s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000064s : 0.06% jit_opt_a.cse : 0.000442s : 0.43% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000558s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000437s : 0.43% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000467s : 0.46% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000078s : 0.08% Time group info: ------[substitution.] 0.000244 25 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 4: substitution.graph_param_transform 86.02% : 0.000209s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.095483 2 97.13% : 0.092746s : 1: type_inference.infer 2.87% : 0.002738s : 1: type_inference.specialize ------[replace.] 0.000100 7 66.99% : 0.000067s : 5: replace.inline 33.01% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.15% : 0.000207s : 5: match.inline 4.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 1.77% : 0.000002s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.40% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.36% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.45% : 0.000002s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.42% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 20: predicate.switch_defer_inline 2.38% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.66% : 0.000011s : 65: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002529 29 71.03% : 0.001796s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.49% : 0.000670s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108931 72 0.05% : 0.000053s : 1: add_recomputation 0.07% : 0.000074s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000297s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.66% : 0.007260s : 1: jit_opt_a 0.14% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.41% : 0.000445s : 1: loop_unroll 0.52% : 0.000566s : 1: mutable_eliminate 0.95% : 0.001039s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000288s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.23% : 0.001345s : 1: renormalize.infer 0.63% : 0.000691s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000104s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 87.75% : 0.095588s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.169.117 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.355881, [30] [bootstrap]: 0.0004525 [type_inference]: 0.333906 [event_method]: 2.605e-05 [auto_monad]: 8.948e-05 [graph_reusing]: 6.78998e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 0.00118293 [rewriter_before_opt_a]: 0.0001123 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.0148802, [2] [Cycle 1]: 0.00858989, [27] [switch_simplify]: 6.534e-05 [loop_unroll]: 3.42e-05 [a_1]: 0.00082428 [with_stream_mark]: 2.243e-05 [recompute_prepare]: 9.52999e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.25002e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 6.51999e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.643e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.097e-05 [inline_without_move]: 6.11998e-06 [renormalize]: 0.00710635 [add_forward_monad_depend]: 1.327e-05 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 7.547e-05 [cse]: 4.635e-05 [replace_applicator]: 3.28e-05 [Cycle 2]: 0.00054936, [27] [switch_simplify]: 1.126e-05 [loop_unroll]: 6.94999e-06 [a_1]: 0.0001796 [with_stream_mark]: 2.269e-05 [recompute_prepare]: 1.014e-05 [updatestate_depend_eliminate]: 5.17999e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.48998e-06 [specialize_transform]: 7.85e-06 [updatestate_useless_node_eliminater]: 7.92998e-06 [accelerated_algorithm]: 8.25999e-06 [meta_shard_fg_expand]: 3.43999e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 5.29998e-06 [cell_reuse_recompute_pass]: 5.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.987e-05 [j_node_and_user_rematch]: 1.224e-05 [meta_fg_expand]: 4.92999e-06 [replace_old_param]: 1.391e-05 [inline_without_move]: 7.35e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.26e-06 [auto_monad_grad]: 1.47001e-06 [auto_monad_eliminator]: 1.192e-05 [cse]: 2.341e-05 [replace_applicator]: 7.35e-06 [py_interpret_to_execute_after_opt_a]: 2.541e-05 [rewriter_after_opt_a]: 7.011e-05 [convert_after_rewriter]: 9.97999e-06 [order_py_execute_after_rewriter]: 5.74e-06 [mutable_eliminate]: 0.00217249 [jit_opt_b]: 8.344e-05, [1] [Cycle 1]: 7.242e-05, [2] [frontend_op_eliminate]: 2.819e-05 [inline_after_opt_a]: 2.549e-05 [cconv]: 4.446e-05 [loop_unroll]: 0.00066082 [jit_opt_after_cconv]: 0.00029809, [1] [Cycle 1]: 0.00028817, [11] [c_1]: 3.094e-05 [parameter_eliminate]: 7.85e-06 [updatestate_depend_eliminate]: 1.14e-05 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 0.00011426 [call_graph_tuple_transform]: 3.379e-05 [tuple_list_get_item_eliminator]: 7.73999e-06 [none_parameter_eliminate]: 1.93002e-06 [renormalize]: 8.49977e-07 [switch_simplify]: 8.95001e-06 [remove_dup_value]: 2.396e-05 [partial_unused_args_eliminate]: 2.73998e-06 [environ_conv]: 1.19e-05 [add_recomputation]: 0.00014775 [cse_after_recomputation]: 3.997e-05, [1] [Cycle 1]: 3.023e-05, [1] [cse]: 1.894e-05 [auto_monad_reorder]: 2.065e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 1.403e-05 [opt_after_jit_grad]: 0.00071333 [symbol_engine_optimizer]: 0.00010047, [1] [Cycle 1]: 9.263e-05, [6] [build]: 7.15998e-06 [elim_shapecalc]: 1.012e-05 [elim_not_effective]: 2.055e-05 [opt_reshape]: 8.27e-06 [fold_const_symbol]: 1.165e-05 [renormalize]: 3.00002e-07 [validate]: 0.00038549 Sums bootstrap : 0.000452s : 0.13% type_inference : 0.333906s : 95.63% event_method : 0.000026s : 0.01% auto_monad : 0.000089s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001183s : 0.34% rewriter_before_opt_a : 0.000112s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.001004s : 0.29% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.007106s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.00% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.03% jit_opt_a.cse : 0.000070s : 0.02% jit_opt_a.replace_applicator : 0.000040s : 0.01% py_interpret_to_execute_after_opt_a : 0.000025s : 0.01% rewriter_after_opt_a : 0.000070s : 0.02% convert_after_rewriter : 0.000010s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.002172s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.01% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000044s : 0.01% loop_unroll : 0.000661s : 0.19% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000114s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000034s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.00% remove_dup_value : 0.000024s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.00% add_recomputation : 0.000148s : 0.04% cse_after_recomputation.cse : 0.000019s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.00% opt_after_jit_grad : 0.000713s : 0.20% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000385s : 0.11% Time group info: ------[substitution.] 0.000333 28 1.41% : 0.000005s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000007s : 4: substitution.graph_param_transform 82.18% : 0.000273s : 5: substitution.inline 1.69% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.79% : 0.000016s : 3: substitution.reduce_eliminate 1.83% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000007s : 2: substitution.replace_old_param 3.34% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.333763 2 97.40% : 0.325078s : 1: type_inference.infer 2.60% : 0.008686s : 1: type_inference.specialize ------[replace.] 0.000109 7 67.81% : 0.000074s : 5: replace.inline 32.19% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 7 96.47% : 0.000270s : 5: match.inline 3.53% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000194 886 1.07% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000003s : 13: predicate.addn_zero_filter 1.63% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000003s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 0.77% : 0.000001s : 13: predicate.compare_switch_simplify 0.89% : 0.000002s : 13: predicate.depend_value_elim 0.99% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 13: predicate.dict_get_item_eliminator 11.94% : 0.000023s : 13: predicate.dict_set_item_eliminator 1.64% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.37% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.38% : 0.000003s : 13: predicate.environ_get_depend_swap 1.06% : 0.000002s : 13: predicate.environ_get_eliminate 0.85% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000001s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000001s : 4: predicate.graph_param_transform 4.44% : 0.000009s : 28: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.15% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.42% : 0.000003s : 19: predicate.load_eliminater 1.82% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.14% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.59% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.85% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 3.23% : 0.000006s : 4: predicate.mutable_eliminate 0.38% : 0.000001s : 4: predicate.opt_reshape 1.74% : 0.000003s : 19: predicate.partial_eliminate 1.00% : 0.000002s : 13: predicate.print_const_string_wrapper 2.03% : 0.000004s : 13: predicate.reduce_eliminate 1.06% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.61% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.14% : 0.000002s : 4: predicate.row_tensor_eliminate 1.53% : 0.000003s : 13: predicate.same_eliminate 0.45% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 8: predicate.special_op_eliminate 0.82% : 0.000002s : 8: predicate.specialize_transform 1.47% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 0.89% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.97% : 0.000004s : 20: predicate.switch_defer_inline 1.92% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.44% : 0.000012s : 64: predicate.switch_simplify 0.98% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.16% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.27% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.44% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.06% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004886 25 43.89% : 0.002145s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 54.26% : 0.002652s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.363154 72 0.04% : 0.000154s : 1: add_recomputation 0.03% : 0.000093s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.13% : 0.000479s : 1: bootstrap 0.01% : 0.000048s : 1: cconv 0.00% : 0.000013s : 1: convert_after_rewriter 0.01% : 0.000042s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.10% : 0.014886s : 1: jit_opt_a 0.08% : 0.000302s : 1: jit_opt_after_cconv 0.02% : 0.000087s : 1: jit_opt_b 0.19% : 0.000674s : 1: loop_unroll 0.60% : 0.002196s : 1: mutable_eliminate 0.36% : 0.001297s : 26: opt.transform.jit_opt_a 0.02% : 0.000077s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000043s : 4: opt.transform.jit_opt_b 0.01% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000034s : 1: opt.transform.mutable_eliminate 0.01% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000730s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.001194s : 1: py_interpret_to_execute 0.01% : 0.000030s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000028s : 1: remove_dup_value 1.02% : 0.003690s : 1: renormalize.infer 0.70% : 0.002550s : 1: renormalize.specialize 0.00% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000076s : 1: rewriter_after_opt_a 0.03% : 0.000117s : 1: rewriter_before_opt_a 0.03% : 0.000103s : 1: symbol_engine_optimizer 91.97% : 0.333978s : 1: type_inference TotalTime = 0.0445982, [30] [bootstrap]: 0.00026537 [type_inference]: 0.017962 [event_method]: 7.088e-05 [auto_monad]: 0.00010695 [graph_reusing]: 7.61999e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 3.629e-05 [rewriter_before_opt_a]: 0.00012468 [expand_dump_flag]: 3.22997e-06 [jit_opt_a]: 0.0232428, [3] [Cycle 1]: 0.0148292, [27] [switch_simplify]: 9.792e-05 [loop_unroll]: 4.807e-05 [a_1]: 0.00118808 [with_stream_mark]: 4.124e-05 [recompute_prepare]: 2.423e-05 [updatestate_depend_eliminate]: 1.061e-05 [updatestate_assign_eliminate]: 7.66001e-06 [updatestate_loads_eliminate]: 7.2e-06 [parameter_eliminate]: 3.43e-06 [specialize_transform]: 1.624e-05 [updatestate_useless_node_eliminater]: 1.416e-05 [accelerated_algorithm]: 1.382e-05 [meta_shard_fg_expand]: 4.80001e-06 [get_grad_eliminate_]: 1.368e-05 [merge_forward]: 1.106e-05 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.31e-05 [j_node_and_user_rematch]: 2.658e-05 [meta_fg_expand]: 0.0022619 [replace_old_param]: 8.494e-05 [inline_without_move]: 6.873e-05 [renormalize]: 0.0100845 [add_forward_monad_depend]: 1.755e-05 [auto_monad_grad]: 7.61999e-06 [auto_monad_eliminator]: 6.36e-05 [cse]: 0.00027491 [replace_applicator]: 9.489e-05 [Cycle 2]: 0.00415808, [27] [switch_simplify]: 4.144e-05 [loop_unroll]: 3.968e-05 [a_1]: 0.00122819 [with_stream_mark]: 2.413e-05 [recompute_prepare]: 1.099e-05 [updatestate_depend_eliminate]: 5.06997e-06 [updatestate_assign_eliminate]: 4.11001e-06 [updatestate_loads_eliminate]: 4.17e-06 [parameter_eliminate]: 2.87002e-06 [specialize_transform]: 8.19998e-06 [updatestate_useless_node_eliminater]: 7.5e-06 [accelerated_algorithm]: 7.6e-06 [meta_shard_fg_expand]: 3.24001e-06 [get_grad_eliminate_]: 6.77002e-06 [merge_forward]: 4.86002e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.806e-05 [j_node_and_user_rematch]: 1.237e-05 [meta_fg_expand]: 0.00019665 [replace_old_param]: 1.354e-05 [inline_without_move]: 8.92999e-06 [renormalize]: 0.00221023 [add_forward_monad_depend]: 9.89999e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.883e-05 [cse]: 3.11e-05 [replace_applicator]: 2.129e-05 [Cycle 3]: 0.00029055, [27] [switch_simplify]: 5.05001e-06 [loop_unroll]: 3.71001e-06 [a_1]: 5.256e-05 [with_stream_mark]: 1.476e-05 [recompute_prepare]: 3.84002e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 1.76998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 3.71999e-06 [updatestate_useless_node_eliminater]: 3.46999e-06 [accelerated_algorithm]: 4.02998e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 3.41999e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 3.13e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 7.41001e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 3.64002e-06 [inline_without_move]: 3.45e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 1.003e-05 [replace_applicator]: 4.22e-06 [py_interpret_to_execute_after_opt_a]: 1.474e-05 [rewriter_after_opt_a]: 4.036e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 4.35e-06 [mutable_eliminate]: 0.00085883 [jit_opt_b]: 5.513e-05, [1] [Cycle 1]: 4.576e-05, [2] [frontend_op_eliminate]: 1.474e-05 [inline_after_opt_a]: 1.509e-05 [cconv]: 3.82e-05 [loop_unroll]: 0.00052317 [jit_opt_after_cconv]: 0.00016315, [1] [Cycle 1]: 0.00015539, [11] [c_1]: 1.498e-05 [parameter_eliminate]: 4.46002e-06 [updatestate_depend_eliminate]: 9.27001e-06 [updatestate_assign_eliminate]: 1.99999e-06 [updatestate_loads_eliminate]: 3.79002e-06 [cse]: 3.035e-05 [call_graph_tuple_transform]: 1.936e-05 [tuple_list_get_item_eliminator]: 5.24998e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 4.2e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.03998e-06 [add_recomputation]: 4.505e-05 [cse_after_recomputation]: 2.294e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 9.52001e-06 [auto_monad_reorder]: 1.449e-05 [get_jit_bprop_graph]: 3.93001e-06 [rewriter_after_jit_bprop_graph]: 9.67001e-06 [opt_after_jit_grad]: 0.00059931 [symbol_engine_optimizer]: 8.167e-05, [1] [Cycle 1]: 7.466e-05, [6] [build]: 5.66e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.443e-05 [opt_reshape]: 5.42001e-06 [fold_const_symbol]: 7.72002e-06 [renormalize]: 4.09986e-07 [validate]: 4.452e-05 Sums bootstrap : 0.000265s : 0.67% type_inference : 0.017962s : 45.34% event_method : 0.000071s : 0.18% auto_monad : 0.000107s : 0.27% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000036s : 0.09% rewriter_before_opt_a : 0.000125s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000144s : 0.36% jit_opt_a.loop_unroll : 0.000091s : 0.23% jit_opt_a.a_1 : 0.002469s : 6.23% jit_opt_a.with_stream_mark : 0.000080s : 0.20% jit_opt_a.recompute_prepare : 0.000039s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000008s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.06% jit_opt_a.accelerated_algorithm : 0.000025s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.06% jit_opt_a.merge_forward : 0.000019s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.12% jit_opt_a.meta_fg_expand : 0.002460s : 6.21% jit_opt_a.replace_old_param : 0.000102s : 0.26% jit_opt_a.inline_without_move : 0.000081s : 0.20% jit_opt_a.renormalize : 0.012295s : 31.03% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.07% jit_opt_a.auto_monad_grad : 0.000011s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000088s : 0.22% jit_opt_a.cse : 0.000316s : 0.80% jit_opt_a.replace_applicator : 0.000120s : 0.30% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000859s : 2.17% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000038s : 0.10% loop_unroll : 0.000523s : 1.32% jit_opt_after_cconv.c_1 : 0.000015s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000045s : 0.11% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.04% get_jit_bprop_graph : 0.000004s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000599s : 1.51% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.11% Time group info: ------[substitution.] 0.000735 104 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.67% : 0.000005s : 1: substitution.graph_param_transform 69.31% : 0.000509s : 13: substitution.inline 3.33% : 0.000024s : 2: substitution.inline_without_move 1.48% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.80% : 0.000013s : 7: substitution.minmaximum_grad 1.09% : 0.000008s : 5: substitution.partial_eliminate 1.69% : 0.000012s : 12: substitution.remove_not_recompute_node 5.18% : 0.000038s : 10: substitution.replace_applicator 1.13% : 0.000008s : 10: substitution.replace_old_param 0.39% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.03% : 0.000008s : 1: substitution.tile_eliminate 3.71% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.24% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.49% : 0.000048s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017864 2 90.65% : 0.016194s : 1: type_inference.infer 9.35% : 0.001670s : 1: type_inference.specialize ------[replace.] 0.000223 20 66.46% : 0.000148s : 13: replace.inline 33.54% : 0.000075s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000526 20 95.35% : 0.000502s : 13: match.inline 4.65% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000401 2433 1.38% : 0.000006s : 42: predicate.accumulaten_eliminater 0.34% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 42: predicate.addn_check_dump 1.50% : 0.000006s : 42: predicate.addn_zero_filter 1.96% : 0.000008s : 42: predicate.arithmetic_simplify 1.58% : 0.000006s : 42: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.34% : 0.000005s : 42: predicate.compare_switch_simplify 1.45% : 0.000006s : 42: predicate.depend_value_elim 1.46% : 0.000006s : 42: predicate.dict_get_item_const_eliminator 1.67% : 0.000007s : 42: predicate.dict_get_item_eliminator 1.56% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.42% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.34% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.50% : 0.000006s : 42: predicate.environ_get_depend_swap 1.45% : 0.000006s : 42: predicate.environ_get_eliminate 1.36% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.74% : 0.000003s : 16: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.44% : 0.000018s : 64: predicate.inline 2.29% : 0.000009s : 44: predicate.inline_without_move 0.29% : 0.000001s : 16: predicate.j_node_and_user_rematch 1.04% : 0.000004s : 16: predicate.less_batch_normalization 1.68% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.84% : 0.000007s : 50: predicate.load_eliminater 0.61% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.19% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.71% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.47% : 0.000006s : 42: predicate.merge_addn 1.41% : 0.000006s : 42: predicate.minmaximum_grad 1.19% : 0.000005s : 1: predicate.mutable_eliminate 0.06% : 0.000000s : 1: predicate.opt_reshape 2.24% : 0.000009s : 50: predicate.partial_eliminate 1.42% : 0.000006s : 42: predicate.print_const_string_wrapper 2.07% : 0.000008s : 42: predicate.reduce_eliminate 1.81% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000002s : 16: predicate.remove_not_recompute_node 2.64% : 0.000011s : 90: predicate.replace_applicator 1.05% : 0.000004s : 44: predicate.replace_old_param 0.25% : 0.000001s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 42: predicate.reshape_eliminate 1.57% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.31% : 0.000001s : 1: predicate.row_tensor_eliminate 1.47% : 0.000006s : 42: predicate.same_eliminate 0.44% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 2: predicate.special_op_eliminate 0.84% : 0.000003s : 16: predicate.specialize_transform 1.57% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.32% : 0.000013s : 62: predicate.switch_defer_inline 2.52% : 0.000010s : 62: predicate.switch_layer_defer_inline 6.58% : 0.000026s : 150: predicate.switch_simplify 1.61% : 0.000006s : 42: predicate.tile_eliminate 1.55% : 0.000006s : 42: predicate.transpose_eliminate 1.96% : 0.000008s : 42: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000014s : 51: predicate.tuple_list_get_item_eliminator 1.80% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.89% : 0.000008s : 49: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.70% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 1.89% : 0.000008s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002983 36 58.78% : 0.001754s : 19: func_graph_cloner_run.FuncGraphClonerGraph 41.22% : 0.001230s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060108 87 0.08% : 0.000048s : 1: add_recomputation 0.19% : 0.000112s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.49% : 0.000292s : 1: bootstrap 0.07% : 0.000041s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.13% : 0.000078s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 38.68% : 0.023249s : 1: jit_opt_a 0.28% : 0.000167s : 1: jit_opt_after_cconv 0.10% : 0.000058s : 1: jit_opt_b 0.89% : 0.000533s : 1: loop_unroll 1.46% : 0.000875s : 1: mutable_eliminate 5.33% : 0.003204s : 39: opt.transform.jit_opt_a 0.07% : 0.000040s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000021s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.01% : 0.000610s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000039s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 15.68% : 0.009423s : 2: renormalize.infer 4.73% : 0.002845s : 2: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000043s : 1: rewriter_after_opt_a 0.21% : 0.000128s : 1: rewriter_before_opt_a 0.14% : 0.000084s : 1: symbol_engine_optimizer 29.92% : 0.017984s : 1: type_inference TotalTime = 0.205562, [30] [bootstrap]: 0.00029434 [type_inference]: 0.19308 [event_method]: 0.00040051 [auto_monad]: 0.00015393 [graph_reusing]: 1.014e-05 [pre_auto_parallel]: 4.3e-06 [py_interpret_to_execute]: 5.311e-05 [rewriter_before_opt_a]: 0.00020986 [expand_dump_flag]: 4.38001e-06 [jit_opt_a]: 0.00907807, [2] [Cycle 1]: 0.00520549, [27] [switch_simplify]: 0.00021341 [loop_unroll]: 6.637e-05 [a_1]: 0.00280465 [with_stream_mark]: 2.701e-05 [recompute_prepare]: 9.09e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 4.89998e-06 [accelerated_algorithm]: 5.98998e-06 [meta_shard_fg_expand]: 2.53003e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 1.023e-05 [inline_without_move]: 5.26002e-06 [renormalize]: 0.00174783 [add_forward_monad_depend]: 5.76e-06 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 1.466e-05 [cse]: 2.95e-05 [replace_applicator]: 1.159e-05 [Cycle 2]: 0.0003131, [27] [switch_simplify]: 5.44998e-06 [loop_unroll]: 4.97e-06 [a_1]: 9.111e-05 [with_stream_mark]: 8.66002e-06 [recompute_prepare]: 4.75001e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 1.96e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.74998e-06 [accelerated_algorithm]: 5.05001e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 4.38999e-06 [merge_forward]: 2.32999e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.295e-05 [j_node_and_user_rematch]: 7.52002e-06 [meta_fg_expand]: 1.51998e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.82998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 4.48999e-06 [cse]: 9.94001e-06 [replace_applicator]: 4.84e-06 [py_interpret_to_execute_after_opt_a]: 1.083e-05 [rewriter_after_opt_a]: 3.571e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 4.73001e-06 [mutable_eliminate]: 0.00059287 [jit_opt_b]: 4.786e-05, [1] [Cycle 1]: 4.116e-05, [2] [frontend_op_eliminate]: 1.566e-05 [inline_after_opt_a]: 1.427e-05 [cconv]: 2.426e-05 [loop_unroll]: 0.00041749 [jit_opt_after_cconv]: 0.00013532, [1] [Cycle 1]: 0.00012899, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 1.575e-05 [call_graph_tuple_transform]: 1.912e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 4.99e-06 [remove_dup_value]: 1.465e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 5.10001e-06 [add_recomputation]: 4.809e-05 [cse_after_recomputation]: 2.034e-05, [1] [Cycle 1]: 1.536e-05, [1] [cse]: 9.77001e-06 [auto_monad_reorder]: 1.468e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00045802 [symbol_engine_optimizer]: 7.184e-05, [1] [Cycle 1]: 6.592e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 7.18e-06 [elim_not_effective]: 1.357e-05 [opt_reshape]: 5.20999e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 3.60014e-07 [validate]: 7.646e-05 Sums bootstrap : 0.000294s : 0.15% type_inference : 0.193080s : 95.91% event_method : 0.000401s : 0.20% auto_monad : 0.000154s : 0.08% graph_reusing : 0.000010s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000053s : 0.03% rewriter_before_opt_a : 0.000210s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000219s : 0.11% jit_opt_a.loop_unroll : 0.000071s : 0.04% jit_opt_a.a_1 : 0.002896s : 1.44% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.00% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001748s : 0.87% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000039s : 0.02% jit_opt_a.replace_applicator : 0.000016s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000593s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000417s : 0.21% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000048s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000458s : 0.23% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000076s : 0.04% Time group info: ------[substitution.] 0.000738 56 0.23% : 0.000002s : 2: substitution.elim_not_effective 0.26% : 0.000002s : 2: substitution.fold_const_symbol 0.75% : 0.000006s : 3: substitution.graph_param_transform 87.10% : 0.000643s : 15: substitution.inline 0.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.96% : 0.000007s : 4: substitution.minmaximum_grad 0.54% : 0.000004s : 4: substitution.remove_not_recompute_node 0.78% : 0.000006s : 2: substitution.replace_old_param 2.28% : 0.000017s : 4: substitution.switch_simplify 1.82% : 0.000013s : 4: substitution.tuple_list_convert_item_index_to_positive 1.41% : 0.000010s : 4: substitution.tuple_list_get_item_depend_reorder 3.51% : 0.000026s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.192970 2 81.19% : 0.156680s : 1: type_inference.infer 18.81% : 0.036290s : 1: type_inference.specialize ------[replace.] 0.001438 23 13.97% : 0.000201s : 15: replace.inline 4.57% : 0.000066s : 4: replace.switch_simplify 81.46% : 0.001172s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000658 23 96.67% : 0.000636s : 15: match.inline 2.12% : 0.000014s : 4: match.switch_simplify 1.20% : 0.000008s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000221 1341 1.39% : 0.000003s : 21: predicate.accumulaten_eliminater 0.56% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000003s : 21: predicate.addn_check_dump 1.45% : 0.000003s : 21: predicate.addn_zero_filter 2.24% : 0.000005s : 21: predicate.arithmetic_simplify 1.47% : 0.000003s : 21: predicate.cast_eliminate 0.26% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000003s : 21: predicate.compare_switch_simplify 1.49% : 0.000003s : 21: predicate.depend_value_elim 1.26% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.38% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.30% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.57% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.30% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.22% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.31% : 0.000003s : 21: predicate.environ_get_depend_swap 1.39% : 0.000003s : 21: predicate.environ_get_eliminate 1.21% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.57% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.17% : 0.000014s : 46: predicate.inline 0.49% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.79% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 1.94% : 0.000004s : 28: predicate.load_eliminater 0.73% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.92% : 0.000011s : 78: predicate.loop_unroll_before_grad 1.78% : 0.000004s : 24: predicate.make_slice_get_slice_eliminator 1.25% : 0.000003s : 21: predicate.merge_addn 1.34% : 0.000003s : 21: predicate.minmaximum_grad 0.90% : 0.000002s : 3: predicate.mutable_eliminate 0.30% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000005s : 28: predicate.partial_eliminate 1.28% : 0.000003s : 21: predicate.print_const_string_wrapper 1.83% : 0.000004s : 21: predicate.reduce_eliminate 1.62% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.32% : 0.000001s : 6: predicate.remove_not_recompute_node 1.48% : 0.000003s : 31: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.16% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000003s : 21: predicate.reshape_eliminate 1.48% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000003s : 21: predicate.same_eliminate 0.33% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.46% : 0.000001s : 6: predicate.special_op_eliminate 0.53% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000004s : 21: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.23% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.55% : 0.000008s : 40: predicate.switch_defer_inline 2.81% : 0.000006s : 40: predicate.switch_layer_defer_inline 9.74% : 0.000022s : 129: predicate.switch_simplify 1.44% : 0.000003s : 21: predicate.tile_eliminate 1.49% : 0.000003s : 21: predicate.transpose_eliminate 1.56% : 0.000003s : 21: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000008s : 31: predicate.tuple_list_get_item_eliminator 1.67% : 0.000004s : 21: predicate.tuple_list_set_item_eliminator 1.61% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.70% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.30% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.66% : 0.000004s : 21: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.36% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003432 38 57.42% : 0.001971s : 15: func_graph_cloner_run.FuncGraphClonerGraph 10.67% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerNode 31.91% : 0.001095s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.210522 72 0.02% : 0.000051s : 1: add_recomputation 0.08% : 0.000162s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.15% : 0.000307s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.19% : 0.000409s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000013s : 1: graph_reusing 4.31% : 0.009082s : 1: jit_opt_a 0.07% : 0.000138s : 1: jit_opt_after_cconv 0.02% : 0.000050s : 1: jit_opt_b 0.20% : 0.000425s : 1: loop_unroll 0.29% : 0.000601s : 1: mutable_eliminate 1.57% : 0.003300s : 26: opt.transform.jit_opt_a 0.02% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000466s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000056s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.55% : 0.001165s : 1: renormalize.infer 0.27% : 0.000573s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.10% : 0.000215s : 1: rewriter_before_opt_a 0.04% : 0.000074s : 1: symbol_engine_optimizer 91.73% : 0.193104s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.243.988 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.244.652 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0385955, [30] [bootstrap]: 0.0003999 [type_inference]: 0.0208368 [event_method]: 2.25e-05 [auto_monad]: 7.731e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 5.814e-05 [rewriter_before_opt_a]: 8.465e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.0138016, [2] [Cycle 1]: 0.00368325, [27] [switch_simplify]: 0.00032996 [loop_unroll]: 0.000181 [a_1]: 0.00107109 [with_stream_mark]: 3.001e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.48999e-06 [parameter_eliminate]: 2.95002e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 5.02999e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.785e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 3.53e-06 [replace_old_param]: 1.152e-05 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00143911 [add_forward_monad_depend]: 9.07999e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 2.103e-05 [cse]: 4.47e-05 [replace_applicator]: 1.849e-05 [Cycle 2]: 0.00035789, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.72999e-06 [a_1]: 0.0001101 [with_stream_mark]: 1.516e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 3.00998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 7.85e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.45999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.57999e-06 [cse]: 1.291e-05 [replace_applicator]: 4.97999e-06 [py_interpret_to_execute_after_opt_a]: 3.201e-05 [rewriter_after_opt_a]: 4.372e-05 [convert_after_rewriter]: 7.45998e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00096022 [jit_opt_b]: 6.147e-05, [1] [Cycle 1]: 5.148e-05, [2] [frontend_op_eliminate]: 1.94e-05 [inline_after_opt_a]: 1.778e-05 [cconv]: 3.35e-05 [loop_unroll]: 0.00060743 [jit_opt_after_cconv]: 0.00024395, [1] [Cycle 1]: 0.00023383, [11] [c_1]: 2.771e-05 [parameter_eliminate]: 5.26002e-06 [updatestate_depend_eliminate]: 1.154e-05 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 4.208e-05 [call_graph_tuple_transform]: 2.638e-05 [tuple_list_get_item_eliminator]: 6.33002e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 9.70002e-07 [switch_simplify]: 7.92e-06 [remove_dup_value]: 2.109e-05 [partial_unused_args_eliminate]: 2.84001e-06 [environ_conv]: 7.87998e-06 [add_recomputation]: 6.599e-05 [cse_after_recomputation]: 3.289e-05, [1] [Cycle 1]: 2.587e-05, [1] [cse]: 1.705e-05 [auto_monad_reorder]: 2.092e-05 [get_jit_bprop_graph]: 3.08e-06 [rewriter_after_jit_bprop_graph]: 1.049e-05 [opt_after_jit_grad]: 0.00073233 [symbol_engine_optimizer]: 0.00010324, [1] [Cycle 1]: 9.187e-05, [6] [build]: 6.54999e-06 [elim_shapecalc]: 1.004e-05 [elim_not_effective]: 2.075e-05 [opt_reshape]: 8.12e-06 [fold_const_symbol]: 1.33e-05 [renormalize]: 2.10013e-07 [validate]: 6.381e-05 Sums bootstrap : 0.000400s : 1.44% type_inference : 0.020837s : 74.79% event_method : 0.000022s : 0.08% auto_monad : 0.000077s : 0.28% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000058s : 0.21% rewriter_before_opt_a : 0.000085s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000336s : 1.21% jit_opt_a.loop_unroll : 0.000187s : 0.67% jit_opt_a.a_1 : 0.001181s : 4.24% jit_opt_a.with_stream_mark : 0.000045s : 0.16% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001439s : 5.17% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.10% jit_opt_a.cse : 0.000058s : 0.21% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000032s : 0.11% rewriter_after_opt_a : 0.000044s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000960s : 3.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000034s : 0.12% loop_unroll : 0.000607s : 2.18% jit_opt_after_cconv.c_1 : 0.000028s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000021s : 0.08% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000066s : 0.24% cse_after_recomputation.cse : 0.000017s : 0.06% auto_monad_reorder : 0.000021s : 0.08% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.04% opt_after_jit_grad : 0.000732s : 2.63% symbol_engine_optimizer.build : 0.000007s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000064s : 0.23% Time group info: ------[substitution.] 0.000389 27 1.09% : 0.000004s : 2: substitution.elim_not_effective 0.79% : 0.000003s : 2: substitution.fold_const_symbol 1.87% : 0.000007s : 3: substitution.graph_param_transform 85.14% : 0.000331s : 5: substitution.inline 1.08% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.33% : 0.000013s : 3: substitution.reduce_eliminate 1.66% : 0.000006s : 4: substitution.remove_not_recompute_node 1.59% : 0.000006s : 2: substitution.replace_old_param 3.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020748 2 93.56% : 0.019413s : 1: type_inference.infer 6.44% : 0.001336s : 1: type_inference.specialize ------[replace.] 0.000122 7 68.51% : 0.000084s : 5: replace.inline 31.49% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000340 7 96.38% : 0.000328s : 5: match.inline 3.62% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000276 747 0.61% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.49% : 0.000001s : 11: predicate.addn_check_dump 0.67% : 0.000002s : 11: predicate.addn_zero_filter 1.18% : 0.000003s : 11: predicate.arithmetic_simplify 0.68% : 0.000002s : 11: predicate.cast_eliminate 0.23% : 0.000001s : 3: predicate.check_bprop_eliminate 0.52% : 0.000001s : 11: predicate.compare_switch_simplify 0.68% : 0.000002s : 11: predicate.depend_value_elim 0.69% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 0.59% : 0.000002s : 11: predicate.dict_get_item_eliminator 0.60% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.77% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000001s : 3: predicate.elim_not_effective 0.37% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.62% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.49% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.51% : 0.000001s : 11: predicate.environ_get_depend_swap 0.55% : 0.000002s : 11: predicate.environ_get_eliminate 0.62% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.11% : 0.000000s : 3: predicate.fold_const_symbol 0.46% : 0.000001s : 6: predicate.get_grad_eliminate 0.19% : 0.000001s : 3: predicate.graph_param_transform 3.10% : 0.000009s : 24: predicate.inline 0.41% : 0.000001s : 6: predicate.inline_without_move 0.17% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.59% : 0.000002s : 6: predicate.less_batch_normalization 0.79% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.09% : 0.000003s : 16: predicate.load_eliminater 1.14% : 0.000003s : 3: predicate.loop_unroll_after_grad 8.70% : 0.000024s : 38: predicate.loop_unroll_before_grad 1.54% : 0.000004s : 14: predicate.make_slice_get_slice_eliminator 0.57% : 0.000002s : 11: predicate.merge_addn 0.64% : 0.000002s : 11: predicate.minmaximum_grad 1.36% : 0.000004s : 3: predicate.mutable_eliminate 0.19% : 0.000001s : 3: predicate.opt_reshape 1.05% : 0.000003s : 16: predicate.partial_eliminate 0.70% : 0.000002s : 11: predicate.print_const_string_wrapper 1.12% : 0.000003s : 11: predicate.reduce_eliminate 0.77% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000001s : 6: predicate.remove_not_recompute_node 0.89% : 0.000002s : 19: predicate.replace_applicator 0.31% : 0.000001s : 6: predicate.replace_old_param 0.12% : 0.000000s : 3: predicate.reset_defer_inline 0.60% : 0.000002s : 11: predicate.reshape_eliminate 0.81% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.34% : 0.000001s : 3: predicate.row_tensor_eliminate 1.01% : 0.000003s : 11: predicate.same_eliminate 0.26% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.53% : 0.000001s : 6: predicate.special_op_eliminate 0.41% : 0.000001s : 6: predicate.specialize_transform 0.82% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 0.65% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.23% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.56% : 0.000004s : 18: predicate.switch_defer_inline 3.99% : 0.000011s : 18: predicate.switch_layer_defer_inline 13.42% : 0.000037s : 59: predicate.switch_simplify 0.67% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000003s : 11: predicate.transpose_eliminate 0.80% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 0.89% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 27.85% : 0.000077s : 19: predicate.tuple_list_get_item_eliminator 1.17% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 0.90% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 0.92% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 1.28% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 0.86% : 0.000002s : 11: predicate.value_based_eliminate 0.15% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.32% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001415 16 53.87% : 0.000762s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.47% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.66% : 0.000547s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041926 72 0.17% : 0.000071s : 1: add_recomputation 0.19% : 0.000081s : 1: auto_monad 0.06% : 0.000025s : 1: auto_monad_reorder 1.01% : 0.000424s : 1: bootstrap 0.09% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000035s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 32.93% : 0.013806s : 1: jit_opt_a 0.59% : 0.000247s : 1: jit_opt_after_cconv 0.15% : 0.000064s : 1: jit_opt_b 1.48% : 0.000619s : 1: loop_unroll 2.33% : 0.000975s : 1: mutable_eliminate 4.38% : 0.001838s : 26: opt.transform.jit_opt_a 0.15% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000021s : 1: opt.transform.mutable_eliminate 0.08% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000047s : 4: opt.transform.symbol_engine_opt 1.78% : 0.000747s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000061s : 1: py_interpret_to_execute 0.08% : 0.000035s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000025s : 1: remove_dup_value 1.90% : 0.000795s : 1: renormalize.infer 1.51% : 0.000632s : 1: renormalize.specialize 0.03% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000047s : 1: rewriter_after_opt_a 0.21% : 0.000088s : 1: rewriter_before_opt_a 0.26% : 0.000107s : 1: symbol_engine_optimizer 49.75% : 0.020857s : 1: type_inference TotalTime = 0.0770994, [30] [bootstrap]: 0.00026946 [type_inference]: 0.0672942 [event_method]: 2.178e-05 [auto_monad]: 7.52e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00012402 [rewriter_before_opt_a]: 8.44e-05 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.00676918, [2] [Cycle 1]: 0.00235879, [27] [switch_simplify]: 6.232e-05 [loop_unroll]: 3.1e-05 [a_1]: 0.00060872 [with_stream_mark]: 2.248e-05 [recompute_prepare]: 1.025e-05 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 7.82998e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.74999e-06 [get_grad_eliminate_]: 6.03998e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 1.042e-05 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 6.34999e-06 [renormalize]: 0.00119769 [add_forward_monad_depend]: 1.635e-05 [auto_monad_grad]: 3.17002e-06 [auto_monad_eliminator]: 2.364e-05 [cse]: 3.874e-05 [replace_applicator]: 2.102e-05 [Cycle 2]: 0.00035751, [27] [switch_simplify]: 6.06e-06 [loop_unroll]: 6.13998e-06 [a_1]: 9.615e-05 [with_stream_mark]: 1.407e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 4.18999e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.68002e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.695e-05 [j_node_and_user_rematch]: 9.21002e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 8.15e-06 [cse]: 1.493e-05 [replace_applicator]: 5.84999e-06 [py_interpret_to_execute_after_opt_a]: 1.479e-05 [rewriter_after_opt_a]: 3.964e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00073919 [jit_opt_b]: 5.301e-05, [1] [Cycle 1]: 4.436e-05, [2] [frontend_op_eliminate]: 1.667e-05 [inline_after_opt_a]: 1.634e-05 [cconv]: 2.657e-05 [loop_unroll]: 0.00045041 [jit_opt_after_cconv]: 0.00015329, [1] [Cycle 1]: 0.00014588, [11] [c_1]: 2.148e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.788e-05 [call_graph_tuple_transform]: 1.998e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.58e-06 [add_recomputation]: 4.939e-05 [cse_after_recomputation]: 5.574e-05, [1] [Cycle 1]: 2.083e-05, [1] [cse]: 1.425e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.57001e-06 [opt_after_jit_grad]: 0.00049305 [symbol_engine_optimizer]: 7.597e-05, [1] [Cycle 1]: 6.962e-05, [6] [build]: 4.33999e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 4.7998e-07 [validate]: 4.165e-05 Sums bootstrap : 0.000269s : 0.37% type_inference : 0.067294s : 93.00% event_method : 0.000022s : 0.03% auto_monad : 0.000075s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000124s : 0.17% rewriter_before_opt_a : 0.000084s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000705s : 0.97% jit_opt_a.with_stream_mark : 0.000037s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001198s : 1.66% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.04% jit_opt_a.cse : 0.000054s : 0.07% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000739s : 1.02% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000450s : 0.62% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000493s : 0.68% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.06% Time group info: ------[substitution.] 0.000218 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000006s : 3: substitution.graph_param_transform 81.41% : 0.000178s : 4: substitution.inline 2.02% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 2.74% : 0.000006s : 2: substitution.replace_old_param 7.33% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067202 2 97.64% : 0.065614s : 1: type_inference.infer 2.36% : 0.001588s : 1: type_inference.specialize ------[replace.] 0.000100 6 54.86% : 0.000055s : 4: replace.inline 45.14% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 92.36% : 0.000175s : 4: match.inline 7.64% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000007s : 22: predicate.inline 1.20% : 0.000002s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.21% : 0.000003s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.08% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.57% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 15: predicate.partial_eliminate 1.38% : 0.000002s : 10: predicate.print_const_string_wrapper 2.27% : 0.000003s : 10: predicate.reduce_eliminate 1.82% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.47% : 0.000002s : 10: predicate.reshape_eliminate 1.53% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.85% : 0.000004s : 16: predicate.switch_defer_inline 1.89% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.96% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.87% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.02% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.47% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000799 13 43.70% : 0.000349s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.70% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.61% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079309 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000080s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.36% : 0.000288s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000058s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.54% : 0.006772s : 1: jit_opt_a 0.20% : 0.000156s : 1: jit_opt_after_cconv 0.07% : 0.000056s : 1: jit_opt_b 0.58% : 0.000458s : 1: loop_unroll 0.95% : 0.000751s : 1: mutable_eliminate 1.20% : 0.000953s : 26: opt.transform.jit_opt_a 0.06% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000503s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000129s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.92% : 0.000733s : 1: renormalize.infer 0.57% : 0.000454s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.11% : 0.000089s : 1: rewriter_before_opt_a 0.10% : 0.000079s : 1: symbol_engine_optimizer 84.88% : 0.067319s : 1: type_inference TotalTime = 0.0282956, [30] [bootstrap]: 0.00027218 [type_inference]: 0.0196704 [event_method]: 1.77e-05 [auto_monad]: 6.88e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 8.957e-05 [rewriter_before_opt_a]: 7.743e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00499364, [2] [Cycle 1]: 0.00162601, [27] [switch_simplify]: 4.975e-05 [loop_unroll]: 2.878e-05 [a_1]: 0.00049589 [with_stream_mark]: 1.581e-05 [recompute_prepare]: 6.84001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.60002e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 0.00072004 [add_forward_monad_depend]: 5.54998e-06 [auto_monad_grad]: 1.86e-06 [auto_monad_eliminator]: 1.436e-05 [cse]: 3.357e-05 [replace_applicator]: 1.295e-05 [Cycle 2]: 0.00033154, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.34998e-06 [a_1]: 9.499e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.309e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 7.45998e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.66998e-06 [cse]: 1.265e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 1.007e-05 [rewriter_after_opt_a]: 6.061e-05 [convert_after_rewriter]: 8.72e-06 [order_py_execute_after_rewriter]: 7.63001e-06 [mutable_eliminate]: 0.00058253 [jit_opt_b]: 5.342e-05, [1] [Cycle 1]: 4.58e-05, [2] [frontend_op_eliminate]: 1.691e-05 [inline_after_opt_a]: 1.706e-05 [cconv]: 3.109e-05 [loop_unroll]: 0.00045521 [jit_opt_after_cconv]: 0.00015911, [1] [Cycle 1]: 0.00015247, [11] [c_1]: 2.237e-05 [parameter_eliminate]: 3.14001e-06 [updatestate_depend_eliminate]: 7.36999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.886e-05 [call_graph_tuple_transform]: 2.091e-05 [tuple_list_get_item_eliminator]: 6.08998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.79e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 6.73998e-06 [add_recomputation]: 5.494e-05 [cse_after_recomputation]: 5.023e-05, [1] [Cycle 1]: 1.887e-05, [1] [cse]: 1.282e-05 [auto_monad_reorder]: 1.959e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 6.47001e-06 [opt_after_jit_grad]: 0.00045675 [symbol_engine_optimizer]: 7.071e-05, [1] [Cycle 1]: 6.472e-05, [6] [build]: 4e-06 [elim_shapecalc]: 7.50998e-06 [elim_not_effective]: 1.266e-05 [opt_reshape]: 5.72999e-06 [fold_const_symbol]: 8.43001e-06 [renormalize]: 4.19997e-07 [validate]: 3.961e-05 Sums bootstrap : 0.000272s : 1.14% type_inference : 0.019670s : 82.51% event_method : 0.000018s : 0.07% auto_monad : 0.000069s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000090s : 0.38% rewriter_before_opt_a : 0.000077s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.23% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000591s : 2.48% jit_opt_a.with_stream_mark : 0.000025s : 0.11% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000720s : 3.02% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000046s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000061s : 0.25% convert_after_rewriter : 0.000009s : 0.04% order_py_execute_after_rewriter : 0.000008s : 0.03% mutable_eliminate : 0.000583s : 2.44% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000031s : 0.13% loop_unroll : 0.000455s : 1.91% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.23% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000020s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000457s : 1.92% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.17% Time group info: ------[substitution.] 0.000183 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.38% : 0.000006s : 3: substitution.graph_param_transform 81.89% : 0.000150s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.87% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 6.33% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019606 2 93.87% : 0.018403s : 1: type_inference.infer 6.13% : 0.001203s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.64% : 0.000043s : 4: replace.inline 32.36% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.31% : 0.000148s : 4: match.inline 6.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.33% : 0.000002s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.19% : 0.000003s : 15: predicate.load_eliminater 1.65% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.76% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.30% : 0.000008s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000692 13 51.28% : 0.000355s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.42% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.30% : 0.000307s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029877 72 0.19% : 0.000058s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.08% : 0.000022s : 1: auto_monad_reorder 0.97% : 0.000290s : 1: bootstrap 0.11% : 0.000034s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.18% : 0.000053s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000021s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 16.72% : 0.004996s : 1: jit_opt_a 0.54% : 0.000162s : 1: jit_opt_after_cconv 0.19% : 0.000056s : 1: jit_opt_b 1.55% : 0.000464s : 1: loop_unroll 1.98% : 0.000592s : 1: mutable_eliminate 2.67% : 0.000799s : 26: opt.transform.jit_opt_a 0.17% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000464s : 1: opt_after_jit_grad 0.03% : 0.000010s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000093s : 1: py_interpret_to_execute 2.81% : 0.000838s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000021s : 1: remove_dup_value 1.37% : 0.000410s : 1: renormalize.infer 1.01% : 0.000303s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000067s : 1: rewriter_after_opt_a 0.27% : 0.000081s : 1: rewriter_before_opt_a 0.24% : 0.000073s : 1: symbol_engine_optimizer 65.88% : 0.019683s : 1: type_inference TotalTime = 0.166007, [30] [bootstrap]: 0.00025073 [type_inference]: 0.130908 [event_method]: 0.00067026 [auto_monad]: 0.00013768 [graph_reusing]: 8.32e-06 [pre_auto_parallel]: 3.27002e-06 [py_interpret_to_execute]: 0.00010255 [rewriter_before_opt_a]: 0.00015346 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.0310815, [3] [Cycle 1]: 0.0214416, [27] [switch_simplify]: 0.00018152 [loop_unroll]: 4.833e-05 [a_1]: 0.00114693 [with_stream_mark]: 3.816e-05 [recompute_prepare]: 2.806e-05 [updatestate_depend_eliminate]: 1.207e-05 [updatestate_assign_eliminate]: 7.15e-06 [updatestate_loads_eliminate]: 6.94999e-06 [parameter_eliminate]: 2.95002e-06 [specialize_transform]: 1.636e-05 [updatestate_useless_node_eliminater]: 1.397e-05 [accelerated_algorithm]: 1.78e-05 [meta_shard_fg_expand]: 7.11999e-06 [get_grad_eliminate_]: 1.738e-05 [merge_forward]: 1.153e-05 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.556e-05 [j_node_and_user_rematch]: 2.876e-05 [meta_fg_expand]: 0.00246993 [replace_old_param]: 9.56e-05 [inline_without_move]: 6.981e-05 [renormalize]: 0.0163649 [add_forward_monad_depend]: 1.639e-05 [auto_monad_grad]: 7.17002e-06 [auto_monad_eliminator]: 6.859e-05 [cse]: 0.00031682 [replace_applicator]: 9.824e-05 [Cycle 2]: 0.0053118, [27] [switch_simplify]: 4.547e-05 [loop_unroll]: 4.289e-05 [a_1]: 0.0017568 [with_stream_mark]: 3.129e-05 [recompute_prepare]: 1.602e-05 [updatestate_depend_eliminate]: 5.84999e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 4.78001e-06 [parameter_eliminate]: 2.59001e-06 [specialize_transform]: 9.04e-06 [updatestate_useless_node_eliminater]: 7.36001e-06 [accelerated_algorithm]: 9.19e-06 [meta_shard_fg_expand]: 4.72e-06 [get_grad_eliminate_]: 7.63001e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.191e-05 [j_node_and_user_rematch]: 1.3e-05 [meta_fg_expand]: 0.00019907 [replace_old_param]: 1.276e-05 [inline_without_move]: 7.23e-06 [renormalize]: 0.0027821 [add_forward_monad_depend]: 1.068e-05 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.824e-05 [cse]: 3.47e-05 [replace_applicator]: 2.208e-05 [Cycle 3]: 0.00030541, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 4.79e-06 [a_1]: 6.01e-05 [with_stream_mark]: 1.473e-05 [recompute_prepare]: 4.13999e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 3.95e-06 [updatestate_useless_node_eliminater]: 3.13998e-06 [accelerated_algorithm]: 4.05e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 3.13e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 2.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 3.85e-06 [inline_without_move]: 3.25e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 4.40999e-06 [cse]: 1.152e-05 [replace_applicator]: 3.80998e-06 [py_interpret_to_execute_after_opt_a]: 1.457e-05 [rewriter_after_opt_a]: 3.994e-05 [convert_after_rewriter]: 6.04001e-06 [order_py_execute_after_rewriter]: 4.25e-06 [mutable_eliminate]: 0.00078978 [jit_opt_b]: 4.749e-05, [1] [Cycle 1]: 3.976e-05, [2] [frontend_op_eliminate]: 1.313e-05 [inline_after_opt_a]: 1.342e-05 [cconv]: 2.816e-05 [loop_unroll]: 0.00059789 [jit_opt_after_cconv]: 0.00014492, [1] [Cycle 1]: 0.00013843, [11] [c_1]: 1.491e-05 [parameter_eliminate]: 3.68999e-06 [updatestate_depend_eliminate]: 5.97001e-06 [updatestate_assign_eliminate]: 1.96e-06 [updatestate_loads_eliminate]: 1.67001e-06 [cse]: 2.606e-05 [call_graph_tuple_transform]: 1.876e-05 [tuple_list_get_item_eliminator]: 4.13999e-06 [none_parameter_eliminate]: 1.34998e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 4.35e-06 [remove_dup_value]: 1.562e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.07999e-06 [add_recomputation]: 3.926e-05 [cse_after_recomputation]: 2.028e-05, [1] [Cycle 1]: 1.513e-05, [1] [cse]: 7.70998e-06 [auto_monad_reorder]: 1.326e-05 [get_jit_bprop_graph]: 2.98e-06 [rewriter_after_jit_bprop_graph]: 6.69999e-06 [opt_after_jit_grad]: 0.00046248 [symbol_engine_optimizer]: 7.132e-05, [1] [Cycle 1]: 6.545e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 7.46001e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 4.57e-06 [fold_const_symbol]: 7.63001e-06 [renormalize]: 3.80009e-07 [validate]: 0.0001495 Sums bootstrap : 0.000251s : 0.16% type_inference : 0.130908s : 81.33% event_method : 0.000670s : 0.42% auto_monad : 0.000138s : 0.09% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000103s : 0.06% rewriter_before_opt_a : 0.000153s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000234s : 0.15% jit_opt_a.loop_unroll : 0.000096s : 0.06% jit_opt_a.a_1 : 0.002964s : 1.84% jit_opt_a.with_stream_mark : 0.000084s : 0.05% jit_opt_a.recompute_prepare : 0.000048s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000021s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000031s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000014s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000028s : 0.02% jit_opt_a.merge_forward : 0.000020s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000072s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000050s : 0.03% jit_opt_a.meta_fg_expand : 0.002671s : 1.66% jit_opt_a.replace_old_param : 0.000112s : 0.07% jit_opt_a.inline_without_move : 0.000080s : 0.05% jit_opt_a.renormalize : 0.019147s : 11.90% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000091s : 0.06% jit_opt_a.cse : 0.000363s : 0.23% jit_opt_a.replace_applicator : 0.000124s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000790s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000598s : 0.37% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000039s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000462s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000150s : 0.09% Time group info: ------[substitution.] 0.000812 104 0.54% : 0.000004s : 1: substitution.elim_not_effective 0.13% : 0.000001s : 1: substitution.fold_const_symbol 0.61% : 0.000005s : 1: substitution.graph_param_transform 69.85% : 0.000567s : 13: substitution.inline 3.14% : 0.000025s : 2: substitution.inline_without_move 1.54% : 0.000012s : 12: substitution.j_node_and_user_rematch 1.63% : 0.000013s : 7: substitution.minmaximum_grad 1.16% : 0.000009s : 5: substitution.partial_eliminate 1.84% : 0.000015s : 12: substitution.remove_not_recompute_node 4.54% : 0.000037s : 10: substitution.replace_applicator 1.58% : 0.000013s : 10: substitution.replace_old_param 0.55% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.88% : 0.000007s : 1: substitution.tile_eliminate 3.40% : 0.000028s : 7: substitution.tuple_list_convert_item_index_to_positive 2.24% : 0.000018s : 7: substitution.tuple_list_get_item_depend_reorder 6.38% : 0.000052s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.130766 2 96.24% : 0.125847s : 1: type_inference.infer 3.76% : 0.004918s : 1: type_inference.specialize ------[replace.] 0.000252 20 64.18% : 0.000162s : 13: replace.inline 35.82% : 0.000090s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000583 20 95.57% : 0.000557s : 13: match.inline 4.43% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000418 2544 1.43% : 0.000006s : 44: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000006s : 44: predicate.addn_check_dump 1.54% : 0.000006s : 44: predicate.addn_zero_filter 1.95% : 0.000008s : 44: predicate.arithmetic_simplify 1.82% : 0.000008s : 44: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.45% : 0.000006s : 44: predicate.compare_switch_simplify 1.30% : 0.000005s : 44: predicate.depend_value_elim 1.73% : 0.000007s : 44: predicate.dict_get_item_const_eliminator 1.46% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.57% : 0.000007s : 44: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.07% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.32% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.32% : 0.000006s : 44: predicate.environ_get_depend_swap 1.48% : 0.000006s : 44: predicate.environ_get_eliminate 1.43% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.83% : 0.000003s : 17: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.67% : 0.000020s : 66: predicate.inline 1.94% : 0.000008s : 45: predicate.inline_without_move 0.32% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.58% : 0.000007s : 17: predicate.less_batch_normalization 1.77% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.89% : 0.000008s : 52: predicate.load_eliminater 0.42% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.59% : 0.000015s : 92: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.51% : 0.000006s : 44: predicate.merge_addn 1.40% : 0.000006s : 44: predicate.minmaximum_grad 0.51% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.22% : 0.000009s : 52: predicate.partial_eliminate 1.47% : 0.000006s : 44: predicate.print_const_string_wrapper 2.16% : 0.000009s : 44: predicate.reduce_eliminate 1.87% : 0.000008s : 51: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000002s : 17: predicate.remove_not_recompute_node 2.63% : 0.000011s : 96: predicate.replace_applicator 1.24% : 0.000005s : 45: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000007s : 44: predicate.reshape_eliminate 1.43% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000006s : 44: predicate.same_eliminate 0.51% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.72% : 0.000003s : 17: predicate.specialize_transform 1.77% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.37% : 0.000014s : 64: predicate.switch_defer_inline 2.32% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.37% : 0.000027s : 157: predicate.switch_simplify 2.06% : 0.000009s : 44: predicate.tile_eliminate 1.51% : 0.000006s : 44: predicate.transpose_eliminate 2.09% : 0.000009s : 44: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000015s : 53: predicate.tuple_list_get_item_eliminator 1.91% : 0.000008s : 44: predicate.tuple_list_set_item_eliminator 1.83% : 0.000008s : 51: predicate.tuple_to_list_eliminator_ 1.63% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.49% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.91% : 0.000008s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.09% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004756 45 72.33% : 0.003440s : 28: func_graph_cloner_run.FuncGraphClonerGraph 27.67% : 0.001316s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.188870 87 0.02% : 0.000042s : 1: add_recomputation 0.08% : 0.000147s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.15% : 0.000274s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.36% : 0.000682s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 16.46% : 0.031086s : 1: jit_opt_a 0.08% : 0.000148s : 1: jit_opt_after_cconv 0.03% : 0.000050s : 1: jit_opt_b 0.32% : 0.000608s : 1: loop_unroll 0.42% : 0.000800s : 1: mutable_eliminate 2.03% : 0.003826s : 39: opt.transform.jit_opt_a 0.02% : 0.000039s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000029s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000470s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000106s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 8.45% : 0.015953s : 2: renormalize.infer 1.67% : 0.003163s : 2: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000158s : 1: rewriter_before_opt_a 0.04% : 0.000074s : 1: symbol_engine_optimizer 69.33% : 0.130939s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.435.877 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d940> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.436.540 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.132799, [30] [bootstrap]: 0.00035141 [type_inference]: 0.108168 [event_method]: 2.657e-05 [auto_monad]: 7.433e-05 [graph_reusing]: 6.89999e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.00031203 [rewriter_before_opt_a]: 0.00010021 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.0213662, [2] [Cycle 1]: 0.00419736, [27] [switch_simplify]: 6.369e-05 [loop_unroll]: 3.765e-05 [a_1]: 0.00072375 [with_stream_mark]: 1.862e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00299561 [add_forward_monad_depend]: 6.38003e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.53e-05 [cse]: 3.826e-05 [replace_applicator]: 1.47e-05 [Cycle 2]: 0.0137253, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 5.99e-06 [a_1]: 0.00015591 [with_stream_mark]: 1.119e-05 [recompute_prepare]: 6.53e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.05002e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 0.0132062 [meta_fg_expand]: 8.24002e-06 [replace_old_param]: 2.978e-05 [inline_without_move]: 7.95e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.59e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 2.094e-05 [cse]: 4.053e-05 [replace_applicator]: 7.20998e-06 [py_interpret_to_execute_after_opt_a]: 1.891e-05 [rewriter_after_opt_a]: 4.564e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00072254 [jit_opt_b]: 6.291e-05, [1] [Cycle 1]: 5.427e-05, [2] [frontend_op_eliminate]: 2.108e-05 [inline_after_opt_a]: 2.122e-05 [cconv]: 2.513e-05 [loop_unroll]: 0.00042098 [jit_opt_after_cconv]: 0.00016685, [1] [Cycle 1]: 0.00016031, [11] [c_1]: 2.675e-05 [parameter_eliminate]: 3.22002e-06 [updatestate_depend_eliminate]: 7.26001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.24001e-06 [cse]: 2.888e-05 [call_graph_tuple_transform]: 2.176e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.61e-06 [remove_dup_value]: 2.094e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 1.004e-05 [add_recomputation]: 5.547e-05 [cse_after_recomputation]: 2.696e-05, [1] [Cycle 1]: 2.04e-05, [1] [cse]: 1.459e-05 [auto_monad_reorder]: 2.005e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.10998e-06 [opt_after_jit_grad]: 0.00045216 [symbol_engine_optimizer]: 7.88e-05, [1] [Cycle 1]: 7.224e-05, [6] [build]: 4.37e-06 [elim_shapecalc]: 9.63002e-06 [elim_not_effective]: 1.419e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 1.011e-05 [renormalize]: 4.69998e-07 [validate]: 5.082e-05 Sums bootstrap : 0.000351s : 0.27% type_inference : 0.108168s : 84.04% event_method : 0.000027s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000312s : 0.24% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.05% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.000880s : 0.68% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.013216s : 10.27% jit_opt_a.meta_fg_expand : 0.000011s : 0.01% jit_opt_a.replace_old_param : 0.000040s : 0.03% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.002996s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.03% jit_opt_a.cse : 0.000079s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000723s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000421s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000452s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000304 25 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000007s : 4: substitution.graph_param_transform 87.32% : 0.000265s : 5: substitution.inline 1.05% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.44% : 0.000007s : 2: substitution.replace_old_param 4.06% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108075 2 97.78% : 0.105677s : 1: type_inference.infer 2.22% : 0.002398s : 1: type_inference.specialize ------[replace.] 0.000098 7 68.69% : 0.000067s : 5: replace.inline 31.31% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 95.94% : 0.000262s : 5: match.inline 4.06% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.013316 888 0.01% : 0.000002s : 13: predicate.accumulaten_eliminater 0.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.01% : 0.000002s : 13: predicate.addn_check_dump 0.01% : 0.000002s : 13: predicate.addn_zero_filter 0.02% : 0.000002s : 13: predicate.arithmetic_simplify 0.01% : 0.000002s : 13: predicate.cast_eliminate 0.00% : 0.000001s : 4: predicate.check_bprop_eliminate 0.01% : 0.000002s : 13: predicate.compare_switch_simplify 0.01% : 0.000002s : 13: predicate.depend_value_elim 0.01% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.01% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.01% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.01% : 0.000001s : 4: predicate.elim_not_effective 0.01% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.01% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.01% : 0.000002s : 13: predicate.environ_get_depend_swap 0.01% : 0.000002s : 13: predicate.environ_get_eliminate 0.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 4: predicate.fold_const_symbol 0.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.00% : 0.000000s : 4: predicate.graph_param_transform 0.06% : 0.000008s : 28: predicate.inline 0.02% : 0.000002s : 8: predicate.inline_without_move 98.95% : 0.013177s : 8: predicate.j_node_and_user_rematch 0.01% : 0.000002s : 8: predicate.less_batch_normalization 0.01% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 0.02% : 0.000003s : 19: predicate.load_eliminater 0.01% : 0.000001s : 4: predicate.loop_unroll_after_grad 0.04% : 0.000006s : 41: predicate.loop_unroll_before_grad 0.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.01% : 0.000002s : 13: predicate.merge_addn 0.01% : 0.000002s : 13: predicate.minmaximum_grad 0.02% : 0.000003s : 4: predicate.mutable_eliminate 0.01% : 0.000001s : 4: predicate.opt_reshape 0.02% : 0.000003s : 19: predicate.partial_eliminate 0.01% : 0.000002s : 13: predicate.print_const_string_wrapper 0.02% : 0.000002s : 13: predicate.reduce_eliminate 0.01% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.01% : 0.000001s : 8: predicate.remove_not_recompute_node 0.02% : 0.000003s : 23: predicate.replace_applicator 0.01% : 0.000001s : 8: predicate.replace_old_param 0.00% : 0.000001s : 4: predicate.reset_defer_inline 0.01% : 0.000002s : 13: predicate.reshape_eliminate 0.01% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.01% : 0.000001s : 4: predicate.row_tensor_eliminate 0.01% : 0.000002s : 13: predicate.same_eliminate 0.01% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.01% : 0.000002s : 8: predicate.special_op_eliminate 0.01% : 0.000001s : 8: predicate.specialize_transform 0.02% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.02% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.01% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.03% : 0.000003s : 20: predicate.switch_defer_inline 0.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 0.08% : 0.000010s : 65: predicate.switch_simplify 0.01% : 0.000002s : 13: predicate.tile_eliminate 0.01% : 0.000002s : 13: predicate.transpose_eliminate 0.02% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.01% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 0.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 0.02% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 0.02% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.02% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 0.03% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 0.02% : 0.000002s : 13: predicate.value_based_eliminate 0.00% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.01% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002688 29 70.74% : 0.001902s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.51% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.75% : 0.000719s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.150210 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.24% : 0.000366s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 14.23% : 0.021370s : 1: jit_opt_a 0.11% : 0.000170s : 1: jit_opt_after_cconv 0.04% : 0.000066s : 1: jit_opt_b 0.29% : 0.000429s : 1: loop_unroll 0.49% : 0.000732s : 1: mutable_eliminate 9.55% : 0.014345s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000460s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000320s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.55% : 0.002323s : 1: renormalize.infer 0.44% : 0.000664s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.07% : 0.000105s : 1: rewriter_before_opt_a 0.05% : 0.000081s : 1: symbol_engine_optimizer 72.03% : 0.108190s : 1: type_inference TotalTime = 0.0661557, [30] [bootstrap]: 0.0002907 [type_inference]: 0.0576683 [event_method]: 1.778e-05 [auto_monad]: 6.732e-05 [graph_reusing]: 5.14e-06 [pre_auto_parallel]: 2.01003e-06 [py_interpret_to_execute]: 0.00011109 [rewriter_before_opt_a]: 7.249e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00570279, [2] [Cycle 1]: 0.0018459, [27] [switch_simplify]: 4.883e-05 [loop_unroll]: 2.945e-05 [a_1]: 0.00051897 [with_stream_mark]: 1.729e-05 [recompute_prepare]: 7.25e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 7.7e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.323e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.81e-06 [renormalize]: 0.00089761 [add_forward_monad_depend]: 5.89e-06 [auto_monad_grad]: 2.95998e-06 [auto_monad_eliminator]: 1.475e-05 [cse]: 3.222e-05 [replace_applicator]: 1.356e-05 [Cycle 2]: 0.00040839, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 5.30999e-06 [a_1]: 0.00015729 [with_stream_mark]: 1.164e-05 [recompute_prepare]: 6.66e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 2.75002e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.301e-05 [j_node_and_user_rematch]: 8.04002e-06 [meta_fg_expand]: 1.76003e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.41998e-06 [auto_monad_grad]: 1.34003e-06 [auto_monad_eliminator]: 8.11002e-06 [cse]: 1.623e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 1.204e-05 [rewriter_after_opt_a]: 3.725e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00056765 [jit_opt_b]: 5.196e-05, [1] [Cycle 1]: 4.496e-05, [2] [frontend_op_eliminate]: 1.718e-05 [inline_after_opt_a]: 1.696e-05 [cconv]: 2.756e-05 [loop_unroll]: 0.00042924 [jit_opt_after_cconv]: 0.00014981, [1] [Cycle 1]: 0.00014277, [11] [c_1]: 2.125e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 6.74999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 2.453e-05 [call_graph_tuple_transform]: 1.938e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 6.58e-06 [add_recomputation]: 5.351e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.799e-05, [1] [cse]: 1.244e-05 [auto_monad_reorder]: 1.821e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.37001e-06 [opt_after_jit_grad]: 0.00048403 [symbol_engine_optimizer]: 7.49e-05, [1] [Cycle 1]: 6.878e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 8.43999e-06 [elim_not_effective]: 1.341e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 9.37001e-06 [renormalize]: 4.19997e-07 [validate]: 4.333e-05 Sums bootstrap : 0.000291s : 0.47% type_inference : 0.057668s : 92.86% event_method : 0.000018s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000111s : 0.18% rewriter_before_opt_a : 0.000072s : 0.12% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000055s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000676s : 1.09% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000898s : 1.45% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000048s : 0.08% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000568s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000429s : 0.69% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000484s : 0.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000189 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 3: substitution.graph_param_transform 82.68% : 0.000157s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000004s : 4: substitution.remove_not_recompute_node 2.33% : 0.000004s : 2: substitution.replace_old_param 6.27% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057593 2 53.58% : 0.030858s : 1: type_inference.infer 46.42% : 0.026735s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.47% : 0.000044s : 4: replace.inline 33.53% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.50% : 0.000154s : 4: match.inline 6.50% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.37% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.82% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.97% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 1.29% : 0.000002s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.00% : 0.000008s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.16% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000782 13 45.03% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.41% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.55% : 0.000395s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067971 72 0.08% : 0.000056s : 1: add_recomputation 0.10% : 0.000071s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.45% : 0.000305s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 8.39% : 0.005706s : 1: jit_opt_a 0.22% : 0.000152s : 1: jit_opt_after_cconv 0.08% : 0.000054s : 1: jit_opt_b 0.64% : 0.000438s : 1: loop_unroll 0.85% : 0.000577s : 1: mutable_eliminate 1.31% : 0.000889s : 26: opt.transform.jit_opt_a 0.07% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000493s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000115s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.79% : 0.000535s : 1: renormalize.infer 0.52% : 0.000355s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.11% : 0.000076s : 1: rewriter_before_opt_a 0.11% : 0.000078s : 1: symbol_engine_optimizer 84.86% : 0.057682s : 1: type_inference TotalTime = 0.0168751, [30] [bootstrap]: 0.00027022 [type_inference]: 0.00834796 [event_method]: 2.296e-05 [auto_monad]: 7.258e-05 [graph_reusing]: 6.26998e-06 [pre_auto_parallel]: 3.02002e-06 [py_interpret_to_execute]: 4.548e-05 [rewriter_before_opt_a]: 9.199e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00582172, [2] [Cycle 1]: 0.00202233, [27] [switch_simplify]: 6.697e-05 [loop_unroll]: 3.324e-05 [a_1]: 0.00067659 [with_stream_mark]: 2.334e-05 [recompute_prepare]: 8.13999e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.53999e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.36998e-06 [merge_forward]: 4.59002e-06 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00086188 [add_forward_monad_depend]: 6.41998e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.519e-05 [cse]: 4.185e-05 [replace_applicator]: 1.271e-05 [Cycle 2]: 0.00032455, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.011e-05 [with_stream_mark]: 1e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.78001e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 8.51002e-06 [meta_fg_expand]: 1.88997e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.99e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.49e-05 [replace_applicator]: 5.47999e-06 [py_interpret_to_execute_after_opt_a]: 1.31e-05 [rewriter_after_opt_a]: 3.922e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00054723 [jit_opt_b]: 5.038e-05, [1] [Cycle 1]: 4.315e-05, [2] [frontend_op_eliminate]: 1.535e-05 [inline_after_opt_a]: 1.617e-05 [cconv]: 2.719e-05 [loop_unroll]: 0.00042156 [jit_opt_after_cconv]: 0.0001555, [1] [Cycle 1]: 0.00014838, [11] [c_1]: 2.195e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 6.58e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.825e-05 [call_graph_tuple_transform]: 2.033e-05 [tuple_list_get_item_eliminator]: 5.97999e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 3.57e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.92999e-06 [add_recomputation]: 5.297e-05 [cse_after_recomputation]: 2.535e-05, [1] [Cycle 1]: 1.954e-05, [1] [cse]: 1.317e-05 [auto_monad_reorder]: 1.804e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00045114 [symbol_engine_optimizer]: 7.159e-05, [1] [Cycle 1]: 6.571e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 7.99002e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 5.73002e-06 [fold_const_symbol]: 8.49002e-06 [renormalize]: 4.60015e-07 [validate]: 4.055e-05 Sums bootstrap : 0.000270s : 2.12% type_inference : 0.008348s : 65.35% event_method : 0.000023s : 0.18% auto_monad : 0.000073s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000045s : 0.36% rewriter_before_opt_a : 0.000092s : 0.72% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.57% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000767s : 6.00% jit_opt_a.with_stream_mark : 0.000033s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000862s : 6.75% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000057s : 0.44% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000039s : 0.31% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000547s : 4.28% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000027s : 0.21% loop_unroll : 0.000422s : 3.30% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000036s : 0.28% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.41% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000451s : 3.53% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.32% Time group info: ------[substitution.] 0.000281 24 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 3: substitution.graph_param_transform 87.09% : 0.000244s : 5: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000005s : 2: substitution.replace_old_param 4.72% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008278 2 87.83% : 0.007270s : 1: type_inference.infer 12.17% : 0.001008s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.40% : 0.000067s : 5: replace.inline 31.60% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 7 95.22% : 0.000241s : 5: match.inline 4.78% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.33% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.59% : 0.000002s : 11: predicate.addn_zero_filter 1.84% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000001s : 11: predicate.environ_get_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.15% : 0.000008s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.07% : 0.000001s : 11: predicate.minmaximum_grad 2.11% : 0.000003s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.51% : 0.000003s : 16: predicate.partial_eliminate 1.12% : 0.000001s : 11: predicate.print_const_string_wrapper 1.64% : 0.000002s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 19: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.61% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.07% : 0.000010s : 59: predicate.switch_simplify 1.19% : 0.000001s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000798 16 49.85% : 0.000398s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.05% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.10% : 0.000320s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018781 72 0.30% : 0.000056s : 1: add_recomputation 0.40% : 0.000076s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.53% : 0.000287s : 1: bootstrap 0.16% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.15% : 0.000028s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.01% : 0.005825s : 1: jit_opt_a 0.84% : 0.000159s : 1: jit_opt_after_cconv 0.28% : 0.000053s : 1: jit_opt_b 2.44% : 0.000458s : 1: loop_unroll 2.96% : 0.000556s : 1: mutable_eliminate 5.31% : 0.000997s : 26: opt.transform.jit_opt_a 0.27% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.44% : 0.000459s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000038s : 1: remove_dup_value 2.69% : 0.000505s : 1: renormalize.infer 1.85% : 0.000347s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000042s : 1: rewriter_after_opt_a 0.51% : 0.000095s : 1: rewriter_before_opt_a 0.39% : 0.000074s : 1: symbol_engine_optimizer 44.55% : 0.008366s : 1: type_inference TotalTime = 0.479632, [30] [bootstrap]: 0.00030854 [type_inference]: 0.426173 [event_method]: 2.352e-05 [auto_monad]: 7.062e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00047488 [rewriter_before_opt_a]: 0.00012452 [expand_dump_flag]: 3.81001e-06 [jit_opt_a]: 0.00748635, [2] [Cycle 1]: 0.00356392, [27] [switch_simplify]: 5.674e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00062949 [with_stream_mark]: 2.044e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 3.94002e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.47001e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.0024911 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.546e-05 [cse]: 3.144e-05 [replace_applicator]: 1.281e-05 [Cycle 2]: 0.00035011, [27] [switch_simplify]: 6.61e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00011868 [with_stream_mark]: 8.89e-06 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.51998e-06 [accelerated_algorithm]: 5.36998e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 8.11002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.99999e-06 [cse]: 1.048e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 3.357e-05 [convert_after_rewriter]: 7.02997e-06 [order_py_execute_after_rewriter]: 8.08001e-06 [mutable_eliminate]: 0.0430079 [jit_opt_b]: 6.533e-05, [1] [Cycle 1]: 5.776e-05, [2] [frontend_op_eliminate]: 2.304e-05 [inline_after_opt_a]: 2.353e-05 [cconv]: 2.448e-05 [loop_unroll]: 0.00052177 [jit_opt_after_cconv]: 0.00017402, [1] [Cycle 1]: 0.00016754, [11] [c_1]: 2.678e-05 [parameter_eliminate]: 3.71999e-06 [updatestate_depend_eliminate]: 7.38e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 3.169e-05 [call_graph_tuple_transform]: 2.492e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 7.93001e-06 [remove_dup_value]: 1.147e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 7.81001e-06 [add_recomputation]: 4.007e-05 [cse_after_recomputation]: 2.256e-05, [1] [Cycle 1]: 1.754e-05, [1] [cse]: 1.152e-05 [auto_monad_reorder]: 1.12e-05 [get_jit_bprop_graph]: 1.64e-06 [rewriter_after_jit_bprop_graph]: 7.97998e-06 [opt_after_jit_grad]: 0.00050196 [symbol_engine_optimizer]: 8.27e-05, [1] [Cycle 1]: 7.682e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.314e-05 [opt_reshape]: 1.045e-05 [fold_const_symbol]: 1.034e-05 [renormalize]: 3.19997e-07 [validate]: 0.00021602 Sums bootstrap : 0.000309s : 0.06% type_inference : 0.426173s : 89.64% event_method : 0.000024s : 0.00% auto_monad : 0.000071s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000475s : 0.10% rewriter_before_opt_a : 0.000125s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.01% jit_opt_a.loop_unroll : 0.000035s : 0.01% jit_opt_a.a_1 : 0.000748s : 0.16% jit_opt_a.with_stream_mark : 0.000029s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.00% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002491s : 0.52% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.00% jit_opt_a.cse : 0.000042s : 0.01% jit_opt_a.replace_applicator : 0.000019s : 0.00% py_interpret_to_execute_after_opt_a : 0.000010s : 0.00% rewriter_after_opt_a : 0.000034s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000008s : 0.00% mutable_eliminate : 0.043008s : 9.05% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.00% jit_opt_b.inline_after_opt_a : 0.000024s : 0.00% cconv : 0.000024s : 0.01% loop_unroll : 0.000522s : 0.11% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000011s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000040s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000011s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000502s : 0.11% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000216s : 0.05% Time group info: ------[substitution.] 0.000228 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 4: substitution.graph_param_transform 84.73% : 0.000193s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 5.81% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.426089 2 99.35% : 0.423318s : 1: type_inference.infer 0.65% : 0.002770s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.76% : 0.000051s : 4: replace.inline 32.24% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.09% : 0.000191s : 4: match.inline 5.91% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.16% : 0.000002s : 12: predicate.addn_zero_filter 2.18% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.72% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 2.67% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.00% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000009s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.88% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002119 22 66.75% : 0.001415s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.09% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.17% : 0.000661s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.483018 72 0.01% : 0.000043s : 1: add_recomputation 0.02% : 0.000074s : 1: auto_monad 0.00% : 0.000014s : 1: auto_monad_reorder 0.07% : 0.000328s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 1.55% : 0.007489s : 1: jit_opt_a 0.04% : 0.000177s : 1: jit_opt_after_cconv 0.01% : 0.000068s : 1: jit_opt_b 0.11% : 0.000530s : 1: loop_unroll 8.91% : 0.043021s : 1: mutable_eliminate 0.20% : 0.000973s : 26: opt.transform.jit_opt_a 0.01% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000038s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000510s : 1: opt_after_jit_grad 0.00% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000481s : 1: py_interpret_to_execute 0.00% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000014s : 1: remove_dup_value 0.37% : 0.001807s : 1: renormalize.infer 0.14% : 0.000676s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000036s : 1: rewriter_after_opt_a 0.03% : 0.000131s : 1: rewriter_before_opt_a 0.02% : 0.000085s : 1: symbol_engine_optimizer 88.24% : 0.426196s : 1: type_inference TotalTime = 0.162563, [30] [bootstrap]: 0.00024083 [type_inference]: 0.129561 [event_method]: 0.00055982 [auto_monad]: 0.00012108 [graph_reusing]: 7.92003e-06 [pre_auto_parallel]: 3.06999e-06 [py_interpret_to_execute]: 9.85e-05 [rewriter_before_opt_a]: 0.00014294 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.0292825, [3] [Cycle 1]: 0.0201938, [27] [switch_simplify]: 7.968e-05 [loop_unroll]: 4.428e-05 [a_1]: 0.00101446 [with_stream_mark]: 3.459e-05 [recompute_prepare]: 2.163e-05 [updatestate_depend_eliminate]: 8.96998e-06 [updatestate_assign_eliminate]: 7.06999e-06 [updatestate_loads_eliminate]: 7.06999e-06 [parameter_eliminate]: 2.53e-06 [specialize_transform]: 1.507e-05 [updatestate_useless_node_eliminater]: 1.381e-05 [accelerated_algorithm]: 1.401e-05 [meta_shard_fg_expand]: 3.65e-06 [get_grad_eliminate_]: 1.388e-05 [merge_forward]: 8.99e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.759e-05 [j_node_and_user_rematch]: 2.448e-05 [meta_fg_expand]: 0.00198228 [replace_old_param]: 7.334e-05 [inline_without_move]: 6.454e-05 [renormalize]: 0.0158825 [add_forward_monad_depend]: 1.893e-05 [auto_monad_grad]: 9.67999e-06 [auto_monad_eliminator]: 7.754e-05 [cse]: 0.00035166 [replace_applicator]: 0.00011195 [Cycle 2]: 0.00503802, [27] [switch_simplify]: 4.733e-05 [loop_unroll]: 4.436e-05 [a_1]: 0.00136941 [with_stream_mark]: 2.92e-05 [recompute_prepare]: 1.388e-05 [updatestate_depend_eliminate]: 7.39002e-06 [updatestate_assign_eliminate]: 4.35e-06 [updatestate_loads_eliminate]: 3.95e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 1.051e-05 [updatestate_useless_node_eliminater]: 9.07999e-06 [accelerated_algorithm]: 9.42001e-06 [meta_shard_fg_expand]: 4.52e-06 [get_grad_eliminate_]: 8.33999e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.196e-05 [j_node_and_user_rematch]: 1.433e-05 [meta_fg_expand]: 0.00019419 [replace_old_param]: 1.302e-05 [inline_without_move]: 9.17999e-06 [renormalize]: 0.00292672 [add_forward_monad_depend]: 1.039e-05 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.715e-05 [cse]: 2.954e-05 [replace_applicator]: 2.034e-05 [Cycle 3]: 0.00028373, [27] [switch_simplify]: 5.44e-06 [loop_unroll]: 4.12e-06 [a_1]: 5.085e-05 [with_stream_mark]: 1.315e-05 [recompute_prepare]: 3.55998e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 4.47e-06 [updatestate_useless_node_eliminater]: 3.85998e-06 [accelerated_algorithm]: 3.61999e-06 [meta_shard_fg_expand]: 1.86998e-06 [get_grad_eliminate_]: 3.66001e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 2.45002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.446e-05 [j_node_and_user_rematch]: 6.98e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 3.8e-06 [inline_without_move]: 3.48e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 4.10998e-06 [cse]: 1.009e-05 [replace_applicator]: 3.69002e-06 [py_interpret_to_execute_after_opt_a]: 1.613e-05 [rewriter_after_opt_a]: 3.681e-05 [convert_after_rewriter]: 6.12999e-06 [order_py_execute_after_rewriter]: 4.43999e-06 [mutable_eliminate]: 0.00083327 [jit_opt_b]: 5.103e-05, [1] [Cycle 1]: 4.154e-05, [2] [frontend_op_eliminate]: 1.286e-05 [inline_after_opt_a]: 1.498e-05 [cconv]: 3.159e-05 [loop_unroll]: 0.0004952 [jit_opt_after_cconv]: 0.00014404, [1] [Cycle 1]: 0.00013674, [11] [c_1]: 1.333e-05 [parameter_eliminate]: 4.46002e-06 [updatestate_depend_eliminate]: 7.31999e-06 [updatestate_assign_eliminate]: 1.81e-06 [updatestate_loads_eliminate]: 1.94e-06 [cse]: 2.517e-05 [call_graph_tuple_transform]: 1.715e-05 [tuple_list_get_item_eliminator]: 4.07e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 8.99978e-07 [switch_simplify]: 4.17003e-06 [remove_dup_value]: 1.694e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 6.12001e-06 [add_recomputation]: 3.714e-05 [cse_after_recomputation]: 2.351e-05, [1] [Cycle 1]: 1.734e-05, [1] [cse]: 1.038e-05 [auto_monad_reorder]: 1.481e-05 [get_jit_bprop_graph]: 2.50002e-06 [rewriter_after_jit_bprop_graph]: 6.94999e-06 [opt_after_jit_grad]: 0.00047923 [symbol_engine_optimizer]: 7.247e-05, [1] [Cycle 1]: 6.611e-05, [6] [build]: 4.74e-06 [elim_shapecalc]: 6.64001e-06 [elim_not_effective]: 1.041e-05 [opt_reshape]: 5.19e-06 [fold_const_symbol]: 6.38e-06 [renormalize]: 8.50006e-07 [validate]: 4.081e-05 Sums bootstrap : 0.000241s : 0.15% type_inference : 0.129561s : 82.09% event_method : 0.000560s : 0.35% auto_monad : 0.000121s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000098s : 0.06% rewriter_before_opt_a : 0.000143s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000132s : 0.08% jit_opt_a.loop_unroll : 0.000093s : 0.06% jit_opt_a.a_1 : 0.002435s : 1.54% jit_opt_a.with_stream_mark : 0.000077s : 0.05% jit_opt_a.recompute_prepare : 0.000039s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000030s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.03% jit_opt_a.meta_fg_expand : 0.002178s : 1.38% jit_opt_a.replace_old_param : 0.000090s : 0.06% jit_opt_a.inline_without_move : 0.000077s : 0.05% jit_opt_a.renormalize : 0.018809s : 11.92% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.02% jit_opt_a.auto_monad_grad : 0.000013s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000099s : 0.06% jit_opt_a.cse : 0.000391s : 0.25% jit_opt_a.replace_applicator : 0.000136s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000833s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000495s : 0.31% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000037s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000479s : 0.30% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000708 107 0.26% : 0.000002s : 1: substitution.elim_not_effective 0.11% : 0.000001s : 1: substitution.fold_const_symbol 0.65% : 0.000005s : 1: substitution.graph_param_transform 69.51% : 0.000492s : 13: substitution.inline 2.65% : 0.000019s : 2: substitution.inline_without_move 1.44% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.76% : 0.000012s : 7: substitution.minmaximum_grad 1.09% : 0.000008s : 5: substitution.partial_eliminate 1.56% : 0.000011s : 13: substitution.remove_not_recompute_node 5.33% : 0.000038s : 10: substitution.replace_applicator 0.96% : 0.000007s : 10: substitution.replace_old_param 1.05% : 0.000007s : 1: substitution.reshape_eliminate 0.46% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.07% : 0.000008s : 1: substitution.tile_eliminate 3.37% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.26% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.46% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129445 2 96.48% : 0.124888s : 1: type_inference.infer 3.52% : 0.004557s : 1: type_inference.specialize ------[replace.] 0.000212 20 65.89% : 0.000140s : 13: replace.inline 34.11% : 0.000072s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000506 20 95.46% : 0.000483s : 13: match.inline 4.54% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000400 2656 1.55% : 0.000006s : 46: predicate.accumulaten_eliminater 0.26% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.48% : 0.000006s : 46: predicate.addn_check_dump 1.53% : 0.000006s : 46: predicate.addn_zero_filter 2.01% : 0.000008s : 46: predicate.arithmetic_simplify 1.59% : 0.000006s : 46: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000006s : 46: predicate.compare_switch_simplify 1.45% : 0.000006s : 46: predicate.depend_value_elim 1.50% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.47% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.38% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.37% : 0.000005s : 46: predicate.environ_get_depend_swap 1.67% : 0.000007s : 46: predicate.environ_get_eliminate 1.45% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.88% : 0.000003s : 19: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.23% : 0.000017s : 68: predicate.inline 1.98% : 0.000008s : 47: predicate.inline_without_move 0.34% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 19: predicate.less_batch_normalization 1.91% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.71% : 0.000007s : 54: predicate.load_eliminater 0.46% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.39% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.87% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.54% : 0.000006s : 46: predicate.merge_addn 1.42% : 0.000006s : 46: predicate.minmaximum_grad 0.88% : 0.000004s : 1: predicate.mutable_eliminate 0.13% : 0.000001s : 1: predicate.opt_reshape 2.27% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 46: predicate.print_const_string_wrapper 2.12% : 0.000008s : 46: predicate.reduce_eliminate 1.71% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 19: predicate.remove_not_recompute_node 2.75% : 0.000011s : 100: predicate.replace_applicator 1.02% : 0.000004s : 47: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000007s : 46: predicate.reshape_eliminate 1.55% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.44% : 0.000006s : 46: predicate.same_eliminate 0.55% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 19: predicate.specialize_transform 1.75% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.90% : 0.000012s : 66: predicate.switch_defer_inline 2.42% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.54% : 0.000026s : 161: predicate.switch_simplify 1.52% : 0.000006s : 46: predicate.tile_eliminate 1.66% : 0.000007s : 46: predicate.transpose_eliminate 1.88% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.81% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000014s : 55: predicate.tuple_list_get_item_eliminator 1.93% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.92% : 0.000008s : 53: predicate.tuple_to_list_eliminator_ 1.89% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.69% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.89% : 0.000008s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.25% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004543 45 69.74% : 0.003168s : 28: func_graph_cloner_run.FuncGraphClonerGraph 30.26% : 0.001375s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.184529 87 0.02% : 0.000040s : 1: add_recomputation 0.07% : 0.000127s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.14% : 0.000263s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.31% : 0.000569s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.87% : 0.029286s : 1: jit_opt_a 0.08% : 0.000147s : 1: jit_opt_after_cconv 0.03% : 0.000054s : 1: jit_opt_b 0.27% : 0.000505s : 1: loop_unroll 0.46% : 0.000848s : 1: mutable_eliminate 1.71% : 0.003164s : 39: opt.transform.jit_opt_a 0.02% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000020s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000490s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000102s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 8.30% : 0.015320s : 2: renormalize.infer 1.87% : 0.003459s : 2: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000147s : 1: rewriter_before_opt_a 0.04% : 0.000075s : 1: symbol_engine_optimizer 70.23% : 0.129590s : 1: type_inference TotalTime = 0.0133888, [30] [bootstrap]: 0.00032762 [type_inference]: 0.00469211 [event_method]: 1.755e-05 [auto_monad]: 6.452e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 3.502e-05 [rewriter_before_opt_a]: 7.67e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00609702, [2] [Cycle 1]: 0.00275898, [27] [switch_simplify]: 5.283e-05 [loop_unroll]: 2.876e-05 [a_1]: 0.00054201 [with_stream_mark]: 1.489e-05 [recompute_prepare]: 7.55998e-06 [updatestate_depend_eliminate]: 3.94002e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 5.83002e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 8.62e-06 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00179892 [add_forward_monad_depend]: 5.84999e-06 [auto_monad_grad]: 2.05002e-06 [auto_monad_eliminator]: 1.565e-05 [cse]: 3.345e-05 [replace_applicator]: 1.241e-05 [Cycle 2]: 0.00031055, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 4.99998e-06 [a_1]: 8.645e-05 [with_stream_mark]: 8.80999e-06 [recompute_prepare]: 4.88001e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.252e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 6.93e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 4.99e-06 [cse]: 1.245e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 1.077e-05 [rewriter_after_opt_a]: 3.515e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00049719 [jit_opt_b]: 4.97e-05, [1] [Cycle 1]: 4.311e-05, [2] [frontend_op_eliminate]: 1.673e-05 [inline_after_opt_a]: 1.507e-05 [cconv]: 2.344e-05 [loop_unroll]: 0.00041143 [jit_opt_after_cconv]: 0.00017099, [1] [Cycle 1]: 0.00016454, [11] [c_1]: 2.021e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.33002e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.055e-05 [call_graph_tuple_transform]: 1.823e-05 [tuple_list_get_item_eliminator]: 5.36998e-06 [none_parameter_eliminate]: 2.06e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.71e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 5.63002e-06 [add_recomputation]: 5.067e-05 [cse_after_recomputation]: 2.399e-05, [1] [Cycle 1]: 1.8e-05, [1] [cse]: 1.194e-05 [auto_monad_reorder]: 1.844e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00045532 [symbol_engine_optimizer]: 7.33e-05, [1] [Cycle 1]: 6.711e-05, [6] [build]: 3.65998e-06 [elim_shapecalc]: 7.89002e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 5.73997e-06 [fold_const_symbol]: 8.45999e-06 [renormalize]: 3.99974e-07 [validate]: 3.991e-05 Sums bootstrap : 0.000328s : 3.35% type_inference : 0.004692s : 47.99% event_method : 0.000018s : 0.18% auto_monad : 0.000065s : 0.66% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.36% rewriter_before_opt_a : 0.000077s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.60% jit_opt_a.loop_unroll : 0.000034s : 0.35% jit_opt_a.a_1 : 0.000628s : 6.43% jit_opt_a.with_stream_mark : 0.000024s : 0.24% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.001799s : 18.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000046s : 0.47% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000035s : 0.36% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000497s : 5.09% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000023s : 0.24% loop_unroll : 0.000411s : 4.21% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000051s : 0.52% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000455s : 4.66% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.41% Time group info: ------[substitution.] 0.000218 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000005s : 3: substitution.graph_param_transform 86.05% : 0.000188s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.06% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004631 2 82.93% : 0.003840s : 1: type_inference.infer 17.07% : 0.000790s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.37% : 0.000045s : 4: replace.inline 31.63% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.90% : 0.000185s : 4: match.inline 5.10% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.23% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.48% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.82% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.59% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000583 13 54.11% : 0.000316s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.01% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.88% : 0.000238s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016072 72 0.33% : 0.000053s : 1: add_recomputation 0.42% : 0.000068s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 2.16% : 0.000347s : 1: bootstrap 0.16% : 0.000026s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.95% : 0.006100s : 1: jit_opt_a 1.08% : 0.000174s : 1: jit_opt_after_cconv 0.32% : 0.000052s : 1: jit_opt_b 2.61% : 0.000419s : 1: loop_unroll 3.14% : 0.000505s : 1: mutable_eliminate 5.17% : 0.000831s : 26: opt.transform.jit_opt_a 0.29% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.89% : 0.000464s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 9.52% : 0.001529s : 1: renormalize.infer 1.62% : 0.000261s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000038s : 1: rewriter_after_opt_a 0.50% : 0.000080s : 1: rewriter_before_opt_a 0.47% : 0.000076s : 1: symbol_engine_optimizer 29.27% : 0.004705s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.624.089 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006ddc0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.624.819 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.338754, [30] [bootstrap]: 0.0003775 [type_inference]: 0.324648 [event_method]: 2.863e-05 [auto_monad]: 8.249e-05 [graph_reusing]: 6.25002e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 0.00065941 [rewriter_before_opt_a]: 0.00010389 [expand_dump_flag]: 3.81001e-06 [jit_opt_a]: 0.0104147, [2] [Cycle 1]: 0.00534586, [27] [switch_simplify]: 6.752e-05 [loop_unroll]: 3.484e-05 [a_1]: 0.00076141 [with_stream_mark]: 2.056e-05 [recompute_prepare]: 9.28002e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.84999e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.168e-05 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00409106 [add_forward_monad_depend]: 7.5e-06 [auto_monad_grad]: 2.06e-06 [auto_monad_eliminator]: 1.913e-05 [cse]: 3.816e-05 [replace_applicator]: 1.659e-05 [Cycle 2]: 0.0004569, [27] [switch_simplify]: 7.46001e-06 [loop_unroll]: 6.73e-06 [a_1]: 0.00018879 [with_stream_mark]: 1.384e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 2.74999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.30001e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.72001e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 6.81001e-06 [cse]: 1.686e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.177e-05 [rewriter_after_opt_a]: 4.043e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00064326 [jit_opt_b]: 5.628e-05, [1] [Cycle 1]: 4.933e-05, [2] [frontend_op_eliminate]: 1.996e-05 [inline_after_opt_a]: 1.887e-05 [cconv]: 2.648e-05 [loop_unroll]: 0.00047503 [jit_opt_after_cconv]: 0.00015518, [1] [Cycle 1]: 0.0001493, [11] [c_1]: 2.736e-05 [parameter_eliminate]: 3.61999e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.185e-05 [call_graph_tuple_transform]: 2.05e-05 [tuple_list_get_item_eliminator]: 6.50002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.04999e-06 [remove_dup_value]: 1.735e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 8.75001e-06 [add_recomputation]: 5.318e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.225e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 5.79e-06 [opt_after_jit_grad]: 0.00045717 [symbol_engine_optimizer]: 7.802e-05, [1] [Cycle 1]: 7.187e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 9.47999e-06 [elim_not_effective]: 1.397e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 2.3999e-07 [validate]: 0.0001421 Sums bootstrap : 0.000377s : 0.11% type_inference : 0.324648s : 97.34% event_method : 0.000029s : 0.01% auto_monad : 0.000082s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000659s : 0.20% rewriter_before_opt_a : 0.000104s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000950s : 0.28% jit_opt_a.with_stream_mark : 0.000034s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004091s : 1.23% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000055s : 0.02% jit_opt_a.replace_applicator : 0.000023s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000643s : 0.19% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000475s : 0.14% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000457s : 0.14% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000142s : 0.04% Time group info: ------[substitution.] 0.000316 28 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 1.84% : 0.000006s : 4: substitution.graph_param_transform 84.81% : 0.000268s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.18% : 0.000013s : 3: substitution.reduce_eliminate 1.57% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000006s : 2: substitution.replace_old_param 3.57% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.324539 2 98.46% : 0.319547s : 1: type_inference.infer 1.54% : 0.004992s : 1: type_inference.specialize ------[replace.] 0.000114 7 67.38% : 0.000077s : 5: replace.inline 32.62% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 7 96.32% : 0.000265s : 5: match.inline 3.68% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 2.13% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.19% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.68% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.72% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003339 25 62.01% : 0.002071s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.00% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.99% : 0.001168s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.344017 72 0.02% : 0.000056s : 1: add_recomputation 0.03% : 0.000086s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000399s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.03% : 0.010418s : 1: jit_opt_a 0.05% : 0.000158s : 1: jit_opt_after_cconv 0.02% : 0.000059s : 1: jit_opt_b 0.14% : 0.000482s : 1: loop_unroll 0.19% : 0.000650s : 1: mutable_eliminate 0.35% : 0.001208s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000464s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000667s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.82% : 0.002811s : 1: renormalize.infer 0.37% : 0.001269s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000108s : 1: rewriter_before_opt_a 0.02% : 0.000080s : 1: symbol_engine_optimizer 94.38% : 0.324673s : 1: type_inference TotalTime = 0.285846, [30] [bootstrap]: 0.00031591 [type_inference]: 0.264244 [event_method]: 0.00043628 [auto_monad]: 0.00015896 [graph_reusing]: 1.084e-05 [pre_auto_parallel]: 4.29002e-06 [py_interpret_to_execute]: 6.016e-05 [rewriter_before_opt_a]: 0.0001929 [expand_dump_flag]: 4.58001e-06 [jit_opt_a]: 0.016052, [2] [Cycle 1]: 0.00421644, [27] [switch_simplify]: 0.00024694 [loop_unroll]: 6.675e-05 [a_1]: 0.00179851 [with_stream_mark]: 2.034e-05 [recompute_prepare]: 8.73001e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 3.65003e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.399e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 0.00174036 [add_forward_monad_depend]: 6.98e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.462e-05 [cse]: 2.554e-05 [replace_applicator]: 1.181e-05 [Cycle 2]: 0.00031998, [27] [switch_simplify]: 5.39e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.499e-05 [with_stream_mark]: 9.79999e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.78998e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.95001e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 4.82998e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 4.80001e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 2.34999e-06 [cell_reuse_recompute_pass]: 2.35002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.285e-05 [j_node_and_user_rematch]: 8.1e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 4.48001e-06 [cse]: 9.00999e-06 [replace_applicator]: 4.68999e-06 [py_interpret_to_execute_after_opt_a]: 1.151e-05 [rewriter_after_opt_a]: 3.527e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 4.69998e-06 [mutable_eliminate]: 0.00261647 [jit_opt_b]: 5.347e-05, [1] [Cycle 1]: 4.465e-05, [2] [frontend_op_eliminate]: 1.759e-05 [inline_after_opt_a]: 1.484e-05 [cconv]: 2.479e-05 [loop_unroll]: 0.00047086 [jit_opt_after_cconv]: 0.00014282, [1] [Cycle 1]: 0.00013628, [11] [c_1]: 2.164e-05 [parameter_eliminate]: 2.58003e-06 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 2.244e-05 [call_graph_tuple_transform]: 1.816e-05 [tuple_list_get_item_eliminator]: 5.11997e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.456e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 5.92999e-06 [add_recomputation]: 4.847e-05 [cse_after_recomputation]: 2.122e-05, [1] [Cycle 1]: 1.571e-05, [1] [cse]: 9.02e-06 [auto_monad_reorder]: 1.594e-05 [get_jit_bprop_graph]: 1.81998e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00045959 [symbol_engine_optimizer]: 7.019e-05, [1] [Cycle 1]: 6.407e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 7.14001e-06 [elim_not_effective]: 1.204e-05 [opt_reshape]: 5.30999e-06 [fold_const_symbol]: 8.67998e-06 [renormalize]: 3.59985e-07 [validate]: 5.324e-05 Sums bootstrap : 0.000316s : 0.12% type_inference : 0.264244s : 96.58% event_method : 0.000436s : 0.16% auto_monad : 0.000159s : 0.06% graph_reusing : 0.000011s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000060s : 0.02% rewriter_before_opt_a : 0.000193s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000252s : 0.09% jit_opt_a.loop_unroll : 0.000072s : 0.03% jit_opt_a.a_1 : 0.001894s : 0.69% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.00% jit_opt_a.accelerated_algorithm : 0.000011s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.00% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.00% jit_opt_a.renormalize : 0.001740s : 0.64% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000035s : 0.01% jit_opt_a.replace_applicator : 0.000016s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000035s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.002616s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000025s : 0.01% loop_unroll : 0.000471s : 0.17% jit_opt_after_cconv.c_1 : 0.000022s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000048s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000460s : 0.17% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.02% Time group info: ------[substitution.] 0.000787 56 0.22% : 0.000002s : 2: substitution.elim_not_effective 0.16% : 0.000001s : 2: substitution.fold_const_symbol 0.71% : 0.000006s : 3: substitution.graph_param_transform 87.28% : 0.000687s : 15: substitution.inline 0.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.89% : 0.000007s : 4: substitution.minmaximum_grad 0.63% : 0.000005s : 4: substitution.remove_not_recompute_node 0.61% : 0.000005s : 2: substitution.replace_old_param 2.29% : 0.000018s : 4: substitution.switch_simplify 1.94% : 0.000015s : 4: substitution.tuple_list_convert_item_index_to_positive 1.40% : 0.000011s : 4: substitution.tuple_list_get_item_depend_reorder 3.44% : 0.000027s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.264133 2 97.62% : 0.257844s : 1: type_inference.infer 2.38% : 0.006288s : 1: type_inference.specialize ------[replace.] 0.000394 23 53.52% : 0.000211s : 15: replace.inline 15.09% : 0.000059s : 4: replace.switch_simplify 31.39% : 0.000124s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000702 23 96.79% : 0.000679s : 15: match.inline 2.06% : 0.000014s : 4: match.switch_simplify 1.16% : 0.000008s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000224 1341 1.46% : 0.000003s : 21: predicate.accumulaten_eliminater 0.51% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000003s : 21: predicate.addn_check_dump 1.50% : 0.000003s : 21: predicate.addn_zero_filter 1.86% : 0.000004s : 21: predicate.arithmetic_simplify 1.54% : 0.000003s : 21: predicate.cast_eliminate 0.22% : 0.000000s : 3: predicate.check_bprop_eliminate 1.31% : 0.000003s : 21: predicate.compare_switch_simplify 1.41% : 0.000003s : 21: predicate.depend_value_elim 1.41% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.33% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.47% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.18% : 0.000000s : 3: predicate.elim_not_effective 0.25% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.33% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.25% : 0.000003s : 21: predicate.environ_get_depend_swap 1.34% : 0.000003s : 21: predicate.environ_get_eliminate 1.24% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.11% : 0.000000s : 3: predicate.fold_const_symbol 0.61% : 0.000001s : 6: predicate.get_grad_eliminate 0.12% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000012s : 46: predicate.inline 0.51% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.80% : 0.000002s : 6: predicate.less_batch_normalization 1.72% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 1.82% : 0.000004s : 28: predicate.load_eliminater 0.59% : 0.000001s : 3: predicate.loop_unroll_after_grad 5.34% : 0.000012s : 78: predicate.loop_unroll_before_grad 1.75% : 0.000004s : 24: predicate.make_slice_get_slice_eliminator 1.28% : 0.000003s : 21: predicate.merge_addn 1.29% : 0.000003s : 21: predicate.minmaximum_grad 0.88% : 0.000002s : 3: predicate.mutable_eliminate 0.25% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000005s : 28: predicate.partial_eliminate 1.36% : 0.000003s : 21: predicate.print_const_string_wrapper 1.99% : 0.000004s : 21: predicate.reduce_eliminate 1.56% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.29% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000003s : 31: predicate.replace_applicator 0.30% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000003s : 21: predicate.reshape_eliminate 1.45% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.40% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000003s : 21: predicate.same_eliminate 0.29% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.54% : 0.000001s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000003s : 21: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.34% : 0.000007s : 40: predicate.switch_defer_inline 2.75% : 0.000006s : 40: predicate.switch_layer_defer_inline 10.87% : 0.000024s : 129: predicate.switch_simplify 1.42% : 0.000003s : 21: predicate.tile_eliminate 1.30% : 0.000003s : 21: predicate.transpose_eliminate 1.63% : 0.000004s : 21: predicate.tuple_list_convert_item_index_to_positive 1.60% : 0.000004s : 21: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000009s : 31: predicate.tuple_list_get_item_eliminator 1.71% : 0.000004s : 21: predicate.tuple_list_set_item_eliminator 1.59% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.65% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.19% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.87% : 0.000004s : 21: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.30% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003541 38 59.61% : 0.002111s : 15: func_graph_cloner_run.FuncGraphClonerGraph 11.08% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerNode 29.31% : 0.001038s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.289840 72 0.02% : 0.000051s : 1: add_recomputation 0.06% : 0.000166s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.11% : 0.000332s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.15% : 0.000445s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000013s : 1: graph_reusing 5.54% : 0.016056s : 1: jit_opt_a 0.05% : 0.000146s : 1: jit_opt_after_cconv 0.02% : 0.000056s : 1: jit_opt_b 0.17% : 0.000479s : 1: loop_unroll 0.91% : 0.002628s : 1: mutable_eliminate 0.80% : 0.002329s : 26: opt.transform.jit_opt_a 0.02% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000026s : 4: opt.transform.jit_opt_b 0.00% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000469s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000064s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.39% : 0.001142s : 1: renormalize.infer 0.20% : 0.000589s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000196s : 1: rewriter_before_opt_a 0.03% : 0.000073s : 1: symbol_engine_optimizer 91.18% : 0.264263s : 1: type_inference TotalTime = 0.098175, [30] [bootstrap]: 0.00031133 [type_inference]: 0.06709 [event_method]: 0.00045079 [auto_monad]: 0.00011391 [graph_reusing]: 7.6e-06 [pre_auto_parallel]: 3.7e-06 [py_interpret_to_execute]: 4.138e-05 [rewriter_before_opt_a]: 0.00013432 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.0278321, [3] [Cycle 1]: 0.0197902, [27] [switch_simplify]: 8.704e-05 [loop_unroll]: 4.857e-05 [a_1]: 0.00111637 [with_stream_mark]: 3.564e-05 [recompute_prepare]: 2.687e-05 [updatestate_depend_eliminate]: 1.15e-05 [updatestate_assign_eliminate]: 7.59002e-06 [updatestate_loads_eliminate]: 6.83e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 1.614e-05 [updatestate_useless_node_eliminater]: 1.426e-05 [accelerated_algorithm]: 1.423e-05 [meta_shard_fg_expand]: 4.57e-06 [get_grad_eliminate_]: 1.587e-05 [merge_forward]: 1.07e-05 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.047e-05 [j_node_and_user_rematch]: 2.505e-05 [meta_fg_expand]: 0.00198391 [replace_old_param]: 7.373e-05 [inline_without_move]: 6.463e-05 [renormalize]: 0.0154675 [add_forward_monad_depend]: 1.162e-05 [auto_monad_grad]: 6.31e-06 [auto_monad_eliminator]: 6.502e-05 [cse]: 0.00028921 [replace_applicator]: 9.329e-05 [Cycle 2]: 0.00403797, [27] [switch_simplify]: 4.601e-05 [loop_unroll]: 4.332e-05 [a_1]: 0.00126964 [with_stream_mark]: 1.78e-05 [recompute_prepare]: 1.143e-05 [updatestate_depend_eliminate]: 5.92999e-06 [updatestate_assign_eliminate]: 4e-06 [updatestate_loads_eliminate]: 4.45e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 8.56002e-06 [updatestate_useless_node_eliminater]: 8.53001e-06 [accelerated_algorithm]: 8.97e-06 [meta_shard_fg_expand]: 3.35e-06 [get_grad_eliminate_]: 8.52e-06 [merge_forward]: 4.74e-06 [cell_reuse_recompute_pass]: 1.01997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.863e-05 [j_node_and_user_rematch]: 1.358e-05 [meta_fg_expand]: 0.00015004 [replace_old_param]: 1.04e-05 [inline_without_move]: 8.68001e-06 [renormalize]: 0.00216538 [add_forward_monad_depend]: 5.52001e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 1.122e-05 [cse]: 2.104e-05 [replace_applicator]: 1.235e-05 [Cycle 3]: 0.00024738, [27] [switch_simplify]: 4.20999e-06 [loop_unroll]: 3.5e-06 [a_1]: 4.066e-05 [with_stream_mark]: 9.24e-06 [recompute_prepare]: 3.79002e-06 [updatestate_depend_eliminate]: 2.44999e-06 [updatestate_assign_eliminate]: 1.87001e-06 [updatestate_loads_eliminate]: 1.44998e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 3.35e-06 [updatestate_useless_node_eliminater]: 3.16999e-06 [accelerated_algorithm]: 3.36999e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 3.20002e-06 [merge_forward]: 2.20002e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.07e-05 [j_node_and_user_rematch]: 5.66e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 3.3e-06 [inline_without_move]: 3.03998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 3.29001e-06 [cse]: 7.92e-06 [replace_applicator]: 3.4e-06 [py_interpret_to_execute_after_opt_a]: 1.07e-05 [rewriter_after_opt_a]: 3.253e-05 [convert_after_rewriter]: 5.49e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00070156 [jit_opt_b]: 4.251e-05, [1] [Cycle 1]: 3.441e-05, [2] [frontend_op_eliminate]: 1.098e-05 [inline_after_opt_a]: 1.117e-05 [cconv]: 2.306e-05 [loop_unroll]: 0.00040504 [jit_opt_after_cconv]: 0.00012696, [1] [Cycle 1]: 0.00011953, [11] [c_1]: 1.244e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 1.78002e-06 [updatestate_loads_eliminate]: 1.59e-06 [cse]: 1.821e-05 [call_graph_tuple_transform]: 1.426e-05 [tuple_list_get_item_eliminator]: 3.73999e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 3.74002e-06 [remove_dup_value]: 1.475e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 4.75001e-06 [add_recomputation]: 3.58e-05 [cse_after_recomputation]: 1.948e-05, [1] [Cycle 1]: 1.399e-05, [1] [cse]: 7.73999e-06 [auto_monad_reorder]: 1.322e-05 [get_jit_bprop_graph]: 1.66e-06 [rewriter_after_jit_bprop_graph]: 4.51002e-06 [opt_after_jit_grad]: 0.00044028 [symbol_engine_optimizer]: 6.655e-05, [1] [Cycle 1]: 6.077e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 5.39998e-06 [elim_not_effective]: 1.088e-05 [opt_reshape]: 4.18999e-06 [fold_const_symbol]: 6.59999e-06 [renormalize]: 3.9002e-07 [validate]: 2.882e-05 Sums bootstrap : 0.000311s : 0.33% type_inference : 0.067090s : 71.72% event_method : 0.000451s : 0.48% auto_monad : 0.000114s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000041s : 0.04% rewriter_before_opt_a : 0.000134s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000137s : 0.15% jit_opt_a.loop_unroll : 0.000095s : 0.10% jit_opt_a.a_1 : 0.002427s : 2.59% jit_opt_a.with_stream_mark : 0.000063s : 0.07% jit_opt_a.recompute_prepare : 0.000042s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.03% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000028s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.05% jit_opt_a.meta_fg_expand : 0.002136s : 2.28% jit_opt_a.replace_old_param : 0.000087s : 0.09% jit_opt_a.inline_without_move : 0.000076s : 0.08% jit_opt_a.renormalize : 0.017633s : 18.85% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000080s : 0.09% jit_opt_a.cse : 0.000318s : 0.34% jit_opt_a.replace_applicator : 0.000109s : 0.12% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000702s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000405s : 0.43% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000440s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.03% Time group info: ------[substitution.] 0.000678 107 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.68% : 0.000005s : 1: substitution.graph_param_transform 69.45% : 0.000471s : 13: substitution.inline 2.99% : 0.000020s : 2: substitution.inline_without_move 1.50% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.84% : 0.000012s : 7: substitution.minmaximum_grad 1.13% : 0.000008s : 5: substitution.partial_eliminate 1.79% : 0.000012s : 13: substitution.remove_not_recompute_node 4.92% : 0.000033s : 10: substitution.replace_applicator 1.04% : 0.000007s : 10: substitution.replace_old_param 1.02% : 0.000007s : 1: substitution.reshape_eliminate 0.39% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.78% : 0.000005s : 1: substitution.tile_eliminate 3.41% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.38% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.29% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066974 2 95.66% : 0.064067s : 1: type_inference.infer 4.34% : 0.002907s : 1: type_inference.specialize ------[replace.] 0.000195 20 66.95% : 0.000130s : 13: replace.inline 33.05% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000484 20 95.76% : 0.000463s : 13: match.inline 4.24% : 0.000020s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000394 2768 1.47% : 0.000006s : 48: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.48% : 0.000006s : 48: predicate.addn_check_dump 1.59% : 0.000006s : 48: predicate.addn_zero_filter 2.16% : 0.000009s : 48: predicate.arithmetic_simplify 1.60% : 0.000006s : 48: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.71% : 0.000007s : 48: predicate.compare_switch_simplify 1.44% : 0.000006s : 48: predicate.depend_value_elim 1.50% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.63% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.67% : 0.000007s : 48: predicate.environ_get_add_eliminate 1.54% : 0.000006s : 48: predicate.environ_get_depend_swap 1.47% : 0.000006s : 48: predicate.environ_get_eliminate 1.49% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.96% : 0.000004s : 20: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.42% : 0.000017s : 70: predicate.inline 2.08% : 0.000008s : 48: predicate.inline_without_move 0.37% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.09% : 0.000004s : 20: predicate.less_batch_normalization 1.79% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.89% : 0.000007s : 56: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.52% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.72% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 48: predicate.merge_addn 1.50% : 0.000006s : 48: predicate.minmaximum_grad 0.42% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.31% : 0.000009s : 56: predicate.partial_eliminate 1.51% : 0.000006s : 48: predicate.print_const_string_wrapper 2.07% : 0.000008s : 48: predicate.reduce_eliminate 1.75% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 20: predicate.remove_not_recompute_node 2.82% : 0.000011s : 103: predicate.replace_applicator 1.17% : 0.000005s : 48: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000006s : 48: predicate.reshape_eliminate 1.49% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.24% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000006s : 48: predicate.same_eliminate 0.50% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.13% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 20: predicate.specialize_transform 1.67% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.86% : 0.000011s : 68: predicate.switch_defer_inline 2.45% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.44% : 0.000025s : 170: predicate.switch_simplify 1.76% : 0.000007s : 48: predicate.tile_eliminate 1.52% : 0.000006s : 48: predicate.transpose_eliminate 1.87% : 0.000007s : 48: predicate.tuple_list_convert_item_index_to_positive 1.78% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.13% : 0.000012s : 57: predicate.tuple_list_get_item_eliminator 1.75% : 0.000007s : 48: predicate.tuple_list_set_item_eliminator 1.95% : 0.000008s : 55: predicate.tuple_to_list_eliminator_ 1.81% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.78% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004598 52 76.47% : 0.003516s : 35: func_graph_cloner_run.FuncGraphClonerGraph 23.53% : 0.001082s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118936 87 0.03% : 0.000038s : 1: add_recomputation 0.10% : 0.000121s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.28% : 0.000335s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.39% : 0.000459s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 23.40% : 0.027837s : 1: jit_opt_a 0.11% : 0.000130s : 1: jit_opt_after_cconv 0.04% : 0.000045s : 1: jit_opt_b 0.35% : 0.000412s : 1: loop_unroll 0.60% : 0.000710s : 1: mutable_eliminate 2.64% : 0.003135s : 39: opt.transform.jit_opt_a 0.03% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000448s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000044s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 12.67% : 0.015067s : 2: renormalize.infer 2.14% : 0.002544s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000138s : 1: rewriter_before_opt_a 0.06% : 0.000069s : 1: symbol_engine_optimizer 56.43% : 0.067113s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.732.752 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.733.432 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0650646, [30] [bootstrap]: 0.00025845 [type_inference]: 0.0567708 [event_method]: 1.977e-05 [auto_monad]: 6.655e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00011184 [rewriter_before_opt_a]: 8.276e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00551122, [2] [Cycle 1]: 0.00197423, [27] [switch_simplify]: 5.636e-05 [loop_unroll]: 3.086e-05 [a_1]: 0.00053944 [with_stream_mark]: 2.025e-05 [recompute_prepare]: 8.47998e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.71001e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00096463 [add_forward_monad_depend]: 6.33e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.655e-05 [cse]: 3.695e-05 [replace_applicator]: 1.478e-05 [Cycle 2]: 0.00032532, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.105e-05 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 5.98002e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.11002e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.21002e-06 [merge_forward]: 3.27002e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 6.89001e-06 [inline_without_move]: 5.22e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.255e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.264e-05 [rewriter_after_opt_a]: 3.869e-05 [convert_after_rewriter]: 7.7e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.0006024 [jit_opt_b]: 5.563e-05, [1] [Cycle 1]: 4.784e-05, [2] [frontend_op_eliminate]: 1.863e-05 [inline_after_opt_a]: 1.732e-05 [cconv]: 2.939e-05 [loop_unroll]: 0.00044511 [jit_opt_after_cconv]: 0.00015954, [1] [Cycle 1]: 0.00015344, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 7.1e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.89001e-06 [cse]: 2.474e-05 [call_graph_tuple_transform]: 1.805e-05 [tuple_list_get_item_eliminator]: 5.87001e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.769e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 7e-06 [add_recomputation]: 5.23e-05 [cse_after_recomputation]: 2.416e-05, [1] [Cycle 1]: 1.882e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 1.781e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00046501 [symbol_engine_optimizer]: 7.323e-05, [1] [Cycle 1]: 6.704e-05, [6] [build]: 3.84002e-06 [elim_shapecalc]: 7.94002e-06 [elim_not_effective]: 1.277e-05 [opt_reshape]: 5.70001e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 3.20026e-07 [validate]: 4.038e-05 Sums bootstrap : 0.000258s : 0.42% type_inference : 0.056771s : 92.68% event_method : 0.000020s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000112s : 0.18% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000630s : 1.03% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000965s : 1.57% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000049s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000602s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000445s : 0.73% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000465s : 0.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.07% Time group info: ------[substitution.] 0.000206 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 83.85% : 0.000173s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000004s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 6.32% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056695 2 94.35% : 0.053492s : 1: type_inference.infer 5.65% : 0.003202s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.75% : 0.000048s : 4: replace.inline 31.25% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.48% : 0.000171s : 4: match.inline 6.52% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.09% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.77% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000761 13 42.44% : 0.000323s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.28% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.28% : 0.000398s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066937 72 0.08% : 0.000055s : 1: add_recomputation 0.10% : 0.000070s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.40% : 0.000268s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.24% : 0.005515s : 1: jit_opt_a 0.24% : 0.000162s : 1: jit_opt_after_cconv 0.09% : 0.000058s : 1: jit_opt_b 0.68% : 0.000453s : 1: loop_unroll 0.92% : 0.000613s : 1: mutable_eliminate 1.27% : 0.000848s : 26: opt.transform.jit_opt_a 0.07% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000116s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.87% : 0.000579s : 1: renormalize.infer 0.56% : 0.000377s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.11% : 0.000076s : 1: symbol_engine_optimizer 84.84% : 0.056787s : 1: type_inference TotalTime = 0.105367, [30] [bootstrap]: 0.00025646 [type_inference]: 0.0720204 [event_method]: 0.00036808 [auto_monad]: 0.00015463 [graph_reusing]: 7.93999e-06 [pre_auto_parallel]: 3.27002e-06 [py_interpret_to_execute]: 3.931e-05 [rewriter_before_opt_a]: 0.00012905 [expand_dump_flag]: 3.00002e-06 [jit_opt_a]: 0.0299109, [3] [Cycle 1]: 0.0216357, [27] [switch_simplify]: 8.323e-05 [loop_unroll]: 4.877e-05 [a_1]: 0.00109541 [with_stream_mark]: 3.521e-05 [recompute_prepare]: 2.194e-05 [updatestate_depend_eliminate]: 9.10999e-06 [updatestate_assign_eliminate]: 6.93e-06 [updatestate_loads_eliminate]: 7.4e-06 [parameter_eliminate]: 3.31999e-06 [specialize_transform]: 1.543e-05 [updatestate_useless_node_eliminater]: 1.39e-05 [accelerated_algorithm]: 1.509e-05 [meta_shard_fg_expand]: 4.13001e-06 [get_grad_eliminate_]: 1.442e-05 [merge_forward]: 9.11998e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.926e-05 [j_node_and_user_rematch]: 2.619e-05 [meta_fg_expand]: 0.00209462 [replace_old_param]: 8.272e-05 [inline_without_move]: 7.89e-05 [renormalize]: 0.017177 [add_forward_monad_depend]: 1.473e-05 [auto_monad_grad]: 7.95e-06 [auto_monad_eliminator]: 6.487e-05 [cse]: 0.00030007 [replace_applicator]: 9.681e-05 [Cycle 2]: 0.00422829, [27] [switch_simplify]: 4.37e-05 [loop_unroll]: 4.357e-05 [a_1]: 0.00140745 [with_stream_mark]: 2.136e-05 [recompute_prepare]: 1.035e-05 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 3.85998e-06 [updatestate_loads_eliminate]: 3.98001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 8.25999e-06 [updatestate_useless_node_eliminater]: 6.73e-06 [accelerated_algorithm]: 7.55998e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.35002e-06 [merge_forward]: 5.03002e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 1.196e-05 [meta_fg_expand]: 0.00014789 [replace_old_param]: 8.13001e-06 [inline_without_move]: 7.16001e-06 [renormalize]: 0.00220496 [add_forward_monad_depend]: 6.27001e-06 [auto_monad_grad]: 2.38002e-06 [auto_monad_eliminator]: 1.341e-05 [cse]: 2.72e-05 [replace_applicator]: 1.585e-05 [Cycle 3]: 0.00025964, [27] [switch_simplify]: 4.58001e-06 [loop_unroll]: 3.93001e-06 [a_1]: 4.402e-05 [with_stream_mark]: 1.116e-05 [recompute_prepare]: 3.49001e-06 [updatestate_depend_eliminate]: 2.83998e-06 [updatestate_assign_eliminate]: 1.97999e-06 [updatestate_loads_eliminate]: 1.80001e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 3.76999e-06 [updatestate_useless_node_eliminater]: 3.44001e-06 [accelerated_algorithm]: 3.54002e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 3.22002e-06 [merge_forward]: 2.55002e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.216e-05 [j_node_and_user_rematch]: 5.94999e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 2.99001e-06 [inline_without_move]: 3.18e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 3.78001e-06 [cse]: 9.71998e-06 [replace_applicator]: 3.6e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.481e-05 [convert_after_rewriter]: 5.66e-06 [order_py_execute_after_rewriter]: 4.39002e-06 [mutable_eliminate]: 0.00088655 [jit_opt_b]: 4.751e-05, [1] [Cycle 1]: 3.983e-05, [2] [frontend_op_eliminate]: 1.422e-05 [inline_after_opt_a]: 1.315e-05 [cconv]: 2.974e-05 [loop_unroll]: 0.00045944 [jit_opt_after_cconv]: 0.00013433, [1] [Cycle 1]: 0.00012615, [11] [c_1]: 1.329e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 1.59e-06 [cse]: 2.096e-05 [call_graph_tuple_transform]: 1.588e-05 [tuple_list_get_item_eliminator]: 3.8e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 3.75e-06 [remove_dup_value]: 1.455e-05 [partial_unused_args_eliminate]: 2.88e-06 [environ_conv]: 5.02999e-06 [add_recomputation]: 3.503e-05 [cse_after_recomputation]: 2.18e-05, [1] [Cycle 1]: 1.689e-05, [1] [cse]: 1.049e-05 [auto_monad_reorder]: 1.458e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00044622 [symbol_engine_optimizer]: 6.857e-05, [1] [Cycle 1]: 6.152e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 5.40001e-06 [elim_not_effective]: 1.037e-05 [opt_reshape]: 5.07e-06 [fold_const_symbol]: 5.94e-06 [renormalize]: 3.50003e-07 [validate]: 3.373e-05 Sums bootstrap : 0.000256s : 0.25% type_inference : 0.072020s : 71.55% event_method : 0.000368s : 0.37% auto_monad : 0.000155s : 0.15% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.04% rewriter_before_opt_a : 0.000129s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000132s : 0.13% jit_opt_a.loop_unroll : 0.000096s : 0.10% jit_opt_a.a_1 : 0.002547s : 2.53% jit_opt_a.with_stream_mark : 0.000068s : 0.07% jit_opt_a.recompute_prepare : 0.000036s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.04% jit_opt_a.meta_fg_expand : 0.002244s : 2.23% jit_opt_a.replace_old_param : 0.000094s : 0.09% jit_opt_a.inline_without_move : 0.000089s : 0.09% jit_opt_a.renormalize : 0.019382s : 19.26% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.08% jit_opt_a.cse : 0.000337s : 0.33% jit_opt_a.replace_applicator : 0.000116s : 0.12% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000887s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000030s : 0.03% loop_unroll : 0.000459s : 0.46% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000446s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000675 104 0.21% : 0.000001s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.81% : 0.000005s : 1: substitution.graph_param_transform 68.39% : 0.000461s : 13: substitution.inline 3.37% : 0.000023s : 2: substitution.inline_without_move 1.52% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.81% : 0.000012s : 7: substitution.minmaximum_grad 1.42% : 0.000010s : 5: substitution.partial_eliminate 1.68% : 0.000011s : 12: substitution.remove_not_recompute_node 5.17% : 0.000035s : 10: substitution.replace_applicator 1.16% : 0.000008s : 10: substitution.replace_old_param 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.98% : 0.000007s : 1: substitution.tile_eliminate 3.61% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.37% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.90% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071898 2 94.92% : 0.068243s : 1: type_inference.infer 5.08% : 0.003654s : 1: type_inference.specialize ------[replace.] 0.000359 20 79.47% : 0.000285s : 13: replace.inline 20.53% : 0.000074s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000476 20 95.24% : 0.000454s : 13: match.inline 4.76% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000396 2656 1.47% : 0.000006s : 46: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.54% : 0.000006s : 46: predicate.addn_check_dump 1.52% : 0.000006s : 46: predicate.addn_zero_filter 2.14% : 0.000008s : 46: predicate.arithmetic_simplify 1.51% : 0.000006s : 46: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.36% : 0.000005s : 46: predicate.compare_switch_simplify 1.50% : 0.000006s : 46: predicate.depend_value_elim 1.51% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.86% : 0.000007s : 46: predicate.dict_get_item_eliminator 1.41% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.42% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_depend_swap 1.60% : 0.000006s : 46: predicate.environ_get_eliminate 1.41% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.75% : 0.000003s : 18: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.29% : 0.000017s : 68: predicate.inline 4.31% : 0.000017s : 46: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 18: predicate.less_batch_normalization 1.75% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 54: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.61% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.72% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.44% : 0.000006s : 46: predicate.merge_addn 1.43% : 0.000006s : 46: predicate.minmaximum_grad 0.56% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.15% : 0.000009s : 54: predicate.partial_eliminate 1.38% : 0.000005s : 46: predicate.print_const_string_wrapper 1.93% : 0.000008s : 46: predicate.reduce_eliminate 1.80% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 18: predicate.remove_not_recompute_node 2.69% : 0.000011s : 99: predicate.replace_applicator 1.14% : 0.000005s : 46: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.63% : 0.000006s : 46: predicate.reshape_eliminate 1.51% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.49% : 0.000006s : 46: predicate.same_eliminate 0.42% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 18: predicate.specialize_transform 1.69% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.87% : 0.000011s : 66: predicate.switch_defer_inline 2.39% : 0.000009s : 66: predicate.switch_layer_defer_inline 6.17% : 0.000024s : 166: predicate.switch_simplify 1.55% : 0.000006s : 46: predicate.tile_eliminate 1.48% : 0.000006s : 46: predicate.transpose_eliminate 1.81% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.32% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.79% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.80% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.71% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.52% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.95% : 0.000008s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004965 52 75.06% : 0.003727s : 35: func_graph_cloner_run.FuncGraphClonerGraph 24.94% : 0.001238s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128006 87 0.03% : 0.000038s : 1: add_recomputation 0.13% : 0.000163s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000277s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.29% : 0.000377s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 23.37% : 0.029915s : 1: jit_opt_a 0.11% : 0.000137s : 1: jit_opt_after_cconv 0.04% : 0.000050s : 1: jit_opt_b 0.36% : 0.000467s : 1: loop_unroll 0.70% : 0.000897s : 1: mutable_eliminate 2.55% : 0.003260s : 39: opt.transform.jit_opt_a 0.03% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 12.72% : 0.016288s : 2: renormalize.infer 2.40% : 0.003068s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.10% : 0.000132s : 1: rewriter_before_opt_a 0.06% : 0.000071s : 1: symbol_engine_optimizer 56.29% : 0.072049s : 1: type_inference TotalTime = 0.135858, [30] [bootstrap]: 0.00031413 [type_inference]: 0.123034 [event_method]: 1.957e-05 [auto_monad]: 6.931e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00054086 [rewriter_before_opt_a]: 8.919e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00916169, [2] [Cycle 1]: 0.00511374, [27] [switch_simplify]: 6.136e-05 [loop_unroll]: 3e-05 [a_1]: 0.00059578 [with_stream_mark]: 1.868e-05 [recompute_prepare]: 8.41002e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00403449 [add_forward_monad_depend]: 7.65998e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.952e-05 [cse]: 3.275e-05 [replace_applicator]: 2.163e-05 [Cycle 2]: 0.00040182, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00013582 [with_stream_mark]: 1.552e-05 [recompute_prepare]: 6.38e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 4.18999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.818e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.78998e-06 [cse]: 1.181e-05 [replace_applicator]: 6.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.419e-05 [rewriter_after_opt_a]: 3.873e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 7.77002e-06 [mutable_eliminate]: 0.00072707 [jit_opt_b]: 5.937e-05, [1] [Cycle 1]: 5.22e-05, [2] [frontend_op_eliminate]: 2.115e-05 [inline_after_opt_a]: 1.951e-05 [cconv]: 2.893e-05 [loop_unroll]: 0.00045888 [jit_opt_after_cconv]: 0.00015729, [1] [Cycle 1]: 0.0001507, [11] [c_1]: 2.576e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.205e-05 [call_graph_tuple_transform]: 2.377e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.49974e-07 [switch_simplify]: 7.6e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 8.81002e-06 [add_recomputation]: 5.244e-05 [cse_after_recomputation]: 2.225e-05, [1] [Cycle 1]: 1.693e-05, [1] [cse]: 1.111e-05 [auto_monad_reorder]: 1.607e-05 [get_jit_bprop_graph]: 2.73e-06 [rewriter_after_jit_bprop_graph]: 7.48999e-06 [opt_after_jit_grad]: 0.00066006 [symbol_engine_optimizer]: 7.924e-05, [1] [Cycle 1]: 7.303e-05, [6] [build]: 4.25999e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.476e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 9.72999e-06 [renormalize]: 6.50005e-07 [validate]: 4.693e-05 Sums bootstrap : 0.000314s : 0.24% type_inference : 0.123034s : 93.51% event_method : 0.000020s : 0.01% auto_monad : 0.000069s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000541s : 0.41% rewriter_before_opt_a : 0.000089s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000732s : 0.56% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.004035s : 3.07% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000008s : 0.01% mutable_eliminate : 0.000727s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000459s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000660s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000227 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.94% : 0.000007s : 4: substitution.graph_param_transform 82.94% : 0.000188s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000006s : 4: substitution.remove_not_recompute_node 2.64% : 0.000006s : 2: substitution.replace_old_param 5.62% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122948 2 97.66% : 0.120072s : 1: type_inference.infer 2.34% : 0.002875s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.73% : 0.000052s : 4: replace.inline 32.27% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.06% : 0.000186s : 4: match.inline 5.94% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.30% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.32% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.51% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.27% : 0.000007s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.54% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.60% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002386 22 63.90% : 0.001525s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.49% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.61% : 0.000826s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140941 72 0.04% : 0.000055s : 1: add_recomputation 0.05% : 0.000073s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000337s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.50% : 0.009166s : 1: jit_opt_a 0.11% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.33% : 0.000467s : 1: loop_unroll 0.52% : 0.000739s : 1: mutable_eliminate 0.69% : 0.000978s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000669s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000548s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.19% : 0.003090s : 1: renormalize.infer 0.66% : 0.000933s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 87.31% : 0.123053s : 1: type_inference TotalTime = 0.0965076, [30] [bootstrap]: 0.00032786 [type_inference]: 0.0842664 [event_method]: 0.00036143 [auto_monad]: 0.00014694 [graph_reusing]: 9.39e-06 [pre_auto_parallel]: 3.99002e-06 [py_interpret_to_execute]: 4.547e-05 [rewriter_before_opt_a]: 0.00017246 [expand_dump_flag]: 3.99997e-06 [jit_opt_a]: 0.00853667, [2] [Cycle 1]: 0.00447227, [27] [switch_simplify]: 0.00021017 [loop_unroll]: 6.523e-05 [a_1]: 0.00174244 [with_stream_mark]: 2.085e-05 [recompute_prepare]: 9.32001e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 4.80001e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.00206334 [add_forward_monad_depend]: 9.49999e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.722e-05 [cse]: 3.03e-05 [replace_applicator]: 1.895e-05 [Cycle 2]: 0.00034784, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 5.35999e-06 [a_1]: 9.68e-05 [with_stream_mark]: 1.382e-05 [recompute_prepare]: 4.83001e-06 [updatestate_depend_eliminate]: 3.52997e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 4.88001e-06 [updatestate_useless_node_eliminater]: 4.68001e-06 [accelerated_algorithm]: 5.12999e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 1.02e-05 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.712e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 5.12e-06 [cse]: 1.13e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.334e-05 [rewriter_after_opt_a]: 3.872e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00074307 [jit_opt_b]: 5.481e-05, [1] [Cycle 1]: 4.666e-05, [2] [frontend_op_eliminate]: 1.641e-05 [inline_after_opt_a]: 1.706e-05 [cconv]: 3.365e-05 [loop_unroll]: 0.00047424 [jit_opt_after_cconv]: 0.00018093, [1] [Cycle 1]: 0.00017412, [11] [c_1]: 2.159e-05 [parameter_eliminate]: 3.07002e-06 [updatestate_depend_eliminate]: 8.35001e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.965e-05 [call_graph_tuple_transform]: 2.221e-05 [tuple_list_get_item_eliminator]: 5.66998e-06 [none_parameter_eliminate]: 2.29001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.12e-06 [remove_dup_value]: 1.414e-05 [partial_unused_args_eliminate]: 2.82002e-06 [environ_conv]: 5.24e-06 [add_recomputation]: 5.08e-05 [cse_after_recomputation]: 2.266e-05, [1] [Cycle 1]: 1.692e-05, [1] [cse]: 1.008e-05 [auto_monad_reorder]: 1.563e-05 [get_jit_bprop_graph]: 2.86e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.00051636 [symbol_engine_optimizer]: 9.459e-05, [1] [Cycle 1]: 8.822e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.277e-05 [opt_reshape]: 2.569e-05 [fold_const_symbol]: 9.62999e-06 [renormalize]: 3.7998e-07 [validate]: 3.937e-05 Sums bootstrap : 0.000328s : 0.36% type_inference : 0.084266s : 91.57% event_method : 0.000361s : 0.39% auto_monad : 0.000147s : 0.16% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000045s : 0.05% rewriter_before_opt_a : 0.000172s : 0.19% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000216s : 0.24% jit_opt_a.loop_unroll : 0.000071s : 0.08% jit_opt_a.a_1 : 0.001839s : 2.00% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000009s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.002063s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000743s : 0.81% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000034s : 0.04% loop_unroll : 0.000474s : 0.52% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000051s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000516s : 0.56% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000026s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000752 56 0.27% : 0.000002s : 2: substitution.elim_not_effective 0.18% : 0.000001s : 2: substitution.fold_const_symbol 0.80% : 0.000006s : 3: substitution.graph_param_transform 87.44% : 0.000658s : 15: substitution.inline 0.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.94% : 0.000007s : 4: substitution.minmaximum_grad 0.64% : 0.000005s : 4: substitution.remove_not_recompute_node 0.63% : 0.000005s : 2: substitution.replace_old_param 1.88% : 0.000014s : 4: substitution.switch_simplify 1.84% : 0.000014s : 4: substitution.tuple_list_convert_item_index_to_positive 1.35% : 0.000010s : 4: substitution.tuple_list_get_item_depend_reorder 3.60% : 0.000027s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.084173 2 95.44% : 0.080333s : 1: type_inference.infer 4.56% : 0.003840s : 1: type_inference.specialize ------[replace.] 0.000391 23 53.17% : 0.000208s : 15: replace.inline 17.37% : 0.000068s : 4: replace.switch_simplify 29.46% : 0.000115s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000671 23 96.94% : 0.000650s : 15: match.inline 1.73% : 0.000012s : 4: match.switch_simplify 1.33% : 0.000009s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000221 1341 1.70% : 0.000004s : 21: predicate.accumulaten_eliminater 0.62% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.29% : 0.000003s : 21: predicate.addn_check_dump 1.41% : 0.000003s : 21: predicate.addn_zero_filter 2.22% : 0.000005s : 21: predicate.arithmetic_simplify 1.39% : 0.000003s : 21: predicate.cast_eliminate 0.22% : 0.000000s : 3: predicate.check_bprop_eliminate 1.23% : 0.000003s : 21: predicate.compare_switch_simplify 1.37% : 0.000003s : 21: predicate.depend_value_elim 1.33% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.33% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.39% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.42% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.28% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.28% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.26% : 0.000003s : 21: predicate.environ_get_depend_swap 1.48% : 0.000003s : 21: predicate.environ_get_eliminate 1.28% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.64% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000001s : 3: predicate.graph_param_transform 5.98% : 0.000013s : 46: predicate.inline 0.47% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.63% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000003s : 25: predicate.list_to_tuple_eliminator_ 1.72% : 0.000004s : 28: predicate.load_eliminater 0.86% : 0.000002s : 3: predicate.loop_unroll_after_grad 5.10% : 0.000011s : 78: predicate.loop_unroll_before_grad 1.66% : 0.000004s : 24: predicate.make_slice_get_slice_eliminator 1.25% : 0.000003s : 21: predicate.merge_addn 1.32% : 0.000003s : 21: predicate.minmaximum_grad 1.22% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000005s : 28: predicate.partial_eliminate 1.28% : 0.000003s : 21: predicate.print_const_string_wrapper 2.11% : 0.000005s : 21: predicate.reduce_eliminate 1.55% : 0.000003s : 25: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000004s : 31: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000001s : 3: predicate.reset_defer_inline 1.30% : 0.000003s : 21: predicate.reshape_eliminate 1.41% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.43% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000003s : 21: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.50% : 0.000001s : 6: predicate.special_op_eliminate 0.48% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000004s : 21: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.37% : 0.000007s : 40: predicate.switch_defer_inline 2.75% : 0.000006s : 40: predicate.switch_layer_defer_inline 9.73% : 0.000022s : 129: predicate.switch_simplify 1.32% : 0.000003s : 21: predicate.tile_eliminate 1.26% : 0.000003s : 21: predicate.transpose_eliminate 1.58% : 0.000003s : 21: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000008s : 31: predicate.tuple_list_get_item_eliminator 1.53% : 0.000003s : 21: predicate.tuple_list_set_item_eliminator 1.58% : 0.000003s : 25: predicate.tuple_to_list_eliminator_ 1.69% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.31% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.76% : 0.000004s : 21: predicate.value_based_eliminate 0.23% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.33% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003716 38 61.07% : 0.002269s : 15: func_graph_cloner_run.FuncGraphClonerGraph 9.95% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerNode 28.98% : 0.001077s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.100781 72 0.05% : 0.000054s : 1: add_recomputation 0.15% : 0.000154s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.34% : 0.000344s : 1: bootstrap 0.04% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.37% : 0.000369s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 8.47% : 0.008540s : 1: jit_opt_a 0.18% : 0.000184s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.48% : 0.000484s : 1: loop_unroll 0.75% : 0.000756s : 1: mutable_eliminate 2.24% : 0.002256s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000053s : 4: opt.transform.symbol_engine_opt 0.52% : 0.000525s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000049s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 1.41% : 0.001425s : 1: renormalize.infer 0.62% : 0.000627s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.18% : 0.000176s : 1: rewriter_before_opt_a 0.10% : 0.000097s : 1: symbol_engine_optimizer 83.63% : 0.084280s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.863.124 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e700> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.863.806 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.228991, [30] [bootstrap]: 0.00027035 [type_inference]: 0.217247 [event_method]: 2.228e-05 [auto_monad]: 8.003e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 0.00044815 [rewriter_before_opt_a]: 9.935e-05 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.0081873, [2] [Cycle 1]: 0.00403954, [27] [switch_simplify]: 6.943e-05 [loop_unroll]: 3.485e-05 [a_1]: 0.00073413 [with_stream_mark]: 2.395e-05 [recompute_prepare]: 5.622e-05 [updatestate_depend_eliminate]: 6.38998e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 9.47001e-06 [updatestate_useless_node_eliminater]: 7.3e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 6.74999e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.798e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.141e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00271589 [add_forward_monad_depend]: 9.53002e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.992e-05 [cse]: 4.128e-05 [replace_applicator]: 2.157e-05 [Cycle 2]: 0.00038865, [27] [switch_simplify]: 7.56999e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.00012498 [with_stream_mark]: 1.517e-05 [recompute_prepare]: 6.44999e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.801e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 8.81997e-06 [inline_without_move]: 5.53002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.84e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 7.23999e-06 [cse]: 1.536e-05 [replace_applicator]: 6.15002e-06 [py_interpret_to_execute_after_opt_a]: 1.657e-05 [rewriter_after_opt_a]: 4.152e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.00075616 [jit_opt_b]: 6.228e-05, [1] [Cycle 1]: 5.436e-05, [2] [frontend_op_eliminate]: 2.216e-05 [inline_after_opt_a]: 2.03e-05 [cconv]: 3.254e-05 [loop_unroll]: 0.00045459 [jit_opt_after_cconv]: 0.00017523, [1] [Cycle 1]: 0.00016795, [11] [c_1]: 2.632e-05 [parameter_eliminate]: 4.05e-06 [updatestate_depend_eliminate]: 8.80001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 3.434e-05 [call_graph_tuple_transform]: 2.386e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 7.60017e-07 [switch_simplify]: 6.55997e-06 [remove_dup_value]: 2.048e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 9.44e-06 [add_recomputation]: 5.72e-05 [cse_after_recomputation]: 2.762e-05, [1] [Cycle 1]: 2.031e-05, [1] [cse]: 1.389e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00051285 [symbol_engine_optimizer]: 8.311e-05, [1] [Cycle 1]: 7.648e-05, [6] [build]: 4.27998e-06 [elim_shapecalc]: 9.67999e-06 [elim_not_effective]: 1.733e-05 [opt_reshape]: 6.94999e-06 [fold_const_symbol]: 1.132e-05 [renormalize]: 6.59988e-07 [validate]: 0.00014116 Sums bootstrap : 0.000270s : 0.12% type_inference : 0.217247s : 96.73% event_method : 0.000022s : 0.01% auto_monad : 0.000080s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000448s : 0.20% rewriter_before_opt_a : 0.000099s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000859s : 0.38% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000063s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002716s : 1.21% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000057s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000756s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000033s : 0.01% loop_unroll : 0.000455s : 0.20% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000057s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000513s : 0.23% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000141s : 0.06% Time group info: ------[substitution.] 0.000303 25 0.83% : 0.000003s : 2: substitution.elim_not_effective 1.10% : 0.000003s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 4: substitution.graph_param_transform 86.12% : 0.000261s : 5: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 4.62% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.217164 2 98.65% : 0.214226s : 1: type_inference.infer 1.35% : 0.002938s : 1: type_inference.specialize ------[replace.] 0.000105 7 69.80% : 0.000074s : 5: replace.inline 30.20% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000271 7 95.29% : 0.000258s : 5: match.inline 4.71% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.13% : 0.000002s : 13: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 13: predicate.addn_check_dump 1.65% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 6.12% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.77% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.72% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 1.11% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 2.01% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.94% : 0.000012s : 64: predicate.switch_simplify 1.10% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002294 25 64.66% : 0.001483s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.62% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.72% : 0.000728s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.232872 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000083s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000289s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.52% : 0.008191s : 1: jit_opt_a 0.08% : 0.000178s : 1: jit_opt_after_cconv 0.03% : 0.000065s : 1: jit_opt_b 0.20% : 0.000464s : 1: loop_unroll 0.33% : 0.000767s : 1: mutable_eliminate 0.51% : 0.001178s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000454s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.84% : 0.001950s : 1: renormalize.infer 0.32% : 0.000753s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000105s : 1: rewriter_before_opt_a 0.04% : 0.000086s : 1: symbol_engine_optimizer 93.30% : 0.217263s : 1: type_inference TotalTime = 0.0330519, [30] [bootstrap]: 0.00027048 [type_inference]: 0.0157024 [event_method]: 6.453e-05 [auto_monad]: 9.75e-05 [graph_reusing]: 7.47002e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 2.932e-05 [rewriter_before_opt_a]: 0.000104 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.014542, [3] [Cycle 1]: 0.00734832, [27] [switch_simplify]: 7.117e-05 [loop_unroll]: 4.149e-05 [a_1]: 0.0009055 [with_stream_mark]: 2.999e-05 [recompute_prepare]: 1.849e-05 [updatestate_depend_eliminate]: 8.98002e-06 [updatestate_assign_eliminate]: 6.66999e-06 [updatestate_loads_eliminate]: 6.69999e-06 [parameter_eliminate]: 2.66999e-06 [specialize_transform]: 1.327e-05 [updatestate_useless_node_eliminater]: 1.22e-05 [accelerated_algorithm]: 1.294e-05 [meta_shard_fg_expand]: 3.36999e-06 [get_grad_eliminate_]: 1.258e-05 [merge_forward]: 8.90999e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.698e-05 [j_node_and_user_rematch]: 2.329e-05 [meta_fg_expand]: 0.00172473 [replace_old_param]: 5.929e-05 [inline_without_move]: 5.305e-05 [renormalize]: 0.00371166 [add_forward_monad_depend]: 1.224e-05 [auto_monad_grad]: 6.41e-06 [auto_monad_eliminator]: 5.804e-05 [cse]: 0.00021428 [replace_applicator]: 7.736e-05 [Cycle 2]: 0.00355169, [27] [switch_simplify]: 4.044e-05 [loop_unroll]: 3.924e-05 [a_1]: 0.00116911 [with_stream_mark]: 1.763e-05 [recompute_prepare]: 1.116e-05 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 4.38001e-06 [updatestate_loads_eliminate]: 4.4e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 9.16002e-06 [updatestate_useless_node_eliminater]: 8.17e-06 [accelerated_algorithm]: 8.23999e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 8.40999e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.83e-05 [j_node_and_user_rematch]: 1.232e-05 [meta_fg_expand]: 0.00014568 [replace_old_param]: 1.044e-05 [inline_without_move]: 8.51002e-06 [renormalize]: 0.00179305 [add_forward_monad_depend]: 5.17e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 1.073e-05 [cse]: 2.019e-05 [replace_applicator]: 1.191e-05 [Cycle 3]: 0.00027712, [27] [switch_simplify]: 4.03999e-06 [loop_unroll]: 3.45e-06 [a_1]: 3.9e-05 [with_stream_mark]: 8.75999e-06 [recompute_prepare]: 3.83999e-06 [updatestate_depend_eliminate]: 2.25002e-06 [updatestate_assign_eliminate]: 1.55999e-06 [updatestate_loads_eliminate]: 1.49e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 1.297e-05 [updatestate_useless_node_eliminater]: 3.5e-06 [accelerated_algorithm]: 3.35998e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 3.29001e-06 [merge_forward]: 2.09e-06 [cell_reuse_recompute_pass]: 1.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.09e-05 [j_node_and_user_rematch]: 5.96003e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 1.657e-05 [inline_without_move]: 3.47002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.95001e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 4.84998e-06 [cse]: 1.086e-05 [replace_applicator]: 3.51999e-06 [py_interpret_to_execute_after_opt_a]: 1.124e-05 [rewriter_after_opt_a]: 3.614e-05 [convert_after_rewriter]: 5.74e-06 [order_py_execute_after_rewriter]: 4.05e-06 [mutable_eliminate]: 0.00071499 [jit_opt_b]: 4.232e-05, [1] [Cycle 1]: 3.469e-05, [2] [frontend_op_eliminate]: 1.092e-05 [inline_after_opt_a]: 1.169e-05 [cconv]: 2.452e-05 [loop_unroll]: 0.00041589 [jit_opt_after_cconv]: 0.00013377, [1] [Cycle 1]: 0.00011695, [11] [c_1]: 1.368e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 1.69998e-06 [updatestate_loads_eliminate]: 1.59e-06 [cse]: 1.679e-05 [call_graph_tuple_transform]: 1.366e-05 [tuple_list_get_item_eliminator]: 3.64002e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 3.79002e-06 [remove_dup_value]: 1.485e-05 [partial_unused_args_eliminate]: 3.43e-06 [environ_conv]: 4.94e-06 [add_recomputation]: 3.74e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 9.32001e-06 [auto_monad_reorder]: 1.32e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 4.55999e-06 [opt_after_jit_grad]: 0.00043946 [symbol_engine_optimizer]: 7.154e-05, [1] [Cycle 1]: 6.509e-05, [6] [build]: 3.23998e-06 [elim_shapecalc]: 6.19001e-06 [elim_not_effective]: 9.84001e-06 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 6.57002e-06 [renormalize]: 3.69997e-07 [validate]: 4.204e-05 Sums bootstrap : 0.000270s : 0.94% type_inference : 0.015702s : 54.45% event_method : 0.000065s : 0.22% auto_monad : 0.000097s : 0.34% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000029s : 0.10% rewriter_before_opt_a : 0.000104s : 0.36% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000116s : 0.40% jit_opt_a.loop_unroll : 0.000084s : 0.29% jit_opt_a.a_1 : 0.002114s : 7.33% jit_opt_a.with_stream_mark : 0.000056s : 0.20% jit_opt_a.recompute_prepare : 0.000033s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000035s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.08% jit_opt_a.accelerated_algorithm : 0.000025s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.08% jit_opt_a.merge_forward : 0.000016s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.14% jit_opt_a.meta_fg_expand : 0.001872s : 6.49% jit_opt_a.replace_old_param : 0.000086s : 0.30% jit_opt_a.inline_without_move : 0.000065s : 0.23% jit_opt_a.renormalize : 0.005505s : 19.09% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.07% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000074s : 0.26% jit_opt_a.cse : 0.000245s : 0.85% jit_opt_a.replace_applicator : 0.000093s : 0.32% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000036s : 0.13% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000715s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.04% jit_opt_b.inline_after_opt_a : 0.000012s : 0.04% cconv : 0.000025s : 0.09% loop_unroll : 0.000416s : 1.44% jit_opt_after_cconv.c_1 : 0.000014s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000017s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000037s : 0.13% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000013s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000439s : 1.52% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.15% Time group info: ------[substitution.] 0.000549 105 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.84% : 0.000005s : 1: substitution.graph_param_transform 63.78% : 0.000350s : 13: substitution.inline 3.00% : 0.000016s : 2: substitution.inline_without_move 1.60% : 0.000009s : 13: substitution.j_node_and_user_rematch 2.05% : 0.000011s : 7: substitution.minmaximum_grad 1.16% : 0.000006s : 5: substitution.partial_eliminate 1.92% : 0.000011s : 13: substitution.remove_not_recompute_node 5.11% : 0.000028s : 10: substitution.replace_applicator 1.05% : 0.000006s : 8: substitution.replace_old_param 1.33% : 0.000007s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.12% : 0.000006s : 1: substitution.tile_eliminate 5.91% : 0.000032s : 7: substitution.tuple_list_convert_item_index_to_positive 2.85% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.42% : 0.000041s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015619 2 91.13% : 0.014235s : 1: type_inference.infer 8.87% : 0.001385s : 1: type_inference.specialize ------[replace.] 0.000166 20 66.24% : 0.000110s : 13: replace.inline 33.76% : 0.000056s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000363 20 94.25% : 0.000342s : 13: match.inline 5.75% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000364 2537 1.53% : 0.000006s : 44: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.48% : 0.000005s : 44: predicate.addn_check_dump 1.56% : 0.000006s : 44: predicate.addn_zero_filter 2.01% : 0.000007s : 44: predicate.arithmetic_simplify 1.55% : 0.000006s : 44: predicate.cast_eliminate 0.15% : 0.000001s : 1: predicate.check_bprop_eliminate 1.45% : 0.000005s : 44: predicate.compare_switch_simplify 1.60% : 0.000006s : 44: predicate.depend_value_elim 1.55% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.57% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.46% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.50% : 0.000005s : 44: predicate.environ_get_depend_swap 1.53% : 0.000006s : 44: predicate.environ_get_eliminate 1.51% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 1: predicate.fold_const_symbol 0.98% : 0.000004s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.14% : 0.000015s : 66: predicate.inline 1.92% : 0.000007s : 42: predicate.inline_without_move 0.37% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.94% : 0.000003s : 18: predicate.less_batch_normalization 1.82% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 2.07% : 0.000008s : 52: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.34% : 0.000012s : 89: predicate.loop_unroll_before_grad 1.79% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.49% : 0.000005s : 44: predicate.merge_addn 1.51% : 0.000005s : 44: predicate.minmaximum_grad 0.55% : 0.000002s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.34% : 0.000009s : 52: predicate.partial_eliminate 1.67% : 0.000006s : 44: predicate.print_const_string_wrapper 2.05% : 0.000007s : 44: predicate.reduce_eliminate 1.81% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 18: predicate.remove_not_recompute_node 2.57% : 0.000009s : 94: predicate.replace_applicator 1.06% : 0.000004s : 42: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.63% : 0.000006s : 44: predicate.reshape_eliminate 1.53% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.32% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000005s : 44: predicate.same_eliminate 0.45% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 18: predicate.specialize_transform 1.81% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000005s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.93% : 0.000011s : 64: predicate.switch_defer_inline 2.54% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.29% : 0.000023s : 154: predicate.switch_simplify 1.58% : 0.000006s : 44: predicate.tile_eliminate 1.54% : 0.000006s : 44: predicate.transpose_eliminate 1.91% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.88% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.98% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.88% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.79% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 2.02% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002042 32 59.13% : 0.001207s : 15: func_graph_cloner_run.FuncGraphClonerGraph 40.87% : 0.000835s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041301 87 0.10% : 0.000040s : 1: add_recomputation 0.25% : 0.000102s : 1: auto_monad 0.04% : 0.000016s : 1: auto_monad_reorder 0.71% : 0.000293s : 1: bootstrap 0.07% : 0.000027s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.17% : 0.000070s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 35.22% : 0.014546s : 1: jit_opt_a 0.33% : 0.000137s : 1: jit_opt_after_cconv 0.11% : 0.000045s : 1: jit_opt_b 1.03% : 0.000424s : 1: loop_unroll 1.75% : 0.000723s : 1: mutable_eliminate 6.66% : 0.002750s : 39: opt.transform.jit_opt_a 0.07% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000025s : 4: opt.transform.symbol_engine_opt 1.08% : 0.000448s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 8.48% : 0.003500s : 2: renormalize.infer 4.81% : 0.001988s : 2: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000039s : 1: rewriter_after_opt_a 0.26% : 0.000107s : 1: rewriter_before_opt_a 0.18% : 0.000074s : 1: symbol_engine_optimizer 38.06% : 0.015720s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.913.805 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006eb80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.914.462 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0423727, [30] [bootstrap]: 0.00025633 [type_inference]: 0.0177554 [event_method]: 7.115e-05 [auto_monad]: 9.867e-05 [graph_reusing]: 8.03999e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 2.939e-05 [rewriter_before_opt_a]: 0.00012042 [expand_dump_flag]: 3.92998e-06 [jit_opt_a]: 0.021583, [3] [Cycle 1]: 0.013601, [27] [switch_simplify]: 8.297e-05 [loop_unroll]: 4.28e-05 [a_1]: 0.00101285 [with_stream_mark]: 3.572e-05 [recompute_prepare]: 2.048e-05 [updatestate_depend_eliminate]: 9.48002e-06 [updatestate_assign_eliminate]: 7.82e-06 [updatestate_loads_eliminate]: 6.68e-06 [parameter_eliminate]: 2.66e-06 [specialize_transform]: 1.409e-05 [updatestate_useless_node_eliminater]: 1.237e-05 [accelerated_algorithm]: 1.259e-05 [meta_shard_fg_expand]: 4.17e-06 [get_grad_eliminate_]: 1.302e-05 [merge_forward]: 9.07999e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.831e-05 [j_node_and_user_rematch]: 2.373e-05 [meta_fg_expand]: 0.00184355 [replace_old_param]: 6.936e-05 [inline_without_move]: 5.963e-05 [renormalize]: 0.00961736 [add_forward_monad_depend]: 1.302e-05 [auto_monad_grad]: 6.26998e-06 [auto_monad_eliminator]: 6.156e-05 [cse]: 0.0002525 [replace_applicator]: 8.683e-05 [Cycle 2]: 0.00386352, [27] [switch_simplify]: 4.047e-05 [loop_unroll]: 4.003e-05 [a_1]: 0.00121557 [with_stream_mark]: 1.891e-05 [recompute_prepare]: 1.228e-05 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 4.50999e-06 [updatestate_loads_eliminate]: 3.82998e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 8.87999e-06 [updatestate_useless_node_eliminater]: 6.61999e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 3.4e-06 [get_grad_eliminate_]: 6.88e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 1.292e-05 [meta_fg_expand]: 0.0001482 [replace_old_param]: 1.158e-05 [inline_without_move]: 7.4e-06 [renormalize]: 0.00202132 [add_forward_monad_depend]: 7.7e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.372e-05 [cse]: 2.782e-05 [replace_applicator]: 1.812e-05 [Cycle 3]: 0.00028439, [27] [switch_simplify]: 5.30999e-06 [loop_unroll]: 4e-06 [a_1]: 5.285e-05 [with_stream_mark]: 1.269e-05 [recompute_prepare]: 3.62002e-06 [updatestate_depend_eliminate]: 2.53e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 3.67998e-06 [updatestate_useless_node_eliminater]: 3.14001e-06 [accelerated_algorithm]: 3.62002e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 3.03998e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 3.11001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 6.56999e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 3.58999e-06 [inline_without_move]: 3.23998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.58002e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 3.85e-06 [cse]: 1.11e-05 [replace_applicator]: 4.1e-06 [py_interpret_to_execute_after_opt_a]: 1.356e-05 [rewriter_after_opt_a]: 3.689e-05 [convert_after_rewriter]: 6.09001e-06 [order_py_execute_after_rewriter]: 4.47e-06 [mutable_eliminate]: 0.00077269 [jit_opt_b]: 4.557e-05, [1] [Cycle 1]: 3.716e-05, [2] [frontend_op_eliminate]: 1.204e-05 [inline_after_opt_a]: 1.263e-05 [cconv]: 3.25e-05 [loop_unroll]: 0.00042567 [jit_opt_after_cconv]: 0.00013611, [1] [Cycle 1]: 0.00012955, [11] [c_1]: 1.391e-05 [parameter_eliminate]: 3.13998e-06 [updatestate_depend_eliminate]: 5.76998e-06 [updatestate_assign_eliminate]: 1.69e-06 [updatestate_loads_eliminate]: 1.82001e-06 [cse]: 2.226e-05 [call_graph_tuple_transform]: 1.647e-05 [tuple_list_get_item_eliminator]: 3.69002e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 4.16001e-06 [remove_dup_value]: 1.751e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 5.35999e-06 [add_recomputation]: 3.77e-05 [cse_after_recomputation]: 2.084e-05, [1] [Cycle 1]: 1.561e-05, [1] [cse]: 8.05999e-06 [auto_monad_reorder]: 1.348e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 6.84999e-06 [opt_after_jit_grad]: 0.00051822 [symbol_engine_optimizer]: 7.99e-05, [1] [Cycle 1]: 7.25e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 7.35e-06 [elim_not_effective]: 1.23e-05 [opt_reshape]: 5.19e-06 [fold_const_symbol]: 8.13999e-06 [renormalize]: 6.69999e-07 [validate]: 3.972e-05 Sums bootstrap : 0.000256s : 0.68% type_inference : 0.017755s : 47.21% event_method : 0.000071s : 0.19% auto_monad : 0.000099s : 0.26% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000029s : 0.08% rewriter_before_opt_a : 0.000120s : 0.32% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000129s : 0.34% jit_opt_a.loop_unroll : 0.000087s : 0.23% jit_opt_a.a_1 : 0.002281s : 6.07% jit_opt_a.with_stream_mark : 0.000067s : 0.18% jit_opt_a.recompute_prepare : 0.000036s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000027s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.06% jit_opt_a.accelerated_algorithm : 0.000023s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000016s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.11% jit_opt_a.meta_fg_expand : 0.001993s : 5.30% jit_opt_a.replace_old_param : 0.000085s : 0.22% jit_opt_a.inline_without_move : 0.000070s : 0.19% jit_opt_a.renormalize : 0.011639s : 30.95% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000079s : 0.21% jit_opt_a.cse : 0.000291s : 0.77% jit_opt_a.replace_applicator : 0.000109s : 0.29% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000773s : 2.05% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.03% jit_opt_b.inline_after_opt_a : 0.000013s : 0.03% cconv : 0.000033s : 0.09% loop_unroll : 0.000426s : 1.13% jit_opt_after_cconv.c_1 : 0.000014s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000038s : 0.10% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000518s : 1.38% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.11% Time group info: ------[substitution.] 0.000644 104 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.82% : 0.000005s : 1: substitution.graph_param_transform 68.25% : 0.000439s : 13: substitution.inline 2.85% : 0.000018s : 2: substitution.inline_without_move 1.68% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.86% : 0.000012s : 7: substitution.minmaximum_grad 1.21% : 0.000008s : 5: substitution.partial_eliminate 1.76% : 0.000011s : 12: substitution.remove_not_recompute_node 5.20% : 0.000033s : 10: substitution.replace_applicator 1.12% : 0.000007s : 10: substitution.replace_old_param 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.07% : 0.000007s : 1: substitution.tile_eliminate 3.71% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.56% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.04% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017664 2 90.86% : 0.016050s : 1: type_inference.infer 9.14% : 0.001615s : 1: type_inference.specialize ------[replace.] 0.000221 20 68.76% : 0.000152s : 13: replace.inline 31.24% : 0.000069s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000455 20 94.99% : 0.000432s : 13: match.inline 5.01% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2433 1.47% : 0.000006s : 42: predicate.accumulaten_eliminater 0.41% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 42: predicate.addn_check_dump 1.59% : 0.000006s : 42: predicate.addn_zero_filter 2.42% : 0.000009s : 42: predicate.arithmetic_simplify 1.58% : 0.000006s : 42: predicate.cast_eliminate 0.23% : 0.000001s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 42: predicate.compare_switch_simplify 1.40% : 0.000005s : 42: predicate.depend_value_elim 1.49% : 0.000006s : 42: predicate.dict_get_item_const_eliminator 1.46% : 0.000005s : 42: predicate.dict_get_item_eliminator 1.50% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.16% : 0.000001s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.57% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.54% : 0.000006s : 42: predicate.environ_get_add_eliminate 1.37% : 0.000005s : 42: predicate.environ_get_depend_swap 1.41% : 0.000005s : 42: predicate.environ_get_eliminate 1.39% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 16: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.30% : 0.000016s : 64: predicate.inline 2.06% : 0.000008s : 44: predicate.inline_without_move 0.32% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.91% : 0.000003s : 16: predicate.less_batch_normalization 1.90% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 50: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.30% : 0.000012s : 87: predicate.loop_unroll_before_grad 1.62% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.44% : 0.000005s : 42: predicate.merge_addn 1.48% : 0.000006s : 42: predicate.minmaximum_grad 0.36% : 0.000001s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.16% : 0.000008s : 50: predicate.partial_eliminate 1.45% : 0.000005s : 42: predicate.print_const_string_wrapper 2.03% : 0.000008s : 42: predicate.reduce_eliminate 1.84% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 16: predicate.remove_not_recompute_node 2.51% : 0.000009s : 90: predicate.replace_applicator 1.17% : 0.000004s : 44: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.82% : 0.000007s : 42: predicate.reshape_eliminate 1.51% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.26% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000006s : 42: predicate.same_eliminate 0.42% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 2: predicate.special_op_eliminate 0.89% : 0.000003s : 16: predicate.specialize_transform 1.88% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000005s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.18% : 0.000012s : 62: predicate.switch_defer_inline 2.62% : 0.000010s : 62: predicate.switch_layer_defer_inline 6.36% : 0.000024s : 150: predicate.switch_simplify 1.66% : 0.000006s : 42: predicate.tile_eliminate 1.51% : 0.000006s : 42: predicate.transpose_eliminate 2.12% : 0.000008s : 42: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000013s : 51: predicate.tuple_list_get_item_eliminator 2.12% : 0.000008s : 42: predicate.tuple_list_set_item_eliminator 1.70% : 0.000006s : 49: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.91% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 2.07% : 0.000008s : 42: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002741 36 60.53% : 0.001659s : 19: func_graph_cloner_run.FuncGraphClonerGraph 39.47% : 0.001082s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056933 87 0.07% : 0.000040s : 1: add_recomputation 0.18% : 0.000104s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.50% : 0.000284s : 1: bootstrap 0.06% : 0.000035s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.13% : 0.000076s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 37.92% : 0.021587s : 1: jit_opt_a 0.24% : 0.000139s : 1: jit_opt_after_cconv 0.08% : 0.000048s : 1: jit_opt_b 0.76% : 0.000435s : 1: loop_unroll 1.37% : 0.000783s : 1: mutable_eliminate 5.16% : 0.002938s : 39: opt.transform.jit_opt_a 0.06% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000017s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000028s : 4: opt.transform.symbol_engine_opt 0.93% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.06% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 15.64% : 0.008902s : 2: renormalize.infer 4.76% : 0.002712s : 2: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000040s : 1: rewriter_after_opt_a 0.22% : 0.000123s : 1: rewriter_before_opt_a 0.15% : 0.000083s : 1: symbol_engine_optimizer 31.23% : 0.017777s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.969.341 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:23.970.162 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0832861, [30] [bootstrap]: 0.0003407 [type_inference]: 0.0461903 [event_method]: 2.041e-05 [auto_monad]: 7.125e-05 [graph_reusing]: 5.72999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 9.245e-05 [rewriter_before_opt_a]: 7.893e-05 [expand_dump_flag]: 3.80998e-06 [jit_opt_a]: 0.00588926, [2] [Cycle 1]: 0.00186094, [27] [switch_simplify]: 5.731e-05 [loop_unroll]: 2.861e-05 [a_1]: 0.0005418 [with_stream_mark]: 2.243e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.22997e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.14999e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 8.87999e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00086307 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 3.523e-05 [replace_applicator]: 1.525e-05 [Cycle 2]: 0.00031724, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 4.99998e-06 [a_1]: 8.672e-05 [with_stream_mark]: 1.096e-05 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.321e-05 [j_node_and_user_rematch]: 8.58001e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 7.73001e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 1.212e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.188e-05 [rewriter_after_opt_a]: 3.83e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.0123221 [jit_opt_b]: 6.468e-05, [1] [Cycle 1]: 5.315e-05, [2] [frontend_op_eliminate]: 1.962e-05 [inline_after_opt_a]: 2.129e-05 [cconv]: 3.747e-05 [loop_unroll]: 0.016864 [jit_opt_after_cconv]: 0.00021338, [1] [Cycle 1]: 0.00020214, [11] [c_1]: 2.351e-05 [parameter_eliminate]: 4.79998e-06 [updatestate_depend_eliminate]: 7.5e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 4.209e-05 [call_graph_tuple_transform]: 5.109e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 1.39989e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.769e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.28999e-06 [add_recomputation]: 5.746e-05 [cse_after_recomputation]: 2.492e-05, [1] [Cycle 1]: 1.892e-05, [1] [cse]: 1.272e-05 [auto_monad_reorder]: 1.899e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 7.88001e-06 [opt_after_jit_grad]: 0.00054551 [symbol_engine_optimizer]: 7.67e-05, [1] [Cycle 1]: 6.985e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 1.46e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 5.50004e-07 [validate]: 4.589e-05 Sums bootstrap : 0.000341s : 0.43% type_inference : 0.046190s : 58.52% event_method : 0.000020s : 0.03% auto_monad : 0.000071s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000092s : 0.12% rewriter_before_opt_a : 0.000079s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.08% jit_opt_a.loop_unroll : 0.000034s : 0.04% jit_opt_a.a_1 : 0.000629s : 0.80% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000863s : 1.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000047s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.012322s : 15.61% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000037s : 0.05% loop_unroll : 0.016864s : 21.36% jit_opt_after_cconv.c_1 : 0.000024s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000051s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000057s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000546s : 0.69% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.06% Time group info: ------[substitution.] 0.000225 23 1.23% : 0.000003s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000006s : 3: substitution.graph_param_transform 84.47% : 0.000190s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000004s : 4: substitution.remove_not_recompute_node 2.17% : 0.000005s : 2: substitution.replace_old_param 5.13% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046112 2 97.14% : 0.044791s : 1: type_inference.infer 2.86% : 0.001321s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.70% : 0.000045s : 4: replace.inline 34.30% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.74% : 0.000187s : 4: match.inline 5.26% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 2.16% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.09% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.84% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 2.78% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.40% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 3.19% : 0.000004s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.62% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.05% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.49% : 0.000002s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 6: predicate.special_op_eliminate 1.12% : 0.000001s : 6: predicate.specialize_transform 1.18% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 1.86% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.23% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000772 13 49.53% : 0.000383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.59% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.88% : 0.000339s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.085114 72 0.07% : 0.000060s : 1: add_recomputation 0.09% : 0.000074s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.43% : 0.000362s : 1: bootstrap 0.05% : 0.000041s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.92% : 0.005893s : 1: jit_opt_a 0.26% : 0.000217s : 1: jit_opt_after_cconv 0.08% : 0.000068s : 1: jit_opt_b 19.83% : 0.016882s : 1: loop_unroll 14.50% : 0.012346s : 1: mutable_eliminate 0.99% : 0.000845s : 26: opt.transform.jit_opt_a 0.10% : 0.000084s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000028s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000032s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000554s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000096s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.61% : 0.000518s : 1: renormalize.infer 0.40% : 0.000337s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000083s : 1: rewriter_before_opt_a 0.09% : 0.000080s : 1: symbol_engine_optimizer 54.29% : 0.046211s : 1: type_inference TotalTime = 0.160339, [30] [bootstrap]: 0.00031352 [type_inference]: 0.131655 [event_method]: 0.00057616 [auto_monad]: 0.00012071 [graph_reusing]: 7.78999e-06 [pre_auto_parallel]: 3.33998e-06 [py_interpret_to_execute]: 5.688e-05 [rewriter_before_opt_a]: 0.00012662 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.0250957, [3] [Cycle 1]: 0.0176308, [27] [switch_simplify]: 7.796e-05 [loop_unroll]: 4.491e-05 [a_1]: 0.00103869 [with_stream_mark]: 3.4e-05 [recompute_prepare]: 1.995e-05 [updatestate_depend_eliminate]: 1.079e-05 [updatestate_assign_eliminate]: 7.5e-06 [updatestate_loads_eliminate]: 7.13998e-06 [parameter_eliminate]: 3.4e-06 [specialize_transform]: 1.455e-05 [updatestate_useless_node_eliminater]: 1.381e-05 [accelerated_algorithm]: 1.522e-05 [meta_shard_fg_expand]: 4.25e-06 [get_grad_eliminate_]: 1.429e-05 [merge_forward]: 9.41e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.017e-05 [j_node_and_user_rematch]: 2.587e-05 [meta_fg_expand]: 0.00200298 [replace_old_param]: 7.065e-05 [inline_without_move]: 6.135e-05 [renormalize]: 0.0134156 [add_forward_monad_depend]: 1.369e-05 [auto_monad_grad]: 6.74999e-06 [auto_monad_eliminator]: 6.171e-05 [cse]: 0.00027581 [replace_applicator]: 8.985e-05 [Cycle 2]: 0.00348761, [27] [switch_simplify]: 4.385e-05 [loop_unroll]: 4.273e-05 [a_1]: 0.00121142 [with_stream_mark]: 1.712e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 5.21002e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.87002e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 7.30998e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 7.78999e-06 [merge_forward]: 4.61002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 1.112e-05 [meta_fg_expand]: 0.00015025 [replace_old_param]: 8.52e-06 [inline_without_move]: 7.13e-06 [renormalize]: 0.00169336 [add_forward_monad_depend]: 4.99e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.106e-05 [cse]: 2.172e-05 [replace_applicator]: 1.267e-05 [Cycle 3]: 0.00024248, [27] [switch_simplify]: 4.03001e-06 [loop_unroll]: 3.56001e-06 [a_1]: 4.092e-05 [with_stream_mark]: 8.52e-06 [recompute_prepare]: 3.44001e-06 [updatestate_depend_eliminate]: 2.16998e-06 [updatestate_assign_eliminate]: 1.84998e-06 [updatestate_loads_eliminate]: 1.50001e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 3.25e-06 [updatestate_useless_node_eliminater]: 3.29001e-06 [accelerated_algorithm]: 3.41001e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 3.4e-06 [merge_forward]: 2.37999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.84999e-06 [j_node_and_user_rematch]: 5.25001e-06 [meta_fg_expand]: 1.11002e-06 [replace_old_param]: 3.6e-06 [inline_without_move]: 3.14999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 3.3e-06 [cse]: 7.95998e-06 [replace_applicator]: 3.51999e-06 [py_interpret_to_execute_after_opt_a]: 1.099e-05 [rewriter_after_opt_a]: 3.36e-05 [convert_after_rewriter]: 6.31998e-06 [order_py_execute_after_rewriter]: 4.42998e-06 [mutable_eliminate]: 0.00076982 [jit_opt_b]: 4.794e-05, [1] [Cycle 1]: 4.032e-05, [2] [frontend_op_eliminate]: 1.429e-05 [inline_after_opt_a]: 1.158e-05 [cconv]: 2.693e-05 [loop_unroll]: 0.00043892 [jit_opt_after_cconv]: 0.0001301, [1] [Cycle 1]: 0.00012387, [11] [c_1]: 1.5e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 1.84998e-06 [updatestate_loads_eliminate]: 1.62999e-06 [cse]: 1.812e-05 [call_graph_tuple_transform]: 1.377e-05 [tuple_list_get_item_eliminator]: 4.58001e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 3.41999e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 4.50001e-06 [add_recomputation]: 4.007e-05 [cse_after_recomputation]: 2.02e-05, [1] [Cycle 1]: 1.423e-05, [1] [cse]: 7.35998e-06 [auto_monad_reorder]: 1.35e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 4.48999e-06 [opt_after_jit_grad]: 0.00044366 [symbol_engine_optimizer]: 0.00011816, [1] [Cycle 1]: 0.00011163, [6] [build]: 4.25e-06 [elim_shapecalc]: 6.32001e-06 [elim_not_effective]: 1.037e-05 [opt_reshape]: 4.48001e-06 [fold_const_symbol]: 5.638e-05 [renormalize]: 5.3001e-07 [validate]: 3.307e-05 Sums bootstrap : 0.000314s : 0.20% type_inference : 0.131655s : 84.55% event_method : 0.000576s : 0.37% auto_monad : 0.000121s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000057s : 0.04% rewriter_before_opt_a : 0.000127s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002291s : 1.47% jit_opt_a.with_stream_mark : 0.000060s : 0.04% jit_opt_a.recompute_prepare : 0.000033s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000025s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.03% jit_opt_a.meta_fg_expand : 0.002154s : 1.38% jit_opt_a.replace_old_param : 0.000083s : 0.05% jit_opt_a.inline_without_move : 0.000072s : 0.05% jit_opt_a.renormalize : 0.015109s : 9.70% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000076s : 0.05% jit_opt_a.cse : 0.000305s : 0.20% jit_opt_a.replace_applicator : 0.000106s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000770s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000439s : 0.28% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000444s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000056s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000033s : 0.02% Time group info: ------[substitution.] 0.000664 104 0.26% : 0.000002s : 1: substitution.elim_not_effective 7.63% : 0.000051s : 1: substitution.fold_const_symbol 0.61% : 0.000004s : 1: substitution.graph_param_transform 63.09% : 0.000419s : 13: substitution.inline 2.73% : 0.000018s : 2: substitution.inline_without_move 1.39% : 0.000009s : 12: substitution.j_node_and_user_rematch 1.80% : 0.000012s : 7: substitution.minmaximum_grad 1.16% : 0.000008s : 5: substitution.partial_eliminate 1.58% : 0.000010s : 12: substitution.remove_not_recompute_node 4.88% : 0.000032s : 10: substitution.replace_applicator 0.97% : 0.000006s : 10: substitution.replace_old_param 0.36% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000006s : 1: substitution.tile_eliminate 3.54% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.36% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.66% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131544 2 96.91% : 0.127475s : 1: type_inference.infer 3.09% : 0.004069s : 1: type_inference.specialize ------[replace.] 0.000205 20 63.37% : 0.000130s : 13: replace.inline 36.63% : 0.000075s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000434 20 94.67% : 0.000411s : 13: match.inline 5.33% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000374 2544 1.52% : 0.000006s : 44: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.47% : 0.000005s : 44: predicate.addn_check_dump 1.61% : 0.000006s : 44: predicate.addn_zero_filter 2.21% : 0.000008s : 44: predicate.arithmetic_simplify 1.63% : 0.000006s : 44: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.48% : 0.000006s : 44: predicate.compare_switch_simplify 1.52% : 0.000006s : 44: predicate.depend_value_elim 1.39% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.63% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.47% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.18% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.42% : 0.000005s : 44: predicate.environ_get_depend_swap 1.55% : 0.000006s : 44: predicate.environ_get_eliminate 1.41% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.88% : 0.000003s : 17: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.35% : 0.000016s : 66: predicate.inline 2.00% : 0.000007s : 45: predicate.inline_without_move 0.32% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.90% : 0.000003s : 17: predicate.less_batch_normalization 1.75% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 52: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.41% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.71% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.45% : 0.000005s : 44: predicate.merge_addn 1.48% : 0.000006s : 44: predicate.minmaximum_grad 0.48% : 0.000002s : 1: predicate.mutable_eliminate 0.17% : 0.000001s : 1: predicate.opt_reshape 2.35% : 0.000009s : 52: predicate.partial_eliminate 1.46% : 0.000005s : 44: predicate.print_const_string_wrapper 2.10% : 0.000008s : 44: predicate.reduce_eliminate 1.74% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 17: predicate.remove_not_recompute_node 2.71% : 0.000010s : 96: predicate.replace_applicator 1.13% : 0.000004s : 45: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.57% : 0.000006s : 44: predicate.reshape_eliminate 1.63% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.68% : 0.000006s : 44: predicate.same_eliminate 0.48% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.75% : 0.000003s : 17: predicate.specialize_transform 1.81% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.08% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.89% : 0.000011s : 64: predicate.switch_defer_inline 2.60% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.61% : 0.000025s : 157: predicate.switch_simplify 1.61% : 0.000006s : 44: predicate.tile_eliminate 1.54% : 0.000006s : 44: predicate.transpose_eliminate 2.04% : 0.000008s : 44: predicate.tuple_list_convert_item_index_to_positive 1.97% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.86% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.75% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.77% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.91% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.29% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004536 45 75.76% : 0.003437s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.24% : 0.001100s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178527 87 0.02% : 0.000043s : 1: add_recomputation 0.07% : 0.000128s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.19% : 0.000344s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000006s : 1: environ_conv 0.33% : 0.000585s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.06% : 0.025099s : 1: jit_opt_a 0.07% : 0.000133s : 1: jit_opt_after_cconv 0.03% : 0.000051s : 1: jit_opt_b 0.25% : 0.000447s : 1: loop_unroll 0.44% : 0.000779s : 1: mutable_eliminate 1.65% : 0.002951s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000092s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000075s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000452s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000060s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.06% : 0.012596s : 2: renormalize.infer 1.40% : 0.002493s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000130s : 1: rewriter_before_opt_a 0.07% : 0.000121s : 1: symbol_engine_optimizer 73.76% : 0.131680s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.159.966 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00659d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.160.643 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.282617, [30] [bootstrap]: 0.00033781 [type_inference]: 0.262519 [event_method]: 0.00037526 [auto_monad]: 0.00604143 [graph_reusing]: 1.12e-05 [pre_auto_parallel]: 4.52e-06 [py_interpret_to_execute]: 6.672e-05 [rewriter_before_opt_a]: 0.00018482 [expand_dump_flag]: 4.01001e-06 [jit_opt_a]: 0.0102075, [2] [Cycle 1]: 0.00462041, [27] [switch_simplify]: 0.00021044 [loop_unroll]: 6.368e-05 [a_1]: 0.00146484 [with_stream_mark]: 2.697e-05 [recompute_prepare]: 1.189e-05 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 3.10998e-06 [specialize_transform]: 7.60998e-06 [updatestate_useless_node_eliminater]: 6.54999e-06 [accelerated_algorithm]: 7.21999e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 4.74002e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.848e-05 [j_node_and_user_rematch]: 1.095e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.228e-05 [inline_without_move]: 7.03998e-06 [renormalize]: 0.00239869 [add_forward_monad_depend]: 8.62998e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.916e-05 [cse]: 4.132e-05 [replace_applicator]: 2.863e-05 [Cycle 2]: 0.00036192, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.79999e-06 [a_1]: 9.505e-05 [with_stream_mark]: 1.577e-05 [recompute_prepare]: 5.69999e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 2.36998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 1.96003e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 6.92002e-06 [cse]: 1.456e-05 [replace_applicator]: 5.43002e-06 [py_interpret_to_execute_after_opt_a]: 1.73e-05 [rewriter_after_opt_a]: 4.166e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00084038 [jit_opt_b]: 5.504e-05, [1] [Cycle 1]: 4.637e-05, [2] [frontend_op_eliminate]: 1.729e-05 [inline_after_opt_a]: 1.717e-05 [cconv]: 3.298e-05 [loop_unroll]: 0.00052918 [jit_opt_after_cconv]: 0.00016918, [1] [Cycle 1]: 0.00016215, [11] [c_1]: 2.328e-05 [parameter_eliminate]: 3.89002e-06 [updatestate_depend_eliminate]: 8.23999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.145e-05 [call_graph_tuple_transform]: 2.286e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 6.59999e-06 [remove_dup_value]: 1.839e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.38e-06 [add_recomputation]: 5.525e-05 [cse_after_recomputation]: 2.229e-05, [1] [Cycle 1]: 1.711e-05, [1] [cse]: 1.163e-05 [auto_monad_reorder]: 1.803e-05 [get_jit_bprop_graph]: 2.89999e-06 [rewriter_after_jit_bprop_graph]: 9.22001e-06 [opt_after_jit_grad]: 0.00054132 [symbol_engine_optimizer]: 0.00013192, [1] [Cycle 1]: 0.00012475, [6] [build]: 3.81001e-06 [elim_shapecalc]: 9.86e-06 [elim_not_effective]: 1.508e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 6.029e-05 [renormalize]: 8.70001e-07 [validate]: 4.795e-05 Sums bootstrap : 0.000338s : 0.12% type_inference : 0.262519s : 94.91% event_method : 0.000375s : 0.14% auto_monad : 0.006041s : 2.18% graph_reusing : 0.000011s : 0.00% pre_auto_parallel : 0.000005s : 0.00% py_interpret_to_execute : 0.000067s : 0.02% rewriter_before_opt_a : 0.000185s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000217s : 0.08% jit_opt_a.loop_unroll : 0.000069s : 0.03% jit_opt_a.a_1 : 0.001560s : 0.56% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002399s : 0.87% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000840s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000033s : 0.01% loop_unroll : 0.000529s : 0.19% jit_opt_after_cconv.c_1 : 0.000023s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000541s : 0.20% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000060s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.02% Time group info: ------[substitution.] 0.000616 35 0.31% : 0.000002s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 1.13% : 0.000007s : 3: substitution.graph_param_transform 89.16% : 0.000549s : 12: substitution.inline 0.88% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.23% : 0.000008s : 2: substitution.replace_old_param 2.08% : 0.000013s : 1: substitution.reshape_eliminate 2.14% : 0.000013s : 3: substitution.switch_simplify 2.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.262401 2 98.72% : 0.259036s : 1: type_inference.infer 1.28% : 0.003365s : 1: type_inference.specialize ------[replace.] 0.000318 18 51.38% : 0.000163s : 12: replace.inline 1.58% : 0.000005s : 1: replace.reshape_eliminate 22.43% : 0.000071s : 3: replace.switch_simplify 24.61% : 0.000078s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000577 18 94.06% : 0.000543s : 12: match.inline 2.00% : 0.000012s : 1: match.reshape_eliminate 1.97% : 0.000011s : 3: match.switch_simplify 1.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000209 1212 1.46% : 0.000003s : 19: predicate.accumulaten_eliminater 0.78% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 19: predicate.addn_check_dump 1.36% : 0.000003s : 19: predicate.addn_zero_filter 2.17% : 0.000005s : 19: predicate.arithmetic_simplify 1.54% : 0.000003s : 20: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000002s : 19: predicate.compare_switch_simplify 1.30% : 0.000003s : 19: predicate.depend_value_elim 1.32% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.48% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.34% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.49% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.31% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.24% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.25% : 0.000003s : 20: predicate.environ_get_depend_swap 1.54% : 0.000003s : 20: predicate.environ_get_eliminate 1.27% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.51% : 0.000001s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000012s : 40: predicate.inline 0.61% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.74% : 0.000004s : 25: predicate.load_eliminater 0.95% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.60% : 0.000010s : 64: predicate.loop_unroll_before_grad 2.24% : 0.000005s : 23: predicate.make_slice_get_slice_eliminator 1.22% : 0.000003s : 19: predicate.merge_addn 1.19% : 0.000002s : 19: predicate.minmaximum_grad 0.77% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000004s : 25: predicate.partial_eliminate 1.28% : 0.000003s : 19: predicate.print_const_string_wrapper 2.02% : 0.000004s : 19: predicate.reduce_eliminate 1.84% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000003s : 28: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.80% : 0.000004s : 20: predicate.reshape_eliminate 1.54% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.51% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000003s : 19: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.63% : 0.000001s : 6: predicate.special_op_eliminate 0.55% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.25% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.23% : 0.000007s : 34: predicate.switch_defer_inline 2.64% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.71% : 0.000018s : 107: predicate.switch_simplify 1.43% : 0.000003s : 19: predicate.tile_eliminate 1.28% : 0.000003s : 19: predicate.transpose_eliminate 1.54% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.94% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.64% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.56% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.26% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.92% : 0.000004s : 19: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003366 40 64.40% : 0.002167s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.85% : 0.000298s : 5: func_graph_cloner_run.FuncGraphClonerNode 26.75% : 0.000900s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.287102 72 0.02% : 0.000058s : 1: add_recomputation 2.13% : 0.006109s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.13% : 0.000360s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.14% : 0.000389s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000017s : 1: graph_reusing 3.56% : 0.010211s : 1: jit_opt_a 0.06% : 0.000172s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.19% : 0.000539s : 1: loop_unroll 0.30% : 0.000855s : 1: mutable_eliminate 0.69% : 0.001993s : 26: opt.transform.jit_opt_a 0.02% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000086s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000553s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000007s : 1: pre_auto_parallel 0.02% : 0.000070s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.62% : 0.001768s : 1: renormalize.infer 0.22% : 0.000619s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000191s : 1: rewriter_before_opt_a 0.05% : 0.000135s : 1: symbol_engine_optimizer 91.45% : 0.262550s : 1: type_inference TotalTime = 0.188004, [30] [bootstrap]: 0.00036164 [type_inference]: 0.150187 [event_method]: 2.354e-05 [auto_monad]: 8.204e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 0.00039975 [rewriter_before_opt_a]: 0.00010959 [expand_dump_flag]: 4.70999e-06 [jit_opt_a]: 0.0336756, [2] [Cycle 1]: 0.0294956, [27] [switch_simplify]: 8.335e-05 [loop_unroll]: 3.509e-05 [a_1]: 0.00073264 [with_stream_mark]: 2.143e-05 [recompute_prepare]: 9.62001e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.48999e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 7.12002e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.78998e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 6.34999e-06 [renormalize]: 0.0281656 [add_forward_monad_depend]: 1.385e-05 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 2.774e-05 [cse]: 5.016e-05 [replace_applicator]: 3.118e-05 [Cycle 2]: 0.00043061, [27] [switch_simplify]: 8.57e-06 [loop_unroll]: 7.46001e-06 [a_1]: 0.00013793 [with_stream_mark]: 1.714e-05 [recompute_prepare]: 7.56999e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.49001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 6.43998e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.68002e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.179e-05 [j_node_and_user_rematch]: 1.086e-05 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 1.14e-05 [inline_without_move]: 5.79999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.84998e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 7.46999e-06 [cse]: 1.715e-05 [replace_applicator]: 7.01001e-06 [py_interpret_to_execute_after_opt_a]: 2.159e-05 [rewriter_after_opt_a]: 4.63e-05 [convert_after_rewriter]: 7.61001e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.00088621 [jit_opt_b]: 6.675e-05, [1] [Cycle 1]: 5.601e-05, [2] [frontend_op_eliminate]: 2.014e-05 [inline_after_opt_a]: 2.188e-05 [cconv]: 3.799e-05 [loop_unroll]: 0.00053996 [jit_opt_after_cconv]: 0.00020718, [1] [Cycle 1]: 0.00019981, [11] [c_1]: 2.751e-05 [parameter_eliminate]: 6.46e-06 [updatestate_depend_eliminate]: 1.258e-05 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 3.07002e-06 [cse]: 4.743e-05 [call_graph_tuple_transform]: 2.862e-05 [tuple_list_get_item_eliminator]: 7.37002e-06 [none_parameter_eliminate]: 2.13002e-06 [renormalize]: 1.04e-06 [switch_simplify]: 6.53e-06 [remove_dup_value]: 2.371e-05 [partial_unused_args_eliminate]: 2.63998e-06 [environ_conv]: 1.281e-05 [add_recomputation]: 6.232e-05 [cse_after_recomputation]: 2.984e-05, [1] [Cycle 1]: 2.414e-05, [1] [cse]: 1.503e-05 [auto_monad_reorder]: 1.902e-05 [get_jit_bprop_graph]: 3.28998e-06 [rewriter_after_jit_bprop_graph]: 1.042e-05 [opt_after_jit_grad]: 0.00077177 [symbol_engine_optimizer]: 9.535e-05, [1] [Cycle 1]: 8.569e-05, [6] [build]: 7.15e-06 [elim_shapecalc]: 1.068e-05 [elim_not_effective]: 2.024e-05 [opt_reshape]: 7.13e-06 [fold_const_symbol]: 1.079e-05 [renormalize]: 6.10016e-07 [validate]: 7.296e-05 Sums bootstrap : 0.000362s : 0.20% type_inference : 0.150187s : 81.83% event_method : 0.000024s : 0.01% auto_monad : 0.000082s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000400s : 0.22% rewriter_before_opt_a : 0.000110s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.000871s : 0.47% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.028166s : 15.35% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.02% jit_opt_a.cse : 0.000067s : 0.04% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000046s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000886s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000038s : 0.02% loop_unroll : 0.000540s : 0.29% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000024s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000062s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000772s : 0.42% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000073s : 0.04% Time group info: ------[substitution.] 0.000299 25 0.91% : 0.000003s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.70% : 0.000008s : 4: substitution.graph_param_transform 85.53% : 0.000256s : 5: substitution.inline 1.72% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 2.33% : 0.000007s : 2: substitution.replace_old_param 4.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.150085 2 98.39% : 0.147670s : 1: type_inference.infer 1.61% : 0.002415s : 1: type_inference.specialize ------[replace.] 0.000108 7 67.76% : 0.000073s : 5: replace.inline 32.24% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 95.51% : 0.000253s : 5: match.inline 4.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 888 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.33% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.87% : 0.000001s : 13: predicate.addn_check_dump 1.16% : 0.000002s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.34% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000002s : 13: predicate.compare_switch_simplify 1.05% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.99% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.57% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.63% : 0.000001s : 4: predicate.elim_not_effective 0.83% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.88% : 0.000002s : 13: predicate.environ_get_depend_swap 1.11% : 0.000002s : 13: predicate.environ_get_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 5.25% : 0.000009s : 28: predicate.inline 0.72% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.55% : 0.000003s : 19: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.71% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 13: predicate.merge_addn 0.92% : 0.000002s : 13: predicate.minmaximum_grad 2.11% : 0.000004s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000004s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.57% : 0.000003s : 13: predicate.reduce_eliminate 1.26% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.17% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000004s : 20: predicate.switch_defer_inline 1.78% : 0.000003s : 20: predicate.switch_layer_defer_inline 13.80% : 0.000024s : 65: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.03% : 0.000002s : 13: predicate.transpose_eliminate 1.23% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.37% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.29% : 0.000002s : 13: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003066 29 64.21% : 0.001969s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.79% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.00% : 0.001012s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.217414 72 0.03% : 0.000066s : 1: add_recomputation 0.04% : 0.000086s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.18% : 0.000382s : 1: bootstrap 0.02% : 0.000041s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 15.49% : 0.033679s : 1: jit_opt_a 0.10% : 0.000210s : 1: jit_opt_after_cconv 0.03% : 0.000070s : 1: jit_opt_b 0.25% : 0.000551s : 1: loop_unroll 0.42% : 0.000904s : 1: mutable_eliminate 0.54% : 0.001171s : 26: opt.transform.jit_opt_a 0.03% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.02% : 0.000039s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000791s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000408s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000026s : 1: remove_dup_value 12.40% : 0.026968s : 1: renormalize.infer 0.54% : 0.001178s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000050s : 1: rewriter_after_opt_a 0.05% : 0.000115s : 1: rewriter_before_opt_a 0.05% : 0.000100s : 1: symbol_engine_optimizer 69.09% : 0.150205s : 1: type_inference TotalTime = 0.057251, [30] [bootstrap]: 0.00040951 [type_inference]: 0.0381939 [event_method]: 2.239e-05 [auto_monad]: 7.548e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 3.53e-06 [py_interpret_to_execute]: 0.00013994 [rewriter_before_opt_a]: 8.751e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.0155987, [2] [Cycle 1]: 0.0115368, [27] [switch_simplify]: 6.413e-05 [loop_unroll]: 2.903e-05 [a_1]: 0.00058733 [with_stream_mark]: 2.603e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 0.0104004 [add_forward_monad_depend]: 1.028e-05 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.51e-05 [cse]: 4.524e-05 [replace_applicator]: 2.525e-05 [Cycle 2]: 0.00044853, [27] [switch_simplify]: 6.63e-06 [loop_unroll]: 5.31002e-06 [a_1]: 0.00010172 [with_stream_mark]: 1.727e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 6.27001e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.8e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.9e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 5.10001e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 4.23001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.109e-05 [j_node_and_user_rematch]: 9.03002e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 5.94e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.14999e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 1.074e-05 [cse]: 1.968e-05 [replace_applicator]: 6.68e-06 [py_interpret_to_execute_after_opt_a]: 1.81e-05 [rewriter_after_opt_a]: 4.443e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 5.99e-06 [mutable_eliminate]: 0.00082995 [jit_opt_b]: 5.5e-05, [1] [Cycle 1]: 4.648e-05, [2] [frontend_op_eliminate]: 1.668e-05 [inline_after_opt_a]: 1.848e-05 [cconv]: 3.604e-05 [loop_unroll]: 0.0004947 [jit_opt_after_cconv]: 0.00016901, [1] [Cycle 1]: 0.00016134, [11] [c_1]: 2.165e-05 [parameter_eliminate]: 4.01001e-06 [updatestate_depend_eliminate]: 8.75999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [cse]: 3.401e-05 [call_graph_tuple_transform]: 2.305e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.897e-05 [partial_unused_args_eliminate]: 1.96003e-06 [environ_conv]: 6.75998e-06 [add_recomputation]: 5.729e-05 [cse_after_recomputation]: 5.257e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.268e-05 [auto_monad_reorder]: 1.997e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 7.26999e-06 [opt_after_jit_grad]: 0.00054388 [symbol_engine_optimizer]: 7.755e-05, [1] [Cycle 1]: 6.91e-05, [6] [build]: 5.04e-06 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 9.24998e-06 [renormalize]: 5.19998e-07 [validate]: 4.766e-05 Sums bootstrap : 0.000410s : 0.77% type_inference : 0.038194s : 72.24% event_method : 0.000022s : 0.04% auto_monad : 0.000075s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000140s : 0.26% rewriter_before_opt_a : 0.000088s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000689s : 1.30% jit_opt_a.with_stream_mark : 0.000043s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.010401s : 19.67% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.07% jit_opt_a.cse : 0.000065s : 0.12% jit_opt_a.replace_applicator : 0.000032s : 0.06% py_interpret_to_execute_after_opt_a : 0.000018s : 0.03% rewriter_after_opt_a : 0.000044s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000830s : 1.57% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000036s : 0.07% loop_unroll : 0.000495s : 0.94% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000057s : 0.11% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000020s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000544s : 1.03% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.09% Time group info: ------[substitution.] 0.000258 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 3: substitution.graph_param_transform 84.23% : 0.000217s : 4: substitution.inline 1.75% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000006s : 4: substitution.remove_not_recompute_node 2.86% : 0.000007s : 2: substitution.replace_old_param 5.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038104 2 95.89% : 0.036537s : 1: type_inference.infer 4.11% : 0.001567s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.38% : 0.000052s : 4: replace.inline 30.62% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.67% : 0.000215s : 4: match.inline 5.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 2.59% : 0.000003s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.34% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.22% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.33% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 15: predicate.load_eliminater 1.82% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.16% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000002s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.74% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000916 13 44.93% : 0.000411s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.20% : 0.000451s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068642 72 0.09% : 0.000061s : 1: add_recomputation 0.12% : 0.000080s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.63% : 0.000433s : 1: bootstrap 0.06% : 0.000039s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000055s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 22.73% : 0.015603s : 1: jit_opt_a 0.25% : 0.000172s : 1: jit_opt_after_cconv 0.08% : 0.000058s : 1: jit_opt_b 0.73% : 0.000504s : 1: loop_unroll 1.23% : 0.000842s : 1: mutable_eliminate 1.37% : 0.000939s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.21% : 0.000146s : 1: py_interpret_to_execute 0.03% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 14.40% : 0.009887s : 1: renormalize.infer 0.73% : 0.000498s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000048s : 1: rewriter_after_opt_a 0.13% : 0.000092s : 1: rewriter_before_opt_a 0.12% : 0.000081s : 1: symbol_engine_optimizer 55.68% : 0.038221s : 1: type_inference TotalTime = 0.159037, [30] [bootstrap]: 0.00024296 [type_inference]: 0.129234 [event_method]: 0.00060018 [auto_monad]: 0.00012287 [graph_reusing]: 7.9e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.0001016 [rewriter_before_opt_a]: 0.00013369 [expand_dump_flag]: 3.62998e-06 [jit_opt_a]: 0.0263027, [3] [Cycle 1]: 0.0180968, [27] [switch_simplify]: 7.633e-05 [loop_unroll]: 4.565e-05 [a_1]: 0.00100921 [with_stream_mark]: 3.395e-05 [recompute_prepare]: 2.222e-05 [updatestate_depend_eliminate]: 9.24998e-06 [updatestate_assign_eliminate]: 7.88001e-06 [updatestate_loads_eliminate]: 6.97002e-06 [parameter_eliminate]: 2.56998e-06 [specialize_transform]: 1.593e-05 [updatestate_useless_node_eliminater]: 1.402e-05 [accelerated_algorithm]: 1.415e-05 [meta_shard_fg_expand]: 3.55e-06 [get_grad_eliminate_]: 1.402e-05 [merge_forward]: 8.99e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.949e-05 [j_node_and_user_rematch]: 2.482e-05 [meta_fg_expand]: 0.00185812 [replace_old_param]: 7.544e-05 [inline_without_move]: 6.175e-05 [renormalize]: 0.0140317 [add_forward_monad_depend]: 1.283e-05 [auto_monad_grad]: 6.44001e-06 [auto_monad_eliminator]: 6.573e-05 [cse]: 0.00029237 [replace_applicator]: 9.754e-05 [Cycle 2]: 0.00416165, [27] [switch_simplify]: 6.111e-05 [loop_unroll]: 4.614e-05 [a_1]: 0.00127031 [with_stream_mark]: 1.856e-05 [recompute_prepare]: 1.108e-05 [updatestate_depend_eliminate]: 6.14999e-06 [updatestate_assign_eliminate]: 4.97e-06 [updatestate_loads_eliminate]: 4.78001e-06 [parameter_eliminate]: 2.68998e-06 [specialize_transform]: 8.81002e-06 [updatestate_useless_node_eliminater]: 8.43001e-06 [accelerated_algorithm]: 8.93002e-06 [meta_shard_fg_expand]: 2.94001e-06 [get_grad_eliminate_]: 8.52998e-06 [merge_forward]: 5.87999e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.02e-05 [j_node_and_user_rematch]: 1.504e-05 [meta_fg_expand]: 0.000133 [replace_old_param]: 1.15e-05 [inline_without_move]: 9.14e-06 [renormalize]: 0.00222488 [add_forward_monad_depend]: 6.75002e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.351e-05 [cse]: 2.365e-05 [replace_applicator]: 1.415e-05 [Cycle 3]: 0.00025278, [27] [switch_simplify]: 5.34e-06 [loop_unroll]: 3.97002e-06 [a_1]: 4.316e-05 [with_stream_mark]: 9.19e-06 [recompute_prepare]: 3.81999e-06 [updatestate_depend_eliminate]: 2.30002e-06 [updatestate_assign_eliminate]: 1.93002e-06 [updatestate_loads_eliminate]: 1.56998e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 3.4e-06 [updatestate_useless_node_eliminater]: 3.18e-06 [accelerated_algorithm]: 3.41001e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 3.33998e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.094e-05 [j_node_and_user_rematch]: 6.21e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 3.51001e-06 [inline_without_move]: 3.00998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 3.61999e-06 [cse]: 7.85e-06 [replace_applicator]: 3.7e-06 [py_interpret_to_execute_after_opt_a]: 1.253e-05 [rewriter_after_opt_a]: 3.674e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.31002e-06 [mutable_eliminate]: 0.00070852 [jit_opt_b]: 4.239e-05, [1] [Cycle 1]: 3.467e-05, [2] [frontend_op_eliminate]: 1.105e-05 [inline_after_opt_a]: 1.217e-05 [cconv]: 2.494e-05 [loop_unroll]: 0.00041657 [jit_opt_after_cconv]: 0.0001275, [1] [Cycle 1]: 0.00012006, [11] [c_1]: 1.282e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.41002e-06 [updatestate_assign_eliminate]: 1.72999e-06 [updatestate_loads_eliminate]: 1.47001e-06 [cse]: 1.769e-05 [call_graph_tuple_transform]: 1.512e-05 [tuple_list_get_item_eliminator]: 3.58999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 3.64002e-06 [remove_dup_value]: 1.494e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 4.94e-06 [add_recomputation]: 3.521e-05 [cse_after_recomputation]: 2.012e-05, [1] [Cycle 1]: 1.462e-05, [1] [cse]: 8.13999e-06 [auto_monad_reorder]: 1.36e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 5.46002e-06 [opt_after_jit_grad]: 0.00044159 [symbol_engine_optimizer]: 7.022e-05, [1] [Cycle 1]: 6.406e-05, [6] [build]: 3.61001e-06 [elim_shapecalc]: 6.34001e-06 [elim_not_effective]: 1.059e-05 [opt_reshape]: 4.44998e-06 [fold_const_symbol]: 6.88e-06 [renormalize]: 3.10014e-07 [validate]: 3.319e-05 Sums bootstrap : 0.000243s : 0.16% type_inference : 0.129234s : 83.77% event_method : 0.000600s : 0.39% auto_monad : 0.000123s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000102s : 0.07% rewriter_before_opt_a : 0.000134s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000143s : 0.09% jit_opt_a.loop_unroll : 0.000096s : 0.06% jit_opt_a.a_1 : 0.002323s : 1.51% jit_opt_a.with_stream_mark : 0.000062s : 0.04% jit_opt_a.recompute_prepare : 0.000037s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.03% jit_opt_a.meta_fg_expand : 0.001993s : 1.29% jit_opt_a.replace_old_param : 0.000090s : 0.06% jit_opt_a.inline_without_move : 0.000074s : 0.05% jit_opt_a.renormalize : 0.016257s : 10.54% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.05% jit_opt_a.cse : 0.000324s : 0.21% jit_opt_a.replace_applicator : 0.000115s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000709s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000417s : 0.27% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000035s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000442s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.02% Time group info: ------[substitution.] 0.000632 107 0.22% : 0.000001s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.68% : 0.000004s : 1: substitution.graph_param_transform 66.88% : 0.000423s : 13: substitution.inline 2.80% : 0.000018s : 2: substitution.inline_without_move 1.61% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.83% : 0.000012s : 7: substitution.minmaximum_grad 1.13% : 0.000007s : 5: substitution.partial_eliminate 1.89% : 0.000012s : 13: substitution.remove_not_recompute_node 5.48% : 0.000035s : 10: substitution.replace_applicator 1.13% : 0.000007s : 10: substitution.replace_old_param 1.20% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.98% : 0.000006s : 1: substitution.tile_eliminate 3.71% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.61% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.26% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129114 2 96.80% : 0.124986s : 1: type_inference.infer 3.20% : 0.004129s : 1: type_inference.specialize ------[replace.] 0.000194 20 66.34% : 0.000129s : 13: replace.inline 33.66% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000438 20 94.65% : 0.000414s : 13: match.inline 5.35% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000389 2656 1.58% : 0.000006s : 46: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.46% : 0.000006s : 46: predicate.addn_check_dump 1.62% : 0.000006s : 46: predicate.addn_zero_filter 2.13% : 0.000008s : 46: predicate.arithmetic_simplify 1.73% : 0.000007s : 46: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.61% : 0.000006s : 46: predicate.compare_switch_simplify 1.54% : 0.000006s : 46: predicate.depend_value_elim 1.47% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.47% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.15% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.43% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 46: predicate.environ_get_depend_swap 1.46% : 0.000006s : 46: predicate.environ_get_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.79% : 0.000003s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.31% : 0.000017s : 68: predicate.inline 2.05% : 0.000008s : 47: predicate.inline_without_move 0.35% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.02% : 0.000004s : 19: predicate.less_batch_normalization 1.89% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.93% : 0.000008s : 54: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.54% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.78% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 46: predicate.merge_addn 1.52% : 0.000006s : 46: predicate.minmaximum_grad 0.45% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.30% : 0.000009s : 54: predicate.partial_eliminate 1.53% : 0.000006s : 46: predicate.print_const_string_wrapper 2.09% : 0.000008s : 46: predicate.reduce_eliminate 1.77% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 19: predicate.remove_not_recompute_node 2.88% : 0.000011s : 100: predicate.replace_applicator 1.10% : 0.000004s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 46: predicate.reshape_eliminate 1.55% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.46% : 0.000006s : 46: predicate.same_eliminate 0.49% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 19: predicate.specialize_transform 1.73% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.76% : 0.000011s : 66: predicate.switch_defer_inline 2.41% : 0.000009s : 66: predicate.switch_layer_defer_inline 6.65% : 0.000026s : 161: predicate.switch_simplify 1.60% : 0.000006s : 46: predicate.tile_eliminate 1.52% : 0.000006s : 46: predicate.transpose_eliminate 1.89% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.90% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.73% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.77% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 2.04% : 0.000008s : 46: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004006 45 74.41% : 0.002981s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.59% : 0.001025s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178325 87 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000131s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.15% : 0.000266s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.34% : 0.000612s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.75% : 0.026307s : 1: jit_opt_a 0.07% : 0.000130s : 1: jit_opt_after_cconv 0.03% : 0.000045s : 1: jit_opt_b 0.24% : 0.000425s : 1: loop_unroll 0.40% : 0.000716s : 1: mutable_eliminate 1.70% : 0.003040s : 39: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000450s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000105s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.73% : 0.013783s : 2: renormalize.infer 1.38% : 0.002453s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000138s : 1: rewriter_before_opt_a 0.07% : 0.000122s : 1: symbol_engine_optimizer 72.49% : 0.129259s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.334.276 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.334.916 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.231612, [30] [bootstrap]: 0.00038016 [type_inference]: 0.219608 [event_method]: 0.00041486 [auto_monad]: 0.00013321 [graph_reusing]: 7.88001e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 4.549e-05 [rewriter_before_opt_a]: 0.00017105 [expand_dump_flag]: 3.15998e-06 [jit_opt_a]: 0.00836987, [2] [Cycle 1]: 0.00459481, [27] [switch_simplify]: 0.00018458 [loop_unroll]: 6.801e-05 [a_1]: 0.00216113 [with_stream_mark]: 1.957e-05 [recompute_prepare]: 9.47999e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.297e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00181297 [add_forward_monad_depend]: 6.94999e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.604e-05 [cse]: 2.854e-05 [replace_applicator]: 1.463e-05 [Cycle 2]: 0.00032367, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.473e-05 [with_stream_mark]: 1.209e-05 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.06002e-06 [updatestate_useless_node_eliminater]: 4.62e-06 [accelerated_algorithm]: 4.82e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.58999e-06 [inline_without_move]: 4.58999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 4.97999e-06 [cse]: 9.52001e-06 [replace_applicator]: 4.87e-06 [py_interpret_to_execute_after_opt_a]: 1.176e-05 [rewriter_after_opt_a]: 3.678e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00073194 [jit_opt_b]: 5.272e-05, [1] [Cycle 1]: 4.407e-05, [2] [frontend_op_eliminate]: 1.635e-05 [inline_after_opt_a]: 1.594e-05 [cconv]: 2.712e-05 [loop_unroll]: 0.00043958 [jit_opt_after_cconv]: 0.00014333, [1] [Cycle 1]: 0.00013738, [11] [c_1]: 2.1e-05 [parameter_eliminate]: 3.26001e-06 [updatestate_depend_eliminate]: 6.76e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.158e-05 [call_graph_tuple_transform]: 1.883e-05 [tuple_list_get_item_eliminator]: 5.12e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.09e-06 [remove_dup_value]: 1.48e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 5.66003e-06 [add_recomputation]: 4.983e-05 [cse_after_recomputation]: 2.081e-05, [1] [Cycle 1]: 1.579e-05, [1] [cse]: 9.93998e-06 [auto_monad_reorder]: 1.514e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.43002e-06 [opt_after_jit_grad]: 0.00047149 [symbol_engine_optimizer]: 9.195e-05, [1] [Cycle 1]: 8.552e-05, [6] [build]: 3.33998e-06 [elim_shapecalc]: 7.94002e-06 [elim_not_effective]: 1.231e-05 [opt_reshape]: 2.424e-05 [fold_const_symbol]: 9.34e-06 [renormalize]: 5.89993e-07 [validate]: 3.706e-05 Sums bootstrap : 0.000380s : 0.17% type_inference : 0.219608s : 96.56% event_method : 0.000415s : 0.18% auto_monad : 0.000133s : 0.06% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000045s : 0.02% rewriter_before_opt_a : 0.000171s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000190s : 0.08% jit_opt_a.loop_unroll : 0.000073s : 0.03% jit_opt_a.a_1 : 0.002256s : 0.99% jit_opt_a.with_stream_mark : 0.000032s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000009s : 0.00% jit_opt_a.accelerated_algorithm : 0.000010s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.00% jit_opt_a.renormalize : 0.001813s : 0.80% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000038s : 0.02% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000732s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000440s : 0.19% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000471s : 0.21% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000024s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.02% Time group info: ------[substitution.] 0.001106 56 0.18% : 0.000002s : 2: substitution.elim_not_effective 0.13% : 0.000001s : 2: substitution.fold_const_symbol 0.56% : 0.000006s : 3: substitution.graph_param_transform 60.56% : 0.000670s : 15: substitution.inline 0.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.58% : 0.000006s : 4: substitution.minmaximum_grad 0.44% : 0.000005s : 4: substitution.remove_not_recompute_node 0.49% : 0.000005s : 2: substitution.replace_old_param 1.34% : 0.000015s : 4: substitution.switch_simplify 1.21% : 0.000013s : 4: substitution.tuple_list_convert_item_index_to_positive 0.92% : 0.000010s : 4: substitution.tuple_list_get_item_depend_reorder 33.32% : 0.000368s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.219511 2 70.69% : 0.155163s : 1: type_inference.infer 29.31% : 0.064348s : 1: type_inference.specialize ------[replace.] 0.000413 23 53.06% : 0.000219s : 15: replace.inline 12.72% : 0.000052s : 4: replace.switch_simplify 34.22% : 0.000141s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000985 23 67.19% : 0.000662s : 15: match.inline 1.24% : 0.000012s : 4: match.switch_simplify 31.57% : 0.000311s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000218 1341 1.41% : 0.000003s : 21: predicate.accumulaten_eliminater 0.68% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000003s : 21: predicate.addn_check_dump 1.44% : 0.000003s : 21: predicate.addn_zero_filter 2.20% : 0.000005s : 21: predicate.arithmetic_simplify 1.41% : 0.000003s : 21: predicate.cast_eliminate 0.24% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000003s : 21: predicate.compare_switch_simplify 1.45% : 0.000003s : 21: predicate.depend_value_elim 1.30% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.58% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.49% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.20% : 0.000000s : 3: predicate.elim_not_effective 0.35% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.33% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.31% : 0.000003s : 21: predicate.environ_get_depend_swap 1.31% : 0.000003s : 21: predicate.environ_get_eliminate 1.23% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.54% : 0.000001s : 6: predicate.get_grad_eliminate 0.13% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000012s : 46: predicate.inline 0.51% : 0.000001s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.56% : 0.000001s : 6: predicate.less_batch_normalization 1.78% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 1.75% : 0.000004s : 28: predicate.load_eliminater 0.66% : 0.000001s : 3: predicate.loop_unroll_after_grad 5.40% : 0.000012s : 78: predicate.loop_unroll_before_grad 1.92% : 0.000004s : 24: predicate.make_slice_get_slice_eliminator 1.21% : 0.000003s : 21: predicate.merge_addn 1.30% : 0.000003s : 21: predicate.minmaximum_grad 0.92% : 0.000002s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000005s : 28: predicate.partial_eliminate 1.28% : 0.000003s : 21: predicate.print_const_string_wrapper 2.11% : 0.000005s : 21: predicate.reduce_eliminate 1.68% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000003s : 31: predicate.replace_applicator 0.30% : 0.000001s : 6: predicate.replace_old_param 0.18% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000003s : 21: predicate.reshape_eliminate 1.41% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000003s : 21: predicate.same_eliminate 0.33% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.54% : 0.000001s : 6: predicate.special_op_eliminate 0.52% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000004s : 21: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.23% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.52% : 0.000008s : 40: predicate.switch_defer_inline 2.86% : 0.000006s : 40: predicate.switch_layer_defer_inline 9.27% : 0.000020s : 129: predicate.switch_simplify 1.44% : 0.000003s : 21: predicate.tile_eliminate 1.35% : 0.000003s : 21: predicate.transpose_eliminate 1.75% : 0.000004s : 21: predicate.tuple_list_convert_item_index_to_positive 1.60% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000007s : 31: predicate.tuple_list_get_item_eliminator 1.74% : 0.000004s : 21: predicate.tuple_list_set_item_eliminator 1.61% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.76% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.36% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.77% : 0.000004s : 21: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003833 38 59.73% : 0.002289s : 15: func_graph_cloner_run.FuncGraphClonerGraph 10.15% : 0.000389s : 6: func_graph_cloner_run.FuncGraphClonerNode 30.12% : 0.001154s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.236014 72 0.02% : 0.000053s : 1: add_recomputation 0.06% : 0.000141s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.17% : 0.000404s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.18% : 0.000422s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 3.55% : 0.008373s : 1: jit_opt_a 0.06% : 0.000146s : 1: jit_opt_after_cconv 0.02% : 0.000056s : 1: jit_opt_b 0.19% : 0.000448s : 1: loop_unroll 0.31% : 0.000741s : 1: mutable_eliminate 1.12% : 0.002637s : 26: opt.transform.jit_opt_a 0.02% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000026s : 4: opt.transform.jit_opt_b 0.00% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000479s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000048s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.51% : 0.001199s : 1: renormalize.infer 0.26% : 0.000604s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000175s : 1: rewriter_before_opt_a 0.04% : 0.000094s : 1: symbol_engine_optimizer 93.05% : 0.219622s : 1: type_inference TotalTime = 0.277907, [30] [bootstrap]: 0.00032801 [type_inference]: 0.240737 [event_method]: 2.07e-05 [auto_monad]: 6.85e-05 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00044959 [rewriter_before_opt_a]: 8.472e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.0337505, [2] [Cycle 1]: 0.0296777, [27] [switch_simplify]: 6.067e-05 [loop_unroll]: 2.997e-05 [a_1]: 0.00061775 [with_stream_mark]: 2.102e-05 [recompute_prepare]: 8.44998e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.79999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.66999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 6.10002e-06 [renormalize]: 0.0285514 [add_forward_monad_depend]: 1.027e-05 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 1.949e-05 [cse]: 4.436e-05 [replace_applicator]: 2.495e-05 [Cycle 2]: 0.00043974, [27] [switch_simplify]: 7.76001e-06 [loop_unroll]: 6.79999e-06 [a_1]: 0.00013162 [with_stream_mark]: 1.516e-05 [recompute_prepare]: 6.34001e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 4.00998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.948e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.51998e-06 [inline_without_move]: 5.51e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.36998e-06 [auto_monad_grad]: 8.40024e-07 [auto_monad_eliminator]: 7.55e-06 [cse]: 1.415e-05 [replace_applicator]: 7.3e-06 [py_interpret_to_execute_after_opt_a]: 1.566e-05 [rewriter_after_opt_a]: 4.12e-05 [convert_after_rewriter]: 8.42998e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00076633 [jit_opt_b]: 5.72e-05, [1] [Cycle 1]: 4.976e-05, [2] [frontend_op_eliminate]: 1.99e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.817e-05 [loop_unroll]: 0.00043273 [jit_opt_after_cconv]: 0.00015277, [1] [Cycle 1]: 0.00014637, [11] [c_1]: 2.653e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 3.06999e-06 [cse]: 1.971e-05 [call_graph_tuple_transform]: 2.163e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.51e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.41002e-06 [add_recomputation]: 5.032e-05 [cse_after_recomputation]: 2.23e-05, [1] [Cycle 1]: 1.737e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.559e-05 [get_jit_bprop_graph]: 3.7e-06 [rewriter_after_jit_bprop_graph]: 4.64002e-06 [opt_after_jit_grad]: 0.00044238 [symbol_engine_optimizer]: 0.00015224, [1] [Cycle 1]: 0.00014566, [6] [build]: 3.31999e-06 [elim_shapecalc]: 8.82e-06 [elim_not_effective]: 8.829e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 1.016e-05 [renormalize]: 4.30009e-07 [validate]: 4.273e-05 Sums bootstrap : 0.000328s : 0.12% type_inference : 0.240737s : 87.98% event_method : 0.000021s : 0.01% auto_monad : 0.000068s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000450s : 0.16% rewriter_before_opt_a : 0.000085s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000749s : 0.27% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.028551s : 10.43% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000059s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000766s : 0.28% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000433s : 0.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000442s : 0.16% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000088s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.02% Time group info: ------[substitution.] 0.000325 24 23.24% : 0.000076s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.03% : 0.000007s : 4: substitution.graph_param_transform 65.31% : 0.000213s : 4: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000006s : 4: substitution.remove_not_recompute_node 2.13% : 0.000007s : 2: substitution.replace_old_param 3.78% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.240656 2 98.85% : 0.237897s : 1: type_inference.infer 1.15% : 0.002759s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.83% : 0.000051s : 4: replace.inline 32.17% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.94% : 0.000210s : 4: match.inline 5.06% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.57% : 0.000002s : 12: predicate.addn_zero_filter 2.37% : 0.000003s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.09% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.36% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.86% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.71% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.86% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.45% : 0.000002s : 8: predicate.remove_not_recompute_node 2.40% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.16% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 1.87% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.85% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.92% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002591 22 65.19% : 0.001689s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.68% : 0.000847s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.307601 72 0.02% : 0.000053s : 1: add_recomputation 0.02% : 0.000071s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.11% : 0.000345s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 10.97% : 0.033755s : 1: jit_opt_a 0.05% : 0.000155s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.14% : 0.000441s : 1: loop_unroll 0.25% : 0.000775s : 1: mutable_eliminate 0.33% : 0.001004s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000111s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000450s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 8.97% : 0.027587s : 1: renormalize.infer 0.31% : 0.000951s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000044s : 1: rewriter_after_opt_a 0.03% : 0.000090s : 1: rewriter_before_opt_a 0.05% : 0.000155s : 1: symbol_engine_optimizer 78.27% : 0.240757s : 1: type_inference TotalTime = 0.0615256, [30] [bootstrap]: 0.00027243 [type_inference]: 0.0531717 [event_method]: 2.149e-05 [auto_monad]: 7.053e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.884e-05 [rewriter_before_opt_a]: 8.384e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00577533, [2] [Cycle 1]: 0.00199752, [27] [switch_simplify]: 6.206e-05 [loop_unroll]: 3.343e-05 [a_1]: 0.00065544 [with_stream_mark]: 2.199e-05 [recompute_prepare]: 7.57998e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 2.21998e-06 [specialize_transform]: 6.21998e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.86e-06 [renormalize]: 0.00087034 [add_forward_monad_depend]: 5.22999e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.626e-05 [cse]: 4.286e-05 [replace_applicator]: 1.295e-05 [Cycle 2]: 0.00033009, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.09e-06 [a_1]: 8.952e-05 [with_stream_mark]: 9.64e-06 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.01002e-06 [merge_forward]: 2.80002e-06 [cell_reuse_recompute_pass]: 1.56002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.374e-05 [j_node_and_user_rematch]: 8.43999e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 5.56e-06 [cse]: 1.582e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.218e-05 [rewriter_after_opt_a]: 3.809e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00052509 [jit_opt_b]: 5.064e-05, [1] [Cycle 1]: 4.376e-05, [2] [frontend_op_eliminate]: 1.618e-05 [inline_after_opt_a]: 1.547e-05 [cconv]: 2.487e-05 [loop_unroll]: 0.00039832 [jit_opt_after_cconv]: 0.00014353, [1] [Cycle 1]: 0.00013726, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.337e-05 [call_graph_tuple_transform]: 1.863e-05 [tuple_list_get_item_eliminator]: 5.49998e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 3.261e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 5.82999e-06 [add_recomputation]: 4.923e-05 [cse_after_recomputation]: 3.277e-05, [1] [Cycle 1]: 2.734e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.00044737 [symbol_engine_optimizer]: 7.251e-05, [1] [Cycle 1]: 6.622e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 7.80998e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 5.76998e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 4.00003e-07 [validate]: 3.705e-05 Sums bootstrap : 0.000272s : 0.47% type_inference : 0.053172s : 92.48% event_method : 0.000021s : 0.04% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000049s : 0.08% rewriter_before_opt_a : 0.000084s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.12% jit_opt_a.loop_unroll : 0.000039s : 0.07% jit_opt_a.a_1 : 0.000745s : 1.30% jit_opt_a.with_stream_mark : 0.000032s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000870s : 1.51% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000059s : 0.10% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000525s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000398s : 0.69% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000033s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000447s : 0.78% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.06% Time group info: ------[substitution.] 0.000266 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000005s : 3: substitution.graph_param_transform 87.00% : 0.000232s : 5: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 4.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053104 2 98.06% : 0.052072s : 1: type_inference.infer 1.94% : 0.001032s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.18% : 0.000064s : 5: replace.inline 31.82% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 95.09% : 0.000229s : 5: match.inline 4.91% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.45% : 0.000002s : 11: predicate.addn_zero_filter 1.84% : 0.000002s : 11: predicate.arithmetic_simplify 1.17% : 0.000001s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.20% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000001s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 16: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 1.64% : 0.000002s : 11: predicate.reduce_eliminate 1.54% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.40% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.04% : 0.000010s : 59: predicate.switch_simplify 1.21% : 0.000001s : 11: predicate.tile_eliminate 1.20% : 0.000001s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 11: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000918 16 50.41% : 0.000463s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.84% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.75% : 0.000374s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063425 72 0.08% : 0.000052s : 1: add_recomputation 0.12% : 0.000074s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.45% : 0.000284s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000035s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.11% : 0.005778s : 1: jit_opt_a 0.23% : 0.000146s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.64% : 0.000405s : 1: loop_unroll 0.84% : 0.000533s : 1: mutable_eliminate 1.53% : 0.000972s : 26: opt.transform.jit_opt_a 0.07% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000052s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000035s : 1: remove_dup_value 0.76% : 0.000480s : 1: renormalize.infer 0.60% : 0.000383s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.14% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 83.86% : 0.053188s : 1: type_inference TotalTime = 0.156045, [30] [bootstrap]: 0.00025456 [type_inference]: 0.124477 [event_method]: 0.0007107 [auto_monad]: 0.00012413 [graph_reusing]: 8.05999e-06 [pre_auto_parallel]: 3.34001e-06 [py_interpret_to_execute]: 0.00012072 [rewriter_before_opt_a]: 0.00014247 [expand_dump_flag]: 4.32998e-06 [jit_opt_a]: 0.0275357, [3] [Cycle 1]: 0.0188976, [27] [switch_simplify]: 8.517e-05 [loop_unroll]: 5.355e-05 [a_1]: 0.00111633 [with_stream_mark]: 4.068e-05 [recompute_prepare]: 2.567e-05 [updatestate_depend_eliminate]: 1.073e-05 [updatestate_assign_eliminate]: 7.87e-06 [updatestate_loads_eliminate]: 7.82e-06 [parameter_eliminate]: 3.63999e-06 [specialize_transform]: 1.625e-05 [updatestate_useless_node_eliminater]: 1.564e-05 [accelerated_algorithm]: 1.616e-05 [meta_shard_fg_expand]: 5.42001e-06 [get_grad_eliminate_]: 1.593e-05 [merge_forward]: 1.053e-05 [cell_reuse_recompute_pass]: 1.56002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.083e-05 [j_node_and_user_rematch]: 2.932e-05 [meta_fg_expand]: 0.00241798 [replace_old_param]: 8.143e-05 [inline_without_move]: 0.00014252 [renormalize]: 0.0139902 [add_forward_monad_depend]: 1.343e-05 [auto_monad_grad]: 7.03e-06 [auto_monad_eliminator]: 6.446e-05 [cse]: 0.00028534 [replace_applicator]: 9.349e-05 [Cycle 2]: 0.00430948, [27] [switch_simplify]: 4.359e-05 [loop_unroll]: 4.229e-05 [a_1]: 0.0011959 [with_stream_mark]: 1.839e-05 [recompute_prepare]: 1.041e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 4.23999e-06 [updatestate_loads_eliminate]: 4.42e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 7.83001e-06 [updatestate_useless_node_eliminater]: 7.29001e-06 [accelerated_algorithm]: 7.9e-06 [meta_shard_fg_expand]: 3.08e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.60999e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.806e-05 [j_node_and_user_rematch]: 1.348e-05 [meta_fg_expand]: 0.00014238 [replace_old_param]: 1.098e-05 [inline_without_move]: 7.2e-06 [renormalize]: 0.0024483 [add_forward_monad_depend]: 1.042e-05 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.751e-05 [cse]: 2.988e-05 [replace_applicator]: 1.886e-05 [Cycle 3]: 0.0002929, [27] [switch_simplify]: 5.02999e-06 [loop_unroll]: 4.12e-06 [a_1]: 5.465e-05 [with_stream_mark]: 1.432e-05 [recompute_prepare]: 3.7e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 1.82999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 4.07998e-06 [updatestate_useless_node_eliminater]: 3.27002e-06 [accelerated_algorithm]: 4.27e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 3.51999e-06 [merge_forward]: 3.39001e-06 [cell_reuse_recompute_pass]: 2.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 7.77998e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 3.55e-06 [inline_without_move]: 3.11999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.36998e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 4.15e-06 [cse]: 9.49e-06 [replace_applicator]: 3.66999e-06 [py_interpret_to_execute_after_opt_a]: 1.533e-05 [rewriter_after_opt_a]: 3.819e-05 [convert_after_rewriter]: 5.92001e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00079972 [jit_opt_b]: 4.774e-05, [1] [Cycle 1]: 3.944e-05, [2] [frontend_op_eliminate]: 1.293e-05 [inline_after_opt_a]: 1.314e-05 [cconv]: 3.22e-05 [loop_unroll]: 0.00050856 [jit_opt_after_cconv]: 0.00016959, [1] [Cycle 1]: 0.00016161, [11] [c_1]: 1.472e-05 [parameter_eliminate]: 4.80001e-06 [updatestate_depend_eliminate]: 7.94002e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 4.20999e-06 [cse]: 3.103e-05 [call_graph_tuple_transform]: 2.183e-05 [tuple_list_get_item_eliminator]: 7.56999e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 8.60018e-07 [switch_simplify]: 4.72e-06 [remove_dup_value]: 1.495e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 5.90002e-06 [add_recomputation]: 4.472e-05 [cse_after_recomputation]: 2.475e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.027e-05 [auto_monad_reorder]: 1.453e-05 [get_jit_bprop_graph]: 3.31001e-06 [rewriter_after_jit_bprop_graph]: 7.84002e-06 [opt_after_jit_grad]: 0.00051355 [symbol_engine_optimizer]: 0.00012833, [1] [Cycle 1]: 0.00012081, [6] [build]: 4.32998e-06 [elim_shapecalc]: 5.525e-05 [elim_not_effective]: 1.317e-05 [opt_reshape]: 5.22e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 3.99974e-07 [validate]: 4.285e-05 Sums bootstrap : 0.000255s : 0.17% type_inference : 0.124477s : 82.45% event_method : 0.000711s : 0.47% auto_monad : 0.000124s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000121s : 0.08% rewriter_before_opt_a : 0.000142s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000134s : 0.09% jit_opt_a.loop_unroll : 0.000100s : 0.07% jit_opt_a.a_1 : 0.002367s : 1.57% jit_opt_a.with_stream_mark : 0.000073s : 0.05% jit_opt_a.recompute_prepare : 0.000040s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000051s : 0.03% jit_opt_a.meta_fg_expand : 0.002563s : 1.70% jit_opt_a.replace_old_param : 0.000096s : 0.06% jit_opt_a.inline_without_move : 0.000153s : 0.10% jit_opt_a.renormalize : 0.016439s : 10.89% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000086s : 0.06% jit_opt_a.cse : 0.000325s : 0.22% jit_opt_a.replace_applicator : 0.000116s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000800s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000509s : 0.34% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000045s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000514s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000055s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000655 104 0.37% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.82% : 0.000005s : 1: substitution.graph_param_transform 66.36% : 0.000434s : 13: substitution.inline 3.58% : 0.000023s : 2: substitution.inline_without_move 2.02% : 0.000013s : 12: substitution.j_node_and_user_rematch 1.95% : 0.000013s : 7: substitution.minmaximum_grad 1.19% : 0.000008s : 5: substitution.partial_eliminate 1.85% : 0.000012s : 12: substitution.remove_not_recompute_node 4.95% : 0.000032s : 10: substitution.replace_applicator 1.72% : 0.000011s : 10: substitution.replace_old_param 0.70% : 0.000005s : 1: substitution.set_cell_output_no_recompute 1.00% : 0.000007s : 1: substitution.tile_eliminate 3.87% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.38% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.03% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124345 2 96.50% : 0.119988s : 1: type_inference.infer 3.50% : 0.004357s : 1: type_inference.specialize ------[replace.] 0.000194 20 66.80% : 0.000130s : 13: replace.inline 33.20% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000449 20 94.82% : 0.000426s : 13: match.inline 5.18% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000400 2544 1.50% : 0.000006s : 44: predicate.accumulaten_eliminater 0.34% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.36% : 0.000005s : 44: predicate.addn_check_dump 1.60% : 0.000006s : 44: predicate.addn_zero_filter 2.07% : 0.000008s : 44: predicate.arithmetic_simplify 1.52% : 0.000006s : 44: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000006s : 44: predicate.compare_switch_simplify 1.43% : 0.000006s : 44: predicate.depend_value_elim 1.37% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.69% : 0.000007s : 44: predicate.dict_get_item_eliminator 1.37% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.30% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.19% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.35% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.31% : 0.000005s : 44: predicate.environ_get_depend_swap 1.62% : 0.000007s : 44: predicate.environ_get_eliminate 1.56% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.94% : 0.000004s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.31% : 0.000017s : 66: predicate.inline 2.25% : 0.000009s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.22% : 0.000005s : 17: predicate.less_batch_normalization 1.70% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.74% : 0.000007s : 52: predicate.load_eliminater 0.68% : 0.000003s : 1: predicate.loop_unroll_after_grad 3.47% : 0.000014s : 92: predicate.loop_unroll_before_grad 1.63% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.36% : 0.000005s : 44: predicate.merge_addn 1.58% : 0.000006s : 44: predicate.minmaximum_grad 0.65% : 0.000003s : 1: predicate.mutable_eliminate 0.17% : 0.000001s : 1: predicate.opt_reshape 2.30% : 0.000009s : 52: predicate.partial_eliminate 1.56% : 0.000006s : 44: predicate.print_const_string_wrapper 2.03% : 0.000008s : 44: predicate.reduce_eliminate 1.79% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000002s : 17: predicate.remove_not_recompute_node 2.64% : 0.000011s : 96: predicate.replace_applicator 1.18% : 0.000005s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000006s : 44: predicate.reshape_eliminate 1.47% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.30% : 0.000001s : 1: predicate.row_tensor_eliminate 1.53% : 0.000006s : 44: predicate.same_eliminate 0.43% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.41% : 0.000002s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 17: predicate.specialize_transform 1.79% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.73% : 0.000011s : 64: predicate.switch_defer_inline 2.32% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.50% : 0.000026s : 157: predicate.switch_simplify 1.69% : 0.000007s : 44: predicate.tile_eliminate 1.54% : 0.000006s : 44: predicate.transpose_eliminate 1.98% : 0.000008s : 44: predicate.tuple_list_convert_item_index_to_positive 2.09% : 0.000008s : 44: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.94% : 0.000008s : 44: predicate.tuple_list_set_item_eliminator 1.70% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.70% : 0.000011s : 69: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004401 45 70.14% : 0.003087s : 28: func_graph_cloner_run.FuncGraphClonerGraph 29.86% : 0.001314s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.175667 87 0.03% : 0.000049s : 1: add_recomputation 0.08% : 0.000134s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.16% : 0.000280s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.41% : 0.000724s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.68% : 0.027540s : 1: jit_opt_a 0.10% : 0.000174s : 1: jit_opt_after_cconv 0.03% : 0.000051s : 1: jit_opt_b 0.30% : 0.000519s : 1: loop_unroll 0.46% : 0.000812s : 1: mutable_eliminate 1.80% : 0.003170s : 39: opt.transform.jit_opt_a 0.03% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000126s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.68% : 0.013496s : 2: renormalize.infer 1.66% : 0.002918s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000147s : 1: rewriter_before_opt_a 0.07% : 0.000131s : 1: symbol_engine_optimizer 70.88% : 0.124506s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.516.081 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dd30> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.516.841 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.020492, [30] [bootstrap]: 0.00037143 [type_inference]: 0.00968155 [event_method]: 2.081e-05 [auto_monad]: 7.014e-05 [graph_reusing]: 6.60002e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 6.316e-05 [rewriter_before_opt_a]: 7.971e-05 [expand_dump_flag]: 2.78e-06 [jit_opt_a]: 0.00750582, [2] [Cycle 1]: 0.00241116, [27] [switch_simplify]: 7.11e-05 [loop_unroll]: 3.093e-05 [a_1]: 0.00061655 [with_stream_mark]: 2.148e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.71e-06 [renormalize]: 0.00130733 [add_forward_monad_depend]: 6.88e-06 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.59e-05 [cse]: 3.474e-05 [replace_applicator]: 1.654e-05 [Cycle 2]: 0.00034223, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 5.45001e-06 [a_1]: 9.853e-05 [with_stream_mark]: 1.139e-05 [recompute_prepare]: 5.65001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 8.1e-06 [inline_without_move]: 4.74998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 8.52e-06 [cse]: 1.386e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.477e-05 [rewriter_after_opt_a]: 4.16e-05 [convert_after_rewriter]: 6.93998e-06 [order_py_execute_after_rewriter]: 5.42999e-06 [mutable_eliminate]: 0.0008109 [jit_opt_b]: 5.737e-05, [1] [Cycle 1]: 4.953e-05, [2] [frontend_op_eliminate]: 1.923e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 2.696e-05 [loop_unroll]: 0.00046189 [jit_opt_after_cconv]: 0.00015622, [1] [Cycle 1]: 0.00014993, [11] [c_1]: 2.337e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.741e-05 [call_graph_tuple_transform]: 2.215e-05 [tuple_list_get_item_eliminator]: 5.74999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.776e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 9.69999e-06 [add_recomputation]: 7.579e-05 [cse_after_recomputation]: 2.828e-05, [1] [Cycle 1]: 2.093e-05, [1] [cse]: 1.394e-05 [auto_monad_reorder]: 1.923e-05 [get_jit_bprop_graph]: 2.48998e-06 [rewriter_after_jit_bprop_graph]: 7.45e-06 [opt_after_jit_grad]: 0.00050226 [symbol_engine_optimizer]: 0.00019177, [1] [Cycle 1]: 0.00018421, [6] [build]: 1.207e-05 [elim_shapecalc]: 9.57001e-06 [elim_not_effective]: 1.335e-05 [opt_reshape]: 4.898e-05 [fold_const_symbol]: 1.264e-05 [renormalize]: 4.19997e-07 [validate]: 5.286e-05 Sums bootstrap : 0.000371s : 2.47% type_inference : 0.009682s : 64.30% event_method : 0.000021s : 0.14% auto_monad : 0.000070s : 0.47% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000063s : 0.42% rewriter_before_opt_a : 0.000080s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.51% jit_opt_a.loop_unroll : 0.000036s : 0.24% jit_opt_a.a_1 : 0.000715s : 4.75% jit_opt_a.with_stream_mark : 0.000033s : 0.22% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000006s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.001307s : 8.68% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000049s : 0.32% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000042s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000811s : 5.39% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000027s : 0.18% loop_unroll : 0.000462s : 3.07% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.06% add_recomputation : 0.000076s : 0.50% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000502s : 3.34% symbol_engine_optimizer.build : 0.000012s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000049s : 0.33% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.35% Time group info: ------[substitution.] 0.000257 23 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 3: substitution.graph_param_transform 85.19% : 0.000219s : 4: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000006s : 2: substitution.replace_old_param 5.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009592 2 84.06% : 0.008063s : 1: type_inference.infer 15.94% : 0.001529s : 1: type_inference.specialize ------[replace.] 0.000090 6 69.38% : 0.000062s : 4: replace.inline 30.62% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.62% : 0.000216s : 4: match.inline 5.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.18% : 0.000007s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 2.23% : 0.000003s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.58% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.55% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.53% : 0.000002s : 10: predicate.transpose_eliminate 1.67% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002038 13 71.43% : 0.001455s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.79% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.79% : 0.000546s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022848 72 0.34% : 0.000079s : 1: add_recomputation 0.32% : 0.000074s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.72% : 0.000393s : 1: bootstrap 0.13% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000030s : 1: cse_after_recomputation 0.05% : 0.000012s : 1: environ_conv 0.11% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.87% : 0.007510s : 1: jit_opt_a 0.69% : 0.000159s : 1: jit_opt_after_cconv 0.26% : 0.000060s : 1: jit_opt_b 2.06% : 0.000470s : 1: loop_unroll 3.59% : 0.000820s : 1: mutable_eliminate 4.19% : 0.000957s : 26: opt.transform.jit_opt_a 0.23% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000030s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.36% : 0.000081s : 4: opt.transform.symbol_engine_opt 2.24% : 0.000511s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000066s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000020s : 1: remove_dup_value 3.26% : 0.000745s : 1: renormalize.infer 2.42% : 0.000554s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000045s : 1: rewriter_after_opt_a 0.36% : 0.000083s : 1: rewriter_before_opt_a 0.85% : 0.000195s : 1: symbol_engine_optimizer 42.45% : 0.009700s : 1: type_inference TotalTime = 0.113598, [30] [bootstrap]: 0.00027503 [type_inference]: 0.0771529 [event_method]: 0.00052736 [auto_monad]: 0.00013232 [graph_reusing]: 9.29e-06 [pre_auto_parallel]: 3.76999e-06 [py_interpret_to_execute]: 4.981e-05 [rewriter_before_opt_a]: 0.000152 [expand_dump_flag]: 3.59002e-06 [jit_opt_a]: 0.0329668, [3] [Cycle 1]: 0.0232487, [27] [switch_simplify]: 0.0001046 [loop_unroll]: 4.982e-05 [a_1]: 0.00133599 [with_stream_mark]: 4.902e-05 [recompute_prepare]: 3.857e-05 [updatestate_depend_eliminate]: 1.457e-05 [updatestate_assign_eliminate]: 9.00001e-06 [updatestate_loads_eliminate]: 6.63e-06 [parameter_eliminate]: 3.45998e-06 [specialize_transform]: 2.033e-05 [updatestate_useless_node_eliminater]: 1.832e-05 [accelerated_algorithm]: 1.769e-05 [meta_shard_fg_expand]: 1.249e-05 [get_grad_eliminate_]: 1.937e-05 [merge_forward]: 1.196e-05 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.887e-05 [j_node_and_user_rematch]: 3.099e-05 [meta_fg_expand]: 0.00252572 [replace_old_param]: 8.846e-05 [inline_without_move]: 7.066e-05 [renormalize]: 0.0178736 [add_forward_monad_depend]: 1.662e-05 [auto_monad_grad]: 7.94002e-06 [auto_monad_eliminator]: 7.195e-05 [cse]: 0.0003502 [replace_applicator]: 0.00010241 [Cycle 2]: 0.00490157, [27] [switch_simplify]: 4.754e-05 [loop_unroll]: 4.465e-05 [a_1]: 0.00131353 [with_stream_mark]: 2.466e-05 [recompute_prepare]: 1.374e-05 [updatestate_depend_eliminate]: 5.43002e-06 [updatestate_assign_eliminate]: 4.43001e-06 [updatestate_loads_eliminate]: 4.27998e-06 [parameter_eliminate]: 2.71999e-06 [specialize_transform]: 8.97999e-06 [updatestate_useless_node_eliminater]: 8.50001e-06 [accelerated_algorithm]: 8.93002e-06 [meta_shard_fg_expand]: 4.64998e-06 [get_grad_eliminate_]: 8.65001e-06 [merge_forward]: 5.59998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.192e-05 [j_node_and_user_rematch]: 1.557e-05 [meta_fg_expand]: 0.00016006 [replace_old_param]: 1.396e-05 [inline_without_move]: 8.54002e-06 [renormalize]: 0.0028967 [add_forward_monad_depend]: 9.82001e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 3.004e-05 [replace_applicator]: 2.079e-05 [Cycle 3]: 0.00027824, [27] [switch_simplify]: 4.72e-06 [loop_unroll]: 4.13999e-06 [a_1]: 5.288e-05 [with_stream_mark]: 1.295e-05 [recompute_prepare]: 4.18001e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.90001e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 3.62002e-06 [updatestate_useless_node_eliminater]: 3.28e-06 [accelerated_algorithm]: 3.76999e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 3.61999e-06 [merge_forward]: 3.42002e-06 [cell_reuse_recompute_pass]: 2.37001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 6.12001e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 3.36999e-06 [inline_without_move]: 3.2e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 3.9e-06 [cse]: 8.85999e-06 [replace_applicator]: 4.05e-06 [py_interpret_to_execute_after_opt_a]: 1.416e-05 [rewriter_after_opt_a]: 3.638e-05 [convert_after_rewriter]: 6.34999e-06 [order_py_execute_after_rewriter]: 5.43002e-06 [mutable_eliminate]: 0.00074583 [jit_opt_b]: 5.845e-05, [1] [Cycle 1]: 5.087e-05, [2] [frontend_op_eliminate]: 2.643e-05 [inline_after_opt_a]: 1.198e-05 [cconv]: 3.471e-05 [loop_unroll]: 0.00043006 [jit_opt_after_cconv]: 0.00012783, [1] [Cycle 1]: 0.0001211, [11] [c_1]: 1.27e-05 [parameter_eliminate]: 3.06999e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 1.84e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.85e-05 [call_graph_tuple_transform]: 1.398e-05 [tuple_list_get_item_eliminator]: 4.11001e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 3.91001e-06 [remove_dup_value]: 1.476e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 5.35999e-06 [add_recomputation]: 3.803e-05 [cse_after_recomputation]: 1.947e-05, [1] [Cycle 1]: 1.424e-05, [1] [cse]: 7.82e-06 [auto_monad_reorder]: 1.325e-05 [get_jit_bprop_graph]: 2.68998e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00043926 [symbol_engine_optimizer]: 6.659e-05, [1] [Cycle 1]: 6.046e-05, [6] [build]: 3.90998e-06 [elim_shapecalc]: 6.20002e-06 [elim_not_effective]: 1.018e-05 [opt_reshape]: 4.27998e-06 [fold_const_symbol]: 6.51e-06 [renormalize]: 3.09985e-07 [validate]: 3.23e-05 Sums bootstrap : 0.000275s : 0.25% type_inference : 0.077153s : 71.42% event_method : 0.000527s : 0.49% auto_monad : 0.000132s : 0.12% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000050s : 0.05% rewriter_before_opt_a : 0.000152s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000157s : 0.15% jit_opt_a.loop_unroll : 0.000099s : 0.09% jit_opt_a.a_1 : 0.002702s : 2.50% jit_opt_a.with_stream_mark : 0.000087s : 0.08% jit_opt_a.recompute_prepare : 0.000056s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000023s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000033s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000030s : 0.03% jit_opt_a.accelerated_algorithm : 0.000030s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000019s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000032s : 0.03% jit_opt_a.merge_forward : 0.000021s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000074s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000053s : 0.05% jit_opt_a.meta_fg_expand : 0.002688s : 2.49% jit_opt_a.replace_old_param : 0.000106s : 0.10% jit_opt_a.inline_without_move : 0.000082s : 0.08% jit_opt_a.renormalize : 0.020770s : 19.23% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.03% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000091s : 0.08% jit_opt_a.cse : 0.000389s : 0.36% jit_opt_a.replace_applicator : 0.000127s : 0.12% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000746s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.02% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000035s : 0.03% loop_unroll : 0.000430s : 0.40% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000038s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000439s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000841 107 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.11% : 0.000001s : 1: substitution.fold_const_symbol 0.51% : 0.000004s : 1: substitution.graph_param_transform 70.97% : 0.000597s : 13: substitution.inline 2.87% : 0.000024s : 2: substitution.inline_without_move 1.39% : 0.000012s : 13: substitution.j_node_and_user_rematch 1.92% : 0.000016s : 7: substitution.minmaximum_grad 1.07% : 0.000009s : 5: substitution.partial_eliminate 1.55% : 0.000013s : 13: substitution.remove_not_recompute_node 4.31% : 0.000036s : 10: substitution.replace_applicator 1.12% : 0.000009s : 10: substitution.replace_old_param 1.00% : 0.000008s : 1: substitution.reshape_eliminate 0.74% : 0.000006s : 1: substitution.set_cell_output_no_recompute 0.88% : 0.000007s : 1: substitution.tile_eliminate 3.28% : 0.000028s : 7: substitution.tuple_list_convert_item_index_to_positive 2.11% : 0.000018s : 7: substitution.tuple_list_get_item_depend_reorder 5.93% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076990 2 95.34% : 0.073403s : 1: type_inference.infer 4.66% : 0.003587s : 1: type_inference.specialize ------[replace.] 0.000224 20 66.90% : 0.000150s : 13: replace.inline 33.10% : 0.000074s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000612 20 95.91% : 0.000587s : 13: match.inline 4.09% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000428 2768 1.46% : 0.000006s : 48: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.49% : 0.000006s : 48: predicate.addn_check_dump 1.45% : 0.000006s : 48: predicate.addn_zero_filter 2.14% : 0.000009s : 48: predicate.arithmetic_simplify 1.54% : 0.000007s : 48: predicate.cast_eliminate 0.10% : 0.000000s : 1: predicate.check_bprop_eliminate 1.63% : 0.000007s : 48: predicate.compare_switch_simplify 1.56% : 0.000007s : 48: predicate.depend_value_elim 1.42% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.54% : 0.000007s : 48: predicate.dict_get_item_eliminator 1.54% : 0.000007s : 48: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.04% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.30% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.46% : 0.000006s : 48: predicate.environ_get_depend_swap 1.44% : 0.000006s : 48: predicate.environ_get_eliminate 1.36% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.95% : 0.000004s : 20: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.33% : 0.000019s : 70: predicate.inline 1.89% : 0.000008s : 48: predicate.inline_without_move 0.34% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.26% : 0.000005s : 20: predicate.less_batch_normalization 1.81% : 0.000008s : 55: predicate.list_to_tuple_eliminator_ 1.99% : 0.000009s : 56: predicate.load_eliminater 0.38% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.25% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.78% : 0.000008s : 49: predicate.make_slice_get_slice_eliminator 1.61% : 0.000007s : 48: predicate.merge_addn 1.45% : 0.000006s : 48: predicate.minmaximum_grad 0.46% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.25% : 0.000010s : 56: predicate.partial_eliminate 1.49% : 0.000006s : 48: predicate.print_const_string_wrapper 2.23% : 0.000010s : 48: predicate.reduce_eliminate 1.98% : 0.000008s : 55: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000003s : 20: predicate.remove_not_recompute_node 2.78% : 0.000012s : 103: predicate.replace_applicator 1.03% : 0.000004s : 48: predicate.replace_old_param 0.08% : 0.000000s : 1: predicate.reset_defer_inline 1.56% : 0.000007s : 48: predicate.reshape_eliminate 1.57% : 0.000007s : 48: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.38% : 0.000006s : 48: predicate.same_eliminate 0.56% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.13% : 0.000001s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 20: predicate.specialize_transform 1.67% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.63% : 0.000007s : 48: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.08% : 0.000013s : 68: predicate.switch_defer_inline 2.55% : 0.000011s : 68: predicate.switch_layer_defer_inline 6.38% : 0.000027s : 170: predicate.switch_simplify 1.45% : 0.000006s : 48: predicate.tile_eliminate 1.47% : 0.000006s : 48: predicate.transpose_eliminate 2.11% : 0.000009s : 48: predicate.tuple_list_convert_item_index_to_positive 1.83% : 0.000008s : 48: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000015s : 57: predicate.tuple_list_get_item_eliminator 1.78% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 1.74% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.60% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 3.11% : 0.000013s : 76: predicate.updatestate_useless_node_eliminater 2.03% : 0.000009s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.18% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005546 58 77.30% : 0.004287s : 41: func_graph_cloner_run.FuncGraphClonerGraph 22.70% : 0.001259s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137885 87 0.03% : 0.000041s : 1: add_recomputation 0.11% : 0.000145s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.22% : 0.000301s : 1: bootstrap 0.03% : 0.000038s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.39% : 0.000541s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000013s : 1: graph_reusing 23.91% : 0.032971s : 1: jit_opt_a 0.09% : 0.000131s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.32% : 0.000437s : 1: loop_unroll 0.55% : 0.000753s : 1: mutable_eliminate 2.55% : 0.003516s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000054s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 12.79% : 0.017629s : 2: renormalize.infer 2.26% : 0.003112s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000156s : 1: rewriter_before_opt_a 0.05% : 0.000069s : 1: symbol_engine_optimizer 55.98% : 0.077185s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.662.934 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006ea60> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.663.689 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.015657, [30] [bootstrap]: 0.00030684 [type_inference]: 0.00567452 [event_method]: 2.165e-05 [auto_monad]: 7.53e-05 [graph_reusing]: 6.86999e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 4.723e-05 [rewriter_before_opt_a]: 7.98e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00695229, [2] [Cycle 1]: 0.00289608, [27] [switch_simplify]: 6.289e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00149518 [with_stream_mark]: 2.6e-05 [recompute_prepare]: 1.063e-05 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.94001e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.91e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 4.56002e-06 [cell_reuse_recompute_pass]: 2.06998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 9.96998e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 0.00090088 [add_forward_monad_depend]: 6.38e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.683e-05 [cse]: 3.661e-05 [replace_applicator]: 1.374e-05 [Cycle 2]: 0.00032745, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.08002e-06 [a_1]: 9.043e-05 [with_stream_mark]: 1.058e-05 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.08002e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.46998e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.394e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.66001e-06 [inline_without_move]: 4.97e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 1.11997e-06 [auto_monad_eliminator]: 5.56e-06 [cse]: 1.441e-05 [replace_applicator]: 5.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.293e-05 [rewriter_after_opt_a]: 4.058e-05 [convert_after_rewriter]: 7.15998e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00072439 [jit_opt_b]: 5.484e-05, [1] [Cycle 1]: 4.668e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.801e-05 [cconv]: 2.962e-05 [loop_unroll]: 0.00045537 [jit_opt_after_cconv]: 0.00015991, [1] [Cycle 1]: 0.00015269, [11] [c_1]: 2.225e-05 [parameter_eliminate]: 3.46999e-06 [updatestate_depend_eliminate]: 7.08e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [cse]: 2.829e-05 [call_graph_tuple_transform]: 2.13e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 6.19001e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 8.66002e-06 [add_recomputation]: 4.996e-05 [cse_after_recomputation]: 2.201e-05, [1] [Cycle 1]: 1.71e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 3.117e-05 [get_jit_bprop_graph]: 1.63002e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00048176 [symbol_engine_optimizer]: 8.055e-05, [1] [Cycle 1]: 7.443e-05, [6] [build]: 9.12001e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 9.06998e-06 [renormalize]: 4.30009e-07 [validate]: 4.503e-05 Sums bootstrap : 0.000307s : 2.73% type_inference : 0.005675s : 50.48% event_method : 0.000022s : 0.19% auto_monad : 0.000075s : 0.67% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.42% rewriter_before_opt_a : 0.000080s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.61% jit_opt_a.loop_unroll : 0.000036s : 0.32% jit_opt_a.a_1 : 0.001586s : 14.11% jit_opt_a.with_stream_mark : 0.000037s : 0.33% jit_opt_a.recompute_prepare : 0.000016s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000901s : 8.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.20% jit_opt_a.cse : 0.000051s : 0.45% jit_opt_a.replace_applicator : 0.000019s : 0.17% py_interpret_to_execute_after_opt_a : 0.000013s : 0.12% rewriter_after_opt_a : 0.000041s : 0.36% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000724s : 6.44% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.16% cconv : 0.000030s : 0.26% loop_unroll : 0.000455s : 4.05% jit_opt_after_cconv.c_1 : 0.000022s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000028s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000050s : 0.44% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000031s : 0.28% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000482s : 4.29% symbol_engine_optimizer.build : 0.000009s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.40% Time group info: ------[substitution.] 0.001104 23 0.19% : 0.000002s : 2: substitution.elim_not_effective 0.15% : 0.000002s : 2: substitution.fold_const_symbol 0.51% : 0.000006s : 3: substitution.graph_param_transform 17.80% : 0.000196s : 4: substitution.inline 0.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.49% : 0.000005s : 4: substitution.remove_not_recompute_node 0.45% : 0.000005s : 2: substitution.replace_old_param 80.04% : 0.000883s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005595 2 79.48% : 0.004447s : 1: type_inference.infer 20.52% : 0.001148s : 1: type_inference.specialize ------[replace.] 0.000103 6 47.22% : 0.000049s : 4: replace.inline 52.78% : 0.000054s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001075 6 18.05% : 0.000194s : 4: match.inline 81.95% : 0.000881s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.84% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.54% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.20% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.55% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 4.98% : 0.000006s : 15: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.93% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.10% : 0.000001s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.28% : 0.000009s : 53: predicate.switch_simplify 1.06% : 0.000001s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000787 13 48.93% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.65% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.42% : 0.000350s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018426 72 0.29% : 0.000053s : 1: add_recomputation 0.43% : 0.000079s : 1: auto_monad 0.18% : 0.000034s : 1: auto_monad_reorder 1.77% : 0.000326s : 1: bootstrap 0.17% : 0.000032s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000011s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 37.75% : 0.006956s : 1: jit_opt_a 0.88% : 0.000163s : 1: jit_opt_after_cconv 0.31% : 0.000057s : 1: jit_opt_b 2.89% : 0.000532s : 1: loop_unroll 3.99% : 0.000736s : 1: mutable_eliminate 9.85% : 0.001815s : 26: opt.transform.jit_opt_a 0.28% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000490s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000050s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.68% : 0.000494s : 1: renormalize.infer 2.16% : 0.000398s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000044s : 1: rewriter_after_opt_a 0.45% : 0.000083s : 1: rewriter_before_opt_a 0.45% : 0.000083s : 1: symbol_engine_optimizer 30.90% : 0.005694s : 1: type_inference TotalTime = 0.0415468, [30] [bootstrap]: 0.00025439 [type_inference]: 0.0207721 [event_method]: 1.796e-05 [auto_monad]: 9.288e-05 [graph_reusing]: 5.61998e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00010019 [rewriter_before_opt_a]: 7.779e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00591221, [2] [Cycle 1]: 0.00186201, [27] [switch_simplify]: 5.095e-05 [loop_unroll]: 2.951e-05 [a_1]: 0.00054453 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 8.06001e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 5.22e-06 [renormalize]: 0.00089618 [add_forward_monad_depend]: 5.50001e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.402e-05 [cse]: 2.766e-05 [replace_applicator]: 1.131e-05 [Cycle 2]: 0.00031273, [27] [switch_simplify]: 5.44998e-06 [loop_unroll]: 4.95001e-06 [a_1]: 8.829e-05 [with_stream_mark]: 1.002e-05 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.13002e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 8.09997e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 7.41001e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.79983e-07 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 5.56e-06 [cse]: 1.149e-05 [replace_applicator]: 4.98001e-06 [py_interpret_to_execute_after_opt_a]: 1.068e-05 [rewriter_after_opt_a]: 6.623e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 5.33002e-06 [mutable_eliminate]: 0.0004935 [jit_opt_b]: 4.642e-05, [1] [Cycle 1]: 4.007e-05, [2] [frontend_op_eliminate]: 1.53e-05 [inline_after_opt_a]: 1.484e-05 [cconv]: 2.368e-05 [loop_unroll]: 0.0003941 [jit_opt_after_cconv]: 0.00014545, [1] [Cycle 1]: 0.00013906, [11] [c_1]: 1.949e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.035e-05 [call_graph_tuple_transform]: 1.807e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.492e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 5.59e-06 [add_recomputation]: 6.995e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.919e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.785e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.10998e-06 [opt_after_jit_grad]: 0.0126622 [symbol_engine_optimizer]: 8.487e-05, [1] [Cycle 1]: 7.433e-05, [6] [build]: 4.92e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.766e-05 [opt_reshape]: 6.15002e-06 [fold_const_symbol]: 9.03002e-06 [renormalize]: 8.00006e-07 [validate]: 4.835e-05 Sums bootstrap : 0.000254s : 0.68% type_inference : 0.020772s : 55.80% event_method : 0.000018s : 0.05% auto_monad : 0.000093s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000100s : 0.27% rewriter_before_opt_a : 0.000078s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.15% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000633s : 1.70% jit_opt_a.with_stream_mark : 0.000029s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000896s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000039s : 0.11% jit_opt_a.replace_applicator : 0.000016s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000066s : 0.18% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000494s : 1.33% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000024s : 0.06% loop_unroll : 0.000394s : 1.06% jit_opt_after_cconv.c_1 : 0.000019s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000070s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.012662s : 34.01% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.13% Time group info: ------[substitution.] 0.000217 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000005s : 3: substitution.graph_param_transform 84.09% : 0.000182s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 2.34% : 0.000005s : 2: substitution.replace_old_param 5.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020592 2 93.65% : 0.019283s : 1: type_inference.infer 6.35% : 0.001308s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.36% : 0.000048s : 4: replace.inline 30.64% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 94.03% : 0.000180s : 4: match.inline 5.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 2.76% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.45% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.77% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.37% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000002s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.84% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000755 13 49.99% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.04% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.98% : 0.000332s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043353 72 0.17% : 0.000074s : 1: add_recomputation 0.22% : 0.000097s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.63% : 0.000273s : 1: bootstrap 0.06% : 0.000026s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.64% : 0.005915s : 1: jit_opt_a 0.34% : 0.000148s : 1: jit_opt_after_cconv 0.11% : 0.000049s : 1: jit_opt_b 0.93% : 0.000401s : 1: loop_unroll 1.16% : 0.000501s : 1: mutable_eliminate 1.94% : 0.000843s : 26: opt.transform.jit_opt_a 0.11% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.10% : 0.000043s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000037s : 4: opt.transform.symbol_engine_opt 29.25% : 0.012679s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000103s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.24% : 0.000536s : 1: renormalize.infer 0.81% : 0.000353s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000070s : 1: rewriter_after_opt_a 0.19% : 0.000081s : 1: rewriter_before_opt_a 0.20% : 0.000088s : 1: symbol_engine_optimizer 47.94% : 0.020785s : 1: type_inference TotalTime = 0.159425, [30] [bootstrap]: 0.00036658 [type_inference]: 0.139122 [event_method]: 1.839e-05 [auto_monad]: 6.663e-05 [graph_reusing]: 6.40002e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00026251 [rewriter_before_opt_a]: 7.774e-05 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.0168492, [2] [Cycle 1]: 0.0130833, [27] [switch_simplify]: 5.586e-05 [loop_unroll]: 2.997e-05 [a_1]: 0.00057667 [with_stream_mark]: 1.948e-05 [recompute_prepare]: 8.51002e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.92001e-06 [renormalize]: 0.0120234 [add_forward_monad_depend]: 1.041e-05 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 2.021e-05 [cse]: 3.377e-05 [replace_applicator]: 2.742e-05 [Cycle 2]: 0.00039544, [27] [switch_simplify]: 8.04002e-06 [loop_unroll]: 6.15002e-06 [a_1]: 0.00013083 [with_stream_mark]: 1.551e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 4.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.813e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.50997e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.34999e-06 [cse]: 1.309e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.461e-05 [rewriter_after_opt_a]: 3.986e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00086722 [jit_opt_b]: 5.617e-05, [1] [Cycle 1]: 4.822e-05, [2] [frontend_op_eliminate]: 1.932e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 3.21e-05 [loop_unroll]: 0.00045133 [jit_opt_after_cconv]: 0.00017267, [1] [Cycle 1]: 0.00016587, [11] [c_1]: 2.63e-05 [parameter_eliminate]: 3.49001e-06 [updatestate_depend_eliminate]: 8.46002e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 3.08e-05 [call_graph_tuple_transform]: 2.454e-05 [tuple_list_get_item_eliminator]: 7.63001e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.696e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 1.009e-05 [add_recomputation]: 5.354e-05 [cse_after_recomputation]: 2.506e-05, [1] [Cycle 1]: 1.932e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.609e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 7.87e-06 [opt_after_jit_grad]: 0.00050954 [symbol_engine_optimizer]: 0.00010773, [1] [Cycle 1]: 0.00010019, [6] [build]: 4.97e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 1.38e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 3.638e-05 [renormalize]: 3.89991e-07 [validate]: 5.905e-05 Sums bootstrap : 0.000367s : 0.24% type_inference : 0.139122s : 89.50% event_method : 0.000018s : 0.01% auto_monad : 0.000067s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000263s : 0.17% rewriter_before_opt_a : 0.000078s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000708s : 0.46% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.012023s : 7.74% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000047s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000867s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000451s : 0.29% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000510s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000036s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.04% Time group info: ------[substitution.] 0.000246 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 11.42% : 0.000028s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 4: substitution.graph_param_transform 73.53% : 0.000181s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000006s : 4: substitution.remove_not_recompute_node 2.33% : 0.000006s : 2: substitution.replace_old_param 5.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139051 2 98.59% : 0.137090s : 1: type_inference.infer 1.41% : 0.001961s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.16% : 0.000045s : 4: replace.inline 32.84% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 93.74% : 0.000178s : 4: match.inline 6.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000002s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.63% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.81% : 0.000008s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.94% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.27% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003391 34 73.62% : 0.002496s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.05% : 0.000849s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.172488 72 0.03% : 0.000057s : 1: add_recomputation 0.04% : 0.000070s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000388s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 9.77% : 0.016853s : 1: jit_opt_a 0.10% : 0.000176s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.27% : 0.000461s : 1: loop_unroll 0.51% : 0.000879s : 1: mutable_eliminate 0.55% : 0.000956s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000062s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000519s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000268s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 6.39% : 0.011024s : 1: renormalize.infer 0.57% : 0.000987s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000083s : 1: rewriter_before_opt_a 0.06% : 0.000110s : 1: symbol_engine_optimizer 80.66% : 0.139135s : 1: type_inference TotalTime = 0.104496, [30] [bootstrap]: 0.00028503 [type_inference]: 0.0726302 [event_method]: 0.00034743 [auto_monad]: 0.00019468 [graph_reusing]: 7.77998e-06 [pre_auto_parallel]: 3.21001e-06 [py_interpret_to_execute]: 3.855e-05 [rewriter_before_opt_a]: 0.00012964 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.0282062, [3] [Cycle 1]: 0.0200405, [27] [switch_simplify]: 8.628e-05 [loop_unroll]: 4.869e-05 [a_1]: 0.0010956 [with_stream_mark]: 3.764e-05 [recompute_prepare]: 2.536e-05 [updatestate_depend_eliminate]: 1.102e-05 [updatestate_assign_eliminate]: 7.7e-06 [updatestate_loads_eliminate]: 6.86001e-06 [parameter_eliminate]: 3.06001e-06 [specialize_transform]: 1.622e-05 [updatestate_useless_node_eliminater]: 1.538e-05 [accelerated_algorithm]: 1.5e-05 [meta_shard_fg_expand]: 5.14e-06 [get_grad_eliminate_]: 1.476e-05 [merge_forward]: 1.036e-05 [cell_reuse_recompute_pass]: 1.83002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.225e-05 [j_node_and_user_rematch]: 2.585e-05 [meta_fg_expand]: 0.00211854 [replace_old_param]: 7.764e-05 [inline_without_move]: 6.709e-05 [renormalize]: 0.0155086 [add_forward_monad_depend]: 1.568e-05 [auto_monad_grad]: 7.31001e-06 [auto_monad_eliminator]: 6.466e-05 [cse]: 0.00030213 [replace_applicator]: 0.00013583 [Cycle 2]: 0.00414101, [27] [switch_simplify]: 4.536e-05 [loop_unroll]: 4.252e-05 [a_1]: 0.00123766 [with_stream_mark]: 2.326e-05 [recompute_prepare]: 1.029e-05 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 4.09002e-06 [updatestate_loads_eliminate]: 4.67e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.78e-06 [accelerated_algorithm]: 7.57002e-06 [meta_shard_fg_expand]: 3.03e-06 [get_grad_eliminate_]: 7.23e-06 [merge_forward]: 4.99998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.828e-05 [j_node_and_user_rematch]: 1.228e-05 [meta_fg_expand]: 0.00014954 [replace_old_param]: 9.89001e-06 [inline_without_move]: 6.63e-06 [renormalize]: 0.00226308 [add_forward_monad_depend]: 8.53001e-06 [auto_monad_grad]: 1.87001e-06 [auto_monad_eliminator]: 1.436e-05 [cse]: 2.854e-05 [replace_applicator]: 1.922e-05 [Cycle 3]: 0.00029202, [27] [switch_simplify]: 5.12999e-06 [loop_unroll]: 3.97998e-06 [a_1]: 5.466e-05 [with_stream_mark]: 1.231e-05 [recompute_prepare]: 4.39002e-06 [updatestate_depend_eliminate]: 3.20998e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 1.80001e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 3.72998e-06 [updatestate_useless_node_eliminater]: 3.75998e-06 [accelerated_algorithm]: 4.23999e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 3.56001e-06 [merge_forward]: 3.05998e-06 [cell_reuse_recompute_pass]: 2.85002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.352e-05 [j_node_and_user_rematch]: 6.91999e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 3.56001e-06 [inline_without_move]: 3.78001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 3.66001e-06 [cse]: 1.051e-05 [replace_applicator]: 3.92998e-06 [py_interpret_to_execute_after_opt_a]: 1.41e-05 [rewriter_after_opt_a]: 4.121e-05 [convert_after_rewriter]: 6.54999e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00081332 [jit_opt_b]: 5.298e-05, [1] [Cycle 1]: 4.415e-05, [2] [frontend_op_eliminate]: 1.492e-05 [inline_after_opt_a]: 1.439e-05 [cconv]: 2.962e-05 [loop_unroll]: 0.00052729 [jit_opt_after_cconv]: 0.00015314, [1] [Cycle 1]: 0.00014359, [11] [c_1]: 1.49e-05 [parameter_eliminate]: 4.00998e-06 [updatestate_depend_eliminate]: 7.82e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 1.63002e-06 [cse]: 2.399e-05 [call_graph_tuple_transform]: 1.807e-05 [tuple_list_get_item_eliminator]: 5.04003e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.12e-06 [remove_dup_value]: 1.585e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.52001e-06 [add_recomputation]: 4.089e-05 [cse_after_recomputation]: 2.422e-05, [1] [Cycle 1]: 1.864e-05, [1] [cse]: 1.068e-05 [auto_monad_reorder]: 1.442e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 6.21e-06 [opt_after_jit_grad]: 0.0005594 [symbol_engine_optimizer]: 7.705e-05, [1] [Cycle 1]: 6.95e-05, [6] [build]: 4.98001e-06 [elim_shapecalc]: 6.29001e-06 [elim_not_effective]: 1.232e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 6.82002e-06 [renormalize]: 5.29981e-07 [validate]: 3.762e-05 Sums bootstrap : 0.000285s : 0.29% type_inference : 0.072630s : 72.78% event_method : 0.000347s : 0.35% auto_monad : 0.000195s : 0.20% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.04% rewriter_before_opt_a : 0.000130s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000137s : 0.14% jit_opt_a.loop_unroll : 0.000095s : 0.10% jit_opt_a.a_1 : 0.002388s : 2.39% jit_opt_a.with_stream_mark : 0.000073s : 0.07% jit_opt_a.recompute_prepare : 0.000040s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.03% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.05% jit_opt_a.meta_fg_expand : 0.002270s : 2.27% jit_opt_a.replace_old_param : 0.000091s : 0.09% jit_opt_a.inline_without_move : 0.000078s : 0.08% jit_opt_a.renormalize : 0.017772s : 17.81% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.03% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.08% jit_opt_a.cse : 0.000341s : 0.34% jit_opt_a.replace_applicator : 0.000159s : 0.16% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000813s : 0.82% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000030s : 0.03% loop_unroll : 0.000527s : 0.53% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000559s : 0.56% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000658 104 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.65% : 0.000004s : 1: substitution.graph_param_transform 66.97% : 0.000441s : 13: substitution.inline 3.31% : 0.000022s : 2: substitution.inline_without_move 1.60% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.84% : 0.000012s : 7: substitution.minmaximum_grad 1.25% : 0.000008s : 5: substitution.partial_eliminate 1.70% : 0.000011s : 12: substitution.remove_not_recompute_node 5.64% : 0.000037s : 10: substitution.replace_applicator 1.05% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.03% : 0.000007s : 1: substitution.tile_eliminate 3.86% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.37% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.85% : 0.000052s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072519 2 95.96% : 0.069591s : 1: type_inference.infer 4.04% : 0.002928s : 1: type_inference.specialize ------[replace.] 0.000198 20 65.87% : 0.000130s : 13: replace.inline 34.13% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000459 20 94.20% : 0.000432s : 13: match.inline 5.80% : 0.000027s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000400 2656 1.44% : 0.000006s : 46: predicate.accumulaten_eliminater 0.42% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.36% : 0.000005s : 46: predicate.addn_check_dump 1.62% : 0.000006s : 46: predicate.addn_zero_filter 2.27% : 0.000009s : 46: predicate.arithmetic_simplify 1.58% : 0.000006s : 46: predicate.cast_eliminate 0.13% : 0.000001s : 1: predicate.check_bprop_eliminate 1.51% : 0.000006s : 46: predicate.compare_switch_simplify 1.36% : 0.000005s : 46: predicate.depend_value_elim 1.57% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.48% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.45% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.35% : 0.000005s : 46: predicate.environ_get_add_eliminate 1.55% : 0.000006s : 46: predicate.environ_get_depend_swap 1.46% : 0.000006s : 46: predicate.environ_get_eliminate 1.46% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.77% : 0.000003s : 18: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.26% : 0.000017s : 68: predicate.inline 1.89% : 0.000008s : 46: predicate.inline_without_move 0.39% : 0.000002s : 18: predicate.j_node_and_user_rematch 1.15% : 0.000005s : 18: predicate.less_batch_normalization 1.75% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.81% : 0.000007s : 54: predicate.load_eliminater 0.61% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.38% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.60% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.36% : 0.000005s : 46: predicate.merge_addn 1.46% : 0.000006s : 46: predicate.minmaximum_grad 0.59% : 0.000002s : 1: predicate.mutable_eliminate 0.12% : 0.000000s : 1: predicate.opt_reshape 2.35% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 46: predicate.print_const_string_wrapper 2.02% : 0.000008s : 46: predicate.reduce_eliminate 1.81% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000002s : 18: predicate.remove_not_recompute_node 2.94% : 0.000012s : 99: predicate.replace_applicator 1.16% : 0.000005s : 46: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.51% : 0.000006s : 46: predicate.reshape_eliminate 1.64% : 0.000007s : 46: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.47% : 0.000006s : 46: predicate.same_eliminate 0.52% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.73% : 0.000003s : 18: predicate.specialize_transform 1.60% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.88% : 0.000012s : 66: predicate.switch_defer_inline 2.45% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.76% : 0.000027s : 166: predicate.switch_simplify 1.46% : 0.000006s : 46: predicate.tile_eliminate 1.43% : 0.000006s : 46: predicate.transpose_eliminate 2.02% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.84% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.88% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.95% : 0.000008s : 53: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.72% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.90% : 0.000008s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004971 52 76.85% : 0.003820s : 35: func_graph_cloner_run.FuncGraphClonerGraph 23.15% : 0.001151s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125408 87 0.04% : 0.000045s : 1: add_recomputation 0.16% : 0.000203s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000309s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.28% : 0.000356s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 22.50% : 0.028211s : 1: jit_opt_a 0.12% : 0.000156s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.43% : 0.000537s : 1: loop_unroll 0.66% : 0.000826s : 1: mutable_eliminate 2.51% : 0.003144s : 39: opt.transform.jit_opt_a 0.03% : 0.000039s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000021s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000570s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 11.74% : 0.014719s : 2: renormalize.infer 2.41% : 0.003016s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.11% : 0.000133s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 57.93% : 0.072651s : 1: type_inference TotalTime = 0.0294582, [30] [bootstrap]: 0.0002552 [type_inference]: 0.0113773 [event_method]: 2.436e-05 [auto_monad]: 0.00015533 [graph_reusing]: 6.80998e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 6.575e-05 [rewriter_before_opt_a]: 8.676e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.0147496, [2] [Cycle 1]: 0.0106424, [27] [switch_simplify]: 6.179e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00906088 [with_stream_mark]: 2.958e-05 [recompute_prepare]: 1.432e-05 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 2.84999e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 6.23002e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 5.81e-06 [renormalize]: 0.0010546 [add_forward_monad_depend]: 7.12002e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.699e-05 [cse]: 3.918e-05 [replace_applicator]: 1.372e-05 [Cycle 2]: 0.0003299, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.37001e-06 [a_1]: 9.372e-05 [with_stream_mark]: 1.112e-05 [recompute_prepare]: 5.61003e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.23002e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.49001e-06 [cell_reuse_recompute_pass]: 2.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.368e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 7.97998e-06 [inline_without_move]: 5.49e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.66998e-06 [cse]: 1.275e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.592e-05 [rewriter_after_opt_a]: 3.986e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00102902 [jit_opt_b]: 5.277e-05, [1] [Cycle 1]: 4.447e-05, [2] [frontend_op_eliminate]: 1.715e-05 [inline_after_opt_a]: 1.612e-05 [cconv]: 2.795e-05 [loop_unroll]: 0.00046051 [jit_opt_after_cconv]: 0.00015454, [1] [Cycle 1]: 0.00014736, [11] [c_1]: 2.159e-05 [parameter_eliminate]: 3.31001e-06 [updatestate_depend_eliminate]: 6.57002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.856e-05 [call_graph_tuple_transform]: 2.015e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.771e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 9.91e-06 [add_recomputation]: 5.275e-05 [cse_after_recomputation]: 2.322e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.218e-05 [auto_monad_reorder]: 1.765e-05 [get_jit_bprop_graph]: 2.398e-05 [rewriter_after_jit_bprop_graph]: 5.74e-06 [opt_after_jit_grad]: 0.00046244 [symbol_engine_optimizer]: 8.032e-05, [1] [Cycle 1]: 7.348e-05, [6] [build]: 1.01e-05 [elim_shapecalc]: 8.34998e-06 [elim_not_effective]: 1.275e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.81002e-06 [renormalize]: 4.19997e-07 [validate]: 4.553e-05 Sums bootstrap : 0.000255s : 1.02% type_inference : 0.011377s : 45.45% event_method : 0.000024s : 0.10% auto_monad : 0.000155s : 0.62% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000066s : 0.26% rewriter_before_opt_a : 0.000087s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.27% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.009155s : 36.57% jit_opt_a.with_stream_mark : 0.000041s : 0.16% jit_opt_a.recompute_prepare : 0.000020s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.001055s : 4.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000052s : 0.21% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001029s : 4.11% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.11% loop_unroll : 0.000461s : 1.84% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.04% add_recomputation : 0.000053s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000024s : 0.10% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000462s : 1.85% symbol_engine_optimizer.build : 0.000010s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.18% Time group info: ------[substitution.] 0.000383 23 0.50% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.56% : 0.000006s : 3: substitution.graph_param_transform 89.56% : 0.000343s : 4: substitution.inline 1.00% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.40% : 0.000005s : 4: substitution.remove_not_recompute_node 1.50% : 0.000006s : 2: substitution.replace_old_param 4.11% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011278 2 40.82% : 0.004604s : 1: type_inference.infer 59.18% : 0.006674s : 1: type_inference.specialize ------[replace.] 0.000107 6 72.83% : 0.000078s : 4: replace.inline 27.17% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000354 6 95.94% : 0.000340s : 4: match.inline 4.06% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.008369 691 0.03% : 0.000002s : 10: predicate.accumulaten_eliminater 0.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.02% : 0.000001s : 10: predicate.addn_check_dump 0.02% : 0.000002s : 10: predicate.addn_zero_filter 0.04% : 0.000003s : 10: predicate.arithmetic_simplify 0.02% : 0.000002s : 10: predicate.cast_eliminate 0.01% : 0.000001s : 3: predicate.check_bprop_eliminate 0.02% : 0.000001s : 10: predicate.compare_switch_simplify 0.03% : 0.000002s : 10: predicate.depend_value_elim 0.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.02% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.02% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.00% : 0.000000s : 3: predicate.elim_not_effective 0.01% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.02% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.02% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.02% : 0.000001s : 10: predicate.environ_get_depend_swap 0.02% : 0.000002s : 10: predicate.environ_get_eliminate 0.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 3: predicate.fold_const_symbol 0.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.01% : 0.000001s : 3: predicate.graph_param_transform 0.08% : 0.000007s : 22: predicate.inline 0.01% : 0.000001s : 6: predicate.inline_without_move 0.01% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.02% : 0.000002s : 6: predicate.less_batch_normalization 0.03% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.07% : 0.000006s : 15: predicate.load_eliminater 0.02% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.03% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.02% : 0.000002s : 10: predicate.merge_addn 0.02% : 0.000001s : 10: predicate.minmaximum_grad 0.03% : 0.000002s : 3: predicate.mutable_eliminate 0.01% : 0.000001s : 3: predicate.opt_reshape 0.07% : 0.000005s : 15: predicate.partial_eliminate 0.02% : 0.000002s : 10: predicate.print_const_string_wrapper 0.04% : 0.000003s : 10: predicate.reduce_eliminate 0.03% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.01% : 0.000001s : 6: predicate.remove_not_recompute_node 0.03% : 0.000003s : 18: predicate.replace_applicator 0.01% : 0.000001s : 6: predicate.replace_old_param 0.01% : 0.000000s : 3: predicate.reset_defer_inline 0.02% : 0.000002s : 10: predicate.reshape_eliminate 0.02% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.01% : 0.000001s : 3: predicate.row_tensor_eliminate 0.02% : 0.000002s : 10: predicate.same_eliminate 0.01% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.02% : 0.000002s : 6: predicate.special_op_eliminate 0.01% : 0.000001s : 6: predicate.specialize_transform 0.02% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.03% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.01% : 0.000000s : 3: predicate.switch_call_monad_eliminater 0.07% : 0.000006s : 16: predicate.switch_defer_inline 0.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 0.11% : 0.000009s : 53: predicate.switch_simplify 0.02% : 0.000002s : 10: predicate.tile_eliminate 0.02% : 0.000002s : 10: predicate.transpose_eliminate 0.02% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.02% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 0.07% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 0.03% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.03% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 98.31% : 0.008228s : 15: predicate.updatestate_pure_node_eliminater 0.04% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 0.02% : 0.000002s : 10: predicate.value_based_eliminate 0.01% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.01% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000883 13 40.42% : 0.000357s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.09% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.50% : 0.000464s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039951 72 0.14% : 0.000056s : 1: add_recomputation 0.40% : 0.000160s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.68% : 0.000273s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000012s : 1: environ_conv 0.07% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.07% : 0.000027s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 36.93% : 0.014753s : 1: jit_opt_a 0.39% : 0.000157s : 1: jit_opt_after_cconv 0.14% : 0.000055s : 1: jit_opt_b 1.17% : 0.000469s : 1: loop_unroll 2.60% : 0.001040s : 1: mutable_eliminate 23.49% : 0.009385s : 26: opt.transform.jit_opt_a 0.12% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.18% : 0.000470s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000069s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.49% : 0.000595s : 1: renormalize.infer 1.13% : 0.000452s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000044s : 1: rewriter_after_opt_a 0.23% : 0.000090s : 1: rewriter_before_opt_a 0.21% : 0.000083s : 1: symbol_engine_optimizer 28.56% : 0.011410s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.811.949 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e700> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.812.575 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0353386, [30] [bootstrap]: 0.00024676 [type_inference]: 0.0172609 [event_method]: 6.669e-05 [auto_monad]: 0.00010227 [graph_reusing]: 7.68999e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 3.26e-05 [rewriter_before_opt_a]: 0.00010743 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.0149901, [3] [Cycle 1]: 0.00763144, [27] [switch_simplify]: 7.467e-05 [loop_unroll]: 4.258e-05 [a_1]: 0.00094578 [with_stream_mark]: 0.00030352 [recompute_prepare]: 2.389e-05 [updatestate_depend_eliminate]: 9.09998e-06 [updatestate_assign_eliminate]: 7.4e-06 [updatestate_loads_eliminate]: 6.34001e-06 [parameter_eliminate]: 3.41001e-06 [specialize_transform]: 1.442e-05 [updatestate_useless_node_eliminater]: 1.276e-05 [accelerated_algorithm]: 1.359e-05 [meta_shard_fg_expand]: 5.05999e-06 [get_grad_eliminate_]: 1.3e-05 [merge_forward]: 9.20001e-06 [cell_reuse_recompute_pass]: 8.60018e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.964e-05 [j_node_and_user_rematch]: 2.432e-05 [meta_fg_expand]: 0.00184111 [replace_old_param]: 6.456e-05 [inline_without_move]: 5.681e-05 [renormalize]: 0.00350617 [add_forward_monad_depend]: 1.239e-05 [auto_monad_grad]: 6.31e-06 [auto_monad_eliminator]: 5.816e-05 [cse]: 0.00022329 [replace_applicator]: 7.827e-05 [Cycle 2]: 0.00362325, [27] [switch_simplify]: 4.117e-05 [loop_unroll]: 3.984e-05 [a_1]: 0.00115545 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 1.029e-05 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 4.13001e-06 [updatestate_loads_eliminate]: 4.05e-06 [parameter_eliminate]: 2.81e-06 [specialize_transform]: 8.54e-06 [updatestate_useless_node_eliminater]: 8.51002e-06 [accelerated_algorithm]: 8.50999e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 8.44002e-06 [merge_forward]: 5.22999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.004e-05 [j_node_and_user_rematch]: 1.381e-05 [meta_fg_expand]: 0.00012692 [replace_old_param]: 1.057e-05 [inline_without_move]: 8.16002e-06 [renormalize]: 0.00184335 [add_forward_monad_depend]: 5.80002e-06 [auto_monad_grad]: 4.78e-05 [auto_monad_eliminator]: 1.268e-05 [cse]: 2.288e-05 [replace_applicator]: 1.416e-05 [Cycle 3]: 0.00025072, [27] [switch_simplify]: 4.75001e-06 [loop_unroll]: 3.61001e-06 [a_1]: 4.166e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 3.46001e-06 [updatestate_depend_eliminate]: 2.41e-06 [updatestate_assign_eliminate]: 1.57001e-06 [updatestate_loads_eliminate]: 1.64e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 3.49001e-06 [updatestate_useless_node_eliminater]: 3.28e-06 [accelerated_algorithm]: 3.18e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 3.44001e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 2.32001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.156e-05 [j_node_and_user_rematch]: 5.56e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 3.03998e-06 [inline_without_move]: 2.89999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 3.53e-06 [cse]: 7.73999e-06 [replace_applicator]: 3.42002e-06 [py_interpret_to_execute_after_opt_a]: 1.256e-05 [rewriter_after_opt_a]: 3.452e-05 [convert_after_rewriter]: 5.66e-06 [order_py_execute_after_rewriter]: 4.07e-06 [mutable_eliminate]: 0.00071603 [jit_opt_b]: 0.0002708, [1] [Cycle 1]: 0.00026139, [2] [frontend_op_eliminate]: 1.048e-05 [inline_after_opt_a]: 0.00023187 [cconv]: 2.766e-05 [loop_unroll]: 0.00047299 [jit_opt_after_cconv]: 0.00013826, [1] [Cycle 1]: 0.00013144, [11] [c_1]: 1.236e-05 [parameter_eliminate]: 2.76999e-06 [updatestate_depend_eliminate]: 4.81002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 1.68002e-06 [cse]: 1.692e-05 [call_graph_tuple_transform]: 1.397e-05 [tuple_list_get_item_eliminator]: 4e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 3.81999e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 4.70001e-06 [add_recomputation]: 3.493e-05 [cse_after_recomputation]: 2.046e-05, [1] [Cycle 1]: 1.511e-05, [1] [cse]: 8.99e-06 [auto_monad_reorder]: 1.402e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.92999e-06 [opt_after_jit_grad]: 0.00044185 [symbol_engine_optimizer]: 6.898e-05, [1] [Cycle 1]: 6.304e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 6.68e-06 [elim_not_effective]: 1.091e-05 [opt_reshape]: 4.25e-06 [fold_const_symbol]: 6.42001e-06 [renormalize]: 4.10015e-07 [validate]: 3.232e-05 Sums bootstrap : 0.000247s : 0.80% type_inference : 0.017261s : 55.73% event_method : 0.000067s : 0.22% auto_monad : 0.000102s : 0.33% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000033s : 0.11% rewriter_before_opt_a : 0.000107s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000121s : 0.39% jit_opt_a.loop_unroll : 0.000086s : 0.28% jit_opt_a.a_1 : 0.002143s : 6.92% jit_opt_a.with_stream_mark : 0.000328s : 1.06% jit_opt_a.recompute_prepare : 0.000038s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.08% jit_opt_a.accelerated_algorithm : 0.000025s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.08% jit_opt_a.merge_forward : 0.000017s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.14% jit_opt_a.meta_fg_expand : 0.001970s : 6.36% jit_opt_a.replace_old_param : 0.000078s : 0.25% jit_opt_a.inline_without_move : 0.000068s : 0.22% jit_opt_a.renormalize : 0.005350s : 17.27% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.06% jit_opt_a.auto_monad_grad : 0.000055s : 0.18% jit_opt_a.auto_monad_eliminator : 0.000074s : 0.24% jit_opt_a.cse : 0.000254s : 0.82% jit_opt_a.replace_applicator : 0.000096s : 0.31% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000035s : 0.11% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000716s : 2.31% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000232s : 0.75% cconv : 0.000028s : 0.09% loop_unroll : 0.000473s : 1.53% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000017s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000035s : 0.11% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000014s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000442s : 1.43% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.10% Time group info: ------[substitution.] 0.000560 105 0.35% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.75% : 0.000004s : 1: substitution.graph_param_transform 65.26% : 0.000366s : 13: substitution.inline 3.47% : 0.000019s : 2: substitution.inline_without_move 1.75% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.78% : 0.000010s : 7: substitution.minmaximum_grad 1.27% : 0.000007s : 5: substitution.partial_eliminate 2.28% : 0.000013s : 13: substitution.remove_not_recompute_node 5.14% : 0.000029s : 10: substitution.replace_applicator 1.06% : 0.000006s : 8: substitution.replace_old_param 1.11% : 0.000006s : 1: substitution.reshape_eliminate 0.59% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.94% : 0.000005s : 1: substitution.tile_eliminate 3.98% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.81% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.29% : 0.000041s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017169 2 90.85% : 0.015598s : 1: type_inference.infer 9.15% : 0.001571s : 1: type_inference.specialize ------[replace.] 0.000168 20 65.33% : 0.000110s : 13: replace.inline 34.67% : 0.000058s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000378 20 94.59% : 0.000358s : 13: match.inline 5.41% : 0.000020s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000373 2537 1.52% : 0.000006s : 44: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 44: predicate.addn_check_dump 1.65% : 0.000006s : 44: predicate.addn_zero_filter 2.05% : 0.000008s : 44: predicate.arithmetic_simplify 1.61% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.49% : 0.000006s : 44: predicate.compare_switch_simplify 1.54% : 0.000006s : 44: predicate.depend_value_elim 1.43% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.51% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.46% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.29% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.16% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.47% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_depend_swap 1.47% : 0.000006s : 44: predicate.environ_get_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.93% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.55% : 0.000017s : 66: predicate.inline 1.89% : 0.000007s : 42: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.99% : 0.000004s : 18: predicate.less_batch_normalization 2.04% : 0.000008s : 51: predicate.list_to_tuple_eliminator_ 1.86% : 0.000007s : 52: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.40% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.59% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.56% : 0.000006s : 44: predicate.merge_addn 1.53% : 0.000006s : 44: predicate.minmaximum_grad 0.51% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.38% : 0.000009s : 52: predicate.partial_eliminate 1.47% : 0.000006s : 44: predicate.print_const_string_wrapper 2.01% : 0.000008s : 44: predicate.reduce_eliminate 1.98% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 18: predicate.remove_not_recompute_node 2.66% : 0.000010s : 94: predicate.replace_applicator 1.01% : 0.000004s : 42: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 44: predicate.reshape_eliminate 1.50% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.26% : 0.000001s : 1: predicate.row_tensor_eliminate 1.53% : 0.000006s : 44: predicate.same_eliminate 0.51% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.91% : 0.000003s : 18: predicate.specialize_transform 1.67% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.89% : 0.000011s : 64: predicate.switch_defer_inline 2.60% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.42% : 0.000024s : 154: predicate.switch_simplify 1.63% : 0.000006s : 44: predicate.tile_eliminate 1.56% : 0.000006s : 44: predicate.transpose_eliminate 1.96% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.91% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.84% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.87% : 0.000011s : 70: predicate.updatestate_useless_node_eliminater 1.95% : 0.000007s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002135 32 58.27% : 0.001244s : 15: func_graph_cloner_run.FuncGraphClonerGraph 41.73% : 0.000891s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043437 87 0.09% : 0.000038s : 1: add_recomputation 0.25% : 0.000107s : 1: auto_monad 0.04% : 0.000017s : 1: auto_monad_reorder 0.63% : 0.000272s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.17% : 0.000072s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 34.52% : 0.014994s : 1: jit_opt_a 0.32% : 0.000141s : 1: jit_opt_after_cconv 0.63% : 0.000274s : 1: jit_opt_b 1.11% : 0.000481s : 1: loop_unroll 1.67% : 0.000725s : 1: mutable_eliminate 6.41% : 0.002786s : 39: opt.transform.jit_opt_a 0.07% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000019s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000011s : 1: opt.transform.mutable_eliminate 0.04% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000024s : 4: opt.transform.symbol_engine_opt 1.04% : 0.000450s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000035s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 7.84% : 0.003405s : 2: renormalize.infer 4.34% : 0.001886s : 2: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000037s : 1: rewriter_after_opt_a 0.25% : 0.000110s : 1: rewriter_before_opt_a 0.16% : 0.000072s : 1: symbol_engine_optimizer 39.79% : 0.017283s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.912.058 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e1f0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.912.736 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.324426, [30] [bootstrap]: 0.00035096 [type_inference]: 0.310706 [event_method]: 2.708e-05 [auto_monad]: 7.559e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 0.00044327 [rewriter_before_opt_a]: 9.799e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.0100495, [2] [Cycle 1]: 0.00611684, [27] [switch_simplify]: 6.515e-05 [loop_unroll]: 3.433e-05 [a_1]: 0.0007227 [with_stream_mark]: 2.19e-05 [recompute_prepare]: 9.18002e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.38998e-06 [accelerated_algorithm]: 6.91999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.48e-06 [merge_forward]: 4.12003e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 1.071e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 6.38e-06 [renormalize]: 0.00487027 [add_forward_monad_depend]: 9.66998e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.957e-05 [cse]: 4.276e-05 [replace_applicator]: 2.483e-05 [Cycle 2]: 0.00039916, [27] [switch_simplify]: 7.82002e-06 [loop_unroll]: 7.03998e-06 [a_1]: 0.00013182 [with_stream_mark]: 1.467e-05 [recompute_prepare]: 6.76999e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.919e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 9.95002e-06 [inline_without_move]: 5.71e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.379e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.616e-05 [rewriter_after_opt_a]: 4.02e-05 [convert_after_rewriter]: 7.25003e-06 [order_py_execute_after_rewriter]: 5.89999e-06 [mutable_eliminate]: 0.00073792 [jit_opt_b]: 6.052e-05, [1] [Cycle 1]: 5.225e-05, [2] [frontend_op_eliminate]: 2.053e-05 [inline_after_opt_a]: 1.996e-05 [cconv]: 2.825e-05 [loop_unroll]: 0.00048564 [jit_opt_after_cconv]: 0.00017454, [1] [Cycle 1]: 0.00016711, [11] [c_1]: 2.693e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 7.56999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 3.317e-05 [call_graph_tuple_transform]: 2.331e-05 [tuple_list_get_item_eliminator]: 6.67002e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.83998e-06 [remove_dup_value]: 1.908e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 1.061e-05 [add_recomputation]: 5.694e-05 [cse_after_recomputation]: 2.582e-05, [1] [Cycle 1]: 2.017e-05, [1] [cse]: 1.441e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.96e-06 [opt_after_jit_grad]: 0.00051318 [symbol_engine_optimizer]: 0.00015819, [1] [Cycle 1]: 0.00015077, [6] [build]: 4.23999e-06 [elim_shapecalc]: 8.55999e-06 [elim_not_effective]: 8.931e-05 [opt_reshape]: 8.05e-06 [fold_const_symbol]: 1.085e-05 [renormalize]: 3.89991e-07 [validate]: 5.757e-05 Sums bootstrap : 0.000351s : 0.11% type_inference : 0.310706s : 97.03% event_method : 0.000027s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000443s : 0.14% rewriter_before_opt_a : 0.000098s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000855s : 0.27% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004870s : 1.52% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000057s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000738s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000486s : 0.15% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000057s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000513s : 0.16% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000089s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000058s : 0.02% Time group info: ------[substitution.] 0.000287 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 86.72% : 0.000249s : 5: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 1.98% : 0.000006s : 2: substitution.replace_old_param 4.37% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.310607 2 99.14% : 0.307948s : 1: type_inference.infer 0.86% : 0.002659s : 1: type_inference.specialize ------[replace.] 0.000101 7 68.49% : 0.000069s : 5: replace.inline 31.51% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 95.61% : 0.000246s : 5: match.inline 4.39% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 1.81% : 0.000003s : 13: predicate.arithmetic_simplify 1.48% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.38% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.76% : 0.000003s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000004s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 1.75% : 0.000003s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.01% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.90% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.94% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002546 25 62.29% : 0.001586s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.38% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.34% : 0.000874s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.330554 72 0.02% : 0.000060s : 1: add_recomputation 0.02% : 0.000079s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.11% : 0.000373s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.04% : 0.010053s : 1: jit_opt_a 0.05% : 0.000178s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.15% : 0.000496s : 1: loop_unroll 0.23% : 0.000748s : 1: mutable_eliminate 0.34% : 0.001123s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000113s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000450s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.17% : 0.003858s : 1: renormalize.infer 0.30% : 0.000995s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000104s : 1: rewriter_before_opt_a 0.05% : 0.000162s : 1: symbol_engine_optimizer 94.01% : 0.310762s : 1: type_inference TotalTime = 0.121394, [30] [bootstrap]: 0.00031448 [type_inference]: 0.0842302 [event_method]: 1.89e-05 [auto_monad]: 5.154e-05 [graph_reusing]: 4.40999e-06 [pre_auto_parallel]: 1.55001e-06 [py_interpret_to_execute]: 0.00027831 [rewriter_before_opt_a]: 7.465e-05 [expand_dump_flag]: 2.21e-06 [jit_opt_a]: 0.0319998, [2] [Cycle 1]: 0.0036737, [27] [switch_simplify]: 6.967e-05 [loop_unroll]: 3.262e-05 [a_1]: 0.00066733 [with_stream_mark]: 2.396e-05 [recompute_prepare]: 9.72999e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.84999e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 1.088e-05 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 1.121e-05 [inline_without_move]: 6.81999e-06 [renormalize]: 0.00249807 [add_forward_monad_depend]: 7.31001e-06 [auto_monad_grad]: 3.25002e-06 [auto_monad_eliminator]: 1.787e-05 [cse]: 3.171e-05 [replace_applicator]: 1.664e-05 [Cycle 2]: 0.00037026, [27] [switch_simplify]: 6.67002e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.0001248 [with_stream_mark]: 1.309e-05 [recompute_prepare]: 5.86998e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 2.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 9.21998e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.12e-05 [replace_applicator]: 5.68002e-06 [py_interpret_to_execute_after_opt_a]: 1.314e-05 [rewriter_after_opt_a]: 3.894e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00069412 [jit_opt_b]: 5.551e-05, [1] [Cycle 1]: 4.816e-05, [2] [frontend_op_eliminate]: 1.908e-05 [inline_after_opt_a]: 1.801e-05 [cconv]: 2.859e-05 [loop_unroll]: 0.00247836 [jit_opt_after_cconv]: 0.00015787, [1] [Cycle 1]: 0.0001515, [11] [c_1]: 2.776e-05 [parameter_eliminate]: 3.15002e-06 [updatestate_depend_eliminate]: 7.10998e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.209e-05 [call_graph_tuple_transform]: 2.278e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 6.64001e-06 [remove_dup_value]: 1.544e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 9.44e-06 [add_recomputation]: 5.24e-05 [cse_after_recomputation]: 2.11e-05, [1] [Cycle 1]: 1.606e-05, [1] [cse]: 1.047e-05 [auto_monad_reorder]: 1.484e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.37001e-06 [opt_after_jit_grad]: 0.00048633 [symbol_engine_optimizer]: 7.44e-05, [1] [Cycle 1]: 6.853e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 6.69999e-06 [fold_const_symbol]: 9.45001e-06 [renormalize]: 3.10014e-07 [validate]: 4.728e-05 Sums bootstrap : 0.000314s : 0.34% type_inference : 0.084230s : 90.76% event_method : 0.000019s : 0.02% auto_monad : 0.000052s : 0.06% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000278s : 0.30% rewriter_before_opt_a : 0.000075s : 0.08% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.08% jit_opt_a.loop_unroll : 0.000038s : 0.04% jit_opt_a.a_1 : 0.000792s : 0.85% jit_opt_a.with_stream_mark : 0.000037s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002498s : 2.69% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000043s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000694s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.002478s : 2.67% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000486s : 0.52% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.05% Time group info: ------[substitution.] 0.000266 24 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000007s : 4: substitution.graph_param_transform 85.40% : 0.000227s : 4: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000006s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 5.11% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.084145 2 95.64% : 0.080479s : 1: type_inference.infer 4.36% : 0.003666s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.77% : 0.000054s : 4: replace.inline 32.23% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 94.77% : 0.000225s : 4: match.inline 5.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.35% : 0.000002s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.30% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 6.19% : 0.000009s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.79% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.81% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000002s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.46% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002406 26 71.53% : 0.001721s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.39% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.08% : 0.000628s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124977 72 0.04% : 0.000055s : 1: add_recomputation 0.04% : 0.000055s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.26% : 0.000330s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 25.61% : 0.032004s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 1.99% : 0.002489s : 1: loop_unroll 0.56% : 0.000703s : 1: mutable_eliminate 0.84% : 0.001046s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.23% : 0.000284s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.41% : 0.001762s : 1: renormalize.infer 0.58% : 0.000726s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000080s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 67.41% : 0.084244s : 1: type_inference TotalTime = 0.0410864, [30] [bootstrap]: 0.00026372 [type_inference]: 0.0168262 [event_method]: 6.651e-05 [auto_monad]: 0.0001062 [graph_reusing]: 7.71999e-06 [pre_auto_parallel]: 3.14001e-06 [py_interpret_to_execute]: 3.275e-05 [rewriter_before_opt_a]: 0.0001309 [expand_dump_flag]: 4.03999e-06 [jit_opt_a]: 0.0213096, [3] [Cycle 1]: 0.0137194, [27] [switch_simplify]: 7.817e-05 [loop_unroll]: 4.722e-05 [a_1]: 0.00103345 [with_stream_mark]: 3.268e-05 [recompute_prepare]: 2.13e-05 [updatestate_depend_eliminate]: 8.87e-06 [updatestate_assign_eliminate]: 7.68999e-06 [updatestate_loads_eliminate]: 7.21001e-06 [parameter_eliminate]: 3.01001e-06 [specialize_transform]: 1.556e-05 [updatestate_useless_node_eliminater]: 1.338e-05 [accelerated_algorithm]: 1.332e-05 [meta_shard_fg_expand]: 4.30999e-06 [get_grad_eliminate_]: 1.346e-05 [merge_forward]: 1e-05 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.93e-05 [j_node_and_user_rematch]: 2.48e-05 [meta_fg_expand]: 0.0019358 [replace_old_param]: 6.896e-05 [inline_without_move]: 5.91e-05 [renormalize]: 0.00960912 [add_forward_monad_depend]: 1.436e-05 [auto_monad_grad]: 6.43e-06 [auto_monad_eliminator]: 6.573e-05 [cse]: 0.00024884 [replace_applicator]: 8.877e-05 [Cycle 2]: 0.00365777, [27] [switch_simplify]: 4.051e-05 [loop_unroll]: 3.939e-05 [a_1]: 0.00114558 [with_stream_mark]: 1.782e-05 [recompute_prepare]: 9.59999e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 3.98999e-06 [updatestate_loads_eliminate]: 3.8e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 7.88001e-06 [updatestate_useless_node_eliminater]: 6.58e-06 [accelerated_algorithm]: 6.95998e-06 [meta_shard_fg_expand]: 2.66999e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.682e-05 [j_node_and_user_rematch]: 8.232e-05 [meta_fg_expand]: 0.00013394 [replace_old_param]: 9.99999e-06 [inline_without_move]: 7.13e-06 [renormalize]: 0.00185625 [add_forward_monad_depend]: 7.5e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.316e-05 [cse]: 2.522e-05 [replace_applicator]: 1.526e-05 [Cycle 3]: 0.00025964, [27] [switch_simplify]: 4.42998e-06 [loop_unroll]: 3.43e-06 [a_1]: 4.353e-05 [with_stream_mark]: 1.066e-05 [recompute_prepare]: 3.71999e-06 [updatestate_depend_eliminate]: 2.44999e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 1.60999e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 3.7e-06 [updatestate_useless_node_eliminater]: 3.45e-06 [accelerated_algorithm]: 3.3e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 3.05002e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 2.69001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.151e-05 [j_node_and_user_rematch]: 6.07001e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 3.3e-06 [inline_without_move]: 3.18e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 3.09999e-06 [cse]: 9.54e-06 [replace_applicator]: 3.81001e-06 [py_interpret_to_execute_after_opt_a]: 1.146e-05 [rewriter_after_opt_a]: 3.657e-05 [convert_after_rewriter]: 6.45002e-06 [order_py_execute_after_rewriter]: 4.2e-06 [mutable_eliminate]: 0.00073244 [jit_opt_b]: 4.257e-05, [1] [Cycle 1]: 3.468e-05, [2] [frontend_op_eliminate]: 1.092e-05 [inline_after_opt_a]: 1.178e-05 [cconv]: 2.632e-05 [loop_unroll]: 0.00041363 [jit_opt_after_cconv]: 0.00012734, [1] [Cycle 1]: 0.00012043, [11] [c_1]: 1.307e-05 [parameter_eliminate]: 3.51001e-06 [updatestate_depend_eliminate]: 5.42999e-06 [updatestate_assign_eliminate]: 1.69998e-06 [updatestate_loads_eliminate]: 1.49e-06 [cse]: 1.826e-05 [call_graph_tuple_transform]: 1.441e-05 [tuple_list_get_item_eliminator]: 3.56001e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 3.3e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 4.79e-06 [add_recomputation]: 7.267e-05 [cse_after_recomputation]: 2.286e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 9.83998e-06 [auto_monad_reorder]: 1.516e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.72001e-06 [opt_after_jit_grad]: 0.00047212 [symbol_engine_optimizer]: 7.235e-05, [1] [Cycle 1]: 6.524e-05, [6] [build]: 3.96001e-06 [elim_shapecalc]: 6.70998e-06 [elim_not_effective]: 1.149e-05 [opt_reshape]: 4.79e-06 [fold_const_symbol]: 7.31001e-06 [renormalize]: 4.30009e-07 [validate]: 3.771e-05 Sums bootstrap : 0.000264s : 0.72% type_inference : 0.016826s : 46.09% event_method : 0.000067s : 0.18% auto_monad : 0.000106s : 0.29% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000033s : 0.09% rewriter_before_opt_a : 0.000131s : 0.36% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000123s : 0.34% jit_opt_a.loop_unroll : 0.000090s : 0.25% jit_opt_a.a_1 : 0.002223s : 6.09% jit_opt_a.with_stream_mark : 0.000061s : 0.17% jit_opt_a.recompute_prepare : 0.000035s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000027s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.06% jit_opt_a.accelerated_algorithm : 0.000024s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000018s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000113s : 0.31% jit_opt_a.meta_fg_expand : 0.002071s : 5.67% jit_opt_a.replace_old_param : 0.000082s : 0.23% jit_opt_a.inline_without_move : 0.000069s : 0.19% jit_opt_a.renormalize : 0.011465s : 31.40% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.22% jit_opt_a.cse : 0.000284s : 0.78% jit_opt_a.replace_applicator : 0.000108s : 0.30% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000732s : 2.01% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.03% jit_opt_b.inline_after_opt_a : 0.000012s : 0.03% cconv : 0.000026s : 0.07% loop_unroll : 0.000414s : 1.13% jit_opt_after_cconv.c_1 : 0.000013s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000073s : 0.20% cse_after_recomputation.cse : 0.000010s : 0.03% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000472s : 1.29% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.10% Time group info: ------[substitution.] 0.000670 104 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.71% : 0.000005s : 1: substitution.graph_param_transform 60.26% : 0.000404s : 13: substitution.inline 2.60% : 0.000017s : 2: substitution.inline_without_move 11.54% : 0.000077s : 12: substitution.j_node_and_user_rematch 1.81% : 0.000012s : 7: substitution.minmaximum_grad 1.12% : 0.000007s : 5: substitution.partial_eliminate 1.55% : 0.000010s : 12: substitution.remove_not_recompute_node 5.12% : 0.000034s : 10: substitution.replace_applicator 1.04% : 0.000007s : 10: substitution.replace_old_param 0.52% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.88% : 0.000006s : 1: substitution.tile_eliminate 3.44% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.39% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.62% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016731 2 89.82% : 0.015028s : 1: type_inference.infer 10.18% : 0.001702s : 1: type_inference.specialize ------[replace.] 0.000191 20 65.20% : 0.000125s : 13: replace.inline 34.80% : 0.000067s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000417 20 94.83% : 0.000396s : 13: match.inline 5.17% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2433 1.48% : 0.000006s : 42: predicate.accumulaten_eliminater 0.36% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000005s : 42: predicate.addn_check_dump 1.59% : 0.000006s : 42: predicate.addn_zero_filter 2.08% : 0.000008s : 42: predicate.arithmetic_simplify 1.64% : 0.000006s : 42: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.52% : 0.000006s : 42: predicate.compare_switch_simplify 1.64% : 0.000006s : 42: predicate.depend_value_elim 1.42% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.66% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.64% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.12% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.54% : 0.000006s : 42: predicate.environ_get_add_eliminate 1.43% : 0.000005s : 42: predicate.environ_get_depend_swap 1.58% : 0.000006s : 42: predicate.environ_get_eliminate 1.45% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.72% : 0.000003s : 16: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.28% : 0.000016s : 64: predicate.inline 1.91% : 0.000007s : 44: predicate.inline_without_move 0.34% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.94% : 0.000004s : 16: predicate.less_batch_normalization 1.89% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 50: predicate.load_eliminater 0.34% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.46% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.68% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.40% : 0.000005s : 42: predicate.merge_addn 1.57% : 0.000006s : 42: predicate.minmaximum_grad 0.39% : 0.000001s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.33% : 0.000009s : 50: predicate.partial_eliminate 1.49% : 0.000006s : 42: predicate.print_const_string_wrapper 1.97% : 0.000007s : 42: predicate.reduce_eliminate 1.99% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 16: predicate.remove_not_recompute_node 2.62% : 0.000010s : 90: predicate.replace_applicator 1.26% : 0.000005s : 44: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.69% : 0.000006s : 42: predicate.reshape_eliminate 1.54% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 1: predicate.row_tensor_eliminate 1.65% : 0.000006s : 42: predicate.same_eliminate 0.41% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.30% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 16: predicate.specialize_transform 1.82% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.70% : 0.000010s : 62: predicate.switch_defer_inline 2.54% : 0.000010s : 62: predicate.switch_layer_defer_inline 6.51% : 0.000024s : 150: predicate.switch_simplify 1.70% : 0.000006s : 42: predicate.tile_eliminate 1.55% : 0.000006s : 42: predicate.transpose_eliminate 2.16% : 0.000008s : 42: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.06% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.78% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.71% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.95% : 0.000007s : 42: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002681 36 60.36% : 0.001618s : 19: func_graph_cloner_run.FuncGraphClonerGraph 39.64% : 0.001063s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055481 87 0.14% : 0.000076s : 1: add_recomputation 0.20% : 0.000111s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.52% : 0.000288s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.13% : 0.000072s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 38.41% : 0.021313s : 1: jit_opt_a 0.23% : 0.000130s : 1: jit_opt_after_cconv 0.08% : 0.000045s : 1: jit_opt_b 0.76% : 0.000421s : 1: loop_unroll 1.34% : 0.000742s : 1: mutable_eliminate 5.31% : 0.002946s : 39: opt.transform.jit_opt_a 0.06% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000011s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.06% : 0.000036s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 16.30% : 0.009043s : 2: renormalize.infer 4.33% : 0.002400s : 2: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000040s : 1: rewriter_after_opt_a 0.24% : 0.000135s : 1: rewriter_before_opt_a 0.14% : 0.000075s : 1: symbol_engine_optimizer 30.37% : 0.016848s : 1: type_inference .[WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.987.998 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d0d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:24.988.726 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. . TotalTime = 0.0579688, [30] [bootstrap]: 0.00043687 [type_inference]: 0.0488838 [event_method]: 2.256e-05 [auto_monad]: 6.945e-05 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 9.582e-05 [rewriter_before_opt_a]: 8.041e-05 [expand_dump_flag]: 3.45998e-06 [jit_opt_a]: 0.00615733, [2] [Cycle 1]: 0.00211313, [27] [switch_simplify]: 5.93e-05 [loop_unroll]: 2.949e-05 [a_1]: 0.00056312 [with_stream_mark]: 2.418e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 4.34002e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 1.22e-05 [updatestate_useless_node_eliminater]: 6.51999e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.686e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 5.54e-06 [renormalize]: 0.00097435 [add_forward_monad_depend]: 3.484e-05 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.724e-05 [cse]: 3.613e-05 [replace_applicator]: 1.393e-05 [Cycle 2]: 0.00031694, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 4.85999e-06 [a_1]: 8.748e-05 [with_stream_mark]: 1.17e-05 [recompute_prepare]: 4.84e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 4.84998e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.59998e-06 [cse]: 1.272e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.471e-05 [rewriter_after_opt_a]: 3.919e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00060305 [jit_opt_b]: 4.836e-05, [1] [Cycle 1]: 4.169e-05, [2] [frontend_op_eliminate]: 1.505e-05 [inline_after_opt_a]: 1.552e-05 [cconv]: 3.069e-05 [loop_unroll]: 0.00041926 [jit_opt_after_cconv]: 0.00015059, [1] [Cycle 1]: 0.00014406, [11] [c_1]: 2.044e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 7.96001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.80002e-06 [cse]: 2.814e-05 [call_graph_tuple_transform]: 1.867e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.19998e-06 [remove_dup_value]: 1.64e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 5.93002e-06 [add_recomputation]: 5.265e-05 [cse_after_recomputation]: 2.306e-05, [1] [Cycle 1]: 1.798e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 2.52001e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00047033 [symbol_engine_optimizer]: 7.159e-05, [1] [Cycle 1]: 6.559e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 7.38999e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.46002e-06 [renormalize]: 7.79983e-07 [validate]: 4.259e-05 Sums bootstrap : 0.000437s : 0.82% type_inference : 0.048884s : 91.23% event_method : 0.000023s : 0.04% auto_monad : 0.000069s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000096s : 0.18% rewriter_before_opt_a : 0.000080s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.12% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000651s : 1.21% jit_opt_a.with_stream_mark : 0.000036s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000017s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000974s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000036s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000049s : 0.09% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000039s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000603s : 1.13% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000031s : 0.06% loop_unroll : 0.000419s : 0.78% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000470s : 0.88% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.08% Time group info: ------[substitution.] 0.000236 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 84.92% : 0.000201s : 4: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048809 2 97.11% : 0.047399s : 1: type_inference.infer 2.89% : 0.001410s : 1: type_inference.specialize ------[replace.] 0.000070 6 69.89% : 0.000049s : 4: replace.inline 30.11% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.36% : 0.000198s : 4: match.inline 5.64% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.22% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.28% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 1.41% : 0.000002s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.21% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000871 13 49.20% : 0.000429s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.93% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.87% : 0.000391s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059872 72 0.09% : 0.000055s : 1: add_recomputation 0.12% : 0.000073s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.77% : 0.000460s : 1: bootstrap 0.06% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.29% : 0.006160s : 1: jit_opt_a 0.26% : 0.000153s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.71% : 0.000427s : 1: loop_unroll 1.02% : 0.000614s : 1: mutable_eliminate 1.47% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000099s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.96% : 0.000572s : 1: renormalize.infer 0.66% : 0.000393s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000042s : 1: rewriter_after_opt_a 0.14% : 0.000084s : 1: rewriter_before_opt_a 0.12% : 0.000074s : 1: symbol_engine_optimizer 81.68% : 0.048903s : 1: type_inference TotalTime = 0.196644, [30] [bootstrap]: 0.00025491 [type_inference]: 0.179411 [event_method]: 0.00253927 [auto_monad]: 0.00017485 [graph_reusing]: 9.91e-06 [pre_auto_parallel]: 3.68e-06 [py_interpret_to_execute]: 6.003e-05 [rewriter_before_opt_a]: 0.00020638 [expand_dump_flag]: 3.95e-06 [jit_opt_a]: 0.0109259, [2] [Cycle 1]: 0.00593298, [27] [switch_simplify]: 0.00026168 [loop_unroll]: 6.71e-05 [a_1]: 0.00207981 [with_stream_mark]: 2.144e-05 [recompute_prepare]: 9.49999e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 3.09999e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 9.16002e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00311051 [add_forward_monad_depend]: 7.7e-06 [auto_monad_grad]: 2.17001e-06 [auto_monad_eliminator]: 1.669e-05 [cse]: 2.886e-05 [replace_applicator]: 1.944e-05 [Cycle 2]: 0.00035898, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.68002e-06 [a_1]: 0.00010905 [with_stream_mark]: 1.207e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.18002e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.08002e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.55998e-06 [cell_reuse_recompute_pass]: 4.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 8.27003e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.11e-05 [replace_applicator]: 5.51e-06 [py_interpret_to_execute_after_opt_a]: 1.403e-05 [rewriter_after_opt_a]: 4.082e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00103157 [jit_opt_b]: 5.651e-05, [1] [Cycle 1]: 4.747e-05, [2] [frontend_op_eliminate]: 1.975e-05 [inline_after_opt_a]: 1.602e-05 [cconv]: 4.697e-05 [loop_unroll]: 0.00050946 [jit_opt_after_cconv]: 0.00015408, [1] [Cycle 1]: 0.00014659, [11] [c_1]: 2.286e-05 [parameter_eliminate]: 3.39001e-06 [updatestate_depend_eliminate]: 6.33e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 2.428e-05 [call_graph_tuple_transform]: 2.055e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.50001e-06 [remove_dup_value]: 1.503e-05 [partial_unused_args_eliminate]: 2.55002e-06 [environ_conv]: 4.90001e-06 [add_recomputation]: 5.485e-05 [cse_after_recomputation]: 2.524e-05, [1] [Cycle 1]: 1.946e-05, [1] [cse]: 1.27e-05 [auto_monad_reorder]: 1.494e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 6.34999e-06 [opt_after_jit_grad]: 0.00050647 [symbol_engine_optimizer]: 7.884e-05, [1] [Cycle 1]: 7.204e-05, [6] [build]: 4.51002e-06 [elim_shapecalc]: 8.98002e-06 [elim_not_effective]: 1.509e-05 [opt_reshape]: 5.61003e-06 [fold_const_symbol]: 9.26998e-06 [renormalize]: 7.00005e-07 [validate]: 8.902e-05 Sums bootstrap : 0.000255s : 0.13% type_inference : 0.179411s : 93.85% event_method : 0.002539s : 1.33% auto_monad : 0.000175s : 0.09% graph_reusing : 0.000010s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000060s : 0.03% rewriter_before_opt_a : 0.000206s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000268s : 0.14% jit_opt_a.loop_unroll : 0.000073s : 0.04% jit_opt_a.a_1 : 0.002189s : 1.15% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003111s : 1.63% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000040s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001032s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000047s : 0.02% loop_unroll : 0.000509s : 0.27% jit_opt_after_cconv.c_1 : 0.000023s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000055s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000506s : 0.26% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000089s : 0.05% Time group info: ------[substitution.] 0.000935 56 0.23% : 0.000002s : 2: substitution.elim_not_effective 0.12% : 0.000001s : 2: substitution.fold_const_symbol 0.62% : 0.000006s : 3: substitution.graph_param_transform 88.61% : 0.000828s : 15: substitution.inline 0.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.88% : 0.000008s : 4: substitution.minmaximum_grad 0.57% : 0.000005s : 4: substitution.remove_not_recompute_node 0.53% : 0.000005s : 2: substitution.replace_old_param 1.97% : 0.000018s : 4: substitution.switch_simplify 1.56% : 0.000015s : 4: substitution.tuple_list_convert_item_index_to_positive 1.27% : 0.000012s : 4: substitution.tuple_list_get_item_depend_reorder 3.29% : 0.000031s : 8: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.179272 2 94.86% : 0.170049s : 1: type_inference.infer 5.14% : 0.009223s : 1: type_inference.specialize ------[replace.] 0.000533 23 47.42% : 0.000253s : 15: replace.inline 16.69% : 0.000089s : 4: replace.switch_simplify 35.89% : 0.000191s : 4: replace.tuple_list_get_item_eliminator ------[match.] 0.000848 23 96.67% : 0.000820s : 15: match.inline 1.92% : 0.000016s : 4: match.switch_simplify 1.40% : 0.000012s : 4: match.tuple_list_get_item_eliminator ------[predicate.] 0.000236 1341 1.61% : 0.000004s : 21: predicate.accumulaten_eliminater 0.63% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000003s : 21: predicate.addn_check_dump 1.46% : 0.000003s : 21: predicate.addn_zero_filter 2.20% : 0.000005s : 21: predicate.arithmetic_simplify 1.73% : 0.000004s : 21: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 1.30% : 0.000003s : 21: predicate.compare_switch_simplify 1.21% : 0.000003s : 21: predicate.depend_value_elim 1.18% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.50% : 0.000004s : 21: predicate.dict_get_item_eliminator 1.61% : 0.000004s : 21: predicate.dict_set_item_eliminator 0.48% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.20% : 0.000000s : 3: predicate.elim_not_effective 0.34% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.20% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.19% : 0.000003s : 21: predicate.environ_get_depend_swap 1.47% : 0.000003s : 21: predicate.environ_get_eliminate 1.32% : 0.000003s : 21: predicate.environ_get_set_eliminate 0.11% : 0.000000s : 3: predicate.fold_const_symbol 0.80% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000013s : 46: predicate.inline 0.42% : 0.000001s : 6: predicate.inline_without_move 0.19% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000004s : 25: predicate.list_to_tuple_eliminator_ 1.71% : 0.000004s : 28: predicate.load_eliminater 0.80% : 0.000002s : 3: predicate.loop_unroll_after_grad 5.15% : 0.000012s : 78: predicate.loop_unroll_before_grad 1.75% : 0.000004s : 24: predicate.make_slice_get_slice_eliminator 1.24% : 0.000003s : 21: predicate.merge_addn 1.24% : 0.000003s : 21: predicate.minmaximum_grad 0.92% : 0.000002s : 3: predicate.mutable_eliminate 0.33% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000005s : 28: predicate.partial_eliminate 1.27% : 0.000003s : 21: predicate.print_const_string_wrapper 1.94% : 0.000005s : 21: predicate.reduce_eliminate 1.74% : 0.000004s : 25: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000004s : 31: predicate.replace_applicator 0.35% : 0.000001s : 6: predicate.replace_old_param 0.14% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000003s : 21: predicate.reshape_eliminate 1.88% : 0.000004s : 21: predicate.row_tensor_add_zeros_like 0.47% : 0.000001s : 3: predicate.row_tensor_eliminate 1.52% : 0.000004s : 21: predicate.same_eliminate 0.29% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.61% : 0.000001s : 6: predicate.special_op_eliminate 0.47% : 0.000001s : 6: predicate.specialize_transform 1.71% : 0.000004s : 21: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.22% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.31% : 0.000008s : 40: predicate.switch_defer_inline 2.65% : 0.000006s : 40: predicate.switch_layer_defer_inline 8.98% : 0.000021s : 129: predicate.switch_simplify 1.40% : 0.000003s : 21: predicate.tile_eliminate 1.37% : 0.000003s : 21: predicate.transpose_eliminate 1.85% : 0.000004s : 21: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000009s : 31: predicate.tuple_list_get_item_eliminator 1.73% : 0.000004s : 21: predicate.tuple_list_set_item_eliminator 1.50% : 0.000004s : 25: predicate.tuple_to_list_eliminator_ 1.62% : 0.000004s : 28: predicate.updatestate_pure_node_eliminater 2.44% : 0.000006s : 34: predicate.updatestate_useless_node_eliminater 1.61% : 0.000004s : 21: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004788 38 51.20% : 0.002451s : 15: func_graph_cloner_run.FuncGraphClonerGraph 10.15% : 0.000486s : 6: func_graph_cloner_run.FuncGraphClonerNode 38.65% : 0.001850s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.202250 72 0.03% : 0.000058s : 1: add_recomputation 0.09% : 0.000184s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.13% : 0.000271s : 1: bootstrap 0.03% : 0.000051s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 1.27% : 0.002559s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 5.40% : 0.010931s : 1: jit_opt_a 0.08% : 0.000158s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.26% : 0.000519s : 1: loop_unroll 0.52% : 0.001043s : 1: mutable_eliminate 1.31% : 0.002658s : 26: opt.transform.jit_opt_a 0.03% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000516s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000063s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.13% : 0.002284s : 1: renormalize.infer 0.40% : 0.000813s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.10% : 0.000209s : 1: rewriter_before_opt_a 0.04% : 0.000081s : 1: symbol_engine_optimizer 88.72% : 0.179436s : 1: type_inference TotalTime = 0.152982, [30] [bootstrap]: 0.00025861 [type_inference]: 0.123133 [event_method]: 0.00058266 [auto_monad]: 0.0001157 [graph_reusing]: 7.06001e-06 [pre_auto_parallel]: 3.75e-06 [py_interpret_to_execute]: 9.237e-05 [rewriter_before_opt_a]: 0.00016378 [expand_dump_flag]: 3.25998e-06 [jit_opt_a]: 0.0261485, [3] [Cycle 1]: 0.0180315, [27] [switch_simplify]: 7.922e-05 [loop_unroll]: 4.436e-05 [a_1]: 0.0011013 [with_stream_mark]: 3.856e-05 [recompute_prepare]: 2.358e-05 [updatestate_depend_eliminate]: 9.80002e-06 [updatestate_assign_eliminate]: 7.46999e-06 [updatestate_loads_eliminate]: 7.98001e-06 [parameter_eliminate]: 3.04001e-06 [specialize_transform]: 1.497e-05 [updatestate_useless_node_eliminater]: 1.413e-05 [accelerated_algorithm]: 1.367e-05 [meta_shard_fg_expand]: 5.15999e-06 [get_grad_eliminate_]: 1.35e-05 [merge_forward]: 1.004e-05 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.883e-05 [j_node_and_user_rematch]: 2.494e-05 [meta_fg_expand]: 0.00201821 [replace_old_param]: 7.071e-05 [inline_without_move]: 6.477e-05 [renormalize]: 0.0137251 [add_forward_monad_depend]: 1.232e-05 [auto_monad_grad]: 6.41e-06 [auto_monad_eliminator]: 6.049e-05 [cse]: 0.00027531 [replace_applicator]: 9.164e-05 [Cycle 2]: 0.00387405, [27] [switch_simplify]: 4.42e-05 [loop_unroll]: 4.277e-05 [a_1]: 0.00118154 [with_stream_mark]: 1.641e-05 [recompute_prepare]: 9.08002e-06 [updatestate_depend_eliminate]: 4.99e-06 [updatestate_assign_eliminate]: 4.46002e-06 [updatestate_loads_eliminate]: 3.9e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 6.33998e-06 [accelerated_algorithm]: 7.11999e-06 [meta_shard_fg_expand]: 3.28e-06 [get_grad_eliminate_]: 6.59001e-06 [merge_forward]: 4.14997e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 0.00012329 [replace_old_param]: 8.82e-06 [inline_without_move]: 7.10998e-06 [renormalize]: 0.00213132 [add_forward_monad_depend]: 6.99001e-06 [auto_monad_grad]: 1.81998e-06 [auto_monad_eliminator]: 1.295e-05 [cse]: 2.226e-05 [replace_applicator]: 1.506e-05 [Cycle 3]: 0.00028575, [27] [switch_simplify]: 5.25001e-06 [loop_unroll]: 4.33001e-06 [a_1]: 5.514e-05 [with_stream_mark]: 1.076e-05 [recompute_prepare]: 3.83999e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 1.64e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 3.77998e-06 [updatestate_useless_node_eliminater]: 3.42002e-06 [accelerated_algorithm]: 4.12e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 3.85998e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 3.3e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 6.40002e-06 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 3.20002e-06 [inline_without_move]: 3.34001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 4.52e-06 [cse]: 8.89e-06 [replace_applicator]: 3.98999e-06 [py_interpret_to_execute_after_opt_a]: 1.037e-05 [rewriter_after_opt_a]: 3.559e-05 [convert_after_rewriter]: 6.80998e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00070827 [jit_opt_b]: 4.265e-05, [1] [Cycle 1]: 3.54e-05, [2] [frontend_op_eliminate]: 1.1e-05 [inline_after_opt_a]: 1.229e-05 [cconv]: 2.662e-05 [loop_unroll]: 0.00046731 [jit_opt_after_cconv]: 0.00014722, [1] [Cycle 1]: 0.00013953, [11] [c_1]: 1.487e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 1.84e-06 [cse]: 2.198e-05 [call_graph_tuple_transform]: 1.695e-05 [tuple_list_get_item_eliminator]: 4.55001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 1.90019e-07 [switch_simplify]: 4.43999e-06 [remove_dup_value]: 1.456e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 6.17999e-06 [add_recomputation]: 4.511e-05 [cse_after_recomputation]: 2.102e-05, [1] [Cycle 1]: 1.49e-05, [1] [cse]: 8.15e-06 [auto_monad_reorder]: 1.467e-05 [get_jit_bprop_graph]: 1.67999e-06 [rewriter_after_jit_bprop_graph]: 6.59999e-06 [opt_after_jit_grad]: 0.00051521 [symbol_engine_optimizer]: 0.00012838, [1] [Cycle 1]: 6.539e-05, [6] [build]: 4.99e-06 [elim_shapecalc]: 6.56999e-06 [elim_not_effective]: 1.002e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 6.21e-06 [renormalize]: 3.4002e-07 [validate]: 4.161e-05 Sums bootstrap : 0.000259s : 0.17% type_inference : 0.123133s : 83.18% event_method : 0.000583s : 0.39% auto_monad : 0.000116s : 0.08% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000092s : 0.06% rewriter_before_opt_a : 0.000164s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.09% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002338s : 1.58% jit_opt_a.with_stream_mark : 0.000066s : 0.04% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.002144s : 1.45% jit_opt_a.replace_old_param : 0.000083s : 0.06% jit_opt_a.inline_without_move : 0.000075s : 0.05% jit_opt_a.renormalize : 0.015857s : 10.71% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000078s : 0.05% jit_opt_a.cse : 0.000306s : 0.21% jit_opt_a.replace_applicator : 0.000111s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000708s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000467s : 0.32% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000045s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000515s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000655 104 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.13% : 0.000001s : 1: substitution.fold_const_symbol 0.77% : 0.000005s : 1: substitution.graph_param_transform 68.31% : 0.000447s : 13: substitution.inline 3.07% : 0.000020s : 2: substitution.inline_without_move 1.43% : 0.000009s : 12: substitution.j_node_and_user_rematch 1.99% : 0.000013s : 7: substitution.minmaximum_grad 1.34% : 0.000009s : 5: substitution.partial_eliminate 1.74% : 0.000011s : 12: substitution.remove_not_recompute_node 5.15% : 0.000034s : 10: substitution.replace_applicator 1.06% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.90% : 0.000006s : 1: substitution.tile_eliminate 4.02% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.58% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.83% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123018 2 96.84% : 0.119129s : 1: type_inference.infer 3.16% : 0.003889s : 1: type_inference.specialize ------[replace.] 0.000202 20 66.48% : 0.000135s : 13: replace.inline 33.52% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000462 20 95.04% : 0.000439s : 13: match.inline 4.96% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000390 2544 1.48% : 0.000006s : 44: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000005s : 44: predicate.addn_check_dump 1.81% : 0.000007s : 44: predicate.addn_zero_filter 2.14% : 0.000008s : 44: predicate.arithmetic_simplify 1.77% : 0.000007s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.35% : 0.000005s : 44: predicate.compare_switch_simplify 1.54% : 0.000006s : 44: predicate.depend_value_elim 1.37% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.20% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.37% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.47% : 0.000006s : 44: predicate.environ_get_depend_swap 2.00% : 0.000008s : 44: predicate.environ_get_eliminate 1.37% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.88% : 0.000003s : 17: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.32% : 0.000017s : 66: predicate.inline 1.91% : 0.000007s : 45: predicate.inline_without_move 0.35% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 17: predicate.less_batch_normalization 1.90% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 2.19% : 0.000009s : 52: predicate.load_eliminater 0.37% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.32% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.83% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 44: predicate.merge_addn 1.41% : 0.000005s : 44: predicate.minmaximum_grad 0.31% : 0.000001s : 1: predicate.mutable_eliminate 0.20% : 0.000001s : 1: predicate.opt_reshape 2.22% : 0.000009s : 52: predicate.partial_eliminate 1.59% : 0.000006s : 44: predicate.print_const_string_wrapper 2.31% : 0.000009s : 44: predicate.reduce_eliminate 1.75% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000002s : 17: predicate.remove_not_recompute_node 2.70% : 0.000011s : 96: predicate.replace_applicator 1.13% : 0.000004s : 45: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.41% : 0.000005s : 44: predicate.reshape_eliminate 1.44% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.12% : 0.000000s : 1: predicate.row_tensor_eliminate 1.57% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.73% : 0.000003s : 17: predicate.specialize_transform 1.93% : 0.000008s : 44: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.85% : 0.000011s : 64: predicate.switch_defer_inline 2.44% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.55% : 0.000026s : 157: predicate.switch_simplify 1.51% : 0.000006s : 44: predicate.tile_eliminate 1.58% : 0.000006s : 44: predicate.transpose_eliminate 1.85% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.80% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.78% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.89% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.83% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.78% : 0.000011s : 69: predicate.updatestate_useless_node_eliminater 1.90% : 0.000007s : 44: predicate.value_based_eliminate 0.12% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.07% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004036 45 72.50% : 0.002926s : 28: func_graph_cloner_run.FuncGraphClonerGraph 27.50% : 0.001110s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.171841 87 0.03% : 0.000048s : 1: add_recomputation 0.07% : 0.000123s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.17% : 0.000286s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.35% : 0.000593s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.22% : 0.026152s : 1: jit_opt_a 0.09% : 0.000150s : 1: jit_opt_after_cconv 0.03% : 0.000045s : 1: jit_opt_b 0.28% : 0.000475s : 1: loop_unroll 0.42% : 0.000717s : 1: mutable_eliminate 1.75% : 0.003012s : 39: opt.transform.jit_opt_a 0.02% : 0.000037s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000524s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000096s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.64% : 0.013136s : 2: renormalize.infer 1.57% : 0.002699s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.10% : 0.000169s : 1: rewriter_before_opt_a 0.08% : 0.000131s : 1: symbol_engine_optimizer 71.67% : 0.123164s : 1: type_inference TotalTime = 0.0172598, [30] [bootstrap]: 0.00037368 [type_inference]: 0.00658902 [event_method]: 2.13e-05 [auto_monad]: 7.766e-05 [graph_reusing]: 6.43003e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 7.488e-05 [rewriter_before_opt_a]: 8.403e-05 [expand_dump_flag]: 2.78998e-06 [jit_opt_a]: 0.00770104, [2] [Cycle 1]: 0.0027326, [27] [switch_simplify]: 6.277e-05 [loop_unroll]: 3.328e-05 [a_1]: 0.00063856 [with_stream_mark]: 2.025e-05 [recompute_prepare]: 7.82e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 4.27998e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.402e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00162658 [add_forward_monad_depend]: 6.96001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.777e-05 [cse]: 3.488e-05 [replace_applicator]: 1.504e-05 [Cycle 2]: 0.000329, [27] [switch_simplify]: 6.35002e-06 [loop_unroll]: 5.52001e-06 [a_1]: 9.426e-05 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.96998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.81003e-06 [replace_old_param]: 7.36999e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.296e-05 [replace_applicator]: 5.26998e-06 [py_interpret_to_execute_after_opt_a]: 1.386e-05 [rewriter_after_opt_a]: 4.043e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00066601 [jit_opt_b]: 5.113e-05, [1] [Cycle 1]: 4.473e-05, [2] [frontend_op_eliminate]: 1.786e-05 [inline_after_opt_a]: 1.612e-05 [cconv]: 2.541e-05 [loop_unroll]: 0.00043671 [jit_opt_after_cconv]: 0.00014621, [1] [Cycle 1]: 0.00013925, [11] [c_1]: 2.105e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.98998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.325e-05 [call_graph_tuple_transform]: 2.023e-05 [tuple_list_get_item_eliminator]: 5.19003e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.61998e-06 [remove_dup_value]: 1.594e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 8.98002e-06 [add_recomputation]: 4.878e-05 [cse_after_recomputation]: 2.503e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.261e-05 [auto_monad_reorder]: 1.553e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.59998e-06 [opt_after_jit_grad]: 0.00047736 [symbol_engine_optimizer]: 0.00010586, [1] [Cycle 1]: 9.962e-05, [6] [build]: 1.061e-05 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 3.458e-05 [renormalize]: 4.00003e-07 [validate]: 4.707e-05 Sums bootstrap : 0.000374s : 3.11% type_inference : 0.006589s : 54.76% event_method : 0.000021s : 0.18% auto_monad : 0.000078s : 0.65% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000075s : 0.62% rewriter_before_opt_a : 0.000084s : 0.70% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.57% jit_opt_a.loop_unroll : 0.000039s : 0.32% jit_opt_a.a_1 : 0.000733s : 6.09% jit_opt_a.with_stream_mark : 0.000031s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001627s : 13.52% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.20% jit_opt_a.cse : 0.000048s : 0.40% jit_opt_a.replace_applicator : 0.000020s : 0.17% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000040s : 0.34% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000666s : 5.53% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000025s : 0.21% loop_unroll : 0.000437s : 3.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.07% add_recomputation : 0.000049s : 0.41% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000016s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000477s : 3.97% symbol_engine_optimizer.build : 0.000011s : 0.09% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000035s : 0.29% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.39% Time group info: ------[substitution.] 0.000268 23 0.99% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 3: substitution.graph_param_transform 86.51% : 0.000232s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000005s : 2: substitution.replace_old_param 4.71% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006510 2 76.14% : 0.004957s : 1: type_inference.infer 23.86% : 0.001554s : 1: type_inference.specialize ------[replace.] 0.000090 6 68.49% : 0.000062s : 4: replace.inline 31.51% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 95.27% : 0.000229s : 4: match.inline 4.73% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 2.21% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.24% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 4.99% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.72% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000002s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 2.45% : 0.000003s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.57% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000965 13 44.02% : 0.000425s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.59% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.39% : 0.000486s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019924 72 0.26% : 0.000051s : 1: add_recomputation 0.41% : 0.000082s : 1: auto_monad 0.09% : 0.000018s : 1: auto_monad_reorder 1.96% : 0.000391s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000011s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 38.68% : 0.007706s : 1: jit_opt_a 0.75% : 0.000149s : 1: jit_opt_after_cconv 0.27% : 0.000054s : 1: jit_opt_b 2.23% : 0.000445s : 1: loop_unroll 3.39% : 0.000675s : 1: mutable_eliminate 4.86% : 0.000968s : 26: opt.transform.jit_opt_a 0.25% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.29% : 0.000059s : 4: opt.transform.symbol_engine_opt 2.44% : 0.000486s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000078s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 3.88% : 0.000772s : 1: renormalize.infer 4.24% : 0.000844s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000044s : 1: rewriter_after_opt_a 0.44% : 0.000087s : 1: rewriter_before_opt_a 0.54% : 0.000108s : 1: symbol_engine_optimizer 33.14% : 0.006603s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.153.929 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.154.548 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0123041, [30] [bootstrap]: 0.00030546 [type_inference]: 0.00454524 [event_method]: 1.823e-05 [auto_monad]: 6.357e-05 [graph_reusing]: 5.88998e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 3.351e-05 [rewriter_before_opt_a]: 7.445e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00520429, [2] [Cycle 1]: 0.00163388, [27] [switch_simplify]: 5.378e-05 [loop_unroll]: 2.835e-05 [a_1]: 0.00053318 [with_stream_mark]: 2.166e-05 [recompute_prepare]: 7.15998e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 3.40003e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.437e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 5.12e-06 [renormalize]: 0.0006693 [add_forward_monad_depend]: 5.30999e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.437e-05 [cse]: 3.395e-05 [replace_applicator]: 1.178e-05 [Cycle 2]: 0.00031091, [27] [switch_simplify]: 5.74999e-06 [loop_unroll]: 4.90999e-06 [a_1]: 8.708e-05 [with_stream_mark]: 8.82e-06 [recompute_prepare]: 4.76002e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 4.89998e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 4.89e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 7.80998e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 6.98e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.39e-06 [cse]: 1.243e-05 [replace_applicator]: 5.14003e-06 [py_interpret_to_execute_after_opt_a]: 1.095e-05 [rewriter_after_opt_a]: 3.661e-05 [convert_after_rewriter]: 7.30003e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00051876 [jit_opt_b]: 4.686e-05, [1] [Cycle 1]: 4.051e-05, [2] [frontend_op_eliminate]: 1.494e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 2.582e-05 [loop_unroll]: 0.00040024 [jit_opt_after_cconv]: 0.00013713, [1] [Cycle 1]: 0.00013041, [11] [c_1]: 1.98e-05 [parameter_eliminate]: 2.17999e-06 [updatestate_depend_eliminate]: 5.65001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 1.942e-05 [call_graph_tuple_transform]: 1.74e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.639e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 6.57002e-06 [add_recomputation]: 5.018e-05 [cse_after_recomputation]: 2.387e-05, [1] [Cycle 1]: 1.844e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.856e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 4.41002e-06 [opt_after_jit_grad]: 0.00043846 [symbol_engine_optimizer]: 8.787e-05, [1] [Cycle 1]: 8.155e-05, [6] [build]: 3.67002e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.277e-05 [opt_reshape]: 2.023e-05 [fold_const_symbol]: 9.21002e-06 [renormalize]: 3.20026e-07 [validate]: 3.787e-05 Sums bootstrap : 0.000305s : 3.60% type_inference : 0.004545s : 53.62% event_method : 0.000018s : 0.22% auto_monad : 0.000064s : 0.75% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.40% rewriter_before_opt_a : 0.000074s : 0.88% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000060s : 0.70% jit_opt_a.loop_unroll : 0.000033s : 0.39% jit_opt_a.a_1 : 0.000620s : 7.32% jit_opt_a.with_stream_mark : 0.000030s : 0.36% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000669s : 7.90% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000046s : 0.55% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000037s : 0.43% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000519s : 6.12% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000026s : 0.30% loop_unroll : 0.000400s : 4.72% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000007s : 0.08% add_recomputation : 0.000050s : 0.59% cse_after_recomputation.cse : 0.000012s : 0.15% auto_monad_reorder : 0.000019s : 0.22% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000438s : 5.17% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000020s : 0.24% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.45% Time group info: ------[substitution.] 0.000212 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000005s : 3: substitution.graph_param_transform 83.85% : 0.000178s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 6.36% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004484 2 81.79% : 0.003667s : 1: type_inference.infer 18.21% : 0.000817s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.29% : 0.000045s : 4: replace.inline 31.71% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 93.40% : 0.000176s : 4: match.inline 6.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000001s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.10% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.37% : 0.000002s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.38% : 0.000002s : 10: predicate.print_const_string_wrapper 1.50% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.97% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000611 13 52.93% : 0.000323s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.79% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.28% : 0.000246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013865 72 0.38% : 0.000053s : 1: add_recomputation 0.48% : 0.000066s : 1: auto_monad 0.15% : 0.000021s : 1: auto_monad_reorder 2.33% : 0.000323s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.16% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.56% : 0.005207s : 1: jit_opt_a 1.06% : 0.000147s : 1: jit_opt_after_cconv 0.36% : 0.000049s : 1: jit_opt_b 2.94% : 0.000408s : 1: loop_unroll 3.80% : 0.000527s : 1: mutable_eliminate 5.96% : 0.000827s : 26: opt.transform.jit_opt_a 0.32% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.34% : 0.000046s : 4: opt.transform.symbol_engine_opt 3.22% : 0.000446s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000036s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000019s : 1: remove_dup_value 2.70% : 0.000375s : 1: renormalize.infer 2.07% : 0.000287s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000039s : 1: rewriter_after_opt_a 0.56% : 0.000077s : 1: rewriter_before_opt_a 0.65% : 0.000090s : 1: symbol_engine_optimizer 32.89% : 0.004560s : 1: type_inference TotalTime = 0.163159, [30] [bootstrap]: 0.00032947 [type_inference]: 0.153019 [event_method]: 2.022e-05 [auto_monad]: 6.684e-05 [graph_reusing]: 5.45001e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.0003163 [rewriter_before_opt_a]: 8.227e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00685162, [2] [Cycle 1]: 0.003128, [27] [switch_simplify]: 5.566e-05 [loop_unroll]: 3.011e-05 [a_1]: 0.00062931 [with_stream_mark]: 2.052e-05 [recompute_prepare]: 8.82e-06 [updatestate_depend_eliminate]: 4.34002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 0.00204492 [add_forward_monad_depend]: 6.46e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.794e-05 [cse]: 3.113e-05 [replace_applicator]: 1.856e-05 [Cycle 2]: 0.00035546, [27] [switch_simplify]: 6.60002e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00011656 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 5.93002e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.41002e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.56002e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.72998e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.087e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.189e-05 [rewriter_after_opt_a]: 3.901e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00062733 [jit_opt_b]: 0.00022518, [1] [Cycle 1]: 0.00021401, [2] [frontend_op_eliminate]: 1.809e-05 [inline_after_opt_a]: 2.018e-05 [cconv]: 2.957e-05 [loop_unroll]: 0.00044629 [jit_opt_after_cconv]: 0.00015122, [1] [Cycle 1]: 0.00014479, [11] [c_1]: 2.421e-05 [parameter_eliminate]: 3.15002e-06 [updatestate_depend_eliminate]: 6.39001e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 2.249e-05 [call_graph_tuple_transform]: 2.096e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.15002e-06 [remove_dup_value]: 1.535e-05 [partial_unused_args_eliminate]: 2.41998e-06 [environ_conv]: 9.44e-06 [add_recomputation]: 5.03e-05 [cse_after_recomputation]: 2.082e-05, [1] [Cycle 1]: 1.586e-05, [1] [cse]: 1.047e-05 [auto_monad_reorder]: 1.622e-05 [get_jit_bprop_graph]: 1.93002e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.0004774 [symbol_engine_optimizer]: 8.931e-05, [1] [Cycle 1]: 8.298e-05, [6] [build]: 3.71999e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 2.719e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 9.89999e-06 [renormalize]: 5.40022e-07 [validate]: 4.54e-05 Sums bootstrap : 0.000329s : 0.21% type_inference : 0.153019s : 96.21% event_method : 0.000020s : 0.01% auto_monad : 0.000067s : 0.04% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000316s : 0.20% rewriter_before_opt_a : 0.000082s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000746s : 0.47% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002045s : 1.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000627s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000446s : 0.28% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000477s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000288 24 5.02% : 0.000014s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000006s : 4: substitution.graph_param_transform 83.57% : 0.000241s : 4: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.30% : 0.000004s : 2: substitution.replace_old_param 4.37% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.152942 2 98.74% : 0.151021s : 1: type_inference.infer 1.26% : 0.001921s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.90% : 0.000048s : 4: replace.inline 32.10% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 6 95.41% : 0.000238s : 4: match.inline 4.59% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.15% : 0.000001s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.56% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.54% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.54% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.42% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000001s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.95% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002280 26 72.14% : 0.001645s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.03% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.83% : 0.000589s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.166255 72 0.03% : 0.000053s : 1: add_recomputation 0.04% : 0.000070s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.21% : 0.000349s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.12% : 0.006856s : 1: jit_opt_a 0.09% : 0.000154s : 1: jit_opt_after_cconv 0.14% : 0.000228s : 1: jit_opt_b 0.27% : 0.000454s : 1: loop_unroll 0.38% : 0.000635s : 1: mutable_eliminate 0.59% : 0.000976s : 26: opt.transform.jit_opt_a 0.03% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000486s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000324s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.83% : 0.001385s : 1: renormalize.infer 0.39% : 0.000650s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000087s : 1: rewriter_before_opt_a 0.06% : 0.000092s : 1: symbol_engine_optimizer 92.05% : 0.153037s : 1: type_inference TotalTime = 0.153727, [30] [bootstrap]: 0.00021883 [type_inference]: 0.124409 [event_method]: 0.00061017 [auto_monad]: 0.00011435 [graph_reusing]: 8.03999e-06 [pre_auto_parallel]: 3.48999e-06 [py_interpret_to_execute]: 5.267e-05 [rewriter_before_opt_a]: 0.00013387 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.0258429, [3] [Cycle 1]: 0.0176285, [27] [switch_simplify]: 8.284e-05 [loop_unroll]: 4.562e-05 [a_1]: 0.00110733 [with_stream_mark]: 3.805e-05 [recompute_prepare]: 2.319e-05 [updatestate_depend_eliminate]: 1.053e-05 [updatestate_assign_eliminate]: 6.96001e-06 [updatestate_loads_eliminate]: 7.11001e-06 [parameter_eliminate]: 3.46999e-06 [specialize_transform]: 1.49e-05 [updatestate_useless_node_eliminater]: 1.322e-05 [accelerated_algorithm]: 1.457e-05 [meta_shard_fg_expand]: 4.63001e-06 [get_grad_eliminate_]: 1.417e-05 [merge_forward]: 8.2e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.844e-05 [j_node_and_user_rematch]: 2.554e-05 [meta_fg_expand]: 0.00204977 [replace_old_param]: 8.462e-05 [inline_without_move]: 6.49e-05 [renormalize]: 0.0132032 [add_forward_monad_depend]: 1.413e-05 [auto_monad_grad]: 6.44999e-06 [auto_monad_eliminator]: 9.473e-05 [cse]: 0.00029139 [replace_applicator]: 9.514e-05 [Cycle 2]: 0.00415198, [27] [switch_simplify]: 4.495e-05 [loop_unroll]: 4.434e-05 [a_1]: 0.00129152 [with_stream_mark]: 1.77e-05 [recompute_prepare]: 1.144e-05 [updatestate_depend_eliminate]: 6.42001e-06 [updatestate_assign_eliminate]: 4.27e-06 [updatestate_loads_eliminate]: 3.98001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 1.02e-05 [updatestate_useless_node_eliminater]: 9.62001e-06 [accelerated_algorithm]: 9.14998e-06 [meta_shard_fg_expand]: 2.94001e-06 [get_grad_eliminate_]: 7.90998e-06 [merge_forward]: 5.00999e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.02e-05 [j_node_and_user_rematch]: 1.351e-05 [meta_fg_expand]: 0.00012297 [replace_old_param]: 9.57001e-06 [inline_without_move]: 8.48999e-06 [renormalize]: 0.00226663 [add_forward_monad_depend]: 7.57002e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.314e-05 [cse]: 2.305e-05 [replace_applicator]: 1.468e-05 [Cycle 3]: 0.00026529, [27] [switch_simplify]: 5.14e-06 [loop_unroll]: 3.53e-06 [a_1]: 4.247e-05 [with_stream_mark]: 1.144e-05 [recompute_prepare]: 3.78001e-06 [updatestate_depend_eliminate]: 2.58e-06 [updatestate_assign_eliminate]: 2.02999e-06 [updatestate_loads_eliminate]: 1.61002e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 4.30999e-06 [updatestate_useless_node_eliminater]: 3.65003e-06 [accelerated_algorithm]: 4.17e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 3.44001e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.268e-05 [j_node_and_user_rematch]: 5.97999e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 3.31001e-06 [inline_without_move]: 3.08998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 3.97e-06 [cse]: 9.82001e-06 [replace_applicator]: 4.29997e-06 [py_interpret_to_execute_after_opt_a]: 1.226e-05 [rewriter_after_opt_a]: 3.565e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00074003 [jit_opt_b]: 4.59e-05, [1] [Cycle 1]: 3.873e-05, [2] [frontend_op_eliminate]: 1.252e-05 [inline_after_opt_a]: 1.332e-05 [cconv]: 2.617e-05 [loop_unroll]: 0.00042385 [jit_opt_after_cconv]: 0.00013187, [1] [Cycle 1]: 0.00012528, [11] [c_1]: 1.338e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 5.14998e-06 [updatestate_assign_eliminate]: 1.80001e-06 [updatestate_loads_eliminate]: 1.59e-06 [cse]: 1.82e-05 [call_graph_tuple_transform]: 1.495e-05 [tuple_list_get_item_eliminator]: 4.32e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 3.78001e-06 [remove_dup_value]: 1.43e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 5.57999e-06 [add_recomputation]: 3.659e-05 [cse_after_recomputation]: 2.137e-05, [1] [Cycle 1]: 1.543e-05, [1] [cse]: 9.10001e-06 [auto_monad_reorder]: 1.385e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 4.75001e-06 [opt_after_jit_grad]: 0.00047328 [symbol_engine_optimizer]: 8.944e-05, [1] [Cycle 1]: 8.212e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 6.01e-06 [elim_not_effective]: 1.15e-05 [opt_reshape]: 4.36002e-06 [fold_const_symbol]: 2.471e-05 [renormalize]: 4.69998e-07 [validate]: 3.614e-05 Sums bootstrap : 0.000219s : 0.15% type_inference : 0.124409s : 83.49% event_method : 0.000610s : 0.41% auto_monad : 0.000114s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000053s : 0.04% rewriter_before_opt_a : 0.000134s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000133s : 0.09% jit_opt_a.loop_unroll : 0.000093s : 0.06% jit_opt_a.a_1 : 0.002441s : 1.64% jit_opt_a.with_stream_mark : 0.000067s : 0.05% jit_opt_a.recompute_prepare : 0.000038s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002174s : 1.46% jit_opt_a.replace_old_param : 0.000098s : 0.07% jit_opt_a.inline_without_move : 0.000076s : 0.05% jit_opt_a.renormalize : 0.015470s : 10.38% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000112s : 0.08% jit_opt_a.cse : 0.000324s : 0.22% jit_opt_a.replace_applicator : 0.000114s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000740s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000424s : 0.28% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000037s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000473s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000025s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.02% Time group info: ------[substitution.] 0.000652 107 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.59% : 0.000004s : 1: substitution.graph_param_transform 67.72% : 0.000441s : 13: substitution.inline 2.98% : 0.000019s : 2: substitution.inline_without_move 1.61% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.89% : 0.000012s : 7: substitution.minmaximum_grad 1.20% : 0.000008s : 5: substitution.partial_eliminate 1.61% : 0.000010s : 13: substitution.remove_not_recompute_node 4.91% : 0.000032s : 10: substitution.replace_applicator 1.11% : 0.000007s : 10: substitution.replace_old_param 1.20% : 0.000008s : 1: substitution.reshape_eliminate 0.55% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.96% : 0.000006s : 1: substitution.tile_eliminate 3.72% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.58% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.90% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124297 2 96.92% : 0.120472s : 1: type_inference.infer 3.08% : 0.003824s : 1: type_inference.specialize ------[replace.] 0.000189 20 65.80% : 0.000124s : 13: replace.inline 34.20% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000455 20 95.11% : 0.000433s : 13: match.inline 4.89% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000440 2656 1.41% : 0.000006s : 46: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000006s : 46: predicate.addn_check_dump 1.37% : 0.000006s : 46: predicate.addn_zero_filter 1.73% : 0.000008s : 46: predicate.arithmetic_simplify 11.52% : 0.000051s : 46: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.30% : 0.000006s : 46: predicate.compare_switch_simplify 1.35% : 0.000006s : 46: predicate.depend_value_elim 1.30% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.38% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.36% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.07% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.33% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.29% : 0.000006s : 46: predicate.environ_get_depend_swap 1.44% : 0.000006s : 46: predicate.environ_get_eliminate 1.30% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 1: predicate.graph_param_transform 3.87% : 0.000017s : 68: predicate.inline 1.81% : 0.000008s : 47: predicate.inline_without_move 0.31% : 0.000001s : 19: predicate.j_node_and_user_rematch 0.82% : 0.000004s : 19: predicate.less_batch_normalization 1.66% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.64% : 0.000007s : 54: predicate.load_eliminater 0.34% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.07% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.63% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.28% : 0.000006s : 46: predicate.merge_addn 1.37% : 0.000006s : 46: predicate.minmaximum_grad 0.37% : 0.000002s : 1: predicate.mutable_eliminate 0.06% : 0.000000s : 1: predicate.opt_reshape 2.12% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000007s : 46: predicate.print_const_string_wrapper 1.91% : 0.000008s : 46: predicate.reduce_eliminate 1.58% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000002s : 19: predicate.remove_not_recompute_node 2.61% : 0.000011s : 100: predicate.replace_applicator 1.00% : 0.000004s : 47: predicate.replace_old_param 0.03% : 0.000000s : 1: predicate.reset_defer_inline 1.44% : 0.000006s : 46: predicate.reshape_eliminate 1.43% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.24% : 0.000001s : 1: predicate.row_tensor_eliminate 1.39% : 0.000006s : 46: predicate.same_eliminate 0.47% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.72% : 0.000003s : 19: predicate.specialize_transform 1.59% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.71% : 0.000012s : 66: predicate.switch_defer_inline 2.23% : 0.000010s : 66: predicate.switch_layer_defer_inline 5.88% : 0.000026s : 161: predicate.switch_simplify 1.43% : 0.000006s : 46: predicate.tile_eliminate 1.51% : 0.000007s : 46: predicate.transpose_eliminate 1.71% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.00% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.80% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.59% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.55% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.55% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.69% : 0.000007s : 46: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003972 45 73.40% : 0.002916s : 28: func_graph_cloner_run.FuncGraphClonerGraph 26.60% : 0.001057s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.172370 87 0.02% : 0.000039s : 1: add_recomputation 0.07% : 0.000122s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.14% : 0.000236s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.36% : 0.000619s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.00% : 0.025847s : 1: jit_opt_a 0.08% : 0.000135s : 1: jit_opt_after_cconv 0.03% : 0.000048s : 1: jit_opt_b 0.25% : 0.000432s : 1: loop_unroll 0.43% : 0.000748s : 1: mutable_eliminate 1.83% : 0.003157s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000481s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000055s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.52% : 0.012961s : 2: renormalize.infer 1.44% : 0.002488s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000137s : 1: rewriter_before_opt_a 0.05% : 0.000092s : 1: symbol_engine_optimizer 72.19% : 0.124438s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.356.164 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d8b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.356.881 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 1.30277, [30] [bootstrap]: 0.00046142 [type_inference]: 1.08589 [event_method]: 2.575e-05 [auto_monad]: 7.55e-05 [graph_reusing]: 6.40997e-06 [pre_auto_parallel]: 3.09001e-06 [py_interpret_to_execute]: 0.00069306 [rewriter_before_opt_a]: 0.00010191 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.212406, [2] [Cycle 1]: 0.20725, [27] [switch_simplify]: 8.706e-05 [loop_unroll]: 3.534e-05 [a_1]: 0.0010832 [with_stream_mark]: 3.02e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 5.10001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.81999e-06 [specialize_transform]: 9.65002e-06 [updatestate_useless_node_eliminater]: 8.27e-06 [accelerated_algorithm]: 8.99e-06 [meta_shard_fg_expand]: 4.20999e-06 [get_grad_eliminate_]: 8.67998e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.007e-05 [j_node_and_user_rematch]: 1.354e-05 [meta_fg_expand]: 4.10998e-06 [replace_old_param]: 1.391e-05 [inline_without_move]: 7.85e-06 [renormalize]: 0.00475141 [add_forward_monad_depend]: 7.82e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.87e-05 [cse]: 4.034e-05 [replace_applicator]: 1.839e-05 [Cycle 2]: 0.00039126, [27] [switch_simplify]: 7.45e-06 [loop_unroll]: 6.62002e-06 [a_1]: 0.0001367 [with_stream_mark]: 1.253e-05 [recompute_prepare]: 6.28002e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.48998e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.384e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.87999e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.90002e-06 [cse]: 1.384e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.462e-05 [rewriter_after_opt_a]: 4.087e-05 [convert_after_rewriter]: 7.04001e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00123142 [jit_opt_b]: 6.467e-05, [1] [Cycle 1]: 5.547e-05, [2] [frontend_op_eliminate]: 2.399e-05 [inline_after_opt_a]: 1.929e-05 [cconv]: 3.036e-05 [loop_unroll]: 0.00048878 [jit_opt_after_cconv]: 0.00016345, [1] [Cycle 1]: 0.00015615, [11] [c_1]: 2.828e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.68e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.429e-05 [call_graph_tuple_transform]: 2.402e-05 [tuple_list_get_item_eliminator]: 6.51999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 7.50998e-06 [remove_dup_value]: 1.927e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 8.15999e-06 [add_recomputation]: 5.543e-05 [cse_after_recomputation]: 2.412e-05, [1] [Cycle 1]: 1.861e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.868e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 6.58e-06 [opt_after_jit_grad]: 0.00047158 [symbol_engine_optimizer]: 8.577e-05, [1] [Cycle 1]: 7.937e-05, [6] [build]: 3.92998e-06 [elim_shapecalc]: 9.16998e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 8.91997e-06 [fold_const_symbol]: 1.314e-05 [renormalize]: 3.00002e-07 [validate]: 0.0001585 Sums bootstrap : 0.000461s : 0.04% type_inference : 1.085886s : 99.03% event_method : 0.000026s : 0.00% auto_monad : 0.000075s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000693s : 0.06% rewriter_before_opt_a : 0.000102s : 0.01% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000095s : 0.01% jit_opt_a.loop_unroll : 0.000042s : 0.00% jit_opt_a.a_1 : 0.001220s : 0.11% jit_opt_a.with_stream_mark : 0.000043s : 0.00% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.004752s : 0.43% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.00% jit_opt_a.cse : 0.000054s : 0.00% jit_opt_a.replace_applicator : 0.000024s : 0.00% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000041s : 0.00% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001231s : 0.11% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.00% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000030s : 0.00% loop_unroll : 0.000489s : 0.04% jit_opt_after_cconv.c_1 : 0.000028s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000055s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000472s : 0.04% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000158s : 0.01% Time group info: ------[substitution.] 0.000469 28 0.39% : 0.000002s : 2: substitution.elim_not_effective 1.01% : 0.000005s : 2: substitution.fold_const_symbol 1.44% : 0.000007s : 4: substitution.graph_param_transform 86.77% : 0.000407s : 5: substitution.inline 0.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.41% : 0.000016s : 3: substitution.reduce_eliminate 1.28% : 0.000006s : 4: substitution.remove_not_recompute_node 1.43% : 0.000007s : 2: substitution.replace_old_param 3.39% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 1.085781 2 99.55% : 1.080884s : 1: type_inference.infer 0.45% : 0.004897s : 1: type_inference.specialize ------[replace.] 0.000168 7 70.30% : 0.000118s : 5: replace.inline 29.70% : 0.000050s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000419 7 96.46% : 0.000404s : 5: match.inline 3.54% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000176 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 1.96% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000001s : 4: predicate.graph_param_transform 5.62% : 0.000010s : 28: predicate.inline 0.69% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.09% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 1.96% : 0.000003s : 19: predicate.partial_eliminate 1.39% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000004s : 13: predicate.reduce_eliminate 1.65% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.68% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.49% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.77% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 7.33% : 0.000013s : 20: predicate.switch_defer_inline 2.14% : 0.000004s : 20: predicate.switch_layer_defer_inline 5.95% : 0.000010s : 64: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.73% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.84% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.62% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004496 25 71.43% : 0.003212s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.56% : 0.000115s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.01% : 0.001170s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 1.308989 72 0.00% : 0.000058s : 1: add_recomputation 0.01% : 0.000079s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.04% : 0.000480s : 1: bootstrap 0.00% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.00% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 16.23% : 0.212411s : 1: jit_opt_a 0.01% : 0.000166s : 1: jit_opt_after_cconv 0.01% : 0.000068s : 1: jit_opt_b 0.04% : 0.000496s : 1: loop_unroll 0.09% : 0.001242s : 1: mutable_eliminate 0.12% : 0.001507s : 26: opt.transform.jit_opt_a 0.00% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.00% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.00% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.04% : 0.000479s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000701s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 0.28% : 0.003634s : 1: renormalize.infer 0.08% : 0.001106s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.00% : 0.000044s : 1: rewriter_after_opt_a 0.01% : 0.000107s : 1: rewriter_before_opt_a 0.01% : 0.000088s : 1: symbol_engine_optimizer 82.96% : 1.085909s : 1: type_inference TotalTime = 0.347397, [30] [bootstrap]: 0.00027455 [type_inference]: 0.335326 [event_method]: 2.557e-05 [auto_monad]: 8.083e-05 [graph_reusing]: 6.76e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00065882 [rewriter_before_opt_a]: 0.00011273 [expand_dump_flag]: 5.00001e-06 [jit_opt_a]: 0.0084397, [2] [Cycle 1]: 0.00432758, [27] [switch_simplify]: 7.003e-05 [loop_unroll]: 3.461e-05 [a_1]: 0.00074501 [with_stream_mark]: 2.392e-05 [recompute_prepare]: 9.28002e-06 [updatestate_depend_eliminate]: 4.81002e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 1.124e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.137e-05 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00305901 [add_forward_monad_depend]: 7.6e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.902e-05 [cse]: 4.262e-05 [replace_applicator]: 2.045e-05 [Cycle 2]: 0.00038752, [27] [switch_simplify]: 7.36001e-06 [loop_unroll]: 6.35002e-06 [a_1]: 0.0001254 [with_stream_mark]: 1.366e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 3.87998e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.697e-05 [j_node_and_user_rematch]: 9.19998e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.68002e-06 [inline_without_move]: 6.19001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.525e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 1.691e-05 [rewriter_after_opt_a]: 4.039e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.0007133 [jit_opt_b]: 5.573e-05, [1] [Cycle 1]: 4.889e-05, [2] [frontend_op_eliminate]: 1.885e-05 [inline_after_opt_a]: 1.896e-05 [cconv]: 2.856e-05 [loop_unroll]: 0.00043089 [jit_opt_after_cconv]: 0.0001581, [1] [Cycle 1]: 0.00015129, [11] [c_1]: 2.656e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 6.50002e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.52e-05 [call_graph_tuple_transform]: 2.177e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.942e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.122e-05 [add_recomputation]: 5.315e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.897e-05, [1] [cse]: 1.332e-05 [auto_monad_reorder]: 1.748e-05 [get_jit_bprop_graph]: 2.52001e-06 [rewriter_after_jit_bprop_graph]: 5.08002e-06 [opt_after_jit_grad]: 0.00045868 [symbol_engine_optimizer]: 7.778e-05, [1] [Cycle 1]: 7.166e-05, [6] [build]: 4.37e-06 [elim_shapecalc]: 9.15999e-06 [elim_not_effective]: 1.444e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 1.032e-05 [renormalize]: 3.10014e-07 [validate]: 0.00013651 Sums bootstrap : 0.000275s : 0.08% type_inference : 0.335326s : 97.75% event_method : 0.000026s : 0.01% auto_monad : 0.000081s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000659s : 0.19% rewriter_before_opt_a : 0.000113s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000870s : 0.25% jit_opt_a.with_stream_mark : 0.000038s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003059s : 0.89% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000058s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000713s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000431s : 0.13% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000459s : 0.13% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000137s : 0.04% Time group info: ------[substitution.] 0.000305 25 0.85% : 0.000003s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 4: substitution.graph_param_transform 86.74% : 0.000264s : 5: substitution.inline 1.51% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000007s : 2: substitution.replace_old_param 4.61% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.335233 2 99.15% : 0.332373s : 1: type_inference.infer 0.85% : 0.002860s : 1: type_inference.specialize ------[replace.] 0.000106 7 67.86% : 0.000072s : 5: replace.inline 32.14% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 95.30% : 0.000261s : 5: match.inline 4.70% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.63% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.41% : 0.000002s : 13: predicate.print_const_string_wrapper 1.93% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.61% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000011s : 64: predicate.switch_simplify 1.69% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.89% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002697 25 65.69% : 0.001772s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.36% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.94% : 0.000835s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.351565 72 0.02% : 0.000056s : 1: add_recomputation 0.02% : 0.000084s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.08% : 0.000292s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.40% : 0.008443s : 1: jit_opt_a 0.05% : 0.000161s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.12% : 0.000439s : 1: loop_unroll 0.21% : 0.000722s : 1: mutable_eliminate 0.32% : 0.001136s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000466s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000672s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.60% : 0.002125s : 1: renormalize.infer 0.26% : 0.000923s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000118s : 1: rewriter_before_opt_a 0.02% : 0.000080s : 1: symbol_engine_optimizer 95.39% : 0.335347s : 1: type_inference TotalTime = 0.0972503, [30] [bootstrap]: 0.00028622 [type_inference]: 0.0440118 [event_method]: 2.187e-05 [auto_monad]: 6.867e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00010396 [rewriter_before_opt_a]: 8.305e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.0503491, [2] [Cycle 1]: 0.00213357, [27] [switch_simplify]: 6.336e-05 [loop_unroll]: 2.939e-05 [a_1]: 0.00058003 [with_stream_mark]: 2.378e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.21998e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.382e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.128e-05 [inline_without_move]: 6.14001e-06 [renormalize]: 0.00103426 [add_forward_monad_depend]: 6.39999e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 8.254e-05 [replace_applicator]: 1.456e-05 [Cycle 2]: 0.00040542, [27] [switch_simplify]: 6.10002e-06 [loop_unroll]: 5.19e-06 [a_1]: 8.995e-05 [with_stream_mark]: 1.165e-05 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 4.2e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 8.12e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.562e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 9.61998e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.05002e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 7.97e-06 [cse]: 1.874e-05 [replace_applicator]: 6.03998e-06 [py_interpret_to_execute_after_opt_a]: 1.752e-05 [rewriter_after_opt_a]: 4.425e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00067463 [jit_opt_b]: 5.248e-05, [1] [Cycle 1]: 4.4e-05, [2] [frontend_op_eliminate]: 1.602e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 3.166e-05 [loop_unroll]: 0.0004508 [jit_opt_after_cconv]: 0.00014644, [1] [Cycle 1]: 0.00014003, [11] [c_1]: 2.025e-05 [parameter_eliminate]: 3.84002e-06 [updatestate_depend_eliminate]: 7.51001e-06 [updatestate_assign_eliminate]: 2.63003e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.488e-05 [call_graph_tuple_transform]: 1.836e-05 [tuple_list_get_item_eliminator]: 5.29998e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.17999e-06 [remove_dup_value]: 1.674e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 6.81999e-06 [add_recomputation]: 5.372e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.726e-05, [1] [cse]: 1.161e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 5.37999e-06 [opt_after_jit_grad]: 0.0004608 [symbol_engine_optimizer]: 7.171e-05, [1] [Cycle 1]: 6.501e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 7.33999e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 8.65999e-06 [renormalize]: 2.89991e-07 [validate]: 4.136e-05 Sums bootstrap : 0.000286s : 0.59% type_inference : 0.044012s : 90.21% event_method : 0.000022s : 0.04% auto_monad : 0.000069s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000104s : 0.21% rewriter_before_opt_a : 0.000083s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.14% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000670s : 1.37% jit_opt_a.with_stream_mark : 0.000035s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001034s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000101s : 0.21% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000044s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000675s : 1.38% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000032s : 0.06% loop_unroll : 0.000451s : 0.92% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 0.94% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.08% Time group info: ------[substitution.] 0.000251 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.04% : 0.000005s : 3: substitution.graph_param_transform 84.84% : 0.000213s : 4: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 3.18% : 0.000008s : 2: substitution.replace_old_param 5.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043934 2 96.59% : 0.042434s : 1: type_inference.infer 3.41% : 0.001500s : 1: type_inference.specialize ------[replace.] 0.000077 6 70.10% : 0.000054s : 4: replace.inline 29.90% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.78% : 0.000211s : 4: match.inline 5.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.67% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.14% : 0.000007s : 22: predicate.inline 1.50% : 0.000002s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.68% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.97% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.28% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.70% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000841 13 45.23% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.46% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.31% : 0.000406s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.099243 72 0.06% : 0.000056s : 1: add_recomputation 0.07% : 0.000072s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000305s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 50.74% : 0.050353s : 1: jit_opt_a 0.15% : 0.000149s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.46% : 0.000459s : 1: loop_unroll 0.69% : 0.000686s : 1: mutable_eliminate 0.91% : 0.000906s : 26: opt.transform.jit_opt_a 0.05% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000107s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.61% : 0.000609s : 1: renormalize.infer 0.42% : 0.000415s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000048s : 1: rewriter_after_opt_a 0.09% : 0.000087s : 1: rewriter_before_opt_a 0.07% : 0.000074s : 1: symbol_engine_optimizer 44.36% : 0.044029s : 1: type_inference TotalTime = 0.0401186, [30] [bootstrap]: 0.0003681 [type_inference]: 0.0291421 [event_method]: 1.905e-05 [auto_monad]: 6.589e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 4.143e-05 [rewriter_before_opt_a]: 7.305e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.00667584, [2] [Cycle 1]: 0.00202571, [27] [switch_simplify]: 6.057e-05 [loop_unroll]: 2.923e-05 [a_1]: 0.00058706 [with_stream_mark]: 2.366e-05 [recompute_prepare]: 7.75998e-06 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.90002e-06 [get_grad_eliminate_]: 5.91998e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.0009377 [add_forward_monad_depend]: 1.457e-05 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.773e-05 [cse]: 4.114e-05 [replace_applicator]: 1.615e-05 [Cycle 2]: 0.00036461, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.27001e-06 [a_1]: 0.00010276 [with_stream_mark]: 1.229e-05 [recompute_prepare]: 5.36998e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.26002e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.29001e-06 [cell_reuse_recompute_pass]: 3.26001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.621e-05 [j_node_and_user_rematch]: 8.54998e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.25e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.64001e-06 [cse]: 1.514e-05 [replace_applicator]: 5.39998e-06 [py_interpret_to_execute_after_opt_a]: 1.93e-05 [rewriter_after_opt_a]: 4.189e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00091202 [jit_opt_b]: 5.794e-05, [1] [Cycle 1]: 4.914e-05, [2] [frontend_op_eliminate]: 1.749e-05 [inline_after_opt_a]: 1.924e-05 [cconv]: 3.432e-05 [loop_unroll]: 0.0012942 [jit_opt_after_cconv]: 0.00019357, [1] [Cycle 1]: 0.00018424, [11] [c_1]: 2.601e-05 [parameter_eliminate]: 5.92001e-06 [updatestate_depend_eliminate]: 1.004e-05 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 3.718e-05 [call_graph_tuple_transform]: 2.62e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.894e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 7.48e-06 [add_recomputation]: 7.612e-05 [cse_after_recomputation]: 2.894e-05, [1] [Cycle 1]: 2.176e-05, [1] [cse]: 1.489e-05 [auto_monad_reorder]: 1.898e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 9.67999e-06 [opt_after_jit_grad]: 0.00066683 [symbol_engine_optimizer]: 8.216e-05, [1] [Cycle 1]: 7.484e-05, [6] [build]: 5.70001e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 1.5e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 9.41998e-06 [renormalize]: 4.30009e-07 [validate]: 4.88e-05 Sums bootstrap : 0.000368s : 1.05% type_inference : 0.029142s : 82.85% event_method : 0.000019s : 0.05% auto_monad : 0.000066s : 0.19% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000041s : 0.12% rewriter_before_opt_a : 0.000073s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.19% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000690s : 1.96% jit_opt_a.with_stream_mark : 0.000036s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000938s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.07% jit_opt_a.cse : 0.000056s : 0.16% jit_opt_a.replace_applicator : 0.000022s : 0.06% py_interpret_to_execute_after_opt_a : 0.000019s : 0.05% rewriter_after_opt_a : 0.000042s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000912s : 2.59% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.05% cconv : 0.000034s : 0.10% loop_unroll : 0.001294s : 3.68% jit_opt_after_cconv.c_1 : 0.000026s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000076s : 0.22% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000667s : 1.90% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.14% Time group info: ------[substitution.] 0.000247 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.68% : 0.000007s : 3: substitution.graph_param_transform 84.54% : 0.000209s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 5.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029068 2 96.70% : 0.028108s : 1: type_inference.infer 3.30% : 0.000960s : 1: type_inference.specialize ------[replace.] 0.000081 6 71.65% : 0.000058s : 4: replace.inline 28.35% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.15% : 0.000206s : 4: match.inline 5.85% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.49% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.96% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.25% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 2.04% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 3.08% : 0.000004s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 1.04% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.13% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.12% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000872 13 56.39% : 0.000492s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.97% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.64% : 0.000328s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042098 72 0.19% : 0.000079s : 1: add_recomputation 0.16% : 0.000069s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.92% : 0.000388s : 1: bootstrap 0.09% : 0.000037s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.87% : 0.006680s : 1: jit_opt_a 0.47% : 0.000197s : 1: jit_opt_after_cconv 0.15% : 0.000061s : 1: jit_opt_b 3.11% : 0.001309s : 1: loop_unroll 2.19% : 0.000924s : 1: mutable_eliminate 2.18% : 0.000917s : 26: opt.transform.jit_opt_a 0.14% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000023s : 1: opt.transform.mutable_eliminate 0.19% : 0.000079s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.61% : 0.000678s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000044s : 1: py_interpret_to_execute 0.05% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000022s : 1: remove_dup_value 1.12% : 0.000473s : 1: renormalize.infer 1.08% : 0.000457s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000045s : 1: rewriter_after_opt_a 0.18% : 0.000076s : 1: rewriter_before_opt_a 0.20% : 0.000085s : 1: symbol_engine_optimizer 69.25% : 0.029153s : 1: type_inference TotalTime = 0.154361, [30] [bootstrap]: 0.00029343 [type_inference]: 0.125458 [event_method]: 0.00059793 [auto_monad]: 0.00011847 [graph_reusing]: 7.04001e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 4.478e-05 [rewriter_before_opt_a]: 0.00012985 [expand_dump_flag]: 3.40003e-06 [jit_opt_a]: 0.0253638, [3] [Cycle 1]: 0.017558, [27] [switch_simplify]: 7.587e-05 [loop_unroll]: 4.412e-05 [a_1]: 0.00100998 [with_stream_mark]: 3.554e-05 [recompute_prepare]: 2.267e-05 [updatestate_depend_eliminate]: 9.02999e-06 [updatestate_assign_eliminate]: 7.18e-06 [updatestate_loads_eliminate]: 6.92002e-06 [parameter_eliminate]: 2.91999e-06 [specialize_transform]: 1.466e-05 [updatestate_useless_node_eliminater]: 1.392e-05 [accelerated_algorithm]: 1.416e-05 [meta_shard_fg_expand]: 4.25e-06 [get_grad_eliminate_]: 1.417e-05 [merge_forward]: 8.65001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.837e-05 [j_node_and_user_rematch]: 2.548e-05 [meta_fg_expand]: 0.00202502 [replace_old_param]: 7.881e-05 [inline_without_move]: 6.418e-05 [renormalize]: 0.0133466 [add_forward_monad_depend]: 1.347e-05 [auto_monad_grad]: 6.91001e-06 [auto_monad_eliminator]: 6.146e-05 [cse]: 0.00027294 [replace_applicator]: 9.192e-05 [Cycle 2]: 0.00378381, [27] [switch_simplify]: 4.416e-05 [loop_unroll]: 8.288e-05 [a_1]: 0.00117427 [with_stream_mark]: 1.947e-05 [recompute_prepare]: 9.29998e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 3.91999e-06 [updatestate_loads_eliminate]: 4.07003e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.15003e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 7.83001e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 7.91001e-06 [merge_forward]: 4.93001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 1.128e-05 [meta_fg_expand]: 0.00013028 [replace_old_param]: 9.24998e-06 [inline_without_move]: 7.38e-06 [renormalize]: 0.00198656 [add_forward_monad_depend]: 6.29001e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.219e-05 [cse]: 2.377e-05 [replace_applicator]: 1.453e-05 [Cycle 3]: 0.00026049, [27] [switch_simplify]: 4.36002e-06 [loop_unroll]: 3.78001e-06 [a_1]: 4.439e-05 [with_stream_mark]: 1.085e-05 [recompute_prepare]: 4.07003e-06 [updatestate_depend_eliminate]: 2.64001e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 3.58e-06 [updatestate_useless_node_eliminater]: 3.26999e-06 [accelerated_algorithm]: 4.17998e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 3.32002e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.252e-05 [j_node_and_user_rematch]: 5.67001e-06 [meta_fg_expand]: 1.44e-06 [replace_old_param]: 3.75e-06 [inline_without_move]: 3.71001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 3.58999e-06 [cse]: 8.59e-06 [replace_applicator]: 3.56999e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 9.373e-05 [convert_after_rewriter]: 6.28e-06 [order_py_execute_after_rewriter]: 4.69002e-06 [mutable_eliminate]: 0.00073339 [jit_opt_b]: 4.31e-05, [1] [Cycle 1]: 3.572e-05, [2] [frontend_op_eliminate]: 1.13e-05 [inline_after_opt_a]: 1.23e-05 [cconv]: 2.83e-05 [loop_unroll]: 0.00042398 [jit_opt_after_cconv]: 0.00012923, [1] [Cycle 1]: 0.00012315, [11] [c_1]: 1.32e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 1.61998e-06 [updatestate_loads_eliminate]: 1.57001e-06 [cse]: 2.173e-05 [call_graph_tuple_transform]: 1.475e-05 [tuple_list_get_item_eliminator]: 4.13999e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 3.88001e-06 [remove_dup_value]: 1.411e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 5.33002e-06 [add_recomputation]: 3.583e-05 [cse_after_recomputation]: 1.843e-05, [1] [Cycle 1]: 1.329e-05, [1] [cse]: 7.38e-06 [auto_monad_reorder]: 1.273e-05 [get_jit_bprop_graph]: 2.83e-06 [rewriter_after_jit_bprop_graph]: 4.88001e-06 [opt_after_jit_grad]: 0.00044404 [symbol_engine_optimizer]: 6.625e-05, [1] [Cycle 1]: 5.987e-05, [6] [build]: 3.21001e-06 [elim_shapecalc]: 5.48002e-06 [elim_not_effective]: 9.96e-06 [opt_reshape]: 5.05001e-06 [fold_const_symbol]: 6.21998e-06 [renormalize]: 4.10015e-07 [validate]: 5.241e-05 Sums bootstrap : 0.000293s : 0.20% type_inference : 0.125458s : 83.80% event_method : 0.000598s : 0.40% auto_monad : 0.000118s : 0.08% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000045s : 0.03% rewriter_before_opt_a : 0.000130s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000124s : 0.08% jit_opt_a.loop_unroll : 0.000131s : 0.09% jit_opt_a.a_1 : 0.002229s : 1.49% jit_opt_a.with_stream_mark : 0.000066s : 0.04% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000025s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.03% jit_opt_a.meta_fg_expand : 0.002157s : 1.44% jit_opt_a.replace_old_param : 0.000092s : 0.06% jit_opt_a.inline_without_move : 0.000075s : 0.05% jit_opt_a.renormalize : 0.015333s : 10.24% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000077s : 0.05% jit_opt_a.cse : 0.000305s : 0.20% jit_opt_a.replace_applicator : 0.000110s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000094s : 0.06% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000733s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000424s : 0.28% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000007s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000444s : 0.30% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000599 104 0.23% : 0.000001s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.68% : 0.000004s : 1: substitution.graph_param_transform 66.61% : 0.000399s : 13: substitution.inline 3.37% : 0.000020s : 2: substitution.inline_without_move 1.52% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.04% : 0.000012s : 7: substitution.minmaximum_grad 1.29% : 0.000008s : 5: substitution.partial_eliminate 1.81% : 0.000011s : 12: substitution.remove_not_recompute_node 5.50% : 0.000033s : 10: substitution.replace_applicator 1.09% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.07% : 0.000006s : 1: substitution.tile_eliminate 4.10% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.67% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.44% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125348 2 97.05% : 0.121649s : 1: type_inference.infer 2.95% : 0.003699s : 1: type_inference.specialize ------[replace.] 0.000181 20 65.43% : 0.000119s : 13: replace.inline 34.57% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000413 20 94.73% : 0.000391s : 13: match.inline 5.27% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2544 1.55% : 0.000006s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.54% : 0.000006s : 44: predicate.addn_check_dump 1.63% : 0.000006s : 44: predicate.addn_zero_filter 2.30% : 0.000009s : 44: predicate.arithmetic_simplify 1.67% : 0.000006s : 44: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 44: predicate.compare_switch_simplify 1.76% : 0.000007s : 44: predicate.depend_value_elim 1.41% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.56% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.62% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.50% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_depend_swap 1.48% : 0.000006s : 44: predicate.environ_get_eliminate 1.47% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.84% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.38% : 0.000017s : 66: predicate.inline 2.17% : 0.000008s : 45: predicate.inline_without_move 0.34% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.12% : 0.000004s : 17: predicate.less_batch_normalization 1.79% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.92% : 0.000007s : 52: predicate.load_eliminater 0.42% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.38% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.65% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 44: predicate.merge_addn 1.53% : 0.000006s : 44: predicate.minmaximum_grad 0.32% : 0.000001s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.31% : 0.000009s : 52: predicate.partial_eliminate 1.62% : 0.000006s : 44: predicate.print_const_string_wrapper 2.13% : 0.000008s : 44: predicate.reduce_eliminate 1.77% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.37% : 0.000001s : 17: predicate.remove_not_recompute_node 2.68% : 0.000010s : 96: predicate.replace_applicator 1.20% : 0.000005s : 45: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.65% : 0.000006s : 44: predicate.reshape_eliminate 1.49% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.22% : 0.000001s : 1: predicate.row_tensor_eliminate 1.46% : 0.000005s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 17: predicate.specialize_transform 1.71% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.84% : 0.000011s : 64: predicate.switch_defer_inline 2.56% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.48% : 0.000024s : 157: predicate.switch_simplify 1.51% : 0.000006s : 44: predicate.tile_eliminate 1.60% : 0.000006s : 44: predicate.transpose_eliminate 1.97% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.83% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.77% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.92% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.84% : 0.000011s : 69: predicate.updatestate_useless_node_eliminater 1.77% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004073 45 74.57% : 0.003037s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.43% : 0.001036s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.172610 87 0.02% : 0.000039s : 1: add_recomputation 0.07% : 0.000125s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.18% : 0.000319s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.35% : 0.000612s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.70% : 0.025368s : 1: jit_opt_a 0.08% : 0.000132s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.25% : 0.000431s : 1: loop_unroll 0.43% : 0.000742s : 1: mutable_eliminate 1.71% : 0.002945s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000451s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000047s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.48% : 0.012913s : 2: renormalize.infer 1.39% : 0.002396s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000097s : 1: rewriter_after_opt_a 0.08% : 0.000133s : 1: rewriter_before_opt_a 0.04% : 0.000069s : 1: symbol_engine_optimizer 72.70% : 0.125480s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.556.037 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006dd30> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.556.743 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0367028, [30] [bootstrap]: 0.00028567 [type_inference]: 0.021969 [event_method]: 2.078e-05 [auto_monad]: 7.215e-05 [graph_reusing]: 6.68998e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00012387 [rewriter_before_opt_a]: 8.173e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.005592, [2] [Cycle 1]: 0.00193422, [27] [switch_simplify]: 5.3e-05 [loop_unroll]: 2.95e-05 [a_1]: 0.0005292 [with_stream_mark]: 2.263e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00096955 [add_forward_monad_depend]: 5.02e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 3.314e-05 [replace_applicator]: 1.285e-05 [Cycle 2]: 0.00031787, [27] [switch_simplify]: 6.02001e-06 [loop_unroll]: 4.96997e-06 [a_1]: 8.884e-05 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.21002e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.07e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.223e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.345e-05 [rewriter_after_opt_a]: 0.00325737 [convert_after_rewriter]: 2.28e-05 [order_py_execute_after_rewriter]: 5.82999e-06 [mutable_eliminate]: 0.00261717 [jit_opt_b]: 6.194e-05, [1] [Cycle 1]: 5.237e-05, [2] [frontend_op_eliminate]: 1.929e-05 [inline_after_opt_a]: 2.071e-05 [cconv]: 4.208e-05 [loop_unroll]: 0.00130354 [jit_opt_after_cconv]: 0.00019326, [1] [Cycle 1]: 0.00018543, [11] [c_1]: 2.323e-05 [parameter_eliminate]: 6.96001e-06 [updatestate_depend_eliminate]: 1.032e-05 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.93998e-06 [cse]: 4.657e-05 [call_graph_tuple_transform]: 2.498e-05 [tuple_list_get_item_eliminator]: 5.49998e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 5.80002e-06 [remove_dup_value]: 1.734e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 7.61001e-06 [add_recomputation]: 5.438e-05 [cse_after_recomputation]: 2.487e-05, [1] [Cycle 1]: 1.969e-05, [1] [cse]: 1.411e-05 [auto_monad_reorder]: 1.87e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 9.14998e-06 [opt_after_jit_grad]: 0.00050715 [symbol_engine_optimizer]: 8.028e-05, [1] [Cycle 1]: 7.375e-05, [6] [build]: 4.85001e-06 [elim_shapecalc]: 9.47999e-06 [elim_not_effective]: 1.491e-05 [opt_reshape]: 6.48e-06 [fold_const_symbol]: 9.57001e-06 [renormalize]: 3.69997e-07 [validate]: 8.323e-05 Sums bootstrap : 0.000286s : 0.87% type_inference : 0.021969s : 67.11% event_method : 0.000021s : 0.06% auto_monad : 0.000072s : 0.22% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000124s : 0.38% rewriter_before_opt_a : 0.000082s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.18% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000618s : 1.89% jit_opt_a.with_stream_mark : 0.000032s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000970s : 2.96% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000045s : 0.14% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.003257s : 9.95% convert_after_rewriter : 0.000023s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.002617s : 7.99% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000042s : 0.13% loop_unroll : 0.001304s : 3.98% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000047s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000054s : 0.17% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000507s : 1.55% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000083s : 0.25% Time group info: ------[substitution.] 0.000209 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 3.06% : 0.000006s : 3: substitution.graph_param_transform 83.50% : 0.000174s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 5.84% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021887 2 90.05% : 0.019710s : 1: type_inference.infer 9.95% : 0.002177s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.61% : 0.000046s : 4: replace.inline 32.39% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.95% : 0.000172s : 4: match.inline 6.05% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.85% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.37% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.07% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 1.08% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.42% : 0.000002s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000810 13 44.69% : 0.000362s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.30% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.00% : 0.000405s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038532 72 0.15% : 0.000057s : 1: add_recomputation 0.20% : 0.000076s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.77% : 0.000297s : 1: bootstrap 0.12% : 0.000045s : 1: cconv 0.07% : 0.000028s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.52% : 0.005595s : 1: jit_opt_a 0.51% : 0.000196s : 1: jit_opt_after_cconv 0.17% : 0.000065s : 1: jit_opt_b 3.41% : 0.001315s : 1: loop_unroll 6.83% : 0.002630s : 1: mutable_eliminate 2.16% : 0.000831s : 26: opt.transform.jit_opt_a 0.15% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000032s : 4: opt.transform.jit_opt_b 0.05% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000025s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000518s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000127s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.46% : 0.000564s : 1: renormalize.infer 1.03% : 0.000398s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 8.51% : 0.003280s : 1: rewriter_after_opt_a 0.22% : 0.000086s : 1: rewriter_before_opt_a 0.21% : 0.000083s : 1: symbol_engine_optimizer 57.06% : 0.021988s : 1: type_inference TotalTime = 0.0513551, [30] [bootstrap]: 0.00027316 [type_inference]: 0.0428196 [event_method]: 2.008e-05 [auto_monad]: 6.72e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 9.913e-05 [rewriter_before_opt_a]: 8.068e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.00556337, [2] [Cycle 1]: 0.0019854, [27] [switch_simplify]: 5.67e-05 [loop_unroll]: 2.919e-05 [a_1]: 0.00055322 [with_stream_mark]: 2.201e-05 [recompute_prepare]: 7.55998e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.559e-05 [j_node_and_user_rematch]: 8.91002e-06 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.58002e-06 [renormalize]: 0.00098364 [add_forward_monad_depend]: 5.17999e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 3.25e-05 [replace_applicator]: 1.342e-05 [Cycle 2]: 0.00031806, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.13002e-06 [a_1]: 8.979e-05 [with_stream_mark]: 9.64e-06 [recompute_prepare]: 4.90001e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.326e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.34002e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.325e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 3.851e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00068027 [jit_opt_b]: 5.198e-05, [1] [Cycle 1]: 4.382e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.654e-05 [cconv]: 2.944e-05 [loop_unroll]: 0.00047325 [jit_opt_after_cconv]: 0.00015403, [1] [Cycle 1]: 0.00014656, [11] [c_1]: 2.138e-05 [parameter_eliminate]: 3.66001e-06 [updatestate_depend_eliminate]: 7.48999e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.91999e-06 [cse]: 2.968e-05 [call_graph_tuple_transform]: 1.888e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.02e-06 [remove_dup_value]: 1.725e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 6.64999e-06 [add_recomputation]: 5.336e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.183e-05 [auto_monad_reorder]: 1.872e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 7.57002e-06 [opt_after_jit_grad]: 0.00050755 [symbol_engine_optimizer]: 9.058e-05, [1] [Cycle 1]: 8.36e-05, [6] [build]: 4.56002e-06 [elim_shapecalc]: 8.87999e-06 [elim_not_effective]: 1.262e-05 [opt_reshape]: 2.048e-05 [fold_const_symbol]: 9.52001e-06 [renormalize]: 7.00005e-07 [validate]: 4.843e-05 Sums bootstrap : 0.000273s : 0.58% type_inference : 0.042820s : 90.14% event_method : 0.000020s : 0.04% auto_monad : 0.000067s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000099s : 0.21% rewriter_before_opt_a : 0.000081s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000643s : 1.35% jit_opt_a.with_stream_mark : 0.000032s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000984s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000046s : 0.10% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000039s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000680s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000029s : 0.06% loop_unroll : 0.000473s : 1.00% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000508s : 1.07% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000020s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.10% Time group info: ------[substitution.] 0.000230 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 3: substitution.graph_param_transform 85.39% : 0.000196s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000004s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 5.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042751 2 96.41% : 0.041215s : 1: type_inference.infer 3.59% : 0.001537s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.12% : 0.000049s : 4: replace.inline 30.88% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.51% : 0.000194s : 4: match.inline 5.49% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.58% : 0.000002s : 10: predicate.accumulaten_eliminater 1.53% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.60% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.37% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 1.01% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.44% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.93% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.85% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.45% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.25% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.21% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000807 13 42.98% : 0.000347s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.33% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.69% : 0.000409s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053268 72 0.11% : 0.000057s : 1: add_recomputation 0.13% : 0.000071s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.54% : 0.000289s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 10.45% : 0.005566s : 1: jit_opt_a 0.30% : 0.000157s : 1: jit_opt_after_cconv 0.10% : 0.000055s : 1: jit_opt_b 0.91% : 0.000485s : 1: loop_unroll 1.30% : 0.000693s : 1: mutable_eliminate 1.61% : 0.000857s : 26: opt.transform.jit_opt_a 0.09% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000020s : 1: opt.transform.mutable_eliminate 0.05% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000518s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000102s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.06% : 0.000567s : 1: renormalize.infer 0.77% : 0.000408s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.16% : 0.000084s : 1: rewriter_before_opt_a 0.18% : 0.000094s : 1: symbol_engine_optimizer 80.42% : 0.042837s : 1: type_inference TotalTime = 0.0365014, [30] [bootstrap]: 0.00035581 [type_inference]: 0.0260009 [event_method]: 2.136e-05 [auto_monad]: 7.269e-05 [graph_reusing]: 5.39e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00018057 [rewriter_before_opt_a]: 8.801e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00730315, [2] [Cycle 1]: 0.00267755, [27] [switch_simplify]: 6.403e-05 [loop_unroll]: 2.991e-05 [a_1]: 0.00060637 [with_stream_mark]: 2.494e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.90998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 3.09001e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.46002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.382e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.078e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00158835 [add_forward_monad_depend]: 6.46e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.706e-05 [cse]: 3.803e-05 [replace_applicator]: 1.555e-05 [Cycle 2]: 0.00033686, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 5.30001e-06 [a_1]: 9.53e-05 [with_stream_mark]: 1.1e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.77998e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 2.64001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 8.58001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.45999e-06 [inline_without_move]: 5.07e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 6.08998e-06 [cse]: 1.448e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 1.477e-05 [rewriter_after_opt_a]: 4.299e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.0007166 [jit_opt_b]: 5.393e-05, [1] [Cycle 1]: 4.658e-05, [2] [frontend_op_eliminate]: 1.645e-05 [inline_after_opt_a]: 1.883e-05 [cconv]: 2.924e-05 [loop_unroll]: 0.00047917 [jit_opt_after_cconv]: 0.0001529, [1] [Cycle 1]: 0.00014642, [11] [c_1]: 2.223e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 2.75997e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.478e-05 [call_graph_tuple_transform]: 2.095e-05 [tuple_list_get_item_eliminator]: 5.91e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.00002e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.33e-06 [add_recomputation]: 5.329e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.221e-05 [auto_monad_reorder]: 1.798e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.12e-06 [opt_after_jit_grad]: 0.00047144 [symbol_engine_optimizer]: 0.00012336, [1] [Cycle 1]: 0.00011621, [6] [build]: 3.98001e-06 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 5.837e-05 [opt_reshape]: 6.61999e-06 [fold_const_symbol]: 9.52001e-06 [renormalize]: 4.39992e-07 [validate]: 4.251e-05 Sums bootstrap : 0.000356s : 1.13% type_inference : 0.026001s : 82.30% event_method : 0.000021s : 0.07% auto_monad : 0.000073s : 0.23% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000181s : 0.57% rewriter_before_opt_a : 0.000088s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.22% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000702s : 2.22% jit_opt_a.with_stream_mark : 0.000036s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001588s : 5.03% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000053s : 0.17% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000043s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000717s : 2.27% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.06% cconv : 0.000029s : 0.09% loop_unroll : 0.000479s : 1.52% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000471s : 1.49% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000058s : 0.18% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.13% Time group info: ------[substitution.] 0.000256 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 86.39% : 0.000221s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000005s : 2: substitution.replace_old_param 4.72% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025913 2 90.93% : 0.023562s : 1: type_inference.infer 9.07% : 0.002351s : 1: type_inference.specialize ------[replace.] 0.000083 6 68.52% : 0.000057s : 4: replace.inline 31.48% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 95.21% : 0.000219s : 4: match.inline 4.79% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.61% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.95% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.18% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 2.19% : 0.000003s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001240 13 37.38% : 0.000463s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.28% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.34% : 0.000723s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039123 72 0.14% : 0.000056s : 1: add_recomputation 0.19% : 0.000076s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.99% : 0.000387s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.68% : 0.007307s : 1: jit_opt_a 0.40% : 0.000155s : 1: jit_opt_after_cconv 0.14% : 0.000057s : 1: jit_opt_b 1.25% : 0.000488s : 1: loop_unroll 1.85% : 0.000725s : 1: mutable_eliminate 2.39% : 0.000936s : 26: opt.transform.jit_opt_a 0.13% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000079s : 4: opt.transform.symbol_engine_opt 1.23% : 0.000480s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000184s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.47% : 0.000965s : 1: renormalize.infer 1.57% : 0.000613s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000046s : 1: rewriter_after_opt_a 0.23% : 0.000091s : 1: rewriter_before_opt_a 0.32% : 0.000126s : 1: symbol_engine_optimizer 66.51% : 0.026020s : 1: type_inference TotalTime = 0.0370632, [30] [bootstrap]: 0.00033734 [type_inference]: 0.00845231 [event_method]: 1.945e-05 [auto_monad]: 6.665e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 4.331e-05 [rewriter_before_opt_a]: 8.597e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0258175, [2] [Cycle 1]: 0.00197038, [27] [switch_simplify]: 7.113e-05 [loop_unroll]: 3.595e-05 [a_1]: 0.00065086 [with_stream_mark]: 2.241e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.662e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 5.99e-06 [renormalize]: 0.00081432 [add_forward_monad_depend]: 5.54e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.655e-05 [cse]: 4.124e-05 [replace_applicator]: 1.38e-05 [Cycle 2]: 0.00033341, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.12999e-06 [a_1]: 8.926e-05 [with_stream_mark]: 9.87999e-06 [recompute_prepare]: 5.68002e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.394e-05 [j_node_and_user_rematch]: 7.71001e-06 [meta_fg_expand]: 1.86003e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.10002e-06 [cse]: 1.502e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.4e-05 [rewriter_after_opt_a]: 3.962e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00060212 [jit_opt_b]: 5.195e-05, [1] [Cycle 1]: 4.441e-05, [2] [frontend_op_eliminate]: 1.645e-05 [inline_after_opt_a]: 1.617e-05 [cconv]: 2.603e-05 [loop_unroll]: 0.00042556 [jit_opt_after_cconv]: 0.00014802, [1] [Cycle 1]: 0.00014145, [11] [c_1]: 2.032e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.532e-05 [call_graph_tuple_transform]: 1.875e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 3.708e-05 [partial_unused_args_eliminate]: 2.68998e-06 [environ_conv]: 1.472e-05 [add_recomputation]: 5.556e-05 [cse_after_recomputation]: 2.689e-05, [1] [Cycle 1]: 2.102e-05, [1] [cse]: 1.438e-05 [auto_monad_reorder]: 1.94e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00046171 [symbol_engine_optimizer]: 7.523e-05, [1] [Cycle 1]: 6.878e-05, [6] [build]: 4.08999e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.313e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 3.50003e-07 [validate]: 4.258e-05 Sums bootstrap : 0.000337s : 2.61% type_inference : 0.008452s : 65.28% event_method : 0.000019s : 0.15% auto_monad : 0.000067s : 0.51% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000043s : 0.33% rewriter_before_opt_a : 0.000086s : 0.66% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000077s : 0.60% jit_opt_a.loop_unroll : 0.000041s : 0.32% jit_opt_a.a_1 : 0.000740s : 5.72% jit_opt_a.with_stream_mark : 0.000032s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000814s : 6.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.17% jit_opt_a.cse : 0.000056s : 0.43% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000040s : 0.31% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000602s : 4.65% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000026s : 0.20% loop_unroll : 0.000426s : 3.29% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000037s : 0.29% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000015s : 0.11% add_recomputation : 0.000056s : 0.43% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000462s : 3.57% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.33% Time group info: ------[substitution.] 0.000243 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000005s : 3: substitution.graph_param_transform 85.32% : 0.000208s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 1.96% : 0.000005s : 2: substitution.replace_old_param 5.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008391 2 88.48% : 0.007424s : 1: type_inference.infer 11.52% : 0.000966s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.07% : 0.000065s : 5: replace.inline 32.93% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 94.22% : 0.000205s : 5: match.inline 5.78% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.44% : 0.000002s : 11: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.14% : 0.000001s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.38% : 0.000002s : 11: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.20% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000001s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 16: predicate.load_eliminater 1.73% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 1.98% : 0.000003s : 11: predicate.reduce_eliminate 1.77% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 11: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.12% : 0.000010s : 59: predicate.switch_simplify 1.50% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000773 16 52.33% : 0.000404s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.59% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.08% : 0.000310s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038920 72 0.15% : 0.000059s : 1: add_recomputation 0.18% : 0.000070s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.91% : 0.000356s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000017s : 1: environ_conv 0.06% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 66.34% : 0.025822s : 1: jit_opt_a 0.39% : 0.000151s : 1: jit_opt_after_cconv 0.14% : 0.000055s : 1: jit_opt_b 1.11% : 0.000433s : 1: loop_unroll 1.57% : 0.000610s : 1: mutable_eliminate 2.53% : 0.000985s : 26: opt.transform.jit_opt_a 0.12% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.21% : 0.000469s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000046s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000040s : 1: remove_dup_value 1.18% : 0.000460s : 1: renormalize.infer 0.89% : 0.000346s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.23% : 0.000089s : 1: rewriter_before_opt_a 0.20% : 0.000078s : 1: symbol_engine_optimizer 21.75% : 0.008464s : 1: type_inference TotalTime = 0.022554, [30] [bootstrap]: 0.00046076 [type_inference]: 0.0114831 [event_method]: 2.107e-05 [auto_monad]: 8.893e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 5.848e-05 [rewriter_before_opt_a]: 8.614e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00749802, [2] [Cycle 1]: 0.00276768, [27] [switch_simplify]: 0.0001308 [loop_unroll]: 3.45e-05 [a_1]: 0.00098694 [with_stream_mark]: 2.053e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 2.41998e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 7.53e-06 [meta_shard_fg_expand]: 2.78998e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.75002e-06 [replace_old_param]: 1.09e-05 [inline_without_move]: 5.71998e-06 [renormalize]: 0.00119732 [add_forward_monad_depend]: 8.33999e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.894e-05 [cse]: 4.141e-05 [replace_applicator]: 1.619e-05 [Cycle 2]: 0.00036761, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.00011156 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 5.07999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.59e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.508e-05 [rewriter_after_opt_a]: 6.073e-05 [convert_after_rewriter]: 9.60001e-06 [order_py_execute_after_rewriter]: 5.55001e-06 [mutable_eliminate]: 0.00090294 [jit_opt_b]: 6.076e-05, [1] [Cycle 1]: 5.254e-05, [2] [frontend_op_eliminate]: 2.064e-05 [inline_after_opt_a]: 1.947e-05 [cconv]: 3.145e-05 [loop_unroll]: 0.00050885 [jit_opt_after_cconv]: 0.00020677, [1] [Cycle 1]: 0.00019902, [11] [c_1]: 2.504e-05 [parameter_eliminate]: 4.80999e-06 [updatestate_depend_eliminate]: 8.71002e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.562e-05 [call_graph_tuple_transform]: 4.524e-05 [tuple_list_get_item_eliminator]: 7.40998e-06 [none_parameter_eliminate]: 1.91998e-06 [renormalize]: 8.2e-07 [switch_simplify]: 7.35e-06 [remove_dup_value]: 4.307e-05 [partial_unused_args_eliminate]: 2.99001e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 5.909e-05 [cse_after_recomputation]: 2.899e-05, [1] [Cycle 1]: 2.174e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 7.38999e-06 [opt_after_jit_grad]: 0.00053604 [symbol_engine_optimizer]: 8.722e-05, [1] [Cycle 1]: 7.945e-05, [6] [build]: 4.54998e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.576e-05 [opt_reshape]: 8.26002e-06 [fold_const_symbol]: 1.126e-05 [renormalize]: 5.8001e-07 [validate]: 5.097e-05 Sums bootstrap : 0.000461s : 2.63% type_inference : 0.011483s : 65.50% event_method : 0.000021s : 0.12% auto_monad : 0.000089s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000058s : 0.33% rewriter_before_opt_a : 0.000086s : 0.49% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000138s : 0.79% jit_opt_a.loop_unroll : 0.000041s : 0.23% jit_opt_a.a_1 : 0.001099s : 6.27% jit_opt_a.with_stream_mark : 0.000033s : 0.19% jit_opt_a.recompute_prepare : 0.000015s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000014s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001197s : 6.83% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.14% jit_opt_a.cse : 0.000057s : 0.33% jit_opt_a.replace_applicator : 0.000022s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.09% rewriter_after_opt_a : 0.000061s : 0.35% convert_after_rewriter : 0.000010s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000903s : 5.15% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.11% cconv : 0.000031s : 0.18% loop_unroll : 0.000509s : 2.90% jit_opt_after_cconv.c_1 : 0.000025s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000045s : 0.26% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.04% remove_dup_value : 0.000043s : 0.25% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000059s : 0.34% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000019s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000536s : 3.06% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.29% Time group info: ------[substitution.] 0.000330 24 0.79% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000007s : 3: substitution.graph_param_transform 88.02% : 0.000291s : 5: substitution.inline 0.95% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.52% : 0.000005s : 4: substitution.remove_not_recompute_node 1.53% : 0.000005s : 2: substitution.replace_old_param 4.64% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011395 2 86.40% : 0.009844s : 1: type_inference.infer 13.60% : 0.001550s : 1: type_inference.specialize ------[replace.] 0.000142 7 66.36% : 0.000094s : 5: replace.inline 33.64% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000302 7 95.47% : 0.000288s : 5: match.inline 4.53% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 747 1.12% : 0.000002s : 11: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.89% : 0.000001s : 11: predicate.addn_check_dump 1.71% : 0.000003s : 11: predicate.addn_zero_filter 2.62% : 0.000004s : 11: predicate.arithmetic_simplify 1.60% : 0.000002s : 11: predicate.cast_eliminate 0.78% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 11: predicate.compare_switch_simplify 1.14% : 0.000002s : 11: predicate.depend_value_elim 0.97% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 11: predicate.environ_get_depend_swap 1.55% : 0.000002s : 11: predicate.environ_get_eliminate 1.19% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000001s : 3: predicate.graph_param_transform 4.80% : 0.000007s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.78% : 0.000003s : 6: predicate.less_batch_normalization 1.77% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 16: predicate.load_eliminater 1.14% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 11: predicate.merge_addn 1.17% : 0.000002s : 11: predicate.minmaximum_grad 2.57% : 0.000004s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000002s : 11: predicate.print_const_string_wrapper 1.89% : 0.000003s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 1.03% : 0.000002s : 6: predicate.remove_not_recompute_node 1.83% : 0.000003s : 19: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.68% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 11: predicate.reshape_eliminate 1.56% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 11: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.94% : 0.000004s : 18: predicate.switch_defer_inline 2.31% : 0.000004s : 18: predicate.switch_layer_defer_inline 6.79% : 0.000010s : 59: predicate.switch_simplify 1.71% : 0.000003s : 11: predicate.tile_eliminate 1.35% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001222 16 48.41% : 0.000591s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.80% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.79% : 0.000547s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025247 72 0.25% : 0.000062s : 1: add_recomputation 0.37% : 0.000093s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.90% : 0.000479s : 1: bootstrap 0.13% : 0.000034s : 1: cconv 0.05% : 0.000013s : 1: convert_after_rewriter 0.12% : 0.000031s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.10% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 29.72% : 0.007503s : 1: jit_opt_a 0.83% : 0.000210s : 1: jit_opt_after_cconv 0.25% : 0.000063s : 1: jit_opt_b 2.05% : 0.000518s : 1: loop_unroll 3.62% : 0.000915s : 1: mutable_eliminate 5.59% : 0.001411s : 26: opt.transform.jit_opt_a 0.32% : 0.000081s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000033s : 4: opt.transform.jit_opt_b 0.06% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000019s : 1: opt.transform.mutable_eliminate 0.09% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.16% : 0.000545s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000061s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000046s : 1: remove_dup_value 2.56% : 0.000645s : 1: renormalize.infer 2.15% : 0.000542s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000064s : 1: rewriter_after_opt_a 0.35% : 0.000089s : 1: rewriter_before_opt_a 0.36% : 0.000090s : 1: symbol_engine_optimizer 45.55% : 0.011499s : 1: type_inference TotalTime = 0.201097, [30] [bootstrap]: 0.00033183 [type_inference]: 0.128227 [event_method]: 1.773e-05 [auto_monad]: 6.882e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.00025881 [rewriter_before_opt_a]: 8.054e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00785029, [2] [Cycle 1]: 0.00323293, [27] [switch_simplify]: 5.914e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.00060898 [with_stream_mark]: 2.221e-05 [recompute_prepare]: 8.67998e-06 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.496e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.99999e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 0.00214456 [add_forward_monad_depend]: 8.49998e-06 [auto_monad_grad]: 3.08e-06 [auto_monad_eliminator]: 2.036e-05 [cse]: 3.375e-05 [replace_applicator]: 2.067e-05 [Cycle 2]: 0.00037063, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.00012359 [with_stream_mark]: 1.205e-05 [recompute_prepare]: 6.08002e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.00002e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.59998e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.57002e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.106e-05 [replace_applicator]: 6.33e-06 [py_interpret_to_execute_after_opt_a]: 1.428e-05 [rewriter_after_opt_a]: 3.788e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.0624284 [jit_opt_b]: 7.359e-05, [1] [Cycle 1]: 6.25e-05, [2] [frontend_op_eliminate]: 2.553e-05 [inline_after_opt_a]: 2.377e-05 [cconv]: 4.345e-05 [loop_unroll]: 0.00050549 [jit_opt_after_cconv]: 0.00019864, [1] [Cycle 1]: 0.00019149, [11] [c_1]: 2.825e-05 [parameter_eliminate]: 7.05e-06 [updatestate_depend_eliminate]: 1.158e-05 [updatestate_assign_eliminate]: 3.42997e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 4.256e-05 [call_graph_tuple_transform]: 2.855e-05 [tuple_list_get_item_eliminator]: 6.08998e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 9.10019e-07 [switch_simplify]: 6.41998e-06 [remove_dup_value]: 1.792e-05 [partial_unused_args_eliminate]: 3.83001e-06 [environ_conv]: 1.17e-05 [add_recomputation]: 5.535e-05 [cse_after_recomputation]: 2.306e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.216e-05 [auto_monad_reorder]: 1.61e-05 [get_jit_bprop_graph]: 2.48998e-06 [rewriter_after_jit_bprop_graph]: 1.103e-05 [opt_after_jit_grad]: 0.0004646 [symbol_engine_optimizer]: 8.16e-05, [1] [Cycle 1]: 7.414e-05, [6] [build]: 4.78001e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.501e-05 [opt_reshape]: 7.1e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 6.00005e-07 [validate]: 5.584e-05 Sums bootstrap : 0.000332s : 0.17% type_inference : 0.128227s : 65.34% event_method : 0.000018s : 0.01% auto_monad : 0.000069s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000259s : 0.13% rewriter_before_opt_a : 0.000081s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000733s : 0.37% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002145s : 1.09% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.062428s : 31.81% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000043s : 0.02% loop_unroll : 0.000505s : 0.26% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000055s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000465s : 0.24% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000245 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000008s : 4: substitution.graph_param_transform 83.68% : 0.000205s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000005s : 4: substitution.remove_not_recompute_node 2.52% : 0.000006s : 2: substitution.replace_old_param 5.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128152 2 98.55% : 0.126291s : 1: type_inference.infer 1.45% : 0.001862s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.53% : 0.000049s : 4: replace.inline 31.47% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.31% : 0.000203s : 4: match.inline 5.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.59% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.16% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000001s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.33% : 0.000009s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.01% : 0.000003s : 18: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 3.07% : 0.000004s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.44% : 0.000002s : 12: predicate.reduce_eliminate 1.26% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.89% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.48% : 0.000002s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.86% : 0.000010s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002300 26 71.31% : 0.001640s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.26% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.44% : 0.000608s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.204301 72 0.03% : 0.000058s : 1: add_recomputation 0.04% : 0.000072s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.17% : 0.000350s : 1: bootstrap 0.02% : 0.000047s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.01% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.84% : 0.007854s : 1: jit_opt_a 0.10% : 0.000201s : 1: jit_opt_after_cconv 0.04% : 0.000077s : 1: jit_opt_b 0.25% : 0.000515s : 1: loop_unroll 30.57% : 0.062448s : 1: mutable_eliminate 0.48% : 0.000971s : 26: opt.transform.jit_opt_a 0.03% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000033s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000473s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000264s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.69% : 0.001416s : 1: renormalize.infer 0.35% : 0.000718s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000086s : 1: rewriter_before_opt_a 0.04% : 0.000084s : 1: symbol_engine_optimizer 62.77% : 0.128240s : 1: type_inference TotalTime = 0.170754, [30] [bootstrap]: 0.00025036 [type_inference]: 0.141031 [event_method]: 0.0006215 [auto_monad]: 0.00011474 [graph_reusing]: 7.35e-06 [pre_auto_parallel]: 3.4e-06 [py_interpret_to_execute]: 6.518e-05 [rewriter_before_opt_a]: 0.00012972 [expand_dump_flag]: 4.55999e-06 [jit_opt_a]: 0.0261661, [3] [Cycle 1]: 0.0181693, [27] [switch_simplify]: 7.486e-05 [loop_unroll]: 4.441e-05 [a_1]: 0.00104399 [with_stream_mark]: 3.181e-05 [recompute_prepare]: 2.201e-05 [updatestate_depend_eliminate]: 8.87e-06 [updatestate_assign_eliminate]: 7.31999e-06 [updatestate_loads_eliminate]: 6.91001e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 1.537e-05 [updatestate_useless_node_eliminater]: 1.356e-05 [accelerated_algorithm]: 1.475e-05 [meta_shard_fg_expand]: 4.58999e-06 [get_grad_eliminate_]: 1.44e-05 [merge_forward]: 9.54e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.888e-05 [j_node_and_user_rematch]: 2.609e-05 [meta_fg_expand]: 0.00211403 [replace_old_param]: 8.572e-05 [inline_without_move]: 6.992e-05 [renormalize]: 0.0137897 [add_forward_monad_depend]: 1.27e-05 [auto_monad_grad]: 6.59999e-06 [auto_monad_eliminator]: 6.575e-05 [cse]: 0.00028813 [replace_applicator]: 9.554e-05 [Cycle 2]: 0.00411136, [27] [switch_simplify]: 4.619e-05 [loop_unroll]: 4.417e-05 [a_1]: 0.00131198 [with_stream_mark]: 1.971e-05 [recompute_prepare]: 1.17e-05 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 4.05998e-06 [updatestate_loads_eliminate]: 4.70999e-06 [parameter_eliminate]: 1.98997e-06 [specialize_transform]: 9.57999e-06 [updatestate_useless_node_eliminater]: 8.59e-06 [accelerated_algorithm]: 8.84e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 8.50001e-06 [merge_forward]: 5.21998e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.829e-05 [j_node_and_user_rematch]: 1.415e-05 [meta_fg_expand]: 0.00012715 [replace_old_param]: 1.027e-05 [inline_without_move]: 8.18001e-06 [renormalize]: 0.0022042 [add_forward_monad_depend]: 6.88998e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 1.185e-05 [cse]: 2.286e-05 [replace_applicator]: 1.465e-05 [Cycle 3]: 0.00027826, [27] [switch_simplify]: 5.57999e-06 [loop_unroll]: 4.23999e-06 [a_1]: 4.907e-05 [with_stream_mark]: 9.72001e-06 [recompute_prepare]: 3.63e-06 [updatestate_depend_eliminate]: 2.14e-06 [updatestate_assign_eliminate]: 1.73002e-06 [updatestate_loads_eliminate]: 1.45001e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 4.13001e-06 [updatestate_useless_node_eliminater]: 3.24001e-06 [accelerated_algorithm]: 3.99002e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 3.86999e-06 [merge_forward]: 2.53003e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.14e-05 [j_node_and_user_rematch]: 5.81e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 3.15998e-06 [inline_without_move]: 3.33e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 4e-06 [cse]: 9.74e-06 [replace_applicator]: 3.55e-06 [py_interpret_to_execute_after_opt_a]: 1.187e-05 [rewriter_after_opt_a]: 3.434e-05 [convert_after_rewriter]: 6.01e-06 [order_py_execute_after_rewriter]: 4.38999e-06 [mutable_eliminate]: 0.00073383 [jit_opt_b]: 4.693e-05, [1] [Cycle 1]: 3.871e-05, [2] [frontend_op_eliminate]: 1.252e-05 [inline_after_opt_a]: 1.238e-05 [cconv]: 2.822e-05 [loop_unroll]: 0.00045092 [jit_opt_after_cconv]: 0.00013548, [1] [Cycle 1]: 0.00012679, [11] [c_1]: 1.282e-05 [parameter_eliminate]: 3.48e-06 [updatestate_depend_eliminate]: 6.02001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 1.48002e-06 [cse]: 2.133e-05 [call_graph_tuple_transform]: 1.485e-05 [tuple_list_get_item_eliminator]: 3.75e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 3.72002e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 7.35e-06 [add_recomputation]: 3.55e-05 [cse_after_recomputation]: 2.171e-05, [1] [Cycle 1]: 1.675e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.343e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 4.59998e-06 [opt_after_jit_grad]: 0.00045376 [symbol_engine_optimizer]: 7.021e-05, [1] [Cycle 1]: 6.425e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.15e-06 [elim_not_effective]: 1.04e-05 [opt_reshape]: 3.97e-06 [fold_const_symbol]: 7.61001e-06 [renormalize]: 3.30008e-07 [validate]: 3.675e-05 Sums bootstrap : 0.000250s : 0.15% type_inference : 0.141031s : 84.86% event_method : 0.000621s : 0.37% auto_monad : 0.000115s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000065s : 0.04% rewriter_before_opt_a : 0.000130s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000127s : 0.08% jit_opt_a.loop_unroll : 0.000093s : 0.06% jit_opt_a.a_1 : 0.002405s : 1.45% jit_opt_a.with_stream_mark : 0.000061s : 0.04% jit_opt_a.recompute_prepare : 0.000037s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.03% jit_opt_a.meta_fg_expand : 0.002243s : 1.35% jit_opt_a.replace_old_param : 0.000099s : 0.06% jit_opt_a.inline_without_move : 0.000081s : 0.05% jit_opt_a.renormalize : 0.015994s : 9.62% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.05% jit_opt_a.cse : 0.000321s : 0.19% jit_opt_a.replace_applicator : 0.000114s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000734s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000451s : 0.27% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000035s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000454s : 0.27% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.02% Time group info: ------[substitution.] 0.000677 107 0.20% : 0.000001s : 1: substitution.elim_not_effective 0.13% : 0.000001s : 1: substitution.fold_const_symbol 0.58% : 0.000004s : 1: substitution.graph_param_transform 65.24% : 0.000441s : 13: substitution.inline 3.55% : 0.000024s : 2: substitution.inline_without_move 1.50% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.81% : 0.000012s : 7: substitution.minmaximum_grad 1.23% : 0.000008s : 5: substitution.partial_eliminate 1.67% : 0.000011s : 13: substitution.remove_not_recompute_node 4.77% : 0.000032s : 10: substitution.replace_applicator 1.24% : 0.000008s : 10: substitution.replace_old_param 1.16% : 0.000008s : 1: substitution.reshape_eliminate 0.39% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.94% : 0.000006s : 1: substitution.tile_eliminate 3.59% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.42% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 9.58% : 0.000065s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.140925 2 97.14% : 0.136894s : 1: type_inference.infer 2.86% : 0.004031s : 1: type_inference.specialize ------[replace.] 0.000199 20 66.01% : 0.000131s : 13: replace.inline 33.99% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000456 20 94.85% : 0.000433s : 13: match.inline 5.15% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000390 2656 1.66% : 0.000006s : 46: predicate.accumulaten_eliminater 0.17% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 46: predicate.addn_check_dump 1.67% : 0.000007s : 46: predicate.addn_zero_filter 2.08% : 0.000008s : 46: predicate.arithmetic_simplify 1.67% : 0.000007s : 46: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.44% : 0.000006s : 46: predicate.compare_switch_simplify 1.51% : 0.000006s : 46: predicate.depend_value_elim 1.47% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.59% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.54% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.20% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.55% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.39% : 0.000005s : 46: predicate.environ_get_depend_swap 1.88% : 0.000007s : 46: predicate.environ_get_eliminate 1.41% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000003s : 19: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.17% : 0.000016s : 68: predicate.inline 2.22% : 0.000009s : 47: predicate.inline_without_move 0.36% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.02% : 0.000004s : 19: predicate.less_batch_normalization 1.76% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.92% : 0.000008s : 54: predicate.load_eliminater 0.23% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.58% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.71% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 46: predicate.merge_addn 1.46% : 0.000006s : 46: predicate.minmaximum_grad 0.47% : 0.000002s : 1: predicate.mutable_eliminate 0.13% : 0.000000s : 1: predicate.opt_reshape 2.26% : 0.000009s : 54: predicate.partial_eliminate 1.63% : 0.000006s : 46: predicate.print_const_string_wrapper 1.99% : 0.000008s : 46: predicate.reduce_eliminate 1.82% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 19: predicate.remove_not_recompute_node 2.77% : 0.000011s : 100: predicate.replace_applicator 1.12% : 0.000004s : 47: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.66% : 0.000006s : 46: predicate.reshape_eliminate 1.51% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.56% : 0.000006s : 46: predicate.same_eliminate 0.51% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.12% : 0.000000s : 2: predicate.special_op_eliminate 0.87% : 0.000003s : 19: predicate.specialize_transform 1.69% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.81% : 0.000011s : 66: predicate.switch_defer_inline 2.64% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.48% : 0.000025s : 161: predicate.switch_simplify 1.56% : 0.000006s : 46: predicate.tile_eliminate 1.46% : 0.000006s : 46: predicate.transpose_eliminate 2.03% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.89% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 2.93% : 0.000011s : 55: predicate.tuple_list_get_item_eliminator 2.09% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.89% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.73% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.81% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.90% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.17% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007046 45 86.03% : 0.006062s : 28: func_graph_cloner_run.FuncGraphClonerGraph 13.97% : 0.000984s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.189806 87 0.02% : 0.000038s : 1: add_recomputation 0.06% : 0.000121s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.14% : 0.000272s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.33% : 0.000629s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 13.79% : 0.026171s : 1: jit_opt_a 0.07% : 0.000138s : 1: jit_opt_after_cconv 0.03% : 0.000050s : 1: jit_opt_b 0.24% : 0.000459s : 1: loop_unroll 0.39% : 0.000743s : 1: mutable_eliminate 1.64% : 0.003118s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000461s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000068s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.14% : 0.013556s : 2: renormalize.infer 1.27% : 0.002416s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000133s : 1: rewriter_before_opt_a 0.04% : 0.000072s : 1: symbol_engine_optimizer 74.31% : 0.141045s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.750.436 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e040> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.751.197 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0383677, [30] [bootstrap]: 0.00029025 [type_inference]: 0.0296314 [event_method]: 2.96e-05 [auto_monad]: 8.236e-05 [graph_reusing]: 6.71e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 7.381e-05 [rewriter_before_opt_a]: 9.65e-05 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.00558001, [2] [Cycle 1]: 0.00184948, [27] [switch_simplify]: 5.92e-05 [loop_unroll]: 3.378e-05 [a_1]: 0.00064101 [with_stream_mark]: 2.032e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 4.02e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.51998e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 0.0007575 [add_forward_monad_depend]: 5.29e-06 [auto_monad_grad]: 2.16e-06 [auto_monad_eliminator]: 1.525e-05 [cse]: 3.866e-05 [replace_applicator]: 1.339e-05 [Cycle 2]: 0.00032861, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 5.20999e-06 [a_1]: 9.057e-05 [with_stream_mark]: 9.91e-06 [recompute_prepare]: 5.43002e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 4.97e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.253e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 6.81001e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.77999e-06 [cse]: 1.537e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.155e-05 [rewriter_after_opt_a]: 3.875e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00054132 [jit_opt_b]: 5.358e-05, [1] [Cycle 1]: 4.715e-05, [2] [frontend_op_eliminate]: 1.809e-05 [inline_after_opt_a]: 1.748e-05 [cconv]: 2.728e-05 [loop_unroll]: 0.00063683 [jit_opt_after_cconv]: 0.00016845, [1] [Cycle 1]: 0.00016105, [11] [c_1]: 2.173e-05 [parameter_eliminate]: 3.83001e-06 [updatestate_depend_eliminate]: 7.96001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.61999e-06 [cse]: 3.567e-05 [call_graph_tuple_transform]: 2.077e-05 [tuple_list_get_item_eliminator]: 5.56998e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 4.416e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 5.404e-05 [cse_after_recomputation]: 2.609e-05, [1] [Cycle 1]: 1.971e-05, [1] [cse]: 1.317e-05 [auto_monad_reorder]: 1.941e-05 [get_jit_bprop_graph]: 2.08002e-06 [rewriter_after_jit_bprop_graph]: 6.69999e-06 [opt_after_jit_grad]: 0.00055777 [symbol_engine_optimizer]: 8.137e-05, [1] [Cycle 1]: 7.382e-05, [6] [build]: 4.22998e-06 [elim_shapecalc]: 9.22999e-06 [elim_not_effective]: 1.506e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 1.058e-05 [renormalize]: 6.50005e-07 [validate]: 8.541e-05 Sums bootstrap : 0.000290s : 0.84% type_inference : 0.029631s : 86.23% event_method : 0.000030s : 0.09% auto_monad : 0.000082s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000074s : 0.21% rewriter_before_opt_a : 0.000096s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.19% jit_opt_a.loop_unroll : 0.000039s : 0.11% jit_opt_a.a_1 : 0.000732s : 2.13% jit_opt_a.with_stream_mark : 0.000030s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000758s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000054s : 0.16% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000039s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000541s : 1.58% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000027s : 0.08% loop_unroll : 0.000637s : 1.85% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000044s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000558s : 1.62% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000085s : 0.25% Time group info: ------[substitution.] 0.000243 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 3: substitution.graph_param_transform 85.94% : 0.000208s : 5: substitution.inline 1.16% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000004s : 4: substitution.remove_not_recompute_node 1.60% : 0.000004s : 2: substitution.replace_old_param 5.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029520 2 24.91% : 0.007353s : 1: type_inference.infer 75.09% : 0.022167s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.17% : 0.000065s : 5: replace.inline 32.83% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 94.59% : 0.000205s : 5: match.inline 5.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.32% : 0.000002s : 11: predicate.accumulaten_eliminater 1.48% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.20% : 0.000002s : 11: predicate.addn_zero_filter 1.88% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.19% : 0.000001s : 11: predicate.depend_value_elim 1.08% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.18% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000008s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 16: predicate.load_eliminater 1.82% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 16: predicate.partial_eliminate 1.28% : 0.000002s : 11: predicate.print_const_string_wrapper 1.92% : 0.000002s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.44% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.34% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.78% : 0.000010s : 59: predicate.switch_simplify 1.20% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.40% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.88% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000793 16 53.59% : 0.000425s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.45% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.96% : 0.000309s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040104 72 0.14% : 0.000057s : 1: add_recomputation 0.21% : 0.000085s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.77% : 0.000308s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000034s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.92% : 0.005583s : 1: jit_opt_a 0.43% : 0.000172s : 1: jit_opt_after_cconv 0.14% : 0.000056s : 1: jit_opt_b 1.62% : 0.000650s : 1: loop_unroll 1.37% : 0.000549s : 1: mutable_eliminate 2.38% : 0.000954s : 26: opt.transform.jit_opt_a 0.13% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.06% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.42% : 0.000568s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000077s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000048s : 1: remove_dup_value 1.06% : 0.000424s : 1: renormalize.infer 0.81% : 0.000325s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.25% : 0.000100s : 1: rewriter_before_opt_a 0.21% : 0.000084s : 1: symbol_engine_optimizer 73.94% : 0.029653s : 1: type_inference TotalTime = 0.0128687, [30] [bootstrap]: 0.00029315 [type_inference]: 0.00449228 [event_method]: 1.677e-05 [auto_monad]: 6.686e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 3.612e-05 [rewriter_before_opt_a]: 7.051e-05 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.00558047, [2] [Cycle 1]: 0.00165568, [27] [switch_simplify]: 5.296e-05 [loop_unroll]: 2.92e-05 [a_1]: 0.00054391 [with_stream_mark]: 1.891e-05 [recompute_prepare]: 7.56999e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.02998e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.00069439 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.375e-05 [cse]: 3.109e-05 [replace_applicator]: 1.061e-05 [Cycle 2]: 0.00031197, [27] [switch_simplify]: 5.40999e-06 [loop_unroll]: 4.76002e-06 [a_1]: 8.703e-05 [with_stream_mark]: 9.36e-06 [recompute_prepare]: 4.87998e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 4.84998e-06 [meta_shard_fg_expand]: 9.99979e-07 [get_grad_eliminate_]: 4.47e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 7.36001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 1.306e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 1.369e-05 [rewriter_after_opt_a]: 3.747e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00051492 [jit_opt_b]: 4.723e-05, [1] [Cycle 1]: 4.088e-05, [2] [frontend_op_eliminate]: 1.497e-05 [inline_after_opt_a]: 1.5e-05 [cconv]: 2.552e-05 [loop_unroll]: 0.00039899 [jit_opt_after_cconv]: 0.00014257, [1] [Cycle 1]: 0.00013069, [11] [c_1]: 2.034e-05 [parameter_eliminate]: 2.55002e-06 [updatestate_depend_eliminate]: 5.47001e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 1.997e-05 [call_graph_tuple_transform]: 1.729e-05 [tuple_list_get_item_eliminator]: 5.37999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.628e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 4.836e-05 [cse_after_recomputation]: 2.267e-05, [1] [Cycle 1]: 1.744e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.08002e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00072396 [symbol_engine_optimizer]: 7.055e-05, [1] [Cycle 1]: 6.448e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.256e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.25999e-06 [renormalize]: 4.19997e-07 [validate]: 3.782e-05 Sums bootstrap : 0.000293s : 3.37% type_inference : 0.004492s : 51.59% event_method : 0.000017s : 0.19% auto_monad : 0.000067s : 0.77% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.41% rewriter_before_opt_a : 0.000071s : 0.81% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000058s : 0.67% jit_opt_a.loop_unroll : 0.000034s : 0.39% jit_opt_a.a_1 : 0.000631s : 7.25% jit_opt_a.with_stream_mark : 0.000028s : 0.32% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000694s : 7.98% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.22% jit_opt_a.cse : 0.000044s : 0.51% jit_opt_a.replace_applicator : 0.000016s : 0.18% py_interpret_to_execute_after_opt_a : 0.000014s : 0.16% rewriter_after_opt_a : 0.000037s : 0.43% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000515s : 5.91% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.29% loop_unroll : 0.000399s : 4.58% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.56% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000018s : 0.21% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000724s : 8.31% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.43% Time group info: ------[substitution.] 0.000219 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000005s : 3: substitution.graph_param_transform 85.92% : 0.000189s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000004s : 4: substitution.remove_not_recompute_node 1.56% : 0.000003s : 2: substitution.replace_old_param 5.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004431 2 81.59% : 0.003615s : 1: type_inference.infer 18.41% : 0.000816s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.36% : 0.000048s : 4: replace.inline 31.64% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.52% : 0.000186s : 4: match.inline 5.48% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.42% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.10% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.73% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.26% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000614 13 52.43% : 0.000322s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.46% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.11% : 0.000246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014452 72 0.35% : 0.000051s : 1: add_recomputation 0.48% : 0.000070s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.13% : 0.000308s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.64% : 0.005584s : 1: jit_opt_a 1.00% : 0.000145s : 1: jit_opt_after_cconv 0.34% : 0.000050s : 1: jit_opt_b 2.81% : 0.000406s : 1: loop_unroll 3.62% : 0.000523s : 1: mutable_eliminate 5.77% : 0.000834s : 26: opt.transform.jit_opt_a 0.31% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 5.07% : 0.000733s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000039s : 1: py_interpret_to_execute 0.11% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.67% : 0.000386s : 1: renormalize.infer 2.08% : 0.000301s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000040s : 1: rewriter_after_opt_a 0.51% : 0.000073s : 1: rewriter_before_opt_a 0.51% : 0.000073s : 1: symbol_engine_optimizer 31.17% : 0.004504s : 1: type_inference TotalTime = 0.0936396, [30] [bootstrap]: 0.00026835 [type_inference]: 0.0850099 [event_method]: 2.335e-05 [auto_monad]: 7.606e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00012816 [rewriter_before_opt_a]: 8.235e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00590012, [2] [Cycle 1]: 0.00196138, [27] [switch_simplify]: 5.796e-05 [loop_unroll]: 3.111e-05 [a_1]: 0.00055442 [with_stream_mark]: 2.103e-05 [recompute_prepare]: 7.84002e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.54999e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00096258 [add_forward_monad_depend]: 4.87998e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.517e-05 [cse]: 3.469e-05 [replace_applicator]: 1.248e-05 [Cycle 2]: 0.00031728, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.16998e-06 [a_1]: 9.118e-05 [with_stream_mark]: 8.54002e-06 [recompute_prepare]: 5.16002e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 5.16998e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 7.66001e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 7.20003e-06 [inline_without_move]: 4.87998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.294e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.129e-05 [rewriter_after_opt_a]: 3.712e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.0005182 [jit_opt_b]: 4.869e-05, [1] [Cycle 1]: 4.208e-05, [2] [frontend_op_eliminate]: 1.537e-05 [inline_after_opt_a]: 1.589e-05 [cconv]: 2.615e-05 [loop_unroll]: 0.00044164 [jit_opt_after_cconv]: 0.00014252, [1] [Cycle 1]: 0.00013627, [11] [c_1]: 2.071e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.13e-05 [call_graph_tuple_transform]: 1.841e-05 [tuple_list_get_item_eliminator]: 5.95002e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 6.41998e-06 [add_recomputation]: 5.251e-05 [cse_after_recomputation]: 2.321e-05, [1] [Cycle 1]: 1.759e-05, [1] [cse]: 1.209e-05 [auto_monad_reorder]: 1.79e-05 [get_jit_bprop_graph]: 1.66e-06 [rewriter_after_jit_bprop_graph]: 4.99998e-06 [opt_after_jit_grad]: 0.00046389 [symbol_engine_optimizer]: 9.613e-05, [1] [Cycle 1]: 8.924e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 7.59002e-06 [elim_not_effective]: 3.447e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 5.09986e-07 [validate]: 4.076e-05 Sums bootstrap : 0.000268s : 0.30% type_inference : 0.085010s : 95.04% event_method : 0.000023s : 0.03% auto_monad : 0.000076s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000128s : 0.14% rewriter_before_opt_a : 0.000082s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.07% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000646s : 0.72% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000963s : 1.08% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000048s : 0.05% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000037s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000518s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000442s : 0.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000464s : 0.52% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000034s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.05% Time group info: ------[substitution.] 0.000221 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 3: substitution.graph_param_transform 85.04% : 0.000188s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 5.70% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.084920 2 79.72% : 0.067698s : 1: type_inference.infer 20.28% : 0.017222s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.15% : 0.000048s : 4: replace.inline 31.85% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.16% : 0.000185s : 4: match.inline 5.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.49% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000006s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016119 13 2.13% : 0.000344s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.29% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 97.57% : 0.015728s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.095520 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000079s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.30% : 0.000284s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.18% : 0.005903s : 1: jit_opt_a 0.15% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000051s : 1: jit_opt_b 0.47% : 0.000450s : 1: loop_unroll 0.55% : 0.000527s : 1: mutable_eliminate 0.90% : 0.000862s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000132s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.58% : 0.000558s : 1: renormalize.infer 0.41% : 0.000395s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000086s : 1: rewriter_before_opt_a 0.10% : 0.000099s : 1: symbol_engine_optimizer 89.02% : 0.085033s : 1: type_inference TotalTime = 0.13315, [30] [bootstrap]: 0.00027618 [type_inference]: 0.0893723 [event_method]: 0.00044559 [auto_monad]: 0.00011801 [graph_reusing]: 7.47002e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 3.932e-05 [rewriter_before_opt_a]: 0.00014141 [expand_dump_flag]: 3.74002e-06 [jit_opt_a]: 0.0403678, [3] [Cycle 1]: 0.0237405, [27] [switch_simplify]: 9.825e-05 [loop_unroll]: 4.905e-05 [a_1]: 0.00114056 [with_stream_mark]: 3.877e-05 [recompute_prepare]: 2.301e-05 [updatestate_depend_eliminate]: 9.17001e-06 [updatestate_assign_eliminate]: 7.78001e-06 [updatestate_loads_eliminate]: 6.72002e-06 [parameter_eliminate]: 2.92002e-06 [specialize_transform]: 1.559e-05 [updatestate_useless_node_eliminater]: 1.414e-05 [accelerated_algorithm]: 1.573e-05 [meta_shard_fg_expand]: 4.28999e-06 [get_grad_eliminate_]: 1.516e-05 [merge_forward]: 9.48997e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.975e-05 [j_node_and_user_rematch]: 2.629e-05 [meta_fg_expand]: 0.00221895 [replace_old_param]: 7.155e-05 [inline_without_move]: 6.31e-05 [renormalize]: 0.019034 [add_forward_monad_depend]: 1.256e-05 [auto_monad_grad]: 6.70002e-06 [auto_monad_eliminator]: 6.652e-05 [cse]: 0.00030912 [replace_applicator]: 0.00017433 [Cycle 2]: 0.00461016, [27] [switch_simplify]: 4.75e-05 [loop_unroll]: 4.478e-05 [a_1]: 0.00133156 [with_stream_mark]: 2.071e-05 [recompute_prepare]: 1.194e-05 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 4.31002e-06 [updatestate_loads_eliminate]: 4.97999e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 9.29e-06 [updatestate_useless_node_eliminater]: 8.62998e-06 [accelerated_algorithm]: 9.25999e-06 [meta_shard_fg_expand]: 3.25e-06 [get_grad_eliminate_]: 8.95001e-06 [merge_forward]: 4.97999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.954e-05 [j_node_and_user_rematch]: 1.456e-05 [meta_fg_expand]: 0.00014139 [replace_old_param]: 1.134e-05 [inline_without_move]: 8.97999e-06 [renormalize]: 0.00264101 [add_forward_monad_depend]: 8.17e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.32e-05 [cse]: 2.403e-05 [replace_applicator]: 1.68e-05 [Cycle 3]: 0.00028278, [27] [switch_simplify]: 5.24998e-06 [loop_unroll]: 5.86e-06 [a_1]: 5.249e-05 [with_stream_mark]: 1.106e-05 [recompute_prepare]: 4.83001e-06 [updatestate_depend_eliminate]: 2.37001e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 1.77001e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 3.65998e-06 [updatestate_useless_node_eliminater]: 3.54002e-06 [accelerated_algorithm]: 3.97998e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 3.74002e-06 [merge_forward]: 2.95998e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 6.68e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 3.96001e-06 [inline_without_move]: 3.73001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 3.98999e-06 [cse]: 8.43999e-06 [replace_applicator]: 3.95e-06 [py_interpret_to_execute_after_opt_a]: 1.315e-05 [rewriter_after_opt_a]: 3.885e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.19003e-06 [mutable_eliminate]: 0.00076278 [jit_opt_b]: 4.506e-05, [1] [Cycle 1]: 3.789e-05, [2] [frontend_op_eliminate]: 1.192e-05 [inline_after_opt_a]: 1.264e-05 [cconv]: 2.975e-05 [loop_unroll]: 0.00044523 [jit_opt_after_cconv]: 0.0001362, [1] [Cycle 1]: 0.00012868, [11] [c_1]: 1.391e-05 [parameter_eliminate]: 3.10002e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 1.77001e-06 [cse]: 2.119e-05 [call_graph_tuple_transform]: 1.586e-05 [tuple_list_get_item_eliminator]: 3.98999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 3.73001e-06 [remove_dup_value]: 1.558e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 3.684e-05 [cse_after_recomputation]: 2.053e-05, [1] [Cycle 1]: 1.553e-05, [1] [cse]: 8.63001e-06 [auto_monad_reorder]: 1.306e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.29998e-06 [opt_after_jit_grad]: 0.00048252 [symbol_engine_optimizer]: 6.591e-05, [1] [Cycle 1]: 5.997e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 6.29999e-06 [elim_not_effective]: 1.051e-05 [opt_reshape]: 4.57e-06 [fold_const_symbol]: 6.16998e-06 [renormalize]: 4.40021e-07 [validate]: 3.342e-05 Sums bootstrap : 0.000276s : 0.23% type_inference : 0.089372s : 74.17% event_method : 0.000446s : 0.37% auto_monad : 0.000118s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.03% rewriter_before_opt_a : 0.000141s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000151s : 0.13% jit_opt_a.loop_unroll : 0.000100s : 0.08% jit_opt_a.a_1 : 0.002525s : 2.10% jit_opt_a.with_stream_mark : 0.000071s : 0.06% jit_opt_a.recompute_prepare : 0.000040s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000029s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000028s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.04% jit_opt_a.meta_fg_expand : 0.002362s : 1.96% jit_opt_a.replace_old_param : 0.000087s : 0.07% jit_opt_a.inline_without_move : 0.000076s : 0.06% jit_opt_a.renormalize : 0.021675s : 17.99% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000084s : 0.07% jit_opt_a.cse : 0.000342s : 0.28% jit_opt_a.replace_applicator : 0.000195s : 0.16% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000763s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000445s : 0.37% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000483s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000685 107 0.21% : 0.000001s : 1: substitution.elim_not_effective 0.13% : 0.000001s : 1: substitution.fold_const_symbol 0.70% : 0.000005s : 1: substitution.graph_param_transform 68.68% : 0.000471s : 13: substitution.inline 2.65% : 0.000018s : 2: substitution.inline_without_move 1.50% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.85% : 0.000013s : 7: substitution.minmaximum_grad 1.15% : 0.000008s : 5: substitution.partial_eliminate 1.61% : 0.000011s : 13: substitution.remove_not_recompute_node 5.17% : 0.000035s : 10: substitution.replace_applicator 1.01% : 0.000007s : 10: substitution.replace_old_param 0.99% : 0.000007s : 1: substitution.reshape_eliminate 0.47% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.93% : 0.000006s : 1: substitution.tile_eliminate 3.92% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.44% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.59% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.089251 2 94.14% : 0.084021s : 1: type_inference.infer 5.86% : 0.005230s : 1: type_inference.specialize ------[replace.] 0.000200 20 66.14% : 0.000132s : 13: replace.inline 33.86% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000485 20 95.33% : 0.000462s : 13: match.inline 4.67% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000423 2768 1.71% : 0.000007s : 48: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.37% : 0.000006s : 48: predicate.addn_check_dump 1.69% : 0.000007s : 48: predicate.addn_zero_filter 2.21% : 0.000009s : 48: predicate.arithmetic_simplify 1.58% : 0.000007s : 48: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.38% : 0.000006s : 48: predicate.compare_switch_simplify 1.55% : 0.000007s : 48: predicate.depend_value_elim 1.41% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.47% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.56% : 0.000007s : 48: predicate.dict_set_item_eliminator 0.19% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.59% : 0.000007s : 48: predicate.environ_get_depend_swap 1.49% : 0.000006s : 48: predicate.environ_get_eliminate 1.39% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.77% : 0.000003s : 20: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.40% : 0.000019s : 70: predicate.inline 1.95% : 0.000008s : 48: predicate.inline_without_move 0.36% : 0.000002s : 20: predicate.j_node_and_user_rematch 0.93% : 0.000004s : 20: predicate.less_batch_normalization 1.79% : 0.000008s : 55: predicate.list_to_tuple_eliminator_ 1.96% : 0.000008s : 56: predicate.load_eliminater 0.52% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.32% : 0.000014s : 101: predicate.loop_unroll_before_grad 2.08% : 0.000009s : 49: predicate.make_slice_get_slice_eliminator 1.44% : 0.000006s : 48: predicate.merge_addn 1.60% : 0.000007s : 48: predicate.minmaximum_grad 0.53% : 0.000002s : 1: predicate.mutable_eliminate 0.20% : 0.000001s : 1: predicate.opt_reshape 2.22% : 0.000009s : 56: predicate.partial_eliminate 1.54% : 0.000007s : 48: predicate.print_const_string_wrapper 2.25% : 0.000010s : 48: predicate.reduce_eliminate 1.73% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 20: predicate.remove_not_recompute_node 2.65% : 0.000011s : 103: predicate.replace_applicator 1.13% : 0.000005s : 48: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000007s : 48: predicate.reshape_eliminate 1.77% : 0.000007s : 48: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.46% : 0.000006s : 48: predicate.same_eliminate 0.58% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.76% : 0.000003s : 20: predicate.specialize_transform 1.82% : 0.000008s : 48: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000007s : 48: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.78% : 0.000012s : 68: predicate.switch_defer_inline 2.56% : 0.000011s : 68: predicate.switch_layer_defer_inline 6.58% : 0.000028s : 170: predicate.switch_simplify 1.62% : 0.000007s : 48: predicate.tile_eliminate 1.46% : 0.000006s : 48: predicate.transpose_eliminate 1.78% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000014s : 57: predicate.tuple_list_get_item_eliminator 1.94% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 1.98% : 0.000008s : 55: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.65% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.86% : 0.000008s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005638 64 80.14% : 0.004518s : 47: func_graph_cloner_run.FuncGraphClonerGraph 19.86% : 0.001120s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158163 87 0.02% : 0.000039s : 1: add_recomputation 0.08% : 0.000124s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.19% : 0.000301s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.29% : 0.000455s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 25.53% : 0.040372s : 1: jit_opt_a 0.09% : 0.000139s : 1: jit_opt_after_cconv 0.03% : 0.000048s : 1: jit_opt_b 0.29% : 0.000454s : 1: loop_unroll 0.49% : 0.000774s : 1: mutable_eliminate 2.11% : 0.003337s : 39: opt.transform.jit_opt_a 0.02% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000492s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 11.95% : 0.018902s : 2: renormalize.infer 1.74% : 0.002750s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000145s : 1: rewriter_before_opt_a 0.04% : 0.000068s : 1: symbol_engine_optimizer 56.52% : 0.089395s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.919.989 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e700> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:25.920.772 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0536082, [30] [bootstrap]: 0.00026725 [type_inference]: 0.00518037 [event_method]: 1.707e-05 [auto_monad]: 6.304e-05 [graph_reusing]: 5.54e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 3.354e-05 [rewriter_before_opt_a]: 7.418e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00499636, [2] [Cycle 1]: 0.00154167, [27] [switch_simplify]: 5.298e-05 [loop_unroll]: 2.943e-05 [a_1]: 0.00052404 [with_stream_mark]: 1.798e-05 [recompute_prepare]: 7.31001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.60003e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 8.84998e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.0005834 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.445e-05 [cse]: 3.491e-05 [replace_applicator]: 1.075e-05 [Cycle 2]: 0.00032332, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.79e-06 [a_1]: 8.835e-05 [with_stream_mark]: 8.18999e-06 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 4.88001e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.50001e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.272e-05 [j_node_and_user_rematch]: 7.99002e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.94e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.254e-05 [replace_applicator]: 5.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.105e-05 [rewriter_after_opt_a]: 3.66e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.0408503 [jit_opt_b]: 6.795e-05, [1] [Cycle 1]: 5.807e-05, [2] [frontend_op_eliminate]: 2.006e-05 [inline_after_opt_a]: 2.405e-05 [cconv]: 4.013e-05 [loop_unroll]: 0.00064637 [jit_opt_after_cconv]: 0.00020411, [1] [Cycle 1]: 0.0001964, [11] [c_1]: 2.299e-05 [parameter_eliminate]: 7.1e-06 [updatestate_depend_eliminate]: 1.285e-05 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [cse]: 4.76e-05 [call_graph_tuple_transform]: 2.475e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 8.80013e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 4.471e-05 [partial_unused_args_eliminate]: 2.98e-06 [environ_conv]: 8.75001e-06 [add_recomputation]: 6.109e-05 [cse_after_recomputation]: 3.103e-05, [1] [Cycle 1]: 2.495e-05, [1] [cse]: 1.602e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 9.18002e-06 [opt_after_jit_grad]: 0.0005746 [symbol_engine_optimizer]: 8.188e-05, [1] [Cycle 1]: 7.487e-05, [6] [build]: 4.65001e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.424e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 6.00005e-07 [validate]: 5.009e-05 Sums bootstrap : 0.000267s : 0.54% type_inference : 0.005180s : 10.40% event_method : 0.000017s : 0.03% auto_monad : 0.000063s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000034s : 0.07% rewriter_before_opt_a : 0.000074s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.12% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000612s : 1.23% jit_opt_a.with_stream_mark : 0.000026s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000583s : 1.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000047s : 0.10% jit_opt_a.replace_applicator : 0.000016s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000037s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.040850s : 81.98% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000024s : 0.05% cconv : 0.000040s : 0.08% loop_unroll : 0.000646s : 1.30% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000045s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000061s : 0.12% cse_after_recomputation.cse : 0.000016s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000575s : 1.15% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.10% Time group info: ------[substitution.] 0.000202 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.23% : 0.000007s : 3: substitution.graph_param_transform 83.31% : 0.000169s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 5.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005124 2 84.69% : 0.004339s : 1: type_inference.infer 15.31% : 0.000784s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.44% : 0.000044s : 4: replace.inline 32.56% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 94.07% : 0.000166s : 4: match.inline 5.93% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.01% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.98% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 4.27% : 0.000005s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.42% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.73% : 0.000001s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.77% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.10% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000613 13 55.12% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.32% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.56% : 0.000236s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055102 72 0.12% : 0.000066s : 1: add_recomputation 0.12% : 0.000066s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.52% : 0.000286s : 1: bootstrap 0.08% : 0.000043s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000033s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.07% : 0.004999s : 1: jit_opt_a 0.38% : 0.000207s : 1: jit_opt_after_cconv 0.13% : 0.000071s : 1: jit_opt_b 1.20% : 0.000660s : 1: loop_unroll 74.18% : 0.040877s : 1: mutable_eliminate 1.49% : 0.000820s : 26: opt.transform.jit_opt_a 0.10% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000034s : 4: opt.transform.jit_opt_b 0.03% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000037s : 1: opt.transform.mutable_eliminate 0.05% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.07% : 0.000587s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000036s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000048s : 1: remove_dup_value 0.58% : 0.000318s : 1: renormalize.infer 0.47% : 0.000259s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.14% : 0.000077s : 1: rewriter_before_opt_a 0.15% : 0.000085s : 1: symbol_engine_optimizer 9.42% : 0.005193s : 1: type_inference TotalTime = 0.0453779, [30] [bootstrap]: 0.00034952 [type_inference]: 0.0373606 [event_method]: 2.171e-05 [auto_monad]: 7.691e-05 [graph_reusing]: 7.01001e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 7.464e-05 [rewriter_before_opt_a]: 8.916e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00536027, [2] [Cycle 1]: 0.00178284, [27] [switch_simplify]: 5.728e-05 [loop_unroll]: 3.317e-05 [a_1]: 0.00060861 [with_stream_mark]: 1.706e-05 [recompute_prepare]: 7.82e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.16997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 6.10002e-06 [renormalize]: 0.00073481 [add_forward_monad_depend]: 4.80001e-06 [auto_monad_grad]: 1.87999e-06 [auto_monad_eliminator]: 1.472e-05 [cse]: 3.814e-05 [replace_applicator]: 1.195e-05 [Cycle 2]: 0.00031783, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.02999e-06 [a_1]: 8.886e-05 [with_stream_mark]: 8.35999e-06 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.01997e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.242e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 4.88001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.337e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.104e-05 [rewriter_after_opt_a]: 3.731e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.0004819 [jit_opt_b]: 4.853e-05, [1] [Cycle 1]: 4.204e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.582e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00040095 [jit_opt_after_cconv]: 0.00014242, [1] [Cycle 1]: 0.00013622, [11] [c_1]: 2.046e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.77999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.396e-05 [call_graph_tuple_transform]: 1.755e-05 [tuple_list_get_item_eliminator]: 5.56998e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.63002e-06 [remove_dup_value]: 3.011e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 5.79999e-06 [add_recomputation]: 5.816e-05 [cse_after_recomputation]: 2.452e-05, [1] [Cycle 1]: 1.912e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.47998e-06 [opt_after_jit_grad]: 0.00045409 [symbol_engine_optimizer]: 7.096e-05, [1] [Cycle 1]: 6.527e-05, [6] [build]: 3.22002e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.82001e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 4.69998e-07 [validate]: 3.487e-05 Sums bootstrap : 0.000350s : 0.84% type_inference : 0.037361s : 89.90% event_method : 0.000022s : 0.05% auto_monad : 0.000077s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000075s : 0.18% rewriter_before_opt_a : 0.000089s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.15% jit_opt_a.loop_unroll : 0.000038s : 0.09% jit_opt_a.a_1 : 0.000697s : 1.68% jit_opt_a.with_stream_mark : 0.000025s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000735s : 1.77% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000052s : 0.12% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000037s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000482s : 1.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.06% loop_unroll : 0.000401s : 0.96% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000030s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000058s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000454s : 1.09% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.08% Time group info: ------[substitution.] 0.000227 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.20% : 0.000005s : 3: substitution.graph_param_transform 85.19% : 0.000193s : 5: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 5.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037276 2 21.16% : 0.007889s : 1: type_inference.infer 78.84% : 0.029387s : 1: type_inference.specialize ------[replace.] 0.000089 7 68.17% : 0.000061s : 5: replace.inline 31.83% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 94.21% : 0.000191s : 5: match.inline 5.79% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.28% : 0.000002s : 11: predicate.addn_zero_filter 1.96% : 0.000002s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.21% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.29% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.07% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 1.19% : 0.000001s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 2.09% : 0.000003s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.67% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.35% : 0.000010s : 59: predicate.switch_simplify 1.30% : 0.000002s : 11: predicate.tile_eliminate 1.39% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000795 16 55.67% : 0.000443s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.18% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.15% : 0.000295s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047087 72 0.13% : 0.000061s : 1: add_recomputation 0.17% : 0.000080s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.79% : 0.000371s : 1: bootstrap 0.06% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 11.39% : 0.005363s : 1: jit_opt_a 0.31% : 0.000145s : 1: jit_opt_after_cconv 0.11% : 0.000051s : 1: jit_opt_b 0.87% : 0.000409s : 1: loop_unroll 1.04% : 0.000490s : 1: mutable_eliminate 1.95% : 0.000917s : 26: opt.transform.jit_opt_a 0.10% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.98% : 0.000462s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000077s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000033s : 1: remove_dup_value 0.87% : 0.000410s : 1: renormalize.infer 0.67% : 0.000317s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.20% : 0.000092s : 1: rewriter_before_opt_a 0.16% : 0.000074s : 1: symbol_engine_optimizer 79.37% : 0.037373s : 1: type_inference TotalTime = 0.0521511, [30] [bootstrap]: 0.00033119 [type_inference]: 0.0314621 [event_method]: 2.125e-05 [auto_monad]: 7.101e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 3.20002e-06 [py_interpret_to_execute]: 0.00010784 [rewriter_before_opt_a]: 8.164e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00537205, [2] [Cycle 1]: 0.00177374, [27] [switch_simplify]: 5.207e-05 [loop_unroll]: 2.931e-05 [a_1]: 0.00052344 [with_stream_mark]: 1.572e-05 [recompute_prepare]: 7.11999e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.35001e-06 [renormalize]: 0.00085012 [add_forward_monad_depend]: 5.52001e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 1.165e-05 [cse]: 1.963e-05 [replace_applicator]: 1.141e-05 [Cycle 2]: 0.0003077, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 4.99998e-06 [a_1]: 8.761e-05 [with_stream_mark]: 7.80998e-06 [recompute_prepare]: 5.14998e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.05001e-06 [meta_shard_fg_expand]: 1.03001e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 2.53003e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.19e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.61998e-06 [replace_old_param]: 6.94001e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.197e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.055e-05 [rewriter_after_opt_a]: 4.021e-05 [convert_after_rewriter]: 6.48e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.0128886 [jit_opt_b]: 6.311e-05, [1] [Cycle 1]: 5.265e-05, [2] [frontend_op_eliminate]: 1.858e-05 [inline_after_opt_a]: 2.054e-05 [cconv]: 4.383e-05 [loop_unroll]: 0.00047103 [jit_opt_after_cconv]: 0.00018092, [1] [Cycle 1]: 0.00017439, [11] [c_1]: 2.192e-05 [parameter_eliminate]: 5.61e-06 [updatestate_depend_eliminate]: 1.125e-05 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.88001e-06 [cse]: 4.206e-05 [call_graph_tuple_transform]: 2.337e-05 [tuple_list_get_item_eliminator]: 6.15002e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 7.49977e-07 [switch_simplify]: 5.60001e-06 [remove_dup_value]: 1.863e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 7.41999e-06 [add_recomputation]: 6.386e-05 [cse_after_recomputation]: 2.483e-05, [1] [Cycle 1]: 1.966e-05, [1] [cse]: 1.335e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 9.89999e-06 [opt_after_jit_grad]: 0.00046019 [symbol_engine_optimizer]: 7.584e-05, [1] [Cycle 1]: 6.862e-05, [6] [build]: 4.23001e-06 [elim_shapecalc]: 8.36002e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 4.60015e-07 [validate]: 5.386e-05 Sums bootstrap : 0.000331s : 0.69% type_inference : 0.031462s : 65.25% event_method : 0.000021s : 0.04% auto_monad : 0.000071s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000108s : 0.22% rewriter_before_opt_a : 0.000082s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.12% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000611s : 1.27% jit_opt_a.with_stream_mark : 0.000024s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000850s : 1.76% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.04% jit_opt_a.cse : 0.000032s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000040s : 0.08% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.012889s : 26.73% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000021s : 0.04% cconv : 0.000044s : 0.09% loop_unroll : 0.000471s : 0.98% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000064s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000460s : 0.95% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.11% Time group info: ------[substitution.] 0.000200 23 1.21% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 3.08% : 0.000006s : 3: substitution.graph_param_transform 83.68% : 0.000167s : 4: substitution.inline 1.18% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000004s : 4: substitution.remove_not_recompute_node 1.81% : 0.000004s : 2: substitution.replace_old_param 6.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031378 2 95.37% : 0.029926s : 1: type_inference.infer 4.63% : 0.001453s : 1: type_inference.specialize ------[replace.] 0.000070 6 69.13% : 0.000049s : 4: replace.inline 30.87% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.56% : 0.000165s : 4: match.inline 6.44% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.83% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 4.42% : 0.000005s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.49% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.23% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.02% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 13 48.74% : 0.000391s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.84% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.41% : 0.000373s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053856 72 0.12% : 0.000067s : 1: add_recomputation 0.14% : 0.000075s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.67% : 0.000362s : 1: bootstrap 0.09% : 0.000047s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 9.98% : 0.005375s : 1: jit_opt_a 0.34% : 0.000185s : 1: jit_opt_after_cconv 0.12% : 0.000066s : 1: jit_opt_b 0.89% : 0.000480s : 1: loop_unroll 23.97% : 0.012910s : 1: mutable_eliminate 1.52% : 0.000816s : 26: opt.transform.jit_opt_a 0.10% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000032s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000111s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 0.89% : 0.000480s : 1: renormalize.infer 0.67% : 0.000362s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.16% : 0.000085s : 1: rewriter_before_opt_a 0.15% : 0.000078s : 1: symbol_engine_optimizer 58.46% : 0.031482s : 1: type_inference TotalTime = 0.133683, [30] [bootstrap]: 0.00031815 [type_inference]: 0.10911 [event_method]: 1.572e-05 [auto_monad]: 4.348e-05 [graph_reusing]: 3.39001e-06 [pre_auto_parallel]: 1.59998e-06 [py_interpret_to_execute]: 0.00010145 [rewriter_before_opt_a]: 6.708e-05 [expand_dump_flag]: 1.95001e-06 [jit_opt_a]: 0.00529435, [2] [Cycle 1]: 0.00177429, [27] [switch_simplify]: 5.254e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00052155 [with_stream_mark]: 1.802e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 2.84999e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.451e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00083392 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.559e-05 [cse]: 3.426e-05 [replace_applicator]: 1.25e-05 [Cycle 2]: 0.000316, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 5.07999e-06 [a_1]: 9.051e-05 [with_stream_mark]: 8.95999e-06 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 2.73998e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.29003e-06 [meta_shard_fg_expand]: 1.09998e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.26997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.244e-05 [j_node_and_user_rematch]: 7.6e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 7.52002e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.248e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 9.22001e-06 [rewriter_after_opt_a]: 3.185e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.0169531 [jit_opt_b]: 6.165e-05, [1] [Cycle 1]: 5.257e-05, [2] [frontend_op_eliminate]: 1.94e-05 [inline_after_opt_a]: 1.99e-05 [cconv]: 3.079e-05 [loop_unroll]: 0.00049551 [jit_opt_after_cconv]: 0.00017434, [1] [Cycle 1]: 0.00016647, [11] [c_1]: 2.34e-05 [parameter_eliminate]: 3.97002e-06 [updatestate_depend_eliminate]: 8.94003e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 3.81e-05 [call_graph_tuple_transform]: 2.257e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 1.623e-05 [partial_unused_args_eliminate]: 2.89001e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 4.751e-05 [cse_after_recomputation]: 2.387e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.612e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 9.09e-06 [opt_after_jit_grad]: 0.0005002 [symbol_engine_optimizer]: 0.0001091, [1] [Cycle 1]: 0.00010271, [6] [build]: 3.73999e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 3.826e-05 [fold_const_symbol]: 1.008e-05 [renormalize]: 5.39992e-07 [validate]: 4.55e-05 Sums bootstrap : 0.000318s : 0.24% type_inference : 0.109110s : 83.99% event_method : 0.000016s : 0.01% auto_monad : 0.000043s : 0.03% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000101s : 0.08% rewriter_before_opt_a : 0.000067s : 0.05% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.04% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000612s : 0.47% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000834s : 0.64% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.01% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.016953s : 13.05% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000031s : 0.02% loop_unroll : 0.000496s : 0.38% jit_opt_after_cconv.c_1 : 0.000023s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000500s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000038s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000198 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 3.05% : 0.000006s : 3: substitution.graph_param_transform 83.87% : 0.000166s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 5.78% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109053 2 98.78% : 0.107726s : 1: type_inference.infer 1.22% : 0.001327s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.87% : 0.000046s : 4: replace.inline 32.13% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 94.05% : 0.000164s : 4: match.inline 5.95% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.84% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.38% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.93% : 0.000003s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000002s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.93% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000779 13 48.78% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.22% : 0.000360s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135446 72 0.04% : 0.000050s : 1: add_recomputation 0.03% : 0.000046s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000340s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.01% : 0.000019s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 3.91% : 0.005297s : 1: jit_opt_a 0.13% : 0.000177s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.37% : 0.000504s : 1: loop_unroll 12.53% : 0.016968s : 1: mutable_eliminate 0.61% : 0.000822s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000024s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000067s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.08% : 0.000105s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.36% : 0.000486s : 1: renormalize.infer 0.25% : 0.000340s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.05% : 0.000071s : 1: rewriter_before_opt_a 0.08% : 0.000112s : 1: symbol_engine_optimizer 80.56% : 0.109120s : 1: type_inference TotalTime = 0.120478, [30] [bootstrap]: 0.00034986 [type_inference]: 0.0895664 [event_method]: 0.00065634 [auto_monad]: 0.0001353 [graph_reusing]: 9.41e-06 [pre_auto_parallel]: 3.81999e-06 [py_interpret_to_execute]: 4.672e-05 [rewriter_before_opt_a]: 0.0001436 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.0271906, [3] [Cycle 1]: 0.0188633, [27] [switch_simplify]: 9.601e-05 [loop_unroll]: 5.053e-05 [a_1]: 0.00125013 [with_stream_mark]: 4.316e-05 [recompute_prepare]: 3.498e-05 [updatestate_depend_eliminate]: 1.059e-05 [updatestate_assign_eliminate]: 8.05999e-06 [updatestate_loads_eliminate]: 6.88e-06 [parameter_eliminate]: 3.33e-06 [specialize_transform]: 1.875e-05 [updatestate_useless_node_eliminater]: 1.485e-05 [accelerated_algorithm]: 1.703e-05 [meta_shard_fg_expand]: 6.91001e-06 [get_grad_eliminate_]: 1.715e-05 [merge_forward]: 1.017e-05 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.335e-05 [j_node_and_user_rematch]: 2.805e-05 [meta_fg_expand]: 0.00222824 [replace_old_param]: 8.199e-05 [inline_without_move]: 6.595e-05 [renormalize]: 0.0140597 [add_forward_monad_depend]: 1.374e-05 [auto_monad_grad]: 7.74002e-06 [auto_monad_eliminator]: 6.472e-05 [cse]: 0.00028809 [replace_applicator]: 8.972e-05 [Cycle 2]: 0.00378534, [27] [switch_simplify]: 4.479e-05 [loop_unroll]: 4.326e-05 [a_1]: 0.00116419 [with_stream_mark]: 1.586e-05 [recompute_prepare]: 9.24998e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 4.15e-06 [updatestate_loads_eliminate]: 3.98999e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 6.84001e-06 [accelerated_algorithm]: 6.96999e-06 [meta_shard_fg_expand]: 2.85002e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.722e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 0.00013185 [replace_old_param]: 7.80998e-06 [inline_without_move]: 7.04001e-06 [renormalize]: 0.00205186 [add_forward_monad_depend]: 5.84e-06 [auto_monad_grad]: 1.71e-06 [auto_monad_eliminator]: 1.211e-05 [cse]: 2.381e-05 [replace_applicator]: 1.471e-05 [Cycle 3]: 0.00026418, [27] [switch_simplify]: 4.47e-06 [loop_unroll]: 4.55001e-06 [a_1]: 4.507e-05 [with_stream_mark]: 1.116e-05 [recompute_prepare]: 4.03999e-06 [updatestate_depend_eliminate]: 2.51e-06 [updatestate_assign_eliminate]: 1.97999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.31998e-06 [specialize_transform]: 3.51999e-06 [updatestate_useless_node_eliminater]: 3.25e-06 [accelerated_algorithm]: 3.46001e-06 [meta_shard_fg_expand]: 1.76003e-06 [get_grad_eliminate_]: 3.55998e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.14e-05 [j_node_and_user_rematch]: 6.76e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 3.85e-06 [inline_without_move]: 3.64002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 3.68999e-06 [cse]: 9.19998e-06 [replace_applicator]: 3.76999e-06 [py_interpret_to_execute_after_opt_a]: 1.22e-05 [rewriter_after_opt_a]: 3.604e-05 [convert_after_rewriter]: 5.74999e-06 [order_py_execute_after_rewriter]: 4.20999e-06 [mutable_eliminate]: 0.0007205 [jit_opt_b]: 4.266e-05, [1] [Cycle 1]: 3.511e-05, [2] [frontend_op_eliminate]: 1.115e-05 [inline_after_opt_a]: 1.167e-05 [cconv]: 2.784e-05 [loop_unroll]: 0.00043872 [jit_opt_after_cconv]: 0.00013488, [1] [Cycle 1]: 0.00012704, [11] [c_1]: 1.294e-05 [parameter_eliminate]: 3.28998e-06 [updatestate_depend_eliminate]: 5.90002e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.148e-05 [call_graph_tuple_transform]: 1.453e-05 [tuple_list_get_item_eliminator]: 4.05998e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 4.06001e-06 [remove_dup_value]: 1.466e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 4.94003e-06 [add_recomputation]: 3.646e-05 [cse_after_recomputation]: 2.101e-05, [1] [Cycle 1]: 1.592e-05, [1] [cse]: 9.19998e-06 [auto_monad_reorder]: 1.335e-05 [get_jit_bprop_graph]: 3.01999e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00050921 [symbol_engine_optimizer]: 7.223e-05, [1] [Cycle 1]: 6.491e-05, [6] [build]: 5.00999e-06 [elim_shapecalc]: 5.99e-06 [elim_not_effective]: 1.068e-05 [opt_reshape]: 4.45e-06 [fold_const_symbol]: 6.60002e-06 [renormalize]: 6.29982e-07 [validate]: 3.64e-05 Sums bootstrap : 0.000350s : 0.30% type_inference : 0.089566s : 77.73% event_method : 0.000656s : 0.57% auto_monad : 0.000135s : 0.12% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000047s : 0.04% rewriter_before_opt_a : 0.000144s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000145s : 0.13% jit_opt_a.loop_unroll : 0.000098s : 0.09% jit_opt_a.a_1 : 0.002459s : 2.13% jit_opt_a.with_stream_mark : 0.000070s : 0.06% jit_opt_a.recompute_prepare : 0.000048s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000012s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000062s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.04% jit_opt_a.meta_fg_expand : 0.002362s : 2.05% jit_opt_a.replace_old_param : 0.000094s : 0.08% jit_opt_a.inline_without_move : 0.000077s : 0.07% jit_opt_a.renormalize : 0.016112s : 13.98% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.07% jit_opt_a.cse : 0.000321s : 0.28% jit_opt_a.replace_applicator : 0.000108s : 0.09% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000721s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000439s : 0.38% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000509s : 0.44% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000669 104 0.32% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.62% : 0.000004s : 1: substitution.graph_param_transform 67.90% : 0.000454s : 13: substitution.inline 3.23% : 0.000022s : 2: substitution.inline_without_move 1.68% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.86% : 0.000012s : 7: substitution.minmaximum_grad 1.31% : 0.000009s : 5: substitution.partial_eliminate 1.67% : 0.000011s : 12: substitution.remove_not_recompute_node 5.05% : 0.000034s : 10: substitution.replace_applicator 1.43% : 0.000010s : 10: substitution.replace_old_param 0.68% : 0.000005s : 1: substitution.set_cell_output_no_recompute 0.95% : 0.000006s : 1: substitution.tile_eliminate 3.59% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.48% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.08% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.089401 2 81.98% : 0.073288s : 1: type_inference.infer 18.02% : 0.016113s : 1: type_inference.specialize ------[replace.] 0.000197 20 67.66% : 0.000133s : 13: replace.inline 32.34% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000469 20 94.97% : 0.000446s : 13: match.inline 5.03% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000400 2656 1.55% : 0.000006s : 46: predicate.accumulaten_eliminater 0.34% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.55% : 0.000006s : 46: predicate.addn_check_dump 1.58% : 0.000006s : 46: predicate.addn_zero_filter 1.91% : 0.000008s : 46: predicate.arithmetic_simplify 1.65% : 0.000007s : 46: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000006s : 46: predicate.compare_switch_simplify 1.64% : 0.000007s : 46: predicate.depend_value_elim 1.46% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.42% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.46% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_depend_swap 1.47% : 0.000006s : 46: predicate.environ_get_eliminate 1.36% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.90% : 0.000004s : 18: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.34% : 0.000017s : 68: predicate.inline 1.97% : 0.000008s : 46: predicate.inline_without_move 0.33% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.12% : 0.000004s : 18: predicate.less_batch_normalization 1.80% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.80% : 0.000007s : 54: predicate.load_eliminater 0.30% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.53% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.49% : 0.000006s : 46: predicate.merge_addn 1.69% : 0.000007s : 46: predicate.minmaximum_grad 0.40% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.38% : 0.000010s : 54: predicate.partial_eliminate 1.47% : 0.000006s : 46: predicate.print_const_string_wrapper 2.03% : 0.000008s : 46: predicate.reduce_eliminate 1.78% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000002s : 18: predicate.remove_not_recompute_node 2.64% : 0.000011s : 99: predicate.replace_applicator 1.08% : 0.000004s : 46: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.51% : 0.000006s : 46: predicate.reshape_eliminate 1.67% : 0.000007s : 46: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.56% : 0.000006s : 46: predicate.same_eliminate 0.50% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.87% : 0.000003s : 18: predicate.specialize_transform 1.86% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.24% : 0.000013s : 66: predicate.switch_defer_inline 2.44% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.79% : 0.000027s : 166: predicate.switch_simplify 1.51% : 0.000006s : 46: predicate.tile_eliminate 1.55% : 0.000006s : 46: predicate.transpose_eliminate 2.08% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.92% : 0.000008s : 46: predicate.tuple_list_get_item_depend_reorder 3.12% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.91% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.86% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.89% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.60% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005677 52 81.20% : 0.004609s : 35: func_graph_cloner_run.FuncGraphClonerGraph 18.80% : 0.001067s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139776 87 0.03% : 0.000039s : 1: add_recomputation 0.10% : 0.000144s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.27% : 0.000382s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.48% : 0.000670s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 19.46% : 0.027194s : 1: jit_opt_a 0.10% : 0.000138s : 1: jit_opt_after_cconv 0.03% : 0.000045s : 1: jit_opt_b 0.32% : 0.000447s : 1: loop_unroll 0.52% : 0.000730s : 1: mutable_eliminate 2.28% : 0.003188s : 39: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000521s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000049s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 9.75% : 0.013624s : 2: renormalize.infer 1.76% : 0.002465s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000148s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 64.10% : 0.089596s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.562.88 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dca0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.570.07 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0172963, [30] [bootstrap]: 0.00032611 [type_inference]: 0.00956126 [event_method]: 2.06e-05 [auto_monad]: 6.772e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 4.23e-05 [rewriter_before_opt_a]: 8.463e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00513594, [2] [Cycle 1]: 0.00172113, [27] [switch_simplify]: 5.629e-05 [loop_unroll]: 3.321e-05 [a_1]: 0.00061501 [with_stream_mark]: 1.834e-05 [recompute_prepare]: 8.17998e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.25002e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.41998e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 8.84998e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 8.48001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 0.00065476 [add_forward_monad_depend]: 5.44998e-06 [auto_monad_grad]: 1.82001e-06 [auto_monad_eliminator]: 1.46e-05 [cse]: 3.861e-05 [replace_applicator]: 1.34e-05 [Cycle 2]: 0.00038321, [27] [switch_simplify]: 5.81003e-06 [loop_unroll]: 5.12e-06 [a_1]: 8.941e-05 [with_stream_mark]: 9.63002e-06 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 3.10002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 4.87e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 5.591e-05 [merge_forward]: 3.34001e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.02998e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 7.21001e-06 [cse]: 1.729e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.2e-05 [rewriter_after_opt_a]: 3.722e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00050562 [jit_opt_b]: 4.815e-05, [1] [Cycle 1]: 4.166e-05, [2] [frontend_op_eliminate]: 1.526e-05 [inline_after_opt_a]: 1.467e-05 [cconv]: 2.476e-05 [loop_unroll]: 0.00040108 [jit_opt_after_cconv]: 0.00014692, [1] [Cycle 1]: 0.0001344, [11] [c_1]: 1.996e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.34998e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.79999e-06 [cse]: 2.212e-05 [call_graph_tuple_transform]: 1.818e-05 [tuple_list_get_item_eliminator]: 5.68002e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.41998e-06 [remove_dup_value]: 3.316e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 6.04999e-06 [add_recomputation]: 5.012e-05 [cse_after_recomputation]: 2.42e-05, [1] [Cycle 1]: 1.91e-05, [1] [cse]: 1.313e-05 [auto_monad_reorder]: 1.821e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.00044203 [symbol_engine_optimizer]: 7.172e-05, [1] [Cycle 1]: 6.586e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 7.56001e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 8.55001e-06 [renormalize]: 4.19997e-07 [validate]: 3.726e-05 Sums bootstrap : 0.000326s : 2.38% type_inference : 0.009561s : 69.86% event_method : 0.000021s : 0.15% auto_monad : 0.000068s : 0.49% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000042s : 0.31% rewriter_before_opt_a : 0.000085s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.45% jit_opt_a.loop_unroll : 0.000038s : 0.28% jit_opt_a.a_1 : 0.000704s : 5.15% jit_opt_a.with_stream_mark : 0.000028s : 0.20% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000061s : 0.45% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000655s : 4.78% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000056s : 0.41% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000037s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000506s : 3.69% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.11% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000025s : 0.18% loop_unroll : 0.000401s : 2.93% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000033s : 0.24% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000050s : 0.37% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000442s : 3.23% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.27% Time group info: ------[substitution.] 0.000229 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 85.58% : 0.000196s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 5.34% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009494 2 89.77% : 0.008522s : 1: type_inference.infer 10.23% : 0.000971s : 1: type_inference.specialize ------[replace.] 0.000090 7 68.86% : 0.000062s : 5: replace.inline 31.14% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 7 94.61% : 0.000193s : 5: match.inline 5.39% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.55% : 0.000002s : 11: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.69% : 0.000002s : 11: predicate.addn_zero_filter 2.14% : 0.000003s : 11: predicate.arithmetic_simplify 1.26% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.18% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.23% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000001s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 16: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.35% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000001s : 11: predicate.print_const_string_wrapper 1.77% : 0.000002s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.44% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.03% : 0.000010s : 59: predicate.switch_simplify 1.22% : 0.000001s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000778 16 53.92% : 0.000419s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.21% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.87% : 0.000302s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018978 72 0.28% : 0.000053s : 1: add_recomputation 0.37% : 0.000071s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.81% : 0.000343s : 1: bootstrap 0.14% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 27.08% : 0.005139s : 1: jit_opt_a 0.79% : 0.000150s : 1: jit_opt_after_cconv 0.27% : 0.000051s : 1: jit_opt_b 2.15% : 0.000408s : 1: loop_unroll 2.70% : 0.000513s : 1: mutable_eliminate 5.13% : 0.000974s : 26: opt.transform.jit_opt_a 0.24% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.37% : 0.000449s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000045s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000036s : 1: remove_dup_value 1.91% : 0.000362s : 1: renormalize.infer 1.50% : 0.000285s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000040s : 1: rewriter_after_opt_a 0.46% : 0.000087s : 1: rewriter_before_opt_a 0.39% : 0.000074s : 1: symbol_engine_optimizer 50.47% : 0.009578s : 1: type_inference TotalTime = 0.154293, [30] [bootstrap]: 0.00026667 [type_inference]: 0.14297 [event_method]: 2.051e-05 [auto_monad]: 7.101e-05 [graph_reusing]: 5.72999e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00043254 [rewriter_before_opt_a]: 8.494e-05 [expand_dump_flag]: 3.82998e-06 [jit_opt_a]: 0.0075416, [2] [Cycle 1]: 0.00368429, [27] [switch_simplify]: 5.709e-05 [loop_unroll]: 2.964e-05 [a_1]: 0.00058517 [with_stream_mark]: 1.932e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.30998e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.88002e-06 [renormalize]: 0.00264424 [add_forward_monad_depend]: 7.47002e-06 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 1.749e-05 [cse]: 3.341e-05 [replace_applicator]: 1.767e-05 [Cycle 2]: 0.0003878, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 6.51e-06 [a_1]: 0.00013328 [with_stream_mark]: 1.199e-05 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.74998e-06 [get_grad_eliminate_]: 5.68997e-06 [merge_forward]: 3.25998e-06 [cell_reuse_recompute_pass]: 2.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 9.04998e-06 [inline_without_move]: 5.99e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.142e-05 [replace_applicator]: 7.18e-06 [py_interpret_to_execute_after_opt_a]: 1.23e-05 [rewriter_after_opt_a]: 3.94e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00063958 [jit_opt_b]: 5.696e-05, [1] [Cycle 1]: 4.997e-05, [2] [frontend_op_eliminate]: 1.996e-05 [inline_after_opt_a]: 1.894e-05 [cconv]: 2.572e-05 [loop_unroll]: 0.00099762 [jit_opt_after_cconv]: 0.00016185, [1] [Cycle 1]: 0.00015525, [11] [c_1]: 2.812e-05 [parameter_eliminate]: 3.14001e-06 [updatestate_depend_eliminate]: 6.64999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.333e-05 [call_graph_tuple_transform]: 2.236e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.749e-05 [partial_unused_args_eliminate]: 2.83e-06 [environ_conv]: 9.22001e-06 [add_recomputation]: 5.003e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.851e-05, [1] [cse]: 1.149e-05 [auto_monad_reorder]: 1.599e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 5.18002e-06 [opt_after_jit_grad]: 0.00049713 [symbol_engine_optimizer]: 7.506e-05, [1] [Cycle 1]: 6.86e-05, [6] [build]: 3.61001e-06 [elim_shapecalc]: 9.10001e-06 [elim_not_effective]: 1.404e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 8.58001e-06 [renormalize]: 3.50003e-07 [validate]: 5.733e-05 Sums bootstrap : 0.000267s : 0.18% type_inference : 0.142970s : 95.17% event_method : 0.000021s : 0.01% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000433s : 0.29% rewriter_before_opt_a : 0.000085s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000718s : 0.48% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002644s : 1.76% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000640s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000998s : 0.66% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000497s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000228 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.97% : 0.000007s : 4: substitution.graph_param_transform 84.41% : 0.000193s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 5.49% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.142891 2 97.91% : 0.139909s : 1: type_inference.infer 2.09% : 0.002982s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.86% : 0.000047s : 4: replace.inline 33.14% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.38% : 0.000190s : 4: match.inline 5.62% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 2.60% : 0.000003s : 18: predicate.partial_eliminate 1.39% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.56% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.37% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002037 22 62.97% : 0.001283s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.56% : 0.000704s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.157955 72 0.03% : 0.000053s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.18% : 0.000278s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.78% : 0.007545s : 1: jit_opt_a 0.10% : 0.000165s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.64% : 0.001007s : 1: loop_unroll 0.41% : 0.000648s : 1: mutable_eliminate 0.61% : 0.000957s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000506s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000439s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.18% : 0.001870s : 1: renormalize.infer 0.48% : 0.000764s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000096s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 90.53% : 0.142995s : 1: type_inference TotalTime = 0.546286, [30] [bootstrap]: 0.00033844 [type_inference]: 0.520098 [event_method]: 2.08e-05 [auto_monad]: 5.842e-05 [graph_reusing]: 3.8e-06 [pre_auto_parallel]: 1.76e-06 [py_interpret_to_execute]: 0.00206819 [rewriter_before_opt_a]: 0.00015319 [expand_dump_flag]: 6.11998e-06 [jit_opt_a]: 0.0112341, [2] [Cycle 1]: 0.00650727, [27] [switch_simplify]: 7.376e-05 [loop_unroll]: 3.824e-05 [a_1]: 0.00079762 [with_stream_mark]: 2.007e-05 [recompute_prepare]: 9.41e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 8.41002e-06 [updatestate_useless_node_eliminater]: 6.90002e-06 [accelerated_algorithm]: 7.43e-06 [meta_shard_fg_expand]: 3.2e-05 [get_grad_eliminate_]: 8.18001e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 1.139e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 6.94999e-06 [renormalize]: 0.00514855 [add_forward_monad_depend]: 7.75e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.989e-05 [cse]: 3.715e-05 [replace_applicator]: 1.914e-05 [Cycle 2]: 0.00039729, [27] [switch_simplify]: 7.33e-06 [loop_unroll]: 6.13002e-06 [a_1]: 0.00013451 [with_stream_mark]: 1.132e-05 [recompute_prepare]: 6.64999e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 3.23998e-06 [cell_reuse_recompute_pass]: 2.63998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.267e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.08998e-06 [cse]: 1.656e-05 [replace_applicator]: 7.31999e-06 [py_interpret_to_execute_after_opt_a]: 1.922e-05 [rewriter_after_opt_a]: 4.202e-05 [convert_after_rewriter]: 7.67002e-06 [order_py_execute_after_rewriter]: 1.842e-05 [mutable_eliminate]: 0.00072416 [jit_opt_b]: 6.901e-05, [1] [Cycle 1]: 6.078e-05, [2] [frontend_op_eliminate]: 1.951e-05 [inline_after_opt_a]: 2.087e-05 [cconv]: 2.488e-05 [loop_unroll]: 0.00050979 [jit_opt_after_cconv]: 0.0001734, [1] [Cycle 1]: 0.00016678, [11] [c_1]: 2.675e-05 [parameter_eliminate]: 2.86999e-06 [updatestate_depend_eliminate]: 7.65e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.21e-05 [call_graph_tuple_transform]: 2.705e-05 [tuple_list_get_item_eliminator]: 5.97999e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 1.616e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 9.76003e-06 [add_recomputation]: 5.503e-05 [cse_after_recomputation]: 2.667e-05, [1] [Cycle 1]: 2.016e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 6.96001e-06 [opt_after_jit_grad]: 0.00993504 [symbol_engine_optimizer]: 0.00034846, [1] [Cycle 1]: 0.00033795, [6] [build]: 5.51e-06 [elim_shapecalc]: 1.06e-05 [elim_not_effective]: 2.478e-05 [opt_reshape]: 7.05002e-06 [fold_const_symbol]: 0.00024958 [renormalize]: 9.70002e-07 [validate]: 5.885e-05 Sums bootstrap : 0.000338s : 0.06% type_inference : 0.520098s : 96.09% event_method : 0.000021s : 0.00% auto_monad : 0.000058s : 0.01% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.002068s : 0.38% rewriter_before_opt_a : 0.000153s : 0.03% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.01% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.000932s : 0.17% jit_opt_a.with_stream_mark : 0.000031s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000033s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.005149s : 0.95% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.00% jit_opt_a.cse : 0.000054s : 0.01% jit_opt_a.replace_applicator : 0.000026s : 0.00% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000018s : 0.00% mutable_eliminate : 0.000724s : 0.13% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000025s : 0.00% loop_unroll : 0.000510s : 0.09% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000055s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.009935s : 1.84% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000250s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.01% Time group info: ------[substitution.] 0.000312 28 1.99% : 0.000006s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000007s : 4: substitution.graph_param_transform 82.80% : 0.000258s : 5: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.68% : 0.000011s : 3: substitution.reduce_eliminate 1.90% : 0.000006s : 4: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_old_param 3.86% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.520014 2 99.05% : 0.515059s : 1: type_inference.infer 0.95% : 0.004955s : 1: type_inference.specialize ------[replace.] 0.000128 7 67.54% : 0.000087s : 5: replace.inline 32.46% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000266 7 95.90% : 0.000255s : 5: match.inline 4.10% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 2.56% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.57% : 0.000002s : 13: predicate.addn_zero_filter 2.19% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.53% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.73% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.32% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.29% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002769 25 61.13% : 0.001693s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.81% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.07% : 0.000999s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.552968 72 0.01% : 0.000058s : 1: add_recomputation 0.01% : 0.000062s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.06% : 0.000355s : 1: bootstrap 0.00% : 0.000028s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.00% : 0.000024s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 2.03% : 0.011239s : 1: jit_opt_a 0.03% : 0.000176s : 1: jit_opt_after_cconv 0.01% : 0.000072s : 1: jit_opt_b 0.09% : 0.000518s : 1: loop_unroll 0.13% : 0.000736s : 1: mutable_eliminate 0.22% : 0.001209s : 26: opt.transform.jit_opt_a 0.01% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000053s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000288s : 4: opt.transform.symbol_engine_opt 1.80% : 0.009952s : 1: opt_after_jit_grad 0.00% : 0.000021s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.002091s : 1: py_interpret_to_execute 0.00% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 0.74% : 0.004075s : 1: renormalize.infer 0.19% : 0.001060s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.03% : 0.000160s : 1: rewriter_before_opt_a 0.06% : 0.000352s : 1: symbol_engine_optimizer 94.06% : 0.520113s : 1: type_inference TotalTime = 0.0979304, [30] [bootstrap]: 0.00028737 [type_inference]: 0.0667719 [event_method]: 0.00034835 [auto_monad]: 0.0001101 [graph_reusing]: 7.65e-06 [pre_auto_parallel]: 3.10002e-06 [py_interpret_to_execute]: 3.752e-05 [rewriter_before_opt_a]: 0.00013052 [expand_dump_flag]: 3.59002e-06 [jit_opt_a]: 0.0280788, [3] [Cycle 1]: 0.0200808, [27] [switch_simplify]: 7.416e-05 [loop_unroll]: 4.903e-05 [a_1]: 0.00106453 [with_stream_mark]: 3.339e-05 [recompute_prepare]: 2.205e-05 [updatestate_depend_eliminate]: 8.64e-06 [updatestate_assign_eliminate]: 6.63e-06 [updatestate_loads_eliminate]: 6.96001e-06 [parameter_eliminate]: 3.12002e-06 [specialize_transform]: 1.572e-05 [updatestate_useless_node_eliminater]: 1.453e-05 [accelerated_algorithm]: 1.611e-05 [meta_shard_fg_expand]: 3.93999e-06 [get_grad_eliminate_]: 1.478e-05 [merge_forward]: 9.81e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.942e-05 [j_node_and_user_rematch]: 2.819e-05 [meta_fg_expand]: 0.00192527 [replace_old_param]: 6.899e-05 [inline_without_move]: 6.657e-05 [renormalize]: 0.0159081 [add_forward_monad_depend]: 1.297e-05 [auto_monad_grad]: 6.91999e-06 [auto_monad_eliminator]: 6.612e-05 [cse]: 0.00028699 [replace_applicator]: 8.988e-05 [Cycle 2]: 0.00417522, [27] [switch_simplify]: 4.641e-05 [loop_unroll]: 4.451e-05 [a_1]: 0.00132761 [with_stream_mark]: 1.773e-05 [recompute_prepare]: 1.183e-05 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 4.36002e-06 [updatestate_loads_eliminate]: 4.25999e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 9.34e-06 [updatestate_useless_node_eliminater]: 9.32999e-06 [accelerated_algorithm]: 9.13002e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 8.39002e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.851e-05 [j_node_and_user_rematch]: 1.395e-05 [meta_fg_expand]: 0.00012439 [replace_old_param]: 1.097e-05 [inline_without_move]: 9.24e-06 [renormalize]: 0.00226016 [add_forward_monad_depend]: 5.81e-06 [auto_monad_grad]: 1.89999e-06 [auto_monad_eliminator]: 1.104e-05 [cse]: 1.982e-05 [replace_applicator]: 1.343e-05 [Cycle 3]: 0.00025282, [27] [switch_simplify]: 4.66002e-06 [loop_unroll]: 3.56001e-06 [a_1]: 4.303e-05 [with_stream_mark]: 9.26002e-06 [recompute_prepare]: 3.53999e-06 [updatestate_depend_eliminate]: 2.19001e-06 [updatestate_assign_eliminate]: 1.81003e-06 [updatestate_loads_eliminate]: 1.39e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 3.5e-06 [updatestate_useless_node_eliminater]: 3.26999e-06 [accelerated_algorithm]: 3.62002e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 3.83999e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.05e-05 [j_node_and_user_rematch]: 6.06e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 3.31999e-06 [inline_without_move]: 3.2e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 3.7e-06 [cse]: 8.47e-06 [replace_applicator]: 3.68e-06 [py_interpret_to_execute_after_opt_a]: 1.118e-05 [rewriter_after_opt_a]: 3.233e-05 [convert_after_rewriter]: 5.79999e-06 [order_py_execute_after_rewriter]: 6.86001e-06 [mutable_eliminate]: 0.00067218 [jit_opt_b]: 4.216e-05, [1] [Cycle 1]: 3.486e-05, [2] [frontend_op_eliminate]: 1.14e-05 [inline_after_opt_a]: 1.162e-05 [cconv]: 2.681e-05 [loop_unroll]: 0.00041447 [jit_opt_after_cconv]: 0.00012505, [1] [Cycle 1]: 0.00011878, [11] [c_1]: 1.225e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 1.64e-06 [updatestate_loads_eliminate]: 1.52001e-06 [cse]: 1.775e-05 [call_graph_tuple_transform]: 1.504e-05 [tuple_list_get_item_eliminator]: 4.09002e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 3.68999e-06 [remove_dup_value]: 1.399e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 4.69002e-06 [add_recomputation]: 3.496e-05 [cse_after_recomputation]: 1.9e-05, [1] [Cycle 1]: 1.346e-05, [1] [cse]: 7.08e-06 [auto_monad_reorder]: 1.316e-05 [get_jit_bprop_graph]: 1.66e-06 [rewriter_after_jit_bprop_graph]: 4.37998e-06 [opt_after_jit_grad]: 0.0004372 [symbol_engine_optimizer]: 6.671e-05, [1] [Cycle 1]: 6.095e-05, [6] [build]: 3.30998e-06 [elim_shapecalc]: 6.53998e-06 [elim_not_effective]: 9.62001e-06 [opt_reshape]: 4.89e-06 [fold_const_symbol]: 6.86001e-06 [renormalize]: 4.39992e-07 [validate]: 3.015e-05 Sums bootstrap : 0.000287s : 0.31% type_inference : 0.066772s : 71.41% event_method : 0.000348s : 0.37% auto_monad : 0.000110s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.04% rewriter_before_opt_a : 0.000131s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000125s : 0.13% jit_opt_a.loop_unroll : 0.000097s : 0.10% jit_opt_a.a_1 : 0.002435s : 2.60% jit_opt_a.with_stream_mark : 0.000060s : 0.06% jit_opt_a.recompute_prepare : 0.000037s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.03% jit_opt_a.accelerated_algorithm : 0.000029s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.03% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.05% jit_opt_a.meta_fg_expand : 0.002051s : 2.19% jit_opt_a.replace_old_param : 0.000083s : 0.09% jit_opt_a.inline_without_move : 0.000079s : 0.08% jit_opt_a.renormalize : 0.018168s : 19.43% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.09% jit_opt_a.cse : 0.000315s : 0.34% jit_opt_a.replace_applicator : 0.000107s : 0.11% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000672s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.03% loop_unroll : 0.000414s : 0.44% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000035s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000437s : 0.47% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.03% Time group info: ------[substitution.] 0.000615 107 0.29% : 0.000002s : 1: substitution.elim_not_effective 0.26% : 0.000002s : 1: substitution.fold_const_symbol 0.77% : 0.000005s : 1: substitution.graph_param_transform 65.94% : 0.000405s : 13: substitution.inline 3.50% : 0.000022s : 2: substitution.inline_without_move 1.80% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.97% : 0.000012s : 7: substitution.minmaximum_grad 1.31% : 0.000008s : 5: substitution.partial_eliminate 1.75% : 0.000011s : 13: substitution.remove_not_recompute_node 5.23% : 0.000032s : 10: substitution.replace_applicator 1.04% : 0.000006s : 10: substitution.replace_old_param 1.11% : 0.000007s : 1: substitution.reshape_eliminate 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.03% : 0.000006s : 1: substitution.tile_eliminate 3.85% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.71% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.94% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066662 2 95.63% : 0.063750s : 1: type_inference.infer 4.37% : 0.002912s : 1: type_inference.specialize ------[replace.] 0.000188 20 66.17% : 0.000125s : 13: replace.inline 33.83% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000418 20 95.12% : 0.000397s : 13: match.inline 4.88% : 0.000020s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000397 2768 1.65% : 0.000007s : 48: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000006s : 48: predicate.addn_check_dump 1.52% : 0.000006s : 48: predicate.addn_zero_filter 2.29% : 0.000009s : 48: predicate.arithmetic_simplify 1.56% : 0.000006s : 48: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000006s : 48: predicate.compare_switch_simplify 1.46% : 0.000006s : 48: predicate.depend_value_elim 1.47% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.58% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.15% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.42% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 48: predicate.environ_get_depend_swap 1.57% : 0.000006s : 48: predicate.environ_get_eliminate 1.43% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000004s : 20: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.09% : 0.000016s : 70: predicate.inline 2.05% : 0.000008s : 48: predicate.inline_without_move 0.42% : 0.000002s : 20: predicate.j_node_and_user_rematch 1.12% : 0.000004s : 20: predicate.less_batch_normalization 1.81% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 56: predicate.load_eliminater 0.36% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.50% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.78% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.42% : 0.000006s : 48: predicate.merge_addn 1.49% : 0.000006s : 48: predicate.minmaximum_grad 0.51% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.26% : 0.000009s : 56: predicate.partial_eliminate 1.51% : 0.000006s : 48: predicate.print_const_string_wrapper 2.11% : 0.000008s : 48: predicate.reduce_eliminate 1.88% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 20: predicate.remove_not_recompute_node 2.79% : 0.000011s : 103: predicate.replace_applicator 1.09% : 0.000004s : 48: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.53% : 0.000006s : 48: predicate.reshape_eliminate 1.51% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 1: predicate.row_tensor_eliminate 1.55% : 0.000006s : 48: predicate.same_eliminate 0.56% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.11% : 0.000000s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 20: predicate.specialize_transform 1.91% : 0.000008s : 48: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.14% : 0.000012s : 68: predicate.switch_defer_inline 2.49% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.59% : 0.000026s : 170: predicate.switch_simplify 1.69% : 0.000007s : 48: predicate.tile_eliminate 1.68% : 0.000007s : 48: predicate.transpose_eliminate 1.79% : 0.000007s : 48: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000013s : 57: predicate.tuple_list_get_item_eliminator 1.92% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 1.84% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.74% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.75% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.92% : 0.000008s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004458 52 76.90% : 0.003428s : 35: func_graph_cloner_run.FuncGraphClonerGraph 23.10% : 0.001030s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119236 87 0.03% : 0.000037s : 1: add_recomputation 0.10% : 0.000117s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.26% : 0.000311s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.30% : 0.000356s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 23.55% : 0.028082s : 1: jit_opt_a 0.11% : 0.000128s : 1: jit_opt_after_cconv 0.04% : 0.000045s : 1: jit_opt_b 0.35% : 0.000422s : 1: loop_unroll 0.57% : 0.000681s : 1: mutable_eliminate 2.63% : 0.003134s : 39: opt.transform.jit_opt_a 0.03% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000445s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000040s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 13.00% : 0.015501s : 2: renormalize.infer 2.22% : 0.002647s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.11% : 0.000134s : 1: rewriter_before_opt_a 0.06% : 0.000069s : 1: symbol_engine_optimizer 56.01% : 0.066788s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.171.828 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004db80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.172.553 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0817744, [30] [bootstrap]: 0.00026968 [type_inference]: 0.0724291 [event_method]: 2.109e-05 [auto_monad]: 6.827e-05 [graph_reusing]: 6.79999e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 0.00011239 [rewriter_before_opt_a]: 8.27e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00669338, [2] [Cycle 1]: 0.00205469, [27] [switch_simplify]: 6.074e-05 [loop_unroll]: 3.066e-05 [a_1]: 0.00055344 [with_stream_mark]: 2.14e-05 [recompute_prepare]: 6.77002e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.49001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00105012 [add_forward_monad_depend]: 7.33e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.515e-05 [cse]: 3.705e-05 [replace_applicator]: 1.242e-05 [Cycle 2]: 0.00032182, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 4.97e-06 [a_1]: 8.985e-05 [with_stream_mark]: 9.36e-06 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.13001e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.95002e-06 [cse]: 1.285e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.38e-05 [rewriter_after_opt_a]: 3.848e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00053008 [jit_opt_b]: 4.781e-05, [1] [Cycle 1]: 4.132e-05, [2] [frontend_op_eliminate]: 1.505e-05 [inline_after_opt_a]: 1.53e-05 [cconv]: 2.727e-05 [loop_unroll]: 0.00041232 [jit_opt_after_cconv]: 0.00013838, [1] [Cycle 1]: 0.00013263, [11] [c_1]: 2.021e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.21003e-06 [cse]: 2.01e-05 [call_graph_tuple_transform]: 1.893e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.573e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 5.72999e-06 [add_recomputation]: 4.931e-05 [cse_after_recomputation]: 2.191e-05, [1] [Cycle 1]: 1.694e-05, [1] [cse]: 1.145e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 2.35002e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00045308 [symbol_engine_optimizer]: 7.072e-05, [1] [Cycle 1]: 6.439e-05, [6] [build]: 2.99999e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 3.59985e-07 [validate]: 3.866e-05 Sums bootstrap : 0.000270s : 0.35% type_inference : 0.072429s : 94.21% event_method : 0.000021s : 0.03% auto_monad : 0.000068s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000112s : 0.15% rewriter_before_opt_a : 0.000083s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000643s : 0.84% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001050s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000050s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000530s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000412s : 0.54% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000453s : 0.59% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.05% Time group info: ------[substitution.] 0.000226 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 3: substitution.graph_param_transform 84.92% : 0.000192s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072355 2 97.95% : 0.070871s : 1: type_inference.infer 2.05% : 0.001484s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.21% : 0.000050s : 4: replace.inline 30.79% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.55% : 0.000189s : 4: match.inline 5.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.33% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.59% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.52% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.46% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000842 13 47.57% : 0.000400s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.62% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.81% : 0.000394s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.083733 72 0.06% : 0.000052s : 1: add_recomputation 0.09% : 0.000072s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.34% : 0.000287s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.00% : 0.006696s : 1: jit_opt_a 0.17% : 0.000141s : 1: jit_opt_after_cconv 0.06% : 0.000050s : 1: jit_opt_b 0.50% : 0.000420s : 1: loop_unroll 0.64% : 0.000539s : 1: mutable_eliminate 1.03% : 0.000864s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000116s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.74% : 0.000622s : 1: renormalize.infer 0.50% : 0.000421s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000086s : 1: rewriter_before_opt_a 0.09% : 0.000073s : 1: symbol_engine_optimizer 86.52% : 0.072447s : 1: type_inference TotalTime = 0.0170857, [30] [bootstrap]: 0.00028344 [type_inference]: 0.00819404 [event_method]: 2.097e-05 [auto_monad]: 7.085e-05 [graph_reusing]: 6.44999e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 4.397e-05 [rewriter_before_opt_a]: 8.453e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00624937, [2] [Cycle 1]: 0.00188109, [27] [switch_simplify]: 6.443e-05 [loop_unroll]: 3.351e-05 [a_1]: 0.00064504 [with_stream_mark]: 2.022e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 4.07998e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00077662 [add_forward_monad_depend]: 5.13002e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.519e-05 [cse]: 3.986e-05 [replace_applicator]: 1.208e-05 [Cycle 2]: 0.00031908, [27] [switch_simplify]: 5.91998e-06 [loop_unroll]: 5.25001e-06 [a_1]: 8.922e-05 [with_stream_mark]: 8.90999e-06 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 4.82998e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.157e-05 [j_node_and_user_rematch]: 8.08001e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.31001e-06 [inline_without_move]: 4.99998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.47999e-06 [cse]: 1.447e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 3.613e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.46002e-06 [mutable_eliminate]: 0.0005306 [jit_opt_b]: 5.126e-05, [1] [Cycle 1]: 4.34e-05, [2] [frontend_op_eliminate]: 1.655e-05 [inline_after_opt_a]: 1.565e-05 [cconv]: 2.692e-05 [loop_unroll]: 0.00041198 [jit_opt_after_cconv]: 0.00014728, [1] [Cycle 1]: 0.00014087, [11] [c_1]: 2.042e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 2.555e-05 [call_graph_tuple_transform]: 1.894e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 3.141e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 6.47001e-06 [add_recomputation]: 6.27e-05 [cse_after_recomputation]: 2.474e-05, [1] [Cycle 1]: 1.917e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 4.27998e-06 [opt_after_jit_grad]: 0.00046132 [symbol_engine_optimizer]: 7.38e-05, [1] [Cycle 1]: 6.757e-05, [6] [build]: 3.53e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 5.68002e-06 [fold_const_symbol]: 8.68001e-06 [renormalize]: 4.30009e-07 [validate]: 3.883e-05 Sums bootstrap : 0.000283s : 2.27% type_inference : 0.008194s : 65.77% event_method : 0.000021s : 0.17% auto_monad : 0.000071s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000044s : 0.35% rewriter_before_opt_a : 0.000085s : 0.68% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.56% jit_opt_a.loop_unroll : 0.000039s : 0.31% jit_opt_a.a_1 : 0.000734s : 5.89% jit_opt_a.with_stream_mark : 0.000029s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000777s : 6.23% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000054s : 0.44% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000036s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000531s : 4.26% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000027s : 0.22% loop_unroll : 0.000412s : 3.31% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000031s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000063s : 0.50% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000461s : 3.70% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.31% Time group info: ------[substitution.] 0.000258 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 3: substitution.graph_param_transform 87.12% : 0.000224s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 4.78% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008126 2 88.30% : 0.007175s : 1: type_inference.infer 11.70% : 0.000951s : 1: type_inference.specialize ------[replace.] 0.000092 7 67.66% : 0.000062s : 5: replace.inline 32.34% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 7 95.22% : 0.000221s : 5: match.inline 4.78% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.29% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.42% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.24% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000001s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.99% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.79% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 16: predicate.load_eliminater 1.11% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.20% : 0.000001s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 1.80% : 0.000002s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 11: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.71% : 0.000003s : 18: predicate.switch_defer_inline 2.37% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.32% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.18% : 0.000001s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000816 16 54.63% : 0.000446s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.47% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.90% : 0.000293s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018876 72 0.35% : 0.000066s : 1: add_recomputation 0.39% : 0.000074s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.58% : 0.000298s : 1: bootstrap 0.16% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 33.13% : 0.006253s : 1: jit_opt_a 0.79% : 0.000150s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.22% : 0.000420s : 1: loop_unroll 2.86% : 0.000540s : 1: mutable_eliminate 5.08% : 0.000959s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.49% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000047s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000034s : 1: remove_dup_value 2.42% : 0.000458s : 1: renormalize.infer 1.65% : 0.000311s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.46% : 0.000088s : 1: rewriter_before_opt_a 0.40% : 0.000076s : 1: symbol_engine_optimizer 43.50% : 0.008211s : 1: type_inference TotalTime = 0.0482802, [30] [bootstrap]: 0.0002809 [type_inference]: 0.0192207 [event_method]: 1.965e-05 [auto_monad]: 6.887e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00010249 [rewriter_before_opt_a]: 8.599e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.026083, [2] [Cycle 1]: 0.0223706, [27] [switch_simplify]: 8.551e-05 [loop_unroll]: 3.051e-05 [a_1]: 0.0006007 [with_stream_mark]: 2.55e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 3.41001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.013e-05 [inline_without_move]: 5.64e-06 [renormalize]: 0.00103951 [add_forward_monad_depend]: 5.83002e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.683e-05 [cse]: 3.721e-05 [replace_applicator]: 1.342e-05 [Cycle 2]: 0.00032159, [27] [switch_simplify]: 5.83997e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.085e-05 [with_stream_mark]: 1.005e-05 [recompute_prepare]: 5.28002e-06 [updatestate_depend_eliminate]: 3.03998e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 4.84003e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 7.78999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.47998e-06 [inline_without_move]: 4.87e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.299e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.542e-05 [rewriter_after_opt_a]: 3.939e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00074203 [jit_opt_b]: 5.237e-05, [1] [Cycle 1]: 4.419e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.721e-05 [cconv]: 2.768e-05 [loop_unroll]: 0.00048064 [jit_opt_after_cconv]: 0.00014888, [1] [Cycle 1]: 0.00014245, [11] [c_1]: 2.107e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 2.674e-05 [call_graph_tuple_transform]: 1.835e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 1.725e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 6.01998e-06 [add_recomputation]: 5.325e-05 [cse_after_recomputation]: 2.337e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.778e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00045262 [symbol_engine_optimizer]: 0.000104, [1] [Cycle 1]: 9.745e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 3.858e-05 [elim_not_effective]: 1.297e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.88002e-06 [renormalize]: 4.49974e-07 [validate]: 3.783e-05 Sums bootstrap : 0.000281s : 1.17% type_inference : 0.019221s : 79.83% event_method : 0.000020s : 0.08% auto_monad : 0.000069s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.43% rewriter_before_opt_a : 0.000086s : 0.36% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000091s : 0.38% jit_opt_a.loop_unroll : 0.000036s : 0.15% jit_opt_a.a_1 : 0.000692s : 2.87% jit_opt_a.with_stream_mark : 0.000036s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001040s : 4.32% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000050s : 0.21% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000039s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000742s : 3.08% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000028s : 0.11% loop_unroll : 0.000481s : 2.00% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000053s : 0.22% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000453s : 1.88% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000039s : 0.16% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.16% Time group info: ------[substitution.] 0.000256 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 3: substitution.graph_param_transform 86.00% : 0.000220s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000005s : 2: substitution.replace_old_param 5.30% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019156 2 92.54% : 0.017727s : 1: type_inference.infer 7.46% : 0.001429s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.30% : 0.000052s : 4: replace.inline 31.70% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.55% : 0.000218s : 4: match.inline 5.45% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 0.76% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000003s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.15% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.55% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.61% : 0.000002s : 10: predicate.reshape_eliminate 1.64% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.76% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 11.86% : 0.000015s : 53: predicate.switch_simplify 1.09% : 0.000001s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.83% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000816 13 45.33% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.65% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.02% : 0.000392s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050343 72 0.11% : 0.000056s : 1: add_recomputation 0.14% : 0.000072s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.59% : 0.000298s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 51.82% : 0.026086s : 1: jit_opt_a 0.30% : 0.000151s : 1: jit_opt_after_cconv 0.11% : 0.000055s : 1: jit_opt_b 0.97% : 0.000489s : 1: loop_unroll 1.49% : 0.000750s : 1: mutable_eliminate 1.86% : 0.000934s : 26: opt.transform.jit_opt_a 0.09% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000063s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000106s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.19% : 0.000598s : 1: renormalize.infer 0.86% : 0.000432s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.18% : 0.000090s : 1: rewriter_before_opt_a 0.21% : 0.000107s : 1: symbol_engine_optimizer 38.21% : 0.019235s : 1: type_inference TotalTime = 0.0998461, [30] [bootstrap]: 0.00024712 [type_inference]: 0.0673688 [event_method]: 0.00039559 [auto_monad]: 0.00011949 [graph_reusing]: 7.8e-06 [pre_auto_parallel]: 3.16999e-06 [py_interpret_to_execute]: 4.229e-05 [rewriter_before_opt_a]: 0.00013329 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.0288746, [3] [Cycle 1]: 0.0201699, [27] [switch_simplify]: 8.847e-05 [loop_unroll]: 4.953e-05 [a_1]: 0.0010974 [with_stream_mark]: 3.574e-05 [recompute_prepare]: 2.464e-05 [updatestate_depend_eliminate]: 1.012e-05 [updatestate_assign_eliminate]: 8.1e-06 [updatestate_loads_eliminate]: 7.2e-06 [parameter_eliminate]: 3.38e-06 [specialize_transform]: 1.694e-05 [updatestate_useless_node_eliminater]: 1.445e-05 [accelerated_algorithm]: 1.58e-05 [meta_shard_fg_expand]: 4.77e-06 [get_grad_eliminate_]: 1.492e-05 [merge_forward]: 1.044e-05 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.013e-05 [j_node_and_user_rematch]: 2.697e-05 [meta_fg_expand]: 0.00213439 [replace_old_param]: 7.818e-05 [inline_without_move]: 6.516e-05 [renormalize]: 0.0156224 [add_forward_monad_depend]: 1.72e-05 [auto_monad_grad]: 7.98001e-06 [auto_monad_eliminator]: 7.171e-05 [cse]: 0.00031044 [replace_applicator]: 0.00010263 [Cycle 2]: 0.00445363, [27] [switch_simplify]: 6.044e-05 [loop_unroll]: 4.443e-05 [a_1]: 0.00129196 [with_stream_mark]: 2.489e-05 [recompute_prepare]: 1.164e-05 [updatestate_depend_eliminate]: 5.44998e-06 [updatestate_assign_eliminate]: 4.33999e-06 [updatestate_loads_eliminate]: 4.27e-06 [parameter_eliminate]: 2.56998e-06 [specialize_transform]: 8.21002e-06 [updatestate_useless_node_eliminater]: 7.51999e-06 [accelerated_algorithm]: 8.28001e-06 [meta_shard_fg_expand]: 3.45e-06 [get_grad_eliminate_]: 6.91001e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.087e-05 [j_node_and_user_rematch]: 1.336e-05 [meta_fg_expand]: 0.00013534 [replace_old_param]: 1.325e-05 [inline_without_move]: 7.26001e-06 [renormalize]: 0.00247379 [add_forward_monad_depend]: 9.79e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 3.231e-05 [replace_applicator]: 1.968e-05 [Cycle 3]: 0.00030479, [27] [switch_simplify]: 5.05001e-06 [loop_unroll]: 4.48001e-06 [a_1]: 5.015e-05 [with_stream_mark]: 1.42e-05 [recompute_prepare]: 4.13999e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 1.89999e-06 [updatestate_loads_eliminate]: 1.87999e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 3.41999e-06 [updatestate_useless_node_eliminater]: 3.45e-06 [accelerated_algorithm]: 3.73999e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 3.35e-06 [merge_forward]: 3.45998e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 7.28e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 3.83999e-06 [inline_without_move]: 3.08e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.04999e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.468e-05 [replace_applicator]: 6.92002e-06 [py_interpret_to_execute_after_opt_a]: 1.529e-05 [rewriter_after_opt_a]: 3.981e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00083259 [jit_opt_b]: 5.293e-05, [1] [Cycle 1]: 4.383e-05, [2] [frontend_op_eliminate]: 1.401e-05 [inline_after_opt_a]: 1.514e-05 [cconv]: 3.15e-05 [loop_unroll]: 0.00049709 [jit_opt_after_cconv]: 0.0001642, [1] [Cycle 1]: 0.00015559, [11] [c_1]: 1.626e-05 [parameter_eliminate]: 4.49002e-06 [updatestate_depend_eliminate]: 7.56999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 3.201e-05 [call_graph_tuple_transform]: 1.977e-05 [tuple_list_get_item_eliminator]: 4.80001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.636e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 6.21998e-06 [add_recomputation]: 3.822e-05 [cse_after_recomputation]: 2.256e-05, [1] [Cycle 1]: 1.722e-05, [1] [cse]: 9.78002e-06 [auto_monad_reorder]: 1.435e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 8.47e-06 [opt_after_jit_grad]: 0.00054417 [symbol_engine_optimizer]: 7.444e-05, [1] [Cycle 1]: 6.628e-05, [6] [build]: 5.44e-06 [elim_shapecalc]: 6.61e-06 [elim_not_effective]: 1.147e-05 [opt_reshape]: 5.07e-06 [fold_const_symbol]: 6.21998e-06 [renormalize]: 3.89991e-07 [validate]: 3.885e-05 Sums bootstrap : 0.000247s : 0.26% type_inference : 0.067369s : 71.01% event_method : 0.000396s : 0.42% auto_monad : 0.000119s : 0.13% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.04% rewriter_before_opt_a : 0.000133s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000154s : 0.16% jit_opt_a.loop_unroll : 0.000098s : 0.10% jit_opt_a.a_1 : 0.002440s : 2.57% jit_opt_a.with_stream_mark : 0.000075s : 0.08% jit_opt_a.recompute_prepare : 0.000040s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000028s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.05% jit_opt_a.meta_fg_expand : 0.002272s : 2.39% jit_opt_a.replace_old_param : 0.000095s : 0.10% jit_opt_a.inline_without_move : 0.000075s : 0.08% jit_opt_a.renormalize : 0.018096s : 19.08% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.03% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000094s : 0.10% jit_opt_a.cse : 0.000357s : 0.38% jit_opt_a.replace_applicator : 0.000129s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000833s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000497s : 0.52% jit_opt_after_cconv.c_1 : 0.000016s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000038s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000544s : 0.57% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000671 104 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.89% : 0.000006s : 1: substitution.graph_param_transform 66.74% : 0.000448s : 13: substitution.inline 3.17% : 0.000021s : 2: substitution.inline_without_move 1.74% : 0.000012s : 12: substitution.j_node_and_user_rematch 1.93% : 0.000013s : 7: substitution.minmaximum_grad 1.14% : 0.000008s : 5: substitution.partial_eliminate 1.73% : 0.000012s : 12: substitution.remove_not_recompute_node 5.61% : 0.000038s : 10: substitution.replace_applicator 1.10% : 0.000007s : 10: substitution.replace_old_param 0.42% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000007s : 1: substitution.tile_eliminate 3.88% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.60% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.58% : 0.000051s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067246 2 95.95% : 0.064523s : 1: type_inference.infer 4.05% : 0.002723s : 1: type_inference.specialize ------[replace.] 0.000199 20 65.42% : 0.000130s : 13: replace.inline 34.58% : 0.000069s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000464 20 94.30% : 0.000438s : 13: match.inline 5.70% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000406 2656 1.54% : 0.000006s : 46: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.52% : 0.000006s : 46: predicate.addn_check_dump 1.83% : 0.000007s : 46: predicate.addn_zero_filter 2.26% : 0.000009s : 46: predicate.arithmetic_simplify 1.73% : 0.000007s : 46: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000006s : 46: predicate.compare_switch_simplify 1.43% : 0.000006s : 46: predicate.depend_value_elim 1.34% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.58% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.42% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.35% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.26% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.34% : 0.000005s : 46: predicate.environ_get_depend_swap 1.43% : 0.000006s : 46: predicate.environ_get_eliminate 1.41% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000004s : 18: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.33% : 0.000018s : 68: predicate.inline 2.04% : 0.000008s : 46: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.15% : 0.000005s : 18: predicate.less_batch_normalization 1.82% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 2.08% : 0.000008s : 54: predicate.load_eliminater 0.50% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.40% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.79% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.51% : 0.000006s : 46: predicate.merge_addn 1.75% : 0.000007s : 46: predicate.minmaximum_grad 0.41% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.19% : 0.000009s : 54: predicate.partial_eliminate 1.67% : 0.000007s : 46: predicate.print_const_string_wrapper 2.00% : 0.000008s : 46: predicate.reduce_eliminate 1.74% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000002s : 18: predicate.remove_not_recompute_node 2.66% : 0.000011s : 99: predicate.replace_applicator 1.17% : 0.000005s : 46: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.51% : 0.000006s : 46: predicate.reshape_eliminate 1.42% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.35% : 0.000001s : 1: predicate.row_tensor_eliminate 1.42% : 0.000006s : 46: predicate.same_eliminate 0.45% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 2: predicate.special_op_eliminate 0.75% : 0.000003s : 18: predicate.specialize_transform 1.83% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.86% : 0.000012s : 66: predicate.switch_defer_inline 2.39% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.85% : 0.000028s : 166: predicate.switch_simplify 1.52% : 0.000006s : 46: predicate.tile_eliminate 1.53% : 0.000006s : 46: predicate.transpose_eliminate 1.85% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.88% : 0.000008s : 46: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.86% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.79% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.66% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.74% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.77% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004613 52 75.11% : 0.003465s : 35: func_graph_cloner_run.FuncGraphClonerGraph 24.89% : 0.001148s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121149 87 0.04% : 0.000043s : 1: add_recomputation 0.11% : 0.000130s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000267s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.34% : 0.000408s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 23.84% : 0.028879s : 1: jit_opt_a 0.14% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.42% : 0.000509s : 1: loop_unroll 0.70% : 0.000849s : 1: mutable_eliminate 2.63% : 0.003189s : 39: opt.transform.jit_opt_a 0.03% : 0.000041s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000020s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000557s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000046s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 12.39% : 0.015005s : 2: renormalize.infer 2.53% : 0.003067s : 2: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.11% : 0.000137s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 55.63% : 0.067396s : 1: type_inference TotalTime = 0.0921915, [30] [bootstrap]: 0.0002681 [type_inference]: 0.0700561 [event_method]: 1.877e-05 [auto_monad]: 7.072e-05 [graph_reusing]: 5.46e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00011575 [rewriter_before_opt_a]: 7.989e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.0192424, [2] [Cycle 1]: 0.0151306, [27] [switch_simplify]: 5.998e-05 [loop_unroll]: 2.987e-05 [a_1]: 0.0135281 [with_stream_mark]: 2.791e-05 [recompute_prepare]: 1.369e-05 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.86999e-06 [get_grad_eliminate_]: 6.00002e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 2.59001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 1.126e-05 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 1.107e-05 [inline_without_move]: 5.67999e-06 [renormalize]: 0.00108633 [add_forward_monad_depend]: 8.2e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.58e-05 [cse]: 3.441e-05 [replace_applicator]: 1.431e-05 [Cycle 2]: 0.00032256, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 5.40001e-06 [a_1]: 8.954e-05 [with_stream_mark]: 9.60001e-06 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.02002e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.364e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.90002e-06 [cse]: 1.226e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 1.38e-05 [rewriter_after_opt_a]: 4.012e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 5.26998e-06 [mutable_eliminate]: 0.0007408 [jit_opt_b]: 5.211e-05, [1] [Cycle 1]: 4.394e-05, [2] [frontend_op_eliminate]: 1.667e-05 [inline_after_opt_a]: 1.58e-05 [cconv]: 2.52e-05 [loop_unroll]: 0.00041781 [jit_opt_after_cconv]: 0.000144, [1] [Cycle 1]: 0.00013777, [11] [c_1]: 2.082e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.18998e-06 [cse]: 2.248e-05 [call_graph_tuple_transform]: 1.884e-05 [tuple_list_get_item_eliminator]: 5.28002e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.684e-05 [partial_unused_args_eliminate]: 2.98998e-06 [environ_conv]: 5.51002e-06 [add_recomputation]: 4.994e-05 [cse_after_recomputation]: 2.326e-05, [1] [Cycle 1]: 1.726e-05, [1] [cse]: 1.181e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.00045551 [symbol_engine_optimizer]: 7.242e-05, [1] [Cycle 1]: 6.63e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.296e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.70999e-06 [renormalize]: 3.50003e-07 [validate]: 3.864e-05 Sums bootstrap : 0.000268s : 0.31% type_inference : 0.070056s : 79.82% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.08% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000116s : 0.13% rewriter_before_opt_a : 0.000080s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.013618s : 15.52% jit_opt_a.with_stream_mark : 0.000038s : 0.04% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001086s : 1.24% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000047s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000741s : 0.84% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000418s : 0.48% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 0.52% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.013009 23 0.01% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000001s : 2: substitution.fold_const_symbol 0.05% : 0.000006s : 3: substitution.graph_param_transform 99.67% : 0.012966s : 4: substitution.inline 0.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.03% : 0.000005s : 4: substitution.remove_not_recompute_node 0.05% : 0.000006s : 2: substitution.replace_old_param 0.14% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069982 2 87.63% : 0.061322s : 1: type_inference.infer 12.37% : 0.008660s : 1: type_inference.specialize ------[replace.] 0.000126 6 66.49% : 0.000083s : 4: replace.inline 33.51% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.012978 6 99.87% : 0.012962s : 4: match.inline 0.13% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.82% : 0.000002s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.10% : 0.000001s : 10: predicate.addn_zero_filter 2.47% : 0.000003s : 10: predicate.arithmetic_simplify 1.22% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.42% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.50% : 0.000002s : 10: predicate.environ_get_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.91% : 0.000009s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.26% : 0.000003s : 15: predicate.load_eliminater 1.00% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.92% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 1.20% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 1.98% : 0.000003s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 1.95% : 0.000003s : 10: predicate.reduce_eliminate 2.16% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.42% : 0.000002s : 10: predicate.reshape_eliminate 1.45% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.69% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.48% : 0.000005s : 16: predicate.switch_defer_inline 2.23% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.98% : 0.000009s : 53: predicate.switch_simplify 1.64% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.48% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.013624 13 2.77% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 93.98% : 0.012803s : 1: func_graph_cloner_run.FuncGraphClonerNode 3.25% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.107156 72 0.05% : 0.000054s : 1: add_recomputation 0.07% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000285s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 17.96% : 0.019246s : 1: jit_opt_a 0.14% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.40% : 0.000426s : 1: loop_unroll 0.70% : 0.000749s : 1: mutable_eliminate 12.92% : 0.013848s : 26: opt.transform.jit_opt_a 0.04% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000120s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.58% : 0.000621s : 1: renormalize.infer 0.43% : 0.000456s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000084s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 65.39% : 0.070070s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.311.926 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065af0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.312.483 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0274311, [30] [bootstrap]: 0.00020812 [type_inference]: 0.014719 [event_method]: 6.694e-05 [auto_monad]: 9.781e-05 [graph_reusing]: 7.55e-06 [pre_auto_parallel]: 3.33e-06 [py_interpret_to_execute]: 3.033e-05 [rewriter_before_opt_a]: 0.00010617 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.010049, [2] [Cycle 1]: 0.00628392, [27] [switch_simplify]: 7.096e-05 [loop_unroll]: 4.252e-05 [a_1]: 0.00094783 [with_stream_mark]: 2.777e-05 [recompute_prepare]: 2.181e-05 [updatestate_depend_eliminate]: 8.50001e-06 [updatestate_assign_eliminate]: 7.18e-06 [updatestate_loads_eliminate]: 6.74999e-06 [parameter_eliminate]: 2.74999e-06 [specialize_transform]: 1.372e-05 [updatestate_useless_node_eliminater]: 1.284e-05 [accelerated_algorithm]: 1.335e-05 [meta_shard_fg_expand]: 3.48999e-06 [get_grad_eliminate_]: 1.335e-05 [merge_forward]: 8.83001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.628e-05 [j_node_and_user_rematch]: 2.411e-05 [meta_fg_expand]: 0.00172681 [replace_old_param]: 6.273e-05 [inline_without_move]: 5.523e-05 [renormalize]: 0.00289718 [add_forward_monad_depend]: 6.11e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.529e-05 [cse]: 2.617e-05 [replace_applicator]: 1.721e-05 [Cycle 2]: 0.00038692, [27] [switch_simplify]: 4.65001e-06 [loop_unroll]: 3.98001e-06 [a_1]: 4.854e-05 [with_stream_mark]: 1.045e-05 [recompute_prepare]: 3.85e-06 [updatestate_depend_eliminate]: 2.61999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 1.76003e-06 [specialize_transform]: 3.68e-06 [updatestate_useless_node_eliminater]: 3.23998e-06 [accelerated_algorithm]: 3.71001e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 3.53e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.311e-05 [j_node_and_user_rematch]: 6.02999e-06 [meta_fg_expand]: 0.00010956 [replace_old_param]: 4.70001e-06 [inline_without_move]: 3.43999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 4.48001e-06 [cse]: 1.11e-05 [replace_applicator]: 3.81001e-06 [py_interpret_to_execute_after_opt_a]: 1.096e-05 [rewriter_after_opt_a]: 3.435e-05 [convert_after_rewriter]: 5.97001e-06 [order_py_execute_after_rewriter]: 4.58999e-06 [mutable_eliminate]: 0.00064255 [jit_opt_b]: 4.126e-05, [1] [Cycle 1]: 3.402e-05, [2] [frontend_op_eliminate]: 1.046e-05 [inline_after_opt_a]: 1.16e-05 [cconv]: 2.308e-05 [loop_unroll]: 0.00041511 [jit_opt_after_cconv]: 0.00012594, [1] [Cycle 1]: 0.00011994, [11] [c_1]: 1.224e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 4.88001e-06 [updatestate_assign_eliminate]: 1.60999e-06 [updatestate_loads_eliminate]: 1.56002e-06 [cse]: 1.843e-05 [call_graph_tuple_transform]: 1.473e-05 [tuple_list_get_item_eliminator]: 3.83999e-06 [none_parameter_eliminate]: 1.27e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 3.71999e-06 [remove_dup_value]: 1.49e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 3.564e-05 [cse_after_recomputation]: 2.004e-05, [1] [Cycle 1]: 1.465e-05, [1] [cse]: 8.22e-06 [auto_monad_reorder]: 1.26e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 5.14998e-06 [opt_after_jit_grad]: 0.00044246 [symbol_engine_optimizer]: 6.78e-05, [1] [Cycle 1]: 6.174e-05, [6] [build]: 3.36999e-06 [elim_shapecalc]: 5.92999e-06 [elim_not_effective]: 1.088e-05 [opt_reshape]: 4.36002e-06 [fold_const_symbol]: 6.73e-06 [renormalize]: 4.7998e-07 [validate]: 3.141e-05 Sums bootstrap : 0.000208s : 0.89% type_inference : 0.014719s : 62.95% event_method : 0.000067s : 0.29% auto_monad : 0.000098s : 0.42% graph_reusing : 0.000008s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000030s : 0.13% rewriter_before_opt_a : 0.000106s : 0.45% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.32% jit_opt_a.loop_unroll : 0.000047s : 0.20% jit_opt_a.a_1 : 0.000996s : 4.26% jit_opt_a.with_stream_mark : 0.000038s : 0.16% jit_opt_a.recompute_prepare : 0.000026s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.04% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000017s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.07% jit_opt_a.accelerated_algorithm : 0.000017s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.07% jit_opt_a.merge_forward : 0.000012s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000030s : 0.13% jit_opt_a.meta_fg_expand : 0.001836s : 7.85% jit_opt_a.replace_old_param : 0.000067s : 0.29% jit_opt_a.inline_without_move : 0.000059s : 0.25% jit_opt_a.renormalize : 0.002897s : 12.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000037s : 0.16% jit_opt_a.replace_applicator : 0.000021s : 0.09% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000034s : 0.15% convert_after_rewriter : 0.000006s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000643s : 2.75% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.04% jit_opt_b.inline_after_opt_a : 0.000012s : 0.05% cconv : 0.000023s : 0.10% loop_unroll : 0.000415s : 1.78% jit_opt_after_cconv.c_1 : 0.000012s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000018s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000036s : 0.15% cse_after_recomputation.cse : 0.000008s : 0.04% auto_monad_reorder : 0.000013s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000442s : 1.89% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.13% Time group info: ------[substitution.] 0.000281 54 0.78% : 0.000002s : 1: substitution.elim_not_effective 0.39% : 0.000001s : 1: substitution.fold_const_symbol 1.71% : 0.000005s : 1: substitution.graph_param_transform 67.64% : 0.000190s : 7: substitution.inline 6.10% : 0.000017s : 2: substitution.inline_without_move 2.52% : 0.000007s : 9: substitution.j_node_and_user_rematch 1.27% : 0.000004s : 2: substitution.minmaximum_grad 1.37% : 0.000004s : 3: substitution.partial_eliminate 2.64% : 0.000007s : 9: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_applicator 2.13% : 0.000006s : 8: substitution.replace_old_param 1.04% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.50% : 0.000007s : 2: substitution.tuple_list_convert_item_index_to_positive 1.92% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.82% : 0.000016s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014641 2 91.15% : 0.013346s : 1: type_inference.infer 8.85% : 0.001295s : 1: type_inference.specialize ------[replace.] 0.000073 9 81.38% : 0.000059s : 7: replace.inline 18.62% : 0.000014s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 9 94.31% : 0.000186s : 7: match.inline 5.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000188 1171 1.34% : 0.000003s : 19: predicate.accumulaten_eliminater 0.49% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.31% : 0.000002s : 19: predicate.addn_check_dump 1.55% : 0.000003s : 19: predicate.addn_zero_filter 2.05% : 0.000004s : 19: predicate.arithmetic_simplify 1.54% : 0.000003s : 19: predicate.cast_eliminate 0.26% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000003s : 19: predicate.compare_switch_simplify 1.30% : 0.000002s : 19: predicate.depend_value_elim 1.25% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.36% : 0.000003s : 19: predicate.dict_get_item_eliminator 1.52% : 0.000003s : 19: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.27% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 19: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 19: predicate.environ_get_depend_swap 1.43% : 0.000003s : 19: predicate.environ_get_eliminate 1.40% : 0.000003s : 19: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.16% : 0.000002s : 12: predicate.get_grad_eliminate 0.17% : 0.000000s : 1: predicate.graph_param_transform 4.55% : 0.000009s : 30: predicate.inline 3.26% : 0.000006s : 36: predicate.inline_without_move 0.46% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.34% : 0.000003s : 12: predicate.less_batch_normalization 1.52% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 22: predicate.load_eliminater 0.68% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.65% : 0.000007s : 48: predicate.loop_unroll_before_grad 1.73% : 0.000003s : 20: predicate.make_slice_get_slice_eliminator 1.28% : 0.000002s : 19: predicate.merge_addn 1.36% : 0.000003s : 19: predicate.minmaximum_grad 1.04% : 0.000002s : 1: predicate.mutable_eliminate 0.13% : 0.000000s : 1: predicate.opt_reshape 2.06% : 0.000004s : 22: predicate.partial_eliminate 1.30% : 0.000002s : 19: predicate.print_const_string_wrapper 2.06% : 0.000004s : 19: predicate.reduce_eliminate 1.63% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 12: predicate.remove_not_recompute_node 1.64% : 0.000003s : 23: predicate.replace_applicator 1.75% : 0.000003s : 36: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.39% : 0.000003s : 19: predicate.reshape_eliminate 1.40% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.39% : 0.000001s : 1: predicate.row_tensor_eliminate 1.28% : 0.000002s : 19: predicate.same_eliminate 0.66% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 2: predicate.special_op_eliminate 1.12% : 0.000002s : 12: predicate.specialize_transform 1.83% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.76% : 0.000005s : 28: predicate.switch_defer_inline 2.37% : 0.000004s : 28: predicate.switch_layer_defer_inline 6.88% : 0.000013s : 77: predicate.switch_simplify 1.47% : 0.000003s : 19: predicate.tile_eliminate 1.42% : 0.000003s : 19: predicate.transpose_eliminate 1.79% : 0.000003s : 19: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 19: predicate.tuple_list_set_item_eliminator 1.47% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.54% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.97% : 0.000006s : 34: predicate.updatestate_useless_node_eliminater 1.85% : 0.000003s : 19: predicate.value_based_eliminate 0.10% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.31% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001548 25 74.59% : 0.001155s : 15: func_graph_cloner_run.FuncGraphClonerGraph 25.41% : 0.000393s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031737 72 0.12% : 0.000038s : 1: add_recomputation 0.32% : 0.000102s : 1: auto_monad 0.05% : 0.000015s : 1: auto_monad_reorder 0.71% : 0.000226s : 1: bootstrap 0.08% : 0.000026s : 1: cconv 0.03% : 0.000008s : 1: convert_after_rewriter 0.07% : 0.000022s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.23% : 0.000073s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 31.68% : 0.010053s : 1: jit_opt_a 0.47% : 0.000148s : 1: jit_opt_after_cconv 0.14% : 0.000044s : 1: jit_opt_b 1.33% : 0.000423s : 1: loop_unroll 2.05% : 0.000652s : 1: mutable_eliminate 4.39% : 0.001394s : 26: opt.transform.jit_opt_a 0.10% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000015s : 4: opt.transform.jit_opt_b 0.03% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000012s : 1: opt.transform.mutable_eliminate 0.05% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000024s : 4: opt.transform.symbol_engine_opt 1.42% : 0.000451s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000033s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 7.44% : 0.002362s : 1: renormalize.infer 1.65% : 0.000525s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000037s : 1: rewriter_after_opt_a 0.34% : 0.000109s : 1: rewriter_before_opt_a 0.22% : 0.000071s : 1: symbol_engine_optimizer 46.43% : 0.014737s : 1: type_inference TotalTime = 0.15173, [30] [bootstrap]: 0.00028825 [type_inference]: 0.125124 [event_method]: 2.087e-05 [auto_monad]: 5.089e-05 [graph_reusing]: 4.07e-06 [pre_auto_parallel]: 2.28002e-06 [py_interpret_to_execute]: 0.0118756 [rewriter_before_opt_a]: 0.00016976 [expand_dump_flag]: 6.51e-06 [jit_opt_a]: 0.0114718, [2] [Cycle 1]: 0.0064556, [27] [switch_simplify]: 7.572e-05 [loop_unroll]: 3.614e-05 [a_1]: 0.00083423 [with_stream_mark]: 2.531e-05 [recompute_prepare]: 9.47999e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 7.26999e-06 [accelerated_algorithm]: 7.79002e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 7.24001e-06 [merge_forward]: 4.14002e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.721e-05 [j_node_and_user_rematch]: 1.235e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.211e-05 [inline_without_move]: 7.66999e-06 [renormalize]: 0.00505864 [add_forward_monad_depend]: 1.036e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.085e-05 [cse]: 4.029e-05 [replace_applicator]: 2.361e-05 [Cycle 2]: 0.00042437, [27] [switch_simplify]: 7.5e-06 [loop_unroll]: 6.91001e-06 [a_1]: 0.00014961 [with_stream_mark]: 1.543e-05 [recompute_prepare]: 7.05e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.98998e-06 [updatestate_useless_node_eliminater]: 6.08002e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 2.66999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 9.38002e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.66998e-06 [inline_without_move]: 6.29999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.605e-05 [replace_applicator]: 6.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.501e-05 [rewriter_after_opt_a]: 3.906e-05 [convert_after_rewriter]: 7.20003e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00078502 [jit_opt_b]: 6.343e-05, [1] [Cycle 1]: 5.532e-05, [2] [frontend_op_eliminate]: 2.189e-05 [inline_after_opt_a]: 2.069e-05 [cconv]: 3.107e-05 [loop_unroll]: 0.00047043 [jit_opt_after_cconv]: 0.00017992, [1] [Cycle 1]: 0.00017253, [11] [c_1]: 2.872e-05 [parameter_eliminate]: 3.38e-06 [updatestate_depend_eliminate]: 8.28001e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 3.15e-05 [call_graph_tuple_transform]: 2.538e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.86001e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 1.057e-05 [add_recomputation]: 5.429e-05 [cse_after_recomputation]: 2.699e-05, [1] [Cycle 1]: 2.082e-05, [1] [cse]: 1.374e-05 [auto_monad_reorder]: 1.794e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 7.23999e-06 [opt_after_jit_grad]: 0.00050348 [symbol_engine_optimizer]: 8.34e-05, [1] [Cycle 1]: 7.652e-05, [6] [build]: 4.28999e-06 [elim_shapecalc]: 9.01998e-06 [elim_not_effective]: 1.521e-05 [opt_reshape]: 7.02002e-06 [fold_const_symbol]: 1.114e-05 [renormalize]: 3.19997e-07 [validate]: 0.00015589 Sums bootstrap : 0.000288s : 0.20% type_inference : 0.125124s : 85.45% event_method : 0.000021s : 0.01% auto_monad : 0.000051s : 0.03% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.011876s : 8.11% rewriter_before_opt_a : 0.000170s : 0.12% expand_dump_flag : 0.000007s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000984s : 0.67% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.005059s : 3.45% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000785s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000470s : 0.32% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000503s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000156s : 0.11% Time group info: ------[substitution.] 0.000354 28 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.83% : 0.000006s : 4: substitution.graph_param_transform 85.68% : 0.000303s : 5: substitution.inline 1.22% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.85% : 0.000014s : 3: substitution.reduce_eliminate 1.61% : 0.000006s : 4: substitution.remove_not_recompute_node 1.76% : 0.000006s : 2: substitution.replace_old_param 3.08% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125050 2 97.27% : 0.121631s : 1: type_inference.infer 2.73% : 0.003420s : 1: type_inference.specialize ------[replace.] 0.000124 7 68.03% : 0.000084s : 5: replace.inline 31.97% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000309 7 96.84% : 0.000300s : 5: match.inline 3.16% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.53% : 0.000002s : 13: predicate.addn_zero_filter 2.23% : 0.000004s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.03% : 0.000008s : 28: predicate.inline 1.21% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.77% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000004s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 2.44% : 0.000004s : 13: predicate.reduce_eliminate 1.60% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.11% : 0.000011s : 64: predicate.switch_simplify 1.59% : 0.000003s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.85% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.56% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002995 25 53.90% : 0.001614s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.15% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.94% : 0.001286s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158008 72 0.04% : 0.000057s : 1: add_recomputation 0.03% : 0.000054s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.19% : 0.000306s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000009s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 7.26% : 0.011476s : 1: jit_opt_a 0.12% : 0.000183s : 1: jit_opt_after_cconv 0.04% : 0.000066s : 1: jit_opt_b 0.30% : 0.000479s : 1: loop_unroll 0.50% : 0.000796s : 1: mutable_eliminate 0.80% : 0.001265s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000513s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 7.54% : 0.011909s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.39% : 0.003775s : 1: renormalize.infer 0.80% : 0.001269s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.11% : 0.000179s : 1: rewriter_before_opt_a 0.06% : 0.000088s : 1: symbol_engine_optimizer 79.20% : 0.125138s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.361.971 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065c10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.362.630 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0438122, [30] [bootstrap]: 0.0002732 [type_inference]: 0.0340166 [event_method]: 2.069e-05 [auto_monad]: 6.721e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00010693 [rewriter_before_opt_a]: 8.105e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.0070482, [2] [Cycle 1]: 0.00319794, [27] [switch_simplify]: 5.996e-05 [loop_unroll]: 3.087e-05 [a_1]: 0.0015956 [with_stream_mark]: 2.428e-05 [recompute_prepare]: 9.57999e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 6.125e-05 [accelerated_algorithm]: 8.61997e-06 [meta_shard_fg_expand]: 3.08998e-06 [get_grad_eliminate_]: 6.08998e-06 [merge_forward]: 4.97e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.01e-06 [renormalize]: 0.00106022 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.676e-05 [cse]: 3.573e-05 [replace_applicator]: 1.423e-05 [Cycle 2]: 0.00032536, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.31002e-06 [a_1]: 9.234e-05 [with_stream_mark]: 1.023e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.395e-05 [j_node_and_user_rematch]: 8.05e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.31999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.277e-05 [replace_applicator]: 5.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.154e-05 [rewriter_after_opt_a]: 5.123e-05 [convert_after_rewriter]: 8.08001e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00058918 [jit_opt_b]: 5.102e-05, [1] [Cycle 1]: 4.332e-05, [2] [frontend_op_eliminate]: 1.565e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 2.866e-05 [loop_unroll]: 0.00042872 [jit_opt_after_cconv]: 0.00014425, [1] [Cycle 1]: 0.00013727, [11] [c_1]: 2.035e-05 [parameter_eliminate]: 2.22001e-06 [updatestate_depend_eliminate]: 6.63e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.225e-05 [call_graph_tuple_transform]: 1.96e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.653e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 4.842e-05 [cse_after_recomputation]: 2.273e-05, [1] [Cycle 1]: 1.746e-05, [1] [cse]: 1.213e-05 [auto_monad_reorder]: 1.818e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 5.19e-06 [opt_after_jit_grad]: 0.00044171 [symbol_engine_optimizer]: 8.981e-05, [1] [Cycle 1]: 8.325e-05, [6] [build]: 3.65998e-06 [elim_shapecalc]: 7.89002e-06 [elim_not_effective]: 2.871e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 2.69996e-07 [validate]: 3.763e-05 Sums bootstrap : 0.000273s : 0.69% type_inference : 0.034017s : 85.71% event_method : 0.000021s : 0.05% auto_monad : 0.000067s : 0.17% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.27% rewriter_before_opt_a : 0.000081s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.17% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.001688s : 4.25% jit_opt_a.with_stream_mark : 0.000035s : 0.09% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000066s : 0.17% jit_opt_a.accelerated_algorithm : 0.000014s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001060s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000049s : 0.12% jit_opt_a.replace_applicator : 0.000020s : 0.05% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000051s : 0.13% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000589s : 1.48% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000429s : 1.08% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000442s : 1.11% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000029s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.09% Time group info: ------[substitution.] 0.000267 23 6.70% : 0.000018s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 3: substitution.graph_param_transform 80.50% : 0.000215s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.04% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033945 2 95.52% : 0.032425s : 1: type_inference.infer 4.48% : 0.001520s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.31% : 0.000053s : 4: replace.inline 31.69% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.51% : 0.000212s : 4: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.87% : 0.000002s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 6.35% : 0.000008s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000002s : 15: predicate.load_eliminater 1.09% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.98% : 0.000002s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.80% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000856 13 44.63% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.43% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.94% : 0.000419s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046914 72 0.11% : 0.000051s : 1: add_recomputation 0.15% : 0.000071s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.62% : 0.000293s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.03% : 0.007051s : 1: jit_opt_a 0.31% : 0.000147s : 1: jit_opt_after_cconv 0.11% : 0.000054s : 1: jit_opt_b 0.93% : 0.000436s : 1: loop_unroll 1.28% : 0.000598s : 1: mutable_eliminate 4.20% : 0.001971s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.96% : 0.000450s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000111s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.30% : 0.000609s : 1: renormalize.infer 0.94% : 0.000442s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000055s : 1: rewriter_after_opt_a 0.18% : 0.000085s : 1: rewriter_before_opt_a 0.20% : 0.000092s : 1: symbol_engine_optimizer 72.54% : 0.034033s : 1: type_inference TotalTime = 0.0369526, [30] [bootstrap]: 0.00024701 [type_inference]: 0.0168218 [event_method]: 7.899e-05 [auto_monad]: 0.00010831 [graph_reusing]: 8.01001e-06 [pre_auto_parallel]: 3.71001e-06 [py_interpret_to_execute]: 3.779e-05 [rewriter_before_opt_a]: 0.00013041 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.01719, [2] [Cycle 1]: 0.0128728, [27] [switch_simplify]: 7.999e-05 [loop_unroll]: 4.436e-05 [a_1]: 0.00098485 [with_stream_mark]: 3.528e-05 [recompute_prepare]: 2.484e-05 [updatestate_depend_eliminate]: 9.47001e-06 [updatestate_assign_eliminate]: 7.48999e-06 [updatestate_loads_eliminate]: 7.09001e-06 [parameter_eliminate]: 2.79999e-06 [specialize_transform]: 1.359e-05 [updatestate_useless_node_eliminater]: 1.254e-05 [accelerated_algorithm]: 1.281e-05 [meta_shard_fg_expand]: 5.10999e-06 [get_grad_eliminate_]: 1.328e-05 [merge_forward]: 9.67999e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.809e-05 [j_node_and_user_rematch]: 2.405e-05 [meta_fg_expand]: 0.00196751 [replace_old_param]: 7.563e-05 [inline_without_move]: 6.374e-05 [renormalize]: 0.00880544 [add_forward_monad_depend]: 1.052e-05 [auto_monad_grad]: 3.08998e-06 [auto_monad_eliminator]: 1.582e-05 [cse]: 2.924e-05 [replace_applicator]: 2.394e-05 [Cycle 2]: 0.00052646, [27] [switch_simplify]: 6.29001e-06 [loop_unroll]: 4.82998e-06 [a_1]: 6.459e-05 [with_stream_mark]: 1.442e-05 [recompute_prepare]: 5.04003e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 3.75e-06 [updatestate_useless_node_eliminater]: 3.29001e-06 [accelerated_algorithm]: 3.54002e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 3.58e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 3.73001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.754e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 0.00020643 [replace_old_param]: 6.29001e-06 [inline_without_move]: 3.37997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.82999e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 5.49998e-06 [cse]: 1.163e-05 [replace_applicator]: 4.13999e-06 [py_interpret_to_execute_after_opt_a]: 1.553e-05 [rewriter_after_opt_a]: 3.85e-05 [convert_after_rewriter]: 6.24001e-06 [order_py_execute_after_rewriter]: 4.72998e-06 [mutable_eliminate]: 0.00074405 [jit_opt_b]: 4.439e-05, [1] [Cycle 1]: 3.663e-05, [2] [frontend_op_eliminate]: 1.161e-05 [inline_after_opt_a]: 1.273e-05 [cconv]: 2.864e-05 [loop_unroll]: 0.00042901 [jit_opt_after_cconv]: 0.00013151, [1] [Cycle 1]: 0.00012544, [11] [c_1]: 1.369e-05 [parameter_eliminate]: 3.28e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 1.67999e-06 [updatestate_loads_eliminate]: 1.55001e-06 [cse]: 2.166e-05 [call_graph_tuple_transform]: 1.574e-05 [tuple_list_get_item_eliminator]: 3.79002e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 3.51001e-06 [remove_dup_value]: 1.501e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 3.767e-05 [cse_after_recomputation]: 2.097e-05, [1] [Cycle 1]: 1.542e-05, [1] [cse]: 9.09e-06 [auto_monad_reorder]: 1.422e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 5.65001e-06 [opt_after_jit_grad]: 0.00045044 [symbol_engine_optimizer]: 6.691e-05, [1] [Cycle 1]: 6.057e-05, [6] [build]: 3.75998e-06 [elim_shapecalc]: 6.02999e-06 [elim_not_effective]: 1.043e-05 [opt_reshape]: 4.28001e-06 [fold_const_symbol]: 6.03002e-06 [renormalize]: 3.69997e-07 [validate]: 3.036e-05 Sums bootstrap : 0.000247s : 0.77% type_inference : 0.016822s : 52.38% event_method : 0.000079s : 0.25% auto_monad : 0.000108s : 0.34% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000038s : 0.12% rewriter_before_opt_a : 0.000130s : 0.41% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000086s : 0.27% jit_opt_a.loop_unroll : 0.000049s : 0.15% jit_opt_a.a_1 : 0.001049s : 3.27% jit_opt_a.with_stream_mark : 0.000050s : 0.15% jit_opt_a.recompute_prepare : 0.000030s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.03% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000017s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.05% jit_opt_a.accelerated_algorithm : 0.000016s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.05% jit_opt_a.merge_forward : 0.000013s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000032s : 0.10% jit_opt_a.meta_fg_expand : 0.002174s : 6.77% jit_opt_a.replace_old_param : 0.000082s : 0.26% jit_opt_a.inline_without_move : 0.000067s : 0.21% jit_opt_a.renormalize : 0.008806s : 27.42% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000041s : 0.13% jit_opt_a.replace_applicator : 0.000028s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000744s : 2.32% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.04% jit_opt_b.inline_after_opt_a : 0.000013s : 0.04% cconv : 0.000029s : 0.09% loop_unroll : 0.000429s : 1.34% jit_opt_after_cconv.c_1 : 0.000014s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000038s : 0.12% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000014s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000450s : 1.40% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.09% Time group info: ------[substitution.] 0.000332 56 0.65% : 0.000002s : 1: substitution.elim_not_effective 0.30% : 0.000001s : 1: substitution.fold_const_symbol 1.55% : 0.000005s : 1: substitution.graph_param_transform 70.20% : 0.000233s : 7: substitution.inline 5.77% : 0.000019s : 2: substitution.inline_without_move 2.58% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.23% : 0.000004s : 2: substitution.minmaximum_grad 1.33% : 0.000004s : 3: substitution.partial_eliminate 2.45% : 0.000008s : 9: substitution.remove_not_recompute_node 1.92% : 0.000006s : 2: substitution.replace_applicator 2.24% : 0.000007s : 10: substitution.replace_old_param 0.96% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.23% : 0.000007s : 2: substitution.tuple_list_convert_item_index_to_positive 1.69% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 4.89% : 0.000016s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016718 2 90.01% : 0.015047s : 1: type_inference.infer 9.99% : 0.001671s : 1: type_inference.specialize ------[replace.] 0.000089 9 78.49% : 0.000070s : 7: replace.inline 21.51% : 0.000019s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 9 95.18% : 0.000229s : 7: match.inline 4.82% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000192 1179 1.34% : 0.000003s : 19: predicate.accumulaten_eliminater 0.47% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 19: predicate.addn_check_dump 1.50% : 0.000003s : 19: predicate.addn_zero_filter 1.94% : 0.000004s : 19: predicate.arithmetic_simplify 1.44% : 0.000003s : 19: predicate.cast_eliminate 0.18% : 0.000000s : 1: predicate.check_bprop_eliminate 1.21% : 0.000002s : 19: predicate.compare_switch_simplify 1.48% : 0.000003s : 19: predicate.depend_value_elim 1.23% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.45% : 0.000003s : 19: predicate.dict_get_item_eliminator 1.43% : 0.000003s : 19: predicate.dict_set_item_eliminator 0.40% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.36% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.53% : 0.000003s : 19: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 19: predicate.environ_get_depend_swap 1.43% : 0.000003s : 19: predicate.environ_get_eliminate 1.48% : 0.000003s : 19: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.21% : 0.000002s : 12: predicate.get_grad_eliminate 0.22% : 0.000000s : 1: predicate.graph_param_transform 5.02% : 0.000010s : 30: predicate.inline 3.70% : 0.000007s : 40: predicate.inline_without_move 0.46% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 12: predicate.less_batch_normalization 1.70% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 22: predicate.load_eliminater 0.57% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.71% : 0.000007s : 48: predicate.loop_unroll_before_grad 1.57% : 0.000003s : 20: predicate.make_slice_get_slice_eliminator 1.37% : 0.000003s : 19: predicate.merge_addn 1.36% : 0.000003s : 19: predicate.minmaximum_grad 0.65% : 0.000001s : 1: predicate.mutable_eliminate 0.23% : 0.000000s : 1: predicate.opt_reshape 1.94% : 0.000004s : 22: predicate.partial_eliminate 1.44% : 0.000003s : 19: predicate.print_const_string_wrapper 1.89% : 0.000004s : 19: predicate.reduce_eliminate 1.67% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 12: predicate.remove_not_recompute_node 1.67% : 0.000003s : 23: predicate.replace_applicator 1.99% : 0.000004s : 40: predicate.replace_old_param 0.16% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000003s : 19: predicate.reshape_eliminate 1.63% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.31% : 0.000001s : 1: predicate.row_tensor_eliminate 1.40% : 0.000003s : 19: predicate.same_eliminate 0.60% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.31% : 0.000001s : 2: predicate.special_op_eliminate 1.06% : 0.000002s : 12: predicate.specialize_transform 1.82% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.19% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.69% : 0.000005s : 28: predicate.switch_defer_inline 2.42% : 0.000005s : 28: predicate.switch_layer_defer_inline 6.92% : 0.000013s : 77: predicate.switch_simplify 1.45% : 0.000003s : 19: predicate.tile_eliminate 1.37% : 0.000003s : 19: predicate.transpose_eliminate 1.62% : 0.000003s : 19: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.28% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000003s : 19: predicate.tuple_list_set_item_eliminator 1.66% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.52% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.57% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 19: predicate.value_based_eliminate 0.10% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.36% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002107 29 75.88% : 0.001599s : 19: func_graph_cloner_run.FuncGraphClonerGraph 24.12% : 0.000508s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047233 72 0.09% : 0.000040s : 1: add_recomputation 0.24% : 0.000113s : 1: auto_monad 0.04% : 0.000017s : 1: auto_monad_reorder 0.58% : 0.000276s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.18% : 0.000085s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 36.40% : 0.017195s : 1: jit_opt_a 0.28% : 0.000134s : 1: jit_opt_after_cconv 0.10% : 0.000047s : 1: jit_opt_b 0.93% : 0.000437s : 1: loop_unroll 1.60% : 0.000754s : 1: mutable_eliminate 3.17% : 0.001497s : 26: opt.transform.jit_opt_a 0.07% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000017s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000007s : 1: pre_auto_parallel 0.09% : 0.000041s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 16.92% : 0.007994s : 1: renormalize.infer 1.69% : 0.000796s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000134s : 1: rewriter_before_opt_a 0.15% : 0.000069s : 1: symbol_engine_optimizer 35.66% : 0.016845s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.410.302 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.411.045 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.239209, [30] [bootstrap]: 0.00048557 [type_inference]: 0.199621 [event_method]: 2.189e-05 [auto_monad]: 6.532e-05 [graph_reusing]: 5.20999e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00047781 [rewriter_before_opt_a]: 8.472e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.0361731, [2] [Cycle 1]: 0.0039869, [27] [switch_simplify]: 7.694e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00068146 [with_stream_mark]: 2.551e-05 [recompute_prepare]: 9.86e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.28002e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 1.182e-05 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00278502 [add_forward_monad_depend]: 8.33999e-06 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 1.829e-05 [cse]: 3.494e-05 [replace_applicator]: 1.792e-05 [Cycle 2]: 0.0003707, [27] [switch_simplify]: 6.69001e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012436 [with_stream_mark]: 1.196e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.46998e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 2.78e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 1.91003e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.21998e-06 [cse]: 1.15e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.255e-05 [rewriter_after_opt_a]: 3.78e-05 [convert_after_rewriter]: 6.57002e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00067656 [jit_opt_b]: 5.282e-05, [1] [Cycle 1]: 4.603e-05, [2] [frontend_op_eliminate]: 1.843e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.67e-05 [loop_unroll]: 0.00040782 [jit_opt_after_cconv]: 0.00014784, [1] [Cycle 1]: 0.00014126, [11] [c_1]: 2.416e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.99999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 2.125e-05 [call_graph_tuple_transform]: 2.109e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.89999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.33002e-06 [remove_dup_value]: 1.486e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 8.69e-06 [add_recomputation]: 4.943e-05 [cse_after_recomputation]: 2.185e-05, [1] [Cycle 1]: 1.67e-05, [1] [cse]: 1.117e-05 [auto_monad_reorder]: 1.518e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.04003e-06 [opt_after_jit_grad]: 0.00043922 [symbol_engine_optimizer]: 7.265e-05, [1] [Cycle 1]: 6.71e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 8.26002e-06 [elim_not_effective]: 1.345e-05 [opt_reshape]: 6.35002e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 3.29979e-07 [validate]: 6.656e-05 Sums bootstrap : 0.000486s : 0.23% type_inference : 0.199621s : 96.54% event_method : 0.000022s : 0.01% auto_monad : 0.000065s : 0.03% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000478s : 0.23% rewriter_before_opt_a : 0.000085s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000806s : 0.39% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002785s : 1.35% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000046s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000677s : 0.33% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000408s : 0.20% jit_opt_after_cconv.c_1 : 0.000024s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000439s : 0.21% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000067s : 0.03% Time group info: ------[substitution.] 0.000287 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.09% : 0.000006s : 4: substitution.graph_param_transform 86.48% : 0.000248s : 4: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000006s : 4: substitution.remove_not_recompute_node 2.31% : 0.000007s : 2: substitution.replace_old_param 4.38% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.199544 2 98.61% : 0.196770s : 1: type_inference.infer 1.39% : 0.002774s : 1: type_inference.specialize ------[replace.] 0.000083 6 70.93% : 0.000059s : 4: replace.inline 29.07% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 6 95.55% : 0.000245s : 4: match.inline 4.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 2.11% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.72% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.35% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.82% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 18: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.58% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 58: predicate.switch_simplify 1.44% : 0.000002s : 12: predicate.tile_eliminate 1.43% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.97% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002458 22 66.35% : 0.001631s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.43% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.22% : 0.000767s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.243092 72 0.02% : 0.000052s : 1: add_recomputation 0.03% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.21% : 0.000514s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 14.88% : 0.036177s : 1: jit_opt_a 0.06% : 0.000150s : 1: jit_opt_after_cconv 0.02% : 0.000055s : 1: jit_opt_b 0.17% : 0.000415s : 1: loop_unroll 0.28% : 0.000685s : 1: mutable_eliminate 0.44% : 0.001065s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000448s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000484s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.79% : 0.001916s : 1: renormalize.infer 0.35% : 0.000859s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000090s : 1: rewriter_before_opt_a 0.03% : 0.000075s : 1: symbol_engine_optimizer 82.13% : 0.199640s : 1: type_inference TotalTime = 0.0124148, [30] [bootstrap]: 0.00032293 [type_inference]: 0.00461921 [event_method]: 1.848e-05 [auto_monad]: 6.745e-05 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 3.395e-05 [rewriter_before_opt_a]: 6.856e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00526942, [2] [Cycle 1]: 0.00181445, [27] [switch_simplify]: 4.876e-05 [loop_unroll]: 2.986e-05 [a_1]: 0.00076556 [with_stream_mark]: 1.823e-05 [recompute_prepare]: 8.04002e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.98002e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 9.58002e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 0.00063794 [add_forward_monad_depend]: 4.92999e-06 [auto_monad_grad]: 2.15002e-06 [auto_monad_eliminator]: 1.231e-05 [cse]: 2.617e-05 [replace_applicator]: 1.093e-05 [Cycle 2]: 0.00031112, [27] [switch_simplify]: 5.62001e-06 [loop_unroll]: 4.85001e-06 [a_1]: 8.986e-05 [with_stream_mark]: 7.96001e-06 [recompute_prepare]: 4.82e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.70999e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.50999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.11001e-06 [inline_without_move]: 4.72e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 5.69e-06 [cse]: 9.97999e-06 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.141e-05 [rewriter_after_opt_a]: 3.302e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00050414 [jit_opt_b]: 4.896e-05, [1] [Cycle 1]: 4.238e-05, [2] [frontend_op_eliminate]: 1.576e-05 [inline_after_opt_a]: 1.513e-05 [cconv]: 2.517e-05 [loop_unroll]: 0.00040342 [jit_opt_after_cconv]: 0.00014609, [1] [Cycle 1]: 0.00013965, [11] [c_1]: 1.963e-05 [parameter_eliminate]: 2.48002e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.846e-05 [call_graph_tuple_transform]: 2.722e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.45001e-06 [remove_dup_value]: 1.555e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 5.78002e-06 [add_recomputation]: 4.837e-05 [cse_after_recomputation]: 2.043e-05, [1] [Cycle 1]: 1.528e-05, [1] [cse]: 1.004e-05 [auto_monad_reorder]: 1.578e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 4.71002e-06 [opt_after_jit_grad]: 0.00043548 [symbol_engine_optimizer]: 7.162e-05, [1] [Cycle 1]: 6.501e-05, [6] [build]: 3.47002e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.231e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 8.32998e-06 [renormalize]: 3.50003e-07 [validate]: 3.704e-05 Sums bootstrap : 0.000323s : 3.71% type_inference : 0.004619s : 53.00% event_method : 0.000018s : 0.21% auto_monad : 0.000067s : 0.77% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.39% rewriter_before_opt_a : 0.000069s : 0.79% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000054s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000855s : 9.82% jit_opt_a.with_stream_mark : 0.000026s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000638s : 7.32% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.21% jit_opt_a.cse : 0.000036s : 0.41% jit_opt_a.replace_applicator : 0.000016s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000033s : 0.38% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000504s : 5.78% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000025s : 0.29% loop_unroll : 0.000403s : 4.63% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.31% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.55% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000435s : 5.00% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.42% Time group info: ------[substitution.] 0.000200 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 7.36% : 0.000015s : 3: substitution.graph_param_transform 78.96% : 0.000158s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000005s : 2: substitution.replace_old_param 5.84% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004561 2 82.19% : 0.003748s : 1: type_inference.infer 17.81% : 0.000812s : 1: type_inference.specialize ------[replace.] 0.000308 6 13.31% : 0.000041s : 4: replace.inline 86.69% : 0.000267s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.63% : 0.000155s : 4: match.inline 6.37% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.17% : 0.000002s : 3: predicate.mutable_eliminate 0.82% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.71% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000614 13 52.08% : 0.000320s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.07% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.85% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014173 72 0.36% : 0.000051s : 1: add_recomputation 0.50% : 0.000071s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.39% : 0.000339s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000022s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.20% : 0.005273s : 1: jit_opt_a 1.05% : 0.000149s : 1: jit_opt_after_cconv 0.36% : 0.000051s : 1: jit_opt_b 2.90% : 0.000411s : 1: loop_unroll 3.61% : 0.000512s : 1: mutable_eliminate 7.48% : 0.001060s : 26: opt.transform.jit_opt_a 0.38% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.13% : 0.000444s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000037s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.39% : 0.000339s : 1: renormalize.infer 2.06% : 0.000291s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000036s : 1: rewriter_after_opt_a 0.50% : 0.000071s : 1: rewriter_before_opt_a 0.52% : 0.000074s : 1: symbol_engine_optimizer 32.67% : 0.004630s : 1: type_inference TotalTime = 0.0251612, [30] [bootstrap]: 0.00032199 [type_inference]: 0.00490511 [event_method]: 1.819e-05 [auto_monad]: 6.62e-05 [graph_reusing]: 5.39998e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 3.953e-05 [rewriter_before_opt_a]: 7.545e-05 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.00517282, [2] [Cycle 1]: 0.00151873, [27] [switch_simplify]: 5.602e-05 [loop_unroll]: 2.902e-05 [a_1]: 0.0005114 [with_stream_mark]: 1.761e-05 [recompute_prepare]: 7.63999e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.68002e-06 [merge_forward]: 4.60999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00058765 [add_forward_monad_depend]: 4.81997e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.382e-05 [cse]: 3.13e-05 [replace_applicator]: 1.144e-05 [Cycle 2]: 0.00031128, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 4.80001e-06 [a_1]: 8.728e-05 [with_stream_mark]: 1.014e-05 [recompute_prepare]: 4.68999e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 4.82998e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.44001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 7.64002e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 6.91001e-06 [inline_without_move]: 4.67998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.85002e-06 [cse]: 1.186e-05 [replace_applicator]: 4.80001e-06 [py_interpret_to_execute_after_opt_a]: 1.163e-05 [rewriter_after_opt_a]: 3.482e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00049387 [jit_opt_b]: 4.828e-05, [1] [Cycle 1]: 4.151e-05, [2] [frontend_op_eliminate]: 1.512e-05 [inline_after_opt_a]: 1.534e-05 [cconv]: 2.656e-05 [loop_unroll]: 0.0124439 [jit_opt_after_cconv]: 0.00024525, [1] [Cycle 1]: 0.00023191, [11] [c_1]: 3.767e-05 [parameter_eliminate]: 7.28e-06 [updatestate_depend_eliminate]: 9.09e-06 [updatestate_assign_eliminate]: 4.06001e-06 [updatestate_loads_eliminate]: 4.17998e-06 [cse]: 3.861e-05 [call_graph_tuple_transform]: 2.834e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 1.65001e-06 [switch_simplify]: 6.27001e-06 [remove_dup_value]: 1.993e-05 [partial_unused_args_eliminate]: 3.11999e-06 [environ_conv]: 8.24998e-06 [add_recomputation]: 5.374e-05 [cse_after_recomputation]: 2.771e-05, [1] [Cycle 1]: 2.091e-05, [1] [cse]: 1.444e-05 [auto_monad_reorder]: 1.899e-05 [get_jit_bprop_graph]: 2.54999e-06 [rewriter_after_jit_bprop_graph]: 9.59e-06 [opt_after_jit_grad]: 0.00077071 [symbol_engine_optimizer]: 7.739e-05, [1] [Cycle 1]: 7.025e-05, [6] [build]: 3.81001e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.468e-05 [opt_reshape]: 5.62999e-06 [fold_const_symbol]: 1.039e-05 [renormalize]: 6.10016e-07 [validate]: 4.287e-05 Sums bootstrap : 0.000322s : 1.52% type_inference : 0.004905s : 23.16% event_method : 0.000018s : 0.09% auto_monad : 0.000066s : 0.31% graph_reusing : 0.000005s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000040s : 0.19% rewriter_before_opt_a : 0.000075s : 0.36% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.29% jit_opt_a.loop_unroll : 0.000034s : 0.16% jit_opt_a.a_1 : 0.000599s : 2.83% jit_opt_a.with_stream_mark : 0.000028s : 0.13% jit_opt_a.recompute_prepare : 0.000012s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000010s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000015s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000588s : 2.77% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.09% jit_opt_a.cse : 0.000043s : 0.20% jit_opt_a.replace_applicator : 0.000016s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000035s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000494s : 2.33% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.07% jit_opt_b.inline_after_opt_a : 0.000015s : 0.07% cconv : 0.000027s : 0.13% loop_unroll : 0.012444s : 58.75% jit_opt_after_cconv.c_1 : 0.000038s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.cse : 0.000039s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000002s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000020s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.04% add_recomputation : 0.000054s : 0.25% cse_after_recomputation.cse : 0.000014s : 0.07% auto_monad_reorder : 0.000019s : 0.09% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.05% opt_after_jit_grad : 0.000771s : 3.64% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.20% Time group info: ------[substitution.] 0.000197 23 1.10% : 0.000002s : 2: substitution.elim_not_effective 1.01% : 0.000002s : 2: substitution.fold_const_symbol 3.28% : 0.000006s : 3: substitution.graph_param_transform 82.52% : 0.000162s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 6.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004836 2 82.82% : 0.004005s : 1: type_inference.infer 17.18% : 0.000831s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.86% : 0.000044s : 4: replace.inline 33.14% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.15% : 0.000160s : 4: match.inline 6.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.47% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 7.96% : 0.000009s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.36% : 0.000008s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.38% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000651 13 57.86% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.24% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.89% : 0.000240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026632 72 0.22% : 0.000058s : 1: add_recomputation 0.26% : 0.000069s : 1: auto_monad 0.08% : 0.000022s : 1: auto_monad_reorder 1.29% : 0.000343s : 1: bootstrap 0.11% : 0.000029s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000030s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 19.44% : 0.005176s : 1: jit_opt_a 0.94% : 0.000250s : 1: jit_opt_after_cconv 0.19% : 0.000051s : 1: jit_opt_b 46.79% : 0.012462s : 1: loop_unroll 1.88% : 0.000502s : 1: mutable_eliminate 3.03% : 0.000806s : 26: opt.transform.jit_opt_a 0.27% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000024s : 4: opt.transform.jit_opt_b 0.05% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.93% : 0.000781s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000042s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000022s : 1: remove_dup_value 1.14% : 0.000303s : 1: renormalize.infer 1.04% : 0.000278s : 1: renormalize.specialize 0.04% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000038s : 1: rewriter_after_opt_a 0.29% : 0.000078s : 1: rewriter_before_opt_a 0.30% : 0.000080s : 1: symbol_engine_optimizer 18.49% : 0.004923s : 1: type_inference TotalTime = 0.0133723, [30] [bootstrap]: 0.00028908 [type_inference]: 0.00579196 [event_method]: 1.833e-05 [auto_monad]: 8.043e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.24001e-06 [py_interpret_to_execute]: 3.613e-05 [rewriter_before_opt_a]: 7.376e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.0050387, [2] [Cycle 1]: 0.00157958, [27] [switch_simplify]: 5.22e-05 [loop_unroll]: 2.941e-05 [a_1]: 0.00051379 [with_stream_mark]: 3.714e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.57002e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.489e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00060777 [add_forward_monad_depend]: 5.07999e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.513e-05 [cse]: 3.406e-05 [replace_applicator]: 1.162e-05 [Cycle 2]: 0.00032129, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 4.95999e-06 [a_1]: 8.774e-05 [with_stream_mark]: 8.42e-06 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.99998e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.47001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.19e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 6.49001e-06 [inline_without_move]: 4.66002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.258e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.038e-05 [rewriter_after_opt_a]: 3.441e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00050302 [jit_opt_b]: 5.085e-05, [1] [Cycle 1]: 4.401e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.543e-05 [cconv]: 2.49e-05 [loop_unroll]: 0.00040741 [jit_opt_after_cconv]: 0.00014957, [1] [Cycle 1]: 0.00013586, [11] [c_1]: 2.064e-05 [parameter_eliminate]: 1.98002e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 1.971e-05 [call_graph_tuple_transform]: 1.746e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.578e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 5.64e-06 [add_recomputation]: 4.946e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.906e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 1.62999e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.0004423 [symbol_engine_optimizer]: 7.28e-05, [1] [Cycle 1]: 6.702e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.291e-05 [opt_reshape]: 5.54998e-06 [fold_const_symbol]: 8.60001e-06 [renormalize]: 3.59985e-07 [validate]: 3.384e-05 Sums bootstrap : 0.000289s : 3.00% type_inference : 0.005792s : 60.09% event_method : 0.000018s : 0.19% auto_monad : 0.000080s : 0.83% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.37% rewriter_before_opt_a : 0.000074s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.60% jit_opt_a.loop_unroll : 0.000034s : 0.36% jit_opt_a.a_1 : 0.000602s : 6.24% jit_opt_a.with_stream_mark : 0.000046s : 0.47% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000608s : 6.31% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.22% jit_opt_a.cse : 0.000047s : 0.48% jit_opt_a.replace_applicator : 0.000017s : 0.17% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000034s : 0.36% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000503s : 5.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000025s : 0.26% loop_unroll : 0.000407s : 4.23% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000049s : 0.51% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000442s : 4.59% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.35% Time group info: ------[substitution.] 0.000192 23 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 83.04% : 0.000159s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.39% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005730 2 85.92% : 0.004923s : 1: type_inference.infer 14.08% : 0.000807s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.03% : 0.000046s : 4: replace.inline 31.97% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.39% : 0.000157s : 4: match.inline 6.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000001s : 6: predicate.special_op_eliminate 1.20% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.41% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000586 13 52.22% : 0.000306s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.99% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.79% : 0.000245s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014846 72 0.35% : 0.000052s : 1: add_recomputation 0.57% : 0.000085s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.08% : 0.000309s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 33.96% : 0.005041s : 1: jit_opt_a 1.03% : 0.000152s : 1: jit_opt_after_cconv 0.36% : 0.000053s : 1: jit_opt_b 2.80% : 0.000415s : 1: loop_unroll 3.45% : 0.000512s : 1: mutable_eliminate 5.45% : 0.000809s : 26: opt.transform.jit_opt_a 0.31% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.03% : 0.000450s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.18% : 0.000323s : 1: renormalize.infer 1.87% : 0.000277s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000037s : 1: rewriter_after_opt_a 0.52% : 0.000077s : 1: rewriter_before_opt_a 0.51% : 0.000075s : 1: symbol_engine_optimizer 39.11% : 0.005807s : 1: type_inference TotalTime = 0.169923, [30] [bootstrap]: 0.00027895 [type_inference]: 0.144074 [event_method]: 0.00064748 [auto_monad]: 0.00012714 [graph_reusing]: 8.02e-06 [pre_auto_parallel]: 3.12002e-06 [py_interpret_to_execute]: 4.466e-05 [rewriter_before_opt_a]: 0.00014013 [expand_dump_flag]: 3.52002e-06 [jit_opt_a]: 0.0222714, [2] [Cycle 1]: 0.0176119, [27] [switch_simplify]: 9.027e-05 [loop_unroll]: 4.665e-05 [a_1]: 0.00108162 [with_stream_mark]: 3.91e-05 [recompute_prepare]: 2.596e-05 [updatestate_depend_eliminate]: 1.024e-05 [updatestate_assign_eliminate]: 7.51001e-06 [updatestate_loads_eliminate]: 6.79001e-06 [parameter_eliminate]: 3.24001e-06 [specialize_transform]: 1.632e-05 [updatestate_useless_node_eliminater]: 1.421e-05 [accelerated_algorithm]: 1.588e-05 [meta_shard_fg_expand]: 4.43999e-06 [get_grad_eliminate_]: 1.497e-05 [merge_forward]: 1.003e-05 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.998e-05 [j_node_and_user_rematch]: 2.709e-05 [meta_fg_expand]: 0.00231852 [replace_old_param]: 9.041e-05 [inline_without_move]: 6.922e-05 [renormalize]: 0.0133128 [add_forward_monad_depend]: 7.69002e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.522e-05 [cse]: 3.074e-05 [replace_applicator]: 2.229e-05 [Cycle 2]: 0.00044608, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 4.50001e-06 [a_1]: 6.47e-05 [with_stream_mark]: 1.453e-05 [recompute_prepare]: 4.34997e-06 [updatestate_depend_eliminate]: 3.79002e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 4.28001e-06 [updatestate_useless_node_eliminater]: 3.85e-06 [accelerated_algorithm]: 4.57e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 3.63e-06 [merge_forward]: 3.31001e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.763e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 0.00012641 [replace_old_param]: 5.14e-06 [inline_without_move]: 3.98001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.56998e-06 [cse]: 1.021e-05 [replace_applicator]: 4.02e-06 [py_interpret_to_execute_after_opt_a]: 1.106e-05 [rewriter_after_opt_a]: 3.676e-05 [convert_after_rewriter]: 5.91e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00075656 [jit_opt_b]: 4.381e-05, [1] [Cycle 1]: 3.665e-05, [2] [frontend_op_eliminate]: 1.178e-05 [inline_after_opt_a]: 1.242e-05 [cconv]: 2.661e-05 [loop_unroll]: 0.00044039 [jit_opt_after_cconv]: 0.00013364, [1] [Cycle 1]: 0.00012671, [11] [c_1]: 1.394e-05 [parameter_eliminate]: 2.76999e-06 [updatestate_depend_eliminate]: 4.96997e-06 [updatestate_assign_eliminate]: 1.93002e-06 [updatestate_loads_eliminate]: 1.69e-06 [cse]: 1.96e-05 [call_graph_tuple_transform]: 1.482e-05 [tuple_list_get_item_eliminator]: 4.36002e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 4.25e-06 [remove_dup_value]: 1.492e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 5.79e-06 [add_recomputation]: 3.775e-05 [cse_after_recomputation]: 1.965e-05, [1] [Cycle 1]: 1.444e-05, [1] [cse]: 8.17998e-06 [auto_monad_reorder]: 1.299e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 5.29e-06 [opt_after_jit_grad]: 0.00044664 [symbol_engine_optimizer]: 6.848e-05, [1] [Cycle 1]: 6.182e-05, [6] [build]: 3.85e-06 [elim_shapecalc]: 5.75001e-06 [elim_not_effective]: 1.025e-05 [opt_reshape]: 5.15001e-06 [fold_const_symbol]: 6.73998e-06 [renormalize]: 6.00005e-07 [validate]: 3.527e-05 Sums bootstrap : 0.000279s : 0.17% type_inference : 0.144074s : 87.35% event_method : 0.000647s : 0.39% auto_monad : 0.000127s : 0.08% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000045s : 0.03% rewriter_before_opt_a : 0.000140s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000096s : 0.06% jit_opt_a.loop_unroll : 0.000051s : 0.03% jit_opt_a.a_1 : 0.001146s : 0.70% jit_opt_a.with_stream_mark : 0.000054s : 0.03% jit_opt_a.recompute_prepare : 0.000030s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000011s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000021s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.01% jit_opt_a.accelerated_algorithm : 0.000020s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000019s : 0.01% jit_opt_a.merge_forward : 0.000013s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000035s : 0.02% jit_opt_a.meta_fg_expand : 0.002445s : 1.48% jit_opt_a.replace_old_param : 0.000096s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.04% jit_opt_a.renormalize : 0.013313s : 8.07% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000041s : 0.02% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000757s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000440s : 0.27% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000038s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000447s : 0.27% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.02% Time group info: ------[substitution.] 0.000378 56 0.41% : 0.000002s : 1: substitution.elim_not_effective 0.37% : 0.000001s : 1: substitution.fold_const_symbol 1.18% : 0.000004s : 1: substitution.graph_param_transform 71.35% : 0.000270s : 7: substitution.inline 6.32% : 0.000024s : 2: substitution.inline_without_move 2.23% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.05% : 0.000004s : 2: substitution.minmaximum_grad 1.22% : 0.000005s : 3: substitution.partial_eliminate 2.20% : 0.000008s : 9: substitution.remove_not_recompute_node 1.89% : 0.000007s : 2: substitution.replace_applicator 2.19% : 0.000008s : 10: substitution.replace_old_param 1.04% : 0.000004s : 1: substitution.set_cell_output_no_recompute 2.29% : 0.000009s : 2: substitution.tuple_list_convert_item_index_to_positive 1.65% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 4.58% : 0.000017s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.143947 2 97.58% : 0.140457s : 1: type_inference.infer 2.42% : 0.003490s : 1: type_inference.specialize ------[replace.] 0.000098 9 78.11% : 0.000077s : 7: replace.inline 21.89% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 9 95.55% : 0.000266s : 7: match.inline 4.45% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000203 1234 1.39% : 0.000003s : 20: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000003s : 20: predicate.addn_check_dump 1.55% : 0.000003s : 20: predicate.addn_zero_filter 2.02% : 0.000004s : 20: predicate.arithmetic_simplify 1.51% : 0.000003s : 20: predicate.cast_eliminate 0.24% : 0.000000s : 1: predicate.check_bprop_eliminate 1.28% : 0.000003s : 20: predicate.compare_switch_simplify 1.43% : 0.000003s : 20: predicate.depend_value_elim 1.25% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.33% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.41% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.12% : 0.000000s : 1: predicate.elim_not_effective 0.27% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.40% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 20: predicate.environ_get_depend_swap 1.30% : 0.000003s : 20: predicate.environ_get_eliminate 1.29% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.05% : 0.000002s : 13: predicate.get_grad_eliminate 0.13% : 0.000000s : 1: predicate.graph_param_transform 4.67% : 0.000009s : 31: predicate.inline 3.67% : 0.000007s : 41: predicate.inline_without_move 0.48% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.97% : 0.000004s : 13: predicate.less_batch_normalization 1.62% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.74% : 0.000004s : 23: predicate.load_eliminater 0.56% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.37% : 0.000007s : 49: predicate.loop_unroll_before_grad 1.73% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 20: predicate.merge_addn 1.25% : 0.000003s : 20: predicate.minmaximum_grad 1.12% : 0.000002s : 1: predicate.mutable_eliminate 0.35% : 0.000001s : 1: predicate.opt_reshape 2.06% : 0.000004s : 23: predicate.partial_eliminate 1.31% : 0.000003s : 20: predicate.print_const_string_wrapper 1.99% : 0.000004s : 20: predicate.reduce_eliminate 1.59% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 13: predicate.remove_not_recompute_node 1.58% : 0.000003s : 24: predicate.replace_applicator 2.32% : 0.000005s : 41: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.42% : 0.000003s : 20: predicate.reshape_eliminate 1.37% : 0.000003s : 20: predicate.row_tensor_add_zeros_like 0.36% : 0.000001s : 1: predicate.row_tensor_eliminate 1.38% : 0.000003s : 20: predicate.same_eliminate 0.65% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.29% : 0.000001s : 2: predicate.special_op_eliminate 1.09% : 0.000002s : 13: predicate.specialize_transform 1.68% : 0.000003s : 20: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000003s : 20: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.45% : 0.000005s : 29: predicate.switch_defer_inline 2.37% : 0.000005s : 29: predicate.switch_layer_defer_inline 6.67% : 0.000014s : 79: predicate.switch_simplify 1.62% : 0.000003s : 20: predicate.tile_eliminate 1.38% : 0.000003s : 20: predicate.transpose_eliminate 1.76% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000004s : 20: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000007s : 24: predicate.tuple_list_get_item_eliminator 1.99% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.42% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.48% : 0.000003s : 23: predicate.updatestate_pure_node_eliminater 2.72% : 0.000006s : 36: predicate.updatestate_useless_node_eliminater 1.84% : 0.000004s : 20: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.27% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003643 38 87.82% : 0.003199s : 28: func_graph_cloner_run.FuncGraphClonerGraph 12.18% : 0.000444s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.184873 72 0.02% : 0.000041s : 1: add_recomputation 0.07% : 0.000136s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.17% : 0.000305s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.36% : 0.000659s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 12.05% : 0.022275s : 1: jit_opt_a 0.07% : 0.000136s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.24% : 0.000448s : 1: loop_unroll 0.41% : 0.000766s : 1: mutable_eliminate 0.88% : 0.001635s : 26: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000455s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000048s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 6.84% : 0.012646s : 1: renormalize.infer 0.35% : 0.000652s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000144s : 1: rewriter_before_opt_a 0.04% : 0.000071s : 1: symbol_engine_optimizer 77.95% : 0.144101s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.590.357 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.591.038 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0913926, [30] [bootstrap]: 0.00032896 [type_inference]: 0.0784098 [event_method]: 2.221e-05 [auto_monad]: 7.146e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00012577 [rewriter_before_opt_a]: 8.582e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00994336, [2] [Cycle 1]: 0.00587461, [27] [switch_simplify]: 6.245e-05 [loop_unroll]: 2.958e-05 [a_1]: 0.00059928 [with_stream_mark]: 2.223e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 4.02e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 8.90999e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.70002e-06 [inline_without_move]: 5.93998e-06 [renormalize]: 0.00478029 [add_forward_monad_depend]: 8.23999e-06 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.941e-05 [cse]: 3.912e-05 [replace_applicator]: 1.858e-05 [Cycle 2]: 0.0003395, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 5.52999e-06 [a_1]: 9.789e-05 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 4.97999e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 8.26002e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 5.02e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.09003e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.312e-05 [replace_applicator]: 5.29998e-06 [py_interpret_to_execute_after_opt_a]: 1.612e-05 [rewriter_after_opt_a]: 4.352e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.60001e-06 [mutable_eliminate]: 0.00073386 [jit_opt_b]: 5.142e-05, [1] [Cycle 1]: 4.362e-05, [2] [frontend_op_eliminate]: 1.715e-05 [inline_after_opt_a]: 1.589e-05 [cconv]: 2.795e-05 [loop_unroll]: 0.00042702 [jit_opt_after_cconv]: 0.00014296, [1] [Cycle 1]: 0.00013671, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 2.74999e-06 [updatestate_depend_eliminate]: 5.87001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.241e-05 [call_graph_tuple_transform]: 1.95e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.583e-05 [partial_unused_args_eliminate]: 2.81999e-06 [environ_conv]: 6.78998e-06 [add_recomputation]: 5.245e-05 [cse_after_recomputation]: 2.228e-05, [1] [Cycle 1]: 1.709e-05, [1] [cse]: 1.118e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.79998e-06 [opt_after_jit_grad]: 0.00050225 [symbol_engine_optimizer]: 7.295e-05, [1] [Cycle 1]: 6.656e-05, [6] [build]: 3.42002e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 3.39991e-07 [validate]: 4.016e-05 Sums bootstrap : 0.000329s : 0.38% type_inference : 0.078410s : 90.08% event_method : 0.000022s : 0.03% auto_monad : 0.000071s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000126s : 0.14% rewriter_before_opt_a : 0.000086s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000697s : 0.80% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.004780s : 5.49% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000052s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000044s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000734s : 0.84% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000427s : 0.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000502s : 0.58% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.05% Time group info: ------[substitution.] 0.000252 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000006s : 3: substitution.graph_param_transform 85.48% : 0.000215s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000005s : 2: substitution.replace_old_param 5.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.078333 2 97.75% : 0.076572s : 1: type_inference.infer 2.25% : 0.001762s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.32% : 0.000052s : 4: replace.inline 32.68% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.46% : 0.000213s : 4: match.inline 5.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.67% : 0.000002s : 10: predicate.accumulaten_eliminater 1.25% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.37% : 0.000000s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 1.93% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.11% : 0.000010s : 53: predicate.switch_simplify 1.71% : 0.000002s : 10: predicate.tile_eliminate 1.57% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.63% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000984 13 41.55% : 0.000409s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.51% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.94% : 0.000521s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.097152 72 0.06% : 0.000056s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.37% : 0.000361s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.24% : 0.009947s : 1: jit_opt_a 0.15% : 0.000146s : 1: jit_opt_after_cconv 0.06% : 0.000054s : 1: jit_opt_b 0.45% : 0.000435s : 1: loop_unroll 0.76% : 0.000743s : 1: mutable_eliminate 0.96% : 0.000928s : 26: opt.transform.jit_opt_a 0.05% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.53% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000130s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 4.29% : 0.004166s : 1: renormalize.infer 0.62% : 0.000604s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000076s : 1: symbol_engine_optimizer 80.73% : 0.078429s : 1: type_inference TotalTime = 0.160368, [30] [bootstrap]: 0.00028492 [type_inference]: 0.146505 [event_method]: 2.176e-05 [auto_monad]: 7.175e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00039946 [rewriter_before_opt_a]: 9.811e-05 [expand_dump_flag]: 3.73999e-06 [jit_opt_a]: 0.010823, [2] [Cycle 1]: 0.00365682, [27] [switch_simplify]: 6.86e-05 [loop_unroll]: 3.464e-05 [a_1]: 0.00070346 [with_stream_mark]: 2.306e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00248099 [add_forward_monad_depend]: 5.14e-06 [auto_monad_grad]: 2.20002e-06 [auto_monad_eliminator]: 1.552e-05 [cse]: 3.619e-05 [replace_applicator]: 1.493e-05 [Cycle 2]: 0.00035923, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.00011452 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 2.70997e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.84999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.40999e-06 [cse]: 1.428e-05 [replace_applicator]: 6.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.33e-05 [rewriter_after_opt_a]: 3.988e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.04003e-06 [mutable_eliminate]: 0.0005584 [jit_opt_b]: 5.455e-05, [1] [Cycle 1]: 4.733e-05, [2] [frontend_op_eliminate]: 1.863e-05 [inline_after_opt_a]: 1.797e-05 [cconv]: 2.648e-05 [loop_unroll]: 0.00041772 [jit_opt_after_cconv]: 0.00015312, [1] [Cycle 1]: 0.00014656, [11] [c_1]: 2.596e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 2.33002e-06 [cse]: 2.334e-05 [call_graph_tuple_transform]: 2.122e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.07001e-06 [remove_dup_value]: 1.785e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 8.45999e-06 [add_recomputation]: 5.104e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.828e-05, [1] [cse]: 1.282e-05 [auto_monad_reorder]: 1.85e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.0004505 [symbol_engine_optimizer]: 7.479e-05, [1] [Cycle 1]: 6.88e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 8.71997e-06 [elim_not_effective]: 1.268e-05 [opt_reshape]: 6.46999e-06 [fold_const_symbol]: 9.83002e-06 [renormalize]: 3.9002e-07 [validate]: 4.218e-05 Sums bootstrap : 0.000285s : 0.19% type_inference : 0.146505s : 95.76% event_method : 0.000022s : 0.01% auto_monad : 0.000072s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000399s : 0.26% rewriter_before_opt_a : 0.000098s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000818s : 0.53% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002481s : 1.62% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000558s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000418s : 0.27% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000450s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000277 25 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 4: substitution.graph_param_transform 87.51% : 0.000243s : 5: substitution.inline 1.03% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000005s : 2: substitution.replace_old_param 4.75% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.146427 2 98.22% : 0.143820s : 1: type_inference.infer 1.78% : 0.002607s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.64% : 0.000068s : 5: replace.inline 31.36% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000252 7 95.26% : 0.000240s : 5: match.inline 4.74% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000002s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 6.04% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.75% : 0.000002s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.91% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002326 25 68.81% : 0.001600s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.57% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.62% : 0.000642s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.163992 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.18% : 0.000298s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.60% : 0.010826s : 1: jit_opt_a 0.10% : 0.000156s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.26% : 0.000425s : 1: loop_unroll 0.35% : 0.000566s : 1: mutable_eliminate 0.65% : 0.001073s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000458s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000405s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.10% : 0.001800s : 1: renormalize.infer 0.41% : 0.000672s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000104s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 89.35% : 0.146528s : 1: type_inference TotalTime = 0.219415, [30] [bootstrap]: 0.00032212 [type_inference]: 0.207225 [event_method]: 2.489e-05 [auto_monad]: 7.146e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 0.00068762 [rewriter_before_opt_a]: 0.00010026 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00851718, [2] [Cycle 1]: 0.00447144, [27] [switch_simplify]: 6.606e-05 [loop_unroll]: 3.647e-05 [a_1]: 0.00074132 [with_stream_mark]: 1.974e-05 [recompute_prepare]: 9.53002e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.77002e-06 [updatestate_useless_node_eliminater]: 1.167e-05 [accelerated_algorithm]: 1.057e-05 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.68e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 1.083e-05 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 1.154e-05 [inline_without_move]: 6.43e-06 [renormalize]: 0.00321793 [add_forward_monad_depend]: 7.43e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.703e-05 [cse]: 3.513e-05 [replace_applicator]: 2.128e-05 [Cycle 2]: 0.00039422, [27] [switch_simplify]: 6.96999e-06 [loop_unroll]: 6.29999e-06 [a_1]: 0.00013634 [with_stream_mark]: 1.322e-05 [recompute_prepare]: 6.73998e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 6.65002e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 2.71999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.82001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.358e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.16e-05 [rewriter_after_opt_a]: 3.97e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.41002e-06 [mutable_eliminate]: 0.00069536 [jit_opt_b]: 5.648e-05, [1] [Cycle 1]: 4.904e-05, [2] [frontend_op_eliminate]: 1.955e-05 [inline_after_opt_a]: 1.808e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00044118 [jit_opt_after_cconv]: 0.00015782, [1] [Cycle 1]: 0.0001514, [11] [c_1]: 2.84e-05 [parameter_eliminate]: 1.91998e-06 [updatestate_depend_eliminate]: 5.47999e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.332e-05 [call_graph_tuple_transform]: 2.078e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 7.73999e-06 [remove_dup_value]: 1.62e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 7.61001e-06 [add_recomputation]: 4.98e-05 [cse_after_recomputation]: 2.39e-05, [1] [Cycle 1]: 1.89e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.914e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.09998e-06 [opt_after_jit_grad]: 0.00049341 [symbol_engine_optimizer]: 7.846e-05, [1] [Cycle 1]: 7.179e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 8.77999e-06 [elim_not_effective]: 1.361e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 1.035e-05 [renormalize]: 5.00004e-07 [validate]: 4.393e-05 Sums bootstrap : 0.000322s : 0.15% type_inference : 0.207225s : 96.35% event_method : 0.000025s : 0.01% auto_monad : 0.000071s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000688s : 0.32% rewriter_before_opt_a : 0.000100s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.000878s : 0.41% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003218s : 1.50% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000049s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000695s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000441s : 0.21% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000493s : 0.23% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.02% Time group info: ------[substitution.] 0.000296 28 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000006s : 4: substitution.graph_param_transform 83.68% : 0.000247s : 5: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000013s : 3: substitution.reduce_eliminate 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000006s : 2: substitution.replace_old_param 3.89% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.207134 2 98.39% : 0.203796s : 1: type_inference.infer 1.61% : 0.003337s : 1: type_inference.specialize ------[replace.] 0.000114 7 67.27% : 0.000077s : 5: replace.inline 32.73% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.93% : 0.000244s : 5: match.inline 4.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 13: predicate.addn_check_dump 1.57% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.87% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 0.89% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 1.86% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.45% : 0.000004s : 23: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.72% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.29% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002618 25 63.67% : 0.001667s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.99% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.34% : 0.000873s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.223852 72 0.02% : 0.000052s : 1: add_recomputation 0.03% : 0.000075s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.15% : 0.000342s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000103s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.81% : 0.008521s : 1: jit_opt_a 0.07% : 0.000161s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.20% : 0.000449s : 1: loop_unroll 0.31% : 0.000703s : 1: mutable_eliminate 0.51% : 0.001150s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000502s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000698s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.05% : 0.002341s : 1: renormalize.infer 0.39% : 0.000867s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000105s : 1: rewriter_before_opt_a 0.04% : 0.000081s : 1: symbol_engine_optimizer 92.58% : 0.207242s : 1: type_inference TotalTime = 0.0414069, [30] [bootstrap]: 0.00032777 [type_inference]: 0.0331502 [event_method]: 2.118e-05 [auto_monad]: 6.794e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 9.391e-05 [rewriter_before_opt_a]: 8.199e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00563363, [2] [Cycle 1]: 0.00188043, [27] [switch_simplify]: 5.56e-05 [loop_unroll]: 2.913e-05 [a_1]: 0.00053243 [with_stream_mark]: 2.08e-05 [recompute_prepare]: 7.52002e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.09998e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.96998e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 8.60999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00091913 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.441e-05 [cse]: 3.332e-05 [replace_applicator]: 1.157e-05 [Cycle 2]: 0.00035261, [27] [switch_simplify]: 5.83002e-06 [loop_unroll]: 4.94e-06 [a_1]: 0.00012395 [with_stream_mark]: 9.51e-06 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.13002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.89998e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.352e-05 [j_node_and_user_rematch]: 7.8e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.44e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.134e-05 [rewriter_after_opt_a]: 3.698e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.0005028 [jit_opt_b]: 4.792e-05, [1] [Cycle 1]: 4.097e-05, [2] [frontend_op_eliminate]: 1.469e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 2.548e-05 [loop_unroll]: 0.00040217 [jit_opt_after_cconv]: 0.00013388, [1] [Cycle 1]: 0.00012801, [11] [c_1]: 1.987e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.56998e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 1.953e-05 [call_graph_tuple_transform]: 1.728e-05 [tuple_list_get_item_eliminator]: 4.95001e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.08002e-06 [remove_dup_value]: 1.513e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 4.964e-05 [cse_after_recomputation]: 3.689e-05, [1] [Cycle 1]: 1.683e-05, [1] [cse]: 1.147e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00043323 [symbol_engine_optimizer]: 6.862e-05, [1] [Cycle 1]: 6.233e-05, [6] [build]: 2.94001e-06 [elim_shapecalc]: 7.45e-06 [elim_not_effective]: 1.238e-05 [opt_reshape]: 5.43002e-06 [fold_const_symbol]: 8.37e-06 [renormalize]: 3.50003e-07 [validate]: 3.77e-05 Sums bootstrap : 0.000328s : 0.88% type_inference : 0.033150s : 88.56% event_method : 0.000021s : 0.06% auto_monad : 0.000068s : 0.18% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000094s : 0.25% rewriter_before_opt_a : 0.000082s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.16% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000656s : 1.75% jit_opt_a.with_stream_mark : 0.000030s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000919s : 2.46% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000048s : 0.13% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000503s : 1.34% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000025s : 0.07% loop_unroll : 0.000402s : 1.07% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000433s : 1.16% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.10% Time group info: ------[substitution.] 0.000212 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000005s : 3: substitution.graph_param_transform 84.97% : 0.000180s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000004s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.57% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033069 2 95.65% : 0.031631s : 1: type_inference.infer 4.35% : 0.001438s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.86% : 0.000047s : 4: replace.inline 32.14% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 94.29% : 0.000178s : 4: match.inline 5.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.51% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000000s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000821 13 46.66% : 0.000383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.47% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.87% : 0.000393s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043241 72 0.12% : 0.000052s : 1: add_recomputation 0.17% : 0.000072s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.80% : 0.000345s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000039s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.04% : 0.005637s : 1: jit_opt_a 0.32% : 0.000136s : 1: jit_opt_after_cconv 0.12% : 0.000050s : 1: jit_opt_b 0.95% : 0.000409s : 1: loop_unroll 1.18% : 0.000510s : 1: mutable_eliminate 2.00% : 0.000866s : 26: opt.transform.jit_opt_a 0.10% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.02% : 0.000440s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000098s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.23% : 0.000532s : 1: renormalize.infer 0.88% : 0.000379s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.20% : 0.000085s : 1: rewriter_before_opt_a 0.16% : 0.000071s : 1: symbol_engine_optimizer 76.71% : 0.033170s : 1: type_inference TotalTime = 0.142909, [30] [bootstrap]: 0.00024779 [type_inference]: 0.12011 [event_method]: 0.00063533 [auto_monad]: 0.00011611 [graph_reusing]: 7.53e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 4.01e-05 [rewriter_before_opt_a]: 0.00013339 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.0193107, [2] [Cycle 1]: 0.0152744, [27] [switch_simplify]: 7.444e-05 [loop_unroll]: 4.431e-05 [a_1]: 0.00100522 [with_stream_mark]: 3.407e-05 [recompute_prepare]: 2.029e-05 [updatestate_depend_eliminate]: 9.78002e-06 [updatestate_assign_eliminate]: 7.11001e-06 [updatestate_loads_eliminate]: 6.87002e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 1.449e-05 [updatestate_useless_node_eliminater]: 1.341e-05 [accelerated_algorithm]: 1.384e-05 [meta_shard_fg_expand]: 4.05e-06 [get_grad_eliminate_]: 1.371e-05 [merge_forward]: 8.65001e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.892e-05 [j_node_and_user_rematch]: 2.479e-05 [meta_fg_expand]: 0.0017827 [replace_old_param]: 6.691e-05 [inline_without_move]: 5.962e-05 [renormalize]: 0.0117308 [add_forward_monad_depend]: 7.26001e-06 [auto_monad_grad]: 2.80997e-06 [auto_monad_eliminator]: 1.535e-05 [cse]: 2.866e-05 [replace_applicator]: 2.084e-05 [Cycle 2]: 0.00040887, [27] [switch_simplify]: 4.58999e-06 [loop_unroll]: 4.82e-06 [a_1]: 5.668e-05 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 4.42e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 3.68e-06 [updatestate_useless_node_eliminater]: 3.51001e-06 [accelerated_algorithm]: 4.02e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 3.53e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 3.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 6.74001e-06 [meta_fg_expand]: 0.00011043 [replace_old_param]: 5.66e-06 [inline_without_move]: 3.53e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.52999e-06 [auto_monad_grad]: 9.60019e-07 [auto_monad_eliminator]: 4.84003e-06 [cse]: 1.145e-05 [replace_applicator]: 3.59002e-06 [py_interpret_to_execute_after_opt_a]: 1.268e-05 [rewriter_after_opt_a]: 3.414e-05 [convert_after_rewriter]: 5.84e-06 [order_py_execute_after_rewriter]: 4.59998e-06 [mutable_eliminate]: 0.00068051 [jit_opt_b]: 4.31e-05, [1] [Cycle 1]: 3.54e-05, [2] [frontend_op_eliminate]: 1.132e-05 [inline_after_opt_a]: 1.195e-05 [cconv]: 2.634e-05 [loop_unroll]: 0.00042382 [jit_opt_after_cconv]: 0.00021273, [1] [Cycle 1]: 0.00020652, [11] [c_1]: 1.341e-05 [parameter_eliminate]: 3.06999e-06 [updatestate_depend_eliminate]: 4.96002e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 1.71e-06 [cse]: 1.829e-05 [call_graph_tuple_transform]: 1.536e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 4.21001e-06 [remove_dup_value]: 1.526e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 5.84999e-06 [add_recomputation]: 3.896e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.096e-05 [auto_monad_reorder]: 1.368e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00045733 [symbol_engine_optimizer]: 6.857e-05, [1] [Cycle 1]: 6.255e-05, [6] [build]: 4.50001e-06 [elim_shapecalc]: 6.31e-06 [elim_not_effective]: 1.031e-05 [opt_reshape]: 4.58999e-06 [fold_const_symbol]: 6.31998e-06 [renormalize]: 2.69996e-07 [validate]: 3.413e-05 Sums bootstrap : 0.000248s : 0.18% type_inference : 0.120110s : 86.71% event_method : 0.000635s : 0.46% auto_monad : 0.000116s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000133s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000049s : 0.04% jit_opt_a.a_1 : 0.001062s : 0.77% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000025s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000017s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000012s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000032s : 0.02% jit_opt_a.meta_fg_expand : 0.001893s : 1.37% jit_opt_a.replace_old_param : 0.000073s : 0.05% jit_opt_a.inline_without_move : 0.000063s : 0.05% jit_opt_a.renormalize : 0.011731s : 8.47% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000681s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000424s : 0.31% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000457s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.02% Time group info: ------[substitution.] 0.000306 56 0.49% : 0.000002s : 1: substitution.elim_not_effective 0.32% : 0.000001s : 1: substitution.fold_const_symbol 1.54% : 0.000005s : 1: substitution.graph_param_transform 70.06% : 0.000214s : 7: substitution.inline 5.78% : 0.000018s : 2: substitution.inline_without_move 2.41% : 0.000007s : 9: substitution.j_node_and_user_rematch 1.51% : 0.000005s : 2: substitution.minmaximum_grad 1.33% : 0.000004s : 3: substitution.partial_eliminate 2.53% : 0.000008s : 9: substitution.remove_not_recompute_node 2.00% : 0.000006s : 2: substitution.replace_applicator 1.98% : 0.000006s : 10: substitution.replace_old_param 0.90% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.55% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.66% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 4.93% : 0.000015s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120022 2 97.09% : 0.116531s : 1: type_inference.infer 2.91% : 0.003491s : 1: type_inference.specialize ------[replace.] 0.000083 9 79.69% : 0.000066s : 7: replace.inline 20.31% : 0.000017s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 9 95.27% : 0.000210s : 7: match.inline 4.73% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000195 1234 1.65% : 0.000003s : 20: predicate.accumulaten_eliminater 0.53% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000003s : 20: predicate.addn_check_dump 1.50% : 0.000003s : 20: predicate.addn_zero_filter 1.85% : 0.000004s : 20: predicate.arithmetic_simplify 1.52% : 0.000003s : 20: predicate.cast_eliminate 0.14% : 0.000000s : 1: predicate.check_bprop_eliminate 1.37% : 0.000003s : 20: predicate.compare_switch_simplify 1.38% : 0.000003s : 20: predicate.depend_value_elim 1.39% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.36% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.47% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.45% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 1: predicate.elim_not_effective 0.22% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.29% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 20: predicate.environ_get_depend_swap 1.32% : 0.000003s : 20: predicate.environ_get_eliminate 1.26% : 0.000002s : 20: predicate.environ_get_set_eliminate 0.07% : 0.000000s : 1: predicate.fold_const_symbol 1.08% : 0.000002s : 13: predicate.get_grad_eliminate 0.16% : 0.000000s : 1: predicate.graph_param_transform 4.51% : 0.000009s : 31: predicate.inline 3.32% : 0.000006s : 41: predicate.inline_without_move 0.52% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.33% : 0.000003s : 13: predicate.less_batch_normalization 1.62% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.79% : 0.000004s : 23: predicate.load_eliminater 0.59% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.71% : 0.000007s : 49: predicate.loop_unroll_before_grad 1.83% : 0.000004s : 21: predicate.make_slice_get_slice_eliminator 1.37% : 0.000003s : 20: predicate.merge_addn 1.33% : 0.000003s : 20: predicate.minmaximum_grad 1.01% : 0.000002s : 1: predicate.mutable_eliminate 0.20% : 0.000000s : 1: predicate.opt_reshape 2.10% : 0.000004s : 23: predicate.partial_eliminate 1.48% : 0.000003s : 20: predicate.print_const_string_wrapper 1.81% : 0.000004s : 20: predicate.reduce_eliminate 1.61% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 13: predicate.remove_not_recompute_node 1.69% : 0.000003s : 24: predicate.replace_applicator 2.17% : 0.000004s : 41: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.52% : 0.000003s : 20: predicate.reshape_eliminate 1.44% : 0.000003s : 20: predicate.row_tensor_add_zeros_like 0.37% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000003s : 20: predicate.same_eliminate 0.61% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.37% : 0.000001s : 2: predicate.special_op_eliminate 1.09% : 0.000002s : 13: predicate.specialize_transform 1.49% : 0.000003s : 20: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000003s : 20: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.73% : 0.000005s : 29: predicate.switch_defer_inline 2.38% : 0.000005s : 29: predicate.switch_layer_defer_inline 6.76% : 0.000013s : 79: predicate.switch_simplify 1.50% : 0.000003s : 20: predicate.tile_eliminate 1.37% : 0.000003s : 20: predicate.transpose_eliminate 1.77% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.54% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.11% : 0.000006s : 24: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.69% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.55% : 0.000003s : 23: predicate.updatestate_pure_node_eliminater 2.94% : 0.000006s : 36: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 20: predicate.value_based_eliminate 0.10% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.31% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003261 38 87.01% : 0.002838s : 28: func_graph_cloner_run.FuncGraphClonerGraph 12.99% : 0.000423s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156140 72 0.03% : 0.000042s : 1: add_recomputation 0.08% : 0.000122s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.18% : 0.000276s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.41% : 0.000643s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 12.37% : 0.019315s : 1: jit_opt_a 0.14% : 0.000216s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.28% : 0.000431s : 1: loop_unroll 0.44% : 0.000690s : 1: mutable_eliminate 0.95% : 0.001487s : 26: opt.transform.jit_opt_a 0.02% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000466s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.13% : 0.011135s : 1: renormalize.infer 0.37% : 0.000583s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.09% : 0.000137s : 1: rewriter_before_opt_a 0.05% : 0.000071s : 1: symbol_engine_optimizer 76.93% : 0.120122s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.759.834 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d820> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.760.523 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0310062, [30] [bootstrap]: 0.00034751 [type_inference]: 0.0199646 [event_method]: 2.013e-05 [auto_monad]: 6.756e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.26998e-06 [py_interpret_to_execute]: 0.00010561 [rewriter_before_opt_a]: 0.00011146 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00790342, [2] [Cycle 1]: 0.00439779, [27] [switch_simplify]: 5.427e-05 [loop_unroll]: 3.01e-05 [a_1]: 0.00050976 [with_stream_mark]: 1.738e-05 [recompute_prepare]: 7.83999e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00337407 [add_forward_monad_depend]: 9.07999e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.944e-05 [cse]: 3.942e-05 [replace_applicator]: 1.973e-05 [Cycle 2]: 0.00035199, [27] [switch_simplify]: 6.16998e-06 [loop_unroll]: 5.49e-06 [a_1]: 9.727e-05 [with_stream_mark]: 1.671e-05 [recompute_prepare]: 5.55001e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.894e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 1.45999e-06 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.385e-05 [replace_applicator]: 4.99003e-06 [py_interpret_to_execute_after_opt_a]: 1.425e-05 [rewriter_after_opt_a]: 7.101e-05 [convert_after_rewriter]: 7.62002e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00076134 [jit_opt_b]: 5.305e-05, [1] [Cycle 1]: 4.495e-05, [2] [frontend_op_eliminate]: 1.673e-05 [inline_after_opt_a]: 1.73e-05 [cconv]: 3.179e-05 [loop_unroll]: 0.00044059 [jit_opt_after_cconv]: 0.00015349, [1] [Cycle 1]: 0.00014683, [11] [c_1]: 2.152e-05 [parameter_eliminate]: 3.05002e-06 [updatestate_depend_eliminate]: 7.1e-06 [updatestate_assign_eliminate]: 2.63003e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.979e-05 [call_graph_tuple_transform]: 1.873e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.21e-06 [add_recomputation]: 5.376e-05 [cse_after_recomputation]: 2.442e-05, [1] [Cycle 1]: 1.819e-05, [1] [cse]: 1.234e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 5.42999e-06 [opt_after_jit_grad]: 0.00048315 [symbol_engine_optimizer]: 9.007e-05, [1] [Cycle 1]: 8.37e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.304e-05 [opt_reshape]: 6.18002e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 3.20026e-07 [validate]: 4.472e-05 Sums bootstrap : 0.000348s : 1.28% type_inference : 0.019965s : 73.44% event_method : 0.000020s : 0.07% auto_monad : 0.000068s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000106s : 0.39% rewriter_before_opt_a : 0.000111s : 0.41% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000607s : 2.23% jit_opt_a.with_stream_mark : 0.000034s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.003374s : 12.41% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000071s : 0.26% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000761s : 2.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000032s : 0.12% loop_unroll : 0.000441s : 1.62% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000483s : 1.78% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000188 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.10% : 0.000006s : 3: substitution.graph_param_transform 80.95% : 0.000152s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.87% : 0.000005s : 2: substitution.replace_old_param 6.59% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019891 2 92.02% : 0.018305s : 1: type_inference.infer 7.98% : 0.001586s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.74% : 0.000047s : 4: replace.inline 31.26% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.02% : 0.000150s : 4: match.inline 6.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.10% : 0.000001s : 10: predicate.addn_zero_filter 2.15% : 0.000003s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.79% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.37% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.33% : 0.000002s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 2.12% : 0.000003s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 1.05% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.48% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.04% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.11% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000850 13 44.63% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.14% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.23% : 0.000444s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035265 72 0.16% : 0.000057s : 1: add_recomputation 0.20% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.04% : 0.000367s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 22.42% : 0.007907s : 1: jit_opt_a 0.44% : 0.000156s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.28% : 0.000450s : 1: loop_unroll 2.19% : 0.000772s : 1: mutable_eliminate 2.36% : 0.000834s : 26: opt.transform.jit_opt_a 0.14% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000493s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000109s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 8.13% : 0.002868s : 1: renormalize.infer 1.40% : 0.000495s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000075s : 1: rewriter_after_opt_a 0.33% : 0.000117s : 1: rewriter_before_opt_a 0.26% : 0.000092s : 1: symbol_engine_optimizer 56.66% : 0.019983s : 1: type_inference TotalTime = 0.0708117, [30] [bootstrap]: 0.00025762 [type_inference]: 0.0529368 [event_method]: 0.00027483 [auto_monad]: 0.00010118 [graph_reusing]: 7.90998e-06 [pre_auto_parallel]: 3.06999e-06 [py_interpret_to_execute]: 3.277e-05 [rewriter_before_opt_a]: 0.00012113 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.0148945, [2] [Cycle 1]: 0.0110781, [27] [switch_simplify]: 7.62e-05 [loop_unroll]: 4.833e-05 [a_1]: 0.00101261 [with_stream_mark]: 2.87e-05 [recompute_prepare]: 2.247e-05 [updatestate_depend_eliminate]: 9.09e-06 [updatestate_assign_eliminate]: 7.03e-06 [updatestate_loads_eliminate]: 7.15e-06 [parameter_eliminate]: 2.55002e-06 [specialize_transform]: 1.523e-05 [updatestate_useless_node_eliminater]: 1.447e-05 [accelerated_algorithm]: 1.409e-05 [meta_shard_fg_expand]: 3.71999e-06 [get_grad_eliminate_]: 1.418e-05 [merge_forward]: 8.95001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.967e-05 [j_node_and_user_rematch]: 2.547e-05 [meta_fg_expand]: 0.00167326 [replace_old_param]: 6.817e-05 [inline_without_move]: 5.946e-05 [renormalize]: 0.00764676 [add_forward_monad_depend]: 7.51001e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.479e-05 [cse]: 2.646e-05 [replace_applicator]: 1.756e-05 [Cycle 2]: 0.00042502, [27] [switch_simplify]: 5.25001e-06 [loop_unroll]: 3.85e-06 [a_1]: 5.194e-05 [with_stream_mark]: 1.098e-05 [recompute_prepare]: 3.55e-06 [updatestate_depend_eliminate]: 3.03998e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 3.7e-06 [updatestate_useless_node_eliminater]: 3.43e-06 [accelerated_algorithm]: 3.5e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 3.5e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 3.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 7.30998e-06 [meta_fg_expand]: 0.00012971 [replace_old_param]: 5.49e-06 [inline_without_move]: 3.63e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.79e-06 [auto_monad_grad]: 1.32999e-06 [auto_monad_eliminator]: 5.25001e-06 [cse]: 1.208e-05 [replace_applicator]: 3.78001e-06 [py_interpret_to_execute_after_opt_a]: 1.093e-05 [rewriter_after_opt_a]: 3.601e-05 [convert_after_rewriter]: 5.96998e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.0006671 [jit_opt_b]: 4.773e-05, [1] [Cycle 1]: 4.006e-05, [2] [frontend_op_eliminate]: 1.336e-05 [inline_after_opt_a]: 1.432e-05 [cconv]: 2.437e-05 [loop_unroll]: 0.00042072 [jit_opt_after_cconv]: 0.00012218, [1] [Cycle 1]: 0.00011581, [11] [c_1]: 1.279e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 1.84e-06 [updatestate_loads_eliminate]: 1.71e-06 [cse]: 1.772e-05 [call_graph_tuple_transform]: 1.345e-05 [tuple_list_get_item_eliminator]: 3.97e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 3.81001e-06 [remove_dup_value]: 1.34e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 4.79e-06 [add_recomputation]: 3.652e-05 [cse_after_recomputation]: 1.956e-05, [1] [Cycle 1]: 1.456e-05, [1] [cse]: 7.75e-06 [auto_monad_reorder]: 1.401e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 4.99e-06 [opt_after_jit_grad]: 0.00044582 [symbol_engine_optimizer]: 6.939e-05, [1] [Cycle 1]: 6.218e-05, [6] [build]: 4.02e-06 [elim_shapecalc]: 6.02999e-06 [elim_not_effective]: 1.057e-05 [opt_reshape]: 4.52e-06 [fold_const_symbol]: 6.36e-06 [renormalize]: 3.50003e-07 [validate]: 2.942e-05 Sums bootstrap : 0.000258s : 0.39% type_inference : 0.052937s : 79.31% event_method : 0.000275s : 0.41% auto_monad : 0.000101s : 0.15% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000033s : 0.05% rewriter_before_opt_a : 0.000121s : 0.18% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.12% jit_opt_a.loop_unroll : 0.000052s : 0.08% jit_opt_a.a_1 : 0.001065s : 1.59% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000026s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000019s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.03% jit_opt_a.accelerated_algorithm : 0.000018s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.03% jit_opt_a.merge_forward : 0.000013s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000033s : 0.05% jit_opt_a.meta_fg_expand : 0.001803s : 2.70% jit_opt_a.replace_old_param : 0.000074s : 0.11% jit_opt_a.inline_without_move : 0.000063s : 0.09% jit_opt_a.renormalize : 0.007647s : 11.46% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000039s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000667s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.02% jit_opt_b.inline_after_opt_a : 0.000014s : 0.02% cconv : 0.000024s : 0.04% loop_unroll : 0.000421s : 0.63% jit_opt_after_cconv.c_1 : 0.000013s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000013s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.05% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000446s : 0.67% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.04% Time group info: ------[substitution.] 0.000284 56 0.62% : 0.000002s : 1: substitution.elim_not_effective 0.41% : 0.000001s : 1: substitution.fold_const_symbol 1.52% : 0.000004s : 1: substitution.graph_param_transform 68.51% : 0.000194s : 7: substitution.inline 5.58% : 0.000016s : 2: substitution.inline_without_move 2.72% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.24% : 0.000004s : 2: substitution.minmaximum_grad 1.46% : 0.000004s : 3: substitution.partial_eliminate 2.79% : 0.000008s : 9: substitution.remove_not_recompute_node 2.01% : 0.000006s : 2: substitution.replace_applicator 2.33% : 0.000007s : 10: substitution.replace_old_param 0.87% : 0.000002s : 1: substitution.set_cell_output_no_recompute 2.52% : 0.000007s : 2: substitution.tuple_list_convert_item_index_to_positive 1.73% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.68% : 0.000016s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052844 2 95.64% : 0.050540s : 1: type_inference.infer 4.36% : 0.002304s : 1: type_inference.specialize ------[replace.] 0.000081 9 77.74% : 0.000063s : 7: replace.inline 22.26% : 0.000018s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 9 94.29% : 0.000190s : 7: match.inline 5.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000200 1343 1.40% : 0.000003s : 22: predicate.accumulaten_eliminater 0.51% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.31% : 0.000003s : 22: predicate.addn_check_dump 1.61% : 0.000003s : 22: predicate.addn_zero_filter 1.97% : 0.000004s : 22: predicate.arithmetic_simplify 1.42% : 0.000003s : 22: predicate.cast_eliminate 0.14% : 0.000000s : 1: predicate.check_bprop_eliminate 1.35% : 0.000003s : 22: predicate.compare_switch_simplify 1.34% : 0.000003s : 22: predicate.depend_value_elim 1.41% : 0.000003s : 22: predicate.dict_get_item_const_eliminator 1.35% : 0.000003s : 22: predicate.dict_get_item_eliminator 1.49% : 0.000003s : 22: predicate.dict_set_item_eliminator 0.61% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.13% : 0.000000s : 1: predicate.elim_not_effective 0.30% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000003s : 22: predicate.environ_add_const_eliminate 1.27% : 0.000003s : 22: predicate.environ_get_add_eliminate 1.30% : 0.000003s : 22: predicate.environ_get_depend_swap 1.39% : 0.000003s : 22: predicate.environ_get_eliminate 1.43% : 0.000003s : 22: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.21% : 0.000002s : 14: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.30% : 0.000009s : 33: predicate.inline 3.41% : 0.000007s : 42: predicate.inline_without_move 0.54% : 0.000001s : 14: predicate.j_node_and_user_rematch 1.30% : 0.000003s : 14: predicate.less_batch_normalization 1.60% : 0.000003s : 24: predicate.list_to_tuple_eliminator_ 1.58% : 0.000003s : 25: predicate.load_eliminater 0.65% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.74% : 0.000007s : 55: predicate.loop_unroll_before_grad 1.89% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.29% : 0.000003s : 22: predicate.merge_addn 1.33% : 0.000003s : 22: predicate.minmaximum_grad 0.79% : 0.000002s : 1: predicate.mutable_eliminate 0.26% : 0.000001s : 1: predicate.opt_reshape 2.17% : 0.000004s : 25: predicate.partial_eliminate 1.33% : 0.000003s : 22: predicate.print_const_string_wrapper 2.09% : 0.000004s : 22: predicate.reduce_eliminate 1.62% : 0.000003s : 24: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 14: predicate.remove_not_recompute_node 1.70% : 0.000003s : 26: predicate.replace_applicator 1.96% : 0.000004s : 42: predicate.replace_old_param 0.17% : 0.000000s : 1: predicate.reset_defer_inline 1.39% : 0.000003s : 22: predicate.reshape_eliminate 1.46% : 0.000003s : 22: predicate.row_tensor_add_zeros_like 0.38% : 0.000001s : 1: predicate.row_tensor_eliminate 1.37% : 0.000003s : 22: predicate.same_eliminate 0.72% : 0.000001s : 14: predicate.set_cell_output_no_recompute 0.36% : 0.000001s : 2: predicate.special_op_eliminate 1.23% : 0.000002s : 14: predicate.specialize_transform 1.51% : 0.000003s : 22: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000003s : 22: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.76% : 0.000006s : 31: predicate.switch_defer_inline 2.38% : 0.000005s : 31: predicate.switch_layer_defer_inline 6.65% : 0.000013s : 87: predicate.switch_simplify 1.37% : 0.000003s : 22: predicate.tile_eliminate 1.43% : 0.000003s : 22: predicate.transpose_eliminate 1.76% : 0.000004s : 22: predicate.tuple_list_convert_item_index_to_positive 1.80% : 0.000004s : 22: predicate.tuple_list_get_item_depend_reorder 3.28% : 0.000007s : 26: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 22: predicate.tuple_list_set_item_eliminator 1.53% : 0.000003s : 24: predicate.tuple_to_list_eliminator_ 1.54% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.87% : 0.000006s : 39: predicate.updatestate_useless_node_eliminater 1.75% : 0.000004s : 22: predicate.value_based_eliminate 0.10% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.18% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002584 33 83.85% : 0.002166s : 23: func_graph_cloner_run.FuncGraphClonerGraph 16.15% : 0.000417s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079973 72 0.05% : 0.000039s : 1: add_recomputation 0.13% : 0.000108s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.35% : 0.000282s : 1: bootstrap 0.03% : 0.000027s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.35% : 0.000283s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 18.63% : 0.014898s : 1: jit_opt_a 0.16% : 0.000125s : 1: jit_opt_after_cconv 0.06% : 0.000051s : 1: jit_opt_b 0.54% : 0.000429s : 1: loop_unroll 0.85% : 0.000676s : 1: mutable_eliminate 1.87% : 0.001498s : 26: opt.transform.jit_opt_a 0.04% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000036s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 8.90% : 0.007122s : 1: renormalize.infer 0.64% : 0.000515s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.16% : 0.000124s : 1: rewriter_before_opt_a 0.09% : 0.000072s : 1: symbol_engine_optimizer 66.22% : 0.052959s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.860.100 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.860.723 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0539648, [30] [bootstrap]: 0.00026778 [type_inference]: 0.0383834 [event_method]: 2.058e-05 [auto_monad]: 6.904e-05 [graph_reusing]: 5.75001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00010994 [rewriter_before_opt_a]: 8.753e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.0129688, [2] [Cycle 1]: 0.00196742, [27] [switch_simplify]: 5.85e-05 [loop_unroll]: 2.995e-05 [a_1]: 0.00056321 [with_stream_mark]: 2.052e-05 [recompute_prepare]: 7.56001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.51002e-06 [renormalize]: 0.0009496 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.567e-05 [cse]: 3.518e-05 [replace_applicator]: 1.231e-05 [Cycle 2]: 0.0003192, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.34e-06 [a_1]: 9.072e-05 [with_stream_mark]: 9.89999e-06 [recompute_prepare]: 5.41002e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.265e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.272e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 1.156e-05 [rewriter_after_opt_a]: 3.704e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00049623 [jit_opt_b]: 4.901e-05, [1] [Cycle 1]: 4.288e-05, [2] [frontend_op_eliminate]: 1.6e-05 [inline_after_opt_a]: 1.635e-05 [cconv]: 2.629e-05 [loop_unroll]: 0.00041196 [jit_opt_after_cconv]: 0.00013789, [1] [Cycle 1]: 0.000132, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.036e-05 [call_graph_tuple_transform]: 1.814e-05 [tuple_list_get_item_eliminator]: 5.48002e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.13002e-06 [remove_dup_value]: 1.676e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 5.85002e-06 [add_recomputation]: 5.13e-05 [cse_after_recomputation]: 2.273e-05, [1] [Cycle 1]: 1.729e-05, [1] [cse]: 1.131e-05 [auto_monad_reorder]: 1.851e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 4.37003e-06 [opt_after_jit_grad]: 0.00044693 [symbol_engine_optimizer]: 8.847e-05, [1] [Cycle 1]: 8.18e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 2.421e-05 [elim_not_effective]: 1.336e-05 [opt_reshape]: 5.66998e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 3.69997e-07 [validate]: 3.755e-05 Sums bootstrap : 0.000268s : 0.63% type_inference : 0.038383s : 89.85% event_method : 0.000021s : 0.05% auto_monad : 0.000069s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000110s : 0.26% rewriter_before_opt_a : 0.000088s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.15% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000654s : 1.53% jit_opt_a.with_stream_mark : 0.000030s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000950s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.07% jit_opt_a.cse : 0.000048s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000037s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000496s : 1.16% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.06% loop_unroll : 0.000412s : 0.96% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.12% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000447s : 1.05% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000024s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.09% Time group info: ------[substitution.] 0.000225 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000005s : 3: substitution.graph_param_transform 85.05% : 0.000191s : 4: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 5.83% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038309 2 96.05% : 0.036796s : 1: type_inference.infer 3.95% : 0.001512s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.88% : 0.000050s : 4: replace.inline 32.12% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.07% : 0.000189s : 4: match.inline 5.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.44% : 0.000002s : 10: predicate.depend_value_elim 1.35% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.21% : 0.000007s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.48% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000799 13 43.74% : 0.000349s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.69% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.56% : 0.000404s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055855 72 0.10% : 0.000054s : 1: add_recomputation 0.13% : 0.000072s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.50% : 0.000279s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 23.23% : 0.012972s : 1: jit_opt_a 0.25% : 0.000140s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.75% : 0.000420s : 1: loop_unroll 0.90% : 0.000505s : 1: mutable_eliminate 1.56% : 0.000871s : 26: opt.transform.jit_opt_a 0.08% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.82% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000113s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.98% : 0.000547s : 1: renormalize.infer 0.71% : 0.000394s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000040s : 1: rewriter_after_opt_a 0.16% : 0.000091s : 1: rewriter_before_opt_a 0.16% : 0.000091s : 1: symbol_engine_optimizer 68.75% : 0.038402s : 1: type_inference TotalTime = 0.142598, [30] [bootstrap]: 0.00033129 [type_inference]: 0.131935 [event_method]: 2.188e-05 [auto_monad]: 9.993e-05 [graph_reusing]: 6.91999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00041878 [rewriter_before_opt_a]: 8.304e-05 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.00731842, [2] [Cycle 1]: 0.0034938, [27] [switch_simplify]: 4.738e-05 [loop_unroll]: 3.006e-05 [a_1]: 0.00060679 [with_stream_mark]: 1.228e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 6.23002e-06 [renormalize]: 0.00248322 [add_forward_monad_depend]: 9.02e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.346e-05 [cse]: 2.165e-05 [replace_applicator]: 1.482e-05 [Cycle 2]: 0.00035984, [27] [switch_simplify]: 6.67002e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00012006 [with_stream_mark]: 1.204e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.93002e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.42001e-06 [cse]: 1.155e-05 [replace_applicator]: 6.22001e-06 [py_interpret_to_execute_after_opt_a]: 1.695e-05 [rewriter_after_opt_a]: 3.373e-05 [convert_after_rewriter]: 6.72002e-06 [order_py_execute_after_rewriter]: 5.81e-06 [mutable_eliminate]: 0.00066672 [jit_opt_b]: 5.592e-05, [1] [Cycle 1]: 4.878e-05, [2] [frontend_op_eliminate]: 1.982e-05 [inline_after_opt_a]: 1.801e-05 [cconv]: 2.652e-05 [loop_unroll]: 0.00044289 [jit_opt_after_cconv]: 0.0001545, [1] [Cycle 1]: 0.00014848, [11] [c_1]: 2.47e-05 [parameter_eliminate]: 3.65998e-06 [updatestate_depend_eliminate]: 5.42999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.429e-05 [call_graph_tuple_transform]: 2.178e-05 [tuple_list_get_item_eliminator]: 5.92001e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.47e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 8.33001e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.425e-05, [1] [Cycle 1]: 1.647e-05, [1] [cse]: 1.072e-05 [auto_monad_reorder]: 1.496e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.00053222 [symbol_engine_optimizer]: 7.429e-05, [1] [Cycle 1]: 6.824e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 8.47998e-06 [elim_not_effective]: 1.272e-05 [opt_reshape]: 6.69001e-06 [fold_const_symbol]: 9.45001e-06 [renormalize]: 3.20026e-07 [validate]: 4.051e-05 Sums bootstrap : 0.000331s : 0.24% type_inference : 0.131935s : 95.23% event_method : 0.000022s : 0.02% auto_monad : 0.000100s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000419s : 0.30% rewriter_before_opt_a : 0.000083s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000727s : 0.52% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002483s : 1.79% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000033s : 0.02% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000667s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000443s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000532s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000239 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 4: substitution.graph_param_transform 87.26% : 0.000208s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.42% : 0.000003s : 2: substitution.replace_old_param 3.92% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131768 2 97.54% : 0.128524s : 1: type_inference.infer 2.46% : 0.003244s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.14% : 0.000045s : 4: replace.inline 33.86% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 96.12% : 0.000206s : 4: match.inline 3.88% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.47% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.39% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.96% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000001s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.12% : 0.000001s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.30% : 0.000002s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 58: predicate.switch_simplify 1.17% : 0.000001s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.63% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002207 22 67.54% : 0.001491s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.06% : 0.000686s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146101 72 0.04% : 0.000054s : 1: add_recomputation 0.07% : 0.000104s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000350s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.01% : 0.007322s : 1: jit_opt_a 0.11% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.31% : 0.000451s : 1: loop_unroll 0.46% : 0.000675s : 1: mutable_eliminate 0.65% : 0.000948s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000541s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000425s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.21% : 0.001772s : 1: renormalize.infer 0.48% : 0.000704s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.06% : 0.000088s : 1: rewriter_before_opt_a 0.05% : 0.000077s : 1: symbol_engine_optimizer 90.33% : 0.131967s : 1: type_inference TotalTime = 0.0450287, [30] [bootstrap]: 0.0002163 [type_inference]: 0.0259747 [event_method]: 9.739e-05 [auto_monad]: 0.00011721 [graph_reusing]: 8.30999e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 3.911e-05 [rewriter_before_opt_a]: 0.00012277 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.0160836, [3] [Cycle 1]: 0.00770819, [27] [switch_simplify]: 8.51e-05 [loop_unroll]: 4.345e-05 [a_1]: 0.00099511 [with_stream_mark]: 3.997e-05 [recompute_prepare]: 2.458e-05 [updatestate_depend_eliminate]: 9.15001e-06 [updatestate_assign_eliminate]: 7.11999e-06 [updatestate_loads_eliminate]: 7.03998e-06 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 1.558e-05 [updatestate_useless_node_eliminater]: 1.26e-05 [accelerated_algorithm]: 1.35e-05 [meta_shard_fg_expand]: 3.79002e-06 [get_grad_eliminate_]: 2.909e-05 [merge_forward]: 1.003e-05 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.964e-05 [j_node_and_user_rematch]: 2.488e-05 [meta_fg_expand]: 0.00201152 [replace_old_param]: 7.308e-05 [inline_without_move]: 6.127e-05 [renormalize]: 0.00355736 [add_forward_monad_depend]: 1.109e-05 [auto_monad_grad]: 6.19001e-06 [auto_monad_eliminator]: 5.609e-05 [cse]: 0.00021641 [replace_applicator]: 8.58e-05 [Cycle 2]: 0.00378364, [27] [switch_simplify]: 4.168e-05 [loop_unroll]: 3.972e-05 [a_1]: 0.00116017 [with_stream_mark]: 1.601e-05 [recompute_prepare]: 1.018e-05 [updatestate_depend_eliminate]: 5.41002e-06 [updatestate_assign_eliminate]: 3.93001e-06 [updatestate_loads_eliminate]: 3.77002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 8.54e-06 [updatestate_useless_node_eliminater]: 8.19002e-06 [accelerated_algorithm]: 8.30999e-06 [meta_shard_fg_expand]: 2.55002e-06 [get_grad_eliminate_]: 7.85e-06 [merge_forward]: 4.82998e-06 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [j_node_and_user_rematch]: 1.257e-05 [meta_fg_expand]: 0.00010828 [replace_old_param]: 9.71e-06 [inline_without_move]: 7.88001e-06 [renormalize]: 0.0020617 [add_forward_monad_depend]: 7.83001e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 1.359e-05 [cse]: 2.615e-05 [replace_applicator]: 1.432e-05 [Cycle 3]: 0.00026605, [27] [switch_simplify]: 4.45e-06 [loop_unroll]: 4.3e-06 [a_1]: 4.302e-05 [with_stream_mark]: 1.169e-05 [recompute_prepare]: 4.02e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 1.79e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 3.66999e-06 [updatestate_useless_node_eliminater]: 3.48e-06 [accelerated_algorithm]: 3.75998e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 3.15002e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.208e-05 [j_node_and_user_rematch]: 6.16e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 3.09999e-06 [inline_without_move]: 2.96001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 4.90001e-06 [cse]: 1.156e-05 [replace_applicator]: 4.27e-06 [py_interpret_to_execute_after_opt_a]: 1.335e-05 [rewriter_after_opt_a]: 3.579e-05 [convert_after_rewriter]: 5.81e-06 [order_py_execute_after_rewriter]: 4.52e-06 [mutable_eliminate]: 0.00074156 [jit_opt_b]: 4.361e-05, [1] [Cycle 1]: 3.553e-05, [2] [frontend_op_eliminate]: 1.127e-05 [inline_after_opt_a]: 1.137e-05 [cconv]: 2.851e-05 [loop_unroll]: 0.00042368 [jit_opt_after_cconv]: 0.00013155, [1] [Cycle 1]: 0.00012473, [11] [c_1]: 1.419e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 1.52001e-06 [cse]: 2.002e-05 [call_graph_tuple_transform]: 1.434e-05 [tuple_list_get_item_eliminator]: 3.76999e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 1.01997e-06 [switch_simplify]: 3.72002e-06 [remove_dup_value]: 1.364e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 5.47999e-06 [add_recomputation]: 3.636e-05 [cse_after_recomputation]: 1.926e-05, [1] [Cycle 1]: 1.398e-05, [1] [cse]: 7.95998e-06 [auto_monad_reorder]: 1.348e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.99e-06 [opt_after_jit_grad]: 0.00052156 [symbol_engine_optimizer]: 7.204e-05, [1] [Cycle 1]: 6.466e-05, [6] [build]: 4.49998e-06 [elim_shapecalc]: 6.59999e-06 [elim_not_effective]: 1.159e-05 [opt_reshape]: 4.17e-06 [fold_const_symbol]: 6.12999e-06 [renormalize]: 5.19998e-07 [validate]: 3.523e-05 Sums bootstrap : 0.000216s : 0.54% type_inference : 0.025975s : 65.28% event_method : 0.000097s : 0.24% auto_monad : 0.000117s : 0.29% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000039s : 0.10% rewriter_before_opt_a : 0.000123s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000131s : 0.33% jit_opt_a.loop_unroll : 0.000087s : 0.22% jit_opt_a.a_1 : 0.002198s : 5.52% jit_opt_a.with_stream_mark : 0.000068s : 0.17% jit_opt_a.recompute_prepare : 0.000039s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.06% jit_opt_a.accelerated_algorithm : 0.000026s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000040s : 0.10% jit_opt_a.merge_forward : 0.000018s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.11% jit_opt_a.meta_fg_expand : 0.002121s : 5.33% jit_opt_a.replace_old_param : 0.000086s : 0.22% jit_opt_a.inline_without_move : 0.000072s : 0.18% jit_opt_a.renormalize : 0.005619s : 14.12% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.05% jit_opt_a.auto_monad_grad : 0.000009s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000075s : 0.19% jit_opt_a.cse : 0.000254s : 0.64% jit_opt_a.replace_applicator : 0.000104s : 0.26% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000036s : 0.09% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000742s : 1.86% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.03% cconv : 0.000029s : 0.07% loop_unroll : 0.000424s : 1.06% jit_opt_after_cconv.c_1 : 0.000014s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.09% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000522s : 1.31% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.09% Time group info: ------[substitution.] 0.000609 105 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.76% : 0.000005s : 1: substitution.graph_param_transform 66.10% : 0.000402s : 13: substitution.inline 3.57% : 0.000022s : 2: substitution.inline_without_move 1.63% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.85% : 0.000011s : 7: substitution.minmaximum_grad 1.23% : 0.000007s : 5: substitution.partial_eliminate 1.69% : 0.000010s : 13: substitution.remove_not_recompute_node 5.98% : 0.000036s : 10: substitution.replace_applicator 1.07% : 0.000006s : 8: substitution.replace_old_param 1.11% : 0.000007s : 1: substitution.reshape_eliminate 0.48% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.89% : 0.000005s : 1: substitution.tile_eliminate 3.51% : 0.000021s : 7: substitution.tuple_list_convert_item_index_to_positive 2.53% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.16% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025856 2 93.52% : 0.024179s : 1: type_inference.infer 6.48% : 0.001677s : 1: type_inference.specialize ------[replace.] 0.000173 20 66.08% : 0.000114s : 13: replace.inline 33.92% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000418 20 94.60% : 0.000395s : 13: match.inline 5.40% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000377 2537 1.51% : 0.000006s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000005s : 44: predicate.addn_check_dump 1.76% : 0.000007s : 44: predicate.addn_zero_filter 2.22% : 0.000008s : 44: predicate.arithmetic_simplify 1.56% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 44: predicate.compare_switch_simplify 1.49% : 0.000006s : 44: predicate.depend_value_elim 1.42% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_depend_swap 1.60% : 0.000006s : 44: predicate.environ_get_eliminate 1.46% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.89% : 0.000003s : 18: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.47% : 0.000017s : 66: predicate.inline 1.86% : 0.000007s : 42: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.95% : 0.000004s : 18: predicate.less_batch_normalization 1.77% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.79% : 0.000007s : 52: predicate.load_eliminater 0.37% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.22% : 0.000012s : 89: predicate.loop_unroll_before_grad 2.02% : 0.000008s : 45: predicate.make_slice_get_slice_eliminator 1.48% : 0.000006s : 44: predicate.merge_addn 1.59% : 0.000006s : 44: predicate.minmaximum_grad 0.48% : 0.000002s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.38% : 0.000009s : 52: predicate.partial_eliminate 1.48% : 0.000006s : 44: predicate.print_const_string_wrapper 2.11% : 0.000008s : 44: predicate.reduce_eliminate 1.81% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000002s : 18: predicate.remove_not_recompute_node 2.55% : 0.000010s : 94: predicate.replace_applicator 1.07% : 0.000004s : 42: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000006s : 44: predicate.reshape_eliminate 1.65% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.32% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000006s : 44: predicate.same_eliminate 0.45% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 18: predicate.specialize_transform 1.91% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.72% : 0.000010s : 64: predicate.switch_defer_inline 2.50% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.44% : 0.000024s : 154: predicate.switch_simplify 1.60% : 0.000006s : 44: predicate.tile_eliminate 1.55% : 0.000006s : 44: predicate.transpose_eliminate 2.09% : 0.000008s : 44: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.32% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.85% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.78% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.96% : 0.000007s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002414 32 56.82% : 0.001371s : 15: func_graph_cloner_run.FuncGraphClonerGraph 43.18% : 0.001042s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053535 87 0.07% : 0.000039s : 1: add_recomputation 0.23% : 0.000123s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.43% : 0.000233s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000021s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.19% : 0.000104s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000015s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 30.05% : 0.016088s : 1: jit_opt_a 0.25% : 0.000134s : 1: jit_opt_after_cconv 0.09% : 0.000046s : 1: jit_opt_b 0.81% : 0.000432s : 1: loop_unroll 1.40% : 0.000750s : 1: mutable_eliminate 5.39% : 0.002887s : 39: opt.transform.jit_opt_a 0.06% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.99% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000042s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 6.74% : 0.003607s : 2: renormalize.infer 3.72% : 0.001994s : 2: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.23% : 0.000126s : 1: rewriter_before_opt_a 0.14% : 0.000074s : 1: symbol_engine_optimizer 48.57% : 0.026002s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.936.183 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006df70> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:26.936.932 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.157527, [30] [bootstrap]: 0.00032289 [type_inference]: 0.146339 [event_method]: 2.114e-05 [auto_monad]: 0.00010249 [graph_reusing]: 7.61001e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 0.00042395 [rewriter_before_opt_a]: 9.995e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00770253, [2] [Cycle 1]: 0.00382209, [27] [switch_simplify]: 6.628e-05 [loop_unroll]: 3.427e-05 [a_1]: 0.00071905 [with_stream_mark]: 2.469e-05 [recompute_prepare]: 9.64999e-06 [updatestate_depend_eliminate]: 4.54998e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.53e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.69001e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 9.46998e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00257723 [add_forward_monad_depend]: 6.99001e-06 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 1.44e-05 [cse]: 3.685e-05 [replace_applicator]: 1.857e-05 [Cycle 2]: 0.00050568, [27] [switch_simplify]: 7.1e-06 [loop_unroll]: 5.98998e-06 [a_1]: 0.00013261 [with_stream_mark]: 1.402e-05 [recompute_prepare]: 6.84001e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.76003e-06 [merge_forward]: 1.852e-05 [cell_reuse_recompute_pass]: 2.78e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.748e-05 [j_node_and_user_rematch]: 2.203e-05 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 6.01998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 9.07001e-06 [cse]: 2.704e-05 [replace_applicator]: 7.36001e-06 [py_interpret_to_execute_after_opt_a]: 1.5e-05 [rewriter_after_opt_a]: 4.163e-05 [convert_after_rewriter]: 7.85e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00072679 [jit_opt_b]: 5.81e-05, [1] [Cycle 1]: 4.953e-05, [2] [frontend_op_eliminate]: 1.931e-05 [inline_after_opt_a]: 1.899e-05 [cconv]: 2.736e-05 [loop_unroll]: 0.00045204 [jit_opt_after_cconv]: 0.00016362, [1] [Cycle 1]: 0.00015723, [11] [c_1]: 2.775e-05 [parameter_eliminate]: 2.25002e-06 [updatestate_depend_eliminate]: 5.64998e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.834e-05 [call_graph_tuple_transform]: 2.138e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 7.13e-06 [remove_dup_value]: 1.918e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 9.64999e-06 [add_recomputation]: 5.289e-05 [cse_after_recomputation]: 2.602e-05, [1] [Cycle 1]: 1.952e-05, [1] [cse]: 1.362e-05 [auto_monad_reorder]: 1.87e-05 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 5.55001e-06 [opt_after_jit_grad]: 0.00046146 [symbol_engine_optimizer]: 8.28e-05, [1] [Cycle 1]: 7.618e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 8.50999e-06 [elim_not_effective]: 1.495e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 1.313e-05 [renormalize]: 4.69998e-07 [validate]: 0.00014284 Sums bootstrap : 0.000323s : 0.21% type_inference : 0.146339s : 95.36% event_method : 0.000021s : 0.01% auto_monad : 0.000102s : 0.07% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000424s : 0.28% rewriter_before_opt_a : 0.000100s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000852s : 0.55% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000023s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000031s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002577s : 1.68% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000064s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000452s : 0.29% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000461s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000143s : 0.09% Time group info: ------[substitution.] 0.000281 25 1.35% : 0.000004s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000007s : 4: substitution.graph_param_transform 86.17% : 0.000242s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 4.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.146256 2 98.14% : 0.143531s : 1: type_inference.infer 1.86% : 0.002725s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.77% : 0.000070s : 5: replace.inline 31.23% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000252 7 95.13% : 0.000239s : 5: match.inline 4.87% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.25% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.42% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 0.90% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.35% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.08% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.85% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.49% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 4: predicate.row_tensor_eliminate 1.47% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.49% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.96% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002250 25 66.95% : 0.001506s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.68% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.37% : 0.000661s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.161207 72 0.03% : 0.000056s : 1: add_recomputation 0.07% : 0.000107s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000333s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 4.78% : 0.007707s : 1: jit_opt_a 0.10% : 0.000166s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.28% : 0.000458s : 1: loop_unroll 0.46% : 0.000738s : 1: mutable_eliminate 0.70% : 0.001126s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000470s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000430s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.16% : 0.001865s : 1: renormalize.infer 0.44% : 0.000702s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000106s : 1: rewriter_before_opt_a 0.05% : 0.000086s : 1: symbol_engine_optimizer 90.79% : 0.146355s : 1: type_inference TotalTime = 0.0442793, [30] [bootstrap]: 0.00032746 [type_inference]: 0.0184337 [event_method]: 7.916e-05 [auto_monad]: 0.0001061 [graph_reusing]: 7.51999e-06 [pre_auto_parallel]: 3.13998e-06 [py_interpret_to_execute]: 3.542e-05 [rewriter_before_opt_a]: 0.0001253 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.0224703, [3] [Cycle 1]: 0.0144564, [27] [switch_simplify]: 8.44e-05 [loop_unroll]: 4.496e-05 [a_1]: 0.00099586 [with_stream_mark]: 4.716e-05 [recompute_prepare]: 2.137e-05 [updatestate_depend_eliminate]: 1.098e-05 [updatestate_assign_eliminate]: 7.55998e-06 [updatestate_loads_eliminate]: 7.47002e-06 [parameter_eliminate]: 3.10002e-06 [specialize_transform]: 1.419e-05 [updatestate_useless_node_eliminater]: 1.287e-05 [accelerated_algorithm]: 1.308e-05 [meta_shard_fg_expand]: 4.12e-06 [get_grad_eliminate_]: 1.282e-05 [merge_forward]: 8.92999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.811e-05 [j_node_and_user_rematch]: 2.29e-05 [meta_fg_expand]: 0.0018638 [replace_old_param]: 7.346e-05 [inline_without_move]: 6.221e-05 [renormalize]: 0.0103544 [add_forward_monad_depend]: 1.63e-05 [auto_monad_grad]: 7.78999e-06 [auto_monad_eliminator]: 6.629e-05 [cse]: 0.00029869 [replace_applicator]: 9.456e-05 [Cycle 2]: 0.0040149, [27] [switch_simplify]: 4.091e-05 [loop_unroll]: 4.051e-05 [a_1]: 0.00120242 [with_stream_mark]: 1.975e-05 [recompute_prepare]: 1.062e-05 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 4.38001e-06 [updatestate_loads_eliminate]: 5.07e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 7.65998e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 7.08998e-06 [meta_shard_fg_expand]: 3.08e-06 [get_grad_eliminate_]: 7.06999e-06 [merge_forward]: 4.84e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.869e-05 [j_node_and_user_rematch]: 1.096e-05 [meta_fg_expand]: 0.00013503 [replace_old_param]: 9.32001e-06 [inline_without_move]: 7.18998e-06 [renormalize]: 0.00219864 [add_forward_monad_depend]: 7.83001e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.45e-05 [cse]: 3.019e-05 [replace_applicator]: 2.048e-05 [Cycle 3]: 0.00029869, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 4.47e-06 [a_1]: 5.741e-05 [with_stream_mark]: 1.397e-05 [recompute_prepare]: 3.57997e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 1.81e-06 [parameter_eliminate]: 1.45001e-06 [specialize_transform]: 3.76999e-06 [updatestate_useless_node_eliminater]: 3.44001e-06 [accelerated_algorithm]: 4.67998e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 3.67002e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 2.82002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 6.51e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 3.98999e-06 [inline_without_move]: 3.21999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.69e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 4.92e-06 [cse]: 1.283e-05 [replace_applicator]: 3.65e-06 [py_interpret_to_execute_after_opt_a]: 1.165e-05 [rewriter_after_opt_a]: 3.723e-05 [convert_after_rewriter]: 6.19999e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00079585 [jit_opt_b]: 5.061e-05, [1] [Cycle 1]: 4.17e-05, [2] [frontend_op_eliminate]: 1.388e-05 [inline_after_opt_a]: 1.432e-05 [cconv]: 3.181e-05 [loop_unroll]: 0.00054841 [jit_opt_after_cconv]: 0.00015248, [1] [Cycle 1]: 0.00014207, [11] [c_1]: 1.599e-05 [parameter_eliminate]: 4.35e-06 [updatestate_depend_eliminate]: 7.95998e-06 [updatestate_assign_eliminate]: 1.86e-06 [updatestate_loads_eliminate]: 1.59998e-06 [cse]: 2.834e-05 [call_graph_tuple_transform]: 1.837e-05 [tuple_list_get_item_eliminator]: 4.30999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 4.10998e-06 [remove_dup_value]: 1.483e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 5.54e-06 [add_recomputation]: 4.289e-05 [cse_after_recomputation]: 2.349e-05, [1] [Cycle 1]: 1.712e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.315e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 7.74002e-06 [opt_after_jit_grad]: 0.00055367 [symbol_engine_optimizer]: 0.0001382, [1] [Cycle 1]: 0.00013099, [6] [build]: 4.25999e-06 [elim_shapecalc]: 5.96e-06 [elim_not_effective]: 7.417e-05 [opt_reshape]: 5.22e-06 [fold_const_symbol]: 7.46999e-06 [renormalize]: 3.19997e-07 [validate]: 3.9e-05 Sums bootstrap : 0.000327s : 0.83% type_inference : 0.018434s : 46.51% event_method : 0.000079s : 0.20% auto_monad : 0.000106s : 0.27% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000035s : 0.09% rewriter_before_opt_a : 0.000125s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000131s : 0.33% jit_opt_a.loop_unroll : 0.000090s : 0.23% jit_opt_a.a_1 : 0.002256s : 5.69% jit_opt_a.with_stream_mark : 0.000081s : 0.20% jit_opt_a.recompute_prepare : 0.000036s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.06% jit_opt_a.accelerated_algorithm : 0.000025s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.06% jit_opt_a.merge_forward : 0.000018s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.10% jit_opt_a.meta_fg_expand : 0.002001s : 5.05% jit_opt_a.replace_old_param : 0.000087s : 0.22% jit_opt_a.inline_without_move : 0.000073s : 0.18% jit_opt_a.renormalize : 0.012553s : 31.67% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.07% jit_opt_a.auto_monad_grad : 0.000011s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000086s : 0.22% jit_opt_a.cse : 0.000342s : 0.86% jit_opt_a.replace_applicator : 0.000119s : 0.30% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000037s : 0.09% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000796s : 2.01% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.04% jit_opt_b.inline_after_opt_a : 0.000014s : 0.04% cconv : 0.000032s : 0.08% loop_unroll : 0.000548s : 1.38% jit_opt_after_cconv.c_1 : 0.000016s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000043s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000554s : 1.40% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000074s : 0.19% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.10% Time group info: ------[substitution.] 0.000629 104 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.78% : 0.000005s : 1: substitution.graph_param_transform 67.61% : 0.000426s : 13: substitution.inline 3.15% : 0.000020s : 2: substitution.inline_without_move 1.50% : 0.000009s : 12: substitution.j_node_and_user_rematch 1.89% : 0.000012s : 7: substitution.minmaximum_grad 1.51% : 0.000009s : 5: substitution.partial_eliminate 1.74% : 0.000011s : 12: substitution.remove_not_recompute_node 5.48% : 0.000035s : 10: substitution.replace_applicator 1.16% : 0.000007s : 10: substitution.replace_old_param 0.43% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.96% : 0.000006s : 1: substitution.tile_eliminate 3.70% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.68% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.98% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018332 2 91.54% : 0.016781s : 1: type_inference.infer 8.46% : 0.001552s : 1: type_inference.specialize ------[replace.] 0.000202 20 65.23% : 0.000132s : 13: replace.inline 34.77% : 0.000070s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000438 20 95.21% : 0.000417s : 13: match.inline 4.79% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000391 2433 1.57% : 0.000006s : 42: predicate.accumulaten_eliminater 0.39% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.37% : 0.000005s : 42: predicate.addn_check_dump 1.64% : 0.000006s : 42: predicate.addn_zero_filter 2.30% : 0.000009s : 42: predicate.arithmetic_simplify 1.54% : 0.000006s : 42: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.47% : 0.000006s : 42: predicate.compare_switch_simplify 1.37% : 0.000005s : 42: predicate.depend_value_elim 1.38% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.60% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.65% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.15% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 42: predicate.environ_get_add_eliminate 1.41% : 0.000006s : 42: predicate.environ_get_depend_swap 1.44% : 0.000006s : 42: predicate.environ_get_eliminate 1.39% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 16: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.31% : 0.000017s : 64: predicate.inline 1.87% : 0.000007s : 44: predicate.inline_without_move 0.30% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 16: predicate.less_batch_normalization 1.81% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.93% : 0.000008s : 50: predicate.load_eliminater 0.44% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.31% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.94% : 0.000008s : 43: predicate.make_slice_get_slice_eliminator 1.54% : 0.000006s : 42: predicate.merge_addn 1.49% : 0.000006s : 42: predicate.minmaximum_grad 0.50% : 0.000002s : 1: predicate.mutable_eliminate 0.15% : 0.000001s : 1: predicate.opt_reshape 2.22% : 0.000009s : 50: predicate.partial_eliminate 1.44% : 0.000006s : 42: predicate.print_const_string_wrapper 2.37% : 0.000009s : 42: predicate.reduce_eliminate 1.73% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000002s : 16: predicate.remove_not_recompute_node 2.47% : 0.000010s : 90: predicate.replace_applicator 1.08% : 0.000004s : 44: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 42: predicate.reshape_eliminate 1.59% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.43% : 0.000006s : 42: predicate.same_eliminate 0.46% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.69% : 0.000003s : 16: predicate.specialize_transform 1.92% : 0.000008s : 42: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.71% : 0.000011s : 62: predicate.switch_defer_inline 2.49% : 0.000010s : 62: predicate.switch_layer_defer_inline 6.53% : 0.000026s : 150: predicate.switch_simplify 1.70% : 0.000007s : 42: predicate.tile_eliminate 1.50% : 0.000006s : 42: predicate.transpose_eliminate 1.99% : 0.000008s : 42: predicate.tuple_list_convert_item_index_to_positive 1.87% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000014s : 51: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.87% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.74% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 1.95% : 0.000008s : 42: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.22% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002727 36 60.57% : 0.001652s : 19: func_graph_cloner_run.FuncGraphClonerGraph 39.43% : 0.001075s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059840 87 0.08% : 0.000046s : 1: add_recomputation 0.19% : 0.000111s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.59% : 0.000350s : 1: bootstrap 0.06% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.14% : 0.000085s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 37.56% : 0.022474s : 1: jit_opt_a 0.26% : 0.000155s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 0.93% : 0.000559s : 1: loop_unroll 1.35% : 0.000808s : 1: mutable_eliminate 4.90% : 0.002935s : 39: opt.transform.jit_opt_a 0.07% : 0.000039s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000020s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000089s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000564s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.06% : 0.000038s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 16.67% : 0.009975s : 2: renormalize.infer 4.27% : 0.002554s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.21% : 0.000128s : 1: rewriter_before_opt_a 0.24% : 0.000141s : 1: symbol_engine_optimizer 30.84% : 0.018453s : 1: type_inference TotalTime = 0.0433463, [30] [bootstrap]: 0.00028626 [type_inference]: 0.0355268 [event_method]: 2.053e-05 [auto_monad]: 7.028e-05 [graph_reusing]: 6.86001e-06 [pre_auto_parallel]: 2.27001e-06 [py_interpret_to_execute]: 9.921e-05 [rewriter_before_opt_a]: 8.094e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00523047, [2] [Cycle 1]: 0.00173587, [27] [switch_simplify]: 4.572e-05 [loop_unroll]: 2.89e-05 [a_1]: 0.0005013 [with_stream_mark]: 1.658e-05 [recompute_prepare]: 7.37002e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.21998e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 3.52997e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.373e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 8.18999e-06 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00083943 [add_forward_monad_depend]: 6.13998e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.301e-05 [cse]: 2.706e-05 [replace_applicator]: 1.215e-05 [Cycle 2]: 0.00031915, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.30001e-06 [a_1]: 9.456e-05 [with_stream_mark]: 1.003e-05 [recompute_prepare]: 5.24003e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 7.59988e-07 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.80001e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 7.71001e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.49998e-06 [cse]: 1.232e-05 [replace_applicator]: 5.00001e-06 [py_interpret_to_execute_after_opt_a]: 1.241e-05 [rewriter_after_opt_a]: 3.402e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00050568 [jit_opt_b]: 4.69e-05, [1] [Cycle 1]: 4.043e-05, [2] [frontend_op_eliminate]: 1.497e-05 [inline_after_opt_a]: 1.49e-05 [cconv]: 2.481e-05 [loop_unroll]: 0.00044858 [jit_opt_after_cconv]: 0.00012903, [1] [Cycle 1]: 0.00012283, [11] [c_1]: 1.984e-05 [parameter_eliminate]: 2.15002e-06 [updatestate_depend_eliminate]: 4.27998e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 1.578e-05 [call_graph_tuple_transform]: 1.727e-05 [tuple_list_get_item_eliminator]: 5.13002e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.385e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 5.50001e-06 [add_recomputation]: 4.401e-05 [cse_after_recomputation]: 2.077e-05, [1] [Cycle 1]: 1.625e-05, [1] [cse]: 1.054e-05 [auto_monad_reorder]: 1.628e-05 [get_jit_bprop_graph]: 1.30999e-06 [rewriter_after_jit_bprop_graph]: 4.52998e-06 [opt_after_jit_grad]: 0.00043646 [symbol_engine_optimizer]: 6.795e-05, [1] [Cycle 1]: 6.192e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 7.25e-06 [elim_not_effective]: 1.224e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.17e-06 [renormalize]: 4.50003e-07 [validate]: 3.225e-05 Sums bootstrap : 0.000286s : 0.72% type_inference : 0.035527s : 89.63% event_method : 0.000021s : 0.05% auto_monad : 0.000070s : 0.18% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000099s : 0.25% rewriter_before_opt_a : 0.000081s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000052s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000596s : 1.50% jit_opt_a.with_stream_mark : 0.000027s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000840s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.05% jit_opt_a.cse : 0.000039s : 0.10% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000034s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000506s : 1.28% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000025s : 0.06% loop_unroll : 0.000449s : 1.13% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000016s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000044s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000436s : 1.10% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.08% Time group info: ------[substitution.] 0.000186 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.04% : 0.000006s : 3: substitution.graph_param_transform 82.93% : 0.000154s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000004s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035462 2 95.87% : 0.033998s : 1: type_inference.infer 4.13% : 0.001464s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.63% : 0.000046s : 4: replace.inline 32.37% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.30% : 0.000152s : 4: match.inline 6.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000107 691 1.39% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.68% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000001s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000006s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.91% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 15: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.27% : 0.000001s : 3: predicate.mutable_eliminate 0.46% : 0.000000s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000008s : 53: predicate.switch_simplify 1.49% : 0.000002s : 10: predicate.tile_eliminate 1.34% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000827 13 43.23% : 0.000358s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.60% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.17% : 0.000432s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045031 72 0.10% : 0.000047s : 1: add_recomputation 0.16% : 0.000073s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.67% : 0.000304s : 1: bootstrap 0.06% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 11.62% : 0.005233s : 1: jit_opt_a 0.29% : 0.000132s : 1: jit_opt_after_cconv 0.11% : 0.000049s : 1: jit_opt_b 1.01% : 0.000455s : 1: loop_unroll 1.14% : 0.000513s : 1: mutable_eliminate 1.77% : 0.000797s : 26: opt.transform.jit_opt_a 0.10% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000012s : 1: opt.transform.mutable_eliminate 0.04% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.98% : 0.000443s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000102s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000016s : 1: remove_dup_value 1.02% : 0.000460s : 1: renormalize.infer 0.83% : 0.000373s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000037s : 1: rewriter_after_opt_a 0.19% : 0.000084s : 1: rewriter_before_opt_a 0.16% : 0.000070s : 1: symbol_engine_optimizer 78.92% : 0.035537s : 1: type_inference TotalTime = 0.149281, [30] [bootstrap]: 0.00036038 [type_inference]: 0.135351 [event_method]: 2.346e-05 [auto_monad]: 8.079e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 0.00056479 [rewriter_before_opt_a]: 0.00010161 [expand_dump_flag]: 4.31002e-06 [jit_opt_a]: 0.009856, [2] [Cycle 1]: 0.00484504, [27] [switch_simplify]: 6.431e-05 [loop_unroll]: 3.482e-05 [a_1]: 0.00077941 [with_stream_mark]: 2.271e-05 [recompute_prepare]: 1.07e-05 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 8.02998e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 6.91999e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.675e-05 [j_node_and_user_rematch]: 1.127e-05 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 1.19e-05 [inline_without_move]: 7.93999e-06 [renormalize]: 0.00350607 [add_forward_monad_depend]: 1.596e-05 [auto_monad_grad]: 3.33e-06 [auto_monad_eliminator]: 2.31e-05 [cse]: 3.793e-05 [replace_applicator]: 2.283e-05 [Cycle 2]: 0.00042317, [27] [switch_simplify]: 7.75e-06 [loop_unroll]: 6.42001e-06 [a_1]: 0.00014485 [with_stream_mark]: 1.455e-05 [recompute_prepare]: 6.76e-06 [updatestate_depend_eliminate]: 3.82998e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.18998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 5.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.33002e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.025e-05 [inline_without_move]: 6.01e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.73002e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 8.60999e-06 [cse]: 1.545e-05 [replace_applicator]: 6.76999e-06 [py_interpret_to_execute_after_opt_a]: 1.663e-05 [rewriter_after_opt_a]: 4.836e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00089234 [jit_opt_b]: 6.427e-05, [1] [Cycle 1]: 5.458e-05, [2] [frontend_op_eliminate]: 2.194e-05 [inline_after_opt_a]: 2.07e-05 [cconv]: 3.294e-05 [loop_unroll]: 0.00048508 [jit_opt_after_cconv]: 0.00017829, [1] [Cycle 1]: 0.00017109, [11] [c_1]: 2.686e-05 [parameter_eliminate]: 3.21001e-06 [updatestate_depend_eliminate]: 8.1e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 3.27e-05 [call_graph_tuple_transform]: 2.409e-05 [tuple_list_get_item_eliminator]: 7.13e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 6.80002e-06 [remove_dup_value]: 1.889e-05 [partial_unused_args_eliminate]: 2.63e-06 [environ_conv]: 9.44998e-06 [add_recomputation]: 6.193e-05 [cse_after_recomputation]: 2.963e-05, [1] [Cycle 1]: 1.995e-05, [1] [cse]: 1.382e-05 [auto_monad_reorder]: 1.888e-05 [get_jit_bprop_graph]: 2.38002e-06 [rewriter_after_jit_bprop_graph]: 6.18002e-06 [opt_after_jit_grad]: 0.00052386 [symbol_engine_optimizer]: 0.00024772, [1] [Cycle 1]: 0.00023979, [6] [build]: 4.53999e-06 [elim_shapecalc]: 1.166e-05 [elim_not_effective]: 1.918e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 0.00016541 [renormalize]: 4.00003e-07 [validate]: 5.746e-05 Sums bootstrap : 0.000360s : 0.25% type_inference : 0.135351s : 94.00% event_method : 0.000023s : 0.02% auto_monad : 0.000081s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000565s : 0.39% rewriter_before_opt_a : 0.000102s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000924s : 0.64% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003506s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000892s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000485s : 0.34% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000062s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000524s : 0.36% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000165s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000482 28 0.37% : 0.000002s : 2: substitution.elim_not_effective 32.22% : 0.000155s : 2: substitution.fold_const_symbol 1.38% : 0.000007s : 4: substitution.graph_param_transform 56.79% : 0.000274s : 5: substitution.inline 0.90% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.29% : 0.000016s : 3: substitution.reduce_eliminate 1.28% : 0.000006s : 4: substitution.remove_not_recompute_node 1.39% : 0.000007s : 2: substitution.replace_old_param 2.38% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.135240 2 97.19% : 0.131438s : 1: type_inference.infer 2.81% : 0.003802s : 1: type_inference.specialize ------[replace.] 0.000115 7 65.54% : 0.000075s : 5: replace.inline 34.46% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000281 7 96.35% : 0.000270s : 5: match.inline 3.65% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 0.71% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 2.00% : 0.000003s : 13: predicate.arithmetic_simplify 1.71% : 0.000003s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 0.99% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000008s : 28: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 19: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 1.98% : 0.000003s : 19: predicate.partial_eliminate 1.36% : 0.000002s : 13: predicate.print_const_string_wrapper 2.43% : 0.000004s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 13: predicate.same_eliminate 0.79% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.01% : 0.000011s : 64: predicate.switch_simplify 1.48% : 0.000002s : 13: predicate.tile_eliminate 1.53% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.07% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002848 25 60.07% : 0.001711s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.24% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.70% : 0.001045s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154205 72 0.04% : 0.000065s : 1: add_recomputation 0.06% : 0.000085s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.25% : 0.000380s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.39% : 0.009860s : 1: jit_opt_a 0.12% : 0.000181s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.32% : 0.000495s : 1: loop_unroll 0.59% : 0.000904s : 1: mutable_eliminate 0.78% : 0.001196s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000200s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000534s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000576s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.68% : 0.002594s : 1: renormalize.infer 0.58% : 0.000900s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.07% : 0.000106s : 1: rewriter_before_opt_a 0.16% : 0.000251s : 1: symbol_engine_optimizer 87.79% : 0.135371s : 1: type_inference TotalTime = 0.030229, [30] [bootstrap]: 0.00030162 [type_inference]: 0.0222788 [event_method]: 1.785e-05 [auto_monad]: 6.256e-05 [graph_reusing]: 4.86002e-06 [pre_auto_parallel]: 2.21e-06 [py_interpret_to_execute]: 9.692e-05 [rewriter_before_opt_a]: 7.636e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00530385, [2] [Cycle 1]: 0.0019289, [27] [switch_simplify]: 4.778e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00062134 [with_stream_mark]: 1.736e-05 [recompute_prepare]: 7.56001e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.53998e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.28998e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.99998e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00090388 [add_forward_monad_depend]: 4.92e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.438e-05 [cse]: 2.193e-05 [replace_applicator]: 1.19e-05 [Cycle 2]: 0.00031519, [27] [switch_simplify]: 5.85002e-06 [loop_unroll]: 5.27999e-06 [a_1]: 8.91e-05 [with_stream_mark]: 9.51e-06 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.14998e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.47001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.274e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 7.61001e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.185e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 1.165e-05 [rewriter_after_opt_a]: 3.497e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00052045 [jit_opt_b]: 4.776e-05, [1] [Cycle 1]: 4.14e-05, [2] [frontend_op_eliminate]: 1.531e-05 [inline_after_opt_a]: 1.558e-05 [cconv]: 2.397e-05 [loop_unroll]: 0.00042803 [jit_opt_after_cconv]: 0.00014074, [1] [Cycle 1]: 0.00013383, [11] [c_1]: 1.984e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.023e-05 [call_graph_tuple_transform]: 1.928e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.489e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.57001e-06 [add_recomputation]: 4.565e-05 [cse_after_recomputation]: 2.277e-05, [1] [Cycle 1]: 1.763e-05, [1] [cse]: 1.192e-05 [auto_monad_reorder]: 1.666e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 3.97e-06 [opt_after_jit_grad]: 0.00045462 [symbol_engine_optimizer]: 9.012e-05, [1] [Cycle 1]: 8.344e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 7.33e-06 [elim_not_effective]: 2.945e-05 [opt_reshape]: 6.24999e-06 [fold_const_symbol]: 8.99e-06 [renormalize]: 3.49974e-07 [validate]: 3.811e-05 Sums bootstrap : 0.000302s : 1.13% type_inference : 0.022279s : 83.72% event_method : 0.000018s : 0.07% auto_monad : 0.000063s : 0.24% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000097s : 0.36% rewriter_before_opt_a : 0.000076s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.20% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000710s : 2.67% jit_opt_a.with_stream_mark : 0.000027s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000904s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000034s : 0.13% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000035s : 0.13% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000520s : 1.96% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000024s : 0.09% loop_unroll : 0.000428s : 1.61% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000046s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000455s : 1.71% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000029s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.14% Time group info: ------[substitution.] 0.000210 23 8.26% : 0.000017s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000005s : 3: substitution.graph_param_transform 77.99% : 0.000164s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000004s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022216 2 93.69% : 0.020814s : 1: type_inference.infer 6.31% : 0.001402s : 1: type_inference.specialize ------[replace.] 0.000104 6 77.09% : 0.000080s : 4: replace.inline 22.91% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 94.14% : 0.000161s : 4: match.inline 5.86% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.83% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.27% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 2.13% : 0.000002s : 10: predicate.reduce_eliminate 1.74% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.99% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.38% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 53: predicate.switch_simplify 1.68% : 0.000002s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.31% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000782 13 46.76% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.46% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.77% : 0.000373s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032119 72 0.15% : 0.000048s : 1: add_recomputation 0.21% : 0.000066s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 0.99% : 0.000320s : 1: bootstrap 0.08% : 0.000026s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.07% : 0.000021s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000007s : 1: graph_reusing 16.52% : 0.005307s : 1: jit_opt_a 0.45% : 0.000143s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.36% : 0.000436s : 1: loop_unroll 1.65% : 0.000529s : 1: mutable_eliminate 2.85% : 0.000915s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000049s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000462s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000100s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.60% : 0.000515s : 1: renormalize.infer 1.19% : 0.000381s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000038s : 1: rewriter_after_opt_a 0.25% : 0.000080s : 1: rewriter_before_opt_a 0.29% : 0.000093s : 1: symbol_engine_optimizer 69.40% : 0.022291s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.799.7 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00655e0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.878.0 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0153295, [30] [bootstrap]: 0.00028006 [type_inference]: 0.00488926 [event_method]: 2.078e-05 [auto_monad]: 6.566e-05 [graph_reusing]: 6.32001e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 3.668e-05 [rewriter_before_opt_a]: 7.575e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00770523, [2] [Cycle 1]: 0.00195402, [27] [switch_simplify]: 6.531e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.00060623 [with_stream_mark]: 2.36e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00085212 [add_forward_monad_depend]: 7.68001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.557e-05 [cse]: 3.744e-05 [replace_applicator]: 1.307e-05 [Cycle 2]: 0.00034473, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.319e-05 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 4.99003e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 2.13002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.77e-06 [inline_without_move]: 4.97e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.34999e-06 [cse]: 1.44e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 1.54e-05 [rewriter_after_opt_a]: 4.132e-05 [convert_after_rewriter]: 6.64001e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.00064495 [jit_opt_b]: 5.138e-05, [1] [Cycle 1]: 4.396e-05, [2] [frontend_op_eliminate]: 1.549e-05 [inline_after_opt_a]: 1.664e-05 [cconv]: 2.718e-05 [loop_unroll]: 0.00041711 [jit_opt_after_cconv]: 0.00015634, [1] [Cycle 1]: 0.00015033, [11] [c_1]: 2.074e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.242e-05 [call_graph_tuple_transform]: 1.956e-05 [tuple_list_get_item_eliminator]: 5.55001e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.733e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.33002e-06 [add_recomputation]: 5.764e-05 [cse_after_recomputation]: 2.466e-05, [1] [Cycle 1]: 1.931e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.884e-05 [get_jit_bprop_graph]: 2.38998e-06 [rewriter_after_jit_bprop_graph]: 4.87998e-06 [opt_after_jit_grad]: 0.00044935 [symbol_engine_optimizer]: 7.564e-05, [1] [Cycle 1]: 6.944e-05, [6] [build]: 3.60003e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.327e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.60999e-06 [renormalize]: 4.30009e-07 [validate]: 3.976e-05 Sums bootstrap : 0.000280s : 3.02% type_inference : 0.004889s : 52.67% event_method : 0.000021s : 0.22% auto_monad : 0.000066s : 0.71% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.40% rewriter_before_opt_a : 0.000076s : 0.82% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000072s : 0.77% jit_opt_a.loop_unroll : 0.000035s : 0.38% jit_opt_a.a_1 : 0.000699s : 7.53% jit_opt_a.with_stream_mark : 0.000034s : 0.37% jit_opt_a.recompute_prepare : 0.000014s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000852s : 9.18% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000052s : 0.56% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000015s : 0.17% rewriter_after_opt_a : 0.000041s : 0.45% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000645s : 6.95% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000027s : 0.29% loop_unroll : 0.000417s : 4.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000058s : 0.62% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000019s : 0.20% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000449s : 4.84% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.43% Time group info: ------[substitution.] 0.000259 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.03% : 0.000005s : 3: substitution.graph_param_transform 86.21% : 0.000223s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004817 2 81.40% : 0.003921s : 1: type_inference.infer 18.60% : 0.000896s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.54% : 0.000052s : 4: replace.inline 31.46% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.73% : 0.000220s : 4: match.inline 5.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.50% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.73% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 6.81% : 0.000008s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.75% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.58% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.26% : 0.000010s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000733 13 47.27% : 0.000346s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.47% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.26% : 0.000332s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017169 72 0.35% : 0.000061s : 1: add_recomputation 0.40% : 0.000069s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.75% : 0.000300s : 1: bootstrap 0.17% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 44.90% : 0.007708s : 1: jit_opt_a 0.93% : 0.000159s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.48% : 0.000425s : 1: loop_unroll 3.81% : 0.000654s : 1: mutable_eliminate 5.42% : 0.000930s : 26: opt.transform.jit_opt_a 0.28% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.67% : 0.000458s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000039s : 1: py_interpret_to_execute 0.10% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.61% : 0.000448s : 1: renormalize.infer 2.31% : 0.000397s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000044s : 1: rewriter_after_opt_a 0.46% : 0.000079s : 1: rewriter_before_opt_a 0.46% : 0.000078s : 1: symbol_engine_optimizer 28.59% : 0.004908s : 1: type_inference TotalTime = 0.0617844, [30] [bootstrap]: 0.00030808 [type_inference]: 0.00814633 [event_method]: 2.144e-05 [auto_monad]: 6.82e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 5.099e-05 [rewriter_before_opt_a]: 8.276e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.0500713, [2] [Cycle 1]: 0.0461222, [27] [switch_simplify]: 6.034e-05 [loop_unroll]: 3.399e-05 [a_1]: 0.00064389 [with_stream_mark]: 1.673e-05 [recompute_prepare]: 7.46999e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 1.76003e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.72001e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00084471 [add_forward_monad_depend]: 5.25999e-06 [auto_monad_grad]: 2.06998e-06 [auto_monad_eliminator]: 1.377e-05 [cse]: 0.0441075 [replace_applicator]: 5.566e-05 [Cycle 2]: 0.00054909, [27] [switch_simplify]: 1.24e-05 [loop_unroll]: 7.48e-06 [a_1]: 0.00016549 [with_stream_mark]: 3.473e-05 [recompute_prepare]: 7.4e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 6.18998e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 8.37998e-06 [meta_shard_fg_expand]: 4.35e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 3.33998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 3.66001e-06 [replace_old_param]: 1.135e-05 [inline_without_move]: 5.74e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 5.49e-06 [auto_monad_grad]: 3.11999e-06 [auto_monad_eliminator]: 1.727e-05 [cse]: 4.115e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 2.681e-05 [rewriter_after_opt_a]: 4.839e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00094064 [jit_opt_b]: 6.908e-05, [1] [Cycle 1]: 5.685e-05, [2] [frontend_op_eliminate]: 2.286e-05 [inline_after_opt_a]: 1.875e-05 [cconv]: 4.073e-05 [loop_unroll]: 0.00053814 [jit_opt_after_cconv]: 0.00026435, [1] [Cycle 1]: 0.00025473, [11] [c_1]: 2.575e-05 [parameter_eliminate]: 4.13001e-06 [updatestate_depend_eliminate]: 9.56998e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 3.939e-05 [call_graph_tuple_transform]: 3.001e-05 [tuple_list_get_item_eliminator]: 8.01001e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 1.30999e-06 [switch_simplify]: 7.04001e-06 [remove_dup_value]: 1.986e-05 [partial_unused_args_eliminate]: 3.16999e-06 [environ_conv]: 9.81e-06 [add_recomputation]: 6.268e-05 [cse_after_recomputation]: 2.931e-05, [1] [Cycle 1]: 2.181e-05, [1] [cse]: 1.357e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 3.11999e-06 [rewriter_after_jit_bprop_graph]: 9.14e-06 [opt_after_jit_grad]: 0.00056761 [symbol_engine_optimizer]: 9.26e-05, [1] [Cycle 1]: 8.497e-05, [6] [build]: 5.54998e-06 [elim_shapecalc]: 1.087e-05 [elim_not_effective]: 1.772e-05 [opt_reshape]: 7.21001e-06 [fold_const_symbol]: 1.193e-05 [renormalize]: 6.30011e-07 [validate]: 5.183e-05 Sums bootstrap : 0.000308s : 0.54% type_inference : 0.008146s : 14.15% event_method : 0.000021s : 0.04% auto_monad : 0.000068s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000051s : 0.09% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.13% jit_opt_a.loop_unroll : 0.000041s : 0.07% jit_opt_a.a_1 : 0.000809s : 1.41% jit_opt_a.with_stream_mark : 0.000051s : 0.09% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000845s : 1.47% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.05% jit_opt_a.cse : 0.044149s : 76.70% jit_opt_a.replace_applicator : 0.000062s : 0.11% py_interpret_to_execute_after_opt_a : 0.000027s : 0.05% rewriter_after_opt_a : 0.000048s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000941s : 1.63% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000041s : 0.07% loop_unroll : 0.000538s : 0.93% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000063s : 0.11% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000568s : 0.99% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.09% Time group info: ------[substitution.] 0.000267 27 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.91% : 0.000008s : 3: substitution.graph_param_transform 78.94% : 0.000211s : 5: substitution.inline 1.70% : 0.000005s : 4: substitution.j_node_and_user_rematch 6.03% : 0.000016s : 3: substitution.reduce_eliminate 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 2.66% : 0.000007s : 2: substitution.replace_old_param 3.88% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008075 2 86.50% : 0.006985s : 1: type_inference.infer 13.50% : 0.001090s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.28% : 0.000066s : 5: replace.inline 31.72% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.71% : 0.000208s : 5: match.inline 4.29% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000164 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.92% : 0.000002s : 11: predicate.addn_check_dump 1.27% : 0.000002s : 11: predicate.addn_zero_filter 2.29% : 0.000004s : 11: predicate.arithmetic_simplify 1.45% : 0.000002s : 11: predicate.cast_eliminate 0.77% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000002s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 0.97% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.96% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 11: predicate.environ_get_depend_swap 1.48% : 0.000002s : 11: predicate.environ_get_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000002s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 5.27% : 0.000009s : 24: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.29% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 16: predicate.load_eliminater 1.62% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.76% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.76% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 11: predicate.merge_addn 0.96% : 0.000002s : 11: predicate.minmaximum_grad 2.43% : 0.000004s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 1.92% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000002s : 11: predicate.print_const_string_wrapper 2.18% : 0.000004s : 11: predicate.reduce_eliminate 1.63% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000003s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000001s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000002s : 11: predicate.same_eliminate 0.40% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000002s : 6: predicate.special_op_eliminate 0.68% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000004s : 18: predicate.switch_defer_inline 2.17% : 0.000004s : 18: predicate.switch_layer_defer_inline 8.44% : 0.000014s : 59: predicate.switch_simplify 1.38% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000002s : 11: predicate.transpose_eliminate 1.54% : 0.000003s : 11: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.44% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 11: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000887 16 49.73% : 0.000441s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.33% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.94% : 0.000381s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063806 72 0.11% : 0.000067s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.51% : 0.000326s : 1: bootstrap 0.07% : 0.000044s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 78.48% : 0.050077s : 1: jit_opt_a 0.42% : 0.000268s : 1: jit_opt_after_cconv 0.11% : 0.000072s : 1: jit_opt_b 0.86% : 0.000551s : 1: loop_unroll 1.49% : 0.000954s : 1: mutable_eliminate 1.71% : 0.001092s : 26: opt.transform.jit_opt_a 0.10% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.03% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000024s : 1: opt.transform.mutable_eliminate 0.05% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000580s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000054s : 1: py_interpret_to_execute 0.05% : 0.000030s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 0.75% : 0.000478s : 1: renormalize.infer 0.56% : 0.000358s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000052s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.15% : 0.000096s : 1: symbol_engine_optimizer 12.79% : 0.008162s : 1: type_inference TotalTime = 0.0868953, [30] [bootstrap]: 0.00029329 [type_inference]: 0.0218101 [event_method]: 2.414e-05 [auto_monad]: 7.612e-05 [graph_reusing]: 6.59001e-06 [pre_auto_parallel]: 2.50997e-06 [py_interpret_to_execute]: 0.00013515 [rewriter_before_opt_a]: 9.013e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.0615151, [2] [Cycle 1]: 0.0570955, [27] [switch_simplify]: 6.684e-05 [loop_unroll]: 7.763e-05 [a_1]: 0.00061031 [with_stream_mark]: 2.727e-05 [recompute_prepare]: 9.52999e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.84e-06 [renormalize]: 0.0558607 [add_forward_monad_depend]: 1.354e-05 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.744e-05 [cse]: 4.887e-05 [replace_applicator]: 2.885e-05 [Cycle 2]: 0.00038733, [27] [switch_simplify]: 8.52e-06 [loop_unroll]: 6.45002e-06 [a_1]: 0.0001077 [with_stream_mark]: 1.827e-05 [recompute_prepare]: 5.89999e-06 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.93999e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 4.97999e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 2.83e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.043e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 5.49e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 7.43999e-06 [cse]: 1.655e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 2.337e-05 [rewriter_after_opt_a]: 4.635e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00086876 [jit_opt_b]: 5.839e-05, [1] [Cycle 1]: 4.888e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.773e-05 [cconv]: 3.183e-05 [loop_unroll]: 0.0004787 [jit_opt_after_cconv]: 0.00017131, [1] [Cycle 1]: 0.00016382, [11] [c_1]: 2.18e-05 [parameter_eliminate]: 3.80998e-06 [updatestate_depend_eliminate]: 8.43001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 3.465e-05 [call_graph_tuple_transform]: 2.4e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 1.99999e-06 [renormalize]: 7.60017e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.898e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 6.78998e-06 [add_recomputation]: 6.045e-05 [cse_after_recomputation]: 2.553e-05, [1] [Cycle 1]: 1.908e-05, [1] [cse]: 1.227e-05 [auto_monad_reorder]: 1.982e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 8.53001e-06 [opt_after_jit_grad]: 0.0007273 [symbol_engine_optimizer]: 8.427e-05, [1] [Cycle 1]: 7.553e-05, [6] [build]: 5.46e-06 [elim_shapecalc]: 9.10999e-06 [elim_not_effective]: 1.575e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 1.07e-06 [validate]: 5.175e-05 Sums bootstrap : 0.000293s : 0.36% type_inference : 0.021810s : 26.55% event_method : 0.000024s : 0.03% auto_monad : 0.000076s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000135s : 0.16% rewriter_before_opt_a : 0.000090s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.09% jit_opt_a.loop_unroll : 0.000084s : 0.10% jit_opt_a.a_1 : 0.000718s : 0.87% jit_opt_a.with_stream_mark : 0.000046s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.055861s : 68.01% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.04% jit_opt_a.cse : 0.000065s : 0.08% jit_opt_a.replace_applicator : 0.000035s : 0.04% py_interpret_to_execute_after_opt_a : 0.000023s : 0.03% rewriter_after_opt_a : 0.000046s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000869s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000032s : 0.04% loop_unroll : 0.000479s : 0.58% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000060s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000727s : 0.89% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.06% Time group info: ------[substitution.] 0.000271 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 84.62% : 0.000229s : 4: substitution.inline 1.85% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.71% : 0.000007s : 2: substitution.replace_old_param 5.11% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021712 2 91.45% : 0.019855s : 1: type_inference.infer 8.55% : 0.001856s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.60% : 0.000054s : 4: replace.inline 32.40% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 94.68% : 0.000227s : 4: match.inline 5.32% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.56% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.70% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.02% : 0.000001s : 10: predicate.depend_value_elim 0.92% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.65% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000001s : 3: predicate.graph_param_transform 5.39% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.01% : 0.000003s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.72% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 2.24% : 0.000003s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.70% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 1.96% : 0.000003s : 16: predicate.switch_defer_inline 1.86% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.21% : 0.000010s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000002s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.95% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.50% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001105 13 38.63% : 0.000427s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.55% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.82% : 0.000617s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143795 72 0.04% : 0.000064s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.22% : 0.000315s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 42.78% : 0.061519s : 1: jit_opt_a 0.12% : 0.000175s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.34% : 0.000489s : 1: loop_unroll 0.61% : 0.000880s : 1: mutable_eliminate 0.71% : 0.001026s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.52% : 0.000744s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000139s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 38.32% : 0.055097s : 1: renormalize.infer 0.50% : 0.000723s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.07% : 0.000094s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 15.19% : 0.021841s : 1: type_inference TotalTime = 0.0140101, [30] [bootstrap]: 0.00027782 [type_inference]: 0.00535189 [event_method]: 1.977e-05 [auto_monad]: 6.756e-05 [graph_reusing]: 6.16998e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 3.642e-05 [rewriter_before_opt_a]: 7.802e-05 [expand_dump_flag]: 3.10002e-06 [jit_opt_a]: 0.00587184, [2] [Cycle 1]: 0.00188877, [27] [switch_simplify]: 6.229e-05 [loop_unroll]: 3.024e-05 [a_1]: 0.00056755 [with_stream_mark]: 2.589e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.03002e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 8.83001e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00083817 [add_forward_monad_depend]: 8.23001e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.809e-05 [cse]: 3.906e-05 [replace_applicator]: 1.624e-05 [Cycle 2]: 0.00033988, [27] [switch_simplify]: 6.32001e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.793e-05 [with_stream_mark]: 1.203e-05 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.25002e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 1.49003e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.63998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 7.18998e-06 [cse]: 1.469e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 1.496e-05 [rewriter_after_opt_a]: 3.918e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00063963 [jit_opt_b]: 4.989e-05, [1] [Cycle 1]: 4.222e-05, [2] [frontend_op_eliminate]: 1.512e-05 [inline_after_opt_a]: 1.592e-05 [cconv]: 3.092e-05 [loop_unroll]: 0.00042 [jit_opt_after_cconv]: 0.00016214, [1] [Cycle 1]: 0.00015526, [11] [c_1]: 2.051e-05 [parameter_eliminate]: 4.87e-06 [updatestate_depend_eliminate]: 8.90999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.46998e-06 [cse]: 2.659e-05 [call_graph_tuple_transform]: 2.06e-05 [tuple_list_get_item_eliminator]: 5.27999e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.09e-06 [remove_dup_value]: 1.807e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.99001e-06 [add_recomputation]: 5.289e-05 [cse_after_recomputation]: 2.465e-05, [1] [Cycle 1]: 1.948e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 2.02e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 4.81997e-06 [opt_after_jit_grad]: 0.00049359 [symbol_engine_optimizer]: 7.552e-05, [1] [Cycle 1]: 6.828e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 8.19002e-06 [elim_not_effective]: 1.429e-05 [opt_reshape]: 5.49e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 8.2e-07 [validate]: 4.413e-05 Sums bootstrap : 0.000278s : 2.85% type_inference : 0.005352s : 54.87% event_method : 0.000020s : 0.20% auto_monad : 0.000068s : 0.69% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.37% rewriter_before_opt_a : 0.000078s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000655s : 6.72% jit_opt_a.with_stream_mark : 0.000038s : 0.39% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000838s : 8.59% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.10% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.26% jit_opt_a.cse : 0.000054s : 0.55% jit_opt_a.replace_applicator : 0.000022s : 0.23% py_interpret_to_execute_after_opt_a : 0.000015s : 0.15% rewriter_after_opt_a : 0.000039s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000640s : 6.56% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000031s : 0.32% loop_unroll : 0.000420s : 4.31% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000027s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000053s : 0.54% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000020s : 0.21% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000494s : 5.06% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.45% Time group info: ------[substitution.] 0.000245 23 1.03% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 84.56% : 0.000207s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 5.60% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005286 2 84.03% : 0.004442s : 1: type_inference.infer 15.97% : 0.000844s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.88% : 0.000048s : 4: replace.inline 32.12% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 6 94.21% : 0.000205s : 4: match.inline 5.79% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.44% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 6.08% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.97% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.45% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.99% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.71% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 1.15% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.40% : 0.000009s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.31% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.61% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000679 13 53.58% : 0.000364s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.63% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.79% : 0.000263s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015783 72 0.35% : 0.000056s : 1: add_recomputation 0.45% : 0.000071s : 1: auto_monad 0.15% : 0.000023s : 1: auto_monad_reorder 1.86% : 0.000293s : 1: bootstrap 0.22% : 0.000034s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.22% : 0.005875s : 1: jit_opt_a 1.04% : 0.000165s : 1: jit_opt_after_cconv 0.34% : 0.000053s : 1: jit_opt_b 2.71% : 0.000428s : 1: loop_unroll 4.12% : 0.000651s : 1: mutable_eliminate 5.60% : 0.000884s : 26: opt.transform.jit_opt_a 0.30% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.20% : 0.000504s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000039s : 1: py_interpret_to_execute 0.11% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000020s : 1: remove_dup_value 3.15% : 0.000496s : 1: renormalize.infer 2.10% : 0.000332s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000042s : 1: rewriter_after_opt_a 0.52% : 0.000082s : 1: rewriter_before_opt_a 0.49% : 0.000078s : 1: symbol_engine_optimizer 34.02% : 0.005369s : 1: type_inference TotalTime = 0.154835, [30] [bootstrap]: 0.00030719 [type_inference]: 0.124446 [event_method]: 0.00048101 [auto_monad]: 0.00011406 [graph_reusing]: 7.48999e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 5.463e-05 [rewriter_before_opt_a]: 0.00012672 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.0263816, [3] [Cycle 1]: 0.0178079, [27] [switch_simplify]: 8.798e-05 [loop_unroll]: 4.575e-05 [a_1]: 0.00105958 [with_stream_mark]: 4.028e-05 [recompute_prepare]: 2.509e-05 [updatestate_depend_eliminate]: 1.053e-05 [updatestate_assign_eliminate]: 7.33999e-06 [updatestate_loads_eliminate]: 7.07002e-06 [parameter_eliminate]: 3.53e-06 [specialize_transform]: 1.668e-05 [updatestate_useless_node_eliminater]: 1.392e-05 [accelerated_algorithm]: 1.417e-05 [meta_shard_fg_expand]: 5.75001e-06 [get_grad_eliminate_]: 1.507e-05 [merge_forward]: 8.69e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.991e-05 [j_node_and_user_rematch]: 2.686e-05 [meta_fg_expand]: 0.00229497 [replace_old_param]: 9.604e-05 [inline_without_move]: 7.21e-05 [renormalize]: 0.0131628 [add_forward_monad_depend]: 1.359e-05 [auto_monad_grad]: 7.00002e-06 [auto_monad_eliminator]: 6.536e-05 [cse]: 0.00027783 [replace_applicator]: 9.419e-05 [Cycle 2]: 0.00419526, [27] [switch_simplify]: 4.51e-05 [loop_unroll]: 4.543e-05 [a_1]: 0.00131923 [with_stream_mark]: 2.806e-05 [recompute_prepare]: 1.247e-05 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 4.10998e-06 [updatestate_loads_eliminate]: 4.01001e-06 [parameter_eliminate]: 2.35002e-06 [specialize_transform]: 9.24998e-06 [updatestate_useless_node_eliminater]: 7.08e-06 [accelerated_algorithm]: 7.41001e-06 [meta_shard_fg_expand]: 3.03e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 5.73997e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.974e-05 [j_node_and_user_rematch]: 1.21e-05 [meta_fg_expand]: 0.00013741 [replace_old_param]: 1.116e-05 [inline_without_move]: 6.64001e-06 [renormalize]: 0.00217828 [add_forward_monad_depend]: 1.13e-05 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 2.123e-05 [cse]: 3.422e-05 [replace_applicator]: 2.174e-05 [Cycle 3]: 0.00029739, [27] [switch_simplify]: 4.97999e-06 [loop_unroll]: 4.31002e-06 [a_1]: 5.282e-05 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 3.66999e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 4.08001e-06 [updatestate_useless_node_eliminater]: 3.79002e-06 [accelerated_algorithm]: 3.71001e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 3.21001e-06 [merge_forward]: 3.38999e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 7.46999e-06 [meta_fg_expand]: 1.30999e-06 [replace_old_param]: 3.57997e-06 [inline_without_move]: 3.66999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.41002e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 4.59002e-06 [cse]: 1.178e-05 [replace_applicator]: 4.13001e-06 [py_interpret_to_execute_after_opt_a]: 1.94e-05 [rewriter_after_opt_a]: 4.029e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 4.23001e-06 [mutable_eliminate]: 0.00089306 [jit_opt_b]: 5.1e-05, [1] [Cycle 1]: 4.176e-05, [2] [frontend_op_eliminate]: 1.382e-05 [inline_after_opt_a]: 1.36e-05 [cconv]: 4.006e-05 [loop_unroll]: 0.00056528 [jit_opt_after_cconv]: 0.0001791, [1] [Cycle 1]: 0.00017056, [11] [c_1]: 1.617e-05 [parameter_eliminate]: 6.35002e-06 [updatestate_depend_eliminate]: 9.83998e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.79999e-06 [cse]: 3.817e-05 [call_graph_tuple_transform]: 2.143e-05 [tuple_list_get_item_eliminator]: 4.57e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 1.45001e-06 [switch_simplify]: 4.72998e-06 [remove_dup_value]: 1.63e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 6.36e-06 [add_recomputation]: 4.321e-05 [cse_after_recomputation]: 2.521e-05, [1] [Cycle 1]: 1.771e-05, [1] [cse]: 9.02999e-06 [auto_monad_reorder]: 1.451e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 9.73998e-06 [opt_after_jit_grad]: 0.00062192 [symbol_engine_optimizer]: 8.148e-05, [1] [Cycle 1]: 7.03e-05, [6] [build]: 6.02001e-06 [elim_shapecalc]: 6.10002e-06 [elim_not_effective]: 1.467e-05 [opt_reshape]: 5.30001e-06 [fold_const_symbol]: 5.64e-06 [renormalize]: 9.00007e-07 [validate]: 4.491e-05 Sums bootstrap : 0.000307s : 0.21% type_inference : 0.124446s : 83.13% event_method : 0.000481s : 0.32% auto_monad : 0.000114s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000055s : 0.04% rewriter_before_opt_a : 0.000127s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000138s : 0.09% jit_opt_a.loop_unroll : 0.000095s : 0.06% jit_opt_a.a_1 : 0.002432s : 1.62% jit_opt_a.with_stream_mark : 0.000084s : 0.06% jit_opt_a.recompute_prepare : 0.000041s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000030s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000065s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.03% jit_opt_a.meta_fg_expand : 0.002434s : 1.63% jit_opt_a.replace_old_param : 0.000111s : 0.07% jit_opt_a.inline_without_move : 0.000082s : 0.06% jit_opt_a.renormalize : 0.015341s : 10.25% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000091s : 0.06% jit_opt_a.cse : 0.000324s : 0.22% jit_opt_a.replace_applicator : 0.000120s : 0.08% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000893s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000040s : 0.03% loop_unroll : 0.000565s : 0.38% jit_opt_after_cconv.c_1 : 0.000016s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000043s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000622s : 0.42% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000729 104 0.21% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.74% : 0.000005s : 1: substitution.graph_param_transform 69.47% : 0.000507s : 13: substitution.inline 3.59% : 0.000026s : 2: substitution.inline_without_move 1.56% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.82% : 0.000013s : 7: substitution.minmaximum_grad 1.12% : 0.000008s : 5: substitution.partial_eliminate 1.57% : 0.000011s : 12: substitution.remove_not_recompute_node 4.76% : 0.000035s : 10: substitution.replace_applicator 1.20% : 0.000009s : 10: substitution.replace_old_param 0.43% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.83% : 0.000006s : 1: substitution.tile_eliminate 3.45% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.29% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.81% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124343 2 97.50% : 0.121231s : 1: type_inference.infer 2.50% : 0.003111s : 1: type_inference.specialize ------[replace.] 0.000212 20 67.91% : 0.000144s : 13: replace.inline 32.09% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000525 20 94.96% : 0.000499s : 13: match.inline 5.04% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000407 2544 1.55% : 0.000006s : 44: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.32% : 0.000005s : 44: predicate.addn_check_dump 1.76% : 0.000007s : 44: predicate.addn_zero_filter 2.19% : 0.000009s : 44: predicate.arithmetic_simplify 1.57% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000006s : 44: predicate.compare_switch_simplify 1.58% : 0.000006s : 44: predicate.depend_value_elim 1.33% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.46% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.36% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.29% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.14% : 0.000001s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.33% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.62% : 0.000007s : 44: predicate.environ_get_depend_swap 1.39% : 0.000006s : 44: predicate.environ_get_eliminate 1.42% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.77% : 0.000003s : 17: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.44% : 0.000018s : 66: predicate.inline 1.99% : 0.000008s : 45: predicate.inline_without_move 0.31% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.96% : 0.000004s : 17: predicate.less_batch_normalization 1.94% : 0.000008s : 51: predicate.list_to_tuple_eliminator_ 1.92% : 0.000008s : 52: predicate.load_eliminater 0.55% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.38% : 0.000014s : 92: predicate.loop_unroll_before_grad 1.86% : 0.000008s : 45: predicate.make_slice_get_slice_eliminator 1.32% : 0.000005s : 44: predicate.merge_addn 1.43% : 0.000006s : 44: predicate.minmaximum_grad 0.87% : 0.000004s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.13% : 0.000009s : 52: predicate.partial_eliminate 1.39% : 0.000006s : 44: predicate.print_const_string_wrapper 2.20% : 0.000009s : 44: predicate.reduce_eliminate 1.73% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 17: predicate.remove_not_recompute_node 2.71% : 0.000011s : 96: predicate.replace_applicator 1.24% : 0.000005s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.56% : 0.000006s : 44: predicate.reshape_eliminate 1.54% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.38% : 0.000002s : 1: predicate.row_tensor_eliminate 1.36% : 0.000006s : 44: predicate.same_eliminate 0.49% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.71% : 0.000003s : 17: predicate.specialize_transform 1.68% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.64% : 0.000007s : 44: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.28% : 0.000013s : 64: predicate.switch_defer_inline 2.38% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.43% : 0.000026s : 157: predicate.switch_simplify 1.68% : 0.000007s : 44: predicate.tile_eliminate 1.47% : 0.000006s : 44: predicate.transpose_eliminate 2.08% : 0.000008s : 44: predicate.tuple_list_convert_item_index_to_positive 1.82% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000014s : 53: predicate.tuple_list_get_item_eliminator 1.90% : 0.000008s : 44: predicate.tuple_list_set_item_eliminator 1.87% : 0.000008s : 51: predicate.tuple_to_list_eliminator_ 1.85% : 0.000008s : 52: predicate.updatestate_pure_node_eliminater 2.50% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.85% : 0.000008s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.22% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004003 45 75.78% : 0.003034s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.22% : 0.000969s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173363 87 0.03% : 0.000046s : 1: add_recomputation 0.07% : 0.000122s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.19% : 0.000335s : 1: bootstrap 0.02% : 0.000043s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.28% : 0.000490s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.22% : 0.026385s : 1: jit_opt_a 0.10% : 0.000182s : 1: jit_opt_after_cconv 0.03% : 0.000054s : 1: jit_opt_b 0.33% : 0.000578s : 1: loop_unroll 0.53% : 0.000914s : 1: mutable_eliminate 1.83% : 0.003175s : 39: opt.transform.jit_opt_a 0.02% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000020s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000029s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000639s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000058s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 7.42% : 0.012869s : 2: renormalize.infer 1.41% : 0.002445s : 2: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000130s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 71.80% : 0.124467s : 1: type_inference TotalTime = 0.0402048, [30] [bootstrap]: 0.00029963 [type_inference]: 0.028602 [event_method]: 2.267e-05 [auto_monad]: 7.267e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 0.00011989 [rewriter_before_opt_a]: 8.614e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.0084197, [2] [Cycle 1]: 0.0021183, [27] [switch_simplify]: 0.00010138 [loop_unroll]: 2.99e-05 [a_1]: 0.00057055 [with_stream_mark]: 2.308e-05 [recompute_prepare]: 8.25999e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.07003e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 0.00104482 [add_forward_monad_depend]: 6.04001e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 3.612e-05 [replace_applicator]: 1.307e-05 [Cycle 2]: 0.00033179, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.22e-06 [a_1]: 9.241e-05 [with_stream_mark]: 1.119e-05 [recompute_prepare]: 5.19003e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 7.88001e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.463e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.65e-05 [rewriter_after_opt_a]: 3.951e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00072642 [jit_opt_b]: 5.617e-05, [1] [Cycle 1]: 4.874e-05, [2] [frontend_op_eliminate]: 1.83e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 3.022e-05 [loop_unroll]: 0.00047078 [jit_opt_after_cconv]: 0.00015459, [1] [Cycle 1]: 0.00014838, [11] [c_1]: 2.161e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 6.63e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.698e-05 [call_graph_tuple_transform]: 2.168e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.43002e-06 [remove_dup_value]: 6.465e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 5.485e-05 [cse_after_recomputation]: 2.619e-05, [1] [Cycle 1]: 2.068e-05, [1] [cse]: 1.358e-05 [auto_monad_reorder]: 1.82e-05 [get_jit_bprop_graph]: 3.14999e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00051181 [symbol_engine_optimizer]: 0.00012085, [1] [Cycle 1]: 0.00011203, [6] [build]: 4.76002e-06 [elim_shapecalc]: 4.544e-05 [elim_not_effective]: 1.529e-05 [opt_reshape]: 7.52998e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 8.2e-07 [validate]: 4.554e-05 Sums bootstrap : 0.000300s : 0.89% type_inference : 0.028602s : 85.09% event_method : 0.000023s : 0.07% auto_monad : 0.000073s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000120s : 0.36% rewriter_before_opt_a : 0.000086s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000107s : 0.32% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000663s : 1.97% jit_opt_a.with_stream_mark : 0.000034s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001045s : 3.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000051s : 0.15% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000726s : 2.16% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000030s : 0.09% loop_unroll : 0.000471s : 1.40% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000065s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000512s : 1.52% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000045s : 0.14% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.14% Time group info: ------[substitution.] 0.000242 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 84.96% : 0.000205s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000006s : 2: substitution.replace_old_param 5.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028518 2 94.38% : 0.026914s : 1: type_inference.infer 5.62% : 0.001604s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.69% : 0.000051s : 4: replace.inline 30.31% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.61% : 0.000203s : 4: match.inline 5.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.92% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.41% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.70% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.26% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.72% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000908 13 45.43% : 0.000413s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.08% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.48% : 0.000440s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042235 72 0.14% : 0.000058s : 1: add_recomputation 0.18% : 0.000077s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.76% : 0.000321s : 1: bootstrap 0.08% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.94% : 0.008424s : 1: jit_opt_a 0.37% : 0.000157s : 1: jit_opt_after_cconv 0.14% : 0.000059s : 1: jit_opt_b 1.13% : 0.000478s : 1: loop_unroll 1.74% : 0.000737s : 1: mutable_eliminate 2.19% : 0.000927s : 26: opt.transform.jit_opt_a 0.12% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.24% : 0.000523s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000124s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.16% : 0.000067s : 1: remove_dup_value 1.42% : 0.000598s : 1: renormalize.infer 1.04% : 0.000438s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.21% : 0.000090s : 1: rewriter_before_opt_a 0.29% : 0.000123s : 1: symbol_engine_optimizer 67.78% : 0.028627s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.188.061 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065040> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.188.729 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0506353, [30] [bootstrap]: 0.00028246 [type_inference]: 0.0418994 [event_method]: 2.044e-05 [auto_monad]: 6.864e-05 [graph_reusing]: 5.81998e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00010068 [rewriter_before_opt_a]: 0.00032701 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00576933, [2] [Cycle 1]: 0.00196439, [27] [switch_simplify]: 5.688e-05 [loop_unroll]: 2.928e-05 [a_1]: 0.00054549 [with_stream_mark]: 2.05e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 3.85998e-06 [updatestate_assign_eliminate]: 3.81999e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00098071 [add_forward_monad_depend]: 5.22e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.542e-05 [cse]: 3.409e-05 [replace_applicator]: 1.353e-05 [Cycle 2]: 0.00031299, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.10001e-06 [a_1]: 8.577e-05 [with_stream_mark]: 8.62e-06 [recompute_prepare]: 4.94998e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 4.92999e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 6.90002e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.382e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.208e-05 [rewriter_after_opt_a]: 3.704e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00057705 [jit_opt_b]: 4.959e-05, [1] [Cycle 1]: 4.258e-05, [2] [frontend_op_eliminate]: 1.536e-05 [inline_after_opt_a]: 1.647e-05 [cconv]: 2.498e-05 [loop_unroll]: 0.00042529 [jit_opt_after_cconv]: 0.00013943, [1] [Cycle 1]: 0.0001333, [11] [c_1]: 2.082e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.198e-05 [call_graph_tuple_transform]: 1.719e-05 [tuple_list_get_item_eliminator]: 5.30999e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 8.40024e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 5.63002e-06 [add_recomputation]: 4.881e-05 [cse_after_recomputation]: 2.186e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.774e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 1.578e-05 [opt_after_jit_grad]: 0.00045367 [symbol_engine_optimizer]: 7.154e-05, [1] [Cycle 1]: 6.501e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.258e-05 [opt_reshape]: 5.71003e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 3.10014e-07 [validate]: 3.729e-05 Sums bootstrap : 0.000282s : 0.61% type_inference : 0.041899s : 89.98% event_method : 0.000020s : 0.04% auto_monad : 0.000069s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000101s : 0.22% rewriter_before_opt_a : 0.000327s : 0.70% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.14% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000631s : 1.36% jit_opt_a.with_stream_mark : 0.000029s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000981s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000048s : 0.10% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000037s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000577s : 1.24% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000025s : 0.05% loop_unroll : 0.000425s : 0.91% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.10% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000016s : 0.03% opt_after_jit_grad : 0.000454s : 0.97% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.08% Time group info: ------[substitution.] 0.000198 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000005s : 3: substitution.graph_param_transform 83.48% : 0.000166s : 4: substitution.inline 1.73% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000004s : 2: substitution.replace_old_param 6.27% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041825 2 96.17% : 0.040225s : 1: type_inference.infer 3.83% : 0.001600s : 1: type_inference.specialize ------[replace.] 0.000086 6 57.53% : 0.000049s : 4: replace.inline 42.47% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.47% : 0.000163s : 4: match.inline 6.53% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.84% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.16% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.60% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.14% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000810 13 47.16% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.51% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.33% : 0.000400s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052513 72 0.10% : 0.000051s : 1: add_recomputation 0.14% : 0.000072s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.58% : 0.000303s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 10.99% : 0.005773s : 1: jit_opt_a 0.27% : 0.000142s : 1: jit_opt_after_cconv 0.10% : 0.000052s : 1: jit_opt_b 0.82% : 0.000433s : 1: loop_unroll 1.12% : 0.000586s : 1: mutable_eliminate 1.61% : 0.000846s : 26: opt.transform.jit_opt_a 0.09% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.88% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000104s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.07% : 0.000560s : 1: renormalize.infer 0.78% : 0.000412s : 1: renormalize.specialize 0.03% : 0.000018s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.64% : 0.000338s : 1: rewriter_before_opt_a 0.14% : 0.000074s : 1: symbol_engine_optimizer 79.82% : 0.041918s : 1: type_inference TotalTime = 0.141226, [30] [bootstrap]: 0.00043492 [type_inference]: 0.127582 [event_method]: 2.566e-05 [auto_monad]: 7.754e-05 [graph_reusing]: 6.73e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00044911 [rewriter_before_opt_a]: 9.828e-05 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.00982008, [2] [Cycle 1]: 0.00416407, [27] [switch_simplify]: 7.24e-05 [loop_unroll]: 3.516e-05 [a_1]: 0.00072338 [with_stream_mark]: 2.154e-05 [recompute_prepare]: 8.38999e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.18998e-06 [updatestate_useless_node_eliminater]: 6.49999e-06 [accelerated_algorithm]: 7.66999e-06 [meta_shard_fg_expand]: 2.60002e-06 [get_grad_eliminate_]: 6.43998e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.04e-05 [inline_without_move]: 6.23998e-06 [renormalize]: 0.00288576 [add_forward_monad_depend]: 9.65002e-06 [auto_monad_grad]: 3.28e-06 [auto_monad_eliminator]: 1.948e-05 [cse]: 4.138e-05 [replace_applicator]: 2.5e-05 [Cycle 2]: 0.00043316, [27] [switch_simplify]: 7.26999e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00013865 [with_stream_mark]: 1.746e-05 [recompute_prepare]: 6.73e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.71e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 3.06999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.131e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 1.032e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 8.74e-06 [cse]: 1.83e-05 [replace_applicator]: 7e-06 [py_interpret_to_execute_after_opt_a]: 1.693e-05 [rewriter_after_opt_a]: 4.441e-05 [convert_after_rewriter]: 8.27e-06 [order_py_execute_after_rewriter]: 6.06e-06 [mutable_eliminate]: 0.00079747 [jit_opt_b]: 6.115e-05, [1] [Cycle 1]: 5.287e-05, [2] [frontend_op_eliminate]: 2.033e-05 [inline_after_opt_a]: 1.925e-05 [cconv]: 3.244e-05 [loop_unroll]: 0.00051158 [jit_opt_after_cconv]: 0.0001793, [1] [Cycle 1]: 0.00017224, [11] [c_1]: 2.589e-05 [parameter_eliminate]: 4.34997e-06 [updatestate_depend_eliminate]: 8.94e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 3.659e-05 [call_graph_tuple_transform]: 2.263e-05 [tuple_list_get_item_eliminator]: 7.00002e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 6.33002e-06 [remove_dup_value]: 2.049e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 1.102e-05 [add_recomputation]: 5.606e-05 [cse_after_recomputation]: 2.568e-05, [1] [Cycle 1]: 2.064e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.872e-05 [get_jit_bprop_graph]: 4.99998e-06 [rewriter_after_jit_bprop_graph]: 7.27997e-06 [opt_after_jit_grad]: 0.0004831 [symbol_engine_optimizer]: 0.00017433, [1] [Cycle 1]: 0.00016707, [6] [build]: 4.48999e-06 [elim_shapecalc]: 1.167e-05 [elim_not_effective]: 0.00010261 [opt_reshape]: 7.63999e-06 [fold_const_symbol]: 1.061e-05 [renormalize]: 5.00004e-07 [validate]: 5.284e-05 Sums bootstrap : 0.000435s : 0.32% type_inference : 0.127582s : 94.28% event_method : 0.000026s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000449s : 0.33% rewriter_before_opt_a : 0.000098s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000862s : 0.64% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002886s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000060s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000797s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000512s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000483s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000103s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.04% Time group info: ------[substitution.] 0.000372 25 24.28% : 0.000090s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.65% : 0.000006s : 4: substitution.graph_param_transform 65.83% : 0.000245s : 5: substitution.inline 1.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.53% : 0.000006s : 2: substitution.replace_old_param 3.67% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127449 2 96.60% : 0.123120s : 1: type_inference.infer 3.40% : 0.004330s : 1: type_inference.specialize ------[replace.] 0.000105 7 69.37% : 0.000073s : 5: replace.inline 30.63% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.16% : 0.000242s : 5: match.inline 4.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.49% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.21% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.70% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.87% : 0.000003s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 19: predicate.load_eliminater 1.61% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.70% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.58% : 0.000011s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.13% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.53% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.50% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004023 25 39.92% : 0.001606s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 58.25% : 0.002343s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.145415 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.31% : 0.000456s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.76% : 0.009824s : 1: jit_opt_a 0.13% : 0.000182s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.36% : 0.000520s : 1: loop_unroll 0.56% : 0.000811s : 1: mutable_eliminate 0.78% : 0.001141s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000129s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000455s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.41% : 0.002052s : 1: renormalize.infer 0.56% : 0.000821s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.07% : 0.000103s : 1: rewriter_before_opt_a 0.12% : 0.000177s : 1: symbol_engine_optimizer 87.76% : 0.127609s : 1: type_inference TotalTime = 0.172911, [30] [bootstrap]: 0.00037398 [type_inference]: 0.146977 [event_method]: 2.743e-05 [auto_monad]: 8.626e-05 [graph_reusing]: 6.58998e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00079592 [rewriter_before_opt_a]: 0.00011534 [expand_dump_flag]: 4.72e-06 [jit_opt_a]: 0.0211199, [2] [Cycle 1]: 0.0162078, [27] [switch_simplify]: 7.491e-05 [loop_unroll]: 3.43e-05 [a_1]: 0.00080953 [with_stream_mark]: 2.758e-05 [recompute_prepare]: 1.032e-05 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.71999e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 7.28e-06 [accelerated_algorithm]: 7.43e-06 [meta_shard_fg_expand]: 3.33e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.659e-05 [j_node_and_user_rematch]: 1.071e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.212e-05 [inline_without_move]: 6.20002e-06 [renormalize]: 0.0146483 [add_forward_monad_depend]: 1.197e-05 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 2.402e-05 [cse]: 6.468e-05 [replace_applicator]: 8.699e-05 [Cycle 2]: 0.0005733, [27] [switch_simplify]: 8.95999e-06 [loop_unroll]: 6.99001e-06 [a_1]: 0.00017925 [with_stream_mark]: 1.82e-05 [recompute_prepare]: 6.59001e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.38999e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 6.55002e-06 [accelerated_algorithm]: 7.31999e-06 [meta_shard_fg_expand]: 2.82002e-06 [get_grad_eliminate_]: 7.08e-06 [merge_forward]: 4.59002e-06 [cell_reuse_recompute_pass]: 9.497e-05 [cell_reuse_handle_not_recompute_node_pass]: 1.775e-05 [j_node_and_user_rematch]: 1.048e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.087e-05 [inline_without_move]: 5.74e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 2.09999e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 8.14002e-06 [cse]: 1.747e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.894e-05 [rewriter_after_opt_a]: 6.59e-05 [convert_after_rewriter]: 8.20999e-06 [order_py_execute_after_rewriter]: 6.09001e-06 [mutable_eliminate]: 0.00127845 [jit_opt_b]: 8.612e-05, [1] [Cycle 1]: 5.575e-05, [2] [frontend_op_eliminate]: 2.268e-05 [inline_after_opt_a]: 2.039e-05 [cconv]: 3.724e-05 [loop_unroll]: 0.00049722 [jit_opt_after_cconv]: 0.00017153, [1] [Cycle 1]: 0.00016518, [11] [c_1]: 2.62e-05 [parameter_eliminate]: 3.78999e-06 [updatestate_depend_eliminate]: 7.71999e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.71999e-06 [cse]: 3.362e-05 [call_graph_tuple_transform]: 2.328e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.852e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 9.45001e-06 [add_recomputation]: 8.838e-05 [cse_after_recomputation]: 2.793e-05, [1] [Cycle 1]: 1.978e-05, [1] [cse]: 1.372e-05 [auto_monad_reorder]: 1.883e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 7.09001e-06 [opt_after_jit_grad]: 0.00049602 [symbol_engine_optimizer]: 0.00019022, [1] [Cycle 1]: 0.00018293, [6] [build]: 4.37e-06 [elim_shapecalc]: 1.058e-05 [elim_not_effective]: 0.00011759 [opt_reshape]: 7.92e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 3.00002e-07 [validate]: 5.61e-05 Sums bootstrap : 0.000374s : 0.22% type_inference : 0.146977s : 87.66% event_method : 0.000027s : 0.02% auto_monad : 0.000086s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000796s : 0.47% rewriter_before_opt_a : 0.000115s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000989s : 0.59% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000098s : 0.06% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.014648s : 8.74% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000082s : 0.05% jit_opt_a.replace_applicator : 0.000093s : 0.06% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000066s : 0.04% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001278s : 0.76% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000037s : 0.02% loop_unroll : 0.000497s : 0.30% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000088s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000496s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000118s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000360 28 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.74% : 0.000006s : 4: substitution.graph_param_transform 84.26% : 0.000304s : 5: substitution.inline 1.50% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.32% : 0.000016s : 3: substitution.reduce_eliminate 1.63% : 0.000006s : 4: substitution.remove_not_recompute_node 2.08% : 0.000007s : 2: substitution.replace_old_param 3.54% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.146851 2 97.09% : 0.142584s : 1: type_inference.infer 2.91% : 0.004267s : 1: type_inference.specialize ------[replace.] 0.000115 7 68.26% : 0.000079s : 5: replace.inline 31.74% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000312 7 96.30% : 0.000300s : 5: match.inline 3.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.69% : 0.000003s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.96% : 0.000003s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.29% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.78% : 0.000009s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.62% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 2.10% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.05% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.69% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.55% : 0.000004s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 20: predicate.switch_defer_inline 1.99% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000011s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.48% : 0.000002s : 13: predicate.transpose_eliminate 1.28% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.49% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.99% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003246 25 59.13% : 0.001919s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.99% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.89% : 0.001230s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.189028 72 0.05% : 0.000092s : 1: add_recomputation 0.05% : 0.000090s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000400s : 1: bootstrap 0.02% : 0.000040s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.20% : 0.021167s : 1: jit_opt_a 0.09% : 0.000174s : 1: jit_opt_after_cconv 0.05% : 0.000089s : 1: jit_opt_b 0.27% : 0.000507s : 1: loop_unroll 0.68% : 0.001292s : 1: mutable_eliminate 0.71% : 0.001335s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000142s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000505s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000810s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 7.10% : 0.013429s : 1: renormalize.infer 0.64% : 0.001203s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000070s : 1: rewriter_after_opt_a 0.06% : 0.000121s : 1: rewriter_before_opt_a 0.10% : 0.000193s : 1: symbol_engine_optimizer 77.77% : 0.147013s : 1: type_inference TotalTime = 0.129763, [30] [bootstrap]: 0.0003312 [type_inference]: 0.118877 [event_method]: 2.052e-05 [auto_monad]: 6.802e-05 [graph_reusing]: 6.79999e-06 [pre_auto_parallel]: 3.00998e-06 [py_interpret_to_execute]: 0.0002844 [rewriter_before_opt_a]: 0.00010151 [expand_dump_flag]: 4.23999e-06 [jit_opt_a]: 0.00756561, [2] [Cycle 1]: 0.00338826, [27] [switch_simplify]: 6.037e-05 [loop_unroll]: 0.0001842 [a_1]: 0.00066717 [with_stream_mark]: 2.179e-05 [recompute_prepare]: 8.93002e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.81999e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 5.88998e-06 [renormalize]: 0.00203492 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.7e-05 [cse]: 3.257e-05 [replace_applicator]: 1.309e-05 [Cycle 2]: 0.00035694, [27] [switch_simplify]: 6.67002e-06 [loop_unroll]: 5.92001e-06 [a_1]: 0.00012073 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 5.92001e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.54e-06 [cse]: 1.074e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 1.22e-05 [rewriter_after_opt_a]: 3.617e-05 [convert_after_rewriter]: 6.68998e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00089133 [jit_opt_b]: 5.347e-05, [1] [Cycle 1]: 4.606e-05, [2] [frontend_op_eliminate]: 1.819e-05 [inline_after_opt_a]: 1.695e-05 [cconv]: 2.615e-05 [loop_unroll]: 0.00042407 [jit_opt_after_cconv]: 0.00014904, [1] [Cycle 1]: 0.00014279, [11] [c_1]: 2.5e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.293e-05 [call_graph_tuple_transform]: 2.087e-05 [tuple_list_get_item_eliminator]: 5.83997e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.84999e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.52e-06 [add_recomputation]: 5.051e-05 [cse_after_recomputation]: 2.154e-05, [1] [Cycle 1]: 1.645e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.466e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 4.48999e-06 [opt_after_jit_grad]: 0.00047718 [symbol_engine_optimizer]: 7.415e-05, [1] [Cycle 1]: 6.828e-05, [6] [build]: 4.01001e-06 [elim_shapecalc]: 8.16002e-06 [elim_not_effective]: 1.336e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 9.27999e-06 [renormalize]: 3.19997e-07 [validate]: 4.216e-05 Sums bootstrap : 0.000331s : 0.26% type_inference : 0.118877s : 94.88% event_method : 0.000021s : 0.02% auto_monad : 0.000068s : 0.05% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000284s : 0.23% rewriter_before_opt_a : 0.000102s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000190s : 0.15% jit_opt_a.a_1 : 0.000788s : 0.63% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002035s : 1.62% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000043s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000891s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000424s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000477s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000263 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 4: substitution.graph_param_transform 86.51% : 0.000228s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118799 2 98.45% : 0.116955s : 1: type_inference.infer 1.55% : 0.001844s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.26% : 0.000052s : 4: replace.inline 30.74% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 95.19% : 0.000225s : 4: match.inline 4.81% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000279 830 0.61% : 0.000002s : 12: predicate.accumulaten_eliminater 0.54% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.50% : 0.000001s : 12: predicate.addn_check_dump 0.64% : 0.000002s : 12: predicate.addn_zero_filter 0.84% : 0.000002s : 12: predicate.arithmetic_simplify 0.72% : 0.000002s : 12: predicate.cast_eliminate 0.24% : 0.000001s : 4: predicate.check_bprop_eliminate 0.49% : 0.000001s : 12: predicate.compare_switch_simplify 0.59% : 0.000002s : 12: predicate.depend_value_elim 0.53% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.55% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.58% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.25% : 0.000001s : 4: predicate.elim_not_effective 0.29% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.55% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.55% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.58% : 0.000002s : 12: predicate.environ_get_depend_swap 0.53% : 0.000001s : 12: predicate.environ_get_eliminate 0.50% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 4: predicate.fold_const_symbol 0.45% : 0.000001s : 8: predicate.get_grad_eliminate 0.22% : 0.000001s : 4: predicate.graph_param_transform 2.72% : 0.000008s : 26: predicate.inline 0.45% : 0.000001s : 8: predicate.inline_without_move 0.24% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.54% : 0.000002s : 8: predicate.less_batch_normalization 0.79% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 0.82% : 0.000002s : 18: predicate.load_eliminater 0.67% : 0.000002s : 4: predicate.loop_unroll_after_grad 54.52% : 0.000152s : 36: predicate.loop_unroll_before_grad 0.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.53% : 0.000001s : 12: predicate.merge_addn 0.53% : 0.000001s : 12: predicate.minmaximum_grad 0.79% : 0.000002s : 4: predicate.mutable_eliminate 0.22% : 0.000001s : 4: predicate.opt_reshape 1.09% : 0.000003s : 18: predicate.partial_eliminate 0.60% : 0.000002s : 12: predicate.print_const_string_wrapper 0.89% : 0.000002s : 12: predicate.reduce_eliminate 0.67% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.35% : 0.000001s : 8: predicate.remove_not_recompute_node 1.02% : 0.000003s : 22: predicate.replace_applicator 0.34% : 0.000001s : 8: predicate.replace_old_param 0.26% : 0.000001s : 4: predicate.reset_defer_inline 0.68% : 0.000002s : 12: predicate.reshape_eliminate 0.58% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.35% : 0.000001s : 4: predicate.row_tensor_eliminate 0.62% : 0.000002s : 12: predicate.same_eliminate 0.34% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.45% : 0.000001s : 8: predicate.special_op_eliminate 0.44% : 0.000001s : 8: predicate.specialize_transform 0.67% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.62% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.21% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.24% : 0.000003s : 18: predicate.switch_defer_inline 0.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 3.46% : 0.000010s : 58: predicate.switch_simplify 0.56% : 0.000002s : 12: predicate.tile_eliminate 0.57% : 0.000002s : 12: predicate.transpose_eliminate 0.65% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.59% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 1.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 0.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 0.78% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 0.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 1.40% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 0.81% : 0.000002s : 12: predicate.value_based_eliminate 0.16% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.31% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002330 26 74.59% : 0.001738s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.25% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.15% : 0.000540s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133036 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000071s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.26% : 0.000349s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.69% : 0.007569s : 1: jit_opt_a 0.11% : 0.000152s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.32% : 0.000431s : 1: loop_unroll 0.68% : 0.000901s : 1: mutable_eliminate 0.88% : 0.001174s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000291s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.06% : 0.001416s : 1: renormalize.infer 0.46% : 0.000610s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 89.37% : 0.118895s : 1: type_inference TotalTime = 0.0739063, [30] [bootstrap]: 0.00034624 [type_inference]: 0.0605255 [event_method]: 2.088e-05 [auto_monad]: 5.768e-05 [graph_reusing]: 4.48001e-06 [pre_auto_parallel]: 2.17001e-06 [py_interpret_to_execute]: 9.982e-05 [rewriter_before_opt_a]: 7.955e-05 [expand_dump_flag]: 2.54001e-06 [jit_opt_a]: 0.0103746, [2] [Cycle 1]: 0.00183383, [27] [switch_simplify]: 5.067e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00052325 [with_stream_mark]: 1.371e-05 [recompute_prepare]: 7.00002e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 6.33998e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 8.70001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.168e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00091599 [add_forward_monad_depend]: 5.51998e-06 [auto_monad_grad]: 1.93002e-06 [auto_monad_eliminator]: 1.203e-05 [cse]: 2.459e-05 [replace_applicator]: 1.279e-05 [Cycle 2]: 0.00032068, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.87e-06 [a_1]: 9.047e-05 [with_stream_mark]: 1.012e-05 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 4.99998e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 7.54002e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.34e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.256e-05 [replace_applicator]: 5.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.078e-05 [rewriter_after_opt_a]: 3.21e-05 [convert_after_rewriter]: 6.12001e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00053553 [jit_opt_b]: 0.00010387, [1] [Cycle 1]: 9.752e-05, [2] [frontend_op_eliminate]: 1.475e-05 [inline_after_opt_a]: 7.156e-05 [cconv]: 2.116e-05 [loop_unroll]: 0.00048825 [jit_opt_after_cconv]: 0.00014025, [1] [Cycle 1]: 0.00013409, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.202e-05 [call_graph_tuple_transform]: 1.652e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 5.24998e-06 [remove_dup_value]: 1.195e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 4.78001e-06 [add_recomputation]: 3.619e-05 [cse_after_recomputation]: 2.209e-05, [1] [Cycle 1]: 1.732e-05, [1] [cse]: 1.141e-05 [auto_monad_reorder]: 1.43e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.00998e-06 [opt_after_jit_grad]: 0.00064426 [symbol_engine_optimizer]: 0.00010075, [1] [Cycle 1]: 9.377e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 8.19002e-06 [elim_not_effective]: 3.876e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 4.19997e-07 [validate]: 3.445e-05 Sums bootstrap : 0.000346s : 0.53% type_inference : 0.060525s : 92.94% event_method : 0.000021s : 0.03% auto_monad : 0.000058s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000100s : 0.15% rewriter_before_opt_a : 0.000080s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.09% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000614s : 0.94% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000916s : 1.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000037s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000032s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000536s : 0.82% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000072s : 0.11% cconv : 0.000021s : 0.03% loop_unroll : 0.000488s : 0.75% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000644s : 0.99% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000039s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.05% Time group info: ------[substitution.] 0.000195 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 1.79% : 0.000003s : 3: substitution.graph_param_transform 85.25% : 0.000166s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000004s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 5.76% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060454 2 97.66% : 0.059038s : 1: type_inference.infer 2.34% : 0.001416s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.97% : 0.000050s : 4: replace.inline 31.03% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 94.17% : 0.000164s : 4: match.inline 5.83% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.24% : 0.000003s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000002s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.60% : 0.000001s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000762 13 46.08% : 0.000351s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.78% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.13% : 0.000374s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075763 72 0.05% : 0.000039s : 1: add_recomputation 0.08% : 0.000062s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.48% : 0.000360s : 1: bootstrap 0.03% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 13.70% : 0.010378s : 1: jit_opt_a 0.19% : 0.000143s : 1: jit_opt_after_cconv 0.14% : 0.000107s : 1: jit_opt_b 0.66% : 0.000498s : 1: loop_unroll 0.72% : 0.000544s : 1: mutable_eliminate 1.09% : 0.000822s : 26: opt.transform.jit_opt_a 0.06% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000080s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.86% : 0.000654s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000104s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 0.69% : 0.000521s : 1: renormalize.infer 0.51% : 0.000388s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.11% : 0.000084s : 1: rewriter_before_opt_a 0.14% : 0.000104s : 1: symbol_engine_optimizer 79.91% : 0.060542s : 1: type_inference TotalTime = 0.154245, [30] [bootstrap]: 0.00025106 [type_inference]: 0.12624 [event_method]: 0.00048156 [auto_monad]: 0.00010648 [graph_reusing]: 7.11999e-06 [pre_auto_parallel]: 3.81001e-06 [py_interpret_to_execute]: 8.114e-05 [rewriter_before_opt_a]: 0.00012423 [expand_dump_flag]: 3.59002e-06 [jit_opt_a]: 0.0246597, [3] [Cycle 1]: 0.0166056, [27] [switch_simplify]: 7.659e-05 [loop_unroll]: 4.455e-05 [a_1]: 0.00099493 [with_stream_mark]: 3.366e-05 [recompute_prepare]: 2.089e-05 [updatestate_depend_eliminate]: 9.51e-06 [updatestate_assign_eliminate]: 7.08998e-06 [updatestate_loads_eliminate]: 6.57002e-06 [parameter_eliminate]: 2.81999e-06 [specialize_transform]: 1.504e-05 [updatestate_useless_node_eliminater]: 1.343e-05 [accelerated_algorithm]: 1.396e-05 [meta_shard_fg_expand]: 3.47997e-06 [get_grad_eliminate_]: 1.403e-05 [merge_forward]: 8.75999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.904e-05 [j_node_and_user_rematch]: 2.558e-05 [meta_fg_expand]: 0.00187258 [replace_old_param]: 7.245e-05 [inline_without_move]: 6.378e-05 [renormalize]: 0.0125848 [add_forward_monad_depend]: 1.183e-05 [auto_monad_grad]: 6.24001e-06 [auto_monad_eliminator]: 6.536e-05 [cse]: 0.00026754 [replace_applicator]: 9.595e-05 [Cycle 2]: 0.00431442, [27] [switch_simplify]: 4.485e-05 [loop_unroll]: 4.375e-05 [a_1]: 0.00128517 [with_stream_mark]: 1.864e-05 [recompute_prepare]: 1.136e-05 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 4.70001e-06 [updatestate_loads_eliminate]: 4.45e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 8.59e-06 [updatestate_useless_node_eliminater]: 8.20999e-06 [accelerated_algorithm]: 8.77999e-06 [meta_shard_fg_expand]: 3.04001e-06 [get_grad_eliminate_]: 7.7e-06 [merge_forward]: 5.17e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.883e-05 [j_node_and_user_rematch]: 1.388e-05 [meta_fg_expand]: 0.0001091 [replace_old_param]: 1.027e-05 [inline_without_move]: 8.30999e-06 [renormalize]: 0.00244474 [add_forward_monad_depend]: 6.67002e-06 [auto_monad_grad]: 1.98002e-06 [auto_monad_eliminator]: 1.291e-05 [cse]: 2.625e-05 [replace_applicator]: 1.664e-05 [Cycle 3]: 0.00025463, [27] [switch_simplify]: 4.20999e-06 [loop_unroll]: 3.66001e-06 [a_1]: 4.241e-05 [with_stream_mark]: 1.051e-05 [recompute_prepare]: 3.56999e-06 [updatestate_depend_eliminate]: 2.27999e-06 [updatestate_assign_eliminate]: 1.75001e-06 [updatestate_loads_eliminate]: 1.71002e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 3.85e-06 [updatestate_useless_node_eliminater]: 3.58e-06 [accelerated_algorithm]: 3.43e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 3.57002e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 2.03002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.209e-05 [j_node_and_user_rematch]: 5.81e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 3.06001e-06 [inline_without_move]: 2.96001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 3.44001e-06 [cse]: 7.78001e-06 [replace_applicator]: 3.55003e-06 [py_interpret_to_execute_after_opt_a]: 1.431e-05 [rewriter_after_opt_a]: 3.563e-05 [convert_after_rewriter]: 5.84999e-06 [order_py_execute_after_rewriter]: 4.26001e-06 [mutable_eliminate]: 0.00077085 [jit_opt_b]: 4.292e-05, [1] [Cycle 1]: 3.551e-05, [2] [frontend_op_eliminate]: 1.037e-05 [inline_after_opt_a]: 1.212e-05 [cconv]: 2.77e-05 [loop_unroll]: 0.00042391 [jit_opt_after_cconv]: 0.0001311, [1] [Cycle 1]: 0.00012435, [11] [c_1]: 1.221e-05 [parameter_eliminate]: 2.63998e-06 [updatestate_depend_eliminate]: 5.82001e-06 [updatestate_assign_eliminate]: 1.89e-06 [updatestate_loads_eliminate]: 1.74e-06 [cse]: 2.249e-05 [call_graph_tuple_transform]: 1.42e-05 [tuple_list_get_item_eliminator]: 3.73001e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 1.03001e-06 [switch_simplify]: 3.93999e-06 [remove_dup_value]: 1.364e-05 [partial_unused_args_eliminate]: 2.98e-06 [environ_conv]: 5.59e-06 [add_recomputation]: 3.741e-05 [cse_after_recomputation]: 1.943e-05, [1] [Cycle 1]: 1.426e-05, [1] [cse]: 7.98001e-06 [auto_monad_reorder]: 1.294e-05 [get_jit_bprop_graph]: 1.78002e-06 [rewriter_after_jit_bprop_graph]: 5.66e-06 [opt_after_jit_grad]: 0.00042955 [symbol_engine_optimizer]: 6.711e-05, [1] [Cycle 1]: 6.105e-05, [6] [build]: 3.65998e-06 [elim_shapecalc]: 5.42999e-06 [elim_not_effective]: 1.106e-05 [opt_reshape]: 5.05999e-06 [fold_const_symbol]: 7.23e-06 [renormalize]: 3.59985e-07 [validate]: 3.25e-05 Sums bootstrap : 0.000251s : 0.17% type_inference : 0.126240s : 84.22% event_method : 0.000482s : 0.32% auto_monad : 0.000106s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000081s : 0.05% rewriter_before_opt_a : 0.000124s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000092s : 0.06% jit_opt_a.a_1 : 0.002323s : 1.55% jit_opt_a.with_stream_mark : 0.000063s : 0.04% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000027s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.001983s : 1.32% jit_opt_a.replace_old_param : 0.000086s : 0.06% jit_opt_a.inline_without_move : 0.000075s : 0.05% jit_opt_a.renormalize : 0.015030s : 10.03% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.05% jit_opt_a.cse : 0.000302s : 0.20% jit_opt_a.replace_applicator : 0.000116s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000771s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000424s : 0.28% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000037s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000430s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.02% Time group info: ------[substitution.] 0.000636 107 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.72% : 0.000005s : 1: substitution.graph_param_transform 67.88% : 0.000432s : 13: substitution.inline 2.84% : 0.000018s : 2: substitution.inline_without_move 1.58% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.86% : 0.000012s : 7: substitution.minmaximum_grad 1.22% : 0.000008s : 5: substitution.partial_eliminate 1.72% : 0.000011s : 13: substitution.remove_not_recompute_node 5.23% : 0.000033s : 10: substitution.replace_applicator 1.04% : 0.000007s : 10: substitution.replace_old_param 1.00% : 0.000006s : 1: substitution.reshape_eliminate 0.46% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.88% : 0.000006s : 1: substitution.tile_eliminate 3.64% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.60% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.89% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126145 2 97.54% : 0.123039s : 1: type_inference.infer 2.46% : 0.003106s : 1: type_inference.specialize ------[replace.] 0.000182 20 66.55% : 0.000121s : 13: replace.inline 33.45% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000445 20 95.12% : 0.000423s : 13: match.inline 4.88% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000386 2656 1.74% : 0.000007s : 46: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.43% : 0.000006s : 46: predicate.addn_check_dump 1.57% : 0.000006s : 46: predicate.addn_zero_filter 2.05% : 0.000008s : 46: predicate.arithmetic_simplify 1.63% : 0.000006s : 46: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000006s : 46: predicate.compare_switch_simplify 1.48% : 0.000006s : 46: predicate.depend_value_elim 1.48% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.54% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.04% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.57% : 0.000006s : 46: predicate.environ_get_depend_swap 1.55% : 0.000006s : 46: predicate.environ_get_eliminate 1.47% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.92% : 0.000004s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.39% : 0.000017s : 68: predicate.inline 2.02% : 0.000008s : 47: predicate.inline_without_move 0.38% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.00% : 0.000004s : 19: predicate.less_batch_normalization 1.94% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.91% : 0.000007s : 54: predicate.load_eliminater 0.36% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.32% : 0.000013s : 94: predicate.loop_unroll_before_grad 1.85% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.39% : 0.000005s : 46: predicate.merge_addn 1.47% : 0.000006s : 46: predicate.minmaximum_grad 0.55% : 0.000002s : 1: predicate.mutable_eliminate 0.15% : 0.000001s : 1: predicate.opt_reshape 2.33% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 46: predicate.print_const_string_wrapper 2.27% : 0.000009s : 46: predicate.reduce_eliminate 1.82% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 19: predicate.remove_not_recompute_node 2.70% : 0.000010s : 100: predicate.replace_applicator 1.21% : 0.000005s : 47: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000006s : 46: predicate.reshape_eliminate 1.64% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.12% : 0.000000s : 1: predicate.row_tensor_eliminate 1.61% : 0.000006s : 46: predicate.same_eliminate 0.47% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 19: predicate.specialize_transform 1.82% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.59% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.80% : 0.000011s : 66: predicate.switch_defer_inline 2.65% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.34% : 0.000024s : 161: predicate.switch_simplify 1.57% : 0.000006s : 46: predicate.tile_eliminate 1.56% : 0.000006s : 46: predicate.transpose_eliminate 1.94% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.74% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.79% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.77% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.77% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.77% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.81% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003895 45 77.04% : 0.003001s : 28: func_graph_cloner_run.FuncGraphClonerGraph 22.96% : 0.000894s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.172286 87 0.02% : 0.000040s : 1: add_recomputation 0.07% : 0.000113s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.16% : 0.000275s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.28% : 0.000490s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.32% : 0.024664s : 1: jit_opt_a 0.08% : 0.000134s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.25% : 0.000432s : 1: loop_unroll 0.45% : 0.000781s : 1: mutable_eliminate 1.75% : 0.003011s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000438s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000085s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.42% : 0.012789s : 2: renormalize.infer 1.29% : 0.002219s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000128s : 1: rewriter_before_opt_a 0.04% : 0.000069s : 1: symbol_engine_optimizer 73.29% : 0.126264s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.352.311 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d9d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.352.953 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0891239, [30] [bootstrap]: 0.00028533 [type_inference]: 0.0630523 [event_method]: 0.00027866 [auto_monad]: 0.00010787 [graph_reusing]: 7.75998e-06 [pre_auto_parallel]: 3.78001e-06 [py_interpret_to_execute]: 3.271e-05 [rewriter_before_opt_a]: 0.00012312 [expand_dump_flag]: 3.62002e-06 [jit_opt_a]: 0.0229408, [3] [Cycle 1]: 0.015492, [27] [switch_simplify]: 8.187e-05 [loop_unroll]: 5.318e-05 [a_1]: 0.00103932 [with_stream_mark]: 3.226e-05 [recompute_prepare]: 2.302e-05 [updatestate_depend_eliminate]: 9.14e-06 [updatestate_assign_eliminate]: 6.86999e-06 [updatestate_loads_eliminate]: 6.52001e-06 [parameter_eliminate]: 3.40998e-06 [specialize_transform]: 1.523e-05 [updatestate_useless_node_eliminater]: 1.371e-05 [accelerated_algorithm]: 1.46e-05 [meta_shard_fg_expand]: 3.33e-06 [get_grad_eliminate_]: 1.415e-05 [merge_forward]: 8.89e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.814e-05 [j_node_and_user_rematch]: 2.492e-05 [meta_fg_expand]: 0.00170621 [replace_old_param]: 6.683e-05 [inline_without_move]: 6.036e-05 [renormalize]: 0.0116043 [add_forward_monad_depend]: 1.25e-05 [auto_monad_grad]: 6.74999e-06 [auto_monad_eliminator]: 6.199e-05 [cse]: 0.00025856 [replace_applicator]: 9.017e-05 [Cycle 2]: 0.00373649, [27] [switch_simplify]: 4.405e-05 [loop_unroll]: 4.399e-05 [a_1]: 0.00124838 [with_stream_mark]: 1.621e-05 [recompute_prepare]: 1.006e-05 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 4.05e-06 [updatestate_loads_eliminate]: 4.23999e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 8.47998e-06 [updatestate_useless_node_eliminater]: 7.88001e-06 [accelerated_algorithm]: 8.63001e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 7.6e-06 [merge_forward]: 4.68001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.873e-05 [j_node_and_user_rematch]: 1.315e-05 [meta_fg_expand]: 9.837e-05 [replace_old_param]: 9.59999e-06 [inline_without_move]: 8.01001e-06 [renormalize]: 0.00194826 [add_forward_monad_depend]: 5.91998e-06 [auto_monad_grad]: 1.86e-06 [auto_monad_eliminator]: 1.093e-05 [cse]: 2.112e-05 [replace_applicator]: 1.241e-05 [Cycle 3]: 0.00025054, [27] [switch_simplify]: 4.43999e-06 [loop_unroll]: 3.49001e-06 [a_1]: 4.003e-05 [with_stream_mark]: 9.84999e-06 [recompute_prepare]: 3.85998e-06 [updatestate_depend_eliminate]: 2.44001e-06 [updatestate_assign_eliminate]: 1.64998e-06 [updatestate_loads_eliminate]: 1.45001e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 3.55e-06 [updatestate_useless_node_eliminater]: 3.19001e-06 [accelerated_algorithm]: 3.16001e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 3.04001e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.059e-05 [j_node_and_user_rematch]: 6.01e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 3.23998e-06 [inline_without_move]: 3.25998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 3.8e-06 [cse]: 8.92999e-06 [replace_applicator]: 3.46999e-06 [py_interpret_to_execute_after_opt_a]: 1.099e-05 [rewriter_after_opt_a]: 3.373e-05 [convert_after_rewriter]: 6.02999e-06 [order_py_execute_after_rewriter]: 4.4e-06 [mutable_eliminate]: 0.00067768 [jit_opt_b]: 4.152e-05, [1] [Cycle 1]: 3.379e-05, [2] [frontend_op_eliminate]: 1.096e-05 [inline_after_opt_a]: 1.132e-05 [cconv]: 2.626e-05 [loop_unroll]: 0.00048449 [jit_opt_after_cconv]: 0.00013844, [1] [Cycle 1]: 0.00013097, [11] [c_1]: 1.491e-05 [parameter_eliminate]: 2.98998e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 1.91e-06 [updatestate_loads_eliminate]: 1.74e-06 [cse]: 2.263e-05 [call_graph_tuple_transform]: 1.478e-05 [tuple_list_get_item_eliminator]: 3.68999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 3.63e-06 [remove_dup_value]: 1.328e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 5.84e-06 [add_recomputation]: 3.758e-05 [cse_after_recomputation]: 1.987e-05, [1] [Cycle 1]: 1.436e-05, [1] [cse]: 7.69002e-06 [auto_monad_reorder]: 1.313e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.00002e-06 [opt_after_jit_grad]: 0.00046983 [symbol_engine_optimizer]: 6.731e-05, [1] [Cycle 1]: 6.143e-05, [6] [build]: 4e-06 [elim_shapecalc]: 6.09001e-06 [elim_not_effective]: 1.048e-05 [opt_reshape]: 3.83001e-06 [fold_const_symbol]: 6.67002e-06 [renormalize]: 3.39991e-07 [validate]: 3.424e-05 Sums bootstrap : 0.000285s : 0.34% type_inference : 0.063052s : 74.35% event_method : 0.000279s : 0.33% auto_monad : 0.000108s : 0.13% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000033s : 0.04% rewriter_before_opt_a : 0.000123s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.15% jit_opt_a.loop_unroll : 0.000101s : 0.12% jit_opt_a.a_1 : 0.002328s : 2.74% jit_opt_a.with_stream_mark : 0.000058s : 0.07% jit_opt_a.recompute_prepare : 0.000037s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.05% jit_opt_a.meta_fg_expand : 0.001806s : 2.13% jit_opt_a.replace_old_param : 0.000080s : 0.09% jit_opt_a.inline_without_move : 0.000072s : 0.08% jit_opt_a.renormalize : 0.013553s : 15.98% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000077s : 0.09% jit_opt_a.cse : 0.000289s : 0.34% jit_opt_a.replace_applicator : 0.000106s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000678s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000026s : 0.03% loop_unroll : 0.000484s : 0.57% jit_opt_after_cconv.c_1 : 0.000015s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000038s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000470s : 0.55% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.04% Time group info: ------[substitution.] 0.000585 107 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.28% : 0.000002s : 1: substitution.fold_const_symbol 0.74% : 0.000004s : 1: substitution.graph_param_transform 66.27% : 0.000388s : 13: substitution.inline 2.91% : 0.000017s : 2: substitution.inline_without_move 1.61% : 0.000009s : 13: substitution.j_node_and_user_rematch 2.01% : 0.000012s : 7: substitution.minmaximum_grad 1.23% : 0.000007s : 5: substitution.partial_eliminate 1.81% : 0.000011s : 13: substitution.remove_not_recompute_node 5.21% : 0.000030s : 10: substitution.replace_applicator 1.12% : 0.000007s : 10: substitution.replace_old_param 1.32% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.91% : 0.000005s : 1: substitution.tile_eliminate 3.80% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.62% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.47% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062958 2 96.39% : 0.060684s : 1: type_inference.infer 3.61% : 0.002274s : 1: type_inference.specialize ------[replace.] 0.000179 20 66.25% : 0.000118s : 13: replace.inline 33.75% : 0.000060s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000402 20 94.52% : 0.000380s : 13: match.inline 5.48% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000397 2768 1.54% : 0.000006s : 48: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.48% : 0.000006s : 48: predicate.addn_check_dump 1.69% : 0.000007s : 48: predicate.addn_zero_filter 1.96% : 0.000008s : 48: predicate.arithmetic_simplify 1.80% : 0.000007s : 48: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.52% : 0.000006s : 48: predicate.compare_switch_simplify 1.51% : 0.000006s : 48: predicate.depend_value_elim 1.41% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.47% : 0.000006s : 48: predicate.environ_get_depend_swap 1.60% : 0.000006s : 48: predicate.environ_get_eliminate 1.54% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 20: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.14% : 0.000016s : 70: predicate.inline 1.98% : 0.000008s : 48: predicate.inline_without_move 0.38% : 0.000001s : 20: predicate.j_node_and_user_rematch 0.99% : 0.000004s : 20: predicate.less_batch_normalization 1.88% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.94% : 0.000008s : 56: predicate.load_eliminater 0.27% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.67% : 0.000015s : 101: predicate.loop_unroll_before_grad 1.80% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 48: predicate.merge_addn 1.50% : 0.000006s : 48: predicate.minmaximum_grad 0.41% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.32% : 0.000009s : 56: predicate.partial_eliminate 1.53% : 0.000006s : 48: predicate.print_const_string_wrapper 2.11% : 0.000008s : 48: predicate.reduce_eliminate 1.80% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 20: predicate.remove_not_recompute_node 2.83% : 0.000011s : 103: predicate.replace_applicator 1.12% : 0.000004s : 48: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.53% : 0.000006s : 48: predicate.reshape_eliminate 1.64% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000006s : 48: predicate.same_eliminate 0.51% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 20: predicate.specialize_transform 1.70% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.79% : 0.000011s : 68: predicate.switch_defer_inline 2.54% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.61% : 0.000026s : 170: predicate.switch_simplify 1.58% : 0.000006s : 48: predicate.tile_eliminate 1.54% : 0.000006s : 48: predicate.transpose_eliminate 1.89% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.08% : 0.000012s : 57: predicate.tuple_list_get_item_eliminator 1.98% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 2.15% : 0.000009s : 55: predicate.tuple_to_list_eliminator_ 1.79% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.81% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.17% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003534 46 75.59% : 0.002672s : 29: func_graph_cloner_run.FuncGraphClonerGraph 24.41% : 0.000863s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.105748 87 0.04% : 0.000040s : 1: add_recomputation 0.11% : 0.000115s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.29% : 0.000308s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.27% : 0.000287s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 21.70% : 0.022945s : 1: jit_opt_a 0.13% : 0.000141s : 1: jit_opt_after_cconv 0.04% : 0.000044s : 1: jit_opt_b 0.47% : 0.000494s : 1: loop_unroll 0.65% : 0.000687s : 1: mutable_eliminate 2.85% : 0.003010s : 39: opt.transform.jit_opt_a 0.03% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000016s : 4: opt.transform.jit_opt_b 0.07% : 0.000073s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000035s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 10.77% : 0.011390s : 2: renormalize.infer 2.03% : 0.002143s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.12% : 0.000126s : 1: rewriter_before_opt_a 0.07% : 0.000070s : 1: symbol_engine_optimizer 59.64% : 0.063072s : 1: type_inference TotalTime = 0.101051, [30] [bootstrap]: 0.00028804 [type_inference]: 0.0341439 [event_method]: 2.146e-05 [auto_monad]: 6.919e-05 [graph_reusing]: 6.25002e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 0.00010558 [rewriter_before_opt_a]: 8.361e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.0639954, [2] [Cycle 1]: 0.0600083, [27] [switch_simplify]: 6.075e-05 [loop_unroll]: 3.144e-05 [a_1]: 0.00058035 [with_stream_mark]: 2.44e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 0.058921 [add_forward_monad_depend]: 1.052e-05 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.851e-05 [cse]: 3.721e-05 [replace_applicator]: 2.413e-05 [Cycle 2]: 0.00035158, [27] [switch_simplify]: 7.24001e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.717e-05 [with_stream_mark]: 1.551e-05 [recompute_prepare]: 5.35001e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 5.42001e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 3.89002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.841e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 5.39e-06 [cse]: 1.26e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.532e-05 [rewriter_after_opt_a]: 4.075e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 4.67e-06 [mutable_eliminate]: 0.0007362 [jit_opt_b]: 4.903e-05, [1] [Cycle 1]: 4.135e-05, [2] [frontend_op_eliminate]: 1.475e-05 [inline_after_opt_a]: 1.601e-05 [cconv]: 4.191e-05 [loop_unroll]: 0.00042373 [jit_opt_after_cconv]: 0.00014293, [1] [Cycle 1]: 0.00013663, [11] [c_1]: 2.068e-05 [parameter_eliminate]: 3.12002e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.308e-05 [call_graph_tuple_transform]: 1.875e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.17999e-06 [remove_dup_value]: 1.705e-05 [partial_unused_args_eliminate]: 1.93997e-06 [environ_conv]: 6.19999e-06 [add_recomputation]: 4.991e-05 [cse_after_recomputation]: 2.418e-05, [1] [Cycle 1]: 1.871e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.853e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00043621 [symbol_engine_optimizer]: 7.129e-05, [1] [Cycle 1]: 6.508e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.271e-05 [opt_reshape]: 6.04999e-06 [fold_const_symbol]: 8.38999e-06 [renormalize]: 3.50003e-07 [validate]: 3.829e-05 Sums bootstrap : 0.000288s : 0.30% type_inference : 0.034144s : 35.28% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000106s : 0.11% rewriter_before_opt_a : 0.000084s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.07% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000678s : 0.70% jit_opt_a.with_stream_mark : 0.000040s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.058921s : 60.88% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000050s : 0.05% jit_opt_a.replace_applicator : 0.000029s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000736s : 0.76% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000042s : 0.04% loop_unroll : 0.000424s : 0.44% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000436s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000242 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 84.71% : 0.000205s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.33% : 0.000006s : 2: substitution.replace_old_param 5.29% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034068 2 95.45% : 0.032518s : 1: type_inference.infer 4.55% : 0.001550s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.22% : 0.000049s : 4: replace.inline 31.78% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.54% : 0.000203s : 4: match.inline 5.46% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.32% : 0.000002s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.47% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.31% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.72% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000970 13 41.77% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.49% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.74% : 0.000511s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160933 72 0.04% : 0.000067s : 1: add_recomputation 0.05% : 0.000073s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.19% : 0.000308s : 1: bootstrap 0.03% : 0.000045s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 39.77% : 0.063999s : 1: jit_opt_a 0.09% : 0.000145s : 1: jit_opt_after_cconv 0.03% : 0.000051s : 1: jit_opt_b 0.27% : 0.000433s : 1: loop_unroll 0.46% : 0.000745s : 1: mutable_eliminate 0.57% : 0.000918s : 26: opt.transform.jit_opt_a 0.03% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000444s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000109s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 36.26% : 0.058362s : 1: renormalize.infer 0.34% : 0.000545s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000087s : 1: rewriter_before_opt_a 0.05% : 0.000074s : 1: symbol_engine_optimizer 21.23% : 0.034166s : 1: type_inference TotalTime = 0.0398256, [30] [bootstrap]: 0.00042201 [type_inference]: 0.0171627 [event_method]: 2.244e-05 [auto_monad]: 7.366e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 4.556e-05 [rewriter_before_opt_a]: 8.633e-05 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.0120195, [2] [Cycle 1]: 0.00528654, [27] [switch_simplify]: 6.508e-05 [loop_unroll]: 3.355e-05 [a_1]: 0.00251314 [with_stream_mark]: 2.296e-05 [recompute_prepare]: 9.89001e-06 [updatestate_depend_eliminate]: 4.89998e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.13998e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 2.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.688e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00223903 [add_forward_monad_depend]: 7.45998e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.739e-05 [cse]: 4.006e-05 [replace_applicator]: 1.719e-05 [Cycle 2]: 0.00034232, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.36998e-06 [a_1]: 0.00010405 [with_stream_mark]: 1.232e-05 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.211e-05 [j_node_and_user_rematch]: 7.64002e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.41001e-06 [inline_without_move]: 4.87e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.255e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 1.479e-05 [rewriter_after_opt_a]: 4.011e-05 [convert_after_rewriter]: 7.75998e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00802354 [jit_opt_b]: 6.375e-05, [1] [Cycle 1]: 5.399e-05, [2] [frontend_op_eliminate]: 1.909e-05 [inline_after_opt_a]: 2.089e-05 [cconv]: 3.085e-05 [loop_unroll]: 0.00067536 [jit_opt_after_cconv]: 0.00018409, [1] [Cycle 1]: 0.00017724, [11] [c_1]: 2.178e-05 [parameter_eliminate]: 3.64002e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 4.013e-05 [call_graph_tuple_transform]: 3.283e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 6.79999e-06 [remove_dup_value]: 1.694e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 6.74001e-06 [add_recomputation]: 5.279e-05 [cse_after_recomputation]: 2.425e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.294e-05 [auto_monad_reorder]: 1.819e-05 [get_jit_bprop_graph]: 3.06001e-06 [rewriter_after_jit_bprop_graph]: 8.23001e-06 [opt_after_jit_grad]: 0.00049223 [symbol_engine_optimizer]: 7.296e-05, [1] [Cycle 1]: 6.678e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.47998e-06 [renormalize]: 4.30009e-07 [validate]: 4.388e-05 Sums bootstrap : 0.000422s : 1.29% type_inference : 0.017163s : 52.36% event_method : 0.000022s : 0.07% auto_monad : 0.000074s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000046s : 0.14% rewriter_before_opt_a : 0.000086s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.22% jit_opt_a.loop_unroll : 0.000039s : 0.12% jit_opt_a.a_1 : 0.002617s : 7.99% jit_opt_a.with_stream_mark : 0.000035s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.002239s : 6.83% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.07% jit_opt_a.cse : 0.000053s : 0.16% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.008024s : 24.48% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000031s : 0.09% loop_unroll : 0.000675s : 2.06% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000040s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000492s : 1.50% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.13% Time group info: ------[substitution.] 0.000259 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 3: substitution.graph_param_transform 79.92% : 0.000207s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.85% : 0.000015s : 3: substitution.reduce_eliminate 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 4.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017074 2 93.84% : 0.016023s : 1: type_inference.infer 6.16% : 0.001052s : 1: type_inference.specialize ------[replace.] 0.000118 7 53.20% : 0.000063s : 5: replace.inline 46.80% : 0.000055s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 94.60% : 0.000204s : 5: match.inline 5.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 747 1.20% : 0.000002s : 11: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 11: predicate.addn_check_dump 3.05% : 0.000004s : 11: predicate.addn_zero_filter 2.14% : 0.000003s : 11: predicate.arithmetic_simplify 1.20% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 11: predicate.compare_switch_simplify 1.35% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.03% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 11: predicate.environ_get_depend_swap 1.08% : 0.000002s : 11: predicate.environ_get_eliminate 0.96% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 6.01% : 0.000008s : 24: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 1.26% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.72% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 11: predicate.merge_addn 0.98% : 0.000001s : 11: predicate.minmaximum_grad 3.36% : 0.000005s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 2.23% : 0.000003s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000001s : 3: predicate.reset_defer_inline 1.71% : 0.000002s : 11: predicate.reshape_eliminate 1.26% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.80% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.88% : 0.000004s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000011s : 59: predicate.switch_simplify 1.15% : 0.000002s : 11: predicate.tile_eliminate 1.36% : 0.000002s : 11: predicate.transpose_eliminate 1.22% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.49% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000900 16 54.90% : 0.000494s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.39% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.71% : 0.000348s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044997 72 0.12% : 0.000056s : 1: add_recomputation 0.17% : 0.000077s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.98% : 0.000442s : 1: bootstrap 0.07% : 0.000033s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 26.72% : 0.012024s : 1: jit_opt_a 0.42% : 0.000187s : 1: jit_opt_after_cconv 0.15% : 0.000067s : 1: jit_opt_b 1.52% : 0.000683s : 1: loop_unroll 17.87% : 0.008043s : 1: mutable_eliminate 6.33% : 0.002849s : 26: opt.transform.jit_opt_a 0.14% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000034s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.11% : 0.000500s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000048s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 4.16% : 0.001871s : 1: renormalize.infer 0.79% : 0.000354s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000043s : 1: rewriter_after_opt_a 0.20% : 0.000090s : 1: rewriter_before_opt_a 0.17% : 0.000076s : 1: symbol_engine_optimizer 38.19% : 0.017182s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.454.182 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004db80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.454.788 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0462906, [30] [bootstrap]: 0.00023454 [type_inference]: 0.0247265 [event_method]: 6.682e-05 [auto_monad]: 0.00010645 [graph_reusing]: 6.82002e-06 [pre_auto_parallel]: 2.97002e-06 [py_interpret_to_execute]: 3.162e-05 [rewriter_before_opt_a]: 0.00010605 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.0186777, [3] [Cycle 1]: 0.0087707, [27] [switch_simplify]: 7.991e-05 [loop_unroll]: 8.922e-05 [a_1]: 0.00094851 [with_stream_mark]: 3.226e-05 [recompute_prepare]: 1.912e-05 [updatestate_depend_eliminate]: 9.00999e-06 [updatestate_assign_eliminate]: 6.87002e-06 [updatestate_loads_eliminate]: 6.78e-06 [parameter_eliminate]: 2.84001e-06 [specialize_transform]: 1.946e-05 [updatestate_useless_node_eliminater]: 1.317e-05 [accelerated_algorithm]: 1.267e-05 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 1.235e-05 [merge_forward]: 9.96998e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.655e-05 [j_node_and_user_rematch]: 2.368e-05 [meta_fg_expand]: 0.00186705 [replace_old_param]: 7.174e-05 [inline_without_move]: 6.414e-05 [renormalize]: 0.0047842 [add_forward_monad_depend]: 1.481e-05 [auto_monad_grad]: 6.37001e-06 [auto_monad_eliminator]: 6.257e-05 [cse]: 0.00023336 [replace_applicator]: 8.554e-05 [Cycle 2]: 0.00476035, [27] [switch_simplify]: 4.042e-05 [loop_unroll]: 3.982e-05 [a_1]: 0.0011768 [with_stream_mark]: 2.034e-05 [recompute_prepare]: 1.156e-05 [updatestate_depend_eliminate]: 5.76998e-06 [updatestate_assign_eliminate]: 4.05e-06 [updatestate_loads_eliminate]: 3.83999e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 8.67e-06 [updatestate_useless_node_eliminater]: 8.32e-06 [accelerated_algorithm]: 8.53001e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 7.6e-06 [merge_forward]: 5.31002e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.095e-05 [j_node_and_user_rematch]: 1.427e-05 [meta_fg_expand]: 0.00011883 [replace_old_param]: 9.51003e-06 [inline_without_move]: 8.35001e-06 [renormalize]: 0.00191677 [add_forward_monad_depend]: 8.17e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.349e-05 [cse]: 0.00107633 [replace_applicator]: 2.085e-05 [Cycle 3]: 0.00028359, [27] [switch_simplify]: 4.97999e-06 [loop_unroll]: 4.18001e-06 [a_1]: 4.747e-05 [with_stream_mark]: 1.517e-05 [recompute_prepare]: 3.61001e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.21998e-06 [updatestate_loads_eliminate]: 1.84e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 4.14002e-06 [updatestate_useless_node_eliminater]: 3.7e-06 [accelerated_algorithm]: 3.98999e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 3.14999e-06 [merge_forward]: 3.50998e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 5.73002e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 3.10998e-06 [inline_without_move]: 3.13e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.72001e-06 [auto_monad_grad]: 1.56998e-06 [auto_monad_eliminator]: 5.49e-06 [cse]: 1.094e-05 [replace_applicator]: 3.51001e-06 [py_interpret_to_execute_after_opt_a]: 1.39e-05 [rewriter_after_opt_a]: 3.818e-05 [convert_after_rewriter]: 6.49999e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00075475 [jit_opt_b]: 4.368e-05, [1] [Cycle 1]: 3.596e-05, [2] [frontend_op_eliminate]: 1.146e-05 [inline_after_opt_a]: 1.268e-05 [cconv]: 2.843e-05 [loop_unroll]: 0.00042908 [jit_opt_after_cconv]: 0.0001422, [1] [Cycle 1]: 0.00013552, [11] [c_1]: 1.179e-05 [parameter_eliminate]: 2.83998e-06 [updatestate_depend_eliminate]: 6.06998e-06 [updatestate_assign_eliminate]: 1.59e-06 [updatestate_loads_eliminate]: 1.55001e-06 [cse]: 1.843e-05 [call_graph_tuple_transform]: 1.403e-05 [tuple_list_get_item_eliminator]: 4.05e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 4.03999e-06 [remove_dup_value]: 1.557e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 5.06002e-06 [add_recomputation]: 3.691e-05 [cse_after_recomputation]: 2.195e-05, [1] [Cycle 1]: 1.684e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.387e-05 [get_jit_bprop_graph]: 2.11998e-06 [rewriter_after_jit_bprop_graph]: 5.09998e-06 [opt_after_jit_grad]: 0.00046012 [symbol_engine_optimizer]: 7.189e-05, [1] [Cycle 1]: 6.503e-05, [6] [build]: 3.71999e-06 [elim_shapecalc]: 6.56e-06 [elim_not_effective]: 1.07e-05 [opt_reshape]: 5.06002e-06 [fold_const_symbol]: 6.70002e-06 [renormalize]: 4.80009e-07 [validate]: 3.883e-05 Sums bootstrap : 0.000235s : 0.58% type_inference : 0.024727s : 61.06% event_method : 0.000067s : 0.16% auto_monad : 0.000106s : 0.26% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000032s : 0.08% rewriter_before_opt_a : 0.000106s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000125s : 0.31% jit_opt_a.loop_unroll : 0.000133s : 0.33% jit_opt_a.a_1 : 0.002173s : 5.37% jit_opt_a.with_stream_mark : 0.000068s : 0.17% jit_opt_a.recompute_prepare : 0.000034s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000032s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.06% jit_opt_a.accelerated_algorithm : 0.000025s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000019s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.11% jit_opt_a.meta_fg_expand : 0.001988s : 4.91% jit_opt_a.replace_old_param : 0.000084s : 0.21% jit_opt_a.inline_without_move : 0.000076s : 0.19% jit_opt_a.renormalize : 0.006701s : 16.55% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.20% jit_opt_a.cse : 0.001321s : 3.26% jit_opt_a.replace_applicator : 0.000110s : 0.27% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000038s : 0.09% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000755s : 1.86% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.03% jit_opt_b.inline_after_opt_a : 0.000013s : 0.03% cconv : 0.000028s : 0.07% loop_unroll : 0.000429s : 1.06% jit_opt_after_cconv.c_1 : 0.000012s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.09% cse_after_recomputation.cse : 0.000010s : 0.03% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000460s : 1.14% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.10% Time group info: ------[substitution.] 0.000583 105 0.30% : 0.000002s : 1: substitution.elim_not_effective 0.25% : 0.000001s : 1: substitution.fold_const_symbol 0.80% : 0.000005s : 1: substitution.graph_param_transform 64.25% : 0.000375s : 13: substitution.inline 3.74% : 0.000022s : 2: substitution.inline_without_move 1.68% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.07% : 0.000012s : 7: substitution.minmaximum_grad 1.17% : 0.000007s : 5: substitution.partial_eliminate 2.12% : 0.000012s : 13: substitution.remove_not_recompute_node 5.36% : 0.000031s : 10: substitution.replace_applicator 1.17% : 0.000007s : 8: substitution.replace_old_param 1.12% : 0.000007s : 1: substitution.reshape_eliminate 0.43% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.05% : 0.000006s : 1: substitution.tile_eliminate 3.97% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.71% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.80% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024628 2 93.95% : 0.023137s : 1: type_inference.infer 6.05% : 0.001491s : 1: type_inference.specialize ------[replace.] 0.000176 20 66.53% : 0.000117s : 13: replace.inline 33.47% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000391 20 94.02% : 0.000368s : 13: match.inline 5.98% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000387 2537 1.64% : 0.000006s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.36% : 0.000005s : 44: predicate.addn_check_dump 1.57% : 0.000006s : 44: predicate.addn_zero_filter 2.12% : 0.000008s : 44: predicate.arithmetic_simplify 1.58% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.37% : 0.000005s : 44: predicate.compare_switch_simplify 1.46% : 0.000006s : 44: predicate.depend_value_elim 1.44% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.58% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.60% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.45% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.56% : 0.000006s : 44: predicate.environ_get_depend_swap 1.47% : 0.000006s : 44: predicate.environ_get_eliminate 1.52% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.78% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.08% : 0.000016s : 66: predicate.inline 2.11% : 0.000008s : 42: predicate.inline_without_move 0.41% : 0.000002s : 18: predicate.j_node_and_user_rematch 1.08% : 0.000004s : 18: predicate.less_batch_normalization 2.03% : 0.000008s : 51: predicate.list_to_tuple_eliminator_ 1.94% : 0.000008s : 52: predicate.load_eliminater 0.31% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.46% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.39% : 0.000005s : 44: predicate.merge_addn 1.57% : 0.000006s : 44: predicate.minmaximum_grad 0.39% : 0.000002s : 1: predicate.mutable_eliminate 0.13% : 0.000001s : 1: predicate.opt_reshape 2.20% : 0.000009s : 52: predicate.partial_eliminate 1.45% : 0.000006s : 44: predicate.print_const_string_wrapper 2.00% : 0.000008s : 44: predicate.reduce_eliminate 1.87% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000002s : 18: predicate.remove_not_recompute_node 2.56% : 0.000010s : 94: predicate.replace_applicator 1.07% : 0.000004s : 42: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.55% : 0.000006s : 44: predicate.reshape_eliminate 1.47% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.45% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 2: predicate.special_op_eliminate 2.17% : 0.000008s : 18: predicate.specialize_transform 1.85% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.72% : 0.000007s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.79% : 0.000011s : 64: predicate.switch_defer_inline 2.45% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.29% : 0.000024s : 154: predicate.switch_simplify 1.49% : 0.000006s : 44: predicate.tile_eliminate 1.56% : 0.000006s : 44: predicate.transpose_eliminate 1.88% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.80% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.76% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.60% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 2.04% : 0.000008s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.18% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002129 32 58.50% : 0.001245s : 15: func_graph_cloner_run.FuncGraphClonerGraph 41.50% : 0.000884s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055880 87 0.07% : 0.000040s : 1: add_recomputation 0.20% : 0.000112s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.46% : 0.000256s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.13% : 0.000072s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 33.43% : 0.018681s : 1: jit_opt_a 0.26% : 0.000145s : 1: jit_opt_after_cconv 0.08% : 0.000046s : 1: jit_opt_b 0.78% : 0.000438s : 1: loop_unroll 1.37% : 0.000764s : 1: mutable_eliminate 5.18% : 0.002894s : 39: opt.transform.jit_opt_a 0.05% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000017s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000034s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 8.21% : 0.004587s : 2: renormalize.infer 3.74% : 0.002091s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.20% : 0.000109s : 1: rewriter_before_opt_a 0.13% : 0.000075s : 1: symbol_engine_optimizer 44.29% : 0.024749s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.508.068 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.508.741 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0276039, [30] [bootstrap]: 0.00035544 [type_inference]: 0.00501322 [event_method]: 1.788e-05 [auto_monad]: 6.98e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 3.544e-05 [rewriter_before_opt_a]: 7.363e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00576176, [2] [Cycle 1]: 0.00191501, [27] [switch_simplify]: 6.332e-05 [loop_unroll]: 3.287e-05 [a_1]: 0.00060599 [with_stream_mark]: 2.328e-05 [recompute_prepare]: 8.61002e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 4.19002e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.492e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 0.00082691 [add_forward_monad_depend]: 6.36998e-06 [auto_monad_grad]: 3.38999e-06 [auto_monad_eliminator]: 1.602e-05 [cse]: 3.488e-05 [replace_applicator]: 1.425e-05 [Cycle 2]: 0.00033872, [27] [switch_simplify]: 6.26998e-06 [loop_unroll]: 5.39998e-06 [a_1]: 9.927e-05 [with_stream_mark]: 1.149e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 4.96997e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 4.44002e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.351e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.61999e-06 [inline_without_move]: 4.67e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.49978e-07 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 6.38003e-06 [cse]: 1.082e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.139e-05 [rewriter_after_opt_a]: 4.401e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00070813 [jit_opt_b]: 5.109e-05, [1] [Cycle 1]: 4.346e-05, [2] [frontend_op_eliminate]: 1.611e-05 [inline_after_opt_a]: 1.63e-05 [cconv]: 3.053e-05 [loop_unroll]: 0.0139314 [jit_opt_after_cconv]: 0.00021729, [1] [Cycle 1]: 0.00020546, [11] [c_1]: 2.6e-05 [parameter_eliminate]: 9.02999e-06 [updatestate_depend_eliminate]: 1.338e-05 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 3.07002e-06 [cse]: 4.641e-05 [call_graph_tuple_transform]: 3.611e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 1.27e-06 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.811e-05 [partial_unused_args_eliminate]: 2.45997e-06 [environ_conv]: 7.83001e-06 [add_recomputation]: 8.896e-05 [cse_after_recomputation]: 2.357e-05, [1] [Cycle 1]: 1.705e-05, [1] [cse]: 1.07e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 1.02e-05 [opt_after_jit_grad]: 0.00076537 [symbol_engine_optimizer]: 7.46e-05, [1] [Cycle 1]: 6.858e-05, [6] [build]: 4.53001e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.365e-05 [opt_reshape]: 5.91998e-06 [fold_const_symbol]: 8.60999e-06 [renormalize]: 4.10015e-07 [validate]: 4.498e-05 Sums bootstrap : 0.000355s : 1.52% type_inference : 0.005013s : 21.37% event_method : 0.000018s : 0.08% auto_monad : 0.000070s : 0.30% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000035s : 0.15% rewriter_before_opt_a : 0.000074s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.30% jit_opt_a.loop_unroll : 0.000038s : 0.16% jit_opt_a.a_1 : 0.000705s : 3.01% jit_opt_a.with_stream_mark : 0.000035s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000827s : 3.53% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.10% jit_opt_a.cse : 0.000046s : 0.19% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000044s : 0.19% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000708s : 3.02% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000031s : 0.13% loop_unroll : 0.013931s : 59.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000009s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000046s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000089s : 0.38% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000016s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.04% opt_after_jit_grad : 0.000765s : 3.26% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.19% Time group info: ------[substitution.] 0.000242 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.95% : 0.000007s : 3: substitution.graph_param_transform 84.03% : 0.000203s : 4: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.86% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004948 2 83.13% : 0.004113s : 1: type_inference.infer 16.87% : 0.000835s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.49% : 0.000051s : 4: replace.inline 31.51% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.06% : 0.000200s : 4: match.inline 5.94% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.11% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 6.62% : 0.000009s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 5.07% : 0.000007s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000002s : 10: predicate.minmaximum_grad 2.25% : 0.000003s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000011s : 53: predicate.switch_simplify 1.49% : 0.000002s : 10: predicate.tile_eliminate 1.13% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.48% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000656 13 52.91% : 0.000347s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.58% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.50% : 0.000259s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029467 72 0.31% : 0.000092s : 1: add_recomputation 0.25% : 0.000073s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.27% : 0.000375s : 1: bootstrap 0.11% : 0.000033s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 19.57% : 0.005766s : 1: jit_opt_a 0.75% : 0.000222s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 47.39% : 0.013963s : 1: loop_unroll 2.43% : 0.000717s : 1: mutable_eliminate 3.17% : 0.000935s : 26: opt.transform.jit_opt_a 0.24% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.14% : 0.000043s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.63% : 0.000774s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000038s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 1.60% : 0.000471s : 1: renormalize.infer 1.18% : 0.000348s : 1: renormalize.specialize 0.04% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000047s : 1: rewriter_after_opt_a 0.26% : 0.000076s : 1: rewriter_before_opt_a 0.26% : 0.000077s : 1: symbol_engine_optimizer 17.07% : 0.005029s : 1: type_inference TotalTime = 0.115189, [30] [bootstrap]: 0.00034274 [type_inference]: 0.0199638 [event_method]: 1.915e-05 [auto_monad]: 6.656e-05 [graph_reusing]: 5.52001e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 0.00010073 [rewriter_before_opt_a]: 7.845e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.0921963, [2] [Cycle 1]: 0.0885896, [27] [switch_simplify]: 5.251e-05 [loop_unroll]: 2.944e-05 [a_1]: 0.00052853 [with_stream_mark]: 1.809e-05 [recompute_prepare]: 7.61001e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 8.49998e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 0.0876034 [add_forward_monad_depend]: 9.04998e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.883e-05 [cse]: 3.301e-05 [replace_applicator]: 2.328e-05 [Cycle 2]: 0.0003683, [27] [switch_simplify]: 7.16001e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00010303 [with_stream_mark]: 1.327e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.52997e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 5.00001e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 3.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.942e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.56e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 6.29999e-06 [cse]: 1.353e-05 [replace_applicator]: 6.50997e-06 [py_interpret_to_execute_after_opt_a]: 1.764e-05 [rewriter_after_opt_a]: 3.961e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.16002e-06 [mutable_eliminate]: 0.00072272 [jit_opt_b]: 5.379e-05, [1] [Cycle 1]: 4.561e-05, [2] [frontend_op_eliminate]: 1.641e-05 [inline_after_opt_a]: 1.687e-05 [cconv]: 2.992e-05 [loop_unroll]: 0.00046619 [jit_opt_after_cconv]: 0.00014575, [1] [Cycle 1]: 0.00013966, [11] [c_1]: 2.153e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 6.47001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.343e-05 [call_graph_tuple_transform]: 1.961e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.686e-05 [partial_unused_args_eliminate]: 2.03002e-06 [environ_conv]: 5.72999e-06 [add_recomputation]: 5.187e-05 [cse_after_recomputation]: 2.278e-05, [1] [Cycle 1]: 1.766e-05, [1] [cse]: 1.208e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 6.19999e-06 [opt_after_jit_grad]: 0.00050458 [symbol_engine_optimizer]: 7.636e-05, [1] [Cycle 1]: 6.957e-05, [6] [build]: 4.60001e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.409e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.59e-06 [renormalize]: 6.30011e-07 [validate]: 4.025e-05 Sums bootstrap : 0.000343s : 0.31% type_inference : 0.019964s : 17.93% event_method : 0.000019s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000101s : 0.09% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000632s : 0.57% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.087603s : 78.67% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000723s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000466s : 0.42% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000505s : 0.45% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000211 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 82.82% : 0.000175s : 4: substitution.inline 2.25% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.26% : 0.000005s : 2: substitution.replace_old_param 5.77% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019899 2 92.96% : 0.018497s : 1: type_inference.infer 7.04% : 0.001401s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.85% : 0.000046s : 4: replace.inline 32.15% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.99% : 0.000172s : 4: match.inline 6.01% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.64% : 0.000002s : 10: predicate.addn_zero_filter 2.03% : 0.000003s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.07% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 6.36% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.89% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.47% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.05% : 0.000009s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.89% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.07% : 0.000003s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000947 13 44.58% : 0.000422s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.71% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.71% : 0.000480s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.203707 72 0.03% : 0.000055s : 1: add_recomputation 0.03% : 0.000070s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.18% : 0.000365s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 45.26% : 0.092200s : 1: jit_opt_a 0.07% : 0.000148s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.23% : 0.000476s : 1: loop_unroll 0.36% : 0.000732s : 1: mutable_eliminate 0.42% : 0.000862s : 26: opt.transform.jit_opt_a 0.02% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000514s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.05% : 0.000104s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 42.73% : 0.087046s : 1: renormalize.infer 0.27% : 0.000544s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000082s : 1: rewriter_before_opt_a 0.04% : 0.000079s : 1: symbol_engine_optimizer 9.81% : 0.019976s : 1: type_inference TotalTime = 0.0401172, [30] [bootstrap]: 0.00022564 [type_inference]: 0.0166882 [event_method]: 6.635e-05 [auto_monad]: 0.00010355 [graph_reusing]: 7.07002e-06 [pre_auto_parallel]: 3.33e-06 [py_interpret_to_execute]: 3.313e-05 [rewriter_before_opt_a]: 0.00012125 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0206183, [3] [Cycle 1]: 0.0131777, [27] [switch_simplify]: 8.283e-05 [loop_unroll]: 4.372e-05 [a_1]: 0.00095944 [with_stream_mark]: 3.452e-05 [recompute_prepare]: 1.898e-05 [updatestate_depend_eliminate]: 9.10999e-06 [updatestate_assign_eliminate]: 6.75998e-06 [updatestate_loads_eliminate]: 7.15e-06 [parameter_eliminate]: 3.41001e-06 [specialize_transform]: 1.373e-05 [updatestate_useless_node_eliminater]: 1.301e-05 [accelerated_algorithm]: 1.347e-05 [meta_shard_fg_expand]: 4.3e-06 [get_grad_eliminate_]: 1.268e-05 [merge_forward]: 9.24e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.812e-05 [j_node_and_user_rematch]: 2.402e-05 [meta_fg_expand]: 0.00182259 [replace_old_param]: 8.447e-05 [inline_without_move]: 6.477e-05 [renormalize]: 0.00923984 [add_forward_monad_depend]: 1.32e-05 [auto_monad_grad]: 6.31e-06 [auto_monad_eliminator]: 6.282e-05 [cse]: 0.00024438 [replace_applicator]: 8.656e-05 [Cycle 2]: 0.00340312, [27] [switch_simplify]: 4.343e-05 [loop_unroll]: 4.082e-05 [a_1]: 0.00114085 [with_stream_mark]: 1.703e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.71999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 6.72002e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 4.70999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 1.156e-05 [meta_fg_expand]: 0.00011028 [replace_old_param]: 7.41999e-06 [inline_without_move]: 7.33999e-06 [renormalize]: 0.0017133 [add_forward_monad_depend]: 6.92002e-06 [auto_monad_grad]: 2.06998e-06 [auto_monad_eliminator]: 1.247e-05 [cse]: 2.394e-05 [replace_applicator]: 1.55e-05 [Cycle 3]: 0.00025615, [27] [switch_simplify]: 4.12e-06 [loop_unroll]: 3.61999e-06 [a_1]: 4.193e-05 [with_stream_mark]: 1.091e-05 [recompute_prepare]: 3.26999e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 1.74e-06 [updatestate_loads_eliminate]: 1.60999e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 3.50003e-06 [updatestate_useless_node_eliminater]: 3.42002e-06 [accelerated_algorithm]: 3.56001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 3.01999e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.265e-05 [j_node_and_user_rematch]: 5.89999e-06 [meta_fg_expand]: 1.42999e-06 [replace_old_param]: 3.23998e-06 [inline_without_move]: 3.04001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 4.04002e-06 [cse]: 8.27e-06 [replace_applicator]: 3.64002e-06 [py_interpret_to_execute_after_opt_a]: 1.243e-05 [rewriter_after_opt_a]: 3.434e-05 [convert_after_rewriter]: 6.24999e-06 [order_py_execute_after_rewriter]: 4.47e-06 [mutable_eliminate]: 0.0007517 [jit_opt_b]: 4.222e-05, [1] [Cycle 1]: 3.546e-05, [2] [frontend_op_eliminate]: 1.207e-05 [inline_after_opt_a]: 1.126e-05 [cconv]: 2.785e-05 [loop_unroll]: 0.00041682 [jit_opt_after_cconv]: 0.00012548, [1] [Cycle 1]: 0.00011863, [11] [c_1]: 1.231e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 1.84998e-06 [updatestate_loads_eliminate]: 1.54e-06 [cse]: 1.952e-05 [call_graph_tuple_transform]: 1.393e-05 [tuple_list_get_item_eliminator]: 3.82998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 7.99977e-07 [switch_simplify]: 3.54002e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 5.37001e-06 [add_recomputation]: 3.608e-05 [cse_after_recomputation]: 2.043e-05, [1] [Cycle 1]: 1.481e-05, [1] [cse]: 8.62e-06 [auto_monad_reorder]: 1.32e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00043009 [symbol_engine_optimizer]: 6.619e-05, [1] [Cycle 1]: 6.053e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 5.67001e-06 [elim_not_effective]: 9.29e-06 [opt_reshape]: 4.17e-06 [fold_const_symbol]: 5.99999e-06 [renormalize]: 3.80009e-07 [validate]: 3.201e-05 Sums bootstrap : 0.000226s : 0.64% type_inference : 0.016688s : 47.08% event_method : 0.000066s : 0.19% auto_monad : 0.000104s : 0.29% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000033s : 0.09% rewriter_before_opt_a : 0.000121s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000130s : 0.37% jit_opt_a.loop_unroll : 0.000088s : 0.25% jit_opt_a.a_1 : 0.002142s : 6.04% jit_opt_a.with_stream_mark : 0.000062s : 0.18% jit_opt_a.recompute_prepare : 0.000031s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000025s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.07% jit_opt_a.accelerated_algorithm : 0.000024s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.06% jit_opt_a.merge_forward : 0.000017s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.12% jit_opt_a.meta_fg_expand : 0.001934s : 5.46% jit_opt_a.replace_old_param : 0.000095s : 0.27% jit_opt_a.inline_without_move : 0.000075s : 0.21% jit_opt_a.renormalize : 0.010953s : 30.90% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.06% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000079s : 0.22% jit_opt_a.cse : 0.000277s : 0.78% jit_opt_a.replace_applicator : 0.000106s : 0.30% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000034s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000752s : 2.12% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.03% cconv : 0.000028s : 0.08% loop_unroll : 0.000417s : 1.18% jit_opt_after_cconv.c_1 : 0.000012s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000036s : 0.10% cse_after_recomputation.cse : 0.000009s : 0.02% auto_monad_reorder : 0.000013s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000430s : 1.21% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.09% Time group info: ------[substitution.] 0.000576 104 0.25% : 0.000001s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.84% : 0.000005s : 1: substitution.graph_param_transform 65.07% : 0.000375s : 13: substitution.inline 3.59% : 0.000021s : 2: substitution.inline_without_move 1.75% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.10% : 0.000012s : 7: substitution.minmaximum_grad 1.27% : 0.000007s : 5: substitution.partial_eliminate 1.82% : 0.000010s : 12: substitution.remove_not_recompute_node 5.67% : 0.000033s : 10: substitution.replace_applicator 1.23% : 0.000007s : 10: substitution.replace_old_param 0.38% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.19% : 0.000007s : 1: substitution.tile_eliminate 4.27% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.61% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.82% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016594 2 90.67% : 0.015046s : 1: type_inference.infer 9.33% : 0.001547s : 1: type_inference.specialize ------[replace.] 0.000185 20 65.84% : 0.000122s : 13: replace.inline 34.16% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000390 20 94.13% : 0.000367s : 13: match.inline 5.87% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000370 2433 1.70% : 0.000006s : 42: predicate.accumulaten_eliminater 0.25% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 42: predicate.addn_check_dump 1.66% : 0.000006s : 42: predicate.addn_zero_filter 2.10% : 0.000008s : 42: predicate.arithmetic_simplify 1.74% : 0.000006s : 42: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000005s : 42: predicate.compare_switch_simplify 1.48% : 0.000005s : 42: predicate.depend_value_elim 1.53% : 0.000006s : 42: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.48% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.47% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 42: predicate.environ_get_depend_swap 1.65% : 0.000006s : 42: predicate.environ_get_eliminate 1.45% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 0.74% : 0.000003s : 16: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.40% : 0.000016s : 64: predicate.inline 2.18% : 0.000008s : 44: predicate.inline_without_move 0.32% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 16: predicate.less_batch_normalization 1.82% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.97% : 0.000007s : 50: predicate.load_eliminater 0.24% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.47% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.99% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.40% : 0.000005s : 42: predicate.merge_addn 1.48% : 0.000005s : 42: predicate.minmaximum_grad 0.42% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.33% : 0.000009s : 50: predicate.partial_eliminate 1.55% : 0.000006s : 42: predicate.print_const_string_wrapper 2.08% : 0.000008s : 42: predicate.reduce_eliminate 1.86% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 16: predicate.remove_not_recompute_node 2.61% : 0.000010s : 90: predicate.replace_applicator 1.11% : 0.000004s : 44: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 42: predicate.reshape_eliminate 1.51% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.28% : 0.000001s : 1: predicate.row_tensor_eliminate 1.57% : 0.000006s : 42: predicate.same_eliminate 0.41% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.77% : 0.000003s : 16: predicate.specialize_transform 1.70% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.76% : 0.000010s : 62: predicate.switch_defer_inline 2.60% : 0.000010s : 62: predicate.switch_layer_defer_inline 6.61% : 0.000024s : 150: predicate.switch_simplify 1.59% : 0.000006s : 42: predicate.tile_eliminate 1.56% : 0.000006s : 42: predicate.transpose_eliminate 1.95% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.82% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.17% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.80% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.93% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.58% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 2.09% : 0.000008s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002463 36 62.37% : 0.001536s : 19: func_graph_cloner_run.FuncGraphClonerGraph 37.63% : 0.000927s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053865 87 0.07% : 0.000039s : 1: add_recomputation 0.20% : 0.000108s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.46% : 0.000249s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.13% : 0.000072s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 38.29% : 0.020623s : 1: jit_opt_a 0.24% : 0.000128s : 1: jit_opt_after_cconv 0.08% : 0.000045s : 1: jit_opt_b 0.79% : 0.000424s : 1: loop_unroll 1.41% : 0.000760s : 1: mutable_eliminate 5.21% : 0.002808s : 39: opt.transform.jit_opt_a 0.06% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000017s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000437s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000035s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 16.26% : 0.008758s : 2: renormalize.infer 4.03% : 0.002172s : 2: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000037s : 1: rewriter_after_opt_a 0.23% : 0.000124s : 1: rewriter_before_opt_a 0.13% : 0.000069s : 1: symbol_engine_optimizer 31.02% : 0.016711s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.556.573 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.557.193 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0295036, [30] [bootstrap]: 0.00028783 [type_inference]: 0.0209297 [event_method]: 2.095e-05 [auto_monad]: 7.151e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00010392 [rewriter_before_opt_a]: 8.387e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00578725, [2] [Cycle 1]: 0.0019871, [27] [switch_simplify]: 5.595e-05 [loop_unroll]: 2.906e-05 [a_1]: 0.0005372 [with_stream_mark]: 2.093e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 8.84998e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.29003e-06 [renormalize]: 0.00100512 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 1.602e-05 [cse]: 3.56e-05 [replace_applicator]: 1.321e-05 [Cycle 2]: 0.00031499, [27] [switch_simplify]: 5.83002e-06 [loop_unroll]: 5.20001e-06 [a_1]: 8.721e-05 [with_stream_mark]: 1.026e-05 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.07999e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.284e-05 [j_node_and_user_rematch]: 7.86001e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.31999e-06 [inline_without_move]: 4.82e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.66998e-06 [cse]: 1.222e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.268e-05 [rewriter_after_opt_a]: 3.816e-05 [convert_after_rewriter]: 7.08998e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00054007 [jit_opt_b]: 4.869e-05, [1] [Cycle 1]: 4.164e-05, [2] [frontend_op_eliminate]: 1.532e-05 [inline_after_opt_a]: 1.513e-05 [cconv]: 2.792e-05 [loop_unroll]: 0.00045664 [jit_opt_after_cconv]: 0.00015396, [1] [Cycle 1]: 0.00014702, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 3.26999e-06 [updatestate_depend_eliminate]: 7.77e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.682e-05 [call_graph_tuple_transform]: 2.025e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 2.19001e-06 [renormalize]: 8.89995e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.728e-05 [partial_unused_args_eliminate]: 2.81999e-06 [environ_conv]: 5.97001e-06 [add_recomputation]: 5.321e-05 [cse_after_recomputation]: 2.2e-05, [1] [Cycle 1]: 1.681e-05, [1] [cse]: 1.072e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 6.23998e-06 [opt_after_jit_grad]: 0.00048299 [symbol_engine_optimizer]: 7.133e-05, [1] [Cycle 1]: 6.505e-05, [6] [build]: 3.81001e-06 [elim_shapecalc]: 7.84997e-06 [elim_not_effective]: 1.256e-05 [opt_reshape]: 5.80002e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 3.69997e-07 [validate]: 4.207e-05 Sums bootstrap : 0.000288s : 1.13% type_inference : 0.020930s : 82.33% event_method : 0.000021s : 0.08% auto_monad : 0.000072s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000104s : 0.41% rewriter_before_opt_a : 0.000084s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000624s : 2.46% jit_opt_a.with_stream_mark : 0.000031s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001005s : 3.95% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000048s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000540s : 2.12% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000028s : 0.11% loop_unroll : 0.000457s : 1.80% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.21% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000483s : 1.90% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.17% Time group info: ------[substitution.] 0.000217 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.63% : 0.000006s : 3: substitution.graph_param_transform 84.76% : 0.000184s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000004s : 4: substitution.remove_not_recompute_node 2.13% : 0.000005s : 2: substitution.replace_old_param 5.58% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020857 2 92.37% : 0.019265s : 1: type_inference.infer 7.63% : 0.001592s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.64% : 0.000047s : 4: replace.inline 31.36% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 94.27% : 0.000182s : 4: match.inline 5.73% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.10% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.79% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.24% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 6.17% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.96% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000845 13 44.50% : 0.000376s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.50% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.00% : 0.000422s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031385 72 0.18% : 0.000057s : 1: add_recomputation 0.24% : 0.000075s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.97% : 0.000304s : 1: bootstrap 0.10% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.45% : 0.005790s : 1: jit_opt_a 0.50% : 0.000157s : 1: jit_opt_after_cconv 0.16% : 0.000051s : 1: jit_opt_b 1.49% : 0.000467s : 1: loop_unroll 1.75% : 0.000549s : 1: mutable_eliminate 2.67% : 0.000838s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.57% : 0.000492s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000108s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.93% : 0.000605s : 1: renormalize.infer 1.25% : 0.000391s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000087s : 1: rewriter_before_opt_a 0.24% : 0.000074s : 1: symbol_engine_optimizer 66.75% : 0.020949s : 1: type_inference TotalTime = 0.0175015, [30] [bootstrap]: 0.00040509 [type_inference]: 0.00598124 [event_method]: 2.058e-05 [auto_monad]: 7.297e-05 [graph_reusing]: 7.11999e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 6.148e-05 [rewriter_before_opt_a]: 8.117e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.0070972, [2] [Cycle 1]: 0.0021762, [27] [switch_simplify]: 7.223e-05 [loop_unroll]: 3.02e-05 [a_1]: 0.00070333 [with_stream_mark]: 2.138e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.79001e-06 [specialize_transform]: 7.51001e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 4.07998e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.768e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 1.105e-05 [inline_without_move]: 5.68002e-06 [renormalize]: 0.00095979 [add_forward_monad_depend]: 7.31001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.787e-05 [cse]: 3.431e-05 [replace_applicator]: 1.621e-05 [Cycle 2]: 0.00034804, [27] [switch_simplify]: 6.21998e-06 [loop_unroll]: 5.62999e-06 [a_1]: 9.596e-05 [with_stream_mark]: 1.168e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.34003e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.81003e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 2.55002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.43999e-06 [inline_without_move]: 4.62998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 6.20002e-06 [cse]: 1.352e-05 [replace_applicator]: 5.38997e-06 [py_interpret_to_execute_after_opt_a]: 1.596e-05 [rewriter_after_opt_a]: 4.329e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 5.69999e-06 [mutable_eliminate]: 0.00080053 [jit_opt_b]: 5.521e-05, [1] [Cycle 1]: 4.721e-05, [2] [frontend_op_eliminate]: 1.866e-05 [inline_after_opt_a]: 1.612e-05 [cconv]: 2.701e-05 [loop_unroll]: 0.00047597 [jit_opt_after_cconv]: 0.00016442, [1] [Cycle 1]: 0.00015801, [11] [c_1]: 2.208e-05 [parameter_eliminate]: 3.26001e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.144e-05 [call_graph_tuple_transform]: 2.192e-05 [tuple_list_get_item_eliminator]: 5.88998e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 6.29982e-07 [switch_simplify]: 6.39001e-06 [remove_dup_value]: 3.383e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 6.46999e-06 [add_recomputation]: 5.098e-05 [cse_after_recomputation]: 2.583e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.373e-05 [auto_monad_reorder]: 1.935e-05 [get_jit_bprop_graph]: 2.82002e-06 [rewriter_after_jit_bprop_graph]: 6.31e-06 [opt_after_jit_grad]: 0.00167594 [symbol_engine_optimizer]: 9.225e-05, [1] [Cycle 1]: 8.452e-05, [6] [build]: 5.34e-06 [elim_shapecalc]: 1.004e-05 [elim_not_effective]: 1.795e-05 [opt_reshape]: 6.76e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 6.89994e-07 [validate]: 4.813e-05 Sums bootstrap : 0.000405s : 3.30% type_inference : 0.005981s : 48.79% event_method : 0.000021s : 0.17% auto_monad : 0.000073s : 0.60% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000061s : 0.50% rewriter_before_opt_a : 0.000081s : 0.66% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000078s : 0.64% jit_opt_a.loop_unroll : 0.000036s : 0.29% jit_opt_a.a_1 : 0.000799s : 6.52% jit_opt_a.with_stream_mark : 0.000033s : 0.27% jit_opt_a.recompute_prepare : 0.000015s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000960s : 7.83% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.20% jit_opt_a.cse : 0.000048s : 0.39% jit_opt_a.replace_applicator : 0.000022s : 0.18% py_interpret_to_execute_after_opt_a : 0.000016s : 0.13% rewriter_after_opt_a : 0.000043s : 0.35% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000801s : 6.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000027s : 0.22% loop_unroll : 0.000476s : 3.88% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000034s : 0.28% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000051s : 0.42% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000019s : 0.16% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.001676s : 13.67% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000048s : 0.39% Time group info: ------[substitution.] 0.000275 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.08% : 0.000006s : 3: substitution.graph_param_transform 84.73% : 0.000233s : 4: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 6.26% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005891 2 78.88% : 0.004647s : 1: type_inference.infer 21.12% : 0.001244s : 1: type_inference.specialize ------[replace.] 0.000095 6 67.74% : 0.000065s : 4: replace.inline 32.26% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 6 93.51% : 0.000231s : 4: match.inline 6.49% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.91% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.54% : 0.000002s : 10: predicate.addn_zero_filter 2.47% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.05% : 0.000001s : 10: predicate.depend_value_elim 0.96% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.85% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 1.43% : 0.000002s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 10: predicate.reshape_eliminate 1.58% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.30% : 0.000002s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.82% : 0.000009s : 53: predicate.switch_simplify 1.56% : 0.000002s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000838 13 45.84% : 0.000384s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.35% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.80% : 0.000400s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019570 72 0.28% : 0.000054s : 1: add_recomputation 0.39% : 0.000077s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 2.18% : 0.000427s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.29% : 0.007102s : 1: jit_opt_a 0.85% : 0.000167s : 1: jit_opt_after_cconv 0.30% : 0.000058s : 1: jit_opt_b 2.48% : 0.000485s : 1: loop_unroll 4.14% : 0.000811s : 1: mutable_eliminate 5.34% : 0.001046s : 26: opt.transform.jit_opt_a 0.27% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.17% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000041s : 4: opt.transform.symbol_engine_opt 8.63% : 0.001690s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000064s : 1: py_interpret_to_execute 0.09% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000036s : 1: remove_dup_value 2.61% : 0.000511s : 1: renormalize.infer 2.25% : 0.000440s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000046s : 1: rewriter_after_opt_a 0.43% : 0.000085s : 1: rewriter_before_opt_a 0.49% : 0.000096s : 1: symbol_engine_optimizer 30.68% : 0.006003s : 1: type_inference TotalTime = 0.0184342, [30] [bootstrap]: 0.00040155 [type_inference]: 0.00938034 [event_method]: 2.302e-05 [auto_monad]: 7.205e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 4.865e-05 [rewriter_before_opt_a]: 8.573e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00588104, [2] [Cycle 1]: 0.00203987, [27] [switch_simplify]: 6.341e-05 [loop_unroll]: 3.228e-05 [a_1]: 0.00068148 [with_stream_mark]: 2.318e-05 [recompute_prepare]: 8.48999e-06 [updatestate_depend_eliminate]: 5.41002e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.49998e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.483e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.42001e-06 [renormalize]: 0.00087125 [add_forward_monad_depend]: 6.12999e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.629e-05 [cse]: 4.272e-05 [replace_applicator]: 1.364e-05 [Cycle 2]: 0.00032823, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.22999e-06 [a_1]: 8.987e-05 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 8.29983e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 4.68001e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 8.24002e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.519e-05 [replace_applicator]: 5.83997e-06 [py_interpret_to_execute_after_opt_a]: 1.429e-05 [rewriter_after_opt_a]: 4.241e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00079367 [jit_opt_b]: 5.166e-05, [1] [Cycle 1]: 4.47e-05, [2] [frontend_op_eliminate]: 1.673e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 3.161e-05 [loop_unroll]: 0.00045137 [jit_opt_after_cconv]: 0.0001604, [1] [Cycle 1]: 0.00015381, [11] [c_1]: 2.272e-05 [parameter_eliminate]: 3.35003e-06 [updatestate_depend_eliminate]: 7.5e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 3.121e-05 [call_graph_tuple_transform]: 1.918e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 4.97e-05 [partial_unused_args_eliminate]: 3.03998e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.605e-05 [cse_after_recomputation]: 2.621e-05, [1] [Cycle 1]: 2.038e-05, [1] [cse]: 1.415e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 6.01e-06 [opt_after_jit_grad]: 0.00049327 [symbol_engine_optimizer]: 7.512e-05, [1] [Cycle 1]: 6.863e-05, [6] [build]: 4.30999e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.334e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 5.00004e-07 [validate]: 4.458e-05 Sums bootstrap : 0.000402s : 2.81% type_inference : 0.009380s : 65.57% event_method : 0.000023s : 0.16% auto_monad : 0.000072s : 0.50% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.34% rewriter_before_opt_a : 0.000086s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.48% jit_opt_a.loop_unroll : 0.000038s : 0.26% jit_opt_a.a_1 : 0.000771s : 5.39% jit_opt_a.with_stream_mark : 0.000034s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000871s : 6.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.16% jit_opt_a.cse : 0.000058s : 0.40% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000042s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000794s : 5.55% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000032s : 0.22% loop_unroll : 0.000451s : 3.16% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000050s : 0.35% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000056s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000493s : 3.45% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.31% Time group info: ------[substitution.] 0.000288 24 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 3: substitution.graph_param_transform 87.51% : 0.000252s : 5: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000005s : 2: substitution.replace_old_param 4.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009301 2 88.57% : 0.008238s : 1: type_inference.infer 11.43% : 0.001063s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.56% : 0.000068s : 5: replace.inline 31.44% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 7 95.40% : 0.000249s : 5: match.inline 4.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.15% : 0.000001s : 11: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.69% : 0.000002s : 11: predicate.arithmetic_simplify 1.34% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.18% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.20% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 6.74% : 0.000008s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 2.05% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 2.51% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.42% : 0.000002s : 11: predicate.print_const_string_wrapper 1.53% : 0.000002s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 11: predicate.reshape_eliminate 1.25% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.89% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000846 16 49.96% : 0.000423s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.00% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.04% : 0.000339s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020366 72 0.29% : 0.000059s : 1: add_recomputation 0.37% : 0.000076s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 2.07% : 0.000422s : 1: bootstrap 0.17% : 0.000034s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.14% : 0.000028s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 28.90% : 0.005885s : 1: jit_opt_a 0.80% : 0.000163s : 1: jit_opt_after_cconv 0.27% : 0.000055s : 1: jit_opt_b 2.26% : 0.000460s : 1: loop_unroll 3.96% : 0.000807s : 1: mutable_eliminate 4.91% : 0.001001s : 26: opt.transform.jit_opt_a 0.25% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000020s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.47% : 0.000502s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000051s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.26% : 0.000053s : 1: remove_dup_value 2.52% : 0.000513s : 1: renormalize.infer 1.72% : 0.000350s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000045s : 1: rewriter_after_opt_a 0.44% : 0.000089s : 1: rewriter_before_opt_a 0.38% : 0.000078s : 1: symbol_engine_optimizer 46.15% : 0.009399s : 1: type_inference TotalTime = 0.148887, [30] [bootstrap]: 0.00023799 [type_inference]: 0.120354 [event_method]: 0.0005188 [auto_monad]: 0.00011966 [graph_reusing]: 7.92e-06 [pre_auto_parallel]: 3.29001e-06 [py_interpret_to_execute]: 4.044e-05 [rewriter_before_opt_a]: 0.00013024 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.0252408, [3] [Cycle 1]: 0.0176476, [27] [switch_simplify]: 8.136e-05 [loop_unroll]: 4.47e-05 [a_1]: 0.0009996 [with_stream_mark]: 3.402e-05 [recompute_prepare]: 2.122e-05 [updatestate_depend_eliminate]: 9.20999e-06 [updatestate_assign_eliminate]: 7.63999e-06 [updatestate_loads_eliminate]: 7.6e-06 [parameter_eliminate]: 2.94001e-06 [specialize_transform]: 1.498e-05 [updatestate_useless_node_eliminater]: 1.342e-05 [accelerated_algorithm]: 1.374e-05 [meta_shard_fg_expand]: 3.76001e-06 [get_grad_eliminate_]: 1.368e-05 [merge_forward]: 9.14e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.854e-05 [j_node_and_user_rematch]: 2.441e-05 [meta_fg_expand]: 0.00196567 [replace_old_param]: 8.329e-05 [inline_without_move]: 6.739e-05 [renormalize]: 0.0134832 [add_forward_monad_depend]: 1.279e-05 [auto_monad_grad]: 6.45002e-06 [auto_monad_eliminator]: 6.079e-05 [cse]: 0.00027172 [replace_applicator]: 9.42e-05 [Cycle 2]: 0.00351658, [27] [switch_simplify]: 4.322e-05 [loop_unroll]: 4.19e-05 [a_1]: 0.00122149 [with_stream_mark]: 1.751e-05 [recompute_prepare]: 1.002e-05 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 4.22e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 7.11999e-06 [meta_shard_fg_expand]: 3.73001e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 0.00014427 [replace_old_param]: 8.35001e-06 [inline_without_move]: 7.05002e-06 [renormalize]: 0.00171074 [add_forward_monad_depend]: 6.55997e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.268e-05 [cse]: 2.355e-05 [replace_applicator]: 1.333e-05 [Cycle 3]: 0.00025556, [27] [switch_simplify]: 4.48999e-06 [loop_unroll]: 3.96001e-06 [a_1]: 4.473e-05 [with_stream_mark]: 9.48002e-06 [recompute_prepare]: 3.66999e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 1.77001e-06 [updatestate_loads_eliminate]: 1.50001e-06 [parameter_eliminate]: 1.21997e-06 [specialize_transform]: 3.51001e-06 [updatestate_useless_node_eliminater]: 3.41001e-06 [accelerated_algorithm]: 3.6e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 2.96999e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 2.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.118e-05 [j_node_and_user_rematch]: 6.03998e-06 [meta_fg_expand]: 1.45999e-06 [replace_old_param]: 3.06001e-06 [inline_without_move]: 3.06001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 3.33e-06 [cse]: 7.81001e-06 [replace_applicator]: 3.55e-06 [py_interpret_to_execute_after_opt_a]: 1.137e-05 [rewriter_after_opt_a]: 3.491e-05 [convert_after_rewriter]: 5.64e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00070562 [jit_opt_b]: 4.174e-05, [1] [Cycle 1]: 3.398e-05, [2] [frontend_op_eliminate]: 1.071e-05 [inline_after_opt_a]: 1.209e-05 [cconv]: 2.477e-05 [loop_unroll]: 0.00043436 [jit_opt_after_cconv]: 0.0001237, [1] [Cycle 1]: 0.00011723, [11] [c_1]: 1.178e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 1.67001e-06 [updatestate_loads_eliminate]: 1.52001e-06 [cse]: 1.884e-05 [call_graph_tuple_transform]: 1.311e-05 [tuple_list_get_item_eliminator]: 3.73001e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 4.46002e-06 [remove_dup_value]: 1.363e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 4.92e-06 [add_recomputation]: 3.951e-05 [cse_after_recomputation]: 1.799e-05, [1] [Cycle 1]: 1.321e-05, [1] [cse]: 7.28e-06 [auto_monad_reorder]: 1.337e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.33999e-06 [opt_after_jit_grad]: 0.00043531 [symbol_engine_optimizer]: 7.962e-05, [1] [Cycle 1]: 7.386e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 6.21e-06 [elim_not_effective]: 1.006e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 1.883e-05 [renormalize]: 4.30009e-07 [validate]: 3.215e-05 Sums bootstrap : 0.000238s : 0.17% type_inference : 0.120354s : 83.48% event_method : 0.000519s : 0.36% auto_monad : 0.000120s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000130s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.09% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002266s : 1.57% jit_opt_a.with_stream_mark : 0.000061s : 0.04% jit_opt_a.recompute_prepare : 0.000035s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.03% jit_opt_a.meta_fg_expand : 0.002111s : 1.46% jit_opt_a.replace_old_param : 0.000095s : 0.07% jit_opt_a.inline_without_move : 0.000078s : 0.05% jit_opt_a.renormalize : 0.015194s : 10.54% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000077s : 0.05% jit_opt_a.cse : 0.000303s : 0.21% jit_opt_a.replace_applicator : 0.000111s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000706s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000434s : 0.30% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000013s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000435s : 0.30% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000019s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.02% Time group info: ------[substitution.] 0.000601 104 0.22% : 0.000001s : 1: substitution.elim_not_effective 2.37% : 0.000014s : 1: substitution.fold_const_symbol 0.63% : 0.000004s : 1: substitution.graph_param_transform 64.44% : 0.000387s : 13: substitution.inline 3.98% : 0.000024s : 2: substitution.inline_without_move 1.56% : 0.000009s : 12: substitution.j_node_and_user_rematch 1.94% : 0.000012s : 7: substitution.minmaximum_grad 1.22% : 0.000007s : 5: substitution.partial_eliminate 1.64% : 0.000010s : 12: substitution.remove_not_recompute_node 5.24% : 0.000031s : 10: substitution.replace_applicator 1.23% : 0.000007s : 10: substitution.replace_old_param 0.39% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.17% : 0.000007s : 1: substitution.tile_eliminate 3.94% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.64% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.38% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120261 2 97.08% : 0.116744s : 1: type_inference.infer 2.92% : 0.003517s : 1: type_inference.specialize ------[replace.] 0.000189 20 66.19% : 0.000125s : 13: replace.inline 33.81% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000402 20 94.50% : 0.000380s : 13: match.inline 5.50% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000428 2544 1.29% : 0.000006s : 44: predicate.accumulaten_eliminater 0.18% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.42% : 0.000006s : 44: predicate.addn_check_dump 1.37% : 0.000006s : 44: predicate.addn_zero_filter 1.83% : 0.000008s : 44: predicate.arithmetic_simplify 1.42% : 0.000006s : 44: predicate.cast_eliminate 0.16% : 0.000001s : 1: predicate.check_bprop_eliminate 1.28% : 0.000005s : 44: predicate.compare_switch_simplify 1.35% : 0.000006s : 44: predicate.depend_value_elim 1.22% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.41% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.30% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.24% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.24% : 0.000005s : 44: predicate.environ_get_depend_swap 1.28% : 0.000005s : 44: predicate.environ_get_eliminate 1.30% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.69% : 0.000003s : 17: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 3.64% : 0.000016s : 66: predicate.inline 2.04% : 0.000009s : 45: predicate.inline_without_move 0.29% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.96% : 0.000004s : 17: predicate.less_batch_normalization 1.67% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.60% : 0.000007s : 52: predicate.load_eliminater 0.26% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.05% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.62% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.37% : 0.000006s : 44: predicate.merge_addn 1.38% : 0.000006s : 44: predicate.minmaximum_grad 0.25% : 0.000001s : 1: predicate.mutable_eliminate 0.17% : 0.000001s : 1: predicate.opt_reshape 2.01% : 0.000009s : 52: predicate.partial_eliminate 1.33% : 0.000006s : 44: predicate.print_const_string_wrapper 1.86% : 0.000008s : 44: predicate.reduce_eliminate 1.58% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 17: predicate.remove_not_recompute_node 2.38% : 0.000010s : 96: predicate.replace_applicator 1.06% : 0.000005s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.31% : 0.000006s : 44: predicate.reshape_eliminate 1.45% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.41% : 0.000006s : 44: predicate.same_eliminate 0.39% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.65% : 0.000003s : 17: predicate.specialize_transform 1.56% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.47% : 0.000011s : 64: predicate.switch_defer_inline 14.77% : 0.000063s : 64: predicate.switch_layer_defer_inline 5.72% : 0.000024s : 157: predicate.switch_simplify 1.48% : 0.000006s : 44: predicate.tile_eliminate 1.30% : 0.000006s : 44: predicate.transpose_eliminate 1.63% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 2.93% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.58% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.64% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.56% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.39% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.70% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003933 45 70.83% : 0.002786s : 28: func_graph_cloner_run.FuncGraphClonerGraph 29.17% : 0.001147s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.167032 87 0.03% : 0.000042s : 1: add_recomputation 0.08% : 0.000127s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.16% : 0.000262s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.32% : 0.000528s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.11% : 0.025244s : 1: jit_opt_a 0.08% : 0.000126s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.26% : 0.000442s : 1: loop_unroll 0.43% : 0.000714s : 1: mutable_eliminate 1.76% : 0.002944s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000443s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.71% : 0.012882s : 2: renormalize.infer 1.37% : 0.002289s : 2: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000133s : 1: rewriter_before_opt_a 0.05% : 0.000082s : 1: symbol_engine_optimizer 72.07% : 0.120378s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.719.814 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e0d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.720.498 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0309905, [30] [bootstrap]: 0.00032253 [type_inference]: 0.0217001 [event_method]: 2.373e-05 [auto_monad]: 7.432e-05 [graph_reusing]: 6.72002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00010468 [rewriter_before_opt_a]: 8.518e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.00630779, [2] [Cycle 1]: 0.00216916, [27] [switch_simplify]: 6.845e-05 [loop_unroll]: 3.032e-05 [a_1]: 0.0006042 [with_stream_mark]: 2.533e-05 [recompute_prepare]: 9.15999e-06 [updatestate_depend_eliminate]: 5.20001e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.46998e-06 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.92999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.755e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 5.49e-06 [renormalize]: 0.00101322 [add_forward_monad_depend]: 7.74002e-06 [auto_monad_grad]: 2.70997e-06 [auto_monad_eliminator]: 1.635e-05 [cse]: 3.341e-05 [replace_applicator]: 1.539e-05 [Cycle 2]: 0.00033285, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 4.77e-06 [a_1]: 8.914e-05 [with_stream_mark]: 1.194e-05 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.63003e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.42e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.96003e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 1.04003e-06 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.577e-05 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.682e-05 [rewriter_after_opt_a]: 4.132e-05 [convert_after_rewriter]: 6.95002e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.0006299 [jit_opt_b]: 5.057e-05, [1] [Cycle 1]: 4.249e-05, [2] [frontend_op_eliminate]: 1.537e-05 [inline_after_opt_a]: 1.619e-05 [cconv]: 2.841e-05 [loop_unroll]: 0.00045695 [jit_opt_after_cconv]: 0.00015608, [1] [Cycle 1]: 0.00014822, [11] [c_1]: 1.958e-05 [parameter_eliminate]: 3.26999e-06 [updatestate_depend_eliminate]: 7.97e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.734e-05 [call_graph_tuple_transform]: 2.086e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 1.734e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.41998e-06 [add_recomputation]: 5.315e-05 [cse_after_recomputation]: 2.557e-05, [1] [Cycle 1]: 1.921e-05, [1] [cse]: 1.259e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 5.64998e-06 [opt_after_jit_grad]: 0.0005199 [symbol_engine_optimizer]: 7.701e-05, [1] [Cycle 1]: 6.979e-05, [6] [build]: 4.22e-06 [elim_shapecalc]: 7.8e-06 [elim_not_effective]: 1.503e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 5.60016e-07 [validate]: 4.294e-05 Sums bootstrap : 0.000323s : 1.22% type_inference : 0.021700s : 81.88% event_method : 0.000024s : 0.09% auto_monad : 0.000074s : 0.28% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000105s : 0.39% rewriter_before_opt_a : 0.000085s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000693s : 2.62% jit_opt_a.with_stream_mark : 0.000037s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001013s : 3.82% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000049s : 0.19% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000041s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000630s : 2.38% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.11% loop_unroll : 0.000457s : 1.72% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000520s : 1.96% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.16% Time group info: ------[substitution.] 0.000263 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 3: substitution.graph_param_transform 85.66% : 0.000225s : 4: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000006s : 2: substitution.replace_old_param 5.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021614 2 92.65% : 0.020025s : 1: type_inference.infer 7.35% : 0.001589s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.38% : 0.000054s : 4: replace.inline 32.62% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.77% : 0.000222s : 4: match.inline 5.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.12% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.59% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.07% : 0.000002s : 3: predicate.mutable_eliminate 0.68% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.94% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.11% : 0.000001s : 6: predicate.specialize_transform 1.25% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.73% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000865 13 44.50% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.68% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.82% : 0.000422s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032983 72 0.17% : 0.000056s : 1: add_recomputation 0.24% : 0.000078s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.03% : 0.000341s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.14% : 0.006313s : 1: jit_opt_a 0.48% : 0.000159s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.41% : 0.000466s : 1: loop_unroll 1.94% : 0.000641s : 1: mutable_eliminate 2.82% : 0.000930s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.60% : 0.000529s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000108s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.80% : 0.000594s : 1: renormalize.infer 1.24% : 0.000409s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000046s : 1: rewriter_after_opt_a 0.27% : 0.000090s : 1: rewriter_before_opt_a 0.24% : 0.000080s : 1: symbol_engine_optimizer 65.86% : 0.021724s : 1: type_inference TotalTime = 0.0304922, [30] [bootstrap]: 0.00031556 [type_inference]: 0.021996 [event_method]: 2.102e-05 [auto_monad]: 6.678e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00010435 [rewriter_before_opt_a]: 8.247e-05 [expand_dump_flag]: 3.22002e-06 [jit_opt_a]: 0.00575159, [2] [Cycle 1]: 0.00195155, [27] [switch_simplify]: 5.455e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00053258 [with_stream_mark]: 2.086e-05 [recompute_prepare]: 7.50998e-06 [updatestate_depend_eliminate]: 4.21001e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 8.97999e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00097904 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.486e-05 [cse]: 3.616e-05 [replace_applicator]: 1.314e-05 [Cycle 2]: 0.00033754, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.819e-05 [with_stream_mark]: 9.99001e-06 [recompute_prepare]: 1.352e-05 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.63002e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.91997e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.327e-05 [j_node_and_user_rematch]: 8.22e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 7.25e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.4e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.242e-05 [rewriter_after_opt_a]: 4.064e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.000565 [jit_opt_b]: 5.101e-05, [1] [Cycle 1]: 4.391e-05, [2] [frontend_op_eliminate]: 1.691e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.487e-05 [loop_unroll]: 0.00043811 [jit_opt_after_cconv]: 0.00014507, [1] [Cycle 1]: 0.00013878, [11] [c_1]: 2.155e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.56998e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 3.09001e-06 [cse]: 2.27e-05 [call_graph_tuple_transform]: 1.867e-05 [tuple_list_get_item_eliminator]: 5.98998e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.51998e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.21003e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 4.774e-05 [cse_after_recomputation]: 2.17e-05, [1] [Cycle 1]: 1.674e-05, [1] [cse]: 1.117e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 4.65999e-06 [opt_after_jit_grad]: 0.00046075 [symbol_engine_optimizer]: 6.923e-05, [1] [Cycle 1]: 6.317e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 7.21999e-06 [elim_not_effective]: 1.233e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 4.30009e-07 [validate]: 3.605e-05 Sums bootstrap : 0.000316s : 1.19% type_inference : 0.021996s : 83.14% event_method : 0.000021s : 0.08% auto_monad : 0.000067s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000104s : 0.39% rewriter_before_opt_a : 0.000082s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.23% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000621s : 2.35% jit_opt_a.with_stream_mark : 0.000031s : 0.12% jit_opt_a.recompute_prepare : 0.000021s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000979s : 3.70% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000565s : 2.14% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000025s : 0.09% loop_unroll : 0.000438s : 1.66% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000461s : 1.74% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.14% Time group info: ------[substitution.] 0.000213 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000005s : 3: substitution.graph_param_transform 84.34% : 0.000180s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000004s : 4: substitution.remove_not_recompute_node 2.04% : 0.000004s : 2: substitution.replace_old_param 6.14% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021918 2 92.73% : 0.020325s : 1: type_inference.infer 7.27% : 0.001592s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.51% : 0.000045s : 4: replace.inline 32.49% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.66% : 0.000177s : 4: match.inline 6.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.62% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.50% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.68% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 1.11% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.49% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000009s : 53: predicate.switch_simplify 1.43% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.98% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000899 13 47.60% : 0.000428s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.05% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.35% : 0.000426s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032375 72 0.16% : 0.000051s : 1: add_recomputation 0.22% : 0.000070s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.02% : 0.000330s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.77% : 0.005754s : 1: jit_opt_a 0.46% : 0.000148s : 1: jit_opt_after_cconv 0.17% : 0.000053s : 1: jit_opt_b 1.38% : 0.000446s : 1: loop_unroll 1.77% : 0.000574s : 1: mutable_eliminate 2.60% : 0.000843s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.45% : 0.000468s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000108s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.81% : 0.000585s : 1: renormalize.infer 1.19% : 0.000386s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.27% : 0.000086s : 1: rewriter_before_opt_a 0.22% : 0.000072s : 1: symbol_engine_optimizer 68.00% : 0.022013s : 1: type_inference TotalTime = 0.082088, [30] [bootstrap]: 0.00030945 [type_inference]: 0.0727098 [event_method]: 1.957e-05 [auto_monad]: 7.221e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.31998e-06 [py_interpret_to_execute]: 9.188e-05 [rewriter_before_opt_a]: 7.951e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00628021, [2] [Cycle 1]: 0.00237209, [27] [switch_simplify]: 5.95e-05 [loop_unroll]: 3.085e-05 [a_1]: 0.0005465 [with_stream_mark]: 2.074e-05 [recompute_prepare]: 8.47998e-06 [updatestate_depend_eliminate]: 4.37998e-06 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.0013778 [add_forward_monad_depend]: 6.49999e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 3.286e-05 [replace_applicator]: 1.193e-05 [Cycle 2]: 0.00040722, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.24e-06 [a_1]: 8.742e-05 [with_stream_mark]: 1.224e-05 [recompute_prepare]: 7.77998e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.26998e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.268e-05 [j_node_and_user_rematch]: 8.23001e-06 [meta_fg_expand]: 1.49998e-06 [replace_old_param]: 7.48e-06 [inline_without_move]: 4.79e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.83e-06 [cse]: 1.595e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 1.336e-05 [rewriter_after_opt_a]: 4.268e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 5.16998e-06 [mutable_eliminate]: 0.00088655 [jit_opt_b]: 5.216e-05, [1] [Cycle 1]: 4.461e-05, [2] [frontend_op_eliminate]: 1.657e-05 [inline_after_opt_a]: 1.732e-05 [cconv]: 2.715e-05 [loop_unroll]: 0.00044135 [jit_opt_after_cconv]: 0.00014399, [1] [Cycle 1]: 0.00013781, [11] [c_1]: 2.016e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.351e-05 [call_graph_tuple_transform]: 1.897e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.19001e-06 [remove_dup_value]: 1.636e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 5.56e-06 [add_recomputation]: 5.457e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.22e-05 [auto_monad_reorder]: 1.723e-05 [get_jit_bprop_graph]: 1.877e-05 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.0004593 [symbol_engine_optimizer]: 7.202e-05, [1] [Cycle 1]: 6.543e-05, [6] [build]: 3.49001e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.305e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 3.59985e-07 [validate]: 3.982e-05 Sums bootstrap : 0.000309s : 0.40% type_inference : 0.072710s : 93.30% event_method : 0.000020s : 0.03% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000092s : 0.12% rewriter_before_opt_a : 0.000080s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000634s : 0.81% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001378s : 1.77% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000049s : 0.06% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000043s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000887s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000441s : 0.57% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000019s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000459s : 0.59% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.05% Time group info: ------[substitution.] 0.000223 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000005s : 3: substitution.graph_param_transform 84.88% : 0.000189s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000004s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.56% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072634 2 97.94% : 0.071136s : 1: type_inference.infer 2.06% : 0.001498s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.87% : 0.000046s : 4: replace.inline 31.13% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.35% : 0.000187s : 4: match.inline 5.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.55% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.79% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 1.17% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.32% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001294 13 33.71% : 0.000436s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.82% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 62.47% : 0.000809s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084376 72 0.07% : 0.000058s : 1: add_recomputation 0.09% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.39% : 0.000332s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000021s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.45% : 0.006283s : 1: jit_opt_a 0.17% : 0.000147s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.53% : 0.000449s : 1: loop_unroll 1.06% : 0.000897s : 1: mutable_eliminate 1.01% : 0.000855s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000467s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000095s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.73% : 0.000614s : 1: renormalize.infer 0.89% : 0.000754s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000046s : 1: rewriter_after_opt_a 0.10% : 0.000083s : 1: rewriter_before_opt_a 0.09% : 0.000074s : 1: symbol_engine_optimizer 86.19% : 0.072725s : 1: type_inference TotalTime = 0.305953, [30] [bootstrap]: 0.00035566 [type_inference]: 0.236026 [event_method]: 0.00290106 [auto_monad]: 9.213e-05 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.0006239 [rewriter_before_opt_a]: 0.0001408 [expand_dump_flag]: 4.88001e-06 [jit_opt_a]: 0.0102956, [2] [Cycle 1]: 0.00484457, [27] [switch_simplify]: 7.938e-05 [loop_unroll]: 3.671e-05 [a_1]: 0.0008717 [with_stream_mark]: 3.289e-05 [recompute_prepare]: 1.318e-05 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.05998e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 8.02e-06 [updatestate_useless_node_eliminater]: 7.01001e-06 [accelerated_algorithm]: 7.27002e-06 [meta_shard_fg_expand]: 3.25998e-06 [get_grad_eliminate_]: 6.65998e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 2.91999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.762e-05 [j_node_and_user_rematch]: 1.125e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.241e-05 [inline_without_move]: 7.78001e-06 [renormalize]: 0.00333583 [add_forward_monad_depend]: 1.084e-05 [auto_monad_grad]: 2.40002e-06 [auto_monad_eliminator]: 2.651e-05 [cse]: 4.28e-05 [replace_applicator]: 2.442e-05 [Cycle 2]: 0.00043748, [27] [switch_simplify]: 7.68999e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00013909 [with_stream_mark]: 1.921e-05 [recompute_prepare]: 6.86001e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 6.42001e-06 [accelerated_algorithm]: 7.43999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 4.80999e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.628e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.23e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.22999e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 1.062e-05 [cse]: 1.873e-05 [replace_applicator]: 7.01001e-06 [py_interpret_to_execute_after_opt_a]: 2.094e-05 [rewriter_after_opt_a]: 4.754e-05 [convert_after_rewriter]: 7.5e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.053225 [jit_opt_b]: 7.607e-05, [1] [Cycle 1]: 6.447e-05, [2] [frontend_op_eliminate]: 2.644e-05 [inline_after_opt_a]: 2.355e-05 [cconv]: 3.472e-05 [loop_unroll]: 0.00080629 [jit_opt_after_cconv]: 0.0001983, [1] [Cycle 1]: 0.000192, [11] [c_1]: 2.821e-05 [parameter_eliminate]: 4.79998e-06 [updatestate_depend_eliminate]: 8.17998e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.26001e-06 [cse]: 4.606e-05 [call_graph_tuple_transform]: 2.866e-05 [tuple_list_get_item_eliminator]: 6.91999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.11999e-06 [remove_dup_value]: 1.822e-05 [partial_unused_args_eliminate]: 3.54002e-06 [environ_conv]: 9.57001e-06 [add_recomputation]: 5.572e-05 [cse_after_recomputation]: 2.408e-05, [1] [Cycle 1]: 1.835e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.86e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 9.10001e-06 [opt_after_jit_grad]: 0.00048577 [symbol_engine_optimizer]: 0.00013147, [1] [Cycle 1]: 0.00012496, [6] [build]: 4.73001e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 1.479e-05 [opt_reshape]: 6.79001e-06 [fold_const_symbol]: 6.15e-05 [renormalize]: 4.30009e-07 [validate]: 5.844e-05 Sums bootstrap : 0.000356s : 0.12% type_inference : 0.236026s : 78.64% event_method : 0.002901s : 0.97% auto_monad : 0.000092s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000624s : 0.21% rewriter_before_opt_a : 0.000141s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.001011s : 0.34% jit_opt_a.with_stream_mark : 0.000052s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.003336s : 1.11% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000062s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000048s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.053225s : 17.73% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000035s : 0.01% loop_unroll : 0.000806s : 0.27% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000486s : 0.16% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000062s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000058s : 0.02% Time group info: ------[substitution.] 0.000383 28 0.56% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000008s : 4: substitution.graph_param_transform 84.59% : 0.000324s : 5: substitution.inline 1.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.80% : 0.000015s : 3: substitution.reduce_eliminate 1.51% : 0.000006s : 4: substitution.remove_not_recompute_node 1.83% : 0.000007s : 2: substitution.replace_old_param 4.07% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.235933 2 98.81% : 0.233136s : 1: type_inference.infer 1.19% : 0.002798s : 1: type_inference.specialize ------[replace.] 0.000143 7 65.19% : 0.000093s : 5: replace.inline 34.81% : 0.000050s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000335 7 95.73% : 0.000320s : 5: match.inline 4.27% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.73% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.90% : 0.000003s : 13: predicate.addn_zero_filter 1.72% : 0.000003s : 13: predicate.arithmetic_simplify 1.54% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.62% : 0.000003s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.01% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.05% : 0.000002s : 13: predicate.environ_get_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.87% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.54% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.26% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.61% : 0.000003s : 19: predicate.load_eliminater 1.06% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.25% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 3.47% : 0.000005s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 1.97% : 0.000003s : 13: predicate.reduce_eliminate 1.27% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.99% : 0.000002s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.98% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 20: predicate.switch_defer_inline 1.83% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.66% : 0.000012s : 64: predicate.switch_simplify 1.62% : 0.000003s : 13: predicate.tile_eliminate 1.75% : 0.000003s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002679 25 64.44% : 0.001726s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.95% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.61% : 0.000847s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.310717 72 0.02% : 0.000060s : 1: add_recomputation 0.04% : 0.000111s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000375s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.94% : 0.002919s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 3.31% : 0.010299s : 1: jit_opt_a 0.06% : 0.000201s : 1: jit_opt_after_cconv 0.03% : 0.000080s : 1: jit_opt_b 0.26% : 0.000815s : 1: loop_unroll 17.14% : 0.053249s : 1: mutable_eliminate 0.42% : 0.001302s : 26: opt.transform.jit_opt_a 0.02% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000041s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000039s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000088s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000637s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.76% : 0.002357s : 1: renormalize.infer 0.31% : 0.000963s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000051s : 1: rewriter_after_opt_a 0.05% : 0.000148s : 1: rewriter_before_opt_a 0.04% : 0.000134s : 1: symbol_engine_optimizer 75.97% : 0.236047s : 1: type_inference TotalTime = 0.151528, [30] [bootstrap]: 0.000226 [type_inference]: 0.121271 [event_method]: 0.00077119 [auto_monad]: 0.00013625 [graph_reusing]: 8.46002e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00011053 [rewriter_before_opt_a]: 0.0001483 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0264029, [3] [Cycle 1]: 0.0175936, [27] [switch_simplify]: 0.00011449 [loop_unroll]: 4.816e-05 [a_1]: 0.00115167 [with_stream_mark]: 3.651e-05 [recompute_prepare]: 2.472e-05 [updatestate_depend_eliminate]: 1.142e-05 [updatestate_assign_eliminate]: 7.43e-06 [updatestate_loads_eliminate]: 7.6e-06 [parameter_eliminate]: 3.47002e-06 [specialize_transform]: 1.684e-05 [updatestate_useless_node_eliminater]: 2.768e-05 [accelerated_algorithm]: 1.643e-05 [meta_shard_fg_expand]: 4.94998e-06 [get_grad_eliminate_]: 1.458e-05 [merge_forward]: 9.72001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.051e-05 [j_node_and_user_rematch]: 2.761e-05 [meta_fg_expand]: 0.00209813 [replace_old_param]: 7.541e-05 [inline_without_move]: 6.205e-05 [renormalize]: 0.0130592 [add_forward_monad_depend]: 1.191e-05 [auto_monad_grad]: 6.51e-06 [auto_monad_eliminator]: 6.617e-05 [cse]: 0.00027049 [replace_applicator]: 0.00010141 [Cycle 2]: 0.00425713, [27] [switch_simplify]: 4.524e-05 [loop_unroll]: 4.341e-05 [a_1]: 0.0012239 [with_stream_mark]: 1.882e-05 [recompute_prepare]: 1.141e-05 [updatestate_depend_eliminate]: 5.88002e-06 [updatestate_assign_eliminate]: 4.18999e-06 [updatestate_loads_eliminate]: 4.43001e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 8.90999e-06 [updatestate_useless_node_eliminater]: 8.08999e-06 [accelerated_algorithm]: 9.09e-06 [meta_shard_fg_expand]: 3.24001e-06 [get_grad_eliminate_]: 7.96001e-06 [merge_forward]: 5.01997e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.918e-05 [j_node_and_user_rematch]: 1.383e-05 [meta_fg_expand]: 0.0001247 [replace_old_param]: 1.011e-05 [inline_without_move]: 8.13999e-06 [renormalize]: 0.00242746 [add_forward_monad_depend]: 8.42998e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.406e-05 [cse]: 2.763e-05 [replace_applicator]: 1.482e-05 [Cycle 3]: 0.00026615, [27] [switch_simplify]: 4.78001e-06 [loop_unroll]: 4.15999e-06 [a_1]: 4.631e-05 [with_stream_mark]: 1.136e-05 [recompute_prepare]: 3.48e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.03997e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 3.41999e-06 [updatestate_useless_node_eliminater]: 3.44001e-06 [accelerated_algorithm]: 4.43001e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 3.53999e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 3.04001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.216e-05 [j_node_and_user_rematch]: 5.77001e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 3.35e-06 [inline_without_move]: 2.99999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 3.63e-06 [cse]: 8.38999e-06 [replace_applicator]: 3.31999e-06 [py_interpret_to_execute_after_opt_a]: 1.157e-05 [rewriter_after_opt_a]: 3.466e-05 [convert_after_rewriter]: 5.89e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00074996 [jit_opt_b]: 4.492e-05, [1] [Cycle 1]: 3.727e-05, [2] [frontend_op_eliminate]: 1.196e-05 [inline_after_opt_a]: 1.324e-05 [cconv]: 2.756e-05 [loop_unroll]: 0.00046209 [jit_opt_after_cconv]: 0.00013896, [1] [Cycle 1]: 0.00013189, [11] [c_1]: 1.319e-05 [parameter_eliminate]: 3.50998e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 1.67001e-06 [cse]: 2.449e-05 [call_graph_tuple_transform]: 1.53e-05 [tuple_list_get_item_eliminator]: 4.22e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 3.57002e-06 [remove_dup_value]: 1.635e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 3.871e-05 [cse_after_recomputation]: 2.215e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.342e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 7.21999e-06 [opt_after_jit_grad]: 0.00052504 [symbol_engine_optimizer]: 7.188e-05, [1] [Cycle 1]: 6.534e-05, [6] [build]: 3.77998e-06 [elim_shapecalc]: 7.53999e-06 [elim_not_effective]: 1.142e-05 [opt_reshape]: 4.50001e-06 [fold_const_symbol]: 7.15e-06 [renormalize]: 7.7e-07 [validate]: 3.404e-05 Sums bootstrap : 0.000226s : 0.15% type_inference : 0.121271s : 82.90% event_method : 0.000771s : 0.53% auto_monad : 0.000136s : 0.09% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000111s : 0.08% rewriter_before_opt_a : 0.000148s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000165s : 0.11% jit_opt_a.loop_unroll : 0.000096s : 0.07% jit_opt_a.a_1 : 0.002422s : 1.66% jit_opt_a.with_stream_mark : 0.000067s : 0.05% jit_opt_a.recompute_prepare : 0.000040s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000039s : 0.03% jit_opt_a.accelerated_algorithm : 0.000030s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000062s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.002225s : 1.52% jit_opt_a.replace_old_param : 0.000089s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.05% jit_opt_a.renormalize : 0.015487s : 10.59% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000084s : 0.06% jit_opt_a.cse : 0.000307s : 0.21% jit_opt_a.replace_applicator : 0.000120s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000750s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000462s : 0.32% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000525s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000034s : 0.02% Time group info: ------[substitution.] 0.000655 107 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.69% : 0.000005s : 1: substitution.graph_param_transform 67.05% : 0.000439s : 13: substitution.inline 2.77% : 0.000018s : 2: substitution.inline_without_move 1.51% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.89% : 0.000012s : 7: substitution.minmaximum_grad 1.41% : 0.000009s : 5: substitution.partial_eliminate 1.70% : 0.000011s : 13: substitution.remove_not_recompute_node 5.21% : 0.000034s : 10: substitution.replace_applicator 1.51% : 0.000010s : 10: substitution.replace_old_param 1.03% : 0.000007s : 1: substitution.reshape_eliminate 0.53% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.95% : 0.000006s : 1: substitution.tile_eliminate 3.76% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.51% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.06% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121145 2 96.70% : 0.117145s : 1: type_inference.infer 3.30% : 0.004000s : 1: type_inference.specialize ------[replace.] 0.000207 20 64.01% : 0.000132s : 13: replace.inline 35.99% : 0.000074s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000454 20 94.86% : 0.000430s : 13: match.inline 5.14% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000402 2656 1.61% : 0.000006s : 46: predicate.accumulaten_eliminater 0.19% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 46: predicate.addn_check_dump 1.53% : 0.000006s : 46: predicate.addn_zero_filter 1.98% : 0.000008s : 46: predicate.arithmetic_simplify 1.79% : 0.000007s : 46: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.52% : 0.000006s : 46: predicate.compare_switch_simplify 1.45% : 0.000006s : 46: predicate.depend_value_elim 1.44% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.17% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.42% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.42% : 0.000006s : 46: predicate.environ_get_depend_swap 1.57% : 0.000006s : 46: predicate.environ_get_eliminate 1.43% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.85% : 0.000003s : 19: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.11% : 0.000017s : 68: predicate.inline 1.98% : 0.000008s : 47: predicate.inline_without_move 0.35% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.14% : 0.000005s : 19: predicate.less_batch_normalization 2.11% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.81% : 0.000007s : 54: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.52% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.39% : 0.000006s : 46: predicate.merge_addn 1.48% : 0.000006s : 46: predicate.minmaximum_grad 0.36% : 0.000001s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.28% : 0.000009s : 54: predicate.partial_eliminate 1.44% : 0.000006s : 46: predicate.print_const_string_wrapper 1.99% : 0.000008s : 46: predicate.reduce_eliminate 1.84% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 19: predicate.remove_not_recompute_node 2.65% : 0.000011s : 100: predicate.replace_applicator 1.13% : 0.000005s : 47: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.57% : 0.000006s : 46: predicate.reshape_eliminate 1.49% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.62% : 0.000007s : 46: predicate.same_eliminate 0.56% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 2: predicate.special_op_eliminate 0.84% : 0.000003s : 19: predicate.specialize_transform 1.78% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.24% : 0.000013s : 66: predicate.switch_defer_inline 2.54% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.46% : 0.000026s : 161: predicate.switch_simplify 1.65% : 0.000007s : 46: predicate.tile_eliminate 1.48% : 0.000006s : 46: predicate.transpose_eliminate 1.88% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000014s : 55: predicate.tuple_list_get_item_eliminator 2.03% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.87% : 0.000008s : 53: predicate.tuple_to_list_eliminator_ 1.89% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.97% : 0.000012s : 73: predicate.updatestate_useless_node_eliminater 1.80% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.09% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003863 45 71.09% : 0.002746s : 28: func_graph_cloner_run.FuncGraphClonerGraph 28.91% : 0.001117s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.170189 87 0.02% : 0.000041s : 1: add_recomputation 0.09% : 0.000146s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.15% : 0.000252s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.46% : 0.000784s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.52% : 0.026407s : 1: jit_opt_a 0.08% : 0.000142s : 1: jit_opt_after_cconv 0.03% : 0.000048s : 1: jit_opt_b 0.28% : 0.000471s : 1: loop_unroll 0.45% : 0.000760s : 1: mutable_eliminate 1.87% : 0.003180s : 39: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000534s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000114s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 7.61% : 0.012945s : 2: renormalize.infer 1.48% : 0.002518s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.09% : 0.000153s : 1: rewriter_before_opt_a 0.04% : 0.000074s : 1: symbol_engine_optimizer 71.27% : 0.121300s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.892.046 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:27.892.768 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.239467, [30] [bootstrap]: 0.00030284 [type_inference]: 0.213997 [event_method]: 1.839e-05 [auto_monad]: 6.905e-05 [graph_reusing]: 6.46999e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 0.00043393 [rewriter_before_opt_a]: 8.295e-05 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.0221596, [2] [Cycle 1]: 0.0184877, [27] [switch_simplify]: 5.503e-05 [loop_unroll]: 2.973e-05 [a_1]: 0.00054253 [with_stream_mark]: 1.672e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.56999e-06 [updatestate_useless_node_eliminater]: 5.66998e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 9.72999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.0174936 [add_forward_monad_depend]: 8.02e-06 [auto_monad_grad]: 1.76e-06 [auto_monad_eliminator]: 1.835e-05 [cse]: 2.907e-05 [replace_applicator]: 2.129e-05 [Cycle 2]: 0.00038861, [27] [switch_simplify]: 6.93998e-06 [loop_unroll]: 6.03002e-06 [a_1]: 0.00013175 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 6.60002e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.85998e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 3.56999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.855e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 5.67999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.063e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 9.59e-06 [rewriter_after_opt_a]: 3.545e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 5.92001e-06 [mutable_eliminate]: 0.00070342 [jit_opt_b]: 5.437e-05, [1] [Cycle 1]: 4.732e-05, [2] [frontend_op_eliminate]: 1.811e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 2.83e-05 [loop_unroll]: 0.00042555 [jit_opt_after_cconv]: 0.00016175, [1] [Cycle 1]: 0.00015484, [11] [c_1]: 2.479e-05 [parameter_eliminate]: 3.6e-06 [updatestate_depend_eliminate]: 7.67998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 2.566e-05 [call_graph_tuple_transform]: 2.237e-05 [tuple_list_get_item_eliminator]: 6.26998e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 8.2e-07 [switch_simplify]: 6.23002e-06 [remove_dup_value]: 1.525e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 8.98002e-06 [add_recomputation]: 5.35e-05 [cse_after_recomputation]: 2.371e-05, [1] [Cycle 1]: 1.68e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.499e-05 [get_jit_bprop_graph]: 1.81998e-06 [rewriter_after_jit_bprop_graph]: 6.06e-06 [opt_after_jit_grad]: 0.00046968 [symbol_engine_optimizer]: 0.00012858, [1] [Cycle 1]: 0.00012177, [6] [build]: 3.65e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.395e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 6.093e-05 [renormalize]: 5.09986e-07 [validate]: 4.997e-05 Sums bootstrap : 0.000303s : 0.13% type_inference : 0.213997s : 90.83% event_method : 0.000018s : 0.01% auto_monad : 0.000069s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000434s : 0.18% rewriter_before_opt_a : 0.000083s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000674s : 0.29% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.017494s : 7.43% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000040s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000010s : 0.00% rewriter_after_opt_a : 0.000035s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000703s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000426s : 0.18% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000470s : 0.20% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000061s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.02% Time group info: ------[substitution.] 0.000200 24 1.27% : 0.000003s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.01% : 0.000006s : 4: substitution.graph_param_transform 81.19% : 0.000163s : 4: substitution.inline 2.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.92% : 0.000006s : 4: substitution.remove_not_recompute_node 3.04% : 0.000006s : 2: substitution.replace_old_param 5.77% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.213925 2 98.87% : 0.211498s : 1: type_inference.infer 1.13% : 0.002427s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.15% : 0.000045s : 4: replace.inline 32.85% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.90% : 0.000160s : 4: match.inline 6.10% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.22% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.35% : 0.000002s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.96% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.42% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.49% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.74% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.12% : 0.000009s : 58: predicate.switch_simplify 1.13% : 0.000001s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002276 22 67.87% : 0.001544s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.84% : 0.000702s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.257980 72 0.02% : 0.000056s : 1: add_recomputation 0.03% : 0.000072s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.13% : 0.000323s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 8.59% : 0.022163s : 1: jit_opt_a 0.06% : 0.000164s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.17% : 0.000434s : 1: loop_unroll 0.28% : 0.000713s : 1: mutable_eliminate 0.35% : 0.000913s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000086s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000479s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000439s : 1: py_interpret_to_execute 0.00% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 6.48% : 0.016709s : 1: renormalize.infer 0.30% : 0.000773s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000039s : 1: rewriter_after_opt_a 0.03% : 0.000088s : 1: rewriter_before_opt_a 0.05% : 0.000131s : 1: symbol_engine_optimizer 82.96% : 0.214012s : 1: type_inference TotalTime = 0.0460634, [30] [bootstrap]: 0.000309 [type_inference]: 0.0367323 [event_method]: 2.111e-05 [auto_monad]: 6.917e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00010444 [rewriter_before_opt_a]: 8.454e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00621132, [2] [Cycle 1]: 0.00222416, [27] [switch_simplify]: 6.044e-05 [loop_unroll]: 2.881e-05 [a_1]: 0.00057524 [with_stream_mark]: 2.751e-05 [recompute_prepare]: 9.34998e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.36998e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 8.60001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00114889 [add_forward_monad_depend]: 8.87999e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.808e-05 [cse]: 3.975e-05 [replace_applicator]: 1.722e-05 [Cycle 2]: 0.00034296, [27] [switch_simplify]: 6.03998e-06 [loop_unroll]: 5.14998e-06 [a_1]: 9.33e-05 [with_stream_mark]: 1.413e-05 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.81998e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.64e-05 [j_node_and_user_rematch]: 8.29002e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 1.39998e-06 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.52e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.611e-05 [rewriter_after_opt_a]: 4.344e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.00073052 [jit_opt_b]: 5.267e-05, [1] [Cycle 1]: 4.419e-05, [2] [frontend_op_eliminate]: 1.637e-05 [inline_after_opt_a]: 1.704e-05 [cconv]: 3.132e-05 [loop_unroll]: 0.00047694 [jit_opt_after_cconv]: 0.0001585, [1] [Cycle 1]: 0.00015151, [11] [c_1]: 2.019e-05 [parameter_eliminate]: 4.3e-06 [updatestate_depend_eliminate]: 7.07002e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 3.187e-05 [call_graph_tuple_transform]: 2.011e-05 [tuple_list_get_item_eliminator]: 5.63002e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.41002e-06 [remove_dup_value]: 1.867e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 7.11001e-06 [add_recomputation]: 5.68e-05 [cse_after_recomputation]: 2.447e-05, [1] [Cycle 1]: 1.874e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.883e-05 [get_jit_bprop_graph]: 2.203e-05 [rewriter_after_jit_bprop_graph]: 6.68e-06 [opt_after_jit_grad]: 0.00052812 [symbol_engine_optimizer]: 7.629e-05, [1] [Cycle 1]: 6.793e-05, [6] [build]: 5.32999e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.02998e-06 [renormalize]: 7.60017e-07 [validate]: 4.42e-05 Sums bootstrap : 0.000309s : 0.74% type_inference : 0.036732s : 87.90% event_method : 0.000021s : 0.05% auto_monad : 0.000069s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000104s : 0.25% rewriter_before_opt_a : 0.000085s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.16% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000669s : 1.60% jit_opt_a.with_stream_mark : 0.000042s : 0.10% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001149s : 2.75% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000055s : 0.13% jit_opt_a.replace_applicator : 0.000023s : 0.06% py_interpret_to_execute_after_opt_a : 0.000016s : 0.04% rewriter_after_opt_a : 0.000043s : 0.10% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000731s : 1.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000031s : 0.07% loop_unroll : 0.000477s : 1.14% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000057s : 0.14% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000022s : 0.05% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000528s : 1.26% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.11% Time group info: ------[substitution.] 0.000246 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000005s : 3: substitution.graph_param_transform 85.22% : 0.000209s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000005s : 2: substitution.replace_old_param 5.69% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036651 2 94.16% : 0.034511s : 1: type_inference.infer 5.84% : 0.002140s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.34% : 0.000049s : 4: replace.inline 31.66% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.14% : 0.000207s : 4: match.inline 5.86% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.70% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.10% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.25% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.72% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 22: predicate.inline 1.03% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.54% : 0.000002s : 15: predicate.load_eliminater 1.76% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 3.08% : 0.000004s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.20% : 0.000001s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.56% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.34% : 0.000002s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.75% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.48% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000880 13 41.52% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.10% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.38% : 0.000461s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048165 72 0.12% : 0.000060s : 1: add_recomputation 0.15% : 0.000073s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.68% : 0.000326s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.05% : 0.000025s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.90% : 0.006215s : 1: jit_opt_a 0.33% : 0.000161s : 1: jit_opt_after_cconv 0.12% : 0.000056s : 1: jit_opt_b 1.01% : 0.000487s : 1: loop_unroll 1.54% : 0.000743s : 1: mutable_eliminate 1.86% : 0.000898s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.12% : 0.000538s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000108s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.33% : 0.000640s : 1: renormalize.infer 1.03% : 0.000498s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000046s : 1: rewriter_after_opt_a 0.18% : 0.000088s : 1: rewriter_before_opt_a 0.16% : 0.000079s : 1: symbol_engine_optimizer 76.31% : 0.036755s : 1: type_inference TotalTime = 0.07505, [30] [bootstrap]: 0.00027194 [type_inference]: 0.021114 [event_method]: 2.076e-05 [auto_monad]: 7.363e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 0.00013921 [rewriter_before_opt_a]: 8.572e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.0510546, [2] [Cycle 1]: 0.0020877, [27] [switch_simplify]: 6.618e-05 [loop_unroll]: 2.989e-05 [a_1]: 0.00060518 [with_stream_mark]: 2.568e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.23002e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 5.70001e-06 [renormalize]: 0.00100326 [add_forward_monad_depend]: 6.49001e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.685e-05 [cse]: 3.648e-05 [replace_applicator]: 1.496e-05 [Cycle 2]: 0.00034888, [27] [switch_simplify]: 6.60002e-06 [loop_unroll]: 5.40999e-06 [a_1]: 9.287e-05 [with_stream_mark]: 1.036e-05 [recompute_prepare]: 5.00999e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.21002e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 2.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.78999e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.363e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.381e-05 [rewriter_after_opt_a]: 4.131e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00069672 [jit_opt_b]: 5.003e-05, [1] [Cycle 1]: 4.25e-05, [2] [frontend_op_eliminate]: 1.566e-05 [inline_after_opt_a]: 1.669e-05 [cconv]: 2.914e-05 [loop_unroll]: 0.0004193 [jit_opt_after_cconv]: 0.00014887, [1] [Cycle 1]: 0.00014242, [11] [c_1]: 2.025e-05 [parameter_eliminate]: 3.09001e-06 [updatestate_depend_eliminate]: 7.06001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.705e-05 [call_graph_tuple_transform]: 1.934e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 6.99976e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 3.041e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.39001e-06 [add_recomputation]: 5.202e-05 [cse_after_recomputation]: 2.395e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.238e-05 [auto_monad_reorder]: 1.719e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 4.86997e-06 [opt_after_jit_grad]: 0.00044453 [symbol_engine_optimizer]: 7.233e-05, [1] [Cycle 1]: 6.617e-05, [6] [build]: 3.98001e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.272e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 8.93002e-06 [renormalize]: 3.20026e-07 [validate]: 4.194e-05 Sums bootstrap : 0.000272s : 1.05% type_inference : 0.021114s : 81.73% event_method : 0.000021s : 0.08% auto_monad : 0.000074s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000139s : 0.54% rewriter_before_opt_a : 0.000086s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000698s : 2.70% jit_opt_a.with_stream_mark : 0.000036s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001003s : 3.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000041s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000697s : 2.70% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000419s : 1.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000030s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000445s : 1.72% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.16% Time group info: ------[substitution.] 0.000266 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 86.32% : 0.000229s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021032 2 91.61% : 0.019267s : 1: type_inference.infer 8.39% : 0.001764s : 1: type_inference.specialize ------[replace.] 0.000080 6 70.34% : 0.000056s : 4: replace.inline 29.66% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 6 95.08% : 0.000227s : 4: match.inline 4.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.36% : 0.000002s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.24% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.84% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.72% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.71% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000826 13 41.59% : 0.000343s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.12% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.28% : 0.000423s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077037 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000077s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.37% : 0.000282s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 66.28% : 0.051058s : 1: jit_opt_a 0.20% : 0.000152s : 1: jit_opt_after_cconv 0.07% : 0.000053s : 1: jit_opt_b 0.56% : 0.000428s : 1: loop_unroll 0.92% : 0.000706s : 1: mutable_eliminate 1.21% : 0.000929s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000143s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000033s : 1: remove_dup_value 0.75% : 0.000581s : 1: renormalize.infer 0.54% : 0.000414s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000089s : 1: rewriter_before_opt_a 0.10% : 0.000075s : 1: symbol_engine_optimizer 27.43% : 0.021134s : 1: type_inference TotalTime = 0.0934521, [30] [bootstrap]: 0.00024797 [type_inference]: 0.0655066 [event_method]: 0.00030419 [auto_monad]: 0.00011264 [graph_reusing]: 6.91001e-06 [pre_auto_parallel]: 3.36001e-06 [py_interpret_to_execute]: 3.496e-05 [rewriter_before_opt_a]: 0.00013037 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.0248343, [3] [Cycle 1]: 0.0169718, [27] [switch_simplify]: 7.635e-05 [loop_unroll]: 4.825e-05 [a_1]: 0.00098245 [with_stream_mark]: 2.987e-05 [recompute_prepare]: 2.149e-05 [updatestate_depend_eliminate]: 9.89999e-06 [updatestate_assign_eliminate]: 7.08e-06 [updatestate_loads_eliminate]: 6.71e-06 [parameter_eliminate]: 2.98e-06 [specialize_transform]: 1.534e-05 [updatestate_useless_node_eliminater]: 1.394e-05 [accelerated_algorithm]: 1.394e-05 [meta_shard_fg_expand]: 3.54002e-06 [get_grad_eliminate_]: 1.365e-05 [merge_forward]: 8.72998e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.85e-05 [j_node_and_user_rematch]: 2.444e-05 [meta_fg_expand]: 0.00173674 [replace_old_param]: 7.019e-05 [inline_without_move]: 5.963e-05 [renormalize]: 0.0131153 [add_forward_monad_depend]: 1.146e-05 [auto_monad_grad]: 6.98998e-06 [auto_monad_eliminator]: 6.436e-05 [cse]: 0.00026186 [replace_applicator]: 8.773e-05 [Cycle 2]: 0.00403669, [27] [switch_simplify]: 4.514e-05 [loop_unroll]: 4.379e-05 [a_1]: 0.00123814 [with_stream_mark]: 2.029e-05 [recompute_prepare]: 1.309e-05 [updatestate_depend_eliminate]: 5.43002e-06 [updatestate_assign_eliminate]: 4.13001e-06 [updatestate_loads_eliminate]: 4.51002e-06 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 8.85999e-06 [updatestate_useless_node_eliminater]: 8.52e-06 [accelerated_algorithm]: 8.23999e-06 [meta_shard_fg_expand]: 3.23e-06 [get_grad_eliminate_]: 7.93001e-06 [merge_forward]: 5.20999e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.021e-05 [j_node_and_user_rematch]: 1.38e-05 [meta_fg_expand]: 0.00011564 [replace_old_param]: 9.86998e-06 [inline_without_move]: 7.79002e-06 [renormalize]: 0.00218394 [add_forward_monad_depend]: 5.74999e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.318e-05 [cse]: 2.653e-05 [replace_applicator]: 1.277e-05 [Cycle 3]: 0.00025213, [27] [switch_simplify]: 4.48001e-06 [loop_unroll]: 4.02e-06 [a_1]: 4.338e-05 [with_stream_mark]: 1.076e-05 [recompute_prepare]: 3.8e-06 [updatestate_depend_eliminate]: 2.29001e-06 [updatestate_assign_eliminate]: 1.99e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 3.45e-06 [updatestate_useless_node_eliminater]: 3.11999e-06 [accelerated_algorithm]: 3.38e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 3.48999e-06 [merge_forward]: 2.44999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.091e-05 [j_node_and_user_rematch]: 5.52999e-06 [meta_fg_expand]: 1.35999e-06 [replace_old_param]: 3.13e-06 [inline_without_move]: 3.22002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 3.41999e-06 [cse]: 7.36999e-06 [replace_applicator]: 3.36999e-06 [py_interpret_to_execute_after_opt_a]: 1.163e-05 [rewriter_after_opt_a]: 3.515e-05 [convert_after_rewriter]: 6.27001e-06 [order_py_execute_after_rewriter]: 5.47999e-06 [mutable_eliminate]: 0.00070891 [jit_opt_b]: 4.159e-05, [1] [Cycle 1]: 3.443e-05, [2] [frontend_op_eliminate]: 1.075e-05 [inline_after_opt_a]: 1.125e-05 [cconv]: 2.362e-05 [loop_unroll]: 0.00048904 [jit_opt_after_cconv]: 0.00012619, [1] [Cycle 1]: 0.00011996, [11] [c_1]: 1.229e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 4.82998e-06 [updatestate_assign_eliminate]: 1.74e-06 [updatestate_loads_eliminate]: 1.54e-06 [cse]: 2e-05 [call_graph_tuple_transform]: 1.368e-05 [tuple_list_get_item_eliminator]: 3.6e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 3.63e-06 [remove_dup_value]: 1.406e-05 [partial_unused_args_eliminate]: 1.92001e-06 [environ_conv]: 4.95001e-06 [add_recomputation]: 3.464e-05 [cse_after_recomputation]: 1.859e-05, [1] [Cycle 1]: 1.312e-05, [1] [cse]: 7.08e-06 [auto_monad_reorder]: 1.351e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 5.23002e-06 [opt_after_jit_grad]: 0.0004353 [symbol_engine_optimizer]: 6.4e-05, [1] [Cycle 1]: 5.809e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 5.55001e-06 [elim_not_effective]: 9.37001e-06 [opt_reshape]: 4.11001e-06 [fold_const_symbol]: 6.12999e-06 [renormalize]: 3.30008e-07 [validate]: 3.17e-05 Sums bootstrap : 0.000248s : 0.28% type_inference : 0.065507s : 73.62% event_method : 0.000304s : 0.34% auto_monad : 0.000113s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000035s : 0.04% rewriter_before_opt_a : 0.000130s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.14% jit_opt_a.loop_unroll : 0.000096s : 0.11% jit_opt_a.a_1 : 0.002264s : 2.54% jit_opt_a.with_stream_mark : 0.000061s : 0.07% jit_opt_a.recompute_prepare : 0.000038s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.02% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.03% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.05% jit_opt_a.meta_fg_expand : 0.001854s : 2.08% jit_opt_a.replace_old_param : 0.000083s : 0.09% jit_opt_a.inline_without_move : 0.000071s : 0.08% jit_opt_a.renormalize : 0.015299s : 17.19% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.09% jit_opt_a.cse : 0.000296s : 0.33% jit_opt_a.replace_applicator : 0.000104s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000709s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000024s : 0.03% loop_unroll : 0.000489s : 0.55% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000035s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000435s : 0.49% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.04% Time group info: ------[substitution.] 0.000554 107 0.30% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.74% : 0.000004s : 1: substitution.graph_param_transform 63.82% : 0.000354s : 13: substitution.inline 2.97% : 0.000016s : 2: substitution.inline_without_move 1.73% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.00% : 0.000011s : 7: substitution.minmaximum_grad 1.34% : 0.000007s : 5: substitution.partial_eliminate 1.99% : 0.000011s : 13: substitution.remove_not_recompute_node 5.47% : 0.000030s : 10: substitution.replace_applicator 1.61% : 0.000009s : 10: substitution.replace_old_param 1.34% : 0.000007s : 1: substitution.reshape_eliminate 0.47% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.15% : 0.000006s : 1: substitution.tile_eliminate 3.93% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.82% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.15% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065404 2 96.21% : 0.062927s : 1: type_inference.infer 3.79% : 0.002477s : 1: type_inference.specialize ------[replace.] 0.000178 20 65.02% : 0.000116s : 13: replace.inline 34.98% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000368 20 93.84% : 0.000346s : 13: match.inline 6.16% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000387 2768 1.58% : 0.000006s : 48: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.57% : 0.000006s : 48: predicate.addn_check_dump 1.59% : 0.000006s : 48: predicate.addn_zero_filter 2.04% : 0.000008s : 48: predicate.arithmetic_simplify 1.58% : 0.000006s : 48: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.50% : 0.000006s : 48: predicate.compare_switch_simplify 1.47% : 0.000006s : 48: predicate.depend_value_elim 1.54% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.57% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.69% : 0.000007s : 48: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.46% : 0.000006s : 48: predicate.environ_get_depend_swap 1.53% : 0.000006s : 48: predicate.environ_get_eliminate 1.46% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.85% : 0.000003s : 20: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 3.94% : 0.000015s : 70: predicate.inline 2.06% : 0.000008s : 48: predicate.inline_without_move 0.38% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.06% : 0.000004s : 20: predicate.less_batch_normalization 1.90% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.82% : 0.000007s : 56: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.53% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.77% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.48% : 0.000006s : 48: predicate.merge_addn 1.50% : 0.000006s : 48: predicate.minmaximum_grad 0.31% : 0.000001s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.28% : 0.000009s : 56: predicate.partial_eliminate 1.54% : 0.000006s : 48: predicate.print_const_string_wrapper 1.96% : 0.000008s : 48: predicate.reduce_eliminate 1.87% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 20: predicate.remove_not_recompute_node 2.75% : 0.000011s : 103: predicate.replace_applicator 1.09% : 0.000004s : 48: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.63% : 0.000006s : 48: predicate.reshape_eliminate 1.52% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.50% : 0.000006s : 48: predicate.same_eliminate 0.50% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 20: predicate.specialize_transform 1.85% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.67% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.68% : 0.000010s : 68: predicate.switch_defer_inline 2.61% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.63% : 0.000026s : 170: predicate.switch_simplify 1.62% : 0.000006s : 48: predicate.tile_eliminate 1.58% : 0.000006s : 48: predicate.transpose_eliminate 2.05% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 2.07% : 0.000008s : 48: predicate.tuple_list_get_item_depend_reorder 2.91% : 0.000011s : 57: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 48: predicate.tuple_list_set_item_eliminator 1.84% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.92% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.75% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.87% : 0.000007s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003986 52 75.79% : 0.003021s : 35: func_graph_cloner_run.FuncGraphClonerGraph 24.21% : 0.000965s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111686 87 0.03% : 0.000037s : 1: add_recomputation 0.11% : 0.000119s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000275s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.28% : 0.000312s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.24% : 0.024837s : 1: jit_opt_a 0.12% : 0.000129s : 1: jit_opt_after_cconv 0.04% : 0.000044s : 1: jit_opt_b 0.44% : 0.000497s : 1: loop_unroll 0.64% : 0.000717s : 1: mutable_eliminate 2.63% : 0.002939s : 39: opt.transform.jit_opt_a 0.03% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000038s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 11.60% : 0.012959s : 2: renormalize.infer 2.08% : 0.002319s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.12% : 0.000133s : 1: rewriter_before_opt_a 0.06% : 0.000066s : 1: symbol_engine_optimizer 58.67% : 0.065528s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.401.8 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.470.6 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.238465, [30] [bootstrap]: 0.00034344 [type_inference]: 0.214739 [event_method]: 2.301e-05 [auto_monad]: 7.285e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.0004357 [rewriter_before_opt_a]: 0.00010892 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0201438, [2] [Cycle 1]: 0.0164886, [27] [switch_simplify]: 0.00013801 [loop_unroll]: 3.506e-05 [a_1]: 0.0130435 [with_stream_mark]: 2.351e-05 [recompute_prepare]: 1.348e-05 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 6.91999e-06 [meta_shard_fg_expand]: 3.28e-06 [get_grad_eliminate_]: 6.97002e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 1.096e-05 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.128e-05 [inline_without_move]: 6.70002e-06 [renormalize]: 0.00280757 [add_forward_monad_depend]: 1.004e-05 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 3.883e-05 [replace_applicator]: 2.235e-05 [Cycle 2]: 0.0003925, [27] [switch_simplify]: 7.55e-06 [loop_unroll]: 6.03998e-06 [a_1]: 0.00012507 [with_stream_mark]: 1.419e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 4.91997e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.812e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.84999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.472e-05 [replace_applicator]: 6.86999e-06 [py_interpret_to_execute_after_opt_a]: 1.422e-05 [rewriter_after_opt_a]: 4.208e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 5.01997e-06 [mutable_eliminate]: 0.00073099 [jit_opt_b]: 0.00010322, [1] [Cycle 1]: 9.583e-05, [2] [frontend_op_eliminate]: 6.329e-05 [inline_after_opt_a]: 1.869e-05 [cconv]: 3.117e-05 [loop_unroll]: 0.00045176 [jit_opt_after_cconv]: 0.00016765, [1] [Cycle 1]: 0.00016091, [11] [c_1]: 2.656e-05 [parameter_eliminate]: 3.01999e-06 [updatestate_depend_eliminate]: 6.75002e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 2.968e-05 [call_graph_tuple_transform]: 2.219e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 9.90025e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.897e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 9.33002e-06 [add_recomputation]: 5.164e-05 [cse_after_recomputation]: 2.617e-05, [1] [Cycle 1]: 2.104e-05, [1] [cse]: 1.386e-05 [auto_monad_reorder]: 1.786e-05 [get_jit_bprop_graph]: 3.66001e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00047956 [symbol_engine_optimizer]: 8.205e-05, [1] [Cycle 1]: 7.569e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 1.13e-05 [elim_not_effective]: 1.593e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 1.161e-05 [renormalize]: 6.09987e-07 [validate]: 0.00015922 Sums bootstrap : 0.000343s : 0.15% type_inference : 0.214739s : 91.55% event_method : 0.000023s : 0.01% auto_monad : 0.000073s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000436s : 0.19% rewriter_before_opt_a : 0.000109s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000146s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.013169s : 5.61% jit_opt_a.with_stream_mark : 0.000038s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002808s : 1.20% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000054s : 0.02% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000731s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000063s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000452s : 0.19% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000052s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.20% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000159s : 0.07% Time group info: ------[substitution.] 0.000333 25 1.46% : 0.000005s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.91% : 0.000006s : 4: substitution.graph_param_transform 86.72% : 0.000289s : 5: substitution.inline 1.43% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000006s : 4: substitution.remove_not_recompute_node 1.76% : 0.000006s : 2: substitution.replace_old_param 4.64% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.214640 2 98.71% : 0.211869s : 1: type_inference.infer 1.29% : 0.002771s : 1: type_inference.specialize ------[replace.] 0.012307 7 99.65% : 0.012264s : 5: replace.inline 0.35% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000300 7 95.30% : 0.000286s : 5: match.inline 4.70% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 2.34% : 0.000004s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.40% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.42% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.98% : 0.000010s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.94% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.47% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.58% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.81% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.46% : 0.000002s : 13: predicate.reshape_eliminate 1.37% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.66% : 0.000001s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 4.78% : 0.000008s : 20: predicate.switch_defer_inline 1.97% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.86% : 0.000011s : 64: predicate.switch_simplify 1.15% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.54% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.64% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002498 25 66.33% : 0.001657s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.03% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.64% : 0.000740s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.254718 72 0.02% : 0.000055s : 1: add_recomputation 0.03% : 0.000076s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.14% : 0.000361s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 7.91% : 0.020147s : 1: jit_opt_a 0.07% : 0.000170s : 1: jit_opt_after_cconv 0.04% : 0.000106s : 1: jit_opt_b 0.18% : 0.000460s : 1: loop_unroll 0.29% : 0.000740s : 1: mutable_eliminate 5.28% : 0.013437s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000075s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000488s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000441s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.77% : 0.001960s : 1: renormalize.infer 0.33% : 0.000836s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.04% : 0.000115s : 1: rewriter_before_opt_a 0.03% : 0.000084s : 1: symbol_engine_optimizer 84.31% : 0.214752s : 1: type_inference TotalTime = 0.0329017, [30] [bootstrap]: 0.00026491 [type_inference]: 0.0239942 [event_method]: 4.882e-05 [auto_monad]: 7.286e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00012473 [rewriter_before_opt_a]: 8.359e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00595587, [2] [Cycle 1]: 0.00200773, [27] [switch_simplify]: 0.00010555 [loop_unroll]: 2.96e-05 [a_1]: 0.00055546 [with_stream_mark]: 1.786e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 5.83002e-06 [merge_forward]: 3.67998e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.33002e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00097878 [add_forward_monad_depend]: 5.74e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.44e-05 [cse]: 2.007e-05 [replace_applicator]: 1.248e-05 [Cycle 2]: 0.00031371, [27] [switch_simplify]: 5.41998e-06 [loop_unroll]: 5.09e-06 [a_1]: 8.796e-05 [with_stream_mark]: 8.65001e-06 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.32e-05 [j_node_and_user_rematch]: 8.08999e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.28e-06 [inline_without_move]: 5.11997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 1.11997e-06 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.236e-05 [replace_applicator]: 5.14003e-06 [py_interpret_to_execute_after_opt_a]: 1.157e-05 [rewriter_after_opt_a]: 3.628e-05 [convert_after_rewriter]: 6.44999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00056167 [jit_opt_b]: 4.934e-05, [1] [Cycle 1]: 4.288e-05, [2] [frontend_op_eliminate]: 1.696e-05 [inline_after_opt_a]: 1.537e-05 [cconv]: 2.422e-05 [loop_unroll]: 0.00056761 [jit_opt_after_cconv]: 0.00013783, [1] [Cycle 1]: 0.00013141, [11] [c_1]: 2.106e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 1.978e-05 [call_graph_tuple_transform]: 1.871e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.23002e-06 [remove_dup_value]: 1.464e-05 [partial_unused_args_eliminate]: 2.83e-06 [environ_conv]: 5.92001e-06 [add_recomputation]: 4.645e-05 [cse_after_recomputation]: 2.148e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.124e-05 [auto_monad_reorder]: 1.72e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 4.55999e-06 [opt_after_jit_grad]: 0.00054168 [symbol_engine_optimizer]: 7.343e-05, [1] [Cycle 1]: 6.666e-05, [6] [build]: 3.49001e-06 [elim_shapecalc]: 8.40999e-06 [elim_not_effective]: 1.319e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 8.60001e-06 [renormalize]: 3.10014e-07 [validate]: 3.772e-05 Sums bootstrap : 0.000265s : 0.92% type_inference : 0.023994s : 83.61% event_method : 0.000049s : 0.17% auto_monad : 0.000073s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000125s : 0.43% rewriter_before_opt_a : 0.000084s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000111s : 0.39% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000643s : 2.24% jit_opt_a.with_stream_mark : 0.000027s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000979s : 3.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000032s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000036s : 0.13% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000562s : 1.96% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000024s : 0.08% loop_unroll : 0.000568s : 1.98% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000046s : 0.16% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000542s : 1.89% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.13% Time group info: ------[substitution.] 0.000218 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 3: substitution.graph_param_transform 83.97% : 0.000183s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 6.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023922 2 92.87% : 0.022216s : 1: type_inference.infer 7.13% : 0.001706s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.35% : 0.000049s : 4: replace.inline 33.65% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 93.71% : 0.000181s : 4: match.inline 6.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.52% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.25% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.09% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.94% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.39% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.60% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.41% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.69% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000816 13 42.02% : 0.000343s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.41% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.57% : 0.000429s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034844 72 0.14% : 0.000050s : 1: add_recomputation 0.22% : 0.000076s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.81% : 0.000283s : 1: bootstrap 0.08% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.15% : 0.000053s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.10% : 0.005959s : 1: jit_opt_a 0.40% : 0.000140s : 1: jit_opt_after_cconv 0.15% : 0.000052s : 1: jit_opt_b 1.66% : 0.000577s : 1: loop_unroll 1.64% : 0.000570s : 1: mutable_eliminate 2.61% : 0.000910s : 26: opt.transform.jit_opt_a 0.13% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000551s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000128s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.60% : 0.000559s : 1: renormalize.infer 1.18% : 0.000412s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000039s : 1: rewriter_after_opt_a 0.25% : 0.000087s : 1: rewriter_before_opt_a 0.22% : 0.000076s : 1: symbol_engine_optimizer 68.90% : 0.024007s : 1: type_inference TotalTime = 0.177858, [30] [bootstrap]: 0.00036046 [type_inference]: 0.164944 [event_method]: 2.295e-05 [auto_monad]: 7.276e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00044775 [rewriter_before_opt_a]: 9.33e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.00918738, [2] [Cycle 1]: 0.0044175, [27] [switch_simplify]: 7.03e-05 [loop_unroll]: 3.556e-05 [a_1]: 0.00082658 [with_stream_mark]: 2.534e-05 [recompute_prepare]: 1.078e-05 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 7.92e-06 [updatestate_useless_node_eliminater]: 6.57002e-06 [accelerated_algorithm]: 7.11999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.95002e-06 [merge_forward]: 5.14e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.745e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.227e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00303648 [add_forward_monad_depend]: 9.53002e-06 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 2.082e-05 [cse]: 4.306e-05 [replace_applicator]: 2.004e-05 [Cycle 2]: 0.00044132, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00014243 [with_stream_mark]: 1.433e-05 [recompute_prepare]: 7.03e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.68003e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 1.872e-05 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 2.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.678e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 8.52e-06 [cse]: 1.66e-05 [replace_applicator]: 7.33999e-06 [py_interpret_to_execute_after_opt_a]: 1.864e-05 [rewriter_after_opt_a]: 4.497e-05 [convert_after_rewriter]: 8.02e-06 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.00080583 [jit_opt_b]: 6.456e-05, [1] [Cycle 1]: 5.531e-05, [2] [frontend_op_eliminate]: 2.127e-05 [inline_after_opt_a]: 2.107e-05 [cconv]: 3.011e-05 [loop_unroll]: 0.00049988 [jit_opt_after_cconv]: 0.00017089, [1] [Cycle 1]: 0.00016422, [11] [c_1]: 2.644e-05 [parameter_eliminate]: 3.51999e-06 [updatestate_depend_eliminate]: 6.92002e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 3.029e-05 [call_graph_tuple_transform]: 2.361e-05 [tuple_list_get_item_eliminator]: 7.01999e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.87002e-06 [remove_dup_value]: 1.983e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 8.77999e-06 [add_recomputation]: 5.591e-05 [cse_after_recomputation]: 2.603e-05, [1] [Cycle 1]: 2.004e-05, [1] [cse]: 1.372e-05 [auto_monad_reorder]: 1.938e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 6.68e-06 [opt_after_jit_grad]: 0.00056379 [symbol_engine_optimizer]: 9.862e-05, [1] [Cycle 1]: 9.18e-05, [6] [build]: 5.14003e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.5e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 2.651e-05 [renormalize]: 4.19997e-07 [validate]: 5.617e-05 Sums bootstrap : 0.000360s : 0.21% type_inference : 0.164944s : 95.43% event_method : 0.000023s : 0.01% auto_monad : 0.000073s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000448s : 0.26% rewriter_before_opt_a : 0.000093s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000969s : 0.56% jit_opt_a.with_stream_mark : 0.000040s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000026s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003037s : 1.76% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000060s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000806s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000500s : 0.29% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000564s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000027s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000326 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000007s : 4: substitution.graph_param_transform 83.44% : 0.000272s : 5: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.89% : 0.000013s : 3: substitution.reduce_eliminate 1.92% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000007s : 2: substitution.replace_old_param 4.31% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.164855 2 98.21% : 0.161900s : 1: type_inference.infer 1.79% : 0.002955s : 1: type_inference.specialize ------[replace.] 0.000168 7 77.07% : 0.000129s : 5: replace.inline 22.93% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000281 7 95.61% : 0.000269s : 5: match.inline 4.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.38% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 2.15% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.54% : 0.000001s : 4: predicate.graph_param_transform 5.88% : 0.000009s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.72% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.21% : 0.000002s : 13: predicate.minmaximum_grad 2.17% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.76% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.77% : 0.000003s : 13: predicate.reduce_eliminate 1.30% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.37% : 0.000011s : 64: predicate.switch_simplify 1.52% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002613 25 64.35% : 0.001681s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.36% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.29% : 0.000844s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.182236 72 0.03% : 0.000059s : 1: add_recomputation 0.04% : 0.000076s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.21% : 0.000381s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.04% : 0.009191s : 1: jit_opt_a 0.10% : 0.000174s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.28% : 0.000511s : 1: loop_unroll 0.45% : 0.000817s : 1: mutable_eliminate 0.69% : 0.001253s : 26: opt.transform.jit_opt_a 0.03% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000054s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000574s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000454s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.18% : 0.002152s : 1: renormalize.infer 0.48% : 0.000872s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.05% : 0.000099s : 1: rewriter_before_opt_a 0.06% : 0.000102s : 1: symbol_engine_optimizer 90.52% : 0.164966s : 1: type_inference TotalTime = 0.0148178, [30] [bootstrap]: 0.00026773 [type_inference]: 0.00435459 [event_method]: 1.883e-05 [auto_monad]: 6.478e-05 [graph_reusing]: 5.81998e-06 [pre_auto_parallel]: 2.90998e-06 [py_interpret_to_execute]: 3.255e-05 [rewriter_before_opt_a]: 7.408e-05 [expand_dump_flag]: 2.93e-06 [jit_opt_a]: 0.00700414, [2] [Cycle 1]: 0.00285282, [27] [switch_simplify]: 5.082e-05 [loop_unroll]: 2.946e-05 [a_1]: 0.00183037 [with_stream_mark]: 1.839e-05 [recompute_prepare]: 8.80001e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 2.28998e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 8.57998e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.50001e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00059602 [add_forward_monad_depend]: 5.32999e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.388e-05 [cse]: 3.345e-05 [replace_applicator]: 1.107e-05 [Cycle 2]: 0.00112791, [27] [switch_simplify]: 5.52001e-06 [loop_unroll]: 4.76002e-06 [a_1]: 0.00088502 [with_stream_mark]: 1.117e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.59998e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.265e-05 [j_node_and_user_rematch]: 7.46999e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 6.81001e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 6.94999e-06 [cse]: 1.672e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.125e-05 [rewriter_after_opt_a]: 3.55e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.72998e-06 [mutable_eliminate]: 0.001412 [jit_opt_b]: 4.985e-05, [1] [Cycle 1]: 4.253e-05, [2] [frontend_op_eliminate]: 1.578e-05 [inline_after_opt_a]: 1.593e-05 [cconv]: 2.766e-05 [loop_unroll]: 0.00044491 [jit_opt_after_cconv]: 0.00015488, [1] [Cycle 1]: 0.00014795, [11] [c_1]: 2.027e-05 [parameter_eliminate]: 3.81001e-06 [updatestate_depend_eliminate]: 7.97998e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.238e-05 [call_graph_tuple_transform]: 1.9e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.60001e-06 [remove_dup_value]: 1.646e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.019e-05 [cse_after_recomputation]: 2.289e-05, [1] [Cycle 1]: 1.764e-05, [1] [cse]: 1.202e-05 [auto_monad_reorder]: 1.863e-05 [get_jit_bprop_graph]: 2.20002e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00044192 [symbol_engine_optimizer]: 7.012e-05, [1] [Cycle 1]: 6.401e-05, [6] [build]: 3.38999e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.25e-05 [opt_reshape]: 5.63002e-06 [fold_const_symbol]: 8.33001e-06 [renormalize]: 4.09986e-07 [validate]: 3.934e-05 Sums bootstrap : 0.000268s : 2.39% type_inference : 0.004355s : 38.83% event_method : 0.000019s : 0.17% auto_monad : 0.000065s : 0.58% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000033s : 0.29% rewriter_before_opt_a : 0.000074s : 0.66% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000056s : 0.50% jit_opt_a.loop_unroll : 0.000034s : 0.31% jit_opt_a.a_1 : 0.002715s : 24.21% jit_opt_a.with_stream_mark : 0.000030s : 0.26% jit_opt_a.recompute_prepare : 0.000015s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000596s : 5.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.19% jit_opt_a.cse : 0.000050s : 0.45% jit_opt_a.replace_applicator : 0.000016s : 0.14% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000036s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.001412s : 12.59% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000028s : 0.25% loop_unroll : 0.000445s : 3.97% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000050s : 0.45% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000019s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000442s : 3.94% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.35% Time group info: ------[substitution.] 0.000206 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000006s : 3: substitution.graph_param_transform 84.04% : 0.000173s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000004s : 2: substitution.replace_old_param 6.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004295 2 81.56% : 0.003503s : 1: type_inference.infer 18.44% : 0.000792s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.11% : 0.000045s : 4: replace.inline 32.89% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.60% : 0.000171s : 4: match.inline 6.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 2.96% : 0.000003s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.32% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.75% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.33% : 0.000008s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000588 13 53.93% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.40% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.67% : 0.000233s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018388 72 0.29% : 0.000053s : 1: add_recomputation 0.37% : 0.000068s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.55% : 0.000284s : 1: bootstrap 0.16% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 38.11% : 0.007007s : 1: jit_opt_a 0.86% : 0.000157s : 1: jit_opt_after_cconv 0.29% : 0.000052s : 1: jit_opt_b 2.46% : 0.000452s : 1: loop_unroll 7.74% : 0.001423s : 1: mutable_eliminate 15.88% : 0.002921s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.45% : 0.000450s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000035s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 1.78% : 0.000328s : 1: renormalize.infer 1.42% : 0.000261s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000038s : 1: rewriter_after_opt_a 0.42% : 0.000077s : 1: rewriter_before_opt_a 0.39% : 0.000073s : 1: symbol_engine_optimizer 23.76% : 0.004369s : 1: type_inference TotalTime = 0.0942216, [30] [bootstrap]: 0.0002332 [type_inference]: 0.0658688 [event_method]: 0.00031724 [auto_monad]: 0.00011004 [graph_reusing]: 6.98998e-06 [pre_auto_parallel]: 3.16001e-06 [py_interpret_to_execute]: 3.85e-05 [rewriter_before_opt_a]: 0.00012822 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.0252788, [3] [Cycle 1]: 0.0174975, [27] [switch_simplify]: 7.997e-05 [loop_unroll]: 4.712e-05 [a_1]: 0.00103605 [with_stream_mark]: 3.269e-05 [recompute_prepare]: 2.147e-05 [updatestate_depend_eliminate]: 9.19e-06 [updatestate_assign_eliminate]: 6.86001e-06 [updatestate_loads_eliminate]: 7.35e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 1.547e-05 [updatestate_useless_node_eliminater]: 1.386e-05 [accelerated_algorithm]: 1.44e-05 [meta_shard_fg_expand]: 3.91999e-06 [get_grad_eliminate_]: 1.383e-05 [merge_forward]: 8.99998e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.915e-05 [j_node_and_user_rematch]: 2.517e-05 [meta_fg_expand]: 0.00184524 [replace_old_param]: 6.907e-05 [inline_without_move]: 6.261e-05 [renormalize]: 0.0134652 [add_forward_monad_depend]: 1.251e-05 [auto_monad_grad]: 6.44001e-06 [auto_monad_eliminator]: 6.213e-05 [cse]: 0.00025674 [replace_applicator]: 8.845e-05 [Cycle 2]: 0.00381539, [27] [switch_simplify]: 4.364e-05 [loop_unroll]: 4.206e-05 [a_1]: 0.00124904 [with_stream_mark]: 2.087e-05 [recompute_prepare]: 1.268e-05 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 4.22e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 7.11999e-06 [updatestate_useless_node_eliminater]: 7.02002e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.82998e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 1.163e-05 [meta_fg_expand]: 0.00011443 [replace_old_param]: 7.98001e-06 [inline_without_move]: 6.83e-06 [renormalize]: 0.0019957 [add_forward_monad_depend]: 6.67002e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.3e-05 [cse]: 2.564e-05 [replace_applicator]: 1.401e-05 [Cycle 3]: 0.00025163, [27] [switch_simplify]: 4.15999e-06 [loop_unroll]: 3.65e-06 [a_1]: 4.248e-05 [with_stream_mark]: 9.89999e-06 [recompute_prepare]: 3.56001e-06 [updatestate_depend_eliminate]: 2.39999e-06 [updatestate_assign_eliminate]: 1.74e-06 [updatestate_loads_eliminate]: 1.54e-06 [parameter_eliminate]: 1.11997e-06 [specialize_transform]: 3.46999e-06 [updatestate_useless_node_eliminater]: 3.18e-06 [accelerated_algorithm]: 3.61001e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 3.21001e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.075e-05 [j_node_and_user_rematch]: 5.73002e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 3.11001e-06 [inline_without_move]: 3.16999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 3.63e-06 [cse]: 8.85999e-06 [replace_applicator]: 3.65003e-06 [py_interpret_to_execute_after_opt_a]: 1.138e-05 [rewriter_after_opt_a]: 3.475e-05 [convert_after_rewriter]: 5.69e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00073349 [jit_opt_b]: 4.188e-05, [1] [Cycle 1]: 3.458e-05, [2] [frontend_op_eliminate]: 1.096e-05 [inline_after_opt_a]: 1.194e-05 [cconv]: 2.69e-05 [loop_unroll]: 0.00042602 [jit_opt_after_cconv]: 0.00012688, [1] [Cycle 1]: 0.00011966, [11] [c_1]: 1.358e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 1.82999e-06 [updatestate_loads_eliminate]: 1.69e-06 [cse]: 1.903e-05 [call_graph_tuple_transform]: 1.492e-05 [tuple_list_get_item_eliminator]: 3.78999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 3.6e-06 [remove_dup_value]: 1.406e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 5.19998e-06 [add_recomputation]: 3.617e-05 [cse_after_recomputation]: 1.907e-05, [1] [Cycle 1]: 1.426e-05, [1] [cse]: 8.33001e-06 [auto_monad_reorder]: 1.401e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 4.99e-06 [opt_after_jit_grad]: 0.00043172 [symbol_engine_optimizer]: 6.584e-05, [1] [Cycle 1]: 6.02e-05, [6] [build]: 3.80998e-06 [elim_shapecalc]: 5.90002e-06 [elim_not_effective]: 9.51e-06 [opt_reshape]: 4.57e-06 [fold_const_symbol]: 5.74e-06 [renormalize]: 3.10014e-07 [validate]: 3.222e-05 Sums bootstrap : 0.000233s : 0.26% type_inference : 0.065869s : 73.49% event_method : 0.000317s : 0.35% auto_monad : 0.000110s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.04% rewriter_before_opt_a : 0.000128s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000128s : 0.14% jit_opt_a.loop_unroll : 0.000093s : 0.10% jit_opt_a.a_1 : 0.002328s : 2.60% jit_opt_a.with_stream_mark : 0.000063s : 0.07% jit_opt_a.recompute_prepare : 0.000038s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.05% jit_opt_a.meta_fg_expand : 0.001961s : 2.19% jit_opt_a.replace_old_param : 0.000080s : 0.09% jit_opt_a.inline_without_move : 0.000073s : 0.08% jit_opt_a.renormalize : 0.015461s : 17.25% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000079s : 0.09% jit_opt_a.cse : 0.000291s : 0.32% jit_opt_a.replace_applicator : 0.000106s : 0.12% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000733s : 0.82% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.03% loop_unroll : 0.000426s : 0.48% jit_opt_after_cconv.c_1 : 0.000014s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000432s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.04% Time group info: ------[substitution.] 0.000570 104 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.80% : 0.000005s : 1: substitution.graph_param_transform 66.92% : 0.000381s : 13: substitution.inline 3.36% : 0.000019s : 2: substitution.inline_without_move 1.67% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.89% : 0.000011s : 7: substitution.minmaximum_grad 1.30% : 0.000007s : 5: substitution.partial_eliminate 1.84% : 0.000010s : 12: substitution.remove_not_recompute_node 5.47% : 0.000031s : 10: substitution.replace_applicator 1.16% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.16% : 0.000007s : 1: substitution.tile_eliminate 3.84% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.61% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.04% : 0.000040s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065763 2 96.17% : 0.063241s : 1: type_inference.infer 3.83% : 0.002521s : 1: type_inference.specialize ------[replace.] 0.000189 20 63.76% : 0.000121s : 13: replace.inline 36.24% : 0.000069s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000393 20 95.02% : 0.000374s : 13: match.inline 4.98% : 0.000020s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000383 2656 1.61% : 0.000006s : 46: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 46: predicate.addn_check_dump 1.85% : 0.000007s : 46: predicate.addn_zero_filter 2.02% : 0.000008s : 46: predicate.arithmetic_simplify 1.83% : 0.000007s : 46: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 46: predicate.compare_switch_simplify 1.47% : 0.000006s : 46: predicate.depend_value_elim 1.57% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.58% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.50% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.52% : 0.000006s : 46: predicate.environ_get_depend_swap 1.55% : 0.000006s : 46: predicate.environ_get_eliminate 1.41% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.04% : 0.000015s : 68: predicate.inline 2.02% : 0.000008s : 46: predicate.inline_without_move 0.33% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.93% : 0.000004s : 18: predicate.less_batch_normalization 1.96% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 54: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.46% : 0.000013s : 99: predicate.loop_unroll_before_grad 1.89% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.47% : 0.000006s : 46: predicate.merge_addn 1.62% : 0.000006s : 46: predicate.minmaximum_grad 0.55% : 0.000002s : 1: predicate.mutable_eliminate 0.13% : 0.000001s : 1: predicate.opt_reshape 2.20% : 0.000008s : 54: predicate.partial_eliminate 1.68% : 0.000006s : 46: predicate.print_const_string_wrapper 2.13% : 0.000008s : 46: predicate.reduce_eliminate 1.78% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 18: predicate.remove_not_recompute_node 2.87% : 0.000011s : 99: predicate.replace_applicator 1.02% : 0.000004s : 46: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.63% : 0.000006s : 46: predicate.reshape_eliminate 1.72% : 0.000007s : 46: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.55% : 0.000006s : 46: predicate.same_eliminate 0.55% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 18: predicate.specialize_transform 1.79% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.63% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.89% : 0.000011s : 66: predicate.switch_defer_inline 2.66% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.45% : 0.000025s : 166: predicate.switch_simplify 1.54% : 0.000006s : 46: predicate.tile_eliminate 1.56% : 0.000006s : 46: predicate.transpose_eliminate 1.86% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000006s : 46: predicate.tuple_list_get_item_depend_reorder 2.92% : 0.000011s : 55: predicate.tuple_list_get_item_eliminator 1.81% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.77% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.84% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.71% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 2.06% : 0.000008s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004140 52 76.38% : 0.003162s : 35: func_graph_cloner_run.FuncGraphClonerGraph 23.62% : 0.000978s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112675 87 0.03% : 0.000039s : 1: add_recomputation 0.10% : 0.000117s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.23% : 0.000258s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.29% : 0.000327s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.44% : 0.025282s : 1: jit_opt_a 0.12% : 0.000130s : 1: jit_opt_after_cconv 0.04% : 0.000044s : 1: jit_opt_b 0.38% : 0.000434s : 1: loop_unroll 0.66% : 0.000742s : 1: mutable_eliminate 2.66% : 0.002992s : 39: opt.transform.jit_opt_a 0.03% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000440s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 11.65% : 0.013131s : 2: renormalize.infer 2.05% : 0.002309s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.12% : 0.000131s : 1: rewriter_before_opt_a 0.06% : 0.000068s : 1: symbol_engine_optimizer 58.48% : 0.065893s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.106.485 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006daf0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.107.074 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.028478, [30] [bootstrap]: 0.00032874 [type_inference]: 0.0196926 [event_method]: 2.049e-05 [auto_monad]: 7.087e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 0.00010957 [rewriter_before_opt_a]: 8.334e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00601367, [2] [Cycle 1]: 0.00204181, [27] [switch_simplify]: 6.225e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.00058306 [with_stream_mark]: 2.159e-05 [recompute_prepare]: 7.35003e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00099959 [add_forward_monad_depend]: 5.96998e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.503e-05 [cse]: 3.611e-05 [replace_applicator]: 1.231e-05 [Cycle 2]: 0.0003162, [27] [switch_simplify]: 5.91003e-06 [loop_unroll]: 5.09e-06 [a_1]: 8.858e-05 [with_stream_mark]: 9.62999e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 2.36998e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.249e-05 [j_node_and_user_rematch]: 7.6e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 7.18e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.05002e-06 [cse]: 1.279e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.331e-05 [rewriter_after_opt_a]: 3.813e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.00055727 [jit_opt_b]: 4.762e-05, [1] [Cycle 1]: 4.097e-05, [2] [frontend_op_eliminate]: 1.515e-05 [inline_after_opt_a]: 1.51e-05 [cconv]: 2.561e-05 [loop_unroll]: 0.00042357 [jit_opt_after_cconv]: 0.00014218, [1] [Cycle 1]: 0.00013528, [11] [c_1]: 2.098e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.224e-05 [call_graph_tuple_transform]: 1.879e-05 [tuple_list_get_item_eliminator]: 5.37999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.723e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 6.63e-06 [add_recomputation]: 5.203e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.146e-05 [auto_monad_reorder]: 1.775e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 4.79002e-06 [opt_after_jit_grad]: 0.00046325 [symbol_engine_optimizer]: 8.572e-05, [1] [Cycle 1]: 7.93e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 7.43999e-06 [elim_not_effective]: 2.538e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 3.09985e-07 [validate]: 3.884e-05 Sums bootstrap : 0.000329s : 1.36% type_inference : 0.019693s : 81.23% event_method : 0.000020s : 0.08% auto_monad : 0.000071s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000110s : 0.45% rewriter_before_opt_a : 0.000083s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.15% jit_opt_a.a_1 : 0.000672s : 2.77% jit_opt_a.with_stream_mark : 0.000031s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001000s : 4.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000049s : 0.20% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000557s : 2.30% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000026s : 0.11% loop_unroll : 0.000424s : 1.75% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000052s : 0.21% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000463s : 1.91% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.16% Time group info: ------[substitution.] 0.000254 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 3: substitution.graph_param_transform 87.33% : 0.000222s : 4: substitution.inline 1.16% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 4.63% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019616 2 92.68% : 0.018181s : 1: type_inference.infer 7.32% : 0.001435s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.52% : 0.000051s : 4: replace.inline 30.48% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 95.36% : 0.000220s : 4: match.inline 4.64% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.09% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.54% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000845 13 44.26% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.27% : 0.000078s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.47% : 0.000393s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030434 72 0.18% : 0.000055s : 1: add_recomputation 0.25% : 0.000075s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.14% : 0.000346s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 19.77% : 0.006017s : 1: jit_opt_a 0.48% : 0.000145s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.42% : 0.000432s : 1: loop_unroll 1.86% : 0.000566s : 1: mutable_eliminate 2.93% : 0.000891s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000472s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000113s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.93% : 0.000588s : 1: renormalize.infer 1.33% : 0.000404s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000087s : 1: rewriter_before_opt_a 0.29% : 0.000088s : 1: symbol_engine_optimizer 64.76% : 0.019710s : 1: type_inference TotalTime = 0.0284582, [30] [bootstrap]: 0.00028521 [type_inference]: 0.020573 [event_method]: 1.901e-05 [auto_monad]: 6.534e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 9.795e-05 [rewriter_before_opt_a]: 7.89e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00511941, [2] [Cycle 1]: 0.00180404, [27] [switch_simplify]: 4.758e-05 [loop_unroll]: 2.978e-05 [a_1]: 0.00054852 [with_stream_mark]: 1.601e-05 [recompute_prepare]: 7.41999e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 8.60018e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 8.27998e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00083716 [add_forward_monad_depend]: 6.39999e-06 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 1.654e-05 [cse]: 3.291e-05 [replace_applicator]: 1.433e-05 [Cycle 2]: 0.0003146, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 5.26002e-06 [a_1]: 8.894e-05 [with_stream_mark]: 9.79e-06 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 2.83998e-06 [updatestate_assign_eliminate]: 2.45997e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 4.96002e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.12999e-06 [meta_shard_fg_expand]: 1.06002e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 7.04001e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.306e-05 [replace_applicator]: 4.99998e-06 [py_interpret_to_execute_after_opt_a]: 1.188e-05 [rewriter_after_opt_a]: 3.598e-05 [convert_after_rewriter]: 6.29999e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00058401 [jit_opt_b]: 5.108e-05, [1] [Cycle 1]: 4.383e-05, [2] [frontend_op_eliminate]: 1.664e-05 [inline_after_opt_a]: 1.578e-05 [cconv]: 2.637e-05 [loop_unroll]: 0.00044139 [jit_opt_after_cconv]: 0.00014109, [1] [Cycle 1]: 0.00013365, [11] [c_1]: 2.049e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.97001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.33002e-06 [cse]: 2.253e-05 [call_graph_tuple_transform]: 1.776e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.588e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 6.49999e-06 [add_recomputation]: 4.995e-05 [cse_after_recomputation]: 2.11e-05, [1] [Cycle 1]: 1.599e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.822e-05 [get_jit_bprop_graph]: 1.66998e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00050576 [symbol_engine_optimizer]: 7.293e-05, [1] [Cycle 1]: 6.667e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 7.65998e-06 [elim_not_effective]: 1.373e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.05001e-06 [renormalize]: 3.19997e-07 [validate]: 3.875e-05 Sums bootstrap : 0.000285s : 1.15% type_inference : 0.020573s : 82.61% event_method : 0.000019s : 0.08% auto_monad : 0.000065s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000098s : 0.39% rewriter_before_opt_a : 0.000079s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000637s : 2.56% jit_opt_a.with_stream_mark : 0.000026s : 0.10% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000015s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000837s : 3.36% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000046s : 0.18% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000036s : 0.14% convert_after_rewriter : 0.000006s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000584s : 2.35% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.11% loop_unroll : 0.000441s : 1.77% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000050s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000506s : 2.03% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.16% Time group info: ------[substitution.] 0.000174 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 2.96% : 0.000005s : 3: substitution.graph_param_transform 82.31% : 0.000143s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000004s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020511 2 92.53% : 0.018978s : 1: type_inference.infer 7.47% : 0.001532s : 1: type_inference.specialize ------[replace.] 0.000064 6 68.16% : 0.000044s : 4: replace.inline 31.84% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 92.91% : 0.000141s : 4: match.inline 7.09% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000175 691 0.79% : 0.000001s : 10: predicate.accumulaten_eliminater 0.80% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.77% : 0.000001s : 10: predicate.addn_check_dump 0.76% : 0.000001s : 10: predicate.addn_zero_filter 1.26% : 0.000002s : 10: predicate.arithmetic_simplify 0.78% : 0.000001s : 10: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 0.70% : 0.000001s : 10: predicate.compare_switch_simplify 0.77% : 0.000001s : 10: predicate.depend_value_elim 0.72% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.94% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.88% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.35% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.73% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.71% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.70% : 0.000001s : 10: predicate.environ_get_depend_swap 0.81% : 0.000001s : 10: predicate.environ_get_eliminate 0.69% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.16% : 0.000000s : 3: predicate.graph_param_transform 3.45% : 0.000006s : 22: predicate.inline 0.58% : 0.000001s : 6: predicate.inline_without_move 0.26% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.93% : 0.000002s : 6: predicate.less_batch_normalization 36.00% : 0.000063s : 12: predicate.list_to_tuple_eliminator_ 1.18% : 0.000002s : 15: predicate.load_eliminater 0.86% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.30% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.69% : 0.000001s : 10: predicate.merge_addn 0.70% : 0.000001s : 10: predicate.minmaximum_grad 1.20% : 0.000002s : 3: predicate.mutable_eliminate 0.33% : 0.000001s : 3: predicate.opt_reshape 1.54% : 0.000003s : 15: predicate.partial_eliminate 0.70% : 0.000001s : 10: predicate.print_const_string_wrapper 1.24% : 0.000002s : 10: predicate.reduce_eliminate 0.94% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 6: predicate.remove_not_recompute_node 1.14% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 0.84% : 0.000001s : 10: predicate.reshape_eliminate 0.83% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 0.90% : 0.000002s : 10: predicate.same_eliminate 0.37% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.71% : 0.000001s : 6: predicate.special_op_eliminate 0.63% : 0.000001s : 6: predicate.specialize_transform 0.83% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 0.81% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.45% : 0.000003s : 16: predicate.switch_defer_inline 1.46% : 0.000003s : 16: predicate.switch_layer_defer_inline 4.95% : 0.000009s : 53: predicate.switch_simplify 0.90% : 0.000002s : 10: predicate.tile_eliminate 0.78% : 0.000001s : 10: predicate.transpose_eliminate 0.90% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.76% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 2.75% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 0.92% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.00% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.09% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 1.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 0.90% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000810 13 47.08% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.65% : 0.000402s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030196 72 0.17% : 0.000053s : 1: add_recomputation 0.23% : 0.000069s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.01% : 0.000304s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000008s : 1: convert_after_rewriter 0.08% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.07% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 16.97% : 0.005123s : 1: jit_opt_a 0.48% : 0.000144s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 1.49% : 0.000449s : 1: loop_unroll 1.96% : 0.000592s : 1: mutable_eliminate 2.79% : 0.000843s : 26: opt.transform.jit_opt_a 0.15% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.70% : 0.000514s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000101s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.51% : 0.000455s : 1: renormalize.infer 1.24% : 0.000375s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000039s : 1: rewriter_after_opt_a 0.27% : 0.000082s : 1: rewriter_before_opt_a 0.25% : 0.000076s : 1: symbol_engine_optimizer 68.17% : 0.020586s : 1: type_inference TotalTime = 0.0314648, [30] [bootstrap]: 0.0002343 [type_inference]: 0.015006 [event_method]: 6.235e-05 [auto_monad]: 9.902e-05 [graph_reusing]: 7.41999e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 2.821e-05 [rewriter_before_opt_a]: 0.00010339 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.0136551, [3] [Cycle 1]: 0.00672122, [27] [switch_simplify]: 7.582e-05 [loop_unroll]: 4.256e-05 [a_1]: 0.00090867 [with_stream_mark]: 3.183e-05 [recompute_prepare]: 1.955e-05 [updatestate_depend_eliminate]: 8.50001e-06 [updatestate_assign_eliminate]: 7.11999e-06 [updatestate_loads_eliminate]: 6.53e-06 [parameter_eliminate]: 2.69001e-06 [specialize_transform]: 1.382e-05 [updatestate_useless_node_eliminater]: 1.253e-05 [accelerated_algorithm]: 1.368e-05 [meta_shard_fg_expand]: 3.65998e-06 [get_grad_eliminate_]: 1.21e-05 [merge_forward]: 8.60999e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.729e-05 [j_node_and_user_rematch]: 2.394e-05 [meta_fg_expand]: 0.00161562 [replace_old_param]: 5.591e-05 [inline_without_move]: 0.00010451 [renormalize]: 0.00314163 [add_forward_monad_depend]: 1.137e-05 [auto_monad_grad]: 6.56e-06 [auto_monad_eliminator]: 5.592e-05 [cse]: 0.0002059 [replace_applicator]: 7.258e-05 [Cycle 2]: 0.0033238, [27] [switch_simplify]: 3.965e-05 [loop_unroll]: 4.074e-05 [a_1]: 0.00114179 [with_stream_mark]: 1.517e-05 [recompute_prepare]: 1.083e-05 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 3.91999e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 8.88002e-06 [updatestate_useless_node_eliminater]: 8.17998e-06 [accelerated_algorithm]: 8.37e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 7.68999e-06 [merge_forward]: 4.47998e-06 [cell_reuse_recompute_pass]: 7.59988e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.861e-05 [j_node_and_user_rematch]: 1.406e-05 [meta_fg_expand]: 0.00010867 [replace_old_param]: 9.42001e-06 [inline_without_move]: 7.87003e-06 [renormalize]: 0.0016369 [add_forward_monad_depend]: 5.52001e-06 [auto_monad_grad]: 1.91998e-06 [auto_monad_eliminator]: 1.162e-05 [cse]: 2.379e-05 [replace_applicator]: 1.244e-05 [Cycle 3]: 0.00024575, [27] [switch_simplify]: 4.53001e-06 [loop_unroll]: 3.7e-06 [a_1]: 3.903e-05 [with_stream_mark]: 8.97999e-06 [recompute_prepare]: 3.9e-06 [updatestate_depend_eliminate]: 2.00002e-06 [updatestate_assign_eliminate]: 1.81e-06 [updatestate_loads_eliminate]: 1.66e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 3.52002e-06 [updatestate_useless_node_eliminater]: 3.18e-06 [accelerated_algorithm]: 3.07002e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 3.16999e-06 [merge_forward]: 2.40002e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.03e-05 [j_node_and_user_rematch]: 5.59e-06 [meta_fg_expand]: 1.35999e-06 [replace_old_param]: 3.25998e-06 [inline_without_move]: 2.94999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 3.37002e-06 [cse]: 9.51003e-06 [replace_applicator]: 3.33998e-06 [py_interpret_to_execute_after_opt_a]: 1.074e-05 [rewriter_after_opt_a]: 3.233e-05 [convert_after_rewriter]: 6.28998e-06 [order_py_execute_after_rewriter]: 4.22003e-06 [mutable_eliminate]: 0.00067164 [jit_opt_b]: 0.00011819, [1] [Cycle 1]: 0.00011059, [2] [frontend_op_eliminate]: 9.83998e-06 [inline_after_opt_a]: 8.85e-05 [cconv]: 2.699e-05 [loop_unroll]: 0.00042613 [jit_opt_after_cconv]: 0.00013859, [1] [Cycle 1]: 0.00013248, [11] [c_1]: 1.259e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 5.16002e-06 [updatestate_assign_eliminate]: 1.77001e-06 [updatestate_loads_eliminate]: 1.73002e-06 [cse]: 1.975e-05 [call_graph_tuple_transform]: 1.402e-05 [tuple_list_get_item_eliminator]: 3.77002e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 3.98001e-06 [remove_dup_value]: 1.332e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 5.22e-06 [add_recomputation]: 3.475e-05 [cse_after_recomputation]: 2.133e-05, [1] [Cycle 1]: 1.589e-05, [1] [cse]: 9.12999e-06 [auto_monad_reorder]: 1.428e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 6.04001e-06 [opt_after_jit_grad]: 0.00045033 [symbol_engine_optimizer]: 6.702e-05, [1] [Cycle 1]: 6.11e-05, [6] [build]: 3.67002e-06 [elim_shapecalc]: 6.49001e-06 [elim_not_effective]: 1.036e-05 [opt_reshape]: 4.99e-06 [fold_const_symbol]: 6.11998e-06 [renormalize]: 4.10015e-07 [validate]: 3.046e-05 Sums bootstrap : 0.000234s : 0.86% type_inference : 0.015006s : 55.04% event_method : 0.000062s : 0.23% auto_monad : 0.000099s : 0.36% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000028s : 0.10% rewriter_before_opt_a : 0.000103s : 0.38% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000120s : 0.44% jit_opt_a.loop_unroll : 0.000087s : 0.32% jit_opt_a.a_1 : 0.002089s : 7.66% jit_opt_a.with_stream_mark : 0.000056s : 0.21% jit_opt_a.recompute_prepare : 0.000034s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.09% jit_opt_a.accelerated_algorithm : 0.000025s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.08% jit_opt_a.merge_forward : 0.000015s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.16% jit_opt_a.meta_fg_expand : 0.001726s : 6.33% jit_opt_a.replace_old_param : 0.000069s : 0.25% jit_opt_a.inline_without_move : 0.000115s : 0.42% jit_opt_a.renormalize : 0.004779s : 17.53% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.07% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000071s : 0.26% jit_opt_a.cse : 0.000239s : 0.88% jit_opt_a.replace_applicator : 0.000088s : 0.32% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000032s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.02% mutable_eliminate : 0.000672s : 2.46% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.04% jit_opt_b.inline_after_opt_a : 0.000089s : 0.32% cconv : 0.000027s : 0.10% loop_unroll : 0.000426s : 1.56% jit_opt_after_cconv.c_1 : 0.000013s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000013s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000035s : 0.13% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000014s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000450s : 1.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.11% Time group info: ------[substitution.] 0.000532 105 0.29% : 0.000002s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.78% : 0.000004s : 1: substitution.graph_param_transform 64.29% : 0.000342s : 13: substitution.inline 2.95% : 0.000016s : 2: substitution.inline_without_move 1.81% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.85% : 0.000010s : 7: substitution.minmaximum_grad 1.24% : 0.000007s : 5: substitution.partial_eliminate 2.16% : 0.000011s : 13: substitution.remove_not_recompute_node 4.83% : 0.000026s : 10: substitution.replace_applicator 1.00% : 0.000005s : 8: substitution.replace_old_param 1.17% : 0.000006s : 1: substitution.reshape_eliminate 0.52% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.98% : 0.000005s : 1: substitution.tile_eliminate 3.84% : 0.000020s : 7: substitution.tuple_list_convert_item_index_to_positive 2.79% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 9.31% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014925 2 91.35% : 0.013633s : 1: type_inference.infer 8.65% : 0.001291s : 1: type_inference.specialize ------[replace.] 0.000164 20 65.47% : 0.000107s : 13: replace.inline 34.53% : 0.000057s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000356 20 94.21% : 0.000335s : 13: match.inline 5.79% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000414 2537 1.35% : 0.000006s : 44: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.29% : 0.000005s : 44: predicate.addn_check_dump 1.37% : 0.000006s : 44: predicate.addn_zero_filter 1.95% : 0.000008s : 44: predicate.arithmetic_simplify 1.41% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.28% : 0.000005s : 44: predicate.compare_switch_simplify 1.33% : 0.000006s : 44: predicate.depend_value_elim 1.31% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.40% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.41% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.22% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.31% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.34% : 0.000006s : 44: predicate.environ_get_depend_swap 1.33% : 0.000006s : 44: predicate.environ_get_eliminate 1.31% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.73% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 3.75% : 0.000016s : 66: predicate.inline 14.07% : 0.000058s : 42: predicate.inline_without_move 0.37% : 0.000002s : 18: predicate.j_node_and_user_rematch 0.78% : 0.000003s : 18: predicate.less_batch_normalization 1.58% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.79% : 0.000007s : 52: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.15% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.53% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.31% : 0.000005s : 44: predicate.merge_addn 1.36% : 0.000006s : 44: predicate.minmaximum_grad 0.25% : 0.000001s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 1.98% : 0.000008s : 52: predicate.partial_eliminate 1.36% : 0.000006s : 44: predicate.print_const_string_wrapper 1.85% : 0.000008s : 44: predicate.reduce_eliminate 1.67% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.37% : 0.000002s : 18: predicate.remove_not_recompute_node 2.27% : 0.000009s : 94: predicate.replace_applicator 0.91% : 0.000004s : 42: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.40% : 0.000006s : 44: predicate.reshape_eliminate 1.38% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.33% : 0.000006s : 44: predicate.same_eliminate 0.42% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.12% : 0.000000s : 2: predicate.special_op_eliminate 0.73% : 0.000003s : 18: predicate.specialize_transform 1.54% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.53% : 0.000010s : 64: predicate.switch_defer_inline 2.21% : 0.000009s : 64: predicate.switch_layer_defer_inline 5.74% : 0.000024s : 154: predicate.switch_simplify 1.40% : 0.000006s : 44: predicate.tile_eliminate 1.34% : 0.000006s : 44: predicate.transpose_eliminate 1.66% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.63% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 2.67% : 0.000011s : 53: predicate.tuple_list_get_item_eliminator 1.64% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.59% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.61% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.46% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.70% : 0.000007s : 44: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001833 32 60.55% : 0.001110s : 15: func_graph_cloner_run.FuncGraphClonerGraph 39.45% : 0.000723s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039083 87 0.10% : 0.000039s : 1: add_recomputation 0.27% : 0.000104s : 1: auto_monad 0.04% : 0.000017s : 1: auto_monad_reorder 0.66% : 0.000259s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.17% : 0.000068s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 34.95% : 0.013658s : 1: jit_opt_a 0.36% : 0.000141s : 1: jit_opt_after_cconv 0.31% : 0.000121s : 1: jit_opt_b 1.11% : 0.000433s : 1: loop_unroll 1.74% : 0.000680s : 1: mutable_eliminate 7.05% : 0.002756s : 39: opt.transform.jit_opt_a 0.08% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.23% : 0.000091s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000011s : 1: opt.transform.mutable_eliminate 0.04% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000024s : 4: opt.transform.symbol_engine_opt 1.17% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000031s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000016s : 1: remove_dup_value 7.87% : 0.003077s : 2: renormalize.infer 4.31% : 0.001684s : 2: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000035s : 1: rewriter_after_opt_a 0.27% : 0.000106s : 1: rewriter_before_opt_a 0.18% : 0.000070s : 1: symbol_engine_optimizer 38.44% : 0.015025s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.151.830 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.152.527 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.134223, [30] [bootstrap]: 0.00030882 [type_inference]: 0.121967 [event_method]: 2.105e-05 [auto_monad]: 7.215e-05 [graph_reusing]: 6.26998e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.00055187 [rewriter_before_opt_a]: 8.817e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00892845, [2] [Cycle 1]: 0.00373449, [27] [switch_simplify]: 5.635e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00059004 [with_stream_mark]: 2.072e-05 [recompute_prepare]: 9.44e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00268847 [add_forward_monad_depend]: 7.6e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.842e-05 [cse]: 3.155e-05 [replace_applicator]: 1.671e-05 [Cycle 2]: 0.00035892, [27] [switch_simplify]: 6.56999e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00011877 [with_stream_mark]: 1.04e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 1.88002e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.63002e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 2.74999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.89995e-07 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 6.18002e-06 [cse]: 1.063e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 1.155e-05 [rewriter_after_opt_a]: 3.786e-05 [convert_after_rewriter]: 6.90002e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00066325 [jit_opt_b]: 5.272e-05, [1] [Cycle 1]: 4.586e-05, [2] [frontend_op_eliminate]: 1.79e-05 [inline_after_opt_a]: 1.706e-05 [cconv]: 2.642e-05 [loop_unroll]: 0.00041548 [jit_opt_after_cconv]: 0.00014416, [1] [Cycle 1]: 0.00013781, [11] [c_1]: 2.438e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 1.921e-05 [call_graph_tuple_transform]: 2.063e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.464e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 8.96002e-06 [add_recomputation]: 4.718e-05 [cse_after_recomputation]: 2.141e-05, [1] [Cycle 1]: 1.615e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.54e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 4.78001e-06 [opt_after_jit_grad]: 0.00045318 [symbol_engine_optimizer]: 0.00011987, [1] [Cycle 1]: 0.00011391, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.342e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 5.567e-05 [renormalize]: 4.19997e-07 [validate]: 4.274e-05 Sums bootstrap : 0.000309s : 0.24% type_inference : 0.121967s : 94.69% event_method : 0.000021s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000552s : 0.43% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000709s : 0.55% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002689s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000663s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000415s : 0.32% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000453s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000056s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000237 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 4: substitution.graph_param_transform 83.99% : 0.000199s : 4: substitution.inline 1.79% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000005s : 2: substitution.replace_old_param 5.58% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121881 2 95.80% : 0.116767s : 1: type_inference.infer 4.20% : 0.005115s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.56% : 0.000047s : 4: replace.inline 32.44% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.25% : 0.000196s : 4: match.inline 5.75% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.35% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 6.00% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.91% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.52% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.79% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.53% : 0.000010s : 58: predicate.switch_simplify 1.48% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002126 22 66.19% : 0.001407s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.36% : 0.000667s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137962 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000321s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.47% : 0.008931s : 1: jit_opt_a 0.11% : 0.000147s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.31% : 0.000423s : 1: loop_unroll 0.49% : 0.000670s : 1: mutable_eliminate 0.68% : 0.000941s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000080s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000558s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.33% : 0.001841s : 1: renormalize.infer 0.61% : 0.000837s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.09% : 0.000122s : 1: symbol_engine_optimizer 88.42% : 0.121991s : 1: type_inference TotalTime = 0.0384205, [30] [bootstrap]: 0.00024694 [type_inference]: 0.0163468 [event_method]: 6.553e-05 [auto_monad]: 9.737e-05 [graph_reusing]: 7.05002e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 3.079e-05 [rewriter_before_opt_a]: 0.00011865 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.0192269, [3] [Cycle 1]: 0.0125273, [27] [switch_simplify]: 7.157e-05 [loop_unroll]: 4.215e-05 [a_1]: 0.00093302 [with_stream_mark]: 3.148e-05 [recompute_prepare]: 1.974e-05 [updatestate_depend_eliminate]: 8.82e-06 [updatestate_assign_eliminate]: 7.61999e-06 [updatestate_loads_eliminate]: 6.56e-06 [parameter_eliminate]: 2.79001e-06 [specialize_transform]: 1.361e-05 [updatestate_useless_node_eliminater]: 1.301e-05 [accelerated_algorithm]: 1.254e-05 [meta_shard_fg_expand]: 3.83999e-06 [get_grad_eliminate_]: 1.228e-05 [merge_forward]: 8.80999e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.685e-05 [j_node_and_user_rematch]: 2.34e-05 [meta_fg_expand]: 0.00169354 [replace_old_param]: 6.383e-05 [inline_without_move]: 5.766e-05 [renormalize]: 0.00882255 [add_forward_monad_depend]: 1.287e-05 [auto_monad_grad]: 6.64001e-06 [auto_monad_eliminator]: 5.997e-05 [cse]: 0.00024698 [replace_applicator]: 8.251e-05 [Cycle 2]: 0.00312828, [27] [switch_simplify]: 4.033e-05 [loop_unroll]: 3.912e-05 [a_1]: 0.00110909 [with_stream_mark]: 1.627e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 4.2e-06 [parameter_eliminate]: 1.91003e-06 [specialize_transform]: 6.79999e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 6.19999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 9.674e-05 [replace_old_param]: 7.43999e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00151961 [add_forward_monad_depend]: 5.00001e-06 [auto_monad_grad]: 1.81003e-06 [auto_monad_eliminator]: 1.025e-05 [cse]: 1.824e-05 [replace_applicator]: 1.188e-05 [Cycle 3]: 0.00024885, [27] [switch_simplify]: 4.50999e-06 [loop_unroll]: 3.65e-06 [a_1]: 3.752e-05 [with_stream_mark]: 8.60999e-06 [recompute_prepare]: 3.51999e-06 [updatestate_depend_eliminate]: 1.89e-06 [updatestate_assign_eliminate]: 1.82999e-06 [updatestate_loads_eliminate]: 1.42e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 3.45e-06 [updatestate_useless_node_eliminater]: 3.23e-06 [accelerated_algorithm]: 3.36999e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 3.13e-06 [merge_forward]: 2.17001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.047e-05 [j_node_and_user_rematch]: 5.74999e-06 [meta_fg_expand]: 1.35999e-06 [replace_old_param]: 3.17997e-06 [inline_without_move]: 3.06001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 4.60999e-06 [cse]: 9.59e-06 [replace_applicator]: 3.78999e-06 [py_interpret_to_execute_after_opt_a]: 1.262e-05 [rewriter_after_opt_a]: 3.467e-05 [convert_after_rewriter]: 6.41e-06 [order_py_execute_after_rewriter]: 4.25e-06 [mutable_eliminate]: 0.00074852 [jit_opt_b]: 4.062e-05, [1] [Cycle 1]: 3.276e-05, [2] [frontend_op_eliminate]: 1.002e-05 [inline_after_opt_a]: 1.171e-05 [cconv]: 2.766e-05 [loop_unroll]: 0.00041728 [jit_opt_after_cconv]: 0.00013941, [1] [Cycle 1]: 0.00013285, [11] [c_1]: 1.224e-05 [parameter_eliminate]: 3.19001e-06 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 1.71e-06 [updatestate_loads_eliminate]: 1.96998e-06 [cse]: 1.917e-05 [call_graph_tuple_transform]: 1.406e-05 [tuple_list_get_item_eliminator]: 3.35998e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 1.601e-05 [remove_dup_value]: 1.74e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 5.31998e-06 [add_recomputation]: 3.859e-05 [cse_after_recomputation]: 2.118e-05, [1] [Cycle 1]: 1.526e-05, [1] [cse]: 8.62e-06 [auto_monad_reorder]: 1.477e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 6.48e-06 [opt_after_jit_grad]: 0.00044398 [symbol_engine_optimizer]: 6.694e-05, [1] [Cycle 1]: 6.082e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 5.88002e-06 [elim_not_effective]: 9.96998e-06 [opt_reshape]: 4.35e-06 [fold_const_symbol]: 6.11e-06 [renormalize]: 5.40022e-07 [validate]: 3.127e-05 Sums bootstrap : 0.000247s : 0.72% type_inference : 0.016347s : 47.73% event_method : 0.000066s : 0.19% auto_monad : 0.000097s : 0.28% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000031s : 0.09% rewriter_before_opt_a : 0.000119s : 0.35% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000116s : 0.34% jit_opt_a.loop_unroll : 0.000085s : 0.25% jit_opt_a.a_1 : 0.002080s : 6.07% jit_opt_a.with_stream_mark : 0.000056s : 0.16% jit_opt_a.recompute_prepare : 0.000032s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000015s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000024s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.07% jit_opt_a.accelerated_algorithm : 0.000023s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.06% jit_opt_a.merge_forward : 0.000015s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000053s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.12% jit_opt_a.meta_fg_expand : 0.001792s : 5.23% jit_opt_a.replace_old_param : 0.000074s : 0.22% jit_opt_a.inline_without_move : 0.000067s : 0.20% jit_opt_a.renormalize : 0.010342s : 30.20% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.06% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000075s : 0.22% jit_opt_a.cse : 0.000275s : 0.80% jit_opt_a.replace_applicator : 0.000098s : 0.29% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000035s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000749s : 2.19% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000012s : 0.03% cconv : 0.000028s : 0.08% loop_unroll : 0.000417s : 1.22% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000003s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000016s : 0.05% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000039s : 0.11% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000444s : 1.30% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000031s : 0.09% Time group info: ------[substitution.] 0.000548 104 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.22% : 0.000001s : 1: substitution.fold_const_symbol 0.92% : 0.000005s : 1: substitution.graph_param_transform 67.40% : 0.000370s : 13: substitution.inline 2.97% : 0.000016s : 2: substitution.inline_without_move 1.77% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.95% : 0.000011s : 7: substitution.minmaximum_grad 1.28% : 0.000007s : 5: substitution.partial_eliminate 1.89% : 0.000010s : 12: substitution.remove_not_recompute_node 5.40% : 0.000030s : 10: substitution.replace_applicator 1.18% : 0.000006s : 10: substitution.replace_old_param 0.46% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.34% : 0.000007s : 1: substitution.tile_eliminate 3.56% : 0.000020s : 7: substitution.tuple_list_convert_item_index_to_positive 2.53% : 0.000014s : 7: substitution.tuple_list_get_item_depend_reorder 6.87% : 0.000038s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016244 2 91.43% : 0.014852s : 1: type_inference.infer 8.57% : 0.001392s : 1: type_inference.specialize ------[replace.] 0.000181 20 65.15% : 0.000118s : 13: replace.inline 34.85% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000381 20 95.02% : 0.000362s : 13: match.inline 4.98% : 0.000019s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000360 2433 1.52% : 0.000005s : 42: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.47% : 0.000005s : 42: predicate.addn_check_dump 1.64% : 0.000006s : 42: predicate.addn_zero_filter 2.09% : 0.000008s : 42: predicate.arithmetic_simplify 1.61% : 0.000006s : 42: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.68% : 0.000006s : 42: predicate.compare_switch_simplify 1.46% : 0.000005s : 42: predicate.depend_value_elim 1.46% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.66% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.58% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.15% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.70% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.49% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.53% : 0.000006s : 42: predicate.environ_get_depend_swap 1.59% : 0.000006s : 42: predicate.environ_get_eliminate 1.47% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.73% : 0.000003s : 16: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.18% : 0.000015s : 64: predicate.inline 2.02% : 0.000007s : 44: predicate.inline_without_move 0.32% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.91% : 0.000003s : 16: predicate.less_batch_normalization 1.93% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 2.01% : 0.000007s : 50: predicate.load_eliminater 0.24% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.45% : 0.000012s : 87: predicate.loop_unroll_before_grad 1.85% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.44% : 0.000005s : 42: predicate.merge_addn 1.52% : 0.000005s : 42: predicate.minmaximum_grad 0.39% : 0.000001s : 1: predicate.mutable_eliminate 0.18% : 0.000001s : 1: predicate.opt_reshape 2.26% : 0.000008s : 50: predicate.partial_eliminate 1.57% : 0.000006s : 42: predicate.print_const_string_wrapper 2.02% : 0.000007s : 42: predicate.reduce_eliminate 1.83% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 16: predicate.remove_not_recompute_node 2.60% : 0.000009s : 90: predicate.replace_applicator 1.09% : 0.000004s : 44: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 42: predicate.reshape_eliminate 1.58% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 1: predicate.row_tensor_eliminate 1.62% : 0.000006s : 42: predicate.same_eliminate 0.49% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.84% : 0.000003s : 16: predicate.specialize_transform 1.98% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.78% : 0.000010s : 62: predicate.switch_defer_inline 2.54% : 0.000009s : 62: predicate.switch_layer_defer_inline 6.54% : 0.000024s : 150: predicate.switch_simplify 1.66% : 0.000006s : 42: predicate.tile_eliminate 1.53% : 0.000005s : 42: predicate.transpose_eliminate 1.95% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.88% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.76% : 0.000006s : 50: predicate.updatestate_pure_node_eliminater 2.68% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002271 36 63.54% : 0.001443s : 19: func_graph_cloner_run.FuncGraphClonerGraph 36.46% : 0.000828s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051466 87 0.08% : 0.000041s : 1: add_recomputation 0.20% : 0.000102s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.53% : 0.000271s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.14% : 0.000071s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 37.37% : 0.019230s : 1: jit_opt_a 0.28% : 0.000142s : 1: jit_opt_after_cconv 0.08% : 0.000043s : 1: jit_opt_b 0.83% : 0.000425s : 1: loop_unroll 1.48% : 0.000759s : 1: mutable_eliminate 5.23% : 0.002689s : 39: opt.transform.jit_opt_a 0.08% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.88% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000033s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 16.34% : 0.008408s : 2: renormalize.infer 3.72% : 0.001916s : 2: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000038s : 1: rewriter_after_opt_a 0.24% : 0.000121s : 1: rewriter_before_opt_a 0.13% : 0.000069s : 1: symbol_engine_optimizer 31.81% : 0.016369s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.211.917 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006ed30> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.212.584 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0187913, [30] [bootstrap]: 0.00093444 [type_inference]: 0.00889624 [event_method]: 2.096e-05 [auto_monad]: 7.456e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 4.353e-05 [rewriter_before_opt_a]: 8.43e-05 [expand_dump_flag]: 3.72002e-06 [jit_opt_a]: 0.00629081, [2] [Cycle 1]: 0.0024024, [27] [switch_simplify]: 6.825e-05 [loop_unroll]: 3.441e-05 [a_1]: 0.00068498 [with_stream_mark]: 2.596e-05 [recompute_prepare]: 9.21998e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 2.52001e-06 [specialize_transform]: 1.014e-05 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.70999e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.702e-05 [j_node_and_user_rematch]: 9.56998e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 5.32001e-06 [renormalize]: 0.0009364 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.773e-05 [cse]: 3.926e-05 [replace_applicator]: 1.381e-05 [Cycle 2]: 0.00036487, [27] [switch_simplify]: 6.36998e-06 [loop_unroll]: 5.43002e-06 [a_1]: 0.00011001 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 5.92001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.37999e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 4.82998e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.229e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 7.1e-06 [cse]: 1.619e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 1.535e-05 [rewriter_after_opt_a]: 4.298e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00068906 [jit_opt_b]: 5.246e-05, [1] [Cycle 1]: 4.501e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.749e-05 [cconv]: 2.953e-05 [loop_unroll]: 0.00047735 [jit_opt_after_cconv]: 0.00016021, [1] [Cycle 1]: 0.00015284, [11] [c_1]: 2.046e-05 [parameter_eliminate]: 3.13998e-06 [updatestate_depend_eliminate]: 7.75e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 2.9e-05 [call_graph_tuple_transform]: 2.022e-05 [tuple_list_get_item_eliminator]: 5.71003e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 7.49977e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 1.773e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.44999e-06 [add_recomputation]: 5.417e-05 [cse_after_recomputation]: 2.494e-05, [1] [Cycle 1]: 1.945e-05, [1] [cse]: 1.297e-05 [auto_monad_reorder]: 1.939e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 6.11998e-06 [opt_after_jit_grad]: 0.00050586 [symbol_engine_optimizer]: 7.827e-05, [1] [Cycle 1]: 7.1e-05, [6] [build]: 4.52998e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 6.29999e-06 [fold_const_symbol]: 8.55001e-06 [renormalize]: 4.50003e-07 [validate]: 4.557e-05 Sums bootstrap : 0.000934s : 6.51% type_inference : 0.008896s : 61.94% event_method : 0.000021s : 0.15% auto_monad : 0.000075s : 0.52% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.30% rewriter_before_opt_a : 0.000084s : 0.59% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000075s : 0.52% jit_opt_a.loop_unroll : 0.000040s : 0.28% jit_opt_a.a_1 : 0.000795s : 5.54% jit_opt_a.with_stream_mark : 0.000039s : 0.27% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000016s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000936s : 6.52% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.17% jit_opt_a.cse : 0.000055s : 0.39% jit_opt_a.replace_applicator : 0.000020s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000043s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000689s : 4.80% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000030s : 0.21% loop_unroll : 0.000477s : 3.32% jit_opt_after_cconv.c_1 : 0.000020s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000054s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000506s : 3.52% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.32% Time group info: ------[substitution.] 0.000290 27 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 3: substitution.graph_param_transform 83.70% : 0.000243s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.90% : 0.000011s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000006s : 2: substitution.replace_old_param 4.11% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008817 2 89.36% : 0.007879s : 1: type_inference.infer 10.64% : 0.000938s : 1: type_inference.specialize ------[replace.] 0.000095 7 69.81% : 0.000066s : 5: replace.inline 30.19% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.71% : 0.000240s : 5: match.inline 4.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 747 1.19% : 0.000002s : 11: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.88% : 0.000003s : 11: predicate.arithmetic_simplify 1.41% : 0.000002s : 11: predicate.cast_eliminate 0.33% : 0.000000s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 11: predicate.compare_switch_simplify 1.21% : 0.000002s : 11: predicate.depend_value_elim 1.03% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.07% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.26% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 11: predicate.environ_get_add_eliminate 8.64% : 0.000012s : 11: predicate.environ_get_depend_swap 1.07% : 0.000002s : 11: predicate.environ_get_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 4.88% : 0.000007s : 24: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 6: predicate.less_batch_normalization 1.24% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 16: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 11: predicate.merge_addn 0.98% : 0.000001s : 11: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 16: predicate.partial_eliminate 1.07% : 0.000002s : 11: predicate.print_const_string_wrapper 1.72% : 0.000002s : 11: predicate.reduce_eliminate 1.25% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 11: predicate.reshape_eliminate 1.13% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.53% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 11: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.03% : 0.000011s : 59: predicate.switch_simplify 1.14% : 0.000002s : 11: predicate.tile_eliminate 1.18% : 0.000002s : 11: predicate.transpose_eliminate 1.24% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.24% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000900 16 46.47% : 0.000418s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.27% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.26% : 0.000398s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020818 72 0.27% : 0.000057s : 1: add_recomputation 0.38% : 0.000078s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 4.60% : 0.000958s : 1: bootstrap 0.15% : 0.000032s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.23% : 0.006294s : 1: jit_opt_a 0.78% : 0.000163s : 1: jit_opt_after_cconv 0.26% : 0.000055s : 1: jit_opt_b 2.34% : 0.000487s : 1: loop_unroll 3.36% : 0.000699s : 1: mutable_eliminate 4.98% : 0.001038s : 26: opt.transform.jit_opt_a 0.23% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.48% : 0.000517s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000046s : 1: py_interpret_to_execute 0.09% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000021s : 1: remove_dup_value 2.39% : 0.000497s : 1: renormalize.infer 2.07% : 0.000431s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000046s : 1: rewriter_after_opt_a 0.42% : 0.000087s : 1: rewriter_before_opt_a 0.39% : 0.000081s : 1: symbol_engine_optimizer 42.82% : 0.008913s : 1: type_inference TotalTime = 0.141621, [30] [bootstrap]: 0.00028889 [type_inference]: 0.119276 [event_method]: 2.279e-05 [auto_monad]: 7.151e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00026815 [rewriter_before_opt_a]: 9.784e-05 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.0192737, [2] [Cycle 1]: 0.015607, [27] [switch_simplify]: 6.141e-05 [loop_unroll]: 3.494e-05 [a_1]: 0.00065925 [with_stream_mark]: 1.714e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.53003e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.72998e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.76998e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.0144508 [add_forward_monad_depend]: 1.03e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.774e-05 [cse]: 3.762e-05 [replace_applicator]: 2.538e-05 [Cycle 2]: 0.00039158, [27] [switch_simplify]: 7.6e-06 [loop_unroll]: 6.45997e-06 [a_1]: 0.00012693 [with_stream_mark]: 1.236e-05 [recompute_prepare]: 6.33e-06 [updatestate_depend_eliminate]: 3.87002e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 4.06001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.841e-05 [j_node_and_user_rematch]: 9.68002e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.78002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 5.99975e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.492e-05 [replace_applicator]: 6.10002e-06 [py_interpret_to_execute_after_opt_a]: 1.009e-05 [rewriter_after_opt_a]: 3.81e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00070024 [jit_opt_b]: 5.676e-05, [1] [Cycle 1]: 4.92e-05, [2] [frontend_op_eliminate]: 1.893e-05 [inline_after_opt_a]: 1.907e-05 [cconv]: 2.535e-05 [loop_unroll]: 0.00042099 [jit_opt_after_cconv]: 0.00015779, [1] [Cycle 1]: 0.000151, [11] [c_1]: 2.672e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 6.40997e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.593e-05 [call_graph_tuple_transform]: 2.19e-05 [tuple_list_get_item_eliminator]: 6.41998e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 1.887e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 9.19e-06 [add_recomputation]: 5.253e-05 [cse_after_recomputation]: 2.453e-05, [1] [Cycle 1]: 1.902e-05, [1] [cse]: 1.333e-05 [auto_monad_reorder]: 2.919e-05 [get_jit_bprop_graph]: 1.60001e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00045539 [symbol_engine_optimizer]: 7.608e-05, [1] [Cycle 1]: 6.939e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 9.33002e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 9.19998e-06 [renormalize]: 5.69999e-07 [validate]: 4.455e-05 Sums bootstrap : 0.000289s : 0.21% type_inference : 0.119276s : 86.58% event_method : 0.000023s : 0.02% auto_monad : 0.000072s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000268s : 0.19% rewriter_before_opt_a : 0.000098s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000786s : 0.57% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.014451s : 10.49% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000700s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000421s : 0.31% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000029s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000242 25 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 4: substitution.graph_param_transform 84.39% : 0.000204s : 5: substitution.inline 1.75% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 2.25% : 0.000005s : 2: substitution.replace_old_param 5.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119199 2 98.25% : 0.117112s : 1: type_inference.infer 1.75% : 0.002086s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.28% : 0.000068s : 5: replace.inline 31.72% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 7 94.66% : 0.000201s : 5: match.inline 5.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.56% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.59% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.26% : 0.000003s : 23: predicate.replace_applicator 1.09% : 0.000002s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.24% : 0.000010s : 65: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002645 29 69.10% : 0.001828s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.30% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.60% : 0.000756s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.157191 72 0.04% : 0.000055s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.02% : 0.000032s : 1: auto_monad_reorder 0.19% : 0.000303s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 12.26% : 0.019277s : 1: jit_opt_a 0.10% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.27% : 0.000429s : 1: loop_unroll 0.45% : 0.000709s : 1: mutable_eliminate 0.67% : 0.001047s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000464s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000274s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 8.69% : 0.013659s : 1: renormalize.infer 0.50% : 0.000781s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000103s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 75.89% : 0.119289s : 1: type_inference TotalTime = 0.0284326, [30] [bootstrap]: 0.00028482 [type_inference]: 0.0202894 [event_method]: 2e-05 [auto_monad]: 6.577e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 1.97001e-06 [py_interpret_to_execute]: 0.00010035 [rewriter_before_opt_a]: 7.969e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00545042, [2] [Cycle 1]: 0.00190231, [27] [switch_simplify]: 4.47e-05 [loop_unroll]: 2.902e-05 [a_1]: 0.00051781 [with_stream_mark]: 1.59e-05 [recompute_prepare]: 7.21999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 8.00006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 7.77e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00099477 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 1.383e-05 [cse]: 2.311e-05 [replace_applicator]: 1.177e-05 [Cycle 2]: 0.00031302, [27] [switch_simplify]: 5.65001e-06 [loop_unroll]: 4.92e-06 [a_1]: 8.83e-05 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.24003e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.213e-05 [j_node_and_user_rematch]: 8.01001e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.79e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.13001e-06 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.285e-05 [replace_applicator]: 4.96002e-06 [py_interpret_to_execute_after_opt_a]: 1.202e-05 [rewriter_after_opt_a]: 3.456e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.0006006 [jit_opt_b]: 4.872e-05, [1] [Cycle 1]: 4.176e-05, [2] [frontend_op_eliminate]: 1.579e-05 [inline_after_opt_a]: 1.537e-05 [cconv]: 2.234e-05 [loop_unroll]: 0.00041607 [jit_opt_after_cconv]: 0.0001373, [1] [Cycle 1]: 0.00013118, [11] [c_1]: 2.03e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.29998e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.025e-05 [call_graph_tuple_transform]: 1.805e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.17e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.436e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 5.60001e-06 [add_recomputation]: 4.269e-05 [cse_after_recomputation]: 2.139e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.095e-05 [auto_monad_reorder]: 1.552e-05 [get_jit_bprop_graph]: 1.71e-06 [rewriter_after_jit_bprop_graph]: 4.28001e-06 [opt_after_jit_grad]: 0.00047172 [symbol_engine_optimizer]: 6.976e-05, [1] [Cycle 1]: 6.384e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 7.84002e-06 [elim_not_effective]: 1.262e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 4.69998e-07 [validate]: 3.477e-05 Sums bootstrap : 0.000285s : 1.16% type_inference : 0.020289s : 82.31% event_method : 0.000020s : 0.08% auto_monad : 0.000066s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000100s : 0.41% rewriter_before_opt_a : 0.000080s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000050s : 0.20% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000606s : 2.46% jit_opt_a.with_stream_mark : 0.000025s : 0.10% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000015s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000995s : 4.04% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000036s : 0.15% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000035s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000601s : 2.44% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000022s : 0.09% loop_unroll : 0.000416s : 1.69% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000014s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000043s : 0.17% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000016s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000472s : 1.91% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.14% Time group info: ------[substitution.] 0.000197 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 84.24% : 0.000166s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000004s : 4: substitution.remove_not_recompute_node 1.67% : 0.000003s : 2: substitution.replace_old_param 6.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020221 2 92.29% : 0.018663s : 1: type_inference.infer 7.71% : 0.001558s : 1: type_inference.specialize ------[replace.] 0.000070 6 70.10% : 0.000049s : 4: replace.inline 29.90% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.75% : 0.000164s : 4: match.inline 6.25% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.57% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.71% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.34% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000006s : 22: predicate.inline 1.14% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.13% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000008s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.32% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.91% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000790 13 42.48% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.95% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.58% : 0.000415s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030289 72 0.15% : 0.000045s : 1: add_recomputation 0.23% : 0.000069s : 1: auto_monad 0.06% : 0.000018s : 1: auto_monad_reorder 1.00% : 0.000302s : 1: bootstrap 0.08% : 0.000025s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.01% : 0.005454s : 1: jit_opt_a 0.46% : 0.000140s : 1: jit_opt_after_cconv 0.17% : 0.000051s : 1: jit_opt_b 1.40% : 0.000424s : 1: loop_unroll 2.01% : 0.000609s : 1: mutable_eliminate 2.65% : 0.000803s : 26: opt.transform.jit_opt_a 0.15% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.59% : 0.000480s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000104s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 2.03% : 0.000614s : 1: renormalize.infer 1.23% : 0.000372s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000037s : 1: rewriter_after_opt_a 0.27% : 0.000083s : 1: rewriter_before_opt_a 0.24% : 0.000072s : 1: symbol_engine_optimizer 67.02% : 0.020301s : 1: type_inference TotalTime = 0.0616805, [30] [bootstrap]: 0.00027551 [type_inference]: 0.052902 [event_method]: 1.852e-05 [auto_monad]: 7.099e-05 [graph_reusing]: 5.61e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 9.928e-05 [rewriter_before_opt_a]: 7.955e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00598526, [2] [Cycle 1]: 0.00184279, [27] [switch_simplify]: 5.575e-05 [loop_unroll]: 2.912e-05 [a_1]: 0.00052094 [with_stream_mark]: 1.856e-05 [recompute_prepare]: 7.4e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 8.61002e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00088821 [add_forward_monad_depend]: 1.11e-05 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.651e-05 [cse]: 3.214e-05 [replace_applicator]: 1.324e-05 [Cycle 2]: 0.00031159, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.523e-05 [with_stream_mark]: 9.74999e-06 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 4.84998e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.376e-05 [j_node_and_user_rematch]: 7.69002e-06 [meta_fg_expand]: 1.49998e-06 [replace_old_param]: 7.12002e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.11997e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 5.50001e-06 [cse]: 1.22e-05 [replace_applicator]: 5.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.401e-05 [rewriter_after_opt_a]: 4.403e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00060457 [jit_opt_b]: 4.824e-05, [1] [Cycle 1]: 4.146e-05, [2] [frontend_op_eliminate]: 1.528e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 2.644e-05 [loop_unroll]: 0.00041518 [jit_opt_after_cconv]: 0.00019493, [1] [Cycle 1]: 0.00018848, [11] [c_1]: 2.091e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 6.76e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.357e-05 [call_graph_tuple_transform]: 1.909e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.583e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 5.66e-06 [add_recomputation]: 5.183e-05 [cse_after_recomputation]: 3.863e-05, [1] [Cycle 1]: 3.311e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.959e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 5.05999e-06 [opt_after_jit_grad]: 0.0004597 [symbol_engine_optimizer]: 7.273e-05, [1] [Cycle 1]: 6.616e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 7.75e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.74999e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 5.69999e-07 [validate]: 3.907e-05 Sums bootstrap : 0.000276s : 0.48% type_inference : 0.052902s : 92.44% event_method : 0.000019s : 0.03% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000099s : 0.17% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.11% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000606s : 1.06% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000888s : 1.55% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000044s : 0.08% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000044s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000605s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000026s : 0.05% loop_unroll : 0.000415s : 0.73% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000460s : 0.80% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.07% Time group info: ------[substitution.] 0.000202 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000005s : 3: substitution.graph_param_transform 84.15% : 0.000170s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000004s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 6.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052840 2 97.17% : 0.051344s : 1: type_inference.infer 2.83% : 0.001496s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.62% : 0.000045s : 4: replace.inline 32.38% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.58% : 0.000167s : 4: match.inline 6.42% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.49% : 0.000001s : 3: predicate.graph_param_transform 5.32% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.37% : 0.000010s : 53: predicate.switch_simplify 1.41% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000797 13 45.99% : 0.000367s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.92% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.09% : 0.000383s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063441 72 0.09% : 0.000055s : 1: add_recomputation 0.12% : 0.000075s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.46% : 0.000293s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000041s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.44% : 0.005989s : 1: jit_opt_a 0.31% : 0.000198s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.67% : 0.000423s : 1: loop_unroll 0.97% : 0.000613s : 1: mutable_eliminate 1.29% : 0.000817s : 26: opt.transform.jit_opt_a 0.08% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000467s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000103s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.78% : 0.000494s : 1: renormalize.infer 0.61% : 0.000386s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000047s : 1: rewriter_after_opt_a 0.13% : 0.000083s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 83.41% : 0.052914s : 1: type_inference TotalTime = 0.0918622, [30] [bootstrap]: 0.00026759 [type_inference]: 0.083405 [event_method]: 1.987e-05 [auto_monad]: 6.945e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 0.00010557 [rewriter_before_opt_a]: 7.731e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00571148, [2] [Cycle 1]: 0.00231272, [27] [switch_simplify]: 4.991e-05 [loop_unroll]: 2.977e-05 [a_1]: 0.00096271 [with_stream_mark]: 2.008e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.54999e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00092156 [add_forward_monad_depend]: 5.81e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.499e-05 [cse]: 3.032e-05 [replace_applicator]: 1.217e-05 [Cycle 2]: 0.00031364, [27] [switch_simplify]: 5.72999e-06 [loop_unroll]: 5.14e-06 [a_1]: 8.735e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 5.01997e-06 [updatestate_depend_eliminate]: 2.66e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.19972e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 7.65998e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 6.89001e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.218e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.172e-05 [rewriter_after_opt_a]: 3.732e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00056793 [jit_opt_b]: 4.923e-05, [1] [Cycle 1]: 4.225e-05, [2] [frontend_op_eliminate]: 1.534e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 2.55e-05 [loop_unroll]: 0.00043915 [jit_opt_after_cconv]: 0.00013687, [1] [Cycle 1]: 0.00013079, [11] [c_1]: 2.042e-05 [parameter_eliminate]: 2.19999e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.28998e-06 [cse]: 2.021e-05 [call_graph_tuple_transform]: 1.855e-05 [tuple_list_get_item_eliminator]: 5.08002e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.34998e-06 [remove_dup_value]: 1.498e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.06998e-06 [add_recomputation]: 5.688e-05 [cse_after_recomputation]: 2.337e-05, [1] [Cycle 1]: 1.798e-05, [1] [cse]: 1.24e-05 [auto_monad_reorder]: 1.752e-05 [get_jit_bprop_graph]: 2.46998e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00051399 [symbol_engine_optimizer]: 6.982e-05, [1] [Cycle 1]: 6.328e-05, [6] [build]: 2.81e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.252e-05 [opt_reshape]: 5.56002e-06 [fold_const_symbol]: 8.45999e-06 [renormalize]: 3.89991e-07 [validate]: 3.865e-05 Sums bootstrap : 0.000268s : 0.30% type_inference : 0.083405s : 94.54% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000106s : 0.12% rewriter_before_opt_a : 0.000077s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.001050s : 1.19% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000922s : 1.04% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000043s : 0.05% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000568s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000439s : 0.50% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000057s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000514s : 0.58% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000579 23 0.32% : 0.000002s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 0.94% : 0.000005s : 3: substitution.graph_param_transform 94.27% : 0.000546s : 4: substitution.inline 0.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.78% : 0.000005s : 4: substitution.remove_not_recompute_node 0.72% : 0.000004s : 2: substitution.replace_old_param 2.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.083342 2 98.27% : 0.081903s : 1: type_inference.infer 1.73% : 0.001439s : 1: type_inference.specialize ------[replace.] 0.000118 6 77.36% : 0.000091s : 4: replace.inline 22.64% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000554 6 97.91% : 0.000542s : 4: match.inline 2.09% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.60% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.38% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.95% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 3: predicate.row_tensor_eliminate 1.48% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.72% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000789 13 46.52% : 0.000367s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.29% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.19% : 0.000373s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.094095 72 0.06% : 0.000060s : 1: add_recomputation 0.08% : 0.000073s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.30% : 0.000284s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.07% : 0.005715s : 1: jit_opt_a 0.15% : 0.000139s : 1: jit_opt_after_cconv 0.06% : 0.000052s : 1: jit_opt_b 0.48% : 0.000447s : 1: loop_unroll 0.61% : 0.000576s : 1: mutable_eliminate 1.34% : 0.001257s : 26: opt.transform.jit_opt_a 0.05% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000110s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.55% : 0.000521s : 1: renormalize.infer 0.42% : 0.000391s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000081s : 1: rewriter_before_opt_a 0.08% : 0.000072s : 1: symbol_engine_optimizer 88.65% : 0.083417s : 1: type_inference TotalTime = 0.150215, [30] [bootstrap]: 0.00024592 [type_inference]: 0.122866 [event_method]: 0.0004948 [auto_monad]: 0.00011109 [graph_reusing]: 7.51999e-06 [pre_auto_parallel]: 3.64002e-06 [py_interpret_to_execute]: 3.867e-05 [rewriter_before_opt_a]: 0.00012713 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.0239956, [3] [Cycle 1]: 0.0164424, [27] [switch_simplify]: 7.575e-05 [loop_unroll]: 4.541e-05 [a_1]: 0.00101667 [with_stream_mark]: 3.27e-05 [recompute_prepare]: 2.281e-05 [updatestate_depend_eliminate]: 9.31e-06 [updatestate_assign_eliminate]: 7.35e-06 [updatestate_loads_eliminate]: 7.2e-06 [parameter_eliminate]: 2.97002e-06 [specialize_transform]: 1.555e-05 [updatestate_useless_node_eliminater]: 1.341e-05 [accelerated_algorithm]: 1.4e-05 [meta_shard_fg_expand]: 4.13001e-06 [get_grad_eliminate_]: 1.343e-05 [merge_forward]: 9.30001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.827e-05 [j_node_and_user_rematch]: 2.543e-05 [meta_fg_expand]: 0.00178038 [replace_old_param]: 7.074e-05 [inline_without_move]: 6.146e-05 [renormalize]: 0.0124845 [add_forward_monad_depend]: 1.354e-05 [auto_monad_grad]: 6.31998e-06 [auto_monad_eliminator]: 6.394e-05 [cse]: 0.00027313 [replace_applicator]: 9.213e-05 [Cycle 2]: 0.0037429, [27] [switch_simplify]: 4.288e-05 [loop_unroll]: 4.199e-05 [a_1]: 0.00123899 [with_stream_mark]: 1.766e-05 [recompute_prepare]: 9.31e-06 [updatestate_depend_eliminate]: 4.66002e-06 [updatestate_assign_eliminate]: 4.47e-06 [updatestate_loads_eliminate]: 4.27003e-06 [parameter_eliminate]: 2.36998e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 4.89998e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.795e-05 [j_node_and_user_rematch]: 1.129e-05 [meta_fg_expand]: 0.00012031 [replace_old_param]: 8.02e-06 [inline_without_move]: 7.17002e-06 [renormalize]: 0.00191397 [add_forward_monad_depend]: 7.68001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.446e-05 [cse]: 2.763e-05 [replace_applicator]: 1.832e-05 [Cycle 3]: 0.00026457, [27] [switch_simplify]: 5.00999e-06 [loop_unroll]: 3.84997e-06 [a_1]: 4.639e-05 [with_stream_mark]: 1.135e-05 [recompute_prepare]: 3.85e-06 [updatestate_depend_eliminate]: 2.47001e-06 [updatestate_assign_eliminate]: 1.94e-06 [updatestate_loads_eliminate]: 1.81e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 3.56999e-06 [updatestate_useless_node_eliminater]: 3.26999e-06 [accelerated_algorithm]: 3.02002e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 3.46001e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 2.74001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.207e-05 [j_node_and_user_rematch]: 6.46e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 3.14999e-06 [inline_without_move]: 3.09001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 3.57002e-06 [cse]: 7.87e-06 [replace_applicator]: 3.55998e-06 [py_interpret_to_execute_after_opt_a]: 1.466e-05 [rewriter_after_opt_a]: 3.593e-05 [convert_after_rewriter]: 6.10002e-06 [order_py_execute_after_rewriter]: 4.48999e-06 [mutable_eliminate]: 0.00073379 [jit_opt_b]: 4.144e-05, [1] [Cycle 1]: 3.412e-05, [2] [frontend_op_eliminate]: 1.044e-05 [inline_after_opt_a]: 1.217e-05 [cconv]: 2.738e-05 [loop_unroll]: 0.00043195 [jit_opt_after_cconv]: 0.00013525, [1] [Cycle 1]: 0.00012865, [11] [c_1]: 1.318e-05 [parameter_eliminate]: 3.36999e-06 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 1.76e-06 [cse]: 2.319e-05 [call_graph_tuple_transform]: 1.504e-05 [tuple_list_get_item_eliminator]: 4.23999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 3.85e-06 [remove_dup_value]: 1.477e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 5.33002e-06 [add_recomputation]: 3.937e-05 [cse_after_recomputation]: 1.964e-05, [1] [Cycle 1]: 1.426e-05, [1] [cse]: 8.15e-06 [auto_monad_reorder]: 1.389e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00044409 [symbol_engine_optimizer]: 6.753e-05, [1] [Cycle 1]: 6.123e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 5.71998e-06 [elim_not_effective]: 9.20999e-06 [opt_reshape]: 4.83001e-06 [fold_const_symbol]: 6.43e-06 [renormalize]: 9.20001e-07 [validate]: 7.688e-05 Sums bootstrap : 0.000246s : 0.17% type_inference : 0.122866s : 84.28% event_method : 0.000495s : 0.34% auto_monad : 0.000111s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000039s : 0.03% rewriter_before_opt_a : 0.000127s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000124s : 0.08% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002302s : 1.58% jit_opt_a.with_stream_mark : 0.000062s : 0.04% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001902s : 1.30% jit_opt_a.replace_old_param : 0.000082s : 0.06% jit_opt_a.inline_without_move : 0.000072s : 0.05% jit_opt_a.renormalize : 0.014399s : 9.88% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.06% jit_opt_a.cse : 0.000309s : 0.21% jit_opt_a.replace_applicator : 0.000114s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000734s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000432s : 0.30% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000444s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000077s : 0.05% Time group info: ------[substitution.] 0.000577 104 0.24% : 0.000001s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.79% : 0.000005s : 1: substitution.graph_param_transform 66.20% : 0.000382s : 13: substitution.inline 3.19% : 0.000018s : 2: substitution.inline_without_move 1.85% : 0.000011s : 12: substitution.j_node_and_user_rematch 2.09% : 0.000012s : 7: substitution.minmaximum_grad 1.33% : 0.000008s : 5: substitution.partial_eliminate 1.71% : 0.000010s : 12: substitution.remove_not_recompute_node 5.45% : 0.000031s : 10: substitution.replace_applicator 1.11% : 0.000006s : 10: substitution.replace_old_param 0.52% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.02% : 0.000006s : 1: substitution.tile_eliminate 4.01% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.68% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.66% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122763 2 97.31% : 0.119456s : 1: type_inference.infer 2.69% : 0.003307s : 1: type_inference.specialize ------[replace.] 0.000235 20 51.57% : 0.000121s : 13: replace.inline 48.43% : 0.000114s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000395 20 94.65% : 0.000374s : 13: match.inline 5.35% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000430 2544 1.32% : 0.000006s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.36% : 0.000006s : 44: predicate.addn_check_dump 1.67% : 0.000007s : 44: predicate.addn_zero_filter 1.81% : 0.000008s : 44: predicate.arithmetic_simplify 1.39% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.21% : 0.000005s : 44: predicate.compare_switch_simplify 1.46% : 0.000006s : 44: predicate.depend_value_elim 1.29% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.49% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.34% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.34% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.42% : 0.000006s : 44: predicate.environ_get_depend_swap 1.31% : 0.000006s : 44: predicate.environ_get_eliminate 1.28% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000004s : 17: predicate.get_grad_eliminate 0.06% : 0.000000s : 1: predicate.graph_param_transform 3.89% : 0.000017s : 66: predicate.inline 1.78% : 0.000008s : 45: predicate.inline_without_move 0.30% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.73% : 0.000003s : 17: predicate.less_batch_normalization 1.61% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.56% : 0.000007s : 52: predicate.load_eliminater 0.30% : 0.000001s : 1: predicate.loop_unroll_after_grad 2.91% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.54% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.23% : 0.000005s : 44: predicate.merge_addn 1.37% : 0.000006s : 44: predicate.minmaximum_grad 0.45% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 1.98% : 0.000009s : 52: predicate.partial_eliminate 1.27% : 0.000005s : 44: predicate.print_const_string_wrapper 1.74% : 0.000007s : 44: predicate.reduce_eliminate 1.59% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 17: predicate.remove_not_recompute_node 2.44% : 0.000010s : 96: predicate.replace_applicator 1.00% : 0.000004s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000007s : 44: predicate.reshape_eliminate 1.30% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.29% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 2: predicate.special_op_eliminate 0.77% : 0.000003s : 17: predicate.specialize_transform 1.53% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.45% : 0.000011s : 64: predicate.switch_defer_inline 2.38% : 0.000010s : 64: predicate.switch_layer_defer_inline 17.97% : 0.000077s : 157: predicate.switch_simplify 1.34% : 0.000006s : 44: predicate.tile_eliminate 1.32% : 0.000006s : 44: predicate.transpose_eliminate 1.61% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 2.95% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.61% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.63% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.52% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.37% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.61% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003926 45 75.05% : 0.002946s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.95% : 0.000980s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.167533 87 0.03% : 0.000042s : 1: add_recomputation 0.07% : 0.000118s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.16% : 0.000272s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.30% : 0.000503s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.33% : 0.024000s : 1: jit_opt_a 0.08% : 0.000138s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.26% : 0.000440s : 1: loop_unroll 0.44% : 0.000743s : 1: mutable_eliminate 1.77% : 0.002966s : 39: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000452s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.23% : 0.012117s : 2: renormalize.infer 1.35% : 0.002259s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000130s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 73.35% : 0.122889s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.375.884 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e820> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.376.537 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0133392, [30] [bootstrap]: 0.00038082 [type_inference]: 0.00478276 [event_method]: 1.86e-05 [auto_monad]: 6.772e-05 [graph_reusing]: 5.39998e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.27e-05 [rewriter_before_opt_a]: 7.229e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00581912, [2] [Cycle 1]: 0.00186533, [27] [switch_simplify]: 5.903e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.00055543 [with_stream_mark]: 2.063e-05 [recompute_prepare]: 7.50998e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 1.26997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 0.000822 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.629e-05 [cse]: 3.014e-05 [replace_applicator]: 1.238e-05 [Cycle 2]: 0.000313, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.78001e-06 [a_1]: 9.075e-05 [with_stream_mark]: 9.35001e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.10002e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 9.99979e-07 [specialize_transform]: 4.86002e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 4.70001e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.301e-05 [j_node_and_user_rematch]: 7.84002e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.15003e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.46002e-06 [cse]: 9.84001e-06 [replace_applicator]: 4.88001e-06 [py_interpret_to_execute_after_opt_a]: 1.029e-05 [rewriter_after_opt_a]: 3.742e-05 [convert_after_rewriter]: 7.13998e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00058693 [jit_opt_b]: 4.861e-05, [1] [Cycle 1]: 4.175e-05, [2] [frontend_op_eliminate]: 1.564e-05 [inline_after_opt_a]: 1.467e-05 [cconv]: 2.63e-05 [loop_unroll]: 0.00042745 [jit_opt_after_cconv]: 0.00013915, [1] [Cycle 1]: 0.00013296, [11] [c_1]: 1.983e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 1.908e-05 [call_graph_tuple_transform]: 1.867e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.543e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 6.05002e-06 [add_recomputation]: 5.181e-05 [cse_after_recomputation]: 2.027e-05, [1] [Cycle 1]: 1.509e-05, [1] [cse]: 9.67999e-06 [auto_monad_reorder]: 1.495e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 4.18001e-06 [opt_after_jit_grad]: 0.00046152 [symbol_engine_optimizer]: 7.379e-05, [1] [Cycle 1]: 6.737e-05, [6] [build]: 3.83999e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.10015e-07 [validate]: 3.842e-05 Sums bootstrap : 0.000381s : 4.20% type_inference : 0.004783s : 52.69% event_method : 0.000019s : 0.20% auto_monad : 0.000068s : 0.75% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000033s : 0.36% rewriter_before_opt_a : 0.000072s : 0.80% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000065s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.38% jit_opt_a.a_1 : 0.000646s : 7.12% jit_opt_a.with_stream_mark : 0.000030s : 0.33% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000822s : 9.06% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000040s : 0.44% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000037s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000587s : 6.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000026s : 0.29% loop_unroll : 0.000427s : 4.71% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000052s : 0.57% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000015s : 0.16% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000462s : 5.08% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.42% Time group info: ------[substitution.] 0.000227 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 3: substitution.graph_param_transform 84.48% : 0.000192s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004715 2 83.01% : 0.003914s : 1: type_inference.infer 16.99% : 0.000801s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.92% : 0.000048s : 4: replace.inline 31.08% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.18% : 0.000189s : 4: match.inline 5.82% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.76% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.60% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.88% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000635 13 52.17% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.26% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.57% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015068 72 0.36% : 0.000055s : 1: add_recomputation 0.47% : 0.000071s : 1: auto_monad 0.11% : 0.000017s : 1: auto_monad_reorder 2.66% : 0.000401s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 38.64% : 0.005822s : 1: jit_opt_a 0.94% : 0.000142s : 1: jit_opt_after_cconv 0.34% : 0.000051s : 1: jit_opt_b 2.89% : 0.000436s : 1: loop_unroll 3.95% : 0.000595s : 1: mutable_eliminate 5.71% : 0.000860s : 26: opt.transform.jit_opt_a 0.30% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.12% : 0.000470s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000035s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 3.23% : 0.000487s : 1: renormalize.infer 2.16% : 0.000325s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000040s : 1: rewriter_after_opt_a 0.50% : 0.000075s : 1: rewriter_before_opt_a 0.51% : 0.000077s : 1: symbol_engine_optimizer 31.84% : 0.004798s : 1: type_inference TotalTime = 0.0276358, [30] [bootstrap]: 0.00029222 [type_inference]: 0.0183971 [event_method]: 2.158e-05 [auto_monad]: 7.177e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 4.383e-05 [rewriter_before_opt_a]: 8.483e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00655291, [2] [Cycle 1]: 0.00192603, [27] [switch_simplify]: 6.44e-05 [loop_unroll]: 3.403e-05 [a_1]: 0.00066583 [with_stream_mark]: 2.186e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.56999e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.42999e-06 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00079221 [add_forward_monad_depend]: 6.64999e-06 [auto_monad_grad]: 2.58998e-06 [auto_monad_eliminator]: 1.447e-05 [cse]: 3.715e-05 [replace_applicator]: 1.255e-05 [Cycle 2]: 0.00032176, [27] [switch_simplify]: 6.23e-06 [loop_unroll]: 5.25999e-06 [a_1]: 8.925e-05 [with_stream_mark]: 1.029e-05 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.283e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.02002e-06 [inline_without_move]: 4.74998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.373e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.233e-05 [rewriter_after_opt_a]: 4.124e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.00056451 [jit_opt_b]: 5.068e-05, [1] [Cycle 1]: 4.359e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.623e-05 [cconv]: 2.81e-05 [loop_unroll]: 0.00040292 [jit_opt_after_cconv]: 0.00014818, [1] [Cycle 1]: 0.0001417, [11] [c_1]: 2.133e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 6.05002e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 2.616e-05 [call_graph_tuple_transform]: 1.829e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 3.747e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.59999e-06 [add_recomputation]: 5.937e-05 [cse_after_recomputation]: 2.513e-05, [1] [Cycle 1]: 1.939e-05, [1] [cse]: 1.322e-05 [auto_monad_reorder]: 1.786e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.00045022 [symbol_engine_optimizer]: 7.151e-05, [1] [Cycle 1]: 6.554e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.80002e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 3.69997e-07 [validate]: 4.614e-05 Sums bootstrap : 0.000292s : 1.28% type_inference : 0.018397s : 80.89% event_method : 0.000022s : 0.09% auto_monad : 0.000072s : 0.32% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000044s : 0.19% rewriter_before_opt_a : 0.000085s : 0.37% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.31% jit_opt_a.loop_unroll : 0.000039s : 0.17% jit_opt_a.a_1 : 0.000755s : 3.32% jit_opt_a.with_stream_mark : 0.000032s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000010s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000792s : 3.48% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000051s : 0.22% jit_opt_a.replace_applicator : 0.000018s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000041s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000565s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000028s : 0.12% loop_unroll : 0.000403s : 1.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000037s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000059s : 0.26% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000450s : 1.98% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.20% Time group info: ------[substitution.] 0.000276 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 3: substitution.graph_param_transform 87.10% : 0.000241s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000005s : 2: substitution.replace_old_param 4.79% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018330 2 93.96% : 0.017223s : 1: type_inference.infer 6.04% : 0.001108s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.11% : 0.000064s : 5: replace.inline 31.89% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 7 95.15% : 0.000238s : 5: match.inline 4.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.44% : 0.000002s : 11: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.62% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.54% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.22% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000001s : 11: predicate.environ_get_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.62% : 0.000001s : 3: predicate.graph_param_transform 5.98% : 0.000007s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.62% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000001s : 11: predicate.print_const_string_wrapper 1.58% : 0.000002s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000003s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.43% : 0.000010s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000001s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000840 16 51.71% : 0.000434s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.59% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.70% : 0.000325s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029455 72 0.21% : 0.000062s : 1: add_recomputation 0.25% : 0.000075s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.05% : 0.000309s : 1: bootstrap 0.10% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 22.26% : 0.006556s : 1: jit_opt_a 0.51% : 0.000151s : 1: jit_opt_after_cconv 0.18% : 0.000054s : 1: jit_opt_b 1.40% : 0.000411s : 1: loop_unroll 1.95% : 0.000573s : 1: mutable_eliminate 3.33% : 0.000982s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.56% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000046s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000040s : 1: remove_dup_value 1.58% : 0.000467s : 1: renormalize.infer 1.08% : 0.000317s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000044s : 1: rewriter_after_opt_a 0.30% : 0.000087s : 1: rewriter_before_opt_a 0.25% : 0.000074s : 1: symbol_engine_optimizer 62.52% : 0.018416s : 1: type_inference TotalTime = 0.0590585, [30] [bootstrap]: 0.00031655 [type_inference]: 0.0329857 [event_method]: 1.973e-05 [auto_monad]: 6.811e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00010703 [rewriter_before_opt_a]: 8.06e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0232799, [2] [Cycle 1]: 0.00207241, [27] [switch_simplify]: 6.28e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00056948 [with_stream_mark]: 2.169e-05 [recompute_prepare]: 7.12002e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.96e-06 [renormalize]: 0.00105097 [add_forward_monad_depend]: 6.28e-06 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 1.508e-05 [cse]: 3.377e-05 [replace_applicator]: 1.199e-05 [Cycle 2]: 0.00031562, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 5.04e-06 [a_1]: 8.808e-05 [with_stream_mark]: 9.44998e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.85002e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 7.71001e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 6.77002e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.51998e-06 [cse]: 1.314e-05 [replace_applicator]: 5.59998e-06 [py_interpret_to_execute_after_opt_a]: 1.242e-05 [rewriter_after_opt_a]: 3.982e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00057343 [jit_opt_b]: 4.839e-05, [1] [Cycle 1]: 4.147e-05, [2] [frontend_op_eliminate]: 1.507e-05 [inline_after_opt_a]: 1.604e-05 [cconv]: 2.845e-05 [loop_unroll]: 0.00044187 [jit_opt_after_cconv]: 0.00014732, [1] [Cycle 1]: 0.00014035, [11] [c_1]: 2.178e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 6.36e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.295e-05 [call_graph_tuple_transform]: 1.94e-05 [tuple_list_get_item_eliminator]: 5.31002e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.537e-05 [partial_unused_args_eliminate]: 2.63e-06 [environ_conv]: 6.06998e-06 [add_recomputation]: 5.047e-05 [cse_after_recomputation]: 2.187e-05, [1] [Cycle 1]: 1.684e-05, [1] [cse]: 1.135e-05 [auto_monad_reorder]: 1.839e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00045612 [symbol_engine_optimizer]: 7.145e-05, [1] [Cycle 1]: 6.526e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 5.61998e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 3.69997e-07 [validate]: 3.918e-05 Sums bootstrap : 0.000317s : 0.84% type_inference : 0.032986s : 87.80% event_method : 0.000020s : 0.05% auto_monad : 0.000068s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000107s : 0.28% rewriter_before_opt_a : 0.000081s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.18% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000658s : 1.75% jit_opt_a.with_stream_mark : 0.000031s : 0.08% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001051s : 2.80% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000047s : 0.12% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000040s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000573s : 1.53% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000028s : 0.08% loop_unroll : 0.000442s : 1.18% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 1.21% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.10% Time group info: ------[substitution.] 0.000237 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 3: substitution.graph_param_transform 85.94% : 0.000204s : 4: substitution.inline 1.04% : 0.000002s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 5.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.032916 2 95.34% : 0.031382s : 1: type_inference.infer 4.66% : 0.001534s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.02% : 0.000051s : 4: replace.inline 30.98% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.39% : 0.000201s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 2.50% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.46% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.17% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.88% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.36% : 0.000002s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.62% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000824 13 45.08% : 0.000371s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.35% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.58% : 0.000400s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061036 72 0.09% : 0.000053s : 1: add_recomputation 0.12% : 0.000072s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.55% : 0.000334s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000043s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 38.15% : 0.023283s : 1: jit_opt_a 0.25% : 0.000150s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.74% : 0.000450s : 1: loop_unroll 0.95% : 0.000582s : 1: mutable_eliminate 1.44% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000110s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.03% : 0.000628s : 1: renormalize.infer 0.68% : 0.000414s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000043s : 1: rewriter_after_opt_a 0.14% : 0.000084s : 1: rewriter_before_opt_a 0.12% : 0.000074s : 1: symbol_engine_optimizer 54.07% : 0.033004s : 1: type_inference TotalTime = 0.0686402, [30] [bootstrap]: 0.00026726 [type_inference]: 0.0521347 [event_method]: 2.007e-05 [auto_monad]: 6.844e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.0001028 [rewriter_before_opt_a]: 8.275e-05 [expand_dump_flag]: 2.89999e-06 [jit_opt_a]: 0.0136024, [2] [Cycle 1]: 0.00992977, [27] [switch_simplify]: 5.553e-05 [loop_unroll]: 2.949e-05 [a_1]: 0.0005498 [with_stream_mark]: 2.174e-05 [recompute_prepare]: 8.15e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.93002e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.496e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00805309 [add_forward_monad_depend]: 8.45001e-06 [auto_monad_grad]: 3.2e-06 [auto_monad_eliminator]: 1.989e-05 [cse]: 3.852e-05 [replace_applicator]: 1.79e-05 [Cycle 2]: 0.00033915, [27] [switch_simplify]: 6.80998e-06 [loop_unroll]: 5.46998e-06 [a_1]: 0.00010073 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.18002e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 2.23998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 7.92003e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.363e-05 [replace_applicator]: 5.44998e-06 [py_interpret_to_execute_after_opt_a]: 1.373e-05 [rewriter_after_opt_a]: 4.307e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00067125 [jit_opt_b]: 8.745e-05, [1] [Cycle 1]: 7.96e-05, [2] [frontend_op_eliminate]: 5.21e-05 [inline_after_opt_a]: 1.563e-05 [cconv]: 2.782e-05 [loop_unroll]: 0.00043895 [jit_opt_after_cconv]: 0.00014289, [1] [Cycle 1]: 0.00013613, [11] [c_1]: 2.02e-05 [parameter_eliminate]: 2.60002e-06 [updatestate_depend_eliminate]: 6.54001e-06 [updatestate_assign_eliminate]: 2.70997e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.178e-05 [call_graph_tuple_transform]: 1.923e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 6.41998e-06 [add_recomputation]: 5.177e-05 [cse_after_recomputation]: 2.397e-05, [1] [Cycle 1]: 1.864e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 3.585e-05 [opt_after_jit_grad]: 0.00046058 [symbol_engine_optimizer]: 7.336e-05, [1] [Cycle 1]: 6.677e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 6.01998e-06 [fold_const_symbol]: 9.10999e-06 [renormalize]: 4.20026e-07 [validate]: 4.126e-05 Sums bootstrap : 0.000267s : 0.42% type_inference : 0.052135s : 81.64% event_method : 0.000020s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000103s : 0.16% rewriter_before_opt_a : 0.000083s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000651s : 1.02% jit_opt_a.with_stream_mark : 0.000033s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.008053s : 12.61% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000043s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000671s : 1.05% jit_opt_b.frontend_op_eliminate : 0.000052s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000028s : 0.04% loop_unroll : 0.000439s : 0.69% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000036s : 0.06% opt_after_jit_grad : 0.000461s : 0.72% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.06% Time group info: ------[substitution.] 0.000224 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 3: substitution.graph_param_transform 85.00% : 0.000190s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 5.38% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052061 2 97.07% : 0.050534s : 1: type_inference.infer 2.93% : 0.001526s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.43% : 0.000049s : 4: replace.inline 32.57% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.51% : 0.000188s : 4: match.inline 5.49% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.61% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.56% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.28% : 0.000002s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.78% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.93% : 0.000008s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.45% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.42% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000913 13 42.15% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.19% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.66% : 0.000481s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077647 72 0.07% : 0.000054s : 1: add_recomputation 0.09% : 0.000072s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.37% : 0.000286s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 17.52% : 0.013606s : 1: jit_opt_a 0.19% : 0.000146s : 1: jit_opt_after_cconv 0.12% : 0.000090s : 1: jit_opt_b 0.58% : 0.000447s : 1: loop_unroll 0.88% : 0.000680s : 1: mutable_eliminate 1.12% : 0.000872s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000062s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000106s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 9.70% : 0.007535s : 1: renormalize.infer 0.65% : 0.000505s : 1: renormalize.specialize 0.05% : 0.000038s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000046s : 1: rewriter_after_opt_a 0.11% : 0.000087s : 1: rewriter_before_opt_a 0.10% : 0.000076s : 1: symbol_engine_optimizer 67.17% : 0.052153s : 1: type_inference TotalTime = 0.0527724, [30] [bootstrap]: 0.00030905 [type_inference]: 0.0443487 [event_method]: 2.098e-05 [auto_monad]: 6.948e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00010192 [rewriter_before_opt_a]: 8.142e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00575441, [2] [Cycle 1]: 0.00192412, [27] [switch_simplify]: 5.822e-05 [loop_unroll]: 3.05e-05 [a_1]: 0.00053681 [with_stream_mark]: 1.957e-05 [recompute_prepare]: 8.09997e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00095053 [add_forward_monad_depend]: 4.97e-06 [auto_monad_grad]: 1.55001e-06 [auto_monad_eliminator]: 1.336e-05 [cse]: 2.282e-05 [replace_applicator]: 1.255e-05 [Cycle 2]: 0.00031997, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.52999e-06 [a_1]: 9.081e-05 [with_stream_mark]: 8.84e-06 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.48002e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.272e-05 [j_node_and_user_rematch]: 8.15999e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.85002e-06 [cse]: 1.239e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 3.008e-05 [convert_after_rewriter]: 5.92999e-06 [order_py_execute_after_rewriter]: 4.42e-06 [mutable_eliminate]: 0.00053121 [jit_opt_b]: 4.81e-05, [1] [Cycle 1]: 4.174e-05, [2] [frontend_op_eliminate]: 1.514e-05 [inline_after_opt_a]: 1.548e-05 [cconv]: 1.698e-05 [loop_unroll]: 0.00043191 [jit_opt_after_cconv]: 0.00013972, [1] [Cycle 1]: 0.00013288, [11] [c_1]: 2.1e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.161e-05 [call_graph_tuple_transform]: 1.77e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 6.69999e-07 [renormalize]: 5.19998e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 9.51003e-06 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 4.90001e-06 [add_recomputation]: 3.292e-05 [cse_after_recomputation]: 2.27e-05, [1] [Cycle 1]: 1.794e-05, [1] [cse]: 1.222e-05 [auto_monad_reorder]: 1.137e-05 [get_jit_bprop_graph]: 1.60001e-06 [rewriter_after_jit_bprop_graph]: 5.50001e-06 [opt_after_jit_grad]: 0.00049216 [symbol_engine_optimizer]: 7.254e-05, [1] [Cycle 1]: 6.606e-05, [6] [build]: 2.39999e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 2.89991e-07 [validate]: 3.052e-05 Sums bootstrap : 0.000309s : 0.63% type_inference : 0.044349s : 91.09% event_method : 0.000021s : 0.04% auto_monad : 0.000069s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000102s : 0.21% rewriter_before_opt_a : 0.000081s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.13% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000628s : 1.29% jit_opt_a.with_stream_mark : 0.000028s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000951s : 1.95% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.04% jit_opt_a.cse : 0.000035s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000531s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000017s : 0.03% loop_unroll : 0.000432s : 0.89% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000033s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000492s : 1.01% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.06% Time group info: ------[substitution.] 0.000204 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 1.82% : 0.000004s : 3: substitution.graph_param_transform 84.75% : 0.000173s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000004s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 6.16% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.044278 2 96.60% : 0.042773s : 1: type_inference.infer 3.40% : 0.001505s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.85% : 0.000049s : 4: replace.inline 32.15% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.73% : 0.000170s : 4: match.inline 6.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.53% : 0.000002s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.04% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000821 13 44.96% : 0.000369s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.29% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.75% : 0.000417s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054634 72 0.07% : 0.000036s : 1: add_recomputation 0.13% : 0.000074s : 1: auto_monad 0.03% : 0.000014s : 1: auto_monad_reorder 0.60% : 0.000327s : 1: bootstrap 0.04% : 0.000020s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 10.54% : 0.005758s : 1: jit_opt_a 0.26% : 0.000142s : 1: jit_opt_after_cconv 0.09% : 0.000050s : 1: jit_opt_b 0.81% : 0.000440s : 1: loop_unroll 0.99% : 0.000540s : 1: mutable_eliminate 1.55% : 0.000847s : 26: opt.transform.jit_opt_a 0.08% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000501s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000105s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 0.97% : 0.000532s : 1: renormalize.infer 0.75% : 0.000410s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000033s : 1: rewriter_after_opt_a 0.16% : 0.000085s : 1: rewriter_before_opt_a 0.14% : 0.000075s : 1: symbol_engine_optimizer 81.20% : 0.044365s : 1: type_inference TotalTime = 0.172858, [30] [bootstrap]: 0.00022881 [type_inference]: 0.140963 [event_method]: 0.00057231 [auto_monad]: 0.00012466 [graph_reusing]: 8.27e-06 [pre_auto_parallel]: 3.53999e-06 [py_interpret_to_execute]: 9.91e-05 [rewriter_before_opt_a]: 0.00014025 [expand_dump_flag]: 4.20999e-06 [jit_opt_a]: 0.0283091, [3] [Cycle 1]: 0.0197566, [27] [switch_simplify]: 7.816e-05 [loop_unroll]: 4.618e-05 [a_1]: 0.00106602 [with_stream_mark]: 4.418e-05 [recompute_prepare]: 2.233e-05 [updatestate_depend_eliminate]: 1.179e-05 [updatestate_assign_eliminate]: 8.15999e-06 [updatestate_loads_eliminate]: 6.97002e-06 [parameter_eliminate]: 2.96001e-06 [specialize_transform]: 1.547e-05 [updatestate_useless_node_eliminater]: 1.377e-05 [accelerated_algorithm]: 1.49e-05 [meta_shard_fg_expand]: 4.36002e-06 [get_grad_eliminate_]: 1.492e-05 [merge_forward]: 9.08002e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.84e-05 [j_node_and_user_rematch]: 2.588e-05 [meta_fg_expand]: 0.00240636 [replace_old_param]: 8.343e-05 [inline_without_move]: 7.202e-05 [renormalize]: 0.0149455 [add_forward_monad_depend]: 1.463e-05 [auto_monad_grad]: 6.46999e-06 [auto_monad_eliminator]: 6.691e-05 [cse]: 0.00030419 [replace_applicator]: 0.0001329 [Cycle 2]: 0.00426101, [27] [switch_simplify]: 5.094e-05 [loop_unroll]: 6.107e-05 [a_1]: 0.00127834 [with_stream_mark]: 2.017e-05 [recompute_prepare]: 1.094e-05 [updatestate_depend_eliminate]: 7.26001e-06 [updatestate_assign_eliminate]: 4.31002e-06 [updatestate_loads_eliminate]: 4.13999e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 9.00999e-06 [updatestate_useless_node_eliminater]: 9.04e-06 [accelerated_algorithm]: 8.50999e-06 [meta_shard_fg_expand]: 2.85002e-06 [get_grad_eliminate_]: 8.15e-06 [merge_forward]: 4.93001e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.99e-05 [j_node_and_user_rematch]: 1.419e-05 [meta_fg_expand]: 0.00013743 [replace_old_param]: 1.064e-05 [inline_without_move]: 8.18001e-06 [renormalize]: 0.00234319 [add_forward_monad_depend]: 7.06001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.415e-05 [cse]: 2.762e-05 [replace_applicator]: 1.559e-05 [Cycle 3]: 0.00026442, [27] [switch_simplify]: 4.43001e-06 [loop_unroll]: 3.96001e-06 [a_1]: 4.235e-05 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 4.2e-06 [updatestate_depend_eliminate]: 2.22001e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 1.79998e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 3.82998e-06 [updatestate_useless_node_eliminater]: 3.7e-06 [accelerated_algorithm]: 4.29002e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 3.17002e-06 [merge_forward]: 2.33998e-06 [cell_reuse_recompute_pass]: 2.16e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.308e-05 [j_node_and_user_rematch]: 6.93998e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 3.34001e-06 [inline_without_move]: 3.47997e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 3.45e-06 [cse]: 8.60999e-06 [replace_applicator]: 3.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.388e-05 [rewriter_after_opt_a]: 3.563e-05 [convert_after_rewriter]: 5.91e-06 [order_py_execute_after_rewriter]: 4.23999e-06 [mutable_eliminate]: 0.00075052 [jit_opt_b]: 4.473e-05, [1] [Cycle 1]: 3.674e-05, [2] [frontend_op_eliminate]: 1.202e-05 [inline_after_opt_a]: 1.211e-05 [cconv]: 2.592e-05 [loop_unroll]: 0.00042813 [jit_opt_after_cconv]: 0.00012795, [1] [Cycle 1]: 0.00012184, [11] [c_1]: 1.236e-05 [parameter_eliminate]: 2.74999e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 1.71002e-06 [updatestate_loads_eliminate]: 1.54e-06 [cse]: 1.919e-05 [call_graph_tuple_transform]: 1.532e-05 [tuple_list_get_item_eliminator]: 4.13001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 3.61001e-06 [remove_dup_value]: 1.564e-05 [partial_unused_args_eliminate]: 1.96998e-06 [environ_conv]: 4.58999e-06 [add_recomputation]: 3.691e-05 [cse_after_recomputation]: 2.011e-05, [1] [Cycle 1]: 1.464e-05, [1] [cse]: 8.47e-06 [auto_monad_reorder]: 1.359e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 5.37001e-06 [opt_after_jit_grad]: 0.00049609 [symbol_engine_optimizer]: 7.94e-05, [1] [Cycle 1]: 7.112e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 8.84e-06 [elim_not_effective]: 1.041e-05 [opt_reshape]: 5.53002e-06 [fold_const_symbol]: 5.82001e-06 [renormalize]: 3.89991e-07 [validate]: 3.454e-05 Sums bootstrap : 0.000229s : 0.14% type_inference : 0.140963s : 83.99% event_method : 0.000572s : 0.34% auto_monad : 0.000125s : 0.07% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000099s : 0.06% rewriter_before_opt_a : 0.000140s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000134s : 0.08% jit_opt_a.loop_unroll : 0.000111s : 0.07% jit_opt_a.a_1 : 0.002387s : 1.42% jit_opt_a.with_stream_mark : 0.000077s : 0.05% jit_opt_a.recompute_prepare : 0.000037s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000021s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.002546s : 1.52% jit_opt_a.replace_old_param : 0.000097s : 0.06% jit_opt_a.inline_without_move : 0.000084s : 0.05% jit_opt_a.renormalize : 0.017289s : 10.30% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.05% jit_opt_a.cse : 0.000340s : 0.20% jit_opt_a.replace_applicator : 0.000152s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000751s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000428s : 0.26% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000037s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000496s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.02% Time group info: ------[substitution.] 0.000701 107 0.26% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.68% : 0.000005s : 1: substitution.graph_param_transform 64.99% : 0.000456s : 13: substitution.inline 3.79% : 0.000027s : 2: substitution.inline_without_move 1.56% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.77% : 0.000012s : 7: substitution.minmaximum_grad 1.11% : 0.000008s : 5: substitution.partial_eliminate 1.67% : 0.000012s : 13: substitution.remove_not_recompute_node 7.67% : 0.000054s : 10: substitution.replace_applicator 1.17% : 0.000008s : 10: substitution.replace_old_param 1.07% : 0.000008s : 1: substitution.reshape_eliminate 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.99% : 0.000007s : 1: substitution.tile_eliminate 3.72% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.32% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.66% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.140846 2 97.48% : 0.137299s : 1: type_inference.infer 2.52% : 0.003547s : 1: type_inference.specialize ------[replace.] 0.000205 20 66.75% : 0.000137s : 13: replace.inline 33.25% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000472 20 94.86% : 0.000448s : 13: match.inline 5.14% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000392 2656 1.54% : 0.000006s : 46: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000006s : 46: predicate.addn_check_dump 1.61% : 0.000006s : 46: predicate.addn_zero_filter 1.98% : 0.000008s : 46: predicate.arithmetic_simplify 1.67% : 0.000007s : 46: predicate.cast_eliminate 0.17% : 0.000001s : 1: predicate.check_bprop_eliminate 1.51% : 0.000006s : 46: predicate.compare_switch_simplify 1.55% : 0.000006s : 46: predicate.depend_value_elim 1.49% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.51% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.50% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.15% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.43% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.54% : 0.000006s : 46: predicate.environ_get_depend_swap 1.59% : 0.000006s : 46: predicate.environ_get_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.97% : 0.000004s : 19: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.48% : 0.000018s : 68: predicate.inline 2.15% : 0.000008s : 47: predicate.inline_without_move 0.36% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.27% : 0.000005s : 19: predicate.less_batch_normalization 1.93% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.91% : 0.000007s : 54: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000013s : 94: predicate.loop_unroll_before_grad 1.63% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 46: predicate.merge_addn 1.45% : 0.000006s : 46: predicate.minmaximum_grad 0.41% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.17% : 0.000009s : 54: predicate.partial_eliminate 1.61% : 0.000006s : 46: predicate.print_const_string_wrapper 2.06% : 0.000008s : 46: predicate.reduce_eliminate 1.79% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 19: predicate.remove_not_recompute_node 2.85% : 0.000011s : 100: predicate.replace_applicator 1.37% : 0.000005s : 47: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 46: predicate.reshape_eliminate 1.49% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.52% : 0.000006s : 46: predicate.same_eliminate 0.51% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 19: predicate.specialize_transform 1.90% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.78% : 0.000011s : 66: predicate.switch_defer_inline 2.48% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.17% : 0.000024s : 161: predicate.switch_simplify 1.63% : 0.000006s : 46: predicate.tile_eliminate 1.56% : 0.000006s : 46: predicate.transpose_eliminate 1.94% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.13% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.83% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.86% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.86% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.67% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 1.88% : 0.000007s : 46: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003858 45 74.92% : 0.002890s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.08% : 0.000967s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.193245 87 0.02% : 0.000039s : 1: add_recomputation 0.07% : 0.000131s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.13% : 0.000248s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.30% : 0.000584s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.65% : 0.028313s : 1: jit_opt_a 0.07% : 0.000130s : 1: jit_opt_after_cconv 0.02% : 0.000047s : 1: jit_opt_b 0.23% : 0.000435s : 1: loop_unroll 0.39% : 0.000760s : 1: mutable_eliminate 1.64% : 0.003165s : 39: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.00% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000027s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000505s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000103s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.62% : 0.014733s : 2: renormalize.infer 1.31% : 0.002532s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000143s : 1: rewriter_before_opt_a 0.04% : 0.000082s : 1: symbol_engine_optimizer 72.96% : 0.140983s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.584.399 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dee0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.585.073 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0526211, [30] [bootstrap]: 0.00026137 [type_inference]: 0.0359067 [event_method]: 2.469e-05 [auto_monad]: 7.165e-05 [graph_reusing]: 7.05e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 5.731e-05 [rewriter_before_opt_a]: 9.301e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.0135928, [2] [Cycle 1]: 0.0058452, [27] [switch_simplify]: 7.453e-05 [loop_unroll]: 3.314e-05 [a_1]: 0.00072047 [with_stream_mark]: 2.718e-05 [recompute_prepare]: 9.67001e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 0.00455736 [add_forward_monad_depend]: 1.278e-05 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 2.694e-05 [cse]: 4.85e-05 [replace_applicator]: 2.406e-05 [Cycle 2]: 0.00035885, [27] [switch_simplify]: 6.46999e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.44e-05 [with_stream_mark]: 1.709e-05 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.08002e-06 [specialize_transform]: 5.66998e-06 [updatestate_useless_node_eliminater]: 4.81002e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 4.52998e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.87e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 5.56998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.62999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 7.09001e-06 [cse]: 1.63e-05 [replace_applicator]: 6.52001e-06 [py_interpret_to_execute_after_opt_a]: 2.098e-05 [rewriter_after_opt_a]: 4.459e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.0007781 [jit_opt_b]: 5.091e-05, [1] [Cycle 1]: 4.272e-05, [2] [frontend_op_eliminate]: 1.542e-05 [inline_after_opt_a]: 1.643e-05 [cconv]: 3.47e-05 [loop_unroll]: 0.00049942 [jit_opt_after_cconv]: 0.00016821, [1] [Cycle 1]: 0.00016185, [11] [c_1]: 2.079e-05 [parameter_eliminate]: 4.67e-06 [updatestate_depend_eliminate]: 1.042e-05 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.73998e-06 [cse]: 3.758e-05 [call_graph_tuple_transform]: 2.11e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 9.80013e-07 [switch_simplify]: 5.26998e-06 [remove_dup_value]: 4.655e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 7.69002e-06 [add_recomputation]: 5.773e-05 [cse_after_recomputation]: 2.608e-05, [1] [Cycle 1]: 2.07e-05, [1] [cse]: 1.42e-05 [auto_monad_reorder]: 1.859e-05 [get_jit_bprop_graph]: 2.57001e-06 [rewriter_after_jit_bprop_graph]: 7.21999e-06 [opt_after_jit_grad]: 0.00050517 [symbol_engine_optimizer]: 7.638e-05, [1] [Cycle 1]: 6.971e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 6.11998e-06 [fold_const_symbol]: 8.98002e-06 [renormalize]: 4.10015e-07 [validate]: 4.771e-05 Sums bootstrap : 0.000261s : 0.59% type_inference : 0.035907s : 80.53% event_method : 0.000025s : 0.06% auto_monad : 0.000072s : 0.16% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000057s : 0.13% rewriter_before_opt_a : 0.000093s : 0.21% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.18% jit_opt_a.loop_unroll : 0.000038s : 0.09% jit_opt_a.a_1 : 0.000815s : 1.83% jit_opt_a.with_stream_mark : 0.000044s : 0.10% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.004557s : 10.22% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.08% jit_opt_a.cse : 0.000065s : 0.15% jit_opt_a.replace_applicator : 0.000031s : 0.07% py_interpret_to_execute_after_opt_a : 0.000021s : 0.05% rewriter_after_opt_a : 0.000045s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000778s : 1.75% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000035s : 0.08% loop_unroll : 0.000499s : 1.12% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000047s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000058s : 0.13% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000505s : 1.13% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.11% Time group info: ------[substitution.] 0.000319 24 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 3: substitution.graph_param_transform 87.78% : 0.000280s : 5: substitution.inline 1.44% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 4.37% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035824 2 95.93% : 0.034367s : 1: type_inference.infer 4.07% : 0.001457s : 1: type_inference.specialize ------[replace.] 0.000104 7 70.27% : 0.000073s : 5: replace.inline 29.73% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 7 95.67% : 0.000277s : 5: match.inline 4.33% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 747 1.08% : 0.000001s : 11: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 2.51% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.25% : 0.000002s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 7.27% : 0.000010s : 24: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 2.24% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000000s : 3: predicate.opt_reshape 2.33% : 0.000003s : 16: predicate.partial_eliminate 1.14% : 0.000001s : 11: predicate.print_const_string_wrapper 1.50% : 0.000002s : 11: predicate.reduce_eliminate 1.34% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 2.21% : 0.000003s : 19: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.85% : 0.000010s : 59: predicate.switch_simplify 1.17% : 0.000002s : 11: predicate.tile_eliminate 1.11% : 0.000001s : 11: predicate.transpose_eliminate 1.71% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001082 16 41.19% : 0.000446s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.57% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.24% : 0.000544s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058296 72 0.10% : 0.000061s : 1: add_recomputation 0.13% : 0.000075s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.48% : 0.000279s : 1: bootstrap 0.06% : 0.000038s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 23.32% : 0.013596s : 1: jit_opt_a 0.29% : 0.000171s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.87% : 0.000510s : 1: loop_unroll 1.35% : 0.000790s : 1: mutable_eliminate 1.84% : 0.001072s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.88% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000060s : 1: py_interpret_to_execute 0.04% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000049s : 1: remove_dup_value 6.81% : 0.003973s : 1: renormalize.infer 0.97% : 0.000568s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000048s : 1: rewriter_after_opt_a 0.17% : 0.000097s : 1: rewriter_before_opt_a 0.14% : 0.000079s : 1: symbol_engine_optimizer 61.63% : 0.035930s : 1: type_inference TotalTime = 0.20113, [30] [bootstrap]: 0.00052579 [type_inference]: 0.184672 [event_method]: 2.84e-05 [auto_monad]: 9.207e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.99999e-06 [py_interpret_to_execute]: 0.00096793 [rewriter_before_opt_a]: 0.00012504 [expand_dump_flag]: 5.16998e-06 [jit_opt_a]: 0.0119275, [2] [Cycle 1]: 0.00720875, [27] [switch_simplify]: 9.196e-05 [loop_unroll]: 3.484e-05 [a_1]: 0.00085859 [with_stream_mark]: 2.89e-05 [recompute_prepare]: 1.161e-05 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.44001e-06 [parameter_eliminate]: 2.38998e-06 [specialize_transform]: 7.78999e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 7.31999e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 6.67002e-06 [merge_forward]: 5.14998e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.755e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 1.195e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.00572707 [add_forward_monad_depend]: 1.194e-05 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 2.396e-05 [cse]: 4.313e-05 [replace_applicator]: 2.631e-05 [Cycle 2]: 0.00041304, [27] [switch_simplify]: 7e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00013811 [with_stream_mark]: 1.766e-05 [recompute_prepare]: 6.79999e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 3.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 9.53002e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 1.109e-05 [inline_without_move]: 5.84e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.361e-05 [replace_applicator]: 6.78e-06 [py_interpret_to_execute_after_opt_a]: 1.984e-05 [rewriter_after_opt_a]: 4.558e-05 [convert_after_rewriter]: 8.05e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00085758 [jit_opt_b]: 5.767e-05, [1] [Cycle 1]: 4.865e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 3.151e-05 [loop_unroll]: 0.00047693 [jit_opt_after_cconv]: 0.00017129, [1] [Cycle 1]: 0.00016431, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 3.69002e-06 [updatestate_depend_eliminate]: 8.43999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 3.081e-05 [call_graph_tuple_transform]: 2.484e-05 [tuple_list_get_item_eliminator]: 6.27001e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 9.46e-06 [add_recomputation]: 5.311e-05 [cse_after_recomputation]: 2.399e-05, [1] [Cycle 1]: 1.835e-05, [1] [cse]: 1.242e-05 [auto_monad_reorder]: 1.841e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 7.22002e-06 [opt_after_jit_grad]: 0.00058025 [symbol_engine_optimizer]: 7.953e-05, [1] [Cycle 1]: 7.308e-05, [6] [build]: 4.58001e-06 [elim_shapecalc]: 8.67998e-06 [elim_not_effective]: 1.414e-05 [opt_reshape]: 6.70002e-06 [fold_const_symbol]: 1.079e-05 [renormalize]: 5.29981e-07 [validate]: 5.403e-05 Sums bootstrap : 0.000526s : 0.27% type_inference : 0.184672s : 94.18% event_method : 0.000028s : 0.01% auto_monad : 0.000092s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000968s : 0.49% rewriter_before_opt_a : 0.000125s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000099s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000997s : 0.51% jit_opt_a.with_stream_mark : 0.000047s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.005727s : 2.92% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000057s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000046s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000858s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000477s : 0.24% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000580s : 0.30% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.03% Time group info: ------[substitution.] 0.000376 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.85% : 0.000007s : 4: substitution.graph_param_transform 85.44% : 0.000321s : 5: substitution.inline 1.14% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.92% : 0.000015s : 3: substitution.reduce_eliminate 1.35% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000007s : 2: substitution.replace_old_param 3.45% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.184520 2 83.62% : 0.154302s : 1: type_inference.infer 16.38% : 0.030218s : 1: type_inference.specialize ------[replace.] 0.000139 7 67.19% : 0.000093s : 5: replace.inline 32.81% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000329 7 96.46% : 0.000317s : 5: match.inline 3.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.61% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.32% : 0.000008s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.68% : 0.000003s : 8: predicate.less_batch_normalization 1.68% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.82% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.41% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.29% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.06% : 0.000002s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 1.08% : 0.000002s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.47% : 0.000011s : 64: predicate.switch_simplify 1.44% : 0.000002s : 13: predicate.tile_eliminate 1.52% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.47% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004356 25 41.31% : 0.001799s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.22% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 56.47% : 0.002460s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.208199 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000096s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000555s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 5.73% : 0.011931s : 1: jit_opt_a 0.08% : 0.000174s : 1: jit_opt_after_cconv 0.03% : 0.000061s : 1: jit_opt_b 0.23% : 0.000486s : 1: loop_unroll 0.42% : 0.000870s : 1: mutable_eliminate 0.62% : 0.001295s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000590s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000985s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.51% : 0.003146s : 1: renormalize.infer 1.23% : 0.002565s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000049s : 1: rewriter_after_opt_a 0.06% : 0.000131s : 1: rewriter_before_opt_a 0.04% : 0.000082s : 1: symbol_engine_optimizer 88.72% : 0.184707s : 1: type_inference TotalTime = 0.0524751, [30] [bootstrap]: 0.0003584 [type_inference]: 0.0435551 [event_method]: 2.092e-05 [auto_monad]: 7.195e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00010821 [rewriter_before_opt_a]: 8.549e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.0061284, [2] [Cycle 1]: 0.00222564, [27] [switch_simplify]: 5.553e-05 [loop_unroll]: 2.999e-05 [a_1]: 0.00057043 [with_stream_mark]: 2.026e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 6.53998e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00117588 [add_forward_monad_depend]: 7.34002e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.701e-05 [cse]: 3.661e-05 [replace_applicator]: 1.416e-05 [Cycle 2]: 0.00031554, [27] [switch_simplify]: 5.57999e-06 [loop_unroll]: 5.20001e-06 [a_1]: 8.921e-05 [with_stream_mark]: 9.70002e-06 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.304e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 1.192e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 1.309e-05 [rewriter_after_opt_a]: 3.634e-05 [convert_after_rewriter]: 6.64001e-06 [order_py_execute_after_rewriter]: 4.79998e-06 [mutable_eliminate]: 0.00054908 [jit_opt_b]: 4.881e-05, [1] [Cycle 1]: 4.183e-05, [2] [frontend_op_eliminate]: 1.549e-05 [inline_after_opt_a]: 1.567e-05 [cconv]: 2.68e-05 [loop_unroll]: 0.00041021 [jit_opt_after_cconv]: 0.00014352, [1] [Cycle 1]: 0.00013717, [11] [c_1]: 2.138e-05 [parameter_eliminate]: 2.97002e-06 [updatestate_depend_eliminate]: 6.17001e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.116e-05 [call_graph_tuple_transform]: 1.773e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 5.099e-05 [cse_after_recomputation]: 2.093e-05, [1] [Cycle 1]: 1.593e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.767e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.0004487 [symbol_engine_optimizer]: 6.994e-05, [1] [Cycle 1]: 6.409e-05, [6] [build]: 3.31001e-06 [elim_shapecalc]: 7.69002e-06 [elim_not_effective]: 1.241e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.56002e-06 [renormalize]: 3.50003e-07 [validate]: 4.101e-05 Sums bootstrap : 0.000358s : 0.74% type_inference : 0.043555s : 90.27% event_method : 0.000021s : 0.04% auto_monad : 0.000072s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000108s : 0.22% rewriter_before_opt_a : 0.000085s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.13% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000660s : 1.37% jit_opt_a.with_stream_mark : 0.000030s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001176s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000049s : 0.10% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000036s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000549s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000027s : 0.06% loop_unroll : 0.000410s : 0.85% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000449s : 0.93% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.08% Time group info: ------[substitution.] 0.000230 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000005s : 3: substitution.graph_param_transform 84.64% : 0.000195s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000004s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 6.28% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043477 2 96.09% : 0.041778s : 1: type_inference.infer 3.91% : 0.001699s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.65% : 0.000048s : 4: replace.inline 30.35% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 93.59% : 0.000193s : 4: match.inline 6.41% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.40% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 2.42% : 0.000003s : 10: predicate.reduce_eliminate 1.84% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.31% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000906 13 47.43% : 0.000430s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.36% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.21% : 0.000428s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054567 72 0.10% : 0.000053s : 1: add_recomputation 0.14% : 0.000075s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.70% : 0.000380s : 1: bootstrap 0.05% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.24% : 0.006132s : 1: jit_opt_a 0.27% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.81% : 0.000442s : 1: loop_unroll 1.02% : 0.000557s : 1: mutable_eliminate 1.61% : 0.000879s : 26: opt.transform.jit_opt_a 0.09% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000112s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.06% : 0.000576s : 1: renormalize.infer 1.08% : 0.000592s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.16% : 0.000090s : 1: rewriter_before_opt_a 0.13% : 0.000072s : 1: symbol_engine_optimizer 79.86% : 0.043576s : 1: type_inference TotalTime = 0.147277, [30] [bootstrap]: 0.00031273 [type_inference]: 0.119592 [event_method]: 0.00063364 [auto_monad]: 0.00011899 [graph_reusing]: 7.65998e-06 [pre_auto_parallel]: 3.31999e-06 [py_interpret_to_execute]: 9.767e-05 [rewriter_before_opt_a]: 0.00013627 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0240341, [3] [Cycle 1]: 0.016726, [27] [switch_simplify]: 7.624e-05 [loop_unroll]: 4.662e-05 [a_1]: 0.00098325 [with_stream_mark]: 3.232e-05 [recompute_prepare]: 2.109e-05 [updatestate_depend_eliminate]: 9.49e-06 [updatestate_assign_eliminate]: 7.28999e-06 [updatestate_loads_eliminate]: 6.63e-06 [parameter_eliminate]: 2.86e-06 [specialize_transform]: 1.522e-05 [updatestate_useless_node_eliminater]: 1.37e-05 [accelerated_algorithm]: 1.423e-05 [meta_shard_fg_expand]: 3.48e-06 [get_grad_eliminate_]: 1.366e-05 [merge_forward]: 9.46e-06 [cell_reuse_recompute_pass]: 1.06997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.782e-05 [j_node_and_user_rematch]: 2.46e-05 [meta_fg_expand]: 0.0018188 [replace_old_param]: 7.112e-05 [inline_without_move]: 0.00010334 [renormalize]: 0.0127081 [add_forward_monad_depend]: 1.483e-05 [auto_monad_grad]: 6.63998e-06 [auto_monad_eliminator]: 6.617e-05 [cse]: 0.00027288 [replace_applicator]: 9.459e-05 [Cycle 2]: 0.00345051, [27] [switch_simplify]: 4.411e-05 [loop_unroll]: 4.264e-05 [a_1]: 0.00116433 [with_stream_mark]: 1.734e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 4.1e-06 [updatestate_loads_eliminate]: 3.81001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 6.35997e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.99001e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.66002e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 1.05e-05 [meta_fg_expand]: 0.00010648 [replace_old_param]: 8.41002e-06 [inline_without_move]: 6.66999e-06 [renormalize]: 0.00174814 [add_forward_monad_depend]: 6.15002e-06 [auto_monad_grad]: 1.72999e-06 [auto_monad_eliminator]: 1.169e-05 [cse]: 2.259e-05 [replace_applicator]: 1.47e-05 [Cycle 3]: 0.0002533, [27] [switch_simplify]: 4.49002e-06 [loop_unroll]: 3.73001e-06 [a_1]: 4.158e-05 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 3.25e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 1.62999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 3.46001e-06 [updatestate_useless_node_eliminater]: 3.16999e-06 [accelerated_algorithm]: 3.45998e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 3.23e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 2.20002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.089e-05 [j_node_and_user_rematch]: 6.11e-06 [meta_fg_expand]: 1.43002e-06 [replace_old_param]: 3.23e-06 [inline_without_move]: 3.04001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 3.95998e-06 [cse]: 8.67e-06 [replace_applicator]: 3.45e-06 [py_interpret_to_execute_after_opt_a]: 1.297e-05 [rewriter_after_opt_a]: 3.634e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 4.36002e-06 [mutable_eliminate]: 0.00075126 [jit_opt_b]: 4.346e-05, [1] [Cycle 1]: 3.502e-05, [2] [frontend_op_eliminate]: 1.122e-05 [inline_after_opt_a]: 1.167e-05 [cconv]: 2.808e-05 [loop_unroll]: 0.00043683 [jit_opt_after_cconv]: 0.0001287, [1] [Cycle 1]: 0.00012085, [11] [c_1]: 1.32e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 1.67999e-06 [cse]: 1.957e-05 [call_graph_tuple_transform]: 1.361e-05 [tuple_list_get_item_eliminator]: 4.04997e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 3.43999e-06 [remove_dup_value]: 1.455e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 5.71e-06 [add_recomputation]: 3.675e-05 [cse_after_recomputation]: 2.041e-05, [1] [Cycle 1]: 1.555e-05, [1] [cse]: 8.55999e-06 [auto_monad_reorder]: 1.285e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.81998e-06 [opt_after_jit_grad]: 0.00048211 [symbol_engine_optimizer]: 6.74e-05, [1] [Cycle 1]: 6.127e-05, [6] [build]: 4.25999e-06 [elim_shapecalc]: 5.92999e-06 [elim_not_effective]: 1.033e-05 [opt_reshape]: 4.25999e-06 [fold_const_symbol]: 6.23e-06 [renormalize]: 3.89991e-07 [validate]: 3.532e-05 Sums bootstrap : 0.000313s : 0.22% type_inference : 0.119592s : 83.75% event_method : 0.000634s : 0.44% auto_monad : 0.000119s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000098s : 0.07% rewriter_before_opt_a : 0.000136s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000125s : 0.09% jit_opt_a.loop_unroll : 0.000093s : 0.07% jit_opt_a.a_1 : 0.002189s : 1.53% jit_opt_a.with_stream_mark : 0.000059s : 0.04% jit_opt_a.recompute_prepare : 0.000033s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000025s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.03% jit_opt_a.meta_fg_expand : 0.001927s : 1.35% jit_opt_a.replace_old_param : 0.000083s : 0.06% jit_opt_a.inline_without_move : 0.000113s : 0.08% jit_opt_a.renormalize : 0.014456s : 10.12% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.06% jit_opt_a.cse : 0.000304s : 0.21% jit_opt_a.replace_applicator : 0.000113s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000751s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000437s : 0.31% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000482s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.02% Time group info: ------[substitution.] 0.000566 104 0.30% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.76% : 0.000004s : 1: substitution.graph_param_transform 65.26% : 0.000369s : 13: substitution.inline 3.25% : 0.000018s : 2: substitution.inline_without_move 1.67% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.14% : 0.000012s : 7: substitution.minmaximum_grad 1.45% : 0.000008s : 5: substitution.partial_eliminate 1.78% : 0.000010s : 12: substitution.remove_not_recompute_node 5.62% : 0.000032s : 10: substitution.replace_applicator 1.15% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.14% : 0.000006s : 1: substitution.tile_eliminate 4.15% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.86% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.83% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119483 2 97.40% : 0.116373s : 1: type_inference.infer 2.60% : 0.003111s : 1: type_inference.specialize ------[replace.] 0.000183 20 65.80% : 0.000120s : 13: replace.inline 34.20% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000383 20 94.21% : 0.000361s : 13: match.inline 5.79% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000371 2544 1.64% : 0.000006s : 44: predicate.accumulaten_eliminater 0.31% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.49% : 0.000006s : 44: predicate.addn_check_dump 1.70% : 0.000006s : 44: predicate.addn_zero_filter 2.05% : 0.000008s : 44: predicate.arithmetic_simplify 1.57% : 0.000006s : 44: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 44: predicate.compare_switch_simplify 1.58% : 0.000006s : 44: predicate.depend_value_elim 1.44% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.46% : 0.000005s : 44: predicate.dict_get_item_eliminator 1.46% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.17% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_depend_swap 1.49% : 0.000006s : 44: predicate.environ_get_eliminate 1.43% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.32% : 0.000016s : 66: predicate.inline 2.06% : 0.000008s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.96% : 0.000004s : 17: predicate.less_batch_normalization 1.85% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.93% : 0.000007s : 52: predicate.load_eliminater 0.41% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.45% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.68% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.38% : 0.000005s : 44: predicate.merge_addn 1.54% : 0.000006s : 44: predicate.minmaximum_grad 0.47% : 0.000002s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000009s : 52: predicate.partial_eliminate 1.50% : 0.000006s : 44: predicate.print_const_string_wrapper 2.18% : 0.000008s : 44: predicate.reduce_eliminate 1.84% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 17: predicate.remove_not_recompute_node 2.70% : 0.000010s : 96: predicate.replace_applicator 1.11% : 0.000004s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.56% : 0.000006s : 44: predicate.reshape_eliminate 1.55% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.22% : 0.000001s : 1: predicate.row_tensor_eliminate 1.65% : 0.000006s : 44: predicate.same_eliminate 0.45% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 17: predicate.specialize_transform 1.85% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.87% : 0.000011s : 64: predicate.switch_defer_inline 2.62% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.51% : 0.000024s : 157: predicate.switch_simplify 1.74% : 0.000006s : 44: predicate.tile_eliminate 1.47% : 0.000005s : 44: predicate.transpose_eliminate 1.86% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.22% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.95% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.83% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.78% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.89% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003778 45 75.38% : 0.002848s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.62% : 0.000930s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.164617 87 0.02% : 0.000039s : 1: add_recomputation 0.08% : 0.000125s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.20% : 0.000328s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.39% : 0.000649s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.60% : 0.024037s : 1: jit_opt_a 0.08% : 0.000131s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.27% : 0.000446s : 1: loop_unroll 0.46% : 0.000760s : 1: mutable_eliminate 1.76% : 0.002891s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000491s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000101s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.35% : 0.012105s : 2: renormalize.infer 1.41% : 0.002329s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000140s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 72.67% : 0.119620s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.748.445 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004db80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.749.144 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0163097, [30] [bootstrap]: 0.00028477 [type_inference]: 0.00478234 [event_method]: 1.883e-05 [auto_monad]: 7.152e-05 [graph_reusing]: 6.48998e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 3.614e-05 [rewriter_before_opt_a]: 7.455e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00607031, [2] [Cycle 1]: 0.00234599, [27] [switch_simplify]: 5.516e-05 [loop_unroll]: 4.965e-05 [a_1]: 0.00057357 [with_stream_mark]: 2.142e-05 [recompute_prepare]: 7.54002e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 2.33998e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.17e-06 [renormalize]: 0.00066158 [add_forward_monad_depend]: 5.69e-06 [auto_monad_grad]: 2.50002e-06 [auto_monad_eliminator]: 1.588e-05 [cse]: 3.561e-05 [replace_applicator]: 1.204e-05 [Cycle 2]: 0.0003208, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.01002e-06 [a_1]: 8.581e-05 [with_stream_mark]: 9.22999e-06 [recompute_prepare]: 4.90001e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.51002e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.264e-05 [j_node_and_user_rematch]: 7.59002e-06 [meta_fg_expand]: 1.51998e-06 [replace_old_param]: 6.78e-06 [inline_without_move]: 5.01002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.317e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.182e-05 [rewriter_after_opt_a]: 4.334e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00054996 [jit_opt_b]: 4.909e-05, [1] [Cycle 1]: 4.209e-05, [2] [frontend_op_eliminate]: 1.495e-05 [inline_after_opt_a]: 1.498e-05 [cconv]: 2.805e-05 [loop_unroll]: 0.00041657 [jit_opt_after_cconv]: 0.00015894, [1] [Cycle 1]: 0.00015263, [11] [c_1]: 2.013e-05 [parameter_eliminate]: 3.25998e-06 [updatestate_depend_eliminate]: 6.69001e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 2.573e-05 [call_graph_tuple_transform]: 1.828e-05 [tuple_list_get_item_eliminator]: 5.31998e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.49998e-06 [remove_dup_value]: 1.9e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 0.00265879 [cse_after_recomputation]: 5.36e-05, [1] [Cycle 1]: 4.332e-05, [1] [cse]: 2.813e-05 [auto_monad_reorder]: 2.29e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.00059117 [symbol_engine_optimizer]: 7.755e-05, [1] [Cycle 1]: 7.083e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 7.88999e-06 [elim_not_effective]: 1.482e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 9.20001e-07 [validate]: 4.816e-05 Sums bootstrap : 0.000285s : 2.45% type_inference : 0.004782s : 41.16% event_method : 0.000019s : 0.16% auto_monad : 0.000072s : 0.62% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.31% rewriter_before_opt_a : 0.000075s : 0.64% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.53% jit_opt_a.loop_unroll : 0.000055s : 0.47% jit_opt_a.a_1 : 0.000659s : 5.68% jit_opt_a.with_stream_mark : 0.000031s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000662s : 5.69% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.19% jit_opt_a.cse : 0.000049s : 0.42% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000043s : 0.37% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000550s : 4.73% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000028s : 0.24% loop_unroll : 0.000417s : 3.59% jit_opt_after_cconv.c_1 : 0.000020s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000019s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.002659s : 22.88% cse_after_recomputation.cse : 0.000028s : 0.24% auto_monad_reorder : 0.000023s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000591s : 5.09% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000048s : 0.41% Time group info: ------[substitution.] 0.000237 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000005s : 3: substitution.graph_param_transform 84.98% : 0.000201s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000004s : 4: substitution.remove_not_recompute_node 1.51% : 0.000004s : 2: substitution.replace_old_param 6.38% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004716 2 82.12% : 0.003873s : 1: type_inference.infer 17.88% : 0.000843s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.38% : 0.000048s : 4: replace.inline 31.62% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 93.44% : 0.000199s : 4: match.inline 6.56% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.70% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000001s : 3: predicate.loop_unroll_after_grad 5.15% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.50% : 0.000003s : 15: predicate.partial_eliminate 1.41% : 0.000002s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.37% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000634 13 53.71% : 0.000341s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.43% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.85% : 0.000246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017897 72 14.95% : 0.002675s : 1: add_recomputation 0.42% : 0.000076s : 1: auto_monad 0.14% : 0.000026s : 1: auto_monad_reorder 1.71% : 0.000307s : 1: bootstrap 0.17% : 0.000031s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.32% : 0.000057s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 33.94% : 0.006074s : 1: jit_opt_a 0.90% : 0.000162s : 1: jit_opt_after_cconv 0.29% : 0.000052s : 1: jit_opt_b 2.37% : 0.000424s : 1: loop_unroll 3.13% : 0.000560s : 1: mutable_eliminate 4.95% : 0.000885s : 26: opt.transform.jit_opt_a 0.26% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000024s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000600s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000039s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.07% : 0.000370s : 1: renormalize.infer 1.58% : 0.000283s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000046s : 1: rewriter_after_opt_a 0.43% : 0.000077s : 1: rewriter_before_opt_a 0.45% : 0.000080s : 1: symbol_engine_optimizer 26.82% : 0.004801s : 1: type_inference TotalTime = 0.109179, [30] [bootstrap]: 0.00026819 [type_inference]: 0.0722934 [event_method]: 0.00031889 [auto_monad]: 0.00010882 [graph_reusing]: 7.38e-06 [pre_auto_parallel]: 3.12002e-06 [py_interpret_to_execute]: 3.46e-05 [rewriter_before_opt_a]: 0.00012548 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0335011, [3] [Cycle 1]: 0.0216971, [27] [switch_simplify]: 8.915e-05 [loop_unroll]: 4.87e-05 [a_1]: 0.00107065 [with_stream_mark]: 3.706e-05 [recompute_prepare]: 2.309e-05 [updatestate_depend_eliminate]: 1.046e-05 [updatestate_assign_eliminate]: 6.91001e-06 [updatestate_loads_eliminate]: 7.23e-06 [parameter_eliminate]: 3.43e-06 [specialize_transform]: 1.561e-05 [updatestate_useless_node_eliminater]: 1.464e-05 [accelerated_algorithm]: 1.492e-05 [meta_shard_fg_expand]: 4.18001e-06 [get_grad_eliminate_]: 1.436e-05 [merge_forward]: 9.31e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.935e-05 [j_node_and_user_rematch]: 2.652e-05 [meta_fg_expand]: 0.002001 [replace_old_param]: 7.256e-05 [inline_without_move]: 6.396e-05 [renormalize]: 0.017366 [add_forward_monad_depend]: 1.357e-05 [auto_monad_grad]: 7.54002e-06 [auto_monad_eliminator]: 6.87e-05 [cse]: 0.0003029 [replace_applicator]: 0.00010302 [Cycle 2]: 0.00728228, [27] [switch_simplify]: 4.621e-05 [loop_unroll]: 4.414e-05 [a_1]: 0.00352991 [with_stream_mark]: 3.088e-05 [recompute_prepare]: 1.66e-05 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 4.38999e-06 [updatestate_loads_eliminate]: 4.08999e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 9.49999e-06 [updatestate_useless_node_eliminater]: 8.77e-06 [accelerated_algorithm]: 8.53001e-06 [meta_shard_fg_expand]: 3.72002e-06 [get_grad_eliminate_]: 8.54e-06 [merge_forward]: 5.54998e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.135e-05 [j_node_and_user_rematch]: 1.435e-05 [meta_fg_expand]: 0.00015886 [replace_old_param]: 1.204e-05 [inline_without_move]: 8.60999e-06 [renormalize]: 0.00300917 [add_forward_monad_depend]: 1.038e-05 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.756e-05 [cse]: 3.394e-05 [replace_applicator]: 2.197e-05 [Cycle 3]: 0.00028527, [27] [switch_simplify]: 4.85999e-06 [loop_unroll]: 4.69002e-06 [a_1]: 5.147e-05 [with_stream_mark]: 1.668e-05 [recompute_prepare]: 3.90998e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 4.12e-06 [updatestate_useless_node_eliminater]: 3.71001e-06 [accelerated_algorithm]: 4.08001e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 3.63e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 3.26999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 6.53998e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 3.44001e-06 [inline_without_move]: 3.56999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 3.66001e-06 [cse]: 9.05999e-06 [replace_applicator]: 3.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.499e-05 [rewriter_after_opt_a]: 3.879e-05 [convert_after_rewriter]: 6.29999e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00078355 [jit_opt_b]: 4.433e-05, [1] [Cycle 1]: 3.653e-05, [2] [frontend_op_eliminate]: 1.208e-05 [inline_after_opt_a]: 1.223e-05 [cconv]: 3.129e-05 [loop_unroll]: 0.00053292 [jit_opt_after_cconv]: 0.00014412, [1] [Cycle 1]: 0.00013738, [11] [c_1]: 1.338e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 6.46e-06 [updatestate_assign_eliminate]: 1.67999e-06 [updatestate_loads_eliminate]: 1.79e-06 [cse]: 2.518e-05 [call_graph_tuple_transform]: 1.726e-05 [tuple_list_get_item_eliminator]: 4.13001e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 4.16001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 3.16999e-06 [environ_conv]: 5.87999e-06 [add_recomputation]: 4.206e-05 [cse_after_recomputation]: 1.938e-05, [1] [Cycle 1]: 1.441e-05, [1] [cse]: 8.23001e-06 [auto_monad_reorder]: 1.398e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 7.8e-06 [opt_after_jit_grad]: 0.00048043 [symbol_engine_optimizer]: 7.087e-05, [1] [Cycle 1]: 6.235e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 5.37001e-06 [elim_not_effective]: 1.095e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 5.84e-06 [renormalize]: 2.89991e-07 [validate]: 4.248e-05 Sums bootstrap : 0.000268s : 0.26% type_inference : 0.072293s : 69.54% event_method : 0.000319s : 0.31% auto_monad : 0.000109s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000035s : 0.03% rewriter_before_opt_a : 0.000125s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000140s : 0.13% jit_opt_a.loop_unroll : 0.000098s : 0.09% jit_opt_a.a_1 : 0.004652s : 4.47% jit_opt_a.with_stream_mark : 0.000085s : 0.08% jit_opt_a.recompute_prepare : 0.000044s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.03% jit_opt_a.accelerated_algorithm : 0.000028s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.05% jit_opt_a.meta_fg_expand : 0.002162s : 2.08% jit_opt_a.replace_old_param : 0.000088s : 0.08% jit_opt_a.inline_without_move : 0.000076s : 0.07% jit_opt_a.renormalize : 0.020375s : 19.60% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000090s : 0.09% jit_opt_a.cse : 0.000346s : 0.33% jit_opt_a.replace_applicator : 0.000128s : 0.12% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000784s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000031s : 0.03% loop_unroll : 0.000533s : 0.51% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000042s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000480s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000774 107 0.22% : 0.000002s : 1: substitution.elim_not_effective 0.12% : 0.000001s : 1: substitution.fold_const_symbol 0.85% : 0.000007s : 1: substitution.graph_param_transform 69.48% : 0.000538s : 13: substitution.inline 2.47% : 0.000019s : 2: substitution.inline_without_move 1.36% : 0.000011s : 13: substitution.j_node_and_user_rematch 2.34% : 0.000018s : 7: substitution.minmaximum_grad 1.05% : 0.000008s : 5: substitution.partial_eliminate 1.52% : 0.000012s : 13: substitution.remove_not_recompute_node 4.83% : 0.000037s : 10: substitution.replace_applicator 0.95% : 0.000007s : 10: substitution.replace_old_param 1.10% : 0.000009s : 1: substitution.reshape_eliminate 0.37% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.96% : 0.000007s : 1: substitution.tile_eliminate 3.44% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.48% : 0.000019s : 7: substitution.tuple_list_get_item_depend_reorder 6.46% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072186 2 96.46% : 0.069632s : 1: type_inference.infer 3.54% : 0.002554s : 1: type_inference.specialize ------[replace.] 0.000211 20 65.03% : 0.000137s : 13: replace.inline 34.97% : 0.000074s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000556 20 95.03% : 0.000528s : 13: match.inline 4.97% : 0.000028s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.002484 2768 0.27% : 0.000007s : 48: predicate.accumulaten_eliminater 0.04% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 0.23% : 0.000006s : 48: predicate.addn_check_dump 0.27% : 0.000007s : 48: predicate.addn_zero_filter 0.32% : 0.000008s : 48: predicate.arithmetic_simplify 0.25% : 0.000006s : 48: predicate.cast_eliminate 0.02% : 0.000000s : 1: predicate.check_bprop_eliminate 0.23% : 0.000006s : 48: predicate.compare_switch_simplify 0.27% : 0.000007s : 48: predicate.depend_value_elim 0.24% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 0.24% : 0.000006s : 48: predicate.dict_get_item_eliminator 0.25% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.05% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.01% : 0.000000s : 1: predicate.elim_not_effective 0.02% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 0.24% : 0.000006s : 48: predicate.environ_add_const_eliminate 0.23% : 0.000006s : 48: predicate.environ_get_add_eliminate 83.51% : 0.002075s : 48: predicate.environ_get_depend_swap 0.25% : 0.000006s : 48: predicate.environ_get_eliminate 0.24% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 1: predicate.fold_const_symbol 0.15% : 0.000004s : 20: predicate.get_grad_eliminate 0.01% : 0.000000s : 1: predicate.graph_param_transform 0.78% : 0.000019s : 70: predicate.inline 0.32% : 0.000008s : 48: predicate.inline_without_move 0.06% : 0.000001s : 20: predicate.j_node_and_user_rematch 0.19% : 0.000005s : 20: predicate.less_batch_normalization 0.30% : 0.000008s : 55: predicate.list_to_tuple_eliminator_ 0.33% : 0.000008s : 56: predicate.load_eliminater 0.06% : 0.000002s : 1: predicate.loop_unroll_after_grad 0.56% : 0.000014s : 101: predicate.loop_unroll_before_grad 0.28% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 0.25% : 0.000006s : 48: predicate.merge_addn 0.25% : 0.000006s : 48: predicate.minmaximum_grad 0.07% : 0.000002s : 1: predicate.mutable_eliminate 0.03% : 0.000001s : 1: predicate.opt_reshape 0.39% : 0.000010s : 56: predicate.partial_eliminate 0.25% : 0.000006s : 48: predicate.print_const_string_wrapper 0.41% : 0.000010s : 48: predicate.reduce_eliminate 0.28% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.08% : 0.000002s : 20: predicate.remove_not_recompute_node 0.47% : 0.000012s : 103: predicate.replace_applicator 0.19% : 0.000005s : 48: predicate.replace_old_param 0.01% : 0.000000s : 1: predicate.reset_defer_inline 0.29% : 0.000007s : 48: predicate.reshape_eliminate 0.30% : 0.000008s : 48: predicate.row_tensor_add_zeros_like 0.04% : 0.000001s : 1: predicate.row_tensor_eliminate 0.24% : 0.000006s : 48: predicate.same_eliminate 0.08% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.03% : 0.000001s : 2: predicate.special_op_eliminate 0.13% : 0.000003s : 20: predicate.specialize_transform 0.30% : 0.000008s : 48: predicate.split_environ_get_set_with_tuple_value 0.24% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.01% : 0.000000s : 1: predicate.switch_call_monad_eliminater 0.50% : 0.000012s : 68: predicate.switch_defer_inline 0.39% : 0.000010s : 68: predicate.switch_layer_defer_inline 1.09% : 0.000027s : 170: predicate.switch_simplify 0.27% : 0.000007s : 48: predicate.tile_eliminate 0.29% : 0.000007s : 48: predicate.transpose_eliminate 0.30% : 0.000007s : 48: predicate.tuple_list_convert_item_index_to_positive 0.29% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 0.56% : 0.000014s : 57: predicate.tuple_list_get_item_eliminator 0.33% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 0.29% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 0.29% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 0.46% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 0.34% : 0.000009s : 48: predicate.value_based_eliminate 0.01% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.03% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005154 58 79.29% : 0.004086s : 41: func_graph_cloner_run.FuncGraphClonerGraph 20.71% : 0.001068s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134938 87 0.03% : 0.000045s : 1: add_recomputation 0.09% : 0.000116s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.22% : 0.000295s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.24% : 0.000327s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 24.83% : 0.033505s : 1: jit_opt_a 0.11% : 0.000147s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.40% : 0.000542s : 1: loop_unroll 0.59% : 0.000794s : 1: mutable_eliminate 4.00% : 0.005391s : 39: opt.transform.jit_opt_a 0.03% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000037s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 13.09% : 0.017659s : 2: renormalize.infer 1.99% : 0.002691s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.10% : 0.000129s : 1: rewriter_before_opt_a 0.05% : 0.000074s : 1: symbol_engine_optimizer 53.59% : 0.072317s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.871.975 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:28.872.781 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0490375, [30] [bootstrap]: 0.00030507 [type_inference]: 0.0220724 [event_method]: 2.135e-05 [auto_monad]: 7.197e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.38998e-06 [py_interpret_to_execute]: 0.0001098 [rewriter_before_opt_a]: 8.493e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0237422, [2] [Cycle 1]: 0.00233704, [27] [switch_simplify]: 6.491e-05 [loop_unroll]: 3.141e-05 [a_1]: 0.00060281 [with_stream_mark]: 2.467e-05 [recompute_prepare]: 9.00999e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 4.90001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.559e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00122236 [add_forward_monad_depend]: 8.42e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.864e-05 [cse]: 3.927e-05 [replace_applicator]: 1.751e-05 [Cycle 2]: 0.00033933, [27] [switch_simplify]: 6.18998e-06 [loop_unroll]: 5.32001e-06 [a_1]: 9.243e-05 [with_stream_mark]: 1.454e-05 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 4.97e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.599e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 7.96001e-06 [inline_without_move]: 4.81002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.392e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.67e-05 [rewriter_after_opt_a]: 4.235e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.67001e-06 [mutable_eliminate]: 0.00079468 [jit_opt_b]: 5.521e-05, [1] [Cycle 1]: 4.673e-05, [2] [frontend_op_eliminate]: 1.701e-05 [inline_after_opt_a]: 1.668e-05 [cconv]: 3.65e-05 [loop_unroll]: 0.00047829 [jit_opt_after_cconv]: 0.0001676, [1] [Cycle 1]: 0.00015969, [11] [c_1]: 2.201e-05 [parameter_eliminate]: 4.91002e-06 [updatestate_depend_eliminate]: 8.89998e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 3.195e-05 [call_graph_tuple_transform]: 2.364e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.84e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 7.58001e-06 [add_recomputation]: 5.765e-05 [cse_after_recomputation]: 2.227e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.123e-05 [auto_monad_reorder]: 1.922e-05 [get_jit_bprop_graph]: 1.859e-05 [rewriter_after_jit_bprop_graph]: 8.17998e-06 [opt_after_jit_grad]: 0.00053325 [symbol_engine_optimizer]: 7.758e-05, [1] [Cycle 1]: 7.066e-05, [6] [build]: 4.34997e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.452e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 9.09998e-06 [renormalize]: 4.69998e-07 [validate]: 4.867e-05 Sums bootstrap : 0.000305s : 1.12% type_inference : 0.022072s : 80.76% event_method : 0.000021s : 0.08% auto_monad : 0.000072s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000110s : 0.40% rewriter_before_opt_a : 0.000085s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000695s : 2.54% jit_opt_a.with_stream_mark : 0.000039s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001222s : 4.47% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000053s : 0.19% jit_opt_a.replace_applicator : 0.000024s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000795s : 2.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000037s : 0.13% loop_unroll : 0.000478s : 1.75% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000058s : 0.21% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000019s : 0.07% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000533s : 1.95% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.18% Time group info: ------[substitution.] 0.000265 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 85.51% : 0.000226s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 5.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021991 2 92.13% : 0.020260s : 1: type_inference.infer 7.87% : 0.001731s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.14% : 0.000052s : 4: replace.inline 31.86% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000236 6 94.78% : 0.000224s : 4: match.inline 5.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.87% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.22% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.68% : 0.000001s : 3: predicate.elim_not_effective 0.95% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.42% : 0.000008s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.23% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.34% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 2.06% : 0.000003s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.04% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000010s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.50% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001095 13 51.53% : 0.000564s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.59% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.88% : 0.000469s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051251 72 0.12% : 0.000060s : 1: add_recomputation 0.15% : 0.000076s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.64% : 0.000326s : 1: bootstrap 0.08% : 0.000039s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.04% : 0.000021s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 46.33% : 0.023747s : 1: jit_opt_a 0.33% : 0.000170s : 1: jit_opt_after_cconv 0.11% : 0.000059s : 1: jit_opt_b 0.95% : 0.000487s : 1: loop_unroll 1.57% : 0.000807s : 1: mutable_eliminate 1.82% : 0.000933s : 26: opt.transform.jit_opt_a 0.10% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.06% : 0.000545s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000113s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.37% : 0.000702s : 1: renormalize.infer 0.99% : 0.000510s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.17% : 0.000089s : 1: rewriter_before_opt_a 0.16% : 0.000080s : 1: symbol_engine_optimizer 43.11% : 0.022096s : 1: type_inference TotalTime = 0.14745, [30] [bootstrap]: 0.00027016 [type_inference]: 0.139241 [event_method]: 3.629e-05 [auto_monad]: 6.879e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00010926 [rewriter_before_opt_a]: 8.552e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00551897, [2] [Cycle 1]: 0.00192757, [27] [switch_simplify]: 5.605e-05 [loop_unroll]: 3.021e-05 [a_1]: 0.00058465 [with_stream_mark]: 1.937e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00088604 [add_forward_monad_depend]: 5.88002e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.696e-05 [cse]: 3.416e-05 [replace_applicator]: 1.328e-05 [Cycle 2]: 0.00033124, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 4.99e-06 [a_1]: 9.243e-05 [with_stream_mark]: 1.013e-05 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.374e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.75998e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.38e-06 [cse]: 1.402e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.781e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00054082 [jit_opt_b]: 5.016e-05, [1] [Cycle 1]: 4.321e-05, [2] [frontend_op_eliminate]: 1.661e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.685e-05 [loop_unroll]: 0.00041956 [jit_opt_after_cconv]: 0.0001376, [1] [Cycle 1]: 0.00013139, [11] [c_1]: 2.071e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.038e-05 [call_graph_tuple_transform]: 1.838e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 5.068e-05 [cse_after_recomputation]: 2.206e-05, [1] [Cycle 1]: 1.714e-05, [1] [cse]: 1.16e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 2.23998e-06 [rewriter_after_jit_bprop_graph]: 4.87998e-06 [opt_after_jit_grad]: 0.00045535 [symbol_engine_optimizer]: 7.147e-05, [1] [Cycle 1]: 6.528e-05, [6] [build]: 3.12002e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 9.06002e-06 [renormalize]: 9.39996e-07 [validate]: 3.655e-05 Sums bootstrap : 0.000270s : 0.19% type_inference : 0.139241s : 96.97% event_method : 0.000036s : 0.03% auto_monad : 0.000069s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000109s : 0.08% rewriter_before_opt_a : 0.000086s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000677s : 0.47% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000886s : 0.62% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000048s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000541s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000420s : 0.29% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.32% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000196 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000005s : 3: substitution.graph_param_transform 82.31% : 0.000161s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000004s : 2: substitution.replace_old_param 6.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139163 2 98.85% : 0.137568s : 1: type_inference.infer 1.15% : 0.001594s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.64% : 0.000051s : 4: replace.inline 31.36% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 92.87% : 0.000159s : 4: match.inline 7.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.26% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000006s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.06% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.48% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.12% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.56% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.27% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000820 13 44.22% : 0.000362s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.77% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.01% : 0.000426s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149282 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000072s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.19% : 0.000282s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.03% : 0.000042s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 3.70% : 0.005522s : 1: jit_opt_a 0.09% : 0.000140s : 1: jit_opt_after_cconv 0.04% : 0.000053s : 1: jit_opt_b 0.29% : 0.000427s : 1: loop_unroll 0.37% : 0.000550s : 1: mutable_eliminate 0.60% : 0.000897s : 26: opt.transform.jit_opt_a 0.03% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000463s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000113s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.32% : 0.000472s : 1: renormalize.infer 0.27% : 0.000407s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000090s : 1: rewriter_before_opt_a 0.05% : 0.000074s : 1: symbol_engine_optimizer 93.29% : 0.139265s : 1: type_inference TotalTime = 0.0289296, [30] [bootstrap]: 0.00032945 [type_inference]: 0.0199969 [event_method]: 1.902e-05 [auto_monad]: 6.645e-05 [graph_reusing]: 5.93002e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 9.432e-05 [rewriter_before_opt_a]: 7.942e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00563329, [2] [Cycle 1]: 0.00188909, [27] [switch_simplify]: 5.666e-05 [loop_unroll]: 2.955e-05 [a_1]: 0.00053694 [with_stream_mark]: 1.934e-05 [recompute_prepare]: 8.67998e-06 [updatestate_depend_eliminate]: 4.19002e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 9.78002e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 0.00091002 [add_forward_monad_depend]: 6.51999e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.584e-05 [cse]: 2.303e-05 [replace_applicator]: 1.512e-05 [Cycle 2]: 0.0003168, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.00001e-06 [a_1]: 8.683e-05 [with_stream_mark]: 1.115e-05 [recompute_prepare]: 5.47999e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.11997e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.261e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 6.83e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.252e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.331e-05 [rewriter_after_opt_a]: 3.845e-05 [convert_after_rewriter]: 6.83998e-06 [order_py_execute_after_rewriter]: 5.69999e-06 [mutable_eliminate]: 0.00094932 [jit_opt_b]: 5.047e-05, [1] [Cycle 1]: 4.299e-05, [2] [frontend_op_eliminate]: 1.544e-05 [inline_after_opt_a]: 1.666e-05 [cconv]: 2.915e-05 [loop_unroll]: 0.00048262 [jit_opt_after_cconv]: 0.00016075, [1] [Cycle 1]: 0.00015417, [11] [c_1]: 2.166e-05 [parameter_eliminate]: 4.08001e-06 [updatestate_depend_eliminate]: 6.89999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.85998e-06 [cse]: 2.943e-05 [call_graph_tuple_transform]: 2.166e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.643e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 7.08998e-06 [add_recomputation]: 5.203e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.887e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.895e-05 [get_jit_bprop_graph]: 3.84002e-06 [rewriter_after_jit_bprop_graph]: 7.28e-06 [opt_after_jit_grad]: 0.00053647 [symbol_engine_optimizer]: 7.393e-05, [1] [Cycle 1]: 6.739e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.466e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.17e-06 [renormalize]: 5.89993e-07 [validate]: 4.038e-05 Sums bootstrap : 0.000329s : 1.32% type_inference : 0.019997s : 80.26% event_method : 0.000019s : 0.08% auto_monad : 0.000066s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000094s : 0.38% rewriter_before_opt_a : 0.000079s : 0.32% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000624s : 2.50% jit_opt_a.with_stream_mark : 0.000030s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000910s : 3.65% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000036s : 0.14% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000949s : 3.81% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000029s : 0.12% loop_unroll : 0.000483s : 1.94% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000052s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000004s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000536s : 2.15% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.16% Time group info: ------[substitution.] 0.000214 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000005s : 3: substitution.graph_param_transform 84.09% : 0.000180s : 4: substitution.inline 2.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.91% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019931 2 93.17% : 0.018570s : 1: type_inference.infer 6.83% : 0.001361s : 1: type_inference.specialize ------[replace.] 0.000070 6 69.29% : 0.000049s : 4: replace.inline 30.71% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.90% : 0.000177s : 4: match.inline 6.10% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.50% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.65% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.53% : 0.000001s : 3: predicate.graph_param_transform 6.17% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.69% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 2.02% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000835 13 48.40% : 0.000404s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.91% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.69% : 0.000390s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030745 72 0.18% : 0.000055s : 1: add_recomputation 0.23% : 0.000070s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.14% : 0.000351s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000022s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000006s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.33% : 0.005637s : 1: jit_opt_a 0.53% : 0.000163s : 1: jit_opt_after_cconv 0.17% : 0.000053s : 1: jit_opt_b 1.60% : 0.000491s : 1: loop_unroll 3.13% : 0.000962s : 1: mutable_eliminate 2.74% : 0.000843s : 26: opt.transform.jit_opt_a 0.17% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.78% : 0.000546s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000098s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.64% : 0.000504s : 1: renormalize.infer 1.29% : 0.000397s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.27% : 0.000083s : 1: rewriter_before_opt_a 0.25% : 0.000076s : 1: symbol_engine_optimizer 65.08% : 0.020009s : 1: type_inference TotalTime = 0.103112, [30] [bootstrap]: 0.00037308 [type_inference]: 0.0731386 [event_method]: 0.00031724 [auto_monad]: 0.00011364 [graph_reusing]: 7.49002e-06 [pre_auto_parallel]: 3.3e-06 [py_interpret_to_execute]: 3.854e-05 [rewriter_before_opt_a]: 0.00012885 [expand_dump_flag]: 4.20999e-06 [jit_opt_a]: 0.0267364, [3] [Cycle 1]: 0.0191238, [27] [switch_simplify]: 8.185e-05 [loop_unroll]: 4.917e-05 [a_1]: 0.00106147 [with_stream_mark]: 3.526e-05 [recompute_prepare]: 2.256e-05 [updatestate_depend_eliminate]: 9.81e-06 [updatestate_assign_eliminate]: 7.18e-06 [updatestate_loads_eliminate]: 6.53e-06 [parameter_eliminate]: 3.05998e-06 [specialize_transform]: 1.565e-05 [updatestate_useless_node_eliminater]: 1.416e-05 [accelerated_algorithm]: 1.503e-05 [meta_shard_fg_expand]: 3.7e-06 [get_grad_eliminate_]: 1.382e-05 [merge_forward]: 8.98002e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.949e-05 [j_node_and_user_rematch]: 2.618e-05 [meta_fg_expand]: 0.00199078 [replace_old_param]: 7.291e-05 [inline_without_move]: 6.416e-05 [renormalize]: 0.0148627 [add_forward_monad_depend]: 1.706e-05 [auto_monad_grad]: 6.53e-06 [auto_monad_eliminator]: 6.647e-05 [cse]: 0.00027456 [replace_applicator]: 9.314e-05 [Cycle 2]: 0.0036717, [27] [switch_simplify]: 4.427e-05 [loop_unroll]: 4.257e-05 [a_1]: 0.00115675 [with_stream_mark]: 1.652e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 4.72998e-06 [updatestate_assign_eliminate]: 4.50001e-06 [updatestate_loads_eliminate]: 4.11001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 7.49002e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 7.36999e-06 [merge_forward]: 4.44998e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 1.081e-05 [meta_fg_expand]: 0.00010731 [replace_old_param]: 8.43001e-06 [inline_without_move]: 6.34999e-06 [renormalize]: 0.00197502 [add_forward_monad_depend]: 5.81998e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.236e-05 [cse]: 2.119e-05 [replace_applicator]: 1.354e-05 [Cycle 3]: 0.00025264, [27] [switch_simplify]: 4.4e-06 [loop_unroll]: 3.81999e-06 [a_1]: 4.119e-05 [with_stream_mark]: 1.012e-05 [recompute_prepare]: 3.55e-06 [updatestate_depend_eliminate]: 2.26e-06 [updatestate_assign_eliminate]: 1.62999e-06 [updatestate_loads_eliminate]: 1.57001e-06 [parameter_eliminate]: 9.69972e-07 [specialize_transform]: 3.43e-06 [updatestate_useless_node_eliminater]: 3.27997e-06 [accelerated_algorithm]: 3.64002e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 3.05998e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.061e-05 [j_node_and_user_rematch]: 6.17999e-06 [meta_fg_expand]: 1.39e-06 [replace_old_param]: 3.09001e-06 [inline_without_move]: 2.97002e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.41998e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 3.93999e-06 [cse]: 9.22999e-06 [replace_applicator]: 3.68999e-06 [py_interpret_to_execute_after_opt_a]: 1.255e-05 [rewriter_after_opt_a]: 3.576e-05 [convert_after_rewriter]: 6.44999e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00073089 [jit_opt_b]: 4.094e-05, [1] [Cycle 1]: 3.364e-05, [2] [frontend_op_eliminate]: 1.063e-05 [inline_after_opt_a]: 1.141e-05 [cconv]: 2.638e-05 [loop_unroll]: 0.00041984 [jit_opt_after_cconv]: 0.00012621, [1] [Cycle 1]: 0.00011868, [11] [c_1]: 1.312e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 4.89003e-06 [updatestate_assign_eliminate]: 1.79998e-06 [updatestate_loads_eliminate]: 1.55999e-06 [cse]: 1.777e-05 [call_graph_tuple_transform]: 1.376e-05 [tuple_list_get_item_eliminator]: 3.9e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 3.43e-06 [remove_dup_value]: 1.493e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 5.47001e-06 [add_recomputation]: 3.686e-05 [cse_after_recomputation]: 2.001e-05, [1] [Cycle 1]: 1.457e-05, [1] [cse]: 8.59e-06 [auto_monad_reorder]: 1.315e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 5.47001e-06 [opt_after_jit_grad]: 0.00043888 [symbol_engine_optimizer]: 6.506e-05, [1] [Cycle 1]: 5.916e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 6.01998e-06 [elim_not_effective]: 9.77999e-06 [opt_reshape]: 3.95998e-06 [fold_const_symbol]: 6.31e-06 [renormalize]: 4.10015e-07 [validate]: 3.317e-05 Sums bootstrap : 0.000373s : 0.38% type_inference : 0.073139s : 74.23% event_method : 0.000317s : 0.32% auto_monad : 0.000114s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.04% rewriter_before_opt_a : 0.000129s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000131s : 0.13% jit_opt_a.loop_unroll : 0.000096s : 0.10% jit_opt_a.a_1 : 0.002259s : 2.29% jit_opt_a.with_stream_mark : 0.000062s : 0.06% jit_opt_a.recompute_prepare : 0.000035s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.04% jit_opt_a.meta_fg_expand : 0.002099s : 2.13% jit_opt_a.replace_old_param : 0.000084s : 0.09% jit_opt_a.inline_without_move : 0.000073s : 0.07% jit_opt_a.renormalize : 0.016838s : 17.09% jit_opt_a.add_forward_monad_depend : 0.000024s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.08% jit_opt_a.cse : 0.000305s : 0.31% jit_opt_a.replace_applicator : 0.000110s : 0.11% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000731s : 0.74% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000026s : 0.03% loop_unroll : 0.000420s : 0.43% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.04% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000439s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000586 104 0.25% : 0.000001s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.79% : 0.000005s : 1: substitution.graph_param_transform 66.10% : 0.000388s : 13: substitution.inline 3.25% : 0.000019s : 2: substitution.inline_without_move 1.77% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.93% : 0.000011s : 7: substitution.minmaximum_grad 1.29% : 0.000008s : 5: substitution.partial_eliminate 1.74% : 0.000010s : 12: substitution.remove_not_recompute_node 5.57% : 0.000033s : 10: substitution.replace_applicator 1.10% : 0.000006s : 10: substitution.replace_old_param 0.53% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.08% : 0.000006s : 1: substitution.tile_eliminate 4.21% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.69% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.50% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.073014 2 96.62% : 0.070548s : 1: type_inference.infer 3.38% : 0.002466s : 1: type_inference.specialize ------[replace.] 0.000179 20 65.91% : 0.000118s : 13: replace.inline 34.09% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000401 20 94.64% : 0.000380s : 13: match.inline 5.36% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000379 2656 1.75% : 0.000007s : 46: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000005s : 46: predicate.addn_check_dump 1.81% : 0.000007s : 46: predicate.addn_zero_filter 2.07% : 0.000008s : 46: predicate.arithmetic_simplify 1.62% : 0.000006s : 46: predicate.cast_eliminate 0.14% : 0.000001s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 46: predicate.compare_switch_simplify 1.54% : 0.000006s : 46: predicate.depend_value_elim 1.45% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.54% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.50% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.15% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.46% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.45% : 0.000005s : 46: predicate.environ_get_depend_swap 1.51% : 0.000006s : 46: predicate.environ_get_eliminate 1.45% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.83% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.31% : 0.000016s : 68: predicate.inline 1.97% : 0.000007s : 46: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.08% : 0.000004s : 18: predicate.less_batch_normalization 1.81% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.93% : 0.000007s : 54: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.60% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.83% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.44% : 0.000005s : 46: predicate.merge_addn 1.55% : 0.000006s : 46: predicate.minmaximum_grad 0.42% : 0.000002s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.34% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 46: predicate.print_const_string_wrapper 2.06% : 0.000008s : 46: predicate.reduce_eliminate 1.85% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 18: predicate.remove_not_recompute_node 2.76% : 0.000010s : 99: predicate.replace_applicator 1.16% : 0.000004s : 46: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 46: predicate.reshape_eliminate 1.51% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.55% : 0.000006s : 46: predicate.same_eliminate 0.48% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 18: predicate.specialize_transform 1.71% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.59% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.71% : 0.000010s : 66: predicate.switch_defer_inline 2.60% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.62% : 0.000025s : 166: predicate.switch_simplify 1.54% : 0.000006s : 46: predicate.tile_eliminate 1.52% : 0.000006s : 46: predicate.transpose_eliminate 1.92% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000006s : 46: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.70% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.89% : 0.000007s : 46: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.09% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004713 52 78.42% : 0.003696s : 35: func_graph_cloner_run.FuncGraphClonerGraph 21.58% : 0.001017s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122879 87 0.03% : 0.000039s : 1: add_recomputation 0.10% : 0.000121s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.33% : 0.000404s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.27% : 0.000326s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 21.76% : 0.026740s : 1: jit_opt_a 0.10% : 0.000129s : 1: jit_opt_after_cconv 0.04% : 0.000043s : 1: jit_opt_b 0.35% : 0.000429s : 1: loop_unroll 0.60% : 0.000739s : 1: mutable_eliminate 2.39% : 0.002937s : 39: opt.transform.jit_opt_a 0.03% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 11.62% : 0.014279s : 2: renormalize.infer 2.06% : 0.002536s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000132s : 1: rewriter_before_opt_a 0.05% : 0.000067s : 1: symbol_engine_optimizer 59.54% : 0.073167s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.248.5 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065b80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.305.7 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0334454, [30] [bootstrap]: 0.00024577 [type_inference]: 0.0161455 [event_method]: 6.32e-05 [auto_monad]: 0.00010456 [graph_reusing]: 7.23999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 2.905e-05 [rewriter_before_opt_a]: 0.00010454 [expand_dump_flag]: 4.13999e-06 [jit_opt_a]: 0.0144745, [3] [Cycle 1]: 0.00712946, [27] [switch_simplify]: 7.765e-05 [loop_unroll]: 4.227e-05 [a_1]: 0.00092946 [with_stream_mark]: 3.412e-05 [recompute_prepare]: 1.964e-05 [updatestate_depend_eliminate]: 9.46e-06 [updatestate_assign_eliminate]: 6.86001e-06 [updatestate_loads_eliminate]: 6.69999e-06 [parameter_eliminate]: 2.74001e-06 [specialize_transform]: 1.369e-05 [updatestate_useless_node_eliminater]: 1.243e-05 [accelerated_algorithm]: 1.241e-05 [meta_shard_fg_expand]: 3.75003e-06 [get_grad_eliminate_]: 1.217e-05 [merge_forward]: 8.87e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.745e-05 [j_node_and_user_rematch]: 2.334e-05 [meta_fg_expand]: 0.00182031 [replace_old_param]: 6.273e-05 [inline_without_move]: 5.528e-05 [renormalize]: 0.00331553 [add_forward_monad_depend]: 1.212e-05 [auto_monad_grad]: 6.35002e-06 [auto_monad_eliminator]: 5.647e-05 [cse]: 0.00023005 [replace_applicator]: 8.038e-05 [Cycle 2]: 0.0035832, [27] [switch_simplify]: 4.069e-05 [loop_unroll]: 3.862e-05 [a_1]: 0.00116841 [with_stream_mark]: 1.955e-05 [recompute_prepare]: 1.147e-05 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.89002e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 9.22999e-06 [updatestate_useless_node_eliminater]: 7.95e-06 [accelerated_algorithm]: 8.35999e-06 [meta_shard_fg_expand]: 3.03998e-06 [get_grad_eliminate_]: 8.60999e-06 [merge_forward]: 6.00002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.941e-05 [j_node_and_user_rematch]: 1.314e-05 [meta_fg_expand]: 0.0001002 [replace_old_param]: 9.27001e-06 [inline_without_move]: 7.82e-06 [renormalize]: 0.00185402 [add_forward_monad_depend]: 7.37002e-06 [auto_monad_grad]: 1.84998e-06 [auto_monad_eliminator]: 1.395e-05 [cse]: 2.452e-05 [replace_applicator]: 1.665e-05 [Cycle 3]: 0.00025547, [27] [switch_simplify]: 4.54002e-06 [loop_unroll]: 3.66999e-06 [a_1]: 4.168e-05 [with_stream_mark]: 1.118e-05 [recompute_prepare]: 3.55e-06 [updatestate_depend_eliminate]: 2.41e-06 [updatestate_assign_eliminate]: 1.58002e-06 [updatestate_loads_eliminate]: 1.74e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 3.71001e-06 [updatestate_useless_node_eliminater]: 3.21001e-06 [accelerated_algorithm]: 3.38999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 3.02002e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.126e-05 [j_node_and_user_rematch]: 5.50001e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 3.01001e-06 [inline_without_move]: 2.99999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 4.12998e-06 [cse]: 9.21998e-06 [replace_applicator]: 3.64002e-06 [py_interpret_to_execute_after_opt_a]: 1.234e-05 [rewriter_after_opt_a]: 3.457e-05 [convert_after_rewriter]: 5.89999e-06 [order_py_execute_after_rewriter]: 4.23999e-06 [mutable_eliminate]: 0.00070827 [jit_opt_b]: 4.129e-05, [1] [Cycle 1]: 3.369e-05, [2] [frontend_op_eliminate]: 1.121e-05 [inline_after_opt_a]: 1.094e-05 [cconv]: 2.594e-05 [loop_unroll]: 0.00044382 [jit_opt_after_cconv]: 0.00013287, [1] [Cycle 1]: 0.00012625, [11] [c_1]: 1.236e-05 [parameter_eliminate]: 3.34001e-06 [updatestate_depend_eliminate]: 4.99998e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 1.70001e-06 [cse]: 2.097e-05 [call_graph_tuple_transform]: 1.602e-05 [tuple_list_get_item_eliminator]: 4.12e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 4.52998e-06 [remove_dup_value]: 1.436e-05 [partial_unused_args_eliminate]: 2.60002e-06 [environ_conv]: 6.24001e-06 [add_recomputation]: 3.733e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.739e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.309e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 5.82999e-06 [opt_after_jit_grad]: 0.00045238 [symbol_engine_optimizer]: 6.657e-05, [1] [Cycle 1]: 6.028e-05, [6] [build]: 3.71001e-06 [elim_shapecalc]: 6.02001e-06 [elim_not_effective]: 1.016e-05 [opt_reshape]: 4.35e-06 [fold_const_symbol]: 5.77001e-06 [renormalize]: 6.30011e-07 [validate]: 3.081e-05 Sums bootstrap : 0.000246s : 0.85% type_inference : 0.016145s : 55.55% event_method : 0.000063s : 0.22% auto_monad : 0.000105s : 0.36% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000029s : 0.10% rewriter_before_opt_a : 0.000105s : 0.36% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000123s : 0.42% jit_opt_a.loop_unroll : 0.000085s : 0.29% jit_opt_a.a_1 : 0.002140s : 7.36% jit_opt_a.with_stream_mark : 0.000065s : 0.22% jit_opt_a.recompute_prepare : 0.000035s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000027s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.08% jit_opt_a.accelerated_algorithm : 0.000024s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.08% jit_opt_a.merge_forward : 0.000017s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.14% jit_opt_a.meta_fg_expand : 0.001923s : 6.61% jit_opt_a.replace_old_param : 0.000075s : 0.26% jit_opt_a.inline_without_move : 0.000066s : 0.23% jit_opt_a.renormalize : 0.005170s : 17.79% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.07% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000075s : 0.26% jit_opt_a.cse : 0.000264s : 0.91% jit_opt_a.replace_applicator : 0.000101s : 0.35% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000035s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000708s : 2.44% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.04% jit_opt_b.inline_after_opt_a : 0.000011s : 0.04% cconv : 0.000026s : 0.09% loop_unroll : 0.000444s : 1.53% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000014s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000037s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000013s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000452s : 1.56% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000031s : 0.11% Time group info: ------[substitution.] 0.000563 105 0.31% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.99% : 0.000006s : 1: substitution.graph_param_transform 65.15% : 0.000367s : 13: substitution.inline 3.14% : 0.000018s : 2: substitution.inline_without_move 1.59% : 0.000009s : 13: substitution.j_node_and_user_rematch 1.98% : 0.000011s : 7: substitution.minmaximum_grad 1.30% : 0.000007s : 5: substitution.partial_eliminate 2.07% : 0.000012s : 13: substitution.remove_not_recompute_node 5.09% : 0.000029s : 10: substitution.replace_applicator 1.00% : 0.000006s : 8: substitution.replace_old_param 1.52% : 0.000009s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.04% : 0.000006s : 1: substitution.tile_eliminate 3.97% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.79% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.45% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016059 2 92.01% : 0.014775s : 1: type_inference.infer 7.99% : 0.001283s : 1: type_inference.specialize ------[replace.] 0.000168 20 65.42% : 0.000110s : 13: replace.inline 34.58% : 0.000058s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000381 20 94.40% : 0.000360s : 13: match.inline 5.60% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000364 2537 1.50% : 0.000005s : 44: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.57% : 0.000006s : 44: predicate.addn_check_dump 1.51% : 0.000006s : 44: predicate.addn_zero_filter 2.04% : 0.000007s : 44: predicate.arithmetic_simplify 1.60% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 44: predicate.compare_switch_simplify 1.49% : 0.000005s : 44: predicate.depend_value_elim 1.45% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.51% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.61% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.45% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.43% : 0.000005s : 44: predicate.environ_get_depend_swap 1.56% : 0.000006s : 44: predicate.environ_get_eliminate 1.46% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.75% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.54% : 0.000017s : 66: predicate.inline 1.88% : 0.000007s : 42: predicate.inline_without_move 0.36% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.04% : 0.000004s : 18: predicate.less_batch_normalization 1.90% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 52: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.45% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.86% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.71% : 0.000006s : 44: predicate.merge_addn 1.50% : 0.000005s : 44: predicate.minmaximum_grad 0.40% : 0.000001s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.38% : 0.000009s : 52: predicate.partial_eliminate 1.58% : 0.000006s : 44: predicate.print_const_string_wrapper 1.95% : 0.000007s : 44: predicate.reduce_eliminate 1.83% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000002s : 18: predicate.remove_not_recompute_node 2.60% : 0.000009s : 94: predicate.replace_applicator 1.09% : 0.000004s : 42: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000006s : 44: predicate.reshape_eliminate 1.52% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.68% : 0.000006s : 44: predicate.same_eliminate 0.47% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 18: predicate.specialize_transform 1.71% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.63% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.75% : 0.000010s : 64: predicate.switch_defer_inline 2.49% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.86% : 0.000025s : 154: predicate.switch_simplify 1.65% : 0.000006s : 44: predicate.tile_eliminate 1.53% : 0.000006s : 44: predicate.transpose_eliminate 1.93% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.88% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.86% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001961 32 60.39% : 0.001184s : 15: func_graph_cloner_run.FuncGraphClonerGraph 39.61% : 0.000777s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041383 87 0.10% : 0.000041s : 1: add_recomputation 0.26% : 0.000109s : 1: auto_monad 0.04% : 0.000016s : 1: auto_monad_reorder 0.65% : 0.000270s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.17% : 0.000069s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 34.99% : 0.014478s : 1: jit_opt_a 0.33% : 0.000136s : 1: jit_opt_after_cconv 0.11% : 0.000044s : 1: jit_opt_b 1.09% : 0.000453s : 1: loop_unroll 1.73% : 0.000718s : 1: mutable_eliminate 6.70% : 0.002773s : 39: opt.transform.jit_opt_a 0.08% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000011s : 1: opt.transform.mutable_eliminate 0.04% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000023s : 4: opt.transform.symbol_engine_opt 1.11% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000032s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000016s : 1: remove_dup_value 8.10% : 0.003353s : 2: renormalize.infer 4.35% : 0.001798s : 2: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000038s : 1: rewriter_after_opt_a 0.26% : 0.000108s : 1: rewriter_before_opt_a 0.17% : 0.000069s : 1: symbol_engine_optimizer 39.06% : 0.016165s : 1: type_inference TotalTime = 0.0669926, [30] [bootstrap]: 0.00030202 [type_inference]: 0.0573204 [event_method]: 2.3e-05 [auto_monad]: 7.391e-05 [graph_reusing]: 6.08998e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00010652 [rewriter_before_opt_a]: 8.373e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.0067787, [2] [Cycle 1]: 0.00194547, [27] [switch_simplify]: 5.624e-05 [loop_unroll]: 2.962e-05 [a_1]: 0.00051671 [with_stream_mark]: 1.729e-05 [recompute_prepare]: 7.43999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 5.93002e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.73001e-06 [inline_without_move]: 5.87999e-06 [renormalize]: 0.00091887 [add_forward_monad_depend]: 4.77e-06 [auto_monad_grad]: 1.85001e-06 [auto_monad_eliminator]: 1.569e-05 [cse]: 3.802e-05 [replace_applicator]: 1.402e-05 [Cycle 2]: 0.00032306, [27] [switch_simplify]: 5.76998e-06 [loop_unroll]: 5.39998e-06 [a_1]: 8.87e-05 [with_stream_mark]: 1.112e-05 [recompute_prepare]: 5.13002e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.29e-05 [j_node_and_user_rematch]: 8.23999e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.48998e-06 [cse]: 1.281e-05 [replace_applicator]: 5.75001e-06 [py_interpret_to_execute_after_opt_a]: 9.10999e-06 [rewriter_after_opt_a]: 3.844e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00058896 [jit_opt_b]: 4.812e-05, [1] [Cycle 1]: 4.125e-05, [2] [frontend_op_eliminate]: 1.487e-05 [inline_after_opt_a]: 1.57e-05 [cconv]: 3.01e-05 [loop_unroll]: 0.0004414 [jit_opt_after_cconv]: 0.00015091, [1] [Cycle 1]: 0.00014378, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 6.89999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.615e-05 [call_graph_tuple_transform]: 1.933e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.738e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 6.83e-06 [add_recomputation]: 5.03e-05 [cse_after_recomputation]: 2.216e-05, [1] [Cycle 1]: 1.684e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.836e-05 [get_jit_bprop_graph]: 1.46002e-06 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.00052355 [symbol_engine_optimizer]: 7.4e-05, [1] [Cycle 1]: 6.72e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 8.03999e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 5.59e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 8.40024e-07 [validate]: 4.112e-05 Sums bootstrap : 0.000302s : 0.49% type_inference : 0.057320s : 92.75% event_method : 0.000023s : 0.04% auto_monad : 0.000074s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000107s : 0.17% rewriter_before_opt_a : 0.000084s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000605s : 0.98% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000919s : 1.49% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000051s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000589s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000030s : 0.05% loop_unroll : 0.000441s : 0.71% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000524s : 0.85% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000184 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.10% : 0.000006s : 3: substitution.graph_param_transform 81.00% : 0.000149s : 4: substitution.inline 1.93% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000004s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 7.53% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057238 2 96.92% : 0.055472s : 1: type_inference.infer 3.08% : 0.001765s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.89% : 0.000046s : 4: replace.inline 32.11% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 92.02% : 0.000146s : 4: match.inline 7.98% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.22% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.81% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 2.02% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.67% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000009s : 53: predicate.switch_simplify 1.55% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000874 13 44.56% : 0.000389s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.06% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.38% : 0.000458s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068763 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000078s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.47% : 0.000321s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.86% : 0.006782s : 1: jit_opt_a 0.22% : 0.000154s : 1: jit_opt_after_cconv 0.07% : 0.000051s : 1: jit_opt_b 0.65% : 0.000450s : 1: loop_unroll 0.87% : 0.000600s : 1: mutable_eliminate 1.19% : 0.000820s : 26: opt.transform.jit_opt_a 0.07% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000534s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000110s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.78% : 0.000539s : 1: renormalize.infer 0.54% : 0.000371s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000077s : 1: symbol_engine_optimizer 83.39% : 0.057343s : 1: type_inference TotalTime = 0.0290821, [30] [bootstrap]: 0.00032337 [type_inference]: 0.0211238 [event_method]: 1.898e-05 [auto_monad]: 5.162e-05 [graph_reusing]: 3.68e-06 [pre_auto_parallel]: 1.60001e-06 [py_interpret_to_execute]: 9.649e-05 [rewriter_before_opt_a]: 6.983e-05 [expand_dump_flag]: 2.31998e-06 [jit_opt_a]: 0.00507443, [2] [Cycle 1]: 0.00172494, [27] [switch_simplify]: 4.259e-05 [loop_unroll]: 2.883e-05 [a_1]: 0.00047249 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.11998e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.96998e-06 [renormalize]: 0.00085875 [add_forward_monad_depend]: 6.44999e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.404e-05 [cse]: 2.695e-05 [replace_applicator]: 1.488e-05 [Cycle 2]: 0.00032167, [27] [switch_simplify]: 5.81e-06 [loop_unroll]: 4.90999e-06 [a_1]: 8.852e-05 [with_stream_mark]: 1.115e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.09e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.76998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 1.30007e-07 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.81001e-06 [cse]: 1.425e-05 [replace_applicator]: 5.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.292e-05 [rewriter_after_opt_a]: 3.509e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00063129 [jit_opt_b]: 4.751e-05, [1] [Cycle 1]: 4.067e-05, [2] [frontend_op_eliminate]: 1.491e-05 [inline_after_opt_a]: 1.579e-05 [cconv]: 2.611e-05 [loop_unroll]: 0.00048866 [jit_opt_after_cconv]: 0.00014198, [1] [Cycle 1]: 0.0001356, [11] [c_1]: 2.058e-05 [parameter_eliminate]: 3.19001e-06 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.246e-05 [call_graph_tuple_transform]: 1.85e-05 [tuple_list_get_item_eliminator]: 5.20001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 6.52001e-06 [add_recomputation]: 4.534e-05 [cse_after_recomputation]: 2.584e-05, [1] [Cycle 1]: 2.004e-05, [1] [cse]: 1.352e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.93001e-06 [opt_after_jit_grad]: 0.00050042 [symbol_engine_optimizer]: 7.522e-05, [1] [Cycle 1]: 6.84e-05, [6] [build]: 3.35998e-06 [elim_shapecalc]: 8.40001e-06 [elim_not_effective]: 1.367e-05 [opt_reshape]: 5.73997e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 4.30009e-07 [validate]: 3.713e-05 Sums bootstrap : 0.000323s : 1.27% type_inference : 0.021124s : 82.91% event_method : 0.000019s : 0.07% auto_monad : 0.000052s : 0.20% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000096s : 0.38% rewriter_before_opt_a : 0.000070s : 0.27% expand_dump_flag : 0.000002s : 0.01% jit_opt_a.switch_simplify : 0.000048s : 0.19% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000561s : 2.20% jit_opt_a.with_stream_mark : 0.000023s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000005s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000859s : 3.37% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000041s : 0.16% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000035s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000631s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000489s : 1.92% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000045s : 0.18% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000500s : 1.96% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000159 23 1.17% : 0.000002s : 2: substitution.elim_not_effective 0.87% : 0.000001s : 2: substitution.fold_const_symbol 3.23% : 0.000005s : 3: substitution.graph_param_transform 82.56% : 0.000131s : 4: substitution.inline 1.94% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000004s : 4: substitution.remove_not_recompute_node 2.21% : 0.000004s : 2: substitution.replace_old_param 5.40% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021062 2 93.59% : 0.019712s : 1: type_inference.infer 6.41% : 0.001351s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.90% : 0.000042s : 4: replace.inline 33.10% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000136 6 94.70% : 0.000129s : 4: match.inline 5.30% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.33% : 0.000001s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000008s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.07% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000812 13 50.62% : 0.000411s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.84% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.54% : 0.000370s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030769 72 0.20% : 0.000063s : 1: add_recomputation 0.18% : 0.000055s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.12% : 0.000343s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000023s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000006s : 1: graph_reusing 16.50% : 0.005078s : 1: jit_opt_a 0.47% : 0.000145s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.61% : 0.000497s : 1: loop_unroll 2.08% : 0.000640s : 1: mutable_eliminate 2.48% : 0.000764s : 26: opt.transform.jit_opt_a 0.15% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000508s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.05% : 0.000015s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.32% : 0.000099s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000017s : 1: remove_dup_value 1.57% : 0.000483s : 1: renormalize.infer 1.20% : 0.000370s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000038s : 1: rewriter_after_opt_a 0.24% : 0.000073s : 1: rewriter_before_opt_a 0.25% : 0.000078s : 1: symbol_engine_optimizer 68.68% : 0.021133s : 1: type_inference TotalTime = 0.381068, [30] [bootstrap]: 0.00031795 [type_inference]: 0.36983 [event_method]: 1.961e-05 [auto_monad]: 6.437e-05 [graph_reusing]: 5.61e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00039523 [rewriter_before_opt_a]: 8.418e-05 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.00793277, [2] [Cycle 1]: 0.0038508, [27] [switch_simplify]: 6.572e-05 [loop_unroll]: 3.114e-05 [a_1]: 0.00055144 [with_stream_mark]: 1.573e-05 [recompute_prepare]: 8.17998e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 2.58998e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.256e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 0.00282269 [add_forward_monad_depend]: 6.79999e-06 [auto_monad_grad]: 1.80001e-06 [auto_monad_eliminator]: 1.452e-05 [cse]: 2.21e-05 [replace_applicator]: 5.782e-05 [Cycle 2]: 0.00052559, [27] [switch_simplify]: 9.68e-05 [loop_unroll]: 7.48999e-06 [a_1]: 0.00014048 [with_stream_mark]: 1.317e-05 [recompute_prepare]: 6.64999e-06 [updatestate_depend_eliminate]: 3.08998e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 8.82e-06 [inline_without_move]: 5.36002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 9.05999e-06 [cse]: 1.553e-05 [replace_applicator]: 6.44999e-06 [py_interpret_to_execute_after_opt_a]: 1.104e-05 [rewriter_after_opt_a]: 3.342e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 4.51002e-06 [mutable_eliminate]: 0.00057169 [jit_opt_b]: 0.00012232, [1] [Cycle 1]: 0.00011551, [2] [frontend_op_eliminate]: 8.362e-05 [inline_after_opt_a]: 1.743e-05 [cconv]: 2.654e-05 [loop_unroll]: 0.00046632 [jit_opt_after_cconv]: 0.00015076, [1] [Cycle 1]: 0.00014408, [11] [c_1]: 2.553e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.084e-05 [call_graph_tuple_transform]: 2.135e-05 [tuple_list_get_item_eliminator]: 6.69999e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.075e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 8.67e-06 [add_recomputation]: 3.794e-05 [cse_after_recomputation]: 2.247e-05, [1] [Cycle 1]: 1.708e-05, [1] [cse]: 1.102e-05 [auto_monad_reorder]: 1.233e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00051855 [symbol_engine_optimizer]: 0.00017869, [1] [Cycle 1]: 0.00017158, [6] [build]: 2.86999e-06 [elim_shapecalc]: 9.32999e-06 [elim_not_effective]: 0.00011085 [opt_reshape]: 7.58999e-06 [fold_const_symbol]: 1.042e-05 [renormalize]: 5.89993e-07 [validate]: 4.029e-05 Sums bootstrap : 0.000318s : 0.08% type_inference : 0.369830s : 98.13% event_method : 0.000020s : 0.01% auto_monad : 0.000064s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000395s : 0.10% rewriter_before_opt_a : 0.000084s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000163s : 0.04% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000692s : 0.18% jit_opt_a.with_stream_mark : 0.000029s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.00% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002823s : 0.75% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000038s : 0.01% jit_opt_a.replace_applicator : 0.000064s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000033s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000572s : 0.15% jit_opt_b.frontend_op_eliminate : 0.000084s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.00% cconv : 0.000027s : 0.01% loop_unroll : 0.000466s : 0.12% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000011s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000038s : 0.01% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000012s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000519s : 0.14% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000111s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.01% Time group info: ------[substitution.] 0.000200 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000005s : 4: substitution.graph_param_transform 83.64% : 0.000167s : 4: substitution.inline 2.02% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000005s : 2: substitution.replace_old_param 5.58% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.369749 2 99.29% : 0.367107s : 1: type_inference.infer 0.71% : 0.002642s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.66% : 0.000047s : 4: replace.inline 31.34% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 94.35% : 0.000165s : 4: match.inline 5.65% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000281 830 0.71% : 0.000002s : 12: predicate.accumulaten_eliminater 0.52% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.50% : 0.000001s : 12: predicate.addn_check_dump 0.67% : 0.000002s : 12: predicate.addn_zero_filter 0.90% : 0.000003s : 12: predicate.arithmetic_simplify 0.64% : 0.000002s : 12: predicate.cast_eliminate 0.34% : 0.000001s : 4: predicate.check_bprop_eliminate 0.50% : 0.000001s : 12: predicate.compare_switch_simplify 0.59% : 0.000002s : 12: predicate.depend_value_elim 0.53% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.52% : 0.000001s : 12: predicate.dict_get_item_eliminator 0.55% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.42% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.24% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.57% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.53% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.52% : 0.000001s : 12: predicate.environ_get_depend_swap 0.53% : 0.000001s : 12: predicate.environ_get_eliminate 0.63% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 4: predicate.fold_const_symbol 0.47% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000001s : 4: predicate.graph_param_transform 2.61% : 0.000007s : 26: predicate.inline 0.45% : 0.000001s : 8: predicate.inline_without_move 0.23% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.58% : 0.000002s : 8: predicate.less_batch_normalization 0.72% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 0.91% : 0.000003s : 18: predicate.load_eliminater 0.60% : 0.000002s : 4: predicate.loop_unroll_after_grad 1.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 0.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.50% : 0.000001s : 12: predicate.merge_addn 0.52% : 0.000001s : 12: predicate.minmaximum_grad 0.72% : 0.000002s : 4: predicate.mutable_eliminate 0.26% : 0.000001s : 4: predicate.opt_reshape 1.05% : 0.000003s : 18: predicate.partial_eliminate 0.71% : 0.000002s : 12: predicate.print_const_string_wrapper 0.76% : 0.000002s : 12: predicate.reduce_eliminate 0.66% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.31% : 0.000001s : 8: predicate.remove_not_recompute_node 1.08% : 0.000003s : 22: predicate.replace_applicator 0.29% : 0.000001s : 8: predicate.replace_old_param 0.19% : 0.000001s : 4: predicate.reset_defer_inline 0.72% : 0.000002s : 12: predicate.reshape_eliminate 0.58% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.32% : 0.000001s : 4: predicate.row_tensor_eliminate 0.55% : 0.000002s : 12: predicate.same_eliminate 0.32% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.53% : 0.000001s : 8: predicate.special_op_eliminate 0.55% : 0.000002s : 8: predicate.specialize_transform 0.67% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.54% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.22% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.18% : 0.000003s : 18: predicate.switch_defer_inline 0.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 33.90% : 0.000095s : 58: predicate.switch_simplify 0.59% : 0.000002s : 12: predicate.tile_eliminate 0.55% : 0.000002s : 12: predicate.transpose_eliminate 0.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.60% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 1.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 0.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 0.73% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 0.83% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 1.41% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 0.77% : 0.000002s : 12: predicate.value_based_eliminate 0.16% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 22.45% : 0.000063s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002213 22 68.70% : 0.001520s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.46% : 0.000652s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.385098 72 0.01% : 0.000041s : 1: add_recomputation 0.02% : 0.000068s : 1: auto_monad 0.00% : 0.000015s : 1: auto_monad_reorder 0.09% : 0.000336s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 2.06% : 0.007936s : 1: jit_opt_a 0.04% : 0.000153s : 1: jit_opt_after_cconv 0.03% : 0.000125s : 1: jit_opt_b 0.12% : 0.000475s : 1: loop_unroll 0.15% : 0.000579s : 1: mutable_eliminate 0.28% : 0.001067s : 26: opt.transform.jit_opt_a 0.01% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000094s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000528s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000401s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000013s : 1: remove_dup_value 0.56% : 0.002158s : 1: renormalize.infer 0.17% : 0.000655s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000036s : 1: rewriter_after_opt_a 0.02% : 0.000089s : 1: rewriter_before_opt_a 0.05% : 0.000182s : 1: symbol_engine_optimizer 96.04% : 0.369845s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.532.73 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.540.63 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0453916, [30] [bootstrap]: 0.00025771 [type_inference]: 0.0219742 [event_method]: 6.05e-05 [auto_monad]: 9.901e-05 [graph_reusing]: 7.53e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 3.416e-05 [rewriter_before_opt_a]: 0.00012632 [expand_dump_flag]: 3.47997e-06 [jit_opt_a]: 0.0206635, [3] [Cycle 1]: 0.0129697, [27] [switch_simplify]: 6.923e-05 [loop_unroll]: 4.373e-05 [a_1]: 0.00095245 [with_stream_mark]: 3.111e-05 [recompute_prepare]: 1.915e-05 [updatestate_depend_eliminate]: 8.57998e-06 [updatestate_assign_eliminate]: 7.34002e-06 [updatestate_loads_eliminate]: 7.53e-06 [parameter_eliminate]: 2.90002e-06 [specialize_transform]: 1.489e-05 [updatestate_useless_node_eliminater]: 1.371e-05 [accelerated_algorithm]: 1.364e-05 [meta_shard_fg_expand]: 3.65e-06 [get_grad_eliminate_]: 1.279e-05 [merge_forward]: 9.34998e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.624e-05 [j_node_and_user_rematch]: 2.305e-05 [meta_fg_expand]: 0.0016891 [replace_old_param]: 6.948e-05 [inline_without_move]: 6.218e-05 [renormalize]: 0.00925763 [add_forward_monad_depend]: 1.186e-05 [auto_monad_grad]: 6.66999e-06 [auto_monad_eliminator]: 5.93e-05 [cse]: 0.00023876 [replace_applicator]: 8.182e-05 [Cycle 2]: 0.00398549, [27] [switch_simplify]: 4.205e-05 [loop_unroll]: 3.966e-05 [a_1]: 0.00113674 [with_stream_mark]: 1.99e-05 [recompute_prepare]: 1.015e-05 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.98999e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.665e-05 [j_node_and_user_rematch]: 1.114e-05 [meta_fg_expand]: 9.468e-05 [replace_old_param]: 7.71999e-06 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00231202 [add_forward_monad_depend]: 6.34001e-06 [auto_monad_grad]: 2.16e-06 [auto_monad_eliminator]: 1.126e-05 [cse]: 2.868e-05 [replace_applicator]: 1.437e-05 [Cycle 3]: 0.00025, [27] [switch_simplify]: 4.66002e-06 [loop_unroll]: 3.41999e-06 [a_1]: 4.066e-05 [with_stream_mark]: 9.87001e-06 [recompute_prepare]: 3.40998e-06 [updatestate_depend_eliminate]: 2.64001e-06 [updatestate_assign_eliminate]: 1.73002e-06 [updatestate_loads_eliminate]: 1.54998e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 3.53999e-06 [updatestate_useless_node_eliminater]: 3.12002e-06 [accelerated_algorithm]: 3.30003e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 2.98e-06 [merge_forward]: 2.21e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1e-05 [j_node_and_user_rematch]: 6.01e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 3.17002e-06 [inline_without_move]: 3.08e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 3.73999e-06 [cse]: 9.46e-06 [replace_applicator]: 3.28e-06 [py_interpret_to_execute_after_opt_a]: 1.15e-05 [rewriter_after_opt_a]: 3.504e-05 [convert_after_rewriter]: 5.86e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00066711 [jit_opt_b]: 4.214e-05, [1] [Cycle 1]: 3.48e-05, [2] [frontend_op_eliminate]: 1.103e-05 [inline_after_opt_a]: 1.145e-05 [cconv]: 2.545e-05 [loop_unroll]: 0.00041509 [jit_opt_after_cconv]: 0.00012629, [1] [Cycle 1]: 0.00011983, [11] [c_1]: 1.206e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.76003e-06 [updatestate_assign_eliminate]: 1.66998e-06 [updatestate_loads_eliminate]: 1.74998e-06 [cse]: 1.892e-05 [call_graph_tuple_transform]: 1.386e-05 [tuple_list_get_item_eliminator]: 3.8e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 3.61001e-06 [remove_dup_value]: 1.499e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 4.85999e-06 [add_recomputation]: 3.447e-05 [cse_after_recomputation]: 1.883e-05, [1] [Cycle 1]: 1.38e-05, [1] [cse]: 7.73001e-06 [auto_monad_reorder]: 1.35e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.0004414 [symbol_engine_optimizer]: 6.525e-05, [1] [Cycle 1]: 5.952e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 5.52001e-06 [elim_not_effective]: 1.038e-05 [opt_reshape]: 4.21001e-06 [fold_const_symbol]: 5.79e-06 [renormalize]: 3.89991e-07 [validate]: 2.858e-05 Sums bootstrap : 0.000258s : 0.63% type_inference : 0.021974s : 53.49% event_method : 0.000060s : 0.15% auto_monad : 0.000099s : 0.24% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000034s : 0.08% rewriter_before_opt_a : 0.000126s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000116s : 0.28% jit_opt_a.loop_unroll : 0.000087s : 0.21% jit_opt_a.a_1 : 0.002130s : 5.18% jit_opt_a.with_stream_mark : 0.000061s : 0.15% jit_opt_a.recompute_prepare : 0.000033s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000025s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.06% jit_opt_a.accelerated_algorithm : 0.000023s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.05% jit_opt_a.merge_forward : 0.000016s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000053s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.10% jit_opt_a.meta_fg_expand : 0.001785s : 4.35% jit_opt_a.replace_old_param : 0.000080s : 0.20% jit_opt_a.inline_without_move : 0.000072s : 0.17% jit_opt_a.renormalize : 0.011570s : 28.16% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.05% jit_opt_a.auto_monad_grad : 0.000009s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000074s : 0.18% jit_opt_a.cse : 0.000277s : 0.67% jit_opt_a.replace_applicator : 0.000099s : 0.24% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000035s : 0.09% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000667s : 1.62% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.03% cconv : 0.000025s : 0.06% loop_unroll : 0.000415s : 1.01% jit_opt_after_cconv.c_1 : 0.000012s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000034s : 0.08% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000441s : 1.07% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.07% Time group info: ------[substitution.] 0.000543 104 0.32% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.76% : 0.000004s : 1: substitution.graph_param_transform 65.45% : 0.000355s : 13: substitution.inline 3.17% : 0.000017s : 2: substitution.inline_without_move 1.80% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.14% : 0.000012s : 7: substitution.minmaximum_grad 1.29% : 0.000007s : 5: substitution.partial_eliminate 1.72% : 0.000009s : 12: substitution.remove_not_recompute_node 5.14% : 0.000028s : 10: substitution.replace_applicator 1.30% : 0.000007s : 10: substitution.replace_old_param 0.46% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.15% : 0.000006s : 1: substitution.tile_eliminate 4.16% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.97% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.00% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021878 2 93.37% : 0.020428s : 1: type_inference.infer 6.63% : 0.001451s : 1: type_inference.specialize ------[replace.] 0.000206 20 70.13% : 0.000144s : 13: replace.inline 29.87% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000370 20 93.93% : 0.000348s : 13: match.inline 6.07% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000366 2433 1.46% : 0.000005s : 42: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.59% : 0.000006s : 42: predicate.addn_check_dump 1.84% : 0.000007s : 42: predicate.addn_zero_filter 2.07% : 0.000008s : 42: predicate.arithmetic_simplify 1.74% : 0.000006s : 42: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.40% : 0.000005s : 42: predicate.compare_switch_simplify 1.46% : 0.000005s : 42: predicate.depend_value_elim 1.43% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.76% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.77% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.66% : 0.000006s : 42: predicate.environ_get_add_eliminate 1.42% : 0.000005s : 42: predicate.environ_get_depend_swap 1.56% : 0.000006s : 42: predicate.environ_get_eliminate 1.44% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.79% : 0.000003s : 16: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.40% : 0.000016s : 64: predicate.inline 2.11% : 0.000008s : 44: predicate.inline_without_move 0.33% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.88% : 0.000003s : 16: predicate.less_batch_normalization 1.95% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.90% : 0.000007s : 50: predicate.load_eliminater 0.35% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.36% : 0.000012s : 87: predicate.loop_unroll_before_grad 1.73% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.44% : 0.000005s : 42: predicate.merge_addn 1.70% : 0.000006s : 42: predicate.minmaximum_grad 0.39% : 0.000001s : 1: predicate.mutable_eliminate 0.14% : 0.000001s : 1: predicate.opt_reshape 2.35% : 0.000009s : 50: predicate.partial_eliminate 1.43% : 0.000005s : 42: predicate.print_const_string_wrapper 1.98% : 0.000007s : 42: predicate.reduce_eliminate 1.82% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 16: predicate.remove_not_recompute_node 2.61% : 0.000010s : 90: predicate.replace_applicator 1.17% : 0.000004s : 44: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.52% : 0.000006s : 42: predicate.reshape_eliminate 1.46% : 0.000005s : 42: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.45% : 0.000005s : 42: predicate.same_eliminate 0.42% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 16: predicate.specialize_transform 1.74% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.78% : 0.000010s : 62: predicate.switch_defer_inline 2.49% : 0.000009s : 62: predicate.switch_layer_defer_inline 6.49% : 0.000024s : 150: predicate.switch_simplify 1.77% : 0.000006s : 42: predicate.tile_eliminate 1.61% : 0.000006s : 42: predicate.transpose_eliminate 1.82% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.78% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.28% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.80% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.75% : 0.000006s : 49: predicate.tuple_to_list_eliminator_ 1.90% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.89% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 1.97% : 0.000007s : 42: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005994 36 86.15% : 0.005164s : 19: func_graph_cloner_run.FuncGraphClonerGraph 13.85% : 0.000830s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059722 87 0.06% : 0.000037s : 1: add_recomputation 0.17% : 0.000104s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.48% : 0.000286s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.11% : 0.000066s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 34.61% : 0.020667s : 1: jit_opt_a 0.22% : 0.000129s : 1: jit_opt_after_cconv 0.07% : 0.000045s : 1: jit_opt_b 0.71% : 0.000423s : 1: loop_unroll 1.13% : 0.000676s : 1: mutable_eliminate 4.62% : 0.002756s : 39: opt.transform.jit_opt_a 0.05% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000010s : 1: opt.transform.mutable_eliminate 0.02% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.06% : 0.000037s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 16.21% : 0.009680s : 2: renormalize.infer 3.13% : 0.001870s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.22% : 0.000129s : 1: rewriter_before_opt_a 0.11% : 0.000068s : 1: symbol_engine_optimizer 36.83% : 0.021994s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.123.857 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.124.543 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.27484, [30] [bootstrap]: 0.00048871 [type_inference]: 0.255039 [event_method]: 2.856e-05 [auto_monad]: 8.566e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00055332 [rewriter_before_opt_a]: 0.00011598 [expand_dump_flag]: 4.67e-06 [jit_opt_a]: 0.0135369, [2] [Cycle 1]: 0.00844866, [27] [switch_simplify]: 8.034e-05 [loop_unroll]: 3.45e-05 [a_1]: 0.00191623 [with_stream_mark]: 3.182e-05 [recompute_prepare]: 1.083e-05 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 4.55999e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.855e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 3.57002e-06 [replace_old_param]: 1.23e-05 [inline_without_move]: 6.12001e-06 [renormalize]: 0.00588576 [add_forward_monad_depend]: 1.253e-05 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 4.512e-05 [cse]: 4.289e-05 [replace_applicator]: 2.725e-05 [Cycle 2]: 0.00044451, [27] [switch_simplify]: 7.23999e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00014619 [with_stream_mark]: 1.725e-05 [recompute_prepare]: 6.88998e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.90002e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 4.05998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 2.316e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 7.63001e-06 [cse]: 1.717e-05 [replace_applicator]: 7.77e-06 [py_interpret_to_execute_after_opt_a]: 2.02e-05 [rewriter_after_opt_a]: 4.388e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00089308 [jit_opt_b]: 6.823e-05, [1] [Cycle 1]: 5.745e-05, [2] [frontend_op_eliminate]: 2.303e-05 [inline_after_opt_a]: 2.083e-05 [cconv]: 3.458e-05 [loop_unroll]: 0.00050432 [jit_opt_after_cconv]: 0.00018093, [1] [Cycle 1]: 0.00017256, [11] [c_1]: 2.764e-05 [parameter_eliminate]: 4.38001e-06 [updatestate_depend_eliminate]: 8.48999e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.55e-05 [call_graph_tuple_transform]: 2.434e-05 [tuple_list_get_item_eliminator]: 6.93e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.61999e-06 [remove_dup_value]: 1.933e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 1.007e-05 [add_recomputation]: 5.875e-05 [cse_after_recomputation]: 2.989e-05, [1] [Cycle 1]: 2.249e-05, [1] [cse]: 1.385e-05 [auto_monad_reorder]: 2.038e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 8.39998e-06 [opt_after_jit_grad]: 0.00251795 [symbol_engine_optimizer]: 0.00023242, [1] [Cycle 1]: 0.00022369, [6] [build]: 7.70998e-06 [elim_shapecalc]: 1.04e-05 [elim_not_effective]: 2.025e-05 [opt_reshape]: 6.64001e-06 [fold_const_symbol]: 0.00014482 [renormalize]: 9.79984e-07 [validate]: 6.984e-05 Sums bootstrap : 0.000489s : 0.18% type_inference : 0.255039s : 94.66% event_method : 0.000029s : 0.01% auto_monad : 0.000086s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000553s : 0.21% rewriter_before_opt_a : 0.000116s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.002062s : 0.77% jit_opt_a.with_stream_mark : 0.000049s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000035s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.005886s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000053s : 0.02% jit_opt_a.cse : 0.000060s : 0.02% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000893s : 0.33% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000035s : 0.01% loop_unroll : 0.000504s : 0.19% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000059s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.002518s : 0.93% symbol_engine_optimizer.build : 0.000008s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000145s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000070s : 0.03% Time group info: ------[substitution.] 0.000421 28 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 1.57% : 0.000007s : 4: substitution.graph_param_transform 85.74% : 0.000361s : 5: substitution.inline 1.24% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.82% : 0.000016s : 3: substitution.reduce_eliminate 1.40% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000008s : 2: substitution.replace_old_param 3.37% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.254911 2 98.39% : 0.250816s : 1: type_inference.infer 1.61% : 0.004094s : 1: type_inference.specialize ------[replace.] 0.000154 7 68.27% : 0.000105s : 5: replace.inline 31.73% : 0.000049s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000370 7 96.64% : 0.000358s : 5: match.inline 3.36% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 1.73% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.90% : 0.000002s : 13: predicate.addn_check_dump 1.71% : 0.000003s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.85% : 0.000003s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 0.91% : 0.000002s : 13: predicate.compare_switch_simplify 1.66% : 0.000003s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 3.16% : 0.000005s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.90% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000010s : 28: predicate.inline 0.75% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.33% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.57% : 0.000003s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.14% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 2.22% : 0.000004s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.41% : 0.000004s : 13: predicate.reduce_eliminate 1.50% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.53% : 0.000003s : 13: predicate.reshape_eliminate 1.14% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.20% : 0.000002s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 13: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.75% : 0.000001s : 8: predicate.specialize_transform 1.20% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.02% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.53% : 0.000006s : 20: predicate.switch_defer_inline 2.35% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.72% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.22% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.38% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.50% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003555 25 60.92% : 0.002166s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.76% : 0.000134s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.32% : 0.001256s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.283282 72 0.02% : 0.000062s : 1: add_recomputation 0.03% : 0.000090s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.18% : 0.000515s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 4.78% : 0.013541s : 1: jit_opt_a 0.06% : 0.000184s : 1: jit_opt_after_cconv 0.03% : 0.000071s : 1: jit_opt_b 0.18% : 0.000515s : 1: loop_unroll 0.32% : 0.000905s : 1: mutable_eliminate 0.83% : 0.002361s : 26: opt.transform.jit_opt_a 0.02% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000040s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000179s : 4: opt.transform.symbol_engine_opt 0.90% : 0.002535s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000563s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.55% : 0.004391s : 1: renormalize.infer 0.52% : 0.001479s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.04% : 0.000122s : 1: rewriter_before_opt_a 0.08% : 0.000236s : 1: symbol_engine_optimizer 90.04% : 0.255066s : 1: type_inference TotalTime = 0.0454325, [30] [bootstrap]: 0.00038207 [type_inference]: 0.0226292 [event_method]: 2.251e-05 [auto_monad]: 7.197e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00010923 [rewriter_before_opt_a]: 8.249e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0197082, [2] [Cycle 1]: 0.0160288, [27] [switch_simplify]: 5.447e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.00052756 [with_stream_mark]: 1.808e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.52998e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.014995 [add_forward_monad_depend]: 1.153e-05 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 2.56e-05 [cse]: 4.015e-05 [replace_applicator]: 2.622e-05 [Cycle 2]: 0.00036109, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 5.58002e-06 [a_1]: 0.00010254 [with_stream_mark]: 1.7e-05 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.78997e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 3.46999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.66002e-06 [inline_without_move]: 4.89e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.49998e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.273e-05 [replace_applicator]: 5.64998e-06 [py_interpret_to_execute_after_opt_a]: 2.021e-05 [rewriter_after_opt_a]: 4.114e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00074974 [jit_opt_b]: 5.092e-05, [1] [Cycle 1]: 4.321e-05, [2] [frontend_op_eliminate]: 1.691e-05 [inline_after_opt_a]: 1.534e-05 [cconv]: 2.661e-05 [loop_unroll]: 0.00041325 [jit_opt_after_cconv]: 0.00018749, [1] [Cycle 1]: 0.00018091, [11] [c_1]: 2.103e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.36998e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.264e-05 [call_graph_tuple_transform]: 1.785e-05 [tuple_list_get_item_eliminator]: 5.66003e-06 [none_parameter_eliminate]: 4.381e-05 [renormalize]: 6.30011e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 1.824e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.30002e-06 [add_recomputation]: 5.392e-05 [cse_after_recomputation]: 2.487e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.325e-05 [auto_monad_reorder]: 1.817e-05 [get_jit_bprop_graph]: 2.58998e-06 [rewriter_after_jit_bprop_graph]: 4.96002e-06 [opt_after_jit_grad]: 0.00046501 [symbol_engine_optimizer]: 7.495e-05, [1] [Cycle 1]: 6.806e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 7.56001e-06 [elim_not_effective]: 1.335e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 3.60014e-07 [validate]: 4.508e-05 Sums bootstrap : 0.000382s : 0.92% type_inference : 0.022629s : 54.56% event_method : 0.000023s : 0.05% auto_monad : 0.000072s : 0.17% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000109s : 0.26% rewriter_before_opt_a : 0.000082s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.15% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000630s : 1.52% jit_opt_a.with_stream_mark : 0.000035s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.014995s : 36.15% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.08% jit_opt_a.cse : 0.000053s : 0.13% jit_opt_a.replace_applicator : 0.000032s : 0.08% py_interpret_to_execute_after_opt_a : 0.000020s : 0.05% rewriter_after_opt_a : 0.000041s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000750s : 1.81% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000027s : 0.06% loop_unroll : 0.000413s : 1.00% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000044s : 0.11% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000465s : 1.12% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.11% Time group info: ------[substitution.] 0.000200 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.68% : 0.000005s : 3: substitution.graph_param_transform 81.77% : 0.000164s : 4: substitution.inline 1.98% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.71% : 0.000005s : 4: substitution.remove_not_recompute_node 2.58% : 0.000005s : 2: substitution.replace_old_param 6.55% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022544 2 92.65% : 0.020888s : 1: type_inference.infer 7.35% : 0.001656s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.18% : 0.000052s : 4: replace.inline 30.82% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.10% : 0.000161s : 4: match.inline 6.90% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.75% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.80% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001058 13 44.96% : 0.000476s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.84% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.20% : 0.000552s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061325 72 0.09% : 0.000057s : 1: add_recomputation 0.12% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.66% : 0.000403s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 32.14% : 0.019712s : 1: jit_opt_a 0.31% : 0.000190s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 0.69% : 0.000422s : 1: loop_unroll 1.24% : 0.000760s : 1: mutable_eliminate 1.41% : 0.000862s : 26: opt.transform.jit_opt_a 0.08% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000114s : 1: py_interpret_to_execute 0.04% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 23.42% : 0.014362s : 1: renormalize.infer 1.00% : 0.000616s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000044s : 1: rewriter_after_opt_a 0.14% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000077s : 1: symbol_engine_optimizer 36.95% : 0.022657s : 1: type_inference TotalTime = 0.0264404, [30] [bootstrap]: 0.00028949 [type_inference]: 0.0113445 [event_method]: 2.168e-05 [auto_monad]: 6.677e-05 [graph_reusing]: 6.02001e-06 [pre_auto_parallel]: 0.00128263 [py_interpret_to_execute]: 4.83e-05 [rewriter_before_opt_a]: 7.82e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.0110568, [2] [Cycle 1]: 0.00635778, [27] [switch_simplify]: 5.68e-05 [loop_unroll]: 2.875e-05 [a_1]: 0.00055124 [with_stream_mark]: 2.139e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 3.75003e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 2.18998e-06 [replace_old_param]: 9.47999e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00532331 [add_forward_monad_depend]: 8.47e-06 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 1.574e-05 [cse]: 3.577e-05 [replace_applicator]: 1.905e-05 [Cycle 2]: 0.00039521, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.232e-05 [with_stream_mark]: 1.427e-05 [recompute_prepare]: 5.28002e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.805e-05 [j_node_and_user_rematch]: 8.59998e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.78999e-06 [inline_without_move]: 4.58999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.353e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 3.962e-05 [convert_after_rewriter]: 6.68998e-06 [order_py_execute_after_rewriter]: 5.82001e-06 [mutable_eliminate]: 0.00067721 [jit_opt_b]: 5.083e-05, [1] [Cycle 1]: 4.333e-05, [2] [frontend_op_eliminate]: 1.595e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 2.784e-05 [loop_unroll]: 0.00040837 [jit_opt_after_cconv]: 0.00015276, [1] [Cycle 1]: 0.00014572, [11] [c_1]: 1.969e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 6.39001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.316e-05 [call_graph_tuple_transform]: 1.834e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.05001e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.06e-06 [add_recomputation]: 5e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.74e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 1.831e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.34998e-06 [opt_after_jit_grad]: 0.00043686 [symbol_engine_optimizer]: 7.408e-05, [1] [Cycle 1]: 6.798e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.229e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 3.69997e-07 [validate]: 3.83e-05 Sums bootstrap : 0.000289s : 1.35% type_inference : 0.011345s : 52.88% event_method : 0.000022s : 0.10% auto_monad : 0.000067s : 0.31% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.001283s : 5.98% py_interpret_to_execute : 0.000048s : 0.23% rewriter_before_opt_a : 0.000078s : 0.36% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.29% jit_opt_a.loop_unroll : 0.000034s : 0.16% jit_opt_a.a_1 : 0.000644s : 3.00% jit_opt_a.with_stream_mark : 0.000036s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.005323s : 24.82% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.10% jit_opt_a.cse : 0.000049s : 0.23% jit_opt_a.replace_applicator : 0.000024s : 0.11% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000040s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000677s : 3.16% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000028s : 0.13% loop_unroll : 0.000408s : 1.90% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000050s : 0.23% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000018s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000437s : 2.04% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.18% Time group info: ------[substitution.] 0.000232 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.30% : 0.000005s : 3: substitution.graph_param_transform 84.41% : 0.000196s : 4: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000006s : 4: substitution.remove_not_recompute_node 2.21% : 0.000005s : 2: substitution.replace_old_param 5.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011264 2 91.10% : 0.010262s : 1: type_inference.infer 8.90% : 0.001002s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.24% : 0.000045s : 4: replace.inline 32.76% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.21% : 0.000194s : 4: match.inline 5.79% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.65% : 0.000002s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 6.54% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000001s : 6: predicate.less_batch_normalization 1.72% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.84% : 0.000001s : 3: predicate.opt_reshape 2.49% : 0.000003s : 15: predicate.partial_eliminate 1.43% : 0.000002s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 6: predicate.remove_not_recompute_node 2.11% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.68% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000681 13 45.68% : 0.000311s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.44% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.89% : 0.000319s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032682 72 0.16% : 0.000053s : 1: add_recomputation 0.22% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.94% : 0.000308s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 33.84% : 0.011060s : 1: jit_opt_a 0.48% : 0.000156s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.27% : 0.000416s : 1: loop_unroll 2.10% : 0.000687s : 1: mutable_eliminate 2.65% : 0.000867s : 26: opt.transform.jit_opt_a 0.14% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.36% : 0.000445s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 3.94% : 0.001289s : 1: pre_auto_parallel 0.16% : 0.000051s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 15.22% : 0.004973s : 1: renormalize.infer 1.04% : 0.000340s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000081s : 1: rewriter_before_opt_a 0.23% : 0.000077s : 1: symbol_engine_optimizer 34.79% : 0.011371s : 1: type_inference TotalTime = 0.158017, [30] [bootstrap]: 0.0002495 [type_inference]: 0.127842 [event_method]: 0.00062041 [auto_monad]: 0.00013093 [graph_reusing]: 8.62998e-06 [pre_auto_parallel]: 4.13001e-06 [py_interpret_to_execute]: 6.382e-05 [rewriter_before_opt_a]: 0.00013576 [expand_dump_flag]: 3.86001e-06 [jit_opt_a]: 0.0263087, [3] [Cycle 1]: 0.0173811, [27] [switch_simplify]: 7.926e-05 [loop_unroll]: 4.485e-05 [a_1]: 0.00100311 [with_stream_mark]: 3.666e-05 [recompute_prepare]: 2.038e-05 [updatestate_depend_eliminate]: 9.62001e-06 [updatestate_assign_eliminate]: 7.45e-06 [updatestate_loads_eliminate]: 6.82002e-06 [parameter_eliminate]: 2.54999e-06 [specialize_transform]: 1.456e-05 [updatestate_useless_node_eliminater]: 1.378e-05 [accelerated_algorithm]: 1.4e-05 [meta_shard_fg_expand]: 3.69002e-06 [get_grad_eliminate_]: 1.349e-05 [merge_forward]: 8.75001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.765e-05 [j_node_and_user_rematch]: 2.463e-05 [meta_fg_expand]: 0.00204461 [replace_old_param]: 8.203e-05 [inline_without_move]: 6.396e-05 [renormalize]: 0.0130744 [add_forward_monad_depend]: 6.086e-05 [auto_monad_grad]: 6.68998e-06 [auto_monad_eliminator]: 6.702e-05 [cse]: 0.00027719 [replace_applicator]: 9.564e-05 [Cycle 2]: 0.00409834, [27] [switch_simplify]: 4.378e-05 [loop_unroll]: 4.163e-05 [a_1]: 0.00119832 [with_stream_mark]: 2.234e-05 [recompute_prepare]: 9.74e-06 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 3.74002e-06 [updatestate_loads_eliminate]: 5.20001e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 7.84002e-06 [updatestate_useless_node_eliminater]: 7.53999e-06 [accelerated_algorithm]: 7.26999e-06 [meta_shard_fg_expand]: 3.58999e-06 [get_grad_eliminate_]: 7.28999e-06 [merge_forward]: 4.76002e-06 [cell_reuse_recompute_pass]: 1.83002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.772e-05 [j_node_and_user_rematch]: 1.244e-05 [meta_fg_expand]: 0.0001301 [replace_old_param]: 1.016e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00222062 [add_forward_monad_depend]: 1.067e-05 [auto_monad_grad]: 2.15002e-06 [auto_monad_eliminator]: 1.54e-05 [cse]: 3e-05 [replace_applicator]: 2.101e-05 [Cycle 3]: 0.0002772, [27] [switch_simplify]: 4.67e-06 [loop_unroll]: 3.93999e-06 [a_1]: 4.676e-05 [with_stream_mark]: 1.405e-05 [recompute_prepare]: 3.56999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 3.60998e-06 [updatestate_useless_node_eliminater]: 3.5e-06 [accelerated_algorithm]: 3.31001e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 3.28e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 2.95002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 6.01e-06 [meta_fg_expand]: 2.18998e-06 [replace_old_param]: 3.54002e-06 [inline_without_move]: 2.86999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 4.43999e-06 [cse]: 9.72001e-06 [replace_applicator]: 3.76999e-06 [py_interpret_to_execute_after_opt_a]: 1.458e-05 [rewriter_after_opt_a]: 3.63e-05 [convert_after_rewriter]: 6.02999e-06 [order_py_execute_after_rewriter]: 4.51002e-06 [mutable_eliminate]: 0.0007777 [jit_opt_b]: 4.665e-05, [1] [Cycle 1]: 3.716e-05, [2] [frontend_op_eliminate]: 1.068e-05 [inline_after_opt_a]: 1.268e-05 [cconv]: 3.111e-05 [loop_unroll]: 0.00053 [jit_opt_after_cconv]: 0.00015368, [1] [Cycle 1]: 0.00014552, [11] [c_1]: 1.455e-05 [parameter_eliminate]: 5.04998e-06 [updatestate_depend_eliminate]: 7.65e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 1.91998e-06 [cse]: 2.886e-05 [call_graph_tuple_transform]: 1.899e-05 [tuple_list_get_item_eliminator]: 4.38999e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 4.02998e-06 [remove_dup_value]: 1.508e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 5.57999e-06 [add_recomputation]: 4.278e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.629e-05, [1] [cse]: 9.16002e-06 [auto_monad_reorder]: 1.269e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 7.77998e-06 [opt_after_jit_grad]: 0.000525 [symbol_engine_optimizer]: 0.00013963, [1] [Cycle 1]: 0.00013156, [6] [build]: 4.95001e-06 [elim_shapecalc]: 5.61e-06 [elim_not_effective]: 7.464e-05 [opt_reshape]: 4.95001e-06 [fold_const_symbol]: 7e-06 [renormalize]: 4.30009e-07 [validate]: 4.321e-05 Sums bootstrap : 0.000250s : 0.16% type_inference : 0.127842s : 83.86% event_method : 0.000620s : 0.41% auto_monad : 0.000131s : 0.09% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000064s : 0.04% rewriter_before_opt_a : 0.000136s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000128s : 0.08% jit_opt_a.loop_unroll : 0.000090s : 0.06% jit_opt_a.a_1 : 0.002248s : 1.47% jit_opt_a.with_stream_mark : 0.000073s : 0.05% jit_opt_a.recompute_prepare : 0.000034s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.002177s : 1.43% jit_opt_a.replace_old_param : 0.000096s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.05% jit_opt_a.renormalize : 0.015295s : 10.03% jit_opt_a.add_forward_monad_depend : 0.000073s : 0.05% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.06% jit_opt_a.cse : 0.000317s : 0.21% jit_opt_a.replace_applicator : 0.000120s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000778s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000530s : 0.35% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000043s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000525s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000075s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000632 104 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.23% : 0.000001s : 1: substitution.fold_const_symbol 0.74% : 0.000005s : 1: substitution.graph_param_transform 66.15% : 0.000418s : 13: substitution.inline 3.02% : 0.000019s : 2: substitution.inline_without_move 1.71% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.97% : 0.000012s : 7: substitution.minmaximum_grad 1.32% : 0.000008s : 5: substitution.partial_eliminate 1.85% : 0.000012s : 12: substitution.remove_not_recompute_node 5.54% : 0.000035s : 10: substitution.replace_applicator 1.74% : 0.000011s : 10: substitution.replace_old_param 0.38% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.18% : 0.000007s : 1: substitution.tile_eliminate 3.89% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.77% : 0.000018s : 7: substitution.tuple_list_get_item_depend_reorder 7.26% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127713 2 97.37% : 0.124354s : 1: type_inference.infer 2.63% : 0.003360s : 1: type_inference.specialize ------[replace.] 0.000187 20 65.64% : 0.000123s : 13: replace.inline 34.36% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000434 20 94.64% : 0.000411s : 13: match.inline 5.36% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000377 2544 1.49% : 0.000006s : 44: predicate.accumulaten_eliminater 0.43% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.35% : 0.000005s : 44: predicate.addn_check_dump 1.70% : 0.000006s : 44: predicate.addn_zero_filter 1.94% : 0.000007s : 44: predicate.arithmetic_simplify 1.57% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 44: predicate.compare_switch_simplify 1.55% : 0.000006s : 44: predicate.depend_value_elim 1.59% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.54% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.51% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.40% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.45% : 0.000005s : 44: predicate.environ_get_depend_swap 1.50% : 0.000006s : 44: predicate.environ_get_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 17: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.29% : 0.000016s : 66: predicate.inline 1.99% : 0.000008s : 45: predicate.inline_without_move 0.32% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.00% : 0.000004s : 17: predicate.less_batch_normalization 1.87% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.82% : 0.000007s : 52: predicate.load_eliminater 0.56% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 44: predicate.merge_addn 1.43% : 0.000005s : 44: predicate.minmaximum_grad 0.60% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.28% : 0.000009s : 52: predicate.partial_eliminate 1.45% : 0.000005s : 44: predicate.print_const_string_wrapper 1.87% : 0.000007s : 44: predicate.reduce_eliminate 1.84% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 17: predicate.remove_not_recompute_node 2.86% : 0.000011s : 96: predicate.replace_applicator 1.39% : 0.000005s : 45: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000006s : 44: predicate.reshape_eliminate 1.93% : 0.000007s : 44: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 17: predicate.specialize_transform 1.76% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.04% : 0.000011s : 64: predicate.switch_defer_inline 2.44% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.41% : 0.000024s : 157: predicate.switch_simplify 1.50% : 0.000006s : 44: predicate.tile_eliminate 1.49% : 0.000006s : 44: predicate.transpose_eliminate 1.88% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.93% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.79% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.74% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.88% : 0.000011s : 69: predicate.updatestate_useless_node_eliminater 1.86% : 0.000007s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003792 45 75.54% : 0.002864s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.46% : 0.000928s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.176312 87 0.03% : 0.000046s : 1: add_recomputation 0.08% : 0.000137s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.15% : 0.000272s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.36% : 0.000636s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.92% : 0.026312s : 1: jit_opt_a 0.09% : 0.000157s : 1: jit_opt_after_cconv 0.03% : 0.000049s : 1: jit_opt_b 0.31% : 0.000540s : 1: loop_unroll 0.45% : 0.000790s : 1: mutable_eliminate 1.67% : 0.002940s : 39: opt.transform.jit_opt_a 0.02% : 0.000038s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000088s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000537s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000067s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.39% : 0.013022s : 2: renormalize.infer 1.28% : 0.002250s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000139s : 1: rewriter_before_opt_a 0.08% : 0.000143s : 1: symbol_engine_optimizer 72.53% : 0.127872s : 1: type_inference TotalTime = 0.521637, [30] [bootstrap]: 0.00032361 [type_inference]: 0.494166 [event_method]: 2.244e-05 [auto_monad]: 7.17e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00044462 [rewriter_before_opt_a]: 0.00010184 [expand_dump_flag]: 4.22e-06 [jit_opt_a]: 0.0238267, [2] [Cycle 1]: 0.0199257, [27] [switch_simplify]: 6.234e-05 [loop_unroll]: 3.349e-05 [a_1]: 0.00070056 [with_stream_mark]: 1.986e-05 [recompute_prepare]: 9.03002e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.69002e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 1.092e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.022e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 0.0187106 [add_forward_monad_depend]: 1.003e-05 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 2.018e-05 [cse]: 4.001e-05 [replace_applicator]: 2.553e-05 [Cycle 2]: 0.00040034, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 6.48998e-06 [a_1]: 0.00012941 [with_stream_mark]: 1.521e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 2.79999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.956e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 5.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.71e-06 [cse]: 1.494e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.663e-05 [rewriter_after_opt_a]: 4.177e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00076578 [jit_opt_b]: 9.657e-05, [1] [Cycle 1]: 8.83e-05, [2] [frontend_op_eliminate]: 2.002e-05 [inline_after_opt_a]: 1.966e-05 [cconv]: 3.034e-05 [loop_unroll]: 0.00059129 [jit_opt_after_cconv]: 0.00016965, [1] [Cycle 1]: 0.00016135, [11] [c_1]: 2.805e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 4.23001e-06 [cse]: 2.688e-05 [call_graph_tuple_transform]: 2.288e-05 [tuple_list_get_item_eliminator]: 7.54002e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 6.30002e-06 [remove_dup_value]: 1.873e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 1.054e-05 [add_recomputation]: 5.105e-05 [cse_after_recomputation]: 2.486e-05, [1] [Cycle 1]: 1.958e-05, [1] [cse]: 1.428e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.07999e-06 [opt_after_jit_grad]: 0.00048623 [symbol_engine_optimizer]: 8.196e-05, [1] [Cycle 1]: 7.61e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 1.063e-05 [elim_not_effective]: 1.583e-05 [opt_reshape]: 6.57002e-06 [fold_const_symbol]: 1.131e-05 [renormalize]: 4.69998e-07 [validate]: 5.149e-05 Sums bootstrap : 0.000324s : 0.06% type_inference : 0.494166s : 95.50% event_method : 0.000022s : 0.00% auto_monad : 0.000072s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000445s : 0.09% rewriter_before_opt_a : 0.000102s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.01% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000830s : 0.16% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.018711s : 3.62% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000055s : 0.01% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000766s : 0.15% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000030s : 0.01% loop_unroll : 0.000591s : 0.11% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000051s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000486s : 0.09% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.01% Time group info: ------[substitution.] 0.000282 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000007s : 4: substitution.graph_param_transform 85.97% : 0.000243s : 5: substitution.inline 1.88% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000006s : 2: substitution.replace_old_param 4.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.494087 2 99.42% : 0.491209s : 1: type_inference.infer 0.58% : 0.002878s : 1: type_inference.specialize ------[replace.] 0.000103 7 69.93% : 0.000072s : 5: replace.inline 30.07% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000252 7 95.35% : 0.000240s : 5: match.inline 4.65% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.45% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.48% : 0.000001s : 4: predicate.graph_param_transform 5.89% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 19: predicate.load_eliminater 1.62% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.20% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000011s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002648 25 64.88% : 0.001718s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.08% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.04% : 0.000849s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.541513 72 0.01% : 0.000054s : 1: add_recomputation 0.01% : 0.000075s : 1: auto_monad 0.00% : 0.000022s : 1: auto_monad_reorder 0.06% : 0.000345s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.00% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.40% : 0.023830s : 1: jit_opt_a 0.03% : 0.000173s : 1: jit_opt_after_cconv 0.02% : 0.000099s : 1: jit_opt_b 0.11% : 0.000601s : 1: loop_unroll 0.14% : 0.000775s : 1: mutable_eliminate 0.20% : 0.001093s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.00% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.09% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000451s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 3.29% : 0.017805s : 1: renormalize.infer 0.16% : 0.000892s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000045s : 1: rewriter_after_opt_a 0.02% : 0.000107s : 1: rewriter_before_opt_a 0.02% : 0.000085s : 1: symbol_engine_optimizer 91.26% : 0.494181s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.316.415 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d8b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.317.257 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0274193, [30] [bootstrap]: 0.00024548 [type_inference]: 0.0189535 [event_method]: 2.036e-05 [auto_monad]: 7.17e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.0001038 [rewriter_before_opt_a]: 8.012e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00573375, [2] [Cycle 1]: 0.00193393, [27] [switch_simplify]: 5.533e-05 [loop_unroll]: 2.877e-05 [a_1]: 0.00053277 [with_stream_mark]: 1.86e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 4.29997e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.425e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.56002e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 0.00088881 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.58e-05 [cse]: 3.375e-05 [replace_applicator]: 1.289e-05 [Cycle 2]: 0.00031995, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 4.99998e-06 [a_1]: 8.835e-05 [with_stream_mark]: 9.87001e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.20998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.239e-05 [j_node_and_user_rematch]: 7.54002e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.75e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 5.49e-06 [cse]: 1.284e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.349e-05 [rewriter_after_opt_a]: 4.224e-05 [convert_after_rewriter]: 6.70002e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00056507 [jit_opt_b]: 4.984e-05, [1] [Cycle 1]: 4.295e-05, [2] [frontend_op_eliminate]: 1.535e-05 [inline_after_opt_a]: 1.601e-05 [cconv]: 2.583e-05 [loop_unroll]: 0.00044297 [jit_opt_after_cconv]: 0.00014244, [1] [Cycle 1]: 0.00013542, [11] [c_1]: 2.023e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.32e-05 [call_graph_tuple_transform]: 1.826e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 1.939e-05 [environ_conv]: 6.26e-06 [add_recomputation]: 5.74e-05 [cse_after_recomputation]: 2.51e-05, [1] [Cycle 1]: 1.944e-05, [1] [cse]: 1.37e-05 [auto_monad_reorder]: 1.821e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 5.88002e-06 [opt_after_jit_grad]: 0.00046559 [symbol_engine_optimizer]: 7.02e-05, [1] [Cycle 1]: 6.377e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.235e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 4.39992e-07 [validate]: 4.473e-05 Sums bootstrap : 0.000245s : 1.05% type_inference : 0.018954s : 81.38% event_method : 0.000020s : 0.09% auto_monad : 0.000072s : 0.31% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000104s : 0.45% rewriter_before_opt_a : 0.000080s : 0.34% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000061s : 0.26% jit_opt_a.loop_unroll : 0.000034s : 0.15% jit_opt_a.a_1 : 0.000621s : 2.67% jit_opt_a.with_stream_mark : 0.000028s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000889s : 3.82% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000047s : 0.20% jit_opt_a.replace_applicator : 0.000018s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000042s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000565s : 2.43% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000026s : 0.11% loop_unroll : 0.000443s : 1.90% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000019s : 0.08% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000057s : 0.25% cse_after_recomputation.cse : 0.000014s : 0.06% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000466s : 2.00% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.19% Time group info: ------[substitution.] 0.000197 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000006s : 3: substitution.graph_param_transform 83.49% : 0.000164s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 6.22% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018881 2 92.31% : 0.017429s : 1: type_inference.infer 7.69% : 0.001452s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.89% : 0.000046s : 4: replace.inline 33.11% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.53% : 0.000162s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.35% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.67% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.08% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.54% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.73% : 0.000003s : 16: predicate.switch_defer_inline 2.26% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000749 13 42.33% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.28% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.39% : 0.000392s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029190 72 0.21% : 0.000061s : 1: add_recomputation 0.26% : 0.000075s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 0.90% : 0.000262s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 19.66% : 0.005737s : 1: jit_opt_a 0.50% : 0.000145s : 1: jit_opt_after_cconv 0.18% : 0.000052s : 1: jit_opt_b 1.55% : 0.000451s : 1: loop_unroll 1.97% : 0.000574s : 1: mutable_eliminate 2.85% : 0.000833s : 26: opt.transform.jit_opt_a 0.16% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.62% : 0.000474s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.07% : 0.000021s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000107s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 1.76% : 0.000513s : 1: renormalize.infer 1.26% : 0.000367s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000045s : 1: rewriter_after_opt_a 0.29% : 0.000083s : 1: rewriter_before_opt_a 0.25% : 0.000073s : 1: symbol_engine_optimizer 65.00% : 0.018973s : 1: type_inference TotalTime = 0.171656, [30] [bootstrap]: 0.00043461 [type_inference]: 0.151354 [event_method]: 2.863e-05 [auto_monad]: 9.72e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00072008 [rewriter_before_opt_a]: 0.00013163 [expand_dump_flag]: 5.36002e-06 [jit_opt_a]: 0.0132354, [2] [Cycle 1]: 0.00780415, [27] [switch_simplify]: 0.00252389 [loop_unroll]: 5.441e-05 [a_1]: 0.00096236 [with_stream_mark]: 3.032e-05 [recompute_prepare]: 1.163e-05 [updatestate_depend_eliminate]: 5.07999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 8.07e-06 [updatestate_useless_node_eliminater]: 6.66999e-06 [accelerated_algorithm]: 7.71999e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 7.45998e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.228e-05 [inline_without_move]: 6.51999e-06 [renormalize]: 0.00375235 [add_forward_monad_depend]: 9.29998e-06 [auto_monad_grad]: 3.68e-06 [auto_monad_eliminator]: 1.934e-05 [cse]: 3.972e-05 [replace_applicator]: 2.333e-05 [Cycle 2]: 0.0004131, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 6.19999e-06 [a_1]: 0.000141 [with_stream_mark]: 1.6e-05 [recompute_prepare]: 6.59999e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 3.33e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 6.02001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.456e-05 [replace_applicator]: 6.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.734e-05 [rewriter_after_opt_a]: 4.277e-05 [convert_after_rewriter]: 7.76001e-06 [order_py_execute_after_rewriter]: 6.59001e-06 [mutable_eliminate]: 0.00090365 [jit_opt_b]: 6.547e-05, [1] [Cycle 1]: 5.63e-05, [2] [frontend_op_eliminate]: 2.229e-05 [inline_after_opt_a]: 2.174e-05 [cconv]: 3.238e-05 [loop_unroll]: 0.00047852 [jit_opt_after_cconv]: 0.00255333, [1] [Cycle 1]: 0.00254342, [11] [c_1]: 2.66e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 7.88999e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.46998e-06 [cse]: 3.617e-05 [call_graph_tuple_transform]: 5.918e-05 [tuple_list_get_item_eliminator]: 9.59e-06 [none_parameter_eliminate]: 4.82998e-06 [renormalize]: 8.2e-07 [switch_simplify]: 7.52002e-06 [remove_dup_value]: 2.985e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.342e-05 [add_recomputation]: 7.468e-05 [cse_after_recomputation]: 4.26e-05, [1] [Cycle 1]: 3.255e-05, [1] [cse]: 2.457e-05 [auto_monad_reorder]: 1.965e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 1.174e-05 [opt_after_jit_grad]: 0.00083222 [symbol_engine_optimizer]: 0.00019713, [1] [Cycle 1]: 0.00018907, [6] [build]: 5.99e-06 [elim_shapecalc]: 9.77001e-06 [elim_not_effective]: 0.00011914 [opt_reshape]: 9.53002e-06 [fold_const_symbol]: 1.341e-05 [renormalize]: 4.7998e-07 [validate]: 7.091e-05 Sums bootstrap : 0.000435s : 0.27% type_inference : 0.151354s : 92.55% event_method : 0.000029s : 0.02% auto_monad : 0.000097s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000720s : 0.44% rewriter_before_opt_a : 0.000132s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.002531s : 1.55% jit_opt_a.loop_unroll : 0.000061s : 0.04% jit_opt_a.a_1 : 0.001103s : 0.67% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003752s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.000904s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000479s : 0.29% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000059s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000030s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000075s : 0.05% cse_after_recomputation.cse : 0.000025s : 0.02% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000832s : 0.51% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000119s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000071s : 0.04% Time group info: ------[substitution.] 0.000398 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 3.40% : 0.000014s : 4: substitution.graph_param_transform 82.86% : 0.000330s : 5: substitution.inline 1.14% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.19% : 0.000017s : 3: substitution.reduce_eliminate 1.58% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000008s : 2: substitution.replace_old_param 3.83% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151193 2 96.39% : 0.145736s : 1: type_inference.infer 3.61% : 0.005457s : 1: type_inference.specialize ------[replace.] 0.000150 7 66.84% : 0.000100s : 5: replace.inline 33.16% : 0.000050s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000341 7 95.83% : 0.000326s : 5: match.inline 4.17% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.002576 886 0.10% : 0.000003s : 13: predicate.accumulaten_eliminater 0.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.06% : 0.000002s : 13: predicate.addn_check_dump 0.10% : 0.000003s : 13: predicate.addn_zero_filter 0.12% : 0.000003s : 13: predicate.arithmetic_simplify 0.09% : 0.000002s : 13: predicate.cast_eliminate 0.04% : 0.000001s : 4: predicate.check_bprop_eliminate 0.07% : 0.000002s : 13: predicate.compare_switch_simplify 0.08% : 0.000002s : 13: predicate.depend_value_elim 0.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.07% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.07% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.02% : 0.000001s : 4: predicate.elim_not_effective 0.04% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.07% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.06% : 0.000002s : 13: predicate.environ_get_depend_swap 0.08% : 0.000002s : 13: predicate.environ_get_eliminate 0.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 4: predicate.fold_const_symbol 0.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.04% : 0.000001s : 4: predicate.graph_param_transform 0.36% : 0.000009s : 28: predicate.inline 0.05% : 0.000001s : 8: predicate.inline_without_move 0.03% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.11% : 0.000003s : 8: predicate.less_batch_normalization 0.08% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 0.13% : 0.000003s : 19: predicate.load_eliminater 0.11% : 0.000003s : 4: predicate.loop_unroll_after_grad 0.38% : 0.000010s : 40: predicate.loop_unroll_before_grad 0.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.06% : 0.000002s : 13: predicate.merge_addn 0.07% : 0.000002s : 13: predicate.minmaximum_grad 0.14% : 0.000004s : 4: predicate.mutable_eliminate 0.04% : 0.000001s : 4: predicate.opt_reshape 0.14% : 0.000004s : 19: predicate.partial_eliminate 0.07% : 0.000002s : 13: predicate.print_const_string_wrapper 0.14% : 0.000004s : 13: predicate.reduce_eliminate 0.13% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.05% : 0.000001s : 8: predicate.remove_not_recompute_node 0.11% : 0.000003s : 23: predicate.replace_applicator 0.05% : 0.000001s : 8: predicate.replace_old_param 0.02% : 0.000001s : 4: predicate.reset_defer_inline 0.12% : 0.000003s : 13: predicate.reshape_eliminate 0.08% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.04% : 0.000001s : 4: predicate.row_tensor_eliminate 0.09% : 0.000002s : 13: predicate.same_eliminate 0.04% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.06% : 0.000001s : 8: predicate.special_op_eliminate 0.05% : 0.000001s : 8: predicate.specialize_transform 0.12% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 0.07% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.03% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.21% : 0.000005s : 20: predicate.switch_defer_inline 0.16% : 0.000004s : 20: predicate.switch_layer_defer_inline 93.69% : 0.002413s : 64: predicate.switch_simplify 0.10% : 0.000002s : 13: predicate.tile_eliminate 0.09% : 0.000002s : 13: predicate.transpose_eliminate 0.10% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 0.09% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 0.28% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 0.10% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 0.11% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 0.09% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 0.18% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 0.15% : 0.000004s : 13: predicate.value_based_eliminate 0.02% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.04% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003053 25 64.09% : 0.001957s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.02% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.89% : 0.001004s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.179449 72 0.04% : 0.000078s : 1: add_recomputation 0.06% : 0.000101s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.26% : 0.000460s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000045s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.38% : 0.013239s : 1: jit_opt_a 1.43% : 0.002558s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.27% : 0.000489s : 1: loop_unroll 0.51% : 0.000916s : 1: mutable_eliminate 2.14% : 0.003846s : 26: opt.transform.jit_opt_a 0.05% : 0.000095s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000148s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000843s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000730s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000033s : 1: remove_dup_value 1.50% : 0.002700s : 1: renormalize.infer 0.58% : 0.001040s : 1: renormalize.specialize 0.01% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000138s : 1: rewriter_before_opt_a 0.11% : 0.000200s : 1: symbol_engine_optimizer 84.36% : 0.151377s : 1: type_inference TotalTime = 0.0129079, [30] [bootstrap]: 0.00033142 [type_inference]: 0.00473341 [event_method]: 1.813e-05 [auto_monad]: 6.857e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 3.644e-05 [rewriter_before_opt_a]: 7.387e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00533073, [2] [Cycle 1]: 0.00165831, [27] [switch_simplify]: 5.559e-05 [loop_unroll]: 2.938e-05 [a_1]: 0.00053894 [with_stream_mark]: 2.147e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 8.83001e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.22e-06 [renormalize]: 0.00067616 [add_forward_monad_depend]: 4.65001e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.539e-05 [cse]: 3.626e-05 [replace_applicator]: 1.208e-05 [Cycle 2]: 0.00031875, [27] [switch_simplify]: 5.57001e-06 [loop_unroll]: 5.26002e-06 [a_1]: 8.927e-05 [with_stream_mark]: 9.43002e-06 [recompute_prepare]: 5.26002e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 7.88999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 6.81999e-06 [inline_without_move]: 4.72e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.211e-05 [replace_applicator]: 5.09003e-06 [py_interpret_to_execute_after_opt_a]: 1.307e-05 [rewriter_after_opt_a]: 3.954e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00073378 [jit_opt_b]: 4.926e-05, [1] [Cycle 1]: 4.247e-05, [2] [frontend_op_eliminate]: 1.576e-05 [inline_after_opt_a]: 1.608e-05 [cconv]: 2.917e-05 [loop_unroll]: 0.00041931 [jit_opt_after_cconv]: 0.00015441, [1] [Cycle 1]: 0.00014756, [11] [c_1]: 2.021e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 5.89e-06 [updatestate_assign_eliminate]: 9.67999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.4e-05 [call_graph_tuple_transform]: 1.871e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 5.55001e-06 [remove_dup_value]: 1.666e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.04001e-06 [add_recomputation]: 5.295e-05 [cse_after_recomputation]: 2.28e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.161e-05 [auto_monad_reorder]: 1.726e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 4.50999e-06 [opt_after_jit_grad]: 0.00044612 [symbol_engine_optimizer]: 7.183e-05, [1] [Cycle 1]: 6.577e-05, [6] [build]: 3.64002e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.25e-05 [opt_reshape]: 5.66998e-06 [fold_const_symbol]: 8.56002e-06 [renormalize]: 3.4002e-07 [validate]: 3.922e-05 Sums bootstrap : 0.000331s : 3.69% type_inference : 0.004733s : 52.72% event_method : 0.000018s : 0.20% auto_monad : 0.000069s : 0.76% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.41% rewriter_before_opt_a : 0.000074s : 0.82% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000061s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.39% jit_opt_a.a_1 : 0.000628s : 7.00% jit_opt_a.with_stream_mark : 0.000031s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000676s : 7.53% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000048s : 0.54% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000013s : 0.15% rewriter_after_opt_a : 0.000040s : 0.44% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000734s : 8.17% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000029s : 0.32% loop_unroll : 0.000419s : 4.67% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000010s : 0.11% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000024s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000053s : 0.59% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000446s : 4.97% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.44% Time group info: ------[substitution.] 0.000211 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000005s : 3: substitution.graph_param_transform 84.55% : 0.000178s : 4: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000004s : 2: substitution.replace_old_param 5.71% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004667 2 81.81% : 0.003819s : 1: type_inference.infer 18.19% : 0.000849s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.19% : 0.000047s : 4: replace.inline 31.81% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 94.14% : 0.000176s : 4: match.inline 5.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.32% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.75% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000001s : 10: predicate.depend_value_elim 1.24% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.87% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.11% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.45% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.37% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000631 13 52.33% : 0.000330s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.89% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.78% : 0.000258s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014478 72 0.39% : 0.000056s : 1: add_recomputation 0.50% : 0.000072s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.42% : 0.000351s : 1: bootstrap 0.22% : 0.000032s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.84% : 0.005333s : 1: jit_opt_a 1.08% : 0.000157s : 1: jit_opt_after_cconv 0.36% : 0.000052s : 1: jit_opt_b 2.95% : 0.000427s : 1: loop_unroll 5.14% : 0.000743s : 1: mutable_eliminate 5.79% : 0.000839s : 26: opt.transform.jit_opt_a 0.32% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.13% : 0.000454s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000039s : 1: py_interpret_to_execute 0.11% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.62% : 0.000379s : 1: renormalize.infer 2.00% : 0.000290s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000043s : 1: rewriter_after_opt_a 0.53% : 0.000076s : 1: rewriter_before_opt_a 0.51% : 0.000074s : 1: symbol_engine_optimizer 32.81% : 0.004749s : 1: type_inference TotalTime = 0.14678, [30] [bootstrap]: 0.00025133 [type_inference]: 0.120264 [event_method]: 0.00049489 [auto_monad]: 0.00011332 [graph_reusing]: 8.18999e-06 [pre_auto_parallel]: 3.02002e-06 [py_interpret_to_execute]: 8.219e-05 [rewriter_before_opt_a]: 0.00012646 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.0232, [3] [Cycle 1]: 0.0157281, [27] [switch_simplify]: 7.176e-05 [loop_unroll]: 4.536e-05 [a_1]: 0.00096477 [with_stream_mark]: 3.379e-05 [recompute_prepare]: 2.271e-05 [updatestate_depend_eliminate]: 9.39998e-06 [updatestate_assign_eliminate]: 6.85002e-06 [updatestate_loads_eliminate]: 6.74999e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 1.472e-05 [updatestate_useless_node_eliminater]: 1.35e-05 [accelerated_algorithm]: 1.422e-05 [meta_shard_fg_expand]: 3.86001e-06 [get_grad_eliminate_]: 1.439e-05 [merge_forward]: 8.81002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.809e-05 [j_node_and_user_rematch]: 2.446e-05 [meta_fg_expand]: 0.00174938 [replace_old_param]: 6.739e-05 [inline_without_move]: 6.451e-05 [renormalize]: 0.0118635 [add_forward_monad_depend]: 1.317e-05 [auto_monad_grad]: 6.39999e-06 [auto_monad_eliminator]: 6.569e-05 [cse]: 0.00026652 [replace_applicator]: 9.575e-05 [Cycle 2]: 0.00371094, [27] [switch_simplify]: 4.519e-05 [loop_unroll]: 4.689e-05 [a_1]: 0.00124787 [with_stream_mark]: 1.667e-05 [recompute_prepare]: 1.044e-05 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 4.02e-06 [updatestate_loads_eliminate]: 3.65003e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 8.75999e-06 [updatestate_useless_node_eliminater]: 8.3e-06 [accelerated_algorithm]: 8.45001e-06 [meta_shard_fg_expand]: 3.06999e-06 [get_grad_eliminate_]: 8.27e-06 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.781e-05 [j_node_and_user_rematch]: 1.295e-05 [meta_fg_expand]: 9.511e-05 [replace_old_param]: 8.90999e-06 [inline_without_move]: 8.07e-06 [renormalize]: 0.00193297 [add_forward_monad_depend]: 5.57999e-06 [auto_monad_grad]: 1.87001e-06 [auto_monad_eliminator]: 9.91998e-06 [cse]: 1.996e-05 [replace_applicator]: 1.112e-05 [Cycle 3]: 0.0002432, [27] [switch_simplify]: 4.13001e-06 [loop_unroll]: 3.62002e-06 [a_1]: 4.004e-05 [with_stream_mark]: 9.51e-06 [recompute_prepare]: 3.43e-06 [updatestate_depend_eliminate]: 2.29999e-06 [updatestate_assign_eliminate]: 1.65001e-06 [updatestate_loads_eliminate]: 1.57001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 3.5e-06 [updatestate_useless_node_eliminater]: 3.21001e-06 [accelerated_algorithm]: 3.53e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 3.06999e-06 [merge_forward]: 2.29999e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.002e-05 [j_node_and_user_rematch]: 5.62001e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 3.26001e-06 [inline_without_move]: 3.03e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 3.41999e-06 [cse]: 8.00999e-06 [replace_applicator]: 3.43e-06 [py_interpret_to_execute_after_opt_a]: 1.18e-05 [rewriter_after_opt_a]: 3.43e-05 [convert_after_rewriter]: 5.85002e-06 [order_py_execute_after_rewriter]: 4.73001e-06 [mutable_eliminate]: 0.00069197 [jit_opt_b]: 4.367e-05, [1] [Cycle 1]: 3.603e-05, [2] [frontend_op_eliminate]: 1.074e-05 [inline_after_opt_a]: 1.235e-05 [cconv]: 2.484e-05 [loop_unroll]: 0.00042114 [jit_opt_after_cconv]: 0.00012396, [1] [Cycle 1]: 0.00011732, [11] [c_1]: 1.249e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 1.60999e-06 [cse]: 1.746e-05 [call_graph_tuple_transform]: 1.404e-05 [tuple_list_get_item_eliminator]: 3.91001e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 3.53999e-06 [remove_dup_value]: 1.486e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 5.39998e-06 [add_recomputation]: 3.588e-05 [cse_after_recomputation]: 2.03e-05, [1] [Cycle 1]: 1.537e-05, [1] [cse]: 9.30001e-06 [auto_monad_reorder]: 1.312e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 5.99999e-06 [opt_after_jit_grad]: 0.00045714 [symbol_engine_optimizer]: 6.773e-05, [1] [Cycle 1]: 6.132e-05, [6] [build]: 3.66001e-06 [elim_shapecalc]: 6.39001e-06 [elim_not_effective]: 1.03e-05 [opt_reshape]: 4.55001e-06 [fold_const_symbol]: 5.80002e-06 [renormalize]: 3.89991e-07 [validate]: 4.458e-05 Sums bootstrap : 0.000251s : 0.18% type_inference : 0.120264s : 84.45% event_method : 0.000495s : 0.35% auto_monad : 0.000113s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000082s : 0.06% rewriter_before_opt_a : 0.000126s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000121s : 0.09% jit_opt_a.loop_unroll : 0.000096s : 0.07% jit_opt_a.a_1 : 0.002253s : 1.58% jit_opt_a.with_stream_mark : 0.000060s : 0.04% jit_opt_a.recompute_prepare : 0.000037s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000027s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001846s : 1.30% jit_opt_a.replace_old_param : 0.000080s : 0.06% jit_opt_a.inline_without_move : 0.000076s : 0.05% jit_opt_a.renormalize : 0.013796s : 9.69% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000079s : 0.06% jit_opt_a.cse : 0.000294s : 0.21% jit_opt_a.replace_applicator : 0.000110s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000692s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000421s : 0.30% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000457s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000569 107 0.25% : 0.000001s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.73% : 0.000004s : 1: substitution.graph_param_transform 65.04% : 0.000370s : 13: substitution.inline 3.85% : 0.000022s : 2: substitution.inline_without_move 1.61% : 0.000009s : 13: substitution.j_node_and_user_rematch 1.90% : 0.000011s : 7: substitution.minmaximum_grad 1.27% : 0.000007s : 5: substitution.partial_eliminate 1.74% : 0.000010s : 13: substitution.remove_not_recompute_node 5.61% : 0.000032s : 10: substitution.replace_applicator 1.12% : 0.000006s : 10: substitution.replace_old_param 1.06% : 0.000006s : 1: substitution.reshape_eliminate 0.43% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.16% : 0.000007s : 1: substitution.tile_eliminate 3.77% : 0.000021s : 7: substitution.tuple_list_convert_item_index_to_positive 2.78% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.51% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120161 2 97.43% : 0.117071s : 1: type_inference.infer 2.57% : 0.003089s : 1: type_inference.specialize ------[replace.] 0.000178 20 66.63% : 0.000118s : 13: replace.inline 33.37% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000383 20 94.53% : 0.000362s : 13: match.inline 5.47% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000389 2656 1.53% : 0.000006s : 46: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.54% : 0.000006s : 46: predicate.addn_check_dump 1.58% : 0.000006s : 46: predicate.addn_zero_filter 2.05% : 0.000008s : 46: predicate.arithmetic_simplify 1.58% : 0.000006s : 46: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000006s : 46: predicate.compare_switch_simplify 1.59% : 0.000006s : 46: predicate.depend_value_elim 1.50% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.19% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.55% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_depend_swap 1.48% : 0.000006s : 46: predicate.environ_get_eliminate 1.51% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.94% : 0.000004s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.08% : 0.000016s : 68: predicate.inline 1.97% : 0.000008s : 47: predicate.inline_without_move 0.36% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.03% : 0.000004s : 19: predicate.less_batch_normalization 2.01% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 54: predicate.load_eliminater 0.30% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.56% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.64% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.51% : 0.000006s : 46: predicate.merge_addn 1.47% : 0.000006s : 46: predicate.minmaximum_grad 0.48% : 0.000002s : 1: predicate.mutable_eliminate 0.21% : 0.000001s : 1: predicate.opt_reshape 2.35% : 0.000009s : 54: predicate.partial_eliminate 1.52% : 0.000006s : 46: predicate.print_const_string_wrapper 2.15% : 0.000008s : 46: predicate.reduce_eliminate 1.81% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000002s : 19: predicate.remove_not_recompute_node 2.88% : 0.000011s : 100: predicate.replace_applicator 1.09% : 0.000004s : 47: predicate.replace_old_param 0.08% : 0.000000s : 1: predicate.reset_defer_inline 1.69% : 0.000007s : 46: predicate.reshape_eliminate 1.69% : 0.000007s : 46: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.63% : 0.000006s : 46: predicate.same_eliminate 0.50% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.12% : 0.000000s : 2: predicate.special_op_eliminate 0.85% : 0.000003s : 19: predicate.specialize_transform 1.66% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.73% : 0.000007s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.87% : 0.000011s : 66: predicate.switch_defer_inline 2.51% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.38% : 0.000025s : 161: predicate.switch_simplify 1.58% : 0.000006s : 46: predicate.tile_eliminate 1.58% : 0.000006s : 46: predicate.transpose_eliminate 1.93% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.11% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.86% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.84% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.74% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.84% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003440 45 75.99% : 0.002614s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.01% : 0.000826s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.163487 87 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000120s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.17% : 0.000278s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.31% : 0.000504s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.19% : 0.023204s : 1: jit_opt_a 0.08% : 0.000127s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.26% : 0.000428s : 1: loop_unroll 0.43% : 0.000700s : 1: mutable_eliminate 1.79% : 0.002927s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000465s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000085s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.15% : 0.011686s : 2: renormalize.infer 1.28% : 0.002091s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000130s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 73.58% : 0.120286s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.486.576 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d0d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.487.306 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.115128, [30] [bootstrap]: 0.00035291 [type_inference]: 0.0629032 [event_method]: 2.424e-05 [auto_monad]: 7.562e-05 [graph_reusing]: 5.67999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00011442 [rewriter_before_opt_a]: 8.537e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.0466618, [2] [Cycle 1]: 0.00240757, [27] [switch_simplify]: 6.325e-05 [loop_unroll]: 3.004e-05 [a_1]: 0.00058495 [with_stream_mark]: 2.391e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.435e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.29998e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00130696 [add_forward_monad_depend]: 6.94999e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.795e-05 [cse]: 4.101e-05 [replace_applicator]: 1.395e-05 [Cycle 2]: 0.00033016, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 4.94998e-06 [a_1]: 9.075e-05 [with_stream_mark]: 1.173e-05 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 3.23998e-06 [cell_reuse_recompute_pass]: 2.13002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 8.48001e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.40003e-06 [inline_without_move]: 4.84e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.23e-05 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.389e-05 [rewriter_after_opt_a]: 3.803e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00060253 [jit_opt_b]: 4.895e-05, [1] [Cycle 1]: 4.233e-05, [2] [frontend_op_eliminate]: 1.617e-05 [inline_after_opt_a]: 1.561e-05 [cconv]: 2.599e-05 [loop_unroll]: 0.00041631 [jit_opt_after_cconv]: 0.00014023, [1] [Cycle 1]: 0.00013354, [11] [c_1]: 2.011e-05 [parameter_eliminate]: 2.85002e-06 [updatestate_depend_eliminate]: 4.99e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 2.136e-05 [call_graph_tuple_transform]: 1.794e-05 [tuple_list_get_item_eliminator]: 5.10999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.567e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 5.46998e-06 [add_recomputation]: 5.044e-05 [cse_after_recomputation]: 3.295e-05, [1] [Cycle 1]: 1.901e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 3.62e-05 [get_jit_bprop_graph]: 3.13e-06 [rewriter_after_jit_bprop_graph]: 8.95001e-06 [opt_after_jit_grad]: 0.00061521 [symbol_engine_optimizer]: 8.165e-05, [1] [Cycle 1]: 7.297e-05, [6] [build]: 6.19999e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.605e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 7.2e-07 [validate]: 4.855e-05 Sums bootstrap : 0.000353s : 0.52% type_inference : 0.062903s : 92.45% event_method : 0.000024s : 0.04% auto_monad : 0.000076s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000114s : 0.17% rewriter_before_opt_a : 0.000085s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000676s : 0.99% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001307s : 1.92% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000053s : 0.08% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000603s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.000416s : 0.61% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000050s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000036s : 0.05% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000615s : 0.90% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000258 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.16% : 0.000006s : 3: substitution.graph_param_transform 85.53% : 0.000220s : 4: substitution.inline 1.79% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 5.60% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062813 2 97.37% : 0.061163s : 1: type_inference.infer 2.63% : 0.001650s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.92% : 0.000052s : 4: replace.inline 30.08% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.23% : 0.000218s : 4: match.inline 5.77% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.38% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.60% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 2.03% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000940 13 46.63% : 0.000438s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.30% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.06% : 0.000442s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117376 72 0.05% : 0.000053s : 1: add_recomputation 0.07% : 0.000080s : 1: auto_monad 0.04% : 0.000047s : 1: auto_monad_reorder 0.32% : 0.000381s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 2.15% : 0.002519s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 39.76% : 0.046665s : 1: jit_opt_a 0.12% : 0.000143s : 1: jit_opt_after_cconv 0.04% : 0.000051s : 1: jit_opt_b 0.36% : 0.000424s : 1: loop_unroll 0.52% : 0.000611s : 1: mutable_eliminate 0.77% : 0.000901s : 26: opt.transform.jit_opt_a 0.04% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.53% : 0.000625s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000118s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.68% : 0.000803s : 1: renormalize.infer 0.42% : 0.000494s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 53.61% : 0.062929s : 1: type_inference TotalTime = 0.240711, [30] [bootstrap]: 0.00030726 [type_inference]: 0.229088 [event_method]: 2.622e-05 [auto_monad]: 8.557e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.00071832 [rewriter_before_opt_a]: 0.00011259 [expand_dump_flag]: 5.40001e-06 [jit_opt_a]: 0.00790815, [2] [Cycle 1]: 0.00366314, [27] [switch_simplify]: 6.72e-05 [loop_unroll]: 3.126e-05 [a_1]: 0.00062468 [with_stream_mark]: 2.282e-05 [recompute_prepare]: 9.22001e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 7.22997e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 7.83001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 1.114e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 9.92001e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 0.00254974 [add_forward_monad_depend]: 6.36998e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.836e-05 [cse]: 3.231e-05 [replace_applicator]: 1.803e-05 [Cycle 2]: 0.0003731, [27] [switch_simplify]: 6.28e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00011931 [with_stream_mark]: 1.365e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.665e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 6.68e-06 [cse]: 1.278e-05 [replace_applicator]: 6.24999e-06 [py_interpret_to_execute_after_opt_a]: 1.238e-05 [rewriter_after_opt_a]: 3.806e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.62999e-06 [mutable_eliminate]: 0.00067411 [jit_opt_b]: 5.735e-05, [1] [Cycle 1]: 4.82e-05, [2] [frontend_op_eliminate]: 1.838e-05 [inline_after_opt_a]: 1.817e-05 [cconv]: 2.909e-05 [loop_unroll]: 0.00042958 [jit_opt_after_cconv]: 0.00015928, [1] [Cycle 1]: 0.00015215, [11] [c_1]: 2.463e-05 [parameter_eliminate]: 3.70998e-06 [updatestate_depend_eliminate]: 8.82e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.533e-05 [call_graph_tuple_transform]: 2.26e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.97999e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.56998e-06 [environ_conv]: 9.06002e-06 [add_recomputation]: 4.976e-05 [cse_after_recomputation]: 2.11e-05, [1] [Cycle 1]: 1.598e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.725e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.81e-06 [opt_after_jit_grad]: 0.00045669 [symbol_engine_optimizer]: 0.00013201, [1] [Cycle 1]: 0.00012536, [6] [build]: 3.68e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 6.277e-05 [fold_const_symbol]: 1.007e-05 [renormalize]: 5.8001e-07 [validate]: 0.00012029 Sums bootstrap : 0.000307s : 0.13% type_inference : 0.229088s : 96.98% event_method : 0.000026s : 0.01% auto_monad : 0.000086s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000718s : 0.30% rewriter_before_opt_a : 0.000113s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000744s : 0.31% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002550s : 1.08% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000674s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000430s : 0.18% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000457s : 0.19% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000063s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000120s : 0.05% Time group info: ------[substitution.] 0.000258 24 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000007s : 4: substitution.graph_param_transform 85.16% : 0.000219s : 4: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000006s : 4: substitution.remove_not_recompute_node 2.21% : 0.000006s : 2: substitution.replace_old_param 4.74% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.228971 2 92.65% : 0.212151s : 1: type_inference.infer 7.35% : 0.016821s : 1: type_inference.specialize ------[replace.] 0.000083 6 68.26% : 0.000057s : 4: replace.inline 31.74% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 95.15% : 0.000217s : 4: match.inline 4.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000001s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.83% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 2.69% : 0.000003s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.51% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.51% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.63% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002342 22 63.70% : 0.001492s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.29% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.01% : 0.000797s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.244298 72 0.02% : 0.000053s : 1: add_recomputation 0.04% : 0.000089s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.13% : 0.000327s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 3.24% : 0.007912s : 1: jit_opt_a 0.07% : 0.000162s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.18% : 0.000438s : 1: loop_unroll 0.28% : 0.000685s : 1: mutable_eliminate 0.41% : 0.000997s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000091s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000466s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000728s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.74% : 0.001799s : 1: renormalize.infer 0.30% : 0.000740s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.05% : 0.000119s : 1: rewriter_before_opt_a 0.06% : 0.000135s : 1: symbol_engine_optimizer 93.78% : 0.229111s : 1: type_inference TotalTime = 0.07422, [30] [bootstrap]: 0.00044246 [type_inference]: 0.0291459 [event_method]: 2.692e-05 [auto_monad]: 7.894e-05 [graph_reusing]: 0.00086111 [pre_auto_parallel]: 5.86e-06 [py_interpret_to_execute]: 8.136e-05 [rewriter_before_opt_a]: 0.00012646 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.00860183, [2] [Cycle 1]: 0.00263931, [27] [switch_simplify]: 6.802e-05 [loop_unroll]: 3.448e-05 [a_1]: 0.00082793 [with_stream_mark]: 3.291e-05 [recompute_prepare]: 1.177e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 3.14001e-06 [specialize_transform]: 7.82e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.915e-05 [j_node_and_user_rematch]: 4.139e-05 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 1.28e-05 [inline_without_move]: 5.94e-06 [renormalize]: 0.00118318 [add_forward_monad_depend]: 8.80999e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 2.189e-05 [cse]: 4.412e-05 [replace_applicator]: 2.033e-05 [Cycle 2]: 0.0004121, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.30001e-06 [a_1]: 0.00011348 [with_stream_mark]: 1.918e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 4.07998e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.01997e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 5.27001e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 9.30001e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 2.15002e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 1.256e-05 [cse]: 1.859e-05 [replace_applicator]: 6.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.934e-05 [rewriter_after_opt_a]: 4.65e-05 [convert_after_rewriter]: 8.17e-06 [order_py_execute_after_rewriter]: 6.01e-06 [mutable_eliminate]: 0.00099932 [jit_opt_b]: 6.508e-05, [1] [Cycle 1]: 5.327e-05, [2] [frontend_op_eliminate]: 2.119e-05 [inline_after_opt_a]: 1.828e-05 [cconv]: 3.73e-05 [loop_unroll]: 0.0320127 [jit_opt_after_cconv]: 0.00023801, [1] [Cycle 1]: 0.00022345, [11] [c_1]: 3.025e-05 [parameter_eliminate]: 5.97999e-06 [updatestate_depend_eliminate]: 1.381e-05 [updatestate_assign_eliminate]: 4.53999e-06 [updatestate_loads_eliminate]: 3.38e-06 [cse]: 5.644e-05 [call_graph_tuple_transform]: 2.83e-05 [tuple_list_get_item_eliminator]: 6.96001e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 7.19001e-06 [remove_dup_value]: 2.039e-05 [partial_unused_args_eliminate]: 2.91e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 6.572e-05 [cse_after_recomputation]: 3.212e-05, [1] [Cycle 1]: 2.403e-05, [1] [cse]: 1.372e-05 [auto_monad_reorder]: 2.022e-05 [get_jit_bprop_graph]: 2.54999e-06 [rewriter_after_jit_bprop_graph]: 1.212e-05 [opt_after_jit_grad]: 0.00080038 [symbol_engine_optimizer]: 8.859e-05, [1] [Cycle 1]: 7.917e-05, [6] [build]: 5.32001e-06 [elim_shapecalc]: 9.11002e-06 [elim_not_effective]: 1.623e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 1.54e-06 [validate]: 5.579e-05 Sums bootstrap : 0.000442s : 0.65% type_inference : 0.029146s : 42.98% event_method : 0.000027s : 0.04% auto_monad : 0.000079s : 0.12% graph_reusing : 0.000861s : 1.27% pre_auto_parallel : 0.000006s : 0.01% py_interpret_to_execute : 0.000081s : 0.12% rewriter_before_opt_a : 0.000126s : 0.19% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.11% jit_opt_a.loop_unroll : 0.000040s : 0.06% jit_opt_a.a_1 : 0.000941s : 1.39% jit_opt_a.with_stream_mark : 0.000052s : 0.08% jit_opt_a.recompute_prepare : 0.000019s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000050s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001183s : 1.74% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.05% jit_opt_a.cse : 0.000063s : 0.09% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000019s : 0.03% rewriter_after_opt_a : 0.000047s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000999s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000037s : 0.06% loop_unroll : 0.032013s : 47.21% jit_opt_after_cconv.c_1 : 0.000030s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000056s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000066s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.02% opt_after_jit_grad : 0.000800s : 1.18% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000056s : 0.08% Time group info: ------[substitution.] 0.000362 27 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.00% : 0.000007s : 3: substitution.graph_param_transform 83.93% : 0.000304s : 5: substitution.inline 1.31% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.13% : 0.000015s : 3: substitution.reduce_eliminate 1.61% : 0.000006s : 4: substitution.remove_not_recompute_node 2.09% : 0.000008s : 2: substitution.replace_old_param 3.75% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029044 2 95.49% : 0.027734s : 1: type_inference.infer 4.51% : 0.001310s : 1: type_inference.specialize ------[replace.] 0.000117 7 67.76% : 0.000079s : 5: replace.inline 32.24% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000313 7 96.05% : 0.000300s : 5: match.inline 3.95% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 747 1.09% : 0.000002s : 11: predicate.accumulaten_eliminater 1.05% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 11: predicate.addn_check_dump 1.50% : 0.000002s : 11: predicate.addn_zero_filter 2.05% : 0.000003s : 11: predicate.arithmetic_simplify 1.40% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 11: predicate.compare_switch_simplify 1.84% : 0.000003s : 11: predicate.depend_value_elim 0.90% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.26% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.87% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 11: predicate.environ_get_depend_swap 1.11% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.72% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000001s : 3: predicate.graph_param_transform 5.36% : 0.000008s : 24: predicate.inline 0.67% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.13% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 16: predicate.load_eliminater 3.91% : 0.000006s : 3: predicate.loop_unroll_after_grad 3.40% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.90% : 0.000001s : 11: predicate.merge_addn 0.91% : 0.000001s : 11: predicate.minmaximum_grad 3.23% : 0.000005s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 1.92% : 0.000003s : 16: predicate.partial_eliminate 1.32% : 0.000002s : 11: predicate.print_const_string_wrapper 1.83% : 0.000003s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.48% : 0.000002s : 19: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.70% : 0.000003s : 11: predicate.reshape_eliminate 1.01% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 3: predicate.row_tensor_eliminate 1.91% : 0.000003s : 11: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.20% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 0.95% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.02% : 0.000005s : 18: predicate.switch_defer_inline 1.85% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.67% : 0.000010s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.32% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.86% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.32% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001210 16 55.71% : 0.000674s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.05% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.24% : 0.000438s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076705 72 0.09% : 0.000070s : 1: add_recomputation 0.11% : 0.000082s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.62% : 0.000472s : 1: bootstrap 0.05% : 0.000040s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000035s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 1.14% : 0.000876s : 1: graph_reusing 11.22% : 0.008605s : 1: jit_opt_a 0.32% : 0.000243s : 1: jit_opt_after_cconv 0.09% : 0.000068s : 1: jit_opt_b 41.77% : 0.032043s : 1: loop_unroll 1.33% : 0.001018s : 1: mutable_eliminate 1.61% : 0.001234s : 26: opt.transform.jit_opt_a 0.09% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.05% : 0.000038s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000027s : 1: opt.transform.mutable_eliminate 0.04% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.06% : 0.000816s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000010s : 1: pre_auto_parallel 0.11% : 0.000085s : 1: py_interpret_to_execute 0.03% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 0.92% : 0.000704s : 1: renormalize.infer 0.61% : 0.000467s : 1: renormalize.specialize 0.02% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000052s : 1: rewriter_after_opt_a 0.17% : 0.000132s : 1: rewriter_before_opt_a 0.12% : 0.000092s : 1: symbol_engine_optimizer 38.02% : 0.029167s : 1: type_inference TotalTime = 0.0496595, [30] [bootstrap]: 0.0003336 [type_inference]: 0.0408107 [event_method]: 2.051e-05 [auto_monad]: 6.73e-05 [graph_reusing]: 6.87002e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 9.763e-05 [rewriter_before_opt_a]: 8.092e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00556088, [2] [Cycle 1]: 0.00197102, [27] [switch_simplify]: 5.708e-05 [loop_unroll]: 2.96e-05 [a_1]: 0.00055972 [with_stream_mark]: 2.23e-05 [recompute_prepare]: 9.51e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 2.91999e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 9.27999e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00093566 [add_forward_monad_depend]: 7.25e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.621e-05 [cse]: 3.485e-05 [replace_applicator]: 1.592e-05 [Cycle 2]: 0.00035118, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.772e-05 [with_stream_mark]: 1.031e-05 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 2.37001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.77e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 7.66001e-06 [cse]: 1.589e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.362e-05 [rewriter_after_opt_a]: 4.143e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00071576 [jit_opt_b]: 5.784e-05, [1] [Cycle 1]: 4.903e-05, [2] [frontend_op_eliminate]: 1.837e-05 [inline_after_opt_a]: 1.865e-05 [cconv]: 3.062e-05 [loop_unroll]: 0.00056241 [jit_opt_after_cconv]: 0.00017486, [1] [Cycle 1]: 0.00016724, [11] [c_1]: 2.263e-05 [parameter_eliminate]: 4.99998e-06 [updatestate_depend_eliminate]: 9.19e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 3.282e-05 [call_graph_tuple_transform]: 2.412e-05 [tuple_list_get_item_eliminator]: 5.66998e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 4.127e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 7.01999e-06 [add_recomputation]: 5.835e-05 [cse_after_recomputation]: 2.881e-05, [1] [Cycle 1]: 2.247e-05, [1] [cse]: 1.528e-05 [auto_monad_reorder]: 2.118e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 7.58001e-06 [opt_after_jit_grad]: 0.00057668 [symbol_engine_optimizer]: 7.993e-05, [1] [Cycle 1]: 7.215e-05, [6] [build]: 4.62e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.447e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 9.56003e-06 [renormalize]: 7.30011e-07 [validate]: 4.711e-05 Sums bootstrap : 0.000334s : 0.73% type_inference : 0.040811s : 89.13% event_method : 0.000021s : 0.04% auto_monad : 0.000067s : 0.15% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000098s : 0.21% rewriter_before_opt_a : 0.000081s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.14% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000657s : 1.44% jit_opt_a.with_stream_mark : 0.000033s : 0.07% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000936s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000051s : 0.11% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000041s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000716s : 1.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000031s : 0.07% loop_unroll : 0.000562s : 1.23% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000041s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000058s : 0.13% cse_after_recomputation.cse : 0.000015s : 0.03% auto_monad_reorder : 0.000021s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000577s : 1.26% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.10% Time group info: ------[substitution.] 0.000223 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 83.24% : 0.000185s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 6.43% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040742 2 96.72% : 0.039407s : 1: type_inference.infer 3.28% : 0.001336s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.92% : 0.000051s : 4: replace.inline 33.08% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 93.44% : 0.000183s : 4: match.inline 6.56% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.05% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.81% : 0.000007s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 2.35% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 3.01% : 0.000004s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.60% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.60% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000759 13 47.01% : 0.000357s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.62% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.37% : 0.000360s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051552 72 0.12% : 0.000063s : 1: add_recomputation 0.14% : 0.000071s : 1: auto_monad 0.05% : 0.000024s : 1: auto_monad_reorder 0.69% : 0.000353s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.79% : 0.005564s : 1: jit_opt_a 0.34% : 0.000178s : 1: jit_opt_after_cconv 0.12% : 0.000060s : 1: jit_opt_b 1.11% : 0.000575s : 1: loop_unroll 1.41% : 0.000729s : 1: mutable_eliminate 1.71% : 0.000884s : 26: opt.transform.jit_opt_a 0.11% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000021s : 1: opt.transform.mutable_eliminate 0.05% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.14% : 0.000587s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000101s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000044s : 1: remove_dup_value 0.99% : 0.000512s : 1: renormalize.infer 0.80% : 0.000414s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000044s : 1: rewriter_after_opt_a 0.16% : 0.000085s : 1: rewriter_before_opt_a 0.16% : 0.000083s : 1: symbol_engine_optimizer 79.19% : 0.040826s : 1: type_inference TotalTime = 0.0443304, [30] [bootstrap]: 0.00030759 [type_inference]: 0.0313087 [event_method]: 2.294e-05 [auto_monad]: 7.671e-05 [graph_reusing]: 5.86003e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00011795 [rewriter_before_opt_a]: 8.19e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00977226, [2] [Cycle 1]: 0.00542699, [27] [switch_simplify]: 6.223e-05 [loop_unroll]: 2.92e-05 [a_1]: 0.00060565 [with_stream_mark]: 2.605e-05 [recompute_prepare]: 8.86002e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.37998e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00426084 [add_forward_monad_depend]: 1.476e-05 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 2.743e-05 [cse]: 4.088e-05 [replace_applicator]: 2.757e-05 [Cycle 2]: 0.00039127, [27] [switch_simplify]: 7.19001e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00010588 [with_stream_mark]: 1.593e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 4.77e-06 [cell_reuse_recompute_pass]: 2.69001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.941e-05 [j_node_and_user_rematch]: 2.329e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.138e-05 [inline_without_move]: 5.22e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 7.58001e-06 [cse]: 1.468e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.995e-05 [rewriter_after_opt_a]: 4.251e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00089922 [jit_opt_b]: 5.526e-05, [1] [Cycle 1]: 4.63e-05, [2] [frontend_op_eliminate]: 1.733e-05 [inline_after_opt_a]: 1.736e-05 [cconv]: 3.326e-05 [loop_unroll]: 0.00045524 [jit_opt_after_cconv]: 0.00015991, [1] [Cycle 1]: 0.00015313, [11] [c_1]: 2.172e-05 [parameter_eliminate]: 3.51001e-06 [updatestate_depend_eliminate]: 7.97998e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 3.025e-05 [call_graph_tuple_transform]: 1.976e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.85e-05 [partial_unused_args_eliminate]: 2.83e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 5.411e-05 [cse_after_recomputation]: 2.581e-05, [1] [Cycle 1]: 1.949e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 7.18e-06 [opt_after_jit_grad]: 0.00047541 [symbol_engine_optimizer]: 7.645e-05, [1] [Cycle 1]: 6.936e-05, [6] [build]: 4.02e-06 [elim_shapecalc]: 8.90001e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 6.06998e-06 [fold_const_symbol]: 9.46998e-06 [renormalize]: 4.7998e-07 [validate]: 4.475e-05 Sums bootstrap : 0.000308s : 0.78% type_inference : 0.031309s : 78.89% event_method : 0.000023s : 0.06% auto_monad : 0.000077s : 0.19% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000118s : 0.30% rewriter_before_opt_a : 0.000082s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.17% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000712s : 1.79% jit_opt_a.with_stream_mark : 0.000042s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000032s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.004261s : 10.74% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.09% jit_opt_a.cse : 0.000056s : 0.14% jit_opt_a.replace_applicator : 0.000033s : 0.08% py_interpret_to_execute_after_opt_a : 0.000020s : 0.05% rewriter_after_opt_a : 0.000043s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000899s : 2.27% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000033s : 0.08% loop_unroll : 0.000455s : 1.15% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000475s : 1.20% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.11% Time group info: ------[substitution.] 0.000265 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 3: substitution.graph_param_transform 83.94% : 0.000222s : 4: substitution.inline 1.77% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000006s : 4: substitution.remove_not_recompute_node 3.18% : 0.000008s : 2: substitution.replace_old_param 5.22% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031213 2 94.58% : 0.029520s : 1: type_inference.infer 5.42% : 0.001693s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.93% : 0.000053s : 4: replace.inline 31.07% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.52% : 0.000220s : 4: match.inline 5.48% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.04% : 0.000001s : 10: predicate.depend_value_elim 0.95% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.51% : 0.000002s : 10: predicate.environ_get_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.11% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 6: predicate.less_batch_normalization 1.85% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.36% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 1.78% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000002s : 10: predicate.print_const_string_wrapper 1.91% : 0.000003s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.50% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000010s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.45% : 0.000002s : 10: predicate.transpose_eliminate 1.21% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.73% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003916 13 9.75% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 88.79% : 0.003477s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049619 72 0.12% : 0.000057s : 1: add_recomputation 0.16% : 0.000080s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.65% : 0.000322s : 1: bootstrap 0.07% : 0.000036s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.70% : 0.009777s : 1: jit_opt_a 0.37% : 0.000184s : 1: jit_opt_after_cconv 0.12% : 0.000058s : 1: jit_opt_b 0.94% : 0.000465s : 1: loop_unroll 1.83% : 0.000909s : 1: mutable_eliminate 1.97% : 0.000976s : 26: opt.transform.jit_opt_a 0.10% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.98% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000121s : 1: py_interpret_to_execute 0.05% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.43% : 0.000712s : 1: renormalize.infer 7.13% : 0.003537s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.17% : 0.000086s : 1: rewriter_before_opt_a 0.16% : 0.000079s : 1: symbol_engine_optimizer 63.17% : 0.031342s : 1: type_inference TotalTime = 0.179881, [30] [bootstrap]: 0.00023955 [type_inference]: 0.150113 [event_method]: 0.00075398 [auto_monad]: 0.00016666 [graph_reusing]: 8.3e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 0.00010999 [rewriter_before_opt_a]: 0.00014674 [expand_dump_flag]: 4.4e-06 [jit_opt_a]: 0.0259199, [3] [Cycle 1]: 0.0180078, [27] [switch_simplify]: 8.739e-05 [loop_unroll]: 4.88e-05 [a_1]: 0.00115741 [with_stream_mark]: 3.801e-05 [recompute_prepare]: 2.766e-05 [updatestate_depend_eliminate]: 1.115e-05 [updatestate_assign_eliminate]: 7.18e-06 [updatestate_loads_eliminate]: 7.25e-06 [parameter_eliminate]: 3.46999e-06 [specialize_transform]: 1.639e-05 [updatestate_useless_node_eliminater]: 1.355e-05 [accelerated_algorithm]: 1.394e-05 [meta_shard_fg_expand]: 4.04002e-06 [get_grad_eliminate_]: 1.403e-05 [merge_forward]: 1.043e-05 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 7.408e-05 [j_node_and_user_rematch]: 2.829e-05 [meta_fg_expand]: 0.0021603 [replace_old_param]: 7.568e-05 [inline_without_move]: 6.377e-05 [renormalize]: 0.0133949 [add_forward_monad_depend]: 1.313e-05 [auto_monad_grad]: 6.19001e-06 [auto_monad_eliminator]: 6.224e-05 [cse]: 0.00027264 [replace_applicator]: 8.991e-05 [Cycle 2]: 0.00351686, [27] [switch_simplify]: 4.504e-05 [loop_unroll]: 4.296e-05 [a_1]: 0.00120212 [with_stream_mark]: 1.76e-05 [recompute_prepare]: 9.39998e-06 [updatestate_depend_eliminate]: 6.11e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.59002e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.81999e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 5.32001e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.118e-05 [meta_fg_expand]: 0.00010981 [replace_old_param]: 7.83999e-06 [inline_without_move]: 6.26998e-06 [renormalize]: 0.00177163 [add_forward_monad_depend]: 5.24998e-06 [auto_monad_grad]: 1.69e-06 [auto_monad_eliminator]: 1.107e-05 [cse]: 1.961e-05 [replace_applicator]: 1.206e-05 [Cycle 3]: 0.00024021, [27] [switch_simplify]: 4.28001e-06 [loop_unroll]: 3.75e-06 [a_1]: 3.832e-05 [with_stream_mark]: 8.76002e-06 [recompute_prepare]: 3.68999e-06 [updatestate_depend_eliminate]: 2.16e-06 [updatestate_assign_eliminate]: 1.64e-06 [updatestate_loads_eliminate]: 1.50999e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 3.48999e-06 [updatestate_useless_node_eliminater]: 3.13e-06 [accelerated_algorithm]: 3.33998e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 3.07002e-06 [merge_forward]: 1.91e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.56003e-06 [j_node_and_user_rematch]: 5.28002e-06 [meta_fg_expand]: 1.35999e-06 [replace_old_param]: 2.98998e-06 [inline_without_move]: 3.08998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 3.11999e-06 [cse]: 8.90999e-06 [replace_applicator]: 3.36999e-06 [py_interpret_to_execute_after_opt_a]: 1.089e-05 [rewriter_after_opt_a]: 6.34e-05 [convert_after_rewriter]: 6.43e-06 [order_py_execute_after_rewriter]: 4.65999e-06 [mutable_eliminate]: 0.00074463 [jit_opt_b]: 4.101e-05, [1] [Cycle 1]: 3.373e-05, [2] [frontend_op_eliminate]: 1.022e-05 [inline_after_opt_a]: 1.143e-05 [cconv]: 2.492e-05 [loop_unroll]: 0.00041904 [jit_opt_after_cconv]: 0.00012269, [1] [Cycle 1]: 0.00011588, [11] [c_1]: 1.241e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 1.65001e-06 [cse]: 1.696e-05 [call_graph_tuple_transform]: 1.372e-05 [tuple_list_get_item_eliminator]: 4.03999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 3.39001e-06 [remove_dup_value]: 1.436e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 5.39998e-06 [add_recomputation]: 9.821e-05 [cse_after_recomputation]: 2.173e-05, [1] [Cycle 1]: 1.609e-05, [1] [cse]: 9.54e-06 [auto_monad_reorder]: 1.383e-05 [get_jit_bprop_graph]: 1.80001e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.00046159 [symbol_engine_optimizer]: 0.00010143, [1] [Cycle 1]: 6.134e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 6.79999e-06 [elim_not_effective]: 9.46e-06 [opt_reshape]: 3.73001e-06 [fold_const_symbol]: 6.48998e-06 [renormalize]: 4.60015e-07 [validate]: 3.156e-05 Sums bootstrap : 0.000240s : 0.14% type_inference : 0.150113s : 85.90% event_method : 0.000754s : 0.43% auto_monad : 0.000167s : 0.10% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000110s : 0.06% rewriter_before_opt_a : 0.000147s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000137s : 0.08% jit_opt_a.loop_unroll : 0.000096s : 0.05% jit_opt_a.a_1 : 0.002398s : 1.37% jit_opt_a.with_stream_mark : 0.000064s : 0.04% jit_opt_a.recompute_prepare : 0.000041s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000027s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.01% jit_opt_a.accelerated_algorithm : 0.000024s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.01% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000101s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002271s : 1.30% jit_opt_a.replace_old_param : 0.000087s : 0.05% jit_opt_a.inline_without_move : 0.000073s : 0.04% jit_opt_a.renormalize : 0.015167s : 8.68% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.01% jit_opt_a.auto_monad_grad : 0.000008s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000076s : 0.04% jit_opt_a.cse : 0.000301s : 0.17% jit_opt_a.replace_applicator : 0.000105s : 0.06% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000063s : 0.04% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000745s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000025s : 0.01% loop_unroll : 0.000419s : 0.24% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000098s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000462s : 0.26% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.02% Time group info: ------[substitution.] 0.000695 104 0.21% : 0.000001s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.61% : 0.000004s : 1: substitution.graph_param_transform 70.87% : 0.000493s : 13: substitution.inline 2.88% : 0.000020s : 2: substitution.inline_without_move 1.51% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.67% : 0.000012s : 7: substitution.minmaximum_grad 1.21% : 0.000008s : 5: substitution.partial_eliminate 1.42% : 0.000010s : 12: substitution.remove_not_recompute_node 4.55% : 0.000032s : 10: substitution.replace_applicator 0.97% : 0.000007s : 10: substitution.replace_old_param 0.57% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.94% : 0.000006s : 1: substitution.tile_eliminate 3.65% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.27% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.51% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.149909 2 97.47% : 0.146115s : 1: type_inference.infer 2.53% : 0.003794s : 1: type_inference.specialize ------[replace.] 0.000190 20 65.57% : 0.000125s : 13: replace.inline 34.43% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000509 20 95.24% : 0.000485s : 13: match.inline 4.76% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000383 2544 1.56% : 0.000006s : 44: predicate.accumulaten_eliminater 0.28% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 44: predicate.addn_check_dump 1.68% : 0.000006s : 44: predicate.addn_zero_filter 2.49% : 0.000010s : 44: predicate.arithmetic_simplify 1.59% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.45% : 0.000006s : 44: predicate.compare_switch_simplify 1.47% : 0.000006s : 44: predicate.depend_value_elim 1.48% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.57% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.52% : 0.000006s : 44: predicate.environ_get_depend_swap 1.49% : 0.000006s : 44: predicate.environ_get_eliminate 1.40% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.30% : 0.000016s : 66: predicate.inline 1.94% : 0.000007s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.90% : 0.000003s : 17: predicate.less_batch_normalization 1.83% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.89% : 0.000007s : 52: predicate.load_eliminater 0.26% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.55% : 0.000014s : 92: predicate.loop_unroll_before_grad 1.68% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.44% : 0.000006s : 44: predicate.merge_addn 1.50% : 0.000006s : 44: predicate.minmaximum_grad 0.35% : 0.000001s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.32% : 0.000009s : 52: predicate.partial_eliminate 1.50% : 0.000006s : 44: predicate.print_const_string_wrapper 2.06% : 0.000008s : 44: predicate.reduce_eliminate 1.83% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 17: predicate.remove_not_recompute_node 2.70% : 0.000010s : 96: predicate.replace_applicator 1.10% : 0.000004s : 45: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000006s : 44: predicate.reshape_eliminate 1.67% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.13% : 0.000001s : 1: predicate.row_tensor_eliminate 1.67% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.94% : 0.000004s : 17: predicate.specialize_transform 1.88% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000011s : 64: predicate.switch_defer_inline 2.58% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.58% : 0.000025s : 157: predicate.switch_simplify 1.56% : 0.000006s : 44: predicate.tile_eliminate 1.50% : 0.000006s : 44: predicate.transpose_eliminate 1.84% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.93% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.83% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.80% : 0.000011s : 69: predicate.updatestate_useless_node_eliminater 1.94% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.24% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003968 45 75.18% : 0.002983s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.82% : 0.000985s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.198166 87 0.05% : 0.000102s : 1: add_recomputation 0.09% : 0.000176s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.13% : 0.000261s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.39% : 0.000770s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 13.08% : 0.025924s : 1: jit_opt_a 0.06% : 0.000125s : 1: jit_opt_after_cconv 0.02% : 0.000044s : 1: jit_opt_b 0.22% : 0.000427s : 1: loop_unroll 0.38% : 0.000753s : 1: mutable_eliminate 1.58% : 0.003125s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000469s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000114s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 6.56% : 0.013003s : 2: renormalize.infer 1.08% : 0.002144s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000067s : 1: rewriter_after_opt_a 0.08% : 0.000151s : 1: rewriter_before_opt_a 0.05% : 0.000104s : 1: symbol_engine_optimizer 75.77% : 0.150144s : 1: type_inference TotalTime = 0.108907, [30] [bootstrap]: 0.00029896 [type_inference]: 0.0640808 [event_method]: 2.144e-05 [auto_monad]: 7.419e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.58003e-06 [py_interpret_to_execute]: 0.00011254 [rewriter_before_opt_a]: 8.597e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0414807, [2] [Cycle 1]: 0.00253544, [27] [switch_simplify]: 7.031e-05 [loop_unroll]: 3.034e-05 [a_1]: 0.00065013 [with_stream_mark]: 2.636e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 6.50002e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 9.66998e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00137051 [add_forward_monad_depend]: 8.20999e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.743e-05 [cse]: 3.907e-05 [replace_applicator]: 1.69e-05 [Cycle 2]: 0.00033945, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 5.37001e-06 [a_1]: 9.472e-05 [with_stream_mark]: 1.268e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.08002e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.49998e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 2.90002e-06 [cell_reuse_recompute_pass]: 2.59999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 7.78001e-06 [inline_without_move]: 5.14e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 7.06001e-06 [cse]: 1.372e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.825e-05 [rewriter_after_opt_a]: 4.311e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00074609 [jit_opt_b]: 5.406e-05, [1] [Cycle 1]: 4.515e-05, [2] [frontend_op_eliminate]: 1.757e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 3.159e-05 [loop_unroll]: 0.00052528 [jit_opt_after_cconv]: 0.00017196, [1] [Cycle 1]: 0.00016463, [11] [c_1]: 2.265e-05 [parameter_eliminate]: 4.22e-06 [updatestate_depend_eliminate]: 9.52999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.546e-05 [call_graph_tuple_transform]: 2.433e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 1.821e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 7.92e-06 [add_recomputation]: 0.00010971 [cse_after_recomputation]: 2.839e-05, [1] [Cycle 1]: 2.224e-05, [1] [cse]: 1.639e-05 [auto_monad_reorder]: 1.905e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 8.26002e-06 [opt_after_jit_grad]: 0.0006111 [symbol_engine_optimizer]: 7.922e-05, [1] [Cycle 1]: 7.08e-05, [6] [build]: 4.62998e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.462e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 8.82999e-06 [renormalize]: 3.00002e-07 [validate]: 4.936e-05 Sums bootstrap : 0.000299s : 0.43% type_inference : 0.064081s : 91.99% event_method : 0.000021s : 0.03% auto_monad : 0.000074s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000113s : 0.16% rewriter_before_opt_a : 0.000086s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000745s : 1.07% jit_opt_a.with_stream_mark : 0.000039s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001371s : 1.97% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000053s : 0.08% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.03% rewriter_after_opt_a : 0.000043s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000746s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000032s : 0.05% loop_unroll : 0.000525s : 0.75% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000110s : 0.16% cse_after_recomputation.cse : 0.000016s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000611s : 0.88% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000291 23 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000007s : 3: substitution.graph_param_transform 86.70% : 0.000252s : 4: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000005s : 2: substitution.replace_old_param 4.92% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063999 2 97.38% : 0.062321s : 1: type_inference.infer 2.62% : 0.001678s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.14% : 0.000060s : 4: replace.inline 30.86% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 6 94.97% : 0.000249s : 4: match.inline 5.03% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.23% : 0.000002s : 10: predicate.accumulaten_eliminater 1.57% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.88% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.29% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.18% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.72% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 15: predicate.load_eliminater 2.61% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 1.97% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.13% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.95% : 0.000010s : 53: predicate.switch_simplify 1.17% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.25% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.40% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000935 13 41.74% : 0.000390s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.72% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.54% : 0.000482s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111321 72 0.10% : 0.000114s : 1: add_recomputation 0.07% : 0.000078s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.28% : 0.000316s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 37.27% : 0.041484s : 1: jit_opt_a 0.16% : 0.000175s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.48% : 0.000535s : 1: loop_unroll 0.68% : 0.000757s : 1: mutable_eliminate 0.88% : 0.000984s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000622s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000116s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.70% : 0.000774s : 1: renormalize.infer 0.53% : 0.000585s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 57.58% : 0.064103s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.697.887 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c310> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.698.740 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0153309, [30] [bootstrap]: 0.00036574 [type_inference]: 0.00590088 [event_method]: 2.009e-05 [auto_monad]: 7.341e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 4.04e-05 [rewriter_before_opt_a]: 7.78e-05 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00627375, [2] [Cycle 1]: 0.00190663, [27] [switch_simplify]: 6.172e-05 [loop_unroll]: 3.087e-05 [a_1]: 0.00061307 [with_stream_mark]: 2.666e-05 [recompute_prepare]: 1.129e-05 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.95002e-06 [meta_shard_fg_expand]: 2.59001e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 5.84e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.779e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 0.0007863 [add_forward_monad_depend]: 7.48e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 1.695e-05 [cse]: 3.696e-05 [replace_applicator]: 1.562e-05 [Cycle 2]: 0.00036621, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 5.09003e-06 [a_1]: 9.008e-05 [with_stream_mark]: 1.186e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 3.85998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 7.21001e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.22999e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 1.012e-05 [cse]: 1.761e-05 [replace_applicator]: 7.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.616e-05 [rewriter_after_opt_a]: 4.237e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00067003 [jit_opt_b]: 5.413e-05, [1] [Cycle 1]: 4.589e-05, [2] [frontend_op_eliminate]: 1.57e-05 [inline_after_opt_a]: 1.771e-05 [cconv]: 3.048e-05 [loop_unroll]: 0.00052792 [jit_opt_after_cconv]: 0.0001744, [1] [Cycle 1]: 0.00016691, [11] [c_1]: 2.141e-05 [parameter_eliminate]: 4.51002e-06 [updatestate_depend_eliminate]: 8.79e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 3.021e-05 [call_graph_tuple_transform]: 2.36e-05 [tuple_list_get_item_eliminator]: 1.158e-05 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.908e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 7.15e-06 [add_recomputation]: 5.618e-05 [cse_after_recomputation]: 3.144e-05, [1] [Cycle 1]: 2.354e-05, [1] [cse]: 1.355e-05 [auto_monad_reorder]: 1.972e-05 [get_jit_bprop_graph]: 2.75002e-06 [rewriter_after_jit_bprop_graph]: 6.93e-06 [opt_after_jit_grad]: 0.0005565 [symbol_engine_optimizer]: 7.997e-05, [1] [Cycle 1]: 7.215e-05, [6] [build]: 4.18999e-06 [elim_shapecalc]: 8.59002e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 8.59998e-06 [renormalize]: 4.19997e-07 [validate]: 4.522e-05 Sums bootstrap : 0.000366s : 3.43% type_inference : 0.005901s : 55.40% event_method : 0.000020s : 0.19% auto_monad : 0.000073s : 0.69% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000040s : 0.38% rewriter_before_opt_a : 0.000078s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.64% jit_opt_a.loop_unroll : 0.000036s : 0.34% jit_opt_a.a_1 : 0.000703s : 6.60% jit_opt_a.with_stream_mark : 0.000039s : 0.36% jit_opt_a.recompute_prepare : 0.000018s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.11% jit_opt_a.accelerated_algorithm : 0.000013s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000010s : 0.10% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.19% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000786s : 7.38% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.25% jit_opt_a.cse : 0.000055s : 0.51% jit_opt_a.replace_applicator : 0.000023s : 0.22% py_interpret_to_execute_after_opt_a : 0.000016s : 0.15% rewriter_after_opt_a : 0.000042s : 0.40% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000670s : 6.29% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.17% cconv : 0.000030s : 0.29% loop_unroll : 0.000528s : 4.96% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000012s : 0.11% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000056s : 0.53% cse_after_recomputation.cse : 0.000014s : 0.13% auto_monad_reorder : 0.000020s : 0.19% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000556s : 5.22% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.42% Time group info: ------[substitution.] 0.000254 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000007s : 3: substitution.graph_param_transform 84.91% : 0.000215s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 5.48% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005817 2 82.24% : 0.004784s : 1: type_inference.infer 17.76% : 0.001033s : 1: type_inference.specialize ------[replace.] 0.000084 6 65.64% : 0.000055s : 4: replace.inline 34.36% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.59% : 0.000212s : 4: match.inline 5.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.12% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.59% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000007s : 22: predicate.inline 1.11% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.23% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 2.42% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 2.44% : 0.000003s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.68% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.93% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 2.27% : 0.000003s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 10: predicate.same_eliminate 0.83% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.64% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.64% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.65% : 0.000011s : 53: predicate.switch_simplify 1.50% : 0.000002s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000764 13 54.20% : 0.000414s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.88% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.92% : 0.000297s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017126 72 0.35% : 0.000060s : 1: add_recomputation 0.45% : 0.000078s : 1: auto_monad 0.14% : 0.000024s : 1: auto_monad_reorder 2.28% : 0.000390s : 1: bootstrap 0.19% : 0.000033s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.20% : 0.000034s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.65% : 0.006277s : 1: jit_opt_a 1.04% : 0.000178s : 1: jit_opt_after_cconv 0.34% : 0.000057s : 1: jit_opt_b 3.16% : 0.000542s : 1: loop_unroll 3.98% : 0.000681s : 1: mutable_eliminate 5.53% : 0.000946s : 26: opt.transform.jit_opt_a 0.34% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.11% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000019s : 1: opt.transform.mutable_eliminate 0.14% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.31% : 0.000567s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000043s : 1: py_interpret_to_execute 0.11% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000022s : 1: remove_dup_value 2.57% : 0.000441s : 1: renormalize.infer 1.96% : 0.000335s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000047s : 1: rewriter_after_opt_a 0.47% : 0.000081s : 1: rewriter_before_opt_a 0.48% : 0.000082s : 1: symbol_engine_optimizer 34.58% : 0.005922s : 1: type_inference TotalTime = 0.168413, [30] [bootstrap]: 0.00027618 [type_inference]: 0.138981 [event_method]: 0.00056431 [auto_monad]: 0.00012585 [graph_reusing]: 8.08999e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 6.949e-05 [rewriter_before_opt_a]: 0.00014485 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.0257266, [3] [Cycle 1]: 0.0169535, [27] [switch_simplify]: 8.882e-05 [loop_unroll]: 4.901e-05 [a_1]: 0.00117277 [with_stream_mark]: 6.879e-05 [recompute_prepare]: 2.911e-05 [updatestate_depend_eliminate]: 1.182e-05 [updatestate_assign_eliminate]: 7.28999e-06 [updatestate_loads_eliminate]: 6.80002e-06 [parameter_eliminate]: 3.2e-06 [specialize_transform]: 1.531e-05 [updatestate_useless_node_eliminater]: 1.387e-05 [accelerated_algorithm]: 1.508e-05 [meta_shard_fg_expand]: 4.85001e-06 [get_grad_eliminate_]: 1.424e-05 [merge_forward]: 1.076e-05 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.004e-05 [j_node_and_user_rematch]: 2.5e-05 [meta_fg_expand]: 0.00213954 [replace_old_param]: 7.441e-05 [inline_without_move]: 6.949e-05 [renormalize]: 0.0123797 [add_forward_monad_depend]: 1.292e-05 [auto_monad_grad]: 6.41998e-06 [auto_monad_eliminator]: 6.368e-05 [cse]: 0.00026155 [replace_applicator]: 8.997e-05 [Cycle 2]: 0.00392809, [27] [switch_simplify]: 4.469e-05 [loop_unroll]: 4.287e-05 [a_1]: 0.00134632 [with_stream_mark]: 1.636e-05 [recompute_prepare]: 1.063e-05 [updatestate_depend_eliminate]: 5.84999e-06 [updatestate_assign_eliminate]: 4.47e-06 [updatestate_loads_eliminate]: 4.03001e-06 [parameter_eliminate]: 2.43998e-06 [specialize_transform]: 8.64e-06 [updatestate_useless_node_eliminater]: 8.31002e-06 [accelerated_algorithm]: 8.32998e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 8.30999e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.022e-05 [j_node_and_user_rematch]: 1.384e-05 [meta_fg_expand]: 9.944e-05 [replace_old_param]: 9.52001e-06 [inline_without_move]: 7.69002e-06 [renormalize]: 0.00202377 [add_forward_monad_depend]: 6.63e-06 [auto_monad_grad]: 2.06e-06 [auto_monad_eliminator]: 1.133e-05 [cse]: 2.394e-05 [replace_applicator]: 1.464e-05 [Cycle 3]: 0.00025833, [27] [switch_simplify]: 4.78001e-06 [loop_unroll]: 3.71999e-06 [a_1]: 4.083e-05 [with_stream_mark]: 1.169e-05 [recompute_prepare]: 4.13001e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 1.91e-06 [updatestate_loads_eliminate]: 1.48002e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 3.57002e-06 [updatestate_useless_node_eliminater]: 3.26999e-06 [accelerated_algorithm]: 3.38e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 2.99999e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.164e-05 [j_node_and_user_rematch]: 5.77999e-06 [meta_fg_expand]: 1.76998e-06 [replace_old_param]: 3.25998e-06 [inline_without_move]: 3.01999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 4.17e-06 [cse]: 9.12999e-06 [replace_applicator]: 3.41001e-06 [py_interpret_to_execute_after_opt_a]: 1.29e-05 [rewriter_after_opt_a]: 5.816e-05 [convert_after_rewriter]: 6.41998e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00084282 [jit_opt_b]: 4.47e-05, [1] [Cycle 1]: 3.701e-05, [2] [frontend_op_eliminate]: 1.093e-05 [inline_after_opt_a]: 1.258e-05 [cconv]: 2.976e-05 [loop_unroll]: 0.00045369 [jit_opt_after_cconv]: 0.00012922, [1] [Cycle 1]: 0.00012267, [11] [c_1]: 1.239e-05 [parameter_eliminate]: 3.61999e-06 [updatestate_depend_eliminate]: 5.14998e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.814e-05 [call_graph_tuple_transform]: 1.533e-05 [tuple_list_get_item_eliminator]: 4.48999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 3.65e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 5.44998e-06 [add_recomputation]: 3.602e-05 [cse_after_recomputation]: 1.996e-05, [1] [Cycle 1]: 1.485e-05, [1] [cse]: 8.72998e-06 [auto_monad_reorder]: 1.342e-05 [get_jit_bprop_graph]: 2.11998e-06 [rewriter_after_jit_bprop_graph]: 6.39001e-06 [opt_after_jit_grad]: 0.00045398 [symbol_engine_optimizer]: 6.905e-05, [1] [Cycle 1]: 6.323e-05, [6] [build]: 5.32999e-06 [elim_shapecalc]: 6.36e-06 [elim_not_effective]: 1.002e-05 [opt_reshape]: 4.22e-06 [fold_const_symbol]: 6.14001e-06 [renormalize]: 2.30008e-07 [validate]: 6.957e-05 Sums bootstrap : 0.000276s : 0.17% type_inference : 0.138981s : 85.33% event_method : 0.000564s : 0.35% auto_monad : 0.000126s : 0.08% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000069s : 0.04% rewriter_before_opt_a : 0.000145s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000138s : 0.08% jit_opt_a.loop_unroll : 0.000096s : 0.06% jit_opt_a.a_1 : 0.002560s : 1.57% jit_opt_a.with_stream_mark : 0.000097s : 0.06% jit_opt_a.recompute_prepare : 0.000044s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000062s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002241s : 1.38% jit_opt_a.replace_old_param : 0.000087s : 0.05% jit_opt_a.inline_without_move : 0.000080s : 0.05% jit_opt_a.renormalize : 0.014404s : 8.84% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000079s : 0.05% jit_opt_a.cse : 0.000295s : 0.18% jit_opt_a.replace_applicator : 0.000108s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000058s : 0.04% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000843s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000454s : 0.28% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000454s : 0.28% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000070s : 0.04% Time group info: ------[substitution.] 0.000688 107 0.30% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.63% : 0.000004s : 1: substitution.graph_param_transform 67.46% : 0.000464s : 13: substitution.inline 3.23% : 0.000022s : 2: substitution.inline_without_move 1.47% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.79% : 0.000012s : 7: substitution.minmaximum_grad 1.47% : 0.000010s : 5: substitution.partial_eliminate 1.81% : 0.000012s : 13: substitution.remove_not_recompute_node 4.56% : 0.000031s : 10: substitution.replace_applicator 0.95% : 0.000007s : 10: substitution.replace_old_param 1.03% : 0.000007s : 1: substitution.reshape_eliminate 0.66% : 0.000005s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000007s : 1: substitution.tile_eliminate 3.84% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.50% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.16% : 0.000049s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.138853 2 97.45% : 0.135311s : 1: type_inference.infer 2.55% : 0.003542s : 1: type_inference.specialize ------[replace.] 0.000230 20 72.37% : 0.000166s : 13: replace.inline 27.63% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000482 20 94.57% : 0.000455s : 13: match.inline 5.43% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000400 2656 1.68% : 0.000007s : 46: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.43% : 0.000006s : 46: predicate.addn_check_dump 1.61% : 0.000006s : 46: predicate.addn_zero_filter 2.03% : 0.000008s : 46: predicate.arithmetic_simplify 1.54% : 0.000006s : 46: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000006s : 46: predicate.compare_switch_simplify 1.64% : 0.000007s : 46: predicate.depend_value_elim 1.44% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.51% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.37% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.04% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_depend_swap 1.48% : 0.000006s : 46: predicate.environ_get_eliminate 1.41% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.94% : 0.000004s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 1: predicate.graph_param_transform 4.46% : 0.000018s : 68: predicate.inline 2.06% : 0.000008s : 47: predicate.inline_without_move 0.39% : 0.000002s : 19: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 19: predicate.less_batch_normalization 1.80% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 2.03% : 0.000008s : 54: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.54% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.66% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 46: predicate.merge_addn 1.44% : 0.000006s : 46: predicate.minmaximum_grad 0.45% : 0.000002s : 1: predicate.mutable_eliminate 0.18% : 0.000001s : 1: predicate.opt_reshape 2.32% : 0.000009s : 54: predicate.partial_eliminate 1.44% : 0.000006s : 46: predicate.print_const_string_wrapper 2.10% : 0.000008s : 46: predicate.reduce_eliminate 1.77% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 19: predicate.remove_not_recompute_node 2.74% : 0.000011s : 100: predicate.replace_applicator 1.17% : 0.000005s : 47: predicate.replace_old_param 0.08% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 46: predicate.reshape_eliminate 1.61% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.50% : 0.000006s : 46: predicate.same_eliminate 0.57% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.13% : 0.000001s : 2: predicate.special_op_eliminate 0.86% : 0.000003s : 19: predicate.specialize_transform 1.74% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.07% : 0.000012s : 66: predicate.switch_defer_inline 2.49% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.34% : 0.000025s : 161: predicate.switch_simplify 1.69% : 0.000007s : 46: predicate.tile_eliminate 1.55% : 0.000006s : 46: predicate.transpose_eliminate 1.92% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000014s : 55: predicate.tuple_list_get_item_eliminator 1.94% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.72% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004023 45 77.42% : 0.003115s : 28: func_graph_cloner_run.FuncGraphClonerGraph 22.58% : 0.000909s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.186047 87 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000133s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.16% : 0.000306s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.31% : 0.000578s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 13.83% : 0.025730s : 1: jit_opt_a 0.07% : 0.000133s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.25% : 0.000461s : 1: loop_unroll 0.46% : 0.000852s : 1: mutable_eliminate 1.76% : 0.003271s : 39: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000462s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000073s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 6.59% : 0.012254s : 2: renormalize.infer 1.14% : 0.002129s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000076s : 1: rewriter_after_opt_a 0.08% : 0.000148s : 1: rewriter_before_opt_a 0.04% : 0.000072s : 1: symbol_engine_optimizer 74.72% : 0.139007s : 1: type_inference TotalTime = 0.153427, [30] [bootstrap]: 0.00041307 [type_inference]: 0.138158 [event_method]: 2.593e-05 [auto_monad]: 0.0001342 [graph_reusing]: 6.86999e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 0.00054086 [rewriter_before_opt_a]: 0.00011239 [expand_dump_flag]: 4.26001e-06 [jit_opt_a]: 0.0107658, [2] [Cycle 1]: 0.00563281, [27] [switch_simplify]: 8.324e-05 [loop_unroll]: 3.54e-05 [a_1]: 0.00084867 [with_stream_mark]: 2.797e-05 [recompute_prepare]: 1.037e-05 [updatestate_depend_eliminate]: 4.34002e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 7.44002e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.744e-05 [j_node_and_user_rematch]: 1.201e-05 [meta_fg_expand]: 2.87002e-06 [replace_old_param]: 1.193e-05 [inline_without_move]: 6.38998e-06 [renormalize]: 0.00418129 [add_forward_monad_depend]: 1.07e-05 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 2.345e-05 [cse]: 4.54e-05 [replace_applicator]: 2.184e-05 [Cycle 2]: 0.00042972, [27] [switch_simplify]: 7.73999e-06 [loop_unroll]: 6.14999e-06 [a_1]: 0.00014252 [with_stream_mark]: 1.676e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.63003e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 4.68001e-06 [cell_reuse_recompute_pass]: 3.38e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 3.08998e-06 [replace_old_param]: 1.118e-05 [inline_without_move]: 6.46999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 8.90001e-06 [cse]: 1.685e-05 [replace_applicator]: 6.81001e-06 [py_interpret_to_execute_after_opt_a]: 1.902e-05 [rewriter_after_opt_a]: 4.911e-05 [convert_after_rewriter]: 8.13001e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.00101625 [jit_opt_b]: 0.00010006, [1] [Cycle 1]: 9.099e-05, [2] [frontend_op_eliminate]: 5.703e-05 [inline_after_opt_a]: 2.033e-05 [cconv]: 3.82e-05 [loop_unroll]: 0.00051533 [jit_opt_after_cconv]: 0.00019592, [1] [Cycle 1]: 0.00018862, [11] [c_1]: 2.701e-05 [parameter_eliminate]: 5.13002e-06 [updatestate_depend_eliminate]: 9.07001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 4.022e-05 [call_graph_tuple_transform]: 2.77e-05 [tuple_list_get_item_eliminator]: 7.16999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 2.199e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 1.053e-05 [add_recomputation]: 5.952e-05 [cse_after_recomputation]: 3.218e-05, [1] [Cycle 1]: 2.365e-05, [1] [cse]: 1.603e-05 [auto_monad_reorder]: 2.068e-05 [get_jit_bprop_graph]: 2.64001e-06 [rewriter_after_jit_bprop_graph]: 8.90999e-06 [opt_after_jit_grad]: 0.00056037 [symbol_engine_optimizer]: 9.393e-05, [1] [Cycle 1]: 8.609e-05, [6] [build]: 5.99999e-06 [elim_shapecalc]: 1.364e-05 [elim_not_effective]: 1.66e-05 [opt_reshape]: 6.59001e-06 [fold_const_symbol]: 1.342e-05 [renormalize]: 6.19999e-07 [validate]: 0.00027093 Sums bootstrap : 0.000413s : 0.28% type_inference : 0.138158s : 93.36% event_method : 0.000026s : 0.02% auto_monad : 0.000134s : 0.09% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000541s : 0.37% rewriter_before_opt_a : 0.000112s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000991s : 0.67% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004181s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000062s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000049s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001016s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000057s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000038s : 0.03% loop_unroll : 0.000515s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000560s : 0.38% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000271s : 0.18% Time group info: ------[substitution.] 0.000385 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 1.37% : 0.000005s : 2: substitution.fold_const_symbol 1.89% : 0.000007s : 4: substitution.graph_param_transform 85.19% : 0.000328s : 5: substitution.inline 1.14% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.67% : 0.000014s : 3: substitution.reduce_eliminate 1.50% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000007s : 2: substitution.replace_old_param 2.72% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.138061 2 97.52% : 0.134633s : 1: type_inference.infer 2.48% : 0.003428s : 1: type_inference.specialize ------[replace.] 0.000135 7 68.05% : 0.000092s : 5: replace.inline 31.95% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000334 7 97.23% : 0.000324s : 5: match.inline 2.77% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.70% : 0.000003s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.16% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 4.94% : 0.000008s : 28: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.33% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 2.03% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 3.04% : 0.000005s : 4: predicate.mutable_eliminate 0.72% : 0.000001s : 4: predicate.opt_reshape 1.96% : 0.000003s : 19: predicate.partial_eliminate 1.50% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000004s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.61% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.80% : 0.000011s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.53% : 0.000002s : 13: predicate.transpose_eliminate 1.67% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.26% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.57% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.95% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003248 25 67.01% : 0.002176s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.27% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.72% : 0.000965s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158782 72 0.04% : 0.000062s : 1: add_recomputation 0.09% : 0.000139s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.28% : 0.000437s : 1: bootstrap 0.03% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.78% : 0.010771s : 1: jit_opt_a 0.13% : 0.000199s : 1: jit_opt_after_cconv 0.07% : 0.000103s : 1: jit_opt_b 0.33% : 0.000525s : 1: loop_unroll 0.65% : 0.001031s : 1: mutable_eliminate 0.81% : 0.001280s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000071s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000570s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000550s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 1.96% : 0.003120s : 1: renormalize.infer 0.66% : 0.001049s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.07% : 0.000119s : 1: rewriter_before_opt_a 0.06% : 0.000096s : 1: symbol_engine_optimizer 87.03% : 0.138180s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.883.388 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00650d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:29.884.226 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0199122, [30] [bootstrap]: 0.000335 [type_inference]: 0.00916024 [event_method]: 1.828e-05 [auto_monad]: 6.577e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 3.582e-05 [rewriter_before_opt_a]: 7.472e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.006507, [2] [Cycle 1]: 0.00170923, [27] [switch_simplify]: 5.735e-05 [loop_unroll]: 2.865e-05 [a_1]: 0.00054209 [with_stream_mark]: 2.101e-05 [recompute_prepare]: 6.86001e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.37002e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.13998e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.84003e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 5.36998e-06 [renormalize]: 0.00071961 [add_forward_monad_depend]: 5.07999e-06 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 1.465e-05 [cse]: 3.32e-05 [replace_applicator]: 1.198e-05 [Cycle 2]: 0.0003186, [27] [switch_simplify]: 5.34e-06 [loop_unroll]: 5.02e-06 [a_1]: 8.776e-05 [with_stream_mark]: 8.37998e-06 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 2.75997e-06 [updatestate_assign_eliminate]: 2.18998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.00999e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.202e-05 [j_node_and_user_rematch]: 7.47002e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 6.86999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.48002e-06 [cse]: 1.189e-05 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.272e-05 [rewriter_after_opt_a]: 3.608e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00051443 [jit_opt_b]: 4.901e-05, [1] [Cycle 1]: 4.142e-05, [2] [frontend_op_eliminate]: 1.485e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 2.55e-05 [loop_unroll]: 0.00069306 [jit_opt_after_cconv]: 0.00015315, [1] [Cycle 1]: 0.0001468, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 5.64998e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.237e-05 [call_graph_tuple_transform]: 1.864e-05 [tuple_list_get_item_eliminator]: 5.48002e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.569e-05 [partial_unused_args_eliminate]: 2.11003e-06 [environ_conv]: 5.98002e-06 [add_recomputation]: 5.255e-05 [cse_after_recomputation]: 2.263e-05, [1] [Cycle 1]: 1.734e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.66002e-06 [opt_after_jit_grad]: 0.00178321 [symbol_engine_optimizer]: 7.745e-05, [1] [Cycle 1]: 6.979e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 8.39998e-06 [renormalize]: 7.50006e-07 [validate]: 4.137e-05 Sums bootstrap : 0.000335s : 2.26% type_inference : 0.009160s : 61.81% event_method : 0.000018s : 0.12% auto_monad : 0.000066s : 0.44% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000036s : 0.24% rewriter_before_opt_a : 0.000075s : 0.50% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.42% jit_opt_a.loop_unroll : 0.000034s : 0.23% jit_opt_a.a_1 : 0.000630s : 4.25% jit_opt_a.with_stream_mark : 0.000029s : 0.20% jit_opt_a.recompute_prepare : 0.000012s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000720s : 4.86% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.14% jit_opt_a.cse : 0.000045s : 0.30% jit_opt_a.replace_applicator : 0.000017s : 0.11% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000036s : 0.24% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000514s : 3.47% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.10% jit_opt_b.inline_after_opt_a : 0.000015s : 0.10% cconv : 0.000025s : 0.17% loop_unroll : 0.000693s : 4.68% jit_opt_after_cconv.c_1 : 0.000021s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000053s : 0.35% cse_after_recomputation.cse : 0.000011s : 0.08% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.001783s : 12.03% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.28% Time group info: ------[substitution.] 0.000219 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000005s : 3: substitution.graph_param_transform 84.79% : 0.000186s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 6.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009087 2 90.85% : 0.008256s : 1: type_inference.infer 9.15% : 0.000831s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.19% : 0.000047s : 4: replace.inline 31.81% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 93.70% : 0.000184s : 4: match.inline 6.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.89% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.39% : 0.000002s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.45% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.69% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000657 13 54.83% : 0.000360s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.19% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.98% : 0.000250s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021524 72 0.26% : 0.000055s : 1: add_recomputation 0.32% : 0.000069s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.64% : 0.000353s : 1: bootstrap 0.13% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.11% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.24% : 0.006510s : 1: jit_opt_a 0.72% : 0.000156s : 1: jit_opt_after_cconv 0.24% : 0.000051s : 1: jit_opt_b 3.26% : 0.000702s : 1: loop_unroll 2.43% : 0.000523s : 1: mutable_eliminate 3.90% : 0.000839s : 26: opt.transform.jit_opt_a 0.22% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000032s : 4: opt.transform.symbol_engine_opt 8.34% : 0.001796s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000038s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000018s : 1: remove_dup_value 1.96% : 0.000421s : 1: renormalize.infer 1.35% : 0.000290s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000039s : 1: rewriter_after_opt_a 0.36% : 0.000077s : 1: rewriter_before_opt_a 0.38% : 0.000081s : 1: symbol_engine_optimizer 42.65% : 0.009179s : 1: type_inference TotalTime = 0.0361103, [30] [bootstrap]: 0.00034447 [type_inference]: 0.0273057 [event_method]: 1.934e-05 [auto_monad]: 6.911e-05 [graph_reusing]: 6.98998e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 9.507e-05 [rewriter_before_opt_a]: 7.87e-05 [expand_dump_flag]: 3.10002e-06 [jit_opt_a]: 0.00600893, [2] [Cycle 1]: 0.00219562, [27] [switch_simplify]: 5.423e-05 [loop_unroll]: 2.863e-05 [a_1]: 0.00082403 [with_stream_mark]: 1.944e-05 [recompute_prepare]: 8.70001e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 0.00093071 [add_forward_monad_depend]: 5.72001e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.471e-05 [cse]: 3.275e-05 [replace_applicator]: 1.287e-05 [Cycle 2]: 0.00034629, [27] [switch_simplify]: 5.91998e-06 [loop_unroll]: 5.23002e-06 [a_1]: 8.667e-05 [with_stream_mark]: 8.87e-06 [recompute_prepare]: 5.26998e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 8.23999e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 7.15998e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.89999e-06 [cse]: 1.479e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 1.355e-05 [rewriter_after_opt_a]: 3.824e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00058065 [jit_opt_b]: 4.87e-05, [1] [Cycle 1]: 4.183e-05, [2] [frontend_op_eliminate]: 1.585e-05 [inline_after_opt_a]: 1.57e-05 [cconv]: 2.824e-05 [loop_unroll]: 0.00042218 [jit_opt_after_cconv]: 0.00014375, [1] [Cycle 1]: 0.00013763, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 3.23998e-06 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.306e-05 [call_graph_tuple_transform]: 1.903e-05 [tuple_list_get_item_eliminator]: 5.14e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.538e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.00002e-06 [add_recomputation]: 5.088e-05 [cse_after_recomputation]: 2.554e-05, [1] [Cycle 1]: 2.011e-05, [1] [cse]: 1.397e-05 [auto_monad_reorder]: 1.945e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 5.65001e-06 [opt_after_jit_grad]: 0.00045696 [symbol_engine_optimizer]: 7.085e-05, [1] [Cycle 1]: 6.485e-05, [6] [build]: 3.85e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.263e-05 [opt_reshape]: 5.58997e-06 [fold_const_symbol]: 8.33001e-06 [renormalize]: 5.99975e-07 [validate]: 4.079e-05 Sums bootstrap : 0.000344s : 1.08% type_inference : 0.027306s : 85.26% event_method : 0.000019s : 0.06% auto_monad : 0.000069s : 0.22% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000095s : 0.30% rewriter_before_opt_a : 0.000079s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.19% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000911s : 2.84% jit_opt_a.with_stream_mark : 0.000028s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000931s : 2.91% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000048s : 0.15% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000038s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000581s : 1.81% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000028s : 0.09% loop_unroll : 0.000422s : 1.32% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000457s : 1.43% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.13% Time group info: ------[substitution.] 0.000312 23 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.65% : 0.000005s : 3: substitution.graph_param_transform 89.16% : 0.000278s : 4: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.50% : 0.000005s : 4: substitution.remove_not_recompute_node 1.27% : 0.000004s : 2: substitution.replace_old_param 4.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027235 2 94.66% : 0.025780s : 1: type_inference.infer 5.34% : 0.001455s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.87% : 0.000048s : 4: replace.inline 31.13% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 6 95.88% : 0.000275s : 4: match.inline 4.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.36% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.71% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.40% : 0.000002s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.36% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.19% : 0.000008s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.12% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 13 49.00% : 0.000393s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.50% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.50% : 0.000365s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038201 72 0.14% : 0.000054s : 1: add_recomputation 0.19% : 0.000073s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.96% : 0.000366s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.74% : 0.006012s : 1: jit_opt_a 0.38% : 0.000146s : 1: jit_opt_after_cconv 0.13% : 0.000051s : 1: jit_opt_b 1.13% : 0.000430s : 1: loop_unroll 1.54% : 0.000590s : 1: mutable_eliminate 2.94% : 0.001124s : 26: opt.transform.jit_opt_a 0.12% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.22% : 0.000466s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000099s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.51% : 0.000578s : 1: renormalize.infer 0.90% : 0.000345s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000041s : 1: rewriter_after_opt_a 0.22% : 0.000083s : 1: rewriter_before_opt_a 0.19% : 0.000073s : 1: symbol_engine_optimizer 71.52% : 0.027323s : 1: type_inference TotalTime = 0.447969, [30] [bootstrap]: 0.00035908 [type_inference]: 0.434474 [event_method]: 2.652e-05 [auto_monad]: 7.696e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00046093 [rewriter_before_opt_a]: 0.00010066 [expand_dump_flag]: 3.78999e-06 [jit_opt_a]: 0.0100673, [2] [Cycle 1]: 0.0057518, [27] [switch_simplify]: 6.346e-05 [loop_unroll]: 3.426e-05 [a_1]: 0.00069108 [with_stream_mark]: 2.061e-05 [recompute_prepare]: 8.88002e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 3.82002e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.629e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00456281 [add_forward_monad_depend]: 8.06001e-06 [auto_monad_grad]: 3.31001e-06 [auto_monad_eliminator]: 2.04e-05 [cse]: 3.728e-05 [replace_applicator]: 1.94e-05 [Cycle 2]: 0.00037824, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012442 [with_stream_mark]: 1.289e-05 [recompute_prepare]: 5.91998e-06 [updatestate_depend_eliminate]: 3.70003e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.55002e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.88998e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 2.23998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.585e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.74999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.397e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.532e-05 [rewriter_after_opt_a]: 4.22e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00072724 [jit_opt_b]: 5.718e-05, [1] [Cycle 1]: 4.9e-05, [2] [frontend_op_eliminate]: 1.974e-05 [inline_after_opt_a]: 1.806e-05 [cconv]: 3e-05 [loop_unroll]: 0.00043424 [jit_opt_after_cconv]: 0.00015529, [1] [Cycle 1]: 0.00014833, [11] [c_1]: 2.562e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 6.81001e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.439e-05 [call_graph_tuple_transform]: 2.134e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 8.11002e-06 [add_recomputation]: 5.091e-05 [cse_after_recomputation]: 2.339e-05, [1] [Cycle 1]: 1.826e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.876e-05 [get_jit_bprop_graph]: 2.45002e-06 [rewriter_after_jit_bprop_graph]: 4.88001e-06 [opt_after_jit_grad]: 0.00046241 [symbol_engine_optimizer]: 7.608e-05, [1] [Cycle 1]: 6.97e-05, [6] [build]: 3.67998e-06 [elim_shapecalc]: 9.09e-06 [elim_not_effective]: 1.38e-05 [opt_reshape]: 6.75002e-06 [fold_const_symbol]: 9.21002e-06 [renormalize]: 3.89991e-07 [validate]: 4.675e-05 Sums bootstrap : 0.000359s : 0.08% type_inference : 0.434474s : 97.98% event_method : 0.000027s : 0.01% auto_monad : 0.000077s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000461s : 0.10% rewriter_before_opt_a : 0.000101s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.02% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000815s : 0.18% jit_opt_a.with_stream_mark : 0.000033s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004563s : 1.03% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000051s : 0.01% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.16% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000030s : 0.01% loop_unroll : 0.000434s : 0.10% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000051s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000462s : 0.10% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.01% Time group info: ------[substitution.] 0.000264 25 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 4: substitution.graph_param_transform 85.99% : 0.000227s : 5: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.434379 2 99.31% : 0.431365s : 1: type_inference.infer 0.69% : 0.003014s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.01% : 0.000067s : 5: replace.inline 32.99% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000236 7 94.88% : 0.000224s : 5: match.inline 5.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 1.81% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 5.68% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000001s : 13: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.48% : 0.000004s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.78% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 23: predicate.replace_applicator 0.99% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.64% : 0.000011s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002730 25 63.77% : 0.001741s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.02% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.21% : 0.000907s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.453664 72 0.01% : 0.000054s : 1: add_recomputation 0.02% : 0.000082s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.08% : 0.000380s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.22% : 0.010071s : 1: jit_opt_a 0.03% : 0.000158s : 1: jit_opt_after_cconv 0.01% : 0.000060s : 1: jit_opt_b 0.10% : 0.000442s : 1: loop_unroll 0.16% : 0.000737s : 1: mutable_eliminate 0.24% : 0.001069s : 26: opt.transform.jit_opt_a 0.01% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000470s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000467s : 1: py_interpret_to_execute 0.00% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 0.80% : 0.003643s : 1: renormalize.infer 0.20% : 0.000907s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000045s : 1: rewriter_after_opt_a 0.02% : 0.000106s : 1: rewriter_before_opt_a 0.02% : 0.000079s : 1: symbol_engine_optimizer 95.78% : 0.434504s : 1: type_inference TotalTime = 0.0198279, [30] [bootstrap]: 0.00034338 [type_inference]: 0.00934511 [event_method]: 2.296e-05 [auto_monad]: 7.218e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 5.839e-05 [rewriter_before_opt_a]: 8.243e-05 [expand_dump_flag]: 2.76e-06 [jit_opt_a]: 0.00744019, [2] [Cycle 1]: 0.00353081, [27] [switch_simplify]: 6.24e-05 [loop_unroll]: 3.342e-05 [a_1]: 0.00067635 [with_stream_mark]: 2.107e-05 [recompute_prepare]: 7.83001e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 9.89999e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 6.03998e-06 [renormalize]: 0.00237299 [add_forward_monad_depend]: 7.31999e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.815e-05 [cse]: 3.499e-05 [replace_applicator]: 1.633e-05 [Cycle 2]: 0.00035017, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.12e-06 [a_1]: 0.0001057 [with_stream_mark]: 1.309e-05 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 3.04999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.04003e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.285e-05 [replace_applicator]: 5.39998e-06 [py_interpret_to_execute_after_opt_a]: 1.541e-05 [rewriter_after_opt_a]: 3.822e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00073406 [jit_opt_b]: 5.463e-05, [1] [Cycle 1]: 4.628e-05, [2] [frontend_op_eliminate]: 1.775e-05 [inline_after_opt_a]: 1.693e-05 [cconv]: 2.836e-05 [loop_unroll]: 0.00044618 [jit_opt_after_cconv]: 0.00019016, [1] [Cycle 1]: 0.00018304, [11] [c_1]: 2.274e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 6.92002e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 3.767e-05 [call_graph_tuple_transform]: 2.175e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.773e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 5.552e-05 [cse_after_recomputation]: 2.522e-05, [1] [Cycle 1]: 1.908e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 6.52001e-06 [opt_after_jit_grad]: 0.00048598 [symbol_engine_optimizer]: 7.857e-05, [1] [Cycle 1]: 7.205e-05, [6] [build]: 3.63999e-06 [elim_shapecalc]: 8.44002e-06 [elim_not_effective]: 1.497e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 9.57999e-06 [renormalize]: 3.80009e-07 [validate]: 4.272e-05 Sums bootstrap : 0.000343s : 2.20% type_inference : 0.009345s : 59.81% event_method : 0.000023s : 0.15% auto_monad : 0.000072s : 0.46% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000058s : 0.37% rewriter_before_opt_a : 0.000082s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.44% jit_opt_a.loop_unroll : 0.000039s : 0.25% jit_opt_a.a_1 : 0.000782s : 5.00% jit_opt_a.with_stream_mark : 0.000034s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.002373s : 15.19% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000048s : 0.31% jit_opt_a.replace_applicator : 0.000022s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000038s : 0.24% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000734s : 4.70% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000028s : 0.18% loop_unroll : 0.000446s : 2.86% jit_opt_after_cconv.c_1 : 0.000023s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000038s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000018s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000056s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000017s : 0.11% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000486s : 3.11% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.27% Time group info: ------[substitution.] 0.000283 27 0.89% : 0.000003s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 83.82% : 0.000237s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.71% : 0.000010s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000005s : 2: substitution.replace_old_param 3.94% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009263 2 79.26% : 0.007342s : 1: type_inference.infer 20.74% : 0.001921s : 1: type_inference.specialize ------[replace.] 0.000095 7 68.06% : 0.000065s : 5: replace.inline 31.94% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 7 95.86% : 0.000234s : 5: match.inline 4.14% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 2.25% : 0.000003s : 11: predicate.arithmetic_simplify 1.39% : 0.000002s : 11: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 11: predicate.compare_switch_simplify 1.17% : 0.000002s : 11: predicate.depend_value_elim 1.08% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.35% : 0.000002s : 11: predicate.environ_get_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 2.46% : 0.000003s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.43% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.68% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000009s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.53% : 0.000002s : 11: predicate.transpose_eliminate 1.72% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 2.03% : 0.000003s : 11: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000949 16 47.49% : 0.000450s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.44% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.07% : 0.000418s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023268 72 0.25% : 0.000059s : 1: add_recomputation 0.32% : 0.000076s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.56% : 0.000364s : 1: bootstrap 0.13% : 0.000031s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 32.00% : 0.007445s : 1: jit_opt_a 0.83% : 0.000194s : 1: jit_opt_after_cconv 0.25% : 0.000057s : 1: jit_opt_b 1.95% : 0.000454s : 1: loop_unroll 3.20% : 0.000744s : 1: mutable_eliminate 4.35% : 0.001013s : 26: opt.transform.jit_opt_a 0.23% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.13% : 0.000495s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000061s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000020s : 1: remove_dup_value 8.07% : 0.001877s : 1: renormalize.infer 2.09% : 0.000486s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000041s : 1: rewriter_after_opt_a 0.37% : 0.000085s : 1: rewriter_before_opt_a 0.35% : 0.000081s : 1: symbol_engine_optimizer 40.24% : 0.009364s : 1: type_inference TotalTime = 0.129551, [30] [bootstrap]: 0.0002747 [type_inference]: 0.0925597 [event_method]: 0.00034569 [auto_monad]: 0.00011328 [graph_reusing]: 8.92999e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 4.222e-05 [rewriter_before_opt_a]: 0.00013406 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0337497, [3] [Cycle 1]: 0.0224874, [27] [switch_simplify]: 8.703e-05 [loop_unroll]: 4.794e-05 [a_1]: 0.00121396 [with_stream_mark]: 4.051e-05 [recompute_prepare]: 2.317e-05 [updatestate_depend_eliminate]: 9.87999e-06 [updatestate_assign_eliminate]: 7.58001e-06 [updatestate_loads_eliminate]: 6.81999e-06 [parameter_eliminate]: 2.97002e-06 [specialize_transform]: 1.561e-05 [updatestate_useless_node_eliminater]: 1.362e-05 [accelerated_algorithm]: 1.433e-05 [meta_shard_fg_expand]: 3.85e-06 [get_grad_eliminate_]: 1.393e-05 [merge_forward]: 9.28002e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.939e-05 [j_node_and_user_rematch]: 2.47e-05 [meta_fg_expand]: 0.00195538 [replace_old_param]: 7.82e-05 [inline_without_move]: 6.493e-05 [renormalize]: 0.0180467 [add_forward_monad_depend]: 1.254e-05 [auto_monad_grad]: 6.83e-06 [auto_monad_eliminator]: 6.572e-05 [cse]: 0.00029233 [replace_applicator]: 9.523e-05 [Cycle 2]: 0.00473263, [27] [switch_simplify]: 4.484e-05 [loop_unroll]: 4.467e-05 [a_1]: 0.00123683 [with_stream_mark]: 1.936e-05 [recompute_prepare]: 1.209e-05 [updatestate_depend_eliminate]: 5.29998e-06 [updatestate_assign_eliminate]: 4.56002e-06 [updatestate_loads_eliminate]: 4.23001e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 9.37001e-06 [updatestate_useless_node_eliminater]: 9.27001e-06 [accelerated_algorithm]: 9.69999e-06 [meta_shard_fg_expand]: 2.97002e-06 [get_grad_eliminate_]: 9.71e-06 [merge_forward]: 5.52001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.146e-05 [j_node_and_user_rematch]: 1.48e-05 [meta_fg_expand]: 0.0001096 [replace_old_param]: 9.42001e-06 [inline_without_move]: 8.05e-06 [renormalize]: 0.0028834 [add_forward_monad_depend]: 7.83001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.429e-05 [cse]: 2.678e-05 [replace_applicator]: 1.836e-05 [Cycle 3]: 0.00026562, [27] [switch_simplify]: 4.50001e-06 [loop_unroll]: 3.66001e-06 [a_1]: 4.635e-05 [with_stream_mark]: 1.427e-05 [recompute_prepare]: 3.36999e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 1.67001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 3.38e-06 [updatestate_useless_node_eliminater]: 3.28998e-06 [accelerated_algorithm]: 3.56999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 3.06999e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.344e-05 [j_node_and_user_rematch]: 6.02999e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 3.36001e-06 [inline_without_move]: 2.91e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 3.74002e-06 [cse]: 7.68999e-06 [replace_applicator]: 3.45e-06 [py_interpret_to_execute_after_opt_a]: 1.393e-05 [rewriter_after_opt_a]: 3.374e-05 [convert_after_rewriter]: 6.29999e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00074433 [jit_opt_b]: 4.101e-05, [1] [Cycle 1]: 3.402e-05, [2] [frontend_op_eliminate]: 1.152e-05 [inline_after_opt_a]: 1.112e-05 [cconv]: 2.58e-05 [loop_unroll]: 0.00044402 [jit_opt_after_cconv]: 0.00014555, [1] [Cycle 1]: 0.00013949, [11] [c_1]: 1.281e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 1.66e-06 [updatestate_loads_eliminate]: 1.47999e-06 [cse]: 2.006e-05 [call_graph_tuple_transform]: 2.95e-05 [tuple_list_get_item_eliminator]: 3.89002e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 4.27e-06 [remove_dup_value]: 1.505e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 5.17999e-06 [add_recomputation]: 3.705e-05 [cse_after_recomputation]: 2.088e-05, [1] [Cycle 1]: 1.455e-05, [1] [cse]: 8.38001e-06 [auto_monad_reorder]: 1.371e-05 [get_jit_bprop_graph]: 1.74998e-06 [rewriter_after_jit_bprop_graph]: 6.25002e-06 [opt_after_jit_grad]: 0.00045423 [symbol_engine_optimizer]: 6.63e-05, [1] [Cycle 1]: 6.053e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 6.01e-06 [elim_not_effective]: 1.175e-05 [opt_reshape]: 4e-06 [fold_const_symbol]: 6.50002e-06 [renormalize]: 4.80009e-07 [validate]: 3.115e-05 Sums bootstrap : 0.000275s : 0.22% type_inference : 0.092560s : 75.66% event_method : 0.000346s : 0.28% auto_monad : 0.000113s : 0.09% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.03% rewriter_before_opt_a : 0.000134s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000136s : 0.11% jit_opt_a.loop_unroll : 0.000096s : 0.08% jit_opt_a.a_1 : 0.002497s : 2.04% jit_opt_a.with_stream_mark : 0.000074s : 0.06% jit_opt_a.recompute_prepare : 0.000039s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.04% jit_opt_a.meta_fg_expand : 0.002066s : 1.69% jit_opt_a.replace_old_param : 0.000091s : 0.07% jit_opt_a.inline_without_move : 0.000076s : 0.06% jit_opt_a.renormalize : 0.020930s : 17.11% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000084s : 0.07% jit_opt_a.cse : 0.000327s : 0.27% jit_opt_a.replace_applicator : 0.000117s : 0.10% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000744s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000444s : 0.36% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000454s : 0.37% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.03% Time group info: ------[substitution.] 0.000626 107 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.30% : 0.000002s : 1: substitution.fold_const_symbol 0.70% : 0.000004s : 1: substitution.graph_param_transform 66.46% : 0.000416s : 13: substitution.inline 3.38% : 0.000021s : 2: substitution.inline_without_move 1.60% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.84% : 0.000012s : 7: substitution.minmaximum_grad 1.23% : 0.000008s : 5: substitution.partial_eliminate 1.77% : 0.000011s : 13: substitution.remove_not_recompute_node 5.20% : 0.000033s : 10: substitution.replace_applicator 1.24% : 0.000008s : 10: substitution.replace_old_param 1.04% : 0.000007s : 1: substitution.reshape_eliminate 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000006s : 1: substitution.tile_eliminate 3.75% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.68% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.09% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.092395 2 97.18% : 0.089793s : 1: type_inference.infer 2.82% : 0.002602s : 1: type_inference.specialize ------[replace.] 0.000189 20 66.46% : 0.000126s : 13: replace.inline 33.54% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000430 20 94.94% : 0.000409s : 13: match.inline 5.06% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000399 2768 1.57% : 0.000006s : 48: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.42% : 0.000006s : 48: predicate.addn_check_dump 1.62% : 0.000006s : 48: predicate.addn_zero_filter 2.27% : 0.000009s : 48: predicate.arithmetic_simplify 1.64% : 0.000007s : 48: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.44% : 0.000006s : 48: predicate.compare_switch_simplify 1.55% : 0.000006s : 48: predicate.depend_value_elim 1.44% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.43% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.42% : 0.000006s : 48: predicate.environ_get_depend_swap 1.51% : 0.000006s : 48: predicate.environ_get_eliminate 1.39% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.85% : 0.000003s : 20: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.19% : 0.000017s : 70: predicate.inline 2.02% : 0.000008s : 48: predicate.inline_without_move 0.36% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.25% : 0.000005s : 20: predicate.less_batch_normalization 1.82% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.95% : 0.000008s : 56: predicate.load_eliminater 0.34% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.46% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.71% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.41% : 0.000006s : 48: predicate.merge_addn 1.48% : 0.000006s : 48: predicate.minmaximum_grad 0.44% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.39% : 0.000010s : 56: predicate.partial_eliminate 1.55% : 0.000006s : 48: predicate.print_const_string_wrapper 2.17% : 0.000009s : 48: predicate.reduce_eliminate 1.79% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 20: predicate.remove_not_recompute_node 2.83% : 0.000011s : 103: predicate.replace_applicator 1.22% : 0.000005s : 48: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.72% : 0.000007s : 48: predicate.reshape_eliminate 1.54% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000006s : 48: predicate.same_eliminate 0.48% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 20: predicate.specialize_transform 1.81% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.78% : 0.000011s : 68: predicate.switch_defer_inline 2.52% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.46% : 0.000026s : 170: predicate.switch_simplify 1.60% : 0.000006s : 48: predicate.tile_eliminate 1.54% : 0.000006s : 48: predicate.transpose_eliminate 2.13% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000013s : 57: predicate.tuple_list_get_item_eliminator 1.88% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 1.73% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.79% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.76% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.89% : 0.000008s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.012037 64 91.76% : 0.011045s : 47: func_graph_cloner_run.FuncGraphClonerGraph 8.24% : 0.000992s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153706 87 0.03% : 0.000040s : 1: add_recomputation 0.08% : 0.000120s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.19% : 0.000296s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.23% : 0.000355s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 21.96% : 0.033754s : 1: jit_opt_a 0.10% : 0.000148s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.29% : 0.000452s : 1: loop_unroll 0.49% : 0.000754s : 1: mutable_eliminate 2.09% : 0.003218s : 39: opt.transform.jit_opt_a 0.03% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000461s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 11.87% : 0.018241s : 2: renormalize.infer 1.73% : 0.002665s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.09% : 0.000137s : 1: rewriter_before_opt_a 0.04% : 0.000069s : 1: symbol_engine_optimizer 60.23% : 0.092581s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.383.35 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065a60> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.391.32 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.260685, [30] [bootstrap]: 0.0003135 [type_inference]: 0.247517 [event_method]: 2.283e-05 [auto_monad]: 7.34e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.00046233 [rewriter_before_opt_a]: 8.796e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00991166, [2] [Cycle 1]: 0.00603175, [27] [switch_simplify]: 5.475e-05 [loop_unroll]: 3.078e-05 [a_1]: 0.00057093 [with_stream_mark]: 1.754e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.93002e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00502161 [add_forward_monad_depend]: 6.51e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.792e-05 [cse]: 3.002e-05 [replace_applicator]: 1.609e-05 [Cycle 2]: 0.00036323, [27] [switch_simplify]: 7.34002e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00012251 [with_stream_mark]: 1.071e-05 [recompute_prepare]: 5.78997e-06 [updatestate_depend_eliminate]: 3.10002e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.091e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.128e-05 [rewriter_after_opt_a]: 3.729e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00061162 [jit_opt_b]: 5.417e-05, [1] [Cycle 1]: 4.691e-05, [2] [frontend_op_eliminate]: 1.856e-05 [inline_after_opt_a]: 1.722e-05 [cconv]: 2.626e-05 [loop_unroll]: 0.00043041 [jit_opt_after_cconv]: 0.00014919, [1] [Cycle 1]: 0.00014226, [11] [c_1]: 2.529e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 6.46999e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 1.976e-05 [call_graph_tuple_transform]: 2.146e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.18998e-06 [environ_conv]: 7.60998e-06 [add_recomputation]: 4.893e-05 [cse_after_recomputation]: 2.143e-05, [1] [Cycle 1]: 1.647e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.7e-05 [get_jit_bprop_graph]: 1.74998e-06 [rewriter_after_jit_bprop_graph]: 4.30999e-06 [opt_after_jit_grad]: 0.0004621 [symbol_engine_optimizer]: 0.00014045, [1] [Cycle 1]: 6.647e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.393e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.50003e-07 [validate]: 4.226e-05 Sums bootstrap : 0.000314s : 0.12% type_inference : 0.247517s : 96.49% event_method : 0.000023s : 0.01% auto_monad : 0.000073s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000462s : 0.18% rewriter_before_opt_a : 0.000088s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000693s : 0.27% jit_opt_a.with_stream_mark : 0.000028s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.005022s : 1.96% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000041s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000037s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000612s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000430s : 0.17% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000462s : 0.18% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.02% Time group info: ------[substitution.] 0.000206 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 4: substitution.graph_param_transform 83.67% : 0.000173s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 6.00% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.247426 2 98.82% : 0.244507s : 1: type_inference.infer 1.18% : 0.002919s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.86% : 0.000050s : 4: replace.inline 32.14% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.85% : 0.000170s : 4: match.inline 6.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.12% : 0.000001s : 12: predicate.addn_zero_filter 2.21% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.35% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.49% : 0.000001s : 4: predicate.graph_param_transform 5.67% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.73% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.24% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.37% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002338 22 68.67% : 0.001605s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.45% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.88% : 0.000699s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.266691 72 0.02% : 0.000052s : 1: add_recomputation 0.03% : 0.000077s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.13% : 0.000334s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.72% : 0.009915s : 1: jit_opt_a 0.06% : 0.000152s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.16% : 0.000438s : 1: loop_unroll 0.23% : 0.000621s : 1: mutable_eliminate 0.35% : 0.000923s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000469s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000468s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.60% : 0.004275s : 1: renormalize.infer 0.28% : 0.000736s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.03% : 0.000093s : 1: rewriter_before_opt_a 0.05% : 0.000143s : 1: symbol_engine_optimizer 92.82% : 0.247537s : 1: type_inference TotalTime = 0.0740661, [30] [bootstrap]: 0.00034429 [type_inference]: 0.065817 [event_method]: 2.345e-05 [auto_monad]: 7.068e-05 [graph_reusing]: 6.04999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00012456 [rewriter_before_opt_a]: 8.685e-05 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00556849, [2] [Cycle 1]: 0.00180868, [27] [switch_simplify]: 5.352e-05 [loop_unroll]: 2.926e-05 [a_1]: 0.00050966 [with_stream_mark]: 1.637e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00088024 [add_forward_monad_depend]: 4.95001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.462e-05 [cse]: 3.018e-05 [replace_applicator]: 1.3e-05 [Cycle 2]: 0.00031065, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 4.92999e-06 [a_1]: 8.744e-05 [with_stream_mark]: 9.87999e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 4.94998e-06 [updatestate_useless_node_eliminater]: 4.85999e-06 [accelerated_algorithm]: 5.29003e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.61002e-06 [merge_forward]: 2.61999e-06 [cell_reuse_recompute_pass]: 1.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 7.82e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 6.74001e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.174e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 1.015e-05 [rewriter_after_opt_a]: 3.333e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.0004996 [jit_opt_b]: 4.691e-05, [1] [Cycle 1]: 4.062e-05, [2] [frontend_op_eliminate]: 1.482e-05 [inline_after_opt_a]: 1.522e-05 [cconv]: 2.487e-05 [loop_unroll]: 0.00041114 [jit_opt_after_cconv]: 0.00013618, [1] [Cycle 1]: 0.00013061, [11] [c_1]: 1.984e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.112e-05 [call_graph_tuple_transform]: 1.758e-05 [tuple_list_get_item_eliminator]: 5.15999e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.637e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 1.641e-05 [add_recomputation]: 4.779e-05 [cse_after_recomputation]: 2.35e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.194e-05 [auto_monad_reorder]: 1.719e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00045488 [symbol_engine_optimizer]: 6.881e-05, [1] [Cycle 1]: 6.244e-05, [6] [build]: 2.87002e-06 [elim_shapecalc]: 7.31001e-06 [elim_not_effective]: 1.211e-05 [opt_reshape]: 5.64e-06 [fold_const_symbol]: 8.20999e-06 [renormalize]: 4.40021e-07 [validate]: 3.593e-05 Sums bootstrap : 0.000344s : 0.49% type_inference : 0.065817s : 93.92% event_method : 0.000023s : 0.03% auto_monad : 0.000071s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000125s : 0.18% rewriter_before_opt_a : 0.000087s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.08% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000597s : 0.85% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000880s : 1.26% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000042s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000500s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000025s : 0.04% loop_unroll : 0.000411s : 0.59% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000016s : 0.02% add_recomputation : 0.000048s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000455s : 0.65% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.05% Time group info: ------[substitution.] 0.000193 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000005s : 3: substitution.graph_param_transform 83.17% : 0.000161s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065741 2 80.80% : 0.053116s : 1: type_inference.infer 19.20% : 0.012625s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.92% : 0.000045s : 4: replace.inline 34.08% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 93.33% : 0.000158s : 4: match.inline 6.67% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 0.83% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.53% : 0.000002s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 1.11% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000008s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000815 13 48.00% : 0.000391s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.49% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.51% : 0.000395s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075808 72 0.07% : 0.000051s : 1: add_recomputation 0.10% : 0.000074s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.47% : 0.000358s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000019s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.35% : 0.005572s : 1: jit_opt_a 0.18% : 0.000139s : 1: jit_opt_after_cconv 0.06% : 0.000049s : 1: jit_opt_b 0.55% : 0.000418s : 1: loop_unroll 0.67% : 0.000507s : 1: mutable_eliminate 1.06% : 0.000806s : 26: opt.transform.jit_opt_a 0.06% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000129s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.66% : 0.000499s : 1: renormalize.infer 0.49% : 0.000374s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.12% : 0.000091s : 1: rewriter_before_opt_a 0.09% : 0.000071s : 1: symbol_engine_optimizer 86.84% : 0.065830s : 1: type_inference TotalTime = 0.0509114, [30] [bootstrap]: 0.00027141 [type_inference]: 0.0414008 [event_method]: 1.919e-05 [auto_monad]: 5.826e-05 [graph_reusing]: 4.53999e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00010631 [rewriter_before_opt_a]: 7.93e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00681726, [2] [Cycle 1]: 0.00327287, [27] [switch_simplify]: 4.582e-05 [loop_unroll]: 2.956e-05 [a_1]: 0.0004855 [with_stream_mark]: 1.498e-05 [recompute_prepare]: 7.95e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.111e-05 [j_node_and_user_rematch]: 8.96002e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.96001e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00076907 [add_forward_monad_depend]: 5.41998e-06 [auto_monad_grad]: 2.14e-06 [auto_monad_eliminator]: 1.174e-05 [cse]: 2.049e-05 [replace_applicator]: 2.175e-05 [Cycle 2]: 0.00036858, [27] [switch_simplify]: 6.81999e-06 [loop_unroll]: 6.05002e-06 [a_1]: 9.32e-05 [with_stream_mark]: 1.715e-05 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 1.61998e-06 [specialize_transform]: 5.29998e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 3.04001e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.611e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 4.99003e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.42001e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.133e-05 [cse]: 2.429e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 1.472e-05 [rewriter_after_opt_a]: 3.5e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.83002e-06 [mutable_eliminate]: 0.00058515 [jit_opt_b]: 4.922e-05, [1] [Cycle 1]: 4.226e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.672e-05 [cconv]: 2.82e-05 [loop_unroll]: 0.00041721 [jit_opt_after_cconv]: 0.00015424, [1] [Cycle 1]: 0.00014753, [11] [c_1]: 2.051e-05 [parameter_eliminate]: 3.18998e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.238e-05 [call_graph_tuple_transform]: 1.891e-05 [tuple_list_get_item_eliminator]: 5.46002e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.41002e-06 [remove_dup_value]: 1.432e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 4.568e-05 [cse_after_recomputation]: 2.419e-05, [1] [Cycle 1]: 1.87e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.55e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 3.98999e-06 [opt_after_jit_grad]: 0.00045859 [symbol_engine_optimizer]: 7.077e-05, [1] [Cycle 1]: 6.46e-05, [6] [build]: 2.95998e-06 [elim_shapecalc]: 7.46999e-06 [elim_not_effective]: 1.281e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 3.50003e-07 [validate]: 3.604e-05 Sums bootstrap : 0.000271s : 0.60% type_inference : 0.041401s : 90.91% event_method : 0.000019s : 0.04% auto_monad : 0.000058s : 0.13% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.23% rewriter_before_opt_a : 0.000079s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000579s : 1.27% jit_opt_a.with_stream_mark : 0.000032s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000769s : 1.69% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000045s : 0.10% jit_opt_a.replace_applicator : 0.000027s : 0.06% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000035s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000585s : 1.28% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000028s : 0.06% loop_unroll : 0.000417s : 0.92% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000046s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000459s : 1.01% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.08% Time group info: ------[substitution.] 0.000165 23 1.12% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000005s : 3: substitution.graph_param_transform 81.92% : 0.000136s : 4: substitution.inline 1.97% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000004s : 4: substitution.remove_not_recompute_node 2.29% : 0.000004s : 2: substitution.replace_old_param 6.19% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041326 2 43.94% : 0.018157s : 1: type_inference.infer 56.06% : 0.023169s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.41% : 0.000045s : 4: replace.inline 33.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 93.56% : 0.000133s : 4: match.inline 6.44% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.25% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.42% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 2.63% : 0.000003s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.97% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000764 13 46.99% : 0.000359s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.84% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.17% : 0.000376s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052535 72 0.09% : 0.000049s : 1: add_recomputation 0.12% : 0.000062s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.55% : 0.000289s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 12.98% : 0.006821s : 1: jit_opt_a 0.30% : 0.000157s : 1: jit_opt_after_cconv 0.10% : 0.000052s : 1: jit_opt_b 0.81% : 0.000425s : 1: loop_unroll 1.13% : 0.000593s : 1: mutable_eliminate 1.52% : 0.000797s : 26: opt.transform.jit_opt_a 0.09% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000467s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000111s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 0.82% : 0.000431s : 1: renormalize.infer 0.63% : 0.000331s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000038s : 1: rewriter_after_opt_a 0.16% : 0.000082s : 1: rewriter_before_opt_a 0.14% : 0.000073s : 1: symbol_engine_optimizer 78.84% : 0.041416s : 1: type_inference TotalTime = 0.104047, [30] [bootstrap]: 0.00032641 [type_inference]: 0.0729384 [event_method]: 0.00035941 [auto_monad]: 0.00011845 [graph_reusing]: 7.68001e-06 [pre_auto_parallel]: 3.69002e-06 [py_interpret_to_execute]: 4.224e-05 [rewriter_before_opt_a]: 0.00022056 [expand_dump_flag]: 4.45e-06 [jit_opt_a]: 0.0275856, [3] [Cycle 1]: 0.0195834, [27] [switch_simplify]: 9.541e-05 [loop_unroll]: 4.85e-05 [a_1]: 0.00110164 [with_stream_mark]: 4.217e-05 [recompute_prepare]: 2.547e-05 [updatestate_depend_eliminate]: 1.025e-05 [updatestate_assign_eliminate]: 7.30998e-06 [updatestate_loads_eliminate]: 7.5e-06 [parameter_eliminate]: 2.73998e-06 [specialize_transform]: 1.628e-05 [updatestate_useless_node_eliminater]: 1.503e-05 [accelerated_algorithm]: 1.54e-05 [meta_shard_fg_expand]: 4.3e-06 [get_grad_eliminate_]: 1.47e-05 [merge_forward]: 9.91e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.257e-05 [j_node_and_user_rematch]: 2.7e-05 [meta_fg_expand]: 0.00219691 [replace_old_param]: 8.155e-05 [inline_without_move]: 6.732e-05 [renormalize]: 0.0150399 [add_forward_monad_depend]: 1.302e-05 [auto_monad_grad]: 6.51999e-06 [auto_monad_eliminator]: 6.335e-05 [cse]: 0.0002534 [replace_applicator]: 9.335e-05 [Cycle 2]: 0.003685, [27] [switch_simplify]: 4.401e-05 [loop_unroll]: 4.384e-05 [a_1]: 0.00120782 [with_stream_mark]: 1.741e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.93001e-06 [updatestate_loads_eliminate]: 3.79002e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 7.48999e-06 [updatestate_useless_node_eliminater]: 7.16001e-06 [accelerated_algorithm]: 7.40998e-06 [meta_shard_fg_expand]: 2.63003e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.73e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 0.00010046 [replace_old_param]: 8.42998e-06 [inline_without_move]: 6.48e-06 [renormalize]: 0.00191589 [add_forward_monad_depend]: 7.62002e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 2.83e-05 [replace_applicator]: 1.694e-05 [Cycle 3]: 0.00026705, [27] [switch_simplify]: 4.65001e-06 [loop_unroll]: 3.95998e-06 [a_1]: 4.281e-05 [with_stream_mark]: 1.26e-05 [recompute_prepare]: 3.63999e-06 [updatestate_depend_eliminate]: 2.49999e-06 [updatestate_assign_eliminate]: 1.73997e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 3.66001e-06 [updatestate_useless_node_eliminater]: 3.11001e-06 [accelerated_algorithm]: 3.66999e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 3.25e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.354e-05 [j_node_and_user_rematch]: 6.56e-06 [meta_fg_expand]: 1.39e-06 [replace_old_param]: 3.3e-06 [inline_without_move]: 3.23998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 3.76999e-06 [cse]: 9.30001e-06 [replace_applicator]: 3.7e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 3.767e-05 [convert_after_rewriter]: 6.02001e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00079271 [jit_opt_b]: 4.405e-05, [1] [Cycle 1]: 3.549e-05, [2] [frontend_op_eliminate]: 1.112e-05 [inline_after_opt_a]: 1.264e-05 [cconv]: 3.078e-05 [loop_unroll]: 0.0004627 [jit_opt_after_cconv]: 0.00014727, [1] [Cycle 1]: 0.00013935, [11] [c_1]: 1.324e-05 [parameter_eliminate]: 4.61002e-06 [updatestate_depend_eliminate]: 7.43e-06 [updatestate_assign_eliminate]: 1.99999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.772e-05 [call_graph_tuple_transform]: 1.632e-05 [tuple_list_get_item_eliminator]: 3.81999e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 1.14e-06 [switch_simplify]: 3.91001e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 5.42001e-06 [add_recomputation]: 3.885e-05 [cse_after_recomputation]: 2.172e-05, [1] [Cycle 1]: 1.586e-05, [1] [cse]: 8.91002e-06 [auto_monad_reorder]: 1.336e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 7.68001e-06 [opt_after_jit_grad]: 0.00048017 [symbol_engine_optimizer]: 6.727e-05, [1] [Cycle 1]: 6.154e-05, [6] [build]: 4.45e-06 [elim_shapecalc]: 5.64998e-06 [elim_not_effective]: 9.92999e-06 [opt_reshape]: 4.37e-06 [fold_const_symbol]: 6.25002e-06 [renormalize]: 4.89992e-07 [validate]: 3.863e-05 Sums bootstrap : 0.000326s : 0.33% type_inference : 0.072938s : 73.63% event_method : 0.000359s : 0.36% auto_monad : 0.000118s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000042s : 0.04% rewriter_before_opt_a : 0.000221s : 0.22% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000144s : 0.15% jit_opt_a.loop_unroll : 0.000096s : 0.10% jit_opt_a.a_1 : 0.002352s : 2.37% jit_opt_a.with_stream_mark : 0.000072s : 0.07% jit_opt_a.recompute_prepare : 0.000037s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.04% jit_opt_a.meta_fg_expand : 0.002299s : 2.32% jit_opt_a.replace_old_param : 0.000093s : 0.09% jit_opt_a.inline_without_move : 0.000077s : 0.08% jit_opt_a.renormalize : 0.016956s : 17.12% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.08% jit_opt_a.cse : 0.000291s : 0.29% jit_opt_a.replace_applicator : 0.000114s : 0.12% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000793s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000031s : 0.03% loop_unroll : 0.000463s : 0.47% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000480s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000626 104 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.75% : 0.000005s : 1: substitution.graph_param_transform 66.65% : 0.000417s : 13: substitution.inline 3.66% : 0.000023s : 2: substitution.inline_without_move 1.57% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.03% : 0.000013s : 7: substitution.minmaximum_grad 1.28% : 0.000008s : 5: substitution.partial_eliminate 1.85% : 0.000012s : 12: substitution.remove_not_recompute_node 5.25% : 0.000033s : 10: substitution.replace_applicator 1.30% : 0.000008s : 10: substitution.replace_old_param 0.56% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.98% : 0.000006s : 1: substitution.tile_eliminate 4.05% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.68% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.95% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072826 2 96.75% : 0.070461s : 1: type_inference.infer 3.25% : 0.002366s : 1: type_inference.specialize ------[replace.] 0.000185 20 66.57% : 0.000123s : 13: replace.inline 33.43% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000431 20 95.03% : 0.000409s : 13: match.inline 4.97% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000391 2656 1.72% : 0.000007s : 46: predicate.accumulaten_eliminater 0.19% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000006s : 46: predicate.addn_check_dump 1.71% : 0.000007s : 46: predicate.addn_zero_filter 2.16% : 0.000008s : 46: predicate.arithmetic_simplify 1.54% : 0.000006s : 46: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 46: predicate.compare_switch_simplify 1.55% : 0.000006s : 46: predicate.depend_value_elim 1.36% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.60% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.39% : 0.000005s : 46: predicate.environ_get_depend_swap 1.57% : 0.000006s : 46: predicate.environ_get_eliminate 1.38% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.74% : 0.000003s : 18: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.50% : 0.000018s : 68: predicate.inline 1.98% : 0.000008s : 46: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.02% : 0.000004s : 18: predicate.less_batch_normalization 1.74% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.76% : 0.000007s : 54: predicate.load_eliminater 0.31% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.63% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.70% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.62% : 0.000006s : 46: predicate.merge_addn 1.49% : 0.000006s : 46: predicate.minmaximum_grad 0.55% : 0.000002s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.30% : 0.000009s : 54: predicate.partial_eliminate 1.46% : 0.000006s : 46: predicate.print_const_string_wrapper 2.04% : 0.000008s : 46: predicate.reduce_eliminate 1.85% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 18: predicate.remove_not_recompute_node 2.76% : 0.000011s : 99: predicate.replace_applicator 1.19% : 0.000005s : 46: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.56% : 0.000006s : 46: predicate.reshape_eliminate 1.49% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.24% : 0.000001s : 1: predicate.row_tensor_eliminate 1.65% : 0.000006s : 46: predicate.same_eliminate 0.46% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.84% : 0.000003s : 18: predicate.specialize_transform 1.74% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.72% : 0.000011s : 66: predicate.switch_defer_inline 2.56% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.68% : 0.000026s : 166: predicate.switch_simplify 1.58% : 0.000006s : 46: predicate.tile_eliminate 1.47% : 0.000006s : 46: predicate.transpose_eliminate 1.89% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.81% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000014s : 55: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.75% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.99% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.83% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004526 52 79.26% : 0.003588s : 35: func_graph_cloner_run.FuncGraphClonerGraph 20.74% : 0.000939s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124069 87 0.03% : 0.000042s : 1: add_recomputation 0.10% : 0.000126s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.28% : 0.000350s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.30% : 0.000369s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.24% : 0.027590s : 1: jit_opt_a 0.12% : 0.000150s : 1: jit_opt_after_cconv 0.04% : 0.000047s : 1: jit_opt_b 0.38% : 0.000471s : 1: loop_unroll 0.65% : 0.000805s : 1: mutable_eliminate 2.47% : 0.003070s : 39: opt.transform.jit_opt_a 0.03% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 11.80% : 0.014634s : 2: renormalize.infer 1.85% : 0.002300s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.18% : 0.000226s : 1: rewriter_before_opt_a 0.06% : 0.000070s : 1: symbol_engine_optimizer 58.81% : 0.072959s : 1: type_inference TotalTime = 0.0121637, [30] [bootstrap]: 0.00029999 [type_inference]: 0.00449567 [event_method]: 1.744e-05 [auto_monad]: 6.351e-05 [graph_reusing]: 5.84999e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 3.341e-05 [rewriter_before_opt_a]: 7.169e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00511461, [2] [Cycle 1]: 0.00155926, [27] [switch_simplify]: 5.272e-05 [loop_unroll]: 2.929e-05 [a_1]: 0.00050914 [with_stream_mark]: 1.778e-05 [recompute_prepare]: 7.41999e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.16998e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.14e-06 [renormalize]: 0.00063422 [add_forward_monad_depend]: 5.57999e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.529e-05 [cse]: 2.95e-05 [replace_applicator]: 1.196e-05 [Cycle 2]: 0.00031483, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 4.83001e-06 [a_1]: 9.09e-05 [with_stream_mark]: 9.10999e-06 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 4.82998e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.214e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.35998e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.029e-05 [replace_applicator]: 5.36998e-06 [py_interpret_to_execute_after_opt_a]: 9.51998e-06 [rewriter_after_opt_a]: 3.284e-05 [convert_after_rewriter]: 7.04001e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00048007 [jit_opt_b]: 5.855e-05, [1] [Cycle 1]: 5.133e-05, [2] [frontend_op_eliminate]: 2.559e-05 [inline_after_opt_a]: 1.521e-05 [cconv]: 2.572e-05 [loop_unroll]: 0.00042444 [jit_opt_after_cconv]: 0.00014735, [1] [Cycle 1]: 0.00014033, [11] [c_1]: 2.186e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.073e-05 [call_graph_tuple_transform]: 1.964e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.76e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 7.95998e-06 [add_recomputation]: 4.97e-05 [cse_after_recomputation]: 2.099e-05, [1] [Cycle 1]: 1.598e-05, [1] [cse]: 9.98002e-06 [auto_monad_reorder]: 1.662e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 5.30001e-06 [opt_after_jit_grad]: 0.00047 [symbol_engine_optimizer]: 7.109e-05, [1] [Cycle 1]: 6.52e-05, [6] [build]: 3.53999e-06 [elim_shapecalc]: 7.46001e-06 [elim_not_effective]: 1.291e-05 [opt_reshape]: 5.62999e-06 [fold_const_symbol]: 8.63001e-06 [renormalize]: 3.80009e-07 [validate]: 3.31e-05 Sums bootstrap : 0.000300s : 3.59% type_inference : 0.004496s : 53.75% event_method : 0.000017s : 0.21% auto_monad : 0.000064s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000033s : 0.40% rewriter_before_opt_a : 0.000072s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.70% jit_opt_a.loop_unroll : 0.000034s : 0.41% jit_opt_a.a_1 : 0.000600s : 7.17% jit_opt_a.with_stream_mark : 0.000027s : 0.32% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000634s : 7.58% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000040s : 0.48% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000033s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000480s : 5.74% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.31% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000026s : 0.31% loop_unroll : 0.000424s : 5.07% jit_opt_after_cconv.c_1 : 0.000022s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000018s : 0.21% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000008s : 0.10% add_recomputation : 0.000050s : 0.59% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000017s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000470s : 5.62% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.40% Time group info: ------[substitution.] 0.000192 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.38% : 0.000007s : 3: substitution.graph_param_transform 82.65% : 0.000159s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000004s : 4: substitution.remove_not_recompute_node 2.21% : 0.000004s : 2: substitution.replace_old_param 6.16% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004435 2 82.45% : 0.003657s : 1: type_inference.infer 17.55% : 0.000778s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.66% : 0.000044s : 4: replace.inline 33.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.59% : 0.000156s : 4: match.inline 6.41% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.26% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.05% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.29% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.20% : 0.000007s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000001s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 53: predicate.switch_simplify 1.40% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000619 13 51.47% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.46% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.07% : 0.000266s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013670 72 0.38% : 0.000053s : 1: add_recomputation 0.49% : 0.000067s : 1: auto_monad 0.14% : 0.000019s : 1: auto_monad_reorder 2.33% : 0.000318s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.07% : 0.000010s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.44% : 0.005118s : 1: jit_opt_a 1.10% : 0.000150s : 1: jit_opt_after_cconv 0.45% : 0.000061s : 1: jit_opt_b 3.17% : 0.000434s : 1: loop_unroll 3.57% : 0.000488s : 1: mutable_eliminate 5.89% : 0.000805s : 26: opt.transform.jit_opt_a 0.36% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.25% : 0.000034s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.50% : 0.000479s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000036s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.15% : 0.000020s : 1: remove_dup_value 2.27% : 0.000310s : 1: renormalize.infer 2.32% : 0.000317s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.54% : 0.000074s : 1: rewriter_before_opt_a 0.54% : 0.000073s : 1: symbol_engine_optimizer 32.98% : 0.004508s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.162.489 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d940> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.163.226 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.10443, [30] [bootstrap]: 0.00031242 [type_inference]: 0.0892649 [event_method]: 2.241e-05 [auto_monad]: 7.168e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00022073 [rewriter_before_opt_a]: 9.369e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0121999, [2] [Cycle 1]: 0.00377912, [27] [switch_simplify]: 6.846e-05 [loop_unroll]: 3.552e-05 [a_1]: 0.00071854 [with_stream_mark]: 2.275e-05 [recompute_prepare]: 1.044e-05 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 7.59002e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 7.04001e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 7.4e-06 [renormalize]: 0.00253153 [add_forward_monad_depend]: 7.66001e-06 [auto_monad_grad]: 2.88003e-06 [auto_monad_eliminator]: 1.813e-05 [cse]: 3.781e-05 [replace_applicator]: 1.881e-05 [Cycle 2]: 0.00041117, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.0001172 [with_stream_mark]: 1.136e-05 [recompute_prepare]: 5.97001e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.73997e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 2.83998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 4.709e-05 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 7.53e-06 [cse]: 1.675e-05 [replace_applicator]: 6.82002e-06 [py_interpret_to_execute_after_opt_a]: 1.738e-05 [rewriter_after_opt_a]: 4.25e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00062943 [jit_opt_b]: 5.331e-05, [1] [Cycle 1]: 4.625e-05, [2] [frontend_op_eliminate]: 1.784e-05 [inline_after_opt_a]: 1.77e-05 [cconv]: 2.75e-05 [loop_unroll]: 0.00041335 [jit_opt_after_cconv]: 0.00015159, [1] [Cycle 1]: 0.00014538, [11] [c_1]: 2.477e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 6.48003e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.309e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.881e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 4.974e-05 [cse_after_recomputation]: 2.4e-05, [1] [Cycle 1]: 1.843e-05, [1] [cse]: 1.268e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 2.28998e-06 [rewriter_after_jit_bprop_graph]: 4.48999e-06 [opt_after_jit_grad]: 0.00045096 [symbol_engine_optimizer]: 8.537e-05, [1] [Cycle 1]: 7.937e-05, [6] [build]: 3.14001e-06 [elim_shapecalc]: 9.03002e-06 [elim_not_effective]: 1.406e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 2.026e-05 [renormalize]: 4.00003e-07 [validate]: 4.023e-05 Sums bootstrap : 0.000312s : 0.33% type_inference : 0.089265s : 93.18% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000221s : 0.23% rewriter_before_opt_a : 0.000094s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.08% jit_opt_a.loop_unroll : 0.000042s : 0.04% jit_opt_a.a_1 : 0.000836s : 0.87% jit_opt_a.with_stream_mark : 0.000034s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000054s : 0.06% jit_opt_a.renormalize : 0.002532s : 2.64% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.03% jit_opt_a.cse : 0.000055s : 0.06% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000629s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000413s : 0.43% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000451s : 0.47% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000020s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000305 25 0.60% : 0.000002s : 2: substitution.elim_not_effective 4.06% : 0.000012s : 2: substitution.fold_const_symbol 2.12% : 0.000006s : 4: substitution.graph_param_transform 83.98% : 0.000256s : 5: substitution.inline 1.60% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 4.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.089187 2 97.80% : 0.087221s : 1: type_inference.infer 2.20% : 0.001966s : 1: type_inference.specialize ------[replace.] 0.000103 7 69.56% : 0.000072s : 5: replace.inline 30.44% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 95.56% : 0.000253s : 5: match.inline 4.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 888 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 6.51% : 0.000009s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 19: predicate.load_eliminater 1.06% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.42% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 1.66% : 0.000002s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.96% : 0.000011s : 65: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001871 21 66.53% : 0.001245s : 12: func_graph_cloner_run.FuncGraphClonerGraph 4.56% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.90% : 0.000541s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108180 72 0.05% : 0.000052s : 1: add_recomputation 0.07% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000333s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.28% : 0.012204s : 1: jit_opt_a 0.14% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.39% : 0.000421s : 1: loop_unroll 0.59% : 0.000639s : 1: mutable_eliminate 1.05% : 0.001140s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000226s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.98% : 0.001056s : 1: renormalize.infer 1.36% : 0.001466s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000099s : 1: rewriter_before_opt_a 0.08% : 0.000088s : 1: symbol_engine_optimizer 82.53% : 0.089282s : 1: type_inference TotalTime = 0.0612528, [30] [bootstrap]: 0.00027981 [type_inference]: 0.0532466 [event_method]: 1.971e-05 [auto_monad]: 7.036e-05 [graph_reusing]: 6.89999e-06 [pre_auto_parallel]: 3.16001e-06 [py_interpret_to_execute]: 0.00010386 [rewriter_before_opt_a]: 7.784e-05 [expand_dump_flag]: 3.20002e-06 [jit_opt_a]: 0.00542124, [2] [Cycle 1]: 0.00189212, [27] [switch_simplify]: 5.343e-05 [loop_unroll]: 3.059e-05 [a_1]: 0.00054719 [with_stream_mark]: 1.906e-05 [recompute_prepare]: 8.03001e-06 [updatestate_depend_eliminate]: 4.49998e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.53003e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 4.19002e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 9.33002e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00090917 [add_forward_monad_depend]: 5.09998e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.389e-05 [cse]: 3.371e-05 [replace_applicator]: 1.26e-05 [Cycle 2]: 0.00031947, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 5.19998e-06 [a_1]: 9.056e-05 [with_stream_mark]: 9.10999e-06 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.19998e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.14998e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.207e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 5.02e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.228e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 1.171e-05 [rewriter_after_opt_a]: 3.769e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00049191 [jit_opt_b]: 5.008e-05, [1] [Cycle 1]: 4.326e-05, [2] [frontend_op_eliminate]: 1.644e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.485e-05 [loop_unroll]: 0.0004062 [jit_opt_after_cconv]: 0.00013916, [1] [Cycle 1]: 0.00013318, [11] [c_1]: 2.122e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.015e-05 [call_graph_tuple_transform]: 1.856e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.504e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 6.12999e-06 [add_recomputation]: 4.837e-05 [cse_after_recomputation]: 2.412e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.286e-05 [auto_monad_reorder]: 1.826e-05 [get_jit_bprop_graph]: 2.28002e-06 [rewriter_after_jit_bprop_graph]: 3.76999e-06 [opt_after_jit_grad]: 0.0004464 [symbol_engine_optimizer]: 7.259e-05, [1] [Cycle 1]: 6.62e-05, [6] [build]: 3.27002e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.278e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 9.17999e-06 [renormalize]: 3.89991e-07 [validate]: 3.626e-05 Sums bootstrap : 0.000280s : 0.49% type_inference : 0.053247s : 92.64% event_method : 0.000020s : 0.03% auto_monad : 0.000070s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000104s : 0.18% rewriter_before_opt_a : 0.000078s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000638s : 1.11% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000909s : 1.58% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000046s : 0.08% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000492s : 0.86% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000406s : 0.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000446s : 0.78% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.06% Time group info: ------[substitution.] 0.000217 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000002s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 3: substitution.graph_param_transform 84.44% : 0.000183s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.67% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053183 2 93.94% : 0.049958s : 1: type_inference.infer 6.06% : 0.003225s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.39% : 0.000048s : 4: replace.inline 31.61% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 94.19% : 0.000181s : 4: match.inline 5.81% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 2.54% : 0.000003s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 1.00% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.05% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002658 13 14.03% : 0.000373s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.72% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 84.25% : 0.002240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063062 72 0.08% : 0.000051s : 1: add_recomputation 0.12% : 0.000074s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.47% : 0.000295s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.60% : 0.005424s : 1: jit_opt_a 0.22% : 0.000142s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.66% : 0.000413s : 1: loop_unroll 0.79% : 0.000500s : 1: mutable_eliminate 1.35% : 0.000851s : 26: opt.transform.jit_opt_a 0.08% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000108s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 0.87% : 0.000550s : 1: renormalize.infer 0.56% : 0.000351s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.13% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 84.45% : 0.053258s : 1: type_inference TotalTime = 0.100337, [30] [bootstrap]: 0.00026638 [type_inference]: 0.0691429 [event_method]: 0.00030059 [auto_monad]: 0.00013425 [graph_reusing]: 7.51999e-06 [pre_auto_parallel]: 3.20002e-06 [py_interpret_to_execute]: 3.84e-05 [rewriter_before_opt_a]: 0.00012465 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.0281166, [3] [Cycle 1]: 0.0199446, [27] [switch_simplify]: 7.984e-05 [loop_unroll]: 4.726e-05 [a_1]: 0.0010666 [with_stream_mark]: 2.552e-05 [recompute_prepare]: 2.27e-05 [updatestate_depend_eliminate]: 8.38999e-06 [updatestate_assign_eliminate]: 7.11001e-06 [updatestate_loads_eliminate]: 6.71e-06 [parameter_eliminate]: 2.50002e-06 [specialize_transform]: 1.73e-05 [updatestate_useless_node_eliminater]: 1.373e-05 [accelerated_algorithm]: 1.473e-05 [meta_shard_fg_expand]: 4.06001e-06 [get_grad_eliminate_]: 1.406e-05 [merge_forward]: 9.48997e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.858e-05 [j_node_and_user_rematch]: 2.582e-05 [meta_fg_expand]: 0.0017758 [replace_old_param]: 7.338e-05 [inline_without_move]: 6.262e-05 [renormalize]: 0.0158378 [add_forward_monad_depend]: 1.877e-05 [auto_monad_grad]: 8.12e-06 [auto_monad_eliminator]: 7.679e-05 [cse]: 0.0003055 [replace_applicator]: 0.00010436 [Cycle 2]: 0.00447408, [27] [switch_simplify]: 4.567e-05 [loop_unroll]: 4.514e-05 [a_1]: 0.00130283 [with_stream_mark]: 2.202e-05 [recompute_prepare]: 1.159e-05 [updatestate_depend_eliminate]: 6.04999e-06 [updatestate_assign_eliminate]: 4.32e-06 [updatestate_loads_eliminate]: 3.9e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 8.84e-06 [updatestate_useless_node_eliminater]: 8.50001e-06 [accelerated_algorithm]: 8.30999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 7.97998e-06 [merge_forward]: 5.09003e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.113e-05 [j_node_and_user_rematch]: 1.387e-05 [meta_fg_expand]: 0.00012421 [replace_old_param]: 1.152e-05 [inline_without_move]: 8.65999e-06 [renormalize]: 0.00251689 [add_forward_monad_depend]: 7.78999e-06 [auto_monad_grad]: 2.12001e-06 [auto_monad_eliminator]: 4.12e-05 [cse]: 3.262e-05 [replace_applicator]: 1.925e-05 [Cycle 3]: 0.00027823, [27] [switch_simplify]: 4.86002e-06 [loop_unroll]: 3.86999e-06 [a_1]: 4.66e-05 [with_stream_mark]: 1.323e-05 [recompute_prepare]: 3.78001e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 3.36999e-06 [updatestate_useless_node_eliminater]: 3.21999e-06 [accelerated_algorithm]: 3.48e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 3.09001e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 6.28e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 3.82002e-06 [inline_without_move]: 3.26001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 4.13001e-06 [cse]: 9.15001e-06 [replace_applicator]: 3.63999e-06 [py_interpret_to_execute_after_opt_a]: 1.073e-05 [rewriter_after_opt_a]: 3.402e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 5.99e-06 [mutable_eliminate]: 0.00070174 [jit_opt_b]: 4.226e-05, [1] [Cycle 1]: 3.452e-05, [2] [frontend_op_eliminate]: 1.077e-05 [inline_after_opt_a]: 1.157e-05 [cconv]: 2.628e-05 [loop_unroll]: 0.00042058 [jit_opt_after_cconv]: 0.00012683, [1] [Cycle 1]: 0.00012031, [11] [c_1]: 1.237e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 1.77001e-06 [cse]: 2.023e-05 [call_graph_tuple_transform]: 1.385e-05 [tuple_list_get_item_eliminator]: 3.73001e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 3.55e-06 [remove_dup_value]: 1.457e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 5.35001e-06 [add_recomputation]: 3.659e-05 [cse_after_recomputation]: 1.905e-05, [1] [Cycle 1]: 1.4e-05, [1] [cse]: 7.8e-06 [auto_monad_reorder]: 1.424e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 5.71003e-06 [opt_after_jit_grad]: 0.00044685 [symbol_engine_optimizer]: 6.389e-05, [1] [Cycle 1]: 5.816e-05, [6] [build]: 3.78001e-06 [elim_shapecalc]: 6.22001e-06 [elim_not_effective]: 8.62e-06 [opt_reshape]: 3.76999e-06 [fold_const_symbol]: 6.16e-06 [renormalize]: 5.49975e-07 [validate]: 2.815e-05 Sums bootstrap : 0.000266s : 0.28% type_inference : 0.069143s : 72.02% event_method : 0.000301s : 0.31% auto_monad : 0.000134s : 0.14% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.04% rewriter_before_opt_a : 0.000125s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.14% jit_opt_a.loop_unroll : 0.000096s : 0.10% jit_opt_a.a_1 : 0.002416s : 2.52% jit_opt_a.with_stream_mark : 0.000061s : 0.06% jit_opt_a.recompute_prepare : 0.000038s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000030s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.05% jit_opt_a.meta_fg_expand : 0.001902s : 1.98% jit_opt_a.replace_old_param : 0.000089s : 0.09% jit_opt_a.inline_without_move : 0.000075s : 0.08% jit_opt_a.renormalize : 0.018355s : 19.12% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.03% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000122s : 0.13% jit_opt_a.cse : 0.000347s : 0.36% jit_opt_a.replace_applicator : 0.000127s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000702s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000026s : 0.03% loop_unroll : 0.000421s : 0.44% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000447s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000028s : 0.03% Time group info: ------[substitution.] 0.000616 107 0.23% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.69% : 0.000004s : 1: substitution.graph_param_transform 64.66% : 0.000398s : 13: substitution.inline 3.07% : 0.000019s : 2: substitution.inline_without_move 1.67% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.04% : 0.000013s : 7: substitution.minmaximum_grad 1.29% : 0.000008s : 5: substitution.partial_eliminate 1.88% : 0.000012s : 13: substitution.remove_not_recompute_node 6.13% : 0.000038s : 10: substitution.replace_applicator 1.17% : 0.000007s : 10: substitution.replace_old_param 1.35% : 0.000008s : 1: substitution.reshape_eliminate 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.12% : 0.000007s : 1: substitution.tile_eliminate 4.05% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.59% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.44% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069037 2 96.46% : 0.066595s : 1: type_inference.infer 3.54% : 0.002443s : 1: type_inference.specialize ------[replace.] 0.000223 20 71.55% : 0.000159s : 13: replace.inline 28.45% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000413 20 94.51% : 0.000390s : 13: match.inline 5.49% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000398 2768 1.53% : 0.000006s : 48: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.47% : 0.000006s : 48: predicate.addn_check_dump 1.60% : 0.000006s : 48: predicate.addn_zero_filter 1.97% : 0.000008s : 48: predicate.arithmetic_simplify 1.55% : 0.000006s : 48: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000006s : 48: predicate.compare_switch_simplify 1.44% : 0.000006s : 48: predicate.depend_value_elim 1.44% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.17% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.49% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.55% : 0.000006s : 48: predicate.environ_get_depend_swap 1.54% : 0.000006s : 48: predicate.environ_get_eliminate 1.44% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000004s : 20: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.27% : 0.000017s : 70: predicate.inline 2.08% : 0.000008s : 48: predicate.inline_without_move 0.49% : 0.000002s : 20: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 20: predicate.less_batch_normalization 1.82% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.90% : 0.000008s : 56: predicate.load_eliminater 0.26% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.41% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.81% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.48% : 0.000006s : 48: predicate.merge_addn 1.49% : 0.000006s : 48: predicate.minmaximum_grad 0.51% : 0.000002s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.35% : 0.000009s : 56: predicate.partial_eliminate 1.52% : 0.000006s : 48: predicate.print_const_string_wrapper 2.14% : 0.000009s : 48: predicate.reduce_eliminate 1.84% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 20: predicate.remove_not_recompute_node 2.90% : 0.000012s : 103: predicate.replace_applicator 1.13% : 0.000004s : 48: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.85% : 0.000007s : 48: predicate.reshape_eliminate 1.56% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000006s : 48: predicate.same_eliminate 0.46% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.13% : 0.000001s : 2: predicate.special_op_eliminate 0.84% : 0.000003s : 20: predicate.specialize_transform 1.84% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.79% : 0.000011s : 68: predicate.switch_defer_inline 2.48% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.50% : 0.000026s : 170: predicate.switch_simplify 1.61% : 0.000006s : 48: predicate.tile_eliminate 1.57% : 0.000006s : 48: predicate.transpose_eliminate 1.91% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000013s : 57: predicate.tuple_list_get_item_eliminator 2.05% : 0.000008s : 48: predicate.tuple_list_set_item_eliminator 1.84% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.73% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.91% : 0.000008s : 48: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004425 52 78.38% : 0.003468s : 35: func_graph_cloner_run.FuncGraphClonerGraph 21.62% : 0.000957s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121823 87 0.03% : 0.000039s : 1: add_recomputation 0.12% : 0.000140s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000290s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.25% : 0.000309s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 23.08% : 0.028121s : 1: jit_opt_a 0.11% : 0.000130s : 1: jit_opt_after_cconv 0.04% : 0.000045s : 1: jit_opt_b 0.35% : 0.000428s : 1: loop_unroll 0.58% : 0.000711s : 1: mutable_eliminate 2.57% : 0.003136s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000453s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 12.94% : 0.015766s : 2: renormalize.infer 2.10% : 0.002561s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.10% : 0.000128s : 1: rewriter_before_opt_a 0.05% : 0.000066s : 1: symbol_engine_optimizer 56.77% : 0.069161s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.275.273 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004db80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.276.071 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0432452, [30] [bootstrap]: 0.00034798 [type_inference]: 0.0315895 [event_method]: 2.058e-05 [auto_monad]: 7.367e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00015084 [rewriter_before_opt_a]: 9.371e-05 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.00813642, [2] [Cycle 1]: 0.00270582, [27] [switch_simplify]: 8.416e-05 [loop_unroll]: 3.174e-05 [a_1]: 0.00065726 [with_stream_mark]: 2.245e-05 [recompute_prepare]: 9.04e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 1.079e-05 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00153779 [add_forward_monad_depend]: 6.46999e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.935e-05 [cse]: 3.476e-05 [replace_applicator]: 1.959e-05 [Cycle 2]: 0.00035528, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.0001097 [with_stream_mark]: 1.211e-05 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 3.18998e-06 [cell_reuse_recompute_pass]: 4.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 4.92999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.279e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.701e-05 [rewriter_after_opt_a]: 4.569e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.49998e-06 [mutable_eliminate]: 0.00093062 [jit_opt_b]: 5.435e-05, [1] [Cycle 1]: 4.574e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 1.642e-05 [cconv]: 3.068e-05 [loop_unroll]: 0.00048054 [jit_opt_after_cconv]: 0.00015151, [1] [Cycle 1]: 0.00014498, [11] [c_1]: 2.364e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 4.29002e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.632e-05 [call_graph_tuple_transform]: 1.975e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.32999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.775e-05 [partial_unused_args_eliminate]: 3.63999e-06 [environ_conv]: 5.29e-06 [add_recomputation]: 5.536e-05 [cse_after_recomputation]: 2.432e-05, [1] [Cycle 1]: 1.849e-05, [1] [cse]: 1.271e-05 [auto_monad_reorder]: 1.717e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.0006016 [symbol_engine_optimizer]: 7.834e-05, [1] [Cycle 1]: 7.024e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 8.57998e-06 [elim_not_effective]: 1.425e-05 [opt_reshape]: 6.28e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 5.39992e-07 [validate]: 4.321e-05 Sums bootstrap : 0.000348s : 0.93% type_inference : 0.031590s : 84.24% event_method : 0.000021s : 0.05% auto_monad : 0.000074s : 0.20% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000151s : 0.40% rewriter_before_opt_a : 0.000094s : 0.25% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000091s : 0.24% jit_opt_a.loop_unroll : 0.000038s : 0.10% jit_opt_a.a_1 : 0.000767s : 2.05% jit_opt_a.with_stream_mark : 0.000035s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001538s : 4.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.07% jit_opt_a.cse : 0.000048s : 0.13% jit_opt_a.replace_applicator : 0.000025s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000046s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000931s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000031s : 0.08% loop_unroll : 0.000481s : 1.28% jit_opt_after_cconv.c_1 : 0.000024s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000004s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000055s : 0.15% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000602s : 1.60% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.12% Time group info: ------[substitution.] 0.000282 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.32% : 0.000007s : 3: substitution.graph_param_transform 86.43% : 0.000244s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000006s : 2: substitution.replace_old_param 4.55% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031504 2 92.87% : 0.029257s : 1: type_inference.infer 7.13% : 0.002246s : 1: type_inference.specialize ------[replace.] 0.000092 6 68.31% : 0.000063s : 4: replace.inline 31.69% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 95.35% : 0.000241s : 4: match.inline 4.65% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.73% : 0.000002s : 10: predicate.addn_zero_filter 2.64% : 0.000004s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.79% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000002s : 10: predicate.depend_value_elim 1.30% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.43% : 0.000002s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 4.98% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 6: predicate.less_batch_normalization 1.22% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.88% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 2.02% : 0.000003s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 2.07% : 0.000003s : 10: predicate.reduce_eliminate 1.64% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.67% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.73% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.82% : 0.000009s : 53: predicate.switch_simplify 1.64% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.11% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001215 13 42.75% : 0.000520s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.75% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.50% : 0.000638s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045808 72 0.13% : 0.000059s : 1: add_recomputation 0.17% : 0.000077s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.79% : 0.000363s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.77% : 0.008142s : 1: jit_opt_a 0.34% : 0.000154s : 1: jit_opt_after_cconv 0.12% : 0.000057s : 1: jit_opt_b 1.06% : 0.000487s : 1: loop_unroll 2.05% : 0.000940s : 1: mutable_eliminate 2.24% : 0.001027s : 26: opt.transform.jit_opt_a 0.11% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000611s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000156s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 2.01% : 0.000923s : 1: renormalize.infer 1.32% : 0.000604s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000049s : 1: rewriter_after_opt_a 0.21% : 0.000098s : 1: rewriter_before_opt_a 0.18% : 0.000081s : 1: symbol_engine_optimizer 69.00% : 0.031606s : 1: type_inference TotalTime = 0.120532, [30] [bootstrap]: 0.00029295 [type_inference]: 0.110418 [event_method]: 2.029e-05 [auto_monad]: 6.911e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00040913 [rewriter_before_opt_a]: 8.642e-05 [expand_dump_flag]: 4.37e-06 [jit_opt_a]: 0.00708693, [2] [Cycle 1]: 0.0032944, [27] [switch_simplify]: 5.392e-05 [loop_unroll]: 3.08e-05 [a_1]: 0.00056833 [with_stream_mark]: 2.04e-05 [recompute_prepare]: 8.58001e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 4.62e-06 [cell_reuse_recompute_pass]: 1.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 6.03002e-06 [renormalize]: 0.00228453 [add_forward_monad_depend]: 5.62001e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.723e-05 [cse]: 3.132e-05 [replace_applicator]: 1.488e-05 [Cycle 2]: 0.00035047, [27] [switch_simplify]: 6.63e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00011759 [with_stream_mark]: 9.87999e-06 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.04999e-06 [updatestate_loads_eliminate]: 1.96998e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 5.46998e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 5.10999e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.138e-05 [replace_applicator]: 5.44998e-06 [py_interpret_to_execute_after_opt_a]: 9.66998e-06 [rewriter_after_opt_a]: 3.48e-05 [convert_after_rewriter]: 6.55002e-06 [order_py_execute_after_rewriter]: 5.96998e-06 [mutable_eliminate]: 0.00052895 [jit_opt_b]: 5.216e-05, [1] [Cycle 1]: 4.572e-05, [2] [frontend_op_eliminate]: 1.762e-05 [inline_after_opt_a]: 1.778e-05 [cconv]: 2.455e-05 [loop_unroll]: 0.00040336 [jit_opt_after_cconv]: 0.00014376, [1] [Cycle 1]: 0.00013774, [11] [c_1]: 2.471e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 1.98002e-06 [cse]: 1.896e-05 [call_graph_tuple_transform]: 1.988e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.56e-06 [remove_dup_value]: 1.561e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 7.66001e-06 [add_recomputation]: 5.02e-05 [cse_after_recomputation]: 2.126e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.04e-05 [auto_monad_reorder]: 1.493e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 5.218e-05 [opt_after_jit_grad]: 0.00046027 [symbol_engine_optimizer]: 7.335e-05, [1] [Cycle 1]: 6.728e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 3.9002e-07 [validate]: 4.002e-05 Sums bootstrap : 0.000293s : 0.25% type_inference : 0.110418s : 94.77% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000409s : 0.35% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000686s : 0.59% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002285s : 1.96% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000529s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000403s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000052s : 0.04% opt_after_jit_grad : 0.000460s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000213 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000005s : 4: substitution.graph_param_transform 83.31% : 0.000177s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000005s : 2: substitution.replace_old_param 6.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110344 2 97.64% : 0.107743s : 1: type_inference.infer 2.36% : 0.002601s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.30% : 0.000048s : 4: replace.inline 31.70% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 6 93.77% : 0.000175s : 4: match.inline 6.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.36% : 0.000000s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000001s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.69% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.73% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000001s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002088 22 68.85% : 0.001437s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.21% : 0.000610s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123785 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000305s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.73% : 0.007090s : 1: jit_opt_a 0.12% : 0.000146s : 1: jit_opt_after_cconv 0.04% : 0.000054s : 1: jit_opt_b 0.33% : 0.000411s : 1: loop_unroll 0.43% : 0.000537s : 1: mutable_eliminate 0.74% : 0.000912s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000417s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.33% : 0.001645s : 1: renormalize.infer 0.51% : 0.000631s : 1: renormalize.specialize 0.04% : 0.000055s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 89.22% : 0.110437s : 1: type_inference TotalTime = 0.102409, [30] [bootstrap]: 0.0002479 [type_inference]: 0.0738218 [event_method]: 0.0002969 [auto_monad]: 0.0001047 [graph_reusing]: 8.13999e-06 [pre_auto_parallel]: 3.39001e-06 [py_interpret_to_execute]: 3.742e-05 [rewriter_before_opt_a]: 0.00012404 [expand_dump_flag]: 3.08998e-06 [jit_opt_a]: 0.0254661, [3] [Cycle 1]: 0.0177706, [27] [switch_simplify]: 8.086e-05 [loop_unroll]: 4.872e-05 [a_1]: 0.00102552 [with_stream_mark]: 3.582e-05 [recompute_prepare]: 2.224e-05 [updatestate_depend_eliminate]: 9.07999e-06 [updatestate_assign_eliminate]: 7.5e-06 [updatestate_loads_eliminate]: 6.66e-06 [parameter_eliminate]: 2.82002e-06 [specialize_transform]: 1.598e-05 [updatestate_useless_node_eliminater]: 1.377e-05 [accelerated_algorithm]: 1.476e-05 [meta_shard_fg_expand]: 3.81001e-06 [get_grad_eliminate_]: 1.405e-05 [merge_forward]: 9.56e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.112e-05 [j_node_and_user_rematch]: 2.663e-05 [meta_fg_expand]: 0.00192482 [replace_old_param]: 7.392e-05 [inline_without_move]: 6.295e-05 [renormalize]: 0.0136279 [add_forward_monad_depend]: 1.24e-05 [auto_monad_grad]: 6.46e-06 [auto_monad_eliminator]: 6.222e-05 [cse]: 0.00027556 [replace_applicator]: 9.411e-05 [Cycle 2]: 0.00389031, [27] [switch_simplify]: 4.473e-05 [loop_unroll]: 4.287e-05 [a_1]: 0.00120943 [with_stream_mark]: 2.014e-05 [recompute_prepare]: 9.72999e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 3.65998e-06 [updatestate_loads_eliminate]: 4.05998e-06 [parameter_eliminate]: 2.58998e-06 [specialize_transform]: 7.82e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 6.90998e-06 [meta_shard_fg_expand]: 3.28e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 1.158e-05 [meta_fg_expand]: 0.00011224 [replace_old_param]: 8.47e-06 [inline_without_move]: 7.01999e-06 [renormalize]: 0.00210677 [add_forward_monad_depend]: 8.08999e-06 [auto_monad_grad]: 1.93002e-06 [auto_monad_eliminator]: 1.55e-05 [cse]: 2.634e-05 [replace_applicator]: 1.776e-05 [Cycle 3]: 0.00025893, [27] [switch_simplify]: 4.30999e-06 [loop_unroll]: 3.73999e-06 [a_1]: 4.262e-05 [with_stream_mark]: 1.275e-05 [recompute_prepare]: 4.2e-06 [updatestate_depend_eliminate]: 2.78998e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 1.58002e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 3.78999e-06 [updatestate_useless_node_eliminater]: 3.21999e-06 [accelerated_algorithm]: 3.8e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 3.31999e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.221e-05 [j_node_and_user_rematch]: 5.62001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 3.11001e-06 [inline_without_move]: 3.19001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 5.40022e-07 [auto_monad_eliminator]: 3.21001e-06 [cse]: 8.65999e-06 [replace_applicator]: 3.71001e-06 [py_interpret_to_execute_after_opt_a]: 1.209e-05 [rewriter_after_opt_a]: 3.593e-05 [convert_after_rewriter]: 5.91003e-06 [order_py_execute_after_rewriter]: 4.25e-06 [mutable_eliminate]: 0.00071982 [jit_opt_b]: 7.627e-05, [1] [Cycle 1]: 6.886e-05, [2] [frontend_op_eliminate]: 9.52999e-06 [inline_after_opt_a]: 4.578e-05 [cconv]: 2.889e-05 [loop_unroll]: 0.00045012 [jit_opt_after_cconv]: 0.00013031, [1] [Cycle 1]: 0.00012274, [11] [c_1]: 1.288e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 1.87001e-06 [updatestate_loads_eliminate]: 1.67001e-06 [cse]: 1.856e-05 [call_graph_tuple_transform]: 1.493e-05 [tuple_list_get_item_eliminator]: 3.96001e-06 [none_parameter_eliminate]: 1.80001e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 3.81999e-06 [remove_dup_value]: 1.429e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 5.39e-06 [add_recomputation]: 3.57e-05 [cse_after_recomputation]: 2.077e-05, [1] [Cycle 1]: 1.533e-05, [1] [cse]: 8.95001e-06 [auto_monad_reorder]: 1.39e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.33002e-06 [opt_after_jit_grad]: 0.00046294 [symbol_engine_optimizer]: 6.476e-05, [1] [Cycle 1]: 5.885e-05, [6] [build]: 3.53e-06 [elim_shapecalc]: 5.77999e-06 [elim_not_effective]: 9.86998e-06 [opt_reshape]: 3.88001e-06 [fold_const_symbol]: 6.08002e-06 [renormalize]: 4.2998e-07 [validate]: 3.209e-05 Sums bootstrap : 0.000248s : 0.25% type_inference : 0.073822s : 75.33% event_method : 0.000297s : 0.30% auto_monad : 0.000105s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.04% rewriter_before_opt_a : 0.000124s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.13% jit_opt_a.loop_unroll : 0.000095s : 0.10% jit_opt_a.a_1 : 0.002278s : 2.32% jit_opt_a.with_stream_mark : 0.000069s : 0.07% jit_opt_a.recompute_prepare : 0.000036s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.04% jit_opt_a.meta_fg_expand : 0.002039s : 2.08% jit_opt_a.replace_old_param : 0.000086s : 0.09% jit_opt_a.inline_without_move : 0.000073s : 0.07% jit_opt_a.renormalize : 0.015735s : 16.06% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.08% jit_opt_a.cse : 0.000311s : 0.32% jit_opt_a.replace_applicator : 0.000116s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000720s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000046s : 0.05% cconv : 0.000029s : 0.03% loop_unroll : 0.000450s : 0.46% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.04% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000463s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000577 104 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.24% : 0.000001s : 1: substitution.fold_const_symbol 0.86% : 0.000005s : 1: substitution.graph_param_transform 65.37% : 0.000377s : 13: substitution.inline 3.09% : 0.000018s : 2: substitution.inline_without_move 1.73% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.13% : 0.000012s : 7: substitution.minmaximum_grad 1.30% : 0.000007s : 5: substitution.partial_eliminate 1.89% : 0.000011s : 12: substitution.remove_not_recompute_node 5.41% : 0.000031s : 10: substitution.replace_applicator 1.22% : 0.000007s : 10: substitution.replace_old_param 0.51% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.32% : 0.000008s : 1: substitution.tile_eliminate 4.06% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.80% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.81% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.073724 2 96.78% : 0.071351s : 1: type_inference.infer 3.22% : 0.002373s : 1: type_inference.specialize ------[replace.] 0.000180 20 65.36% : 0.000117s : 13: replace.inline 34.64% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000392 20 94.06% : 0.000369s : 13: match.inline 5.94% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000384 2656 1.56% : 0.000006s : 46: predicate.accumulaten_eliminater 0.19% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.46% : 0.000006s : 46: predicate.addn_check_dump 1.72% : 0.000007s : 46: predicate.addn_zero_filter 2.15% : 0.000008s : 46: predicate.arithmetic_simplify 1.57% : 0.000006s : 46: predicate.cast_eliminate 0.15% : 0.000001s : 1: predicate.check_bprop_eliminate 1.46% : 0.000006s : 46: predicate.compare_switch_simplify 1.51% : 0.000006s : 46: predicate.depend_value_elim 1.44% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.64% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 46: predicate.environ_get_add_eliminate 1.51% : 0.000006s : 46: predicate.environ_get_depend_swap 1.46% : 0.000006s : 46: predicate.environ_get_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.79% : 0.000003s : 18: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.52% : 0.000017s : 68: predicate.inline 2.03% : 0.000008s : 46: predicate.inline_without_move 0.36% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.04% : 0.000004s : 18: predicate.less_batch_normalization 1.80% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.81% : 0.000007s : 54: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.58% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.76% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.42% : 0.000005s : 46: predicate.merge_addn 1.52% : 0.000006s : 46: predicate.minmaximum_grad 0.33% : 0.000001s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.30% : 0.000009s : 54: predicate.partial_eliminate 1.48% : 0.000006s : 46: predicate.print_const_string_wrapper 1.95% : 0.000007s : 46: predicate.reduce_eliminate 1.85% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 18: predicate.remove_not_recompute_node 2.79% : 0.000011s : 99: predicate.replace_applicator 1.15% : 0.000004s : 46: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.56% : 0.000006s : 46: predicate.reshape_eliminate 1.52% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000006s : 46: predicate.same_eliminate 0.52% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.13% : 0.000000s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 18: predicate.specialize_transform 1.86% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.79% : 0.000011s : 66: predicate.switch_defer_inline 2.54% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.81% : 0.000026s : 166: predicate.switch_simplify 1.56% : 0.000006s : 46: predicate.tile_eliminate 1.52% : 0.000006s : 46: predicate.transpose_eliminate 1.97% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.89% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.94% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.83% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.88% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.66% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.98% : 0.000008s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004206 52 77.67% : 0.003267s : 35: func_graph_cloner_run.FuncGraphClonerGraph 22.33% : 0.000939s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121141 87 0.03% : 0.000039s : 1: add_recomputation 0.09% : 0.000111s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.21% : 0.000258s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.25% : 0.000305s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 21.02% : 0.025469s : 1: jit_opt_a 0.11% : 0.000133s : 1: jit_opt_after_cconv 0.07% : 0.000079s : 1: jit_opt_b 0.38% : 0.000458s : 1: loop_unroll 0.60% : 0.000728s : 1: mutable_eliminate 2.45% : 0.002964s : 39: opt.transform.jit_opt_a 0.03% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000049s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000040s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 11.02% : 0.013345s : 2: renormalize.infer 1.95% : 0.002367s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.10% : 0.000127s : 1: rewriter_before_opt_a 0.06% : 0.000067s : 1: symbol_engine_optimizer 60.95% : 0.073840s : 1: type_inference TotalTime = 0.217806, [30] [bootstrap]: 0.00034045 [type_inference]: 0.192982 [event_method]: 0.00041499 [auto_monad]: 0.00013317 [graph_reusing]: 9.17999e-06 [pre_auto_parallel]: 3.73999e-06 [py_interpret_to_execute]: 4.088e-05 [rewriter_before_opt_a]: 0.00015176 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.02157, [2] [Cycle 1]: 0.00512793, [27] [switch_simplify]: 0.00019392 [loop_unroll]: 5.392e-05 [a_1]: 0.00150828 [with_stream_mark]: 1.759e-05 [recompute_prepare]: 9.02e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.16998e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.83002e-06 [renormalize]: 0.00302316 [add_forward_monad_depend]: 5.42999e-06 [auto_monad_grad]: 2.28998e-06 [auto_monad_eliminator]: 1.55e-05 [cse]: 2.439e-05 [replace_applicator]: 1.341e-05 [Cycle 2]: 0.00033428, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.79e-06 [a_1]: 9.567e-05 [with_stream_mark]: 9.35001e-06 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.06002e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.397e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.78001e-06 [inline_without_move]: 5.29e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.219e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.299e-05 [rewriter_after_opt_a]: 3.802e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.00053274 [jit_opt_b]: 5.015e-05, [1] [Cycle 1]: 4.379e-05, [2] [frontend_op_eliminate]: 1.645e-05 [inline_after_opt_a]: 1.605e-05 [cconv]: 2.415e-05 [loop_unroll]: 0.00041988 [jit_opt_after_cconv]: 0.00013844, [1] [Cycle 1]: 0.00013266, [11] [c_1]: 2.069e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.026e-05 [call_graph_tuple_transform]: 1.675e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 1.542e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 4.574e-05 [cse_after_recomputation]: 2.26e-05, [1] [Cycle 1]: 1.763e-05, [1] [cse]: 1.192e-05 [auto_monad_reorder]: 1.676e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.57998e-06 [opt_after_jit_grad]: 0.00045671 [symbol_engine_optimizer]: 0.00012966, [1] [Cycle 1]: 0.00012323, [6] [build]: 3.59002e-06 [elim_shapecalc]: 7.78001e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 5.35001e-06 [fold_const_symbol]: 6.407e-05 [renormalize]: 5.19998e-07 [validate]: 4.04e-05 Sums bootstrap : 0.000340s : 0.17% type_inference : 0.192982s : 95.96% event_method : 0.000415s : 0.21% auto_monad : 0.000133s : 0.07% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000041s : 0.02% rewriter_before_opt_a : 0.000152s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000200s : 0.10% jit_opt_a.loop_unroll : 0.000060s : 0.03% jit_opt_a.a_1 : 0.001604s : 0.80% jit_opt_a.with_stream_mark : 0.000027s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003023s : 1.50% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000037s : 0.02% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000533s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000420s : 0.21% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.404.517 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e4c0> should be wrapped by jit only once. environ_conv : 0.000006s : 0.00% add_recomputation : 0.000046s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000457s : 0.23% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000064s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.02% Time group info: ------[substitution.] 0.000679 35 0.30% : 0.000002s : 2: substitution.elim_not_effective 8.15% : 0.000055s : 2: substitution.fold_const_symbol 0.69% : 0.000005s : 3: substitution.graph_param_transform 84.54% : 0.000574s : 12: substitution.inline 0.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.67% : 0.000005s : 4: substitution.remove_not_recompute_node 0.60% : 0.000004s : 2: substitution.replace_old_param 1.08% : 0.000007s : 1: substitution.reshape_eliminate 2.00% : 0.000014s : 3: substitution.switch_simplify 1.46% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.192876 2 97.67% : 0.188387s : 1: type_inference.infer 2.33% : 0.004489s : 1: type_inference.specialize ------[replace.] 0.000338 18 53.11% : 0.000180s : 12: replace.inline 1.61% : 0.000005s : 1: replace.reshape_eliminate 17.45% : 0.000059s : 3: replace.switch_simplify 27.83% : 0.000094s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000596 18 95.41% : 0.000569s : 12: match.inline 1.09% : 0.000006s : 1: match.reshape_eliminate 2.03% : 0.000012s : 3: match.switch_simplify 1.47% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000196 1212 1.37% : 0.000003s : 19: predicate.accumulaten_eliminater 0.67% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 19: predicate.addn_check_dump 1.51% : 0.000003s : 19: predicate.addn_zero_filter 2.14% : 0.000004s : 19: predicate.arithmetic_simplify 1.51% : 0.000003s : 20: predicate.cast_eliminate 0.34% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000002s : 19: predicate.compare_switch_simplify 1.35% : 0.000003s : 19: predicate.depend_value_elim 1.32% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.52% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.46% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.46% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.20% : 0.000000s : 3: predicate.elim_not_effective 0.31% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.33% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_depend_swap 1.48% : 0.000003s : 20: predicate.environ_get_eliminate 1.35% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.68% : 0.000001s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000011s : 40: predicate.inline 0.57% : 0.000001s : 6: predicate.inline_without_move 0.26% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.78% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.80% : 0.000004s : 25: predicate.load_eliminater 0.86% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.93% : 0.000010s : 64: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 23: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 19: predicate.merge_addn 1.28% : 0.000003s : 19: predicate.minmaximum_grad 0.99% : 0.000002s : 3: predicate.mutable_eliminate 0.28% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000004s : 25: predicate.partial_eliminate 1.31% : 0.000003s : 19: predicate.print_const_string_wrapper 1.98% : 0.000004s : 19: predicate.reduce_eliminate 1.89% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000003s : 28: predicate.replace_applicator 0.34% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.83% : 0.000004s : 20: predicate.reshape_eliminate 1.32% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.45% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000003s : 19: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.68% : 0.000001s : 6: predicate.special_op_eliminate 0.61% : 0.000001s : 6: predicate.specialize_transform 1.65% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.27% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.13% : 0.000006s : 34: predicate.switch_defer_inline 2.87% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.88% : 0.000017s : 107: predicate.switch_simplify 1.51% : 0.000003s : 19: predicate.tile_eliminate 1.38% : 0.000003s : 19: predicate.transpose_eliminate 1.71% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.17% : 0.000006s : 28: predicate.tuple_list_get_item_eliminator 1.81% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.62% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.37% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 19: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.35% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003653 40 61.43% : 0.002244s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.94% : 0.000327s : 5: func_graph_cloner_run.FuncGraphClonerNode 29.63% : 0.001082s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.222915 72 0.02% : 0.000048s : 1: add_recomputation 0.06% : 0.000139s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.16% : 0.000358s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.19% : 0.000422s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 9.68% : 0.021574s : 1: jit_opt_a 0.06% : 0.000141s : 1: jit_opt_after_cconv 0.02% : 0.000053s : 1: jit_opt_b 0.19% : 0.000427s : 1: loop_unroll 0.24% : 0.000540s : 1: mutable_eliminate 0.89% : 0.001989s : 26: opt.transform.jit_opt_a 0.02% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000087s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000463s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000044s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.98% : 0.002186s : 1: renormalize.infer 0.37% : 0.000828s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000155s : 1: rewriter_before_opt_a 0.06% : 0.000132s : 1: symbol_engine_optimizer 86.58% : 0.193000s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.405.262 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0284744, [30] [bootstrap]: 0.00026887 [type_inference]: 0.015737 [event_method]: 6.211e-05 [auto_monad]: 9.747e-05 [graph_reusing]: 7.08e-06 [pre_auto_parallel]: 3.08998e-06 [py_interpret_to_execute]: 2.941e-05 [rewriter_before_opt_a]: 0.00010508 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00972893, [2] [Cycle 1]: 0.006146, [27] [switch_simplify]: 7.237e-05 [loop_unroll]: 4.269e-05 [a_1]: 0.00092576 [with_stream_mark]: 3.235e-05 [recompute_prepare]: 2.073e-05 [updatestate_depend_eliminate]: 8.92e-06 [updatestate_assign_eliminate]: 6.77002e-06 [updatestate_loads_eliminate]: 7.4e-06 [parameter_eliminate]: 3.22002e-06 [specialize_transform]: 1.377e-05 [updatestate_useless_node_eliminater]: 1.228e-05 [accelerated_algorithm]: 1.399e-05 [meta_shard_fg_expand]: 3.98999e-06 [get_grad_eliminate_]: 1.24e-05 [merge_forward]: 8.99e-06 [cell_reuse_recompute_pass]: 9.29984e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.786e-05 [j_node_and_user_rematch]: 2.328e-05 [meta_fg_expand]: 0.00175638 [replace_old_param]: 6.912e-05 [inline_without_move]: 5.676e-05 [renormalize]: 0.00273455 [add_forward_monad_depend]: 7.39002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.462e-05 [cse]: 2.665e-05 [replace_applicator]: 1.67e-05 [Cycle 2]: 0.00038065, [27] [switch_simplify]: 5.04e-06 [loop_unroll]: 3.78999e-06 [a_1]: 4.906e-05 [with_stream_mark]: 1.082e-05 [recompute_prepare]: 4.08001e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 2.53003e-06 [specialize_transform]: 4e-06 [updatestate_useless_node_eliminater]: 3.56999e-06 [accelerated_algorithm]: 4.23999e-06 [meta_shard_fg_expand]: 2.30997e-06 [get_grad_eliminate_]: 3.58999e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 2.59999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 7.24001e-06 [meta_fg_expand]: 8.878e-05 [replace_old_param]: 5.40999e-06 [inline_without_move]: 3.61001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 5.37001e-06 [cse]: 1.179e-05 [replace_applicator]: 4.1e-06 [py_interpret_to_execute_after_opt_a]: 1.285e-05 [rewriter_after_opt_a]: 3.83e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00074009 [jit_opt_b]: 4.526e-05, [1] [Cycle 1]: 3.765e-05, [2] [frontend_op_eliminate]: 1.138e-05 [inline_after_opt_a]: 1.305e-05 [cconv]: 2.702e-05 [loop_unroll]: 0.00046846 [jit_opt_after_cconv]: 0.00013444, [1] [Cycle 1]: 0.0001276, [11] [c_1]: 1.414e-05 [parameter_eliminate]: 3.17002e-06 [updatestate_depend_eliminate]: 6.17001e-06 [updatestate_assign_eliminate]: 1.67999e-06 [updatestate_loads_eliminate]: 1.85001e-06 [cse]: 2.181e-05 [call_graph_tuple_transform]: 1.456e-05 [tuple_list_get_item_eliminator]: 3.78999e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 8.10018e-07 [switch_simplify]: 3.8e-06 [remove_dup_value]: 1.657e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 5.67999e-06 [add_recomputation]: 3.736e-05 [cse_after_recomputation]: 5.141e-05, [1] [Cycle 1]: 4.551e-05, [1] [cse]: 8.77e-06 [auto_monad_reorder]: 3.633e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 6.48e-06 [opt_after_jit_grad]: 0.00049556 [symbol_engine_optimizer]: 7.169e-05, [1] [Cycle 1]: 6.512e-05, [6] [build]: 4.45e-06 [elim_shapecalc]: 6.65998e-06 [elim_not_effective]: 1.113e-05 [opt_reshape]: 4.80999e-06 [fold_const_symbol]: 7.33e-06 [renormalize]: 4.10015e-07 [validate]: 3.603e-05 Sums bootstrap : 0.000269s : 1.09% type_inference : 0.015737s : 64.06% event_method : 0.000062s : 0.25% auto_monad : 0.000097s : 0.40% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000029s : 0.12% rewriter_before_opt_a : 0.000105s : 0.43% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.32% jit_opt_a.loop_unroll : 0.000046s : 0.19% jit_opt_a.a_1 : 0.000975s : 3.97% jit_opt_a.with_stream_mark : 0.000043s : 0.18% jit_opt_a.recompute_prepare : 0.000025s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000010s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000018s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.06% jit_opt_a.accelerated_algorithm : 0.000018s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.07% jit_opt_a.merge_forward : 0.000012s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000031s : 0.12% jit_opt_a.meta_fg_expand : 0.001845s : 7.51% jit_opt_a.replace_old_param : 0.000075s : 0.30% jit_opt_a.inline_without_move : 0.000060s : 0.25% jit_opt_a.renormalize : 0.002735s : 11.13% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000038s : 0.16% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000740s : 3.01% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.05% jit_opt_b.inline_after_opt_a : 0.000013s : 0.05% cconv : 0.000027s : 0.11% loop_unroll : 0.000468s : 1.91% jit_opt_after_cconv.c_1 : 0.000014s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000037s : 0.15% cse_after_recomputation.cse : 0.000009s : 0.04% auto_monad_reorder : 0.000036s : 0.15% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000496s : 2.02% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.15% Time group info: ------[substitution.] 0.000305 54 0.64% : 0.000002s : 1: substitution.elim_not_effective 0.38% : 0.000001s : 1: substitution.fold_const_symbol 1.30% : 0.000004s : 1: substitution.graph_param_transform 68.62% : 0.000209s : 7: substitution.inline 6.17% : 0.000019s : 2: substitution.inline_without_move 2.77% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.23% : 0.000004s : 2: substitution.minmaximum_grad 1.31% : 0.000004s : 3: substitution.partial_eliminate 2.68% : 0.000008s : 9: substitution.remove_not_recompute_node 2.30% : 0.000007s : 2: substitution.replace_applicator 2.25% : 0.000007s : 8: substitution.replace_old_param 0.80% : 0.000002s : 1: substitution.set_cell_output_no_recompute 2.43% : 0.000007s : 2: substitution.tuple_list_convert_item_index_to_positive 1.62% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.49% : 0.000017s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015654 2 91.92% : 0.014389s : 1: type_inference.infer 8.08% : 0.001265s : 1: type_inference.specialize ------[replace.] 0.000073 9 81.61% : 0.000060s : 7: replace.inline 18.39% : 0.000013s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 9 94.36% : 0.000205s : 7: match.inline 5.64% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000184 1171 1.57% : 0.000003s : 19: predicate.accumulaten_eliminater 0.49% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.32% : 0.000002s : 19: predicate.addn_check_dump 1.36% : 0.000003s : 19: predicate.addn_zero_filter 2.03% : 0.000004s : 19: predicate.arithmetic_simplify 1.48% : 0.000003s : 19: predicate.cast_eliminate 0.22% : 0.000000s : 1: predicate.check_bprop_eliminate 1.22% : 0.000002s : 19: predicate.compare_switch_simplify 1.26% : 0.000002s : 19: predicate.depend_value_elim 1.28% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 19: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 19: predicate.dict_set_item_eliminator 0.46% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.13% : 0.000000s : 1: predicate.elim_not_effective 0.31% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 19: predicate.environ_get_add_eliminate 1.43% : 0.000003s : 19: predicate.environ_get_depend_swap 1.24% : 0.000002s : 19: predicate.environ_get_eliminate 1.23% : 0.000002s : 19: predicate.environ_get_set_eliminate 0.06% : 0.000000s : 1: predicate.fold_const_symbol 1.16% : 0.000002s : 12: predicate.get_grad_eliminate 0.06% : 0.000000s : 1: predicate.graph_param_transform 4.61% : 0.000008s : 30: predicate.inline 3.31% : 0.000006s : 36: predicate.inline_without_move 0.45% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.50% : 0.000003s : 12: predicate.less_batch_normalization 1.49% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 22: predicate.load_eliminater 0.99% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.59% : 0.000007s : 48: predicate.loop_unroll_before_grad 2.14% : 0.000004s : 20: predicate.make_slice_get_slice_eliminator 1.32% : 0.000002s : 19: predicate.merge_addn 1.30% : 0.000002s : 19: predicate.minmaximum_grad 1.00% : 0.000002s : 1: predicate.mutable_eliminate 0.18% : 0.000000s : 1: predicate.opt_reshape 2.08% : 0.000004s : 22: predicate.partial_eliminate 1.36% : 0.000003s : 19: predicate.print_const_string_wrapper 2.07% : 0.000004s : 19: predicate.reduce_eliminate 1.66% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 12: predicate.remove_not_recompute_node 1.49% : 0.000003s : 23: predicate.replace_applicator 1.91% : 0.000004s : 36: predicate.replace_old_param 0.17% : 0.000000s : 1: predicate.reset_defer_inline 1.42% : 0.000003s : 19: predicate.reshape_eliminate 1.44% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.32% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000003s : 19: predicate.same_eliminate 0.59% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.52% : 0.000001s : 2: predicate.special_op_eliminate 1.10% : 0.000002s : 12: predicate.specialize_transform 1.54% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.19% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.63% : 0.000005s : 28: predicate.switch_defer_inline 2.30% : 0.000004s : 28: predicate.switch_layer_defer_inline 7.21% : 0.000013s : 77: predicate.switch_simplify 1.35% : 0.000002s : 19: predicate.tile_eliminate 1.38% : 0.000003s : 19: predicate.transpose_eliminate 1.73% : 0.000003s : 19: predicate.tuple_list_convert_item_index_to_positive 1.53% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.77% : 0.000003s : 19: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.52% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.86% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 19: predicate.value_based_eliminate 0.13% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.25% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001518 25 77.56% : 0.001177s : 15: func_graph_cloner_run.FuncGraphClonerGraph 22.44% : 0.000340s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032605 72 0.12% : 0.000040s : 1: add_recomputation 0.31% : 0.000102s : 1: auto_monad 0.12% : 0.000040s : 1: auto_monad_reorder 0.89% : 0.000291s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000054s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.21% : 0.000068s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 29.85% : 0.009732s : 1: jit_opt_a 0.42% : 0.000137s : 1: jit_opt_after_cconv 0.15% : 0.000048s : 1: jit_opt_b 1.47% : 0.000478s : 1: loop_unroll 2.30% : 0.000750s : 1: mutable_eliminate 4.25% : 0.001385s : 26: opt.transform.jit_opt_a 0.10% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000017s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000025s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000505s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000032s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 7.05% : 0.002297s : 1: renormalize.infer 1.31% : 0.000428s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.33% : 0.000108s : 1: rewriter_before_opt_a 0.23% : 0.000074s : 1: symbol_engine_optimizer 48.32% : 0.015754s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.448.687 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e9d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.449.512 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0392857, [30] [bootstrap]: 0.00026214 [type_inference]: 0.0189076 [event_method]: 8.599e-05 [auto_monad]: 0.00011067 [graph_reusing]: 7.26001e-06 [pre_auto_parallel]: 3.8e-06 [py_interpret_to_execute]: 4.022e-05 [rewriter_before_opt_a]: 0.0001908 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.0174254, [2] [Cycle 1]: 0.0128841, [27] [switch_simplify]: 8.677e-05 [loop_unroll]: 4.455e-05 [a_1]: 0.00100354 [with_stream_mark]: 3.807e-05 [recompute_prepare]: 2.521e-05 [updatestate_depend_eliminate]: 9.37999e-06 [updatestate_assign_eliminate]: 6.84999e-06 [updatestate_loads_eliminate]: 7.05e-06 [parameter_eliminate]: 3.4e-06 [specialize_transform]: 1.414e-05 [updatestate_useless_node_eliminater]: 1.304e-05 [accelerated_algorithm]: 1.298e-05 [meta_shard_fg_expand]: 4.32e-06 [get_grad_eliminate_]: 1.419e-05 [merge_forward]: 9.77999e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.915e-05 [j_node_and_user_rematch]: 2.532e-05 [meta_fg_expand]: 0.00218559 [replace_old_param]: 8.705e-05 [inline_without_move]: 6.855e-05 [renormalize]: 0.00880865 [add_forward_monad_depend]: 7.61999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.455e-05 [cse]: 2.957e-05 [replace_applicator]: 2.172e-05 [Cycle 2]: 0.00038624, [27] [switch_simplify]: 5.04e-06 [loop_unroll]: 4.08001e-06 [a_1]: 5.195e-05 [with_stream_mark]: 1.321e-05 [recompute_prepare]: 3.63999e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 3.49001e-06 [updatestate_useless_node_eliminater]: 3.86999e-06 [accelerated_algorithm]: 3.68e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 3.56001e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 3.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.398e-05 [j_node_and_user_rematch]: 6.35002e-06 [meta_fg_expand]: 9.874e-05 [replace_old_param]: 5.40999e-06 [inline_without_move]: 3.83001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 4.87998e-06 [cse]: 1.159e-05 [replace_applicator]: 3.83001e-06 [py_interpret_to_execute_after_opt_a]: 1.173e-05 [rewriter_after_opt_a]: 3.64e-05 [convert_after_rewriter]: 5.97001e-06 [order_py_execute_after_rewriter]: 4.50999e-06 [mutable_eliminate]: 0.00071256 [jit_opt_b]: 4.097e-05, [1] [Cycle 1]: 3.377e-05, [2] [frontend_op_eliminate]: 1.017e-05 [inline_after_opt_a]: 1.127e-05 [cconv]: 2.565e-05 [loop_unroll]: 0.00042187 [jit_opt_after_cconv]: 0.00015017, [1] [Cycle 1]: 0.00014382, [11] [c_1]: 1.254e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 1.72001e-06 [updatestate_loads_eliminate]: 1.42999e-06 [cse]: 1.749e-05 [call_graph_tuple_transform]: 1.502e-05 [tuple_list_get_item_eliminator]: 3.9e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 8.2e-07 [switch_simplify]: 3.73999e-06 [remove_dup_value]: 1.461e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 5.86e-06 [add_recomputation]: 3.486e-05 [cse_after_recomputation]: 1.898e-05, [1] [Cycle 1]: 1.372e-05, [1] [cse]: 7.86001e-06 [auto_monad_reorder]: 1.326e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.00044332 [symbol_engine_optimizer]: 6.6e-05, [1] [Cycle 1]: 5.976e-05, [6] [build]: 3.85e-06 [elim_shapecalc]: 6.09001e-06 [elim_not_effective]: 9.82001e-06 [opt_reshape]: 4.10998e-06 [fold_const_symbol]: 5.74e-06 [renormalize]: 4.89992e-07 [validate]: 2.983e-05 Sums bootstrap : 0.000262s : 0.76% type_inference : 0.018908s : 55.05% event_method : 0.000086s : 0.25% auto_monad : 0.000111s : 0.32% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000040s : 0.12% rewriter_before_opt_a : 0.000191s : 0.56% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.27% jit_opt_a.loop_unroll : 0.000049s : 0.14% jit_opt_a.a_1 : 0.001055s : 3.07% jit_opt_a.with_stream_mark : 0.000051s : 0.15% jit_opt_a.recompute_prepare : 0.000029s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.03% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000018s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000017s : 0.05% jit_opt_a.accelerated_algorithm : 0.000017s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.05% jit_opt_a.merge_forward : 0.000013s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000032s : 0.09% jit_opt_a.meta_fg_expand : 0.002284s : 6.65% jit_opt_a.replace_old_param : 0.000092s : 0.27% jit_opt_a.inline_without_move : 0.000072s : 0.21% jit_opt_a.renormalize : 0.008809s : 25.65% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.06% jit_opt_a.cse : 0.000041s : 0.12% jit_opt_a.replace_applicator : 0.000026s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000036s : 0.11% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000713s : 2.07% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.03% cconv : 0.000026s : 0.07% loop_unroll : 0.000422s : 1.23% jit_opt_after_cconv.c_1 : 0.000013s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000035s : 0.10% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000443s : 1.29% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.09% Time group info: ------[substitution.] 0.000347 56 0.43% : 0.000001s : 1: substitution.elim_not_effective 0.27% : 0.000001s : 1: substitution.fold_const_symbol 1.33% : 0.000005s : 1: substitution.graph_param_transform 69.53% : 0.000242s : 7: substitution.inline 7.03% : 0.000024s : 2: substitution.inline_without_move 2.40% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.19% : 0.000004s : 2: substitution.minmaximum_grad 1.32% : 0.000005s : 3: substitution.partial_eliminate 2.39% : 0.000008s : 9: substitution.remove_not_recompute_node 1.72% : 0.000006s : 2: substitution.replace_applicator 2.53% : 0.000009s : 10: substitution.replace_old_param 1.22% : 0.000004s : 1: substitution.set_cell_output_no_recompute 2.25% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.52% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 4.86% : 0.000017s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018794 2 91.17% : 0.017135s : 1: type_inference.infer 8.83% : 0.001659s : 1: type_inference.specialize ------[replace.] 0.000093 9 77.45% : 0.000072s : 7: replace.inline 22.55% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 9 95.21% : 0.000237s : 7: match.inline 4.79% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000192 1179 1.31% : 0.000003s : 19: predicate.accumulaten_eliminater 0.40% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 19: predicate.addn_check_dump 1.38% : 0.000003s : 19: predicate.addn_zero_filter 2.12% : 0.000004s : 19: predicate.arithmetic_simplify 1.42% : 0.000003s : 19: predicate.cast_eliminate 0.20% : 0.000000s : 1: predicate.check_bprop_eliminate 1.28% : 0.000002s : 19: predicate.compare_switch_simplify 1.35% : 0.000003s : 19: predicate.depend_value_elim 1.28% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.40% : 0.000003s : 19: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 19: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.24% : 0.000000s : 1: predicate.elim_not_effective 0.28% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 19: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 19: predicate.environ_get_depend_swap 1.52% : 0.000003s : 19: predicate.environ_get_eliminate 1.24% : 0.000002s : 19: predicate.environ_get_set_eliminate 0.07% : 0.000000s : 1: predicate.fold_const_symbol 1.18% : 0.000002s : 12: predicate.get_grad_eliminate 0.16% : 0.000000s : 1: predicate.graph_param_transform 4.91% : 0.000009s : 30: predicate.inline 3.70% : 0.000007s : 40: predicate.inline_without_move 0.44% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.39% : 0.000003s : 12: predicate.less_batch_normalization 1.79% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.60% : 0.000003s : 22: predicate.load_eliminater 0.60% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.53% : 0.000007s : 48: predicate.loop_unroll_before_grad 1.65% : 0.000003s : 20: predicate.make_slice_get_slice_eliminator 1.49% : 0.000003s : 19: predicate.merge_addn 1.29% : 0.000002s : 19: predicate.minmaximum_grad 0.65% : 0.000001s : 1: predicate.mutable_eliminate 0.22% : 0.000000s : 1: predicate.opt_reshape 2.02% : 0.000004s : 22: predicate.partial_eliminate 1.47% : 0.000003s : 19: predicate.print_const_string_wrapper 1.86% : 0.000004s : 19: predicate.reduce_eliminate 1.70% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 12: predicate.remove_not_recompute_node 1.64% : 0.000003s : 23: predicate.replace_applicator 2.26% : 0.000004s : 40: predicate.replace_old_param 0.13% : 0.000000s : 1: predicate.reset_defer_inline 1.39% : 0.000003s : 19: predicate.reshape_eliminate 1.35% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.29% : 0.000001s : 1: predicate.row_tensor_eliminate 1.32% : 0.000003s : 19: predicate.same_eliminate 0.60% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.32% : 0.000001s : 2: predicate.special_op_eliminate 1.07% : 0.000002s : 12: predicate.specialize_transform 1.74% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.68% : 0.000005s : 28: predicate.switch_defer_inline 2.29% : 0.000004s : 28: predicate.switch_layer_defer_inline 6.81% : 0.000013s : 77: predicate.switch_simplify 1.50% : 0.000003s : 19: predicate.tile_eliminate 1.51% : 0.000003s : 19: predicate.transpose_eliminate 1.95% : 0.000004s : 19: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 19: predicate.tuple_list_set_item_eliminator 1.59% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.46% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.86% : 0.000005s : 34: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 19: predicate.value_based_eliminate 0.10% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.30% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002187 29 78.87% : 0.001725s : 19: func_graph_cloner_run.FuncGraphClonerGraph 21.13% : 0.000462s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049623 72 0.08% : 0.000038s : 1: add_recomputation 0.23% : 0.000116s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.59% : 0.000291s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000021s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.19% : 0.000093s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 35.12% : 0.017430s : 1: jit_opt_a 0.31% : 0.000153s : 1: jit_opt_after_cconv 0.09% : 0.000044s : 1: jit_opt_b 0.87% : 0.000430s : 1: loop_unroll 1.45% : 0.000721s : 1: mutable_eliminate 3.07% : 0.001521s : 26: opt.transform.jit_opt_a 0.06% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.09% : 0.000043s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 16.62% : 0.008247s : 1: renormalize.infer 1.10% : 0.000548s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000039s : 1: rewriter_after_opt_a 0.39% : 0.000195s : 1: rewriter_before_opt_a 0.14% : 0.000068s : 1: symbol_engine_optimizer 38.16% : 0.018935s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.495.977 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e040> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.496.671 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0116111, [30] [bootstrap]: 0.00024079 [type_inference]: 0.00419312 [event_method]: 1.782e-05 [auto_monad]: 6.542e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.21e-06 [py_interpret_to_execute]: 3.413e-05 [rewriter_before_opt_a]: 7.384e-05 [expand_dump_flag]: 3.10998e-06 [jit_opt_a]: 0.00491523, [2] [Cycle 1]: 0.00147816, [27] [switch_simplify]: 5.343e-05 [loop_unroll]: 3.031e-05 [a_1]: 0.00052779 [with_stream_mark]: 1.404e-05 [recompute_prepare]: 7.47998e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.65998e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.31002e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.352e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 0.00052671 [add_forward_monad_depend]: 4.70999e-06 [auto_monad_grad]: 2.33998e-06 [auto_monad_eliminator]: 1.373e-05 [cse]: 3.523e-05 [replace_applicator]: 1.099e-05 [Cycle 2]: 0.00033796, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.04e-05 [with_stream_mark]: 8.14002e-06 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 1.909e-05 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.55001e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.45002e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.123e-05 [j_node_and_user_rematch]: 7.85e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.85002e-06 [cse]: 1.335e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 1.026e-05 [rewriter_after_opt_a]: 3.539e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00048125 [jit_opt_b]: 4.829e-05, [1] [Cycle 1]: 4.165e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 2.426e-05 [loop_unroll]: 0.00040529 [jit_opt_after_cconv]: 0.00015286, [1] [Cycle 1]: 0.00014621, [11] [c_1]: 1.976e-05 [parameter_eliminate]: 2.06998e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.63003e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.099e-05 [call_graph_tuple_transform]: 1.832e-05 [tuple_list_get_item_eliminator]: 1.635e-05 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.691e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 4.886e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.967e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.42e-06 [opt_after_jit_grad]: 0.0004927 [symbol_engine_optimizer]: 7.807e-05, [1] [Cycle 1]: 7.074e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.483e-05 [opt_reshape]: 6.38003e-06 [fold_const_symbol]: 8.60001e-06 [renormalize]: 5.3001e-07 [validate]: 4.194e-05 Sums bootstrap : 0.000241s : 3.03% type_inference : 0.004193s : 52.70% event_method : 0.000018s : 0.22% auto_monad : 0.000065s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000034s : 0.43% rewriter_before_opt_a : 0.000074s : 0.93% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.75% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000618s : 7.77% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000023s : 0.29% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.08% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000527s : 6.62% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.25% jit_opt_a.cse : 0.000049s : 0.61% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.13% rewriter_after_opt_a : 0.000035s : 0.44% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000481s : 6.05% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000024s : 0.30% loop_unroll : 0.000405s : 5.09% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000016s : 0.21% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000017s : 0.21% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000049s : 0.61% cse_after_recomputation.cse : 0.000013s : 0.16% auto_monad_reorder : 0.000020s : 0.25% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000493s : 6.19% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.19% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000042s : 0.53% Time group info: ------[substitution.] 0.000199 23 1.27% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000006s : 3: substitution.graph_param_transform 83.47% : 0.000166s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000004s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 6.35% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004135 2 81.01% : 0.003350s : 1: type_inference.infer 18.99% : 0.000785s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.43% : 0.000045s : 4: replace.inline 33.57% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.43% : 0.000164s : 4: match.inline 6.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.50% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.24% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.85% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000537 13 49.95% : 0.000268s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.46% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.59% : 0.000234s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013035 72 0.40% : 0.000052s : 1: add_recomputation 0.53% : 0.000069s : 1: auto_monad 0.17% : 0.000022s : 1: auto_monad_reorder 1.93% : 0.000251s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.20% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.73% : 0.004918s : 1: jit_opt_a 1.19% : 0.000155s : 1: jit_opt_after_cconv 0.39% : 0.000051s : 1: jit_opt_b 3.16% : 0.000412s : 1: loop_unroll 3.74% : 0.000488s : 1: mutable_eliminate 6.35% : 0.000827s : 26: opt.transform.jit_opt_a 0.44% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.19% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.27% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.87% : 0.000504s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000037s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.15% : 0.000019s : 1: remove_dup_value 1.97% : 0.000256s : 1: renormalize.infer 2.02% : 0.000264s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000038s : 1: rewriter_after_opt_a 0.59% : 0.000077s : 1: rewriter_before_opt_a 0.62% : 0.000081s : 1: symbol_engine_optimizer 32.25% : 0.004204s : 1: type_inference TotalTime = 0.0499572, [30] [bootstrap]: 0.00033 [type_inference]: 0.00472828 [event_method]: 1.891e-05 [auto_monad]: 6.808e-05 [graph_reusing]: 6.25002e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.003783 [rewriter_before_opt_a]: 0.00027028 [expand_dump_flag]: 4.19002e-06 [jit_opt_a]: 0.00554729, [2] [Cycle 1]: 0.00172971, [27] [switch_simplify]: 5.359e-05 [loop_unroll]: 2.858e-05 [a_1]: 0.00056292 [with_stream_mark]: 2.177e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.419e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.00071514 [add_forward_monad_depend]: 5.89999e-06 [auto_monad_grad]: 2.85002e-06 [auto_monad_eliminator]: 1.539e-05 [cse]: 3.873e-05 [replace_applicator]: 1.193e-05 [Cycle 2]: 0.00032886, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 5.02999e-06 [a_1]: 8.538e-05 [with_stream_mark]: 9.24e-06 [recompute_prepare]: 4.92999e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.86002e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.88002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 1.33002e-06 [auto_monad_eliminator]: 7.37002e-06 [cse]: 1.456e-05 [replace_applicator]: 4.90999e-06 [py_interpret_to_execute_after_opt_a]: 1.409e-05 [rewriter_after_opt_a]: 4.079e-05 [convert_after_rewriter]: 8.23999e-06 [order_py_execute_after_rewriter]: 5.56998e-06 [mutable_eliminate]: 0.00065734 [jit_opt_b]: 4.906e-05, [1] [Cycle 1]: 4.154e-05, [2] [frontend_op_eliminate]: 1.475e-05 [inline_after_opt_a]: 1.565e-05 [cconv]: 3.072e-05 [loop_unroll]: 0.00046492 [jit_opt_after_cconv]: 0.00015778, [1] [Cycle 1]: 0.00015168, [11] [c_1]: 2.003e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 7.63001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.527e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 5.16998e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 7.7e-07 [switch_simplify]: 1.209e-05 [remove_dup_value]: 1.666e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 5.472e-05 [cse_after_recomputation]: 2.395e-05, [1] [Cycle 1]: 1.852e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.769e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.0332675 [symbol_engine_optimizer]: 8.866e-05, [1] [Cycle 1]: 7.971e-05, [6] [build]: 5.39e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.92e-05 [opt_reshape]: 6.04999e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 1.92001e-06 [validate]: 6.773e-05 Sums bootstrap : 0.000330s : 0.72% type_inference : 0.004728s : 10.32% event_method : 0.000019s : 0.04% auto_monad : 0.000068s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.003783s : 8.26% rewriter_before_opt_a : 0.000270s : 0.59% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000648s : 1.41% jit_opt_a.with_stream_mark : 0.000031s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000715s : 1.56% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000053s : 0.12% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000041s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000657s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000031s : 0.07% loop_unroll : 0.000465s : 1.01% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000012s : 0.03% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.12% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.033268s : 72.60% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000068s : 0.15% Time group info: ------[substitution.] 0.000242 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 85.81% : 0.000207s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000005s : 2: substitution.replace_old_param 4.83% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004661 2 82.62% : 0.003851s : 1: type_inference.infer 17.38% : 0.000810s : 1: type_inference.specialize ------[replace.] 0.000070 6 69.45% : 0.000048s : 4: replace.inline 30.55% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 95.10% : 0.000205s : 4: match.inline 4.90% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 3.20% : 0.000004s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.61% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.70% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.66% : 0.000001s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.12% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.40% : 0.000002s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.61% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000623 13 53.13% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.86% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.01% : 0.000243s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051572 72 0.11% : 0.000058s : 1: add_recomputation 0.14% : 0.000071s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.68% : 0.000352s : 1: bootstrap 0.06% : 0.000033s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.76% : 0.005550s : 1: jit_opt_a 0.31% : 0.000161s : 1: jit_opt_after_cconv 0.10% : 0.000051s : 1: jit_opt_b 0.92% : 0.000474s : 1: loop_unroll 1.30% : 0.000669s : 1: mutable_eliminate 1.66% : 0.000856s : 26: opt.transform.jit_opt_a 0.10% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000040s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000039s : 4: opt.transform.symbol_engine_opt 64.53% : 0.033279s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 7.36% : 0.003798s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 0.78% : 0.000400s : 1: renormalize.infer 0.60% : 0.000308s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000044s : 1: rewriter_after_opt_a 0.54% : 0.000281s : 1: rewriter_before_opt_a 0.18% : 0.000091s : 1: symbol_engine_optimizer 9.19% : 0.004742s : 1: type_inference TotalTime = 0.0361777, [30] [bootstrap]: 0.00026813 [type_inference]: 0.0110374 [event_method]: 1.843e-05 [auto_monad]: 5.738e-05 [graph_reusing]: 4.40999e-06 [pre_auto_parallel]: 1.87999e-06 [py_interpret_to_execute]: 4.272e-05 [rewriter_before_opt_a]: 7.718e-05 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.00615297, [2] [Cycle 1]: 0.00209691, [27] [switch_simplify]: 5.705e-05 [loop_unroll]: 3.403e-05 [a_1]: 0.00066517 [with_stream_mark]: 2.029e-05 [recompute_prepare]: 9.51e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.94999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00094885 [add_forward_monad_depend]: 7.93999e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.79e-05 [cse]: 4.172e-05 [replace_applicator]: 1.602e-05 [Cycle 2]: 0.00036854, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.158e-05 [with_stream_mark]: 1.48e-05 [recompute_prepare]: 6.38003e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.49998e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 2.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.48002e-06 [inline_without_move]: 4.72e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 8.81997e-06 [cse]: 2.019e-05 [replace_applicator]: 7.71001e-06 [py_interpret_to_execute_after_opt_a]: 1.573e-05 [rewriter_after_opt_a]: 4.235e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00075941 [jit_opt_b]: 0.015685, [1] [Cycle 1]: 0.0156745, [2] [frontend_op_eliminate]: 0.0155978 [inline_after_opt_a]: 3.055e-05 [cconv]: 4.167e-05 [loop_unroll]: 0.00080879 [jit_opt_after_cconv]: 0.00018694, [1] [Cycle 1]: 0.00017697, [11] [c_1]: 2.248e-05 [parameter_eliminate]: 4.99e-06 [updatestate_depend_eliminate]: 9.84999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.24001e-06 [cse]: 4.465e-05 [call_graph_tuple_transform]: 2.369e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.75001e-06 [remove_dup_value]: 4.492e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 7e-06 [add_recomputation]: 5.555e-05 [cse_after_recomputation]: 2.479e-05, [1] [Cycle 1]: 1.882e-05, [1] [cse]: 1.28e-05 [auto_monad_reorder]: 1.904e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 7.9e-06 [opt_after_jit_grad]: 0.00047113 [symbol_engine_optimizer]: 7.559e-05, [1] [Cycle 1]: 6.924e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 6.09987e-07 [validate]: 4.435e-05 Sums bootstrap : 0.000268s : 0.84% type_inference : 0.011037s : 34.70% event_method : 0.000018s : 0.06% auto_monad : 0.000057s : 0.18% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000043s : 0.13% rewriter_before_opt_a : 0.000077s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.20% jit_opt_a.loop_unroll : 0.000039s : 0.12% jit_opt_a.a_1 : 0.000757s : 2.38% jit_opt_a.with_stream_mark : 0.000035s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000949s : 2.98% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.08% jit_opt_a.cse : 0.000062s : 0.19% jit_opt_a.replace_applicator : 0.000024s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000042s : 0.13% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000759s : 2.39% jit_opt_b.frontend_op_eliminate : 0.015598s : 49.04% jit_opt_b.inline_after_opt_a : 0.000031s : 0.10% cconv : 0.000042s : 0.13% loop_unroll : 0.000809s : 2.54% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000045s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000045s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000471s : 1.48% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.14% Time group info: ------[substitution.] 0.000273 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.12% : 0.000006s : 3: substitution.graph_param_transform 86.46% : 0.000236s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000005s : 2: substitution.replace_old_param 4.71% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010982 2 90.51% : 0.009940s : 1: type_inference.infer 9.49% : 0.001043s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.30% : 0.000066s : 5: replace.inline 32.70% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 95.23% : 0.000233s : 5: match.inline 4.77% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.46% : 0.000002s : 11: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 11: predicate.addn_check_dump 1.19% : 0.000002s : 11: predicate.addn_zero_filter 1.89% : 0.000003s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.11% : 0.000001s : 11: predicate.depend_value_elim 1.02% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.67% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000002s : 11: predicate.environ_get_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000008s : 24: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 16: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.33% : 0.000002s : 11: predicate.print_const_string_wrapper 1.57% : 0.000002s : 11: predicate.reduce_eliminate 1.37% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.51% : 0.000002s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 1.11% : 0.000001s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 11: predicate.reshape_eliminate 1.13% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.53% : 0.000002s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000010s : 59: predicate.switch_simplify 1.11% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.52% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.51% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 3.86% : 0.000005s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000786 16 48.56% : 0.000382s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.72% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.71% : 0.000320s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053739 72 0.11% : 0.000058s : 1: add_recomputation 0.11% : 0.000060s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.54% : 0.000289s : 1: bootstrap 0.08% : 0.000045s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 11.46% : 0.006156s : 1: jit_opt_a 0.35% : 0.000190s : 1: jit_opt_after_cconv 29.20% : 0.015691s : 1: jit_opt_b 1.52% : 0.000817s : 1: loop_unroll 1.43% : 0.000771s : 1: mutable_eliminate 1.84% : 0.000991s : 26: opt.transform.jit_opt_a 0.10% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 29.05% : 0.015613s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000045s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000048s : 1: remove_dup_value 1.04% : 0.000556s : 1: renormalize.infer 0.71% : 0.000382s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000047s : 1: rewriter_after_opt_a 0.15% : 0.000080s : 1: rewriter_before_opt_a 0.15% : 0.000078s : 1: symbol_engine_optimizer 20.56% : 0.011047s : 1: type_inference TotalTime = 0.0134409, [30] [bootstrap]: 0.00036298 [type_inference]: 0.00553647 [event_method]: 2.049e-05 [auto_monad]: 7.209e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 3.908e-05 [rewriter_before_opt_a]: 8.063e-05 [expand_dump_flag]: 2.91999e-06 [jit_opt_a]: 0.00528637, [2] [Cycle 1]: 0.0015725, [27] [switch_simplify]: 5.46e-05 [loop_unroll]: 3.05e-05 [a_1]: 0.00052737 [with_stream_mark]: 1.839e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.78002e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.494e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.28002e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00061127 [add_forward_monad_depend]: 4.89003e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.42e-05 [cse]: 3.344e-05 [replace_applicator]: 1.18e-05 [Cycle 2]: 0.00031631, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.15001e-06 [a_1]: 8.933e-05 [with_stream_mark]: 8.17998e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 2.93003e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.146e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.81001e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.334e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.04e-05 [rewriter_after_opt_a]: 3.46e-05 [convert_after_rewriter]: 7.52002e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00048903 [jit_opt_b]: 4.902e-05, [1] [Cycle 1]: 4.233e-05, [2] [frontend_op_eliminate]: 1.552e-05 [inline_after_opt_a]: 1.554e-05 [cconv]: 2.533e-05 [loop_unroll]: 0.00039583 [jit_opt_after_cconv]: 0.00014976, [1] [Cycle 1]: 0.00014326, [11] [c_1]: 2.03e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.86998e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.085e-05 [call_graph_tuple_transform]: 1.871e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.59e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 5.48002e-06 [add_recomputation]: 4.999e-05 [cse_after_recomputation]: 2.341e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.249e-05 [auto_monad_reorder]: 1.704e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.33999e-06 [opt_after_jit_grad]: 0.00044901 [symbol_engine_optimizer]: 7.279e-05, [1] [Cycle 1]: 6.674e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.25e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 3.10014e-07 [validate]: 3.722e-05 Sums bootstrap : 0.000363s : 3.84% type_inference : 0.005536s : 58.59% event_method : 0.000020s : 0.22% auto_monad : 0.000072s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.41% rewriter_before_opt_a : 0.000081s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.64% jit_opt_a.loop_unroll : 0.000036s : 0.38% jit_opt_a.a_1 : 0.000617s : 6.53% jit_opt_a.with_stream_mark : 0.000027s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000611s : 6.47% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.21% jit_opt_a.cse : 0.000047s : 0.50% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000035s : 0.37% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000489s : 5.17% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000025s : 0.27% loop_unroll : 0.000396s : 4.19% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000050s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000449s : 4.75% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.39% Time group info: ------[substitution.] 0.000207 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000006s : 3: substitution.graph_param_transform 84.32% : 0.000174s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000004s : 2: substitution.replace_old_param 5.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005460 2 83.10% : 0.004537s : 1: type_inference.infer 16.90% : 0.000922s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.07% : 0.000044s : 4: replace.inline 31.93% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 94.17% : 0.000172s : 4: match.inline 5.83% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.39% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.68% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 15: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000685 13 55.86% : 0.000383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.08% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.07% : 0.000261s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014931 72 0.36% : 0.000053s : 1: add_recomputation 0.51% : 0.000076s : 1: auto_monad 0.13% : 0.000019s : 1: auto_monad_reorder 2.59% : 0.000386s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.17% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 35.42% : 0.005289s : 1: jit_opt_a 1.02% : 0.000152s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.70% : 0.000403s : 1: loop_unroll 3.33% : 0.000497s : 1: mutable_eliminate 5.54% : 0.000828s : 26: opt.transform.jit_opt_a 0.31% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.06% : 0.000457s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.30% : 0.000343s : 1: renormalize.infer 1.75% : 0.000261s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000037s : 1: rewriter_after_opt_a 0.56% : 0.000084s : 1: rewriter_before_opt_a 0.50% : 0.000075s : 1: symbol_engine_optimizer 37.24% : 0.005560s : 1: type_inference TotalTime = 0.524851, [30] [bootstrap]: 0.00036238 [type_inference]: 0.505377 [event_method]: 2.914e-05 [auto_monad]: 8.709e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00065247 [rewriter_before_opt_a]: 0.0001174 [expand_dump_flag]: 3.52002e-06 [jit_opt_a]: 0.0154247, [2] [Cycle 1]: 0.00783025, [27] [switch_simplify]: 6.886e-05 [loop_unroll]: 3.419e-05 [a_1]: 0.00082238 [with_stream_mark]: 2.209e-05 [recompute_prepare]: 9.96998e-06 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.27997e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 6.28998e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 6.80002e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 6.48e-06 [renormalize]: 0.00651252 [add_forward_monad_depend]: 6.81001e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.843e-05 [cse]: 3.474e-05 [replace_applicator]: 1.765e-05 [Cycle 2]: 0.00225941, [27] [switch_simplify]: 7.35998e-06 [loop_unroll]: 6.43e-06 [a_1]: 0.00013311 [with_stream_mark]: 1.147e-05 [recompute_prepare]: 6.31998e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.43002e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 2.73e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 9.13002e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.06998e-06 [cse]: 3.195e-05 [replace_applicator]: 1.91e-05 [py_interpret_to_execute_after_opt_a]: 2.008e-05 [rewriter_after_opt_a]: 5.496e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00072959 [jit_opt_b]: 0.00011382, [1] [Cycle 1]: 0.00010567, [2] [frontend_op_eliminate]: 7.132e-05 [inline_after_opt_a]: 2.106e-05 [cconv]: 5.126e-05 [loop_unroll]: 0.00044387 [jit_opt_after_cconv]: 0.00016822, [1] [Cycle 1]: 0.00016179, [11] [c_1]: 2.714e-05 [parameter_eliminate]: 2.51998e-06 [updatestate_depend_eliminate]: 7.05e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 2.951e-05 [call_graph_tuple_transform]: 2.256e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.86998e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 9.49e-06 [add_recomputation]: 5.688e-05 [cse_after_recomputation]: 2.772e-05, [1] [Cycle 1]: 1.875e-05, [1] [cse]: 1.285e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 2.01003e-06 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.0005117 [symbol_engine_optimizer]: 0.00026582, [1] [Cycle 1]: 0.00025869, [6] [build]: 4.92e-06 [elim_shapecalc]: 2.813e-05 [elim_not_effective]: 1.611e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 0.00017027 [renormalize]: 5.29981e-07 [validate]: 5.657e-05 Sums bootstrap : 0.000362s : 0.07% type_inference : 0.505377s : 97.75% event_method : 0.000029s : 0.01% auto_monad : 0.000087s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000652s : 0.13% rewriter_before_opt_a : 0.000117s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000955s : 0.18% jit_opt_a.with_stream_mark : 0.000034s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.006513s : 1.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.00% jit_opt_a.cse : 0.000067s : 0.01% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.00% rewriter_after_opt_a : 0.000055s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000730s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000071s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000051s : 0.01% loop_unroll : 0.000444s : 0.09% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000512s : 0.10% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000028s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000170s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.01% Time group info: ------[substitution.] 0.000493 28 0.40% : 0.000002s : 2: substitution.elim_not_effective 32.33% : 0.000160s : 2: substitution.fold_const_symbol 1.37% : 0.000007s : 4: substitution.graph_param_transform 58.21% : 0.000287s : 5: substitution.inline 0.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000013s : 3: substitution.reduce_eliminate 0.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.04% : 0.000005s : 2: substitution.replace_old_param 2.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.505246 2 91.82% : 0.463934s : 1: type_inference.infer 8.18% : 0.041312s : 1: type_inference.specialize ------[replace.] 0.000127 7 73.56% : 0.000094s : 5: replace.inline 26.44% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000295 7 96.39% : 0.000284s : 5: match.inline 3.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 2.17% : 0.000003s : 13: predicate.arithmetic_simplify 1.45% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.37% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.13% : 0.000003s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.41% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.61% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.81% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.90% : 0.000010s : 64: predicate.switch_simplify 1.48% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004930 25 40.03% : 0.001974s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.02% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 57.95% : 0.002857s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.532857 72 0.01% : 0.000060s : 1: add_recomputation 0.02% : 0.000090s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.07% : 0.000382s : 1: bootstrap 0.01% : 0.000055s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.90% : 0.015430s : 1: jit_opt_a 0.03% : 0.000171s : 1: jit_opt_after_cconv 0.02% : 0.000116s : 1: jit_opt_b 0.08% : 0.000450s : 1: loop_unroll 0.14% : 0.000736s : 1: mutable_eliminate 0.23% : 0.001218s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000085s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000217s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000520s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000658s : 1: py_interpret_to_execute 0.00% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 0.70% : 0.003706s : 1: renormalize.infer 0.52% : 0.002795s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000058s : 1: rewriter_after_opt_a 0.02% : 0.000124s : 1: rewriter_before_opt_a 0.05% : 0.000269s : 1: symbol_engine_optimizer 94.85% : 0.505403s : 1: type_inference TotalTime = 0.15979, [30] [bootstrap]: 0.00024925 [type_inference]: 0.134294 [event_method]: 0.00057329 [auto_monad]: 0.00012477 [graph_reusing]: 8.69e-06 [pre_auto_parallel]: 3.55998e-06 [py_interpret_to_execute]: 4.22e-05 [rewriter_before_opt_a]: 0.00013525 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0221249, [2] [Cycle 1]: 0.017004, [27] [switch_simplify]: 8.537e-05 [loop_unroll]: 9.904e-05 [a_1]: 0.00106653 [with_stream_mark]: 4.083e-05 [recompute_prepare]: 2.815e-05 [updatestate_depend_eliminate]: 9.74999e-06 [updatestate_assign_eliminate]: 7.2e-06 [updatestate_loads_eliminate]: 6.97997e-06 [parameter_eliminate]: 3.53999e-06 [specialize_transform]: 1.581e-05 [updatestate_useless_node_eliminater]: 1.434e-05 [accelerated_algorithm]: 1.504e-05 [meta_shard_fg_expand]: 4.13999e-06 [get_grad_eliminate_]: 1.601e-05 [merge_forward]: 9.62999e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.247e-05 [j_node_and_user_rematch]: 2.846e-05 [meta_fg_expand]: 0.00208064 [replace_old_param]: 7.832e-05 [inline_without_move]: 6.844e-05 [renormalize]: 0.012929 [add_forward_monad_depend]: 7.98999e-06 [auto_monad_grad]: 3.07002e-06 [auto_monad_eliminator]: 1.6e-05 [cse]: 2.932e-05 [replace_applicator]: 2.262e-05 [Cycle 2]: 0.00041332, [27] [switch_simplify]: 5.38002e-06 [loop_unroll]: 4.01001e-06 [a_1]: 5.145e-05 [with_stream_mark]: 1.252e-05 [recompute_prepare]: 3.90998e-06 [updatestate_depend_eliminate]: 3.22002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 3.86999e-06 [updatestate_useless_node_eliminater]: 3.41001e-06 [accelerated_algorithm]: 3.81001e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 3.32002e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 3.09001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.632e-05 [j_node_and_user_rematch]: 6.83e-06 [meta_fg_expand]: 0.00011955 [replace_old_param]: 5.74e-06 [inline_without_move]: 3.76999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 1.21002e-06 [auto_monad_eliminator]: 5.13002e-06 [cse]: 1.202e-05 [replace_applicator]: 4e-06 [py_interpret_to_execute_after_opt_a]: 1.079e-05 [rewriter_after_opt_a]: 3.683e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 4.73001e-06 [mutable_eliminate]: 0.00067284 [jit_opt_b]: 4.197e-05, [1] [Cycle 1]: 3.407e-05, [2] [frontend_op_eliminate]: 1.031e-05 [inline_after_opt_a]: 1.173e-05 [cconv]: 2.912e-05 [loop_unroll]: 0.00043658 [jit_opt_after_cconv]: 0.0001356, [1] [Cycle 1]: 0.00012922, [11] [c_1]: 1.289e-05 [parameter_eliminate]: 3.47002e-06 [updatestate_depend_eliminate]: 6.34001e-06 [updatestate_assign_eliminate]: 1.71998e-06 [updatestate_loads_eliminate]: 1.47999e-06 [cse]: 2.094e-05 [call_graph_tuple_transform]: 1.716e-05 [tuple_list_get_item_eliminator]: 4.60001e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 9.50007e-07 [switch_simplify]: 3.88001e-06 [remove_dup_value]: 1.367e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 5.04998e-06 [add_recomputation]: 3.876e-05 [cse_after_recomputation]: 2.017e-05, [1] [Cycle 1]: 1.432e-05, [1] [cse]: 7.66001e-06 [auto_monad_reorder]: 1.406e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.89e-06 [opt_after_jit_grad]: 0.00044584 [symbol_engine_optimizer]: 6.727e-05, [1] [Cycle 1]: 6.126e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 6.41e-06 [elim_not_effective]: 9.92999e-06 [opt_reshape]: 4.03999e-06 [fold_const_symbol]: 5.94999e-06 [renormalize]: 6.40022e-07 [validate]: 3.7e-05 Sums bootstrap : 0.000249s : 0.16% type_inference : 0.134294s : 87.01% event_method : 0.000573s : 0.37% auto_monad : 0.000125s : 0.08% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000042s : 0.03% rewriter_before_opt_a : 0.000135s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.06% jit_opt_a.loop_unroll : 0.000103s : 0.07% jit_opt_a.a_1 : 0.001118s : 0.72% jit_opt_a.with_stream_mark : 0.000053s : 0.03% jit_opt_a.recompute_prepare : 0.000032s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000020s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.01% jit_opt_a.accelerated_algorithm : 0.000019s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000019s : 0.01% jit_opt_a.merge_forward : 0.000013s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000049s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000035s : 0.02% jit_opt_a.meta_fg_expand : 0.002200s : 1.43% jit_opt_a.replace_old_param : 0.000084s : 0.05% jit_opt_a.inline_without_move : 0.000072s : 0.05% jit_opt_a.renormalize : 0.012929s : 8.38% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000673s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000437s : 0.28% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.00% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000446s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.02% Time group info: ------[substitution.] 0.000343 56 0.41% : 0.000001s : 1: substitution.elim_not_effective 0.28% : 0.000001s : 1: substitution.fold_const_symbol 1.15% : 0.000004s : 1: substitution.graph_param_transform 70.10% : 0.000240s : 7: substitution.inline 6.81% : 0.000023s : 2: substitution.inline_without_move 2.29% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.12% : 0.000004s : 2: substitution.minmaximum_grad 1.21% : 0.000004s : 3: substitution.partial_eliminate 2.49% : 0.000009s : 9: substitution.remove_not_recompute_node 1.59% : 0.000005s : 2: substitution.replace_applicator 2.19% : 0.000008s : 10: substitution.replace_old_param 1.34% : 0.000005s : 1: substitution.set_cell_output_no_recompute 2.37% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.57% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.07% : 0.000017s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.134166 2 97.63% : 0.130987s : 1: type_inference.infer 2.37% : 0.003179s : 1: type_inference.specialize ------[replace.] 0.000092 9 80.03% : 0.000074s : 7: replace.inline 19.97% : 0.000018s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 9 94.94% : 0.000236s : 7: match.inline 5.06% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000203 1234 1.37% : 0.000003s : 20: predicate.accumulaten_eliminater 0.44% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.24% : 0.000003s : 20: predicate.addn_check_dump 1.65% : 0.000003s : 20: predicate.addn_zero_filter 1.94% : 0.000004s : 20: predicate.arithmetic_simplify 1.44% : 0.000003s : 20: predicate.cast_eliminate 0.16% : 0.000000s : 1: predicate.check_bprop_eliminate 1.28% : 0.000003s : 20: predicate.compare_switch_simplify 1.36% : 0.000003s : 20: predicate.depend_value_elim 1.23% : 0.000002s : 20: predicate.dict_get_item_const_eliminator 1.35% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.38% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.39% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.22% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 20: predicate.environ_get_add_eliminate 1.25% : 0.000003s : 20: predicate.environ_get_depend_swap 1.52% : 0.000003s : 20: predicate.environ_get_eliminate 1.23% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 1.19% : 0.000002s : 13: predicate.get_grad_eliminate 0.17% : 0.000000s : 1: predicate.graph_param_transform 4.54% : 0.000009s : 31: predicate.inline 3.78% : 0.000008s : 41: predicate.inline_without_move 0.54% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.42% : 0.000003s : 13: predicate.less_batch_normalization 1.50% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.76% : 0.000004s : 23: predicate.load_eliminater 0.57% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.67% : 0.000007s : 49: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 20: predicate.merge_addn 1.25% : 0.000003s : 20: predicate.minmaximum_grad 1.09% : 0.000002s : 1: predicate.mutable_eliminate 0.17% : 0.000000s : 1: predicate.opt_reshape 2.06% : 0.000004s : 23: predicate.partial_eliminate 1.31% : 0.000003s : 20: predicate.print_const_string_wrapper 1.95% : 0.000004s : 20: predicate.reduce_eliminate 1.48% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000002s : 13: predicate.remove_not_recompute_node 1.64% : 0.000003s : 24: predicate.replace_applicator 2.18% : 0.000004s : 41: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.49% : 0.000003s : 20: predicate.reshape_eliminate 1.57% : 0.000003s : 20: predicate.row_tensor_add_zeros_like 0.50% : 0.000001s : 1: predicate.row_tensor_eliminate 1.37% : 0.000003s : 20: predicate.same_eliminate 0.73% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.24% : 0.000000s : 2: predicate.special_op_eliminate 1.18% : 0.000002s : 13: predicate.specialize_transform 1.59% : 0.000003s : 20: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000003s : 20: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.80% : 0.000006s : 29: predicate.switch_defer_inline 2.34% : 0.000005s : 29: predicate.switch_layer_defer_inline 7.02% : 0.000014s : 79: predicate.switch_simplify 1.64% : 0.000003s : 20: predicate.tile_eliminate 1.45% : 0.000003s : 20: predicate.transpose_eliminate 1.68% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.24% : 0.000007s : 24: predicate.tuple_list_get_item_eliminator 1.60% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.61% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.70% : 0.000003s : 23: predicate.updatestate_pure_node_eliminater 2.80% : 0.000006s : 36: predicate.updatestate_useless_node_eliminater 1.78% : 0.000004s : 20: predicate.value_based_eliminate 0.08% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.21% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003360 38 87.83% : 0.002951s : 28: func_graph_cloner_run.FuncGraphClonerGraph 12.17% : 0.000409s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.174370 72 0.02% : 0.000042s : 1: add_recomputation 0.08% : 0.000132s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.15% : 0.000270s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.33% : 0.000584s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 12.69% : 0.022128s : 1: jit_opt_a 0.08% : 0.000138s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.26% : 0.000445s : 1: loop_unroll 0.39% : 0.000682s : 1: mutable_eliminate 0.94% : 0.001647s : 26: opt.transform.jit_opt_a 0.02% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000455s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.07% : 0.012321s : 1: renormalize.infer 0.34% : 0.000593s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000139s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 77.03% : 0.134319s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.668.280 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d040> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.669.486 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.027165, [30] [bootstrap]: 0.00041605 [type_inference]: 0.00583505 [event_method]: 2.071e-05 [auto_monad]: 6.946e-05 [graph_reusing]: 6.28002e-06 [pre_auto_parallel]: 3.02002e-06 [py_interpret_to_execute]: 3.764e-05 [rewriter_before_opt_a]: 7.484e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0180733, [2] [Cycle 1]: 0.0140394, [27] [switch_simplify]: 6.314e-05 [loop_unroll]: 3.035e-05 [a_1]: 0.00056187 [with_stream_mark]: 2.147e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.86999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.50002e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.13002e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.0129399 [add_forward_monad_depend]: 1.326e-05 [auto_monad_grad]: 2.58003e-06 [auto_monad_eliminator]: 2.478e-05 [cse]: 3.958e-05 [replace_applicator]: 2.56e-05 [Cycle 2]: 0.00040956, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00010051 [with_stream_mark]: 1.928e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.63997e-06 [merge_forward]: 4.44002e-06 [cell_reuse_recompute_pass]: 3.32002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.18e-05 [j_node_and_user_rematch]: 9.78998e-06 [meta_fg_expand]: 3.05002e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 4.82998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.15002e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 1.001e-05 [cse]: 1.756e-05 [replace_applicator]: 6.58e-06 [py_interpret_to_execute_after_opt_a]: 2.193e-05 [rewriter_after_opt_a]: 4.485e-05 [convert_after_rewriter]: 7.82998e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.00084153 [jit_opt_b]: 5.916e-05, [1] [Cycle 1]: 4.972e-05, [2] [frontend_op_eliminate]: 1.88e-05 [inline_after_opt_a]: 1.856e-05 [cconv]: 3.712e-05 [loop_unroll]: 0.00046914 [jit_opt_after_cconv]: 0.00018155, [1] [Cycle 1]: 0.00017429, [11] [c_1]: 2.182e-05 [parameter_eliminate]: 5.74e-06 [updatestate_depend_eliminate]: 1.108e-05 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 3.86e-05 [call_graph_tuple_transform]: 2.396e-05 [tuple_list_get_item_eliminator]: 5.80002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.662e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 7.32002e-06 [add_recomputation]: 6.108e-05 [cse_after_recomputation]: 2.62e-05, [1] [Cycle 1]: 2.04e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.92e-05 [get_jit_bprop_graph]: 2.53003e-06 [rewriter_after_jit_bprop_graph]: 7.75998e-06 [opt_after_jit_grad]: 0.00048115 [symbol_engine_optimizer]: 7.411e-05, [1] [Cycle 1]: 6.815e-05, [6] [build]: 4.33999e-06 [elim_shapecalc]: 7.99002e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.37e-06 [renormalize]: 3.30008e-07 [validate]: 4.579e-05 Sums bootstrap : 0.000416s : 1.82% type_inference : 0.005835s : 25.55% event_method : 0.000021s : 0.09% auto_monad : 0.000069s : 0.30% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000038s : 0.16% rewriter_before_opt_a : 0.000075s : 0.33% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.31% jit_opt_a.loop_unroll : 0.000036s : 0.16% jit_opt_a.a_1 : 0.000662s : 2.90% jit_opt_a.with_stream_mark : 0.000041s : 0.18% jit_opt_a.recompute_prepare : 0.000015s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000009s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.09% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.012940s : 56.66% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.15% jit_opt_a.cse : 0.000057s : 0.25% jit_opt_a.replace_applicator : 0.000032s : 0.14% py_interpret_to_execute_after_opt_a : 0.000022s : 0.10% rewriter_after_opt_a : 0.000045s : 0.20% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000842s : 3.68% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.08% jit_opt_b.inline_after_opt_a : 0.000019s : 0.08% cconv : 0.000037s : 0.16% loop_unroll : 0.000469s : 2.05% jit_opt_after_cconv.c_1 : 0.000022s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000061s : 0.27% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000481s : 2.11% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.20% Time group info: ------[substitution.] 0.000239 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000007s : 3: substitution.graph_param_transform 83.69% : 0.000200s : 4: substitution.inline 1.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000006s : 4: substitution.remove_not_recompute_node 2.73% : 0.000007s : 2: substitution.replace_old_param 5.21% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005754 2 84.64% : 0.004870s : 1: type_inference.infer 15.36% : 0.000884s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.11% : 0.000048s : 4: replace.inline 31.89% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 6 94.64% : 0.000198s : 4: match.inline 5.36% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 1.63% : 0.000002s : 10: predicate.arithmetic_simplify 1.51% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 3.15% : 0.000004s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000003s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.42% : 0.000002s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.19% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.75% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.60% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000860 13 51.66% : 0.000444s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.81% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.54% : 0.000366s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041079 72 0.16% : 0.000065s : 1: add_recomputation 0.18% : 0.000073s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 1.08% : 0.000444s : 1: bootstrap 0.10% : 0.000040s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 44.00% : 0.018077s : 1: jit_opt_a 0.45% : 0.000184s : 1: jit_opt_after_cconv 0.15% : 0.000063s : 1: jit_opt_b 1.17% : 0.000479s : 1: loop_unroll 2.09% : 0.000860s : 1: mutable_eliminate 2.22% : 0.000914s : 26: opt.transform.jit_opt_a 0.13% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000024s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.19% : 0.000489s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000041s : 1: py_interpret_to_execute 0.06% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 0.76% : 0.000314s : 1: renormalize.infer 30.71% : 0.012616s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000049s : 1: rewriter_after_opt_a 0.19% : 0.000078s : 1: rewriter_before_opt_a 0.19% : 0.000077s : 1: symbol_engine_optimizer 14.26% : 0.005857s : 1: type_inference TotalTime = 0.148827, [30] [bootstrap]: 0.00026608 [type_inference]: 0.126418 [event_method]: 0.00052141 [auto_monad]: 0.00011411 [graph_reusing]: 7.61999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 9.238e-05 [rewriter_before_opt_a]: 0.0001559 [expand_dump_flag]: 3.62002e-06 [jit_opt_a]: 0.0190451, [2] [Cycle 1]: 0.0150323, [27] [switch_simplify]: 7.668e-05 [loop_unroll]: 4.466e-05 [a_1]: 0.00104526 [with_stream_mark]: 3.374e-05 [recompute_prepare]: 2.149e-05 [updatestate_depend_eliminate]: 9.49999e-06 [updatestate_assign_eliminate]: 7.00998e-06 [updatestate_loads_eliminate]: 7.05002e-06 [parameter_eliminate]: 2.60002e-06 [specialize_transform]: 1.425e-05 [updatestate_useless_node_eliminater]: 1.321e-05 [accelerated_algorithm]: 1.382e-05 [meta_shard_fg_expand]: 3.80998e-06 [get_grad_eliminate_]: 1.413e-05 [merge_forward]: 8.12998e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.974e-05 [j_node_and_user_rematch]: 2.465e-05 [meta_fg_expand]: 0.00187962 [replace_old_param]: 7.13e-05 [inline_without_move]: 6.798e-05 [renormalize]: 0.0113407 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.412e-05 [cse]: 2.636e-05 [replace_applicator]: 1.868e-05 [Cycle 2]: 0.00037903, [27] [switch_simplify]: 5.22999e-06 [loop_unroll]: 4.30999e-06 [a_1]: 5.129e-05 [with_stream_mark]: 1.211e-05 [recompute_prepare]: 3.97e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 3.65e-06 [updatestate_useless_node_eliminater]: 3.3e-06 [accelerated_algorithm]: 3.72002e-06 [meta_shard_fg_expand]: 1.66998e-06 [get_grad_eliminate_]: 3.68e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 2.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.411e-05 [j_node_and_user_rematch]: 7.1e-06 [meta_fg_expand]: 9.432e-05 [replace_old_param]: 5.57001e-06 [inline_without_move]: 3.40998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 4.50001e-06 [cse]: 1.017e-05 [replace_applicator]: 4.02e-06 [py_interpret_to_execute_after_opt_a]: 1.101e-05 [rewriter_after_opt_a]: 3.313e-05 [convert_after_rewriter]: 5.94e-06 [order_py_execute_after_rewriter]: 4.17e-06 [mutable_eliminate]: 0.00063935 [jit_opt_b]: 4.012e-05, [1] [Cycle 1]: 3.352e-05, [2] [frontend_op_eliminate]: 1.057e-05 [inline_after_opt_a]: 1.144e-05 [cconv]: 2.418e-05 [loop_unroll]: 0.00045469 [jit_opt_after_cconv]: 0.00012497, [1] [Cycle 1]: 0.00011858, [11] [c_1]: 1.309e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 1.82001e-06 [updatestate_loads_eliminate]: 1.54998e-06 [cse]: 1.627e-05 [call_graph_tuple_transform]: 1.519e-05 [tuple_list_get_item_eliminator]: 3.83001e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 3.98001e-06 [remove_dup_value]: 1.514e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 5.35001e-06 [add_recomputation]: 3.549e-05 [cse_after_recomputation]: 2.071e-05, [1] [Cycle 1]: 1.524e-05, [1] [cse]: 8.84e-06 [auto_monad_reorder]: 1.456e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00045334 [symbol_engine_optimizer]: 6.977e-05, [1] [Cycle 1]: 6.366e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 5.87999e-06 [elim_not_effective]: 1.052e-05 [opt_reshape]: 4.53001e-06 [fold_const_symbol]: 7.00002e-06 [renormalize]: 5.10016e-07 [validate]: 3.164e-05 Sums bootstrap : 0.000266s : 0.18% type_inference : 0.126418s : 87.48% event_method : 0.000521s : 0.36% auto_monad : 0.000114s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000092s : 0.06% rewriter_before_opt_a : 0.000156s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.06% jit_opt_a.loop_unroll : 0.000049s : 0.03% jit_opt_a.a_1 : 0.001097s : 0.76% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000025s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000010s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000017s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.01% jit_opt_a.merge_forward : 0.000012s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000032s : 0.02% jit_opt_a.meta_fg_expand : 0.001974s : 1.37% jit_opt_a.replace_old_param : 0.000077s : 0.05% jit_opt_a.inline_without_move : 0.000071s : 0.05% jit_opt_a.renormalize : 0.011341s : 7.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000639s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000455s : 0.31% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000035s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000453s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000032s : 0.02% Time group info: ------[substitution.] 0.000351 56 0.42% : 0.000001s : 1: substitution.elim_not_effective 0.39% : 0.000001s : 1: substitution.fold_const_symbol 1.30% : 0.000005s : 1: substitution.graph_param_transform 71.41% : 0.000251s : 7: substitution.inline 6.84% : 0.000024s : 2: substitution.inline_without_move 2.09% : 0.000007s : 9: substitution.j_node_and_user_rematch 1.10% : 0.000004s : 2: substitution.minmaximum_grad 1.26% : 0.000004s : 3: substitution.partial_eliminate 2.29% : 0.000008s : 9: substitution.remove_not_recompute_node 1.69% : 0.000006s : 2: substitution.replace_applicator 1.87% : 0.000007s : 10: substitution.replace_old_param 0.66% : 0.000002s : 1: substitution.set_cell_output_no_recompute 2.35% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.55% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 4.78% : 0.000017s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126307 2 97.38% : 0.123001s : 1: type_inference.infer 2.62% : 0.003306s : 1: type_inference.specialize ------[replace.] 0.000085 9 78.20% : 0.000066s : 7: replace.inline 21.80% : 0.000018s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 9 95.36% : 0.000247s : 7: match.inline 4.64% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000191 1234 1.43% : 0.000003s : 20: predicate.accumulaten_eliminater 0.39% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000003s : 20: predicate.addn_check_dump 1.74% : 0.000003s : 20: predicate.addn_zero_filter 1.87% : 0.000004s : 20: predicate.arithmetic_simplify 1.40% : 0.000003s : 20: predicate.cast_eliminate 0.17% : 0.000000s : 1: predicate.check_bprop_eliminate 1.26% : 0.000002s : 20: predicate.compare_switch_simplify 1.31% : 0.000003s : 20: predicate.depend_value_elim 1.37% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.35% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.39% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.42% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.13% : 0.000000s : 1: predicate.elim_not_effective 0.21% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 20: predicate.environ_get_add_eliminate 1.37% : 0.000003s : 20: predicate.environ_get_depend_swap 1.36% : 0.000003s : 20: predicate.environ_get_eliminate 1.35% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.51% : 0.000003s : 13: predicate.get_grad_eliminate 0.16% : 0.000000s : 1: predicate.graph_param_transform 4.43% : 0.000008s : 31: predicate.inline 3.30% : 0.000006s : 41: predicate.inline_without_move 0.51% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.35% : 0.000003s : 13: predicate.less_batch_normalization 1.61% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 23: predicate.load_eliminater 0.62% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.82% : 0.000007s : 49: predicate.loop_unroll_before_grad 1.67% : 0.000003s : 21: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 20: predicate.merge_addn 1.26% : 0.000002s : 20: predicate.minmaximum_grad 0.72% : 0.000001s : 1: predicate.mutable_eliminate 0.19% : 0.000000s : 1: predicate.opt_reshape 2.24% : 0.000004s : 23: predicate.partial_eliminate 1.33% : 0.000003s : 20: predicate.print_const_string_wrapper 1.82% : 0.000003s : 20: predicate.reduce_eliminate 1.66% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 13: predicate.remove_not_recompute_node 1.63% : 0.000003s : 24: predicate.replace_applicator 2.00% : 0.000004s : 41: predicate.replace_old_param 0.13% : 0.000000s : 1: predicate.reset_defer_inline 1.41% : 0.000003s : 20: predicate.reshape_eliminate 1.38% : 0.000003s : 20: predicate.row_tensor_add_zeros_like 0.37% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000003s : 20: predicate.same_eliminate 0.70% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.47% : 0.000001s : 2: predicate.special_op_eliminate 1.09% : 0.000002s : 13: predicate.specialize_transform 1.84% : 0.000004s : 20: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000003s : 20: predicate.stack_unstack_eliminate 0.13% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.67% : 0.000005s : 29: predicate.switch_defer_inline 2.41% : 0.000005s : 29: predicate.switch_layer_defer_inline 6.78% : 0.000013s : 79: predicate.switch_simplify 1.37% : 0.000003s : 20: predicate.tile_eliminate 1.58% : 0.000003s : 20: predicate.transpose_eliminate 1.66% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000007s : 24: predicate.tuple_list_get_item_eliminator 1.85% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.52% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.50% : 0.000003s : 23: predicate.updatestate_pure_node_eliminater 2.84% : 0.000005s : 36: predicate.updatestate_useless_node_eliminater 1.84% : 0.000004s : 20: predicate.value_based_eliminate 0.13% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.30% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003394 38 87.66% : 0.002975s : 28: func_graph_cloner_run.FuncGraphClonerGraph 12.34% : 0.000419s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.161711 72 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000121s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.18% : 0.000295s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.33% : 0.000531s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 11.78% : 0.019048s : 1: jit_opt_a 0.08% : 0.000128s : 1: jit_opt_after_cconv 0.03% : 0.000043s : 1: jit_opt_b 0.29% : 0.000463s : 1: loop_unroll 0.40% : 0.000649s : 1: mutable_eliminate 0.95% : 0.001534s : 26: opt.transform.jit_opt_a 0.02% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000462s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000096s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 6.70% : 0.010827s : 1: renormalize.infer 0.31% : 0.000501s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.10% : 0.000161s : 1: rewriter_before_opt_a 0.04% : 0.000072s : 1: symbol_engine_optimizer 78.19% : 0.126440s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.830.024 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.830.718 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0792715, [30] [bootstrap]: 0.00024983 [type_inference]: 0.0598694 [event_method]: 0.00030031 [auto_monad]: 0.00011553 [graph_reusing]: 8.36002e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 3.946e-05 [rewriter_before_opt_a]: 0.00012581 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.0162376, [2] [Cycle 1]: 0.0120646, [27] [switch_simplify]: 8.488e-05 [loop_unroll]: 4.805e-05 [a_1]: 0.00105972 [with_stream_mark]: 3.797e-05 [recompute_prepare]: 2.224e-05 [updatestate_depend_eliminate]: 9.98002e-06 [updatestate_assign_eliminate]: 7.25998e-06 [updatestate_loads_eliminate]: 7.35e-06 [parameter_eliminate]: 2.82002e-06 [specialize_transform]: 1.567e-05 [updatestate_useless_node_eliminater]: 1.474e-05 [accelerated_algorithm]: 1.424e-05 [meta_shard_fg_expand]: 4.28999e-06 [get_grad_eliminate_]: 1.467e-05 [merge_forward]: 9.68997e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.99e-05 [j_node_and_user_rematch]: 2.535e-05 [meta_fg_expand]: 0.00208355 [replace_old_param]: 7.888e-05 [inline_without_move]: 6.886e-05 [renormalize]: 0.00808935 [add_forward_monad_depend]: 8.19002e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.5e-05 [cse]: 2.93e-05 [replace_applicator]: 2.265e-05 [Cycle 2]: 0.00038804, [27] [switch_simplify]: 5.49998e-06 [loop_unroll]: 3.93999e-06 [a_1]: 4.98e-05 [with_stream_mark]: 1.441e-05 [recompute_prepare]: 4.3e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 3.83001e-06 [updatestate_useless_node_eliminater]: 4.18001e-06 [accelerated_algorithm]: 3.71999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 3.18998e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 3.71999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 6.35002e-06 [meta_fg_expand]: 9.896e-05 [replace_old_param]: 4.78001e-06 [inline_without_move]: 3.60998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 4.90999e-06 [cse]: 1.043e-05 [replace_applicator]: 3.83999e-06 [py_interpret_to_execute_after_opt_a]: 1.21e-05 [rewriter_after_opt_a]: 3.646e-05 [convert_after_rewriter]: 6.57002e-06 [order_py_execute_after_rewriter]: 4.38999e-06 [mutable_eliminate]: 0.00067557 [jit_opt_b]: 4.364e-05, [1] [Cycle 1]: 3.538e-05, [2] [frontend_op_eliminate]: 1.08e-05 [inline_after_opt_a]: 1.26e-05 [cconv]: 2.717e-05 [loop_unroll]: 0.00043745 [jit_opt_after_cconv]: 0.00016449, [1] [Cycle 1]: 0.00015811, [11] [c_1]: 1.317e-05 [parameter_eliminate]: 3.68999e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 1.72001e-06 [cse]: 2.09e-05 [call_graph_tuple_transform]: 1.724e-05 [tuple_list_get_item_eliminator]: 4.1e-06 [none_parameter_eliminate]: 2.07001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 3.84002e-06 [remove_dup_value]: 1.557e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 5.32999e-06 [add_recomputation]: 3.734e-05 [cse_after_recomputation]: 2.06e-05, [1] [Cycle 1]: 1.457e-05, [1] [cse]: 7.88001e-06 [auto_monad_reorder]: 1.407e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 6.28e-06 [opt_after_jit_grad]: 0.00048893 [symbol_engine_optimizer]: 6.892e-05, [1] [Cycle 1]: 6.238e-05, [6] [build]: 4.12e-06 [elim_shapecalc]: 6.58e-06 [elim_not_effective]: 9.84999e-06 [opt_reshape]: 4.41002e-06 [fold_const_symbol]: 6.31e-06 [renormalize]: 5.60016e-07 [validate]: 3.591e-05 Sums bootstrap : 0.000250s : 0.33% type_inference : 0.059869s : 80.11% event_method : 0.000300s : 0.40% auto_monad : 0.000116s : 0.15% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.05% rewriter_before_opt_a : 0.000126s : 0.17% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.12% jit_opt_a.loop_unroll : 0.000052s : 0.07% jit_opt_a.a_1 : 0.001110s : 1.48% jit_opt_a.with_stream_mark : 0.000052s : 0.07% jit_opt_a.recompute_prepare : 0.000027s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000010s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000020s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000019s : 0.03% jit_opt_a.accelerated_algorithm : 0.000018s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.02% jit_opt_a.merge_forward : 0.000013s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000032s : 0.04% jit_opt_a.meta_fg_expand : 0.002183s : 2.92% jit_opt_a.replace_old_param : 0.000084s : 0.11% jit_opt_a.inline_without_move : 0.000072s : 0.10% jit_opt_a.renormalize : 0.008089s : 10.82% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000040s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000676s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000437s : 0.59% jit_opt_after_cconv.c_1 : 0.000013s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.05% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000489s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.05% Time group info: ------[substitution.] 0.000325 56 0.45% : 0.000001s : 1: substitution.elim_not_effective 0.35% : 0.000001s : 1: substitution.fold_const_symbol 1.51% : 0.000005s : 1: substitution.graph_param_transform 68.28% : 0.000222s : 7: substitution.inline 6.94% : 0.000023s : 2: substitution.inline_without_move 2.35% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.39% : 0.000005s : 2: substitution.minmaximum_grad 1.35% : 0.000004s : 3: substitution.partial_eliminate 2.49% : 0.000008s : 9: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_applicator 2.30% : 0.000007s : 10: substitution.replace_old_param 0.81% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.71% : 0.000009s : 2: substitution.tuple_list_convert_item_index_to_positive 1.62% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.66% : 0.000018s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.059743 2 94.04% : 0.056185s : 1: type_inference.infer 5.96% : 0.003558s : 1: type_inference.specialize ------[replace.] 0.000083 9 79.24% : 0.000065s : 7: replace.inline 20.76% : 0.000017s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 9 94.21% : 0.000218s : 7: match.inline 5.79% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000204 1343 1.34% : 0.000003s : 22: predicate.accumulaten_eliminater 0.40% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.25% : 0.000003s : 22: predicate.addn_check_dump 1.47% : 0.000003s : 22: predicate.addn_zero_filter 2.00% : 0.000004s : 22: predicate.arithmetic_simplify 1.44% : 0.000003s : 22: predicate.cast_eliminate 0.14% : 0.000000s : 1: predicate.check_bprop_eliminate 1.23% : 0.000003s : 22: predicate.compare_switch_simplify 1.28% : 0.000003s : 22: predicate.depend_value_elim 1.50% : 0.000003s : 22: predicate.dict_get_item_const_eliminator 1.34% : 0.000003s : 22: predicate.dict_get_item_eliminator 1.33% : 0.000003s : 22: predicate.dict_set_item_eliminator 0.51% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.18% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000003s : 22: predicate.environ_add_const_eliminate 1.30% : 0.000003s : 22: predicate.environ_get_add_eliminate 1.27% : 0.000003s : 22: predicate.environ_get_depend_swap 1.38% : 0.000003s : 22: predicate.environ_get_eliminate 1.27% : 0.000003s : 22: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.17% : 0.000002s : 14: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.85% : 0.000010s : 33: predicate.inline 3.75% : 0.000008s : 42: predicate.inline_without_move 0.52% : 0.000001s : 14: predicate.j_node_and_user_rematch 1.28% : 0.000003s : 14: predicate.less_batch_normalization 1.56% : 0.000003s : 24: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 25: predicate.load_eliminater 0.60% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.78% : 0.000008s : 55: predicate.loop_unroll_before_grad 1.66% : 0.000003s : 23: predicate.make_slice_get_slice_eliminator 1.24% : 0.000003s : 22: predicate.merge_addn 1.32% : 0.000003s : 22: predicate.minmaximum_grad 0.69% : 0.000001s : 1: predicate.mutable_eliminate 0.19% : 0.000000s : 1: predicate.opt_reshape 2.09% : 0.000004s : 25: predicate.partial_eliminate 1.29% : 0.000003s : 22: predicate.print_const_string_wrapper 1.91% : 0.000004s : 22: predicate.reduce_eliminate 1.79% : 0.000004s : 24: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 14: predicate.remove_not_recompute_node 1.72% : 0.000004s : 26: predicate.replace_applicator 2.24% : 0.000005s : 42: predicate.replace_old_param 0.14% : 0.000000s : 1: predicate.reset_defer_inline 1.43% : 0.000003s : 22: predicate.reshape_eliminate 1.76% : 0.000004s : 22: predicate.row_tensor_add_zeros_like 0.29% : 0.000001s : 1: predicate.row_tensor_eliminate 1.32% : 0.000003s : 22: predicate.same_eliminate 0.72% : 0.000001s : 14: predicate.set_cell_output_no_recompute 0.28% : 0.000001s : 2: predicate.special_op_eliminate 1.21% : 0.000002s : 14: predicate.specialize_transform 1.78% : 0.000004s : 22: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000003s : 22: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.46% : 0.000005s : 31: predicate.switch_defer_inline 2.24% : 0.000005s : 31: predicate.switch_layer_defer_inline 6.96% : 0.000014s : 87: predicate.switch_simplify 1.49% : 0.000003s : 22: predicate.tile_eliminate 1.44% : 0.000003s : 22: predicate.transpose_eliminate 1.65% : 0.000003s : 22: predicate.tuple_list_convert_item_index_to_positive 1.64% : 0.000003s : 22: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000007s : 26: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 22: predicate.tuple_list_set_item_eliminator 1.68% : 0.000003s : 24: predicate.tuple_to_list_eliminator_ 1.45% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 3.22% : 0.000007s : 39: predicate.updatestate_useless_node_eliminater 1.64% : 0.000003s : 22: predicate.value_based_eliminate 0.10% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.22% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002777 33 84.36% : 0.002343s : 23: func_graph_cloner_run.FuncGraphClonerGraph 15.64% : 0.000434s : 10: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.088941 72 0.04% : 0.000040s : 1: add_recomputation 0.14% : 0.000123s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.31% : 0.000277s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.35% : 0.000309s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 18.26% : 0.016242s : 1: jit_opt_a 0.19% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000046s : 1: jit_opt_b 0.50% : 0.000446s : 1: loop_unroll 0.77% : 0.000685s : 1: mutable_eliminate 1.77% : 0.001574s : 26: opt.transform.jit_opt_a 0.04% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000042s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 8.47% : 0.007536s : 1: renormalize.infer 0.61% : 0.000541s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000039s : 1: rewriter_after_opt_a 0.14% : 0.000129s : 1: rewriter_before_opt_a 0.08% : 0.000072s : 1: symbol_engine_optimizer 67.35% : 0.059900s : 1: type_inference TotalTime = 0.0529049, [30] [bootstrap]: 0.00033771 [type_inference]: 0.0434008 [event_method]: 2.418e-05 [auto_monad]: 7.292e-05 [graph_reusing]: 5.50001e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00011788 [rewriter_before_opt_a]: 8.304e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00635102, [2] [Cycle 1]: 0.00234333, [27] [switch_simplify]: 6.38e-05 [loop_unroll]: 2.975e-05 [a_1]: 0.00057214 [with_stream_mark]: 2.356e-05 [recompute_prepare]: 8.23001e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 6.68998e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00129886 [add_forward_monad_depend]: 7.9e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.694e-05 [cse]: 3.46e-05 [replace_applicator]: 1.235e-05 [Cycle 2]: 0.0003343, [27] [switch_simplify]: 6.42001e-06 [loop_unroll]: 5.67999e-06 [a_1]: 9.782e-05 [with_stream_mark]: 1.131e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.78998e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 1.182e-05 [replace_applicator]: 4.97e-06 [py_interpret_to_execute_after_opt_a]: 1.328e-05 [rewriter_after_opt_a]: 3.705e-05 [convert_after_rewriter]: 6.29001e-06 [order_py_execute_after_rewriter]: 5.04003e-06 [mutable_eliminate]: 0.00069411 [jit_opt_b]: 0.00012426, [1] [Cycle 1]: 0.00011708, [2] [frontend_op_eliminate]: 8.479e-05 [inline_after_opt_a]: 1.655e-05 [cconv]: 2.8e-05 [loop_unroll]: 0.00049845 [jit_opt_after_cconv]: 0.00015313, [1] [Cycle 1]: 0.00014645, [11] [c_1]: 2.006e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 7.58999e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.76e-05 [call_graph_tuple_transform]: 2.05e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.522e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 6.76e-06 [add_recomputation]: 5.593e-05 [cse_after_recomputation]: 2.546e-05, [1] [Cycle 1]: 1.951e-05, [1] [cse]: 1.349e-05 [auto_monad_reorder]: 1.731e-05 [get_jit_bprop_graph]: 2.46998e-06 [rewriter_after_jit_bprop_graph]: 6.38e-06 [opt_after_jit_grad]: 0.00049925 [symbol_engine_optimizer]: 7.188e-05, [1] [Cycle 1]: 6.56e-05, [6] [build]: 4.38001e-06 [elim_shapecalc]: 7.93999e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.09002e-06 [renormalize]: 5.89993e-07 [validate]: 4.583e-05 Sums bootstrap : 0.000338s : 0.69% type_inference : 0.043401s : 89.28% event_method : 0.000024s : 0.05% auto_monad : 0.000073s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000118s : 0.24% rewriter_before_opt_a : 0.000083s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.14% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000670s : 1.38% jit_opt_a.with_stream_mark : 0.000035s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001299s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000046s : 0.10% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000037s : 0.08% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000694s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000085s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000028s : 0.06% loop_unroll : 0.000498s : 1.03% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.12% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000499s : 1.03% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.09% Time group info: ------[substitution.] 0.000242 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000005s : 3: substitution.graph_param_transform 85.76% : 0.000208s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 4.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043311 2 43.64% : 0.018899s : 1: type_inference.infer 56.36% : 0.024412s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.92% : 0.000052s : 4: replace.inline 30.08% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.94% : 0.000205s : 4: match.inline 5.06% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.92% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.32% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000914 13 41.50% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.53% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.97% : 0.000484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055216 72 0.11% : 0.000060s : 1: add_recomputation 0.14% : 0.000076s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.65% : 0.000357s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000018s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.51% : 0.006354s : 1: jit_opt_a 0.28% : 0.000156s : 1: jit_opt_after_cconv 0.23% : 0.000127s : 1: jit_opt_b 0.92% : 0.000507s : 1: loop_unroll 1.27% : 0.000704s : 1: mutable_eliminate 1.63% : 0.000898s : 26: opt.transform.jit_opt_a 0.09% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000095s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000507s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000121s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.53% : 0.000844s : 1: renormalize.infer 0.81% : 0.000445s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000040s : 1: rewriter_after_opt_a 0.16% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000074s : 1: symbol_engine_optimizer 78.64% : 0.043424s : 1: type_inference TotalTime = 0.0134056, [30] [bootstrap]: 0.00036862 [type_inference]: 0.00481541 [event_method]: 1.991e-05 [auto_monad]: 6.869e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 3.978e-05 [rewriter_before_opt_a]: 7.687e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.00588529, [2] [Cycle 1]: 0.00188301, [27] [switch_simplify]: 6.694e-05 [loop_unroll]: 3.104e-05 [a_1]: 0.00064252 [with_stream_mark]: 2.416e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 2.23998e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 3.018e-05 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 1.049e-05 [inline_without_move]: 5.35001e-06 [renormalize]: 0.00074724 [add_forward_monad_depend]: 5.47999e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.518e-05 [cse]: 3.63e-05 [replace_applicator]: 1.196e-05 [Cycle 2]: 0.00032784, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.379e-05 [with_stream_mark]: 9.05999e-06 [recompute_prepare]: 5.19998e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.16998e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 7.21001e-06 [inline_without_move]: 4.94e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.96998e-06 [cse]: 1.376e-05 [replace_applicator]: 5.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.351e-05 [rewriter_after_opt_a]: 3.894e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00054726 [jit_opt_b]: 5.245e-05, [1] [Cycle 1]: 4.524e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.674e-05 [cconv]: 2.602e-05 [loop_unroll]: 0.00042215 [jit_opt_after_cconv]: 0.0001442, [1] [Cycle 1]: 0.00013781, [11] [c_1]: 2.174e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.052e-05 [call_graph_tuple_transform]: 1.795e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 3.20026e-07 [switch_simplify]: 5.55001e-06 [remove_dup_value]: 1.644e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.10002e-06 [add_recomputation]: 4.619e-05 [cse_after_recomputation]: 2.332e-05, [1] [Cycle 1]: 1.82e-05, [1] [cse]: 1.242e-05 [auto_monad_reorder]: 1.765e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00045909 [symbol_engine_optimizer]: 7.273e-05, [1] [Cycle 1]: 6.671e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.68001e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 3.69997e-07 [validate]: 3.755e-05 Sums bootstrap : 0.000369s : 4.03% type_inference : 0.004815s : 52.69% event_method : 0.000020s : 0.22% auto_monad : 0.000069s : 0.75% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000040s : 0.44% rewriter_before_opt_a : 0.000077s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.80% jit_opt_a.loop_unroll : 0.000036s : 0.40% jit_opt_a.a_1 : 0.000736s : 8.06% jit_opt_a.with_stream_mark : 0.000033s : 0.36% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000038s : 0.42% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000747s : 8.18% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.23% jit_opt_a.cse : 0.000050s : 0.55% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000039s : 0.43% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000547s : 5.99% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000026s : 0.28% loop_unroll : 0.000422s : 4.62% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000046s : 0.51% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000459s : 5.02% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.41% Time group info: ------[substitution.] 0.000249 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000005s : 3: substitution.graph_param_transform 86.09% : 0.000215s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000005s : 2: substitution.replace_old_param 5.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004744 2 82.36% : 0.003907s : 1: type_inference.infer 17.64% : 0.000837s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.28% : 0.000051s : 4: replace.inline 32.72% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.63% : 0.000212s : 4: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 691 1.04% : 0.000002s : 10: predicate.accumulaten_eliminater 0.71% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.71% : 0.000001s : 10: predicate.addn_check_dump 0.96% : 0.000002s : 10: predicate.addn_zero_filter 1.40% : 0.000002s : 10: predicate.arithmetic_simplify 0.85% : 0.000001s : 10: predicate.cast_eliminate 0.32% : 0.000001s : 3: predicate.check_bprop_eliminate 0.73% : 0.000001s : 10: predicate.compare_switch_simplify 1.01% : 0.000002s : 10: predicate.depend_value_elim 0.77% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.84% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.84% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.61% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000001s : 3: predicate.elim_not_effective 0.38% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.83% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.76% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.76% : 0.000001s : 10: predicate.environ_get_depend_swap 0.90% : 0.000002s : 10: predicate.environ_get_eliminate 0.74% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.71% : 0.000001s : 6: predicate.get_grad_eliminate 0.18% : 0.000000s : 3: predicate.graph_param_transform 4.16% : 0.000007s : 22: predicate.inline 0.66% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.90% : 0.000002s : 6: predicate.less_batch_normalization 1.06% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.44% : 0.000002s : 15: predicate.load_eliminater 1.06% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.86% : 0.000001s : 10: predicate.merge_addn 0.82% : 0.000001s : 10: predicate.minmaximum_grad 1.14% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 1.61% : 0.000003s : 15: predicate.partial_eliminate 0.82% : 0.000001s : 10: predicate.print_const_string_wrapper 1.31% : 0.000002s : 10: predicate.reduce_eliminate 1.08% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.28% : 0.000002s : 18: predicate.replace_applicator 0.38% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 0.87% : 0.000001s : 10: predicate.reshape_eliminate 0.77% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.55% : 0.000001s : 3: predicate.row_tensor_eliminate 0.85% : 0.000001s : 10: predicate.same_eliminate 0.37% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.70% : 0.000001s : 6: predicate.specialize_transform 0.97% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.98% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.62% : 0.000003s : 16: predicate.switch_defer_inline 1.49% : 0.000003s : 16: predicate.switch_layer_defer_inline 5.68% : 0.000010s : 53: predicate.switch_simplify 0.97% : 0.000002s : 10: predicate.tile_eliminate 0.85% : 0.000001s : 10: predicate.transpose_eliminate 1.03% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.86% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 31.58% : 0.000053s : 18: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.03% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.16% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.23% : 0.000002s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000638 13 52.90% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.49% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.61% : 0.000246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015195 72 0.33% : 0.000049s : 1: add_recomputation 0.47% : 0.000072s : 1: auto_monad 0.14% : 0.000021s : 1: auto_monad_reorder 2.56% : 0.000390s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.75% : 0.005888s : 1: jit_opt_a 0.97% : 0.000147s : 1: jit_opt_after_cconv 0.36% : 0.000055s : 1: jit_opt_b 2.83% : 0.000430s : 1: loop_unroll 3.66% : 0.000556s : 1: mutable_eliminate 6.48% : 0.000985s : 26: opt.transform.jit_opt_a 0.32% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.07% : 0.000467s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000043s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.67% : 0.000406s : 1: renormalize.infer 2.19% : 0.000332s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000042s : 1: rewriter_after_opt_a 0.52% : 0.000080s : 1: rewriter_before_opt_a 0.50% : 0.000076s : 1: symbol_engine_optimizer 31.80% : 0.004831s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.932.820 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006da60> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.933.522 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0212382, [30] [bootstrap]: 0.000284 [type_inference]: 0.0116272 [event_method]: 1.988e-05 [auto_monad]: 6.647e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 4.655e-05 [rewriter_before_opt_a]: 8.511e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00669694, [2] [Cycle 1]: 0.00216442, [27] [switch_simplify]: 5.465e-05 [loop_unroll]: 3.292e-05 [a_1]: 0.00062273 [with_stream_mark]: 1.748e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.49001e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00110766 [add_forward_monad_depend]: 6.37001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.801e-05 [cse]: 2.721e-05 [replace_applicator]: 1.489e-05 [Cycle 2]: 0.00032553, [27] [switch_simplify]: 5.88002e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.037e-05 [with_stream_mark]: 1.076e-05 [recompute_prepare]: 5.43997e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 4.83001e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.66997e-06 [merge_forward]: 3.15998e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 5.50004e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.449e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.463e-05 [rewriter_after_opt_a]: 3.934e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00069539 [jit_opt_b]: 5.107e-05, [1] [Cycle 1]: 4.337e-05, [2] [frontend_op_eliminate]: 1.61e-05 [inline_after_opt_a]: 1.611e-05 [cconv]: 2.99e-05 [loop_unroll]: 0.00045662 [jit_opt_after_cconv]: 0.00015443, [1] [Cycle 1]: 0.00014777, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 3.19001e-06 [updatestate_depend_eliminate]: 6.64999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 3.02002e-06 [cse]: 2.79e-05 [call_graph_tuple_transform]: 2.085e-05 [tuple_list_get_item_eliminator]: 6.08998e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 3.786e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 5.03e-05 [cse_after_recomputation]: 4.157e-05, [1] [Cycle 1]: 3.556e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.913e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.77001e-06 [opt_after_jit_grad]: 0.00050896 [symbol_engine_optimizer]: 7.136e-05, [1] [Cycle 1]: 6.519e-05, [6] [build]: 2.97002e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.377e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 4.00003e-07 [validate]: 4.005e-05 Sums bootstrap : 0.000284s : 1.73% type_inference : 0.011627s : 70.64% event_method : 0.000020s : 0.12% auto_monad : 0.000066s : 0.40% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.28% rewriter_before_opt_a : 0.000085s : 0.52% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000061s : 0.37% jit_opt_a.loop_unroll : 0.000038s : 0.23% jit_opt_a.a_1 : 0.000713s : 4.33% jit_opt_a.with_stream_mark : 0.000028s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.001108s : 6.73% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.14% jit_opt_a.cse : 0.000042s : 0.25% jit_opt_a.replace_applicator : 0.000020s : 0.12% py_interpret_to_execute_after_opt_a : 0.000015s : 0.09% rewriter_after_opt_a : 0.000039s : 0.24% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000695s : 4.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000030s : 0.18% loop_unroll : 0.000457s : 2.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000038s : 0.23% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000050s : 0.31% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000509s : 3.09% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.24% Time group info: ------[substitution.] 0.000239 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000005s : 3: substitution.graph_param_transform 85.70% : 0.000205s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000005s : 2: substitution.replace_old_param 5.13% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011563 2 89.24% : 0.010318s : 1: type_inference.infer 10.76% : 0.001244s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.06% : 0.000064s : 5: replace.inline 31.94% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 7 94.79% : 0.000202s : 5: match.inline 5.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000002s : 11: predicate.arithmetic_simplify 1.49% : 0.000002s : 11: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.14% : 0.000001s : 11: predicate.environ_get_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000006s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.99% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 2.06% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000001s : 11: predicate.print_const_string_wrapper 2.07% : 0.000002s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 11: predicate.reshape_eliminate 1.44% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.69% : 0.000009s : 59: predicate.switch_simplify 1.20% : 0.000001s : 11: predicate.tile_eliminate 1.19% : 0.000001s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.90% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000908 16 46.99% : 0.000427s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.39% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.62% : 0.000414s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023347 72 0.23% : 0.000053s : 1: add_recomputation 0.30% : 0.000070s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.27% : 0.000296s : 1: bootstrap 0.14% : 0.000032s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000044s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.10% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 28.70% : 0.006701s : 1: jit_opt_a 0.67% : 0.000157s : 1: jit_opt_after_cconv 0.23% : 0.000054s : 1: jit_opt_b 1.99% : 0.000465s : 1: loop_unroll 3.02% : 0.000705s : 1: mutable_eliminate 4.01% : 0.000937s : 26: opt.transform.jit_opt_a 0.21% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000017s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.21% : 0.000517s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000049s : 1: py_interpret_to_execute 0.07% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000040s : 1: remove_dup_value 2.29% : 0.000535s : 1: renormalize.infer 2.41% : 0.000564s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000042s : 1: rewriter_after_opt_a 0.38% : 0.000088s : 1: rewriter_before_opt_a 0.32% : 0.000074s : 1: symbol_engine_optimizer 49.85% : 0.011639s : 1: type_inference TotalTime = 0.287175, [30] [bootstrap]: 0.00141768 [type_inference]: 0.274371 [event_method]: 2.131e-05 [auto_monad]: 6.948e-05 [graph_reusing]: 6.03002e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00023979 [rewriter_before_opt_a]: 8.246e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00875512, [2] [Cycle 1]: 0.00473975, [27] [switch_simplify]: 5.577e-05 [loop_unroll]: 2.987e-05 [a_1]: 0.00056653 [with_stream_mark]: 1.756e-05 [recompute_prepare]: 8.59e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 6.47001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.725e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 5.96e-06 [renormalize]: 0.00369038 [add_forward_monad_depend]: 7.65998e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.949e-05 [cse]: 3.208e-05 [replace_applicator]: 1.735e-05 [Cycle 2]: 0.00038893, [27] [switch_simplify]: 6.94001e-06 [loop_unroll]: 5.89e-06 [a_1]: 0.00012331 [with_stream_mark]: 1.129e-05 [recompute_prepare]: 5.73002e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.53002e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.635e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.217e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 1.33e-05 [rewriter_after_opt_a]: 3.669e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00061184 [jit_opt_b]: 5.293e-05, [1] [Cycle 1]: 4.573e-05, [2] [frontend_op_eliminate]: 1.752e-05 [inline_after_opt_a]: 1.719e-05 [cconv]: 2.573e-05 [loop_unroll]: 0.00041414 [jit_opt_after_cconv]: 0.00014528, [1] [Cycle 1]: 0.00013883, [11] [c_1]: 2.473e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 6.02999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.908e-05 [call_graph_tuple_transform]: 2.025e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.675e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 7.95e-06 [add_recomputation]: 4.989e-05 [cse_after_recomputation]: 2.043e-05, [1] [Cycle 1]: 1.529e-05, [1] [cse]: 9.96998e-06 [auto_monad_reorder]: 1.684e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00044836 [symbol_engine_optimizer]: 8.553e-05, [1] [Cycle 1]: 7.961e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 2.595e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 9.23002e-06 [renormalize]: 3.4002e-07 [validate]: 4.305e-05 Sums bootstrap : 0.001418s : 0.50% type_inference : 0.274371s : 96.98% event_method : 0.000021s : 0.01% auto_monad : 0.000069s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000240s : 0.08% rewriter_before_opt_a : 0.000082s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.02% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000690s : 0.24% jit_opt_a.with_stream_mark : 0.000029s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003690s : 1.30% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000023s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000037s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000612s : 0.22% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000414s : 0.15% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000448s : 0.16% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.02% Time group info: ------[substitution.] 0.000213 24 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.83% : 0.000006s : 4: substitution.graph_param_transform 82.16% : 0.000175s : 4: substitution.inline 2.30% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.97% : 0.000006s : 4: substitution.remove_not_recompute_node 2.11% : 0.000004s : 2: substitution.replace_old_param 6.00% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.274287 2 99.30% : 0.272371s : 1: type_inference.infer 0.70% : 0.001916s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.75% : 0.000044s : 4: replace.inline 33.25% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 93.66% : 0.000172s : 4: match.inline 6.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.09% : 0.000001s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.30% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.94% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000001s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 1.10% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.42% : 0.000009s : 58: predicate.switch_simplify 1.46% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.98% : 0.000003s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005547 26 88.86% : 0.004929s : 19: func_graph_cloner_run.FuncGraphClonerGraph 0.76% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 10.38% : 0.000576s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.291848 72 0.02% : 0.000053s : 1: add_recomputation 0.02% : 0.000073s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.50% : 0.001451s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.00% : 0.008758s : 1: jit_opt_a 0.05% : 0.000148s : 1: jit_opt_after_cconv 0.02% : 0.000055s : 1: jit_opt_b 0.14% : 0.000422s : 1: loop_unroll 0.21% : 0.000620s : 1: mutable_eliminate 0.32% : 0.000927s : 26: opt.transform.jit_opt_a 0.02% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000456s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000245s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.03% : 0.003014s : 1: renormalize.infer 0.23% : 0.000665s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000039s : 1: rewriter_after_opt_a 0.03% : 0.000087s : 1: rewriter_before_opt_a 0.03% : 0.000088s : 1: symbol_engine_optimizer 94.02% : 0.274395s : 1: type_inference TotalTime = 0.0363944, [30] [bootstrap]: 0.00025181 [type_inference]: 0.0165347 [event_method]: 6.269e-05 [auto_monad]: 0.00010151 [graph_reusing]: 7.98001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 3.145e-05 [rewriter_before_opt_a]: 0.00010653 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.0165013, [3] [Cycle 1]: 0.00773359, [27] [switch_simplify]: 8.351e-05 [loop_unroll]: 4.278e-05 [a_1]: 0.0009663 [with_stream_mark]: 3.857e-05 [recompute_prepare]: 2.138e-05 [updatestate_depend_eliminate]: 1.062e-05 [updatestate_assign_eliminate]: 8.07e-06 [updatestate_loads_eliminate]: 6.57002e-06 [parameter_eliminate]: 3.07002e-06 [specialize_transform]: 1.42e-05 [updatestate_useless_node_eliminater]: 1.237e-05 [accelerated_algorithm]: 1.258e-05 [meta_shard_fg_expand]: 4.41002e-06 [get_grad_eliminate_]: 1.248e-05 [merge_forward]: 8.48001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.797e-05 [j_node_and_user_rematch]: 2.316e-05 [meta_fg_expand]: 0.00195438 [replace_old_param]: 6.889e-05 [inline_without_move]: 6.01e-05 [renormalize]: 0.00363813 [add_forward_monad_depend]: 1.537e-05 [auto_monad_grad]: 6.91001e-06 [auto_monad_eliminator]: 6.403e-05 [cse]: 0.00024186 [replace_applicator]: 9.602e-05 [Cycle 2]: 0.00476033, [27] [switch_simplify]: 4.596e-05 [loop_unroll]: 4.383e-05 [a_1]: 0.00124483 [with_stream_mark]: 3.002e-05 [recompute_prepare]: 1.322e-05 [updatestate_depend_eliminate]: 8.01001e-06 [updatestate_assign_eliminate]: 4.15999e-06 [updatestate_loads_eliminate]: 5.03002e-06 [parameter_eliminate]: 2.94999e-06 [specialize_transform]: 9.44e-06 [updatestate_useless_node_eliminater]: 9.59999e-06 [accelerated_algorithm]: 8.86002e-06 [meta_shard_fg_expand]: 4.55001e-06 [get_grad_eliminate_]: 8.63001e-06 [merge_forward]: 5.69e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.217e-05 [j_node_and_user_rematch]: 1.566e-05 [meta_fg_expand]: 0.00014714 [replace_old_param]: 1.298e-05 [inline_without_move]: 8.77999e-06 [renormalize]: 0.00279449 [add_forward_monad_depend]: 1.157e-05 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 2.04e-05 [cse]: 3.172e-05 [replace_applicator]: 2.547e-05 [Cycle 3]: 0.00029597, [27] [switch_simplify]: 4.82998e-06 [loop_unroll]: 5.14e-06 [a_1]: 5.264e-05 [with_stream_mark]: 1.605e-05 [recompute_prepare]: 4.43999e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.77999e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 3.97998e-06 [updatestate_useless_node_eliminater]: 3.34001e-06 [accelerated_algorithm]: 3.86001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 3.65998e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.71e-05 [j_node_and_user_rematch]: 6.62002e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 3.14999e-06 [inline_without_move]: 3.18e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 3.73001e-06 [cse]: 1.007e-05 [replace_applicator]: 3.71999e-06 [py_interpret_to_execute_after_opt_a]: 1.547e-05 [rewriter_after_opt_a]: 3.928e-05 [convert_after_rewriter]: 5.62001e-06 [order_py_execute_after_rewriter]: 4.60001e-06 [mutable_eliminate]: 0.00083163 [jit_opt_b]: 4.759e-05, [1] [Cycle 1]: 3.975e-05, [2] [frontend_op_eliminate]: 1.2e-05 [inline_after_opt_a]: 1.432e-05 [cconv]: 3.505e-05 [loop_unroll]: 0.00055223 [jit_opt_after_cconv]: 0.00015094, [1] [Cycle 1]: 0.00014402, [11] [c_1]: 1.439e-05 [parameter_eliminate]: 4.27e-06 [updatestate_depend_eliminate]: 7.35e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 1.85001e-06 [cse]: 2.815e-05 [call_graph_tuple_transform]: 1.787e-05 [tuple_list_get_item_eliminator]: 4.53999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 7.7e-07 [switch_simplify]: 4.22e-06 [remove_dup_value]: 1.52e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.04999e-06 [add_recomputation]: 4.211e-05 [cse_after_recomputation]: 2.224e-05, [1] [Cycle 1]: 1.604e-05, [1] [cse]: 9.00999e-06 [auto_monad_reorder]: 4.457e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 7.94002e-06 [opt_after_jit_grad]: 0.00059542 [symbol_engine_optimizer]: 8.208e-05, [1] [Cycle 1]: 7.319e-05, [6] [build]: 4.95999e-06 [elim_shapecalc]: 6.86999e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 4.97e-06 [fold_const_symbol]: 7.3e-06 [renormalize]: 6.29982e-07 [validate]: 4.306e-05 Sums bootstrap : 0.000252s : 0.80% type_inference : 0.016535s : 52.23% event_method : 0.000063s : 0.20% auto_monad : 0.000102s : 0.32% graph_reusing : 0.000008s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000031s : 0.10% rewriter_before_opt_a : 0.000107s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000134s : 0.42% jit_opt_a.loop_unroll : 0.000092s : 0.29% jit_opt_a.a_1 : 0.002264s : 7.15% jit_opt_a.with_stream_mark : 0.000085s : 0.27% jit_opt_a.recompute_prepare : 0.000039s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000022s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.08% jit_opt_a.accelerated_algorithm : 0.000025s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.08% jit_opt_a.merge_forward : 0.000018s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.14% jit_opt_a.meta_fg_expand : 0.002104s : 6.64% jit_opt_a.replace_old_param : 0.000085s : 0.27% jit_opt_a.inline_without_move : 0.000072s : 0.23% jit_opt_a.renormalize : 0.006433s : 20.32% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.09% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000088s : 0.28% jit_opt_a.cse : 0.000284s : 0.90% jit_opt_a.replace_applicator : 0.000125s : 0.40% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000832s : 2.63% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.04% jit_opt_b.inline_after_opt_a : 0.000014s : 0.05% cconv : 0.000035s : 0.11% loop_unroll : 0.000552s : 1.74% jit_opt_after_cconv.c_1 : 0.000014s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000042s : 0.13% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000045s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000595s : 1.88% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.14% Time group info: ------[substitution.] 0.000640 105 0.35% : 0.000002s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.80% : 0.000005s : 1: substitution.graph_param_transform 64.88% : 0.000415s : 13: substitution.inline 3.38% : 0.000022s : 2: substitution.inline_without_move 1.68% : 0.000011s : 13: substitution.j_node_and_user_rematch 2.03% : 0.000013s : 7: substitution.minmaximum_grad 1.36% : 0.000009s : 5: substitution.partial_eliminate 1.94% : 0.000012s : 13: substitution.remove_not_recompute_node 5.70% : 0.000036s : 10: substitution.replace_applicator 1.01% : 0.000006s : 8: substitution.replace_old_param 1.32% : 0.000008s : 1: substitution.reshape_eliminate 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.12% : 0.000007s : 1: substitution.tile_eliminate 4.02% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.56% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.21% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016443 2 91.90% : 0.015112s : 1: type_inference.infer 8.10% : 0.001331s : 1: type_inference.specialize ------[replace.] 0.000186 20 64.83% : 0.000120s : 13: replace.inline 35.17% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000431 20 94.64% : 0.000408s : 13: match.inline 5.36% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000388 2537 1.50% : 0.000006s : 44: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.32% : 0.000005s : 44: predicate.addn_check_dump 1.55% : 0.000006s : 44: predicate.addn_zero_filter 2.06% : 0.000008s : 44: predicate.arithmetic_simplify 1.73% : 0.000007s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000006s : 44: predicate.compare_switch_simplify 1.50% : 0.000006s : 44: predicate.depend_value_elim 1.35% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.57% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.42% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.47% : 0.000006s : 44: predicate.environ_get_depend_swap 1.42% : 0.000005s : 44: predicate.environ_get_eliminate 1.42% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000004s : 18: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.36% : 0.000017s : 66: predicate.inline 1.98% : 0.000008s : 42: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.08% : 0.000004s : 18: predicate.less_batch_normalization 1.84% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 2.03% : 0.000008s : 52: predicate.load_eliminater 0.44% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.91% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.40% : 0.000005s : 44: predicate.merge_addn 1.47% : 0.000006s : 44: predicate.minmaximum_grad 0.62% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.25% : 0.000009s : 52: predicate.partial_eliminate 1.47% : 0.000006s : 44: predicate.print_const_string_wrapper 1.99% : 0.000008s : 44: predicate.reduce_eliminate 1.83% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 18: predicate.remove_not_recompute_node 2.82% : 0.000011s : 94: predicate.replace_applicator 1.11% : 0.000004s : 42: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.65% : 0.000006s : 44: predicate.reshape_eliminate 1.62% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000006s : 44: predicate.same_eliminate 0.47% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 2: predicate.special_op_eliminate 0.77% : 0.000003s : 18: predicate.specialize_transform 1.81% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.95% : 0.000011s : 64: predicate.switch_defer_inline 2.44% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.44% : 0.000025s : 154: predicate.switch_simplify 1.57% : 0.000006s : 44: predicate.tile_eliminate 1.51% : 0.000006s : 44: predicate.transpose_eliminate 1.86% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.87% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.94% : 0.000008s : 51: predicate.tuple_to_list_eliminator_ 1.74% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.75% : 0.000011s : 70: predicate.updatestate_useless_node_eliminater 1.95% : 0.000008s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002113 32 59.57% : 0.001259s : 15: func_graph_cloner_run.FuncGraphClonerGraph 40.43% : 0.000854s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045773 87 0.10% : 0.000046s : 1: add_recomputation 0.23% : 0.000106s : 1: auto_monad 0.10% : 0.000048s : 1: auto_monad_reorder 0.60% : 0.000277s : 1: bootstrap 0.08% : 0.000038s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.15% : 0.000068s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 36.06% : 0.016505s : 1: jit_opt_a 0.34% : 0.000154s : 1: jit_opt_after_cconv 0.11% : 0.000050s : 1: jit_opt_b 1.23% : 0.000562s : 1: loop_unroll 1.85% : 0.000847s : 1: mutable_eliminate 6.49% : 0.002969s : 39: opt.transform.jit_opt_a 0.08% : 0.000037s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000019s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000029s : 4: opt.transform.symbol_engine_opt 1.32% : 0.000606s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000034s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 9.34% : 0.004275s : 2: renormalize.infer 4.65% : 0.002130s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000110s : 1: rewriter_before_opt_a 0.19% : 0.000085s : 1: symbol_engine_optimizer 36.18% : 0.016559s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.981.313 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:30.982.017 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0450713, [30] [bootstrap]: 0.00025245 [type_inference]: 0.0181737 [event_method]: 8.95e-05 [auto_monad]: 0.0001182 [graph_reusing]: 7.67998e-06 [pre_auto_parallel]: 3.30998e-06 [py_interpret_to_execute]: 3.971e-05 [rewriter_before_opt_a]: 0.00013448 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.0234625, [3] [Cycle 1]: 0.0148765, [27] [switch_simplify]: 9.405e-05 [loop_unroll]: 4.55e-05 [a_1]: 0.00104805 [with_stream_mark]: 4.297e-05 [recompute_prepare]: 2.45e-05 [updatestate_depend_eliminate]: 1.022e-05 [updatestate_assign_eliminate]: 8.02998e-06 [updatestate_loads_eliminate]: 7.06001e-06 [parameter_eliminate]: 3.55003e-06 [specialize_transform]: 1.488e-05 [updatestate_useless_node_eliminater]: 1.309e-05 [accelerated_algorithm]: 1.317e-05 [meta_shard_fg_expand]: 5.71e-06 [get_grad_eliminate_]: 1.297e-05 [merge_forward]: 1.025e-05 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.073e-05 [j_node_and_user_rematch]: 2.499e-05 [meta_fg_expand]: 0.00221251 [replace_old_param]: 8.42e-05 [inline_without_move]: 0.00010077 [renormalize]: 0.0103198 [add_forward_monad_depend]: 1.571e-05 [auto_monad_grad]: 6.46e-06 [auto_monad_eliminator]: 6.409e-05 [cse]: 0.00025733 [replace_applicator]: 9.148e-05 [Cycle 2]: 0.00404575, [27] [switch_simplify]: 4.023e-05 [loop_unroll]: 3.929e-05 [a_1]: 0.00120091 [with_stream_mark]: 2.131e-05 [recompute_prepare]: 9.86e-06 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 4.83001e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.69999e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 3.36001e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 5.14e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.748e-05 [j_node_and_user_rematch]: 1.126e-05 [meta_fg_expand]: 0.00013951 [replace_old_param]: 1.069e-05 [inline_without_move]: 6.84999e-06 [renormalize]: 0.00219397 [add_forward_monad_depend]: 1.142e-05 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.855e-05 [cse]: 3.279e-05 [replace_applicator]: 2.263e-05 [Cycle 3]: 0.00028909, [27] [switch_simplify]: 4.78001e-06 [loop_unroll]: 3.91001e-06 [a_1]: 5.214e-05 [with_stream_mark]: 1.558e-05 [recompute_prepare]: 4.37e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 4.03999e-06 [updatestate_useless_node_eliminater]: 3.31999e-06 [accelerated_algorithm]: 3.62002e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 3.4e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 3.25e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.548e-05 [j_node_and_user_rematch]: 6.58e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 3.69002e-06 [inline_without_move]: 3.49001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 4.07e-06 [cse]: 9.96998e-06 [replace_applicator]: 3.63e-06 [py_interpret_to_execute_after_opt_a]: 1.758e-05 [rewriter_after_opt_a]: 3.978e-05 [convert_after_rewriter]: 6.11e-06 [order_py_execute_after_rewriter]: 4.68001e-06 [mutable_eliminate]: 0.0008794 [jit_opt_b]: 4.804e-05, [1] [Cycle 1]: 3.775e-05, [2] [frontend_op_eliminate]: 1.141e-05 [inline_after_opt_a]: 1.428e-05 [cconv]: 3.593e-05 [loop_unroll]: 0.00053204 [jit_opt_after_cconv]: 0.00016014, [1] [Cycle 1]: 0.00015133, [11] [c_1]: 1.357e-05 [parameter_eliminate]: 5.10001e-06 [updatestate_depend_eliminate]: 8.60001e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 3.276e-05 [call_graph_tuple_transform]: 1.873e-05 [tuple_list_get_item_eliminator]: 4.50999e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 4.26001e-06 [remove_dup_value]: 1.667e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 4.529e-05 [cse_after_recomputation]: 2.415e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.073e-05 [auto_monad_reorder]: 1.416e-05 [get_jit_bprop_graph]: 3.31999e-06 [rewriter_after_jit_bprop_graph]: 9.37999e-06 [opt_after_jit_grad]: 0.00057226 [symbol_engine_optimizer]: 7.532e-05, [1] [Cycle 1]: 6.799e-05, [6] [build]: 4.80001e-06 [elim_shapecalc]: 6.54999e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 4.47e-06 [fold_const_symbol]: 6.94999e-06 [renormalize]: 4.39992e-07 [validate]: 4.164e-05 Sums bootstrap : 0.000252s : 0.63% type_inference : 0.018174s : 45.69% event_method : 0.000089s : 0.23% auto_monad : 0.000118s : 0.30% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000040s : 0.10% rewriter_before_opt_a : 0.000134s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000139s : 0.35% jit_opt_a.loop_unroll : 0.000089s : 0.22% jit_opt_a.a_1 : 0.002301s : 5.78% jit_opt_a.with_stream_mark : 0.000080s : 0.20% jit_opt_a.recompute_prepare : 0.000039s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.06% jit_opt_a.accelerated_algorithm : 0.000024s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000019s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.11% jit_opt_a.meta_fg_expand : 0.002354s : 5.92% jit_opt_a.replace_old_param : 0.000099s : 0.25% jit_opt_a.inline_without_move : 0.000111s : 0.28% jit_opt_a.renormalize : 0.012514s : 31.46% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.22% jit_opt_a.cse : 0.000300s : 0.75% jit_opt_a.replace_applicator : 0.000118s : 0.30% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000879s : 2.21% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.03% jit_opt_b.inline_after_opt_a : 0.000014s : 0.04% cconv : 0.000036s : 0.09% loop_unroll : 0.000532s : 1.34% jit_opt_after_cconv.c_1 : 0.000014s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000045s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000014s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000572s : 1.44% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.10% Time group info: ------[substitution.] 0.000656 104 0.34% : 0.000002s : 1: substitution.elim_not_effective 0.22% : 0.000001s : 1: substitution.fold_const_symbol 0.72% : 0.000005s : 1: substitution.graph_param_transform 67.41% : 0.000442s : 13: substitution.inline 3.75% : 0.000025s : 2: substitution.inline_without_move 1.79% : 0.000012s : 12: substitution.j_node_and_user_rematch 1.80% : 0.000012s : 7: substitution.minmaximum_grad 1.30% : 0.000009s : 5: substitution.partial_eliminate 1.63% : 0.000011s : 12: substitution.remove_not_recompute_node 5.30% : 0.000035s : 10: substitution.replace_applicator 1.22% : 0.000008s : 10: substitution.replace_old_param 0.61% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.90% : 0.000006s : 1: substitution.tile_eliminate 3.62% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.48% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.90% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018048 2 90.62% : 0.016354s : 1: type_inference.infer 9.38% : 0.001694s : 1: type_inference.specialize ------[replace.] 0.000200 20 67.41% : 0.000135s : 13: replace.inline 32.59% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000457 20 94.94% : 0.000434s : 13: match.inline 5.06% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000444 2433 1.32% : 0.000006s : 42: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.23% : 0.000005s : 42: predicate.addn_check_dump 1.47% : 0.000007s : 42: predicate.addn_zero_filter 1.81% : 0.000008s : 42: predicate.arithmetic_simplify 1.35% : 0.000006s : 42: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.51% : 0.000007s : 42: predicate.compare_switch_simplify 1.39% : 0.000006s : 42: predicate.depend_value_elim 1.24% : 0.000006s : 42: predicate.dict_get_item_const_eliminator 1.49% : 0.000007s : 42: predicate.dict_get_item_eliminator 1.33% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.45% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.29% : 0.000006s : 42: predicate.environ_get_add_eliminate 12.01% : 0.000053s : 42: predicate.environ_get_depend_swap 1.51% : 0.000007s : 42: predicate.environ_get_eliminate 1.26% : 0.000006s : 42: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.68% : 0.000003s : 16: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 3.97% : 0.000018s : 64: predicate.inline 1.96% : 0.000009s : 44: predicate.inline_without_move 0.28% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.89% : 0.000004s : 16: predicate.less_batch_normalization 1.58% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.63% : 0.000007s : 50: predicate.load_eliminater 0.35% : 0.000002s : 1: predicate.loop_unroll_after_grad 2.91% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.42% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.23% : 0.000005s : 42: predicate.merge_addn 1.31% : 0.000006s : 42: predicate.minmaximum_grad 0.63% : 0.000003s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.00% : 0.000009s : 50: predicate.partial_eliminate 1.36% : 0.000006s : 42: predicate.print_const_string_wrapper 2.01% : 0.000009s : 42: predicate.reduce_eliminate 1.56% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000002s : 16: predicate.remove_not_recompute_node 2.25% : 0.000010s : 90: predicate.replace_applicator 1.08% : 0.000005s : 44: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.35% : 0.000006s : 42: predicate.reshape_eliminate 1.39% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.33% : 0.000006s : 42: predicate.same_eliminate 0.48% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.64% : 0.000003s : 16: predicate.specialize_transform 1.56% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.08% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.62% : 0.000012s : 62: predicate.switch_defer_inline 2.27% : 0.000010s : 62: predicate.switch_layer_defer_inline 6.10% : 0.000027s : 150: predicate.switch_simplify 1.36% : 0.000006s : 42: predicate.tile_eliminate 1.34% : 0.000006s : 42: predicate.transpose_eliminate 1.67% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.11% : 0.000014s : 51: predicate.tuple_list_get_item_eliminator 1.66% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.53% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.55% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.40% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 1.81% : 0.000008s : 42: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002734 36 61.60% : 0.001684s : 19: func_graph_cloner_run.FuncGraphClonerGraph 38.40% : 0.001050s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060624 87 0.08% : 0.000048s : 1: add_recomputation 0.20% : 0.000124s : 1: auto_monad 0.07% : 0.000043s : 1: auto_monad_reorder 0.46% : 0.000280s : 1: bootstrap 0.06% : 0.000039s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.16% : 0.000096s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 38.71% : 0.023467s : 1: jit_opt_a 0.27% : 0.000163s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.89% : 0.000542s : 1: loop_unroll 1.47% : 0.000893s : 1: mutable_eliminate 5.01% : 0.003038s : 39: opt.transform.jit_opt_a 0.06% : 0.000038s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000018s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000027s : 4: opt.transform.symbol_engine_opt 0.96% : 0.000583s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000042s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 16.77% : 0.010167s : 2: renormalize.infer 3.82% : 0.002317s : 2: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000043s : 1: rewriter_after_opt_a 0.23% : 0.000138s : 1: rewriter_before_opt_a 0.13% : 0.000079s : 1: symbol_engine_optimizer 30.03% : 0.018204s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.638.75 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.646.24 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.302149, [30] [bootstrap]: 0.00036388 [type_inference]: 0.287399 [event_method]: 2.764e-05 [auto_monad]: 9.016e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.00073344 [rewriter_before_opt_a]: 0.00010862 [expand_dump_flag]: 4.11001e-06 [jit_opt_a]: 0.0107453, [2] [Cycle 1]: 0.00606845, [27] [switch_simplify]: 7.457e-05 [loop_unroll]: 3.587e-05 [a_1]: 0.00081525 [with_stream_mark]: 3.047e-05 [recompute_prepare]: 9.77001e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.62002e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 8.66997e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 8.35999e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 7.25998e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.596e-05 [j_node_and_user_rematch]: 1.168e-05 [meta_fg_expand]: 3.13e-06 [replace_old_param]: 1.213e-05 [inline_without_move]: 7.2e-06 [renormalize]: 0.00411718 [add_forward_monad_depend]: 1.365e-05 [auto_monad_grad]: 2.95998e-06 [auto_monad_eliminator]: 2.776e-05 [cse]: 4.521e-05 [replace_applicator]: 3.02e-05 [Cycle 2]: 0.00043282, [27] [switch_simplify]: 7.88001e-06 [loop_unroll]: 7.15e-06 [a_1]: 0.00015541 [with_stream_mark]: 1.87e-05 [recompute_prepare]: 6.30002e-06 [updatestate_depend_eliminate]: 3.90998e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 6.10002e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 3.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.594e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.85998e-06 [replace_old_param]: 1.133e-05 [inline_without_move]: 5.84999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.498e-05 [replace_applicator]: 6.06998e-06 [py_interpret_to_execute_after_opt_a]: 1.936e-05 [rewriter_after_opt_a]: 5.063e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00086516 [jit_opt_b]: 6.168e-05, [1] [Cycle 1]: 5.254e-05, [2] [frontend_op_eliminate]: 2.196e-05 [inline_after_opt_a]: 1.901e-05 [cconv]: 3.443e-05 [loop_unroll]: 0.00046133 [jit_opt_after_cconv]: 0.00016971, [1] [Cycle 1]: 0.00016299, [11] [c_1]: 2.673e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 7.43e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.886e-05 [call_graph_tuple_transform]: 2.298e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.84999e-06 [remove_dup_value]: 2.13e-05 [partial_unused_args_eliminate]: 3.23998e-06 [environ_conv]: 1.025e-05 [add_recomputation]: 6.001e-05 [cse_after_recomputation]: 2.774e-05, [1] [Cycle 1]: 2.202e-05, [1] [cse]: 1.568e-05 [auto_monad_reorder]: 1.715e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 7.65e-06 [opt_after_jit_grad]: 0.00048447 [symbol_engine_optimizer]: 8.291e-05, [1] [Cycle 1]: 7.515e-05, [6] [build]: 4.41002e-06 [elim_shapecalc]: 9.04e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 7.77e-06 [fold_const_symbol]: 9.28002e-06 [renormalize]: 4.00003e-07 [validate]: 5.447e-05 Sums bootstrap : 0.000364s : 0.12% type_inference : 0.287399s : 96.87% event_method : 0.000028s : 0.01% auto_monad : 0.000090s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000733s : 0.25% rewriter_before_opt_a : 0.000109s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.000971s : 0.33% jit_opt_a.with_stream_mark : 0.000049s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004117s : 1.39% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.01% jit_opt_a.cse : 0.000060s : 0.02% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000051s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000865s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.000461s : 0.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000060s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000484s : 0.16% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.02% Time group info: ------[substitution.] 0.000350 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000007s : 4: substitution.graph_param_transform 83.32% : 0.000292s : 5: substitution.inline 1.30% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.33% : 0.000015s : 3: substitution.reduce_eliminate 1.74% : 0.000006s : 4: substitution.remove_not_recompute_node 2.06% : 0.000007s : 2: substitution.replace_old_param 4.26% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.287271 2 98.40% : 0.282683s : 1: type_inference.infer 1.60% : 0.004588s : 1: type_inference.specialize ------[replace.] 0.000116 7 66.70% : 0.000078s : 5: replace.inline 33.30% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000301 7 95.70% : 0.000288s : 5: match.inline 4.30% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 886 1.46% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.53% : 0.000004s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.48% : 0.000009s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.92% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.32% : 0.000007s : 40: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000004s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.56% : 0.000004s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.81% : 0.000011s : 64: predicate.switch_simplify 1.62% : 0.000003s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.77% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.81% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003102 25 61.43% : 0.001906s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.07% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.49% : 0.001101s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.307577 72 0.02% : 0.000064s : 1: add_recomputation 0.03% : 0.000094s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000384s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.50% : 0.010750s : 1: jit_opt_a 0.06% : 0.000173s : 1: jit_opt_after_cconv 0.02% : 0.000065s : 1: jit_opt_b 0.15% : 0.000470s : 1: loop_unroll 0.28% : 0.000876s : 1: mutable_eliminate 0.41% : 0.001257s : 26: opt.transform.jit_opt_a 0.02% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000744s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 0.96% : 0.002942s : 1: renormalize.infer 0.38% : 0.001162s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000054s : 1: rewriter_after_opt_a 0.04% : 0.000114s : 1: rewriter_before_opt_a 0.03% : 0.000086s : 1: symbol_engine_optimizer 93.45% : 0.287425s : 1: type_inference TotalTime = 0.0128098, [30] [bootstrap]: 0.00026451 [type_inference]: 0.00442458 [event_method]: 1.801e-05 [auto_monad]: 6.391e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 3.156e-05 [rewriter_before_opt_a]: 8.382e-05 [expand_dump_flag]: 2.89999e-06 [jit_opt_a]: 0.00597297, [2] [Cycle 1]: 0.00152336, [27] [switch_simplify]: 5.307e-05 [loop_unroll]: 2.902e-05 [a_1]: 0.0005341 [with_stream_mark]: 1.803e-05 [recompute_prepare]: 8.00999e-06 [updatestate_depend_eliminate]: 3.65998e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.29998e-06 [meta_shard_fg_expand]: 1.98002e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.2e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.0005779 [add_forward_monad_depend]: 5.44e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.403e-05 [cse]: 2.878e-05 [replace_applicator]: 1.077e-05 [Cycle 2]: 0.00030994, [27] [switch_simplify]: 5.55001e-06 [loop_unroll]: 4.88001e-06 [a_1]: 8.682e-05 [with_stream_mark]: 8.82999e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.253e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.56001e-06 [inline_without_move]: 4.84003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.10019e-07 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.39998e-06 [cse]: 9.65002e-06 [replace_applicator]: 4.95999e-06 [py_interpret_to_execute_after_opt_a]: 9.75002e-06 [rewriter_after_opt_a]: 3.429e-05 [convert_after_rewriter]: 7.25003e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00048203 [jit_opt_b]: 4.724e-05, [1] [Cycle 1]: 4.042e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.471e-05 [cconv]: 2.475e-05 [loop_unroll]: 0.00039125 [jit_opt_after_cconv]: 0.00013189, [1] [Cycle 1]: 0.00012592, [11] [c_1]: 1.986e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.41002e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 1.705e-05 [call_graph_tuple_transform]: 1.759e-05 [tuple_list_get_item_eliminator]: 4.97e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.442e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 5.20999e-06 [add_recomputation]: 4.807e-05 [cse_after_recomputation]: 2.148e-05, [1] [Cycle 1]: 1.639e-05, [1] [cse]: 1.069e-05 [auto_monad_reorder]: 1.538e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 4.22e-06 [opt_after_jit_grad]: 0.00042479 [symbol_engine_optimizer]: 6.937e-05, [1] [Cycle 1]: 6.346e-05, [6] [build]: 3.21001e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.206e-05 [opt_reshape]: 5.39e-06 [fold_const_symbol]: 8.61997e-06 [renormalize]: 3.19997e-07 [validate]: 3.413e-05 Sums bootstrap : 0.000265s : 3.26% type_inference : 0.004425s : 54.50% event_method : 0.000018s : 0.22% auto_monad : 0.000064s : 0.79% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000032s : 0.39% rewriter_before_opt_a : 0.000084s : 1.03% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.72% jit_opt_a.loop_unroll : 0.000034s : 0.42% jit_opt_a.a_1 : 0.000621s : 7.65% jit_opt_a.with_stream_mark : 0.000027s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000578s : 7.12% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.24% jit_opt_a.cse : 0.000038s : 0.47% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000034s : 0.42% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000482s : 5.94% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.30% loop_unroll : 0.000391s : 4.82% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000048s : 0.59% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000425s : 5.23% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.42% Time group info: ------[substitution.] 0.000206 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000005s : 3: substitution.graph_param_transform 84.02% : 0.000173s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000004s : 2: substitution.replace_old_param 6.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004367 2 81.89% : 0.003576s : 1: type_inference.infer 18.11% : 0.000791s : 1: type_inference.specialize ------[replace.] 0.000072 6 63.07% : 0.000046s : 4: replace.inline 36.93% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.67% : 0.000170s : 4: match.inline 6.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000000s : 3: predicate.graph_param_transform 6.24% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.98% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000586 13 52.97% : 0.000311s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.13% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.90% : 0.000240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014258 72 0.36% : 0.000051s : 1: add_recomputation 0.47% : 0.000067s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 1.98% : 0.000282s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 41.91% : 0.005975s : 1: jit_opt_a 0.94% : 0.000134s : 1: jit_opt_after_cconv 0.35% : 0.000050s : 1: jit_opt_b 2.80% : 0.000399s : 1: loop_unroll 3.43% : 0.000490s : 1: mutable_eliminate 5.79% : 0.000826s : 26: opt.transform.jit_opt_a 0.31% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.03% : 0.000432s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000034s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.18% : 0.000310s : 1: renormalize.infer 1.83% : 0.000260s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000037s : 1: rewriter_after_opt_a 0.61% : 0.000087s : 1: rewriter_before_opt_a 0.50% : 0.000072s : 1: symbol_engine_optimizer 31.11% : 0.004436s : 1: type_inference TotalTime = 0.07371, [30] [bootstrap]: 0.00035619 [type_inference]: 0.0652259 [event_method]: 2.023e-05 [auto_monad]: 6.932e-05 [graph_reusing]: 6.02001e-06 [pre_auto_parallel]: 2.20002e-06 [py_interpret_to_execute]: 0.00010111 [rewriter_before_opt_a]: 8.655e-05 [expand_dump_flag]: 2.86999e-06 [jit_opt_a]: 0.00566853, [2] [Cycle 1]: 0.00186484, [27] [switch_simplify]: 5.699e-05 [loop_unroll]: 2.88e-05 [a_1]: 0.00053061 [with_stream_mark]: 1.813e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 2.333e-05 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00088551 [add_forward_monad_depend]: 5.36998e-06 [auto_monad_grad]: 2.04e-06 [auto_monad_eliminator]: 1.491e-05 [cse]: 3.35e-05 [replace_applicator]: 1.221e-05 [Cycle 2]: 0.00031094, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 4.96002e-06 [a_1]: 8.91e-05 [with_stream_mark]: 8.1e-06 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.43998e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 5.12999e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 2.46998e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.205e-05 [j_node_and_user_rematch]: 7.57998e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.87998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.202e-05 [replace_applicator]: 4.87998e-06 [py_interpret_to_execute_after_opt_a]: 1.058e-05 [rewriter_after_opt_a]: 3.633e-05 [convert_after_rewriter]: 6.37001e-06 [order_py_execute_after_rewriter]: 5.31002e-06 [mutable_eliminate]: 0.00052023 [jit_opt_b]: 4.759e-05, [1] [Cycle 1]: 4.092e-05, [2] [frontend_op_eliminate]: 1.508e-05 [inline_after_opt_a]: 1.518e-05 [cconv]: 2.555e-05 [loop_unroll]: 0.00041693 [jit_opt_after_cconv]: 0.00013929, [1] [Cycle 1]: 0.00013315, [11] [c_1]: 1.997e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.149e-05 [call_graph_tuple_transform]: 1.837e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 6.03002e-06 [add_recomputation]: 4.914e-05 [cse_after_recomputation]: 2.155e-05, [1] [Cycle 1]: 1.688e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.732e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 4.53001e-06 [opt_after_jit_grad]: 0.00055037 [symbol_engine_optimizer]: 7.177e-05, [1] [Cycle 1]: 6.506e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.248e-05 [opt_reshape]: 5.88002e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 6.89994e-07 [validate]: 3.818e-05 Sums bootstrap : 0.000356s : 0.51% type_inference : 0.065226s : 93.65% event_method : 0.000020s : 0.03% auto_monad : 0.000069s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000101s : 0.15% rewriter_before_opt_a : 0.000087s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.09% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000620s : 0.89% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000028s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000886s : 1.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000046s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000520s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.000417s : 0.60% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000550s : 0.79% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.05% Time group info: ------[substitution.] 0.000208 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000005s : 3: substitution.graph_param_transform 84.02% : 0.000175s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 6.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065155 2 97.73% : 0.063677s : 1: type_inference.infer 2.27% : 0.001478s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.41% : 0.000047s : 4: replace.inline 32.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 93.58% : 0.000172s : 4: match.inline 6.42% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.31% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000830 13 47.25% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.00% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.75% : 0.000396s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075481 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.50% : 0.000376s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.51% : 0.005671s : 1: jit_opt_a 0.19% : 0.000142s : 1: jit_opt_after_cconv 0.07% : 0.000050s : 1: jit_opt_b 0.56% : 0.000425s : 1: loop_unroll 0.70% : 0.000528s : 1: mutable_eliminate 1.12% : 0.000846s : 26: opt.transform.jit_opt_a 0.06% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000559s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000104s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.67% : 0.000504s : 1: renormalize.infer 0.49% : 0.000372s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.12% : 0.000091s : 1: rewriter_before_opt_a 0.10% : 0.000074s : 1: symbol_engine_optimizer 86.43% : 0.065242s : 1: type_inference TotalTime = 0.0292782, [30] [bootstrap]: 0.00034725 [type_inference]: 0.00907334 [event_method]: 2.34e-05 [auto_monad]: 7.59e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.0104774 [rewriter_before_opt_a]: 0.00014768 [expand_dump_flag]: 6.63e-06 [jit_opt_a]: 0.00678031, [2] [Cycle 1]: 0.00231543, [27] [switch_simplify]: 6.973e-05 [loop_unroll]: 3.396e-05 [a_1]: 0.00072625 [with_stream_mark]: 2.605e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.10002e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.089e-05 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00110073 [add_forward_monad_depend]: 5.67001e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.562e-05 [cse]: 3.656e-05 [replace_applicator]: 1.248e-05 [Cycle 2]: 0.00033498, [27] [switch_simplify]: 5.87001e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.919e-05 [with_stream_mark]: 1.076e-05 [recompute_prepare]: 5.44998e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 1.78002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.103e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 7.04001e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.172e-05 [replace_applicator]: 4.94e-06 [py_interpret_to_execute_after_opt_a]: 1.333e-05 [rewriter_after_opt_a]: 4.018e-05 [convert_after_rewriter]: 6.77002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00064375 [jit_opt_b]: 5.334e-05, [1] [Cycle 1]: 4.596e-05, [2] [frontend_op_eliminate]: 1.828e-05 [inline_after_opt_a]: 1.665e-05 [cconv]: 2.813e-05 [loop_unroll]: 0.00042737 [jit_opt_after_cconv]: 0.00016775, [1] [Cycle 1]: 0.00016, [11] [c_1]: 2.215e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 7.05e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 2.624e-05 [call_graph_tuple_transform]: 1.876e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 1.888e-05 [remove_dup_value]: 1.563e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 6.37001e-06 [add_recomputation]: 5.279e-05 [cse_after_recomputation]: 2.408e-05, [1] [Cycle 1]: 1.826e-05, [1] [cse]: 1.227e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 5.10001e-06 [opt_after_jit_grad]: 0.00046439 [symbol_engine_optimizer]: 7.745e-05, [1] [Cycle 1]: 7.052e-05, [6] [build]: 4.50001e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.41e-05 [opt_reshape]: 5.94999e-06 [fold_const_symbol]: 9.23002e-06 [renormalize]: 5.3001e-07 [validate]: 4.228e-05 Sums bootstrap : 0.000347s : 1.42% type_inference : 0.009073s : 37.07% event_method : 0.000023s : 0.10% auto_monad : 0.000076s : 0.31% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.010477s : 42.81% rewriter_before_opt_a : 0.000148s : 0.60% expand_dump_flag : 0.000007s : 0.03% jit_opt_a.switch_simplify : 0.000076s : 0.31% jit_opt_a.loop_unroll : 0.000039s : 0.16% jit_opt_a.a_1 : 0.000825s : 3.37% jit_opt_a.with_stream_mark : 0.000037s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001101s : 4.50% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000048s : 0.20% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000644s : 2.63% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000028s : 0.11% loop_unroll : 0.000427s : 1.75% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000019s : 0.08% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000053s : 0.22% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000464s : 1.90% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.17% Time group info: ------[substitution.] 0.000317 27 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.67% : 0.000005s : 3: substitution.graph_param_transform 85.91% : 0.000272s : 5: substitution.inline 0.98% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.49% : 0.000011s : 3: substitution.reduce_eliminate 1.31% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000005s : 2: substitution.replace_old_param 3.88% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008996 2 86.55% : 0.007786s : 1: type_inference.infer 13.45% : 0.001210s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.08% : 0.000071s : 5: replace.inline 31.92% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 7 96.03% : 0.000269s : 5: match.inline 3.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.16% : 0.000001s : 11: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 11: predicate.addn_check_dump 1.42% : 0.000002s : 11: predicate.addn_zero_filter 2.23% : 0.000003s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.68% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.40% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.44% : 0.000002s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.29% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.72% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 16: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.06% : 0.000001s : 11: predicate.minmaximum_grad 2.00% : 0.000003s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 16: predicate.partial_eliminate 1.14% : 0.000001s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.71% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 11: predicate.reshape_eliminate 1.40% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 18: predicate.switch_defer_inline 2.27% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.57% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000992 16 49.07% : 0.000487s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.10% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.83% : 0.000415s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031490 72 0.18% : 0.000056s : 1: add_recomputation 0.25% : 0.000079s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.17% : 0.000370s : 1: bootstrap 0.10% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000028s : 1: event_method 0.03% : 0.000011s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 21.55% : 0.006785s : 1: jit_opt_a 0.54% : 0.000171s : 1: jit_opt_after_cconv 0.18% : 0.000056s : 1: jit_opt_b 1.38% : 0.000436s : 1: loop_unroll 2.07% : 0.000653s : 1: mutable_eliminate 3.36% : 0.001058s : 26: opt.transform.jit_opt_a 0.20% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.50% : 0.000473s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 33.38% : 0.010510s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 2.12% : 0.000667s : 1: renormalize.infer 1.35% : 0.000425s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.49% : 0.000155s : 1: rewriter_before_opt_a 0.25% : 0.000080s : 1: symbol_engine_optimizer 28.88% : 0.009093s : 1: type_inference TotalTime = 0.0164478, [30] [bootstrap]: 0.00034299 [type_inference]: 0.00473949 [event_method]: 1.74e-05 [auto_monad]: 6.362e-05 [graph_reusing]: 5.46002e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 3.54e-05 [rewriter_before_opt_a]: 7.129e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00539976, [2] [Cycle 1]: 0.00179759, [27] [switch_simplify]: 5.882e-05 [loop_unroll]: 3.042e-05 [a_1]: 0.00055598 [with_stream_mark]: 2.539e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.11002e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.96998e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 0.00077194 [add_forward_monad_depend]: 6.49999e-06 [auto_monad_grad]: 2.76999e-06 [auto_monad_eliminator]: 1.572e-05 [cse]: 3.835e-05 [replace_applicator]: 1.325e-05 [Cycle 2]: 0.00033002, [27] [switch_simplify]: 6.17001e-06 [loop_unroll]: 5.10001e-06 [a_1]: 8.916e-05 [with_stream_mark]: 1.277e-05 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 8.07e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.398e-05 [replace_applicator]: 5.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.579e-05 [rewriter_after_opt_a]: 3.847e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.38002e-06 [mutable_eliminate]: 0.00390498 [jit_opt_b]: 8.141e-05, [1] [Cycle 1]: 7.075e-05, [2] [frontend_op_eliminate]: 1.971e-05 [inline_after_opt_a]: 3.225e-05 [cconv]: 8.997e-05 [loop_unroll]: 0.00048213 [jit_opt_after_cconv]: 0.00019777, [1] [Cycle 1]: 0.00019043, [11] [c_1]: 2.38e-05 [parameter_eliminate]: 7.26001e-06 [updatestate_depend_eliminate]: 1.15e-05 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.43999e-06 [cse]: 4.61e-05 [call_graph_tuple_transform]: 2.525e-05 [tuple_list_get_item_eliminator]: 6.12999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.896e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 7.76001e-06 [add_recomputation]: 5.955e-05 [cse_after_recomputation]: 2.5e-05, [1] [Cycle 1]: 1.934e-05, [1] [cse]: 1.271e-05 [auto_monad_reorder]: 1.878e-05 [get_jit_bprop_graph]: 2.76e-06 [rewriter_after_jit_bprop_graph]: 8.59e-06 [opt_after_jit_grad]: 0.00048701 [symbol_engine_optimizer]: 7.569e-05, [1] [Cycle 1]: 6.872e-05, [6] [build]: 4.55001e-06 [elim_shapecalc]: 7.82998e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 5.67001e-06 [fold_const_symbol]: 8.44002e-06 [renormalize]: 4.99975e-07 [validate]: 4.634e-05 Sums bootstrap : 0.000343s : 2.73% type_inference : 0.004739s : 37.78% event_method : 0.000017s : 0.14% auto_monad : 0.000064s : 0.51% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.28% rewriter_before_opt_a : 0.000071s : 0.57% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.52% jit_opt_a.loop_unroll : 0.000036s : 0.28% jit_opt_a.a_1 : 0.000645s : 5.14% jit_opt_a.with_stream_mark : 0.000038s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000772s : 6.15% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000052s : 0.42% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.13% rewriter_after_opt_a : 0.000038s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.003905s : 31.13% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.16% jit_opt_b.inline_after_opt_a : 0.000032s : 0.26% cconv : 0.000090s : 0.72% loop_unroll : 0.000482s : 3.84% jit_opt_after_cconv.c_1 : 0.000024s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000046s : 0.37% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.06% add_recomputation : 0.000060s : 0.47% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000009s : 0.07% opt_after_jit_grad : 0.000487s : 3.88% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.37% Time group info: ------[substitution.] 0.000230 23 1.26% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 3: substitution.graph_param_transform 84.31% : 0.000194s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000006s : 2: substitution.replace_old_param 5.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004674 2 82.82% : 0.003871s : 1: type_inference.infer 17.18% : 0.000803s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.28% : 0.000048s : 4: replace.inline 31.72% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.39% : 0.000191s : 4: match.inline 5.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.18% : 0.000003s : 15: predicate.load_eliminater 1.65% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 3.29% : 0.000004s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.65% : 0.000001s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.15% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.02% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000711 13 58.33% : 0.000415s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.88% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.79% : 0.000247s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018169 72 0.34% : 0.000063s : 1: add_recomputation 0.37% : 0.000067s : 1: auto_monad 0.12% : 0.000022s : 1: auto_monad_reorder 2.00% : 0.000363s : 1: bootstrap 0.51% : 0.000093s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.12% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.74% : 0.005403s : 1: jit_opt_a 1.11% : 0.000201s : 1: jit_opt_after_cconv 0.47% : 0.000085s : 1: jit_opt_b 2.70% : 0.000491s : 1: loop_unroll 21.58% : 0.003921s : 1: mutable_eliminate 4.76% : 0.000865s : 26: opt.transform.jit_opt_a 0.32% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.24% : 0.000043s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.16% : 0.000028s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000496s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.38% : 0.000432s : 1: renormalize.infer 1.83% : 0.000332s : 1: renormalize.specialize 0.06% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000044s : 1: rewriter_after_opt_a 0.41% : 0.000074s : 1: rewriter_before_opt_a 0.43% : 0.000078s : 1: symbol_engine_optimizer 26.16% : 0.004753s : 1: type_inference TotalTime = 0.172076, [30] [bootstrap]: 0.00026723 [type_inference]: 0.138264 [event_method]: 0.00046808 [auto_monad]: 0.00011145 [graph_reusing]: 7.76001e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 3.613e-05 [rewriter_before_opt_a]: 0.00015113 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.0304197, [3] [Cycle 1]: 0.0216346, [27] [switch_simplify]: 0.00011158 [loop_unroll]: 4.424e-05 [a_1]: 0.00102721 [with_stream_mark]: 3.749e-05 [recompute_prepare]: 2.274e-05 [updatestate_depend_eliminate]: 9.17001e-06 [updatestate_assign_eliminate]: 6.94999e-06 [updatestate_loads_eliminate]: 6.59999e-06 [parameter_eliminate]: 2.66e-06 [specialize_transform]: 1.459e-05 [updatestate_useless_node_eliminater]: 1.35e-05 [accelerated_algorithm]: 1.351e-05 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 1.36e-05 [merge_forward]: 8.97e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.992e-05 [j_node_and_user_rematch]: 2.569e-05 [meta_fg_expand]: 0.00188116 [replace_old_param]: 7.26e-05 [inline_without_move]: 6.142e-05 [renormalize]: 0.0175153 [add_forward_monad_depend]: 1.319e-05 [auto_monad_grad]: 6.29001e-06 [auto_monad_eliminator]: 6.325e-05 [cse]: 0.00026438 [replace_applicator]: 9.422e-05 [Cycle 2]: 0.00449338, [27] [switch_simplify]: 4.315e-05 [loop_unroll]: 4.183e-05 [a_1]: 0.0011799 [with_stream_mark]: 2.1e-05 [recompute_prepare]: 1.028e-05 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.95998e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.97002e-06 [updatestate_useless_node_eliminater]: 6.47001e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.735e-05 [j_node_and_user_rematch]: 1.153e-05 [meta_fg_expand]: 0.00010846 [replace_old_param]: 7.92e-06 [inline_without_move]: 7.13e-06 [renormalize]: 0.00274407 [add_forward_monad_depend]: 8.27e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.572e-05 [cse]: 2.69e-05 [replace_applicator]: 1.699e-05 [Cycle 3]: 0.00026254, [27] [switch_simplify]: 4.44998e-06 [loop_unroll]: 3.73999e-06 [a_1]: 4.572e-05 [with_stream_mark]: 1.128e-05 [recompute_prepare]: 3.8e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 1.87999e-06 [updatestate_loads_eliminate]: 1.54e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 3.73999e-06 [updatestate_useless_node_eliminater]: 3.6e-06 [accelerated_algorithm]: 3.14001e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 3.10998e-06 [merge_forward]: 2.65002e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.18e-05 [j_node_and_user_rematch]: 6.11e-06 [meta_fg_expand]: 1.47999e-06 [replace_old_param]: 3.11001e-06 [inline_without_move]: 3.41999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 3.43e-06 [cse]: 9.24998e-06 [replace_applicator]: 3.43999e-06 [py_interpret_to_execute_after_opt_a]: 1.343e-05 [rewriter_after_opt_a]: 3.637e-05 [convert_after_rewriter]: 5.69999e-06 [order_py_execute_after_rewriter]: 4.48001e-06 [mutable_eliminate]: 0.00072466 [jit_opt_b]: 4.215e-05, [1] [Cycle 1]: 3.408e-05, [2] [frontend_op_eliminate]: 1.064e-05 [inline_after_opt_a]: 1.225e-05 [cconv]: 2.881e-05 [loop_unroll]: 0.00045376 [jit_opt_after_cconv]: 0.00013498, [1] [Cycle 1]: 0.00012787, [11] [c_1]: 1.29e-05 [parameter_eliminate]: 3.15002e-06 [updatestate_depend_eliminate]: 6.08998e-06 [updatestate_assign_eliminate]: 1.82999e-06 [updatestate_loads_eliminate]: 1.52001e-06 [cse]: 2.271e-05 [call_graph_tuple_transform]: 1.515e-05 [tuple_list_get_item_eliminator]: 4.1e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 4.50001e-06 [remove_dup_value]: 1.408e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 4.75999e-06 [add_recomputation]: 3.599e-05 [cse_after_recomputation]: 1.841e-05, [1] [Cycle 1]: 1.347e-05, [1] [cse]: 6.91001e-06 [auto_monad_reorder]: 1.367e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 5.46e-06 [opt_after_jit_grad]: 0.00045206 [symbol_engine_optimizer]: 6.613e-05, [1] [Cycle 1]: 5.856e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 5.61e-06 [elim_not_effective]: 1.029e-05 [opt_reshape]: 4.32e-06 [fold_const_symbol]: 5.61e-06 [renormalize]: 3.00002e-07 [validate]: 3.344e-05 Sums bootstrap : 0.000267s : 0.16% type_inference : 0.138264s : 82.75% event_method : 0.000468s : 0.28% auto_monad : 0.000111s : 0.07% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000036s : 0.02% rewriter_before_opt_a : 0.000151s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000159s : 0.10% jit_opt_a.loop_unroll : 0.000090s : 0.05% jit_opt_a.a_1 : 0.002253s : 1.35% jit_opt_a.with_stream_mark : 0.000070s : 0.04% jit_opt_a.recompute_prepare : 0.000037s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000025s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.01% jit_opt_a.accelerated_algorithm : 0.000024s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.01% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001991s : 1.19% jit_opt_a.replace_old_param : 0.000084s : 0.05% jit_opt_a.inline_without_move : 0.000072s : 0.04% jit_opt_a.renormalize : 0.020259s : 12.12% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.05% jit_opt_a.cse : 0.000301s : 0.18% jit_opt_a.replace_applicator : 0.000115s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000725s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000454s : 0.27% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000007s : 0.00% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000452s : 0.27% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.02% Time group info: ------[substitution.] 0.000582 104 0.22% : 0.000001s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.69% : 0.000004s : 1: substitution.graph_param_transform 65.54% : 0.000382s : 13: substitution.inline 3.00% : 0.000017s : 2: substitution.inline_without_move 1.69% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.07% : 0.000012s : 7: substitution.minmaximum_grad 1.29% : 0.000008s : 5: substitution.partial_eliminate 1.85% : 0.000011s : 12: substitution.remove_not_recompute_node 5.82% : 0.000034s : 10: substitution.replace_applicator 1.18% : 0.000007s : 10: substitution.replace_old_param 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000006s : 1: substitution.tile_eliminate 4.10% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.81% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.02% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.138156 2 97.80% : 0.135122s : 1: type_inference.infer 2.20% : 0.003035s : 1: type_inference.specialize ------[replace.] 0.000181 20 66.69% : 0.000121s : 13: replace.inline 33.31% : 0.000060s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000395 20 94.42% : 0.000373s : 13: match.inline 5.58% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000374 2544 1.53% : 0.000006s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.47% : 0.000006s : 44: predicate.addn_check_dump 1.59% : 0.000006s : 44: predicate.addn_zero_filter 2.03% : 0.000008s : 44: predicate.arithmetic_simplify 1.60% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.40% : 0.000005s : 44: predicate.compare_switch_simplify 1.49% : 0.000006s : 44: predicate.depend_value_elim 1.51% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.56% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.42% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.46% : 0.000005s : 44: predicate.environ_get_depend_swap 1.63% : 0.000006s : 44: predicate.environ_get_eliminate 1.38% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.77% : 0.000003s : 17: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.47% : 0.000017s : 66: predicate.inline 1.99% : 0.000007s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.91% : 0.000003s : 17: predicate.less_batch_normalization 1.86% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.84% : 0.000007s : 52: predicate.load_eliminater 0.30% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.36% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.64% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 44: predicate.merge_addn 2.01% : 0.000008s : 44: predicate.minmaximum_grad 0.54% : 0.000002s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.46% : 0.000009s : 52: predicate.partial_eliminate 1.55% : 0.000006s : 44: predicate.print_const_string_wrapper 1.95% : 0.000007s : 44: predicate.reduce_eliminate 1.85% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 17: predicate.remove_not_recompute_node 3.09% : 0.000012s : 96: predicate.replace_applicator 1.18% : 0.000004s : 45: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.52% : 0.000006s : 44: predicate.reshape_eliminate 1.69% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.57% : 0.000006s : 44: predicate.same_eliminate 0.46% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 17: predicate.specialize_transform 1.75% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.95% : 0.000011s : 64: predicate.switch_defer_inline 2.55% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.48% : 0.000024s : 157: predicate.switch_simplify 1.58% : 0.000006s : 44: predicate.tile_eliminate 1.53% : 0.000006s : 44: predicate.transpose_eliminate 1.90% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.67% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.90% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.75% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004031 45 77.61% : 0.003129s : 28: func_graph_cloner_run.FuncGraphClonerGraph 22.39% : 0.000902s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.195214 87 0.02% : 0.000039s : 1: add_recomputation 0.06% : 0.000117s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.15% : 0.000296s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.25% : 0.000481s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.58% : 0.030423s : 1: jit_opt_a 0.07% : 0.000138s : 1: jit_opt_after_cconv 0.02% : 0.000045s : 1: jit_opt_b 0.24% : 0.000463s : 1: loop_unroll 0.38% : 0.000736s : 1: mutable_eliminate 1.49% : 0.002918s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000460s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000039s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 9.23% : 0.018016s : 2: renormalize.infer 1.14% : 0.002222s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000154s : 1: rewriter_before_opt_a 0.04% : 0.000068s : 1: symbol_engine_optimizer 70.84% : 0.138291s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.286.412 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006d4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.287.831 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0123804, [30] [bootstrap]: 0.00031469 [type_inference]: 0.00500535 [event_method]: 1.727e-05 [auto_monad]: 6.549e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 3.726e-05 [rewriter_before_opt_a]: 7.568e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00491651, [2] [Cycle 1]: 0.00147634, [27] [switch_simplify]: 5.261e-05 [loop_unroll]: 3.002e-05 [a_1]: 0.00050652 [with_stream_mark]: 1.755e-05 [recompute_prepare]: 7.45e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.13998e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 0.00056759 [add_forward_monad_depend]: 5.34e-06 [auto_monad_grad]: 1.81003e-06 [auto_monad_eliminator]: 1.43e-05 [cse]: 2.725e-05 [replace_applicator]: 1.027e-05 [Cycle 2]: 0.00030197, [27] [switch_simplify]: 5.34998e-06 [loop_unroll]: 4.82e-06 [a_1]: 8.76e-05 [with_stream_mark]: 7.97e-06 [recompute_prepare]: 5.09998e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 4.84998e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 4.65001e-06 [meta_shard_fg_expand]: 1.14998e-06 [get_grad_eliminate_]: 4.43001e-06 [merge_forward]: 2.46998e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.146e-05 [j_node_and_user_rematch]: 7.51999e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 6.73e-06 [inline_without_move]: 4.82e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 9.94001e-06 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 8.35999e-06 [rewriter_after_opt_a]: 3.141e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00045179 [jit_opt_b]: 4.692e-05, [1] [Cycle 1]: 4.011e-05, [2] [frontend_op_eliminate]: 1.495e-05 [inline_after_opt_a]: 1.432e-05 [cconv]: 2.512e-05 [loop_unroll]: 0.00039412 [jit_opt_after_cconv]: 0.00012907, [1] [Cycle 1]: 0.00012284, [11] [c_1]: 1.976e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 1.607e-05 [call_graph_tuple_transform]: 1.675e-05 [tuple_list_get_item_eliminator]: 5.14e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 5.02e-06 [remove_dup_value]: 2.252e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 5.15999e-06 [add_recomputation]: 4.742e-05 [cse_after_recomputation]: 2.231e-05, [1] [Cycle 1]: 1.693e-05, [1] [cse]: 1.122e-05 [auto_monad_reorder]: 1.555e-05 [get_jit_bprop_graph]: 1.45001e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00045407 [symbol_engine_optimizer]: 6.943e-05, [1] [Cycle 1]: 6.366e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 7.57002e-06 [elim_not_effective]: 1.234e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 8.25e-06 [renormalize]: 3.9002e-07 [validate]: 3.348e-05 Sums bootstrap : 0.000315s : 3.61% type_inference : 0.005005s : 57.49% event_method : 0.000017s : 0.20% auto_monad : 0.000065s : 0.75% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000037s : 0.43% rewriter_before_opt_a : 0.000076s : 0.87% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000594s : 6.82% jit_opt_a.with_stream_mark : 0.000026s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000014s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000568s : 6.52% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000037s : 0.43% jit_opt_a.replace_applicator : 0.000015s : 0.18% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000031s : 0.36% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000452s : 5.19% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000014s : 0.16% cconv : 0.000025s : 0.29% loop_unroll : 0.000394s : 4.53% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000016s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000023s : 0.26% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.54% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000454s : 5.22% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.38% Time group info: ------[substitution.] 0.000188 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 83.61% : 0.000158s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000005s : 4: substitution.remove_not_recompute_node 1.51% : 0.000003s : 2: substitution.replace_old_param 6.54% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004943 2 81.36% : 0.004022s : 1: type_inference.infer 18.64% : 0.000922s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.86% : 0.000044s : 4: replace.inline 32.14% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.23% : 0.000155s : 4: match.inline 6.77% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.41% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.32% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000656 13 53.20% : 0.000349s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.25% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.55% : 0.000272s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013797 72 0.36% : 0.000050s : 1: add_recomputation 0.50% : 0.000069s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.43% : 0.000335s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 35.65% : 0.004919s : 1: jit_opt_a 0.95% : 0.000132s : 1: jit_opt_after_cconv 0.36% : 0.000049s : 1: jit_opt_b 2.91% : 0.000402s : 1: loop_unroll 3.33% : 0.000459s : 1: mutable_eliminate 5.76% : 0.000795s : 26: opt.transform.jit_opt_a 0.32% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000023s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.14% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000462s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000025s : 1: remove_dup_value 2.13% : 0.000294s : 1: renormalize.infer 1.93% : 0.000267s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000034s : 1: rewriter_after_opt_a 0.57% : 0.000079s : 1: rewriter_before_opt_a 0.52% : 0.000072s : 1: symbol_engine_optimizer 36.37% : 0.005018s : 1: type_inference TotalTime = 0.0562034, [30] [bootstrap]: 0.00027166 [type_inference]: 0.0478312 [event_method]: 1.981e-05 [auto_monad]: 6.988e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.63998e-06 [py_interpret_to_execute]: 0.00010568 [rewriter_before_opt_a]: 8.416e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0056851, [2] [Cycle 1]: 0.00197911, [27] [switch_simplify]: 5.826e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.00055144 [with_stream_mark]: 2.168e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 2.80997e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 5.98002e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 8.57998e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00098906 [add_forward_monad_depend]: 5.87001e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.509e-05 [cse]: 3.488e-05 [replace_applicator]: 1.207e-05 [Cycle 2]: 0.00031325, [27] [switch_simplify]: 5.95002e-06 [loop_unroll]: 4.99998e-06 [a_1]: 8.791e-05 [with_stream_mark]: 9.19998e-06 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 2.70002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.07002e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.222e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.98997e-06 [replace_old_param]: 7.14001e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 5.81998e-06 [cse]: 1.182e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.225e-05 [rewriter_after_opt_a]: 3.619e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00055863 [jit_opt_b]: 4.793e-05, [1] [Cycle 1]: 4.118e-05, [2] [frontend_op_eliminate]: 1.549e-05 [inline_after_opt_a]: 1.494e-05 [cconv]: 2.664e-05 [loop_unroll]: 0.00042029 [jit_opt_after_cconv]: 0.00013643, [1] [Cycle 1]: 0.00013041, [11] [c_1]: 2.025e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.64e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 1.976e-05 [call_graph_tuple_transform]: 1.783e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.19998e-06 [remove_dup_value]: 1.58e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 5.60001e-06 [add_recomputation]: 5.036e-05 [cse_after_recomputation]: 2.175e-05, [1] [Cycle 1]: 1.681e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.846e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 4.82998e-06 [opt_after_jit_grad]: 0.00045569 [symbol_engine_optimizer]: 7.173e-05, [1] [Cycle 1]: 6.515e-05, [6] [build]: 3.71999e-06 [elim_shapecalc]: 7.76001e-06 [elim_not_effective]: 1.248e-05 [opt_reshape]: 5.76998e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 4.00003e-07 [validate]: 3.838e-05 Sums bootstrap : 0.000272s : 0.52% type_inference : 0.047831s : 91.57% event_method : 0.000020s : 0.04% auto_monad : 0.000070s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.20% rewriter_before_opt_a : 0.000084s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000639s : 1.22% jit_opt_a.with_stream_mark : 0.000031s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000989s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000047s : 0.09% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000559s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000420s : 0.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 0.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.07% Time group info: ------[substitution.] 0.000224 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000005s : 3: substitution.graph_param_transform 85.28% : 0.000191s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047757 2 96.86% : 0.046259s : 1: type_inference.infer 3.14% : 0.001497s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.48% : 0.000049s : 4: replace.inline 30.52% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.28% : 0.000189s : 4: match.inline 5.72% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.91% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.42% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.46% : 0.000008s : 53: predicate.switch_simplify 1.32% : 0.000001s : 10: predicate.tile_eliminate 1.32% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000796 13 43.09% : 0.000343s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.08% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.83% : 0.000405s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058081 72 0.09% : 0.000053s : 1: add_recomputation 0.13% : 0.000073s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.49% : 0.000284s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 9.79% : 0.005688s : 1: jit_opt_a 0.24% : 0.000139s : 1: jit_opt_after_cconv 0.09% : 0.000050s : 1: jit_opt_b 0.74% : 0.000428s : 1: loop_unroll 0.98% : 0.000567s : 1: mutable_eliminate 1.47% : 0.000852s : 26: opt.transform.jit_opt_a 0.08% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000109s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.99% : 0.000576s : 1: renormalize.infer 0.70% : 0.000405s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.15% : 0.000088s : 1: rewriter_before_opt_a 0.13% : 0.000074s : 1: symbol_engine_optimizer 82.39% : 0.047851s : 1: type_inference TotalTime = 0.143831, [30] [bootstrap]: 0.00031372 [type_inference]: 0.130629 [event_method]: 2.666e-05 [auto_monad]: 8.074e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00057719 [rewriter_before_opt_a]: 0.00010405 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00934199, [2] [Cycle 1]: 0.00513267, [27] [switch_simplify]: 6.938e-05 [loop_unroll]: 3.583e-05 [a_1]: 0.00077758 [with_stream_mark]: 2.576e-05 [recompute_prepare]: 1.021e-05 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.55003e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 1.333e-05 [updatestate_useless_node_eliminater]: 7.8e-06 [accelerated_algorithm]: 8.35999e-06 [meta_shard_fg_expand]: 2.90998e-06 [get_grad_eliminate_]: 7.15e-06 [merge_forward]: 5.22e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.75e-05 [j_node_and_user_rematch]: 1.253e-05 [meta_fg_expand]: 2.90998e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 7.78999e-06 [renormalize]: 0.00375245 [add_forward_monad_depend]: 7.9e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.036e-05 [cse]: 3.536e-05 [replace_applicator]: 2.199e-05 [Cycle 2]: 0.0004188, [27] [switch_simplify]: 8.03001e-06 [loop_unroll]: 6.74001e-06 [a_1]: 0.0001491 [with_stream_mark]: 1.362e-05 [recompute_prepare]: 6.81999e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 6.33998e-06 [merge_forward]: 3.54002e-06 [cell_reuse_recompute_pass]: 2.74999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 3.14001e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.49999e-06 [cse]: 1.367e-05 [replace_applicator]: 6.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.628e-05 [rewriter_after_opt_a]: 4.043e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00078016 [jit_opt_b]: 6.087e-05, [1] [Cycle 1]: 5.26e-05, [2] [frontend_op_eliminate]: 2.133e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 2.88e-05 [loop_unroll]: 0.00050153 [jit_opt_after_cconv]: 0.00017668, [1] [Cycle 1]: 0.00016915, [11] [c_1]: 2.881e-05 [parameter_eliminate]: 3.12002e-06 [updatestate_depend_eliminate]: 9.19e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 3.008e-05 [call_graph_tuple_transform]: 2.492e-05 [tuple_list_get_item_eliminator]: 6.53e-06 [none_parameter_eliminate]: 2.09999e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.871e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 9.91e-06 [add_recomputation]: 5.533e-05 [cse_after_recomputation]: 2.883e-05, [1] [Cycle 1]: 2.273e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.656e-05 [get_jit_bprop_graph]: 4.91002e-06 [rewriter_after_jit_bprop_graph]: 7.50998e-06 [opt_after_jit_grad]: 0.00048232 [symbol_engine_optimizer]: 0.00022901, [1] [Cycle 1]: 0.00022241, [6] [build]: 4.77e-06 [elim_shapecalc]: 1.312e-05 [elim_not_effective]: 1.818e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 0.00014891 [renormalize]: 4.19997e-07 [validate]: 6.058e-05 Sums bootstrap : 0.000314s : 0.23% type_inference : 0.130629s : 93.77% event_method : 0.000027s : 0.02% auto_monad : 0.000081s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000577s : 0.41% rewriter_before_opt_a : 0.000104s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000927s : 0.67% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000019s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003753s : 2.69% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000780s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000502s : 0.36% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000482s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000149s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.04% Time group info: ------[substitution.] 0.000329 28 1.89% : 0.000006s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.88% : 0.000006s : 4: substitution.graph_param_transform 82.85% : 0.000272s : 5: substitution.inline 1.48% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000015s : 3: substitution.reduce_eliminate 1.67% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000006s : 2: substitution.replace_old_param 3.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.130529 2 97.03% : 0.126653s : 1: type_inference.infer 2.97% : 0.003876s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.74% : 0.000073s : 5: replace.inline 31.26% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 7 96.24% : 0.000269s : 5: match.inline 3.76% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.46% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 2.31% : 0.000004s : 13: predicate.arithmetic_simplify 1.45% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.36% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.11% : 0.000008s : 28: predicate.inline 0.97% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 2.36% : 0.000004s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.36% : 0.000004s : 13: predicate.reduce_eliminate 1.64% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.75% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 13: predicate.reshape_eliminate 1.53% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 1.33% : 0.000002s : 8: predicate.specialize_transform 1.69% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.22% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.09% : 0.000002s : 13: predicate.transpose_eliminate 1.29% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002724 25 62.24% : 0.001695s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.40% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.37% : 0.000936s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148990 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000084s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000332s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.27% : 0.009347s : 1: jit_opt_a 0.12% : 0.000179s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.34% : 0.000510s : 1: loop_unroll 0.53% : 0.000791s : 1: mutable_eliminate 0.81% : 0.001207s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000184s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000491s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000585s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.87% : 0.002782s : 1: renormalize.infer 0.64% : 0.000958s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000110s : 1: rewriter_before_opt_a 0.16% : 0.000232s : 1: symbol_engine_optimizer 87.69% : 0.130653s : 1: type_inference TotalTime = 0.15791, [30] [bootstrap]: 0.00043632 [type_inference]: 0.130564 [event_method]: 0.00046054 [auto_monad]: 0.00011157 [graph_reusing]: 9.07999e-06 [pre_auto_parallel]: 3.35e-06 [py_interpret_to_execute]: 3.443e-05 [rewriter_before_opt_a]: 0.00012512 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.023959, [3] [Cycle 1]: 0.0163362, [27] [switch_simplify]: 7.576e-05 [loop_unroll]: 4.423e-05 [a_1]: 0.00097453 [with_stream_mark]: 3.729e-05 [recompute_prepare]: 2.528e-05 [updatestate_depend_eliminate]: 1.01e-05 [updatestate_assign_eliminate]: 7.83999e-06 [updatestate_loads_eliminate]: 6.79001e-06 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 1.534e-05 [updatestate_useless_node_eliminater]: 1.346e-05 [accelerated_algorithm]: 1.375e-05 [meta_shard_fg_expand]: 3.7e-06 [get_grad_eliminate_]: 1.351e-05 [merge_forward]: 9.27999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.84e-05 [j_node_and_user_rematch]: 2.506e-05 [meta_fg_expand]: 0.00191663 [replace_old_param]: 7.626e-05 [inline_without_move]: 6.172e-05 [renormalize]: 0.0122803 [add_forward_monad_depend]: 1.226e-05 [auto_monad_grad]: 6.12001e-06 [auto_monad_eliminator]: 6.565e-05 [cse]: 0.00025994 [replace_applicator]: 8.942e-05 [Cycle 2]: 0.00382138, [27] [switch_simplify]: 4.569e-05 [loop_unroll]: 4.362e-05 [a_1]: 0.0012095 [with_stream_mark]: 1.663e-05 [recompute_prepare]: 1.051e-05 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 4.08001e-06 [updatestate_loads_eliminate]: 4.07998e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 8.70999e-06 [updatestate_useless_node_eliminater]: 8.54e-06 [accelerated_algorithm]: 8.47998e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 7.93999e-06 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 4.696e-05 [j_node_and_user_rematch]: 1.455e-05 [meta_fg_expand]: 0.0001096 [replace_old_param]: 1.023e-05 [inline_without_move]: 8.45001e-06 [renormalize]: 0.00201702 [add_forward_monad_depend]: 6.74999e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.189e-05 [cse]: 2.359e-05 [replace_applicator]: 1.443e-05 [Cycle 3]: 0.00024956, [27] [switch_simplify]: 4.50999e-06 [loop_unroll]: 3.8e-06 [a_1]: 4.069e-05 [with_stream_mark]: 9.93998e-06 [recompute_prepare]: 3.83999e-06 [updatestate_depend_eliminate]: 2.38002e-06 [updatestate_assign_eliminate]: 1.68002e-06 [updatestate_loads_eliminate]: 1.40999e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 3.56999e-06 [updatestate_useless_node_eliminater]: 3.28e-06 [accelerated_algorithm]: 3.13e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 3.03e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.107e-05 [j_node_and_user_rematch]: 5.71e-06 [meta_fg_expand]: 1.41002e-06 [replace_old_param]: 3.21001e-06 [inline_without_move]: 2.88998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 3.45998e-06 [cse]: 8.03999e-06 [replace_applicator]: 3.59002e-06 [py_interpret_to_execute_after_opt_a]: 1.236e-05 [rewriter_after_opt_a]: 3.245e-05 [convert_after_rewriter]: 6.08998e-06 [order_py_execute_after_rewriter]: 4.32e-06 [mutable_eliminate]: 0.00068397 [jit_opt_b]: 4.171e-05, [1] [Cycle 1]: 3.466e-05, [2] [frontend_op_eliminate]: 1.078e-05 [inline_after_opt_a]: 1.175e-05 [cconv]: 2.514e-05 [loop_unroll]: 0.00041983 [jit_opt_after_cconv]: 0.00012246, [1] [Cycle 1]: 0.00011647, [11] [c_1]: 1.256e-05 [parameter_eliminate]: 3.00002e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 1.84e-06 [updatestate_loads_eliminate]: 1.49e-06 [cse]: 1.783e-05 [call_graph_tuple_transform]: 1.391e-05 [tuple_list_get_item_eliminator]: 3.8e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 3.83999e-06 [remove_dup_value]: 3.65e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 5.25001e-06 [add_recomputation]: 3.574e-05 [cse_after_recomputation]: 1.99e-05, [1] [Cycle 1]: 1.435e-05, [1] [cse]: 8.01001e-06 [auto_monad_reorder]: 1.277e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00044352 [symbol_engine_optimizer]: 6.37e-05, [1] [Cycle 1]: 5.75e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 6.16e-06 [elim_not_effective]: 9.34e-06 [opt_reshape]: 3.97e-06 [fold_const_symbol]: 5.90002e-06 [renormalize]: 3.59985e-07 [validate]: 2.795e-05 Sums bootstrap : 0.000436s : 0.28% type_inference : 0.130564s : 85.07% event_method : 0.000461s : 0.30% auto_monad : 0.000112s : 0.07% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000034s : 0.02% rewriter_before_opt_a : 0.000125s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000092s : 0.06% jit_opt_a.a_1 : 0.002225s : 1.45% jit_opt_a.with_stream_mark : 0.000064s : 0.04% jit_opt_a.recompute_prepare : 0.000040s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000086s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002028s : 1.32% jit_opt_a.replace_old_param : 0.000090s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.05% jit_opt_a.renormalize : 0.014297s : 9.32% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.05% jit_opt_a.cse : 0.000292s : 0.19% jit_opt_a.replace_applicator : 0.000107s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000032s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000684s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000420s : 0.27% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000036s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000444s : 0.29% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.02% TotalTime = 0.0273073, [30] [bootstrap]: 0.00031101 [type_inference]: 0.0195355 [event_method]: 1.879e-05 [auto_monad]: 6.427e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 8.572e-05 [rewriter_before_opt_a]: 7.603e-05 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.00519829, [2] [Cycle 1]: 0.00164585, [27] [switch_simplify]: 5.127e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00049569 [with_stream_mark]: 1.833e-05 [recompute_prepare]: 7.82998e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.36002e-06 [renormalize]: 0.00072825 [add_forward_monad_depend]: 5.33002e-06 [auto_monad_grad]: 2.04e-06 [auto_monad_eliminator]: 1.385e-05 [cse]: 3.22e-05 [replace_applicator]: 1.213e-05 [Cycle 2]: 0.00031654, [27] [switch_simplify]: 5.62001e-06 [loop_unroll]: 5.27001e-06 [a_1]: 8.947e-05 [with_stream_mark]: 8.40001e-06 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.175e-05 [j_node_and_user_rematch]: 8.00999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.74999e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.23998e-06 [cse]: 1.23e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 1.018e-05 [rewriter_after_opt_a]: 3.701e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00046093 [jit_opt_b]: 4.792e-05, [1] [Cycle 1]: 4.171e-05, [2] [frontend_op_eliminate]: 1.548e-05 [inline_after_opt_a]: 1.559e-05 [cconv]: 2.314e-05 [loop_unroll]: 0.0004228 [jit_opt_after_cconv]: 0.00013669, [1] [Cycle 1]: 0.00013007, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 1.956e-05 [call_graph_tuple_transform]: 1.757e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 2.592e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.65002e-06 [add_recomputation]: 4.931e-05 [cse_after_recomputation]: 2.439e-05, [1] [Cycle 1]: 1.841e-05, [1] [cse]: 1.262e-05 [auto_monad_reorder]: 1.8e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 4.64998e-06 [opt_after_jit_grad]: 0.00044012 [symbol_engine_optimizer]: 7.053e-05, [1] [Cycle 1]: 6.461e-05, [6] [build]: 2.91999e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 5.39992e-07 [validate]: 3.749e-05 Sums bootstrap : 0.000311s : 1.32% type_inference : 0.019535s : 83.10% event_method : 0.000019s : 0.08% auto_monad : 0.000064s : 0.27% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000086s : 0.36% rewriter_before_opt_a : 0.000076s : 0.32% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000057s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.15% jit_opt_a.a_1 : 0.000585s : 2.49% jit_opt_a.with_stream_mark : 0.000027s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000728s : 3.10% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.09% jit_opt_a.cse : 0.000045s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000037s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000461s : 1.96% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000023s : 0.10% loop_unroll : 0.000423s : 1.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000026s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000049s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000440s : 1.87% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.16% Time group info: ------[substitution.] 0.000607 107 0.24% : 0.000001s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.61% : 0.000004s : 1: substitution.graph_param_transform 63.09% : 0.000383s : 13: substitution.inline 3.12% : 0.000019s : 2: substitution.inline_without_move 1.59% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.85% : 0.000011s : 7: substitution.minmaximum_grad 1.17% : 0.000007s : 5: substitution.partial_eliminate 5.91% : 0.000036s : 13: substitution.remove_not_recompute_node 4.94% : 0.000030s : 10: substitution.replace_applicator 1.17% : 0.000007s : 10: substitution.replace_old_param 1.14% : 0.000007s : 1: substitution.reshape_eliminate 0.53% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.91% : 0.000006s : 1: substitution.tile_eliminate 3.75% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.71% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.08% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.130464 2 97.75% : 0.127526s : 1: type_inference.infer 2.25% : 0.002938s : 1: type_inference.specialize ------[replace.] 0.000177 20 67.37% : 0.000119s : 13: replace.inline 32.63% : 0.000058s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000396 20 94.62% : 0.000375s : 13: match.inline 5.38% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2656 1.58% : 0.000006s : 46: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 46: predicate.addn_check_dump 1.74% : 0.000007s : 46: predicate.addn_zero_filter 2.09% : 0.000008s : 46: predicate.arithmetic_simplify 1.65% : 0.000006s : 46: predicate.cast_eliminate 0.14% : 0.000001s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 46: predicate.compare_switch_simplify 1.61% : 0.000006s : 46: predicate.depend_value_elim 1.43% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.61% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_depend_swap 1.59% : 0.000006s : 46: predicate.environ_get_eliminate 1.46% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.87% : 0.000003s : 19: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.28% : 0.000016s : 68: predicate.inline 2.13% : 0.000008s : 47: predicate.inline_without_move 0.39% : 0.000001s : 19: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 19: predicate.less_batch_normalization 1.94% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.93% : 0.000007s : 54: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.43% : 0.000013s : 94: predicate.loop_unroll_before_grad 1.67% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.44% : 0.000005s : 46: predicate.merge_addn 1.51% : 0.000006s : 46: predicate.minmaximum_grad 0.35% : 0.000001s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.30% : 0.000009s : 54: predicate.partial_eliminate 1.55% : 0.000006s : 46: predicate.print_const_string_wrapper 2.02% : 0.000008s : 46: predicate.reduce_eliminate 1.82% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 19: predicate.remove_not_recompute_node 2.82% : 0.000011s : 100: predicate.replace_applicator 1.14% : 0.000004s : 47: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 46: predicate.reshape_eliminate 1.52% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.59% : 0.000006s : 46: predicate.same_eliminate 0.52% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 19: predicate.specialize_transform 1.68% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.76% : 0.000010s : 66: predicate.switch_defer_inline 2.52% : 0.000009s : 66: predicate.switch_layer_defer_inline 6.51% : 0.000024s : 161: predicate.switch_simplify 1.61% : 0.000006s : 46: predicate.tile_eliminate 1.64% : 0.000006s : 46: predicate.transpose_eliminate 1.93% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.90% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.85% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003827 45 77.28% : 0.002958s : 28: func_graph_cloner_run.FuncGraphClonerGraph 22.72% : 0.000869s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.175141 87 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000118s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.26% : 0.000461s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.27% : 0.000469s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 13.68% : 0.023963s : 1: jit_opt_a 0.07% : 0.000125s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.24% : 0.000427s : 1: loop_unroll 0.40% : 0.000692s : 1: mutable_eliminate 1.68% : 0.002936s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000010s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000452s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000037s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000039s : 1: remove_dup_value 6.92% : 0.012119s : 2: renormalize.infer 1.23% : 0.002158s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000128s : 1: rewriter_before_opt_a 0.04% : 0.000066s : 1: symbol_engine_optimizer 74.56% : 0.130589s : 1: type_inference Time group info: ------[substitution.] 0.000184 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000005s : 3: substitution.graph_param_transform 82.45% : 0.000152s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000004s : 4: substitution.remove_not_recompute_node 2.21% : 0.000004s : 2: substitution.replace_old_param 6.89% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019465 2 93.88% : 0.018274s : 1: type_inference.infer 6.12% : 0.001190s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.67% : 0.000043s : 4: replace.inline 32.33% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 92.78% : 0.000149s : 4: match.inline 7.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000108 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.82% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000006s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.26% : 0.000001s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.49% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.78% : 0.000008s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000727 13 51.08% : 0.000372s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.05% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.88% : 0.000326s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028879 72 0.18% : 0.000052s : 1: add_recomputation 0.23% : 0.000068s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.14% : 0.000330s : 1: bootstrap 0.09% : 0.000026s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000023s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.01% : 0.005201s : 1: jit_opt_a 0.48% : 0.000139s : 1: jit_opt_after_cconv 0.17% : 0.000050s : 1: jit_opt_b 1.49% : 0.000431s : 1: loop_unroll 1.62% : 0.000469s : 1: mutable_eliminate 2.75% : 0.000793s : 26: opt.transform.jit_opt_a 0.16% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000012s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000448s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000089s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000029s : 1: remove_dup_value 1.41% : 0.000408s : 1: renormalize.infer 1.08% : 0.000312s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000040s : 1: rewriter_after_opt_a 0.28% : 0.000079s : 1: rewriter_before_opt_a 0.25% : 0.000073s : 1: symbol_engine_optimizer 67.70% : 0.019552s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.489.379 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e3a0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.490.139 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.120885, [30] [bootstrap]: 0.0002957 [type_inference]: 0.110549 [event_method]: 2.268e-05 [auto_monad]: 8.986e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 8.431e-05 [rewriter_before_opt_a]: 8.122e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.00754175, [2] [Cycle 1]: 0.00358468, [27] [switch_simplify]: 5.862e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00058568 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.84001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 5.86e-06 [renormalize]: 0.00252828 [add_forward_monad_depend]: 6.78e-06 [auto_monad_grad]: 2.60997e-06 [auto_monad_eliminator]: 1.85e-05 [cse]: 3.256e-05 [replace_applicator]: 1.761e-05 [Cycle 2]: 0.00036529, [27] [switch_simplify]: 6.79999e-06 [loop_unroll]: 5.64998e-06 [a_1]: 0.0001206 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 5.65001e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.53002e-06 [accelerated_algorithm]: 5.81998e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.39001e-06 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.647e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 9.64999e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.036e-05 [replace_applicator]: 5.73002e-06 [py_interpret_to_execute_after_opt_a]: 1.205e-05 [rewriter_after_opt_a]: 3.68e-05 [convert_after_rewriter]: 6.90002e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00063357 [jit_opt_b]: 5.308e-05, [1] [Cycle 1]: 4.634e-05, [2] [frontend_op_eliminate]: 1.796e-05 [inline_after_opt_a]: 1.738e-05 [cconv]: 2.512e-05 [loop_unroll]: 0.00040875 [jit_opt_after_cconv]: 0.0001439, [1] [Cycle 1]: 0.00013771, [11] [c_1]: 2.532e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.837e-05 [call_graph_tuple_transform]: 1.922e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.533e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 7.95e-06 [add_recomputation]: 5.106e-05 [cse_after_recomputation]: 2.094e-05, [1] [Cycle 1]: 1.552e-05, [1] [cse]: 1.003e-05 [auto_monad_reorder]: 1.562e-05 [get_jit_bprop_graph]: 1.84998e-06 [rewriter_after_jit_bprop_graph]: 4.3e-06 [opt_after_jit_grad]: 0.0004675 [symbol_engine_optimizer]: 7.248e-05, [1] [Cycle 1]: 6.67e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 9.05001e-06 [renormalize]: 5.00004e-07 [validate]: 4.066e-05 Sums bootstrap : 0.000296s : 0.25% type_inference : 0.110549s : 94.73% event_method : 0.000023s : 0.02% auto_monad : 0.000090s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000084s : 0.07% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000706s : 0.61% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002528s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000634s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000409s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000468s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000230 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 83.61% : 0.000192s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000006s : 4: substitution.remove_not_recompute_node 2.42% : 0.000006s : 2: substitution.replace_old_param 5.87% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110460 2 97.38% : 0.107566s : 1: type_inference.infer 2.62% : 0.002894s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.62% : 0.000048s : 4: replace.inline 31.38% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 93.87% : 0.000190s : 4: match.inline 6.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.94% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.51% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.57% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000001s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.14% : 0.000001s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.65% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.92% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002131 22 66.35% : 0.001414s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.33% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.32% : 0.000667s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124420 72 0.04% : 0.000054s : 1: add_recomputation 0.08% : 0.000094s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000315s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.06% : 0.007545s : 1: jit_opt_a 0.12% : 0.000147s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.33% : 0.000416s : 1: loop_unroll 0.52% : 0.000642s : 1: mutable_eliminate 0.76% : 0.000946s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000087s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.44% : 0.001792s : 1: renormalize.infer 0.58% : 0.000726s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000084s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.87% : 0.110574s : 1: type_inference TotalTime = 0.0887701, [30] [bootstrap]: 0.00022769 [type_inference]: 0.0602332 [event_method]: 0.00026983 [auto_monad]: 0.00011481 [graph_reusing]: 7.87003e-06 [pre_auto_parallel]: 3.33998e-06 [py_interpret_to_execute]: 3.729e-05 [rewriter_before_opt_a]: 0.00012632 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.0250789, [3] [Cycle 1]: 0.0168273, [27] [switch_simplify]: 8.129e-05 [loop_unroll]: 4.876e-05 [a_1]: 0.00100334 [with_stream_mark]: 3.472e-05 [recompute_prepare]: 2.203e-05 [updatestate_depend_eliminate]: 9.12999e-06 [updatestate_assign_eliminate]: 7.11999e-06 [updatestate_loads_eliminate]: 6.71e-06 [parameter_eliminate]: 2.81e-06 [specialize_transform]: 1.541e-05 [updatestate_useless_node_eliminater]: 1.413e-05 [accelerated_algorithm]: 1.408e-05 [meta_shard_fg_expand]: 3.53e-06 [get_grad_eliminate_]: 1.381e-05 [merge_forward]: 9.02999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.876e-05 [j_node_and_user_rematch]: 2.402e-05 [meta_fg_expand]: 0.00178873 [replace_old_param]: 7.243e-05 [inline_without_move]: 6.368e-05 [renormalize]: 0.0127986 [add_forward_monad_depend]: 1.556e-05 [auto_monad_grad]: 7.44002e-06 [auto_monad_eliminator]: 7.04e-05 [cse]: 0.00027642 [replace_applicator]: 0.00010592 [Cycle 2]: 0.0042705, [27] [switch_simplify]: 4.709e-05 [loop_unroll]: 4.485e-05 [a_1]: 0.00135875 [with_stream_mark]: 2.586e-05 [recompute_prepare]: 1.311e-05 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 4.32e-06 [updatestate_loads_eliminate]: 4.50001e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 9.15001e-06 [updatestate_useless_node_eliminater]: 8.13001e-06 [accelerated_algorithm]: 8.45999e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 7.96001e-06 [merge_forward]: 5.34e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.949e-05 [j_node_and_user_rematch]: 1.339e-05 [meta_fg_expand]: 0.00011152 [replace_old_param]: 1.091e-05 [inline_without_move]: 8.84e-06 [renormalize]: 0.00226509 [add_forward_monad_depend]: 1.243e-05 [auto_monad_grad]: 2.73998e-06 [auto_monad_eliminator]: 1.818e-05 [cse]: 3.074e-05 [replace_applicator]: 1.955e-05 [Cycle 3]: 0.0002984, [27] [switch_simplify]: 4.65001e-06 [loop_unroll]: 4.12e-06 [a_1]: 4.396e-05 [with_stream_mark]: 1.571e-05 [recompute_prepare]: 4.65001e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 1.76998e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 3.97e-06 [updatestate_useless_node_eliminater]: 3.42002e-06 [accelerated_algorithm]: 3.2e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 3.3e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 3.60998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 6.81999e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 3.75998e-06 [inline_without_move]: 2.89999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.96e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 7.16999e-06 [cse]: 1.228e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.513e-05 [rewriter_after_opt_a]: 4.261e-05 [convert_after_rewriter]: 6.48e-06 [order_py_execute_after_rewriter]: 5.04998e-06 [mutable_eliminate]: 0.00083955 [jit_opt_b]: 4.531e-05, [1] [Cycle 1]: 3.619e-05, [2] [frontend_op_eliminate]: 1.221e-05 [inline_after_opt_a]: 1.212e-05 [cconv]: 3.585e-05 [loop_unroll]: 0.00052927 [jit_opt_after_cconv]: 0.00015987, [1] [Cycle 1]: 0.00015235, [11] [c_1]: 1.376e-05 [parameter_eliminate]: 6.02001e-06 [updatestate_depend_eliminate]: 9.02e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 1.79998e-06 [cse]: 2.974e-05 [call_graph_tuple_transform]: 2.003e-05 [tuple_list_get_item_eliminator]: 4.23999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 1.01002e-06 [switch_simplify]: 4.68999e-06 [remove_dup_value]: 1.668e-05 [partial_unused_args_eliminate]: 2.84999e-06 [environ_conv]: 6.18998e-06 [add_recomputation]: 4.323e-05 [cse_after_recomputation]: 2.198e-05, [1] [Cycle 1]: 1.612e-05, [1] [cse]: 8.69e-06 [auto_monad_reorder]: 1.475e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 7.40998e-06 [opt_after_jit_grad]: 0.00053381 [symbol_engine_optimizer]: 7.38e-05, [1] [Cycle 1]: 6.564e-05, [6] [build]: 5.01997e-06 [elim_shapecalc]: 6.74999e-06 [elim_not_effective]: 1.205e-05 [opt_reshape]: 4.50001e-06 [fold_const_symbol]: 5.85002e-06 [renormalize]: 6.50005e-07 [validate]: 3.689e-05 Sums bootstrap : 0.000228s : 0.27% type_inference : 0.060233s : 71.63% event_method : 0.000270s : 0.32% auto_monad : 0.000115s : 0.14% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.04% rewriter_before_opt_a : 0.000126s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000133s : 0.16% jit_opt_a.loop_unroll : 0.000098s : 0.12% jit_opt_a.a_1 : 0.002406s : 2.86% jit_opt_a.with_stream_mark : 0.000076s : 0.09% jit_opt_a.recompute_prepare : 0.000040s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.02% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.03% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.05% jit_opt_a.meta_fg_expand : 0.001902s : 2.26% jit_opt_a.replace_old_param : 0.000087s : 0.10% jit_opt_a.inline_without_move : 0.000075s : 0.09% jit_opt_a.renormalize : 0.015064s : 17.91% jit_opt_a.add_forward_monad_depend : 0.000030s : 0.04% jit_opt_a.auto_monad_grad : 0.000012s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000096s : 0.11% jit_opt_a.cse : 0.000319s : 0.38% jit_opt_a.replace_applicator : 0.000131s : 0.16% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000043s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000840s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000036s : 0.04% loop_unroll : 0.000529s : 0.63% jit_opt_after_cconv.c_1 : 0.000014s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000043s : 0.05% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000534s : 0.63% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.04% Time group info: ------[substitution.] 0.000636 107 0.26% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 1.01% : 0.000006s : 1: substitution.graph_param_transform 65.23% : 0.000415s : 13: substitution.inline 2.98% : 0.000019s : 2: substitution.inline_without_move 1.58% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.82% : 0.000012s : 7: substitution.minmaximum_grad 1.15% : 0.000007s : 5: substitution.partial_eliminate 1.73% : 0.000011s : 13: substitution.remove_not_recompute_node 5.68% : 0.000036s : 10: substitution.replace_applicator 1.09% : 0.000007s : 10: substitution.replace_old_param 1.24% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000007s : 1: substitution.tile_eliminate 3.93% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.69% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.96% : 0.000051s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060113 2 96.11% : 0.057775s : 1: type_inference.infer 3.89% : 0.002338s : 1: type_inference.specialize ------[replace.] 0.000191 20 66.64% : 0.000127s : 13: replace.inline 33.36% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000431 20 94.00% : 0.000405s : 13: match.inline 6.00% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000404 2768 1.54% : 0.000006s : 48: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.47% : 0.000006s : 48: predicate.addn_check_dump 1.67% : 0.000007s : 48: predicate.addn_zero_filter 2.04% : 0.000008s : 48: predicate.arithmetic_simplify 1.72% : 0.000007s : 48: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000006s : 48: predicate.compare_switch_simplify 1.47% : 0.000006s : 48: predicate.depend_value_elim 1.44% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.46% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.20% : 0.000001s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.71% : 0.000007s : 48: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.44% : 0.000006s : 48: predicate.environ_get_depend_swap 1.51% : 0.000006s : 48: predicate.environ_get_eliminate 1.42% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 20: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.43% : 0.000018s : 70: predicate.inline 2.24% : 0.000009s : 48: predicate.inline_without_move 0.38% : 0.000002s : 20: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 20: predicate.less_batch_normalization 1.82% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.75% : 0.000007s : 56: predicate.load_eliminater 0.50% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.91% : 0.000008s : 49: predicate.make_slice_get_slice_eliminator 1.39% : 0.000006s : 48: predicate.merge_addn 1.68% : 0.000007s : 48: predicate.minmaximum_grad 0.63% : 0.000003s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.25% : 0.000009s : 56: predicate.partial_eliminate 1.52% : 0.000006s : 48: predicate.print_const_string_wrapper 1.95% : 0.000008s : 48: predicate.reduce_eliminate 1.89% : 0.000008s : 55: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 20: predicate.remove_not_recompute_node 2.84% : 0.000011s : 103: predicate.replace_applicator 1.20% : 0.000005s : 48: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000006s : 48: predicate.reshape_eliminate 1.57% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.47% : 0.000006s : 48: predicate.same_eliminate 0.49% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.86% : 0.000003s : 20: predicate.specialize_transform 1.70% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000011s : 68: predicate.switch_defer_inline 2.39% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.56% : 0.000027s : 170: predicate.switch_simplify 1.60% : 0.000006s : 48: predicate.tile_eliminate 1.45% : 0.000006s : 48: predicate.transpose_eliminate 2.10% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.10% : 0.000013s : 57: predicate.tuple_list_get_item_eliminator 1.86% : 0.000007s : 48: predicate.tuple_list_set_item_eliminator 1.74% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.63% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.86% : 0.000008s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.24% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003555 46 74.02% : 0.002631s : 29: func_graph_cloner_run.FuncGraphClonerGraph 25.98% : 0.000923s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.106978 87 0.04% : 0.000046s : 1: add_recomputation 0.11% : 0.000122s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000244s : 1: bootstrap 0.04% : 0.000039s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.26% : 0.000279s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 23.45% : 0.025083s : 1: jit_opt_a 0.15% : 0.000163s : 1: jit_opt_after_cconv 0.04% : 0.000048s : 1: jit_opt_b 0.51% : 0.000542s : 1: loop_unroll 0.80% : 0.000857s : 1: mutable_eliminate 2.92% : 0.003129s : 39: opt.transform.jit_opt_a 0.04% : 0.000039s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000026s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000547s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000041s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 11.76% : 0.012578s : 2: renormalize.infer 2.30% : 0.002461s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.12% : 0.000131s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 56.33% : 0.060261s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.587.356 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.587.975 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0250462, [30] [bootstrap]: 0.00026587 [type_inference]: 0.00461492 [event_method]: 1.827e-05 [auto_monad]: 6.451e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 3.273e-05 [rewriter_before_opt_a]: 7.483e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.0175577, [2] [Cycle 1]: 0.0140579, [27] [switch_simplify]: 5.216e-05 [loop_unroll]: 2.855e-05 [a_1]: 0.0128041 [with_stream_mark]: 2.441e-05 [recompute_prepare]: 1.28e-05 [updatestate_depend_eliminate]: 4.88001e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 3.53e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.465e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 5.28002e-06 [renormalize]: 0.00076272 [add_forward_monad_depend]: 6.29001e-06 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.543e-05 [cse]: 3.578e-05 [replace_applicator]: 1.208e-05 [Cycle 2]: 0.00032253, [27] [switch_simplify]: 6.13002e-06 [loop_unroll]: 5.04998e-06 [a_1]: 8.783e-05 [with_stream_mark]: 9.56e-06 [recompute_prepare]: 5.27999e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 4.90001e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 4.49998e-06 [merge_forward]: 2.51998e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 7.56999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.38e-06 [cse]: 1.235e-05 [replace_applicator]: 4.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.227e-05 [rewriter_after_opt_a]: 3.988e-05 [convert_after_rewriter]: 6.50997e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00072369 [jit_opt_b]: 4.941e-05, [1] [Cycle 1]: 4.218e-05, [2] [frontend_op_eliminate]: 1.525e-05 [inline_after_opt_a]: 1.565e-05 [cconv]: 2.672e-05 [loop_unroll]: 0.00041701 [jit_opt_after_cconv]: 0.00015522, [1] [Cycle 1]: 0.00014948, [11] [c_1]: 2.11e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 5.99999e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.306e-05 [call_graph_tuple_transform]: 1.833e-05 [tuple_list_get_item_eliminator]: 1.094e-05 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 1.48002e-06 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 1.659e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 6.39001e-06 [add_recomputation]: 5.334e-05 [cse_after_recomputation]: 2.342e-05, [1] [Cycle 1]: 1.824e-05, [1] [cse]: 1.191e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.22e-06 [opt_after_jit_grad]: 0.00055014 [symbol_engine_optimizer]: 7.552e-05, [1] [Cycle 1]: 6.845e-05, [6] [build]: 4.23001e-06 [elim_shapecalc]: 7.46001e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 6.30011e-07 [validate]: 4.285e-05 Sums bootstrap : 0.000266s : 1.25% type_inference : 0.004615s : 21.73% event_method : 0.000018s : 0.09% auto_monad : 0.000065s : 0.30% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000033s : 0.15% rewriter_before_opt_a : 0.000075s : 0.35% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.27% jit_opt_a.loop_unroll : 0.000034s : 0.16% jit_opt_a.a_1 : 0.012892s : 60.69% jit_opt_a.with_stream_mark : 0.000034s : 0.16% jit_opt_a.recompute_prepare : 0.000018s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000763s : 3.59% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.10% jit_opt_a.cse : 0.000048s : 0.23% jit_opt_a.replace_applicator : 0.000017s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.06% rewriter_after_opt_a : 0.000040s : 0.19% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000724s : 3.41% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000027s : 0.13% loop_unroll : 0.000417s : 1.96% jit_opt_after_cconv.c_1 : 0.000021s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000011s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.08% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000053s : 0.25% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000550s : 2.59% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.20% Time group info: ------[substitution.] 0.012389 23 0.02% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000002s : 2: substitution.fold_const_symbol 0.04% : 0.000005s : 3: substitution.graph_param_transform 99.71% : 0.012352s : 4: substitution.inline 0.03% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.04% : 0.000005s : 4: substitution.remove_not_recompute_node 0.04% : 0.000005s : 2: substitution.replace_old_param 0.12% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004553 2 81.63% : 0.003717s : 1: type_inference.infer 18.37% : 0.000836s : 1: type_inference.specialize ------[replace.] 0.000116 6 79.29% : 0.000092s : 4: replace.inline 20.71% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.012360 6 99.89% : 0.012346s : 4: match.inline 0.11% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.89% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.44% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.64% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.26% : 0.000002s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.42% : 0.000004s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.91% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000627 13 52.41% : 0.000329s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.27% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.32% : 0.000240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038965 72 0.14% : 0.000056s : 1: add_recomputation 0.17% : 0.000068s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.73% : 0.000284s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 45.07% : 0.017561s : 1: jit_opt_a 0.41% : 0.000158s : 1: jit_opt_after_cconv 0.13% : 0.000052s : 1: jit_opt_b 1.09% : 0.000425s : 1: loop_unroll 1.88% : 0.000732s : 1: mutable_eliminate 33.63% : 0.013102s : 26: opt.transform.jit_opt_a 0.14% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000560s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000035s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.13% : 0.000439s : 1: renormalize.infer 0.81% : 0.000315s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.20% : 0.000078s : 1: rewriter_before_opt_a 0.20% : 0.000078s : 1: symbol_engine_optimizer 11.89% : 0.004631s : 1: type_inference TotalTime = 0.372961, [30] [bootstrap]: 0.00033842 [type_inference]: 0.31827 [event_method]: 2.284e-05 [auto_monad]: 7.309e-05 [graph_reusing]: 5.34e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00049174 [rewriter_before_opt_a]: 0.0001001 [expand_dump_flag]: 4.34002e-06 [jit_opt_a]: 0.0512875, [2] [Cycle 1]: 0.0470727, [27] [switch_simplify]: 6.285e-05 [loop_unroll]: 3.387e-05 [a_1]: 0.0006929 [with_stream_mark]: 2.083e-05 [recompute_prepare]: 8.78001e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 6.48e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 9.40025e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 0.0458992 [add_forward_monad_depend]: 9.47001e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 1.903e-05 [cse]: 3.088e-05 [replace_applicator]: 1.811e-05 [Cycle 2]: 0.0003876, [27] [switch_simplify]: 7.2e-06 [loop_unroll]: 7.94002e-06 [a_1]: 0.00012848 [with_stream_mark]: 1.407e-05 [recompute_prepare]: 6.48998e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 5.07e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.452e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 1.442e-05 [rewriter_after_opt_a]: 3.81e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.21002e-06 [mutable_eliminate]: 0.00063392 [jit_opt_b]: 5.426e-05, [1] [Cycle 1]: 4.739e-05, [2] [frontend_op_eliminate]: 1.854e-05 [inline_after_opt_a]: 1.819e-05 [cconv]: 2.302e-05 [loop_unroll]: 0.00041578 [jit_opt_after_cconv]: 0.00028772, [1] [Cycle 1]: 0.00028097, [11] [c_1]: 2.561e-05 [parameter_eliminate]: 2.85998e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.45002e-06 [cse]: 2.794e-05 [call_graph_tuple_transform]: 2.059e-05 [tuple_list_get_item_eliminator]: 6.23e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 1.048e-05 [remove_dup_value]: 1.83e-05 [partial_unused_args_eliminate]: 3.01001e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.832e-05 [cse_after_recomputation]: 2.83e-05, [1] [Cycle 1]: 2.28e-05, [1] [cse]: 1.641e-05 [auto_monad_reorder]: 1.609e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 5.50001e-06 [opt_after_jit_grad]: 0.0004624 [symbol_engine_optimizer]: 7.514e-05, [1] [Cycle 1]: 6.903e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 9.09e-06 [elim_not_effective]: 1.422e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 9.13002e-06 [renormalize]: 4.89992e-07 [validate]: 4.185e-05 Sums bootstrap : 0.000338s : 0.09% type_inference : 0.318270s : 86.39% event_method : 0.000023s : 0.01% auto_monad : 0.000073s : 0.02% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000492s : 0.13% rewriter_before_opt_a : 0.000100s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000821s : 0.22% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.045899s : 12.46% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000045s : 0.01% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000038s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000634s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000023s : 0.01% loop_unroll : 0.000416s : 0.11% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000048s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000462s : 0.13% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.01% Time group info: ------[substitution.] 0.000270 25 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 4: substitution.graph_param_transform 86.94% : 0.000235s : 5: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.71% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.318186 2 98.38% : 0.313025s : 1: type_inference.infer 1.62% : 0.005161s : 1: type_inference.specialize ------[replace.] 0.000102 7 67.87% : 0.000069s : 5: replace.inline 32.13% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 7 95.26% : 0.000232s : 5: match.inline 4.74% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.67% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.46% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.26% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.58% : 0.000002s : 13: predicate.environ_get_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.88% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.00% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000001s : 13: predicate.minmaximum_grad 1.04% : 0.000001s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 1.70% : 0.000002s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 23: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000011s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.63% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016328 25 81.54% : 0.013314s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.49% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 17.97% : 0.002934s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.420007 72 0.01% : 0.000051s : 1: add_recomputation 0.02% : 0.000076s : 1: auto_monad 0.00% : 0.000018s : 1: auto_monad_reorder 0.09% : 0.000358s : 1: bootstrap 0.01% : 0.000026s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 12.21% : 0.051291s : 1: jit_opt_a 0.07% : 0.000290s : 1: jit_opt_after_cconv 0.01% : 0.000057s : 1: jit_opt_b 0.10% : 0.000424s : 1: loop_unroll 0.15% : 0.000643s : 1: mutable_eliminate 0.26% : 0.001074s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000471s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000501s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 10.63% : 0.044662s : 1: renormalize.infer 0.29% : 0.001223s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000041s : 1: rewriter_after_opt_a 0.02% : 0.000105s : 1: rewriter_before_opt_a 0.02% : 0.000077s : 1: symbol_engine_optimizer 75.78% : 0.318283s : 1: type_inference TotalTime = 0.0398601, [30] [bootstrap]: 0.00024173 [type_inference]: 0.0200736 [event_method]: 8.473e-05 [auto_monad]: 0.00010817 [graph_reusing]: 7.71001e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 3.161e-05 [rewriter_before_opt_a]: 0.00011493 [expand_dump_flag]: 3.67998e-06 [jit_opt_a]: 0.0166017, [3] [Cycle 1]: 0.0083637, [27] [switch_simplify]: 8.021e-05 [loop_unroll]: 4.188e-05 [a_1]: 0.00107789 [with_stream_mark]: 3.901e-05 [recompute_prepare]: 2.083e-05 [updatestate_depend_eliminate]: 9.77999e-06 [updatestate_assign_eliminate]: 7.46001e-06 [updatestate_loads_eliminate]: 6.68998e-06 [parameter_eliminate]: 3.19001e-06 [specialize_transform]: 1.455e-05 [updatestate_useless_node_eliminater]: 1.233e-05 [accelerated_algorithm]: 1.286e-05 [meta_shard_fg_expand]: 4.72e-06 [get_grad_eliminate_]: 1.271e-05 [merge_forward]: 9.19e-06 [cell_reuse_recompute_pass]: 1.01997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.875e-05 [j_node_and_user_rematch]: 2.401e-05 [meta_fg_expand]: 0.00207025 [replace_old_param]: 8.027e-05 [inline_without_move]: 6.237e-05 [renormalize]: 0.00400454 [add_forward_monad_depend]: 1.415e-05 [auto_monad_grad]: 6.67002e-06 [auto_monad_eliminator]: 6.686e-05 [cse]: 0.00025213 [replace_applicator]: 9.296e-05 [Cycle 2]: 0.00395774, [27] [switch_simplify]: 4.174e-05 [loop_unroll]: 4.123e-05 [a_1]: 0.00122571 [with_stream_mark]: 2.155e-05 [recompute_prepare]: 1.355e-05 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 4.26001e-06 [updatestate_loads_eliminate]: 4.03999e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 8.70001e-06 [updatestate_useless_node_eliminater]: 8.27e-06 [accelerated_algorithm]: 8.64e-06 [meta_shard_fg_expand]: 3.34001e-06 [get_grad_eliminate_]: 8.44998e-06 [merge_forward]: 5.19e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.933e-05 [j_node_and_user_rematch]: 1.417e-05 [meta_fg_expand]: 0.00012253 [replace_old_param]: 1.046e-05 [inline_without_move]: 8.43001e-06 [renormalize]: 0.00207117 [add_forward_monad_depend]: 7.66001e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.477e-05 [cse]: 2.643e-05 [replace_applicator]: 1.647e-05 [Cycle 3]: 0.00030519, [27] [switch_simplify]: 4.93001e-06 [loop_unroll]: 3.81001e-06 [a_1]: 4.397e-05 [with_stream_mark]: 1.124e-05 [recompute_prepare]: 4.07003e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 1.68002e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 3.93001e-06 [updatestate_useless_node_eliminater]: 3.21999e-06 [accelerated_algorithm]: 3.6e-06 [meta_shard_fg_expand]: 1.83997e-06 [get_grad_eliminate_]: 3.46001e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 6.26998e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 3.18998e-06 [inline_without_move]: 3.14999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 4.88001e-06 [cse]: 1.086e-05 [replace_applicator]: 3.71001e-06 [py_interpret_to_execute_after_opt_a]: 1.504e-05 [rewriter_after_opt_a]: 3.675e-05 [convert_after_rewriter]: 5.97001e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00076856 [jit_opt_b]: 4.392e-05, [1] [Cycle 1]: 3.536e-05, [2] [frontend_op_eliminate]: 1.022e-05 [inline_after_opt_a]: 1.245e-05 [cconv]: 3.158e-05 [loop_unroll]: 0.00049582 [jit_opt_after_cconv]: 0.00015188, [1] [Cycle 1]: 0.0001433, [11] [c_1]: 1.378e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 8e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 1.74e-06 [cse]: 2.831e-05 [call_graph_tuple_transform]: 1.834e-05 [tuple_list_get_item_eliminator]: 4.1e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 1.11997e-06 [switch_simplify]: 3.55e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 5.78997e-06 [add_recomputation]: 6.095e-05 [cse_after_recomputation]: 2.466e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.085e-05 [auto_monad_reorder]: 1.456e-05 [get_jit_bprop_graph]: 2.52001e-06 [rewriter_after_jit_bprop_graph]: 7.63999e-06 [opt_after_jit_grad]: 0.00058201 [symbol_engine_optimizer]: 7.48e-05, [1] [Cycle 1]: 6.796e-05, [6] [build]: 4.53001e-06 [elim_shapecalc]: 6.54999e-06 [elim_not_effective]: 1.26e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 6.69999e-06 [renormalize]: 3.19997e-07 [validate]: 4.196e-05 Sums bootstrap : 0.000242s : 0.69% type_inference : 0.020074s : 57.62% event_method : 0.000085s : 0.24% auto_monad : 0.000108s : 0.31% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000032s : 0.09% rewriter_before_opt_a : 0.000115s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000127s : 0.36% jit_opt_a.loop_unroll : 0.000087s : 0.25% jit_opt_a.a_1 : 0.002348s : 6.74% jit_opt_a.with_stream_mark : 0.000072s : 0.21% jit_opt_a.recompute_prepare : 0.000038s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000027s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.07% jit_opt_a.accelerated_algorithm : 0.000025s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.07% jit_opt_a.merge_forward : 0.000018s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.13% jit_opt_a.meta_fg_expand : 0.002195s : 6.30% jit_opt_a.replace_old_param : 0.000094s : 0.27% jit_opt_a.inline_without_move : 0.000074s : 0.21% jit_opt_a.renormalize : 0.006076s : 17.44% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.25% jit_opt_a.cse : 0.000289s : 0.83% jit_opt_a.replace_applicator : 0.000113s : 0.32% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000037s : 0.11% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000769s : 2.21% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000012s : 0.04% cconv : 0.000032s : 0.09% loop_unroll : 0.000496s : 1.42% jit_opt_after_cconv.c_1 : 0.000014s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000061s : 0.17% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000582s : 1.67% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.12% Time group info: ------[substitution.] 0.000644 105 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.75% : 0.000005s : 1: substitution.graph_param_transform 65.78% : 0.000423s : 13: substitution.inline 3.74% : 0.000024s : 2: substitution.inline_without_move 1.74% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.95% : 0.000013s : 7: substitution.minmaximum_grad 1.35% : 0.000009s : 5: substitution.partial_eliminate 1.72% : 0.000011s : 13: substitution.remove_not_recompute_node 5.32% : 0.000034s : 10: substitution.replace_applicator 1.14% : 0.000007s : 8: substitution.replace_old_param 1.27% : 0.000008s : 1: substitution.reshape_eliminate 0.48% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.05% : 0.000007s : 1: substitution.tile_eliminate 3.64% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.55% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.09% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019973 2 92.99% : 0.018572s : 1: type_inference.infer 7.01% : 0.001401s : 1: type_inference.specialize ------[replace.] 0.000189 20 66.31% : 0.000126s : 13: replace.inline 33.69% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000439 20 94.66% : 0.000415s : 13: match.inline 5.34% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000472 2537 1.33% : 0.000006s : 44: predicate.accumulaten_eliminater 0.32% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.15% : 0.000005s : 44: predicate.addn_check_dump 1.42% : 0.000007s : 44: predicate.addn_zero_filter 1.76% : 0.000008s : 44: predicate.arithmetic_simplify 1.32% : 0.000006s : 44: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.15% : 0.000005s : 44: predicate.compare_switch_simplify 1.20% : 0.000006s : 44: predicate.depend_value_elim 1.14% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.30% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.17% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.11% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.15% : 0.000005s : 44: predicate.environ_get_depend_swap 1.16% : 0.000005s : 44: predicate.environ_get_eliminate 1.14% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.72% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 3.71% : 0.000017s : 66: predicate.inline 1.56% : 0.000007s : 42: predicate.inline_without_move 0.29% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.98% : 0.000005s : 18: predicate.less_batch_normalization 1.48% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.49% : 0.000007s : 52: predicate.load_eliminater 0.34% : 0.000002s : 1: predicate.loop_unroll_after_grad 2.61% : 0.000012s : 89: predicate.loop_unroll_before_grad 1.36% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.22% : 0.000006s : 44: predicate.merge_addn 1.21% : 0.000006s : 44: predicate.minmaximum_grad 0.45% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 1.75% : 0.000008s : 52: predicate.partial_eliminate 1.19% : 0.000006s : 44: predicate.print_const_string_wrapper 1.61% : 0.000008s : 44: predicate.reduce_eliminate 1.62% : 0.000008s : 51: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000002s : 18: predicate.remove_not_recompute_node 2.16% : 0.000010s : 94: predicate.replace_applicator 0.93% : 0.000004s : 42: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.42% : 0.000007s : 44: predicate.reshape_eliminate 1.25% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 1: predicate.row_tensor_eliminate 1.22% : 0.000006s : 44: predicate.same_eliminate 0.43% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.71% : 0.000003s : 18: predicate.specialize_transform 1.36% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.04% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.38% : 0.000011s : 64: predicate.switch_defer_inline 2.05% : 0.000010s : 64: predicate.switch_layer_defer_inline 5.20% : 0.000025s : 154: predicate.switch_simplify 1.25% : 0.000006s : 44: predicate.tile_eliminate 1.18% : 0.000006s : 44: predicate.transpose_eliminate 1.54% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 20.20% : 0.000095s : 44: predicate.tuple_list_get_item_depend_reorder 2.74% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.59% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.53% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.40% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.19% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.68% : 0.000008s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.09% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002098 32 60.56% : 0.001270s : 15: func_graph_cloner_run.FuncGraphClonerGraph 39.44% : 0.000827s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048973 87 0.13% : 0.000064s : 1: add_recomputation 0.23% : 0.000113s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.54% : 0.000263s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.18% : 0.000090s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 33.91% : 0.016605s : 1: jit_opt_a 0.32% : 0.000155s : 1: jit_opt_after_cconv 0.09% : 0.000046s : 1: jit_opt_b 1.03% : 0.000506s : 1: loop_unroll 1.59% : 0.000780s : 1: mutable_eliminate 6.19% : 0.003031s : 39: opt.transform.jit_opt_a 0.07% : 0.000036s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000028s : 4: opt.transform.symbol_engine_opt 1.21% : 0.000593s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000034s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 8.27% : 0.004048s : 2: renormalize.infer 4.10% : 0.002006s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000039s : 1: rewriter_after_opt_a 0.24% : 0.000118s : 1: rewriter_before_opt_a 0.16% : 0.000077s : 1: symbol_engine_optimizer 41.04% : 0.020100s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.652.658 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e820> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.653.351 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0444881, [30] [bootstrap]: 0.00026112 [type_inference]: 0.0187674 [event_method]: 6.934e-05 [auto_monad]: 0.00010726 [graph_reusing]: 8.08999e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 3.77e-05 [rewriter_before_opt_a]: 0.00012739 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.0225634, [3] [Cycle 1]: 0.0144628, [27] [switch_simplify]: 8.135e-05 [loop_unroll]: 4.442e-05 [a_1]: 0.00100521 [with_stream_mark]: 3.965e-05 [recompute_prepare]: 2.321e-05 [updatestate_depend_eliminate]: 9.97999e-06 [updatestate_assign_eliminate]: 6.84001e-06 [updatestate_loads_eliminate]: 7.42998e-06 [parameter_eliminate]: 3.28e-06 [specialize_transform]: 1.525e-05 [updatestate_useless_node_eliminater]: 1.3e-05 [accelerated_algorithm]: 1.346e-05 [meta_shard_fg_expand]: 4.21001e-06 [get_grad_eliminate_]: 1.319e-05 [merge_forward]: 9.19e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.988e-05 [j_node_and_user_rematch]: 2.291e-05 [meta_fg_expand]: 0.00213255 [replace_old_param]: 8.205e-05 [inline_without_move]: 6.584e-05 [renormalize]: 0.0100986 [add_forward_monad_depend]: 1.533e-05 [auto_monad_grad]: 6.88e-06 [auto_monad_eliminator]: 6.536e-05 [cse]: 0.00026228 [replace_applicator]: 9.349e-05 [Cycle 2]: 0.00381971, [27] [switch_simplify]: 4.113e-05 [loop_unroll]: 3.898e-05 [a_1]: 0.00115404 [with_stream_mark]: 2.14e-05 [recompute_prepare]: 9.97001e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 4.08001e-06 [updatestate_loads_eliminate]: 4.35999e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.76001e-06 [updatestate_useless_node_eliminater]: 7.1e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.98e-06 [get_grad_eliminate_]: 6.70002e-06 [merge_forward]: 4.82998e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.713e-05 [j_node_and_user_rematch]: 1.136e-05 [meta_fg_expand]: 0.00011766 [replace_old_param]: 8.69998e-06 [inline_without_move]: 6.68e-06 [renormalize]: 0.00205715 [add_forward_monad_depend]: 1.02e-05 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.644e-05 [cse]: 3.053e-05 [replace_applicator]: 1.953e-05 [Cycle 3]: 0.00028284, [27] [switch_simplify]: 4.68999e-06 [loop_unroll]: 3.91999e-06 [a_1]: 5.169e-05 [with_stream_mark]: 1.304e-05 [recompute_prepare]: 4.23001e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 3.61001e-06 [updatestate_useless_node_eliminater]: 3.46999e-06 [accelerated_algorithm]: 3.97e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 3.53e-06 [merge_forward]: 3.42002e-06 [cell_reuse_recompute_pass]: 3.09001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 6.30002e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 3.7e-06 [inline_without_move]: 3.18e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.00001e-06 [cse]: 9.53997e-06 [replace_applicator]: 3.51001e-06 [py_interpret_to_execute_after_opt_a]: 1.344e-05 [rewriter_after_opt_a]: 3.942e-05 [convert_after_rewriter]: 8.05e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00078735 [jit_opt_b]: 4.639e-05, [1] [Cycle 1]: 3.717e-05, [2] [frontend_op_eliminate]: 1.216e-05 [inline_after_opt_a]: 1.235e-05 [cconv]: 3.209e-05 [loop_unroll]: 0.00047817 [jit_opt_after_cconv]: 0.00014247, [1] [Cycle 1]: 0.00013498, [11] [c_1]: 1.274e-05 [parameter_eliminate]: 4.25e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 2.02999e-06 [updatestate_loads_eliminate]: 3.23e-06 [cse]: 2.679e-05 [call_graph_tuple_transform]: 1.547e-05 [tuple_list_get_item_eliminator]: 4.66002e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 7.2e-07 [switch_simplify]: 3.55e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 5.76e-06 [add_recomputation]: 8.437e-05 [cse_after_recomputation]: 2.16e-05, [1] [Cycle 1]: 1.587e-05, [1] [cse]: 8.74998e-06 [auto_monad_reorder]: 1.518e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 7.18998e-06 [opt_after_jit_grad]: 0.00051632 [symbol_engine_optimizer]: 7.18e-05, [1] [Cycle 1]: 6.539e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 6.41e-06 [elim_not_effective]: 1.119e-05 [opt_reshape]: 4.90001e-06 [fold_const_symbol]: 6.66999e-06 [renormalize]: 4.19997e-07 [validate]: 4.016e-05 Sums bootstrap : 0.000261s : 0.66% type_inference : 0.018767s : 47.48% event_method : 0.000069s : 0.18% auto_monad : 0.000107s : 0.27% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000038s : 0.10% rewriter_before_opt_a : 0.000127s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000127s : 0.32% jit_opt_a.loop_unroll : 0.000087s : 0.22% jit_opt_a.a_1 : 0.002211s : 5.59% jit_opt_a.with_stream_mark : 0.000074s : 0.19% jit_opt_a.recompute_prepare : 0.000037s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000027s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.06% jit_opt_a.accelerated_algorithm : 0.000024s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000017s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.10% jit_opt_a.meta_fg_expand : 0.002252s : 5.70% jit_opt_a.replace_old_param : 0.000094s : 0.24% jit_opt_a.inline_without_move : 0.000076s : 0.19% jit_opt_a.renormalize : 0.012156s : 30.75% jit_opt_a.add_forward_monad_depend : 0.000027s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.22% jit_opt_a.cse : 0.000302s : 0.76% jit_opt_a.replace_applicator : 0.000117s : 0.29% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000039s : 0.10% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000787s : 1.99% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.03% jit_opt_b.inline_after_opt_a : 0.000012s : 0.03% cconv : 0.000032s : 0.08% loop_unroll : 0.000478s : 1.21% jit_opt_after_cconv.c_1 : 0.000013s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000084s : 0.21% cse_after_recomputation.cse : 0.000009s : 0.02% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000516s : 1.31% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.10% Time group info: ------[substitution.] 0.000624 104 0.26% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.72% : 0.000005s : 1: substitution.graph_param_transform 66.53% : 0.000415s : 13: substitution.inline 3.64% : 0.000023s : 2: substitution.inline_without_move 1.45% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.13% : 0.000013s : 7: substitution.minmaximum_grad 1.22% : 0.000008s : 5: substitution.partial_eliminate 1.80% : 0.000011s : 12: substitution.remove_not_recompute_node 5.46% : 0.000034s : 10: substitution.replace_applicator 1.19% : 0.000007s : 10: substitution.replace_old_param 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.06% : 0.000007s : 1: substitution.tile_eliminate 3.66% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.78% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.40% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018662 2 91.70% : 0.017113s : 1: type_inference.infer 8.30% : 0.001549s : 1: type_inference.specialize ------[replace.] 0.000194 20 64.84% : 0.000126s : 13: replace.inline 35.16% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000430 20 94.60% : 0.000407s : 13: match.inline 5.40% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000372 2433 1.49% : 0.000006s : 42: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 42: predicate.addn_check_dump 1.78% : 0.000007s : 42: predicate.addn_zero_filter 2.23% : 0.000008s : 42: predicate.arithmetic_simplify 1.62% : 0.000006s : 42: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000005s : 42: predicate.compare_switch_simplify 1.50% : 0.000006s : 42: predicate.depend_value_elim 1.47% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.18% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.42% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.40% : 0.000005s : 42: predicate.environ_get_depend_swap 1.56% : 0.000006s : 42: predicate.environ_get_eliminate 1.44% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 16: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.28% : 0.000016s : 64: predicate.inline 1.99% : 0.000007s : 44: predicate.inline_without_move 0.30% : 0.000001s : 16: predicate.j_node_and_user_rematch 1.15% : 0.000004s : 16: predicate.less_batch_normalization 1.92% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 2.01% : 0.000007s : 50: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.67% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.41% : 0.000005s : 42: predicate.merge_addn 1.45% : 0.000005s : 42: predicate.minmaximum_grad 0.49% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.36% : 0.000009s : 50: predicate.partial_eliminate 1.48% : 0.000006s : 42: predicate.print_const_string_wrapper 2.15% : 0.000008s : 42: predicate.reduce_eliminate 1.78% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000002s : 16: predicate.remove_not_recompute_node 2.52% : 0.000009s : 90: predicate.replace_applicator 1.29% : 0.000005s : 44: predicate.replace_old_param 0.03% : 0.000000s : 1: predicate.reset_defer_inline 1.55% : 0.000006s : 42: predicate.reshape_eliminate 1.55% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.56% : 0.000006s : 42: predicate.same_eliminate 0.42% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.74% : 0.000003s : 16: predicate.specialize_transform 1.92% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.70% : 0.000010s : 62: predicate.switch_defer_inline 2.47% : 0.000009s : 62: predicate.switch_layer_defer_inline 6.34% : 0.000024s : 150: predicate.switch_simplify 1.59% : 0.000006s : 42: predicate.tile_eliminate 1.56% : 0.000006s : 42: predicate.transpose_eliminate 1.99% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.74% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000013s : 51: predicate.tuple_list_get_item_eliminator 2.02% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.70% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.94% : 0.000007s : 42: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002793 36 61.35% : 0.001713s : 19: func_graph_cloner_run.FuncGraphClonerGraph 38.65% : 0.001079s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059533 87 0.15% : 0.000088s : 1: add_recomputation 0.19% : 0.000112s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.48% : 0.000286s : 1: bootstrap 0.06% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.13% : 0.000075s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 37.91% : 0.022567s : 1: jit_opt_a 0.25% : 0.000146s : 1: jit_opt_after_cconv 0.08% : 0.000049s : 1: jit_opt_b 0.82% : 0.000488s : 1: loop_unroll 1.34% : 0.000800s : 1: mutable_eliminate 4.86% : 0.002894s : 39: opt.transform.jit_opt_a 0.06% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000018s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.88% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000040s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 16.42% : 0.009777s : 2: renormalize.infer 3.95% : 0.002354s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000042s : 1: rewriter_after_opt_a 0.22% : 0.000130s : 1: rewriter_before_opt_a 0.12% : 0.000074s : 1: symbol_engine_optimizer 31.56% : 0.018791s : 1: type_inference TotalTime = 0.241542, [30] [bootstrap]: 0.00033854 [type_inference]: 0.203267 [event_method]: 2.572e-05 [auto_monad]: 8.188e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.00061041 [rewriter_before_opt_a]: 0.00010306 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.033406, [2] [Cycle 1]: 0.00525084, [27] [switch_simplify]: 9.092e-05 [loop_unroll]: 3.458e-05 [a_1]: 0.00088052 [with_stream_mark]: 2.592e-05 [recompute_prepare]: 1.095e-05 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 2.59001e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 7.51999e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.807e-05 [j_node_and_user_rematch]: 1.144e-05 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 1.236e-05 [inline_without_move]: 6.71999e-06 [renormalize]: 0.00378072 [add_forward_monad_depend]: 9.77001e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 2.178e-05 [cse]: 3.899e-05 [replace_applicator]: 2.277e-05 [Cycle 2]: 0.00041857, [27] [switch_simplify]: 7.65e-06 [loop_unroll]: 6.85002e-06 [a_1]: 0.00014483 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 6.28e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.68998e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 3.45998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 1.145e-05 [inline_without_move]: 6.01e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.549e-05 [replace_applicator]: 6.44999e-06 [py_interpret_to_execute_after_opt_a]: 1.76e-05 [rewriter_after_opt_a]: 4.203e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.00081504 [jit_opt_b]: 9.125e-05, [1] [Cycle 1]: 8.139e-05, [2] [frontend_op_eliminate]: 1.974e-05 [inline_after_opt_a]: 1.932e-05 [cconv]: 3.154e-05 [loop_unroll]: 0.00120202 [jit_opt_after_cconv]: 0.00020888, [1] [Cycle 1]: 0.00019754, [11] [c_1]: 3.648e-05 [parameter_eliminate]: 5.86e-06 [updatestate_depend_eliminate]: 9.91e-06 [updatestate_assign_eliminate]: 4.90001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 3.79e-05 [call_graph_tuple_transform]: 2.739e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.996e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.239e-05 [add_recomputation]: 5.479e-05 [cse_after_recomputation]: 2.815e-05, [1] [Cycle 1]: 1.995e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 8.63001e-06 [opt_after_jit_grad]: 0.00057669 [symbol_engine_optimizer]: 9.472e-05, [1] [Cycle 1]: 8.841e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 9.64999e-06 [elim_not_effective]: 1.947e-05 [opt_reshape]: 6.90998e-06 [fold_const_symbol]: 1.486e-05 [renormalize]: 4.39992e-07 [validate]: 0.0002256 Sums bootstrap : 0.000339s : 0.16% type_inference : 0.203267s : 95.41% event_method : 0.000026s : 0.01% auto_monad : 0.000082s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000610s : 0.29% rewriter_before_opt_a : 0.000103s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000099s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.001025s : 0.48% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003781s : 1.77% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000815s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.001202s : 0.56% jit_opt_after_cconv.c_1 : 0.000036s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000055s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000577s : 0.27% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000226s : 0.11% Time group info: ------[substitution.] 0.000386 28 0.54% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.71% : 0.000007s : 4: substitution.graph_param_transform 84.77% : 0.000328s : 5: substitution.inline 1.11% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.15% : 0.000016s : 3: substitution.reduce_eliminate 1.40% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000008s : 2: substitution.replace_old_param 3.79% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.203154 2 98.07% : 0.199235s : 1: type_inference.infer 1.93% : 0.003919s : 1: type_inference.specialize ------[replace.] 0.000121 7 71.21% : 0.000086s : 5: replace.inline 28.79% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000338 7 96.08% : 0.000324s : 5: match.inline 3.92% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000170 886 1.61% : 0.000003s : 13: predicate.accumulaten_eliminater 0.93% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 2.61% : 0.000004s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 6.20% : 0.000011s : 28: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.34% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000003s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.34% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.31% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 19: predicate.partial_eliminate 1.44% : 0.000002s : 13: predicate.print_const_string_wrapper 2.57% : 0.000004s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.58% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.13% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.84% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.35% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.49% : 0.000013s : 64: predicate.switch_simplify 1.48% : 0.000003s : 13: predicate.tile_eliminate 1.05% : 0.000002s : 13: predicate.transpose_eliminate 1.19% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.08% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000003s : 13: predicate.value_based_eliminate 0.25% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003020 25 65.70% : 0.001984s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.44% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.86% : 0.000932s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.246549 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000086s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.15% : 0.000360s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 13.55% : 0.033410s : 1: jit_opt_a 0.09% : 0.000212s : 1: jit_opt_after_cconv 0.04% : 0.000094s : 1: jit_opt_b 0.49% : 0.001218s : 1: loop_unroll 0.33% : 0.000826s : 1: mutable_eliminate 0.53% : 0.001319s : 26: opt.transform.jit_opt_a 0.03% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000587s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000622s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.13% : 0.002783s : 1: renormalize.infer 0.40% : 0.000985s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.04% : 0.000108s : 1: rewriter_before_opt_a 0.04% : 0.000101s : 1: symbol_engine_optimizer 82.46% : 0.203293s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.717.703 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006e4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.718.350 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0290714, [30] [bootstrap]: 0.00032084 [type_inference]: 0.0210767 [event_method]: 1.987e-05 [auto_monad]: 7.035e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 9.05e-05 [rewriter_before_opt_a]: 8.03e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00513349, [2] [Cycle 1]: 0.00171659, [27] [switch_simplify]: 5.591e-05 [loop_unroll]: 2.905e-05 [a_1]: 0.00051406 [with_stream_mark]: 1.898e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 9.04998e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.0007647 [add_forward_monad_depend]: 4.92999e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.469e-05 [cse]: 3.407e-05 [replace_applicator]: 1.316e-05 [Cycle 2]: 0.00031825, [27] [switch_simplify]: 5.68002e-06 [loop_unroll]: 5.12e-06 [a_1]: 8.906e-05 [with_stream_mark]: 9.41e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.61998e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.09003e-06 [get_grad_eliminate_]: 4.69002e-06 [merge_forward]: 3.03998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.295e-05 [j_node_and_user_rematch]: 8.08001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 7.25e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.234e-05 [replace_applicator]: 5.63002e-06 [py_interpret_to_execute_after_opt_a]: 1.256e-05 [rewriter_after_opt_a]: 3.703e-05 [convert_after_rewriter]: 6.80998e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00054169 [jit_opt_b]: 5.113e-05, [1] [Cycle 1]: 4.37e-05, [2] [frontend_op_eliminate]: 1.648e-05 [inline_after_opt_a]: 1.641e-05 [cconv]: 2.564e-05 [loop_unroll]: 0.0005656 [jit_opt_after_cconv]: 0.00014861, [1] [Cycle 1]: 0.00014175, [11] [c_1]: 2.113e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.649e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.32e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 5.95002e-06 [add_recomputation]: 5.074e-05 [cse_after_recomputation]: 3.366e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.38002e-06 [opt_after_jit_grad]: 0.00045603 [symbol_engine_optimizer]: 7.037e-05, [1] [Cycle 1]: 6.424e-05, [6] [build]: 2.63e-06 [elim_shapecalc]: 7.02002e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.48001e-06 [renormalize]: 3.39991e-07 [validate]: 3.813e-05 Sums bootstrap : 0.000321s : 1.26% type_inference : 0.021077s : 83.01% event_method : 0.000020s : 0.08% auto_monad : 0.000070s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000090s : 0.36% rewriter_before_opt_a : 0.000080s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000603s : 2.38% jit_opt_a.with_stream_mark : 0.000028s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000765s : 3.01% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000046s : 0.18% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000037s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000542s : 2.13% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000566s : 2.23% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000456s : 1.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.15% Time group info: ------[substitution.] 0.000192 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.34% : 0.000006s : 3: substitution.graph_param_transform 81.60% : 0.000157s : 4: substitution.inline 1.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021002 2 93.89% : 0.019718s : 1: type_inference.infer 6.11% : 0.001284s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.07% : 0.000047s : 4: replace.inline 31.93% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 92.72% : 0.000154s : 4: match.inline 7.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.30% : 0.000001s : 3: predicate.mutable_eliminate 0.63% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.76% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000009s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000729 13 50.20% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.92% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.88% : 0.000334s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030710 72 0.17% : 0.000054s : 1: add_recomputation 0.24% : 0.000074s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.11% : 0.000340s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000036s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 16.73% : 0.005137s : 1: jit_opt_a 0.49% : 0.000151s : 1: jit_opt_after_cconv 0.17% : 0.000054s : 1: jit_opt_b 1.87% : 0.000574s : 1: loop_unroll 1.79% : 0.000549s : 1: mutable_eliminate 2.66% : 0.000817s : 26: opt.transform.jit_opt_a 0.16% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000464s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000094s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.39% : 0.000427s : 1: renormalize.infer 1.07% : 0.000329s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000040s : 1: rewriter_after_opt_a 0.27% : 0.000084s : 1: rewriter_before_opt_a 0.24% : 0.000073s : 1: symbol_engine_optimizer 68.69% : 0.021094s : 1: type_inference TotalTime = 0.147875, [30] [bootstrap]: 0.00029432 [type_inference]: 0.137085 [event_method]: 1.951e-05 [auto_monad]: 7.137e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00041803 [rewriter_before_opt_a]: 8.903e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00752961, [2] [Cycle 1]: 0.00360359, [27] [switch_simplify]: 5.579e-05 [loop_unroll]: 3.025e-05 [a_1]: 0.0006002 [with_stream_mark]: 2.214e-05 [recompute_prepare]: 8.44998e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.64e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.68002e-06 [renormalize]: 0.00253414 [add_forward_monad_depend]: 7.8e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.875e-05 [cse]: 3.255e-05 [replace_applicator]: 1.678e-05 [Cycle 2]: 0.00036717, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.56e-06 [a_1]: 0.00011857 [with_stream_mark]: 1.361e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 2.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 1.86998e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.60001e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.287e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.421e-05 [rewriter_after_opt_a]: 3.776e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00066081 [jit_opt_b]: 5.577e-05, [1] [Cycle 1]: 4.765e-05, [2] [frontend_op_eliminate]: 1.817e-05 [inline_after_opt_a]: 1.794e-05 [cconv]: 2.988e-05 [loop_unroll]: 0.00045384 [jit_opt_after_cconv]: 0.00015818, [1] [Cycle 1]: 0.00015103, [11] [c_1]: 2.485e-05 [parameter_eliminate]: 3.90998e-06 [updatestate_depend_eliminate]: 6.92002e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.08998e-06 [cse]: 2.464e-05 [call_graph_tuple_transform]: 2.143e-05 [tuple_list_get_item_eliminator]: 7.03998e-06 [none_parameter_eliminate]: 2.06e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.71998e-06 [remove_dup_value]: 1.699e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 9.88002e-06 [add_recomputation]: 5.375e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.765e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.645e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 6.53e-06 [opt_after_jit_grad]: 0.00048957 [symbol_engine_optimizer]: 8.328e-05, [1] [Cycle 1]: 7.612e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 9.71e-06 [elim_not_effective]: 1.502e-05 [opt_reshape]: 7.21001e-06 [fold_const_symbol]: 1.011e-05 [renormalize]: 6.39993e-07 [validate]: 4.931e-05 Sums bootstrap : 0.000294s : 0.20% type_inference : 0.137085s : 95.38% event_method : 0.000020s : 0.01% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000418s : 0.29% rewriter_before_opt_a : 0.000089s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000719s : 0.50% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002534s : 1.76% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000661s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000454s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000490s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.03% Time group info: ------[substitution.] 0.000233 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 4: substitution.graph_param_transform 84.44% : 0.000197s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000006s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.137010 2 98.19% : 0.134537s : 1: type_inference.infer 1.81% : 0.002473s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.85% : 0.000047s : 4: replace.inline 33.15% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.31% : 0.000195s : 4: match.inline 5.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.67% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.08% : 0.000001s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.79% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.86% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 2.19% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000001s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 1.00% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.12% : 0.000001s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.52% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002155 22 67.45% : 0.001454s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.32% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.23% : 0.000652s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.151426 72 0.04% : 0.000056s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.20% : 0.000305s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.97% : 0.007533s : 1: jit_opt_a 0.11% : 0.000161s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.31% : 0.000462s : 1: loop_unroll 0.44% : 0.000671s : 1: mutable_eliminate 0.63% : 0.000951s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000499s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000424s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.19% : 0.001804s : 1: renormalize.infer 0.47% : 0.000718s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000094s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 90.54% : 0.137105s : 1: type_inference TotalTime = 0.0182776, [30] [bootstrap]: 0.00032444 [type_inference]: 0.00914431 [event_method]: 2.302e-05 [auto_monad]: 7.391e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 5.291e-05 [rewriter_before_opt_a]: 8.667e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00633002, [2] [Cycle 1]: 0.00221012, [27] [switch_simplify]: 6.95e-05 [loop_unroll]: 3.403e-05 [a_1]: 0.00070721 [with_stream_mark]: 2.255e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.39002e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.50001e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 0.00102078 [add_forward_monad_depend]: 5.67999e-06 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 3.471e-05 [replace_applicator]: 1.295e-05 [Cycle 2]: 0.00034092, [27] [switch_simplify]: 5.79999e-06 [loop_unroll]: 5.46e-06 [a_1]: 0.00010315 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 5.74999e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.41002e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.071e-05 [j_node_and_user_rematch]: 7.66999e-06 [meta_fg_expand]: 1.78002e-06 [replace_old_param]: 7.41001e-06 [inline_without_move]: 5.21002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.263e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.206e-05 [rewriter_after_opt_a]: 3.87e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00059277 [jit_opt_b]: 5.274e-05, [1] [Cycle 1]: 4.568e-05, [2] [frontend_op_eliminate]: 1.802e-05 [inline_after_opt_a]: 1.581e-05 [cconv]: 2.729e-05 [loop_unroll]: 0.00043951 [jit_opt_after_cconv]: 0.00016097, [1] [Cycle 1]: 0.00015438, [11] [c_1]: 2.17e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.359e-05 [call_graph_tuple_transform]: 1.963e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.584e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 6.73e-06 [add_recomputation]: 5.169e-05 [cse_after_recomputation]: 2.369e-05, [1] [Cycle 1]: 1.78e-05, [1] [cse]: 1.128e-05 [auto_monad_reorder]: 1.785e-05 [get_jit_bprop_graph]: 2.51998e-06 [rewriter_after_jit_bprop_graph]: 4.80999e-06 [opt_after_jit_grad]: 0.00045645 [symbol_engine_optimizer]: 7.477e-05, [1] [Cycle 1]: 6.867e-05, [6] [build]: 3.89002e-06 [elim_shapecalc]: 8.11002e-06 [elim_not_effective]: 1.404e-05 [opt_reshape]: 5.66998e-06 [fold_const_symbol]: 8.35001e-06 [renormalize]: 5.59987e-07 [validate]: 4.012e-05 Sums bootstrap : 0.000324s : 2.34% type_inference : 0.009144s : 65.96% event_method : 0.000023s : 0.17% auto_monad : 0.000074s : 0.53% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.38% rewriter_before_opt_a : 0.000087s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000075s : 0.54% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000810s : 5.85% jit_opt_a.with_stream_mark : 0.000032s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001021s : 7.36% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000047s : 0.34% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000039s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000593s : 4.28% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000027s : 0.20% loop_unroll : 0.000440s : 3.17% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000052s : 0.37% cse_after_recomputation.cse : 0.000011s : 0.08% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000456s : 3.29% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.29% Time group info: ------[substitution.] 0.000293 27 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.77% : 0.000005s : 3: substitution.graph_param_transform 85.22% : 0.000250s : 5: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.79% : 0.000011s : 3: substitution.reduce_eliminate 1.55% : 0.000005s : 4: substitution.remove_not_recompute_node 1.61% : 0.000005s : 2: substitution.replace_old_param 3.79% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009064 2 86.85% : 0.007872s : 1: type_inference.infer 13.15% : 0.001192s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.71% : 0.000069s : 5: replace.inline 32.29% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 96.11% : 0.000247s : 5: match.inline 3.89% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 2.17% : 0.000003s : 11: predicate.arithmetic_simplify 1.39% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 1.29% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.30% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000007s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.93% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 16: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 2.33% : 0.000003s : 11: predicate.reduce_eliminate 1.72% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 11: predicate.reshape_eliminate 1.37% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.87% : 0.000010s : 59: predicate.switch_simplify 1.50% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.33% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001178 16 54.53% : 0.000643s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.76% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.71% : 0.000456s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020394 72 0.27% : 0.000055s : 1: add_recomputation 0.38% : 0.000077s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.71% : 0.000348s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 31.07% : 0.006336s : 1: jit_opt_a 0.80% : 0.000164s : 1: jit_opt_after_cconv 0.27% : 0.000055s : 1: jit_opt_b 2.20% : 0.000448s : 1: loop_unroll 2.95% : 0.000601s : 1: mutable_eliminate 5.13% : 0.001047s : 26: opt.transform.jit_opt_a 0.24% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.28% : 0.000465s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000056s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.78% : 0.000566s : 1: renormalize.infer 2.19% : 0.000446s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000042s : 1: rewriter_after_opt_a 0.44% : 0.000090s : 1: rewriter_before_opt_a 0.38% : 0.000077s : 1: symbol_engine_optimizer 44.94% : 0.009165s : 1: type_inference TotalTime = 0.0902534, [30] [bootstrap]: 0.0002842 [type_inference]: 0.049561 [event_method]: 2.061e-05 [auto_monad]: 6.892e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.87002e-06 [py_interpret_to_execute]: 9.232e-05 [rewriter_before_opt_a]: 7.938e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00534922, [2] [Cycle 1]: 0.00184173, [27] [switch_simplify]: 5.735e-05 [loop_unroll]: 2.885e-05 [a_1]: 0.0005376 [with_stream_mark]: 2.135e-05 [recompute_prepare]: 7.72998e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.76999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.35002e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00085642 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 3.342e-05 [replace_applicator]: 1.415e-05 [Cycle 2]: 0.00031331, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.93001e-06 [a_1]: 8.691e-05 [with_stream_mark]: 8.90999e-06 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 3.05998e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 4.95999e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 1.76998e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.309e-05 [j_node_and_user_rematch]: 8.1e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 5.00999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.95002e-06 [cse]: 1.2e-05 [replace_applicator]: 5.13002e-06 [py_interpret_to_execute_after_opt_a]: 1.206e-05 [rewriter_after_opt_a]: 3.47e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.0329938 [jit_opt_b]: 6.05e-05, [1] [Cycle 1]: 5.091e-05, [2] [frontend_op_eliminate]: 1.788e-05 [inline_after_opt_a]: 2.126e-05 [cconv]: 3.386e-05 [loop_unroll]: 0.00052517 [jit_opt_after_cconv]: 0.00017625, [1] [Cycle 1]: 0.00016935, [11] [c_1]: 2.18e-05 [parameter_eliminate]: 4.17998e-06 [updatestate_depend_eliminate]: 8.92999e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 4.266e-05 [call_graph_tuple_transform]: 2.294e-05 [tuple_list_get_item_eliminator]: 5.27999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 1.11002e-06 [switch_simplify]: 5.96998e-06 [remove_dup_value]: 1.854e-05 [partial_unused_args_eliminate]: 2.79999e-06 [environ_conv]: 6.48998e-06 [add_recomputation]: 5.621e-05 [cse_after_recomputation]: 2.686e-05, [1] [Cycle 1]: 2.064e-05, [1] [cse]: 1.413e-05 [auto_monad_reorder]: 1.962e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.94001e-06 [opt_after_jit_grad]: 0.00046116 [symbol_engine_optimizer]: 7.399e-05, [1] [Cycle 1]: 6.657e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.306e-05 [opt_reshape]: 6.18002e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 3.4002e-07 [validate]: 4.076e-05 Sums bootstrap : 0.000284s : 0.33% type_inference : 0.049561s : 57.34% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000092s : 0.11% rewriter_before_opt_a : 0.000079s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.07% jit_opt_a.loop_unroll : 0.000034s : 0.04% jit_opt_a.a_1 : 0.000625s : 0.72% jit_opt_a.with_stream_mark : 0.000030s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000856s : 0.99% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000045s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.032994s : 38.17% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.04% loop_unroll : 0.000525s : 0.61% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000461s : 0.53% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.05% Time group info: ------[substitution.] 0.000219 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 3.32% : 0.000007s : 3: substitution.graph_param_transform 83.54% : 0.000183s : 4: substitution.inline 1.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000004s : 2: substitution.replace_old_param 5.86% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049485 2 97.24% : 0.048117s : 1: type_inference.infer 2.76% : 0.001368s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.00% : 0.000047s : 4: replace.inline 31.00% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 93.82% : 0.000180s : 4: match.inline 6.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 1.70% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.15% : 0.000007s : 22: predicate.inline 1.03% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 3.17% : 0.000004s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 1.02% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.31% : 0.000002s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.65% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000798 13 46.20% : 0.000369s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.93% : 0.000383s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.091992 72 0.06% : 0.000059s : 1: add_recomputation 0.08% : 0.000072s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.33% : 0.000301s : 1: bootstrap 0.04% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.82% : 0.005352s : 1: jit_opt_a 0.19% : 0.000179s : 1: jit_opt_after_cconv 0.07% : 0.000064s : 1: jit_opt_b 0.58% : 0.000533s : 1: loop_unroll 35.89% : 0.033013s : 1: mutable_eliminate 0.91% : 0.000840s : 26: opt.transform.jit_opt_a 0.06% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000029s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000470s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000096s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.54% : 0.000495s : 1: renormalize.infer 0.38% : 0.000354s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000037s : 1: rewriter_after_opt_a 0.09% : 0.000083s : 1: rewriter_before_opt_a 0.08% : 0.000076s : 1: symbol_engine_optimizer 53.90% : 0.049580s : 1: type_inference TotalTime = 0.157565, [30] [bootstrap]: 0.00025276 [type_inference]: 0.127917 [event_method]: 0.00054401 [auto_monad]: 0.0001247 [graph_reusing]: 8.15e-06 [pre_auto_parallel]: 3.44001e-06 [py_interpret_to_execute]: 4.064e-05 [rewriter_before_opt_a]: 0.00013632 [expand_dump_flag]: 3.81001e-06 [jit_opt_a]: 0.0262728, [3] [Cycle 1]: 0.0184592, [27] [switch_simplify]: 8.825e-05 [loop_unroll]: 4.609e-05 [a_1]: 0.00107848 [with_stream_mark]: 4.106e-05 [recompute_prepare]: 2.733e-05 [updatestate_depend_eliminate]: 1.064e-05 [updatestate_assign_eliminate]: 7.35998e-06 [updatestate_loads_eliminate]: 6.78998e-06 [parameter_eliminate]: 3.31999e-06 [specialize_transform]: 1.538e-05 [updatestate_useless_node_eliminater]: 1.372e-05 [accelerated_algorithm]: 1.463e-05 [meta_shard_fg_expand]: 3.99002e-06 [get_grad_eliminate_]: 1.382e-05 [merge_forward]: 9.05999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.333e-05 [j_node_and_user_rematch]: 2.549e-05 [meta_fg_expand]: 0.00215511 [replace_old_param]: 8.559e-05 [inline_without_move]: 6.872e-05 [renormalize]: 0.0139384 [add_forward_monad_depend]: 1.62e-05 [auto_monad_grad]: 6.78e-06 [auto_monad_eliminator]: 6.623e-05 [cse]: 0.0002739 [replace_applicator]: 9.392e-05 [Cycle 2]: 0.00365087, [27] [switch_simplify]: 4.51e-05 [loop_unroll]: 4.223e-05 [a_1]: 0.00118817 [with_stream_mark]: 2.086e-05 [recompute_prepare]: 1.043e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 4.02998e-06 [updatestate_loads_eliminate]: 4.25e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.90002e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.75002e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.672e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 0.00011718 [replace_old_param]: 8.96998e-06 [inline_without_move]: 6.74001e-06 [renormalize]: 0.00188014 [add_forward_monad_depend]: 8.28999e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.486e-05 [cse]: 2.679e-05 [replace_applicator]: 1.631e-05 [Cycle 3]: 0.00026467, [27] [switch_simplify]: 4.13999e-06 [loop_unroll]: 3.52002e-06 [a_1]: 4.514e-05 [with_stream_mark]: 1.167e-05 [recompute_prepare]: 3.85998e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 1.95001e-06 [updatestate_loads_eliminate]: 1.69998e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 3.64002e-06 [updatestate_useless_node_eliminater]: 3.56001e-06 [accelerated_algorithm]: 3.22997e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 3.11999e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 2.79001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.242e-05 [j_node_and_user_rematch]: 6.57002e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 3.5e-06 [inline_without_move]: 3.11001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 3.3e-06 [cse]: 8.56002e-06 [replace_applicator]: 3.77002e-06 [py_interpret_to_execute_after_opt_a]: 1.368e-05 [rewriter_after_opt_a]: 3.661e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00071887 [jit_opt_b]: 4.257e-05, [1] [Cycle 1]: 3.49e-05, [2] [frontend_op_eliminate]: 1.186e-05 [inline_after_opt_a]: 1.116e-05 [cconv]: 2.853e-05 [loop_unroll]: 0.00042917 [jit_opt_after_cconv]: 0.00012884, [1] [Cycle 1]: 0.00012201, [11] [c_1]: 1.315e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 1.66002e-06 [cse]: 2.002e-05 [call_graph_tuple_transform]: 1.409e-05 [tuple_list_get_item_eliminator]: 3.86999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 3.51999e-06 [remove_dup_value]: 1.373e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 5.05999e-06 [add_recomputation]: 3.766e-05 [cse_after_recomputation]: 1.916e-05, [1] [Cycle 1]: 1.423e-05, [1] [cse]: 8.15e-06 [auto_monad_reorder]: 1.255e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.26998e-06 [opt_after_jit_grad]: 0.00043587 [symbol_engine_optimizer]: 8.13e-05, [1] [Cycle 1]: 7.487e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 7.68999e-06 [elim_not_effective]: 9.76e-06 [opt_reshape]: 3.76999e-06 [fold_const_symbol]: 1.967e-05 [renormalize]: 4.19997e-07 [validate]: 3.403e-05 Sums bootstrap : 0.000253s : 0.17% type_inference : 0.127917s : 83.76% event_method : 0.000544s : 0.36% auto_monad : 0.000125s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000041s : 0.03% rewriter_before_opt_a : 0.000136s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000137s : 0.09% jit_opt_a.loop_unroll : 0.000092s : 0.06% jit_opt_a.a_1 : 0.002312s : 1.51% jit_opt_a.with_stream_mark : 0.000074s : 0.05% jit_opt_a.recompute_prepare : 0.000042s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000062s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.002274s : 1.49% jit_opt_a.replace_old_param : 0.000098s : 0.06% jit_opt_a.inline_without_move : 0.000079s : 0.05% jit_opt_a.renormalize : 0.015819s : 10.36% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000084s : 0.06% jit_opt_a.cse : 0.000309s : 0.20% jit_opt_a.replace_applicator : 0.000114s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000719s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000429s : 0.28% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000038s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000436s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000020s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.02% Time group info: ------[substitution.] 0.000666 104 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.66% : 0.000004s : 1: substitution.graph_param_transform 66.94% : 0.000446s : 13: substitution.inline 3.73% : 0.000025s : 2: substitution.inline_without_move 1.45% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.91% : 0.000013s : 7: substitution.minmaximum_grad 1.22% : 0.000008s : 5: substitution.partial_eliminate 1.51% : 0.000010s : 12: substitution.remove_not_recompute_node 5.15% : 0.000034s : 10: substitution.replace_applicator 1.80% : 0.000012s : 10: substitution.replace_old_param 0.78% : 0.000005s : 1: substitution.set_cell_output_no_recompute 1.14% : 0.000008s : 1: substitution.tile_eliminate 3.67% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.58% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.04% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127790 2 97.58% : 0.124702s : 1: type_inference.infer 2.42% : 0.003088s : 1: type_inference.specialize ------[replace.] 0.000201 20 67.24% : 0.000135s : 13: replace.inline 32.76% : 0.000066s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000461 20 94.85% : 0.000437s : 13: match.inline 5.15% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000381 2544 1.61% : 0.000006s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.49% : 0.000006s : 44: predicate.addn_check_dump 1.62% : 0.000006s : 44: predicate.addn_zero_filter 2.23% : 0.000008s : 44: predicate.arithmetic_simplify 1.57% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 44: predicate.compare_switch_simplify 1.56% : 0.000006s : 44: predicate.depend_value_elim 1.41% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.51% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.44% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.51% : 0.000006s : 44: predicate.environ_get_depend_swap 1.47% : 0.000006s : 44: predicate.environ_get_eliminate 1.40% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.89% : 0.000003s : 17: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.37% : 0.000017s : 66: predicate.inline 2.24% : 0.000009s : 45: predicate.inline_without_move 0.35% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.04% : 0.000004s : 17: predicate.less_batch_normalization 1.87% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.96% : 0.000007s : 52: predicate.load_eliminater 0.37% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.52% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.41% : 0.000005s : 44: predicate.merge_addn 1.48% : 0.000006s : 44: predicate.minmaximum_grad 0.35% : 0.000001s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.33% : 0.000009s : 52: predicate.partial_eliminate 1.47% : 0.000006s : 44: predicate.print_const_string_wrapper 2.09% : 0.000008s : 44: predicate.reduce_eliminate 1.78% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 17: predicate.remove_not_recompute_node 2.83% : 0.000011s : 96: predicate.replace_applicator 1.15% : 0.000004s : 45: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 44: predicate.reshape_eliminate 1.58% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000006s : 44: predicate.same_eliminate 0.45% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.11% : 0.000000s : 2: predicate.special_op_eliminate 0.79% : 0.000003s : 17: predicate.specialize_transform 1.78% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.74% : 0.000010s : 64: predicate.switch_defer_inline 2.53% : 0.000010s : 64: predicate.switch_layer_defer_inline 6.73% : 0.000026s : 157: predicate.switch_simplify 1.84% : 0.000007s : 44: predicate.tile_eliminate 1.56% : 0.000006s : 44: predicate.transpose_eliminate 1.90% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.80% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.80% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.67% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.80% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003945 45 76.45% : 0.003016s : 28: func_graph_cloner_run.FuncGraphClonerGraph 23.55% : 0.000929s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.176410 87 0.02% : 0.000040s : 1: add_recomputation 0.07% : 0.000132s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.16% : 0.000280s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.31% : 0.000554s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.89% : 0.026276s : 1: jit_opt_a 0.07% : 0.000131s : 1: jit_opt_after_cconv 0.03% : 0.000045s : 1: jit_opt_b 0.25% : 0.000437s : 1: loop_unroll 0.41% : 0.000728s : 1: mutable_eliminate 1.71% : 0.003022s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000444s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.59% : 0.013382s : 2: renormalize.infer 1.37% : 0.002411s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000140s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 72.52% : 0.127940s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.885.434 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dd30> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:31.886.243 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.123556, [30] [bootstrap]: 0.00045423 [type_inference]: 0.0433706 [event_method]: 2.182e-05 [auto_monad]: 7.055e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.45002e-06 [py_interpret_to_execute]: 0.00012673 [rewriter_before_opt_a]: 8.833e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0764276, [2] [Cycle 1]: 0.00342884, [27] [switch_simplify]: 0.00021331 [loop_unroll]: 7.014e-05 [a_1]: 0.00090831 [with_stream_mark]: 2.88e-05 [recompute_prepare]: 1.065e-05 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 3.28e-06 [specialize_transform]: 7.54002e-06 [updatestate_useless_node_eliminater]: 7.13e-06 [accelerated_algorithm]: 8.54e-06 [meta_shard_fg_expand]: 4.02e-06 [get_grad_eliminate_]: 8.82e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 1.66998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.013e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 3.01001e-06 [replace_old_param]: 1.296e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00171881 [add_forward_monad_depend]: 8.95999e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 2.002e-05 [cse]: 3.844e-05 [replace_applicator]: 2.132e-05 [Cycle 2]: 0.00037942, [27] [switch_simplify]: 6.76999e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00010683 [with_stream_mark]: 1.187e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 6.89001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.833e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.524e-05 [replace_applicator]: 5.64998e-06 [py_interpret_to_execute_after_opt_a]: 1.834e-05 [rewriter_after_opt_a]: 5.232e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00101183 [jit_opt_b]: 6.147e-05, [1] [Cycle 1]: 5.235e-05, [2] [frontend_op_eliminate]: 2.004e-05 [inline_after_opt_a]: 1.914e-05 [cconv]: 3.388e-05 [loop_unroll]: 0.00053448 [jit_opt_after_cconv]: 0.00017686, [1] [Cycle 1]: 0.00017066, [11] [c_1]: 2.306e-05 [parameter_eliminate]: 4.15e-06 [updatestate_depend_eliminate]: 8.2e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 3.899e-05 [call_graph_tuple_transform]: 2.301e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.07001e-06 [remove_dup_value]: 1.89e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 6.92997e-06 [add_recomputation]: 6.466e-05 [cse_after_recomputation]: 2.615e-05, [1] [Cycle 1]: 2.043e-05, [1] [cse]: 1.302e-05 [auto_monad_reorder]: 1.875e-05 [get_jit_bprop_graph]: 3.71999e-06 [rewriter_after_jit_bprop_graph]: 9.00001e-06 [opt_after_jit_grad]: 0.0005244 [symbol_engine_optimizer]: 9.829e-05, [1] [Cycle 1]: 8.983e-05, [6] [build]: 5.02e-06 [elim_shapecalc]: 1.011e-05 [elim_not_effective]: 1.559e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 1.023e-05 [renormalize]: 7.89994e-07 [validate]: 9.676e-05 Sums bootstrap : 0.000454s : 0.91% type_inference : 0.043371s : 86.44% event_method : 0.000022s : 0.04% auto_monad : 0.000071s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000127s : 0.25% rewriter_before_opt_a : 0.000088s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000220s : 0.44% jit_opt_a.loop_unroll : 0.000077s : 0.15% jit_opt_a.a_1 : 0.001015s : 2.02% jit_opt_a.with_stream_mark : 0.000041s : 0.08% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001719s : 3.43% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.05% jit_opt_a.cse : 0.000054s : 0.11% jit_opt_a.replace_applicator : 0.000027s : 0.05% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000052s : 0.10% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001012s : 2.02% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000034s : 0.07% loop_unroll : 0.000534s : 1.07% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000065s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000004s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000524s : 1.05% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000097s : 0.19% Time group info: ------[substitution.] 0.000403 23 0.97% : 0.000004s : 2: substitution.elim_not_effective 0.39% : 0.000002s : 2: substitution.fold_const_symbol 1.57% : 0.000006s : 3: substitution.graph_param_transform 87.90% : 0.000354s : 4: substitution.inline 1.14% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000007s : 4: substitution.remove_not_recompute_node 1.72% : 0.000007s : 2: substitution.replace_old_param 4.49% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043252 2 96.20% : 0.041607s : 1: type_inference.infer 3.80% : 0.001645s : 1: type_inference.specialize ------[replace.] 0.000128 6 69.17% : 0.000088s : 4: replace.inline 30.83% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000368 6 95.36% : 0.000351s : 4: match.inline 4.64% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000242 691 1.14% : 0.000003s : 10: predicate.accumulaten_eliminater 0.76% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.78% : 0.000002s : 10: predicate.addn_check_dump 0.93% : 0.000002s : 10: predicate.addn_zero_filter 1.68% : 0.000004s : 10: predicate.arithmetic_simplify 1.47% : 0.000004s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 0.78% : 0.000002s : 10: predicate.compare_switch_simplify 0.87% : 0.000002s : 10: predicate.depend_value_elim 0.83% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000003s : 10: predicate.dict_get_item_eliminator 0.88% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.50% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.18% : 0.000000s : 3: predicate.elim_not_effective 0.36% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.74% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.72% : 0.000002s : 10: predicate.environ_get_depend_swap 0.77% : 0.000002s : 10: predicate.environ_get_eliminate 0.56% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000001s : 3: predicate.graph_param_transform 3.60% : 0.000009s : 22: predicate.inline 0.44% : 0.000001s : 6: predicate.inline_without_move 0.19% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000003s : 6: predicate.less_batch_normalization 1.14% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000004s : 15: predicate.load_eliminater 1.12% : 0.000003s : 3: predicate.loop_unroll_after_grad 5.55% : 0.000013s : 34: predicate.loop_unroll_before_grad 1.53% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.69% : 0.000002s : 10: predicate.merge_addn 0.69% : 0.000002s : 10: predicate.minmaximum_grad 1.43% : 0.000003s : 3: predicate.mutable_eliminate 0.27% : 0.000001s : 3: predicate.opt_reshape 1.13% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000002s : 10: predicate.print_const_string_wrapper 1.58% : 0.000004s : 10: predicate.reduce_eliminate 1.06% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.06% : 0.000003s : 18: predicate.replace_applicator 0.36% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000001s : 3: predicate.reset_defer_inline 0.97% : 0.000002s : 10: predicate.reshape_eliminate 0.97% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000003s : 10: predicate.same_eliminate 0.26% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.63% : 0.000002s : 6: predicate.special_op_eliminate 0.49% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000003s : 10: predicate.stack_unstack_eliminate 0.21% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.02% : 0.000005s : 16: predicate.switch_defer_inline 1.35% : 0.000003s : 16: predicate.switch_layer_defer_inline 30.02% : 0.000073s : 53: predicate.switch_simplify 0.96% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000003s : 10: predicate.transpose_eliminate 0.95% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.98% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 2.63% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.10% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 1.64% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.36% : 0.000003s : 10: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.44% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001009 13 41.66% : 0.000420s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.40% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.94% : 0.000524s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126735 72 0.05% : 0.000067s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.38% : 0.000476s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 60.31% : 0.076433s : 1: jit_opt_a 0.14% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.43% : 0.000544s : 1: loop_unroll 0.81% : 0.001027s : 1: mutable_eliminate 1.14% : 0.001451s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000534s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000131s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.80% : 0.001013s : 1: renormalize.infer 0.55% : 0.000693s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000056s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.08% : 0.000101s : 1: symbol_engine_optimizer 34.24% : 0.043391s : 1: type_inference TotalTime = 0.0266708, [30] [bootstrap]: 0.00027079 [type_inference]: 0.0187733 [event_method]: 1.803e-05 [auto_monad]: 6.865e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 9.218e-05 [rewriter_before_opt_a]: 7.571e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00519477, [2] [Cycle 1]: 0.0017525, [27] [switch_simplify]: 5.513e-05 [loop_unroll]: 3.209e-05 [a_1]: 0.00052744 [with_stream_mark]: 1.676e-05 [recompute_prepare]: 7.75e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.494e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.26998e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00078659 [add_forward_monad_depend]: 6.96001e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.494e-05 [cse]: 3.589e-05 [replace_applicator]: 1.354e-05 [Cycle 2]: 0.00031524, [27] [switch_simplify]: 5.68997e-06 [loop_unroll]: 5.37001e-06 [a_1]: 9.002e-05 [with_stream_mark]: 9.34998e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.161e-05 [j_node_and_user_rematch]: 8.22e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 4.72998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.30001e-06 [cse]: 1.203e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.109e-05 [rewriter_after_opt_a]: 3.494e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00048639 [jit_opt_b]: 4.992e-05, [1] [Cycle 1]: 4.216e-05, [2] [frontend_op_eliminate]: 1.567e-05 [inline_after_opt_a]: 1.53e-05 [cconv]: 2.459e-05 [loop_unroll]: 0.00040677 [jit_opt_after_cconv]: 0.00013637, [1] [Cycle 1]: 0.00012985, [11] [c_1]: 1.991e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 1.943e-05 [call_graph_tuple_transform]: 1.748e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 1.497e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5.159e-05 [cse_after_recomputation]: 3.426e-05, [1] [Cycle 1]: 2.922e-05, [1] [cse]: 1.145e-05 [auto_monad_reorder]: 1.907e-05 [get_jit_bprop_graph]: 1.78997e-06 [rewriter_after_jit_bprop_graph]: 1.813e-05 [opt_after_jit_grad]: 0.00057192 [symbol_engine_optimizer]: 7.283e-05, [1] [Cycle 1]: 6.605e-05, [6] [build]: 3.33998e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.248e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 4.00003e-07 [validate]: 3.739e-05 Sums bootstrap : 0.000271s : 1.18% type_inference : 0.018773s : 81.76% event_method : 0.000018s : 0.08% auto_monad : 0.000069s : 0.30% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000092s : 0.40% rewriter_before_opt_a : 0.000076s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.16% jit_opt_a.a_1 : 0.000617s : 2.69% jit_opt_a.with_stream_mark : 0.000026s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000787s : 3.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.09% jit_opt_a.cse : 0.000048s : 0.21% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000035s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000486s : 2.12% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000015s : 0.07% cconv : 0.000025s : 0.11% loop_unroll : 0.000407s : 1.77% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000052s : 0.22% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000018s : 0.08% opt_after_jit_grad : 0.000572s : 2.49% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.16% Time group info: ------[substitution.] 0.000198 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 83.42% : 0.000165s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000004s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 6.16% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018703 2 93.48% : 0.017483s : 1: type_inference.infer 6.52% : 0.001220s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.59% : 0.000044s : 4: replace.inline 32.41% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.60% : 0.000163s : 4: match.inline 6.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.39% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.55% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.54% : 0.000002s : 10: predicate.environ_get_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.59% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.23% : 0.000001s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000729 13 46.76% : 0.000341s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.04% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.20% : 0.000351s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028342 72 0.19% : 0.000054s : 1: add_recomputation 0.25% : 0.000072s : 1: auto_monad 0.08% : 0.000022s : 1: auto_monad_reorder 1.02% : 0.000289s : 1: bootstrap 0.10% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000036s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.34% : 0.005198s : 1: jit_opt_a 0.49% : 0.000139s : 1: jit_opt_after_cconv 0.19% : 0.000053s : 1: jit_opt_b 1.46% : 0.000414s : 1: loop_unroll 1.75% : 0.000495s : 1: mutable_eliminate 2.94% : 0.000833s : 26: opt.transform.jit_opt_a 0.16% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.08% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.05% : 0.000581s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000096s : 1: py_interpret_to_execute 0.05% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000017s : 1: remove_dup_value 1.58% : 0.000448s : 1: renormalize.infer 1.17% : 0.000331s : 1: renormalize.specialize 0.07% : 0.000020s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000038s : 1: rewriter_after_opt_a 0.28% : 0.000079s : 1: rewriter_before_opt_a 0.27% : 0.000075s : 1: symbol_engine_optimizer 66.29% : 0.018789s : 1: type_inference TotalTime = 0.155003, [30] [bootstrap]: 0.00026721 [type_inference]: 0.127325 [event_method]: 0.00043412 [auto_monad]: 0.00010889 [graph_reusing]: 7.25e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 7.259e-05 [rewriter_before_opt_a]: 0.00012344 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.0243703, [3] [Cycle 1]: 0.0166242, [27] [switch_simplify]: 7.261e-05 [loop_unroll]: 4.306e-05 [a_1]: 0.00095961 [with_stream_mark]: 3.152e-05 [recompute_prepare]: 2.062e-05 [updatestate_depend_eliminate]: 9.16998e-06 [updatestate_assign_eliminate]: 6.84001e-06 [updatestate_loads_eliminate]: 6.80002e-06 [parameter_eliminate]: 2.65997e-06 [specialize_transform]: 1.486e-05 [updatestate_useless_node_eliminater]: 1.327e-05 [accelerated_algorithm]: 1.464e-05 [meta_shard_fg_expand]: 3.71999e-06 [get_grad_eliminate_]: 1.343e-05 [merge_forward]: 8.73001e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.727e-05 [j_node_and_user_rematch]: 2.583e-05 [meta_fg_expand]: 0.00181916 [replace_old_param]: 7.552e-05 [inline_without_move]: 6.241e-05 [renormalize]: 0.0127051 [add_forward_monad_depend]: 1.278e-05 [auto_monad_grad]: 6.58e-06 [auto_monad_eliminator]: 6.578e-05 [cse]: 0.00026 [replace_applicator]: 9.441e-05 [Cycle 2]: 0.00406403, [27] [switch_simplify]: 4.433e-05 [loop_unroll]: 4.379e-05 [a_1]: 0.00123534 [with_stream_mark]: 2.026e-05 [recompute_prepare]: 1.085e-05 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 4.58999e-06 [updatestate_loads_eliminate]: 4.23001e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 8.52998e-06 [updatestate_useless_node_eliminater]: 8.84003e-06 [accelerated_algorithm]: 8.84e-06 [meta_shard_fg_expand]: 3.09999e-06 [get_grad_eliminate_]: 7.9e-06 [merge_forward]: 5.59e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.912e-05 [j_node_and_user_rematch]: 1.399e-05 [meta_fg_expand]: 0.00011239 [replace_old_param]: 1.002e-05 [inline_without_move]: 8.33999e-06 [renormalize]: 0.00223958 [add_forward_monad_depend]: 8.36002e-06 [auto_monad_grad]: 2.14e-06 [auto_monad_eliminator]: 1.456e-05 [cse]: 2.439e-05 [replace_applicator]: 1.651e-05 [Cycle 3]: 0.00025385, [27] [switch_simplify]: 4.57e-06 [loop_unroll]: 3.79002e-06 [a_1]: 4.125e-05 [with_stream_mark]: 1.075e-05 [recompute_prepare]: 3.6e-06 [updatestate_depend_eliminate]: 2.36e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.92001e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 3.41001e-06 [updatestate_useless_node_eliminater]: 3.54002e-06 [accelerated_algorithm]: 3.26999e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 3.06001e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.151e-05 [j_node_and_user_rematch]: 6.16e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 3.11001e-06 [inline_without_move]: 2.91e-06 [renormalize]: 1.80007e-07 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 3.70998e-06 [cse]: 8.33001e-06 [replace_applicator]: 3.51001e-06 [py_interpret_to_execute_after_opt_a]: 1.3e-05 [rewriter_after_opt_a]: 3.576e-05 [convert_after_rewriter]: 5.79e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00071203 [jit_opt_b]: 4.397e-05, [1] [Cycle 1]: 3.621e-05, [2] [frontend_op_eliminate]: 1.067e-05 [inline_after_opt_a]: 1.16e-05 [cconv]: 2.721e-05 [loop_unroll]: 0.00042461 [jit_opt_after_cconv]: 0.00013103, [1] [Cycle 1]: 0.00012372, [11] [c_1]: 1.239e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 1.92999e-06 [cse]: 2.079e-05 [call_graph_tuple_transform]: 1.458e-05 [tuple_list_get_item_eliminator]: 3.66001e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 3.56001e-06 [remove_dup_value]: 1.462e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 5.29e-06 [add_recomputation]: 3.57e-05 [cse_after_recomputation]: 2.011e-05, [1] [Cycle 1]: 1.511e-05, [1] [cse]: 8.82e-06 [auto_monad_reorder]: 1.276e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00049292 [symbol_engine_optimizer]: 6.887e-05, [1] [Cycle 1]: 6.283e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 7.01001e-06 [elim_not_effective]: 1.098e-05 [opt_reshape]: 4.28001e-06 [fold_const_symbol]: 6.30002e-06 [renormalize]: 3.30008e-07 [validate]: 3.374e-05 Sums bootstrap : 0.000267s : 0.18% type_inference : 0.127325s : 84.49% event_method : 0.000434s : 0.29% auto_monad : 0.000109s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000073s : 0.05% rewriter_before_opt_a : 0.000123s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000122s : 0.08% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002236s : 1.48% jit_opt_a.with_stream_mark : 0.000063s : 0.04% jit_opt_a.recompute_prepare : 0.000035s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000027s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.03% jit_opt_a.meta_fg_expand : 0.001933s : 1.28% jit_opt_a.replace_old_param : 0.000089s : 0.06% jit_opt_a.inline_without_move : 0.000074s : 0.05% jit_opt_a.renormalize : 0.014945s : 9.92% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000084s : 0.06% jit_opt_a.cse : 0.000293s : 0.19% jit_opt_a.replace_applicator : 0.000114s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000712s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000425s : 0.28% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000493s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.02% Time group info: ------[substitution.] 0.000587 107 0.30% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.77% : 0.000005s : 1: substitution.graph_param_transform 65.35% : 0.000384s : 13: substitution.inline 3.32% : 0.000019s : 2: substitution.inline_without_move 1.84% : 0.000011s : 13: substitution.j_node_and_user_rematch 2.02% : 0.000012s : 7: substitution.minmaximum_grad 1.25% : 0.000007s : 5: substitution.partial_eliminate 1.83% : 0.000011s : 13: substitution.remove_not_recompute_node 5.47% : 0.000032s : 10: substitution.replace_applicator 1.17% : 0.000007s : 10: substitution.replace_old_param 1.34% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.11% : 0.000007s : 1: substitution.tile_eliminate 3.80% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.58% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.22% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127228 2 97.69% : 0.124290s : 1: type_inference.infer 2.31% : 0.002939s : 1: type_inference.specialize ------[replace.] 0.000180 20 65.82% : 0.000118s : 13: replace.inline 34.18% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000397 20 94.67% : 0.000376s : 13: match.inline 5.33% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000383 2656 1.54% : 0.000006s : 46: predicate.accumulaten_eliminater 0.26% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.52% : 0.000006s : 46: predicate.addn_check_dump 1.56% : 0.000006s : 46: predicate.addn_zero_filter 1.95% : 0.000007s : 46: predicate.arithmetic_simplify 1.67% : 0.000006s : 46: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 46: predicate.compare_switch_simplify 1.44% : 0.000006s : 46: predicate.depend_value_elim 1.48% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.57% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.45% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_depend_swap 1.59% : 0.000006s : 46: predicate.environ_get_eliminate 1.41% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.84% : 0.000003s : 19: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.28% : 0.000016s : 68: predicate.inline 2.18% : 0.000008s : 47: predicate.inline_without_move 0.39% : 0.000002s : 19: predicate.j_node_and_user_rematch 1.20% : 0.000005s : 19: predicate.less_batch_normalization 1.88% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.89% : 0.000007s : 54: predicate.load_eliminater 0.35% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.50% : 0.000013s : 94: predicate.loop_unroll_before_grad 1.70% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.50% : 0.000006s : 46: predicate.merge_addn 1.45% : 0.000006s : 46: predicate.minmaximum_grad 0.48% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.27% : 0.000009s : 54: predicate.partial_eliminate 1.61% : 0.000006s : 46: predicate.print_const_string_wrapper 2.17% : 0.000008s : 46: predicate.reduce_eliminate 1.92% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000002s : 19: predicate.remove_not_recompute_node 2.82% : 0.000011s : 100: predicate.replace_applicator 1.21% : 0.000005s : 47: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 46: predicate.reshape_eliminate 1.49% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 1: predicate.row_tensor_eliminate 1.62% : 0.000006s : 46: predicate.same_eliminate 0.52% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 19: predicate.specialize_transform 1.81% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.73% : 0.000010s : 66: predicate.switch_defer_inline 2.44% : 0.000009s : 66: predicate.switch_layer_defer_inline 6.28% : 0.000024s : 161: predicate.switch_simplify 1.52% : 0.000006s : 46: predicate.tile_eliminate 1.47% : 0.000006s : 46: predicate.transpose_eliminate 1.92% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.22% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.96% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.86% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.99% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.79% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.85% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.09% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003913 45 76.45% : 0.002991s : 28: func_graph_cloner_run.FuncGraphClonerGraph 23.55% : 0.000922s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.172863 87 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000115s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.17% : 0.000298s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.26% : 0.000442s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.10% : 0.024373s : 1: jit_opt_a 0.08% : 0.000134s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.25% : 0.000432s : 1: loop_unroll 0.42% : 0.000721s : 1: mutable_eliminate 1.69% : 0.002917s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000500s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000076s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.31% : 0.012641s : 2: renormalize.infer 1.32% : 0.002281s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000127s : 1: rewriter_before_opt_a 0.04% : 0.000071s : 1: symbol_engine_optimizer 73.67% : 0.127347s : 1: type_inference TotalTime = 0.0932447, [30] [bootstrap]: 0.00034567 [type_inference]: 0.0208007 [event_method]: 1.87e-05 [auto_monad]: 6.788e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 9.224e-05 [rewriter_before_opt_a]: 8.175e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.0696137, [2] [Cycle 1]: 0.066126, [27] [switch_simplify]: 5.251e-05 [loop_unroll]: 2.996e-05 [a_1]: 0.00051567 [with_stream_mark]: 1.725e-05 [recompute_prepare]: 7.38e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 9.56003e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 0.0651493 [add_forward_monad_depend]: 8.64e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.015e-05 [cse]: 3.596e-05 [replace_applicator]: 2.27e-05 [Cycle 2]: 0.00037043, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 5.29998e-06 [a_1]: 0.00010015 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 3.84997e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 4.79998e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 3.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.705e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 9.08002e-06 [inline_without_move]: 4.82998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.362e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.365e-05 [rewriter_after_opt_a]: 3.877e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00063125 [jit_opt_b]: 5.026e-05, [1] [Cycle 1]: 4.329e-05, [2] [frontend_op_eliminate]: 1.634e-05 [inline_after_opt_a]: 1.62e-05 [cconv]: 2.687e-05 [loop_unroll]: 0.00041007 [jit_opt_after_cconv]: 0.00014077, [1] [Cycle 1]: 0.00013472, [11] [c_1]: 2.058e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.084e-05 [call_graph_tuple_transform]: 1.934e-05 [tuple_list_get_item_eliminator]: 5.27999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.611e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 5.968e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.835e-05, [1] [cse]: 1.272e-05 [auto_monad_reorder]: 1.784e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 4.96002e-06 [opt_after_jit_grad]: 0.00047289 [symbol_engine_optimizer]: 7.103e-05, [1] [Cycle 1]: 6.463e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.68001e-06 [elim_not_effective]: 1.302e-05 [opt_reshape]: 5.70001e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.89991e-07 [validate]: 4.155e-05 Sums bootstrap : 0.000346s : 0.39% type_inference : 0.020801s : 23.23% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000092s : 0.10% rewriter_before_opt_a : 0.000082s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000616s : 0.69% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000012s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.065149s : 72.77% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000050s : 0.06% jit_opt_a.replace_applicator : 0.000029s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000631s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000410s : 0.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000060s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000473s : 0.53% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.05% Time group info: ------[substitution.] 0.000196 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.83% : 0.000006s : 3: substitution.graph_param_transform 81.66% : 0.000160s : 4: substitution.inline 1.96% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 3.01% : 0.000006s : 2: substitution.replace_old_param 6.13% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020736 2 93.60% : 0.019408s : 1: type_inference.infer 6.40% : 0.001328s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.60% : 0.000048s : 4: replace.inline 31.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.46% : 0.000157s : 4: match.inline 6.54% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.72% : 0.000002s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.77% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.55% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.03% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000002s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.96% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000881 13 44.43% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.99% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.58% : 0.000455s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.159279 72 0.04% : 0.000063s : 1: add_recomputation 0.04% : 0.000071s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000365s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 43.71% : 0.069617s : 1: jit_opt_a 0.09% : 0.000143s : 1: jit_opt_after_cconv 0.03% : 0.000053s : 1: jit_opt_b 0.26% : 0.000418s : 1: loop_unroll 0.40% : 0.000639s : 1: mutable_eliminate 0.53% : 0.000841s : 26: opt.transform.jit_opt_a 0.03% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000480s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000096s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 40.57% : 0.064615s : 1: renormalize.infer 0.33% : 0.000520s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000085s : 1: rewriter_before_opt_a 0.05% : 0.000073s : 1: symbol_engine_optimizer 13.07% : 0.020814s : 1: type_inference TotalTime = 0.0510667, [30] [bootstrap]: 0.0002773 [type_inference]: 0.0422165 [event_method]: 2.032e-05 [auto_monad]: 6.8e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.0002037 [rewriter_before_opt_a]: 7.982e-05 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00595858, [2] [Cycle 1]: 0.00240122, [27] [switch_simplify]: 4.567e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.00054571 [with_stream_mark]: 1.384e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.18002e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.151e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 6.84999e-06 [renormalize]: 0.00145377 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.427e-05 [cse]: 2.079e-05 [replace_applicator]: 1.389e-05 [Cycle 2]: 0.00035158, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.76e-06 [a_1]: 0.00011817 [with_stream_mark]: 1.014e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 2.83003e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.59998e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.29998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 1.48002e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.009e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 9.60001e-06 [rewriter_after_opt_a]: 2.998e-05 [convert_after_rewriter]: 6.43998e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00062689 [jit_opt_b]: 5.482e-05, [1] [Cycle 1]: 4.768e-05, [2] [frontend_op_eliminate]: 1.823e-05 [inline_after_opt_a]: 1.821e-05 [cconv]: 2.528e-05 [loop_unroll]: 0.00043804 [jit_opt_after_cconv]: 0.00015731, [1] [Cycle 1]: 0.00015053, [11] [c_1]: 2.547e-05 [parameter_eliminate]: 3.66001e-06 [updatestate_depend_eliminate]: 6.71999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.447e-05 [call_graph_tuple_transform]: 2.311e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.22e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.359e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 4.693e-05 [cse_after_recomputation]: 2.097e-05, [1] [Cycle 1]: 1.579e-05, [1] [cse]: 1.025e-05 [auto_monad_reorder]: 1.501e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.36002e-06 [opt_after_jit_grad]: 0.00048212 [symbol_engine_optimizer]: 7.754e-05, [1] [Cycle 1]: 7.07e-05, [6] [build]: 3.86001e-06 [elim_shapecalc]: 8.46002e-06 [elim_not_effective]: 1.462e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 3.00002e-07 [validate]: 3.773e-05 Sums bootstrap : 0.000277s : 0.59% type_inference : 0.042217s : 89.25% event_method : 0.000020s : 0.04% auto_monad : 0.000068s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000204s : 0.43% rewriter_before_opt_a : 0.000080s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000052s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000664s : 1.40% jit_opt_a.with_stream_mark : 0.000024s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000003s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001454s : 3.07% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000031s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000627s : 1.33% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000025s : 0.05% loop_unroll : 0.000438s : 0.93% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000047s : 0.10% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000482s : 1.02% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.08% Time group info: ------[substitution.] 0.000196 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 4: substitution.graph_param_transform 83.20% : 0.000163s : 4: substitution.inline 1.79% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 6.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042143 2 95.86% : 0.040400s : 1: type_inference.infer 4.14% : 0.001743s : 1: type_inference.specialize ------[replace.] 0.000067 6 69.02% : 0.000046s : 4: replace.inline 30.98% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.50% : 0.000161s : 4: match.inline 6.50% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000001s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.47% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.72% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000001s : 12: predicate.print_const_string_wrapper 1.53% : 0.000002s : 12: predicate.reduce_eliminate 1.56% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000001s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000001s : 12: predicate.same_eliminate 0.98% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.10% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000001s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001694 18 69.43% : 0.001176s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.00% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.57% : 0.000484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053482 72 0.09% : 0.000050s : 1: add_recomputation 0.13% : 0.000071s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.54% : 0.000286s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.15% : 0.005961s : 1: jit_opt_a 0.30% : 0.000161s : 1: jit_opt_after_cconv 0.11% : 0.000057s : 1: jit_opt_b 0.83% : 0.000446s : 1: loop_unroll 1.19% : 0.000636s : 1: mutable_eliminate 1.65% : 0.000881s : 26: opt.transform.jit_opt_a 0.11% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000209s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.81% : 0.000970s : 1: renormalize.infer 0.89% : 0.000475s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000033s : 1: rewriter_after_opt_a 0.16% : 0.000085s : 1: rewriter_before_opt_a 0.15% : 0.000080s : 1: symbol_engine_optimizer 78.97% : 0.042235s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.524.80 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dc10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.532.88 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0124303, [30] [bootstrap]: 0.0002988 [type_inference]: 0.00461759 [event_method]: 1.681e-05 [auto_monad]: 0.00011033 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 3.472e-05 [rewriter_before_opt_a]: 7.479e-05 [expand_dump_flag]: 3.03998e-06 [jit_opt_a]: 0.00527428, [2] [Cycle 1]: 0.00176619, [27] [switch_simplify]: 5.787e-05 [loop_unroll]: 3.232e-05 [a_1]: 0.00056057 [with_stream_mark]: 1.785e-05 [recompute_prepare]: 7.21001e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.21998e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00061541 [add_forward_monad_depend]: 5.65001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.516e-05 [cse]: 0.00018057 [replace_applicator]: 1.266e-05 [Cycle 2]: 0.00032836, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.15001e-06 [a_1]: 9.439e-05 [with_stream_mark]: 1.188e-05 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 4.86997e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 4.55999e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.37e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.342e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 7.51001e-06 [inline_without_move]: 4.57e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.235e-05 [replace_applicator]: 5.09998e-06 [py_interpret_to_execute_after_opt_a]: 9.72001e-06 [rewriter_after_opt_a]: 3.399e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00051369 [jit_opt_b]: 4.779e-05, [1] [Cycle 1]: 4.09e-05, [2] [frontend_op_eliminate]: 1.498e-05 [inline_after_opt_a]: 1.545e-05 [cconv]: 2.512e-05 [loop_unroll]: 0.00039865 [jit_opt_after_cconv]: 0.00013685, [1] [Cycle 1]: 0.00013014, [11] [c_1]: 1.981e-05 [parameter_eliminate]: 2.86999e-06 [updatestate_depend_eliminate]: 5.99e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.776e-05 [call_graph_tuple_transform]: 1.825e-05 [tuple_list_get_item_eliminator]: 5.56998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.504e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 6.32001e-06 [add_recomputation]: 5.009e-05 [cse_after_recomputation]: 2.258e-05, [1] [Cycle 1]: 1.68e-05, [1] [cse]: 1.089e-05 [auto_monad_reorder]: 1.594e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 3.88999e-06 [opt_after_jit_grad]: 0.00042385 [symbol_engine_optimizer]: 7.058e-05, [1] [Cycle 1]: 6.441e-05, [6] [build]: 3.12002e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.314e-05 [opt_reshape]: 5.63002e-06 [fold_const_symbol]: 8.31002e-06 [renormalize]: 3.59985e-07 [validate]: 3.408e-05 Sums bootstrap : 0.000299s : 3.44% type_inference : 0.004618s : 53.18% event_method : 0.000017s : 0.19% auto_monad : 0.000110s : 1.27% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.40% rewriter_before_opt_a : 0.000075s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000064s : 0.74% jit_opt_a.loop_unroll : 0.000037s : 0.43% jit_opt_a.a_1 : 0.000655s : 7.54% jit_opt_a.with_stream_mark : 0.000030s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.05% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000616s : 7.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000193s : 2.22% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000034s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000514s : 5.92% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.29% loop_unroll : 0.000399s : 4.59% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000050s : 0.58% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000424s : 4.88% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.39% Time group info: ------[substitution.] 0.000202 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 83.45% : 0.000169s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000005s : 2: substitution.replace_old_param 6.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004560 2 82.86% : 0.003779s : 1: type_inference.infer 17.14% : 0.000782s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.33% : 0.000044s : 4: replace.inline 33.67% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.73% : 0.000166s : 4: match.inline 6.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.32% : 0.000002s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.36% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.78% : 0.000001s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.50% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.42% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000010s : 53: predicate.switch_simplify 1.41% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.95% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000610 13 53.15% : 0.000324s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.96% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.88% : 0.000249s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013965 72 0.38% : 0.000053s : 1: add_recomputation 0.82% : 0.000115s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.28% : 0.000318s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.79% : 0.005277s : 1: jit_opt_a 1.00% : 0.000139s : 1: jit_opt_after_cconv 0.36% : 0.000050s : 1: jit_opt_b 2.91% : 0.000406s : 1: loop_unroll 3.74% : 0.000522s : 1: mutable_eliminate 6.24% : 0.000872s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.14% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.09% : 0.000431s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.40% : 0.000335s : 1: renormalize.infer 1.95% : 0.000273s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000037s : 1: rewriter_after_opt_a 0.56% : 0.000078s : 1: rewriter_before_opt_a 0.52% : 0.000073s : 1: symbol_engine_optimizer 33.16% : 0.004630s : 1: type_inference TotalTime = 0.0948231, [30] [bootstrap]: 0.00025784 [type_inference]: 0.0656468 [event_method]: 0.00027097 [auto_monad]: 0.00010563 [graph_reusing]: 7.38e-06 [pre_auto_parallel]: 3.3e-06 [py_interpret_to_execute]: 3.446e-05 [rewriter_before_opt_a]: 0.00012322 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.0260231, [3] [Cycle 1]: 0.0180679, [27] [switch_simplify]: 8.36e-05 [loop_unroll]: 4.764e-05 [a_1]: 0.0010462 [with_stream_mark]: 3.677e-05 [recompute_prepare]: 2.51e-05 [updatestate_depend_eliminate]: 1.064e-05 [updatestate_assign_eliminate]: 7.45003e-06 [updatestate_loads_eliminate]: 6.64001e-06 [parameter_eliminate]: 3.73001e-06 [specialize_transform]: 1.707e-05 [updatestate_useless_node_eliminater]: 1.379e-05 [accelerated_algorithm]: 1.479e-05 [meta_shard_fg_expand]: 4.53001e-06 [get_grad_eliminate_]: 1.476e-05 [merge_forward]: 8.70999e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.195e-05 [j_node_and_user_rematch]: 3.559e-05 [meta_fg_expand]: 0.00208099 [replace_old_param]: 7.604e-05 [inline_without_move]: 6.347e-05 [renormalize]: 0.0135757 [add_forward_monad_depend]: 1.294e-05 [auto_monad_grad]: 6.46e-06 [auto_monad_eliminator]: 6.433e-05 [cse]: 0.0002664 [replace_applicator]: 0.00012205 [Cycle 2]: 0.00398071, [27] [switch_simplify]: 4.667e-05 [loop_unroll]: 4.353e-05 [a_1]: 0.0012264 [with_stream_mark]: 1.824e-05 [recompute_prepare]: 1.105e-05 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 3.98001e-06 [updatestate_loads_eliminate]: 4.16001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 8.53001e-06 [updatestate_useless_node_eliminater]: 8.17e-06 [accelerated_algorithm]: 8.97e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 8.20999e-06 [merge_forward]: 4.55999e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.858e-05 [j_node_and_user_rematch]: 1.327e-05 [meta_fg_expand]: 0.00010077 [replace_old_param]: 9.66998e-06 [inline_without_move]: 8.3e-06 [renormalize]: 0.00218709 [add_forward_monad_depend]: 7.70998e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.189e-05 [cse]: 2.501e-05 [replace_applicator]: 1.491e-05 [Cycle 3]: 0.00025119, [27] [switch_simplify]: 4.32e-06 [loop_unroll]: 4.53001e-06 [a_1]: 3.945e-05 [with_stream_mark]: 1.057e-05 [recompute_prepare]: 3.58e-06 [updatestate_depend_eliminate]: 2.47001e-06 [updatestate_assign_eliminate]: 1.62001e-06 [updatestate_loads_eliminate]: 1.72001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 3.56001e-06 [updatestate_useless_node_eliminater]: 3.21999e-06 [accelerated_algorithm]: 3.09999e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 2.99001e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.218e-05 [j_node_and_user_rematch]: 5.72001e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 3.23998e-06 [inline_without_move]: 2.98e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 3.56001e-06 [cse]: 8.28999e-06 [replace_applicator]: 3.6e-06 [py_interpret_to_execute_after_opt_a]: 1.311e-05 [rewriter_after_opt_a]: 3.624e-05 [convert_after_rewriter]: 6.43998e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.00077971 [jit_opt_b]: 4.552e-05, [1] [Cycle 1]: 3.647e-05, [2] [frontend_op_eliminate]: 1.133e-05 [inline_after_opt_a]: 1.252e-05 [cconv]: 2.715e-05 [loop_unroll]: 0.00046586 [jit_opt_after_cconv]: 0.0001345, [1] [Cycle 1]: 0.000127, [11] [c_1]: 1.188e-05 [parameter_eliminate]: 3.21001e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 1.70001e-06 [updatestate_loads_eliminate]: 1.59e-06 [cse]: 2.484e-05 [call_graph_tuple_transform]: 1.546e-05 [tuple_list_get_item_eliminator]: 3.95e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 9.70002e-07 [switch_simplify]: 3.66001e-06 [remove_dup_value]: 1.569e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 4.74998e-06 [add_recomputation]: 3.682e-05 [cse_after_recomputation]: 1.834e-05, [1] [Cycle 1]: 1.319e-05, [1] [cse]: 7.03e-06 [auto_monad_reorder]: 1.362e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 6.30997e-06 [opt_after_jit_grad]: 0.0004417 [symbol_engine_optimizer]: 6.434e-05, [1] [Cycle 1]: 5.827e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 5.17e-06 [elim_not_effective]: 9.36e-06 [opt_reshape]: 4.33001e-06 [fold_const_symbol]: 6.42001e-06 [renormalize]: 3.59985e-07 [validate]: 3.111e-05 Sums bootstrap : 0.000258s : 0.29% type_inference : 0.065647s : 72.87% event_method : 0.000271s : 0.30% auto_monad : 0.000106s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000034s : 0.04% rewriter_before_opt_a : 0.000123s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000135s : 0.15% jit_opt_a.loop_unroll : 0.000096s : 0.11% jit_opt_a.a_1 : 0.002312s : 2.57% jit_opt_a.with_stream_mark : 0.000066s : 0.07% jit_opt_a.recompute_prepare : 0.000040s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000055s : 0.06% jit_opt_a.meta_fg_expand : 0.002183s : 2.42% jit_opt_a.replace_old_param : 0.000089s : 0.10% jit_opt_a.inline_without_move : 0.000075s : 0.08% jit_opt_a.renormalize : 0.015763s : 17.50% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000080s : 0.09% jit_opt_a.cse : 0.000300s : 0.33% jit_opt_a.replace_applicator : 0.000141s : 0.16% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000780s : 0.87% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000027s : 0.03% loop_unroll : 0.000466s : 0.52% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000442s : 0.49% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.03% Time group info: ------[substitution.] 0.000597 107 0.24% : 0.000001s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.71% : 0.000004s : 1: substitution.graph_param_transform 65.30% : 0.000390s : 13: substitution.inline 3.44% : 0.000021s : 2: substitution.inline_without_move 1.79% : 0.000011s : 13: substitution.j_node_and_user_rematch 2.04% : 0.000012s : 7: substitution.minmaximum_grad 1.31% : 0.000008s : 5: substitution.partial_eliminate 1.94% : 0.000012s : 13: substitution.remove_not_recompute_node 5.29% : 0.000032s : 10: substitution.replace_applicator 1.14% : 0.000007s : 10: substitution.replace_old_param 1.17% : 0.000007s : 1: substitution.reshape_eliminate 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.17% : 0.000007s : 1: substitution.tile_eliminate 3.78% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.80% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.25% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065547 2 96.64% : 0.063342s : 1: type_inference.infer 3.36% : 0.002205s : 1: type_inference.specialize ------[replace.] 0.000181 20 66.27% : 0.000120s : 13: replace.inline 33.73% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000404 20 94.63% : 0.000382s : 13: match.inline 5.37% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000415 2768 1.46% : 0.000006s : 48: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000006s : 48: predicate.addn_check_dump 1.76% : 0.000007s : 48: predicate.addn_zero_filter 1.90% : 0.000008s : 48: predicate.arithmetic_simplify 1.53% : 0.000006s : 48: predicate.cast_eliminate 0.16% : 0.000001s : 1: predicate.check_bprop_eliminate 1.35% : 0.000006s : 48: predicate.compare_switch_simplify 1.39% : 0.000006s : 48: predicate.depend_value_elim 1.47% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.48% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.32% : 0.000005s : 48: predicate.environ_get_add_eliminate 1.38% : 0.000006s : 48: predicate.environ_get_depend_swap 1.40% : 0.000006s : 48: predicate.environ_get_eliminate 1.34% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.88% : 0.000004s : 20: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.00% : 0.000017s : 70: predicate.inline 2.00% : 0.000008s : 48: predicate.inline_without_move 0.38% : 0.000002s : 20: predicate.j_node_and_user_rematch 0.96% : 0.000004s : 20: predicate.less_batch_normalization 1.71% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.74% : 0.000007s : 56: predicate.load_eliminater 0.39% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.29% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.60% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.39% : 0.000006s : 48: predicate.merge_addn 1.43% : 0.000006s : 48: predicate.minmaximum_grad 0.70% : 0.000003s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.26% : 0.000009s : 56: predicate.partial_eliminate 1.43% : 0.000006s : 48: predicate.print_const_string_wrapper 1.85% : 0.000008s : 48: predicate.reduce_eliminate 1.74% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000002s : 20: predicate.remove_not_recompute_node 2.67% : 0.000011s : 103: predicate.replace_applicator 1.08% : 0.000004s : 48: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.54% : 0.000006s : 48: predicate.reshape_eliminate 1.45% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000006s : 48: predicate.same_eliminate 0.48% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 20: predicate.specialize_transform 1.73% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.67% : 0.000011s : 68: predicate.switch_defer_inline 2.33% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.15% : 0.000026s : 170: predicate.switch_simplify 1.47% : 0.000006s : 48: predicate.tile_eliminate 6.93% : 0.000029s : 48: predicate.transpose_eliminate 1.79% : 0.000007s : 48: predicate.tuple_list_convert_item_index_to_positive 1.64% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.00% : 0.000012s : 57: predicate.tuple_list_get_item_eliminator 1.76% : 0.000007s : 48: predicate.tuple_list_set_item_eliminator 1.72% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.64% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.63% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.71% : 0.000007s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004134 52 77.13% : 0.003188s : 35: func_graph_cloner_run.FuncGraphClonerGraph 22.87% : 0.000945s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113647 87 0.03% : 0.000040s : 1: add_recomputation 0.10% : 0.000112s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000280s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000020s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.25% : 0.000281s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.90% : 0.026026s : 1: jit_opt_a 0.12% : 0.000137s : 1: jit_opt_after_cconv 0.04% : 0.000048s : 1: jit_opt_b 0.42% : 0.000475s : 1: loop_unroll 0.70% : 0.000791s : 1: mutable_eliminate 2.69% : 0.003059s : 39: opt.transform.jit_opt_a 0.03% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000013s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000037s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 11.86% : 0.013481s : 2: renormalize.infer 1.99% : 0.002262s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000126s : 1: rewriter_before_opt_a 0.06% : 0.000067s : 1: symbol_engine_optimizer 57.78% : 0.065666s : 1: type_inference TotalTime = 0.0748799, [30] [bootstrap]: 0.00029714 [type_inference]: 0.0667522 [event_method]: 2.14e-05 [auto_monad]: 7.231e-05 [graph_reusing]: 5.44e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 0.00014339 [rewriter_before_opt_a]: 8.302e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00548254, [2] [Cycle 1]: 0.00184061, [27] [switch_simplify]: 5.287e-05 [loop_unroll]: 3.083e-05 [a_1]: 0.00051233 [with_stream_mark]: 1.667e-05 [recompute_prepare]: 7.76001e-06 [updatestate_depend_eliminate]: 3.80998e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.397e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 0.00090977 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.70001e-06 [auto_monad_eliminator]: 1.442e-05 [cse]: 3.386e-05 [replace_applicator]: 1.193e-05 [Cycle 2]: 0.00031338, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 5.24e-06 [a_1]: 8.983e-05 [with_stream_mark]: 8.30999e-06 [recompute_prepare]: 5.14998e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.56998e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.169e-05 [j_node_and_user_rematch]: 8.07e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.51002e-06 [cse]: 1.245e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 9.32001e-06 [rewriter_after_opt_a]: 3.633e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00045214 [jit_opt_b]: 4.945e-05, [1] [Cycle 1]: 4.273e-05, [2] [frontend_op_eliminate]: 1.594e-05 [inline_after_opt_a]: 1.603e-05 [cconv]: 2.51e-05 [loop_unroll]: 0.00041388 [jit_opt_after_cconv]: 0.00013798, [1] [Cycle 1]: 0.0001317, [11] [c_1]: 2.09e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 5.73997e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.004e-05 [call_graph_tuple_transform]: 1.752e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.39001e-06 [add_recomputation]: 4.937e-05 [cse_after_recomputation]: 2.21e-05, [1] [Cycle 1]: 1.713e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 4.36002e-06 [opt_after_jit_grad]: 0.00046228 [symbol_engine_optimizer]: 8.679e-05, [1] [Cycle 1]: 8.101e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 7.18e-06 [elim_not_effective]: 1.319e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 6.10016e-07 [validate]: 3.862e-05 Sums bootstrap : 0.000297s : 0.42% type_inference : 0.066752s : 94.04% event_method : 0.000021s : 0.03% auto_monad : 0.000072s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000143s : 0.20% rewriter_before_opt_a : 0.000083s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000602s : 0.85% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000910s : 1.28% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000046s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000452s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.04% loop_unroll : 0.000414s : 0.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000462s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.05% Time group info: ------[substitution.] 0.000186 23 1.24% : 0.000002s : 2: substitution.elim_not_effective 0.94% : 0.000002s : 2: substitution.fold_const_symbol 2.63% : 0.000005s : 3: substitution.graph_param_transform 83.07% : 0.000155s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000004s : 4: substitution.remove_not_recompute_node 1.80% : 0.000003s : 2: substitution.replace_old_param 6.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066202 2 97.04% : 0.064243s : 1: type_inference.infer 2.96% : 0.001958s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.26% : 0.000045s : 4: replace.inline 32.74% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.18% : 0.000152s : 4: match.inline 6.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000002s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 1.01% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.50% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000971 13 41.12% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.30% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.57% : 0.000540s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076649 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.41% : 0.000314s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.16% : 0.005485s : 1: jit_opt_a 0.18% : 0.000141s : 1: jit_opt_after_cconv 0.07% : 0.000052s : 1: jit_opt_b 0.55% : 0.000421s : 1: loop_unroll 0.60% : 0.000459s : 1: mutable_eliminate 1.06% : 0.000812s : 26: opt.transform.jit_opt_a 0.06% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000147s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.69% : 0.000528s : 1: renormalize.infer 0.49% : 0.000374s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000090s : 1: symbol_engine_optimizer 87.11% : 0.066769s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.167.472 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065b80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.168.099 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0287673, [30] [bootstrap]: 0.00033595 [type_inference]: 0.0205182 [event_method]: 2.154e-05 [auto_monad]: 6.806e-05 [graph_reusing]: 5.56998e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 9.822e-05 [rewriter_before_opt_a]: 8.036e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00542552, [2] [Cycle 1]: 0.00182303, [27] [switch_simplify]: 5.239e-05 [loop_unroll]: 2.9e-05 [a_1]: 0.00052381 [with_stream_mark]: 2.028e-05 [recompute_prepare]: 8.18001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 4.38001e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 0.00085174 [add_forward_monad_depend]: 6.48998e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.56e-05 [cse]: 3.613e-05 [replace_applicator]: 1.494e-05 [Cycle 2]: 0.00033187, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 4.95999e-06 [a_1]: 8.85e-05 [with_stream_mark]: 1.118e-05 [recompute_prepare]: 5.28002e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.60002e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.03002e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 4.85001e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 4.46002e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.342e-05 [j_node_and_user_rematch]: 7.96001e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 6.86001e-06 [inline_without_move]: 4.84e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 8.79983e-07 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.12001e-06 [cse]: 1.356e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.318e-05 [rewriter_after_opt_a]: 3.751e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 4.94003e-06 [mutable_eliminate]: 0.00060686 [jit_opt_b]: 4.984e-05, [1] [Cycle 1]: 4.189e-05, [2] [frontend_op_eliminate]: 1.503e-05 [inline_after_opt_a]: 1.537e-05 [cconv]: 2.864e-05 [loop_unroll]: 0.00041982 [jit_opt_after_cconv]: 0.00014509, [1] [Cycle 1]: 0.00013887, [11] [c_1]: 1.992e-05 [parameter_eliminate]: 3.35003e-06 [updatestate_depend_eliminate]: 7.41001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.584e-05 [call_graph_tuple_transform]: 1.832e-05 [tuple_list_get_item_eliminator]: 5.10999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 5.79999e-06 [add_recomputation]: 5.123e-05 [cse_after_recomputation]: 2.239e-05, [1] [Cycle 1]: 1.759e-05, [1] [cse]: 1.187e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 6.12999e-06 [opt_after_jit_grad]: 0.00047688 [symbol_engine_optimizer]: 7.012e-05, [1] [Cycle 1]: 6.367e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.21001e-06 [elim_not_effective]: 1.241e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.91997e-06 [renormalize]: 3.80009e-07 [validate]: 3.955e-05 Sums bootstrap : 0.000336s : 1.35% type_inference : 0.020518s : 82.41% event_method : 0.000022s : 0.09% auto_monad : 0.000068s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000098s : 0.39% rewriter_before_opt_a : 0.000080s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000612s : 2.46% jit_opt_a.with_stream_mark : 0.000031s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000852s : 3.42% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000050s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000607s : 2.44% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000029s : 0.12% loop_unroll : 0.000420s : 1.69% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000477s : 1.92% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.16% Time group info: ------[substitution.] 0.000206 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000005s : 3: substitution.graph_param_transform 83.85% : 0.000173s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 6.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020441 2 93.15% : 0.019041s : 1: type_inference.infer 6.85% : 0.001400s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.31% : 0.000046s : 4: replace.inline 31.69% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.50% : 0.000170s : 4: match.inline 6.50% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.59% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.56% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.16% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.16% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.66% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000826 13 48.21% : 0.000398s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.81% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.98% : 0.000388s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030493 72 0.18% : 0.000054s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.17% : 0.000357s : 1: bootstrap 0.10% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.80% : 0.005429s : 1: jit_opt_a 0.48% : 0.000148s : 1: jit_opt_after_cconv 0.17% : 0.000053s : 1: jit_opt_b 1.40% : 0.000428s : 1: loop_unroll 2.02% : 0.000617s : 1: mutable_eliminate 2.70% : 0.000823s : 26: opt.transform.jit_opt_a 0.15% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.59% : 0.000486s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000103s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.61% : 0.000492s : 1: renormalize.infer 1.15% : 0.000352s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000040s : 1: rewriter_after_opt_a 0.27% : 0.000083s : 1: rewriter_before_opt_a 0.24% : 0.000073s : 1: symbol_engine_optimizer 67.36% : 0.020539s : 1: type_inference TotalTime = 0.417016, [30] [bootstrap]: 0.00032228 [type_inference]: 0.402234 [event_method]: 2.391e-05 [auto_monad]: 7.637e-05 [graph_reusing]: 6.23002e-06 [pre_auto_parallel]: 3.05002e-06 [py_interpret_to_execute]: 0.00063689 [rewriter_before_opt_a]: 0.00010831 [expand_dump_flag]: 4.09002e-06 [jit_opt_a]: 0.011, [2] [Cycle 1]: 0.00615156, [27] [switch_simplify]: 8.181e-05 [loop_unroll]: 3.545e-05 [a_1]: 0.00085143 [with_stream_mark]: 2.44e-05 [recompute_prepare]: 1.041e-05 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 8.14997e-06 [updatestate_useless_node_eliminater]: 6.92002e-06 [accelerated_algorithm]: 8.16002e-06 [meta_shard_fg_expand]: 3.72002e-06 [get_grad_eliminate_]: 7.47002e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.904e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.107e-05 [inline_without_move]: 6.82002e-06 [renormalize]: 0.00472821 [add_forward_monad_depend]: 9.34998e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.914e-05 [cse]: 3.825e-05 [replace_applicator]: 2.401e-05 [Cycle 2]: 0.00040332, [27] [switch_simplify]: 8.27998e-06 [loop_unroll]: 8.09002e-06 [a_1]: 0.00013754 [with_stream_mark]: 1.252e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 4.02002e-06 [cell_reuse_recompute_pass]: 3.40998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.499e-05 [replace_applicator]: 6.15002e-06 [py_interpret_to_execute_after_opt_a]: 1.58e-05 [rewriter_after_opt_a]: 4.255e-05 [convert_after_rewriter]: 7.83999e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00083204 [jit_opt_b]: 5.981e-05, [1] [Cycle 1]: 5.124e-05, [2] [frontend_op_eliminate]: 2.107e-05 [inline_after_opt_a]: 1.881e-05 [cconv]: 2.521e-05 [loop_unroll]: 0.00044745 [jit_opt_after_cconv]: 0.00016237, [1] [Cycle 1]: 0.00015542, [11] [c_1]: 2.633e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.506e-05 [call_graph_tuple_transform]: 2.166e-05 [tuple_list_get_item_eliminator]: 7.51001e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.98e-06 [remove_dup_value]: 1.766e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 8.54e-06 [add_recomputation]: 4.854e-05 [cse_after_recomputation]: 2.521e-05, [1] [Cycle 1]: 1.947e-05, [1] [cse]: 1.407e-05 [auto_monad_reorder]: 1.863e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 5.39e-06 [opt_after_jit_grad]: 0.00047527 [symbol_engine_optimizer]: 8.728e-05, [1] [Cycle 1]: 8.056e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 1.056e-05 [elim_not_effective]: 1.472e-05 [opt_reshape]: 8.97e-06 [fold_const_symbol]: 1.063e-05 [renormalize]: 1.59984e-07 [validate]: 0.0001182 Sums bootstrap : 0.000322s : 0.08% type_inference : 0.402234s : 97.65% event_method : 0.000024s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000637s : 0.15% rewriter_before_opt_a : 0.000108s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.02% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.000989s : 0.24% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004728s : 1.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000053s : 0.01% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000832s : 0.20% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000025s : 0.01% loop_unroll : 0.000447s : 0.11% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000049s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000475s : 0.12% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000118s : 0.03% Time group info: ------[substitution.] 0.000354 25 0.51% : 0.000002s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 1.82% : 0.000006s : 4: substitution.graph_param_transform 88.62% : 0.000313s : 5: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000006s : 4: substitution.remove_not_recompute_node 1.62% : 0.000006s : 2: substitution.replace_old_param 4.16% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.402135 2 98.80% : 0.397314s : 1: type_inference.infer 1.20% : 0.004821s : 1: type_inference.specialize ------[replace.] 0.000137 7 65.44% : 0.000090s : 5: replace.inline 34.56% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000324 7 95.81% : 0.000310s : 5: match.inline 4.19% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000002s : 13: predicate.addn_check_dump 1.25% : 0.000002s : 13: predicate.addn_zero_filter 2.29% : 0.000004s : 13: predicate.arithmetic_simplify 1.65% : 0.000003s : 13: predicate.cast_eliminate 0.70% : 0.000001s : 4: predicate.check_bprop_eliminate 1.24% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.79% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 13: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.53% : 0.000001s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000009s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000003s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.79% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 1.07% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000003s : 13: predicate.reduce_eliminate 1.62% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000011s : 64: predicate.switch_simplify 1.46% : 0.000002s : 13: predicate.tile_eliminate 1.40% : 0.000002s : 13: predicate.transpose_eliminate 1.18% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.77% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 2.48% : 0.000004s : 15: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.11% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003053 25 55.54% : 0.001696s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.28% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.18% : 0.001257s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.423019 72 0.01% : 0.000051s : 1: add_recomputation 0.02% : 0.000080s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.08% : 0.000340s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 2.60% : 0.011004s : 1: jit_opt_a 0.04% : 0.000165s : 1: jit_opt_after_cconv 0.01% : 0.000062s : 1: jit_opt_b 0.11% : 0.000456s : 1: loop_unroll 0.20% : 0.000842s : 1: mutable_eliminate 0.30% : 0.001281s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000483s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000646s : 1: py_interpret_to_execute 0.00% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 0.80% : 0.003399s : 1: renormalize.infer 0.31% : 0.001316s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.03% : 0.000113s : 1: rewriter_before_opt_a 0.02% : 0.000090s : 1: symbol_engine_optimizer 95.09% : 0.402252s : 1: type_inference TotalTime = 0.0140619, [30] [bootstrap]: 0.00032758 [type_inference]: 0.00559658 [event_method]: 2.018e-05 [auto_monad]: 6.853e-05 [graph_reusing]: 6.74001e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 4.472e-05 [rewriter_before_opt_a]: 7.803e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00566425, [2] [Cycle 1]: 0.00192506, [27] [switch_simplify]: 5.954e-05 [loop_unroll]: 3.013e-05 [a_1]: 0.00057214 [with_stream_mark]: 2.377e-05 [recompute_prepare]: 9.28002e-06 [updatestate_depend_eliminate]: 5.34e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.23998e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.11997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.0008812 [add_forward_monad_depend]: 7.33999e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.722e-05 [cse]: 3.023e-05 [replace_applicator]: 1.571e-05 [Cycle 2]: 0.00032539, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 4.99998e-06 [a_1]: 9.046e-05 [with_stream_mark]: 1.114e-05 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.01997e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 4.62998e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.27002e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.58999e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.207e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.335e-05 [rewriter_after_opt_a]: 3.885e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00062182 [jit_opt_b]: 5.075e-05, [1] [Cycle 1]: 4.273e-05, [2] [frontend_op_eliminate]: 1.551e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 3.315e-05 [loop_unroll]: 0.00043709 [jit_opt_after_cconv]: 0.00014987, [1] [Cycle 1]: 0.0001433, [11] [c_1]: 2.007e-05 [parameter_eliminate]: 3.38999e-06 [updatestate_depend_eliminate]: 7.61999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.93e-06 [cse]: 2.555e-05 [call_graph_tuple_transform]: 1.88e-05 [tuple_list_get_item_eliminator]: 5.48002e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.441e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 5.74999e-06 [add_recomputation]: 5.344e-05 [cse_after_recomputation]: 3.229e-05, [1] [Cycle 1]: 1.606e-05, [1] [cse]: 1.056e-05 [auto_monad_reorder]: 1.578e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 3.71999e-06 [opt_after_jit_grad]: 0.00047173 [symbol_engine_optimizer]: 6.995e-05, [1] [Cycle 1]: 6.427e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 7.45e-06 [elim_not_effective]: 1.278e-05 [opt_reshape]: 5.45001e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 5.00004e-07 [validate]: 3.729e-05 Sums bootstrap : 0.000328s : 3.26% type_inference : 0.005597s : 55.76% event_method : 0.000020s : 0.20% auto_monad : 0.000069s : 0.68% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.45% rewriter_before_opt_a : 0.000078s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.35% jit_opt_a.a_1 : 0.000663s : 6.60% jit_opt_a.with_stream_mark : 0.000035s : 0.35% jit_opt_a.recompute_prepare : 0.000015s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000881s : 8.78% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.23% jit_opt_a.cse : 0.000042s : 0.42% jit_opt_a.replace_applicator : 0.000021s : 0.21% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000039s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000622s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000033s : 0.33% loop_unroll : 0.000437s : 4.36% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000026s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000014s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.53% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000472s : 4.70% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.37% Time group info: ------[substitution.] 0.000240 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000005s : 3: substitution.graph_param_transform 85.43% : 0.000205s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.27% : 0.000005s : 2: substitution.replace_old_param 5.17% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005520 2 81.50% : 0.004499s : 1: type_inference.infer 18.50% : 0.001021s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.27% : 0.000049s : 4: replace.inline 31.73% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.71% : 0.000202s : 4: match.inline 5.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.15% : 0.000003s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.57% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.72% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.72% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.12% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.92% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.94% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000772 13 51.67% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.72% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.61% : 0.000321s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015882 72 0.35% : 0.000056s : 1: add_recomputation 0.46% : 0.000072s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.18% : 0.000346s : 1: bootstrap 0.23% : 0.000036s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.22% : 0.000034s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 35.69% : 0.005668s : 1: jit_opt_a 0.96% : 0.000153s : 1: jit_opt_after_cconv 0.34% : 0.000054s : 1: jit_opt_b 2.80% : 0.000445s : 1: loop_unroll 3.98% : 0.000632s : 1: mutable_eliminate 5.57% : 0.000884s : 26: opt.transform.jit_opt_a 0.29% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.05% : 0.000484s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000047s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 3.17% : 0.000504s : 1: renormalize.infer 2.32% : 0.000369s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000042s : 1: rewriter_after_opt_a 0.51% : 0.000081s : 1: rewriter_before_opt_a 0.46% : 0.000073s : 1: symbol_engine_optimizer 35.35% : 0.005615s : 1: type_inference TotalTime = 0.091071, [30] [bootstrap]: 0.0001972 [type_inference]: 0.0644118 [event_method]: 0.00027941 [auto_monad]: 0.00014245 [graph_reusing]: 7.06999e-06 [pre_auto_parallel]: 3.34001e-06 [py_interpret_to_execute]: 3.383e-05 [rewriter_before_opt_a]: 0.0001199 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0236667, [3] [Cycle 1]: 0.016726, [27] [switch_simplify]: 7.821e-05 [loop_unroll]: 4.851e-05 [a_1]: 0.00102065 [with_stream_mark]: 3.163e-05 [recompute_prepare]: 2.193e-05 [updatestate_depend_eliminate]: 9.66e-06 [updatestate_assign_eliminate]: 6.86001e-06 [updatestate_loads_eliminate]: 6.98e-06 [parameter_eliminate]: 2.78998e-06 [specialize_transform]: 1.532e-05 [updatestate_useless_node_eliminater]: 1.367e-05 [accelerated_algorithm]: 1.424e-05 [meta_shard_fg_expand]: 3.46999e-06 [get_grad_eliminate_]: 1.414e-05 [merge_forward]: 9.54e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.81e-05 [j_node_and_user_rematch]: 2.515e-05 [meta_fg_expand]: 0.00175206 [replace_old_param]: 6.939e-05 [inline_without_move]: 5.918e-05 [renormalize]: 0.0127837 [add_forward_monad_depend]: 1.202e-05 [auto_monad_grad]: 6.05002e-06 [auto_monad_eliminator]: 5.991e-05 [cse]: 0.0002921 [replace_applicator]: 9.093e-05 [Cycle 2]: 0.00333049, [27] [switch_simplify]: 4.362e-05 [loop_unroll]: 4.192e-05 [a_1]: 0.00112068 [with_stream_mark]: 1.668e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 5.52001e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.76999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 6.58e-06 [accelerated_algorithm]: 7.03e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.569e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 9.622e-05 [replace_old_param]: 7.42002e-06 [inline_without_move]: 6.66e-06 [renormalize]: 0.00169751 [add_forward_monad_depend]: 5.45001e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 9.98002e-06 [cse]: 2.008e-05 [replace_applicator]: 1.187e-05 [Cycle 3]: 0.00024086, [27] [switch_simplify]: 3.88001e-06 [loop_unroll]: 3.44001e-06 [a_1]: 3.879e-05 [with_stream_mark]: 8.60999e-06 [recompute_prepare]: 3.53e-06 [updatestate_depend_eliminate]: 2.02001e-06 [updatestate_assign_eliminate]: 1.67001e-06 [updatestate_loads_eliminate]: 1.45001e-06 [parameter_eliminate]: 1.14003e-06 [specialize_transform]: 3.33998e-06 [updatestate_useless_node_eliminater]: 3.09999e-06 [accelerated_algorithm]: 3.25e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 3.03e-06 [merge_forward]: 2.40002e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.75002e-06 [j_node_and_user_rematch]: 5.39998e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 3.08e-06 [inline_without_move]: 3.06001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 3.33e-06 [cse]: 8.85999e-06 [replace_applicator]: 3.56001e-06 [py_interpret_to_execute_after_opt_a]: 1.191e-05 [rewriter_after_opt_a]: 5.36e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 4.33999e-06 [mutable_eliminate]: 0.00067903 [jit_opt_b]: 4.199e-05, [1] [Cycle 1]: 3.431e-05, [2] [frontend_op_eliminate]: 1.137e-05 [inline_after_opt_a]: 1.124e-05 [cconv]: 2.54e-05 [loop_unroll]: 0.0004331 [jit_opt_after_cconv]: 0.00012044, [1] [Cycle 1]: 0.00011337, [11] [c_1]: 1.188e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 1.71e-06 [updatestate_loads_eliminate]: 1.91e-06 [cse]: 1.602e-05 [call_graph_tuple_transform]: 1.356e-05 [tuple_list_get_item_eliminator]: 4.38001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 3.86999e-06 [remove_dup_value]: 1.303e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 4.93001e-06 [add_recomputation]: 3.699e-05 [cse_after_recomputation]: 1.8e-05, [1] [Cycle 1]: 1.347e-05, [1] [cse]: 7.45998e-06 [auto_monad_reorder]: 1.259e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.0004327 [symbol_engine_optimizer]: 6.535e-05, [1] [Cycle 1]: 5.899e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 6.24999e-06 [elim_not_effective]: 9.92999e-06 [opt_reshape]: 3.91999e-06 [fold_const_symbol]: 5.87001e-06 [renormalize]: 4.59986e-07 [validate]: 3.178e-05 Sums bootstrap : 0.000197s : 0.23% type_inference : 0.064412s : 74.17% event_method : 0.000279s : 0.32% auto_monad : 0.000142s : 0.16% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000034s : 0.04% rewriter_before_opt_a : 0.000120s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.14% jit_opt_a.loop_unroll : 0.000094s : 0.11% jit_opt_a.a_1 : 0.002180s : 2.51% jit_opt_a.with_stream_mark : 0.000057s : 0.07% jit_opt_a.recompute_prepare : 0.000034s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.05% jit_opt_a.meta_fg_expand : 0.001850s : 2.13% jit_opt_a.replace_old_param : 0.000080s : 0.09% jit_opt_a.inline_without_move : 0.000069s : 0.08% jit_opt_a.renormalize : 0.014481s : 16.68% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000073s : 0.08% jit_opt_a.cse : 0.000321s : 0.37% jit_opt_a.replace_applicator : 0.000106s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000054s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000679s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000025s : 0.03% loop_unroll : 0.000433s : 0.50% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000433s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.04% Time group info: ------[substitution.] 0.000541 104 0.44% : 0.000002s : 1: substitution.elim_not_effective 0.20% : 0.000001s : 1: substitution.fold_const_symbol 0.77% : 0.000004s : 1: substitution.graph_param_transform 65.38% : 0.000354s : 13: substitution.inline 3.12% : 0.000017s : 2: substitution.inline_without_move 1.60% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.08% : 0.000011s : 7: substitution.minmaximum_grad 1.34% : 0.000007s : 5: substitution.partial_eliminate 1.77% : 0.000010s : 12: substitution.remove_not_recompute_node 5.57% : 0.000030s : 10: substitution.replace_applicator 1.30% : 0.000007s : 10: substitution.replace_old_param 0.53% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.99% : 0.000005s : 1: substitution.tile_eliminate 4.21% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.75% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.95% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.064314 2 96.66% : 0.062167s : 1: type_inference.infer 3.34% : 0.002147s : 1: type_inference.specialize ------[replace.] 0.000173 20 65.94% : 0.000114s : 13: replace.inline 34.06% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000367 20 94.24% : 0.000346s : 13: match.inline 5.76% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000373 2656 1.52% : 0.000006s : 46: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.52% : 0.000006s : 46: predicate.addn_check_dump 1.67% : 0.000006s : 46: predicate.addn_zero_filter 2.11% : 0.000008s : 46: predicate.arithmetic_simplify 1.65% : 0.000006s : 46: predicate.cast_eliminate 0.10% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000005s : 46: predicate.compare_switch_simplify 1.45% : 0.000005s : 46: predicate.depend_value_elim 1.52% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.48% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.72% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 46: predicate.environ_get_depend_swap 1.56% : 0.000006s : 46: predicate.environ_get_eliminate 1.43% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 18: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.15% : 0.000015s : 68: predicate.inline 1.96% : 0.000007s : 46: predicate.inline_without_move 0.38% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 18: predicate.less_batch_normalization 1.82% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 54: predicate.load_eliminater 0.34% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.77% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.69% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.42% : 0.000005s : 46: predicate.merge_addn 1.55% : 0.000006s : 46: predicate.minmaximum_grad 0.42% : 0.000002s : 1: predicate.mutable_eliminate 0.12% : 0.000000s : 1: predicate.opt_reshape 2.36% : 0.000009s : 54: predicate.partial_eliminate 1.50% : 0.000006s : 46: predicate.print_const_string_wrapper 2.05% : 0.000008s : 46: predicate.reduce_eliminate 1.83% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 18: predicate.remove_not_recompute_node 2.90% : 0.000011s : 99: predicate.replace_applicator 1.11% : 0.000004s : 46: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.63% : 0.000006s : 46: predicate.reshape_eliminate 1.55% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000006s : 46: predicate.same_eliminate 0.49% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 18: predicate.specialize_transform 1.71% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.88% : 0.000011s : 66: predicate.switch_defer_inline 2.58% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.62% : 0.000025s : 166: predicate.switch_simplify 1.51% : 0.000006s : 46: predicate.tile_eliminate 1.52% : 0.000006s : 46: predicate.transpose_eliminate 1.92% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.81% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 2.02% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.85% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.85% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.89% : 0.000007s : 46: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003797 52 77.37% : 0.002938s : 35: func_graph_cloner_run.FuncGraphClonerGraph 22.63% : 0.000859s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108365 87 0.04% : 0.000040s : 1: add_recomputation 0.14% : 0.000151s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.20% : 0.000213s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000020s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.26% : 0.000287s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 21.84% : 0.023670s : 1: jit_opt_a 0.11% : 0.000123s : 1: jit_opt_after_cconv 0.04% : 0.000045s : 1: jit_opt_b 0.41% : 0.000441s : 1: loop_unroll 0.63% : 0.000687s : 1: mutable_eliminate 2.62% : 0.002834s : 39: opt.transform.jit_opt_a 0.03% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000441s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000037s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 11.42% : 0.012376s : 2: renormalize.infer 1.93% : 0.002087s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000058s : 1: rewriter_after_opt_a 0.11% : 0.000123s : 1: rewriter_before_opt_a 0.06% : 0.000067s : 1: symbol_engine_optimizer 59.46% : 0.064431s : 1: type_inference TotalTime = 0.0287323, [30] [bootstrap]: 0.00031889 [type_inference]: 0.0210037 [event_method]: 1.967e-05 [auto_monad]: 6.62e-05 [graph_reusing]: 6.51999e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 9.034e-05 [rewriter_before_opt_a]: 8.038e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00516366, [2] [Cycle 1]: 0.00178476, [27] [switch_simplify]: 5.321e-05 [loop_unroll]: 2.858e-05 [a_1]: 0.00056452 [with_stream_mark]: 1.868e-05 [recompute_prepare]: 6.78998e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 0.00080047 [add_forward_monad_depend]: 5.74e-06 [auto_monad_grad]: 2.09e-06 [auto_monad_eliminator]: 1.44e-05 [cse]: 3.198e-05 [replace_applicator]: 1.08e-05 [Cycle 2]: 0.00030755, [27] [switch_simplify]: 5.64998e-06 [loop_unroll]: 4.88001e-06 [a_1]: 8.652e-05 [with_stream_mark]: 8.07e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.04998e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.56998e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.237e-05 [j_node_and_user_rematch]: 7.65e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 6.74999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.35999e-06 [cse]: 1.217e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.035e-05 [rewriter_after_opt_a]: 3.531e-05 [convert_after_rewriter]: 6.69999e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00047455 [jit_opt_b]: 4.676e-05, [1] [Cycle 1]: 4.042e-05, [2] [frontend_op_eliminate]: 1.479e-05 [inline_after_opt_a]: 1.522e-05 [cconv]: 2.441e-05 [loop_unroll]: 0.00040601 [jit_opt_after_cconv]: 0.00013328, [1] [Cycle 1]: 0.00012694, [11] [c_1]: 1.938e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 1.873e-05 [call_graph_tuple_transform]: 1.739e-05 [tuple_list_get_item_eliminator]: 5.54998e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.525e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 4.798e-05 [cse_after_recomputation]: 2.115e-05, [1] [Cycle 1]: 1.637e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.735e-05 [get_jit_bprop_graph]: 1.68002e-06 [rewriter_after_jit_bprop_graph]: 4.05e-06 [opt_after_jit_grad]: 0.00045529 [symbol_engine_optimizer]: 7.161e-05, [1] [Cycle 1]: 6.497e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.251e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 4.69998e-07 [validate]: 3.663e-05 Sums bootstrap : 0.000319s : 1.27% type_inference : 0.021004s : 83.61% event_method : 0.000020s : 0.08% auto_monad : 0.000066s : 0.26% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000090s : 0.36% rewriter_before_opt_a : 0.000080s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.23% jit_opt_a.loop_unroll : 0.000033s : 0.13% jit_opt_a.a_1 : 0.000651s : 2.59% jit_opt_a.with_stream_mark : 0.000027s : 0.11% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000801s : 3.19% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000044s : 0.18% jit_opt_a.replace_applicator : 0.000016s : 0.06% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000035s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000475s : 1.89% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000024s : 0.10% loop_unroll : 0.000406s : 1.62% jit_opt_after_cconv.c_1 : 0.000019s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000455s : 1.81% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000205 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 3: substitution.graph_param_transform 84.14% : 0.000172s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000004s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 6.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020935 2 93.47% : 0.019568s : 1: type_inference.infer 6.53% : 0.001367s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.61% : 0.000047s : 4: replace.inline 31.39% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.54% : 0.000170s : 4: match.inline 6.46% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.34% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.81% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.82% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.21% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 13 48.59% : 0.000390s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.96% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.45% : 0.000373s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030442 72 0.17% : 0.000051s : 1: add_recomputation 0.23% : 0.000070s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.08% : 0.000328s : 1: bootstrap 0.09% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 16.97% : 0.005166s : 1: jit_opt_a 0.45% : 0.000136s : 1: jit_opt_after_cconv 0.16% : 0.000049s : 1: jit_opt_b 1.36% : 0.000414s : 1: loop_unroll 1.58% : 0.000482s : 1: mutable_eliminate 2.81% : 0.000855s : 26: opt.transform.jit_opt_a 0.15% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000463s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000094s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.49% : 0.000454s : 1: renormalize.infer 1.11% : 0.000338s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000038s : 1: rewriter_after_opt_a 0.28% : 0.000084s : 1: rewriter_before_opt_a 0.24% : 0.000074s : 1: symbol_engine_optimizer 69.05% : 0.021020s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.269.971 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065310> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.270.625 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.276802, [30] [bootstrap]: 0.00030883 [type_inference]: 0.262845 [event_method]: 2.958e-05 [auto_monad]: 9.108e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00080154 [rewriter_before_opt_a]: 0.00011376 [expand_dump_flag]: 4.78001e-06 [jit_opt_a]: 0.00986733, [2] [Cycle 1]: 0.00528121, [27] [switch_simplify]: 7.751e-05 [loop_unroll]: 3.447e-05 [a_1]: 0.00084656 [with_stream_mark]: 2.538e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 6.86999e-06 [accelerated_algorithm]: 7.83001e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.766e-05 [j_node_and_user_rematch]: 1.089e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.193e-05 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00389017 [add_forward_monad_depend]: 9.15999e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.936e-05 [cse]: 3.583e-05 [replace_applicator]: 2.232e-05 [Cycle 2]: 0.00041713, [27] [switch_simplify]: 7.78001e-06 [loop_unroll]: 6.59001e-06 [a_1]: 0.00014424 [with_stream_mark]: 1.693e-05 [recompute_prepare]: 6.02999e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.60002e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 5.93998e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 4.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 9.71998e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.20002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 7.18e-06 [cse]: 1.454e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.596e-05 [rewriter_after_opt_a]: 3.884e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00080185 [jit_opt_b]: 6.048e-05, [1] [Cycle 1]: 5.267e-05, [2] [frontend_op_eliminate]: 2.099e-05 [inline_after_opt_a]: 1.846e-05 [cconv]: 2.838e-05 [loop_unroll]: 0.00045029 [jit_opt_after_cconv]: 0.00016646, [1] [Cycle 1]: 0.00015927, [11] [c_1]: 2.76e-05 [parameter_eliminate]: 2.70002e-06 [updatestate_depend_eliminate]: 6.51e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 3.68999e-06 [cse]: 2.649e-05 [call_graph_tuple_transform]: 2.223e-05 [tuple_list_get_item_eliminator]: 7.90998e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.686e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 9.06002e-06 [add_recomputation]: 5.335e-05 [cse_after_recomputation]: 2.773e-05, [1] [Cycle 1]: 2.208e-05, [1] [cse]: 1.618e-05 [auto_monad_reorder]: 1.789e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 6.36998e-06 [opt_after_jit_grad]: 0.00048054 [symbol_engine_optimizer]: 8.777e-05, [1] [Cycle 1]: 8.164e-05, [6] [build]: 4.71002e-06 [elim_shapecalc]: 1.146e-05 [elim_not_effective]: 1.67e-05 [opt_reshape]: 7.32997e-06 [fold_const_symbol]: 1.213e-05 [renormalize]: 3.7998e-07 [validate]: 6.224e-05 Sums bootstrap : 0.000309s : 0.11% type_inference : 0.262845s : 96.71% event_method : 0.000030s : 0.01% auto_monad : 0.000091s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000802s : 0.29% rewriter_before_opt_a : 0.000114s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000085s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000991s : 0.36% jit_opt_a.with_stream_mark : 0.000042s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003890s : 1.43% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000802s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000450s : 0.17% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000481s : 0.18% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.02% Time group info: ------[substitution.] 0.000347 28 0.56% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 4: substitution.graph_param_transform 84.47% : 0.000293s : 5: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.33% : 0.000015s : 3: substitution.reduce_eliminate 1.84% : 0.000006s : 4: substitution.remove_not_recompute_node 1.97% : 0.000007s : 2: substitution.replace_old_param 3.45% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.262712 2 87.49% : 0.229857s : 1: type_inference.infer 12.51% : 0.032855s : 1: type_inference.specialize ------[replace.] 0.000120 7 69.00% : 0.000083s : 5: replace.inline 31.00% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000301 7 96.41% : 0.000290s : 5: match.inline 3.59% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000177 886 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 2.28% : 0.000004s : 13: predicate.arithmetic_simplify 1.13% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 0.95% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.91% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.04% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.39% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.89% : 0.000002s : 13: predicate.environ_get_depend_swap 1.02% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 4.87% : 0.000009s : 28: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.49% : 0.000003s : 19: predicate.load_eliminater 0.86% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.71% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 1.32% : 0.000002s : 4: predicate.mutable_eliminate 0.36% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000004s : 19: predicate.partial_eliminate 0.97% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000004s : 13: predicate.reduce_eliminate 1.32% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.67% : 0.000003s : 23: predicate.replace_applicator 0.45% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.11% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000002s : 8: predicate.special_op_eliminate 0.76% : 0.000001s : 8: predicate.specialize_transform 1.22% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000004s : 20: predicate.switch_defer_inline 1.95% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.14% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.07% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.24% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 14.85% : 0.000026s : 19: predicate.updatestate_pure_node_eliminater 2.35% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.26% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002934 25 59.70% : 0.001752s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.29% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.00% : 0.001086s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.281839 72 0.02% : 0.000057s : 1: add_recomputation 0.03% : 0.000095s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000328s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.50% : 0.009872s : 1: jit_opt_a 0.06% : 0.000170s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.16% : 0.000458s : 1: loop_unroll 0.29% : 0.000811s : 1: mutable_eliminate 0.45% : 0.001268s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000489s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000812s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.98% : 0.002749s : 1: renormalize.infer 0.40% : 0.001129s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.04% : 0.000120s : 1: rewriter_before_opt_a 0.03% : 0.000090s : 1: symbol_engine_optimizer 93.27% : 0.262873s : 1: type_inference TotalTime = 0.0314194, [30] [bootstrap]: 0.00024705 [type_inference]: 0.0146515 [event_method]: 5.562e-05 [auto_monad]: 9.833e-05 [graph_reusing]: 7.08e-06 [pre_auto_parallel]: 3.23998e-06 [py_interpret_to_execute]: 2.748e-05 [rewriter_before_opt_a]: 0.00010386 [expand_dump_flag]: 3.05002e-06 [jit_opt_a]: 0.0139752, [3] [Cycle 1]: 0.00682157, [27] [switch_simplify]: 7.172e-05 [loop_unroll]: 4.541e-05 [a_1]: 0.00090326 [with_stream_mark]: 3.133e-05 [recompute_prepare]: 1.963e-05 [updatestate_depend_eliminate]: 8.2e-06 [updatestate_assign_eliminate]: 6.98e-06 [updatestate_loads_eliminate]: 6.73998e-06 [parameter_eliminate]: 2.78e-06 [specialize_transform]: 1.41e-05 [updatestate_useless_node_eliminater]: 1.278e-05 [accelerated_algorithm]: 1.278e-05 [meta_shard_fg_expand]: 4.06001e-06 [get_grad_eliminate_]: 1.252e-05 [merge_forward]: 9.00999e-06 [cell_reuse_recompute_pass]: 8.59989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.71e-05 [j_node_and_user_rematch]: 2.322e-05 [meta_fg_expand]: 0.00168853 [replace_old_param]: 6.131e-05 [inline_without_move]: 5.56e-05 [renormalize]: 0.00316465 [add_forward_monad_depend]: 1.225e-05 [auto_monad_grad]: 5.92999e-06 [auto_monad_eliminator]: 5.677e-05 [cse]: 0.00021224 [replace_applicator]: 7.903e-05 [Cycle 2]: 0.00361994, [27] [switch_simplify]: 4.052e-05 [loop_unroll]: 3.973e-05 [a_1]: 0.00118123 [with_stream_mark]: 1.834e-05 [recompute_prepare]: 1.022e-05 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 4.38001e-06 [updatestate_loads_eliminate]: 3.82998e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 8.64003e-06 [updatestate_useless_node_eliminater]: 7.98001e-06 [accelerated_algorithm]: 8.42e-06 [meta_shard_fg_expand]: 3.13e-06 [get_grad_eliminate_]: 7.87998e-06 [merge_forward]: 5.61e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.08e-05 [j_node_and_user_rematch]: 1.358e-05 [meta_fg_expand]: 9.254e-05 [replace_old_param]: 1.004e-05 [inline_without_move]: 8.80001e-06 [renormalize]: 0.00186042 [add_forward_monad_depend]: 6.88998e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.385e-05 [cse]: 2.441e-05 [replace_applicator]: 3.731e-05 [Cycle 3]: 0.00024984, [27] [switch_simplify]: 4.48999e-06 [loop_unroll]: 3.71001e-06 [a_1]: 3.852e-05 [with_stream_mark]: 1.045e-05 [recompute_prepare]: 3.65e-06 [updatestate_depend_eliminate]: 2.66e-06 [updatestate_assign_eliminate]: 1.87001e-06 [updatestate_loads_eliminate]: 1.49e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 3.38e-06 [updatestate_useless_node_eliminater]: 3.14999e-06 [accelerated_algorithm]: 3.36999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 3.03e-06 [merge_forward]: 2.48e-06 [cell_reuse_recompute_pass]: 2.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.19e-05 [j_node_and_user_rematch]: 6.06e-06 [meta_fg_expand]: 1.20999e-06 [replace_old_param]: 3.09001e-06 [inline_without_move]: 2.98e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 3.51001e-06 [cse]: 9.39998e-06 [replace_applicator]: 3.53e-06 [py_interpret_to_execute_after_opt_a]: 1.228e-05 [rewriter_after_opt_a]: 3.428e-05 [convert_after_rewriter]: 5.53002e-06 [order_py_execute_after_rewriter]: 4.24997e-06 [mutable_eliminate]: 0.00069336 [jit_opt_b]: 3.841e-05, [1] [Cycle 1]: 3.077e-05, [2] [frontend_op_eliminate]: 9.17001e-06 [inline_after_opt_a]: 1.062e-05 [cconv]: 2.629e-05 [loop_unroll]: 0.00044138 [jit_opt_after_cconv]: 0.00016343, [1] [Cycle 1]: 0.0001489, [11] [c_1]: 1.219e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 1.69e-06 [updatestate_loads_eliminate]: 1.60001e-06 [cse]: 4.567e-05 [call_graph_tuple_transform]: 1.42e-05 [tuple_list_get_item_eliminator]: 3.79002e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 7.90023e-07 [switch_simplify]: 3.46999e-06 [remove_dup_value]: 1.475e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 5.19e-06 [add_recomputation]: 3.718e-05 [cse_after_recomputation]: 2.124e-05, [1] [Cycle 1]: 1.563e-05, [1] [cse]: 9.54999e-06 [auto_monad_reorder]: 1.315e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 5.05999e-06 [opt_after_jit_grad]: 0.00045048 [symbol_engine_optimizer]: 6.546e-05, [1] [Cycle 1]: 5.915e-05, [6] [build]: 3.96001e-06 [elim_shapecalc]: 5.52001e-06 [elim_not_effective]: 1.002e-05 [opt_reshape]: 4.17e-06 [fold_const_symbol]: 5.66998e-06 [renormalize]: 2.69996e-07 [validate]: 3.184e-05 Sums bootstrap : 0.000247s : 0.91% type_inference : 0.014651s : 53.77% event_method : 0.000056s : 0.20% auto_monad : 0.000098s : 0.36% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000027s : 0.10% rewriter_before_opt_a : 0.000104s : 0.38% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000117s : 0.43% jit_opt_a.loop_unroll : 0.000089s : 0.33% jit_opt_a.a_1 : 0.002123s : 7.79% jit_opt_a.with_stream_mark : 0.000060s : 0.22% jit_opt_a.recompute_prepare : 0.000034s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.09% jit_opt_a.accelerated_algorithm : 0.000025s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.09% jit_opt_a.merge_forward : 0.000017s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.16% jit_opt_a.meta_fg_expand : 0.001782s : 6.54% jit_opt_a.replace_old_param : 0.000074s : 0.27% jit_opt_a.inline_without_move : 0.000067s : 0.25% jit_opt_a.renormalize : 0.005025s : 18.44% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.07% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000074s : 0.27% jit_opt_a.cse : 0.000246s : 0.90% jit_opt_a.replace_applicator : 0.000120s : 0.44% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000034s : 0.13% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.02% mutable_eliminate : 0.000693s : 2.54% jit_opt_b.frontend_op_eliminate : 0.000009s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.04% cconv : 0.000026s : 0.10% loop_unroll : 0.000441s : 1.62% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000046s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.01% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000037s : 0.14% cse_after_recomputation.cse : 0.000010s : 0.04% auto_monad_reorder : 0.000013s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000450s : 1.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.12% Time group info: ------[substitution.] 0.000535 105 0.32% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.77% : 0.000004s : 1: substitution.graph_param_transform 63.15% : 0.000338s : 13: substitution.inline 3.49% : 0.000019s : 2: substitution.inline_without_move 1.86% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.18% : 0.000012s : 7: substitution.minmaximum_grad 1.24% : 0.000007s : 5: substitution.partial_eliminate 2.29% : 0.000012s : 13: substitution.remove_not_recompute_node 5.56% : 0.000030s : 10: substitution.replace_applicator 1.11% : 0.000006s : 8: substitution.replace_old_param 1.35% : 0.000007s : 1: substitution.reshape_eliminate 0.47% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.12% : 0.000006s : 1: substitution.tile_eliminate 4.10% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.87% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.94% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014572 2 91.80% : 0.013376s : 1: type_inference.infer 8.20% : 0.001195s : 1: type_inference.specialize ------[replace.] 0.000161 20 65.99% : 0.000106s : 13: replace.inline 34.01% : 0.000055s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000352 20 93.96% : 0.000331s : 13: match.inline 6.04% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000377 2537 1.51% : 0.000006s : 44: predicate.accumulaten_eliminater 0.26% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000005s : 44: predicate.addn_check_dump 1.60% : 0.000006s : 44: predicate.addn_zero_filter 2.03% : 0.000008s : 44: predicate.arithmetic_simplify 1.52% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.53% : 0.000006s : 44: predicate.compare_switch_simplify 1.65% : 0.000006s : 44: predicate.depend_value_elim 1.41% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.46% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.43% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000005s : 44: predicate.environ_add_const_eliminate 4.67% : 0.000018s : 44: predicate.environ_get_add_eliminate 1.41% : 0.000005s : 44: predicate.environ_get_depend_swap 1.42% : 0.000005s : 44: predicate.environ_get_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000003s : 18: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.10% : 0.000015s : 66: predicate.inline 1.94% : 0.000007s : 42: predicate.inline_without_move 0.37% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.96% : 0.000004s : 18: predicate.less_batch_normalization 1.88% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 52: predicate.load_eliminater 0.41% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.29% : 0.000012s : 89: predicate.loop_unroll_before_grad 1.66% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 44: predicate.merge_addn 1.49% : 0.000006s : 44: predicate.minmaximum_grad 0.45% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.42% : 0.000009s : 52: predicate.partial_eliminate 1.45% : 0.000005s : 44: predicate.print_const_string_wrapper 1.99% : 0.000007s : 44: predicate.reduce_eliminate 1.69% : 0.000006s : 51: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000002s : 18: predicate.remove_not_recompute_node 2.78% : 0.000010s : 94: predicate.replace_applicator 1.05% : 0.000004s : 42: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.51% : 0.000006s : 44: predicate.reshape_eliminate 1.50% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 1: predicate.row_tensor_eliminate 1.47% : 0.000006s : 44: predicate.same_eliminate 0.49% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 18: predicate.specialize_transform 1.67% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.75% : 0.000010s : 64: predicate.switch_defer_inline 2.48% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.41% : 0.000024s : 154: predicate.switch_simplify 1.56% : 0.000006s : 44: predicate.tile_eliminate 1.48% : 0.000006s : 44: predicate.transpose_eliminate 1.79% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.24% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.76% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.75% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.71% : 0.000006s : 52: predicate.updatestate_pure_node_eliminater 2.70% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.74% : 0.000007s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001732 32 64.54% : 0.001118s : 15: func_graph_cloner_run.FuncGraphClonerGraph 35.46% : 0.000614s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039220 87 0.10% : 0.000040s : 1: add_recomputation 0.26% : 0.000103s : 1: auto_monad 0.04% : 0.000015s : 1: auto_monad_reorder 0.69% : 0.000269s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.16% : 0.000061s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 35.64% : 0.013978s : 1: jit_opt_a 0.42% : 0.000166s : 1: jit_opt_after_cconv 0.10% : 0.000041s : 1: jit_opt_b 1.15% : 0.000450s : 1: loop_unroll 1.79% : 0.000702s : 1: mutable_eliminate 7.08% : 0.002776s : 39: opt.transform.jit_opt_a 0.08% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000014s : 4: opt.transform.jit_opt_b 0.03% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000011s : 1: opt.transform.mutable_eliminate 0.04% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000022s : 4: opt.transform.symbol_engine_opt 1.17% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000030s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 8.67% : 0.003401s : 2: renormalize.infer 4.10% : 0.001608s : 2: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000037s : 1: rewriter_after_opt_a 0.27% : 0.000107s : 1: rewriter_before_opt_a 0.17% : 0.000068s : 1: symbol_engine_optimizer 37.40% : 0.014669s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.322.640 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.323.331 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0541289, [30] [bootstrap]: 0.0002359 [type_inference]: 0.017356 [event_method]: 6.142e-05 [auto_monad]: 0.00015053 [graph_reusing]: 8.33999e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 3.934e-05 [rewriter_before_opt_a]: 0.00012845 [expand_dump_flag]: 3.90998e-06 [jit_opt_a]: 0.0339552, [3] [Cycle 1]: 0.0260573, [27] [switch_simplify]: 8.255e-05 [loop_unroll]: 7.943e-05 [a_1]: 0.00097823 [with_stream_mark]: 3.617e-05 [recompute_prepare]: 1.975e-05 [updatestate_depend_eliminate]: 9.26998e-06 [updatestate_assign_eliminate]: 7.01001e-06 [updatestate_loads_eliminate]: 7.21999e-06 [parameter_eliminate]: 2.66e-06 [specialize_transform]: 1.4e-05 [updatestate_useless_node_eliminater]: 1.235e-05 [accelerated_algorithm]: 1.266e-05 [meta_shard_fg_expand]: 3.68e-06 [get_grad_eliminate_]: 1.339e-05 [merge_forward]: 8.79e-06 [cell_reuse_recompute_pass]: 8.60018e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.672e-05 [j_node_and_user_rematch]: 2.352e-05 [meta_fg_expand]: 0.00173755 [replace_old_param]: 6.307e-05 [inline_without_move]: 5.707e-05 [renormalize]: 0.0221142 [add_forward_monad_depend]: 1.803e-05 [auto_monad_grad]: 6.93e-06 [auto_monad_eliminator]: 6.948e-05 [cse]: 0.00026232 [replace_applicator]: 0.00011585 [Cycle 2]: 0.00330347, [27] [switch_simplify]: 4.051e-05 [loop_unroll]: 3.85e-05 [a_1]: 0.00111398 [with_stream_mark]: 2.207e-05 [recompute_prepare]: 8.70001e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.78001e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 2.007e-05 [updatestate_useless_node_eliminater]: 6.64999e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.21998e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.056e-05 [meta_fg_expand]: 0.0001066 [replace_old_param]: 8.15999e-06 [inline_without_move]: 6.45002e-06 [renormalize]: 0.00164315 [add_forward_monad_depend]: 5.89e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.169e-05 [cse]: 2.165e-05 [replace_applicator]: 1.304e-05 [Cycle 3]: 0.00024694, [27] [switch_simplify]: 4.45999e-06 [loop_unroll]: 4e-06 [a_1]: 4.11e-05 [with_stream_mark]: 9.50001e-06 [recompute_prepare]: 3.41999e-06 [updatestate_depend_eliminate]: 2.34001e-06 [updatestate_assign_eliminate]: 1.89e-06 [updatestate_loads_eliminate]: 1.48002e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 3.9e-06 [updatestate_useless_node_eliminater]: 3.3e-06 [accelerated_algorithm]: 3.51999e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 2.98e-06 [merge_forward]: 2.07999e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.004e-05 [j_node_and_user_rematch]: 5.37001e-06 [meta_fg_expand]: 1.20001e-06 [replace_old_param]: 2.91e-06 [inline_without_move]: 2.89999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 3.34001e-06 [cse]: 8.88002e-06 [replace_applicator]: 3.4e-06 [py_interpret_to_execute_after_opt_a]: 1.193e-05 [rewriter_after_opt_a]: 3.363e-05 [convert_after_rewriter]: 5.91e-06 [order_py_execute_after_rewriter]: 4.56002e-06 [mutable_eliminate]: 0.00070814 [jit_opt_b]: 4.027e-05, [1] [Cycle 1]: 3.263e-05, [2] [frontend_op_eliminate]: 9.84999e-06 [inline_after_opt_a]: 1.08e-05 [cconv]: 2.637e-05 [loop_unroll]: 0.00040518 [jit_opt_after_cconv]: 0.00012096, [1] [Cycle 1]: 0.00011461, [11] [c_1]: 1.177e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 4.72998e-06 [updatestate_assign_eliminate]: 1.75001e-06 [updatestate_loads_eliminate]: 1.92001e-06 [cse]: 1.732e-05 [call_graph_tuple_transform]: 1.25e-05 [tuple_list_get_item_eliminator]: 3.90998e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 3.68e-06 [remove_dup_value]: 1.419e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 5.07e-06 [add_recomputation]: 3.462e-05 [cse_after_recomputation]: 1.944e-05, [1] [Cycle 1]: 1.409e-05, [1] [cse]: 7.93001e-06 [auto_monad_reorder]: 1.321e-05 [get_jit_bprop_graph]: 1.73002e-06 [rewriter_after_jit_bprop_graph]: 5.19998e-06 [opt_after_jit_grad]: 0.00044066 [symbol_engine_optimizer]: 6.548e-05, [1] [Cycle 1]: 5.906e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 5.37001e-06 [elim_not_effective]: 9.69e-06 [opt_reshape]: 4.07e-06 [fold_const_symbol]: 6.38998e-06 [renormalize]: 3.39991e-07 [validate]: 3.018e-05 Sums bootstrap : 0.000236s : 0.48% type_inference : 0.017356s : 35.50% event_method : 0.000061s : 0.13% auto_monad : 0.000151s : 0.31% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000039s : 0.08% rewriter_before_opt_a : 0.000128s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000128s : 0.26% jit_opt_a.loop_unroll : 0.000122s : 0.25% jit_opt_a.a_1 : 0.002133s : 4.36% jit_opt_a.with_stream_mark : 0.000068s : 0.14% jit_opt_a.recompute_prepare : 0.000032s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000038s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.05% jit_opt_a.accelerated_algorithm : 0.000023s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.05% jit_opt_a.merge_forward : 0.000015s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000039s : 0.08% jit_opt_a.meta_fg_expand : 0.001845s : 3.77% jit_opt_a.replace_old_param : 0.000074s : 0.15% jit_opt_a.inline_without_move : 0.000066s : 0.14% jit_opt_a.renormalize : 0.023757s : 48.59% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.05% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.17% jit_opt_a.cse : 0.000293s : 0.60% jit_opt_a.replace_applicator : 0.000132s : 0.27% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000034s : 0.07% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000708s : 1.45% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.02% jit_opt_b.inline_after_opt_a : 0.000011s : 0.02% cconv : 0.000026s : 0.05% loop_unroll : 0.000405s : 0.83% jit_opt_after_cconv.c_1 : 0.000012s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000012s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000035s : 0.07% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000441s : 0.90% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.06% Time group info: ------[substitution.] 0.000617 104 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.65% : 0.000004s : 1: substitution.graph_param_transform 64.60% : 0.000398s : 13: substitution.inline 2.65% : 0.000016s : 2: substitution.inline_without_move 1.45% : 0.000009s : 12: substitution.j_node_and_user_rematch 1.94% : 0.000012s : 7: substitution.minmaximum_grad 1.12% : 0.000007s : 5: substitution.partial_eliminate 1.60% : 0.000010s : 12: substitution.remove_not_recompute_node 9.02% : 0.000056s : 10: substitution.replace_applicator 1.04% : 0.000006s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.14% : 0.000007s : 1: substitution.tile_eliminate 3.67% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.73% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.46% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017250 2 90.94% : 0.015686s : 1: type_inference.infer 9.06% : 0.001564s : 1: type_inference.specialize ------[replace.] 0.000180 20 65.73% : 0.000119s : 13: replace.inline 34.27% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000413 20 94.48% : 0.000391s : 13: match.inline 5.52% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000399 2433 1.42% : 0.000006s : 42: predicate.accumulaten_eliminater 0.18% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000006s : 42: predicate.addn_check_dump 1.41% : 0.000006s : 42: predicate.addn_zero_filter 2.04% : 0.000008s : 42: predicate.arithmetic_simplify 1.47% : 0.000006s : 42: predicate.cast_eliminate 0.14% : 0.000001s : 1: predicate.check_bprop_eliminate 1.30% : 0.000005s : 42: predicate.compare_switch_simplify 1.43% : 0.000006s : 42: predicate.depend_value_elim 1.34% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.47% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.31% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.28% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.32% : 0.000005s : 42: predicate.environ_get_depend_swap 1.37% : 0.000005s : 42: predicate.environ_get_eliminate 1.30% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.73% : 0.000003s : 16: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.02% : 0.000016s : 64: predicate.inline 1.84% : 0.000007s : 44: predicate.inline_without_move 0.28% : 0.000001s : 16: predicate.j_node_and_user_rematch 1.02% : 0.000004s : 16: predicate.less_batch_normalization 1.73% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.75% : 0.000007s : 50: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 12.03% : 0.000048s : 87: predicate.loop_unroll_before_grad 1.63% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.28% : 0.000005s : 42: predicate.merge_addn 1.37% : 0.000005s : 42: predicate.minmaximum_grad 0.46% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.06% : 0.000008s : 50: predicate.partial_eliminate 1.32% : 0.000005s : 42: predicate.print_const_string_wrapper 1.81% : 0.000007s : 42: predicate.reduce_eliminate 1.65% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000002s : 16: predicate.remove_not_recompute_node 2.45% : 0.000010s : 90: predicate.replace_applicator 1.05% : 0.000004s : 44: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.48% : 0.000006s : 42: predicate.reshape_eliminate 1.51% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.33% : 0.000005s : 42: predicate.same_eliminate 0.37% : 0.000001s : 16: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.72% : 0.000003s : 16: predicate.specialize_transform 1.59% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.46% : 0.000010s : 62: predicate.switch_defer_inline 2.33% : 0.000009s : 62: predicate.switch_layer_defer_inline 6.20% : 0.000025s : 150: predicate.switch_simplify 1.47% : 0.000006s : 42: predicate.tile_eliminate 1.41% : 0.000006s : 42: predicate.transpose_eliminate 1.69% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.62% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.17% : 0.000013s : 51: predicate.tuple_list_get_item_eliminator 1.73% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.67% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.60% : 0.000006s : 50: predicate.updatestate_pure_node_eliminater 2.50% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.88% : 0.000007s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002416 36 63.36% : 0.001530s : 19: func_graph_cloner_run.FuncGraphClonerGraph 36.64% : 0.000885s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.080703 87 0.05% : 0.000038s : 1: add_recomputation 0.19% : 0.000157s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.32% : 0.000257s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.08% : 0.000068s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 42.08% : 0.033958s : 1: jit_opt_a 0.15% : 0.000124s : 1: jit_opt_after_cconv 0.05% : 0.000043s : 1: jit_opt_b 0.51% : 0.000413s : 1: loop_unroll 0.89% : 0.000716s : 1: mutable_eliminate 3.52% : 0.002840s : 39: opt.transform.jit_opt_a 0.04% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000014s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000007s : 1: pre_auto_parallel 0.05% : 0.000042s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000024s : 1: remove_dup_value 26.51% : 0.021394s : 2: renormalize.infer 2.88% : 0.002323s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.16% : 0.000133s : 1: rewriter_before_opt_a 0.08% : 0.000068s : 1: symbol_engine_optimizer 21.53% : 0.017378s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.389.986 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007caf0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.390.665 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0552995, [30] [bootstrap]: 0.00027271 [type_inference]: 0.0460435 [event_method]: 2.067e-05 [auto_monad]: 6.912e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 0.00010733 [rewriter_before_opt_a]: 8.444e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00664091, [2] [Cycle 1]: 0.00194329, [27] [switch_simplify]: 5.329e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00051778 [with_stream_mark]: 1.797e-05 [recompute_prepare]: 7.23e-06 [updatestate_depend_eliminate]: 3.79002e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.84998e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.26002e-06 [renormalize]: 0.00099455 [add_forward_monad_depend]: 5.65001e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.529e-05 [cse]: 3.46e-05 [replace_applicator]: 1.216e-05 [Cycle 2]: 0.00031154, [27] [switch_simplify]: 6.22001e-06 [loop_unroll]: 5.21002e-06 [a_1]: 8.715e-05 [with_stream_mark]: 8.98002e-06 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 2.66999e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 7.6e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 7.21999e-06 [inline_without_move]: 4.69002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.47999e-06 [cse]: 1.301e-05 [replace_applicator]: 4.90999e-06 [py_interpret_to_execute_after_opt_a]: 1.132e-05 [rewriter_after_opt_a]: 3.584e-05 [convert_after_rewriter]: 6.66999e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00051877 [jit_opt_b]: 4.897e-05, [1] [Cycle 1]: 4.118e-05, [2] [frontend_op_eliminate]: 1.5e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.47e-05 [loop_unroll]: 0.0004092 [jit_opt_after_cconv]: 0.00013815, [1] [Cycle 1]: 0.00013164, [11] [c_1]: 2.025e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 2.43998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.116e-05 [call_graph_tuple_transform]: 1.779e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.20001e-06 [remove_dup_value]: 1.747e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.51998e-06 [add_recomputation]: 4.866e-05 [cse_after_recomputation]: 2.203e-05, [1] [Cycle 1]: 1.709e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00043977 [symbol_engine_optimizer]: 8.131e-05, [1] [Cycle 1]: 7.487e-05, [6] [build]: 3.12002e-06 [elim_shapecalc]: 1.771e-05 [elim_not_effective]: 1.274e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 3.29979e-07 [validate]: 3.665e-05 Sums bootstrap : 0.000273s : 0.54% type_inference : 0.046044s : 91.45% event_method : 0.000021s : 0.04% auto_monad : 0.000069s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.21% rewriter_before_opt_a : 0.000084s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000605s : 1.20% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000995s : 1.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000048s : 0.09% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000519s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000409s : 0.81% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000440s : 0.87% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000018s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000196 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000005s : 3: substitution.graph_param_transform 82.99% : 0.000162s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000004s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.92% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045961 2 96.69% : 0.044440s : 1: type_inference.infer 3.31% : 0.001521s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.49% : 0.000048s : 4: replace.inline 31.51% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 92.80% : 0.000160s : 4: match.inline 7.20% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000001s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.18% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.97% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.03% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000845 13 49.98% : 0.000423s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.49% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.53% : 0.000393s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057169 72 0.09% : 0.000051s : 1: add_recomputation 0.13% : 0.000073s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.51% : 0.000291s : 1: bootstrap 0.05% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 11.62% : 0.006644s : 1: jit_opt_a 0.25% : 0.000141s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.73% : 0.000416s : 1: loop_unroll 0.92% : 0.000527s : 1: mutable_eliminate 1.42% : 0.000812s : 26: opt.transform.jit_opt_a 0.08% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000111s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.00% : 0.000572s : 1: renormalize.infer 0.72% : 0.000414s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.15% : 0.000088s : 1: rewriter_before_opt_a 0.15% : 0.000084s : 1: symbol_engine_optimizer 80.57% : 0.046062s : 1: type_inference TotalTime = 0.0112868, [30] [bootstrap]: 0.00027438 [type_inference]: 0.00427345 [event_method]: 1.629e-05 [auto_monad]: 4.674e-05 [graph_reusing]: 4.05e-06 [pre_auto_parallel]: 1.85001e-06 [py_interpret_to_execute]: 3.231e-05 [rewriter_before_opt_a]: 6.51e-05 [expand_dump_flag]: 2.19001e-06 [jit_opt_a]: 0.00457497, [2] [Cycle 1]: 0.0013415, [27] [switch_simplify]: 4.442e-05 [loop_unroll]: 2.904e-05 [a_1]: 0.00046328 [with_stream_mark]: 9.94001e-06 [recompute_prepare]: 6.78e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 8.00006e-07 [specialize_transform]: 6.01998e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.089e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.38999e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 0.00052177 [add_forward_monad_depend]: 4.15e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 9.91e-06 [cse]: 1.881e-05 [replace_applicator]: 1.117e-05 [Cycle 2]: 0.00031134, [27] [switch_simplify]: 5.43002e-06 [loop_unroll]: 4.71002e-06 [a_1]: 8.779e-05 [with_stream_mark]: 9.37001e-06 [recompute_prepare]: 4.65999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.54001e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.139e-05 [j_node_and_user_rematch]: 7.68001e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 6.99001e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.15001e-06 [cse]: 1.202e-05 [replace_applicator]: 4.79e-06 [py_interpret_to_execute_after_opt_a]: 8.65001e-06 [rewriter_after_opt_a]: 2.684e-05 [convert_after_rewriter]: 5.48002e-06 [order_py_execute_after_rewriter]: 4.13001e-06 [mutable_eliminate]: 0.00052259 [jit_opt_b]: 4.713e-05, [1] [Cycle 1]: 4.146e-05, [2] [frontend_op_eliminate]: 1.514e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 1.62e-05 [loop_unroll]: 0.00041573 [jit_opt_after_cconv]: 0.00013647, [1] [Cycle 1]: 0.00013025, [11] [c_1]: 2.032e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.43002e-06 [updatestate_assign_eliminate]: 2.43998e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.079e-05 [call_graph_tuple_transform]: 1.649e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 8.90024e-07 [renormalize]: 3.10014e-07 [switch_simplify]: 5.12e-06 [remove_dup_value]: 9.72001e-06 [partial_unused_args_eliminate]: 1.79e-06 [environ_conv]: 4.60999e-06 [add_recomputation]: 3.205e-05 [cse_after_recomputation]: 2.377e-05, [1] [Cycle 1]: 1.824e-05, [1] [cse]: 1.221e-05 [auto_monad_reorder]: 1.013e-05 [get_jit_bprop_graph]: 1.44998e-06 [rewriter_after_jit_bprop_graph]: 4.16001e-06 [opt_after_jit_grad]: 0.00044925 [symbol_engine_optimizer]: 7.143e-05, [1] [Cycle 1]: 6.502e-05, [6] [build]: 3.02002e-06 [elim_shapecalc]: 7.89002e-06 [elim_not_effective]: 1.253e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.74003e-06 [renormalize]: 3.50003e-07 [validate]: 3.801e-05 Sums bootstrap : 0.000274s : 3.51% type_inference : 0.004273s : 54.64% event_method : 0.000016s : 0.21% auto_monad : 0.000047s : 0.60% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000032s : 0.41% rewriter_before_opt_a : 0.000065s : 0.83% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000050s : 0.64% jit_opt_a.loop_unroll : 0.000034s : 0.43% jit_opt_a.a_1 : 0.000551s : 7.05% jit_opt_a.with_stream_mark : 0.000019s : 0.25% jit_opt_a.recompute_prepare : 0.000011s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000014s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000522s : 6.67% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000015s : 0.19% jit_opt_a.cse : 0.000031s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000027s : 0.34% convert_after_rewriter : 0.000005s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000523s : 6.68% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000016s : 0.21% loop_unroll : 0.000416s : 5.32% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000010s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000032s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.16% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000449s : 5.74% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.49% Time group info: ------[substitution.] 0.000148 23 1.36% : 0.000002s : 2: substitution.elim_not_effective 0.87% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000003s : 3: substitution.graph_param_transform 83.34% : 0.000123s : 4: substitution.inline 1.69% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000003s : 4: substitution.remove_not_recompute_node 2.00% : 0.000003s : 2: substitution.replace_old_param 6.21% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004224 2 82.48% : 0.003484s : 1: type_inference.infer 17.52% : 0.000740s : 1: type_inference.specialize ------[replace.] 0.000062 6 64.77% : 0.000040s : 4: replace.inline 35.23% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000129 6 93.77% : 0.000121s : 4: match.inline 6.23% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.36% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.28% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000000s : 3: predicate.opt_reshape 2.26% : 0.000002s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.95% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000008s : 53: predicate.switch_simplify 1.45% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.85% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.58% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000544 13 51.44% : 0.000280s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.71% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.84% : 0.000238s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012599 72 0.28% : 0.000035s : 1: add_recomputation 0.40% : 0.000050s : 1: auto_monad 0.10% : 0.000013s : 1: auto_monad_reorder 2.31% : 0.000291s : 1: bootstrap 0.15% : 0.000019s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.20% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 36.33% : 0.004578s : 1: jit_opt_a 1.10% : 0.000139s : 1: jit_opt_after_cconv 0.39% : 0.000049s : 1: jit_opt_b 3.36% : 0.000424s : 1: loop_unroll 4.21% : 0.000530s : 1: mutable_eliminate 5.91% : 0.000744s : 26: opt.transform.jit_opt_a 0.35% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.63% : 0.000457s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000035s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000012s : 1: remove_dup_value 2.08% : 0.000262s : 1: renormalize.infer 2.01% : 0.000253s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000030s : 1: rewriter_after_opt_a 0.54% : 0.000068s : 1: rewriter_before_opt_a 0.59% : 0.000074s : 1: symbol_engine_optimizer 34.01% : 0.004285s : 1: type_inference TotalTime = 0.0695552, [30] [bootstrap]: 0.00033481 [type_inference]: 0.0558463 [event_method]: 1.851e-05 [auto_monad]: 6.758e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00011419 [rewriter_before_opt_a]: 7.847e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00594586, [2] [Cycle 1]: 0.00198537, [27] [switch_simplify]: 5.44e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00053382 [with_stream_mark]: 1.726e-05 [recompute_prepare]: 7.96001e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.36998e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00099439 [add_forward_monad_depend]: 3.291e-05 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.461e-05 [cse]: 3.597e-05 [replace_applicator]: 1.02e-05 [Cycle 2]: 0.00032329, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.27001e-06 [a_1]: 9.075e-05 [with_stream_mark]: 9.25001e-06 [recompute_prepare]: 5.73002e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.47999e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.264e-05 [j_node_and_user_rematch]: 7.68999e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 4.82998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 5.27001e-06 [cse]: 1.409e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.145e-05 [rewriter_after_opt_a]: 3.631e-05 [convert_after_rewriter]: 7.08998e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00054496 [jit_opt_b]: 4.965e-05, [1] [Cycle 1]: 4.287e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.587e-05 [cconv]: 2.437e-05 [loop_unroll]: 0.00047434 [jit_opt_after_cconv]: 0.00013353, [1] [Cycle 1]: 0.00012768, [11] [c_1]: 2.059e-05 [parameter_eliminate]: 1.87001e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 1.706e-05 [call_graph_tuple_transform]: 1.812e-05 [tuple_list_get_item_eliminator]: 5.55001e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 2.70025e-07 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 1.615e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 4.98e-05 [cse_after_recomputation]: 2.307e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.161e-05 [auto_monad_reorder]: 1.871e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00541701 [symbol_engine_optimizer]: 8.205e-05, [1] [Cycle 1]: 7.429e-05, [6] [build]: 3.5e-06 [elim_shapecalc]: 8.92e-06 [elim_not_effective]: 1.652e-05 [opt_reshape]: 6.39999e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 4.00003e-07 [validate]: 4.069e-05 Sums bootstrap : 0.000335s : 0.51% type_inference : 0.055846s : 85.48% event_method : 0.000019s : 0.03% auto_monad : 0.000068s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000114s : 0.17% rewriter_before_opt_a : 0.000078s : 0.12% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000625s : 0.96% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000994s : 1.52% jit_opt_a.add_forward_monad_depend : 0.000034s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000050s : 0.08% jit_opt_a.replace_applicator : 0.000015s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000545s : 0.83% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000024s : 0.04% loop_unroll : 0.000474s : 0.73% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.005417s : 8.29% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.06% Time group info: ------[substitution.] 0.000202 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.89% : 0.000002s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 3: substitution.graph_param_transform 83.33% : 0.000168s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000004s : 4: substitution.remove_not_recompute_node 2.01% : 0.000004s : 2: substitution.replace_old_param 6.25% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055783 2 97.22% : 0.054232s : 1: type_inference.infer 2.78% : 0.001551s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.36% : 0.000047s : 4: replace.inline 33.64% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.46% : 0.000166s : 4: match.inline 6.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 2.13% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.72% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.72% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.28% : 0.000001s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.86% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000847 13 48.31% : 0.000409s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.72% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.97% : 0.000406s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071453 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000071s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.50% : 0.000355s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000019s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.33% : 0.005949s : 1: jit_opt_a 0.19% : 0.000136s : 1: jit_opt_after_cconv 0.07% : 0.000052s : 1: jit_opt_b 0.67% : 0.000481s : 1: loop_unroll 0.77% : 0.000553s : 1: mutable_eliminate 1.17% : 0.000837s : 26: opt.transform.jit_opt_a 0.06% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000038s : 4: opt.transform.symbol_engine_opt 7.60% : 0.005431s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000118s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.78% : 0.000554s : 1: renormalize.infer 0.60% : 0.000432s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000085s : 1: symbol_engine_optimizer 78.18% : 0.055859s : 1: type_inference TotalTime = 0.147172, [30] [bootstrap]: 0.00024666 [type_inference]: 0.119035 [event_method]: 0.00042405 [auto_monad]: 0.00011387 [graph_reusing]: 7.23e-06 [pre_auto_parallel]: 2.90002e-06 [py_interpret_to_execute]: 7.499e-05 [rewriter_before_opt_a]: 0.00012679 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.0247177, [3] [Cycle 1]: 0.0171018, [27] [switch_simplify]: 8.195e-05 [loop_unroll]: 4.499e-05 [a_1]: 0.00100801 [with_stream_mark]: 3.665e-05 [recompute_prepare]: 2.238e-05 [updatestate_depend_eliminate]: 9.99999e-06 [updatestate_assign_eliminate]: 6.88998e-06 [updatestate_loads_eliminate]: 7.26999e-06 [parameter_eliminate]: 3.04999e-06 [specialize_transform]: 1.49e-05 [updatestate_useless_node_eliminater]: 1.321e-05 [accelerated_algorithm]: 1.393e-05 [meta_shard_fg_expand]: 3.85998e-06 [get_grad_eliminate_]: 1.327e-05 [merge_forward]: 8.48999e-06 [cell_reuse_recompute_pass]: 9.29984e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.755e-05 [j_node_and_user_rematch]: 2.44e-05 [meta_fg_expand]: 0.00182125 [replace_old_param]: 7.735e-05 [inline_without_move]: 6.517e-05 [renormalize]: 0.0130413 [add_forward_monad_depend]: 1.38e-05 [auto_monad_grad]: 6.29001e-06 [auto_monad_eliminator]: 6.473e-05 [cse]: 0.00029867 [replace_applicator]: 9.668e-05 [Cycle 2]: 0.00381771, [27] [switch_simplify]: 4.394e-05 [loop_unroll]: 4.205e-05 [a_1]: 0.00117641 [with_stream_mark]: 2.139e-05 [recompute_prepare]: 9.14998e-06 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 3.89002e-06 [updatestate_loads_eliminate]: 4.02e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 7.86001e-06 [accelerated_algorithm]: 7.73001e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 7.1e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 1.16997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2e-05 [j_node_and_user_rematch]: 1.172e-05 [meta_fg_expand]: 0.00013574 [replace_old_param]: 9.77001e-06 [inline_without_move]: 7.06999e-06 [renormalize]: 0.00194076 [add_forward_monad_depend]: 9.13002e-06 [auto_monad_grad]: 2.05002e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 2.857e-05 [replace_applicator]: 2.223e-05 [Cycle 3]: 0.00027003, [27] [switch_simplify]: 4.60001e-06 [loop_unroll]: 3.46999e-06 [a_1]: 4.339e-05 [with_stream_mark]: 1.39e-05 [recompute_prepare]: 3.61001e-06 [updatestate_depend_eliminate]: 2.56998e-06 [updatestate_assign_eliminate]: 2.06003e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 3.83999e-06 [updatestate_useless_node_eliminater]: 3.56001e-06 [accelerated_algorithm]: 3.49001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 3.16001e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 6.39999e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 3.46001e-06 [inline_without_move]: 2.88998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 3.9e-06 [cse]: 8.64e-06 [replace_applicator]: 3.58e-06 [py_interpret_to_execute_after_opt_a]: 1.435e-05 [rewriter_after_opt_a]: 4.052e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00076933 [jit_opt_b]: 4.308e-05, [1] [Cycle 1]: 3.44e-05, [2] [frontend_op_eliminate]: 1.072e-05 [inline_after_opt_a]: 1.178e-05 [cconv]: 3.145e-05 [loop_unroll]: 0.00045715 [jit_opt_after_cconv]: 0.00014997, [1] [Cycle 1]: 0.00014213, [11] [c_1]: 1.37e-05 [parameter_eliminate]: 5.49e-06 [updatestate_depend_eliminate]: 7.25998e-06 [updatestate_assign_eliminate]: 1.77001e-06 [updatestate_loads_eliminate]: 1.77001e-06 [cse]: 2.936e-05 [call_graph_tuple_transform]: 1.753e-05 [tuple_list_get_item_eliminator]: 3.76999e-06 [none_parameter_eliminate]: 1.24998e-06 [renormalize]: 1.33002e-06 [switch_simplify]: 3.9e-06 [remove_dup_value]: 1.583e-05 [partial_unused_args_eliminate]: 2.33002e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 3.995e-05 [cse_after_recomputation]: 1.988e-05, [1] [Cycle 1]: 1.343e-05, [1] [cse]: 7.23e-06 [auto_monad_reorder]: 1.289e-05 [get_jit_bprop_graph]: 3.03e-06 [rewriter_after_jit_bprop_graph]: 8.50001e-06 [opt_after_jit_grad]: 0.00046717 [symbol_engine_optimizer]: 8.403e-05, [1] [Cycle 1]: 7.723e-05, [6] [build]: 3.84002e-06 [elim_shapecalc]: 6.26e-06 [elim_not_effective]: 1.057e-05 [opt_reshape]: 2.01e-05 [fold_const_symbol]: 5.91e-06 [renormalize]: 3.50003e-07 [validate]: 3.76e-05 Sums bootstrap : 0.000247s : 0.17% type_inference : 0.119035s : 83.45% event_method : 0.000424s : 0.30% auto_monad : 0.000114s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000075s : 0.05% rewriter_before_opt_a : 0.000127s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.09% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002228s : 1.56% jit_opt_a.with_stream_mark : 0.000072s : 0.05% jit_opt_a.recompute_prepare : 0.000035s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001959s : 1.37% jit_opt_a.replace_old_param : 0.000091s : 0.06% jit_opt_a.inline_without_move : 0.000075s : 0.05% jit_opt_a.renormalize : 0.014982s : 10.50% jit_opt_a.add_forward_monad_depend : 0.000024s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.06% jit_opt_a.cse : 0.000336s : 0.24% jit_opt_a.replace_applicator : 0.000122s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000769s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000457s : 0.32% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000467s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000020s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.03% Time group info: ------[substitution.] 0.000605 104 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.77% : 0.000005s : 1: substitution.graph_param_transform 65.47% : 0.000396s : 13: substitution.inline 3.43% : 0.000021s : 2: substitution.inline_without_move 1.70% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.14% : 0.000013s : 7: substitution.minmaximum_grad 1.16% : 0.000007s : 5: substitution.partial_eliminate 2.04% : 0.000012s : 12: substitution.remove_not_recompute_node 5.69% : 0.000034s : 10: substitution.replace_applicator 1.76% : 0.000011s : 10: substitution.replace_old_param 0.51% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.04% : 0.000006s : 1: substitution.tile_eliminate 3.90% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.65% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.32% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118929 2 97.44% : 0.115886s : 1: type_inference.infer 2.56% : 0.003043s : 1: type_inference.specialize ------[replace.] 0.000206 20 70.01% : 0.000144s : 13: replace.inline 29.99% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000409 20 94.83% : 0.000388s : 13: match.inline 5.17% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000380 2544 1.51% : 0.000006s : 44: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000005s : 44: predicate.addn_check_dump 1.69% : 0.000006s : 44: predicate.addn_zero_filter 2.11% : 0.000008s : 44: predicate.arithmetic_simplify 1.54% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000005s : 44: predicate.compare_switch_simplify 1.46% : 0.000006s : 44: predicate.depend_value_elim 1.41% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.65% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.65% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.49% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_depend_swap 1.46% : 0.000006s : 44: predicate.environ_get_eliminate 1.42% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 17: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.52% : 0.000017s : 66: predicate.inline 2.20% : 0.000008s : 45: predicate.inline_without_move 0.34% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.06% : 0.000004s : 17: predicate.less_batch_normalization 1.83% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.93% : 0.000007s : 52: predicate.load_eliminater 0.38% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.32% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.71% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.49% : 0.000006s : 44: predicate.merge_addn 1.67% : 0.000006s : 44: predicate.minmaximum_grad 0.40% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.32% : 0.000009s : 52: predicate.partial_eliminate 1.44% : 0.000005s : 44: predicate.print_const_string_wrapper 2.01% : 0.000008s : 44: predicate.reduce_eliminate 2.17% : 0.000008s : 51: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 17: predicate.remove_not_recompute_node 2.89% : 0.000011s : 96: predicate.replace_applicator 1.21% : 0.000005s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.53% : 0.000006s : 44: predicate.reshape_eliminate 1.49% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.29% : 0.000001s : 1: predicate.row_tensor_eliminate 1.58% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 2: predicate.special_op_eliminate 0.76% : 0.000003s : 17: predicate.specialize_transform 1.75% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.75% : 0.000010s : 64: predicate.switch_defer_inline 2.43% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.46% : 0.000025s : 157: predicate.switch_simplify 1.59% : 0.000006s : 44: predicate.tile_eliminate 1.56% : 0.000006s : 44: predicate.transpose_eliminate 1.86% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.95% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.79% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.81% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.86% : 0.000007s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003647 45 76.46% : 0.002789s : 28: func_graph_cloner_run.FuncGraphClonerGraph 23.54% : 0.000858s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.165089 87 0.03% : 0.000044s : 1: add_recomputation 0.07% : 0.000120s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.16% : 0.000268s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.26% : 0.000433s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.97% : 0.024721s : 1: jit_opt_a 0.09% : 0.000152s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.28% : 0.000466s : 1: loop_unroll 0.47% : 0.000781s : 1: mutable_eliminate 1.77% : 0.002922s : 39: opt.transform.jit_opt_a 0.02% : 0.000036s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000476s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000079s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.74% : 0.012773s : 2: renormalize.infer 1.32% : 0.002185s : 2: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000130s : 1: rewriter_before_opt_a 0.05% : 0.000086s : 1: symbol_engine_optimizer 72.12% : 0.119058s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.559.054 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dca0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.559.721 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0133415, [30] [bootstrap]: 0.0002909 [type_inference]: 0.00506863 [event_method]: 1.878e-05 [auto_monad]: 6.709e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 4.18e-05 [rewriter_before_opt_a]: 7.604e-05 [expand_dump_flag]: 3.10998e-06 [jit_opt_a]: 0.00561729, [2] [Cycle 1]: 0.00176528, [27] [switch_simplify]: 5.666e-05 [loop_unroll]: 2.838e-05 [a_1]: 0.00055662 [with_stream_mark]: 2.117e-05 [recompute_prepare]: 7.38999e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 4.12003e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.447e-05 [j_node_and_user_rematch]: 9.11998e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00075192 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.51e-05 [cse]: 3.717e-05 [replace_applicator]: 1.218e-05 [Cycle 2]: 0.00032205, [27] [switch_simplify]: 5.44998e-06 [loop_unroll]: 4.97e-06 [a_1]: 8.838e-05 [with_stream_mark]: 9.12999e-06 [recompute_prepare]: 4.80001e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.65999e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.23e-05 [j_node_and_user_rematch]: 7.55998e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 6.93998e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.27001e-06 [cse]: 1.192e-05 [replace_applicator]: 5.30001e-06 [py_interpret_to_execute_after_opt_a]: 1.181e-05 [rewriter_after_opt_a]: 3.718e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00056577 [jit_opt_b]: 4.967e-05, [1] [Cycle 1]: 4.277e-05, [2] [frontend_op_eliminate]: 1.674e-05 [inline_after_opt_a]: 1.496e-05 [cconv]: 2.487e-05 [loop_unroll]: 0.0004217 [jit_opt_after_cconv]: 0.00015041, [1] [Cycle 1]: 0.00014385, [11] [c_1]: 2.059e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.017e-05 [call_graph_tuple_transform]: 1.79e-05 [tuple_list_get_item_eliminator]: 5.12e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.51002e-06 [remove_dup_value]: 1.592e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 5.74999e-06 [add_recomputation]: 5.207e-05 [cse_after_recomputation]: 2.449e-05, [1] [Cycle 1]: 1.909e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.782e-05 [get_jit_bprop_graph]: 1.79998e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00046662 [symbol_engine_optimizer]: 7.166e-05, [1] [Cycle 1]: 6.571e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 7.24001e-06 [elim_not_effective]: 1.232e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 3.69997e-07 [validate]: 3.759e-05 Sums bootstrap : 0.000291s : 3.16% type_inference : 0.005069s : 55.09% event_method : 0.000019s : 0.20% auto_monad : 0.000067s : 0.73% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000042s : 0.45% rewriter_before_opt_a : 0.000076s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.68% jit_opt_a.loop_unroll : 0.000033s : 0.36% jit_opt_a.a_1 : 0.000645s : 7.01% jit_opt_a.with_stream_mark : 0.000030s : 0.33% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000752s : 8.17% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000049s : 0.53% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000037s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000566s : 6.15% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000025s : 0.27% loop_unroll : 0.000422s : 4.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.57% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000467s : 5.07% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.41% Time group info: ------[substitution.] 0.000232 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 85.11% : 0.000198s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000004s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.84% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005003 2 82.21% : 0.004113s : 1: type_inference.infer 17.79% : 0.000890s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.25% : 0.000047s : 4: replace.inline 32.75% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 93.97% : 0.000195s : 4: match.inline 6.03% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.74% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.34% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000001s : 10: predicate.print_const_string_wrapper 2.33% : 0.000003s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.98% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.42% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.95% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000669 13 51.72% : 0.000346s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.20% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.08% : 0.000275s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014998 72 0.37% : 0.000055s : 1: add_recomputation 0.47% : 0.000070s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.08% : 0.000312s : 1: bootstrap 0.18% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.47% : 0.005620s : 1: jit_opt_a 1.02% : 0.000153s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.86% : 0.000429s : 1: loop_unroll 3.83% : 0.000574s : 1: mutable_eliminate 5.70% : 0.000855s : 26: opt.transform.jit_opt_a 0.31% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.16% : 0.000475s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000044s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.81% : 0.000422s : 1: renormalize.infer 2.15% : 0.000322s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000040s : 1: rewriter_after_opt_a 0.52% : 0.000079s : 1: rewriter_before_opt_a 0.49% : 0.000074s : 1: symbol_engine_optimizer 33.92% : 0.005087s : 1: type_inference TotalTime = 0.221191, [30] [bootstrap]: 0.00035076 [type_inference]: 0.209875 [event_method]: 2.259e-05 [auto_monad]: 7.141e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00024344 [rewriter_before_opt_a]: 9.573e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0081842, [2] [Cycle 1]: 0.00333407, [27] [switch_simplify]: 6.725e-05 [loop_unroll]: 3.544e-05 [a_1]: 0.00072939 [with_stream_mark]: 2.089e-05 [recompute_prepare]: 9.31e-06 [updatestate_depend_eliminate]: 4.62998e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 6.73998e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 4.027e-05 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.707e-05 [j_node_and_user_rematch]: 1.052e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.088e-05 [inline_without_move]: 6.65002e-06 [renormalize]: 0.00206829 [add_forward_monad_depend]: 7.31001e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.755e-05 [cse]: 3.628e-05 [replace_applicator]: 2.05e-05 [Cycle 2]: 0.00036673, [27] [switch_simplify]: 6.91999e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.0001193 [with_stream_mark]: 1.27e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.16002e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 8.43001e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 5.34e-06 [cse]: 1.463e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.527e-05 [rewriter_after_opt_a]: 4.066e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.65001e-06 [mutable_eliminate]: 0.00066177 [jit_opt_b]: 5.677e-05, [1] [Cycle 1]: 4.857e-05, [2] [frontend_op_eliminate]: 1.899e-05 [inline_after_opt_a]: 1.859e-05 [cconv]: 2.863e-05 [loop_unroll]: 0.00043557 [jit_opt_after_cconv]: 0.00015482, [1] [Cycle 1]: 0.00014813, [11] [c_1]: 2.612e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 6.05002e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.39e-05 [call_graph_tuple_transform]: 2.135e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 6.03002e-06 [remove_dup_value]: 1.811e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 8.52998e-06 [add_recomputation]: 4.978e-05 [cse_after_recomputation]: 2.414e-05, [1] [Cycle 1]: 1.863e-05, [1] [cse]: 1.287e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 4.99e-06 [opt_after_jit_grad]: 0.0004665 [symbol_engine_optimizer]: 9.501e-05, [1] [Cycle 1]: 6.903e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 8.67998e-06 [elim_not_effective]: 1.419e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 9.34998e-06 [renormalize]: 5.39992e-07 [validate]: 4.878e-05 Sums bootstrap : 0.000351s : 0.16% type_inference : 0.209875s : 97.13% event_method : 0.000023s : 0.01% auto_monad : 0.000071s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000243s : 0.11% rewriter_before_opt_a : 0.000096s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000849s : 0.39% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000046s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002068s : 0.96% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000051s : 0.02% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000662s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000436s : 0.20% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000467s : 0.22% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.02% Time group info: ------[substitution.] 0.000285 25 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 4: substitution.graph_param_transform 87.05% : 0.000248s : 5: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 4.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.209792 2 99.05% : 0.207802s : 1: type_inference.infer 0.95% : 0.001990s : 1: type_inference.specialize ------[replace.] 0.000105 7 69.60% : 0.000073s : 5: replace.inline 30.40% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 7 95.39% : 0.000246s : 5: match.inline 4.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.39% : 0.000002s : 13: predicate.environ_get_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000008s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.25% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.22% : 0.000002s : 13: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.47% : 0.000002s : 13: predicate.print_const_string_wrapper 1.44% : 0.000002s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.96% : 0.000011s : 65: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002168 25 66.83% : 0.001449s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.83% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.34% : 0.000636s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.224468 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000075s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.16% : 0.000365s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.65% : 0.008188s : 1: jit_opt_a 0.08% : 0.000173s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.20% : 0.000444s : 1: loop_unroll 0.30% : 0.000671s : 1: mutable_eliminate 0.51% : 0.001141s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000475s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000248s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.61% : 0.001374s : 1: renormalize.infer 0.31% : 0.000685s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000101s : 1: rewriter_before_opt_a 0.04% : 0.000097s : 1: symbol_engine_optimizer 93.51% : 0.209893s : 1: type_inference TotalTime = 0.238539, [30] [bootstrap]: 0.00031661 [type_inference]: 0.226388 [event_method]: 2.213e-05 [auto_monad]: 7.575e-05 [graph_reusing]: 7.54002e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00047488 [rewriter_before_opt_a]: 8.955e-05 [expand_dump_flag]: 3.27997e-06 [jit_opt_a]: 0.0087223, [2] [Cycle 1]: 0.00422215, [27] [switch_simplify]: 5.785e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00060482 [with_stream_mark]: 2.209e-05 [recompute_prepare]: 8.26002e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.96998e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.675e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 7.05002e-06 [renormalize]: 0.00314012 [add_forward_monad_depend]: 6.58e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.912e-05 [cse]: 3.603e-05 [replace_applicator]: 1.857e-05 [Cycle 2]: 0.00037134, [27] [switch_simplify]: 6.71999e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00012596 [with_stream_mark]: 1.177e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.33998e-06 [cell_reuse_recompute_pass]: 3.11999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.89998e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.211e-05 [replace_applicator]: 5.77999e-06 [py_interpret_to_execute_after_opt_a]: 1.442e-05 [rewriter_after_opt_a]: 3.88e-05 [convert_after_rewriter]: 3.718e-05 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00065953 [jit_opt_b]: 5.548e-05, [1] [Cycle 1]: 4.841e-05, [2] [frontend_op_eliminate]: 1.977e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 2.724e-05 [loop_unroll]: 0.00042428 [jit_opt_after_cconv]: 0.00014873, [1] [Cycle 1]: 0.00014264, [11] [c_1]: 2.524e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 6.01998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [cse]: 2.003e-05 [call_graph_tuple_transform]: 2.088e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 8.87e-06 [add_recomputation]: 5.126e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.87e-05, [1] [cse]: 1.276e-05 [auto_monad_reorder]: 6.201e-05 [get_jit_bprop_graph]: 4.2e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00045975 [symbol_engine_optimizer]: 0.00016104, [1] [Cycle 1]: 0.00015454, [6] [build]: 4.00998e-06 [elim_shapecalc]: 9.51e-06 [elim_not_effective]: 9.572e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 1.018e-05 [renormalize]: 5.09986e-07 [validate]: 4.634e-05 Sums bootstrap : 0.000317s : 0.14% type_inference : 0.226388s : 96.82% event_method : 0.000022s : 0.01% auto_monad : 0.000076s : 0.03% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000475s : 0.20% rewriter_before_opt_a : 0.000090s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000731s : 0.31% jit_opt_a.with_stream_mark : 0.000034s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003140s : 1.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000048s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000037s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000660s : 0.28% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000424s : 0.18% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000062s : 0.03% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000460s : 0.20% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000096s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.02% Time group info: ------[substitution.] 0.000321 24 26.14% : 0.000084s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 4: substitution.graph_param_transform 62.97% : 0.000202s : 4: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000006s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 3.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.226305 2 98.77% : 0.223525s : 1: type_inference.infer 1.23% : 0.002780s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.12% : 0.000052s : 4: replace.inline 30.88% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.49% : 0.000200s : 4: match.inline 5.51% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.24% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.94% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002665 22 56.05% : 0.001494s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.08% : 0.001122s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.242792 72 0.02% : 0.000054s : 1: add_recomputation 0.03% : 0.000080s : 1: auto_monad 0.03% : 0.000065s : 1: auto_monad_reorder 0.14% : 0.000333s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.02% : 0.000040s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 3.59% : 0.008726s : 1: jit_opt_a 0.06% : 0.000151s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.18% : 0.000432s : 1: loop_unroll 0.28% : 0.000668s : 1: mutable_eliminate 0.40% : 0.000970s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000119s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000468s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000481s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.80% : 0.001932s : 1: renormalize.infer 0.49% : 0.001197s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000164s : 1: symbol_engine_optimizer 93.25% : 0.226407s : 1: type_inference TotalTime = 0.263197, [30] [bootstrap]: 0.00036824 [type_inference]: 0.249605 [event_method]: 2.89e-05 [auto_monad]: 8.422e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00058792 [rewriter_before_opt_a]: 0.00011011 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.0097254, [2] [Cycle 1]: 0.00532103, [27] [switch_simplify]: 7.836e-05 [loop_unroll]: 3.462e-05 [a_1]: 0.00082279 [with_stream_mark]: 2.292e-05 [recompute_prepare]: 8.83001e-06 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 3.60998e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 7.61001e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.95002e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.121e-05 [inline_without_move]: 6.24999e-06 [renormalize]: 0.00394694 [add_forward_monad_depend]: 1.072e-05 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.996e-05 [cse]: 4.005e-05 [replace_applicator]: 2.412e-05 [Cycle 2]: 0.00042216, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 6.20002e-06 [a_1]: 0.00014775 [with_stream_mark]: 1.667e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.79999e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.87002e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 3.56999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.23002e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.81e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.519e-05 [replace_applicator]: 7.2e-06 [py_interpret_to_execute_after_opt_a]: 1.727e-05 [rewriter_after_opt_a]: 4.168e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.61998e-06 [mutable_eliminate]: 0.00081217 [jit_opt_b]: 6.327e-05, [1] [Cycle 1]: 5.501e-05, [2] [frontend_op_eliminate]: 2.245e-05 [inline_after_opt_a]: 2.022e-05 [cconv]: 3.431e-05 [loop_unroll]: 0.00046188 [jit_opt_after_cconv]: 0.00018147, [1] [Cycle 1]: 0.00017437, [11] [c_1]: 2.75e-05 [parameter_eliminate]: 4.32e-06 [updatestate_depend_eliminate]: 8.82999e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 3.464e-05 [call_graph_tuple_transform]: 2.454e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 1.995e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 1.01e-05 [add_recomputation]: 5.497e-05 [cse_after_recomputation]: 2.584e-05, [1] [Cycle 1]: 1.934e-05, [1] [cse]: 1.345e-05 [auto_monad_reorder]: 1.692e-05 [get_jit_bprop_graph]: 2.85998e-06 [rewriter_after_jit_bprop_graph]: 7.06999e-06 [opt_after_jit_grad]: 0.00049305 [symbol_engine_optimizer]: 8.823e-05, [1] [Cycle 1]: 8.203e-05, [6] [build]: 5.02e-06 [elim_shapecalc]: 9.64e-06 [elim_not_effective]: 1.57e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 1.179e-05 [renormalize]: 3.89991e-07 [validate]: 0.00010437 Sums bootstrap : 0.000368s : 0.14% type_inference : 0.249605s : 96.55% event_method : 0.000029s : 0.01% auto_monad : 0.000084s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000588s : 0.23% rewriter_before_opt_a : 0.000110s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000971s : 0.38% jit_opt_a.with_stream_mark : 0.000040s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003947s : 1.53% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000055s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000812s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.000462s : 0.18% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000493s : 0.19% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000104s : 0.04% Time group info: ------[substitution.] 0.000346 28 0.89% : 0.000003s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 1.78% : 0.000006s : 4: substitution.graph_param_transform 85.17% : 0.000295s : 5: substitution.inline 1.23% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000015s : 3: substitution.reduce_eliminate 1.31% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000006s : 2: substitution.replace_old_param 3.26% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.249484 2 98.35% : 0.245365s : 1: type_inference.infer 1.65% : 0.004119s : 1: type_inference.specialize ------[replace.] 0.000124 7 68.70% : 0.000085s : 5: replace.inline 31.30% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000301 7 96.63% : 0.000291s : 5: match.inline 3.37% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.13% : 0.000003s : 13: predicate.arithmetic_simplify 1.15% : 0.000002s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.35% : 0.000002s : 13: predicate.environ_get_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000008s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 0.99% : 0.000002s : 13: predicate.minmaximum_grad 1.62% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.48% : 0.000004s : 13: predicate.reduce_eliminate 1.85% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.20% : 0.000002s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.03% : 0.000005s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.88% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.12% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.48% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.00% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003090 25 60.08% : 0.001857s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.16% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.76% : 0.001136s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.268406 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000088s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.15% : 0.000391s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.62% : 0.009729s : 1: jit_opt_a 0.07% : 0.000184s : 1: jit_opt_after_cconv 0.02% : 0.000066s : 1: jit_opt_b 0.18% : 0.000471s : 1: loop_unroll 0.31% : 0.000824s : 1: mutable_eliminate 0.47% : 0.001250s : 26: opt.transform.jit_opt_a 0.02% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000503s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000595s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 1.02% : 0.002730s : 1: renormalize.infer 0.45% : 0.001204s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000116s : 1: rewriter_before_opt_a 0.03% : 0.000091s : 1: symbol_engine_optimizer 93.01% : 0.249634s : 1: type_inference TotalTime = 0.0279147, [30] [bootstrap]: 0.0003311 [type_inference]: 0.0196658 [event_method]: 1.837e-05 [auto_monad]: 6.853e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00010257 [rewriter_before_opt_a]: 9.611e-05 [expand_dump_flag]: 3.17997e-06 [jit_opt_a]: 0.00544861, [2] [Cycle 1]: 0.00187986, [27] [switch_simplify]: 5.46e-05 [loop_unroll]: 2.895e-05 [a_1]: 0.00052641 [with_stream_mark]: 1.805e-05 [recompute_prepare]: 7.14001e-06 [updatestate_depend_eliminate]: 3.303e-05 [updatestate_assign_eliminate]: 3.75998e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.494e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 9.39998e-06 [inline_without_move]: 5.24e-06 [renormalize]: 0.00088789 [add_forward_monad_depend]: 5.57999e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 3.259e-05 [replace_applicator]: 1.209e-05 [Cycle 2]: 0.00031465, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.37001e-06 [a_1]: 8.923e-05 [with_stream_mark]: 8.71002e-06 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.297e-05 [j_node_and_user_rematch]: 7.8e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.42001e-06 [cse]: 1.209e-05 [replace_applicator]: 4.93001e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 3.847e-05 [convert_after_rewriter]: 6.52001e-06 [order_py_execute_after_rewriter]: 4.76002e-06 [mutable_eliminate]: 0.0005751 [jit_opt_b]: 4.752e-05, [1] [Cycle 1]: 4.078e-05, [2] [frontend_op_eliminate]: 1.555e-05 [inline_after_opt_a]: 1.551e-05 [cconv]: 2.701e-05 [loop_unroll]: 0.00043296 [jit_opt_after_cconv]: 0.00014005, [1] [Cycle 1]: 0.00013382, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 2.33002e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.144e-05 [call_graph_tuple_transform]: 1.885e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.71999e-06 [environ_conv]: 5.89999e-06 [add_recomputation]: 5.016e-05 [cse_after_recomputation]: 2.109e-05, [1] [Cycle 1]: 1.626e-05, [1] [cse]: 1.112e-05 [auto_monad_reorder]: 1.741e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 4.82e-06 [opt_after_jit_grad]: 0.00049254 [symbol_engine_optimizer]: 7.215e-05, [1] [Cycle 1]: 6.564e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.358e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 4.10015e-07 [validate]: 3.922e-05 Sums bootstrap : 0.000331s : 1.37% type_inference : 0.019666s : 81.59% event_method : 0.000018s : 0.08% auto_monad : 0.000069s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.43% rewriter_before_opt_a : 0.000096s : 0.40% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.25% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000616s : 2.55% jit_opt_a.with_stream_mark : 0.000027s : 0.11% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000036s : 0.15% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000888s : 3.68% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000045s : 0.19% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000575s : 2.39% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.11% loop_unroll : 0.000433s : 1.80% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.21% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000493s : 2.04% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.16% Time group info: ------[substitution.] 0.000204 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 83.40% : 0.000170s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 6.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019600 2 93.19% : 0.018264s : 1: type_inference.infer 6.81% : 0.001335s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.28% : 0.000048s : 4: replace.inline 31.72% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.15% : 0.000168s : 4: match.inline 6.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.87% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.09% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000790 13 48.74% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.58% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.67% : 0.000369s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029685 72 0.18% : 0.000053s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.16% : 0.000345s : 1: bootstrap 0.10% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.07% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.37% : 0.005452s : 1: jit_opt_a 0.48% : 0.000143s : 1: jit_opt_after_cconv 0.17% : 0.000050s : 1: jit_opt_b 1.49% : 0.000441s : 1: loop_unroll 1.97% : 0.000584s : 1: mutable_eliminate 2.79% : 0.000829s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.68% : 0.000500s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000106s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.63% : 0.000485s : 1: renormalize.infer 1.33% : 0.000394s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000042s : 1: rewriter_after_opt_a 0.34% : 0.000101s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 66.29% : 0.019679s : 1: type_inference TotalTime = 0.0471051, [30] [bootstrap]: 0.0002833 [type_inference]: 0.0394185 [event_method]: 2.023e-05 [auto_monad]: 6.927e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 9.909e-05 [rewriter_before_opt_a]: 8.014e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00512366, [2] [Cycle 1]: 0.00169932, [27] [switch_simplify]: 5.124e-05 [loop_unroll]: 2.882e-05 [a_1]: 0.00050472 [with_stream_mark]: 1.922e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 0.00077295 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.427e-05 [cse]: 3.548e-05 [replace_applicator]: 1.233e-05 [Cycle 2]: 0.00031966, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 5.05999e-06 [a_1]: 8.628e-05 [with_stream_mark]: 9.02999e-06 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.04e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 7.68001e-06 [meta_fg_expand]: 1.45999e-06 [replace_old_param]: 6.68e-06 [inline_without_move]: 1.308e-05 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.48998e-06 [cse]: 1.355e-05 [replace_applicator]: 5.34998e-06 [py_interpret_to_execute_after_opt_a]: 1.104e-05 [rewriter_after_opt_a]: 3.568e-05 [convert_after_rewriter]: 6.54999e-06 [order_py_execute_after_rewriter]: 5.09003e-06 [mutable_eliminate]: 0.00048165 [jit_opt_b]: 4.812e-05, [1] [Cycle 1]: 4.135e-05, [2] [frontend_op_eliminate]: 1.47e-05 [inline_after_opt_a]: 1.532e-05 [cconv]: 2.453e-05 [loop_unroll]: 0.00039987 [jit_opt_after_cconv]: 0.00013722, [1] [Cycle 1]: 0.0001304, [11] [c_1]: 1.937e-05 [parameter_eliminate]: 2.20002e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.15e-05 [call_graph_tuple_transform]: 1.731e-05 [tuple_list_get_item_eliminator]: 5.10001e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.526e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 6.66e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 2.278e-05, [1] [Cycle 1]: 1.72e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.56002e-06 [opt_after_jit_grad]: 0.00045424 [symbol_engine_optimizer]: 7.051e-05, [1] [Cycle 1]: 6.395e-05, [6] [build]: 2.84999e-06 [elim_shapecalc]: 7.34002e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 5.64998e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 4.50003e-07 [validate]: 3.677e-05 Sums bootstrap : 0.000283s : 0.65% type_inference : 0.039418s : 90.73% event_method : 0.000020s : 0.05% auto_monad : 0.000069s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000099s : 0.23% rewriter_before_opt_a : 0.000080s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000591s : 1.36% jit_opt_a.with_stream_mark : 0.000028s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000018s : 0.04% jit_opt_a.renormalize : 0.000773s : 1.78% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000049s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000036s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000482s : 1.11% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000025s : 0.06% loop_unroll : 0.000400s : 0.92% jit_opt_after_cconv.c_1 : 0.000019s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000050s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000454s : 1.05% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.08% Time group info: ------[substitution.] 0.000194 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000005s : 3: substitution.graph_param_transform 83.72% : 0.000163s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000004s : 4: substitution.remove_not_recompute_node 2.04% : 0.000004s : 2: substitution.replace_old_param 6.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039345 2 96.12% : 0.037818s : 1: type_inference.infer 3.88% : 0.001527s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.86% : 0.000045s : 4: replace.inline 31.14% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.80% : 0.000160s : 4: match.inline 6.20% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000108 691 1.32% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.24% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.84% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.98% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.45% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000008s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.62% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000783 13 47.76% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.31% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.93% : 0.000367s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048736 72 0.11% : 0.000052s : 1: add_recomputation 0.15% : 0.000072s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.62% : 0.000302s : 1: bootstrap 0.06% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.52% : 0.005126s : 1: jit_opt_a 0.29% : 0.000140s : 1: jit_opt_after_cconv 0.10% : 0.000051s : 1: jit_opt_b 0.84% : 0.000407s : 1: loop_unroll 1.00% : 0.000489s : 1: mutable_eliminate 1.65% : 0.000804s : 26: opt.transform.jit_opt_a 0.09% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000102s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 0.90% : 0.000437s : 1: renormalize.infer 0.67% : 0.000328s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000039s : 1: rewriter_after_opt_a 0.17% : 0.000084s : 1: rewriter_before_opt_a 0.15% : 0.000073s : 1: symbol_engine_optimizer 80.92% : 0.039437s : 1: type_inference TotalTime = 0.166392, [30] [bootstrap]: 0.00023464 [type_inference]: 0.133411 [event_method]: 0.00049408 [auto_monad]: 0.00012949 [graph_reusing]: 8.40001e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 8.777e-05 [rewriter_before_opt_a]: 0.00014535 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.0293924, [3] [Cycle 1]: 0.0207905, [27] [switch_simplify]: 9.047e-05 [loop_unroll]: 4.435e-05 [a_1]: 0.00104169 [with_stream_mark]: 3.755e-05 [recompute_prepare]: 2.206e-05 [updatestate_depend_eliminate]: 1.035e-05 [updatestate_assign_eliminate]: 7.15003e-06 [updatestate_loads_eliminate]: 6.88e-06 [parameter_eliminate]: 2.95998e-06 [specialize_transform]: 1.501e-05 [updatestate_useless_node_eliminater]: 1.325e-05 [accelerated_algorithm]: 1.385e-05 [meta_shard_fg_expand]: 3.91999e-06 [get_grad_eliminate_]: 1.349e-05 [merge_forward]: 9.24e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.98e-05 [j_node_and_user_rematch]: 2.467e-05 [meta_fg_expand]: 0.00391253 [replace_old_param]: 9.019e-05 [inline_without_move]: 6.498e-05 [renormalize]: 0.014567 [add_forward_monad_depend]: 1.577e-05 [auto_monad_grad]: 6.36e-06 [auto_monad_eliminator]: 6.815e-05 [cse]: 0.000284 [replace_applicator]: 0.00010004 [Cycle 2]: 0.00449426, [27] [switch_simplify]: 4.569e-05 [loop_unroll]: 4.576e-05 [a_1]: 0.00137304 [with_stream_mark]: 3.076e-05 [recompute_prepare]: 1.881e-05 [updatestate_depend_eliminate]: 6.61e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 4.74e-06 [parameter_eliminate]: 2.92002e-06 [specialize_transform]: 1.046e-05 [updatestate_useless_node_eliminater]: 8.08999e-06 [accelerated_algorithm]: 9.02e-06 [meta_shard_fg_expand]: 3.5e-06 [get_grad_eliminate_]: 1.037e-05 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 2.10002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.329e-05 [j_node_and_user_rematch]: 1.666e-05 [meta_fg_expand]: 0.00017354 [replace_old_param]: 1.489e-05 [inline_without_move]: 8.50001e-06 [renormalize]: 0.00237839 [add_forward_monad_depend]: 7.8e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.465e-05 [cse]: 2.797e-05 [replace_applicator]: 1.809e-05 [Cycle 3]: 0.00025989, [27] [switch_simplify]: 4.2e-06 [loop_unroll]: 3.58e-06 [a_1]: 4.206e-05 [with_stream_mark]: 1.33e-05 [recompute_prepare]: 3.81001e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 1.82999e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 3.4e-06 [updatestate_useless_node_eliminater]: 3.19001e-06 [accelerated_algorithm]: 4.07e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 3.14999e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.76998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.197e-05 [j_node_and_user_rematch]: 6.35002e-06 [meta_fg_expand]: 1.29e-06 [replace_old_param]: 3.06999e-06 [inline_without_move]: 2.96999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 3.9e-06 [cse]: 8.72e-06 [replace_applicator]: 3.85e-06 [py_interpret_to_execute_after_opt_a]: 1.399e-05 [rewriter_after_opt_a]: 3.814e-05 [convert_after_rewriter]: 6.14001e-06 [order_py_execute_after_rewriter]: 4.4e-06 [mutable_eliminate]: 0.00076216 [jit_opt_b]: 4.474e-05, [1] [Cycle 1]: 3.598e-05, [2] [frontend_op_eliminate]: 1.08e-05 [inline_after_opt_a]: 1.186e-05 [cconv]: 2.809e-05 [loop_unroll]: 0.00047086 [jit_opt_after_cconv]: 0.00013742, [1] [Cycle 1]: 0.0001297, [11] [c_1]: 1.421e-05 [parameter_eliminate]: 4.03001e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 1.69e-06 [cse]: 2.104e-05 [call_graph_tuple_transform]: 1.5e-05 [tuple_list_get_item_eliminator]: 4.08999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 3.55e-06 [remove_dup_value]: 1.634e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 5.03002e-06 [add_recomputation]: 3.736e-05 [cse_after_recomputation]: 2.209e-05, [1] [Cycle 1]: 1.603e-05, [1] [cse]: 9.46e-06 [auto_monad_reorder]: 1.528e-05 [get_jit_bprop_graph]: 1.76003e-06 [rewriter_after_jit_bprop_graph]: 6.09999e-06 [opt_after_jit_grad]: 0.00052383 [symbol_engine_optimizer]: 8.289e-05, [1] [Cycle 1]: 7.578e-05, [6] [build]: 4.48001e-06 [elim_shapecalc]: 5.65001e-06 [elim_not_effective]: 1.251e-05 [opt_reshape]: 3.79002e-06 [fold_const_symbol]: 1.863e-05 [renormalize]: 5.3001e-07 [validate]: 3.808e-05 Sums bootstrap : 0.000235s : 0.15% type_inference : 0.133411s : 82.59% event_method : 0.000494s : 0.31% auto_monad : 0.000129s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000088s : 0.05% rewriter_before_opt_a : 0.000145s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000140s : 0.09% jit_opt_a.loop_unroll : 0.000094s : 0.06% jit_opt_a.a_1 : 0.002457s : 1.52% jit_opt_a.with_stream_mark : 0.000082s : 0.05% jit_opt_a.recompute_prepare : 0.000045s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000065s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.004087s : 2.53% jit_opt_a.replace_old_param : 0.000108s : 0.07% jit_opt_a.inline_without_move : 0.000076s : 0.05% jit_opt_a.renormalize : 0.016945s : 10.49% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.05% jit_opt_a.cse : 0.000321s : 0.20% jit_opt_a.replace_applicator : 0.000122s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000762s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000471s : 0.29% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000037s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000524s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000019s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.02% Time group info: ------[substitution.] 0.000730 107 0.27% : 0.000002s : 1: substitution.elim_not_effective 1.79% : 0.000013s : 1: substitution.fold_const_symbol 0.51% : 0.000004s : 1: substitution.graph_param_transform 67.49% : 0.000493s : 13: substitution.inline 2.90% : 0.000021s : 2: substitution.inline_without_move 1.56% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.77% : 0.000013s : 7: substitution.minmaximum_grad 1.02% : 0.000007s : 5: substitution.partial_eliminate 1.65% : 0.000012s : 13: substitution.remove_not_recompute_node 4.83% : 0.000035s : 10: substitution.replace_applicator 1.00% : 0.000007s : 10: substitution.replace_old_param 1.30% : 0.000009s : 1: substitution.reshape_eliminate 0.34% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.09% : 0.000008s : 1: substitution.tile_eliminate 3.35% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.21% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.94% : 0.000051s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.133261 2 97.14% : 0.129455s : 1: type_inference.infer 2.86% : 0.003806s : 1: type_inference.specialize ------[replace.] 0.000229 20 65.22% : 0.000149s : 13: replace.inline 34.78% : 0.000080s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000511 20 94.77% : 0.000484s : 13: match.inline 5.23% : 0.000027s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000389 2656 1.54% : 0.000006s : 46: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000005s : 46: predicate.addn_check_dump 1.50% : 0.000006s : 46: predicate.addn_zero_filter 1.91% : 0.000007s : 46: predicate.arithmetic_simplify 1.48% : 0.000006s : 46: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000005s : 46: predicate.compare_switch_simplify 1.53% : 0.000006s : 46: predicate.depend_value_elim 1.42% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.45% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.80% : 0.000007s : 46: predicate.dict_set_item_eliminator 0.40% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.40% : 0.000005s : 46: predicate.environ_get_add_eliminate 1.41% : 0.000005s : 46: predicate.environ_get_depend_swap 1.45% : 0.000006s : 46: predicate.environ_get_eliminate 1.43% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000004s : 19: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.57% : 0.000018s : 68: predicate.inline 2.15% : 0.000008s : 47: predicate.inline_without_move 0.36% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.15% : 0.000004s : 19: predicate.less_batch_normalization 1.90% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 2.04% : 0.000008s : 54: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.36% : 0.000013s : 94: predicate.loop_unroll_before_grad 1.96% : 0.000008s : 47: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 46: predicate.merge_addn 1.45% : 0.000006s : 46: predicate.minmaximum_grad 0.43% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.35% : 0.000009s : 54: predicate.partial_eliminate 1.45% : 0.000006s : 46: predicate.print_const_string_wrapper 2.01% : 0.000008s : 46: predicate.reduce_eliminate 1.84% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000002s : 19: predicate.remove_not_recompute_node 2.78% : 0.000011s : 100: predicate.replace_applicator 1.20% : 0.000005s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 46: predicate.reshape_eliminate 1.50% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.45% : 0.000006s : 46: predicate.same_eliminate 0.48% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 2: predicate.special_op_eliminate 0.85% : 0.000003s : 19: predicate.specialize_transform 1.69% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.03% : 0.000012s : 66: predicate.switch_defer_inline 2.51% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.47% : 0.000025s : 161: predicate.switch_simplify 1.48% : 0.000006s : 46: predicate.tile_eliminate 1.58% : 0.000006s : 46: predicate.transpose_eliminate 1.90% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.84% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.78% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.76% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.78% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 2.01% : 0.000008s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004140 45 75.56% : 0.003129s : 28: func_graph_cloner_run.FuncGraphClonerGraph 24.44% : 0.001012s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.186573 87 0.02% : 0.000040s : 1: add_recomputation 0.07% : 0.000138s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.14% : 0.000258s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.27% : 0.000507s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.76% : 0.029396s : 1: jit_opt_a 0.07% : 0.000140s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.26% : 0.000481s : 1: loop_unroll 0.41% : 0.000773s : 1: mutable_eliminate 1.72% : 0.003204s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000040s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000535s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000091s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 7.72% : 0.014410s : 2: renormalize.infer 1.34% : 0.002507s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000151s : 1: rewriter_before_opt_a 0.05% : 0.000085s : 1: symbol_engine_optimizer 71.52% : 0.133442s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.735.286 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d5e0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.735.946 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0482169, [30] [bootstrap]: 0.00027108 [type_inference]: 0.0204811 [event_method]: 1.917e-05 [auto_monad]: 6.487e-05 [graph_reusing]: 4.81002e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00010797 [rewriter_before_opt_a]: 7.624e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.0104746, [2] [Cycle 1]: 0.00217254, [27] [switch_simplify]: 5.793e-05 [loop_unroll]: 3.07e-05 [a_1]: 0.00059383 [with_stream_mark]: 2.158e-05 [recompute_prepare]: 7.82002e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00112544 [add_forward_monad_depend]: 5.99999e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.536e-05 [cse]: 3.317e-05 [replace_applicator]: 1.215e-05 [Cycle 2]: 0.00031751, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 5.07e-06 [a_1]: 9.078e-05 [with_stream_mark]: 9.38002e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.85002e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 7.8e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.259e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 1.273e-05 [rewriter_after_opt_a]: 3.751e-05 [convert_after_rewriter]: 6.80998e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00053466 [jit_opt_b]: 4.909e-05, [1] [Cycle 1]: 4.231e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.601e-05 [cconv]: 2.563e-05 [loop_unroll]: 0.00041165 [jit_opt_after_cconv]: 0.00013779, [1] [Cycle 1]: 0.00013169, [11] [c_1]: 2.078e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.68003e-06 [cse]: 2e-05 [call_graph_tuple_transform]: 1.744e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 6.99976e-07 [switch_simplify]: 5.45001e-06 [remove_dup_value]: 1.499e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 5.74e-06 [add_recomputation]: 5.006e-05 [cse_after_recomputation]: 2.192e-05, [1] [Cycle 1]: 1.703e-05, [1] [cse]: 1.137e-05 [auto_monad_reorder]: 1.815e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.99e-06 [opt_after_jit_grad]: 0.0149847 [symbol_engine_optimizer]: 0.00014409, [1] [Cycle 1]: 0.00013421, [6] [build]: 5.25999e-06 [elim_shapecalc]: 9.13002e-06 [elim_not_effective]: 6.971e-05 [opt_reshape]: 8.40001e-06 [fold_const_symbol]: 1.057e-05 [renormalize]: 1.26997e-06 [validate]: 4.909e-05 Sums bootstrap : 0.000271s : 0.68% type_inference : 0.020481s : 51.68% event_method : 0.000019s : 0.05% auto_monad : 0.000065s : 0.16% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000108s : 0.27% rewriter_before_opt_a : 0.000076s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.16% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000685s : 1.73% jit_opt_a.with_stream_mark : 0.000031s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001126s : 2.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000046s : 0.12% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000535s : 1.35% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.06% loop_unroll : 0.000412s : 1.04% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.014985s : 37.81% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000070s : 0.18% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.12% Time group info: ------[substitution.] 0.000255 23 1.09% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 3: substitution.graph_param_transform 86.31% : 0.000220s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 5.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020415 2 92.39% : 0.018861s : 1: type_inference.infer 7.61% : 0.001554s : 1: type_inference.specialize ------[replace.] 0.000074 6 70.14% : 0.000052s : 4: replace.inline 29.86% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.94% : 0.000218s : 4: match.inline 5.06% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 3.68% : 0.000004s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.54% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.85% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.50% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.62% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.42% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000874 13 45.15% : 0.000395s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.19% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.66% : 0.000425s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050327 72 0.10% : 0.000053s : 1: add_recomputation 0.14% : 0.000068s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.58% : 0.000290s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 20.82% : 0.010478s : 1: jit_opt_a 0.28% : 0.000141s : 1: jit_opt_after_cconv 0.10% : 0.000052s : 1: jit_opt_b 0.83% : 0.000420s : 1: loop_unroll 1.08% : 0.000543s : 1: mutable_eliminate 1.79% : 0.000902s : 26: opt.transform.jit_opt_a 0.09% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000052s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000047s : 4: opt.transform.symbol_engine_opt 29.82% : 0.015007s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000112s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.35% : 0.000680s : 1: renormalize.infer 0.87% : 0.000437s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.16% : 0.000080s : 1: rewriter_before_opt_a 0.29% : 0.000147s : 1: symbol_engine_optimizer 40.72% : 0.020494s : 1: type_inference TotalTime = 0.035462, [30] [bootstrap]: 0.00033291 [type_inference]: 0.00918708 [event_method]: 2.387e-05 [auto_monad]: 7.204e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 5.728e-05 [rewriter_before_opt_a]: 8.56e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0233624, [2] [Cycle 1]: 0.00243639, [27] [switch_simplify]: 7.111e-05 [loop_unroll]: 3.468e-05 [a_1]: 0.00084613 [with_stream_mark]: 2.522e-05 [recompute_prepare]: 1.041e-05 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 6.93998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 1.689e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.098e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00106677 [add_forward_monad_depend]: 6.30997e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.59e-05 [cse]: 3.721e-05 [replace_applicator]: 1.542e-05 [Cycle 2]: 0.00033983, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.44e-06 [a_1]: 0.00010232 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 5.29003e-06 [updatestate_depend_eliminate]: 2.95998e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.93001e-06 [merge_forward]: 2.95002e-06 [cell_reuse_recompute_pass]: 2.04999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.126e-05 [j_node_and_user_rematch]: 7.83999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 5.01997e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.31998e-06 [cse]: 1.339e-05 [replace_applicator]: 5.52999e-06 [py_interpret_to_execute_after_opt_a]: 1.328e-05 [rewriter_after_opt_a]: 3.878e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 4.91997e-06 [mutable_eliminate]: 0.00067845 [jit_opt_b]: 5.321e-05, [1] [Cycle 1]: 4.541e-05, [2] [frontend_op_eliminate]: 1.776e-05 [inline_after_opt_a]: 1.541e-05 [cconv]: 2.664e-05 [loop_unroll]: 0.00042854 [jit_opt_after_cconv]: 0.00016426, [1] [Cycle 1]: 0.00015632, [11] [c_1]: 2.155e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.41e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.607e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 6.66e-06 [add_recomputation]: 5.426e-05 [cse_after_recomputation]: 2.408e-05, [1] [Cycle 1]: 1.879e-05, [1] [cse]: 1.313e-05 [auto_monad_reorder]: 1.736e-05 [get_jit_bprop_graph]: 2.28998e-06 [rewriter_after_jit_bprop_graph]: 5.27999e-06 [opt_after_jit_grad]: 0.00047939 [symbol_engine_optimizer]: 7.546e-05, [1] [Cycle 1]: 6.853e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 8.95001e-06 [elim_not_effective]: 1.306e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 4.49974e-07 [validate]: 3.963e-05 Sums bootstrap : 0.000333s : 2.34% type_inference : 0.009187s : 64.55% event_method : 0.000024s : 0.17% auto_monad : 0.000072s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.40% rewriter_before_opt_a : 0.000086s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.54% jit_opt_a.loop_unroll : 0.000040s : 0.28% jit_opt_a.a_1 : 0.000948s : 6.66% jit_opt_a.with_stream_mark : 0.000037s : 0.26% jit_opt_a.recompute_prepare : 0.000016s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001067s : 7.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000051s : 0.36% jit_opt_a.replace_applicator : 0.000021s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000039s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000678s : 4.77% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000027s : 0.19% loop_unroll : 0.000429s : 3.01% jit_opt_after_cconv.c_1 : 0.000022s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000054s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000017s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000479s : 3.37% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.28% Time group info: ------[substitution.] 0.000370 27 0.49% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.65% : 0.000006s : 3: substitution.graph_param_transform 87.54% : 0.000324s : 5: substitution.inline 0.92% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.16% : 0.000012s : 3: substitution.reduce_eliminate 1.27% : 0.000005s : 4: substitution.remove_not_recompute_node 1.42% : 0.000005s : 2: substitution.replace_old_param 3.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009103 2 86.70% : 0.007892s : 1: type_inference.infer 13.30% : 0.001211s : 1: type_inference.specialize ------[replace.] 0.000119 7 64.81% : 0.000077s : 5: replace.inline 35.19% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000331 7 96.84% : 0.000320s : 5: match.inline 3.16% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.44% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 11: predicate.addn_check_dump 1.15% : 0.000002s : 11: predicate.addn_zero_filter 2.24% : 0.000003s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.05% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.15% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.36% : 0.000002s : 11: predicate.environ_get_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.21% : 0.000002s : 6: predicate.get_grad_eliminate 0.51% : 0.000001s : 3: predicate.graph_param_transform 5.44% : 0.000008s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.54% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 11: predicate.merge_addn 1.02% : 0.000001s : 11: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 2.90% : 0.000004s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 19: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000002s : 11: predicate.reshape_eliminate 1.73% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000010s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.45% : 0.000002s : 11: predicate.transpose_eliminate 1.28% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.91% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.50% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001031 16 49.89% : 0.000515s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.43% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.68% : 0.000420s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037780 72 0.15% : 0.000057s : 1: add_recomputation 0.20% : 0.000076s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000351s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 61.85% : 0.023367s : 1: jit_opt_a 0.44% : 0.000167s : 1: jit_opt_after_cconv 0.15% : 0.000056s : 1: jit_opt_b 1.16% : 0.000437s : 1: loop_unroll 1.82% : 0.000689s : 1: mutable_eliminate 3.17% : 0.001199s : 26: opt.transform.jit_opt_a 0.13% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.29% : 0.000488s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000061s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.65% : 0.000623s : 1: renormalize.infer 1.15% : 0.000434s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000089s : 1: rewriter_before_opt_a 0.21% : 0.000078s : 1: symbol_engine_optimizer 24.38% : 0.009209s : 1: type_inference TotalTime = 0.0167815, [30] [bootstrap]: 0.00029882 [type_inference]: 0.00831672 [event_method]: 2.032e-05 [auto_monad]: 8.495e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 4.293e-05 [rewriter_before_opt_a]: 8.473e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00569949, [2] [Cycle 1]: 0.0018695, [27] [switch_simplify]: 5.695e-05 [loop_unroll]: 3.308e-05 [a_1]: 0.0006286 [with_stream_mark]: 1.988e-05 [recompute_prepare]: 7.41001e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 0.00077627 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.593e-05 [cse]: 4.118e-05 [replace_applicator]: 1.475e-05 [Cycle 2]: 0.00032466, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 5.26002e-06 [a_1]: 8.941e-05 [with_stream_mark]: 1.053e-05 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 4.73001e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.364e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 7.31001e-06 [inline_without_move]: 4.67e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.537e-05 [replace_applicator]: 5.26002e-06 [py_interpret_to_execute_after_opt_a]: 1.335e-05 [rewriter_after_opt_a]: 4.104e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00058891 [jit_opt_b]: 4.947e-05, [1] [Cycle 1]: 4.172e-05, [2] [frontend_op_eliminate]: 1.51e-05 [inline_after_opt_a]: 1.554e-05 [cconv]: 2.981e-05 [loop_unroll]: 0.00040551 [jit_opt_after_cconv]: 0.00015656, [1] [Cycle 1]: 0.00015025, [11] [c_1]: 2.028e-05 [parameter_eliminate]: 3.31001e-06 [updatestate_depend_eliminate]: 7.9e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 3.18998e-06 [cse]: 3.133e-05 [call_graph_tuple_transform]: 1.924e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 3.812e-05 [partial_unused_args_eliminate]: 2.78998e-06 [environ_conv]: 5.92001e-06 [add_recomputation]: 5.328e-05 [cse_after_recomputation]: 3.425e-05, [1] [Cycle 1]: 2.068e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.851e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 5.54998e-06 [opt_after_jit_grad]: 0.00047284 [symbol_engine_optimizer]: 7.181e-05, [1] [Cycle 1]: 6.551e-05, [6] [build]: 3.06999e-06 [elim_shapecalc]: 7.93001e-06 [elim_not_effective]: 1.206e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 8.70001e-06 [renormalize]: 5.19998e-07 [validate]: 3.881e-05 Sums bootstrap : 0.000299s : 2.36% type_inference : 0.008317s : 65.61% event_method : 0.000020s : 0.16% auto_monad : 0.000085s : 0.67% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000043s : 0.34% rewriter_before_opt_a : 0.000085s : 0.67% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000718s : 5.66% jit_opt_a.with_stream_mark : 0.000030s : 0.24% jit_opt_a.recompute_prepare : 0.000012s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000776s : 6.12% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.18% jit_opt_a.cse : 0.000057s : 0.45% jit_opt_a.replace_applicator : 0.000020s : 0.16% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000041s : 0.32% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000589s : 4.65% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000030s : 0.24% loop_unroll : 0.000406s : 3.20% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000031s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000038s : 0.30% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.42% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000473s : 3.73% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.31% Time group info: ------[substitution.] 0.000249 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000005s : 3: substitution.graph_param_transform 86.38% : 0.000215s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000005s : 2: substitution.replace_old_param 4.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008246 2 88.60% : 0.007306s : 1: type_inference.infer 11.40% : 0.000940s : 1: type_inference.specialize ------[replace.] 0.000089 7 68.67% : 0.000061s : 5: replace.inline 31.33% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 94.98% : 0.000212s : 5: match.inline 5.02% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.24% : 0.000001s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.28% : 0.000002s : 11: predicate.addn_zero_filter 1.76% : 0.000002s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.20% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.76% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.29% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 16: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 1.87% : 0.000002s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.25% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.34% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.15% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000001s : 11: predicate.tile_eliminate 1.20% : 0.000001s : 11: predicate.transpose_eliminate 1.58% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000762 16 52.47% : 0.000400s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.54% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.98% : 0.000290s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018550 72 0.31% : 0.000057s : 1: add_recomputation 0.48% : 0.000089s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.71% : 0.000317s : 1: bootstrap 0.17% : 0.000032s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.20% : 0.000036s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.74% : 0.005702s : 1: jit_opt_a 0.86% : 0.000160s : 1: jit_opt_after_cconv 0.28% : 0.000052s : 1: jit_opt_b 2.23% : 0.000414s : 1: loop_unroll 3.23% : 0.000600s : 1: mutable_eliminate 5.06% : 0.000939s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.60% : 0.000482s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000041s : 1: remove_dup_value 2.50% : 0.000464s : 1: renormalize.infer 1.64% : 0.000303s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000044s : 1: rewriter_after_opt_a 0.47% : 0.000088s : 1: rewriter_before_opt_a 0.40% : 0.000074s : 1: symbol_engine_optimizer 44.93% : 0.008335s : 1: type_inference TotalTime = 0.0394147, [30] [bootstrap]: 0.00029505 [type_inference]: 0.0300254 [event_method]: 2.126e-05 [auto_monad]: 7.313e-05 [graph_reusing]: 5.63002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00010999 [rewriter_before_opt_a]: 8.129e-05 [expand_dump_flag]: 3.87998e-06 [jit_opt_a]: 0.00641747, [2] [Cycle 1]: 0.00213028, [27] [switch_simplify]: 6.069e-05 [loop_unroll]: 3.035e-05 [a_1]: 0.00055803 [with_stream_mark]: 1.921e-05 [recompute_prepare]: 7.91001e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.51002e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.437e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 0.00113286 [add_forward_monad_depend]: 6.38e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 2.307e-05 [replace_applicator]: 1.547e-05 [Cycle 2]: 0.00032419, [27] [switch_simplify]: 6.09999e-06 [loop_unroll]: 5.17999e-06 [a_1]: 9.116e-05 [with_stream_mark]: 1.173e-05 [recompute_prepare]: 5.08002e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.38e-05 [j_node_and_user_rematch]: 8.23999e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.41999e-06 [inline_without_move]: 4.87998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.59001e-06 [cse]: 1.3e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.348e-05 [rewriter_after_opt_a]: 3.828e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 4.91997e-06 [mutable_eliminate]: 0.00067611 [jit_opt_b]: 4.997e-05, [1] [Cycle 1]: 4.223e-05, [2] [frontend_op_eliminate]: 1.556e-05 [inline_after_opt_a]: 1.556e-05 [cconv]: 2.839e-05 [loop_unroll]: 0.00048756 [jit_opt_after_cconv]: 0.00015116, [1] [Cycle 1]: 0.00014459, [11] [c_1]: 2.224e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 6.19999e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.409e-05 [call_graph_tuple_transform]: 2.086e-05 [tuple_list_get_item_eliminator]: 5.51998e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.797e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 7.06001e-06 [add_recomputation]: 5.004e-05 [cse_after_recomputation]: 2.448e-05, [1] [Cycle 1]: 1.907e-05, [1] [cse]: 1.327e-05 [auto_monad_reorder]: 1.824e-05 [get_jit_bprop_graph]: 2.58e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00049004 [symbol_engine_optimizer]: 8.961e-05, [1] [Cycle 1]: 8.285e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 7.67998e-06 [elim_not_effective]: 1.353e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 4.39992e-07 [validate]: 3.826e-05 Sums bootstrap : 0.000295s : 0.85% type_inference : 0.030025s : 86.14% event_method : 0.000021s : 0.06% auto_monad : 0.000073s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000110s : 0.32% rewriter_before_opt_a : 0.000081s : 0.23% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.19% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000649s : 1.86% jit_opt_a.with_stream_mark : 0.000031s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001133s : 3.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000036s : 0.10% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000038s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000676s : 1.94% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000028s : 0.08% loop_unroll : 0.000488s : 1.40% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000050s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000490s : 1.41% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.11% Time group info: ------[substitution.] 0.000232 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 3: substitution.graph_param_transform 84.68% : 0.000196s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 5.74% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029950 2 94.63% : 0.028341s : 1: type_inference.infer 5.37% : 0.001609s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.66% : 0.000049s : 4: replace.inline 32.34% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.12% : 0.000194s : 4: match.inline 5.88% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.35% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 6.39% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.20% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.60% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.97% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000890 13 42.96% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.71% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.33% : 0.000457s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041476 72 0.13% : 0.000053s : 1: add_recomputation 0.18% : 0.000076s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.75% : 0.000312s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.48% : 0.006421s : 1: jit_opt_a 0.37% : 0.000154s : 1: jit_opt_after_cconv 0.13% : 0.000053s : 1: jit_opt_b 1.20% : 0.000496s : 1: loop_unroll 1.65% : 0.000685s : 1: mutable_eliminate 2.10% : 0.000870s : 26: opt.transform.jit_opt_a 0.12% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000499s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000114s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.58% : 0.000654s : 1: renormalize.infer 1.13% : 0.000469s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000041s : 1: rewriter_after_opt_a 0.20% : 0.000085s : 1: rewriter_before_opt_a 0.22% : 0.000092s : 1: symbol_engine_optimizer 72.44% : 0.030044s : 1: type_inference TotalTime = 0.158364, [30] [bootstrap]: 0.00024423 [type_inference]: 0.121972 [event_method]: 0.00042893 [auto_monad]: 0.00011084 [graph_reusing]: 8.96002e-06 [pre_auto_parallel]: 2.88998e-06 [py_interpret_to_execute]: 7.885e-05 [rewriter_before_opt_a]: 0.00012634 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.0329931, [3] [Cycle 1]: 0.0251091, [27] [switch_simplify]: 8.109e-05 [loop_unroll]: 4.5e-05 [a_1]: 0.00099601 [with_stream_mark]: 3.291e-05 [recompute_prepare]: 2.109e-05 [updatestate_depend_eliminate]: 8.92e-06 [updatestate_assign_eliminate]: 6.73003e-06 [updatestate_loads_eliminate]: 6.66999e-06 [parameter_eliminate]: 2.68998e-06 [specialize_transform]: 1.455e-05 [updatestate_useless_node_eliminater]: 1.35e-05 [accelerated_algorithm]: 1.435e-05 [meta_shard_fg_expand]: 4.12e-06 [get_grad_eliminate_]: 1.389e-05 [merge_forward]: 9.17001e-06 [cell_reuse_recompute_pass]: 8.59989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.864e-05 [j_node_and_user_rematch]: 2.674e-05 [meta_fg_expand]: 0.00917001 [replace_old_param]: 8.956e-05 [inline_without_move]: 6.759e-05 [renormalize]: 0.0136592 [add_forward_monad_depend]: 1.508e-05 [auto_monad_grad]: 7.33999e-06 [auto_monad_eliminator]: 6.902e-05 [cse]: 0.00030574 [replace_applicator]: 9.86e-05 [Cycle 2]: 0.00409499, [27] [switch_simplify]: 4.291e-05 [loop_unroll]: 4.194e-05 [a_1]: 0.00121091 [with_stream_mark]: 2.329e-05 [recompute_prepare]: 1.184e-05 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 3.81999e-06 [updatestate_loads_eliminate]: 3.83999e-06 [parameter_eliminate]: 2.52001e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 8.14997e-06 [accelerated_algorithm]: 7.29001e-06 [meta_shard_fg_expand]: 2.91e-06 [get_grad_eliminate_]: 7.16999e-06 [merge_forward]: 4.85001e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.841e-05 [j_node_and_user_rematch]: 1.356e-05 [meta_fg_expand]: 0.00014438 [replace_old_param]: 1.033e-05 [inline_without_move]: 7.06001e-06 [renormalize]: 0.00218437 [add_forward_monad_depend]: 8.56002e-06 [auto_monad_grad]: 2.33998e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 2.978e-05 [replace_applicator]: 1.758e-05 [Cycle 3]: 0.00028052, [27] [switch_simplify]: 4.68001e-06 [loop_unroll]: 3.66999e-06 [a_1]: 4.73e-05 [with_stream_mark]: 1.424e-05 [recompute_prepare]: 3.34001e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 3.67998e-06 [updatestate_useless_node_eliminater]: 3.64002e-06 [accelerated_algorithm]: 3.64002e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 3.13e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.376e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 3.03e-06 [inline_without_move]: 3.36999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 1.48002e-06 [auto_monad_eliminator]: 4.53001e-06 [cse]: 9.86e-06 [replace_applicator]: 3.64002e-06 [py_interpret_to_execute_after_opt_a]: 1.34e-05 [rewriter_after_opt_a]: 3.921e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.60999e-06 [mutable_eliminate]: 0.00077306 [jit_opt_b]: 4.66e-05, [1] [Cycle 1]: 3.945e-05, [2] [frontend_op_eliminate]: 1.265e-05 [inline_after_opt_a]: 1.394e-05 [cconv]: 2.992e-05 [loop_unroll]: 0.0004667 [jit_opt_after_cconv]: 0.00014183, [1] [Cycle 1]: 0.00013533, [11] [c_1]: 1.32e-05 [parameter_eliminate]: 5.87001e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 1.99e-06 [updatestate_loads_eliminate]: 1.52999e-06 [cse]: 2.379e-05 [call_graph_tuple_transform]: 1.742e-05 [tuple_list_get_item_eliminator]: 3.56001e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 3.63e-06 [remove_dup_value]: 1.467e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 3.877e-05 [cse_after_recomputation]: 1.832e-05, [1] [Cycle 1]: 1.29e-05, [1] [cse]: 6.98998e-06 [auto_monad_reorder]: 1.3e-05 [get_jit_bprop_graph]: 1.63997e-06 [rewriter_after_jit_bprop_graph]: 7.08e-06 [opt_after_jit_grad]: 0.0004463 [symbol_engine_optimizer]: 8.384e-05, [1] [Cycle 1]: 7.713e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 5.40999e-06 [elim_not_effective]: 1.012e-05 [opt_reshape]: 4.68999e-06 [fold_const_symbol]: 2.237e-05 [renormalize]: 8.50006e-07 [validate]: 3.754e-05 Sums bootstrap : 0.000244s : 0.16% type_inference : 0.121972s : 79.28% event_method : 0.000429s : 0.28% auto_monad : 0.000111s : 0.07% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000079s : 0.05% rewriter_before_opt_a : 0.000126s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.08% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002254s : 1.47% jit_opt_a.with_stream_mark : 0.000070s : 0.05% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.009316s : 6.06% jit_opt_a.replace_old_param : 0.000103s : 0.07% jit_opt_a.inline_without_move : 0.000078s : 0.05% jit_opt_a.renormalize : 0.015844s : 10.30% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000089s : 0.06% jit_opt_a.cse : 0.000345s : 0.22% jit_opt_a.replace_applicator : 0.000120s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000773s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000467s : 0.30% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000446s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000022s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.02% Time group info: ------[substitution.] 0.000624 104 0.24% : 0.000001s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.81% : 0.000005s : 1: substitution.graph_param_transform 65.85% : 0.000411s : 13: substitution.inline 3.78% : 0.000024s : 2: substitution.inline_without_move 1.97% : 0.000012s : 12: substitution.j_node_and_user_rematch 2.01% : 0.000013s : 7: substitution.minmaximum_grad 1.30% : 0.000008s : 5: substitution.partial_eliminate 1.80% : 0.000011s : 12: substitution.remove_not_recompute_node 5.45% : 0.000034s : 10: substitution.replace_applicator 1.28% : 0.000008s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000007s : 1: substitution.tile_eliminate 3.65% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.57% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.57% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121876 2 97.38% : 0.118679s : 1: type_inference.infer 2.62% : 0.003197s : 1: type_inference.specialize ------[replace.] 0.000194 20 66.07% : 0.000128s : 13: replace.inline 33.93% : 0.000066s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000427 20 94.30% : 0.000403s : 13: match.inline 5.70% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000381 2544 1.67% : 0.000006s : 44: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 44: predicate.addn_check_dump 1.85% : 0.000007s : 44: predicate.addn_zero_filter 2.06% : 0.000008s : 44: predicate.arithmetic_simplify 1.58% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000006s : 44: predicate.compare_switch_simplify 1.45% : 0.000006s : 44: predicate.depend_value_elim 1.48% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.48% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.45% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.63% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.40% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.49% : 0.000006s : 44: predicate.environ_get_depend_swap 1.52% : 0.000006s : 44: predicate.environ_get_eliminate 1.45% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 17: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.44% : 0.000017s : 66: predicate.inline 2.06% : 0.000008s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.00% : 0.000004s : 17: predicate.less_batch_normalization 1.84% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.80% : 0.000007s : 52: predicate.load_eliminater 0.41% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.44% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.59% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.37% : 0.000005s : 44: predicate.merge_addn 1.44% : 0.000005s : 44: predicate.minmaximum_grad 0.73% : 0.000003s : 1: predicate.mutable_eliminate 0.14% : 0.000001s : 1: predicate.opt_reshape 2.44% : 0.000009s : 52: predicate.partial_eliminate 1.41% : 0.000005s : 44: predicate.print_const_string_wrapper 1.99% : 0.000008s : 44: predicate.reduce_eliminate 1.77% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 17: predicate.remove_not_recompute_node 2.80% : 0.000011s : 96: predicate.replace_applicator 1.23% : 0.000005s : 45: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.56% : 0.000006s : 44: predicate.reshape_eliminate 1.50% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000006s : 44: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.35% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 17: predicate.specialize_transform 1.84% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.76% : 0.000011s : 64: predicate.switch_defer_inline 2.42% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.35% : 0.000024s : 157: predicate.switch_simplify 1.65% : 0.000006s : 44: predicate.tile_eliminate 1.44% : 0.000005s : 44: predicate.transpose_eliminate 1.97% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 2.06% : 0.000008s : 44: predicate.tuple_list_set_item_eliminator 1.91% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 3.03% : 0.000012s : 69: predicate.updatestate_useless_node_eliminater 1.79% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.010752 45 91.91% : 0.009882s : 28: func_graph_cloner_run.FuncGraphClonerGraph 8.09% : 0.000870s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.177187 87 0.02% : 0.000041s : 1: add_recomputation 0.07% : 0.000118s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.15% : 0.000269s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.25% : 0.000437s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 18.62% : 0.032997s : 1: jit_opt_a 0.08% : 0.000145s : 1: jit_opt_after_cconv 0.03% : 0.000049s : 1: jit_opt_b 0.27% : 0.000476s : 1: loop_unroll 0.44% : 0.000784s : 1: mutable_eliminate 1.67% : 0.002965s : 39: opt.transform.jit_opt_a 0.02% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000019s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000455s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000084s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.51% : 0.013300s : 2: renormalize.infer 1.42% : 0.002518s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000129s : 1: rewriter_before_opt_a 0.05% : 0.000086s : 1: symbol_engine_optimizer 68.85% : 0.121992s : 1: type_inference TotalTime = 0.0544213, [30] [bootstrap]: 0.00031547 [type_inference]: 0.0337213 [event_method]: 2.033e-05 [auto_monad]: 6.819e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00011368 [rewriter_before_opt_a]: 8.336e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0179338, [2] [Cycle 1]: 0.00202564, [27] [switch_simplify]: 5.925e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00053706 [with_stream_mark]: 1.716e-05 [recompute_prepare]: 8.03001e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.418e-05 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 6.98998e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.594e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.70002e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 5.71e-06 [renormalize]: 0.00101354 [add_forward_monad_depend]: 6.12001e-06 [auto_monad_grad]: 2.09e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 3.351e-05 [replace_applicator]: 1.404e-05 [Cycle 2]: 0.0003401, [27] [switch_simplify]: 6.02001e-06 [loop_unroll]: 5.19998e-06 [a_1]: 9.184e-05 [with_stream_mark]: 1.02e-05 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 1.31998e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.376e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 9.64999e-06 [rewriter_after_opt_a]: 3.63e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00054574 [jit_opt_b]: 5.073e-05, [1] [Cycle 1]: 4.408e-05, [2] [frontend_op_eliminate]: 1.618e-05 [inline_after_opt_a]: 1.551e-05 [cconv]: 2.577e-05 [loop_unroll]: 0.00045023 [jit_opt_after_cconv]: 0.00014134, [1] [Cycle 1]: 0.00013504, [11] [c_1]: 2.112e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.2e-05 [call_graph_tuple_transform]: 1.758e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 5.66003e-06 [add_recomputation]: 4.915e-05 [cse_after_recomputation]: 2.323e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.215e-05 [auto_monad_reorder]: 1.889e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00046069 [symbol_engine_optimizer]: 8.877e-05, [1] [Cycle 1]: 6.516e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.236e-05 [opt_reshape]: 5.47001e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 3.39991e-07 [validate]: 3.902e-05 Sums bootstrap : 0.000315s : 0.82% type_inference : 0.033721s : 88.16% event_method : 0.000020s : 0.05% auto_monad : 0.000068s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000114s : 0.30% rewriter_before_opt_a : 0.000083s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.17% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000629s : 1.64% jit_opt_a.with_stream_mark : 0.000027s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000027s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001014s : 2.65% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000047s : 0.12% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000036s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000546s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.07% loop_unroll : 0.000450s : 1.18% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 1.20% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.10% Time group info: ------[substitution.] 0.000197 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000005s : 3: substitution.graph_param_transform 82.39% : 0.000162s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000005s : 4: substitution.remove_not_recompute_node 2.26% : 0.000004s : 2: substitution.replace_old_param 6.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033648 2 95.03% : 0.031975s : 1: type_inference.infer 4.97% : 0.001673s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.23% : 0.000052s : 4: replace.inline 31.77% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 92.80% : 0.000159s : 4: match.inline 7.20% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.59% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.62% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.68% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.56% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.13% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.60% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000852 13 44.01% : 0.000375s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.24% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.75% : 0.000449s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056348 72 0.09% : 0.000052s : 1: add_recomputation 0.13% : 0.000072s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.58% : 0.000328s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 31.83% : 0.017937s : 1: jit_opt_a 0.26% : 0.000144s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 0.81% : 0.000458s : 1: loop_unroll 0.98% : 0.000555s : 1: mutable_eliminate 1.52% : 0.000857s : 26: opt.transform.jit_opt_a 0.08% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000118s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.05% : 0.000591s : 1: renormalize.infer 0.73% : 0.000414s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.16% : 0.000087s : 1: rewriter_before_opt_a 0.16% : 0.000091s : 1: symbol_engine_optimizer 59.88% : 0.033740s : 1: type_inference TotalTime = 0.0113271, [30] [bootstrap]: 0.00026268 [type_inference]: 0.00417873 [event_method]: 1.69e-05 [auto_monad]: 6.612e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 3.168e-05 [rewriter_before_opt_a]: 6.948e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00474001, [2] [Cycle 1]: 0.00141937, [27] [switch_simplify]: 4.689e-05 [loop_unroll]: 2.888e-05 [a_1]: 0.00049301 [with_stream_mark]: 1.426e-05 [recompute_prepare]: 6.92002e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.147e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.43001e-06 [inline_without_move]: 5.36002e-06 [renormalize]: 0.00053629 [add_forward_monad_depend]: 4.67e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.123e-05 [cse]: 2.145e-05 [replace_applicator]: 1.122e-05 [Cycle 2]: 0.00031787, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.79998e-06 [a_1]: 8.797e-05 [with_stream_mark]: 8.17e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.63001e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.175e-05 [j_node_and_user_rematch]: 7.56999e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 6.73e-06 [inline_without_move]: 4.82e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 7.89994e-07 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.44e-06 [cse]: 1.155e-05 [replace_applicator]: 4.90999e-06 [py_interpret_to_execute_after_opt_a]: 9.65002e-06 [rewriter_after_opt_a]: 2.984e-05 [convert_after_rewriter]: 6.34001e-06 [order_py_execute_after_rewriter]: 4.18001e-06 [mutable_eliminate]: 0.00049908 [jit_opt_b]: 4.877e-05, [1] [Cycle 1]: 4.269e-05, [2] [frontend_op_eliminate]: 1.607e-05 [inline_after_opt_a]: 1.519e-05 [cconv]: 1.993e-05 [loop_unroll]: 0.00039812 [jit_opt_after_cconv]: 0.000138, [1] [Cycle 1]: 0.00013229, [11] [c_1]: 1.909e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.078e-05 [call_graph_tuple_transform]: 1.755e-05 [tuple_list_get_item_eliminator]: 5.07e-06 [none_parameter_eliminate]: 1.05999e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.04e-06 [remove_dup_value]: 1.311e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 5.68002e-06 [add_recomputation]: 4.081e-05 [cse_after_recomputation]: 2.331e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.199e-05 [auto_monad_reorder]: 1.44e-05 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00043368 [symbol_engine_optimizer]: 7.175e-05, [1] [Cycle 1]: 6.571e-05, [6] [build]: 2.52001e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 1.284e-05 [opt_reshape]: 5.61003e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 2.69996e-07 [validate]: 3.1e-05 Sums bootstrap : 0.000263s : 3.38% type_inference : 0.004179s : 53.83% event_method : 0.000017s : 0.22% auto_monad : 0.000066s : 0.85% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000032s : 0.41% rewriter_before_opt_a : 0.000069s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000053s : 0.68% jit_opt_a.loop_unroll : 0.000034s : 0.43% jit_opt_a.a_1 : 0.000581s : 7.48% jit_opt_a.with_stream_mark : 0.000022s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000536s : 6.91% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.21% jit_opt_a.cse : 0.000033s : 0.43% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000030s : 0.38% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000499s : 6.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000020s : 0.26% loop_unroll : 0.000398s : 5.13% jit_opt_after_cconv.c_1 : 0.000019s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000041s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.15% auto_monad_reorder : 0.000014s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000434s : 5.59% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.40% Time group info: ------[substitution.] 0.000180 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000005s : 3: substitution.graph_param_transform 83.60% : 0.000150s : 4: substitution.inline 1.29% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000004s : 4: substitution.remove_not_recompute_node 1.94% : 0.000003s : 2: substitution.replace_old_param 6.34% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004125 2 80.20% : 0.003308s : 1: type_inference.infer 19.80% : 0.000817s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.63% : 0.000043s : 4: replace.inline 33.37% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.44% : 0.000148s : 4: match.inline 6.56% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000108 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.68% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.36% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000534 13 50.78% : 0.000271s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.02% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.20% : 0.000236s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012698 72 0.34% : 0.000044s : 1: add_recomputation 0.55% : 0.000069s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.16% : 0.000274s : 1: bootstrap 0.18% : 0.000022s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.20% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.07% : 0.000009s : 1: graph_reusing 37.35% : 0.004743s : 1: jit_opt_a 1.11% : 0.000141s : 1: jit_opt_after_cconv 0.40% : 0.000051s : 1: jit_opt_b 3.20% : 0.000406s : 1: loop_unroll 4.00% : 0.000507s : 1: mutable_eliminate 6.12% : 0.000777s : 26: opt.transform.jit_opt_a 0.34% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.48% : 0.000441s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000034s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.22% : 0.000282s : 1: renormalize.infer 1.95% : 0.000247s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000032s : 1: rewriter_after_opt_a 0.57% : 0.000072s : 1: rewriter_before_opt_a 0.59% : 0.000074s : 1: symbol_engine_optimizer 32.99% : 0.004189s : 1: type_inference TotalTime = 0.0270868, [30] [bootstrap]: 0.00025124 [type_inference]: 0.0194241 [event_method]: 1.863e-05 [auto_monad]: 6.537e-05 [graph_reusing]: 5.51002e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 9.589e-05 [rewriter_before_opt_a]: 7.724e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.0051268, [2] [Cycle 1]: 0.00177488, [27] [switch_simplify]: 5.127e-05 [loop_unroll]: 2.941e-05 [a_1]: 0.00051605 [with_stream_mark]: 1.656e-05 [recompute_prepare]: 7.56001e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.395e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 5.24e-06 [renormalize]: 0.00085745 [add_forward_monad_depend]: 4.97e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.446e-05 [cse]: 2.123e-05 [replace_applicator]: 1.189e-05 [Cycle 2]: 0.00031066, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.03002e-06 [a_1]: 8.853e-05 [with_stream_mark]: 8.53001e-06 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 3.14001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.12999e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.256e-05 [j_node_and_user_rematch]: 7.73999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.41999e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.20999e-06 [cse]: 1.185e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 1.141e-05 [rewriter_after_opt_a]: 3.402e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00051031 [jit_opt_b]: 4.888e-05, [1] [Cycle 1]: 4.176e-05, [2] [frontend_op_eliminate]: 1.509e-05 [inline_after_opt_a]: 1.59e-05 [cconv]: 2.62e-05 [loop_unroll]: 0.00040769 [jit_opt_after_cconv]: 0.00013622, [1] [Cycle 1]: 0.00012983, [11] [c_1]: 1.999e-05 [parameter_eliminate]: 2.19999e-06 [updatestate_depend_eliminate]: 4.98001e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.003e-05 [call_graph_tuple_transform]: 1.7e-05 [tuple_list_get_item_eliminator]: 5.51998e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.691e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 5.78002e-06 [add_recomputation]: 4.513e-05 [cse_after_recomputation]: 2.285e-05, [1] [Cycle 1]: 1.749e-05, [1] [cse]: 1.192e-05 [auto_monad_reorder]: 1.785e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 4.89003e-06 [opt_after_jit_grad]: 0.00043752 [symbol_engine_optimizer]: 8.248e-05, [1] [Cycle 1]: 7.614e-05, [6] [build]: 2.69001e-06 [elim_shapecalc]: 1.85e-05 [elim_not_effective]: 1.259e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.74e-06 [renormalize]: 6.30011e-07 [validate]: 3.64e-05 Sums bootstrap : 0.000251s : 1.07% type_inference : 0.019424s : 82.63% event_method : 0.000019s : 0.08% auto_monad : 0.000065s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000096s : 0.41% rewriter_before_opt_a : 0.000077s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.15% jit_opt_a.a_1 : 0.000605s : 2.57% jit_opt_a.with_stream_mark : 0.000025s : 0.11% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000858s : 3.65% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000033s : 0.14% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000034s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000510s : 2.17% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000026s : 0.11% loop_unroll : 0.000408s : 1.73% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000045s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000438s : 1.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000018s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.15% Time group info: ------[substitution.] 0.000204 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000005s : 3: substitution.graph_param_transform 84.68% : 0.000173s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000004s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 5.62% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019363 2 93.28% : 0.018061s : 1: type_inference.infer 6.72% : 0.001302s : 1: type_inference.specialize ------[replace.] 0.000064 6 68.50% : 0.000044s : 4: replace.inline 31.50% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 94.23% : 0.000170s : 4: match.inline 5.77% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.25% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.48% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.72% : 0.000008s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.87% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000749 13 45.13% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.10% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.77% : 0.000365s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028822 72 0.17% : 0.000048s : 1: add_recomputation 0.24% : 0.000069s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 0.92% : 0.000265s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.80% : 0.005129s : 1: jit_opt_a 0.48% : 0.000139s : 1: jit_opt_after_cconv 0.18% : 0.000051s : 1: jit_opt_b 1.44% : 0.000415s : 1: loop_unroll 1.80% : 0.000518s : 1: mutable_eliminate 2.81% : 0.000810s : 26: opt.transform.jit_opt_a 0.16% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000446s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000099s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 1.66% : 0.000477s : 1: renormalize.infer 1.29% : 0.000372s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000037s : 1: rewriter_after_opt_a 0.28% : 0.000080s : 1: rewriter_before_opt_a 0.30% : 0.000085s : 1: symbol_engine_optimizer 67.43% : 0.019435s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.939.994 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c3a0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:32.940.676 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.05533, [30] [bootstrap]: 0.00029941 [type_inference]: 0.0119321 [event_method]: 1.902e-05 [auto_monad]: 6.087e-05 [graph_reusing]: 4.70999e-06 [pre_auto_parallel]: 2.04e-06 [py_interpret_to_execute]: 4.637e-05 [rewriter_before_opt_a]: 8.334e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.0052082, [2] [Cycle 1]: 0.00180851, [27] [switch_simplify]: 5.115e-05 [loop_unroll]: 3.242e-05 [a_1]: 0.00063424 [with_stream_mark]: 1.363e-05 [recompute_prepare]: 7.72002e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 1.93002e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.07002e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.251e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 9.13002e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.0007766 [add_forward_monad_depend]: 4.45e-06 [auto_monad_grad]: 1.97001e-06 [auto_monad_eliminator]: 1.125e-05 [cse]: 2.646e-05 [replace_applicator]: 1.144e-05 [Cycle 2]: 0.00031162, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.30999e-06 [a_1]: 8.701e-05 [with_stream_mark]: 7.93001e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.73998e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.72e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.189e-05 [j_node_and_user_rematch]: 7.88999e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.09001e-06 [inline_without_move]: 4.82e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.354e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.011e-05 [rewriter_after_opt_a]: 3.075e-05 [convert_after_rewriter]: 6.11e-06 [order_py_execute_after_rewriter]: 4.45e-06 [mutable_eliminate]: 0.00047871 [jit_opt_b]: 4.737e-05, [1] [Cycle 1]: 4.164e-05, [2] [frontend_op_eliminate]: 1.52e-05 [inline_after_opt_a]: 1.569e-05 [cconv]: 2.198e-05 [loop_unroll]: 0.0004143 [jit_opt_after_cconv]: 0.00013745, [1] [Cycle 1]: 0.00013158, [11] [c_1]: 2.002e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.262e-05 [call_graph_tuple_transform]: 1.7e-05 [tuple_list_get_item_eliminator]: 5.41998e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.19998e-06 [remove_dup_value]: 0.0350252 [partial_unused_args_eliminate]: 7.06999e-06 [environ_conv]: 1.406e-05 [add_recomputation]: 7.392e-05 [cse_after_recomputation]: 7.034e-05, [1] [Cycle 1]: 5.78e-05, [1] [cse]: 3.908e-05 [auto_monad_reorder]: 2.251e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 7.77e-06 [opt_after_jit_grad]: 0.00095848 [symbol_engine_optimizer]: 8.612e-05, [1] [Cycle 1]: 7.8e-05, [6] [build]: 4.36002e-06 [elim_shapecalc]: 8.97999e-06 [elim_not_effective]: 1.936e-05 [opt_reshape]: 6.19001e-06 [fold_const_symbol]: 9.08002e-06 [renormalize]: 8.80013e-07 [validate]: 4.942e-05 Sums bootstrap : 0.000299s : 0.58% type_inference : 0.011932s : 23.11% event_method : 0.000019s : 0.04% auto_monad : 0.000061s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000046s : 0.09% rewriter_before_opt_a : 0.000083s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.11% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000721s : 1.40% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000777s : 1.50% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000040s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000031s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000479s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000022s : 0.04% loop_unroll : 0.000414s : 0.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.035025s : 67.83% partial_unused_args_eliminate : 0.000007s : 0.01% environ_conv : 0.000014s : 0.03% add_recomputation : 0.000074s : 0.14% cse_after_recomputation.cse : 0.000039s : 0.08% auto_monad_reorder : 0.000023s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000958s : 1.86% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.10% Time group info: ------[substitution.] 0.000218 24 1.18% : 0.000003s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000005s : 3: substitution.graph_param_transform 86.71% : 0.000189s : 5: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.50% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011874 2 89.74% : 0.010656s : 1: type_inference.infer 10.26% : 0.001218s : 1: type_inference.specialize ------[replace.] 0.000087 7 68.66% : 0.000060s : 5: replace.inline 31.34% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 7 95.55% : 0.000186s : 5: match.inline 4.45% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 2.09% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.39% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.21% : 0.000001s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000001s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.36% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 3: predicate.elim_not_effective 0.79% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 1.65% : 0.000002s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000009s : 59: predicate.switch_simplify 1.37% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000001s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001031 16 56.02% : 0.000578s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.29% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.69% : 0.000389s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057091 72 0.13% : 0.000077s : 1: add_recomputation 0.11% : 0.000064s : 1: auto_monad 0.04% : 0.000025s : 1: auto_monad_reorder 0.56% : 0.000317s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.13% : 0.000073s : 1: cse_after_recomputation 0.03% : 0.000016s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.13% : 0.005211s : 1: jit_opt_a 0.25% : 0.000140s : 1: jit_opt_after_cconv 0.09% : 0.000050s : 1: jit_opt_b 0.74% : 0.000422s : 1: loop_unroll 0.85% : 0.000487s : 1: mutable_eliminate 1.63% : 0.000933s : 26: opt.transform.jit_opt_a 0.08% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.06% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.70% : 0.000971s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000013s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000049s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 61.39% : 0.035048s : 1: remove_dup_value 0.76% : 0.000431s : 1: renormalize.infer 0.59% : 0.000339s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000033s : 1: rewriter_after_opt_a 0.15% : 0.000086s : 1: rewriter_before_opt_a 0.16% : 0.000089s : 1: symbol_engine_optimizer 20.92% : 0.011942s : 1: type_inference TotalTime = 0.100299, [30] [bootstrap]: 0.0002501 [type_inference]: 0.0708128 [event_method]: 0.00028061 [auto_monad]: 0.00010676 [graph_reusing]: 7.12002e-06 [pre_auto_parallel]: 3.24001e-06 [py_interpret_to_execute]: 3.374e-05 [rewriter_before_opt_a]: 0.00012443 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0264759, [3] [Cycle 1]: 0.0181232, [27] [switch_simplify]: 8.155e-05 [loop_unroll]: 4.844e-05 [a_1]: 0.00101147 [with_stream_mark]: 3.064e-05 [recompute_prepare]: 2.05e-05 [updatestate_depend_eliminate]: 9.37999e-06 [updatestate_assign_eliminate]: 7.14001e-06 [updatestate_loads_eliminate]: 6.78998e-06 [parameter_eliminate]: 2.53998e-06 [specialize_transform]: 1.519e-05 [updatestate_useless_node_eliminater]: 1.411e-05 [accelerated_algorithm]: 1.438e-05 [meta_shard_fg_expand]: 3.59002e-06 [get_grad_eliminate_]: 1.391e-05 [merge_forward]: 8.54e-06 [cell_reuse_recompute_pass]: 8.89995e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.749e-05 [j_node_and_user_rematch]: 2.471e-05 [meta_fg_expand]: 0.00167967 [replace_old_param]: 6.855e-05 [inline_without_move]: 5.947e-05 [renormalize]: 0.0142701 [add_forward_monad_depend]: 1.304e-05 [auto_monad_grad]: 7.21001e-06 [auto_monad_eliminator]: 6.507e-05 [cse]: 0.00028142 [replace_applicator]: 9.062e-05 [Cycle 2]: 0.00442445, [27] [switch_simplify]: 4.49e-05 [loop_unroll]: 4.412e-05 [a_1]: 0.00120541 [with_stream_mark]: 1.695e-05 [recompute_prepare]: 1.115e-05 [updatestate_depend_eliminate]: 6.11998e-06 [updatestate_assign_eliminate]: 4.07998e-06 [updatestate_loads_eliminate]: 4.16001e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 8.70999e-06 [updatestate_useless_node_eliminater]: 8.79e-06 [accelerated_algorithm]: 8.55001e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 7.92e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.96e-05 [j_node_and_user_rematch]: 1.335e-05 [meta_fg_expand]: 0.00010407 [replace_old_param]: 9.77001e-06 [inline_without_move]: 7.69997e-06 [renormalize]: 0.00263267 [add_forward_monad_depend]: 9.05001e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.458e-05 [cse]: 2.84e-05 [replace_applicator]: 1.841e-05 [Cycle 3]: 0.00026009, [27] [switch_simplify]: 4.45e-06 [loop_unroll]: 3.8e-06 [a_1]: 4.039e-05 [with_stream_mark]: 1.18e-05 [recompute_prepare]: 3.7e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 1.96e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 3.55e-06 [updatestate_useless_node_eliminater]: 3.53e-06 [accelerated_algorithm]: 3.41999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 3.33998e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 2.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.27e-05 [j_node_and_user_rematch]: 5.72001e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 3.17997e-06 [inline_without_move]: 3.23e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 4.42e-06 [cse]: 8.60001e-06 [replace_applicator]: 3.45e-06 [py_interpret_to_execute_after_opt_a]: 1.226e-05 [rewriter_after_opt_a]: 3.554e-05 [convert_after_rewriter]: 5.86998e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00069414 [jit_opt_b]: 4.067e-05, [1] [Cycle 1]: 3.363e-05, [2] [frontend_op_eliminate]: 1.014e-05 [inline_after_opt_a]: 1.185e-05 [cconv]: 2.675e-05 [loop_unroll]: 0.0004141 [jit_opt_after_cconv]: 0.00013116, [1] [Cycle 1]: 0.0001251, [11] [c_1]: 1.249e-05 [parameter_eliminate]: 3.13998e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 1.72001e-06 [updatestate_loads_eliminate]: 1.68997e-06 [cse]: 2.087e-05 [call_graph_tuple_transform]: 1.637e-05 [tuple_list_get_item_eliminator]: 3.66001e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 4.15999e-06 [remove_dup_value]: 1.386e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 5.52999e-06 [add_recomputation]: 3.554e-05 [cse_after_recomputation]: 1.923e-05, [1] [Cycle 1]: 1.365e-05, [1] [cse]: 7.25998e-06 [auto_monad_reorder]: 1.267e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00044803 [symbol_engine_optimizer]: 6.419e-05, [1] [Cycle 1]: 5.794e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 5.63002e-06 [elim_not_effective]: 9.61e-06 [opt_reshape]: 4.68999e-06 [fold_const_symbol]: 5.49e-06 [renormalize]: 3.69997e-07 [validate]: 3.19e-05 Sums bootstrap : 0.000250s : 0.26% type_inference : 0.070813s : 73.95% event_method : 0.000281s : 0.29% auto_monad : 0.000107s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000034s : 0.04% rewriter_before_opt_a : 0.000124s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000131s : 0.14% jit_opt_a.loop_unroll : 0.000096s : 0.10% jit_opt_a.a_1 : 0.002257s : 2.36% jit_opt_a.with_stream_mark : 0.000059s : 0.06% jit_opt_a.recompute_prepare : 0.000035s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.03% jit_opt_a.accelerated_algorithm : 0.000026s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.05% jit_opt_a.meta_fg_expand : 0.001786s : 1.86% jit_opt_a.replace_old_param : 0.000081s : 0.09% jit_opt_a.inline_without_move : 0.000070s : 0.07% jit_opt_a.renormalize : 0.016903s : 17.65% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000084s : 0.09% jit_opt_a.cse : 0.000318s : 0.33% jit_opt_a.replace_applicator : 0.000112s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000694s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.03% loop_unroll : 0.000414s : 0.43% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000036s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000448s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000005s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000571 107 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.85% : 0.000005s : 1: substitution.graph_param_transform 65.82% : 0.000376s : 13: substitution.inline 2.91% : 0.000017s : 2: substitution.inline_without_move 1.58% : 0.000009s : 13: substitution.j_node_and_user_rematch 1.99% : 0.000011s : 7: substitution.minmaximum_grad 1.28% : 0.000007s : 5: substitution.partial_eliminate 1.91% : 0.000011s : 13: substitution.remove_not_recompute_node 5.17% : 0.000030s : 10: substitution.replace_applicator 1.19% : 0.000007s : 10: substitution.replace_old_param 1.29% : 0.000007s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.07% : 0.000006s : 1: substitution.tile_eliminate 4.08% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.72% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.29% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.070712 2 96.76% : 0.068422s : 1: type_inference.infer 3.24% : 0.002290s : 1: type_inference.specialize ------[replace.] 0.000179 20 65.07% : 0.000116s : 13: replace.inline 34.93% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000389 20 94.72% : 0.000368s : 13: match.inline 5.28% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000388 2768 1.58% : 0.000006s : 48: predicate.accumulaten_eliminater 0.32% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 48: predicate.addn_check_dump 1.57% : 0.000006s : 48: predicate.addn_zero_filter 2.07% : 0.000008s : 48: predicate.arithmetic_simplify 1.65% : 0.000006s : 48: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.53% : 0.000006s : 48: predicate.compare_switch_simplify 1.47% : 0.000006s : 48: predicate.depend_value_elim 1.47% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.60% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.46% : 0.000006s : 48: predicate.environ_get_depend_swap 1.49% : 0.000006s : 48: predicate.environ_get_eliminate 1.48% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.90% : 0.000004s : 20: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.45% : 0.000017s : 70: predicate.inline 1.94% : 0.000008s : 48: predicate.inline_without_move 0.39% : 0.000001s : 20: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 20: predicate.less_batch_normalization 1.84% : 0.000007s : 55: predicate.list_to_tuple_eliminator_ 1.89% : 0.000007s : 56: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.53% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.67% : 0.000006s : 49: predicate.make_slice_get_slice_eliminator 1.47% : 0.000006s : 48: predicate.merge_addn 1.51% : 0.000006s : 48: predicate.minmaximum_grad 0.44% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.28% : 0.000009s : 56: predicate.partial_eliminate 1.49% : 0.000006s : 48: predicate.print_const_string_wrapper 2.09% : 0.000008s : 48: predicate.reduce_eliminate 1.77% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 20: predicate.remove_not_recompute_node 2.95% : 0.000011s : 103: predicate.replace_applicator 1.02% : 0.000004s : 48: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000006s : 48: predicate.reshape_eliminate 1.51% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.13% : 0.000001s : 1: predicate.row_tensor_eliminate 1.59% : 0.000006s : 48: predicate.same_eliminate 0.48% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 20: predicate.specialize_transform 1.78% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.80% : 0.000011s : 68: predicate.switch_defer_inline 2.50% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.83% : 0.000026s : 170: predicate.switch_simplify 1.75% : 0.000007s : 48: predicate.tile_eliminate 1.47% : 0.000006s : 48: predicate.transpose_eliminate 1.87% : 0.000007s : 48: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000013s : 57: predicate.tuple_list_get_item_eliminator 1.82% : 0.000007s : 48: predicate.tuple_list_set_item_eliminator 1.86% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.86% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.87% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004449 58 83.07% : 0.003696s : 41: func_graph_cloner_run.FuncGraphClonerGraph 16.93% : 0.000753s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120150 87 0.03% : 0.000039s : 1: add_recomputation 0.09% : 0.000113s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000274s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.24% : 0.000289s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.04% : 0.026479s : 1: jit_opt_a 0.11% : 0.000134s : 1: jit_opt_after_cconv 0.04% : 0.000043s : 1: jit_opt_b 0.35% : 0.000422s : 1: loop_unroll 0.59% : 0.000703s : 1: mutable_eliminate 2.45% : 0.002942s : 39: opt.transform.jit_opt_a 0.03% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000036s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 12.19% : 0.014649s : 2: renormalize.infer 1.86% : 0.002234s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.11% : 0.000128s : 1: rewriter_before_opt_a 0.06% : 0.000067s : 1: symbol_engine_optimizer 58.96% : 0.070836s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.488.89 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c5e0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.495.88 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.280804, [30] [bootstrap]: 0.00030543 [type_inference]: 0.261825 [event_method]: 2.258e-05 [auto_monad]: 7.63e-05 [graph_reusing]: 5.78002e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00050388 [rewriter_before_opt_a]: 9.691e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.0154587, [2] [Cycle 1]: 0.0113544, [27] [switch_simplify]: 6.195e-05 [loop_unroll]: 3.129e-05 [a_1]: 0.00062181 [with_stream_mark]: 2.476e-05 [recompute_prepare]: 9.07999e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.645e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.081e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.0102071 [add_forward_monad_depend]: 1.1e-05 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 2.229e-05 [cse]: 3.636e-05 [replace_applicator]: 2.401e-05 [Cycle 2]: 0.00040234, [27] [switch_simplify]: 7.09001e-06 [loop_unroll]: 6.58003e-06 [a_1]: 0.0001293 [with_stream_mark]: 1.746e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 4.01001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.009e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 5.65001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.54999e-06 [cse]: 1.395e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.639e-05 [rewriter_after_opt_a]: 4.177e-05 [convert_after_rewriter]: 8.50001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.0006332 [jit_opt_b]: 5.936e-05, [1] [Cycle 1]: 5.137e-05, [2] [frontend_op_eliminate]: 2.134e-05 [inline_after_opt_a]: 1.875e-05 [cconv]: 3.184e-05 [loop_unroll]: 0.0004282 [jit_opt_after_cconv]: 0.00016532, [1] [Cycle 1]: 0.0001582, [11] [c_1]: 2.548e-05 [parameter_eliminate]: 2.94999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.115e-05 [call_graph_tuple_transform]: 2.373e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.638e-05 [partial_unused_args_eliminate]: 3.77998e-06 [environ_conv]: 9.67001e-06 [add_recomputation]: 5.658e-05 [cse_after_recomputation]: 2.384e-05, [1] [Cycle 1]: 1.843e-05, [1] [cse]: 1.208e-05 [auto_monad_reorder]: 1.602e-05 [get_jit_bprop_graph]: 2.08002e-06 [rewriter_after_jit_bprop_graph]: 6.73e-06 [opt_after_jit_grad]: 0.00052012 [symbol_engine_optimizer]: 0.00020441, [1] [Cycle 1]: 0.00019767, [6] [build]: 3.76001e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.731e-05 [opt_reshape]: 0.00012683 [fold_const_symbol]: 1.132e-05 [renormalize]: 4.19997e-07 [validate]: 4.878e-05 Sums bootstrap : 0.000305s : 0.11% type_inference : 0.261825s : 94.71% event_method : 0.000023s : 0.01% auto_monad : 0.000076s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000504s : 0.18% rewriter_before_opt_a : 0.000097s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.000751s : 0.27% jit_opt_a.with_stream_mark : 0.000042s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.010207s : 3.69% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000633s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000428s : 0.15% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000057s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000520s : 0.19% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000127s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.02% Time group info: ------[substitution.] 0.000252 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.95% : 0.000007s : 4: substitution.graph_param_transform 83.87% : 0.000211s : 4: substitution.inline 1.92% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000006s : 4: substitution.remove_not_recompute_node 2.46% : 0.000006s : 2: substitution.replace_old_param 4.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.261728 2 98.59% : 0.258041s : 1: type_inference.infer 1.41% : 0.003687s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.17% : 0.000053s : 4: replace.inline 30.83% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.80% : 0.000209s : 4: match.inline 5.20% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.30% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.68% : 0.000008s : 26: predicate.inline 1.09% : 0.000002s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.79% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.32% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.51% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 12: predicate.value_based_eliminate 0.51% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.020204 22 95.45% : 0.019284s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.28% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 4.27% : 0.000863s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.292198 72 0.02% : 0.000060s : 1: add_recomputation 0.03% : 0.000079s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.11% : 0.000325s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 5.29% : 0.015463s : 1: jit_opt_a 0.06% : 0.000168s : 1: jit_opt_after_cconv 0.02% : 0.000062s : 1: jit_opt_b 0.15% : 0.000437s : 1: loop_unroll 0.22% : 0.000643s : 1: mutable_eliminate 0.34% : 0.001007s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000157s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000531s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000513s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 3.19% : 0.009317s : 1: renormalize.infer 0.30% : 0.000877s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.03% : 0.000102s : 1: rewriter_before_opt_a 0.07% : 0.000207s : 1: symbol_engine_optimizer 89.61% : 0.261848s : 1: type_inference TotalTime = 0.0137938, [30] [bootstrap]: 0.00028375 [type_inference]: 0.00539022 [event_method]: 1.972e-05 [auto_monad]: 6.887e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 3.878e-05 [rewriter_before_opt_a]: 7.646e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00565911, [2] [Cycle 1]: 0.00176867, [27] [switch_simplify]: 5.285e-05 [loop_unroll]: 2.848e-05 [a_1]: 0.00053815 [with_stream_mark]: 1.924e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.251e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.27998e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 0.00081348 [add_forward_monad_depend]: 6.79999e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.551e-05 [cse]: 2.684e-05 [replace_applicator]: 1.175e-05 [Cycle 2]: 0.00032073, [27] [switch_simplify]: 5.68002e-06 [loop_unroll]: 4.90999e-06 [a_1]: 8.742e-05 [with_stream_mark]: 1.238e-05 [recompute_prepare]: 5.49998e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.353e-05 [j_node_and_user_rematch]: 7.52002e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 4.56002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 1.27999e-06 [auto_monad_eliminator]: 6.38e-06 [cse]: 1.309e-05 [replace_applicator]: 4.72998e-06 [py_interpret_to_execute_after_opt_a]: 1.46e-05 [rewriter_after_opt_a]: 3.862e-05 [convert_after_rewriter]: 6.50002e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00058045 [jit_opt_b]: 4.944e-05, [1] [Cycle 1]: 4.213e-05, [2] [frontend_op_eliminate]: 1.518e-05 [inline_after_opt_a]: 1.599e-05 [cconv]: 2.71e-05 [loop_unroll]: 0.00043595 [jit_opt_after_cconv]: 0.00015493, [1] [Cycle 1]: 0.00014814, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.88e-06 [cse]: 2.659e-05 [call_graph_tuple_transform]: 1.904e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 1.30999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 1.205e-05 [remove_dup_value]: 1.554e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 5.84e-06 [add_recomputation]: 9.78e-05 [cse_after_recomputation]: 2.539e-05, [1] [Cycle 1]: 1.947e-05, [1] [cse]: 1.39e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 6.62002e-06 [opt_after_jit_grad]: 0.00047563 [symbol_engine_optimizer]: 7.09e-05, [1] [Cycle 1]: 6.41e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 7.48e-06 [elim_not_effective]: 1.238e-05 [opt_reshape]: 5.42001e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 5.3001e-07 [validate]: 4.042e-05 Sums bootstrap : 0.000284s : 2.94% type_inference : 0.005390s : 55.82% event_method : 0.000020s : 0.20% auto_monad : 0.000069s : 0.71% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.40% rewriter_before_opt_a : 0.000076s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.61% jit_opt_a.loop_unroll : 0.000033s : 0.35% jit_opt_a.a_1 : 0.000626s : 6.48% jit_opt_a.with_stream_mark : 0.000032s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000814s : 8.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.23% jit_opt_a.cse : 0.000040s : 0.41% jit_opt_a.replace_applicator : 0.000016s : 0.17% py_interpret_to_execute_after_opt_a : 0.000015s : 0.15% rewriter_after_opt_a : 0.000039s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000580s : 6.01% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000027s : 0.28% loop_unroll : 0.000436s : 4.51% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000027s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000012s : 0.12% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000098s : 1.01% cse_after_recomputation.cse : 0.000014s : 0.14% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000476s : 4.93% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000040s : 0.42% Time group info: ------[substitution.] 0.000217 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000005s : 3: substitution.graph_param_transform 84.34% : 0.000183s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 2.08% : 0.000005s : 2: substitution.replace_old_param 5.74% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005319 2 81.59% : 0.004340s : 1: type_inference.infer 18.41% : 0.000979s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.04% : 0.000049s : 4: replace.inline 30.96% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 94.18% : 0.000181s : 4: match.inline 5.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.64% : 0.000002s : 10: predicate.accumulaten_eliminater 1.29% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.73% : 0.000008s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.75% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 2.02% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.78% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.59% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.23% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 2.98% : 0.000003s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000769 13 43.85% : 0.000337s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.69% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.45% : 0.000388s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015500 72 0.66% : 0.000102s : 1: add_recomputation 0.47% : 0.000072s : 1: auto_monad 0.14% : 0.000021s : 1: auto_monad_reorder 1.91% : 0.000296s : 1: bootstrap 0.20% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.53% : 0.005662s : 1: jit_opt_a 1.02% : 0.000157s : 1: jit_opt_after_cconv 0.34% : 0.000052s : 1: jit_opt_b 2.87% : 0.000445s : 1: loop_unroll 3.80% : 0.000589s : 1: mutable_eliminate 5.37% : 0.000833s : 26: opt.transform.jit_opt_a 0.35% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.11% : 0.000483s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000042s : 1: py_interpret_to_execute 0.11% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.68% : 0.000415s : 1: renormalize.infer 2.52% : 0.000391s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000041s : 1: rewriter_after_opt_a 0.51% : 0.000080s : 1: rewriter_before_opt_a 0.48% : 0.000074s : 1: symbol_engine_optimizer 34.91% : 0.005411s : 1: type_inference TotalTime = 0.0710136, [30] [bootstrap]: 0.00034223 [type_inference]: 0.0615396 [event_method]: 2.597e-05 [auto_monad]: 7.365e-05 [graph_reusing]: 6.83e-06 [pre_auto_parallel]: 3.09001e-06 [py_interpret_to_execute]: 0.00012042 [rewriter_before_opt_a]: 8.655e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00631804, [2] [Cycle 1]: 0.0022252, [27] [switch_simplify]: 6.641e-05 [loop_unroll]: 3.005e-05 [a_1]: 0.00058894 [with_stream_mark]: 2.427e-05 [recompute_prepare]: 7.53e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.43002e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 6.20002e-06 [renormalize]: 0.00111148 [add_forward_monad_depend]: 5.84e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.641e-05 [cse]: 7.881e-05 [replace_applicator]: 1.298e-05 [Cycle 2]: 0.00033434, [27] [switch_simplify]: 5.81998e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.003e-05 [with_stream_mark]: 1.151e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 7.39002e-06 [cse]: 1.365e-05 [replace_applicator]: 5.36998e-06 [py_interpret_to_execute_after_opt_a]: 1.444e-05 [rewriter_after_opt_a]: 3.967e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.51998e-06 [mutable_eliminate]: 0.00075765 [jit_opt_b]: 5.036e-05, [1] [Cycle 1]: 4.279e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.603e-05 [cconv]: 2.935e-05 [loop_unroll]: 0.00042674 [jit_opt_after_cconv]: 0.00020258, [1] [Cycle 1]: 0.00019618, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 6.58e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 7.373e-05 [call_graph_tuple_transform]: 2.042e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.57999e-06 [remove_dup_value]: 1.666e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 5.552e-05 [cse_after_recomputation]: 2.468e-05, [1] [Cycle 1]: 1.902e-05, [1] [cse]: 1.255e-05 [auto_monad_reorder]: 1.844e-05 [get_jit_bprop_graph]: 2.91999e-06 [rewriter_after_jit_bprop_graph]: 7.00998e-06 [opt_after_jit_grad]: 0.00050446 [symbol_engine_optimizer]: 7.887e-05, [1] [Cycle 1]: 7.179e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 7.97998e-06 [elim_not_effective]: 1.457e-05 [opt_reshape]: 7.26999e-06 [fold_const_symbol]: 9.42999e-06 [renormalize]: 3.29979e-07 [validate]: 4.472e-05 Sums bootstrap : 0.000342s : 0.51% type_inference : 0.061540s : 92.37% event_method : 0.000026s : 0.04% auto_monad : 0.000074s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000120s : 0.18% rewriter_before_opt_a : 0.000087s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000679s : 1.02% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001112s : 1.67% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000092s : 0.14% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000758s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000029s : 0.04% loop_unroll : 0.000427s : 0.64% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000074s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000504s : 0.76% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.07% Time group info: ------[substitution.] 0.000252 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000005s : 3: substitution.graph_param_transform 86.29% : 0.000218s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 4.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061449 2 65.82% : 0.040446s : 1: type_inference.infer 34.18% : 0.021003s : 1: type_inference.specialize ------[replace.] 0.000078 6 69.57% : 0.000055s : 4: replace.inline 30.43% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 95.14% : 0.000215s : 4: match.inline 4.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.24% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.42% : 0.000002s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000007s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.07% : 0.000002s : 3: predicate.mutable_eliminate 0.71% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001045 13 40.87% : 0.000427s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.98% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.15% : 0.000566s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073086 72 0.08% : 0.000058s : 1: add_recomputation 0.11% : 0.000077s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.50% : 0.000363s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.65% : 0.006322s : 1: jit_opt_a 0.28% : 0.000205s : 1: jit_opt_after_cconv 0.07% : 0.000053s : 1: jit_opt_b 0.59% : 0.000435s : 1: loop_unroll 1.05% : 0.000768s : 1: mutable_eliminate 1.25% : 0.000911s : 26: opt.transform.jit_opt_a 0.07% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000124s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.89% : 0.000653s : 1: renormalize.infer 0.61% : 0.000449s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000081s : 1: symbol_engine_optimizer 84.24% : 0.061569s : 1: type_inference TotalTime = 0.100157, [30] [bootstrap]: 0.00025152 [type_inference]: 0.0694963 [event_method]: 0.00027007 [auto_monad]: 0.00010312 [graph_reusing]: 7.06999e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 3.214e-05 [rewriter_before_opt_a]: 0.00012073 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0277517, [3] [Cycle 1]: 0.0209209, [27] [switch_simplify]: 7.399e-05 [loop_unroll]: 4.798e-05 [a_1]: 0.00097613 [with_stream_mark]: 2.585e-05 [recompute_prepare]: 2.011e-05 [updatestate_depend_eliminate]: 8.59e-06 [updatestate_assign_eliminate]: 7.28e-06 [updatestate_loads_eliminate]: 6.58003e-06 [parameter_eliminate]: 2.83998e-06 [specialize_transform]: 1.511e-05 [updatestate_useless_node_eliminater]: 1.381e-05 [accelerated_algorithm]: 1.42e-05 [meta_shard_fg_expand]: 4.05e-06 [get_grad_eliminate_]: 1.377e-05 [merge_forward]: 8.1e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.851e-05 [j_node_and_user_rematch]: 2.447e-05 [meta_fg_expand]: 0.00162473 [replace_old_param]: 6.75e-05 [inline_without_move]: 5.883e-05 [renormalize]: 0.017198 [add_forward_monad_depend]: 1.291e-05 [auto_monad_grad]: 7.45e-06 [auto_monad_eliminator]: 6.379e-05 [cse]: 0.00026286 [replace_applicator]: 9.061e-05 [Cycle 2]: 0.00341682, [27] [switch_simplify]: 4.391e-05 [loop_unroll]: 4.143e-05 [a_1]: 0.00124124 [with_stream_mark]: 1.783e-05 [recompute_prepare]: 9.79999e-06 [updatestate_depend_eliminate]: 4.96997e-06 [updatestate_assign_eliminate]: 3.90998e-06 [updatestate_loads_eliminate]: 3.71999e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.38998e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 4.46002e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.751e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 0.00010419 [replace_old_param]: 9.10999e-06 [inline_without_move]: 6.50997e-06 [renormalize]: 0.00164777 [add_forward_monad_depend]: 5.29e-06 [auto_monad_grad]: 1.81003e-06 [auto_monad_eliminator]: 1.064e-05 [cse]: 1.985e-05 [replace_applicator]: 1.156e-05 [Cycle 3]: 0.00023898, [27] [switch_simplify]: 4.27e-06 [loop_unroll]: 3.58999e-06 [a_1]: 3.777e-05 [with_stream_mark]: 7.98999e-06 [recompute_prepare]: 3.5e-06 [updatestate_depend_eliminate]: 2.13002e-06 [updatestate_assign_eliminate]: 1.57001e-06 [updatestate_loads_eliminate]: 1.52001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 3.5e-06 [updatestate_useless_node_eliminater]: 3.28998e-06 [accelerated_algorithm]: 3.28e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 3.25e-06 [merge_forward]: 2.12001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.007e-05 [j_node_and_user_rematch]: 5.30001e-06 [meta_fg_expand]: 1.12e-06 [replace_old_param]: 3.16001e-06 [inline_without_move]: 2.89999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 3.23e-06 [cse]: 8.43999e-06 [replace_applicator]: 3.79002e-06 [py_interpret_to_execute_after_opt_a]: 1.101e-05 [rewriter_after_opt_a]: 3.319e-05 [convert_after_rewriter]: 6.12999e-06 [order_py_execute_after_rewriter]: 4.66002e-06 [mutable_eliminate]: 0.000662 [jit_opt_b]: 3.962e-05, [1] [Cycle 1]: 3.254e-05, [2] [frontend_op_eliminate]: 9.91998e-06 [inline_after_opt_a]: 1.168e-05 [cconv]: 2.435e-05 [loop_unroll]: 0.00041152 [jit_opt_after_cconv]: 0.00011814, [1] [Cycle 1]: 0.00011166, [11] [c_1]: 1.213e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 1.69998e-06 [updatestate_loads_eliminate]: 1.57001e-06 [cse]: 1.432e-05 [call_graph_tuple_transform]: 1.225e-05 [tuple_list_get_item_eliminator]: 3.80998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 5.20027e-07 [switch_simplify]: 3.75e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 5.17e-06 [add_recomputation]: 4.715e-05 [cse_after_recomputation]: 2.101e-05, [1] [Cycle 1]: 1.545e-05, [1] [cse]: 9.05001e-06 [auto_monad_reorder]: 1.331e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.18001e-06 [opt_after_jit_grad]: 0.00042735 [symbol_engine_optimizer]: 6.23e-05, [1] [Cycle 1]: 5.655e-05, [6] [build]: 2.78998e-06 [elim_shapecalc]: 5.20999e-06 [elim_not_effective]: 9.05999e-06 [opt_reshape]: 3.91999e-06 [fold_const_symbol]: 5.94e-06 [renormalize]: 3.80009e-07 [validate]: 2.917e-05 Sums bootstrap : 0.000252s : 0.26% type_inference : 0.069496s : 72.28% event_method : 0.000270s : 0.28% auto_monad : 0.000103s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000032s : 0.03% rewriter_before_opt_a : 0.000121s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000122s : 0.13% jit_opt_a.loop_unroll : 0.000093s : 0.10% jit_opt_a.a_1 : 0.002255s : 2.35% jit_opt_a.with_stream_mark : 0.000052s : 0.05% jit_opt_a.recompute_prepare : 0.000033s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000015s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.04% jit_opt_a.meta_fg_expand : 0.001730s : 1.80% jit_opt_a.replace_old_param : 0.000080s : 0.08% jit_opt_a.inline_without_move : 0.000068s : 0.07% jit_opt_a.renormalize : 0.018846s : 19.60% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000078s : 0.08% jit_opt_a.cse : 0.000291s : 0.30% jit_opt_a.replace_applicator : 0.000106s : 0.11% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000662s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000024s : 0.03% loop_unroll : 0.000412s : 0.43% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000014s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000012s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000047s : 0.05% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000427s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.03% Time group info: ------[substitution.] 0.000616 104 0.23% : 0.000001s : 1: substitution.elim_not_effective 0.20% : 0.000001s : 1: substitution.fold_const_symbol 0.58% : 0.000004s : 1: substitution.graph_param_transform 69.64% : 0.000429s : 13: substitution.inline 2.61% : 0.000016s : 2: substitution.inline_without_move 1.42% : 0.000009s : 12: substitution.j_node_and_user_rematch 1.92% : 0.000012s : 7: substitution.minmaximum_grad 1.11% : 0.000007s : 5: substitution.partial_eliminate 1.60% : 0.000010s : 12: substitution.remove_not_recompute_node 4.97% : 0.000031s : 10: substitution.replace_applicator 1.05% : 0.000006s : 10: substitution.replace_old_param 0.39% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.94% : 0.000006s : 1: substitution.tile_eliminate 3.74% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.51% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.08% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069404 2 94.80% : 0.065797s : 1: type_inference.infer 5.20% : 0.003607s : 1: type_inference.specialize ------[replace.] 0.000181 20 65.82% : 0.000119s : 13: replace.inline 34.18% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000443 20 95.00% : 0.000421s : 13: match.inline 5.00% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000374 2656 1.58% : 0.000006s : 46: predicate.accumulaten_eliminater 0.26% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.48% : 0.000006s : 46: predicate.addn_check_dump 1.75% : 0.000007s : 46: predicate.addn_zero_filter 2.00% : 0.000007s : 46: predicate.arithmetic_simplify 1.74% : 0.000007s : 46: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.44% : 0.000005s : 46: predicate.compare_switch_simplify 1.50% : 0.000006s : 46: predicate.depend_value_elim 1.47% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 46: predicate.environ_get_depend_swap 1.49% : 0.000006s : 46: predicate.environ_get_eliminate 1.42% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.77% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.37% : 0.000016s : 68: predicate.inline 1.99% : 0.000007s : 46: predicate.inline_without_move 0.37% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.88% : 0.000003s : 18: predicate.less_batch_normalization 1.93% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 54: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.59% : 0.000013s : 99: predicate.loop_unroll_before_grad 1.85% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.48% : 0.000006s : 46: predicate.merge_addn 1.56% : 0.000006s : 46: predicate.minmaximum_grad 0.32% : 0.000001s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000009s : 54: predicate.partial_eliminate 1.58% : 0.000006s : 46: predicate.print_const_string_wrapper 1.91% : 0.000007s : 46: predicate.reduce_eliminate 1.79% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 18: predicate.remove_not_recompute_node 3.04% : 0.000011s : 99: predicate.replace_applicator 1.15% : 0.000004s : 46: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 46: predicate.reshape_eliminate 1.57% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.49% : 0.000006s : 46: predicate.same_eliminate 0.46% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 18: predicate.specialize_transform 1.80% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.80% : 0.000010s : 66: predicate.switch_defer_inline 2.51% : 0.000009s : 66: predicate.switch_layer_defer_inline 6.67% : 0.000025s : 166: predicate.switch_simplify 1.57% : 0.000006s : 46: predicate.tile_eliminate 1.49% : 0.000006s : 46: predicate.transpose_eliminate 2.06% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.87% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.86% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.74% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.86% : 0.000007s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003861 52 80.12% : 0.003093s : 35: func_graph_cloner_run.FuncGraphClonerGraph 19.88% : 0.000768s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121903 87 0.04% : 0.000050s : 1: add_recomputation 0.09% : 0.000109s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.22% : 0.000272s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.23% : 0.000277s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.77% : 0.027755s : 1: jit_opt_a 0.10% : 0.000121s : 1: jit_opt_after_cconv 0.03% : 0.000042s : 1: jit_opt_b 0.34% : 0.000419s : 1: loop_unroll 0.55% : 0.000671s : 1: mutable_eliminate 2.38% : 0.002901s : 39: opt.transform.jit_opt_a 0.02% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000010s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000021s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000435s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000035s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 13.73% : 0.016735s : 2: renormalize.infer 1.72% : 0.002092s : 2: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.10% : 0.000124s : 1: rewriter_before_opt_a 0.05% : 0.000065s : 1: symbol_engine_optimizer 57.02% : 0.069513s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.169.502 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cd30> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.170.052 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0305649, [30] [bootstrap]: 0.00023514 [type_inference]: 0.0143978 [event_method]: 5.578e-05 [auto_monad]: 0.00010174 [graph_reusing]: 7.44002e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 2.712e-05 [rewriter_before_opt_a]: 0.0001048 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.0135101, [3] [Cycle 1]: 0.00670656, [27] [switch_simplify]: 6.717e-05 [loop_unroll]: 4.192e-05 [a_1]: 0.00093573 [with_stream_mark]: 2.905e-05 [recompute_prepare]: 1.876e-05 [updatestate_depend_eliminate]: 8.33999e-06 [updatestate_assign_eliminate]: 6.74999e-06 [updatestate_loads_eliminate]: 6.39001e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 1.374e-05 [updatestate_useless_node_eliminater]: 1.232e-05 [accelerated_algorithm]: 1.227e-05 [meta_shard_fg_expand]: 3.3e-06 [get_grad_eliminate_]: 1.238e-05 [merge_forward]: 8.54e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.672e-05 [j_node_and_user_rematch]: 2.344e-05 [meta_fg_expand]: 0.00160014 [replace_old_param]: 6.11e-05 [inline_without_move]: 5.489e-05 [renormalize]: 0.00316995 [add_forward_monad_depend]: 1.147e-05 [auto_monad_grad]: 5.98002e-06 [auto_monad_eliminator]: 5.692e-05 [cse]: 0.0002085 [replace_applicator]: 7.569e-05 [Cycle 2]: 0.00336679, [27] [switch_simplify]: 4.018e-05 [loop_unroll]: 3.936e-05 [a_1]: 0.00112377 [with_stream_mark]: 1.579e-05 [recompute_prepare]: 9.96998e-06 [updatestate_depend_eliminate]: 5.57999e-06 [updatestate_assign_eliminate]: 4.11001e-06 [updatestate_loads_eliminate]: 3.72002e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 8.88002e-06 [updatestate_useless_node_eliminater]: 8.28001e-06 [accelerated_algorithm]: 8.13999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 7.85998e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.865e-05 [j_node_and_user_rematch]: 1.304e-05 [meta_fg_expand]: 8.859e-05 [replace_old_param]: 9.11998e-06 [inline_without_move]: 7.78001e-06 [renormalize]: 0.0017281 [add_forward_monad_depend]: 5.69e-06 [auto_monad_grad]: 1.68002e-06 [auto_monad_eliminator]: 1.09e-05 [cse]: 2.082e-05 [replace_applicator]: 1.238e-05 [Cycle 3]: 0.00024168, [27] [switch_simplify]: 4.67e-06 [loop_unroll]: 3.49001e-06 [a_1]: 3.699e-05 [with_stream_mark]: 9.12001e-06 [recompute_prepare]: 3.42002e-06 [updatestate_depend_eliminate]: 2.15002e-06 [updatestate_assign_eliminate]: 1.86998e-06 [updatestate_loads_eliminate]: 1.42e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 3.41001e-06 [updatestate_useless_node_eliminater]: 3.12002e-06 [accelerated_algorithm]: 3.39001e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 3.11999e-06 [merge_forward]: 2.34001e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.77999e-06 [j_node_and_user_rematch]: 5.86998e-06 [meta_fg_expand]: 1.18001e-06 [replace_old_param]: 3.05998e-06 [inline_without_move]: 2.98e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 3.46001e-06 [cse]: 9.24e-06 [replace_applicator]: 3.59002e-06 [py_interpret_to_execute_after_opt_a]: 1.164e-05 [rewriter_after_opt_a]: 3.206e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 4.27e-06 [mutable_eliminate]: 0.00066933 [jit_opt_b]: 3.954e-05, [1] [Cycle 1]: 3.242e-05, [2] [frontend_op_eliminate]: 9.51998e-06 [inline_after_opt_a]: 1.091e-05 [cconv]: 2.424e-05 [loop_unroll]: 0.00040361 [jit_opt_after_cconv]: 0.000122, [1] [Cycle 1]: 0.00011576, [11] [c_1]: 1.166e-05 [parameter_eliminate]: 2.21998e-06 [updatestate_depend_eliminate]: 4.72998e-06 [updatestate_assign_eliminate]: 1.64e-06 [updatestate_loads_eliminate]: 1.53002e-06 [cse]: 1.694e-05 [call_graph_tuple_transform]: 1.394e-05 [tuple_list_get_item_eliminator]: 3.57997e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 4.23001e-06 [remove_dup_value]: 2.29e-05 [partial_unused_args_eliminate]: 2.48998e-06 [environ_conv]: 5.92999e-06 [add_recomputation]: 3.364e-05 [cse_after_recomputation]: 2.102e-05, [1] [Cycle 1]: 1.518e-05, [1] [cse]: 8.99998e-06 [auto_monad_reorder]: 1.342e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 4.82998e-06 [opt_after_jit_grad]: 0.0004265 [symbol_engine_optimizer]: 6.597e-05, [1] [Cycle 1]: 5.964e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 6.04999e-06 [elim_not_effective]: 1.034e-05 [opt_reshape]: 4.25e-06 [fold_const_symbol]: 6.02999e-06 [renormalize]: 4.2998e-07 [validate]: 2.911e-05 Sums bootstrap : 0.000235s : 0.89% type_inference : 0.014398s : 54.22% event_method : 0.000056s : 0.21% auto_monad : 0.000102s : 0.38% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000027s : 0.10% rewriter_before_opt_a : 0.000105s : 0.39% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000112s : 0.42% jit_opt_a.loop_unroll : 0.000085s : 0.32% jit_opt_a.a_1 : 0.002096s : 7.90% jit_opt_a.with_stream_mark : 0.000054s : 0.20% jit_opt_a.recompute_prepare : 0.000032s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.09% jit_opt_a.accelerated_algorithm : 0.000024s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.09% jit_opt_a.merge_forward : 0.000015s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000055s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.16% jit_opt_a.meta_fg_expand : 0.001690s : 6.36% jit_opt_a.replace_old_param : 0.000073s : 0.28% jit_opt_a.inline_without_move : 0.000066s : 0.25% jit_opt_a.renormalize : 0.004898s : 18.45% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.07% jit_opt_a.auto_monad_grad : 0.000008s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000071s : 0.27% jit_opt_a.cse : 0.000239s : 0.90% jit_opt_a.replace_applicator : 0.000092s : 0.35% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000032s : 0.12% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000004s : 0.02% mutable_eliminate : 0.000669s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.04% jit_opt_b.inline_after_opt_a : 0.000011s : 0.04% cconv : 0.000024s : 0.09% loop_unroll : 0.000404s : 1.52% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000017s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.02% remove_dup_value : 0.000023s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000034s : 0.13% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000013s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000426s : 1.61% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.11% Time group info: ------[substitution.] 0.000510 105 0.31% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.90% : 0.000005s : 1: substitution.graph_param_transform 63.09% : 0.000322s : 13: substitution.inline 3.34% : 0.000017s : 2: substitution.inline_without_move 1.95% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.25% : 0.000012s : 7: substitution.minmaximum_grad 1.52% : 0.000008s : 5: substitution.partial_eliminate 2.10% : 0.000011s : 13: substitution.remove_not_recompute_node 5.39% : 0.000027s : 10: substitution.replace_applicator 1.12% : 0.000006s : 8: substitution.replace_old_param 1.34% : 0.000007s : 1: substitution.reshape_eliminate 0.52% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.94% : 0.000005s : 1: substitution.tile_eliminate 4.04% : 0.000021s : 7: substitution.tuple_list_convert_item_index_to_positive 2.90% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 8.11% : 0.000041s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014316 2 91.66% : 0.013122s : 1: type_inference.infer 8.34% : 0.001194s : 1: type_inference.specialize ------[replace.] 0.000162 20 66.66% : 0.000108s : 13: replace.inline 33.34% : 0.000054s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000336 20 93.60% : 0.000315s : 13: match.inline 6.40% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000363 2537 1.54% : 0.000006s : 44: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.50% : 0.000005s : 44: predicate.addn_check_dump 1.56% : 0.000006s : 44: predicate.addn_zero_filter 1.97% : 0.000007s : 44: predicate.arithmetic_simplify 1.59% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.47% : 0.000005s : 44: predicate.compare_switch_simplify 1.53% : 0.000006s : 44: predicate.depend_value_elim 1.53% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.60% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.60% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.47% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.52% : 0.000006s : 44: predicate.environ_get_depend_swap 1.55% : 0.000006s : 44: predicate.environ_get_eliminate 1.47% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.86% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.25% : 0.000015s : 66: predicate.inline 1.97% : 0.000007s : 42: predicate.inline_without_move 0.36% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.95% : 0.000003s : 18: predicate.less_batch_normalization 1.81% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 2.09% : 0.000008s : 52: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.55% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.66% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.45% : 0.000005s : 44: predicate.merge_addn 1.56% : 0.000006s : 44: predicate.minmaximum_grad 0.41% : 0.000001s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.38% : 0.000009s : 52: predicate.partial_eliminate 1.72% : 0.000006s : 44: predicate.print_const_string_wrapper 1.99% : 0.000007s : 44: predicate.reduce_eliminate 1.82% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 18: predicate.remove_not_recompute_node 2.57% : 0.000009s : 94: predicate.replace_applicator 1.05% : 0.000004s : 42: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 44: predicate.reshape_eliminate 1.54% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 1: predicate.row_tensor_eliminate 1.55% : 0.000006s : 44: predicate.same_eliminate 0.46% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.86% : 0.000003s : 18: predicate.specialize_transform 1.73% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000005s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.81% : 0.000010s : 64: predicate.switch_defer_inline 2.59% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.83% : 0.000025s : 154: predicate.switch_simplify 1.62% : 0.000006s : 44: predicate.tile_eliminate 1.54% : 0.000006s : 44: predicate.transpose_eliminate 1.89% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.11% : 0.000011s : 53: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.87% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.78% : 0.000006s : 52: predicate.updatestate_pure_node_eliminater 2.80% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 2.11% : 0.000008s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001750 32 61.18% : 0.001071s : 15: func_graph_cloner_run.FuncGraphClonerGraph 38.82% : 0.000679s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038172 87 0.10% : 0.000036s : 1: add_recomputation 0.28% : 0.000106s : 1: auto_monad 0.04% : 0.000016s : 1: auto_monad_reorder 0.68% : 0.000258s : 1: bootstrap 0.07% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.16% : 0.000061s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 35.40% : 0.013513s : 1: jit_opt_a 0.33% : 0.000124s : 1: jit_opt_after_cconv 0.11% : 0.000042s : 1: jit_opt_b 1.08% : 0.000411s : 1: loop_unroll 1.77% : 0.000677s : 1: mutable_eliminate 7.09% : 0.002706s : 39: opt.transform.jit_opt_a 0.08% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000014s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000010s : 1: opt.transform.mutable_eliminate 0.04% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000024s : 4: opt.transform.symbol_engine_opt 1.14% : 0.000434s : 1: opt_after_jit_grad 0.02% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.08% : 0.000030s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000025s : 1: remove_dup_value 8.43% : 0.003219s : 2: renormalize.infer 4.36% : 0.001663s : 2: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000035s : 1: rewriter_after_opt_a 0.28% : 0.000108s : 1: rewriter_before_opt_a 0.18% : 0.000069s : 1: symbol_engine_optimizer 37.77% : 0.014416s : 1: type_inference TotalTime = 0.0656699, [30] [bootstrap]: 0.00031926 [type_inference]: 0.033532 [event_method]: 2.026e-05 [auto_monad]: 6.907e-05 [graph_reusing]: 6.18998e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00010154 [rewriter_before_opt_a]: 8.603e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.0287462, [2] [Cycle 1]: 0.00222562, [27] [switch_simplify]: 7.034e-05 [loop_unroll]: 2.976e-05 [a_1]: 0.00062791 [with_stream_mark]: 2.678e-05 [recompute_prepare]: 9.51e-06 [updatestate_depend_eliminate]: 5.03002e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.73002e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.628e-05 [j_node_and_user_rematch]: 9.38002e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.01998e-06 [renormalize]: 0.00108744 [add_forward_monad_depend]: 8.1e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.817e-05 [cse]: 3.858e-05 [replace_applicator]: 1.759e-05 [Cycle 2]: 0.00032727, [27] [switch_simplify]: 5.54e-06 [loop_unroll]: 4.91002e-06 [a_1]: 8.845e-05 [with_stream_mark]: 1.317e-05 [recompute_prepare]: 5.13002e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.25999e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.29001e-06 [cell_reuse_recompute_pass]: 1.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 6.25002e-06 [cse]: 1.29e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.58e-05 [rewriter_after_opt_a]: 4.174e-05 [convert_after_rewriter]: 6.90002e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00081321 [jit_opt_b]: 7.749e-05, [1] [Cycle 1]: 5.355e-05, [2] [frontend_op_eliminate]: 1.792e-05 [inline_after_opt_a]: 2.257e-05 [cconv]: 3.944e-05 [loop_unroll]: 0.000572 [jit_opt_after_cconv]: 0.00018002, [1] [Cycle 1]: 0.00017205, [11] [c_1]: 2.246e-05 [parameter_eliminate]: 5.94999e-06 [updatestate_depend_eliminate]: 1.066e-05 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.80997e-06 [cse]: 3.644e-05 [call_graph_tuple_transform]: 2.555e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.76003e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 6.63e-06 [remove_dup_value]: 1.852e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 8.06001e-06 [add_recomputation]: 5.769e-05 [cse_after_recomputation]: 6.067e-05, [1] [Cycle 1]: 2.123e-05, [1] [cse]: 1.501e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 1.071e-05 [opt_after_jit_grad]: 0.00053424 [symbol_engine_optimizer]: 7.79e-05, [1] [Cycle 1]: 6.955e-05, [6] [build]: 2.98e-06 [elim_shapecalc]: 8.26002e-06 [elim_not_effective]: 1.489e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 8.82999e-06 [renormalize]: 2.69996e-07 [validate]: 4.4e-05 Sums bootstrap : 0.000319s : 0.82% type_inference : 0.033532s : 86.44% event_method : 0.000020s : 0.05% auto_monad : 0.000069s : 0.18% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.26% rewriter_before_opt_a : 0.000086s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.20% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000716s : 1.85% jit_opt_a.with_stream_mark : 0.000040s : 0.10% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001088s : 2.80% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000051s : 0.13% jit_opt_a.replace_applicator : 0.000023s : 0.06% py_interpret_to_execute_after_opt_a : 0.000016s : 0.04% rewriter_after_opt_a : 0.000042s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000813s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000023s : 0.06% cconv : 0.000039s : 0.10% loop_unroll : 0.000572s : 1.47% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000058s : 0.15% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.03% opt_after_jit_grad : 0.000534s : 1.38% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.11% Time group info: ------[substitution.] 0.000282 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 86.52% : 0.000244s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.88% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033458 2 95.59% : 0.031983s : 1: type_inference.infer 4.41% : 0.001475s : 1: type_inference.specialize ------[replace.] 0.000080 6 69.80% : 0.000056s : 4: replace.inline 30.20% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 6 95.11% : 0.000242s : 4: match.inline 4.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.54% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.89% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000007s : 22: predicate.inline 1.17% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.37% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.47% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.73% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.28% : 0.000010s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000936 13 48.01% : 0.000449s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.53% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.46% : 0.000426s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067795 72 0.09% : 0.000061s : 1: add_recomputation 0.11% : 0.000072s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.50% : 0.000340s : 1: bootstrap 0.06% : 0.000042s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000063s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 42.41% : 0.028750s : 1: jit_opt_a 0.27% : 0.000183s : 1: jit_opt_after_cconv 0.12% : 0.000080s : 1: jit_opt_b 0.86% : 0.000583s : 1: loop_unroll 1.22% : 0.000829s : 1: mutable_eliminate 1.41% : 0.000954s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000031s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000542s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000105s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.93% : 0.000628s : 1: renormalize.infer 0.66% : 0.000450s : 1: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000045s : 1: rewriter_after_opt_a 0.13% : 0.000091s : 1: rewriter_before_opt_a 0.12% : 0.000080s : 1: symbol_engine_optimizer 49.49% : 0.033552s : 1: type_inference TotalTime = 0.288045, [30] [bootstrap]: 0.00033064 [type_inference]: 0.260011 [event_method]: 2.64e-05 [auto_monad]: 8.618e-05 [graph_reusing]: 7.21001e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00062297 [rewriter_before_opt_a]: 0.00011074 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0238602, [2] [Cycle 1]: 0.00839088, [27] [switch_simplify]: 9.413e-05 [loop_unroll]: 3.808e-05 [a_1]: 0.00099113 [with_stream_mark]: 2.695e-05 [recompute_prepare]: 1.168e-05 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 8.54e-06 [updatestate_useless_node_eliminater]: 7e-06 [accelerated_algorithm]: 8.43999e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 7.76001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.063e-05 [j_node_and_user_rematch]: 1.371e-05 [meta_fg_expand]: 3.02002e-06 [replace_old_param]: 1.38e-05 [inline_without_move]: 7.88999e-06 [renormalize]: 0.00675641 [add_forward_monad_depend]: 8.40999e-06 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 2.281e-05 [cse]: 4.259e-05 [replace_applicator]: 2.756e-05 [Cycle 2]: 0.00050769, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.79999e-06 [a_1]: 0.00020553 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 7.23e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 6.56999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 7.16001e-06 [meta_shard_fg_expand]: 2.76999e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 4.49002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.643e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 3.18e-06 [replace_old_param]: 1.086e-05 [inline_without_move]: 6.35002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.90001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 7.95e-06 [cse]: 1.836e-05 [replace_applicator]: 6.61999e-06 [py_interpret_to_execute_after_opt_a]: 1.561e-05 [rewriter_after_opt_a]: 5.264e-05 [convert_after_rewriter]: 7.59002e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.00081339 [jit_opt_b]: 6.587e-05, [1] [Cycle 1]: 5.662e-05, [2] [frontend_op_eliminate]: 2.296e-05 [inline_after_opt_a]: 2.127e-05 [cconv]: 3.125e-05 [loop_unroll]: 0.00048247 [jit_opt_after_cconv]: 0.00019017, [1] [Cycle 1]: 0.00018304, [11] [c_1]: 2.939e-05 [parameter_eliminate]: 4.25999e-06 [updatestate_depend_eliminate]: 9.97999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 3.659e-05 [call_graph_tuple_transform]: 2.782e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.922e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 1.149e-05 [add_recomputation]: 5.902e-05 [cse_after_recomputation]: 2.908e-05, [1] [Cycle 1]: 2.187e-05, [1] [cse]: 1.428e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 8.04002e-06 [opt_after_jit_grad]: 0.00054128 [symbol_engine_optimizer]: 8.839e-05, [1] [Cycle 1]: 8.111e-05, [6] [build]: 5.14998e-06 [elim_shapecalc]: 1.009e-05 [elim_not_effective]: 1.727e-05 [opt_reshape]: 6.59001e-06 [fold_const_symbol]: 1.069e-05 [renormalize]: 7.30011e-07 [validate]: 0.00031048 Sums bootstrap : 0.000331s : 0.12% type_inference : 0.260011s : 95.48% event_method : 0.000026s : 0.01% auto_monad : 0.000086s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000623s : 0.23% rewriter_before_opt_a : 0.000111s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000102s : 0.04% jit_opt_a.loop_unroll : 0.000045s : 0.02% jit_opt_a.a_1 : 0.001197s : 0.44% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.006756s : 2.48% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000061s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000053s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000813s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000482s : 0.18% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000059s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000541s : 0.20% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000310s : 0.11% Time group info: ------[substitution.] 0.000467 28 0.82% : 0.000004s : 2: substitution.elim_not_effective 0.24% : 0.000001s : 2: substitution.fold_const_symbol 1.32% : 0.000006s : 4: substitution.graph_param_transform 86.74% : 0.000405s : 5: substitution.inline 1.20% : 0.000006s : 4: substitution.j_node_and_user_rematch 3.65% : 0.000017s : 3: substitution.reduce_eliminate 1.24% : 0.000006s : 4: substitution.remove_not_recompute_node 1.61% : 0.000008s : 2: substitution.replace_old_param 3.18% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.259892 2 98.39% : 0.255717s : 1: type_inference.infer 1.61% : 0.004174s : 1: type_inference.specialize ------[replace.] 0.000144 7 66.66% : 0.000096s : 5: replace.inline 33.34% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000415 7 96.86% : 0.000402s : 5: match.inline 3.14% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000173 886 1.06% : 0.000002s : 13: predicate.accumulaten_eliminater 1.40% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 2.36% : 0.000004s : 13: predicate.arithmetic_simplify 1.51% : 0.000003s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.06% : 0.000002s : 13: predicate.depend_value_elim 0.95% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.18% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.63% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.66% : 0.000003s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 5.23% : 0.000009s : 28: predicate.inline 1.05% : 0.000002s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.69% : 0.000003s : 8: predicate.less_batch_normalization 2.08% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 1.54% : 0.000003s : 19: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.91% : 0.000002s : 13: predicate.merge_addn 0.98% : 0.000002s : 13: predicate.minmaximum_grad 1.52% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 0.99% : 0.000002s : 13: predicate.print_const_string_wrapper 2.53% : 0.000004s : 13: predicate.reduce_eliminate 1.61% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.10% : 0.000002s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.65% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 20: predicate.switch_defer_inline 1.95% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000012s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 2.35% : 0.000004s : 15: predicate.tuple_to_list_eliminator_ 1.36% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.34% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003601 25 55.87% : 0.002012s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.10% : 0.000112s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.02% : 0.001477s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.296129 72 0.02% : 0.000063s : 1: add_recomputation 0.03% : 0.000090s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000350s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 8.06% : 0.023864s : 1: jit_opt_a 0.07% : 0.000193s : 1: jit_opt_after_cconv 0.02% : 0.000068s : 1: jit_opt_b 0.17% : 0.000493s : 1: loop_unroll 0.28% : 0.000824s : 1: mutable_eliminate 0.51% : 0.001516s : 26: opt.transform.jit_opt_a 0.02% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000551s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000632s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.78% : 0.005257s : 1: renormalize.infer 0.50% : 0.001484s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000056s : 1: rewriter_after_opt_a 0.04% : 0.000115s : 1: rewriter_before_opt_a 0.03% : 0.000091s : 1: symbol_engine_optimizer 87.81% : 0.260038s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.242.270 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00651f0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.242.913 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0411913, [30] [bootstrap]: 0.00023914 [type_inference]: 0.0147107 [event_method]: 5.71e-05 [auto_monad]: 9.896e-05 [graph_reusing]: 6.78998e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 2.976e-05 [rewriter_before_opt_a]: 0.00011817 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.0215515, [3] [Cycle 1]: 0.0136307, [27] [switch_simplify]: 7.32e-05 [loop_unroll]: 4.307e-05 [a_1]: 0.00093269 [with_stream_mark]: 3.179e-05 [recompute_prepare]: 1.864e-05 [updatestate_depend_eliminate]: 8.90999e-06 [updatestate_assign_eliminate]: 6.81001e-06 [updatestate_loads_eliminate]: 6.59999e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 1.366e-05 [updatestate_useless_node_eliminater]: 1.253e-05 [accelerated_algorithm]: 1.303e-05 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 1.282e-05 [merge_forward]: 9.69999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.691e-05 [j_node_and_user_rematch]: 2.496e-05 [meta_fg_expand]: 0.00177593 [replace_old_param]: 6.546e-05 [inline_without_move]: 5.696e-05 [renormalize]: 0.00983604 [add_forward_monad_depend]: 1.284e-05 [auto_monad_grad]: 6.34999e-06 [auto_monad_eliminator]: 6.274e-05 [cse]: 0.0002415 [replace_applicator]: 8.521e-05 [Cycle 2]: 0.00335264, [27] [switch_simplify]: 3.976e-05 [loop_unroll]: 3.85e-05 [a_1]: 0.00117544 [with_stream_mark]: 1.92e-05 [recompute_prepare]: 9.26002e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.67002e-06 [updatestate_loads_eliminate]: 3.83999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 7.25e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.65998e-06 [merge_forward]: 5.00999e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 1.077e-05 [meta_fg_expand]: 0.00010629 [replace_old_param]: 8.65999e-06 [inline_without_move]: 6.34001e-06 [renormalize]: 0.0016256 [add_forward_monad_depend]: 8.90001e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.436e-05 [cse]: 2.483e-05 [replace_applicator]: 1.639e-05 [Cycle 3]: 0.00025658, [27] [switch_simplify]: 4.35e-06 [loop_unroll]: 3.37002e-06 [a_1]: 4.046e-05 [with_stream_mark]: 1.311e-05 [recompute_prepare]: 3.41999e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 1.91e-06 [updatestate_loads_eliminate]: 1.83997e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 3.53999e-06 [updatestate_useless_node_eliminater]: 3.26001e-06 [accelerated_algorithm]: 3.84002e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 3.26999e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.266e-05 [j_node_and_user_rematch]: 6.33e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 3.01001e-06 [inline_without_move]: 2.89999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 3.65998e-06 [cse]: 7.9e-06 [replace_applicator]: 3.25e-06 [py_interpret_to_execute_after_opt_a]: 1.319e-05 [rewriter_after_opt_a]: 3.544e-05 [convert_after_rewriter]: 6.28998e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00071403 [jit_opt_b]: 4.284e-05, [1] [Cycle 1]: 3.533e-05, [2] [frontend_op_eliminate]: 1.005e-05 [inline_after_opt_a]: 1.288e-05 [cconv]: 2.842e-05 [loop_unroll]: 0.00225806 [jit_opt_after_cconv]: 0.00018595, [1] [Cycle 1]: 0.00017468, [11] [c_1]: 2.54e-05 [parameter_eliminate]: 7.30003e-06 [updatestate_depend_eliminate]: 1.06e-05 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 3.836e-05 [call_graph_tuple_transform]: 2.025e-05 [tuple_list_get_item_eliminator]: 4.00998e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 3.43e-06 [remove_dup_value]: 1.782e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 6.89001e-06 [add_recomputation]: 4.21e-05 [cse_after_recomputation]: 2.145e-05, [1] [Cycle 1]: 1.541e-05, [1] [cse]: 8.54e-06 [auto_monad_reorder]: 1.411e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 9.73998e-06 [opt_after_jit_grad]: 0.00062245 [symbol_engine_optimizer]: 7.525e-05, [1] [Cycle 1]: 6.874e-05, [6] [build]: 4.62e-06 [elim_shapecalc]: 7.23e-06 [elim_not_effective]: 1.233e-05 [opt_reshape]: 5.22e-06 [fold_const_symbol]: 7.33999e-06 [renormalize]: 2.60014e-07 [validate]: 4.199e-05 Sums bootstrap : 0.000239s : 0.66% type_inference : 0.014711s : 40.90% event_method : 0.000057s : 0.16% auto_monad : 0.000099s : 0.28% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000030s : 0.08% rewriter_before_opt_a : 0.000118s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000117s : 0.33% jit_opt_a.loop_unroll : 0.000085s : 0.24% jit_opt_a.a_1 : 0.002149s : 5.97% jit_opt_a.with_stream_mark : 0.000064s : 0.18% jit_opt_a.recompute_prepare : 0.000031s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000024s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.06% jit_opt_a.accelerated_algorithm : 0.000024s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000018s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000055s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.12% jit_opt_a.meta_fg_expand : 0.001884s : 5.24% jit_opt_a.replace_old_param : 0.000077s : 0.21% jit_opt_a.inline_without_move : 0.000066s : 0.18% jit_opt_a.renormalize : 0.011462s : 31.87% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.06% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.22% jit_opt_a.cse : 0.000274s : 0.76% jit_opt_a.replace_applicator : 0.000105s : 0.29% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000035s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000714s : 1.99% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000013s : 0.04% cconv : 0.000028s : 0.08% loop_unroll : 0.002258s : 6.28% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.01% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000042s : 0.12% cse_after_recomputation.cse : 0.000009s : 0.02% auto_monad_reorder : 0.000014s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000622s : 1.73% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.12% Time group info: ------[substitution.] 0.000560 104 0.34% : 0.000002s : 1: substitution.elim_not_effective 0.27% : 0.000001s : 1: substitution.fold_const_symbol 0.96% : 0.000005s : 1: substitution.graph_param_transform 65.27% : 0.000366s : 13: substitution.inline 2.86% : 0.000016s : 2: substitution.inline_without_move 1.70% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.10% : 0.000012s : 7: substitution.minmaximum_grad 1.30% : 0.000007s : 5: substitution.partial_eliminate 1.86% : 0.000010s : 12: substitution.remove_not_recompute_node 5.38% : 0.000030s : 10: substitution.replace_applicator 1.23% : 0.000007s : 10: substitution.replace_old_param 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000006s : 1: substitution.tile_eliminate 4.25% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 3.02% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.95% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014627 2 90.41% : 0.013225s : 1: type_inference.infer 9.59% : 0.001402s : 1: type_inference.specialize ------[replace.] 0.000185 20 65.47% : 0.000121s : 13: replace.inline 34.53% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000380 20 94.10% : 0.000358s : 13: match.inline 5.90% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000371 2433 1.55% : 0.000006s : 42: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.47% : 0.000005s : 42: predicate.addn_check_dump 1.60% : 0.000006s : 42: predicate.addn_zero_filter 2.16% : 0.000008s : 42: predicate.arithmetic_simplify 1.60% : 0.000006s : 42: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.44% : 0.000005s : 42: predicate.compare_switch_simplify 1.51% : 0.000006s : 42: predicate.depend_value_elim 1.42% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.61% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.66% : 0.000006s : 42: predicate.dict_set_item_eliminator 0.31% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.41% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.40% : 0.000005s : 42: predicate.environ_get_depend_swap 1.53% : 0.000006s : 42: predicate.environ_get_eliminate 1.43% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.86% : 0.000003s : 16: predicate.get_grad_eliminate 0.10% : 0.000000s : 1: predicate.graph_param_transform 5.05% : 0.000019s : 64: predicate.inline 2.05% : 0.000008s : 44: predicate.inline_without_move 0.39% : 0.000001s : 16: predicate.j_node_and_user_rematch 1.03% : 0.000004s : 16: predicate.less_batch_normalization 1.83% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.76% : 0.000007s : 50: predicate.load_eliminater 0.46% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.30% : 0.000012s : 87: predicate.loop_unroll_before_grad 1.77% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.41% : 0.000005s : 42: predicate.merge_addn 1.48% : 0.000006s : 42: predicate.minmaximum_grad 0.45% : 0.000002s : 1: predicate.mutable_eliminate 0.13% : 0.000001s : 1: predicate.opt_reshape 2.28% : 0.000008s : 50: predicate.partial_eliminate 1.59% : 0.000006s : 42: predicate.print_const_string_wrapper 2.15% : 0.000008s : 42: predicate.reduce_eliminate 1.72% : 0.000006s : 49: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000002s : 16: predicate.remove_not_recompute_node 2.63% : 0.000010s : 90: predicate.replace_applicator 1.21% : 0.000004s : 44: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 42: predicate.reshape_eliminate 1.51% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.25% : 0.000001s : 1: predicate.row_tensor_eliminate 1.56% : 0.000006s : 42: predicate.same_eliminate 0.41% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.26% : 0.000001s : 2: predicate.special_op_eliminate 0.73% : 0.000003s : 16: predicate.specialize_transform 1.82% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.74% : 0.000010s : 62: predicate.switch_defer_inline 2.50% : 0.000009s : 62: predicate.switch_layer_defer_inline 6.35% : 0.000024s : 150: predicate.switch_simplify 1.63% : 0.000006s : 42: predicate.tile_eliminate 1.46% : 0.000005s : 42: predicate.transpose_eliminate 1.80% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.10% : 0.000011s : 51: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.83% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.89% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.93% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 1.77% : 0.000007s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002313 36 62.59% : 0.001448s : 19: func_graph_cloner_run.FuncGraphClonerGraph 37.41% : 0.000865s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057238 87 0.11% : 0.000064s : 1: add_recomputation 0.18% : 0.000103s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.46% : 0.000262s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.11% : 0.000062s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 37.66% : 0.021555s : 1: jit_opt_a 0.33% : 0.000190s : 1: jit_opt_after_cconv 0.08% : 0.000045s : 1: jit_opt_b 3.98% : 0.002279s : 1: loop_unroll 1.27% : 0.000724s : 1: mutable_eliminate 4.84% : 0.002771s : 39: opt.transform.jit_opt_a 0.08% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 3.17% : 0.001815s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000011s : 1: opt.transform.mutable_eliminate 0.03% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000028s : 4: opt.transform.symbol_engine_opt 1.11% : 0.000634s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 16.39% : 0.009382s : 2: renormalize.infer 3.60% : 0.002058s : 2: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000038s : 1: rewriter_after_opt_a 0.21% : 0.000121s : 1: rewriter_before_opt_a 0.14% : 0.000078s : 1: symbol_engine_optimizer 25.73% : 0.014728s : 1: type_inference TotalTime = 0.111686, [30] [bootstrap]: 0.00032196 [type_inference]: 0.0408289 [event_method]: 1.876e-05 [auto_monad]: 6.912e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00010829 [rewriter_before_opt_a]: 7.746e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0678918, [2] [Cycle 1]: 0.0527547, [27] [switch_simplify]: 7.035e-05 [loop_unroll]: 2.946e-05 [a_1]: 0.00062763 [with_stream_mark]: 2.699e-05 [recompute_prepare]: 8.89998e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.747e-05 [j_node_and_user_rematch]: 9.83002e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 1.167e-05 [inline_without_move]: 5.58002e-06 [renormalize]: 0.051542 [add_forward_monad_depend]: 1.356e-05 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 2.444e-05 [cse]: 3.765e-05 [replace_applicator]: 2.874e-05 [Cycle 2]: 0.00037755, [27] [switch_simplify]: 7.77e-06 [loop_unroll]: 6.29999e-06 [a_1]: 0.00010801 [with_stream_mark]: 1.795e-05 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 3.36001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.823e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.57001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.429e-05 [replace_applicator]: 5.35001e-06 [py_interpret_to_execute_after_opt_a]: 2.044e-05 [rewriter_after_opt_a]: 4.054e-05 [convert_after_rewriter]: 6.98998e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00076804 [jit_opt_b]: 5.308e-05, [1] [Cycle 1]: 4.456e-05, [2] [frontend_op_eliminate]: 1.628e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.814e-05 [loop_unroll]: 0.00042997 [jit_opt_after_cconv]: 0.00014421, [1] [Cycle 1]: 0.00013723, [11] [c_1]: 2.135e-05 [parameter_eliminate]: 2.79999e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.176e-05 [call_graph_tuple_transform]: 1.926e-05 [tuple_list_get_item_eliminator]: 5.71003e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.39998e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 5.94e-06 [add_recomputation]: 5.072e-05 [cse_after_recomputation]: 2.343e-05, [1] [Cycle 1]: 1.796e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.7e-05 [get_jit_bprop_graph]: 1.84998e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00045318 [symbol_engine_optimizer]: 7.552e-05, [1] [Cycle 1]: 6.896e-05, [6] [build]: 4.42998e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.375e-05 [opt_reshape]: 6.29001e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 3.7998e-07 [validate]: 4.366e-05 Sums bootstrap : 0.000322s : 0.33% type_inference : 0.040829s : 42.41% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000108s : 0.11% rewriter_before_opt_a : 0.000077s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000736s : 0.76% jit_opt_a.with_stream_mark : 0.000045s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.051542s : 53.53% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.03% jit_opt_a.cse : 0.000052s : 0.05% jit_opt_a.replace_applicator : 0.000034s : 0.04% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000768s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000430s : 0.45% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000453s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.05% Time group info: ------[substitution.] 0.000270 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 1.83% : 0.000005s : 3: substitution.graph_param_transform 85.03% : 0.000230s : 4: substitution.inline 1.92% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000006s : 4: substitution.remove_not_recompute_node 2.93% : 0.000008s : 2: substitution.replace_old_param 4.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040755 2 95.76% : 0.039025s : 1: type_inference.infer 4.24% : 0.001730s : 1: type_inference.specialize ------[replace.] 0.000097 6 59.05% : 0.000057s : 4: replace.inline 40.95% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 6 95.07% : 0.000227s : 4: match.inline 4.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000003s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 0.96% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.26% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 6.17% : 0.000008s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.29% : 0.000002s : 10: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.41% : 0.000002s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 1.01% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 2.03% : 0.000003s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.97% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001187 13 35.11% : 0.000417s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.90% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 59.99% : 0.000712s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.164268 72 0.03% : 0.000053s : 1: add_recomputation 0.04% : 0.000073s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.21% : 0.000339s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 41.33% : 0.067896s : 1: jit_opt_a 0.09% : 0.000147s : 1: jit_opt_after_cconv 0.03% : 0.000056s : 1: jit_opt_b 0.27% : 0.000437s : 1: loop_unroll 0.47% : 0.000776s : 1: mutable_eliminate 0.61% : 0.000999s : 26: opt.transform.jit_opt_a 0.03% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000461s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000111s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 30.88% : 0.050719s : 1: renormalize.infer 0.49% : 0.000804s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000081s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 24.86% : 0.040838s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.309.646 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.310.380 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0749494, [30] [bootstrap]: 0.00032339 [type_inference]: 0.0637133 [event_method]: 2.301e-05 [auto_monad]: 7.2e-05 [graph_reusing]: 6.91001e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 0.00011957 [rewriter_before_opt_a]: 9.025e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00797922, [2] [Cycle 1]: 0.00270499, [27] [switch_simplify]: 7.734e-05 [loop_unroll]: 3.205e-05 [a_1]: 0.00063715 [with_stream_mark]: 2.369e-05 [recompute_prepare]: 8.23001e-06 [updatestate_depend_eliminate]: 4.88001e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 7.65e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.773e-05 [j_node_and_user_rematch]: 1.102e-05 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 1.127e-05 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00154371 [add_forward_monad_depend]: 6.66e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.684e-05 [cse]: 3.615e-05 [replace_applicator]: 1.687e-05 [Cycle 2]: 0.00034047, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.62999e-06 [a_1]: 9.593e-05 [with_stream_mark]: 1.09e-05 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 3.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 7.3e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29003e-06 [auto_monad_grad]: 9.60019e-07 [auto_monad_eliminator]: 6.34999e-06 [cse]: 1.401e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.68e-05 [rewriter_after_opt_a]: 4.02e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 4.89003e-06 [mutable_eliminate]: 0.00075904 [jit_opt_b]: 5.431e-05, [1] [Cycle 1]: 4.672e-05, [2] [frontend_op_eliminate]: 1.806e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 2.607e-05 [loop_unroll]: 0.00046575 [jit_opt_after_cconv]: 0.00015131, [1] [Cycle 1]: 0.00014379, [11] [c_1]: 2.327e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 6.29999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.38998e-06 [cse]: 2.492e-05 [call_graph_tuple_transform]: 1.969e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.706e-05 [partial_unused_args_eliminate]: 2.30002e-06 [environ_conv]: 7.3e-06 [add_recomputation]: 5.105e-05 [cse_after_recomputation]: 2.404e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.778e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 6.04001e-06 [opt_after_jit_grad]: 0.00051484 [symbol_engine_optimizer]: 0.00021255, [1] [Cycle 1]: 0.00020482, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.06001e-06 [elim_not_effective]: 0.00011191 [opt_reshape]: 9.36e-06 [fold_const_symbol]: 3.431e-05 [renormalize]: 6.50005e-07 [validate]: 4.626e-05 Sums bootstrap : 0.000323s : 0.47% type_inference : 0.063713s : 91.84% event_method : 0.000023s : 0.03% auto_monad : 0.000072s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000120s : 0.17% rewriter_before_opt_a : 0.000090s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000084s : 0.12% jit_opt_a.loop_unroll : 0.000038s : 0.05% jit_opt_a.a_1 : 0.000733s : 1.06% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001544s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000050s : 0.07% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000759s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.000466s : 0.67% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000051s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000515s : 0.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000112s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000034s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.07% Time group info: ------[substitution.] 0.000269 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 3: substitution.graph_param_transform 86.04% : 0.000232s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000006s : 4: substitution.remove_not_recompute_node 1.76% : 0.000005s : 2: substitution.replace_old_param 4.88% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063630 2 97.04% : 0.061747s : 1: type_inference.infer 2.96% : 0.001884s : 1: type_inference.specialize ------[replace.] 0.000096 6 67.39% : 0.000065s : 4: replace.inline 32.61% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 6 95.01% : 0.000229s : 4: match.inline 4.99% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.75% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.68% : 0.000001s : 3: predicate.elim_not_effective 0.71% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.02% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 1.17% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.06% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.03% : 0.000009s : 53: predicate.switch_simplify 1.67% : 0.000002s : 10: predicate.tile_eliminate 1.52% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000965 13 42.01% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.02% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.98% : 0.000511s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077659 72 0.07% : 0.000054s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.43% : 0.000337s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.28% : 0.007984s : 1: jit_opt_a 0.20% : 0.000154s : 1: jit_opt_after_cconv 0.07% : 0.000057s : 1: jit_opt_b 0.61% : 0.000474s : 1: loop_unroll 0.99% : 0.000768s : 1: mutable_eliminate 1.27% : 0.000985s : 26: opt.transform.jit_opt_a 0.07% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000160s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000524s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000124s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.18% : 0.000919s : 1: renormalize.infer 0.79% : 0.000615s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.12% : 0.000094s : 1: rewriter_before_opt_a 0.28% : 0.000215s : 1: symbol_engine_optimizer 82.07% : 0.063738s : 1: type_inference TotalTime = 0.0822238, [30] [bootstrap]: 0.00039486 [type_inference]: 0.0680035 [event_method]: 2.456e-05 [auto_monad]: 7.932e-05 [graph_reusing]: 7.56999e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00030768 [rewriter_before_opt_a]: 9.107e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.0107121, [2] [Cycle 1]: 0.00380804, [27] [switch_simplify]: 7.298e-05 [loop_unroll]: 3.238e-05 [a_1]: 0.00070986 [with_stream_mark]: 2.65e-05 [recompute_prepare]: 9.72999e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.08998e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 7.06001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [j_node_and_user_rematch]: 1.173e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.221e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00254134 [add_forward_monad_depend]: 1.011e-05 [auto_monad_grad]: 3.71001e-06 [auto_monad_eliminator]: 2.212e-05 [cse]: 3.56e-05 [replace_applicator]: 2.243e-05 [Cycle 2]: 0.00040128, [27] [switch_simplify]: 7.61001e-06 [loop_unroll]: 6.58e-06 [a_1]: 0.00013632 [with_stream_mark]: 1.68e-05 [recompute_prepare]: 6.47001e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 2.96999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.812e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.38002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.088e-05 [replace_applicator]: 6.40002e-06 [py_interpret_to_execute_after_opt_a]: 1.59e-05 [rewriter_after_opt_a]: 4.075e-05 [convert_after_rewriter]: 8e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00079798 [jit_opt_b]: 5.738e-05, [1] [Cycle 1]: 4.999e-05, [2] [frontend_op_eliminate]: 1.927e-05 [inline_after_opt_a]: 1.838e-05 [cconv]: 2.975e-05 [loop_unroll]: 0.0004326 [jit_opt_after_cconv]: 0.00015299, [1] [Cycle 1]: 0.00014644, [11] [c_1]: 2.586e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 3.55e-06 [cse]: 2.071e-05 [call_graph_tuple_transform]: 2.138e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 6.43003e-06 [remove_dup_value]: 1.708e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 9.38002e-06 [add_recomputation]: 5.55e-05 [cse_after_recomputation]: 2.509e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.322e-05 [auto_monad_reorder]: 1.642e-05 [get_jit_bprop_graph]: 3.03998e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00048686 [symbol_engine_optimizer]: 0.00016813, [1] [Cycle 1]: 0.0001611, [6] [build]: 3.98001e-06 [elim_shapecalc]: 9.463e-05 [elim_not_effective]: 1.505e-05 [opt_reshape]: 7.14001e-06 [fold_const_symbol]: 9.48002e-06 [renormalize]: 5.59987e-07 [validate]: 4.725e-05 Sums bootstrap : 0.000395s : 0.53% type_inference : 0.068004s : 90.62% event_method : 0.000025s : 0.03% auto_monad : 0.000079s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000308s : 0.41% rewriter_before_opt_a : 0.000091s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.11% jit_opt_a.loop_unroll : 0.000039s : 0.05% jit_opt_a.a_1 : 0.000846s : 1.13% jit_opt_a.with_stream_mark : 0.000043s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002541s : 3.39% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.04% jit_opt_a.cse : 0.000046s : 0.06% jit_opt_a.replace_applicator : 0.000029s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000798s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000030s : 0.04% loop_unroll : 0.000433s : 0.58% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000055s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000487s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000095s : 0.13% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.06% Time group info: ------[substitution.] 0.000305 24 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000006s : 4: substitution.graph_param_transform 85.86% : 0.000262s : 4: substitution.inline 1.59% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000007s : 4: substitution.remove_not_recompute_node 2.51% : 0.000008s : 2: substitution.replace_old_param 4.72% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067888 2 96.87% : 0.065766s : 1: type_inference.infer 3.13% : 0.002123s : 1: type_inference.specialize ------[replace.] 0.000087 6 71.42% : 0.000062s : 4: replace.inline 28.58% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 6 95.12% : 0.000260s : 4: match.inline 4.88% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.39% : 0.000002s : 12: predicate.addn_check_dump 1.60% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.42% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.74% : 0.000003s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000011s : 58: predicate.switch_simplify 1.69% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002492 22 68.73% : 0.001713s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.57% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.70% : 0.000715s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.086027 72 0.07% : 0.000058s : 1: add_recomputation 0.10% : 0.000083s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.49% : 0.000420s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 12.46% : 0.010716s : 1: jit_opt_a 0.18% : 0.000156s : 1: jit_opt_after_cconv 0.07% : 0.000060s : 1: jit_opt_b 0.51% : 0.000441s : 1: loop_unroll 0.94% : 0.000809s : 1: mutable_eliminate 1.30% : 0.001119s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000123s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000317s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.89% : 0.001622s : 1: renormalize.infer 1.05% : 0.000907s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.11% : 0.000096s : 1: rewriter_before_opt_a 0.20% : 0.000171s : 1: symbol_engine_optimizer 79.08% : 0.068035s : 1: type_inference TotalTime = 0.272324, [30] [bootstrap]: 0.00036295 [type_inference]: 0.230696 [event_method]: 2.855e-05 [auto_monad]: 7.721e-05 [graph_reusing]: 6.05002e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00060821 [rewriter_before_opt_a]: 0.00010219 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00934324, [2] [Cycle 1]: 0.00528233, [27] [switch_simplify]: 6.674e-05 [loop_unroll]: 3.465e-05 [a_1]: 0.00073854 [with_stream_mark]: 1.934e-05 [recompute_prepare]: 9.29e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 6.53003e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.006e-05 [inline_without_move]: 6.38998e-06 [renormalize]: 0.00404714 [add_forward_monad_depend]: 7.64002e-06 [auto_monad_grad]: 2.58998e-06 [auto_monad_eliminator]: 1.967e-05 [cse]: 3.714e-05 [replace_applicator]: 2.022e-05 [Cycle 2]: 0.0003928, [27] [switch_simplify]: 7.76001e-06 [loop_unroll]: 6.80002e-06 [a_1]: 0.00012701 [with_stream_mark]: 1.579e-05 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 3.75998e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.75002e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.48998e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.36998e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.683e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.76002e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.45001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.12001e-06 [cse]: 1.65e-05 [replace_applicator]: 6.28998e-06 [py_interpret_to_execute_after_opt_a]: 1.341e-05 [rewriter_after_opt_a]: 3.86e-05 [convert_after_rewriter]: 7.27997e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00070329 [jit_opt_b]: 6.127e-05, [1] [Cycle 1]: 5.443e-05, [2] [frontend_op_eliminate]: 2.117e-05 [inline_after_opt_a]: 1.843e-05 [cconv]: 2.887e-05 [loop_unroll]: 0.00043559 [jit_opt_after_cconv]: 0.00016927, [1] [Cycle 1]: 0.00016318, [11] [c_1]: 2.602e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 7.3e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 2.739e-05 [call_graph_tuple_transform]: 2.202e-05 [tuple_list_get_item_eliminator]: 7.16999e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.55997e-06 [remove_dup_value]: 1.836e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 9.24e-06 [add_recomputation]: 5.415e-05 [cse_after_recomputation]: 2.846e-05, [1] [Cycle 1]: 2.314e-05, [1] [cse]: 1.474e-05 [auto_monad_reorder]: 0.0280862 [get_jit_bprop_graph]: 8.56002e-06 [rewriter_after_jit_bprop_graph]: 1.371e-05 [opt_after_jit_grad]: 0.00099134 [symbol_engine_optimizer]: 0.00012181, [1] [Cycle 1]: 0.0001131, [6] [build]: 6.64999e-06 [elim_shapecalc]: 2e-05 [elim_not_effective]: 2.62e-05 [opt_reshape]: 8.59e-06 [fold_const_symbol]: 1.829e-05 [renormalize]: 7.50006e-07 [validate]: 7.23e-05 Sums bootstrap : 0.000363s : 0.14% type_inference : 0.230696s : 86.08% event_method : 0.000029s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000608s : 0.23% rewriter_before_opt_a : 0.000102s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000866s : 0.32% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004047s : 1.51% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000054s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000703s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000436s : 0.16% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.028086s : 10.48% get_jit_bprop_graph : 0.000009s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.01% opt_after_jit_grad : 0.000991s : 0.37% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000020s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000018s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000072s : 0.03% Time group info: ------[substitution.] 0.000301 25 3.01% : 0.000009s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 4: substitution.graph_param_transform 85.92% : 0.000258s : 5: substitution.inline 1.18% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000005s : 2: substitution.replace_old_param 4.16% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.230531 2 98.00% : 0.225911s : 1: type_inference.infer 2.00% : 0.004620s : 1: type_inference.specialize ------[replace.] 0.000111 7 66.65% : 0.000074s : 5: replace.inline 33.35% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000266 7 95.74% : 0.000255s : 5: match.inline 4.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.44% : 0.000002s : 13: predicate.accumulaten_eliminater 1.48% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.53% : 0.000002s : 13: predicate.addn_zero_filter 1.81% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.53% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 4: predicate.elim_not_effective 0.79% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000002s : 13: predicate.environ_get_eliminate 1.35% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.24% : 0.000002s : 4: predicate.mutable_eliminate 0.84% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.84% : 0.000003s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003069 25 61.04% : 0.001873s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.89% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.07% : 0.001107s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.277575 72 0.02% : 0.000057s : 1: add_recomputation 0.03% : 0.000080s : 1: auto_monad 10.13% : 0.028114s : 1: auto_monad_reorder 0.14% : 0.000376s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000015s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.37% : 0.009347s : 1: jit_opt_a 0.06% : 0.000172s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.16% : 0.000442s : 1: loop_unroll 0.26% : 0.000711s : 1: mutable_eliminate 0.41% : 0.001129s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000069s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000999s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000614s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.07% : 0.002960s : 1: renormalize.infer 0.39% : 0.001076s : 1: renormalize.specialize 0.01% : 0.000016s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.04% : 0.000107s : 1: rewriter_before_opt_a 0.04% : 0.000124s : 1: symbol_engine_optimizer 83.12% : 0.230711s : 1: type_inference TotalTime = 0.0362021, [30] [bootstrap]: 0.00037839 [type_inference]: 0.0256913 [event_method]: 2.241e-05 [auto_monad]: 6.685e-05 [graph_reusing]: 5.57999e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00013964 [rewriter_before_opt_a]: 8.739e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00713239, [2] [Cycle 1]: 0.00291613, [27] [switch_simplify]: 6.319e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.0006149 [with_stream_mark]: 1.958e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.81999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.411e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00181511 [add_forward_monad_depend]: 7.31999e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.889e-05 [cse]: 3.55e-05 [replace_applicator]: 1.898e-05 [Cycle 2]: 0.00034414, [27] [switch_simplify]: 6.58998e-06 [loop_unroll]: 5.56998e-06 [a_1]: 9.74e-05 [with_stream_mark]: 1.157e-05 [recompute_prepare]: 5.65001e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 3.57997e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 7.24001e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.508e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 3.388e-05 [rewriter_after_opt_a]: 5.115e-05 [convert_after_rewriter]: 7.88999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00074728 [jit_opt_b]: 5.834e-05, [1] [Cycle 1]: 4.984e-05, [2] [frontend_op_eliminate]: 1.977e-05 [inline_after_opt_a]: 1.715e-05 [cconv]: 2.8e-05 [loop_unroll]: 0.00051302 [jit_opt_after_cconv]: 0.00017149, [1] [Cycle 1]: 0.00016351, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 3.20002e-06 [updatestate_depend_eliminate]: 6.72002e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.79999e-06 [cse]: 3.329e-05 [call_graph_tuple_transform]: 2.192e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.75e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.39e-05 [cse_after_recomputation]: 2.616e-05, [1] [Cycle 1]: 2.006e-05, [1] [cse]: 1.385e-05 [auto_monad_reorder]: 1.856e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 6.12001e-06 [opt_after_jit_grad]: 0.00053928 [symbol_engine_optimizer]: 0.00012729, [1] [Cycle 1]: 0.00012059, [6] [build]: 4.75001e-06 [elim_shapecalc]: 9.71e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 5.187e-05 [fold_const_symbol]: 1.149e-05 [renormalize]: 8.90024e-07 [validate]: 4.916e-05 Sums bootstrap : 0.000378s : 1.19% type_inference : 0.025691s : 81.08% event_method : 0.000022s : 0.07% auto_monad : 0.000067s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000140s : 0.44% rewriter_before_opt_a : 0.000087s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.22% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000712s : 2.25% jit_opt_a.with_stream_mark : 0.000031s : 0.10% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001815s : 5.73% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.08% jit_opt_a.cse : 0.000051s : 0.16% jit_opt_a.replace_applicator : 0.000024s : 0.08% py_interpret_to_execute_after_opt_a : 0.000034s : 0.11% rewriter_after_opt_a : 0.000051s : 0.16% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000747s : 2.36% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000028s : 0.09% loop_unroll : 0.000513s : 1.62% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.17% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000539s : 1.70% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000052s : 0.16% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.16% Time group info: ------[substitution.] 0.000250 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000002s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 86.23% : 0.000216s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000004s : 2: substitution.replace_old_param 4.68% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025605 2 91.41% : 0.023405s : 1: type_inference.infer 8.59% : 0.002199s : 1: type_inference.specialize ------[replace.] 0.000091 6 71.30% : 0.000065s : 4: replace.inline 28.70% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 95.28% : 0.000213s : 4: match.inline 4.72% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.20% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.05% : 0.000003s : 10: predicate.arithmetic_simplify 1.60% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.05% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.39% : 0.000002s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.28% : 0.000002s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 4.94% : 0.000006s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 15: predicate.load_eliminater 1.85% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.98% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 2.09% : 0.000003s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.53% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.61% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.96% : 0.000009s : 53: predicate.switch_simplify 1.72% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.22% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.28% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.93% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001145 13 40.04% : 0.000459s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.03% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.93% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039072 72 0.15% : 0.000057s : 1: add_recomputation 0.18% : 0.000070s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.02% : 0.000397s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.27% : 0.007137s : 1: jit_opt_a 0.45% : 0.000174s : 1: jit_opt_after_cconv 0.16% : 0.000061s : 1: jit_opt_b 1.34% : 0.000522s : 1: loop_unroll 1.97% : 0.000769s : 1: mutable_eliminate 2.43% : 0.000948s : 26: opt.transform.jit_opt_a 0.14% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000084s : 4: opt.transform.symbol_engine_opt 1.41% : 0.000550s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000144s : 1: py_interpret_to_execute 0.10% : 0.000037s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.71% : 0.001057s : 1: renormalize.infer 1.91% : 0.000747s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000055s : 1: rewriter_after_opt_a 0.23% : 0.000091s : 1: rewriter_before_opt_a 0.33% : 0.000130s : 1: symbol_engine_optimizer 65.80% : 0.025709s : 1: type_inference TotalTime = 0.158668, [30] [bootstrap]: 0.00025778 [type_inference]: 0.126821 [event_method]: 0.00060628 [auto_monad]: 0.00012233 [graph_reusing]: 8.02e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 9.509e-05 [rewriter_before_opt_a]: 0.00014525 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.02804, [3] [Cycle 1]: 0.0198958, [27] [switch_simplify]: 8.601e-05 [loop_unroll]: 4.372e-05 [a_1]: 0.0010447 [with_stream_mark]: 3.595e-05 [recompute_prepare]: 1.976e-05 [updatestate_depend_eliminate]: 9.59999e-06 [updatestate_assign_eliminate]: 7.40998e-06 [updatestate_loads_eliminate]: 6.84001e-06 [parameter_eliminate]: 3.48e-06 [specialize_transform]: 1.526e-05 [updatestate_useless_node_eliminater]: 1.378e-05 [accelerated_algorithm]: 1.42e-05 [meta_shard_fg_expand]: 4.12998e-06 [get_grad_eliminate_]: 1.472e-05 [merge_forward]: 9.00999e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.933e-05 [j_node_and_user_rematch]: 2.61e-05 [meta_fg_expand]: 0.0020175 [replace_old_param]: 7.749e-05 [inline_without_move]: 6.262e-05 [renormalize]: 0.0155657 [add_forward_monad_depend]: 1.519e-05 [auto_monad_grad]: 7.80998e-06 [auto_monad_eliminator]: 6.792e-05 [cse]: 0.00032713 [replace_applicator]: 9.59e-05 [Cycle 2]: 0.0039093, [27] [switch_simplify]: 4.329e-05 [loop_unroll]: 4.225e-05 [a_1]: 0.00115923 [with_stream_mark]: 1.757e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 4.05e-06 [updatestate_loads_eliminate]: 3.88001e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 6.89001e-06 [updatestate_useless_node_eliminater]: 6.64999e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.27998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 0.0001454 [replace_old_param]: 9.09e-06 [inline_without_move]: 6.68e-06 [renormalize]: 0.00214288 [add_forward_monad_depend]: 7.57002e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.416e-05 [cse]: 2.681e-05 [replace_applicator]: 1.829e-05 [Cycle 3]: 0.00027737, [27] [switch_simplify]: 4.71002e-06 [loop_unroll]: 4.23001e-06 [a_1]: 5.239e-05 [with_stream_mark]: 1.079e-05 [recompute_prepare]: 3.83001e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 1.91003e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 4.02e-06 [updatestate_useless_node_eliminater]: 3.66001e-06 [accelerated_algorithm]: 3.9e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 3.38e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 2.89001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.189e-05 [j_node_and_user_rematch]: 6.68e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 3.36001e-06 [inline_without_move]: 3.06999e-06 [renormalize]: 1.29978e-07 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 3.61001e-06 [cse]: 8.38999e-06 [replace_applicator]: 3.93001e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 3.842e-05 [convert_after_rewriter]: 6.32001e-06 [order_py_execute_after_rewriter]: 4.64998e-06 [mutable_eliminate]: 0.00078772 [jit_opt_b]: 4.489e-05, [1] [Cycle 1]: 3.68e-05, [2] [frontend_op_eliminate]: 1.178e-05 [inline_after_opt_a]: 1.282e-05 [cconv]: 2.919e-05 [loop_unroll]: 0.00050335 [jit_opt_after_cconv]: 0.00014558, [1] [Cycle 1]: 0.00013882, [11] [c_1]: 1.494e-05 [parameter_eliminate]: 3.39001e-06 [updatestate_depend_eliminate]: 6.17001e-06 [updatestate_assign_eliminate]: 1.92001e-06 [updatestate_loads_eliminate]: 1.77001e-06 [cse]: 2.267e-05 [call_graph_tuple_transform]: 1.663e-05 [tuple_list_get_item_eliminator]: 4.68001e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 8.10018e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 1.555e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 4.93001e-06 [add_recomputation]: 3.996e-05 [cse_after_recomputation]: 1.855e-05, [1] [Cycle 1]: 1.332e-05, [1] [cse]: 7.21999e-06 [auto_monad_reorder]: 1.334e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 7.58999e-06 [opt_after_jit_grad]: 0.00053289 [symbol_engine_optimizer]: 7.106e-05, [1] [Cycle 1]: 6.353e-05, [6] [build]: 4.99998e-06 [elim_shapecalc]: 5.89e-06 [elim_not_effective]: 1.098e-05 [opt_reshape]: 4.68999e-06 [fold_const_symbol]: 5.81e-06 [renormalize]: 9.00007e-07 [validate]: 6.687e-05 Sums bootstrap : 0.000258s : 0.17% type_inference : 0.126821s : 82.47% event_method : 0.000606s : 0.39% auto_monad : 0.000122s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000095s : 0.06% rewriter_before_opt_a : 0.000145s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000134s : 0.09% jit_opt_a.loop_unroll : 0.000090s : 0.06% jit_opt_a.a_1 : 0.002256s : 1.47% jit_opt_a.with_stream_mark : 0.000064s : 0.04% jit_opt_a.recompute_prepare : 0.000032s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.002165s : 1.41% jit_opt_a.replace_old_param : 0.000090s : 0.06% jit_opt_a.inline_without_move : 0.000072s : 0.05% jit_opt_a.renormalize : 0.017709s : 11.52% jit_opt_a.add_forward_monad_depend : 0.000024s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000086s : 0.06% jit_opt_a.cse : 0.000362s : 0.24% jit_opt_a.replace_applicator : 0.000118s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000788s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000503s : 0.33% jit_opt_after_cconv.c_1 : 0.000015s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000533s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000067s : 0.04% Time group info: ------[substitution.] 0.000635 104 0.26% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.74% : 0.000005s : 1: substitution.graph_param_transform 67.91% : 0.000431s : 13: substitution.inline 3.23% : 0.000021s : 2: substitution.inline_without_move 1.66% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.92% : 0.000012s : 7: substitution.minmaximum_grad 1.16% : 0.000007s : 5: substitution.partial_eliminate 1.86% : 0.000012s : 12: substitution.remove_not_recompute_node 5.53% : 0.000035s : 10: substitution.replace_applicator 1.16% : 0.000007s : 10: substitution.replace_old_param 0.39% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.96% : 0.000006s : 1: substitution.tile_eliminate 3.87% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.44% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.74% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126704 2 97.05% : 0.122965s : 1: type_inference.infer 2.95% : 0.003739s : 1: type_inference.specialize ------[replace.] 0.000206 20 65.87% : 0.000136s : 13: replace.inline 34.13% : 0.000070s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000445 20 95.15% : 0.000424s : 13: match.inline 4.85% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2544 1.59% : 0.000006s : 44: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 44: predicate.addn_check_dump 1.62% : 0.000006s : 44: predicate.addn_zero_filter 2.30% : 0.000009s : 44: predicate.arithmetic_simplify 1.67% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.45% : 0.000005s : 44: predicate.compare_switch_simplify 1.56% : 0.000006s : 44: predicate.depend_value_elim 1.39% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.47% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.54% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.49% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.43% : 0.000005s : 44: predicate.environ_get_depend_swap 1.49% : 0.000006s : 44: predicate.environ_get_eliminate 1.41% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.31% : 0.000016s : 66: predicate.inline 1.97% : 0.000007s : 45: predicate.inline_without_move 0.36% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.07% : 0.000004s : 17: predicate.less_batch_normalization 1.86% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 52: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.47% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.45% : 0.000005s : 44: predicate.merge_addn 1.48% : 0.000006s : 44: predicate.minmaximum_grad 0.39% : 0.000001s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.31% : 0.000009s : 52: predicate.partial_eliminate 1.50% : 0.000006s : 44: predicate.print_const_string_wrapper 2.05% : 0.000008s : 44: predicate.reduce_eliminate 1.92% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 17: predicate.remove_not_recompute_node 2.75% : 0.000010s : 96: predicate.replace_applicator 1.30% : 0.000005s : 45: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000006s : 44: predicate.reshape_eliminate 1.55% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.29% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000006s : 44: predicate.same_eliminate 0.45% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.76% : 0.000003s : 17: predicate.specialize_transform 1.78% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.84% : 0.000011s : 64: predicate.switch_defer_inline 2.52% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.65% : 0.000025s : 157: predicate.switch_simplify 1.54% : 0.000006s : 44: predicate.tile_eliminate 1.49% : 0.000006s : 44: predicate.transpose_eliminate 1.95% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.97% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004135 45 73.31% : 0.003032s : 28: func_graph_cloner_run.FuncGraphClonerGraph 26.69% : 0.001104s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.179287 87 0.02% : 0.000044s : 1: add_recomputation 0.07% : 0.000129s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.16% : 0.000284s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.34% : 0.000616s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.64% : 0.028045s : 1: jit_opt_a 0.08% : 0.000149s : 1: jit_opt_after_cconv 0.03% : 0.000048s : 1: jit_opt_b 0.29% : 0.000512s : 1: loop_unroll 0.44% : 0.000798s : 1: mutable_eliminate 1.64% : 0.002943s : 39: opt.transform.jit_opt_a 0.02% : 0.000038s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000542s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000098s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 8.27% : 0.014819s : 2: renormalize.infer 1.60% : 0.002865s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000149s : 1: rewriter_before_opt_a 0.04% : 0.000073s : 1: symbol_engine_optimizer 70.75% : 0.126845s : 1: type_inference TotalTime = 0.016306, [30] [bootstrap]: 0.00031146 [type_inference]: 0.00478546 [event_method]: 1.824e-05 [auto_monad]: 6.825e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 3.969e-05 [rewriter_before_opt_a]: 7.417e-05 [expand_dump_flag]: 3.57002e-06 [jit_opt_a]: 0.0089128, [2] [Cycle 1]: 0.00177761, [27] [switch_simplify]: 5.993e-05 [loop_unroll]: 2.944e-05 [a_1]: 0.00056005 [with_stream_mark]: 2.222e-05 [recompute_prepare]: 7.27997e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.511e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.00075745 [add_forward_monad_depend]: 4.84e-06 [auto_monad_grad]: 2.55002e-06 [auto_monad_eliminator]: 1.378e-05 [cse]: 5.525e-05 [replace_applicator]: 1.158e-05 [Cycle 2]: 0.00031275, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 4.87998e-06 [a_1]: 9.026e-05 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 5.11002e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.14003e-06 [get_grad_eliminate_]: 4.40999e-06 [merge_forward]: 2.53998e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.239e-05 [j_node_and_user_rematch]: 8.23999e-06 [meta_fg_expand]: 1.66998e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 4.62998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.78002e-06 [cse]: 1.035e-05 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.149e-05 [rewriter_after_opt_a]: 3.827e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00050912 [jit_opt_b]: 4.797e-05, [1] [Cycle 1]: 4.153e-05, [2] [frontend_op_eliminate]: 1.564e-05 [inline_after_opt_a]: 1.536e-05 [cconv]: 2.59e-05 [loop_unroll]: 0.00041325 [jit_opt_after_cconv]: 0.00013717, [1] [Cycle 1]: 0.00013124, [11] [c_1]: 2.036e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.41998e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.949e-05 [call_graph_tuple_transform]: 1.821e-05 [tuple_list_get_item_eliminator]: 5.14998e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.03002e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 1.158e-05 [environ_conv]: 5.20999e-06 [add_recomputation]: 5.441e-05 [cse_after_recomputation]: 2.15e-05, [1] [Cycle 1]: 1.605e-05, [1] [cse]: 1.032e-05 [auto_monad_reorder]: 1.622e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 5.54998e-06 [opt_after_jit_grad]: 0.00046906 [symbol_engine_optimizer]: 7.343e-05, [1] [Cycle 1]: 6.698e-05, [6] [build]: 3.99002e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 4.00003e-07 [validate]: 4.127e-05 Sums bootstrap : 0.000311s : 3.49% type_inference : 0.004785s : 53.67% event_method : 0.000018s : 0.20% auto_monad : 0.000068s : 0.77% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000040s : 0.45% rewriter_before_opt_a : 0.000074s : 0.83% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000066s : 0.74% jit_opt_a.loop_unroll : 0.000034s : 0.38% jit_opt_a.a_1 : 0.000650s : 7.29% jit_opt_a.with_stream_mark : 0.000031s : 0.35% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000758s : 8.50% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000066s : 0.74% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000038s : 0.43% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000509s : 5.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.29% loop_unroll : 0.000413s : 4.63% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000012s : 0.13% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000054s : 0.61% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000469s : 5.26% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.46% Time group info: ------[substitution.] 0.000233 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 84.83% : 0.000197s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004722 2 82.59% : 0.003900s : 1: type_inference.infer 17.41% : 0.000822s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.92% : 0.000048s : 4: replace.inline 31.08% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 94.40% : 0.000195s : 4: match.inline 5.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.25% : 0.000001s : 10: predicate.minmaximum_grad 1.89% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.33% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.21% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000639 13 52.41% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.63% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.96% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017974 72 0.32% : 0.000058s : 1: add_recomputation 0.40% : 0.000072s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.85% : 0.000332s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.12% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 49.61% : 0.008916s : 1: jit_opt_a 0.78% : 0.000140s : 1: jit_opt_after_cconv 0.28% : 0.000050s : 1: jit_opt_b 2.34% : 0.000421s : 1: loop_unroll 2.89% : 0.000519s : 1: mutable_eliminate 4.81% : 0.000864s : 26: opt.transform.jit_opt_a 0.25% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000478s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.08% : 0.000014s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.40% : 0.000431s : 1: renormalize.infer 1.77% : 0.000319s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000041s : 1: rewriter_after_opt_a 0.43% : 0.000077s : 1: rewriter_before_opt_a 0.42% : 0.000076s : 1: symbol_engine_optimizer 26.70% : 0.004799s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.503.744 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065af0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.504.399 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0483907, [30] [bootstrap]: 0.00035518 [type_inference]: 0.0365108 [event_method]: 2.526e-05 [auto_monad]: 7.966e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00015942 [rewriter_before_opt_a]: 9.264e-05 [expand_dump_flag]: 3.37002e-06 [jit_opt_a]: 0.00846817, [2] [Cycle 1]: 0.00288684, [27] [switch_simplify]: 6.985e-05 [loop_unroll]: 3.475e-05 [a_1]: 0.00064542 [with_stream_mark]: 2.412e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.18002e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.35002e-06 [renormalize]: 0.00174174 [add_forward_monad_depend]: 6.54001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.695e-05 [cse]: 3.688e-05 [replace_applicator]: 1.578e-05 [Cycle 2]: 0.00035948, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 5.83002e-06 [a_1]: 0.00010693 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.55002e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.84999e-06 [cse]: 1.589e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.495e-05 [rewriter_after_opt_a]: 4.117e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00074927 [jit_opt_b]: 5.7e-05, [1] [Cycle 1]: 4.826e-05, [2] [frontend_op_eliminate]: 1.86e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 3.148e-05 [loop_unroll]: 0.00051685 [jit_opt_after_cconv]: 0.00017224, [1] [Cycle 1]: 0.00016463, [11] [c_1]: 2.248e-05 [parameter_eliminate]: 3.76001e-06 [updatestate_depend_eliminate]: 8.69e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [cse]: 3.273e-05 [call_graph_tuple_transform]: 2.287e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.687e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 7.93001e-06 [add_recomputation]: 5.577e-05 [cse_after_recomputation]: 2.69e-05, [1] [Cycle 1]: 2.144e-05, [1] [cse]: 1.287e-05 [auto_monad_reorder]: 1.854e-05 [get_jit_bprop_graph]: 3.71999e-06 [rewriter_after_jit_bprop_graph]: 8.05999e-06 [opt_after_jit_grad]: 0.00057067 [symbol_engine_optimizer]: 0.00012334, [1] [Cycle 1]: 0.00011652, [6] [build]: 4.33999e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.634e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 5.119e-05 [renormalize]: 5.29981e-07 [validate]: 4.575e-05 Sums bootstrap : 0.000355s : 0.84% type_inference : 0.036511s : 85.87% event_method : 0.000025s : 0.06% auto_monad : 0.000080s : 0.19% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000159s : 0.37% rewriter_before_opt_a : 0.000093s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.18% jit_opt_a.loop_unroll : 0.000041s : 0.10% jit_opt_a.a_1 : 0.000752s : 1.77% jit_opt_a.with_stream_mark : 0.000037s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001742s : 4.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000053s : 0.12% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000041s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000749s : 1.76% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000031s : 0.07% loop_unroll : 0.000517s : 1.22% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000056s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000004s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000571s : 1.34% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000051s : 0.12% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.11% Time group info: ------[substitution.] 0.000274 23 1.30% : 0.000004s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 3: substitution.graph_param_transform 86.32% : 0.000236s : 4: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 4.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036405 2 92.10% : 0.033528s : 1: type_inference.infer 7.90% : 0.002877s : 1: type_inference.specialize ------[replace.] 0.000089 6 68.31% : 0.000061s : 4: replace.inline 31.69% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 6 95.39% : 0.000234s : 4: match.inline 4.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.25% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.39% : 0.000001s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 4.77% : 0.000006s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.74% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000002s : 10: predicate.minmaximum_grad 2.37% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 2.05% : 0.000003s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.42% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.18% : 0.000002s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.08% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001265 13 34.29% : 0.000434s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.51% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 61.20% : 0.000774s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051224 72 0.12% : 0.000059s : 1: add_recomputation 0.16% : 0.000084s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.73% : 0.000373s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.54% : 0.008472s : 1: jit_opt_a 0.34% : 0.000175s : 1: jit_opt_after_cconv 0.12% : 0.000060s : 1: jit_opt_b 1.03% : 0.000526s : 1: loop_unroll 1.49% : 0.000761s : 1: mutable_eliminate 1.95% : 0.000999s : 26: opt.transform.jit_opt_a 0.10% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000079s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000581s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000164s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 2.11% : 0.001082s : 1: renormalize.infer 1.27% : 0.000649s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.19% : 0.000096s : 1: rewriter_before_opt_a 0.25% : 0.000126s : 1: symbol_engine_optimizer 71.33% : 0.036537s : 1: type_inference TotalTime = 0.0153257, [30] [bootstrap]: 0.00030056 [type_inference]: 0.00503683 [event_method]: 1.793e-05 [auto_monad]: 6.643e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 3.2e-06 [py_interpret_to_execute]: 3.699e-05 [rewriter_before_opt_a]: 7.244e-05 [expand_dump_flag]: 2.74999e-06 [jit_opt_a]: 0.00723286, [2] [Cycle 1]: 0.0019328, [27] [switch_simplify]: 6.909e-05 [loop_unroll]: 2.885e-05 [a_1]: 0.00060253 [with_stream_mark]: 2.614e-05 [recompute_prepare]: 7.83001e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 0.00082427 [add_forward_monad_depend]: 7.36999e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.652e-05 [cse]: 3.777e-05 [replace_applicator]: 1.538e-05 [Cycle 2]: 0.00034244, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.29998e-06 [a_1]: 9.118e-05 [with_stream_mark]: 1.226e-05 [recompute_prepare]: 5.43002e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.03002e-06 [updatestate_useless_node_eliminater]: 4.72998e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 2.45002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 8.44998e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.66999e-06 [inline_without_move]: 4.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.60002e-06 [cse]: 1.484e-05 [replace_applicator]: 5.27999e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 4.109e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00073193 [jit_opt_b]: 5.459e-05, [1] [Cycle 1]: 4.655e-05, [2] [frontend_op_eliminate]: 1.729e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 3.2e-05 [loop_unroll]: 0.00051115 [jit_opt_after_cconv]: 0.00020163, [1] [Cycle 1]: 0.00019441, [11] [c_1]: 2.166e-05 [parameter_eliminate]: 3.95e-06 [updatestate_depend_eliminate]: 1.028e-05 [updatestate_assign_eliminate]: 3.00002e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 4.226e-05 [call_graph_tuple_transform]: 2.286e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.752e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.658e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.039e-05, [1] [cse]: 1.371e-05 [auto_monad_reorder]: 1.831e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 7.77998e-06 [opt_after_jit_grad]: 0.00049649 [symbol_engine_optimizer]: 8.068e-05, [1] [Cycle 1]: 7.367e-05, [6] [build]: 4.52e-06 [elim_shapecalc]: 8.90999e-06 [elim_not_effective]: 1.526e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 8.50006e-07 [validate]: 4.41e-05 Sums bootstrap : 0.000301s : 3.10% type_inference : 0.005037s : 51.91% event_method : 0.000018s : 0.18% auto_monad : 0.000066s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000037s : 0.38% rewriter_before_opt_a : 0.000072s : 0.75% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000075s : 0.77% jit_opt_a.loop_unroll : 0.000034s : 0.35% jit_opt_a.a_1 : 0.000694s : 7.15% jit_opt_a.with_stream_mark : 0.000038s : 0.40% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000824s : 8.50% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.24% jit_opt_a.cse : 0.000053s : 0.54% jit_opt_a.replace_applicator : 0.000021s : 0.21% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000041s : 0.42% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000732s : 7.54% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000032s : 0.33% loop_unroll : 0.000511s : 5.27% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.11% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000042s : 0.44% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000018s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000057s : 0.58% cse_after_recomputation.cse : 0.000014s : 0.14% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.08% opt_after_jit_grad : 0.000496s : 5.12% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.45% Time group info: ------[substitution.] 0.000257 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 85.14% : 0.000219s : 4: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.08% : 0.000005s : 2: substitution.replace_old_param 5.61% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004957 2 81.49% : 0.004040s : 1: type_inference.infer 18.51% : 0.000918s : 1: type_inference.specialize ------[replace.] 0.000082 6 69.84% : 0.000057s : 4: replace.inline 30.16% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.26% : 0.000216s : 4: match.inline 5.74% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 2.21% : 0.000003s : 10: predicate.arithmetic_simplify 1.77% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.23% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.78% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 15: predicate.load_eliminater 2.26% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.65% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.30% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.61% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.18% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.19% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.67% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000675 13 49.41% : 0.000333s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.65% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.94% : 0.000290s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017144 72 0.35% : 0.000060s : 1: add_recomputation 0.41% : 0.000070s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.86% : 0.000319s : 1: bootstrap 0.20% : 0.000035s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 42.21% : 0.007236s : 1: jit_opt_a 1.19% : 0.000205s : 1: jit_opt_after_cconv 0.33% : 0.000057s : 1: jit_opt_b 3.05% : 0.000522s : 1: loop_unroll 4.33% : 0.000742s : 1: mutable_eliminate 5.41% : 0.000928s : 26: opt.transform.jit_opt_a 0.31% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000028s : 4: opt.transform.jit_opt_b 0.10% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000020s : 1: opt.transform.mutable_eliminate 0.14% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.96% : 0.000507s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000040s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 2.61% : 0.000448s : 1: renormalize.infer 2.15% : 0.000368s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000044s : 1: rewriter_after_opt_a 0.44% : 0.000075s : 1: rewriter_before_opt_a 0.49% : 0.000083s : 1: symbol_engine_optimizer 29.49% : 0.005056s : 1: type_inference TotalTime = 0.0481722, [30] [bootstrap]: 0.00033754 [type_inference]: 0.0402012 [event_method]: 2.031e-05 [auto_monad]: 6.846e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 9.869e-05 [rewriter_before_opt_a]: 8.024e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.00523749, [2] [Cycle 1]: 0.00180107, [27] [switch_simplify]: 5.388e-05 [loop_unroll]: 2.897e-05 [a_1]: 0.00052142 [with_stream_mark]: 1.865e-05 [recompute_prepare]: 7.95e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 4.96002e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.409e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.00085218 [add_forward_monad_depend]: 5.47999e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.743e-05 [replace_applicator]: 1.291e-05 [Cycle 2]: 0.00031463, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.09998e-06 [a_1]: 8.785e-05 [with_stream_mark]: 9.65002e-06 [recompute_prepare]: 4.78001e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.09003e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.284e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.98e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 1.252e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.134e-05 [rewriter_after_opt_a]: 3.58e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00054258 [jit_opt_b]: 4.893e-05, [1] [Cycle 1]: 4.226e-05, [2] [frontend_op_eliminate]: 1.538e-05 [inline_after_opt_a]: 1.526e-05 [cconv]: 2.71e-05 [loop_unroll]: 0.00043551 [jit_opt_after_cconv]: 0.00014273, [1] [Cycle 1]: 0.00013614, [11] [c_1]: 2.077e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 6.44999e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.287e-05 [call_graph_tuple_transform]: 1.851e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.508e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.55001e-06 [add_recomputation]: 5.201e-05 [cse_after_recomputation]: 2.218e-05, [1] [Cycle 1]: 1.723e-05, [1] [cse]: 1.155e-05 [auto_monad_reorder]: 1.781e-05 [get_jit_bprop_graph]: 1.72001e-06 [rewriter_after_jit_bprop_graph]: 1.701e-05 [opt_after_jit_grad]: 0.00044714 [symbol_engine_optimizer]: 6.864e-05, [1] [Cycle 1]: 6.238e-05, [6] [build]: 2.71e-06 [elim_shapecalc]: 7.40998e-06 [elim_not_effective]: 1.228e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.69003e-06 [renormalize]: 3.19997e-07 [validate]: 3.819e-05 Sums bootstrap : 0.000338s : 0.76% type_inference : 0.040201s : 90.36% event_method : 0.000020s : 0.05% auto_monad : 0.000068s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000099s : 0.22% rewriter_before_opt_a : 0.000080s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.14% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000609s : 1.37% jit_opt_a.with_stream_mark : 0.000028s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000852s : 1.92% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000050s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000036s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000543s : 1.22% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000027s : 0.06% loop_unroll : 0.000436s : 0.98% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000017s : 0.04% opt_after_jit_grad : 0.000447s : 1.01% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.09% Time group info: ------[substitution.] 0.000203 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.80% : 0.000006s : 3: substitution.graph_param_transform 83.75% : 0.000170s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000004s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 5.81% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040131 2 96.40% : 0.038687s : 1: type_inference.infer 3.60% : 0.001445s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.70% : 0.000048s : 4: replace.inline 31.30% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 93.97% : 0.000168s : 4: match.inline 6.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.35% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000000s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.14% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000830 13 47.24% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.60% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.16% : 0.000400s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049893 72 0.11% : 0.000055s : 1: add_recomputation 0.14% : 0.000072s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.72% : 0.000359s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.50% : 0.005240s : 1: jit_opt_a 0.29% : 0.000145s : 1: jit_opt_after_cconv 0.10% : 0.000051s : 1: jit_opt_b 0.89% : 0.000443s : 1: loop_unroll 1.10% : 0.000550s : 1: mutable_eliminate 1.64% : 0.000818s : 26: opt.transform.jit_opt_a 0.09% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000102s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 0.95% : 0.000473s : 1: renormalize.infer 0.74% : 0.000371s : 1: renormalize.specialize 0.04% : 0.000019s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000039s : 1: rewriter_after_opt_a 0.17% : 0.000084s : 1: rewriter_before_opt_a 0.14% : 0.000071s : 1: symbol_engine_optimizer 80.61% : 0.040219s : 1: type_inference TotalTime = 0.0345195, [30] [bootstrap]: 0.0003812 [type_inference]: 0.024228 [event_method]: 2.17e-05 [auto_monad]: 7.027e-05 [graph_reusing]: 5.78002e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00015816 [rewriter_before_opt_a]: 9.251e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.0070007, [2] [Cycle 1]: 0.00248528, [27] [switch_simplify]: 6.333e-05 [loop_unroll]: 3.119e-05 [a_1]: 0.00059764 [with_stream_mark]: 2.308e-05 [recompute_prepare]: 7.43e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00141024 [add_forward_monad_depend]: 6.39001e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.657e-05 [cse]: 3.731e-05 [replace_applicator]: 1.528e-05 [Cycle 2]: 0.00033224, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.501e-05 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.99002e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.374e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 1.468e-05 [rewriter_after_opt_a]: 4.401e-05 [convert_after_rewriter]: 7.65998e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00079334 [jit_opt_b]: 5.36e-05, [1] [Cycle 1]: 4.624e-05, [2] [frontend_op_eliminate]: 1.647e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 2.686e-05 [loop_unroll]: 0.00051442 [jit_opt_after_cconv]: 0.00015351, [1] [Cycle 1]: 0.00014709, [11] [c_1]: 2.262e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 6.91001e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.552e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 2.02001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.34998e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.99999e-06 [add_recomputation]: 5.251e-05 [cse_after_recomputation]: 2.308e-05, [1] [Cycle 1]: 1.708e-05, [1] [cse]: 1.141e-05 [auto_monad_reorder]: 1.815e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 5.97999e-06 [opt_after_jit_grad]: 0.00047261 [symbol_engine_optimizer]: 0.00010272, [1] [Cycle 1]: 9.646e-05, [6] [build]: 4.21001e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.412e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 3.565e-05 [renormalize]: 2.3999e-07 [validate]: 4.57e-05 Sums bootstrap : 0.000381s : 1.28% type_inference : 0.024228s : 81.51% event_method : 0.000022s : 0.07% auto_monad : 0.000070s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000158s : 0.53% rewriter_before_opt_a : 0.000093s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.23% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000693s : 2.33% jit_opt_a.with_stream_mark : 0.000034s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001410s : 4.74% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000051s : 0.17% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000044s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000793s : 2.67% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000027s : 0.09% loop_unroll : 0.000514s : 1.73% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000473s : 1.59% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000036s : 0.12% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.15% Time group info: ------[substitution.] 0.000274 23 1.02% : 0.000003s : 2: substitution.elim_not_effective 10.24% : 0.000028s : 2: substitution.fold_const_symbol 1.94% : 0.000005s : 3: substitution.graph_param_transform 77.13% : 0.000211s : 4: substitution.inline 1.60% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.61% : 0.000004s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 4.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024137 2 89.89% : 0.021696s : 1: type_inference.infer 10.11% : 0.002441s : 1: type_inference.specialize ------[replace.] 0.000086 6 65.02% : 0.000056s : 4: replace.inline 34.98% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.67% : 0.000208s : 4: match.inline 5.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.70% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.99% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.70% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.73% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.30% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001167 13 41.65% : 0.000486s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.52% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.83% : 0.000628s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036926 72 0.15% : 0.000055s : 1: add_recomputation 0.20% : 0.000074s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.09% : 0.000401s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.97% : 0.007006s : 1: jit_opt_a 0.42% : 0.000156s : 1: jit_opt_after_cconv 0.15% : 0.000056s : 1: jit_opt_b 1.42% : 0.000523s : 1: loop_unroll 2.17% : 0.000803s : 1: mutable_eliminate 2.50% : 0.000923s : 26: opt.transform.jit_opt_a 0.14% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000060s : 4: opt.transform.symbol_engine_opt 1.30% : 0.000481s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.44% : 0.000163s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.27% : 0.000838s : 1: renormalize.infer 1.52% : 0.000562s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000047s : 1: rewriter_after_opt_a 0.26% : 0.000096s : 1: rewriter_before_opt_a 0.29% : 0.000105s : 1: symbol_engine_optimizer 65.66% : 0.024247s : 1: type_inference TotalTime = 0.285502, [30] [bootstrap]: 0.00041437 [type_inference]: 0.259179 [event_method]: 2.37e-05 [auto_monad]: 7.654e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.20002e-06 [py_interpret_to_execute]: 0.00075326 [rewriter_before_opt_a]: 0.00012107 [expand_dump_flag]: 4.42e-06 [jit_opt_a]: 0.00966848, [2] [Cycle 1]: 0.00526831, [27] [switch_simplify]: 6.585e-05 [loop_unroll]: 3.411e-05 [a_1]: 0.00074279 [with_stream_mark]: 1.958e-05 [recompute_prepare]: 9.42001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 1.19003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 1.12e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00404384 [add_forward_monad_depend]: 5.82999e-06 [auto_monad_grad]: 1.32999e-06 [auto_monad_eliminator]: 1.379e-05 [cse]: 3.617e-05 [replace_applicator]: 2.11e-05 [Cycle 2]: 0.00041824, [27] [switch_simplify]: 7.53e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00014725 [with_stream_mark]: 1.461e-05 [recompute_prepare]: 6.75998e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 3.51001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.00002e-06 [cse]: 1.507e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.475e-05 [rewriter_after_opt_a]: 4.069e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00066684 [jit_opt_b]: 7.267e-05, [1] [Cycle 1]: 6.384e-05, [2] [frontend_op_eliminate]: 2.056e-05 [inline_after_opt_a]: 1.858e-05 [cconv]: 3.059e-05 [loop_unroll]: 0.00044438 [jit_opt_after_cconv]: 0.00016685, [1] [Cycle 1]: 0.00015896, [11] [c_1]: 2.749e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 9.52999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.233e-05 [call_graph_tuple_transform]: 2.428e-05 [tuple_list_get_item_eliminator]: 6.87002e-06 [none_parameter_eliminate]: 1.34998e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.88e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 9.29998e-06 [add_recomputation]: 4.997e-05 [cse_after_recomputation]: 2.523e-05, [1] [Cycle 1]: 1.97e-05, [1] [cse]: 1.352e-05 [auto_monad_reorder]: 1.913e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 5.97999e-06 [opt_after_jit_grad]: 0.00049556 [symbol_engine_optimizer]: 8.89e-05, [1] [Cycle 1]: 8.174e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.756e-05 [opt_reshape]: 1.055e-05 [fold_const_symbol]: 1.024e-05 [renormalize]: 3.60014e-07 [validate]: 0.012872 Sums bootstrap : 0.000414s : 0.15% type_inference : 0.259179s : 92.28% event_method : 0.000024s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000753s : 0.27% rewriter_before_opt_a : 0.000121s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000890s : 0.32% jit_opt_a.with_stream_mark : 0.000034s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004044s : 1.44% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000051s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000667s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000444s : 0.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000496s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.012872s : 4.58% Time group info: ------[substitution.] 0.000303 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 4: substitution.graph_param_transform 84.33% : 0.000255s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.12% : 0.000012s : 3: substitution.reduce_eliminate 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.55% : 0.000005s : 2: substitution.replace_old_param 3.74% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.259069 2 92.00% : 0.238343s : 1: type_inference.infer 8.00% : 0.020726s : 1: type_inference.specialize ------[replace.] 0.000110 7 67.79% : 0.000075s : 5: replace.inline 32.21% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000263 7 96.19% : 0.000253s : 5: match.inline 3.81% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 2.22% : 0.000003s : 13: predicate.arithmetic_simplify 1.47% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.46% : 0.000002s : 13: predicate.environ_get_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.75% : 0.000003s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.31% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.22% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.00% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.015277 25 92.37% : 0.014112s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.59% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 7.04% : 0.001076s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.277928 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000080s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.16% : 0.000437s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.48% : 0.009673s : 1: jit_opt_a 0.06% : 0.000169s : 1: jit_opt_after_cconv 0.03% : 0.000076s : 1: jit_opt_b 0.16% : 0.000451s : 1: loop_unroll 0.24% : 0.000674s : 1: mutable_eliminate 0.41% : 0.001152s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000503s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000759s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.08% : 0.003006s : 1: renormalize.infer 0.37% : 0.001028s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.05% : 0.000127s : 1: rewriter_before_opt_a 0.03% : 0.000092s : 1: symbol_engine_optimizer 93.26% : 0.259194s : 1: type_inference TotalTime = 0.154781, [30] [bootstrap]: 0.00022873 [type_inference]: 0.124653 [event_method]: 0.00061918 [auto_monad]: 0.00012974 [graph_reusing]: 8.84998e-06 [pre_auto_parallel]: 3.16001e-06 [py_interpret_to_execute]: 9.945e-05 [rewriter_before_opt_a]: 0.00015785 [expand_dump_flag]: 3.89002e-06 [jit_opt_a]: 0.0266565, [3] [Cycle 1]: 0.0183264, [27] [switch_simplify]: 9.047e-05 [loop_unroll]: 4.525e-05 [a_1]: 0.00101715 [with_stream_mark]: 3.495e-05 [recompute_prepare]: 2.162e-05 [updatestate_depend_eliminate]: 1.095e-05 [updatestate_assign_eliminate]: 7.59002e-06 [updatestate_loads_eliminate]: 6.91999e-06 [parameter_eliminate]: 2.81999e-06 [specialize_transform]: 1.502e-05 [updatestate_useless_node_eliminater]: 1.38e-05 [accelerated_algorithm]: 1.475e-05 [meta_shard_fg_expand]: 3.71999e-06 [get_grad_eliminate_]: 1.403e-05 [merge_forward]: 9.89001e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.922e-05 [j_node_and_user_rematch]: 2.544e-05 [meta_fg_expand]: 0.00205699 [replace_old_param]: 7.884e-05 [inline_without_move]: 6.385e-05 [renormalize]: 0.0140193 [add_forward_monad_depend]: 1.43e-05 [auto_monad_grad]: 6.31998e-06 [auto_monad_eliminator]: 6.608e-05 [cse]: 0.00028893 [replace_applicator]: 9.42e-05 [Cycle 2]: 0.00423372, [27] [switch_simplify]: 4.477e-05 [loop_unroll]: 4.39e-05 [a_1]: 0.00140313 [with_stream_mark]: 2.125e-05 [recompute_prepare]: 1.314e-05 [updatestate_depend_eliminate]: 7.11001e-06 [updatestate_assign_eliminate]: 4.63001e-06 [updatestate_loads_eliminate]: 4e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 8.87999e-06 [updatestate_useless_node_eliminater]: 9.14e-06 [accelerated_algorithm]: 9.12999e-06 [meta_shard_fg_expand]: 3.61001e-06 [get_grad_eliminate_]: 8.01001e-06 [merge_forward]: 5.20999e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.028e-05 [j_node_and_user_rematch]: 1.337e-05 [meta_fg_expand]: 0.00013814 [replace_old_param]: 1.155e-05 [inline_without_move]: 9.00001e-06 [renormalize]: 0.00220565 [add_forward_monad_depend]: 5.49e-06 [auto_monad_grad]: 1.79e-06 [auto_monad_eliminator]: 1.09e-05 [cse]: 2.574e-05 [replace_applicator]: 1.507e-05 [Cycle 3]: 0.00025892, [27] [switch_simplify]: 4.60001e-06 [loop_unroll]: 3.78001e-06 [a_1]: 4.408e-05 [with_stream_mark]: 1.059e-05 [recompute_prepare]: 3.93001e-06 [updatestate_depend_eliminate]: 2.12999e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 1.47999e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 3.76999e-06 [updatestate_useless_node_eliminater]: 3.49001e-06 [accelerated_algorithm]: 3.53e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 3.31001e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 1.71998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.146e-05 [j_node_and_user_rematch]: 6.73e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 3.33e-06 [inline_without_move]: 3.33e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 3.53999e-06 [cse]: 8.48001e-06 [replace_applicator]: 3.66999e-06 [py_interpret_to_execute_after_opt_a]: 1.094e-05 [rewriter_after_opt_a]: 4.91e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 4.32e-06 [mutable_eliminate]: 0.00069468 [jit_opt_b]: 4.181e-05, [1] [Cycle 1]: 3.379e-05, [2] [frontend_op_eliminate]: 1.047e-05 [inline_after_opt_a]: 1.116e-05 [cconv]: 2.56e-05 [loop_unroll]: 0.00041686 [jit_opt_after_cconv]: 0.00012665, [1] [Cycle 1]: 0.00012004, [11] [c_1]: 1.297e-05 [parameter_eliminate]: 2.23998e-06 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 1.60001e-06 [cse]: 1.917e-05 [call_graph_tuple_transform]: 1.44e-05 [tuple_list_get_item_eliminator]: 3.44001e-06 [none_parameter_eliminate]: 1.29998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 3.36001e-06 [remove_dup_value]: 1.564e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 5.81998e-06 [add_recomputation]: 3.52e-05 [cse_after_recomputation]: 2.033e-05, [1] [Cycle 1]: 1.536e-05, [1] [cse]: 8.65999e-06 [auto_monad_reorder]: 1.371e-05 [get_jit_bprop_graph]: 1.74998e-06 [rewriter_after_jit_bprop_graph]: 6.17999e-06 [opt_after_jit_grad]: 0.00044104 [symbol_engine_optimizer]: 6.505e-05, [1] [Cycle 1]: 5.857e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 5.64998e-06 [elim_not_effective]: 9.91e-06 [opt_reshape]: 4.02e-06 [fold_const_symbol]: 5.90002e-06 [renormalize]: 3.89991e-07 [validate]: 4.539e-05 Sums bootstrap : 0.000229s : 0.15% type_inference : 0.124653s : 83.08% event_method : 0.000619s : 0.41% auto_monad : 0.000130s : 0.09% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000099s : 0.07% rewriter_before_opt_a : 0.000158s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000140s : 0.09% jit_opt_a.loop_unroll : 0.000093s : 0.06% jit_opt_a.a_1 : 0.002464s : 1.64% jit_opt_a.with_stream_mark : 0.000067s : 0.04% jit_opt_a.recompute_prepare : 0.000039s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.03% jit_opt_a.meta_fg_expand : 0.002197s : 1.46% jit_opt_a.replace_old_param : 0.000094s : 0.06% jit_opt_a.inline_without_move : 0.000076s : 0.05% jit_opt_a.renormalize : 0.016225s : 10.81% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.05% jit_opt_a.cse : 0.000323s : 0.22% jit_opt_a.replace_applicator : 0.000113s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000049s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000695s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000417s : 0.28% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000003s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000035s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000441s : 0.29% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000684 107 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.70% : 0.000005s : 1: substitution.graph_param_transform 68.18% : 0.000466s : 13: substitution.inline 2.96% : 0.000020s : 2: substitution.inline_without_move 1.45% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.90% : 0.000013s : 7: substitution.minmaximum_grad 1.26% : 0.000009s : 5: substitution.partial_eliminate 1.63% : 0.000011s : 13: substitution.remove_not_recompute_node 4.92% : 0.000034s : 10: substitution.replace_applicator 1.57% : 0.000011s : 10: substitution.replace_old_param 1.05% : 0.000007s : 1: substitution.reshape_eliminate 0.37% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.03% : 0.000007s : 1: substitution.tile_eliminate 3.29% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.44% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.84% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124515 2 96.44% : 0.120077s : 1: type_inference.infer 3.56% : 0.004438s : 1: type_inference.specialize ------[replace.] 0.000219 20 64.09% : 0.000141s : 13: replace.inline 35.91% : 0.000079s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000482 20 95.01% : 0.000458s : 13: match.inline 4.99% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000385 2656 1.61% : 0.000006s : 46: predicate.accumulaten_eliminater 0.19% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.56% : 0.000006s : 46: predicate.addn_check_dump 1.59% : 0.000006s : 46: predicate.addn_zero_filter 2.05% : 0.000008s : 46: predicate.arithmetic_simplify 1.62% : 0.000006s : 46: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.48% : 0.000006s : 46: predicate.compare_switch_simplify 1.51% : 0.000006s : 46: predicate.depend_value_elim 1.50% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.64% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.46% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.19% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.60% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.61% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.61% : 0.000006s : 46: predicate.environ_get_depend_swap 1.56% : 0.000006s : 46: predicate.environ_get_eliminate 1.43% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.86% : 0.000003s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.52% : 0.000017s : 68: predicate.inline 2.04% : 0.000008s : 47: predicate.inline_without_move 0.37% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.03% : 0.000004s : 19: predicate.less_batch_normalization 1.79% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.81% : 0.000007s : 54: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.43% : 0.000013s : 94: predicate.loop_unroll_before_grad 1.76% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.42% : 0.000005s : 46: predicate.merge_addn 1.48% : 0.000006s : 46: predicate.minmaximum_grad 0.35% : 0.000001s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.24% : 0.000009s : 54: predicate.partial_eliminate 1.47% : 0.000006s : 46: predicate.print_const_string_wrapper 2.04% : 0.000008s : 46: predicate.reduce_eliminate 1.76% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 19: predicate.remove_not_recompute_node 2.75% : 0.000011s : 100: predicate.replace_applicator 1.18% : 0.000005s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 46: predicate.reshape_eliminate 1.65% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.28% : 0.000001s : 1: predicate.row_tensor_eliminate 1.59% : 0.000006s : 46: predicate.same_eliminate 0.47% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 19: predicate.specialize_transform 1.70% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.16% : 0.000012s : 66: predicate.switch_defer_inline 2.47% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.39% : 0.000025s : 161: predicate.switch_simplify 1.55% : 0.000006s : 46: predicate.tile_eliminate 1.53% : 0.000006s : 46: predicate.transpose_eliminate 1.93% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.84% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.81% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.77% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.75% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.84% : 0.000007s : 46: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.17% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004076 45 71.57% : 0.002917s : 28: func_graph_cloner_run.FuncGraphClonerGraph 28.43% : 0.001159s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.174166 87 0.02% : 0.000038s : 1: add_recomputation 0.08% : 0.000136s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.14% : 0.000244s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.36% : 0.000630s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.31% : 0.026661s : 1: jit_opt_a 0.07% : 0.000129s : 1: jit_opt_after_cconv 0.03% : 0.000045s : 1: jit_opt_b 0.24% : 0.000424s : 1: loop_unroll 0.40% : 0.000702s : 1: mutable_eliminate 1.82% : 0.003178s : 39: opt.transform.jit_opt_a 0.02% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000448s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000103s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.78% : 0.013546s : 2: renormalize.infer 1.53% : 0.002657s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.09% : 0.000162s : 1: rewriter_before_opt_a 0.04% : 0.000067s : 1: symbol_engine_optimizer 71.59% : 0.124678s : 1: type_inference TotalTime = 0.0347124, [30] [bootstrap]: 0.0003558 [type_inference]: 0.0235502 [event_method]: 2.386e-05 [auto_monad]: 7.401e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00011141 [rewriter_before_opt_a]: 8.56e-05 [expand_dump_flag]: 2.84001e-06 [jit_opt_a]: 0.00773319, [2] [Cycle 1]: 0.00360796, [27] [switch_simplify]: 6.469e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00060452 [with_stream_mark]: 2.806e-05 [recompute_prepare]: 9.69999e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.674e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 1.069e-05 [inline_without_move]: 5.81e-06 [renormalize]: 0.00245018 [add_forward_monad_depend]: 1.155e-05 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 2.397e-05 [cse]: 4.168e-05 [replace_applicator]: 2.261e-05 [Cycle 2]: 0.00037608, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 5.37999e-06 [a_1]: 0.00010093 [with_stream_mark]: 1.969e-05 [recompute_prepare]: 6.52001e-06 [updatestate_depend_eliminate]: 3.82998e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 5.47999e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 4.54002e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.847e-05 [j_node_and_user_rematch]: 9.37999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.17999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 7.78001e-06 [cse]: 1.583e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.999e-05 [rewriter_after_opt_a]: 4.499e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00081185 [jit_opt_b]: 5.856e-05, [1] [Cycle 1]: 4.926e-05, [2] [frontend_op_eliminate]: 1.871e-05 [inline_after_opt_a]: 1.834e-05 [cconv]: 3.655e-05 [loop_unroll]: 0.00048579 [jit_opt_after_cconv]: 0.00017516, [1] [Cycle 1]: 0.00016785, [11] [c_1]: 2.121e-05 [parameter_eliminate]: 5.11997e-06 [updatestate_depend_eliminate]: 9.39998e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [cse]: 3.699e-05 [call_graph_tuple_transform]: 2.543e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 7.49977e-07 [switch_simplify]: 5.57999e-06 [remove_dup_value]: 1.696e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 5.92001e-06 [add_recomputation]: 0.00012276 [cse_after_recomputation]: 2.854e-05, [1] [Cycle 1]: 2.159e-05, [1] [cse]: 1.431e-05 [auto_monad_reorder]: 1.952e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 9.42999e-06 [opt_after_jit_grad]: 0.00055163 [symbol_engine_optimizer]: 8.165e-05, [1] [Cycle 1]: 7.36e-05, [6] [build]: 5.13002e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.52e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 9.43002e-06 [renormalize]: 8.89995e-07 [validate]: 4.82e-05 Sums bootstrap : 0.000356s : 1.18% type_inference : 0.023550s : 77.84% event_method : 0.000024s : 0.08% auto_monad : 0.000074s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000111s : 0.37% rewriter_before_opt_a : 0.000086s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000705s : 2.33% jit_opt_a.with_stream_mark : 0.000048s : 0.16% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.002450s : 8.10% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.10% jit_opt_a.cse : 0.000058s : 0.19% jit_opt_a.replace_applicator : 0.000029s : 0.09% py_interpret_to_execute_after_opt_a : 0.000020s : 0.07% rewriter_after_opt_a : 0.000045s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000812s : 2.68% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000037s : 0.12% loop_unroll : 0.000486s : 1.61% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000123s : 0.41% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000552s : 1.82% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.16% Time group info: ------[substitution.] 0.000262 23 0.96% : 0.000003s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 84.07% : 0.000220s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000006s : 4: substitution.remove_not_recompute_node 2.77% : 0.000007s : 2: substitution.replace_old_param 5.55% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023457 2 92.72% : 0.021750s : 1: type_inference.infer 7.28% : 0.001707s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.27% : 0.000054s : 4: replace.inline 32.73% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.27% : 0.000218s : 4: match.inline 5.73% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.70% : 0.000002s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.24% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 15: predicate.load_eliminater 1.77% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 3.21% : 0.000004s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 2.03% : 0.000003s : 18: predicate.replace_applicator 0.97% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.41% : 0.000002s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.43% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.39% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001068 13 43.19% : 0.000461s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.31% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.50% : 0.000550s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038177 72 0.33% : 0.000126s : 1: add_recomputation 0.20% : 0.000078s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.97% : 0.000372s : 1: bootstrap 0.10% : 0.000040s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000056s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 20.27% : 0.007737s : 1: jit_opt_a 0.47% : 0.000178s : 1: jit_opt_after_cconv 0.16% : 0.000062s : 1: jit_opt_b 1.30% : 0.000496s : 1: loop_unroll 2.17% : 0.000827s : 1: mutable_eliminate 2.50% : 0.000953s : 26: opt.transform.jit_opt_a 0.14% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000022s : 1: opt.transform.mutable_eliminate 0.07% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.47% : 0.000561s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000115s : 1: py_interpret_to_execute 0.06% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 4.81% : 0.001835s : 1: renormalize.infer 1.57% : 0.000601s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000049s : 1: rewriter_after_opt_a 0.23% : 0.000089s : 1: rewriter_before_opt_a 0.22% : 0.000085s : 1: symbol_engine_optimizer 61.76% : 0.023576s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.678.646 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065ee0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.679.256 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0436242, [30] [bootstrap]: 0.00037874 [type_inference]: 0.0341067 [event_method]: 2.634e-05 [auto_monad]: 7.692e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 0.00025346 [rewriter_before_opt_a]: 9.83e-05 [expand_dump_flag]: 4.05e-06 [jit_opt_a]: 0.00654534, [2] [Cycle 1]: 0.00219055, [27] [switch_simplify]: 5.658e-05 [loop_unroll]: 2.997e-05 [a_1]: 0.00054086 [with_stream_mark]: 1.766e-05 [recompute_prepare]: 7.75e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.49e-06 [renormalize]: 0.00121114 [add_forward_monad_depend]: 5.07e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.455e-05 [cse]: 3.332e-05 [replace_applicator]: 1.288e-05 [Cycle 2]: 0.00031921, [27] [switch_simplify]: 5.91003e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.121e-05 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.296e-05 [j_node_and_user_rematch]: 8.27998e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 6.96001e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.62001e-06 [cse]: 1.251e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 1.208e-05 [rewriter_after_opt_a]: 3.633e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00054675 [jit_opt_b]: 5.037e-05, [1] [Cycle 1]: 4.404e-05, [2] [frontend_op_eliminate]: 1.76e-05 [inline_after_opt_a]: 1.571e-05 [cconv]: 2.429e-05 [loop_unroll]: 0.00042074 [jit_opt_after_cconv]: 0.00014042, [1] [Cycle 1]: 0.00013471, [11] [c_1]: 2.162e-05 [parameter_eliminate]: 2.45002e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.093e-05 [call_graph_tuple_transform]: 1.832e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.638e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 5.58002e-06 [add_recomputation]: 4.725e-05 [cse_after_recomputation]: 2.246e-05, [1] [Cycle 1]: 1.714e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.692e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00045566 [symbol_engine_optimizer]: 8.874e-05, [1] [Cycle 1]: 8.258e-05, [6] [build]: 3.37002e-06 [elim_shapecalc]: 2.336e-05 [elim_not_effective]: 1.313e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.39992e-07 [validate]: 3.733e-05 Sums bootstrap : 0.000379s : 0.97% type_inference : 0.034107s : 87.44% event_method : 0.000026s : 0.07% auto_monad : 0.000077s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000253s : 0.65% rewriter_before_opt_a : 0.000098s : 0.25% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000632s : 1.62% jit_opt_a.with_stream_mark : 0.000027s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001211s : 3.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000046s : 0.12% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000036s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000547s : 1.40% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000024s : 0.06% loop_unroll : 0.000421s : 1.08% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000047s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 1.17% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000023s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.10% Time group info: ------[substitution.] 0.000203 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 3: substitution.graph_param_transform 84.17% : 0.000171s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000004s : 2: substitution.replace_old_param 5.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034012 2 91.76% : 0.031210s : 1: type_inference.infer 8.24% : 0.002802s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.12% : 0.000052s : 4: replace.inline 31.88% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 94.09% : 0.000168s : 4: match.inline 5.91% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.92% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.41% : 0.000002s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000009s : 53: predicate.switch_simplify 1.53% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.91% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001098 13 38.28% : 0.000420s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.89% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.83% : 0.000646s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045753 72 0.11% : 0.000050s : 1: add_recomputation 0.18% : 0.000080s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.85% : 0.000391s : 1: bootstrap 0.06% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.31% : 0.006548s : 1: jit_opt_a 0.31% : 0.000143s : 1: jit_opt_after_cconv 0.12% : 0.000053s : 1: jit_opt_b 0.94% : 0.000429s : 1: loop_unroll 1.21% : 0.000555s : 1: mutable_eliminate 1.85% : 0.000849s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000048s : 4: opt.transform.symbol_engine_opt 1.01% : 0.000464s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.57% : 0.000259s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.55% : 0.000710s : 1: renormalize.infer 1.08% : 0.000494s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000039s : 1: rewriter_after_opt_a 0.23% : 0.000104s : 1: rewriter_before_opt_a 0.20% : 0.000091s : 1: symbol_engine_optimizer 74.59% : 0.034129s : 1: type_inference TotalTime = 0.0384395, [30] [bootstrap]: 0.00029087 [type_inference]: 0.00520473 [event_method]: 1.918e-05 [auto_monad]: 6.308e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.55997e-06 [py_interpret_to_execute]: 4.443e-05 [rewriter_before_opt_a]: 7.443e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.0307655, [2] [Cycle 1]: 0.00213136, [27] [switch_simplify]: 7.216e-05 [loop_unroll]: 3.281e-05 [a_1]: 0.00060418 [with_stream_mark]: 2.283e-05 [recompute_prepare]: 7.34002e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00107105 [add_forward_monad_depend]: 5.16002e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 2.881e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00038966, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.00001e-06 [a_1]: 0.00015575 [with_stream_mark]: 1.022e-05 [recompute_prepare]: 5.97001e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 4.95999e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.54002e-06 [merge_forward]: 2.43002e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.21e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.25003e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.41998e-06 [cse]: 1.344e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.109e-05 [rewriter_after_opt_a]: 3.443e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.00047216 [jit_opt_b]: 4.88e-05, [1] [Cycle 1]: 4.24e-05, [2] [frontend_op_eliminate]: 1.663e-05 [inline_after_opt_a]: 1.517e-05 [cconv]: 2.396e-05 [loop_unroll]: 0.00039922 [jit_opt_after_cconv]: 0.00013307, [1] [Cycle 1]: 0.00012652, [11] [c_1]: 2.024e-05 [parameter_eliminate]: 2.26003e-06 [updatestate_depend_eliminate]: 5.44998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.762e-05 [call_graph_tuple_transform]: 1.725e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.10999e-06 [remove_dup_value]: 1.457e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 5.22e-06 [add_recomputation]: 4.863e-05 [cse_after_recomputation]: 2.29e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.174e-05 [auto_monad_reorder]: 1.625e-05 [get_jit_bprop_graph]: 2.03997e-06 [rewriter_after_jit_bprop_graph]: 4.61002e-06 [opt_after_jit_grad]: 0.00043835 [symbol_engine_optimizer]: 6.908e-05, [1] [Cycle 1]: 6.348e-05, [6] [build]: 3.17997e-06 [elim_shapecalc]: 7.34002e-06 [elim_not_effective]: 1.193e-05 [opt_reshape]: 5.80002e-06 [fold_const_symbol]: 8.44002e-06 [renormalize]: 3.29979e-07 [validate]: 3.391e-05 Sums bootstrap : 0.000291s : 3.02% type_inference : 0.005205s : 54.11% event_method : 0.000019s : 0.20% auto_monad : 0.000063s : 0.66% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000044s : 0.46% rewriter_before_opt_a : 0.000074s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000078s : 0.81% jit_opt_a.loop_unroll : 0.000038s : 0.39% jit_opt_a.a_1 : 0.000760s : 7.90% jit_opt_a.with_stream_mark : 0.000033s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.001071s : 11.14% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.22% jit_opt_a.cse : 0.000042s : 0.44% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000034s : 0.36% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000472s : 4.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000024s : 0.25% loop_unroll : 0.000399s : 4.15% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000049s : 0.51% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000438s : 4.56% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.35% Time group info: ------[substitution.] 0.000243 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000005s : 3: substitution.graph_param_transform 86.63% : 0.000210s : 4: substitution.inline 1.11% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.33% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005134 2 79.24% : 0.004068s : 1: type_inference.infer 20.76% : 0.001066s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.23% : 0.000061s : 4: replace.inline 30.77% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.63% : 0.000208s : 4: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.13% : 0.000003s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.47% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.24% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.51% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000010s : 53: predicate.switch_simplify 1.66% : 0.000002s : 10: predicate.tile_eliminate 1.73% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000787 13 49.17% : 0.000387s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.18% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.64% : 0.000359s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040551 72 0.13% : 0.000052s : 1: add_recomputation 0.16% : 0.000066s : 1: auto_monad 0.05% : 0.000019s : 1: auto_monad_reorder 0.76% : 0.000309s : 1: bootstrap 0.07% : 0.000026s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000021s : 1: environ_conv 0.06% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 75.88% : 0.030770s : 1: jit_opt_a 0.33% : 0.000136s : 1: jit_opt_after_cconv 0.13% : 0.000051s : 1: jit_opt_b 1.00% : 0.000406s : 1: loop_unroll 1.18% : 0.000480s : 1: mutable_eliminate 2.44% : 0.000988s : 26: opt.transform.jit_opt_a 0.11% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000012s : 1: opt.transform.mutable_eliminate 0.05% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.10% : 0.000445s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000047s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.43% : 0.000580s : 1: renormalize.infer 1.19% : 0.000483s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000037s : 1: rewriter_after_opt_a 0.19% : 0.000077s : 1: rewriter_before_opt_a 0.18% : 0.000072s : 1: symbol_engine_optimizer 12.86% : 0.005215s : 1: type_inference TotalTime = 0.276987, [30] [bootstrap]: 0.00028667 [type_inference]: 0.259559 [event_method]: 3.225e-05 [auto_monad]: 8.841e-05 [graph_reusing]: 6.19999e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00080512 [rewriter_before_opt_a]: 0.00011535 [expand_dump_flag]: 4.42e-06 [jit_opt_a]: 0.0131422, [2] [Cycle 1]: 0.00869968, [27] [switch_simplify]: 7.83e-05 [loop_unroll]: 3.428e-05 [a_1]: 0.00084422 [with_stream_mark]: 3.131e-05 [recompute_prepare]: 1.206e-05 [updatestate_depend_eliminate]: 5.55001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 8.62e-06 [updatestate_useless_node_eliminater]: 6.45002e-06 [accelerated_algorithm]: 7.04001e-06 [meta_shard_fg_expand]: 2.79001e-06 [get_grad_eliminate_]: 7.80998e-06 [merge_forward]: 5.29e-06 [cell_reuse_recompute_pass]: 1.83002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.921e-05 [j_node_and_user_rematch]: 1.154e-05 [meta_fg_expand]: 2.86999e-06 [replace_old_param]: 1.258e-05 [inline_without_move]: 7.45e-06 [renormalize]: 0.00721732 [add_forward_monad_depend]: 1.486e-05 [auto_monad_grad]: 3.22002e-06 [auto_monad_eliminator]: 2.735e-05 [cse]: 4.461e-05 [replace_applicator]: 3.036e-05 [Cycle 2]: 0.00043452, [27] [switch_simplify]: 8.15e-06 [loop_unroll]: 7.09001e-06 [a_1]: 0.00013501 [with_stream_mark]: 1.681e-05 [recompute_prepare]: 6.97002e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 4.79002e-06 [cell_reuse_recompute_pass]: 3.06999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.557e-05 [j_node_and_user_rematch]: 1.055e-05 [meta_fg_expand]: 3.21999e-06 [replace_old_param]: 1.149e-05 [inline_without_move]: 6.10002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.31e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 7.84002e-06 [cse]: 1.753e-05 [replace_applicator]: 7.18e-06 [py_interpret_to_execute_after_opt_a]: 2.154e-05 [rewriter_after_opt_a]: 4.886e-05 [convert_after_rewriter]: 7.7e-06 [order_py_execute_after_rewriter]: 5.31002e-06 [mutable_eliminate]: 0.00083076 [jit_opt_b]: 0.00012789, [1] [Cycle 1]: 0.00011838, [2] [frontend_op_eliminate]: 8.252e-05 [inline_after_opt_a]: 2.048e-05 [cconv]: 3.97e-05 [loop_unroll]: 0.00049946 [jit_opt_after_cconv]: 0.00019604, [1] [Cycle 1]: 0.00018759, [11] [c_1]: 2.633e-05 [parameter_eliminate]: 5.05001e-06 [updatestate_depend_eliminate]: 1.165e-05 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 4.078e-05 [call_graph_tuple_transform]: 2.682e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.70002e-06 [remove_dup_value]: 2.048e-05 [partial_unused_args_eliminate]: 2.58003e-06 [environ_conv]: 1.096e-05 [add_recomputation]: 5.813e-05 [cse_after_recomputation]: 2.797e-05, [1] [Cycle 1]: 2.129e-05, [1] [cse]: 1.427e-05 [auto_monad_reorder]: 1.691e-05 [get_jit_bprop_graph]: 4.48001e-06 [rewriter_after_jit_bprop_graph]: 6.73e-06 [opt_after_jit_grad]: 0.0005112 [symbol_engine_optimizer]: 8.968e-05, [1] [Cycle 1]: 8.281e-05, [6] [build]: 5.81e-06 [elim_shapecalc]: 1.171e-05 [elim_not_effective]: 1.861e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 1.219e-05 [renormalize]: 5.50004e-07 [validate]: 0.00019447 Sums bootstrap : 0.000287s : 0.11% type_inference : 0.259559s : 95.34% event_method : 0.000032s : 0.01% auto_monad : 0.000088s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000805s : 0.30% rewriter_before_opt_a : 0.000115s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000979s : 0.36% jit_opt_a.with_stream_mark : 0.000048s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.007217s : 2.65% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.01% jit_opt_a.cse : 0.000062s : 0.02% jit_opt_a.replace_applicator : 0.000038s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000049s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000831s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000083s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000040s : 0.01% loop_unroll : 0.000499s : 0.18% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000511s : 0.19% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000194s : 0.07% Time group info: ------[substitution.] 0.000351 25 1.65% : 0.000006s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.70% : 0.000006s : 4: substitution.graph_param_transform 86.90% : 0.000305s : 5: substitution.inline 1.44% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000007s : 4: substitution.remove_not_recompute_node 2.27% : 0.000008s : 2: substitution.replace_old_param 3.83% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.259419 2 80.90% : 0.209871s : 1: type_inference.infer 19.10% : 0.049547s : 1: type_inference.specialize ------[replace.] 0.000159 7 76.27% : 0.000121s : 5: replace.inline 23.73% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000314 7 96.12% : 0.000302s : 5: match.inline 3.88% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_depend_swap 1.16% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.47% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.35% : 0.000008s : 28: predicate.inline 1.04% : 0.000002s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 19: predicate.load_eliminater 2.66% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 2.68% : 0.000004s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000003s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 23: predicate.replace_applicator 1.00% : 0.000002s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 20: predicate.switch_defer_inline 1.89% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000011s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.22% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002596 25 65.00% : 0.001687s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.70% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.30% : 0.000812s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.285487 72 0.02% : 0.000061s : 1: add_recomputation 0.03% : 0.000092s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.11% : 0.000306s : 1: bootstrap 0.01% : 0.000043s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000038s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.60% : 0.013146s : 1: jit_opt_a 0.07% : 0.000199s : 1: jit_opt_after_cconv 0.05% : 0.000131s : 1: jit_opt_b 0.18% : 0.000511s : 1: loop_unroll 0.30% : 0.000847s : 1: mutable_eliminate 0.45% : 0.001285s : 26: opt.transform.jit_opt_a 0.02% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000095s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000525s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000812s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.83% : 0.002384s : 1: renormalize.infer 1.69% : 0.004816s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000053s : 1: rewriter_after_opt_a 0.04% : 0.000121s : 1: rewriter_before_opt_a 0.03% : 0.000092s : 1: symbol_engine_optimizer 90.93% : 0.259585s : 1: type_inference TotalTime = 0.0339386, [30] [bootstrap]: 0.00031242 [type_inference]: 0.0233488 [event_method]: 1.953e-05 [auto_monad]: 6.369e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00012791 [rewriter_before_opt_a]: 8.404e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.0076213, [2] [Cycle 1]: 0.00392201, [27] [switch_simplify]: 4.965e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00051337 [with_stream_mark]: 1.385e-05 [recompute_prepare]: 7.37997e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 2.21998e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.93998e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00298852 [add_forward_monad_depend]: 5.70001e-06 [auto_monad_grad]: 2.84999e-06 [auto_monad_eliminator]: 1.476e-05 [cse]: 3.227e-05 [replace_applicator]: 1.408e-05 [Cycle 2]: 0.00032572, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.124e-05 [with_stream_mark]: 1.029e-05 [recompute_prepare]: 5.47999e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.16002e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 4.84998e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 7.90998e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 7.73999e-06 [inline_without_move]: 4.72e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.359e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 1.212e-05 [rewriter_after_opt_a]: 3.649e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00064386 [jit_opt_b]: 5.187e-05, [1] [Cycle 1]: 4.547e-05, [2] [frontend_op_eliminate]: 1.808e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 2.545e-05 [loop_unroll]: 0.0004366 [jit_opt_after_cconv]: 0.00014366, [1] [Cycle 1]: 0.00013757, [11] [c_1]: 2.145e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.127e-05 [call_graph_tuple_transform]: 1.978e-05 [tuple_list_get_item_eliminator]: 5.91e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.83002e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 5.058e-05 [cse_after_recomputation]: 2.248e-05, [1] [Cycle 1]: 1.73e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.744e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 5.94999e-06 [opt_after_jit_grad]: 0.0004924 [symbol_engine_optimizer]: 0.00014875, [1] [Cycle 1]: 0.00014215, [6] [build]: 3.61999e-06 [elim_shapecalc]: 8.23001e-06 [elim_not_effective]: 8.276e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 1.024e-05 [renormalize]: 1.05999e-06 [validate]: 4.327e-05 Sums bootstrap : 0.000312s : 1.04% type_inference : 0.023349s : 77.86% event_method : 0.000020s : 0.07% auto_monad : 0.000064s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000128s : 0.43% rewriter_before_opt_a : 0.000084s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.19% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000605s : 2.02% jit_opt_a.with_stream_mark : 0.000024s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.002989s : 9.97% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000046s : 0.15% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000036s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000644s : 2.15% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000025s : 0.08% loop_unroll : 0.000437s : 1.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000492s : 1.64% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000083s : 0.28% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.14% Time group info: ------[substitution.] 0.000187 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 1.09% : 0.000002s : 2: substitution.fold_const_symbol 2.78% : 0.000005s : 3: substitution.graph_param_transform 82.95% : 0.000155s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.26% : 0.000004s : 2: substitution.replace_old_param 5.84% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023276 2 91.36% : 0.021265s : 1: type_inference.infer 8.64% : 0.002011s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.84% : 0.000048s : 4: replace.inline 31.16% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 93.99% : 0.000152s : 4: match.inline 6.01% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.51% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 1.07% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.17% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.41% : 0.000002s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.45% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 1.09% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000973 13 41.79% : 0.000407s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.11% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.09% : 0.000536s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037865 72 0.14% : 0.000053s : 1: add_recomputation 0.18% : 0.000067s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.87% : 0.000329s : 1: bootstrap 0.07% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 20.14% : 0.007625s : 1: jit_opt_a 0.39% : 0.000146s : 1: jit_opt_after_cconv 0.14% : 0.000054s : 1: jit_opt_b 1.18% : 0.000445s : 1: loop_unroll 1.72% : 0.000653s : 1: mutable_eliminate 2.15% : 0.000815s : 26: opt.transform.jit_opt_a 0.13% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.28% : 0.000105s : 4: opt.transform.symbol_engine_opt 1.32% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000132s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 6.59% : 0.002495s : 1: renormalize.infer 1.28% : 0.000486s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000040s : 1: rewriter_after_opt_a 0.23% : 0.000088s : 1: rewriter_before_opt_a 0.40% : 0.000152s : 1: symbol_engine_optimizer 61.70% : 0.023363s : 1: type_inference TotalTime = 0.145485, [30] [bootstrap]: 0.00019763 [type_inference]: 0.119069 [event_method]: 0.00045844 [auto_monad]: 0.00010794 [graph_reusing]: 7.16999e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00010164 [rewriter_before_opt_a]: 0.00012905 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.0231571, [3] [Cycle 1]: 0.0158487, [27] [switch_simplify]: 7.46e-05 [loop_unroll]: 4.553e-05 [a_1]: 0.00095888 [with_stream_mark]: 3.142e-05 [recompute_prepare]: 2.032e-05 [updatestate_depend_eliminate]: 8.81997e-06 [updatestate_assign_eliminate]: 7.09001e-06 [updatestate_loads_eliminate]: 7.31001e-06 [parameter_eliminate]: 2.79999e-06 [specialize_transform]: 1.489e-05 [updatestate_useless_node_eliminater]: 1.374e-05 [accelerated_algorithm]: 1.405e-05 [meta_shard_fg_expand]: 3.93999e-06 [get_grad_eliminate_]: 1.36e-05 [merge_forward]: 9.04e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.915e-05 [j_node_and_user_rematch]: 2.458e-05 [meta_fg_expand]: 0.00175508 [replace_old_param]: 7.048e-05 [inline_without_move]: 5.859e-05 [renormalize]: 0.0120664 [add_forward_monad_depend]: 1.014e-05 [auto_monad_grad]: 5.24998e-06 [auto_monad_eliminator]: 5.575e-05 [cse]: 0.00024264 [replace_applicator]: 8.147e-05 [Cycle 2]: 0.003771, [27] [switch_simplify]: 4.343e-05 [loop_unroll]: 4.162e-05 [a_1]: 0.00114016 [with_stream_mark]: 1.458e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 6.43003e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 0.00014594 [replace_old_param]: 8.77e-06 [inline_without_move]: 6.26998e-06 [renormalize]: 0.00206934 [add_forward_monad_depend]: 6.91999e-06 [auto_monad_grad]: 2.20002e-06 [auto_monad_eliminator]: 1.216e-05 [cse]: 2.246e-05 [replace_applicator]: 1.416e-05 [Cycle 3]: 0.00026155, [27] [switch_simplify]: 4.58001e-06 [loop_unroll]: 3.71999e-06 [a_1]: 4.519e-05 [with_stream_mark]: 1.236e-05 [recompute_prepare]: 3.51999e-06 [updatestate_depend_eliminate]: 2.27999e-06 [updatestate_assign_eliminate]: 2.06e-06 [updatestate_loads_eliminate]: 1.47999e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 3.91999e-06 [updatestate_useless_node_eliminater]: 3.55e-06 [accelerated_algorithm]: 3.65e-06 [meta_shard_fg_expand]: 1.96998e-06 [get_grad_eliminate_]: 3.06999e-06 [merge_forward]: 2.21998e-06 [cell_reuse_recompute_pass]: 2.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.148e-05 [j_node_and_user_rematch]: 5.52001e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 3.45e-06 [inline_without_move]: 3.21999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.57999e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 3.33e-06 [cse]: 8.86997e-06 [replace_applicator]: 3.66999e-06 [py_interpret_to_execute_after_opt_a]: 1.168e-05 [rewriter_after_opt_a]: 3.395e-05 [convert_after_rewriter]: 5.81998e-06 [order_py_execute_after_rewriter]: 4.25999e-06 [mutable_eliminate]: 0.0007163 [jit_opt_b]: 4.457e-05, [1] [Cycle 1]: 3.74e-05, [2] [frontend_op_eliminate]: 1.152e-05 [inline_after_opt_a]: 1.295e-05 [cconv]: 2.568e-05 [loop_unroll]: 0.00042496 [jit_opt_after_cconv]: 0.00013391, [1] [Cycle 1]: 0.00012781, [11] [c_1]: 1.426e-05 [parameter_eliminate]: 3.48e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 1.77999e-06 [updatestate_loads_eliminate]: 1.55999e-06 [cse]: 2.043e-05 [call_graph_tuple_transform]: 1.595e-05 [tuple_list_get_item_eliminator]: 5.02e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 1.00999e-06 [switch_simplify]: 3.58999e-06 [remove_dup_value]: 1.4e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 4.68999e-06 [add_recomputation]: 3.417e-05 [cse_after_recomputation]: 2.311e-05, [1] [Cycle 1]: 1.55e-05, [1] [cse]: 8.52e-06 [auto_monad_reorder]: 1.239e-05 [get_jit_bprop_graph]: 1.78997e-06 [rewriter_after_jit_bprop_graph]: 5.29e-06 [opt_after_jit_grad]: 0.00045511 [symbol_engine_optimizer]: 6.751e-05, [1] [Cycle 1]: 6.15e-05, [6] [build]: 3.27002e-06 [elim_shapecalc]: 5.95002e-06 [elim_not_effective]: 1.02e-05 [opt_reshape]: 5.10001e-06 [fold_const_symbol]: 6.36998e-06 [renormalize]: 6.69999e-07 [validate]: 5.29e-05 Sums bootstrap : 0.000198s : 0.14% type_inference : 0.119069s : 84.21% event_method : 0.000458s : 0.32% auto_monad : 0.000108s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000102s : 0.07% rewriter_before_opt_a : 0.000129s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000123s : 0.09% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002144s : 1.52% jit_opt_a.with_stream_mark : 0.000058s : 0.04% jit_opt_a.recompute_prepare : 0.000032s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000015s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.03% jit_opt_a.meta_fg_expand : 0.001903s : 1.35% jit_opt_a.replace_old_param : 0.000083s : 0.06% jit_opt_a.inline_without_move : 0.000068s : 0.05% jit_opt_a.renormalize : 0.014136s : 10.00% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.01% jit_opt_a.auto_monad_grad : 0.000008s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000071s : 0.05% jit_opt_a.cse : 0.000274s : 0.19% jit_opt_a.replace_applicator : 0.000099s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000716s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000425s : 0.30% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000034s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.32% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.04% Time group info: ------[substitution.] 0.000536 104 0.29% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.93% : 0.000005s : 1: substitution.graph_param_transform 66.27% : 0.000355s : 13: substitution.inline 3.06% : 0.000016s : 2: substitution.inline_without_move 1.58% : 0.000008s : 12: substitution.j_node_and_user_rematch 1.97% : 0.000011s : 7: substitution.minmaximum_grad 1.45% : 0.000008s : 5: substitution.partial_eliminate 1.83% : 0.000010s : 12: substitution.remove_not_recompute_node 5.47% : 0.000029s : 10: substitution.replace_applicator 1.14% : 0.000006s : 10: substitution.replace_old_param 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.95% : 0.000005s : 1: substitution.tile_eliminate 4.02% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.92% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.49% : 0.000040s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118982 2 96.85% : 0.115230s : 1: type_inference.infer 3.15% : 0.003752s : 1: type_inference.specialize ------[replace.] 0.000179 20 64.64% : 0.000116s : 13: replace.inline 35.36% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000369 20 94.34% : 0.000348s : 13: match.inline 5.66% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000366 2544 1.57% : 0.000006s : 44: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 44: predicate.addn_check_dump 1.71% : 0.000006s : 44: predicate.addn_zero_filter 2.14% : 0.000008s : 44: predicate.arithmetic_simplify 1.54% : 0.000006s : 44: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.44% : 0.000005s : 44: predicate.compare_switch_simplify 1.47% : 0.000005s : 44: predicate.depend_value_elim 1.44% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.51% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.48% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.31% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.55% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.47% : 0.000005s : 44: predicate.environ_get_depend_swap 1.48% : 0.000005s : 44: predicate.environ_get_eliminate 1.51% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.79% : 0.000003s : 17: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.57% : 0.000017s : 66: predicate.inline 1.98% : 0.000007s : 45: predicate.inline_without_move 0.34% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.02% : 0.000004s : 17: predicate.less_batch_normalization 1.85% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.82% : 0.000007s : 52: predicate.load_eliminater 0.25% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.47% : 0.000013s : 92: predicate.loop_unroll_before_grad 1.71% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.57% : 0.000006s : 44: predicate.merge_addn 1.45% : 0.000005s : 44: predicate.minmaximum_grad 0.49% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.34% : 0.000009s : 52: predicate.partial_eliminate 1.47% : 0.000005s : 44: predicate.print_const_string_wrapper 2.22% : 0.000008s : 44: predicate.reduce_eliminate 1.81% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000002s : 17: predicate.remove_not_recompute_node 2.87% : 0.000011s : 96: predicate.replace_applicator 1.12% : 0.000004s : 45: predicate.replace_old_param 0.12% : 0.000000s : 1: predicate.reset_defer_inline 1.53% : 0.000006s : 44: predicate.reshape_eliminate 1.50% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.25% : 0.000001s : 1: predicate.row_tensor_eliminate 1.57% : 0.000006s : 44: predicate.same_eliminate 0.48% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 17: predicate.specialize_transform 1.74% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.84% : 0.000010s : 64: predicate.switch_defer_inline 2.58% : 0.000009s : 64: predicate.switch_layer_defer_inline 6.54% : 0.000024s : 157: predicate.switch_simplify 1.57% : 0.000006s : 44: predicate.tile_eliminate 1.50% : 0.000005s : 44: predicate.transpose_eliminate 1.86% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.82% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.15% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.89% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.84% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.88% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.78% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.92% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003882 45 73.35% : 0.002848s : 28: func_graph_cloner_run.FuncGraphClonerGraph 26.65% : 0.001035s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.162399 87 0.02% : 0.000037s : 1: add_recomputation 0.07% : 0.000114s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.13% : 0.000213s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.29% : 0.000466s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.26% : 0.023161s : 1: jit_opt_a 0.08% : 0.000136s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.27% : 0.000433s : 1: loop_unroll 0.45% : 0.000725s : 1: mutable_eliminate 1.72% : 0.002786s : 39: opt.transform.jit_opt_a 0.02% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000463s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000106s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.21% : 0.011713s : 2: renormalize.infer 1.48% : 0.002405s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000132s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 73.33% : 0.119086s : 1: type_inference TotalTime = 0.0142645, [30] [bootstrap]: 0.00034568 [type_inference]: 0.00519337 [event_method]: 1.941e-05 [auto_monad]: 6.383e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 3.626e-05 [rewriter_before_opt_a]: 7.339e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00627689, [2] [Cycle 1]: 0.00231477, [27] [switch_simplify]: 6.194e-05 [loop_unroll]: 2.919e-05 [a_1]: 0.00058336 [with_stream_mark]: 2.429e-05 [recompute_prepare]: 8.48999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 5.62001e-06 [renormalize]: 0.00123575 [add_forward_monad_depend]: 8.82e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.006e-05 [cse]: 3.736e-05 [replace_applicator]: 1.86e-05 [Cycle 2]: 0.00033894, [27] [switch_simplify]: 5.65001e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.26e-05 [with_stream_mark]: 1.286e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 4.82998e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.67998e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 5.36998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09003e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.73e-06 [cse]: 1.279e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.472e-05 [rewriter_after_opt_a]: 3.892e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00065804 [jit_opt_b]: 5.068e-05, [1] [Cycle 1]: 4.382e-05, [2] [frontend_op_eliminate]: 1.573e-05 [inline_after_opt_a]: 1.653e-05 [cconv]: 3.024e-05 [loop_unroll]: 0.00041207 [jit_opt_after_cconv]: 0.00015843, [1] [Cycle 1]: 0.00015215, [11] [c_1]: 2.114e-05 [parameter_eliminate]: 3.34001e-06 [updatestate_depend_eliminate]: 7.04001e-06 [updatestate_assign_eliminate]: 8.72e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.636e-05 [call_graph_tuple_transform]: 2.046e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.672e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 6.83e-06 [add_recomputation]: 5.644e-05 [cse_after_recomputation]: 2.467e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.724e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.51999e-06 [opt_after_jit_grad]: 0.00044749 [symbol_engine_optimizer]: 7.088e-05, [1] [Cycle 1]: 6.462e-05, [6] [build]: 3.73999e-06 [elim_shapecalc]: 7.35998e-06 [elim_not_effective]: 1.178e-05 [opt_reshape]: 5.35999e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.99974e-07 [validate]: 4.356e-05 Sums bootstrap : 0.000346s : 3.45% type_inference : 0.005193s : 51.77% event_method : 0.000019s : 0.19% auto_monad : 0.000064s : 0.64% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.36% rewriter_before_opt_a : 0.000073s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.67% jit_opt_a.loop_unroll : 0.000034s : 0.34% jit_opt_a.a_1 : 0.000676s : 6.74% jit_opt_a.with_stream_mark : 0.000037s : 0.37% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.001236s : 12.32% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.10% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.27% jit_opt_a.cse : 0.000050s : 0.50% jit_opt_a.replace_applicator : 0.000024s : 0.24% py_interpret_to_execute_after_opt_a : 0.000015s : 0.15% rewriter_after_opt_a : 0.000039s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000658s : 6.56% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000030s : 0.30% loop_unroll : 0.000412s : 4.11% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000009s : 0.09% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000056s : 0.56% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000017s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000447s : 4.46% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.43% Time group info: ------[substitution.] 0.000253 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000005s : 3: substitution.graph_param_transform 86.09% : 0.000218s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 5.03% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005125 2 83.27% : 0.004268s : 1: type_inference.infer 16.73% : 0.000857s : 1: type_inference.specialize ------[replace.] 0.000071 6 70.26% : 0.000050s : 4: replace.inline 29.74% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.84% : 0.000216s : 4: match.inline 5.16% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.12% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.53% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.69% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.56% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.50% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 22: predicate.inline 1.11% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.01% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.42% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.42% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.24% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000701 13 53.71% : 0.000376s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.00% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.29% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016456 72 0.37% : 0.000060s : 1: add_recomputation 0.41% : 0.000067s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 2.19% : 0.000360s : 1: bootstrap 0.20% : 0.000033s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.17% : 0.006281s : 1: jit_opt_a 0.98% : 0.000161s : 1: jit_opt_after_cconv 0.32% : 0.000053s : 1: jit_opt_b 2.56% : 0.000421s : 1: loop_unroll 4.06% : 0.000669s : 1: mutable_eliminate 5.50% : 0.000905s : 26: opt.transform.jit_opt_a 0.30% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000456s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000039s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.64% : 0.000434s : 1: renormalize.infer 4.82% : 0.000793s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000042s : 1: rewriter_after_opt_a 0.46% : 0.000077s : 1: rewriter_before_opt_a 0.45% : 0.000073s : 1: symbol_engine_optimizer 31.68% : 0.005212s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.872.265 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:33.872.927 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0325333, [30] [bootstrap]: 0.00040688 [type_inference]: 0.022694 [event_method]: 2.049e-05 [auto_monad]: 6.551e-05 [graph_reusing]: 6.06998e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00012945 [rewriter_before_opt_a]: 8.39e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00674149, [2] [Cycle 1]: 0.00236481, [27] [switch_simplify]: 5.336e-05 [loop_unroll]: 2.97e-05 [a_1]: 0.00053095 [with_stream_mark]: 1.713e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.368e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.56998e-06 [renormalize]: 0.00139899 [add_forward_monad_depend]: 5.58997e-06 [auto_monad_grad]: 2.20002e-06 [auto_monad_eliminator]: 1.458e-05 [cse]: 3.248e-05 [replace_applicator]: 1.477e-05 [Cycle 2]: 0.00056848, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00030276 [with_stream_mark]: 1.298e-05 [recompute_prepare]: 7.72002e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.349e-05 [j_node_and_user_rematch]: 8.34002e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.59002e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 1.54e-06 [auto_monad_eliminator]: 8.32e-06 [cse]: 1.77e-05 [replace_applicator]: 5.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.278e-05 [rewriter_after_opt_a]: 3.856e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00062951 [jit_opt_b]: 5.292e-05, [1] [Cycle 1]: 4.542e-05, [2] [frontend_op_eliminate]: 1.725e-05 [inline_after_opt_a]: 1.729e-05 [cconv]: 2.555e-05 [loop_unroll]: 0.00047676 [jit_opt_after_cconv]: 0.0001588, [1] [Cycle 1]: 0.00015249, [11] [c_1]: 2.192e-05 [parameter_eliminate]: 3.01001e-06 [updatestate_depend_eliminate]: 6.97002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.66999e-06 [cse]: 2.804e-05 [call_graph_tuple_transform]: 2.177e-05 [tuple_list_get_item_eliminator]: 5.48002e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.619e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.79999e-06 [add_recomputation]: 5.061e-05 [cse_after_recomputation]: 2.581e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.271e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.58002e-06 [opt_after_jit_grad]: 0.00050791 [symbol_engine_optimizer]: 0.00010452, [1] [Cycle 1]: 9.783e-05, [6] [build]: 4.23999e-06 [elim_shapecalc]: 8.12003e-06 [elim_not_effective]: 1.38e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 4.30009e-07 [validate]: 4.391e-05 Sums bootstrap : 0.000407s : 1.45% type_inference : 0.022694s : 80.81% event_method : 0.000020s : 0.07% auto_monad : 0.000066s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000129s : 0.46% rewriter_before_opt_a : 0.000084s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.21% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000834s : 2.97% jit_opt_a.with_stream_mark : 0.000030s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001399s : 4.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000050s : 0.18% jit_opt_a.replace_applicator : 0.000020s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000630s : 2.24% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000026s : 0.09% loop_unroll : 0.000477s : 1.70% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000051s : 0.18% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000508s : 1.81% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.16% Time group info: ------[substitution.] 0.000194 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.16% : 0.000006s : 3: substitution.graph_param_transform 82.12% : 0.000159s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.26% : 0.000004s : 2: substitution.replace_old_param 6.57% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022615 2 90.44% : 0.020452s : 1: type_inference.infer 9.56% : 0.002163s : 1: type_inference.specialize ------[replace.] 0.000079 6 66.67% : 0.000053s : 4: replace.inline 33.33% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.13% : 0.000157s : 4: match.inline 6.87% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.50% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 2.01% : 0.000002s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.89% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.05% : 0.000006s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.84% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001132 13 40.47% : 0.000458s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.57% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.96% : 0.000644s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035045 72 0.15% : 0.000054s : 1: add_recomputation 0.20% : 0.000069s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.22% : 0.000428s : 1: bootstrap 0.08% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.25% : 0.006746s : 1: jit_opt_a 0.46% : 0.000162s : 1: jit_opt_after_cconv 0.16% : 0.000056s : 1: jit_opt_b 1.39% : 0.000486s : 1: loop_unroll 1.83% : 0.000640s : 1: mutable_eliminate 3.00% : 0.001052s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.48% : 0.000517s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000133s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.38% : 0.000833s : 1: renormalize.infer 1.59% : 0.000558s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000041s : 1: rewriter_after_opt_a 0.25% : 0.000088s : 1: rewriter_before_opt_a 0.31% : 0.000107s : 1: symbol_engine_optimizer 64.80% : 0.022710s : 1: type_inference TotalTime = 0.0756337, [30] [bootstrap]: 0.00035397 [type_inference]: 0.0658981 [event_method]: 2.275e-05 [auto_monad]: 7.235e-05 [graph_reusing]: 6.63998e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00013335 [rewriter_before_opt_a]: 8.829e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00663124, [2] [Cycle 1]: 0.00236034, [27] [switch_simplify]: 6.669e-05 [loop_unroll]: 3.052e-05 [a_1]: 0.00061221 [with_stream_mark]: 2.421e-05 [recompute_prepare]: 8.05e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00125413 [add_forward_monad_depend]: 8.12e-06 [auto_monad_grad]: 3.3e-06 [auto_monad_eliminator]: 1.694e-05 [cse]: 3.721e-05 [replace_applicator]: 1.653e-05 [Cycle 2]: 0.00034252, [27] [switch_simplify]: 6.75998e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.6e-05 [with_stream_mark]: 1.213e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.75002e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 4.91997e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 2.10002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.91002e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.234e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.243e-05 [rewriter_after_opt_a]: 3.946e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00071501 [jit_opt_b]: 5.303e-05, [1] [Cycle 1]: 4.546e-05, [2] [frontend_op_eliminate]: 1.719e-05 [inline_after_opt_a]: 1.678e-05 [cconv]: 2.728e-05 [loop_unroll]: 0.00043258 [jit_opt_after_cconv]: 0.00015755, [1] [Cycle 1]: 0.0001511, [11] [c_1]: 2.228e-05 [parameter_eliminate]: 3.21999e-06 [updatestate_depend_eliminate]: 6.82002e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.848e-05 [call_graph_tuple_transform]: 2.062e-05 [tuple_list_get_item_eliminator]: 5.90002e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.573e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 6.68e-06 [add_recomputation]: 5.242e-05 [cse_after_recomputation]: 2.451e-05, [1] [Cycle 1]: 1.852e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.854e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.32001e-06 [opt_after_jit_grad]: 0.00047422 [symbol_engine_optimizer]: 0.00013216, [1] [Cycle 1]: 0.00012469, [6] [build]: 4.62e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.601e-05 [opt_reshape]: 6.82002e-06 [fold_const_symbol]: 1.037e-05 [renormalize]: 5.29981e-07 [validate]: 4.571e-05 Sums bootstrap : 0.000354s : 0.50% type_inference : 0.065898s : 92.77% event_method : 0.000023s : 0.03% auto_monad : 0.000072s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000133s : 0.19% rewriter_before_opt_a : 0.000088s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000708s : 1.00% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001254s : 1.77% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000050s : 0.07% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000715s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000433s : 0.61% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000474s : 0.67% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.06% Time group info: ------[substitution.] 0.000260 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 85.54% : 0.000223s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 2.38% : 0.000006s : 2: substitution.replace_old_param 5.03% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065803 2 97.35% : 0.064056s : 1: type_inference.infer 2.65% : 0.001747s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.81% : 0.000056s : 4: replace.inline 33.19% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.85% : 0.000220s : 4: match.inline 5.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.57% : 0.000002s : 10: predicate.addn_zero_filter 2.51% : 0.000003s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.63% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.86% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.95% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.87% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000978 13 44.37% : 0.000434s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.99% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.64% : 0.000486s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077888 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.48% : 0.000376s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.52% : 0.006635s : 1: jit_opt_a 0.21% : 0.000161s : 1: jit_opt_after_cconv 0.07% : 0.000056s : 1: jit_opt_b 0.57% : 0.000441s : 1: loop_unroll 0.93% : 0.000725s : 1: mutable_eliminate 1.21% : 0.000945s : 26: opt.transform.jit_opt_a 0.07% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000138s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.95% : 0.000743s : 1: renormalize.infer 0.64% : 0.000501s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000092s : 1: rewriter_before_opt_a 0.17% : 0.000135s : 1: symbol_engine_optimizer 84.63% : 0.065919s : 1: type_inference TotalTime = 0.0484975, [30] [bootstrap]: 0.00032278 [type_inference]: 0.0379823 [event_method]: 2.168e-05 [auto_monad]: 6.719e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00016227 [rewriter_before_opt_a]: 8.64e-05 [expand_dump_flag]: 2.90998e-06 [jit_opt_a]: 0.0069182, [2] [Cycle 1]: 0.00250026, [27] [switch_simplify]: 6.109e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00058697 [with_stream_mark]: 1.745e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00143495 [add_forward_monad_depend]: 8.37e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.905e-05 [cse]: 3.896e-05 [replace_applicator]: 1.939e-05 [Cycle 2]: 0.00035248, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.979e-05 [with_stream_mark]: 1.174e-05 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.665e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.387e-05 [replace_applicator]: 5.85002e-06 [py_interpret_to_execute_after_opt_a]: 1.682e-05 [rewriter_after_opt_a]: 4.6e-05 [convert_after_rewriter]: 7.61999e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00087456 [jit_opt_b]: 5.505e-05, [1] [Cycle 1]: 4.744e-05, [2] [frontend_op_eliminate]: 1.845e-05 [inline_after_opt_a]: 1.708e-05 [cconv]: 3.015e-05 [loop_unroll]: 0.00049116 [jit_opt_after_cconv]: 0.00016567, [1] [Cycle 1]: 0.00015867, [11] [c_1]: 2.275e-05 [parameter_eliminate]: 3.10998e-06 [updatestate_depend_eliminate]: 7.57002e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.375e-05 [call_graph_tuple_transform]: 2.13e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.98998e-06 [remove_dup_value]: 1.696e-05 [partial_unused_args_eliminate]: 2.06003e-06 [environ_conv]: 6.96001e-06 [add_recomputation]: 5.453e-05 [cse_after_recomputation]: 2.318e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 8.13999e-06 [opt_after_jit_grad]: 0.00065817 [symbol_engine_optimizer]: 0.00018231, [1] [Cycle 1]: 0.00017451, [6] [build]: 4.60001e-06 [elim_shapecalc]: 9.82999e-06 [elim_not_effective]: 0.00010526 [opt_reshape]: 8.00999e-06 [fold_const_symbol]: 1.303e-05 [renormalize]: 1.02e-06 [validate]: 5.75e-05 Sums bootstrap : 0.000323s : 0.74% type_inference : 0.037982s : 86.73% event_method : 0.000022s : 0.05% auto_monad : 0.000067s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000162s : 0.37% rewriter_before_opt_a : 0.000086s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.16% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000687s : 1.57% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001435s : 3.28% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.06% jit_opt_a.cse : 0.000053s : 0.12% jit_opt_a.replace_applicator : 0.000025s : 0.06% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000046s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000875s : 2.00% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000030s : 0.07% loop_unroll : 0.000491s : 1.12% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000658s : 1.50% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000105s : 0.24% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.13% Time group info: ------[substitution.] 0.000234 23 1.10% : 0.000003s : 2: substitution.elim_not_effective 1.00% : 0.000002s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 3: substitution.graph_param_transform 80.55% : 0.000189s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 9.13% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037893 2 92.93% : 0.035213s : 1: type_inference.infer 7.07% : 0.002681s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.41% : 0.000055s : 4: replace.inline 33.59% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 90.22% : 0.000186s : 4: match.inline 9.78% : 0.000020s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.62% : 0.000002s : 10: predicate.accumulaten_eliminater 2.25% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.77% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.02% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.83% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.96% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 1.19% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.30% : 0.000002s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 4.99% : 0.000006s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.09% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 2.19% : 0.000003s : 10: predicate.reduce_eliminate 1.83% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.57% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.85% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.04% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001080 13 40.89% : 0.000442s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.28% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.83% : 0.000603s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050907 72 0.11% : 0.000058s : 1: add_recomputation 0.14% : 0.000071s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.67% : 0.000339s : 1: bootstrap 0.06% : 0.000033s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.60% : 0.006924s : 1: jit_opt_a 0.33% : 0.000168s : 1: jit_opt_after_cconv 0.11% : 0.000058s : 1: jit_opt_b 0.98% : 0.000500s : 1: loop_unroll 1.74% : 0.000884s : 1: mutable_eliminate 1.81% : 0.000919s : 26: opt.transform.jit_opt_a 0.10% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.06% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000045s : 4: opt.transform.symbol_engine_opt 1.31% : 0.000668s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000166s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.65% : 0.000842s : 1: renormalize.infer 1.15% : 0.000584s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000050s : 1: rewriter_after_opt_a 0.18% : 0.000091s : 1: rewriter_before_opt_a 0.36% : 0.000185s : 1: symbol_engine_optimizer 74.65% : 0.038001s : 1: type_inference TotalTime = 0.153519, [30] [bootstrap]: 0.0002505 [type_inference]: 0.12134 [event_method]: 0.00063204 [auto_monad]: 0.00012205 [graph_reusing]: 7.48e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 0.00010851 [rewriter_before_opt_a]: 0.00014003 [expand_dump_flag]: 3.74002e-06 [jit_opt_a]: 0.0282955, [3] [Cycle 1]: 0.0193112, [27] [switch_simplify]: 8.733e-05 [loop_unroll]: 4.456e-05 [a_1]: 0.00108299 [with_stream_mark]: 3.384e-05 [recompute_prepare]: 2.24e-05 [updatestate_depend_eliminate]: 1.248e-05 [updatestate_assign_eliminate]: 8.18999e-06 [updatestate_loads_eliminate]: 7.18e-06 [parameter_eliminate]: 2.97002e-06 [specialize_transform]: 1.716e-05 [updatestate_useless_node_eliminater]: 1.43e-05 [accelerated_algorithm]: 1.519e-05 [meta_shard_fg_expand]: 5.59e-06 [get_grad_eliminate_]: 1.511e-05 [merge_forward]: 1.051e-05 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.095e-05 [j_node_and_user_rematch]: 2.731e-05 [meta_fg_expand]: 0.0021131 [replace_old_param]: 8.917e-05 [inline_without_move]: 6.67e-05 [renormalize]: 0.0148454 [add_forward_monad_depend]: 1.645e-05 [auto_monad_grad]: 6.59001e-06 [auto_monad_eliminator]: 6.822e-05 [cse]: 0.00030045 [replace_applicator]: 0.00010091 [Cycle 2]: 0.0050776, [27] [switch_simplify]: 4.858e-05 [loop_unroll]: 4.586e-05 [a_1]: 0.00142681 [with_stream_mark]: 2.795e-05 [recompute_prepare]: 1.506e-05 [updatestate_depend_eliminate]: 6.72002e-06 [updatestate_assign_eliminate]: 4.62e-06 [updatestate_loads_eliminate]: 4.27998e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 9.67999e-06 [updatestate_useless_node_eliminater]: 9.24998e-06 [accelerated_algorithm]: 9.96e-06 [meta_shard_fg_expand]: 3.3e-06 [get_grad_eliminate_]: 8.74e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.236e-05 [j_node_and_user_rematch]: 1.79e-05 [meta_fg_expand]: 0.00016531 [replace_old_param]: 1.38e-05 [inline_without_move]: 9.45001e-06 [renormalize]: 0.00291282 [add_forward_monad_depend]: 8.65001e-06 [auto_monad_grad]: 2.40002e-06 [auto_monad_eliminator]: 1.501e-05 [cse]: 3.102e-05 [replace_applicator]: 2.305e-05 [Cycle 3]: 0.00030915, [27] [switch_simplify]: 5.05001e-06 [loop_unroll]: 4.74998e-06 [a_1]: 5.942e-05 [with_stream_mark]: 1.58e-05 [recompute_prepare]: 4.19002e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.98997e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 4.15e-06 [updatestate_useless_node_eliminater]: 3.38999e-06 [accelerated_algorithm]: 4.74e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 3.81001e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.613e-05 [j_node_and_user_rematch]: 7e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 3.75e-06 [inline_without_move]: 3.31999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.14e-06 [cse]: 1.043e-05 [replace_applicator]: 4.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.535e-05 [rewriter_after_opt_a]: 4.164e-05 [convert_after_rewriter]: 6.21e-06 [order_py_execute_after_rewriter]: 4.39002e-06 [mutable_eliminate]: 0.00077218 [jit_opt_b]: 4.894e-05, [1] [Cycle 1]: 3.926e-05, [2] [frontend_op_eliminate]: 1.277e-05 [inline_after_opt_a]: 1.268e-05 [cconv]: 3.049e-05 [loop_unroll]: 0.0006305 [jit_opt_after_cconv]: 0.00015007, [1] [Cycle 1]: 0.00014069, [11] [c_1]: 1.601e-05 [parameter_eliminate]: 3.44001e-06 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.774e-05 [call_graph_tuple_transform]: 1.533e-05 [tuple_list_get_item_eliminator]: 4.40999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 4.47e-06 [remove_dup_value]: 1.586e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 3.649e-05 [cse_after_recomputation]: 2.015e-05, [1] [Cycle 1]: 1.499e-05, [1] [cse]: 8.78001e-06 [auto_monad_reorder]: 1.414e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 5.24003e-06 [opt_after_jit_grad]: 0.00047576 [symbol_engine_optimizer]: 0.00010635, [1] [Cycle 1]: 9.914e-05, [6] [build]: 3.53999e-06 [elim_shapecalc]: 6.40002e-06 [elim_not_effective]: 1.054e-05 [opt_reshape]: 4.61002e-06 [fold_const_symbol]: 6.29999e-06 [renormalize]: 3.69997e-07 [validate]: 3.41e-05 Sums bootstrap : 0.000250s : 0.17% type_inference : 0.121340s : 81.48% event_method : 0.000632s : 0.42% auto_monad : 0.000122s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000109s : 0.07% rewriter_before_opt_a : 0.000140s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000141s : 0.09% jit_opt_a.loop_unroll : 0.000095s : 0.06% jit_opt_a.a_1 : 0.002569s : 1.73% jit_opt_a.with_stream_mark : 0.000078s : 0.05% jit_opt_a.recompute_prepare : 0.000042s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000023s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000031s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000030s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000028s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000069s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000052s : 0.04% jit_opt_a.meta_fg_expand : 0.002281s : 1.53% jit_opt_a.replace_old_param : 0.000107s : 0.07% jit_opt_a.inline_without_move : 0.000079s : 0.05% jit_opt_a.renormalize : 0.017758s : 11.92% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000088s : 0.06% jit_opt_a.cse : 0.000342s : 0.23% jit_opt_a.replace_applicator : 0.000128s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000772s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000630s : 0.42% jit_opt_after_cconv.c_1 : 0.000016s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000476s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.02% Time group info: ------[substitution.] 0.000763 107 0.22% : 0.000002s : 1: substitution.elim_not_effective 0.12% : 0.000001s : 1: substitution.fold_const_symbol 0.69% : 0.000005s : 1: substitution.graph_param_transform 68.76% : 0.000524s : 13: substitution.inline 2.73% : 0.000021s : 2: substitution.inline_without_move 1.54% : 0.000012s : 13: substitution.j_node_and_user_rematch 1.90% : 0.000014s : 7: substitution.minmaximum_grad 1.07% : 0.000008s : 5: substitution.partial_eliminate 1.90% : 0.000014s : 13: substitution.remove_not_recompute_node 4.82% : 0.000037s : 10: substitution.replace_applicator 1.56% : 0.000012s : 10: substitution.replace_old_param 1.04% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.01% : 0.000008s : 1: substitution.tile_eliminate 3.44% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.28% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.50% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121237 2 96.83% : 0.117396s : 1: type_inference.infer 3.17% : 0.003840s : 1: type_inference.specialize ------[replace.] 0.000241 20 63.44% : 0.000153s : 13: replace.inline 36.56% : 0.000088s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000540 20 95.39% : 0.000515s : 13: match.inline 4.61% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000406 2656 1.80% : 0.000007s : 46: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.37% : 0.000006s : 46: predicate.addn_check_dump 1.51% : 0.000006s : 46: predicate.addn_zero_filter 2.34% : 0.000010s : 46: predicate.arithmetic_simplify 1.61% : 0.000007s : 46: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.37% : 0.000006s : 46: predicate.compare_switch_simplify 1.52% : 0.000006s : 46: predicate.depend_value_elim 1.40% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.36% : 0.000006s : 46: predicate.environ_get_depend_swap 1.52% : 0.000006s : 46: predicate.environ_get_eliminate 1.40% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.86% : 0.000003s : 19: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.52% : 0.000018s : 68: predicate.inline 2.14% : 0.000009s : 47: predicate.inline_without_move 0.42% : 0.000002s : 19: predicate.j_node_and_user_rematch 1.24% : 0.000005s : 19: predicate.less_batch_normalization 2.10% : 0.000009s : 53: predicate.list_to_tuple_eliminator_ 1.87% : 0.000008s : 54: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.39% : 0.000014s : 94: predicate.loop_unroll_before_grad 1.81% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.39% : 0.000006s : 46: predicate.merge_addn 1.44% : 0.000006s : 46: predicate.minmaximum_grad 0.30% : 0.000001s : 1: predicate.mutable_eliminate 0.12% : 0.000001s : 1: predicate.opt_reshape 2.17% : 0.000009s : 54: predicate.partial_eliminate 1.43% : 0.000006s : 46: predicate.print_const_string_wrapper 2.19% : 0.000009s : 46: predicate.reduce_eliminate 1.91% : 0.000008s : 53: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000002s : 19: predicate.remove_not_recompute_node 2.80% : 0.000011s : 100: predicate.replace_applicator 1.18% : 0.000005s : 47: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000007s : 46: predicate.reshape_eliminate 1.52% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.53% : 0.000006s : 46: predicate.same_eliminate 0.44% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 19: predicate.specialize_transform 1.89% : 0.000008s : 46: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.94% : 0.000012s : 66: predicate.switch_defer_inline 2.42% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.11% : 0.000025s : 161: predicate.switch_simplify 1.62% : 0.000007s : 46: predicate.tile_eliminate 1.43% : 0.000006s : 46: predicate.transpose_eliminate 1.97% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000014s : 55: predicate.tuple_list_get_item_eliminator 2.19% : 0.000009s : 46: predicate.tuple_list_set_item_eliminator 1.73% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.68% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.87% : 0.000008s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004228 45 71.35% : 0.003017s : 28: func_graph_cloner_run.FuncGraphClonerGraph 28.65% : 0.001211s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.174616 87 0.02% : 0.000039s : 1: add_recomputation 0.07% : 0.000129s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.16% : 0.000273s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.37% : 0.000640s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 16.21% : 0.028300s : 1: jit_opt_a 0.09% : 0.000153s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.37% : 0.000642s : 1: loop_unroll 0.45% : 0.000784s : 1: mutable_eliminate 1.91% : 0.003338s : 39: opt.transform.jit_opt_a 0.02% : 0.000037s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000483s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000113s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 8.46% : 0.014774s : 2: renormalize.infer 1.69% : 0.002955s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000145s : 1: rewriter_before_opt_a 0.06% : 0.000109s : 1: symbol_engine_optimizer 69.50% : 0.121352s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.603.10 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f8b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.609.80 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.143465, [30] [bootstrap]: 0.00054708 [type_inference]: 0.129417 [event_method]: 2.26e-05 [auto_monad]: 7.589e-05 [graph_reusing]: 5.57001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00069368 [rewriter_before_opt_a]: 9.852e-05 [expand_dump_flag]: 3.73999e-06 [jit_opt_a]: 0.0100525, [2] [Cycle 1]: 0.00524851, [27] [switch_simplify]: 6.59e-05 [loop_unroll]: 2.987e-05 [a_1]: 0.00070361 [with_stream_mark]: 2.22e-05 [recompute_prepare]: 8.90001e-06 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.38002e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 1.138e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.118e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00405433 [add_forward_monad_depend]: 8.31002e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.689e-05 [cse]: 3.228e-05 [replace_applicator]: 2.216e-05 [Cycle 2]: 0.00040348, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.19999e-06 [a_1]: 0.00013791 [with_stream_mark]: 1.482e-05 [recompute_prepare]: 6.09999e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 3.64002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.869e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.065e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.336e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.371e-05 [rewriter_after_opt_a]: 3.916e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 4.63999e-06 [mutable_eliminate]: 0.00082674 [jit_opt_b]: 6.118e-05, [1] [Cycle 1]: 5.283e-05, [2] [frontend_op_eliminate]: 2.063e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.582e-05 [loop_unroll]: 0.00046138 [jit_opt_after_cconv]: 0.00015931, [1] [Cycle 1]: 0.00015153, [11] [c_1]: 2.637e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 6.02001e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 2.327e-05 [call_graph_tuple_transform]: 2.179e-05 [tuple_list_get_item_eliminator]: 5.95002e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 1.437e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 9.02e-06 [add_recomputation]: 4.616e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.693e-05, [1] [cse]: 1.091e-05 [auto_monad_reorder]: 1.598e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 5.86e-06 [opt_after_jit_grad]: 0.0004746 [symbol_engine_optimizer]: 7.629e-05, [1] [Cycle 1]: 7.049e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.474e-05 [opt_reshape]: 6.21998e-06 [fold_const_symbol]: 1e-05 [renormalize]: 3.59985e-07 [validate]: 7.418e-05 Sums bootstrap : 0.000547s : 0.40% type_inference : 0.129417s : 93.49% event_method : 0.000023s : 0.02% auto_monad : 0.000076s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000694s : 0.50% rewriter_before_opt_a : 0.000099s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000842s : 0.61% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004054s : 2.93% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000046s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000827s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000461s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000475s : 0.34% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000074s : 0.05% Time group info: ------[substitution.] 0.000277 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 4: substitution.graph_param_transform 85.73% : 0.000237s : 4: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000006s : 4: substitution.remove_not_recompute_node 2.71% : 0.000007s : 2: substitution.replace_old_param 4.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129306 2 96.38% : 0.124625s : 1: type_inference.infer 3.62% : 0.004681s : 1: type_inference.specialize ------[replace.] 0.000084 6 68.46% : 0.000057s : 4: replace.inline 31.54% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 6 95.27% : 0.000235s : 4: match.inline 4.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.35% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000002s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 2.22% : 0.000003s : 12: predicate.reduce_eliminate 1.25% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.43% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.08% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.72% : 0.000010s : 58: predicate.switch_simplify 1.61% : 0.000002s : 12: predicate.tile_eliminate 1.42% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002911 22 64.04% : 0.001864s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.98% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.99% : 0.000989s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148649 72 0.03% : 0.000049s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.38% : 0.000569s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.77% : 0.010058s : 1: jit_opt_a 0.11% : 0.000162s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.32% : 0.000469s : 1: loop_unroll 0.56% : 0.000837s : 1: mutable_eliminate 0.74% : 0.001098s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000482s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000701s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.99% : 0.002954s : 1: renormalize.infer 0.73% : 0.001088s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000105s : 1: rewriter_before_opt_a 0.05% : 0.000079s : 1: symbol_engine_optimizer 87.08% : 0.129440s : 1: type_inference TotalTime = 0.0346458, [30] [bootstrap]: 0.00034636 [type_inference]: 0.00537951 [event_method]: 2.098e-05 [auto_monad]: 7.041e-05 [graph_reusing]: 7e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 4.517e-05 [rewriter_before_opt_a]: 8.257e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.02628, [2] [Cycle 1]: 0.0221444, [27] [switch_simplify]: 6.182e-05 [loop_unroll]: 2.925e-05 [a_1]: 0.00058556 [with_stream_mark]: 2.411e-05 [recompute_prepare]: 9.15001e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.0210446 [add_forward_monad_depend]: 9.86e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.821e-05 [cse]: 3.994e-05 [replace_applicator]: 2.047e-05 [Cycle 2]: 0.00036478, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.30001e-06 [a_1]: 0.00010078 [with_stream_mark]: 1.663e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 2.36998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.344e-05 [replace_applicator]: 5.29998e-06 [py_interpret_to_execute_after_opt_a]: 1.516e-05 [rewriter_after_opt_a]: 3.853e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.0007959 [jit_opt_b]: 5.237e-05, [1] [Cycle 1]: 4.444e-05, [2] [frontend_op_eliminate]: 1.652e-05 [inline_after_opt_a]: 1.603e-05 [cconv]: 2.596e-05 [loop_unroll]: 0.0004238 [jit_opt_after_cconv]: 0.0001486, [1] [Cycle 1]: 0.00014222, [11] [c_1]: 2.06e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.32e-05 [call_graph_tuple_transform]: 1.854e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.36002e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.729e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.31e-06 [add_recomputation]: 5.257e-05 [cse_after_recomputation]: 2.466e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.71e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00045541 [symbol_engine_optimizer]: 7.515e-05, [1] [Cycle 1]: 6.932e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.346e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 4.69998e-07 [validate]: 4.273e-05 Sums bootstrap : 0.000346s : 1.15% type_inference : 0.005380s : 17.80% event_method : 0.000021s : 0.07% auto_monad : 0.000070s : 0.23% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000045s : 0.15% rewriter_before_opt_a : 0.000083s : 0.27% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.23% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000686s : 2.27% jit_opt_a.with_stream_mark : 0.000041s : 0.13% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.021045s : 69.63% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000053s : 0.18% jit_opt_a.replace_applicator : 0.000026s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000796s : 2.63% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000026s : 0.09% loop_unroll : 0.000424s : 1.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000455s : 1.51% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.14% Time group info: ------[substitution.] 0.000250 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.03% : 0.000005s : 3: substitution.graph_param_transform 85.30% : 0.000213s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.34% : 0.000006s : 2: substitution.replace_old_param 5.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005296 2 81.94% : 0.004340s : 1: type_inference.infer 18.06% : 0.000956s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.10% : 0.000052s : 4: replace.inline 32.90% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.77% : 0.000210s : 4: match.inline 5.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.25% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 2.41% : 0.000003s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.44% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.37% : 0.000002s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.45% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.63% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000765 13 49.38% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.94% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.68% : 0.000334s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056650 72 0.10% : 0.000056s : 1: add_recomputation 0.13% : 0.000074s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.65% : 0.000368s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 46.40% : 0.026284s : 1: jit_opt_a 0.27% : 0.000151s : 1: jit_opt_after_cconv 0.10% : 0.000055s : 1: jit_opt_b 0.76% : 0.000432s : 1: loop_unroll 1.42% : 0.000806s : 1: mutable_eliminate 1.63% : 0.000924s : 26: opt.transform.jit_opt_a 0.08% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.82% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000048s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 36.34% : 0.020585s : 1: renormalize.infer 0.79% : 0.000448s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.15% : 0.000086s : 1: rewriter_before_opt_a 0.14% : 0.000078s : 1: symbol_engine_optimizer 9.53% : 0.005400s : 1: type_inference TotalTime = 0.0279381, [30] [bootstrap]: 0.00034621 [type_inference]: 0.0200964 [event_method]: 1.978e-05 [auto_monad]: 6.576e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 9.27e-05 [rewriter_before_opt_a]: 8.133e-05 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.00499151, [2] [Cycle 1]: 0.00167688, [27] [switch_simplify]: 5.211e-05 [loop_unroll]: 2.908e-05 [a_1]: 0.00050123 [with_stream_mark]: 1.712e-05 [recompute_prepare]: 7.26999e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.06998e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.545e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00075614 [add_forward_monad_depend]: 4.92999e-06 [auto_monad_grad]: 1.86e-06 [auto_monad_eliminator]: 1.53e-05 [cse]: 3.441e-05 [replace_applicator]: 1.121e-05 [Cycle 2]: 0.00031146, [27] [switch_simplify]: 5.67001e-06 [loop_unroll]: 4.94e-06 [a_1]: 8.747e-05 [with_stream_mark]: 8.26002e-06 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.86002e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.59002e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.26997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 7.87003e-06 [meta_fg_expand]: 1.81003e-06 [replace_old_param]: 7.03e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.242e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 9.35001e-06 [rewriter_after_opt_a]: 3.533e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00051274 [jit_opt_b]: 4.685e-05, [1] [Cycle 1]: 4.012e-05, [2] [frontend_op_eliminate]: 1.461e-05 [inline_after_opt_a]: 1.493e-05 [cconv]: 2.629e-05 [loop_unroll]: 0.00040885 [jit_opt_after_cconv]: 0.00013935, [1] [Cycle 1]: 0.0001334, [11] [c_1]: 2.06e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.039e-05 [call_graph_tuple_transform]: 1.788e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 1.869e-05 [add_recomputation]: 5.086e-05 [cse_after_recomputation]: 2.486e-05, [1] [Cycle 1]: 1.91e-05, [1] [cse]: 1.302e-05 [auto_monad_reorder]: 1.817e-05 [get_jit_bprop_graph]: 1.65001e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00062235 [symbol_engine_optimizer]: 7.183e-05, [1] [Cycle 1]: 6.517e-05, [6] [build]: 2.98e-06 [elim_shapecalc]: 7.69002e-06 [elim_not_effective]: 1.245e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 5.8001e-07 [validate]: 3.655e-05 Sums bootstrap : 0.000346s : 1.42% type_inference : 0.020096s : 82.45% event_method : 0.000020s : 0.08% auto_monad : 0.000066s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000093s : 0.38% rewriter_before_opt_a : 0.000081s : 0.33% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000589s : 2.42% jit_opt_a.with_stream_mark : 0.000025s : 0.10% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000756s : 3.10% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000047s : 0.19% jit_opt_a.replace_applicator : 0.000016s : 0.07% py_interpret_to_execute_after_opt_a : 0.000009s : 0.04% rewriter_after_opt_a : 0.000035s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000513s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000026s : 0.11% loop_unroll : 0.000409s : 1.68% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000019s : 0.08% add_recomputation : 0.000051s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000622s : 2.55% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000186 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 2.80% : 0.000005s : 3: substitution.graph_param_transform 82.50% : 0.000154s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000004s : 2: substitution.replace_old_param 6.59% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020026 2 92.96% : 0.018616s : 1: type_inference.infer 7.04% : 0.001411s : 1: type_inference.specialize ------[replace.] 0.000066 6 69.31% : 0.000046s : 4: replace.inline 30.69% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.13% : 0.000151s : 4: match.inline 6.87% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.65% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000006s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.77% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000883 13 46.00% : 0.000406s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.80% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.19% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029543 72 0.18% : 0.000054s : 1: add_recomputation 0.23% : 0.000069s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.24% : 0.000366s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.07% : 0.000021s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 16.90% : 0.004994s : 1: jit_opt_a 0.48% : 0.000142s : 1: jit_opt_after_cconv 0.17% : 0.000049s : 1: jit_opt_b 1.41% : 0.000417s : 1: loop_unroll 1.76% : 0.000520s : 1: mutable_eliminate 2.69% : 0.000795s : 26: opt.transform.jit_opt_a 0.16% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.14% : 0.000632s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000096s : 1: py_interpret_to_execute 0.04% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.42% : 0.000418s : 1: renormalize.infer 1.12% : 0.000330s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000038s : 1: rewriter_after_opt_a 0.29% : 0.000085s : 1: rewriter_before_opt_a 0.25% : 0.000074s : 1: symbol_engine_optimizer 68.07% : 0.020111s : 1: type_inference TotalTime = 0.112942, [30] [bootstrap]: 0.00029394 [type_inference]: 0.0770125 [event_method]: 0.00034992 [auto_monad]: 0.00011449 [graph_reusing]: 7.48e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 4.24e-05 [rewriter_before_opt_a]: 0.00013434 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.0327488, [3] [Cycle 1]: 0.0237469, [27] [switch_simplify]: 9.996e-05 [loop_unroll]: 5.176e-05 [a_1]: 0.00121221 [with_stream_mark]: 3.686e-05 [recompute_prepare]: 2.532e-05 [updatestate_depend_eliminate]: 1.076e-05 [updatestate_assign_eliminate]: 7.36999e-06 [updatestate_loads_eliminate]: 7.41001e-06 [parameter_eliminate]: 3.16001e-06 [specialize_transform]: 1.632e-05 [updatestate_useless_node_eliminater]: 1.424e-05 [accelerated_algorithm]: 1.472e-05 [meta_shard_fg_expand]: 5.37001e-06 [get_grad_eliminate_]: 1.463e-05 [merge_forward]: 9.82999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.848e-05 [j_node_and_user_rematch]: 2.515e-05 [meta_fg_expand]: 0.00206014 [replace_old_param]: 7.403e-05 [inline_without_move]: 6.678e-05 [renormalize]: 0.0191018 [add_forward_monad_depend]: 1.603e-05 [auto_monad_grad]: 7.28999e-06 [auto_monad_eliminator]: 7.416e-05 [cse]: 0.00036232 [replace_applicator]: 0.00010696 [Cycle 2]: 0.00466988, [27] [switch_simplify]: 4.561e-05 [loop_unroll]: 4.491e-05 [a_1]: 0.00127998 [with_stream_mark]: 2.402e-05 [recompute_prepare]: 1.248e-05 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 4.23999e-06 [updatestate_loads_eliminate]: 4.18001e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 9.37999e-06 [updatestate_useless_node_eliminater]: 8.28999e-06 [accelerated_algorithm]: 9.56e-06 [meta_shard_fg_expand]: 2.99001e-06 [get_grad_eliminate_]: 9.36e-06 [merge_forward]: 5.49e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.046e-05 [j_node_and_user_rematch]: 1.43e-05 [meta_fg_expand]: 0.00015228 [replace_old_param]: 1.065e-05 [inline_without_move]: 8.40999e-06 [renormalize]: 0.00274189 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 1.449e-05 [cse]: 2.696e-05 [replace_applicator]: 1.432e-05 [Cycle 3]: 0.0002647, [27] [switch_simplify]: 4.08999e-06 [loop_unroll]: 4.03001e-06 [a_1]: 4.535e-05 [with_stream_mark]: 1.255e-05 [recompute_prepare]: 3.9e-06 [updatestate_depend_eliminate]: 2.80997e-06 [updatestate_assign_eliminate]: 2.10002e-06 [updatestate_loads_eliminate]: 1.81e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 3.75e-06 [updatestate_useless_node_eliminater]: 3.13e-06 [accelerated_algorithm]: 3.19001e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 3.33998e-06 [merge_forward]: 2.91999e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.366e-05 [j_node_and_user_rematch]: 5.57999e-06 [meta_fg_expand]: 1.37e-06 [replace_old_param]: 3.09001e-06 [inline_without_move]: 2.94999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 3.86999e-06 [cse]: 7.63999e-06 [replace_applicator]: 3.32002e-06 [py_interpret_to_execute_after_opt_a]: 1.177e-05 [rewriter_after_opt_a]: 3.644e-05 [convert_after_rewriter]: 6.17001e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00071146 [jit_opt_b]: 4.176e-05, [1] [Cycle 1]: 3.447e-05, [2] [frontend_op_eliminate]: 1.046e-05 [inline_after_opt_a]: 1.17e-05 [cconv]: 2.468e-05 [loop_unroll]: 0.00040756 [jit_opt_after_cconv]: 0.00015682, [1] [Cycle 1]: 0.00015057, [11] [c_1]: 1.208e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 3.398e-05 [updatestate_assign_eliminate]: 1.92999e-06 [updatestate_loads_eliminate]: 1.57999e-06 [cse]: 1.817e-05 [call_graph_tuple_transform]: 1.433e-05 [tuple_list_get_item_eliminator]: 3.74002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 3.93999e-06 [remove_dup_value]: 1.47e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 5.09003e-06 [add_recomputation]: 3.614e-05 [cse_after_recomputation]: 1.746e-05, [1] [Cycle 1]: 1.244e-05, [1] [cse]: 6.54001e-06 [auto_monad_reorder]: 1.294e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.66e-06 [opt_after_jit_grad]: 0.00044655 [symbol_engine_optimizer]: 6.641e-05, [1] [Cycle 1]: 6.039e-05, [6] [build]: 3.86001e-06 [elim_shapecalc]: 6.38e-06 [elim_not_effective]: 9.12001e-06 [opt_reshape]: 4.55999e-06 [fold_const_symbol]: 5.70001e-06 [renormalize]: 4.09986e-07 [validate]: 3.23e-05 Sums bootstrap : 0.000294s : 0.27% type_inference : 0.077013s : 71.34% event_method : 0.000350s : 0.32% auto_monad : 0.000114s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.04% rewriter_before_opt_a : 0.000134s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000150s : 0.14% jit_opt_a.loop_unroll : 0.000101s : 0.09% jit_opt_a.a_1 : 0.002538s : 2.35% jit_opt_a.with_stream_mark : 0.000073s : 0.07% jit_opt_a.recompute_prepare : 0.000042s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.04% jit_opt_a.meta_fg_expand : 0.002214s : 2.05% jit_opt_a.replace_old_param : 0.000088s : 0.08% jit_opt_a.inline_without_move : 0.000078s : 0.07% jit_opt_a.renormalize : 0.021844s : 20.23% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000093s : 0.09% jit_opt_a.cse : 0.000397s : 0.37% jit_opt_a.replace_applicator : 0.000125s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000711s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000408s : 0.38% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000034s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000447s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000727 107 0.21% : 0.000002s : 1: substitution.elim_not_effective 0.12% : 0.000001s : 1: substitution.fold_const_symbol 0.58% : 0.000004s : 1: substitution.graph_param_transform 69.21% : 0.000503s : 13: substitution.inline 2.77% : 0.000020s : 2: substitution.inline_without_move 1.35% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.84% : 0.000013s : 7: substitution.minmaximum_grad 1.22% : 0.000009s : 5: substitution.partial_eliminate 1.55% : 0.000011s : 13: substitution.remove_not_recompute_node 5.36% : 0.000039s : 10: substitution.replace_applicator 0.95% : 0.000007s : 10: substitution.replace_old_param 1.01% : 0.000007s : 1: substitution.reshape_eliminate 0.52% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.95% : 0.000007s : 1: substitution.tile_eliminate 3.31% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.21% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.84% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076889 2 96.14% : 0.073918s : 1: type_inference.infer 3.86% : 0.002971s : 1: type_inference.specialize ------[replace.] 0.000228 20 65.82% : 0.000150s : 13: replace.inline 34.18% : 0.000078s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000518 20 95.21% : 0.000494s : 13: match.inline 4.79% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000410 2768 1.47% : 0.000006s : 48: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.37% : 0.000006s : 48: predicate.addn_check_dump 1.45% : 0.000006s : 48: predicate.addn_zero_filter 2.06% : 0.000008s : 48: predicate.arithmetic_simplify 1.73% : 0.000007s : 48: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.45% : 0.000006s : 48: predicate.compare_switch_simplify 1.46% : 0.000006s : 48: predicate.depend_value_elim 1.47% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 48: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.18% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.17% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.36% : 0.000006s : 48: predicate.environ_get_depend_swap 1.56% : 0.000006s : 48: predicate.environ_get_eliminate 1.45% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 20: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.16% : 0.000017s : 70: predicate.inline 1.97% : 0.000008s : 48: predicate.inline_without_move 0.37% : 0.000002s : 20: predicate.j_node_and_user_rematch 1.06% : 0.000004s : 20: predicate.less_batch_normalization 1.87% : 0.000008s : 55: predicate.list_to_tuple_eliminator_ 1.75% : 0.000007s : 56: predicate.load_eliminater 0.39% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.56% : 0.000015s : 101: predicate.loop_unroll_before_grad 1.72% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.37% : 0.000006s : 48: predicate.merge_addn 1.49% : 0.000006s : 48: predicate.minmaximum_grad 0.37% : 0.000002s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.29% : 0.000009s : 56: predicate.partial_eliminate 1.43% : 0.000006s : 48: predicate.print_const_string_wrapper 2.07% : 0.000009s : 48: predicate.reduce_eliminate 1.97% : 0.000008s : 55: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 20: predicate.remove_not_recompute_node 2.89% : 0.000012s : 103: predicate.replace_applicator 1.27% : 0.000005s : 48: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.60% : 0.000007s : 48: predicate.reshape_eliminate 1.50% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 1: predicate.row_tensor_eliminate 1.44% : 0.000006s : 48: predicate.same_eliminate 0.48% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.86% : 0.000004s : 20: predicate.specialize_transform 1.80% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000006s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.07% : 0.000013s : 68: predicate.switch_defer_inline 2.36% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.76% : 0.000028s : 170: predicate.switch_simplify 1.54% : 0.000006s : 48: predicate.tile_eliminate 1.46% : 0.000006s : 48: predicate.transpose_eliminate 1.83% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.63% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000015s : 57: predicate.tuple_list_get_item_eliminator 2.30% : 0.000009s : 48: predicate.tuple_list_set_item_eliminator 1.75% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.70% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.53% : 0.000010s : 76: predicate.updatestate_useless_node_eliminater 2.60% : 0.000011s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005799 64 80.48% : 0.004667s : 47: func_graph_cloner_run.FuncGraphClonerGraph 19.52% : 0.001132s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138059 87 0.03% : 0.000039s : 1: add_recomputation 0.09% : 0.000121s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000313s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.26% : 0.000359s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 23.72% : 0.032752s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.30% : 0.000415s : 1: loop_unroll 0.52% : 0.000720s : 1: mutable_eliminate 2.38% : 0.003282s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 13.60% : 0.018777s : 2: renormalize.infer 2.20% : 0.003040s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.10% : 0.000139s : 1: rewriter_before_opt_a 0.05% : 0.000069s : 1: symbol_engine_optimizer 55.80% : 0.077035s : 1: type_inference TotalTime = 0.0907898, [30] [bootstrap]: 0.00030907 [type_inference]: 0.0811955 [event_method]: 2.45e-05 [auto_monad]: 7.225e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.00015041 [rewriter_before_opt_a]: 8.77e-05 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00659561, [2] [Cycle 1]: 0.00238586, [27] [switch_simplify]: 5.601e-05 [loop_unroll]: 2.983e-05 [a_1]: 0.00060692 [with_stream_mark]: 2.105e-05 [recompute_prepare]: 8.20999e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.41002e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.05999e-06 [inline_without_move]: 5.56998e-06 [renormalize]: 0.00132756 [add_forward_monad_depend]: 6.24001e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.635e-05 [cse]: 3.481e-05 [replace_applicator]: 1.679e-05 [Cycle 2]: 0.00034051, [27] [switch_simplify]: 6.29001e-06 [loop_unroll]: 5.48002e-06 [a_1]: 9.465e-05 [with_stream_mark]: 1.221e-05 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.01002e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 2.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 8.43999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.73001e-06 [inline_without_move]: 4.99e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.398e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 4.79998e-06 [mutable_eliminate]: 0.00061084 [jit_opt_b]: 5.12e-05, [1] [Cycle 1]: 4.422e-05, [2] [frontend_op_eliminate]: 1.636e-05 [inline_after_opt_a]: 1.593e-05 [cconv]: 2.857e-05 [loop_unroll]: 0.00044465 [jit_opt_after_cconv]: 0.00015444, [1] [Cycle 1]: 0.00014784, [11] [c_1]: 2.184e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 7.87e-06 [updatestate_assign_eliminate]: 3.00002e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 2.603e-05 [call_graph_tuple_transform]: 2.142e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 2.05002e-06 [renormalize]: 1.50001e-07 [switch_simplify]: 5.59998e-06 [remove_dup_value]: 1.542e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 6.91001e-06 [add_recomputation]: 5.316e-05 [cse_after_recomputation]: 2.304e-05, [1] [Cycle 1]: 1.798e-05, [1] [cse]: 1.174e-05 [auto_monad_reorder]: 1.859e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 6.06998e-06 [opt_after_jit_grad]: 0.00049667 [symbol_engine_optimizer]: 0.00013298, [1] [Cycle 1]: 0.0001269, [6] [build]: 3.35e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.302e-05 [opt_reshape]: 6.381e-05 [fold_const_symbol]: 1.002e-05 [renormalize]: 4.69998e-07 [validate]: 4.561e-05 Sums bootstrap : 0.000309s : 0.36% type_inference : 0.081196s : 94.05% event_method : 0.000025s : 0.03% auto_monad : 0.000072s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000150s : 0.17% rewriter_before_opt_a : 0.000088s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000702s : 0.81% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001328s : 1.54% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000049s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000611s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000445s : 0.52% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000497s : 0.58% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000064s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.05% Time group info: ------[substitution.] 0.000231 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 84.74% : 0.000196s : 4: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.081103 2 96.96% : 0.078634s : 1: type_inference.infer 3.04% : 0.002469s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.42% : 0.000052s : 4: replace.inline 32.58% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.35% : 0.000193s : 4: match.inline 5.65% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 691 0.97% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.86% : 0.000001s : 10: predicate.addn_check_dump 0.86% : 0.000001s : 10: predicate.addn_zero_filter 1.70% : 0.000003s : 10: predicate.arithmetic_simplify 1.02% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 0.81% : 0.000001s : 10: predicate.compare_switch_simplify 0.86% : 0.000001s : 10: predicate.depend_value_elim 0.82% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.87% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.94% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.82% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 0.79% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 13.38% : 0.000021s : 22: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.29% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 6: predicate.less_batch_normalization 1.12% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.45% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.59% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.79% : 0.000001s : 10: predicate.merge_addn 0.93% : 0.000001s : 10: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 1.76% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000002s : 10: predicate.print_const_string_wrapper 1.50% : 0.000002s : 10: predicate.reduce_eliminate 1.08% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.28% : 0.000002s : 18: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 0.97% : 0.000002s : 10: predicate.reshape_eliminate 1.05% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 0.89% : 0.000001s : 10: predicate.same_eliminate 0.37% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.73% : 0.000001s : 6: predicate.specialize_transform 1.08% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.96% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.83% : 0.000003s : 16: predicate.switch_defer_inline 1.60% : 0.000003s : 16: predicate.switch_layer_defer_inline 5.97% : 0.000009s : 53: predicate.switch_simplify 1.01% : 0.000002s : 10: predicate.tile_eliminate 13.47% : 0.000021s : 10: predicate.transpose_eliminate 1.06% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.07% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.24% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.19% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.22% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001181 13 42.83% : 0.000506s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.85% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.33% : 0.000630s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.093153 72 0.06% : 0.000056s : 1: add_recomputation 0.08% : 0.000076s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.35% : 0.000326s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.08% : 0.006599s : 1: jit_opt_a 0.17% : 0.000157s : 1: jit_opt_after_cconv 0.06% : 0.000054s : 1: jit_opt_b 0.49% : 0.000452s : 1: loop_unroll 0.66% : 0.000619s : 1: mutable_eliminate 0.99% : 0.000926s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000092s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000154s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.83% : 0.000777s : 1: renormalize.infer 0.58% : 0.000540s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.10% : 0.000091s : 1: rewriter_before_opt_a 0.15% : 0.000136s : 1: symbol_engine_optimizer 87.19% : 0.081219s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.228.218 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00655e0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.228.894 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0537172, [30] [bootstrap]: 0.00031536 [type_inference]: 0.0443751 [event_method]: 2.17e-05 [auto_monad]: 6.828e-05 [graph_reusing]: 5.51998e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00011797 [rewriter_before_opt_a]: 8.328e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00641725, [2] [Cycle 1]: 0.00236314, [27] [switch_simplify]: 5.952e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.00056999 [with_stream_mark]: 1.869e-05 [recompute_prepare]: 8.80001e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.36998e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.20999e-06 [inline_without_move]: 5.86e-06 [renormalize]: 0.00131483 [add_forward_monad_depend]: 9.59999e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.828e-05 [cse]: 3.631e-05 [replace_applicator]: 1.918e-05 [Cycle 2]: 0.0003487, [27] [switch_simplify]: 6.32001e-06 [loop_unroll]: 5.47999e-06 [a_1]: 9.603e-05 [with_stream_mark]: 1.38e-05 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.39998e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.48998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.682e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.33001e-06 [inline_without_move]: 5.29e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.441e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.479e-05 [rewriter_after_opt_a]: 3.854e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00063373 [jit_opt_b]: 5.611e-05, [1] [Cycle 1]: 4.656e-05, [2] [frontend_op_eliminate]: 1.695e-05 [inline_after_opt_a]: 1.738e-05 [cconv]: 2.991e-05 [loop_unroll]: 0.00043707 [jit_opt_after_cconv]: 0.00015889, [1] [Cycle 1]: 0.00015182, [11] [c_1]: 2.141e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 6.93e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 3.05e-05 [call_graph_tuple_transform]: 2.019e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.74e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 6.86999e-06 [add_recomputation]: 5.583e-05 [cse_after_recomputation]: 2.644e-05, [1] [Cycle 1]: 2.052e-05, [1] [cse]: 1.405e-05 [auto_monad_reorder]: 1.819e-05 [get_jit_bprop_graph]: 2.58e-06 [rewriter_after_jit_bprop_graph]: 6.88e-06 [opt_after_jit_grad]: 0.0004634 [symbol_engine_optimizer]: 7.799e-05, [1] [Cycle 1]: 7.071e-05, [6] [build]: 4.29997e-06 [elim_shapecalc]: 8.69003e-06 [elim_not_effective]: 1.357e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 1.002e-05 [renormalize]: 4.89992e-07 [validate]: 4.523e-05 Sums bootstrap : 0.000315s : 0.64% type_inference : 0.044375s : 89.86% event_method : 0.000022s : 0.04% auto_monad : 0.000068s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000118s : 0.24% rewriter_before_opt_a : 0.000083s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.13% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000666s : 1.35% jit_opt_a.with_stream_mark : 0.000032s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001315s : 2.66% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000051s : 0.10% jit_opt_a.replace_applicator : 0.000025s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000039s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000634s : 1.28% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000030s : 0.06% loop_unroll : 0.000437s : 0.89% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.11% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000463s : 0.94% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.09% Time group info: ------[substitution.] 0.000227 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.35% : 0.000005s : 3: substitution.graph_param_transform 84.40% : 0.000191s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 2.35% : 0.000005s : 2: substitution.replace_old_param 5.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.044295 2 96.24% : 0.042629s : 1: type_inference.infer 3.76% : 0.001667s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.12% : 0.000053s : 4: replace.inline 32.88% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.45% : 0.000188s : 4: match.inline 5.55% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.45% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.97% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.97% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.42% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.59% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000878 13 43.44% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.12% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.44% : 0.000452s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055981 72 0.11% : 0.000059s : 1: add_recomputation 0.13% : 0.000072s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.59% : 0.000333s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000029s : 1: cse_after_recomputation 0.06% : 0.000031s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.47% : 0.006421s : 1: jit_opt_a 0.29% : 0.000161s : 1: jit_opt_after_cconv 0.11% : 0.000059s : 1: jit_opt_b 0.80% : 0.000446s : 1: loop_unroll 1.15% : 0.000644s : 1: mutable_eliminate 1.60% : 0.000897s : 26: opt.transform.jit_opt_a 0.09% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000121s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.13% : 0.000631s : 1: renormalize.infer 1.20% : 0.000673s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.16% : 0.000087s : 1: rewriter_before_opt_a 0.14% : 0.000081s : 1: symbol_engine_optimizer 79.30% : 0.044392s : 1: type_inference TotalTime = 0.13225, [30] [bootstrap]: 0.00034907 [type_inference]: 0.120427 [event_method]: 2.105e-05 [auto_monad]: 5.463e-05 [graph_reusing]: 4.60999e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.00028331 [rewriter_before_opt_a]: 9.152e-05 [expand_dump_flag]: 2.61e-06 [jit_opt_a]: 0.0076147, [2] [Cycle 1]: 0.00383694, [27] [switch_simplify]: 6.116e-05 [loop_unroll]: 3.408e-05 [a_1]: 0.00072483 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 8.87e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.36e-05 [j_node_and_user_rematch]: 1.073e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00263674 [add_forward_monad_depend]: 9.30001e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.623e-05 [cse]: 3.415e-05 [replace_applicator]: 2.038e-05 [Cycle 2]: 0.00039201, [27] [switch_simplify]: 7.13e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00012793 [with_stream_mark]: 1.456e-05 [recompute_prepare]: 6.38998e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.61002e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.71998e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.71e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.05002e-06 [cse]: 1.563e-05 [replace_applicator]: 7.65e-06 [py_interpret_to_execute_after_opt_a]: 1.412e-05 [rewriter_after_opt_a]: 4.071e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.60001e-06 [mutable_eliminate]: 0.00073506 [jit_opt_b]: 5.806e-05, [1] [Cycle 1]: 4.949e-05, [2] [frontend_op_eliminate]: 1.984e-05 [inline_after_opt_a]: 1.869e-05 [cconv]: 2.946e-05 [loop_unroll]: 0.00044775 [jit_opt_after_cconv]: 0.00016641, [1] [Cycle 1]: 0.00015969, [11] [c_1]: 2.496e-05 [parameter_eliminate]: 3.86999e-06 [updatestate_depend_eliminate]: 6.24999e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.68998e-06 [cse]: 3.318e-05 [call_graph_tuple_transform]: 2.116e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.942e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 9.41e-06 [add_recomputation]: 0.00010887 [cse_after_recomputation]: 2.822e-05, [1] [Cycle 1]: 2.209e-05, [1] [cse]: 1.555e-05 [auto_monad_reorder]: 1.8e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.22999e-06 [opt_after_jit_grad]: 0.00138605 [symbol_engine_optimizer]: 8.058e-05, [1] [Cycle 1]: 7.32e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 9.11002e-06 [elim_not_effective]: 1.474e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 9.42999e-06 [renormalize]: 5.3001e-07 [validate]: 5.214e-05 Sums bootstrap : 0.000349s : 0.27% type_inference : 0.120427s : 93.89% event_method : 0.000021s : 0.02% auto_monad : 0.000055s : 0.04% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000283s : 0.22% rewriter_before_opt_a : 0.000092s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000853s : 0.66% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002637s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000735s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000448s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000109s : 0.08% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.001386s : 1.08% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000284 25 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 87.14% : 0.000248s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000005s : 2: substitution.replace_old_param 4.39% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120345 2 98.08% : 0.118033s : 1: type_inference.infer 1.92% : 0.002311s : 1: type_inference.specialize ------[replace.] 0.000110 7 67.75% : 0.000074s : 5: replace.inline 32.25% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 95.59% : 0.000245s : 5: match.inline 4.41% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 888 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.41% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.86% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.35% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000002s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 65: predicate.switch_simplify 1.12% : 0.000002s : 13: predicate.tile_eliminate 1.54% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.65% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002795 29 71.95% : 0.002011s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.05% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 25.00% : 0.000699s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136069 72 0.08% : 0.000113s : 1: add_recomputation 0.04% : 0.000058s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000367s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.60% : 0.007619s : 1: jit_opt_a 0.12% : 0.000169s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.33% : 0.000455s : 1: loop_unroll 0.55% : 0.000749s : 1: mutable_eliminate 0.82% : 0.001110s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.03% : 0.001397s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000290s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.38% : 0.001872s : 1: renormalize.infer 0.56% : 0.000755s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000097s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 88.51% : 0.120439s : 1: type_inference TotalTime = 0.398883, [30] [bootstrap]: 0.00042526 [type_inference]: 0.34737 [event_method]: 2.678e-05 [auto_monad]: 7.919e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00071693 [rewriter_before_opt_a]: 0.00010912 [expand_dump_flag]: 4.4e-06 [jit_opt_a]: 0.0473042, [2] [Cycle 1]: 0.00573042, [27] [switch_simplify]: 9.355e-05 [loop_unroll]: 3.477e-05 [a_1]: 0.00095375 [with_stream_mark]: 2.823e-05 [recompute_prepare]: 1.035e-05 [updatestate_depend_eliminate]: 4.61002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 8.15999e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 7.89002e-06 [meta_shard_fg_expand]: 2.76999e-06 [get_grad_eliminate_]: 7.58999e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.761e-05 [j_node_and_user_rematch]: 1.197e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.268e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00417598 [add_forward_monad_depend]: 1.022e-05 [auto_monad_grad]: 3.05002e-06 [auto_monad_eliminator]: 2.068e-05 [cse]: 3.647e-05 [replace_applicator]: 2.487e-05 [Cycle 2]: 0.00041877, [27] [switch_simplify]: 7.16001e-06 [loop_unroll]: 6.79001e-06 [a_1]: 0.00014518 [with_stream_mark]: 1.713e-05 [recompute_prepare]: 6.58998e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 5.81998e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 3.35e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 6.28e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.569e-05 [replace_applicator]: 6.54999e-06 [py_interpret_to_execute_after_opt_a]: 1.793e-05 [rewriter_after_opt_a]: 4.226e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.00084714 [jit_opt_b]: 6.332e-05, [1] [Cycle 1]: 5.305e-05, [2] [frontend_op_eliminate]: 2.251e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 2.899e-05 [loop_unroll]: 0.00045387 [jit_opt_after_cconv]: 0.00016959, [1] [Cycle 1]: 0.00016254, [11] [c_1]: 2.782e-05 [parameter_eliminate]: 3.38e-06 [updatestate_depend_eliminate]: 7.13998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 2.671e-05 [call_graph_tuple_transform]: 2.223e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 6.51999e-06 [remove_dup_value]: 1.688e-05 [partial_unused_args_eliminate]: 4.30999e-06 [environ_conv]: 9.94999e-06 [add_recomputation]: 5.128e-05 [cse_after_recomputation]: 2.534e-05, [1] [Cycle 1]: 1.971e-05, [1] [cse]: 1.359e-05 [auto_monad_reorder]: 1.708e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 6.41e-06 [opt_after_jit_grad]: 0.00047647 [symbol_engine_optimizer]: 0.00030768, [1] [Cycle 1]: 7.733e-05, [6] [build]: 4.70001e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.656e-05 [opt_reshape]: 9.55001e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 3.30008e-07 [validate]: 5.921e-05 Sums bootstrap : 0.000425s : 0.12% type_inference : 0.347370s : 97.36% event_method : 0.000027s : 0.01% auto_monad : 0.000079s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000717s : 0.20% rewriter_before_opt_a : 0.000109s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000101s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.001099s : 0.31% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004176s : 1.17% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000052s : 0.01% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000847s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000454s : 0.13% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000051s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000476s : 0.13% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.02% Time group info: ------[substitution.] 0.000405 28 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.82% : 0.000007s : 4: substitution.graph_param_transform 85.77% : 0.000348s : 5: substitution.inline 1.21% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.73% : 0.000015s : 3: substitution.reduce_eliminate 1.32% : 0.000005s : 4: substitution.remove_not_recompute_node 1.72% : 0.000007s : 2: substitution.replace_old_param 3.54% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.347273 2 98.80% : 0.343103s : 1: type_inference.infer 1.20% : 0.004170s : 1: type_inference.specialize ------[replace.] 0.000136 7 69.84% : 0.000095s : 5: replace.inline 30.16% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000357 7 96.31% : 0.000344s : 5: match.inline 3.69% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 886 1.50% : 0.000003s : 13: predicate.accumulaten_eliminater 0.84% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.44% : 0.000002s : 13: predicate.addn_check_dump 1.11% : 0.000002s : 13: predicate.addn_zero_filter 2.69% : 0.000005s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.71% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.40% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.70% : 0.000003s : 13: predicate.environ_get_eliminate 1.30% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.49% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.11% : 0.000004s : 8: predicate.less_batch_normalization 1.59% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 0.98% : 0.000002s : 13: predicate.minmaximum_grad 1.67% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 2.60% : 0.000004s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 8: predicate.remove_not_recompute_node 1.77% : 0.000003s : 23: predicate.replace_applicator 0.47% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 13: predicate.reshape_eliminate 1.69% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000002s : 8: predicate.specialize_transform 1.70% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 1.91% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.32% : 0.000012s : 64: predicate.switch_simplify 1.84% : 0.000003s : 13: predicate.tile_eliminate 1.09% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 2.07% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.97% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003120 25 61.69% : 0.001925s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.53% : 0.000110s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.78% : 0.001085s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.404510 72 0.01% : 0.000056s : 1: add_recomputation 0.02% : 0.000083s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.11% : 0.000455s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.70% : 0.047308s : 1: jit_opt_a 0.04% : 0.000172s : 1: jit_opt_after_cconv 0.02% : 0.000066s : 1: jit_opt_b 0.11% : 0.000463s : 1: loop_unroll 0.21% : 0.000858s : 1: mutable_eliminate 0.35% : 0.001399s : 26: opt.transform.jit_opt_a 0.01% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.12% : 0.000486s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000725s : 1: py_interpret_to_execute 0.00% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.75% : 0.003025s : 1: renormalize.infer 0.28% : 0.001137s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000045s : 1: rewriter_after_opt_a 0.03% : 0.000114s : 1: rewriter_before_opt_a 0.08% : 0.000311s : 1: symbol_engine_optimizer 85.88% : 0.347392s : 1: type_inference TotalTime = 0.0926977, [30] [bootstrap]: 0.00030125 [type_inference]: 0.0651435 [event_method]: 0.00029804 [auto_monad]: 0.00010702 [graph_reusing]: 7.29001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 3.291e-05 [rewriter_before_opt_a]: 0.00012424 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0244423, [3] [Cycle 1]: 0.0174312, [27] [switch_simplify]: 7.195e-05 [loop_unroll]: 4.765e-05 [a_1]: 0.00098612 [with_stream_mark]: 2.792e-05 [recompute_prepare]: 2.087e-05 [updatestate_depend_eliminate]: 8.35999e-06 [updatestate_assign_eliminate]: 7.06001e-06 [updatestate_loads_eliminate]: 7.06001e-06 [parameter_eliminate]: 2.83998e-06 [specialize_transform]: 1.505e-05 [updatestate_useless_node_eliminater]: 1.447e-05 [accelerated_algorithm]: 1.504e-05 [meta_shard_fg_expand]: 3.44001e-06 [get_grad_eliminate_]: 1.39e-05 [merge_forward]: 8.99e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.785e-05 [j_node_and_user_rematch]: 2.482e-05 [meta_fg_expand]: 0.00168455 [replace_old_param]: 6.957e-05 [inline_without_move]: 6.15e-05 [renormalize]: 0.0136316 [add_forward_monad_depend]: 1.141e-05 [auto_monad_grad]: 6.94001e-06 [auto_monad_eliminator]: 6.28e-05 [cse]: 0.00027167 [replace_applicator]: 8.936e-05 [Cycle 2]: 0.00351721, [27] [switch_simplify]: 4.391e-05 [loop_unroll]: 4.171e-05 [a_1]: 0.00114077 [with_stream_mark]: 1.702e-05 [recompute_prepare]: 9.59e-06 [updatestate_depend_eliminate]: 4.90999e-06 [updatestate_assign_eliminate]: 3.87002e-06 [updatestate_loads_eliminate]: 3.9e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 6.71e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.693e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 0.0001331 [replace_old_param]: 9.11998e-06 [inline_without_move]: 6.86999e-06 [renormalize]: 0.00181955 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 1.69e-06 [auto_monad_eliminator]: 1.089e-05 [cse]: 2.011e-05 [replace_applicator]: 1.301e-05 [Cycle 3]: 0.00024427, [27] [switch_simplify]: 4.09997e-06 [loop_unroll]: 3.81999e-06 [a_1]: 3.826e-05 [with_stream_mark]: 8.99e-06 [recompute_prepare]: 3.46001e-06 [updatestate_depend_eliminate]: 2.37999e-06 [updatestate_assign_eliminate]: 1.94e-06 [updatestate_loads_eliminate]: 1.49998e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 3.41999e-06 [updatestate_useless_node_eliminater]: 3.03998e-06 [accelerated_algorithm]: 3.33e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 3.04999e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.05e-05 [j_node_and_user_rematch]: 5.72999e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 3.21001e-06 [inline_without_move]: 2.89999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 3.65e-06 [cse]: 8.97999e-06 [replace_applicator]: 3.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.105e-05 [rewriter_after_opt_a]: 3.265e-05 [convert_after_rewriter]: 6.11e-06 [order_py_execute_after_rewriter]: 4.06001e-06 [mutable_eliminate]: 0.00065808 [jit_opt_b]: 4.121e-05, [1] [Cycle 1]: 3.435e-05, [2] [frontend_op_eliminate]: 1.04e-05 [inline_after_opt_a]: 1.179e-05 [cconv]: 2.372e-05 [loop_unroll]: 0.00041302 [jit_opt_after_cconv]: 0.0001237, [1] [Cycle 1]: 0.00011626, [11] [c_1]: 1.3e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 1.67001e-06 [updatestate_loads_eliminate]: 1.67999e-06 [cse]: 1.6e-05 [call_graph_tuple_transform]: 1.385e-05 [tuple_list_get_item_eliminator]: 3.83999e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 3.35e-06 [remove_dup_value]: 1.398e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 4.80999e-06 [add_recomputation]: 3.468e-05 [cse_after_recomputation]: 1.973e-05, [1] [Cycle 1]: 1.464e-05, [1] [cse]: 8.65001e-06 [auto_monad_reorder]: 1.222e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 4.60999e-06 [opt_after_jit_grad]: 0.00054013 [symbol_engine_optimizer]: 6.89e-05, [1] [Cycle 1]: 6.251e-05, [6] [build]: 3.53e-06 [elim_shapecalc]: 6.78998e-06 [elim_not_effective]: 9.24e-06 [opt_reshape]: 4.57e-06 [fold_const_symbol]: 6.11e-06 [renormalize]: 4.60015e-07 [validate]: 3.423e-05 Sums bootstrap : 0.000301s : 0.34% type_inference : 0.065143s : 73.52% event_method : 0.000298s : 0.34% auto_monad : 0.000107s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000033s : 0.04% rewriter_before_opt_a : 0.000124s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000120s : 0.14% jit_opt_a.loop_unroll : 0.000093s : 0.11% jit_opt_a.a_1 : 0.002165s : 2.44% jit_opt_a.with_stream_mark : 0.000054s : 0.06% jit_opt_a.recompute_prepare : 0.000034s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000025s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000055s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.05% jit_opt_a.meta_fg_expand : 0.001819s : 2.05% jit_opt_a.replace_old_param : 0.000082s : 0.09% jit_opt_a.inline_without_move : 0.000071s : 0.08% jit_opt_a.renormalize : 0.015451s : 17.44% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000077s : 0.09% jit_opt_a.cse : 0.000301s : 0.34% jit_opt_a.replace_applicator : 0.000106s : 0.12% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000658s : 0.74% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000024s : 0.03% loop_unroll : 0.000413s : 0.47% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000035s : 0.04% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000540s : 0.61% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.04% Time group info: ------[substitution.] 0.000537 104 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.20% : 0.000001s : 1: substitution.fold_const_symbol 0.85% : 0.000005s : 1: substitution.graph_param_transform 65.33% : 0.000351s : 13: substitution.inline 3.18% : 0.000017s : 2: substitution.inline_without_move 1.69% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.07% : 0.000011s : 7: substitution.minmaximum_grad 1.35% : 0.000007s : 5: substitution.partial_eliminate 1.85% : 0.000010s : 12: substitution.remove_not_recompute_node 5.66% : 0.000030s : 10: substitution.replace_applicator 1.27% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.07% : 0.000006s : 1: substitution.tile_eliminate 4.13% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.84% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.79% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.065047 2 95.90% : 0.062380s : 1: type_inference.infer 4.10% : 0.002667s : 1: type_inference.specialize ------[replace.] 0.000177 20 64.44% : 0.000114s : 13: replace.inline 35.56% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000364 20 94.30% : 0.000343s : 13: match.inline 5.70% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000370 2656 1.50% : 0.000006s : 46: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.52% : 0.000006s : 46: predicate.addn_check_dump 1.61% : 0.000006s : 46: predicate.addn_zero_filter 2.04% : 0.000008s : 46: predicate.arithmetic_simplify 1.62% : 0.000006s : 46: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 46: predicate.compare_switch_simplify 1.49% : 0.000006s : 46: predicate.depend_value_elim 1.47% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.61% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.17% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.48% : 0.000005s : 46: predicate.environ_get_add_eliminate 1.49% : 0.000006s : 46: predicate.environ_get_depend_swap 1.61% : 0.000006s : 46: predicate.environ_get_eliminate 1.47% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.89% : 0.000003s : 18: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.14% : 0.000015s : 68: predicate.inline 2.08% : 0.000008s : 46: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.99% : 0.000004s : 18: predicate.less_batch_normalization 1.96% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 54: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.60% : 0.000013s : 99: predicate.loop_unroll_before_grad 1.73% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.47% : 0.000005s : 46: predicate.merge_addn 1.54% : 0.000006s : 46: predicate.minmaximum_grad 0.40% : 0.000001s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.36% : 0.000009s : 54: predicate.partial_eliminate 1.50% : 0.000006s : 46: predicate.print_const_string_wrapper 1.94% : 0.000007s : 46: predicate.reduce_eliminate 1.89% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000002s : 18: predicate.remove_not_recompute_node 3.01% : 0.000011s : 99: predicate.replace_applicator 1.10% : 0.000004s : 46: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.54% : 0.000006s : 46: predicate.reshape_eliminate 1.52% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.53% : 0.000006s : 46: predicate.same_eliminate 0.52% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 18: predicate.specialize_transform 1.80% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000010s : 66: predicate.switch_defer_inline 2.54% : 0.000009s : 66: predicate.switch_layer_defer_inline 6.47% : 0.000024s : 166: predicate.switch_simplify 1.59% : 0.000006s : 46: predicate.tile_eliminate 1.51% : 0.000006s : 46: predicate.transpose_eliminate 1.93% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.81% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.29% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.89% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.67% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.89% : 0.000007s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004317 52 75.57% : 0.003262s : 35: func_graph_cloner_run.FuncGraphClonerGraph 24.43% : 0.001055s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.110965 87 0.03% : 0.000037s : 1: add_recomputation 0.10% : 0.000114s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.29% : 0.000322s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.28% : 0.000306s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.03% : 0.024445s : 1: jit_opt_a 0.11% : 0.000127s : 1: jit_opt_after_cconv 0.04% : 0.000044s : 1: jit_opt_b 0.38% : 0.000420s : 1: loop_unroll 0.60% : 0.000667s : 1: mutable_eliminate 2.54% : 0.002817s : 39: opt.transform.jit_opt_a 0.03% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.02% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000549s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000036s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 11.69% : 0.012973s : 2: renormalize.infer 2.22% : 0.002458s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.11% : 0.000127s : 1: rewriter_before_opt_a 0.06% : 0.000071s : 1: symbol_engine_optimizer 58.72% : 0.065161s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.349.444 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065700> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.350.209 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0466058, [30] [bootstrap]: 0.00027661 [type_inference]: 0.0386125 [event_method]: 2.234e-05 [auto_monad]: 6.952e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 9.672e-05 [rewriter_before_opt_a]: 8.327e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00533504, [2] [Cycle 1]: 0.00178055, [27] [switch_simplify]: 5.177e-05 [loop_unroll]: 2.868e-05 [a_1]: 0.00052486 [with_stream_mark]: 2.03e-05 [recompute_prepare]: 7.36999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.411e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.04e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00083278 [add_forward_monad_depend]: 6.42001e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.513e-05 [cse]: 3.325e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00030775, [27] [switch_simplify]: 5.49998e-06 [loop_unroll]: 5.12e-06 [a_1]: 8.721e-05 [with_stream_mark]: 9.18002e-06 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.01002e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.196e-05 [j_node_and_user_rematch]: 7.58999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7e-06 [inline_without_move]: 4.64998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.28002e-06 [cse]: 1.167e-05 [replace_applicator]: 4.86002e-06 [py_interpret_to_execute_after_opt_a]: 1.022e-05 [rewriter_after_opt_a]: 3.69e-05 [convert_after_rewriter]: 6.90002e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00048823 [jit_opt_b]: 4.709e-05, [1] [Cycle 1]: 4.063e-05, [2] [frontend_op_eliminate]: 1.475e-05 [inline_after_opt_a]: 1.523e-05 [cconv]: 2.537e-05 [loop_unroll]: 0.00039752 [jit_opt_after_cconv]: 0.00013493, [1] [Cycle 1]: 0.0001289, [11] [c_1]: 1.985e-05 [parameter_eliminate]: 2.17999e-06 [updatestate_depend_eliminate]: 5.32001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.917e-05 [call_graph_tuple_transform]: 1.76e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.30001e-06 [remove_dup_value]: 1.567e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 5.357e-05 [add_recomputation]: 5.431e-05 [cse_after_recomputation]: 2.971e-05, [1] [Cycle 1]: 2.35e-05, [1] [cse]: 1.462e-05 [auto_monad_reorder]: 1.965e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.73001e-06 [opt_after_jit_grad]: 0.00045 [symbol_engine_optimizer]: 8.595e-05, [1] [Cycle 1]: 7.994e-05, [6] [build]: 3.78001e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.194e-05 [opt_reshape]: 5.30999e-06 [fold_const_symbol]: 2.42e-05 [renormalize]: 3.00002e-07 [validate]: 3.809e-05 Sums bootstrap : 0.000277s : 0.65% type_inference : 0.038613s : 90.25% event_method : 0.000022s : 0.05% auto_monad : 0.000070s : 0.16% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000097s : 0.23% rewriter_before_opt_a : 0.000083s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000612s : 1.43% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000833s : 1.95% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000045s : 0.10% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000037s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000488s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000025s : 0.06% loop_unroll : 0.000398s : 0.93% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000054s : 0.13% add_recomputation : 0.000054s : 0.13% cse_after_recomputation.cse : 0.000015s : 0.03% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000450s : 1.05% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000024s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.09% Time group info: ------[substitution.] 0.000221 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 7.55% : 0.000017s : 2: substitution.fold_const_symbol 2.32% : 0.000005s : 3: substitution.graph_param_transform 78.73% : 0.000174s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000004s : 4: substitution.remove_not_recompute_node 1.91% : 0.000004s : 2: substitution.replace_old_param 5.43% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038533 2 95.89% : 0.036950s : 1: type_inference.infer 4.11% : 0.001584s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.99% : 0.000046s : 4: replace.inline 31.01% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 94.06% : 0.000172s : 4: match.inline 5.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.65% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.18% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.53% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.92% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000904 13 43.42% : 0.000393s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.66% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.92% : 0.000469s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048316 72 0.12% : 0.000058s : 1: add_recomputation 0.15% : 0.000073s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.62% : 0.000298s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000032s : 1: cse_after_recomputation 0.12% : 0.000058s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 11.05% : 0.005338s : 1: jit_opt_a 0.28% : 0.000137s : 1: jit_opt_after_cconv 0.10% : 0.000050s : 1: jit_opt_b 0.84% : 0.000405s : 1: loop_unroll 1.03% : 0.000497s : 1: mutable_eliminate 1.69% : 0.000816s : 26: opt.transform.jit_opt_a 0.09% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000100s : 1: py_interpret_to_execute 0.03% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.00% : 0.000485s : 1: renormalize.infer 0.70% : 0.000340s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.18% : 0.000087s : 1: rewriter_before_opt_a 0.18% : 0.000088s : 1: symbol_engine_optimizer 79.97% : 0.038637s : 1: type_inference TotalTime = 0.080649, [30] [bootstrap]: 0.00026806 [type_inference]: 0.0718099 [event_method]: 1.898e-05 [auto_monad]: 6.906e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.28002e-06 [py_interpret_to_execute]: 0.00011104 [rewriter_before_opt_a]: 8.481e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00602059, [2] [Cycle 1]: 0.00246901, [27] [switch_simplify]: 5.23e-05 [loop_unroll]: 2.949e-05 [a_1]: 0.00096315 [with_stream_mark]: 2.149e-05 [recompute_prepare]: 9.65002e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.36998e-06 [specialize_transform]: 6.11998e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.80998e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.56002e-06 [renormalize]: 0.00102889 [add_forward_monad_depend]: 5.97999e-06 [auto_monad_grad]: 2.70002e-06 [auto_monad_eliminator]: 1.623e-05 [cse]: 3.148e-05 [replace_applicator]: 3.969e-05 [Cycle 2]: 0.00033032, [27] [switch_simplify]: 6.26998e-06 [loop_unroll]: 5.24e-06 [a_1]: 8.84e-05 [with_stream_mark]: 1.222e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 8.25e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.59002e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 6.95002e-06 [cse]: 1.502e-05 [replace_applicator]: 5.00001e-06 [py_interpret_to_execute_after_opt_a]: 1.315e-05 [rewriter_after_opt_a]: 7.574e-05 [convert_after_rewriter]: 8.08999e-06 [order_py_execute_after_rewriter]: 5.50001e-06 [mutable_eliminate]: 0.0005472 [jit_opt_b]: 4.986e-05, [1] [Cycle 1]: 4.23e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.565e-05 [cconv]: 2.978e-05 [loop_unroll]: 0.00047925 [jit_opt_after_cconv]: 0.000142, [1] [Cycle 1]: 0.00013575, [11] [c_1]: 2.015e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 6.56e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.27e-05 [call_graph_tuple_transform]: 1.848e-05 [tuple_list_get_item_eliminator]: 5.31002e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.32999e-06 [remove_dup_value]: 2.763e-05 [partial_unused_args_eliminate]: 2.68003e-06 [environ_conv]: 6.33998e-06 [add_recomputation]: 5.178e-05 [cse_after_recomputation]: 2.224e-05, [1] [Cycle 1]: 1.712e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.824e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00047988 [symbol_engine_optimizer]: 7.211e-05, [1] [Cycle 1]: 6.587e-05, [6] [build]: 3.09001e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.302e-05 [opt_reshape]: 5.78002e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 4.90021e-07 [validate]: 3.916e-05 Sums bootstrap : 0.000268s : 0.35% type_inference : 0.071810s : 93.45% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000111s : 0.14% rewriter_before_opt_a : 0.000085s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.001052s : 1.37% jit_opt_a.with_stream_mark : 0.000034s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001029s : 1.34% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000047s : 0.06% jit_opt_a.replace_applicator : 0.000045s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000076s : 0.10% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000547s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000030s : 0.04% loop_unroll : 0.000479s : 0.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000028s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000480s : 0.62% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.05% Time group info: ------[substitution.] 0.000264 23 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 87.61% : 0.000232s : 4: substitution.inline 1.10% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.54% : 0.000004s : 4: substitution.remove_not_recompute_node 1.65% : 0.000004s : 2: substitution.replace_old_param 4.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071741 2 97.60% : 0.070019s : 1: type_inference.infer 2.40% : 0.001723s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.02% : 0.000052s : 4: replace.inline 31.98% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 95.22% : 0.000229s : 4: match.inline 4.78% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000474 691 0.34% : 0.000002s : 10: predicate.accumulaten_eliminater 0.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.27% : 0.000001s : 10: predicate.addn_check_dump 0.30% : 0.000001s : 10: predicate.addn_zero_filter 0.46% : 0.000002s : 10: predicate.arithmetic_simplify 0.30% : 0.000001s : 10: predicate.cast_eliminate 0.10% : 0.000000s : 3: predicate.check_bprop_eliminate 0.26% : 0.000001s : 10: predicate.compare_switch_simplify 0.30% : 0.000001s : 10: predicate.depend_value_elim 0.34% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 0.31% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 3: predicate.elim_not_effective 0.13% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.28% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.27% : 0.000001s : 10: predicate.environ_get_depend_swap 0.30% : 0.000001s : 10: predicate.environ_get_eliminate 0.26% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.06% : 0.000000s : 3: predicate.fold_const_symbol 0.22% : 0.000001s : 6: predicate.get_grad_eliminate 0.10% : 0.000000s : 3: predicate.graph_param_transform 76.69% : 0.000364s : 22: predicate.inline 0.24% : 0.000001s : 6: predicate.inline_without_move 0.09% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.32% : 0.000001s : 6: predicate.less_batch_normalization 0.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.45% : 0.000002s : 15: predicate.load_eliminater 0.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.47% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.27% : 0.000001s : 10: predicate.merge_addn 0.26% : 0.000001s : 10: predicate.minmaximum_grad 0.38% : 0.000002s : 3: predicate.mutable_eliminate 0.12% : 0.000001s : 3: predicate.opt_reshape 0.58% : 0.000003s : 15: predicate.partial_eliminate 0.30% : 0.000001s : 10: predicate.print_const_string_wrapper 0.36% : 0.000002s : 10: predicate.reduce_eliminate 0.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.17% : 0.000001s : 6: predicate.remove_not_recompute_node 0.51% : 0.000002s : 18: predicate.replace_applicator 0.18% : 0.000001s : 6: predicate.replace_old_param 0.12% : 0.000001s : 3: predicate.reset_defer_inline 0.30% : 0.000001s : 10: predicate.reshape_eliminate 0.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 3: predicate.row_tensor_eliminate 0.30% : 0.000001s : 10: predicate.same_eliminate 0.15% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 6: predicate.special_op_eliminate 0.24% : 0.000001s : 6: predicate.specialize_transform 0.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.11% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.61% : 0.000003s : 16: predicate.switch_defer_inline 0.51% : 0.000002s : 16: predicate.switch_layer_defer_inline 1.77% : 0.000008s : 53: predicate.switch_simplify 0.29% : 0.000001s : 10: predicate.tile_eliminate 0.35% : 0.000002s : 10: predicate.transpose_eliminate 0.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 1.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 0.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.41% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 0.41% : 0.000002s : 10: predicate.value_based_eliminate 0.09% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000856 13 44.65% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.46% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.89% : 0.000427s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.083026 72 0.07% : 0.000055s : 1: add_recomputation 0.09% : 0.000073s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.35% : 0.000288s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.26% : 0.006024s : 1: jit_opt_a 0.17% : 0.000145s : 1: jit_opt_after_cconv 0.06% : 0.000053s : 1: jit_opt_b 0.59% : 0.000488s : 1: loop_unroll 0.67% : 0.000557s : 1: mutable_eliminate 1.56% : 0.001293s : 26: opt.transform.jit_opt_a 0.06% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000114s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000031s : 1: remove_dup_value 0.72% : 0.000599s : 1: renormalize.infer 0.51% : 0.000420s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000080s : 1: rewriter_after_opt_a 0.11% : 0.000089s : 1: rewriter_before_opt_a 0.09% : 0.000075s : 1: symbol_engine_optimizer 86.51% : 0.071824s : 1: type_inference TotalTime = 0.0964282, [30] [bootstrap]: 0.00025584 [type_inference]: 0.0673755 [event_method]: 0.00033575 [auto_monad]: 0.00011 [graph_reusing]: 7.56999e-06 [pre_auto_parallel]: 3.02002e-06 [py_interpret_to_execute]: 3.602e-05 [rewriter_before_opt_a]: 0.00012701 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.0260505, [3] [Cycle 1]: 0.0183967, [27] [switch_simplify]: 8.523e-05 [loop_unroll]: 4.877e-05 [a_1]: 0.00106349 [with_stream_mark]: 3.672e-05 [recompute_prepare]: 2.126e-05 [updatestate_depend_eliminate]: 9.92999e-06 [updatestate_assign_eliminate]: 6.94999e-06 [updatestate_loads_eliminate]: 6.49001e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 1.583e-05 [updatestate_useless_node_eliminater]: 1.432e-05 [accelerated_algorithm]: 1.512e-05 [meta_shard_fg_expand]: 4.95001e-06 [get_grad_eliminate_]: 1.41e-05 [merge_forward]: 9.07001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.043e-05 [j_node_and_user_rematch]: 2.618e-05 [meta_fg_expand]: 0.00193309 [replace_old_param]: 7.116e-05 [inline_without_move]: 6.276e-05 [renormalize]: 0.0141987 [add_forward_monad_depend]: 1.274e-05 [auto_monad_grad]: 6.28e-06 [auto_monad_eliminator]: 6.261e-05 [cse]: 0.00028873 [replace_applicator]: 9.385e-05 [Cycle 2]: 0.00385283, [27] [switch_simplify]: 4.462e-05 [loop_unroll]: 4.465e-05 [a_1]: 0.00126201 [with_stream_mark]: 1.747e-05 [recompute_prepare]: 9.82001e-06 [updatestate_depend_eliminate]: 5.86e-06 [updatestate_assign_eliminate]: 3.98999e-06 [updatestate_loads_eliminate]: 3.8e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 9.69e-06 [updatestate_useless_node_eliminater]: 8.32e-06 [accelerated_algorithm]: 8.60999e-06 [meta_shard_fg_expand]: 3.33e-06 [get_grad_eliminate_]: 8.54e-06 [merge_forward]: 4.82998e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.024e-05 [j_node_and_user_rematch]: 1.362e-05 [meta_fg_expand]: 0.00013081 [replace_old_param]: 9.37999e-06 [inline_without_move]: 8.28999e-06 [renormalize]: 0.00202053 [add_forward_monad_depend]: 5.59998e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 9.44e-06 [cse]: 1.849e-05 [replace_applicator]: 1.183e-05 [Cycle 3]: 0.00023988, [27] [switch_simplify]: 4.08001e-06 [loop_unroll]: 3.74002e-06 [a_1]: 4.004e-05 [with_stream_mark]: 7.92998e-06 [recompute_prepare]: 3.4e-06 [updatestate_depend_eliminate]: 2.16e-06 [updatestate_assign_eliminate]: 1.66e-06 [updatestate_loads_eliminate]: 1.59e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 3.43e-06 [updatestate_useless_node_eliminater]: 3.06001e-06 [accelerated_algorithm]: 3.03e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 3.05002e-06 [merge_forward]: 2.02999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.61e-06 [j_node_and_user_rematch]: 5.49e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 3.35e-06 [inline_without_move]: 2.95998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 3.43999e-06 [cse]: 7.61001e-06 [replace_applicator]: 3.4e-06 [py_interpret_to_execute_after_opt_a]: 1.076e-05 [rewriter_after_opt_a]: 3.249e-05 [convert_after_rewriter]: 5.63002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00067029 [jit_opt_b]: 4.273e-05, [1] [Cycle 1]: 3.483e-05, [2] [frontend_op_eliminate]: 1.148e-05 [inline_after_opt_a]: 1.14e-05 [cconv]: 2.449e-05 [loop_unroll]: 0.00040625 [jit_opt_after_cconv]: 0.00012227, [1] [Cycle 1]: 0.00011604, [11] [c_1]: 1.231e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 1.79e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.61e-05 [call_graph_tuple_transform]: 1.351e-05 [tuple_list_get_item_eliminator]: 4.1e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 3.5e-06 [remove_dup_value]: 1.452e-05 [partial_unused_args_eliminate]: 1.92999e-06 [environ_conv]: 4.78001e-06 [add_recomputation]: 3.508e-05 [cse_after_recomputation]: 1.875e-05, [1] [Cycle 1]: 1.364e-05, [1] [cse]: 7.11001e-06 [auto_monad_reorder]: 1.24e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.50999e-06 [opt_after_jit_grad]: 0.00042566 [symbol_engine_optimizer]: 6.243e-05, [1] [Cycle 1]: 5.632e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 5.65001e-06 [elim_not_effective]: 9.27999e-06 [opt_reshape]: 3.63e-06 [fold_const_symbol]: 5.99e-06 [renormalize]: 3.69997e-07 [validate]: 2.589e-05 Sums bootstrap : 0.000256s : 0.28% type_inference : 0.067376s : 73.23% event_method : 0.000336s : 0.36% auto_monad : 0.000110s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000036s : 0.04% rewriter_before_opt_a : 0.000127s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000134s : 0.15% jit_opt_a.loop_unroll : 0.000097s : 0.11% jit_opt_a.a_1 : 0.002366s : 2.57% jit_opt_a.with_stream_mark : 0.000062s : 0.07% jit_opt_a.recompute_prepare : 0.000034s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.03% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.05% jit_opt_a.meta_fg_expand : 0.002065s : 2.24% jit_opt_a.replace_old_param : 0.000084s : 0.09% jit_opt_a.inline_without_move : 0.000074s : 0.08% jit_opt_a.renormalize : 0.016219s : 17.63% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.02% jit_opt_a.auto_monad_grad : 0.000008s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000075s : 0.08% jit_opt_a.cse : 0.000315s : 0.34% jit_opt_a.replace_applicator : 0.000109s : 0.12% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000670s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000024s : 0.03% loop_unroll : 0.000406s : 0.44% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000035s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000426s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000026s : 0.03% Time group info: ------[substitution.] 0.000645 107 0.29% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.60% : 0.000004s : 1: substitution.graph_param_transform 64.14% : 0.000414s : 13: substitution.inline 2.96% : 0.000019s : 2: substitution.inline_without_move 1.44% : 0.000009s : 13: substitution.j_node_and_user_rematch 1.99% : 0.000013s : 7: substitution.minmaximum_grad 1.31% : 0.000008s : 5: substitution.partial_eliminate 1.65% : 0.000011s : 13: substitution.remove_not_recompute_node 5.13% : 0.000033s : 10: substitution.replace_applicator 0.97% : 0.000006s : 10: substitution.replace_old_param 1.02% : 0.000007s : 1: substitution.reshape_eliminate 0.36% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000006s : 1: substitution.tile_eliminate 7.93% : 0.000051s : 7: substitution.tuple_list_convert_item_index_to_positive 2.41% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.68% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067269 2 95.96% : 0.064550s : 1: type_inference.infer 4.04% : 0.002719s : 1: type_inference.specialize ------[replace.] 0.000188 20 65.98% : 0.000124s : 13: replace.inline 34.02% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000427 20 94.95% : 0.000406s : 13: match.inline 5.05% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000392 2768 1.55% : 0.000006s : 48: predicate.accumulaten_eliminater 0.20% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.42% : 0.000006s : 48: predicate.addn_check_dump 1.61% : 0.000006s : 48: predicate.addn_zero_filter 1.92% : 0.000008s : 48: predicate.arithmetic_simplify 1.67% : 0.000007s : 48: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000006s : 48: predicate.compare_switch_simplify 1.47% : 0.000006s : 48: predicate.depend_value_elim 1.44% : 0.000006s : 48: predicate.dict_get_item_const_eliminator 1.69% : 0.000007s : 48: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 48: predicate.dict_set_item_eliminator 0.18% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000006s : 48: predicate.environ_add_const_eliminate 1.51% : 0.000006s : 48: predicate.environ_get_add_eliminate 1.42% : 0.000006s : 48: predicate.environ_get_depend_swap 1.48% : 0.000006s : 48: predicate.environ_get_eliminate 1.51% : 0.000006s : 48: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.95% : 0.000004s : 20: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.32% : 0.000017s : 70: predicate.inline 1.98% : 0.000008s : 48: predicate.inline_without_move 0.37% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.00% : 0.000004s : 20: predicate.less_batch_normalization 1.97% : 0.000008s : 55: predicate.list_to_tuple_eliminator_ 1.82% : 0.000007s : 56: predicate.load_eliminater 0.23% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.58% : 0.000014s : 101: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.44% : 0.000006s : 48: predicate.merge_addn 1.59% : 0.000006s : 48: predicate.minmaximum_grad 0.30% : 0.000001s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.36% : 0.000009s : 56: predicate.partial_eliminate 1.51% : 0.000006s : 48: predicate.print_const_string_wrapper 2.02% : 0.000008s : 48: predicate.reduce_eliminate 1.82% : 0.000007s : 55: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 20: predicate.remove_not_recompute_node 2.84% : 0.000011s : 103: predicate.replace_applicator 1.22% : 0.000005s : 48: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000006s : 48: predicate.reshape_eliminate 1.58% : 0.000006s : 48: predicate.row_tensor_add_zeros_like 0.13% : 0.000001s : 1: predicate.row_tensor_eliminate 1.63% : 0.000006s : 48: predicate.same_eliminate 0.52% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.13% : 0.000001s : 2: predicate.special_op_eliminate 0.89% : 0.000003s : 20: predicate.specialize_transform 1.77% : 0.000007s : 48: predicate.split_environ_get_set_with_tuple_value 1.78% : 0.000007s : 48: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.94% : 0.000012s : 68: predicate.switch_defer_inline 2.57% : 0.000010s : 68: predicate.switch_layer_defer_inline 6.47% : 0.000025s : 170: predicate.switch_simplify 1.59% : 0.000006s : 48: predicate.tile_eliminate 1.53% : 0.000006s : 48: predicate.transpose_eliminate 1.95% : 0.000008s : 48: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000007s : 48: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000013s : 57: predicate.tuple_list_get_item_eliminator 1.90% : 0.000007s : 48: predicate.tuple_list_set_item_eliminator 1.89% : 0.000007s : 55: predicate.tuple_to_list_eliminator_ 1.76% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.74% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.91% : 0.000007s : 48: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.11% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004362 52 77.17% : 0.003366s : 35: func_graph_cloner_run.FuncGraphClonerGraph 22.83% : 0.000996s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115711 87 0.03% : 0.000038s : 1: add_recomputation 0.10% : 0.000116s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000284s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.30% : 0.000346s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.52% : 0.026054s : 1: jit_opt_a 0.11% : 0.000125s : 1: jit_opt_after_cconv 0.04% : 0.000045s : 1: jit_opt_b 0.36% : 0.000414s : 1: loop_unroll 0.59% : 0.000678s : 1: mutable_eliminate 2.65% : 0.003061s : 39: opt.transform.jit_opt_a 0.03% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000010s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000433s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000039s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 11.93% : 0.013804s : 2: renormalize.infer 2.07% : 0.002395s : 2: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.11% : 0.000130s : 1: rewriter_before_opt_a 0.06% : 0.000065s : 1: symbol_engine_optimizer 58.25% : 0.067398s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.500.728 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00651f0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.501.571 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0413155, [30] [bootstrap]: 0.00035323 [type_inference]: 0.0141685 [event_method]: 2.61e-05 [auto_monad]: 8.289e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 6.608e-05 [rewriter_before_opt_a]: 8.956e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00740799, [2] [Cycle 1]: 0.00271295, [27] [switch_simplify]: 7.859e-05 [loop_unroll]: 3.397e-05 [a_1]: 0.00079561 [with_stream_mark]: 2.874e-05 [recompute_prepare]: 1.027e-05 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 3.14999e-06 [get_grad_eliminate_]: 6.74999e-06 [merge_forward]: 4.89998e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.699e-05 [j_node_and_user_rematch]: 1.094e-05 [meta_fg_expand]: 3.20998e-06 [replace_old_param]: 1.194e-05 [inline_without_move]: 5.59e-06 [renormalize]: 0.00134085 [add_forward_monad_depend]: 9.27999e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.062e-05 [cse]: 4.129e-05 [replace_applicator]: 2.198e-05 [Cycle 2]: 0.00038333, [27] [switch_simplify]: 7.06001e-06 [loop_unroll]: 5.17e-06 [a_1]: 0.00011598 [with_stream_mark]: 1.607e-05 [recompute_prepare]: 6.44999e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 3.41001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 8.42998e-06 [cse]: 1.393e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.926e-05 [rewriter_after_opt_a]: 4.13e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.62001e-06 [mutable_eliminate]: 0.00084421 [jit_opt_b]: 6.113e-05, [1] [Cycle 1]: 5.2e-05, [2] [frontend_op_eliminate]: 2.061e-05 [inline_after_opt_a]: 1.822e-05 [cconv]: 3.341e-05 [loop_unroll]: 0.0005218 [jit_opt_after_cconv]: 0.00021283, [1] [Cycle 1]: 0.00020433, [11] [c_1]: 2.334e-05 [parameter_eliminate]: 5.15999e-06 [updatestate_depend_eliminate]: 1.16e-05 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.67002e-06 [cse]: 3.636e-05 [call_graph_tuple_transform]: 2.682e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.89001e-06 [remove_dup_value]: 1.963e-05 [partial_unused_args_eliminate]: 2.99001e-06 [environ_conv]: 8.82e-06 [add_recomputation]: 6.202e-05 [cse_after_recomputation]: 2.848e-05, [1] [Cycle 1]: 2.114e-05, [1] [cse]: 1.325e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 2.68e-06 [rewriter_after_jit_bprop_graph]: 8.47e-06 [opt_after_jit_grad]: 0.0167739 [symbol_engine_optimizer]: 0.0001197, [1] [Cycle 1]: 0.00010511, [6] [build]: 8.42998e-06 [elim_shapecalc]: 1.586e-05 [elim_not_effective]: 2.692e-05 [opt_reshape]: 7.79997e-06 [fold_const_symbol]: 1.087e-05 [renormalize]: 1.01002e-06 [validate]: 5.996e-05 Sums bootstrap : 0.000353s : 0.98% type_inference : 0.014168s : 39.12% event_method : 0.000026s : 0.07% auto_monad : 0.000083s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000066s : 0.18% rewriter_before_opt_a : 0.000090s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000086s : 0.24% jit_opt_a.loop_unroll : 0.000039s : 0.11% jit_opt_a.a_1 : 0.000912s : 2.52% jit_opt_a.with_stream_mark : 0.000045s : 0.12% jit_opt_a.recompute_prepare : 0.000017s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001341s : 3.70% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.08% jit_opt_a.cse : 0.000055s : 0.15% jit_opt_a.replace_applicator : 0.000027s : 0.07% py_interpret_to_execute_after_opt_a : 0.000019s : 0.05% rewriter_after_opt_a : 0.000041s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000844s : 2.33% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000033s : 0.09% loop_unroll : 0.000522s : 1.44% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000062s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.016774s : 46.31% symbol_engine_optimizer.build : 0.000008s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000016s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000060s : 0.17% Time group info: ------[substitution.] 0.000370 27 1.03% : 0.000004s : 2: substitution.elim_not_effective 0.43% : 0.000002s : 2: substitution.fold_const_symbol 1.91% : 0.000007s : 3: substitution.graph_param_transform 84.63% : 0.000313s : 5: substitution.inline 1.13% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.95% : 0.000015s : 3: substitution.reduce_eliminate 1.52% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000007s : 2: substitution.replace_old_param 3.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014069 2 88.54% : 0.012456s : 1: type_inference.infer 11.46% : 0.001613s : 1: type_inference.specialize ------[replace.] 0.000119 7 69.06% : 0.000082s : 5: replace.inline 30.94% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 7 96.46% : 0.000310s : 5: match.inline 3.54% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 4.70% : 0.000007s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 11: predicate.addn_check_dump 1.12% : 0.000002s : 11: predicate.addn_zero_filter 2.25% : 0.000004s : 11: predicate.arithmetic_simplify 1.06% : 0.000002s : 11: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.43% : 0.000002s : 11: predicate.compare_switch_simplify 0.95% : 0.000001s : 11: predicate.depend_value_elim 0.86% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 2.81% : 0.000004s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 1.03% : 0.000002s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.87% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 11: predicate.environ_get_depend_swap 1.20% : 0.000002s : 11: predicate.environ_get_eliminate 0.93% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.35% : 0.000002s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000008s : 24: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.55% : 0.000002s : 16: predicate.load_eliminater 1.79% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.38% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 11: predicate.merge_addn 1.02% : 0.000002s : 11: predicate.minmaximum_grad 2.47% : 0.000004s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 1.82% : 0.000003s : 16: predicate.partial_eliminate 1.07% : 0.000002s : 11: predicate.print_const_string_wrapper 2.43% : 0.000004s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.42% : 0.000002s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 0.97% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.95% : 0.000002s : 3: predicate.row_tensor_eliminate 1.05% : 0.000002s : 11: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.59% : 0.000003s : 6: predicate.special_op_eliminate 0.73% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.31% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.96% : 0.000011s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 0.97% : 0.000002s : 11: predicate.transpose_eliminate 1.13% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.00% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.62% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.24% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.35% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 11: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 1.01% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001266 16 38.89% : 0.000493s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.82% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 53.29% : 0.000675s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060057 72 0.11% : 0.000066s : 1: add_recomputation 0.14% : 0.000087s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.63% : 0.000377s : 1: bootstrap 0.06% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.05% : 0.000031s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 12.34% : 0.007412s : 1: jit_opt_a 0.36% : 0.000216s : 1: jit_opt_after_cconv 0.11% : 0.000064s : 1: jit_opt_b 0.89% : 0.000533s : 1: loop_unroll 1.44% : 0.000863s : 1: mutable_eliminate 1.96% : 0.001177s : 26: opt.transform.jit_opt_a 0.10% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000022s : 1: opt.transform.mutable_eliminate 26.95% : 0.016188s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000055s : 4: opt.transform.symbol_engine_opt 27.98% : 0.016806s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000070s : 1: py_interpret_to_execute 0.04% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 1.30% : 0.000783s : 1: renormalize.infer 0.91% : 0.000545s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000093s : 1: rewriter_before_opt_a 0.21% : 0.000124s : 1: symbol_engine_optimizer 23.63% : 0.014192s : 1: type_inference TotalTime = 0.118929, [30] [bootstrap]: 0.00027727 [type_inference]: 0.0781409 [event_method]: 0.00036967 [auto_monad]: 0.00012111 [graph_reusing]: 7.82002e-06 [pre_auto_parallel]: 3.35998e-06 [py_interpret_to_execute]: 5.272e-05 [rewriter_before_opt_a]: 0.00014153 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0357889, [3] [Cycle 1]: 0.0257246, [27] [switch_simplify]: 0.0001054 [loop_unroll]: 5.39e-05 [a_1]: 0.0012336 [with_stream_mark]: 4.472e-05 [recompute_prepare]: 2.939e-05 [updatestate_depend_eliminate]: 1.135e-05 [updatestate_assign_eliminate]: 7.85998e-06 [updatestate_loads_eliminate]: 7.41001e-06 [parameter_eliminate]: 3.96001e-06 [specialize_transform]: 1.683e-05 [updatestate_useless_node_eliminater]: 1.481e-05 [accelerated_algorithm]: 1.545e-05 [meta_shard_fg_expand]: 7.31001e-06 [get_grad_eliminate_]: 1.533e-05 [merge_forward]: 1.117e-05 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.406e-05 [j_node_and_user_rematch]: 3.062e-05 [meta_fg_expand]: 0.00273411 [replace_old_param]: 0.00010768 [inline_without_move]: 7.855e-05 [renormalize]: 0.0198674 [add_forward_monad_depend]: 2.766e-05 [auto_monad_grad]: 1.111e-05 [auto_monad_eliminator]: 9.938e-05 [cse]: 0.00056873 [replace_applicator]: 0.00013642 [Cycle 2]: 0.00557654, [27] [switch_simplify]: 4.748e-05 [loop_unroll]: 4.505e-05 [a_1]: 0.00165266 [with_stream_mark]: 3.883e-05 [recompute_prepare]: 2.233e-05 [updatestate_depend_eliminate]: 7.16999e-06 [updatestate_assign_eliminate]: 4.18999e-06 [updatestate_loads_eliminate]: 5.15001e-06 [parameter_eliminate]: 3.61999e-06 [specialize_transform]: 1.071e-05 [updatestate_useless_node_eliminater]: 7.90998e-06 [accelerated_algorithm]: 7.82e-06 [meta_shard_fg_expand]: 5.72001e-06 [get_grad_eliminate_]: 8.30999e-06 [merge_forward]: 5.85002e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.451e-05 [j_node_and_user_rematch]: 1.369e-05 [meta_fg_expand]: 0.00020479 [replace_old_param]: 1.907e-05 [inline_without_move]: 7.79002e-06 [renormalize]: 0.00303833 [add_forward_monad_depend]: 1.323e-05 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 2.3e-05 [cse]: 3.615e-05 [replace_applicator]: 2.704e-05 [Cycle 3]: 0.00034769, [27] [switch_simplify]: 5.64998e-06 [loop_unroll]: 4.97e-06 [a_1]: 6.181e-05 [with_stream_mark]: 1.852e-05 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 4.79998e-06 [updatestate_useless_node_eliminater]: 3.7e-06 [accelerated_algorithm]: 4.50001e-06 [meta_shard_fg_expand]: 3.04999e-06 [get_grad_eliminate_]: 3.3e-06 [merge_forward]: 3.18998e-06 [cell_reuse_recompute_pass]: 3.3e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.875e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 3.87998e-06 [inline_without_move]: 3.20998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.62001e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 7.38e-06 [cse]: 1.655e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 2.117e-05 [rewriter_after_opt_a]: 4.904e-05 [convert_after_rewriter]: 8.07998e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00102021 [jit_opt_b]: 6.189e-05, [1] [Cycle 1]: 4.996e-05, [2] [frontend_op_eliminate]: 1.557e-05 [inline_after_opt_a]: 1.597e-05 [cconv]: 4.183e-05 [loop_unroll]: 0.00117787 [jit_opt_after_cconv]: 0.00021423, [1] [Cycle 1]: 0.0001998, [11] [c_1]: 2.215e-05 [parameter_eliminate]: 8.06001e-06 [updatestate_depend_eliminate]: 1.151e-05 [updatestate_assign_eliminate]: 5.04e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 4.173e-05 [call_graph_tuple_transform]: 2.789e-05 [tuple_list_get_item_eliminator]: 6.84999e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 9.89996e-07 [switch_simplify]: 4.93001e-06 [remove_dup_value]: 1.778e-05 [partial_unused_args_eliminate]: 3.35e-06 [environ_conv]: 9.22999e-06 [add_recomputation]: 5.17e-05 [cse_after_recomputation]: 3.53e-05, [1] [Cycle 1]: 2.704e-05, [1] [cse]: 1.646e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 3.47002e-06 [rewriter_after_jit_bprop_graph]: 1.43e-05 [opt_after_jit_grad]: 0.00083163 [symbol_engine_optimizer]: 9.875e-05, [1] [Cycle 1]: 8.905e-05, [6] [build]: 8.13001e-06 [elim_shapecalc]: 9.42001e-06 [elim_not_effective]: 1.92e-05 [opt_reshape]: 5.33002e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 7.59988e-07 [validate]: 4.594e-05 Sums bootstrap : 0.000277s : 0.24% type_inference : 0.078141s : 68.89% event_method : 0.000370s : 0.33% auto_monad : 0.000121s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000053s : 0.05% rewriter_before_opt_a : 0.000142s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000159s : 0.14% jit_opt_a.loop_unroll : 0.000104s : 0.09% jit_opt_a.a_1 : 0.002948s : 2.60% jit_opt_a.with_stream_mark : 0.000102s : 0.09% jit_opt_a.recompute_prepare : 0.000057s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000022s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000009s : 0.01% jit_opt_a.specialize_transform : 0.000032s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000016s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000020s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000077s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000052s : 0.05% jit_opt_a.meta_fg_expand : 0.002941s : 2.59% jit_opt_a.replace_old_param : 0.000131s : 0.12% jit_opt_a.inline_without_move : 0.000090s : 0.08% jit_opt_a.renormalize : 0.022906s : 20.19% jit_opt_a.add_forward_monad_depend : 0.000044s : 0.04% jit_opt_a.auto_monad_grad : 0.000016s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000130s : 0.11% jit_opt_a.cse : 0.000621s : 0.55% jit_opt_a.replace_applicator : 0.000170s : 0.15% py_interpret_to_execute_after_opt_a : 0.000021s : 0.02% rewriter_after_opt_a : 0.000049s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001020s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000042s : 0.04% loop_unroll : 0.001178s : 1.04% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000014s : 0.01% opt_after_jit_grad : 0.000832s : 0.73% symbol_engine_optimizer.build : 0.000008s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000959 104 0.22% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.61% : 0.000006s : 1: substitution.graph_param_transform 69.79% : 0.000669s : 13: substitution.inline 2.97% : 0.000028s : 2: substitution.inline_without_move 1.34% : 0.000013s : 12: substitution.j_node_and_user_rematch 1.68% : 0.000016s : 7: substitution.minmaximum_grad 1.18% : 0.000011s : 5: substitution.partial_eliminate 1.25% : 0.000012s : 12: substitution.remove_not_recompute_node 5.95% : 0.000057s : 10: substitution.replace_applicator 0.91% : 0.000009s : 10: substitution.replace_old_param 0.36% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.03% : 0.000010s : 1: substitution.tile_eliminate 3.47% : 0.000033s : 7: substitution.tuple_list_convert_item_index_to_positive 2.25% : 0.000022s : 7: substitution.tuple_list_get_item_depend_reorder 6.85% : 0.000066s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.078009 2 96.00% : 0.074889s : 1: type_inference.infer 4.00% : 0.003120s : 1: type_inference.specialize ------[replace.] 0.000315 20 65.99% : 0.000208s : 13: replace.inline 34.01% : 0.000107s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000691 20 94.70% : 0.000655s : 13: match.inline 5.30% : 0.000037s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000444 2656 1.71% : 0.000008s : 46: predicate.accumulaten_eliminater 0.65% : 0.000003s : 1: predicate.ad_related_special_op_eliminate 1.24% : 0.000006s : 46: predicate.addn_check_dump 1.59% : 0.000007s : 46: predicate.addn_zero_filter 2.26% : 0.000010s : 46: predicate.arithmetic_simplify 1.35% : 0.000006s : 46: predicate.cast_eliminate 0.17% : 0.000001s : 1: predicate.check_bprop_eliminate 1.25% : 0.000006s : 46: predicate.compare_switch_simplify 1.50% : 0.000007s : 46: predicate.depend_value_elim 1.60% : 0.000007s : 46: predicate.dict_get_item_const_eliminator 1.43% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.36% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.37% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.24% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.27% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.26% : 0.000006s : 46: predicate.environ_get_depend_swap 1.30% : 0.000006s : 46: predicate.environ_get_eliminate 1.23% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.90% : 0.000004s : 18: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 5.55% : 0.000025s : 68: predicate.inline 2.14% : 0.000010s : 46: predicate.inline_without_move 0.35% : 0.000002s : 18: predicate.j_node_and_user_rematch 1.12% : 0.000005s : 18: predicate.less_batch_normalization 1.81% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.76% : 0.000008s : 54: predicate.load_eliminater 0.66% : 0.000003s : 1: predicate.loop_unroll_after_grad 3.26% : 0.000014s : 99: predicate.loop_unroll_before_grad 1.91% : 0.000008s : 47: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 46: predicate.merge_addn 1.28% : 0.000006s : 46: predicate.minmaximum_grad 0.65% : 0.000003s : 1: predicate.mutable_eliminate 0.16% : 0.000001s : 1: predicate.opt_reshape 2.33% : 0.000010s : 54: predicate.partial_eliminate 1.46% : 0.000006s : 46: predicate.print_const_string_wrapper 1.93% : 0.000009s : 46: predicate.reduce_eliminate 1.74% : 0.000008s : 53: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000003s : 18: predicate.remove_not_recompute_node 2.66% : 0.000012s : 99: predicate.replace_applicator 1.07% : 0.000005s : 46: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.42% : 0.000006s : 46: predicate.reshape_eliminate 1.42% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 1: predicate.row_tensor_eliminate 1.59% : 0.000007s : 46: predicate.same_eliminate 0.70% : 0.000003s : 18: predicate.set_cell_output_no_recompute 0.28% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 18: predicate.specialize_transform 1.58% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.43% : 0.000015s : 66: predicate.switch_defer_inline 2.26% : 0.000010s : 66: predicate.switch_layer_defer_inline 6.40% : 0.000028s : 166: predicate.switch_simplify 1.44% : 0.000006s : 46: predicate.tile_eliminate 1.47% : 0.000007s : 46: predicate.transpose_eliminate 1.85% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000017s : 55: predicate.tuple_list_get_item_eliminator 1.86% : 0.000008s : 46: predicate.tuple_list_set_item_eliminator 1.64% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.85% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.59% : 0.000012s : 72: predicate.updatestate_useless_node_eliminater 1.79% : 0.000008s : 46: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005638 52 73.52% : 0.004145s : 35: func_graph_cloner_run.FuncGraphClonerGraph 26.48% : 0.001493s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.145702 87 0.04% : 0.000058s : 1: add_recomputation 0.09% : 0.000128s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.21% : 0.000304s : 1: bootstrap 0.03% : 0.000045s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000038s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.26% : 0.000378s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 24.57% : 0.035794s : 1: jit_opt_a 0.15% : 0.000219s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.83% : 0.001203s : 1: loop_unroll 0.72% : 0.001044s : 1: mutable_eliminate 2.63% : 0.003827s : 39: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000022s : 4: opt.transform.jit_opt_b 0.02% : 0.000031s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000028s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000854s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000056s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 12.71% : 0.018514s : 2: renormalize.infer 2.99% : 0.004351s : 2: renormalize.specialize 0.01% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000056s : 1: rewriter_after_opt_a 0.10% : 0.000145s : 1: rewriter_before_opt_a 0.07% : 0.000102s : 1: symbol_engine_optimizer 53.65% : 0.078164s : 1: type_inference TotalTime = 0.0330728, [30] [bootstrap]: 0.00028001 [type_inference]: 0.00461529 [event_method]: 1.832e-05 [auto_monad]: 6.421e-05 [graph_reusing]: 5.97999e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 3.429e-05 [rewriter_before_opt_a]: 7.202e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0257052, [2] [Cycle 1]: 0.022099, [27] [switch_simplify]: 5.33e-05 [loop_unroll]: 2.917e-05 [a_1]: 0.0005061 [with_stream_mark]: 1.935e-05 [recompute_prepare]: 7.25998e-06 [updatestate_depend_eliminate]: 3.89997e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.0211171 [add_forward_monad_depend]: 8.90001e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.818e-05 [cse]: 3.952e-05 [replace_applicator]: 2.383e-05 [Cycle 2]: 0.0003595, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.30001e-06 [a_1]: 0.00010379 [with_stream_mark]: 1.578e-05 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 4.19997e-06 [cell_reuse_recompute_pass]: 3.37002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.782e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.24e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.52001e-06 [cse]: 1.269e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.408e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 4.82998e-06 [mutable_eliminate]: 0.00075525 [jit_opt_b]: 5.028e-05, [1] [Cycle 1]: 4.246e-05, [2] [frontend_op_eliminate]: 1.609e-05 [inline_after_opt_a]: 1.533e-05 [cconv]: 2.692e-05 [loop_unroll]: 0.00039577 [jit_opt_after_cconv]: 0.00014555, [1] [Cycle 1]: 0.00013955, [11] [c_1]: 2.024e-05 [parameter_eliminate]: 2.28002e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 1.955e-05 [call_graph_tuple_transform]: 2.493e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 6.49976e-07 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 1.708e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.72001e-06 [add_recomputation]: 5.282e-05 [cse_after_recomputation]: 2.332e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.211e-05 [auto_monad_reorder]: 1.747e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.07e-06 [opt_after_jit_grad]: 0.00043117 [symbol_engine_optimizer]: 7.121e-05, [1] [Cycle 1]: 6.493e-05, [6] [build]: 3.35998e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.26e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.52998e-06 [renormalize]: 3.29979e-07 [validate]: 3.776e-05 Sums bootstrap : 0.000280s : 0.96% type_inference : 0.004615s : 15.79% event_method : 0.000018s : 0.06% auto_monad : 0.000064s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000034s : 0.12% rewriter_before_opt_a : 0.000072s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.20% jit_opt_a.loop_unroll : 0.000034s : 0.12% jit_opt_a.a_1 : 0.000610s : 2.09% jit_opt_a.with_stream_mark : 0.000035s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.021117s : 72.23% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000029s : 0.10% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000755s : 2.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000027s : 0.09% loop_unroll : 0.000396s : 1.35% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000431s : 1.47% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.13% Time group info: ------[substitution.] 0.000196 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 81.95% : 0.000160s : 4: substitution.inline 1.75% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000005s : 4: substitution.remove_not_recompute_node 3.17% : 0.000006s : 2: substitution.replace_old_param 6.11% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004557 2 82.34% : 0.003752s : 1: type_inference.infer 17.66% : 0.000805s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.83% : 0.000044s : 4: replace.inline 32.17% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.55% : 0.000158s : 4: match.inline 6.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.63% : 0.000002s : 10: predicate.accumulaten_eliminater 0.88% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.56% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.29% : 0.000002s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.76% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.56% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 2.16% : 0.000003s : 10: predicate.reduce_eliminate 1.72% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 2.05% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000675 13 49.24% : 0.000332s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.22% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.53% : 0.000307s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055079 72 0.10% : 0.000056s : 1: add_recomputation 0.12% : 0.000067s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.54% : 0.000296s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 46.68% : 0.025709s : 1: jit_opt_a 0.27% : 0.000148s : 1: jit_opt_after_cconv 0.10% : 0.000053s : 1: jit_opt_b 0.73% : 0.000404s : 1: loop_unroll 1.39% : 0.000764s : 1: mutable_eliminate 1.52% : 0.000836s : 26: opt.transform.jit_opt_a 0.10% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000439s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000037s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 37.52% : 0.020663s : 1: renormalize.infer 0.80% : 0.000442s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000041s : 1: rewriter_after_opt_a 0.14% : 0.000075s : 1: rewriter_before_opt_a 0.13% : 0.000074s : 1: symbol_engine_optimizer 8.41% : 0.004631s : 1: type_inference TotalTime = 0.0986409, [30] [bootstrap]: 0.00035442 [type_inference]: 0.0886223 [event_method]: 2.457e-05 [auto_monad]: 7.563e-05 [graph_reusing]: 5.58002e-06 [pre_auto_parallel]: 2.33002e-06 [py_interpret_to_execute]: 0.00012875 [rewriter_before_opt_a]: 8.574e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.0069367, [2] [Cycle 1]: 0.00275787, [27] [switch_simplify]: 6.961e-05 [loop_unroll]: 3.088e-05 [a_1]: 0.00060395 [with_stream_mark]: 2.473e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 9.31002e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 0.00164628 [add_forward_monad_depend]: 7.83999e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.961e-05 [cse]: 4.024e-05 [replace_applicator]: 1.901e-05 [Cycle 2]: 0.00034834, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.56e-06 [a_1]: 9.77e-05 [with_stream_mark]: 1.306e-05 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 8.89003e-06 [meta_fg_expand]: 2.08998e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.381e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.787e-05 [rewriter_after_opt_a]: 4.169e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00072871 [jit_opt_b]: 5.196e-05, [1] [Cycle 1]: 4.458e-05, [2] [frontend_op_eliminate]: 1.697e-05 [inline_after_opt_a]: 1.625e-05 [cconv]: 3.049e-05 [loop_unroll]: 0.00043233 [jit_opt_after_cconv]: 0.00015072, [1] [Cycle 1]: 0.00014383, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 2.79999e-06 [updatestate_depend_eliminate]: 6.48998e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.608e-05 [call_graph_tuple_transform]: 1.919e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 2.11998e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.58e-06 [add_recomputation]: 5.298e-05 [cse_after_recomputation]: 2.449e-05, [1] [Cycle 1]: 1.887e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 2.28002e-06 [rewriter_after_jit_bprop_graph]: 5.95002e-06 [opt_after_jit_grad]: 0.00046441 [symbol_engine_optimizer]: 7.761e-05, [1] [Cycle 1]: 7.065e-05, [6] [build]: 4.51002e-06 [elim_shapecalc]: 9.07001e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 5.96003e-06 [fold_const_symbol]: 9.15999e-06 [renormalize]: 4.40021e-07 [validate]: 4.238e-05 Sums bootstrap : 0.000354s : 0.38% type_inference : 0.088622s : 94.12% event_method : 0.000025s : 0.03% auto_monad : 0.000076s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000129s : 0.14% rewriter_before_opt_a : 0.000086s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000702s : 0.75% jit_opt_a.with_stream_mark : 0.000038s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001646s : 1.75% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.03% jit_opt_a.cse : 0.000054s : 0.06% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000729s : 0.77% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000432s : 0.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000464s : 0.49% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.05% [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.657.644 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c8b0> should be wrapped by jit only once. Time group info: ------[substitution.] 0.000257 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.20% : 0.000006s : 3: substitution.graph_param_transform 86.81% : 0.000223s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.45% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.088522 2 97.84% : 0.086607s : 1: type_inference.infer 2.16% : 0.001914s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.23% : 0.000055s : 4: replace.inline 30.77% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 95.59% : 0.000220s : 4: match.inline 4.41% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.44% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.63% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.89% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.45% : 0.000002s : 10: predicate.print_const_string_wrapper 2.12% : 0.000003s : 10: predicate.reduce_eliminate 1.68% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001130 13 43.40% : 0.000490s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.05% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.55% : 0.000582s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.101280 72 0.06% : 0.000056s : 1: add_recomputation 0.08% : 0.000079s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.37% : 0.000380s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000044s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.85% : 0.006940s : 1: jit_opt_a 0.15% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.43% : 0.000440s : 1: loop_unroll 0.73% : 0.000739s : 1: mutable_eliminate 0.93% : 0.000943s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000133s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.63% : 0.000637s : 1: renormalize.infer 0.99% : 0.000999s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000080s : 1: symbol_engine_optimizer 87.53% : 0.088649s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:34.658.268 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.235231, [30] [bootstrap]: 0.00038163 [type_inference]: 0.190716 [event_method]: 3.764e-05 [auto_monad]: 0.00011127 [graph_reusing]: 6.70998e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00088904 [rewriter_before_opt_a]: 0.0001297 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00866572, [2] [Cycle 1]: 0.00444553, [27] [switch_simplify]: 6.112e-05 [loop_unroll]: 3.508e-05 [a_1]: 0.00071521 [with_stream_mark]: 1.923e-05 [recompute_prepare]: 8.92999e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 1.692e-05 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.70998e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 1.095e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.43e-06 [renormalize]: 0.00323868 [add_forward_monad_depend]: 7e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.794e-05 [cse]: 3.447e-05 [replace_applicator]: 1.474e-05 [Cycle 2]: 0.00037587, [27] [switch_simplify]: 6.72002e-06 [loop_unroll]: 6.03002e-06 [a_1]: 0.00012371 [with_stream_mark]: 1.085e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 2.49999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.597e-05 [replace_applicator]: 6.43003e-06 [py_interpret_to_execute_after_opt_a]: 1.419e-05 [rewriter_after_opt_a]: 3.761e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00061268 [jit_opt_b]: 5.748e-05, [1] [Cycle 1]: 5.082e-05, [2] [frontend_op_eliminate]: 2.04e-05 [inline_after_opt_a]: 1.874e-05 [cconv]: 2.666e-05 [loop_unroll]: 0.0004124 [jit_opt_after_cconv]: 0.00015612, [1] [Cycle 1]: 0.00015032, [11] [c_1]: 2.528e-05 [parameter_eliminate]: 3.01001e-06 [updatestate_depend_eliminate]: 6.63998e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.409e-05 [call_graph_tuple_transform]: 2.12e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.88e-06 [remove_dup_value]: 1.718e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 8.1e-06 [add_recomputation]: 4.931e-05 [cse_after_recomputation]: 2.504e-05, [1] [Cycle 1]: 1.975e-05, [1] [cse]: 1.376e-05 [auto_monad_reorder]: 1.769e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.0323066 [symbol_engine_optimizer]: 0.00010394, [1] [Cycle 1]: 9.455e-05, [6] [build]: 6.34999e-06 [elim_shapecalc]: 1.07e-05 [elim_not_effective]: 1.865e-05 [opt_reshape]: 1.085e-05 [fold_const_symbol]: 1.298e-05 [renormalize]: 1.14e-06 [validate]: 0.00019675 Sums bootstrap : 0.000382s : 0.17% type_inference : 0.190716s : 82.66% event_method : 0.000038s : 0.02% auto_monad : 0.000111s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000889s : 0.39% rewriter_before_opt_a : 0.000130s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000839s : 0.36% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000023s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003239s : 1.40% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000613s : 0.27% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000412s : 0.18% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.032307s : 14.00% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000197s : 0.09% Time group info: ------[substitution.] 0.000268 25 0.72% : 0.000002s : 2: substitution.elim_not_effective 1.41% : 0.000004s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 4: substitution.graph_param_transform 85.84% : 0.000230s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.62% : 0.000004s : 2: substitution.replace_old_param 4.93% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151518 2 96.50% : 0.146216s : 1: type_inference.infer 3.50% : 0.005302s : 1: type_inference.specialize ------[replace.] 0.000119 7 67.86% : 0.000080s : 5: replace.inline 32.14% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 7 95.02% : 0.000227s : 5: match.inline 4.98% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 888 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 2.73% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.87% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.42% : 0.000001s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.01% : 0.000007s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 19: predicate.load_eliminater 1.02% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 2.62% : 0.000004s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 8: predicate.special_op_eliminate 1.09% : 0.000002s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.76% : 0.000010s : 65: predicate.switch_simplify 1.70% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.58% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.47% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003417 29 67.22% : 0.002297s : 20: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.84% : 0.001054s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.239508 72 0.02% : 0.000052s : 1: add_recomputation 0.05% : 0.000115s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.16% : 0.000394s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.02% : 0.000043s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.62% : 0.008669s : 1: jit_opt_a 0.07% : 0.000159s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.17% : 0.000419s : 1: loop_unroll 0.26% : 0.000620s : 1: mutable_eliminate 0.46% : 0.001096s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000053s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000049s : 4: opt.transform.symbol_engine_opt 13.50% : 0.032338s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000894s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.95% : 0.002264s : 1: renormalize.infer 0.40% : 0.000965s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000136s : 1: rewriter_before_opt_a 0.04% : 0.000107s : 1: symbol_engine_optimizer 79.64% : 0.190740s : 1: type_inference TotalTime = 0.0344685, [30] [bootstrap]: 0.00025662 [type_inference]: 0.0170987 [event_method]: 6.397e-05 [auto_monad]: 9.986e-05 [graph_reusing]: 7.69002e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 2.768e-05 [rewriter_before_opt_a]: 0.0001044 [expand_dump_flag]: 3.22997e-06 [jit_opt_a]: 0.0144124, [3] [Cycle 1]: 0.00810338, [27] [switch_simplify]: 8.019e-05 [loop_unroll]: 4.271e-05 [a_1]: 0.00101694 [with_stream_mark]: 3.901e-05 [recompute_prepare]: 2.576e-05 [updatestate_depend_eliminate]: 9.18002e-06 [updatestate_assign_eliminate]: 7.06001e-06 [updatestate_loads_eliminate]: 6.89999e-06 [parameter_eliminate]: 3.46001e-06 [specialize_transform]: 1.494e-05 [updatestate_useless_node_eliminater]: 1.27e-05 [accelerated_algorithm]: 1.344e-05 [meta_shard_fg_expand]: 3.78999e-06 [get_grad_eliminate_]: 1.245e-05 [merge_forward]: 9.79e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.963e-05 [j_node_and_user_rematch]: 2.488e-05 [meta_fg_expand]: 0.00213352 [replace_old_param]: 7.558e-05 [inline_without_move]: 6.203e-05 [renormalize]: 0.00378416 [add_forward_monad_depend]: 1.484e-05 [auto_monad_grad]: 6.97002e-06 [auto_monad_eliminator]: 6.18e-05 [cse]: 0.00022066 [replace_applicator]: 8.545e-05 [Cycle 2]: 0.0025432, [27] [switch_simplify]: 4.023e-05 [loop_unroll]: 4.174e-05 [a_1]: 0.00111154 [with_stream_mark]: 1.799e-05 [recompute_prepare]: 7.06001e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 2.43002e-06 [specialize_transform]: 5.50001e-06 [updatestate_useless_node_eliminater]: 4.60999e-06 [accelerated_algorithm]: 4.88001e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 4.67998e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.35e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 0.00011523 [replace_old_param]: 6.59001e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 0.00089794 [add_forward_monad_depend]: 5.94999e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.356e-05 [cse]: 2.505e-05 [replace_applicator]: 1.473e-05 [Cycle 3]: 0.00030725, [27] [switch_simplify]: 5.00001e-06 [loop_unroll]: 5.35001e-06 [a_1]: 7.096e-05 [with_stream_mark]: 9.97999e-06 [recompute_prepare]: 4.45999e-06 [updatestate_depend_eliminate]: 3.45003e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 4.73001e-06 [updatestate_useless_node_eliminater]: 4.23999e-06 [accelerated_algorithm]: 4.38999e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 4.23001e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 7.92998e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 4.15e-06 [inline_without_move]: 4.52e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.76998e-06 [cse]: 1.262e-05 [replace_applicator]: 4.60999e-06 [py_interpret_to_execute_after_opt_a]: 1.443e-05 [rewriter_after_opt_a]: 4.194e-05 [convert_after_rewriter]: 7.87e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00074301 [jit_opt_b]: 5.179e-05, [1] [Cycle 1]: 4.378e-05, [2] [frontend_op_eliminate]: 1.5e-05 [inline_after_opt_a]: 1.54e-05 [cconv]: 2.838e-05 [loop_unroll]: 0.00044475 [jit_opt_after_cconv]: 0.00014929, [1] [Cycle 1]: 0.00014227, [11] [c_1]: 1.731e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 6.78e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 3.48e-06 [cse]: 2.594e-05 [call_graph_tuple_transform]: 1.777e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.29e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.13002e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 7.22997e-06 [add_recomputation]: 4.626e-05 [cse_after_recomputation]: 2.299e-05, [1] [Cycle 1]: 1.775e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 2.582e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00046477 [symbol_engine_optimizer]: 7.643e-05, [1] [Cycle 1]: 7.012e-05, [6] [build]: 3.66001e-06 [elim_shapecalc]: 7.36001e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 6.10002e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 4.09986e-07 [validate]: 3.941e-05 Sums bootstrap : 0.000257s : 0.85% type_inference : 0.017099s : 56.83% event_method : 0.000064s : 0.21% auto_monad : 0.000100s : 0.33% graph_reusing : 0.000008s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000028s : 0.09% rewriter_before_opt_a : 0.000104s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000125s : 0.42% jit_opt_a.loop_unroll : 0.000090s : 0.30% jit_opt_a.a_1 : 0.002199s : 7.31% jit_opt_a.with_stream_mark : 0.000067s : 0.22% jit_opt_a.recompute_prepare : 0.000037s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000025s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.07% jit_opt_a.accelerated_algorithm : 0.000023s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000021s : 0.07% jit_opt_a.merge_forward : 0.000017s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.14% jit_opt_a.meta_fg_expand : 0.002250s : 7.48% jit_opt_a.replace_old_param : 0.000086s : 0.29% jit_opt_a.inline_without_move : 0.000072s : 0.24% jit_opt_a.renormalize : 0.004682s : 15.56% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.27% jit_opt_a.cse : 0.000258s : 0.86% jit_opt_a.replace_applicator : 0.000105s : 0.35% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000743s : 2.47% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000028s : 0.09% loop_unroll : 0.000445s : 1.48% jit_opt_after_cconv.c_1 : 0.000017s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000046s : 0.15% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000026s : 0.09% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000465s : 1.54% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.13% Time group info: ------[substitution.] 0.000625 104 0.30% : 0.000002s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 0.86% : 0.000005s : 2: substitution.graph_param_transform 67.32% : 0.000421s : 13: substitution.inline 3.78% : 0.000024s : 2: substitution.inline_without_move 1.74% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.96% : 0.000012s : 7: substitution.minmaximum_grad 1.20% : 0.000008s : 5: substitution.partial_eliminate 1.82% : 0.000011s : 12: substitution.remove_not_recompute_node 5.22% : 0.000033s : 10: substitution.replace_applicator 1.15% : 0.000007s : 8: substitution.replace_old_param 0.69% : 0.000004s : 1: substitution.set_cell_output_no_recompute 3.80% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.84% : 0.000018s : 7: substitution.tuple_list_get_item_depend_reorder 7.10% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017016 2 92.38% : 0.015720s : 1: type_inference.infer 7.62% : 0.001296s : 1: type_inference.specialize ------[replace.] 0.000197 20 66.52% : 0.000131s : 13: replace.inline 33.48% : 0.000066s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000435 20 95.03% : 0.000413s : 13: match.inline 4.97% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000371 2397 1.45% : 0.000005s : 41: predicate.accumulaten_eliminater 0.38% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.41% : 0.000005s : 41: predicate.addn_check_dump 1.83% : 0.000007s : 41: predicate.addn_zero_filter 2.26% : 0.000008s : 41: predicate.arithmetic_simplify 1.57% : 0.000006s : 41: predicate.cast_eliminate 0.18% : 0.000001s : 2: predicate.check_bprop_eliminate 1.40% : 0.000005s : 41: predicate.compare_switch_simplify 1.45% : 0.000005s : 41: predicate.depend_value_elim 1.69% : 0.000006s : 41: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 41: predicate.dict_get_item_eliminator 1.57% : 0.000006s : 41: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.14% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 41: predicate.environ_add_const_eliminate 1.44% : 0.000005s : 41: predicate.environ_get_add_eliminate 1.46% : 0.000005s : 41: predicate.environ_get_depend_swap 1.59% : 0.000006s : 41: predicate.environ_get_eliminate 1.44% : 0.000005s : 41: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.70% : 0.000003s : 15: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.66% : 0.000017s : 65: predicate.inline 1.79% : 0.000007s : 39: predicate.inline_without_move 0.28% : 0.000001s : 15: predicate.j_node_and_user_rematch 0.85% : 0.000003s : 15: predicate.less_batch_normalization 1.94% : 0.000007s : 48: predicate.list_to_tuple_eliminator_ 1.92% : 0.000007s : 50: predicate.load_eliminater 0.37% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.79% : 0.000014s : 86: predicate.loop_unroll_before_grad 1.66% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.51% : 0.000006s : 41: predicate.merge_addn 1.61% : 0.000006s : 41: predicate.minmaximum_grad 0.57% : 0.000002s : 2: predicate.mutable_eliminate 0.17% : 0.000001s : 2: predicate.opt_reshape 2.35% : 0.000009s : 50: predicate.partial_eliminate 1.51% : 0.000006s : 41: predicate.print_const_string_wrapper 2.12% : 0.000008s : 41: predicate.reduce_eliminate 1.84% : 0.000007s : 48: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 15: predicate.remove_not_recompute_node 2.52% : 0.000009s : 89: predicate.replace_applicator 0.99% : 0.000004s : 39: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.53% : 0.000006s : 41: predicate.reshape_eliminate 1.51% : 0.000006s : 41: predicate.row_tensor_add_zeros_like 0.22% : 0.000001s : 2: predicate.row_tensor_eliminate 1.51% : 0.000006s : 41: predicate.same_eliminate 0.43% : 0.000002s : 15: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 4: predicate.special_op_eliminate 0.78% : 0.000003s : 15: predicate.specialize_transform 1.70% : 0.000006s : 41: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 41: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.98% : 0.000011s : 61: predicate.switch_defer_inline 2.51% : 0.000009s : 61: predicate.switch_layer_defer_inline 6.47% : 0.000024s : 149: predicate.switch_simplify 1.47% : 0.000005s : 41: predicate.tile_eliminate 1.49% : 0.000006s : 41: predicate.transpose_eliminate 1.96% : 0.000007s : 41: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000006s : 41: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000012s : 52: predicate.tuple_list_get_item_eliminator 1.83% : 0.000007s : 41: predicate.tuple_list_set_item_eliminator 1.79% : 0.000007s : 48: predicate.tuple_to_list_eliminator_ 1.79% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.59% : 0.000010s : 65: predicate.updatestate_useless_node_eliminater 1.78% : 0.000007s : 41: predicate.value_based_eliminate 0.09% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.27% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002166 32 63.66% : 0.001379s : 15: func_graph_cloner_run.FuncGraphClonerGraph 36.34% : 0.000787s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042032 87 0.12% : 0.000049s : 1: add_recomputation 0.25% : 0.000104s : 1: auto_monad 0.07% : 0.000029s : 1: auto_monad_reorder 0.67% : 0.000280s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.17% : 0.000069s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 34.30% : 0.014417s : 1: jit_opt_a 0.36% : 0.000152s : 1: jit_opt_after_cconv 0.13% : 0.000055s : 1: jit_opt_b 1.08% : 0.000453s : 1: loop_unroll 1.79% : 0.000752s : 1: mutable_eliminate 6.78% : 0.002852s : 39: opt.transform.jit_opt_a 0.10% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000023s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.05% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000473s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000030s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 6.41% : 0.002696s : 2: renormalize.infer 4.68% : 0.001968s : 2: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000045s : 1: rewriter_after_opt_a 0.25% : 0.000107s : 1: rewriter_before_opt_a 0.19% : 0.000079s : 1: symbol_engine_optimizer 40.73% : 0.017119s : 1: type_inference TotalTime = 0.13849, [30] [bootstrap]: 0.00030827 [type_inference]: 0.0272844 [event_method]: 2.022e-05 [auto_monad]: 6.831e-05 [graph_reusing]: 6.08998e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00010475 [rewriter_before_opt_a]: 8.164e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.108184, [2] [Cycle 1]: 0.00211249, [27] [switch_simplify]: 6.014e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00057283 [with_stream_mark]: 2.321e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 2.43998e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.26998e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.661e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00106544 [add_forward_monad_depend]: 6.13002e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.654e-05 [cse]: 3.549e-05 [replace_applicator]: 1.298e-05 [Cycle 2]: 0.0003159, [27] [switch_simplify]: 5.48002e-06 [loop_unroll]: 5.01002e-06 [a_1]: 8.949e-05 [with_stream_mark]: 1.122e-05 [recompute_prepare]: 4.87998e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.74002e-06 [accelerated_algorithm]: 4.85001e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.247e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 6.61e-06 [inline_without_move]: 4.86997e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.256e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.316e-05 [rewriter_after_opt_a]: 9.206e-05 [convert_after_rewriter]: 7.44002e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.00062058 [jit_opt_b]: 5.393e-05, [1] [Cycle 1]: 4.611e-05, [2] [frontend_op_eliminate]: 1.701e-05 [inline_after_opt_a]: 1.744e-05 [cconv]: 3.041e-05 [loop_unroll]: 0.00048128 [jit_opt_after_cconv]: 0.00015948, [1] [Cycle 1]: 0.00015218, [11] [c_1]: 2.22e-05 [parameter_eliminate]: 3.61001e-06 [updatestate_depend_eliminate]: 7.15e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 2.984e-05 [call_graph_tuple_transform]: 2.142e-05 [tuple_list_get_item_eliminator]: 5.80002e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.49998e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.22001e-06 [add_recomputation]: 5.599e-05 [cse_after_recomputation]: 2.239e-05, [1] [Cycle 1]: 1.658e-05, [1] [cse]: 1.106e-05 [auto_monad_reorder]: 1.706e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.57999e-06 [opt_after_jit_grad]: 0.00046683 [symbol_engine_optimizer]: 0.0001342, [1] [Cycle 1]: 0.00012778, [6] [build]: 3.97002e-06 [elim_shapecalc]: 8.13001e-06 [elim_not_effective]: 7.098e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 1.042e-05 [renormalize]: 3.69997e-07 [validate]: 4.303e-05 Sums bootstrap : 0.000308s : 0.96% type_inference : 0.027284s : 84.94% event_method : 0.000020s : 0.06% auto_monad : 0.000068s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000105s : 0.33% rewriter_before_opt_a : 0.000082s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.20% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000662s : 2.06% jit_opt_a.with_stream_mark : 0.000034s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001066s : 3.32% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000048s : 0.15% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000092s : 0.29% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000621s : 1.93% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000030s : 0.09% loop_unroll : 0.000481s : 1.50% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000056s : 0.17% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000467s : 1.45% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000071s : 0.22% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.13% Time group info: ------[substitution.] 0.000299 23 19.90% : 0.000060s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.03% : 0.000006s : 3: substitution.graph_param_transform 68.98% : 0.000206s : 4: substitution.inline 1.02% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 4.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027202 2 93.92% : 0.025549s : 1: type_inference.infer 6.08% : 0.001653s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.02% : 0.000051s : 4: replace.inline 30.98% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.29% : 0.000204s : 4: match.inline 5.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 2.19% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.69% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000001s : 10: predicate.minmaximum_grad 2.34% : 0.000003s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.09% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.96% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.73% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.63% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000855 13 44.43% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.55% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.02% : 0.000428s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140551 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000072s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000328s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 76.97% : 0.108188s : 1: jit_opt_a 0.12% : 0.000163s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.35% : 0.000491s : 1: loop_unroll 0.45% : 0.000631s : 1: mutable_eliminate 0.63% : 0.000880s : 26: opt.transform.jit_opt_a 0.04% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000093s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000109s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.45% : 0.000632s : 1: renormalize.infer 0.30% : 0.000425s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000096s : 1: rewriter_after_opt_a 0.06% : 0.000086s : 1: rewriter_before_opt_a 0.10% : 0.000137s : 1: symbol_engine_optimizer 19.43% : 0.027304s : 1: type_inference TotalTime = 0.306314, [30] [bootstrap]: 0.00032765 [type_inference]: 0.2637 [event_method]: 2.017e-05 [auto_monad]: 6.809e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.000425 [rewriter_before_opt_a]: 8.169e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0393051, [2] [Cycle 1]: 0.00381282, [27] [switch_simplify]: 6.878e-05 [loop_unroll]: 2.969e-05 [a_1]: 0.00062393 [with_stream_mark]: 2.42e-05 [recompute_prepare]: 8.90999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.39999e-06 [accelerated_algorithm]: 6.28002e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.63001e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 1.097e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.032e-05 [inline_without_move]: 5.98998e-06 [renormalize]: 0.00267249 [add_forward_monad_depend]: 7.25998e-06 [auto_monad_grad]: 2.97002e-06 [auto_monad_eliminator]: 1.913e-05 [cse]: 3.559e-05 [replace_applicator]: 1.887e-05 [Cycle 2]: 0.00037093, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 5.87001e-06 [a_1]: 0.00012195 [with_stream_mark]: 1.204e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 3.00998e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.729e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 8.49002e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.225e-05 [replace_applicator]: 6.11998e-06 [py_interpret_to_execute_after_opt_a]: 1.306e-05 [rewriter_after_opt_a]: 3.842e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00069733 [jit_opt_b]: 5.668e-05, [1] [Cycle 1]: 4.802e-05, [2] [frontend_op_eliminate]: 1.92e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 2.985e-05 [loop_unroll]: 0.00042471 [jit_opt_after_cconv]: 0.00015467, [1] [Cycle 1]: 0.00014823, [11] [c_1]: 2.506e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 7.22002e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.06998e-06 [cse]: 2.336e-05 [call_graph_tuple_transform]: 2.109e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.33002e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 9.46e-06 [add_recomputation]: 5.292e-05 [cse_after_recomputation]: 2.166e-05, [1] [Cycle 1]: 1.674e-05, [1] [cse]: 1.125e-05 [auto_monad_reorder]: 1.533e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.0004573 [symbol_engine_optimizer]: 7.701e-05, [1] [Cycle 1]: 6.949e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 7.93001e-06 [elim_not_effective]: 1.506e-05 [opt_reshape]: 6.67002e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 2.89991e-07 [validate]: 0.00010283 Sums bootstrap : 0.000328s : 0.12% type_inference : 0.263700s : 97.46% event_method : 0.000020s : 0.01% auto_monad : 0.000068s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000425s : 0.16% rewriter_before_opt_a : 0.000082s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000746s : 0.28% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002673s : 0.99% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000048s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000038s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000697s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000425s : 0.16% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000457s : 0.17% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000103s : 0.04% Time group info: ------[substitution.] 0.000258 24 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 4: substitution.graph_param_transform 85.44% : 0.000220s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000006s : 2: substitution.replace_old_param 5.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.263628 2 99.05% : 0.261115s : 1: type_inference.infer 0.95% : 0.002513s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.78% : 0.000052s : 4: replace.inline 31.22% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.78% : 0.000218s : 4: match.inline 5.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.80% : 0.000002s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.30% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.83% : 0.000008s : 26: predicate.inline 1.14% : 0.000002s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 8: predicate.less_batch_normalization 1.33% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.28% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.80% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.92% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 1.22% : 0.000002s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.68% : 0.000012s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002129 22 66.60% : 0.001418s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.66% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.74% : 0.000654s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.309988 72 0.02% : 0.000056s : 1: add_recomputation 0.02% : 0.000071s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.11% : 0.000342s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.68% : 0.039309s : 1: jit_opt_a 0.05% : 0.000157s : 1: jit_opt_after_cconv 0.02% : 0.000059s : 1: jit_opt_b 0.14% : 0.000433s : 1: loop_unroll 0.23% : 0.000707s : 1: mutable_eliminate 0.32% : 0.000999s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000465s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000430s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.61% : 0.001901s : 1: renormalize.infer 0.25% : 0.000762s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000041s : 1: rewriter_after_opt_a 0.03% : 0.000086s : 1: rewriter_before_opt_a 0.03% : 0.000079s : 1: symbol_engine_optimizer 85.07% : 0.263720s : 1: type_inference TotalTime = 0.0765863, [30] [bootstrap]: 0.0003383 [type_inference]: 0.0639847 [event_method]: 2.659e-05 [auto_monad]: 8.498e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.00018292 [rewriter_before_opt_a]: 0.00010277 [expand_dump_flag]: 2.89999e-06 [jit_opt_a]: 0.00972652, [2] [Cycle 1]: 0.0032183, [27] [switch_simplify]: 5.646e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00102672 [with_stream_mark]: 2.031e-05 [recompute_prepare]: 7.78001e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.74999e-06 [renormalize]: 0.00174858 [add_forward_monad_depend]: 5.45001e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.476e-05 [cse]: 3.295e-05 [replace_applicator]: 1.147e-05 [Cycle 2]: 0.0003409, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.21998e-06 [a_1]: 9.352e-05 [with_stream_mark]: 1.943e-05 [recompute_prepare]: 6.52001e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.41998e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.26998e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 7.97003e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.48e-06 [inline_without_move]: 5.12e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 6.38003e-06 [cse]: 1.339e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.076e-05 [rewriter_after_opt_a]: 3.601e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.72999e-06 [mutable_eliminate]: 0.00050024 [jit_opt_b]: 4.921e-05, [1] [Cycle 1]: 4.273e-05, [2] [frontend_op_eliminate]: 1.598e-05 [inline_after_opt_a]: 1.629e-05 [cconv]: 2.475e-05 [loop_unroll]: 0.00042675 [jit_opt_after_cconv]: 0.00013981, [1] [Cycle 1]: 0.00013386, [11] [c_1]: 2.162e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.018e-05 [call_graph_tuple_transform]: 1.817e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 4.99975e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.612e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 5.74e-06 [add_recomputation]: 5.15e-05 [cse_after_recomputation]: 2.222e-05, [1] [Cycle 1]: 1.716e-05, [1] [cse]: 1.165e-05 [auto_monad_reorder]: 1.765e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.22999e-06 [opt_after_jit_grad]: 0.000482 [symbol_engine_optimizer]: 7.433e-05, [1] [Cycle 1]: 6.751e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 9.66e-06 [renormalize]: 4.10015e-07 [validate]: 3.949e-05 Sums bootstrap : 0.000338s : 0.48% type_inference : 0.063985s : 91.66% event_method : 0.000027s : 0.04% auto_monad : 0.000085s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000183s : 0.26% rewriter_before_opt_a : 0.000103s : 0.15% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.001120s : 1.60% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001749s : 2.51% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000046s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000500s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.04% loop_unroll : 0.000427s : 0.61% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000482s : 0.69% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.06% Time group info: ------[substitution.] 0.000663 23 0.33% : 0.000002s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 0.80% : 0.000005s : 3: substitution.graph_param_transform 94.80% : 0.000628s : 4: substitution.inline 0.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.68% : 0.000004s : 4: substitution.remove_not_recompute_node 0.66% : 0.000004s : 2: substitution.replace_old_param 2.05% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063864 2 96.35% : 0.061535s : 1: type_inference.infer 3.65% : 0.002329s : 1: type_inference.specialize ------[replace.] 0.000087 6 67.16% : 0.000058s : 4: replace.inline 32.84% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000638 6 98.08% : 0.000625s : 4: match.inline 1.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.61% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.78% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000978 13 47.46% : 0.000464s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.19% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.36% : 0.000453s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079718 72 0.07% : 0.000054s : 1: add_recomputation 0.11% : 0.000088s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.45% : 0.000358s : 1: bootstrap 0.03% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000040s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 12.20% : 0.009729s : 1: jit_opt_a 0.18% : 0.000142s : 1: jit_opt_after_cconv 0.06% : 0.000052s : 1: jit_opt_b 0.55% : 0.000434s : 1: loop_unroll 0.64% : 0.000508s : 1: mutable_eliminate 1.68% : 0.001338s : 26: opt.transform.jit_opt_a 0.06% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000186s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.33% : 0.001064s : 1: renormalize.infer 0.85% : 0.000676s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000107s : 1: rewriter_before_opt_a 0.10% : 0.000077s : 1: symbol_engine_optimizer 80.29% : 0.064010s : 1: type_inference TotalTime = 0.042039, [30] [bootstrap]: 0.00034275 [type_inference]: 0.00897847 [event_method]: 2.173e-05 [auto_monad]: 6.815e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 4.242e-05 [rewriter_before_opt_a]: 8.554e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.0302714, [2] [Cycle 1]: 0.00217514, [27] [switch_simplify]: 6.817e-05 [loop_unroll]: 3.523e-05 [a_1]: 0.00067834 [with_stream_mark]: 2.511e-05 [recompute_prepare]: 8.26002e-06 [updatestate_depend_eliminate]: 4.57998e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.28002e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.57e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.074e-05 [inline_without_move]: 5.83002e-06 [renormalize]: 0.00094363 [add_forward_monad_depend]: 5.674e-05 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 4.139e-05 [replace_applicator]: 1.398e-05 [Cycle 2]: 0.00032813, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.42999e-06 [a_1]: 8.86e-05 [with_stream_mark]: 1.308e-05 [recompute_prepare]: 5.14998e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 4.95999e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.489e-05 [j_node_and_user_rematch]: 8.25e-06 [meta_fg_expand]: 1.81003e-06 [replace_old_param]: 7.23999e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.487e-05 [replace_applicator]: 5.16998e-06 [py_interpret_to_execute_after_opt_a]: 1.362e-05 [rewriter_after_opt_a]: 4.095e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00061695 [jit_opt_b]: 4.99e-05, [1] [Cycle 1]: 4.345e-05, [2] [frontend_op_eliminate]: 1.519e-05 [inline_after_opt_a]: 1.666e-05 [cconv]: 2.86e-05 [loop_unroll]: 0.00040437 [jit_opt_after_cconv]: 0.00015145, [1] [Cycle 1]: 0.00014539, [11] [c_1]: 2.016e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 7.64002e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.95e-05 [call_graph_tuple_transform]: 1.938e-05 [tuple_list_get_item_eliminator]: 5.39998e-06 [none_parameter_eliminate]: 1.96003e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 3.842e-05 [partial_unused_args_eliminate]: 9.05001e-06 [environ_conv]: 6.50002e-06 [add_recomputation]: 5.116e-05 [cse_after_recomputation]: 2.56e-05, [1] [Cycle 1]: 2.022e-05, [1] [cse]: 1.388e-05 [auto_monad_reorder]: 1.812e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 5.44e-06 [opt_after_jit_grad]: 0.00045278 [symbol_engine_optimizer]: 7.141e-05, [1] [Cycle 1]: 6.532e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.218e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 3.70026e-07 [validate]: 4.036e-05 Sums bootstrap : 0.000343s : 2.51% type_inference : 0.008978s : 65.65% event_method : 0.000022s : 0.16% auto_monad : 0.000068s : 0.50% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000042s : 0.31% rewriter_before_opt_a : 0.000086s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.54% jit_opt_a.loop_unroll : 0.000041s : 0.30% jit_opt_a.a_1 : 0.000767s : 5.61% jit_opt_a.with_stream_mark : 0.000038s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000944s : 6.90% jit_opt_a.add_forward_monad_depend : 0.000058s : 0.42% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.18% jit_opt_a.cse : 0.000056s : 0.41% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000041s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000617s : 4.51% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000029s : 0.21% loop_unroll : 0.000404s : 2.96% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000038s : 0.28% partial_unused_args_eliminate : 0.000009s : 0.07% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000051s : 0.37% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000453s : 3.31% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.30% Time group info: ------[substitution.] 0.000288 24 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 3: substitution.graph_param_transform 87.80% : 0.000253s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 4.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008902 2 88.90% : 0.007914s : 1: type_inference.infer 11.10% : 0.000988s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.61% : 0.000068s : 5: replace.inline 31.39% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 7 95.96% : 0.000250s : 5: match.inline 4.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.27% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.23% : 0.000001s : 11: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000001s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000001s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 16: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.56% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000001s : 11: predicate.print_const_string_wrapper 1.63% : 0.000002s : 11: predicate.reduce_eliminate 1.66% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 19: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.32% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.10% : 0.000010s : 59: predicate.switch_simplify 1.25% : 0.000001s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.33% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.85% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000871 16 52.27% : 0.000455s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.22% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.51% : 0.000327s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044041 72 0.12% : 0.000054s : 1: add_recomputation 0.16% : 0.000072s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.82% : 0.000363s : 1: bootstrap 0.07% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 68.74% : 0.030275s : 1: jit_opt_a 0.35% : 0.000154s : 1: jit_opt_after_cconv 0.12% : 0.000053s : 1: jit_opt_b 0.94% : 0.000412s : 1: loop_unroll 1.42% : 0.000626s : 1: mutable_eliminate 2.29% : 0.001008s : 26: opt.transform.jit_opt_a 0.11% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.05% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000011s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000045s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000041s : 1: remove_dup_value 1.19% : 0.000524s : 1: renormalize.infer 0.93% : 0.000411s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000044s : 1: rewriter_after_opt_a 0.20% : 0.000089s : 1: rewriter_before_opt_a 0.17% : 0.000074s : 1: symbol_engine_optimizer 20.42% : 0.008994s : 1: type_inference TotalTime = 0.0951147, [30] [bootstrap]: 0.00025603 [type_inference]: 0.086705 [event_method]: 2.367e-05 [auto_monad]: 7.167e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00010793 [rewriter_before_opt_a]: 8.132e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00585495, [2] [Cycle 1]: 0.00178294, [27] [switch_simplify]: 5.216e-05 [loop_unroll]: 2.946e-05 [a_1]: 0.00051368 [with_stream_mark]: 1.959e-05 [recompute_prepare]: 7.48999e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.427e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 8.96002e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 0.00084541 [add_forward_monad_depend]: 4.97999e-06 [auto_monad_grad]: 2.50002e-06 [auto_monad_eliminator]: 1.52e-05 [cse]: 3.284e-05 [replace_applicator]: 1.19e-05 [Cycle 2]: 0.00066928, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 4.90001e-06 [a_1]: 8.699e-05 [with_stream_mark]: 8.77e-06 [recompute_prepare]: 1.146e-05 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 8.63001e-06 [updatestate_useless_node_eliminater]: 3.35e-05 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 1.909e-05 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 8.45001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 5.02e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.26998e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 8.03999e-06 [cse]: 1.809e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.207e-05 [rewriter_after_opt_a]: 3.621e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.0004934 [jit_opt_b]: 4.647e-05, [1] [Cycle 1]: 3.978e-05, [2] [frontend_op_eliminate]: 1.433e-05 [inline_after_opt_a]: 1.523e-05 [cconv]: 2.799e-05 [loop_unroll]: 0.00039508 [jit_opt_after_cconv]: 0.00013435, [1] [Cycle 1]: 0.00012811, [11] [c_1]: 1.964e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 5.93002e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 1.877e-05 [call_graph_tuple_transform]: 1.753e-05 [tuple_list_get_item_eliminator]: 5.30999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.23002e-06 [remove_dup_value]: 1.559e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 5.74999e-06 [add_recomputation]: 5.181e-05 [cse_after_recomputation]: 2.171e-05, [1] [Cycle 1]: 1.7e-05, [1] [cse]: 1.112e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 1.66002e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.0004356 [symbol_engine_optimizer]: 6.851e-05, [1] [Cycle 1]: 6.275e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 7.45e-06 [elim_not_effective]: 1.191e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.28001e-06 [renormalize]: 4.10015e-07 [validate]: 3.719e-05 Sums bootstrap : 0.000256s : 0.28% type_inference : 0.086705s : 95.43% event_method : 0.000024s : 0.03% auto_monad : 0.000072s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000108s : 0.12% rewriter_before_opt_a : 0.000081s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.06% jit_opt_a.loop_unroll : 0.000034s : 0.04% jit_opt_a.a_1 : 0.000601s : 0.66% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000039s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000023s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000845s : 0.93% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000051s : 0.06% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000493s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000395s : 0.43% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000436s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.04% Time group info: ------[substitution.] 0.000200 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000005s : 3: substitution.graph_param_transform 83.52% : 0.000167s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.35% : 0.000005s : 2: substitution.replace_old_param 6.15% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.086624 2 98.14% : 0.085014s : 1: type_inference.infer 1.86% : 0.001610s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.94% : 0.000047s : 4: replace.inline 31.06% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.61% : 0.000165s : 4: match.inline 6.39% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.32% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000000s : 3: predicate.graph_param_transform 5.83% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.48% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.44% : 0.000002s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.51% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000805 13 43.92% : 0.000353s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.53% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.54% : 0.000415s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.096856 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.28% : 0.000270s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.05% : 0.005858s : 1: jit_opt_a 0.14% : 0.000137s : 1: jit_opt_after_cconv 0.05% : 0.000049s : 1: jit_opt_b 0.42% : 0.000403s : 1: loop_unroll 0.52% : 0.000501s : 1: mutable_eliminate 0.88% : 0.000849s : 26: opt.transform.jit_opt_a 0.05% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000443s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000111s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.52% : 0.000502s : 1: renormalize.infer 0.35% : 0.000335s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000039s : 1: rewriter_after_opt_a 0.09% : 0.000085s : 1: rewriter_before_opt_a 0.07% : 0.000071s : 1: symbol_engine_optimizer 89.54% : 0.086729s : 1: type_inference TotalTime = 0.091139, [30] [bootstrap]: 0.00026415 [type_inference]: 0.0801316 [event_method]: 2.522e-05 [auto_monad]: 7.475e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00011805 [rewriter_before_opt_a]: 8.514e-05 [expand_dump_flag]: 3.35998e-06 [jit_opt_a]: 0.00824394, [2] [Cycle 1]: 0.00202565, [27] [switch_simplify]: 5.635e-05 [loop_unroll]: 3.164e-05 [a_1]: 0.00056057 [with_stream_mark]: 1.96e-05 [recompute_prepare]: 7.64002e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 3.67002e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 7.95998e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.22e-06 [renormalize]: 0.00101384 [add_forward_monad_depend]: 5.66e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.457e-05 [cse]: 3.693e-05 [replace_applicator]: 1.253e-05 [Cycle 2]: 0.00263336, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 5.12e-06 [a_1]: 0.0023412 [with_stream_mark]: 1.682e-05 [recompute_prepare]: 9.31e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.636e-05 [j_node_and_user_rematch]: 8.12998e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 7.86001e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.96998e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.153e-05 [cse]: 2.363e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.491e-05 [rewriter_after_opt_a]: 4.008e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00059427 [jit_opt_b]: 5.01e-05, [1] [Cycle 1]: 4.171e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 3.014e-05 [loop_unroll]: 0.00041464 [jit_opt_after_cconv]: 0.00013965, [1] [Cycle 1]: 0.00013316, [11] [c_1]: 2.037e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 5.34998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.061e-05 [call_graph_tuple_transform]: 1.868e-05 [tuple_list_get_item_eliminator]: 5.05001e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.742e-05 [partial_unused_args_eliminate]: 3.04999e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 5.342e-05 [cse_after_recomputation]: 2.129e-05, [1] [Cycle 1]: 1.627e-05, [1] [cse]: 1.084e-05 [auto_monad_reorder]: 1.836e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00044055 [symbol_engine_optimizer]: 9.045e-05, [1] [Cycle 1]: 8.444e-05, [6] [build]: 4.31002e-06 [elim_shapecalc]: 2.454e-05 [elim_not_effective]: 1.35e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 8.89995e-07 [validate]: 3.954e-05 Sums bootstrap : 0.000264s : 0.30% type_inference : 0.080132s : 92.17% event_method : 0.000025s : 0.03% auto_monad : 0.000075s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000118s : 0.14% rewriter_before_opt_a : 0.000085s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.07% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.002902s : 3.34% jit_opt_a.with_stream_mark : 0.000036s : 0.04% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001014s : 1.17% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.03% jit_opt_a.cse : 0.000061s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000594s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000415s : 0.48% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000441s : 0.51% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000025s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.05% Time group info: ------[substitution.] 0.000230 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 84.86% : 0.000195s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000005s : 2: substitution.replace_old_param 5.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.080041 2 81.41% : 0.065159s : 1: type_inference.infer 18.59% : 0.014882s : 1: type_inference.specialize ------[replace.] 0.000067 6 69.28% : 0.000047s : 4: replace.inline 30.72% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.37% : 0.000193s : 4: match.inline 5.63% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.65% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.40% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.74% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.64% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.21% : 0.000001s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.41% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.44% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.10% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 5.19% : 0.000006s : 10: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000834 13 44.03% : 0.000367s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.50% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.47% : 0.000413s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.095323 72 0.06% : 0.000056s : 1: add_recomputation 0.08% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000283s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.65% : 0.008248s : 1: jit_opt_a 0.15% : 0.000142s : 1: jit_opt_after_cconv 0.06% : 0.000053s : 1: jit_opt_b 0.44% : 0.000423s : 1: loop_unroll 0.63% : 0.000602s : 1: mutable_eliminate 3.28% : 0.003125s : 26: opt.transform.jit_opt_a 0.05% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000122s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.63% : 0.000605s : 1: renormalize.infer 0.42% : 0.000401s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000089s : 1: rewriter_before_opt_a 0.10% : 0.000093s : 1: symbol_engine_optimizer 84.09% : 0.080158s : 1: type_inference TotalTime = 0.0521237, [30] [bootstrap]: 0.00030371 [type_inference]: 0.00992095 [event_method]: 2.274e-05 [auto_monad]: 0.0322249 [graph_reusing]: 7.56999e-06 [pre_auto_parallel]: 3.86999e-06 [py_interpret_to_execute]: 0.00011315 [rewriter_before_opt_a]: 0.00011903 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.00662032, [2] [Cycle 1]: 0.00239404, [27] [switch_simplify]: 7.66e-05 [loop_unroll]: 3.366e-05 [a_1]: 0.00075039 [with_stream_mark]: 2.51e-05 [recompute_prepare]: 8.35999e-06 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.70002e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 6.03998e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.636e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 5.70001e-06 [renormalize]: 0.0011237 [add_forward_monad_depend]: 7.01001e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.816e-05 [cse]: 4.354e-05 [replace_applicator]: 1.829e-05 [Cycle 2]: 0.00033828, [27] [switch_simplify]: 6.04999e-06 [loop_unroll]: 5.00001e-06 [a_1]: 9.019e-05 [with_stream_mark]: 1.431e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.55997e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 4.74e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.58003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 7.26999e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 7.87e-06 [cse]: 1.599e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.609e-05 [rewriter_after_opt_a]: 4.42e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00085306 [jit_opt_b]: 5.507e-05, [1] [Cycle 1]: 4.749e-05, [2] [frontend_op_eliminate]: 1.703e-05 [inline_after_opt_a]: 1.792e-05 [cconv]: 3.244e-05 [loop_unroll]: 0.000569 [jit_opt_after_cconv]: 0.00017415, [1] [Cycle 1]: 0.00016722, [11] [c_1]: 2.209e-05 [parameter_eliminate]: 4.42e-06 [updatestate_depend_eliminate]: 9.91e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 3.944e-05 [call_graph_tuple_transform]: 2.173e-05 [tuple_list_get_item_eliminator]: 5.49998e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.64998e-06 [remove_dup_value]: 4.477e-05 [partial_unused_args_eliminate]: 2.08002e-06 [environ_conv]: 6.52001e-06 [add_recomputation]: 5.615e-05 [cse_after_recomputation]: 2.54e-05, [1] [Cycle 1]: 2.021e-05, [1] [cse]: 1.443e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 7.13e-06 [opt_after_jit_grad]: 0.0005122 [symbol_engine_optimizer]: 7.973e-05, [1] [Cycle 1]: 7.311e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 8.54998e-06 [elim_not_effective]: 1.527e-05 [opt_reshape]: 7.45e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 3.50003e-07 [validate]: 4.595e-05 Sums bootstrap : 0.000304s : 0.64% type_inference : 0.009921s : 20.85% event_method : 0.000023s : 0.05% auto_monad : 0.032225s : 67.73% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000113s : 0.24% rewriter_before_opt_a : 0.000119s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000083s : 0.17% jit_opt_a.loop_unroll : 0.000039s : 0.08% jit_opt_a.a_1 : 0.000841s : 1.77% jit_opt_a.with_stream_mark : 0.000039s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001124s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.05% jit_opt_a.cse : 0.000060s : 0.13% jit_opt_a.replace_applicator : 0.000024s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000044s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000853s : 1.79% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000032s : 0.07% loop_unroll : 0.000569s : 1.20% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000045s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.12% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000512s : 1.08% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.10% Time group info: ------[substitution.] 0.000330 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 1.78% : 0.000006s : 3: substitution.graph_param_transform 88.52% : 0.000292s : 5: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000006s : 4: substitution.remove_not_recompute_node 1.43% : 0.000005s : 2: substitution.replace_old_param 4.19% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009836 2 85.69% : 0.008429s : 1: type_inference.infer 14.31% : 0.001408s : 1: type_inference.specialize ------[replace.] 0.000112 7 69.90% : 0.000078s : 5: replace.inline 30.10% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000302 7 95.87% : 0.000289s : 5: match.inline 4.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.48% : 0.000002s : 11: predicate.addn_zero_filter 2.11% : 0.000003s : 11: predicate.arithmetic_simplify 1.20% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.11% : 0.000001s : 11: predicate.depend_value_elim 1.05% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.09% : 0.000001s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.27% : 0.000008s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 16: predicate.load_eliminater 1.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.70% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.23% : 0.000002s : 11: predicate.print_const_string_wrapper 1.81% : 0.000002s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 19: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.47% : 0.000002s : 11: predicate.reshape_eliminate 1.26% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 59: predicate.switch_simplify 1.69% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000002s : 11: predicate.transpose_eliminate 1.34% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001071 16 48.39% : 0.000518s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.86% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.75% : 0.000458s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054388 72 0.11% : 0.000059s : 1: add_recomputation 59.30% : 0.032250s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.59% : 0.000321s : 1: bootstrap 0.06% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000013s : 1: graph_reusing 12.18% : 0.006624s : 1: jit_opt_a 0.33% : 0.000177s : 1: jit_opt_after_cconv 0.11% : 0.000058s : 1: jit_opt_b 1.06% : 0.000578s : 1: loop_unroll 1.59% : 0.000866s : 1: mutable_eliminate 2.01% : 0.001091s : 26: opt.transform.jit_opt_a 0.09% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.96% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.21% : 0.000117s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000048s : 1: remove_dup_value 1.18% : 0.000642s : 1: renormalize.infer 0.87% : 0.000471s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000047s : 1: rewriter_after_opt_a 0.23% : 0.000123s : 1: rewriter_before_opt_a 0.15% : 0.000082s : 1: symbol_engine_optimizer 18.28% : 0.009944s : 1: type_inference . TotalTime = 0.0663374, [30] [bootstrap]: 0.0003967 [type_inference]: 0.005097 [event_method]: 1.814e-05 [auto_monad]: 6.748e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 3.685e-05 [rewriter_before_opt_a]: 7.406e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00520516, [2] [Cycle 1]: 0.00158346, [27] [switch_simplify]: 5.43e-05 [loop_unroll]: 3.108e-05 [a_1]: 0.00053284 [with_stream_mark]: 1.787e-05 [recompute_prepare]: 7.25998e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.98999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.60001e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 0.00061181 [add_forward_monad_depend]: 4.67e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.383e-05 [cse]: 3.44e-05 [replace_applicator]: 1.149e-05 [Cycle 2]: 0.00032847, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.119e-05 [with_stream_mark]: 9.12001e-06 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.227e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.32997e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.272e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.05e-05 [rewriter_after_opt_a]: 3.476e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.0536724 [jit_opt_b]: 6.601e-05, [1] [Cycle 1]: 5.399e-05, [2] [frontend_op_eliminate]: 1.917e-05 [inline_after_opt_a]: 2.081e-05 [cconv]: 4.328e-05 [loop_unroll]: 0.00048241 [jit_opt_after_cconv]: 0.0002111, [1] [Cycle 1]: 0.00020466, [11] [c_1]: 2.258e-05 [parameter_eliminate]: 4.85001e-06 [updatestate_depend_eliminate]: 1.052e-05 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 4.507e-05 [call_graph_tuple_transform]: 2.478e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 5.96998e-06 [remove_dup_value]: 1.806e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 7.42998e-06 [add_recomputation]: 5.569e-05 [cse_after_recomputation]: 2.571e-05, [1] [Cycle 1]: 1.99e-05, [1] [cse]: 1.366e-05 [auto_monad_reorder]: 1.917e-05 [get_jit_bprop_graph]: 2.64999e-06 [rewriter_after_jit_bprop_graph]: 1.049e-05 [opt_after_jit_grad]: 0.00044244 [symbol_engine_optimizer]: 7.667e-05, [1] [Cycle 1]: 6.991e-05, [6] [build]: 3.74002e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.332e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 4.09986e-07 [validate]: 4.527e-05 Sums bootstrap : 0.000397s : 0.64% type_inference : 0.005097s : 8.17% event_method : 0.000018s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000037s : 0.06% rewriter_before_opt_a : 0.000074s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000624s : 1.00% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000612s : 0.98% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000047s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.053672s : 86.01% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000043s : 0.07% loop_unroll : 0.000482s : 0.77% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000442s : 0.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.07% Time group info: ------[substitution.] 0.000206 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000002s : 2: substitution.fold_const_symbol 3.24% : 0.000007s : 3: substitution.graph_param_transform 82.88% : 0.000171s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 6.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005033 2 83.57% : 0.004206s : 1: type_inference.infer 16.43% : 0.000827s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.53% : 0.000047s : 4: replace.inline 32.47% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.61% : 0.000169s : 4: match.inline 6.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.18% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 4.31% : 0.000005s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.63% : 0.000001s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000655 13 56.56% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.61% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.83% : 0.000248s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067862 72 0.09% : 0.000058s : 1: add_recomputation 0.10% : 0.000071s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.62% : 0.000421s : 1: bootstrap 0.07% : 0.000046s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.67% : 0.005208s : 1: jit_opt_a 0.32% : 0.000214s : 1: jit_opt_after_cconv 0.10% : 0.000069s : 1: jit_opt_b 0.72% : 0.000490s : 1: loop_unroll 79.12% : 0.053691s : 1: mutable_eliminate 1.23% : 0.000834s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000034s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000450s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000039s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 0.48% : 0.000323s : 1: renormalize.infer 0.41% : 0.000282s : 1: renormalize.specialize 0.02% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.11% : 0.000077s : 1: rewriter_before_opt_a 0.12% : 0.000079s : 1: symbol_engine_optimizer 7.53% : 0.005110s : 1: type_inference TotalTime = 0.285779, [30] [bootstrap]: 0.00035538 [type_inference]: 0.234139 [event_method]: 2.913e-05 [auto_monad]: 8.081e-05 [graph_reusing]: 6.75998e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00061751 [rewriter_before_opt_a]: 0.00010793 [expand_dump_flag]: 4.08999e-06 [jit_opt_a]: 0.0479411, [2] [Cycle 1]: 0.0423521, [27] [switch_simplify]: 7.453e-05 [loop_unroll]: 3.417e-05 [a_1]: 0.00080749 [with_stream_mark]: 4.627e-05 [recompute_prepare]: 3.974e-05 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.77002e-06 [specialize_transform]: 8.64e-06 [updatestate_useless_node_eliminater]: 8.08001e-06 [accelerated_algorithm]: 1.09e-05 [meta_shard_fg_expand]: 6.13002e-06 [get_grad_eliminate_]: 8.20999e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 3.48999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.895e-05 [j_node_and_user_rematch]: 1.281e-05 [meta_fg_expand]: 4.25e-06 [replace_old_param]: 1.461e-05 [inline_without_move]: 6.80002e-06 [renormalize]: 0.0361873 [add_forward_monad_depend]: 9.05999e-06 [auto_monad_grad]: 2.85998e-06 [auto_monad_eliminator]: 1.783e-05 [cse]: 2.972e-05 [replace_applicator]: 2.625e-05 [Cycle 2]: 0.00042429, [27] [switch_simplify]: 7.82998e-06 [loop_unroll]: 6.81001e-06 [a_1]: 0.00015355 [with_stream_mark]: 1.478e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.48998e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 4.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 8.99998e-06 [inline_without_move]: 6.32001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.453e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.448e-05 [rewriter_after_opt_a]: 3.893e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00080722 [jit_opt_b]: 5.884e-05, [1] [Cycle 1]: 5.042e-05, [2] [frontend_op_eliminate]: 2.069e-05 [inline_after_opt_a]: 1.838e-05 [cconv]: 2.833e-05 [loop_unroll]: 0.00042606 [jit_opt_after_cconv]: 0.00015609, [1] [Cycle 1]: 0.00014858, [11] [c_1]: 2.679e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.086e-05 [call_graph_tuple_transform]: 2.143e-05 [tuple_list_get_item_eliminator]: 7.03e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.21998e-06 [remove_dup_value]: 1.643e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 8.68001e-06 [add_recomputation]: 4.925e-05 [cse_after_recomputation]: 2.444e-05, [1] [Cycle 1]: 1.864e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00045031 [symbol_engine_optimizer]: 7.6e-05, [1] [Cycle 1]: 6.993e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.358e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 1.002e-05 [renormalize]: 3.80009e-07 [validate]: 0.00010048 Sums bootstrap : 0.000355s : 0.13% type_inference : 0.234139s : 85.07% event_method : 0.000029s : 0.01% auto_monad : 0.000081s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000618s : 0.22% rewriter_before_opt_a : 0.000108s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000961s : 0.35% jit_opt_a.with_stream_mark : 0.000061s : 0.02% jit_opt_a.recompute_prepare : 0.000047s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000045s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.036187s : 13.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000807s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000426s : 0.15% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000450s : 0.16% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000100s : 0.04% Time group info: ------[substitution.] 0.000324 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000006s : 4: substitution.graph_param_transform 82.65% : 0.000267s : 5: substitution.inline 1.64% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.73% : 0.000015s : 3: substitution.reduce_eliminate 1.75% : 0.000006s : 4: substitution.remove_not_recompute_node 2.42% : 0.000008s : 2: substitution.replace_old_param 3.95% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.234032 2 98.07% : 0.229511s : 1: type_inference.infer 1.93% : 0.004521s : 1: type_inference.specialize ------[replace.] 0.000121 7 66.61% : 0.000081s : 5: replace.inline 33.39% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000276 7 95.82% : 0.000265s : 5: match.inline 4.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.40% : 0.000002s : 13: predicate.accumulaten_eliminater 0.77% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.82% : 0.000003s : 13: predicate.addn_zero_filter 2.36% : 0.000004s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.48% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.45% : 0.000002s : 13: predicate.environ_get_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.34% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.22% : 0.000008s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.85% : 0.000005s : 8: predicate.less_batch_normalization 1.62% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 0.91% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.19% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000004s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.39% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.54% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.96% : 0.000002s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 1.14% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 1.21% : 0.000002s : 8: predicate.specialize_transform 1.56% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.87% : 0.000011s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003588 25 50.58% : 0.001815s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.44% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.98% : 0.001686s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.323256 72 0.02% : 0.000052s : 1: add_recomputation 0.03% : 0.000085s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000378s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 14.83% : 0.047945s : 1: jit_opt_a 0.05% : 0.000159s : 1: jit_opt_after_cconv 0.02% : 0.000061s : 1: jit_opt_b 0.13% : 0.000435s : 1: loop_unroll 0.25% : 0.000816s : 1: mutable_eliminate 0.40% : 0.001287s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000458s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000626s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 10.65% : 0.034426s : 1: renormalize.infer 0.54% : 0.001745s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000113s : 1: rewriter_before_opt_a 0.02% : 0.000079s : 1: symbol_engine_optimizer 72.44% : 0.234161s : 1: type_inference TotalTime = 0.124907, [30] [bootstrap]: 0.00033216 [type_inference]: 0.116769 [event_method]: 2.421e-05 [auto_monad]: 7.025e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 0.00010316 [rewriter_before_opt_a]: 8.117e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00545282, [2] [Cycle 1]: 0.0018129, [27] [switch_simplify]: 5.117e-05 [loop_unroll]: 2.895e-05 [a_1]: 0.00049846 [with_stream_mark]: 1.546e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.0009064 [add_forward_monad_depend]: 4.88001e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.507e-05 [cse]: 3.142e-05 [replace_applicator]: 1.183e-05 [Cycle 2]: 0.0003054, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 4.85999e-06 [a_1]: 8.624e-05 [with_stream_mark]: 8.1e-06 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.216e-05 [j_node_and_user_rematch]: 7.80998e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.37999e-06 [cse]: 1.174e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 9.27001e-06 [rewriter_after_opt_a]: 3.512e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00047499 [jit_opt_b]: 4.636e-05, [1] [Cycle 1]: 3.967e-05, [2] [frontend_op_eliminate]: 1.443e-05 [inline_after_opt_a]: 1.497e-05 [cconv]: 9.032e-05 [loop_unroll]: 0.00041287 [jit_opt_after_cconv]: 0.00013514, [1] [Cycle 1]: 0.00012909, [11] [c_1]: 1.975e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 1.914e-05 [call_graph_tuple_transform]: 1.732e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.16998e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.99999e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 4.818e-05 [cse_after_recomputation]: 2.115e-05, [1] [Cycle 1]: 1.641e-05, [1] [cse]: 1.081e-05 [auto_monad_reorder]: 1.672e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 4.45e-06 [opt_after_jit_grad]: 0.00043271 [symbol_engine_optimizer]: 7.105e-05, [1] [Cycle 1]: 6.483e-05, [6] [build]: 2.86e-06 [elim_shapecalc]: 7.77998e-06 [elim_not_effective]: 1.232e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 5.10016e-07 [validate]: 3.565e-05 Sums bootstrap : 0.000332s : 0.27% type_inference : 0.116769s : 96.50% event_method : 0.000024s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000103s : 0.09% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000034s : 0.03% jit_opt_a.a_1 : 0.000585s : 0.48% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000906s : 0.75% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000017s : 0.01% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000475s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000090s : 0.07% loop_unroll : 0.000413s : 0.34% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000433s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000188 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.93% : 0.000002s : 2: substitution.fold_const_symbol 2.80% : 0.000005s : 3: substitution.graph_param_transform 82.85% : 0.000155s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000004s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116687 2 98.61% : 0.115060s : 1: type_inference.infer 1.39% : 0.001627s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.46% : 0.000045s : 4: replace.inline 31.54% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 6 93.29% : 0.000153s : 4: match.inline 6.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000108 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000001s : 10: predicate.addn_zero_filter 1.67% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.17% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000996 13 44.50% : 0.000443s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.10% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.39% : 0.000522s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126654 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.28% : 0.000350s : 1: bootstrap 0.08% : 0.000095s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000014s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.31% : 0.005455s : 1: jit_opt_a 0.11% : 0.000137s : 1: jit_opt_after_cconv 0.04% : 0.000049s : 1: jit_opt_b 0.33% : 0.000421s : 1: loop_unroll 0.38% : 0.000483s : 1: mutable_eliminate 0.62% : 0.000789s : 26: opt.transform.jit_opt_a 0.04% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000441s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000107s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.37% : 0.000469s : 1: renormalize.infer 0.34% : 0.000430s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.06% : 0.000073s : 1: symbol_engine_optimizer 92.21% : 0.116793s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.142.378 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cb80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.143.008 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.159058, [30] [bootstrap]: 0.00037079 [type_inference]: 0.136916 [event_method]: 2.393e-05 [auto_monad]: 7.471e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00035777 [rewriter_before_opt_a]: 8.713e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.0187307, [2] [Cycle 1]: 0.0145473, [27] [switch_simplify]: 5.359e-05 [loop_unroll]: 2.948e-05 [a_1]: 0.00060802 [with_stream_mark]: 1.854e-05 [recompute_prepare]: 8.46002e-06 [updatestate_depend_eliminate]: 3.89997e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.18998e-06 [specialize_transform]: 6.94001e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.90002e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.13002e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 9.53002e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.0134694 [add_forward_monad_depend]: 1.06e-05 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 2.101e-05 [cse]: 3.122e-05 [replace_applicator]: 2.353e-05 [Cycle 2]: 0.00039896, [27] [switch_simplify]: 7.45e-06 [loop_unroll]: 6.83e-06 [a_1]: 0.0001373 [with_stream_mark]: 1.489e-05 [recompute_prepare]: 6.17999e-06 [updatestate_depend_eliminate]: 3.53999e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 3.6e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.691e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.86998e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.098e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 1.561e-05 [rewriter_after_opt_a]: 3.84e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 4.73001e-06 [mutable_eliminate]: 0.00076219 [jit_opt_b]: 5.836e-05, [1] [Cycle 1]: 5.12e-05, [2] [frontend_op_eliminate]: 2.09e-05 [inline_after_opt_a]: 1.923e-05 [cconv]: 2.805e-05 [loop_unroll]: 0.00044644 [jit_opt_after_cconv]: 0.00016311, [1] [Cycle 1]: 0.0001567, [11] [c_1]: 2.742e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 6.59999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.415e-05 [call_graph_tuple_transform]: 2.279e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.644e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 9.65002e-06 [add_recomputation]: 5.202e-05 [cse_after_recomputation]: 2.315e-05, [1] [Cycle 1]: 1.723e-05, [1] [cse]: 1.146e-05 [auto_monad_reorder]: 1.601e-05 [get_jit_bprop_graph]: 2.79999e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00046052 [symbol_engine_optimizer]: 0.00013229, [1] [Cycle 1]: 0.00012582, [6] [build]: 4.53001e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 6.425e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.184e-05 [renormalize]: 2.09984e-07 [validate]: 5.045e-05 Sums bootstrap : 0.000371s : 0.24% type_inference : 0.136916s : 88.53% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000358s : 0.23% rewriter_before_opt_a : 0.000087s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000745s : 0.48% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.013470s : 8.71% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000762s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000446s : 0.29% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000461s : 0.30% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000064s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000296 24 17.73% : 0.000052s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000007s : 4: substitution.graph_param_transform 70.36% : 0.000208s : 4: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.24% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.136809 2 97.70% : 0.133665s : 1: type_inference.infer 2.30% : 0.003145s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.95% : 0.000049s : 4: replace.inline 32.05% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.74% : 0.000205s : 4: match.inline 5.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000002s : 12: predicate.arithmetic_simplify 1.52% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 12: predicate.compare_switch_simplify 1.08% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.83% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.45% : 0.000002s : 12: predicate.environ_get_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.34% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.82% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.59% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.73% : 0.000009s : 58: predicate.switch_simplify 1.67% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.93% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.006787 26 69.38% : 0.004709s : 19: func_graph_cloner_run.FuncGraphClonerGraph 0.65% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.97% : 0.002034s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173626 72 0.03% : 0.000055s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000385s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.79% : 0.018735s : 1: jit_opt_a 0.10% : 0.000165s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.26% : 0.000455s : 1: loop_unroll 0.44% : 0.000771s : 1: mutable_eliminate 0.57% : 0.000986s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000088s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000467s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000364s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 6.54% : 0.011355s : 1: renormalize.infer 1.21% : 0.002101s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.05% : 0.000092s : 1: rewriter_before_opt_a 0.08% : 0.000135s : 1: symbol_engine_optimizer 78.87% : 0.136939s : 1: type_inference TotalTime = 0.0495853, [30] [bootstrap]: 0.00023658 [type_inference]: 0.0275114 [event_method]: 6.307e-05 [auto_monad]: 9.777e-05 [graph_reusing]: 7.29001e-06 [pre_auto_parallel]: 3.54002e-06 [py_interpret_to_execute]: 3.274e-05 [rewriter_before_opt_a]: 0.00011949 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.0192433, [3] [Cycle 1]: 0.0129319, [27] [switch_simplify]: 6.866e-05 [loop_unroll]: 4.26e-05 [a_1]: 0.00089441 [with_stream_mark]: 2.742e-05 [recompute_prepare]: 1.954e-05 [updatestate_depend_eliminate]: 8.59e-06 [updatestate_assign_eliminate]: 6.78e-06 [updatestate_loads_eliminate]: 7.01001e-06 [parameter_eliminate]: 3.24001e-06 [specialize_transform]: 1.366e-05 [updatestate_useless_node_eliminater]: 1.287e-05 [accelerated_algorithm]: 1.256e-05 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 1.264e-05 [merge_forward]: 8.77e-06 [cell_reuse_recompute_pass]: 8.70001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.671e-05 [j_node_and_user_rematch]: 2.306e-05 [meta_fg_expand]: 0.00173356 [replace_old_param]: 6.652e-05 [inline_without_move]: 5.686e-05 [renormalize]: 0.00919574 [add_forward_monad_depend]: 1.393e-05 [auto_monad_grad]: 6.06998e-06 [auto_monad_eliminator]: 5.912e-05 [cse]: 0.00024877 [replace_applicator]: 9.128e-05 [Cycle 2]: 0.0027087, [27] [switch_simplify]: 3.996e-05 [loop_unroll]: 3.805e-05 [a_1]: 0.00110604 [with_stream_mark]: 1.629e-05 [recompute_prepare]: 7.40998e-06 [updatestate_depend_eliminate]: 4.04002e-06 [updatestate_assign_eliminate]: 3.86001e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 5.19998e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.385e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 0.00013002 [replace_old_param]: 6.41e-06 [inline_without_move]: 4.66002e-06 [renormalize]: 0.00106986 [add_forward_monad_depend]: 5.62999e-06 [auto_monad_grad]: 1.68002e-06 [auto_monad_eliminator]: 1.293e-05 [cse]: 2.341e-05 [replace_applicator]: 1.309e-05 [Cycle 3]: 0.00030219, [27] [switch_simplify]: 5.05999e-06 [loop_unroll]: 4.79e-06 [a_1]: 6.878e-05 [with_stream_mark]: 8.43999e-06 [recompute_prepare]: 4.56002e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.40025e-07 [specialize_transform]: 4.74998e-06 [updatestate_useless_node_eliminater]: 4.32998e-06 [accelerated_algorithm]: 4.57e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.37998e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.353e-05 [j_node_and_user_rematch]: 7.33e-06 [meta_fg_expand]: 1.61998e-06 [replace_old_param]: 4.22e-06 [inline_without_move]: 4.38999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.201e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.417e-05 [rewriter_after_opt_a]: 3.534e-05 [convert_after_rewriter]: 6.46999e-06 [order_py_execute_after_rewriter]: 5.43002e-06 [mutable_eliminate]: 0.00069579 [jit_opt_b]: 4.807e-05, [1] [Cycle 1]: 4.086e-05, [2] [frontend_op_eliminate]: 1.436e-05 [inline_after_opt_a]: 1.477e-05 [cconv]: 2.515e-05 [loop_unroll]: 0.00042808 [jit_opt_after_cconv]: 0.00013959, [1] [Cycle 1]: 0.00013345, [11] [c_1]: 1.738e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.145e-05 [call_graph_tuple_transform]: 1.678e-05 [tuple_list_get_item_eliminator]: 5.10001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 4.65001e-06 [remove_dup_value]: 1.623e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.00002e-06 [add_recomputation]: 4.341e-05 [cse_after_recomputation]: 2.276e-05, [1] [Cycle 1]: 1.778e-05, [1] [cse]: 1.183e-05 [auto_monad_reorder]: 1.394e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 5.09998e-06 [opt_after_jit_grad]: 0.00045334 [symbol_engine_optimizer]: 8.157e-05, [1] [Cycle 1]: 7.488e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 6.21e-06 [elim_not_effective]: 2.192e-05 [opt_reshape]: 5.24998e-06 [fold_const_symbol]: 8.34998e-06 [renormalize]: 4.69998e-07 [validate]: 3.441e-05 Sums bootstrap : 0.000237s : 0.52% type_inference : 0.027511s : 60.58% event_method : 0.000063s : 0.14% auto_monad : 0.000098s : 0.22% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000033s : 0.07% rewriter_before_opt_a : 0.000119s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000114s : 0.25% jit_opt_a.loop_unroll : 0.000085s : 0.19% jit_opt_a.a_1 : 0.002069s : 4.56% jit_opt_a.with_stream_mark : 0.000052s : 0.11% jit_opt_a.recompute_prepare : 0.000032s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000024s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.05% jit_opt_a.accelerated_algorithm : 0.000022s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.05% jit_opt_a.merge_forward : 0.000015s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.09% jit_opt_a.meta_fg_expand : 0.001865s : 4.11% jit_opt_a.replace_old_param : 0.000077s : 0.17% jit_opt_a.inline_without_move : 0.000066s : 0.15% jit_opt_a.renormalize : 0.010266s : 22.60% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.05% jit_opt_a.auto_monad_grad : 0.000008s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000078s : 0.17% jit_opt_a.cse : 0.000284s : 0.63% jit_opt_a.replace_applicator : 0.000110s : 0.24% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000035s : 0.08% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000696s : 1.53% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000025s : 0.06% loop_unroll : 0.000428s : 0.94% jit_opt_after_cconv.c_1 : 0.000017s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000043s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000453s : 1.00% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.08% Time group info: ------[substitution.] 0.000546 106 2.02% : 0.000011s : 2: substitution.elim_not_effective 0.22% : 0.000001s : 2: substitution.fold_const_symbol 0.99% : 0.000005s : 2: substitution.graph_param_transform 63.39% : 0.000346s : 13: substitution.inline 3.13% : 0.000017s : 2: substitution.inline_without_move 1.59% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.25% : 0.000012s : 7: substitution.minmaximum_grad 1.26% : 0.000007s : 5: substitution.partial_eliminate 2.05% : 0.000011s : 12: substitution.remove_not_recompute_node 5.95% : 0.000033s : 10: substitution.replace_applicator 1.26% : 0.000007s : 10: substitution.replace_old_param 0.47% : 0.000003s : 1: substitution.set_cell_output_no_recompute 4.53% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.97% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.92% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027424 2 94.59% : 0.025940s : 1: type_inference.infer 5.41% : 0.001485s : 1: type_inference.specialize ------[replace.] 0.000176 20 64.36% : 0.000113s : 13: replace.inline 35.64% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000361 20 93.93% : 0.000339s : 13: match.inline 6.07% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000363 2405 1.72% : 0.000006s : 41: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.43% : 0.000005s : 41: predicate.addn_check_dump 1.54% : 0.000006s : 41: predicate.addn_zero_filter 2.09% : 0.000008s : 41: predicate.arithmetic_simplify 1.54% : 0.000006s : 41: predicate.cast_eliminate 0.24% : 0.000001s : 2: predicate.check_bprop_eliminate 1.44% : 0.000005s : 41: predicate.compare_switch_simplify 1.50% : 0.000005s : 41: predicate.depend_value_elim 1.52% : 0.000006s : 41: predicate.dict_get_item_const_eliminator 1.61% : 0.000006s : 41: predicate.dict_get_item_eliminator 1.50% : 0.000005s : 41: predicate.dict_set_item_eliminator 0.29% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 2: predicate.elim_not_effective 0.18% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000005s : 41: predicate.environ_add_const_eliminate 1.44% : 0.000005s : 41: predicate.environ_get_add_eliminate 1.47% : 0.000005s : 41: predicate.environ_get_depend_swap 1.50% : 0.000005s : 41: predicate.environ_get_eliminate 1.46% : 0.000005s : 41: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.83% : 0.000003s : 15: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.48% : 0.000016s : 65: predicate.inline 1.91% : 0.000007s : 43: predicate.inline_without_move 0.29% : 0.000001s : 15: predicate.j_node_and_user_rematch 0.86% : 0.000003s : 15: predicate.less_batch_normalization 1.96% : 0.000007s : 48: predicate.list_to_tuple_eliminator_ 1.91% : 0.000007s : 50: predicate.load_eliminater 0.54% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.36% : 0.000012s : 86: predicate.loop_unroll_before_grad 1.82% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.53% : 0.000006s : 41: predicate.merge_addn 1.53% : 0.000006s : 41: predicate.minmaximum_grad 0.43% : 0.000002s : 2: predicate.mutable_eliminate 0.13% : 0.000000s : 2: predicate.opt_reshape 2.47% : 0.000009s : 50: predicate.partial_eliminate 1.50% : 0.000005s : 41: predicate.print_const_string_wrapper 2.11% : 0.000008s : 41: predicate.reduce_eliminate 1.85% : 0.000007s : 48: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 15: predicate.remove_not_recompute_node 2.69% : 0.000010s : 89: predicate.replace_applicator 1.02% : 0.000004s : 43: predicate.replace_old_param 0.08% : 0.000000s : 2: predicate.reset_defer_inline 1.54% : 0.000006s : 41: predicate.reshape_eliminate 1.53% : 0.000006s : 41: predicate.row_tensor_add_zeros_like 0.22% : 0.000001s : 2: predicate.row_tensor_eliminate 1.51% : 0.000005s : 41: predicate.same_eliminate 0.40% : 0.000001s : 15: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 4: predicate.special_op_eliminate 0.75% : 0.000003s : 15: predicate.specialize_transform 1.70% : 0.000006s : 41: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 41: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.86% : 0.000010s : 61: predicate.switch_defer_inline 2.47% : 0.000009s : 61: predicate.switch_layer_defer_inline 6.39% : 0.000023s : 149: predicate.switch_simplify 1.53% : 0.000006s : 41: predicate.tile_eliminate 1.55% : 0.000006s : 41: predicate.transpose_eliminate 1.81% : 0.000007s : 41: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000006s : 41: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000012s : 52: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 41: predicate.tuple_list_set_item_eliminator 1.90% : 0.000007s : 48: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.64% : 0.000010s : 65: predicate.updatestate_useless_node_eliminater 1.94% : 0.000007s : 41: predicate.value_based_eliminate 0.11% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002385 36 61.52% : 0.001467s : 19: func_graph_cloner_run.FuncGraphClonerGraph 38.48% : 0.000918s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062572 87 0.07% : 0.000046s : 1: add_recomputation 0.16% : 0.000102s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.42% : 0.000261s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.11% : 0.000068s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 30.76% : 0.019246s : 1: jit_opt_a 0.23% : 0.000142s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.70% : 0.000436s : 1: loop_unroll 1.13% : 0.000704s : 1: mutable_eliminate 4.30% : 0.002689s : 39: opt.transform.jit_opt_a 0.06% : 0.000040s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000023s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.06% : 0.000035s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 12.84% : 0.008032s : 2: renormalize.infer 3.54% : 0.002214s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.20% : 0.000122s : 1: rewriter_before_opt_a 0.13% : 0.000084s : 1: symbol_engine_optimizer 44.00% : 0.027530s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.236.121 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c310> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.236.760 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0870269, [30] [bootstrap]: 0.00027312 [type_inference]: 0.0271896 [event_method]: 1.815e-05 [auto_monad]: 6.66e-05 [graph_reusing]: 6.25002e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 9.388e-05 [rewriter_before_opt_a]: 7.874e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.0571791, [2] [Cycle 1]: 0.00238386, [27] [switch_simplify]: 7.031e-05 [loop_unroll]: 2.921e-05 [a_1]: 0.00060735 [with_stream_mark]: 2.259e-05 [recompute_prepare]: 7.31001e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.01998e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.70997e-06 [replace_old_param]: 9.74999e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.00132025 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.477e-05 [cse]: 3.319e-05 [replace_applicator]: 1.332e-05 [Cycle 2]: 0.00031681, [27] [switch_simplify]: 5.71998e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.039e-05 [with_stream_mark]: 9.51e-06 [recompute_prepare]: 5.08002e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 4.99998e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.83002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.251e-05 [j_node_and_user_rematch]: 8.32998e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.26001e-06 [inline_without_move]: 5.02e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.30999e-06 [cse]: 1.245e-05 [replace_applicator]: 5.31998e-06 [py_interpret_to_execute_after_opt_a]: 1.361e-05 [rewriter_after_opt_a]: 3.707e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 9.72001e-06 [mutable_eliminate]: 0.00055807 [jit_opt_b]: 5.014e-05, [1] [Cycle 1]: 4.34e-05, [2] [frontend_op_eliminate]: 1.621e-05 [inline_after_opt_a]: 1.64e-05 [cconv]: 2.585e-05 [loop_unroll]: 0.00040211 [jit_opt_after_cconv]: 0.00016798, [1] [Cycle 1]: 0.00016184, [11] [c_1]: 2.111e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.32001e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 1.931e-05 [call_graph_tuple_transform]: 1.847e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 5.92001e-06 [add_recomputation]: 5.101e-05 [cse_after_recomputation]: 2.415e-05, [1] [Cycle 1]: 1.871e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.723e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 4.41002e-06 [opt_after_jit_grad]: 0.00043782 [symbol_engine_optimizer]: 7.034e-05, [1] [Cycle 1]: 6.442e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.246e-05 [opt_reshape]: 5.58002e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.00002e-07 [validate]: 3.712e-05 Sums bootstrap : 0.000273s : 0.85% type_inference : 0.027190s : 85.11% event_method : 0.000018s : 0.06% auto_monad : 0.000067s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000094s : 0.29% rewriter_before_opt_a : 0.000079s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000698s : 2.18% jit_opt_a.with_stream_mark : 0.000032s : 0.10% jit_opt_a.recompute_prepare : 0.000012s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001320s : 4.13% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.06% jit_opt_a.cse : 0.000046s : 0.14% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000010s : 0.03% mutable_eliminate : 0.000558s : 1.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000026s : 0.08% loop_unroll : 0.000402s : 1.26% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000438s : 1.37% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.12% Time group info: ------[substitution.] 0.000252 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000005s : 3: substitution.graph_param_transform 87.54% : 0.000221s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000004s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.74% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027120 2 95.05% : 0.025778s : 1: type_inference.infer 4.95% : 0.001342s : 1: type_inference.specialize ------[replace.] 0.000083 6 68.44% : 0.000057s : 4: replace.inline 31.56% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 95.26% : 0.000219s : 4: match.inline 4.74% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.42% : 0.000008s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.47% : 0.000002s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.29% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.54% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000801 13 43.70% : 0.000350s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.71% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.59% : 0.000397s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.089325 72 0.06% : 0.000054s : 1: add_recomputation 0.08% : 0.000070s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.33% : 0.000293s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 64.02% : 0.057183s : 1: jit_opt_a 0.19% : 0.000171s : 1: jit_opt_after_cconv 0.06% : 0.000053s : 1: jit_opt_b 0.46% : 0.000409s : 1: loop_unroll 0.63% : 0.000566s : 1: mutable_eliminate 1.04% : 0.000928s : 26: opt.transform.jit_opt_a 0.05% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000012s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000097s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.93% : 0.000827s : 1: renormalize.infer 0.54% : 0.000484s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000082s : 1: rewriter_before_opt_a 0.08% : 0.000073s : 1: symbol_engine_optimizer 30.46% : 0.027207s : 1: type_inference TotalTime = 0.24658, [30] [bootstrap]: 0.00031369 [type_inference]: 0.234017 [event_method]: 2.67e-05 [auto_monad]: 7.546e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00061512 [rewriter_before_opt_a]: 9.934e-05 [expand_dump_flag]: 4.54002e-06 [jit_opt_a]: 0.00931029, [2] [Cycle 1]: 0.00470303, [27] [switch_simplify]: 6.201e-05 [loop_unroll]: 3.488e-05 [a_1]: 0.00072485 [with_stream_mark]: 1.969e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 4.21001e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.40997e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.0035288 [add_forward_monad_depend]: 5.23002e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.521e-05 [cse]: 3.219e-05 [replace_applicator]: 1.35e-05 [Cycle 2]: 0.00037513, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 6.29999e-06 [a_1]: 0.00012784 [with_stream_mark]: 9.92999e-06 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.98998e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.232e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.28001e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 5.93998e-06 [cse]: 1.333e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.099e-05 [rewriter_after_opt_a]: 3.687e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 4.86002e-06 [mutable_eliminate]: 0.00049819 [jit_opt_b]: 5.468e-05, [1] [Cycle 1]: 4.8e-05, [2] [frontend_op_eliminate]: 1.923e-05 [inline_after_opt_a]: 1.806e-05 [cconv]: 2.396e-05 [loop_unroll]: 0.00041376 [jit_opt_after_cconv]: 0.00015215, [1] [Cycle 1]: 0.0001463, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 2.064e-05 [call_graph_tuple_transform]: 2.048e-05 [tuple_list_get_item_eliminator]: 6.12999e-06 [none_parameter_eliminate]: 1.32e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.663e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 7.13998e-06 [add_recomputation]: 4.954e-05 [cse_after_recomputation]: 2.333e-05, [1] [Cycle 1]: 1.832e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.651e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 4.10998e-06 [opt_after_jit_grad]: 0.00045105 [symbol_engine_optimizer]: 7.618e-05, [1] [Cycle 1]: 6.978e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 8.54e-06 [elim_not_effective]: 1.293e-05 [opt_reshape]: 7.26999e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 3.39991e-07 [validate]: 8.947e-05 Sums bootstrap : 0.000314s : 0.13% type_inference : 0.234017s : 96.79% event_method : 0.000027s : 0.01% auto_monad : 0.000075s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000615s : 0.25% rewriter_before_opt_a : 0.000099s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000853s : 0.35% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003529s : 1.46% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000046s : 0.02% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000498s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000414s : 0.17% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000451s : 0.19% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.04% Time group info: ------[substitution.] 0.000268 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000006s : 4: substitution.graph_param_transform 84.69% : 0.000227s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.84% : 0.000010s : 3: substitution.reduce_eliminate 1.62% : 0.000004s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 3.73% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.233929 2 97.78% : 0.228730s : 1: type_inference.infer 2.22% : 0.005199s : 1: type_inference.specialize ------[replace.] 0.000108 7 61.53% : 0.000066s : 5: replace.inline 38.47% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 7 96.19% : 0.000224s : 5: match.inline 3.81% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.35% : 0.000000s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.51% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000008s : 28: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.16% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.54% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000004s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.84% : 0.000013s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.90% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003092 25 54.53% : 0.001686s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.37% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.10% : 0.001333s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.251225 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000079s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.13% : 0.000323s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 3.71% : 0.009314s : 1: jit_opt_a 0.06% : 0.000155s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.17% : 0.000420s : 1: loop_unroll 0.20% : 0.000505s : 1: mutable_eliminate 0.44% : 0.001096s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000458s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000621s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.04% : 0.002618s : 1: renormalize.infer 0.36% : 0.000902s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.04% : 0.000104s : 1: rewriter_before_opt_a 0.03% : 0.000079s : 1: symbol_engine_optimizer 93.16% : 0.234033s : 1: type_inference TotalTime = 0.0278116, [30] [bootstrap]: 0.00026629 [type_inference]: 0.0197528 [event_method]: 1.97e-05 [auto_monad]: 6.764e-05 [graph_reusing]: 6.44999e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 9.981e-05 [rewriter_before_opt_a]: 8.152e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00533273, [2] [Cycle 1]: 0.00188064, [27] [switch_simplify]: 5.4e-05 [loop_unroll]: 3.026e-05 [a_1]: 0.00053822 [with_stream_mark]: 1.994e-05 [recompute_prepare]: 7.93999e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.14999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.50997e-06 [get_grad_eliminate_]: 5.53997e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 5.76e-06 [renormalize]: 0.00090158 [add_forward_monad_depend]: 6.09999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.725e-05 [cse]: 3.465e-05 [replace_applicator]: 1.299e-05 [Cycle 2]: 0.00032601, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.303e-05 [with_stream_mark]: 9.07001e-06 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 8.05999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.47998e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.317e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.206e-05 [rewriter_after_opt_a]: 3.765e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00059173 [jit_opt_b]: 4.974e-05, [1] [Cycle 1]: 4.24e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.571e-05 [cconv]: 2.691e-05 [loop_unroll]: 0.00042626 [jit_opt_after_cconv]: 0.00014397, [1] [Cycle 1]: 0.00013757, [11] [c_1]: 2.066e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.63003e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.256e-05 [call_graph_tuple_transform]: 1.978e-05 [tuple_list_get_item_eliminator]: 5.72999e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.532e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 6.303e-05 [cse_after_recomputation]: 2.455e-05, [1] [Cycle 1]: 1.895e-05, [1] [cse]: 1.277e-05 [auto_monad_reorder]: 1.762e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.64002e-06 [opt_after_jit_grad]: 0.00046324 [symbol_engine_optimizer]: 7.151e-05, [1] [Cycle 1]: 6.523e-05, [6] [build]: 3.33998e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.305e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 4.19997e-07 [validate]: 3.69e-05 Sums bootstrap : 0.000266s : 1.10% type_inference : 0.019753s : 81.90% event_method : 0.000020s : 0.08% auto_monad : 0.000068s : 0.28% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000100s : 0.41% rewriter_before_opt_a : 0.000082s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.15% jit_opt_a.a_1 : 0.000631s : 2.62% jit_opt_a.with_stream_mark : 0.000029s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000902s : 3.74% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.10% jit_opt_a.cse : 0.000048s : 0.20% jit_opt_a.replace_applicator : 0.000018s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000592s : 2.45% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000027s : 0.11% loop_unroll : 0.000426s : 1.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000063s : 0.26% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000463s : 1.92% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000210 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 83.69% : 0.000175s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 6.03% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019684 2 93.12% : 0.018331s : 1: type_inference.infer 6.88% : 0.001354s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.23% : 0.000048s : 4: replace.inline 30.77% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 93.79% : 0.000173s : 4: match.inline 6.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 6.08% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 2.19% : 0.000003s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000002s : 10: predicate.reshape_eliminate 1.54% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000759 13 44.10% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.71% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.19% : 0.000381s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029617 72 0.22% : 0.000066s : 1: add_recomputation 0.24% : 0.000071s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 0.95% : 0.000281s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.02% : 0.005336s : 1: jit_opt_a 0.50% : 0.000147s : 1: jit_opt_after_cconv 0.18% : 0.000052s : 1: jit_opt_b 1.46% : 0.000434s : 1: loop_unroll 2.03% : 0.000600s : 1: mutable_eliminate 2.86% : 0.000846s : 26: opt.transform.jit_opt_a 0.16% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.59% : 0.000472s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000103s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.69% : 0.000499s : 1: renormalize.infer 1.33% : 0.000393s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000041s : 1: rewriter_after_opt_a 0.29% : 0.000085s : 1: rewriter_before_opt_a 0.25% : 0.000074s : 1: symbol_engine_optimizer 66.75% : 0.019769s : 1: type_inference TotalTime = 0.16002, [30] [bootstrap]: 0.00023647 [type_inference]: 0.127686 [event_method]: 0.00090301 [auto_monad]: 0.00014455 [graph_reusing]: 8.45999e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 4.884e-05 [rewriter_before_opt_a]: 0.00016994 [expand_dump_flag]: 4.59002e-06 [jit_opt_a]: 0.0282504, [3] [Cycle 1]: 0.0204355, [27] [switch_simplify]: 0.00011639 [loop_unroll]: 4.653e-05 [a_1]: 0.00125326 [with_stream_mark]: 4.204e-05 [recompute_prepare]: 2.386e-05 [updatestate_depend_eliminate]: 1.076e-05 [updatestate_assign_eliminate]: 7.61001e-06 [updatestate_loads_eliminate]: 7.64002e-06 [parameter_eliminate]: 3.26999e-06 [specialize_transform]: 1.594e-05 [updatestate_useless_node_eliminater]: 1.386e-05 [accelerated_algorithm]: 1.514e-05 [meta_shard_fg_expand]: 5.47001e-06 [get_grad_eliminate_]: 1.504e-05 [merge_forward]: 1.036e-05 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.01e-05 [j_node_and_user_rematch]: 2.625e-05 [meta_fg_expand]: 0.00219816 [replace_old_param]: 8.002e-05 [inline_without_move]: 6.815e-05 [renormalize]: 0.0156625 [add_forward_monad_depend]: 1.657e-05 [auto_monad_grad]: 7.18998e-06 [auto_monad_eliminator]: 6.513e-05 [cse]: 0.00030305 [replace_applicator]: 9.613e-05 [Cycle 2]: 0.00320877, [27] [switch_simplify]: 4.264e-05 [loop_unroll]: 4.151e-05 [a_1]: 0.00121353 [with_stream_mark]: 1.976e-05 [recompute_prepare]: 7.53999e-06 [updatestate_depend_eliminate]: 5.09998e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.91e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 4.91002e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 0.00014118 [replace_old_param]: 6.85002e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00141949 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 1.654e-05 [cse]: 2.703e-05 [replace_applicator]: 1.447e-05 [Cycle 3]: 0.00031485, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 5.12e-06 [a_1]: 7.088e-05 [with_stream_mark]: 1.202e-05 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.25999e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.3e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 9.23002e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 4.52998e-06 [inline_without_move]: 4.42e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.08998e-06 [cse]: 1.148e-05 [replace_applicator]: 4.95001e-06 [py_interpret_to_execute_after_opt_a]: 1.487e-05 [rewriter_after_opt_a]: 3.738e-05 [convert_after_rewriter]: 6.57002e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00075811 [jit_opt_b]: 4.909e-05, [1] [Cycle 1]: 4.213e-05, [2] [frontend_op_eliminate]: 1.391e-05 [inline_after_opt_a]: 1.596e-05 [cconv]: 2.985e-05 [loop_unroll]: 0.00045406 [jit_opt_after_cconv]: 0.00016191, [1] [Cycle 1]: 0.00015547, [11] [c_1]: 1.9e-05 [parameter_eliminate]: 3.5e-06 [updatestate_depend_eliminate]: 8.12e-06 [updatestate_assign_eliminate]: 2.80997e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.744e-05 [call_graph_tuple_transform]: 2.135e-05 [tuple_list_get_item_eliminator]: 4.85001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.83e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 7.38999e-06 [add_recomputation]: 5.045e-05 [cse_after_recomputation]: 2.479e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.284e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 8.02003e-06 [opt_after_jit_grad]: 0.00051977 [symbol_engine_optimizer]: 7.805e-05, [1] [Cycle 1]: 7.17e-05, [6] [build]: 4.67e-06 [elim_shapecalc]: 6.83998e-06 [elim_not_effective]: 1.247e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 8.65999e-06 [renormalize]: 3.30008e-07 [validate]: 8.659e-05 Sums bootstrap : 0.000236s : 0.15% type_inference : 0.127686s : 82.50% event_method : 0.000903s : 0.58% auto_monad : 0.000145s : 0.09% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000049s : 0.03% rewriter_before_opt_a : 0.000170s : 0.11% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000165s : 0.11% jit_opt_a.loop_unroll : 0.000093s : 0.06% jit_opt_a.a_1 : 0.002538s : 1.64% jit_opt_a.with_stream_mark : 0.000074s : 0.05% jit_opt_a.recompute_prepare : 0.000037s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000027s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002341s : 1.51% jit_opt_a.replace_old_param : 0.000091s : 0.06% jit_opt_a.inline_without_move : 0.000078s : 0.05% jit_opt_a.renormalize : 0.017082s : 11.04% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000088s : 0.06% jit_opt_a.cse : 0.000342s : 0.22% jit_opt_a.replace_applicator : 0.000116s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000758s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000454s : 0.29% jit_opt_after_cconv.c_1 : 0.000019s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000520s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000087s : 0.06% Time group info: ------[substitution.] 0.000775 106 0.26% : 0.000002s : 2: substitution.elim_not_effective 0.24% : 0.000002s : 2: substitution.fold_const_symbol 0.78% : 0.000006s : 2: substitution.graph_param_transform 69.26% : 0.000536s : 13: substitution.inline 2.91% : 0.000023s : 2: substitution.inline_without_move 1.35% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.72% : 0.000013s : 7: substitution.minmaximum_grad 4.49% : 0.000035s : 5: substitution.partial_eliminate 1.45% : 0.000011s : 12: substitution.remove_not_recompute_node 4.68% : 0.000036s : 10: substitution.replace_applicator 0.94% : 0.000007s : 10: substitution.replace_old_param 0.41% : 0.000003s : 1: substitution.set_cell_output_no_recompute 3.33% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.02% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.16% : 0.000048s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127550 2 96.23% : 0.122747s : 1: type_inference.infer 3.77% : 0.004803s : 1: type_inference.specialize ------[replace.] 0.000247 20 67.09% : 0.000166s : 13: replace.inline 32.91% : 0.000081s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000552 20 95.61% : 0.000527s : 13: match.inline 4.39% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000390 2516 1.51% : 0.000006s : 43: predicate.accumulaten_eliminater 0.38% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.38% : 0.000005s : 43: predicate.addn_check_dump 1.56% : 0.000006s : 43: predicate.addn_zero_filter 1.97% : 0.000008s : 43: predicate.arithmetic_simplify 2.15% : 0.000008s : 43: predicate.cast_eliminate 0.12% : 0.000000s : 2: predicate.check_bprop_eliminate 1.31% : 0.000005s : 43: predicate.compare_switch_simplify 1.40% : 0.000005s : 43: predicate.depend_value_elim 1.58% : 0.000006s : 43: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 43: predicate.dict_get_item_eliminator 1.46% : 0.000006s : 43: predicate.dict_set_item_eliminator 0.30% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.12% : 0.000000s : 2: predicate.elim_not_effective 0.11% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000005s : 43: predicate.environ_add_const_eliminate 1.37% : 0.000005s : 43: predicate.environ_get_add_eliminate 1.46% : 0.000006s : 43: predicate.environ_get_depend_swap 1.48% : 0.000006s : 43: predicate.environ_get_eliminate 1.37% : 0.000005s : 43: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.69% : 0.000003s : 16: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.28% : 0.000017s : 67: predicate.inline 2.10% : 0.000008s : 44: predicate.inline_without_move 0.30% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.85% : 0.000003s : 16: predicate.less_batch_normalization 1.69% : 0.000007s : 50: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 52: predicate.load_eliminater 0.46% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.33% : 0.000013s : 91: predicate.loop_unroll_before_grad 1.73% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.39% : 0.000005s : 43: predicate.merge_addn 1.56% : 0.000006s : 43: predicate.minmaximum_grad 0.54% : 0.000002s : 2: predicate.mutable_eliminate 0.12% : 0.000000s : 2: predicate.opt_reshape 2.29% : 0.000009s : 52: predicate.partial_eliminate 1.40% : 0.000005s : 43: predicate.print_const_string_wrapper 2.06% : 0.000008s : 43: predicate.reduce_eliminate 1.82% : 0.000007s : 50: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000002s : 16: predicate.remove_not_recompute_node 2.70% : 0.000011s : 95: predicate.replace_applicator 1.08% : 0.000004s : 44: predicate.replace_old_param 0.12% : 0.000000s : 2: predicate.reset_defer_inline 1.51% : 0.000006s : 43: predicate.reshape_eliminate 1.44% : 0.000006s : 43: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 2: predicate.row_tensor_eliminate 1.99% : 0.000008s : 43: predicate.same_eliminate 0.46% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.26% : 0.000001s : 4: predicate.special_op_eliminate 0.74% : 0.000003s : 16: predicate.specialize_transform 1.81% : 0.000007s : 43: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000006s : 43: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 2: predicate.switch_call_monad_eliminater 3.36% : 0.000013s : 63: predicate.switch_defer_inline 2.48% : 0.000010s : 63: predicate.switch_layer_defer_inline 6.71% : 0.000026s : 156: predicate.switch_simplify 1.47% : 0.000006s : 43: predicate.tile_eliminate 1.46% : 0.000006s : 43: predicate.transpose_eliminate 1.92% : 0.000007s : 43: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 43: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000014s : 54: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 43: predicate.tuple_list_set_item_eliminator 1.72% : 0.000007s : 50: predicate.tuple_to_list_eliminator_ 1.71% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.66% : 0.000010s : 68: predicate.updatestate_useless_node_eliminater 2.04% : 0.000008s : 43: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004347 45 71.41% : 0.003104s : 28: func_graph_cloner_run.FuncGraphClonerGraph 28.59% : 0.001243s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.180352 87 0.03% : 0.000054s : 1: add_recomputation 0.08% : 0.000151s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.14% : 0.000260s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.51% : 0.000917s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.67% : 0.028255s : 1: jit_opt_a 0.09% : 0.000165s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.26% : 0.000463s : 1: loop_unroll 0.43% : 0.000768s : 1: mutable_eliminate 1.81% : 0.003268s : 39: opt.transform.jit_opt_a 0.03% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000529s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000052s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 7.90% : 0.014248s : 2: renormalize.infer 1.56% : 0.002810s : 2: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000174s : 1: rewriter_before_opt_a 0.04% : 0.000080s : 1: symbol_engine_optimizer 70.82% : 0.127723s : 1: type_inference TotalTime = 0.0854085, [30] [bootstrap]: 0.00026525 [type_inference]: 0.0679344 [event_method]: 1.82e-05 [auto_monad]: 6.904e-05 [graph_reusing]: 5.97999e-06 [pre_auto_parallel]: 4.37e-06 [py_interpret_to_execute]: 0.00011935 [rewriter_before_opt_a]: 8.302e-05 [expand_dump_flag]: 3.75998e-06 [jit_opt_a]: 0.0144391, [2] [Cycle 1]: 0.00203698, [27] [switch_simplify]: 6.09e-05 [loop_unroll]: 2.994e-05 [a_1]: 0.00056251 [with_stream_mark]: 2.03e-05 [recompute_prepare]: 7.93999e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00101831 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.664e-05 [replace_applicator]: 1.43e-05 [Cycle 2]: 0.00031729, [27] [switch_simplify]: 6.06e-06 [loop_unroll]: 5.07999e-06 [a_1]: 8.802e-05 [with_stream_mark]: 1.059e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.13002e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.02998e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 7.85e-06 [inline_without_move]: 4.74e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.205e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 1.169e-05 [rewriter_after_opt_a]: 3.777e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00074275 [jit_opt_b]: 4.87e-05, [1] [Cycle 1]: 4.206e-05, [2] [frontend_op_eliminate]: 1.622e-05 [inline_after_opt_a]: 1.521e-05 [cconv]: 2.549e-05 [loop_unroll]: 0.00041116 [jit_opt_after_cconv]: 0.00014625, [1] [Cycle 1]: 0.00013224, [11] [c_1]: 1.999e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 1.973e-05 [call_graph_tuple_transform]: 1.842e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 5.45001e-06 [remove_dup_value]: 1.566e-05 [partial_unused_args_eliminate]: 2.41998e-06 [environ_conv]: 6.21e-06 [add_recomputation]: 5.18e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.855e-05, [1] [cse]: 1.272e-05 [auto_monad_reorder]: 1.873e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 5.55001e-06 [opt_after_jit_grad]: 0.00043872 [symbol_engine_optimizer]: 7.075e-05, [1] [Cycle 1]: 6.478e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 7.94997e-06 [elim_not_effective]: 1.249e-05 [opt_reshape]: 5.46e-06 [fold_const_symbol]: 8.66997e-06 [renormalize]: 4.39992e-07 [validate]: 3.794e-05 Sums bootstrap : 0.000265s : 0.37% type_inference : 0.067934s : 93.63% event_method : 0.000018s : 0.03% auto_monad : 0.000069s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000119s : 0.16% rewriter_before_opt_a : 0.000083s : 0.11% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000651s : 0.90% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001018s : 1.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000049s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000743s : 1.02% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000025s : 0.04% loop_unroll : 0.000411s : 0.57% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000439s : 0.60% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.05% Time group info: ------[substitution.] 0.000228 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 3: substitution.graph_param_transform 84.15% : 0.000192s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 2.46% : 0.000006s : 2: substitution.replace_old_param 5.93% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067855 2 92.09% : 0.062487s : 1: type_inference.infer 7.91% : 0.005367s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.73% : 0.000051s : 4: replace.inline 30.27% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 93.85% : 0.000190s : 4: match.inline 6.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.85% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.49% : 0.000002s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000745 13 46.42% : 0.000346s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.72% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.86% : 0.000357s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.087347 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000072s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.33% : 0.000285s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.21% : 0.000179s : 1: graph_reusing 16.53% : 0.014442s : 1: jit_opt_a 0.17% : 0.000149s : 1: jit_opt_after_cconv 0.06% : 0.000052s : 1: jit_opt_b 0.48% : 0.000419s : 1: loop_unroll 0.86% : 0.000753s : 1: mutable_eliminate 1.00% : 0.000872s : 26: opt.transform.jit_opt_a 0.05% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000009s : 1: pre_auto_parallel 0.14% : 0.000124s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.73% : 0.000634s : 1: renormalize.infer 0.43% : 0.000375s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000087s : 1: rewriter_before_opt_a 0.08% : 0.000073s : 1: symbol_engine_optimizer 77.79% : 0.067951s : 1: type_inference TotalTime = 0.0700613, [30] [bootstrap]: 0.00031705 [type_inference]: 0.0618007 [event_method]: 2.267e-05 [auto_monad]: 7.312e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00010898 [rewriter_before_opt_a]: 8.14e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00561909, [2] [Cycle 1]: 0.00187896, [27] [switch_simplify]: 5.24e-05 [loop_unroll]: 2.922e-05 [a_1]: 0.00052077 [with_stream_mark]: 1.899e-05 [recompute_prepare]: 7.00998e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.07999e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.82999e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 0.00090056 [add_forward_monad_depend]: 5.12e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 4.518e-05 [cse]: 3.345e-05 [replace_applicator]: 1.261e-05 [Cycle 2]: 0.00031283, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 5.14e-06 [a_1]: 8.732e-05 [with_stream_mark]: 9.89999e-06 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 4.93001e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 8.08001e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.13998e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.05999e-06 [cse]: 1.184e-05 [replace_applicator]: 5.31002e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.586e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00049225 [jit_opt_b]: 6.408e-05, [1] [Cycle 1]: 5.776e-05, [2] [frontend_op_eliminate]: 1.46e-05 [inline_after_opt_a]: 3.231e-05 [cconv]: 3.195e-05 [loop_unroll]: 0.00040416 [jit_opt_after_cconv]: 0.00013595, [1] [Cycle 1]: 0.00012996, [11] [c_1]: 1.964e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.77999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.018e-05 [call_graph_tuple_transform]: 1.772e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 1.558e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 4.888e-05 [cse_after_recomputation]: 2.233e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.133e-05 [auto_monad_reorder]: 1.74e-05 [get_jit_bprop_graph]: 1.213e-05 [rewriter_after_jit_bprop_graph]: 5.12e-06 [opt_after_jit_grad]: 0.00043224 [symbol_engine_optimizer]: 7.015e-05, [1] [Cycle 1]: 6.418e-05, [6] [build]: 3.58e-06 [elim_shapecalc]: 7.59002e-06 [elim_not_effective]: 1.236e-05 [opt_reshape]: 5.62999e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 2.80008e-07 [validate]: 3.55e-05 Sums bootstrap : 0.000317s : 0.48% type_inference : 0.061801s : 93.53% event_method : 0.000023s : 0.03% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000109s : 0.16% rewriter_before_opt_a : 0.000081s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.09% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000608s : 0.92% jit_opt_a.with_stream_mark : 0.000029s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000901s : 1.36% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000050s : 0.08% jit_opt_a.cse : 0.000045s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000492s : 0.74% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000032s : 0.05% cconv : 0.000032s : 0.05% loop_unroll : 0.000404s : 0.61% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000012s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000432s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.05% Time group info: ------[substitution.] 0.000204 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 3: substitution.graph_param_transform 84.00% : 0.000171s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000004s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 5.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061721 2 97.34% : 0.060080s : 1: type_inference.infer 2.66% : 0.001641s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.15% : 0.000048s : 4: replace.inline 30.85% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.84% : 0.000169s : 4: match.inline 6.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.00% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000008s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000848 13 44.55% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.75% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.70% : 0.000430s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071847 72 0.07% : 0.000052s : 1: add_recomputation 0.11% : 0.000077s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.46% : 0.000333s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000014s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.82% : 0.005622s : 1: jit_opt_a 0.19% : 0.000138s : 1: jit_opt_after_cconv 0.09% : 0.000066s : 1: jit_opt_b 0.57% : 0.000412s : 1: loop_unroll 0.70% : 0.000501s : 1: mutable_eliminate 1.13% : 0.000814s : 26: opt.transform.jit_opt_a 0.06% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000041s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000440s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000112s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.72% : 0.000520s : 1: renormalize.infer 0.52% : 0.000372s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.12% : 0.000085s : 1: rewriter_before_opt_a 0.10% : 0.000073s : 1: symbol_engine_optimizer 86.05% : 0.061822s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.492.408 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004de50> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.493.047 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.268156, [30] [bootstrap]: 0.00031396 [type_inference]: 0.239722 [event_method]: 2.581e-05 [auto_monad]: 7.27e-05 [graph_reusing]: 6.48998e-06 [pre_auto_parallel]: 2.70997e-06 [py_interpret_to_execute]: 0.00059484 [rewriter_before_opt_a]: 9.786e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.0247944, [2] [Cycle 1]: 0.0205935, [27] [switch_simplify]: 6.417e-05 [loop_unroll]: 3.457e-05 [a_1]: 0.00075516 [with_stream_mark]: 2.21e-05 [recompute_prepare]: 9.76e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 7.81001e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 6.53003e-06 [merge_forward]: 3.87002e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.089e-05 [inline_without_move]: 6.82002e-06 [renormalize]: 0.0193338 [add_forward_monad_depend]: 9.72999e-06 [auto_monad_grad]: 2.75002e-06 [auto_monad_eliminator]: 2.052e-05 [cse]: 3.699e-05 [replace_applicator]: 2.091e-05 [Cycle 2]: 0.00040279, [27] [switch_simplify]: 8.47e-06 [loop_unroll]: 7.47002e-06 [a_1]: 0.00013576 [with_stream_mark]: 1.328e-05 [recompute_prepare]: 6.56999e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 3.74002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.93998e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 6.67002e-06 [cse]: 1.536e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.618e-05 [rewriter_after_opt_a]: 4.136e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00078665 [jit_opt_b]: 5.698e-05, [1] [Cycle 1]: 4.979e-05, [2] [frontend_op_eliminate]: 2.02e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 2.705e-05 [loop_unroll]: 0.00044797 [jit_opt_after_cconv]: 0.00016074, [1] [Cycle 1]: 0.00015439, [11] [c_1]: 2.691e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.612e-05 [call_graph_tuple_transform]: 2.095e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.52001e-06 [remove_dup_value]: 1.837e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 6.144e-05 [cse_after_recomputation]: 2.563e-05, [1] [Cycle 1]: 2.027e-05, [1] [cse]: 1.43e-05 [auto_monad_reorder]: 1.772e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00045503 [symbol_engine_optimizer]: 7.698e-05, [1] [Cycle 1]: 7.132e-05, [6] [build]: 3.23998e-06 [elim_shapecalc]: 9.42999e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 9.95997e-06 [renormalize]: 3.80009e-07 [validate]: 0.00011113 Sums bootstrap : 0.000314s : 0.12% type_inference : 0.239722s : 90.89% event_method : 0.000026s : 0.01% auto_monad : 0.000073s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000595s : 0.23% rewriter_before_opt_a : 0.000098s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000891s : 0.34% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.019334s : 7.33% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000052s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000787s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000448s : 0.17% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000061s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.17% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000111s : 0.04% Time group info: ------[substitution.] 0.000303 25 0.51% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 1.80% : 0.000005s : 4: substitution.graph_param_transform 88.42% : 0.000268s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000005s : 2: substitution.replace_old_param 4.00% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.239626 2 98.18% : 0.235266s : 1: type_inference.infer 1.82% : 0.004360s : 1: type_inference.specialize ------[replace.] 0.000113 7 67.54% : 0.000077s : 5: replace.inline 32.46% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 7 96.01% : 0.000264s : 5: match.inline 3.99% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 2.22% : 0.000003s : 13: predicate.arithmetic_simplify 1.41% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.49% : 0.000002s : 13: predicate.environ_get_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.15% : 0.000008s : 28: predicate.inline 1.00% : 0.000002s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 2.00% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 19: predicate.partial_eliminate 1.47% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.65% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.57% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.84% : 0.000010s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.52% : 0.000002s : 13: predicate.transpose_eliminate 1.75% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.72% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.82% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003203 25 52.23% : 0.001673s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.83% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.94% : 0.001439s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.288641 72 0.02% : 0.000064s : 1: add_recomputation 0.03% : 0.000077s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000334s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 8.59% : 0.024799s : 1: jit_opt_a 0.06% : 0.000163s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.16% : 0.000455s : 1: loop_unroll 0.28% : 0.000794s : 1: mutable_eliminate 0.40% : 0.001156s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000462s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000601s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 6.18% : 0.017826s : 1: renormalize.infer 0.52% : 0.001495s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000102s : 1: rewriter_before_opt_a 0.03% : 0.000079s : 1: symbol_engine_optimizer 83.06% : 0.239742s : 1: type_inference TotalTime = 0.160486, [30] [bootstrap]: 0.00029945 [type_inference]: 0.0695515 [event_method]: 2.077e-05 [auto_monad]: 6.574e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00022943 [rewriter_before_opt_a]: 0.0802074 [expand_dump_flag]: 1.221e-05 [jit_opt_a]: 0.00717466, [2] [Cycle 1]: 0.00313228, [27] [switch_simplify]: 5.605e-05 [loop_unroll]: 7.17e-05 [a_1]: 0.00061162 [with_stream_mark]: 2.181e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.62999e-06 [inline_without_move]: 6.46999e-06 [renormalize]: 0.00202987 [add_forward_monad_depend]: 5.30999e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.629e-05 [cse]: 3.211e-05 [replace_applicator]: 1.306e-05 [Cycle 2]: 0.00035869, [27] [switch_simplify]: 6.41998e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00011822 [with_stream_mark]: 9.82999e-06 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 2.82002e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.61998e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.363e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 6.02999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.248e-05 [replace_applicator]: 6.68998e-06 [py_interpret_to_execute_after_opt_a]: 1.134e-05 [rewriter_after_opt_a]: 3.757e-05 [convert_after_rewriter]: 7.69002e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00062741 [jit_opt_b]: 0.00068159, [1] [Cycle 1]: 0.00067169, [2] [frontend_op_eliminate]: 1.839e-05 [inline_after_opt_a]: 1.712e-05 [cconv]: 2.939e-05 [loop_unroll]: 0.00045671 [jit_opt_after_cconv]: 0.00014687, [1] [Cycle 1]: 0.00014042, [11] [c_1]: 2.489e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.052e-05 [call_graph_tuple_transform]: 2.001e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.504e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 9.07999e-06 [add_recomputation]: 4.943e-05 [cse_after_recomputation]: 2.102e-05, [1] [Cycle 1]: 1.597e-05, [1] [cse]: 1.056e-05 [auto_monad_reorder]: 1.51e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.00045053 [symbol_engine_optimizer]: 8.59e-05, [1] [Cycle 1]: 8.003e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 7.45e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 2.398e-05 [renormalize]: 3.4002e-07 [validate]: 4.526e-05 Sums bootstrap : 0.000299s : 0.19% type_inference : 0.069551s : 44.71% event_method : 0.000021s : 0.01% auto_monad : 0.000066s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000229s : 0.15% rewriter_before_opt_a : 0.080207s : 51.56% expand_dump_flag : 0.000012s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000078s : 0.05% jit_opt_a.a_1 : 0.000730s : 0.47% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002030s : 1.30% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000627s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000457s : 0.29% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000451s : 0.29% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000024s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000242 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 4: substitution.graph_param_transform 86.07% : 0.000208s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069472 2 97.46% : 0.067707s : 1: type_inference.infer 2.54% : 0.001765s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.28% : 0.000051s : 4: replace.inline 31.72% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.83% : 0.000206s : 4: match.inline 5.17% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.56% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000009s : 58: predicate.switch_simplify 1.42% : 0.000002s : 12: predicate.tile_eliminate 1.35% : 0.000002s : 12: predicate.transpose_eliminate 1.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002115 26 71.44% : 0.001511s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.51% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.05% : 0.000551s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.163581 72 0.03% : 0.000052s : 1: add_recomputation 0.04% : 0.000069s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.19% : 0.000314s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000018s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.39% : 0.007178s : 1: jit_opt_a 0.09% : 0.000149s : 1: jit_opt_after_cconv 0.42% : 0.000685s : 1: jit_opt_b 0.28% : 0.000464s : 1: loop_unroll 0.39% : 0.000636s : 1: mutable_eliminate 0.61% : 0.001000s : 26: opt.transform.jit_opt_a 0.03% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000458s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000235s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.85% : 0.001392s : 1: renormalize.infer 0.38% : 0.000629s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 49.05% : 0.080238s : 1: rewriter_before_opt_a 0.05% : 0.000088s : 1: symbol_engine_optimizer 42.53% : 0.069568s : 1: type_inference TotalTime = 0.0393791, [30] [bootstrap]: 0.00035767 [type_inference]: 0.0289483 [event_method]: 2.338e-05 [auto_monad]: 7.543e-05 [graph_reusing]: 5.98998e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 0.00017034 [rewriter_before_opt_a]: 8.519e-05 [expand_dump_flag]: 3.37997e-06 [jit_opt_a]: 0.00716596, [2] [Cycle 1]: 0.00270058, [27] [switch_simplify]: 6.51e-05 [loop_unroll]: 3.116e-05 [a_1]: 0.00061015 [with_stream_mark]: 1.998e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 0.00163089 [add_forward_monad_depend]: 4.84e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.417e-05 [cse]: 3.595e-05 [replace_applicator]: 1.275e-05 [Cycle 2]: 0.00036402, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 5.15999e-06 [a_1]: 0.00011973 [with_stream_mark]: 1.027e-05 [recompute_prepare]: 6.00002e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.61003e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.327e-05 [j_node_and_user_rematch]: 8.17998e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 6.56999e-06 [cse]: 1.549e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.293e-05 [rewriter_after_opt_a]: 3.964e-05 [convert_after_rewriter]: 2.076e-05 [order_py_execute_after_rewriter]: 5.79e-06 [mutable_eliminate]: 0.00070355 [jit_opt_b]: 5.326e-05, [1] [Cycle 1]: 4.626e-05, [2] [frontend_op_eliminate]: 1.776e-05 [inline_after_opt_a]: 1.65e-05 [cconv]: 3.02e-05 [loop_unroll]: 0.00047445 [jit_opt_after_cconv]: 0.00016633, [1] [Cycle 1]: 0.00015889, [11] [c_1]: 2.449e-05 [parameter_eliminate]: 3.68999e-06 [updatestate_depend_eliminate]: 6.91001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 4.15e-06 [cse]: 2.97e-05 [call_graph_tuple_transform]: 2.248e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.985e-05 [partial_unused_args_eliminate]: 2.30002e-06 [environ_conv]: 6.59999e-06 [add_recomputation]: 5.597e-05 [cse_after_recomputation]: 2.737e-05, [1] [Cycle 1]: 2.17e-05, [1] [cse]: 1.51e-05 [auto_monad_reorder]: 1.789e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 7.77002e-06 [opt_after_jit_grad]: 0.00051107 [symbol_engine_optimizer]: 8.716e-05, [1] [Cycle 1]: 7.747e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 9.98002e-06 [elim_not_effective]: 1.458e-05 [opt_reshape]: 8.06001e-06 [fold_const_symbol]: 1.02e-05 [renormalize]: 4.19997e-07 [validate]: 5.087e-05 Sums bootstrap : 0.000358s : 1.03% type_inference : 0.028948s : 83.64% event_method : 0.000023s : 0.07% auto_monad : 0.000075s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000170s : 0.49% rewriter_before_opt_a : 0.000085s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.21% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000730s : 2.11% jit_opt_a.with_stream_mark : 0.000030s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001631s : 4.71% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000051s : 0.15% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000040s : 0.11% convert_after_rewriter : 0.000021s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000704s : 2.03% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000030s : 0.09% loop_unroll : 0.000474s : 1.37% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.16% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000511s : 1.48% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.15% Time group info: ------[substitution.] 0.000248 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 85.83% : 0.000213s : 4: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000005s : 4: substitution.remove_not_recompute_node 1.53% : 0.000004s : 2: substitution.replace_old_param 5.50% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028857 2 92.22% : 0.026612s : 1: type_inference.infer 7.78% : 0.002245s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.70% : 0.000059s : 4: replace.inline 31.30% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.39% : 0.000210s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.50% : 0.000002s : 10: predicate.addn_zero_filter 2.16% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000002s : 10: predicate.environ_get_eliminate 1.24% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.10% : 0.000006s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.31% : 0.000002s : 10: predicate.minmaximum_grad 2.79% : 0.000003s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 1.21% : 0.000002s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 53: predicate.switch_simplify 1.43% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001165 13 45.85% : 0.000534s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.99% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.16% : 0.000584s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041978 72 0.14% : 0.000059s : 1: add_recomputation 0.19% : 0.000079s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.90% : 0.000376s : 1: bootstrap 0.08% : 0.000033s : 1: cconv 0.06% : 0.000023s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.08% : 0.007170s : 1: jit_opt_a 0.40% : 0.000170s : 1: jit_opt_after_cconv 0.13% : 0.000056s : 1: jit_opt_b 1.15% : 0.000483s : 1: loop_unroll 1.70% : 0.000715s : 1: mutable_eliminate 2.28% : 0.000959s : 26: opt.transform.jit_opt_a 0.13% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.24% : 0.000520s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000174s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000022s : 1: remove_dup_value 2.38% : 0.000997s : 1: renormalize.infer 1.49% : 0.000626s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.21% : 0.000089s : 1: rewriter_before_opt_a 0.21% : 0.000090s : 1: symbol_engine_optimizer 69.01% : 0.028970s : 1: type_inference TotalTime = 0.168745, [30] [bootstrap]: 0.00026639 [type_inference]: 0.138648 [event_method]: 0.00060955 [auto_monad]: 0.00016228 [graph_reusing]: 7.31001e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 4.938e-05 [rewriter_before_opt_a]: 0.00013508 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.0265252, [3] [Cycle 1]: 0.0196182, [27] [switch_simplify]: 0.00010995 [loop_unroll]: 4.594e-05 [a_1]: 0.0011431 [with_stream_mark]: 6.168e-05 [recompute_prepare]: 2.425e-05 [updatestate_depend_eliminate]: 1.023e-05 [updatestate_assign_eliminate]: 7.61001e-06 [updatestate_loads_eliminate]: 7.02002e-06 [parameter_eliminate]: 2.83003e-06 [specialize_transform]: 1.597e-05 [updatestate_useless_node_eliminater]: 1.506e-05 [accelerated_algorithm]: 1.494e-05 [meta_shard_fg_expand]: 5.94999e-06 [get_grad_eliminate_]: 1.571e-05 [merge_forward]: 9.72001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.977e-05 [j_node_and_user_rematch]: 2.83e-05 [meta_fg_expand]: 0.00207901 [replace_old_param]: 7.709e-05 [inline_without_move]: 6.304e-05 [renormalize]: 0.0151003 [add_forward_monad_depend]: 1.225e-05 [auto_monad_grad]: 7.08998e-06 [auto_monad_eliminator]: 8.728e-05 [cse]: 0.00028423 [replace_applicator]: 8.998e-05 [Cycle 2]: 0.00272425, [27] [switch_simplify]: 4.305e-05 [loop_unroll]: 4.046e-05 [a_1]: 0.00111879 [with_stream_mark]: 1.575e-05 [recompute_prepare]: 6.86999e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 4.89998e-06 [updatestate_useless_node_eliminater]: 4.79998e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.46999e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 0.00012963 [replace_old_param]: 5.68997e-06 [inline_without_move]: 4.97e-06 [renormalize]: 0.00108355 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.34998e-06 [auto_monad_eliminator]: 1.139e-05 [cse]: 2.099e-05 [replace_applicator]: 1.205e-05 [Cycle 3]: 0.00029393, [27] [switch_simplify]: 5.33002e-06 [loop_unroll]: 4.74e-06 [a_1]: 6.672e-05 [with_stream_mark]: 8.76002e-06 [recompute_prepare]: 4.67e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 4.32e-06 [accelerated_algorithm]: 4.65999e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.40999e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.288e-05 [j_node_and_user_rematch]: 7.77e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 4.07998e-06 [inline_without_move]: 4.17e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 1.055e-05 [replace_applicator]: 4.68999e-06 [py_interpret_to_execute_after_opt_a]: 1.258e-05 [rewriter_after_opt_a]: 7.027e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00067767 [jit_opt_b]: 4.702e-05, [1] [Cycle 1]: 3.976e-05, [2] [frontend_op_eliminate]: 1.313e-05 [inline_after_opt_a]: 1.533e-05 [cconv]: 2.42e-05 [loop_unroll]: 0.00040756 [jit_opt_after_cconv]: 0.00013951, [1] [Cycle 1]: 0.00013292, [11] [c_1]: 1.763e-05 [parameter_eliminate]: 2.30002e-06 [updatestate_depend_eliminate]: 5.88998e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 1.928e-05 [call_graph_tuple_transform]: 1.776e-05 [tuple_list_get_item_eliminator]: 5.19e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 4.58001e-06 [remove_dup_value]: 1.633e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 7.488e-05 [cse_after_recomputation]: 5.643e-05, [1] [Cycle 1]: 5.102e-05, [1] [cse]: 4.381e-05 [auto_monad_reorder]: 1.522e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00045419 [symbol_engine_optimizer]: 9.343e-05, [1] [Cycle 1]: 8.734e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 2.938e-05 [opt_reshape]: 6.07001e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 6.80011e-07 [validate]: 3.559e-05 Sums bootstrap : 0.000266s : 0.16% type_inference : 0.138648s : 84.54% event_method : 0.000610s : 0.37% auto_monad : 0.000162s : 0.10% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000049s : 0.03% rewriter_before_opt_a : 0.000135s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000158s : 0.10% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002329s : 1.42% jit_opt_a.with_stream_mark : 0.000086s : 0.05% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.01% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002210s : 1.35% jit_opt_a.replace_old_param : 0.000087s : 0.05% jit_opt_a.inline_without_move : 0.000072s : 0.04% jit_opt_a.renormalize : 0.016184s : 9.87% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000104s : 0.06% jit_opt_a.cse : 0.000316s : 0.19% jit_opt_a.replace_applicator : 0.000107s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000070s : 0.04% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000678s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000408s : 0.25% jit_opt_after_cconv.c_1 : 0.000018s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000075s : 0.05% cse_after_recomputation.cse : 0.000044s : 0.03% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000454s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000029s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.02% Time group info: ------[substitution.] 0.000678 106 0.31% : 0.000002s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 0.78% : 0.000005s : 2: substitution.graph_param_transform 68.69% : 0.000466s : 13: substitution.inline 2.83% : 0.000019s : 2: substitution.inline_without_move 1.52% : 0.000010s : 12: substitution.j_node_and_user_rematch 4.24% : 0.000029s : 7: substitution.minmaximum_grad 1.29% : 0.000009s : 5: substitution.partial_eliminate 1.54% : 0.000010s : 12: substitution.remove_not_recompute_node 4.60% : 0.000031s : 10: substitution.replace_applicator 0.90% : 0.000006s : 10: substitution.replace_old_param 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 3.46% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.29% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.88% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.138539 2 96.61% : 0.133837s : 1: type_inference.infer 3.39% : 0.004702s : 1: type_inference.specialize ------[replace.] 0.000210 20 65.47% : 0.000137s : 13: replace.inline 34.53% : 0.000072s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000481 20 95.23% : 0.000458s : 13: match.inline 4.77% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000368 2516 1.53% : 0.000006s : 43: predicate.accumulaten_eliminater 0.34% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.43% : 0.000005s : 43: predicate.addn_check_dump 1.53% : 0.000006s : 43: predicate.addn_zero_filter 2.08% : 0.000008s : 43: predicate.arithmetic_simplify 1.61% : 0.000006s : 43: predicate.cast_eliminate 0.11% : 0.000000s : 2: predicate.check_bprop_eliminate 1.43% : 0.000005s : 43: predicate.compare_switch_simplify 1.53% : 0.000006s : 43: predicate.depend_value_elim 1.43% : 0.000005s : 43: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 43: predicate.dict_get_item_eliminator 1.48% : 0.000005s : 43: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.12% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.60% : 0.000006s : 43: predicate.environ_add_const_eliminate 1.44% : 0.000005s : 43: predicate.environ_get_add_eliminate 1.42% : 0.000005s : 43: predicate.environ_get_depend_swap 1.54% : 0.000006s : 43: predicate.environ_get_eliminate 1.43% : 0.000005s : 43: predicate.environ_get_set_eliminate 0.06% : 0.000000s : 2: predicate.fold_const_symbol 0.76% : 0.000003s : 16: predicate.get_grad_eliminate 0.11% : 0.000000s : 2: predicate.graph_param_transform 4.19% : 0.000015s : 67: predicate.inline 2.05% : 0.000008s : 44: predicate.inline_without_move 0.31% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 16: predicate.less_batch_normalization 1.80% : 0.000007s : 50: predicate.list_to_tuple_eliminator_ 2.05% : 0.000008s : 52: predicate.load_eliminater 0.35% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.40% : 0.000012s : 91: predicate.loop_unroll_before_grad 1.82% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.44% : 0.000005s : 43: predicate.merge_addn 1.59% : 0.000006s : 43: predicate.minmaximum_grad 0.40% : 0.000001s : 2: predicate.mutable_eliminate 0.16% : 0.000001s : 2: predicate.opt_reshape 2.39% : 0.000009s : 52: predicate.partial_eliminate 1.47% : 0.000005s : 43: predicate.print_const_string_wrapper 1.97% : 0.000007s : 43: predicate.reduce_eliminate 1.79% : 0.000007s : 50: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 16: predicate.remove_not_recompute_node 2.76% : 0.000010s : 95: predicate.replace_applicator 1.04% : 0.000004s : 44: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.52% : 0.000006s : 43: predicate.reshape_eliminate 1.65% : 0.000006s : 43: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 2: predicate.row_tensor_eliminate 1.47% : 0.000005s : 43: predicate.same_eliminate 0.42% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 4: predicate.special_op_eliminate 0.88% : 0.000003s : 16: predicate.specialize_transform 1.75% : 0.000006s : 43: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 43: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 2: predicate.switch_call_monad_eliminater 3.00% : 0.000011s : 63: predicate.switch_defer_inline 2.51% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.59% : 0.000024s : 156: predicate.switch_simplify 1.51% : 0.000006s : 43: predicate.tile_eliminate 1.58% : 0.000006s : 43: predicate.transpose_eliminate 2.07% : 0.000008s : 43: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000006s : 43: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000013s : 54: predicate.tuple_list_get_item_eliminator 1.86% : 0.000007s : 43: predicate.tuple_list_set_item_eliminator 1.84% : 0.000007s : 50: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.77% : 0.000010s : 68: predicate.updatestate_useless_node_eliminater 1.84% : 0.000007s : 43: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.24% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004161 45 74.67% : 0.003107s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.33% : 0.001054s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.188004 87 0.04% : 0.000078s : 1: add_recomputation 0.09% : 0.000169s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.15% : 0.000286s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000059s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.33% : 0.000618s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.11% : 0.026529s : 1: jit_opt_a 0.08% : 0.000142s : 1: jit_opt_after_cconv 0.03% : 0.000049s : 1: jit_opt_b 0.22% : 0.000415s : 1: loop_unroll 0.36% : 0.000686s : 1: mutable_eliminate 1.61% : 0.003031s : 39: opt.transform.jit_opt_a 0.02% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000022s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000462s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000052s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 7.23% : 0.013588s : 2: renormalize.infer 1.37% : 0.002577s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000074s : 1: rewriter_after_opt_a 0.07% : 0.000138s : 1: rewriter_before_opt_a 0.05% : 0.000096s : 1: symbol_engine_optimizer 73.75% : 0.138660s : 1: type_inference TotalTime = 0.148984, [30] [bootstrap]: 0.00032595 [type_inference]: 0.140364 [event_method]: 1.895e-05 [auto_monad]: 6.467e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 9.952e-05 [rewriter_before_opt_a]: 7.7e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00581328, [2] [Cycle 1]: 0.00200709, [27] [switch_simplify]: 5.758e-05 [loop_unroll]: 2.909e-05 [a_1]: 0.00054816 [with_stream_mark]: 2.226e-05 [recompute_prepare]: 7.45e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00100946 [add_forward_monad_depend]: 5.81e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.481e-05 [cse]: 3.703e-05 [replace_applicator]: 1.314e-05 [Cycle 2]: 0.0003168, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 4.99e-06 [a_1]: 8.794e-05 [with_stream_mark]: 9.61e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.91999e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.24e-05 [j_node_and_user_rematch]: 8.09002e-06 [meta_fg_expand]: 1.76998e-06 [replace_old_param]: 7.17002e-06 [inline_without_move]: 4.84e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.326e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.411e-05 [rewriter_after_opt_a]: 3.952e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.00058545 [jit_opt_b]: 4.904e-05, [1] [Cycle 1]: 4.12e-05, [2] [frontend_op_eliminate]: 1.478e-05 [inline_after_opt_a]: 1.556e-05 [cconv]: 2.722e-05 [loop_unroll]: 0.00042608 [jit_opt_after_cconv]: 0.00015077, [1] [Cycle 1]: 0.0001446, [11] [c_1]: 1.995e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 7.02002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 2.852e-05 [call_graph_tuple_transform]: 1.862e-05 [tuple_list_get_item_eliminator]: 5.54998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 5.061e-05 [cse_after_recomputation]: 2.199e-05, [1] [Cycle 1]: 1.688e-05, [1] [cse]: 1.152e-05 [auto_monad_reorder]: 1.728e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 5.37999e-06 [opt_after_jit_grad]: 0.00048164 [symbol_engine_optimizer]: 7.182e-05, [1] [Cycle 1]: 6.609e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 7.59002e-06 [elim_not_effective]: 1.279e-05 [opt_reshape]: 5.83002e-06 [fold_const_symbol]: 8.73001e-06 [renormalize]: 5.10016e-07 [validate]: 4.06e-05 Sums bootstrap : 0.000326s : 0.22% type_inference : 0.140364s : 96.87% event_method : 0.000019s : 0.01% auto_monad : 0.000065s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000100s : 0.07% rewriter_before_opt_a : 0.000077s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.04% jit_opt_a.loop_unroll : 0.000034s : 0.02% jit_opt_a.a_1 : 0.000636s : 0.44% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001010s : 0.70% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000585s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000426s : 0.29% jit_opt_after_cconv.c_1 : 0.000020s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000482s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000225 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 3: substitution.graph_param_transform 85.13% : 0.000192s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000004s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.140294 2 99.00% : 0.138885s : 1: type_inference.infer 1.00% : 0.001409s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.46% : 0.000048s : 4: replace.inline 31.54% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.37% : 0.000189s : 4: match.inline 5.63% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.19% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.81% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 2.11% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.83% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000859 13 50.53% : 0.000434s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.37% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.10% : 0.000379s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.150890 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000068s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000346s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 3.85% : 0.005817s : 1: jit_opt_a 0.10% : 0.000154s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.29% : 0.000434s : 1: loop_unroll 0.39% : 0.000595s : 1: mutable_eliminate 0.56% : 0.000848s : 26: opt.transform.jit_opt_a 0.03% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000103s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.42% : 0.000637s : 1: renormalize.infer 0.24% : 0.000365s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000081s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 93.04% : 0.140385s : 1: type_inference TotalTime = 0.084138, [30] [bootstrap]: 0.00041415 [type_inference]: 0.0453862 [event_method]: 2.177e-05 [auto_monad]: 6.694e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.0001024 [rewriter_before_opt_a]: 8.037e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0358276, [2] [Cycle 1]: 0.00326222, [27] [switch_simplify]: 6.409e-05 [loop_unroll]: 3.181e-05 [a_1]: 0.00078316 [with_stream_mark]: 2.194e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.397e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.98998e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00195565 [add_forward_monad_depend]: 5.25001e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.466e-05 [cse]: 3.654e-05 [replace_applicator]: 1.178e-05 [Cycle 2]: 0.00031538, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.06002e-06 [a_1]: 8.845e-05 [with_stream_mark]: 8.27e-06 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.09998e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.265e-05 [j_node_and_user_rematch]: 7.80998e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 7.4e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.297e-05 [replace_applicator]: 5.35001e-06 [py_interpret_to_execute_after_opt_a]: 1.341e-05 [rewriter_after_opt_a]: 3.78e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00059518 [jit_opt_b]: 5.175e-05, [1] [Cycle 1]: 4.401e-05, [2] [frontend_op_eliminate]: 1.617e-05 [inline_after_opt_a]: 1.631e-05 [cconv]: 2.795e-05 [loop_unroll]: 0.00045237 [jit_opt_after_cconv]: 0.0001471, [1] [Cycle 1]: 0.00014055, [11] [c_1]: 2.273e-05 [parameter_eliminate]: 2.48002e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.158e-05 [call_graph_tuple_transform]: 1.933e-05 [tuple_list_get_item_eliminator]: 5.91003e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.88002e-06 [remove_dup_value]: 1.543e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 5.48002e-06 [add_recomputation]: 5.085e-05 [cse_after_recomputation]: 2.54e-05, [1] [Cycle 1]: 1.984e-05, [1] [cse]: 1.376e-05 [auto_monad_reorder]: 1.919e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 4.45999e-06 [opt_after_jit_grad]: 0.00046227 [symbol_engine_optimizer]: 7.179e-05, [1] [Cycle 1]: 6.561e-05, [6] [build]: 4.00998e-06 [elim_shapecalc]: 7.67002e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.54998e-06 [renormalize]: 4.19997e-07 [validate]: 3.682e-05 Sums bootstrap : 0.000414s : 0.81% type_inference : 0.045386s : 88.60% event_method : 0.000022s : 0.04% auto_monad : 0.000067s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000102s : 0.20% rewriter_before_opt_a : 0.000080s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.14% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000872s : 1.70% jit_opt_a.with_stream_mark : 0.000030s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001956s : 3.82% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000050s : 0.10% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000595s : 1.16% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000452s : 0.88% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000051s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000462s : 0.90% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000433 23 0.43% : 0.000002s : 2: substitution.elim_not_effective 0.29% : 0.000001s : 2: substitution.fold_const_symbol 1.26% : 0.000005s : 3: substitution.graph_param_transform 92.10% : 0.000399s : 4: substitution.inline 0.84% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.95% : 0.000004s : 4: substitution.remove_not_recompute_node 1.11% : 0.000005s : 2: substitution.replace_old_param 3.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045314 2 96.95% : 0.043931s : 1: type_inference.infer 3.05% : 0.001383s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.99% : 0.000055s : 4: replace.inline 30.01% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000408 6 97.10% : 0.000396s : 4: match.inline 2.90% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.48% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.44% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.14% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.44% : 0.000002s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000009s : 53: predicate.switch_simplify 1.52% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000906 13 46.45% : 0.000421s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.35% : 0.000085s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.20% : 0.000401s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.087243 72 0.07% : 0.000064s : 1: add_recomputation 0.08% : 0.000070s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.50% : 0.000436s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 41.07% : 0.035831s : 1: jit_opt_a 0.17% : 0.000149s : 1: jit_opt_after_cconv 0.06% : 0.000054s : 1: jit_opt_b 0.53% : 0.000461s : 1: loop_unroll 0.69% : 0.000604s : 1: mutable_eliminate 1.25% : 0.001094s : 26: opt.transform.jit_opt_a 0.06% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000470s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000106s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.76% : 0.001533s : 1: renormalize.infer 0.48% : 0.000415s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000084s : 1: rewriter_before_opt_a 0.09% : 0.000074s : 1: symbol_engine_optimizer 52.04% : 0.045404s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.735.554 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004db80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.736.227 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0127391, [30] [bootstrap]: 0.00029426 [type_inference]: 0.00499595 [event_method]: 1.663e-05 [auto_monad]: 6.742e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 3.672e-05 [rewriter_before_opt_a]: 7.317e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.00515449, [2] [Cycle 1]: 0.00157051, [27] [switch_simplify]: 5.233e-05 [loop_unroll]: 3.073e-05 [a_1]: 0.00052262 [with_stream_mark]: 1.848e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 3.54002e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.36998e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.06002e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.629e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 0.00061577 [add_forward_monad_depend]: 6.23998e-06 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 1.496e-05 [cse]: 2.902e-05 [replace_applicator]: 1.205e-05 [Cycle 2]: 0.00031169, [27] [switch_simplify]: 5.20001e-06 [loop_unroll]: 4.72998e-06 [a_1]: 8.808e-05 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 4.85001e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.77e-06 [accelerated_algorithm]: 4.62e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.70997e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.44e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.015e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.134e-05 [rewriter_after_opt_a]: 3.484e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00051114 [jit_opt_b]: 4.805e-05, [1] [Cycle 1]: 4.119e-05, [2] [frontend_op_eliminate]: 1.485e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 2.76e-05 [loop_unroll]: 0.00047696 [jit_opt_after_cconv]: 0.00013793, [1] [Cycle 1]: 0.00013152, [11] [c_1]: 1.967e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 6.44999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.05002e-06 [cse]: 1.919e-05 [call_graph_tuple_transform]: 1.869e-05 [tuple_list_get_item_eliminator]: 5.20001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 5.22999e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 5.67001e-06 [add_recomputation]: 5.756e-05 [cse_after_recomputation]: 2.127e-05, [1] [Cycle 1]: 1.569e-05, [1] [cse]: 9.77999e-06 [auto_monad_reorder]: 1.561e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.55999e-06 [opt_after_jit_grad]: 0.00043466 [symbol_engine_optimizer]: 6.899e-05, [1] [Cycle 1]: 6.341e-05, [6] [build]: 3.11999e-06 [elim_shapecalc]: 7.28e-06 [elim_not_effective]: 1.269e-05 [opt_reshape]: 5.25999e-06 [fold_const_symbol]: 8.33001e-06 [renormalize]: 3.39991e-07 [validate]: 3.565e-05 Sums bootstrap : 0.000294s : 3.31% type_inference : 0.004996s : 56.11% event_method : 0.000017s : 0.19% auto_monad : 0.000067s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.41% rewriter_before_opt_a : 0.000073s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000611s : 6.86% jit_opt_a.with_stream_mark : 0.000028s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000616s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000039s : 0.44% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000035s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000511s : 5.74% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000028s : 0.31% loop_unroll : 0.000477s : 5.36% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000058s : 0.65% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000435s : 4.88% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.40% Time group info: ------[substitution.] 0.000199 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 83.49% : 0.000166s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 6.00% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004933 2 82.71% : 0.004080s : 1: type_inference.infer 17.29% : 0.000853s : 1: type_inference.specialize ------[replace.] 0.000068 6 69.40% : 0.000047s : 4: replace.inline 30.60% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.82% : 0.000164s : 4: match.inline 6.18% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.49% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.60% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.32% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.03% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.96% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000001s : 10: predicate.reshape_eliminate 1.33% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.53% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000008s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000618 13 53.46% : 0.000330s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.96% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.58% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014230 72 0.43% : 0.000061s : 1: add_recomputation 0.50% : 0.000071s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.20% : 0.000313s : 1: bootstrap 0.21% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.24% : 0.005157s : 1: jit_opt_a 0.99% : 0.000140s : 1: jit_opt_after_cconv 0.35% : 0.000051s : 1: jit_opt_b 3.41% : 0.000485s : 1: loop_unroll 3.66% : 0.000521s : 1: mutable_eliminate 5.77% : 0.000821s : 26: opt.transform.jit_opt_a 0.32% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.12% : 0.000443s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000039s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.29% : 0.000326s : 1: renormalize.infer 1.99% : 0.000283s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000038s : 1: rewriter_after_opt_a 0.53% : 0.000076s : 1: rewriter_before_opt_a 0.50% : 0.000072s : 1: symbol_engine_optimizer 35.19% : 0.005008s : 1: type_inference TotalTime = 0.0318396, [30] [bootstrap]: 0.00030923 [type_inference]: 0.0201411 [event_method]: 2.05e-05 [auto_monad]: 7.099e-05 [graph_reusing]: 5.74999e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 0.00010748 [rewriter_before_opt_a]: 8.394e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.0090212, [2] [Cycle 1]: 0.00186766, [27] [switch_simplify]: 5.175e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.00052604 [with_stream_mark]: 1.778e-05 [recompute_prepare]: 7.37002e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.41002e-06 [meta_shard_fg_expand]: 2.53003e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00092846 [add_forward_monad_depend]: 5.76e-06 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.518e-05 [cse]: 2.493e-05 [replace_applicator]: 1.127e-05 [Cycle 2]: 0.00031706, [27] [switch_simplify]: 5.84999e-06 [loop_unroll]: 4.94e-06 [a_1]: 9.056e-05 [with_stream_mark]: 8.13001e-06 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.44999e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.212e-05 [j_node_and_user_rematch]: 7.97003e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 6.80002e-06 [inline_without_move]: 4.81997e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.3e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 1.039e-05 [rewriter_after_opt_a]: 3.589e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00051209 [jit_opt_b]: 4.84e-05, [1] [Cycle 1]: 4.221e-05, [2] [frontend_op_eliminate]: 1.563e-05 [inline_after_opt_a]: 1.609e-05 [cconv]: 2.508e-05 [loop_unroll]: 0.00041278 [jit_opt_after_cconv]: 0.00013818, [1] [Cycle 1]: 0.00013199, [11] [c_1]: 2.075e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 1.974e-05 [call_graph_tuple_transform]: 1.81e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 5.69e-06 [add_recomputation]: 4.591e-05 [cse_after_recomputation]: 3.244e-05, [1] [Cycle 1]: 2.693e-05, [1] [cse]: 2.12e-05 [auto_monad_reorder]: 1.882e-05 [get_jit_bprop_graph]: 1.954e-05 [rewriter_after_jit_bprop_graph]: 4.91997e-06 [opt_after_jit_grad]: 0.00045508 [symbol_engine_optimizer]: 7.302e-05, [1] [Cycle 1]: 6.626e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.277e-05 [opt_reshape]: 5.59998e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 5.10016e-07 [validate]: 3.707e-05 Sums bootstrap : 0.000309s : 1.26% type_inference : 0.020141s : 82.38% event_method : 0.000021s : 0.08% auto_monad : 0.000071s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000107s : 0.44% rewriter_before_opt_a : 0.000084s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.15% jit_opt_a.a_1 : 0.000617s : 2.52% jit_opt_a.with_stream_mark : 0.000026s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000929s : 3.80% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000038s : 0.16% jit_opt_a.replace_applicator : 0.000016s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000036s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000512s : 2.09% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000025s : 0.10% loop_unroll : 0.000413s : 1.69% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000046s : 0.19% cse_after_recomputation.cse : 0.000021s : 0.09% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000020s : 0.08% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000455s : 1.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000191 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000005s : 3: substitution.graph_param_transform 83.26% : 0.000159s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000004s : 4: substitution.remove_not_recompute_node 1.91% : 0.000004s : 2: substitution.replace_old_param 6.39% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020069 2 92.46% : 0.018556s : 1: type_inference.infer 7.54% : 0.001513s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.41% : 0.000049s : 4: replace.inline 31.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.37% : 0.000157s : 4: match.inline 6.63% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000002s : 10: predicate.arithmetic_simplify 1.69% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.43% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000002s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 2.10% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.53% : 0.000002s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.76% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000793 13 45.00% : 0.000357s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.77% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.23% : 0.000398s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033650 72 0.14% : 0.000049s : 1: add_recomputation 0.22% : 0.000074s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.97% : 0.000326s : 1: bootstrap 0.08% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000034s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.07% : 0.000022s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 26.82% : 0.009024s : 1: jit_opt_a 0.42% : 0.000141s : 1: jit_opt_after_cconv 0.15% : 0.000051s : 1: jit_opt_b 1.25% : 0.000420s : 1: loop_unroll 1.55% : 0.000521s : 1: mutable_eliminate 2.46% : 0.000826s : 26: opt.transform.jit_opt_a 0.14% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.37% : 0.000463s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000111s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.58% : 0.000531s : 1: renormalize.infer 1.16% : 0.000389s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000039s : 1: rewriter_after_opt_a 0.26% : 0.000088s : 1: rewriter_before_opt_a 0.22% : 0.000076s : 1: symbol_engine_optimizer 59.90% : 0.020156s : 1: type_inference TotalTime = 0.0847919, [30] [bootstrap]: 0.0002816 [type_inference]: 0.0574482 [event_method]: 0.00031781 [auto_monad]: 0.00012017 [graph_reusing]: 7.61999e-06 [pre_auto_parallel]: 3.45003e-06 [py_interpret_to_execute]: 4.376e-05 [rewriter_before_opt_a]: 0.00013379 [expand_dump_flag]: 4.28001e-06 [jit_opt_a]: 0.0237759, [3] [Cycle 1]: 0.0158849, [27] [switch_simplify]: 8.774e-05 [loop_unroll]: 4.891e-05 [a_1]: 0.00109772 [with_stream_mark]: 3.64e-05 [recompute_prepare]: 2.204e-05 [updatestate_depend_eliminate]: 1.096e-05 [updatestate_assign_eliminate]: 7.18e-06 [updatestate_loads_eliminate]: 7.02002e-06 [parameter_eliminate]: 2.84999e-06 [specialize_transform]: 1.598e-05 [updatestate_useless_node_eliminater]: 1.481e-05 [accelerated_algorithm]: 1.453e-05 [meta_shard_fg_expand]: 4.03001e-06 [get_grad_eliminate_]: 1.515e-05 [merge_forward]: 9.61e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.023e-05 [j_node_and_user_rematch]: 2.509e-05 [meta_fg_expand]: 0.00199964 [replace_old_param]: 7.78e-05 [inline_without_move]: 6.739e-05 [renormalize]: 0.0114465 [add_forward_monad_depend]: 2.192e-05 [auto_monad_grad]: 7.26999e-06 [auto_monad_eliminator]: 7.527e-05 [cse]: 0.00033616 [replace_applicator]: 0.00010504 [Cycle 2]: 0.00373072, [27] [switch_simplify]: 4.47e-05 [loop_unroll]: 4.217e-05 [a_1]: 0.00130195 [with_stream_mark]: 5.592e-05 [recompute_prepare]: 1.287e-05 [updatestate_depend_eliminate]: 7.03e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 4.72998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.968e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 0.00018751 [replace_old_param]: 1.033e-05 [inline_without_move]: 5.68997e-06 [renormalize]: 0.00168594 [add_forward_monad_depend]: 9.97001e-06 [auto_monad_grad]: 2.11998e-06 [auto_monad_eliminator]: 1.976e-05 [cse]: 3.437e-05 [replace_applicator]: 2.236e-05 [Cycle 3]: 0.00035128, [27] [switch_simplify]: 5.96998e-06 [loop_unroll]: 5.24e-06 [a_1]: 8.628e-05 [with_stream_mark]: 1.581e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 4.65999e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.886e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 4.35e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.09e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.364e-05 [replace_applicator]: 4.85999e-06 [py_interpret_to_execute_after_opt_a]: 1.871e-05 [rewriter_after_opt_a]: 4.517e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.00084537 [jit_opt_b]: 8.949e-05, [1] [Cycle 1]: 8.12e-05, [2] [frontend_op_eliminate]: 1.618e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 3.07e-05 [loop_unroll]: 0.0004662 [jit_opt_after_cconv]: 0.00017169, [1] [Cycle 1]: 0.0001653, [11] [c_1]: 2.035e-05 [parameter_eliminate]: 3.61001e-06 [updatestate_depend_eliminate]: 8.03001e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 3.175e-05 [call_graph_tuple_transform]: 2.302e-05 [tuple_list_get_item_eliminator]: 5.23002e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 7.7e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 1.765e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 7.71999e-06 [add_recomputation]: 4.892e-05 [cse_after_recomputation]: 4.69e-05, [1] [Cycle 1]: 4.078e-05, [1] [cse]: 1.303e-05 [auto_monad_reorder]: 1.591e-05 [get_jit_bprop_graph]: 1.70001e-06 [rewriter_after_jit_bprop_graph]: 6.94001e-06 [opt_after_jit_grad]: 0.00049094 [symbol_engine_optimizer]: 8.062e-05, [1] [Cycle 1]: 7.433e-05, [6] [build]: 4.77e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.37e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 3.10014e-07 [validate]: 4.303e-05 Sums bootstrap : 0.000282s : 0.35% type_inference : 0.057448s : 71.86% event_method : 0.000318s : 0.40% auto_monad : 0.000120s : 0.15% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000044s : 0.05% rewriter_before_opt_a : 0.000134s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000138s : 0.17% jit_opt_a.loop_unroll : 0.000096s : 0.12% jit_opt_a.a_1 : 0.002486s : 3.11% jit_opt_a.with_stream_mark : 0.000108s : 0.14% jit_opt_a.recompute_prepare : 0.000040s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000022s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.02% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000027s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000069s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.06% jit_opt_a.meta_fg_expand : 0.002189s : 2.74% jit_opt_a.replace_old_param : 0.000092s : 0.12% jit_opt_a.inline_without_move : 0.000078s : 0.10% jit_opt_a.renormalize : 0.013132s : 16.43% jit_opt_a.add_forward_monad_depend : 0.000034s : 0.04% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000101s : 0.13% jit_opt_a.cse : 0.000384s : 0.48% jit_opt_a.replace_applicator : 0.000132s : 0.17% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000045s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000845s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000031s : 0.04% loop_unroll : 0.000466s : 0.58% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000491s : 0.61% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.05% Time group info: ------[substitution.] 0.000716 106 0.36% : 0.000003s : 2: substitution.elim_not_effective 0.27% : 0.000002s : 2: substitution.fold_const_symbol 0.95% : 0.000007s : 2: substitution.graph_param_transform 68.70% : 0.000492s : 13: substitution.inline 3.01% : 0.000022s : 2: substitution.inline_without_move 1.40% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.81% : 0.000013s : 7: substitution.minmaximum_grad 1.20% : 0.000009s : 5: substitution.partial_eliminate 1.92% : 0.000014s : 12: substitution.remove_not_recompute_node 5.51% : 0.000040s : 10: substitution.replace_applicator 0.95% : 0.000007s : 10: substitution.replace_old_param 0.41% : 0.000003s : 1: substitution.set_cell_output_no_recompute 3.77% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.29% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.44% : 0.000053s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057322 2 94.70% : 0.054286s : 1: type_inference.infer 5.30% : 0.003037s : 1: type_inference.specialize ------[replace.] 0.000228 20 65.34% : 0.000149s : 13: replace.inline 34.66% : 0.000079s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000511 20 94.63% : 0.000483s : 13: match.inline 5.37% : 0.000027s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000426 2628 5.91% : 0.000025s : 45: predicate.accumulaten_eliminater 0.27% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.46% : 0.000006s : 45: predicate.addn_check_dump 1.43% : 0.000006s : 45: predicate.addn_zero_filter 2.00% : 0.000009s : 45: predicate.arithmetic_simplify 1.47% : 0.000006s : 45: predicate.cast_eliminate 0.10% : 0.000000s : 2: predicate.check_bprop_eliminate 1.39% : 0.000006s : 45: predicate.compare_switch_simplify 1.30% : 0.000006s : 45: predicate.depend_value_elim 1.27% : 0.000005s : 45: predicate.dict_get_item_const_eliminator 1.35% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.34% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.15% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000005s : 45: predicate.environ_add_const_eliminate 1.26% : 0.000005s : 45: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 45: predicate.environ_get_depend_swap 1.70% : 0.000007s : 45: predicate.environ_get_eliminate 1.25% : 0.000005s : 45: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.79% : 0.000003s : 17: predicate.get_grad_eliminate 0.05% : 0.000000s : 2: predicate.graph_param_transform 4.42% : 0.000019s : 69: predicate.inline 1.97% : 0.000008s : 45: predicate.inline_without_move 0.28% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.29% : 0.000005s : 17: predicate.less_batch_normalization 1.62% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.69% : 0.000007s : 54: predicate.load_eliminater 0.42% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.30% : 0.000014s : 98: predicate.loop_unroll_before_grad 1.70% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.46% : 0.000006s : 45: predicate.merge_addn 1.31% : 0.000006s : 45: predicate.minmaximum_grad 0.58% : 0.000002s : 2: predicate.mutable_eliminate 0.11% : 0.000000s : 2: predicate.opt_reshape 2.23% : 0.000010s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 45: predicate.print_const_string_wrapper 2.35% : 0.000010s : 45: predicate.reduce_eliminate 1.93% : 0.000008s : 52: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 17: predicate.remove_not_recompute_node 2.58% : 0.000011s : 98: predicate.replace_applicator 1.02% : 0.000004s : 45: predicate.replace_old_param 0.11% : 0.000000s : 2: predicate.reset_defer_inline 1.50% : 0.000006s : 45: predicate.reshape_eliminate 1.32% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 2: predicate.row_tensor_eliminate 1.30% : 0.000006s : 45: predicate.same_eliminate 0.49% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.33% : 0.000001s : 4: predicate.special_op_eliminate 0.77% : 0.000003s : 17: predicate.specialize_transform 1.76% : 0.000008s : 45: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.13% : 0.000001s : 2: predicate.switch_call_monad_eliminater 3.21% : 0.000014s : 65: predicate.switch_defer_inline 2.42% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.09% : 0.000026s : 165: predicate.switch_simplify 1.55% : 0.000007s : 45: predicate.tile_eliminate 1.34% : 0.000006s : 45: predicate.transpose_eliminate 1.64% : 0.000007s : 45: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.16% : 0.000013s : 56: predicate.tuple_list_get_item_eliminator 1.93% : 0.000008s : 45: predicate.tuple_list_set_item_eliminator 1.61% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.67% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.43% : 0.000010s : 71: predicate.updatestate_useless_node_eliminater 1.70% : 0.000007s : 45: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.21% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003912 40 68.44% : 0.002677s : 23: func_graph_cloner_run.FuncGraphClonerGraph 31.56% : 0.001235s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.101176 87 0.05% : 0.000052s : 1: add_recomputation 0.13% : 0.000127s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.30% : 0.000305s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000050s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.32% : 0.000326s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 23.51% : 0.023782s : 1: jit_opt_a 0.17% : 0.000174s : 1: jit_opt_after_cconv 0.09% : 0.000092s : 1: jit_opt_b 0.47% : 0.000474s : 1: loop_unroll 0.85% : 0.000858s : 1: mutable_eliminate 3.19% : 0.003223s : 39: opt.transform.jit_opt_a 0.05% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000500s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000047s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 9.66% : 0.009778s : 2: renormalize.infer 3.29% : 0.003327s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000049s : 1: rewriter_after_opt_a 0.14% : 0.000137s : 1: rewriter_before_opt_a 0.08% : 0.000083s : 1: symbol_engine_optimizer 56.80% : 0.057472s : 1: type_inference TotalTime = 0.0248069, [30] [bootstrap]: 0.0003173 [type_inference]: 0.00442357 [event_method]: 1.602e-05 [auto_monad]: 4.861e-05 [graph_reusing]: 4.77e-06 [pre_auto_parallel]: 1.99e-06 [py_interpret_to_execute]: 3.117e-05 [rewriter_before_opt_a]: 7.077e-05 [expand_dump_flag]: 2.61999e-06 [jit_opt_a]: 0.0175402, [2] [Cycle 1]: 0.0142811, [27] [switch_simplify]: 5.633e-05 [loop_unroll]: 3.038e-05 [a_1]: 0.0130335 [with_stream_mark]: 2.681e-05 [recompute_prepare]: 1.22e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.59998e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.665e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 5.30001e-06 [renormalize]: 0.00076335 [add_forward_monad_depend]: 5.90002e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.631e-05 [cse]: 3.021e-05 [replace_applicator]: 1.305e-05 [Cycle 2]: 0.00031122, [27] [switch_simplify]: 5.69e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.64e-05 [with_stream_mark]: 9.52001e-06 [recompute_prepare]: 4.95001e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.03997e-06 [parameter_eliminate]: 8.49977e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.09e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.47998e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.241e-05 [j_node_and_user_rematch]: 7.71999e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.43002e-06 [cse]: 1.211e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.304e-05 [rewriter_after_opt_a]: 3.693e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00074089 [jit_opt_b]: 4.952e-05, [1] [Cycle 1]: 4.248e-05, [2] [frontend_op_eliminate]: 1.537e-05 [inline_after_opt_a]: 1.586e-05 [cconv]: 2.798e-05 [loop_unroll]: 0.00040443 [jit_opt_after_cconv]: 0.00015049, [1] [Cycle 1]: 0.00014396, [11] [c_1]: 1.972e-05 [parameter_eliminate]: 2.35002e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.16003e-06 [cse]: 2.307e-05 [call_graph_tuple_transform]: 2.401e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.04999e-06 [add_recomputation]: 5.009e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 6.364e-05 [rewriter_after_jit_bprop_graph]: 5.54998e-06 [opt_after_jit_grad]: 0.00045097 [symbol_engine_optimizer]: 7.119e-05, [1] [Cycle 1]: 6.517e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 5.42999e-06 [fold_const_symbol]: 8.43001e-06 [renormalize]: 2.69996e-07 [validate]: 3.846e-05 Sums bootstrap : 0.000317s : 1.49% type_inference : 0.004424s : 20.80% event_method : 0.000016s : 0.08% auto_monad : 0.000049s : 0.23% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000031s : 0.15% rewriter_before_opt_a : 0.000071s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.29% jit_opt_a.loop_unroll : 0.000035s : 0.17% jit_opt_a.a_1 : 0.013120s : 61.70% jit_opt_a.with_stream_mark : 0.000036s : 0.17% jit_opt_a.recompute_prepare : 0.000017s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000763s : 3.59% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.10% jit_opt_a.cse : 0.000042s : 0.20% jit_opt_a.replace_applicator : 0.000018s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000037s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000741s : 3.48% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000028s : 0.13% loop_unroll : 0.000404s : 1.90% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000016s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000050s : 0.24% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000064s : 0.30% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000451s : 2.12% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.18% Time group info: ------[substitution.] 0.012604 23 0.02% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000001s : 2: substitution.fold_const_symbol 0.04% : 0.000006s : 3: substitution.graph_param_transform 99.71% : 0.012567s : 4: substitution.inline 0.03% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.04% : 0.000004s : 4: substitution.remove_not_recompute_node 0.04% : 0.000005s : 2: substitution.replace_old_param 0.12% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004372 2 81.54% : 0.003565s : 1: type_inference.infer 18.46% : 0.000807s : 1: type_inference.specialize ------[replace.] 0.000113 6 78.19% : 0.000088s : 4: replace.inline 21.81% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.012573 6 99.89% : 0.012559s : 4: match.inline 0.11% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.58% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000003s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.53% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 2.01% : 0.000003s : 10: predicate.reduce_eliminate 1.75% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.75% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.97% : 0.000004s : 16: predicate.switch_defer_inline 2.26% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000654 13 45.17% : 0.000296s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.42% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.41% : 0.000304s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038966 72 0.14% : 0.000053s : 1: add_recomputation 0.13% : 0.000052s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.86% : 0.000335s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.17% : 0.000067s : 1: get_jit_bprop_graph 0.02% : 0.000007s : 1: graph_reusing 45.02% : 0.017544s : 1: jit_opt_a 0.39% : 0.000153s : 1: jit_opt_after_cconv 0.13% : 0.000052s : 1: jit_opt_b 1.06% : 0.000413s : 1: loop_unroll 1.93% : 0.000751s : 1: mutable_eliminate 34.23% : 0.013338s : 26: opt.transform.jit_opt_a 0.13% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.18% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000034s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.10% : 0.000429s : 1: renormalize.infer 0.84% : 0.000326s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000040s : 1: rewriter_after_opt_a 0.19% : 0.000074s : 1: rewriter_before_opt_a 0.19% : 0.000073s : 1: symbol_engine_optimizer 11.38% : 0.004436s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.911.507 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:35.912.151 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0497281, [30] [bootstrap]: 0.00025752 [type_inference]: 0.0189089 [event_method]: 7.472e-05 [auto_monad]: 0.0001034 [graph_reusing]: 7.66999e-06 [pre_auto_parallel]: 3.41999e-06 [py_interpret_to_execute]: 3.381e-05 [rewriter_before_opt_a]: 0.000111 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.0274406, [3] [Cycle 1]: 0.00839234, [27] [switch_simplify]: 8.621e-05 [loop_unroll]: 4.341e-05 [a_1]: 0.00100459 [with_stream_mark]: 4.074e-05 [recompute_prepare]: 2.224e-05 [updatestate_depend_eliminate]: 8.93002e-06 [updatestate_assign_eliminate]: 7.60998e-06 [updatestate_loads_eliminate]: 6.43998e-06 [parameter_eliminate]: 3.48999e-06 [specialize_transform]: 0.0002098 [updatestate_useless_node_eliminater]: 1.534e-05 [accelerated_algorithm]: 1.431e-05 [meta_shard_fg_expand]: 5.31002e-06 [get_grad_eliminate_]: 1.359e-05 [merge_forward]: 1.22e-05 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.252e-05 [j_node_and_user_rematch]: 2.4e-05 [meta_fg_expand]: 0.0020404 [replace_old_param]: 7.27e-05 [inline_without_move]: 6.009e-05 [renormalize]: 0.00391699 [add_forward_monad_depend]: 1.593e-05 [auto_monad_grad]: 7.25e-06 [auto_monad_eliminator]: 6.804e-05 [cse]: 0.00025082 [replace_applicator]: 9.683e-05 [Cycle 2]: 0.0146261, [27] [switch_simplify]: 4.341e-05 [loop_unroll]: 4.15e-05 [a_1]: 0.00134961 [with_stream_mark]: 2.367e-05 [recompute_prepare]: 1.318e-05 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 4.28001e-06 [updatestate_loads_eliminate]: 3.90998e-06 [parameter_eliminate]: 3.04001e-06 [specialize_transform]: 9.37001e-06 [updatestate_useless_node_eliminater]: 8.97e-06 [accelerated_algorithm]: 9.43002e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 8.76002e-06 [merge_forward]: 5.92001e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.15e-05 [j_node_and_user_rematch]: 1.582e-05 [meta_fg_expand]: 0.00014882 [replace_old_param]: 1.152e-05 [inline_without_move]: 9.14e-06 [renormalize]: 0.0125378 [add_forward_monad_depend]: 1.335e-05 [auto_monad_grad]: 3.13e-06 [auto_monad_eliminator]: 2.42e-05 [cse]: 3.84e-05 [replace_applicator]: 3.129e-05 [Cycle 3]: 0.00039808, [27] [switch_simplify]: 8.25e-06 [loop_unroll]: 7.36001e-06 [a_1]: 9.648e-05 [with_stream_mark]: 1.852e-05 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 4.38999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 3.78999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.895e-05 [j_node_and_user_rematch]: 1.12e-05 [meta_fg_expand]: 3.31999e-06 [replace_old_param]: 4.84e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 7.59002e-06 [cse]: 1.452e-05 [replace_applicator]: 4.68999e-06 [py_interpret_to_execute_after_opt_a]: 1.895e-05 [rewriter_after_opt_a]: 4.875e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00086539 [jit_opt_b]: 5.571e-05, [1] [Cycle 1]: 4.709e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 3.69e-05 [loop_unroll]: 0.00048708 [jit_opt_after_cconv]: 0.00016869, [1] [Cycle 1]: 0.0001619, [11] [c_1]: 1.92e-05 [parameter_eliminate]: 5.17999e-06 [updatestate_depend_eliminate]: 8.60001e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 3.103e-05 [call_graph_tuple_transform]: 2.372e-05 [tuple_list_get_item_eliminator]: 5.07999e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 1.24e-06 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.901e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 7.04001e-06 [add_recomputation]: 6.087e-05 [cse_after_recomputation]: 4.35e-05, [1] [Cycle 1]: 3.695e-05, [1] [cse]: 2.846e-05 [auto_monad_reorder]: 1.892e-05 [get_jit_bprop_graph]: 3.7e-06 [rewriter_after_jit_bprop_graph]: 9.04e-06 [opt_after_jit_grad]: 0.00054273 [symbol_engine_optimizer]: 8.502e-05, [1] [Cycle 1]: 7.757e-05, [6] [build]: 5.90002e-06 [elim_shapecalc]: 8.03001e-06 [elim_not_effective]: 1.578e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 9.58997e-06 [renormalize]: 5.39992e-07 [validate]: 4.91e-05 Sums bootstrap : 0.000258s : 0.58% type_inference : 0.018909s : 42.36% event_method : 0.000075s : 0.17% auto_monad : 0.000103s : 0.23% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000034s : 0.08% rewriter_before_opt_a : 0.000111s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000138s : 0.31% jit_opt_a.loop_unroll : 0.000092s : 0.21% jit_opt_a.a_1 : 0.002451s : 5.49% jit_opt_a.with_stream_mark : 0.000083s : 0.19% jit_opt_a.recompute_prepare : 0.000041s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000008s : 0.02% jit_opt_a.specialize_transform : 0.000225s : 0.50% jit_opt_a.updatestate_useless_node_eliminater : 0.000029s : 0.06% jit_opt_a.accelerated_algorithm : 0.000030s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000028s : 0.06% jit_opt_a.merge_forward : 0.000022s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000083s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000051s : 0.11% jit_opt_a.meta_fg_expand : 0.002193s : 4.91% jit_opt_a.replace_old_param : 0.000089s : 0.20% jit_opt_a.inline_without_move : 0.000074s : 0.17% jit_opt_a.renormalize : 0.016455s : 36.86% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.07% jit_opt_a.auto_monad_grad : 0.000013s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000100s : 0.22% jit_opt_a.cse : 0.000304s : 0.68% jit_opt_a.replace_applicator : 0.000133s : 0.30% py_interpret_to_execute_after_opt_a : 0.000019s : 0.04% rewriter_after_opt_a : 0.000049s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000865s : 1.94% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000037s : 0.08% loop_unroll : 0.000487s : 1.09% jit_opt_after_cconv.c_1 : 0.000019s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000061s : 0.14% cse_after_recomputation.cse : 0.000028s : 0.06% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000004s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000543s : 1.22% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.11% Time group info: ------[substitution.] 0.000705 110 0.32% : 0.000002s : 2: substitution.elim_not_effective 0.24% : 0.000002s : 2: substitution.fold_const_symbol 0.86% : 0.000006s : 2: substitution.graph_param_transform 66.38% : 0.000468s : 13: substitution.inline 3.11% : 0.000022s : 2: substitution.inline_without_move 1.71% : 0.000012s : 14: substitution.j_node_and_user_rematch 1.68% : 0.000012s : 7: substitution.minmaximum_grad 1.14% : 0.000008s : 5: substitution.partial_eliminate 3.09% : 0.000022s : 14: substitution.remove_not_recompute_node 5.25% : 0.000037s : 10: substitution.replace_applicator 0.98% : 0.000007s : 8: substitution.replace_old_param 1.11% : 0.000008s : 1: substitution.reshape_eliminate 0.38% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000007s : 1: substitution.tile_eliminate 3.70% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.47% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.58% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018804 2 91.26% : 0.017160s : 1: type_inference.infer 8.74% : 0.001644s : 1: type_inference.specialize ------[replace.] 0.000203 20 67.72% : 0.000137s : 13: replace.inline 32.28% : 0.000066s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000484 20 95.06% : 0.000460s : 13: match.inline 4.94% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000410 2621 1.49% : 0.000006s : 45: predicate.accumulaten_eliminater 0.32% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.38% : 0.000006s : 45: predicate.addn_check_dump 1.47% : 0.000006s : 45: predicate.addn_zero_filter 1.85% : 0.000008s : 45: predicate.arithmetic_simplify 1.49% : 0.000006s : 45: predicate.cast_eliminate 0.15% : 0.000001s : 2: predicate.check_bprop_eliminate 1.31% : 0.000005s : 45: predicate.compare_switch_simplify 1.63% : 0.000007s : 45: predicate.depend_value_elim 1.50% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.40% : 0.000002s : 2: predicate.dumpgradient_eliminate 0.14% : 0.000001s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.42% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.43% : 0.000006s : 45: predicate.environ_get_depend_swap 1.47% : 0.000006s : 45: predicate.environ_get_eliminate 1.34% : 0.000005s : 45: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.84% : 0.000003s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 2: predicate.graph_param_transform 4.61% : 0.000019s : 69: predicate.inline 1.80% : 0.000007s : 43: predicate.inline_without_move 0.39% : 0.000002s : 19: predicate.j_node_and_user_rematch 1.23% : 0.000005s : 19: predicate.less_batch_normalization 1.84% : 0.000008s : 52: predicate.list_to_tuple_eliminator_ 1.87% : 0.000008s : 54: predicate.load_eliminater 0.54% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.26% : 0.000013s : 90: predicate.loop_unroll_before_grad 1.64% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.37% : 0.000006s : 45: predicate.merge_addn 1.43% : 0.000006s : 45: predicate.minmaximum_grad 0.72% : 0.000003s : 2: predicate.mutable_eliminate 0.12% : 0.000001s : 2: predicate.opt_reshape 2.31% : 0.000009s : 54: predicate.partial_eliminate 1.49% : 0.000006s : 45: predicate.print_const_string_wrapper 2.06% : 0.000008s : 45: predicate.reduce_eliminate 1.90% : 0.000008s : 52: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 19: predicate.remove_not_recompute_node 2.53% : 0.000010s : 97: predicate.replace_applicator 1.09% : 0.000004s : 43: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.55% : 0.000006s : 45: predicate.reshape_eliminate 1.53% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 2: predicate.row_tensor_eliminate 1.53% : 0.000006s : 45: predicate.same_eliminate 0.44% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 4: predicate.special_op_eliminate 0.99% : 0.000004s : 19: predicate.specialize_transform 1.78% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.73% : 0.000007s : 45: predicate.stack_unstack_eliminate 0.14% : 0.000001s : 2: predicate.switch_call_monad_eliminater 3.45% : 0.000014s : 65: predicate.switch_defer_inline 2.43% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.21% : 0.000025s : 157: predicate.switch_simplify 1.60% : 0.000007s : 45: predicate.tile_eliminate 1.48% : 0.000006s : 45: predicate.transpose_eliminate 1.79% : 0.000007s : 45: predicate.tuple_list_convert_item_index_to_positive 1.87% : 0.000008s : 45: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000015s : 56: predicate.tuple_list_get_item_eliminator 1.84% : 0.000008s : 45: predicate.tuple_list_set_item_eliminator 1.81% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.70% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.85% : 0.000012s : 73: predicate.updatestate_useless_node_eliminater 1.75% : 0.000007s : 45: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002461 32 57.31% : 0.001410s : 15: func_graph_cloner_run.FuncGraphClonerGraph 42.69% : 0.001051s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.069589 87 0.09% : 0.000065s : 1: add_recomputation 0.16% : 0.000108s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.41% : 0.000285s : 1: bootstrap 0.06% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000046s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.11% : 0.000080s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 39.44% : 0.027445s : 1: jit_opt_a 0.25% : 0.000171s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.71% : 0.000497s : 1: loop_unroll 1.26% : 0.000880s : 1: mutable_eliminate 4.89% : 0.003400s : 39: opt.transform.jit_opt_a 0.07% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000556s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000037s : 1: py_interpret_to_execute 0.03% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 20.09% : 0.013982s : 2: renormalize.infer 3.51% : 0.002445s : 2: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000052s : 1: rewriter_after_opt_a 0.16% : 0.000114s : 1: rewriter_before_opt_a 0.13% : 0.000088s : 1: symbol_engine_optimizer 27.21% : 0.018934s : 1: type_inference TotalTime = 0.0701187, [30] [bootstrap]: 0.00030544 [type_inference]: 0.0616331 [event_method]: 2.054e-05 [auto_monad]: 7.13e-05 [graph_reusing]: 5.91003e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 4.557e-05 [rewriter_before_opt_a]: 7.43e-05 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.00575019, [2] [Cycle 1]: 0.0017962, [27] [switch_simplify]: 6.015e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00056777 [with_stream_mark]: 2.353e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.01002e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 2.08998e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.565e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.36998e-06 [renormalize]: 0.00075771 [add_forward_monad_depend]: 5.74e-06 [auto_monad_grad]: 2.78998e-06 [auto_monad_eliminator]: 1.593e-05 [cse]: 3.94e-05 [replace_applicator]: 1.288e-05 [Cycle 2]: 0.0003345, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 4.99e-06 [a_1]: 8.934e-05 [with_stream_mark]: 1.178e-05 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 3.00998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.34998e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 6.81999e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.01997e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.309e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.351e-05 [rewriter_after_opt_a]: 3.779e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00059321 [jit_opt_b]: 4.995e-05, [1] [Cycle 1]: 4.247e-05, [2] [frontend_op_eliminate]: 1.52e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 3e-05 [loop_unroll]: 0.00041728 [jit_opt_after_cconv]: 0.00016216, [1] [Cycle 1]: 0.00015643, [11] [c_1]: 2.037e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 6.82002e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.787e-05 [call_graph_tuple_transform]: 2.662e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.638e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 5.49e-06 [add_recomputation]: 5.387e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.886e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 6.84999e-06 [opt_after_jit_grad]: 0.00045967 [symbol_engine_optimizer]: 7.584e-05, [1] [Cycle 1]: 6.919e-05, [6] [build]: 4.23999e-06 [elim_shapecalc]: 8.03999e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 4.19997e-07 [validate]: 4.22e-05 Sums bootstrap : 0.000305s : 0.46% type_inference : 0.061633s : 93.55% event_method : 0.000021s : 0.03% auto_monad : 0.000071s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000046s : 0.07% rewriter_before_opt_a : 0.000074s : 0.11% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000657s : 1.00% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000758s : 1.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000593s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000030s : 0.05% loop_unroll : 0.000417s : 0.63% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000054s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000460s : 0.70% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.06% Time group info: ------[substitution.] 0.000241 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 3: substitution.graph_param_transform 85.35% : 0.000206s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.62% : 0.000004s : 2: substitution.replace_old_param 5.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061546 2 13.32% : 0.008197s : 1: type_inference.infer 86.68% : 0.053349s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.41% : 0.000048s : 4: replace.inline 31.59% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.26% : 0.000203s : 4: match.inline 5.74% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 6.15% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.53% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.31% : 0.000010s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.65% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002857 13 88.05% : 0.002515s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.89% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 10.07% : 0.000288s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071807 72 0.08% : 0.000057s : 1: add_recomputation 0.10% : 0.000075s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.45% : 0.000326s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.01% : 0.005753s : 1: jit_opt_a 0.23% : 0.000165s : 1: jit_opt_after_cconv 0.07% : 0.000053s : 1: jit_opt_b 0.59% : 0.000425s : 1: loop_unroll 0.84% : 0.000604s : 1: mutable_eliminate 1.22% : 0.000876s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000048s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.60% : 0.000429s : 1: renormalize.infer 0.45% : 0.000321s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.11% : 0.000077s : 1: rewriter_before_opt_a 0.11% : 0.000078s : 1: symbol_engine_optimizer 85.86% : 0.061652s : 1: type_inference TotalTime = 0.0330309, [30] [bootstrap]: 0.00034222 [type_inference]: 0.00510735 [event_method]: 1.82e-05 [auto_monad]: 6.341e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 3.483e-05 [rewriter_before_opt_a]: 7.475e-05 [expand_dump_flag]: 2.84001e-06 [jit_opt_a]: 0.0251346, [2] [Cycle 1]: 0.00144968, [27] [switch_simplify]: 5.389e-05 [loop_unroll]: 2.99e-05 [a_1]: 0.00050688 [with_stream_mark]: 1.565e-05 [recompute_prepare]: 7.21001e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.00998e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.20999e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 0.00053664 [add_forward_monad_depend]: 5.27001e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.424e-05 [cse]: 2.798e-05 [replace_applicator]: 1.051e-05 [Cycle 2]: 0.0204691, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.92999e-06 [a_1]: 8.839e-05 [with_stream_mark]: 7.43e-06 [recompute_prepare]: 4.79e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 1.95001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 4.85999e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 4.42e-06 [meta_shard_fg_expand]: 1.05001e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.41e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 7.38e-06 [meta_fg_expand]: 1.44e-06 [replace_old_param]: 0.0200485 [inline_without_move]: 2.307e-05 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 8.62e-06 [auto_monad_grad]: 1.674e-05 [auto_monad_eliminator]: 2.347e-05 [cse]: 2.642e-05 [replace_applicator]: 7.75e-06 [py_interpret_to_execute_after_opt_a]: 1.74e-05 [rewriter_after_opt_a]: 4.135e-05 [convert_after_rewriter]: 8.18999e-06 [order_py_execute_after_rewriter]: 4.99003e-06 [mutable_eliminate]: 0.00065166 [jit_opt_b]: 5.436e-05, [1] [Cycle 1]: 4.687e-05, [2] [frontend_op_eliminate]: 1.688e-05 [inline_after_opt_a]: 1.796e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00041555 [jit_opt_after_cconv]: 0.00014542, [1] [Cycle 1]: 0.00013915, [11] [c_1]: 2.187e-05 [parameter_eliminate]: 3.53999e-06 [updatestate_depend_eliminate]: 5.67999e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.021e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 5.39998e-06 [remove_dup_value]: 1.57e-05 [partial_unused_args_eliminate]: 2.08998e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 4.538e-05 [cse_after_recomputation]: 5.442e-05, [1] [Cycle 1]: 1.626e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.464e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 5.55001e-06 [opt_after_jit_grad]: 0.0004486 [symbol_engine_optimizer]: 7.503e-05, [1] [Cycle 1]: 6.909e-05, [6] [build]: 2.61999e-06 [elim_shapecalc]: 8.44998e-06 [elim_not_effective]: 1.453e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 9.50001e-06 [renormalize]: 2.50002e-07 [validate]: 3.733e-05 Sums bootstrap : 0.000342s : 1.17% type_inference : 0.005107s : 17.50% event_method : 0.000018s : 0.06% auto_monad : 0.000063s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000035s : 0.12% rewriter_before_opt_a : 0.000075s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.20% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000595s : 2.04% jit_opt_a.with_stream_mark : 0.000023s : 0.08% jit_opt_a.recompute_prepare : 0.000012s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.020057s : 68.73% jit_opt_a.inline_without_move : 0.000028s : 0.10% jit_opt_a.renormalize : 0.000537s : 1.84% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.05% jit_opt_a.auto_monad_grad : 0.000019s : 0.06% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.13% jit_opt_a.cse : 0.000054s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000041s : 0.14% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000652s : 2.23% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.000416s : 1.42% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000045s : 0.16% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000015s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000449s : 1.54% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.13% Time group info: ------[substitution.] 0.000186 23 1.41% : 0.000003s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.10% : 0.000006s : 3: substitution.graph_param_transform 82.06% : 0.000153s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005045 2 82.05% : 0.004139s : 1: type_inference.infer 17.95% : 0.000905s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.51% : 0.000045s : 4: replace.inline 31.49% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.25% : 0.000150s : 4: match.inline 6.75% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.68% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.79% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.52% : 0.000007s : 22: predicate.inline 4.18% : 0.000005s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.30% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.10% : 0.000010s : 53: predicate.switch_simplify 1.43% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000664 13 55.69% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.51% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.81% : 0.000264s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054485 72 0.09% : 0.000048s : 1: add_recomputation 0.12% : 0.000067s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.67% : 0.000363s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000057s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 46.14% : 0.025139s : 1: jit_opt_a 0.27% : 0.000149s : 1: jit_opt_after_cconv 0.10% : 0.000057s : 1: jit_opt_b 0.78% : 0.000423s : 1: loop_unroll 1.21% : 0.000659s : 1: mutable_eliminate 38.27% : 0.020853s : 26: opt.transform.jit_opt_a 0.09% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000037s : 1: py_interpret_to_execute 0.04% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.50% : 0.000275s : 1: renormalize.infer 0.47% : 0.000255s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000044s : 1: rewriter_after_opt_a 0.14% : 0.000077s : 1: rewriter_before_opt_a 0.14% : 0.000078s : 1: symbol_engine_optimizer 9.40% : 0.005120s : 1: type_inference TotalTime = 0.0284318, [30] [bootstrap]: 0.00028246 [type_inference]: 0.0204286 [event_method]: 2.203e-05 [auto_monad]: 6.81e-05 [graph_reusing]: 6.48003e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 9.607e-05 [rewriter_before_opt_a]: 8.076e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00534189, [2] [Cycle 1]: 0.0018647, [27] [switch_simplify]: 5.082e-05 [loop_unroll]: 2.93e-05 [a_1]: 0.00052746 [with_stream_mark]: 2.062e-05 [recompute_prepare]: 8.20999e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.28998e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00089493 [add_forward_monad_depend]: 5.28002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.586e-05 [cse]: 3.681e-05 [replace_applicator]: 1.199e-05 [Cycle 2]: 0.00032223, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 5.35999e-06 [a_1]: 9.009e-05 [with_stream_mark]: 1.071e-05 [recompute_prepare]: 5.56998e-06 [updatestate_depend_eliminate]: 3.20002e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.299e-05 [j_node_and_user_rematch]: 7.95e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 6.83e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.28e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.152e-05 [rewriter_after_opt_a]: 3.856e-05 [convert_after_rewriter]: 8.02998e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00054271 [jit_opt_b]: 4.789e-05, [1] [Cycle 1]: 4.124e-05, [2] [frontend_op_eliminate]: 1.475e-05 [inline_after_opt_a]: 1.507e-05 [cconv]: 2.563e-05 [loop_unroll]: 0.00040432 [jit_opt_after_cconv]: 0.00014067, [1] [Cycle 1]: 0.00013443, [11] [c_1]: 2.012e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.11e-05 [call_graph_tuple_transform]: 1.927e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 1.517e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 5.59998e-06 [add_recomputation]: 6.865e-05 [cse_after_recomputation]: 2.468e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.784e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 4.70999e-06 [opt_after_jit_grad]: 0.00045102 [symbol_engine_optimizer]: 7.381e-05, [1] [Cycle 1]: 6.714e-05, [6] [build]: 3.66999e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.283e-05 [opt_reshape]: 6.22001e-06 [fold_const_symbol]: 9.18002e-06 [renormalize]: 5.90022e-07 [validate]: 4.106e-05 Sums bootstrap : 0.000282s : 1.14% type_inference : 0.020429s : 82.69% event_method : 0.000022s : 0.09% auto_monad : 0.000068s : 0.28% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000096s : 0.39% rewriter_before_opt_a : 0.000081s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.23% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000618s : 2.50% jit_opt_a.with_stream_mark : 0.000031s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000895s : 3.62% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000050s : 0.20% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000039s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000543s : 2.20% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000404s : 1.64% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000069s : 0.28% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000451s : 1.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.17% Time group info: ------[substitution.] 0.000207 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000005s : 3: substitution.graph_param_transform 84.49% : 0.000174s : 4: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000004s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 5.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020359 2 93.18% : 0.018970s : 1: type_inference.infer 6.82% : 0.001389s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.79% : 0.000048s : 4: replace.inline 31.21% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 94.07% : 0.000172s : 4: match.inline 5.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.70% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000000s : 3: predicate.graph_param_transform 6.19% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.07% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.52% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.93% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000792 13 46.22% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.32% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.46% : 0.000384s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030206 72 0.24% : 0.000072s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 0.98% : 0.000295s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.70% : 0.005346s : 1: jit_opt_a 0.48% : 0.000144s : 1: jit_opt_after_cconv 0.17% : 0.000051s : 1: jit_opt_b 1.36% : 0.000412s : 1: loop_unroll 1.82% : 0.000550s : 1: mutable_eliminate 2.74% : 0.000827s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000458s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000099s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.71% : 0.000517s : 1: renormalize.infer 1.23% : 0.000371s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000085s : 1: rewriter_before_opt_a 0.25% : 0.000076s : 1: symbol_engine_optimizer 67.69% : 0.020447s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.253.21 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.260.84 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0515024, [30] [bootstrap]: 0.0002289 [type_inference]: 0.0176873 [event_method]: 7.638e-05 [auto_monad]: 7.593e-05 [graph_reusing]: 5.00001e-06 [pre_auto_parallel]: 3.38e-06 [py_interpret_to_execute]: 3.307e-05 [rewriter_before_opt_a]: 0.00012222 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.0309713, [3] [Cycle 1]: 0.0133016, [27] [switch_simplify]: 7.441e-05 [loop_unroll]: 4.293e-05 [a_1]: 0.00092167 [with_stream_mark]: 2.741e-05 [recompute_prepare]: 1.925e-05 [updatestate_depend_eliminate]: 8.77999e-06 [updatestate_assign_eliminate]: 7.63999e-06 [updatestate_loads_eliminate]: 7.1e-06 [parameter_eliminate]: 3.11999e-06 [specialize_transform]: 1.433e-05 [updatestate_useless_node_eliminater]: 1.246e-05 [accelerated_algorithm]: 1.289e-05 [meta_shard_fg_expand]: 3.38e-06 [get_grad_eliminate_]: 1.238e-05 [merge_forward]: 9.74e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.703e-05 [j_node_and_user_rematch]: 2.403e-05 [meta_fg_expand]: 0.00224478 [replace_old_param]: 6.463e-05 [inline_without_move]: 5.809e-05 [renormalize]: 0.00909414 [add_forward_monad_depend]: 1.066e-05 [auto_monad_grad]: 5.92999e-06 [auto_monad_eliminator]: 5.817e-05 [cse]: 0.00023152 [replace_applicator]: 8.032e-05 [Cycle 2]: 0.013971, [27] [switch_simplify]: 4.088e-05 [loop_unroll]: 0.00011583 [a_1]: 0.00111604 [with_stream_mark]: 1.521e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 6.62002e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.68e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.465e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 0.00010724 [replace_old_param]: 7.33e-06 [inline_without_move]: 6.64999e-06 [renormalize]: 0.0121985 [add_forward_monad_depend]: 1.174e-05 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 2.281e-05 [cse]: 3.481e-05 [replace_applicator]: 2.527e-05 [Cycle 3]: 0.00035078, [27] [switch_simplify]: 7.05e-06 [loop_unroll]: 5.47001e-06 [a_1]: 8.907e-05 [with_stream_mark]: 1.617e-05 [recompute_prepare]: 5.16002e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.37e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 2.73e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.9e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 4.68001e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.12e-05 [replace_applicator]: 4.62e-06 [py_interpret_to_execute_after_opt_a]: 1.611e-05 [rewriter_after_opt_a]: 3.942e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 5.59998e-06 [mutable_eliminate]: 0.00072612 [jit_opt_b]: 5.017e-05, [1] [Cycle 1]: 4.25e-05, [2] [frontend_op_eliminate]: 1.499e-05 [inline_after_opt_a]: 1.591e-05 [cconv]: 2.364e-05 [loop_unroll]: 0.00041344 [jit_opt_after_cconv]: 0.00015012, [1] [Cycle 1]: 0.000133, [11] [c_1]: 1.701e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.13002e-06 [cse]: 2.142e-05 [call_graph_tuple_transform]: 1.635e-05 [tuple_list_get_item_eliminator]: 5.07e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 4.89e-06 [remove_dup_value]: 1.577e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 4.5e-05 [cse_after_recomputation]: 2.384e-05, [1] [Cycle 1]: 1.856e-05, [1] [cse]: 1.201e-05 [auto_monad_reorder]: 1.515e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.58001e-06 [opt_after_jit_grad]: 0.00046147 [symbol_engine_optimizer]: 7.393e-05, [1] [Cycle 1]: 6.772e-05, [6] [build]: 4.01001e-06 [elim_shapecalc]: 7.09001e-06 [elim_not_effective]: 1.207e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 8.38001e-06 [renormalize]: 3.80009e-07 [validate]: 3.917e-05 Sums bootstrap : 0.000229s : 0.48% type_inference : 0.017687s : 37.39% event_method : 0.000076s : 0.16% auto_monad : 0.000076s : 0.16% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000033s : 0.07% rewriter_before_opt_a : 0.000122s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000122s : 0.26% jit_opt_a.loop_unroll : 0.000164s : 0.35% jit_opt_a.a_1 : 0.002127s : 4.50% jit_opt_a.with_stream_mark : 0.000059s : 0.12% jit_opt_a.recompute_prepare : 0.000032s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.05% jit_opt_a.accelerated_algorithm : 0.000025s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.05% jit_opt_a.merge_forward : 0.000017s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.09% jit_opt_a.meta_fg_expand : 0.002355s : 4.98% jit_opt_a.replace_old_param : 0.000077s : 0.16% jit_opt_a.inline_without_move : 0.000069s : 0.15% jit_opt_a.renormalize : 0.021293s : 45.01% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.05% jit_opt_a.auto_monad_grad : 0.000009s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.18% jit_opt_a.cse : 0.000278s : 0.59% jit_opt_a.replace_applicator : 0.000110s : 0.23% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000039s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000726s : 1.53% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000024s : 0.05% loop_unroll : 0.000413s : 0.87% jit_opt_after_cconv.c_1 : 0.000017s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000045s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 0.98% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.08% Time group info: ------[substitution.] 0.000535 109 0.37% : 0.000002s : 2: substitution.elim_not_effective 0.27% : 0.000001s : 2: substitution.fold_const_symbol 0.92% : 0.000005s : 2: substitution.graph_param_transform 65.92% : 0.000353s : 13: substitution.inline 3.09% : 0.000017s : 2: substitution.inline_without_move 2.02% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.99% : 0.000011s : 7: substitution.minmaximum_grad 1.25% : 0.000007s : 5: substitution.partial_eliminate 2.11% : 0.000011s : 13: substitution.remove_not_recompute_node 5.33% : 0.000029s : 10: substitution.replace_applicator 1.12% : 0.000006s : 10: substitution.replace_old_param 0.44% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000005s : 1: substitution.tile_eliminate 3.96% : 0.000021s : 7: substitution.tuple_list_convert_item_index_to_positive 2.90% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.34% : 0.000039s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.017607 2 80.18% : 0.014117s : 1: type_inference.infer 19.82% : 0.003490s : 1: type_inference.specialize ------[replace.] 0.000177 20 65.17% : 0.000115s : 13: replace.inline 34.83% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000363 20 94.74% : 0.000344s : 13: match.inline 5.26% : 0.000019s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000375 2517 1.52% : 0.000006s : 43: predicate.accumulaten_eliminater 0.26% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.39% : 0.000005s : 43: predicate.addn_check_dump 1.56% : 0.000006s : 43: predicate.addn_zero_filter 2.07% : 0.000008s : 43: predicate.arithmetic_simplify 1.51% : 0.000006s : 43: predicate.cast_eliminate 0.16% : 0.000001s : 2: predicate.check_bprop_eliminate 1.43% : 0.000005s : 43: predicate.compare_switch_simplify 1.50% : 0.000006s : 43: predicate.depend_value_elim 1.58% : 0.000006s : 43: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 43: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 43: predicate.dict_set_item_eliminator 0.22% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.13% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000006s : 43: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 43: predicate.environ_get_add_eliminate 1.43% : 0.000005s : 43: predicate.environ_get_depend_swap 1.52% : 0.000006s : 43: predicate.environ_get_eliminate 1.40% : 0.000005s : 43: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.82% : 0.000003s : 17: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.50% : 0.000017s : 67: predicate.inline 1.94% : 0.000007s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.07% : 0.000004s : 17: predicate.less_batch_normalization 1.81% : 0.000007s : 50: predicate.list_to_tuple_eliminator_ 1.84% : 0.000007s : 52: predicate.load_eliminater 0.30% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.31% : 0.000012s : 88: predicate.loop_unroll_before_grad 1.69% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.54% : 0.000006s : 43: predicate.merge_addn 1.47% : 0.000006s : 43: predicate.minmaximum_grad 0.34% : 0.000001s : 2: predicate.mutable_eliminate 0.12% : 0.000000s : 2: predicate.opt_reshape 2.51% : 0.000009s : 52: predicate.partial_eliminate 1.64% : 0.000006s : 43: predicate.print_const_string_wrapper 2.11% : 0.000008s : 43: predicate.reduce_eliminate 1.96% : 0.000007s : 50: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 17: predicate.remove_not_recompute_node 2.66% : 0.000010s : 93: predicate.replace_applicator 1.10% : 0.000004s : 45: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.54% : 0.000006s : 43: predicate.reshape_eliminate 1.54% : 0.000006s : 43: predicate.row_tensor_add_zeros_like 0.24% : 0.000001s : 2: predicate.row_tensor_eliminate 1.46% : 0.000005s : 43: predicate.same_eliminate 0.44% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.30% : 0.000001s : 4: predicate.special_op_eliminate 0.82% : 0.000003s : 17: predicate.specialize_transform 1.92% : 0.000007s : 43: predicate.split_environ_get_set_with_tuple_value 1.72% : 0.000006s : 43: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.80% : 0.000011s : 63: predicate.switch_defer_inline 2.47% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.39% : 0.000024s : 153: predicate.switch_simplify 1.61% : 0.000006s : 43: predicate.tile_eliminate 1.53% : 0.000006s : 43: predicate.transpose_eliminate 1.87% : 0.000007s : 43: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000006s : 43: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000013s : 54: predicate.tuple_list_get_item_eliminator 1.97% : 0.000007s : 43: predicate.tuple_list_set_item_eliminator 1.75% : 0.000007s : 50: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.94% : 0.000007s : 43: predicate.value_based_eliminate 0.11% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.27% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004485 36 31.79% : 0.001426s : 19: func_graph_cloner_run.FuncGraphClonerGraph 68.21% : 0.003059s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075676 87 0.06% : 0.000048s : 1: add_recomputation 0.11% : 0.000080s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.33% : 0.000249s : 1: bootstrap 0.03% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.11% : 0.000081s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 40.93% : 0.030977s : 1: jit_opt_a 0.20% : 0.000153s : 1: jit_opt_after_cconv 0.07% : 0.000052s : 1: jit_opt_b 0.56% : 0.000421s : 1: loop_unroll 0.97% : 0.000734s : 1: mutable_eliminate 3.78% : 0.002857s : 39: opt.transform.jit_opt_a 0.05% : 0.000039s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000024s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000035s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 24.79% : 0.018760s : 2: renormalize.infer 3.32% : 0.002510s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.16% : 0.000125s : 1: rewriter_before_opt_a 0.10% : 0.000076s : 1: symbol_engine_optimizer 23.39% : 0.017701s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.119.891 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006fa60> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.120.553 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0385305, [30] [bootstrap]: 0.00031815 [type_inference]: 0.0249284 [event_method]: 2.127e-05 [auto_monad]: 6.849e-05 [graph_reusing]: 5.81003e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 0.00013445 [rewriter_before_opt_a]: 8.163e-05 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.00934244, [2] [Cycle 1]: 0.0030106, [27] [switch_simplify]: 7.869e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.0006842 [with_stream_mark]: 2.233e-05 [recompute_prepare]: 9.29998e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.78997e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.91999e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.692e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 6.38e-06 [renormalize]: 0.00177161 [add_forward_monad_depend]: 9.58002e-06 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 2.314e-05 [cse]: 4.077e-05 [replace_applicator]: 2.568e-05 [Cycle 2]: 0.0004391, [27] [switch_simplify]: 8.07e-06 [loop_unroll]: 6.77002e-06 [a_1]: 0.00012275 [with_stream_mark]: 1.551e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 7.36999e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 5.47999e-06 [cell_reuse_recompute_pass]: 5.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.184e-05 [j_node_and_user_rematch]: 1.138e-05 [meta_fg_expand]: 2.58003e-06 [replace_old_param]: 1.204e-05 [inline_without_move]: 5.68002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.11998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 1.101e-05 [cse]: 1.837e-05 [replace_applicator]: 7.55e-06 [py_interpret_to_execute_after_opt_a]: 2.523e-05 [rewriter_after_opt_a]: 0.00028411 [convert_after_rewriter]: 2.135e-05 [order_py_execute_after_rewriter]: 6.12999e-06 [mutable_eliminate]: 0.00102191 [jit_opt_b]: 6.278e-05, [1] [Cycle 1]: 5.318e-05, [2] [frontend_op_eliminate]: 2.09e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 3.726e-05 [loop_unroll]: 0.00057323 [jit_opt_after_cconv]: 0.00019826, [1] [Cycle 1]: 0.0001898, [11] [c_1]: 2.627e-05 [parameter_eliminate]: 5.89999e-06 [updatestate_depend_eliminate]: 9.77001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.99002e-06 [cse]: 4.466e-05 [call_graph_tuple_transform]: 2.746e-05 [tuple_list_get_item_eliminator]: 7.20003e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 2.027e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 7.88001e-06 [add_recomputation]: 5.866e-05 [cse_after_recomputation]: 2.922e-05, [1] [Cycle 1]: 2.322e-05, [1] [cse]: 1.588e-05 [auto_monad_reorder]: 1.915e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 9.37001e-06 [opt_after_jit_grad]: 0.00066968 [symbol_engine_optimizer]: 9.073e-05, [1] [Cycle 1]: 8.156e-05, [6] [build]: 5.40001e-06 [elim_shapecalc]: 9.99999e-06 [elim_not_effective]: 1.751e-05 [opt_reshape]: 8.37e-06 [fold_const_symbol]: 1.054e-05 [renormalize]: 6.79982e-07 [validate]: 5.5e-05 Sums bootstrap : 0.000318s : 1.00% type_inference : 0.024928s : 78.59% event_method : 0.000021s : 0.07% auto_monad : 0.000068s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000134s : 0.42% rewriter_before_opt_a : 0.000082s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000087s : 0.27% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000807s : 2.54% jit_opt_a.with_stream_mark : 0.000038s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000010s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000023s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001772s : 5.59% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.11% jit_opt_a.cse : 0.000059s : 0.19% jit_opt_a.replace_applicator : 0.000033s : 0.10% py_interpret_to_execute_after_opt_a : 0.000025s : 0.08% rewriter_after_opt_a : 0.000284s : 0.90% convert_after_rewriter : 0.000021s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.001022s : 3.22% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000037s : 0.12% loop_unroll : 0.000573s : 1.81% jit_opt_after_cconv.c_1 : 0.000026s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000045s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000059s : 0.18% cse_after_recomputation.cse : 0.000016s : 0.05% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000670s : 2.11% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.17% Time group info: ------[substitution.] 0.000302 23 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.03% : 0.000006s : 3: substitution.graph_param_transform 85.02% : 0.000257s : 4: substitution.inline 1.79% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000008s : 4: substitution.remove_not_recompute_node 2.43% : 0.000007s : 2: substitution.replace_old_param 4.50% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024841 2 90.47% : 0.022474s : 1: type_inference.infer 9.53% : 0.002367s : 1: type_inference.specialize ------[replace.] 0.000096 6 68.94% : 0.000066s : 4: replace.inline 31.06% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 6 95.32% : 0.000254s : 4: match.inline 4.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 2.68% : 0.000004s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.99% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.38% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.40% : 0.000002s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.46% : 0.000008s : 22: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.74% : 0.000002s : 6: predicate.less_batch_normalization 1.71% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.15% : 0.000003s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.87% : 0.000001s : 10: predicate.minmaximum_grad 2.39% : 0.000003s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 1.89% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.88% : 0.000003s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 10: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.49% : 0.000011s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001234 13 32.98% : 0.000407s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.93% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 62.09% : 0.000766s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041261 72 0.15% : 0.000062s : 1: add_recomputation 0.17% : 0.000072s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.82% : 0.000338s : 1: bootstrap 0.10% : 0.000040s : 1: cconv 0.06% : 0.000025s : 1: convert_after_rewriter 0.08% : 0.000031s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 22.66% : 0.009349s : 1: jit_opt_a 0.49% : 0.000203s : 1: jit_opt_after_cconv 0.16% : 0.000066s : 1: jit_opt_b 1.42% : 0.000584s : 1: loop_unroll 2.51% : 0.001035s : 1: mutable_eliminate 2.64% : 0.001090s : 26: opt.transform.jit_opt_a 0.15% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000031s : 4: opt.transform.jit_opt_b 0.04% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000024s : 1: opt.transform.mutable_eliminate 0.07% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.66% : 0.000683s : 1: opt_after_jit_grad 0.02% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000138s : 1: py_interpret_to_execute 0.07% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000023s : 1: remove_dup_value 2.37% : 0.000979s : 1: renormalize.infer 1.89% : 0.000781s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.72% : 0.000296s : 1: rewriter_after_opt_a 0.21% : 0.000086s : 1: rewriter_before_opt_a 0.23% : 0.000094s : 1: symbol_engine_optimizer 60.46% : 0.024945s : 1: type_inference TotalTime = 0.54347, [30] [bootstrap]: 0.00030876 [type_inference]: 0.496785 [event_method]: 2.692e-05 [auto_monad]: 7.628e-05 [graph_reusing]: 6.18002e-06 [pre_auto_parallel]: 3.05998e-06 [py_interpret_to_execute]: 0.00082021 [rewriter_before_opt_a]: 0.00011324 [expand_dump_flag]: 4.35e-06 [jit_opt_a]: 0.0428653, [2] [Cycle 1]: 0.00570395, [27] [switch_simplify]: 8.318e-05 [loop_unroll]: 6.5e-05 [a_1]: 0.00084419 [with_stream_mark]: 2.458e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 7.63999e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.79999e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 1.179e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.154e-05 [inline_without_move]: 7.31001e-06 [renormalize]: 0.00429739 [add_forward_monad_depend]: 6.24999e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.808e-05 [cse]: 3.716e-05 [replace_applicator]: 1.842e-05 [Cycle 2]: 0.00040161, [27] [switch_simplify]: 8.03999e-06 [loop_unroll]: 6.39001e-06 [a_1]: 0.00013623 [with_stream_mark]: 1.21e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.294e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.2e-06 [inline_without_move]: 6.41e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.86e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 7.53e-06 [cse]: 1.57e-05 [replace_applicator]: 6.76e-06 [py_interpret_to_execute_after_opt_a]: 1.576e-05 [rewriter_after_opt_a]: 4.21e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00064862 [jit_opt_b]: 6.001e-05, [1] [Cycle 1]: 5.331e-05, [2] [frontend_op_eliminate]: 2.157e-05 [inline_after_opt_a]: 1.964e-05 [cconv]: 2.768e-05 [loop_unroll]: 0.00046802 [jit_opt_after_cconv]: 0.00016693, [1] [Cycle 1]: 0.00016083, [11] [c_1]: 2.685e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 7.36001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 3.3e-06 [cse]: 2.757e-05 [call_graph_tuple_transform]: 2.369e-05 [tuple_list_get_item_eliminator]: 7.31001e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.7e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 8.93002e-06 [add_recomputation]: 5.107e-05 [cse_after_recomputation]: 2.593e-05, [1] [Cycle 1]: 2.086e-05, [1] [cse]: 1.437e-05 [auto_monad_reorder]: 1.663e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 6.06e-06 [opt_after_jit_grad]: 0.00047549 [symbol_engine_optimizer]: 0.00016375, [1] [Cycle 1]: 0.00015622, [6] [build]: 3.88999e-06 [elim_shapecalc]: 1.001e-05 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.96001e-06 [fold_const_symbol]: 9.165e-05 [renormalize]: 3.59985e-07 [validate]: 5e-05 Sums bootstrap : 0.000309s : 0.06% type_inference : 0.496785s : 98.17% event_method : 0.000027s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000820s : 0.16% rewriter_before_opt_a : 0.000113s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.02% jit_opt_a.loop_unroll : 0.000071s : 0.01% jit_opt_a.a_1 : 0.000980s : 0.19% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.004297s : 0.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000053s : 0.01% jit_opt_a.replace_applicator : 0.000025s : 0.00% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000649s : 0.13% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000028s : 0.01% loop_unroll : 0.000468s : 0.09% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000475s : 0.09% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000092s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.01% Time group info: ------[substitution.] 0.000445 28 0.42% : 0.000002s : 2: substitution.elim_not_effective 18.49% : 0.000082s : 2: substitution.fold_const_symbol 1.37% : 0.000006s : 4: substitution.graph_param_transform 70.94% : 0.000316s : 5: substitution.inline 0.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.86% : 0.000013s : 3: substitution.reduce_eliminate 1.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.10% : 0.000005s : 2: substitution.replace_old_param 2.91% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.496688 2 99.05% : 0.491949s : 1: type_inference.infer 0.95% : 0.004740s : 1: type_inference.specialize ------[replace.] 0.000129 7 67.84% : 0.000087s : 5: replace.inline 32.16% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000324 7 96.36% : 0.000312s : 5: match.inline 3.64% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.66% : 0.000002s : 13: predicate.addn_zero_filter 2.49% : 0.000004s : 13: predicate.arithmetic_simplify 1.41% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.09% : 0.000008s : 28: predicate.inline 1.01% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.38% : 0.000004s : 13: predicate.reduce_eliminate 1.86% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.60% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.30% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.16% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.26% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003037 25 60.02% : 0.001823s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.72% : 0.001115s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.549204 72 0.01% : 0.000054s : 1: add_recomputation 0.01% : 0.000080s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 0.06% : 0.000325s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.81% : 0.042871s : 1: jit_opt_a 0.03% : 0.000170s : 1: jit_opt_after_cconv 0.01% : 0.000063s : 1: jit_opt_b 0.09% : 0.000476s : 1: loop_unroll 0.12% : 0.000658s : 1: mutable_eliminate 0.23% : 0.001288s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.00% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000118s : 4: opt.transform.symbol_engine_opt 0.09% : 0.000483s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000827s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.58% : 0.003181s : 1: renormalize.infer 0.20% : 0.001105s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.02% : 0.000119s : 1: rewriter_before_opt_a 0.03% : 0.000167s : 1: symbol_engine_optimizer 90.46% : 0.496804s : 1: type_inference TotalTime = 0.516024, [30] [bootstrap]: 0.00035715 [type_inference]: 0.472765 [event_method]: 2.791e-05 [auto_monad]: 8.496e-05 [graph_reusing]: 5.75001e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 0.00068307 [rewriter_before_opt_a]: 0.00012173 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.00914766, [2] [Cycle 1]: 0.00483166, [27] [switch_simplify]: 7.704e-05 [loop_unroll]: 3.8e-05 [a_1]: 0.00078 [with_stream_mark]: 2.844e-05 [recompute_prepare]: 1.043e-05 [updatestate_depend_eliminate]: 5.03002e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 7.82998e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 7.68001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.37998e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.649e-05 [j_node_and_user_rematch]: 1.125e-05 [meta_fg_expand]: 3.05998e-06 [replace_old_param]: 1.262e-05 [inline_without_move]: 7.45e-06 [renormalize]: 0.00348662 [add_forward_monad_depend]: 9.17999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.035e-05 [cse]: 3.855e-05 [replace_applicator]: 2.394e-05 [Cycle 2]: 0.00039482, [27] [switch_simplify]: 7.75e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00012475 [with_stream_mark]: 1.678e-05 [recompute_prepare]: 6.38998e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 4.37998e-06 [cell_reuse_recompute_pass]: 3.43999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.784e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.76e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.22001e-06 [cse]: 1.454e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.583e-05 [rewriter_after_opt_a]: 4.34e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.0304686 [jit_opt_b]: 7.435e-05, [1] [Cycle 1]: 6.301e-05, [2] [frontend_op_eliminate]: 2.511e-05 [inline_after_opt_a]: 2.481e-05 [cconv]: 4.481e-05 [loop_unroll]: 0.00068275 [jit_opt_after_cconv]: 0.00021828, [1] [Cycle 1]: 0.00021002, [11] [c_1]: 2.886e-05 [parameter_eliminate]: 7.36999e-06 [updatestate_depend_eliminate]: 1.317e-05 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 4.25999e-06 [cse]: 5.39e-05 [call_graph_tuple_transform]: 2.9e-05 [tuple_list_get_item_eliminator]: 8.43999e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 1.07e-06 [switch_simplify]: 6.86001e-06 [remove_dup_value]: 2.178e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 1.285e-05 [add_recomputation]: 5.92e-05 [cse_after_recomputation]: 2.87e-05, [1] [Cycle 1]: 2.251e-05, [1] [cse]: 1.565e-05 [auto_monad_reorder]: 1.753e-05 [get_jit_bprop_graph]: 3.11001e-06 [rewriter_after_jit_bprop_graph]: 1.145e-05 [opt_after_jit_grad]: 0.00056158 [symbol_engine_optimizer]: 0.00019333, [1] [Cycle 1]: 0.00018645, [6] [build]: 5.43002e-06 [elim_shapecalc]: 1.051e-05 [elim_not_effective]: 1.662e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 0.00011715 [renormalize]: 9.29984e-07 [validate]: 0.00011977 Sums bootstrap : 0.000357s : 0.07% type_inference : 0.472765s : 92.44% event_method : 0.000028s : 0.01% auto_monad : 0.000085s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000683s : 0.13% rewriter_before_opt_a : 0.000122s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000085s : 0.02% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.000905s : 0.18% jit_opt_a.with_stream_mark : 0.000045s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003487s : 0.68% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000053s : 0.01% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.030469s : 5.96% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.00% jit_opt_b.inline_after_opt_a : 0.000025s : 0.00% cconv : 0.000045s : 0.01% loop_unroll : 0.000683s : 0.13% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000054s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000059s : 0.01% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000562s : 0.11% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000117s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000120s : 0.02% Time group info: ------[substitution.] 0.000429 25 0.48% : 0.000002s : 2: substitution.elim_not_effective 25.31% : 0.000108s : 2: substitution.fold_const_symbol 1.61% : 0.000007s : 4: substitution.graph_param_transform 65.42% : 0.000280s : 5: substitution.inline 1.01% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.23% : 0.000005s : 4: substitution.remove_not_recompute_node 1.43% : 0.000006s : 2: substitution.replace_old_param 3.51% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.472640 2 87.39% : 0.413035s : 1: type_inference.infer 12.61% : 0.059605s : 1: type_inference.specialize ------[replace.] 0.000114 7 67.25% : 0.000077s : 5: replace.inline 32.75% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 7 95.32% : 0.000277s : 5: match.inline 4.68% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.53% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.13% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.09% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.91% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.97% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 4.14% : 0.000007s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.74% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.76% : 0.000001s : 4: predicate.reset_defer_inline 1.14% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.27% : 0.000002s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 1.93% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.32% : 0.000012s : 64: predicate.switch_simplify 1.08% : 0.000002s : 13: predicate.tile_eliminate 1.09% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.07% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.25% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.50% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.20% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002820 25 64.56% : 0.001821s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.39% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.05% : 0.000904s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.520856 72 0.01% : 0.000062s : 1: add_recomputation 0.02% : 0.000088s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.07% : 0.000376s : 1: bootstrap 0.01% : 0.000048s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000016s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 1.76% : 0.009151s : 1: jit_opt_a 0.04% : 0.000222s : 1: jit_opt_after_cconv 0.01% : 0.000078s : 1: jit_opt_b 0.13% : 0.000692s : 1: loop_unroll 5.85% : 0.030494s : 1: mutable_eliminate 0.23% : 0.001191s : 26: opt.transform.jit_opt_a 0.01% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000041s : 4: opt.transform.jit_opt_b 0.00% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000047s : 1: opt.transform.mutable_eliminate 0.01% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000147s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000572s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000689s : 1: py_interpret_to_execute 0.00% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000024s : 1: remove_dup_value 0.48% : 0.002477s : 1: renormalize.infer 0.19% : 0.000996s : 1: renormalize.specialize 0.00% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.02% : 0.000127s : 1: rewriter_before_opt_a 0.04% : 0.000196s : 1: symbol_engine_optimizer 90.77% : 0.472791s : 1: type_inference TotalTime = 0.320419, [30] [bootstrap]: 0.00025757 [type_inference]: 0.270441 [event_method]: 0.00044671 [auto_monad]: 0.00013122 [graph_reusing]: 9.49e-06 [pre_auto_parallel]: 3.73001e-06 [py_interpret_to_execute]: 4.209e-05 [rewriter_before_opt_a]: 0.00013964 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00951663, [2] [Cycle 1]: 0.00530792, [27] [switch_simplify]: 0.00019771 [loop_unroll]: 5.744e-05 [a_1]: 0.00145803 [with_stream_mark]: 2.156e-05 [recompute_prepare]: 9.12999e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.63e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 0.00320559 [add_forward_monad_depend]: 7.98999e-06 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 1.633e-05 [cse]: 3.454e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.00036625, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.61e-06 [a_1]: 0.00010429 [with_stream_mark]: 1.258e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 3.10998e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.27998e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.16999e-06 [cse]: 1.641e-05 [replace_applicator]: 6.58998e-06 [py_interpret_to_execute_after_opt_a]: 1.406e-05 [rewriter_after_opt_a]: 3.884e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.68002e-06 [mutable_eliminate]: 0.00072003 [jit_opt_b]: 5.75e-05, [1] [Cycle 1]: 4.98e-05, [2] [frontend_op_eliminate]: 1.978e-05 [inline_after_opt_a]: 1.793e-05 [cconv]: 6.424e-05 [loop_unroll]: 0.00096454 [jit_opt_after_cconv]: 0.0002184, [1] [Cycle 1]: 0.00020841, [11] [c_1]: 3.343e-05 [parameter_eliminate]: 6.22001e-06 [updatestate_depend_eliminate]: 1.124e-05 [updatestate_assign_eliminate]: 3.62998e-06 [updatestate_loads_eliminate]: 5.04998e-06 [cse]: 4.653e-05 [call_graph_tuple_transform]: 2.787e-05 [tuple_list_get_item_eliminator]: 8.74e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 7.30998e-06 [remove_dup_value]: 1.937e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.62998e-06 [add_recomputation]: 5.707e-05 [cse_after_recomputation]: 2.902e-05, [1] [Cycle 1]: 2.353e-05, [1] [cse]: 1.659e-05 [auto_monad_reorder]: 1.739e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 1.027e-05 [opt_after_jit_grad]: 0.00055197 [symbol_engine_optimizer]: 0.00029225, [1] [Cycle 1]: 0.0002841, [6] [build]: 4.87e-06 [elim_shapecalc]: 1.226e-05 [elim_not_effective]: 1.666e-05 [opt_reshape]: 6.76e-06 [fold_const_symbol]: 0.00021014 [renormalize]: 5.19998e-07 [validate]: 5.095e-05 Sums bootstrap : 0.000258s : 0.09% type_inference : 0.270441s : 96.64% event_method : 0.000447s : 0.16% auto_monad : 0.000131s : 0.05% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000042s : 0.02% rewriter_before_opt_a : 0.000140s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000204s : 0.07% jit_opt_a.loop_unroll : 0.000063s : 0.02% jit_opt_a.a_1 : 0.001562s : 0.56% jit_opt_a.with_stream_mark : 0.000034s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.003206s : 1.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000051s : 0.02% jit_opt_a.replace_applicator : 0.000023s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000720s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000064s : 0.02% loop_unroll : 0.000965s : 0.34% jit_opt_after_cconv.c_1 : 0.000033s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000047s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000057s : 0.02% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000552s : 0.20% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000210s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.02% Time group info: ------[substitution.] 0.000801 35 0.26% : 0.000002s : 2: substitution.elim_not_effective 24.99% : 0.000200s : 2: substitution.fold_const_symbol 0.86% : 0.000007s : 3: substitution.graph_param_transform 68.00% : 0.000545s : 12: substitution.inline 0.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.57% : 0.000005s : 4: substitution.remove_not_recompute_node 0.52% : 0.000004s : 2: substitution.replace_old_param 1.23% : 0.000010s : 1: substitution.reshape_eliminate 1.75% : 0.000014s : 3: substitution.switch_simplify 1.35% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.270349 2 98.42% : 0.266082s : 1: type_inference.infer 1.58% : 0.004266s : 1: type_inference.specialize ------[replace.] 0.000318 18 50.34% : 0.000160s : 12: replace.inline 1.44% : 0.000005s : 1: replace.reshape_eliminate 20.53% : 0.000065s : 3: replace.switch_simplify 27.69% : 0.000088s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000569 18 94.56% : 0.000538s : 12: match.inline 1.56% : 0.000009s : 1: match.reshape_eliminate 2.18% : 0.000012s : 3: match.switch_simplify 1.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000216 1212 1.48% : 0.000003s : 19: predicate.accumulaten_eliminater 1.07% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 19: predicate.addn_check_dump 1.40% : 0.000003s : 19: predicate.addn_zero_filter 2.12% : 0.000005s : 19: predicate.arithmetic_simplify 1.38% : 0.000003s : 20: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.35% : 0.000003s : 19: predicate.compare_switch_simplify 1.30% : 0.000003s : 19: predicate.depend_value_elim 1.26% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.51% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.22% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.36% : 0.000003s : 20: predicate.environ_get_depend_swap 1.53% : 0.000003s : 20: predicate.environ_get_eliminate 1.23% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.62% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000001s : 3: predicate.graph_param_transform 5.86% : 0.000013s : 40: predicate.inline 0.54% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.91% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.78% : 0.000004s : 25: predicate.load_eliminater 1.47% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.64% : 0.000010s : 64: predicate.loop_unroll_before_grad 2.37% : 0.000005s : 23: predicate.make_slice_get_slice_eliminator 1.22% : 0.000003s : 19: predicate.merge_addn 1.17% : 0.000003s : 19: predicate.minmaximum_grad 1.30% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000004s : 25: predicate.partial_eliminate 1.21% : 0.000003s : 19: predicate.print_const_string_wrapper 1.75% : 0.000004s : 19: predicate.reduce_eliminate 1.47% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.29% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000004s : 28: predicate.replace_applicator 0.30% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.82% : 0.000004s : 20: predicate.reshape_eliminate 1.36% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.46% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000003s : 19: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.69% : 0.000001s : 6: predicate.special_op_eliminate 0.52% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.99% : 0.000006s : 34: predicate.switch_defer_inline 2.57% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.68% : 0.000019s : 107: predicate.switch_simplify 1.50% : 0.000003s : 19: predicate.tile_eliminate 1.32% : 0.000003s : 19: predicate.transpose_eliminate 1.47% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.58% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.69% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.64% : 0.000004s : 25: predicate.updatestate_pure_node_eliminater 2.47% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.60% : 0.000003s : 19: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003445 40 57.40% : 0.001977s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.81% : 0.000304s : 5: func_graph_cloner_run.FuncGraphClonerNode 33.79% : 0.001164s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.325862 72 0.02% : 0.000060s : 1: add_recomputation 0.04% : 0.000137s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.08% : 0.000275s : 1: bootstrap 0.02% : 0.000072s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.14% : 0.000454s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000012s : 1: graph_reusing 2.92% : 0.009521s : 1: jit_opt_a 0.07% : 0.000224s : 1: jit_opt_after_cconv 11.09% : 0.036132s : 1: jit_opt_b 0.30% : 0.000974s : 1: loop_unroll 0.22% : 0.000729s : 1: mutable_eliminate 0.60% : 0.001962s : 26: opt.transform.jit_opt_a 0.02% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000026s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000240s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000560s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.01% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.72% : 0.002342s : 1: renormalize.infer 0.26% : 0.000853s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.04% : 0.000143s : 1: rewriter_before_opt_a 0.09% : 0.000295s : 1: symbol_engine_optimizer 83.00% : 0.270457s : 1: type_inference TotalTime = 0.202371, [30] [bootstrap]: 0.00022375 [type_inference]: 0.147081 [event_method]: 0.00089333 [auto_monad]: 0.00014343 [graph_reusing]: 8.60001e-06 [pre_auto_parallel]: 4.25e-06 [py_interpret_to_execute]: 0.00010081 [rewriter_before_opt_a]: 0.00020445 [expand_dump_flag]: 4.43999e-06 [jit_opt_a]: 0.0512367, [3] [Cycle 1]: 0.0242726, [27] [switch_simplify]: 0.00010844 [loop_unroll]: 4.746e-05 [a_1]: 0.001252 [with_stream_mark]: 4.933e-05 [recompute_prepare]: 3.368e-05 [updatestate_depend_eliminate]: 1.315e-05 [updatestate_assign_eliminate]: 8.47e-06 [updatestate_loads_eliminate]: 8.72e-06 [parameter_eliminate]: 4.20999e-06 [specialize_transform]: 1.766e-05 [updatestate_useless_node_eliminater]: 1.618e-05 [accelerated_algorithm]: 1.642e-05 [meta_shard_fg_expand]: 7.4e-06 [get_grad_eliminate_]: 1.64e-05 [merge_forward]: 1.05e-05 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.344e-05 [j_node_and_user_rematch]: 2.868e-05 [meta_fg_expand]: 0.0027917 [replace_old_param]: 0.00010795 [inline_without_move]: 7.687e-05 [renormalize]: 0.0187063 [add_forward_monad_depend]: 1.851e-05 [auto_monad_grad]: 6.78e-06 [auto_monad_eliminator]: 7.509e-05 [cse]: 0.00036583 [replace_applicator]: 0.00011171 [Cycle 2]: 0.022022, [27] [switch_simplify]: 4.53e-05 [loop_unroll]: 4.367e-05 [a_1]: 0.00134594 [with_stream_mark]: 2.538e-05 [recompute_prepare]: 1.205e-05 [updatestate_depend_eliminate]: 6.66999e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 2.73003e-06 [specialize_transform]: 7.43e-06 [updatestate_useless_node_eliminater]: 7.61001e-06 [accelerated_algorithm]: 7.09001e-06 [meta_shard_fg_expand]: 4.25e-06 [get_grad_eliminate_]: 9.25001e-06 [merge_forward]: 5.96e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.242e-05 [j_node_and_user_rematch]: 1.218e-05 [meta_fg_expand]: 0.00020553 [replace_old_param]: 1.305e-05 [inline_without_move]: 7.65e-06 [renormalize]: 0.0199111 [add_forward_monad_depend]: 1.447e-05 [auto_monad_grad]: 2.86999e-06 [auto_monad_eliminator]: 2.317e-05 [cse]: 3.706e-05 [replace_applicator]: 2.706e-05 [Cycle 3]: 0.00037306, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.36998e-06 [a_1]: 9.832e-05 [with_stream_mark]: 1.517e-05 [recompute_prepare]: 5.65001e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 5.66003e-06 [updatestate_useless_node_eliminater]: 6.68003e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 2.96001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.986e-05 [j_node_and_user_rematch]: 1.047e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 5.00999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 6.21998e-06 [cse]: 1.275e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 1.741e-05 [rewriter_after_opt_a]: 3.711e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00085203 [jit_opt_b]: 5.096e-05, [1] [Cycle 1]: 4.329e-05, [2] [frontend_op_eliminate]: 1.541e-05 [inline_after_opt_a]: 1.516e-05 [cconv]: 2.736e-05 [loop_unroll]: 0.00042481 [jit_opt_after_cconv]: 0.00014176, [1] [Cycle 1]: 0.00013498, [11] [c_1]: 1.769e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.78e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 2.065e-05 [call_graph_tuple_transform]: 1.739e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 4.89e-06 [remove_dup_value]: 1.714e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 5.90002e-06 [add_recomputation]: 4.854e-05 [cse_after_recomputation]: 2.365e-05, [1] [Cycle 1]: 1.857e-05, [1] [cse]: 1.212e-05 [auto_monad_reorder]: 1.473e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 5.24e-06 [opt_after_jit_grad]: 0.00044329 [symbol_engine_optimizer]: 7.395e-05, [1] [Cycle 1]: 6.782e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.205e-05 [opt_reshape]: 5.24e-06 [fold_const_symbol]: 8.03999e-06 [renormalize]: 4.90021e-07 [validate]: 3.698e-05 Sums bootstrap : 0.000224s : 0.11% type_inference : 0.147081s : 74.75% event_method : 0.000893s : 0.45% auto_monad : 0.000143s : 0.07% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000101s : 0.05% rewriter_before_opt_a : 0.000204s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000161s : 0.08% jit_opt_a.loop_unroll : 0.000097s : 0.05% jit_opt_a.a_1 : 0.002696s : 1.37% jit_opt_a.with_stream_mark : 0.000090s : 0.05% jit_opt_a.recompute_prepare : 0.000051s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000024s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000009s : 0.00% jit_opt_a.specialize_transform : 0.000031s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000030s : 0.02% jit_opt_a.accelerated_algorithm : 0.000029s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000014s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000032s : 0.02% jit_opt_a.merge_forward : 0.000021s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000076s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000051s : 0.03% jit_opt_a.meta_fg_expand : 0.003000s : 1.52% jit_opt_a.replace_old_param : 0.000126s : 0.06% jit_opt_a.inline_without_move : 0.000089s : 0.05% jit_opt_a.renormalize : 0.038617s : 19.63% jit_opt_a.add_forward_monad_depend : 0.000034s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000104s : 0.05% jit_opt_a.cse : 0.000416s : 0.21% jit_opt_a.replace_applicator : 0.000144s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000852s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000425s : 0.22% jit_opt_after_cconv.c_1 : 0.000018s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000443s : 0.23% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.02% Time group info: ------[substitution.] 0.000838 109 0.21% : 0.000002s : 2: substitution.elim_not_effective 0.14% : 0.000001s : 2: substitution.fold_const_symbol 0.64% : 0.000005s : 2: substitution.graph_param_transform 70.09% : 0.000587s : 13: substitution.inline 3.29% : 0.000028s : 2: substitution.inline_without_move 1.39% : 0.000012s : 13: substitution.j_node_and_user_rematch 1.67% : 0.000014s : 7: substitution.minmaximum_grad 1.07% : 0.000009s : 5: substitution.partial_eliminate 1.72% : 0.000014s : 13: substitution.remove_not_recompute_node 5.35% : 0.000045s : 10: substitution.replace_applicator 1.20% : 0.000010s : 10: substitution.replace_old_param 0.50% : 0.000004s : 1: substitution.set_cell_output_no_recompute 0.80% : 0.000007s : 1: substitution.tile_eliminate 3.29% : 0.000028s : 7: substitution.tuple_list_convert_item_index_to_positive 2.07% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.58% : 0.000055s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.146921 2 95.73% : 0.140644s : 1: type_inference.infer 4.27% : 0.006277s : 1: type_inference.specialize ------[replace.] 0.000251 20 66.47% : 0.000167s : 13: replace.inline 33.53% : 0.000084s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000604 20 95.24% : 0.000575s : 13: match.inline 4.76% : 0.000029s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000427 2628 1.43% : 0.000006s : 45: predicate.accumulaten_eliminater 0.24% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.34% : 0.000006s : 45: predicate.addn_check_dump 1.58% : 0.000007s : 45: predicate.addn_zero_filter 2.29% : 0.000010s : 45: predicate.arithmetic_simplify 1.41% : 0.000006s : 45: predicate.cast_eliminate 0.10% : 0.000000s : 2: predicate.check_bprop_eliminate 1.43% : 0.000006s : 45: predicate.compare_switch_simplify 1.39% : 0.000006s : 45: predicate.depend_value_elim 1.29% : 0.000005s : 45: predicate.dict_get_item_const_eliminator 1.44% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.67% : 0.000007s : 45: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 45: predicate.environ_add_const_eliminate 2.20% : 0.000009s : 45: predicate.environ_get_add_eliminate 1.36% : 0.000006s : 45: predicate.environ_get_depend_swap 1.52% : 0.000006s : 45: predicate.environ_get_eliminate 1.32% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.95% : 0.000004s : 18: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.56% : 0.000019s : 69: predicate.inline 2.16% : 0.000009s : 46: predicate.inline_without_move 0.32% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.11% : 0.000005s : 18: predicate.less_batch_normalization 1.67% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.83% : 0.000008s : 54: predicate.load_eliminater 0.33% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.24% : 0.000014s : 93: predicate.loop_unroll_before_grad 1.57% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.25% : 0.000005s : 45: predicate.merge_addn 1.37% : 0.000006s : 45: predicate.minmaximum_grad 0.48% : 0.000002s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.33% : 0.000010s : 54: predicate.partial_eliminate 1.35% : 0.000006s : 45: predicate.print_const_string_wrapper 2.23% : 0.000010s : 45: predicate.reduce_eliminate 1.81% : 0.000008s : 52: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000002s : 18: predicate.remove_not_recompute_node 2.76% : 0.000012s : 99: predicate.replace_applicator 1.15% : 0.000005s : 46: predicate.replace_old_param 0.06% : 0.000000s : 2: predicate.reset_defer_inline 1.70% : 0.000007s : 45: predicate.reshape_eliminate 1.40% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 2: predicate.row_tensor_eliminate 1.43% : 0.000006s : 45: predicate.same_eliminate 0.70% : 0.000003s : 18: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 4: predicate.special_op_eliminate 0.76% : 0.000003s : 18: predicate.specialize_transform 1.89% : 0.000008s : 45: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000007s : 45: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 3.28% : 0.000014s : 65: predicate.switch_defer_inline 2.40% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.18% : 0.000026s : 160: predicate.switch_simplify 1.50% : 0.000006s : 45: predicate.tile_eliminate 1.55% : 0.000007s : 45: predicate.transpose_eliminate 1.92% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.83% : 0.000008s : 45: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000017s : 56: predicate.tuple_list_get_item_eliminator 2.01% : 0.000009s : 45: predicate.tuple_list_set_item_eliminator 1.80% : 0.000008s : 52: predicate.tuple_to_list_eliminator_ 1.78% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.65% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.75% : 0.000007s : 45: predicate.value_based_eliminate 0.10% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005466 45 66.96% : 0.003660s : 28: func_graph_cloner_run.FuncGraphClonerGraph 33.04% : 0.001806s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.244536 87 0.02% : 0.000051s : 1: add_recomputation 0.06% : 0.000154s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.10% : 0.000245s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.37% : 0.000906s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000012s : 1: graph_reusing 20.95% : 0.051242s : 1: jit_opt_a 0.06% : 0.000144s : 1: jit_opt_after_cconv 0.02% : 0.000053s : 1: jit_opt_b 0.18% : 0.000432s : 1: loop_unroll 0.35% : 0.000861s : 1: mutable_eliminate 1.45% : 0.003541s : 39: opt.transform.jit_opt_a 0.02% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000024s : 4: opt.transform.jit_opt_b 0.00% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000451s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000105s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 14.21% : 0.034738s : 2: renormalize.infer 1.57% : 0.003846s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000224s : 1: rewriter_before_opt_a 0.03% : 0.000076s : 1: symbol_engine_optimizer 60.16% : 0.147107s : 1: type_inference TotalTime = 0.310221, [30] [bootstrap]: 0.00034823 [type_inference]: 0.236936 [event_method]: 2.51e-05 [auto_monad]: 8.437e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00091047 [rewriter_before_opt_a]: 0.00010505 [expand_dump_flag]: 4.18999e-06 [jit_opt_a]: 0.0683922, [2] [Cycle 1]: 0.0631636, [27] [switch_simplify]: 7.963e-05 [loop_unroll]: 3.208e-05 [a_1]: 0.00076176 [with_stream_mark]: 2.907e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 4.22e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.73e-06 [specialize_transform]: 8.33001e-06 [updatestate_useless_node_eliminater]: 7.08e-06 [accelerated_algorithm]: 7.89002e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.98e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.764e-05 [j_node_and_user_rematch]: 1.141e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.187e-05 [inline_without_move]: 6.12001e-06 [renormalize]: 0.0617879 [add_forward_monad_depend]: 1.374e-05 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 2.749e-05 [cse]: 4.245e-05 [replace_applicator]: 2.965e-05 [Cycle 2]: 0.00045334, [27] [switch_simplify]: 8.73001e-06 [loop_unroll]: 7.65e-06 [a_1]: 0.00015557 [with_stream_mark]: 2.035e-05 [recompute_prepare]: 6.88e-06 [updatestate_depend_eliminate]: 3.99002e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 3.22002e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 5.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.238e-05 [j_node_and_user_rematch]: 1.127e-05 [meta_fg_expand]: 3.58e-06 [replace_old_param]: 1.186e-05 [inline_without_move]: 5.85002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 7.89002e-06 [cse]: 1.388e-05 [replace_applicator]: 6.08002e-06 [py_interpret_to_execute_after_opt_a]: 2.176e-05 [rewriter_after_opt_a]: 9.044e-05 [convert_after_rewriter]: 9.07999e-06 [order_py_execute_after_rewriter]: 6.42001e-06 [mutable_eliminate]: 0.00107711 [jit_opt_b]: 7.805e-05, [1] [Cycle 1]: 6.85e-05, [2] [frontend_op_eliminate]: 2.983e-05 [inline_after_opt_a]: 2.443e-05 [cconv]: 3.738e-05 [loop_unroll]: 0.00056411 [jit_opt_after_cconv]: 0.00019836, [1] [Cycle 1]: 0.00019121, [11] [c_1]: 3.289e-05 [parameter_eliminate]: 5.17e-06 [updatestate_depend_eliminate]: 9.09e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 3.87e-05 [call_graph_tuple_transform]: 2.557e-05 [tuple_list_get_item_eliminator]: 6.61999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 7.19001e-06 [remove_dup_value]: 1.838e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 9.94001e-06 [add_recomputation]: 6.263e-05 [cse_after_recomputation]: 2.653e-05, [1] [Cycle 1]: 1.979e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.721e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 1.127e-05 [opt_after_jit_grad]: 0.0005462 [symbol_engine_optimizer]: 9.69e-05, [1] [Cycle 1]: 8.998e-05, [6] [build]: 4.66002e-06 [elim_shapecalc]: 9.32999e-06 [elim_not_effective]: 1.829e-05 [opt_reshape]: 7.26001e-06 [fold_const_symbol]: 1.534e-05 [renormalize]: 3.30008e-07 [validate]: 0.00028111 Sums bootstrap : 0.000348s : 0.11% type_inference : 0.236936s : 77.76% event_method : 0.000025s : 0.01% auto_monad : 0.000084s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000910s : 0.30% rewriter_before_opt_a : 0.000105s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.01% jit_opt_a.a_1 : 0.000917s : 0.30% jit_opt_a.with_stream_mark : 0.000049s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.061788s : 20.28% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000090s : 0.03% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001077s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000037s : 0.01% loop_unroll : 0.000564s : 0.19% jit_opt_after_cconv.c_1 : 0.000033s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000063s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000546s : 0.18% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000281s : 0.09% Time group info: ------[substitution.] 0.000337 24 1.64% : 0.000006s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000007s : 4: substitution.graph_param_transform 85.57% : 0.000289s : 4: substitution.inline 1.61% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000007s : 4: substitution.remove_not_recompute_node 2.38% : 0.000008s : 2: substitution.replace_old_param 4.26% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.236804 2 97.16% : 0.230083s : 1: type_inference.infer 2.84% : 0.006721s : 1: type_inference.specialize ------[replace.] 0.000106 6 67.63% : 0.000071s : 4: replace.inline 32.37% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000299 6 95.58% : 0.000286s : 4: match.inline 4.42% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000162 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 12: predicate.addn_check_dump 1.45% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.71% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 12: predicate.compare_switch_simplify 0.90% : 0.000001s : 12: predicate.depend_value_elim 0.91% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.95% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 12: predicate.environ_get_depend_swap 1.47% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000008s : 26: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.25% : 0.000004s : 18: predicate.load_eliminater 1.63% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.49% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000002s : 12: predicate.minmaximum_grad 2.76% : 0.000004s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 1.99% : 0.000003s : 18: predicate.partial_eliminate 1.02% : 0.000002s : 12: predicate.print_const_string_wrapper 2.04% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.50% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.71% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.42% : 0.000010s : 58: predicate.switch_simplify 1.42% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 2.08% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.38% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000003s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.020913 22 90.35% : 0.018894s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.31% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 9.34% : 0.001954s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.373071 72 0.02% : 0.000066s : 1: add_recomputation 0.02% : 0.000088s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.10% : 0.000368s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 18.33% : 0.068397s : 1: jit_opt_a 0.05% : 0.000201s : 1: jit_opt_after_cconv 0.02% : 0.000081s : 1: jit_opt_b 0.15% : 0.000575s : 1: loop_unroll 0.29% : 0.001090s : 1: mutable_eliminate 0.32% : 0.001211s : 26: opt.transform.jit_opt_a 0.02% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000044s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000556s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000924s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 15.97% : 0.059580s : 1: renormalize.infer 0.59% : 0.002189s : 1: renormalize.specialize 0.00% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000096s : 1: rewriter_after_opt_a 0.03% : 0.000111s : 1: rewriter_before_opt_a 0.03% : 0.000099s : 1: symbol_engine_optimizer 63.52% : 0.236968s : 1: type_inference TotalTime = 0.0741553, [30] [bootstrap]: 0.00026106 [type_inference]: 0.052301 [event_method]: 2.26e-05 [auto_monad]: 7.092e-05 [graph_reusing]: 6.33998e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 9.891e-05 [rewriter_before_opt_a]: 8.114e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0189619, [2] [Cycle 1]: 0.0153225, [27] [switch_simplify]: 6.671e-05 [loop_unroll]: 2.859e-05 [a_1]: 0.00051965 [with_stream_mark]: 1.944e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.8e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.437e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.0143242 [add_forward_monad_depend]: 8.74e-06 [auto_monad_grad]: 2.65997e-06 [auto_monad_eliminator]: 1.68e-05 [cse]: 3.747e-05 [replace_applicator]: 2.314e-05 [Cycle 2]: 0.00035494, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.37001e-06 [a_1]: 9.921e-05 [with_stream_mark]: 1.523e-05 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.18998e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 3.55e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.868e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.02999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.295e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.329e-05 [rewriter_after_opt_a]: 3.965e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00078774 [jit_opt_b]: 5.064e-05, [1] [Cycle 1]: 4.305e-05, [2] [frontend_op_eliminate]: 1.602e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 2.817e-05 [loop_unroll]: 0.00041001 [jit_opt_after_cconv]: 0.00014252, [1] [Cycle 1]: 0.00013625, [11] [c_1]: 2.094e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.99e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.169e-05 [call_graph_tuple_transform]: 1.94e-05 [tuple_list_get_item_eliminator]: 5.30999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.46e-06 [remove_dup_value]: 1.584e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 5.196e-05 [cse_after_recomputation]: 3.819e-05, [1] [Cycle 1]: 3.312e-05, [1] [cse]: 2.708e-05 [auto_monad_reorder]: 1.948e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00043938 [symbol_engine_optimizer]: 7.211e-05, [1] [Cycle 1]: 6.582e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.99998e-06 [renormalize]: 4.39992e-07 [validate]: 3.725e-05 Sums bootstrap : 0.000261s : 0.37% type_inference : 0.052301s : 74.41% event_method : 0.000023s : 0.03% auto_monad : 0.000071s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000099s : 0.14% rewriter_before_opt_a : 0.000081s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.10% jit_opt_a.loop_unroll : 0.000034s : 0.05% jit_opt_a.a_1 : 0.000619s : 0.88% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.014324s : 20.38% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000050s : 0.07% jit_opt_a.replace_applicator : 0.000028s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000788s : 1.12% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000028s : 0.04% loop_unroll : 0.000410s : 0.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000027s : 0.04% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000439s : 0.63% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.05% Time group info: ------[substitution.] 0.000207 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 82.56% : 0.000171s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.82% : 0.000006s : 4: substitution.remove_not_recompute_node 2.51% : 0.000005s : 2: substitution.replace_old_param 6.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052220 2 96.91% : 0.050605s : 1: type_inference.infer 3.09% : 0.001615s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.70% : 0.000046s : 4: replace.inline 31.30% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.61% : 0.000169s : 4: match.inline 6.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.97% : 0.000002s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.75% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.08% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.80% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.98% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 2.07% : 0.000002s : 18: predicate.replace_applicator 0.92% : 0.000001s : 6: predicate.replace_old_param 0.63% : 0.000001s : 3: predicate.reset_defer_inline 1.81% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000842 13 41.28% : 0.000348s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.91% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.81% : 0.000453s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.089381 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000074s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.31% : 0.000276s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000040s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 21.22% : 0.018966s : 1: jit_opt_a 0.16% : 0.000145s : 1: jit_opt_after_cconv 0.06% : 0.000053s : 1: jit_opt_b 0.47% : 0.000418s : 1: loop_unroll 0.89% : 0.000796s : 1: mutable_eliminate 0.95% : 0.000845s : 26: opt.transform.jit_opt_a 0.05% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000102s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 15.51% : 0.013861s : 1: renormalize.infer 0.50% : 0.000451s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000085s : 1: rewriter_before_opt_a 0.08% : 0.000075s : 1: symbol_engine_optimizer 58.54% : 0.052324s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.451.429 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.452.169 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.177566, [30] [bootstrap]: 0.00029775 [type_inference]: 0.0895082 [event_method]: 1.999e-05 [auto_monad]: 6.798e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.33002e-06 [py_interpret_to_execute]: 0.00010071 [rewriter_before_opt_a]: 8.265e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.0822136, [2] [Cycle 1]: 0.0786028, [27] [switch_simplify]: 5.079e-05 [loop_unroll]: 2.948e-05 [a_1]: 0.00051429 [with_stream_mark]: 1.714e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.33002e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 2.79001e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.57002e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 8.29002e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.53001e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 0.0775992 [add_forward_monad_depend]: 1.278e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 2.069e-05 [cse]: 4.004e-05 [replace_applicator]: 2.837e-05 [Cycle 2]: 0.00036382, [27] [switch_simplify]: 6.48998e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00010363 [with_stream_mark]: 1.611e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.55997e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 4.24997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.839e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.22e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.51e-06 [cse]: 1.424e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 1.851e-05 [rewriter_after_opt_a]: 4.692e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00079302 [jit_opt_b]: 5.33e-05, [1] [Cycle 1]: 4.49e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.709e-05 [cconv]: 3.149e-05 [loop_unroll]: 0.00043129 [jit_opt_after_cconv]: 0.00016365, [1] [Cycle 1]: 0.00015748, [11] [c_1]: 2.102e-05 [parameter_eliminate]: 1.331e-05 [updatestate_depend_eliminate]: 8.15999e-06 [updatestate_assign_eliminate]: 2.95002e-06 [updatestate_loads_eliminate]: 2.86999e-06 [cse]: 2.814e-05 [call_graph_tuple_transform]: 1.872e-05 [tuple_list_get_item_eliminator]: 5.28002e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.53997e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.46999e-06 [add_recomputation]: 5.46e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.728e-05, [1] [cse]: 1.194e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.97001e-06 [opt_after_jit_grad]: 0.00048203 [symbol_engine_optimizer]: 0.00011263, [1] [Cycle 1]: 0.00010181, [6] [build]: 6.71e-06 [elim_shapecalc]: 2.262e-05 [elim_not_effective]: 1.607e-05 [opt_reshape]: 6.76999e-06 [fold_const_symbol]: 1.025e-05 [renormalize]: 6.00005e-07 [validate]: 5.435e-05 Sums bootstrap : 0.000298s : 0.17% type_inference : 0.089508s : 52.36% event_method : 0.000020s : 0.01% auto_monad : 0.000068s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000101s : 0.06% rewriter_before_opt_a : 0.000083s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.03% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000618s : 0.36% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.077599s : 45.40% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000047s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000793s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000431s : 0.25% jit_opt_after_cconv.c_1 : 0.000021s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000055s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000482s : 0.28% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000023s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.03% Time group info: ------[substitution.] 0.000203 23 1.22% : 0.000002s : 2: substitution.elim_not_effective 0.85% : 0.000002s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 82.05% : 0.000166s : 4: substitution.inline 1.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.83% : 0.000006s : 4: substitution.remove_not_recompute_node 2.43% : 0.000005s : 2: substitution.replace_old_param 5.89% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.089434 2 98.38% : 0.087986s : 1: type_inference.infer 1.62% : 0.001448s : 1: type_inference.specialize ------[replace.] 0.000067 6 69.07% : 0.000046s : 4: replace.inline 30.93% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.81% : 0.000164s : 4: match.inline 6.19% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.62% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.62% : 0.000001s : 3: predicate.elim_not_effective 1.28% : 0.000002s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.31% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.30% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.99% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.30% : 0.000003s : 15: predicate.load_eliminater 1.19% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.96% : 0.000002s : 3: predicate.mutable_eliminate 0.78% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000971 13 42.71% : 0.000415s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.85% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.44% : 0.000519s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.256059 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000071s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000318s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 32.11% : 0.082217s : 1: jit_opt_a 0.06% : 0.000166s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.17% : 0.000440s : 1: loop_unroll 0.31% : 0.000804s : 1: mutable_eliminate 0.33% : 0.000848s : 26: opt.transform.jit_opt_a 0.02% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000049s : 4: opt.transform.symbol_engine_opt 1.26% : 0.003228s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.04% : 0.000104s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 30.06% : 0.076962s : 1: renormalize.infer 0.24% : 0.000624s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000051s : 1: rewriter_after_opt_a 0.03% : 0.000086s : 1: rewriter_before_opt_a 0.05% : 0.000117s : 1: symbol_engine_optimizer 34.96% : 0.089528s : 1: type_inference TotalTime = 0.272811, [30] [bootstrap]: 0.0003071 [type_inference]: 0.260382 [event_method]: 2.313e-05 [auto_monad]: 7.434e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00063425 [rewriter_before_opt_a]: 0.00014765 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.00884098, [2] [Cycle 1]: 0.00483361, [27] [switch_simplify]: 6.452e-05 [loop_unroll]: 3.505e-05 [a_1]: 0.00079568 [with_stream_mark]: 2.188e-05 [recompute_prepare]: 9.32001e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.93003e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 7.48999e-06 [updatestate_useless_node_eliminater]: 6.26998e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.78998e-06 [replace_old_param]: 1.119e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00353154 [add_forward_monad_depend]: 8.33999e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.916e-05 [cse]: 3.459e-05 [replace_applicator]: 2.028e-05 [Cycle 2]: 0.00040959, [27] [switch_simplify]: 7.60998e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00014032 [with_stream_mark]: 1.508e-05 [recompute_prepare]: 6.73e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 2.90002e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 2.98e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.603e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 1.47001e-06 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.453e-05 [replace_applicator]: 6.41e-06 [py_interpret_to_execute_after_opt_a]: 1.437e-05 [rewriter_after_opt_a]: 3.88e-05 [convert_after_rewriter]: 7.61999e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00069629 [jit_opt_b]: 5.598e-05, [1] [Cycle 1]: 4.876e-05, [2] [frontend_op_eliminate]: 1.962e-05 [inline_after_opt_a]: 1.807e-05 [cconv]: 2.608e-05 [loop_unroll]: 0.00042438 [jit_opt_after_cconv]: 0.00017157, [1] [Cycle 1]: 0.00016434, [11] [c_1]: 2.878e-05 [parameter_eliminate]: 2.96999e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.4e-06 [cse]: 2.496e-05 [call_graph_tuple_transform]: 2.421e-05 [tuple_list_get_item_eliminator]: 7.85e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 6.68e-06 [remove_dup_value]: 1.494e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 9.01002e-06 [add_recomputation]: 5.017e-05 [cse_after_recomputation]: 2.368e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.197e-05 [auto_monad_reorder]: 1.729e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.20999e-06 [opt_after_jit_grad]: 0.00046565 [symbol_engine_optimizer]: 7.725e-05, [1] [Cycle 1]: 7.151e-05, [6] [build]: 3.66999e-06 [elim_shapecalc]: 8.84998e-06 [elim_not_effective]: 1.422e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 3.89991e-07 [validate]: 9.053e-05 Sums bootstrap : 0.000307s : 0.11% type_inference : 0.260382s : 96.94% event_method : 0.000023s : 0.01% auto_monad : 0.000074s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000634s : 0.24% rewriter_before_opt_a : 0.000148s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000936s : 0.35% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003532s : 1.31% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000049s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000696s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000424s : 0.16% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000466s : 0.17% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000091s : 0.03% Time group info: ------[substitution.] 0.000350 28 0.53% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.96% : 0.000007s : 4: substitution.graph_param_transform 85.51% : 0.000299s : 5: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.94% : 0.000014s : 3: substitution.reduce_eliminate 1.69% : 0.000006s : 4: substitution.remove_not_recompute_node 1.55% : 0.000005s : 2: substitution.replace_old_param 3.20% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.260282 2 98.60% : 0.256650s : 1: type_inference.infer 1.40% : 0.003632s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.56% : 0.000077s : 5: replace.inline 31.44% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000306 7 96.71% : 0.000296s : 5: match.inline 3.29% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.21% : 0.000002s : 13: predicate.addn_zero_filter 2.12% : 0.000003s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.40% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.53% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.25% : 0.000002s : 13: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 2.50% : 0.000004s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.20% : 0.000010s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.48% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.82% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002947 25 66.02% : 0.001946s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.82% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.16% : 0.000918s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.277568 72 0.02% : 0.000053s : 1: add_recomputation 0.03% : 0.000078s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000326s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.19% : 0.008846s : 1: jit_opt_a 0.06% : 0.000174s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.16% : 0.000432s : 1: loop_unroll 0.25% : 0.000705s : 1: mutable_eliminate 0.43% : 0.001197s : 26: opt.transform.jit_opt_a 0.02% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000474s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000641s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.91% : 0.002530s : 1: renormalize.infer 0.36% : 0.000991s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000155s : 1: rewriter_before_opt_a 0.03% : 0.000080s : 1: symbol_engine_optimizer 93.82% : 0.260401s : 1: type_inference TotalTime = 0.214524, [30] [bootstrap]: 0.00026808 [type_inference]: 0.17666 [event_method]: 0.00063852 [auto_monad]: 0.00011731 [graph_reusing]: 7.61001e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 8.78e-05 [rewriter_before_opt_a]: 0.00013513 [expand_dump_flag]: 3.77002e-06 [jit_opt_a]: 0.0341849, [3] [Cycle 1]: 0.0189902, [27] [switch_simplify]: 7.902e-05 [loop_unroll]: 4.621e-05 [a_1]: 0.00100853 [with_stream_mark]: 2.903e-05 [recompute_prepare]: 2.153e-05 [updatestate_depend_eliminate]: 9.66e-06 [updatestate_assign_eliminate]: 7.73999e-06 [updatestate_loads_eliminate]: 7.59002e-06 [parameter_eliminate]: 2.70997e-06 [specialize_transform]: 1.464e-05 [updatestate_useless_node_eliminater]: 1.361e-05 [accelerated_algorithm]: 1.399e-05 [meta_shard_fg_expand]: 4.17e-06 [get_grad_eliminate_]: 1.453e-05 [merge_forward]: 9.84001e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.922e-05 [j_node_and_user_rematch]: 2.565e-05 [meta_fg_expand]: 0.00254055 [replace_old_param]: 8.494e-05 [inline_without_move]: 6.366e-05 [renormalize]: 0.0142206 [add_forward_monad_depend]: 1.337e-05 [auto_monad_grad]: 6.62002e-06 [auto_monad_eliminator]: 6.615e-05 [cse]: 0.0003151 [replace_applicator]: 9.407e-05 [Cycle 2]: 0.0111681, [27] [switch_simplify]: 4.642e-05 [loop_unroll]: 4.517e-05 [a_1]: 0.00129186 [with_stream_mark]: 1.653e-05 [recompute_prepare]: 1.025e-05 [updatestate_depend_eliminate]: 5.28002e-06 [updatestate_assign_eliminate]: 4.99e-06 [updatestate_loads_eliminate]: 4.71002e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 8.78001e-06 [updatestate_useless_node_eliminater]: 8.08001e-06 [accelerated_algorithm]: 9.26002e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 8.06001e-06 [merge_forward]: 5.56e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.925e-05 [j_node_and_user_rematch]: 1.371e-05 [meta_fg_expand]: 0.00013649 [replace_old_param]: 9.54e-06 [inline_without_move]: 8.38001e-06 [renormalize]: 0.00924376 [add_forward_monad_depend]: 7.38e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.679e-05 [cse]: 3.49e-05 [replace_applicator]: 2.315e-05 [Cycle 3]: 0.00035917, [27] [switch_simplify]: 7.13e-06 [loop_unroll]: 5.51998e-06 [a_1]: 9.639e-05 [with_stream_mark]: 1.409e-05 [recompute_prepare]: 4.86002e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 4.64002e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 3.09001e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.852e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 4.42e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.282e-05 [replace_applicator]: 4.86002e-06 [py_interpret_to_execute_after_opt_a]: 1.203e-05 [rewriter_after_opt_a]: 3.596e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00077892 [jit_opt_b]: 5.308e-05, [1] [Cycle 1]: 4.53e-05, [2] [frontend_op_eliminate]: 1.688e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 2.727e-05 [loop_unroll]: 0.00044072 [jit_opt_after_cconv]: 0.00014501, [1] [Cycle 1]: 0.00013806, [11] [c_1]: 1.867e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.82001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.104e-05 [call_graph_tuple_transform]: 1.943e-05 [tuple_list_get_item_eliminator]: 5.17999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 4.97e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 6.28002e-06 [add_recomputation]: 4.324e-05 [cse_after_recomputation]: 2.576e-05, [1] [Cycle 1]: 1.981e-05, [1] [cse]: 1.368e-05 [auto_monad_reorder]: 1.572e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.48001e-06 [opt_after_jit_grad]: 0.0004553 [symbol_engine_optimizer]: 7.597e-05, [1] [Cycle 1]: 7.006e-05, [6] [build]: 3.71001e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 9.36998e-06 [renormalize]: 3.50003e-07 [validate]: 6.169e-05 Sums bootstrap : 0.000268s : 0.13% type_inference : 0.176660s : 84.13% event_method : 0.000639s : 0.30% auto_monad : 0.000117s : 0.06% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000088s : 0.04% rewriter_before_opt_a : 0.000135s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000133s : 0.06% jit_opt_a.loop_unroll : 0.000097s : 0.05% jit_opt_a.a_1 : 0.002397s : 1.14% jit_opt_a.with_stream_mark : 0.000060s : 0.03% jit_opt_a.recompute_prepare : 0.000037s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.01% jit_opt_a.accelerated_algorithm : 0.000029s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.01% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.02% jit_opt_a.meta_fg_expand : 0.002679s : 1.28% jit_opt_a.replace_old_param : 0.000099s : 0.05% jit_opt_a.inline_without_move : 0.000077s : 0.04% jit_opt_a.renormalize : 0.023464s : 11.17% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000089s : 0.04% jit_opt_a.cse : 0.000363s : 0.17% jit_opt_a.replace_applicator : 0.000122s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000779s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000441s : 0.21% jit_opt_after_cconv.c_1 : 0.000019s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000043s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000455s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.03% Time group info: ------[substitution.] 0.000625 112 0.32% : 0.000002s : 2: substitution.elim_not_effective 0.26% : 0.000002s : 2: substitution.fold_const_symbol 1.00% : 0.000006s : 2: substitution.graph_param_transform 66.73% : 0.000417s : 13: substitution.inline 3.20% : 0.000020s : 2: substitution.inline_without_move 1.67% : 0.000010s : 14: substitution.j_node_and_user_rematch 1.88% : 0.000012s : 7: substitution.minmaximum_grad 1.27% : 0.000008s : 5: substitution.partial_eliminate 2.05% : 0.000013s : 14: substitution.remove_not_recompute_node 5.12% : 0.000032s : 10: substitution.replace_applicator 1.11% : 0.000007s : 10: substitution.replace_old_param 0.97% : 0.000006s : 1: substitution.reshape_eliminate 0.39% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.86% : 0.000005s : 1: substitution.tile_eliminate 3.74% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.55% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.90% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.176507 2 96.98% : 0.171169s : 1: type_inference.infer 3.02% : 0.005337s : 1: type_inference.specialize ------[replace.] 0.000195 20 65.86% : 0.000128s : 13: replace.inline 34.14% : 0.000066s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000429 20 95.16% : 0.000409s : 13: match.inline 4.84% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000403 2740 1.60% : 0.000006s : 47: predicate.accumulaten_eliminater 0.26% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.41% : 0.000006s : 47: predicate.addn_check_dump 1.53% : 0.000006s : 47: predicate.addn_zero_filter 1.98% : 0.000008s : 47: predicate.arithmetic_simplify 1.50% : 0.000006s : 47: predicate.cast_eliminate 0.12% : 0.000000s : 2: predicate.check_bprop_eliminate 1.40% : 0.000006s : 47: predicate.compare_switch_simplify 1.67% : 0.000007s : 47: predicate.depend_value_elim 1.42% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.61% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.59% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.16% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.57% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.39% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.49% : 0.000006s : 47: predicate.environ_get_depend_swap 1.49% : 0.000006s : 47: predicate.environ_get_eliminate 1.54% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.85% : 0.000003s : 20: predicate.get_grad_eliminate 0.07% : 0.000000s : 2: predicate.graph_param_transform 4.34% : 0.000017s : 71: predicate.inline 2.03% : 0.000008s : 48: predicate.inline_without_move 0.36% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.12% : 0.000005s : 20: predicate.less_batch_normalization 1.80% : 0.000007s : 54: predicate.list_to_tuple_eliminator_ 1.93% : 0.000008s : 56: predicate.load_eliminater 0.37% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.21% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.78% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.53% : 0.000006s : 47: predicate.merge_addn 1.63% : 0.000007s : 47: predicate.minmaximum_grad 0.59% : 0.000002s : 2: predicate.mutable_eliminate 0.17% : 0.000001s : 2: predicate.opt_reshape 2.34% : 0.000009s : 56: predicate.partial_eliminate 1.44% : 0.000006s : 47: predicate.print_const_string_wrapper 2.23% : 0.000009s : 47: predicate.reduce_eliminate 1.80% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000002s : 20: predicate.remove_not_recompute_node 2.71% : 0.000011s : 103: predicate.replace_applicator 1.18% : 0.000005s : 48: predicate.replace_old_param 0.06% : 0.000000s : 2: predicate.reset_defer_inline 1.51% : 0.000006s : 47: predicate.reshape_eliminate 1.50% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 2: predicate.row_tensor_eliminate 1.54% : 0.000006s : 47: predicate.same_eliminate 0.50% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 4: predicate.special_op_eliminate 0.81% : 0.000003s : 20: predicate.specialize_transform 1.71% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 47: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.61% : 0.000011s : 67: predicate.switch_defer_inline 2.40% : 0.000010s : 67: predicate.switch_layer_defer_inline 6.22% : 0.000025s : 164: predicate.switch_simplify 1.50% : 0.000006s : 47: predicate.tile_eliminate 1.59% : 0.000006s : 47: predicate.transpose_eliminate 2.12% : 0.000009s : 47: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000014s : 58: predicate.tuple_list_get_item_eliminator 1.96% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.90% : 0.000008s : 54: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.66% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.91% : 0.000008s : 47: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.26% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004919 45 68.95% : 0.003392s : 28: func_graph_cloner_run.FuncGraphClonerGraph 31.05% : 0.001528s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.241124 87 0.02% : 0.000046s : 1: add_recomputation 0.05% : 0.000124s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.12% : 0.000298s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.27% : 0.000646s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 14.18% : 0.034190s : 1: jit_opt_a 0.06% : 0.000148s : 1: jit_opt_after_cconv 0.02% : 0.000055s : 1: jit_opt_b 0.19% : 0.000448s : 1: loop_unroll 0.33% : 0.000789s : 1: mutable_eliminate 1.30% : 0.003132s : 39: opt.transform.jit_opt_a 0.02% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000463s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000091s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 8.37% : 0.020171s : 2: renormalize.infer 1.35% : 0.003265s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.06% : 0.000138s : 1: rewriter_before_opt_a 0.03% : 0.000078s : 1: symbol_engine_optimizer 73.27% : 0.176680s : 1: type_inference TotalTime = 0.0181454, [30] [bootstrap]: 0.00044835 [type_inference]: 0.00617725 [event_method]: 1.898e-05 [auto_monad]: 6.4e-05 [graph_reusing]: 5.52999e-06 [pre_auto_parallel]: 2.04e-06 [py_interpret_to_execute]: 4.955e-05 [rewriter_before_opt_a]: 7.24e-05 [expand_dump_flag]: 2.82002e-06 [jit_opt_a]: 0.00573932, [2] [Cycle 1]: 0.00165131, [27] [switch_simplify]: 5.408e-05 [loop_unroll]: 2.955e-05 [a_1]: 0.00052973 [with_stream_mark]: 1.566e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 3.15002e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 4.29002e-06 [cell_reuse_recompute_pass]: 8.00006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.373e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00070671 [add_forward_monad_depend]: 5.63002e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.406e-05 [cse]: 2.296e-05 [replace_applicator]: 1.143e-05 [Cycle 2]: 0.0003244, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 5.11002e-06 [a_1]: 8.936e-05 [with_stream_mark]: 7.66001e-06 [recompute_prepare]: 5.06002e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.18002e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 4.95999e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.178e-05 [j_node_and_user_rematch]: 7.78999e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 7.44002e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.253e-05 [replace_applicator]: 5.27999e-06 [py_interpret_to_execute_after_opt_a]: 1.02e-05 [rewriter_after_opt_a]: 3.554e-05 [convert_after_rewriter]: 7.04001e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00051817 [jit_opt_b]: 5.048e-05, [1] [Cycle 1]: 4.338e-05, [2] [frontend_op_eliminate]: 1.676e-05 [inline_after_opt_a]: 1.516e-05 [cconv]: 2.41e-05 [loop_unroll]: 0.00043684 [jit_opt_after_cconv]: 0.00015399, [1] [Cycle 1]: 0.0001478, [11] [c_1]: 2.044e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.053e-05 [call_graph_tuple_transform]: 2.9e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 1.573e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 6.07999e-06 [add_recomputation]: 4.529e-05 [cse_after_recomputation]: 2.355e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.234e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.00389622 [symbol_engine_optimizer]: 8.4e-05, [1] [Cycle 1]: 7.582e-05, [6] [build]: 4.19002e-06 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.632e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 9.62999e-06 [renormalize]: 3.89991e-07 [validate]: 4.367e-05 Sums bootstrap : 0.000448s : 3.25% type_inference : 0.006177s : 44.83% event_method : 0.000019s : 0.14% auto_monad : 0.000064s : 0.46% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000050s : 0.36% rewriter_before_opt_a : 0.000072s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000060s : 0.44% jit_opt_a.loop_unroll : 0.000035s : 0.25% jit_opt_a.a_1 : 0.000619s : 4.49% jit_opt_a.with_stream_mark : 0.000023s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000707s : 5.13% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.14% jit_opt_a.cse : 0.000035s : 0.26% jit_opt_a.replace_applicator : 0.000017s : 0.12% py_interpret_to_execute_after_opt_a : 0.000010s : 0.07% rewriter_after_opt_a : 0.000036s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000518s : 3.76% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000024s : 0.17% loop_unroll : 0.000437s : 3.17% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000045s : 0.33% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000016s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.003896s : 28.27% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.32% Time group info: ------[substitution.] 0.000195 23 1.25% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000006s : 3: substitution.graph_param_transform 82.93% : 0.000162s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000004s : 4: substitution.remove_not_recompute_node 2.01% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006107 2 66.57% : 0.004065s : 1: type_inference.infer 33.43% : 0.002042s : 1: type_inference.specialize ------[replace.] 0.000071 6 65.31% : 0.000047s : 4: replace.inline 34.69% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.35% : 0.000159s : 4: match.inline 6.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 2.12% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.32% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.49% : 0.000002s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.24% : 0.000008s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.87% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001684 13 21.89% : 0.000368s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.79% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 76.32% : 0.001285s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019747 72 0.24% : 0.000048s : 1: add_recomputation 0.34% : 0.000067s : 1: auto_monad 0.09% : 0.000019s : 1: auto_monad_reorder 2.36% : 0.000466s : 1: bootstrap 0.13% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.08% : 0.005743s : 1: jit_opt_a 0.80% : 0.000157s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.25% : 0.000445s : 1: loop_unroll 2.66% : 0.000526s : 1: mutable_eliminate 4.20% : 0.000829s : 26: opt.transform.jit_opt_a 0.29% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000037s : 4: opt.transform.symbol_engine_opt 19.81% : 0.003911s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000052s : 1: py_interpret_to_execute 0.06% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 1.90% : 0.000375s : 1: renormalize.infer 1.64% : 0.000325s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000038s : 1: rewriter_after_opt_a 0.38% : 0.000075s : 1: rewriter_before_opt_a 0.44% : 0.000087s : 1: symbol_engine_optimizer 31.35% : 0.006191s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.741.349 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda01a1c10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:36.742.055 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0608088, [30] [bootstrap]: 0.00026804 [type_inference]: 0.0451793 [event_method]: 2.17e-05 [auto_monad]: 7.143e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00010371 [rewriter_before_opt_a]: 8.228e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.0129316, [2] [Cycle 1]: 0.00677695, [27] [switch_simplify]: 6.243e-05 [loop_unroll]: 2.943e-05 [a_1]: 0.0005698 [with_stream_mark]: 2.351e-05 [recompute_prepare]: 7.22002e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.21998e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.89001e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00573438 [add_forward_monad_depend]: 6.68e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.763e-05 [cse]: 3.409e-05 [replace_applicator]: 1.661e-05 [Cycle 2]: 0.00032388, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 4.86002e-06 [a_1]: 8.886e-05 [with_stream_mark]: 1.205e-05 [recompute_prepare]: 5.09998e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 4.77e-06 [updatestate_useless_node_eliminater]: 4.78001e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 8.14997e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 7.32002e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.54e-06 [cse]: 1.349e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.42e-05 [rewriter_after_opt_a]: 3.649e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00059468 [jit_opt_b]: 4.916e-05, [1] [Cycle 1]: 4.166e-05, [2] [frontend_op_eliminate]: 1.481e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 2.823e-05 [loop_unroll]: 0.00040684 [jit_opt_after_cconv]: 0.00014039, [1] [Cycle 1]: 0.0001344, [11] [c_1]: 1.988e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 5.52001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.284e-05 [call_graph_tuple_transform]: 1.911e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.48002e-06 [remove_dup_value]: 1.491e-05 [partial_unused_args_eliminate]: 2.56998e-06 [environ_conv]: 5.74e-06 [add_recomputation]: 5.115e-05 [cse_after_recomputation]: 2.143e-05, [1] [Cycle 1]: 1.674e-05, [1] [cse]: 1.141e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 5.06997e-06 [opt_after_jit_grad]: 0.00044069 [symbol_engine_optimizer]: 7.027e-05, [1] [Cycle 1]: 6.416e-05, [6] [build]: 3.78001e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.218e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.36002e-06 [renormalize]: 3.80009e-07 [validate]: 4.045e-05 Sums bootstrap : 0.000268s : 0.49% type_inference : 0.045179s : 83.08% event_method : 0.000022s : 0.04% auto_monad : 0.000071s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000104s : 0.19% rewriter_before_opt_a : 0.000082s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.13% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000659s : 1.21% jit_opt_a.with_stream_mark : 0.000036s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.005734s : 10.54% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000048s : 0.09% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000036s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000595s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000407s : 0.75% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000441s : 0.81% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.07% Time group info: ------[substitution.] 0.000242 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 3: substitution.graph_param_transform 85.48% : 0.000207s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.58% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045098 2 94.93% : 0.042811s : 1: type_inference.infer 5.07% : 0.002287s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.70% : 0.000051s : 4: replace.inline 30.30% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.28% : 0.000204s : 4: match.inline 5.72% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.92% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 1.05% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.75% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001086 13 42.28% : 0.000459s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.06% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.66% : 0.000572s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067471 72 0.08% : 0.000054s : 1: add_recomputation 0.11% : 0.000075s : 1: auto_monad 0.04% : 0.000030s : 1: auto_monad_reorder 0.43% : 0.000287s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 19.17% : 0.012935s : 1: jit_opt_a 0.21% : 0.000143s : 1: jit_opt_after_cconv 0.08% : 0.000052s : 1: jit_opt_b 0.61% : 0.000414s : 1: loop_unroll 0.89% : 0.000603s : 1: mutable_eliminate 1.31% : 0.000882s : 26: opt.transform.jit_opt_a 0.07% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000448s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000107s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 7.79% : 0.005257s : 1: renormalize.infer 0.69% : 0.000466s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.11% : 0.000073s : 1: symbol_engine_optimizer 66.99% : 0.045201s : 1: type_inference TotalTime = 0.0944418, [30] [bootstrap]: 0.00030807 [type_inference]: 0.0436631 [event_method]: 2.408e-05 [auto_monad]: 7.597e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00013319 [rewriter_before_opt_a]: 8.64e-05 [expand_dump_flag]: 3.63999e-06 [jit_opt_a]: 0.0476642, [2] [Cycle 1]: 0.0135776, [27] [switch_simplify]: 6.267e-05 [loop_unroll]: 2.945e-05 [a_1]: 0.0121818 [with_stream_mark]: 2.022e-05 [recompute_prepare]: 1.197e-05 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.50998e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.86998e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.73997e-06 [renormalize]: 0.00090347 [add_forward_monad_depend]: 6.04001e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 3.433e-05 [replace_applicator]: 1.258e-05 [Cycle 2]: 0.00937758, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.52999e-06 [a_1]: 0.00895139 [with_stream_mark]: 3.884e-05 [recompute_prepare]: 1.653e-05 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 3.09999e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 7.70998e-06 [meta_shard_fg_expand]: 3.53e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 5.26998e-06 [cell_reuse_recompute_pass]: 3.26999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.501e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 3.25998e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 5.04e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 5.57001e-06 [auto_monad_grad]: 4.02e-06 [auto_monad_eliminator]: 1.996e-05 [cse]: 4.465e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 2.26e-05 [rewriter_after_opt_a]: 4.853e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00078521 [jit_opt_b]: 5.522e-05, [1] [Cycle 1]: 4.509e-05, [2] [frontend_op_eliminate]: 1.665e-05 [inline_after_opt_a]: 1.739e-05 [cconv]: 3.925e-05 [loop_unroll]: 0.00041926 [jit_opt_after_cconv]: 0.00014641, [1] [Cycle 1]: 0.0001401, [11] [c_1]: 2.175e-05 [parameter_eliminate]: 2.78998e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.283e-05 [call_graph_tuple_transform]: 2.023e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.38002e-06 [remove_dup_value]: 1.722e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.07999e-06 [add_recomputation]: 0.0001073 [cse_after_recomputation]: 2.657e-05, [1] [Cycle 1]: 2.089e-05, [1] [cse]: 1.431e-05 [auto_monad_reorder]: 1.887e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 5.07999e-06 [opt_after_jit_grad]: 0.00045115 [symbol_engine_optimizer]: 7.061e-05, [1] [Cycle 1]: 6.408e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 7.55998e-06 [elim_not_effective]: 1.177e-05 [opt_reshape]: 5.58002e-06 [fold_const_symbol]: 8.55999e-06 [renormalize]: 3.19997e-07 [validate]: 4.36e-05 Sums bootstrap : 0.000308s : 0.45% type_inference : 0.043663s : 63.25% event_method : 0.000024s : 0.03% auto_monad : 0.000076s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000133s : 0.19% rewriter_before_opt_a : 0.000086s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.021133s : 30.61% jit_opt_a.with_stream_mark : 0.000059s : 0.09% jit_opt_a.recompute_prepare : 0.000028s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000904s : 1.31% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.05% jit_opt_a.cse : 0.000079s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000023s : 0.03% rewriter_after_opt_a : 0.000049s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000785s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000039s : 0.06% loop_unroll : 0.000419s : 0.61% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000107s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000451s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.06% Time group info: ------[substitution.] 0.011824 23 0.02% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000002s : 2: substitution.fold_const_symbol 0.05% : 0.000006s : 3: substitution.graph_param_transform 99.65% : 0.011783s : 4: substitution.inline 0.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.05% : 0.000006s : 4: substitution.remove_not_recompute_node 0.07% : 0.000008s : 2: substitution.replace_old_param 0.12% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043575 2 96.23% : 0.041932s : 1: type_inference.infer 3.77% : 0.001644s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.71% : 0.000055s : 4: replace.inline 30.29% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.011792 6 99.89% : 0.011779s : 4: match.inline 0.11% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.008949 691 0.03% : 0.000003s : 10: predicate.accumulaten_eliminater 0.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.02% : 0.000002s : 10: predicate.addn_check_dump 98.60% : 0.008824s : 10: predicate.addn_zero_filter 0.03% : 0.000002s : 10: predicate.arithmetic_simplify 0.02% : 0.000002s : 10: predicate.cast_eliminate 0.01% : 0.000000s : 3: predicate.check_bprop_eliminate 0.01% : 0.000001s : 10: predicate.compare_switch_simplify 0.02% : 0.000002s : 10: predicate.depend_value_elim 0.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.02% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.02% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.00% : 0.000000s : 3: predicate.elim_not_effective 0.01% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.01% : 0.000001s : 10: predicate.environ_get_depend_swap 0.02% : 0.000001s : 10: predicate.environ_get_eliminate 0.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 3: predicate.fold_const_symbol 0.02% : 0.000002s : 6: predicate.get_grad_eliminate 0.01% : 0.000000s : 3: predicate.graph_param_transform 0.08% : 0.000008s : 22: predicate.inline 0.01% : 0.000001s : 6: predicate.inline_without_move 0.00% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.03% : 0.000002s : 6: predicate.less_batch_normalization 0.02% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.03% : 0.000002s : 15: predicate.load_eliminater 0.01% : 0.000001s : 3: predicate.loop_unroll_after_grad 0.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.02% : 0.000001s : 10: predicate.merge_addn 0.01% : 0.000001s : 10: predicate.minmaximum_grad 0.02% : 0.000001s : 3: predicate.mutable_eliminate 0.01% : 0.000001s : 3: predicate.opt_reshape 0.03% : 0.000003s : 15: predicate.partial_eliminate 0.02% : 0.000002s : 10: predicate.print_const_string_wrapper 0.02% : 0.000002s : 10: predicate.reduce_eliminate 0.02% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.01% : 0.000001s : 6: predicate.remove_not_recompute_node 0.02% : 0.000002s : 18: predicate.replace_applicator 0.01% : 0.000001s : 6: predicate.replace_old_param 0.00% : 0.000000s : 3: predicate.reset_defer_inline 0.02% : 0.000002s : 10: predicate.reshape_eliminate 0.02% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.01% : 0.000001s : 3: predicate.row_tensor_eliminate 0.02% : 0.000002s : 10: predicate.same_eliminate 0.02% : 0.000002s : 6: predicate.set_cell_output_no_recompute 0.01% : 0.000001s : 6: predicate.special_op_eliminate 0.03% : 0.000002s : 6: predicate.specialize_transform 0.02% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.02% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.01% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.03% : 0.000003s : 16: predicate.switch_defer_inline 0.03% : 0.000003s : 16: predicate.switch_layer_defer_inline 0.10% : 0.000009s : 53: predicate.switch_simplify 0.02% : 0.000002s : 10: predicate.tile_eliminate 0.02% : 0.000002s : 10: predicate.transpose_eliminate 0.02% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.02% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 0.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 0.02% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.02% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.02% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.04% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 0.02% : 0.000002s : 10: predicate.value_based_eliminate 0.00% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.01% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000901 13 47.58% : 0.000429s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.57% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.85% : 0.000440s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116775 72 0.09% : 0.000111s : 1: add_recomputation 0.07% : 0.000080s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.28% : 0.000329s : 1: bootstrap 0.04% : 0.000042s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 40.82% : 0.047668s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000427s : 1: loop_unroll 0.68% : 0.000794s : 1: mutable_eliminate 18.31% : 0.021386s : 26: opt.transform.jit_opt_a 0.04% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000137s : 1: py_interpret_to_execute 0.02% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 0.44% : 0.000509s : 1: renormalize.infer 0.33% : 0.000386s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000052s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000073s : 1: symbol_engine_optimizer 37.41% : 0.043686s : 1: type_inference TotalTime = 0.0599277, [30] [bootstrap]: 0.00027941 [type_inference]: 0.0399737 [event_method]: 1.924e-05 [auto_monad]: 0.00176819 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00010372 [rewriter_before_opt_a]: 8.281e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0153995, [2] [Cycle 1]: 0.0045605, [27] [switch_simplify]: 6.659e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00064568 [with_stream_mark]: 2.484e-05 [recompute_prepare]: 8.77999e-06 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.59001e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00339867 [add_forward_monad_depend]: 8.16002e-06 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 1.959e-05 [cse]: 3.984e-05 [replace_applicator]: 1.929e-05 [Cycle 2]: 0.00123793, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 5.19998e-06 [a_1]: 9.386e-05 [with_stream_mark]: 1.336e-05 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 0.00087508 [updatestate_loads_eliminate]: 3.98999e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 9.05001e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 1.78002e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 8.83001e-06 [inline_without_move]: 4.84e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.24999e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 8.58001e-06 [cse]: 1.867e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.645e-05 [rewriter_after_opt_a]: 4.19e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00071174 [jit_opt_b]: 4.948e-05, [1] [Cycle 1]: 4.157e-05, [2] [frontend_op_eliminate]: 1.558e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.92e-05 [loop_unroll]: 0.00040687 [jit_opt_after_cconv]: 0.00014262, [1] [Cycle 1]: 0.00013635, [11] [c_1]: 2.039e-05 [parameter_eliminate]: 3.18998e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.263e-05 [call_graph_tuple_transform]: 1.9e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.80001e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.609e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 6.06e-06 [add_recomputation]: 5.398e-05 [cse_after_recomputation]: 2.172e-05, [1] [Cycle 1]: 1.627e-05, [1] [cse]: 1.095e-05 [auto_monad_reorder]: 1.812e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00045331 [symbol_engine_optimizer]: 7.485e-05, [1] [Cycle 1]: 6.767e-05, [6] [build]: 5.08002e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 9.62001e-06 [renormalize]: 3.69997e-07 [validate]: 4.387e-05 Sums bootstrap : 0.000279s : 0.56% type_inference : 0.039974s : 80.43% event_method : 0.000019s : 0.04% auto_monad : 0.001768s : 3.56% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000104s : 0.21% rewriter_before_opt_a : 0.000083s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.15% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000740s : 1.49% jit_opt_a.with_stream_mark : 0.000038s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000878s : 1.77% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000015s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.003399s : 6.84% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.06% jit_opt_a.cse : 0.000059s : 0.12% jit_opt_a.replace_applicator : 0.000025s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000042s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000712s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000029s : 0.06% loop_unroll : 0.000407s : 0.82% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000453s : 0.91% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.09% Time group info: ------[substitution.] 0.000303 23 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 3: substitution.graph_param_transform 87.53% : 0.000265s : 4: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000006s : 2: substitution.replace_old_param 4.18% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039905 2 96.52% : 0.038517s : 1: type_inference.infer 3.48% : 0.001388s : 1: type_inference.specialize ------[replace.] 0.000080 6 71.16% : 0.000057s : 4: replace.inline 28.84% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 6 95.76% : 0.000263s : 4: match.inline 4.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.53% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.51% : 0.000002s : 10: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.31% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.26% : 0.000001s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.78% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.20% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.80% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000856 13 44.30% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.60% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.10% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064349 72 0.09% : 0.000057s : 1: add_recomputation 2.76% : 0.001775s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.46% : 0.000297s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 23.94% : 0.015403s : 1: jit_opt_a 0.23% : 0.000145s : 1: jit_opt_after_cconv 0.08% : 0.000052s : 1: jit_opt_b 0.64% : 0.000415s : 1: loop_unroll 1.12% : 0.000721s : 1: mutable_eliminate 1.52% : 0.000980s : 26: opt.transform.jit_opt_a 0.07% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000108s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 4.51% : 0.002903s : 1: renormalize.infer 0.75% : 0.000484s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000045s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000078s : 1: symbol_engine_optimizer 62.15% : 0.039991s : 1: type_inference TotalTime = 0.133215, [30] [bootstrap]: 0.00026619 [type_inference]: 0.0826829 [event_method]: 0.00047434 [auto_monad]: 0.00012965 [graph_reusing]: 8.22e-06 [pre_auto_parallel]: 3.29001e-06 [py_interpret_to_execute]: 4.151e-05 [rewriter_before_opt_a]: 0.00014038 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.0464046, [3] [Cycle 1]: 0.0291287, [27] [switch_simplify]: 0.00011977 [loop_unroll]: 5.035e-05 [a_1]: 0.00122404 [with_stream_mark]: 3.972e-05 [recompute_prepare]: 2.476e-05 [updatestate_depend_eliminate]: 1.021e-05 [updatestate_assign_eliminate]: 7.63999e-06 [updatestate_loads_eliminate]: 7.44002e-06 [parameter_eliminate]: 2.81999e-06 [specialize_transform]: 1.616e-05 [updatestate_useless_node_eliminater]: 1.44e-05 [accelerated_algorithm]: 1.575e-05 [meta_shard_fg_expand]: 5.96998e-06 [get_grad_eliminate_]: 1.572e-05 [merge_forward]: 1.01e-05 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.251e-05 [j_node_and_user_rematch]: 2.748e-05 [meta_fg_expand]: 0.00259629 [replace_old_param]: 8.258e-05 [inline_without_move]: 6.965e-05 [renormalize]: 0.0238555 [add_forward_monad_depend]: 1.868e-05 [auto_monad_grad]: 9.51998e-06 [auto_monad_eliminator]: 7.953e-05 [cse]: 0.00036486 [replace_applicator]: 0.00011851 [Cycle 2]: 0.0125116, [27] [switch_simplify]: 4.685e-05 [loop_unroll]: 4.611e-05 [a_1]: 0.00142904 [with_stream_mark]: 2.804e-05 [recompute_prepare]: 1.47e-05 [updatestate_depend_eliminate]: 7.11999e-06 [updatestate_assign_eliminate]: 4.29002e-06 [updatestate_loads_eliminate]: 4.56002e-06 [parameter_eliminate]: 2.67001e-06 [specialize_transform]: 9.32999e-06 [updatestate_useless_node_eliminater]: 1.099e-05 [accelerated_algorithm]: 1.307e-05 [meta_shard_fg_expand]: 5.37001e-06 [get_grad_eliminate_]: 9.57999e-06 [merge_forward]: 6.24999e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.386e-05 [j_node_and_user_rematch]: 1.63e-05 [meta_fg_expand]: 0.00021308 [replace_old_param]: 1.378e-05 [inline_without_move]: 1.091e-05 [renormalize]: 0.0101805 [add_forward_monad_depend]: 1.382e-05 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 2.421e-05 [cse]: 4.008e-05 [replace_applicator]: 2.999e-05 [Cycle 3]: 0.00039311, [27] [switch_simplify]: 7.55e-06 [loop_unroll]: 6.48e-06 [a_1]: 9.824e-05 [with_stream_mark]: 1.815e-05 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 4.69002e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 6.42001e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 3.23e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 3.31001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.097e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 3.10002e-06 [replace_old_param]: 5.84e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 7.82998e-06 [cse]: 1.336e-05 [replace_applicator]: 6.27001e-06 [py_interpret_to_execute_after_opt_a]: 2.12e-05 [rewriter_after_opt_a]: 4.471e-05 [convert_after_rewriter]: 8.27e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00113004 [jit_opt_b]: 6.319e-05, [1] [Cycle 1]: 5.388e-05, [2] [frontend_op_eliminate]: 1.935e-05 [inline_after_opt_a]: 2.024e-05 [cconv]: 3.546e-05 [loop_unroll]: 0.00057024 [jit_opt_after_cconv]: 0.00018848, [1] [Cycle 1]: 0.00018129, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 5.86e-06 [updatestate_depend_eliminate]: 1.153e-05 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 4.131e-05 [call_graph_tuple_transform]: 2.404e-05 [tuple_list_get_item_eliminator]: 5.69999e-06 [none_parameter_eliminate]: 2.46e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 7.85e-06 [add_recomputation]: 5.559e-05 [cse_after_recomputation]: 2.244e-05, [1] [Cycle 1]: 1.669e-05, [1] [cse]: 1.014e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 8.38001e-06 [opt_after_jit_grad]: 0.00049574 [symbol_engine_optimizer]: 8.189e-05, [1] [Cycle 1]: 7.533e-05, [6] [build]: 4.17998e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.364e-05 [opt_reshape]: 7.3e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 3.39991e-07 [validate]: 4.594e-05 Sums bootstrap : 0.000266s : 0.21% type_inference : 0.082683s : 64.74% event_method : 0.000474s : 0.37% auto_monad : 0.000130s : 0.10% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.03% rewriter_before_opt_a : 0.000140s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000174s : 0.14% jit_opt_a.loop_unroll : 0.000103s : 0.08% jit_opt_a.a_1 : 0.002751s : 2.15% jit_opt_a.with_stream_mark : 0.000086s : 0.07% jit_opt_a.recompute_prepare : 0.000045s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000022s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000032s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000030s : 0.02% jit_opt_a.accelerated_algorithm : 0.000035s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000015s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000030s : 0.02% jit_opt_a.merge_forward : 0.000021s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000077s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000054s : 0.04% jit_opt_a.meta_fg_expand : 0.002812s : 2.20% jit_opt_a.replace_old_param : 0.000102s : 0.08% jit_opt_a.inline_without_move : 0.000086s : 0.07% jit_opt_a.renormalize : 0.034036s : 26.65% jit_opt_a.add_forward_monad_depend : 0.000034s : 0.03% jit_opt_a.auto_monad_grad : 0.000014s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000112s : 0.09% jit_opt_a.cse : 0.000418s : 0.33% jit_opt_a.replace_applicator : 0.000155s : 0.12% py_interpret_to_execute_after_opt_a : 0.000021s : 0.02% rewriter_after_opt_a : 0.000045s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001130s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000035s : 0.03% loop_unroll : 0.000570s : 0.45% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000496s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000817 112 0.26% : 0.000002s : 2: substitution.elim_not_effective 0.32% : 0.000003s : 2: substitution.fold_const_symbol 0.78% : 0.000006s : 2: substitution.graph_param_transform 69.77% : 0.000570s : 13: substitution.inline 2.77% : 0.000023s : 2: substitution.inline_without_move 1.30% : 0.000011s : 14: substitution.j_node_and_user_rematch 1.75% : 0.000014s : 7: substitution.minmaximum_grad 1.18% : 0.000010s : 5: substitution.partial_eliminate 1.72% : 0.000014s : 14: substitution.remove_not_recompute_node 5.33% : 0.000044s : 10: substitution.replace_applicator 1.16% : 0.000009s : 10: substitution.replace_old_param 0.88% : 0.000007s : 1: substitution.reshape_eliminate 0.39% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.80% : 0.000007s : 1: substitution.tile_eliminate 3.23% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.13% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.22% : 0.000051s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.082521 2 95.10% : 0.078480s : 1: type_inference.infer 4.90% : 0.004041s : 1: type_inference.specialize ------[replace.] 0.000230 20 67.69% : 0.000156s : 13: replace.inline 32.31% : 0.000074s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000586 20 95.55% : 0.000560s : 13: match.inline 4.45% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000449 2852 1.45% : 0.000007s : 49: predicate.accumulaten_eliminater 0.28% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.36% : 0.000006s : 49: predicate.addn_check_dump 1.64% : 0.000007s : 49: predicate.addn_zero_filter 2.09% : 0.000009s : 49: predicate.arithmetic_simplify 1.43% : 0.000006s : 49: predicate.cast_eliminate 0.18% : 0.000001s : 2: predicate.check_bprop_eliminate 1.39% : 0.000006s : 49: predicate.compare_switch_simplify 1.55% : 0.000007s : 49: predicate.depend_value_elim 1.31% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.61% : 0.000007s : 49: predicate.dict_get_item_eliminator 1.42% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 2: predicate.elim_not_effective 0.09% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000007s : 49: predicate.environ_add_const_eliminate 1.41% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.29% : 0.000006s : 49: predicate.environ_get_depend_swap 1.50% : 0.000007s : 49: predicate.environ_get_eliminate 1.42% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.96% : 0.000004s : 21: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.21% : 0.000019s : 73: predicate.inline 2.16% : 0.000010s : 49: predicate.inline_without_move 0.43% : 0.000002s : 21: predicate.j_node_and_user_rematch 1.39% : 0.000006s : 21: predicate.less_batch_normalization 1.93% : 0.000009s : 56: predicate.list_to_tuple_eliminator_ 1.68% : 0.000008s : 58: predicate.load_eliminater 0.54% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.28% : 0.000015s : 102: predicate.loop_unroll_before_grad 2.01% : 0.000009s : 51: predicate.make_slice_get_slice_eliminator 1.33% : 0.000006s : 49: predicate.merge_addn 1.49% : 0.000007s : 49: predicate.minmaximum_grad 1.02% : 0.000005s : 2: predicate.mutable_eliminate 0.15% : 0.000001s : 2: predicate.opt_reshape 2.19% : 0.000010s : 58: predicate.partial_eliminate 1.70% : 0.000008s : 49: predicate.print_const_string_wrapper 2.00% : 0.000009s : 49: predicate.reduce_eliminate 1.80% : 0.000008s : 56: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 21: predicate.remove_not_recompute_node 2.84% : 0.000013s : 106: predicate.replace_applicator 1.10% : 0.000005s : 49: predicate.replace_old_param 0.13% : 0.000001s : 2: predicate.reset_defer_inline 1.49% : 0.000007s : 49: predicate.reshape_eliminate 1.61% : 0.000007s : 49: predicate.row_tensor_add_zeros_like 0.34% : 0.000002s : 2: predicate.row_tensor_eliminate 1.47% : 0.000007s : 49: predicate.same_eliminate 0.64% : 0.000003s : 21: predicate.set_cell_output_no_recompute 0.28% : 0.000001s : 4: predicate.special_op_eliminate 0.71% : 0.000003s : 21: predicate.specialize_transform 1.71% : 0.000008s : 49: predicate.split_environ_get_set_with_tuple_value 1.61% : 0.000007s : 49: predicate.stack_unstack_eliminate 0.12% : 0.000001s : 2: predicate.switch_call_monad_eliminater 3.12% : 0.000014s : 69: predicate.switch_defer_inline 2.37% : 0.000011s : 69: predicate.switch_layer_defer_inline 6.52% : 0.000029s : 173: predicate.switch_simplify 1.43% : 0.000006s : 49: predicate.tile_eliminate 1.69% : 0.000008s : 49: predicate.transpose_eliminate 1.78% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000008s : 49: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000015s : 60: predicate.tuple_list_get_item_eliminator 1.81% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.62% : 0.000007s : 56: predicate.tuple_to_list_eliminator_ 1.64% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.57% : 0.000012s : 79: predicate.updatestate_useless_node_eliminater 1.90% : 0.000009s : 49: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005495 46 70.72% : 0.003886s : 29: func_graph_cloner_run.FuncGraphClonerGraph 29.28% : 0.001609s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.170898 87 0.03% : 0.000059s : 1: add_recomputation 0.08% : 0.000136s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.17% : 0.000289s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.28% : 0.000487s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 27.16% : 0.046410s : 1: jit_opt_a 0.11% : 0.000191s : 1: jit_opt_after_cconv 0.04% : 0.000066s : 1: jit_opt_b 0.34% : 0.000579s : 1: loop_unroll 0.67% : 0.001149s : 1: mutable_eliminate 2.11% : 0.003610s : 39: opt.transform.jit_opt_a 0.03% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000028s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000504s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000044s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 17.75% : 0.030328s : 2: renormalize.infer 2.15% : 0.003673s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.08% : 0.000143s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 48.40% : 0.082714s : 1: type_inference TotalTime = 0.543121, [30] [bootstrap]: 0.00035306 [type_inference]: 0.53067 [event_method]: 2.518e-05 [auto_monad]: 8.076e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00058624 [rewriter_before_opt_a]: 0.00010688 [expand_dump_flag]: 4.05998e-06 [jit_opt_a]: 0.00869343, [2] [Cycle 1]: 0.00459035, [27] [switch_simplify]: 7.103e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.00075745 [with_stream_mark]: 2.743e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.52002e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.52001e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 6.61e-06 [renormalize]: 0.00331484 [add_forward_monad_depend]: 8.39002e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.963e-05 [cse]: 3.983e-05 [replace_applicator]: 2.074e-05 [Cycle 2]: 0.00040663, [27] [switch_simplify]: 7.13e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00013137 [with_stream_mark]: 1.544e-05 [recompute_prepare]: 6.59001e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 6.23002e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 6.28998e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 3.3e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.895e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 5.90002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.504e-05 [replace_applicator]: 6.78e-06 [py_interpret_to_execute_after_opt_a]: 1.509e-05 [rewriter_after_opt_a]: 4.83e-05 [convert_after_rewriter]: 7.52002e-06 [order_py_execute_after_rewriter]: 5.46002e-06 [mutable_eliminate]: 0.00076772 [jit_opt_b]: 5.666e-05, [1] [Cycle 1]: 4.846e-05, [2] [frontend_op_eliminate]: 1.912e-05 [inline_after_opt_a]: 1.778e-05 [cconv]: 2.887e-05 [loop_unroll]: 0.00045353 [jit_opt_after_cconv]: 0.00016728, [1] [Cycle 1]: 0.00015987, [11] [c_1]: 2.668e-05 [parameter_eliminate]: 3.51999e-06 [updatestate_depend_eliminate]: 7.19001e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 2.937e-05 [call_graph_tuple_transform]: 2.203e-05 [tuple_list_get_item_eliminator]: 6.90002e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.836e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.37001e-06 [add_recomputation]: 6.013e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.068e-05, [1] [cse]: 1.488e-05 [auto_monad_reorder]: 1.848e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 6.96999e-06 [opt_after_jit_grad]: 0.00047859 [symbol_engine_optimizer]: 7.734e-05, [1] [Cycle 1]: 7.128e-05, [6] [build]: 3.99002e-06 [elim_shapecalc]: 9.79999e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.50002e-06 [fold_const_symbol]: 9.57001e-06 [renormalize]: 5.40022e-07 [validate]: 0.00012898 Sums bootstrap : 0.000353s : 0.07% type_inference : 0.530670s : 98.49% event_method : 0.000025s : 0.00% auto_monad : 0.000081s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000586s : 0.11% rewriter_before_opt_a : 0.000107s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000889s : 0.16% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003315s : 0.62% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.00% jit_opt_a.cse : 0.000055s : 0.01% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000048s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000768s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000029s : 0.01% loop_unroll : 0.000454s : 0.08% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000060s : 0.01% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000479s : 0.09% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000129s : 0.02% Time group info: ------[substitution.] 0.000313 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000006s : 4: substitution.graph_param_transform 88.21% : 0.000276s : 5: substitution.inline 1.19% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000007s : 4: substitution.remove_not_recompute_node 1.70% : 0.000005s : 2: substitution.replace_old_param 3.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.530560 2 99.38% : 0.527273s : 1: type_inference.infer 0.62% : 0.003287s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.46% : 0.000077s : 5: replace.inline 31.54% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000284 7 96.31% : 0.000273s : 5: match.inline 3.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.19% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.69% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 1.82% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.75% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 13: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002834 25 66.62% : 0.001888s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.21% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.17% : 0.000855s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.547573 72 0.01% : 0.000063s : 1: add_recomputation 0.02% : 0.000084s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.07% : 0.000376s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 1.59% : 0.008698s : 1: jit_opt_a 0.03% : 0.000171s : 1: jit_opt_after_cconv 0.01% : 0.000059s : 1: jit_opt_b 0.08% : 0.000463s : 1: loop_unroll 0.14% : 0.000777s : 1: mutable_eliminate 0.21% : 0.001158s : 26: opt.transform.jit_opt_a 0.01% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.00% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.09% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000595s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 0.44% : 0.002396s : 1: renormalize.infer 0.17% : 0.000908s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000052s : 1: rewriter_after_opt_a 0.02% : 0.000112s : 1: rewriter_before_opt_a 0.01% : 0.000080s : 1: symbol_engine_optimizer 96.92% : 0.530699s : 1: type_inference TotalTime = 0.0296793, [30] [bootstrap]: 0.00025077 [type_inference]: 0.0106597 [event_method]: 1.766e-05 [auto_monad]: 6.535e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 1.97999e-06 [py_interpret_to_execute]: 3.613e-05 [rewriter_before_opt_a]: 7.108e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.0162158, [2] [Cycle 1]: 0.00625511, [27] [switch_simplify]: 6.017e-05 [loop_unroll]: 4.242e-05 [a_1]: 0.00055403 [with_stream_mark]: 2.459e-05 [recompute_prepare]: 7.13e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 4.03999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.50997e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.71003e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.416e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 0.00517782 [add_forward_monad_depend]: 1.016e-05 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 2.252e-05 [cse]: 3.862e-05 [replace_applicator]: 2.089e-05 [Cycle 2]: 0.0003429, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.565e-05 [with_stream_mark]: 1.373e-05 [recompute_prepare]: 5.11002e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.11997e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 2.87002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.667e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.89995e-07 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.22e-06 [cse]: 1.473e-05 [replace_applicator]: 4.99998e-06 [py_interpret_to_execute_after_opt_a]: 1.545e-05 [rewriter_after_opt_a]: 4.131e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.0007021 [jit_opt_b]: 4.962e-05, [1] [Cycle 1]: 4.284e-05, [2] [frontend_op_eliminate]: 1.49e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 2.875e-05 [loop_unroll]: 0.0004192 [jit_opt_after_cconv]: 0.00015726, [1] [Cycle 1]: 0.00015102, [11] [c_1]: 2.072e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.267e-05 [call_graph_tuple_transform]: 2.065e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.05999e-06 [remove_dup_value]: 1.842e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 5.616e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.835e-05, [1] [cse]: 1.254e-05 [auto_monad_reorder]: 1.922e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 5.61998e-06 [opt_after_jit_grad]: 0.00044591 [symbol_engine_optimizer]: 7.337e-05, [1] [Cycle 1]: 6.722e-05, [6] [build]: 4.22998e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.327e-05 [opt_reshape]: 5.79999e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.89991e-07 [validate]: 4.52e-05 Sums bootstrap : 0.000251s : 1.29% type_inference : 0.010660s : 54.98% event_method : 0.000018s : 0.09% auto_monad : 0.000065s : 0.34% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000036s : 0.19% rewriter_before_opt_a : 0.000071s : 0.37% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.34% jit_opt_a.loop_unroll : 0.000048s : 0.25% jit_opt_a.a_1 : 0.000650s : 3.35% jit_opt_a.with_stream_mark : 0.000038s : 0.20% jit_opt_a.recompute_prepare : 0.000012s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.09% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.09% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.005178s : 26.71% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.14% jit_opt_a.cse : 0.000053s : 0.28% jit_opt_a.replace_applicator : 0.000026s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.08% rewriter_after_opt_a : 0.000041s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000702s : 3.62% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.08% jit_opt_b.inline_after_opt_a : 0.000017s : 0.09% cconv : 0.000029s : 0.15% loop_unroll : 0.000419s : 2.16% jit_opt_after_cconv.c_1 : 0.000021s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000018s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000056s : 0.29% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000019s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000446s : 2.30% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.23% Time group info: ------[substitution.] 0.000236 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000007s : 3: substitution.graph_param_transform 84.74% : 0.000200s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010594 2 91.62% : 0.009706s : 1: type_inference.infer 8.38% : 0.000888s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.66% : 0.000046s : 4: replace.inline 32.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 6 94.71% : 0.000198s : 4: match.inline 5.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.50% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000003s : 10: predicate.arithmetic_simplify 1.20% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 0.95% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.05% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.46% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.21% : 0.000002s : 3: predicate.loop_unroll_after_grad 12.85% : 0.000017s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.53% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 16: predicate.switch_defer_inline 1.87% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.91% : 0.000009s : 53: predicate.switch_simplify 0.99% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.20% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.52% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000654 13 43.87% : 0.000287s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.00% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.13% : 0.000315s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035796 72 0.17% : 0.000059s : 1: add_recomputation 0.19% : 0.000068s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.75% : 0.000268s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.06% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 45.31% : 0.016219s : 1: jit_opt_a 0.45% : 0.000160s : 1: jit_opt_after_cconv 0.15% : 0.000052s : 1: jit_opt_b 1.19% : 0.000427s : 1: loop_unroll 1.99% : 0.000712s : 1: mutable_eliminate 2.49% : 0.000892s : 26: opt.transform.jit_opt_a 0.14% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.27% : 0.000454s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000039s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000079s : 1: remove_dup_value 13.25% : 0.004744s : 1: renormalize.infer 1.17% : 0.000421s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000044s : 1: rewriter_after_opt_a 0.21% : 0.000074s : 1: rewriter_before_opt_a 0.21% : 0.000076s : 1: symbol_engine_optimizer 29.82% : 0.010674s : 1: type_inference TotalTime = 0.0420146, [30] [bootstrap]: 0.00049138 [type_inference]: 0.0285213 [event_method]: 2.502e-05 [auto_monad]: 7.781e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00015924 [rewriter_before_opt_a]: 0.00010496 [expand_dump_flag]: 3.07002e-06 [jit_opt_a]: 0.00841149, [2] [Cycle 1]: 0.00300586, [27] [switch_simplify]: 7.815e-05 [loop_unroll]: 3.173e-05 [a_1]: 0.00069148 [with_stream_mark]: 2.481e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.81003e-06 [specialize_transform]: 6.80002e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 6.38998e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.159e-05 [inline_without_move]: 6.63e-06 [renormalize]: 0.00173504 [add_forward_monad_depend]: 1.23e-05 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 2.485e-05 [cse]: 4.354e-05 [replace_applicator]: 2.528e-05 [Cycle 2]: 0.00044737, [27] [switch_simplify]: 7.39002e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00012725 [with_stream_mark]: 1.968e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 8.83001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 5.44e-06 [cell_reuse_recompute_pass]: 5.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.164e-05 [j_node_and_user_rematch]: 1.088e-05 [meta_fg_expand]: 3.93999e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 5.04e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.86998e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 1.108e-05 [cse]: 2.005e-05 [replace_applicator]: 6.49001e-06 [py_interpret_to_execute_after_opt_a]: 2.673e-05 [rewriter_after_opt_a]: 5.656e-05 [convert_after_rewriter]: 9.25001e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00148051 [jit_opt_b]: 7.586e-05, [1] [Cycle 1]: 6.296e-05, [2] [frontend_op_eliminate]: 2.459e-05 [inline_after_opt_a]: 2.149e-05 [cconv]: 3.963e-05 [loop_unroll]: 0.00079 [jit_opt_after_cconv]: 0.00022941, [1] [Cycle 1]: 0.00021727, [11] [c_1]: 2.789e-05 [parameter_eliminate]: 6.77002e-06 [updatestate_depend_eliminate]: 1.271e-05 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 4.967e-05 [call_graph_tuple_transform]: 3.563e-05 [tuple_list_get_item_eliminator]: 7e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.38998e-06 [remove_dup_value]: 2.243e-05 [partial_unused_args_eliminate]: 3.38e-06 [environ_conv]: 8.10999e-06 [add_recomputation]: 6.708e-05 [cse_after_recomputation]: 3.451e-05, [1] [Cycle 1]: 2.666e-05, [1] [cse]: 1.628e-05 [auto_monad_reorder]: 2.218e-05 [get_jit_bprop_graph]: 3.13e-06 [rewriter_after_jit_bprop_graph]: 1.213e-05 [opt_after_jit_grad]: 0.00087883 [symbol_engine_optimizer]: 0.00010373, [1] [Cycle 1]: 9.343e-05, [6] [build]: 7.47002e-06 [elim_shapecalc]: 1.014e-05 [elim_not_effective]: 2.256e-05 [opt_reshape]: 8.84e-06 [fold_const_symbol]: 1.159e-05 [renormalize]: 5.50004e-07 [validate]: 5.775e-05 Sums bootstrap : 0.000491s : 1.36% type_inference : 0.028521s : 78.71% event_method : 0.000025s : 0.07% auto_monad : 0.000078s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000159s : 0.44% rewriter_before_opt_a : 0.000105s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000086s : 0.24% jit_opt_a.loop_unroll : 0.000038s : 0.10% jit_opt_a.a_1 : 0.000819s : 2.26% jit_opt_a.with_stream_mark : 0.000044s : 0.12% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.03% jit_opt_a.merge_forward : 0.000010s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.06% jit_opt_a.meta_fg_expand : 0.000007s : 0.02% jit_opt_a.replace_old_param : 0.000022s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001735s : 4.79% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.10% jit_opt_a.cse : 0.000064s : 0.18% jit_opt_a.replace_applicator : 0.000032s : 0.09% py_interpret_to_execute_after_opt_a : 0.000027s : 0.07% rewriter_after_opt_a : 0.000057s : 0.16% convert_after_rewriter : 0.000009s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001481s : 4.09% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.07% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000040s : 0.11% loop_unroll : 0.000790s : 2.18% jit_opt_after_cconv.c_1 : 0.000028s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000050s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000022s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000067s : 0.19% cse_after_recomputation.cse : 0.000016s : 0.04% auto_monad_reorder : 0.000022s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.03% opt_after_jit_grad : 0.000879s : 2.43% symbol_engine_optimizer.build : 0.000007s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.16% Time group info: ------[substitution.] 0.000314 23 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.23% : 0.000007s : 3: substitution.graph_param_transform 85.85% : 0.000269s : 4: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000007s : 2: substitution.replace_old_param 4.95% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028413 2 90.33% : 0.025664s : 1: type_inference.infer 9.67% : 0.002748s : 1: type_inference.specialize ------[replace.] 0.000094 6 69.36% : 0.000065s : 4: replace.inline 30.64% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000281 6 94.88% : 0.000267s : 4: match.inline 5.12% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.79% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.80% : 0.000001s : 10: predicate.addn_check_dump 1.74% : 0.000003s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.76% : 0.000003s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000002s : 10: predicate.compare_switch_simplify 1.10% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 0.96% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.05% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.59% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000002s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000010s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.77% : 0.000003s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 15: predicate.load_eliminater 2.40% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.88% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000002s : 10: predicate.minmaximum_grad 4.03% : 0.000006s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 1.76% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000002s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.35% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000001s : 3: predicate.reset_defer_inline 1.67% : 0.000003s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.20% : 0.000002s : 3: predicate.row_tensor_eliminate 1.09% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.36% : 0.000002s : 6: predicate.special_op_eliminate 1.02% : 0.000002s : 6: predicate.specialize_transform 1.04% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 1.81% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.33% : 0.000012s : 53: predicate.switch_simplify 0.96% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.13% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.28% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.28% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001475 13 42.51% : 0.000627s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.25% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.24% : 0.000785s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044955 72 0.16% : 0.000073s : 1: add_recomputation 0.18% : 0.000082s : 1: auto_monad 0.06% : 0.000026s : 1: auto_monad_reorder 1.14% : 0.000514s : 1: bootstrap 0.10% : 0.000043s : 1: cconv 0.03% : 0.000012s : 1: convert_after_rewriter 0.08% : 0.000037s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.07% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.73% : 0.008418s : 1: jit_opt_a 0.52% : 0.000233s : 1: jit_opt_after_cconv 0.18% : 0.000080s : 1: jit_opt_b 1.80% : 0.000809s : 1: loop_unroll 3.35% : 0.001508s : 1: mutable_eliminate 2.44% : 0.001096s : 26: opt.transform.jit_opt_a 0.16% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000037s : 4: opt.transform.jit_opt_b 0.06% : 0.000026s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000043s : 1: opt.transform.mutable_eliminate 0.08% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000048s : 4: opt.transform.symbol_engine_opt 2.00% : 0.000897s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000163s : 1: py_interpret_to_execute 0.07% : 0.000031s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000025s : 1: remove_dup_value 2.21% : 0.000995s : 1: renormalize.infer 1.61% : 0.000726s : 1: renormalize.specialize 0.03% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000063s : 1: rewriter_after_opt_a 0.25% : 0.000111s : 1: rewriter_before_opt_a 0.24% : 0.000108s : 1: symbol_engine_optimizer 63.50% : 0.028547s : 1: type_inference TotalTime = 0.498617, [30] [bootstrap]: 0.00038274 [type_inference]: 0.426154 [event_method]: 2.14e-05 [auto_monad]: 6.778e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00042265 [rewriter_before_opt_a]: 8.842e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.0689451, [2] [Cycle 1]: 0.0640229, [27] [switch_simplify]: 6.522e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00059526 [with_stream_mark]: 2.171e-05 [recompute_prepare]: 8.95999e-06 [updatestate_depend_eliminate]: 3.79002e-06 [updatestate_assign_eliminate]: 3.93999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.40002e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.662e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 6.05002e-06 [renormalize]: 0.0629211 [add_forward_monad_depend]: 1.109e-05 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 2.232e-05 [cse]: 3.681e-05 [replace_applicator]: 2.629e-05 [Cycle 2]: 0.00040225, [27] [switch_simplify]: 7.10998e-06 [loop_unroll]: 6.35002e-06 [a_1]: 0.00013233 [with_stream_mark]: 1.846e-05 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 5.76003e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 3.93999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.937e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.66e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 1.11002e-06 [auto_monad_eliminator]: 7.28e-06 [cse]: 1.203e-05 [replace_applicator]: 5.66003e-06 [py_interpret_to_execute_after_opt_a]: 1.399e-05 [rewriter_after_opt_a]: 4.225e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00075185 [jit_opt_b]: 5.905e-05, [1] [Cycle 1]: 4.9e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 3.038e-05 [loop_unroll]: 0.00050612 [jit_opt_after_cconv]: 0.00015308, [1] [Cycle 1]: 0.00014622, [11] [c_1]: 2.567e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 7.95998e-06 [updatestate_assign_eliminate]: 2.45997e-06 [updatestate_loads_eliminate]: 1.96e-06 [cse]: 2.153e-05 [call_graph_tuple_transform]: 2.106e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 9.42999e-06 [add_recomputation]: 4.916e-05 [cse_after_recomputation]: 2.239e-05, [1] [Cycle 1]: 1.605e-05, [1] [cse]: 1.026e-05 [auto_monad_reorder]: 1.739e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00043104 [symbol_engine_optimizer]: 7.484e-05, [1] [Cycle 1]: 6.839e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 8.13001e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 2.59985e-07 [validate]: 4.523e-05 Sums bootstrap : 0.000383s : 0.08% type_inference : 0.426154s : 86.37% event_method : 0.000021s : 0.00% auto_monad : 0.000068s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000423s : 0.09% rewriter_before_opt_a : 0.000088s : 0.02% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.01% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000728s : 0.15% jit_opt_a.with_stream_mark : 0.000040s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.062921s : 12.75% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000049s : 0.01% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000752s : 0.15% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000030s : 0.01% loop_unroll : 0.000506s : 0.10% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000049s : 0.01% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000431s : 0.09% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.01% Time group info: ------[substitution.] 0.000226 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000006s : 4: substitution.graph_param_transform 82.94% : 0.000187s : 4: substitution.inline 1.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.07% : 0.000007s : 4: substitution.remove_not_recompute_node 2.67% : 0.000006s : 2: substitution.replace_old_param 5.58% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.426075 2 99.39% : 0.423483s : 1: type_inference.infer 0.61% : 0.002592s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.01% : 0.000050s : 4: replace.inline 30.99% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.23% : 0.000185s : 4: match.inline 5.77% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.72% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.45% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.93% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.56% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002283 22 67.27% : 0.001536s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.73% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.00% : 0.000708s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.562538 72 0.01% : 0.000052s : 1: add_recomputation 0.01% : 0.000071s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.07% : 0.000403s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.00% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.00% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 12.26% : 0.068949s : 1: jit_opt_a 0.03% : 0.000155s : 1: jit_opt_after_cconv 0.01% : 0.000062s : 1: jit_opt_b 0.09% : 0.000514s : 1: loop_unroll 0.14% : 0.000764s : 1: mutable_eliminate 0.17% : 0.000979s : 26: opt.transform.jit_opt_a 0.01% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.00% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000439s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000429s : 1: py_interpret_to_execute 0.00% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000018s : 1: remove_dup_value 11.04% : 0.062089s : 1: renormalize.infer 0.15% : 0.000819s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.02% : 0.000094s : 1: rewriter_before_opt_a 0.02% : 0.000133s : 1: symbol_engine_optimizer 75.76% : 0.426169s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.823.5 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007ce50> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.962.3 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0425188, [30] [bootstrap]: 0.00041359 [type_inference]: 0.0200715 [event_method]: 6.489e-05 [auto_monad]: 0.00010449 [graph_reusing]: 7.28e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 2.992e-05 [rewriter_before_opt_a]: 0.00010503 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.0192329, [3] [Cycle 1]: 0.00746276, [27] [switch_simplify]: 7.158e-05 [loop_unroll]: 4.21e-05 [a_1]: 0.00094909 [with_stream_mark]: 3.135e-05 [recompute_prepare]: 2.083e-05 [updatestate_depend_eliminate]: 8.58001e-06 [updatestate_assign_eliminate]: 7.16001e-06 [updatestate_loads_eliminate]: 6.64001e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 1.348e-05 [updatestate_useless_node_eliminater]: 1.238e-05 [accelerated_algorithm]: 1.249e-05 [meta_shard_fg_expand]: 3.5e-06 [get_grad_eliminate_]: 1.217e-05 [merge_forward]: 8.66002e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.669e-05 [j_node_and_user_rematch]: 2.388e-05 [meta_fg_expand]: 0.00178712 [replace_old_param]: 6.302e-05 [inline_without_move]: 5.563e-05 [renormalize]: 0.00363797 [add_forward_monad_depend]: 1.262e-05 [auto_monad_grad]: 6.54001e-06 [auto_monad_eliminator]: 6.049e-05 [cse]: 0.00022344 [replace_applicator]: 9.143e-05 [Cycle 2]: 0.00781173, [27] [switch_simplify]: 4.088e-05 [loop_unroll]: 3.992e-05 [a_1]: 0.00127182 [with_stream_mark]: 1.954e-05 [recompute_prepare]: 1.289e-05 [updatestate_depend_eliminate]: 5.85002e-06 [updatestate_assign_eliminate]: 4.43001e-06 [updatestate_loads_eliminate]: 4.03999e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 9.99999e-06 [updatestate_useless_node_eliminater]: 8.49002e-06 [accelerated_algorithm]: 8.45001e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 9.13002e-06 [merge_forward]: 4.95999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.312e-05 [j_node_and_user_rematch]: 1.457e-05 [meta_fg_expand]: 0.00012064 [replace_old_param]: 1.213e-05 [inline_without_move]: 9.04998e-06 [renormalize]: 0.00589278 [add_forward_monad_depend]: 8.01001e-06 [auto_monad_grad]: 2.99001e-06 [auto_monad_eliminator]: 1.883e-05 [cse]: 3.19e-05 [replace_applicator]: 2.385e-05 [Cycle 3]: 0.00034118, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.99e-06 [a_1]: 8.04e-05 [with_stream_mark]: 1.421e-05 [recompute_prepare]: 4.59002e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.60002e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.63999e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 4.49998e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 3.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.747e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 4.73001e-06 [inline_without_move]: 4.25e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.192e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 1.508e-05 [rewriter_after_opt_a]: 4.435e-05 [convert_after_rewriter]: 7.30998e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00078403 [jit_opt_b]: 5.857e-05, [1] [Cycle 1]: 4.919e-05, [2] [frontend_op_eliminate]: 1.955e-05 [inline_after_opt_a]: 1.636e-05 [cconv]: 2.825e-05 [loop_unroll]: 0.00044498 [jit_opt_after_cconv]: 0.00016809, [1] [Cycle 1]: 0.00016104, [11] [c_1]: 1.794e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 5.84999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 1.512e-05 [cse]: 2.824e-05 [call_graph_tuple_transform]: 1.974e-05 [tuple_list_get_item_eliminator]: 5.12e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 6.05002e-06 [add_recomputation]: 5.426e-05 [cse_after_recomputation]: 2.487e-05, [1] [Cycle 1]: 1.869e-05, [1] [cse]: 1.228e-05 [auto_monad_reorder]: 1.572e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.91998e-06 [opt_after_jit_grad]: 0.0004819 [symbol_engine_optimizer]: 7.794e-05, [1] [Cycle 1]: 7.191e-05, [6] [build]: 3.32002e-06 [elim_shapecalc]: 8.65999e-06 [elim_not_effective]: 1.297e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 6.80011e-07 [validate]: 4.218e-05 Sums bootstrap : 0.000414s : 1.09% type_inference : 0.020072s : 52.86% event_method : 0.000065s : 0.17% auto_monad : 0.000104s : 0.28% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000030s : 0.08% rewriter_before_opt_a : 0.000105s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000119s : 0.31% jit_opt_a.loop_unroll : 0.000088s : 0.23% jit_opt_a.a_1 : 0.002301s : 6.06% jit_opt_a.with_stream_mark : 0.000065s : 0.17% jit_opt_a.recompute_prepare : 0.000038s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.04% jit_opt_a.parameter_eliminate : 0.000008s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.07% jit_opt_a.accelerated_algorithm : 0.000026s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.07% jit_opt_a.merge_forward : 0.000017s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.12% jit_opt_a.meta_fg_expand : 0.001910s : 5.03% jit_opt_a.replace_old_param : 0.000080s : 0.21% jit_opt_a.inline_without_move : 0.000069s : 0.18% jit_opt_a.renormalize : 0.009531s : 25.10% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.22% jit_opt_a.cse : 0.000267s : 0.70% jit_opt_a.replace_applicator : 0.000120s : 0.32% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000044s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000784s : 2.06% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000028s : 0.07% loop_unroll : 0.000445s : 1.17% jit_opt_after_cconv.c_1 : 0.000018s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000015s : 0.04% jit_opt_after_cconv.cse : 0.000028s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.14% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000482s : 1.27% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.11% Time group info: ------[substitution.] 0.000598 110 0.36% : 0.000002s : 2: substitution.elim_not_effective 0.28% : 0.000002s : 2: substitution.fold_const_symbol 1.03% : 0.000006s : 2: substitution.graph_param_transform 64.37% : 0.000385s : 13: substitution.inline 3.05% : 0.000018s : 2: substitution.inline_without_move 1.78% : 0.000011s : 14: substitution.j_node_and_user_rematch 2.07% : 0.000012s : 7: substitution.minmaximum_grad 1.30% : 0.000008s : 5: substitution.partial_eliminate 2.23% : 0.000013s : 14: substitution.remove_not_recompute_node 5.34% : 0.000032s : 10: substitution.replace_applicator 1.01% : 0.000006s : 8: substitution.replace_old_param 1.33% : 0.000008s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.04% : 0.000006s : 1: substitution.tile_eliminate 3.78% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.75% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.85% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019966 2 87.91% : 0.017553s : 1: type_inference.infer 12.09% : 0.002413s : 1: type_inference.specialize ------[replace.] 0.000188 20 66.62% : 0.000125s : 13: replace.inline 33.38% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000401 20 94.03% : 0.000377s : 13: match.inline 5.97% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000394 2621 1.51% : 0.000006s : 45: predicate.accumulaten_eliminater 0.36% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.37% : 0.000005s : 45: predicate.addn_check_dump 1.62% : 0.000006s : 45: predicate.addn_zero_filter 2.01% : 0.000008s : 45: predicate.arithmetic_simplify 1.53% : 0.000006s : 45: predicate.cast_eliminate 0.22% : 0.000001s : 2: predicate.check_bprop_eliminate 1.36% : 0.000005s : 45: predicate.compare_switch_simplify 1.42% : 0.000006s : 45: predicate.depend_value_elim 1.41% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.47% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.20% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.40% : 0.000005s : 45: predicate.environ_get_depend_swap 1.47% : 0.000006s : 45: predicate.environ_get_eliminate 1.38% : 0.000005s : 45: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.91% : 0.000004s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.38% : 0.000017s : 69: predicate.inline 1.87% : 0.000007s : 43: predicate.inline_without_move 0.32% : 0.000001s : 19: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 19: predicate.less_batch_normalization 1.91% : 0.000008s : 52: predicate.list_to_tuple_eliminator_ 1.80% : 0.000007s : 54: predicate.load_eliminater 0.36% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.23% : 0.000013s : 90: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.35% : 0.000005s : 45: predicate.merge_addn 1.48% : 0.000006s : 45: predicate.minmaximum_grad 0.53% : 0.000002s : 2: predicate.mutable_eliminate 0.11% : 0.000000s : 2: predicate.opt_reshape 2.19% : 0.000009s : 54: predicate.partial_eliminate 1.46% : 0.000006s : 45: predicate.print_const_string_wrapper 1.87% : 0.000007s : 45: predicate.reduce_eliminate 1.84% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 19: predicate.remove_not_recompute_node 4.57% : 0.000018s : 97: predicate.replace_applicator 1.04% : 0.000004s : 43: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.66% : 0.000007s : 45: predicate.reshape_eliminate 1.47% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.26% : 0.000001s : 2: predicate.row_tensor_eliminate 1.49% : 0.000006s : 45: predicate.same_eliminate 0.45% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.39% : 0.000002s : 4: predicate.special_op_eliminate 0.76% : 0.000003s : 19: predicate.specialize_transform 1.79% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.71% : 0.000011s : 65: predicate.switch_defer_inline 2.43% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.34% : 0.000025s : 157: predicate.switch_simplify 1.64% : 0.000006s : 45: predicate.tile_eliminate 1.45% : 0.000006s : 45: predicate.transpose_eliminate 2.03% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.62% : 0.000006s : 45: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000013s : 56: predicate.tuple_list_get_item_eliminator 1.87% : 0.000007s : 45: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.72% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.63% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 2.00% : 0.000008s : 45: predicate.value_based_eliminate 0.09% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.26% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003457 32 44.26% : 0.001530s : 15: func_graph_cloner_run.FuncGraphClonerGraph 55.74% : 0.001927s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055057 87 0.10% : 0.000057s : 1: add_recomputation 0.20% : 0.000110s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.79% : 0.000435s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.13% : 0.000071s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 34.94% : 0.019237s : 1: jit_opt_a 0.31% : 0.000171s : 1: jit_opt_after_cconv 0.11% : 0.000061s : 1: jit_opt_b 0.82% : 0.000453s : 1: loop_unroll 1.44% : 0.000793s : 1: mutable_eliminate 5.42% : 0.002982s : 39: opt.transform.jit_opt_a 0.08% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 13.17% : 0.007252s : 2: renormalize.infer 4.10% : 0.002256s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000048s : 1: rewriter_after_opt_a 0.20% : 0.000109s : 1: rewriter_before_opt_a 0.15% : 0.000080s : 1: symbol_engine_optimizer 36.49% : 0.020092s : 1: type_inference TotalTime = 0.0468809, [30] [bootstrap]: 0.00025343 [type_inference]: 0.038839 [event_method]: 2.118e-05 [auto_monad]: 6.98e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 4.492e-05 [rewriter_before_opt_a]: 7.492e-05 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.00546118, [2] [Cycle 1]: 0.00168048, [27] [switch_simplify]: 5.315e-05 [loop_unroll]: 2.918e-05 [a_1]: 0.00051983 [with_stream_mark]: 2.078e-05 [recompute_prepare]: 8.42998e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.66998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.26997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 2.127e-05 [inline_without_move]: 5.74999e-06 [renormalize]: 0.00069645 [add_forward_monad_depend]: 5.74e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.51e-05 [cse]: 3.644e-05 [replace_applicator]: 1.476e-05 [Cycle 2]: 0.0003332, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 4.70001e-06 [a_1]: 8.915e-05 [with_stream_mark]: 1.108e-05 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.28002e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.01002e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 2.95998e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.342e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 6.96999e-06 [inline_without_move]: 4.52998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 7.90023e-07 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.218e-05 [replace_applicator]: 5.01002e-06 [py_interpret_to_execute_after_opt_a]: 1.257e-05 [rewriter_after_opt_a]: 3.769e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.0005591 [jit_opt_b]: 5.033e-05, [1] [Cycle 1]: 4.282e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.577e-05 [cconv]: 2.934e-05 [loop_unroll]: 0.00040744 [jit_opt_after_cconv]: 0.00014805, [1] [Cycle 1]: 0.00014225, [11] [c_1]: 2.04e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 7.09001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.464e-05 [call_graph_tuple_transform]: 1.876e-05 [tuple_list_get_item_eliminator]: 5.16998e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.683e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 5.82999e-06 [add_recomputation]: 5.283e-05 [cse_after_recomputation]: 2.419e-05, [1] [Cycle 1]: 1.859e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00043569 [symbol_engine_optimizer]: 7.071e-05, [1] [Cycle 1]: 6.49e-05, [6] [build]: 2.94001e-06 [elim_shapecalc]: 7.33999e-06 [elim_not_effective]: 1.244e-05 [opt_reshape]: 5.45001e-06 [fold_const_symbol]: 8.33999e-06 [renormalize]: 5.19998e-07 [validate]: 3.862e-05 Sums bootstrap : 0.000253s : 0.59% type_inference : 0.038839s : 90.67% event_method : 0.000021s : 0.05% auto_monad : 0.000070s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000045s : 0.10% rewriter_before_opt_a : 0.000075s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.14% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000609s : 1.42% jit_opt_a.with_stream_mark : 0.000032s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000028s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000697s : 1.63% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000049s : 0.11% jit_opt_a.replace_applicator : 0.000020s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000559s : 1.31% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000407s : 0.95% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000436s : 1.02% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.09% Time group info: ------[substitution.] 0.000216 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000005s : 3: substitution.graph_param_transform 79.12% : 0.000171s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000004s : 4: substitution.remove_not_recompute_node 7.27% : 0.000016s : 2: substitution.replace_old_param 5.84% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038762 2 8.81% : 0.003414s : 1: type_inference.infer 91.19% : 0.035348s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.39% : 0.000044s : 4: replace.inline 31.61% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.60% : 0.000169s : 4: match.inline 6.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.51% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.10% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000002s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.09% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000659 13 46.27% : 0.000305s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.79% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.94% : 0.000316s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048463 72 0.12% : 0.000056s : 1: add_recomputation 0.15% : 0.000073s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.55% : 0.000266s : 1: bootstrap 0.07% : 0.000032s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.27% : 0.005464s : 1: jit_opt_a 0.32% : 0.000156s : 1: jit_opt_after_cconv 0.11% : 0.000053s : 1: jit_opt_b 0.86% : 0.000415s : 1: loop_unroll 1.17% : 0.000568s : 1: mutable_eliminate 1.72% : 0.000833s : 26: opt.transform.jit_opt_a 0.10% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000048s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 0.83% : 0.000403s : 1: renormalize.infer 0.59% : 0.000284s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000041s : 1: rewriter_after_opt_a 0.16% : 0.000078s : 1: rewriter_before_opt_a 0.15% : 0.000073s : 1: symbol_engine_optimizer 80.19% : 0.038862s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.104.072 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.104.848 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0557827, [30] [bootstrap]: 0.00027127 [type_inference]: 0.0233859 [event_method]: 6.067e-05 [auto_monad]: 0.00010344 [graph_reusing]: 7.79002e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 3.274e-05 [rewriter_before_opt_a]: 0.0001228 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.025998, [3] [Cycle 1]: 0.0146643, [27] [switch_simplify]: 8.16e-05 [loop_unroll]: 4.437e-05 [a_1]: 0.00105047 [with_stream_mark]: 3.857e-05 [recompute_prepare]: 2.171e-05 [updatestate_depend_eliminate]: 1.062e-05 [updatestate_assign_eliminate]: 7.05e-06 [updatestate_loads_eliminate]: 7.22002e-06 [parameter_eliminate]: 2.89999e-06 [specialize_transform]: 1.422e-05 [updatestate_useless_node_eliminater]: 1.242e-05 [accelerated_algorithm]: 1.292e-05 [meta_shard_fg_expand]: 4.22e-06 [get_grad_eliminate_]: 1.238e-05 [merge_forward]: 8.77e-06 [cell_reuse_recompute_pass]: 8.89995e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.012e-05 [j_node_and_user_rematch]: 2.501e-05 [meta_fg_expand]: 0.00200315 [replace_old_param]: 7.969e-05 [inline_without_move]: 6.253e-05 [renormalize]: 0.0104154 [add_forward_monad_depend]: 1.55e-05 [auto_monad_grad]: 6.33e-06 [auto_monad_eliminator]: 6.584e-05 [cse]: 0.00025359 [replace_applicator]: 9.234e-05 [Cycle 2]: 0.00722865, [27] [switch_simplify]: 4.34e-05 [loop_unroll]: 4.055e-05 [a_1]: 0.00112554 [with_stream_mark]: 2.097e-05 [recompute_prepare]: 9.89001e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 4e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 7.80998e-06 [updatestate_useless_node_eliminater]: 6.81001e-06 [accelerated_algorithm]: 7.35998e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.827e-05 [j_node_and_user_rematch]: 1.12e-05 [meta_fg_expand]: 0.0001107 [replace_old_param]: 9.46e-06 [inline_without_move]: 6.46999e-06 [renormalize]: 0.0054675 [add_forward_monad_depend]: 1.309e-05 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 2.486e-05 [cse]: 3.559e-05 [replace_applicator]: 2.733e-05 [Cycle 3]: 0.0003724, [27] [switch_simplify]: 7.27997e-06 [loop_unroll]: 1.215e-05 [a_1]: 8.291e-05 [with_stream_mark]: 1.703e-05 [recompute_prepare]: 6.77002e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 4.55001e-06 [accelerated_algorithm]: 5.03002e-06 [meta_shard_fg_expand]: 2.77002e-06 [get_grad_eliminate_]: 4.77998e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 3.41001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.09e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 4.65999e-06 [inline_without_move]: 4.24002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.31e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 6.79999e-06 [cse]: 1.527e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 1.695e-05 [rewriter_after_opt_a]: 4.443e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 6.37001e-06 [mutable_eliminate]: 0.00083207 [jit_opt_b]: 5.423e-05, [1] [Cycle 1]: 4.596e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 3.423e-05 [loop_unroll]: 0.00049423 [jit_opt_after_cconv]: 0.00016602, [1] [Cycle 1]: 0.00015926, [11] [c_1]: 1.836e-05 [parameter_eliminate]: 4.36002e-06 [updatestate_depend_eliminate]: 7.79002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.288e-05 [call_graph_tuple_transform]: 2.177e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 6.83998e-06 [remove_dup_value]: 1.709e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 6.27001e-06 [add_recomputation]: 5.076e-05 [cse_after_recomputation]: 2.39e-05, [1] [Cycle 1]: 1.848e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.547e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.00052396 [symbol_engine_optimizer]: 0.00319395, [1] [Cycle 1]: 0.00318391, [6] [build]: 4.61002e-06 [elim_shapecalc]: 8.03001e-06 [elim_not_effective]: 1.39e-05 [opt_reshape]: 6.15002e-06 [fold_const_symbol]: 0.00307369 [renormalize]: 1.97001e-06 [validate]: 7.238e-05 Sums bootstrap : 0.000271s : 0.53% type_inference : 0.023386s : 45.83% event_method : 0.000061s : 0.12% auto_monad : 0.000103s : 0.20% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000033s : 0.06% rewriter_before_opt_a : 0.000123s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000132s : 0.26% jit_opt_a.loop_unroll : 0.000097s : 0.19% jit_opt_a.a_1 : 0.002259s : 4.43% jit_opt_a.with_stream_mark : 0.000077s : 0.15% jit_opt_a.recompute_prepare : 0.000038s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.05% jit_opt_a.accelerated_algorithm : 0.000025s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.05% jit_opt_a.merge_forward : 0.000017s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000069s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.09% jit_opt_a.meta_fg_expand : 0.002117s : 4.15% jit_opt_a.replace_old_param : 0.000094s : 0.18% jit_opt_a.inline_without_move : 0.000073s : 0.14% jit_opt_a.renormalize : 0.015883s : 31.13% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000097s : 0.19% jit_opt_a.cse : 0.000304s : 0.60% jit_opt_a.replace_applicator : 0.000126s : 0.25% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000044s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000832s : 1.63% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000034s : 0.07% loop_unroll : 0.000494s : 0.97% jit_opt_after_cconv.c_1 : 0.000018s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000524s : 1.03% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.003074s : 6.02% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000072s : 0.14% Time group info: ------[substitution.] 0.000619 109 0.41% : 0.000003s : 2: substitution.elim_not_effective 0.62% : 0.000004s : 2: substitution.fold_const_symbol 1.00% : 0.000006s : 2: substitution.graph_param_transform 65.74% : 0.000407s : 13: substitution.inline 3.43% : 0.000021s : 2: substitution.inline_without_move 1.81% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.72% : 0.000011s : 7: substitution.minmaximum_grad 1.18% : 0.000007s : 5: substitution.partial_eliminate 2.21% : 0.000014s : 13: substitution.remove_not_recompute_node 5.38% : 0.000033s : 10: substitution.replace_applicator 1.33% : 0.000008s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000006s : 1: substitution.tile_eliminate 3.79% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.50% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.46% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023287 2 93.28% : 0.021723s : 1: type_inference.infer 6.72% : 0.001564s : 1: type_inference.specialize ------[replace.] 0.000191 20 65.11% : 0.000124s : 13: replace.inline 34.89% : 0.000067s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000422 20 94.57% : 0.000399s : 13: match.inline 5.43% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000384 2517 1.50% : 0.000006s : 43: predicate.accumulaten_eliminater 0.49% : 0.000002s : 2: predicate.ad_related_special_op_eliminate 1.37% : 0.000005s : 43: predicate.addn_check_dump 1.54% : 0.000006s : 43: predicate.addn_zero_filter 1.97% : 0.000008s : 43: predicate.arithmetic_simplify 1.50% : 0.000006s : 43: predicate.cast_eliminate 0.11% : 0.000000s : 2: predicate.check_bprop_eliminate 1.36% : 0.000005s : 43: predicate.compare_switch_simplify 1.46% : 0.000006s : 43: predicate.depend_value_elim 1.39% : 0.000005s : 43: predicate.dict_get_item_const_eliminator 1.45% : 0.000006s : 43: predicate.dict_get_item_eliminator 1.46% : 0.000006s : 43: predicate.dict_set_item_eliminator 0.28% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.14% : 0.000001s : 2: predicate.elim_not_effective 0.18% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000006s : 43: predicate.environ_add_const_eliminate 1.40% : 0.000005s : 43: predicate.environ_get_add_eliminate 1.36% : 0.000005s : 43: predicate.environ_get_depend_swap 1.42% : 0.000005s : 43: predicate.environ_get_eliminate 1.36% : 0.000005s : 43: predicate.environ_get_set_eliminate 0.40% : 0.000002s : 2: predicate.fold_const_symbol 0.79% : 0.000003s : 17: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.45% : 0.000017s : 67: predicate.inline 2.09% : 0.000008s : 45: predicate.inline_without_move 0.32% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.20% : 0.000005s : 17: predicate.less_batch_normalization 1.81% : 0.000007s : 50: predicate.list_to_tuple_eliminator_ 1.86% : 0.000007s : 52: predicate.load_eliminater 0.53% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.41% : 0.000013s : 88: predicate.loop_unroll_before_grad 1.86% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 43: predicate.merge_addn 1.46% : 0.000006s : 43: predicate.minmaximum_grad 0.89% : 0.000003s : 2: predicate.mutable_eliminate 0.11% : 0.000000s : 2: predicate.opt_reshape 2.32% : 0.000009s : 52: predicate.partial_eliminate 1.46% : 0.000006s : 43: predicate.print_const_string_wrapper 2.01% : 0.000008s : 43: predicate.reduce_eliminate 1.84% : 0.000007s : 50: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000002s : 17: predicate.remove_not_recompute_node 2.77% : 0.000011s : 93: predicate.replace_applicator 1.36% : 0.000005s : 45: predicate.replace_old_param 0.08% : 0.000000s : 2: predicate.reset_defer_inline 1.52% : 0.000006s : 43: predicate.reshape_eliminate 1.44% : 0.000006s : 43: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 2: predicate.row_tensor_eliminate 1.56% : 0.000006s : 43: predicate.same_eliminate 0.57% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 4: predicate.special_op_eliminate 0.74% : 0.000003s : 17: predicate.specialize_transform 1.94% : 0.000007s : 43: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000006s : 43: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.76% : 0.000011s : 63: predicate.switch_defer_inline 2.39% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.30% : 0.000024s : 153: predicate.switch_simplify 1.58% : 0.000006s : 43: predicate.tile_eliminate 1.47% : 0.000006s : 43: predicate.transpose_eliminate 1.95% : 0.000007s : 43: predicate.tuple_list_convert_item_index_to_positive 1.67% : 0.000006s : 43: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000013s : 54: predicate.tuple_list_get_item_eliminator 1.77% : 0.000007s : 43: predicate.tuple_list_set_item_eliminator 1.85% : 0.000007s : 50: predicate.tuple_to_list_eliminator_ 1.84% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.71% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.86% : 0.000007s : 43: predicate.value_based_eliminate 0.10% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.29% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002861 36 61.54% : 0.001761s : 19: func_graph_cloner_run.FuncGraphClonerGraph 38.46% : 0.001100s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077693 87 0.07% : 0.000054s : 1: add_recomputation 0.14% : 0.000108s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.38% : 0.000293s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.09% : 0.000067s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 33.47% : 0.026002s : 1: jit_opt_a 0.22% : 0.000169s : 1: jit_opt_after_cconv 0.07% : 0.000057s : 1: jit_opt_b 0.65% : 0.000503s : 1: loop_unroll 1.09% : 0.000847s : 1: mutable_eliminate 3.83% : 0.002976s : 39: opt.transform.jit_opt_a 0.06% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 3.98% : 0.003095s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000533s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000035s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 17.11% : 0.013294s : 2: renormalize.infer 3.29% : 0.002558s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000048s : 1: rewriter_after_opt_a 0.16% : 0.000126s : 1: rewriter_before_opt_a 4.12% : 0.003199s : 1: symbol_engine_optimizer 30.13% : 0.023411s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.202.187 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cdc0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.203.088 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.029572, [30] [bootstrap]: 0.00032303 [type_inference]: 0.0196388 [event_method]: 1.823e-05 [auto_monad]: 6.652e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 9.656e-05 [rewriter_before_opt_a]: 8.004e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00728913, [2] [Cycle 1]: 0.00166287, [27] [switch_simplify]: 5.211e-05 [loop_unroll]: 2.841e-05 [a_1]: 0.00050269 [with_stream_mark]: 1.588e-05 [recompute_prepare]: 7.68999e-06 [updatestate_depend_eliminate]: 3.92998e-06 [updatestate_assign_eliminate]: 3.77002e-06 [updatestate_loads_eliminate]: 1.68e-05 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.391e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00072712 [add_forward_monad_depend]: 4.94e-06 [auto_monad_grad]: 2.76999e-06 [auto_monad_eliminator]: 1.481e-05 [cse]: 3.481e-05 [replace_applicator]: 1.099e-05 [Cycle 2]: 0.00030758, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.82e-06 [a_1]: 8.718e-05 [with_stream_mark]: 9.02e-06 [recompute_prepare]: 4.92999e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 2.50002e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.176e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.00999e-06 [cse]: 1.225e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.034e-05 [rewriter_after_opt_a]: 3.456e-05 [convert_after_rewriter]: 9.39e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.0005236 [jit_opt_b]: 4.725e-05, [1] [Cycle 1]: 4.084e-05, [2] [frontend_op_eliminate]: 1.453e-05 [inline_after_opt_a]: 1.559e-05 [cconv]: 2.534e-05 [loop_unroll]: 0.00041025 [jit_opt_after_cconv]: 0.00014162, [1] [Cycle 1]: 0.00013497, [11] [c_1]: 2.042e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 5.62001e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 2.192e-05 [call_graph_tuple_transform]: 1.805e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.76998e-06 [remove_dup_value]: 1.515e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 5.09e-06 [add_recomputation]: 5.106e-05 [cse_after_recomputation]: 2.266e-05, [1] [Cycle 1]: 1.746e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.823e-05 [get_jit_bprop_graph]: 1.53002e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00044383 [symbol_engine_optimizer]: 7.054e-05, [1] [Cycle 1]: 6.445e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 7.53e-06 [elim_not_effective]: 1.297e-05 [opt_reshape]: 5.72999e-06 [fold_const_symbol]: 8.55001e-06 [renormalize]: 4.09986e-07 [validate]: 3.541e-05 Sums bootstrap : 0.000323s : 1.36% type_inference : 0.019639s : 82.87% event_method : 0.000018s : 0.08% auto_monad : 0.000067s : 0.28% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000097s : 0.41% rewriter_before_opt_a : 0.000080s : 0.34% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.25% jit_opt_a.loop_unroll : 0.000033s : 0.14% jit_opt_a.a_1 : 0.000590s : 2.49% jit_opt_a.with_stream_mark : 0.000025s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000019s : 0.08% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000015s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000727s : 3.07% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000047s : 0.20% jit_opt_a.replace_applicator : 0.000016s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000035s : 0.15% convert_after_rewriter : 0.000009s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000524s : 2.21% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000025s : 0.11% loop_unroll : 0.000410s : 1.73% jit_opt_after_cconv.c_1 : 0.000020s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000051s : 0.22% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000444s : 1.87% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.15% Time group info: ------[substitution.] 0.000183 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 2.94% : 0.000005s : 3: substitution.graph_param_transform 82.09% : 0.000150s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000004s : 4: substitution.remove_not_recompute_node 1.94% : 0.000004s : 2: substitution.replace_old_param 7.52% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019572 2 93.54% : 0.018307s : 1: type_inference.infer 6.46% : 0.001265s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.02% : 0.000045s : 4: replace.inline 31.98% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 92.15% : 0.000148s : 4: match.inline 7.85% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.34% : 0.000001s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.57% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.47% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 1.14% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.20% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000733 13 50.63% : 0.000371s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.86% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.51% : 0.000334s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031149 72 0.17% : 0.000054s : 1: add_recomputation 0.22% : 0.000070s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.11% : 0.000345s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.04% : 0.000012s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.07% : 0.000022s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 23.41% : 0.007292s : 1: jit_opt_a 0.46% : 0.000144s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.34% : 0.000418s : 1: loop_unroll 1.71% : 0.000532s : 1: mutable_eliminate 2.55% : 0.000794s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.45% : 0.000452s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000100s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000017s : 1: remove_dup_value 1.29% : 0.000403s : 1: renormalize.infer 1.02% : 0.000316s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000037s : 1: rewriter_after_opt_a 0.27% : 0.000084s : 1: rewriter_before_opt_a 0.23% : 0.000073s : 1: symbol_engine_optimizer 63.09% : 0.019651s : 1: type_inference TotalTime = 0.0774007, [30] [bootstrap]: 0.00027182 [type_inference]: 0.0696898 [event_method]: 2.024e-05 [auto_monad]: 6.834e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 9.281e-05 [rewriter_before_opt_a]: 7.974e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00512243, [2] [Cycle 1]: 0.0016663, [27] [switch_simplify]: 5.059e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00049471 [with_stream_mark]: 1.594e-05 [recompute_prepare]: 7.95e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.87998e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.532e-05 [j_node_and_user_rematch]: 8.84998e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 8.54002e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00075303 [add_forward_monad_depend]: 5.49998e-06 [auto_monad_grad]: 2.11998e-06 [auto_monad_eliminator]: 1.467e-05 [cse]: 3.436e-05 [replace_applicator]: 1.157e-05 [Cycle 2]: 0.00031052, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 4.79e-06 [a_1]: 8.69e-05 [with_stream_mark]: 8.62e-06 [recompute_prepare]: 4.94998e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.81002e-06 [updatestate_useless_node_eliminater]: 4.89003e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 7.8e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.80013e-07 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.27e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.09e-05 [rewriter_after_opt_a]: 3.513e-05 [convert_after_rewriter]: 6.93998e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00051456 [jit_opt_b]: 4.88e-05, [1] [Cycle 1]: 4.193e-05, [2] [frontend_op_eliminate]: 1.539e-05 [inline_after_opt_a]: 1.58e-05 [cconv]: 2.462e-05 [loop_unroll]: 0.0004069 [jit_opt_after_cconv]: 0.00015615, [1] [Cycle 1]: 0.00014976, [11] [c_1]: 2.028e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 2.058e-05 [call_graph_tuple_transform]: 1.755e-05 [tuple_list_get_item_eliminator]: 2.255e-05 [none_parameter_eliminate]: 1.92999e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.659e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 4.894e-05 [cse_after_recomputation]: 2.365e-05, [1] [Cycle 1]: 1.807e-05, [1] [cse]: 1.25e-05 [auto_monad_reorder]: 1.735e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00044201 [symbol_engine_optimizer]: 6.926e-05, [1] [Cycle 1]: 6.311e-05, [6] [build]: 3.16999e-06 [elim_shapecalc]: 7.13e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 5.49e-06 [fold_const_symbol]: 8.43001e-06 [renormalize]: 3.69997e-07 [validate]: 3.55e-05 Sums bootstrap : 0.000272s : 0.37% type_inference : 0.069690s : 94.55% event_method : 0.000020s : 0.03% auto_monad : 0.000068s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000093s : 0.13% rewriter_before_opt_a : 0.000080s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000582s : 0.79% jit_opt_a.with_stream_mark : 0.000025s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000753s : 1.02% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000047s : 0.06% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000515s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000407s : 0.55% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000023s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000442s : 0.60% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.05% Time group info: ------[substitution.] 0.000178 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000005s : 3: substitution.graph_param_transform 82.54% : 0.000147s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000004s : 2: substitution.replace_old_param 6.58% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069622 2 98.08% : 0.068283s : 1: type_inference.infer 1.92% : 0.001339s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.22% : 0.000044s : 4: replace.inline 31.78% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 93.12% : 0.000145s : 4: match.inline 6.88% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.70% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.48% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000712 13 47.98% : 0.000342s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.17% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.85% : 0.000341s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079014 72 0.07% : 0.000052s : 1: add_recomputation 0.09% : 0.000072s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.36% : 0.000288s : 1: bootstrap 0.03% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.49% : 0.005125s : 1: jit_opt_a 0.20% : 0.000159s : 1: jit_opt_after_cconv 0.06% : 0.000051s : 1: jit_opt_b 0.52% : 0.000414s : 1: loop_unroll 0.66% : 0.000523s : 1: mutable_eliminate 1.00% : 0.000788s : 26: opt.transform.jit_opt_a 0.08% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000096s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.52% : 0.000407s : 1: renormalize.infer 0.43% : 0.000338s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000038s : 1: rewriter_after_opt_a 0.11% : 0.000083s : 1: rewriter_before_opt_a 0.09% : 0.000072s : 1: symbol_engine_optimizer 88.22% : 0.069707s : 1: type_inference TotalTime = 0.216536, [30] [bootstrap]: 0.00039756 [type_inference]: 0.204877 [event_method]: 2.032e-05 [auto_monad]: 6.668e-05 [graph_reusing]: 5.09e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 0.00027394 [rewriter_before_opt_a]: 9.227e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00830868, [2] [Cycle 1]: 0.00473466, [27] [switch_simplify]: 5.458e-05 [loop_unroll]: 3.476e-05 [a_1]: 0.00065156 [with_stream_mark]: 1.635e-05 [recompute_prepare]: 8.50001e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.412e-05 [j_node_and_user_rematch]: 9.71003e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 6.24001e-06 [renormalize]: 0.0036133 [add_forward_monad_depend]: 9.12001e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.924e-05 [cse]: 3.426e-05 [replace_applicator]: 2.116e-05 [Cycle 2]: 0.00038165, [27] [switch_simplify]: 7.09001e-06 [loop_unroll]: 6.19999e-06 [a_1]: 0.00012082 [with_stream_mark]: 1.399e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 6.11998e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.693e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.77999e-06 [inline_without_move]: 5.71e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.57002e-06 [cse]: 1.548e-05 [replace_applicator]: 6.51999e-06 [py_interpret_to_execute_after_opt_a]: 1.543e-05 [rewriter_after_opt_a]: 4.199e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00078299 [jit_opt_b]: 5.763e-05, [1] [Cycle 1]: 4.963e-05, [2] [frontend_op_eliminate]: 1.938e-05 [inline_after_opt_a]: 1.856e-05 [cconv]: 3.141e-05 [loop_unroll]: 0.00043912 [jit_opt_after_cconv]: 0.00017688, [1] [Cycle 1]: 0.00017053, [11] [c_1]: 2.603e-05 [parameter_eliminate]: 5.48002e-06 [updatestate_depend_eliminate]: 9.24e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.88e-06 [cse]: 3.578e-05 [call_graph_tuple_transform]: 2.373e-05 [tuple_list_get_item_eliminator]: 6.69999e-06 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.88e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 1.088e-05 [add_recomputation]: 5.611e-05 [cse_after_recomputation]: 2.608e-05, [1] [Cycle 1]: 2.101e-05, [1] [cse]: 1.475e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 6.97002e-06 [opt_after_jit_grad]: 0.00047208 [symbol_engine_optimizer]: 7.888e-05, [1] [Cycle 1]: 7.257e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 9.07001e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 6.83998e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 5.69999e-07 [validate]: 5.459e-05 Sums bootstrap : 0.000398s : 0.19% type_inference : 0.204877s : 96.30% event_method : 0.000020s : 0.01% auto_monad : 0.000067s : 0.03% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000274s : 0.13% rewriter_before_opt_a : 0.000092s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000772s : 0.36% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003613s : 1.70% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000783s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000439s : 0.21% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000472s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.03% Time group info: ------[substitution.] 0.000244 25 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 4: substitution.graph_param_transform 85.52% : 0.000209s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.02% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.204793 2 78.82% : 0.161427s : 1: type_inference.infer 21.18% : 0.043366s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.76% : 0.000064s : 5: replace.inline 31.24% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 94.89% : 0.000206s : 5: match.inline 5.11% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000002s : 13: predicate.arithmetic_simplify 1.55% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.87% : 0.000008s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 19: predicate.load_eliminater 1.61% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.77% : 0.000002s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.88% : 0.000011s : 65: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.043995 33 5.08% : 0.002233s : 24: func_graph_cloner_run.FuncGraphClonerGraph 0.15% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 94.77% : 0.041695s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.221237 72 0.03% : 0.000059s : 1: add_recomputation 0.03% : 0.000070s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.19% : 0.000417s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 3.76% : 0.008312s : 1: jit_opt_a 0.08% : 0.000180s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.20% : 0.000447s : 1: loop_unroll 0.36% : 0.000794s : 1: mutable_eliminate 0.46% : 0.001021s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000480s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000279s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.29% : 0.002847s : 1: renormalize.infer 0.34% : 0.000756s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.04% : 0.000098s : 1: rewriter_before_opt_a 0.04% : 0.000081s : 1: symbol_engine_optimizer 92.61% : 0.204890s : 1: type_inference TotalTime = 0.168804, [30] [bootstrap]: 0.00034937 [type_inference]: 0.134653 [event_method]: 0.00050805 [auto_monad]: 0.00011479 [graph_reusing]: 7.65e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 3.905e-05 [rewriter_before_opt_a]: 0.0001319 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0304479, [3] [Cycle 1]: 0.0181717, [27] [switch_simplify]: 9.255e-05 [loop_unroll]: 4.633e-05 [a_1]: 0.00107718 [with_stream_mark]: 3.806e-05 [recompute_prepare]: 2.382e-05 [updatestate_depend_eliminate]: 1.093e-05 [updatestate_assign_eliminate]: 8.15e-06 [updatestate_loads_eliminate]: 7.6e-06 [parameter_eliminate]: 3.23e-06 [specialize_transform]: 1.605e-05 [updatestate_useless_node_eliminater]: 1.479e-05 [accelerated_algorithm]: 1.49e-05 [meta_shard_fg_expand]: 4.79e-06 [get_grad_eliminate_]: 1.447e-05 [merge_forward]: 9.33002e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.002e-05 [j_node_and_user_rematch]: 2.629e-05 [meta_fg_expand]: 0.00209935 [replace_old_param]: 8.205e-05 [inline_without_move]: 6.507e-05 [renormalize]: 0.013699 [add_forward_monad_depend]: 1.421e-05 [auto_monad_grad]: 7.31999e-06 [auto_monad_eliminator]: 6.538e-05 [cse]: 0.0002734 [replace_applicator]: 9.413e-05 [Cycle 2]: 0.00729673, [27] [switch_simplify]: 4.42e-05 [loop_unroll]: 4.261e-05 [a_1]: 0.0011805 [with_stream_mark]: 1.776e-05 [recompute_prepare]: 8.93002e-06 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 4.05e-06 [updatestate_loads_eliminate]: 3.99002e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.69001e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 6.32001e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 1.198e-05 [meta_fg_expand]: 0.00011444 [replace_old_param]: 8.48001e-06 [inline_without_move]: 6.72002e-06 [renormalize]: 0.00544672 [add_forward_monad_depend]: 1.188e-05 [auto_monad_grad]: 2.99001e-06 [auto_monad_eliminator]: 2.317e-05 [cse]: 9.626e-05 [replace_applicator]: 2.505e-05 [Cycle 3]: 0.00039197, [27] [switch_simplify]: 6.00002e-06 [loop_unroll]: 5.92001e-06 [a_1]: 8.512e-05 [with_stream_mark]: 1.59e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.21998e-06 [accelerated_algorithm]: 5.09e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 2.73998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.031e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 5.26002e-06 [inline_without_move]: 4.67e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.13002e-06 [auto_monad_grad]: 1.04998e-06 [auto_monad_eliminator]: 6.96999e-06 [cse]: 1.484e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.583e-05 [rewriter_after_opt_a]: 4.156e-05 [convert_after_rewriter]: 7.68999e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00077934 [jit_opt_b]: 5.462e-05, [1] [Cycle 1]: 4.647e-05, [2] [frontend_op_eliminate]: 1.741e-05 [inline_after_opt_a]: 1.685e-05 [cconv]: 2.96e-05 [loop_unroll]: 0.00047035 [jit_opt_after_cconv]: 0.00015667, [1] [Cycle 1]: 0.00014951, [11] [c_1]: 1.998e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 6.25002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.334e-05 [call_graph_tuple_transform]: 2.075e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 1.16002e-06 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.79e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 6.51e-06 [add_recomputation]: 4.558e-05 [cse_after_recomputation]: 2.483e-05, [1] [Cycle 1]: 1.926e-05, [1] [cse]: 1.302e-05 [auto_monad_reorder]: 1.663e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 5.51e-06 [opt_after_jit_grad]: 0.00049992 [symbol_engine_optimizer]: 0.00010082, [1] [Cycle 1]: 9.382e-05, [6] [build]: 4.11001e-06 [elim_shapecalc]: 7.53e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 2.955e-05 [renormalize]: 2.69996e-07 [validate]: 4.269e-05 Sums bootstrap : 0.000349s : 0.21% type_inference : 0.134653s : 82.52% event_method : 0.000508s : 0.31% auto_monad : 0.000115s : 0.07% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000039s : 0.02% rewriter_before_opt_a : 0.000132s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000143s : 0.09% jit_opt_a.loop_unroll : 0.000095s : 0.06% jit_opt_a.a_1 : 0.002343s : 1.44% jit_opt_a.with_stream_mark : 0.000072s : 0.04% jit_opt_a.recompute_prepare : 0.000038s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.002216s : 1.36% jit_opt_a.replace_old_param : 0.000096s : 0.06% jit_opt_a.inline_without_move : 0.000076s : 0.05% jit_opt_a.renormalize : 0.019146s : 11.73% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000096s : 0.06% jit_opt_a.cse : 0.000385s : 0.24% jit_opt_a.replace_applicator : 0.000125s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000779s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000470s : 0.29% jit_opt_after_cconv.c_1 : 0.000020s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000500s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000030s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000632 109 0.35% : 0.000002s : 2: substitution.elim_not_effective 0.29% : 0.000002s : 2: substitution.fold_const_symbol 1.12% : 0.000007s : 2: substitution.graph_param_transform 67.13% : 0.000425s : 13: substitution.inline 3.21% : 0.000020s : 2: substitution.inline_without_move 1.73% : 0.000011s : 13: substitution.j_node_and_user_rematch 1.85% : 0.000012s : 7: substitution.minmaximum_grad 1.38% : 0.000009s : 5: substitution.partial_eliminate 1.93% : 0.000012s : 13: substitution.remove_not_recompute_node 5.20% : 0.000033s : 10: substitution.replace_applicator 1.21% : 0.000008s : 10: substitution.replace_old_param 0.42% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.86% : 0.000005s : 1: substitution.tile_eliminate 3.57% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.59% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.15% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.134549 2 97.62% : 0.131350s : 1: type_inference.infer 2.38% : 0.003199s : 1: type_inference.specialize ------[replace.] 0.000191 20 66.32% : 0.000127s : 13: replace.inline 33.68% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000439 20 94.91% : 0.000417s : 13: match.inline 5.09% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000395 2628 1.53% : 0.000006s : 45: predicate.accumulaten_eliminater 0.42% : 0.000002s : 2: predicate.ad_related_special_op_eliminate 1.38% : 0.000005s : 45: predicate.addn_check_dump 1.72% : 0.000007s : 45: predicate.addn_zero_filter 2.19% : 0.000009s : 45: predicate.arithmetic_simplify 1.62% : 0.000006s : 45: predicate.cast_eliminate 0.09% : 0.000000s : 2: predicate.check_bprop_eliminate 1.40% : 0.000006s : 45: predicate.compare_switch_simplify 1.47% : 0.000006s : 45: predicate.depend_value_elim 1.41% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.60% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.29% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 2: predicate.elim_not_effective 0.15% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.40% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.44% : 0.000006s : 45: predicate.environ_get_depend_swap 1.50% : 0.000006s : 45: predicate.environ_get_eliminate 1.40% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.84% : 0.000003s : 18: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.54% : 0.000018s : 69: predicate.inline 1.96% : 0.000008s : 46: predicate.inline_without_move 0.33% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.99% : 0.000004s : 18: predicate.less_batch_normalization 1.75% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 54: predicate.load_eliminater 0.48% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.30% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.70% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.40% : 0.000006s : 45: predicate.merge_addn 1.47% : 0.000006s : 45: predicate.minmaximum_grad 0.45% : 0.000002s : 2: predicate.mutable_eliminate 0.15% : 0.000001s : 2: predicate.opt_reshape 2.40% : 0.000009s : 54: predicate.partial_eliminate 1.46% : 0.000006s : 45: predicate.print_const_string_wrapper 2.10% : 0.000008s : 45: predicate.reduce_eliminate 1.78% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 18: predicate.remove_not_recompute_node 2.81% : 0.000011s : 99: predicate.replace_applicator 1.13% : 0.000004s : 46: predicate.replace_old_param 0.08% : 0.000000s : 2: predicate.reset_defer_inline 1.58% : 0.000006s : 45: predicate.reshape_eliminate 1.60% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 2: predicate.row_tensor_eliminate 1.46% : 0.000006s : 45: predicate.same_eliminate 0.46% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.36% : 0.000001s : 4: predicate.special_op_eliminate 0.78% : 0.000003s : 18: predicate.specialize_transform 1.80% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.68% : 0.000011s : 65: predicate.switch_defer_inline 2.39% : 0.000009s : 65: predicate.switch_layer_defer_inline 6.69% : 0.000026s : 160: predicate.switch_simplify 1.66% : 0.000007s : 45: predicate.tile_eliminate 1.57% : 0.000006s : 45: predicate.transpose_eliminate 1.98% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000013s : 56: predicate.tuple_list_get_item_eliminator 1.93% : 0.000008s : 45: predicate.tuple_list_set_item_eliminator 1.80% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.77% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.69% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.87% : 0.000007s : 45: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004866 45 78.75% : 0.003832s : 28: func_graph_cloner_run.FuncGraphClonerGraph 21.25% : 0.001034s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.191074 87 0.03% : 0.000049s : 1: add_recomputation 0.06% : 0.000121s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.20% : 0.000381s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.27% : 0.000517s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.94% : 0.030452s : 1: jit_opt_a 0.08% : 0.000160s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.25% : 0.000478s : 1: loop_unroll 0.41% : 0.000788s : 1: mutable_eliminate 1.61% : 0.003080s : 39: opt.transform.jit_opt_a 0.02% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000053s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000509s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 8.66% : 0.016539s : 2: renormalize.infer 1.35% : 0.002580s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000135s : 1: rewriter_before_opt_a 0.05% : 0.000104s : 1: symbol_engine_optimizer 70.48% : 0.134677s : 1: type_inference TotalTime = 0.581586, [30] [bootstrap]: 0.00029736 [type_inference]: 0.518029 [event_method]: 2.782e-05 [auto_monad]: 8.67e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00065681 [rewriter_before_opt_a]: 0.00010798 [expand_dump_flag]: 4.15999e-06 [jit_opt_a]: 0.0387341, [2] [Cycle 1]: 0.00554088, [27] [switch_simplify]: 7.799e-05 [loop_unroll]: 3.656e-05 [a_1]: 0.00083528 [with_stream_mark]: 2.297e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 7.71999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.655e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.63003e-06 [replace_old_param]: 1.173e-05 [inline_without_move]: 7.26001e-06 [renormalize]: 0.00410976 [add_forward_monad_depend]: 1.101e-05 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 2.243e-05 [cse]: 4.205e-05 [replace_applicator]: 2.599e-05 [Cycle 2]: 0.00044766, [27] [switch_simplify]: 8.28999e-06 [loop_unroll]: 7.27002e-06 [a_1]: 0.00016115 [with_stream_mark]: 1.744e-05 [recompute_prepare]: 7.25998e-06 [updatestate_depend_eliminate]: 4.00998e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 3.9e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 1.158e-05 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 1.103e-05 [inline_without_move]: 5.64998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.64998e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.63001e-06 [cse]: 1.602e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 2.036e-05 [rewriter_after_opt_a]: 4.227e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.50001e-06 [mutable_eliminate]: 0.00084392 [jit_opt_b]: 6.385e-05, [1] [Cycle 1]: 5.518e-05, [2] [frontend_op_eliminate]: 2.252e-05 [inline_after_opt_a]: 2.017e-05 [cconv]: 3.182e-05 [loop_unroll]: 0.00045622 [jit_opt_after_cconv]: 0.00017433, [1] [Cycle 1]: 0.00016748, [11] [c_1]: 2.767e-05 [parameter_eliminate]: 3.68e-06 [updatestate_depend_eliminate]: 7.96001e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.223e-05 [call_graph_tuple_transform]: 2.381e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 6.51e-06 [remove_dup_value]: 1.673e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 8.92999e-06 [add_recomputation]: 5.664e-05 [cse_after_recomputation]: 2.617e-05, [1] [Cycle 1]: 1.959e-05, [1] [cse]: 1.309e-05 [auto_monad_reorder]: 1.767e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 6.39001e-06 [opt_after_jit_grad]: 0.0214319 [symbol_engine_optimizer]: 0.0001155, [1] [Cycle 1]: 0.00010381, [6] [build]: 7.83999e-06 [elim_shapecalc]: 1.223e-05 [elim_not_effective]: 2.748e-05 [opt_reshape]: 8.89e-06 [fold_const_symbol]: 1.389e-05 [renormalize]: 1.17e-06 [validate]: 6.829e-05 Sums bootstrap : 0.000297s : 0.05% type_inference : 0.518029s : 94.51% event_method : 0.000028s : 0.01% auto_monad : 0.000087s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000657s : 0.12% rewriter_before_opt_a : 0.000108s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.02% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.000996s : 0.18% jit_opt_a.with_stream_mark : 0.000040s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004110s : 0.75% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000058s : 0.01% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000844s : 0.15% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.00% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000032s : 0.01% loop_unroll : 0.000456s : 0.08% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.021432s : 3.91% symbol_engine_optimizer.build : 0.000008s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.01% Time group info: ------[substitution.] 0.000357 28 0.86% : 0.000003s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 1.61% : 0.000006s : 4: substitution.graph_param_transform 84.64% : 0.000302s : 5: substitution.inline 1.48% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.11% : 0.000015s : 3: substitution.reduce_eliminate 1.51% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000007s : 2: substitution.replace_old_param 3.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.517907 2 99.20% : 0.513782s : 1: type_inference.infer 0.80% : 0.004126s : 1: type_inference.specialize ------[replace.] 0.000126 7 68.16% : 0.000086s : 5: replace.inline 31.84% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000310 7 96.54% : 0.000299s : 5: match.inline 3.46% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000163 886 1.14% : 0.000002s : 13: predicate.accumulaten_eliminater 3.35% : 0.000005s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.73% : 0.000003s : 13: predicate.addn_zero_filter 2.17% : 0.000004s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.74% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000009s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.09% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 19: predicate.partial_eliminate 0.99% : 0.000002s : 13: predicate.print_const_string_wrapper 2.42% : 0.000004s : 13: predicate.reduce_eliminate 1.26% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.55% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.49% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.77% : 0.000011s : 64: predicate.switch_simplify 1.53% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.59% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.43% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004484 25 74.01% : 0.003319s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.15% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 23.84% : 0.001069s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.587072 72 0.01% : 0.000059s : 1: add_recomputation 0.02% : 0.000090s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.05% : 0.000315s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.60% : 0.038739s : 1: jit_opt_a 0.03% : 0.000177s : 1: jit_opt_after_cconv 0.01% : 0.000067s : 1: jit_opt_b 0.08% : 0.000465s : 1: loop_unroll 0.15% : 0.000855s : 1: mutable_eliminate 0.22% : 0.001284s : 26: opt.transform.jit_opt_a 0.01% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000036s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000063s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000057s : 4: opt.transform.symbol_engine_opt 3.65% : 0.021457s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000664s : 1: py_interpret_to_execute 0.00% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 0.50% : 0.002938s : 1: renormalize.infer 0.20% : 0.001158s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.02% : 0.000113s : 1: rewriter_before_opt_a 0.02% : 0.000119s : 1: symbol_engine_optimizer 88.24% : 0.518054s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.428.710 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.429.330 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0119758, [30] [bootstrap]: 0.00030988 [type_inference]: 0.00439904 [event_method]: 1.797e-05 [auto_monad]: 6.356e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 3.282e-05 [rewriter_before_opt_a]: 7.565e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00503013, [2] [Cycle 1]: 0.00142846, [27] [switch_simplify]: 5.347e-05 [loop_unroll]: 2.883e-05 [a_1]: 0.00050878 [with_stream_mark]: 1.715e-05 [recompute_prepare]: 7.08e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.09998e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00049705 [add_forward_monad_depend]: 5.23002e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.424e-05 [cse]: 3.263e-05 [replace_applicator]: 1.098e-05 [Cycle 2]: 0.00033141, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.75999e-06 [a_1]: 8.757e-05 [with_stream_mark]: 8.34002e-06 [recompute_prepare]: 4.85001e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 4.86002e-06 [updatestate_useless_node_eliminater]: 4.72998e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.65997e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.78e-06 [inline_without_move]: 4.58999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.26998e-06 [cse]: 3.302e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.093e-05 [rewriter_after_opt_a]: 3.575e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00048709 [jit_opt_b]: 4.81e-05, [1] [Cycle 1]: 4.108e-05, [2] [frontend_op_eliminate]: 1.482e-05 [inline_after_opt_a]: 1.558e-05 [cconv]: 2.471e-05 [loop_unroll]: 0.00044262 [jit_opt_after_cconv]: 0.00014647, [1] [Cycle 1]: 0.00013988, [11] [c_1]: 1.973e-05 [parameter_eliminate]: 2.31e-06 [updatestate_depend_eliminate]: 5.47001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.149e-05 [call_graph_tuple_transform]: 2.458e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.593e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 5.84999e-06 [add_recomputation]: 5.056e-05 [cse_after_recomputation]: 2.238e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.182e-05 [auto_monad_reorder]: 1.871e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 6.00002e-06 [opt_after_jit_grad]: 0.00043262 [symbol_engine_optimizer]: 7.083e-05, [1] [Cycle 1]: 6.501e-05, [6] [build]: 3.06999e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.224e-05 [opt_reshape]: 5.29e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 4.69998e-07 [validate]: 3.726e-05 Sums bootstrap : 0.000310s : 3.80% type_inference : 0.004399s : 53.99% event_method : 0.000018s : 0.22% auto_monad : 0.000064s : 0.78% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000033s : 0.40% rewriter_before_opt_a : 0.000076s : 0.93% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.73% jit_opt_a.loop_unroll : 0.000034s : 0.41% jit_opt_a.a_1 : 0.000596s : 7.32% jit_opt_a.with_stream_mark : 0.000025s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000497s : 6.10% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000066s : 0.81% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000036s : 0.44% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000487s : 5.98% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000025s : 0.30% loop_unroll : 0.000443s : 5.43% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.30% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000051s : 0.62% cse_after_recomputation.cse : 0.000012s : 0.15% auto_monad_reorder : 0.000019s : 0.23% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000433s : 5.31% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000037s : 0.46% Time group info: ------[substitution.] 0.000191 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.97% : 0.000006s : 3: substitution.graph_param_transform 82.84% : 0.000159s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004337 2 81.18% : 0.003521s : 1: type_inference.infer 18.82% : 0.000816s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.65% : 0.000044s : 4: replace.inline 31.35% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.29% : 0.000156s : 4: match.inline 6.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.43% : 0.000002s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000001s : 10: predicate.reshape_eliminate 1.46% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.73% : 0.000010s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.53% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.54% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000562 13 54.81% : 0.000308s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.74% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.45% : 0.000222s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013333 72 0.40% : 0.000053s : 1: add_recomputation 0.50% : 0.000067s : 1: auto_monad 0.16% : 0.000021s : 1: auto_monad_reorder 2.47% : 0.000329s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.17% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.75% : 0.005033s : 1: jit_opt_a 1.12% : 0.000149s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.38% : 0.000450s : 1: loop_unroll 3.71% : 0.000495s : 1: mutable_eliminate 6.00% : 0.000799s : 26: opt.transform.jit_opt_a 0.39% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.30% : 0.000440s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000035s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 1.88% : 0.000251s : 1: renormalize.infer 1.79% : 0.000239s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000039s : 1: rewriter_after_opt_a 0.59% : 0.000078s : 1: rewriter_before_opt_a 0.55% : 0.000073s : 1: symbol_engine_optimizer 33.11% : 0.004415s : 1: type_inference TotalTime = 0.334485, [30] [bootstrap]: 0.00036596 [type_inference]: 0.310792 [event_method]: 2.263e-05 [auto_monad]: 7.592e-05 [graph_reusing]: 6.88e-06 [pre_auto_parallel]: 2.80997e-06 [py_interpret_to_execute]: 0.00050418 [rewriter_before_opt_a]: 9.773e-05 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.0199617, [2] [Cycle 1]: 0.0158841, [27] [switch_simplify]: 6.518e-05 [loop_unroll]: 3.199e-05 [a_1]: 0.0120412 [with_stream_mark]: 2.945e-05 [recompute_prepare]: 1.434e-05 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 4.28001e-06 [updatestate_loads_eliminate]: 3.45003e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 6.89999e-06 [accelerated_algorithm]: 8.43999e-06 [meta_shard_fg_expand]: 4.31002e-06 [get_grad_eliminate_]: 7.01999e-06 [merge_forward]: 4.73001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.746e-05 [j_node_and_user_rematch]: 1.209e-05 [meta_fg_expand]: 3.04001e-06 [replace_old_param]: 1.212e-05 [inline_without_move]: 6.31e-06 [renormalize]: 0.00325088 [add_forward_monad_depend]: 1.009e-05 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 2.13e-05 [cse]: 3.567e-05 [replace_applicator]: 2.254e-05 [Cycle 2]: 0.00039665, [27] [switch_simplify]: 7.26999e-06 [loop_unroll]: 6.35997e-06 [a_1]: 0.00013078 [with_stream_mark]: 1.682e-05 [recompute_prepare]: 5.88002e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 3.15998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.905e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.61e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 6.87002e-06 [cse]: 1.094e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.637e-05 [rewriter_after_opt_a]: 4.196e-05 [convert_after_rewriter]: 7.91001e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00080831 [jit_opt_b]: 5.713e-05, [1] [Cycle 1]: 4.912e-05, [2] [frontend_op_eliminate]: 1.959e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 3.403e-05 [loop_unroll]: 0.000463 [jit_opt_after_cconv]: 0.0001699, [1] [Cycle 1]: 0.000163, [11] [c_1]: 2.668e-05 [parameter_eliminate]: 4.35999e-06 [updatestate_depend_eliminate]: 8.12e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.804e-05 [call_graph_tuple_transform]: 2.393e-05 [tuple_list_get_item_eliminator]: 7.2e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.73e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 1.088e-05 [add_recomputation]: 5.591e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.953e-05, [1] [cse]: 1.306e-05 [auto_monad_reorder]: 1.567e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 7.98001e-06 [opt_after_jit_grad]: 0.00050094 [symbol_engine_optimizer]: 0.00014073, [1] [Cycle 1]: 0.00013393, [6] [build]: 4.61002e-06 [elim_shapecalc]: 9.42999e-06 [elim_not_effective]: 7.076e-05 [opt_reshape]: 8.02e-06 [fold_const_symbol]: 1.112e-05 [renormalize]: 1.02e-06 [validate]: 5.758e-05 Sums bootstrap : 0.000366s : 0.11% type_inference : 0.310792s : 94.15% event_method : 0.000023s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000504s : 0.15% rewriter_before_opt_a : 0.000098s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.02% jit_opt_a.loop_unroll : 0.000038s : 0.01% jit_opt_a.a_1 : 0.012172s : 3.69% jit_opt_a.with_stream_mark : 0.000046s : 0.01% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003251s : 0.98% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000047s : 0.01% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.00% rewriter_after_opt_a : 0.000042s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000808s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.000463s : 0.14% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000501s : 0.15% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000071s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.02% TotalTime = 0.0729438, [30] [bootstrap]: 0.00026601 [type_inference]: 0.0500136 [event_method]: 2.242e-05 [auto_monad]: 7.39e-05 [graph_reusing]: 6.54001e-06 [pre_auto_parallel]: 2.10002e-06 [py_interpret_to_execute]: 0.00016637 [rewriter_before_opt_a]: 8.464e-05 [expand_dump_flag]: 2.61999e-06 [jit_opt_a]: 0.0196916, [2] [Cycle 1]: 0.0151797, [27] [switch_simplify]: 6.958e-05 [loop_unroll]: 0.0123569 [a_1]: 0.00074604 [with_stream_mark]: 2.783e-05 [recompute_prepare]: 1.082e-05 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.67998e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 7.51999e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 7.21999e-06 [meta_shard_fg_expand]: 2.90002e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.764e-05 [j_node_and_user_rematch]: 9.46998e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.143e-05 [inline_without_move]: 5.80002e-06 [renormalize]: 0.00156316 [add_forward_monad_depend]: 7.73999e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.671e-05 [cse]: 3.665e-05 [replace_applicator]: 1.609e-05 [Cycle 2]: 0.00033368, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 5.60001e-06 [a_1]: 9.609e-05 [with_stream_mark]: 1.215e-05 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.07002e-06 [cell_reuse_recompute_pass]: 1.78997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 8.43001e-06 [meta_fg_expand]: 1.91998e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.78998e-06 [cse]: 1.244e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 1.549e-05 [rewriter_after_opt_a]: 4.089e-05 [convert_after_rewriter]: 7.63999e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00090931 [jit_opt_b]: 5.455e-05, [1] [Cycle 1]: 4.692e-05, [2] [frontend_op_eliminate]: 1.827e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.838e-05 [loop_unroll]: 0.00044697 [jit_opt_after_cconv]: 0.00015551, [1] [Cycle 1]: 0.0001495, [11] [c_1]: 2.261e-05 [parameter_eliminate]: 3.08998e-06 [updatestate_depend_eliminate]: 7.10998e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 3.86999e-06 [cse]: 2.749e-05 [call_graph_tuple_transform]: 2.012e-05 [tuple_list_get_item_eliminator]: 6.88e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.61998e-06 [remove_dup_value]: 1.752e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 7.21999e-06 [add_recomputation]: 5.403e-05 [cse_after_recomputation]: 2.449e-05, [1] [Cycle 1]: 1.902e-05, [1] [cse]: 1.309e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 7.16001e-06 [opt_after_jit_grad]: 0.00048457 [symbol_engine_optimizer]: 7.741e-05, [1] [Cycle 1]: 7.016e-05, [6] [build]: 4.74998e-06 [elim_shapecalc]: 8.67998e-06 [elim_not_effective]: 1.335e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 9.37001e-06 [renormalize]: 4.20026e-07 [validate]: 4.528e-05 Sums bootstrap : 0.000266s : 0.39% type_inference : 0.050014s : 73.44% event_method : 0.000022s : 0.03% auto_monad : 0.000074s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000166s : 0.24% rewriter_before_opt_a : 0.000085s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.11% jit_opt_a.loop_unroll : 0.012362s : 18.15% jit_opt_a.a_1 : 0.000842s : 1.24% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001563s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000049s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000041s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000909s : 1.34% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000447s : 0.66% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000485s : 0.71% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.07% Time group info: ------[substitution.] 0.000322 23 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.85% : 0.000006s : 3: substitution.graph_param_transform 88.14% : 0.000284s : 4: substitution.inline 1.10% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.53% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000005s : 2: substitution.replace_old_param 4.69% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049930 2 95.80% : 0.047832s : 1: type_inference.infer 4.20% : 0.002098s : 1: type_inference.specialize ------[replace.] 0.000102 6 70.68% : 0.000072s : 4: replace.inline 29.32% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 6 95.25% : 0.000282s : 4: match.inline 4.75% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 10: predicate.addn_check_dump 1.54% : 0.000002s : 10: predicate.addn_zero_filter 2.08% : 0.000003s : 10: predicate.arithmetic_simplify 1.50% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.24% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.54% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.02% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000008s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.08% : 0.000002s : 3: predicate.loop_unroll_after_grad 7.14% : 0.000010s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 0.89% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 1.75% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 1.94% : 0.000003s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.43% : 0.000002s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.70% : 0.000002s : 10: predicate.reshape_eliminate 1.09% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000002s : 10: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.40% : 0.000005s : 16: predicate.switch_defer_inline 1.87% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.53% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.32% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.23% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.13% : 0.000003s : 10: predicate.value_based_eliminate 0.40% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000996 13 34.51% : 0.000344s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.57% : 0.000065s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.91% : 0.000587s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.087966 72 0.06% : 0.000057s : 1: add_recomputation 0.09% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.32% : 0.000279s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000064s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 22.39% : 0.019696s : 1: jit_opt_a 0.18% : 0.000158s : 1: jit_opt_after_cconv 0.06% : 0.000057s : 1: jit_opt_b 0.52% : 0.000454s : 1: loop_unroll 1.04% : 0.000917s : 1: mutable_eliminate 15.24% : 0.013408s : 26: opt.transform.jit_opt_a 0.06% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000170s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.08% : 0.000948s : 1: renormalize.infer 0.69% : 0.000605s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.10% : 0.000089s : 1: rewriter_before_opt_a 0.09% : 0.000080s : 1: symbol_engine_optimizer 56.87% : 0.050027s : 1: type_inference TotalTime = 0.0145341, [30] [bootstrap]: 0.00031996 [type_inference]: 0.00527574 [event_method]: 1.99e-05 [auto_monad]: 6.59e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 4.87e-05 [rewriter_before_opt_a]: 7.311e-05 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00621131, [2] [Cycle 1]: 0.00199105, [27] [switch_simplify]: 6.109e-05 [loop_unroll]: 2.97e-05 [a_1]: 0.00068843 [with_stream_mark]: 1.913e-05 [recompute_prepare]: 7.91001e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 9.72001e-06 [inline_without_move]: 5.64e-06 [renormalize]: 0.00083282 [add_forward_monad_depend]: 5.85002e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 3.679e-05 [replace_applicator]: 1.333e-05 [Cycle 2]: 0.0003407, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.665e-05 [with_stream_mark]: 1.066e-05 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 7.85998e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 7.2e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 7.90023e-07 [auto_monad_eliminator]: 6.13998e-06 [cse]: 1.253e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.41e-05 [rewriter_after_opt_a]: 4.071e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00069015 [jit_opt_b]: 5.196e-05, [1] [Cycle 1]: 4.578e-05, [2] [frontend_op_eliminate]: 1.721e-05 [inline_after_opt_a]: 1.667e-05 [cconv]: 2.801e-05 [loop_unroll]: 0.00047259 [jit_opt_after_cconv]: 0.00017932, [1] [Cycle 1]: 0.00017255, [11] [c_1]: 2.219e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 6.95002e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 2.97e-05 [call_graph_tuple_transform]: 2.216e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.61003e-06 [remove_dup_value]: 1.86e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 7.21001e-06 [add_recomputation]: 5.515e-05 [cse_after_recomputation]: 2.558e-05, [1] [Cycle 1]: 1.987e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.81e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 7.63001e-06 [opt_after_jit_grad]: 0.00056547 [symbol_engine_optimizer]: 8.849e-05, [1] [Cycle 1]: 8.154e-05, [6] [build]: 4.79e-06 [elim_shapecalc]: 8.86002e-06 [elim_not_effective]: 1.702e-05 [opt_reshape]: 7.28e-06 [fold_const_symbol]: 9.94001e-06 [renormalize]: 1.00001e-06 [validate]: 4.864e-05 Sums bootstrap : 0.000320s : 3.19% type_inference : 0.005276s : 52.67% event_method : 0.000020s : 0.20% auto_monad : 0.000066s : 0.66% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000049s : 0.49% rewriter_before_opt_a : 0.000073s : 0.73% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000067s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.35% jit_opt_a.a_1 : 0.000785s : 7.84% jit_opt_a.with_stream_mark : 0.000030s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000833s : 8.32% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000049s : 0.49% jit_opt_a.replace_applicator : 0.000019s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.14% rewriter_after_opt_a : 0.000041s : 0.41% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000690s : 6.89% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.17% cconv : 0.000028s : 0.28% loop_unroll : 0.000473s : 4.72% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000030s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000019s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000055s : 0.55% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000018s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.08% opt_after_jit_grad : 0.000565s : 5.65% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000049s : 0.49% Time group info: ------[substitution.] 0.000347 23 0.80% : 0.000003s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.67% : 0.000006s : 3: substitution.graph_param_transform 90.13% : 0.000313s : 4: substitution.inline 0.80% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.40% : 0.000005s : 4: substitution.remove_not_recompute_node 1.14% : 0.000004s : 2: substitution.replace_old_param 3.67% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005202 2 80.64% : 0.004195s : 1: type_inference.infer 19.36% : 0.001007s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.08% : 0.000053s : 4: replace.inline 30.92% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 6 96.40% : 0.000310s : 4: match.inline 3.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.78% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.92% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000006s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 2.02% : 0.000002s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.16% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.47% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000757 13 52.52% : 0.000398s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.68% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.80% : 0.000324s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016435 72 0.35% : 0.000058s : 1: add_recomputation 0.42% : 0.000069s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 2.03% : 0.000334s : 1: bootstrap 0.19% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000028s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 37.82% : 0.006216s : 1: jit_opt_a 1.11% : 0.000182s : 1: jit_opt_after_cconv 0.33% : 0.000054s : 1: jit_opt_b 2.92% : 0.000480s : 1: loop_unroll 4.25% : 0.000699s : 1: mutable_eliminate 6.13% : 0.001008s : 26: opt.transform.jit_opt_a 0.32% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.18% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000040s : 4: opt.transform.symbol_engine_opt 3.50% : 0.000575s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000051s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000022s : 1: remove_dup_value 2.73% : 0.000448s : 1: renormalize.infer 2.29% : 0.000376s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000044s : 1: rewriter_after_opt_a 0.46% : 0.000076s : 1: rewriter_before_opt_a 0.56% : 0.000092s : 1: symbol_engine_optimizer 32.18% : 0.005289s : 1: type_inference Time group info: ------[substitution.] 0.000418 24 13.99% : 0.000058s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.65% : 0.000007s : 4: substitution.graph_param_transform 74.93% : 0.000313s : 4: substitution.inline 1.36% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.47% : 0.000006s : 4: substitution.remove_not_recompute_node 1.68% : 0.000007s : 2: substitution.replace_old_param 4.56% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.310673 2 99.08% : 0.307810s : 1: type_inference.infer 0.92% : 0.002863s : 1: type_inference.specialize ------[replace.] 0.000157 6 67.51% : 0.000106s : 4: replace.inline 32.49% : 0.000051s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000327 6 94.70% : 0.000310s : 4: match.inline 5.30% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.24% : 0.000004s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 0.87% : 0.000001s : 12: predicate.compare_switch_simplify 0.97% : 0.000002s : 12: predicate.depend_value_elim 0.96% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.94% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.88% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 0.91% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 7.00% : 0.000012s : 26: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.47% : 0.000002s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.11% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.95% : 0.000002s : 12: predicate.merge_addn 1.25% : 0.000002s : 12: predicate.minmaximum_grad 1.94% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 18: predicate.partial_eliminate 1.02% : 0.000002s : 12: predicate.print_const_string_wrapper 2.57% : 0.000004s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 5.23% : 0.000009s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.73% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.31% : 0.000005s : 18: predicate.switch_defer_inline 1.82% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.09% : 0.000010s : 58: predicate.switch_simplify 1.85% : 0.000003s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.23% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.99% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.77% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.18% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.54% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000003s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002484 22 62.17% : 0.001544s : 15: func_graph_cloner_run.FuncGraphClonerGraph 3.75% : 0.000093s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.08% : 0.000847s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.350286 72 0.02% : 0.000059s : 1: add_recomputation 0.02% : 0.000079s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.11% : 0.000386s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.70% : 0.019966s : 1: jit_opt_a 0.05% : 0.000173s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.13% : 0.000471s : 1: loop_unroll 0.23% : 0.000820s : 1: mutable_eliminate 3.55% : 0.012441s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000095s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000510s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000511s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.62% : 0.002189s : 1: renormalize.infer 0.30% : 0.001048s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000045s : 1: rewriter_after_opt_a 0.03% : 0.000103s : 1: rewriter_before_opt_a 0.04% : 0.000144s : 1: symbol_engine_optimizer 88.73% : 0.310818s : 1: type_inference TotalTime = 0.0345721, [30] [bootstrap]: 0.00033175 [type_inference]: 0.0240578 [event_method]: 2.295e-05 [auto_monad]: 7.19e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00014765 [rewriter_before_opt_a]: 8.662e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00706263, [2] [Cycle 1]: 0.00263186, [27] [switch_simplify]: 6.9e-05 [loop_unroll]: 3.162e-05 [a_1]: 0.00063762 [with_stream_mark]: 2.481e-05 [recompute_prepare]: 1.019e-05 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 2.53998e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.70002e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 1.087e-05 [meta_fg_expand]: 3.05002e-06 [replace_old_param]: 1.04e-05 [inline_without_move]: 6.19001e-06 [renormalize]: 0.00148324 [add_forward_monad_depend]: 7.36999e-06 [auto_monad_grad]: 2.98998e-06 [auto_monad_eliminator]: 1.86e-05 [cse]: 3.576e-05 [replace_applicator]: 2.096e-05 [Cycle 2]: 0.00036883, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 6.23e-06 [a_1]: 0.00010635 [with_stream_mark]: 1.373e-05 [recompute_prepare]: 6.56999e-06 [updatestate_depend_eliminate]: 4.19997e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 2.98e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 3.83001e-06 [replace_old_param]: 7.75e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.511e-05 [replace_applicator]: 6.08002e-06 [py_interpret_to_execute_after_opt_a]: 1.657e-05 [rewriter_after_opt_a]: 4.337e-05 [convert_after_rewriter]: 7.97998e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00086168 [jit_opt_b]: 5.825e-05, [1] [Cycle 1]: 4.971e-05, [2] [frontend_op_eliminate]: 2.036e-05 [inline_after_opt_a]: 1.717e-05 [cconv]: 2.99e-05 [loop_unroll]: 0.0005108 [jit_opt_after_cconv]: 0.00016826, [1] [Cycle 1]: 0.0001599, [11] [c_1]: 2.462e-05 [parameter_eliminate]: 3.97002e-06 [updatestate_depend_eliminate]: 8.11002e-06 [updatestate_assign_eliminate]: 4.32e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.783e-05 [call_graph_tuple_transform]: 2.191e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.727e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 7.46001e-06 [add_recomputation]: 5.664e-05 [cse_after_recomputation]: 2.906e-05, [1] [Cycle 1]: 2.143e-05, [1] [cse]: 1.43e-05 [auto_monad_reorder]: 1.898e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 7.13e-06 [opt_after_jit_grad]: 0.00056685 [symbol_engine_optimizer]: 8.456e-05, [1] [Cycle 1]: 7.573e-05, [6] [build]: 4.43001e-06 [elim_shapecalc]: 9.05001e-06 [elim_not_effective]: 1.657e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.22999e-06 [renormalize]: 5.50004e-07 [validate]: 4.615e-05 Sums bootstrap : 0.000332s : 1.11% type_inference : 0.024058s : 80.65% event_method : 0.000023s : 0.08% auto_monad : 0.000072s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000148s : 0.49% rewriter_before_opt_a : 0.000087s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.25% jit_opt_a.loop_unroll : 0.000038s : 0.13% jit_opt_a.a_1 : 0.000744s : 2.49% jit_opt_a.with_stream_mark : 0.000039s : 0.13% jit_opt_a.recompute_prepare : 0.000017s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000007s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001483s : 4.97% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.08% jit_opt_a.cse : 0.000051s : 0.17% jit_opt_a.replace_applicator : 0.000027s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000043s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000862s : 2.89% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000030s : 0.10% loop_unroll : 0.000511s : 1.71% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000057s : 0.19% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000567s : 1.90% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.15% Time group info: ------[substitution.] 0.000268 23 1.04% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 3: substitution.graph_param_transform 85.44% : 0.000229s : 4: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000006s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 5.27% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023952 2 91.51% : 0.021920s : 1: type_inference.infer 8.49% : 0.002032s : 1: type_inference.specialize ------[replace.] 0.000095 6 64.50% : 0.000061s : 4: replace.inline 35.50% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 6 94.73% : 0.000226s : 4: match.inline 5.27% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.13% : 0.000002s : 10: predicate.accumulaten_eliminater 1.34% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.70% : 0.000002s : 10: predicate.addn_zero_filter 2.75% : 0.000004s : 10: predicate.arithmetic_simplify 1.55% : 0.000002s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000002s : 10: predicate.compare_switch_simplify 1.48% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.04% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000008s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 6: predicate.less_batch_normalization 1.19% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.13% : 0.000003s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.94% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000002s : 10: predicate.print_const_string_wrapper 2.50% : 0.000003s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000003s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.06% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.86% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.48% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.34% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001165 13 45.38% : 0.000528s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.88% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.74% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037117 72 0.28% : 0.000103s : 1: add_recomputation 0.20% : 0.000075s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.94% : 0.000349s : 1: bootstrap 0.09% : 0.000033s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000032s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.04% : 0.007066s : 1: jit_opt_a 0.46% : 0.000172s : 1: jit_opt_after_cconv 0.16% : 0.000061s : 1: jit_opt_b 1.40% : 0.000519s : 1: loop_unroll 2.35% : 0.000871s : 1: mutable_eliminate 2.69% : 0.000998s : 26: opt.transform.jit_opt_a 0.15% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000575s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000151s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.32% : 0.000862s : 1: renormalize.infer 1.65% : 0.000611s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000046s : 1: rewriter_after_opt_a 0.24% : 0.000090s : 1: rewriter_before_opt_a 0.24% : 0.000087s : 1: symbol_engine_optimizer 64.87% : 0.024078s : 1: type_inference TotalTime = 0.19753, [30] [bootstrap]: 0.00029363 [type_inference]: 0.149291 [event_method]: 0.0004751 [auto_monad]: 0.00010892 [graph_reusing]: 7.78999e-06 [pre_auto_parallel]: 3.61001e-06 [py_interpret_to_execute]: 3.716e-05 [rewriter_before_opt_a]: 0.00012344 [expand_dump_flag]: 3.67002e-06 [jit_opt_a]: 0.0445715, [3] [Cycle 1]: 0.0192439, [27] [switch_simplify]: 8.05e-05 [loop_unroll]: 4.619e-05 [a_1]: 0.00100905 [with_stream_mark]: 3.66e-05 [recompute_prepare]: 2.087e-05 [updatestate_depend_eliminate]: 9.97001e-06 [updatestate_assign_eliminate]: 7.46001e-06 [updatestate_loads_eliminate]: 6.95998e-06 [parameter_eliminate]: 2.74999e-06 [specialize_transform]: 1.516e-05 [updatestate_useless_node_eliminater]: 1.354e-05 [accelerated_algorithm]: 1.434e-05 [meta_shard_fg_expand]: 4.66002e-06 [get_grad_eliminate_]: 1.423e-05 [merge_forward]: 9.46e-06 [cell_reuse_recompute_pass]: 8.89995e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.923e-05 [j_node_and_user_rematch]: 2.533e-05 [meta_fg_expand]: 0.00194625 [replace_old_param]: 8.265e-05 [inline_without_move]: 6.513e-05 [renormalize]: 0.0150058 [add_forward_monad_depend]: 1.756e-05 [auto_monad_grad]: 7.06999e-06 [auto_monad_eliminator]: 7.282e-05 [cse]: 0.0003011 [replace_applicator]: 0.00010636 [Cycle 2]: 0.0212633, [27] [switch_simplify]: 4.593e-05 [loop_unroll]: 4.478e-05 [a_1]: 0.00136439 [with_stream_mark]: 2.77e-05 [recompute_prepare]: 1.413e-05 [updatestate_depend_eliminate]: 6.89999e-06 [updatestate_assign_eliminate]: 4.29002e-06 [updatestate_loads_eliminate]: 4.48001e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 8.94998e-06 [updatestate_useless_node_eliminater]: 9.18002e-06 [accelerated_algorithm]: 8.95001e-06 [meta_shard_fg_expand]: 3.18e-06 [get_grad_eliminate_]: 8.2e-06 [merge_forward]: 5.05999e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.313e-05 [j_node_and_user_rematch]: 1.604e-05 [meta_fg_expand]: 0.00013499 [replace_old_param]: 1.419e-05 [inline_without_move]: 9.60001e-06 [renormalize]: 0.0191688 [add_forward_monad_depend]: 1.342e-05 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 2.425e-05 [cse]: 3.743e-05 [replace_applicator]: 2.643e-05 [Cycle 3]: 0.00036649, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.92999e-06 [a_1]: 9e-05 [with_stream_mark]: 1.689e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 3.08e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 3.00998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.979e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 5.12e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.54998e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.249e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.642e-05 [rewriter_after_opt_a]: 4.013e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00084532 [jit_opt_b]: 5.403e-05, [1] [Cycle 1]: 4.554e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.71e-05 [cconv]: 2.673e-05 [loop_unroll]: 0.00046543 [jit_opt_after_cconv]: 0.00016228, [1] [Cycle 1]: 0.00015395, [11] [c_1]: 2.019e-05 [parameter_eliminate]: 3.29001e-06 [updatestate_depend_eliminate]: 8.23999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.533e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 1.04e-06 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.756e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 7.52998e-06 [add_recomputation]: 4.927e-05 [cse_after_recomputation]: 2.622e-05, [1] [Cycle 1]: 2.061e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.651e-05 [get_jit_bprop_graph]: 2.35002e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.00051111 [symbol_engine_optimizer]: 8.326e-05, [1] [Cycle 1]: 7.638e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.524e-05 [opt_reshape]: 6.01998e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 4.00003e-07 [validate]: 4.684e-05 Sums bootstrap : 0.000294s : 0.15% type_inference : 0.149291s : 77.43% event_method : 0.000475s : 0.25% auto_monad : 0.000109s : 0.06% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000037s : 0.02% rewriter_before_opt_a : 0.000123s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000133s : 0.07% jit_opt_a.loop_unroll : 0.000097s : 0.05% jit_opt_a.a_1 : 0.002463s : 1.28% jit_opt_a.with_stream_mark : 0.000081s : 0.04% jit_opt_a.recompute_prepare : 0.000040s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000021s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000028s : 0.01% jit_opt_a.accelerated_algorithm : 0.000029s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.01% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000072s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000051s : 0.03% jit_opt_a.meta_fg_expand : 0.002084s : 1.08% jit_opt_a.replace_old_param : 0.000102s : 0.05% jit_opt_a.inline_without_move : 0.000080s : 0.04% jit_opt_a.renormalize : 0.034175s : 17.72% jit_opt_a.add_forward_monad_depend : 0.000033s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000103s : 0.05% jit_opt_a.cse : 0.000351s : 0.18% jit_opt_a.replace_applicator : 0.000138s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000845s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000465s : 0.24% jit_opt_after_cconv.c_1 : 0.000020s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000511s : 0.27% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.02% Time group info: ------[substitution.] 0.000683 112 0.30% : 0.000002s : 2: substitution.elim_not_effective 0.17% : 0.000001s : 2: substitution.fold_const_symbol 0.88% : 0.000006s : 2: substitution.graph_param_transform 67.15% : 0.000459s : 13: substitution.inline 2.71% : 0.000019s : 2: substitution.inline_without_move 1.67% : 0.000011s : 14: substitution.j_node_and_user_rematch 1.73% : 0.000012s : 7: substitution.minmaximum_grad 1.21% : 0.000008s : 5: substitution.partial_eliminate 1.94% : 0.000013s : 14: substitution.remove_not_recompute_node 5.48% : 0.000037s : 10: substitution.replace_applicator 1.02% : 0.000007s : 10: substitution.replace_old_param 1.20% : 0.000008s : 1: substitution.reshape_eliminate 0.36% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.06% : 0.000007s : 1: substitution.tile_eliminate 3.85% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.33% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.96% : 0.000048s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.149199 2 97.90% : 0.146062s : 1: type_inference.infer 2.10% : 0.003137s : 1: type_inference.specialize ------[replace.] 0.000205 20 65.41% : 0.000134s : 13: replace.inline 34.59% : 0.000071s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000473 20 94.76% : 0.000449s : 13: match.inline 5.24% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000412 2740 1.50% : 0.000006s : 47: predicate.accumulaten_eliminater 0.36% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.39% : 0.000006s : 47: predicate.addn_check_dump 1.48% : 0.000006s : 47: predicate.addn_zero_filter 2.09% : 0.000009s : 47: predicate.arithmetic_simplify 1.63% : 0.000007s : 47: predicate.cast_eliminate 0.19% : 0.000001s : 2: predicate.check_bprop_eliminate 1.39% : 0.000006s : 47: predicate.compare_switch_simplify 1.45% : 0.000006s : 47: predicate.depend_value_elim 1.43% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.45% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.38% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.44% : 0.000002s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.15% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.41% : 0.000006s : 47: predicate.environ_get_depend_swap 1.51% : 0.000006s : 47: predicate.environ_get_eliminate 1.39% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.85% : 0.000003s : 20: predicate.get_grad_eliminate 0.11% : 0.000000s : 2: predicate.graph_param_transform 4.44% : 0.000018s : 71: predicate.inline 2.13% : 0.000009s : 48: predicate.inline_without_move 0.36% : 0.000002s : 20: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 20: predicate.less_batch_normalization 1.89% : 0.000008s : 54: predicate.list_to_tuple_eliminator_ 1.80% : 0.000007s : 56: predicate.load_eliminater 0.38% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.47% : 0.000014s : 95: predicate.loop_unroll_before_grad 1.89% : 0.000008s : 49: predicate.make_slice_get_slice_eliminator 1.51% : 0.000006s : 47: predicate.merge_addn 1.49% : 0.000006s : 47: predicate.minmaximum_grad 0.48% : 0.000002s : 2: predicate.mutable_eliminate 0.16% : 0.000001s : 2: predicate.opt_reshape 2.40% : 0.000010s : 56: predicate.partial_eliminate 1.50% : 0.000006s : 47: predicate.print_const_string_wrapper 2.08% : 0.000009s : 47: predicate.reduce_eliminate 1.84% : 0.000008s : 54: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000002s : 20: predicate.remove_not_recompute_node 2.85% : 0.000012s : 103: predicate.replace_applicator 1.22% : 0.000005s : 48: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.53% : 0.000006s : 47: predicate.reshape_eliminate 1.53% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 2: predicate.row_tensor_eliminate 1.53% : 0.000006s : 47: predicate.same_eliminate 0.47% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.34% : 0.000001s : 4: predicate.special_op_eliminate 0.80% : 0.000003s : 20: predicate.specialize_transform 1.71% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.67% : 0.000007s : 47: predicate.stack_unstack_eliminate 0.14% : 0.000001s : 2: predicate.switch_call_monad_eliminater 2.65% : 0.000011s : 67: predicate.switch_defer_inline 2.41% : 0.000010s : 67: predicate.switch_layer_defer_inline 6.25% : 0.000026s : 164: predicate.switch_simplify 1.65% : 0.000007s : 47: predicate.tile_eliminate 1.48% : 0.000006s : 47: predicate.transpose_eliminate 2.06% : 0.000008s : 47: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000014s : 58: predicate.tuple_list_get_item_eliminator 1.85% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 54: predicate.tuple_to_list_eliminator_ 1.69% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.66% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.99% : 0.000008s : 47: predicate.value_based_eliminate 0.18% : 0.000001s : 2: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.009771 45 87.42% : 0.008541s : 28: func_graph_cloner_run.FuncGraphClonerGraph 12.58% : 0.001229s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.234956 87 0.02% : 0.000052s : 1: add_recomputation 0.05% : 0.000115s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.13% : 0.000314s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.21% : 0.000484s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000011s : 1: graph_reusing 18.97% : 0.044575s : 1: jit_opt_a 0.07% : 0.000165s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.20% : 0.000475s : 1: loop_unroll 0.36% : 0.000854s : 1: mutable_eliminate 1.37% : 0.003231s : 39: opt.transform.jit_opt_a 0.02% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000520s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.02% : 0.000040s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 13.28% : 0.031195s : 2: renormalize.infer 1.25% : 0.002947s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000127s : 1: rewriter_before_opt_a 0.05% : 0.000107s : 1: symbol_engine_optimizer 63.55% : 0.149310s : 1: type_inference TotalTime = 0.0846126, [30] [bootstrap]: 0.00048778 [type_inference]: 0.0699194 [event_method]: 2.394e-05 [auto_monad]: 7.547e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.0004747 [rewriter_before_opt_a]: 0.00010882 [expand_dump_flag]: 3.74002e-06 [jit_opt_a]: 0.0108685, [2] [Cycle 1]: 0.00605123, [27] [switch_simplify]: 8.076e-05 [loop_unroll]: 3.651e-05 [a_1]: 0.00086383 [with_stream_mark]: 2.2e-05 [recompute_prepare]: 1.184e-05 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 4.48999e-06 [updatestate_loads_eliminate]: 3.44001e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 9.20001e-06 [updatestate_useless_node_eliminater]: 7.97998e-06 [accelerated_algorithm]: 9.09e-06 [meta_shard_fg_expand]: 4.79998e-06 [get_grad_eliminate_]: 8.22e-06 [merge_forward]: 4.68001e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.883e-05 [j_node_and_user_rematch]: 1.262e-05 [meta_fg_expand]: 4.16001e-06 [replace_old_param]: 1.198e-05 [inline_without_move]: 6.78e-06 [renormalize]: 0.00459858 [add_forward_monad_depend]: 8.71002e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.864e-05 [cse]: 3.899e-05 [replace_applicator]: 2.728e-05 [Cycle 2]: 0.00044434, [27] [switch_simplify]: 9.00001e-06 [loop_unroll]: 8.10999e-06 [a_1]: 0.00015236 [with_stream_mark]: 1.733e-05 [recompute_prepare]: 6.94999e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.50998e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.72998e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 7.38e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.38998e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 3.09001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.731e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 3.43999e-06 [replace_old_param]: 9.74999e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 1.42999e-06 [auto_monad_eliminator]: 8.34002e-06 [cse]: 1.785e-05 [replace_applicator]: 6.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.753e-05 [rewriter_after_opt_a]: 4.263e-05 [convert_after_rewriter]: 7.73001e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00080406 [jit_opt_b]: 6.302e-05, [1] [Cycle 1]: 5.554e-05, [2] [frontend_op_eliminate]: 2.171e-05 [inline_after_opt_a]: 2.086e-05 [cconv]: 2.518e-05 [loop_unroll]: 0.0004847 [jit_opt_after_cconv]: 0.0001847, [1] [Cycle 1]: 0.00017856, [11] [c_1]: 3.128e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 6.44999e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 3.668e-05 [call_graph_tuple_transform]: 2.453e-05 [tuple_list_get_item_eliminator]: 7.23999e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 7.26001e-06 [remove_dup_value]: 2.209e-05 [partial_unused_args_eliminate]: 2.41998e-06 [environ_conv]: 8.55001e-06 [add_recomputation]: 5.49e-05 [cse_after_recomputation]: 2.726e-05, [1] [Cycle 1]: 2.107e-05, [1] [cse]: 1.484e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 7.36999e-06 [opt_after_jit_grad]: 0.000531 [symbol_engine_optimizer]: 8.353e-05, [1] [Cycle 1]: 7.689e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 1.059e-05 [elim_not_effective]: 1.528e-05 [opt_reshape]: 7.23999e-06 [fold_const_symbol]: 1.182e-05 [renormalize]: 7.30011e-07 [validate]: 5.047e-05 Sums bootstrap : 0.000488s : 0.61% type_inference : 0.069919s : 87.87% event_method : 0.000024s : 0.03% auto_monad : 0.000075s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000475s : 0.60% rewriter_before_opt_a : 0.000109s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.11% jit_opt_a.loop_unroll : 0.000045s : 0.06% jit_opt_a.a_1 : 0.001016s : 1.28% jit_opt_a.with_stream_mark : 0.000039s : 0.05% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000017s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.02% jit_opt_a.accelerated_algorithm : 0.000016s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.03% jit_opt_a.meta_fg_expand : 0.000008s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.004599s : 5.78% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000057s : 0.07% jit_opt_a.replace_applicator : 0.000034s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000043s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000804s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000025s : 0.03% loop_unroll : 0.000485s : 0.61% jit_opt_after_cconv.c_1 : 0.000031s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000022s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000055s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000531s : 0.67% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.06% Time group info: ------[substitution.] 0.000346 25 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000003s : 2: substitution.fold_const_symbol 1.74% : 0.000006s : 4: substitution.graph_param_transform 88.24% : 0.000305s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.39% : 0.000005s : 2: substitution.replace_old_param 4.36% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069817 2 94.84% : 0.066217s : 1: type_inference.infer 5.16% : 0.003600s : 1: type_inference.specialize ------[replace.] 0.000141 7 65.22% : 0.000092s : 5: replace.inline 34.78% : 0.000049s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000315 7 95.61% : 0.000302s : 5: match.inline 4.39% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.75% : 0.000003s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.02% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.47% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 4.34% : 0.000007s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000003s : 8: predicate.less_batch_normalization 1.61% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000007s : 41: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 0.99% : 0.000002s : 13: predicate.minmaximum_grad 1.23% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 2.01% : 0.000003s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.87% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.79% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.43% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.43% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000002s : 8: predicate.specialize_transform 1.57% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.71% : 0.000005s : 20: predicate.switch_defer_inline 1.90% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000012s : 65: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.63% : 0.000003s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.84% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.63% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.13% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.79% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003574 29 61.22% : 0.002188s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.69% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.09% : 0.001290s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.090607 72 0.06% : 0.000058s : 1: add_recomputation 0.09% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.56% : 0.000509s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 12.00% : 0.010873s : 1: jit_opt_a 0.21% : 0.000187s : 1: jit_opt_after_cconv 0.07% : 0.000065s : 1: jit_opt_b 0.54% : 0.000492s : 1: loop_unroll 0.90% : 0.000812s : 1: mutable_eliminate 1.46% : 0.001324s : 26: opt.transform.jit_opt_a 0.07% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000538s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.53% : 0.000480s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000025s : 1: remove_dup_value 3.47% : 0.003143s : 1: renormalize.infer 1.59% : 0.001441s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000046s : 1: rewriter_after_opt_a 0.13% : 0.000113s : 1: rewriter_before_opt_a 0.09% : 0.000086s : 1: symbol_engine_optimizer 77.19% : 0.069939s : 1: type_inference TotalTime = 0.0372361, [30] [bootstrap]: 0.00037697 [type_inference]: 0.0265531 [event_method]: 2.194e-05 [auto_monad]: 7.439e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00020646 [rewriter_before_opt_a]: 8.918e-05 [expand_dump_flag]: 3.95998e-06 [jit_opt_a]: 0.00744764, [2] [Cycle 1]: 0.00253081, [27] [switch_simplify]: 5.951e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.00061399 [with_stream_mark]: 1.37e-05 [recompute_prepare]: 9.52999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 6.28002e-06 [renormalize]: 0.00149034 [add_forward_monad_depend]: 5.82999e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.291e-05 [cse]: 2.169e-05 [replace_applicator]: 1.432e-05 [Cycle 2]: 0.00035345, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.47999e-06 [a_1]: 0.0001072 [with_stream_mark]: 1.247e-05 [recompute_prepare]: 5.42999e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.26997e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.14998e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 8.07e-06 [inline_without_move]: 5.96998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 1.01997e-06 [auto_monad_eliminator]: 6.02999e-06 [cse]: 1.41e-05 [replace_applicator]: 5.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.247e-05 [rewriter_after_opt_a]: 3.816e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00068619 [jit_opt_b]: 5.738e-05, [1] [Cycle 1]: 4.902e-05, [2] [frontend_op_eliminate]: 2.025e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 5.864e-05 [loop_unroll]: 0.00048992 [jit_opt_after_cconv]: 0.00016492, [1] [Cycle 1]: 0.00015827, [11] [c_1]: 2.519e-05 [parameter_eliminate]: 3.05998e-06 [updatestate_depend_eliminate]: 6.48003e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [cse]: 2.666e-05 [call_graph_tuple_transform]: 2.273e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.262e-05 [partial_unused_args_eliminate]: 3.09999e-06 [environ_conv]: 5.41002e-06 [add_recomputation]: 4.586e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.754e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.451e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 5.96998e-06 [opt_after_jit_grad]: 0.00052445 [symbol_engine_optimizer]: 8.022e-05, [1] [Cycle 1]: 7.365e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 8.28001e-06 [elim_not_effective]: 1.271e-05 [opt_reshape]: 8.48999e-06 [fold_const_symbol]: 1.061e-05 [renormalize]: 3.70026e-07 [validate]: 3.856e-05 Sums bootstrap : 0.000377s : 1.17% type_inference : 0.026553s : 82.76% event_method : 0.000022s : 0.07% auto_monad : 0.000074s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000206s : 0.64% rewriter_before_opt_a : 0.000089s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.21% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000721s : 2.25% jit_opt_a.with_stream_mark : 0.000026s : 0.08% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001490s : 4.65% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.06% jit_opt_a.cse : 0.000036s : 0.11% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000038s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000686s : 2.14% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000059s : 0.18% loop_unroll : 0.000490s : 1.53% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000013s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000046s : 0.14% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000015s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000524s : 1.63% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.12% Time group info: ------[substitution.] 0.000236 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 1.17% : 0.000003s : 2: substitution.fold_const_symbol 3.17% : 0.000007s : 3: substitution.graph_param_transform 84.64% : 0.000199s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000004s : 2: substitution.replace_old_param 5.36% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026461 2 91.15% : 0.024118s : 1: type_inference.infer 8.85% : 0.002343s : 1: type_inference.specialize ------[replace.] 0.000089 6 66.65% : 0.000059s : 4: replace.inline 33.35% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 6 94.45% : 0.000197s : 4: match.inline 5.55% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.55% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 2.20% : 0.000003s : 10: predicate.arithmetic_simplify 1.68% : 0.000002s : 10: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.58% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.98% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000002s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 4.22% : 0.000006s : 22: predicate.inline 1.10% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 2.40% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.48% : 0.000002s : 15: predicate.load_eliminater 1.06% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.56% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 1.90% : 0.000003s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 2.06% : 0.000003s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.50% : 0.000002s : 10: predicate.reshape_eliminate 1.50% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 0.98% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.94% : 0.000004s : 16: predicate.switch_defer_inline 1.95% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.96% : 0.000009s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.26% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.38% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001080 13 38.20% : 0.000412s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.55% : 0.000632s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039751 72 0.12% : 0.000049s : 1: add_recomputation 0.20% : 0.000079s : 1: auto_monad 0.04% : 0.000017s : 1: auto_monad_reorder 0.98% : 0.000388s : 1: bootstrap 0.16% : 0.000062s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.75% : 0.007452s : 1: jit_opt_a 0.42% : 0.000168s : 1: jit_opt_after_cconv 0.15% : 0.000060s : 1: jit_opt_b 1.25% : 0.000498s : 1: loop_unroll 1.75% : 0.000695s : 1: mutable_eliminate 2.39% : 0.000951s : 26: opt.transform.jit_opt_a 0.14% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000532s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.53% : 0.000210s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000015s : 1: remove_dup_value 2.18% : 0.000868s : 1: renormalize.infer 1.54% : 0.000613s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000041s : 1: rewriter_after_opt_a 0.23% : 0.000093s : 1: rewriter_before_opt_a 0.21% : 0.000083s : 1: symbol_engine_optimizer 66.84% : 0.026569s : 1: type_inference TotalTime = 0.0503846, [30] [bootstrap]: 0.00041472 [type_inference]: 0.0410054 [event_method]: 2.614e-05 [auto_monad]: 7.882e-05 [graph_reusing]: 7.05e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00011455 [rewriter_before_opt_a]: 8.808e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00622491, [2] [Cycle 1]: 0.00205596, [27] [switch_simplify]: 6.452e-05 [loop_unroll]: 2.86e-05 [a_1]: 0.00058851 [with_stream_mark]: 2.621e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00097197 [add_forward_monad_depend]: 7.66001e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.868e-05 [cse]: 3.666e-05 [replace_applicator]: 1.74e-05 [Cycle 2]: 0.00032911, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 4.96002e-06 [a_1]: 8.893e-05 [with_stream_mark]: 1.254e-05 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.90002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.36998e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.61001e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.72001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.277e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.547e-05 [rewriter_after_opt_a]: 4e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.0007243 [jit_opt_b]: 4.932e-05, [1] [Cycle 1]: 4.167e-05, [2] [frontend_op_eliminate]: 1.505e-05 [inline_after_opt_a]: 1.586e-05 [cconv]: 3.542e-05 [loop_unroll]: 0.00043591 [jit_opt_after_cconv]: 0.00015961, [1] [Cycle 1]: 0.00015299, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 4.46002e-06 [updatestate_depend_eliminate]: 8.93002e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 3.006e-05 [call_graph_tuple_transform]: 2.104e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.676e-05 [partial_unused_args_eliminate]: 1.309e-05 [environ_conv]: 6.17001e-06 [add_recomputation]: 5.955e-05 [cse_after_recomputation]: 2.443e-05, [1] [Cycle 1]: 1.799e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 2.69999e-06 [rewriter_after_jit_bprop_graph]: 6.16e-06 [opt_after_jit_grad]: 0.00047205 [symbol_engine_optimizer]: 7.226e-05, [1] [Cycle 1]: 6.633e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 1.346e-05 [opt_reshape]: 6.22001e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 2.79979e-07 [validate]: 4.763e-05 Sums bootstrap : 0.000415s : 0.90% type_inference : 0.041005s : 89.31% event_method : 0.000026s : 0.06% auto_monad : 0.000079s : 0.17% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000115s : 0.25% rewriter_before_opt_a : 0.000088s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.15% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000677s : 1.48% jit_opt_a.with_stream_mark : 0.000039s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000972s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.06% jit_opt_a.cse : 0.000049s : 0.11% jit_opt_a.replace_applicator : 0.000023s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000040s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000724s : 1.58% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000035s : 0.08% loop_unroll : 0.000436s : 0.95% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000013s : 0.03% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000060s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000472s : 1.03% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.10% Time group info: ------[substitution.] 0.000256 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 85.40% : 0.000219s : 4: substitution.inline 1.81% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000004s : 4: substitution.remove_not_recompute_node 2.23% : 0.000006s : 2: substitution.replace_old_param 5.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040909 2 96.11% : 0.039316s : 1: type_inference.infer 3.89% : 0.001593s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.99% : 0.000053s : 4: replace.inline 30.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.64% : 0.000216s : 4: match.inline 5.36% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 7.38% : 0.000009s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 2.04% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.34% : 0.000002s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.71% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.36% : 0.000002s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.92% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.05% : 0.000010s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.11% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000868 13 48.99% : 0.000425s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.58% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.44% : 0.000386s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052309 72 0.12% : 0.000063s : 1: add_recomputation 0.16% : 0.000083s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.84% : 0.000437s : 1: bootstrap 0.07% : 0.000038s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000033s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 11.91% : 0.006228s : 1: jit_opt_a 0.31% : 0.000162s : 1: jit_opt_after_cconv 0.10% : 0.000052s : 1: jit_opt_b 0.85% : 0.000444s : 1: loop_unroll 1.40% : 0.000734s : 1: mutable_eliminate 1.74% : 0.000908s : 26: opt.transform.jit_opt_a 0.10% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000015s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000118s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.10% : 0.000574s : 1: renormalize.infer 0.74% : 0.000389s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.18% : 0.000092s : 1: rewriter_before_opt_a 0.14% : 0.000075s : 1: symbol_engine_optimizer 78.45% : 0.041035s : 1: type_inference TotalTime = 0.0389909, [30] [bootstrap]: 0.00035627 [type_inference]: 0.025609 [event_method]: 2.2e-05 [auto_monad]: 7.518e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00015947 [rewriter_before_opt_a]: 9.036e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00960702, [2] [Cycle 1]: 0.00286144, [27] [switch_simplify]: 7.305e-05 [loop_unroll]: 3.152e-05 [a_1]: 0.00067899 [with_stream_mark]: 2.334e-05 [recompute_prepare]: 8.76002e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 3.09999e-06 [get_grad_eliminate_]: 7.15e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 5.71e-06 [renormalize]: 0.00164566 [add_forward_monad_depend]: 8.40999e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.846e-05 [cse]: 3.686e-05 [replace_applicator]: 2.269e-05 [Cycle 2]: 0.00040831, [27] [switch_simplify]: 7.78001e-06 [loop_unroll]: 5.69999e-06 [a_1]: 0.0001314 [with_stream_mark]: 1.57e-05 [recompute_prepare]: 6.10002e-06 [updatestate_depend_eliminate]: 4.78001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 7.12002e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 5.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.882e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 9.19e-06 [cse]: 1.714e-05 [replace_applicator]: 5.22999e-06 [py_interpret_to_execute_after_opt_a]: 1.75e-05 [rewriter_after_opt_a]: 4.387e-05 [convert_after_rewriter]: 7.55e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00092077 [jit_opt_b]: 6.141e-05, [1] [Cycle 1]: 5.309e-05, [2] [frontend_op_eliminate]: 2.174e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 3.359e-05 [loop_unroll]: 0.00059216 [jit_opt_after_cconv]: 0.00018312, [1] [Cycle 1]: 0.00017588, [11] [c_1]: 2.567e-05 [parameter_eliminate]: 3.06999e-06 [updatestate_depend_eliminate]: 7.68999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.76999e-06 [cse]: 3.782e-05 [call_graph_tuple_transform]: 2.42e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 2.02001e-06 [renormalize]: 1.07e-06 [switch_simplify]: 6.71e-06 [remove_dup_value]: 3.733e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 8.13999e-06 [add_recomputation]: 6.341e-05 [cse_after_recomputation]: 2.862e-05, [1] [Cycle 1]: 2.06e-05, [1] [cse]: 1.344e-05 [auto_monad_reorder]: 2.003e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 8.28001e-06 [opt_after_jit_grad]: 0.00068137 [symbol_engine_optimizer]: 9.226e-05, [1] [Cycle 1]: 8.286e-05, [6] [build]: 4.69998e-06 [elim_shapecalc]: 9.22001e-06 [elim_not_effective]: 1.927e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 1.117e-05 [renormalize]: 1.00999e-06 [validate]: 4.871e-05 Sums bootstrap : 0.000356s : 1.11% type_inference : 0.025609s : 80.07% event_method : 0.000022s : 0.07% auto_monad : 0.000075s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000159s : 0.50% rewriter_before_opt_a : 0.000090s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.25% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000810s : 2.53% jit_opt_a.with_stream_mark : 0.000039s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001646s : 5.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.09% jit_opt_a.cse : 0.000054s : 0.17% jit_opt_a.replace_applicator : 0.000028s : 0.09% py_interpret_to_execute_after_opt_a : 0.000018s : 0.05% rewriter_after_opt_a : 0.000044s : 0.14% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000921s : 2.88% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.07% jit_opt_b.inline_after_opt_a : 0.000019s : 0.06% cconv : 0.000034s : 0.11% loop_unroll : 0.000592s : 1.85% jit_opt_after_cconv.c_1 : 0.000026s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000037s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000063s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000681s : 2.13% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.15% Time group info: ------[substitution.] 0.000295 23 0.87% : 0.000003s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000007s : 3: substitution.graph_param_transform 85.66% : 0.000252s : 4: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000006s : 2: substitution.replace_old_param 5.48% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025515 2 91.30% : 0.023294s : 1: type_inference.infer 8.70% : 0.002221s : 1: type_inference.specialize ------[replace.] 0.000099 6 69.36% : 0.000069s : 4: replace.inline 30.64% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 6 94.33% : 0.000250s : 4: match.inline 5.67% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 691 1.07% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.87% : 0.000001s : 10: predicate.addn_check_dump 1.70% : 0.000003s : 10: predicate.addn_zero_filter 2.29% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.77% : 0.000001s : 3: predicate.check_bprop_eliminate 0.87% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.89% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.83% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 10: predicate.environ_get_depend_swap 1.07% : 0.000002s : 10: predicate.environ_get_eliminate 1.31% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.42% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.52% : 0.000007s : 22: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.37% : 0.000004s : 15: predicate.load_eliminater 1.64% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.58% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000002s : 10: predicate.minmaximum_grad 2.60% : 0.000004s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 1.88% : 0.000003s : 15: predicate.partial_eliminate 1.46% : 0.000002s : 10: predicate.print_const_string_wrapper 2.04% : 0.000003s : 10: predicate.reduce_eliminate 1.66% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.09% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000002s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 10: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 6: predicate.special_op_eliminate 0.75% : 0.000001s : 6: predicate.specialize_transform 1.73% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.32% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 16: predicate.switch_defer_inline 1.73% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.07% : 0.000010s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.83% : 0.000003s : 10: predicate.transpose_eliminate 1.18% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.08% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 2.68% : 0.000004s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001157 13 41.52% : 0.000480s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.97% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.51% : 0.000631s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041781 72 0.16% : 0.000066s : 1: add_recomputation 0.19% : 0.000079s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 0.90% : 0.000375s : 1: bootstrap 0.09% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 23.00% : 0.009611s : 1: jit_opt_a 0.45% : 0.000186s : 1: jit_opt_after_cconv 0.15% : 0.000064s : 1: jit_opt_b 1.44% : 0.000602s : 1: loop_unroll 2.23% : 0.000932s : 1: mutable_eliminate 2.57% : 0.001072s : 26: opt.transform.jit_opt_a 0.14% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000034s : 4: opt.transform.jit_opt_b 0.04% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000021s : 1: opt.transform.mutable_eliminate 0.07% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000691s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000163s : 1: py_interpret_to_execute 0.05% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000040s : 1: remove_dup_value 2.25% : 0.000940s : 1: renormalize.infer 1.66% : 0.000692s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000048s : 1: rewriter_after_opt_a 0.22% : 0.000094s : 1: rewriter_before_opt_a 0.23% : 0.000095s : 1: symbol_engine_optimizer 61.34% : 0.025628s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.709.707 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.710.570 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.168275, [30] [bootstrap]: 0.00044673 [type_inference]: 0.150184 [event_method]: 2.836e-05 [auto_monad]: 8.842e-05 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00131649 [rewriter_before_opt_a]: 0.00013693 [expand_dump_flag]: 4.96002e-06 [jit_opt_a]: 0.0123992, [2] [Cycle 1]: 0.00702918, [27] [switch_simplify]: 8.754e-05 [loop_unroll]: 0.00013937 [a_1]: 0.00088575 [with_stream_mark]: 2.457e-05 [recompute_prepare]: 1.09e-05 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 9.41e-06 [updatestate_useless_node_eliminater]: 7.11999e-06 [accelerated_algorithm]: 8.03001e-06 [meta_shard_fg_expand]: 3.38e-06 [get_grad_eliminate_]: 8.79e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.913e-05 [j_node_and_user_rematch]: 1.099e-05 [meta_fg_expand]: 3.11001e-06 [replace_old_param]: 1.167e-05 [inline_without_move]: 7.15998e-06 [renormalize]: 0.00544004 [add_forward_monad_depend]: 1.65e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 2.371e-05 [cse]: 4.097e-05 [replace_applicator]: 1.965e-05 [Cycle 2]: 0.00048832, [27] [switch_simplify]: 8.97e-06 [loop_unroll]: 8.26002e-06 [a_1]: 0.00017768 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 7.51001e-06 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.43999e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 7.65e-06 [accelerated_algorithm]: 8.35999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 7.68999e-06 [merge_forward]: 4.87998e-06 [cell_reuse_recompute_pass]: 3.99002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 1.148e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.101e-05 [inline_without_move]: 5.70001e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.96e-06 [auto_monad_grad]: 1.54e-06 [auto_monad_eliminator]: 7.27002e-06 [cse]: 1.533e-05 [replace_applicator]: 6.28998e-06 [py_interpret_to_execute_after_opt_a]: 2.155e-05 [rewriter_after_opt_a]: 5.381e-05 [convert_after_rewriter]: 8.08999e-06 [order_py_execute_after_rewriter]: 6.88e-06 [mutable_eliminate]: 0.00128572 [jit_opt_b]: 7.619e-05, [1] [Cycle 1]: 6.55e-05, [2] [frontend_op_eliminate]: 2.782e-05 [inline_after_opt_a]: 2.479e-05 [cconv]: 3.234e-05 [loop_unroll]: 0.00067062 [jit_opt_after_cconv]: 0.00019784, [1] [Cycle 1]: 0.00018991, [11] [c_1]: 3.335e-05 [parameter_eliminate]: 3.88999e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 3.327e-05 [call_graph_tuple_transform]: 2.962e-05 [tuple_list_get_item_eliminator]: 8.28001e-06 [none_parameter_eliminate]: 2.24001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 7.14001e-06 [remove_dup_value]: 1.79e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 1.037e-05 [add_recomputation]: 7.524e-05 [cse_after_recomputation]: 2.798e-05, [1] [Cycle 1]: 2.018e-05, [1] [cse]: 1.32e-05 [auto_monad_reorder]: 1.95e-05 [get_jit_bprop_graph]: 2.72001e-06 [rewriter_after_jit_bprop_graph]: 8.204e-05 [opt_after_jit_grad]: 0.00065466 [symbol_engine_optimizer]: 0.00010178, [1] [Cycle 1]: 9.356e-05, [6] [build]: 4.97e-06 [elim_shapecalc]: 1.088e-05 [elim_not_effective]: 2.021e-05 [opt_reshape]: 1.091e-05 [fold_const_symbol]: 1.412e-05 [renormalize]: 4.30009e-07 [validate]: 6.976e-05 Sums bootstrap : 0.000447s : 0.27% type_inference : 0.150184s : 92.34% event_method : 0.000028s : 0.02% auto_monad : 0.000088s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001316s : 0.81% rewriter_before_opt_a : 0.000137s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000097s : 0.06% jit_opt_a.loop_unroll : 0.000148s : 0.09% jit_opt_a.a_1 : 0.001063s : 0.65% jit_opt_a.with_stream_mark : 0.000042s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005440s : 3.34% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000056s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000054s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.001286s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.02% jit_opt_b.inline_after_opt_a : 0.000025s : 0.02% cconv : 0.000032s : 0.02% loop_unroll : 0.000671s : 0.41% jit_opt_after_cconv.c_1 : 0.000033s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000075s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000082s : 0.05% opt_after_jit_grad : 0.000655s : 0.40% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000070s : 0.04% Time group info: ------[substitution.] 0.000361 28 0.84% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.12% : 0.000008s : 4: substitution.graph_param_transform 83.49% : 0.000302s : 5: substitution.inline 1.34% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.35% : 0.000016s : 3: substitution.reduce_eliminate 1.81% : 0.000007s : 4: substitution.remove_not_recompute_node 1.77% : 0.000006s : 2: substitution.replace_old_param 3.71% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.150045 2 96.15% : 0.144266s : 1: type_inference.infer 3.85% : 0.005779s : 1: type_inference.specialize ------[replace.] 0.000144 7 66.30% : 0.000096s : 5: replace.inline 33.70% : 0.000049s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000310 7 96.02% : 0.000298s : 5: match.inline 3.98% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000178 886 1.43% : 0.000003s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.49% : 0.000004s : 13: predicate.arithmetic_simplify 1.80% : 0.000003s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 0.90% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 0.94% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.46% : 0.000003s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 4.60% : 0.000008s : 28: predicate.inline 0.67% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000003s : 8: predicate.less_batch_normalization 1.46% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.02% : 0.000004s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.23% : 0.000008s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 2.06% : 0.000004s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000004s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.43% : 0.000004s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.96% : 0.000002s : 4: predicate.row_tensor_eliminate 1.64% : 0.000003s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000002s : 8: predicate.specialize_transform 1.56% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.09% : 0.000013s : 64: predicate.switch_simplify 1.84% : 0.000003s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.84% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.52% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.97% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003692 25 56.57% : 0.002088s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.10% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.33% : 0.001526s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.175276 72 0.04% : 0.000079s : 1: add_recomputation 0.05% : 0.000093s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.27% : 0.000467s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.08% : 0.012404s : 1: jit_opt_a 0.11% : 0.000201s : 1: jit_opt_after_cconv 0.05% : 0.000080s : 1: jit_opt_b 0.39% : 0.000680s : 1: loop_unroll 0.74% : 0.001299s : 1: mutable_eliminate 0.84% : 0.001471s : 26: opt.transform.jit_opt_a 0.04% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.02% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000663s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.76% : 0.001331s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.22% : 0.003886s : 1: renormalize.infer 0.88% : 0.001539s : 1: renormalize.specialize 0.05% : 0.000085s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000057s : 1: rewriter_after_opt_a 0.08% : 0.000144s : 1: rewriter_before_opt_a 0.06% : 0.000105s : 1: symbol_engine_optimizer 85.70% : 0.150214s : 1: type_inference TotalTime = 0.0225522, [30] [bootstrap]: 0.00038206 [type_inference]: 0.0117972 [event_method]: 2.345e-05 [auto_monad]: 7.575e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 6.486e-05 [rewriter_before_opt_a]: 9.003e-05 [expand_dump_flag]: 3.40998e-06 [jit_opt_a]: 0.00739955, [2] [Cycle 1]: 0.00260958, [27] [switch_simplify]: 7.655e-05 [loop_unroll]: 3.571e-05 [a_1]: 0.00077001 [with_stream_mark]: 1.466e-05 [recompute_prepare]: 9.49e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.19003e-06 [specialize_transform]: 7.82e-06 [updatestate_useless_node_eliminater]: 6.64001e-06 [accelerated_algorithm]: 7.04001e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.91001e-06 [merge_forward]: 3.15002e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00133908 [add_forward_monad_depend]: 6.94001e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.68e-05 [cse]: 3.665e-05 [replace_applicator]: 1.499e-05 [Cycle 2]: 0.00038953, [27] [switch_simplify]: 6.70002e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00011433 [with_stream_mark]: 1.559e-05 [recompute_prepare]: 6.93998e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 3.14001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.99001e-06 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 9.02999e-06 [inline_without_move]: 6.58998e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.76e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 7.3e-06 [cse]: 1.755e-05 [replace_applicator]: 6.84999e-06 [py_interpret_to_execute_after_opt_a]: 1.666e-05 [rewriter_after_opt_a]: 4.168e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.82001e-06 [mutable_eliminate]: 0.00075106 [jit_opt_b]: 6.192e-05, [1] [Cycle 1]: 5.478e-05, [2] [frontend_op_eliminate]: 2.162e-05 [inline_after_opt_a]: 2.041e-05 [cconv]: 2.945e-05 [loop_unroll]: 0.00048626 [jit_opt_after_cconv]: 0.00017267, [1] [Cycle 1]: 0.00016656, [11] [c_1]: 2.686e-05 [parameter_eliminate]: 3.50998e-06 [updatestate_depend_eliminate]: 7.98001e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 3.111e-05 [call_graph_tuple_transform]: 2.305e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.20001e-06 [renormalize]: 2.00002e-07 [switch_simplify]: 8.08001e-06 [remove_dup_value]: 4.17e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 4.239e-05 [add_recomputation]: 4.792e-05 [cse_after_recomputation]: 2.985e-05, [1] [Cycle 1]: 2.345e-05, [1] [cse]: 1.5e-05 [auto_monad_reorder]: 1.341e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 8.95001e-06 [opt_after_jit_grad]: 0.00060226 [symbol_engine_optimizer]: 8.738e-05, [1] [Cycle 1]: 7.909e-05, [6] [build]: 3.82002e-06 [elim_shapecalc]: 9.96998e-06 [elim_not_effective]: 1.56e-05 [opt_reshape]: 7.48e-06 [fold_const_symbol]: 1.158e-05 [renormalize]: 3.39991e-07 [validate]: 4.075e-05 Sums bootstrap : 0.000382s : 2.18% type_inference : 0.011797s : 67.46% event_method : 0.000023s : 0.13% auto_monad : 0.000076s : 0.43% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000065s : 0.37% rewriter_before_opt_a : 0.000090s : 0.51% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000083s : 0.48% jit_opt_a.loop_unroll : 0.000042s : 0.24% jit_opt_a.a_1 : 0.000884s : 5.06% jit_opt_a.with_stream_mark : 0.000030s : 0.17% jit_opt_a.recompute_prepare : 0.000016s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000014s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.10% jit_opt_a.inline_without_move : 0.000013s : 0.07% jit_opt_a.renormalize : 0.001339s : 7.66% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.14% jit_opt_a.cse : 0.000054s : 0.31% jit_opt_a.replace_applicator : 0.000022s : 0.12% py_interpret_to_execute_after_opt_a : 0.000017s : 0.10% rewriter_after_opt_a : 0.000042s : 0.24% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000751s : 4.30% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.12% jit_opt_b.inline_after_opt_a : 0.000020s : 0.12% cconv : 0.000029s : 0.17% loop_unroll : 0.000486s : 2.78% jit_opt_after_cconv.c_1 : 0.000027s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.05% remove_dup_value : 0.000042s : 0.24% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000042s : 0.24% add_recomputation : 0.000048s : 0.27% cse_after_recomputation.cse : 0.000015s : 0.09% auto_monad_reorder : 0.000013s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.05% opt_after_jit_grad : 0.000602s : 3.44% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.23% Time group info: ------[substitution.] 0.000311 24 0.90% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 1.80% : 0.000006s : 3: substitution.graph_param_transform 88.46% : 0.000275s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000006s : 4: substitution.remove_not_recompute_node 1.24% : 0.000004s : 2: substitution.replace_old_param 4.05% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011718 2 87.69% : 0.010276s : 1: type_inference.infer 12.31% : 0.001442s : 1: type_inference.specialize ------[replace.] 0.000125 7 65.57% : 0.000082s : 5: replace.inline 34.43% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 7 95.96% : 0.000272s : 5: match.inline 4.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 747 1.13% : 0.000002s : 11: predicate.accumulaten_eliminater 1.35% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 11: predicate.addn_check_dump 1.17% : 0.000002s : 11: predicate.addn_zero_filter 2.04% : 0.000003s : 11: predicate.arithmetic_simplify 1.50% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.00% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.59% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.28% : 0.000002s : 11: predicate.environ_get_depend_swap 1.34% : 0.000002s : 11: predicate.environ_get_eliminate 0.98% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000008s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 16: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000007s : 38: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 11: predicate.merge_addn 1.18% : 0.000002s : 11: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000002s : 11: predicate.print_const_string_wrapper 2.08% : 0.000003s : 11: predicate.reduce_eliminate 1.86% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 19: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.59% : 0.000001s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 11: predicate.reshape_eliminate 1.15% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.82% : 0.000004s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000011s : 59: predicate.switch_simplify 1.66% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000002s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.96% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.92% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.14% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001224 16 49.73% : 0.000609s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.07% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.19% : 0.000529s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025122 72 0.21% : 0.000052s : 1: add_recomputation 0.31% : 0.000079s : 1: auto_monad 0.07% : 0.000017s : 1: auto_monad_reorder 1.60% : 0.000401s : 1: bootstrap 0.13% : 0.000032s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000033s : 1: cse_after_recomputation 0.18% : 0.000045s : 1: environ_conv 0.11% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 29.47% : 0.007405s : 1: jit_opt_a 0.70% : 0.000175s : 1: jit_opt_after_cconv 0.26% : 0.000065s : 1: jit_opt_b 1.96% : 0.000494s : 1: loop_unroll 3.02% : 0.000759s : 1: mutable_eliminate 4.56% : 0.001147s : 26: opt.transform.jit_opt_a 0.23% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000035s : 4: opt.transform.jit_opt_b 0.06% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000020s : 1: opt.transform.mutable_eliminate 0.11% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.56% : 0.000643s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000068s : 1: py_interpret_to_execute 0.08% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000045s : 1: remove_dup_value 3.04% : 0.000764s : 1: renormalize.infer 2.25% : 0.000565s : 1: renormalize.specialize 0.04% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000045s : 1: rewriter_after_opt_a 0.37% : 0.000093s : 1: rewriter_before_opt_a 0.36% : 0.000090s : 1: symbol_engine_optimizer 47.01% : 0.011810s : 1: type_inference TotalTime = 0.0361159, [30] [bootstrap]: 0.00029652 [type_inference]: 0.0269647 [event_method]: 2.038e-05 [auto_monad]: 6.885e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 9.384e-05 [rewriter_before_opt_a]: 7.906e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.00632707, [2] [Cycle 1]: 0.00180175, [27] [switch_simplify]: 5.854e-05 [loop_unroll]: 3.142e-05 [a_1]: 0.00053513 [with_stream_mark]: 1.894e-05 [recompute_prepare]: 7.56001e-06 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.67999e-06 [renormalize]: 0.00080054 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 3.673e-05 [replace_applicator]: 1.434e-05 [Cycle 2]: 0.00034866, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.46e-06 [a_1]: 9.634e-05 [with_stream_mark]: 9.78998e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 1.61002e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 8.24998e-06 [get_grad_eliminate_]: 5.85002e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.66998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.323e-05 [j_node_and_user_rematch]: 8.27998e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.55002e-06 [cse]: 1.36e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.265e-05 [rewriter_after_opt_a]: 3.771e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 6.29999e-06 [mutable_eliminate]: 0.00059502 [jit_opt_b]: 5.117e-05, [1] [Cycle 1]: 4.411e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.66e-05 [loop_unroll]: 0.00048627 [jit_opt_after_cconv]: 0.00014543, [1] [Cycle 1]: 0.00013898, [11] [c_1]: 2.037e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.372e-05 [call_graph_tuple_transform]: 1.879e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 1.61e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 6.27001e-06 [add_recomputation]: 5.186e-05 [cse_after_recomputation]: 2.454e-05, [1] [Cycle 1]: 1.913e-05, [1] [cse]: 1.277e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 5.39e-06 [opt_after_jit_grad]: 0.00045448 [symbol_engine_optimizer]: 7.209e-05, [1] [Cycle 1]: 6.586e-05, [6] [build]: 3.50998e-06 [elim_shapecalc]: 7.70998e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 3.39991e-07 [validate]: 3.878e-05 Sums bootstrap : 0.000297s : 0.95% type_inference : 0.026965s : 86.08% event_method : 0.000020s : 0.07% auto_monad : 0.000069s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000094s : 0.30% rewriter_before_opt_a : 0.000079s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.21% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000631s : 2.02% jit_opt_a.with_stream_mark : 0.000029s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000801s : 2.56% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000050s : 0.16% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000038s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000595s : 1.90% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000027s : 0.08% loop_unroll : 0.000486s : 1.55% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000454s : 1.45% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.12% Time group info: ------[substitution.] 0.000196 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.81% : 0.000006s : 3: substitution.graph_param_transform 81.82% : 0.000160s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.86% : 0.000006s : 4: substitution.remove_not_recompute_node 2.58% : 0.000005s : 2: substitution.replace_old_param 6.29% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026891 2 94.97% : 0.025537s : 1: type_inference.infer 5.03% : 0.001354s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.69% : 0.000046s : 4: replace.inline 32.31% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.32% : 0.000158s : 4: match.inline 6.68% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.45% : 0.000003s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.24% : 0.000002s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.50% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.45% : 0.000009s : 53: predicate.switch_simplify 1.40% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000769 13 51.23% : 0.000394s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.27% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.49% : 0.000342s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037831 72 0.14% : 0.000055s : 1: add_recomputation 0.19% : 0.000072s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.85% : 0.000320s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.73% : 0.006330s : 1: jit_opt_a 0.39% : 0.000148s : 1: jit_opt_after_cconv 0.14% : 0.000054s : 1: jit_opt_b 1.31% : 0.000494s : 1: loop_unroll 1.60% : 0.000604s : 1: mutable_eliminate 2.27% : 0.000860s : 26: opt.transform.jit_opt_a 0.12% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.22% : 0.000462s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000097s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000028s : 1: remove_dup_value 1.20% : 0.000454s : 1: renormalize.infer 0.90% : 0.000339s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000041s : 1: rewriter_after_opt_a 0.22% : 0.000083s : 1: rewriter_before_opt_a 0.20% : 0.000074s : 1: symbol_engine_optimizer 71.33% : 0.026985s : 1: type_inference TotalTime = 0.0364996, [30] [bootstrap]: 0.00043177 [type_inference]: 0.0252155 [event_method]: 2.148e-05 [auto_monad]: 7.258e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.00018322 [rewriter_before_opt_a]: 8.314e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00767849, [2] [Cycle 1]: 0.00291375, [27] [switch_simplify]: 7.32e-05 [loop_unroll]: 3.153e-05 [a_1]: 0.00068141 [with_stream_mark]: 2.219e-05 [recompute_prepare]: 1.115e-05 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.84001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 3.55e-06 [get_grad_eliminate_]: 7.38999e-06 [merge_forward]: 4.62998e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.833e-05 [j_node_and_user_rematch]: 1.137e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00170636 [add_forward_monad_depend]: 8.57998e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.791e-05 [cse]: 3.471e-05 [replace_applicator]: 2.111e-05 [Cycle 2]: 0.00038617, [27] [switch_simplify]: 7.77002e-06 [loop_unroll]: 6.44001e-06 [a_1]: 0.00011128 [with_stream_mark]: 1.485e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 2.43998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.835e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.83997e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.562e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.726e-05 [rewriter_after_opt_a]: 4.4e-05 [convert_after_rewriter]: 8.08999e-06 [order_py_execute_after_rewriter]: 5.85002e-06 [mutable_eliminate]: 0.00084247 [jit_opt_b]: 8.213e-05, [1] [Cycle 1]: 7.401e-05, [2] [frontend_op_eliminate]: 4.088e-05 [inline_after_opt_a]: 1.82e-05 [cconv]: 2.967e-05 [loop_unroll]: 0.00051131 [jit_opt_after_cconv]: 0.00016425, [1] [Cycle 1]: 0.00015726, [11] [c_1]: 2.477e-05 [parameter_eliminate]: 4.64998e-06 [updatestate_depend_eliminate]: 7.61001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.68e-05 [call_graph_tuple_transform]: 2.174e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.71003e-06 [remove_dup_value]: 1.782e-05 [partial_unused_args_eliminate]: 2.08002e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.464e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.222e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 3.24001e-06 [rewriter_after_jit_bprop_graph]: 6.52001e-06 [opt_after_jit_grad]: 0.00060279 [symbol_engine_optimizer]: 0.00013195, [1] [Cycle 1]: 0.00012386, [6] [build]: 5.09998e-06 [elim_shapecalc]: 4.844e-05 [elim_not_effective]: 1.814e-05 [opt_reshape]: 7.38999e-06 [fold_const_symbol]: 1.031e-05 [renormalize]: 5.09986e-07 [validate]: 4.756e-05 Sums bootstrap : 0.000432s : 1.37% type_inference : 0.025216s : 80.11% event_method : 0.000021s : 0.07% auto_monad : 0.000073s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000183s : 0.58% rewriter_before_opt_a : 0.000083s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.26% jit_opt_a.loop_unroll : 0.000038s : 0.12% jit_opt_a.a_1 : 0.000793s : 2.52% jit_opt_a.with_stream_mark : 0.000037s : 0.12% jit_opt_a.recompute_prepare : 0.000018s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001706s : 5.42% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000050s : 0.16% jit_opt_a.replace_applicator : 0.000027s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000044s : 0.14% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000842s : 2.68% jit_opt_b.frontend_op_eliminate : 0.000041s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000030s : 0.09% loop_unroll : 0.000511s : 1.62% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000603s : 1.92% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000048s : 0.15% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.15% Time group info: ------[substitution.] 0.000290 23 0.93% : 0.000003s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 3: substitution.graph_param_transform 86.74% : 0.000251s : 4: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 4.67% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025134 2 91.41% : 0.022974s : 1: type_inference.infer 8.59% : 0.002160s : 1: type_inference.specialize ------[replace.] 0.000096 6 67.53% : 0.000065s : 4: replace.inline 32.47% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 6 95.29% : 0.000248s : 4: match.inline 4.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 691 1.08% : 0.000002s : 10: predicate.accumulaten_eliminater 1.11% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.44% : 0.000003s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.40% : 0.000002s : 10: predicate.depend_value_elim 1.43% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.76% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.59% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 4.39% : 0.000006s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.92% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 10: predicate.merge_addn 1.31% : 0.000002s : 10: predicate.minmaximum_grad 2.49% : 0.000003s : 3: predicate.mutable_eliminate 0.72% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000002s : 10: predicate.print_const_string_wrapper 2.04% : 0.000003s : 10: predicate.reduce_eliminate 1.65% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000001s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.01% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 1.81% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.92% : 0.000010s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.23% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 3.47% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001127 13 41.93% : 0.000473s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.27% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.80% : 0.000606s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039371 72 0.14% : 0.000054s : 1: add_recomputation 0.19% : 0.000076s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.13% : 0.000447s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.51% : 0.007683s : 1: jit_opt_a 0.42% : 0.000167s : 1: jit_opt_after_cconv 0.22% : 0.000085s : 1: jit_opt_b 1.32% : 0.000519s : 1: loop_unroll 2.16% : 0.000850s : 1: mutable_eliminate 2.70% : 0.001062s : 26: opt.transform.jit_opt_a 0.14% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000031s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000080s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000611s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000187s : 1: py_interpret_to_execute 0.05% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.62% : 0.001031s : 1: renormalize.infer 1.69% : 0.000664s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000048s : 1: rewriter_after_opt_a 0.22% : 0.000087s : 1: rewriter_before_opt_a 0.34% : 0.000135s : 1: symbol_engine_optimizer 64.08% : 0.025230s : 1: type_inference TotalTime = 0.040995, [30] [bootstrap]: 0.00035702 [type_inference]: 0.0239854 [event_method]: 2.562e-05 [auto_monad]: 8.563e-05 [graph_reusing]: 6.93e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00010181 [rewriter_before_opt_a]: 0.00010696 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0133185, [2] [Cycle 1]: 0.00820901, [27] [switch_simplify]: 8.225e-05 [loop_unroll]: 3.614e-05 [a_1]: 0.0059872 [with_stream_mark]: 2.317e-05 [recompute_prepare]: 1.279e-05 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.93001e-06 [updatestate_useless_node_eliminater]: 6.42001e-06 [accelerated_algorithm]: 7.00002e-06 [meta_shard_fg_expand]: 3.73999e-06 [get_grad_eliminate_]: 6.96999e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.725e-05 [j_node_and_user_rematch]: 1.042e-05 [meta_fg_expand]: 3.4e-06 [replace_old_param]: 5.106e-05 [inline_without_move]: 6.30997e-06 [renormalize]: 0.00161094 [add_forward_monad_depend]: 7.85e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.914e-05 [cse]: 3.835e-05 [replace_applicator]: 2.563e-05 [Cycle 2]: 0.00038121, [27] [switch_simplify]: 7.7e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.00011194 [with_stream_mark]: 1.558e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 1.81998e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 2.65997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.649e-05 [j_node_and_user_rematch]: 8.70999e-06 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 9.02999e-06 [inline_without_move]: 5.17e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.44003e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 6.81001e-06 [cse]: 1.736e-05 [replace_applicator]: 6.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.58e-05 [rewriter_after_opt_a]: 4.326e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00091046 [jit_opt_b]: 6.417e-05, [1] [Cycle 1]: 5.667e-05, [2] [frontend_op_eliminate]: 2.324e-05 [inline_after_opt_a]: 2.228e-05 [cconv]: 3.221e-05 [loop_unroll]: 0.00051659 [jit_opt_after_cconv]: 0.00020351, [1] [Cycle 1]: 0.0001963, [11] [c_1]: 2.428e-05 [parameter_eliminate]: 4.74e-06 [updatestate_depend_eliminate]: 8.75999e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 4.87e-06 [cse]: 3.94e-05 [call_graph_tuple_transform]: 4.115e-05 [tuple_list_get_item_eliminator]: 8.43001e-06 [none_parameter_eliminate]: 2.11998e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 6.73e-06 [remove_dup_value]: 5.153e-05 [partial_unused_args_eliminate]: 2.55002e-06 [environ_conv]: 8.51002e-06 [add_recomputation]: 5.593e-05 [cse_after_recomputation]: 2.899e-05, [1] [Cycle 1]: 2.217e-05, [1] [cse]: 1.454e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 9.17999e-06 [opt_after_jit_grad]: 0.00060922 [symbol_engine_optimizer]: 0.00016723, [1] [Cycle 1]: 0.00015959, [6] [build]: 5.03002e-06 [elim_shapecalc]: 9.72999e-06 [elim_not_effective]: 1.834e-05 [opt_reshape]: 9.34998e-06 [fold_const_symbol]: 1.059e-05 [renormalize]: 2.69996e-07 [validate]: 5.344e-05 Sums bootstrap : 0.000357s : 1.00% type_inference : 0.023985s : 67.51% event_method : 0.000026s : 0.07% auto_monad : 0.000086s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.29% rewriter_before_opt_a : 0.000107s : 0.30% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000090s : 0.25% jit_opt_a.loop_unroll : 0.000042s : 0.12% jit_opt_a.a_1 : 0.006099s : 17.17% jit_opt_a.with_stream_mark : 0.000039s : 0.11% jit_opt_a.recompute_prepare : 0.000019s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000060s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001611s : 4.53% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.07% jit_opt_a.cse : 0.000056s : 0.16% jit_opt_a.replace_applicator : 0.000032s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.04% rewriter_after_opt_a : 0.000043s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000910s : 2.56% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.07% jit_opt_b.inline_after_opt_a : 0.000022s : 0.06% cconv : 0.000032s : 0.09% loop_unroll : 0.000517s : 1.45% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000041s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000052s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000056s : 0.16% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000609s : 1.71% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.15% Time group info: ------[substitution.] 0.000442 24 0.62% : 0.000003s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.33% : 0.000006s : 3: substitution.graph_param_transform 81.71% : 0.000361s : 5: substitution.inline 0.96% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.30% : 0.000006s : 4: substitution.remove_not_recompute_node 10.01% : 0.000044s : 2: substitution.replace_old_param 3.73% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023878 2 90.78% : 0.021675s : 1: type_inference.infer 9.22% : 0.002203s : 1: type_inference.specialize ------[replace.] 0.000149 7 69.75% : 0.000104s : 5: replace.inline 30.25% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000373 7 95.90% : 0.000358s : 5: match.inline 4.10% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.005218 747 0.04% : 0.000002s : 11: predicate.accumulaten_eliminater 0.03% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.03% : 0.000002s : 11: predicate.addn_check_dump 0.04% : 0.000002s : 11: predicate.addn_zero_filter 0.08% : 0.000004s : 11: predicate.arithmetic_simplify 0.06% : 0.000003s : 11: predicate.cast_eliminate 0.01% : 0.000001s : 3: predicate.check_bprop_eliminate 0.04% : 0.000002s : 11: predicate.compare_switch_simplify 0.04% : 0.000002s : 11: predicate.depend_value_elim 0.03% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 0.09% : 0.000005s : 11: predicate.dict_get_item_eliminator 0.04% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.03% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.01% : 0.000001s : 3: predicate.elim_not_effective 0.02% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.05% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.03% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.03% : 0.000002s : 11: predicate.environ_get_depend_swap 0.04% : 0.000002s : 11: predicate.environ_get_eliminate 0.03% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.01% : 0.000000s : 3: predicate.fold_const_symbol 0.03% : 0.000002s : 6: predicate.get_grad_eliminate 0.01% : 0.000000s : 3: predicate.graph_param_transform 0.18% : 0.000009s : 24: predicate.inline 0.03% : 0.000001s : 6: predicate.inline_without_move 0.01% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.04% : 0.000002s : 6: predicate.less_batch_normalization 0.06% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 0.06% : 0.000003s : 16: predicate.load_eliminater 0.05% : 0.000003s : 3: predicate.loop_unroll_after_grad 0.13% : 0.000007s : 38: predicate.loop_unroll_before_grad 0.07% : 0.000004s : 14: predicate.make_slice_get_slice_eliminator 0.03% : 0.000002s : 11: predicate.merge_addn 0.04% : 0.000002s : 11: predicate.minmaximum_grad 0.07% : 0.000003s : 3: predicate.mutable_eliminate 0.02% : 0.000001s : 3: predicate.opt_reshape 0.06% : 0.000003s : 16: predicate.partial_eliminate 0.05% : 0.000002s : 11: predicate.print_const_string_wrapper 0.09% : 0.000005s : 11: predicate.reduce_eliminate 0.05% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.02% : 0.000001s : 6: predicate.remove_not_recompute_node 0.05% : 0.000003s : 19: predicate.replace_applicator 0.02% : 0.000001s : 6: predicate.replace_old_param 0.01% : 0.000001s : 3: predicate.reset_defer_inline 0.05% : 0.000002s : 11: predicate.reshape_eliminate 0.05% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.04% : 0.000002s : 3: predicate.row_tensor_eliminate 0.05% : 0.000003s : 11: predicate.same_eliminate 0.02% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.03% : 0.000002s : 6: predicate.special_op_eliminate 0.03% : 0.000001s : 6: predicate.specialize_transform 0.06% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 0.06% : 0.000003s : 11: predicate.stack_unstack_eliminate 0.02% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.12% : 0.000006s : 18: predicate.switch_defer_inline 0.07% : 0.000004s : 18: predicate.switch_layer_defer_inline 0.24% : 0.000012s : 59: predicate.switch_simplify 0.04% : 0.000002s : 11: predicate.tile_eliminate 0.04% : 0.000002s : 11: predicate.transpose_eliminate 96.63% : 0.005042s : 11: predicate.tuple_list_convert_item_index_to_positive 0.05% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 0.13% : 0.000007s : 19: predicate.tuple_list_get_item_eliminator 0.07% : 0.000004s : 11: predicate.tuple_list_set_item_eliminator 0.03% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 0.05% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 0.09% : 0.000005s : 22: predicate.updatestate_useless_node_eliminater 0.06% : 0.000003s : 11: predicate.value_based_eliminate 0.01% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.02% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001578 16 44.40% : 0.000701s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.75% : 0.000107s : 2: func_graph_cloner_run.FuncGraphClonerNode 48.85% : 0.000771s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049116 72 0.12% : 0.000059s : 1: add_recomputation 0.18% : 0.000090s : 1: auto_monad 0.05% : 0.000023s : 1: auto_monad_reorder 0.76% : 0.000371s : 1: bootstrap 0.07% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.06% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 27.13% : 0.013323s : 1: jit_opt_a 0.42% : 0.000208s : 1: jit_opt_after_cconv 0.14% : 0.000067s : 1: jit_opt_b 1.07% : 0.000524s : 1: loop_unroll 1.87% : 0.000919s : 1: mutable_eliminate 13.07% : 0.006421s : 26: opt.transform.jit_opt_a 0.16% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000037s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000020s : 1: opt.transform.mutable_eliminate 0.06% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000617s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000104s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000054s : 1: remove_dup_value 1.82% : 0.000893s : 1: renormalize.infer 1.44% : 0.000706s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000046s : 1: rewriter_after_opt_a 0.23% : 0.000111s : 1: rewriter_before_opt_a 0.35% : 0.000171s : 1: symbol_engine_optimizer 48.88% : 0.024006s : 1: type_inference TotalTime = 0.109527, [30] [bootstrap]: 0.00027129 [type_inference]: 0.0699902 [event_method]: 0.00034214 [auto_monad]: 0.00011429 [graph_reusing]: 8.15999e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 3.789e-05 [rewriter_before_opt_a]: 0.00012819 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.0358019, [3] [Cycle 1]: 0.0193976, [27] [switch_simplify]: 8.356e-05 [loop_unroll]: 4.896e-05 [a_1]: 0.00106127 [with_stream_mark]: 3.547e-05 [recompute_prepare]: 2.267e-05 [updatestate_depend_eliminate]: 9.42001e-06 [updatestate_assign_eliminate]: 7.77e-06 [updatestate_loads_eliminate]: 7.1e-06 [parameter_eliminate]: 3.14001e-06 [specialize_transform]: 1.535e-05 [updatestate_useless_node_eliminater]: 1.418e-05 [accelerated_algorithm]: 1.51e-05 [meta_shard_fg_expand]: 4.50999e-06 [get_grad_eliminate_]: 1.538e-05 [merge_forward]: 9.24998e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.878e-05 [j_node_and_user_rematch]: 2.493e-05 [meta_fg_expand]: 0.00185708 [replace_old_param]: 7.148e-05 [inline_without_move]: 6.546e-05 [renormalize]: 0.0152101 [add_forward_monad_depend]: 1.602e-05 [auto_monad_grad]: 6.83e-06 [auto_monad_eliminator]: 7.368e-05 [cse]: 0.00030144 [replace_applicator]: 0.00010817 [Cycle 2]: 0.0122863, [27] [switch_simplify]: 4.674e-05 [loop_unroll]: 4.481e-05 [a_1]: 0.00145861 [with_stream_mark]: 3.268e-05 [recompute_prepare]: 2.021e-05 [updatestate_depend_eliminate]: 6.51e-06 [updatestate_assign_eliminate]: 4.65001e-06 [updatestate_loads_eliminate]: 4.02998e-06 [parameter_eliminate]: 3.00998e-06 [specialize_transform]: 9.19e-06 [updatestate_useless_node_eliminater]: 9.12999e-06 [accelerated_algorithm]: 9.63002e-06 [meta_shard_fg_expand]: 3.45e-06 [get_grad_eliminate_]: 9.34998e-06 [merge_forward]: 5.69e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.309e-05 [j_node_and_user_rematch]: 1.444e-05 [meta_fg_expand]: 0.00014025 [replace_old_param]: 1.236e-05 [inline_without_move]: 8.52e-06 [renormalize]: 0.0100452 [add_forward_monad_depend]: 1.341e-05 [auto_monad_grad]: 3.38e-06 [auto_monad_eliminator]: 2.68e-05 [cse]: 3.983e-05 [replace_applicator]: 2.905e-05 [Cycle 3]: 0.00040237, [27] [switch_simplify]: 6.79999e-06 [loop_unroll]: 5.27001e-06 [a_1]: 8.948e-05 [with_stream_mark]: 3.349e-05 [recompute_prepare]: 6.88e-06 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 4.65999e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 3.57002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.139e-05 [j_node_and_user_rematch]: 9.78002e-06 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 4.87e-06 [inline_without_move]: 4.67998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 8.57e-06 [cse]: 1.514e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 2.243e-05 [rewriter_after_opt_a]: 4.707e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00085217 [jit_opt_b]: 6.219e-05, [1] [Cycle 1]: 5.11e-05, [2] [frontend_op_eliminate]: 1.731e-05 [inline_after_opt_a]: 1.898e-05 [cconv]: 3.592e-05 [loop_unroll]: 0.00052434 [jit_opt_after_cconv]: 0.00018461, [1] [Cycle 1]: 0.00017747, [11] [c_1]: 1.944e-05 [parameter_eliminate]: 5.40001e-06 [updatestate_depend_eliminate]: 1.091e-05 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 3.687e-05 [call_graph_tuple_transform]: 2.637e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.35001e-06 [remove_dup_value]: 2.111e-05 [partial_unused_args_eliminate]: 4.07e-06 [environ_conv]: 8.17e-06 [add_recomputation]: 6.984e-05 [cse_after_recomputation]: 2.511e-05, [1] [Cycle 1]: 1.927e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.786e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 8.09997e-06 [opt_after_jit_grad]: 0.00055682 [symbol_engine_optimizer]: 8.424e-05, [1] [Cycle 1]: 7.67e-05, [6] [build]: 4.32e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.632e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 8.50006e-07 [validate]: 4.676e-05 Sums bootstrap : 0.000271s : 0.26% type_inference : 0.069990s : 66.82% event_method : 0.000342s : 0.33% auto_monad : 0.000114s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.04% rewriter_before_opt_a : 0.000128s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000137s : 0.13% jit_opt_a.loop_unroll : 0.000099s : 0.09% jit_opt_a.a_1 : 0.002609s : 2.49% jit_opt_a.with_stream_mark : 0.000102s : 0.10% jit_opt_a.recompute_prepare : 0.000050s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000021s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000009s : 0.01% jit_opt_a.specialize_transform : 0.000031s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000028s : 0.03% jit_opt_a.accelerated_algorithm : 0.000030s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000011s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000029s : 0.03% jit_opt_a.merge_forward : 0.000019s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000073s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000049s : 0.05% jit_opt_a.meta_fg_expand : 0.002000s : 1.91% jit_opt_a.replace_old_param : 0.000089s : 0.08% jit_opt_a.inline_without_move : 0.000079s : 0.08% jit_opt_a.renormalize : 0.025255s : 24.11% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.03% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000109s : 0.10% jit_opt_a.cse : 0.000356s : 0.34% jit_opt_a.replace_applicator : 0.000143s : 0.14% py_interpret_to_execute_after_opt_a : 0.000022s : 0.02% rewriter_after_opt_a : 0.000047s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000852s : 0.81% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000524s : 0.50% jit_opt_after_cconv.c_1 : 0.000019s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000070s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000557s : 0.53% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000685 112 0.26% : 0.000002s : 2: substitution.elim_not_effective 0.27% : 0.000002s : 2: substitution.fold_const_symbol 1.09% : 0.000007s : 2: substitution.graph_param_transform 66.01% : 0.000452s : 13: substitution.inline 2.84% : 0.000019s : 2: substitution.inline_without_move 1.71% : 0.000012s : 14: substitution.j_node_and_user_rematch 1.70% : 0.000012s : 7: substitution.minmaximum_grad 1.23% : 0.000008s : 5: substitution.partial_eliminate 1.86% : 0.000013s : 14: substitution.remove_not_recompute_node 5.71% : 0.000039s : 10: substitution.replace_applicator 0.95% : 0.000006s : 10: substitution.replace_old_param 1.34% : 0.000009s : 1: substitution.reshape_eliminate 0.38% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.08% : 0.000007s : 1: substitution.tile_eliminate 3.90% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.41% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.26% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069873 2 96.24% : 0.067244s : 1: type_inference.infer 3.76% : 0.002629s : 1: type_inference.specialize ------[replace.] 0.000211 20 65.98% : 0.000139s : 13: replace.inline 34.02% : 0.000072s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000468 20 94.51% : 0.000443s : 13: match.inline 5.49% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000496 2852 1.33% : 0.000007s : 49: predicate.accumulaten_eliminater 0.24% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.16% : 0.000006s : 49: predicate.addn_check_dump 1.33% : 0.000007s : 49: predicate.addn_zero_filter 1.95% : 0.000010s : 49: predicate.arithmetic_simplify 1.30% : 0.000006s : 49: predicate.cast_eliminate 0.09% : 0.000000s : 2: predicate.check_bprop_eliminate 1.18% : 0.000006s : 49: predicate.compare_switch_simplify 1.30% : 0.000006s : 49: predicate.depend_value_elim 1.23% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.29% : 0.000006s : 49: predicate.dict_get_item_eliminator 1.27% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.11% : 0.000001s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000006s : 49: predicate.environ_add_const_eliminate 1.18% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.16% : 0.000006s : 49: predicate.environ_get_depend_swap 1.27% : 0.000006s : 49: predicate.environ_get_eliminate 1.14% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.82% : 0.000004s : 21: predicate.get_grad_eliminate 0.08% : 0.000000s : 2: predicate.graph_param_transform 3.95% : 0.000020s : 73: predicate.inline 1.65% : 0.000008s : 49: predicate.inline_without_move 0.32% : 0.000002s : 21: predicate.j_node_and_user_rematch 0.93% : 0.000005s : 21: predicate.less_batch_normalization 1.53% : 0.000008s : 56: predicate.list_to_tuple_eliminator_ 1.51% : 0.000008s : 58: predicate.load_eliminater 0.38% : 0.000002s : 2: predicate.loop_unroll_after_grad 2.90% : 0.000014s : 102: predicate.loop_unroll_before_grad 1.54% : 0.000008s : 51: predicate.make_slice_get_slice_eliminator 1.23% : 0.000006s : 49: predicate.merge_addn 1.21% : 0.000006s : 49: predicate.minmaximum_grad 0.53% : 0.000003s : 2: predicate.mutable_eliminate 0.12% : 0.000001s : 2: predicate.opt_reshape 1.97% : 0.000010s : 58: predicate.partial_eliminate 1.22% : 0.000006s : 49: predicate.print_const_string_wrapper 1.91% : 0.000009s : 49: predicate.reduce_eliminate 1.50% : 0.000007s : 56: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000002s : 21: predicate.remove_not_recompute_node 2.52% : 0.000013s : 106: predicate.replace_applicator 0.88% : 0.000004s : 49: predicate.replace_old_param 0.11% : 0.000001s : 2: predicate.reset_defer_inline 1.39% : 0.000007s : 49: predicate.reshape_eliminate 1.45% : 0.000007s : 49: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 2: predicate.row_tensor_eliminate 15.83% : 0.000079s : 49: predicate.same_eliminate 0.51% : 0.000003s : 21: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 4: predicate.special_op_eliminate 0.74% : 0.000004s : 21: predicate.specialize_transform 1.44% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000007s : 49: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.38% : 0.000012s : 69: predicate.switch_defer_inline 2.03% : 0.000010s : 69: predicate.switch_layer_defer_inline 5.48% : 0.000027s : 173: predicate.switch_simplify 1.38% : 0.000007s : 49: predicate.tile_eliminate 1.24% : 0.000006s : 49: predicate.transpose_eliminate 1.67% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.63% : 0.000008s : 49: predicate.tuple_list_get_item_depend_reorder 2.82% : 0.000014s : 60: predicate.tuple_list_get_item_eliminator 1.66% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.47% : 0.000007s : 56: predicate.tuple_to_list_eliminator_ 1.46% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.28% : 0.000011s : 79: predicate.updatestate_useless_node_eliminater 1.69% : 0.000008s : 49: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.21% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004806 52 72.83% : 0.003500s : 35: func_graph_cloner_run.FuncGraphClonerGraph 27.17% : 0.001306s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138208 87 0.05% : 0.000073s : 1: add_recomputation 0.09% : 0.000121s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000298s : 1: bootstrap 0.03% : 0.000040s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.26% : 0.000354s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 25.91% : 0.035806s : 1: jit_opt_a 0.14% : 0.000188s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.39% : 0.000537s : 1: loop_unroll 0.63% : 0.000870s : 1: mutable_eliminate 2.45% : 0.003386s : 39: opt.transform.jit_opt_a 0.04% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000568s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000041s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 16.05% : 0.022182s : 2: renormalize.infer 2.20% : 0.003042s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000051s : 1: rewriter_after_opt_a 0.10% : 0.000133s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 50.66% : 0.070018s : 1: type_inference TotalTime = 0.0542597, [30] [bootstrap]: 0.0002758 [type_inference]: 0.0258772 [event_method]: 1.971e-05 [auto_monad]: 6.899e-05 [graph_reusing]: 5.28002e-06 [pre_auto_parallel]: 2.26998e-06 [py_interpret_to_execute]: 0.00010915 [rewriter_before_opt_a]: 8.041e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.0256442, [2] [Cycle 1]: 0.00206623, [27] [switch_simplify]: 6.35e-05 [loop_unroll]: 2.955e-05 [a_1]: 0.00057175 [with_stream_mark]: 2.508e-05 [recompute_prepare]: 8.15e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 5.83002e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 4.29002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.433e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 5.36998e-06 [renormalize]: 0.00102756 [add_forward_monad_depend]: 5.39e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 1.571e-05 [cse]: 3.609e-05 [replace_applicator]: 1.195e-05 [Cycle 2]: 0.00032122, [27] [switch_simplify]: 5.71e-06 [loop_unroll]: 5.04998e-06 [a_1]: 8.885e-05 [with_stream_mark]: 1.007e-05 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.21998e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.366e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 7.11999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.4e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.437e-05 [rewriter_after_opt_a]: 3.972e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 5.01997e-06 [mutable_eliminate]: 0.00059031 [jit_opt_b]: 4.822e-05, [1] [Cycle 1]: 4.168e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.649e-05 [cconv]: 2.759e-05 [loop_unroll]: 0.00042187 [jit_opt_after_cconv]: 0.00014162, [1] [Cycle 1]: 0.00013518, [11] [c_1]: 2e-05 [parameter_eliminate]: 3.05002e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.234e-05 [call_graph_tuple_transform]: 1.818e-05 [tuple_list_get_item_eliminator]: 5.15001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.602e-05 [partial_unused_args_eliminate]: 1.943e-05 [environ_conv]: 6.00002e-06 [add_recomputation]: 5.291e-05 [cse_after_recomputation]: 2.494e-05, [1] [Cycle 1]: 1.908e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.79e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.0004559 [symbol_engine_optimizer]: 7.081e-05, [1] [Cycle 1]: 6.451e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 7.53999e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 5.89999e-06 [fold_const_symbol]: 8.62e-06 [renormalize]: 4.19997e-07 [validate]: 3.806e-05 Sums bootstrap : 0.000276s : 0.91% type_inference : 0.025877s : 85.05% event_method : 0.000020s : 0.06% auto_monad : 0.000069s : 0.23% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000109s : 0.36% rewriter_before_opt_a : 0.000080s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.23% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000661s : 2.17% jit_opt_a.with_stream_mark : 0.000035s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001028s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000050s : 0.16% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000590s : 1.94% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000028s : 0.09% loop_unroll : 0.000422s : 1.39% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000019s : 0.06% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 1.50% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.13% Time group info: ------[substitution.] 0.000242 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000006s : 3: substitution.graph_param_transform 85.67% : 0.000207s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.25% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025810 2 94.32% : 0.024344s : 1: type_inference.infer 5.68% : 0.001466s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.78% : 0.000052s : 4: replace.inline 30.22% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.72% : 0.000205s : 4: match.inline 5.28% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.12% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.64% : 0.000002s : 10: predicate.addn_zero_filter 1.67% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.71% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000002s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.99% : 0.000002s : 10: predicate.reduce_eliminate 1.75% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 16: predicate.switch_defer_inline 2.63% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.89% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000851 13 44.51% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.33% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.16% : 0.000418s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056218 72 0.10% : 0.000056s : 1: add_recomputation 0.13% : 0.000073s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.52% : 0.000294s : 1: bootstrap 0.05% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 45.62% : 0.025648s : 1: jit_opt_a 0.26% : 0.000144s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.76% : 0.000429s : 1: loop_unroll 1.07% : 0.000599s : 1: mutable_eliminate 1.57% : 0.000881s : 26: opt.transform.jit_opt_a 0.08% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.82% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000022s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000113s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.03% : 0.000580s : 1: renormalize.infer 0.78% : 0.000439s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.15% : 0.000084s : 1: rewriter_before_opt_a 0.13% : 0.000073s : 1: symbol_engine_optimizer 46.05% : 0.025889s : 1: type_inference TotalTime = 0.0142996, [30] [bootstrap]: 0.00030733 [type_inference]: 0.00577875 [event_method]: 1.87e-05 [auto_monad]: 6.883e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.90002e-06 [py_interpret_to_execute]: 3.557e-05 [rewriter_before_opt_a]: 7.663e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00564372, [2] [Cycle 1]: 0.00169549, [27] [switch_simplify]: 5.86e-05 [loop_unroll]: 2.884e-05 [a_1]: 0.00053122 [with_stream_mark]: 2.232e-05 [recompute_prepare]: 7.72998e-06 [updatestate_depend_eliminate]: 4.67998e-06 [updatestate_assign_eliminate]: 3.40003e-06 [updatestate_loads_eliminate]: 3.45998e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.91e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00068001 [add_forward_monad_depend]: 6.39001e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.57e-05 [cse]: 3.98e-05 [replace_applicator]: 1.57e-05 [Cycle 2]: 0.00034771, [27] [switch_simplify]: 5.83002e-06 [loop_unroll]: 4.87e-06 [a_1]: 8.939e-05 [with_stream_mark]: 1.234e-05 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 4.90001e-06 [updatestate_useless_node_eliminater]: 5.06002e-06 [accelerated_algorithm]: 5.16998e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.06003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.93999e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 1.34998e-06 [auto_monad_eliminator]: 6.46e-06 [cse]: 1.422e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.434e-05 [rewriter_after_opt_a]: 4.674e-05 [convert_after_rewriter]: 7.28999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00064553 [jit_opt_b]: 5.334e-05, [1] [Cycle 1]: 4.381e-05, [2] [frontend_op_eliminate]: 1.578e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 2.697e-05 [loop_unroll]: 0.00045107 [jit_opt_after_cconv]: 0.00017645, [1] [Cycle 1]: 0.00016869, [11] [c_1]: 2.174e-05 [parameter_eliminate]: 3.78999e-06 [updatestate_depend_eliminate]: 7.38e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.83998e-06 [cse]: 4.464e-05 [call_graph_tuple_transform]: 2.206e-05 [tuple_list_get_item_eliminator]: 5.31998e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.747e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.31e-06 [add_recomputation]: 5.913e-05 [cse_after_recomputation]: 2.632e-05, [1] [Cycle 1]: 1.987e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 6.05002e-06 [opt_after_jit_grad]: 0.00049147 [symbol_engine_optimizer]: 7.371e-05, [1] [Cycle 1]: 6.716e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 7.38e-06 [elim_not_effective]: 1.304e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.3e-06 [renormalize]: 8.89995e-07 [validate]: 4.396e-05 Sums bootstrap : 0.000307s : 3.06% type_inference : 0.005779s : 57.45% event_method : 0.000019s : 0.19% auto_monad : 0.000069s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.35% rewriter_before_opt_a : 0.000077s : 0.76% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.64% jit_opt_a.loop_unroll : 0.000034s : 0.34% jit_opt_a.a_1 : 0.000621s : 6.17% jit_opt_a.with_stream_mark : 0.000035s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000680s : 6.76% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000054s : 0.54% jit_opt_a.replace_applicator : 0.000021s : 0.21% py_interpret_to_execute_after_opt_a : 0.000014s : 0.14% rewriter_after_opt_a : 0.000047s : 0.46% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000646s : 6.42% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000027s : 0.27% loop_unroll : 0.000451s : 4.48% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000045s : 0.44% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000059s : 0.59% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000018s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000491s : 4.89% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.44% Time group info: ------[substitution.] 0.000210 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 3.48% : 0.000007s : 3: substitution.graph_param_transform 82.89% : 0.000174s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.44% : 0.000005s : 2: substitution.replace_old_param 5.85% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005699 2 85.47% : 0.004871s : 1: type_inference.infer 14.53% : 0.000828s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.99% : 0.000047s : 4: replace.inline 32.01% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.84% : 0.000172s : 4: match.inline 6.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.26% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.86% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.87% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.45% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.50% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000702 13 60.67% : 0.000426s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.09% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.23% : 0.000247s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015874 72 0.39% : 0.000062s : 1: add_recomputation 0.46% : 0.000072s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 2.06% : 0.000327s : 1: bootstrap 0.19% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.58% : 0.005648s : 1: jit_opt_a 1.13% : 0.000179s : 1: jit_opt_after_cconv 0.36% : 0.000056s : 1: jit_opt_b 2.90% : 0.000460s : 1: loop_unroll 4.13% : 0.000656s : 1: mutable_eliminate 5.29% : 0.000839s : 26: opt.transform.jit_opt_a 0.32% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.16% : 0.000501s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000038s : 1: py_interpret_to_execute 0.11% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 2.20% : 0.000350s : 1: renormalize.infer 2.03% : 0.000322s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.31% : 0.000050s : 1: rewriter_after_opt_a 0.50% : 0.000080s : 1: rewriter_before_opt_a 0.48% : 0.000076s : 1: symbol_engine_optimizer 36.53% : 0.005799s : 1: type_inference TotalTime = 0.0195912, [30] [bootstrap]: 0.00037773 [type_inference]: 0.00932572 [event_method]: 2.163e-05 [auto_monad]: 7.201e-05 [graph_reusing]: 6.08998e-06 [pre_auto_parallel]: 2.09999e-06 [py_interpret_to_execute]: 6.117e-05 [rewriter_before_opt_a]: 8.344e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00702294, [2] [Cycle 1]: 0.00243029, [27] [switch_simplify]: 7.352e-05 [loop_unroll]: 3.317e-05 [a_1]: 0.00074815 [with_stream_mark]: 1.79e-05 [recompute_prepare]: 1.027e-05 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.48999e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 4.75999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.661e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 6.01e-06 [renormalize]: 0.00119736 [add_forward_monad_depend]: 6.29999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.564e-05 [cse]: 2.342e-05 [replace_applicator]: 1.967e-05 [Cycle 2]: 0.00038688, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.83002e-06 [a_1]: 0.00011868 [with_stream_mark]: 1.173e-05 [recompute_prepare]: 6.69999e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 4.34002e-06 [cell_reuse_recompute_pass]: 2.70002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.333e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 8.04002e-06 [inline_without_move]: 5.19e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 1.13001e-06 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.561e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.7e-05 [rewriter_after_opt_a]: 3.854e-05 [convert_after_rewriter]: 8.17e-06 [order_py_execute_after_rewriter]: 6.16e-06 [mutable_eliminate]: 0.00078711 [jit_opt_b]: 5.86e-05, [1] [Cycle 1]: 4.95e-05, [2] [frontend_op_eliminate]: 1.975e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 2.584e-05 [loop_unroll]: 0.000523 [jit_opt_after_cconv]: 0.0001615, [1] [Cycle 1]: 0.00015421, [11] [c_1]: 2.371e-05 [parameter_eliminate]: 3.48e-06 [updatestate_depend_eliminate]: 6.02001e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [cse]: 2.202e-05 [call_graph_tuple_transform]: 2.398e-05 [tuple_list_get_item_eliminator]: 6.53e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 8.40024e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.825e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 7.93001e-06 [add_recomputation]: 5.075e-05 [cse_after_recomputation]: 2.697e-05, [1] [Cycle 1]: 2.002e-05, [1] [cse]: 1.284e-05 [auto_monad_reorder]: 1.863e-05 [get_jit_bprop_graph]: 2.57001e-06 [rewriter_after_jit_bprop_graph]: 6.16998e-06 [opt_after_jit_grad]: 0.00054981 [symbol_engine_optimizer]: 8.17e-05, [1] [Cycle 1]: 7.442e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 9.57999e-06 [elim_not_effective]: 1.536e-05 [opt_reshape]: 7.33999e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 8.49977e-07 [validate]: 4.397e-05 Sums bootstrap : 0.000378s : 2.56% type_inference : 0.009326s : 63.20% event_method : 0.000022s : 0.15% auto_monad : 0.000072s : 0.49% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000061s : 0.41% rewriter_before_opt_a : 0.000083s : 0.57% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000080s : 0.54% jit_opt_a.loop_unroll : 0.000039s : 0.26% jit_opt_a.a_1 : 0.000867s : 5.87% jit_opt_a.with_stream_mark : 0.000030s : 0.20% jit_opt_a.recompute_prepare : 0.000017s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000014s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000009s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001197s : 8.11% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.15% jit_opt_a.cse : 0.000039s : 0.26% jit_opt_a.replace_applicator : 0.000027s : 0.18% py_interpret_to_execute_after_opt_a : 0.000017s : 0.12% rewriter_after_opt_a : 0.000039s : 0.26% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000787s : 5.33% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000026s : 0.18% loop_unroll : 0.000523s : 3.54% jit_opt_after_cconv.c_1 : 0.000024s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000051s : 0.34% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000550s : 3.73% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.30% Time group info: ------[substitution.] 0.000304 27 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.28% : 0.000007s : 3: substitution.graph_param_transform 84.12% : 0.000255s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.40% : 0.000013s : 3: substitution.reduce_eliminate 1.46% : 0.000004s : 4: substitution.remove_not_recompute_node 1.40% : 0.000004s : 2: substitution.replace_old_param 3.59% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009248 2 85.98% : 0.007951s : 1: type_inference.infer 14.02% : 0.001297s : 1: type_inference.specialize ------[replace.] 0.000119 7 65.49% : 0.000078s : 5: replace.inline 34.51% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 96.28% : 0.000252s : 5: match.inline 3.72% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 11: predicate.addn_check_dump 1.75% : 0.000003s : 11: predicate.addn_zero_filter 2.86% : 0.000004s : 11: predicate.arithmetic_simplify 1.65% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000002s : 11: predicate.compare_switch_simplify 1.07% : 0.000002s : 11: predicate.depend_value_elim 1.40% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.00% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.16% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.74% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 16: predicate.load_eliminater 1.15% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 11: predicate.merge_addn 1.38% : 0.000002s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 2.24% : 0.000003s : 11: predicate.reduce_eliminate 1.72% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 19: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 11: predicate.reshape_eliminate 1.20% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.42% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 59: predicate.switch_simplify 1.55% : 0.000002s : 11: predicate.tile_eliminate 1.70% : 0.000002s : 11: predicate.transpose_eliminate 1.30% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.74% : 0.000003s : 11: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.44% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.79% : 0.000003s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001130 16 50.59% : 0.000572s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.79% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.62% : 0.000482s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021977 72 0.25% : 0.000054s : 1: add_recomputation 0.34% : 0.000075s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.79% : 0.000394s : 1: bootstrap 0.13% : 0.000029s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000029s : 1: cse_after_recomputation 0.05% : 0.000011s : 1: environ_conv 0.11% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.98% : 0.007028s : 1: jit_opt_a 0.75% : 0.000165s : 1: jit_opt_after_cconv 0.28% : 0.000061s : 1: jit_opt_b 2.42% : 0.000531s : 1: loop_unroll 3.62% : 0.000796s : 1: mutable_eliminate 5.10% : 0.001122s : 26: opt.transform.jit_opt_a 0.26% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000030s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.54% : 0.000558s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000064s : 1: py_interpret_to_execute 0.09% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000021s : 1: remove_dup_value 2.97% : 0.000653s : 1: renormalize.infer 2.43% : 0.000533s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000042s : 1: rewriter_after_opt_a 0.39% : 0.000087s : 1: rewriter_before_opt_a 0.38% : 0.000084s : 1: symbol_engine_optimizer 42.49% : 0.009338s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.894.416 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006fd30> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:37.895.180 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0369385, [30] [bootstrap]: 0.00034002 [type_inference]: 0.0252636 [event_method]: 2.12e-05 [auto_monad]: 7.434e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00017637 [rewriter_before_opt_a]: 8.767e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00712093, [2] [Cycle 1]: 0.00271771, [27] [switch_simplify]: 6.522e-05 [loop_unroll]: 3.096e-05 [a_1]: 0.00063863 [with_stream_mark]: 2.309e-05 [recompute_prepare]: 1.072e-05 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 2.93e-05 [accelerated_algorithm]: 7.02002e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.23998e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.641e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.54999e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00156474 [add_forward_monad_depend]: 8.00999e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.831e-05 [cse]: 3.306e-05 [replace_applicator]: 1.857e-05 [Cycle 2]: 0.00035938, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 5.34e-06 [a_1]: 0.00010206 [with_stream_mark]: 1.38e-05 [recompute_prepare]: 6.10002e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.98002e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.711e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 7.56001e-06 [inline_without_move]: 5.46e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.71998e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 7.98999e-06 [cse]: 1.303e-05 [replace_applicator]: 5.08002e-06 [py_interpret_to_execute_after_opt_a]: 1.492e-05 [rewriter_after_opt_a]: 4.032e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00075949 [jit_opt_b]: 5.798e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.942e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 2.822e-05 [loop_unroll]: 0.00048188 [jit_opt_after_cconv]: 0.00016373, [1] [Cycle 1]: 0.0001559, [11] [c_1]: 2.221e-05 [parameter_eliminate]: 4.53001e-06 [updatestate_depend_eliminate]: 9.05001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.88e-06 [cse]: 2.597e-05 [call_graph_tuple_transform]: 2.254e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.98002e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 6.03002e-06 [remove_dup_value]: 1.618e-05 [partial_unused_args_eliminate]: 2.99001e-06 [environ_conv]: 6.14999e-06 [add_recomputation]: 5.187e-05 [cse_after_recomputation]: 2.36e-05, [1] [Cycle 1]: 1.825e-05, [1] [cse]: 1.211e-05 [auto_monad_reorder]: 1.785e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00176728 [symbol_engine_optimizer]: 0.00014816, [1] [Cycle 1]: 0.00013947, [6] [build]: 5.34e-06 [elim_shapecalc]: 6.376e-05 [elim_not_effective]: 1.876e-05 [opt_reshape]: 7.78001e-06 [fold_const_symbol]: 1.18e-05 [renormalize]: 7.30011e-07 [validate]: 5.13e-05 Sums bootstrap : 0.000340s : 1.05% type_inference : 0.025264s : 78.30% event_method : 0.000021s : 0.07% auto_monad : 0.000074s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000176s : 0.55% rewriter_before_opt_a : 0.000088s : 0.27% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000741s : 2.30% jit_opt_a.with_stream_mark : 0.000037s : 0.11% jit_opt_a.recompute_prepare : 0.000017s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000034s : 0.11% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001565s : 4.85% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000046s : 0.14% jit_opt_a.replace_applicator : 0.000024s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000759s : 2.35% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000028s : 0.09% loop_unroll : 0.000482s : 1.49% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.001767s : 5.48% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000064s : 0.20% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.16% Time group info: ------[substitution.] 0.000270 23 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.88% : 0.000002s : 2: substitution.fold_const_symbol 2.64% : 0.000007s : 3: substitution.graph_param_transform 85.99% : 0.000233s : 4: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000005s : 2: substitution.replace_old_param 4.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025171 2 91.19% : 0.022954s : 1: type_inference.infer 8.81% : 0.002217s : 1: type_inference.specialize ------[replace.] 0.000089 6 65.75% : 0.000059s : 4: replace.inline 34.25% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 6 95.28% : 0.000230s : 4: match.inline 4.72% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.05% : 0.000001s : 10: predicate.accumulaten_eliminater 2.35% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.90% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000003s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 0.92% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.50% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.57% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.29% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.71% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.65% : 0.000002s : 10: predicate.environ_get_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.23% : 0.000002s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 4.88% : 0.000006s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 6: predicate.less_batch_normalization 1.99% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.52% : 0.000002s : 15: predicate.load_eliminater 1.15% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.52% : 0.000002s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.01% : 0.000004s : 16: predicate.switch_defer_inline 1.84% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.89% : 0.000003s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.62% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001171 13 41.76% : 0.000489s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.52% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.72% : 0.000629s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039629 72 0.14% : 0.000055s : 1: add_recomputation 0.20% : 0.000078s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.90% : 0.000356s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.98% : 0.007125s : 1: jit_opt_a 0.42% : 0.000166s : 1: jit_opt_after_cconv 0.15% : 0.000061s : 1: jit_opt_b 1.24% : 0.000490s : 1: loop_unroll 1.94% : 0.000769s : 1: mutable_eliminate 2.54% : 0.001005s : 26: opt.transform.jit_opt_a 0.13% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.09% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000098s : 4: opt.transform.symbol_engine_opt 4.49% : 0.001778s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000181s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.38% : 0.000942s : 1: renormalize.infer 1.54% : 0.000611s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.23% : 0.000091s : 1: rewriter_before_opt_a 0.38% : 0.000151s : 1: symbol_engine_optimizer 63.79% : 0.025280s : 1: type_inference TotalTime = 0.020815, [30] [bootstrap]: 0.00035446 [type_inference]: 0.00721338 [event_method]: 2.001e-05 [auto_monad]: 6.965e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 5.267e-05 [rewriter_before_opt_a]: 7.966e-05 [expand_dump_flag]: 2.74999e-06 [jit_opt_a]: 0.0101809, [2] [Cycle 1]: 0.00240118, [27] [switch_simplify]: 6.964e-05 [loop_unroll]: 3.066e-05 [a_1]: 0.00065619 [with_stream_mark]: 2.197e-05 [recompute_prepare]: 8.96002e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 7e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 1.098e-05 [inline_without_move]: 5.54e-06 [renormalize]: 0.00122689 [add_forward_monad_depend]: 9.19998e-06 [auto_monad_grad]: 2.85002e-06 [auto_monad_eliminator]: 1.852e-05 [cse]: 3.575e-05 [replace_applicator]: 2.198e-05 [Cycle 2]: 0.00039108, [27] [switch_simplify]: 7.7e-06 [loop_unroll]: 6.59999e-06 [a_1]: 0.00011434 [with_stream_mark]: 1.495e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 3.88001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.877e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 1.18001e-06 [auto_monad_eliminator]: 6.81001e-06 [cse]: 1.583e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.952e-05 [rewriter_after_opt_a]: 4.299e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00088273 [jit_opt_b]: 6.134e-05, [1] [Cycle 1]: 5.31e-05, [2] [frontend_op_eliminate]: 2.087e-05 [inline_after_opt_a]: 2.055e-05 [cconv]: 2.871e-05 [loop_unroll]: 0.00054895 [jit_opt_after_cconv]: 0.00018976, [1] [Cycle 1]: 0.00018191, [11] [c_1]: 2.436e-05 [parameter_eliminate]: 5.28002e-06 [updatestate_depend_eliminate]: 9.72999e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 3.25002e-06 [cse]: 3.808e-05 [call_graph_tuple_transform]: 2.488e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.97999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.36998e-06 [remove_dup_value]: 1.923e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 7.21001e-06 [add_recomputation]: 5.474e-05 [cse_after_recomputation]: 2.828e-05, [1] [Cycle 1]: 2.13e-05, [1] [cse]: 1.405e-05 [auto_monad_reorder]: 1.881e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 8.90001e-06 [opt_after_jit_grad]: 0.00058544 [symbol_engine_optimizer]: 8.384e-05, [1] [Cycle 1]: 7.64e-05, [6] [build]: 4.08001e-06 [elim_shapecalc]: 9.32001e-06 [elim_not_effective]: 1.57e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 1.022e-05 [renormalize]: 7.2e-07 [validate]: 4.406e-05 Sums bootstrap : 0.000354s : 2.78% type_inference : 0.007213s : 56.50% event_method : 0.000020s : 0.16% auto_monad : 0.000070s : 0.55% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000053s : 0.41% rewriter_before_opt_a : 0.000080s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.61% jit_opt_a.loop_unroll : 0.000037s : 0.29% jit_opt_a.a_1 : 0.000771s : 6.04% jit_opt_a.with_stream_mark : 0.000037s : 0.29% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001227s : 9.61% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.20% jit_opt_a.cse : 0.000052s : 0.40% jit_opt_a.replace_applicator : 0.000027s : 0.21% py_interpret_to_execute_after_opt_a : 0.000020s : 0.15% rewriter_after_opt_a : 0.000043s : 0.34% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000883s : 6.91% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.16% jit_opt_b.inline_after_opt_a : 0.000021s : 0.16% cconv : 0.000029s : 0.22% loop_unroll : 0.000549s : 4.30% jit_opt_after_cconv.c_1 : 0.000024s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000038s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000055s : 0.43% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000009s : 0.07% opt_after_jit_grad : 0.000585s : 4.59% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.35% Time group info: ------[substitution.] 0.000295 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.25% : 0.000007s : 3: substitution.graph_param_transform 85.69% : 0.000253s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000006s : 2: substitution.replace_old_param 4.94% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007127 2 84.13% : 0.005996s : 1: type_inference.infer 15.87% : 0.001131s : 1: type_inference.specialize ------[replace.] 0.000088 6 68.97% : 0.000061s : 4: replace.inline 31.03% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 6 94.93% : 0.000250s : 4: match.inline 5.07% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 2.27% : 0.000003s : 10: predicate.arithmetic_simplify 1.09% : 0.000002s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.32% : 0.000002s : 10: predicate.compare_switch_simplify 1.14% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.99% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 0.98% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000002s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000007s : 22: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.45% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.40% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.32% : 0.000002s : 10: predicate.merge_addn 1.22% : 0.000002s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000002s : 10: predicate.print_const_string_wrapper 2.02% : 0.000003s : 10: predicate.reduce_eliminate 1.73% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000002s : 10: predicate.reshape_eliminate 1.60% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 6: predicate.special_op_eliminate 0.78% : 0.000001s : 6: predicate.specialize_transform 1.22% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000011s : 53: predicate.switch_simplify 1.53% : 0.000002s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.97% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.44% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000910 13 49.80% : 0.000453s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.30% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.90% : 0.000399s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023137 72 0.25% : 0.000058s : 1: add_recomputation 0.31% : 0.000073s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.60% : 0.000370s : 1: bootstrap 0.13% : 0.000031s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000030s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.11% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 44.02% : 0.010185s : 1: jit_opt_a 0.83% : 0.000193s : 1: jit_opt_after_cconv 0.28% : 0.000064s : 1: jit_opt_b 2.41% : 0.000558s : 1: loop_unroll 3.86% : 0.000893s : 1: mutable_eliminate 4.44% : 0.001026s : 26: opt.transform.jit_opt_a 0.25% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000032s : 4: opt.transform.jit_opt_b 0.07% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000019s : 1: opt.transform.mutable_eliminate 0.11% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.56% : 0.000593s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000056s : 1: py_interpret_to_execute 0.10% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000022s : 1: remove_dup_value 2.49% : 0.000576s : 1: renormalize.infer 2.77% : 0.000640s : 1: renormalize.specialize 0.05% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000046s : 1: rewriter_after_opt_a 0.36% : 0.000083s : 1: rewriter_before_opt_a 0.37% : 0.000087s : 1: symbol_engine_optimizer 31.26% : 0.007233s : 1: type_inference TotalTime = 0.221884, [30] [bootstrap]: 0.00033571 [type_inference]: 0.180711 [event_method]: 2.575e-05 [auto_monad]: 8.459e-05 [graph_reusing]: 6.81999e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.00045104 [rewriter_before_opt_a]: 0.000103 [expand_dump_flag]: 4.21001e-06 [jit_opt_a]: 0.0371892, [2] [Cycle 1]: 0.0325637, [27] [switch_simplify]: 7.115e-05 [loop_unroll]: 3.029e-05 [a_1]: 0.0288719 [with_stream_mark]: 3.861e-05 [recompute_prepare]: 1.518e-05 [updatestate_depend_eliminate]: 5.42999e-06 [updatestate_assign_eliminate]: 3.89002e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.53998e-06 [specialize_transform]: 8.15e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 8.16002e-06 [meta_shard_fg_expand]: 3.68e-06 [get_grad_eliminate_]: 7.33999e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 3.55e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.743e-05 [j_node_and_user_rematch]: 1.257e-05 [meta_fg_expand]: 3.08e-06 [replace_old_param]: 1.423e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.003064 [add_forward_monad_depend]: 1.022e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.468e-05 [cse]: 3.801e-05 [replace_applicator]: 2.38e-05 [Cycle 2]: 0.00042072, [27] [switch_simplify]: 7.14001e-06 [loop_unroll]: 6.89001e-06 [a_1]: 0.00014689 [with_stream_mark]: 1.607e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 4.00998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 3.06001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.969e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 3.21001e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 5.90002e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.99e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 6.95002e-06 [cse]: 1.561e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.78e-05 [rewriter_after_opt_a]: 4.181e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00085045 [jit_opt_b]: 6.464e-05, [1] [Cycle 1]: 5.549e-05, [2] [frontend_op_eliminate]: 2.289e-05 [inline_after_opt_a]: 1.977e-05 [cconv]: 3.388e-05 [loop_unroll]: 0.00055485 [jit_opt_after_cconv]: 0.00024062, [1] [Cycle 1]: 0.0002327, [11] [c_1]: 2.931e-05 [parameter_eliminate]: 4.19002e-06 [updatestate_depend_eliminate]: 7.98001e-06 [updatestate_assign_eliminate]: 5.09e-05 [updatestate_loads_eliminate]: 3.70998e-06 [cse]: 3.574e-05 [call_graph_tuple_transform]: 2.687e-05 [tuple_list_get_item_eliminator]: 6.51999e-06 [none_parameter_eliminate]: 2.38998e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 7.1e-06 [remove_dup_value]: 1.753e-05 [partial_unused_args_eliminate]: 3.45e-06 [environ_conv]: 1.03e-05 [add_recomputation]: 6.016e-05 [cse_after_recomputation]: 2.492e-05, [1] [Cycle 1]: 1.875e-05, [1] [cse]: 1.327e-05 [auto_monad_reorder]: 1.584e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 7.71001e-06 [opt_after_jit_grad]: 0.00059756 [symbol_engine_optimizer]: 8.621e-05, [1] [Cycle 1]: 7.76e-05, [6] [build]: 5.15999e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.711e-05 [opt_reshape]: 8.18001e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 6.80011e-07 [validate]: 9.745e-05 Sums bootstrap : 0.000336s : 0.15% type_inference : 0.180711s : 83.30% event_method : 0.000026s : 0.01% auto_monad : 0.000085s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000451s : 0.21% rewriter_before_opt_a : 0.000103s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.04% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.029019s : 13.38% jit_opt_a.with_stream_mark : 0.000055s : 0.03% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003064s : 1.41% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000054s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000850s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000555s : 0.26% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000051s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000598s : 0.28% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000097s : 0.04% Time group info: ------[substitution.] 0.000290 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000008s : 4: substitution.graph_param_transform 81.35% : 0.000236s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000006s : 4: substitution.remove_not_recompute_node 3.24% : 0.000009s : 2: substitution.replace_old_param 7.38% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.180587 2 98.68% : 0.178199s : 1: type_inference.infer 1.32% : 0.002387s : 1: type_inference.specialize ------[replace.] 0.000141 6 40.32% : 0.000057s : 4: replace.inline 59.68% : 0.000084s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 6 92.78% : 0.000233s : 4: match.inline 7.22% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000182 830 1.41% : 0.000003s : 12: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 0.86% : 0.000002s : 12: predicate.compare_switch_simplify 0.97% : 0.000002s : 12: predicate.depend_value_elim 0.91% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.99% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.91% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.87% : 0.000002s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 0.92% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.87% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 6.27% : 0.000011s : 26: predicate.inline 0.69% : 0.000001s : 8: predicate.inline_without_move 0.33% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.49% : 0.000003s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.84% : 0.000005s : 16: predicate.make_slice_get_slice_eliminator 0.86% : 0.000002s : 12: predicate.merge_addn 0.98% : 0.000002s : 12: predicate.minmaximum_grad 1.52% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 1.80% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 9.64% : 0.000018s : 12: predicate.reduce_eliminate 1.02% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.58% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.09% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.46% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000002s : 8: predicate.specialize_transform 1.21% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.67% : 0.000005s : 18: predicate.switch_defer_inline 1.88% : 0.000003s : 18: predicate.switch_layer_defer_inline 5.91% : 0.000011s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.14% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 6.86% : 0.000012s : 22: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.29% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.22% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000003s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003213 30 67.51% : 0.002169s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.62% : 0.000984s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.254276 72 0.02% : 0.000063s : 1: add_recomputation 0.04% : 0.000090s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.14% : 0.000357s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 14.63% : 0.037194s : 1: jit_opt_a 0.10% : 0.000244s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.22% : 0.000565s : 1: loop_unroll 0.34% : 0.000866s : 1: mutable_eliminate 11.52% : 0.029298s : 26: opt.transform.jit_opt_a 0.03% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000608s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000462s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.79% : 0.002004s : 1: renormalize.infer 0.41% : 0.001045s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.04% : 0.000110s : 1: rewriter_before_opt_a 0.03% : 0.000089s : 1: symbol_engine_optimizer 71.08% : 0.180739s : 1: type_inference TotalTime = 0.0383951, [30] [bootstrap]: 0.00035894 [type_inference]: 0.0271821 [event_method]: 2.898e-05 [auto_monad]: 8.434e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.0002192 [rewriter_before_opt_a]: 9.874e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00763095, [2] [Cycle 1]: 0.00292624, [27] [switch_simplify]: 6.772e-05 [loop_unroll]: 3.08e-05 [a_1]: 0.0006684 [with_stream_mark]: 2.231e-05 [recompute_prepare]: 1.114e-05 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.87002e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 5.66003e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 4.13001e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.74e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 1.05e-05 [meta_fg_expand]: 3.13e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.74999e-06 [renormalize]: 0.00171165 [add_forward_monad_depend]: 7.9e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 3.677e-05 [replace_applicator]: 4.932e-05 [Cycle 2]: 0.00038909, [27] [switch_simplify]: 6.95998e-06 [loop_unroll]: 6.19001e-06 [a_1]: 0.0001108 [with_stream_mark]: 1.562e-05 [recompute_prepare]: 6.94999e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 5.58002e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 3.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 8.59998e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 7.97e-06 [cse]: 1.752e-05 [replace_applicator]: 6.98998e-06 [py_interpret_to_execute_after_opt_a]: 1.403e-05 [rewriter_after_opt_a]: 4.036e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.74e-06 [mutable_eliminate]: 0.00080132 [jit_opt_b]: 6.573e-05, [1] [Cycle 1]: 5.682e-05, [2] [frontend_op_eliminate]: 2.21e-05 [inline_after_opt_a]: 2.162e-05 [cconv]: 3.199e-05 [loop_unroll]: 0.00053108 [jit_opt_after_cconv]: 0.0001845, [1] [Cycle 1]: 0.00017645, [11] [c_1]: 2.37e-05 [parameter_eliminate]: 4.47e-06 [updatestate_depend_eliminate]: 1.012e-05 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.98e-06 [cse]: 3.604e-05 [call_graph_tuple_transform]: 2.715e-05 [tuple_list_get_item_eliminator]: 5.78997e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 8.81002e-06 [remove_dup_value]: 1.708e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 7.53e-06 [add_recomputation]: 5.498e-05 [cse_after_recomputation]: 2.635e-05, [1] [Cycle 1]: 2.085e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.769e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 7.15e-06 [opt_after_jit_grad]: 0.00057057 [symbol_engine_optimizer]: 0.00014997, [1] [Cycle 1]: 0.00014208, [6] [build]: 4.33001e-06 [elim_shapecalc]: 8.80001e-06 [elim_not_effective]: 1.306e-05 [opt_reshape]: 7.073e-05 [fold_const_symbol]: 1.238e-05 [renormalize]: 6.10016e-07 [validate]: 4.559e-05 Sums bootstrap : 0.000359s : 1.07% type_inference : 0.027182s : 81.32% event_method : 0.000029s : 0.09% auto_monad : 0.000084s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000219s : 0.66% rewriter_before_opt_a : 0.000099s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.22% jit_opt_a.loop_unroll : 0.000037s : 0.11% jit_opt_a.a_1 : 0.000779s : 2.33% jit_opt_a.with_stream_mark : 0.000038s : 0.11% jit_opt_a.recompute_prepare : 0.000018s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001712s : 5.12% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000054s : 0.16% jit_opt_a.replace_applicator : 0.000056s : 0.17% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000801s : 2.40% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.07% jit_opt_b.inline_after_opt_a : 0.000022s : 0.06% cconv : 0.000032s : 0.10% loop_unroll : 0.000531s : 1.59% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.03% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000055s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000571s : 1.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000071s : 0.21% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.14% Time group info: ------[substitution.] 0.000285 23 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000007s : 3: substitution.graph_param_transform 86.39% : 0.000246s : 4: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000006s : 4: substitution.remove_not_recompute_node 1.72% : 0.000005s : 2: substitution.replace_old_param 4.68% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026818 2 90.09% : 0.024160s : 1: type_inference.infer 9.91% : 0.002658s : 1: type_inference.specialize ------[replace.] 0.000099 6 66.35% : 0.000066s : 4: replace.inline 33.65% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 95.21% : 0.000243s : 4: match.inline 4.79% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 691 1.00% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.92% : 0.000001s : 10: predicate.addn_check_dump 2.12% : 0.000003s : 10: predicate.addn_zero_filter 2.34% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.80% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.18% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.48% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.29% : 0.000003s : 3: predicate.mutable_eliminate 0.95% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000003s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000001s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.02% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.38% : 0.000002s : 3: predicate.row_tensor_eliminate 1.58% : 0.000002s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.81% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.86% : 0.000004s : 16: predicate.switch_defer_inline 1.81% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.09% : 0.000010s : 53: predicate.switch_simplify 1.11% : 0.000002s : 10: predicate.tile_eliminate 1.73% : 0.000002s : 10: predicate.transpose_eliminate 1.60% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.23% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.34% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001357 13 41.85% : 0.000568s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.38% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.77% : 0.000730s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041305 72 0.14% : 0.000058s : 1: add_recomputation 0.21% : 0.000088s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.91% : 0.000376s : 1: bootstrap 0.08% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.08% : 0.000033s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 18.49% : 0.007636s : 1: jit_opt_a 0.45% : 0.000187s : 1: jit_opt_after_cconv 0.17% : 0.000069s : 1: jit_opt_b 1.30% : 0.000539s : 1: loop_unroll 1.97% : 0.000813s : 1: mutable_eliminate 2.57% : 0.001062s : 26: opt.transform.jit_opt_a 0.15% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000035s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000022s : 1: opt.transform.mutable_eliminate 0.06% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000102s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000578s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.54% : 0.000223s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.40% : 0.000992s : 1: renormalize.infer 1.71% : 0.000707s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000102s : 1: rewriter_before_opt_a 0.37% : 0.000153s : 1: symbol_engine_optimizer 65.85% : 0.027199s : 1: type_inference TotalTime = 0.0268684, [30] [bootstrap]: 0.00032795 [type_inference]: 0.00482621 [event_method]: 1.781e-05 [auto_monad]: 6.326e-05 [graph_reusing]: 5.52999e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 3.192e-05 [rewriter_before_opt_a]: 0.012755 [expand_dump_flag]: 5.77001e-06 [jit_opt_a]: 0.00634039, [2] [Cycle 1]: 0.00195719, [27] [switch_simplify]: 6.678e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00062639 [with_stream_mark]: 2.38e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 4.99998e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.13998e-06 [replace_old_param]: 1.013e-05 [inline_without_move]: 5.26002e-06 [renormalize]: 0.00083076 [add_forward_monad_depend]: 7.33999e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 3.88e-05 [replace_applicator]: 1.552e-05 [Cycle 2]: 0.0003417, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 4.99e-06 [a_1]: 8.875e-05 [with_stream_mark]: 1.179e-05 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 3.56001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.74002e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 4.79998e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 7.91001e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 8.07e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 1.75001e-06 [auto_monad_eliminator]: 7.15003e-06 [cse]: 1.515e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.482e-05 [rewriter_after_opt_a]: 4.03e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00071426 [jit_opt_b]: 5.061e-05, [1] [Cycle 1]: 4.247e-05, [2] [frontend_op_eliminate]: 1.601e-05 [inline_after_opt_a]: 1.5e-05 [cconv]: 3.119e-05 [loop_unroll]: 0.00046459 [jit_opt_after_cconv]: 0.00016606, [1] [Cycle 1]: 0.00015847, [11] [c_1]: 2.057e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 3.081e-05 [call_graph_tuple_transform]: 2.081e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.669e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 5.425e-05 [cse_after_recomputation]: 2.629e-05, [1] [Cycle 1]: 2.074e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 6.62002e-06 [opt_after_jit_grad]: 0.0005193 [symbol_engine_optimizer]: 7.611e-05, [1] [Cycle 1]: 6.888e-05, [6] [build]: 5.42001e-06 [elim_shapecalc]: 8.16002e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 5.47999e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 6.39993e-07 [validate]: 4.35e-05 Sums bootstrap : 0.000328s : 1.48% type_inference : 0.004826s : 21.80% event_method : 0.000018s : 0.08% auto_monad : 0.000063s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000032s : 0.14% rewriter_before_opt_a : 0.012755s : 57.60% expand_dump_flag : 0.000006s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.33% jit_opt_a.loop_unroll : 0.000035s : 0.16% jit_opt_a.a_1 : 0.000715s : 3.23% jit_opt_a.with_stream_mark : 0.000036s : 0.16% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000831s : 3.75% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.11% jit_opt_a.cse : 0.000054s : 0.24% jit_opt_a.replace_applicator : 0.000022s : 0.10% py_interpret_to_execute_after_opt_a : 0.000015s : 0.07% rewriter_after_opt_a : 0.000040s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000714s : 3.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000015s : 0.07% cconv : 0.000031s : 0.14% loop_unroll : 0.000465s : 2.10% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000054s : 0.24% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000519s : 2.35% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.20% Time group info: ------[substitution.] 0.000286 23 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 3: substitution.graph_param_transform 87.06% : 0.000249s : 4: substitution.inline 1.16% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 4.77% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004760 2 83.30% : 0.003965s : 1: type_inference.infer 16.70% : 0.000795s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.64% : 0.000052s : 4: replace.inline 31.36% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 6 95.17% : 0.000247s : 4: match.inline 4.83% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.66% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.36% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.76% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.87% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.17% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000000s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.97% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.92% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000618 13 53.99% : 0.000334s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.12% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.89% : 0.000247s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028689 72 0.20% : 0.000058s : 1: add_recomputation 0.23% : 0.000066s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.22% : 0.000350s : 1: bootstrap 0.12% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.04% : 0.000011s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 22.11% : 0.006344s : 1: jit_opt_a 0.59% : 0.000169s : 1: jit_opt_after_cconv 0.19% : 0.000053s : 1: jit_opt_b 1.65% : 0.000474s : 1: loop_unroll 2.53% : 0.000725s : 1: mutable_eliminate 3.29% : 0.000944s : 26: opt.transform.jit_opt_a 0.17% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.85% : 0.000531s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000034s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 1.77% : 0.000509s : 1: renormalize.infer 1.09% : 0.000313s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000043s : 1: rewriter_after_opt_a 44.55% : 0.012782s : 1: rewriter_before_opt_a 0.28% : 0.000079s : 1: symbol_engine_optimizer 16.89% : 0.004845s : 1: type_inference TotalTime = 0.120421, [30] [bootstrap]: 0.00027943 [type_inference]: 0.0872834 [event_method]: 0.00029395 [auto_monad]: 0.00010618 [graph_reusing]: 7.62002e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 3.587e-05 [rewriter_before_opt_a]: 0.00013004 [expand_dump_flag]: 3.92002e-06 [jit_opt_a]: 0.0297393, [3] [Cycle 1]: 0.0176603, [27] [switch_simplify]: 7.662e-05 [loop_unroll]: 4.954e-05 [a_1]: 0.00103181 [with_stream_mark]: 3.264e-05 [recompute_prepare]: 2.328e-05 [updatestate_depend_eliminate]: 9.39e-06 [updatestate_assign_eliminate]: 7.35e-06 [updatestate_loads_eliminate]: 7.11999e-06 [parameter_eliminate]: 2.91999e-06 [specialize_transform]: 1.611e-05 [updatestate_useless_node_eliminater]: 1.412e-05 [accelerated_algorithm]: 1.484e-05 [meta_shard_fg_expand]: 3.91999e-06 [get_grad_eliminate_]: 1.486e-05 [merge_forward]: 8.92e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.896e-05 [j_node_and_user_rematch]: 2.487e-05 [meta_fg_expand]: 0.00188216 [replace_old_param]: 7.219e-05 [inline_without_move]: 6.398e-05 [renormalize]: 0.0135455 [add_forward_monad_depend]: 1.376e-05 [auto_monad_grad]: 6.85998e-06 [auto_monad_eliminator]: 6.486e-05 [cse]: 0.0002768 [replace_applicator]: 9.635e-05 [Cycle 2]: 0.0082004, [27] [switch_simplify]: 4.433e-05 [loop_unroll]: 4.332e-05 [a_1]: 0.00128581 [with_stream_mark]: 1.905e-05 [recompute_prepare]: 1.103e-05 [updatestate_depend_eliminate]: 5.24998e-06 [updatestate_assign_eliminate]: 3.89002e-06 [updatestate_loads_eliminate]: 4.35e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.42002e-06 [updatestate_useless_node_eliminater]: 7.48e-06 [accelerated_algorithm]: 7.33999e-06 [meta_shard_fg_expand]: 2.46998e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 4.63001e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.764e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 0.00011143 [replace_old_param]: 9.29998e-06 [inline_without_move]: 7.03e-06 [renormalize]: 0.00628693 [add_forward_monad_depend]: 1.094e-05 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.309e-05 [cse]: 3.55e-05 [replace_applicator]: 2.583e-05 [Cycle 3]: 0.00041741, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 5.30001e-06 [a_1]: 7.93e-05 [with_stream_mark]: 1.486e-05 [recompute_prepare]: 4.77e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 3.00002e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 4.45999e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 2.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.876e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 4.48999e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 8.40024e-07 [auto_monad_eliminator]: 6.38003e-06 [cse]: 1.214e-05 [replace_applicator]: 8.102e-05 [py_interpret_to_execute_after_opt_a]: 1.563e-05 [rewriter_after_opt_a]: 3.93e-05 [convert_after_rewriter]: 6.64001e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00078513 [jit_opt_b]: 5.286e-05, [1] [Cycle 1]: 4.43e-05, [2] [frontend_op_eliminate]: 1.554e-05 [inline_after_opt_a]: 1.663e-05 [cconv]: 2.834e-05 [loop_unroll]: 0.00045032 [jit_opt_after_cconv]: 0.00015721, [1] [Cycle 1]: 0.00014989, [11] [c_1]: 1.898e-05 [parameter_eliminate]: 3.72002e-06 [updatestate_depend_eliminate]: 7.21999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.773e-05 [call_graph_tuple_transform]: 1.89e-05 [tuple_list_get_item_eliminator]: 5.30999e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 4.75001e-06 [remove_dup_value]: 1.759e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 7.06001e-06 [add_recomputation]: 0.00010061 [cse_after_recomputation]: 3.195e-05, [1] [Cycle 1]: 2.559e-05, [1] [cse]: 1.739e-05 [auto_monad_reorder]: 1.661e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 6.62002e-06 [opt_after_jit_grad]: 0.00048982 [symbol_engine_optimizer]: 7.772e-05, [1] [Cycle 1]: 7.085e-05, [6] [build]: 4.54998e-06 [elim_shapecalc]: 7.6e-06 [elim_not_effective]: 1.216e-05 [opt_reshape]: 6.11e-06 [fold_const_symbol]: 9.52001e-06 [renormalize]: 5.29981e-07 [validate]: 4.013e-05 Sums bootstrap : 0.000279s : 0.24% type_inference : 0.087283s : 75.23% event_method : 0.000294s : 0.25% auto_monad : 0.000106s : 0.09% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000036s : 0.03% rewriter_before_opt_a : 0.000130s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000127s : 0.11% jit_opt_a.loop_unroll : 0.000098s : 0.08% jit_opt_a.a_1 : 0.002397s : 2.07% jit_opt_a.with_stream_mark : 0.000067s : 0.06% jit_opt_a.recompute_prepare : 0.000039s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000065s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.04% jit_opt_a.meta_fg_expand : 0.001996s : 1.72% jit_opt_a.replace_old_param : 0.000086s : 0.07% jit_opt_a.inline_without_move : 0.000076s : 0.07% jit_opt_a.renormalize : 0.019832s : 17.09% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000094s : 0.08% jit_opt_a.cse : 0.000324s : 0.28% jit_opt_a.replace_applicator : 0.000203s : 0.18% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000785s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000450s : 0.39% jit_opt_after_cconv.c_1 : 0.000019s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000101s : 0.09% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000490s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000599 109 0.31% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000002s : 2: substitution.fold_const_symbol 0.87% : 0.000005s : 2: substitution.graph_param_transform 65.21% : 0.000391s : 13: substitution.inline 2.97% : 0.000018s : 2: substitution.inline_without_move 1.65% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.01% : 0.000012s : 7: substitution.minmaximum_grad 1.48% : 0.000009s : 5: substitution.partial_eliminate 1.96% : 0.000012s : 13: substitution.remove_not_recompute_node 5.66% : 0.000034s : 10: substitution.replace_applicator 1.28% : 0.000008s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.20% : 0.000007s : 1: substitution.tile_eliminate 3.94% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.80% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.84% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.087179 2 97.18% : 0.084722s : 1: type_inference.infer 2.82% : 0.002457s : 1: type_inference.specialize ------[replace.] 0.000190 20 64.17% : 0.000122s : 13: replace.inline 35.83% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000405 20 94.36% : 0.000383s : 13: match.inline 5.64% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000408 2740 1.52% : 0.000006s : 47: predicate.accumulaten_eliminater 0.33% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.41% : 0.000006s : 47: predicate.addn_check_dump 1.61% : 0.000007s : 47: predicate.addn_zero_filter 1.87% : 0.000008s : 47: predicate.arithmetic_simplify 1.52% : 0.000006s : 47: predicate.cast_eliminate 0.10% : 0.000000s : 2: predicate.check_bprop_eliminate 1.39% : 0.000006s : 47: predicate.compare_switch_simplify 1.45% : 0.000006s : 47: predicate.depend_value_elim 1.37% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.63% : 0.000007s : 47: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.18% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.38% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.38% : 0.000006s : 47: predicate.environ_get_depend_swap 1.45% : 0.000006s : 47: predicate.environ_get_eliminate 1.39% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.86% : 0.000004s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.44% : 0.000018s : 71: predicate.inline 1.96% : 0.000008s : 47: predicate.inline_without_move 0.34% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.03% : 0.000004s : 19: predicate.less_batch_normalization 1.72% : 0.000007s : 54: predicate.list_to_tuple_eliminator_ 1.80% : 0.000007s : 56: predicate.load_eliminater 0.36% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.43% : 0.000014s : 100: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.40% : 0.000006s : 47: predicate.merge_addn 1.53% : 0.000006s : 47: predicate.minmaximum_grad 2.49% : 0.000010s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.32% : 0.000009s : 56: predicate.partial_eliminate 1.46% : 0.000006s : 47: predicate.print_const_string_wrapper 1.99% : 0.000008s : 47: predicate.reduce_eliminate 1.79% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000002s : 19: predicate.remove_not_recompute_node 2.74% : 0.000011s : 102: predicate.replace_applicator 1.08% : 0.000004s : 47: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.54% : 0.000006s : 47: predicate.reshape_eliminate 1.57% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 2: predicate.row_tensor_eliminate 1.56% : 0.000006s : 47: predicate.same_eliminate 0.42% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 4: predicate.special_op_eliminate 0.83% : 0.000003s : 19: predicate.specialize_transform 1.78% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.61% : 0.000007s : 47: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.79% : 0.000011s : 67: predicate.switch_defer_inline 2.51% : 0.000010s : 67: predicate.switch_layer_defer_inline 6.19% : 0.000025s : 169: predicate.switch_simplify 1.53% : 0.000006s : 47: predicate.tile_eliminate 1.47% : 0.000006s : 47: predicate.transpose_eliminate 1.79% : 0.000007s : 47: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000014s : 58: predicate.tuple_list_get_item_eliminator 1.85% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.86% : 0.000008s : 54: predicate.tuple_to_list_eliminator_ 1.71% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.70% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.86% : 0.000008s : 47: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005579 52 80.48% : 0.004490s : 35: func_graph_cloner_run.FuncGraphClonerGraph 19.52% : 0.001089s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143476 87 0.07% : 0.000106s : 1: add_recomputation 0.08% : 0.000113s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.21% : 0.000303s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000035s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.21% : 0.000302s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 20.73% : 0.029743s : 1: jit_opt_a 0.11% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.32% : 0.000458s : 1: loop_unroll 0.55% : 0.000795s : 1: mutable_eliminate 2.22% : 0.003189s : 39: opt.transform.jit_opt_a 0.03% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000039s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 12.06% : 0.017306s : 2: renormalize.infer 1.74% : 0.002499s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000134s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 60.85% : 0.087303s : 1: type_inference TotalTime = 0.0362725, [30] [bootstrap]: 0.00036372 [type_inference]: 0.0254416 [event_method]: 2.429e-05 [auto_monad]: 7.519e-05 [graph_reusing]: 5.75001e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00018849 [rewriter_before_opt_a]: 9.169e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.0073735, [2] [Cycle 1]: 0.00279519, [27] [switch_simplify]: 6.731e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00060767 [with_stream_mark]: 2.139e-05 [recompute_prepare]: 9.04e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 7.72002e-06 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 6.41998e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.746e-05 [j_node_and_user_rematch]: 1.226e-05 [meta_fg_expand]: 3.36999e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 7.44002e-06 [renormalize]: 0.00167491 [add_forward_monad_depend]: 8.61002e-06 [auto_monad_grad]: 2.97002e-06 [auto_monad_eliminator]: 1.643e-05 [cse]: 3.353e-05 [replace_applicator]: 2.134e-05 [Cycle 2]: 0.0003814, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 5.74999e-06 [a_1]: 0.0001112 [with_stream_mark]: 1.411e-05 [recompute_prepare]: 7.11001e-06 [updatestate_depend_eliminate]: 3.62002e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 2.03002e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 4.24002e-06 [cell_reuse_recompute_pass]: 2.89999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.734e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 2.71999e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.83e-06 [cse]: 1.537e-05 [replace_applicator]: 6.24001e-06 [py_interpret_to_execute_after_opt_a]: 1.477e-05 [rewriter_after_opt_a]: 4.002e-05 [convert_after_rewriter]: 8.55001e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00075191 [jit_opt_b]: 5.817e-05, [1] [Cycle 1]: 4.97e-05, [2] [frontend_op_eliminate]: 1.998e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 3.136e-05 [loop_unroll]: 0.00050596 [jit_opt_after_cconv]: 0.00017041, [1] [Cycle 1]: 0.00016402, [11] [c_1]: 2.442e-05 [parameter_eliminate]: 3.75998e-06 [updatestate_depend_eliminate]: 7.05002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.382e-05 [call_graph_tuple_transform]: 2.304e-05 [tuple_list_get_item_eliminator]: 6.20002e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 3.33e-06 [environ_conv]: 6.16998e-06 [add_recomputation]: 5.106e-05 [cse_after_recomputation]: 2.385e-05, [1] [Cycle 1]: 1.848e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.896e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 4.74998e-06 [opt_after_jit_grad]: 0.00065915 [symbol_engine_optimizer]: 9.1e-05, [1] [Cycle 1]: 8.332e-05, [6] [build]: 4.34997e-06 [elim_shapecalc]: 9.92999e-06 [elim_not_effective]: 1.812e-05 [opt_reshape]: 8.16002e-06 [fold_const_symbol]: 1.17e-05 [renormalize]: 4.00003e-07 [validate]: 4.362e-05 Sums bootstrap : 0.000364s : 1.16% type_inference : 0.025442s : 80.92% event_method : 0.000024s : 0.08% auto_monad : 0.000075s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000188s : 0.60% rewriter_before_opt_a : 0.000092s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000719s : 2.29% jit_opt_a.with_stream_mark : 0.000036s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000015s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.07% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000013s : 0.04% jit_opt_a.renormalize : 0.001675s : 5.33% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000049s : 0.16% jit_opt_a.replace_applicator : 0.000028s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.13% convert_after_rewriter : 0.000009s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000752s : 2.39% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000031s : 0.10% loop_unroll : 0.000506s : 1.61% jit_opt_after_cconv.c_1 : 0.000024s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000659s : 2.10% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.14% Time group info: ------[substitution.] 0.000240 23 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 3.12% : 0.000007s : 3: substitution.graph_param_transform 83.27% : 0.000200s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000004s : 2: substitution.replace_old_param 6.00% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025340 2 89.51% : 0.022681s : 1: type_inference.infer 10.49% : 0.002659s : 1: type_inference.specialize ------[replace.] 0.000090 6 68.38% : 0.000062s : 4: replace.inline 31.62% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 93.73% : 0.000197s : 4: match.inline 6.27% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 691 1.09% : 0.000002s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000003s : 10: predicate.arithmetic_simplify 1.60% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 0.98% : 0.000001s : 10: predicate.depend_value_elim 0.95% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.99% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.91% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000002s : 10: predicate.environ_get_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 4.55% : 0.000006s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.51% : 0.000001s : 6: predicate.j_node_and_user_rematch 2.24% : 0.000003s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 15: predicate.load_eliminater 1.15% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.31% : 0.000002s : 10: predicate.minmaximum_grad 2.50% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000002s : 10: predicate.print_const_string_wrapper 1.99% : 0.000003s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.60% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.24% : 0.000002s : 6: predicate.specialize_transform 1.65% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.37% : 0.000010s : 53: predicate.switch_simplify 1.41% : 0.000002s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.96% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 0.92% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001276 13 40.71% : 0.000519s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.39% : 0.000719s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039057 72 0.14% : 0.000055s : 1: add_recomputation 0.20% : 0.000079s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.98% : 0.000382s : 1: bootstrap 0.09% : 0.000034s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.89% : 0.007377s : 1: jit_opt_a 0.44% : 0.000173s : 1: jit_opt_after_cconv 0.16% : 0.000061s : 1: jit_opt_b 1.32% : 0.000514s : 1: loop_unroll 1.95% : 0.000763s : 1: mutable_eliminate 2.51% : 0.000979s : 26: opt.transform.jit_opt_a 0.14% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000021s : 1: opt.transform.mutable_eliminate 0.22% : 0.000087s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.71% : 0.000669s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.49% : 0.000193s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.49% : 0.000973s : 1: renormalize.infer 1.77% : 0.000690s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000044s : 1: rewriter_after_opt_a 0.24% : 0.000095s : 1: rewriter_before_opt_a 0.24% : 0.000094s : 1: symbol_engine_optimizer 65.18% : 0.025457s : 1: type_inference TotalTime = 0.0426983, [30] [bootstrap]: 0.00032846 [type_inference]: 0.0290062 [event_method]: 2.211e-05 [auto_monad]: 7.835e-05 [graph_reusing]: 5.34e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.00015882 [rewriter_before_opt_a]: 9.242e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00875779, [2] [Cycle 1]: 0.00378428, [27] [switch_simplify]: 6.779e-05 [loop_unroll]: 3.061e-05 [a_1]: 0.00064581 [with_stream_mark]: 2.095e-05 [recompute_prepare]: 9.84001e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 3.17002e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.879e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.70997e-06 [replace_old_param]: 1.121e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00258944 [add_forward_monad_depend]: 1.204e-05 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 2.321e-05 [cse]: 4.143e-05 [replace_applicator]: 2.444e-05 [Cycle 2]: 0.00042214, [27] [switch_simplify]: 6.92002e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012969 [with_stream_mark]: 1.775e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 7.15003e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 5.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.079e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.52001e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 8.98002e-06 [cse]: 1.776e-05 [replace_applicator]: 5.99999e-06 [py_interpret_to_execute_after_opt_a]: 2.294e-05 [rewriter_after_opt_a]: 4.644e-05 [convert_after_rewriter]: 8.07998e-06 [order_py_execute_after_rewriter]: 5.33002e-06 [mutable_eliminate]: 0.000944 [jit_opt_b]: 6.21e-05, [1] [Cycle 1]: 5.338e-05, [2] [frontend_op_eliminate]: 2.025e-05 [inline_after_opt_a]: 2.089e-05 [cconv]: 3.339e-05 [loop_unroll]: 0.00056773 [jit_opt_after_cconv]: 0.00018028, [1] [Cycle 1]: 0.00017325, [11] [c_1]: 2.478e-05 [parameter_eliminate]: 3.33998e-06 [updatestate_depend_eliminate]: 7.10998e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.02002e-06 [cse]: 3.712e-05 [call_graph_tuple_transform]: 2.5e-05 [tuple_list_get_item_eliminator]: 6.39999e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.06998e-06 [remove_dup_value]: 2.279e-05 [partial_unused_args_eliminate]: 2.75997e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 0.00014036 [cse_after_recomputation]: 3.338e-05, [1] [Cycle 1]: 2.539e-05, [1] [cse]: 1.755e-05 [auto_monad_reorder]: 2.084e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 8.82999e-06 [opt_after_jit_grad]: 0.00175578 [symbol_engine_optimizer]: 9.765e-05, [1] [Cycle 1]: 8.744e-05, [6] [build]: 6.35002e-06 [elim_shapecalc]: 9.69e-06 [elim_not_effective]: 2.085e-05 [opt_reshape]: 7.56001e-06 [fold_const_symbol]: 1.082e-05 [renormalize]: 7.00005e-07 [validate]: 5.5e-05 Sums bootstrap : 0.000328s : 0.88% type_inference : 0.029006s : 77.47% event_method : 0.000022s : 0.06% auto_monad : 0.000078s : 0.21% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000159s : 0.42% rewriter_before_opt_a : 0.000092s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.20% jit_opt_a.loop_unroll : 0.000037s : 0.10% jit_opt_a.a_1 : 0.000775s : 2.07% jit_opt_a.with_stream_mark : 0.000039s : 0.10% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000014s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.002590s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.09% jit_opt_a.cse : 0.000059s : 0.16% jit_opt_a.replace_applicator : 0.000030s : 0.08% py_interpret_to_execute_after_opt_a : 0.000023s : 0.06% rewriter_after_opt_a : 0.000046s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000944s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000033s : 0.09% loop_unroll : 0.000568s : 1.52% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000023s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000140s : 0.37% cse_after_recomputation.cse : 0.000018s : 0.05% auto_monad_reorder : 0.000021s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.001756s : 4.69% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.15% Time group info: ------[substitution.] 0.000267 23 0.96% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000007s : 3: substitution.graph_param_transform 83.88% : 0.000224s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000007s : 4: substitution.remove_not_recompute_node 2.35% : 0.000006s : 2: substitution.replace_old_param 5.45% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028914 2 92.29% : 0.026683s : 1: type_inference.infer 7.71% : 0.002230s : 1: type_inference.specialize ------[replace.] 0.000097 6 68.20% : 0.000066s : 4: replace.inline 31.80% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.25% : 0.000222s : 4: match.inline 5.75% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 691 0.93% : 0.000001s : 10: predicate.accumulaten_eliminater 1.76% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.69% : 0.000003s : 10: predicate.addn_zero_filter 2.58% : 0.000004s : 10: predicate.arithmetic_simplify 1.23% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.24% : 0.000002s : 10: predicate.compare_switch_simplify 1.53% : 0.000002s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.49% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 4.67% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.29% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.35% : 0.000002s : 15: predicate.load_eliminater 1.08% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.70% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000002s : 10: predicate.minmaximum_grad 1.96% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 1.91% : 0.000003s : 15: predicate.partial_eliminate 1.54% : 0.000002s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000003s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.45% : 0.000001s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000002s : 10: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.61% : 0.000002s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 16: predicate.switch_defer_inline 1.85% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.05% : 0.000011s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.61% : 0.000002s : 10: predicate.transpose_eliminate 1.80% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.86% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.27% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001188 13 35.43% : 0.000421s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.85% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 60.73% : 0.000721s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046397 72 0.31% : 0.000144s : 1: add_recomputation 0.18% : 0.000082s : 1: auto_monad 0.05% : 0.000024s : 1: auto_monad_reorder 0.76% : 0.000351s : 1: bootstrap 0.08% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000036s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.89% : 0.008762s : 1: jit_opt_a 0.40% : 0.000184s : 1: jit_opt_after_cconv 0.14% : 0.000065s : 1: jit_opt_b 1.24% : 0.000576s : 1: loop_unroll 2.06% : 0.000957s : 1: mutable_eliminate 2.24% : 0.001041s : 26: opt.transform.jit_opt_a 0.13% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000033s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000022s : 1: opt.transform.mutable_eliminate 0.09% : 0.000040s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000045s : 4: opt.transform.symbol_engine_opt 3.82% : 0.001771s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000163s : 1: py_interpret_to_execute 0.05% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000026s : 1: remove_dup_value 3.80% : 0.001765s : 1: renormalize.infer 1.74% : 0.000808s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000050s : 1: rewriter_after_opt_a 0.21% : 0.000096s : 1: rewriter_before_opt_a 0.22% : 0.000101s : 1: symbol_engine_optimizer 62.56% : 0.029028s : 1: type_inference TotalTime = 0.177384, [30] [bootstrap]: 0.00038593 [type_inference]: 0.160291 [event_method]: 2.72e-05 [auto_monad]: 8.337e-05 [graph_reusing]: 6.18998e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00122308 [rewriter_before_opt_a]: 0.00012665 [expand_dump_flag]: 4.4e-06 [jit_opt_a]: 0.0119642, [2] [Cycle 1]: 0.00696015, [27] [switch_simplify]: 8.342e-05 [loop_unroll]: 3.715e-05 [a_1]: 0.0008851 [with_stream_mark]: 2.013e-05 [recompute_prepare]: 1.074e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 8.59e-06 [updatestate_useless_node_eliminater]: 7.55e-06 [accelerated_algorithm]: 9.19998e-06 [meta_shard_fg_expand]: 3.37997e-06 [get_grad_eliminate_]: 7.63001e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 2.93003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.85e-05 [j_node_and_user_rematch]: 1.257e-05 [meta_fg_expand]: 3.36999e-06 [replace_old_param]: 1.154e-05 [inline_without_move]: 7.76001e-06 [renormalize]: 0.0054563 [add_forward_monad_depend]: 8.78001e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.949e-05 [cse]: 4.013e-05 [replace_applicator]: 2.773e-05 [Cycle 2]: 0.00043499, [27] [switch_simplify]: 8.60001e-06 [loop_unroll]: 7.26999e-06 [a_1]: 0.00014776 [with_stream_mark]: 1.347e-05 [recompute_prepare]: 6.58e-06 [updatestate_depend_eliminate]: 3.55998e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.95002e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 7.68001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 3.91001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.042e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 3.19001e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 6.59001e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 2.14999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.77002e-06 [cse]: 1.761e-05 [replace_applicator]: 6.95002e-06 [py_interpret_to_execute_after_opt_a]: 1.96e-05 [rewriter_after_opt_a]: 4.473e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00094215 [jit_opt_b]: 7.328e-05, [1] [Cycle 1]: 6.451e-05, [2] [frontend_op_eliminate]: 2.611e-05 [inline_after_opt_a]: 2.588e-05 [cconv]: 3.165e-05 [loop_unroll]: 0.00056283 [jit_opt_after_cconv]: 0.00019869, [1] [Cycle 1]: 0.0001908, [11] [c_1]: 2.9e-05 [parameter_eliminate]: 4.47e-06 [updatestate_depend_eliminate]: 9.66e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 3.681e-05 [call_graph_tuple_transform]: 2.838e-05 [tuple_list_get_item_eliminator]: 7.56999e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.77002e-06 [remove_dup_value]: 2.106e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 1.219e-05 [add_recomputation]: 5.559e-05 [cse_after_recomputation]: 3.479e-05, [1] [Cycle 1]: 2.294e-05, [1] [cse]: 1.64e-05 [auto_monad_reorder]: 1.859e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 7.62998e-06 [opt_after_jit_grad]: 0.00058569 [symbol_engine_optimizer]: 0.00038376, [1] [Cycle 1]: 0.00037636, [6] [build]: 3.51001e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 0.00030234 [opt_reshape]: 7.95e-06 [fold_const_symbol]: 1.48e-05 [renormalize]: 9.40025e-07 [validate]: 6.302e-05 Sums bootstrap : 0.000386s : 0.22% type_inference : 0.160291s : 93.14% event_method : 0.000027s : 0.02% auto_monad : 0.000083s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001223s : 0.71% rewriter_before_opt_a : 0.000127s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.05% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.001033s : 0.60% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.005456s : 3.17% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000058s : 0.03% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000942s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.02% jit_opt_b.inline_after_opt_a : 0.000026s : 0.02% cconv : 0.000032s : 0.02% loop_unroll : 0.000563s : 0.33% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000586s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000302s : 0.18% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.04% Time group info: ------[substitution.] 0.000650 25 44.31% : 0.000288s : 2: substitution.elim_not_effective 0.40% : 0.000003s : 2: substitution.fold_const_symbol 1.06% : 0.000007s : 4: substitution.graph_param_transform 49.41% : 0.000321s : 5: substitution.inline 0.77% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.99% : 0.000006s : 4: substitution.remove_not_recompute_node 0.82% : 0.000005s : 2: substitution.replace_old_param 2.25% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.160179 2 95.58% : 0.153102s : 1: type_inference.infer 4.42% : 0.007077s : 1: type_inference.specialize ------[replace.] 0.000151 7 65.60% : 0.000099s : 5: replace.inline 34.40% : 0.000052s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000332 7 95.96% : 0.000318s : 5: match.inline 4.04% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 886 1.93% : 0.000003s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.69% : 0.000003s : 13: predicate.addn_zero_filter 2.17% : 0.000004s : 13: predicate.arithmetic_simplify 1.51% : 0.000003s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000002s : 13: predicate.compare_switch_simplify 1.64% : 0.000003s : 13: predicate.depend_value_elim 1.56% : 0.000003s : 13: predicate.dict_get_item_const_eliminator 0.96% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.57% : 0.000003s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.02% : 0.000008s : 28: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.83% : 0.000003s : 8: predicate.less_batch_normalization 2.25% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 1.60% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.30% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 0.95% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.03% : 0.000003s : 19: predicate.partial_eliminate 0.99% : 0.000002s : 13: predicate.print_const_string_wrapper 1.70% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.95% : 0.000002s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.78% : 0.000003s : 13: predicate.reshape_eliminate 1.17% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000002s : 8: predicate.specialize_transform 1.51% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.02% : 0.000003s : 20: predicate.switch_defer_inline 1.88% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.96% : 0.000012s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.60% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.54% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.34% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003742 25 56.51% : 0.002115s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.63% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.86% : 0.001529s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.184557 72 0.03% : 0.000058s : 1: add_recomputation 0.05% : 0.000087s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000398s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000037s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 6.49% : 0.011969s : 1: jit_opt_a 0.11% : 0.000201s : 1: jit_opt_after_cconv 0.04% : 0.000076s : 1: jit_opt_b 0.31% : 0.000571s : 1: loop_unroll 0.52% : 0.000954s : 1: mutable_eliminate 0.73% : 0.001343s : 26: opt.transform.jit_opt_a 0.04% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000331s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000595s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.67% : 0.001230s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000027s : 1: remove_dup_value 2.12% : 0.003910s : 1: renormalize.infer 0.83% : 0.001532s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.07% : 0.000132s : 1: rewriter_before_opt_a 0.21% : 0.000387s : 1: symbol_engine_optimizer 86.86% : 0.160303s : 1: type_inference TotalTime = 0.0245772, [30] [bootstrap]: 0.00034886 [type_inference]: 0.0129309 [event_method]: 3.032e-05 [auto_monad]: 9.163e-05 [graph_reusing]: 6.49999e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 6.57e-05 [rewriter_before_opt_a]: 8.895e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.00844828, [2] [Cycle 1]: 0.00394482, [27] [switch_simplify]: 6.155e-05 [loop_unroll]: 2.906e-05 [a_1]: 0.00058695 [with_stream_mark]: 2.673e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 4.56002e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.29003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 9.41003e-06 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 0.0028221 [add_forward_monad_depend]: 1.327e-05 [auto_monad_grad]: 2.91999e-06 [auto_monad_eliminator]: 2.4e-05 [cse]: 4.169e-05 [replace_applicator]: 2.029e-05 [Cycle 2]: 0.00035477, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.82e-06 [a_1]: 9.213e-05 [with_stream_mark]: 1.609e-05 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 5.16002e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 3.3e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.733e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 5.17e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.452e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 2.035e-05 [rewriter_after_opt_a]: 4.138e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.0007798 [jit_opt_b]: 5.739e-05, [1] [Cycle 1]: 4.917e-05, [2] [frontend_op_eliminate]: 2.019e-05 [inline_after_opt_a]: 1.649e-05 [cconv]: 3.122e-05 [loop_unroll]: 0.00045814 [jit_opt_after_cconv]: 0.00015669, [1] [Cycle 1]: 0.00014944, [11] [c_1]: 2.077e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 7.38999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.791e-05 [call_graph_tuple_transform]: 2.03e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 5.46e-06 [remove_dup_value]: 1.704e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.47001e-06 [add_recomputation]: 5.671e-05 [cse_after_recomputation]: 2.508e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.316e-05 [auto_monad_reorder]: 1.834e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 6.34001e-06 [opt_after_jit_grad]: 0.00048824 [symbol_engine_optimizer]: 7.521e-05, [1] [Cycle 1]: 6.856e-05, [6] [build]: 4.72998e-06 [elim_shapecalc]: 7.53e-06 [elim_not_effective]: 1.421e-05 [opt_reshape]: 5.49998e-06 [fold_const_symbol]: 8.40999e-06 [renormalize]: 3.80009e-07 [validate]: 4.651e-05 Sums bootstrap : 0.000349s : 1.77% type_inference : 0.012931s : 65.63% event_method : 0.000030s : 0.15% auto_monad : 0.000092s : 0.47% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000066s : 0.33% rewriter_before_opt_a : 0.000089s : 0.45% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000068s : 0.34% jit_opt_a.loop_unroll : 0.000034s : 0.17% jit_opt_a.a_1 : 0.000679s : 3.45% jit_opt_a.with_stream_mark : 0.000043s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.09% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.002822s : 14.32% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.16% jit_opt_a.cse : 0.000056s : 0.29% jit_opt_a.replace_applicator : 0.000026s : 0.13% py_interpret_to_execute_after_opt_a : 0.000020s : 0.10% rewriter_after_opt_a : 0.000041s : 0.21% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000780s : 3.96% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000031s : 0.16% loop_unroll : 0.000458s : 2.33% jit_opt_after_cconv.c_1 : 0.000021s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000017s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000057s : 0.29% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000018s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000488s : 2.48% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.24% Time group info: ------[substitution.] 0.000261 23 1.02% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 3: substitution.graph_param_transform 85.09% : 0.000222s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000007s : 2: substitution.replace_old_param 5.04% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008132 2 89.69% : 0.007294s : 1: type_inference.infer 10.31% : 0.000838s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.19% : 0.000052s : 4: replace.inline 30.81% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.77% : 0.000220s : 4: match.inline 5.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.39% : 0.000002s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.07% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.63% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.88% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 2.55% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.56% : 0.000002s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.20% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000010s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000746 13 52.47% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.96% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.57% : 0.000295s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028309 72 0.21% : 0.000060s : 1: add_recomputation 0.34% : 0.000095s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.30% : 0.000368s : 1: bootstrap 0.12% : 0.000034s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.13% : 0.000037s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 29.85% : 0.008451s : 1: jit_opt_a 0.56% : 0.000160s : 1: jit_opt_after_cconv 0.21% : 0.000060s : 1: jit_opt_b 1.65% : 0.000468s : 1: loop_unroll 2.80% : 0.000792s : 1: mutable_eliminate 3.22% : 0.000911s : 26: opt.transform.jit_opt_a 0.17% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000031s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.77% : 0.000500s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000069s : 1: py_interpret_to_execute 0.08% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 8.29% : 0.002347s : 1: renormalize.infer 1.62% : 0.000458s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000045s : 1: rewriter_after_opt_a 0.33% : 0.000092s : 1: rewriter_before_opt_a 0.28% : 0.000078s : 1: symbol_engine_optimizer 45.80% : 0.012965s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.119.685 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.120.309 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0804606, [30] [bootstrap]: 0.00033568 [type_inference]: 0.0686759 [event_method]: 2.163e-05 [auto_monad]: 6.734e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 0.00035321 [rewriter_before_opt_a]: 8.311e-05 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.00846054, [2] [Cycle 1]: 0.00426617, [27] [switch_simplify]: 5.827e-05 [loop_unroll]: 3.147e-05 [a_1]: 0.00060032 [with_stream_mark]: 1.713e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 6.88e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00319765 [add_forward_monad_depend]: 6.80002e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.659e-05 [cse]: 2.843e-05 [replace_applicator]: 1.934e-05 [Cycle 2]: 0.00036434, [27] [switch_simplify]: 6.91999e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.0001244 [with_stream_mark]: 9.83998e-06 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.581e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.17e-05 [replace_applicator]: 5.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.189e-05 [rewriter_after_opt_a]: 3.693e-05 [convert_after_rewriter]: 6.77002e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00069648 [jit_opt_b]: 5.697e-05, [1] [Cycle 1]: 4.928e-05, [2] [frontend_op_eliminate]: 2.006e-05 [inline_after_opt_a]: 1.84e-05 [cconv]: 2.524e-05 [loop_unroll]: 0.00045829 [jit_opt_after_cconv]: 0.00015501, [1] [Cycle 1]: 0.00014838, [11] [c_1]: 2.565e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 1.97999e-06 [cse]: 2.262e-05 [call_graph_tuple_transform]: 2.177e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.41998e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.59999e-06 [remove_dup_value]: 1.489e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 8.51002e-06 [add_recomputation]: 4.912e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.744e-05, [1] [cse]: 1.1e-05 [auto_monad_reorder]: 1.573e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 5.32001e-06 [opt_after_jit_grad]: 0.00052126 [symbol_engine_optimizer]: 0.00012934, [1] [Cycle 1]: 0.0001218, [6] [build]: 3.84002e-06 [elim_shapecalc]: 8.50999e-06 [elim_not_effective]: 5.759e-05 [opt_reshape]: 7.74002e-06 [fold_const_symbol]: 1.145e-05 [renormalize]: 4.39992e-07 [validate]: 4.658e-05 Sums bootstrap : 0.000336s : 0.44% type_inference : 0.068676s : 90.33% event_method : 0.000022s : 0.03% auto_monad : 0.000067s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000353s : 0.46% rewriter_before_opt_a : 0.000083s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.09% jit_opt_a.loop_unroll : 0.000038s : 0.05% jit_opt_a.a_1 : 0.000725s : 0.95% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.003198s : 4.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000040s : 0.05% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000037s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000696s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000458s : 0.60% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000521s : 0.69% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000058s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.06% Time group info: ------[substitution.] 0.000226 24 1.22% : 0.000003s : 2: substitution.elim_not_effective 0.79% : 0.000002s : 2: substitution.fold_const_symbol 2.88% : 0.000007s : 4: substitution.graph_param_transform 83.95% : 0.000190s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 5.62% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068569 2 95.52% : 0.065500s : 1: type_inference.infer 4.48% : 0.003069s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.60% : 0.000055s : 4: replace.inline 32.40% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.16% : 0.000187s : 4: match.inline 5.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.73% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.55% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.38% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 4.83% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.22% : 0.000002s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.77% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.45% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002673 26 70.62% : 0.001887s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.20% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.18% : 0.000753s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084737 72 0.06% : 0.000052s : 1: add_recomputation 0.08% : 0.000071s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.41% : 0.000350s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.99% : 0.008464s : 1: jit_opt_a 0.19% : 0.000158s : 1: jit_opt_after_cconv 0.07% : 0.000060s : 1: jit_opt_b 0.55% : 0.000466s : 1: loop_unroll 0.83% : 0.000705s : 1: mutable_eliminate 1.14% : 0.000966s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000082s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000530s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000359s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 2.80% : 0.002377s : 1: renormalize.infer 0.96% : 0.000811s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.10% : 0.000088s : 1: rewriter_before_opt_a 0.16% : 0.000132s : 1: symbol_engine_optimizer 81.07% : 0.068693s : 1: type_inference TotalTime = 0.172102, [30] [bootstrap]: 0.00053916 [type_inference]: 0.155659 [event_method]: 2.971e-05 [auto_monad]: 0.00011522 [graph_reusing]: 7.36999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00103385 [rewriter_before_opt_a]: 0.0001213 [expand_dump_flag]: 5.09e-06 [jit_opt_a]: 0.0116872, [2] [Cycle 1]: 0.00654204, [27] [switch_simplify]: 8.167e-05 [loop_unroll]: 3.558e-05 [a_1]: 0.00089962 [with_stream_mark]: 2.571e-05 [recompute_prepare]: 1.176e-05 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 8.13001e-06 [updatestate_useless_node_eliminater]: 7.25e-06 [accelerated_algorithm]: 7.99997e-06 [meta_shard_fg_expand]: 3.02002e-06 [get_grad_eliminate_]: 7.51999e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.799e-05 [j_node_and_user_rematch]: 1.175e-05 [meta_fg_expand]: 3.31999e-06 [replace_old_param]: 1.167e-05 [inline_without_move]: 6.93e-06 [renormalize]: 0.00506991 [add_forward_monad_depend]: 1.007e-05 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 2.019e-05 [cse]: 3.846e-05 [replace_applicator]: 2.819e-05 [Cycle 2]: 0.00043478, [27] [switch_simplify]: 8.40001e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00015377 [with_stream_mark]: 1.481e-05 [recompute_prepare]: 7.41999e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 3.91999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 3.63e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 6.12001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.45999e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.79999e-06 [cse]: 1.564e-05 [replace_applicator]: 6.68e-06 [py_interpret_to_execute_after_opt_a]: 1.756e-05 [rewriter_after_opt_a]: 4.169e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.62999e-06 [mutable_eliminate]: 0.00083249 [jit_opt_b]: 6.721e-05, [1] [Cycle 1]: 5.776e-05, [2] [frontend_op_eliminate]: 2.504e-05 [inline_after_opt_a]: 2.084e-05 [cconv]: 3.228e-05 [loop_unroll]: 0.00050275 [jit_opt_after_cconv]: 0.00018969, [1] [Cycle 1]: 0.00018274, [11] [c_1]: 3.016e-05 [parameter_eliminate]: 4.59998e-06 [updatestate_depend_eliminate]: 8.58001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.48002e-06 [cse]: 3.357e-05 [call_graph_tuple_transform]: 2.942e-05 [tuple_list_get_item_eliminator]: 6.98e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.86001e-06 [remove_dup_value]: 1.646e-05 [partial_unused_args_eliminate]: 3.35e-06 [environ_conv]: 9.96e-06 [add_recomputation]: 6.109e-05 [cse_after_recomputation]: 2.689e-05, [1] [Cycle 1]: 2.109e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 1.769e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 8.2e-06 [opt_after_jit_grad]: 0.00057386 [symbol_engine_optimizer]: 0.00021813, [1] [Cycle 1]: 0.00021018, [6] [build]: 4.44998e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 0.00014113 [opt_reshape]: 9.52001e-06 [fold_const_symbol]: 1.385e-05 [renormalize]: 4.80009e-07 [validate]: 5.598e-05 Sums bootstrap : 0.000539s : 0.32% type_inference : 0.155659s : 93.37% event_method : 0.000030s : 0.02% auto_monad : 0.000115s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001034s : 0.62% rewriter_before_opt_a : 0.000121s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.001053s : 0.63% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005070s : 3.04% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000832s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000503s : 0.30% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000061s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000574s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000141s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000381 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000002s : 2: substitution.fold_const_symbol 2.22% : 0.000008s : 4: substitution.graph_param_transform 85.63% : 0.000326s : 5: substitution.inline 0.98% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.58% : 0.000014s : 3: substitution.reduce_eliminate 1.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000006s : 2: substitution.replace_old_param 3.65% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.155534 2 96.72% : 0.150426s : 1: type_inference.infer 3.28% : 0.005108s : 1: type_inference.specialize ------[replace.] 0.000137 7 65.78% : 0.000090s : 5: replace.inline 34.22% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000335 7 96.19% : 0.000322s : 5: match.inline 3.81% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.30% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.47% : 0.000004s : 13: predicate.arithmetic_simplify 1.55% : 0.000003s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.25% : 0.000008s : 28: predicate.inline 0.74% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.38% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000003s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 2.31% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.14% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 2.08% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 1.92% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.03% : 0.000011s : 64: predicate.switch_simplify 1.70% : 0.000003s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 2.07% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.06% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003620 25 59.39% : 0.002150s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.86% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.75% : 0.001366s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178720 72 0.04% : 0.000065s : 1: add_recomputation 0.07% : 0.000119s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000556s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.54% : 0.011691s : 1: jit_opt_a 0.11% : 0.000192s : 1: jit_opt_after_cconv 0.04% : 0.000070s : 1: jit_opt_b 0.29% : 0.000511s : 1: loop_unroll 0.47% : 0.000841s : 1: mutable_eliminate 0.75% : 0.001348s : 26: opt.transform.jit_opt_a 0.04% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000169s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000581s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.58% : 0.001044s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 2.03% : 0.003632s : 1: renormalize.infer 0.80% : 0.001423s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000127s : 1: rewriter_before_opt_a 0.12% : 0.000222s : 1: symbol_engine_optimizer 87.11% : 0.155680s : 1: type_inference TotalTime = 0.0516901, [30] [bootstrap]: 0.00019929 [type_inference]: 0.0147711 [event_method]: 6.368e-05 [auto_monad]: 0.00010285 [graph_reusing]: 7.51999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 3.016e-05 [rewriter_before_opt_a]: 0.00010851 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0338347, [3] [Cycle 1]: 0.00791128, [27] [switch_simplify]: 8.119e-05 [loop_unroll]: 4.273e-05 [a_1]: 0.00094358 [with_stream_mark]: 2.723e-05 [recompute_prepare]: 1.944e-05 [updatestate_depend_eliminate]: 8.2e-06 [updatestate_assign_eliminate]: 7.03e-06 [updatestate_loads_eliminate]: 6.63e-06 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 1.334e-05 [updatestate_useless_node_eliminater]: 1.235e-05 [accelerated_algorithm]: 1.287e-05 [meta_shard_fg_expand]: 3.59002e-06 [get_grad_eliminate_]: 1.248e-05 [merge_forward]: 9.68002e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.737e-05 [j_node_and_user_rematch]: 2.272e-05 [meta_fg_expand]: 0.00201439 [replace_old_param]: 7.402e-05 [inline_without_move]: 6.344e-05 [renormalize]: 0.00386194 [add_forward_monad_depend]: 1.163e-05 [auto_monad_grad]: 6.12999e-06 [auto_monad_eliminator]: 6.126e-05 [cse]: 0.00022657 [replace_applicator]: 7.842e-05 [Cycle 2]: 0.0216864, [27] [switch_simplify]: 4.067e-05 [loop_unroll]: 3.894e-05 [a_1]: 0.00115295 [with_stream_mark]: 1.31e-05 [recompute_prepare]: 1.037e-05 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.24003e-06 [specialize_transform]: 8.67e-06 [updatestate_useless_node_eliminater]: 8.03999e-06 [accelerated_algorithm]: 8.23001e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 7.98001e-06 [merge_forward]: 5.14e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.705e-05 [j_node_and_user_rematch]: 1.494e-05 [meta_fg_expand]: 0.00011076 [replace_old_param]: 9.58002e-06 [inline_without_move]: 8.37e-06 [renormalize]: 0.0199273 [add_forward_monad_depend]: 1.229e-05 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 2.389e-05 [cse]: 3.492e-05 [replace_applicator]: 2.533e-05 [Cycle 3]: 0.00040712, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 4.89003e-06 [a_1]: 0.00014023 [with_stream_mark]: 1.606e-05 [recompute_prepare]: 5.06002e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.50999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 3.46999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.81e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 3.25002e-06 [replace_old_param]: 4.43999e-06 [inline_without_move]: 4.2e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 1.13001e-06 [auto_monad_eliminator]: 7.26999e-06 [cse]: 1.252e-05 [replace_applicator]: 5.22999e-06 [py_interpret_to_execute_after_opt_a]: 1.564e-05 [rewriter_after_opt_a]: 4.132e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00082051 [jit_opt_b]: 5.111e-05, [1] [Cycle 1]: 4.247e-05, [2] [frontend_op_eliminate]: 1.365e-05 [inline_after_opt_a]: 1.675e-05 [cconv]: 3.271e-05 [loop_unroll]: 0.00049025 [jit_opt_after_cconv]: 0.00016354, [1] [Cycle 1]: 0.00015641, [11] [c_1]: 1.782e-05 [parameter_eliminate]: 4.75999e-06 [updatestate_depend_eliminate]: 8.23001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 3.16e-05 [call_graph_tuple_transform]: 2.179e-05 [tuple_list_get_item_eliminator]: 4.96997e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 1.02998e-06 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.823e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 2.407e-05 [add_recomputation]: 5.075e-05 [cse_after_recomputation]: 2.438e-05, [1] [Cycle 1]: 1.833e-05, [1] [cse]: 1.175e-05 [auto_monad_reorder]: 1.562e-05 [get_jit_bprop_graph]: 2.78998e-06 [rewriter_after_jit_bprop_graph]: 8.42e-06 [opt_after_jit_grad]: 0.00048674 [symbol_engine_optimizer]: 7.718e-05, [1] [Cycle 1]: 7.118e-05, [6] [build]: 3.87998e-06 [elim_shapecalc]: 7.2e-06 [elim_not_effective]: 1.517e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 4.00003e-07 [validate]: 4.648e-05 Sums bootstrap : 0.000199s : 0.42% type_inference : 0.014771s : 31.45% event_method : 0.000064s : 0.14% auto_monad : 0.000103s : 0.22% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000030s : 0.06% rewriter_before_opt_a : 0.000109s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000128s : 0.27% jit_opt_a.loop_unroll : 0.000087s : 0.18% jit_opt_a.a_1 : 0.002237s : 4.76% jit_opt_a.with_stream_mark : 0.000056s : 0.12% jit_opt_a.recompute_prepare : 0.000035s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.05% jit_opt_a.accelerated_algorithm : 0.000026s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.05% jit_opt_a.merge_forward : 0.000019s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.10% jit_opt_a.meta_fg_expand : 0.002128s : 4.53% jit_opt_a.replace_old_param : 0.000088s : 0.19% jit_opt_a.inline_without_move : 0.000076s : 0.16% jit_opt_a.renormalize : 0.023789s : 50.65% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.05% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000092s : 0.20% jit_opt_a.cse : 0.000274s : 0.58% jit_opt_a.replace_applicator : 0.000109s : 0.23% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000041s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000821s : 1.75% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000033s : 0.07% loop_unroll : 0.000490s : 1.04% jit_opt_after_cconv.c_1 : 0.000018s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000024s : 0.05% add_recomputation : 0.000051s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000487s : 1.04% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.10% Time group info: ------[substitution.] 0.000574 110 0.43% : 0.000002s : 2: substitution.elim_not_effective 0.25% : 0.000001s : 2: substitution.fold_const_symbol 0.96% : 0.000006s : 2: substitution.graph_param_transform 64.94% : 0.000373s : 13: substitution.inline 4.15% : 0.000024s : 2: substitution.inline_without_move 1.91% : 0.000011s : 14: substitution.j_node_and_user_rematch 1.74% : 0.000010s : 7: substitution.minmaximum_grad 1.08% : 0.000006s : 5: substitution.partial_eliminate 2.29% : 0.000013s : 14: substitution.remove_not_recompute_node 5.35% : 0.000031s : 10: substitution.replace_applicator 1.18% : 0.000007s : 8: substitution.replace_old_param 1.17% : 0.000007s : 1: substitution.reshape_eliminate 0.39% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.08% : 0.000006s : 1: substitution.tile_eliminate 3.56% : 0.000020s : 7: substitution.tuple_list_convert_item_index_to_positive 2.49% : 0.000014s : 7: substitution.tuple_list_get_item_depend_reorder 7.02% : 0.000040s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.014692 2 91.09% : 0.013383s : 1: type_inference.infer 8.91% : 0.001309s : 1: type_inference.specialize ------[replace.] 0.000169 20 65.70% : 0.000111s : 13: replace.inline 34.30% : 0.000058s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000387 20 94.44% : 0.000365s : 13: match.inline 5.56% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000387 2621 1.54% : 0.000006s : 45: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.42% : 0.000006s : 45: predicate.addn_check_dump 1.60% : 0.000006s : 45: predicate.addn_zero_filter 2.03% : 0.000008s : 45: predicate.arithmetic_simplify 1.53% : 0.000006s : 45: predicate.cast_eliminate 0.13% : 0.000000s : 2: predicate.check_bprop_eliminate 1.47% : 0.000006s : 45: predicate.compare_switch_simplify 1.48% : 0.000006s : 45: predicate.depend_value_elim 1.45% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.56% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.14% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.46% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 45: predicate.environ_get_depend_swap 1.50% : 0.000006s : 45: predicate.environ_get_eliminate 1.43% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.81% : 0.000003s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.35% : 0.000017s : 69: predicate.inline 2.00% : 0.000008s : 43: predicate.inline_without_move 0.34% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.16% : 0.000004s : 19: predicate.less_batch_normalization 1.74% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.94% : 0.000008s : 54: predicate.load_eliminater 0.37% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.33% : 0.000013s : 90: predicate.loop_unroll_before_grad 1.81% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.42% : 0.000006s : 45: predicate.merge_addn 1.56% : 0.000006s : 45: predicate.minmaximum_grad 0.58% : 0.000002s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.34% : 0.000009s : 54: predicate.partial_eliminate 1.49% : 0.000006s : 45: predicate.print_const_string_wrapper 2.04% : 0.000008s : 45: predicate.reduce_eliminate 1.86% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 19: predicate.remove_not_recompute_node 2.66% : 0.000010s : 97: predicate.replace_applicator 1.14% : 0.000004s : 43: predicate.replace_old_param 0.06% : 0.000000s : 2: predicate.reset_defer_inline 1.63% : 0.000006s : 45: predicate.reshape_eliminate 1.51% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 2: predicate.row_tensor_eliminate 1.56% : 0.000006s : 45: predicate.same_eliminate 0.48% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 4: predicate.special_op_eliminate 0.81% : 0.000003s : 19: predicate.specialize_transform 1.83% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.84% : 0.000011s : 65: predicate.switch_defer_inline 2.49% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.18% : 0.000024s : 157: predicate.switch_simplify 1.56% : 0.000006s : 45: predicate.tile_eliminate 1.57% : 0.000006s : 45: predicate.transpose_eliminate 1.96% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.90% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000013s : 56: predicate.tuple_list_get_item_eliminator 1.84% : 0.000007s : 45: predicate.tuple_list_set_item_eliminator 1.79% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.79% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.81% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 2.02% : 0.000008s : 45: predicate.value_based_eliminate 0.09% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002044 32 55.17% : 0.001128s : 15: func_graph_cloner_run.FuncGraphClonerGraph 44.83% : 0.000916s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.078429 87 0.07% : 0.000054s : 1: add_recomputation 0.14% : 0.000108s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.28% : 0.000216s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000027s : 1: environ_conv 0.09% : 0.000068s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 43.15% : 0.033839s : 1: jit_opt_a 0.21% : 0.000166s : 1: jit_opt_after_cconv 0.07% : 0.000054s : 1: jit_opt_b 0.64% : 0.000499s : 1: loop_unroll 1.06% : 0.000831s : 1: mutable_eliminate 3.72% : 0.002921s : 39: opt.transform.jit_opt_a 0.06% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000023s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000033s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 27.42% : 0.021505s : 2: renormalize.infer 2.88% : 0.002258s : 2: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.14% : 0.000112s : 1: rewriter_before_opt_a 0.10% : 0.000080s : 1: symbol_engine_optimizer 18.85% : 0.014784s : 1: type_inference TotalTime = 0.0355609, [30] [bootstrap]: 0.00035544 [type_inference]: 0.0253806 [event_method]: 2.086e-05 [auto_monad]: 6.923e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.58998e-06 [py_interpret_to_execute]: 0.00014505 [rewriter_before_opt_a]: 8.982e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00700266, [2] [Cycle 1]: 0.00267889, [27] [switch_simplify]: 6.549e-05 [loop_unroll]: 3.183e-05 [a_1]: 0.00059832 [with_stream_mark]: 1.868e-05 [recompute_prepare]: 8.02998e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.68998e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.79001e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.483e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 5.49998e-06 [renormalize]: 0.00159801 [add_forward_monad_depend]: 7.28e-06 [auto_monad_grad]: 2.16998e-06 [auto_monad_eliminator]: 1.737e-05 [cse]: 3.768e-05 [replace_applicator]: 1.693e-05 [Cycle 2]: 0.00034882, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.62001e-06 [a_1]: 9.858e-05 [with_stream_mark]: 1.182e-05 [recompute_prepare]: 5.42999e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 3.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.638e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.21998e-06 [cse]: 1.351e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.231e-05 [rewriter_after_opt_a]: 4.249e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.58002e-06 [mutable_eliminate]: 0.00069787 [jit_opt_b]: 5.763e-05, [1] [Cycle 1]: 4.972e-05, [2] [frontend_op_eliminate]: 1.9e-05 [inline_after_opt_a]: 1.866e-05 [cconv]: 2.929e-05 [loop_unroll]: 0.00047616 [jit_opt_after_cconv]: 0.00015103, [1] [Cycle 1]: 0.00014486, [11] [c_1]: 2.125e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 6.99001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.807e-05 [call_graph_tuple_transform]: 1.883e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 6.45002e-06 [remove_dup_value]: 1.707e-05 [partial_unused_args_eliminate]: 1.98997e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 6.52e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.933e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.91e-06 [opt_after_jit_grad]: 0.00051515 [symbol_engine_optimizer]: 8.123e-05, [1] [Cycle 1]: 7.445e-05, [6] [build]: 4.64002e-06 [elim_shapecalc]: 9.11998e-06 [elim_not_effective]: 1.551e-05 [opt_reshape]: 6.81999e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 9.39996e-07 [validate]: 4.784e-05 Sums bootstrap : 0.000355s : 1.15% type_inference : 0.025381s : 82.05% event_method : 0.000021s : 0.07% auto_monad : 0.000069s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000145s : 0.47% rewriter_before_opt_a : 0.000090s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.23% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000697s : 2.25% jit_opt_a.with_stream_mark : 0.000030s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001598s : 5.17% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000051s : 0.17% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000698s : 2.26% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000019s : 0.06% cconv : 0.000029s : 0.09% loop_unroll : 0.000476s : 1.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000051s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000515s : 1.67% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.15% Time group info: ------[substitution.] 0.000243 23 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.17% : 0.000005s : 3: substitution.graph_param_transform 84.52% : 0.000206s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000005s : 4: substitution.remove_not_recompute_node 2.01% : 0.000005s : 2: substitution.replace_old_param 5.71% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025292 2 91.54% : 0.023152s : 1: type_inference.infer 8.46% : 0.002140s : 1: type_inference.specialize ------[replace.] 0.000087 6 66.60% : 0.000058s : 4: replace.inline 33.40% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.06% : 0.000203s : 4: match.inline 5.94% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.20% : 0.000002s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.68% : 0.000001s : 3: predicate.check_bprop_eliminate 1.43% : 0.000002s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.27% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.67% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 2.32% : 0.000003s : 10: predicate.reduce_eliminate 1.70% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 2.12% : 0.000003s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.45% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.19% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.90% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001126 13 44.17% : 0.000497s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.92% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.92% : 0.000585s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038146 72 0.14% : 0.000054s : 1: add_recomputation 0.19% : 0.000073s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.98% : 0.000373s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.18% : 0.000067s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.37% : 0.007007s : 1: jit_opt_a 0.40% : 0.000154s : 1: jit_opt_after_cconv 0.16% : 0.000060s : 1: jit_opt_b 1.27% : 0.000483s : 1: loop_unroll 1.86% : 0.000709s : 1: mutable_eliminate 2.46% : 0.000939s : 26: opt.transform.jit_opt_a 0.13% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.37% : 0.000524s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000148s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.62% : 0.000999s : 1: renormalize.infer 1.54% : 0.000588s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.25% : 0.000094s : 1: rewriter_before_opt_a 0.22% : 0.000084s : 1: symbol_engine_optimizer 66.58% : 0.025397s : 1: type_inference TotalTime = 0.0389382, [30] [bootstrap]: 0.0003238 [type_inference]: 0.0290595 [event_method]: 2.354e-05 [auto_monad]: 6.35e-05 [graph_reusing]: 5.32999e-06 [pre_auto_parallel]: 2.31998e-06 [py_interpret_to_execute]: 0.00016227 [rewriter_before_opt_a]: 8.451e-05 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.00677616, [2] [Cycle 1]: 0.00260901, [27] [switch_simplify]: 5.712e-05 [loop_unroll]: 3.325e-05 [a_1]: 0.00056832 [with_stream_mark]: 1.364e-05 [recompute_prepare]: 7.33e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.76998e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 8.30012e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.161e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 0.00162321 [add_forward_monad_depend]: 5.39e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.532e-05 [cse]: 2.553e-05 [replace_applicator]: 1.459e-05 [Cycle 2]: 0.00035588, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00010382 [with_stream_mark]: 1.058e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.28002e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.85998e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.347e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.228e-05 [rewriter_after_opt_a]: 3.543e-05 [convert_after_rewriter]: 6.12999e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00065987 [jit_opt_b]: 5.375e-05, [1] [Cycle 1]: 4.71e-05, [2] [frontend_op_eliminate]: 1.754e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.505e-05 [loop_unroll]: 0.00047837 [jit_opt_after_cconv]: 0.00016107, [1] [Cycle 1]: 0.00015427, [11] [c_1]: 2.383e-05 [parameter_eliminate]: 3.34001e-06 [updatestate_depend_eliminate]: 6.44001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.33e-06 [cse]: 2.58e-05 [call_graph_tuple_transform]: 2.159e-05 [tuple_list_get_item_eliminator]: 7.58999e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.31998e-06 [remove_dup_value]: 1.445e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 6.56999e-06 [add_recomputation]: 4.634e-05 [cse_after_recomputation]: 2.544e-05, [1] [Cycle 1]: 1.997e-05, [1] [cse]: 1.319e-05 [auto_monad_reorder]: 1.502e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.71e-06 [opt_after_jit_grad]: 0.00054346 [symbol_engine_optimizer]: 0.00011711, [1] [Cycle 1]: 0.00011033, [6] [build]: 4e-06 [elim_shapecalc]: 9.09998e-06 [elim_not_effective]: 4.941e-05 [opt_reshape]: 7.32002e-06 [fold_const_symbol]: 1.104e-05 [renormalize]: 5.50004e-07 [validate]: 4.419e-05 Sums bootstrap : 0.000324s : 0.94% type_inference : 0.029060s : 84.12% event_method : 0.000024s : 0.07% auto_monad : 0.000063s : 0.18% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000162s : 0.47% rewriter_before_opt_a : 0.000085s : 0.24% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.19% jit_opt_a.loop_unroll : 0.000040s : 0.12% jit_opt_a.a_1 : 0.000672s : 1.95% jit_opt_a.with_stream_mark : 0.000024s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001623s : 4.70% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000039s : 0.11% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000035s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000660s : 1.91% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000025s : 0.07% loop_unroll : 0.000478s : 1.38% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000014s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000046s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000543s : 1.57% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000049s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.13% Time group info: ------[substitution.] 0.000225 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 3: substitution.graph_param_transform 85.28% : 0.000192s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000004s : 2: substitution.replace_old_param 4.75% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028981 2 91.97% : 0.026654s : 1: type_inference.infer 8.03% : 0.002327s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.39% : 0.000054s : 4: replace.inline 32.61% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 95.14% : 0.000189s : 4: match.inline 4.86% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.34% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.57% : 0.000002s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 4.62% : 0.000006s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.57% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.29% : 0.000002s : 10: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.74% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 2.15% : 0.000003s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.67% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 16: predicate.switch_defer_inline 1.96% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.98% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001167 13 38.71% : 0.000452s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.56% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 57.73% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041564 72 0.12% : 0.000049s : 1: add_recomputation 0.16% : 0.000067s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.81% : 0.000335s : 1: bootstrap 0.07% : 0.000028s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.31% : 0.006780s : 1: jit_opt_a 0.39% : 0.000164s : 1: jit_opt_after_cconv 0.14% : 0.000056s : 1: jit_opt_b 1.17% : 0.000487s : 1: loop_unroll 1.60% : 0.000667s : 1: mutable_eliminate 2.17% : 0.000901s : 26: opt.transform.jit_opt_a 0.13% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000073s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000552s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000165s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 2.06% : 0.000857s : 1: renormalize.infer 1.82% : 0.000757s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000038s : 1: rewriter_after_opt_a 0.21% : 0.000088s : 1: rewriter_before_opt_a 0.29% : 0.000120s : 1: symbol_engine_optimizer 69.95% : 0.029074s : 1: type_inference TotalTime = 0.0203947, [30] [bootstrap]: 0.00033926 [type_inference]: 0.0107188 [event_method]: 2.562e-05 [auto_monad]: 7.854e-05 [graph_reusing]: 5.48002e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 7.679e-05 [rewriter_before_opt_a]: 9.215e-05 [expand_dump_flag]: 3.89997e-06 [jit_opt_a]: 0.00675908, [2] [Cycle 1]: 0.00227728, [27] [switch_simplify]: 6.824e-05 [loop_unroll]: 3.422e-05 [a_1]: 0.00070546 [with_stream_mark]: 1.996e-05 [recompute_prepare]: 9.42999e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 6.13998e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 3.13998e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 3.74002e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 3.768e-05 [inline_without_move]: 6.96999e-06 [renormalize]: 0.00106897 [add_forward_monad_depend]: 6.39999e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.596e-05 [cse]: 3.426e-05 [replace_applicator]: 1.59e-05 [Cycle 2]: 0.00034413, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 5.51e-06 [a_1]: 0.00010541 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 2.58003e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.54002e-06 [cell_reuse_recompute_pass]: 2.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.131e-05 [j_node_and_user_rematch]: 7.93999e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.97e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.20002e-06 [cse]: 1.27e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.225e-05 [rewriter_after_opt_a]: 3.726e-05 [convert_after_rewriter]: 7.13998e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00065308 [jit_opt_b]: 5.521e-05, [1] [Cycle 1]: 4.719e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.679e-05 [cconv]: 2.546e-05 [loop_unroll]: 0.0004312 [jit_opt_after_cconv]: 0.00017405, [1] [Cycle 1]: 0.00016785, [11] [c_1]: 2.329e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 6.89999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.475e-05 [call_graph_tuple_transform]: 2.056e-05 [tuple_list_get_item_eliminator]: 5.99999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.544e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.18002e-06 [add_recomputation]: 5.211e-05 [cse_after_recomputation]: 2.462e-05, [1] [Cycle 1]: 1.842e-05, [1] [cse]: 1.231e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 4.57998e-06 [opt_after_jit_grad]: 0.00046955 [symbol_engine_optimizer]: 7.791e-05, [1] [Cycle 1]: 7.127e-05, [6] [build]: 3.61001e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.461e-05 [opt_reshape]: 5.98998e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 4.50003e-07 [validate]: 3.795e-05 Sums bootstrap : 0.000339s : 2.17% type_inference : 0.010719s : 68.53% event_method : 0.000026s : 0.16% auto_monad : 0.000079s : 0.50% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000077s : 0.49% rewriter_before_opt_a : 0.000092s : 0.59% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000075s : 0.48% jit_opt_a.loop_unroll : 0.000040s : 0.25% jit_opt_a.a_1 : 0.000811s : 5.18% jit_opt_a.with_stream_mark : 0.000030s : 0.19% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000045s : 0.29% jit_opt_a.inline_without_move : 0.000012s : 0.08% jit_opt_a.renormalize : 0.001069s : 6.83% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.14% jit_opt_a.cse : 0.000047s : 0.30% jit_opt_a.replace_applicator : 0.000021s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.08% rewriter_after_opt_a : 0.000037s : 0.24% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000653s : 4.18% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000025s : 0.16% loop_unroll : 0.000431s : 2.76% jit_opt_after_cconv.c_1 : 0.000023s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000015s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000052s : 0.33% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000470s : 3.00% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.24% Time group info: ------[substitution.] 0.000282 27 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 83.38% : 0.000235s : 5: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.21% : 0.000012s : 3: substitution.reduce_eliminate 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.16% : 0.000003s : 2: substitution.replace_old_param 4.43% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010623 2 85.80% : 0.009114s : 1: type_inference.infer 14.20% : 0.001509s : 1: type_inference.specialize ------[replace.] 0.000114 7 66.15% : 0.000075s : 5: replace.inline 33.85% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 95.29% : 0.000232s : 5: match.inline 4.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.40% : 0.000002s : 11: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 11: predicate.addn_check_dump 1.15% : 0.000002s : 11: predicate.addn_zero_filter 2.16% : 0.000003s : 11: predicate.arithmetic_simplify 1.42% : 0.000002s : 11: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.11% : 0.000001s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 1.03% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.38% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000007s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.44% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.40% : 0.000002s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.34% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 2.28% : 0.000003s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.18% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.81% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.92% : 0.000003s : 11: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 59: predicate.switch_simplify 1.43% : 0.000002s : 11: predicate.tile_eliminate 1.44% : 0.000002s : 11: predicate.transpose_eliminate 1.81% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001162 16 47.53% : 0.000552s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.85% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.61% : 0.000542s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022599 72 0.24% : 0.000055s : 1: add_recomputation 0.36% : 0.000082s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.57% : 0.000355s : 1: bootstrap 0.12% : 0.000028s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000030s : 1: event_method 0.03% : 0.000007s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 29.93% : 0.006763s : 1: jit_opt_a 0.78% : 0.000177s : 1: jit_opt_after_cconv 0.26% : 0.000058s : 1: jit_opt_b 1.94% : 0.000438s : 1: loop_unroll 2.92% : 0.000660s : 1: mutable_eliminate 4.77% : 0.001078s : 26: opt.transform.jit_opt_a 0.23% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000029s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.11% : 0.000476s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000080s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000018s : 1: remove_dup_value 2.67% : 0.000603s : 1: renormalize.infer 2.02% : 0.000457s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000040s : 1: rewriter_after_opt_a 0.42% : 0.000096s : 1: rewriter_before_opt_a 0.36% : 0.000080s : 1: symbol_engine_optimizer 47.51% : 0.010736s : 1: type_inference TotalTime = 0.0319058, [30] [bootstrap]: 0.00034204 [type_inference]: 0.0225221 [event_method]: 1.959e-05 [auto_monad]: 7.058e-05 [graph_reusing]: 5.40999e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00013169 [rewriter_before_opt_a]: 8.178e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.0064294, [2] [Cycle 1]: 0.00233221, [27] [switch_simplify]: 5.81e-05 [loop_unroll]: 2.979e-05 [a_1]: 0.00056996 [with_stream_mark]: 1.986e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.397e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.60002e-06 [replace_old_param]: 9.06002e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00131569 [add_forward_monad_depend]: 6.89999e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.596e-05 [cse]: 3.404e-05 [replace_applicator]: 1.345e-05 [Cycle 2]: 0.00048657, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.24998e-06 [a_1]: 9.332e-05 [with_stream_mark]: 1.143e-05 [recompute_prepare]: 5.46002e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.23002e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 7.51999e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.06997e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.25002e-06 [cse]: 0.00015821 [replace_applicator]: 9.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.393e-05 [rewriter_after_opt_a]: 4.143e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 5.42999e-06 [mutable_eliminate]: 0.00063971 [jit_opt_b]: 5.096e-05, [1] [Cycle 1]: 4.359e-05, [2] [frontend_op_eliminate]: 1.685e-05 [inline_after_opt_a]: 1.546e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.00044091 [jit_opt_after_cconv]: 0.00015313, [1] [Cycle 1]: 0.00014686, [11] [c_1]: 2.146e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 2.277e-05 [call_graph_tuple_transform]: 2.689e-05 [tuple_list_get_item_eliminator]: 6.67002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.518e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.34998e-06 [add_recomputation]: 5.306e-05 [cse_after_recomputation]: 2.472e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.341e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00047813 [symbol_engine_optimizer]: 7.474e-05, [1] [Cycle 1]: 6.751e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.302e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 2.49973e-07 [validate]: 4.023e-05 Sums bootstrap : 0.000342s : 1.24% type_inference : 0.022522s : 81.34% event_method : 0.000020s : 0.07% auto_monad : 0.000071s : 0.25% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000132s : 0.48% rewriter_before_opt_a : 0.000082s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.23% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000663s : 2.40% jit_opt_a.with_stream_mark : 0.000031s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001316s : 4.75% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000192s : 0.69% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000640s : 2.31% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000441s : 1.59% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000053s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000478s : 1.73% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.15% Time group info: ------[substitution.] 0.000229 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 5.75% : 0.000013s : 3: substitution.graph_param_transform 81.63% : 0.000187s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.70% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022446 2 91.02% : 0.020430s : 1: type_inference.infer 8.98% : 0.002017s : 1: type_inference.specialize ------[replace.] 0.000086 6 68.88% : 0.000059s : 4: replace.inline 31.12% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.89% : 0.000185s : 4: match.inline 6.11% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.72% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.49% : 0.000002s : 10: predicate.cast_eliminate 0.79% : 0.000001s : 3: predicate.check_bprop_eliminate 1.36% : 0.000002s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.60% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.04% : 0.000006s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.98% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.53% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.43% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.01% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001038 13 44.24% : 0.000459s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.50% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.26% : 0.000542s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034144 72 0.16% : 0.000056s : 1: add_recomputation 0.22% : 0.000074s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.05% : 0.000359s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.84% : 0.006433s : 1: jit_opt_a 0.46% : 0.000156s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.31% : 0.000448s : 1: loop_unroll 1.90% : 0.000648s : 1: mutable_eliminate 2.60% : 0.000886s : 26: opt.transform.jit_opt_a 0.17% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.42% : 0.000486s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000135s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 2.18% : 0.000745s : 1: renormalize.infer 1.64% : 0.000561s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.25% : 0.000085s : 1: rewriter_before_opt_a 0.23% : 0.000077s : 1: symbol_engine_optimizer 66.00% : 0.022537s : 1: type_inference TotalTime = 0.0143632, [30] [bootstrap]: 0.00027467 [type_inference]: 0.00541763 [event_method]: 1.999e-05 [auto_monad]: 6.903e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 3.619e-05 [rewriter_before_opt_a]: 7.426e-05 [expand_dump_flag]: 2.79999e-06 [jit_opt_a]: 0.00559831, [2] [Cycle 1]: 0.00177085, [27] [switch_simplify]: 5.835e-05 [loop_unroll]: 3.118e-05 [a_1]: 0.00055154 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 7.36999e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.8e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.41002e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00076794 [add_forward_monad_depend]: 5.49e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.639e-05 [cse]: 3.214e-05 [replace_applicator]: 1.271e-05 [Cycle 2]: 0.00032571, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 4.94e-06 [a_1]: 9.637e-05 [with_stream_mark]: 9.62001e-06 [recompute_prepare]: 4.70001e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 4.75999e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 4.74002e-06 [meta_shard_fg_expand]: 1.04e-06 [get_grad_eliminate_]: 4.54002e-06 [merge_forward]: 2.63998e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.384e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.49998e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 4.84e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.2e-06 [cse]: 1.061e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 1.146e-05 [rewriter_after_opt_a]: 3.817e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00058874 [jit_opt_b]: 5.051e-05, [1] [Cycle 1]: 4.252e-05, [2] [frontend_op_eliminate]: 1.523e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 3.048e-05 [loop_unroll]: 0.00046799 [jit_opt_after_cconv]: 0.00014871, [1] [Cycle 1]: 0.00014228, [11] [c_1]: 2.033e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 7.7e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 2.447e-05 [call_graph_tuple_transform]: 1.982e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.05999e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 5.82001e-06 [add_recomputation]: 6.017e-05 [cse_after_recomputation]: 2.15e-05, [1] [Cycle 1]: 1.654e-05, [1] [cse]: 1.105e-05 [auto_monad_reorder]: 1.493e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 6.20002e-06 [opt_after_jit_grad]: 0.00043454 [symbol_engine_optimizer]: 9.408e-05, [1] [Cycle 1]: 8.406e-05, [6] [build]: 4.50001e-06 [elim_shapecalc]: 1.469e-05 [elim_not_effective]: 1.397e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 3.9002e-07 [validate]: 4.27e-05 Sums bootstrap : 0.000275s : 2.85% type_inference : 0.005418s : 56.27% event_method : 0.000020s : 0.21% auto_monad : 0.000069s : 0.72% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.38% rewriter_before_opt_a : 0.000074s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.67% jit_opt_a.loop_unroll : 0.000036s : 0.38% jit_opt_a.a_1 : 0.000648s : 6.73% jit_opt_a.with_stream_mark : 0.000031s : 0.32% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000768s : 7.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.25% jit_opt_a.cse : 0.000043s : 0.44% jit_opt_a.replace_applicator : 0.000018s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000038s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000589s : 6.11% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000030s : 0.32% loop_unroll : 0.000468s : 4.86% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000024s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000060s : 0.62% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000015s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000435s : 4.51% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000015s : 0.15% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.44% Time group info: ------[substitution.] 0.000228 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 3: substitution.graph_param_transform 84.32% : 0.000192s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000005s : 2: substitution.replace_old_param 5.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005348 2 70.24% : 0.003757s : 1: type_inference.infer 29.76% : 0.001592s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.80% : 0.000046s : 4: replace.inline 31.20% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.08% : 0.000189s : 4: match.inline 5.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 2.47% : 0.000003s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 1.14% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000002s : 15: predicate.load_eliminater 2.01% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.38% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.47% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.79% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.46% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001356 13 24.86% : 0.000337s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.36% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 71.78% : 0.000973s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016048 72 0.40% : 0.000063s : 1: add_recomputation 0.45% : 0.000072s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 1.83% : 0.000294s : 1: bootstrap 0.21% : 0.000033s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 34.91% : 0.005602s : 1: jit_opt_a 0.95% : 0.000152s : 1: jit_opt_after_cconv 0.33% : 0.000054s : 1: jit_opt_b 2.97% : 0.000476s : 1: loop_unroll 3.75% : 0.000601s : 1: mutable_eliminate 5.38% : 0.000864s : 26: opt.transform.jit_opt_a 0.30% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000039s : 4: opt.transform.symbol_engine_opt 6.66% : 0.001069s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.67% : 0.000429s : 1: renormalize.infer 2.06% : 0.000330s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000041s : 1: rewriter_after_opt_a 0.48% : 0.000077s : 1: rewriter_before_opt_a 0.61% : 0.000098s : 1: symbol_engine_optimizer 33.88% : 0.005436s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.284.766 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065700> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.285.420 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.147304, [30] [bootstrap]: 0.00036618 [type_inference]: 0.132663 [event_method]: 2.497e-05 [auto_monad]: 6.937e-05 [graph_reusing]: 5.68002e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00063341 [rewriter_before_opt_a]: 0.0001242 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0106908, [2] [Cycle 1]: 0.00655533, [27] [switch_simplify]: 6.896e-05 [loop_unroll]: 3.386e-05 [a_1]: 0.00079999 [with_stream_mark]: 1.868e-05 [recompute_prepare]: 9.97001e-06 [updatestate_depend_eliminate]: 4.81997e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.98999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 8.52998e-06 [updatestate_useless_node_eliminater]: 7.3e-06 [accelerated_algorithm]: 8.12998e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 7.25e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 1.214e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 7.06001e-06 [renormalize]: 0.0052394 [add_forward_monad_depend]: 7.2e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 1.57e-05 [cse]: 3.688e-05 [replace_applicator]: 2.421e-05 [Cycle 2]: 0.00040277, [27] [switch_simplify]: 7.73001e-06 [loop_unroll]: 6.79001e-06 [a_1]: 0.00013444 [with_stream_mark]: 1.306e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.87002e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 3.40003e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.01e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.524e-05 [replace_applicator]: 6.44001e-06 [py_interpret_to_execute_after_opt_a]: 1.401e-05 [rewriter_after_opt_a]: 3.939e-05 [convert_after_rewriter]: 7.12997e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00077788 [jit_opt_b]: 6.026e-05, [1] [Cycle 1]: 5.256e-05, [2] [frontend_op_eliminate]: 2.219e-05 [inline_after_opt_a]: 1.88e-05 [cconv]: 2.689e-05 [loop_unroll]: 0.00051227 [jit_opt_after_cconv]: 0.00016832, [1] [Cycle 1]: 0.0001616, [11] [c_1]: 2.796e-05 [parameter_eliminate]: 3.31999e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.736e-05 [call_graph_tuple_transform]: 2.351e-05 [tuple_list_get_item_eliminator]: 6.86001e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.68e-06 [remove_dup_value]: 1.732e-05 [partial_unused_args_eliminate]: 3.03e-06 [environ_conv]: 9.39e-06 [add_recomputation]: 5.002e-05 [cse_after_recomputation]: 2.697e-05, [1] [Cycle 1]: 2.162e-05, [1] [cse]: 1.534e-05 [auto_monad_reorder]: 1.822e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 6.07001e-06 [opt_after_jit_grad]: 0.00050029 [symbol_engine_optimizer]: 8.181e-05, [1] [Cycle 1]: 7.436e-05, [6] [build]: 3.28998e-06 [elim_shapecalc]: 9.27001e-06 [elim_not_effective]: 1.434e-05 [opt_reshape]: 8.51002e-06 [fold_const_symbol]: 9.22999e-06 [renormalize]: 2.89991e-07 [validate]: 0.00020271 Sums bootstrap : 0.000366s : 0.26% type_inference : 0.132663s : 92.81% event_method : 0.000025s : 0.02% auto_monad : 0.000069s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000633s : 0.44% rewriter_before_opt_a : 0.000124s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000934s : 0.65% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005239s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000778s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000512s : 0.36% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000500s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000203s : 0.14% Time group info: ------[substitution.] 0.000302 25 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 4: substitution.graph_param_transform 86.41% : 0.000261s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 1.57% : 0.000005s : 2: substitution.replace_old_param 5.49% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132574 2 96.59% : 0.128051s : 1: type_inference.infer 3.41% : 0.004523s : 1: type_inference.specialize ------[replace.] 0.000134 7 61.62% : 0.000083s : 5: replace.inline 38.38% : 0.000052s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 94.39% : 0.000258s : 5: match.inline 5.61% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.17% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.52% : 0.000002s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.68% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 4.98% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 2.71% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 1.76% : 0.000003s : 13: predicate.reduce_eliminate 1.83% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.83% : 0.000010s : 64: predicate.switch_simplify 1.52% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.86% : 0.000003s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003135 25 58.99% : 0.001849s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.86% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.15% : 0.001196s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153674 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000073s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000383s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.96% : 0.010695s : 1: jit_opt_a 0.11% : 0.000171s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.34% : 0.000520s : 1: loop_unroll 0.51% : 0.000786s : 1: mutable_eliminate 0.79% : 0.001213s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000508s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000639s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.59% : 0.003981s : 1: renormalize.infer 0.81% : 0.001248s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000130s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 86.34% : 0.132685s : 1: type_inference TotalTime = 0.037301, [30] [bootstrap]: 0.00031723 [type_inference]: 0.02722 [event_method]: 2.342e-05 [auto_monad]: 7.032e-05 [graph_reusing]: 5.79999e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00032153 [rewriter_before_opt_a]: 9.185e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00674367, [2] [Cycle 1]: 0.00256145, [27] [switch_simplify]: 6.805e-05 [loop_unroll]: 3.098e-05 [a_1]: 0.00060137 [with_stream_mark]: 1.865e-05 [recompute_prepare]: 1.015e-05 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 7.50998e-06 [updatestate_useless_node_eliminater]: 6.74999e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 6.38e-06 [renormalize]: 0.00147447 [add_forward_monad_depend]: 5.97999e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.69e-05 [cse]: 3.294e-05 [replace_applicator]: 1.847e-05 [Cycle 2]: 0.00035501, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.00010081 [with_stream_mark]: 1.236e-05 [recompute_prepare]: 5.53002e-06 [updatestate_depend_eliminate]: 3.63999e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 5.50001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 3.01001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 6.63998e-06 [cse]: 1.403e-05 [replace_applicator]: 5.61998e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 3.833e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00071852 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.771e-05, [2] [frontend_op_eliminate]: 1.821e-05 [inline_after_opt_a]: 1.727e-05 [cconv]: 2.667e-05 [loop_unroll]: 0.0004509 [jit_opt_after_cconv]: 0.00016144, [1] [Cycle 1]: 0.00015538, [11] [c_1]: 2.401e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 8.54998e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 4.22e-06 [cse]: 2.669e-05 [call_graph_tuple_transform]: 2.186e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.602e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 7.50998e-06 [add_recomputation]: 5.149e-05 [cse_after_recomputation]: 2.477e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.313e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00053734 [symbol_engine_optimizer]: 0.00013062, [1] [Cycle 1]: 0.00012381, [6] [build]: 3.97e-06 [elim_shapecalc]: 1.044e-05 [elim_not_effective]: 6.111e-05 [opt_reshape]: 7.24001e-06 [fold_const_symbol]: 1.057e-05 [renormalize]: 5.19998e-07 [validate]: 4.63e-05 Sums bootstrap : 0.000317s : 0.97% type_inference : 0.027220s : 82.82% event_method : 0.000023s : 0.07% auto_monad : 0.000070s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000322s : 0.98% rewriter_before_opt_a : 0.000092s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.23% jit_opt_a.loop_unroll : 0.000037s : 0.11% jit_opt_a.a_1 : 0.000702s : 2.14% jit_opt_a.with_stream_mark : 0.000031s : 0.09% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001475s : 4.49% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.07% jit_opt_a.cse : 0.000047s : 0.14% jit_opt_a.replace_applicator : 0.000024s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000038s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000719s : 2.19% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000027s : 0.08% loop_unroll : 0.000451s : 1.37% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000537s : 1.63% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000061s : 0.19% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.14% TotalTime = 0.0132751, [30] [bootstrap]: 0.00034045 [type_inference]: 0.00469542 [event_method]: 1.638e-05 [auto_monad]: 6.3e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 3.309e-05 [rewriter_before_opt_a]: 7.251e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.00518496, [2] [Cycle 1]: 0.00161653, [27] [switch_simplify]: 5.489e-05 [loop_unroll]: 2.867e-05 [a_1]: 0.00052972 [with_stream_mark]: 1.907e-05 [recompute_prepare]: 7.35e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 2.85002e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00064402 [add_forward_monad_depend]: 5.78002e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 3.51e-05 [replace_applicator]: 1.216e-05 [Cycle 2]: 0.00032387, [27] [switch_simplify]: 5.75001e-06 [loop_unroll]: 4.90001e-06 [a_1]: 8.857e-05 [with_stream_mark]: 9.74999e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.215e-05 [j_node_and_user_rematch]: 7.79002e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.82998e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 1.42e-06 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.263e-05 [replace_applicator]: 7.11001e-06 [py_interpret_to_execute_after_opt_a]: 1.377e-05 [rewriter_after_opt_a]: 3.794e-05 [convert_after_rewriter]: 7.36999e-06 [order_py_execute_after_rewriter]: 2.496e-05 [mutable_eliminate]: 0.00116386 [jit_opt_b]: 5.247e-05, [1] [Cycle 1]: 4.382e-05, [2] [frontend_op_eliminate]: 1.558e-05 [inline_after_opt_a]: 1.736e-05 [cconv]: 3.094e-05 [loop_unroll]: 0.00047107 [jit_opt_after_cconv]: 0.00016146, [1] [Cycle 1]: 0.00015399, [11] [c_1]: 2.012e-05 [parameter_eliminate]: 4.4e-06 [updatestate_depend_eliminate]: 8.02e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 3.192e-05 [call_graph_tuple_transform]: 1.997e-05 [tuple_list_get_item_eliminator]: 5.51998e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.675e-05 [partial_unused_args_eliminate]: 2.61999e-06 [environ_conv]: 6.30002e-06 [add_recomputation]: 5.473e-05 [cse_after_recomputation]: 2.396e-05, [1] [Cycle 1]: 1.868e-05, [1] [cse]: 1.265e-05 [auto_monad_reorder]: 1.975e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 7.88999e-06 [opt_after_jit_grad]: 0.00046302 [symbol_engine_optimizer]: 7.131e-05, [1] [Cycle 1]: 6.5e-05, [6] [build]: 4.75999e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.206e-05 [opt_reshape]: 5.15999e-06 [fold_const_symbol]: 8.27998e-06 [renormalize]: 4.20026e-07 [validate]: 4.387e-05 Sums bootstrap : 0.000340s : 3.61% type_inference : 0.004695s : 49.76% event_method : 0.000016s : 0.17% auto_monad : 0.000063s : 0.67% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000033s : 0.35% rewriter_before_opt_a : 0.000073s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.64% jit_opt_a.loop_unroll : 0.000034s : 0.36% jit_opt_a.a_1 : 0.000618s : 6.55% jit_opt_a.with_stream_mark : 0.000029s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000644s : 6.83% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000048s : 0.51% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000038s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000025s : 0.26% mutable_eliminate : 0.001164s : 12.33% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000031s : 0.33% loop_unroll : 0.000471s : 4.99% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000032s : 0.34% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000055s : 0.58% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000020s : 0.21% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000008s : 0.08% opt_after_jit_grad : 0.000463s : 4.91% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.46% Time group info: ------[substitution.] 0.000234 23 1.13% : 0.000003s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 3: substitution.graph_param_transform 84.32% : 0.000197s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000005s : 2: substitution.replace_old_param 5.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027115 2 91.47% : 0.024802s : 1: type_inference.infer 8.53% : 0.002313s : 1: type_inference.specialize ------[replace.] 0.000092 6 66.34% : 0.000061s : 4: replace.inline 33.66% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.31% : 0.000195s : 4: match.inline 5.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 2.17% : 0.000003s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 2.25% : 0.000003s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.62% : 0.000001s : 3: predicate.check_bprop_eliminate 0.92% : 0.000001s : 10: predicate.compare_switch_simplify 1.01% : 0.000001s : 10: predicate.depend_value_elim 0.96% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.62% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.65% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.52% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 4.92% : 0.000007s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.80% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.46% : 0.000002s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.00% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.48% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.27% : 0.000004s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.72% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.48% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.51% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.89% : 0.000003s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001061 13 38.21% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.10% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.69% : 0.000623s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039833 72 0.14% : 0.000054s : 1: add_recomputation 0.18% : 0.000073s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.82% : 0.000328s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.94% : 0.006749s : 1: jit_opt_a 0.41% : 0.000165s : 1: jit_opt_after_cconv 0.14% : 0.000057s : 1: jit_opt_b 1.15% : 0.000459s : 1: loop_unroll 1.83% : 0.000727s : 1: mutable_eliminate 2.38% : 0.000948s : 26: opt.transform.jit_opt_a 0.14% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000084s : 4: opt.transform.symbol_engine_opt 1.37% : 0.000546s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.83% : 0.000329s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.15% : 0.000858s : 1: renormalize.infer 1.52% : 0.000606s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000096s : 1: rewriter_before_opt_a 0.34% : 0.000134s : 1: symbol_engine_optimizer 68.37% : 0.027233s : 1: type_inference Time group info: ------[substitution.] 0.000214 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000005s : 3: substitution.graph_param_transform 84.26% : 0.000180s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000004s : 4: substitution.remove_not_recompute_node 2.27% : 0.000005s : 2: substitution.replace_old_param 6.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004637 2 83.41% : 0.003867s : 1: type_inference.infer 16.59% : 0.000769s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.28% : 0.000045s : 4: replace.inline 31.72% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 93.81% : 0.000178s : 4: match.inline 6.19% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.16% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.77% : 0.000003s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 1.27% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.93% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000598 13 54.75% : 0.000328s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.96% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.28% : 0.000229s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014801 72 0.39% : 0.000057s : 1: add_recomputation 0.45% : 0.000066s : 1: auto_monad 0.15% : 0.000022s : 1: auto_monad_reorder 2.43% : 0.000360s : 1: bootstrap 0.23% : 0.000033s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.13% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 35.05% : 0.005188s : 1: jit_opt_a 1.11% : 0.000165s : 1: jit_opt_after_cconv 0.37% : 0.000055s : 1: jit_opt_b 3.24% : 0.000480s : 1: loop_unroll 7.97% : 0.001180s : 1: mutable_eliminate 5.60% : 0.000829s : 26: opt.transform.jit_opt_a 0.32% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.14% : 0.000021s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.20% : 0.000473s : 1: opt_after_jit_grad 0.19% : 0.000028s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000036s : 1: py_interpret_to_execute 0.11% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.35% : 0.000347s : 1: renormalize.infer 1.95% : 0.000288s : 1: renormalize.specialize 0.07% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000041s : 1: rewriter_after_opt_a 0.51% : 0.000075s : 1: rewriter_before_opt_a 0.50% : 0.000074s : 1: symbol_engine_optimizer 31.81% : 0.004708s : 1: type_inference TotalTime = 0.0514346, [30] [bootstrap]: 0.00024449 [type_inference]: 0.0167982 [event_method]: 6.287e-05 [auto_monad]: 0.00012548 [graph_reusing]: 7.58999e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 3.831e-05 [rewriter_before_opt_a]: 0.00012862 [expand_dump_flag]: 3.63999e-06 [jit_opt_a]: 0.0316175, [3] [Cycle 1]: 0.0134696, [27] [switch_simplify]: 7.996e-05 [loop_unroll]: 4.448e-05 [a_1]: 0.00100836 [with_stream_mark]: 3.771e-05 [recompute_prepare]: 2.457e-05 [updatestate_depend_eliminate]: 1e-05 [updatestate_assign_eliminate]: 7.1e-06 [updatestate_loads_eliminate]: 7.2e-06 [parameter_eliminate]: 3.00002e-06 [specialize_transform]: 1.513e-05 [updatestate_useless_node_eliminater]: 1.283e-05 [accelerated_algorithm]: 1.367e-05 [meta_shard_fg_expand]: 3.81999e-06 [get_grad_eliminate_]: 1.311e-05 [merge_forward]: 1.061e-05 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.048e-05 [j_node_and_user_rematch]: 2.559e-05 [meta_fg_expand]: 0.00221152 [replace_old_param]: 8.003e-05 [inline_without_move]: 6.563e-05 [renormalize]: 0.00904931 [add_forward_monad_depend]: 1.341e-05 [auto_monad_grad]: 6.79001e-06 [auto_monad_eliminator]: 6.29e-05 [cse]: 0.00024676 [replace_applicator]: 8.689e-05 [Cycle 2]: 0.0140007, [27] [switch_simplify]: 4.155e-05 [loop_unroll]: 3.878e-05 [a_1]: 0.00128691 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 1.024e-05 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 4.08001e-06 [updatestate_loads_eliminate]: 4.05e-06 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 7.40998e-06 [updatestate_useless_node_eliminater]: 6.84001e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 3.13998e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 0.00011374 [replace_old_param]: 8.16002e-06 [inline_without_move]: 6.61e-06 [renormalize]: 0.0120971 [add_forward_monad_depend]: 1.164e-05 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 2.424e-05 [cse]: 3.52e-05 [replace_applicator]: 2.707e-05 [Cycle 3]: 0.00035361, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.39e-06 [a_1]: 8.547e-05 [with_stream_mark]: 1.629e-05 [recompute_prepare]: 5.01002e-06 [updatestate_depend_eliminate]: 4.69002e-06 [updatestate_assign_eliminate]: 4.03001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 4.57998e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 3.38e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.756e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 3.04999e-06 [replace_old_param]: 4.64998e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.307e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.706e-05 [rewriter_after_opt_a]: 4.197e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00076364 [jit_opt_b]: 4.742e-05, [1] [Cycle 1]: 3.945e-05, [2] [frontend_op_eliminate]: 1.44e-05 [inline_after_opt_a]: 1.412e-05 [cconv]: 2.897e-05 [loop_unroll]: 0.00042156 [jit_opt_after_cconv]: 0.00015018, [1] [Cycle 1]: 0.00014364, [11] [c_1]: 1.745e-05 [parameter_eliminate]: 3.60998e-06 [updatestate_depend_eliminate]: 6.00002e-06 [updatestate_assign_eliminate]: 2.33998e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.614e-05 [call_graph_tuple_transform]: 1.925e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.06002e-06 [remove_dup_value]: 1.769e-05 [partial_unused_args_eliminate]: 3.03998e-06 [environ_conv]: 6.65002e-06 [add_recomputation]: 4.979e-05 [cse_after_recomputation]: 2.376e-05, [1] [Cycle 1]: 1.872e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.571e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 5.98002e-06 [opt_after_jit_grad]: 0.00046931 [symbol_engine_optimizer]: 8.911e-05, [1] [Cycle 1]: 8.322e-05, [6] [build]: 4.34002e-06 [elim_shapecalc]: 1.867e-05 [elim_not_effective]: 1.432e-05 [opt_reshape]: 5.35001e-06 [fold_const_symbol]: 8.41002e-06 [renormalize]: 6.00005e-07 [validate]: 4.012e-05 Sums bootstrap : 0.000244s : 0.52% type_inference : 0.016798s : 35.98% event_method : 0.000063s : 0.13% auto_monad : 0.000125s : 0.27% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000038s : 0.08% rewriter_before_opt_a : 0.000129s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000128s : 0.27% jit_opt_a.loop_unroll : 0.000089s : 0.19% jit_opt_a.a_1 : 0.002381s : 5.10% jit_opt_a.with_stream_mark : 0.000073s : 0.16% jit_opt_a.recompute_prepare : 0.000040s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.05% jit_opt_a.accelerated_algorithm : 0.000026s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.05% jit_opt_a.merge_forward : 0.000019s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000065s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.10% jit_opt_a.meta_fg_expand : 0.002328s : 4.99% jit_opt_a.replace_old_param : 0.000093s : 0.20% jit_opt_a.inline_without_move : 0.000077s : 0.16% jit_opt_a.renormalize : 0.021146s : 45.29% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000093s : 0.20% jit_opt_a.cse : 0.000295s : 0.63% jit_opt_a.replace_applicator : 0.000119s : 0.26% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000042s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000764s : 1.64% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.03% jit_opt_b.inline_after_opt_a : 0.000014s : 0.03% cconv : 0.000029s : 0.06% loop_unroll : 0.000422s : 0.90% jit_opt_after_cconv.c_1 : 0.000017s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000469s : 1.01% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000019s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.09% Time group info: ------[substitution.] 0.000624 109 0.45% : 0.000003s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 0.94% : 0.000006s : 2: substitution.graph_param_transform 66.06% : 0.000412s : 13: substitution.inline 3.59% : 0.000022s : 2: substitution.inline_without_move 1.75% : 0.000011s : 13: substitution.j_node_and_user_rematch 2.03% : 0.000013s : 7: substitution.minmaximum_grad 1.14% : 0.000007s : 5: substitution.partial_eliminate 1.95% : 0.000012s : 13: substitution.remove_not_recompute_node 5.05% : 0.000032s : 10: substitution.replace_applicator 1.18% : 0.000007s : 10: substitution.replace_old_param 0.64% : 0.000004s : 1: substitution.set_cell_output_no_recompute 1.04% : 0.000006s : 1: substitution.tile_eliminate 3.86% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.59% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.55% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016693 2 90.13% : 0.015045s : 1: type_inference.infer 9.87% : 0.001647s : 1: type_inference.specialize ------[replace.] 0.000189 20 65.65% : 0.000124s : 13: replace.inline 34.35% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000427 20 94.43% : 0.000403s : 13: match.inline 5.57% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000385 2517 1.74% : 0.000007s : 43: predicate.accumulaten_eliminater 0.32% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.66% : 0.000006s : 43: predicate.addn_check_dump 1.77% : 0.000007s : 43: predicate.addn_zero_filter 2.21% : 0.000009s : 43: predicate.arithmetic_simplify 1.50% : 0.000006s : 43: predicate.cast_eliminate 0.12% : 0.000000s : 2: predicate.check_bprop_eliminate 1.43% : 0.000006s : 43: predicate.compare_switch_simplify 1.43% : 0.000006s : 43: predicate.depend_value_elim 1.57% : 0.000006s : 43: predicate.dict_get_item_const_eliminator 1.46% : 0.000006s : 43: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 43: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.12% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000006s : 43: predicate.environ_add_const_eliminate 1.39% : 0.000005s : 43: predicate.environ_get_add_eliminate 1.36% : 0.000005s : 43: predicate.environ_get_depend_swap 1.60% : 0.000006s : 43: predicate.environ_get_eliminate 1.39% : 0.000005s : 43: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.81% : 0.000003s : 17: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.37% : 0.000017s : 67: predicate.inline 2.13% : 0.000008s : 45: predicate.inline_without_move 0.30% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.18% : 0.000005s : 17: predicate.less_batch_normalization 1.77% : 0.000007s : 50: predicate.list_to_tuple_eliminator_ 1.80% : 0.000007s : 52: predicate.load_eliminater 0.36% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.22% : 0.000012s : 88: predicate.loop_unroll_before_grad 1.84% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.40% : 0.000005s : 43: predicate.merge_addn 1.43% : 0.000006s : 43: predicate.minmaximum_grad 0.38% : 0.000001s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.35% : 0.000009s : 52: predicate.partial_eliminate 1.43% : 0.000006s : 43: predicate.print_const_string_wrapper 2.11% : 0.000008s : 43: predicate.reduce_eliminate 1.98% : 0.000008s : 50: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000002s : 17: predicate.remove_not_recompute_node 2.59% : 0.000010s : 93: predicate.replace_applicator 1.16% : 0.000004s : 45: predicate.replace_old_param 0.08% : 0.000000s : 2: predicate.reset_defer_inline 1.56% : 0.000006s : 43: predicate.reshape_eliminate 1.63% : 0.000006s : 43: predicate.row_tensor_add_zeros_like 0.26% : 0.000001s : 2: predicate.row_tensor_eliminate 1.45% : 0.000006s : 43: predicate.same_eliminate 0.46% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 4: predicate.special_op_eliminate 1.09% : 0.000004s : 17: predicate.specialize_transform 1.77% : 0.000007s : 43: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 43: predicate.stack_unstack_eliminate 0.15% : 0.000001s : 2: predicate.switch_call_monad_eliminater 2.93% : 0.000011s : 63: predicate.switch_defer_inline 2.42% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.28% : 0.000024s : 153: predicate.switch_simplify 1.57% : 0.000006s : 43: predicate.tile_eliminate 1.59% : 0.000006s : 43: predicate.transpose_eliminate 1.81% : 0.000007s : 43: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000007s : 43: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000013s : 54: predicate.tuple_list_get_item_eliminator 2.03% : 0.000008s : 43: predicate.tuple_list_set_item_eliminator 1.81% : 0.000007s : 50: predicate.tuple_to_list_eliminator_ 1.76% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.68% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.85% : 0.000007s : 43: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002644 36 58.50% : 0.001547s : 19: func_graph_cloner_run.FuncGraphClonerGraph 41.50% : 0.001097s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075694 87 0.07% : 0.000053s : 1: add_recomputation 0.17% : 0.000132s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.35% : 0.000266s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.09% : 0.000069s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 41.78% : 0.031622s : 1: jit_opt_a 0.20% : 0.000153s : 1: jit_opt_after_cconv 0.07% : 0.000050s : 1: jit_opt_b 0.57% : 0.000430s : 1: loop_unroll 1.02% : 0.000775s : 1: mutable_eliminate 4.07% : 0.003080s : 39: opt.transform.jit_opt_a 0.06% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000023s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000041s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 24.82% : 0.018784s : 2: renormalize.infer 3.09% : 0.002335s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.17% : 0.000132s : 1: rewriter_before_opt_a 0.12% : 0.000092s : 1: symbol_engine_optimizer 22.22% : 0.016821s : 1: type_inference TotalTime = 0.0367709, [30] [bootstrap]: 0.00040764 [type_inference]: 0.0254903 [event_method]: 2.03e-05 [auto_monad]: 7.076e-05 [graph_reusing]: 6.40002e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 0.00015231 [rewriter_before_opt_a]: 8.675e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00823976, [2] [Cycle 1]: 0.00246681, [27] [switch_simplify]: 7.214e-05 [loop_unroll]: 3.011e-05 [a_1]: 0.00061335 [with_stream_mark]: 1.906e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.40003e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.94001e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 6.06003e-06 [renormalize]: 0.00138022 [add_forward_monad_depend]: 7.5e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 1.606e-05 [cse]: 3.2e-05 [replace_applicator]: 1.606e-05 [Cycle 2]: 0.00033558, [27] [switch_simplify]: 5.93002e-06 [loop_unroll]: 5.57999e-06 [a_1]: 9.562e-05 [with_stream_mark]: 1.053e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 3.51001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 7.5e-06 [inline_without_move]: 5.00999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 6.08002e-06 [cse]: 1.308e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.273e-05 [rewriter_after_opt_a]: 3.974e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.51998e-06 [mutable_eliminate]: 0.00071339 [jit_opt_b]: 5.133e-05, [1] [Cycle 1]: 4.44e-05, [2] [frontend_op_eliminate]: 1.722e-05 [inline_after_opt_a]: 1.601e-05 [cconv]: 2.7e-05 [loop_unroll]: 0.00042367 [jit_opt_after_cconv]: 0.00014038, [1] [Cycle 1]: 0.00013421, [11] [c_1]: 2.159e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.42999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.103e-05 [call_graph_tuple_transform]: 1.826e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.582e-05 [partial_unused_args_eliminate]: 2.05002e-06 [environ_conv]: 5.89e-06 [add_recomputation]: 5.019e-05 [cse_after_recomputation]: 2.211e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.164e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 4.35e-06 [opt_after_jit_grad]: 0.0004404 [symbol_engine_optimizer]: 6.964e-05, [1] [Cycle 1]: 6.341e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.23e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 3.19997e-07 [validate]: 3.82e-05 Sums bootstrap : 0.000408s : 1.33% type_inference : 0.025490s : 82.95% event_method : 0.000020s : 0.07% auto_monad : 0.000071s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000152s : 0.50% rewriter_before_opt_a : 0.000087s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000709s : 2.31% jit_opt_a.with_stream_mark : 0.000030s : 0.10% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001380s : 4.49% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000045s : 0.15% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000040s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000713s : 2.32% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000027s : 0.09% loop_unroll : 0.000424s : 1.38% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000440s : 1.43% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.12% Time group info: ------[substitution.] 0.000246 23 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000005s : 3: substitution.graph_param_transform 85.61% : 0.000210s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.50% : 0.000004s : 2: substitution.replace_old_param 5.94% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025405 2 91.73% : 0.023304s : 1: type_inference.infer 8.27% : 0.002101s : 1: type_inference.specialize ------[replace.] 0.000093 6 65.98% : 0.000062s : 4: replace.inline 34.02% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 93.97% : 0.000208s : 4: match.inline 6.03% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.50% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.59% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.49% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.55% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.54% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.52% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.47% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.94% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001072 13 43.88% : 0.000470s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.38% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.74% : 0.000565s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039119 72 0.13% : 0.000053s : 1: add_recomputation 0.19% : 0.000074s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 1.08% : 0.000424s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 21.07% : 0.008244s : 1: jit_opt_a 0.37% : 0.000143s : 1: jit_opt_after_cconv 0.14% : 0.000054s : 1: jit_opt_b 1.10% : 0.000430s : 1: loop_unroll 1.85% : 0.000723s : 1: mutable_eliminate 2.43% : 0.000950s : 26: opt.transform.jit_opt_a 0.12% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.14% : 0.000447s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000156s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.06% : 0.000808s : 1: renormalize.infer 1.44% : 0.000563s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.23% : 0.000090s : 1: rewriter_before_opt_a 0.18% : 0.000072s : 1: symbol_engine_optimizer 65.20% : 0.025505s : 1: type_inference TotalTime = 0.0142931, [30] [bootstrap]: 0.0003305 [type_inference]: 0.00552678 [event_method]: 2.032e-05 [auto_monad]: 6.863e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 4.949e-05 [rewriter_before_opt_a]: 7.967e-05 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.00580118, [2] [Cycle 1]: 0.00190461, [27] [switch_simplify]: 5.978e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00058596 [with_stream_mark]: 2.125e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 8.90999e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 0.00086635 [add_forward_monad_depend]: 6.21e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.652e-05 [cse]: 3.289e-05 [replace_applicator]: 1.301e-05 [Cycle 2]: 0.00032128, [27] [switch_simplify]: 5.59998e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.624e-05 [with_stream_mark]: 9.86998e-06 [recompute_prepare]: 4.95001e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 1.91e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.11997e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.09998e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.50002e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.64002e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.102e-05 [replace_applicator]: 5.11002e-06 [py_interpret_to_execute_after_opt_a]: 1.208e-05 [rewriter_after_opt_a]: 3.767e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00063353 [jit_opt_b]: 5.079e-05, [1] [Cycle 1]: 4.289e-05, [2] [frontend_op_eliminate]: 1.665e-05 [inline_after_opt_a]: 1.556e-05 [cconv]: 2.957e-05 [loop_unroll]: 0.00051873 [jit_opt_after_cconv]: 0.00017899, [1] [Cycle 1]: 0.00017137, [11] [c_1]: 2.294e-05 [parameter_eliminate]: 3.55998e-06 [updatestate_depend_eliminate]: 6.54999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.375e-05 [call_graph_tuple_transform]: 2.017e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 6.31998e-06 [remove_dup_value]: 1.589e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 6.09999e-06 [add_recomputation]: 5.273e-05 [cse_after_recomputation]: 2.255e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.603e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 6.68e-06 [opt_after_jit_grad]: 0.00050657 [symbol_engine_optimizer]: 7.917e-05, [1] [Cycle 1]: 7.247e-05, [6] [build]: 4.53999e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.457e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 4.10015e-07 [validate]: 3.973e-05 Sums bootstrap : 0.000330s : 3.27% type_inference : 0.005527s : 54.71% event_method : 0.000020s : 0.20% auto_monad : 0.000069s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000049s : 0.49% rewriter_before_opt_a : 0.000080s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.34% jit_opt_a.a_1 : 0.000682s : 6.75% jit_opt_a.with_stream_mark : 0.000031s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000866s : 8.58% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000044s : 0.43% jit_opt_a.replace_applicator : 0.000018s : 0.18% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000038s : 0.37% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000634s : 6.27% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000030s : 0.29% loop_unroll : 0.000519s : 5.13% jit_opt_after_cconv.c_1 : 0.000023s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.52% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000507s : 5.01% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.39% Time group info: ------[substitution.] 0.000249 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 85.69% : 0.000213s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 5.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005450 2 78.99% : 0.004305s : 1: type_inference.infer 21.01% : 0.001145s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.04% : 0.000052s : 4: replace.inline 30.96% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.57% : 0.000211s : 4: match.inline 5.43% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.82% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.97% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000002s : 10: predicate.print_const_string_wrapper 2.00% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.60% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.97% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000829 13 44.81% : 0.000371s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.33% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.86% : 0.000405s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016119 72 0.34% : 0.000056s : 1: add_recomputation 0.45% : 0.000072s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 2.18% : 0.000351s : 1: bootstrap 0.20% : 0.000032s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.01% : 0.005804s : 1: jit_opt_a 1.13% : 0.000182s : 1: jit_opt_after_cconv 0.33% : 0.000053s : 1: jit_opt_b 3.27% : 0.000528s : 1: loop_unroll 3.99% : 0.000643s : 1: mutable_eliminate 5.57% : 0.000898s : 26: opt.transform.jit_opt_a 0.32% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.19% : 0.000515s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000052s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.88% : 0.000464s : 1: renormalize.infer 2.44% : 0.000394s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000040s : 1: rewriter_after_opt_a 0.51% : 0.000082s : 1: rewriter_before_opt_a 0.51% : 0.000082s : 1: symbol_engine_optimizer 34.41% : 0.005546s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.417.282 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065b80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.418.043 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0357224, [30] [bootstrap]: 0.00035717 [type_inference]: 0.0246622 [event_method]: 2.271e-05 [auto_monad]: 7.882e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00019461 [rewriter_before_opt_a]: 9.08e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0074737, [2] [Cycle 1]: 0.00283489, [27] [switch_simplify]: 6.497e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00064881 [with_stream_mark]: 2.235e-05 [recompute_prepare]: 1.092e-05 [updatestate_depend_eliminate]: 4.56002e-06 [updatestate_assign_eliminate]: 3.84002e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.03998e-06 [meta_shard_fg_expand]: 3.66999e-06 [get_grad_eliminate_]: 7.68001e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 2.06998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.729e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 3.01999e-06 [replace_old_param]: 9.81998e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.0016765 [add_forward_monad_depend]: 8.54e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 2.046e-05 [cse]: 3.41e-05 [replace_applicator]: 2.159e-05 [Cycle 2]: 0.00037697, [27] [switch_simplify]: 7.32002e-06 [loop_unroll]: 5.65001e-06 [a_1]: 0.00010733 [with_stream_mark]: 1.314e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.27001e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.29997e-06 [cell_reuse_recompute_pass]: 3.57002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.842e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 5.22e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.49998e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.367e-05 [replace_applicator]: 6.46e-06 [py_interpret_to_execute_after_opt_a]: 1.605e-05 [rewriter_after_opt_a]: 4.058e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.67001e-06 [mutable_eliminate]: 0.00076824 [jit_opt_b]: 5.834e-05, [1] [Cycle 1]: 5.08e-05, [2] [frontend_op_eliminate]: 1.799e-05 [inline_after_opt_a]: 1.959e-05 [cconv]: 3.095e-05 [loop_unroll]: 0.00054133 [jit_opt_after_cconv]: 0.00017171, [1] [Cycle 1]: 0.00016435, [11] [c_1]: 2.511e-05 [parameter_eliminate]: 5.03002e-06 [updatestate_depend_eliminate]: 8.50001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.61999e-06 [cse]: 3.017e-05 [call_graph_tuple_transform]: 2.196e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 6.63e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 5.114e-05 [cse_after_recomputation]: 2.558e-05, [1] [Cycle 1]: 1.901e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.38e-06 [opt_after_jit_grad]: 0.00060611 [symbol_engine_optimizer]: 0.00021653, [1] [Cycle 1]: 0.00020952, [6] [build]: 4.4e-06 [elim_shapecalc]: 0.00013806 [elim_not_effective]: 1.675e-05 [opt_reshape]: 7.32002e-06 [fold_const_symbol]: 9.87999e-06 [renormalize]: 6.39993e-07 [validate]: 4.909e-05 Sums bootstrap : 0.000357s : 1.16% type_inference : 0.024662s : 80.02% event_method : 0.000023s : 0.07% auto_monad : 0.000079s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000195s : 0.63% rewriter_before_opt_a : 0.000091s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.23% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000756s : 2.45% jit_opt_a.with_stream_mark : 0.000035s : 0.12% jit_opt_a.recompute_prepare : 0.000017s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001677s : 5.44% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.09% jit_opt_a.cse : 0.000048s : 0.15% jit_opt_a.replace_applicator : 0.000028s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000041s : 0.13% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000768s : 2.49% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000020s : 0.06% cconv : 0.000031s : 0.10% loop_unroll : 0.000541s : 1.76% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000606s : 1.97% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000138s : 0.45% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.16% Time group info: ------[substitution.] 0.000268 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 3: substitution.graph_param_transform 85.69% : 0.000230s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000005s : 2: substitution.replace_old_param 5.34% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024567 2 89.49% : 0.021985s : 1: type_inference.infer 10.51% : 0.002582s : 1: type_inference.specialize ------[replace.] 0.000094 6 65.62% : 0.000061s : 4: replace.inline 34.38% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 94.55% : 0.000227s : 4: match.inline 5.45% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.56% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 10: predicate.addn_check_dump 1.81% : 0.000003s : 10: predicate.addn_zero_filter 2.12% : 0.000003s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 0.88% : 0.000001s : 10: predicate.compare_switch_simplify 1.01% : 0.000001s : 10: predicate.depend_value_elim 0.94% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.99% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.95% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 2.02% : 0.000003s : 10: predicate.environ_get_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 5.46% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.80% : 0.000003s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.55% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.86% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 15: predicate.partial_eliminate 2.24% : 0.000003s : 10: predicate.print_const_string_wrapper 1.77% : 0.000003s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.67% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.11% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.73% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.41% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000002s : 10: predicate.tile_eliminate 1.11% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.02% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.04% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 2.06% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.36% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001274 13 40.64% : 0.000518s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.20% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.16% : 0.000703s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038480 72 0.14% : 0.000055s : 1: add_recomputation 0.21% : 0.000083s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.96% : 0.000371s : 1: bootstrap 0.09% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.43% : 0.007478s : 1: jit_opt_a 0.45% : 0.000175s : 1: jit_opt_after_cconv 0.16% : 0.000061s : 1: jit_opt_b 1.43% : 0.000550s : 1: loop_unroll 2.02% : 0.000778s : 1: mutable_eliminate 2.62% : 0.001009s : 26: opt.transform.jit_opt_a 0.14% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.05% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000023s : 1: opt.transform.mutable_eliminate 0.07% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.60% : 0.000614s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.51% : 0.000198s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.51% : 0.000966s : 1: renormalize.infer 1.81% : 0.000698s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000044s : 1: rewriter_after_opt_a 0.25% : 0.000094s : 1: rewriter_before_opt_a 0.57% : 0.000219s : 1: symbol_engine_optimizer 64.14% : 0.024680s : 1: type_inference TotalTime = 0.156054, [30] [bootstrap]: 0.00032257 [type_inference]: 0.141173 [event_method]: 2.641e-05 [auto_monad]: 8.213e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00080577 [rewriter_before_opt_a]: 0.00011112 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.0110947, [2] [Cycle 1]: 0.00585559, [27] [switch_simplify]: 7.269e-05 [loop_unroll]: 3.4e-05 [a_1]: 0.00081099 [with_stream_mark]: 2.149e-05 [recompute_prepare]: 9.41e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 8.16002e-06 [updatestate_useless_node_eliminater]: 6.73e-06 [accelerated_algorithm]: 7.56999e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 6.93e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.681e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 1.142e-05 [inline_without_move]: 7.24001e-06 [renormalize]: 0.00453658 [add_forward_monad_depend]: 6.74001e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.709e-05 [cse]: 3.563e-05 [replace_applicator]: 2.114e-05 [Cycle 2]: 0.00040792, [27] [switch_simplify]: 7.48e-06 [loop_unroll]: 6.78e-06 [a_1]: 0.00013142 [with_stream_mark]: 1.365e-05 [recompute_prepare]: 7.03e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.43999e-06 [parameter_eliminate]: 1.61002e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 3.03e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.842e-05 [j_node_and_user_rematch]: 9.19998e-06 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 9.04e-06 [inline_without_move]: 5.99e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 1.21002e-06 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.86e-05 [replace_applicator]: 6.15002e-06 [py_interpret_to_execute_after_opt_a]: 1.466e-05 [rewriter_after_opt_a]: 4.078e-05 [convert_after_rewriter]: 7.50003e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00072738 [jit_opt_b]: 6.149e-05, [1] [Cycle 1]: 5.387e-05, [2] [frontend_op_eliminate]: 2.126e-05 [inline_after_opt_a]: 2.151e-05 [cconv]: 2.432e-05 [loop_unroll]: 0.00044555 [jit_opt_after_cconv]: 0.00017129, [1] [Cycle 1]: 0.00016507, [11] [c_1]: 2.71e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 6.59999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.68998e-06 [cse]: 3.129e-05 [call_graph_tuple_transform]: 2.29e-05 [tuple_list_get_item_eliminator]: 6.88998e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 7.80998e-06 [remove_dup_value]: 1.835e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 8.53001e-06 [add_recomputation]: 5.116e-05 [cse_after_recomputation]: 2.65e-05, [1] [Cycle 1]: 2.111e-05, [1] [cse]: 1.472e-05 [auto_monad_reorder]: 1.676e-05 [get_jit_bprop_graph]: 1.84998e-06 [rewriter_after_jit_bprop_graph]: 7.2e-06 [opt_after_jit_grad]: 0.00048346 [symbol_engine_optimizer]: 8.11e-05, [1] [Cycle 1]: 7.459e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 9.17001e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 8.38999e-06 [fold_const_symbol]: 1.01e-05 [renormalize]: 4.39992e-07 [validate]: 4.771e-05 Sums bootstrap : 0.000323s : 0.21% type_inference : 0.141173s : 93.73% event_method : 0.000026s : 0.02% auto_monad : 0.000082s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000806s : 0.53% rewriter_before_opt_a : 0.000111s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000942s : 0.63% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004537s : 3.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000446s : 0.30% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000483s : 0.32% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.03% Time group info: ------[substitution.] 0.000335 25 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 4: substitution.graph_param_transform 88.79% : 0.000297s : 5: substitution.inline 1.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000006s : 4: substitution.remove_not_recompute_node 1.34% : 0.000004s : 2: substitution.replace_old_param 3.96% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.141062 2 96.11% : 0.135569s : 1: type_inference.infer 3.89% : 0.005493s : 1: type_inference.specialize ------[replace.] 0.000131 7 67.06% : 0.000088s : 5: replace.inline 32.94% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000306 7 96.05% : 0.000294s : 5: match.inline 3.95% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.60% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.61% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.28% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.02% : 0.000003s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.39% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.51% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.47% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.74% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.80% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003280 25 60.36% : 0.001980s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.98% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.67% : 0.001203s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.161884 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000086s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.21% : 0.000336s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.86% : 0.011099s : 1: jit_opt_a 0.11% : 0.000174s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.28% : 0.000452s : 1: loop_unroll 0.45% : 0.000735s : 1: mutable_eliminate 0.75% : 0.001218s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000492s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000811s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 2.06% : 0.003334s : 1: renormalize.infer 0.74% : 0.001192s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000116s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 87.22% : 0.141194s : 1: type_inference TotalTime = 0.200183, [30] [bootstrap]: 0.00033118 [type_inference]: 0.185227 [event_method]: 2.407e-05 [auto_monad]: 7.841e-05 [graph_reusing]: 5.97999e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 0.00081276 [rewriter_before_opt_a]: 0.00010666 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.0107789, [2] [Cycle 1]: 0.00644953, [27] [switch_simplify]: 6.972e-05 [loop_unroll]: 3.675e-05 [a_1]: 0.00082213 [with_stream_mark]: 2.196e-05 [recompute_prepare]: 1.088e-05 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 8.02e-06 [updatestate_useless_node_eliminater]: 6.94999e-06 [accelerated_algorithm]: 7.23e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.78998e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 1.277e-05 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.17e-05 [inline_without_move]: 6.83998e-06 [renormalize]: 0.00509067 [add_forward_monad_depend]: 1.095e-05 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.073e-05 [cse]: 3.494e-05 [replace_applicator]: 2.45e-05 [Cycle 2]: 0.00045111, [27] [switch_simplify]: 8.40999e-06 [loop_unroll]: 7.45998e-06 [a_1]: 0.0001637 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 7.87998e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 6.95998e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.69001e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 4.44998e-06 [cell_reuse_recompute_pass]: 4.66002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.599e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 1.09e-05 [inline_without_move]: 6.26e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 7.43999e-06 [cse]: 1.539e-05 [replace_applicator]: 7.19001e-06 [py_interpret_to_execute_after_opt_a]: 1.563e-05 [rewriter_after_opt_a]: 4.249e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00088687 [jit_opt_b]: 6.628e-05, [1] [Cycle 1]: 5.852e-05, [2] [frontend_op_eliminate]: 2.414e-05 [inline_after_opt_a]: 2.181e-05 [cconv]: 2.682e-05 [loop_unroll]: 0.00048063 [jit_opt_after_cconv]: 0.00018361, [1] [Cycle 1]: 0.00017645, [11] [c_1]: 2.902e-05 [parameter_eliminate]: 3.88999e-06 [updatestate_depend_eliminate]: 7.23999e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.66999e-06 [cse]: 3.092e-05 [call_graph_tuple_transform]: 2.742e-05 [tuple_list_get_item_eliminator]: 7.03998e-06 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 7.63999e-06 [remove_dup_value]: 1.751e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 9.12001e-06 [add_recomputation]: 5.37e-05 [cse_after_recomputation]: 2.699e-05, [1] [Cycle 1]: 2.067e-05, [1] [cse]: 1.442e-05 [auto_monad_reorder]: 1.759e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 8.57e-06 [opt_after_jit_grad]: 0.00051545 [symbol_engine_optimizer]: 0.00019937, [1] [Cycle 1]: 0.00019177, [6] [build]: 5.00001e-06 [elim_shapecalc]: 9.05999e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 8.28001e-06 [fold_const_symbol]: 0.00012231 [renormalize]: 5.8001e-07 [validate]: 5.594e-05 Sums bootstrap : 0.000331s : 0.17% type_inference : 0.185227s : 94.67% event_method : 0.000024s : 0.01% auto_monad : 0.000078s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000813s : 0.42% rewriter_before_opt_a : 0.000107s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.04% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.000986s : 0.50% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005091s : 2.60% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000887s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000481s : 0.25% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000515s : 0.26% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000122s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000346 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000002s : 2: substitution.fold_const_symbol 2.13% : 0.000007s : 4: substitution.graph_param_transform 84.64% : 0.000293s : 5: substitution.inline 1.45% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.07% : 0.000014s : 3: substitution.reduce_eliminate 1.70% : 0.000006s : 4: substitution.remove_not_recompute_node 1.79% : 0.000006s : 2: substitution.replace_old_param 3.16% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.185125 2 97.44% : 0.180384s : 1: type_inference.infer 2.56% : 0.004741s : 1: type_inference.specialize ------[replace.] 0.000123 7 66.62% : 0.000082s : 5: replace.inline 33.38% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000300 7 96.72% : 0.000290s : 5: match.inline 3.28% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000164 886 1.55% : 0.000003s : 13: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.57% : 0.000003s : 13: predicate.addn_zero_filter 2.18% : 0.000004s : 13: predicate.arithmetic_simplify 1.63% : 0.000003s : 13: predicate.cast_eliminate 0.76% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.60% : 0.000003s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 4.70% : 0.000008s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 1.72% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000004s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000004s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.52% : 0.000002s : 13: predicate.reshape_eliminate 1.51% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 1.06% : 0.000002s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.37% : 0.000010s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.49% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.67% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.12% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003316 25 55.90% : 0.001854s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.19% : 0.001366s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.206730 72 0.03% : 0.000056s : 1: add_recomputation 0.04% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.17% : 0.000343s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.22% : 0.010784s : 1: jit_opt_a 0.09% : 0.000186s : 1: jit_opt_after_cconv 0.03% : 0.000069s : 1: jit_opt_b 0.24% : 0.000487s : 1: loop_unroll 0.43% : 0.000895s : 1: mutable_eliminate 0.61% : 0.001269s : 26: opt.transform.jit_opt_a 0.03% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000151s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000523s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000820s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.75% : 0.003627s : 1: renormalize.infer 0.70% : 0.001449s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.05% : 0.000111s : 1: rewriter_before_opt_a 0.10% : 0.000202s : 1: symbol_engine_optimizer 89.61% : 0.185247s : 1: type_inference TotalTime = 0.0351564, [30] [bootstrap]: 0.00039129 [type_inference]: 0.0237216 [event_method]: 2.21e-05 [auto_monad]: 7.174e-05 [graph_reusing]: 6.18002e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00015215 [rewriter_before_opt_a]: 8.536e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00753234, [2] [Cycle 1]: 0.00318317, [27] [switch_simplify]: 7.24e-05 [loop_unroll]: 3.083e-05 [a_1]: 0.00093577 [with_stream_mark]: 2.809e-05 [recompute_prepare]: 9.12999e-06 [updatestate_depend_eliminate]: 5.03002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.70002e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.635e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.091e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00172993 [add_forward_monad_depend]: 8.25e-06 [auto_monad_grad]: 3.20998e-06 [auto_monad_eliminator]: 1.75e-05 [cse]: 3.707e-05 [replace_applicator]: 1.725e-05 [Cycle 2]: 0.0003585, [27] [switch_simplify]: 6.77002e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00010262 [with_stream_mark]: 1.315e-05 [recompute_prepare]: 5.70001e-06 [updatestate_depend_eliminate]: 3.22002e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 4.04997e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 8.94998e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 8.26002e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 7.01001e-06 [cse]: 1.642e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.591e-05 [rewriter_after_opt_a]: 4.203e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00091558 [jit_opt_b]: 5.946e-05, [1] [Cycle 1]: 5.112e-05, [2] [frontend_op_eliminate]: 1.908e-05 [inline_after_opt_a]: 1.944e-05 [cconv]: 3.592e-05 [loop_unroll]: 0.00054305 [jit_opt_after_cconv]: 0.0001836, [1] [Cycle 1]: 0.00017725, [11] [c_1]: 2.482e-05 [parameter_eliminate]: 4.72998e-06 [updatestate_depend_eliminate]: 1.123e-05 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 3.926e-05 [call_graph_tuple_transform]: 2.454e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 2.24001e-06 [renormalize]: 2.09984e-07 [switch_simplify]: 8.33999e-06 [remove_dup_value]: 1.77e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 7.05e-06 [add_recomputation]: 5.982e-05 [cse_after_recomputation]: 2.796e-05, [1] [Cycle 1]: 2.188e-05, [1] [cse]: 1.471e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 2.18998e-06 [rewriter_after_jit_bprop_graph]: 9.29e-06 [opt_after_jit_grad]: 0.00080775 [symbol_engine_optimizer]: 8.845e-05, [1] [Cycle 1]: 8.018e-05, [6] [build]: 6.23998e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.556e-05 [opt_reshape]: 8.33001e-06 [fold_const_symbol]: 1.052e-05 [renormalize]: 7.30011e-07 [validate]: 0.00012417 Sums bootstrap : 0.000391s : 1.28% type_inference : 0.023722s : 77.70% event_method : 0.000022s : 0.07% auto_monad : 0.000072s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000152s : 0.50% rewriter_before_opt_a : 0.000085s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.001038s : 3.40% jit_opt_a.with_stream_mark : 0.000041s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001730s : 5.67% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.08% jit_opt_a.cse : 0.000053s : 0.18% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000916s : 3.00% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000019s : 0.06% cconv : 0.000036s : 0.12% loop_unroll : 0.000543s : 1.78% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000060s : 0.20% cse_after_recomputation.cse : 0.000015s : 0.05% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000808s : 2.65% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000124s : 0.41% Time group info: ------[substitution.] 0.000304 23 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 3: substitution.graph_param_transform 85.78% : 0.000261s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000006s : 4: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_old_param 5.50% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023632 2 90.65% : 0.021422s : 1: type_inference.infer 9.35% : 0.002210s : 1: type_inference.specialize ------[replace.] 0.000133 6 63.78% : 0.000085s : 4: replace.inline 36.22% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 6 94.47% : 0.000258s : 4: match.inline 5.53% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.44% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 2.09% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.41% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000002s : 10: predicate.environ_get_eliminate 1.27% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.37% : 0.000001s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.16% : 0.000008s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 2.99% : 0.000004s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 2.08% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.90% : 0.000001s : 10: predicate.merge_addn 1.24% : 0.000002s : 10: predicate.minmaximum_grad 1.92% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 1.86% : 0.000003s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.06% : 0.000003s : 16: predicate.switch_defer_inline 1.80% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.80% : 0.000009s : 53: predicate.switch_simplify 1.64% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.16% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001151 13 38.91% : 0.000448s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.35% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.74% : 0.000642s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038166 72 0.16% : 0.000062s : 1: add_recomputation 0.20% : 0.000075s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 1.06% : 0.000405s : 1: bootstrap 0.10% : 0.000039s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.75% : 0.007536s : 1: jit_opt_a 0.49% : 0.000187s : 1: jit_opt_after_cconv 0.16% : 0.000062s : 1: jit_opt_b 1.45% : 0.000552s : 1: loop_unroll 2.43% : 0.000928s : 1: mutable_eliminate 3.37% : 0.001286s : 26: opt.transform.jit_opt_a 0.16% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.05% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.08% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.14% : 0.000817s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000156s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.72% : 0.001037s : 1: renormalize.infer 1.79% : 0.000683s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.23% : 0.000089s : 1: rewriter_before_opt_a 0.24% : 0.000091s : 1: symbol_engine_optimizer 62.20% : 0.023738s : 1: type_inference TotalTime = 0.180991, [30] [bootstrap]: 0.00026256 [type_inference]: 0.129765 [event_method]: 0.00048777 [auto_monad]: 0.00011391 [graph_reusing]: 7.53e-06 [pre_auto_parallel]: 3.16999e-06 [py_interpret_to_execute]: 3.781e-05 [rewriter_before_opt_a]: 0.00012314 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.0469384, [3] [Cycle 1]: 0.018565, [27] [switch_simplify]: 7.992e-05 [loop_unroll]: 4.396e-05 [a_1]: 0.0010928 [with_stream_mark]: 3.907e-05 [recompute_prepare]: 2.33e-05 [updatestate_depend_eliminate]: 9.29998e-06 [updatestate_assign_eliminate]: 7.03e-06 [updatestate_loads_eliminate]: 6.69999e-06 [parameter_eliminate]: 3.23e-06 [specialize_transform]: 1.579e-05 [updatestate_useless_node_eliminater]: 1.464e-05 [accelerated_algorithm]: 1.405e-05 [meta_shard_fg_expand]: 4.50001e-06 [get_grad_eliminate_]: 1.434e-05 [merge_forward]: 9.29998e-06 [cell_reuse_recompute_pass]: 1.06997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.989e-05 [j_node_and_user_rematch]: 2.692e-05 [meta_fg_expand]: 0.0020777 [replace_old_param]: 8.082e-05 [inline_without_move]: 6.9e-05 [renormalize]: 0.0141647 [add_forward_monad_depend]: 1.395e-05 [auto_monad_grad]: 6.54001e-06 [auto_monad_eliminator]: 6.459e-05 [cse]: 0.00027095 [replace_applicator]: 9.523e-05 [Cycle 2]: 0.0242773, [27] [switch_simplify]: 4.357e-05 [loop_unroll]: 4.154e-05 [a_1]: 0.00117623 [with_stream_mark]: 2.022e-05 [recompute_prepare]: 1.023e-05 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 4.52e-06 [updatestate_loads_eliminate]: 3.93001e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 6.63e-06 [accelerated_algorithm]: 7e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 6.58998e-06 [merge_forward]: 4.87998e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.819e-05 [j_node_and_user_rematch]: 1.22e-05 [meta_fg_expand]: 0.00011379 [replace_old_param]: 8.20999e-06 [inline_without_move]: 6.69999e-06 [renormalize]: 0.0224343 [add_forward_monad_depend]: 1.318e-05 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 2.683e-05 [cse]: 3.963e-05 [replace_applicator]: 2.993e-05 [Cycle 3]: 0.00036908, [27] [switch_simplify]: 5.86998e-06 [loop_unroll]: 5.75001e-06 [a_1]: 9.033e-05 [with_stream_mark]: 1.922e-05 [recompute_prepare]: 5.27999e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 4.49998e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 3.45998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.121e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 5.24e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.88997e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 6.38003e-06 [cse]: 1.456e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 1.762e-05 [rewriter_after_opt_a]: 4.311e-05 [convert_after_rewriter]: 7.55e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00095639 [jit_opt_b]: 5.912e-05, [1] [Cycle 1]: 4.939e-05, [2] [frontend_op_eliminate]: 1.739e-05 [inline_after_opt_a]: 1.816e-05 [cconv]: 3.706e-05 [loop_unroll]: 0.00070645 [jit_opt_after_cconv]: 0.00020054, [1] [Cycle 1]: 0.00019142, [11] [c_1]: 2.221e-05 [parameter_eliminate]: 7.50998e-06 [updatestate_depend_eliminate]: 1.223e-05 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 4.387e-05 [call_graph_tuple_transform]: 2.672e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 1.63002e-06 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 2.067e-05 [partial_unused_args_eliminate]: 2.76999e-06 [environ_conv]: 7.73001e-06 [add_recomputation]: 5.901e-05 [cse_after_recomputation]: 2.781e-05, [1] [Cycle 1]: 2.104e-05, [1] [cse]: 1.408e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 2.66999e-06 [rewriter_after_jit_bprop_graph]: 1.136e-05 [opt_after_jit_grad]: 0.00065677 [symbol_engine_optimizer]: 8.325e-05, [1] [Cycle 1]: 7.628e-05, [6] [build]: 5.51e-06 [elim_shapecalc]: 7.92998e-06 [elim_not_effective]: 1.521e-05 [opt_reshape]: 5.33002e-06 [fold_const_symbol]: 9.38002e-06 [renormalize]: 5.79981e-07 [validate]: 9.703e-05 Sums bootstrap : 0.000263s : 0.15% type_inference : 0.129765s : 73.62% event_method : 0.000488s : 0.28% auto_monad : 0.000114s : 0.06% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.02% rewriter_before_opt_a : 0.000123s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.07% jit_opt_a.loop_unroll : 0.000091s : 0.05% jit_opt_a.a_1 : 0.002359s : 1.34% jit_opt_a.with_stream_mark : 0.000079s : 0.04% jit_opt_a.recompute_prepare : 0.000039s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.01% jit_opt_a.accelerated_algorithm : 0.000026s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.01% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000069s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000049s : 0.03% jit_opt_a.meta_fg_expand : 0.002194s : 1.24% jit_opt_a.replace_old_param : 0.000094s : 0.05% jit_opt_a.inline_without_move : 0.000080s : 0.05% jit_opt_a.renormalize : 0.036599s : 20.77% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000098s : 0.06% jit_opt_a.cse : 0.000325s : 0.18% jit_opt_a.replace_applicator : 0.000130s : 0.07% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000956s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000037s : 0.02% loop_unroll : 0.000706s : 0.40% jit_opt_after_cconv.c_1 : 0.000022s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000002s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000059s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000657s : 0.37% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000097s : 0.06% Time group info: ------[substitution.] 0.000628 109 0.35% : 0.000002s : 2: substitution.elim_not_effective 0.18% : 0.000001s : 2: substitution.fold_const_symbol 0.98% : 0.000006s : 2: substitution.graph_param_transform 65.57% : 0.000412s : 13: substitution.inline 3.64% : 0.000023s : 2: substitution.inline_without_move 1.86% : 0.000012s : 13: substitution.j_node_and_user_rematch 1.92% : 0.000012s : 7: substitution.minmaximum_grad 1.30% : 0.000008s : 5: substitution.partial_eliminate 2.41% : 0.000015s : 13: substitution.remove_not_recompute_node 5.48% : 0.000034s : 10: substitution.replace_applicator 1.73% : 0.000011s : 10: substitution.replace_old_param 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.06% : 0.000007s : 1: substitution.tile_eliminate 3.65% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.52% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 6.85% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129658 2 97.47% : 0.126378s : 1: type_inference.infer 2.53% : 0.003280s : 1: type_inference.specialize ------[replace.] 0.000190 20 66.05% : 0.000126s : 13: replace.inline 33.95% : 0.000065s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000425 20 94.90% : 0.000403s : 13: match.inline 5.10% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000405 2628 1.57% : 0.000006s : 45: predicate.accumulaten_eliminater 0.41% : 0.000002s : 2: predicate.ad_related_special_op_eliminate 1.36% : 0.000005s : 45: predicate.addn_check_dump 1.54% : 0.000006s : 45: predicate.addn_zero_filter 2.31% : 0.000009s : 45: predicate.arithmetic_simplify 1.60% : 0.000006s : 45: predicate.cast_eliminate 0.19% : 0.000001s : 2: predicate.check_bprop_eliminate 1.53% : 0.000006s : 45: predicate.compare_switch_simplify 1.70% : 0.000007s : 45: predicate.depend_value_elim 1.41% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.41% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.41% : 0.000002s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.15% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.42% : 0.000006s : 45: predicate.environ_get_depend_swap 1.44% : 0.000006s : 45: predicate.environ_get_eliminate 1.41% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.79% : 0.000003s : 18: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.68% : 0.000019s : 69: predicate.inline 2.03% : 0.000008s : 46: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.01% : 0.000004s : 18: predicate.less_batch_normalization 2.03% : 0.000008s : 52: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 54: predicate.load_eliminater 0.54% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.12% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.79% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.41% : 0.000006s : 45: predicate.merge_addn 1.44% : 0.000006s : 45: predicate.minmaximum_grad 0.76% : 0.000003s : 2: predicate.mutable_eliminate 0.14% : 0.000001s : 2: predicate.opt_reshape 2.20% : 0.000009s : 54: predicate.partial_eliminate 1.42% : 0.000006s : 45: predicate.print_const_string_wrapper 2.09% : 0.000008s : 45: predicate.reduce_eliminate 1.77% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 18: predicate.remove_not_recompute_node 2.86% : 0.000012s : 99: predicate.replace_applicator 1.14% : 0.000005s : 46: predicate.replace_old_param 0.05% : 0.000000s : 2: predicate.reset_defer_inline 1.75% : 0.000007s : 45: predicate.reshape_eliminate 1.49% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.36% : 0.000001s : 2: predicate.row_tensor_eliminate 1.57% : 0.000006s : 45: predicate.same_eliminate 0.44% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.26% : 0.000001s : 4: predicate.special_op_eliminate 0.80% : 0.000003s : 18: predicate.specialize_transform 1.70% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.17% : 0.000001s : 2: predicate.switch_call_monad_eliminater 2.65% : 0.000011s : 65: predicate.switch_defer_inline 2.43% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.13% : 0.000025s : 160: predicate.switch_simplify 1.51% : 0.000006s : 45: predicate.tile_eliminate 1.52% : 0.000006s : 45: predicate.transpose_eliminate 1.81% : 0.000007s : 45: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000014s : 56: predicate.tuple_list_get_item_eliminator 1.76% : 0.000007s : 45: predicate.tuple_list_set_item_eliminator 1.86% : 0.000008s : 52: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.66% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.85% : 0.000007s : 45: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.26% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007456 45 85.08% : 0.006344s : 28: func_graph_cloner_run.FuncGraphClonerGraph 14.92% : 0.001112s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.220672 87 0.03% : 0.000062s : 1: add_recomputation 0.05% : 0.000121s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.13% : 0.000285s : 1: bootstrap 0.02% : 0.000040s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.23% : 0.000497s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 21.27% : 0.046943s : 1: jit_opt_a 0.09% : 0.000204s : 1: jit_opt_after_cconv 0.03% : 0.000062s : 1: jit_opt_b 0.33% : 0.000719s : 1: loop_unroll 0.44% : 0.000971s : 1: mutable_eliminate 1.40% : 0.003091s : 39: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000667s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 15.37% : 0.033906s : 2: renormalize.infer 1.21% : 0.002663s : 2: renormalize.specialize 0.01% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.06% : 0.000126s : 1: rewriter_before_opt_a 0.04% : 0.000086s : 1: symbol_engine_optimizer 58.82% : 0.129789s : 1: type_inference TotalTime = 0.0475524, [30] [bootstrap]: 0.00045961 [type_inference]: 0.0287795 [event_method]: 2.455e-05 [auto_monad]: 7.48e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 3.40998e-06 [py_interpret_to_execute]: 5.87e-05 [rewriter_before_opt_a]: 8.233e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.0144411, [2] [Cycle 1]: 0.00240724, [27] [switch_simplify]: 7.687e-05 [loop_unroll]: 2.954e-05 [a_1]: 0.00073914 [with_stream_mark]: 2.575e-05 [recompute_prepare]: 1.228e-05 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 7.17997e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 7.06999e-06 [meta_shard_fg_expand]: 3.98999e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.68001e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.695e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.83998e-06 [replace_old_param]: 1.176e-05 [inline_without_move]: 6.49001e-06 [renormalize]: 0.00110807 [add_forward_monad_depend]: 1.828e-05 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.81e-05 [cse]: 3.123e-05 [replace_applicator]: 1.943e-05 [Cycle 2]: 0.00038539, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00010844 [with_stream_mark]: 1.408e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 4.48999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.847e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 3.30998e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 5.74999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.07999e-06 [auto_monad_grad]: 1.27999e-06 [auto_monad_eliminator]: 7.90998e-06 [cse]: 1.203e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.616e-05 [rewriter_after_opt_a]: 4.003e-05 [convert_after_rewriter]: 7.29001e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00085161 [jit_opt_b]: 6.359e-05, [1] [Cycle 1]: 5.494e-05, [2] [frontend_op_eliminate]: 1.961e-05 [inline_after_opt_a]: 2.166e-05 [cconv]: 3.415e-05 [loop_unroll]: 0.00056363 [jit_opt_after_cconv]: 0.00024857, [1] [Cycle 1]: 0.00024113, [11] [c_1]: 2.452e-05 [parameter_eliminate]: 4.16001e-06 [updatestate_depend_eliminate]: 6.82002e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 3.136e-05 [call_graph_tuple_transform]: 2.327e-05 [tuple_list_get_item_eliminator]: 6.91999e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 7.76001e-06 [remove_dup_value]: 1.701e-05 [partial_unused_args_eliminate]: 2.92002e-06 [environ_conv]: 8.45001e-06 [add_recomputation]: 8.21e-05 [cse_after_recomputation]: 2.657e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.80002e-06 [rewriter_after_jit_bprop_graph]: 8.35001e-06 [opt_after_jit_grad]: 0.00126077 [symbol_engine_optimizer]: 8.824e-05, [1] [Cycle 1]: 7.954e-05, [6] [build]: 5.10001e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 1.71e-05 [opt_reshape]: 6.91001e-06 [fold_const_symbol]: 9.68002e-06 [renormalize]: 4.39992e-07 [validate]: 4.802e-05 Sums bootstrap : 0.000460s : 1.31% type_inference : 0.028780s : 81.97% event_method : 0.000025s : 0.07% auto_monad : 0.000075s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000059s : 0.17% rewriter_before_opt_a : 0.000082s : 0.23% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000083s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000848s : 2.41% jit_opt_a.with_stream_mark : 0.000040s : 0.11% jit_opt_a.recompute_prepare : 0.000017s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001108s : 3.16% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.07% jit_opt_a.cse : 0.000043s : 0.12% jit_opt_a.replace_applicator : 0.000025s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000040s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000852s : 2.43% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000022s : 0.06% cconv : 0.000034s : 0.10% loop_unroll : 0.000564s : 1.61% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000082s : 0.23% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.001261s : 3.59% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.14% Time group info: ------[substitution.] 0.000337 23 0.82% : 0.000003s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 3: substitution.graph_param_transform 87.83% : 0.000296s : 4: substitution.inline 1.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000007s : 4: substitution.remove_not_recompute_node 1.89% : 0.000006s : 2: substitution.replace_old_param 4.23% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028674 2 95.79% : 0.027467s : 1: type_inference.infer 4.21% : 0.001207s : 1: type_inference.specialize ------[replace.] 0.000092 6 68.56% : 0.000063s : 4: replace.inline 31.44% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000307 6 95.70% : 0.000294s : 4: match.inline 4.30% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 691 1.12% : 0.000002s : 10: predicate.accumulaten_eliminater 1.91% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.56% : 0.000002s : 10: predicate.addn_check_dump 1.72% : 0.000003s : 10: predicate.addn_zero_filter 1.97% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000002s : 10: predicate.compare_switch_simplify 1.13% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.02% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.80% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000002s : 10: predicate.environ_get_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 1.36% : 0.000002s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 5.10% : 0.000008s : 22: predicate.inline 1.16% : 0.000002s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.08% : 0.000003s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.05% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 10: predicate.merge_addn 0.89% : 0.000001s : 10: predicate.minmaximum_grad 2.10% : 0.000003s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 2.20% : 0.000003s : 10: predicate.reduce_eliminate 1.80% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.52% : 0.000001s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.80% : 0.000003s : 10: predicate.same_eliminate 0.76% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.70% : 0.000004s : 16: predicate.switch_defer_inline 1.94% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000012s : 53: predicate.switch_simplify 1.12% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.53% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.92% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.27% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000969 13 49.01% : 0.000475s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.53% : 0.000092s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.47% : 0.000402s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049826 72 0.17% : 0.000085s : 1: add_recomputation 0.16% : 0.000078s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.96% : 0.000480s : 1: bootstrap 0.07% : 0.000037s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.06% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 28.99% : 0.014446s : 1: jit_opt_a 0.51% : 0.000252s : 1: jit_opt_after_cconv 0.13% : 0.000066s : 1: jit_opt_b 1.15% : 0.000572s : 1: loop_unroll 1.73% : 0.000864s : 1: mutable_eliminate 2.22% : 0.001107s : 26: opt.transform.jit_opt_a 0.12% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000021s : 1: opt.transform.mutable_eliminate 0.07% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.56% : 0.001274s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000062s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.24% : 0.000618s : 1: renormalize.infer 0.96% : 0.000478s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000044s : 1: rewriter_after_opt_a 0.17% : 0.000086s : 1: rewriter_before_opt_a 0.18% : 0.000091s : 1: symbol_engine_optimizer 57.80% : 0.028799s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.666.136 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.666.968 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0480273, [30] [bootstrap]: 0.00036639 [type_inference]: 0.0257781 [event_method]: 2.546e-05 [auto_monad]: 8.136e-05 [graph_reusing]: 6.98e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00019669 [rewriter_before_opt_a]: 9.892e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.0185517, [2] [Cycle 1]: 0.0134883, [27] [switch_simplify]: 8.064e-05 [loop_unroll]: 3.182e-05 [a_1]: 0.00067612 [with_stream_mark]: 2.462e-05 [recompute_prepare]: 9.84001e-06 [updatestate_depend_eliminate]: 4.94003e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.62e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.742e-05 [j_node_and_user_rematch]: 9.98998e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.136e-05 [inline_without_move]: 6.54001e-06 [renormalize]: 0.0122421 [add_forward_monad_depend]: 9.85002e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 2.242e-05 [cse]: 3.779e-05 [replace_applicator]: 2.826e-05 [Cycle 2]: 0.00045954, [27] [switch_simplify]: 7.38999e-06 [loop_unroll]: 7.33e-06 [a_1]: 0.00014668 [with_stream_mark]: 1.886e-05 [recompute_prepare]: 6.60002e-06 [updatestate_depend_eliminate]: 4.07998e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.97002e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.85001e-06 [cell_reuse_recompute_pass]: 4.67e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.096e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.22001e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 1.023e-05 [cse]: 1.911e-05 [replace_applicator]: 7.06001e-06 [py_interpret_to_execute_after_opt_a]: 1.794e-05 [rewriter_after_opt_a]: 4.746e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00090183 [jit_opt_b]: 5.805e-05, [1] [Cycle 1]: 5.011e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.791e-05 [cconv]: 3.261e-05 [loop_unroll]: 0.00053766 [jit_opt_after_cconv]: 0.00017976, [1] [Cycle 1]: 0.00017193, [11] [c_1]: 2.457e-05 [parameter_eliminate]: 5.12999e-06 [updatestate_depend_eliminate]: 9.91998e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.95e-06 [cse]: 3.121e-05 [call_graph_tuple_transform]: 2.335e-05 [tuple_list_get_item_eliminator]: 8.74998e-06 [none_parameter_eliminate]: 2.12001e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.30002e-06 [remove_dup_value]: 1.883e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.86001e-06 [add_recomputation]: 5.387e-05 [cse_after_recomputation]: 2.968e-05, [1] [Cycle 1]: 2.409e-05, [1] [cse]: 1.549e-05 [auto_monad_reorder]: 1.972e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 6.07001e-06 [opt_after_jit_grad]: 0.00057776 [symbol_engine_optimizer]: 0.00014957, [1] [Cycle 1]: 0.0001422, [6] [build]: 5.17e-06 [elim_shapecalc]: 1.063e-05 [elim_not_effective]: 7.297e-05 [opt_reshape]: 8.89e-06 [fold_const_symbol]: 1.22e-05 [renormalize]: 3.00002e-07 [validate]: 5.024e-05 Sums bootstrap : 0.000366s : 0.86% type_inference : 0.025778s : 60.34% event_method : 0.000025s : 0.06% auto_monad : 0.000081s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000197s : 0.46% rewriter_before_opt_a : 0.000099s : 0.23% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000088s : 0.21% jit_opt_a.loop_unroll : 0.000039s : 0.09% jit_opt_a.a_1 : 0.000823s : 1.93% jit_opt_a.with_stream_mark : 0.000043s : 0.10% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.012242s : 28.66% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.08% jit_opt_a.cse : 0.000057s : 0.13% jit_opt_a.replace_applicator : 0.000035s : 0.08% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000047s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000902s : 2.11% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000033s : 0.08% loop_unroll : 0.000538s : 1.26% jit_opt_after_cconv.c_1 : 0.000025s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000054s : 0.13% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000578s : 1.35% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000073s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.12% Time group info: ------[substitution.] 0.000294 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.25% : 0.000007s : 3: substitution.graph_param_transform 85.61% : 0.000252s : 4: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 4.77% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025668 2 89.94% : 0.023085s : 1: type_inference.infer 10.06% : 0.002583s : 1: type_inference.specialize ------[replace.] 0.000099 6 67.83% : 0.000067s : 4: replace.inline 32.17% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 6 95.04% : 0.000248s : 4: match.inline 4.96% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000170 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 10: predicate.addn_check_dump 1.00% : 0.000002s : 10: predicate.addn_zero_filter 1.77% : 0.000003s : 10: predicate.arithmetic_simplify 1.15% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 0.89% : 0.000002s : 10: predicate.compare_switch_simplify 0.82% : 0.000001s : 10: predicate.depend_value_elim 0.85% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.75% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000002s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 4.11% : 0.000007s : 22: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.37% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.28% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.55% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.73% : 0.000001s : 10: predicate.merge_addn 0.87% : 0.000001s : 10: predicate.minmaximum_grad 1.25% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 1.65% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 16.30% : 0.000028s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000003s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000001s : 3: predicate.reset_defer_inline 0.93% : 0.000002s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.38% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 6: predicate.special_op_eliminate 0.73% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.14% : 0.000004s : 16: predicate.switch_defer_inline 1.69% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.06% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.13% : 0.000002s : 10: predicate.transpose_eliminate 0.92% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.80% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.24% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.37% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.36% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 10: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001422 13 37.41% : 0.000532s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.23% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.36% : 0.000830s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061439 72 0.09% : 0.000057s : 1: add_recomputation 0.14% : 0.000085s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.62% : 0.000382s : 1: bootstrap 0.06% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 30.20% : 0.018557s : 1: jit_opt_a 0.30% : 0.000185s : 1: jit_opt_after_cconv 0.10% : 0.000061s : 1: jit_opt_b 0.89% : 0.000546s : 1: loop_unroll 1.49% : 0.000913s : 1: mutable_eliminate 1.80% : 0.001105s : 26: opt.transform.jit_opt_a 0.10% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000586s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000201s : 1: py_interpret_to_execute 0.03% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 18.46% : 0.011344s : 1: renormalize.infer 1.44% : 0.000884s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000050s : 1: rewriter_after_opt_a 0.17% : 0.000103s : 1: rewriter_before_opt_a 0.25% : 0.000153s : 1: symbol_engine_optimizer 41.99% : 0.025801s : 1: type_inference TotalTime = 0.032683, [30] [bootstrap]: 0.00029665 [type_inference]: 0.00447008 [event_method]: 1.754e-05 [auto_monad]: 6.341e-05 [graph_reusing]: 5.54e-06 [pre_auto_parallel]: 2.85998e-06 [py_interpret_to_execute]: 3.289e-05 [rewriter_before_opt_a]: 7.135e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.0048942, [2] [Cycle 1]: 0.00151876, [27] [switch_simplify]: 5.199e-05 [loop_unroll]: 2.942e-05 [a_1]: 0.00050062 [with_stream_mark]: 1.942e-05 [recompute_prepare]: 7.44002e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 4.12e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.423e-05 [j_node_and_user_rematch]: 8.62998e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00058544 [add_forward_monad_depend]: 5.87001e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.42e-05 [cse]: 3.775e-05 [replace_applicator]: 1.22e-05 [Cycle 2]: 0.00031957, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 4.79e-06 [a_1]: 8.553e-05 [with_stream_mark]: 9.71e-06 [recompute_prepare]: 4.79e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 4.80001e-06 [updatestate_useless_node_eliminater]: 4.70001e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.50999e-06 [merge_forward]: 2.90998e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 7.84002e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.04001e-06 [inline_without_move]: 4.99998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.33002e-06 [cse]: 1.437e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.155e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00056452 [jit_opt_b]: 5.318e-05, [1] [Cycle 1]: 4.569e-05, [2] [frontend_op_eliminate]: 1.759e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 2.883e-05 [loop_unroll]: 0.0209151 [jit_opt_after_cconv]: 0.00019834, [1] [Cycle 1]: 0.00018655, [11] [c_1]: 2.455e-05 [parameter_eliminate]: 6.53e-06 [updatestate_depend_eliminate]: 1.167e-05 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 3.21999e-06 [cse]: 4.708e-05 [call_graph_tuple_transform]: 2.248e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 1.22e-06 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.82e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 8.30999e-06 [add_recomputation]: 6.177e-05 [cse_after_recomputation]: 2.325e-05, [1] [Cycle 1]: 1.771e-05, [1] [cse]: 1.199e-05 [auto_monad_reorder]: 1.908e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 8.39998e-06 [opt_after_jit_grad]: 0.00053702 [symbol_engine_optimizer]: 7.399e-05, [1] [Cycle 1]: 6.745e-05, [6] [build]: 4.22e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.341e-05 [opt_reshape]: 5.61003e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 2.10013e-07 [validate]: 4.814e-05 Sums bootstrap : 0.000297s : 1.02% type_inference : 0.004470s : 15.41% event_method : 0.000018s : 0.06% auto_monad : 0.000063s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000033s : 0.11% rewriter_before_opt_a : 0.000071s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.20% jit_opt_a.loop_unroll : 0.000034s : 0.12% jit_opt_a.a_1 : 0.000586s : 2.02% jit_opt_a.with_stream_mark : 0.000029s : 0.10% jit_opt_a.recompute_prepare : 0.000012s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000586s : 2.02% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000565s : 1.95% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.020915s : 72.09% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000047s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000062s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000537s : 1.85% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.17% Time group info: ------[substitution.] 0.000191 23 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.26% : 0.000006s : 3: substitution.graph_param_transform 82.32% : 0.000157s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000004s : 4: substitution.remove_not_recompute_node 2.19% : 0.000004s : 2: substitution.replace_old_param 6.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004410 2 82.84% : 0.003653s : 1: type_inference.infer 17.16% : 0.000757s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.70% : 0.000043s : 4: replace.inline 33.30% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.42% : 0.000155s : 4: match.inline 6.58% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.22% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.31% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.30% : 0.000001s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 3.49% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.40% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.76% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.50% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.62% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000573 13 55.07% : 0.000316s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.50% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.43% : 0.000226s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034141 72 0.19% : 0.000065s : 1: add_recomputation 0.20% : 0.000067s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.92% : 0.000315s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.06% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 14.34% : 0.004897s : 1: jit_opt_a 0.59% : 0.000202s : 1: jit_opt_after_cconv 0.16% : 0.000056s : 1: jit_opt_b 61.35% : 0.020947s : 1: loop_unroll 1.68% : 0.000575s : 1: mutable_eliminate 2.32% : 0.000791s : 26: opt.transform.jit_opt_a 0.16% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.11% : 0.000037s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.60% : 0.000546s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000035s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 0.87% : 0.000296s : 1: renormalize.infer 0.83% : 0.000283s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000042s : 1: rewriter_after_opt_a 0.22% : 0.000074s : 1: rewriter_before_opt_a 0.22% : 0.000077s : 1: symbol_engine_optimizer 13.13% : 0.004483s : 1: type_inference TotalTime = 0.208083, [30] [bootstrap]: 0.00035678 [type_inference]: 0.194111 [event_method]: 2.257e-05 [auto_monad]: 7.389e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 3.02002e-06 [py_interpret_to_execute]: 0.0008713 [rewriter_before_opt_a]: 0.00010285 [expand_dump_flag]: 4.54998e-06 [jit_opt_a]: 0.00985854, [2] [Cycle 1]: 0.00534087, [27] [switch_simplify]: 6.455e-05 [loop_unroll]: 2.983e-05 [a_1]: 0.00062278 [with_stream_mark]: 1.766e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.78998e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 1.111e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00424352 [add_forward_monad_depend]: 7.54002e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.518e-05 [cse]: 3.057e-05 [replace_applicator]: 2.035e-05 [Cycle 2]: 0.00042075, [27] [switch_simplify]: 7.68001e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00013287 [with_stream_mark]: 1.462e-05 [recompute_prepare]: 6.44001e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 4.32003e-06 [cell_reuse_recompute_pass]: 3.58999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.818e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 1.014e-05 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.55002e-06 [cse]: 1.328e-05 [replace_applicator]: 6.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.41e-05 [rewriter_after_opt_a]: 3.691e-05 [convert_after_rewriter]: 7.3e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00076443 [jit_opt_b]: 6.431e-05, [1] [Cycle 1]: 5.634e-05, [2] [frontend_op_eliminate]: 2.243e-05 [inline_after_opt_a]: 2.068e-05 [cconv]: 2.953e-05 [loop_unroll]: 0.00047382 [jit_opt_after_cconv]: 0.0001712, [1] [Cycle 1]: 0.00016398, [11] [c_1]: 2.745e-05 [parameter_eliminate]: 3.21999e-06 [updatestate_depend_eliminate]: 6.72002e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.544e-05 [call_graph_tuple_transform]: 2.262e-05 [tuple_list_get_item_eliminator]: 6.74001e-06 [none_parameter_eliminate]: 1.88997e-06 [renormalize]: 6.79982e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.597e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 9.04998e-06 [add_recomputation]: 4.995e-05 [cse_after_recomputation]: 2.488e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.433e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 6.16e-06 [opt_after_jit_grad]: 0.00048152 [symbol_engine_optimizer]: 8.839e-05, [1] [Cycle 1]: 8.219e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.758e-05 [opt_reshape]: 6.94001e-06 [fold_const_symbol]: 1.116e-05 [renormalize]: 4.19997e-07 [validate]: 0.00021308 Sums bootstrap : 0.000357s : 0.18% type_inference : 0.194111s : 95.46% event_method : 0.000023s : 0.01% auto_monad : 0.000074s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000871s : 0.43% rewriter_before_opt_a : 0.000103s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000756s : 0.37% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000016s : 0.01% jit_opt_a.renormalize : 0.004244s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000764s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000474s : 0.23% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000482s : 0.24% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000213s : 0.10% Time group info: ------[substitution.] 0.000237 24 2.40% : 0.000006s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000007s : 4: substitution.graph_param_transform 82.88% : 0.000197s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 5.32% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.194015 2 97.62% : 0.189406s : 1: type_inference.infer 2.38% : 0.004609s : 1: type_inference.specialize ------[replace.] 0.000089 6 67.88% : 0.000060s : 4: replace.inline 32.12% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.39% : 0.000194s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.15% : 0.000002s : 12: predicate.addn_zero_filter 2.18% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.44% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.02% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.95% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.77% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.06% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.37% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002685 22 63.07% : 0.001693s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.23% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.70% : 0.000959s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.213243 72 0.02% : 0.000053s : 1: add_recomputation 0.04% : 0.000077s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.18% : 0.000377s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.63% : 0.009863s : 1: jit_opt_a 0.08% : 0.000174s : 1: jit_opt_after_cconv 0.03% : 0.000067s : 1: jit_opt_b 0.23% : 0.000481s : 1: loop_unroll 0.36% : 0.000774s : 1: mutable_eliminate 0.47% : 0.001012s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000489s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000878s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.51% : 0.003209s : 1: renormalize.infer 0.48% : 0.001022s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.05% : 0.000108s : 1: rewriter_before_opt_a 0.04% : 0.000091s : 1: symbol_engine_optimizer 91.04% : 0.194131s : 1: type_inference TotalTime = 0.166562, [30] [bootstrap]: 0.00035666 [type_inference]: 0.15034 [event_method]: 2.744e-05 [auto_monad]: 8.341e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00091222 [rewriter_before_opt_a]: 0.00010644 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.01136, [2] [Cycle 1]: 0.00681559, [27] [switch_simplify]: 7.866e-05 [loop_unroll]: 3.709e-05 [a_1]: 0.00085295 [with_stream_mark]: 2.044e-05 [recompute_prepare]: 1.151e-05 [updatestate_depend_eliminate]: 5.06997e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.00998e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 7.36999e-06 [accelerated_algorithm]: 8.50999e-06 [meta_shard_fg_expand]: 3.52002e-06 [get_grad_eliminate_]: 7.61999e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.946e-05 [j_node_and_user_rematch]: 1.135e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 7.5e-06 [renormalize]: 0.00540273 [add_forward_monad_depend]: 1.004e-05 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 2.207e-05 [cse]: 3.712e-05 [replace_applicator]: 2.693e-05 [Cycle 2]: 0.00045607, [27] [switch_simplify]: 8.01001e-06 [loop_unroll]: 7.2e-06 [a_1]: 0.00016081 [with_stream_mark]: 1.573e-05 [recompute_prepare]: 8.27998e-06 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 7.53e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 5.03002e-06 [cell_reuse_recompute_pass]: 4.28999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 1.072e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 7.18e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.86998e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 7.65e-06 [cse]: 1.74e-05 [replace_applicator]: 7.12997e-06 [py_interpret_to_execute_after_opt_a]: 1.522e-05 [rewriter_after_opt_a]: 4.227e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.00086881 [jit_opt_b]: 6.681e-05, [1] [Cycle 1]: 5.81e-05, [2] [frontend_op_eliminate]: 2.275e-05 [inline_after_opt_a]: 2.273e-05 [cconv]: 2.786e-05 [loop_unroll]: 0.00052886 [jit_opt_after_cconv]: 0.00017545, [1] [Cycle 1]: 0.00016796, [11] [c_1]: 2.928e-05 [parameter_eliminate]: 3.28998e-06 [updatestate_depend_eliminate]: 7.93999e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.71e-05 [call_graph_tuple_transform]: 2.48e-05 [tuple_list_get_item_eliminator]: 6.76e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 7.46999e-06 [remove_dup_value]: 1.733e-05 [partial_unused_args_eliminate]: 2.84999e-06 [environ_conv]: 9.81e-06 [add_recomputation]: 5.379e-05 [cse_after_recomputation]: 2.522e-05, [1] [Cycle 1]: 1.964e-05, [1] [cse]: 1.346e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.65001e-06 [opt_after_jit_grad]: 0.00098552 [symbol_engine_optimizer]: 8.664e-05, [1] [Cycle 1]: 7.973e-05, [6] [build]: 3.91001e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 1.583e-05 [opt_reshape]: 8.57e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 3.70026e-07 [validate]: 5.59e-05 Sums bootstrap : 0.000357s : 0.22% type_inference : 0.150340s : 93.00% event_method : 0.000027s : 0.02% auto_monad : 0.000083s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000912s : 0.56% rewriter_before_opt_a : 0.000106s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.05% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.001014s : 0.63% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.005403s : 3.34% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000055s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000869s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000023s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000529s : 0.33% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000986s : 0.61% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000336 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000009s : 4: substitution.graph_param_transform 83.88% : 0.000282s : 5: substitution.inline 1.09% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.19% : 0.000014s : 3: substitution.reduce_eliminate 1.80% : 0.000006s : 4: substitution.remove_not_recompute_node 1.53% : 0.000005s : 2: substitution.replace_old_param 3.93% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.150222 2 96.70% : 0.145268s : 1: type_inference.infer 3.30% : 0.004954s : 1: type_inference.specialize ------[replace.] 0.000139 7 66.32% : 0.000092s : 5: replace.inline 33.68% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 7 95.86% : 0.000279s : 5: match.inline 4.14% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000167 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 2.80% : 0.000005s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.45% : 0.000002s : 13: predicate.depend_value_elim 1.29% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.94% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000001s : 4: predicate.graph_param_transform 4.79% : 0.000008s : 28: predicate.inline 0.90% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.57% : 0.000003s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000007s : 40: predicate.loop_unroll_before_grad 2.47% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.66% : 0.000004s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.09% : 0.000002s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.55% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.58% : 0.000011s : 64: predicate.switch_simplify 1.50% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.84% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.67% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.43% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003330 25 59.14% : 0.001970s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.44% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.42% : 0.001280s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173348 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000087s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000373s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.56% : 0.011365s : 1: jit_opt_a 0.10% : 0.000178s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.31% : 0.000536s : 1: loop_unroll 0.51% : 0.000878s : 1: mutable_eliminate 0.76% : 0.001313s : 26: opt.transform.jit_opt_a 0.04% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000994s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.53% : 0.000919s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.11% : 0.003654s : 1: renormalize.infer 1.00% : 0.001733s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.06% : 0.000113s : 1: rewriter_before_opt_a 0.14% : 0.000249s : 1: symbol_engine_optimizer 86.74% : 0.150361s : 1: type_inference TotalTime = 0.0258327, [30] [bootstrap]: 0.00034319 [type_inference]: 0.0151412 [event_method]: 1.946e-05 [auto_monad]: 6.456e-05 [graph_reusing]: 5.18002e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 5.4e-05 [rewriter_before_opt_a]: 7.465e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00664661, [2] [Cycle 1]: 0.00217835, [27] [switch_simplify]: 6.615e-05 [loop_unroll]: 3.118e-05 [a_1]: 0.00062809 [with_stream_mark]: 2.142e-05 [recompute_prepare]: 9.57999e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.79001e-06 [get_grad_eliminate_]: 6.62002e-06 [merge_forward]: 4.58001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 6.58998e-06 [renormalize]: 0.00107881 [add_forward_monad_depend]: 6.89999e-06 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 1.73e-05 [cse]: 2.664e-05 [replace_applicator]: 1.612e-05 [Cycle 2]: 0.0003417, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.87999e-06 [a_1]: 9.813e-05 [with_stream_mark]: 1.119e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 3.25e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 7.73999e-06 [inline_without_move]: 4.81997e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 6.80998e-06 [cse]: 1.06e-05 [replace_applicator]: 4.87e-06 [py_interpret_to_execute_after_opt_a]: 1.302e-05 [rewriter_after_opt_a]: 3.829e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 5.87999e-06 [mutable_eliminate]: 0.00075542 [jit_opt_b]: 5.286e-05, [1] [Cycle 1]: 4.604e-05, [2] [frontend_op_eliminate]: 1.819e-05 [inline_after_opt_a]: 1.699e-05 [cconv]: 2.882e-05 [loop_unroll]: 0.00048569 [jit_opt_after_cconv]: 0.00095673, [1] [Cycle 1]: 0.00015252, [11] [c_1]: 2.418e-05 [parameter_eliminate]: 3.08e-06 [updatestate_depend_eliminate]: 7.9e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.587e-05 [call_graph_tuple_transform]: 2.147e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 2.115e-05 [partial_unused_args_eliminate]: 3.76999e-06 [environ_conv]: 8.35001e-06 [add_recomputation]: 6.106e-05 [cse_after_recomputation]: 3.459e-05, [1] [Cycle 1]: 2.639e-05, [1] [cse]: 1.73e-05 [auto_monad_reorder]: 1.66e-05 [get_jit_bprop_graph]: 2.71999e-06 [rewriter_after_jit_bprop_graph]: 7.61999e-06 [opt_after_jit_grad]: 0.00062641 [symbol_engine_optimizer]: 8.811e-05, [1] [Cycle 1]: 7.893e-05, [6] [build]: 5.02999e-06 [elim_shapecalc]: 9.69e-06 [elim_not_effective]: 1.813e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 9.78998e-06 [renormalize]: 6.59988e-07 [validate]: 4.688e-05 Sums bootstrap : 0.000343s : 1.69% type_inference : 0.015141s : 74.72% event_method : 0.000019s : 0.10% auto_monad : 0.000065s : 0.32% graph_reusing : 0.000005s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000054s : 0.27% rewriter_before_opt_a : 0.000075s : 0.37% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.36% jit_opt_a.loop_unroll : 0.000037s : 0.18% jit_opt_a.a_1 : 0.000726s : 3.58% jit_opt_a.with_stream_mark : 0.000033s : 0.16% jit_opt_a.recompute_prepare : 0.000015s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.09% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001079s : 5.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.12% jit_opt_a.cse : 0.000037s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.10% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000038s : 0.19% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000755s : 3.73% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.09% jit_opt_b.inline_after_opt_a : 0.000017s : 0.08% cconv : 0.000029s : 0.14% loop_unroll : 0.000486s : 2.40% jit_opt_after_cconv.c_1 : 0.000024s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000021s : 0.10% partial_unused_args_eliminate : 0.000004s : 0.02% environ_conv : 0.000008s : 0.04% add_recomputation : 0.000061s : 0.30% cse_after_recomputation.cse : 0.000017s : 0.09% auto_monad_reorder : 0.000017s : 0.08% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.04% opt_after_jit_grad : 0.000626s : 3.09% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.23% Time group info: ------[substitution.] 0.000250 23 1.02% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 84.87% : 0.000213s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000004s : 2: substitution.replace_old_param 5.94% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015069 2 92.14% : 0.013885s : 1: type_inference.infer 7.86% : 0.001184s : 1: type_inference.specialize ------[replace.] 0.000087 6 64.58% : 0.000056s : 4: replace.inline 35.42% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 93.98% : 0.000210s : 4: match.inline 6.02% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.03% : 0.000001s : 10: predicate.accumulaten_eliminater 1.96% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 1.61% : 0.000002s : 10: predicate.addn_zero_filter 2.38% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 1.23% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.88% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.27% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.62% : 0.000002s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 4.92% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.85% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.86% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 6: predicate.remove_not_recompute_node 1.47% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.66% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 0.99% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.69% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 16: predicate.switch_defer_inline 1.86% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.05% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000002s : 10: predicate.transpose_eliminate 1.59% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.26% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.45% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000887 13 49.24% : 0.000437s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.20% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.56% : 0.000404s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027915 72 0.23% : 0.000064s : 1: add_recomputation 0.24% : 0.000068s : 1: auto_monad 0.07% : 0.000019s : 1: auto_monad_reorder 1.31% : 0.000364s : 1: bootstrap 0.11% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000037s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.08% : 0.000023s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000007s : 1: graph_reusing 23.83% : 0.006651s : 1: jit_opt_a 3.46% : 0.000966s : 1: jit_opt_after_cconv 0.20% : 0.000055s : 1: jit_opt_b 1.77% : 0.000494s : 1: loop_unroll 2.74% : 0.000764s : 1: mutable_eliminate 3.45% : 0.000963s : 26: opt.transform.jit_opt_a 0.19% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.28% : 0.000637s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000057s : 1: py_interpret_to_execute 0.06% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000025s : 1: remove_dup_value 1.98% : 0.000551s : 1: renormalize.infer 1.85% : 0.000517s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000077s : 1: rewriter_before_opt_a 0.33% : 0.000092s : 1: symbol_engine_optimizer 54.29% : 0.015155s : 1: type_inference TotalTime = 0.186368, [30] [bootstrap]: 0.00041168 [type_inference]: 0.17175 [event_method]: 2.236e-05 [auto_monad]: 5.29e-05 [graph_reusing]: 3.92998e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00074965 [rewriter_before_opt_a]: 0.00010459 [expand_dump_flag]: 2.79001e-06 [jit_opt_a]: 0.0104453, [2] [Cycle 1]: 0.00601819, [27] [switch_simplify]: 7.14e-05 [loop_unroll]: 3.544e-05 [a_1]: 0.00080907 [with_stream_mark]: 1.337e-05 [recompute_prepare]: 1.085e-05 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 8.31002e-06 [updatestate_useless_node_eliminater]: 6.42001e-06 [accelerated_algorithm]: 7.68001e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 7.77e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 1.149e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.132e-05 [inline_without_move]: 6.72002e-06 [renormalize]: 0.00473007 [add_forward_monad_depend]: 7.10998e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 2.161e-05 [replace_applicator]: 2.237e-05 [Cycle 2]: 0.00041541, [27] [switch_simplify]: 7.48999e-06 [loop_unroll]: 7.45e-06 [a_1]: 0.00013422 [with_stream_mark]: 1.393e-05 [recompute_prepare]: 7.80998e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 6.70002e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 4.39998e-06 [cell_reuse_recompute_pass]: 3.46001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.747e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 7.16999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 1.13001e-06 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.511e-05 [replace_applicator]: 6.97002e-06 [py_interpret_to_execute_after_opt_a]: 1.334e-05 [rewriter_after_opt_a]: 3.767e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00075696 [jit_opt_b]: 6.253e-05, [1] [Cycle 1]: 5.547e-05, [2] [frontend_op_eliminate]: 2.244e-05 [inline_after_opt_a]: 2.15e-05 [cconv]: 2.4e-05 [loop_unroll]: 0.0004745 [jit_opt_after_cconv]: 0.00017112, [1] [Cycle 1]: 0.00016409, [11] [c_1]: 2.766e-05 [parameter_eliminate]: 3.24001e-06 [updatestate_depend_eliminate]: 5.62001e-06 [updatestate_assign_eliminate]: 2.80997e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.921e-05 [call_graph_tuple_transform]: 2.167e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 2.011e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 8.74e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 3.103e-05, [1] [Cycle 1]: 2.009e-05, [1] [cse]: 1.401e-05 [auto_monad_reorder]: 1.692e-05 [get_jit_bprop_graph]: 1.62001e-06 [rewriter_after_jit_bprop_graph]: 5.57999e-06 [opt_after_jit_grad]: 0.00059731 [symbol_engine_optimizer]: 0.00030531, [1] [Cycle 1]: 0.00029782, [6] [build]: 3.95e-06 [elim_shapecalc]: 1.152e-05 [elim_not_effective]: 0.00022449 [opt_reshape]: 1.028e-05 [fold_const_symbol]: 1.38e-05 [renormalize]: 4.69998e-07 [validate]: 4.959e-05 Sums bootstrap : 0.000412s : 0.23% type_inference : 0.171750s : 94.51% event_method : 0.000022s : 0.01% auto_monad : 0.000053s : 0.03% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000750s : 0.41% rewriter_before_opt_a : 0.000105s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.000943s : 0.52% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004730s : 2.60% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000037s : 0.02% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000757s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000475s : 0.26% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000597s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000224s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000289 25 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.90% : 0.000005s : 4: substitution.graph_param_transform 88.17% : 0.000255s : 5: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 1.42% : 0.000004s : 2: substitution.replace_old_param 3.97% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.171665 2 97.08% : 0.166656s : 1: type_inference.infer 2.92% : 0.005009s : 1: type_inference.specialize ------[replace.] 0.000144 7 67.46% : 0.000097s : 5: replace.inline 32.54% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 96.07% : 0.000251s : 5: match.inline 3.93% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 2.69% : 0.000004s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.25% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.43% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 4.61% : 0.000007s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.50% : 0.000002s : 19: predicate.load_eliminater 0.95% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 1.97% : 0.000003s : 19: predicate.partial_eliminate 1.42% : 0.000002s : 13: predicate.print_const_string_wrapper 2.09% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.72% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.83% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000012s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.74% : 0.000003s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.49% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003407 25 58.62% : 0.001997s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.35% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.03% : 0.001330s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.192613 72 0.03% : 0.000053s : 1: add_recomputation 0.03% : 0.000056s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000429s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.43% : 0.010450s : 1: jit_opt_a 0.09% : 0.000174s : 1: jit_opt_after_cconv 0.03% : 0.000065s : 1: jit_opt_b 0.25% : 0.000481s : 1: loop_unroll 0.40% : 0.000765s : 1: mutable_eliminate 0.63% : 0.001223s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000255s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000606s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000754s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.76% : 0.003384s : 1: renormalize.infer 0.69% : 0.001337s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.06% : 0.000108s : 1: rewriter_before_opt_a 0.16% : 0.000308s : 1: symbol_engine_optimizer 89.18% : 0.171764s : 1: type_inference TotalTime = 0.0347444, [30] [bootstrap]: 0.00035196 [type_inference]: 0.0229646 [event_method]: 2.118e-05 [auto_monad]: 6.809e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.0001744 [rewriter_before_opt_a]: 8.489e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00838726, [2] [Cycle 1]: 0.00417481, [27] [switch_simplify]: 5.937e-05 [loop_unroll]: 3.171e-05 [a_1]: 0.00060197 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 7.83001e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 1.036e-05 [inline_without_move]: 5.75001e-06 [renormalize]: 0.0031263 [add_forward_monad_depend]: 7.05e-06 [auto_monad_grad]: 2.33998e-06 [auto_monad_eliminator]: 1.616e-05 [cse]: 2.9e-05 [replace_applicator]: 1.846e-05 [Cycle 2]: 0.0003878, [27] [switch_simplify]: 7.55998e-06 [loop_unroll]: 6.80002e-06 [a_1]: 0.00011279 [with_stream_mark]: 1.336e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 7e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.74002e-06 [cell_reuse_recompute_pass]: 2.68003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 3.41999e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.56e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 7.72002e-06 [cse]: 1.608e-05 [replace_applicator]: 6.38998e-06 [py_interpret_to_execute_after_opt_a]: 1.232e-05 [rewriter_after_opt_a]: 3.778e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.0007477 [jit_opt_b]: 5.773e-05, [1] [Cycle 1]: 4.967e-05, [2] [frontend_op_eliminate]: 1.929e-05 [inline_after_opt_a]: 1.773e-05 [cconv]: 2.636e-05 [loop_unroll]: 0.00054684 [jit_opt_after_cconv]: 0.00016566, [1] [Cycle 1]: 0.00015743, [11] [c_1]: 2.537e-05 [parameter_eliminate]: 2.76999e-06 [updatestate_depend_eliminate]: 8.23001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 2.687e-05 [call_graph_tuple_transform]: 2.328e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.419e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 6.43998e-06 [add_recomputation]: 5.027e-05 [cse_after_recomputation]: 2.664e-05, [1] [Cycle 1]: 2.012e-05, [1] [cse]: 1.316e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00058325 [symbol_engine_optimizer]: 8.938e-05, [1] [Cycle 1]: 8.213e-05, [6] [build]: 3.76001e-06 [elim_shapecalc]: 9.36e-06 [elim_not_effective]: 1.707e-05 [opt_reshape]: 8.42e-06 [fold_const_symbol]: 1.161e-05 [renormalize]: 3.10014e-07 [validate]: 4.158e-05 Sums bootstrap : 0.000352s : 1.16% type_inference : 0.022965s : 75.90% event_method : 0.000021s : 0.07% auto_monad : 0.000068s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000174s : 0.58% rewriter_before_opt_a : 0.000085s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.22% jit_opt_a.loop_unroll : 0.000039s : 0.13% jit_opt_a.a_1 : 0.000715s : 2.36% jit_opt_a.with_stream_mark : 0.000029s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.003126s : 10.33% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000045s : 0.15% jit_opt_a.replace_applicator : 0.000025s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000038s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000748s : 2.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000026s : 0.09% loop_unroll : 0.000547s : 1.81% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000014s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000583s : 1.93% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.14% Time group info: ------[substitution.] 0.000229 23 1.21% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 3: substitution.graph_param_transform 84.58% : 0.000193s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 5.21% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022889 2 89.95% : 0.020588s : 1: type_inference.infer 10.05% : 0.002301s : 1: type_inference.specialize ------[replace.] 0.000089 6 63.39% : 0.000056s : 4: replace.inline 36.61% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.65% : 0.000191s : 4: match.inline 5.35% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 691 1.87% : 0.000003s : 10: predicate.accumulaten_eliminater 1.11% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000002s : 10: predicate.addn_zero_filter 2.09% : 0.000003s : 10: predicate.arithmetic_simplify 1.52% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 0.93% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.99% : 0.000003s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 2.00% : 0.000003s : 10: predicate.environ_add_const_eliminate 1.36% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000002s : 10: predicate.environ_get_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.48% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 2.36% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.22% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.69% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.49% : 0.000002s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000004s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.05% : 0.000010s : 53: predicate.switch_simplify 1.67% : 0.000002s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.60% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.24% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.46% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001165 13 36.74% : 0.000428s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.17% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 60.10% : 0.000700s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038846 72 0.14% : 0.000053s : 1: add_recomputation 0.18% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.94% : 0.000367s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 21.60% : 0.008392s : 1: jit_opt_a 0.43% : 0.000169s : 1: jit_opt_after_cconv 0.16% : 0.000060s : 1: jit_opt_b 1.43% : 0.000555s : 1: loop_unroll 1.95% : 0.000757s : 1: mutable_eliminate 2.46% : 0.000955s : 26: opt.transform.jit_opt_a 0.15% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000591s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000178s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000016s : 1: remove_dup_value 6.06% : 0.002355s : 1: renormalize.infer 1.96% : 0.000760s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000041s : 1: rewriter_after_opt_a 0.23% : 0.000089s : 1: rewriter_before_opt_a 0.24% : 0.000093s : 1: symbol_engine_optimizer 59.15% : 0.022977s : 1: type_inference TotalTime = 0.188887, [30] [bootstrap]: 0.00029761 [type_inference]: 0.120342 [event_method]: 0.00044952 [auto_monad]: 0.00011697 [graph_reusing]: 7.08e-06 [pre_auto_parallel]: 3.42002e-06 [py_interpret_to_execute]: 8.931e-05 [rewriter_before_opt_a]: 0.00012837 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.0649171, [3] [Cycle 1]: 0.0169423, [27] [switch_simplify]: 7.718e-05 [loop_unroll]: 4.474e-05 [a_1]: 0.00105122 [with_stream_mark]: 3.63e-05 [recompute_prepare]: 2.227e-05 [updatestate_depend_eliminate]: 1.026e-05 [updatestate_assign_eliminate]: 7.28e-06 [updatestate_loads_eliminate]: 6.78998e-06 [parameter_eliminate]: 2.87002e-06 [specialize_transform]: 1.518e-05 [updatestate_useless_node_eliminater]: 1.341e-05 [accelerated_algorithm]: 1.387e-05 [meta_shard_fg_expand]: 4.25e-06 [get_grad_eliminate_]: 1.342e-05 [merge_forward]: 8.74e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.864e-05 [j_node_and_user_rematch]: 2.54e-05 [meta_fg_expand]: 0.00189166 [replace_old_param]: 7.467e-05 [inline_without_move]: 6.193e-05 [renormalize]: 0.0127933 [add_forward_monad_depend]: 1.263e-05 [auto_monad_grad]: 6.67002e-06 [auto_monad_eliminator]: 6.556e-05 [cse]: 0.00026886 [replace_applicator]: 0.00010711 [Cycle 2]: 0.0439229, [27] [switch_simplify]: 4.528e-05 [loop_unroll]: 4.401e-05 [a_1]: 0.00125707 [with_stream_mark]: 2.216e-05 [recompute_prepare]: 1.439e-05 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 4.25e-06 [updatestate_loads_eliminate]: 4.48999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 9.58997e-06 [updatestate_useless_node_eliminater]: 8.02e-06 [accelerated_algorithm]: 8.85999e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 8.03999e-06 [merge_forward]: 5.27999e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.023e-05 [j_node_and_user_rematch]: 1.478e-05 [meta_fg_expand]: 0.00011023 [replace_old_param]: 1.065e-05 [inline_without_move]: 8.37e-06 [renormalize]: 0.0419968 [add_forward_monad_depend]: 1.41e-05 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 2.663e-05 [cse]: 3.542e-05 [replace_applicator]: 2.847e-05 [Cycle 3]: 0.00037257, [27] [switch_simplify]: 7.29001e-06 [loop_unroll]: 6.65002e-06 [a_1]: 9.883e-05 [with_stream_mark]: 1.716e-05 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.60001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.65002e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 3.16001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.896e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 4.70001e-06 [inline_without_move]: 4.53999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.328e-05 [replace_applicator]: 4.67998e-06 [py_interpret_to_execute_after_opt_a]: 2e-05 [rewriter_after_opt_a]: 4.219e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00082997 [jit_opt_b]: 5.008e-05, [1] [Cycle 1]: 4.146e-05, [2] [frontend_op_eliminate]: 1.397e-05 [inline_after_opt_a]: 1.487e-05 [cconv]: 3.11e-05 [loop_unroll]: 0.00044502 [jit_opt_after_cconv]: 0.00016616, [1] [Cycle 1]: 0.00014533, [11] [c_1]: 1.75e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 7.55998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.432e-05 [call_graph_tuple_transform]: 1.946e-05 [tuple_list_get_item_eliminator]: 5.38002e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 5.06002e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 3.01999e-06 [environ_conv]: 6.67002e-06 [add_recomputation]: 4.963e-05 [cse_after_recomputation]: 2.348e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.182e-05 [auto_monad_reorder]: 1.575e-05 [get_jit_bprop_graph]: 1.88002e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00047475 [symbol_engine_optimizer]: 7.16e-05, [1] [Cycle 1]: 6.501e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 6.90002e-06 [elim_not_effective]: 1.222e-05 [opt_reshape]: 5.46002e-06 [fold_const_symbol]: 7.82002e-06 [renormalize]: 3.9002e-07 [validate]: 5.5e-05 Sums bootstrap : 0.000298s : 0.16% type_inference : 0.120342s : 65.32% event_method : 0.000450s : 0.24% auto_monad : 0.000117s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000089s : 0.05% rewriter_before_opt_a : 0.000128s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.07% jit_opt_a.loop_unroll : 0.000095s : 0.05% jit_opt_a.a_1 : 0.002407s : 1.31% jit_opt_a.with_stream_mark : 0.000076s : 0.04% jit_opt_a.recompute_prepare : 0.000042s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000030s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.01% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.01% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000068s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000049s : 0.03% jit_opt_a.meta_fg_expand : 0.002004s : 1.09% jit_opt_a.replace_old_param : 0.000090s : 0.05% jit_opt_a.inline_without_move : 0.000075s : 0.04% jit_opt_a.renormalize : 0.054790s : 29.74% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000099s : 0.05% jit_opt_a.cse : 0.000318s : 0.17% jit_opt_a.replace_applicator : 0.000140s : 0.08% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000830s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000445s : 0.24% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000475s : 0.26% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.03% Time group info: ------[substitution.] 0.000626 112 0.28% : 0.000002s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 0.89% : 0.000006s : 2: substitution.graph_param_transform 65.47% : 0.000410s : 13: substitution.inline 2.92% : 0.000018s : 2: substitution.inline_without_move 1.91% : 0.000012s : 14: substitution.j_node_and_user_rematch 1.96% : 0.000012s : 7: substitution.minmaximum_grad 1.32% : 0.000008s : 5: substitution.partial_eliminate 2.09% : 0.000013s : 14: substitution.remove_not_recompute_node 5.33% : 0.000033s : 10: substitution.replace_applicator 1.19% : 0.000007s : 10: substitution.replace_old_param 1.13% : 0.000007s : 1: substitution.reshape_eliminate 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.05% : 0.000007s : 1: substitution.tile_eliminate 3.81% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.74% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.26% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120234 2 97.40% : 0.117104s : 1: type_inference.infer 2.60% : 0.003130s : 1: type_inference.specialize ------[replace.] 0.000189 20 66.75% : 0.000126s : 13: replace.inline 33.25% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000424 20 94.68% : 0.000402s : 13: match.inline 5.32% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000418 2740 1.93% : 0.000008s : 47: predicate.accumulaten_eliminater 0.25% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.35% : 0.000006s : 47: predicate.addn_check_dump 1.69% : 0.000007s : 47: predicate.addn_zero_filter 2.91% : 0.000012s : 47: predicate.arithmetic_simplify 1.55% : 0.000006s : 47: predicate.cast_eliminate 0.11% : 0.000000s : 2: predicate.check_bprop_eliminate 1.36% : 0.000006s : 47: predicate.compare_switch_simplify 1.60% : 0.000007s : 47: predicate.depend_value_elim 1.31% : 0.000005s : 47: predicate.dict_get_item_const_eliminator 1.42% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.59% : 0.000007s : 47: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.12% : 0.000000s : 2: predicate.elim_not_effective 0.15% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.36% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.39% : 0.000006s : 47: predicate.environ_get_depend_swap 1.42% : 0.000006s : 47: predicate.environ_get_eliminate 1.43% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 1.02% : 0.000004s : 20: predicate.get_grad_eliminate 0.10% : 0.000000s : 2: predicate.graph_param_transform 4.07% : 0.000017s : 71: predicate.inline 1.92% : 0.000008s : 48: predicate.inline_without_move 0.35% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.24% : 0.000005s : 20: predicate.less_batch_normalization 1.99% : 0.000008s : 54: predicate.list_to_tuple_eliminator_ 1.80% : 0.000008s : 56: predicate.load_eliminater 0.37% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.41% : 0.000014s : 95: predicate.loop_unroll_before_grad 1.85% : 0.000008s : 49: predicate.make_slice_get_slice_eliminator 1.37% : 0.000006s : 47: predicate.merge_addn 1.40% : 0.000006s : 47: predicate.minmaximum_grad 0.58% : 0.000002s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.17% : 0.000009s : 56: predicate.partial_eliminate 1.41% : 0.000006s : 47: predicate.print_const_string_wrapper 2.53% : 0.000011s : 47: predicate.reduce_eliminate 1.96% : 0.000008s : 54: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000002s : 20: predicate.remove_not_recompute_node 2.65% : 0.000011s : 103: predicate.replace_applicator 1.15% : 0.000005s : 48: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.66% : 0.000007s : 47: predicate.reshape_eliminate 1.68% : 0.000007s : 47: predicate.row_tensor_add_zeros_like 0.19% : 0.000001s : 2: predicate.row_tensor_eliminate 1.61% : 0.000007s : 47: predicate.same_eliminate 0.47% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 4: predicate.special_op_eliminate 0.84% : 0.000004s : 20: predicate.specialize_transform 1.77% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 47: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.66% : 0.000011s : 67: predicate.switch_defer_inline 2.38% : 0.000010s : 67: predicate.switch_layer_defer_inline 5.90% : 0.000025s : 164: predicate.switch_simplify 1.43% : 0.000006s : 47: predicate.tile_eliminate 1.45% : 0.000006s : 47: predicate.transpose_eliminate 1.78% : 0.000007s : 47: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.22% : 0.000013s : 58: predicate.tuple_list_get_item_eliminator 2.03% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.88% : 0.000008s : 54: predicate.tuple_to_list_eliminator_ 1.66% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.61% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 2.14% : 0.000009s : 47: predicate.value_based_eliminate 0.14% : 0.000001s : 2: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003917 45 73.39% : 0.002874s : 28: func_graph_cloner_run.FuncGraphClonerGraph 26.61% : 0.001042s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.246833 87 0.02% : 0.000053s : 1: add_recomputation 0.05% : 0.000122s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.13% : 0.000326s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.19% : 0.000460s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 26.30% : 0.064921s : 1: jit_opt_a 0.07% : 0.000169s : 1: jit_opt_after_cconv 0.02% : 0.000053s : 1: jit_opt_b 0.18% : 0.000453s : 1: loop_unroll 0.34% : 0.000843s : 1: mutable_eliminate 1.28% : 0.003151s : 39: opt.transform.jit_opt_a 0.02% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000022s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000029s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000484s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000093s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 21.17% : 0.052251s : 2: renormalize.infer 1.02% : 0.002512s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.05% : 0.000132s : 1: rewriter_before_opt_a 0.03% : 0.000074s : 1: symbol_engine_optimizer 48.76% : 0.120364s : 1: type_inference TotalTime = 0.0275413, [30] [bootstrap]: 0.00034227 [type_inference]: 0.0183825 [event_method]: 2.232e-05 [auto_monad]: 6.885e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 5.89e-05 [rewriter_before_opt_a]: 8.236e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00636417, [2] [Cycle 1]: 0.00235374, [27] [switch_simplify]: 6.185e-05 [loop_unroll]: 3.317e-05 [a_1]: 0.00068034 [with_stream_mark]: 1.947e-05 [recompute_prepare]: 7.68001e-06 [updatestate_depend_eliminate]: 3.94002e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 6.08002e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 8.70999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00122128 [add_forward_monad_depend]: 6.64999e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.508e-05 [cse]: 3.233e-05 [replace_applicator]: 1.379e-05 [Cycle 2]: 0.00034991, [27] [switch_simplify]: 5.92001e-06 [loop_unroll]: 5.38002e-06 [a_1]: 0.00010503 [with_stream_mark]: 1.084e-05 [recompute_prepare]: 9.77999e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.21e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 7.16999e-06 [inline_without_move]: 5.17e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.26002e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.302e-05 [replace_applicator]: 4.97e-06 [py_interpret_to_execute_after_opt_a]: 1.292e-05 [rewriter_after_opt_a]: 3.939e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 5.91998e-06 [mutable_eliminate]: 0.0005897 [jit_opt_b]: 5.291e-05, [1] [Cycle 1]: 4.584e-05, [2] [frontend_op_eliminate]: 1.809e-05 [inline_after_opt_a]: 1.62e-05 [cconv]: 2.559e-05 [loop_unroll]: 0.00044286 [jit_opt_after_cconv]: 0.00015275, [1] [Cycle 1]: 0.0001462, [11] [c_1]: 2.27e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 6.39001e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.36e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 6.04001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.59998e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.96998e-06 [add_recomputation]: 5.13e-05 [cse_after_recomputation]: 2.308e-05, [1] [Cycle 1]: 1.754e-05, [1] [cse]: 1.164e-05 [auto_monad_reorder]: 1.734e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.34998e-06 [opt_after_jit_grad]: 0.00046832 [symbol_engine_optimizer]: 7.64e-05, [1] [Cycle 1]: 7.073e-05, [6] [build]: 3.31001e-06 [elim_shapecalc]: 8.41002e-06 [elim_not_effective]: 1.367e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 5.09986e-07 [validate]: 4.002e-05 Sums bootstrap : 0.000342s : 1.47% type_inference : 0.018383s : 78.90% event_method : 0.000022s : 0.10% auto_monad : 0.000069s : 0.30% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000059s : 0.25% rewriter_before_opt_a : 0.000082s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.29% jit_opt_a.loop_unroll : 0.000039s : 0.17% jit_opt_a.a_1 : 0.000785s : 3.37% jit_opt_a.with_stream_mark : 0.000030s : 0.13% jit_opt_a.recompute_prepare : 0.000017s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001221s : 5.24% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000045s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000039s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000590s : 2.53% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000026s : 0.11% loop_unroll : 0.000443s : 1.90% jit_opt_after_cconv.c_1 : 0.000023s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000051s : 0.22% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000468s : 2.01% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.17% Time group info: ------[substitution.] 0.000274 27 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 3: substitution.graph_param_transform 84.70% : 0.000232s : 5: substitution.inline 0.98% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.80% : 0.000010s : 3: substitution.reduce_eliminate 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.32% : 0.000004s : 2: substitution.replace_old_param 3.85% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018306 2 93.00% : 0.017025s : 1: type_inference.infer 7.00% : 0.001281s : 1: type_inference.specialize ------[replace.] 0.000104 7 66.03% : 0.000069s : 5: replace.inline 33.97% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 7 96.03% : 0.000229s : 5: match.inline 3.97% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.54% : 0.000002s : 11: predicate.addn_zero_filter 2.43% : 0.000003s : 11: predicate.arithmetic_simplify 1.36% : 0.000002s : 11: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.09% : 0.000001s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.86% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_depend_swap 1.39% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.03% : 0.000007s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.28% : 0.000002s : 11: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000001s : 11: predicate.print_const_string_wrapper 2.24% : 0.000003s : 11: predicate.reduce_eliminate 1.60% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 11: predicate.reshape_eliminate 1.52% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.12% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 11: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.52% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.59% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.36% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.55% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001015 16 45.81% : 0.000465s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.19% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 47.00% : 0.000477s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029837 72 0.18% : 0.000054s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.20% : 0.000359s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 21.35% : 0.006369s : 1: jit_opt_a 0.52% : 0.000156s : 1: jit_opt_after_cconv 0.19% : 0.000055s : 1: jit_opt_b 1.51% : 0.000449s : 1: loop_unroll 2.00% : 0.000597s : 1: mutable_eliminate 3.40% : 0.001015s : 26: opt.transform.jit_opt_a 0.17% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.59% : 0.000475s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000062s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 2.54% : 0.000759s : 1: renormalize.infer 1.52% : 0.000453s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.29% : 0.000085s : 1: rewriter_before_opt_a 0.26% : 0.000079s : 1: symbol_engine_optimizer 61.66% : 0.018397s : 1: type_inference TotalTime = 0.0717796, [30] [bootstrap]: 0.00033921 [type_inference]: 0.0312413 [event_method]: 1.835e-05 [auto_monad]: 6.909e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 8.755e-05 [rewriter_before_opt_a]: 7.752e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.0379112, [2] [Cycle 1]: 0.00191515, [27] [switch_simplify]: 6.076e-05 [loop_unroll]: 2.911e-05 [a_1]: 0.00060177 [with_stream_mark]: 2.063e-05 [recompute_prepare]: 8.12998e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00086454 [add_forward_monad_depend]: 5.40001e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 3.315e-05 [replace_applicator]: 1.126e-05 [Cycle 2]: 0.0003127, [27] [switch_simplify]: 5.92001e-06 [loop_unroll]: 5.07999e-06 [a_1]: 8.81e-05 [with_stream_mark]: 9.29998e-06 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 7.23999e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.23e-05 [replace_applicator]: 4.84e-06 [py_interpret_to_execute_after_opt_a]: 1.371e-05 [rewriter_after_opt_a]: 3.956e-05 [convert_after_rewriter]: 6.58003e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00051395 [jit_opt_b]: 4.766e-05, [1] [Cycle 1]: 4.055e-05, [2] [frontend_op_eliminate]: 1.474e-05 [inline_after_opt_a]: 1.514e-05 [cconv]: 2.445e-05 [loop_unroll]: 0.00039525 [jit_opt_after_cconv]: 0.00013366, [1] [Cycle 1]: 0.00012747, [11] [c_1]: 1.978e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.866e-05 [call_graph_tuple_transform]: 1.738e-05 [tuple_list_get_item_eliminator]: 5.37999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.649e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 5.51002e-06 [add_recomputation]: 5.196e-05 [cse_after_recomputation]: 3.035e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.268e-05 [auto_monad_reorder]: 1.691e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00043469 [symbol_engine_optimizer]: 6.872e-05, [1] [Cycle 1]: 6.298e-05, [6] [build]: 3.16999e-06 [elim_shapecalc]: 7.26001e-06 [elim_not_effective]: 1.231e-05 [opt_reshape]: 5.54998e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 4.2998e-07 [validate]: 3.919e-05 Sums bootstrap : 0.000339s : 0.95% type_inference : 0.031241s : 87.95% event_method : 0.000018s : 0.05% auto_monad : 0.000069s : 0.19% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000088s : 0.25% rewriter_before_opt_a : 0.000078s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.19% jit_opt_a.loop_unroll : 0.000034s : 0.10% jit_opt_a.a_1 : 0.000690s : 1.94% jit_opt_a.with_stream_mark : 0.000030s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000865s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000045s : 0.13% jit_opt_a.replace_applicator : 0.000016s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000040s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000514s : 1.45% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000015s : 0.04% cconv : 0.000024s : 0.07% loop_unroll : 0.000395s : 1.11% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.15% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000435s : 1.22% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.11% Time group info: ------[substitution.] 0.000194 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000005s : 3: substitution.graph_param_transform 83.00% : 0.000161s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 6.49% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031171 2 96.18% : 0.029980s : 1: type_inference.infer 3.82% : 0.001191s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.27% : 0.000047s : 4: replace.inline 33.73% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 93.25% : 0.000159s : 4: match.inline 6.75% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000187 691 0.91% : 0.000002s : 10: predicate.accumulaten_eliminater 0.65% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.67% : 0.000001s : 10: predicate.addn_check_dump 0.72% : 0.000001s : 10: predicate.addn_zero_filter 1.14% : 0.000002s : 10: predicate.arithmetic_simplify 0.70% : 0.000001s : 10: predicate.cast_eliminate 0.26% : 0.000000s : 3: predicate.check_bprop_eliminate 0.66% : 0.000001s : 10: predicate.compare_switch_simplify 0.73% : 0.000001s : 10: predicate.depend_value_elim 0.68% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.76% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.68% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.52% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000001s : 3: predicate.elim_not_effective 0.27% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.74% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.64% : 0.000001s : 10: predicate.environ_get_add_eliminate 42.28% : 0.000079s : 10: predicate.environ_get_depend_swap 0.69% : 0.000001s : 10: predicate.environ_get_eliminate 0.64% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.56% : 0.000001s : 6: predicate.get_grad_eliminate 0.18% : 0.000000s : 3: predicate.graph_param_transform 3.34% : 0.000006s : 22: predicate.inline 0.55% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.80% : 0.000001s : 6: predicate.less_batch_normalization 0.95% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.14% : 0.000002s : 15: predicate.load_eliminater 0.73% : 0.000001s : 3: predicate.loop_unroll_after_grad 2.39% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.10% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.66% : 0.000001s : 10: predicate.merge_addn 0.65% : 0.000001s : 10: predicate.minmaximum_grad 0.96% : 0.000002s : 3: predicate.mutable_eliminate 0.24% : 0.000000s : 3: predicate.opt_reshape 1.39% : 0.000003s : 15: predicate.partial_eliminate 0.68% : 0.000001s : 10: predicate.print_const_string_wrapper 0.97% : 0.000002s : 10: predicate.reduce_eliminate 0.84% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.30% : 0.000001s : 6: predicate.remove_not_recompute_node 0.99% : 0.000002s : 18: predicate.replace_applicator 0.37% : 0.000001s : 6: predicate.replace_old_param 0.20% : 0.000000s : 3: predicate.reset_defer_inline 0.76% : 0.000001s : 10: predicate.reshape_eliminate 0.73% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.39% : 0.000001s : 3: predicate.row_tensor_eliminate 0.67% : 0.000001s : 10: predicate.same_eliminate 0.36% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.51% : 0.000001s : 6: predicate.special_op_eliminate 0.58% : 0.000001s : 6: predicate.specialize_transform 0.81% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.77% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.26% : 0.000000s : 3: predicate.switch_call_monad_eliminater 1.53% : 0.000003s : 16: predicate.switch_defer_inline 1.30% : 0.000002s : 16: predicate.switch_layer_defer_inline 4.67% : 0.000009s : 53: predicate.switch_simplify 0.79% : 0.000001s : 10: predicate.tile_eliminate 0.69% : 0.000001s : 10: predicate.transpose_eliminate 0.87% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.68% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 2.49% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 0.86% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.93% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.01% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 1.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.01% : 0.000002s : 10: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000713 13 49.39% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.90% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.71% : 0.000333s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073597 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000072s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.49% : 0.000360s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 51.52% : 0.037915s : 1: jit_opt_a 0.19% : 0.000136s : 1: jit_opt_after_cconv 0.07% : 0.000050s : 1: jit_opt_b 0.55% : 0.000403s : 1: loop_unroll 0.71% : 0.000522s : 1: mutable_eliminate 1.23% : 0.000907s : 26: opt.transform.jit_opt_a 0.06% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000442s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000091s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.67% : 0.000496s : 1: renormalize.infer 0.49% : 0.000361s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.11% : 0.000081s : 1: rewriter_before_opt_a 0.10% : 0.000071s : 1: symbol_engine_optimizer 42.47% : 0.031257s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.943.696 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f430> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:38.944.375 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0878875, [30] [bootstrap]: 0.00034567 [type_inference]: 0.0738578 [event_method]: 2.542e-05 [auto_monad]: 7.204e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.0004474 [rewriter_before_opt_a]: 0.00010352 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.0105015, [2] [Cycle 1]: 0.00607754, [27] [switch_simplify]: 6.773e-05 [loop_unroll]: 3.544e-05 [a_1]: 0.00079213 [with_stream_mark]: 1.955e-05 [recompute_prepare]: 9.96998e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 8.37998e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 7.5e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 7.15998e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.686e-05 [j_node_and_user_rematch]: 1.231e-05 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 1.102e-05 [inline_without_move]: 6.64999e-06 [renormalize]: 0.00478155 [add_forward_monad_depend]: 8.34998e-06 [auto_monad_grad]: 2.75002e-06 [auto_monad_eliminator]: 1.71e-05 [cse]: 3.487e-05 [replace_applicator]: 2.241e-05 [Cycle 2]: 0.0004027, [27] [switch_simplify]: 7.88001e-06 [loop_unroll]: 6.65002e-06 [a_1]: 0.00013591 [with_stream_mark]: 1.323e-05 [recompute_prepare]: 6.49001e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.66998e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.65998e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 3.55998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.787e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 6.23998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.524e-05 [replace_applicator]: 6.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.405e-05 [rewriter_after_opt_a]: 3.901e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00075554 [jit_opt_b]: 6.022e-05, [1] [Cycle 1]: 5.369e-05, [2] [frontend_op_eliminate]: 2.175e-05 [inline_after_opt_a]: 2.016e-05 [cconv]: 2.656e-05 [loop_unroll]: 0.0004447 [jit_opt_after_cconv]: 0.00016254, [1] [Cycle 1]: 0.00015689, [11] [c_1]: 2.635e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.34999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.642e-05 [call_graph_tuple_transform]: 2.254e-05 [tuple_list_get_item_eliminator]: 6.89001e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.954e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 8.23999e-06 [add_recomputation]: 4.874e-05 [cse_after_recomputation]: 2.734e-05, [1] [Cycle 1]: 2.153e-05, [1] [cse]: 1.536e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 6.09001e-06 [opt_after_jit_grad]: 0.00046841 [symbol_engine_optimizer]: 9.325e-05, [1] [Cycle 1]: 8.712e-05, [6] [build]: 4.22e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.556e-05 [opt_reshape]: 9.64999e-06 [fold_const_symbol]: 1.196e-05 [renormalize]: 1.42e-06 [validate]: 0.00013012 Sums bootstrap : 0.000346s : 0.42% type_inference : 0.073858s : 88.71% event_method : 0.000025s : 0.03% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000447s : 0.54% rewriter_before_opt_a : 0.000104s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.09% jit_opt_a.loop_unroll : 0.000042s : 0.05% jit_opt_a.a_1 : 0.000928s : 1.11% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.004782s : 5.74% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000050s : 0.06% jit_opt_a.replace_applicator : 0.000029s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000756s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000445s : 0.53% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000468s : 0.56% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000130s : 0.16% Time group info: ------[substitution.] 0.000296 25 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 4: substitution.graph_param_transform 86.59% : 0.000256s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000006s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 4.86% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.073760 2 92.91% : 0.068532s : 1: type_inference.infer 7.09% : 0.005228s : 1: type_inference.specialize ------[replace.] 0.000132 7 65.18% : 0.000086s : 5: replace.inline 34.82% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000266 7 95.06% : 0.000253s : 5: match.inline 4.94% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 888 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.17% : 0.000002s : 13: predicate.addn_zero_filter 1.76% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.86% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.09% : 0.000008s : 28: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.93% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 19: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.11% : 0.000002s : 13: predicate.print_const_string_wrapper 1.58% : 0.000002s : 13: predicate.reduce_eliminate 1.84% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.48% : 0.000005s : 20: predicate.switch_defer_inline 1.92% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.77% : 0.000010s : 65: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.50% : 0.000002s : 13: predicate.transpose_eliminate 1.60% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 2.17% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.07% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003953 37 68.60% : 0.002712s : 28: func_graph_cloner_run.FuncGraphClonerGraph 1.97% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.43% : 0.001163s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.093863 72 0.05% : 0.000051s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.38% : 0.000359s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.19% : 0.010506s : 1: jit_opt_a 0.18% : 0.000165s : 1: jit_opt_after_cconv 0.07% : 0.000063s : 1: jit_opt_b 0.48% : 0.000451s : 1: loop_unroll 0.81% : 0.000763s : 1: mutable_eliminate 1.28% : 0.001202s : 26: opt.transform.jit_opt_a 0.06% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000453s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 3.83% : 0.003596s : 1: renormalize.infer 1.25% : 0.001175s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.11% : 0.000108s : 1: rewriter_before_opt_a 0.10% : 0.000096s : 1: symbol_engine_optimizer 78.71% : 0.073877s : 1: type_inference TotalTime = 0.187894, [30] [bootstrap]: 0.00032128 [type_inference]: 0.175897 [event_method]: 2.024e-05 [auto_monad]: 6.622e-05 [graph_reusing]: 6.42001e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 0.00043327 [rewriter_before_opt_a]: 8.062e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.0076115, [2] [Cycle 1]: 0.00388549, [27] [switch_simplify]: 5.522e-05 [loop_unroll]: 2.964e-05 [a_1]: 0.00057732 [with_stream_mark]: 1.87e-05 [recompute_prepare]: 8.27998e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 6.79001e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 9.22999e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00286195 [add_forward_monad_depend]: 6.59001e-06 [auto_monad_grad]: 2.45997e-06 [auto_monad_eliminator]: 1.688e-05 [cse]: 3.259e-05 [replace_applicator]: 1.493e-05 [Cycle 2]: 0.00036438, [27] [switch_simplify]: 7.73001e-06 [loop_unroll]: 6.02001e-06 [a_1]: 0.00012232 [with_stream_mark]: 1.131e-05 [recompute_prepare]: 5.98998e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.33998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 5.61e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.59998e-06 [cse]: 1.071e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.112e-05 [rewriter_after_opt_a]: 3.592e-05 [convert_after_rewriter]: 7.29001e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00057335 [jit_opt_b]: 5.256e-05, [1] [Cycle 1]: 4.568e-05, [2] [frontend_op_eliminate]: 1.829e-05 [inline_after_opt_a]: 1.7e-05 [cconv]: 2.676e-05 [loop_unroll]: 0.0004062 [jit_opt_after_cconv]: 0.00015462, [1] [Cycle 1]: 0.00014853, [11] [c_1]: 2.508e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.814e-05 [call_graph_tuple_transform]: 2.056e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.502e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 7.78001e-06 [add_recomputation]: 4.894e-05 [cse_after_recomputation]: 2.101e-05, [1] [Cycle 1]: 1.6e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 4.69998e-06 [opt_after_jit_grad]: 0.00138823 [symbol_engine_optimizer]: 0.00015978, [1] [Cycle 1]: 0.00014671, [6] [build]: 9.50001e-06 [elim_shapecalc]: 3.502e-05 [elim_not_effective]: 2.626e-05 [opt_reshape]: 8.50001e-06 [fold_const_symbol]: 1.291e-05 [renormalize]: 1.01002e-06 [validate]: 0.00030115 Sums bootstrap : 0.000321s : 0.17% type_inference : 0.175897s : 95.65% event_method : 0.000020s : 0.01% auto_monad : 0.000066s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000433s : 0.24% rewriter_before_opt_a : 0.000081s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000700s : 0.38% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002862s : 1.56% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000043s : 0.02% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000573s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000406s : 0.22% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.001388s : 0.75% symbol_engine_optimizer.build : 0.000010s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000035s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000301s : 0.16% Time group info: ------[substitution.] 0.000220 24 1.96% : 0.000004s : 2: substitution.elim_not_effective 0.86% : 0.000002s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 4: substitution.graph_param_transform 82.61% : 0.000182s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000005s : 2: substitution.replace_old_param 5.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.175819 2 98.46% : 0.173109s : 1: type_inference.infer 1.54% : 0.002710s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.71% : 0.000047s : 4: replace.inline 33.29% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.93% : 0.000179s : 4: match.inline 6.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.73% : 0.000002s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.96% : 0.000001s : 4: predicate.elim_not_effective 3.54% : 0.000005s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.48% : 0.000001s : 4: predicate.graph_param_transform 5.38% : 0.000007s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.89% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.51% : 0.000002s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.24% : 0.000010s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002210 22 67.50% : 0.001492s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.56% : 0.000676s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.191516 72 0.03% : 0.000052s : 1: add_recomputation 0.04% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.18% : 0.000336s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.98% : 0.007615s : 1: jit_opt_a 0.08% : 0.000157s : 1: jit_opt_after_cconv 0.03% : 0.000055s : 1: jit_opt_b 0.22% : 0.000414s : 1: loop_unroll 0.30% : 0.000582s : 1: mutable_eliminate 0.49% : 0.000930s : 26: opt.transform.jit_opt_a 0.03% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000075s : 4: opt.transform.symbol_engine_opt 0.74% : 0.001414s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000439s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.12% : 0.002138s : 1: renormalize.infer 0.37% : 0.000714s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.04% : 0.000085s : 1: rewriter_before_opt_a 0.09% : 0.000164s : 1: symbol_engine_optimizer 91.86% : 0.175917s : 1: type_inference TotalTime = 0.0382951, [30] [bootstrap]: 0.00044849 [type_inference]: 0.0289808 [event_method]: 1.973e-05 [auto_monad]: 4.872e-05 [graph_reusing]: 3.48e-06 [pre_auto_parallel]: 2.21e-06 [py_interpret_to_execute]: 0.00013955 [rewriter_before_opt_a]: 0.00010505 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00603616, [2] [Cycle 1]: 0.00223708, [27] [switch_simplify]: 4.973e-05 [loop_unroll]: 3.045e-05 [a_1]: 0.00051738 [with_stream_mark]: 1.233e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 7.89994e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.119e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 7.68999e-06 [inline_without_move]: 5.49e-06 [renormalize]: 0.00133794 [add_forward_monad_depend]: 4.50001e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 9.77001e-06 [cse]: 1.845e-05 [replace_applicator]: 1.088e-05 [Cycle 2]: 0.00032126, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.32999e-06 [a_1]: 9.075e-05 [with_stream_mark]: 8.56002e-06 [recompute_prepare]: 5.26002e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.229e-05 [j_node_and_user_rematch]: 7.71999e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 6.83e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.258e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 9.54999e-06 [rewriter_after_opt_a]: 3.169e-05 [convert_after_rewriter]: 6.16e-06 [order_py_execute_after_rewriter]: 4.60999e-06 [mutable_eliminate]: 0.00085602 [jit_opt_b]: 5.533e-05, [1] [Cycle 1]: 4.819e-05, [2] [frontend_op_eliminate]: 1.859e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 1.994e-05 [loop_unroll]: 0.00043534 [jit_opt_after_cconv]: 0.00014225, [1] [Cycle 1]: 0.00013692, [11] [c_1]: 2.158e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.43002e-06 [cse]: 2.342e-05 [call_graph_tuple_transform]: 1.671e-05 [tuple_list_get_item_eliminator]: 5.70001e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.298e-05 [partial_unused_args_eliminate]: 1.71998e-06 [environ_conv]: 4.52998e-06 [add_recomputation]: 3.81e-05 [cse_after_recomputation]: 2.405e-05, [1] [Cycle 1]: 1.86e-05, [1] [cse]: 1.164e-05 [auto_monad_reorder]: 1.149e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.0005607 [symbol_engine_optimizer]: 7.443e-05, [1] [Cycle 1]: 6.883e-05, [6] [build]: 2.99001e-06 [elim_shapecalc]: 8.52998e-06 [elim_not_effective]: 1.345e-05 [opt_reshape]: 7.48999e-06 [fold_const_symbol]: 9.22001e-06 [renormalize]: 3.9002e-07 [validate]: 3.828e-05 Sums bootstrap : 0.000448s : 1.31% type_inference : 0.028981s : 84.61% event_method : 0.000020s : 0.06% auto_monad : 0.000049s : 0.14% graph_reusing : 0.000003s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000140s : 0.41% rewriter_before_opt_a : 0.000105s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.16% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000608s : 1.78% jit_opt_a.with_stream_mark : 0.000021s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001338s : 3.91% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.05% jit_opt_a.cse : 0.000031s : 0.09% jit_opt_a.replace_applicator : 0.000016s : 0.05% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000032s : 0.09% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000856s : 2.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000020s : 0.06% loop_unroll : 0.000435s : 1.27% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000013s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000038s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000011s : 0.03% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000561s : 1.64% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.11% Time group info: ------[substitution.] 0.000173 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 85.36% : 0.000148s : 4: substitution.inline 1.40% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000004s : 4: substitution.remove_not_recompute_node 1.62% : 0.000003s : 2: substitution.replace_old_param 4.92% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028915 2 92.42% : 0.026722s : 1: type_inference.infer 7.58% : 0.002193s : 1: type_inference.specialize ------[replace.] 0.000075 6 65.54% : 0.000049s : 4: replace.inline 34.46% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 95.15% : 0.000145s : 4: match.inline 4.85% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.14% : 0.000002s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.55% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 4.90% : 0.000006s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.08% : 0.000002s : 15: predicate.load_eliminater 1.12% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.90% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000002s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.84% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.13% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001084 13 44.52% : 0.000482s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.89% : 0.000573s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040511 72 0.10% : 0.000041s : 1: add_recomputation 0.13% : 0.000052s : 1: auto_monad 0.03% : 0.000014s : 1: auto_monad_reorder 1.15% : 0.000467s : 1: bootstrap 0.06% : 0.000023s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.06% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 14.91% : 0.006040s : 1: jit_opt_a 0.36% : 0.000145s : 1: jit_opt_after_cconv 0.14% : 0.000058s : 1: jit_opt_b 1.09% : 0.000441s : 1: loop_unroll 2.14% : 0.000866s : 1: mutable_eliminate 2.01% : 0.000816s : 26: opt.transform.jit_opt_a 0.11% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000569s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000143s : 1: py_interpret_to_execute 0.03% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000015s : 1: remove_dup_value 1.99% : 0.000807s : 1: renormalize.infer 1.30% : 0.000525s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000035s : 1: rewriter_after_opt_a 0.27% : 0.000110s : 1: rewriter_before_opt_a 0.19% : 0.000077s : 1: symbol_engine_optimizer 71.57% : 0.028993s : 1: type_inference TotalTime = 0.203749, [30] [bootstrap]: 0.00033621 [type_inference]: 0.188634 [event_method]: 2.388e-05 [auto_monad]: 7.913e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00075587 [rewriter_before_opt_a]: 9.834e-05 [expand_dump_flag]: 4.48001e-06 [jit_opt_a]: 0.0108756, [2] [Cycle 1]: 0.00581609, [27] [switch_simplify]: 7.294e-05 [loop_unroll]: 3.134e-05 [a_1]: 0.00072872 [with_stream_mark]: 1.641e-05 [recompute_prepare]: 9.62001e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.96001e-06 [updatestate_useless_node_eliminater]: 8.25999e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 7.73999e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 1.136e-05 [meta_fg_expand]: 3.48999e-06 [replace_old_param]: 1.144e-05 [inline_without_move]: 6.89999e-06 [renormalize]: 0.0045798 [add_forward_monad_depend]: 9.73002e-06 [auto_monad_grad]: 3.16999e-06 [auto_monad_eliminator]: 1.965e-05 [cse]: 3.241e-05 [replace_applicator]: 1.849e-05 [Cycle 2]: 0.00042125, [27] [switch_simplify]: 8.03001e-06 [loop_unroll]: 6.75002e-06 [a_1]: 0.00014694 [with_stream_mark]: 1.675e-05 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 3.76001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.742e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 6.69999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.51998e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 7.18e-06 [cse]: 1.255e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.65e-05 [rewriter_after_opt_a]: 4.085e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.78002e-06 [mutable_eliminate]: 0.00089822 [jit_opt_b]: 6.501e-05, [1] [Cycle 1]: 5.725e-05, [2] [frontend_op_eliminate]: 2.411e-05 [inline_after_opt_a]: 2.074e-05 [cconv]: 2.696e-05 [loop_unroll]: 0.00058344 [jit_opt_after_cconv]: 0.00017383, [1] [Cycle 1]: 0.00016706, [11] [c_1]: 2.843e-05 [parameter_eliminate]: 3.63999e-06 [updatestate_depend_eliminate]: 7.53e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 2.852e-05 [call_graph_tuple_transform]: 2.319e-05 [tuple_list_get_item_eliminator]: 6.53e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 6.73998e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 8.84998e-06 [add_recomputation]: 5.143e-05 [cse_after_recomputation]: 2.638e-05, [1] [Cycle 1]: 1.93e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.658e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 5.92999e-06 [opt_after_jit_grad]: 0.00051321 [symbol_engine_optimizer]: 0.00021852, [1] [Cycle 1]: 0.00021141, [6] [build]: 3.75998e-06 [elim_shapecalc]: 8.82999e-06 [elim_not_effective]: 1.558e-05 [opt_reshape]: 6.83e-06 [fold_const_symbol]: 0.00014354 [renormalize]: 4.69998e-07 [validate]: 5.275e-05 Sums bootstrap : 0.000336s : 0.17% type_inference : 0.188634s : 95.05% event_method : 0.000024s : 0.01% auto_monad : 0.000079s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000756s : 0.38% rewriter_before_opt_a : 0.000098s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.04% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000876s : 0.44% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004580s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000898s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000583s : 0.29% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000513s : 0.26% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000144s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.03% Time group info: ------[substitution.] 0.000281 24 1.42% : 0.000004s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.54% : 0.000007s : 4: substitution.graph_param_transform 85.05% : 0.000239s : 4: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000007s : 4: substitution.remove_not_recompute_node 1.62% : 0.000005s : 2: substitution.replace_old_param 4.82% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.188536 2 97.06% : 0.182988s : 1: type_inference.infer 2.94% : 0.005548s : 1: type_inference.specialize ------[replace.] 0.000107 6 65.31% : 0.000070s : 4: replace.inline 34.69% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 6 95.07% : 0.000236s : 4: match.inline 4.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 830 1.68% : 0.000003s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 2.49% : 0.000004s : 12: predicate.arithmetic_simplify 2.01% : 0.000003s : 12: predicate.cast_eliminate 0.79% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.88% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 0.97% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.38% : 0.000001s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 4.64% : 0.000008s : 26: predicate.inline 0.75% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.56% : 0.000003s : 8: predicate.less_batch_normalization 1.50% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 18: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.50% : 0.000003s : 12: predicate.merge_addn 1.34% : 0.000002s : 12: predicate.minmaximum_grad 1.19% : 0.000002s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 1.67% : 0.000003s : 18: predicate.partial_eliminate 1.50% : 0.000003s : 12: predicate.print_const_string_wrapper 1.87% : 0.000003s : 12: predicate.reduce_eliminate 1.79% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 8: predicate.remove_not_recompute_node 1.73% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.21% : 0.000002s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.74% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 18: predicate.switch_defer_inline 2.10% : 0.000004s : 18: predicate.switch_layer_defer_inline 6.98% : 0.000012s : 58: predicate.switch_simplify 1.86% : 0.000003s : 12: predicate.tile_eliminate 1.50% : 0.000003s : 12: predicate.transpose_eliminate 1.19% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 2.78% : 0.000005s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.27% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.27% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.16% : 0.000004s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002966 22 59.35% : 0.001760s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.72% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.92% : 0.001154s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.209673 72 0.03% : 0.000054s : 1: add_recomputation 0.04% : 0.000082s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.17% : 0.000357s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 5.19% : 0.010880s : 1: jit_opt_a 0.08% : 0.000176s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.28% : 0.000591s : 1: loop_unroll 0.43% : 0.000907s : 1: mutable_eliminate 0.55% : 0.001148s : 26: opt.transform.jit_opt_a 0.03% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000171s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000521s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000764s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.61% : 0.003374s : 1: renormalize.infer 0.57% : 0.001194s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.05% : 0.000103s : 1: rewriter_before_opt_a 0.11% : 0.000221s : 1: symbol_engine_optimizer 89.98% : 0.188654s : 1: type_inference TotalTime = 0.176466, [30] [bootstrap]: 0.00026138 [type_inference]: 0.11812 [event_method]: 0.00041335 [auto_monad]: 0.00010238 [graph_reusing]: 7.11001e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 5.988e-05 [rewriter_before_opt_a]: 0.00011471 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.0549824, [3] [Cycle 1]: 0.0168902, [27] [switch_simplify]: 9.714e-05 [loop_unroll]: 4.548e-05 [a_1]: 0.00100234 [with_stream_mark]: 2.716e-05 [recompute_prepare]: 2.14e-05 [updatestate_depend_eliminate]: 9.46e-06 [updatestate_assign_eliminate]: 7.04001e-06 [updatestate_loads_eliminate]: 6.59001e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 1.583e-05 [updatestate_useless_node_eliminater]: 1.477e-05 [accelerated_algorithm]: 1.466e-05 [meta_shard_fg_expand]: 3.9e-06 [get_grad_eliminate_]: 1.445e-05 [merge_forward]: 8.58001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.128e-05 [j_node_and_user_rematch]: 2.766e-05 [meta_fg_expand]: 0.00186177 [replace_old_param]: 7.34e-05 [inline_without_move]: 6.254e-05 [renormalize]: 0.012892 [add_forward_monad_depend]: 1.167e-05 [auto_monad_grad]: 6.40002e-06 [auto_monad_eliminator]: 5.964e-05 [cse]: 0.00024148 [replace_applicator]: 8.453e-05 [Cycle 2]: 0.0341083, [27] [switch_simplify]: 4.356e-05 [loop_unroll]: 4.262e-05 [a_1]: 0.00124304 [with_stream_mark]: 1.802e-05 [recompute_prepare]: 9.54999e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.8e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 7.85e-06 [updatestate_useless_node_eliminater]: 7.06999e-06 [accelerated_algorithm]: 7.48e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 7.18998e-06 [merge_forward]: 4.54998e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 1.173e-05 [meta_fg_expand]: 9.866e-05 [replace_old_param]: 8.34002e-06 [inline_without_move]: 6.93e-06 [renormalize]: 0.032267 [add_forward_monad_depend]: 1.211e-05 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 2.267e-05 [cse]: 3.35e-05 [replace_applicator]: 2.553e-05 [Cycle 3]: 0.00034143, [27] [switch_simplify]: 5.87001e-06 [loop_unroll]: 5.27999e-06 [a_1]: 7.988e-05 [with_stream_mark]: 1.593e-05 [recompute_prepare]: 4.99e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.54998e-06 [specialize_transform]: 5.56002e-06 [updatestate_useless_node_eliminater]: 4.70001e-06 [accelerated_algorithm]: 5.21998e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 2.84001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.981e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 4.57e-06 [inline_without_move]: 4.55999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.89e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.56e-06 [cse]: 1.195e-05 [replace_applicator]: 4.78001e-06 [py_interpret_to_execute_after_opt_a]: 1.717e-05 [rewriter_after_opt_a]: 3.852e-05 [convert_after_rewriter]: 6.37001e-06 [order_py_execute_after_rewriter]: 4.91997e-06 [mutable_eliminate]: 0.00075752 [jit_opt_b]: 4.977e-05, [1] [Cycle 1]: 4.204e-05, [2] [frontend_op_eliminate]: 1.451e-05 [inline_after_opt_a]: 1.498e-05 [cconv]: 2.972e-05 [loop_unroll]: 0.0004208 [jit_opt_after_cconv]: 0.00014737, [1] [Cycle 1]: 0.0001406, [11] [c_1]: 1.687e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 7.11999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.338e-05 [call_graph_tuple_transform]: 1.881e-05 [tuple_list_get_item_eliminator]: 5.20999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 4.92e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 6.41998e-06 [add_recomputation]: 4.684e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.781e-05, [1] [cse]: 1.146e-05 [auto_monad_reorder]: 1.51e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.00045309 [symbol_engine_optimizer]: 7.343e-05, [1] [Cycle 1]: 6.742e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 6.88998e-06 [elim_not_effective]: 1.194e-05 [opt_reshape]: 6.11e-06 [fold_const_symbol]: 8.3e-06 [renormalize]: 3.60014e-07 [validate]: 5.447e-05 Sums bootstrap : 0.000261s : 0.15% type_inference : 0.118120s : 68.71% event_method : 0.000413s : 0.24% auto_monad : 0.000102s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000060s : 0.03% rewriter_before_opt_a : 0.000115s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000147s : 0.09% jit_opt_a.loop_unroll : 0.000093s : 0.05% jit_opt_a.a_1 : 0.002325s : 1.35% jit_opt_a.with_stream_mark : 0.000061s : 0.04% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.001963s : 1.14% jit_opt_a.replace_old_param : 0.000086s : 0.05% jit_opt_a.inline_without_move : 0.000074s : 0.04% jit_opt_a.renormalize : 0.045159s : 26.27% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.01% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000089s : 0.05% jit_opt_a.cse : 0.000287s : 0.17% jit_opt_a.replace_applicator : 0.000115s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000758s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000421s : 0.24% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000047s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000453s : 0.26% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.03% Time group info: ------[substitution.] 0.000568 109 0.36% : 0.000002s : 2: substitution.elim_not_effective 0.31% : 0.000002s : 2: substitution.fold_const_symbol 0.87% : 0.000005s : 2: substitution.graph_param_transform 65.50% : 0.000372s : 13: substitution.inline 3.25% : 0.000018s : 2: substitution.inline_without_move 1.93% : 0.000011s : 13: substitution.j_node_and_user_rematch 2.17% : 0.000012s : 7: substitution.minmaximum_grad 1.30% : 0.000007s : 5: substitution.partial_eliminate 2.18% : 0.000012s : 13: substitution.remove_not_recompute_node 5.15% : 0.000029s : 10: substitution.replace_applicator 1.19% : 0.000007s : 10: substitution.replace_old_param 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.14% : 0.000006s : 1: substitution.tile_eliminate 4.03% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.66% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.56% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118038 2 97.50% : 0.115091s : 1: type_inference.infer 2.50% : 0.002947s : 1: type_inference.specialize ------[replace.] 0.000178 20 65.75% : 0.000117s : 13: replace.inline 34.25% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000384 20 94.60% : 0.000364s : 13: match.inline 5.40% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000392 2628 1.61% : 0.000006s : 45: predicate.accumulaten_eliminater 0.32% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 45: predicate.addn_check_dump 1.68% : 0.000007s : 45: predicate.addn_zero_filter 2.16% : 0.000008s : 45: predicate.arithmetic_simplify 1.79% : 0.000007s : 45: predicate.cast_eliminate 0.16% : 0.000001s : 2: predicate.check_bprop_eliminate 1.46% : 0.000006s : 45: predicate.compare_switch_simplify 1.64% : 0.000006s : 45: predicate.depend_value_elim 1.42% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.54% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.51% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.43% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.41% : 0.000006s : 45: predicate.environ_get_depend_swap 1.50% : 0.000006s : 45: predicate.environ_get_eliminate 1.49% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.86% : 0.000003s : 18: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.47% : 0.000018s : 69: predicate.inline 2.00% : 0.000008s : 46: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.10% : 0.000004s : 18: predicate.less_batch_normalization 1.91% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 54: predicate.load_eliminater 0.35% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.33% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 45: predicate.merge_addn 1.55% : 0.000006s : 45: predicate.minmaximum_grad 0.37% : 0.000001s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.31% : 0.000009s : 54: predicate.partial_eliminate 1.54% : 0.000006s : 45: predicate.print_const_string_wrapper 2.00% : 0.000008s : 45: predicate.reduce_eliminate 1.84% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000002s : 18: predicate.remove_not_recompute_node 2.84% : 0.000011s : 99: predicate.replace_applicator 1.19% : 0.000005s : 46: predicate.replace_old_param 0.09% : 0.000000s : 2: predicate.reset_defer_inline 1.57% : 0.000006s : 45: predicate.reshape_eliminate 1.52% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.26% : 0.000001s : 2: predicate.row_tensor_eliminate 1.51% : 0.000006s : 45: predicate.same_eliminate 0.45% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 4: predicate.special_op_eliminate 0.81% : 0.000003s : 18: predicate.specialize_transform 1.88% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.83% : 0.000011s : 65: predicate.switch_defer_inline 2.51% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.32% : 0.000025s : 160: predicate.switch_simplify 1.50% : 0.000006s : 45: predicate.tile_eliminate 1.58% : 0.000006s : 45: predicate.transpose_eliminate 1.92% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.15% : 0.000012s : 56: predicate.tuple_list_get_item_eliminator 1.92% : 0.000008s : 45: predicate.tuple_list_set_item_eliminator 1.79% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.77% : 0.000011s : 72: predicate.updatestate_useless_node_eliminater 1.85% : 0.000007s : 45: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.25% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003806 45 71.75% : 0.002731s : 28: func_graph_cloner_run.FuncGraphClonerGraph 28.25% : 0.001075s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.224655 87 0.02% : 0.000050s : 1: add_recomputation 0.05% : 0.000109s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.13% : 0.000298s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.19% : 0.000420s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 24.48% : 0.054987s : 1: jit_opt_a 0.07% : 0.000150s : 1: jit_opt_after_cconv 0.02% : 0.000052s : 1: jit_opt_b 0.19% : 0.000429s : 1: loop_unroll 0.34% : 0.000766s : 1: mutable_eliminate 1.36% : 0.003048s : 39: opt.transform.jit_opt_a 0.02% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000460s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000063s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 18.98% : 0.042645s : 2: renormalize.infer 1.11% : 0.002490s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000118s : 1: rewriter_before_opt_a 0.03% : 0.000076s : 1: symbol_engine_optimizer 52.59% : 0.118136s : 1: type_inference TotalTime = 0.0846157, [30] [bootstrap]: 0.00032792 [type_inference]: 0.0703884 [event_method]: 2.772e-05 [auto_monad]: 8.044e-05 [graph_reusing]: 6.30002e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00045609 [rewriter_before_opt_a]: 0.00010738 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.0101378, [2] [Cycle 1]: 0.00543155, [27] [switch_simplify]: 8.143e-05 [loop_unroll]: 3.55e-05 [a_1]: 0.00083532 [with_stream_mark]: 2.519e-05 [recompute_prepare]: 9.67999e-06 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 8.63001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.77e-06 [meta_shard_fg_expand]: 3.36999e-06 [get_grad_eliminate_]: 7.23999e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.748e-05 [j_node_and_user_rematch]: 1.178e-05 [meta_fg_expand]: 3.03e-06 [replace_old_param]: 1.099e-05 [inline_without_move]: 7.01999e-06 [renormalize]: 0.00402234 [add_forward_monad_depend]: 8.85999e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 2.014e-05 [cse]: 4.097e-05 [replace_applicator]: 2.713e-05 [Cycle 2]: 0.00043396, [27] [switch_simplify]: 9.29998e-06 [loop_unroll]: 8.02e-06 [a_1]: 0.00014172 [with_stream_mark]: 1.644e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 5.28002e-06 [cell_reuse_recompute_pass]: 4.1e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.099e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.071e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 6.96999e-06 [cse]: 1.888e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 1.806e-05 [rewriter_after_opt_a]: 4.763e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00098203 [jit_opt_b]: 6.66e-05, [1] [Cycle 1]: 5.614e-05, [2] [frontend_op_eliminate]: 2.256e-05 [inline_after_opt_a]: 2.063e-05 [cconv]: 3.004e-05 [loop_unroll]: 0.00059674 [jit_opt_after_cconv]: 0.00019303, [1] [Cycle 1]: 0.00018392, [11] [c_1]: 3.001e-05 [parameter_eliminate]: 4.47998e-06 [updatestate_depend_eliminate]: 8.04997e-06 [updatestate_assign_eliminate]: 4.23001e-06 [updatestate_loads_eliminate]: 3.00002e-06 [cse]: 3.884e-05 [call_graph_tuple_transform]: 2.474e-05 [tuple_list_get_item_eliminator]: 7.34002e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 1.17e-06 [switch_simplify]: 6.78998e-06 [remove_dup_value]: 2.239e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 1.166e-05 [add_recomputation]: 5.463e-05 [cse_after_recomputation]: 2.778e-05, [1] [Cycle 1]: 2.079e-05, [1] [cse]: 1.479e-05 [auto_monad_reorder]: 1.866e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 7.41001e-06 [opt_after_jit_grad]: 0.00061924 [symbol_engine_optimizer]: 8.933e-05, [1] [Cycle 1]: 8.193e-05, [6] [build]: 5.09e-06 [elim_shapecalc]: 9.99999e-06 [elim_not_effective]: 1.64e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 1.21e-05 [renormalize]: 6.10016e-07 [validate]: 5.931e-05 Sums bootstrap : 0.000328s : 0.41% type_inference : 0.070388s : 88.37% event_method : 0.000028s : 0.03% auto_monad : 0.000080s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000456s : 0.57% rewriter_before_opt_a : 0.000107s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.11% jit_opt_a.loop_unroll : 0.000044s : 0.05% jit_opt_a.a_1 : 0.000977s : 1.23% jit_opt_a.with_stream_mark : 0.000042s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000016s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.004022s : 5.05% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000060s : 0.08% jit_opt_a.replace_applicator : 0.000034s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000048s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000982s : 1.23% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000597s : 0.75% jit_opt_after_cconv.c_1 : 0.000030s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000022s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000055s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000619s : 0.78% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.07% Time group info: ------[substitution.] 0.000349 25 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.91% : 0.000007s : 4: substitution.graph_param_transform 87.59% : 0.000306s : 5: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000007s : 4: substitution.remove_not_recompute_node 1.88% : 0.000007s : 2: substitution.replace_old_param 4.17% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.070282 2 94.96% : 0.066743s : 1: type_inference.infer 5.04% : 0.003539s : 1: type_inference.specialize ------[replace.] 0.000131 7 67.52% : 0.000089s : 5: replace.inline 32.48% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000316 7 95.86% : 0.000303s : 5: match.inline 4.14% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 888 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.28% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_depend_swap 1.50% : 0.000002s : 13: predicate.environ_get_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000008s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 19: predicate.load_eliminater 1.75% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.30% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 2.27% : 0.000004s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 1.77% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.55% : 0.000002s : 13: predicate.reshape_eliminate 1.51% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.77% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000004s : 20: predicate.switch_defer_inline 1.99% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.43% : 0.000012s : 65: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.46% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003487 29 64.80% : 0.002259s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.89% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.32% : 0.001127s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.089990 72 0.06% : 0.000058s : 1: add_recomputation 0.09% : 0.000084s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.38% : 0.000344s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000014s : 1: environ_conv 0.04% : 0.000032s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.27% : 0.010143s : 1: jit_opt_a 0.22% : 0.000196s : 1: jit_opt_after_cconv 0.08% : 0.000069s : 1: jit_opt_b 0.68% : 0.000608s : 1: loop_unroll 1.11% : 0.000998s : 1: mutable_eliminate 1.42% : 0.001277s : 26: opt.transform.jit_opt_a 0.07% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000035s : 4: opt.transform.jit_opt_b 0.02% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000025s : 1: opt.transform.mutable_eliminate 0.03% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000631s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.51% : 0.000463s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000025s : 1: remove_dup_value 3.09% : 0.002783s : 1: renormalize.infer 1.36% : 0.001226s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000051s : 1: rewriter_after_opt_a 0.12% : 0.000112s : 1: rewriter_before_opt_a 0.10% : 0.000094s : 1: symbol_engine_optimizer 78.24% : 0.070408s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.160.779 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cf70> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.161.566 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.158905, [30] [bootstrap]: 0.00032082 [type_inference]: 0.140468 [event_method]: 2.455e-05 [auto_monad]: 7.846e-05 [graph_reusing]: 7.17002e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00091842 [rewriter_before_opt_a]: 0.00011206 [expand_dump_flag]: 4.22998e-06 [jit_opt_a]: 0.0141837, [2] [Cycle 1]: 0.00859745, [27] [switch_simplify]: 7.975e-05 [loop_unroll]: 3.636e-05 [a_1]: 0.00086488 [with_stream_mark]: 2.312e-05 [recompute_prepare]: 1.203e-05 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.67001e-06 [specialize_transform]: 9.34998e-06 [updatestate_useless_node_eliminater]: 7.29001e-06 [accelerated_algorithm]: 8.18001e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 8.37e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00137529 [j_node_and_user_rematch]: 3.744e-05 [meta_fg_expand]: 6.18998e-06 [replace_old_param]: 1.554e-05 [inline_without_move]: 8.38001e-06 [renormalize]: 0.00577407 [add_forward_monad_depend]: 6.84001e-06 [auto_monad_grad]: 1.72001e-06 [auto_monad_eliminator]: 1.681e-05 [cse]: 2.639e-05 [replace_applicator]: 2.283e-05 [Cycle 2]: 0.00044971, [27] [switch_simplify]: 7.5e-06 [loop_unroll]: 7.92e-06 [a_1]: 0.00015903 [with_stream_mark]: 1.59e-05 [recompute_prepare]: 8.19998e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.61999e-06 [accelerated_algorithm]: 7.53e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 3.98001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 1.054e-05 [meta_fg_expand]: 3.16999e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.10002e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 7.25998e-06 [cse]: 1.732e-05 [replace_applicator]: 6.96001e-06 [py_interpret_to_execute_after_opt_a]: 1.671e-05 [rewriter_after_opt_a]: 3.857e-05 [convert_after_rewriter]: 7.9e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00079789 [jit_opt_b]: 7.01e-05, [1] [Cycle 1]: 6.039e-05, [2] [frontend_op_eliminate]: 2.579e-05 [inline_after_opt_a]: 2.202e-05 [cconv]: 2.865e-05 [loop_unroll]: 0.00053797 [jit_opt_after_cconv]: 0.00017901, [1] [Cycle 1]: 0.00017134, [11] [c_1]: 3.186e-05 [parameter_eliminate]: 3.62002e-06 [updatestate_depend_eliminate]: 6.46e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.53998e-06 [cse]: 2.608e-05 [call_graph_tuple_transform]: 2.517e-05 [tuple_list_get_item_eliminator]: 7.47002e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 7.23999e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 3.26999e-06 [environ_conv]: 9.68002e-06 [add_recomputation]: 5.343e-05 [cse_after_recomputation]: 2.894e-05, [1] [Cycle 1]: 2.272e-05, [1] [cse]: 1.538e-05 [auto_monad_reorder]: 1.945e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.32999e-06 [opt_after_jit_grad]: 0.00058132 [symbol_engine_optimizer]: 8.653e-05, [1] [Cycle 1]: 7.941e-05, [6] [build]: 5.03002e-06 [elim_shapecalc]: 9.62999e-06 [elim_not_effective]: 1.734e-05 [opt_reshape]: 8.85999e-06 [fold_const_symbol]: 9.66998e-06 [renormalize]: 3.4002e-07 [validate]: 9.861e-05 Sums bootstrap : 0.000321s : 0.21% type_inference : 0.140468s : 91.76% event_method : 0.000025s : 0.02% auto_monad : 0.000078s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000918s : 0.60% rewriter_before_opt_a : 0.000112s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.001024s : 0.67% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.001390s : 0.91% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.000009s : 0.01% jit_opt_a.replace_old_param : 0.000025s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.005774s : 3.77% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000798s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000538s : 0.35% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000581s : 0.38% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000099s : 0.06% Time group info: ------[substitution.] 0.000362 28 0.46% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000007s : 4: substitution.graph_param_transform 85.05% : 0.000308s : 5: substitution.inline 1.59% : 0.000006s : 4: substitution.j_node_and_user_rematch 3.56% : 0.000013s : 3: substitution.reduce_eliminate 1.66% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000007s : 2: substitution.replace_old_param 3.41% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.140363 2 96.40% : 0.135309s : 1: type_inference.infer 3.60% : 0.005054s : 1: type_inference.specialize ------[replace.] 0.000136 7 66.41% : 0.000090s : 5: replace.inline 33.59% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000315 7 96.50% : 0.000304s : 5: match.inline 3.50% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000164 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.63% : 0.000004s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 0.97% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000002s : 13: predicate.environ_get_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.35% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.05% : 0.000008s : 28: predicate.inline 1.18% : 0.000002s : 8: predicate.inline_without_move 1.05% : 0.000002s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 1.18% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 1.99% : 0.000003s : 19: predicate.partial_eliminate 1.70% : 0.000003s : 13: predicate.print_const_string_wrapper 2.95% : 0.000005s : 13: predicate.reduce_eliminate 1.63% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.49% : 0.000002s : 13: predicate.reshape_eliminate 1.39% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.61% : 0.000003s : 13: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 0.77% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.94% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.54% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003374 25 51.79% : 0.001747s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.12% : 0.000105s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.09% : 0.001521s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.166055 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000082s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.20% : 0.000331s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 8.54% : 0.014188s : 1: jit_opt_a 0.11% : 0.000182s : 1: jit_opt_after_cconv 0.04% : 0.000073s : 1: jit_opt_b 0.33% : 0.000547s : 1: loop_unroll 0.49% : 0.000807s : 1: mutable_eliminate 0.81% : 0.001346s : 26: opt.transform.jit_opt_a 0.04% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000589s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.56% : 0.000925s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.54% : 0.004221s : 1: renormalize.infer 0.93% : 0.001539s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000118s : 1: rewriter_before_opt_a 0.05% : 0.000089s : 1: symbol_engine_optimizer 84.60% : 0.140486s : 1: type_inference TotalTime = 0.045559, [30] [bootstrap]: 0.00046653 [type_inference]: 0.0353832 [event_method]: 1.885e-05 [auto_monad]: 6.769e-05 [graph_reusing]: 5.40999e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 0.00019118 [rewriter_before_opt_a]: 8.346e-05 [expand_dump_flag]: 3.87998e-06 [jit_opt_a]: 0.00689844, [2] [Cycle 1]: 0.00232755, [27] [switch_simplify]: 6.143e-05 [loop_unroll]: 3.102e-05 [a_1]: 0.00058791 [with_stream_mark]: 1.827e-05 [recompute_prepare]: 8.41002e-06 [updatestate_depend_eliminate]: 3.90998e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.26997e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.81e-06 [inline_without_move]: 6.38e-06 [renormalize]: 0.00130381 [add_forward_monad_depend]: 5.65001e-06 [auto_monad_grad]: 2.63003e-06 [auto_monad_eliminator]: 1.35e-05 [cse]: 2.261e-05 [replace_applicator]: 1.494e-05 [Cycle 2]: 0.00035351, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.51e-06 [a_1]: 9.893e-05 [with_stream_mark]: 1.096e-05 [recompute_prepare]: 5.95002e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.55002e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.14e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.95001e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.429e-05 [replace_applicator]: 6.43003e-06 [py_interpret_to_execute_after_opt_a]: 1.264e-05 [rewriter_after_opt_a]: 3.747e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00070709 [jit_opt_b]: 5.166e-05, [1] [Cycle 1]: 4.442e-05, [2] [frontend_op_eliminate]: 1.657e-05 [inline_after_opt_a]: 1.663e-05 [cconv]: 2.122e-05 [loop_unroll]: 0.00051293 [jit_opt_after_cconv]: 0.00015368, [1] [Cycle 1]: 0.000145, [11] [c_1]: 2.232e-05 [parameter_eliminate]: 2.78998e-06 [updatestate_depend_eliminate]: 6.69999e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.272e-05 [call_graph_tuple_transform]: 1.928e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.03002e-06 [remove_dup_value]: 1.286e-05 [partial_unused_args_eliminate]: 1.66e-06 [environ_conv]: 5.44e-06 [add_recomputation]: 4.029e-05 [cse_after_recomputation]: 2.375e-05, [1] [Cycle 1]: 1.804e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.284e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 6.61e-06 [opt_after_jit_grad]: 0.00053148 [symbol_engine_optimizer]: 8.31e-05, [1] [Cycle 1]: 7.602e-05, [6] [build]: 2.83e-06 [elim_shapecalc]: 8.09002e-06 [elim_not_effective]: 1.946e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 1.059e-05 [renormalize]: 3.59985e-07 [validate]: 3.613e-05 Sums bootstrap : 0.000467s : 1.14% type_inference : 0.035383s : 86.82% event_method : 0.000019s : 0.05% auto_monad : 0.000068s : 0.17% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000191s : 0.47% rewriter_before_opt_a : 0.000083s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.17% jit_opt_a.loop_unroll : 0.000037s : 0.09% jit_opt_a.a_1 : 0.000687s : 1.69% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001304s : 3.20% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000037s : 0.09% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000037s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000707s : 1.74% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000021s : 0.05% loop_unroll : 0.000513s : 1.26% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000040s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000531s : 1.30% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.09% Time group info: ------[substitution.] 0.000210 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 3: substitution.graph_param_transform 83.09% : 0.000175s : 4: substitution.inline 1.96% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 5.96% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035308 2 91.76% : 0.032397s : 1: type_inference.infer 8.24% : 0.002911s : 1: type_inference.specialize ------[replace.] 0.000089 6 62.49% : 0.000056s : 4: replace.inline 37.51% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 93.85% : 0.000173s : 4: match.inline 6.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.06% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 2.12% : 0.000003s : 10: predicate.arithmetic_simplify 1.62% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.26% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.91% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.83% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 4.53% : 0.000006s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 2.03% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.54% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.48% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.33% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.90% : 0.000002s : 10: predicate.reshape_eliminate 2.02% : 0.000003s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.81% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 16: predicate.switch_defer_inline 2.43% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.88% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001477 13 39.22% : 0.000579s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.30% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.48% : 0.000864s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047842 72 0.09% : 0.000043s : 1: add_recomputation 0.15% : 0.000071s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 1.01% : 0.000485s : 1: bootstrap 0.05% : 0.000024s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.05% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 14.43% : 0.006902s : 1: jit_opt_a 0.33% : 0.000156s : 1: jit_opt_after_cconv 0.11% : 0.000054s : 1: jit_opt_b 1.09% : 0.000521s : 1: loop_unroll 1.50% : 0.000716s : 1: mutable_eliminate 1.91% : 0.000915s : 26: opt.transform.jit_opt_a 0.10% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000539s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000196s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000015s : 1: remove_dup_value 1.55% : 0.000741s : 1: renormalize.infer 1.16% : 0.000554s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.18% : 0.000087s : 1: rewriter_before_opt_a 0.18% : 0.000086s : 1: symbol_engine_optimizer 73.98% : 0.035394s : 1: type_inference TotalTime = 0.155315, [30] [bootstrap]: 0.00036215 [type_inference]: 0.141057 [event_method]: 2.483e-05 [auto_monad]: 7.76e-05 [graph_reusing]: 6.73e-06 [pre_auto_parallel]: 3.48e-06 [py_interpret_to_execute]: 0.00090596 [rewriter_before_opt_a]: 0.0001004 [expand_dump_flag]: 4.89e-06 [jit_opt_a]: 0.0102396, [2] [Cycle 1]: 0.00557292, [27] [switch_simplify]: 7.523e-05 [loop_unroll]: 3.069e-05 [a_1]: 0.00074731 [with_stream_mark]: 1.98e-05 [recompute_prepare]: 1.111e-05 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 7.80998e-06 [updatestate_useless_node_eliminater]: 6.13002e-06 [accelerated_algorithm]: 7.73001e-06 [meta_shard_fg_expand]: 3.04999e-06 [get_grad_eliminate_]: 7.26999e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.715e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00431003 [add_forward_monad_depend]: 7.6e-06 [auto_monad_grad]: 2.73998e-06 [auto_monad_eliminator]: 1.597e-05 [cse]: 2.876e-05 [replace_applicator]: 2.351e-05 [Cycle 2]: 0.00039361, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.82002e-06 [a_1]: 0.00013975 [with_stream_mark]: 1.192e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 3.22002e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.36998e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 4.69002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.675e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.139e-05 [replace_applicator]: 6.03998e-06 [py_interpret_to_execute_after_opt_a]: 1.228e-05 [rewriter_after_opt_a]: 3.369e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00077244 [jit_opt_b]: 5.633e-05, [1] [Cycle 1]: 4.91e-05, [2] [frontend_op_eliminate]: 2.018e-05 [inline_after_opt_a]: 1.762e-05 [cconv]: 2.436e-05 [loop_unroll]: 0.00042743 [jit_opt_after_cconv]: 0.00015367, [1] [Cycle 1]: 0.00014732, [11] [c_1]: 2.642e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.47001e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.06003e-06 [cse]: 2.18e-05 [call_graph_tuple_transform]: 2.224e-05 [tuple_list_get_item_eliminator]: 6.49001e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.19001e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 8.55999e-06 [add_recomputation]: 5.082e-05 [cse_after_recomputation]: 2.312e-05, [1] [Cycle 1]: 1.816e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.532e-05 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.00047312 [symbol_engine_optimizer]: 0.00020422, [1] [Cycle 1]: 0.0001973, [6] [build]: 3.53e-06 [elim_shapecalc]: 1.025e-05 [elim_not_effective]: 1.434e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 0.00013082 [renormalize]: 4.7998e-07 [validate]: 4.974e-05 Sums bootstrap : 0.000362s : 0.24% type_inference : 0.141057s : 93.78% event_method : 0.000025s : 0.02% auto_monad : 0.000078s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000906s : 0.60% rewriter_before_opt_a : 0.000100s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000887s : 0.59% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004310s : 2.87% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000772s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000427s : 0.28% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000473s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000131s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000318 24 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.37% : 0.000008s : 4: substitution.graph_param_transform 86.81% : 0.000276s : 4: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000006s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 4.45% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.140962 2 96.46% : 0.135971s : 1: type_inference.infer 3.54% : 0.004991s : 1: type_inference.specialize ------[replace.] 0.000107 6 66.59% : 0.000071s : 4: replace.inline 33.41% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000286 6 95.45% : 0.000273s : 4: match.inline 4.55% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 12: predicate.addn_check_dump 1.50% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.06% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.61% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.57% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.82% : 0.000007s : 26: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 12: predicate.merge_addn 0.97% : 0.000001s : 12: predicate.minmaximum_grad 1.27% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 2.18% : 0.000003s : 12: predicate.reduce_eliminate 1.68% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.60% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.79% : 0.000004s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.05% : 0.000010s : 58: predicate.switch_simplify 1.45% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.78% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.07% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002865 22 63.57% : 0.001821s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.03% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.40% : 0.000986s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160960 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000379s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.36% : 0.010244s : 1: jit_opt_a 0.10% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.27% : 0.000435s : 1: loop_unroll 0.48% : 0.000780s : 1: mutable_eliminate 0.72% : 0.001157s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000157s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000480s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.57% : 0.000913s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.04% : 0.003284s : 1: renormalize.infer 0.63% : 0.001016s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000106s : 1: rewriter_before_opt_a 0.13% : 0.000208s : 1: symbol_engine_optimizer 87.65% : 0.141076s : 1: type_inference TotalTime = 0.0807238, [30] [bootstrap]: 0.00047076 [type_inference]: 0.0690276 [event_method]: 2.366e-05 [auto_monad]: 7.081e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.00043989 [rewriter_before_opt_a]: 9.947e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.0084725, [2] [Cycle 1]: 0.00422353, [27] [switch_simplify]: 6.742e-05 [loop_unroll]: 3.546e-05 [a_1]: 0.00070592 [with_stream_mark]: 1.761e-05 [recompute_prepare]: 8.43001e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 7.95e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 7.46999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.87002e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 1.153e-05 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.065e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00305037 [add_forward_monad_depend]: 5.47999e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 3.333e-05 [replace_applicator]: 1.538e-05 [Cycle 2]: 0.00035731, [27] [switch_simplify]: 6.80002e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.00011787 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.373e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.409e-05 [replace_applicator]: 6.24999e-06 [py_interpret_to_execute_after_opt_a]: 1.159e-05 [rewriter_after_opt_a]: 3.689e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00051464 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.807e-05, [2] [frontend_op_eliminate]: 1.874e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 2.355e-05 [loop_unroll]: 0.00041306 [jit_opt_after_cconv]: 0.00014607, [1] [Cycle 1]: 0.00014041, [11] [c_1]: 2.574e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.058e-05 [call_graph_tuple_transform]: 1.959e-05 [tuple_list_get_item_eliminator]: 6.22001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 7.8e-06 [add_recomputation]: 4.57e-05 [cse_after_recomputation]: 2.38e-05, [1] [Cycle 1]: 1.904e-05, [1] [cse]: 1.367e-05 [auto_monad_reorder]: 1.712e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 4.15e-06 [opt_after_jit_grad]: 0.00046846 [symbol_engine_optimizer]: 9.037e-05, [1] [Cycle 1]: 8.434e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 6.80998e-06 [fold_const_symbol]: 2.624e-05 [renormalize]: 3.69997e-07 [validate]: 4.318e-05 Sums bootstrap : 0.000471s : 0.62% type_inference : 0.069028s : 90.51% event_method : 0.000024s : 0.03% auto_monad : 0.000071s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000440s : 0.58% rewriter_before_opt_a : 0.000099s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.10% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000824s : 1.08% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.003050s : 4.00% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000047s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000037s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000515s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000024s : 0.03% loop_unroll : 0.000413s : 0.54% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000468s : 0.61% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000026s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.06% Time group info: ------[substitution.] 0.000264 25 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 87.37% : 0.000231s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 1.33% : 0.000004s : 2: substitution.replace_old_param 4.57% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068934 2 94.95% : 0.065453s : 1: type_inference.infer 5.05% : 0.003481s : 1: type_inference.specialize ------[replace.] 0.000115 7 67.28% : 0.000077s : 5: replace.inline 32.72% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 7 95.44% : 0.000227s : 5: match.inline 4.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.22% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.27% : 0.000002s : 4: predicate.mutable_eliminate 0.79% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.68% : 0.000002s : 13: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.55% : 0.000010s : 65: predicate.switch_simplify 1.60% : 0.000002s : 13: predicate.tile_eliminate 1.48% : 0.000002s : 13: predicate.transpose_eliminate 1.56% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003064 29 67.96% : 0.002082s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.16% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.88% : 0.000916s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084934 72 0.06% : 0.000049s : 1: add_recomputation 0.09% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.57% : 0.000488s : 1: bootstrap 0.03% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.98% : 0.008476s : 1: jit_opt_a 0.17% : 0.000149s : 1: jit_opt_after_cconv 0.07% : 0.000057s : 1: jit_opt_b 0.49% : 0.000420s : 1: loop_unroll 0.62% : 0.000523s : 1: mutable_eliminate 1.27% : 0.001078s : 26: opt.transform.jit_opt_a 0.06% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.52% : 0.000445s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 2.57% : 0.002183s : 1: renormalize.infer 1.01% : 0.000858s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.12% : 0.000104s : 1: rewriter_before_opt_a 0.11% : 0.000093s : 1: symbol_engine_optimizer 81.29% : 0.069044s : 1: type_inference TotalTime = 0.120406, [30] [bootstrap]: 0.00026819 [type_inference]: 0.0720156 [event_method]: 0.00030953 [auto_monad]: 0.00011308 [graph_reusing]: 8e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 3.811e-05 [rewriter_before_opt_a]: 0.00013516 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.0452172, [3] [Cycle 1]: 0.0201739, [27] [switch_simplify]: 7.38e-05 [loop_unroll]: 4.776e-05 [a_1]: 0.00101762 [with_stream_mark]: 3.243e-05 [recompute_prepare]: 2.194e-05 [updatestate_depend_eliminate]: 8.97e-06 [updatestate_assign_eliminate]: 7.21999e-06 [updatestate_loads_eliminate]: 7.20003e-06 [parameter_eliminate]: 2.94001e-06 [specialize_transform]: 1.531e-05 [updatestate_useless_node_eliminater]: 1.385e-05 [accelerated_algorithm]: 1.431e-05 [meta_shard_fg_expand]: 4.32003e-06 [get_grad_eliminate_]: 1.422e-05 [merge_forward]: 8.40999e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.915e-05 [j_node_and_user_rematch]: 2.614e-05 [meta_fg_expand]: 0.00174905 [replace_old_param]: 7.391e-05 [inline_without_move]: 6.544e-05 [renormalize]: 0.0162321 [add_forward_monad_depend]: 1.311e-05 [auto_monad_grad]: 6.07999e-06 [auto_monad_eliminator]: 6.507e-05 [cse]: 0.00027424 [replace_applicator]: 9.663e-05 [Cycle 2]: 0.0211254, [27] [switch_simplify]: 4.512e-05 [loop_unroll]: 4.418e-05 [a_1]: 0.00123285 [with_stream_mark]: 1.922e-05 [recompute_prepare]: 1.068e-05 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 4.15999e-06 [updatestate_loads_eliminate]: 4.40999e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 9.20999e-06 [updatestate_useless_node_eliminater]: 8.15999e-06 [accelerated_algorithm]: 8.73001e-06 [meta_shard_fg_expand]: 3.26999e-06 [get_grad_eliminate_]: 8.85001e-06 [merge_forward]: 5.61e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.95e-05 [j_node_and_user_rematch]: 1.506e-05 [meta_fg_expand]: 0.00011131 [replace_old_param]: 1.126e-05 [inline_without_move]: 8.33999e-06 [renormalize]: 0.0192618 [add_forward_monad_depend]: 1.165e-05 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 2.226e-05 [cse]: 3.285e-05 [replace_applicator]: 2.629e-05 [Cycle 3]: 0.00033008, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 5.32001e-06 [a_1]: 7.871e-05 [with_stream_mark]: 1.452e-05 [recompute_prepare]: 4.79998e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 4.55999e-06 [accelerated_algorithm]: 4.78001e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 4.52998e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.79e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 4.45e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.32001e-06 [cse]: 1.139e-05 [replace_applicator]: 4.72e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 3.564e-05 [convert_after_rewriter]: 6.48e-06 [order_py_execute_after_rewriter]: 4.60001e-06 [mutable_eliminate]: 0.00071286 [jit_opt_b]: 4.843e-05, [1] [Cycle 1]: 4.174e-05, [2] [frontend_op_eliminate]: 1.433e-05 [inline_after_opt_a]: 1.485e-05 [cconv]: 2.695e-05 [loop_unroll]: 0.00040681 [jit_opt_after_cconv]: 0.00018327, [1] [Cycle 1]: 0.00017717, [11] [c_1]: 6.02e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 1.964e-05 [call_graph_tuple_transform]: 1.678e-05 [tuple_list_get_item_eliminator]: 5.08002e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 4.77e-06 [remove_dup_value]: 1.761e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 6.62002e-06 [add_recomputation]: 4.295e-05 [cse_after_recomputation]: 2.416e-05, [1] [Cycle 1]: 1.83e-05, [1] [cse]: 1.181e-05 [auto_monad_reorder]: 1.437e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 4.23999e-06 [opt_after_jit_grad]: 0.00043978 [symbol_engine_optimizer]: 7.276e-05, [1] [Cycle 1]: 6.67e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 6.89999e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.29003e-06 [fold_const_symbol]: 8.55001e-06 [renormalize]: 2.60014e-07 [validate]: 3.387e-05 Sums bootstrap : 0.000268s : 0.23% type_inference : 0.072016s : 62.12% event_method : 0.000310s : 0.27% auto_monad : 0.000113s : 0.10% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.03% rewriter_before_opt_a : 0.000135s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000125s : 0.11% jit_opt_a.loop_unroll : 0.000097s : 0.08% jit_opt_a.a_1 : 0.002329s : 2.01% jit_opt_a.with_stream_mark : 0.000066s : 0.06% jit_opt_a.recompute_prepare : 0.000037s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000030s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000028s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000051s : 0.04% jit_opt_a.meta_fg_expand : 0.001863s : 1.61% jit_opt_a.replace_old_param : 0.000090s : 0.08% jit_opt_a.inline_without_move : 0.000079s : 0.07% jit_opt_a.renormalize : 0.035494s : 30.62% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000093s : 0.08% jit_opt_a.cse : 0.000318s : 0.27% jit_opt_a.replace_applicator : 0.000128s : 0.11% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000713s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000407s : 0.35% jit_opt_after_cconv.c_1 : 0.000060s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000043s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000440s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000580 112 0.43% : 0.000003s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 0.82% : 0.000005s : 2: substitution.graph_param_transform 64.50% : 0.000374s : 13: substitution.inline 3.03% : 0.000018s : 2: substitution.inline_without_move 1.80% : 0.000010s : 14: substitution.j_node_and_user_rematch 1.89% : 0.000011s : 7: substitution.minmaximum_grad 1.28% : 0.000007s : 5: substitution.partial_eliminate 2.09% : 0.000012s : 14: substitution.remove_not_recompute_node 5.47% : 0.000032s : 10: substitution.replace_applicator 1.24% : 0.000007s : 10: substitution.replace_old_param 1.42% : 0.000008s : 1: substitution.reshape_eliminate 0.53% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.16% : 0.000007s : 1: substitution.tile_eliminate 3.98% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.64% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.52% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071906 2 96.49% : 0.069384s : 1: type_inference.infer 3.51% : 0.002522s : 1: type_inference.specialize ------[replace.] 0.000174 20 65.86% : 0.000115s : 13: replace.inline 34.14% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000388 20 94.30% : 0.000366s : 13: match.inline 5.70% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000412 2852 1.77% : 0.000007s : 49: predicate.accumulaten_eliminater 0.25% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 49: predicate.addn_check_dump 1.63% : 0.000007s : 49: predicate.addn_zero_filter 1.96% : 0.000008s : 49: predicate.arithmetic_simplify 1.63% : 0.000007s : 49: predicate.cast_eliminate 0.12% : 0.000001s : 2: predicate.check_bprop_eliminate 1.43% : 0.000006s : 49: predicate.compare_switch_simplify 1.51% : 0.000006s : 49: predicate.depend_value_elim 1.48% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 49: predicate.dict_get_item_eliminator 1.51% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.12% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 49: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 49: predicate.environ_get_depend_swap 1.51% : 0.000006s : 49: predicate.environ_get_eliminate 1.45% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.99% : 0.000004s : 21: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.31% : 0.000018s : 73: predicate.inline 2.08% : 0.000009s : 49: predicate.inline_without_move 0.39% : 0.000002s : 21: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 21: predicate.less_batch_normalization 1.88% : 0.000008s : 56: predicate.list_to_tuple_eliminator_ 1.86% : 0.000008s : 58: predicate.load_eliminater 0.34% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.35% : 0.000014s : 102: predicate.loop_unroll_before_grad 1.74% : 0.000007s : 51: predicate.make_slice_get_slice_eliminator 1.46% : 0.000006s : 49: predicate.merge_addn 1.49% : 0.000006s : 49: predicate.minmaximum_grad 0.35% : 0.000001s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.35% : 0.000010s : 58: predicate.partial_eliminate 1.49% : 0.000006s : 49: predicate.print_const_string_wrapper 2.14% : 0.000009s : 49: predicate.reduce_eliminate 1.84% : 0.000008s : 56: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 21: predicate.remove_not_recompute_node 2.79% : 0.000011s : 106: predicate.replace_applicator 1.14% : 0.000005s : 49: predicate.replace_old_param 0.06% : 0.000000s : 2: predicate.reset_defer_inline 1.79% : 0.000007s : 49: predicate.reshape_eliminate 1.62% : 0.000007s : 49: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 2: predicate.row_tensor_eliminate 1.51% : 0.000006s : 49: predicate.same_eliminate 0.47% : 0.000002s : 21: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 4: predicate.special_op_eliminate 0.86% : 0.000004s : 21: predicate.specialize_transform 1.79% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000007s : 49: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.77% : 0.000011s : 69: predicate.switch_defer_inline 2.43% : 0.000010s : 69: predicate.switch_layer_defer_inline 6.38% : 0.000026s : 173: predicate.switch_simplify 1.59% : 0.000007s : 49: predicate.tile_eliminate 1.58% : 0.000007s : 49: predicate.transpose_eliminate 1.90% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000007s : 49: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000014s : 60: predicate.tuple_list_get_item_eliminator 1.91% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 56: predicate.tuple_to_list_eliminator_ 1.79% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.82% : 0.000012s : 79: predicate.updatestate_useless_node_eliminater 1.85% : 0.000008s : 49: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.18% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004953 58 77.35% : 0.003832s : 41: func_graph_cloner_run.FuncGraphClonerGraph 22.65% : 0.001122s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.159020 87 0.03% : 0.000046s : 1: add_recomputation 0.08% : 0.000120s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.18% : 0.000291s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.20% : 0.000318s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 28.44% : 0.045221s : 1: jit_opt_a 0.12% : 0.000186s : 1: jit_opt_after_cconv 0.03% : 0.000051s : 1: jit_opt_b 0.26% : 0.000414s : 1: loop_unroll 0.45% : 0.000721s : 1: mutable_eliminate 1.92% : 0.003059s : 39: opt.transform.jit_opt_a 0.05% : 0.000084s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000448s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 20.63% : 0.032799s : 2: renormalize.infer 1.68% : 0.002670s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.09% : 0.000138s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 45.30% : 0.072036s : 1: type_inference TotalTime = 0.142036, [30] [bootstrap]: 0.00035055 [type_inference]: 0.130876 [event_method]: 1.892e-05 [auto_monad]: 6.57e-05 [graph_reusing]: 5.37001e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00050593 [rewriter_before_opt_a]: 8.276e-05 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00796042, [2] [Cycle 1]: 0.00415547, [27] [switch_simplify]: 4.921e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.00053612 [with_stream_mark]: 1.479e-05 [recompute_prepare]: 8.87999e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 7.71999e-06 [updatestate_useless_node_eliminater]: 6.23002e-06 [accelerated_algorithm]: 6.88998e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.97002e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 9.75002e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.36002e-06 [inline_without_move]: 5.96998e-06 [renormalize]: 0.00319928 [add_forward_monad_depend]: 5.40001e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.616e-05 [cse]: 2.329e-05 [replace_applicator]: 1.549e-05 [Cycle 2]: 0.00036506, [27] [switch_simplify]: 7.13e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.0001217 [with_stream_mark]: 1.008e-05 [recompute_prepare]: 6.04999e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.56998e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 3.24001e-06 [cell_reuse_recompute_pass]: 3.08998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.29003e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.167e-05 [replace_applicator]: 5.68002e-06 [py_interpret_to_execute_after_opt_a]: 1.011e-05 [rewriter_after_opt_a]: 3.167e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00060081 [jit_opt_b]: 5.544e-05, [1] [Cycle 1]: 4.936e-05, [2] [frontend_op_eliminate]: 2.029e-05 [inline_after_opt_a]: 1.825e-05 [cconv]: 2.237e-05 [loop_unroll]: 0.00043618 [jit_opt_after_cconv]: 0.00014703, [1] [Cycle 1]: 0.00014071, [11] [c_1]: 2.589e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 4.79002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.849e-05 [call_graph_tuple_transform]: 2.034e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.326e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 7.26001e-06 [add_recomputation]: 4.645e-05 [cse_after_recomputation]: 2.172e-05, [1] [Cycle 1]: 1.583e-05, [1] [cse]: 1.048e-05 [auto_monad_reorder]: 1.401e-05 [get_jit_bprop_graph]: 1.78002e-06 [rewriter_after_jit_bprop_graph]: 4.35999e-06 [opt_after_jit_grad]: 0.00045116 [symbol_engine_optimizer]: 7.713e-05, [1] [Cycle 1]: 7.134e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 9.40001e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 1.111e-05 [renormalize]: 3.19997e-07 [validate]: 4.131e-05 Sums bootstrap : 0.000351s : 0.25% type_inference : 0.130876s : 94.81% event_method : 0.000019s : 0.01% auto_monad : 0.000066s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000506s : 0.37% rewriter_before_opt_a : 0.000083s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.04% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000658s : 0.48% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003199s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.02% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000601s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000022s : 0.02% loop_unroll : 0.000436s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000451s : 0.33% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000189 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 1.64% : 0.000003s : 2: substitution.fold_const_symbol 3.30% : 0.000006s : 4: substitution.graph_param_transform 81.43% : 0.000154s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.10% : 0.000006s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 5.93% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.130801 2 97.05% : 0.126940s : 1: type_inference.infer 2.95% : 0.003861s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.97% : 0.000046s : 4: replace.inline 33.03% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.77% : 0.000151s : 4: match.inline 6.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.51% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.09% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.74% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000001s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.69% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 1.10% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.36% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.50% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002444 22 66.19% : 0.001618s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.17% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.64% : 0.000798s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146191 72 0.03% : 0.000049s : 1: add_recomputation 0.05% : 0.000069s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000367s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.45% : 0.007964s : 1: jit_opt_a 0.10% : 0.000150s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.30% : 0.000443s : 1: loop_unroll 0.42% : 0.000608s : 1: mutable_eliminate 0.61% : 0.000885s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000511s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.64% : 0.002395s : 1: renormalize.infer 0.54% : 0.000796s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000034s : 1: rewriter_after_opt_a 0.06% : 0.000088s : 1: rewriter_before_opt_a 0.05% : 0.000080s : 1: symbol_engine_optimizer 89.53% : 0.130888s : 1: type_inference TotalTime = 0.0460902, [30] [bootstrap]: 0.0003243 [type_inference]: 0.0361282 [event_method]: 2.288e-05 [auto_monad]: 6.843e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00014112 [rewriter_before_opt_a]: 8.316e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00680379, [2] [Cycle 1]: 0.00248182, [27] [switch_simplify]: 6.392e-05 [loop_unroll]: 3.049e-05 [a_1]: 0.00061626 [with_stream_mark]: 2.439e-05 [recompute_prepare]: 1.017e-05 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.84001e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.20997e-06 [merge_forward]: 4.94003e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.68998e-06 [replace_old_param]: 9.97001e-06 [inline_without_move]: 6.83e-06 [renormalize]: 0.00137607 [add_forward_monad_depend]: 6.89001e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.742e-05 [cse]: 3.379e-05 [replace_applicator]: 1.596e-05 [Cycle 2]: 0.0003808, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.92999e-06 [a_1]: 9.9e-05 [with_stream_mark]: 1.197e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.38002e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 8.66002e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 6.46999e-06 [cse]: 4.705e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 1.492e-05 [rewriter_after_opt_a]: 4.051e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.0007682 [jit_opt_b]: 5.256e-05, [1] [Cycle 1]: 4.498e-05, [2] [frontend_op_eliminate]: 1.749e-05 [inline_after_opt_a]: 1.701e-05 [cconv]: 2.665e-05 [loop_unroll]: 0.00044698 [jit_opt_after_cconv]: 0.00015964, [1] [Cycle 1]: 0.00015249, [11] [c_1]: 2.284e-05 [parameter_eliminate]: 3.11001e-06 [updatestate_depend_eliminate]: 7.01999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.863e-05 [call_graph_tuple_transform]: 2.102e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.787e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.89001e-06 [add_recomputation]: 5.425e-05 [cse_after_recomputation]: 2.415e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.227e-05 [auto_monad_reorder]: 1.819e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 6.59999e-06 [opt_after_jit_grad]: 0.00054106 [symbol_engine_optimizer]: 8.305e-05, [1] [Cycle 1]: 7.618e-05, [6] [build]: 4.22e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.458e-05 [opt_reshape]: 8.1e-06 [fold_const_symbol]: 1.008e-05 [renormalize]: 5.10016e-07 [validate]: 4.633e-05 Sums bootstrap : 0.000324s : 0.78% type_inference : 0.036128s : 86.99% event_method : 0.000023s : 0.06% auto_monad : 0.000068s : 0.16% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000141s : 0.34% rewriter_before_opt_a : 0.000083s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.17% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000715s : 1.72% jit_opt_a.with_stream_mark : 0.000036s : 0.09% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001376s : 3.31% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000081s : 0.19% jit_opt_a.replace_applicator : 0.000022s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000041s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000768s : 1.85% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000027s : 0.06% loop_unroll : 0.000447s : 1.08% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000054s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000541s : 1.30% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.11% Time group info: ------[substitution.] 0.000251 23 1.11% : 0.000003s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 85.71% : 0.000215s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000004s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 5.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036051 2 93.64% : 0.033757s : 1: type_inference.infer 6.36% : 0.002294s : 1: type_inference.specialize ------[replace.] 0.000087 6 68.83% : 0.000060s : 4: replace.inline 31.17% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.89% : 0.000212s : 4: match.inline 5.11% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000002s : 10: predicate.addn_zero_filter 2.13% : 0.000003s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.43% : 0.000002s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 2.37% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 2.21% : 0.000003s : 15: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.87% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.59% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.14% : 0.000004s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.69% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.82% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.90% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001115 13 34.28% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.64% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 61.08% : 0.000681s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048473 72 0.12% : 0.000057s : 1: add_recomputation 0.15% : 0.000072s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.69% : 0.000335s : 1: bootstrap 0.06% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.05% : 0.006808s : 1: jit_opt_a 0.33% : 0.000162s : 1: jit_opt_after_cconv 0.11% : 0.000056s : 1: jit_opt_b 0.94% : 0.000455s : 1: loop_unroll 1.60% : 0.000777s : 1: mutable_eliminate 1.96% : 0.000952s : 26: opt.transform.jit_opt_a 0.11% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000549s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000145s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.68% : 0.000813s : 1: renormalize.infer 1.14% : 0.000553s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000044s : 1: rewriter_after_opt_a 0.18% : 0.000087s : 1: rewriter_before_opt_a 0.18% : 0.000086s : 1: symbol_engine_optimizer 74.58% : 0.036149s : 1: type_inference TotalTime = 0.0494247, [30] [bootstrap]: 0.00028758 [type_inference]: 0.0401785 [event_method]: 2.259e-05 [auto_monad]: 7.169e-05 [graph_reusing]: 5.90002e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 9.986e-05 [rewriter_before_opt_a]: 8.01e-05 [expand_dump_flag]: 3.67998e-06 [jit_opt_a]: 0.00631991, [2] [Cycle 1]: 0.00212644, [27] [switch_simplify]: 6.296e-05 [loop_unroll]: 3.233e-05 [a_1]: 0.00064586 [with_stream_mark]: 2.492e-05 [recompute_prepare]: 1.056e-05 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.641e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.091e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00096337 [add_forward_monad_depend]: 7.78999e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.945e-05 [cse]: 3.821e-05 [replace_applicator]: 1.564e-05 [Cycle 2]: 0.00034843, [27] [switch_simplify]: 6.63e-06 [loop_unroll]: 5.62001e-06 [a_1]: 9.327e-05 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.12e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 7.52998e-06 [cse]: 1.498e-05 [replace_applicator]: 5.51e-06 [py_interpret_to_execute_after_opt_a]: 1.499e-05 [rewriter_after_opt_a]: 3.991e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00063741 [jit_opt_b]: 5.151e-05, [1] [Cycle 1]: 4.33e-05, [2] [frontend_op_eliminate]: 1.471e-05 [inline_after_opt_a]: 1.725e-05 [cconv]: 3.183e-05 [loop_unroll]: 0.00043757 [jit_opt_after_cconv]: 0.00015042, [1] [Cycle 1]: 0.00014331, [11] [c_1]: 1.969e-05 [parameter_eliminate]: 3.07002e-06 [updatestate_depend_eliminate]: 6.44001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.618e-05 [call_graph_tuple_transform]: 2.054e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 7.99977e-07 [switch_simplify]: 5.06002e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 5.55e-05 [cse_after_recomputation]: 2.455e-05, [1] [Cycle 1]: 1.89e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 2.08998e-06 [rewriter_after_jit_bprop_graph]: 7.08e-06 [opt_after_jit_grad]: 0.00052269 [symbol_engine_optimizer]: 7.33e-05, [1] [Cycle 1]: 6.611e-05, [6] [build]: 4.54002e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.313e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 5.89993e-07 [validate]: 4.182e-05 Sums bootstrap : 0.000288s : 0.64% type_inference : 0.040179s : 89.44% event_method : 0.000023s : 0.05% auto_monad : 0.000072s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000100s : 0.22% rewriter_before_opt_a : 0.000080s : 0.18% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.15% jit_opt_a.loop_unroll : 0.000038s : 0.08% jit_opt_a.a_1 : 0.000739s : 1.65% jit_opt_a.with_stream_mark : 0.000038s : 0.08% jit_opt_a.recompute_prepare : 0.000016s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000963s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.06% jit_opt_a.cse : 0.000053s : 0.12% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000040s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000637s : 1.42% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000032s : 0.07% loop_unroll : 0.000438s : 0.97% jit_opt_after_cconv.c_1 : 0.000020s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000523s : 1.16% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.09% Time group info: ------[substitution.] 0.000259 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 85.11% : 0.000221s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 2.30% : 0.000006s : 2: substitution.replace_old_param 5.65% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040099 2 96.66% : 0.038758s : 1: type_inference.infer 3.34% : 0.001341s : 1: type_inference.specialize ------[replace.] 0.000117 6 80.25% : 0.000094s : 4: replace.inline 19.75% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.19% : 0.000218s : 4: match.inline 5.81% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.39% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.08% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.51% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.66% : 0.000001s : 3: predicate.graph_param_transform 6.04% : 0.000008s : 22: predicate.inline 1.06% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 2.53% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.65% : 0.000003s : 3: predicate.mutable_eliminate 0.37% : 0.000000s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.70% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000787 13 46.45% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.91% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.64% : 0.000367s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051418 72 0.11% : 0.000059s : 1: add_recomputation 0.15% : 0.000076s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.60% : 0.000308s : 1: bootstrap 0.07% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.30% : 0.006324s : 1: jit_opt_a 0.30% : 0.000153s : 1: jit_opt_after_cconv 0.11% : 0.000054s : 1: jit_opt_b 0.87% : 0.000447s : 1: loop_unroll 1.26% : 0.000649s : 1: mutable_eliminate 1.91% : 0.000982s : 26: opt.transform.jit_opt_a 0.09% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.04% : 0.000534s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000104s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.10% : 0.000565s : 1: renormalize.infer 0.76% : 0.000389s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.16% : 0.000084s : 1: rewriter_before_opt_a 0.15% : 0.000076s : 1: symbol_engine_optimizer 78.19% : 0.040201s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.409.367 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.410.134 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0847695, [30] [bootstrap]: 0.00038337 [type_inference]: 0.0714604 [event_method]: 2.552e-05 [auto_monad]: 7.801e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 0.00049158 [rewriter_before_opt_a]: 0.00010854 [expand_dump_flag]: 3.74002e-06 [jit_opt_a]: 0.00958851, [2] [Cycle 1]: 0.00501765, [27] [switch_simplify]: 7.748e-05 [loop_unroll]: 3.587e-05 [a_1]: 0.00076079 [with_stream_mark]: 1.866e-05 [recompute_prepare]: 9.51e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.8e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 7.97003e-06 [updatestate_useless_node_eliminater]: 6.57002e-06 [accelerated_algorithm]: 7.61001e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 7.33e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.803e-05 [j_node_and_user_rematch]: 1.115e-05 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 6.69001e-06 [renormalize]: 0.00372717 [add_forward_monad_depend]: 8.94998e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.64e-05 [cse]: 3.775e-05 [replace_applicator]: 2.325e-05 [Cycle 2]: 0.00043632, [27] [switch_simplify]: 8.13999e-06 [loop_unroll]: 6.59001e-06 [a_1]: 0.00013715 [with_stream_mark]: 1.382e-05 [recompute_prepare]: 6.68998e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 6.08998e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 3.22002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 9.72999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 6.79999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.95998e-06 [cse]: 1.823e-05 [replace_applicator]: 6.95998e-06 [py_interpret_to_execute_after_opt_a]: 1.58e-05 [rewriter_after_opt_a]: 4.104e-05 [convert_after_rewriter]: 7.52998e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.0008091 [jit_opt_b]: 6.51e-05, [1] [Cycle 1]: 5.602e-05, [2] [frontend_op_eliminate]: 2.289e-05 [inline_after_opt_a]: 1.981e-05 [cconv]: 3.006e-05 [loop_unroll]: 0.00049644 [jit_opt_after_cconv]: 0.00017815, [1] [Cycle 1]: 0.00017106, [11] [c_1]: 2.78e-05 [parameter_eliminate]: 3.9e-06 [updatestate_depend_eliminate]: 6.74001e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 3.225e-05 [call_graph_tuple_transform]: 2.418e-05 [tuple_list_get_item_eliminator]: 7.01999e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 7.41001e-06 [remove_dup_value]: 2.025e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 1.145e-05 [add_recomputation]: 5.358e-05 [cse_after_recomputation]: 2.651e-05, [1] [Cycle 1]: 2.102e-05, [1] [cse]: 1.49e-05 [auto_monad_reorder]: 1.786e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 6.43e-06 [opt_after_jit_grad]: 0.00050198 [symbol_engine_optimizer]: 8.471e-05, [1] [Cycle 1]: 7.606e-05, [6] [build]: 4.08001e-06 [elim_shapecalc]: 9.52001e-06 [elim_not_effective]: 1.504e-05 [opt_reshape]: 8.94998e-06 [fold_const_symbol]: 9.28997e-06 [renormalize]: 1.03001e-06 [validate]: 5.166e-05 Sums bootstrap : 0.000383s : 0.48% type_inference : 0.071460s : 89.35% event_method : 0.000026s : 0.03% auto_monad : 0.000078s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000492s : 0.61% rewriter_before_opt_a : 0.000109s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.11% jit_opt_a.loop_unroll : 0.000042s : 0.05% jit_opt_a.a_1 : 0.000898s : 1.12% jit_opt_a.with_stream_mark : 0.000032s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.003727s : 4.66% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000056s : 0.07% jit_opt_a.replace_applicator : 0.000030s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000809s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.04% loop_unroll : 0.000496s : 0.62% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000502s : 0.63% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.06% Time group info: ------[substitution.] 0.000295 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000007s : 4: substitution.graph_param_transform 86.85% : 0.000256s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000006s : 4: substitution.remove_not_recompute_node 1.72% : 0.000005s : 2: substitution.replace_old_param 4.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071341 2 94.80% : 0.067633s : 1: type_inference.infer 5.20% : 0.003708s : 1: type_inference.specialize ------[replace.] 0.000124 7 66.29% : 0.000082s : 5: replace.inline 33.71% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 95.40% : 0.000253s : 5: match.inline 4.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.67% : 0.000003s : 13: predicate.addn_zero_filter 2.37% : 0.000004s : 13: predicate.arithmetic_simplify 1.55% : 0.000002s : 13: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.28% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.60% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.13% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.05% : 0.000002s : 13: predicate.print_const_string_wrapper 1.73% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.53% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.79% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 1.95% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.03% : 0.000011s : 65: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.65% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003374 29 65.84% : 0.002221s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.10% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.06% : 0.001082s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.089750 72 0.06% : 0.000057s : 1: add_recomputation 0.09% : 0.000081s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.45% : 0.000400s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000014s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.69% : 0.009593s : 1: jit_opt_a 0.20% : 0.000181s : 1: jit_opt_after_cconv 0.08% : 0.000068s : 1: jit_opt_b 0.56% : 0.000504s : 1: loop_unroll 0.91% : 0.000817s : 1: mutable_eliminate 1.32% : 0.001185s : 26: opt.transform.jit_opt_a 0.07% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000036s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.55% : 0.000497s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 2.92% : 0.002621s : 1: renormalize.infer 1.22% : 0.001094s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.13% : 0.000114s : 1: rewriter_before_opt_a 0.10% : 0.000087s : 1: symbol_engine_optimizer 79.64% : 0.071479s : 1: type_inference TotalTime = 0.138747, [30] [bootstrap]: 0.00031369 [type_inference]: 0.125313 [event_method]: 2.131e-05 [auto_monad]: 7.345e-05 [graph_reusing]: 6.83e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00070869 [rewriter_before_opt_a]: 9.269e-05 [expand_dump_flag]: 4.53001e-06 [jit_opt_a]: 0.00960937, [2] [Cycle 1]: 0.00520873, [27] [switch_simplify]: 7.273e-05 [loop_unroll]: 3.182e-05 [a_1]: 0.00067874 [with_stream_mark]: 1.702e-05 [recompute_prepare]: 9.14998e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.44001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 8.03999e-06 [updatestate_useless_node_eliminater]: 7.31001e-06 [accelerated_algorithm]: 8.46002e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 7.82e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 1.26e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.204e-05 [inline_without_move]: 7e-06 [renormalize]: 0.00404811 [add_forward_monad_depend]: 6.35002e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 2.941e-05 [replace_applicator]: 1.34e-05 [Cycle 2]: 0.00038932, [27] [switch_simplify]: 6.46999e-06 [loop_unroll]: 6.26998e-06 [a_1]: 0.00013461 [with_stream_mark]: 1.196e-05 [recompute_prepare]: 5.81003e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.66998e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 2.74999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.24003e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.09e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.376e-05 [rewriter_after_opt_a]: 3.522e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 1.757e-05 [mutable_eliminate]: 0.00074354 [jit_opt_b]: 6.092e-05, [1] [Cycle 1]: 5.396e-05, [2] [frontend_op_eliminate]: 2.12e-05 [inline_after_opt_a]: 2.07e-05 [cconv]: 2.664e-05 [loop_unroll]: 0.0004609 [jit_opt_after_cconv]: 0.00015436, [1] [Cycle 1]: 0.00014798, [11] [c_1]: 2.7e-05 [parameter_eliminate]: 2.70002e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 1.73e-05 [call_graph_tuple_transform]: 2.45e-05 [tuple_list_get_item_eliminator]: 6.06998e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 8.29002e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 8.97e-06 [add_recomputation]: 5.424e-05 [cse_after_recomputation]: 2.096e-05, [1] [Cycle 1]: 1.546e-05, [1] [cse]: 9.76e-06 [auto_monad_reorder]: 1.482e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 8.12e-06 [opt_after_jit_grad]: 0.00062868 [symbol_engine_optimizer]: 8.589e-05, [1] [Cycle 1]: 7.895e-05, [6] [build]: 4.63999e-06 [elim_shapecalc]: 8.97999e-06 [elim_not_effective]: 1.641e-05 [opt_reshape]: 7.95e-06 [fold_const_symbol]: 1.064e-05 [renormalize]: 3.80009e-07 [validate]: 4.542e-05 Sums bootstrap : 0.000314s : 0.23% type_inference : 0.125313s : 93.43% event_method : 0.000021s : 0.02% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000709s : 0.53% rewriter_before_opt_a : 0.000093s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000813s : 0.61% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004048s : 3.02% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000018s : 0.01% mutable_eliminate : 0.000744s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000461s : 0.34% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000629s : 0.47% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000272 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000007s : 4: substitution.graph_param_transform 86.55% : 0.000236s : 4: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000006s : 4: substitution.remove_not_recompute_node 1.63% : 0.000004s : 2: substitution.replace_old_param 4.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125218 2 96.47% : 0.120795s : 1: type_inference.infer 3.53% : 0.004423s : 1: type_inference.specialize ------[replace.] 0.000093 6 66.16% : 0.000062s : 4: replace.inline 33.84% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 95.30% : 0.000233s : 4: match.inline 4.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.58% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.69% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_depend_swap 1.10% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 4.92% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 1.43% : 0.000002s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.45% : 0.000002s : 12: predicate.print_const_string_wrapper 1.98% : 0.000003s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.14% : 0.000002s : 12: predicate.reshape_eliminate 1.49% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.47% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002614 22 62.27% : 0.001627s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.07% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.66% : 0.000932s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143948 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000077s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000331s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.68% : 0.009614s : 1: jit_opt_a 0.11% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.32% : 0.000468s : 1: loop_unroll 0.52% : 0.000752s : 1: mutable_eliminate 0.75% : 0.001075s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000637s : 1: opt_after_jit_grad 0.01% : 0.000020s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000716s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 2.13% : 0.003063s : 1: renormalize.infer 0.68% : 0.000975s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000097s : 1: rewriter_before_opt_a 0.06% : 0.000088s : 1: symbol_engine_optimizer 87.07% : 0.125331s : 1: type_inference TotalTime = 0.0340367, [30] [bootstrap]: 0.00030637 [type_inference]: 0.0249523 [event_method]: 2.252e-05 [auto_monad]: 6.865e-05 [graph_reusing]: 6.16998e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.00017827 [rewriter_before_opt_a]: 8.463e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00627587, [2] [Cycle 1]: 0.00207658, [27] [switch_simplify]: 5.553e-05 [loop_unroll]: 3.098e-05 [a_1]: 0.00052441 [with_stream_mark]: 9.85002e-06 [recompute_prepare]: 7.23e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.239e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.00115059 [add_forward_monad_depend]: 5.72999e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 1.336e-05 [cse]: 2.491e-05 [replace_applicator]: 1.144e-05 [Cycle 2]: 0.00034462, [27] [switch_simplify]: 5.63997e-06 [loop_unroll]: 6.15002e-06 [a_1]: 9.735e-05 [with_stream_mark]: 9.27999e-06 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 7.50006e-07 [specialize_transform]: 5.75001e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.79998e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.002e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 7.57998e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.38998e-06 [cse]: 1.342e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.051e-05 [rewriter_after_opt_a]: 3.199e-05 [convert_after_rewriter]: 6.34999e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00056685 [jit_opt_b]: 4.985e-05, [1] [Cycle 1]: 4.433e-05, [2] [frontend_op_eliminate]: 1.684e-05 [inline_after_opt_a]: 1.645e-05 [cconv]: 1.902e-05 [loop_unroll]: 0.00042908 [jit_opt_after_cconv]: 0.00014575, [1] [Cycle 1]: 0.00013954, [11] [c_1]: 2.187e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.473e-05 [call_graph_tuple_transform]: 1.72e-05 [tuple_list_get_item_eliminator]: 5.66998e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 2.30008e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.131e-05 [partial_unused_args_eliminate]: 1.98997e-06 [environ_conv]: 4.45e-06 [add_recomputation]: 3.674e-05 [cse_after_recomputation]: 2.547e-05, [1] [Cycle 1]: 1.965e-05, [1] [cse]: 1.387e-05 [auto_monad_reorder]: 1.491e-05 [get_jit_bprop_graph]: 1.67999e-06 [rewriter_after_jit_bprop_graph]: 4.97999e-06 [opt_after_jit_grad]: 0.00047511 [symbol_engine_optimizer]: 7.562e-05, [1] [Cycle 1]: 6.912e-05, [6] [build]: 2.60002e-06 [elim_shapecalc]: 9.21002e-06 [elim_not_effective]: 1.437e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 9.22999e-06 [renormalize]: 6.50005e-07 [validate]: 3.571e-05 Sums bootstrap : 0.000306s : 1.03% type_inference : 0.024952s : 84.29% event_method : 0.000023s : 0.08% auto_monad : 0.000069s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000178s : 0.60% rewriter_before_opt_a : 0.000085s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.21% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000622s : 2.10% jit_opt_a.with_stream_mark : 0.000019s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001151s : 3.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000038s : 0.13% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000032s : 0.11% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000567s : 1.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000019s : 0.06% loop_unroll : 0.000429s : 1.45% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000011s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000004s : 0.02% add_recomputation : 0.000037s : 0.12% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000015s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000475s : 1.60% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.12% Time group info: ------[substitution.] 0.000183 23 1.41% : 0.000003s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000004s : 3: substitution.graph_param_transform 84.56% : 0.000155s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000004s : 4: substitution.remove_not_recompute_node 1.31% : 0.000002s : 2: substitution.replace_old_param 5.81% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024865 2 82.75% : 0.020577s : 1: type_inference.infer 17.25% : 0.004288s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.29% : 0.000047s : 4: replace.inline 33.71% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 94.23% : 0.000152s : 4: match.inline 5.77% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 2.17% : 0.000003s : 10: predicate.arithmetic_simplify 1.60% : 0.000002s : 10: predicate.cast_eliminate 0.70% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.25% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.50% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.36% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.11% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.74% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.09% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.38% : 0.000002s : 10: predicate.minmaximum_grad 1.35% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.52% : 0.000003s : 15: predicate.partial_eliminate 1.58% : 0.000002s : 10: predicate.print_const_string_wrapper 2.18% : 0.000003s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.84% : 0.000009s : 53: predicate.switch_simplify 1.56% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001061 13 47.60% : 0.000505s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.94% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.46% : 0.000525s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036090 72 0.16% : 0.000058s : 1: add_recomputation 0.20% : 0.000071s : 1: auto_monad 0.05% : 0.000018s : 1: auto_monad_reorder 0.90% : 0.000323s : 1: bootstrap 0.06% : 0.000022s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000006s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.40% : 0.006280s : 1: jit_opt_a 0.41% : 0.000149s : 1: jit_opt_after_cconv 0.14% : 0.000052s : 1: jit_opt_b 1.21% : 0.000436s : 1: loop_unroll 1.59% : 0.000573s : 1: mutable_eliminate 2.35% : 0.000847s : 26: opt.transform.jit_opt_a 0.13% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000011s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000483s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000182s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000014s : 1: remove_dup_value 1.94% : 0.000699s : 1: renormalize.infer 1.23% : 0.000444s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000035s : 1: rewriter_after_opt_a 0.24% : 0.000088s : 1: rewriter_before_opt_a 0.22% : 0.000078s : 1: symbol_engine_optimizer 69.17% : 0.024963s : 1: type_inference TotalTime = 0.0286034, [30] [bootstrap]: 0.00037672 [type_inference]: 0.0204868 [event_method]: 1.915e-05 [auto_monad]: 6.584e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 9.542e-05 [rewriter_before_opt_a]: 7.722e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00537437, [2] [Cycle 1]: 0.00194872, [27] [switch_simplify]: 5.317e-05 [loop_unroll]: 2.948e-05 [a_1]: 0.00053443 [with_stream_mark]: 1.909e-05 [recompute_prepare]: 7.36999e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.00097368 [add_forward_monad_depend]: 6.47001e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.537e-05 [cse]: 3.704e-05 [replace_applicator]: 1.358e-05 [Cycle 2]: 0.00031671, [27] [switch_simplify]: 5.83002e-06 [loop_unroll]: 4.94e-06 [a_1]: 8.816e-05 [with_stream_mark]: 1.053e-05 [recompute_prepare]: 5.11997e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 4.85999e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 7.69002e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 6.78e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.255e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.14e-05 [rewriter_after_opt_a]: 3.539e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 5.41002e-06 [mutable_eliminate]: 0.00053778 [jit_opt_b]: 4.767e-05, [1] [Cycle 1]: 4.093e-05, [2] [frontend_op_eliminate]: 1.502e-05 [inline_after_opt_a]: 1.555e-05 [cconv]: 2.583e-05 [loop_unroll]: 0.00040024 [jit_opt_after_cconv]: 0.00013778, [1] [Cycle 1]: 0.00013135, [11] [c_1]: 2.034e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.34998e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 1.987e-05 [call_graph_tuple_transform]: 1.858e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.24e-06 [remove_dup_value]: 1.687e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 5.47001e-06 [add_recomputation]: 4.865e-05 [cse_after_recomputation]: 2.418e-05, [1] [Cycle 1]: 1.861e-05, [1] [cse]: 1.225e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.000439 [symbol_engine_optimizer]: 7.014e-05, [1] [Cycle 1]: 6.381e-05, [6] [build]: 3.29001e-06 [elim_shapecalc]: 7.24001e-06 [elim_not_effective]: 1.28e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 4.09986e-07 [validate]: 3.786e-05 Sums bootstrap : 0.000377s : 1.51% type_inference : 0.020487s : 82.34% event_method : 0.000019s : 0.08% auto_monad : 0.000066s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000095s : 0.38% rewriter_before_opt_a : 0.000077s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000623s : 2.50% jit_opt_a.with_stream_mark : 0.000030s : 0.12% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000974s : 3.91% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000050s : 0.20% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000035s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000538s : 2.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000400s : 1.61% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000049s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000439s : 1.76% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.15% Time group info: ------[substitution.] 0.000213 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.33% : 0.000005s : 3: substitution.graph_param_transform 84.73% : 0.000181s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000004s : 2: substitution.replace_old_param 5.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020401 2 93.71% : 0.019117s : 1: type_inference.infer 6.29% : 0.001284s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.41% : 0.000046s : 4: replace.inline 31.59% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 94.36% : 0.000178s : 4: match.inline 5.64% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.07% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.95% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.62% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.57% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000785 13 48.70% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.26% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.04% : 0.000361s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030450 72 0.17% : 0.000052s : 1: add_recomputation 0.23% : 0.000069s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.31% : 0.000400s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.12% : 0.000035s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.66% : 0.005378s : 1: jit_opt_a 0.46% : 0.000140s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.34% : 0.000408s : 1: loop_unroll 1.79% : 0.000546s : 1: mutable_eliminate 2.74% : 0.000833s : 26: opt.transform.jit_opt_a 0.15% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.47% : 0.000447s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000099s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.98% : 0.000603s : 1: renormalize.infer 1.19% : 0.000362s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000038s : 1: rewriter_after_opt_a 0.26% : 0.000081s : 1: rewriter_before_opt_a 0.24% : 0.000073s : 1: symbol_engine_optimizer 67.34% : 0.020504s : 1: type_inference TotalTime = 0.0693698, [30] [bootstrap]: 0.00034057 [type_inference]: 0.0573452 [event_method]: 2.103e-05 [auto_monad]: 7.164e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00029824 [rewriter_before_opt_a]: 0.00012285 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.0084026, [2] [Cycle 1]: 0.00379719, [27] [switch_simplify]: 6.576e-05 [loop_unroll]: 3.367e-05 [a_1]: 0.0007687 [with_stream_mark]: 2.782e-05 [recompute_prepare]: 1.597e-05 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 3.83999e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 9.57001e-06 [updatestate_useless_node_eliminater]: 8.74003e-06 [accelerated_algorithm]: 7.96001e-06 [meta_shard_fg_expand]: 4.3e-06 [get_grad_eliminate_]: 7.9e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 2.69001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.965e-05 [j_node_and_user_rematch]: 1.143e-05 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.252e-05 [inline_without_move]: 6.98998e-06 [renormalize]: 0.00245442 [add_forward_monad_depend]: 9.47999e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 2.049e-05 [cse]: 2.863e-05 [replace_applicator]: 2.469e-05 [Cycle 2]: 0.0004228, [27] [switch_simplify]: 8.97999e-06 [loop_unroll]: 6.60997e-06 [a_1]: 0.00013625 [with_stream_mark]: 1.568e-05 [recompute_prepare]: 7.11999e-06 [updatestate_depend_eliminate]: 3.65998e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 7.5e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 4.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.992e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 9.12001e-06 [cse]: 1.352e-05 [replace_applicator]: 7.48e-06 [py_interpret_to_execute_after_opt_a]: 1.713e-05 [rewriter_after_opt_a]: 4.446e-05 [convert_after_rewriter]: 1.03e-05 [order_py_execute_after_rewriter]: 5.42999e-06 [mutable_eliminate]: 0.00087856 [jit_opt_b]: 6.826e-05, [1] [Cycle 1]: 6.04e-05, [2] [frontend_op_eliminate]: 2.584e-05 [inline_after_opt_a]: 2.042e-05 [cconv]: 3.381e-05 [loop_unroll]: 0.00050324 [jit_opt_after_cconv]: 0.00017916, [1] [Cycle 1]: 0.00017249, [11] [c_1]: 2.852e-05 [parameter_eliminate]: 5.09e-06 [updatestate_depend_eliminate]: 9.98002e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.36001e-06 [cse]: 2.845e-05 [call_graph_tuple_transform]: 2.671e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 6.54999e-06 [remove_dup_value]: 1.584e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 7.60998e-06 [add_recomputation]: 5.526e-05 [cse_after_recomputation]: 2.338e-05, [1] [Cycle 1]: 1.771e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.618e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 7.75e-06 [opt_after_jit_grad]: 0.00052527 [symbol_engine_optimizer]: 8.479e-05, [1] [Cycle 1]: 7.812e-05, [6] [build]: 4.75001e-06 [elim_shapecalc]: 9.15999e-06 [elim_not_effective]: 1.595e-05 [opt_reshape]: 7.7e-06 [fold_const_symbol]: 1.121e-05 [renormalize]: 2.80008e-07 [validate]: 4.809e-05 Sums bootstrap : 0.000341s : 0.53% type_inference : 0.057345s : 88.93% event_method : 0.000021s : 0.03% auto_monad : 0.000072s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000298s : 0.46% rewriter_before_opt_a : 0.000123s : 0.19% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.12% jit_opt_a.loop_unroll : 0.000040s : 0.06% jit_opt_a.a_1 : 0.000905s : 1.40% jit_opt_a.with_stream_mark : 0.000044s : 0.07% jit_opt_a.recompute_prepare : 0.000023s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000016s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002454s : 3.81% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.05% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000032s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000044s : 0.07% convert_after_rewriter : 0.000010s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000879s : 1.36% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000034s : 0.05% loop_unroll : 0.000503s : 0.78% jit_opt_after_cconv.c_1 : 0.000029s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000055s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000525s : 0.81% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.07% Time group info: ------[substitution.] 0.000292 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.37% : 0.000007s : 4: substitution.graph_param_transform 84.52% : 0.000247s : 4: substitution.inline 1.61% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000007s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 5.87% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057258 2 95.40% : 0.054624s : 1: type_inference.infer 4.60% : 0.002633s : 1: type_inference.specialize ------[replace.] 0.000118 6 56.84% : 0.000067s : 4: replace.inline 43.16% : 0.000051s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 6 94.24% : 0.000243s : 4: match.inline 5.76% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.08% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.53% : 0.000002s : 12: predicate.addn_zero_filter 2.46% : 0.000004s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.72% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000002s : 12: predicate.compare_switch_simplify 0.95% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.15% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.57% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.41% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.06% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.95% : 0.000003s : 8: predicate.less_batch_normalization 1.70% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 18: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 0.93% : 0.000001s : 12: predicate.minmaximum_grad 2.83% : 0.000004s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 1.97% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.00% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 1.26% : 0.000002s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.36% : 0.000005s : 18: predicate.switch_defer_inline 1.88% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.47% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.15% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.63% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.52% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.24% : 0.000004s : 12: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002082 18 63.47% : 0.001321s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.92% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.61% : 0.000700s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073097 72 0.08% : 0.000058s : 1: add_recomputation 0.10% : 0.000075s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.49% : 0.000357s : 1: bootstrap 0.05% : 0.000036s : 1: cconv 0.02% : 0.000013s : 1: convert_after_rewriter 0.08% : 0.000062s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.50% : 0.008408s : 1: jit_opt_a 0.25% : 0.000182s : 1: jit_opt_after_cconv 0.10% : 0.000071s : 1: jit_opt_b 0.70% : 0.000510s : 1: loop_unroll 1.22% : 0.000889s : 1: mutable_eliminate 1.63% : 0.001192s : 26: opt.transform.jit_opt_a 0.09% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000037s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000024s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000532s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000303s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.22% : 0.001625s : 1: renormalize.infer 1.12% : 0.000816s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000048s : 1: rewriter_after_opt_a 0.18% : 0.000129s : 1: rewriter_before_opt_a 0.12% : 0.000087s : 1: symbol_engine_optimizer 78.47% : 0.057360s : 1: type_inference TotalTime = 0.120444, [30] [bootstrap]: 0.00027313 [type_inference]: 0.0742321 [event_method]: 0.00029911 [auto_monad]: 0.00013488 [graph_reusing]: 8.18999e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 3.961e-05 [rewriter_before_opt_a]: 0.0001258 [expand_dump_flag]: 4.85001e-06 [jit_opt_a]: 0.0429702, [3] [Cycle 1]: 0.0195736, [27] [switch_simplify]: 8.905e-05 [loop_unroll]: 4.83e-05 [a_1]: 0.00111556 [with_stream_mark]: 3.996e-05 [recompute_prepare]: 2.396e-05 [updatestate_depend_eliminate]: 9.91e-06 [updatestate_assign_eliminate]: 7.41999e-06 [updatestate_loads_eliminate]: 6.81001e-06 [parameter_eliminate]: 3.6e-06 [specialize_transform]: 1.615e-05 [updatestate_useless_node_eliminater]: 1.448e-05 [accelerated_algorithm]: 1.466e-05 [meta_shard_fg_expand]: 4e-06 [get_grad_eliminate_]: 1.494e-05 [merge_forward]: 1.016e-05 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.024e-05 [j_node_and_user_rematch]: 2.704e-05 [meta_fg_expand]: 0.00222778 [replace_old_param]: 8.349e-05 [inline_without_move]: 6.736e-05 [renormalize]: 0.0149383 [add_forward_monad_depend]: 1.498e-05 [auto_monad_grad]: 6.37001e-06 [auto_monad_eliminator]: 6.663e-05 [cse]: 0.00027801 [replace_applicator]: 9.752e-05 [Cycle 2]: 0.0191435, [27] [switch_simplify]: 4.348e-05 [loop_unroll]: 4.359e-05 [a_1]: 0.00126359 [with_stream_mark]: 2.754e-05 [recompute_prepare]: 1.202e-05 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 4.25e-06 [updatestate_loads_eliminate]: 4.1e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.63003e-06 [accelerated_algorithm]: 6.72002e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.93001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.726e-05 [j_node_and_user_rematch]: 1.136e-05 [meta_fg_expand]: 0.00012124 [replace_old_param]: 1.135e-05 [inline_without_move]: 7.8e-06 [renormalize]: 0.0172138 [add_forward_monad_depend]: 1.261e-05 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 2.235e-05 [cse]: 3.681e-05 [replace_applicator]: 2.736e-05 [Cycle 3]: 0.0003441, [27] [switch_simplify]: 6.85002e-06 [loop_unroll]: 5.19e-06 [a_1]: 8.122e-05 [with_stream_mark]: 1.538e-05 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.83001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 3.7e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 4.43999e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.95002e-06 [cse]: 1.306e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.56e-05 [rewriter_after_opt_a]: 3.833e-05 [convert_after_rewriter]: 6.80998e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00075329 [jit_opt_b]: 4.978e-05, [1] [Cycle 1]: 4.231e-05, [2] [frontend_op_eliminate]: 1.391e-05 [inline_after_opt_a]: 1.589e-05 [cconv]: 2.79e-05 [loop_unroll]: 0.00043026 [jit_opt_after_cconv]: 0.00014249, [1] [Cycle 1]: 0.00013577, [11] [c_1]: 1.662e-05 [parameter_eliminate]: 3.27002e-06 [updatestate_depend_eliminate]: 6.98e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.13002e-06 [cse]: 2.012e-05 [call_graph_tuple_transform]: 1.748e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 4.83001e-06 [remove_dup_value]: 1.683e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 5.59e-06 [add_recomputation]: 4.78e-05 [cse_after_recomputation]: 2.28e-05, [1] [Cycle 1]: 1.786e-05, [1] [cse]: 1.141e-05 [auto_monad_reorder]: 1.531e-05 [get_jit_bprop_graph]: 2.67001e-06 [rewriter_after_jit_bprop_graph]: 5.36998e-06 [opt_after_jit_grad]: 0.00044578 [symbol_engine_optimizer]: 7.297e-05, [1] [Cycle 1]: 6.702e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 7.25998e-06 [elim_not_effective]: 1.302e-05 [opt_reshape]: 5.22999e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 3.00002e-07 [validate]: 3.882e-05 Sums bootstrap : 0.000273s : 0.24% type_inference : 0.074232s : 64.24% event_method : 0.000299s : 0.26% auto_monad : 0.000135s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000126s : 0.11% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000139s : 0.12% jit_opt_a.loop_unroll : 0.000097s : 0.08% jit_opt_a.a_1 : 0.002460s : 2.13% jit_opt_a.with_stream_mark : 0.000083s : 0.07% jit_opt_a.recompute_prepare : 0.000041s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000065s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.04% jit_opt_a.meta_fg_expand : 0.002352s : 2.04% jit_opt_a.replace_old_param : 0.000099s : 0.09% jit_opt_a.inline_without_move : 0.000080s : 0.07% jit_opt_a.renormalize : 0.032152s : 27.83% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.03% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000095s : 0.08% jit_opt_a.cse : 0.000328s : 0.28% jit_opt_a.replace_applicator : 0.000130s : 0.11% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000753s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000430s : 0.37% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000446s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000675 109 0.41% : 0.000003s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 0.76% : 0.000005s : 2: substitution.graph_param_transform 66.12% : 0.000446s : 13: substitution.inline 3.13% : 0.000021s : 2: substitution.inline_without_move 1.76% : 0.000012s : 13: substitution.j_node_and_user_rematch 2.00% : 0.000014s : 7: substitution.minmaximum_grad 1.37% : 0.000009s : 5: substitution.partial_eliminate 1.83% : 0.000012s : 13: substitution.remove_not_recompute_node 5.56% : 0.000038s : 10: substitution.replace_applicator 1.23% : 0.000008s : 10: substitution.replace_old_param 0.50% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000007s : 1: substitution.tile_eliminate 4.09% : 0.000028s : 7: substitution.tuple_list_convert_item_index_to_positive 2.52% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.42% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.074103 2 96.72% : 0.071669s : 1: type_inference.infer 3.28% : 0.002434s : 1: type_inference.specialize ------[replace.] 0.000199 20 66.70% : 0.000133s : 13: replace.inline 33.30% : 0.000066s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000460 20 94.64% : 0.000436s : 13: match.inline 5.36% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000404 2740 1.51% : 0.000006s : 47: predicate.accumulaten_eliminater 0.25% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.60% : 0.000006s : 47: predicate.addn_check_dump 1.73% : 0.000007s : 47: predicate.addn_zero_filter 2.11% : 0.000009s : 47: predicate.arithmetic_simplify 1.60% : 0.000006s : 47: predicate.cast_eliminate 0.10% : 0.000000s : 2: predicate.check_bprop_eliminate 1.43% : 0.000006s : 47: predicate.compare_switch_simplify 1.47% : 0.000006s : 47: predicate.depend_value_elim 1.46% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.12% : 0.000001s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.40% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.43% : 0.000006s : 47: predicate.environ_get_depend_swap 1.48% : 0.000006s : 47: predicate.environ_get_eliminate 1.41% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.83% : 0.000003s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.60% : 0.000019s : 71: predicate.inline 1.93% : 0.000008s : 47: predicate.inline_without_move 0.35% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.03% : 0.000004s : 19: predicate.less_batch_normalization 1.84% : 0.000007s : 54: predicate.list_to_tuple_eliminator_ 1.97% : 0.000008s : 56: predicate.load_eliminater 0.37% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.38% : 0.000014s : 100: predicate.loop_unroll_before_grad 1.70% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.39% : 0.000006s : 47: predicate.merge_addn 1.46% : 0.000006s : 47: predicate.minmaximum_grad 0.42% : 0.000002s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.38% : 0.000010s : 56: predicate.partial_eliminate 1.44% : 0.000006s : 47: predicate.print_const_string_wrapper 2.20% : 0.000009s : 47: predicate.reduce_eliminate 1.83% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 19: predicate.remove_not_recompute_node 3.00% : 0.000012s : 102: predicate.replace_applicator 1.12% : 0.000005s : 47: predicate.replace_old_param 0.11% : 0.000000s : 2: predicate.reset_defer_inline 1.63% : 0.000007s : 47: predicate.reshape_eliminate 1.47% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 2: predicate.row_tensor_eliminate 1.46% : 0.000006s : 47: predicate.same_eliminate 0.55% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 4: predicate.special_op_eliminate 0.79% : 0.000003s : 19: predicate.specialize_transform 1.76% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 47: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.66% : 0.000011s : 67: predicate.switch_defer_inline 2.43% : 0.000010s : 67: predicate.switch_layer_defer_inline 6.25% : 0.000025s : 169: predicate.switch_simplify 1.52% : 0.000006s : 47: predicate.tile_eliminate 1.51% : 0.000006s : 47: predicate.transpose_eliminate 2.03% : 0.000008s : 47: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000015s : 58: predicate.tuple_list_get_item_eliminator 1.92% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 54: predicate.tuple_to_list_eliminator_ 1.97% : 0.000008s : 56: predicate.updatestate_pure_node_eliminater 2.64% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.76% : 0.000007s : 47: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005000 52 77.74% : 0.003887s : 35: func_graph_cloner_run.FuncGraphClonerGraph 22.26% : 0.001113s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155822 87 0.03% : 0.000051s : 1: add_recomputation 0.09% : 0.000143s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.19% : 0.000298s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.20% : 0.000308s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 27.58% : 0.042974s : 1: jit_opt_a 0.09% : 0.000145s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.28% : 0.000438s : 1: loop_unroll 0.49% : 0.000762s : 1: mutable_eliminate 2.06% : 0.003208s : 39: opt.transform.jit_opt_a 0.03% : 0.000041s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000454s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 18.88% : 0.029418s : 2: renormalize.infer 1.74% : 0.002707s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000129s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 47.66% : 0.074261s : 1: type_inference TotalTime = 0.0207208, [30] [bootstrap]: 0.00034951 [type_inference]: 0.0111955 [event_method]: 2.391e-05 [auto_monad]: 7.003e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 6.303e-05 [rewriter_before_opt_a]: 8.58e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00669087, [2] [Cycle 1]: 0.00240888, [27] [switch_simplify]: 6.817e-05 [loop_unroll]: 3.285e-05 [a_1]: 0.00076629 [with_stream_mark]: 2.191e-05 [recompute_prepare]: 8.83001e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 4.07e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.77002e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.96998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 5.71998e-06 [renormalize]: 0.00115945 [add_forward_monad_depend]: 6.09001e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.83e-05 [replace_applicator]: 1.408e-05 [Cycle 2]: 0.00036709, [27] [switch_simplify]: 6.29001e-06 [loop_unroll]: 5.62001e-06 [a_1]: 9.714e-05 [with_stream_mark]: 3.336e-05 [recompute_prepare]: 6.58998e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.01002e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.311e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.18999e-06 [inline_without_move]: 5.04e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 1.15001e-06 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.687e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 1.263e-05 [rewriter_after_opt_a]: 3.898e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00061566 [jit_opt_b]: 5.197e-05, [1] [Cycle 1]: 4.432e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.657e-05 [cconv]: 2.445e-05 [loop_unroll]: 0.00041324 [jit_opt_after_cconv]: 0.00014951, [1] [Cycle 1]: 0.00014351, [11] [c_1]: 2.15e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 6.56999e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.58e-05 [call_graph_tuple_transform]: 1.983e-05 [tuple_list_get_item_eliminator]: 5.27999e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 3.512e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 5.74e-06 [add_recomputation]: 4.881e-05 [cse_after_recomputation]: 2.368e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.179e-05 [auto_monad_reorder]: 1.742e-05 [get_jit_bprop_graph]: 2.20002e-06 [rewriter_after_jit_bprop_graph]: 6.14001e-06 [opt_after_jit_grad]: 0.00046187 [symbol_engine_optimizer]: 9.92e-05, [1] [Cycle 1]: 9.238e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 9.49e-06 [elim_not_effective]: 1.372e-05 [opt_reshape]: 6.69999e-06 [fold_const_symbol]: 1.026e-05 [renormalize]: 5.70028e-07 [validate]: 3.903e-05 Sums bootstrap : 0.000350s : 2.16% type_inference : 0.011196s : 69.12% event_method : 0.000024s : 0.15% auto_monad : 0.000070s : 0.43% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000063s : 0.39% rewriter_before_opt_a : 0.000086s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.46% jit_opt_a.loop_unroll : 0.000038s : 0.24% jit_opt_a.a_1 : 0.000863s : 5.33% jit_opt_a.with_stream_mark : 0.000055s : 0.34% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001160s : 7.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.13% jit_opt_a.cse : 0.000055s : 0.34% jit_opt_a.replace_applicator : 0.000019s : 0.12% py_interpret_to_execute_after_opt_a : 0.000013s : 0.08% rewriter_after_opt_a : 0.000039s : 0.24% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000616s : 3.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000024s : 0.15% loop_unroll : 0.000413s : 2.55% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000035s : 0.22% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000049s : 0.30% cse_after_recomputation.cse : 0.000012s : 0.07% auto_monad_reorder : 0.000017s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000462s : 2.85% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.24% Time group info: ------[substitution.] 0.000320 24 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 3: substitution.graph_param_transform 88.45% : 0.000283s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.28% : 0.000004s : 4: substitution.remove_not_recompute_node 1.29% : 0.000004s : 2: substitution.replace_old_param 4.69% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011109 2 86.61% : 0.009621s : 1: type_inference.infer 13.39% : 0.001488s : 1: type_inference.specialize ------[replace.] 0.000121 7 65.01% : 0.000079s : 5: replace.inline 34.99% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000293 7 95.34% : 0.000280s : 5: match.inline 4.66% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.13% : 0.000002s : 11: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.48% : 0.000002s : 11: predicate.addn_zero_filter 2.51% : 0.000003s : 11: predicate.arithmetic_simplify 1.18% : 0.000002s : 11: predicate.cast_eliminate 0.33% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000002s : 11: predicate.compare_switch_simplify 1.08% : 0.000001s : 11: predicate.depend_value_elim 1.02% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.45% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 5.18% : 0.000007s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.04% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 16: predicate.partial_eliminate 1.67% : 0.000002s : 11: predicate.print_const_string_wrapper 2.02% : 0.000003s : 11: predicate.reduce_eliminate 1.68% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.50% : 0.000002s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.53% : 0.000002s : 11: predicate.reshape_eliminate 1.52% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.88% : 0.000003s : 11: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.71% : 0.000004s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.24% : 0.000011s : 59: predicate.switch_simplify 1.36% : 0.000002s : 11: predicate.tile_eliminate 1.68% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.49% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001161 16 47.82% : 0.000555s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.98% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.19% : 0.000513s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023039 72 0.22% : 0.000051s : 1: add_recomputation 0.32% : 0.000073s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.58% : 0.000364s : 1: bootstrap 0.12% : 0.000027s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.12% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.06% : 0.006695s : 1: jit_opt_a 0.66% : 0.000152s : 1: jit_opt_after_cconv 0.24% : 0.000054s : 1: jit_opt_b 1.82% : 0.000419s : 1: loop_unroll 2.70% : 0.000622s : 1: mutable_eliminate 4.80% : 0.001105s : 26: opt.transform.jit_opt_a 0.21% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000014s : 1: opt.transform.mutable_eliminate 0.09% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.04% : 0.000469s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000065s : 1: py_interpret_to_execute 0.06% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.16% : 0.000038s : 1: remove_dup_value 2.86% : 0.000659s : 1: renormalize.infer 2.13% : 0.000491s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000042s : 1: rewriter_after_opt_a 0.38% : 0.000088s : 1: rewriter_before_opt_a 0.44% : 0.000102s : 1: symbol_engine_optimizer 48.67% : 0.011214s : 1: type_inference TotalTime = 0.0318891, [30] [bootstrap]: 0.00030222 [type_inference]: 0.022329 [event_method]: 2.185e-05 [auto_monad]: 7e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 2.38998e-06 [py_interpret_to_execute]: 0.00013372 [rewriter_before_opt_a]: 8.428e-05 [expand_dump_flag]: 3.17002e-06 [jit_opt_a]: 0.00649041, [2] [Cycle 1]: 0.0022034, [27] [switch_simplify]: 5.928e-05 [loop_unroll]: 3.318e-05 [a_1]: 0.00057837 [with_stream_mark]: 1.746e-05 [recompute_prepare]: 9.93002e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00115984 [add_forward_monad_depend]: 7e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.676e-05 [cse]: 3.156e-05 [replace_applicator]: 1.656e-05 [Cycle 2]: 0.00034825, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.77999e-06 [a_1]: 9.811e-05 [with_stream_mark]: 1.079e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.03002e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 7.16999e-06 [cse]: 1.371e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.37e-05 [rewriter_after_opt_a]: 3.947e-05 [convert_after_rewriter]: 6.98998e-06 [order_py_execute_after_rewriter]: 5.21998e-06 [mutable_eliminate]: 0.00070016 [jit_opt_b]: 5.409e-05, [1] [Cycle 1]: 4.733e-05, [2] [frontend_op_eliminate]: 1.907e-05 [inline_after_opt_a]: 1.707e-05 [cconv]: 2.955e-05 [loop_unroll]: 0.00047533 [jit_opt_after_cconv]: 0.00015992, [1] [Cycle 1]: 0.00015297, [11] [c_1]: 2.26e-05 [parameter_eliminate]: 3.88001e-06 [updatestate_depend_eliminate]: 7.68001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 3.81999e-06 [cse]: 2.78e-05 [call_graph_tuple_transform]: 2.098e-05 [tuple_list_get_item_eliminator]: 6.10002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 7.7e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.594e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.63e-06 [add_recomputation]: 5.458e-05 [cse_after_recomputation]: 2.352e-05, [1] [Cycle 1]: 1.833e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.707e-05 [get_jit_bprop_graph]: 1.36998e-06 [rewriter_after_jit_bprop_graph]: 6.09999e-06 [opt_after_jit_grad]: 0.00050848 [symbol_engine_optimizer]: 7.748e-05, [1] [Cycle 1]: 7.093e-05, [6] [build]: 3.74002e-06 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 1.529e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.72001e-06 [renormalize]: 7.39994e-07 [validate]: 4.629e-05 Sums bootstrap : 0.000302s : 1.11% type_inference : 0.022329s : 81.69% event_method : 0.000022s : 0.08% auto_monad : 0.000070s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000134s : 0.49% rewriter_before_opt_a : 0.000084s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.24% jit_opt_a.loop_unroll : 0.000039s : 0.14% jit_opt_a.a_1 : 0.000676s : 2.47% jit_opt_a.with_stream_mark : 0.000028s : 0.10% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001160s : 4.24% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000045s : 0.17% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000700s : 2.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000030s : 0.11% loop_unroll : 0.000475s : 1.74% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000508s : 1.86% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.17% Time group info: ------[substitution.] 0.000211 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.88% : 0.000002s : 2: substitution.fold_const_symbol 3.06% : 0.000006s : 3: substitution.graph_param_transform 82.34% : 0.000174s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000005s : 2: substitution.replace_old_param 6.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022243 2 90.96% : 0.020231s : 1: type_inference.infer 9.04% : 0.002012s : 1: type_inference.specialize ------[replace.] 0.000080 6 65.66% : 0.000053s : 4: replace.inline 34.34% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.25% : 0.000171s : 4: match.inline 6.75% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.14% : 0.000002s : 10: predicate.accumulaten_eliminater 1.38% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 2.68% : 0.000004s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.58% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 4.96% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000002s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.61% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.65% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.74% : 0.000009s : 53: predicate.switch_simplify 1.67% : 0.000002s : 10: predicate.tile_eliminate 1.82% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.46% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.54% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000964 13 41.90% : 0.000404s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.51% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.58% : 0.000526s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034001 72 0.17% : 0.000058s : 1: add_recomputation 0.22% : 0.000074s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000317s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.10% : 0.006494s : 1: jit_opt_a 0.48% : 0.000163s : 1: jit_opt_after_cconv 0.17% : 0.000056s : 1: jit_opt_b 1.42% : 0.000482s : 1: loop_unroll 2.08% : 0.000708s : 1: mutable_eliminate 2.68% : 0.000912s : 26: opt.transform.jit_opt_a 0.15% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000030s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000516s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000137s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.11% : 0.000717s : 1: renormalize.infer 1.28% : 0.000435s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.26% : 0.000088s : 1: rewriter_before_opt_a 0.24% : 0.000080s : 1: symbol_engine_optimizer 65.73% : 0.022348s : 1: type_inference TotalTime = 0.0154929, [30] [bootstrap]: 0.00035931 [type_inference]: 0.00563668 [event_method]: 1.708e-05 [auto_monad]: 6.339e-05 [graph_reusing]: 4.79e-06 [pre_auto_parallel]: 2.28002e-06 [py_interpret_to_execute]: 4.407e-05 [rewriter_before_opt_a]: 7.194e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.00657036, [2] [Cycle 1]: 0.00206337, [27] [switch_simplify]: 6.102e-05 [loop_unroll]: 3.09e-05 [a_1]: 0.00061564 [with_stream_mark]: 1.76e-05 [recompute_prepare]: 8.74998e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.63999e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 7.31999e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.08002e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.671e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.096e-05 [inline_without_move]: 6.05002e-06 [renormalize]: 0.00097635 [add_forward_monad_depend]: 7.83001e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.789e-05 [cse]: 2.873e-05 [replace_applicator]: 1.618e-05 [Cycle 2]: 0.00035413, [27] [switch_simplify]: 6.69001e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.00010243 [with_stream_mark]: 1.253e-05 [recompute_prepare]: 5.64998e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 3.50998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.425e-05 [j_node_and_user_rematch]: 7.93999e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 7.98999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.53998e-06 [cse]: 1.015e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.568e-05 [rewriter_after_opt_a]: 3.592e-05 [convert_after_rewriter]: 8.08001e-06 [order_py_execute_after_rewriter]: 4.89003e-06 [mutable_eliminate]: 0.00079348 [jit_opt_b]: 5.926e-05, [1] [Cycle 1]: 5.124e-05, [2] [frontend_op_eliminate]: 1.971e-05 [inline_after_opt_a]: 1.795e-05 [cconv]: 2.627e-05 [loop_unroll]: 0.00049426 [jit_opt_after_cconv]: 0.00026722, [1] [Cycle 1]: 0.00025646, [11] [c_1]: 2.412e-05 [parameter_eliminate]: 4.07998e-06 [updatestate_depend_eliminate]: 7.54002e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 2.075e-05 [call_graph_tuple_transform]: 2.233e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 7.45998e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 5.797e-05 [cse_after_recomputation]: 2.825e-05, [1] [Cycle 1]: 2.184e-05, [1] [cse]: 1.383e-05 [auto_monad_reorder]: 1.627e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 7.82002e-06 [opt_after_jit_grad]: 0.0005732 [symbol_engine_optimizer]: 8.411e-05, [1] [Cycle 1]: 7.703e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.611e-05 [opt_reshape]: 6.61999e-06 [fold_const_symbol]: 1.049e-05 [renormalize]: 4.69998e-07 [validate]: 4.394e-05 Sums bootstrap : 0.000359s : 3.38% type_inference : 0.005637s : 53.10% event_method : 0.000017s : 0.16% auto_monad : 0.000063s : 0.60% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000044s : 0.42% rewriter_before_opt_a : 0.000072s : 0.68% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.64% jit_opt_a.loop_unroll : 0.000037s : 0.35% jit_opt_a.a_1 : 0.000718s : 6.76% jit_opt_a.with_stream_mark : 0.000030s : 0.28% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000976s : 9.20% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.23% jit_opt_a.cse : 0.000039s : 0.37% jit_opt_a.replace_applicator : 0.000022s : 0.21% py_interpret_to_execute_after_opt_a : 0.000016s : 0.15% rewriter_after_opt_a : 0.000036s : 0.34% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000793s : 7.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.19% jit_opt_b.inline_after_opt_a : 0.000018s : 0.17% cconv : 0.000026s : 0.25% loop_unroll : 0.000494s : 4.66% jit_opt_after_cconv.c_1 : 0.000024s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.07% remove_dup_value : 0.000018s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000058s : 0.55% cse_after_recomputation.cse : 0.000014s : 0.13% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.07% opt_after_jit_grad : 0.000573s : 5.40% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.41% Time group info: ------[substitution.] 0.000254 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 2.63% : 0.000007s : 3: substitution.graph_param_transform 84.36% : 0.000214s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005565 2 81.39% : 0.004530s : 1: type_inference.infer 18.61% : 0.001036s : 1: type_inference.specialize ------[replace.] 0.000081 6 65.88% : 0.000053s : 4: replace.inline 34.12% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.37% : 0.000212s : 4: match.inline 5.63% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.25% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.89% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 2.16% : 0.000003s : 10: predicate.arithmetic_simplify 1.64% : 0.000002s : 10: predicate.cast_eliminate 0.72% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.45% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.17% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.41% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 4.80% : 0.000006s : 22: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.52% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.42% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.27% : 0.000002s : 10: predicate.minmaximum_grad 2.04% : 0.000003s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 0.92% : 0.000001s : 10: predicate.print_const_string_wrapper 2.00% : 0.000003s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.00% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000003s : 18: predicate.replace_applicator 0.41% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.07% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 10: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.88% : 0.000004s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 53: predicate.switch_simplify 1.21% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.43% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000801 13 51.09% : 0.000409s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.29% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.62% : 0.000358s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017492 72 0.35% : 0.000061s : 1: add_recomputation 0.39% : 0.000067s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.12% : 0.000371s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000031s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.12% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 37.59% : 0.006575s : 1: jit_opt_a 1.55% : 0.000271s : 1: jit_opt_after_cconv 0.36% : 0.000062s : 1: jit_opt_b 2.87% : 0.000502s : 1: loop_unroll 4.59% : 0.000803s : 1: mutable_eliminate 5.44% : 0.000952s : 26: opt.transform.jit_opt_a 0.32% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000030s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000019s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000038s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000581s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000047s : 1: py_interpret_to_execute 0.10% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.95% : 0.000517s : 1: renormalize.infer 2.58% : 0.000451s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000039s : 1: rewriter_after_opt_a 0.43% : 0.000075s : 1: rewriter_before_opt_a 0.50% : 0.000087s : 1: symbol_engine_optimizer 32.29% : 0.005648s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.591.819 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c820> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.592.434 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0404339, [30] [bootstrap]: 0.00050832 [type_inference]: 0.0153048 [event_method]: 6.186e-05 [auto_monad]: 0.00010164 [graph_reusing]: 8.17998e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 2.913e-05 [rewriter_before_opt_a]: 0.00010543 [expand_dump_flag]: 3.60998e-06 [jit_opt_a]: 0.0219189, [3] [Cycle 1]: 0.00717141, [27] [switch_simplify]: 7.377e-05 [loop_unroll]: 4.254e-05 [a_1]: 0.00097152 [with_stream_mark]: 3.62e-05 [recompute_prepare]: 2.208e-05 [updatestate_depend_eliminate]: 8.54998e-06 [updatestate_assign_eliminate]: 6.86999e-06 [updatestate_loads_eliminate]: 6.82002e-06 [parameter_eliminate]: 2.51998e-06 [specialize_transform]: 1.424e-05 [updatestate_useless_node_eliminater]: 1.257e-05 [accelerated_algorithm]: 1.295e-05 [meta_shard_fg_expand]: 4.48999e-06 [get_grad_eliminate_]: 1.26e-05 [merge_forward]: 8.74e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.776e-05 [j_node_and_user_rematch]: 2.403e-05 [meta_fg_expand]: 0.00179662 [replace_old_param]: 6.68e-05 [inline_without_move]: 5.641e-05 [renormalize]: 0.00333123 [add_forward_monad_depend]: 1.102e-05 [auto_monad_grad]: 6.26e-06 [auto_monad_eliminator]: 5.911e-05 [cse]: 0.00021724 [replace_applicator]: 8.079e-05 [Cycle 2]: 0.0108802, [27] [switch_simplify]: 4.145e-05 [loop_unroll]: 3.985e-05 [a_1]: 0.00115788 [with_stream_mark]: 1.851e-05 [recompute_prepare]: 1.082e-05 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 4.15e-06 [updatestate_loads_eliminate]: 4.10998e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 9.05001e-06 [updatestate_useless_node_eliminater]: 8.20999e-06 [accelerated_algorithm]: 8.50001e-06 [meta_shard_fg_expand]: 3.23998e-06 [get_grad_eliminate_]: 8.15e-06 [merge_forward]: 5.91e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.156e-05 [j_node_and_user_rematch]: 1.411e-05 [meta_fg_expand]: 9.95e-05 [replace_old_param]: 1.025e-05 [inline_without_move]: 9.14998e-06 [renormalize]: 0.00910196 [add_forward_monad_depend]: 1.197e-05 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 2.224e-05 [cse]: 3.378e-05 [replace_applicator]: 2.412e-05 [Cycle 3]: 0.00033118, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.67999e-06 [a_1]: 7.449e-05 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 4.91002e-06 [updatestate_depend_eliminate]: 3.82002e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 5.00001e-06 [updatestate_useless_node_eliminater]: 4.50001e-06 [accelerated_algorithm]: 4.65001e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 4.43001e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.801e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 4.27003e-06 [inline_without_move]: 4.35999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 1.01997e-06 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.228e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 1.613e-05 [rewriter_after_opt_a]: 4.012e-05 [convert_after_rewriter]: 6.43998e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00075095 [jit_opt_b]: 4.887e-05, [1] [Cycle 1]: 4.162e-05, [2] [frontend_op_eliminate]: 1.44e-05 [inline_after_opt_a]: 1.577e-05 [cconv]: 2.76e-05 [loop_unroll]: 0.00044046 [jit_opt_after_cconv]: 0.00014632, [1] [Cycle 1]: 0.00013967, [11] [c_1]: 1.774e-05 [parameter_eliminate]: 2.94001e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.292e-05 [call_graph_tuple_transform]: 1.756e-05 [tuple_list_get_item_eliminator]: 5.17999e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 4.92999e-06 [remove_dup_value]: 1.82e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 1.824e-05 [add_recomputation]: 4.679e-05 [cse_after_recomputation]: 2.389e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.24e-05 [auto_monad_reorder]: 1.591e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.58002e-06 [opt_after_jit_grad]: 0.00046307 [symbol_engine_optimizer]: 7.537e-05, [1] [Cycle 1]: 6.906e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 4.39992e-07 [validate]: 3.914e-05 Sums bootstrap : 0.000508s : 1.41% type_inference : 0.015305s : 42.52% event_method : 0.000062s : 0.17% auto_monad : 0.000102s : 0.28% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000029s : 0.08% rewriter_before_opt_a : 0.000105s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000121s : 0.34% jit_opt_a.loop_unroll : 0.000088s : 0.24% jit_opt_a.a_1 : 0.002204s : 6.12% jit_opt_a.with_stream_mark : 0.000068s : 0.19% jit_opt_a.recompute_prepare : 0.000038s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.07% jit_opt_a.accelerated_algorithm : 0.000026s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.07% jit_opt_a.merge_forward : 0.000018s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.13% jit_opt_a.meta_fg_expand : 0.001899s : 5.27% jit_opt_a.replace_old_param : 0.000081s : 0.23% jit_opt_a.inline_without_move : 0.000070s : 0.19% jit_opt_a.renormalize : 0.012433s : 34.54% jit_opt_a.add_forward_monad_depend : 0.000024s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000087s : 0.24% jit_opt_a.cse : 0.000263s : 0.73% jit_opt_a.replace_applicator : 0.000110s : 0.31% py_interpret_to_execute_after_opt_a : 0.000016s : 0.04% rewriter_after_opt_a : 0.000040s : 0.11% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000751s : 2.09% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000028s : 0.08% loop_unroll : 0.000440s : 1.22% jit_opt_after_cconv.c_1 : 0.000018s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000018s : 0.05% add_recomputation : 0.000047s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000463s : 1.29% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.11% Time group info: ------[substitution.] 0.000558 110 0.39% : 0.000002s : 2: substitution.elim_not_effective 0.29% : 0.000002s : 2: substitution.fold_const_symbol 0.89% : 0.000005s : 2: substitution.graph_param_transform 64.30% : 0.000359s : 13: substitution.inline 3.27% : 0.000018s : 2: substitution.inline_without_move 1.92% : 0.000011s : 14: substitution.j_node_and_user_rematch 1.93% : 0.000011s : 7: substitution.minmaximum_grad 1.24% : 0.000007s : 5: substitution.partial_eliminate 2.31% : 0.000013s : 14: substitution.remove_not_recompute_node 5.25% : 0.000029s : 10: substitution.replace_applicator 1.05% : 0.000006s : 8: substitution.replace_old_param 1.21% : 0.000007s : 1: substitution.reshape_eliminate 0.46% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.02% : 0.000006s : 1: substitution.tile_eliminate 3.92% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.76% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.79% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015218 2 91.79% : 0.013970s : 1: type_inference.infer 8.21% : 0.001249s : 1: type_inference.specialize ------[replace.] 0.000169 20 66.57% : 0.000113s : 13: replace.inline 33.43% : 0.000057s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000373 20 94.14% : 0.000351s : 13: match.inline 5.86% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000382 2621 1.49% : 0.000006s : 45: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.47% : 0.000006s : 45: predicate.addn_check_dump 1.64% : 0.000006s : 45: predicate.addn_zero_filter 2.12% : 0.000008s : 45: predicate.arithmetic_simplify 1.61% : 0.000006s : 45: predicate.cast_eliminate 0.12% : 0.000000s : 2: predicate.check_bprop_eliminate 1.44% : 0.000006s : 45: predicate.compare_switch_simplify 1.51% : 0.000006s : 45: predicate.depend_value_elim 1.43% : 0.000005s : 45: predicate.dict_get_item_const_eliminator 1.59% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.22% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.42% : 0.000005s : 45: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 45: predicate.environ_get_depend_swap 1.51% : 0.000006s : 45: predicate.environ_get_eliminate 1.48% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.87% : 0.000003s : 19: predicate.get_grad_eliminate 0.10% : 0.000000s : 2: predicate.graph_param_transform 4.32% : 0.000017s : 69: predicate.inline 1.94% : 0.000007s : 43: predicate.inline_without_move 0.37% : 0.000001s : 19: predicate.j_node_and_user_rematch 0.94% : 0.000004s : 19: predicate.less_batch_normalization 1.79% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.86% : 0.000007s : 54: predicate.load_eliminater 0.50% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.33% : 0.000013s : 90: predicate.loop_unroll_before_grad 1.79% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 45: predicate.merge_addn 1.50% : 0.000006s : 45: predicate.minmaximum_grad 0.61% : 0.000002s : 2: predicate.mutable_eliminate 0.10% : 0.000000s : 2: predicate.opt_reshape 2.35% : 0.000009s : 54: predicate.partial_eliminate 1.49% : 0.000006s : 45: predicate.print_const_string_wrapper 2.16% : 0.000008s : 45: predicate.reduce_eliminate 1.83% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000002s : 19: predicate.remove_not_recompute_node 2.66% : 0.000010s : 97: predicate.replace_applicator 1.05% : 0.000004s : 43: predicate.replace_old_param 0.09% : 0.000000s : 2: predicate.reset_defer_inline 1.62% : 0.000006s : 45: predicate.reshape_eliminate 1.51% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 2: predicate.row_tensor_eliminate 1.55% : 0.000006s : 45: predicate.same_eliminate 0.47% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 4: predicate.special_op_eliminate 0.84% : 0.000003s : 19: predicate.specialize_transform 1.75% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.84% : 0.000011s : 65: predicate.switch_defer_inline 2.55% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.44% : 0.000025s : 157: predicate.switch_simplify 1.54% : 0.000006s : 45: predicate.tile_eliminate 1.47% : 0.000006s : 45: predicate.transpose_eliminate 1.95% : 0.000007s : 45: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000013s : 56: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 45: predicate.tuple_list_set_item_eliminator 1.83% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.80% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.94% : 0.000007s : 45: predicate.value_based_eliminate 0.10% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001945 32 58.83% : 0.001144s : 15: func_graph_cloner_run.FuncGraphClonerGraph 41.17% : 0.000801s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055775 87 0.09% : 0.000050s : 1: add_recomputation 0.19% : 0.000106s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.96% : 0.000538s : 1: bootstrap 0.05% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000021s : 1: environ_conv 0.12% : 0.000068s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 39.31% : 0.021923s : 1: jit_opt_a 0.27% : 0.000149s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.80% : 0.000449s : 1: loop_unroll 1.37% : 0.000762s : 1: mutable_eliminate 5.16% : 0.002878s : 39: opt.transform.jit_opt_a 0.08% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.85% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 18.83% : 0.010503s : 2: renormalize.infer 3.42% : 0.001909s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.19% : 0.000109s : 1: rewriter_before_opt_a 0.14% : 0.000078s : 1: symbol_engine_optimizer 27.47% : 0.015323s : 1: type_inference TotalTime = 0.0173201, [30] [bootstrap]: 0.00033722 [type_inference]: 0.00664004 [event_method]: 2.235e-05 [auto_monad]: 7.56e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 8.111e-05 [rewriter_before_opt_a]: 8.903e-05 [expand_dump_flag]: 2.61999e-06 [jit_opt_a]: 0.00734174, [2] [Cycle 1]: 0.00247165, [27] [switch_simplify]: 7.085e-05 [loop_unroll]: 3.528e-05 [a_1]: 0.00067502 [with_stream_mark]: 2.153e-05 [recompute_prepare]: 1.072e-05 [updatestate_depend_eliminate]: 4.62998e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 4.15e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.705e-05 [j_node_and_user_rematch]: 9.61998e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 5.70001e-06 [renormalize]: 0.001292 [add_forward_monad_depend]: 7.35e-06 [auto_monad_grad]: 1.85001e-06 [auto_monad_eliminator]: 1.423e-05 [cse]: 2.285e-05 [replace_applicator]: 1.881e-05 [Cycle 2]: 0.00036502, [27] [switch_simplify]: 6.95998e-06 [loop_unroll]: 6.38003e-06 [a_1]: 0.00010728 [with_stream_mark]: 1.397e-05 [recompute_prepare]: 6.21998e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.48998e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 4.28001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.483e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 3.26001e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.14e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.29999e-06 [cse]: 1.251e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 1.717e-05 [rewriter_after_opt_a]: 4.315e-05 [convert_after_rewriter]: 8.11002e-06 [order_py_execute_after_rewriter]: 5.41998e-06 [mutable_eliminate]: 0.00082837 [jit_opt_b]: 5.809e-05, [1] [Cycle 1]: 5.023e-05, [2] [frontend_op_eliminate]: 2.052e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 2.687e-05 [loop_unroll]: 0.00047496 [jit_opt_after_cconv]: 0.00016848, [1] [Cycle 1]: 0.0001622, [11] [c_1]: 2.369e-05 [parameter_eliminate]: 4.47003e-06 [updatestate_depend_eliminate]: 9.44e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 2.43998e-06 [cse]: 3.137e-05 [call_graph_tuple_transform]: 2.245e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.06998e-06 [remove_dup_value]: 1.746e-05 [partial_unused_args_eliminate]: 2.68998e-06 [environ_conv]: 6.70002e-06 [add_recomputation]: 5.849e-05 [cse_after_recomputation]: 6.969e-05, [1] [Cycle 1]: 2.299e-05, [1] [cse]: 1.428e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 7.73999e-06 [opt_after_jit_grad]: 0.00058836 [symbol_engine_optimizer]: 8.373e-05, [1] [Cycle 1]: 7.635e-05, [6] [build]: 4.80001e-06 [elim_shapecalc]: 9.47001e-06 [elim_not_effective]: 1.547e-05 [opt_reshape]: 6.94999e-06 [fold_const_symbol]: 1.062e-05 [renormalize]: 5.09986e-07 [validate]: 4.77e-05 Sums bootstrap : 0.000337s : 2.78% type_inference : 0.006640s : 54.70% event_method : 0.000022s : 0.18% auto_monad : 0.000076s : 0.62% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000081s : 0.67% rewriter_before_opt_a : 0.000089s : 0.73% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000078s : 0.64% jit_opt_a.loop_unroll : 0.000042s : 0.34% jit_opt_a.a_1 : 0.000782s : 6.44% jit_opt_a.with_stream_mark : 0.000035s : 0.29% jit_opt_a.recompute_prepare : 0.000017s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000013s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.06% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.05% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000006s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001292s : 10.64% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000035s : 0.29% jit_opt_a.replace_applicator : 0.000024s : 0.20% py_interpret_to_execute_after_opt_a : 0.000017s : 0.14% rewriter_after_opt_a : 0.000043s : 0.36% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000828s : 6.82% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.17% jit_opt_b.inline_after_opt_a : 0.000018s : 0.15% cconv : 0.000027s : 0.22% loop_unroll : 0.000475s : 3.91% jit_opt_after_cconv.c_1 : 0.000024s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000058s : 0.48% cse_after_recomputation.cse : 0.000014s : 0.12% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.06% opt_after_jit_grad : 0.000588s : 4.85% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.39% Time group info: ------[substitution.] 0.000264 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.54% : 0.000007s : 3: substitution.graph_param_transform 84.49% : 0.000223s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000006s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006530 2 76.83% : 0.005017s : 1: type_inference.infer 23.17% : 0.001513s : 1: type_inference.specialize ------[replace.] 0.000102 6 66.40% : 0.000068s : 4: replace.inline 33.60% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 6 94.24% : 0.000220s : 4: match.inline 5.76% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 2.35% : 0.000003s : 10: predicate.arithmetic_simplify 1.65% : 0.000002s : 10: predicate.cast_eliminate 0.75% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000002s : 10: predicate.compare_switch_simplify 0.93% : 0.000001s : 10: predicate.depend_value_elim 0.91% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.91% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.49% : 0.000002s : 10: predicate.environ_get_depend_swap 1.02% : 0.000002s : 10: predicate.environ_get_eliminate 1.20% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.28% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.88% : 0.000007s : 22: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.65% : 0.000002s : 6: predicate.less_batch_normalization 1.81% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000007s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000002s : 10: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.85% : 0.000003s : 10: predicate.reduce_eliminate 1.73% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000002s : 18: predicate.replace_applicator 0.40% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 0.98% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 0.91% : 0.000001s : 10: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000002s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.70% : 0.000004s : 16: predicate.switch_defer_inline 2.02% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.27% : 0.000011s : 53: predicate.switch_simplify 1.66% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.99% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.26% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 2.81% : 0.000004s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000984 13 45.34% : 0.000446s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.08% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.58% : 0.000498s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019697 72 0.31% : 0.000061s : 1: add_recomputation 0.40% : 0.000079s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.78% : 0.000351s : 1: bootstrap 0.15% : 0.000029s : 1: cconv 0.05% : 0.000011s : 1: convert_after_rewriter 0.37% : 0.000072s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 37.30% : 0.007346s : 1: jit_opt_a 0.87% : 0.000171s : 1: jit_opt_after_cconv 0.31% : 0.000061s : 1: jit_opt_b 2.45% : 0.000483s : 1: loop_unroll 4.25% : 0.000837s : 1: mutable_eliminate 5.26% : 0.001037s : 26: opt.transform.jit_opt_a 0.27% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000030s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000039s : 4: opt.transform.symbol_engine_opt 3.02% : 0.000596s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000084s : 1: py_interpret_to_execute 0.10% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 3.00% : 0.000590s : 1: renormalize.infer 3.51% : 0.000692s : 1: renormalize.specialize 0.05% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000046s : 1: rewriter_after_opt_a 0.47% : 0.000093s : 1: rewriter_before_opt_a 0.44% : 0.000087s : 1: symbol_engine_optimizer 33.78% : 0.006655s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.655.634 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda01a6160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.656.267 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0924561, [30] [bootstrap]: 0.00042789 [type_inference]: 0.0779069 [event_method]: 2.347e-05 [auto_monad]: 8.116e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.0007632 [rewriter_before_opt_a]: 0.00010506 [expand_dump_flag]: 4.40999e-06 [jit_opt_a]: 0.0101874, [2] [Cycle 1]: 0.00554929, [27] [switch_simplify]: 6.977e-05 [loop_unroll]: 3.19e-05 [a_1]: 0.00068361 [with_stream_mark]: 1.811e-05 [recompute_prepare]: 1.026e-05 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 8.38999e-06 [updatestate_useless_node_eliminater]: 6.59001e-06 [accelerated_algorithm]: 7.45e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 7.47998e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 1.157e-05 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 6.71e-06 [renormalize]: 0.00434688 [add_forward_monad_depend]: 1.071e-05 [auto_monad_grad]: 3.53e-06 [auto_monad_eliminator]: 2.046e-05 [cse]: 3.185e-05 [replace_applicator]: 2.536e-05 [Cycle 2]: 0.00042141, [27] [switch_simplify]: 8.33999e-06 [loop_unroll]: 7.02002e-06 [a_1]: 0.00014017 [with_stream_mark]: 1.639e-05 [recompute_prepare]: 6.67002e-06 [updatestate_depend_eliminate]: 3.40003e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.50997e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 4.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.121e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 3.56001e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 5.81e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 7.16999e-06 [cse]: 1.288e-05 [replace_applicator]: 7.27002e-06 [py_interpret_to_execute_after_opt_a]: 1.769e-05 [rewriter_after_opt_a]: 3.975e-05 [convert_after_rewriter]: 8.26002e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00086862 [jit_opt_b]: 6.323e-05, [1] [Cycle 1]: 5.426e-05, [2] [frontend_op_eliminate]: 2.146e-05 [inline_after_opt_a]: 1.993e-05 [cconv]: 3.183e-05 [loop_unroll]: 0.00057592 [jit_opt_after_cconv]: 0.00018576, [1] [Cycle 1]: 0.00017859, [11] [c_1]: 2.955e-05 [parameter_eliminate]: 5.10001e-06 [updatestate_depend_eliminate]: 7.41001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 3.226e-05 [call_graph_tuple_transform]: 2.496e-05 [tuple_list_get_item_eliminator]: 8.69e-06 [none_parameter_eliminate]: 2.62001e-06 [renormalize]: 7.49977e-07 [switch_simplify]: 7.28999e-06 [remove_dup_value]: 1.689e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 1.113e-05 [add_recomputation]: 5.486e-05 [cse_after_recomputation]: 2.724e-05, [1] [Cycle 1]: 2.125e-05, [1] [cse]: 1.388e-05 [auto_monad_reorder]: 1.616e-05 [get_jit_bprop_graph]: 2.59001e-06 [rewriter_after_jit_bprop_graph]: 7.39002e-06 [opt_after_jit_grad]: 0.00055941 [symbol_engine_optimizer]: 0.00018742, [1] [Cycle 1]: 0.00018082, [6] [build]: 4.27e-06 [elim_shapecalc]: 1.078e-05 [elim_not_effective]: 1.58e-05 [opt_reshape]: 6.59001e-06 [fold_const_symbol]: 0.00011157 [renormalize]: 5.99975e-07 [validate]: 5.934e-05 Sums bootstrap : 0.000428s : 0.49% type_inference : 0.077907s : 88.95% event_method : 0.000023s : 0.03% auto_monad : 0.000081s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000763s : 0.87% rewriter_before_opt_a : 0.000105s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.09% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000824s : 0.94% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004347s : 4.96% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.03% jit_opt_a.cse : 0.000045s : 0.05% jit_opt_a.replace_applicator : 0.000033s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000869s : 0.99% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000032s : 0.04% loop_unroll : 0.000576s : 0.66% jit_opt_after_cconv.c_1 : 0.000030s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000055s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000559s : 0.64% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000112s : 0.13% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.07% Time group info: ------[substitution.] 0.000262 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.52% : 0.000007s : 4: substitution.graph_param_transform 83.60% : 0.000219s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000007s : 4: substitution.remove_not_recompute_node 2.19% : 0.000006s : 2: substitution.replace_old_param 5.75% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.077788 2 95.64% : 0.074395s : 1: type_inference.infer 4.36% : 0.003393s : 1: type_inference.specialize ------[replace.] 0.000095 6 66.08% : 0.000063s : 4: replace.inline 33.92% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 93.93% : 0.000216s : 4: match.inline 6.07% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.15% : 0.000002s : 12: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.61% : 0.000002s : 12: predicate.cast_eliminate 0.61% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000001s : 12: predicate.compare_switch_simplify 1.02% : 0.000002s : 12: predicate.depend_value_elim 0.99% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.99% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.72% : 0.000003s : 12: predicate.environ_add_const_eliminate 1.35% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.72% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.37% : 0.000004s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000002s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.16% : 0.000011s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.25% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.49% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.14% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 2.06% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003929 34 71.48% : 0.002808s : 27: func_graph_cloner_run.FuncGraphClonerGraph 0.97% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.55% : 0.001082s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.098067 72 0.06% : 0.000057s : 1: add_recomputation 0.09% : 0.000084s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.45% : 0.000446s : 1: bootstrap 0.04% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000015s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.39% : 0.010192s : 1: jit_opt_a 0.19% : 0.000190s : 1: jit_opt_after_cconv 0.07% : 0.000066s : 1: jit_opt_b 0.60% : 0.000584s : 1: loop_unroll 0.90% : 0.000879s : 1: mutable_eliminate 1.12% : 0.001102s : 26: opt.transform.jit_opt_a 0.07% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000139s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000567s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.79% : 0.000774s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 3.18% : 0.003114s : 1: renormalize.infer 1.24% : 0.001220s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.11% : 0.000110s : 1: rewriter_before_opt_a 0.19% : 0.000190s : 1: symbol_engine_optimizer 79.46% : 0.077924s : 1: type_inference TotalTime = 0.0417584, [30] [bootstrap]: 0.00020765 [type_inference]: 0.01539 [event_method]: 6.112e-05 [auto_monad]: 0.00010539 [graph_reusing]: 7.11001e-06 [pre_auto_parallel]: 3.49001e-06 [py_interpret_to_execute]: 3.526e-05 [rewriter_before_opt_a]: 0.00012559 [expand_dump_flag]: 3.57997e-06 [jit_opt_a]: 0.0231175, [3] [Cycle 1]: 0.0136005, [27] [switch_simplify]: 7.208e-05 [loop_unroll]: 4.432e-05 [a_1]: 0.00092628 [with_stream_mark]: 3.067e-05 [recompute_prepare]: 1.952e-05 [updatestate_depend_eliminate]: 1.075e-05 [updatestate_assign_eliminate]: 7.41999e-06 [updatestate_loads_eliminate]: 7e-06 [parameter_eliminate]: 2.73e-06 [specialize_transform]: 1.386e-05 [updatestate_useless_node_eliminater]: 1.301e-05 [accelerated_algorithm]: 1.283e-05 [meta_shard_fg_expand]: 3.67002e-06 [get_grad_eliminate_]: 1.263e-05 [merge_forward]: 9.76998e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.84e-05 [j_node_and_user_rematch]: 2.412e-05 [meta_fg_expand]: 0.00177112 [replace_old_param]: 6.71e-05 [inline_without_move]: 6.086e-05 [renormalize]: 0.00973757 [add_forward_monad_depend]: 1.615e-05 [auto_monad_grad]: 6.39001e-06 [auto_monad_eliminator]: 6.389e-05 [cse]: 0.00026973 [replace_applicator]: 9.595e-05 [Cycle 2]: 0.00569335, [27] [switch_simplify]: 4.364e-05 [loop_unroll]: 4.216e-05 [a_1]: 0.00119843 [with_stream_mark]: 2.734e-05 [recompute_prepare]: 1.254e-05 [updatestate_depend_eliminate]: 5.55001e-06 [updatestate_assign_eliminate]: 4.66002e-06 [updatestate_loads_eliminate]: 3.71999e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 8.54002e-06 [updatestate_useless_node_eliminater]: 6.61e-06 [accelerated_algorithm]: 7.97998e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.86002e-06 [cell_reuse_recompute_pass]: 1.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.841e-05 [j_node_and_user_rematch]: 1.203e-05 [meta_fg_expand]: 0.00012611 [replace_old_param]: 1.068e-05 [inline_without_move]: 6.91001e-06 [renormalize]: 0.00381458 [add_forward_monad_depend]: 9.97001e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 2.131e-05 [cse]: 3.724e-05 [replace_applicator]: 2.439e-05 [Cycle 3]: 0.0003615, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.99e-06 [a_1]: 8.596e-05 [with_stream_mark]: 1.654e-05 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.10999e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.934e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 4.70999e-06 [inline_without_move]: 4.37998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 6.53998e-06 [cse]: 1.271e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.616e-05 [rewriter_after_opt_a]: 4.063e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.00082881 [jit_opt_b]: 5.356e-05, [1] [Cycle 1]: 4.524e-05, [2] [frontend_op_eliminate]: 1.498e-05 [inline_after_opt_a]: 1.693e-05 [cconv]: 3.052e-05 [loop_unroll]: 0.00047846 [jit_opt_after_cconv]: 0.00017122, [1] [Cycle 1]: 0.00016432, [11] [c_1]: 1.797e-05 [parameter_eliminate]: 4.05998e-06 [updatestate_depend_eliminate]: 7.92e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.659e-05 [call_graph_tuple_transform]: 2.113e-05 [tuple_list_get_item_eliminator]: 4.80999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 9.79984e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 2.024e-05 [partial_unused_args_eliminate]: 3.46999e-06 [environ_conv]: 7.78999e-06 [add_recomputation]: 5.619e-05 [cse_after_recomputation]: 2.843e-05, [1] [Cycle 1]: 2.2e-05, [1] [cse]: 1.358e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 7.33999e-06 [opt_after_jit_grad]: 0.00056654 [symbol_engine_optimizer]: 8.272e-05, [1] [Cycle 1]: 7.489e-05, [6] [build]: 4.57e-06 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 5.53997e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 6.50005e-07 [validate]: 5.174e-05 Sums bootstrap : 0.000208s : 0.56% type_inference : 0.015390s : 41.26% event_method : 0.000061s : 0.16% auto_monad : 0.000105s : 0.28% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000035s : 0.09% rewriter_before_opt_a : 0.000126s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000122s : 0.33% jit_opt_a.loop_unroll : 0.000092s : 0.25% jit_opt_a.a_1 : 0.002211s : 5.93% jit_opt_a.with_stream_mark : 0.000075s : 0.20% jit_opt_a.recompute_prepare : 0.000037s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000028s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.07% jit_opt_a.accelerated_algorithm : 0.000027s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.07% jit_opt_a.merge_forward : 0.000019s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.12% jit_opt_a.meta_fg_expand : 0.001900s : 5.09% jit_opt_a.replace_old_param : 0.000082s : 0.22% jit_opt_a.inline_without_move : 0.000072s : 0.19% jit_opt_a.renormalize : 0.013552s : 36.33% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000092s : 0.25% jit_opt_a.cse : 0.000320s : 0.86% jit_opt_a.replace_applicator : 0.000126s : 0.34% py_interpret_to_execute_after_opt_a : 0.000016s : 0.04% rewriter_after_opt_a : 0.000041s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000829s : 2.22% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000031s : 0.08% loop_unroll : 0.000478s : 1.28% jit_opt_after_cconv.c_1 : 0.000018s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000056s : 0.15% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000567s : 1.52% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.14% Time group info: ------[substitution.] 0.000600 109 0.31% : 0.000002s : 2: substitution.elim_not_effective 0.26% : 0.000002s : 2: substitution.fold_const_symbol 1.05% : 0.000006s : 2: substitution.graph_param_transform 64.74% : 0.000388s : 13: substitution.inline 3.18% : 0.000019s : 2: substitution.inline_without_move 1.92% : 0.000012s : 13: substitution.j_node_and_user_rematch 2.15% : 0.000013s : 7: substitution.minmaximum_grad 1.27% : 0.000008s : 5: substitution.partial_eliminate 1.98% : 0.000012s : 13: substitution.remove_not_recompute_node 5.53% : 0.000033s : 10: substitution.replace_applicator 1.14% : 0.000007s : 10: substitution.replace_old_param 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000007s : 1: substitution.tile_eliminate 4.01% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.74% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.21% : 0.000049s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015296 2 91.04% : 0.013925s : 1: type_inference.infer 8.96% : 0.001370s : 1: type_inference.specialize ------[replace.] 0.000186 20 65.91% : 0.000122s : 13: replace.inline 34.09% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000406 20 93.57% : 0.000380s : 13: match.inline 6.43% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000395 2517 1.52% : 0.000006s : 43: predicate.accumulaten_eliminater 0.46% : 0.000002s : 2: predicate.ad_related_special_op_eliminate 1.35% : 0.000005s : 43: predicate.addn_check_dump 1.66% : 0.000007s : 43: predicate.addn_zero_filter 2.16% : 0.000009s : 43: predicate.arithmetic_simplify 1.50% : 0.000006s : 43: predicate.cast_eliminate 0.17% : 0.000001s : 2: predicate.check_bprop_eliminate 1.39% : 0.000005s : 43: predicate.compare_switch_simplify 1.41% : 0.000006s : 43: predicate.depend_value_elim 1.37% : 0.000005s : 43: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 43: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 43: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.14% : 0.000001s : 2: predicate.elim_not_effective 0.20% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 43: predicate.environ_add_const_eliminate 1.37% : 0.000005s : 43: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 43: predicate.environ_get_depend_swap 1.45% : 0.000006s : 43: predicate.environ_get_eliminate 1.34% : 0.000005s : 43: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.79% : 0.000003s : 17: predicate.get_grad_eliminate 0.12% : 0.000000s : 2: predicate.graph_param_transform 4.32% : 0.000017s : 67: predicate.inline 1.97% : 0.000008s : 45: predicate.inline_without_move 0.32% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.13% : 0.000004s : 17: predicate.less_batch_normalization 1.88% : 0.000007s : 50: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 52: predicate.load_eliminater 0.55% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.26% : 0.000013s : 88: predicate.loop_unroll_before_grad 1.80% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.32% : 0.000005s : 43: predicate.merge_addn 1.38% : 0.000005s : 43: predicate.minmaximum_grad 0.88% : 0.000003s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.35% : 0.000009s : 52: predicate.partial_eliminate 1.59% : 0.000006s : 43: predicate.print_const_string_wrapper 2.16% : 0.000009s : 43: predicate.reduce_eliminate 1.87% : 0.000007s : 50: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000002s : 17: predicate.remove_not_recompute_node 2.60% : 0.000010s : 93: predicate.replace_applicator 1.14% : 0.000005s : 45: predicate.replace_old_param 0.08% : 0.000000s : 2: predicate.reset_defer_inline 1.51% : 0.000006s : 43: predicate.reshape_eliminate 1.69% : 0.000007s : 43: predicate.row_tensor_add_zeros_like 0.22% : 0.000001s : 2: predicate.row_tensor_eliminate 1.41% : 0.000006s : 43: predicate.same_eliminate 0.53% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.23% : 0.000001s : 4: predicate.special_op_eliminate 0.86% : 0.000003s : 17: predicate.specialize_transform 1.72% : 0.000007s : 43: predicate.split_environ_get_set_with_tuple_value 1.81% : 0.000007s : 43: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.92% : 0.000012s : 63: predicate.switch_defer_inline 2.38% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.22% : 0.000025s : 153: predicate.switch_simplify 1.44% : 0.000006s : 43: predicate.tile_eliminate 1.48% : 0.000006s : 43: predicate.transpose_eliminate 1.98% : 0.000008s : 43: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 43: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000014s : 54: predicate.tuple_list_get_item_eliminator 1.90% : 0.000008s : 43: predicate.tuple_list_set_item_eliminator 1.84% : 0.000007s : 50: predicate.tuple_to_list_eliminator_ 1.76% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.64% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.98% : 0.000008s : 43: predicate.value_based_eliminate 0.11% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002400 36 59.34% : 0.001424s : 19: func_graph_cloner_run.FuncGraphClonerGraph 40.66% : 0.000976s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058251 87 0.10% : 0.000059s : 1: add_recomputation 0.19% : 0.000110s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.39% : 0.000226s : 1: bootstrap 0.06% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.11% : 0.000066s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 39.69% : 0.023122s : 1: jit_opt_a 0.30% : 0.000175s : 1: jit_opt_after_cconv 0.10% : 0.000056s : 1: jit_opt_b 0.84% : 0.000490s : 1: loop_unroll 1.45% : 0.000844s : 1: mutable_eliminate 4.98% : 0.002903s : 39: opt.transform.jit_opt_a 0.08% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.06% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.99% : 0.000577s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000038s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000039s : 1: remove_dup_value 19.29% : 0.011238s : 2: renormalize.infer 3.93% : 0.002289s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000044s : 1: rewriter_after_opt_a 0.22% : 0.000129s : 1: rewriter_before_opt_a 0.15% : 0.000086s : 1: symbol_engine_optimizer 26.46% : 0.015412s : 1: type_inference TotalTime = 0.0480123, [30] [bootstrap]: 0.00039499 [type_inference]: 0.0362273 [event_method]: 2.069e-05 [auto_monad]: 6.99e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.0001399 [rewriter_before_opt_a]: 8.512e-05 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.00807342, [2] [Cycle 1]: 0.00264973, [27] [switch_simplify]: 6.212e-05 [loop_unroll]: 3.085e-05 [a_1]: 0.00059062 [with_stream_mark]: 2.176e-05 [recompute_prepare]: 9.07999e-06 [updatestate_depend_eliminate]: 4.94003e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.69002e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 5.05999e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.635e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00150792 [add_forward_monad_depend]: 1.085e-05 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.449e-05 [cse]: 3.869e-05 [replace_applicator]: 2.775e-05 [Cycle 2]: 0.00041402, [27] [switch_simplify]: 8.40999e-06 [loop_unroll]: 7.08998e-06 [a_1]: 0.00011621 [with_stream_mark]: 1.983e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 4.67998e-06 [updatestate_assign_eliminate]: 4.09002e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.63002e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 6.68998e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.75999e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.126e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 3.16999e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.46e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 8.57e-06 [cse]: 1.849e-05 [replace_applicator]: 6.74001e-06 [py_interpret_to_execute_after_opt_a]: 2.106e-05 [rewriter_after_opt_a]: 4.525e-05 [convert_after_rewriter]: 8.28999e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00086314 [jit_opt_b]: 6.302e-05, [1] [Cycle 1]: 5.408e-05, [2] [frontend_op_eliminate]: 2.098e-05 [inline_after_opt_a]: 1.925e-05 [cconv]: 3.526e-05 [loop_unroll]: 0.00058028 [jit_opt_after_cconv]: 0.00022122, [1] [Cycle 1]: 0.00021347, [11] [c_1]: 2.436e-05 [parameter_eliminate]: 4.669e-05 [updatestate_depend_eliminate]: 7.03998e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 3.783e-05 [call_graph_tuple_transform]: 2.397e-05 [tuple_list_get_item_eliminator]: 6.57002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.52001e-06 [remove_dup_value]: 1.74e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 7.75e-06 [add_recomputation]: 5.466e-05 [cse_after_recomputation]: 2.677e-05, [1] [Cycle 1]: 2.057e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.871e-05 [get_jit_bprop_graph]: 2.87002e-06 [rewriter_after_jit_bprop_graph]: 7.627e-05 [opt_after_jit_grad]: 0.00061695 [symbol_engine_optimizer]: 8.402e-05, [1] [Cycle 1]: 7.572e-05, [6] [build]: 3.57002e-06 [elim_shapecalc]: 9.37001e-06 [elim_not_effective]: 1.597e-05 [opt_reshape]: 7.01001e-06 [fold_const_symbol]: 9.82999e-06 [renormalize]: 6.59988e-07 [validate]: 4.408e-05 Sums bootstrap : 0.000395s : 0.93% type_inference : 0.036227s : 85.60% event_method : 0.000021s : 0.05% auto_monad : 0.000070s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000140s : 0.33% rewriter_before_opt_a : 0.000085s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.17% jit_opt_a.loop_unroll : 0.000038s : 0.09% jit_opt_a.a_1 : 0.000707s : 1.67% jit_opt_a.with_stream_mark : 0.000042s : 0.10% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000010s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001508s : 3.56% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.08% jit_opt_a.cse : 0.000057s : 0.14% jit_opt_a.replace_applicator : 0.000034s : 0.08% py_interpret_to_execute_after_opt_a : 0.000021s : 0.05% rewriter_after_opt_a : 0.000045s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000863s : 2.04% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.05% cconv : 0.000035s : 0.08% loop_unroll : 0.000580s : 1.37% jit_opt_after_cconv.c_1 : 0.000024s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000047s : 0.11% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000055s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000076s : 0.18% opt_after_jit_grad : 0.000617s : 1.46% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.10% Time group info: ------[substitution.] 0.000243 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.99% : 0.000007s : 3: substitution.graph_param_transform 83.82% : 0.000204s : 4: substitution.inline 1.88% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000006s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 4.91% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036144 2 94.46% : 0.034141s : 1: type_inference.infer 5.54% : 0.002003s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.45% : 0.000054s : 4: replace.inline 31.55% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.92% : 0.000201s : 4: match.inline 5.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 691 1.09% : 0.000002s : 10: predicate.accumulaten_eliminater 1.53% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.39% : 0.000002s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000003s : 10: predicate.arithmetic_simplify 1.60% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000002s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.99% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.63% : 0.000002s : 10: predicate.environ_get_depend_swap 1.16% : 0.000002s : 10: predicate.environ_get_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 4.65% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 15: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000003s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000003s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000002s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.33% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.51% : 0.000011s : 53: predicate.switch_simplify 1.18% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.58% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.45% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.44% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001085 13 41.89% : 0.000455s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.47% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.64% : 0.000582s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050548 72 0.11% : 0.000058s : 1: add_recomputation 0.14% : 0.000073s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.81% : 0.000407s : 1: bootstrap 0.08% : 0.000038s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.98% : 0.008078s : 1: jit_opt_a 0.44% : 0.000224s : 1: jit_opt_after_cconv 0.13% : 0.000066s : 1: jit_opt_b 1.17% : 0.000590s : 1: loop_unroll 1.73% : 0.000873s : 1: mutable_eliminate 1.91% : 0.000965s : 26: opt.transform.jit_opt_a 0.11% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.24% : 0.000625s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000144s : 1: py_interpret_to_execute 0.05% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.68% : 0.000851s : 1: renormalize.infer 1.27% : 0.000643s : 1: renormalize.specialize 0.16% : 0.000079s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000048s : 1: rewriter_after_opt_a 0.18% : 0.000089s : 1: rewriter_before_opt_a 0.17% : 0.000087s : 1: symbol_engine_optimizer 71.71% : 0.036247s : 1: type_inference TotalTime = 0.0450725, [30] [bootstrap]: 0.00027996 [type_inference]: 0.0371698 [event_method]: 2.085e-05 [auto_monad]: 6.765e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 9.904e-05 [rewriter_before_opt_a]: 7.978e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00530079, [2] [Cycle 1]: 0.00180113, [27] [switch_simplify]: 5.324e-05 [loop_unroll]: 2.944e-05 [a_1]: 0.00052127 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 7.23e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.07003e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.68001e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.0008474 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.571e-05 [cse]: 3.626e-05 [replace_applicator]: 1.162e-05 [Cycle 2]: 0.00031274, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.15999e-06 [a_1]: 8.86e-05 [with_stream_mark]: 9.12001e-06 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.21998e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.249e-05 [j_node_and_user_rematch]: 7.61999e-06 [meta_fg_expand]: 1.60001e-06 [replace_old_param]: 7.03e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.90025e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.22e-06 [cse]: 1.224e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.05e-05 [rewriter_after_opt_a]: 3.744e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00048827 [jit_opt_b]: 4.714e-05, [1] [Cycle 1]: 4.12e-05, [2] [frontend_op_eliminate]: 1.476e-05 [inline_after_opt_a]: 1.58e-05 [cconv]: 2.64e-05 [loop_unroll]: 0.00041198 [jit_opt_after_cconv]: 0.00013889, [1] [Cycle 1]: 0.0001324, [11] [c_1]: 1.978e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.134e-05 [call_graph_tuple_transform]: 1.799e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.523e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.04999e-06 [add_recomputation]: 5.092e-05 [cse_after_recomputation]: 2.235e-05, [1] [Cycle 1]: 1.758e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 1.821e-05 [get_jit_bprop_graph]: 2.13998e-06 [rewriter_after_jit_bprop_graph]: 4.02e-06 [opt_after_jit_grad]: 0.00046555 [symbol_engine_optimizer]: 7.265e-05, [1] [Cycle 1]: 6.672e-05, [6] [build]: 4.33999e-06 [elim_shapecalc]: 7.6e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 5.78002e-06 [fold_const_symbol]: 9.03002e-06 [renormalize]: 4.39992e-07 [validate]: 3.964e-05 Sums bootstrap : 0.000280s : 0.68% type_inference : 0.037170s : 89.94% event_method : 0.000021s : 0.05% auto_monad : 0.000068s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000099s : 0.24% rewriter_before_opt_a : 0.000080s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.14% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000610s : 1.48% jit_opt_a.with_stream_mark : 0.000028s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000847s : 2.05% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000048s : 0.12% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000037s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000488s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.06% loop_unroll : 0.000412s : 1.00% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.12% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000466s : 1.13% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.10% TotalTime = 0.181194, [30] [bootstrap]: 0.00037363 [type_inference]: 0.164335 [event_method]: 2.911e-05 [auto_monad]: 9.009e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 3.07002e-06 [py_interpret_to_execute]: 0.00100003 [rewriter_before_opt_a]: 0.00012492 [expand_dump_flag]: 4.30999e-06 [jit_opt_a]: 0.0121875, [2] [Cycle 1]: 0.00717913, [27] [switch_simplify]: 9.03e-05 [loop_unroll]: 3.653e-05 [a_1]: 0.00089707 [with_stream_mark]: 2.564e-05 [recompute_prepare]: 1.32e-05 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 1.015e-05 [updatestate_useless_node_eliminater]: 7.86001e-06 [accelerated_algorithm]: 9.34e-06 [meta_shard_fg_expand]: 3.64002e-06 [get_grad_eliminate_]: 9.19e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.122e-05 [j_node_and_user_rematch]: 1.347e-05 [meta_fg_expand]: 3.4e-06 [replace_old_param]: 1.17e-05 [inline_without_move]: 6.71999e-06 [renormalize]: 0.00566809 [add_forward_monad_depend]: 9.73998e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.999e-05 [cse]: 4.018e-05 [replace_applicator]: 2.642e-05 [Cycle 2]: 0.0004467, [27] [switch_simplify]: 8.95999e-06 [loop_unroll]: 7.7e-06 [a_1]: 0.00015008 [with_stream_mark]: 1.55e-05 [recompute_prepare]: 7.20998e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 7.05998e-06 [accelerated_algorithm]: 7.78999e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.48998e-06 [merge_forward]: 5.10001e-06 [cell_reuse_recompute_pass]: 4.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.02e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.32001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 8.18999e-06 [cse]: 1.788e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 1.863e-05 [rewriter_after_opt_a]: 4.286e-05 [convert_after_rewriter]: 8.24002e-06 [order_py_execute_after_rewriter]: 5.72001e-06 [mutable_eliminate]: 0.00088398 [jit_opt_b]: 6.688e-05, [1] [Cycle 1]: 5.836e-05, [2] [frontend_op_eliminate]: 2.423e-05 [inline_after_opt_a]: 2.057e-05 [cconv]: 3.059e-05 [loop_unroll]: 0.00052587 [jit_opt_after_cconv]: 0.00018968, [1] [Cycle 1]: 0.00018188, [11] [c_1]: 3.058e-05 [parameter_eliminate]: 3.44001e-06 [updatestate_depend_eliminate]: 7.66001e-06 [updatestate_assign_eliminate]: 2.95998e-06 [updatestate_loads_eliminate]: 4.59998e-06 [cse]: 3.542e-05 [call_graph_tuple_transform]: 2.694e-05 [tuple_list_get_item_eliminator]: 9.19e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 7.6e-06 [remove_dup_value]: 2.173e-05 [partial_unused_args_eliminate]: 2.33002e-06 [environ_conv]: 1.042e-05 [add_recomputation]: 5.172e-05 [cse_after_recomputation]: 2.979e-05, [1] [Cycle 1]: 2.433e-05, [1] [cse]: 1.758e-05 [auto_monad_reorder]: 1.82e-05 [get_jit_bprop_graph]: 2.79001e-06 [rewriter_after_jit_bprop_graph]: 7.78001e-06 [opt_after_jit_grad]: 0.00056598 [symbol_engine_optimizer]: 9.238e-05, [1] [Cycle 1]: 8.513e-05, [6] [build]: 5.99999e-06 [elim_shapecalc]: 1.178e-05 [elim_not_effective]: 1.675e-05 [opt_reshape]: 7.66999e-06 [fold_const_symbol]: 1.197e-05 [renormalize]: 7.2e-07 [validate]: 0.00024193 Sums bootstrap : 0.000374s : 0.21% type_inference : 0.164335s : 93.41% event_method : 0.000029s : 0.02% auto_monad : 0.000090s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001000s : 0.57% rewriter_before_opt_a : 0.000125s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000099s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.001047s : 0.60% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005668s : 3.22% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000058s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000884s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000526s : 0.30% jit_opt_after_cconv.c_1 : 0.000031s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000566s : 0.32% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000242s : 0.14% Time group info: ------[substitution.] 0.000369 25 0.54% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000007s : 4: substitution.graph_param_transform 87.86% : 0.000324s : 5: substitution.inline 1.37% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000006s : 4: substitution.remove_not_recompute_node 1.66% : 0.000006s : 2: substitution.replace_old_param 4.71% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.164212 2 96.88% : 0.159086s : 1: type_inference.infer 3.12% : 0.005125s : 1: type_inference.specialize ------[replace.] 0.000151 7 65.79% : 0.000100s : 5: replace.inline 34.21% : 0.000052s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000337 7 95.36% : 0.000321s : 5: match.inline 4.64% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 2.48% : 0.000004s : 13: predicate.arithmetic_simplify 1.70% : 0.000003s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 0.91% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.41% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000009s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000003s : 19: predicate.load_eliminater 1.64% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.40% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 0.94% : 0.000002s : 13: predicate.minmaximum_grad 1.67% : 0.000003s : 4: predicate.mutable_eliminate 0.38% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.19% : 0.000004s : 13: predicate.reduce_eliminate 1.64% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 8: predicate.remove_not_recompute_node 1.71% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.48% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.64% : 0.000004s : 20: predicate.switch_defer_inline 1.79% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.82% : 0.000011s : 64: predicate.switch_simplify 1.00% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.22% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 2.09% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003592 25 55.73% : 0.002002s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.78% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.49% : 0.001490s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.188118 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000094s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000392s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.48% : 0.012192s : 1: jit_opt_a 0.10% : 0.000194s : 1: jit_opt_after_cconv 0.04% : 0.000070s : 1: jit_opt_b 0.28% : 0.000533s : 1: loop_unroll 0.48% : 0.000894s : 1: mutable_eliminate 0.73% : 0.001370s : 26: opt.transform.jit_opt_a 0.04% : 0.000070s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000574s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.54% : 0.001014s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 2.15% : 0.004036s : 1: renormalize.infer 0.86% : 0.001616s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.07% : 0.000130s : 1: rewriter_before_opt_a 0.05% : 0.000095s : 1: symbol_engine_optimizer 87.37% : 0.164359s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.804.301 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:39.804.988 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0332483, [30] [bootstrap]: 0.00041083 [type_inference]: 0.023509 [event_method]: 2.074e-05 [auto_monad]: 6.784e-05 [graph_reusing]: 6.80998e-06 [pre_auto_parallel]: 1.433e-05 [py_interpret_to_execute]: 0.00012985 [rewriter_before_opt_a]: 8.161e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00649663, [2] [Cycle 1]: 0.00209799, [27] [switch_simplify]: 6.09e-05 [loop_unroll]: 3.127e-05 [a_1]: 0.00058808 [with_stream_mark]: 2.184e-05 [recompute_prepare]: 9.41e-06 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 7.48e-06 [merge_forward]: 5.77001e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.787e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 6.01e-06 [renormalize]: 0.00101996 [add_forward_monad_depend]: 6.60002e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.316e-05 [replace_applicator]: 1.827e-05 [Cycle 2]: 0.00035179, [27] [switch_simplify]: 6.30002e-06 [loop_unroll]: 5.67001e-06 [a_1]: 9.854e-05 [with_stream_mark]: 1.118e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.78997e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 8.81997e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 7.97998e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.328e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.27e-05 [rewriter_after_opt_a]: 3.979e-05 [convert_after_rewriter]: 8.34002e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00070696 [jit_opt_b]: 5.272e-05, [1] [Cycle 1]: 4.537e-05, [2] [frontend_op_eliminate]: 1.786e-05 [inline_after_opt_a]: 1.657e-05 [cconv]: 2.397e-05 [loop_unroll]: 0.00050722 [jit_opt_after_cconv]: 0.00016089, [1] [Cycle 1]: 0.00015371, [11] [c_1]: 2.307e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 6.83e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.91e-06 [cse]: 2.775e-05 [call_graph_tuple_transform]: 2.213e-05 [tuple_list_get_item_eliminator]: 6.41998e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.522e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 5.86003e-06 [add_recomputation]: 4.99e-05 [cse_after_recomputation]: 2.749e-05, [1] [Cycle 1]: 2.075e-05, [1] [cse]: 1.374e-05 [auto_monad_reorder]: 1.876e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.46998e-06 [opt_after_jit_grad]: 0.00053448 [symbol_engine_optimizer]: 8.038e-05, [1] [Cycle 1]: 7.318e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 8.65999e-06 [elim_not_effective]: 1.582e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 9.72999e-06 [renormalize]: 3.89991e-07 [validate]: 4.083e-05 Sums bootstrap : 0.000411s : 1.44% type_inference : 0.023509s : 82.31% event_method : 0.000021s : 0.07% auto_monad : 0.000068s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000014s : 0.05% py_interpret_to_execute : 0.000130s : 0.45% rewriter_before_opt_a : 0.000082s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000687s : 2.40% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001020s : 3.57% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000046s : 0.16% jit_opt_a.replace_applicator : 0.000024s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000707s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000024s : 0.08% loop_unroll : 0.000507s : 1.78% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.17% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000534s : 1.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.14% Time group info: ------[substitution.] 0.000228 23 1.11% : 0.000003s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 3.11% : 0.000007s : 3: substitution.graph_param_transform 82.94% : 0.000189s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 6.35% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023427 2 93.21% : 0.021837s : 1: type_inference.infer 6.79% : 0.001590s : 1: type_inference.specialize ------[replace.] 0.000075 6 65.08% : 0.000049s : 4: replace.inline 34.92% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 93.33% : 0.000186s : 4: match.inline 6.67% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.08% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.34% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.85% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000002s : 10: predicate.compare_switch_simplify 1.01% : 0.000001s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.44% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.70% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.16% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.36% : 0.000000s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 2.00% : 0.000003s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.91% : 0.000003s : 10: predicate.reshape_eliminate 1.01% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.01% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.50% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000910 13 48.19% : 0.000438s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.95% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.86% : 0.000426s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035260 72 0.21% : 0.000075s : 1: add_recomputation 0.20% : 0.000071s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.21% : 0.000426s : 1: bootstrap 0.07% : 0.000026s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.08% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.43% : 0.006500s : 1: jit_opt_a 0.46% : 0.000163s : 1: jit_opt_after_cconv 0.16% : 0.000056s : 1: jit_opt_b 1.46% : 0.000515s : 1: loop_unroll 2.03% : 0.000716s : 1: mutable_eliminate 2.63% : 0.000928s : 26: opt.transform.jit_opt_a 0.15% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.54% : 0.000543s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.05% : 0.000017s : 1: pre_auto_parallel 0.38% : 0.000134s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.73% : 0.000609s : 1: renormalize.infer 1.14% : 0.000400s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.24% : 0.000085s : 1: rewriter_before_opt_a 0.24% : 0.000083s : 1: symbol_engine_optimizer 66.72% : 0.023525s : 1: type_inference TotalTime = 0.0944692, [30] [bootstrap]: 0.00035286 [type_inference]: 0.0780373 [event_method]: 2.347e-05 [auto_monad]: 7.686e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 3.49001e-06 [py_interpret_to_execute]: 0.00243301 [rewriter_before_opt_a]: 0.00011676 [expand_dump_flag]: 5.74999e-06 [jit_opt_a]: 0.0103095, [2] [Cycle 1]: 0.00554984, [27] [switch_simplify]: 7.175e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.0007567 [with_stream_mark]: 2.903e-05 [recompute_prepare]: 1.41e-05 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 3.72998e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 9.04e-06 [updatestate_useless_node_eliminater]: 7.01001e-06 [accelerated_algorithm]: 7.16001e-06 [meta_shard_fg_expand]: 3.58e-06 [get_grad_eliminate_]: 7.53e-06 [merge_forward]: 4.64998e-06 [cell_reuse_recompute_pass]: 2.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.342e-05 [j_node_and_user_rematch]: 1.473e-05 [meta_fg_expand]: 4.52e-06 [replace_old_param]: 1.264e-05 [inline_without_move]: 7.93999e-06 [renormalize]: 0.00419274 [add_forward_monad_depend]: 1.151e-05 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 2.278e-05 [cse]: 3.34e-05 [replace_applicator]: 2.614e-05 [Cycle 2]: 0.0004714, [27] [switch_simplify]: 7.98001e-06 [loop_unroll]: 6.91001e-06 [a_1]: 0.00014916 [with_stream_mark]: 1.85e-05 [recompute_prepare]: 7.94002e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 6.86001e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 3.16999e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 4.32998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.382e-05 [j_node_and_user_rematch]: 1.094e-05 [meta_fg_expand]: 3.60003e-06 [replace_old_param]: 1.231e-05 [inline_without_move]: 7.06001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.49999e-06 [auto_monad_grad]: 1.60001e-06 [auto_monad_eliminator]: 9.24e-06 [cse]: 1.763e-05 [replace_applicator]: 9.96e-06 [py_interpret_to_execute_after_opt_a]: 1.631e-05 [rewriter_after_opt_a]: 4.068e-05 [convert_after_rewriter]: 7.79002e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00089149 [jit_opt_b]: 7.189e-05, [1] [Cycle 1]: 6.132e-05, [2] [frontend_op_eliminate]: 2.498e-05 [inline_after_opt_a]: 2.143e-05 [cconv]: 2.75e-05 [loop_unroll]: 0.00061157 [jit_opt_after_cconv]: 0.00018928, [1] [Cycle 1]: 0.00017918, [11] [c_1]: 2.965e-05 [parameter_eliminate]: 4.60001e-06 [updatestate_depend_eliminate]: 1.049e-05 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 3.073e-05 [call_graph_tuple_transform]: 2.792e-05 [tuple_list_get_item_eliminator]: 7.11001e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.88e-06 [remove_dup_value]: 1.536e-05 [partial_unused_args_eliminate]: 2.30002e-06 [environ_conv]: 1.04e-05 [add_recomputation]: 5.6e-05 [cse_after_recomputation]: 2.597e-05, [1] [Cycle 1]: 1.903e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.935e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.97999e-06 [opt_after_jit_grad]: 0.00062705 [symbol_engine_optimizer]: 0.00018805, [1] [Cycle 1]: 0.00018016, [6] [build]: 4.04002e-06 [elim_shapecalc]: 1.037e-05 [elim_not_effective]: 1.678e-05 [opt_reshape]: 9.878e-05 [fold_const_symbol]: 1.64e-05 [renormalize]: 4.80009e-07 [validate]: 5.171e-05 Sums bootstrap : 0.000353s : 0.39% type_inference : 0.078037s : 87.25% event_method : 0.000023s : 0.03% auto_monad : 0.000077s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.002433s : 2.72% rewriter_before_opt_a : 0.000117s : 0.13% expand_dump_flag : 0.000006s : 0.01% jit_opt_a.switch_simplify : 0.000080s : 0.09% jit_opt_a.loop_unroll : 0.000038s : 0.04% jit_opt_a.a_1 : 0.000906s : 1.01% jit_opt_a.with_stream_mark : 0.000048s : 0.05% jit_opt_a.recompute_prepare : 0.000022s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.02% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.03% jit_opt_a.meta_fg_expand : 0.000008s : 0.01% jit_opt_a.replace_old_param : 0.000025s : 0.03% jit_opt_a.inline_without_move : 0.000015s : 0.02% jit_opt_a.renormalize : 0.004193s : 4.69% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.04% jit_opt_a.cse : 0.000051s : 0.06% jit_opt_a.replace_applicator : 0.000036s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000891s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000612s : 0.68% jit_opt_after_cconv.c_1 : 0.000030s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000627s : 0.70% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000099s : 0.11% symbol_engine_optimizer.fold_const_symbol : 0.000016s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.06% Time group info: ------[substitution.] 0.000314 24 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000003s : 2: substitution.fold_const_symbol 2.46% : 0.000008s : 4: substitution.graph_param_transform 85.05% : 0.000267s : 4: substitution.inline 1.58% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000007s : 4: substitution.remove_not_recompute_node 2.21% : 0.000007s : 2: substitution.replace_old_param 5.01% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.077919 2 95.73% : 0.074590s : 1: type_inference.infer 4.27% : 0.003329s : 1: type_inference.specialize ------[replace.] 0.000104 6 64.29% : 0.000067s : 4: replace.inline 35.71% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 6 94.81% : 0.000264s : 4: match.inline 5.19% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 830 1.53% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 0.91% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 0.89% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.68% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.60% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.73% : 0.000003s : 12: predicate.environ_add_const_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.46% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 4.72% : 0.000008s : 26: predicate.inline 1.24% : 0.000002s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.58% : 0.000003s : 18: predicate.load_eliminater 1.79% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.45% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.98% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.65% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 1.99% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000003s : 12: predicate.reduce_eliminate 1.63% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.58% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.07% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.39% : 0.000002s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000004s : 18: predicate.switch_defer_inline 1.82% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.73% : 0.000011s : 58: predicate.switch_simplify 1.58% : 0.000003s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.26% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.66% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.47% : 0.000006s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003342 26 65.10% : 0.002176s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.89% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.01% : 0.001103s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.100057 72 0.06% : 0.000059s : 1: add_recomputation 0.08% : 0.000080s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.37% : 0.000369s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000030s : 1: graph_reusing 10.31% : 0.010314s : 1: jit_opt_a 0.19% : 0.000192s : 1: jit_opt_after_cconv 0.07% : 0.000075s : 1: jit_opt_b 0.62% : 0.000620s : 1: loop_unroll 0.90% : 0.000903s : 1: mutable_eliminate 1.22% : 0.001221s : 26: opt.transform.jit_opt_a 0.07% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000038s : 4: opt.transform.jit_opt_b 0.02% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.03% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000138s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000635s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 2.45% : 0.002447s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.81% : 0.002815s : 1: renormalize.infer 1.36% : 0.001361s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000123s : 1: rewriter_before_opt_a 0.19% : 0.000191s : 1: symbol_engine_optimizer 78.01% : 0.078054s : 1: type_inference Time group info: ------[substitution.] 0.000203 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000005s : 3: substitution.graph_param_transform 83.52% : 0.000170s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000004s : 2: substitution.replace_old_param 6.32% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037093 2 96.14% : 0.035662s : 1: type_inference.infer 3.86% : 0.001430s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.15% : 0.000045s : 4: replace.inline 32.85% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.44% : 0.000167s : 4: match.inline 6.56% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.64% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.29% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.87% : 0.000006s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.17% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000001s : 10: predicate.tile_eliminate 1.33% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000802 13 47.58% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.88% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.54% : 0.000381s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046788 72 0.11% : 0.000054s : 1: add_recomputation 0.15% : 0.000071s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.64% : 0.000299s : 1: bootstrap 0.06% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.34% : 0.005304s : 1: jit_opt_a 0.30% : 0.000141s : 1: jit_opt_after_cconv 0.11% : 0.000050s : 1: jit_opt_b 0.90% : 0.000419s : 1: loop_unroll 1.06% : 0.000496s : 1: mutable_eliminate 1.75% : 0.000818s : 26: opt.transform.jit_opt_a 0.10% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.01% : 0.000473s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000103s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.00% : 0.000469s : 1: renormalize.infer 0.79% : 0.000371s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.18% : 0.000083s : 1: rewriter_before_opt_a 0.16% : 0.000075s : 1: symbol_engine_optimizer 79.48% : 0.037187s : 1: type_inference TotalTime = 0.157354, [30] [bootstrap]: 0.00040811 [type_inference]: 0.141504 [event_method]: 2.136e-05 [auto_monad]: 7.724e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 0.00070145 [rewriter_before_opt_a]: 9.345e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.0114232, [2] [Cycle 1]: 0.00660678, [27] [switch_simplify]: 7.467e-05 [loop_unroll]: 3.324e-05 [a_1]: 0.00078302 [with_stream_mark]: 2.428e-05 [recompute_prepare]: 1.4e-05 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.98999e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 8.58001e-06 [updatestate_useless_node_eliminater]: 7.88001e-06 [accelerated_algorithm]: 8.60999e-06 [meta_shard_fg_expand]: 3.43999e-06 [get_grad_eliminate_]: 8.49002e-06 [merge_forward]: 5.14e-06 [cell_reuse_recompute_pass]: 2.19999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.123e-05 [j_node_and_user_rematch]: 1.295e-05 [meta_fg_expand]: 4.13999e-06 [replace_old_param]: 1.231e-05 [inline_without_move]: 7.2e-06 [renormalize]: 0.00522987 [add_forward_monad_depend]: 9.61e-06 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 2.177e-05 [cse]: 3.496e-05 [replace_applicator]: 2.76e-05 [Cycle 2]: 0.0004349, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 6.98e-06 [a_1]: 0.0001485 [with_stream_mark]: 1.533e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 7.74002e-06 [meta_shard_fg_expand]: 2.55002e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 4.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 3.09001e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 5.52001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 1.09003e-06 [auto_monad_eliminator]: 7.95e-06 [cse]: 1.293e-05 [replace_applicator]: 6.82002e-06 [py_interpret_to_execute_after_opt_a]: 1.625e-05 [rewriter_after_opt_a]: 3.989e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 2.063e-05 [mutable_eliminate]: 0.0008936 [jit_opt_b]: 7.013e-05, [1] [Cycle 1]: 6.105e-05, [2] [frontend_op_eliminate]: 2.589e-05 [inline_after_opt_a]: 2.183e-05 [cconv]: 2.628e-05 [loop_unroll]: 0.00052349 [jit_opt_after_cconv]: 0.00018705, [1] [Cycle 1]: 0.00017983, [11] [c_1]: 3.141e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 7.88001e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.909e-05 [call_graph_tuple_transform]: 2.595e-05 [tuple_list_get_item_eliminator]: 7.2e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 7.05e-06 [remove_dup_value]: 1.68e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 1.022e-05 [add_recomputation]: 5.653e-05 [cse_after_recomputation]: 2.888e-05, [1] [Cycle 1]: 2.102e-05, [1] [cse]: 1.286e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 8.83001e-06 [opt_after_jit_grad]: 0.00060831 [symbol_engine_optimizer]: 0.00032006, [1] [Cycle 1]: 0.00031071, [6] [build]: 4.37e-06 [elim_shapecalc]: 1.078e-05 [elim_not_effective]: 2.112e-05 [opt_reshape]: 8.50001e-06 [fold_const_symbol]: 0.00022244 [renormalize]: 8.59989e-07 [validate]: 5.88e-05 Sums bootstrap : 0.000408s : 0.27% type_inference : 0.141504s : 92.94% event_method : 0.000021s : 0.01% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000701s : 0.46% rewriter_before_opt_a : 0.000093s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000932s : 0.61% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005230s : 3.43% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000048s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000021s : 0.01% mutable_eliminate : 0.000894s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000523s : 0.34% jit_opt_after_cconv.c_1 : 0.000031s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000608s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000222s : 0.15% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.04% Time group info: ------[substitution.] 0.000290 24 2.26% : 0.000007s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000007s : 4: substitution.graph_param_transform 83.43% : 0.000242s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000006s : 4: substitution.remove_not_recompute_node 1.97% : 0.000006s : 2: substitution.replace_old_param 5.76% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.141402 2 96.86% : 0.136961s : 1: type_inference.infer 3.14% : 0.004441s : 1: type_inference.specialize ------[replace.] 0.000125 6 63.60% : 0.000080s : 4: replace.inline 36.40% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000252 6 94.09% : 0.000237s : 4: match.inline 5.91% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000175 830 1.15% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 12: predicate.addn_check_dump 1.71% : 0.000003s : 12: predicate.addn_zero_filter 2.14% : 0.000004s : 12: predicate.arithmetic_simplify 1.46% : 0.000003s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 0.91% : 0.000002s : 12: predicate.compare_switch_simplify 1.03% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.85% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.95% : 0.000003s : 12: predicate.dict_set_item_eliminator 0.62% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.89% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.75% : 0.000003s : 12: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_depend_swap 1.86% : 0.000003s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.63% : 0.000001s : 4: predicate.graph_param_transform 4.79% : 0.000008s : 26: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.59% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.10% : 0.000004s : 8: predicate.less_batch_normalization 1.56% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.42% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000004s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 2.60% : 0.000005s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 1.70% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.04% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.95% : 0.000005s : 18: predicate.switch_defer_inline 1.66% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000012s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.19% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.53% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.85% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.10% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 2.24% : 0.000004s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003119 22 59.36% : 0.001851s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.17% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.46% : 0.001231s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.164103 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000426s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.96% : 0.011428s : 1: jit_opt_a 0.12% : 0.000190s : 1: jit_opt_after_cconv 0.04% : 0.000073s : 1: jit_opt_b 0.32% : 0.000532s : 1: loop_unroll 0.55% : 0.000902s : 1: mutable_eliminate 0.75% : 0.001228s : 26: opt.transform.jit_opt_a 0.04% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000258s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000616s : 1: opt_after_jit_grad 0.01% : 0.000023s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000708s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.35% : 0.003850s : 1: renormalize.infer 0.83% : 0.001365s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000097s : 1: rewriter_before_opt_a 0.20% : 0.000323s : 1: symbol_engine_optimizer 86.24% : 0.141518s : 1: type_inference TotalTime = 0.0395236, [30] [bootstrap]: 0.00035024 [type_inference]: 0.0294136 [event_method]: 1.952e-05 [auto_monad]: 7.442e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 3.9e-06 [py_interpret_to_execute]: 0.00014242 [rewriter_before_opt_a]: 8.887e-05 [expand_dump_flag]: 3.77998e-06 [jit_opt_a]: 0.00676923, [2] [Cycle 1]: 0.00220878, [27] [switch_simplify]: 6.465e-05 [loop_unroll]: 3.388e-05 [a_1]: 0.00064367 [with_stream_mark]: 1.98e-05 [recompute_prepare]: 1.225e-05 [updatestate_depend_eliminate]: 5.13002e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 2.73e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 5.09e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.785e-05 [j_node_and_user_rematch]: 1.048e-05 [meta_fg_expand]: 2.86999e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 7.19001e-06 [renormalize]: 0.0010522 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.586e-05 [cse]: 3.372e-05 [replace_applicator]: 1.784e-05 [Cycle 2]: 0.00036492, [27] [switch_simplify]: 7.44002e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00010191 [with_stream_mark]: 1.152e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.57e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.14003e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 2.59001e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.92002e-06 [cse]: 1.652e-05 [replace_applicator]: 7.03e-06 [py_interpret_to_execute_after_opt_a]: 1.291e-05 [rewriter_after_opt_a]: 4.049e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.86998e-06 [mutable_eliminate]: 0.00076173 [jit_opt_b]: 5.496e-05, [1] [Cycle 1]: 4.683e-05, [2] [frontend_op_eliminate]: 1.807e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00052325 [jit_opt_after_cconv]: 0.00016321, [1] [Cycle 1]: 0.00015463, [11] [c_1]: 2.32e-05 [parameter_eliminate]: 3.06999e-06 [updatestate_depend_eliminate]: 6.91001e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 2.864e-05 [call_graph_tuple_transform]: 2.075e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 6.41998e-06 [remove_dup_value]: 1.688e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 5.44998e-06 [add_recomputation]: 5.341e-05 [cse_after_recomputation]: 3.013e-05, [1] [Cycle 1]: 2.34e-05, [1] [cse]: 1.538e-05 [auto_monad_reorder]: 2.015e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.00057223 [symbol_engine_optimizer]: 7.893e-05, [1] [Cycle 1]: 7.212e-05, [6] [build]: 3.16999e-06 [elim_shapecalc]: 7.74002e-06 [elim_not_effective]: 1.646e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 9.77999e-06 [renormalize]: 6.69999e-07 [validate]: 4.292e-05 Sums bootstrap : 0.000350s : 1.01% type_inference : 0.029414s : 84.90% event_method : 0.000020s : 0.06% auto_monad : 0.000074s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000142s : 0.41% rewriter_before_opt_a : 0.000089s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.21% jit_opt_a.loop_unroll : 0.000040s : 0.11% jit_opt_a.a_1 : 0.000746s : 2.15% jit_opt_a.with_stream_mark : 0.000031s : 0.09% jit_opt_a.recompute_prepare : 0.000018s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001052s : 3.04% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.07% jit_opt_a.cse : 0.000050s : 0.15% jit_opt_a.replace_applicator : 0.000025s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000762s : 2.20% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000026s : 0.07% loop_unroll : 0.000523s : 1.51% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000053s : 0.15% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000572s : 1.65% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.12% Time group info: ------[substitution.] 0.000227 23 1.20% : 0.000003s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 3: substitution.graph_param_transform 83.74% : 0.000190s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000006s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 6.02% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029329 2 93.94% : 0.027553s : 1: type_inference.infer 6.06% : 0.001776s : 1: type_inference.specialize ------[replace.] 0.000089 6 62.93% : 0.000056s : 4: replace.inline 37.07% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 93.79% : 0.000187s : 4: match.inline 6.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 2.47% : 0.000003s : 10: predicate.arithmetic_simplify 2.21% : 0.000003s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.56% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.58% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.58% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 2.10% : 0.000003s : 10: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000002s : 10: predicate.environ_get_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.10% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 2.28% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.48% : 0.000002s : 15: predicate.load_eliminater 0.88% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.39% : 0.000002s : 10: predicate.merge_addn 1.12% : 0.000002s : 10: predicate.minmaximum_grad 1.32% : 0.000002s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000001s : 10: predicate.print_const_string_wrapper 2.49% : 0.000004s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.82% : 0.000003s : 10: predicate.reshape_eliminate 1.18% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000011s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.54% : 0.000002s : 10: predicate.transpose_eliminate 1.21% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.42% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.33% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000859 13 44.85% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.00% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.15% : 0.000439s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041599 72 0.14% : 0.000057s : 1: add_recomputation 0.19% : 0.000078s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.88% : 0.000366s : 1: bootstrap 0.07% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.02% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 16.28% : 0.006773s : 1: jit_opt_a 0.40% : 0.000166s : 1: jit_opt_after_cconv 0.14% : 0.000058s : 1: jit_opt_b 1.28% : 0.000531s : 1: loop_unroll 1.85% : 0.000771s : 1: mutable_eliminate 2.40% : 0.000999s : 26: opt.transform.jit_opt_a 0.13% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000581s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.35% : 0.000147s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.47% : 0.000611s : 1: renormalize.infer 1.04% : 0.000431s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000044s : 1: rewriter_after_opt_a 0.23% : 0.000094s : 1: rewriter_before_opt_a 0.20% : 0.000081s : 1: symbol_engine_optimizer 70.75% : 0.029429s : 1: type_inference TotalTime = 0.0946533, [30] [bootstrap]: 0.00040596 [type_inference]: 0.0791295 [event_method]: 2.686e-05 [auto_monad]: 0.00011234 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 3.3e-06 [py_interpret_to_execute]: 0.00066846 [rewriter_before_opt_a]: 0.0001233 [expand_dump_flag]: 4.41002e-06 [jit_opt_a]: 0.0110425, [2] [Cycle 1]: 0.00607703, [27] [switch_simplify]: 9.301e-05 [loop_unroll]: 3.748e-05 [a_1]: 0.00090724 [with_stream_mark]: 2.357e-05 [recompute_prepare]: 1.145e-05 [updatestate_depend_eliminate]: 4.97999e-06 [updatestate_assign_eliminate]: 3.98999e-06 [updatestate_loads_eliminate]: 3.97002e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 9.28002e-06 [updatestate_useless_node_eliminater]: 7.33e-06 [accelerated_algorithm]: 9.88002e-06 [meta_shard_fg_expand]: 3.56999e-06 [get_grad_eliminate_]: 9.35001e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.054e-05 [j_node_and_user_rematch]: 1.245e-05 [meta_fg_expand]: 3.61999e-06 [replace_old_param]: 1.417e-05 [inline_without_move]: 8.25e-06 [renormalize]: 0.00455297 [add_forward_monad_depend]: 1.144e-05 [auto_monad_grad]: 3.04999e-06 [auto_monad_eliminator]: 2.236e-05 [cse]: 4.258e-05 [replace_applicator]: 2.666e-05 [Cycle 2]: 0.00048055, [27] [switch_simplify]: 8.75999e-06 [loop_unroll]: 8.13001e-06 [a_1]: 0.00015117 [with_stream_mark]: 1.624e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.85998e-06 [meta_shard_fg_expand]: 3.23998e-06 [get_grad_eliminate_]: 7.4e-06 [merge_forward]: 5.24e-06 [cell_reuse_recompute_pass]: 3.73999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.328e-05 [j_node_and_user_rematch]: 1.178e-05 [meta_fg_expand]: 4.13999e-06 [replace_old_param]: 1.173e-05 [inline_without_move]: 6.43e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 9.89001e-06 [cse]: 2.348e-05 [replace_applicator]: 8.66002e-06 [py_interpret_to_execute_after_opt_a]: 1.818e-05 [rewriter_after_opt_a]: 7.075e-05 [convert_after_rewriter]: 9.40001e-06 [order_py_execute_after_rewriter]: 5.95002e-06 [mutable_eliminate]: 0.00093627 [jit_opt_b]: 7.066e-05, [1] [Cycle 1]: 6.065e-05, [2] [frontend_op_eliminate]: 2.444e-05 [inline_after_opt_a]: 2.193e-05 [cconv]: 3.257e-05 [loop_unroll]: 0.00056924 [jit_opt_after_cconv]: 0.00021029, [1] [Cycle 1]: 0.00020112, [11] [c_1]: 3.111e-05 [parameter_eliminate]: 5.54e-06 [updatestate_depend_eliminate]: 1.143e-05 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 4.211e-05 [call_graph_tuple_transform]: 2.913e-05 [tuple_list_get_item_eliminator]: 7.59002e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 8.84e-06 [remove_dup_value]: 2.468e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 1.137e-05 [add_recomputation]: 6.012e-05 [cse_after_recomputation]: 2.983e-05, [1] [Cycle 1]: 2.371e-05, [1] [cse]: 1.625e-05 [auto_monad_reorder]: 2.001e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 7.91001e-06 [opt_after_jit_grad]: 0.00060814 [symbol_engine_optimizer]: 9.22e-05, [1] [Cycle 1]: 8.399e-05, [6] [build]: 5.03002e-06 [elim_shapecalc]: 1.01e-05 [elim_not_effective]: 1.81e-05 [opt_reshape]: 9.39e-06 [fold_const_symbol]: 1.124e-05 [renormalize]: 5.89993e-07 [validate]: 0.00013946 Sums bootstrap : 0.000406s : 0.45% type_inference : 0.079130s : 88.45% event_method : 0.000027s : 0.03% auto_monad : 0.000112s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000668s : 0.75% rewriter_before_opt_a : 0.000123s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000102s : 0.11% jit_opt_a.loop_unroll : 0.000046s : 0.05% jit_opt_a.a_1 : 0.001058s : 1.18% jit_opt_a.with_stream_mark : 0.000040s : 0.04% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000016s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.02% jit_opt_a.accelerated_algorithm : 0.000017s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.02% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.03% jit_opt_a.meta_fg_expand : 0.000008s : 0.01% jit_opt_a.replace_old_param : 0.000026s : 0.03% jit_opt_a.inline_without_move : 0.000015s : 0.02% jit_opt_a.renormalize : 0.004553s : 5.09% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.04% jit_opt_a.cse : 0.000066s : 0.07% jit_opt_a.replace_applicator : 0.000035s : 0.04% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000071s : 0.08% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000936s : 1.05% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.03% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000033s : 0.04% loop_unroll : 0.000569s : 0.64% jit_opt_after_cconv.c_1 : 0.000031s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000025s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.07% cse_after_recomputation.cse : 0.000016s : 0.02% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000608s : 0.68% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000139s : 0.16% Time group info: ------[substitution.] 0.000357 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000007s : 4: substitution.graph_param_transform 87.86% : 0.000313s : 5: substitution.inline 1.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000007s : 4: substitution.remove_not_recompute_node 1.68% : 0.000006s : 2: substitution.replace_old_param 4.21% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.079018 2 94.87% : 0.074965s : 1: type_inference.infer 5.13% : 0.004053s : 1: type_inference.specialize ------[replace.] 0.000157 7 64.13% : 0.000101s : 5: replace.inline 35.87% : 0.000056s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000324 7 95.83% : 0.000310s : 5: match.inline 4.17% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 888 0.97% : 0.000002s : 13: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.46% : 0.000004s : 13: predicate.arithmetic_simplify 1.59% : 0.000003s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.28% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.61% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.81% : 0.000003s : 13: predicate.environ_get_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.35% : 0.000001s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 4.42% : 0.000008s : 28: predicate.inline 0.70% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.46% : 0.000003s : 19: predicate.load_eliminater 2.17% : 0.000004s : 4: predicate.loop_unroll_after_grad 4.31% : 0.000008s : 41: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.90% : 0.000002s : 13: predicate.merge_addn 0.90% : 0.000002s : 13: predicate.minmaximum_grad 2.01% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 1.90% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000004s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 1.67% : 0.000003s : 23: predicate.replace_applicator 0.45% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.88% : 0.000002s : 4: predicate.row_tensor_eliminate 1.06% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.79% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.57% : 0.000013s : 65: predicate.switch_simplify 1.09% : 0.000002s : 13: predicate.tile_eliminate 1.49% : 0.000003s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.97% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.60% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 13: predicate.value_based_eliminate 0.25% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003911 29 64.24% : 0.002513s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.52% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.24% : 0.001300s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.100595 72 0.06% : 0.000063s : 1: add_recomputation 0.12% : 0.000116s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.41% : 0.000415s : 1: bootstrap 0.04% : 0.000036s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.03% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.03% : 0.000031s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.98% : 0.011047s : 1: jit_opt_a 0.21% : 0.000213s : 1: jit_opt_after_cconv 0.07% : 0.000073s : 1: jit_opt_b 0.57% : 0.000577s : 1: loop_unroll 0.94% : 0.000946s : 1: mutable_eliminate 1.38% : 0.001388s : 26: opt.transform.jit_opt_a 0.07% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000038s : 4: opt.transform.jit_opt_b 0.02% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000025s : 1: opt.transform.mutable_eliminate 0.03% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000616s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.67% : 0.000676s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000027s : 1: remove_dup_value 3.14% : 0.003163s : 1: renormalize.infer 1.37% : 0.001376s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000075s : 1: rewriter_after_opt_a 0.13% : 0.000129s : 1: rewriter_before_opt_a 0.09% : 0.000095s : 1: symbol_engine_optimizer 78.68% : 0.079148s : 1: type_inference TotalTime = 0.160936, [30] [bootstrap]: 0.00031811 [type_inference]: 0.124605 [event_method]: 0.00050369 [auto_monad]: 0.0001235 [graph_reusing]: 7.79002e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 9.75e-05 [rewriter_before_opt_a]: 0.00013759 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.032343, [3] [Cycle 1]: 0.0190757, [27] [switch_simplify]: 8.507e-05 [loop_unroll]: 4.508e-05 [a_1]: 0.00106555 [with_stream_mark]: 3.92e-05 [recompute_prepare]: 2.327e-05 [updatestate_depend_eliminate]: 9.67001e-06 [updatestate_assign_eliminate]: 7.43999e-06 [updatestate_loads_eliminate]: 6.81001e-06 [parameter_eliminate]: 2.88e-06 [specialize_transform]: 1.545e-05 [updatestate_useless_node_eliminater]: 1.365e-05 [accelerated_algorithm]: 1.425e-05 [meta_shard_fg_expand]: 4.92e-06 [get_grad_eliminate_]: 1.395e-05 [merge_forward]: 9.31e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.992e-05 [j_node_and_user_rematch]: 2.605e-05 [meta_fg_expand]: 0.00213236 [replace_old_param]: 7.951e-05 [inline_without_move]: 6.893e-05 [renormalize]: 0.0145582 [add_forward_monad_depend]: 1.831e-05 [auto_monad_grad]: 6.69001e-06 [auto_monad_eliminator]: 7.052e-05 [cse]: 0.0003057 [replace_applicator]: 0.00010107 [Cycle 2]: 0.00884432, [27] [switch_simplify]: 4.696e-05 [loop_unroll]: 4.632e-05 [a_1]: 0.0012747 [with_stream_mark]: 2.672e-05 [recompute_prepare]: 1.389e-05 [updatestate_depend_eliminate]: 6.14001e-06 [updatestate_assign_eliminate]: 4.27e-06 [updatestate_loads_eliminate]: 4.13001e-06 [parameter_eliminate]: 2.98998e-06 [specialize_transform]: 7.92e-06 [updatestate_useless_node_eliminater]: 6.78e-06 [accelerated_algorithm]: 7.66001e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 5.42999e-06 [cell_reuse_recompute_pass]: 2.08998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.066e-05 [j_node_and_user_rematch]: 1.187e-05 [meta_fg_expand]: 0.00014847 [replace_old_param]: 1.126e-05 [inline_without_move]: 8.06001e-06 [renormalize]: 0.00683943 [add_forward_monad_depend]: 1.267e-05 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 2.469e-05 [cse]: 3.678e-05 [replace_applicator]: 2.66e-05 [Cycle 3]: 0.00037352, [27] [switch_simplify]: 6.39999e-06 [loop_unroll]: 5.99e-06 [a_1]: 8.814e-05 [with_stream_mark]: 1.657e-05 [recompute_prepare]: 5.41002e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.10998e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 4.40999e-06 [accelerated_algorithm]: 5.12999e-06 [meta_shard_fg_expand]: 2.28998e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 3.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.828e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 4.38999e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 9.06998e-06 [cse]: 1.505e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 2.07e-05 [rewriter_after_opt_a]: 4.374e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00085703 [jit_opt_b]: 5.464e-05, [1] [Cycle 1]: 4.569e-05, [2] [frontend_op_eliminate]: 1.569e-05 [inline_after_opt_a]: 1.623e-05 [cconv]: 3.829e-05 [loop_unroll]: 0.00051757 [jit_opt_after_cconv]: 0.0001728, [1] [Cycle 1]: 0.00016539, [11] [c_1]: 1.811e-05 [parameter_eliminate]: 4.43001e-06 [updatestate_depend_eliminate]: 9.45001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.698e-05 [call_graph_tuple_transform]: 2.161e-05 [tuple_list_get_item_eliminator]: 5.41002e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 9.49978e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 2.072e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.59999e-06 [add_recomputation]: 7.078e-05 [cse_after_recomputation]: 2.752e-05, [1] [Cycle 1]: 2.104e-05, [1] [cse]: 1.417e-05 [auto_monad_reorder]: 1.58e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 8.23999e-06 [opt_after_jit_grad]: 0.00052639 [symbol_engine_optimizer]: 0.00011148, [1] [Cycle 1]: 7.947e-05, [6] [build]: 4.87e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.805e-05 [opt_reshape]: 5.74999e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 8.50006e-07 [validate]: 5.305e-05 Sums bootstrap : 0.000318s : 0.20% type_inference : 0.124605s : 79.97% event_method : 0.000504s : 0.32% auto_monad : 0.000124s : 0.08% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000098s : 0.06% rewriter_before_opt_a : 0.000138s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000138s : 0.09% jit_opt_a.loop_unroll : 0.000097s : 0.06% jit_opt_a.a_1 : 0.002428s : 1.56% jit_opt_a.with_stream_mark : 0.000082s : 0.05% jit_opt_a.recompute_prepare : 0.000043s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000079s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000048s : 0.03% jit_opt_a.meta_fg_expand : 0.002283s : 1.47% jit_opt_a.replace_old_param : 0.000095s : 0.06% jit_opt_a.inline_without_move : 0.000082s : 0.05% jit_opt_a.renormalize : 0.021398s : 13.73% jit_opt_a.add_forward_monad_depend : 0.000033s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000104s : 0.07% jit_opt_a.cse : 0.000358s : 0.23% jit_opt_a.replace_applicator : 0.000133s : 0.09% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000857s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000038s : 0.02% loop_unroll : 0.000518s : 0.33% jit_opt_after_cconv.c_1 : 0.000018s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000071s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000526s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.03% Time group info: ------[substitution.] 0.000675 109 0.54% : 0.000004s : 2: substitution.elim_not_effective 0.24% : 0.000002s : 2: substitution.fold_const_symbol 0.86% : 0.000006s : 2: substitution.graph_param_transform 66.47% : 0.000448s : 13: substitution.inline 3.64% : 0.000025s : 2: substitution.inline_without_move 1.92% : 0.000013s : 13: substitution.j_node_and_user_rematch 1.78% : 0.000012s : 7: substitution.minmaximum_grad 1.29% : 0.000009s : 5: substitution.partial_eliminate 1.79% : 0.000012s : 13: substitution.remove_not_recompute_node 5.30% : 0.000036s : 10: substitution.replace_applicator 1.13% : 0.000008s : 10: substitution.replace_old_param 0.47% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.03% : 0.000007s : 1: substitution.tile_eliminate 3.93% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.44% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.19% : 0.000048s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124490 2 97.42% : 0.121279s : 1: type_inference.infer 2.58% : 0.003211s : 1: type_inference.specialize ------[replace.] 0.000204 20 65.86% : 0.000134s : 13: replace.inline 34.14% : 0.000070s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000465 20 94.55% : 0.000440s : 13: match.inline 5.45% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000402 2628 1.55% : 0.000006s : 45: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.46% : 0.000006s : 45: predicate.addn_check_dump 1.60% : 0.000006s : 45: predicate.addn_zero_filter 2.02% : 0.000008s : 45: predicate.arithmetic_simplify 1.59% : 0.000006s : 45: predicate.cast_eliminate 0.08% : 0.000000s : 2: predicate.check_bprop_eliminate 1.40% : 0.000006s : 45: predicate.compare_switch_simplify 1.64% : 0.000007s : 45: predicate.depend_value_elim 1.48% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.45% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.13% : 0.000001s : 2: predicate.elim_not_effective 0.26% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.38% : 0.000006s : 45: predicate.environ_get_depend_swap 1.42% : 0.000006s : 45: predicate.environ_get_eliminate 1.43% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.77% : 0.000003s : 18: predicate.get_grad_eliminate 0.07% : 0.000000s : 2: predicate.graph_param_transform 4.70% : 0.000019s : 69: predicate.inline 2.04% : 0.000008s : 46: predicate.inline_without_move 0.35% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.25% : 0.000005s : 18: predicate.less_batch_normalization 1.98% : 0.000008s : 52: predicate.list_to_tuple_eliminator_ 1.79% : 0.000007s : 54: predicate.load_eliminater 0.59% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.33% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.64% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.40% : 0.000006s : 45: predicate.merge_addn 1.44% : 0.000006s : 45: predicate.minmaximum_grad 0.65% : 0.000003s : 2: predicate.mutable_eliminate 0.15% : 0.000001s : 2: predicate.opt_reshape 2.23% : 0.000009s : 54: predicate.partial_eliminate 1.49% : 0.000006s : 45: predicate.print_const_string_wrapper 2.19% : 0.000009s : 45: predicate.reduce_eliminate 1.72% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 18: predicate.remove_not_recompute_node 2.82% : 0.000011s : 99: predicate.replace_applicator 1.23% : 0.000005s : 46: predicate.replace_old_param 0.06% : 0.000000s : 2: predicate.reset_defer_inline 1.53% : 0.000006s : 45: predicate.reshape_eliminate 1.51% : 0.000006s : 45: predicate.row_tensor_add_zeros_like 0.27% : 0.000001s : 2: predicate.row_tensor_eliminate 1.50% : 0.000006s : 45: predicate.same_eliminate 0.46% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 4: predicate.special_op_eliminate 0.86% : 0.000003s : 18: predicate.specialize_transform 1.81% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.87% : 0.000012s : 65: predicate.switch_defer_inline 2.38% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.46% : 0.000026s : 160: predicate.switch_simplify 1.59% : 0.000006s : 45: predicate.tile_eliminate 1.42% : 0.000006s : 45: predicate.transpose_eliminate 1.99% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000013s : 56: predicate.tuple_list_get_item_eliminator 1.78% : 0.000007s : 45: predicate.tuple_list_set_item_eliminator 1.74% : 0.000007s : 52: predicate.tuple_to_list_eliminator_ 1.93% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.58% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.90% : 0.000008s : 45: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.21% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004178 45 73.87% : 0.003087s : 28: func_graph_cloner_run.FuncGraphClonerGraph 26.13% : 0.001092s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.185553 87 0.04% : 0.000075s : 1: add_recomputation 0.07% : 0.000132s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.18% : 0.000342s : 1: bootstrap 0.02% : 0.000041s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.28% : 0.000515s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 17.43% : 0.032348s : 1: jit_opt_a 0.09% : 0.000176s : 1: jit_opt_after_cconv 0.03% : 0.000058s : 1: jit_opt_b 0.28% : 0.000529s : 1: loop_unroll 0.47% : 0.000872s : 1: mutable_eliminate 1.72% : 0.003189s : 39: opt.transform.jit_opt_a 0.03% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000032s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000536s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000101s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 10.06% : 0.018664s : 2: renormalize.infer 1.46% : 0.002703s : 2: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000141s : 1: rewriter_before_opt_a 0.06% : 0.000114s : 1: symbol_engine_optimizer 67.17% : 0.124630s : 1: type_inference TotalTime = 0.0878243, [30] [bootstrap]: 0.00040571 [type_inference]: 0.075629 [event_method]: 1.88e-05 [auto_monad]: 4.802e-05 [graph_reusing]: 4.05998e-06 [pre_auto_parallel]: 2.81999e-06 [py_interpret_to_execute]: 0.0004049 [rewriter_before_opt_a]: 9.049e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00878995, [2] [Cycle 1]: 0.00441193, [27] [switch_simplify]: 5.646e-05 [loop_unroll]: 3.083e-05 [a_1]: 0.00062986 [with_stream_mark]: 1.399e-05 [recompute_prepare]: 8.92e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 8.08999e-06 [updatestate_useless_node_eliminater]: 6.91001e-06 [accelerated_algorithm]: 7.14001e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 6.94999e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.42e-05 [j_node_and_user_rematch]: 1.117e-05 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.82999e-06 [inline_without_move]: 6.64001e-06 [renormalize]: 0.00335708 [add_forward_monad_depend]: 6.54999e-06 [auto_monad_grad]: 2.02001e-06 [auto_monad_eliminator]: 1.306e-05 [cse]: 1.921e-05 [replace_applicator]: 1.426e-05 [Cycle 2]: 0.00038429, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 6.15002e-06 [a_1]: 0.00013283 [with_stream_mark]: 1.291e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 3.96001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.492e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.184e-05 [replace_applicator]: 5.91998e-06 [py_interpret_to_execute_after_opt_a]: 1.304e-05 [rewriter_after_opt_a]: 3.337e-05 [convert_after_rewriter]: 6.49001e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00074075 [jit_opt_b]: 5.768e-05, [1] [Cycle 1]: 5.084e-05, [2] [frontend_op_eliminate]: 2.114e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 2.37e-05 [loop_unroll]: 0.00044982 [jit_opt_after_cconv]: 0.00015809, [1] [Cycle 1]: 0.00015156, [11] [c_1]: 2.771e-05 [parameter_eliminate]: 2.24999e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.463e-05 [call_graph_tuple_transform]: 2.216e-05 [tuple_list_get_item_eliminator]: 6.88e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.493e-05 [partial_unused_args_eliminate]: 1.78997e-06 [environ_conv]: 8.35001e-06 [add_recomputation]: 4.222e-05 [cse_after_recomputation]: 2.477e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.247e-05 [get_jit_bprop_graph]: 1.53002e-06 [rewriter_after_jit_bprop_graph]: 5.64e-06 [opt_after_jit_grad]: 0.00048371 [symbol_engine_optimizer]: 8.052e-05, [1] [Cycle 1]: 7.439e-05, [6] [build]: 3.33998e-06 [elim_shapecalc]: 8.79003e-06 [elim_not_effective]: 1.457e-05 [opt_reshape]: 6.85002e-06 [fold_const_symbol]: 1.076e-05 [renormalize]: 3.39991e-07 [validate]: 8.017e-05 Sums bootstrap : 0.000406s : 0.49% type_inference : 0.075629s : 90.85% event_method : 0.000019s : 0.02% auto_monad : 0.000048s : 0.06% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000405s : 0.49% rewriter_before_opt_a : 0.000090s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.08% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000763s : 0.92% jit_opt_a.with_stream_mark : 0.000027s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.003357s : 4.03% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000031s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000033s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000741s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.03% loop_unroll : 0.000450s : 0.54% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000042s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000484s : 0.58% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000080s : 0.10% Time group info: ------[substitution.] 0.000226 24 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 4: substitution.graph_param_transform 85.23% : 0.000193s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000005s : 2: substitution.replace_old_param 4.19% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.075535 2 95.94% : 0.072468s : 1: type_inference.infer 4.06% : 0.003067s : 1: type_inference.specialize ------[replace.] 0.000090 6 64.98% : 0.000058s : 4: replace.inline 35.02% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 95.81% : 0.000191s : 4: match.inline 4.19% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.78% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.51% : 0.000001s : 4: predicate.graph_param_transform 4.64% : 0.000006s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 18: predicate.load_eliminater 1.04% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.44% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.37% : 0.000002s : 12: predicate.print_const_string_wrapper 1.99% : 0.000003s : 12: predicate.reduce_eliminate 1.56% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.48% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.61% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003247 26 71.44% : 0.002320s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.56% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.00% : 0.000877s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.092226 72 0.05% : 0.000045s : 1: add_recomputation 0.06% : 0.000051s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.46% : 0.000425s : 1: bootstrap 0.03% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.54% : 0.008795s : 1: jit_opt_a 0.17% : 0.000161s : 1: jit_opt_after_cconv 0.07% : 0.000061s : 1: jit_opt_b 0.50% : 0.000457s : 1: loop_unroll 0.81% : 0.000750s : 1: mutable_eliminate 1.09% : 0.001005s : 26: opt.transform.jit_opt_a 0.06% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.53% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.44% : 0.000410s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.59% : 0.002387s : 1: renormalize.infer 1.04% : 0.000963s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000037s : 1: rewriter_after_opt_a 0.10% : 0.000095s : 1: rewriter_before_opt_a 0.09% : 0.000083s : 1: symbol_engine_optimizer 82.02% : 0.075643s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.914.1 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004dc10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.990.4 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0335112, [30] [bootstrap]: 0.00036171 [type_inference]: 0.0240103 [event_method]: 1.982e-05 [auto_monad]: 6.681e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00012246 [rewriter_before_opt_a]: 8.01e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00644363, [2] [Cycle 1]: 0.00204693, [27] [switch_simplify]: 5.569e-05 [loop_unroll]: 3.056e-05 [a_1]: 0.00058273 [with_stream_mark]: 1.983e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.76003e-06 [renormalize]: 0.00099088 [add_forward_monad_depend]: 7.23999e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.85e-05 [cse]: 3.596e-05 [replace_applicator]: 1.986e-05 [Cycle 2]: 0.00035149, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.83002e-06 [a_1]: 9.937e-05 [with_stream_mark]: 1.081e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 5.29998e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.51002e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.42002e-06 [cell_reuse_recompute_pass]: 2.78e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 8.24002e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.38998e-06 [cse]: 1.477e-05 [replace_applicator]: 6.62002e-06 [py_interpret_to_execute_after_opt_a]: 1.306e-05 [rewriter_after_opt_a]: 3.943e-05 [convert_after_rewriter]: 7.97e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00064554 [jit_opt_b]: 5.419e-05, [1] [Cycle 1]: 4.615e-05, [2] [frontend_op_eliminate]: 1.831e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.619e-05 [loop_unroll]: 0.00046649 [jit_opt_after_cconv]: 0.00015676, [1] [Cycle 1]: 0.00014961, [11] [c_1]: 2.123e-05 [parameter_eliminate]: 2.57001e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 2.66e-05 [call_graph_tuple_transform]: 2.111e-05 [tuple_list_get_item_eliminator]: 6.16e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.469e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.79999e-06 [add_recomputation]: 5.303e-05 [cse_after_recomputation]: 2.756e-05, [1] [Cycle 1]: 2.121e-05, [1] [cse]: 1.466e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.84e-06 [opt_after_jit_grad]: 0.00052831 [symbol_engine_optimizer]: 8.13e-05, [1] [Cycle 1]: 7.426e-05, [6] [build]: 4.15999e-06 [elim_shapecalc]: 9.05001e-06 [elim_not_effective]: 1.414e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 1.058e-05 [renormalize]: 5.09986e-07 [validate]: 4.287e-05 Sums bootstrap : 0.000362s : 1.25% type_inference : 0.024010s : 83.25% event_method : 0.000020s : 0.07% auto_monad : 0.000067s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000122s : 0.42% rewriter_before_opt_a : 0.000080s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000682s : 2.37% jit_opt_a.with_stream_mark : 0.000031s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000991s : 3.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000051s : 0.18% jit_opt_a.replace_applicator : 0.000026s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000646s : 2.24% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000026s : 0.09% loop_unroll : 0.000466s : 1.62% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.18% cse_after_recomputation.cse : 0.000015s : 0.05% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000528s : 1.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.15% Time group info: ------[substitution.] 0.000222 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.99% : 0.000002s : 2: substitution.fold_const_symbol 3.32% : 0.000007s : 3: substitution.graph_param_transform 82.62% : 0.000184s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000005s : 2: substitution.replace_old_param 6.20% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023937 2 93.39% : 0.022355s : 1: type_inference.infer 6.61% : 0.001582s : 1: type_inference.specialize ------[replace.] 0.000077 6 64.65% : 0.000050s : 4: replace.inline 35.35% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 93.52% : 0.000181s : 4: match.inline 6.48% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.21% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.76% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.80% : 0.000004s : 15: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.84% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.70% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.75% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000837 13 43.91% : 0.000367s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.83% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.27% : 0.000429s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035458 72 0.16% : 0.000056s : 1: add_recomputation 0.20% : 0.000070s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.08% : 0.000382s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000030s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.19% : 0.006448s : 1: jit_opt_a 0.45% : 0.000160s : 1: jit_opt_after_cconv 0.16% : 0.000057s : 1: jit_opt_b 1.34% : 0.000474s : 1: loop_unroll 1.84% : 0.000653s : 1: mutable_eliminate 2.57% : 0.000912s : 26: opt.transform.jit_opt_a 0.14% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000536s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000127s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.59% : 0.000562s : 1: renormalize.infer 1.19% : 0.000420s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000083s : 1: rewriter_before_opt_a 0.24% : 0.000084s : 1: symbol_engine_optimizer 67.75% : 0.024024s : 1: type_inference TotalTime = 0.0213557, [30] [bootstrap]: 0.00035677 [type_inference]: 0.0107766 [event_method]: 2.197e-05 [auto_monad]: 6.435e-05 [graph_reusing]: 5.29e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 6.801e-05 [rewriter_before_opt_a]: 8.471e-05 [expand_dump_flag]: 2.58998e-06 [jit_opt_a]: 0.00724423, [2] [Cycle 1]: 0.00253901, [27] [switch_simplify]: 6.979e-05 [loop_unroll]: 3.427e-05 [a_1]: 0.00074256 [with_stream_mark]: 1.658e-05 [recompute_prepare]: 8.71002e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.55002e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.301e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.97001e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00132695 [add_forward_monad_depend]: 6.64001e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.605e-05 [cse]: 3.115e-05 [replace_applicator]: 1.514e-05 [Cycle 2]: 0.00035804, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.00010762 [with_stream_mark]: 1.254e-05 [recompute_prepare]: 6.04999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.76003e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 5.16998e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 7.77998e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.447e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.534e-05 [rewriter_after_opt_a]: 3.859e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00081973 [jit_opt_b]: 5.719e-05, [1] [Cycle 1]: 4.957e-05, [2] [frontend_op_eliminate]: 1.973e-05 [inline_after_opt_a]: 1.759e-05 [cconv]: 2.694e-05 [loop_unroll]: 0.00050739 [jit_opt_after_cconv]: 0.00017121, [1] [Cycle 1]: 0.00016449, [11] [c_1]: 2.529e-05 [parameter_eliminate]: 3.31001e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 3.617e-05 [call_graph_tuple_transform]: 2.134e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.98002e-06 [remove_dup_value]: 4.17e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 5.98002e-06 [add_recomputation]: 4.685e-05 [cse_after_recomputation]: 5.672e-05, [1] [Cycle 1]: 5.102e-05, [1] [cse]: 4.348e-05 [auto_monad_reorder]: 1.711e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 7.18998e-06 [opt_after_jit_grad]: 0.00056242 [symbol_engine_optimizer]: 8.546e-05, [1] [Cycle 1]: 7.87e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 1.008e-05 [elim_not_effective]: 1.699e-05 [opt_reshape]: 7.73999e-06 [fold_const_symbol]: 1.01e-05 [renormalize]: 4.00003e-07 [validate]: 4.501e-05 Sums bootstrap : 0.000357s : 2.18% type_inference : 0.010777s : 65.82% event_method : 0.000022s : 0.13% auto_monad : 0.000064s : 0.39% graph_reusing : 0.000005s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000068s : 0.42% rewriter_before_opt_a : 0.000085s : 0.52% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.47% jit_opt_a.loop_unroll : 0.000040s : 0.24% jit_opt_a.a_1 : 0.000850s : 5.19% jit_opt_a.with_stream_mark : 0.000029s : 0.18% jit_opt_a.recompute_prepare : 0.000015s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001327s : 8.11% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.14% jit_opt_a.cse : 0.000046s : 0.28% jit_opt_a.replace_applicator : 0.000021s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.09% rewriter_after_opt_a : 0.000039s : 0.24% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000820s : 5.01% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.11% cconv : 0.000027s : 0.16% loop_unroll : 0.000507s : 3.10% jit_opt_after_cconv.c_1 : 0.000025s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000042s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000047s : 0.29% cse_after_recomputation.cse : 0.000043s : 0.27% auto_monad_reorder : 0.000017s : 0.10% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000562s : 3.44% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.27% Time group info: ------[substitution.] 0.000301 24 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 1.78% : 0.000005s : 3: substitution.graph_param_transform 87.93% : 0.000265s : 5: substitution.inline 1.06% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.35% : 0.000004s : 2: substitution.replace_old_param 4.67% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010696 2 86.93% : 0.009299s : 1: type_inference.infer 13.07% : 0.001398s : 1: type_inference.specialize ------[replace.] 0.000125 7 64.85% : 0.000081s : 5: replace.inline 35.15% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 95.34% : 0.000261s : 5: match.inline 4.66% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 747 1.51% : 0.000002s : 11: predicate.accumulaten_eliminater 1.17% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 11: predicate.addn_check_dump 1.59% : 0.000002s : 11: predicate.addn_zero_filter 2.37% : 0.000003s : 11: predicate.arithmetic_simplify 1.44% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 11: predicate.compare_switch_simplify 1.13% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.47% : 0.000002s : 11: predicate.environ_get_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.81% : 0.000007s : 24: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 16: predicate.load_eliminater 1.07% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 11: predicate.merge_addn 1.27% : 0.000002s : 11: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 16: predicate.partial_eliminate 1.45% : 0.000002s : 11: predicate.print_const_string_wrapper 2.55% : 0.000004s : 11: predicate.reduce_eliminate 1.37% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 19: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.16% : 0.000002s : 3: predicate.row_tensor_eliminate 1.62% : 0.000002s : 11: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.28% : 0.000002s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 18: predicate.switch_defer_inline 2.27% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 59: predicate.switch_simplify 1.42% : 0.000002s : 11: predicate.tile_eliminate 1.35% : 0.000002s : 11: predicate.transpose_eliminate 1.81% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 2.23% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001140 16 46.65% : 0.000532s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.95% : 0.000079s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.40% : 0.000529s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023822 72 0.21% : 0.000050s : 1: add_recomputation 0.28% : 0.000068s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.55% : 0.000369s : 1: bootstrap 0.12% : 0.000029s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.25% : 0.000059s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.11% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 30.43% : 0.007249s : 1: jit_opt_a 0.73% : 0.000174s : 1: jit_opt_after_cconv 0.25% : 0.000060s : 1: jit_opt_b 2.16% : 0.000515s : 1: loop_unroll 3.49% : 0.000832s : 1: mutable_eliminate 4.60% : 0.001095s : 26: opt.transform.jit_opt_a 0.23% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000030s : 4: opt.transform.jit_opt_b 0.07% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000017s : 1: opt.transform.mutable_eliminate 0.10% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000041s : 4: opt.transform.symbol_engine_opt 2.39% : 0.000570s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000071s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000044s : 1: remove_dup_value 3.11% : 0.000742s : 1: renormalize.infer 2.41% : 0.000575s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000042s : 1: rewriter_after_opt_a 0.37% : 0.000088s : 1: rewriter_before_opt_a 0.37% : 0.000088s : 1: symbol_engine_optimizer 45.32% : 0.010796s : 1: type_inference TotalTime = 0.0220686, [30] [bootstrap]: 0.000296 [type_inference]: 0.00498657 [event_method]: 2.004e-05 [auto_monad]: 7.097e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 3.906e-05 [rewriter_before_opt_a]: 7.651e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.0141315, [2] [Cycle 1]: 0.00196999, [27] [switch_simplify]: 7.761e-05 [loop_unroll]: 3.004e-05 [a_1]: 0.00064359 [with_stream_mark]: 2.777e-05 [recompute_prepare]: 7.63001e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.01997e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.615e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 9.99001e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00081629 [add_forward_monad_depend]: 6.28e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.566e-05 [cse]: 4.036e-05 [replace_applicator]: 1.328e-05 [Cycle 2]: 0.00032166, [27] [switch_simplify]: 6.21998e-06 [loop_unroll]: 4.97999e-06 [a_1]: 9.004e-05 [with_stream_mark]: 1.099e-05 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 1.98002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.3e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.44002e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.218e-05 [replace_applicator]: 4.94998e-06 [py_interpret_to_execute_after_opt_a]: 1.524e-05 [rewriter_after_opt_a]: 3.997e-05 [convert_after_rewriter]: 7.61999e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00071879 [jit_opt_b]: 0.00010352, [1] [Cycle 1]: 9.598e-05, [2] [frontend_op_eliminate]: 6.577e-05 [inline_after_opt_a]: 1.751e-05 [cconv]: 2.966e-05 [loop_unroll]: 0.00045216 [jit_opt_after_cconv]: 0.00016637, [1] [Cycle 1]: 0.00015926, [11] [c_1]: 2.07e-05 [parameter_eliminate]: 2.88998e-06 [updatestate_depend_eliminate]: 7.08e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.824e-05 [call_graph_tuple_transform]: 3.097e-05 [tuple_list_get_item_eliminator]: 5.17e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.826e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 5.649e-05 [cse_after_recomputation]: 2.385e-05, [1] [Cycle 1]: 1.824e-05, [1] [cse]: 1.221e-05 [auto_monad_reorder]: 1.88e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.80002e-06 [opt_after_jit_grad]: 0.00045365 [symbol_engine_optimizer]: 7.453e-05, [1] [Cycle 1]: 6.813e-05, [6] [build]: 4.38001e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 4.2998e-07 [validate]: 4.323e-05 Sums bootstrap : 0.000296s : 3.08% type_inference : 0.004987s : 51.92% event_method : 0.000020s : 0.21% auto_monad : 0.000071s : 0.74% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.41% rewriter_before_opt_a : 0.000077s : 0.80% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000084s : 0.87% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000734s : 7.64% jit_opt_a.with_stream_mark : 0.000039s : 0.40% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000816s : 8.50% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.22% jit_opt_a.cse : 0.000053s : 0.55% jit_opt_a.replace_applicator : 0.000018s : 0.19% py_interpret_to_execute_after_opt_a : 0.000015s : 0.16% rewriter_after_opt_a : 0.000040s : 0.42% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000719s : 7.48% jit_opt_b.frontend_op_eliminate : 0.000066s : 0.68% jit_opt_b.inline_after_opt_a : 0.000018s : 0.18% cconv : 0.000030s : 0.31% loop_unroll : 0.000452s : 4.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.32% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000018s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000056s : 0.59% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000019s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000454s : 4.72% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.45% Time group info: ------[substitution.] 0.000288 23 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.08% : 0.000006s : 3: substitution.graph_param_transform 87.32% : 0.000252s : 4: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 4.77% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004910 2 81.00% : 0.003977s : 1: type_inference.infer 19.00% : 0.000933s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.28% : 0.000052s : 4: replace.inline 30.72% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 6 95.22% : 0.000249s : 4: match.inline 4.78% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.55% : 0.000002s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.34% : 0.000002s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.36% : 0.000008s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.49% : 0.000002s : 10: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.55% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.58% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.20% : 0.000004s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.65% : 0.000011s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000684 13 51.41% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 9.34% : 0.000064s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.25% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023916 72 0.25% : 0.000059s : 1: add_recomputation 0.31% : 0.000075s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.32% : 0.000316s : 1: bootstrap 0.14% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.10% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 59.11% : 0.014136s : 1: jit_opt_a 0.71% : 0.000169s : 1: jit_opt_after_cconv 0.45% : 0.000107s : 1: jit_opt_b 1.94% : 0.000463s : 1: loop_unroll 3.05% : 0.000730s : 1: mutable_eliminate 4.06% : 0.000971s : 26: opt.transform.jit_opt_a 0.25% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.08% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.93% : 0.000462s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000042s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000021s : 1: remove_dup_value 1.95% : 0.000467s : 1: renormalize.infer 1.42% : 0.000340s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000043s : 1: rewriter_after_opt_a 0.33% : 0.000079s : 1: rewriter_before_opt_a 0.32% : 0.000077s : 1: symbol_engine_optimizer 20.94% : 0.005007s : 1: type_inference TotalTime = 0.0744852, [30] [bootstrap]: 0.00036831 [type_inference]: 0.0612896 [event_method]: 2.104e-05 [auto_monad]: 6.852e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00039621 [rewriter_before_opt_a]: 8.733e-05 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00970002, [2] [Cycle 1]: 0.00529313, [27] [switch_simplify]: 0.00011342 [loop_unroll]: 3.186e-05 [a_1]: 0.00068116 [with_stream_mark]: 2.104e-05 [recompute_prepare]: 9.40001e-06 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 7.51001e-06 [meta_shard_fg_expand]: 3.18998e-06 [get_grad_eliminate_]: 6.65002e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 1.111e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.082e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00404231 [add_forward_monad_depend]: 1.016e-05 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.967e-05 [cse]: 3.096e-05 [replace_applicator]: 2.34e-05 [Cycle 2]: 0.00041069, [27] [switch_simplify]: 7.67002e-06 [loop_unroll]: 6.97002e-06 [a_1]: 0.00014142 [with_stream_mark]: 1.34e-05 [recompute_prepare]: 6.16998e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 6.67002e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.63002e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 4.26001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.967e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 5.57001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 5.80002e-06 [cse]: 1.4e-05 [replace_applicator]: 7.75e-06 [py_interpret_to_execute_after_opt_a]: 1.605e-05 [rewriter_after_opt_a]: 3.738e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.82999e-06 [mutable_eliminate]: 0.00081966 [jit_opt_b]: 5.87e-05, [1] [Cycle 1]: 5.111e-05, [2] [frontend_op_eliminate]: 2.061e-05 [inline_after_opt_a]: 1.926e-05 [cconv]: 2.767e-05 [loop_unroll]: 0.00045152 [jit_opt_after_cconv]: 0.0001574, [1] [Cycle 1]: 0.0001507, [11] [c_1]: 2.669e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 2.375e-05 [call_graph_tuple_transform]: 2.166e-05 [tuple_list_get_item_eliminator]: 6.62002e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 2.30008e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.464e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 8.35001e-06 [add_recomputation]: 5.074e-05 [cse_after_recomputation]: 2.438e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.513e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 5.76998e-06 [opt_after_jit_grad]: 0.00049622 [symbol_engine_optimizer]: 9.972e-05, [1] [Cycle 1]: 9.3e-05, [6] [build]: 4.63999e-06 [elim_shapecalc]: 9.02999e-06 [elim_not_effective]: 1.563e-05 [opt_reshape]: 7.33999e-06 [fold_const_symbol]: 1.131e-05 [renormalize]: 5.79981e-07 [validate]: 4.922e-05 Sums bootstrap : 0.000368s : 0.53% type_inference : 0.061290s : 87.76% event_method : 0.000021s : 0.03% auto_monad : 0.000069s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000396s : 0.57% rewriter_before_opt_a : 0.000087s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000121s : 0.17% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000823s : 1.18% jit_opt_a.with_stream_mark : 0.000034s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.004042s : 5.79% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000045s : 0.06% jit_opt_a.replace_applicator : 0.000031s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000037s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000820s : 1.17% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000452s : 0.65% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000496s : 0.71% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000271 24 1.21% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 84.45% : 0.000229s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 5.54% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061193 2 95.30% : 0.058314s : 1: type_inference.infer 4.70% : 0.002879s : 1: type_inference.specialize ------[replace.] 0.000091 6 66.98% : 0.000061s : 4: replace.inline 33.02% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 6 94.21% : 0.000227s : 4: match.inline 5.79% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 2.51% : 0.000004s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000001s : 12: predicate.compare_switch_simplify 1.02% : 0.000002s : 12: predicate.depend_value_elim 0.98% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.94% : 0.000007s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 8: predicate.less_batch_normalization 1.70% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 12: predicate.merge_addn 0.98% : 0.000001s : 12: predicate.minmaximum_grad 1.72% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.56% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.58% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000011s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.07% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002878 26 68.55% : 0.001973s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.86% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.58% : 0.000851s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079726 72 0.07% : 0.000054s : 1: add_recomputation 0.09% : 0.000072s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.49% : 0.000387s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 12.17% : 0.009705s : 1: jit_opt_a 0.20% : 0.000160s : 1: jit_opt_after_cconv 0.08% : 0.000061s : 1: jit_opt_b 0.58% : 0.000459s : 1: loop_unroll 1.04% : 0.000828s : 1: mutable_eliminate 1.43% : 0.001136s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000402s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.95% : 0.002348s : 1: renormalize.infer 2.11% : 0.001681s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.12% : 0.000092s : 1: rewriter_before_opt_a 0.13% : 0.000102s : 1: symbol_engine_optimizer 76.90% : 0.061312s : 1: type_inference TotalTime = 0.154326, [30] [bootstrap]: 0.00027491 [type_inference]: 0.121245 [event_method]: 0.000434 [auto_monad]: 0.00011142 [graph_reusing]: 7.41001e-06 [pre_auto_parallel]: 3.43999e-06 [py_interpret_to_execute]: 4.279e-05 [rewriter_before_opt_a]: 0.0001238 [expand_dump_flag]: 3.05002e-06 [jit_opt_a]: 0.0297792, [3] [Cycle 1]: 0.0160059, [27] [switch_simplify]: 7.417e-05 [loop_unroll]: 4.376e-05 [a_1]: 0.00097861 [with_stream_mark]: 3.234e-05 [recompute_prepare]: 2.168e-05 [updatestate_depend_eliminate]: 9.14e-06 [updatestate_assign_eliminate]: 7.2e-06 [updatestate_loads_eliminate]: 6.84999e-06 [parameter_eliminate]: 2.43998e-06 [specialize_transform]: 1.452e-05 [updatestate_useless_node_eliminater]: 1.319e-05 [accelerated_algorithm]: 1.308e-05 [meta_shard_fg_expand]: 4.23999e-06 [get_grad_eliminate_]: 5.298e-05 [merge_forward]: 9.76998e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.955e-05 [j_node_and_user_rematch]: 2.578e-05 [meta_fg_expand]: 0.00180824 [replace_old_param]: 7.433e-05 [inline_without_move]: 5.994e-05 [renormalize]: 0.0120144 [add_forward_monad_depend]: 1.292e-05 [auto_monad_grad]: 7.07002e-06 [auto_monad_eliminator]: 6.503e-05 [cse]: 0.00026407 [replace_applicator]: 9.511e-05 [Cycle 2]: 0.00995677, [27] [switch_simplify]: 4.575e-05 [loop_unroll]: 4.366e-05 [a_1]: 0.0012159 [with_stream_mark]: 2.129e-05 [recompute_prepare]: 1.279e-05 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 4.15999e-06 [updatestate_loads_eliminate]: 4.45999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 8.80001e-06 [updatestate_useless_node_eliminater]: 8.27998e-06 [accelerated_algorithm]: 8.05e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 7.88999e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.917e-05 [j_node_and_user_rematch]: 1.32e-05 [meta_fg_expand]: 9.962e-05 [replace_old_param]: 9.59e-06 [inline_without_move]: 8.93002e-06 [renormalize]: 0.00808099 [add_forward_monad_depend]: 1.082e-05 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 2.292e-05 [cse]: 3.425e-05 [replace_applicator]: 2.252e-05 [Cycle 3]: 0.00032977, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.21002e-06 [a_1]: 7.814e-05 [with_stream_mark]: 1.399e-05 [recompute_prepare]: 4.67e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.57998e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 4.33001e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 3.11999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.726e-05 [j_node_and_user_rematch]: 8.07e-06 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 4.47998e-06 [inline_without_move]: 4.27e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.215e-05 [replace_applicator]: 4.59002e-06 [py_interpret_to_execute_after_opt_a]: 1.509e-05 [rewriter_after_opt_a]: 3.857e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 4.62998e-06 [mutable_eliminate]: 0.00072867 [jit_opt_b]: 4.768e-05, [1] [Cycle 1]: 4.001e-05, [2] [frontend_op_eliminate]: 1.31e-05 [inline_after_opt_a]: 1.443e-05 [cconv]: 2.589e-05 [loop_unroll]: 0.00041453 [jit_opt_after_cconv]: 0.00014104, [1] [Cycle 1]: 0.00013531, [11] [c_1]: 1.645e-05 [parameter_eliminate]: 2.75997e-06 [updatestate_depend_eliminate]: 7.01999e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.164e-05 [call_graph_tuple_transform]: 1.866e-05 [tuple_list_get_item_eliminator]: 4.81002e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 5.24003e-06 [remove_dup_value]: 1.729e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 6.63998e-06 [add_recomputation]: 4.675e-05 [cse_after_recomputation]: 2.242e-05, [1] [Cycle 1]: 1.721e-05, [1] [cse]: 1.103e-05 [auto_monad_reorder]: 1.524e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00044545 [symbol_engine_optimizer]: 7.207e-05, [1] [Cycle 1]: 6.556e-05, [6] [build]: 4.07998e-06 [elim_shapecalc]: 6.93998e-06 [elim_not_effective]: 1.178e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 7.31999e-06 [renormalize]: 4.30009e-07 [validate]: 3.92e-05 Sums bootstrap : 0.000275s : 0.18% type_inference : 0.121245s : 80.89% event_method : 0.000434s : 0.29% auto_monad : 0.000111s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000043s : 0.03% rewriter_before_opt_a : 0.000124s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000093s : 0.06% jit_opt_a.a_1 : 0.002273s : 1.52% jit_opt_a.with_stream_mark : 0.000068s : 0.05% jit_opt_a.recompute_prepare : 0.000039s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000065s : 0.04% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.001911s : 1.27% jit_opt_a.replace_old_param : 0.000088s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.05% jit_opt_a.renormalize : 0.020095s : 13.41% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000094s : 0.06% jit_opt_a.cse : 0.000310s : 0.21% jit_opt_a.replace_applicator : 0.000122s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000729s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000415s : 0.28% jit_opt_after_cconv.c_1 : 0.000016s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000047s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000445s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000593 112 0.31% : 0.000002s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 0.81% : 0.000005s : 2: substitution.graph_param_transform 64.93% : 0.000385s : 13: substitution.inline 2.92% : 0.000017s : 2: substitution.inline_without_move 1.82% : 0.000011s : 14: substitution.j_node_and_user_rematch 2.01% : 0.000012s : 7: substitution.minmaximum_grad 1.25% : 0.000007s : 5: substitution.partial_eliminate 2.21% : 0.000013s : 14: substitution.remove_not_recompute_node 5.24% : 0.000031s : 10: substitution.replace_applicator 1.71% : 0.000010s : 10: substitution.replace_old_param 1.23% : 0.000007s : 1: substitution.reshape_eliminate 0.47% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.13% : 0.000007s : 1: substitution.tile_eliminate 3.86% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.61% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.30% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121140 2 97.50% : 0.118117s : 1: type_inference.infer 2.50% : 0.003024s : 1: type_inference.specialize ------[replace.] 0.000176 20 66.01% : 0.000116s : 13: replace.inline 33.99% : 0.000060s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000398 20 94.71% : 0.000377s : 13: match.inline 5.29% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000390 2740 1.55% : 0.000006s : 47: predicate.accumulaten_eliminater 0.29% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.49% : 0.000006s : 47: predicate.addn_check_dump 1.65% : 0.000006s : 47: predicate.addn_zero_filter 2.02% : 0.000008s : 47: predicate.arithmetic_simplify 1.51% : 0.000006s : 47: predicate.cast_eliminate 0.10% : 0.000000s : 2: predicate.check_bprop_eliminate 1.40% : 0.000005s : 47: predicate.compare_switch_simplify 1.53% : 0.000006s : 47: predicate.depend_value_elim 1.48% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.51% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.29% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.22% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.52% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.41% : 0.000006s : 47: predicate.environ_get_depend_swap 1.51% : 0.000006s : 47: predicate.environ_get_eliminate 1.49% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.83% : 0.000003s : 20: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.20% : 0.000016s : 71: predicate.inline 2.18% : 0.000008s : 48: predicate.inline_without_move 0.37% : 0.000001s : 20: predicate.j_node_and_user_rematch 0.95% : 0.000004s : 20: predicate.less_batch_normalization 1.80% : 0.000007s : 54: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 56: predicate.load_eliminater 0.38% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.42% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.73% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.53% : 0.000006s : 47: predicate.merge_addn 1.54% : 0.000006s : 47: predicate.minmaximum_grad 0.37% : 0.000001s : 2: predicate.mutable_eliminate 0.14% : 0.000001s : 2: predicate.opt_reshape 2.24% : 0.000009s : 56: predicate.partial_eliminate 1.48% : 0.000006s : 47: predicate.print_const_string_wrapper 1.97% : 0.000008s : 47: predicate.reduce_eliminate 1.82% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 20: predicate.remove_not_recompute_node 2.85% : 0.000011s : 103: predicate.replace_applicator 1.14% : 0.000004s : 48: predicate.replace_old_param 0.09% : 0.000000s : 2: predicate.reset_defer_inline 1.62% : 0.000006s : 47: predicate.reshape_eliminate 1.55% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 2: predicate.row_tensor_eliminate 1.59% : 0.000006s : 47: predicate.same_eliminate 0.59% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 4: predicate.special_op_eliminate 0.85% : 0.000003s : 20: predicate.specialize_transform 1.70% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 47: predicate.stack_unstack_eliminate 0.09% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.76% : 0.000011s : 67: predicate.switch_defer_inline 2.43% : 0.000009s : 67: predicate.switch_layer_defer_inline 6.51% : 0.000025s : 164: predicate.switch_simplify 1.60% : 0.000006s : 47: predicate.tile_eliminate 1.53% : 0.000006s : 47: predicate.transpose_eliminate 1.94% : 0.000008s : 47: predicate.tuple_list_convert_item_index_to_positive 1.83% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000013s : 58: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 47: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 54: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.81% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.97% : 0.000008s : 47: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.17% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003935 45 74.92% : 0.002948s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.08% : 0.000987s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.177454 87 0.03% : 0.000049s : 1: add_recomputation 0.07% : 0.000119s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.17% : 0.000300s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.25% : 0.000443s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 16.78% : 0.029783s : 1: jit_opt_a 0.08% : 0.000143s : 1: jit_opt_after_cconv 0.03% : 0.000050s : 1: jit_opt_b 0.24% : 0.000423s : 1: loop_unroll 0.42% : 0.000738s : 1: mutable_eliminate 1.70% : 0.003019s : 39: opt.transform.jit_opt_a 0.02% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000022s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000029s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000454s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 10.00% : 0.017738s : 2: renormalize.infer 1.32% : 0.002334s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000127s : 1: rewriter_before_opt_a 0.04% : 0.000074s : 1: symbol_engine_optimizer 68.34% : 0.121268s : 1: type_inference TotalTime = 0.0961778, [30] [bootstrap]: 0.00032216 [type_inference]: 0.085055 [event_method]: 0.00033025 [auto_monad]: 0.00012021 [graph_reusing]: 8.13001e-06 [pre_auto_parallel]: 3.2e-06 [py_interpret_to_execute]: 4.012e-05 [rewriter_before_opt_a]: 0.00013434 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00794483, [2] [Cycle 1]: 0.00395477, [27] [switch_simplify]: 0.00016473 [loop_unroll]: 5.952e-05 [a_1]: 0.00133514 [with_stream_mark]: 1.755e-05 [recompute_prepare]: 9.79999e-06 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4.22003e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.581e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00202106 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 2.14999e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.295e-05 [replace_applicator]: 1.589e-05 [Cycle 2]: 0.00033995, [27] [switch_simplify]: 6.56e-06 [loop_unroll]: 5.41002e-06 [a_1]: 9.902e-05 [with_stream_mark]: 1.054e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 5.21002e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.207e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.003e-05 [rewriter_after_opt_a]: 3.588e-05 [convert_after_rewriter]: 7.45998e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00059773 [jit_opt_b]: 5.231e-05, [1] [Cycle 1]: 4.524e-05, [2] [frontend_op_eliminate]: 1.727e-05 [inline_after_opt_a]: 1.668e-05 [cconv]: 2.524e-05 [loop_unroll]: 0.00041888 [jit_opt_after_cconv]: 0.00014426, [1] [Cycle 1]: 0.0001377, [11] [c_1]: 2.27e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.08e-05 [call_graph_tuple_transform]: 1.841e-05 [tuple_list_get_item_eliminator]: 5.78002e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.74e-06 [remove_dup_value]: 1.655e-05 [partial_unused_args_eliminate]: 2.55002e-06 [environ_conv]: 5.99999e-06 [add_recomputation]: 4.895e-05 [cse_after_recomputation]: 2.344e-05, [1] [Cycle 1]: 1.783e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.669e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.79002e-06 [opt_after_jit_grad]: 0.00046125 [symbol_engine_optimizer]: 0.00011958, [1] [Cycle 1]: 0.00011275, [6] [build]: 4.10998e-06 [elim_shapecalc]: 9.25001e-06 [elim_not_effective]: 1.297e-05 [opt_reshape]: 6.06998e-06 [fold_const_symbol]: 4.919e-05 [renormalize]: 3.00002e-07 [validate]: 4.207e-05 Sums bootstrap : 0.000322s : 0.35% type_inference : 0.085055s : 92.52% event_method : 0.000330s : 0.36% auto_monad : 0.000120s : 0.13% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.04% rewriter_before_opt_a : 0.000134s : 0.15% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000171s : 0.19% jit_opt_a.loop_unroll : 0.000065s : 0.07% jit_opt_a.a_1 : 0.001434s : 1.56% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002021s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000045s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000598s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000419s : 0.46% jit_opt_after_cconv.c_1 : 0.000023s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000049s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.05% Time group info: ------[substitution.] 0.000549 35 0.33% : 0.000002s : 2: substitution.elim_not_effective 7.14% : 0.000039s : 2: substitution.fold_const_symbol 1.03% : 0.000006s : 3: substitution.graph_param_transform 83.72% : 0.000460s : 12: substitution.inline 0.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.96% : 0.000005s : 4: substitution.remove_not_recompute_node 0.72% : 0.000004s : 2: substitution.replace_old_param 1.59% : 0.000009s : 1: substitution.reshape_eliminate 2.03% : 0.000011s : 3: substitution.switch_simplify 1.84% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.084971 2 96.61% : 0.082095s : 1: type_inference.infer 3.39% : 0.002877s : 1: type_inference.specialize ------[replace.] 0.000273 18 54.12% : 0.000148s : 12: replace.inline 1.83% : 0.000005s : 1: replace.reshape_eliminate 18.59% : 0.000051s : 3: replace.switch_simplify 25.46% : 0.000070s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000480 18 94.54% : 0.000454s : 12: match.inline 1.60% : 0.000008s : 1: match.reshape_eliminate 2.00% : 0.000010s : 3: match.switch_simplify 1.86% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000205 1212 1.41% : 0.000003s : 19: predicate.accumulaten_eliminater 0.54% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000003s : 19: predicate.addn_check_dump 1.45% : 0.000003s : 19: predicate.addn_zero_filter 2.10% : 0.000004s : 19: predicate.arithmetic_simplify 1.64% : 0.000003s : 20: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.32% : 0.000003s : 19: predicate.compare_switch_simplify 1.32% : 0.000003s : 19: predicate.depend_value_elim 1.35% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.45% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.51% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.53% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.40% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.34% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.34% : 0.000003s : 20: predicate.environ_get_depend_swap 1.50% : 0.000003s : 20: predicate.environ_get_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.64% : 0.000001s : 6: predicate.get_grad_eliminate 0.15% : 0.000000s : 3: predicate.graph_param_transform 5.02% : 0.000010s : 40: predicate.inline 0.54% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.93% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.80% : 0.000004s : 25: predicate.load_eliminater 0.80% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.52% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.85% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.39% : 0.000003s : 19: predicate.merge_addn 1.38% : 0.000003s : 19: predicate.minmaximum_grad 0.88% : 0.000002s : 3: predicate.mutable_eliminate 0.28% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000004s : 25: predicate.partial_eliminate 1.42% : 0.000003s : 19: predicate.print_const_string_wrapper 1.73% : 0.000004s : 19: predicate.reduce_eliminate 1.56% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.31% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000003s : 28: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.16% : 0.000000s : 3: predicate.reset_defer_inline 2.01% : 0.000004s : 20: predicate.reshape_eliminate 1.60% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.45% : 0.000001s : 3: predicate.row_tensor_eliminate 1.40% : 0.000003s : 19: predicate.same_eliminate 0.32% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.63% : 0.000001s : 6: predicate.special_op_eliminate 0.54% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.22% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.11% : 0.000006s : 34: predicate.switch_defer_inline 2.70% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.59% : 0.000018s : 107: predicate.switch_simplify 1.44% : 0.000003s : 19: predicate.tile_eliminate 1.50% : 0.000003s : 19: predicate.transpose_eliminate 1.70% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.32% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.78% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.70% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.48% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.81% : 0.000004s : 19: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.44% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002945 40 64.17% : 0.001890s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.42% : 0.000248s : 5: func_graph_cloner_run.FuncGraphClonerNode 27.40% : 0.000807s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.100087 72 0.05% : 0.000052s : 1: add_recomputation 0.13% : 0.000126s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.34% : 0.000339s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.34% : 0.000337s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 7.94% : 0.007948s : 1: jit_opt_a 0.15% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.43% : 0.000425s : 1: loop_unroll 0.60% : 0.000605s : 1: mutable_eliminate 1.80% : 0.001798s : 26: opt.transform.jit_opt_a 0.05% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000074s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.44% : 0.001438s : 1: renormalize.infer 0.57% : 0.000574s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000039s : 1: rewriter_after_opt_a 0.14% : 0.000137s : 1: rewriter_before_opt_a 0.12% : 0.000123s : 1: symbol_engine_optimizer 85.00% : 0.085069s : 1: type_inference TotalTime = 0.148453, [30] [bootstrap]: 0.00041909 [type_inference]: 0.135305 [event_method]: 2.128e-05 [auto_monad]: 6.767e-05 [graph_reusing]: 5.17e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00061712 [rewriter_before_opt_a]: 8.656e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00929342, [2] [Cycle 1]: 0.00504316, [27] [switch_simplify]: 5.461e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00059063 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 8.37998e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 1.048e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00400949 [add_forward_monad_depend]: 1.194e-05 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 1.614e-05 [cse]: 2.665e-05 [replace_applicator]: 2.056e-05 [Cycle 2]: 0.00039912, [27] [switch_simplify]: 7.95e-06 [loop_unroll]: 6.64001e-06 [a_1]: 0.00013667 [with_stream_mark]: 1.318e-05 [recompute_prepare]: 5.79999e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 3.71001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.96998e-06 [inline_without_move]: 6.02999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.43003e-06 [cse]: 1.19e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.431e-05 [rewriter_after_opt_a]: 3.792e-05 [convert_after_rewriter]: 7.54002e-06 [order_py_execute_after_rewriter]: 5.62999e-06 [mutable_eliminate]: 0.00079844 [jit_opt_b]: 6.199e-05, [1] [Cycle 1]: 5.474e-05, [2] [frontend_op_eliminate]: 2.299e-05 [inline_after_opt_a]: 1.996e-05 [cconv]: 2.277e-05 [loop_unroll]: 0.0004887 [jit_opt_after_cconv]: 0.00016973, [1] [Cycle 1]: 0.00016259, [11] [c_1]: 2.82e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 4.3e-06 [updatestate_loads_eliminate]: 2.61999e-06 [cse]: 2.459e-05 [call_graph_tuple_transform]: 2.412e-05 [tuple_list_get_item_eliminator]: 8.77e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.42001e-06 [remove_dup_value]: 1.438e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.03999e-06 [add_recomputation]: 5.611e-05 [cse_after_recomputation]: 2.595e-05, [1] [Cycle 1]: 1.999e-05, [1] [cse]: 1.341e-05 [auto_monad_reorder]: 1.511e-05 [get_jit_bprop_graph]: 1.86003e-06 [rewriter_after_jit_bprop_graph]: 6.81999e-06 [opt_after_jit_grad]: 0.0005157 [symbol_engine_optimizer]: 0.00012511, [1] [Cycle 1]: 0.00011839, [6] [build]: 3.26999e-06 [elim_shapecalc]: 4.899e-05 [elim_not_effective]: 1.434e-05 [opt_reshape]: 9.41e-06 [fold_const_symbol]: 1.263e-05 [renormalize]: 3.19997e-07 [validate]: 4.478e-05 Sums bootstrap : 0.000419s : 0.29% type_inference : 0.135305s : 93.98% event_method : 0.000021s : 0.01% auto_monad : 0.000068s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000617s : 0.43% rewriter_before_opt_a : 0.000087s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.04% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000727s : 0.51% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004010s : 2.78% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000798s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000489s : 0.34% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000516s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000049s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000205 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 1.08% : 0.000002s : 2: substitution.fold_const_symbol 3.01% : 0.000006s : 4: substitution.graph_param_transform 83.54% : 0.000171s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000004s : 2: substitution.replace_old_param 4.97% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.135208 2 96.95% : 0.131081s : 1: type_inference.infer 3.05% : 0.004126s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.13% : 0.000053s : 4: replace.inline 33.87% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 94.92% : 0.000169s : 4: match.inline 5.08% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.26% : 0.000003s : 12: predicate.arithmetic_simplify 1.67% : 0.000002s : 12: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.75% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.58% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.32% : 0.000006s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 18: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 1.03% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 18: predicate.partial_eliminate 1.04% : 0.000001s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.60% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.52% : 0.000004s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.44% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.10% : 0.000002s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.51% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000010s : 58: predicate.switch_simplify 1.55% : 0.000002s : 12: predicate.tile_eliminate 1.46% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002693 22 63.29% : 0.001704s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.17% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.54% : 0.000957s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153552 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000071s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.29% : 0.000442s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 6.05% : 0.009298s : 1: jit_opt_a 0.11% : 0.000173s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.32% : 0.000496s : 1: loop_unroll 0.53% : 0.000807s : 1: mutable_eliminate 0.63% : 0.000970s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000082s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000022s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000622s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.94% : 0.002973s : 1: renormalize.infer 0.67% : 0.001026s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000091s : 1: rewriter_before_opt_a 0.08% : 0.000128s : 1: symbol_engine_optimizer 88.13% : 0.135322s : 1: type_inference TotalTime = 0.138643, [30] [bootstrap]: 0.00033166 [type_inference]: 0.125143 [event_method]: 2.22e-05 [auto_monad]: 7.172e-05 [graph_reusing]: 5.19003e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00099296 [rewriter_before_opt_a]: 0.00010539 [expand_dump_flag]: 3.77002e-06 [jit_opt_a]: 0.00939711, [2] [Cycle 1]: 0.00522657, [27] [switch_simplify]: 5.689e-05 [loop_unroll]: 3.393e-05 [a_1]: 0.00072404 [with_stream_mark]: 1.315e-05 [recompute_prepare]: 8.58001e-06 [updatestate_depend_eliminate]: 3.46001e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 7.13998e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.337e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 6.86001e-06 [renormalize]: 0.00407118 [add_forward_monad_depend]: 6.91999e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 1.288e-05 [cse]: 2.204e-05 [replace_applicator]: 1.701e-05 [Cycle 2]: 0.00038726, [27] [switch_simplify]: 7.48999e-06 [loop_unroll]: 6.95998e-06 [a_1]: 0.00012827 [with_stream_mark]: 1.08e-05 [recompute_prepare]: 6.77002e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.39003e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.48001e-06 [inline_without_move]: 6.19999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.401e-05 [replace_applicator]: 6.59999e-06 [py_interpret_to_execute_after_opt_a]: 1.507e-05 [rewriter_after_opt_a]: 3.72e-05 [convert_after_rewriter]: 7.9e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00063501 [jit_opt_b]: 5.586e-05, [1] [Cycle 1]: 4.972e-05, [2] [frontend_op_eliminate]: 2.016e-05 [inline_after_opt_a]: 1.854e-05 [cconv]: 1.549e-05 [loop_unroll]: 0.00041742 [jit_opt_after_cconv]: 0.00015288, [1] [Cycle 1]: 0.00014692, [11] [c_1]: 2.681e-05 [parameter_eliminate]: 2.28002e-06 [updatestate_depend_eliminate]: 5.99999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.339e-05 [call_graph_tuple_transform]: 2.001e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.81999e-06 [remove_dup_value]: 1.336e-05 [partial_unused_args_eliminate]: 1.40001e-06 [environ_conv]: 5.69e-06 [add_recomputation]: 3.306e-05 [cse_after_recomputation]: 2.426e-05, [1] [Cycle 1]: 1.937e-05, [1] [cse]: 1.349e-05 [auto_monad_reorder]: 1.565e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 5.12999e-06 [opt_after_jit_grad]: 0.00078853 [symbol_engine_optimizer]: 0.00010516, [1] [Cycle 1]: 9.878e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 9.52999e-06 [elim_not_effective]: 1.337e-05 [opt_reshape]: 7.41999e-06 [fold_const_symbol]: 3.405e-05 [renormalize]: 5.50004e-07 [validate]: 4.964e-05 Sums bootstrap : 0.000332s : 0.25% type_inference : 0.125143s : 93.20% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000993s : 0.74% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000852s : 0.63% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004071s : 3.03% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000635s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000015s : 0.01% loop_unroll : 0.000417s : 0.31% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000033s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000789s : 0.59% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000034s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000295 25 0.46% : 0.000001s : 2: substitution.elim_not_effective 8.45% : 0.000025s : 2: substitution.fold_const_symbol 1.58% : 0.000005s : 4: substitution.graph_param_transform 81.26% : 0.000239s : 5: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.65% : 0.000005s : 4: substitution.remove_not_recompute_node 1.13% : 0.000003s : 2: substitution.replace_old_param 4.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125062 2 96.40% : 0.120554s : 1: type_inference.infer 3.60% : 0.004508s : 1: type_inference.specialize ------[replace.] 0.000114 7 67.19% : 0.000077s : 5: replace.inline 32.81% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 7 95.42% : 0.000237s : 5: match.inline 4.58% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.44% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.80% : 0.000003s : 13: predicate.addn_zero_filter 2.22% : 0.000003s : 13: predicate.arithmetic_simplify 1.65% : 0.000002s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.08% : 0.000007s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 19: predicate.partial_eliminate 1.41% : 0.000002s : 13: predicate.print_const_string_wrapper 1.89% : 0.000003s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.30% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.67% : 0.000010s : 64: predicate.switch_simplify 1.46% : 0.000002s : 13: predicate.tile_eliminate 1.44% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.90% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002832 25 59.06% : 0.001672s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.69% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.26% : 0.001083s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143904 72 0.02% : 0.000036s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000346s : 1: bootstrap 0.01% : 0.000018s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.53% : 0.009401s : 1: jit_opt_a 0.11% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.29% : 0.000424s : 1: loop_unroll 0.45% : 0.000642s : 1: mutable_eliminate 0.77% : 0.001102s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000061s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000796s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.70% : 0.001003s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 2.13% : 0.003058s : 1: renormalize.infer 0.70% : 0.001004s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.08% : 0.000108s : 1: symbol_engine_optimizer 86.97% : 0.125156s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.258.790 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.259.532 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0286335, [30] [bootstrap]: 0.00028248 [type_inference]: 0.0198027 [event_method]: 2.119e-05 [auto_monad]: 6.672e-05 [graph_reusing]: 5.93002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 9.052e-05 [rewriter_before_opt_a]: 8.212e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00570573, [2] [Cycle 1]: 0.00202547, [27] [switch_simplify]: 5.978e-05 [loop_unroll]: 2.937e-05 [a_1]: 0.00062176 [with_stream_mark]: 2.288e-05 [recompute_prepare]: 8.90001e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00092916 [add_forward_monad_depend]: 5.46998e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.645e-05 [cse]: 3.806e-05 [replace_applicator]: 1.484e-05 [Cycle 2]: 0.00033602, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.231e-05 [with_stream_mark]: 1.115e-05 [recompute_prepare]: 5.89999e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.73001e-06 [inline_without_move]: 5.34e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.428e-05 [replace_applicator]: 5.49998e-06 [py_interpret_to_execute_after_opt_a]: 1.534e-05 [rewriter_after_opt_a]: 4e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00064099 [jit_opt_b]: 5.028e-05, [1] [Cycle 1]: 4.339e-05, [2] [frontend_op_eliminate]: 1.503e-05 [inline_after_opt_a]: 1.648e-05 [cconv]: 2.808e-05 [loop_unroll]: 0.00044326 [jit_opt_after_cconv]: 0.00014858, [1] [Cycle 1]: 0.0001421, [11] [c_1]: 1.953e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 6.81999e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.649e-05 [call_graph_tuple_transform]: 1.99e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.92999e-06 [renormalize]: 6.90023e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.639e-05 [partial_unused_args_eliminate]: 2.77002e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 6.746e-05 [cse_after_recomputation]: 2.503e-05, [1] [Cycle 1]: 1.949e-05, [1] [cse]: 1.311e-05 [auto_monad_reorder]: 1.827e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.81998e-06 [opt_after_jit_grad]: 0.0007496 [symbol_engine_optimizer]: 7.265e-05, [1] [Cycle 1]: 6.595e-05, [6] [build]: 4.67e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.291e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 8.15999e-06 [renormalize]: 3.89991e-07 [validate]: 4.102e-05 Sums bootstrap : 0.000282s : 1.14% type_inference : 0.019803s : 80.22% event_method : 0.000021s : 0.09% auto_monad : 0.000067s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000091s : 0.37% rewriter_before_opt_a : 0.000082s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.27% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000714s : 2.89% jit_opt_a.with_stream_mark : 0.000034s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000929s : 3.76% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000052s : 0.21% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000641s : 2.60% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000028s : 0.11% loop_unroll : 0.000443s : 1.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000067s : 0.27% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000750s : 3.04% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.17% Time group info: ------[substitution.] 0.000240 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 84.07% : 0.000202s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 2.87% : 0.000007s : 2: substitution.replace_old_param 5.65% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019730 2 92.87% : 0.018323s : 1: type_inference.infer 7.13% : 0.001407s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.51% : 0.000048s : 4: replace.inline 32.49% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.20% : 0.000199s : 4: match.inline 5.80% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 691 0.95% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.81% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 1.62% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 0.81% : 0.000001s : 10: predicate.compare_switch_simplify 0.94% : 0.000001s : 10: predicate.depend_value_elim 0.82% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.92% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.01% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.40% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.90% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.80% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.80% : 0.000001s : 10: predicate.environ_get_depend_swap 0.89% : 0.000001s : 10: predicate.environ_get_eliminate 0.82% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.70% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 15.04% : 0.000023s : 22: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.82% : 0.000001s : 6: predicate.less_batch_normalization 0.98% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.36% : 0.000002s : 15: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.37% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.79% : 0.000001s : 10: predicate.merge_addn 0.81% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000003s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 1.72% : 0.000003s : 15: predicate.partial_eliminate 0.98% : 0.000002s : 10: predicate.print_const_string_wrapper 1.19% : 0.000002s : 10: predicate.reduce_eliminate 1.01% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.36% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000000s : 3: predicate.reset_defer_inline 0.94% : 0.000001s : 10: predicate.reshape_eliminate 0.91% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.49% : 0.000001s : 3: predicate.row_tensor_eliminate 0.92% : 0.000001s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.64% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.02% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 14.34% : 0.000022s : 10: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 1.99% : 0.000003s : 16: predicate.switch_defer_inline 1.60% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.02% : 0.000009s : 53: predicate.switch_simplify 0.92% : 0.000001s : 10: predicate.tile_eliminate 0.91% : 0.000001s : 10: predicate.transpose_eliminate 0.99% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.91% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.10% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.09% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.27% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.01% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.28% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.46% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 13 45.84% : 0.000368s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.57% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.60% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030554 72 0.23% : 0.000071s : 1: add_recomputation 0.23% : 0.000070s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 0.99% : 0.000301s : 1: bootstrap 0.10% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.68% : 0.005709s : 1: jit_opt_a 0.50% : 0.000151s : 1: jit_opt_after_cconv 0.17% : 0.000053s : 1: jit_opt_b 1.48% : 0.000452s : 1: loop_unroll 2.13% : 0.000651s : 1: mutable_eliminate 3.08% : 0.000940s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.49% : 0.000761s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000094s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.77% : 0.000541s : 1: renormalize.infer 1.24% : 0.000380s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.28% : 0.000086s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 64.87% : 0.019821s : 1: type_inference TotalTime = 0.155829, [30] [bootstrap]: 0.00031333 [type_inference]: 0.139392 [event_method]: 2.388e-05 [auto_monad]: 7.992e-05 [graph_reusing]: 6.74001e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00080539 [rewriter_before_opt_a]: 9.856e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.0119715, [2] [Cycle 1]: 0.00653108, [27] [switch_simplify]: 7.683e-05 [loop_unroll]: 3.391e-05 [a_1]: 0.00074743 [with_stream_mark]: 2.103e-05 [recompute_prepare]: 1.097e-05 [updatestate_depend_eliminate]: 4.91997e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.06003e-06 [specialize_transform]: 7.73999e-06 [updatestate_useless_node_eliminater]: 6.59001e-06 [accelerated_algorithm]: 7.21001e-06 [meta_shard_fg_expand]: 2.86e-06 [get_grad_eliminate_]: 6.96001e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.782e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 3.22002e-06 [replace_old_param]: 1.267e-05 [inline_without_move]: 6.84001e-06 [renormalize]: 0.00522008 [add_forward_monad_depend]: 1.079e-05 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 2.254e-05 [cse]: 3.446e-05 [replace_applicator]: 2.715e-05 [Cycle 2]: 0.00044178, [27] [switch_simplify]: 8.96002e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00014738 [with_stream_mark]: 1.823e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 6.53e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 4.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.998e-05 [j_node_and_user_rematch]: 1.095e-05 [meta_fg_expand]: 3.12002e-06 [replace_old_param]: 1.114e-05 [inline_without_move]: 6.14001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 7.17002e-06 [cse]: 1.488e-05 [replace_applicator]: 6.96001e-06 [py_interpret_to_execute_after_opt_a]: 1.768e-05 [rewriter_after_opt_a]: 4.009e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 5.77999e-06 [mutable_eliminate]: 0.00104664 [jit_opt_b]: 6.785e-05, [1] [Cycle 1]: 5.92e-05, [2] [frontend_op_eliminate]: 2.372e-05 [inline_after_opt_a]: 2.284e-05 [cconv]: 3.119e-05 [loop_unroll]: 0.00055666 [jit_opt_after_cconv]: 0.00019268, [1] [Cycle 1]: 0.00018543, [11] [c_1]: 2.99e-05 [parameter_eliminate]: 4.58999e-06 [updatestate_depend_eliminate]: 1.062e-05 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.213e-05 [call_graph_tuple_transform]: 2.857e-05 [tuple_list_get_item_eliminator]: 7.51999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 7.2e-07 [switch_simplify]: 8.84e-06 [remove_dup_value]: 1.68e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 9.51998e-06 [add_recomputation]: 5.696e-05 [cse_after_recomputation]: 2.536e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.222e-05 [auto_monad_reorder]: 1.624e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 7.55998e-06 [opt_after_jit_grad]: 0.00060564 [symbol_engine_optimizer]: 9.188e-05, [1] [Cycle 1]: 8.454e-05, [6] [build]: 5.46998e-06 [elim_shapecalc]: 9.64e-06 [elim_not_effective]: 1.812e-05 [opt_reshape]: 9.44e-06 [fold_const_symbol]: 1.153e-05 [renormalize]: 5.10016e-07 [validate]: 0.00012282 Sums bootstrap : 0.000313s : 0.21% type_inference : 0.139392s : 92.84% event_method : 0.000024s : 0.02% auto_monad : 0.000080s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000805s : 0.54% rewriter_before_opt_a : 0.000099s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000895s : 0.60% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005220s : 3.48% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000049s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001047s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000023s : 0.02% cconv : 0.000031s : 0.02% loop_unroll : 0.000557s : 0.37% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000606s : 0.40% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000123s : 0.08% Time group info: ------[substitution.] 0.000295 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 1.03% : 0.000003s : 2: substitution.fold_const_symbol 2.58% : 0.000008s : 4: substitution.graph_param_transform 84.52% : 0.000250s : 4: substitution.inline 1.58% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000007s : 4: substitution.remove_not_recompute_node 1.87% : 0.000006s : 2: substitution.replace_old_param 5.24% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139288 2 96.54% : 0.134473s : 1: type_inference.infer 3.46% : 0.004815s : 1: type_inference.specialize ------[replace.] 0.000105 6 66.88% : 0.000070s : 4: replace.inline 33.12% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 6 94.50% : 0.000247s : 4: match.inline 5.50% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000164 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.57% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 2.27% : 0.000004s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 12: predicate.compare_switch_simplify 0.97% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.55% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.62% : 0.000003s : 12: predicate.environ_add_const_eliminate 0.91% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 4.84% : 0.000008s : 26: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000002s : 12: predicate.minmaximum_grad 2.47% : 0.000004s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 18: predicate.partial_eliminate 1.55% : 0.000003s : 12: predicate.print_const_string_wrapper 1.86% : 0.000003s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 12: predicate.reshape_eliminate 1.11% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.05% : 0.000002s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 12: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.24% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.07% : 0.000003s : 18: predicate.switch_defer_inline 2.49% : 0.000004s : 18: predicate.switch_layer_defer_inline 8.01% : 0.000013s : 58: predicate.switch_simplify 1.54% : 0.000003s : 12: predicate.tile_eliminate 1.74% : 0.000003s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.66% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.48% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003986 22 66.21% : 0.002639s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.27% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.52% : 0.001296s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.162260 72 0.04% : 0.000060s : 1: add_recomputation 0.05% : 0.000083s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.20% : 0.000330s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.38% : 0.011976s : 1: jit_opt_a 0.12% : 0.000195s : 1: jit_opt_after_cconv 0.04% : 0.000071s : 1: jit_opt_b 0.35% : 0.000565s : 1: loop_unroll 0.65% : 0.001059s : 1: mutable_eliminate 0.73% : 0.001186s : 26: opt.transform.jit_opt_a 0.04% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000026s : 1: opt.transform.mutable_eliminate 0.02% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000615s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000811s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 2.32% : 0.003762s : 1: renormalize.infer 0.89% : 0.001443s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000104s : 1: rewriter_before_opt_a 0.06% : 0.000095s : 1: symbol_engine_optimizer 85.92% : 0.139415s : 1: type_inference TotalTime = 0.0944944, [30] [bootstrap]: 0.00041315 [type_inference]: 0.0811368 [event_method]: 2.516e-05 [auto_monad]: 8.149e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00038249 [rewriter_before_opt_a]: 9.082e-05 [expand_dump_flag]: 4.07e-06 [jit_opt_a]: 0.00911233, [2] [Cycle 1]: 0.00434038, [27] [switch_simplify]: 6.583e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00071356 [with_stream_mark]: 2.428e-05 [recompute_prepare]: 1.08e-05 [updatestate_depend_eliminate]: 5.31002e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.37002e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 7.7e-06 [updatestate_useless_node_eliminater]: 6.83998e-06 [accelerated_algorithm]: 7.25e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 1.85001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.822e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 3.55e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 6.83998e-06 [renormalize]: 0.0030966 [add_forward_monad_depend]: 1.004e-05 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 2.181e-05 [cse]: 3.362e-05 [replace_applicator]: 2.251e-05 [Cycle 2]: 0.00043935, [27] [switch_simplify]: 7.73001e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00014547 [with_stream_mark]: 1.786e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 3.07002e-06 [get_grad_eliminate_]: 6.58003e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 4.1e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.95e-05 [j_node_and_user_rematch]: 1.215e-05 [meta_fg_expand]: 2.96001e-06 [replace_old_param]: 1.082e-05 [inline_without_move]: 6.74001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 7.6e-06 [cse]: 1.344e-05 [replace_applicator]: 8.54e-06 [py_interpret_to_execute_after_opt_a]: 1.678e-05 [rewriter_after_opt_a]: 5.131e-05 [convert_after_rewriter]: 8.67e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00092208 [jit_opt_b]: 7.022e-05, [1] [Cycle 1]: 6.071e-05, [2] [frontend_op_eliminate]: 2.531e-05 [inline_after_opt_a]: 2.146e-05 [cconv]: 3.352e-05 [loop_unroll]: 0.00058986 [jit_opt_after_cconv]: 0.00019602, [1] [Cycle 1]: 0.00018873, [11] [c_1]: 3.051e-05 [parameter_eliminate]: 4.94e-06 [updatestate_depend_eliminate]: 9.94999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 3.285e-05 [call_graph_tuple_transform]: 3.148e-05 [tuple_list_get_item_eliminator]: 7.53e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 7.49002e-06 [remove_dup_value]: 1.747e-05 [partial_unused_args_eliminate]: 3.85998e-06 [environ_conv]: 9.62999e-06 [add_recomputation]: 6.683e-05 [cse_after_recomputation]: 2.842e-05, [1] [Cycle 1]: 2.118e-05, [1] [cse]: 1.366e-05 [auto_monad_reorder]: 1.634e-05 [get_jit_bprop_graph]: 0.00017209 [rewriter_after_jit_bprop_graph]: 1.158e-05 [opt_after_jit_grad]: 0.00064668 [symbol_engine_optimizer]: 9.328e-05, [1] [Cycle 1]: 8.599e-05, [6] [build]: 4.95001e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.952e-05 [opt_reshape]: 9.04e-06 [fold_const_symbol]: 1.158e-05 [renormalize]: 7.40023e-07 [validate]: 6.272e-05 Sums bootstrap : 0.000413s : 0.46% type_inference : 0.081137s : 90.68% event_method : 0.000025s : 0.03% auto_monad : 0.000081s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000382s : 0.43% rewriter_before_opt_a : 0.000091s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.08% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000859s : 0.96% jit_opt_a.with_stream_mark : 0.000042s : 0.05% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.03% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.02% jit_opt_a.renormalize : 0.003097s : 3.46% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.03% jit_opt_a.cse : 0.000047s : 0.05% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000051s : 0.06% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000922s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.04% loop_unroll : 0.000590s : 0.66% jit_opt_after_cconv.c_1 : 0.000031s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000067s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000172s : 0.19% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000647s : 0.72% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.07% Time group info: ------[substitution.] 0.000293 24 0.98% : 0.000003s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 3.09% : 0.000009s : 4: substitution.graph_param_transform 84.00% : 0.000246s : 4: substitution.inline 1.63% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000007s : 4: substitution.remove_not_recompute_node 1.93% : 0.000006s : 2: substitution.replace_old_param 5.33% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.081024 2 96.37% : 0.078083s : 1: type_inference.infer 3.63% : 0.002942s : 1: type_inference.specialize ------[replace.] 0.000098 6 66.21% : 0.000065s : 4: replace.inline 33.79% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 6 94.37% : 0.000243s : 4: match.inline 5.63% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 1.54% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000001s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 2.26% : 0.000004s : 12: predicate.arithmetic_simplify 1.54% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 0.94% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.58% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.65% : 0.000003s : 12: predicate.environ_add_const_eliminate 0.90% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.87% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 0.91% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.41% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.77% : 0.000003s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.15% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 12: predicate.merge_addn 0.92% : 0.000001s : 12: predicate.minmaximum_grad 1.80% : 0.000003s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 1.97% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 2.20% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000002s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.40% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.19% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.80% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 18: predicate.switch_defer_inline 1.78% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.65% : 0.000011s : 58: predicate.switch_simplify 2.00% : 0.000003s : 12: predicate.tile_eliminate 1.97% : 0.000003s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.63% : 0.000003s : 12: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.57% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002963 22 69.83% : 0.002069s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.30% : 0.000838s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.098790 72 0.07% : 0.000070s : 1: add_recomputation 0.09% : 0.000085s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.44% : 0.000430s : 1: bootstrap 0.04% : 0.000036s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.18% : 0.000176s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.23% : 0.009117s : 1: jit_opt_a 0.20% : 0.000199s : 1: jit_opt_after_cconv 0.07% : 0.000073s : 1: jit_opt_b 0.61% : 0.000598s : 1: loop_unroll 0.94% : 0.000931s : 1: mutable_eliminate 1.15% : 0.001133s : 26: opt.transform.jit_opt_a 0.07% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000039s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.03% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000655s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000387s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 2.18% : 0.002151s : 1: renormalize.infer 0.94% : 0.000933s : 1: renormalize.specialize 0.01% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000055s : 1: rewriter_after_opt_a 0.10% : 0.000095s : 1: rewriter_before_opt_a 0.10% : 0.000097s : 1: symbol_engine_optimizer 82.15% : 0.081154s : 1: type_inference TotalTime = 0.0389652, [30] [bootstrap]: 0.00031649 [type_inference]: 0.0295015 [event_method]: 2.169e-05 [auto_monad]: 6.938e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00012275 [rewriter_before_opt_a]: 8.311e-05 [expand_dump_flag]: 3.20998e-06 [jit_opt_a]: 0.00638174, [2] [Cycle 1]: 0.0020433, [27] [switch_simplify]: 7.125e-05 [loop_unroll]: 2.975e-05 [a_1]: 0.00055701 [with_stream_mark]: 2.226e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 6.23998e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.629e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 5.66003e-06 [renormalize]: 0.00102026 [add_forward_monad_depend]: 6.06e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.362e-05 [cse]: 3.446e-05 [replace_applicator]: 1.227e-05 [Cycle 2]: 0.00057101, [27] [switch_simplify]: 6.13002e-06 [loop_unroll]: 5.14e-06 [a_1]: 0.00030899 [with_stream_mark]: 1.442e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.377e-05 [j_node_and_user_rematch]: 8.42998e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 7.68001e-06 [cse]: 1.893e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.318e-05 [rewriter_after_opt_a]: 3.763e-05 [convert_after_rewriter]: 6.39999e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00065489 [jit_opt_b]: 5.031e-05, [1] [Cycle 1]: 4.345e-05, [2] [frontend_op_eliminate]: 1.564e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 2.941e-05 [loop_unroll]: 0.00043594 [jit_opt_after_cconv]: 0.00024234, [1] [Cycle 1]: 0.00023582, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 5.02e-06 [updatestate_depend_eliminate]: 8.72e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 3.3e-06 [cse]: 3.258e-05 [call_graph_tuple_transform]: 2.391e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 7.478e-05 [renormalize]: 1.25001e-06 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.674e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 6.94001e-06 [add_recomputation]: 5.582e-05 [cse_after_recomputation]: 2.843e-05, [1] [Cycle 1]: 2.175e-05, [1] [cse]: 1.536e-05 [auto_monad_reorder]: 1.938e-05 [get_jit_bprop_graph]: 2.52001e-06 [rewriter_after_jit_bprop_graph]: 7.21999e-06 [opt_after_jit_grad]: 0.00049693 [symbol_engine_optimizer]: 7.635e-05, [1] [Cycle 1]: 6.905e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.472e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.95999e-06 [renormalize]: 7.50006e-07 [validate]: 4.667e-05 Sums bootstrap : 0.000316s : 0.92% type_inference : 0.029502s : 85.38% event_method : 0.000022s : 0.06% auto_monad : 0.000069s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000123s : 0.36% rewriter_before_opt_a : 0.000083s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.22% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000866s : 2.51% jit_opt_a.with_stream_mark : 0.000037s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001020s : 2.95% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.06% jit_opt_a.cse : 0.000053s : 0.15% jit_opt_a.replace_applicator : 0.000017s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000038s : 0.11% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000655s : 1.90% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000029s : 0.09% loop_unroll : 0.000436s : 1.26% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000075s : 0.22% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.16% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000497s : 1.44% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.14% Time group info: ------[substitution.] 0.000229 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 3.02% : 0.000007s : 3: substitution.graph_param_transform 84.10% : 0.000193s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029421 2 94.67% : 0.027854s : 1: type_inference.infer 5.33% : 0.001567s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.82% : 0.000051s : 4: replace.inline 30.18% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.60% : 0.000190s : 4: match.inline 5.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.10% : 0.000001s : 10: predicate.accumulaten_eliminater 1.48% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.54% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.21% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.83% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.02% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 2.88% : 0.000003s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.17% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.67% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000891 13 47.78% : 0.000426s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.64% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.59% : 0.000415s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041119 72 0.14% : 0.000059s : 1: add_recomputation 0.18% : 0.000074s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.81% : 0.000334s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.53% : 0.006386s : 1: jit_opt_a 0.60% : 0.000245s : 1: jit_opt_after_cconv 0.13% : 0.000053s : 1: jit_opt_b 1.08% : 0.000445s : 1: loop_unroll 1.62% : 0.000666s : 1: mutable_eliminate 2.68% : 0.001104s : 26: opt.transform.jit_opt_a 0.13% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.23% : 0.000507s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000128s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.44% : 0.000594s : 1: renormalize.infer 1.02% : 0.000418s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000040s : 1: rewriter_after_opt_a 0.21% : 0.000087s : 1: rewriter_before_opt_a 0.19% : 0.000079s : 1: symbol_engine_optimizer 71.81% : 0.029526s : 1: type_inference TotalTime = 0.157797, [30] [bootstrap]: 0.00034153 [type_inference]: 0.143549 [event_method]: 2.488e-05 [auto_monad]: 7.732e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 0.00063537 [rewriter_before_opt_a]: 0.00010001 [expand_dump_flag]: 3.97998e-06 [jit_opt_a]: 0.01009, [2] [Cycle 1]: 0.00576056, [27] [switch_simplify]: 7.014e-05 [loop_unroll]: 3.48e-05 [a_1]: 0.00074529 [with_stream_mark]: 1.922e-05 [recompute_prepare]: 9.25999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.92998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 8.04002e-06 [updatestate_useless_node_eliminater]: 7.15e-06 [accelerated_algorithm]: 7.74002e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 7.68001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.637e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.88e-06 [renormalize]: 0.00450433 [add_forward_monad_depend]: 8e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 3.679e-05 [replace_applicator]: 2.341e-05 [Cycle 2]: 0.00041639, [27] [switch_simplify]: 9.36e-06 [loop_unroll]: 7.27002e-06 [a_1]: 0.00014417 [with_stream_mark]: 1.291e-05 [recompute_prepare]: 6.53e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.14999e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 6.49999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 3.31999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.788e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 6.38e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.486e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.453e-05 [rewriter_after_opt_a]: 3.905e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00082891 [jit_opt_b]: 7.235e-05, [1] [Cycle 1]: 6.214e-05, [2] [frontend_op_eliminate]: 2.853e-05 [inline_after_opt_a]: 2.071e-05 [cconv]: 2.754e-05 [loop_unroll]: 0.00049674 [jit_opt_after_cconv]: 0.00018843, [1] [Cycle 1]: 0.00018146, [11] [c_1]: 2.834e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 8.83001e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 3.465e-05 [call_graph_tuple_transform]: 2.623e-05 [tuple_list_get_item_eliminator]: 7.5e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 7.33e-06 [remove_dup_value]: 1.928e-05 [partial_unused_args_eliminate]: 5.29998e-06 [environ_conv]: 9.49999e-06 [add_recomputation]: 5.242e-05 [cse_after_recomputation]: 2.712e-05, [1] [Cycle 1]: 2.16e-05, [1] [cse]: 1.506e-05 [auto_monad_reorder]: 1.748e-05 [get_jit_bprop_graph]: 1.58002e-06 [rewriter_after_jit_bprop_graph]: 6.49999e-06 [opt_after_jit_grad]: 0.00051842 [symbol_engine_optimizer]: 0.00037062, [1] [Cycle 1]: 0.00036321, [6] [build]: 4.37e-06 [elim_shapecalc]: 9.54e-06 [elim_not_effective]: 1.594e-05 [opt_reshape]: 0.00028367 [fold_const_symbol]: 1.552e-05 [renormalize]: 2.29978e-07 [validate]: 5.579e-05 Sums bootstrap : 0.000342s : 0.22% type_inference : 0.143549s : 93.68% event_method : 0.000025s : 0.02% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000635s : 0.41% rewriter_before_opt_a : 0.000100s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000889s : 0.58% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004504s : 2.94% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000829s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000029s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000497s : 0.32% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000518s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000284s : 0.19% symbol_engine_optimizer.fold_const_symbol : 0.000016s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.04% Time group info: ------[substitution.] 0.000272 25 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 3.33% : 0.000009s : 4: substitution.graph_param_transform 85.68% : 0.000233s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 4.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.143457 2 96.82% : 0.138899s : 1: type_inference.infer 3.18% : 0.004559s : 1: type_inference.specialize ------[replace.] 0.000130 7 57.49% : 0.000074s : 5: replace.inline 42.51% : 0.000055s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 95.33% : 0.000230s : 5: match.inline 4.67% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 13: predicate.addn_check_dump 1.11% : 0.000002s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.51% : 0.000002s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.41% : 0.000001s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.29% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000003s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 19: predicate.partial_eliminate 1.07% : 0.000002s : 13: predicate.print_const_string_wrapper 1.69% : 0.000003s : 13: predicate.reduce_eliminate 1.66% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000004s : 20: predicate.switch_defer_inline 2.32% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.59% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.96% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003228 25 62.56% : 0.002019s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.10% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.34% : 0.001141s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.163818 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000358s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.16% : 0.010094s : 1: jit_opt_a 0.12% : 0.000191s : 1: jit_opt_after_cconv 0.05% : 0.000075s : 1: jit_opt_b 0.31% : 0.000504s : 1: loop_unroll 0.51% : 0.000837s : 1: mutable_eliminate 0.71% : 0.001165s : 26: opt.transform.jit_opt_a 0.04% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000042s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000319s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000526s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000641s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.02% : 0.003311s : 1: renormalize.infer 0.72% : 0.001182s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000104s : 1: rewriter_before_opt_a 0.23% : 0.000374s : 1: symbol_engine_optimizer 87.64% : 0.143567s : 1: type_inference TotalTime = 0.18325, [30] [bootstrap]: 0.0002192 [type_inference]: 0.133041 [event_method]: 0.00049199 [auto_monad]: 0.00012005 [graph_reusing]: 8.36002e-06 [pre_auto_parallel]: 3.05998e-06 [py_interpret_to_execute]: 9.972e-05 [rewriter_before_opt_a]: 0.00013536 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.0465771, [3] [Cycle 1]: 0.0182108, [27] [switch_simplify]: 8.265e-05 [loop_unroll]: 4.789e-05 [a_1]: 0.00106182 [with_stream_mark]: 3.855e-05 [recompute_prepare]: 2.741e-05 [updatestate_depend_eliminate]: 1.05e-05 [updatestate_assign_eliminate]: 7.21999e-06 [updatestate_loads_eliminate]: 6.66e-06 [parameter_eliminate]: 3.46999e-06 [specialize_transform]: 1.532e-05 [updatestate_useless_node_eliminater]: 1.372e-05 [accelerated_algorithm]: 1.386e-05 [meta_shard_fg_expand]: 4.11001e-06 [get_grad_eliminate_]: 1.38e-05 [merge_forward]: 9.98002e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.936e-05 [j_node_and_user_rematch]: 2.421e-05 [meta_fg_expand]: 0.00202534 [replace_old_param]: 8.134e-05 [inline_without_move]: 6.514e-05 [renormalize]: 0.0138554 [add_forward_monad_depend]: 1.508e-05 [auto_monad_grad]: 7.11999e-06 [auto_monad_eliminator]: 6.778e-05 [cse]: 0.00027082 [replace_applicator]: 9.968e-05 [Cycle 2]: 0.0241801, [27] [switch_simplify]: 4.529e-05 [loop_unroll]: 4.23e-05 [a_1]: 0.00132901 [with_stream_mark]: 2.605e-05 [recompute_prepare]: 1.263e-05 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 4.05998e-06 [updatestate_loads_eliminate]: 4.82e-06 [parameter_eliminate]: 2.69001e-06 [specialize_transform]: 8.84e-06 [updatestate_useless_node_eliminater]: 6.86001e-06 [accelerated_algorithm]: 7.63999e-06 [meta_shard_fg_expand]: 2.95002e-06 [get_grad_eliminate_]: 6.61999e-06 [merge_forward]: 4.52998e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.994e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 0.00011701 [replace_old_param]: 1.226e-05 [inline_without_move]: 7.25998e-06 [renormalize]: 0.0221709 [add_forward_monad_depend]: 1.338e-05 [auto_monad_grad]: 2.70997e-06 [auto_monad_eliminator]: 2.336e-05 [cse]: 3.652e-05 [replace_applicator]: 2.676e-05 [Cycle 3]: 0.00034697, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.23002e-06 [a_1]: 8.083e-05 [with_stream_mark]: 1.758e-05 [recompute_prepare]: 4.95999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 4.46002e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 4.32e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 3.36999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.977e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 5.07e-06 [inline_without_move]: 4.33999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.161e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 1.853e-05 [rewriter_after_opt_a]: 3.927e-05 [convert_after_rewriter]: 6.87002e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00083881 [jit_opt_b]: 5.08e-05, [1] [Cycle 1]: 4.248e-05, [2] [frontend_op_eliminate]: 1.408e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 3.301e-05 [loop_unroll]: 0.00045713 [jit_opt_after_cconv]: 0.00016055, [1] [Cycle 1]: 0.00015428, [11] [c_1]: 1.849e-05 [parameter_eliminate]: 3.73999e-06 [updatestate_depend_eliminate]: 8.41002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 3.136e-05 [call_graph_tuple_transform]: 1.978e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.19998e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.84001e-06 [environ_conv]: 6.56999e-06 [add_recomputation]: 4.768e-05 [cse_after_recomputation]: 2.19e-05, [1] [Cycle 1]: 1.712e-05, [1] [cse]: 1.1e-05 [auto_monad_reorder]: 1.634e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 7.03e-06 [opt_after_jit_grad]: 0.00047671 [symbol_engine_optimizer]: 7.493e-05, [1] [Cycle 1]: 6.793e-05, [6] [build]: 4.60001e-06 [elim_shapecalc]: 7.28e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 8.06001e-06 [renormalize]: 3.80009e-07 [validate]: 4.309e-05 Sums bootstrap : 0.000219s : 0.12% type_inference : 0.133041s : 74.58% event_method : 0.000492s : 0.28% auto_monad : 0.000120s : 0.07% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000100s : 0.06% rewriter_before_opt_a : 0.000135s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000135s : 0.08% jit_opt_a.loop_unroll : 0.000095s : 0.05% jit_opt_a.a_1 : 0.002472s : 1.39% jit_opt_a.with_stream_mark : 0.000082s : 0.05% jit_opt_a.recompute_prepare : 0.000045s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.00% jit_opt_a.specialize_transform : 0.000029s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.01% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.01% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000069s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.002145s : 1.20% jit_opt_a.replace_old_param : 0.000099s : 0.06% jit_opt_a.inline_without_move : 0.000077s : 0.04% jit_opt_a.renormalize : 0.036026s : 20.19% jit_opt_a.add_forward_monad_depend : 0.000030s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000098s : 0.05% jit_opt_a.cse : 0.000319s : 0.18% jit_opt_a.replace_applicator : 0.000131s : 0.07% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000839s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000457s : 0.26% jit_opt_after_cconv.c_1 : 0.000018s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000048s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000477s : 0.27% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.02% Time group info: ------[substitution.] 0.000663 109 0.26% : 0.000002s : 2: substitution.elim_not_effective 0.23% : 0.000002s : 2: substitution.fold_const_symbol 0.97% : 0.000006s : 2: substitution.graph_param_transform 66.50% : 0.000441s : 13: substitution.inline 3.15% : 0.000021s : 2: substitution.inline_without_move 1.56% : 0.000010s : 13: substitution.j_node_and_user_rematch 2.01% : 0.000013s : 7: substitution.minmaximum_grad 1.21% : 0.000008s : 5: substitution.partial_eliminate 1.92% : 0.000013s : 13: substitution.remove_not_recompute_node 5.52% : 0.000037s : 10: substitution.replace_applicator 1.06% : 0.000007s : 10: substitution.replace_old_param 0.54% : 0.000004s : 1: substitution.set_cell_output_no_recompute 1.22% : 0.000008s : 1: substitution.tile_eliminate 3.77% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.51% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.57% : 0.000050s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132924 2 97.60% : 0.129734s : 1: type_inference.infer 2.40% : 0.003190s : 1: type_inference.specialize ------[replace.] 0.000206 20 68.88% : 0.000142s : 13: replace.inline 31.12% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000457 20 94.29% : 0.000431s : 13: match.inline 5.71% : 0.000026s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000403 2628 1.49% : 0.000006s : 45: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.40% : 0.000006s : 45: predicate.addn_check_dump 1.61% : 0.000006s : 45: predicate.addn_zero_filter 2.15% : 0.000009s : 45: predicate.arithmetic_simplify 1.55% : 0.000006s : 45: predicate.cast_eliminate 0.12% : 0.000000s : 2: predicate.check_bprop_eliminate 1.47% : 0.000006s : 45: predicate.compare_switch_simplify 1.50% : 0.000006s : 45: predicate.depend_value_elim 1.46% : 0.000006s : 45: predicate.dict_get_item_const_eliminator 1.49% : 0.000006s : 45: predicate.dict_get_item_eliminator 1.45% : 0.000006s : 45: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000006s : 45: predicate.environ_add_const_eliminate 1.41% : 0.000006s : 45: predicate.environ_get_add_eliminate 1.64% : 0.000007s : 45: predicate.environ_get_depend_swap 1.48% : 0.000006s : 45: predicate.environ_get_eliminate 1.42% : 0.000006s : 45: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.83% : 0.000003s : 18: predicate.get_grad_eliminate 0.10% : 0.000000s : 2: predicate.graph_param_transform 4.66% : 0.000019s : 69: predicate.inline 2.10% : 0.000008s : 46: predicate.inline_without_move 0.31% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.03% : 0.000004s : 18: predicate.less_batch_normalization 1.84% : 0.000007s : 52: predicate.list_to_tuple_eliminator_ 1.92% : 0.000008s : 54: predicate.load_eliminater 0.42% : 0.000002s : 2: predicate.loop_unroll_after_grad 3.44% : 0.000014s : 93: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.38% : 0.000006s : 45: predicate.merge_addn 1.38% : 0.000006s : 45: predicate.minmaximum_grad 0.64% : 0.000003s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.20% : 0.000009s : 54: predicate.partial_eliminate 1.59% : 0.000006s : 45: predicate.print_const_string_wrapper 1.94% : 0.000008s : 45: predicate.reduce_eliminate 1.76% : 0.000007s : 52: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000002s : 18: predicate.remove_not_recompute_node 2.73% : 0.000011s : 99: predicate.replace_applicator 1.37% : 0.000006s : 46: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.54% : 0.000006s : 45: predicate.reshape_eliminate 1.87% : 0.000008s : 45: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 2: predicate.row_tensor_eliminate 1.45% : 0.000006s : 45: predicate.same_eliminate 0.50% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 4: predicate.special_op_eliminate 0.74% : 0.000003s : 18: predicate.specialize_transform 1.67% : 0.000007s : 45: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000006s : 45: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.78% : 0.000011s : 65: predicate.switch_defer_inline 2.46% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.51% : 0.000026s : 160: predicate.switch_simplify 1.50% : 0.000006s : 45: predicate.tile_eliminate 1.39% : 0.000006s : 45: predicate.transpose_eliminate 1.92% : 0.000008s : 45: predicate.tuple_list_convert_item_index_to_positive 1.67% : 0.000007s : 45: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000014s : 56: predicate.tuple_list_get_item_eliminator 1.91% : 0.000008s : 45: predicate.tuple_list_set_item_eliminator 1.94% : 0.000008s : 52: predicate.tuple_to_list_eliminator_ 1.95% : 0.000008s : 54: predicate.updatestate_pure_node_eliminater 2.59% : 0.000010s : 72: predicate.updatestate_useless_node_eliminater 1.77% : 0.000007s : 45: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004318 45 74.02% : 0.003196s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.98% : 0.001122s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.222515 87 0.02% : 0.000050s : 1: add_recomputation 0.06% : 0.000128s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.11% : 0.000242s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.23% : 0.000506s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 20.93% : 0.046580s : 1: jit_opt_a 0.07% : 0.000163s : 1: jit_opt_after_cconv 0.02% : 0.000054s : 1: jit_opt_b 0.21% : 0.000466s : 1: loop_unroll 0.38% : 0.000850s : 1: mutable_eliminate 1.45% : 0.003215s : 39: opt.transform.jit_opt_a 0.02% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000485s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000104s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 15.00% : 0.033369s : 2: renormalize.infer 1.18% : 0.002625s : 2: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000140s : 1: rewriter_before_opt_a 0.03% : 0.000077s : 1: symbol_engine_optimizer 59.80% : 0.133072s : 1: type_inference TotalTime = 0.0135529, [30] [bootstrap]: 0.00040545 [type_inference]: 0.00517919 [event_method]: 1.864e-05 [auto_monad]: 6.604e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 4.298e-05 [rewriter_before_opt_a]: 7.231e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.00569733, [2] [Cycle 1]: 0.00175787, [27] [switch_simplify]: 5.509e-05 [loop_unroll]: 3.194e-05 [a_1]: 0.000546 [with_stream_mark]: 1.864e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 3.87002e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.46002e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00078502 [add_forward_monad_depend]: 5.15999e-06 [auto_monad_grad]: 1.92999e-06 [auto_monad_eliminator]: 1.388e-05 [cse]: 2.556e-05 [replace_applicator]: 1.113e-05 [Cycle 2]: 0.00032227, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.03002e-06 [a_1]: 9.264e-05 [with_stream_mark]: 8.14002e-06 [recompute_prepare]: 4.90001e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 4.99003e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 4.92e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.48e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.22e-05 [j_node_and_user_rematch]: 7.72002e-06 [meta_fg_expand]: 1.88997e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.80013e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.09e-06 [cse]: 1.079e-05 [replace_applicator]: 4.94e-06 [py_interpret_to_execute_after_opt_a]: 1.057e-05 [rewriter_after_opt_a]: 3.346e-05 [convert_after_rewriter]: 6.63998e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00046763 [jit_opt_b]: 4.903e-05, [1] [Cycle 1]: 4.274e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.481e-05 [cconv]: 3.681e-05 [loop_unroll]: 0.00043239 [jit_opt_after_cconv]: 0.00014166, [1] [Cycle 1]: 0.00013489, [11] [c_1]: 2.174e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.738e-05 [call_graph_tuple_transform]: 1.801e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 2.29978e-07 [switch_simplify]: 5.12e-06 [remove_dup_value]: 2.559e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 5.01002e-06 [add_recomputation]: 5.297e-05 [cse_after_recomputation]: 2.229e-05, [1] [Cycle 1]: 1.704e-05, [1] [cse]: 1.093e-05 [auto_monad_reorder]: 1.406e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.48001e-06 [opt_after_jit_grad]: 0.00047097 [symbol_engine_optimizer]: 7.543e-05, [1] [Cycle 1]: 6.937e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 7.88999e-06 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 8.37e-06 [renormalize]: 3.69997e-07 [validate]: 3.982e-05 Sums bootstrap : 0.000405s : 4.33% type_inference : 0.005179s : 55.33% event_method : 0.000019s : 0.20% auto_monad : 0.000066s : 0.71% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000043s : 0.46% rewriter_before_opt_a : 0.000072s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.65% jit_opt_a.loop_unroll : 0.000037s : 0.39% jit_opt_a.a_1 : 0.000639s : 6.82% jit_opt_a.with_stream_mark : 0.000027s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000785s : 8.39% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.20% jit_opt_a.cse : 0.000036s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.17% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000033s : 0.36% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000468s : 5.00% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000037s : 0.39% loop_unroll : 0.000432s : 4.62% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000017s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000026s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000053s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000014s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000471s : 5.03% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.43% Time group info: ------[substitution.] 0.000209 23 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000005s : 3: substitution.graph_param_transform 84.58% : 0.000177s : 4: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000004s : 2: substitution.replace_old_param 5.86% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005116 2 81.44% : 0.004167s : 1: type_inference.infer 18.56% : 0.000950s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.95% : 0.000045s : 4: replace.inline 33.05% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 94.02% : 0.000174s : 4: match.inline 5.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.83% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.28% : 0.000008s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000742 13 51.41% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.71% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.88% : 0.000318s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015241 72 0.37% : 0.000056s : 1: add_recomputation 0.45% : 0.000069s : 1: auto_monad 0.11% : 0.000016s : 1: auto_monad_reorder 2.77% : 0.000422s : 1: bootstrap 0.26% : 0.000040s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.40% : 0.005700s : 1: jit_opt_a 0.95% : 0.000144s : 1: jit_opt_after_cconv 0.34% : 0.000052s : 1: jit_opt_b 2.88% : 0.000439s : 1: loop_unroll 3.11% : 0.000475s : 1: mutable_eliminate 5.58% : 0.000850s : 26: opt.transform.jit_opt_a 0.31% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.14% : 0.000478s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000028s : 1: remove_dup_value 2.83% : 0.000431s : 1: renormalize.infer 2.27% : 0.000347s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000036s : 1: rewriter_after_opt_a 0.49% : 0.000075s : 1: rewriter_before_opt_a 0.51% : 0.000078s : 1: symbol_engine_optimizer 34.05% : 0.005189s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.497.794 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065310> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.498.391 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0137674, [30] [bootstrap]: 0.00030772 [type_inference]: 0.00499474 [event_method]: 1.819e-05 [auto_monad]: 0.0001058 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.594e-05 [rewriter_before_opt_a]: 7.513e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.00596891, [2] [Cycle 1]: 0.00185146, [27] [switch_simplify]: 9.757e-05 [loop_unroll]: 2.947e-05 [a_1]: 0.00057521 [with_stream_mark]: 2.458e-05 [recompute_prepare]: 8.46002e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 9.26998e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00077273 [add_forward_monad_depend]: 6.60002e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.426e-05 [cse]: 3.671e-05 [replace_applicator]: 1.386e-05 [Cycle 2]: 0.0003214, [27] [switch_simplify]: 5.71e-06 [loop_unroll]: 4.89998e-06 [a_1]: 8.682e-05 [with_stream_mark]: 1.062e-05 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.71003e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.296e-05 [j_node_and_user_rematch]: 7.86001e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.26999e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.356e-05 [replace_applicator]: 5.11997e-06 [py_interpret_to_execute_after_opt_a]: 1.372e-05 [rewriter_after_opt_a]: 3.905e-05 [convert_after_rewriter]: 6.24001e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00062138 [jit_opt_b]: 5.054e-05, [1] [Cycle 1]: 4.251e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 3.035e-05 [loop_unroll]: 0.00041608 [jit_opt_after_cconv]: 0.00016136, [1] [Cycle 1]: 0.00015436, [11] [c_1]: 2.015e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 8.47e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.621e-05 [call_graph_tuple_transform]: 2.04e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 6.20028e-07 [switch_simplify]: 5.75001e-06 [remove_dup_value]: 1.749e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.80998e-06 [add_recomputation]: 5.351e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.842e-05, [1] [cse]: 1.216e-05 [auto_monad_reorder]: 1.741e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00048436 [symbol_engine_optimizer]: 7.313e-05, [1] [Cycle 1]: 6.657e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 7.36001e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.29998e-06 [renormalize]: 6.09987e-07 [validate]: 4.248e-05 Sums bootstrap : 0.000308s : 3.28% type_inference : 0.004995s : 53.30% event_method : 0.000018s : 0.19% auto_monad : 0.000106s : 1.13% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.38% rewriter_before_opt_a : 0.000075s : 0.80% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000103s : 1.10% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000662s : 7.06% jit_opt_a.with_stream_mark : 0.000035s : 0.38% jit_opt_a.recompute_prepare : 0.000014s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000012s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000773s : 8.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.22% jit_opt_a.cse : 0.000050s : 0.54% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000039s : 0.42% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000621s : 6.63% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000030s : 0.32% loop_unroll : 0.000416s : 4.44% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000054s : 0.57% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000484s : 5.17% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000042s : 0.45% Time group info: ------[substitution.] 0.000247 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 85.70% : 0.000211s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000005s : 2: substitution.replace_old_param 5.14% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004922 2 82.91% : 0.004081s : 1: type_inference.infer 17.09% : 0.000841s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.99% : 0.000050s : 4: replace.inline 31.01% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.73% : 0.000209s : 4: match.inline 5.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.53% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.00% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.01% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 2.12% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000676 13 54.18% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.85% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.97% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015510 72 0.36% : 0.000056s : 1: add_recomputation 0.70% : 0.000109s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.10% : 0.000325s : 1: bootstrap 0.21% : 0.000033s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 38.51% : 0.005973s : 1: jit_opt_a 1.06% : 0.000164s : 1: jit_opt_after_cconv 0.34% : 0.000053s : 1: jit_opt_b 2.74% : 0.000425s : 1: loop_unroll 4.08% : 0.000632s : 1: mutable_eliminate 5.93% : 0.000920s : 26: opt.transform.jit_opt_a 0.31% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.17% : 0.000491s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000039s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000020s : 1: remove_dup_value 2.76% : 0.000428s : 1: renormalize.infer 2.16% : 0.000335s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000042s : 1: rewriter_after_opt_a 0.51% : 0.000078s : 1: rewriter_before_opt_a 0.49% : 0.000076s : 1: symbol_engine_optimizer 32.29% : 0.005009s : 1: type_inference TotalTime = 0.164187, [30] [bootstrap]: 0.00036525 [type_inference]: 0.142958 [event_method]: 2.825e-05 [auto_monad]: 8.441e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.0010232 [rewriter_before_opt_a]: 0.00011123 [expand_dump_flag]: 5.18002e-06 [jit_opt_a]: 0.0163644, [2] [Cycle 1]: 0.00638068, [27] [switch_simplify]: 8.432e-05 [loop_unroll]: 3.219e-05 [a_1]: 0.00078376 [with_stream_mark]: 2.812e-05 [recompute_prepare]: 1.22e-05 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 3.52002e-06 [updatestate_loads_eliminate]: 3.73001e-06 [parameter_eliminate]: 2.66e-06 [specialize_transform]: 8.20999e-06 [updatestate_useless_node_eliminater]: 6.86999e-06 [accelerated_algorithm]: 7.01999e-06 [meta_shard_fg_expand]: 3.6e-06 [get_grad_eliminate_]: 8.12e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 2.16e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.904e-05 [j_node_and_user_rematch]: 1.293e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.29e-05 [inline_without_move]: 6.73e-06 [renormalize]: 0.00500844 [add_forward_monad_depend]: 9.66e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 2.316e-05 [cse]: 3.342e-05 [replace_applicator]: 2.701e-05 [Cycle 2]: 0.00044661, [27] [switch_simplify]: 7.81001e-06 [loop_unroll]: 6.83998e-06 [a_1]: 0.00014364 [with_stream_mark]: 1.589e-05 [recompute_prepare]: 6.63998e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 3.03e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.76002e-06 [cell_reuse_recompute_pass]: 3.52997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.192e-05 [j_node_and_user_rematch]: 1.084e-05 [meta_fg_expand]: 3.30998e-06 [replace_old_param]: 1.147e-05 [inline_without_move]: 7.3e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.60001e-06 [auto_monad_grad]: 1.27999e-06 [auto_monad_eliminator]: 9.84999e-06 [cse]: 1.594e-05 [replace_applicator]: 8.54e-06 [py_interpret_to_execute_after_opt_a]: 1.762e-05 [rewriter_after_opt_a]: 4.33e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.299e-05 [mutable_eliminate]: 0.00086544 [jit_opt_b]: 6.626e-05, [1] [Cycle 1]: 5.727e-05, [2] [frontend_op_eliminate]: 2.353e-05 [inline_after_opt_a]: 2.155e-05 [cconv]: 3.242e-05 [loop_unroll]: 0.00059061 [jit_opt_after_cconv]: 0.00019697, [1] [Cycle 1]: 0.0001891, [11] [c_1]: 3.182e-05 [parameter_eliminate]: 5.25001e-06 [updatestate_depend_eliminate]: 9.77001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 3.147e-05 [call_graph_tuple_transform]: 2.912e-05 [tuple_list_get_item_eliminator]: 7.51001e-06 [none_parameter_eliminate]: 2.44999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 9.66e-06 [remove_dup_value]: 1.704e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 1.083e-05 [add_recomputation]: 6.128e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.024e-05, [1] [cse]: 1.219e-05 [auto_monad_reorder]: 1.647e-05 [get_jit_bprop_graph]: 2.53003e-06 [rewriter_after_jit_bprop_graph]: 9.93002e-06 [opt_after_jit_grad]: 0.00060574 [symbol_engine_optimizer]: 9.662e-05, [1] [Cycle 1]: 9.016e-05, [6] [build]: 4.15999e-06 [elim_shapecalc]: 8.69003e-06 [elim_not_effective]: 1.5e-05 [opt_reshape]: 1.37e-05 [fold_const_symbol]: 1.233e-05 [renormalize]: 2.89991e-07 [validate]: 0.00028823 Sums bootstrap : 0.000365s : 0.24% type_inference : 0.142958s : 92.87% event_method : 0.000028s : 0.02% auto_monad : 0.000084s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001023s : 0.66% rewriter_before_opt_a : 0.000111s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000927s : 0.60% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.005009s : 3.25% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000049s : 0.03% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000053s : 0.03% mutable_eliminate : 0.000865s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000591s : 0.38% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000061s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000606s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000014s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000288s : 0.19% Time group info: ------[substitution.] 0.000324 24 0.63% : 0.000002s : 2: substitution.elim_not_effective 1.35% : 0.000004s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 4: substitution.graph_param_transform 85.78% : 0.000278s : 4: substitution.inline 1.51% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 2.18% : 0.000007s : 2: substitution.replace_old_param 4.51% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.142841 2 96.41% : 0.137712s : 1: type_inference.infer 3.59% : 0.005129s : 1: type_inference.specialize ------[replace.] 0.000112 6 68.16% : 0.000076s : 4: replace.inline 31.84% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 6 95.33% : 0.000274s : 4: match.inline 4.67% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000163 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000003s : 12: predicate.arithmetic_simplify 1.58% : 0.000003s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.88% : 0.000001s : 12: predicate.compare_switch_simplify 1.45% : 0.000002s : 12: predicate.depend_value_elim 1.39% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.89% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 0.90% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.48% : 0.000009s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.70% : 0.000003s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.10% : 0.000003s : 18: predicate.load_eliminater 1.58% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.88% : 0.000001s : 12: predicate.merge_addn 0.85% : 0.000001s : 12: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000004s : 18: predicate.partial_eliminate 1.39% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.55% : 0.000003s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000004s : 18: predicate.switch_defer_inline 1.82% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.80% : 0.000013s : 58: predicate.switch_simplify 1.14% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.23% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.98% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.75% : 0.000008s : 22: predicate.tuple_list_get_item_eliminator 2.10% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.37% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000003s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003291 22 59.99% : 0.001974s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.14% : 0.001255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.170277 72 0.04% : 0.000064s : 1: add_recomputation 0.05% : 0.000089s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000383s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 9.61% : 0.016369s : 1: jit_opt_a 0.12% : 0.000201s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.35% : 0.000601s : 1: loop_unroll 0.51% : 0.000874s : 1: mutable_eliminate 0.72% : 0.001231s : 26: opt.transform.jit_opt_a 0.04% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000613s : 1: opt_after_jit_grad 0.03% : 0.000056s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.61% : 0.001031s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 2.12% : 0.003605s : 1: renormalize.infer 0.81% : 0.001387s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.07% : 0.000119s : 1: rewriter_before_opt_a 0.06% : 0.000099s : 1: symbol_engine_optimizer 83.97% : 0.142981s : 1: type_inference TotalTime = 1.11568, [30] [bootstrap]: 0.00148507 [type_inference]: 0.879306 [event_method]: 2.511e-05 [auto_monad]: 7.449e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 0.00087203 [rewriter_before_opt_a]: 0.00013479 [expand_dump_flag]: 4.19002e-06 [jit_opt_a]: 0.00845916, [2] [Cycle 1]: 0.00450203, [27] [switch_simplify]: 9.04e-05 [loop_unroll]: 3.43e-05 [a_1]: 0.00070453 [with_stream_mark]: 1.751e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 7.01999e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.78998e-06 [get_grad_eliminate_]: 6.79999e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 6.43e-06 [renormalize]: 0.00330046 [add_forward_monad_depend]: 5.79999e-06 [auto_monad_grad]: 2.55002e-06 [auto_monad_eliminator]: 1.642e-05 [cse]: 3.717e-05 [replace_applicator]: 1.483e-05 [Cycle 2]: 0.00037975, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00013262 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 6.20002e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.11997e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.35998e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.258e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 5.81998e-06 [renormalize]: 1.30007e-07 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.308e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.068e-05 [rewriter_after_opt_a]: 3.691e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00054453 [jit_opt_b]: 5.719e-05, [1] [Cycle 1]: 5.058e-05, [2] [frontend_op_eliminate]: 2.1e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 2.694e-05 [loop_unroll]: 0.00061607 [jit_opt_after_cconv]: 0.00015335, [1] [Cycle 1]: 0.00014733, [11] [c_1]: 2.734e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.182e-05 [call_graph_tuple_transform]: 2.115e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.835e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 7.98999e-06 [add_recomputation]: 5.208e-05 [cse_after_recomputation]: 2.486e-05, [1] [Cycle 1]: 1.878e-05, [1] [cse]: 1.306e-05 [auto_monad_reorder]: 1.694e-05 [get_jit_bprop_graph]: 1.44998e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00050115 [symbol_engine_optimizer]: 0.00016408, [1] [Cycle 1]: 0.00015642, [6] [build]: 5.26002e-06 [elim_shapecalc]: 1.076e-05 [elim_not_effective]: 1.653e-05 [opt_reshape]: 6.94999e-06 [fold_const_symbol]: 8.826e-05 [renormalize]: 3.19997e-07 [validate]: 0.222783 Sums bootstrap : 0.001485s : 0.13% type_inference : 0.879306s : 79.12% event_method : 0.000025s : 0.00% auto_monad : 0.000074s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000872s : 0.08% rewriter_before_opt_a : 0.000135s : 0.01% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000097s : 0.01% jit_opt_a.loop_unroll : 0.000040s : 0.00% jit_opt_a.a_1 : 0.000837s : 0.08% jit_opt_a.with_stream_mark : 0.000028s : 0.00% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003301s : 0.30% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.00% jit_opt_a.cse : 0.000050s : 0.00% jit_opt_a.replace_applicator : 0.000021s : 0.00% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000037s : 0.00% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000545s : 0.05% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000027s : 0.00% loop_unroll : 0.000616s : 0.06% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000052s : 0.00% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000501s : 0.05% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000088s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.222783s : 20.04% Time group info: ------[substitution.] 0.000274 28 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000007s : 4: substitution.graph_param_transform 83.46% : 0.000229s : 5: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.90% : 0.000011s : 3: substitution.reduce_eliminate 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 4.06% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.879212 2 99.50% : 0.874788s : 1: type_inference.infer 0.50% : 0.004425s : 1: type_inference.specialize ------[replace.] 0.000100 7 67.98% : 0.000068s : 5: replace.inline 32.02% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 7 95.76% : 0.000225s : 5: match.inline 4.24% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.96% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.27% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.08% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.26% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.16% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.06% : 0.000002s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.95% : 0.000010s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003020 25 65.36% : 0.001974s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.23% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.41% : 0.000979s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.897396 72 0.01% : 0.000055s : 1: add_recomputation 0.01% : 0.000078s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 0.17% : 0.001507s : 1: bootstrap 0.00% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.00% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 0.94% : 0.008462s : 1: jit_opt_a 0.02% : 0.000156s : 1: jit_opt_after_cconv 0.01% : 0.000060s : 1: jit_opt_b 0.07% : 0.000624s : 1: loop_unroll 0.06% : 0.000552s : 1: mutable_eliminate 0.12% : 0.001082s : 26: opt.transform.jit_opt_a 0.01% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.00% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000119s : 4: opt.transform.symbol_engine_opt 0.06% : 0.000508s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000881s : 1: py_interpret_to_execute 0.00% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 0.27% : 0.002429s : 1: renormalize.infer 0.10% : 0.000862s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.00% : 0.000040s : 1: rewriter_after_opt_a 0.02% : 0.000140s : 1: rewriter_before_opt_a 0.02% : 0.000168s : 1: symbol_engine_optimizer 97.99% : 0.879322s : 1: type_inference TotalTime = 0.0428744, [30] [bootstrap]: 0.00039994 [type_inference]: 0.0200812 [event_method]: 1.998e-05 [auto_monad]: 7.121e-05 [graph_reusing]: 5.45001e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 6.754e-05 [rewriter_before_opt_a]: 8.248e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00665902, [2] [Cycle 1]: 0.00204017, [27] [switch_simplify]: 6.319e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00057247 [with_stream_mark]: 1.898e-05 [recompute_prepare]: 8.35001e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.00103247 [add_forward_monad_depend]: 5.05999e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.386e-05 [cse]: 2.331e-05 [replace_applicator]: 1.381e-05 [Cycle 2]: 0.00032468, [27] [switch_simplify]: 5.76998e-06 [loop_unroll]: 5.15001e-06 [a_1]: 9.605e-05 [with_stream_mark]: 9.24998e-06 [recompute_prepare]: 4.84e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 2.96999e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 8.09002e-06 [inline_without_move]: 4.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.071e-05 [replace_applicator]: 4.82e-06 [py_interpret_to_execute_after_opt_a]: 1.091e-05 [rewriter_after_opt_a]: 3.313e-05 [convert_after_rewriter]: 7.58001e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00055748 [jit_opt_b]: 4.999e-05, [1] [Cycle 1]: 4.333e-05, [2] [frontend_op_eliminate]: 1.671e-05 [inline_after_opt_a]: 1.554e-05 [cconv]: 2.311e-05 [loop_unroll]: 0.0134925 [jit_opt_after_cconv]: 0.00017886, [1] [Cycle 1]: 0.00017037, [11] [c_1]: 2.932e-05 [parameter_eliminate]: 4.32998e-06 [updatestate_depend_eliminate]: 7.21999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 3.084e-05 [call_graph_tuple_transform]: 2.401e-05 [tuple_list_get_item_eliminator]: 7.81001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.745e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 7.46999e-06 [add_recomputation]: 5.759e-05 [cse_after_recomputation]: 3.08e-05, [1] [Cycle 1]: 2.323e-05, [1] [cse]: 1.591e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 9.87001e-06 [opt_after_jit_grad]: 0.00059141 [symbol_engine_optimizer]: 8.116e-05, [1] [Cycle 1]: 7.427e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 9.47001e-06 [elim_not_effective]: 1.461e-05 [opt_reshape]: 6.55002e-06 [fold_const_symbol]: 1.091e-05 [renormalize]: 2.89991e-07 [validate]: 4.955e-05 Sums bootstrap : 0.000400s : 1.05% type_inference : 0.020081s : 52.97% event_method : 0.000020s : 0.05% auto_monad : 0.000071s : 0.19% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000068s : 0.18% rewriter_before_opt_a : 0.000082s : 0.22% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.18% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000669s : 1.76% jit_opt_a.with_stream_mark : 0.000028s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001033s : 2.72% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000034s : 0.09% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000033s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000557s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000023s : 0.06% loop_unroll : 0.013493s : 35.59% jit_opt_after_cconv.c_1 : 0.000029s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000058s : 0.15% cse_after_recomputation.cse : 0.000016s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000591s : 1.56% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.13% TotalTime = 0.0191456, [30] [bootstrap]: 0.0003903 [type_inference]: 0.00983031 [event_method]: 2.236e-05 [auto_monad]: 6.879e-05 [graph_reusing]: 5.83002e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 5.399e-05 [rewriter_before_opt_a]: 8.337e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00640523, [2] [Cycle 1]: 0.00250521, [27] [switch_simplify]: 6.747e-05 [loop_unroll]: 3.352e-05 [a_1]: 0.00072818 [with_stream_mark]: 2.31e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.34999e-06 [renormalize]: 0.00115713 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.889e-05 [cse]: 3.957e-05 [replace_applicator]: 1.737e-05 [Cycle 2]: 0.00034518, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.76e-06 [a_1]: 9.737e-05 [with_stream_mark]: 1.121e-05 [recompute_prepare]: 5.36998e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 8.69998e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.81002e-06 [inline_without_move]: 5.22e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.44e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.414e-05 [rewriter_after_opt_a]: 3.973e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00066436 [jit_opt_b]: 5.27e-05, [1] [Cycle 1]: 4.595e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.594e-05 [cconv]: 2.884e-05 [loop_unroll]: 0.0004286 [jit_opt_after_cconv]: 0.00017191, [1] [Cycle 1]: 0.00016582, [11] [c_1]: 2.344e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 6.14001e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.424e-05 [call_graph_tuple_transform]: 3.846e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 3.52e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 4.77e-06 [add_recomputation]: 3.408e-05 [cse_after_recomputation]: 2.496e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.32e-05 [auto_monad_reorder]: 1.265e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.69002e-06 [opt_after_jit_grad]: 0.00046231 [symbol_engine_optimizer]: 7.938e-05, [1] [Cycle 1]: 7.329e-05, [6] [build]: 2.99999e-06 [elim_shapecalc]: 9.44e-06 [elim_not_effective]: 1.463e-05 [opt_reshape]: 7.26001e-06 [fold_const_symbol]: 9.83002e-06 [renormalize]: 5.09986e-07 [validate]: 3.436e-05 Sums bootstrap : 0.000390s : 2.62% type_inference : 0.009830s : 66.11% event_method : 0.000022s : 0.15% auto_monad : 0.000069s : 0.46% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000054s : 0.36% rewriter_before_opt_a : 0.000083s : 0.56% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.50% jit_opt_a.loop_unroll : 0.000039s : 0.26% jit_opt_a.a_1 : 0.000826s : 5.55% jit_opt_a.with_stream_mark : 0.000034s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.13% jit_opt_a.inline_without_move : 0.000012s : 0.08% jit_opt_a.renormalize : 0.001157s : 7.78% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.17% jit_opt_a.cse : 0.000054s : 0.36% jit_opt_a.replace_applicator : 0.000023s : 0.16% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000040s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000664s : 4.47% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000029s : 0.19% loop_unroll : 0.000429s : 2.88% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.26% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000035s : 0.24% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.03% add_recomputation : 0.000034s : 0.23% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000013s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000462s : 3.11% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000034s : 0.23% Time group info: ------[substitution.] 0.000228 23 1.16% : 0.000003s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 2.80% : 0.000006s : 3: substitution.graph_param_transform 83.78% : 0.000191s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000006s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 5.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019986 2 92.80% : 0.018547s : 1: type_inference.infer 7.20% : 0.001440s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.31% : 0.000055s : 4: replace.inline 33.69% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.03% : 0.000188s : 4: match.inline 5.97% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.11% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.90% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.30% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.96% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 3.33% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 1.45% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 2.11% : 0.000003s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 16: predicate.switch_defer_inline 1.83% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.88% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.53% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001046 13 52.21% : 0.000546s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.50% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.29% : 0.000463s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044804 72 0.13% : 0.000060s : 1: add_recomputation 0.17% : 0.000075s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.93% : 0.000416s : 1: bootstrap 0.06% : 0.000026s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000034s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 14.87% : 0.006663s : 1: jit_opt_a 0.41% : 0.000181s : 1: jit_opt_after_cconv 0.12% : 0.000052s : 1: jit_opt_b 30.15% : 0.013508s : 1: loop_unroll 1.26% : 0.000565s : 1: mutable_eliminate 1.99% : 0.000893s : 26: opt.transform.jit_opt_a 0.14% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000029s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000012s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.34% : 0.000599s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000071s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 1.25% : 0.000560s : 1: renormalize.infer 1.04% : 0.000465s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000036s : 1: rewriter_after_opt_a 0.19% : 0.000086s : 1: rewriter_before_opt_a 0.19% : 0.000084s : 1: symbol_engine_optimizer 44.85% : 0.020097s : 1: type_inference Time group info: ------[substitution.] 0.000323 24 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 7.40% : 0.000024s : 3: substitution.graph_param_transform 83.83% : 0.000271s : 5: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.62% : 0.000005s : 2: substitution.replace_old_param 3.52% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009759 2 87.38% : 0.008527s : 1: type_inference.infer 12.62% : 0.001232s : 1: type_inference.specialize ------[replace.] 0.000112 7 66.35% : 0.000074s : 5: replace.inline 33.65% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000277 7 96.31% : 0.000267s : 5: match.inline 3.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.14% : 0.000001s : 11: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.88% : 0.000002s : 11: predicate.arithmetic_simplify 1.66% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.20% : 0.000002s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.30% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.36% : 0.000007s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 16: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.07% : 0.000001s : 11: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 16: predicate.partial_eliminate 1.30% : 0.000002s : 11: predicate.print_const_string_wrapper 2.04% : 0.000003s : 11: predicate.reduce_eliminate 1.87% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 11: predicate.reshape_eliminate 1.35% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.68% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.74% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.64% : 0.000010s : 59: predicate.switch_simplify 1.55% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.96% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001013 16 47.84% : 0.000485s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.29% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.87% : 0.000434s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021457 72 0.17% : 0.000037s : 1: add_recomputation 0.33% : 0.000072s : 1: auto_monad 0.07% : 0.000015s : 1: auto_monad_reorder 1.89% : 0.000406s : 1: bootstrap 0.15% : 0.000031s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000007s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.87% : 0.006410s : 1: jit_opt_a 0.81% : 0.000175s : 1: jit_opt_after_cconv 0.26% : 0.000055s : 1: jit_opt_b 2.03% : 0.000436s : 1: loop_unroll 3.13% : 0.000672s : 1: mutable_eliminate 4.98% : 0.001069s : 26: opt.transform.jit_opt_a 0.33% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.19% : 0.000469s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000056s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000038s : 1: remove_dup_value 3.04% : 0.000653s : 1: renormalize.infer 2.31% : 0.000495s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000043s : 1: rewriter_after_opt_a 0.40% : 0.000086s : 1: rewriter_before_opt_a 0.38% : 0.000082s : 1: symbol_engine_optimizer 45.87% : 0.009843s : 1: type_inference TotalTime = 0.0447889, [30] [bootstrap]: 0.00029299 [type_inference]: 0.0347495 [event_method]: 2.184e-05 [auto_monad]: 6.694e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 9.238e-05 [rewriter_before_opt_a]: 8.428e-05 [expand_dump_flag]: 2.90002e-06 [jit_opt_a]: 0.00705576, [2] [Cycle 1]: 0.00209691, [27] [switch_simplify]: 6.192e-05 [loop_unroll]: 2.878e-05 [a_1]: 0.00058963 [with_stream_mark]: 2.391e-05 [recompute_prepare]: 8.72e-06 [updatestate_depend_eliminate]: 4.82998e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 9.03002e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00104432 [add_forward_monad_depend]: 6.53e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.399e-05 [cse]: 3.352e-05 [replace_applicator]: 1.347e-05 [Cycle 2]: 0.00032154, [27] [switch_simplify]: 5.93998e-06 [loop_unroll]: 5.25999e-06 [a_1]: 8.76e-05 [with_stream_mark]: 1.095e-05 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.21998e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 2.96999e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.302e-05 [j_node_and_user_rematch]: 7.79997e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.25e-06 [inline_without_move]: 4.84e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.54998e-06 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.313e-05 [replace_applicator]: 5.19003e-06 [py_interpret_to_execute_after_opt_a]: 1.324e-05 [rewriter_after_opt_a]: 3.998e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00079792 [jit_opt_b]: 5.15e-05, [1] [Cycle 1]: 4.361e-05, [2] [frontend_op_eliminate]: 1.571e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 3.229e-05 [loop_unroll]: 0.00042102 [jit_opt_after_cconv]: 0.00015322, [1] [Cycle 1]: 0.00014694, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 3.53999e-06 [updatestate_depend_eliminate]: 7.08998e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.82e-05 [call_graph_tuple_transform]: 2.113e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.11002e-06 [remove_dup_value]: 1.602e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.74001e-06 [add_recomputation]: 5.137e-05 [cse_after_recomputation]: 2.186e-05, [1] [Cycle 1]: 1.695e-05, [1] [cse]: 1.145e-05 [auto_monad_reorder]: 2.725e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 7.2e-06 [opt_after_jit_grad]: 0.0004603 [symbol_engine_optimizer]: 7.301e-05, [1] [Cycle 1]: 6.664e-05, [6] [build]: 4.30999e-06 [elim_shapecalc]: 7.53e-06 [elim_not_effective]: 1.251e-05 [opt_reshape]: 5.41998e-06 [fold_const_symbol]: 9.32001e-06 [renormalize]: 7.30011e-07 [validate]: 4.067e-05 Sums bootstrap : 0.000293s : 0.74% type_inference : 0.034750s : 87.85% event_method : 0.000022s : 0.06% auto_monad : 0.000067s : 0.17% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000092s : 0.23% rewriter_before_opt_a : 0.000084s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.17% jit_opt_a.loop_unroll : 0.000034s : 0.09% jit_opt_a.a_1 : 0.000677s : 1.71% jit_opt_a.with_stream_mark : 0.000035s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001044s : 2.64% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.05% jit_opt_a.cse : 0.000047s : 0.12% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000798s : 2.02% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000032s : 0.08% loop_unroll : 0.000421s : 1.06% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000051s : 0.13% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000027s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000460s : 1.16% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.10% Time group info: ------[substitution.] 0.000245 23 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 3: substitution.graph_param_transform 86.14% : 0.000211s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000004s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 4.91% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034672 2 95.71% : 0.033183s : 1: type_inference.infer 4.29% : 0.001488s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.31% : 0.000053s : 4: replace.inline 30.69% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 95.05% : 0.000208s : 4: match.inline 4.95% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.23% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.10% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.20% : 0.000003s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.17% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000885 13 47.54% : 0.000421s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.20% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.26% : 0.000409s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046788 72 0.12% : 0.000054s : 1: add_recomputation 0.15% : 0.000070s : 1: auto_monad 0.06% : 0.000030s : 1: auto_monad_reorder 0.67% : 0.000313s : 1: bootstrap 0.07% : 0.000035s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.09% : 0.007059s : 1: jit_opt_a 0.33% : 0.000156s : 1: jit_opt_after_cconv 0.12% : 0.000055s : 1: jit_opt_b 0.92% : 0.000429s : 1: loop_unroll 1.73% : 0.000809s : 1: mutable_eliminate 1.92% : 0.000899s : 26: opt.transform.jit_opt_a 0.11% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.00% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000096s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.32% : 0.000617s : 1: renormalize.infer 0.90% : 0.000419s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000043s : 1: rewriter_after_opt_a 0.19% : 0.000088s : 1: rewriter_before_opt_a 0.16% : 0.000075s : 1: symbol_engine_optimizer 74.31% : 0.034768s : 1: type_inference TotalTime = 0.161248, [30] [bootstrap]: 0.00023296 [type_inference]: 0.122761 [event_method]: 0.00045009 [auto_monad]: 0.00010634 [graph_reusing]: 8.32e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 3.731e-05 [rewriter_before_opt_a]: 0.00012285 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.035257, [3] [Cycle 1]: 0.0159218, [27] [switch_simplify]: 7.437e-05 [loop_unroll]: 4.918e-05 [a_1]: 0.00099687 [with_stream_mark]: 2.867e-05 [recompute_prepare]: 1.975e-05 [updatestate_depend_eliminate]: 8.70999e-06 [updatestate_assign_eliminate]: 7.1e-06 [updatestate_loads_eliminate]: 6.88e-06 [parameter_eliminate]: 2.84001e-06 [specialize_transform]: 1.429e-05 [updatestate_useless_node_eliminater]: 1.331e-05 [accelerated_algorithm]: 1.338e-05 [meta_shard_fg_expand]: 3.48e-06 [get_grad_eliminate_]: 1.338e-05 [merge_forward]: 8.67e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.836e-05 [j_node_and_user_rematch]: 2.38e-05 [meta_fg_expand]: 0.00163844 [replace_old_param]: 6.374e-05 [inline_without_move]: 6.404e-05 [renormalize]: 0.0120681 [add_forward_monad_depend]: 1.381e-05 [auto_monad_grad]: 6.49999e-06 [auto_monad_eliminator]: 6.979e-05 [cse]: 0.00033108 [replace_applicator]: 9.544e-05 [Cycle 2]: 0.0157122, [27] [switch_simplify]: 4.535e-05 [loop_unroll]: 4.29e-05 [a_1]: 0.00124201 [with_stream_mark]: 1.973e-05 [recompute_prepare]: 1.089e-05 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 4.15e-06 [updatestate_loads_eliminate]: 4.43999e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 8.54e-06 [updatestate_useless_node_eliminater]: 8.28001e-06 [accelerated_algorithm]: 8.69998e-06 [meta_shard_fg_expand]: 2.68998e-06 [get_grad_eliminate_]: 8.16002e-06 [merge_forward]: 4.98001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.947e-05 [j_node_and_user_rematch]: 1.408e-05 [meta_fg_expand]: 0.00010692 [replace_old_param]: 1.003e-05 [inline_without_move]: 8.43999e-06 [renormalize]: 0.0138458 [add_forward_monad_depend]: 1.115e-05 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 2.117e-05 [cse]: 3.272e-05 [replace_applicator]: 2.366e-05 [Cycle 3]: 0.00035736, [27] [switch_simplify]: 6.53998e-06 [loop_unroll]: 2.168e-05 [a_1]: 7.929e-05 [with_stream_mark]: 1.454e-05 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 4.29002e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.53001e-06 [accelerated_algorithm]: 5.07999e-06 [meta_shard_fg_expand]: 2.38002e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 3.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 4.85999e-06 [inline_without_move]: 4.35e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.41998e-06 [cse]: 1.295e-05 [replace_applicator]: 4.57998e-06 [py_interpret_to_execute_after_opt_a]: 1.552e-05 [rewriter_after_opt_a]: 3.703e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.76997e-06 [mutable_eliminate]: 0.00072056 [jit_opt_b]: 4.764e-05, [1] [Cycle 1]: 4.028e-05, [2] [frontend_op_eliminate]: 1.408e-05 [inline_after_opt_a]: 1.47e-05 [cconv]: 2.737e-05 [loop_unroll]: 0.00040785 [jit_opt_after_cconv]: 0.00014469, [1] [Cycle 1]: 0.00013855, [11] [c_1]: 1.745e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.78002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.344e-05 [call_graph_tuple_transform]: 1.751e-05 [tuple_list_get_item_eliminator]: 5.04998e-06 [none_parameter_eliminate]: 1.51002e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 5.09e-06 [remove_dup_value]: 1.663e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 5.89e-06 [add_recomputation]: 4.353e-05 [cse_after_recomputation]: 2.367e-05, [1] [Cycle 1]: 1.848e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 1.556e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 5.75001e-06 [opt_after_jit_grad]: 0.00043825 [symbol_engine_optimizer]: 7.259e-05, [1] [Cycle 1]: 6.621e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 6.81001e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 5.61998e-06 [fold_const_symbol]: 7.74002e-06 [renormalize]: 4.50003e-07 [validate]: 3.643e-05 Sums bootstrap : 0.000233s : 0.15% type_inference : 0.122761s : 78.15% event_method : 0.000450s : 0.29% auto_monad : 0.000106s : 0.07% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.02% rewriter_before_opt_a : 0.000123s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000114s : 0.07% jit_opt_a.a_1 : 0.002318s : 1.48% jit_opt_a.with_stream_mark : 0.000063s : 0.04% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.001747s : 1.11% jit_opt_a.replace_old_param : 0.000079s : 0.05% jit_opt_a.inline_without_move : 0.000077s : 0.05% jit_opt_a.renormalize : 0.025914s : 16.50% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000097s : 0.06% jit_opt_a.cse : 0.000377s : 0.24% jit_opt_a.replace_applicator : 0.000124s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000721s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000408s : 0.26% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000044s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000438s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.02% Time group info: ------[substitution.] 0.000589 112 0.30% : 0.000002s : 2: substitution.elim_not_effective 0.22% : 0.000001s : 2: substitution.fold_const_symbol 0.89% : 0.000005s : 2: substitution.graph_param_transform 64.61% : 0.000381s : 13: substitution.inline 2.91% : 0.000017s : 2: substitution.inline_without_move 1.71% : 0.000010s : 14: substitution.j_node_and_user_rematch 2.04% : 0.000012s : 7: substitution.minmaximum_grad 1.42% : 0.000008s : 5: substitution.partial_eliminate 2.01% : 0.000012s : 14: substitution.remove_not_recompute_node 5.52% : 0.000033s : 10: substitution.replace_applicator 1.08% : 0.000006s : 10: substitution.replace_old_param 1.23% : 0.000007s : 1: substitution.reshape_eliminate 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.24% : 0.000007s : 1: substitution.tile_eliminate 3.98% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.82% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.61% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122667 2 97.70% : 0.119840s : 1: type_inference.infer 2.30% : 0.002827s : 1: type_inference.specialize ------[replace.] 0.000181 20 65.53% : 0.000119s : 13: replace.inline 34.47% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000395 20 94.38% : 0.000373s : 13: match.inline 5.62% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000404 2740 1.69% : 0.000007s : 47: predicate.accumulaten_eliminater 0.33% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.45% : 0.000006s : 47: predicate.addn_check_dump 1.65% : 0.000007s : 47: predicate.addn_zero_filter 2.01% : 0.000008s : 47: predicate.arithmetic_simplify 1.62% : 0.000007s : 47: predicate.cast_eliminate 0.16% : 0.000001s : 2: predicate.check_bprop_eliminate 1.41% : 0.000006s : 47: predicate.compare_switch_simplify 1.55% : 0.000006s : 47: predicate.depend_value_elim 1.43% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.49% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.12% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.44% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.41% : 0.000006s : 47: predicate.environ_get_depend_swap 1.55% : 0.000006s : 47: predicate.environ_get_eliminate 1.45% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.78% : 0.000003s : 20: predicate.get_grad_eliminate 0.09% : 0.000000s : 2: predicate.graph_param_transform 4.33% : 0.000017s : 71: predicate.inline 1.89% : 0.000008s : 48: predicate.inline_without_move 0.36% : 0.000001s : 20: predicate.j_node_and_user_rematch 1.04% : 0.000004s : 20: predicate.less_batch_normalization 1.88% : 0.000008s : 54: predicate.list_to_tuple_eliminator_ 1.85% : 0.000007s : 56: predicate.load_eliminater 0.35% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.43% : 0.000014s : 95: predicate.loop_unroll_before_grad 1.74% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.39% : 0.000006s : 47: predicate.merge_addn 1.61% : 0.000006s : 47: predicate.minmaximum_grad 0.45% : 0.000002s : 2: predicate.mutable_eliminate 0.15% : 0.000001s : 2: predicate.opt_reshape 2.30% : 0.000009s : 56: predicate.partial_eliminate 1.47% : 0.000006s : 47: predicate.print_const_string_wrapper 2.05% : 0.000008s : 47: predicate.reduce_eliminate 1.85% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 20: predicate.remove_not_recompute_node 2.92% : 0.000012s : 103: predicate.replace_applicator 1.05% : 0.000004s : 48: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.66% : 0.000007s : 47: predicate.reshape_eliminate 1.62% : 0.000007s : 47: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 2: predicate.row_tensor_eliminate 1.57% : 0.000006s : 47: predicate.same_eliminate 0.49% : 0.000002s : 20: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 4: predicate.special_op_eliminate 0.84% : 0.000003s : 20: predicate.specialize_transform 1.72% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000007s : 47: predicate.stack_unstack_eliminate 0.14% : 0.000001s : 2: predicate.switch_call_monad_eliminater 2.74% : 0.000011s : 67: predicate.switch_defer_inline 2.42% : 0.000010s : 67: predicate.switch_layer_defer_inline 6.57% : 0.000026s : 164: predicate.switch_simplify 1.56% : 0.000006s : 47: predicate.tile_eliminate 1.49% : 0.000006s : 47: predicate.transpose_eliminate 1.89% : 0.000008s : 47: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000013s : 58: predicate.tuple_list_get_item_eliminator 1.87% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.74% : 0.000007s : 54: predicate.tuple_to_list_eliminator_ 1.90% : 0.000008s : 56: predicate.updatestate_pure_node_eliminater 2.78% : 0.000011s : 76: predicate.updatestate_useless_node_eliminater 1.95% : 0.000008s : 47: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003597 45 73.87% : 0.002657s : 28: func_graph_cloner_run.FuncGraphClonerGraph 26.13% : 0.000940s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.190223 87 0.02% : 0.000046s : 1: add_recomputation 0.06% : 0.000113s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.13% : 0.000252s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.24% : 0.000459s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 18.54% : 0.035260s : 1: jit_opt_a 0.08% : 0.000147s : 1: jit_opt_after_cconv 0.03% : 0.000050s : 1: jit_opt_b 0.22% : 0.000416s : 1: loop_unroll 0.38% : 0.000730s : 1: mutable_eliminate 1.60% : 0.003042s : 39: opt.transform.jit_opt_a 0.02% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000446s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000040s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 12.38% : 0.023543s : 2: renormalize.infer 1.23% : 0.002345s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000126s : 1: rewriter_before_opt_a 0.04% : 0.000075s : 1: symbol_engine_optimizer 64.55% : 0.122781s : 1: type_inference TotalTime = 0.0181478, [30] [bootstrap]: 0.00031201 [type_inference]: 0.00914349 [event_method]: 2.103e-05 [auto_monad]: 6.787e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 5.477e-05 [rewriter_before_opt_a]: 8.503e-05 [expand_dump_flag]: 2.91e-06 [jit_opt_a]: 0.00622711, [2] [Cycle 1]: 0.00242507, [27] [switch_simplify]: 6.475e-05 [loop_unroll]: 3.368e-05 [a_1]: 0.00093388 [with_stream_mark]: 1.811e-05 [recompute_prepare]: 8.72998e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 0.00101913 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.45e-05 [cse]: 3.909e-05 [replace_applicator]: 1.603e-05 [Cycle 2]: 0.00033795, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.41998e-06 [a_1]: 0.0001003 [with_stream_mark]: 8.43001e-06 [recompute_prepare]: 5.31002e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8.23001e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 6.77002e-06 [inline_without_move]: 5.09e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 5.49998e-06 [cse]: 1.423e-05 [replace_applicator]: 5.70001e-06 [py_interpret_to_execute_after_opt_a]: 1.258e-05 [rewriter_after_opt_a]: 3.786e-05 [convert_after_rewriter]: 7.10998e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00061228 [jit_opt_b]: 5.062e-05, [1] [Cycle 1]: 4.42e-05, [2] [frontend_op_eliminate]: 1.748e-05 [inline_after_opt_a]: 1.589e-05 [cconv]: 2.634e-05 [loop_unroll]: 0.0004123 [jit_opt_after_cconv]: 0.00016074, [1] [Cycle 1]: 0.00015429, [11] [c_1]: 2.22e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.86e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.366e-05 [call_graph_tuple_transform]: 1.952e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 3.491e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 5.82001e-06 [add_recomputation]: 4.869e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.92e-05, [1] [cse]: 1.268e-05 [auto_monad_reorder]: 1.737e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 4.90001e-06 [opt_after_jit_grad]: 0.00047931 [symbol_engine_optimizer]: 7.429e-05, [1] [Cycle 1]: 6.799e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 9.84999e-06 [renormalize]: 5.00004e-07 [validate]: 4.065e-05 Sums bootstrap : 0.000312s : 2.21% type_inference : 0.009143s : 64.89% event_method : 0.000021s : 0.15% auto_monad : 0.000068s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000055s : 0.39% rewriter_before_opt_a : 0.000085s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.50% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.001034s : 7.34% jit_opt_a.with_stream_mark : 0.000027s : 0.19% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001019s : 7.23% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.14% jit_opt_a.cse : 0.000053s : 0.38% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000038s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000612s : 4.35% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000026s : 0.19% loop_unroll : 0.000412s : 2.93% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000035s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000049s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000017s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000479s : 3.40% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.29% Time group info: ------[substitution.] 0.000278 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 1.95% : 0.000005s : 3: substitution.graph_param_transform 87.71% : 0.000244s : 5: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.59% : 0.000004s : 4: substitution.remove_not_recompute_node 1.24% : 0.000003s : 2: substitution.replace_old_param 4.98% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009071 2 86.99% : 0.007891s : 1: type_inference.infer 13.01% : 0.001180s : 1: type_inference.specialize ------[replace.] 0.000319 7 87.75% : 0.000280s : 5: replace.inline 12.25% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 7 95.10% : 0.000241s : 5: match.inline 4.90% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 11: predicate.addn_check_dump 1.46% : 0.000002s : 11: predicate.addn_zero_filter 1.89% : 0.000003s : 11: predicate.arithmetic_simplify 1.38% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 11: predicate.compare_switch_simplify 1.19% : 0.000002s : 11: predicate.depend_value_elim 1.23% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 11: predicate.environ_get_depend_swap 1.31% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.10% : 0.000007s : 24: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.87% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 16: predicate.load_eliminater 1.13% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.24% : 0.000002s : 11: predicate.minmaximum_grad 1.34% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.38% : 0.000002s : 11: predicate.print_const_string_wrapper 1.68% : 0.000002s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000003s : 19: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 11: predicate.reshape_eliminate 1.49% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.92% : 0.000004s : 18: predicate.switch_defer_inline 2.33% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.05% : 0.000011s : 59: predicate.switch_simplify 1.36% : 0.000002s : 11: predicate.tile_eliminate 1.93% : 0.000003s : 11: predicate.transpose_eliminate 1.52% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000961 16 49.75% : 0.000478s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.54% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.71% : 0.000410s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020491 72 0.25% : 0.000052s : 1: add_recomputation 0.35% : 0.000071s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.60% : 0.000329s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.41% : 0.006231s : 1: jit_opt_a 0.80% : 0.000163s : 1: jit_opt_after_cconv 0.26% : 0.000053s : 1: jit_opt_b 2.04% : 0.000419s : 1: loop_unroll 3.02% : 0.000620s : 1: mutable_eliminate 6.20% : 0.001270s : 26: opt.transform.jit_opt_a 0.24% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.37% : 0.000486s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000057s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000038s : 1: remove_dup_value 2.78% : 0.000570s : 1: renormalize.infer 2.15% : 0.000441s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000040s : 1: rewriter_after_opt_a 0.43% : 0.000088s : 1: rewriter_before_opt_a 0.37% : 0.000077s : 1: symbol_engine_optimizer 44.68% : 0.009155s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.685.277 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065dc0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.686.000 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0367128, [30] [bootstrap]: 0.00029284 [type_inference]: 0.0252313 [event_method]: 2.364e-05 [auto_monad]: 7.318e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00010569 [rewriter_before_opt_a]: 8.658e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00863447, [2] [Cycle 1]: 0.00211772, [27] [switch_simplify]: 6.824e-05 [loop_unroll]: 2.941e-05 [a_1]: 0.0006033 [with_stream_mark]: 2.666e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.03998e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 9.69972e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 6.06e-06 [renormalize]: 0.00104407 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.613e-05 [cse]: 3.292e-05 [replace_applicator]: 1.244e-05 [Cycle 2]: 0.00034233, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 4.90001e-06 [a_1]: 0.00010644 [with_stream_mark]: 1.056e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 2.32001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.378e-05 [j_node_and_user_rematch]: 8.23001e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.45001e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 6.61999e-06 [cse]: 1.358e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.433e-05 [rewriter_after_opt_a]: 3.938e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 4.84998e-06 [mutable_eliminate]: 0.0006384 [jit_opt_b]: 5.188e-05, [1] [Cycle 1]: 4.333e-05, [2] [frontend_op_eliminate]: 1.531e-05 [inline_after_opt_a]: 1.684e-05 [cconv]: 2.805e-05 [loop_unroll]: 0.00042409 [jit_opt_after_cconv]: 0.00015231, [1] [Cycle 1]: 0.00014524, [11] [c_1]: 2.125e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 7.21001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 2.668e-05 [call_graph_tuple_transform]: 1.984e-05 [tuple_list_get_item_eliminator]: 5.37999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.554e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 5.384e-05 [cse_after_recomputation]: 2.295e-05, [1] [Cycle 1]: 1.761e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.703e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 5.30001e-06 [opt_after_jit_grad]: 0.00045467 [symbol_engine_optimizer]: 8.582e-05, [1] [Cycle 1]: 7.875e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 2.379e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 9.49999e-06 [renormalize]: 3.00002e-07 [validate]: 4.563e-05 Sums bootstrap : 0.000293s : 0.98% type_inference : 0.025231s : 84.26% event_method : 0.000024s : 0.08% auto_monad : 0.000073s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.35% rewriter_before_opt_a : 0.000087s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.25% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000710s : 2.37% jit_opt_a.with_stream_mark : 0.000037s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001044s : 3.49% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000047s : 0.16% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000638s : 2.13% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000028s : 0.09% loop_unroll : 0.000424s : 1.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000455s : 1.52% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.15% Time group info: ------[substitution.] 0.000282 23 4.39% : 0.000012s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000005s : 3: substitution.graph_param_transform 83.84% : 0.000237s : 4: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000006s : 2: substitution.replace_old_param 4.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025148 2 93.38% : 0.023483s : 1: type_inference.infer 6.62% : 0.001666s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.99% : 0.000053s : 4: replace.inline 30.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 6 95.27% : 0.000234s : 4: match.inline 4.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.15% : 0.000002s : 10: predicate.accumulaten_eliminater 0.88% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.08% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 0.94% : 0.000001s : 10: predicate.compare_switch_simplify 1.03% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.00% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.00% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_depend_swap 1.03% : 0.000001s : 10: predicate.environ_get_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.41% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 0.94% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.01% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.23% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.04% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.21% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.73% : 0.000009s : 53: predicate.switch_simplify 1.00% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000002s : 10: predicate.transpose_eliminate 1.15% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 16.32% : 0.000022s : 18: predicate.tuple_list_get_item_eliminator 1.22% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.28% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000913 13 43.50% : 0.000397s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.30% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.20% : 0.000458s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038756 72 0.15% : 0.000057s : 1: add_recomputation 0.20% : 0.000077s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.80% : 0.000310s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 22.29% : 0.008638s : 1: jit_opt_a 0.40% : 0.000155s : 1: jit_opt_after_cconv 0.14% : 0.000054s : 1: jit_opt_b 1.12% : 0.000433s : 1: loop_unroll 1.67% : 0.000648s : 1: mutable_eliminate 2.42% : 0.000938s : 26: opt.transform.jit_opt_a 0.13% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.19% : 0.000462s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000109s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.58% : 0.000612s : 1: renormalize.infer 1.09% : 0.000423s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.23% : 0.000090s : 1: rewriter_before_opt_a 0.23% : 0.000088s : 1: symbol_engine_optimizer 65.15% : 0.025251s : 1: type_inference TotalTime = 0.0206452, [30] [bootstrap]: 0.00042075 [type_inference]: 0.0104495 [event_method]: 2.304e-05 [auto_monad]: 7.702e-05 [graph_reusing]: 6.88e-06 [pre_auto_parallel]: 2.63998e-06 [py_interpret_to_execute]: 7.428e-05 [rewriter_before_opt_a]: 9.12e-05 [expand_dump_flag]: 3.20002e-06 [jit_opt_a]: 0.00690361, [2] [Cycle 1]: 0.00219887, [27] [switch_simplify]: 7.042e-05 [loop_unroll]: 3.332e-05 [a_1]: 0.00069911 [with_stream_mark]: 2.075e-05 [recompute_prepare]: 7.78999e-06 [updatestate_depend_eliminate]: 4.78001e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 6.95998e-06 [merge_forward]: 4.65999e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00101691 [add_forward_monad_depend]: 5.92999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.532e-05 [cse]: 3.951e-05 [replace_applicator]: 1.324e-05 [Cycle 2]: 0.00033054, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.36002e-06 [a_1]: 9.409e-05 [with_stream_mark]: 1.097e-05 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 5.21998e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.307e-05 [j_node_and_user_rematch]: 8.19002e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.07002e-06 [inline_without_move]: 5.49e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.33002e-06 [cse]: 1.467e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 1.321e-05 [rewriter_after_opt_a]: 3.839e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00073821 [jit_opt_b]: 5.694e-05, [1] [Cycle 1]: 4.856e-05, [2] [frontend_op_eliminate]: 1.857e-05 [inline_after_opt_a]: 1.828e-05 [cconv]: 3.193e-05 [loop_unroll]: 0.00053057 [jit_opt_after_cconv]: 0.00016461, [1] [Cycle 1]: 0.00015746, [11] [c_1]: 2.252e-05 [parameter_eliminate]: 3.27002e-06 [updatestate_depend_eliminate]: 7.60998e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.60002e-06 [cse]: 3.34e-05 [call_graph_tuple_transform]: 2.133e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.99999e-06 [remove_dup_value]: 3.917e-05 [partial_unused_args_eliminate]: 2.43002e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5.179e-05 [cse_after_recomputation]: 2.694e-05, [1] [Cycle 1]: 2.095e-05, [1] [cse]: 1.426e-05 [auto_monad_reorder]: 1.811e-05 [get_jit_bprop_graph]: 2.58e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.0005107 [symbol_engine_optimizer]: 8.156e-05, [1] [Cycle 1]: 7.37e-05, [6] [build]: 4.29997e-06 [elim_shapecalc]: 8.54e-06 [elim_not_effective]: 1.505e-05 [opt_reshape]: 6.29001e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 4.00003e-07 [validate]: 4.756e-05 Sums bootstrap : 0.000421s : 2.69% type_inference : 0.010450s : 66.83% event_method : 0.000023s : 0.15% auto_monad : 0.000077s : 0.49% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000074s : 0.48% rewriter_before_opt_a : 0.000091s : 0.58% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.49% jit_opt_a.loop_unroll : 0.000039s : 0.25% jit_opt_a.a_1 : 0.000793s : 5.07% jit_opt_a.with_stream_mark : 0.000032s : 0.20% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001017s : 6.50% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.14% jit_opt_a.cse : 0.000054s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.12% py_interpret_to_execute_after_opt_a : 0.000013s : 0.08% rewriter_after_opt_a : 0.000038s : 0.25% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000738s : 4.72% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000032s : 0.20% loop_unroll : 0.000531s : 3.39% jit_opt_after_cconv.c_1 : 0.000023s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000039s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000052s : 0.33% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000511s : 3.27% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.30% Time group info: ------[substitution.] 0.000281 24 0.91% : 0.000003s : 2: substitution.elim_not_effective 0.86% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000006s : 3: substitution.graph_param_transform 86.93% : 0.000244s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 1.49% : 0.000004s : 2: substitution.replace_old_param 4.90% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010348 2 86.06% : 0.008906s : 1: type_inference.infer 13.94% : 0.001442s : 1: type_inference.specialize ------[replace.] 0.000114 7 66.95% : 0.000077s : 5: replace.inline 33.05% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 7 95.07% : 0.000241s : 5: match.inline 4.93% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000003s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_depend_swap 1.35% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.78% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.93% : 0.000003s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 16: predicate.partial_eliminate 1.36% : 0.000002s : 11: predicate.print_const_string_wrapper 1.94% : 0.000003s : 11: predicate.reduce_eliminate 1.60% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 59: predicate.switch_simplify 1.53% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001083 16 50.37% : 0.000545s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.39% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.24% : 0.000468s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022756 72 0.32% : 0.000073s : 1: add_recomputation 0.35% : 0.000081s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.93% : 0.000438s : 1: bootstrap 0.15% : 0.000035s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.12% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 30.36% : 0.006908s : 1: jit_opt_a 0.73% : 0.000167s : 1: jit_opt_after_cconv 0.26% : 0.000060s : 1: jit_opt_b 2.37% : 0.000539s : 1: loop_unroll 3.29% : 0.000749s : 1: mutable_eliminate 4.54% : 0.001033s : 26: opt.transform.jit_opt_a 0.23% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000031s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000020s : 1: opt.transform.mutable_eliminate 0.11% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.28% : 0.000519s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000077s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000042s : 1: remove_dup_value 2.55% : 0.000579s : 1: renormalize.infer 1.89% : 0.000429s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000041s : 1: rewriter_after_opt_a 0.42% : 0.000095s : 1: rewriter_before_opt_a 0.37% : 0.000085s : 1: symbol_engine_optimizer 46.02% : 0.010473s : 1: type_inference TotalTime = 0.0935114, [30] [bootstrap]: 0.00028622 [type_inference]: 0.00735169 [event_method]: 1.886e-05 [auto_monad]: 7.055e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 4.145e-05 [rewriter_before_opt_a]: 7.487e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00703206, [2] [Cycle 1]: 0.00182516, [27] [switch_simplify]: 5.695e-05 [loop_unroll]: 2.945e-05 [a_1]: 0.000609 [with_stream_mark]: 2.16e-05 [recompute_prepare]: 7.92998e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.29e-06 [renormalize]: 0.00077148 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 1.547e-05 [cse]: 3.335e-05 [replace_applicator]: 1.234e-05 [Cycle 2]: 0.00031553, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 5.13002e-06 [a_1]: 9.214e-05 [with_stream_mark]: 9.34e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.49001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.63001e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.45999e-06 [merge_forward]: 2.54001e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.21e-05 [j_node_and_user_rematch]: 7.77998e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.85002e-06 [cse]: 1.008e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.028e-05 [rewriter_after_opt_a]: 3.706e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00060912 [jit_opt_b]: 5.059e-05, [1] [Cycle 1]: 4.315e-05, [2] [frontend_op_eliminate]: 1.601e-05 [inline_after_opt_a]: 1.566e-05 [cconv]: 2.827e-05 [loop_unroll]: 0.0763378 [jit_opt_after_cconv]: 0.00025779, [1] [Cycle 1]: 0.00024495, [11] [c_1]: 3.052e-05 [parameter_eliminate]: 8.41002e-06 [updatestate_depend_eliminate]: 1.732e-05 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 4.582e-05 [call_graph_tuple_transform]: 6.641e-05 [tuple_list_get_item_eliminator]: 7.49002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 1.01002e-06 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.96e-05 [partial_unused_args_eliminate]: 3.15998e-06 [environ_conv]: 8.95001e-06 [add_recomputation]: 6.493e-05 [cse_after_recomputation]: 2.455e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.152e-05 [auto_monad_reorder]: 1.677e-05 [get_jit_bprop_graph]: 2.83998e-06 [rewriter_after_jit_bprop_graph]: 1.135e-05 [opt_after_jit_grad]: 0.00078479 [symbol_engine_optimizer]: 7.763e-05, [1] [Cycle 1]: 7.086e-05, [6] [build]: 5.00001e-06 [elim_shapecalc]: 8.49998e-06 [elim_not_effective]: 1.399e-05 [opt_reshape]: 5.89999e-06 [fold_const_symbol]: 9.54999e-06 [renormalize]: 4.09986e-07 [validate]: 4.909e-05 Sums bootstrap : 0.000286s : 0.33% type_inference : 0.007352s : 8.36% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000041s : 0.05% rewriter_before_opt_a : 0.000075s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000701s : 0.80% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000010s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000772s : 0.88% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000043s : 0.05% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000037s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000609s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.076338s : 86.76% jit_opt_after_cconv.c_1 : 0.000031s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000066s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000065s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000785s : 0.89% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.06% Time group info: ------[substitution.] 0.000278 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 3.17% : 0.000009s : 3: substitution.graph_param_transform 86.10% : 0.000239s : 4: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 4.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007277 2 86.69% : 0.006309s : 1: type_inference.infer 13.31% : 0.000968s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.26% : 0.000048s : 4: replace.inline 33.74% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 6 95.39% : 0.000237s : 4: match.inline 4.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.08% : 0.000001s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.62% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.04% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.21% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 7.49% : 0.000010s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 6.40% : 0.000008s : 3: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.38% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.22% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 1.97% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.48% : 0.000002s : 10: predicate.reduce_eliminate 1.28% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.04% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.24% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 1.87% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.35% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.26% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.27% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000698 13 52.53% : 0.000367s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.52% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.96% : 0.000286s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.095334 72 0.07% : 0.000068s : 1: add_recomputation 0.08% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.32% : 0.000305s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.38% : 0.007035s : 1: jit_opt_a 0.27% : 0.000262s : 1: jit_opt_after_cconv 0.06% : 0.000053s : 1: jit_opt_b 80.11% : 0.076369s : 1: loop_unroll 0.65% : 0.000619s : 1: mutable_eliminate 0.96% : 0.000914s : 26: opt.transform.jit_opt_a 0.11% : 0.000107s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000048s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000795s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.05% : 0.000044s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 0.45% : 0.000428s : 1: renormalize.infer 0.35% : 0.000335s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000078s : 1: rewriter_before_opt_a 0.08% : 0.000081s : 1: symbol_engine_optimizer 7.73% : 0.007371s : 1: type_inference TotalTime = 0.143235, [30] [bootstrap]: 0.00030156 [type_inference]: 0.128024 [event_method]: 2.497e-05 [auto_monad]: 7.788e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.0006153 [rewriter_before_opt_a]: 9.67e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0108414, [2] [Cycle 1]: 0.00545096, [27] [switch_simplify]: 6.978e-05 [loop_unroll]: 3.047e-05 [a_1]: 0.00073517 [with_stream_mark]: 2.822e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 4.49002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.13002e-06 [specialize_transform]: 7.24001e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 1.222e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.237e-05 [inline_without_move]: 7.97e-06 [renormalize]: 0.00414625 [add_forward_monad_depend]: 1.18e-05 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 2.275e-05 [cse]: 3.541e-05 [replace_applicator]: 2.727e-05 [Cycle 2]: 0.00044351, [27] [switch_simplify]: 8.13999e-06 [loop_unroll]: 7.37002e-06 [a_1]: 0.00015797 [with_stream_mark]: 1.627e-05 [recompute_prepare]: 6.68998e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 4.17003e-06 [cell_reuse_recompute_pass]: 5.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.14e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 3.35e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 5.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 6.03002e-06 [cse]: 1.34e-05 [replace_applicator]: 7.00998e-06 [py_interpret_to_execute_after_opt_a]: 1.796e-05 [rewriter_after_opt_a]: 4.085e-05 [convert_after_rewriter]: 7.75998e-06 [order_py_execute_after_rewriter]: 5.77e-05 [mutable_eliminate]: 0.00093473 [jit_opt_b]: 7.196e-05, [1] [Cycle 1]: 6.207e-05, [2] [frontend_op_eliminate]: 2.416e-05 [inline_after_opt_a]: 2.398e-05 [cconv]: 3.278e-05 [loop_unroll]: 0.00053858 [jit_opt_after_cconv]: 0.00019172, [1] [Cycle 1]: 0.00018504, [11] [c_1]: 3.009e-05 [parameter_eliminate]: 4.53001e-06 [updatestate_depend_eliminate]: 9.33002e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 3.362e-05 [call_graph_tuple_transform]: 2.833e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 8.47e-06 [remove_dup_value]: 1.563e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 1.081e-05 [add_recomputation]: 5.95e-05 [cse_after_recomputation]: 2.412e-05, [1] [Cycle 1]: 1.819e-05, [1] [cse]: 1.202e-05 [auto_monad_reorder]: 1.714e-05 [get_jit_bprop_graph]: 2.92002e-06 [rewriter_after_jit_bprop_graph]: 1.062e-05 [opt_after_jit_grad]: 0.00064899 [symbol_engine_optimizer]: 0.0001016, [1] [Cycle 1]: 9.445e-05, [6] [build]: 6.00002e-06 [elim_shapecalc]: 9.76e-06 [elim_not_effective]: 1.61e-05 [opt_reshape]: 1.44e-05 [fold_const_symbol]: 1.538e-05 [renormalize]: 5.69999e-07 [validate]: 0.00024204 Sums bootstrap : 0.000302s : 0.22% type_inference : 0.128024s : 93.05% event_method : 0.000025s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000615s : 0.45% rewriter_before_opt_a : 0.000097s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000893s : 0.65% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004146s : 3.01% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000058s : 0.04% mutable_eliminate : 0.000935s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000024s : 0.02% cconv : 0.000033s : 0.02% loop_unroll : 0.000539s : 0.39% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000649s : 0.47% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000014s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000242s : 0.18% Time group info: ------[substitution.] 0.000328 24 0.63% : 0.000002s : 2: substitution.elim_not_effective 2.17% : 0.000007s : 2: substitution.fold_const_symbol 2.24% : 0.000007s : 4: substitution.graph_param_transform 85.40% : 0.000281s : 4: substitution.inline 1.58% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 4.15% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127907 2 96.82% : 0.123843s : 1: type_inference.infer 3.18% : 0.004064s : 1: type_inference.specialize ------[replace.] 0.000089 6 69.16% : 0.000062s : 4: replace.inline 30.84% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 6 95.69% : 0.000278s : 4: match.inline 4.31% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 2.45% : 0.000004s : 12: predicate.arithmetic_simplify 1.70% : 0.000003s : 12: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 0.98% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.89% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000008s : 26: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.48% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 12: predicate.merge_addn 0.94% : 0.000001s : 12: predicate.minmaximum_grad 1.97% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.67% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.57% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.78% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.08% : 0.000003s : 18: predicate.switch_defer_inline 1.79% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000011s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.25% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002813 22 61.53% : 0.001731s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.10% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.37% : 0.001023s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148460 72 0.04% : 0.000062s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.21% : 0.000318s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.01% : 0.000010s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.31% : 0.010845s : 1: jit_opt_a 0.13% : 0.000194s : 1: jit_opt_after_cconv 0.05% : 0.000075s : 1: jit_opt_b 0.37% : 0.000548s : 1: loop_unroll 0.64% : 0.000945s : 1: mutable_eliminate 0.79% : 0.001173s : 26: opt.transform.jit_opt_a 0.05% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000659s : 1: opt_after_jit_grad 0.04% : 0.000060s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000622s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.04% : 0.003027s : 1: renormalize.infer 0.74% : 0.001103s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000102s : 1: rewriter_before_opt_a 0.07% : 0.000104s : 1: symbol_engine_optimizer 86.25% : 0.128043s : 1: type_inference TotalTime = 0.133073, [30] [bootstrap]: 0.00025631 [type_inference]: 0.0939599 [event_method]: 0.00028648 [auto_monad]: 0.00010741 [graph_reusing]: 7.93001e-06 [pre_auto_parallel]: 3.06999e-06 [py_interpret_to_execute]: 3.664e-05 [rewriter_before_opt_a]: 0.00012543 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.0358414, [3] [Cycle 1]: 0.0230139, [27] [switch_simplify]: 8.177e-05 [loop_unroll]: 4.791e-05 [a_1]: 0.00110572 [with_stream_mark]: 3.582e-05 [recompute_prepare]: 2.183e-05 [updatestate_depend_eliminate]: 9.87001e-06 [updatestate_assign_eliminate]: 7.40998e-06 [updatestate_loads_eliminate]: 7.68999e-06 [parameter_eliminate]: 3.23e-06 [specialize_transform]: 1.691e-05 [updatestate_useless_node_eliminater]: 1.54e-05 [accelerated_algorithm]: 1.554e-05 [meta_shard_fg_expand]: 4.59998e-06 [get_grad_eliminate_]: 1.553e-05 [merge_forward]: 9.29e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.053e-05 [j_node_and_user_rematch]: 2.726e-05 [meta_fg_expand]: 0.00189091 [replace_old_param]: 7.18e-05 [inline_without_move]: 6.165e-05 [renormalize]: 0.0187828 [add_forward_monad_depend]: 1.49e-05 [auto_monad_grad]: 6.32001e-06 [auto_monad_eliminator]: 6.687e-05 [cse]: 0.00028896 [replace_applicator]: 9.44e-05 [Cycle 2]: 0.00882836, [27] [switch_simplify]: 4.571e-05 [loop_unroll]: 4.398e-05 [a_1]: 0.00124562 [with_stream_mark]: 2.248e-05 [recompute_prepare]: 1.209e-05 [updatestate_depend_eliminate]: 6.39999e-06 [updatestate_assign_eliminate]: 4.47e-06 [updatestate_loads_eliminate]: 4.22e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 9.08002e-06 [updatestate_useless_node_eliminater]: 8.90001e-06 [accelerated_algorithm]: 8.40001e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 8.23001e-06 [merge_forward]: 5.40999e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.513e-05 [j_node_and_user_rematch]: 1.463e-05 [meta_fg_expand]: 0.00012257 [replace_old_param]: 1.253e-05 [inline_without_move]: 8.72e-06 [renormalize]: 0.00689301 [add_forward_monad_depend]: 1.255e-05 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 2.412e-05 [cse]: 3.582e-05 [replace_applicator]: 2.531e-05 [Cycle 3]: 0.00034185, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.34e-06 [a_1]: 7.887e-05 [with_stream_mark]: 1.569e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.43999e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 2.88998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.825e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 4.32998e-06 [inline_without_move]: 4.33999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 1.40999e-06 [auto_monad_eliminator]: 6.72002e-06 [cse]: 1.186e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 1.512e-05 [rewriter_after_opt_a]: 3.856e-05 [convert_after_rewriter]: 7.20998e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00084798 [jit_opt_b]: 5.264e-05, [1] [Cycle 1]: 4.35e-05, [2] [frontend_op_eliminate]: 1.382e-05 [inline_after_opt_a]: 1.569e-05 [cconv]: 3.168e-05 [loop_unroll]: 0.00041992 [jit_opt_after_cconv]: 0.00014653, [1] [Cycle 1]: 0.00013998, [11] [c_1]: 1.869e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.255e-05 [call_graph_tuple_transform]: 1.882e-05 [tuple_list_get_item_eliminator]: 5.04003e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.00002e-07 [switch_simplify]: 5.07e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 4.731e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.491e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.91002e-06 [opt_after_jit_grad]: 0.00044655 [symbol_engine_optimizer]: 7.296e-05, [1] [Cycle 1]: 6.668e-05, [6] [build]: 4.3e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.247e-05 [opt_reshape]: 4.81002e-06 [fold_const_symbol]: 7.92e-06 [renormalize]: 4.59986e-07 [validate]: 3.716e-05 Sums bootstrap : 0.000256s : 0.20% type_inference : 0.093960s : 73.14% event_method : 0.000286s : 0.22% auto_monad : 0.000107s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.03% rewriter_before_opt_a : 0.000125s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000133s : 0.10% jit_opt_a.loop_unroll : 0.000097s : 0.08% jit_opt_a.a_1 : 0.002430s : 1.89% jit_opt_a.with_stream_mark : 0.000074s : 0.06% jit_opt_a.recompute_prepare : 0.000040s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000020s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000015s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000031s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000029s : 0.02% jit_opt_a.accelerated_algorithm : 0.000029s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000029s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000084s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000051s : 0.04% jit_opt_a.meta_fg_expand : 0.002016s : 1.57% jit_opt_a.replace_old_param : 0.000089s : 0.07% jit_opt_a.inline_without_move : 0.000075s : 0.06% jit_opt_a.renormalize : 0.025676s : 19.99% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000098s : 0.08% jit_opt_a.cse : 0.000337s : 0.26% jit_opt_a.replace_applicator : 0.000125s : 0.10% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000848s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000420s : 0.33% jit_opt_after_cconv.c_1 : 0.000019s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000447s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000645 112 0.27% : 0.000002s : 2: substitution.elim_not_effective 0.20% : 0.000001s : 2: substitution.fold_const_symbol 0.95% : 0.000006s : 2: substitution.graph_param_transform 66.34% : 0.000428s : 13: substitution.inline 2.85% : 0.000018s : 2: substitution.inline_without_move 1.81% : 0.000012s : 14: substitution.j_node_and_user_rematch 1.83% : 0.000012s : 7: substitution.minmaximum_grad 1.26% : 0.000008s : 5: substitution.partial_eliminate 2.01% : 0.000013s : 14: substitution.remove_not_recompute_node 5.07% : 0.000033s : 10: substitution.replace_applicator 1.28% : 0.000008s : 10: substitution.replace_old_param 1.28% : 0.000008s : 1: substitution.reshape_eliminate 0.39% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.12% : 0.000007s : 1: substitution.tile_eliminate 3.75% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.42% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.16% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.093848 2 97.54% : 0.091542s : 1: type_inference.infer 2.46% : 0.002306s : 1: type_inference.specialize ------[replace.] 0.000219 20 70.90% : 0.000156s : 13: replace.inline 29.10% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000444 20 94.70% : 0.000420s : 13: match.inline 5.30% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000402 2852 1.64% : 0.000007s : 49: predicate.accumulaten_eliminater 0.21% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.47% : 0.000006s : 49: predicate.addn_check_dump 1.63% : 0.000007s : 49: predicate.addn_zero_filter 2.06% : 0.000008s : 49: predicate.arithmetic_simplify 1.63% : 0.000007s : 49: predicate.cast_eliminate 0.12% : 0.000000s : 2: predicate.check_bprop_eliminate 1.42% : 0.000006s : 49: predicate.compare_switch_simplify 1.62% : 0.000007s : 49: predicate.depend_value_elim 1.43% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.62% : 0.000007s : 49: predicate.dict_get_item_eliminator 1.57% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.13% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000006s : 49: predicate.environ_add_const_eliminate 1.48% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.40% : 0.000006s : 49: predicate.environ_get_depend_swap 1.52% : 0.000006s : 49: predicate.environ_get_eliminate 1.39% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 2: predicate.fold_const_symbol 0.97% : 0.000004s : 21: predicate.get_grad_eliminate 0.05% : 0.000000s : 2: predicate.graph_param_transform 4.41% : 0.000018s : 73: predicate.inline 1.98% : 0.000008s : 49: predicate.inline_without_move 0.40% : 0.000002s : 21: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 21: predicate.less_batch_normalization 1.82% : 0.000007s : 56: predicate.list_to_tuple_eliminator_ 1.78% : 0.000007s : 58: predicate.load_eliminater 0.35% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.37% : 0.000014s : 102: predicate.loop_unroll_before_grad 1.68% : 0.000007s : 51: predicate.make_slice_get_slice_eliminator 1.40% : 0.000006s : 49: predicate.merge_addn 1.47% : 0.000006s : 49: predicate.minmaximum_grad 0.39% : 0.000002s : 2: predicate.mutable_eliminate 0.11% : 0.000000s : 2: predicate.opt_reshape 2.35% : 0.000009s : 58: predicate.partial_eliminate 1.53% : 0.000006s : 49: predicate.print_const_string_wrapper 2.15% : 0.000009s : 49: predicate.reduce_eliminate 1.86% : 0.000008s : 56: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000002s : 21: predicate.remove_not_recompute_node 2.85% : 0.000011s : 106: predicate.replace_applicator 1.23% : 0.000005s : 49: predicate.replace_old_param 0.06% : 0.000000s : 2: predicate.reset_defer_inline 1.67% : 0.000007s : 49: predicate.reshape_eliminate 1.56% : 0.000006s : 49: predicate.row_tensor_add_zeros_like 0.25% : 0.000001s : 2: predicate.row_tensor_eliminate 1.48% : 0.000006s : 49: predicate.same_eliminate 0.52% : 0.000002s : 21: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 4: predicate.special_op_eliminate 0.87% : 0.000004s : 21: predicate.specialize_transform 1.78% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000006s : 49: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.67% : 0.000011s : 69: predicate.switch_defer_inline 2.36% : 0.000010s : 69: predicate.switch_layer_defer_inline 6.40% : 0.000026s : 173: predicate.switch_simplify 1.55% : 0.000006s : 49: predicate.tile_eliminate 1.50% : 0.000006s : 49: predicate.transpose_eliminate 1.91% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.90% : 0.000008s : 49: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000014s : 60: predicate.tuple_list_get_item_eliminator 1.83% : 0.000007s : 49: predicate.tuple_list_set_item_eliminator 1.81% : 0.000007s : 56: predicate.tuple_to_list_eliminator_ 1.77% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.95% : 0.000012s : 79: predicate.updatestate_useless_node_eliminater 1.89% : 0.000008s : 49: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005659 64 80.63% : 0.004563s : 47: func_graph_cloner_run.FuncGraphClonerGraph 19.37% : 0.001096s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.161955 87 0.03% : 0.000050s : 1: add_recomputation 0.07% : 0.000115s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.17% : 0.000283s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.18% : 0.000295s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 22.13% : 0.035846s : 1: jit_opt_a 0.09% : 0.000149s : 1: jit_opt_after_cconv 0.03% : 0.000055s : 1: jit_opt_b 0.26% : 0.000427s : 1: loop_unroll 0.53% : 0.000857s : 1: mutable_eliminate 1.97% : 0.003185s : 39: opt.transform.jit_opt_a 0.03% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000454s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000039s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 14.15% : 0.022916s : 2: renormalize.infer 1.69% : 0.002734s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000129s : 1: rewriter_before_opt_a 0.05% : 0.000076s : 1: symbol_engine_optimizer 58.03% : 0.093985s : 1: type_inference TotalTime = 0.0168992, [30] [bootstrap]: 0.0003283 [type_inference]: 0.00493041 [event_method]: 1.75e-05 [auto_monad]: 6.336e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 3.583e-05 [rewriter_before_opt_a]: 7.534e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00573716, [2] [Cycle 1]: 0.00182266, [27] [switch_simplify]: 6.306e-05 [loop_unroll]: 2.858e-05 [a_1]: 0.00057257 [with_stream_mark]: 2.321e-05 [recompute_prepare]: 7.87998e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.446e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.00078364 [add_forward_monad_depend]: 6.48e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 3.605e-05 [replace_applicator]: 1.346e-05 [Cycle 2]: 0.00031877, [27] [switch_simplify]: 5.64998e-06 [loop_unroll]: 4.70999e-06 [a_1]: 8.621e-05 [with_stream_mark]: 9.53002e-06 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.54998e-06 [merge_forward]: 3.44001e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.406e-05 [j_node_and_user_rematch]: 7.61999e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.89e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.319e-05 [replace_applicator]: 4.95999e-06 [py_interpret_to_execute_after_opt_a]: 1.528e-05 [rewriter_after_opt_a]: 3.898e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00062766 [jit_opt_b]: 5.079e-05, [1] [Cycle 1]: 4.314e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.613e-05 [cconv]: 3.135e-05 [loop_unroll]: 0.0004308 [jit_opt_after_cconv]: 0.00016666, [1] [Cycle 1]: 0.00015966, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 4.48999e-06 [updatestate_depend_eliminate]: 8.35001e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.169e-05 [call_graph_tuple_transform]: 2.105e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 1.784e-05 [environ_conv]: 2.122e-05 [add_recomputation]: 7.874e-05 [cse_after_recomputation]: 6.929e-05, [1] [Cycle 1]: 5.7e-05, [1] [cse]: 3.64e-05 [auto_monad_reorder]: 2.329e-05 [get_jit_bprop_graph]: 2.59001e-06 [rewriter_after_jit_bprop_graph]: 1.09e-05 [opt_after_jit_grad]: 0.00075836 [symbol_engine_optimizer]: 0.00014845, [1] [Cycle 1]: 0.00014103, [6] [build]: 4.45e-06 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 1.849e-05 [opt_reshape]: 7.61999e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 9.00007e-07 [validate]: 5.249e-05 Sums bootstrap : 0.000328s : 3.40% type_inference : 0.004930s : 51.00% event_method : 0.000018s : 0.18% auto_monad : 0.000063s : 0.66% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.37% rewriter_before_opt_a : 0.000075s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.71% jit_opt_a.loop_unroll : 0.000033s : 0.34% jit_opt_a.a_1 : 0.000659s : 6.81% jit_opt_a.with_stream_mark : 0.000033s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000784s : 8.11% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.23% jit_opt_a.cse : 0.000049s : 0.51% jit_opt_a.replace_applicator : 0.000018s : 0.19% py_interpret_to_execute_after_opt_a : 0.000015s : 0.16% rewriter_after_opt_a : 0.000039s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000628s : 6.49% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000031s : 0.32% loop_unroll : 0.000431s : 4.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000032s : 0.33% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000018s : 0.18% environ_conv : 0.000021s : 0.22% add_recomputation : 0.000079s : 0.81% cse_after_recomputation.cse : 0.000036s : 0.38% auto_monad_reorder : 0.000023s : 0.24% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000011s : 0.11% opt_after_jit_grad : 0.000758s : 7.84% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.19% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000052s : 0.54% Time group info: ------[substitution.] 0.000244 23 1.03% : 0.000003s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.39% : 0.000006s : 3: substitution.graph_param_transform 85.70% : 0.000209s : 4: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004864 2 82.42% : 0.004009s : 1: type_inference.infer 17.58% : 0.000855s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.95% : 0.000049s : 4: replace.inline 31.05% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 6 94.76% : 0.000206s : 4: match.inline 5.24% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.46% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.22% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.85% : 0.000001s : 3: predicate.elim_not_effective 0.97% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 6.37% : 0.000007s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.65% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.65% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000002s : 3: predicate.mutable_eliminate 0.74% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.38% : 0.000002s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.55% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.35% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.79% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000681 13 51.18% : 0.000348s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.58% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.24% : 0.000281s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018606 72 0.44% : 0.000083s : 1: add_recomputation 0.36% : 0.000067s : 1: auto_monad 0.14% : 0.000026s : 1: auto_monad_reorder 1.88% : 0.000349s : 1: bootstrap 0.18% : 0.000034s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.39% : 0.000072s : 1: cse_after_recomputation 0.13% : 0.000024s : 1: environ_conv 0.11% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.85% : 0.005740s : 1: jit_opt_a 0.91% : 0.000170s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.36% : 0.000440s : 1: loop_unroll 3.43% : 0.000637s : 1: mutable_eliminate 4.71% : 0.000876s : 26: opt.transform.jit_opt_a 0.27% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000018s : 1: opt.transform.mutable_eliminate 0.17% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000041s : 4: opt.transform.symbol_engine_opt 4.13% : 0.000768s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.21% : 0.000039s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000038s : 1: py_interpret_to_execute 0.09% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 15.72% : 0.002924s : 1: remove_dup_value 2.36% : 0.000439s : 1: renormalize.infer 1.81% : 0.000336s : 1: renormalize.specialize 0.07% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.42% : 0.000079s : 1: rewriter_before_opt_a 0.81% : 0.000151s : 1: symbol_engine_optimizer 26.60% : 0.004949s : 1: type_inference .[WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.878.568 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004ddc0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:40.879.275 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0587214, [30] [bootstrap]: 0.00030678 [type_inference]: 0.00914765 [event_method]: 2.152e-05 [auto_monad]: 7.146e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 4.935e-05 [rewriter_before_opt_a]: 8.767e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.0466651, [2] [Cycle 1]: 0.0022231, [27] [switch_simplify]: 7.27e-05 [loop_unroll]: 3.605e-05 [a_1]: 0.00072341 [with_stream_mark]: 2.568e-05 [recompute_prepare]: 9.31998e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.66003e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.581e-05 [j_node_and_user_rematch]: 9.75002e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 0.00098567 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 2.91999e-06 [auto_monad_eliminator]: 1.831e-05 [cse]: 4.432e-05 [replace_applicator]: 1.652e-05 [Cycle 2]: 0.00034852, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.53002e-06 [a_1]: 9.74e-05 [with_stream_mark]: 1.302e-05 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.59998e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.569e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 7.30998e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.40024e-07 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.508e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 4.288e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00064159 [jit_opt_b]: 5.157e-05, [1] [Cycle 1]: 4.411e-05, [2] [frontend_op_eliminate]: 1.598e-05 [inline_after_opt_a]: 1.59e-05 [cconv]: 2.881e-05 [loop_unroll]: 0.00042593 [jit_opt_after_cconv]: 0.00015496, [1] [Cycle 1]: 0.00014841, [11] [c_1]: 2.094e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 6.53e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 2.814e-05 [call_graph_tuple_transform]: 2.131e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 4.016e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 6.09001e-06 [add_recomputation]: 8.164e-05 [cse_after_recomputation]: 3.383e-05, [1] [Cycle 1]: 2.105e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 2.003e-05 [get_jit_bprop_graph]: 1.136e-05 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.00047843 [symbol_engine_optimizer]: 7.593e-05, [1] [Cycle 1]: 6.918e-05, [6] [build]: 4.67e-06 [elim_shapecalc]: 8.09002e-06 [elim_not_effective]: 1.423e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 9.02999e-06 [renormalize]: 3.50003e-07 [validate]: 4.344e-05 Sums bootstrap : 0.000307s : 2.19% type_inference : 0.009148s : 65.33% event_method : 0.000022s : 0.15% auto_monad : 0.000071s : 0.51% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.35% rewriter_before_opt_a : 0.000088s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000079s : 0.57% jit_opt_a.loop_unroll : 0.000042s : 0.30% jit_opt_a.a_1 : 0.000821s : 5.86% jit_opt_a.with_stream_mark : 0.000039s : 0.28% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000986s : 7.04% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.17% jit_opt_a.cse : 0.000059s : 0.42% jit_opt_a.replace_applicator : 0.000023s : 0.16% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000043s : 0.31% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000642s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000029s : 0.21% loop_unroll : 0.000426s : 3.04% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000040s : 0.29% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000082s : 0.58% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000020s : 0.14% get_jit_bprop_graph : 0.000011s : 0.08% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000478s : 3.42% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.31% Time group info: ------[substitution.] 0.000303 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.01% : 0.000006s : 3: substitution.graph_param_transform 87.39% : 0.000265s : 5: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.75% : 0.000005s : 2: substitution.replace_old_param 4.49% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009075 2 88.86% : 0.008064s : 1: type_inference.infer 11.14% : 0.001011s : 1: type_inference.specialize ------[replace.] 0.000103 7 67.76% : 0.000070s : 5: replace.inline 32.24% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 95.47% : 0.000262s : 5: match.inline 4.53% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 1.88% : 0.000003s : 11: predicate.arithmetic_simplify 1.52% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.62% : 0.000001s : 3: predicate.graph_param_transform 6.58% : 0.000009s : 24: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.13% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.93% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000000s : 3: predicate.opt_reshape 2.73% : 0.000004s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 1.75% : 0.000002s : 11: predicate.reduce_eliminate 1.37% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000003s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 11: predicate.reshape_eliminate 1.16% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.75% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.44% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.33% : 0.000011s : 59: predicate.switch_simplify 1.22% : 0.000002s : 11: predicate.tile_eliminate 1.57% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000864 16 51.40% : 0.000444s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.51% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.09% : 0.000329s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060831 72 0.14% : 0.000086s : 1: add_recomputation 0.12% : 0.000075s : 1: auto_monad 0.04% : 0.000023s : 1: auto_monad_reorder 0.54% : 0.000328s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000014s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 76.72% : 0.046668s : 1: jit_opt_a 0.26% : 0.000158s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.71% : 0.000434s : 1: loop_unroll 1.07% : 0.000651s : 1: mutable_eliminate 1.76% : 0.001074s : 26: opt.transform.jit_opt_a 0.08% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000052s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000043s : 1: remove_dup_value 0.99% : 0.000603s : 1: renormalize.infer 0.61% : 0.000373s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000046s : 1: rewriter_after_opt_a 0.15% : 0.000091s : 1: rewriter_before_opt_a 0.13% : 0.000078s : 1: symbol_engine_optimizer 15.07% : 0.009167s : 1: type_inference TotalTime = 0.0180659, [30] [bootstrap]: 0.00030854 [type_inference]: 0.00903506 [event_method]: 2.185e-05 [auto_monad]: 7.008e-05 [graph_reusing]: 6.50002e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 4.715e-05 [rewriter_before_opt_a]: 8.5e-05 [expand_dump_flag]: 3.22002e-06 [jit_opt_a]: 0.00615579, [2] [Cycle 1]: 0.0022931, [27] [switch_simplify]: 6.576e-05 [loop_unroll]: 3.327e-05 [a_1]: 0.00068596 [with_stream_mark]: 2.393e-05 [recompute_prepare]: 9.07001e-06 [updatestate_depend_eliminate]: 4.86002e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.37002e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 7.08998e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.83e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 6.21998e-06 [renormalize]: 0.00109283 [add_forward_monad_depend]: 6.79001e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.895e-05 [cse]: 4.485e-05 [replace_applicator]: 1.554e-05 [Cycle 2]: 0.00035757, [27] [switch_simplify]: 6.61e-06 [loop_unroll]: 5.40999e-06 [a_1]: 0.00010163 [with_stream_mark]: 1.167e-05 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 3.10998e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.743e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 1.492e-05 [rewriter_after_opt_a]: 4.337e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00065504 [jit_opt_b]: 5.176e-05, [1] [Cycle 1]: 4.507e-05, [2] [frontend_op_eliminate]: 1.681e-05 [inline_after_opt_a]: 1.685e-05 [cconv]: 2.709e-05 [loop_unroll]: 0.00042788 [jit_opt_after_cconv]: 0.00015598, [1] [Cycle 1]: 0.00014945, [11] [c_1]: 2.136e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 7.2e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 2.972e-05 [call_graph_tuple_transform]: 1.975e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 4.127e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 5.484e-05 [cse_after_recomputation]: 3.57e-05, [1] [Cycle 1]: 2.943e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.878e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.0004739 [symbol_engine_optimizer]: 7.461e-05, [1] [Cycle 1]: 6.839e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.372e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.09986e-07 [validate]: 3.994e-05 Sums bootstrap : 0.000309s : 2.22% type_inference : 0.009035s : 64.89% event_method : 0.000022s : 0.16% auto_monad : 0.000070s : 0.50% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.34% rewriter_before_opt_a : 0.000085s : 0.61% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.52% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000788s : 5.66% jit_opt_a.with_stream_mark : 0.000036s : 0.26% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001093s : 7.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.18% jit_opt_a.cse : 0.000062s : 0.45% jit_opt_a.replace_applicator : 0.000021s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000043s : 0.31% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000655s : 4.70% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000027s : 0.19% loop_unroll : 0.000428s : 3.07% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000041s : 0.30% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000055s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000474s : 3.40% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.29% Time group info: ------[substitution.] 0.000280 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 3: substitution.graph_param_transform 86.92% : 0.000244s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000005s : 2: substitution.replace_old_param 5.06% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008955 2 88.55% : 0.007930s : 1: type_inference.infer 11.45% : 0.001025s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.22% : 0.000065s : 5: replace.inline 32.78% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 7 94.86% : 0.000240s : 5: match.inline 5.14% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.51% : 0.000002s : 11: predicate.addn_zero_filter 1.84% : 0.000002s : 11: predicate.arithmetic_simplify 1.40% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.17% : 0.000002s : 11: predicate.depend_value_elim 1.25% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_depend_swap 1.33% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.50% : 0.000001s : 3: predicate.graph_param_transform 6.01% : 0.000008s : 24: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 16: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 11: predicate.merge_addn 1.27% : 0.000002s : 11: predicate.minmaximum_grad 1.89% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 1.94% : 0.000003s : 11: predicate.reduce_eliminate 1.51% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 19: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.34% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001030 16 41.97% : 0.000432s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.04% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.00% : 0.000515s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020246 72 0.29% : 0.000058s : 1: add_recomputation 0.36% : 0.000073s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.64% : 0.000331s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000038s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.14% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.42% : 0.006159s : 1: jit_opt_a 0.78% : 0.000158s : 1: jit_opt_after_cconv 0.27% : 0.000055s : 1: jit_opt_b 2.15% : 0.000436s : 1: loop_unroll 3.28% : 0.000665s : 1: mutable_eliminate 5.08% : 0.001029s : 26: opt.transform.jit_opt_a 0.24% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.38% : 0.000482s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000050s : 1: py_interpret_to_execute 0.09% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000044s : 1: remove_dup_value 2.53% : 0.000513s : 1: renormalize.infer 2.81% : 0.000570s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000047s : 1: rewriter_after_opt_a 0.44% : 0.000088s : 1: rewriter_before_opt_a 0.38% : 0.000077s : 1: symbol_engine_optimizer 44.73% : 0.009057s : 1: type_inference TotalTime = 0.139105, [30] [bootstrap]: 0.00025735 [type_inference]: 0.079558 [event_method]: 0.00027036 [auto_monad]: 0.00010848 [graph_reusing]: 7.68001e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 3.5e-05 [rewriter_before_opt_a]: 0.0001328 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0563888, [3] [Cycle 1]: 0.0167745, [27] [switch_simplify]: 7.839e-05 [loop_unroll]: 4.795e-05 [a_1]: 0.00100704 [with_stream_mark]: 3.167e-05 [recompute_prepare]: 2.146e-05 [updatestate_depend_eliminate]: 9.32001e-06 [updatestate_assign_eliminate]: 7.06999e-06 [updatestate_loads_eliminate]: 7.02997e-06 [parameter_eliminate]: 2.76999e-06 [specialize_transform]: 1.563e-05 [updatestate_useless_node_eliminater]: 1.512e-05 [accelerated_algorithm]: 1.534e-05 [meta_shard_fg_expand]: 3.65e-06 [get_grad_eliminate_]: 1.508e-05 [merge_forward]: 9.22001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.872e-05 [j_node_and_user_rematch]: 2.474e-05 [meta_fg_expand]: 0.00169524 [replace_old_param]: 6.407e-05 [inline_without_move]: 6.293e-05 [renormalize]: 0.0129306 [add_forward_monad_depend]: 1.428e-05 [auto_monad_grad]: 6.23002e-06 [auto_monad_eliminator]: 6.055e-05 [cse]: 0.00025803 [replace_applicator]: 9.283e-05 [Cycle 2]: 0.0349871, [27] [switch_simplify]: 4.37e-05 [loop_unroll]: 4.207e-05 [a_1]: 0.00115998 [with_stream_mark]: 1.665e-05 [recompute_prepare]: 9.17001e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 3.62002e-06 [updatestate_loads_eliminate]: 4.05998e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 6.71e-06 [accelerated_algorithm]: 7.01999e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 1.102e-05 [meta_fg_expand]: 9.591e-05 [replace_old_param]: 7.95998e-06 [inline_without_move]: 6.33e-06 [renormalize]: 0.0332323 [add_forward_monad_depend]: 1.134e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.525e-05 [cse]: 3.447e-05 [replace_applicator]: 2.543e-05 [Cycle 3]: 0.00033568, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 4.89003e-06 [a_1]: 7.782e-05 [with_stream_mark]: 1.601e-05 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 4.90001e-06 [updatestate_useless_node_eliminater]: 4.50001e-06 [accelerated_algorithm]: 5.11002e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 3.26999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.884e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 4.07998e-06 [inline_without_move]: 4.18999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 1.171e-05 [replace_applicator]: 4.93001e-06 [py_interpret_to_execute_after_opt_a]: 1.68e-05 [rewriter_after_opt_a]: 3.819e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00076441 [jit_opt_b]: 4.947e-05, [1] [Cycle 1]: 4.207e-05, [2] [frontend_op_eliminate]: 1.462e-05 [inline_after_opt_a]: 1.479e-05 [cconv]: 2.806e-05 [loop_unroll]: 0.00043551 [jit_opt_after_cconv]: 0.00014032, [1] [Cycle 1]: 0.00013397, [11] [c_1]: 1.709e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 2.204e-05 [call_graph_tuple_transform]: 1.729e-05 [tuple_list_get_item_eliminator]: 4.95001e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 8.2e-07 [switch_simplify]: 4.64998e-06 [remove_dup_value]: 1.7e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.21e-06 [add_recomputation]: 4.424e-05 [cse_after_recomputation]: 2.248e-05, [1] [Cycle 1]: 1.68e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.566e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00043893 [symbol_engine_optimizer]: 6.995e-05, [1] [Cycle 1]: 6.391e-05, [6] [build]: 3.29001e-06 [elim_shapecalc]: 6.89999e-06 [elim_not_effective]: 1.176e-05 [opt_reshape]: 4.85001e-06 [fold_const_symbol]: 7.87e-06 [renormalize]: 4.50003e-07 [validate]: 3.417e-05 Sums bootstrap : 0.000257s : 0.19% type_inference : 0.079558s : 59.41% event_method : 0.000270s : 0.20% auto_monad : 0.000108s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000035s : 0.03% rewriter_before_opt_a : 0.000133s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000128s : 0.10% jit_opt_a.loop_unroll : 0.000095s : 0.07% jit_opt_a.a_1 : 0.002245s : 1.68% jit_opt_a.with_stream_mark : 0.000064s : 0.05% jit_opt_a.recompute_prepare : 0.000036s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000045s : 0.03% jit_opt_a.meta_fg_expand : 0.001794s : 1.34% jit_opt_a.replace_old_param : 0.000076s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.05% jit_opt_a.renormalize : 0.046163s : 34.47% jit_opt_a.add_forward_monad_depend : 0.000027s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000091s : 0.07% jit_opt_a.cse : 0.000304s : 0.23% jit_opt_a.replace_applicator : 0.000123s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000764s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000436s : 0.33% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000044s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000439s : 0.33% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000572 109 0.31% : 0.000002s : 2: substitution.elim_not_effective 0.27% : 0.000002s : 2: substitution.fold_const_symbol 0.92% : 0.000005s : 2: substitution.graph_param_transform 65.74% : 0.000376s : 13: substitution.inline 3.19% : 0.000018s : 2: substitution.inline_without_move 1.78% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.96% : 0.000011s : 7: substitution.minmaximum_grad 1.44% : 0.000008s : 5: substitution.partial_eliminate 2.03% : 0.000012s : 13: substitution.remove_not_recompute_node 5.47% : 0.000031s : 10: substitution.replace_applicator 1.08% : 0.000006s : 10: substitution.replace_old_param 0.48% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.99% : 0.000006s : 1: substitution.tile_eliminate 4.06% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.68% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.59% : 0.000043s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.079453 2 97.12% : 0.077166s : 1: type_inference.infer 2.88% : 0.002287s : 1: type_inference.specialize ------[replace.] 0.000174 20 66.39% : 0.000116s : 13: replace.inline 33.61% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000390 20 94.49% : 0.000368s : 13: match.inline 5.51% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000385 2740 1.48% : 0.000006s : 47: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 47: predicate.addn_check_dump 1.62% : 0.000006s : 47: predicate.addn_zero_filter 2.06% : 0.000008s : 47: predicate.arithmetic_simplify 1.71% : 0.000007s : 47: predicate.cast_eliminate 0.09% : 0.000000s : 2: predicate.check_bprop_eliminate 1.50% : 0.000006s : 47: predicate.compare_switch_simplify 1.54% : 0.000006s : 47: predicate.depend_value_elim 1.44% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.56% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.50% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 2: predicate.elim_not_effective 0.15% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.49% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.42% : 0.000005s : 47: predicate.environ_get_depend_swap 1.52% : 0.000006s : 47: predicate.environ_get_eliminate 1.43% : 0.000005s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.81% : 0.000003s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 2: predicate.graph_param_transform 4.46% : 0.000017s : 71: predicate.inline 1.97% : 0.000008s : 47: predicate.inline_without_move 0.37% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.06% : 0.000004s : 19: predicate.less_batch_normalization 1.92% : 0.000007s : 54: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 56: predicate.load_eliminater 0.37% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.55% : 0.000014s : 100: predicate.loop_unroll_before_grad 1.78% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.53% : 0.000006s : 47: predicate.merge_addn 1.52% : 0.000006s : 47: predicate.minmaximum_grad 0.61% : 0.000002s : 2: predicate.mutable_eliminate 0.10% : 0.000000s : 2: predicate.opt_reshape 2.34% : 0.000009s : 56: predicate.partial_eliminate 1.46% : 0.000006s : 47: predicate.print_const_string_wrapper 2.06% : 0.000008s : 47: predicate.reduce_eliminate 1.83% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 19: predicate.remove_not_recompute_node 2.93% : 0.000011s : 102: predicate.replace_applicator 1.02% : 0.000004s : 47: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.56% : 0.000006s : 47: predicate.reshape_eliminate 1.63% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 2: predicate.row_tensor_eliminate 1.47% : 0.000006s : 47: predicate.same_eliminate 0.49% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 4: predicate.special_op_eliminate 0.85% : 0.000003s : 19: predicate.specialize_transform 1.74% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000006s : 47: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.80% : 0.000011s : 67: predicate.switch_defer_inline 2.45% : 0.000009s : 67: predicate.switch_layer_defer_inline 6.67% : 0.000026s : 169: predicate.switch_simplify 1.55% : 0.000006s : 47: predicate.tile_eliminate 1.51% : 0.000006s : 47: predicate.transpose_eliminate 1.86% : 0.000007s : 47: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000006s : 47: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000013s : 58: predicate.tuple_list_get_item_eliminator 1.81% : 0.000007s : 47: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 54: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.78% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 47: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.21% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004135 52 75.01% : 0.003102s : 35: func_graph_cloner_run.FuncGraphClonerGraph 24.99% : 0.001033s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.188230 87 0.03% : 0.000047s : 1: add_recomputation 0.06% : 0.000116s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.15% : 0.000281s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.15% : 0.000278s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 29.96% : 0.056392s : 1: jit_opt_a 0.08% : 0.000143s : 1: jit_opt_after_cconv 0.03% : 0.000052s : 1: jit_opt_b 0.24% : 0.000444s : 1: loop_unroll 0.41% : 0.000775s : 1: mutable_eliminate 1.56% : 0.002939s : 39: opt.transform.jit_opt_a 0.02% : 0.000041s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000029s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000447s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000038s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 23.25% : 0.043769s : 2: renormalize.infer 1.26% : 0.002370s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000136s : 1: rewriter_before_opt_a 0.04% : 0.000072s : 1: symbol_engine_optimizer 42.28% : 0.079580s : 1: type_inference TotalTime = 0.0372102, [30] [bootstrap]: 0.00028235 [type_inference]: 0.0280782 [event_method]: 2.194e-05 [auto_monad]: 7.178e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00010268 [rewriter_before_opt_a]: 8.223e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.0063134, [2] [Cycle 1]: 0.00226254, [27] [switch_simplify]: 6.165e-05 [loop_unroll]: 2.92e-05 [a_1]: 0.00057192 [with_stream_mark]: 2.479e-05 [recompute_prepare]: 7.26999e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 9.75002e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 0.00122375 [add_forward_monad_depend]: 6.09999e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.591e-05 [cse]: 3.521e-05 [replace_applicator]: 1.5e-05 [Cycle 2]: 0.00031943, [27] [switch_simplify]: 6.65998e-06 [loop_unroll]: 5.19e-06 [a_1]: 8.861e-05 [with_stream_mark]: 1.033e-05 [recompute_prepare]: 5.27999e-06 [updatestate_depend_eliminate]: 3.14001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.11997e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.374e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.21999e-06 [inline_without_move]: 4.65001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.49e-06 [cse]: 1.237e-05 [replace_applicator]: 4.85001e-06 [py_interpret_to_execute_after_opt_a]: 1.352e-05 [rewriter_after_opt_a]: 4.01e-05 [convert_after_rewriter]: 6.64001e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00064895 [jit_opt_b]: 4.937e-05, [1] [Cycle 1]: 4.187e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 2.909e-05 [loop_unroll]: 0.00041441 [jit_opt_after_cconv]: 0.00014281, [1] [Cycle 1]: 0.00013637, [11] [c_1]: 1.99e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 6.60002e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 2.348e-05 [call_graph_tuple_transform]: 1.844e-05 [tuple_list_get_item_eliminator]: 5.14e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.631e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 5.085e-05 [cse_after_recomputation]: 2.552e-05, [1] [Cycle 1]: 1.946e-05, [1] [cse]: 1.323e-05 [auto_monad_reorder]: 1.79e-05 [get_jit_bprop_graph]: 2.43998e-06 [rewriter_after_jit_bprop_graph]: 6.01e-06 [opt_after_jit_grad]: 0.00045839 [symbol_engine_optimizer]: 7.203e-05, [1] [Cycle 1]: 6.575e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 7.83001e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 4.39992e-07 [validate]: 4.407e-05 Sums bootstrap : 0.000282s : 0.86% type_inference : 0.028078s : 85.41% event_method : 0.000022s : 0.07% auto_monad : 0.000072s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.31% rewriter_before_opt_a : 0.000082s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.21% jit_opt_a.loop_unroll : 0.000034s : 0.10% jit_opt_a.a_1 : 0.000661s : 2.01% jit_opt_a.with_stream_mark : 0.000035s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001224s : 3.72% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000048s : 0.14% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000649s : 1.97% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000029s : 0.09% loop_unroll : 0.000414s : 1.26% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.15% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000458s : 1.39% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.13% Time group info: ------[substitution.] 0.000242 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 3: substitution.graph_param_transform 85.50% : 0.000207s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000004s : 2: substitution.replace_old_param 5.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027998 2 94.51% : 0.026459s : 1: type_inference.infer 5.49% : 0.001538s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.21% : 0.000051s : 4: replace.inline 32.79% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.54% : 0.000205s : 4: match.inline 5.46% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.61% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.16% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000890 13 45.49% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.89% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.61% : 0.000433s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039360 72 0.17% : 0.000067s : 1: add_recomputation 0.19% : 0.000075s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.77% : 0.000302s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.05% : 0.006316s : 1: jit_opt_a 0.37% : 0.000146s : 1: jit_opt_after_cconv 0.13% : 0.000052s : 1: jit_opt_b 1.07% : 0.000422s : 1: loop_unroll 1.67% : 0.000658s : 1: mutable_eliminate 2.24% : 0.000881s : 26: opt.transform.jit_opt_a 0.12% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.19% : 0.000467s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000106s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.72% : 0.000679s : 1: renormalize.infer 1.36% : 0.000535s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.22% : 0.000086s : 1: rewriter_before_opt_a 0.19% : 0.000074s : 1: symbol_engine_optimizer 71.39% : 0.028098s : 1: type_inference TotalTime = 0.159519, [30] [bootstrap]: 0.00028387 [type_inference]: 0.121094 [event_method]: 2.356e-05 [auto_monad]: 7.326e-05 [graph_reusing]: 6.03002e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00069463 [rewriter_before_opt_a]: 9.052e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.0345786, [2] [Cycle 1]: 0.00566379, [27] [switch_simplify]: 6.796e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.0006858 [with_stream_mark]: 2.37e-05 [recompute_prepare]: 9.04e-06 [updatestate_depend_eliminate]: 4.62998e-06 [updatestate_assign_eliminate]: 3.98999e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 7.67998e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 7.33e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 7.07002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.16998e-06 [renormalize]: 0.00446813 [add_forward_monad_depend]: 9.87999e-06 [auto_monad_grad]: 3.09001e-06 [auto_monad_eliminator]: 1.843e-05 [cse]: 3.301e-05 [replace_applicator]: 2.337e-05 [Cycle 2]: 0.0249315, [27] [switch_simplify]: 8.17998e-06 [loop_unroll]: 6.96999e-06 [a_1]: 0.024522 [with_stream_mark]: 3.405e-05 [recompute_prepare]: 1.252e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 2.95998e-06 [updatestate_loads_eliminate]: 2.78003e-06 [parameter_eliminate]: 2.71e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 7.15003e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 5.29e-06 [cell_reuse_recompute_pass]: 4.10998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.24e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 3.58e-06 [replace_old_param]: 1.304e-05 [inline_without_move]: 5.66998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 4.43999e-06 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 2.054e-05 [cse]: 4.009e-05 [replace_applicator]: 6.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.726e-05 [rewriter_after_opt_a]: 4.349e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 4.67998e-06 [mutable_eliminate]: 0.00074345 [jit_opt_b]: 6.54e-05, [1] [Cycle 1]: 5.398e-05, [2] [frontend_op_eliminate]: 2.343e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 2.398e-05 [loop_unroll]: 0.00041044 [jit_opt_after_cconv]: 0.00016407, [1] [Cycle 1]: 0.00015421, [11] [c_1]: 2.497e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 7.97998e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 2.666e-05 [call_graph_tuple_transform]: 2.17e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.97999e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.746e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 1.311e-05 [add_recomputation]: 5.309e-05 [cse_after_recomputation]: 2.907e-05, [1] [Cycle 1]: 1.737e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.876e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 4.23999e-06 [opt_after_jit_grad]: 0.00064291 [symbol_engine_optimizer]: 7.599e-05, [1] [Cycle 1]: 6.921e-05, [6] [build]: 3.81001e-06 [elim_shapecalc]: 8.12003e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 3.00002e-07 [validate]: 4.233e-05 Sums bootstrap : 0.000284s : 0.18% type_inference : 0.121094s : 78.25% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000695s : 0.45% rewriter_before_opt_a : 0.000091s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.025208s : 16.29% jit_opt_a.with_stream_mark : 0.000058s : 0.04% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004468s : 2.89% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000006s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.03% jit_opt_a.cse : 0.000073s : 0.05% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000743s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000410s : 0.27% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000643s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000285 24 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 84.65% : 0.000241s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000007s : 4: substitution.remove_not_recompute_node 3.26% : 0.000009s : 2: substitution.replace_old_param 4.68% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120991 2 96.35% : 0.116578s : 1: type_inference.infer 3.65% : 0.004413s : 1: type_inference.specialize ------[replace.] 0.000099 6 67.99% : 0.000067s : 4: replace.inline 32.01% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 6 95.15% : 0.000238s : 4: match.inline 4.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000002s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 3.57% : 0.000006s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.67% : 0.000003s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.67% : 0.000009s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.01% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.20% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.94% : 0.000002s : 12: predicate.merge_addn 3.40% : 0.000005s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.05% : 0.000002s : 12: predicate.print_const_string_wrapper 2.15% : 0.000003s : 12: predicate.reduce_eliminate 1.61% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.63% : 0.000003s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000004s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.59% : 0.000011s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.36% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 2.14% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002724 22 59.92% : 0.001632s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.08% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.00% : 0.001035s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.189431 72 0.03% : 0.000056s : 1: add_recomputation 0.04% : 0.000076s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.16% : 0.000301s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 18.26% : 0.034583s : 1: jit_opt_a 0.09% : 0.000167s : 1: jit_opt_after_cconv 0.04% : 0.000068s : 1: jit_opt_b 0.22% : 0.000417s : 1: loop_unroll 0.40% : 0.000752s : 1: mutable_eliminate 13.45% : 0.025482s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000651s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000701s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.74% : 0.003300s : 1: renormalize.infer 0.61% : 0.001154s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.05% : 0.000095s : 1: rewriter_before_opt_a 0.04% : 0.000078s : 1: symbol_engine_optimizer 63.94% : 0.121113s : 1: type_inference TotalTime = 0.151355, [30] [bootstrap]: 0.00087107 [type_inference]: 0.137642 [event_method]: 2.479e-05 [auto_monad]: 8.14e-05 [graph_reusing]: 5.39e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.0006442 [rewriter_before_opt_a]: 9.536e-05 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00952448, [2] [Cycle 1]: 0.00466245, [27] [switch_simplify]: 6.042e-05 [loop_unroll]: 3.039e-05 [a_1]: 0.00068543 [with_stream_mark]: 2.521e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.13002e-06 [accelerated_algorithm]: 6.85002e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 1.047e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 1.088e-05 [inline_without_move]: 6.06e-06 [renormalize]: 0.00348717 [add_forward_monad_depend]: 7.78001e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.947e-05 [cse]: 3.256e-05 [replace_applicator]: 1.784e-05 [Cycle 2]: 0.00040784, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.06998e-06 [a_1]: 0.00014491 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 6.68998e-06 [updatestate_depend_eliminate]: 3.52997e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.13002e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.40997e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 3.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.841e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.96003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.245e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.42e-05 [rewriter_after_opt_a]: 3.9e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00077112 [jit_opt_b]: 5.629e-05, [1] [Cycle 1]: 4.962e-05, [2] [frontend_op_eliminate]: 2.023e-05 [inline_after_opt_a]: 1.789e-05 [cconv]: 2.754e-05 [loop_unroll]: 0.00043787 [jit_opt_after_cconv]: 0.00015554, [1] [Cycle 1]: 0.00014936, [11] [c_1]: 2.74e-05 [parameter_eliminate]: 2.65002e-06 [updatestate_depend_eliminate]: 6.69001e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 3.05998e-06 [cse]: 2.058e-05 [call_graph_tuple_transform]: 2.188e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.52e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 9.27001e-06 [add_recomputation]: 4.926e-05 [cse_after_recomputation]: 2.287e-05, [1] [Cycle 1]: 1.697e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 2.96001e-06 [rewriter_after_jit_bprop_graph]: 5.71e-06 [opt_after_jit_grad]: 0.00048692 [symbol_engine_optimizer]: 7.746e-05, [1] [Cycle 1]: 7.116e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 8.41002e-06 [elim_not_effective]: 1.426e-05 [opt_reshape]: 6.51999e-06 [fold_const_symbol]: 1.061e-05 [renormalize]: 5.39992e-07 [validate]: 5.194e-05 Sums bootstrap : 0.000871s : 0.60% type_inference : 0.137642s : 94.10% event_method : 0.000025s : 0.02% auto_monad : 0.000081s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000644s : 0.44% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000830s : 0.57% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003487s : 2.38% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000771s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000438s : 0.30% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000487s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000260 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 4: substitution.graph_param_transform 85.20% : 0.000221s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000006s : 4: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.137519 2 91.61% : 0.125975s : 1: type_inference.infer 8.39% : 0.011543s : 1: type_inference.specialize ------[replace.] 0.000126 6 40.40% : 0.000051s : 4: replace.inline 59.60% : 0.000075s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 95.03% : 0.000219s : 4: match.inline 4.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.15% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 2.33% : 0.000003s : 12: predicate.arithmetic_simplify 1.61% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 18: predicate.load_eliminater 1.66% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 2.18% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.51% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000001s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.82% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.88% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002792 22 67.90% : 0.001896s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.01% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.10% : 0.000840s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155973 72 0.03% : 0.000052s : 1: add_recomputation 0.05% : 0.000085s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.58% : 0.000899s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 6.11% : 0.009528s : 1: jit_opt_a 0.10% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.29% : 0.000445s : 1: loop_unroll 0.50% : 0.000779s : 1: mutable_eliminate 0.69% : 0.001080s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000495s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000651s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.66% : 0.002586s : 1: renormalize.infer 0.57% : 0.000891s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000100s : 1: rewriter_before_opt_a 0.05% : 0.000080s : 1: symbol_engine_optimizer 88.26% : 0.137666s : 1: type_inference TotalTime = 0.0453889, [30] [bootstrap]: 0.00027487 [type_inference]: 0.0355239 [event_method]: 2.237e-05 [auto_monad]: 7.123e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.675e-05 [rewriter_before_opt_a]: 8.501e-05 [expand_dump_flag]: 3.29001e-06 [jit_opt_a]: 0.00699079, [2] [Cycle 1]: 0.00235804, [27] [switch_simplify]: 7.09e-05 [loop_unroll]: 3.366e-05 [a_1]: 0.00074213 [with_stream_mark]: 1.884e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 4.07998e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 1.61998e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.19003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.52999e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 5.86998e-06 [renormalize]: 0.0011516 [add_forward_monad_depend]: 5.99e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.515e-05 [cse]: 3.55e-05 [replace_applicator]: 1.393e-05 [Cycle 2]: 0.00044209, [27] [switch_simplify]: 6.00002e-06 [loop_unroll]: 5.04e-06 [a_1]: 9.664e-05 [with_stream_mark]: 1.109e-05 [recompute_prepare]: 5.51002e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 4.87998e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.722e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 7.98001e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.84e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 7.88999e-06 [cse]: 1.926e-05 [replace_applicator]: 5.81998e-06 [py_interpret_to_execute_after_opt_a]: 1.488e-05 [rewriter_after_opt_a]: 4.586e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.0006978 [jit_opt_b]: 5.418e-05, [1] [Cycle 1]: 4.778e-05, [2] [frontend_op_eliminate]: 1.819e-05 [inline_after_opt_a]: 1.774e-05 [cconv]: 2.672e-05 [loop_unroll]: 0.00042482 [jit_opt_after_cconv]: 0.00015094, [1] [Cycle 1]: 0.00014431, [11] [c_1]: 2.278e-05 [parameter_eliminate]: 3.2e-06 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.3e-05 [call_graph_tuple_transform]: 2.063e-05 [tuple_list_get_item_eliminator]: 5.76998e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.57999e-06 [remove_dup_value]: 3.845e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 6.326e-05 [cse_after_recomputation]: 2.653e-05, [1] [Cycle 1]: 2.025e-05, [1] [cse]: 1.366e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.87999e-06 [opt_after_jit_grad]: 0.00048713 [symbol_engine_optimizer]: 7.538e-05, [1] [Cycle 1]: 6.872e-05, [6] [build]: 3.47002e-06 [elim_shapecalc]: 8.43001e-06 [elim_not_effective]: 1.288e-05 [opt_reshape]: 6.70998e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 3.80009e-07 [validate]: 4.114e-05 Sums bootstrap : 0.000275s : 0.68% type_inference : 0.035524s : 87.64% event_method : 0.000022s : 0.06% auto_monad : 0.000071s : 0.18% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000047s : 0.12% rewriter_before_opt_a : 0.000085s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.19% jit_opt_a.loop_unroll : 0.000039s : 0.10% jit_opt_a.a_1 : 0.000839s : 2.07% jit_opt_a.with_stream_mark : 0.000030s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001152s : 2.84% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000055s : 0.14% jit_opt_a.replace_applicator : 0.000020s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.04% rewriter_after_opt_a : 0.000046s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000698s : 1.72% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.000425s : 1.05% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000038s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000063s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000487s : 1.20% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.10% Time group info: ------[substitution.] 0.000310 24 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 3: substitution.graph_param_transform 88.97% : 0.000276s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.50% : 0.000005s : 4: substitution.remove_not_recompute_node 1.30% : 0.000004s : 2: substitution.replace_old_param 4.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035447 2 96.76% : 0.034298s : 1: type_inference.infer 3.24% : 0.001149s : 1: type_inference.specialize ------[replace.] 0.000122 7 67.00% : 0.000082s : 5: replace.inline 33.00% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000284 7 95.93% : 0.000273s : 5: match.inline 4.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.20% : 0.000002s : 11: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.03% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.66% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.54% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.22% : 0.000007s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.71% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 16: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000002s : 11: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.59% : 0.000003s : 16: predicate.partial_eliminate 1.38% : 0.000002s : 11: predicate.print_const_string_wrapper 1.73% : 0.000002s : 11: predicate.reduce_eliminate 1.67% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 11: predicate.reshape_eliminate 1.68% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.37% : 0.000002s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000873 16 46.16% : 0.000403s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.40% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.44% : 0.000379s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047683 72 0.14% : 0.000066s : 1: add_recomputation 0.16% : 0.000074s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.60% : 0.000288s : 1: bootstrap 0.06% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.67% : 0.006995s : 1: jit_opt_a 0.32% : 0.000153s : 1: jit_opt_after_cconv 0.12% : 0.000057s : 1: jit_opt_b 0.90% : 0.000431s : 1: loop_unroll 1.48% : 0.000706s : 1: mutable_eliminate 2.27% : 0.001083s : 26: opt.transform.jit_opt_a 0.11% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.04% : 0.000494s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000049s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000041s : 1: remove_dup_value 1.41% : 0.000671s : 1: renormalize.infer 0.99% : 0.000472s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000049s : 1: rewriter_after_opt_a 0.18% : 0.000088s : 1: rewriter_before_opt_a 0.16% : 0.000078s : 1: symbol_engine_optimizer 74.53% : 0.035540s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.154.331 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda01a1c10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.155.027 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0859466, [30] [bootstrap]: 0.00032764 [type_inference]: 0.0752598 [event_method]: 2.274e-05 [auto_monad]: 7.069e-05 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.21998e-06 [py_interpret_to_execute]: 0.0001089 [rewriter_before_opt_a]: 8.417e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00644286, [2] [Cycle 1]: 0.00224759, [27] [switch_simplify]: 6.698e-05 [loop_unroll]: 3.108e-05 [a_1]: 0.00063789 [with_stream_mark]: 2.713e-05 [recompute_prepare]: 7.36999e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.56999e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.54998e-06 [renormalize]: 0.00108879 [add_forward_monad_depend]: 6.96001e-06 [auto_monad_grad]: 3.67002e-06 [auto_monad_eliminator]: 2.265e-05 [cse]: 4.619e-05 [replace_applicator]: 1.762e-05 [Cycle 2]: 0.0003386, [27] [switch_simplify]: 5.87001e-06 [loop_unroll]: 5.05001e-06 [a_1]: 9.322e-05 [with_stream_mark]: 1.45e-05 [recompute_prepare]: 5.73002e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.357e-05 [j_node_and_user_rematch]: 8.17998e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.296e-05 [replace_applicator]: 5.38002e-06 [py_interpret_to_execute_after_opt_a]: 1.377e-05 [rewriter_after_opt_a]: 3.934e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00068637 [jit_opt_b]: 5.261e-05, [1] [Cycle 1]: 4.334e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.676e-05 [cconv]: 3.108e-05 [loop_unroll]: 0.00042915 [jit_opt_after_cconv]: 0.00015829, [1] [Cycle 1]: 0.00015189, [11] [c_1]: 1.969e-05 [parameter_eliminate]: 4.11001e-06 [updatestate_depend_eliminate]: 8.57e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 3.023e-05 [call_graph_tuple_transform]: 2.286e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.51002e-06 [remove_dup_value]: 1.564e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.221e-05 [cse_after_recomputation]: 2.363e-05, [1] [Cycle 1]: 1.867e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.721e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 7.17002e-06 [opt_after_jit_grad]: 0.00050491 [symbol_engine_optimizer]: 0.00128649, [1] [Cycle 1]: 0.00127736, [6] [build]: 0.00107043 [elim_shapecalc]: 2.488e-05 [elim_not_effective]: 7.298e-05 [opt_reshape]: 7.63001e-06 [fold_const_symbol]: 1.038e-05 [renormalize]: 1.49998e-06 [validate]: 6.109e-05 Sums bootstrap : 0.000328s : 0.40% type_inference : 0.075260s : 92.49% event_method : 0.000023s : 0.03% auto_monad : 0.000071s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000109s : 0.13% rewriter_before_opt_a : 0.000084s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000731s : 0.90% jit_opt_a.with_stream_mark : 0.000042s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.001089s : 1.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.04% jit_opt_a.cse : 0.000059s : 0.07% jit_opt_a.replace_applicator : 0.000023s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000686s : 0.84% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000031s : 0.04% loop_unroll : 0.000429s : 0.53% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000505s : 0.62% symbol_engine_optimizer.build : 0.001070s : 1.32% symbol_engine_optimizer.elim_shapecalc : 0.000025s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000073s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000061s : 0.08% Time group info: ------[substitution.] 0.000270 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 86.34% : 0.000233s : 4: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.78% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.075174 2 97.63% : 0.073394s : 1: type_inference.infer 2.37% : 0.001781s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.26% : 0.000055s : 4: replace.inline 29.74% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 94.88% : 0.000231s : 4: match.inline 5.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.69% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.49% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.77% : 0.000001s : 3: predicate.elim_not_effective 1.81% : 0.000002s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.58% : 0.000001s : 3: predicate.graph_param_transform 5.35% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.81% : 0.000002s : 6: predicate.less_batch_normalization 1.29% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.64% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.47% : 0.000003s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 2.04% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000010s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000955 13 43.92% : 0.000420s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.12% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.95% : 0.000477s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.088101 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.40% : 0.000353s : 1: bootstrap 0.04% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.32% : 0.006446s : 1: jit_opt_a 0.18% : 0.000161s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.50% : 0.000438s : 1: loop_unroll 0.79% : 0.000698s : 1: mutable_eliminate 1.09% : 0.000965s : 26: opt.transform.jit_opt_a 0.06% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000108s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.13% : 0.000112s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 0.71% : 0.000625s : 1: renormalize.infer 0.52% : 0.000455s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.10% : 0.000088s : 1: rewriter_before_opt_a 1.46% : 0.001290s : 1: symbol_engine_optimizer 85.46% : 0.075290s : 1: type_inference TotalTime = 0.101046, [30] [bootstrap]: 0.00038293 [type_inference]: 0.0877208 [event_method]: 0.00049295 [auto_monad]: 0.00014248 [graph_reusing]: 8.40001e-06 [pre_auto_parallel]: 3.27002e-06 [py_interpret_to_execute]: 4.967e-05 [rewriter_before_opt_a]: 0.0001515 [expand_dump_flag]: 4.02002e-06 [jit_opt_a]: 0.00946195, [2] [Cycle 1]: 0.00488193, [27] [switch_simplify]: 0.00020092 [loop_unroll]: 6.371e-05 [a_1]: 0.00147877 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 9.52001e-06 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 6.46e-06 [renormalize]: 0.00270278 [add_forward_monad_depend]: 9.90002e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.774e-05 [cse]: 3.461e-05 [replace_applicator]: 2.421e-05 [Cycle 2]: 0.00037638, [27] [switch_simplify]: 7.03998e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.0001086 [with_stream_mark]: 1.432e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.75998e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 3.45998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.016e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.414e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.635e-05 [rewriter_after_opt_a]: 3.93e-05 [convert_after_rewriter]: 9.76e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.00083347 [jit_opt_b]: 6.213e-05, [1] [Cycle 1]: 5.325e-05, [2] [frontend_op_eliminate]: 2.096e-05 [inline_after_opt_a]: 1.926e-05 [cconv]: 3.037e-05 [loop_unroll]: 0.00049982 [jit_opt_after_cconv]: 0.00016283, [1] [Cycle 1]: 0.00015582, [11] [c_1]: 2.455e-05 [parameter_eliminate]: 2.97002e-06 [updatestate_depend_eliminate]: 6.02999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 3.51001e-06 [cse]: 2.832e-05 [call_graph_tuple_transform]: 2.179e-05 [tuple_list_get_item_eliminator]: 7.16999e-06 [none_parameter_eliminate]: 1.41998e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.856e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 6.78e-06 [add_recomputation]: 5.136e-05 [cse_after_recomputation]: 2.604e-05, [1] [Cycle 1]: 2.028e-05, [1] [cse]: 1.42e-05 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 5.24998e-06 [opt_after_jit_grad]: 0.00049525 [symbol_engine_optimizer]: 8.463e-05, [1] [Cycle 1]: 7.776e-05, [6] [build]: 4.42e-06 [elim_shapecalc]: 1.059e-05 [elim_not_effective]: 1.66e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 5.00004e-07 [validate]: 4.453e-05 Sums bootstrap : 0.000383s : 0.40% type_inference : 0.087721s : 91.23% event_method : 0.000493s : 0.51% auto_monad : 0.000142s : 0.15% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000050s : 0.05% rewriter_before_opt_a : 0.000152s : 0.16% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000208s : 0.22% jit_opt_a.loop_unroll : 0.000070s : 0.07% jit_opt_a.a_1 : 0.001587s : 1.65% jit_opt_a.with_stream_mark : 0.000034s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002703s : 2.81% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000049s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000010s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000833s : 0.87% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000500s : 0.52% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000495s : 0.52% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.05% Time group info: ------[substitution.] 0.000632 35 0.33% : 0.000002s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 0.96% : 0.000006s : 3: substitution.graph_param_transform 90.18% : 0.000570s : 12: substitution.inline 0.72% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.96% : 0.000006s : 4: substitution.remove_not_recompute_node 0.86% : 0.000005s : 2: substitution.replace_old_param 1.62% : 0.000010s : 1: substitution.reshape_eliminate 2.22% : 0.000014s : 3: substitution.switch_simplify 1.96% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.087611 2 96.26% : 0.084333s : 1: type_inference.infer 3.74% : 0.003277s : 1: type_inference.specialize ------[replace.] 0.000312 18 51.18% : 0.000160s : 12: replace.inline 1.57% : 0.000005s : 1: replace.reshape_eliminate 20.81% : 0.000065s : 3: replace.switch_simplify 26.44% : 0.000082s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000595 18 94.54% : 0.000563s : 12: match.inline 1.54% : 0.000009s : 1: match.reshape_eliminate 2.02% : 0.000012s : 3: match.switch_simplify 1.89% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000216 1212 1.35% : 0.000003s : 19: predicate.accumulaten_eliminater 0.53% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000003s : 19: predicate.addn_check_dump 1.47% : 0.000003s : 19: predicate.addn_zero_filter 2.11% : 0.000005s : 19: predicate.arithmetic_simplify 1.56% : 0.000003s : 20: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000003s : 19: predicate.compare_switch_simplify 1.41% : 0.000003s : 19: predicate.depend_value_elim 1.26% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.38% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.57% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.44% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.39% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.25% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.24% : 0.000003s : 20: predicate.environ_get_depend_swap 1.74% : 0.000004s : 20: predicate.environ_get_eliminate 1.45% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.73% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000011s : 40: predicate.inline 0.52% : 0.000001s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000002s : 6: predicate.less_batch_normalization 1.81% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.78% : 0.000004s : 25: predicate.load_eliminater 0.82% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.99% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.18% : 0.000003s : 19: predicate.merge_addn 1.19% : 0.000003s : 19: predicate.minmaximum_grad 1.11% : 0.000002s : 3: predicate.mutable_eliminate 0.28% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000004s : 25: predicate.partial_eliminate 1.28% : 0.000003s : 19: predicate.print_const_string_wrapper 2.06% : 0.000004s : 19: predicate.reduce_eliminate 1.59% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000003s : 28: predicate.replace_applicator 0.29% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.61% : 0.000003s : 20: predicate.reshape_eliminate 1.54% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.51% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000003s : 19: predicate.same_eliminate 0.29% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000002s : 6: predicate.special_op_eliminate 0.54% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.29% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.30% : 0.000007s : 34: predicate.switch_defer_inline 2.70% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.57% : 0.000019s : 107: predicate.switch_simplify 1.44% : 0.000003s : 19: predicate.tile_eliminate 1.41% : 0.000003s : 19: predicate.transpose_eliminate 1.75% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.53% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.90% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.83% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.64% : 0.000004s : 25: predicate.updatestate_pure_node_eliminater 2.51% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.76% : 0.000004s : 19: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003477 40 60.97% : 0.002120s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.15% : 0.000318s : 5: func_graph_cloner_run.FuncGraphClonerNode 29.89% : 0.001039s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.105814 72 0.05% : 0.000054s : 1: add_recomputation 0.14% : 0.000150s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.38% : 0.000402s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.48% : 0.000504s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 8.95% : 0.009466s : 1: jit_opt_a 0.16% : 0.000167s : 1: jit_opt_after_cconv 0.06% : 0.000065s : 1: jit_opt_b 0.48% : 0.000508s : 1: loop_unroll 0.80% : 0.000843s : 1: mutable_eliminate 1.90% : 0.002010s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000503s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000053s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.74% : 0.001840s : 1: renormalize.infer 0.80% : 0.000851s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.15% : 0.000155s : 1: rewriter_before_opt_a 0.08% : 0.000087s : 1: symbol_engine_optimizer 82.92% : 0.087745s : 1: type_inference TotalTime = 0.17771, [30] [bootstrap]: 0.00031132 [type_inference]: 0.167215 [event_method]: 2.528e-05 [auto_monad]: 8.308e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 0.00030571 [rewriter_before_opt_a]: 9.457e-05 [expand_dump_flag]: 3.37997e-06 [jit_opt_a]: 0.00735443, [2] [Cycle 1]: 0.00333903, [27] [switch_simplify]: 5.972e-05 [loop_unroll]: 2.936e-05 [a_1]: 0.00061491 [with_stream_mark]: 2.273e-05 [recompute_prepare]: 8.36002e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.57997e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.76999e-06 [get_grad_eliminate_]: 6.58003e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.585e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00225033 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.469e-05 [replace_applicator]: 1.447e-05 [Cycle 2]: 0.00036066, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00011796 [with_stream_mark]: 1.129e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 2.78998e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.56998e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.646e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.70999e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.46e-06 [cse]: 1.243e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 1.296e-05 [rewriter_after_opt_a]: 3.751e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00063641 [jit_opt_b]: 5.614e-05, [1] [Cycle 1]: 4.769e-05, [2] [frontend_op_eliminate]: 1.843e-05 [inline_after_opt_a]: 1.753e-05 [cconv]: 2.889e-05 [loop_unroll]: 0.00042214 [jit_opt_after_cconv]: 0.00015585, [1] [Cycle 1]: 0.00014905, [11] [c_1]: 2.53e-05 [parameter_eliminate]: 2.93998e-06 [updatestate_depend_eliminate]: 7.63001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.516e-05 [call_graph_tuple_transform]: 2.079e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.88998e-06 [remove_dup_value]: 1.59e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 8.62998e-06 [add_recomputation]: 5.081e-05 [cse_after_recomputation]: 2.104e-05, [1] [Cycle 1]: 1.575e-05, [1] [cse]: 1.021e-05 [auto_monad_reorder]: 1.465e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 5.29998e-06 [opt_after_jit_grad]: 0.00046081 [symbol_engine_optimizer]: 0.00011475, [1] [Cycle 1]: 0.00010778, [6] [build]: 4.15999e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.322e-05 [opt_reshape]: 4.452e-05 [fold_const_symbol]: 1.013e-05 [renormalize]: 3.60014e-07 [validate]: 4.864e-05 Sums bootstrap : 0.000311s : 0.18% type_inference : 0.167215s : 96.41% event_method : 0.000025s : 0.01% auto_monad : 0.000083s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000306s : 0.18% rewriter_before_opt_a : 0.000095s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.04% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000733s : 0.42% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002250s : 1.30% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000047s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000636s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000422s : 0.24% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000461s : 0.27% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000045s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.03% Time group info: ------[substitution.] 0.000252 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 4: substitution.graph_param_transform 85.40% : 0.000215s : 4: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.22% : 0.000006s : 2: substitution.replace_old_param 4.99% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.167091 2 89.01% : 0.148733s : 1: type_inference.infer 10.99% : 0.018358s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.69% : 0.000051s : 4: replace.inline 32.31% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.98% : 0.000213s : 4: match.inline 5.02% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.18% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.37% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 6.18% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.85% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 2.25% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.51% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.83% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002610 26 74.14% : 0.001935s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.73% : 0.000619s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.181026 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000087s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.18% : 0.000331s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.06% : 0.007358s : 1: jit_opt_a 0.09% : 0.000158s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.24% : 0.000430s : 1: loop_unroll 0.36% : 0.000646s : 1: mutable_eliminate 0.54% : 0.000969s : 26: opt.transform.jit_opt_a 0.03% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000073s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000470s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000311s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.86% : 0.001555s : 1: renormalize.infer 0.38% : 0.000686s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.05% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000117s : 1: symbol_engine_optimizer 92.39% : 0.167246s : 1: type_inference TotalTime = 0.0800481, [30] [bootstrap]: 0.00037514 [type_inference]: 0.0673996 [event_method]: 2.201e-05 [auto_monad]: 7.456e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 0.00033435 [rewriter_before_opt_a]: 8.635e-05 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.00912083, [2] [Cycle 1]: 0.00438769, [27] [switch_simplify]: 9.808e-05 [loop_unroll]: 3.147e-05 [a_1]: 0.00068399 [with_stream_mark]: 2.394e-05 [recompute_prepare]: 1.008e-05 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 8.59998e-06 [updatestate_useless_node_eliminater]: 6.54999e-06 [accelerated_algorithm]: 7.21999e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 7.24001e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.685e-05 [j_node_and_user_rematch]: 1.195e-05 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 1.336e-05 [inline_without_move]: 6.78998e-06 [renormalize]: 0.0031436 [add_forward_monad_depend]: 9.42999e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 2.065e-05 [cse]: 3.391e-05 [replace_applicator]: 2.258e-05 [Cycle 2]: 0.00041012, [27] [switch_simplify]: 7.61999e-06 [loop_unroll]: 6.49999e-06 [a_1]: 0.0001384 [with_stream_mark]: 1.563e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 3.93001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.731e-05 [j_node_and_user_rematch]: 1.042e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.46e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 7.19001e-06 [cse]: 1.361e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.589e-05 [rewriter_after_opt_a]: 4.085e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00080256 [jit_opt_b]: 6.151e-05, [1] [Cycle 1]: 5.312e-05, [2] [frontend_op_eliminate]: 2.16e-05 [inline_after_opt_a]: 1.935e-05 [cconv]: 2.954e-05 [loop_unroll]: 0.00049023 [jit_opt_after_cconv]: 0.0001654, [1] [Cycle 1]: 0.00015722, [11] [c_1]: 2.686e-05 [parameter_eliminate]: 3.58999e-06 [updatestate_depend_eliminate]: 6.37001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.686e-05 [call_graph_tuple_transform]: 2.441e-05 [tuple_list_get_item_eliminator]: 6.19999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.613e-05 [partial_unused_args_eliminate]: 2.43002e-06 [environ_conv]: 9.37999e-06 [add_recomputation]: 5.219e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.775e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 1.73002e-06 [rewriter_after_jit_bprop_graph]: 6.16e-06 [opt_after_jit_grad]: 0.00054769 [symbol_engine_optimizer]: 8.695e-05, [1] [Cycle 1]: 8.055e-05, [6] [build]: 3.11999e-06 [elim_shapecalc]: 9.96e-06 [elim_not_effective]: 1.455e-05 [opt_reshape]: 8.80999e-06 [fold_const_symbol]: 1.068e-05 [renormalize]: 3.50003e-07 [validate]: 5.339e-05 Sums bootstrap : 0.000375s : 0.50% type_inference : 0.067400s : 89.76% event_method : 0.000022s : 0.03% auto_monad : 0.000075s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000334s : 0.45% rewriter_before_opt_a : 0.000086s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000106s : 0.14% jit_opt_a.loop_unroll : 0.000038s : 0.05% jit_opt_a.a_1 : 0.000822s : 1.10% jit_opt_a.with_stream_mark : 0.000040s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.003144s : 4.19% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.04% jit_opt_a.cse : 0.000048s : 0.06% jit_opt_a.replace_applicator : 0.000028s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000803s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000490s : 0.65% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000548s : 0.73% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.07% Time group info: ------[substitution.] 0.000280 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.48% : 0.000007s : 4: substitution.graph_param_transform 85.34% : 0.000239s : 4: substitution.inline 1.65% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000006s : 2: substitution.replace_old_param 5.21% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067296 2 96.04% : 0.064634s : 1: type_inference.infer 3.96% : 0.002662s : 1: type_inference.specialize ------[replace.] 0.000082 6 66.83% : 0.000055s : 4: replace.inline 33.17% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 6 94.62% : 0.000237s : 4: match.inline 5.38% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.37% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 12: predicate.addn_check_dump 1.53% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000003s : 12: predicate.arithmetic_simplify 1.62% : 0.000002s : 12: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 0.98% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.51% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 26: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.74% : 0.000003s : 8: predicate.less_batch_normalization 1.69% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 12: predicate.merge_addn 0.98% : 0.000001s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.88% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.02% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000004s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.21% : 0.000011s : 58: predicate.switch_simplify 1.48% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 2.01% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.51% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002907 26 69.45% : 0.002019s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.11% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.44% : 0.000827s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084376 72 0.06% : 0.000055s : 1: add_recomputation 0.09% : 0.000078s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.47% : 0.000393s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.81% : 0.009125s : 1: jit_opt_a 0.20% : 0.000168s : 1: jit_opt_after_cconv 0.08% : 0.000064s : 1: jit_opt_b 0.59% : 0.000498s : 1: loop_unroll 0.96% : 0.000812s : 1: mutable_eliminate 1.33% : 0.001121s : 26: opt.transform.jit_opt_a 0.07% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000556s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000340s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.60% : 0.002196s : 1: renormalize.infer 1.11% : 0.000935s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.11% : 0.000091s : 1: rewriter_before_opt_a 0.11% : 0.000089s : 1: symbol_engine_optimizer 79.90% : 0.067416s : 1: type_inference TotalTime = 0.147183, [30] [bootstrap]: 0.00025446 [type_inference]: 0.114473 [event_method]: 0.00030091 [auto_monad]: 0.00011124 [graph_reusing]: 8.31002e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 3.82e-05 [rewriter_before_opt_a]: 0.0001281 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0295478, [3] [Cycle 1]: 0.0188092, [27] [switch_simplify]: 8.361e-05 [loop_unroll]: 4.774e-05 [a_1]: 0.00104677 [with_stream_mark]: 3.604e-05 [recompute_prepare]: 2.392e-05 [updatestate_depend_eliminate]: 9.71998e-06 [updatestate_assign_eliminate]: 7.11999e-06 [updatestate_loads_eliminate]: 6.88e-06 [parameter_eliminate]: 2.75997e-06 [specialize_transform]: 1.589e-05 [updatestate_useless_node_eliminater]: 1.453e-05 [accelerated_algorithm]: 1.447e-05 [meta_shard_fg_expand]: 3.65003e-06 [get_grad_eliminate_]: 1.472e-05 [merge_forward]: 9.92999e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.971e-05 [j_node_and_user_rematch]: 2.614e-05 [meta_fg_expand]: 0.00194586 [replace_old_param]: 7.439e-05 [inline_without_move]: 6.442e-05 [renormalize]: 0.0146161 [add_forward_monad_depend]: 1.21e-05 [auto_monad_grad]: 6.19001e-06 [auto_monad_eliminator]: 6.352e-05 [cse]: 0.00026112 [replace_applicator]: 9.196e-05 [Cycle 2]: 0.0066319, [27] [switch_simplify]: 4.641e-05 [loop_unroll]: 5.735e-05 [a_1]: 0.00121953 [with_stream_mark]: 1.63e-05 [recompute_prepare]: 1.003e-05 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 4.15999e-06 [updatestate_loads_eliminate]: 4.20999e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 8.80999e-06 [updatestate_useless_node_eliminater]: 8.50001e-06 [accelerated_algorithm]: 8.35999e-06 [meta_shard_fg_expand]: 2.70002e-06 [get_grad_eliminate_]: 7.89002e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.763e-05 [j_node_and_user_rematch]: 1.293e-05 [meta_fg_expand]: 9.861e-05 [replace_old_param]: 9.71998e-06 [inline_without_move]: 8.67998e-06 [renormalize]: 0.00481108 [add_forward_monad_depend]: 6.93e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 3.105e-05 [cse]: 2.809e-05 [replace_applicator]: 1.822e-05 [Cycle 3]: 0.00031377, [27] [switch_simplify]: 6.41e-06 [loop_unroll]: 5.17e-06 [a_1]: 7.166e-05 [with_stream_mark]: 1.135e-05 [recompute_prepare]: 4.80999e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 2.65997e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 4.47e-06 [accelerated_algorithm]: 4.50001e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.594e-05 [j_node_and_user_rematch]: 8.09002e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 4.18001e-06 [inline_without_move]: 4.13001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.36998e-06 [auto_monad_grad]: 8.40024e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.092e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 1.386e-05 [rewriter_after_opt_a]: 3.743e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00070079 [jit_opt_b]: 4.75e-05, [1] [Cycle 1]: 4.04e-05, [2] [frontend_op_eliminate]: 1.41e-05 [inline_after_opt_a]: 1.482e-05 [cconv]: 2.619e-05 [loop_unroll]: 0.00045435 [jit_opt_after_cconv]: 0.00014274, [1] [Cycle 1]: 0.00013633, [11] [c_1]: 1.723e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.232e-05 [call_graph_tuple_transform]: 1.737e-05 [tuple_list_get_item_eliminator]: 5.73997e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 4.73001e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 2.03997e-06 [environ_conv]: 5.97001e-06 [add_recomputation]: 4.568e-05 [cse_after_recomputation]: 2.426e-05, [1] [Cycle 1]: 1.895e-05, [1] [cse]: 1.249e-05 [auto_monad_reorder]: 1.556e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 5.57001e-06 [opt_after_jit_grad]: 0.00045255 [symbol_engine_optimizer]: 7.157e-05, [1] [Cycle 1]: 6.582e-05, [6] [build]: 3.73999e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.233e-05 [opt_reshape]: 5.12e-06 [fold_const_symbol]: 7.65e-06 [renormalize]: 4.69998e-07 [validate]: 3.493e-05 Sums bootstrap : 0.000254s : 0.18% type_inference : 0.114473s : 80.34% event_method : 0.000301s : 0.21% auto_monad : 0.000111s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000038s : 0.03% rewriter_before_opt_a : 0.000128s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000136s : 0.10% jit_opt_a.loop_unroll : 0.000110s : 0.08% jit_opt_a.a_1 : 0.002338s : 1.64% jit_opt_a.with_stream_mark : 0.000064s : 0.04% jit_opt_a.recompute_prepare : 0.000039s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000030s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000028s : 0.02% jit_opt_a.accelerated_algorithm : 0.000027s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000027s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.002046s : 1.44% jit_opt_a.replace_old_param : 0.000088s : 0.06% jit_opt_a.inline_without_move : 0.000077s : 0.05% jit_opt_a.renormalize : 0.019427s : 13.63% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000100s : 0.07% jit_opt_a.cse : 0.000300s : 0.21% jit_opt_a.replace_applicator : 0.000115s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000701s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000454s : 0.32% jit_opt_after_cconv.c_1 : 0.000017s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000453s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.02% Time group info: ------[substitution.] 0.000605 112 0.36% : 0.000002s : 2: substitution.elim_not_effective 0.20% : 0.000001s : 2: substitution.fold_const_symbol 0.88% : 0.000005s : 2: substitution.graph_param_transform 65.37% : 0.000396s : 13: substitution.inline 3.38% : 0.000020s : 2: substitution.inline_without_move 1.72% : 0.000010s : 14: substitution.j_node_and_user_rematch 2.04% : 0.000012s : 7: substitution.minmaximum_grad 1.32% : 0.000008s : 5: substitution.partial_eliminate 1.97% : 0.000012s : 14: substitution.remove_not_recompute_node 5.04% : 0.000031s : 10: substitution.replace_applicator 1.16% : 0.000007s : 10: substitution.replace_old_param 1.25% : 0.000008s : 1: substitution.reshape_eliminate 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 0.96% : 0.000006s : 1: substitution.tile_eliminate 3.97% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.64% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.25% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114362 2 97.90% : 0.111955s : 1: type_inference.infer 2.10% : 0.002407s : 1: type_inference.specialize ------[replace.] 0.000183 20 66.38% : 0.000121s : 13: replace.inline 33.62% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000410 20 94.68% : 0.000388s : 13: match.inline 5.32% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000400 2852 1.55% : 0.000006s : 49: predicate.accumulaten_eliminater 0.25% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.45% : 0.000006s : 49: predicate.addn_check_dump 1.56% : 0.000006s : 49: predicate.addn_zero_filter 2.06% : 0.000008s : 49: predicate.arithmetic_simplify 1.74% : 0.000007s : 49: predicate.cast_eliminate 0.11% : 0.000000s : 2: predicate.check_bprop_eliminate 1.42% : 0.000006s : 49: predicate.compare_switch_simplify 1.49% : 0.000006s : 49: predicate.depend_value_elim 1.43% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 49: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.20% : 0.000001s : 2: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 49: predicate.environ_add_const_eliminate 1.46% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.41% : 0.000006s : 49: predicate.environ_get_depend_swap 1.57% : 0.000006s : 49: predicate.environ_get_eliminate 1.47% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.92% : 0.000004s : 21: predicate.get_grad_eliminate 0.10% : 0.000000s : 2: predicate.graph_param_transform 4.20% : 0.000017s : 73: predicate.inline 2.08% : 0.000008s : 49: predicate.inline_without_move 0.39% : 0.000002s : 21: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 21: predicate.less_batch_normalization 1.80% : 0.000007s : 56: predicate.list_to_tuple_eliminator_ 1.86% : 0.000007s : 58: predicate.load_eliminater 0.37% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.41% : 0.000014s : 102: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 51: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 49: predicate.merge_addn 1.53% : 0.000006s : 49: predicate.minmaximum_grad 0.46% : 0.000002s : 2: predicate.mutable_eliminate 0.13% : 0.000001s : 2: predicate.opt_reshape 2.26% : 0.000009s : 58: predicate.partial_eliminate 1.50% : 0.000006s : 49: predicate.print_const_string_wrapper 2.01% : 0.000008s : 49: predicate.reduce_eliminate 1.84% : 0.000007s : 56: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000002s : 21: predicate.remove_not_recompute_node 2.80% : 0.000011s : 106: predicate.replace_applicator 1.15% : 0.000005s : 49: predicate.replace_old_param 0.07% : 0.000000s : 2: predicate.reset_defer_inline 1.68% : 0.000007s : 49: predicate.reshape_eliminate 1.53% : 0.000006s : 49: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 2: predicate.row_tensor_eliminate 1.54% : 0.000006s : 49: predicate.same_eliminate 0.51% : 0.000002s : 21: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 4: predicate.special_op_eliminate 0.82% : 0.000003s : 21: predicate.specialize_transform 1.71% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 49: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.84% : 0.000011s : 69: predicate.switch_defer_inline 2.49% : 0.000010s : 69: predicate.switch_layer_defer_inline 6.59% : 0.000026s : 173: predicate.switch_simplify 1.63% : 0.000007s : 49: predicate.tile_eliminate 1.55% : 0.000006s : 49: predicate.transpose_eliminate 2.01% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000007s : 49: predicate.tuple_list_get_item_depend_reorder 3.10% : 0.000012s : 60: predicate.tuple_list_get_item_eliminator 1.92% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 56: predicate.tuple_to_list_eliminator_ 1.79% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.84% : 0.000011s : 79: predicate.updatestate_useless_node_eliminater 1.94% : 0.000008s : 49: predicate.value_based_eliminate 0.08% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.036730 52 97.52% : 0.035820s : 35: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000910s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.169709 87 0.03% : 0.000049s : 1: add_recomputation 0.07% : 0.000119s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.17% : 0.000280s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.18% : 0.000309s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 17.41% : 0.029551s : 1: jit_opt_a 0.09% : 0.000146s : 1: jit_opt_after_cconv 0.03% : 0.000050s : 1: jit_opt_b 0.27% : 0.000462s : 1: loop_unroll 0.42% : 0.000709s : 1: mutable_eliminate 1.81% : 0.003074s : 39: opt.transform.jit_opt_a 0.02% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000460s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 10.11% : 0.017155s : 2: renormalize.infer 1.33% : 0.002250s : 2: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000131s : 1: rewriter_before_opt_a 0.04% : 0.000074s : 1: symbol_engine_optimizer 67.47% : 0.114499s : 1: type_inference TotalTime = 0.0133453, [30] [bootstrap]: 0.00030686 [type_inference]: 0.0050087 [event_method]: 1.792e-05 [auto_monad]: 6.346e-05 [graph_reusing]: 5.06002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 3.486e-05 [rewriter_before_opt_a]: 7.221e-05 [expand_dump_flag]: 3.17002e-06 [jit_opt_a]: 0.00563457, [2] [Cycle 1]: 0.00177472, [27] [switch_simplify]: 6.241e-05 [loop_unroll]: 2.911e-05 [a_1]: 0.00055804 [with_stream_mark]: 2.289e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.28002e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.631e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00076133 [add_forward_monad_depend]: 6.07001e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.544e-05 [cse]: 3.481e-05 [replace_applicator]: 1.258e-05 [Cycle 2]: 0.00032196, [27] [switch_simplify]: 5.57999e-06 [loop_unroll]: 4.85001e-06 [a_1]: 8.682e-05 [with_stream_mark]: 1.035e-05 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 4.49998e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.41002e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.25002e-06 [cse]: 1.269e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.488e-05 [rewriter_after_opt_a]: 3.835e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00062284 [jit_opt_b]: 4.871e-05, [1] [Cycle 1]: 4.138e-05, [2] [frontend_op_eliminate]: 1.561e-05 [inline_after_opt_a]: 1.511e-05 [cconv]: 2.846e-05 [loop_unroll]: 0.0004118 [jit_opt_after_cconv]: 0.00015798, [1] [Cycle 1]: 0.00015176, [11] [c_1]: 1.999e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 7.21999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 2.785e-05 [call_graph_tuple_transform]: 2.561e-05 [tuple_list_get_item_eliminator]: 5.20001e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.48002e-06 [remove_dup_value]: 1.612e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 6.81999e-06 [add_recomputation]: 5.025e-05 [cse_after_recomputation]: 2.507e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.371e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 4.88001e-06 [opt_after_jit_grad]: 0.00044267 [symbol_engine_optimizer]: 7.2e-05, [1] [Cycle 1]: 6.565e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 7.4e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 5.76998e-06 [fold_const_symbol]: 8.33999e-06 [renormalize]: 3.89991e-07 [validate]: 4.431e-05 Sums bootstrap : 0.000307s : 3.33% type_inference : 0.005009s : 54.31% event_method : 0.000018s : 0.19% auto_monad : 0.000063s : 0.69% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.38% rewriter_before_opt_a : 0.000072s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.74% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000645s : 6.99% jit_opt_a.with_stream_mark : 0.000033s : 0.36% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000012s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000761s : 8.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000048s : 0.52% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000015s : 0.16% rewriter_after_opt_a : 0.000038s : 0.42% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000623s : 6.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000028s : 0.31% loop_unroll : 0.000412s : 4.47% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000028s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.28% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000050s : 0.54% cse_after_recomputation.cse : 0.000014s : 0.15% auto_monad_reorder : 0.000017s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000443s : 4.80% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.48% Time group info: ------[substitution.] 0.000241 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 4.96% : 0.000012s : 3: substitution.graph_param_transform 82.33% : 0.000198s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000006s : 4: substitution.remove_not_recompute_node 2.33% : 0.000006s : 2: substitution.replace_old_param 5.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004940 2 83.47% : 0.004123s : 1: type_inference.infer 16.53% : 0.000817s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.21% : 0.000047s : 4: replace.inline 32.79% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 94.43% : 0.000196s : 4: match.inline 5.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.84% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.05% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.97% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.51% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.70% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000673 13 54.66% : 0.000368s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.43% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.90% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015026 72 0.36% : 0.000053s : 1: add_recomputation 0.44% : 0.000066s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.18% : 0.000327s : 1: bootstrap 0.21% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.53% : 0.005639s : 1: jit_opt_a 1.07% : 0.000160s : 1: jit_opt_after_cconv 0.34% : 0.000051s : 1: jit_opt_b 2.79% : 0.000420s : 1: loop_unroll 4.21% : 0.000633s : 1: mutable_eliminate 5.77% : 0.000867s : 26: opt.transform.jit_opt_a 0.35% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.00% : 0.000451s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000037s : 1: py_interpret_to_execute 0.11% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.77% : 0.000416s : 1: renormalize.infer 2.25% : 0.000338s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000041s : 1: rewriter_after_opt_a 0.50% : 0.000075s : 1: rewriter_before_opt_a 0.50% : 0.000074s : 1: symbol_engine_optimizer 33.44% : 0.005024s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.327.994 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007ce50> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.328.752 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.149514, [30] [bootstrap]: 0.00032074 [type_inference]: 0.135068 [event_method]: 2.809e-05 [auto_monad]: 8.206e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.87002e-06 [py_interpret_to_execute]: 0.00080508 [rewriter_before_opt_a]: 0.00011427 [expand_dump_flag]: 5.00001e-06 [jit_opt_a]: 0.0102893, [2] [Cycle 1]: 0.00541098, [27] [switch_simplify]: 7.856e-05 [loop_unroll]: 3.57e-05 [a_1]: 0.00082107 [with_stream_mark]: 2.154e-05 [recompute_prepare]: 1.241e-05 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.46999e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 8.08999e-06 [updatestate_useless_node_eliminater]: 6.66e-06 [accelerated_algorithm]: 8.19002e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 8.92999e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 2.00002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.789e-05 [j_node_and_user_rematch]: 1.263e-05 [meta_fg_expand]: 3.10998e-06 [replace_old_param]: 1.141e-05 [inline_without_move]: 7.53999e-06 [renormalize]: 0.00399411 [add_forward_monad_depend]: 1.053e-05 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 2.139e-05 [cse]: 4.407e-05 [replace_applicator]: 2.824e-05 [Cycle 2]: 0.0004501, [27] [switch_simplify]: 9.29e-06 [loop_unroll]: 7.08998e-06 [a_1]: 0.00015188 [with_stream_mark]: 1.728e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 6.93998e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 7.32002e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.37001e-06 [merge_forward]: 5.66998e-06 [cell_reuse_recompute_pass]: 4.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.958e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.62001e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 8.62998e-06 [cse]: 1.794e-05 [replace_applicator]: 8.25999e-06 [py_interpret_to_execute_after_opt_a]: 2.106e-05 [rewriter_after_opt_a]: 4.52e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.49998e-06 [mutable_eliminate]: 0.00088337 [jit_opt_b]: 6.577e-05, [1] [Cycle 1]: 5.703e-05, [2] [frontend_op_eliminate]: 2.33e-05 [inline_after_opt_a]: 2.111e-05 [cconv]: 3.337e-05 [loop_unroll]: 0.00044877 [jit_opt_after_cconv]: 0.00018005, [1] [Cycle 1]: 0.00017233, [11] [c_1]: 2.916e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 7.45e-06 [updatestate_assign_eliminate]: 4.58001e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 3.221e-05 [call_graph_tuple_transform]: 2.382e-05 [tuple_list_get_item_eliminator]: 7.38e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 2.29978e-07 [switch_simplify]: 7.51999e-06 [remove_dup_value]: 2.172e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.104e-05 [add_recomputation]: 5.244e-05 [cse_after_recomputation]: 2.891e-05, [1] [Cycle 1]: 2.2e-05, [1] [cse]: 1.555e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 6.79999e-06 [opt_after_jit_grad]: 0.00049095 [symbol_engine_optimizer]: 8.467e-05, [1] [Cycle 1]: 7.875e-05, [6] [build]: 4.42e-06 [elim_shapecalc]: 1.019e-05 [elim_not_effective]: 1.562e-05 [opt_reshape]: 7.36001e-06 [fold_const_symbol]: 1.011e-05 [renormalize]: 5.8001e-07 [validate]: 0.00017941 Sums bootstrap : 0.000321s : 0.22% type_inference : 0.135068s : 93.54% event_method : 0.000028s : 0.02% auto_monad : 0.000082s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000805s : 0.56% rewriter_before_opt_a : 0.000114s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000973s : 0.67% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003994s : 2.77% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000062s : 0.04% jit_opt_a.replace_applicator : 0.000036s : 0.03% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000883s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000449s : 0.31% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000022s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000491s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000179s : 0.12% Time group info: ------[substitution.] 0.000308 25 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 4: substitution.graph_param_transform 87.91% : 0.000270s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000006s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 4.38% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.134954 2 96.39% : 0.130080s : 1: type_inference.infer 3.61% : 0.004873s : 1: type_inference.specialize ------[replace.] 0.000138 7 65.41% : 0.000090s : 5: replace.inline 34.59% : 0.000048s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 7 95.66% : 0.000267s : 5: match.inline 4.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 886 2.01% : 0.000003s : 13: predicate.accumulaten_eliminater 0.89% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.49% : 0.000003s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.55% : 0.000003s : 13: predicate.environ_get_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.44% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 4.99% : 0.000009s : 28: predicate.inline 0.88% : 0.000002s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000003s : 8: predicate.less_batch_normalization 1.50% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 19: predicate.load_eliminater 0.92% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.46% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.95% : 0.000002s : 13: predicate.merge_addn 1.41% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.90% : 0.000003s : 13: predicate.print_const_string_wrapper 2.15% : 0.000004s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.27% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.67% : 0.000005s : 20: predicate.switch_defer_inline 2.33% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.11% : 0.000012s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.46% : 0.000003s : 13: predicate.transpose_eliminate 1.51% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002940 25 60.46% : 0.001777s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.07% : 0.001090s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154728 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000336s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.65% : 0.010294s : 1: jit_opt_a 0.12% : 0.000183s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.29% : 0.000455s : 1: loop_unroll 0.58% : 0.000893s : 1: mutable_eliminate 0.82% : 0.001275s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000498s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.53% : 0.000813s : 1: py_interpret_to_execute 0.02% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 1.86% : 0.002872s : 1: renormalize.infer 0.72% : 0.001109s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000120s : 1: rewriter_before_opt_a 0.06% : 0.000088s : 1: symbol_engine_optimizer 87.31% : 0.135089s : 1: type_inference TotalTime = 0.10441, [30] [bootstrap]: 0.00031115 [type_inference]: 0.0905147 [event_method]: 0.00039187 [auto_monad]: 0.00013112 [graph_reusing]: 8.06001e-06 [pre_auto_parallel]: 3.71001e-06 [py_interpret_to_execute]: 4.081e-05 [rewriter_before_opt_a]: 0.00014288 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.0099804, [2] [Cycle 1]: 0.00543764, [27] [switch_simplify]: 0.00017669 [loop_unroll]: 6.271e-05 [a_1]: 0.00151734 [with_stream_mark]: 2.297e-05 [recompute_prepare]: 1.208e-05 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 2.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.659e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 6.49999e-06 [renormalize]: 0.00325004 [add_forward_monad_depend]: 1.272e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.957e-05 [cse]: 2.691e-05 [replace_applicator]: 2.661e-05 [Cycle 2]: 0.00040866, [27] [switch_simplify]: 8.13001e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00011201 [with_stream_mark]: 1.681e-05 [recompute_prepare]: 7.56999e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.64998e-06 [cell_reuse_recompute_pass]: 4.67e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.025e-05 [j_node_and_user_rematch]: 1.076e-05 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 5.87001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.06998e-06 [auto_monad_grad]: 2.20002e-06 [auto_monad_eliminator]: 9.86e-06 [cse]: 1.586e-05 [replace_applicator]: 8.82e-06 [py_interpret_to_execute_after_opt_a]: 2.513e-05 [rewriter_after_opt_a]: 4.346e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 6.04999e-06 [mutable_eliminate]: 0.00097289 [jit_opt_b]: 6.222e-05, [1] [Cycle 1]: 5.362e-05, [2] [frontend_op_eliminate]: 1.987e-05 [inline_after_opt_a]: 2.159e-05 [cconv]: 3.118e-05 [loop_unroll]: 0.00049447 [jit_opt_after_cconv]: 0.00017286, [1] [Cycle 1]: 0.00016595, [11] [c_1]: 2.37e-05 [parameter_eliminate]: 4.38001e-06 [updatestate_depend_eliminate]: 7.6e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 3.108e-05 [call_graph_tuple_transform]: 2.447e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.817e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 5.91e-06 [add_recomputation]: 5.468e-05 [cse_after_recomputation]: 2.893e-05, [1] [Cycle 1]: 2.07e-05, [1] [cse]: 1.48e-05 [auto_monad_reorder]: 1.881e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 6.36998e-06 [opt_after_jit_grad]: 0.00050177 [symbol_engine_optimizer]: 8.142e-05, [1] [Cycle 1]: 7.5e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.513e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 1.129e-05 [renormalize]: 4.59986e-07 [validate]: 0.00015549 Sums bootstrap : 0.000311s : 0.31% type_inference : 0.090515s : 90.86% event_method : 0.000392s : 0.39% auto_monad : 0.000131s : 0.13% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000041s : 0.04% rewriter_before_opt_a : 0.000143s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000185s : 0.19% jit_opt_a.loop_unroll : 0.000069s : 0.07% jit_opt_a.a_1 : 0.001629s : 1.64% jit_opt_a.with_stream_mark : 0.000040s : 0.04% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003250s : 3.26% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.03% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000035s : 0.04% py_interpret_to_execute_after_opt_a : 0.000025s : 0.03% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000973s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000494s : 0.50% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000502s : 0.50% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000155s : 0.16% Time group info: ------[substitution.] 0.000633 35 0.48% : 0.000003s : 2: substitution.elim_not_effective 0.27% : 0.000002s : 2: substitution.fold_const_symbol 0.96% : 0.000006s : 3: substitution.graph_param_transform 90.25% : 0.000571s : 12: substitution.inline 0.76% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.98% : 0.000006s : 4: substitution.remove_not_recompute_node 0.92% : 0.000006s : 2: substitution.replace_old_param 1.57% : 0.000010s : 1: substitution.reshape_eliminate 2.04% : 0.000013s : 3: substitution.switch_simplify 1.76% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.090420 2 96.32% : 0.087096s : 1: type_inference.infer 3.68% : 0.003324s : 1: type_inference.specialize ------[replace.] 0.000320 18 54.78% : 0.000175s : 12: replace.inline 2.25% : 0.000007s : 1: replace.reshape_eliminate 17.92% : 0.000057s : 3: replace.switch_simplify 25.05% : 0.000080s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000595 18 94.92% : 0.000565s : 12: match.inline 1.47% : 0.000009s : 1: match.reshape_eliminate 1.91% : 0.000011s : 3: match.switch_simplify 1.70% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000224 1212 1.30% : 0.000003s : 19: predicate.accumulaten_eliminater 0.73% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.32% : 0.000003s : 19: predicate.addn_check_dump 1.64% : 0.000004s : 19: predicate.addn_zero_filter 2.43% : 0.000005s : 19: predicate.arithmetic_simplify 1.56% : 0.000003s : 20: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000002s : 19: predicate.compare_switch_simplify 1.30% : 0.000003s : 19: predicate.depend_value_elim 1.18% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.39% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.72% : 0.000004s : 20: predicate.dict_set_item_eliminator 0.67% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.18% : 0.000000s : 3: predicate.elim_not_effective 0.33% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.35% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.16% : 0.000003s : 20: predicate.environ_get_depend_swap 1.53% : 0.000003s : 20: predicate.environ_get_eliminate 1.46% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000002s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.08% : 0.000011s : 40: predicate.inline 0.79% : 0.000002s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.70% : 0.000004s : 25: predicate.load_eliminater 0.84% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000010s : 64: predicate.loop_unroll_before_grad 1.83% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.15% : 0.000003s : 19: predicate.merge_addn 1.12% : 0.000003s : 19: predicate.minmaximum_grad 1.06% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 1.98% : 0.000004s : 25: predicate.partial_eliminate 1.47% : 0.000003s : 19: predicate.print_const_string_wrapper 1.89% : 0.000004s : 19: predicate.reduce_eliminate 1.60% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000004s : 28: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000001s : 3: predicate.reset_defer_inline 1.68% : 0.000004s : 20: predicate.reshape_eliminate 1.57% : 0.000004s : 19: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.42% : 0.000003s : 19: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.61% : 0.000001s : 6: predicate.special_op_eliminate 0.50% : 0.000001s : 6: predicate.specialize_transform 1.64% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.29% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.56% : 0.000008s : 34: predicate.switch_defer_inline 3.00% : 0.000007s : 34: predicate.switch_layer_defer_inline 7.93% : 0.000018s : 107: predicate.switch_simplify 1.58% : 0.000004s : 19: predicate.tile_eliminate 1.26% : 0.000003s : 19: predicate.transpose_eliminate 1.51% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.85% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.47% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 2.00% : 0.000004s : 25: predicate.updatestate_pure_node_eliminater 2.33% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.70% : 0.000004s : 19: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004168 40 52.79% : 0.002201s : 21: func_graph_cloner_run.FuncGraphClonerGraph 7.45% : 0.000310s : 5: func_graph_cloner_run.FuncGraphClonerNode 39.76% : 0.001657s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109662 72 0.05% : 0.000057s : 1: add_recomputation 0.13% : 0.000138s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000324s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.36% : 0.000399s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 9.10% : 0.009984s : 1: jit_opt_a 0.16% : 0.000176s : 1: jit_opt_after_cconv 0.06% : 0.000066s : 1: jit_opt_b 0.46% : 0.000502s : 1: loop_unroll 0.90% : 0.000984s : 1: mutable_eliminate 1.86% : 0.002043s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000044s : 1: py_interpret_to_execute 0.03% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.60% : 0.001758s : 1: renormalize.infer 1.35% : 0.001478s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.13% : 0.000147s : 1: rewriter_before_opt_a 0.08% : 0.000084s : 1: symbol_engine_optimizer 82.56% : 0.090533s : 1: type_inference TotalTime = 0.0126703, [30] [bootstrap]: 0.00032699 [type_inference]: 0.0047066 [event_method]: 1.784e-05 [auto_monad]: 6.871e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 3.55e-05 [rewriter_before_opt_a]: 7.312e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00531707, [2] [Cycle 1]: 0.00168299, [27] [switch_simplify]: 5.802e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00054114 [with_stream_mark]: 2.2e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00070157 [add_forward_monad_depend]: 5.42999e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.54e-05 [cse]: 3.38e-05 [replace_applicator]: 1.184e-05 [Cycle 2]: 0.00031619, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 4.70999e-06 [a_1]: 9.066e-05 [with_stream_mark]: 8.73001e-06 [recompute_prepare]: 4.72998e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.99979e-07 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 4.72e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.38999e-06 [merge_forward]: 2.52001e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 7.80998e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7.76001e-06 [inline_without_move]: 4.62e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.141e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 1.135e-05 [rewriter_after_opt_a]: 3.588e-05 [convert_after_rewriter]: 7.07997e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00056748 [jit_opt_b]: 5.122e-05, [1] [Cycle 1]: 4.389e-05, [2] [frontend_op_eliminate]: 1.626e-05 [inline_after_opt_a]: 1.577e-05 [cconv]: 2.796e-05 [loop_unroll]: 0.00041015 [jit_opt_after_cconv]: 0.00014219, [1] [Cycle 1]: 0.00013577, [11] [c_1]: 2.079e-05 [parameter_eliminate]: 2.68998e-06 [updatestate_depend_eliminate]: 6.36998e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.21e-05 [call_graph_tuple_transform]: 1.89e-05 [tuple_list_get_item_eliminator]: 5.14e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 4.96002e-06 [remove_dup_value]: 1.625e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 5.61e-06 [add_recomputation]: 5.334e-05 [cse_after_recomputation]: 2.232e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.069e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.00043731 [symbol_engine_optimizer]: 7.163e-05, [1] [Cycle 1]: 6.512e-05, [6] [build]: 4.02e-06 [elim_shapecalc]: 7.77002e-06 [elim_not_effective]: 1.194e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 2.79979e-07 [validate]: 3.965e-05 Sums bootstrap : 0.000327s : 3.73% type_inference : 0.004707s : 53.65% event_method : 0.000018s : 0.20% auto_monad : 0.000069s : 0.78% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.40% rewriter_before_opt_a : 0.000073s : 0.83% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000064s : 0.73% jit_opt_a.loop_unroll : 0.000034s : 0.39% jit_opt_a.a_1 : 0.000632s : 7.20% jit_opt_a.with_stream_mark : 0.000031s : 0.35% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000702s : 8.00% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000045s : 0.52% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000036s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000567s : 6.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000028s : 0.32% loop_unroll : 0.000410s : 4.68% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.61% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000017s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000437s : 4.99% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.45% Time group info: ------[substitution.] 0.000222 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000005s : 3: substitution.graph_param_transform 84.60% : 0.000188s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000005s : 2: substitution.replace_old_param 5.43% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004645 2 82.21% : 0.003818s : 1: type_inference.infer 17.79% : 0.000827s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.88% : 0.000044s : 4: replace.inline 32.12% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.43% : 0.000185s : 4: match.inline 5.57% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.51% : 0.000001s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.12% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.66% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.43% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000632 13 52.89% : 0.000334s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.80% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.31% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014266 72 0.40% : 0.000056s : 1: add_recomputation 0.51% : 0.000072s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.43% : 0.000347s : 1: bootstrap 0.21% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.13% : 0.000018s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.29% : 0.005320s : 1: jit_opt_a 1.02% : 0.000145s : 1: jit_opt_after_cconv 0.38% : 0.000054s : 1: jit_opt_b 2.93% : 0.000418s : 1: loop_unroll 4.05% : 0.000577s : 1: mutable_eliminate 5.92% : 0.000845s : 26: opt.transform.jit_opt_a 0.33% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.12% : 0.000445s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.68% : 0.000382s : 1: renormalize.infer 2.17% : 0.000310s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.53% : 0.000076s : 1: rewriter_before_opt_a 0.52% : 0.000074s : 1: symbol_engine_optimizer 33.09% : 0.004721s : 1: type_inference TotalTime = 0.114978, [30] [bootstrap]: 0.00026603 [type_inference]: 0.0737621 [event_method]: 0.00029063 [auto_monad]: 0.00011179 [graph_reusing]: 8.00999e-06 [pre_auto_parallel]: 3.30998e-06 [py_interpret_to_execute]: 4.218e-05 [rewriter_before_opt_a]: 0.00012972 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.0379947, [3] [Cycle 1]: 0.0177266, [27] [switch_simplify]: 7.711e-05 [loop_unroll]: 4.798e-05 [a_1]: 0.00102044 [with_stream_mark]: 3.448e-05 [recompute_prepare]: 2.245e-05 [updatestate_depend_eliminate]: 9.72001e-06 [updatestate_assign_eliminate]: 7.33e-06 [updatestate_loads_eliminate]: 7.07002e-06 [parameter_eliminate]: 3.18e-06 [specialize_transform]: 1.622e-05 [updatestate_useless_node_eliminater]: 1.353e-05 [accelerated_algorithm]: 1.417e-05 [meta_shard_fg_expand]: 3.93999e-06 [get_grad_eliminate_]: 1.433e-05 [merge_forward]: 8.92e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.802e-05 [j_node_and_user_rematch]: 2.541e-05 [meta_fg_expand]: 0.00211992 [replace_old_param]: 7.207e-05 [inline_without_move]: 6.09e-05 [renormalize]: 0.0134042 [add_forward_monad_depend]: 1.385e-05 [auto_monad_grad]: 6.54001e-06 [auto_monad_eliminator]: 6.27e-05 [cse]: 0.00026731 [replace_applicator]: 9.125e-05 [Cycle 2]: 0.0164249, [27] [switch_simplify]: 4.303e-05 [loop_unroll]: 4.264e-05 [a_1]: 0.00134103 [with_stream_mark]: 1.953e-05 [recompute_prepare]: 1.058e-05 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 4.01001e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 1.168e-05 [meta_fg_expand]: 0.00010546 [replace_old_param]: 8.2e-06 [inline_without_move]: 6.57002e-06 [renormalize]: 0.0144703 [add_forward_monad_depend]: 1.232e-05 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 2.436e-05 [cse]: 3.517e-05 [replace_applicator]: 2.671e-05 [Cycle 3]: 0.00037432, [27] [switch_simplify]: 2.36e-05 [loop_unroll]: 5.27999e-06 [a_1]: 8.824e-05 [with_stream_mark]: 1.67e-05 [recompute_prepare]: 5.14998e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 4.89998e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 4.71002e-06 [cell_reuse_recompute_pass]: 3.36999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.775e-05 [j_node_and_user_rematch]: 9.36998e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 4.89e-06 [inline_without_move]: 4.28999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.70002e-06 [cse]: 1.406e-05 [replace_applicator]: 4.75999e-06 [py_interpret_to_execute_after_opt_a]: 1.572e-05 [rewriter_after_opt_a]: 4.058e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00076182 [jit_opt_b]: 4.854e-05, [1] [Cycle 1]: 4.124e-05, [2] [frontend_op_eliminate]: 1.346e-05 [inline_after_opt_a]: 1.544e-05 [cconv]: 2.893e-05 [loop_unroll]: 0.00042592 [jit_opt_after_cconv]: 0.00014775, [1] [Cycle 1]: 0.00014177, [11] [c_1]: 1.713e-05 [parameter_eliminate]: 3.09999e-06 [updatestate_depend_eliminate]: 6.68998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.633e-05 [call_graph_tuple_transform]: 1.877e-05 [tuple_list_get_item_eliminator]: 4.98001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 4.79002e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 5.91e-06 [add_recomputation]: 4.61e-05 [cse_after_recomputation]: 2.309e-05, [1] [Cycle 1]: 1.756e-05, [1] [cse]: 1.103e-05 [auto_monad_reorder]: 1.514e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 5.82001e-06 [opt_after_jit_grad]: 0.00045042 [symbol_engine_optimizer]: 7.274e-05, [1] [Cycle 1]: 6.685e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 7.21999e-06 [elim_not_effective]: 1.219e-05 [opt_reshape]: 5.56002e-06 [fold_const_symbol]: 8.12e-06 [renormalize]: 2.30008e-07 [validate]: 3.823e-05 Sums bootstrap : 0.000266s : 0.24% type_inference : 0.073762s : 66.71% event_method : 0.000291s : 0.26% auto_monad : 0.000112s : 0.10% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.04% rewriter_before_opt_a : 0.000130s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000144s : 0.13% jit_opt_a.loop_unroll : 0.000096s : 0.09% jit_opt_a.a_1 : 0.002450s : 2.22% jit_opt_a.with_stream_mark : 0.000071s : 0.06% jit_opt_a.recompute_prepare : 0.000038s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000015s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000014s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000029s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000026s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.04% jit_opt_a.meta_fg_expand : 0.002228s : 2.01% jit_opt_a.replace_old_param : 0.000085s : 0.08% jit_opt_a.inline_without_move : 0.000072s : 0.06% jit_opt_a.renormalize : 0.027875s : 25.21% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000094s : 0.08% jit_opt_a.cse : 0.000317s : 0.29% jit_opt_a.replace_applicator : 0.000123s : 0.11% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000762s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000015s : 0.01% cconv : 0.000029s : 0.03% loop_unroll : 0.000426s : 0.39% jit_opt_after_cconv.c_1 : 0.000017s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.00% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000450s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.03% Time group info: ------[substitution.] 0.000580 109 0.34% : 0.000002s : 2: substitution.elim_not_effective 0.22% : 0.000001s : 2: substitution.fold_const_symbol 0.93% : 0.000005s : 2: substitution.graph_param_transform 65.62% : 0.000381s : 13: substitution.inline 3.20% : 0.000019s : 2: substitution.inline_without_move 1.80% : 0.000010s : 13: substitution.j_node_and_user_rematch 1.93% : 0.000011s : 7: substitution.minmaximum_grad 1.34% : 0.000008s : 5: substitution.partial_eliminate 1.87% : 0.000011s : 13: substitution.remove_not_recompute_node 5.54% : 0.000032s : 10: substitution.replace_applicator 1.11% : 0.000006s : 10: substitution.replace_old_param 0.40% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.20% : 0.000007s : 1: substitution.tile_eliminate 4.03% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.84% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.65% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.073631 2 96.74% : 0.071228s : 1: type_inference.infer 3.26% : 0.002403s : 1: type_inference.specialize ------[replace.] 0.000181 20 66.06% : 0.000119s : 13: replace.inline 33.94% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000396 20 94.20% : 0.000373s : 13: match.inline 5.80% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000395 2740 1.56% : 0.000006s : 47: predicate.accumulaten_eliminater 0.31% : 0.000001s : 2: predicate.ad_related_special_op_eliminate 1.41% : 0.000006s : 47: predicate.addn_check_dump 1.62% : 0.000006s : 47: predicate.addn_zero_filter 2.06% : 0.000008s : 47: predicate.arithmetic_simplify 1.65% : 0.000007s : 47: predicate.cast_eliminate 0.11% : 0.000000s : 2: predicate.check_bprop_eliminate 1.41% : 0.000006s : 47: predicate.compare_switch_simplify 1.50% : 0.000006s : 47: predicate.depend_value_elim 1.41% : 0.000006s : 47: predicate.dict_get_item_const_eliminator 1.49% : 0.000006s : 47: predicate.dict_get_item_eliminator 1.46% : 0.000006s : 47: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 2: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 2: predicate.elim_not_effective 0.12% : 0.000000s : 2: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000006s : 47: predicate.environ_add_const_eliminate 1.40% : 0.000006s : 47: predicate.environ_get_add_eliminate 1.43% : 0.000006s : 47: predicate.environ_get_depend_swap 1.49% : 0.000006s : 47: predicate.environ_get_eliminate 1.42% : 0.000006s : 47: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 2: predicate.fold_const_symbol 0.82% : 0.000003s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 2: predicate.graph_param_transform 4.59% : 0.000018s : 71: predicate.inline 1.90% : 0.000008s : 47: predicate.inline_without_move 0.34% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.00% : 0.000004s : 19: predicate.less_batch_normalization 1.79% : 0.000007s : 54: predicate.list_to_tuple_eliminator_ 1.90% : 0.000007s : 56: predicate.load_eliminater 0.33% : 0.000001s : 2: predicate.loop_unroll_after_grad 3.53% : 0.000014s : 100: predicate.loop_unroll_before_grad 1.69% : 0.000007s : 49: predicate.make_slice_get_slice_eliminator 1.42% : 0.000006s : 47: predicate.merge_addn 1.49% : 0.000006s : 47: predicate.minmaximum_grad 0.51% : 0.000002s : 2: predicate.mutable_eliminate 0.23% : 0.000001s : 2: predicate.opt_reshape 2.35% : 0.000009s : 56: predicate.partial_eliminate 1.48% : 0.000006s : 47: predicate.print_const_string_wrapper 2.03% : 0.000008s : 47: predicate.reduce_eliminate 1.79% : 0.000007s : 54: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000002s : 19: predicate.remove_not_recompute_node 2.85% : 0.000011s : 102: predicate.replace_applicator 1.14% : 0.000004s : 47: predicate.replace_old_param 0.09% : 0.000000s : 2: predicate.reset_defer_inline 1.56% : 0.000006s : 47: predicate.reshape_eliminate 1.61% : 0.000006s : 47: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 2: predicate.row_tensor_eliminate 1.50% : 0.000006s : 47: predicate.same_eliminate 0.46% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 4: predicate.special_op_eliminate 0.84% : 0.000003s : 19: predicate.specialize_transform 1.77% : 0.000007s : 47: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000006s : 47: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 2: predicate.switch_call_monad_eliminater 2.88% : 0.000011s : 67: predicate.switch_defer_inline 2.52% : 0.000010s : 67: predicate.switch_layer_defer_inline 6.64% : 0.000026s : 169: predicate.switch_simplify 1.49% : 0.000006s : 47: predicate.tile_eliminate 1.53% : 0.000006s : 47: predicate.transpose_eliminate 1.98% : 0.000008s : 47: predicate.tuple_list_convert_item_index_to_positive 1.74% : 0.000007s : 47: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000013s : 58: predicate.tuple_list_get_item_eliminator 1.95% : 0.000008s : 47: predicate.tuple_list_set_item_eliminator 1.77% : 0.000007s : 54: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 56: predicate.updatestate_pure_node_eliminater 2.81% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 2.06% : 0.000008s : 47: predicate.value_based_eliminate 0.07% : 0.000000s : 2: predicate.virtual_view_grad_eliminate 0.17% : 0.000001s : 2: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004543 52 76.00% : 0.003453s : 35: func_graph_cloner_run.FuncGraphClonerGraph 24.00% : 0.001090s : 17: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146037 87 0.03% : 0.000049s : 1: add_recomputation 0.08% : 0.000118s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.20% : 0.000295s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.20% : 0.000298s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 26.02% : 0.037999s : 1: jit_opt_a 0.10% : 0.000151s : 1: jit_opt_after_cconv 0.03% : 0.000051s : 1: jit_opt_b 0.30% : 0.000433s : 1: loop_unroll 0.53% : 0.000771s : 1: mutable_eliminate 2.17% : 0.003167s : 39: opt.transform.jit_opt_a 0.03% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000023s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000030s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 17.37% : 0.025364s : 2: renormalize.infer 1.70% : 0.002483s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000133s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 50.53% : 0.073787s : 1: type_inference TotalTime = 0.403316, [30] [bootstrap]: 0.00039191 [type_inference]: 0.384607 [event_method]: 3.067e-05 [auto_monad]: 8.998e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00124013 [rewriter_before_opt_a]: 0.0001601 [expand_dump_flag]: 5.47999e-06 [jit_opt_a]: 0.013349, [2] [Cycle 1]: 0.0075086, [27] [switch_simplify]: 8.598e-05 [loop_unroll]: 5.281e-05 [a_1]: 0.00090117 [with_stream_mark]: 2.527e-05 [recompute_prepare]: 1.102e-05 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 8.2e-06 [updatestate_useless_node_eliminater]: 6.81999e-06 [accelerated_algorithm]: 8.31002e-06 [meta_shard_fg_expand]: 3.09001e-06 [get_grad_eliminate_]: 7.85e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.8e-05 [j_node_and_user_rematch]: 1.345e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.42e-05 [inline_without_move]: 7.56999e-06 [renormalize]: 0.00589943 [add_forward_monad_depend]: 6.266e-05 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 2.349e-05 [cse]: 4.25e-05 [replace_applicator]: 3.019e-05 [Cycle 2]: 0.00046241, [27] [switch_simplify]: 8.97999e-06 [loop_unroll]: 6.84999e-06 [a_1]: 0.00016269 [with_stream_mark]: 1.615e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 7.61001e-06 [updatestate_useless_node_eliminater]: 6.87002e-06 [accelerated_algorithm]: 7.28e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 6.23002e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 4.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 1.075e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 1.39989e-07 [add_forward_monad_depend]: 2.02999e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 7.88001e-06 [cse]: 1.696e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.846e-05 [rewriter_after_opt_a]: 4.702e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 6.04999e-06 [mutable_eliminate]: 0.00089927 [jit_opt_b]: 7.046e-05, [1] [Cycle 1]: 6.067e-05, [2] [frontend_op_eliminate]: 2.637e-05 [inline_after_opt_a]: 2.175e-05 [cconv]: 3.365e-05 [loop_unroll]: 0.00069823 [jit_opt_after_cconv]: 0.00025056, [1] [Cycle 1]: 0.00024148, [11] [c_1]: 3.472e-05 [parameter_eliminate]: 4.32e-06 [updatestate_depend_eliminate]: 9.96998e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 3.22002e-06 [cse]: 4.043e-05 [call_graph_tuple_transform]: 3.101e-05 [tuple_list_get_item_eliminator]: 6.89999e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 4.733e-05 [remove_dup_value]: 1.906e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 1.25e-05 [add_recomputation]: 6.621e-05 [cse_after_recomputation]: 3.77e-05, [1] [Cycle 1]: 2.929e-05, [1] [cse]: 1.82e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 2.36998e-06 [rewriter_after_jit_bprop_graph]: 9.57999e-06 [opt_after_jit_grad]: 0.00063744 [symbol_engine_optimizer]: 0.00028254, [1] [Cycle 1]: 0.00027418, [6] [build]: 5.17999e-06 [elim_shapecalc]: 0.00018526 [elim_not_effective]: 2.166e-05 [opt_reshape]: 1.065e-05 [fold_const_symbol]: 1.372e-05 [renormalize]: 3.10014e-07 [validate]: 6.434e-05 Sums bootstrap : 0.000392s : 0.10% type_inference : 0.384607s : 96.84% event_method : 0.000031s : 0.01% auto_monad : 0.000090s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001240s : 0.31% rewriter_before_opt_a : 0.000160s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000095s : 0.02% jit_opt_a.loop_unroll : 0.000060s : 0.02% jit_opt_a.a_1 : 0.001064s : 0.27% jit_opt_a.with_stream_mark : 0.000041s : 0.01% jit_opt_a.recompute_prepare : 0.000019s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000016s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000053s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.005900s : 1.49% jit_opt_a.add_forward_monad_depend : 0.000065s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000059s : 0.01% jit_opt_a.replace_applicator : 0.000036s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.00% rewriter_after_opt_a : 0.000047s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000899s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.000698s : 0.18% jit_opt_after_cconv.c_1 : 0.000035s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000047s : 0.01% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.00% add_recomputation : 0.000066s : 0.02% cse_after_recomputation.cse : 0.000018s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000637s : 0.16% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000185s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000064s : 0.02% Time group info: ------[substitution.] 0.000394 28 0.79% : 0.000003s : 2: substitution.elim_not_effective 0.45% : 0.000002s : 2: substitution.fold_const_symbol 2.11% : 0.000008s : 4: substitution.graph_param_transform 84.44% : 0.000333s : 5: substitution.inline 1.24% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.19% : 0.000017s : 3: substitution.reduce_eliminate 1.60% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000007s : 2: substitution.replace_old_param 3.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.384465 2 98.54% : 0.378849s : 1: type_inference.infer 1.46% : 0.005616s : 1: type_inference.specialize ------[replace.] 0.000140 7 67.27% : 0.000094s : 5: replace.inline 32.73% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000342 7 96.55% : 0.000330s : 5: match.inline 3.45% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000210 886 1.11% : 0.000002s : 13: predicate.accumulaten_eliminater 0.88% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.90% : 0.000002s : 13: predicate.addn_check_dump 0.97% : 0.000002s : 13: predicate.addn_zero_filter 1.87% : 0.000004s : 13: predicate.arithmetic_simplify 1.16% : 0.000002s : 13: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 0.93% : 0.000002s : 13: predicate.compare_switch_simplify 0.97% : 0.000002s : 13: predicate.depend_value_elim 0.87% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.61% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.76% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 4.22% : 0.000009s : 28: predicate.inline 0.65% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000003s : 8: predicate.less_batch_normalization 1.53% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.47% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000003s : 4: predicate.loop_unroll_after_grad 2.81% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.82% : 0.000002s : 13: predicate.merge_addn 0.77% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 1.48% : 0.000003s : 19: predicate.partial_eliminate 1.07% : 0.000002s : 13: predicate.print_const_string_wrapper 2.61% : 0.000005s : 13: predicate.reduce_eliminate 1.10% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.51% : 0.000003s : 23: predicate.replace_applicator 0.49% : 0.000001s : 8: predicate.replace_old_param 0.24% : 0.000001s : 4: predicate.reset_defer_inline 0.89% : 0.000002s : 13: predicate.reshape_eliminate 1.02% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 0.87% : 0.000002s : 13: predicate.same_eliminate 0.42% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.64% : 0.000001s : 8: predicate.specialize_transform 1.66% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.12% : 0.000004s : 20: predicate.switch_defer_inline 1.64% : 0.000003s : 20: predicate.switch_layer_defer_inline 22.74% : 0.000048s : 64: predicate.switch_simplify 1.10% : 0.000002s : 13: predicate.tile_eliminate 1.07% : 0.000002s : 13: predicate.transpose_eliminate 1.15% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.33% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.21% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.23% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.10% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.22% : 0.000003s : 13: predicate.value_based_eliminate 0.21% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003642 25 55.36% : 0.002016s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.71% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.93% : 0.001527s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.410924 72 0.02% : 0.000070s : 1: add_recomputation 0.02% : 0.000093s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.10% : 0.000409s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000042s : 1: cse_after_recomputation 0.00% : 0.000015s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 3.25% : 0.013354s : 1: jit_opt_a 0.06% : 0.000254s : 1: jit_opt_after_cconv 0.02% : 0.000074s : 1: jit_opt_b 0.17% : 0.000710s : 1: loop_unroll 0.22% : 0.000911s : 1: mutable_eliminate 0.34% : 0.001409s : 26: opt.transform.jit_opt_a 0.03% : 0.000116s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000225s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000647s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.001258s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.03% : 0.004233s : 1: renormalize.infer 0.40% : 0.001651s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000050s : 1: rewriter_after_opt_a 0.04% : 0.000167s : 1: rewriter_before_opt_a 0.07% : 0.000286s : 1: symbol_engine_optimizer 93.60% : 0.384631s : 1: type_inference TotalTime = 0.107103, [30] [bootstrap]: 0.00029921 [type_inference]: 0.0958554 [event_method]: 0.00034171 [auto_monad]: 0.00013599 [graph_reusing]: 9.04e-06 [pre_auto_parallel]: 3.16999e-06 [py_interpret_to_execute]: 4.208e-05 [rewriter_before_opt_a]: 0.00013413 [expand_dump_flag]: 4.43999e-06 [jit_opt_a]: 0.00797432, [2] [Cycle 1]: 0.00399179, [27] [switch_simplify]: 0.00016594 [loop_unroll]: 5.316e-05 [a_1]: 0.00133303 [with_stream_mark]: 2.324e-05 [recompute_prepare]: 8.99e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 0.00206604 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.698e-05 [cse]: 3.411e-05 [replace_applicator]: 1.522e-05 [Cycle 2]: 0.00034608, [27] [switch_simplify]: 6.72002e-06 [loop_unroll]: 6.32001e-06 [a_1]: 9.918e-05 [with_stream_mark]: 1.109e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.91002e-06 [merge_forward]: 2.70002e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 8.22998e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.39e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.4e-05 [replace_applicator]: 6.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.383e-05 [rewriter_after_opt_a]: 4.023e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.59998e-06 [mutable_eliminate]: 0.00064895 [jit_opt_b]: 5.283e-05, [1] [Cycle 1]: 4.574e-05, [2] [frontend_op_eliminate]: 1.678e-05 [inline_after_opt_a]: 1.77e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.0004251 [jit_opt_after_cconv]: 0.00015762, [1] [Cycle 1]: 0.00015134, [11] [c_1]: 2.156e-05 [parameter_eliminate]: 3.74002e-06 [updatestate_depend_eliminate]: 7.88999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 2.534e-05 [call_graph_tuple_transform]: 2.171e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.601e-05 [partial_unused_args_eliminate]: 2.03002e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 5.33e-05 [cse_after_recomputation]: 2.459e-05, [1] [Cycle 1]: 1.848e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.27999e-06 [opt_after_jit_grad]: 0.00048376 [symbol_engine_optimizer]: 7.931e-05, [1] [Cycle 1]: 7.338e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 8.44002e-06 [elim_not_effective]: 1.462e-05 [opt_reshape]: 6.43e-06 [fold_const_symbol]: 1.016e-05 [renormalize]: 4.39992e-07 [validate]: 4.388e-05 Sums bootstrap : 0.000299s : 0.29% type_inference : 0.095855s : 93.20% event_method : 0.000342s : 0.33% auto_monad : 0.000136s : 0.13% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.04% rewriter_before_opt_a : 0.000134s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000173s : 0.17% jit_opt_a.loop_unroll : 0.000059s : 0.06% jit_opt_a.a_1 : 0.001432s : 1.39% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002066s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000048s : 0.05% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000649s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000425s : 0.41% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000484s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000532 35 0.34% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000002s : 2: substitution.fold_const_symbol 1.14% : 0.000006s : 3: substitution.graph_param_transform 89.88% : 0.000478s : 12: substitution.inline 0.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.91% : 0.000005s : 4: substitution.remove_not_recompute_node 0.87% : 0.000005s : 2: substitution.replace_old_param 1.64% : 0.000009s : 1: substitution.reshape_eliminate 2.33% : 0.000012s : 3: substitution.switch_simplify 1.92% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.095765 2 96.85% : 0.092748s : 1: type_inference.infer 3.15% : 0.003018s : 1: type_inference.specialize ------[replace.] 0.000264 18 54.25% : 0.000143s : 12: replace.inline 1.79% : 0.000005s : 1: replace.reshape_eliminate 18.99% : 0.000050s : 3: replace.switch_simplify 24.98% : 0.000066s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000499 18 94.43% : 0.000472s : 12: match.inline 1.60% : 0.000008s : 1: match.reshape_eliminate 2.14% : 0.000011s : 3: match.switch_simplify 1.83% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000200 1212 1.35% : 0.000003s : 19: predicate.accumulaten_eliminater 0.61% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 19: predicate.addn_check_dump 1.49% : 0.000003s : 19: predicate.addn_zero_filter 2.27% : 0.000005s : 19: predicate.arithmetic_simplify 1.63% : 0.000003s : 20: predicate.cast_eliminate 0.29% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000002s : 19: predicate.compare_switch_simplify 1.28% : 0.000003s : 19: predicate.depend_value_elim 1.38% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.50% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.49% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.55% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.29% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.34% : 0.000003s : 20: predicate.environ_get_depend_swap 1.68% : 0.000003s : 20: predicate.environ_get_eliminate 1.32% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 0.63% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000001s : 3: predicate.graph_param_transform 5.66% : 0.000011s : 40: predicate.inline 0.54% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.71% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.86% : 0.000004s : 25: predicate.load_eliminater 0.91% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.68% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.70% : 0.000003s : 23: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 19: predicate.merge_addn 1.23% : 0.000002s : 19: predicate.minmaximum_grad 1.05% : 0.000002s : 3: predicate.mutable_eliminate 0.34% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000005s : 25: predicate.partial_eliminate 1.27% : 0.000003s : 19: predicate.print_const_string_wrapper 2.05% : 0.000004s : 19: predicate.reduce_eliminate 1.62% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000003s : 28: predicate.replace_applicator 0.32% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000001s : 3: predicate.reset_defer_inline 1.73% : 0.000003s : 20: predicate.reshape_eliminate 1.49% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.53% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000003s : 19: predicate.same_eliminate 0.30% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.55% : 0.000001s : 6: predicate.special_op_eliminate 0.58% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.20% : 0.000006s : 34: predicate.switch_defer_inline 2.81% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.53% : 0.000017s : 107: predicate.switch_simplify 1.41% : 0.000003s : 19: predicate.tile_eliminate 1.42% : 0.000003s : 19: predicate.transpose_eliminate 1.69% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.54% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.75% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.39% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.68% : 0.000003s : 19: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003380 40 67.82% : 0.002292s : 21: func_graph_cloner_run.FuncGraphClonerGraph 7.71% : 0.000260s : 5: func_graph_cloner_run.FuncGraphClonerNode 24.48% : 0.000827s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111005 72 0.05% : 0.000056s : 1: add_recomputation 0.13% : 0.000142s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.28% : 0.000316s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.32% : 0.000350s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 7.19% : 0.007978s : 1: jit_opt_a 0.14% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.39% : 0.000433s : 1: loop_unroll 0.59% : 0.000657s : 1: mutable_eliminate 1.61% : 0.001789s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000045s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.32% : 0.001462s : 1: renormalize.infer 0.54% : 0.000595s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.12% : 0.000137s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 86.37% : 0.095874s : 1: type_inference TotalTime = 0.0395544, [30] [bootstrap]: 0.00034092 [type_inference]: 0.0248542 [event_method]: 2.031e-05 [auto_monad]: 6.946e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 9.802e-05 [rewriter_before_opt_a]: 8.373e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.0114389, [2] [Cycle 1]: 0.00456814, [27] [switch_simplify]: 6.634e-05 [loop_unroll]: 2.955e-05 [a_1]: 0.00282741 [with_stream_mark]: 3.374e-05 [recompute_prepare]: 1.359e-05 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 6.03002e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 2.48998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.053e-05 [meta_fg_expand]: 2.68998e-06 [replace_old_param]: 1.187e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00118092 [add_forward_monad_depend]: 8.75001e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.916e-05 [cse]: 3.748e-05 [replace_applicator]: 1.792e-05 [Cycle 2]: 0.00034065, [27] [switch_simplify]: 5.62001e-06 [loop_unroll]: 5.20001e-06 [a_1]: 8.732e-05 [with_stream_mark]: 1.495e-05 [recompute_prepare]: 6.46e-06 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 5.67999e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.733e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 7.10002e-06 [cse]: 1.33e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 1.662e-05 [rewriter_after_opt_a]: 4.319e-05 [convert_after_rewriter]: 8.33001e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00077962 [jit_opt_b]: 5.357e-05, [1] [Cycle 1]: 4.456e-05, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 1.672e-05 [cconv]: 3.336e-05 [loop_unroll]: 0.00053107 [jit_opt_after_cconv]: 0.00017051, [1] [Cycle 1]: 0.00016335, [11] [c_1]: 2.135e-05 [parameter_eliminate]: 5.54e-06 [updatestate_depend_eliminate]: 9.96e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.78998e-06 [cse]: 3.508e-05 [call_graph_tuple_transform]: 2.37e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.07e-06 [remove_dup_value]: 1.601e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.851e-05 [cse_after_recomputation]: 2.662e-05, [1] [Cycle 1]: 2.076e-05, [1] [cse]: 1.365e-05 [auto_monad_reorder]: 1.872e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 6.93998e-06 [opt_after_jit_grad]: 0.00052017 [symbol_engine_optimizer]: 7.607e-05, [1] [Cycle 1]: 6.901e-05, [6] [build]: 4.33001e-06 [elim_shapecalc]: 7.50998e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 5.97999e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 4.69998e-07 [validate]: 4.46e-05 Sums bootstrap : 0.000341s : 1.05% type_inference : 0.024854s : 76.86% event_method : 0.000020s : 0.06% auto_monad : 0.000069s : 0.21% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000098s : 0.30% rewriter_before_opt_a : 0.000084s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.22% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.002915s : 9.01% jit_opt_a.with_stream_mark : 0.000049s : 0.15% jit_opt_a.recompute_prepare : 0.000020s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001181s : 3.65% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000051s : 0.16% jit_opt_a.replace_applicator : 0.000023s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000043s : 0.13% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000780s : 2.41% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000033s : 0.10% loop_unroll : 0.000531s : 1.64% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000035s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000059s : 0.18% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000520s : 1.61% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.14% Time group info: ------[substitution.] 0.000277 23 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 3: substitution.graph_param_transform 83.21% : 0.000230s : 4: substitution.inline 1.68% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000006s : 4: substitution.remove_not_recompute_node 2.96% : 0.000008s : 2: substitution.replace_old_param 6.58% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024773 2 93.79% : 0.023235s : 1: type_inference.infer 6.21% : 0.001538s : 1: type_inference.specialize ------[replace.] 0.000127 6 44.52% : 0.000057s : 4: replace.inline 55.48% : 0.000070s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 93.67% : 0.000227s : 4: match.inline 6.33% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.002248 691 0.06% : 0.000001s : 10: predicate.accumulaten_eliminater 0.08% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.06% : 0.000001s : 10: predicate.addn_check_dump 0.06% : 0.000001s : 10: predicate.addn_zero_filter 0.10% : 0.000002s : 10: predicate.arithmetic_simplify 0.06% : 0.000001s : 10: predicate.cast_eliminate 0.02% : 0.000000s : 3: predicate.check_bprop_eliminate 0.06% : 0.000001s : 10: predicate.compare_switch_simplify 0.07% : 0.000002s : 10: predicate.depend_value_elim 0.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.02% : 0.000000s : 3: predicate.elim_not_effective 0.03% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.22% : 0.000005s : 10: predicate.environ_add_const_eliminate 0.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 94.43% : 0.002123s : 10: predicate.environ_get_depend_swap 0.06% : 0.000001s : 10: predicate.environ_get_eliminate 0.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.01% : 0.000000s : 3: predicate.fold_const_symbol 0.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.02% : 0.000000s : 3: predicate.graph_param_transform 0.42% : 0.000009s : 22: predicate.inline 0.04% : 0.000001s : 6: predicate.inline_without_move 0.02% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.08% : 0.000002s : 6: predicate.less_batch_normalization 0.07% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.09% : 0.000002s : 15: predicate.load_eliminater 0.09% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.09% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.05% : 0.000001s : 10: predicate.merge_addn 0.05% : 0.000001s : 10: predicate.minmaximum_grad 0.14% : 0.000003s : 3: predicate.mutable_eliminate 0.02% : 0.000001s : 3: predicate.opt_reshape 0.14% : 0.000003s : 15: predicate.partial_eliminate 0.06% : 0.000001s : 10: predicate.print_const_string_wrapper 0.12% : 0.000003s : 10: predicate.reduce_eliminate 0.07% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.04% : 0.000001s : 6: predicate.remove_not_recompute_node 0.10% : 0.000002s : 18: predicate.replace_applicator 0.04% : 0.000001s : 6: predicate.replace_old_param 0.03% : 0.000001s : 3: predicate.reset_defer_inline 0.07% : 0.000002s : 10: predicate.reshape_eliminate 0.06% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.05% : 0.000001s : 3: predicate.row_tensor_eliminate 0.05% : 0.000001s : 10: predicate.same_eliminate 0.04% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.05% : 0.000001s : 6: predicate.special_op_eliminate 0.06% : 0.000001s : 6: predicate.specialize_transform 0.07% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.08% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.03% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.15% : 0.000003s : 16: predicate.switch_defer_inline 0.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 0.42% : 0.000010s : 53: predicate.switch_simplify 0.07% : 0.000002s : 10: predicate.tile_eliminate 0.06% : 0.000001s : 10: predicate.transpose_eliminate 0.07% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.06% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 0.24% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 0.07% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.08% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.08% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.14% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 0.08% : 0.000002s : 10: predicate.value_based_eliminate 0.02% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.04% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000956 13 46.77% : 0.000447s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.92% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.31% : 0.000452s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043953 72 0.14% : 0.000062s : 1: add_recomputation 0.17% : 0.000074s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.83% : 0.000363s : 1: bootstrap 0.08% : 0.000036s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000017s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 26.03% : 0.011443s : 1: jit_opt_a 0.40% : 0.000174s : 1: jit_opt_after_cconv 0.13% : 0.000057s : 1: jit_opt_b 1.23% : 0.000542s : 1: loop_unroll 1.81% : 0.000795s : 1: mutable_eliminate 7.19% : 0.003160s : 26: opt.transform.jit_opt_a 0.12% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000020s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.21% : 0.000532s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000102s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.57% : 0.000688s : 1: renormalize.infer 1.09% : 0.000481s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000046s : 1: rewriter_after_opt_a 0.20% : 0.000088s : 1: rewriter_before_opt_a 0.18% : 0.000079s : 1: symbol_engine_optimizer 56.60% : 0.024878s : 1: type_inference TotalTime = 0.0175275, [30] [bootstrap]: 0.0003192 [type_inference]: 0.0086287 [event_method]: 2.098e-05 [auto_monad]: 6.768e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 5.335e-05 [rewriter_before_opt_a]: 8.258e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00630498, [2] [Cycle 1]: 0.00225878, [27] [switch_simplify]: 6.683e-05 [loop_unroll]: 3.557e-05 [a_1]: 0.00073576 [with_stream_mark]: 1.969e-05 [recompute_prepare]: 1.04e-05 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 3.17002e-06 [get_grad_eliminate_]: 6.25997e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.036e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00104807 [add_forward_monad_depend]: 5.27999e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.322e-05 [cse]: 3.341e-05 [replace_applicator]: 1.383e-05 [Cycle 2]: 0.00033329, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.24e-06 [a_1]: 0.00010221 [with_stream_mark]: 9.34e-06 [recompute_prepare]: 5.56002e-06 [updatestate_depend_eliminate]: 3.08998e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.031e-05 [j_node_and_user_rematch]: 7.63999e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 6.86001e-06 [inline_without_move]: 4.88001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.79983e-07 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.41998e-06 [cse]: 1.317e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 8.60001e-06 [rewriter_after_opt_a]: 3.467e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.00049146 [jit_opt_b]: 6.189e-05, [1] [Cycle 1]: 5.527e-05, [2] [frontend_op_eliminate]: 1.658e-05 [inline_after_opt_a]: 2.759e-05 [cconv]: 2.372e-05 [loop_unroll]: 0.00042146 [jit_opt_after_cconv]: 0.00014137, [1] [Cycle 1]: 0.00013509, [11] [c_1]: 2.121e-05 [parameter_eliminate]: 1.67999e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.102e-05 [call_graph_tuple_transform]: 1.733e-05 [tuple_list_get_item_eliminator]: 5.74999e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.583e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 6.81001e-06 [add_recomputation]: 4.527e-05 [cse_after_recomputation]: 2.265e-05, [1] [Cycle 1]: 1.723e-05, [1] [cse]: 1.143e-05 [auto_monad_reorder]: 1.81e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.00044875 [symbol_engine_optimizer]: 7.297e-05, [1] [Cycle 1]: 6.735e-05, [6] [build]: 3.06999e-06 [elim_shapecalc]: 8.08001e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 9.16002e-06 [renormalize]: 4.60015e-07 [validate]: 3.66e-05 Sums bootstrap : 0.000319s : 2.41% type_inference : 0.008629s : 65.20% event_method : 0.000021s : 0.16% auto_monad : 0.000068s : 0.51% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.40% rewriter_before_opt_a : 0.000083s : 0.62% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.55% jit_opt_a.loop_unroll : 0.000041s : 0.31% jit_opt_a.a_1 : 0.000838s : 6.33% jit_opt_a.with_stream_mark : 0.000029s : 0.22% jit_opt_a.recompute_prepare : 0.000016s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001048s : 7.92% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.14% jit_opt_a.cse : 0.000047s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.06% rewriter_after_opt_a : 0.000035s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000491s : 3.71% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000028s : 0.21% cconv : 0.000024s : 0.18% loop_unroll : 0.000421s : 3.18% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000045s : 0.34% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000449s : 3.39% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.28% Time group info: ------[substitution.] 0.000293 27 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.66% : 0.000005s : 3: substitution.graph_param_transform 85.24% : 0.000250s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.88% : 0.000011s : 3: substitution.reduce_eliminate 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.37% : 0.000004s : 2: substitution.replace_old_param 3.90% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008558 2 85.99% : 0.007360s : 1: type_inference.infer 14.01% : 0.001199s : 1: type_inference.specialize ------[replace.] 0.000119 7 65.11% : 0.000077s : 5: replace.inline 34.89% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 95.97% : 0.000246s : 5: match.inline 4.03% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 0.88% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 11: predicate.addn_check_dump 1.54% : 0.000002s : 11: predicate.addn_zero_filter 2.22% : 0.000003s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.33% : 0.000002s : 11: predicate.compare_switch_simplify 1.38% : 0.000002s : 11: predicate.depend_value_elim 1.03% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.59% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.24% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.69% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.32% : 0.000002s : 11: predicate.environ_get_eliminate 1.37% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.04% : 0.000007s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 16: predicate.load_eliminater 0.88% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.58% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.72% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 11: predicate.merge_addn 1.49% : 0.000002s : 11: predicate.minmaximum_grad 1.04% : 0.000001s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 16: predicate.partial_eliminate 2.13% : 0.000003s : 11: predicate.print_const_string_wrapper 3.06% : 0.000004s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000003s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.73% : 0.000002s : 11: predicate.reshape_eliminate 1.43% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.78% : 0.000011s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.90% : 0.000003s : 11: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 2.19% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.46% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000996 16 48.12% : 0.000479s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.60% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.28% : 0.000441s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019713 72 0.24% : 0.000048s : 1: add_recomputation 0.36% : 0.000071s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.71% : 0.000337s : 1: bootstrap 0.13% : 0.000026s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.00% : 0.006309s : 1: jit_opt_a 0.73% : 0.000144s : 1: jit_opt_after_cconv 0.33% : 0.000064s : 1: jit_opt_b 2.17% : 0.000428s : 1: loop_unroll 2.53% : 0.000498s : 1: mutable_eliminate 5.46% : 0.001076s : 26: opt.transform.jit_opt_a 0.24% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000038s : 4: opt.transform.jit_opt_b 0.06% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000011s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.31% : 0.000455s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000056s : 1: py_interpret_to_execute 0.06% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 3.13% : 0.000618s : 1: renormalize.infer 2.14% : 0.000421s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000038s : 1: rewriter_after_opt_a 0.43% : 0.000085s : 1: rewriter_before_opt_a 0.38% : 0.000076s : 1: symbol_engine_optimizer 43.84% : 0.008643s : 1: type_inference TotalTime = 0.202659, [30] [bootstrap]: 0.00041435 [type_inference]: 0.187512 [event_method]: 2.782e-05 [auto_monad]: 8.652e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.99999e-06 [py_interpret_to_execute]: 0.00062221 [rewriter_before_opt_a]: 0.00011892 [expand_dump_flag]: 3.90998e-06 [jit_opt_a]: 0.0109671, [2] [Cycle 1]: 0.00664976, [27] [switch_simplify]: 7.932e-05 [loop_unroll]: 3.624e-05 [a_1]: 0.00082889 [with_stream_mark]: 2.636e-05 [recompute_prepare]: 1.051e-05 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.71e-06 [specialize_transform]: 7.75e-06 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 7.35998e-06 [meta_shard_fg_expand]: 3.18998e-06 [get_grad_eliminate_]: 7.10998e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 1.105e-05 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.201e-05 [inline_without_move]: 7.03e-06 [renormalize]: 0.00522555 [add_forward_monad_depend]: 1.341e-05 [auto_monad_grad]: 3.30003e-06 [auto_monad_eliminator]: 2.695e-05 [cse]: 4.28e-05 [replace_applicator]: 2.949e-05 [Cycle 2]: 0.00043769, [27] [switch_simplify]: 8.08001e-06 [loop_unroll]: 7.41999e-06 [a_1]: 0.00014169 [with_stream_mark]: 1.665e-05 [recompute_prepare]: 7.06001e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.13998e-06 [specialize_transform]: 6.72002e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.47001e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 3.26999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.121e-05 [j_node_and_user_rematch]: 1.099e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.071e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.67998e-06 [cse]: 1.812e-05 [replace_applicator]: 7.13998e-06 [py_interpret_to_execute_after_opt_a]: 2.108e-05 [rewriter_after_opt_a]: 4.437e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00090853 [jit_opt_b]: 6.53e-05, [1] [Cycle 1]: 5.713e-05, [2] [frontend_op_eliminate]: 2.223e-05 [inline_after_opt_a]: 2.212e-05 [cconv]: 3.135e-05 [loop_unroll]: 0.00046375 [jit_opt_after_cconv]: 0.00019102, [1] [Cycle 1]: 0.00018404, [11] [c_1]: 2.905e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 9.80002e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 3.59e-05 [call_graph_tuple_transform]: 2.789e-05 [tuple_list_get_item_eliminator]: 7.84002e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 7.73001e-06 [remove_dup_value]: 2.111e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 1.088e-05 [add_recomputation]: 5.436e-05 [cse_after_recomputation]: 3.019e-05, [1] [Cycle 1]: 2.274e-05, [1] [cse]: 1.575e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 7.42002e-06 [opt_after_jit_grad]: 0.00052104 [symbol_engine_optimizer]: 8.69e-05, [1] [Cycle 1]: 8.015e-05, [6] [build]: 4.21001e-06 [elim_shapecalc]: 9.95002e-06 [elim_not_effective]: 1.776e-05 [opt_reshape]: 7.19001e-06 [fold_const_symbol]: 1.067e-05 [renormalize]: 4.30009e-07 [validate]: 0.00019154 Sums bootstrap : 0.000414s : 0.21% type_inference : 0.187512s : 94.66% event_method : 0.000028s : 0.01% auto_monad : 0.000087s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000622s : 0.31% rewriter_before_opt_a : 0.000119s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.04% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.000971s : 0.49% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005226s : 2.64% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.02% jit_opt_a.cse : 0.000061s : 0.03% jit_opt_a.replace_applicator : 0.000037s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000909s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000464s : 0.23% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000521s : 0.26% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000192s : 0.10% Time group info: ------[substitution.] 0.000348 25 1.04% : 0.000004s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 4: substitution.graph_param_transform 87.31% : 0.000304s : 5: substitution.inline 1.30% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000006s : 4: substitution.remove_not_recompute_node 2.19% : 0.000008s : 2: substitution.replace_old_param 4.04% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.187396 2 88.95% : 0.166682s : 1: type_inference.infer 11.05% : 0.020714s : 1: type_inference.specialize ------[replace.] 0.000131 7 66.89% : 0.000088s : 5: replace.inline 33.11% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000314 7 95.95% : 0.000301s : 5: match.inline 4.05% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.58% : 0.000002s : 13: predicate.addn_zero_filter 2.30% : 0.000004s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.22% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.84% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.62% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.94% : 0.000003s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.38% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003206 25 61.13% : 0.001960s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.00% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.87% : 0.001150s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.209097 72 0.03% : 0.000058s : 1: add_recomputation 0.04% : 0.000090s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.21% : 0.000432s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 5.25% : 0.010971s : 1: jit_opt_a 0.09% : 0.000194s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.23% : 0.000473s : 1: loop_unroll 0.44% : 0.000922s : 1: mutable_eliminate 0.61% : 0.001271s : 26: opt.transform.jit_opt_a 0.03% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000530s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000631s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 1.88% : 0.003934s : 1: renormalize.infer 0.61% : 0.001275s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.06% : 0.000123s : 1: rewriter_before_opt_a 0.04% : 0.000090s : 1: symbol_engine_optimizer 89.69% : 0.187537s : 1: type_inference TotalTime = 0.101625, [30] [bootstrap]: 0.00030114 [type_inference]: 0.089632 [event_method]: 0.00036706 [auto_monad]: 0.00013182 [graph_reusing]: 8.80001e-06 [pre_auto_parallel]: 3.37002e-06 [py_interpret_to_execute]: 4.251e-05 [rewriter_before_opt_a]: 0.00014041 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.00853055, [2] [Cycle 1]: 0.00431932, [27] [switch_simplify]: 0.0001795 [loop_unroll]: 5.85e-05 [a_1]: 0.00141991 [with_stream_mark]: 2.468e-05 [recompute_prepare]: 1.167e-05 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 4.08001e-06 [parameter_eliminate]: 2.01003e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.23002e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.75998e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 9.46998e-06 [inline_without_move]: 6.26e-06 [renormalize]: 0.00224556 [add_forward_monad_depend]: 8.28999e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.832e-05 [cse]: 3.46e-05 [replace_applicator]: 1.962e-05 [Cycle 2]: 0.0003487, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 5.97001e-06 [a_1]: 9.813e-05 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.60002e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 2.92002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 5.98998e-06 [cse]: 1.36e-05 [replace_applicator]: 6.22001e-06 [py_interpret_to_execute_after_opt_a]: 1.449e-05 [rewriter_after_opt_a]: 3.96e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00075849 [jit_opt_b]: 5.464e-05, [1] [Cycle 1]: 4.641e-05, [2] [frontend_op_eliminate]: 1.685e-05 [inline_after_opt_a]: 1.794e-05 [cconv]: 2.782e-05 [loop_unroll]: 0.00044686 [jit_opt_after_cconv]: 0.0001637, [1] [Cycle 1]: 0.00015674, [11] [c_1]: 2.248e-05 [parameter_eliminate]: 4.34002e-06 [updatestate_depend_eliminate]: 8.17e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.811e-05 [call_graph_tuple_transform]: 2.106e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 9.79984e-07 [switch_simplify]: 6.05002e-06 [remove_dup_value]: 1.644e-05 [partial_unused_args_eliminate]: 2.41998e-06 [environ_conv]: 7.00998e-06 [add_recomputation]: 5.648e-05 [cse_after_recomputation]: 2.575e-05, [1] [Cycle 1]: 1.967e-05, [1] [cse]: 1.319e-05 [auto_monad_reorder]: 1.814e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 6.12999e-06 [opt_after_jit_grad]: 0.00048178 [symbol_engine_optimizer]: 7.34e-05, [1] [Cycle 1]: 6.757e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 3.00002e-07 [validate]: 7.137e-05 Sums bootstrap : 0.000301s : 0.31% type_inference : 0.089632s : 92.27% event_method : 0.000367s : 0.38% auto_monad : 0.000132s : 0.14% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000043s : 0.04% rewriter_before_opt_a : 0.000140s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000186s : 0.19% jit_opt_a.loop_unroll : 0.000064s : 0.07% jit_opt_a.a_1 : 0.001518s : 1.56% jit_opt_a.with_stream_mark : 0.000038s : 0.04% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002246s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000048s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000758s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000447s : 0.46% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000482s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000071s : 0.07% Time group info: ------[substitution.] 0.000581 35 0.33% : 0.000002s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 0.93% : 0.000005s : 3: substitution.graph_param_transform 90.41% : 0.000526s : 12: substitution.inline 0.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.91% : 0.000005s : 4: substitution.remove_not_recompute_node 0.84% : 0.000005s : 2: substitution.replace_old_param 1.61% : 0.000009s : 1: substitution.reshape_eliminate 2.16% : 0.000013s : 3: substitution.switch_simplify 1.85% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.089532 2 96.39% : 0.086300s : 1: type_inference.infer 3.61% : 0.003232s : 1: type_inference.specialize ------[replace.] 0.000296 18 53.44% : 0.000158s : 12: replace.inline 1.64% : 0.000005s : 1: replace.reshape_eliminate 19.23% : 0.000057s : 3: replace.switch_simplify 25.70% : 0.000076s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000548 18 94.70% : 0.000519s : 12: match.inline 1.53% : 0.000008s : 1: match.reshape_eliminate 2.00% : 0.000011s : 3: match.switch_simplify 1.77% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000210 1212 1.27% : 0.000003s : 19: predicate.accumulaten_eliminater 0.74% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 19: predicate.addn_check_dump 1.43% : 0.000003s : 19: predicate.addn_zero_filter 2.24% : 0.000005s : 19: predicate.arithmetic_simplify 1.74% : 0.000004s : 20: predicate.cast_eliminate 0.31% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000003s : 19: predicate.compare_switch_simplify 1.24% : 0.000003s : 19: predicate.depend_value_elim 1.53% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.32% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.47% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.59% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000001s : 3: predicate.elim_not_effective 0.31% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.24% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.26% : 0.000003s : 20: predicate.environ_get_depend_swap 1.39% : 0.000003s : 20: predicate.environ_get_eliminate 1.23% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000002s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000012s : 40: predicate.inline 0.60% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.81% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 25: predicate.load_eliminater 1.16% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.87% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 19: predicate.merge_addn 1.17% : 0.000002s : 19: predicate.minmaximum_grad 0.98% : 0.000002s : 3: predicate.mutable_eliminate 0.28% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000005s : 25: predicate.partial_eliminate 1.36% : 0.000003s : 19: predicate.print_const_string_wrapper 2.05% : 0.000004s : 19: predicate.reduce_eliminate 1.67% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000004s : 28: predicate.replace_applicator 0.30% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000001s : 3: predicate.reset_defer_inline 1.67% : 0.000004s : 20: predicate.reshape_eliminate 1.48% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.43% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000003s : 19: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.68% : 0.000001s : 6: predicate.special_op_eliminate 0.58% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.30% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.00% : 0.000006s : 34: predicate.switch_defer_inline 2.61% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.31% : 0.000017s : 107: predicate.switch_simplify 1.47% : 0.000003s : 19: predicate.tile_eliminate 1.32% : 0.000003s : 19: predicate.transpose_eliminate 1.68% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.78% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.53% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.61% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.73% : 0.000004s : 19: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003437 40 65.90% : 0.002265s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.44% : 0.000290s : 5: func_graph_cloner_run.FuncGraphClonerNode 25.65% : 0.000882s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.105801 72 0.06% : 0.000060s : 1: add_recomputation 0.13% : 0.000137s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000317s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.35% : 0.000375s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 8.07% : 0.008534s : 1: jit_opt_a 0.16% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.43% : 0.000454s : 1: loop_unroll 0.72% : 0.000766s : 1: mutable_eliminate 1.80% : 0.001906s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000045s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.48% : 0.001565s : 1: renormalize.infer 0.63% : 0.000671s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.14% : 0.000144s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 84.74% : 0.089652s : 1: type_inference TotalTime = 0.0434094, [30] [bootstrap]: 0.00033615 [type_inference]: 0.0329707 [event_method]: 1.996e-05 [auto_monad]: 6.487e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 9.981e-05 [rewriter_before_opt_a]: 8.392e-05 [expand_dump_flag]: 3.29001e-06 [jit_opt_a]: 0.00728733, [2] [Cycle 1]: 0.00331891, [27] [switch_simplify]: 6.071e-05 [loop_unroll]: 2.979e-05 [a_1]: 0.00055745 [with_stream_mark]: 2.169e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 6.75002e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.443e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.51002e-06 [renormalize]: 0.00225821 [add_forward_monad_depend]: 1.213e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.127e-05 [cse]: 3.619e-05 [replace_applicator]: 2.3e-05 [Cycle 2]: 0.00037051, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.54998e-06 [a_1]: 9.869e-05 [with_stream_mark]: 1.461e-05 [recompute_prepare]: 6.64001e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 2.96001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.8e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 9.77001e-06 [inline_without_move]: 5.14e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.75001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.41999e-06 [cse]: 1.48e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.847e-05 [rewriter_after_opt_a]: 4.513e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.0007943 [jit_opt_b]: 5.346e-05, [1] [Cycle 1]: 4.441e-05, [2] [frontend_op_eliminate]: 1.556e-05 [inline_after_opt_a]: 1.783e-05 [cconv]: 3.32e-05 [loop_unroll]: 0.00044107 [jit_opt_after_cconv]: 0.00015992, [1] [Cycle 1]: 0.00015275, [11] [c_1]: 2.183e-05 [parameter_eliminate]: 3.98999e-06 [updatestate_depend_eliminate]: 7.06999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 3.102e-05 [call_graph_tuple_transform]: 2.095e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.48002e-06 [remove_dup_value]: 1.585e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 6.74999e-06 [add_recomputation]: 5.138e-05 [cse_after_recomputation]: 2.318e-05, [1] [Cycle 1]: 1.781e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.633e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.93002e-06 [opt_after_jit_grad]: 0.00051651 [symbol_engine_optimizer]: 7.922e-05, [1] [Cycle 1]: 7.142e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 6.87002e-06 [fold_const_symbol]: 9.56998e-06 [renormalize]: 4.10015e-07 [validate]: 4.557e-05 Sums bootstrap : 0.000336s : 0.86% type_inference : 0.032971s : 84.21% event_method : 0.000020s : 0.05% auto_monad : 0.000065s : 0.17% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000100s : 0.25% rewriter_before_opt_a : 0.000084s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.17% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000656s : 1.68% jit_opt_a.with_stream_mark : 0.000036s : 0.09% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.002258s : 5.77% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.07% jit_opt_a.cse : 0.000051s : 0.13% jit_opt_a.replace_applicator : 0.000029s : 0.07% py_interpret_to_execute_after_opt_a : 0.000018s : 0.05% rewriter_after_opt_a : 0.000045s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000794s : 2.03% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.05% cconv : 0.000033s : 0.08% loop_unroll : 0.000441s : 1.13% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000051s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000517s : 1.32% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.12% Time group info: ------[substitution.] 0.000231 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.65% : 0.000006s : 3: substitution.graph_param_transform 83.40% : 0.000193s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000006s : 4: substitution.remove_not_recompute_node 2.55% : 0.000006s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.032896 2 95.42% : 0.031388s : 1: type_inference.infer 4.58% : 0.001507s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.54% : 0.000051s : 4: replace.inline 31.46% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.28% : 0.000190s : 4: match.inline 5.72% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.09% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.66% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.29% : 0.000003s : 3: predicate.mutable_eliminate 0.82% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.32% : 0.000002s : 10: predicate.print_const_string_wrapper 1.97% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000009s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002060 13 21.69% : 0.000447s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.25% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 76.07% : 0.001567s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046599 72 0.12% : 0.000054s : 1: add_recomputation 0.15% : 0.000069s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.76% : 0.000353s : 1: bootstrap 0.08% : 0.000036s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.65% : 0.007291s : 1: jit_opt_a 0.35% : 0.000163s : 1: jit_opt_after_cconv 0.12% : 0.000056s : 1: jit_opt_b 0.97% : 0.000451s : 1: loop_unroll 1.73% : 0.000806s : 1: mutable_eliminate 1.92% : 0.000896s : 26: opt.transform.jit_opt_a 0.11% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000526s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000105s : 1: py_interpret_to_execute 0.05% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.22% : 0.000569s : 1: renormalize.infer 3.61% : 0.001680s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000050s : 1: rewriter_after_opt_a 0.19% : 0.000087s : 1: rewriter_before_opt_a 0.18% : 0.000082s : 1: symbol_engine_optimizer 70.79% : 0.032987s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.767.197 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cb80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.768.503 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.212132, [30] [bootstrap]: 0.00038337 [type_inference]: 0.160632 [event_method]: 2.009e-05 [auto_monad]: 6.702e-05 [graph_reusing]: 6.70998e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00026978 [rewriter_before_opt_a]: 8.815e-05 [expand_dump_flag]: 4e-06 [jit_opt_a]: 0.047931, [2] [Cycle 1]: 0.0439861, [27] [switch_simplify]: 6.153e-05 [loop_unroll]: 3.038e-05 [a_1]: 0.0405526 [with_stream_mark]: 3.182e-05 [recompute_prepare]: 1.563e-05 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 3.66999e-06 [specialize_transform]: 7.32002e-06 [updatestate_useless_node_eliminater]: 6.93e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 4.52e-06 [get_grad_eliminate_]: 6.75002e-06 [merge_forward]: 5.10999e-06 [cell_reuse_recompute_pass]: 2.61e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.856e-05 [j_node_and_user_rematch]: 1.187e-05 [meta_fg_expand]: 3.04001e-06 [replace_old_param]: 1.416e-05 [inline_without_move]: 7.2e-06 [renormalize]: 0.00285093 [add_forward_monad_depend]: 8.17e-06 [auto_monad_grad]: 3.14999e-06 [auto_monad_eliminator]: 2.127e-05 [cse]: 3.585e-05 [replace_applicator]: 1.983e-05 [Cycle 2]: 0.00038393, [27] [switch_simplify]: 7.22002e-06 [loop_unroll]: 6.22001e-06 [a_1]: 0.00012586 [with_stream_mark]: 1.457e-05 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.48002e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 3.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.125e-05 [replace_applicator]: 5.71003e-06 [py_interpret_to_execute_after_opt_a]: 1.48e-05 [rewriter_after_opt_a]: 3.938e-05 [convert_after_rewriter]: 7.86001e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00081206 [jit_opt_b]: 5.725e-05, [1] [Cycle 1]: 4.867e-05, [2] [frontend_op_eliminate]: 1.885e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 3.062e-05 [loop_unroll]: 0.00045656 [jit_opt_after_cconv]: 0.00015945, [1] [Cycle 1]: 0.00015254, [11] [c_1]: 2.557e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 6.44999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 2.632e-05 [call_graph_tuple_transform]: 2.201e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.582e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 1.006e-05 [add_recomputation]: 5.353e-05 [cse_after_recomputation]: 2.277e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.105e-05 [auto_monad_reorder]: 1.631e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 6.21e-06 [opt_after_jit_grad]: 0.0006587 [symbol_engine_optimizer]: 0.00010236, [1] [Cycle 1]: 9.583e-05, [6] [build]: 5.04e-06 [elim_shapecalc]: 9.72001e-06 [elim_not_effective]: 1.415e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 3.135e-05 [renormalize]: 6.50005e-07 [validate]: 5.657e-05 Sums bootstrap : 0.000383s : 0.18% type_inference : 0.160632s : 77.27% event_method : 0.000020s : 0.01% auto_monad : 0.000067s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000270s : 0.13% rewriter_before_opt_a : 0.000088s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.040679s : 19.57% jit_opt_a.with_stream_mark : 0.000046s : 0.02% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002851s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000047s : 0.02% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000812s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000457s : 0.22% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000659s : 0.32% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000031s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.03% Time group info: ------[substitution.] 0.000345 24 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.97% : 0.000007s : 4: substitution.graph_param_transform 85.69% : 0.000296s : 4: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.71% : 0.000006s : 4: substitution.remove_not_recompute_node 2.38% : 0.000008s : 2: substitution.replace_old_param 5.80% : 0.000020s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.160548 2 98.65% : 0.158376s : 1: type_inference.infer 1.35% : 0.002172s : 1: type_inference.specialize ------[replace.] 0.000156 6 65.72% : 0.000102s : 4: replace.inline 34.28% : 0.000053s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000311 6 94.04% : 0.000293s : 4: match.inline 5.96% : 0.000019s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.039815 830 0.01% : 0.000002s : 12: predicate.accumulaten_eliminater 0.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.00% : 0.000002s : 12: predicate.addn_check_dump 0.01% : 0.000002s : 12: predicate.addn_zero_filter 0.01% : 0.000004s : 12: predicate.arithmetic_simplify 0.01% : 0.000002s : 12: predicate.cast_eliminate 0.00% : 0.000001s : 4: predicate.check_bprop_eliminate 0.00% : 0.000002s : 12: predicate.compare_switch_simplify 0.01% : 0.000002s : 12: predicate.depend_value_elim 0.00% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.00% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.00% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.00% : 0.000001s : 4: predicate.elim_not_effective 0.00% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.01% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.00% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.00% : 0.000002s : 12: predicate.environ_get_depend_swap 0.01% : 0.000002s : 12: predicate.environ_get_eliminate 0.00% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.00% : 0.000000s : 4: predicate.fold_const_symbol 0.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.00% : 0.000001s : 4: predicate.graph_param_transform 0.02% : 0.000008s : 26: predicate.inline 0.00% : 0.000001s : 8: predicate.inline_without_move 0.00% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.01% : 0.000002s : 8: predicate.less_batch_normalization 0.01% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 0.01% : 0.000004s : 18: predicate.load_eliminater 0.00% : 0.000002s : 4: predicate.loop_unroll_after_grad 0.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 0.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.00% : 0.000002s : 12: predicate.merge_addn 0.00% : 0.000002s : 12: predicate.minmaximum_grad 0.01% : 0.000003s : 4: predicate.mutable_eliminate 0.00% : 0.000001s : 4: predicate.opt_reshape 0.02% : 0.000006s : 18: predicate.partial_eliminate 0.00% : 0.000002s : 12: predicate.print_const_string_wrapper 0.01% : 0.000004s : 12: predicate.reduce_eliminate 0.01% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.00% : 0.000001s : 8: predicate.remove_not_recompute_node 0.01% : 0.000003s : 22: predicate.replace_applicator 0.00% : 0.000002s : 8: predicate.replace_old_param 0.00% : 0.000001s : 4: predicate.reset_defer_inline 0.01% : 0.000003s : 12: predicate.reshape_eliminate 0.01% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.00% : 0.000001s : 4: predicate.row_tensor_eliminate 0.00% : 0.000002s : 12: predicate.same_eliminate 0.00% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.00% : 0.000002s : 8: predicate.special_op_eliminate 0.00% : 0.000001s : 8: predicate.specialize_transform 0.01% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.01% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.00% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.01% : 0.000006s : 18: predicate.switch_defer_inline 0.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 0.03% : 0.000010s : 58: predicate.switch_simplify 0.00% : 0.000002s : 12: predicate.tile_eliminate 0.00% : 0.000002s : 12: predicate.transpose_eliminate 0.01% : 0.000003s : 12: predicate.tuple_list_convert_item_index_to_positive 0.01% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 0.02% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 0.01% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 0.01% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 99.59% : 0.039653s : 18: predicate.updatestate_pure_node_eliminater 0.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 0.01% : 0.000003s : 12: predicate.value_based_eliminate 0.00% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.00% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003680 26 77.85% : 0.002865s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.46% : 0.000091s : 1: func_graph_cloner_run.FuncGraphClonerNode 19.69% : 0.000725s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.255991 72 0.02% : 0.000057s : 1: add_recomputation 0.03% : 0.000070s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.16% : 0.000406s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 18.73% : 0.047935s : 1: jit_opt_a 0.06% : 0.000162s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.18% : 0.000464s : 1: loop_unroll 0.32% : 0.000823s : 1: mutable_eliminate 15.99% : 0.040936s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000058s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000670s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000276s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.77% : 0.001977s : 1: renormalize.infer 0.34% : 0.000861s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.04% : 0.000094s : 1: rewriter_before_opt_a 0.04% : 0.000105s : 1: symbol_engine_optimizer 62.76% : 0.160649s : 1: type_inference TotalTime = 0.246, [30] [bootstrap]: 0.00025989 [type_inference]: 0.226097 [event_method]: 2.57e-05 [auto_monad]: 7.518e-05 [graph_reusing]: 6.68998e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00049948 [rewriter_before_opt_a]: 9.339e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.0162226, [2] [Cycle 1]: 0.0120481, [27] [switch_simplify]: 7.2e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00483039 [with_stream_mark]: 3.903e-05 [recompute_prepare]: 1.83e-05 [updatestate_depend_eliminate]: 5.70001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 2.83e-06 [specialize_transform]: 8.47998e-06 [updatestate_useless_node_eliminater]: 6.83e-06 [accelerated_algorithm]: 8.28001e-06 [meta_shard_fg_expand]: 4.12e-06 [get_grad_eliminate_]: 7.46999e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 3.51999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.255e-05 [j_node_and_user_rematch]: 1.309e-05 [meta_fg_expand]: 3.38e-06 [replace_old_param]: 1.276e-05 [inline_without_move]: 6.46e-06 [renormalize]: 0.00659244 [add_forward_monad_depend]: 1.087e-05 [auto_monad_grad]: 3.21001e-06 [auto_monad_eliminator]: 2.48e-05 [cse]: 3.674e-05 [replace_applicator]: 2.555e-05 [Cycle 2]: 0.00039524, [27] [switch_simplify]: 7.17002e-06 [loop_unroll]: 6.51e-06 [a_1]: 0.00013269 [with_stream_mark]: 1.523e-05 [recompute_prepare]: 5.90002e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.81999e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.978e-05 [j_node_and_user_rematch]: 9.66998e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.62999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.139e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.87e-05 [rewriter_after_opt_a]: 4.212e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00088012 [jit_opt_b]: 5.782e-05, [1] [Cycle 1]: 4.917e-05, [2] [frontend_op_eliminate]: 2.073e-05 [inline_after_opt_a]: 1.738e-05 [cconv]: 3.098e-05 [loop_unroll]: 0.00044729 [jit_opt_after_cconv]: 0.00016515, [1] [Cycle 1]: 0.00015855, [11] [c_1]: 2.52e-05 [parameter_eliminate]: 3.16999e-06 [updatestate_depend_eliminate]: 7.64002e-06 [updatestate_assign_eliminate]: 2.21998e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.77e-05 [call_graph_tuple_transform]: 2.321e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.657e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 9.06998e-06 [add_recomputation]: 5.267e-05 [cse_after_recomputation]: 2.35e-05, [1] [Cycle 1]: 1.668e-05, [1] [cse]: 1.1e-05 [auto_monad_reorder]: 1.545e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 7.77e-06 [opt_after_jit_grad]: 0.00048611 [symbol_engine_optimizer]: 8.084e-05, [1] [Cycle 1]: 7.496e-05, [6] [build]: 5.29e-06 [elim_shapecalc]: 1.005e-05 [elim_not_effective]: 1.59e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.062e-05 [renormalize]: 3.30008e-07 [validate]: 0.00015004 Sums bootstrap : 0.000260s : 0.11% type_inference : 0.226097s : 93.61% event_method : 0.000026s : 0.01% auto_monad : 0.000075s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000499s : 0.21% rewriter_before_opt_a : 0.000093s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.004963s : 2.05% jit_opt_a.with_stream_mark : 0.000054s : 0.02% jit_opt_a.recompute_prepare : 0.000024s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.006593s : 2.73% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000048s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000880s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000447s : 0.19% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000486s : 0.20% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000150s : 0.06% Time group info: ------[substitution.] 0.000282 24 0.66% : 0.000002s : 2: substitution.elim_not_effective 1.15% : 0.000003s : 2: substitution.fold_const_symbol 2.11% : 0.000006s : 4: substitution.graph_param_transform 84.14% : 0.000237s : 4: substitution.inline 2.06% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000007s : 4: substitution.remove_not_recompute_node 3.01% : 0.000008s : 2: substitution.replace_old_param 4.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.225995 2 93.29% : 0.210827s : 1: type_inference.infer 6.71% : 0.015169s : 1: type_inference.specialize ------[replace.] 0.004187 6 1.42% : 0.000059s : 4: replace.inline 98.58% : 0.004127s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 6 95.40% : 0.000235s : 4: match.inline 4.60% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 12: predicate.addn_check_dump 1.74% : 0.000003s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 0.92% : 0.000001s : 12: predicate.compare_switch_simplify 1.44% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.89% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_depend_swap 1.60% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 7.11% : 0.000011s : 26: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.75% : 0.000003s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.20% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 12: predicate.merge_addn 0.98% : 0.000002s : 12: predicate.minmaximum_grad 1.24% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.97% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.70% : 0.000003s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 4.84% : 0.000008s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.29% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.64% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.53% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 12: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016501 22 9.79% : 0.001615s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.33% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 89.88% : 0.014831s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.257798 72 0.02% : 0.000056s : 1: add_recomputation 0.03% : 0.000079s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.11% : 0.000275s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.29% : 0.016226s : 1: jit_opt_a 0.07% : 0.000168s : 1: jit_opt_after_cconv 0.02% : 0.000061s : 1: jit_opt_b 0.18% : 0.000456s : 1: loop_unroll 0.35% : 0.000893s : 1: mutable_eliminate 2.04% : 0.005250s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000507s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.09% : 0.002820s : 1: renormalize.infer 1.46% : 0.003758s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.04% : 0.000099s : 1: rewriter_before_opt_a 0.03% : 0.000083s : 1: symbol_engine_optimizer 87.71% : 0.226121s : 1: type_inference TotalTime = 0.169245, [30] [bootstrap]: 0.00043108 [type_inference]: 0.152715 [event_method]: 2.471e-05 [auto_monad]: 8.128e-05 [graph_reusing]: 4.43001e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.00106862 [rewriter_before_opt_a]: 0.00010755 [expand_dump_flag]: 4.63999e-06 [jit_opt_a]: 0.0117881, [2] [Cycle 1]: 0.00615078, [27] [switch_simplify]: 6.532e-05 [loop_unroll]: 3.509e-05 [a_1]: 0.00095889 [with_stream_mark]: 2.032e-05 [recompute_prepare]: 9.89999e-06 [updatestate_depend_eliminate]: 4.34002e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 8.56002e-06 [updatestate_useless_node_eliminater]: 6.75002e-06 [accelerated_algorithm]: 7.51001e-06 [meta_shard_fg_expand]: 2.46998e-06 [get_grad_eliminate_]: 6.91001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.78998e-06 [replace_old_param]: 1.066e-05 [inline_without_move]: 6.78e-06 [renormalize]: 0.0046246 [add_forward_monad_depend]: 9.49999e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.889e-05 [cse]: 5.161e-05 [replace_applicator]: 2.525e-05 [Cycle 2]: 0.00044542, [27] [switch_simplify]: 8.81997e-06 [loop_unroll]: 6.51e-06 [a_1]: 0.00015535 [with_stream_mark]: 1.641e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.11003e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 7.2e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 7.08e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 3.60003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.046e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 8.55001e-06 [cse]: 1.759e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.751e-05 [rewriter_after_opt_a]: 8.565e-05 [convert_after_rewriter]: 7.85e-06 [order_py_execute_after_rewriter]: 6.41e-06 [mutable_eliminate]: 0.0008082 [jit_opt_b]: 6.563e-05, [1] [Cycle 1]: 5.776e-05, [2] [frontend_op_eliminate]: 2.446e-05 [inline_after_opt_a]: 2.109e-05 [cconv]: 3.286e-05 [loop_unroll]: 0.00046632 [jit_opt_after_cconv]: 0.0001844, [1] [Cycle 1]: 0.00017767, [11] [c_1]: 2.935e-05 [parameter_eliminate]: 4.70001e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 3.142e-05 [call_graph_tuple_transform]: 2.623e-05 [tuple_list_get_item_eliminator]: 6.89001e-06 [none_parameter_eliminate]: 2.22001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 7.51001e-06 [remove_dup_value]: 1.685e-05 [partial_unused_args_eliminate]: 2.88998e-06 [environ_conv]: 1.034e-05 [add_recomputation]: 0.00015607 [cse_after_recomputation]: 3.33e-05, [1] [Cycle 1]: 2.553e-05, [1] [cse]: 1.752e-05 [auto_monad_reorder]: 2.006e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 6.63e-06 [opt_after_jit_grad]: 0.00056268 [symbol_engine_optimizer]: 0.00016518, [1] [Cycle 1]: 0.00015816, [6] [build]: 4.82e-06 [elim_shapecalc]: 9.76998e-06 [elim_not_effective]: 1.716e-05 [opt_reshape]: 7.98001e-06 [fold_const_symbol]: 8.509e-05 [renormalize]: 3.50003e-07 [validate]: 9.607e-05 Sums bootstrap : 0.000431s : 0.26% type_inference : 0.152715s : 93.52% event_method : 0.000025s : 0.02% auto_monad : 0.000081s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001069s : 0.65% rewriter_before_opt_a : 0.000108s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.001114s : 0.68% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004625s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000069s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000086s : 0.05% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000808s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000466s : 0.29% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000156s : 0.10% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000563s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000085s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000096s : 0.06% Time group info: ------[substitution.] 0.000423 28 0.76% : 0.000003s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.70% : 0.000007s : 4: substitution.graph_param_transform 87.52% : 0.000370s : 5: substitution.inline 0.88% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.23% : 0.000014s : 3: substitution.reduce_eliminate 1.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.36% : 0.000006s : 2: substitution.replace_old_param 2.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.152525 2 96.38% : 0.146997s : 1: type_inference.infer 3.62% : 0.005529s : 1: type_inference.specialize ------[replace.] 0.000115 7 68.60% : 0.000079s : 5: replace.inline 31.40% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000378 7 97.13% : 0.000367s : 5: match.inline 2.87% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000004s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.51% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000009s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 0.99% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.39% : 0.000004s : 13: predicate.reduce_eliminate 1.61% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.71% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.64% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000011s : 64: predicate.switch_simplify 1.54% : 0.000002s : 13: predicate.tile_eliminate 1.57% : 0.000002s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.82% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004163 25 47.31% : 0.001969s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.17% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.52% : 0.002103s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.175368 72 0.09% : 0.000161s : 1: add_recomputation 0.05% : 0.000085s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.26% : 0.000452s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 6.72% : 0.011793s : 1: jit_opt_a 0.11% : 0.000188s : 1: jit_opt_after_cconv 0.04% : 0.000068s : 1: jit_opt_b 0.27% : 0.000474s : 1: loop_unroll 0.47% : 0.000817s : 1: mutable_eliminate 0.79% : 0.001389s : 26: opt.transform.jit_opt_a 0.04% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000116s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000571s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.62% : 0.001079s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 2.00% : 0.003515s : 1: renormalize.infer 0.63% : 0.001098s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000089s : 1: rewriter_after_opt_a 0.06% : 0.000112s : 1: rewriter_before_opt_a 0.10% : 0.000168s : 1: symbol_engine_optimizer 87.12% : 0.152788s : 1: type_inference TotalTime = 0.0530172, [30] [bootstrap]: 0.00053286 [type_inference]: 0.0383939 [event_method]: 3.656e-05 [auto_monad]: 0.00013857 [graph_reusing]: 9.22999e-06 [pre_auto_parallel]: 3.76001e-06 [py_interpret_to_execute]: 4.178e-05 [rewriter_before_opt_a]: 0.00015816 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.011521, [2] [Cycle 1]: 0.00658186, [27] [switch_simplify]: 0.00017137 [loop_unroll]: 6.313e-05 [a_1]: 0.00123353 [with_stream_mark]: 3.094e-05 [recompute_prepare]: 1.843e-05 [updatestate_depend_eliminate]: 8.42e-06 [updatestate_assign_eliminate]: 6.94001e-06 [updatestate_loads_eliminate]: 6.26e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 1.38e-05 [updatestate_useless_node_eliminater]: 1.315e-05 [accelerated_algorithm]: 1.328e-05 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 1.257e-05 [merge_forward]: 9.15001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.761e-05 [j_node_and_user_rematch]: 2.311e-05 [meta_fg_expand]: 0.00209369 [replace_old_param]: 6.394e-05 [inline_without_move]: 5.875e-05 [renormalize]: 0.00241353 [add_forward_monad_depend]: 1.106e-05 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.269e-05 [cse]: 2.502e-05 [replace_applicator]: 1.278e-05 [Cycle 2]: 0.00052184, [27] [switch_simplify]: 4.38001e-06 [loop_unroll]: 4.07e-06 [a_1]: 4.285e-05 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 3.63e-06 [updatestate_depend_eliminate]: 2.34001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 1.62001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 3.28e-06 [updatestate_useless_node_eliminater]: 3.30998e-06 [accelerated_algorithm]: 3.53e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 3.35e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.236e-05 [j_node_and_user_rematch]: 5.96998e-06 [meta_fg_expand]: 0.00024581 [replace_old_param]: 6.31998e-06 [inline_without_move]: 3.57002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.54001e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.336e-05 [replace_applicator]: 4.05998e-06 [py_interpret_to_execute_after_opt_a]: 1.104e-05 [rewriter_after_opt_a]: 3.524e-05 [convert_after_rewriter]: 5.96e-06 [order_py_execute_after_rewriter]: 4.36002e-06 [mutable_eliminate]: 0.00059123 [jit_opt_b]: 3.867e-05, [1] [Cycle 1]: 3.092e-05, [2] [frontend_op_eliminate]: 8.55999e-06 [inline_after_opt_a]: 1.081e-05 [cconv]: 2.195e-05 [loop_unroll]: 0.00040502 [jit_opt_after_cconv]: 0.00012065, [1] [Cycle 1]: 0.00011478, [11] [c_1]: 1.219e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 4.57998e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 1.75001e-06 [cse]: 1.622e-05 [call_graph_tuple_transform]: 1.39e-05 [tuple_list_get_item_eliminator]: 3.7e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 3.68999e-06 [remove_dup_value]: 1.371e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 4.72e-06 [add_recomputation]: 3.933e-05 [cse_after_recomputation]: 1.97e-05, [1] [Cycle 1]: 1.439e-05, [1] [cse]: 8.43999e-06 [auto_monad_reorder]: 1.369e-05 [get_jit_bprop_graph]: 1.75001e-06 [rewriter_after_jit_bprop_graph]: 4.61002e-06 [opt_after_jit_grad]: 0.00050272 [symbol_engine_optimizer]: 9.881e-05, [1] [Cycle 1]: 9.21e-05, [6] [build]: 3.97002e-06 [elim_shapecalc]: 6.14001e-06 [elim_not_effective]: 9.69999e-06 [opt_reshape]: 3.86999e-06 [fold_const_symbol]: 3.579e-05 [renormalize]: 4.39992e-07 [validate]: 3.307e-05 Sums bootstrap : 0.000533s : 1.11% type_inference : 0.038394s : 80.14% event_method : 0.000037s : 0.08% auto_monad : 0.000139s : 0.29% graph_reusing : 0.000009s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000042s : 0.09% rewriter_before_opt_a : 0.000158s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000176s : 0.37% jit_opt_a.loop_unroll : 0.000067s : 0.14% jit_opt_a.a_1 : 0.001276s : 2.66% jit_opt_a.with_stream_mark : 0.000041s : 0.09% jit_opt_a.recompute_prepare : 0.000022s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000008s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000017s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.03% jit_opt_a.accelerated_algorithm : 0.000017s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.03% jit_opt_a.merge_forward : 0.000012s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000029s : 0.06% jit_opt_a.meta_fg_expand : 0.002340s : 4.88% jit_opt_a.replace_old_param : 0.000070s : 0.15% jit_opt_a.inline_without_move : 0.000062s : 0.13% jit_opt_a.renormalize : 0.002414s : 5.04% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.04% jit_opt_a.cse : 0.000038s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000035s : 0.07% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000591s : 1.23% jit_opt_b.frontend_op_eliminate : 0.000009s : 0.02% jit_opt_b.inline_after_opt_a : 0.000011s : 0.02% cconv : 0.000022s : 0.05% loop_unroll : 0.000405s : 0.85% jit_opt_after_cconv.c_1 : 0.000012s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000039s : 0.08% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000503s : 1.05% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000036s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.07% Time group info: ------[substitution.] 0.000349 63 0.61% : 0.000002s : 1: substitution.elim_not_effective 0.35% : 0.000001s : 1: substitution.fold_const_symbol 1.43% : 0.000005s : 1: substitution.graph_param_transform 69.14% : 0.000241s : 13: substitution.inline 5.47% : 0.000019s : 2: substitution.inline_without_move 1.95% : 0.000007s : 9: substitution.j_node_and_user_rematch 1.09% : 0.000004s : 2: substitution.minmaximum_grad 1.25% : 0.000004s : 3: substitution.partial_eliminate 2.09% : 0.000007s : 9: substitution.remove_not_recompute_node 1.76% : 0.000006s : 2: substitution.replace_applicator 2.00% : 0.000007s : 8: substitution.replace_old_param 0.75% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.76% : 0.000010s : 2: substitution.switch_simplify 2.15% : 0.000007s : 2: substitution.tuple_list_convert_item_index_to_positive 1.53% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.67% : 0.000020s : 5: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038209 2 94.19% : 0.035989s : 1: type_inference.infer 5.81% : 0.002220s : 1: type_inference.specialize ------[replace.] 0.000152 18 55.82% : 0.000085s : 13: replace.inline 31.24% : 0.000047s : 2: replace.switch_simplify 12.94% : 0.000020s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 18 91.15% : 0.000235s : 13: match.inline 3.30% : 0.000008s : 2: match.switch_simplify 5.55% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000230 1528 1.74% : 0.000004s : 25: predicate.accumulaten_eliminater 0.65% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.34% : 0.000003s : 25: predicate.addn_check_dump 1.45% : 0.000003s : 25: predicate.addn_zero_filter 1.86% : 0.000004s : 25: predicate.arithmetic_simplify 1.49% : 0.000003s : 25: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.32% : 0.000003s : 25: predicate.compare_switch_simplify 1.40% : 0.000003s : 25: predicate.depend_value_elim 1.33% : 0.000003s : 25: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 25: predicate.dict_get_item_eliminator 1.51% : 0.000003s : 25: predicate.dict_set_item_eliminator 0.44% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.22% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000003s : 25: predicate.environ_add_const_eliminate 1.34% : 0.000003s : 25: predicate.environ_get_add_eliminate 1.34% : 0.000003s : 25: predicate.environ_get_depend_swap 1.46% : 0.000003s : 25: predicate.environ_get_eliminate 1.35% : 0.000003s : 25: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 0.86% : 0.000002s : 12: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.76% : 0.000011s : 43: predicate.inline 2.68% : 0.000006s : 36: predicate.inline_without_move 0.37% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.06% : 0.000002s : 12: predicate.less_batch_normalization 1.60% : 0.000004s : 28: predicate.list_to_tuple_eliminator_ 1.75% : 0.000004s : 29: predicate.load_eliminater 0.51% : 0.000001s : 1: predicate.loop_unroll_after_grad 4.39% : 0.000010s : 74: predicate.loop_unroll_before_grad 1.71% : 0.000004s : 26: predicate.make_slice_get_slice_eliminator 1.34% : 0.000003s : 25: predicate.merge_addn 1.37% : 0.000003s : 25: predicate.minmaximum_grad 0.72% : 0.000002s : 1: predicate.mutable_eliminate 0.18% : 0.000000s : 1: predicate.opt_reshape 2.25% : 0.000005s : 29: predicate.partial_eliminate 1.33% : 0.000003s : 25: predicate.print_const_string_wrapper 1.83% : 0.000004s : 25: predicate.reduce_eliminate 1.58% : 0.000004s : 28: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 12: predicate.remove_not_recompute_node 1.49% : 0.000003s : 30: predicate.replace_applicator 1.52% : 0.000003s : 36: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000004s : 25: predicate.reshape_eliminate 1.52% : 0.000003s : 25: predicate.row_tensor_add_zeros_like 0.21% : 0.000000s : 1: predicate.row_tensor_eliminate 1.48% : 0.000003s : 25: predicate.same_eliminate 0.47% : 0.000001s : 12: predicate.set_cell_output_no_recompute 0.19% : 0.000000s : 2: predicate.special_op_eliminate 1.07% : 0.000002s : 12: predicate.specialize_transform 1.64% : 0.000004s : 25: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000003s : 25: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.90% : 0.000007s : 41: predicate.switch_defer_inline 2.69% : 0.000006s : 41: predicate.switch_layer_defer_inline 8.44% : 0.000019s : 120: predicate.switch_simplify 1.42% : 0.000003s : 25: predicate.tile_eliminate 1.48% : 0.000003s : 25: predicate.transpose_eliminate 1.73% : 0.000004s : 25: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000004s : 25: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000007s : 30: predicate.tuple_list_get_item_eliminator 1.64% : 0.000004s : 25: predicate.tuple_list_set_item_eliminator 1.67% : 0.000004s : 28: predicate.tuple_to_list_eliminator_ 1.64% : 0.000004s : 29: predicate.updatestate_pure_node_eliminater 2.54% : 0.000006s : 41: predicate.updatestate_useless_node_eliminater 1.82% : 0.000004s : 25: predicate.value_based_eliminate 0.08% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002726 33 78.04% : 0.002127s : 17: func_graph_cloner_run.FuncGraphClonerGraph 21.96% : 0.000599s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057242 72 0.07% : 0.000042s : 1: add_recomputation 0.25% : 0.000144s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.99% : 0.000564s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.07% : 0.000042s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 20.13% : 0.011524s : 1: jit_opt_a 0.22% : 0.000123s : 1: jit_opt_after_cconv 0.07% : 0.000041s : 1: jit_opt_b 0.72% : 0.000412s : 1: loop_unroll 1.05% : 0.000600s : 1: mutable_eliminate 3.13% : 0.001792s : 26: opt.transform.jit_opt_a 0.05% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000013s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000011s : 1: opt.transform.mutable_eliminate 0.03% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000053s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000512s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.08% : 0.000044s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 3.58% : 0.002048s : 1: renormalize.infer 0.62% : 0.000357s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000038s : 1: rewriter_after_opt_a 0.28% : 0.000161s : 1: rewriter_before_opt_a 0.18% : 0.000102s : 1: symbol_engine_optimizer 67.11% : 0.038414s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.839.832 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c9d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.840.615 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0578771, [30] [bootstrap]: 0.00033176 [type_inference]: 0.02659 [event_method]: 2.279e-05 [auto_monad]: 6.89e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.00010411 [rewriter_before_opt_a]: 8.395e-05 [expand_dump_flag]: 3.45998e-06 [jit_opt_a]: 0.0237612, [2] [Cycle 1]: 0.0198717, [27] [switch_simplify]: 9.207e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00057855 [with_stream_mark]: 2.162e-05 [recompute_prepare]: 8.02e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.38002e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00097936 [add_forward_monad_depend]: 6.61e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.609e-05 [cse]: 3.394e-05 [replace_applicator]: 1.504e-05 [Cycle 2]: 0.00034224, [27] [switch_simplify]: 5.96998e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.962e-05 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.331e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 7.58999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.227e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 1.348e-05 [rewriter_after_opt_a]: 3.802e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.43997e-06 [mutable_eliminate]: 0.00072855 [jit_opt_b]: 5.048e-05, [1] [Cycle 1]: 4.243e-05, [2] [frontend_op_eliminate]: 1.53e-05 [inline_after_opt_a]: 1.575e-05 [cconv]: 2.728e-05 [loop_unroll]: 0.00466592 [jit_opt_after_cconv]: 0.00021166, [1] [Cycle 1]: 0.00020112, [11] [c_1]: 3.794e-05 [parameter_eliminate]: 6.61999e-06 [updatestate_depend_eliminate]: 1.147e-05 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 4.08999e-06 [cse]: 4.339e-05 [call_graph_tuple_transform]: 2.452e-05 [tuple_list_get_item_eliminator]: 6.87002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 1.21002e-06 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.855e-05 [partial_unused_args_eliminate]: 2.56998e-06 [environ_conv]: 8.14997e-06 [add_recomputation]: 5.632e-05 [cse_after_recomputation]: 2.748e-05, [1] [Cycle 1]: 2.04e-05, [1] [cse]: 1.415e-05 [auto_monad_reorder]: 2.004e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 8.48999e-06 [opt_after_jit_grad]: 0.00063597 [symbol_engine_optimizer]: 7.969e-05, [1] [Cycle 1]: 7.252e-05, [6] [build]: 4.35999e-06 [elim_shapecalc]: 8.20999e-06 [elim_not_effective]: 1.49e-05 [opt_reshape]: 6.43e-06 [fold_const_symbol]: 1.047e-05 [renormalize]: 4.50003e-07 [validate]: 4.79e-05 Sums bootstrap : 0.000332s : 0.93% type_inference : 0.026590s : 74.20% event_method : 0.000023s : 0.06% auto_monad : 0.000069s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000104s : 0.29% rewriter_before_opt_a : 0.000084s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000098s : 0.27% jit_opt_a.loop_unroll : 0.000036s : 0.10% jit_opt_a.a_1 : 0.000678s : 1.89% jit_opt_a.with_stream_mark : 0.000032s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000979s : 2.73% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000046s : 0.13% jit_opt_a.replace_applicator : 0.000021s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000038s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000729s : 2.03% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000027s : 0.08% loop_unroll : 0.004666s : 13.02% jit_opt_after_cconv.c_1 : 0.000038s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000043s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000056s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000636s : 1.77% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.13% Time group info: ------[substitution.] 0.000226 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.99% : 0.000002s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 3: substitution.graph_param_transform 83.40% : 0.000189s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 6.10% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026512 2 93.85% : 0.024882s : 1: type_inference.infer 6.15% : 0.001630s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.39% : 0.000054s : 4: replace.inline 30.61% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 93.61% : 0.000186s : 4: match.inline 6.39% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 691 1.65% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.53% : 0.000002s : 10: predicate.addn_zero_filter 1.89% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.59% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 15: predicate.load_eliminater 2.18% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.48% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 1.96% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000002s : 10: predicate.print_const_string_wrapper 1.90% : 0.000003s : 10: predicate.reduce_eliminate 1.87% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.59% : 0.000002s : 18: predicate.replace_applicator 0.42% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.65% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.05% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 10.80% : 0.000015s : 53: predicate.switch_simplify 1.14% : 0.000002s : 10: predicate.tile_eliminate 1.10% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.13% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000897 13 47.38% : 0.000425s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.82% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.80% : 0.000438s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059878 72 0.16% : 0.000093s : 1: add_recomputation 0.12% : 0.000072s : 1: auto_monad 0.04% : 0.000023s : 1: auto_monad_reorder 0.58% : 0.000348s : 1: bootstrap 0.05% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 39.69% : 0.023765s : 1: jit_opt_a 0.36% : 0.000216s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 7.83% : 0.004689s : 1: loop_unroll 1.23% : 0.000737s : 1: mutable_eliminate 1.56% : 0.000936s : 26: opt.transform.jit_opt_a 0.12% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000029s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.08% : 0.000646s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000108s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.92% : 0.000553s : 1: renormalize.infer 0.70% : 0.000419s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000042s : 1: rewriter_after_opt_a 0.15% : 0.000088s : 1: rewriter_before_opt_a 0.14% : 0.000082s : 1: symbol_engine_optimizer 44.45% : 0.026618s : 1: type_inference TotalTime = 0.0373786, [30] [bootstrap]: 0.00038506 [type_inference]: 0.0258414 [event_method]: 2.172e-05 [auto_monad]: 7.894e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.0002283 [rewriter_before_opt_a]: 8.92e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00753598, [2] [Cycle 1]: 0.00277739, [27] [switch_simplify]: 6.758e-05 [loop_unroll]: 3.362e-05 [a_1]: 0.00084392 [with_stream_mark]: 2.491e-05 [recompute_prepare]: 1.218e-05 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.831e-05 [j_node_and_user_rematch]: 1.14e-05 [meta_fg_expand]: 3.53e-06 [replace_old_param]: 1.118e-05 [inline_without_move]: 6.54001e-06 [renormalize]: 0.00136338 [add_forward_monad_depend]: 9.52999e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 2.198e-05 [cse]: 3.917e-05 [replace_applicator]: 2.28e-05 [Cycle 2]: 0.00039061, [27] [switch_simplify]: 6.48998e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00010722 [with_stream_mark]: 1.58e-05 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.58003e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.79999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 4.47998e-06 [cell_reuse_recompute_pass]: 3.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.824e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 5.32001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 1.01002e-06 [auto_monad_eliminator]: 9.28002e-06 [cse]: 1.7e-05 [replace_applicator]: 7.28999e-06 [py_interpret_to_execute_after_opt_a]: 1.901e-05 [rewriter_after_opt_a]: 4.562e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00091085 [jit_opt_b]: 6.493e-05, [1] [Cycle 1]: 5.444e-05, [2] [frontend_op_eliminate]: 2.064e-05 [inline_after_opt_a]: 2.073e-05 [cconv]: 3.445e-05 [loop_unroll]: 0.00066873 [jit_opt_after_cconv]: 0.00019942, [1] [Cycle 1]: 0.00018962, [11] [c_1]: 2.582e-05 [parameter_eliminate]: 6.17999e-06 [updatestate_depend_eliminate]: 9.32001e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 4.399e-05 [call_graph_tuple_transform]: 2.779e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 2.07001e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 7.68001e-06 [remove_dup_value]: 1.73e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 7.73999e-06 [add_recomputation]: 6.522e-05 [cse_after_recomputation]: 3.094e-05, [1] [Cycle 1]: 2.29e-05, [1] [cse]: 1.433e-05 [auto_monad_reorder]: 1.969e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 8.54e-06 [opt_after_jit_grad]: 0.00071366 [symbol_engine_optimizer]: 8.665e-05, [1] [Cycle 1]: 7.819e-05, [6] [build]: 5.19e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.812e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 7.00005e-07 [validate]: 5.288e-05 Sums bootstrap : 0.000385s : 1.19% type_inference : 0.025841s : 80.04% event_method : 0.000022s : 0.07% auto_monad : 0.000079s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000228s : 0.71% rewriter_before_opt_a : 0.000089s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.23% jit_opt_a.loop_unroll : 0.000040s : 0.12% jit_opt_a.a_1 : 0.000951s : 2.95% jit_opt_a.with_stream_mark : 0.000041s : 0.13% jit_opt_a.recompute_prepare : 0.000018s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001363s : 4.22% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.10% jit_opt_a.cse : 0.000056s : 0.17% jit_opt_a.replace_applicator : 0.000030s : 0.09% py_interpret_to_execute_after_opt_a : 0.000019s : 0.06% rewriter_after_opt_a : 0.000046s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000911s : 2.82% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000034s : 0.11% loop_unroll : 0.000669s : 2.07% jit_opt_after_cconv.c_1 : 0.000026s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000044s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000065s : 0.20% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000714s : 2.21% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.16% Time group info: ------[substitution.] 0.000250 23 1.41% : 0.000004s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000007s : 3: substitution.graph_param_transform 82.35% : 0.000206s : 4: substitution.inline 1.81% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000006s : 4: substitution.remove_not_recompute_node 2.67% : 0.000007s : 2: substitution.replace_old_param 6.04% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025749 2 92.89% : 0.023920s : 1: type_inference.infer 7.11% : 0.001830s : 1: type_inference.specialize ------[replace.] 0.000102 6 59.21% : 0.000061s : 4: replace.inline 40.79% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 93.69% : 0.000203s : 4: match.inline 6.31% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 691 1.85% : 0.000003s : 10: predicate.accumulaten_eliminater 1.84% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 2.59% : 0.000004s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 0.90% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.29% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000008s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 15: predicate.load_eliminater 1.99% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 0.90% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.96% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 1.67% : 0.000003s : 10: predicate.reduce_eliminate 2.39% : 0.000004s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.21% : 0.000000s : 3: predicate.reset_defer_inline 1.06% : 0.000002s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000002s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.30% : 0.000002s : 6: predicate.special_op_eliminate 0.73% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 16: predicate.switch_defer_inline 1.74% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.83% : 0.000010s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 10: predicate.value_based_eliminate 0.33% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001027 13 40.83% : 0.000419s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.53% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.64% : 0.000571s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040043 72 0.17% : 0.000068s : 1: add_recomputation 0.21% : 0.000083s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.01% : 0.000406s : 1: bootstrap 0.09% : 0.000037s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000033s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.83% : 0.007541s : 1: jit_opt_a 0.51% : 0.000203s : 1: jit_opt_after_cconv 0.17% : 0.000068s : 1: jit_opt_b 1.70% : 0.000682s : 1: loop_unroll 2.31% : 0.000925s : 1: mutable_eliminate 3.04% : 0.001216s : 26: opt.transform.jit_opt_a 0.16% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000033s : 4: opt.transform.jit_opt_b 0.06% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000027s : 1: opt.transform.mutable_eliminate 0.09% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000039s : 4: opt.transform.symbol_engine_opt 1.81% : 0.000726s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.58% : 0.000233s : 1: py_interpret_to_execute 0.05% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.80% : 0.000719s : 1: renormalize.infer 1.58% : 0.000631s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000049s : 1: rewriter_after_opt_a 0.23% : 0.000093s : 1: rewriter_before_opt_a 0.22% : 0.000090s : 1: symbol_engine_optimizer 64.59% : 0.025863s : 1: type_inference TotalTime = 0.0392721, [30] [bootstrap]: 0.00028514 [type_inference]: 0.0158939 [event_method]: 5.922e-05 [auto_monad]: 0.00010593 [graph_reusing]: 8.50999e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 4.18e-05 [rewriter_before_opt_a]: 0.00012955 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.0204254, [2] [Cycle 1]: 0.0136314, [27] [switch_simplify]: 8.813e-05 [loop_unroll]: 4.388e-05 [a_1]: 0.00099551 [with_stream_mark]: 4.181e-05 [recompute_prepare]: 3.057e-05 [updatestate_depend_eliminate]: 1.198e-05 [updatestate_assign_eliminate]: 7.8e-06 [updatestate_loads_eliminate]: 6.79999e-06 [parameter_eliminate]: 3.75998e-06 [specialize_transform]: 1.584e-05 [updatestate_useless_node_eliminater]: 1.44e-05 [accelerated_algorithm]: 1.439e-05 [meta_shard_fg_expand]: 4.68999e-06 [get_grad_eliminate_]: 1.441e-05 [merge_forward]: 1.046e-05 [cell_reuse_recompute_pass]: 1.73997e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.298e-05 [j_node_and_user_rematch]: 2.775e-05 [meta_fg_expand]: 0.00227666 [replace_old_param]: 8.548e-05 [inline_without_move]: 6.805e-05 [renormalize]: 0.0093791 [add_forward_monad_depend]: 8.77999e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.618e-05 [cse]: 3.235e-05 [replace_applicator]: 2.513e-05 [Cycle 2]: 0.00035234, [27] [switch_simplify]: 4.68001e-06 [loop_unroll]: 4.02e-06 [a_1]: 5.104e-05 [with_stream_mark]: 1.401e-05 [recompute_prepare]: 3.85e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 3.57002e-06 [updatestate_useless_node_eliminater]: 3.55e-06 [accelerated_algorithm]: 3.9e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 3.15998e-06 [merge_forward]: 3.46999e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 7.05e-06 [meta_fg_expand]: 6.668e-05 [replace_old_param]: 5.00999e-06 [inline_without_move]: 3.29001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.36998e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 4.92999e-06 [cse]: 1.059e-05 [replace_applicator]: 3.66999e-06 [py_interpret_to_execute_after_opt_a]: 1.287e-05 [rewriter_after_opt_a]: 3.71e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 4.70999e-06 [mutable_eliminate]: 0.00070423 [jit_opt_b]: 3.93e-05, [1] [Cycle 1]: 3.229e-05, [2] [frontend_op_eliminate]: 9.34e-06 [inline_after_opt_a]: 1.121e-05 [cconv]: 3.284e-05 [loop_unroll]: 0.00042412 [jit_opt_after_cconv]: 0.00015076, [1] [Cycle 1]: 0.000144, [11] [c_1]: 1.197e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 1.76e-06 [updatestate_loads_eliminate]: 1.55001e-06 [cse]: 1.723e-05 [call_graph_tuple_transform]: 1.456e-05 [tuple_list_get_item_eliminator]: 3.43e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 3.085e-05 [remove_dup_value]: 1.397e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.07001e-06 [add_recomputation]: 3.772e-05 [cse_after_recomputation]: 2.117e-05, [1] [Cycle 1]: 1.539e-05, [1] [cse]: 9.30001e-06 [auto_monad_reorder]: 1.353e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00044886 [symbol_engine_optimizer]: 6.721e-05, [1] [Cycle 1]: 6.073e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 5.62999e-06 [elim_not_effective]: 1.047e-05 [opt_reshape]: 4.23999e-06 [fold_const_symbol]: 6.24001e-06 [renormalize]: 5.60016e-07 [validate]: 3.157e-05 Sums bootstrap : 0.000285s : 0.89% type_inference : 0.015894s : 49.74% event_method : 0.000059s : 0.19% auto_monad : 0.000106s : 0.33% graph_reusing : 0.000009s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000042s : 0.13% rewriter_before_opt_a : 0.000130s : 0.41% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000093s : 0.29% jit_opt_a.loop_unroll : 0.000048s : 0.15% jit_opt_a.a_1 : 0.001047s : 3.28% jit_opt_a.with_stream_mark : 0.000056s : 0.17% jit_opt_a.recompute_prepare : 0.000034s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.03% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000019s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.06% jit_opt_a.accelerated_algorithm : 0.000018s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000018s : 0.05% jit_opt_a.merge_forward : 0.000014s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000035s : 0.11% jit_opt_a.meta_fg_expand : 0.002343s : 7.33% jit_opt_a.replace_old_param : 0.000090s : 0.28% jit_opt_a.inline_without_move : 0.000071s : 0.22% jit_opt_a.renormalize : 0.009379s : 29.35% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000043s : 0.13% jit_opt_a.replace_applicator : 0.000029s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000704s : 2.20% jit_opt_b.frontend_op_eliminate : 0.000009s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.04% cconv : 0.000033s : 0.10% loop_unroll : 0.000424s : 1.33% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000003s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000031s : 0.10% remove_dup_value : 0.000014s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000038s : 0.12% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000014s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000449s : 1.40% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000032s : 0.10% Time group info: ------[substitution.] 0.000350 55 0.58% : 0.000002s : 1: substitution.elim_not_effective 0.29% : 0.000001s : 1: substitution.fold_const_symbol 1.50% : 0.000005s : 1: substitution.graph_param_transform 66.19% : 0.000232s : 6: substitution.inline 7.17% : 0.000025s : 2: substitution.inline_without_move 2.49% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.14% : 0.000004s : 2: substitution.minmaximum_grad 1.36% : 0.000005s : 3: substitution.partial_eliminate 2.46% : 0.000009s : 9: substitution.remove_not_recompute_node 2.41% : 0.000008s : 2: substitution.replace_applicator 2.61% : 0.000009s : 10: substitution.replace_old_param 1.38% : 0.000005s : 1: substitution.set_cell_output_no_recompute 2.27% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.70% : 0.000006s : 2: substitution.tuple_list_get_item_depend_reorder 6.45% : 0.000023s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015760 2 69.95% : 0.011024s : 1: type_inference.infer 30.05% : 0.004737s : 1: type_inference.specialize ------[replace.] 0.000085 8 78.20% : 0.000066s : 6: replace.inline 21.80% : 0.000018s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 8 93.40% : 0.000227s : 6: match.inline 6.60% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 1123 1.29% : 0.000002s : 18: predicate.accumulaten_eliminater 0.54% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 18: predicate.addn_check_dump 1.55% : 0.000003s : 18: predicate.addn_zero_filter 2.22% : 0.000004s : 18: predicate.arithmetic_simplify 1.35% : 0.000003s : 18: predicate.cast_eliminate 0.15% : 0.000000s : 1: predicate.check_bprop_eliminate 1.22% : 0.000002s : 18: predicate.compare_switch_simplify 1.35% : 0.000003s : 18: predicate.depend_value_elim 1.22% : 0.000002s : 18: predicate.dict_get_item_const_eliminator 1.34% : 0.000003s : 18: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 18: predicate.dict_set_item_eliminator 0.45% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.24% : 0.000000s : 1: predicate.elim_not_effective 0.23% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000003s : 18: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 18: predicate.environ_get_add_eliminate 1.29% : 0.000002s : 18: predicate.environ_get_depend_swap 1.27% : 0.000002s : 18: predicate.environ_get_eliminate 1.42% : 0.000003s : 18: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 1.04% : 0.000002s : 12: predicate.get_grad_eliminate 0.17% : 0.000000s : 1: predicate.graph_param_transform 5.01% : 0.000009s : 28: predicate.inline 3.56% : 0.000007s : 40: predicate.inline_without_move 0.49% : 0.000001s : 12: predicate.j_node_and_user_rematch 1.65% : 0.000003s : 12: predicate.less_batch_normalization 1.78% : 0.000003s : 20: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 21: predicate.load_eliminater 0.61% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.40% : 0.000006s : 44: predicate.loop_unroll_before_grad 1.54% : 0.000003s : 19: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 18: predicate.merge_addn 1.23% : 0.000002s : 18: predicate.minmaximum_grad 0.71% : 0.000001s : 1: predicate.mutable_eliminate 0.20% : 0.000000s : 1: predicate.opt_reshape 2.06% : 0.000004s : 21: predicate.partial_eliminate 1.53% : 0.000003s : 18: predicate.print_const_string_wrapper 2.12% : 0.000004s : 18: predicate.reduce_eliminate 1.54% : 0.000003s : 20: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 12: predicate.remove_not_recompute_node 1.68% : 0.000003s : 22: predicate.replace_applicator 2.26% : 0.000004s : 40: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.55% : 0.000003s : 18: predicate.reshape_eliminate 1.41% : 0.000003s : 18: predicate.row_tensor_add_zeros_like 0.28% : 0.000001s : 1: predicate.row_tensor_eliminate 1.28% : 0.000002s : 18: predicate.same_eliminate 1.04% : 0.000002s : 12: predicate.set_cell_output_no_recompute 0.32% : 0.000001s : 2: predicate.special_op_eliminate 1.26% : 0.000002s : 12: predicate.specialize_transform 1.72% : 0.000003s : 18: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 18: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.85% : 0.000005s : 26: predicate.switch_defer_inline 2.16% : 0.000004s : 26: predicate.switch_layer_defer_inline 7.33% : 0.000014s : 71: predicate.switch_simplify 1.39% : 0.000003s : 18: predicate.tile_eliminate 1.33% : 0.000002s : 18: predicate.transpose_eliminate 1.57% : 0.000003s : 18: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000003s : 18: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.68% : 0.000003s : 18: predicate.tuple_list_set_item_eliminator 1.48% : 0.000003s : 20: predicate.tuple_to_list_eliminator_ 1.49% : 0.000003s : 21: predicate.updatestate_pure_node_eliminater 2.71% : 0.000005s : 33: predicate.updatestate_useless_node_eliminater 1.64% : 0.000003s : 18: predicate.value_based_eliminate 0.11% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.24% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002165 27 77.12% : 0.001669s : 18: func_graph_cloner_run.FuncGraphClonerGraph 22.88% : 0.000495s : 9: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050154 72 0.08% : 0.000041s : 1: add_recomputation 0.22% : 0.000111s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.62% : 0.000313s : 1: bootstrap 0.07% : 0.000036s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.13% : 0.000064s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 40.73% : 0.020429s : 1: jit_opt_a 0.31% : 0.000153s : 1: jit_opt_after_cconv 0.08% : 0.000042s : 1: jit_opt_b 0.86% : 0.000432s : 1: loop_unroll 1.42% : 0.000713s : 1: mutable_eliminate 3.04% : 0.001527s : 26: opt.transform.jit_opt_a 0.11% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000014s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.91% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000045s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 17.48% : 0.008765s : 1: renormalize.infer 1.19% : 0.000599s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.26% : 0.000133s : 1: rewriter_before_opt_a 0.14% : 0.000070s : 1: symbol_engine_optimizer 31.75% : 0.015923s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.912.099 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f9d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:41.912.834 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0257469, [30] [bootstrap]: 0.00051923 [type_inference]: 0.0130902 [event_method]: 2.176e-05 [auto_monad]: 7.276e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 5.092e-05 [rewriter_before_opt_a]: 8.425e-05 [expand_dump_flag]: 2.91e-06 [jit_opt_a]: 0.00918511, [2] [Cycle 1]: 0.00236167, [27] [switch_simplify]: 6.547e-05 [loop_unroll]: 3.368e-05 [a_1]: 0.00081097 [with_stream_mark]: 2.043e-05 [recompute_prepare]: 9.86e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 4.134e-05 [meta_shard_fg_expand]: 4.17e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 4.37998e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.659e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 3.15002e-06 [replace_old_param]: 9.59999e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00101106 [add_forward_monad_depend]: 7.08e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.861e-05 [cse]: 3.532e-05 [replace_applicator]: 1.75e-05 [Cycle 2]: 0.00037226, [27] [switch_simplify]: 6.01003e-06 [loop_unroll]: 5.39e-06 [a_1]: 0.00010764 [with_stream_mark]: 1.323e-05 [recompute_prepare]: 6.00002e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.78002e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 8.45001e-06 [cse]: 1.479e-05 [replace_applicator]: 6.48998e-06 [py_interpret_to_execute_after_opt_a]: 1.47e-05 [rewriter_after_opt_a]: 4.22e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00068094 [jit_opt_b]: 5.519e-05, [1] [Cycle 1]: 4.752e-05, [2] [frontend_op_eliminate]: 1.748e-05 [inline_after_opt_a]: 1.715e-05 [cconv]: 2.925e-05 [loop_unroll]: 0.00047435 [jit_opt_after_cconv]: 0.00016729, [1] [Cycle 1]: 0.00015997, [11] [c_1]: 2.296e-05 [parameter_eliminate]: 3.02002e-06 [updatestate_depend_eliminate]: 6.14001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 3.117e-05 [call_graph_tuple_transform]: 2.267e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 5.191e-05 [cse_after_recomputation]: 2.596e-05, [1] [Cycle 1]: 2.016e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.817e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.0008011 [symbol_engine_optimizer]: 7.896e-05, [1] [Cycle 1]: 7.237e-05, [6] [build]: 4.23001e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.21998e-06 [renormalize]: 6.09987e-07 [validate]: 4.047e-05 Sums bootstrap : 0.000519s : 2.78% type_inference : 0.013090s : 70.17% event_method : 0.000022s : 0.12% auto_monad : 0.000073s : 0.39% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000051s : 0.27% rewriter_before_opt_a : 0.000084s : 0.45% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.38% jit_opt_a.loop_unroll : 0.000039s : 0.21% jit_opt_a.a_1 : 0.000919s : 4.92% jit_opt_a.with_stream_mark : 0.000034s : 0.18% jit_opt_a.recompute_prepare : 0.000016s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000047s : 0.25% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.09% jit_opt_a.inline_without_move : 0.000012s : 0.06% jit_opt_a.renormalize : 0.001011s : 5.42% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.15% jit_opt_a.cse : 0.000050s : 0.27% jit_opt_a.replace_applicator : 0.000024s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.08% rewriter_after_opt_a : 0.000042s : 0.23% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000681s : 3.65% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.09% jit_opt_b.inline_after_opt_a : 0.000017s : 0.09% cconv : 0.000029s : 0.16% loop_unroll : 0.000474s : 2.54% jit_opt_after_cconv.c_1 : 0.000023s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000015s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000052s : 0.28% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000801s : 4.29% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.22% Time group info: ------[substitution.] 0.000325 27 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 2.29% : 0.000007s : 3: substitution.graph_param_transform 85.24% : 0.000277s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.96% : 0.000013s : 3: substitution.reduce_eliminate 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.25% : 0.000004s : 2: substitution.replace_old_param 3.37% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013012 2 89.51% : 0.011647s : 1: type_inference.infer 10.49% : 0.001366s : 1: type_inference.specialize ------[replace.] 0.000142 7 71.68% : 0.000102s : 5: replace.inline 28.32% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 7 96.53% : 0.000274s : 5: match.inline 3.47% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.55% : 0.000002s : 11: predicate.addn_zero_filter 2.11% : 0.000003s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.39% : 0.000002s : 11: predicate.compare_switch_simplify 1.63% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.62% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_depend_swap 1.53% : 0.000002s : 11: predicate.environ_get_eliminate 1.39% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.31% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.91% : 0.000008s : 24: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 16: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000002s : 11: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 16: predicate.partial_eliminate 1.55% : 0.000002s : 11: predicate.print_const_string_wrapper 2.81% : 0.000004s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 1.13% : 0.000002s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.68% : 0.000002s : 11: predicate.reshape_eliminate 1.35% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 1.85% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.97% : 0.000010s : 59: predicate.switch_simplify 1.44% : 0.000002s : 11: predicate.tile_eliminate 1.49% : 0.000002s : 11: predicate.transpose_eliminate 1.66% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.54% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.55% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001420 16 56.31% : 0.000800s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.69% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.01% : 0.000540s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028020 72 0.20% : 0.000055s : 1: add_recomputation 0.27% : 0.000076s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.91% : 0.000536s : 1: bootstrap 0.11% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 32.80% : 0.009189s : 1: jit_opt_a 0.61% : 0.000171s : 1: jit_opt_after_cconv 0.21% : 0.000058s : 1: jit_opt_b 1.72% : 0.000483s : 1: loop_unroll 2.46% : 0.000690s : 1: mutable_eliminate 4.26% : 0.001195s : 26: opt.transform.jit_opt_a 0.19% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.10% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.89% : 0.000810s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000054s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.87% : 0.000524s : 1: renormalize.infer 1.70% : 0.000476s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000047s : 1: rewriter_after_opt_a 0.31% : 0.000087s : 1: rewriter_before_opt_a 0.29% : 0.000082s : 1: symbol_engine_optimizer 46.77% : 0.013104s : 1: type_inference TotalTime = 0.0140262, [30] [bootstrap]: 0.0003605 [type_inference]: 0.00555547 [event_method]: 1.99e-05 [auto_monad]: 6.601e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 4.509e-05 [rewriter_before_opt_a]: 7.744e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00583165, [2] [Cycle 1]: 0.00164602, [27] [switch_simplify]: 5.95e-05 [loop_unroll]: 2.849e-05 [a_1]: 0.00051917 [with_stream_mark]: 1.829e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 9.01998e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.61998e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00069108 [add_forward_monad_depend]: 4.90999e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.298e-05 [cse]: 3.209e-05 [replace_applicator]: 1.14e-05 [Cycle 2]: 0.0003086, [27] [switch_simplify]: 5.50001e-06 [loop_unroll]: 4.79e-06 [a_1]: 8.676e-05 [with_stream_mark]: 8.60001e-06 [recompute_prepare]: 4.92999e-06 [updatestate_depend_eliminate]: 3.08998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 4.84998e-06 [updatestate_useless_node_eliminater]: 4.79002e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.14003e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.172e-05 [j_node_and_user_rematch]: 7.31999e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 6.76e-06 [inline_without_move]: 4.48001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.224e-05 [replace_applicator]: 4.85001e-06 [py_interpret_to_execute_after_opt_a]: 1.249e-05 [rewriter_after_opt_a]: 3.623e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00053469 [jit_opt_b]: 4.78e-05, [1] [Cycle 1]: 4.157e-05, [2] [frontend_op_eliminate]: 1.469e-05 [inline_after_opt_a]: 1.566e-05 [cconv]: 2.58e-05 [loop_unroll]: 0.0004023 [jit_opt_after_cconv]: 0.0001508, [1] [Cycle 1]: 0.00014417, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 5.72999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.339e-05 [call_graph_tuple_transform]: 2.325e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 5.74e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.76e-06 [add_recomputation]: 4.793e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.81e-05, [1] [cse]: 1.253e-05 [auto_monad_reorder]: 1.644e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 4.53999e-06 [opt_after_jit_grad]: 0.00042909 [symbol_engine_optimizer]: 6.901e-05, [1] [Cycle 1]: 6.295e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 7.21999e-06 [elim_not_effective]: 1.264e-05 [opt_reshape]: 5.29e-06 [fold_const_symbol]: 8.24002e-06 [renormalize]: 3.19997e-07 [validate]: 3.783e-05 Sums bootstrap : 0.000360s : 3.77% type_inference : 0.005555s : 58.07% event_method : 0.000020s : 0.21% auto_monad : 0.000066s : 0.69% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000045s : 0.47% rewriter_before_opt_a : 0.000077s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.68% jit_opt_a.loop_unroll : 0.000033s : 0.35% jit_opt_a.a_1 : 0.000606s : 6.33% jit_opt_a.with_stream_mark : 0.000027s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000691s : 7.22% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.20% jit_opt_a.cse : 0.000044s : 0.46% jit_opt_a.replace_applicator : 0.000016s : 0.17% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000036s : 0.38% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000535s : 5.59% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000026s : 0.27% loop_unroll : 0.000402s : 4.21% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000048s : 0.50% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000429s : 4.49% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.40% Time group info: ------[substitution.] 0.000204 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 5.11% : 0.000010s : 3: substitution.graph_param_transform 81.56% : 0.000166s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000004s : 2: substitution.replace_old_param 6.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005482 2 82.46% : 0.004521s : 1: type_inference.infer 17.54% : 0.000961s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.17% : 0.000046s : 4: replace.inline 32.83% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.55% : 0.000164s : 4: match.inline 6.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.30% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.33% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.13% : 0.000001s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000008s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.91% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000704 13 54.03% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.22% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.74% : 0.000294s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015589 72 0.33% : 0.000051s : 1: add_recomputation 0.44% : 0.000069s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.46% : 0.000383s : 1: bootstrap 0.18% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.43% : 0.005835s : 1: jit_opt_a 0.98% : 0.000153s : 1: jit_opt_after_cconv 0.32% : 0.000050s : 1: jit_opt_b 2.63% : 0.000410s : 1: loop_unroll 3.48% : 0.000543s : 1: mutable_eliminate 5.25% : 0.000818s : 26: opt.transform.jit_opt_a 0.34% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.82% : 0.000439s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.42% : 0.000378s : 1: renormalize.infer 1.96% : 0.000306s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.51% : 0.000080s : 1: rewriter_before_opt_a 0.46% : 0.000071s : 1: symbol_engine_optimizer 35.77% : 0.005576s : 1: type_inference TotalTime = 0.0144931, [30] [bootstrap]: 0.0003813 [type_inference]: 0.00556543 [event_method]: 2.033e-05 [auto_monad]: 7.132e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 4.085e-05 [rewriter_before_opt_a]: 7.519e-05 [expand_dump_flag]: 3.00002e-06 [jit_opt_a]: 0.00591284, [2] [Cycle 1]: 0.00195823, [27] [switch_simplify]: 5.782e-05 [loop_unroll]: 2.92e-05 [a_1]: 0.00055783 [with_stream_mark]: 2.171e-05 [recompute_prepare]: 7.17997e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 2.43998e-06 [get_grad_eliminate_]: 5.91998e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00092783 [add_forward_monad_depend]: 8.38999e-06 [auto_monad_grad]: 2.15002e-06 [auto_monad_eliminator]: 1.771e-05 [cse]: 3.155e-05 [replace_applicator]: 1.531e-05 [Cycle 2]: 0.00036111, [27] [switch_simplify]: 6.00002e-06 [loop_unroll]: 5.45001e-06 [a_1]: 9.98e-05 [with_stream_mark]: 1.341e-05 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.06998e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 4.97e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.411e-05 [j_node_and_user_rematch]: 8.00999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 4.64002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 7.4e-06 [cse]: 1.278e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.299e-05 [rewriter_after_opt_a]: 4.482e-05 [convert_after_rewriter]: 8.15e-06 [order_py_execute_after_rewriter]: 4.81997e-06 [mutable_eliminate]: 0.0006326 [jit_opt_b]: 5.48e-05, [1] [Cycle 1]: 4.66e-05, [2] [frontend_op_eliminate]: 1.597e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.791e-05 [loop_unroll]: 0.00046882 [jit_opt_after_cconv]: 0.00015618, [1] [Cycle 1]: 0.00014883, [11] [c_1]: 2.127e-05 [parameter_eliminate]: 3.68999e-06 [updatestate_depend_eliminate]: 7.08e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 2.641e-05 [call_graph_tuple_transform]: 1.983e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 5.74999e-06 [add_recomputation]: 7.627e-05 [cse_after_recomputation]: 2.728e-05, [1] [Cycle 1]: 1.976e-05, [1] [cse]: 1.263e-05 [auto_monad_reorder]: 1.602e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 7.21999e-06 [opt_after_jit_grad]: 0.00052395 [symbol_engine_optimizer]: 8.036e-05, [1] [Cycle 1]: 7.235e-05, [6] [build]: 5.30999e-06 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 1.402e-05 [opt_reshape]: 5.53002e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 5.39992e-07 [validate]: 4.296e-05 Sums bootstrap : 0.000381s : 3.72% type_inference : 0.005565s : 54.36% event_method : 0.000020s : 0.20% auto_monad : 0.000071s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000041s : 0.40% rewriter_before_opt_a : 0.000075s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.34% jit_opt_a.a_1 : 0.000658s : 6.42% jit_opt_a.with_stream_mark : 0.000035s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000928s : 9.06% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.25% jit_opt_a.cse : 0.000044s : 0.43% jit_opt_a.replace_applicator : 0.000020s : 0.20% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000045s : 0.44% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000633s : 6.18% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000018s : 0.17% cconv : 0.000028s : 0.27% loop_unroll : 0.000469s : 4.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000026s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000076s : 0.74% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000524s : 5.12% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000043s : 0.42% Time group info: ------[substitution.] 0.000227 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000005s : 3: substitution.graph_param_transform 83.63% : 0.000190s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000006s : 4: substitution.remove_not_recompute_node 2.62% : 0.000006s : 2: substitution.replace_old_param 5.97% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005486 2 83.19% : 0.004564s : 1: type_inference.infer 16.81% : 0.000922s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.99% : 0.000050s : 4: replace.inline 32.01% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 93.76% : 0.000187s : 4: match.inline 6.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.74% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.58% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.81% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 2.36% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.47% : 0.000003s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.93% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000732 13 51.90% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.29% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.81% : 0.000306s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016358 72 0.50% : 0.000081s : 1: add_recomputation 0.46% : 0.000075s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.48% : 0.000406s : 1: bootstrap 0.19% : 0.000030s : 1: cconv 0.06% : 0.000011s : 1: convert_after_rewriter 0.18% : 0.000030s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.16% : 0.005916s : 1: jit_opt_a 0.98% : 0.000160s : 1: jit_opt_after_cconv 0.35% : 0.000058s : 1: jit_opt_b 2.93% : 0.000479s : 1: loop_unroll 3.94% : 0.000645s : 1: mutable_eliminate 5.38% : 0.000880s : 26: opt.transform.jit_opt_a 0.30% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.16% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.28% : 0.000536s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000043s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 3.42% : 0.000559s : 1: renormalize.infer 2.20% : 0.000360s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000049s : 1: rewriter_after_opt_a 0.48% : 0.000078s : 1: rewriter_before_opt_a 0.51% : 0.000083s : 1: symbol_engine_optimizer 34.14% : 0.005585s : 1: type_inference TotalTime = 0.0298697, [30] [bootstrap]: 0.00033704 [type_inference]: 0.0209522 [event_method]: 1.959e-05 [auto_monad]: 6.855e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00013405 [rewriter_before_opt_a]: 8.26e-05 [expand_dump_flag]: 3.25002e-06 [jit_opt_a]: 0.00582206, [2] [Cycle 1]: 0.00197137, [27] [switch_simplify]: 5.39e-05 [loop_unroll]: 3.094e-05 [a_1]: 0.00053779 [with_stream_mark]: 1.729e-05 [recompute_prepare]: 8.64998e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.93002e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00098922 [add_forward_monad_depend]: 5.84999e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.461e-05 [cse]: 3.32e-05 [replace_applicator]: 1.549e-05 [Cycle 2]: 0.00033294, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 5.33002e-06 [a_1]: 9.05e-05 [with_stream_mark]: 1.12e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.53998e-06 [parameter_eliminate]: 1.26997e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.83001e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.53e-06 [cse]: 1.238e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 1.182e-05 [rewriter_after_opt_a]: 3.776e-05 [convert_after_rewriter]: 7.34002e-06 [order_py_execute_after_rewriter]: 5.59998e-06 [mutable_eliminate]: 0.00079363 [jit_opt_b]: 5.224e-05, [1] [Cycle 1]: 4.557e-05, [2] [frontend_op_eliminate]: 1.695e-05 [inline_after_opt_a]: 1.629e-05 [cconv]: 2.691e-05 [loop_unroll]: 0.00043103 [jit_opt_after_cconv]: 0.00014926, [1] [Cycle 1]: 0.00014308, [11] [c_1]: 2.073e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 6.34001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.517e-05 [call_graph_tuple_transform]: 1.924e-05 [tuple_list_get_item_eliminator]: 5.69999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 5.49e-06 [add_recomputation]: 5.075e-05 [cse_after_recomputation]: 2.455e-05, [1] [Cycle 1]: 1.946e-05, [1] [cse]: 1.257e-05 [auto_monad_reorder]: 1.767e-05 [get_jit_bprop_graph]: 3.28998e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00048642 [symbol_engine_optimizer]: 9.546e-05, [1] [Cycle 1]: 8.861e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.418e-05 [opt_reshape]: 6.28e-06 [fold_const_symbol]: 2.861e-05 [renormalize]: 3.19997e-07 [validate]: 4.342e-05 Sums bootstrap : 0.000337s : 1.31% type_inference : 0.020952s : 81.32% event_method : 0.000020s : 0.08% auto_monad : 0.000069s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000134s : 0.52% rewriter_before_opt_a : 0.000083s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.23% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000628s : 2.44% jit_opt_a.with_stream_mark : 0.000028s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000989s : 3.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000046s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000794s : 3.08% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000431s : 1.67% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000051s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000486s : 1.89% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000029s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.17% Time group info: ------[substitution.] 0.000198 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 82.83% : 0.000164s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.26% : 0.000004s : 2: substitution.replace_old_param 6.24% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020875 2 92.73% : 0.019357s : 1: type_inference.infer 7.27% : 0.001518s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.34% : 0.000046s : 4: replace.inline 32.66% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.52% : 0.000162s : 4: match.inline 6.48% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.20% : 0.000003s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.86% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.68% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.62% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.66% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000843 13 46.55% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.60% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.86% : 0.000420s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031779 72 0.17% : 0.000054s : 1: add_recomputation 0.23% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.11% : 0.000353s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.33% : 0.005826s : 1: jit_opt_a 0.48% : 0.000152s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.38% : 0.000438s : 1: loop_unroll 2.52% : 0.000802s : 1: mutable_eliminate 2.68% : 0.000851s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000054s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000494s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000138s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.77% : 0.000562s : 1: renormalize.infer 1.32% : 0.000420s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.27% : 0.000087s : 1: rewriter_before_opt_a 0.31% : 0.000098s : 1: symbol_engine_optimizer 65.98% : 0.020967s : 1: type_inference TotalTime = 0.157458, [30] [bootstrap]: 0.00034131 [type_inference]: 0.144995 [event_method]: 2.661e-05 [auto_monad]: 7.827e-05 [graph_reusing]: 6.03002e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.0005564 [rewriter_before_opt_a]: 0.00010343 [expand_dump_flag]: 4.38001e-06 [jit_opt_a]: 0.00878143, [2] [Cycle 1]: 0.00479549, [27] [switch_simplify]: 6.63e-05 [loop_unroll]: 3.573e-05 [a_1]: 0.00075621 [with_stream_mark]: 1.906e-05 [recompute_prepare]: 9.67999e-06 [updatestate_depend_eliminate]: 4.96002e-06 [updatestate_assign_eliminate]: 4.14997e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7.65998e-06 [updatestate_useless_node_eliminater]: 6.84001e-06 [accelerated_algorithm]: 7.03e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 7.07002e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.764e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 6.49001e-06 [renormalize]: 0.00352449 [add_forward_monad_depend]: 8.31002e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.849e-05 [cse]: 3.969e-05 [replace_applicator]: 2.136e-05 [Cycle 2]: 0.00041529, [27] [switch_simplify]: 8.05e-06 [loop_unroll]: 7.1e-06 [a_1]: 0.0001449 [with_stream_mark]: 1.328e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.40997e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 3.80998e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24998e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.646e-05 [replace_applicator]: 6.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.428e-05 [rewriter_after_opt_a]: 3.994e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.0007228 [jit_opt_b]: 6.204e-05, [1] [Cycle 1]: 5.288e-05, [2] [frontend_op_eliminate]: 2.248e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.716e-05 [loop_unroll]: 0.00042905 [jit_opt_after_cconv]: 0.00018267, [1] [Cycle 1]: 0.00017587, [11] [c_1]: 2.671e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 6.59999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 2.584e-05 [call_graph_tuple_transform]: 2.324e-05 [tuple_list_get_item_eliminator]: 7.2e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 7.78001e-06 [remove_dup_value]: 1.925e-05 [partial_unused_args_eliminate]: 3.52997e-06 [environ_conv]: 8.27998e-06 [add_recomputation]: 5.094e-05 [cse_after_recomputation]: 2.718e-05, [1] [Cycle 1]: 2.155e-05, [1] [cse]: 1.475e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00048139 [symbol_engine_optimizer]: 0.00020827, [1] [Cycle 1]: 0.00020124, [6] [build]: 4.02e-06 [elim_shapecalc]: 9.68997e-06 [elim_not_effective]: 1.679e-05 [opt_reshape]: 0.00012765 [fold_const_symbol]: 1.246e-05 [renormalize]: 4.00003e-07 [validate]: 4.983e-05 Sums bootstrap : 0.000341s : 0.22% type_inference : 0.144995s : 94.62% event_method : 0.000027s : 0.02% auto_monad : 0.000078s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000556s : 0.36% rewriter_before_opt_a : 0.000103s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000901s : 0.59% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003525s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000723s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000429s : 0.28% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000481s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000128s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000272 25 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.74% : 0.000007s : 4: substitution.graph_param_transform 85.57% : 0.000233s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 5.12% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.144897 2 97.57% : 0.141371s : 1: type_inference.infer 2.43% : 0.003525s : 1: type_inference.specialize ------[replace.] 0.000123 7 65.79% : 0.000081s : 5: replace.inline 34.21% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 94.80% : 0.000229s : 5: match.inline 5.20% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.44% : 0.000002s : 13: predicate.accumulaten_eliminater 1.01% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 2.74% : 0.000004s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.33% : 0.000002s : 4: predicate.mutable_eliminate 0.76% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 19: predicate.partial_eliminate 1.80% : 0.000003s : 13: predicate.print_const_string_wrapper 1.66% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.91% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.88% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002712 25 66.55% : 0.001805s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.38% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.07% : 0.000842s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.162342 72 0.03% : 0.000055s : 1: add_recomputation 0.05% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000359s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.41% : 0.008785s : 1: jit_opt_a 0.11% : 0.000185s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.27% : 0.000437s : 1: loop_unroll 0.45% : 0.000732s : 1: mutable_eliminate 0.72% : 0.001169s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000161s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000490s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000565s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.62% : 0.002634s : 1: renormalize.infer 0.54% : 0.000878s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000108s : 1: rewriter_before_opt_a 0.13% : 0.000211s : 1: symbol_engine_optimizer 89.33% : 0.145016s : 1: type_inference TotalTime = 0.162587, [30] [bootstrap]: 0.00034267 [type_inference]: 0.149161 [event_method]: 2.275e-05 [auto_monad]: 7.684e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00051299 [rewriter_before_opt_a]: 9.499e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00885425, [2] [Cycle 1]: 0.00483544, [27] [switch_simplify]: 6.371e-05 [loop_unroll]: 3.031e-05 [a_1]: 0.00063744 [with_stream_mark]: 2.246e-05 [recompute_prepare]: 8.27e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.75e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 6.92002e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 1.089e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 6.01998e-06 [renormalize]: 0.00369726 [add_forward_monad_depend]: 8.08999e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.918e-05 [cse]: 3.276e-05 [replace_applicator]: 2.09e-05 [Cycle 2]: 0.0003717, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.56e-06 [a_1]: 0.00012199 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.35998e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.735e-05 [j_node_and_user_rematch]: 9.43002e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.45001e-06 [inline_without_move]: 5.46998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.49999e-06 [cse]: 1.135e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 1.43e-05 [rewriter_after_opt_a]: 3.723e-05 [convert_after_rewriter]: 6.63003e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.0006621 [jit_opt_b]: 5.5e-05, [1] [Cycle 1]: 4.709e-05, [2] [frontend_op_eliminate]: 1.916e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.781e-05 [loop_unroll]: 0.00154224 [jit_opt_after_cconv]: 0.00016452, [1] [Cycle 1]: 0.00015805, [11] [c_1]: 2.638e-05 [parameter_eliminate]: 4.06001e-06 [updatestate_depend_eliminate]: 7.53e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.723e-05 [call_graph_tuple_transform]: 2.278e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 1.08001e-06 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 8.85001e-06 [add_recomputation]: 5.032e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.66e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.461e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 7.12002e-06 [opt_after_jit_grad]: 0.00048038 [symbol_engine_optimizer]: 7.338e-05, [1] [Cycle 1]: 6.704e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.92e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 7.13998e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 3.00002e-07 [validate]: 0.0001209 Sums bootstrap : 0.000343s : 0.22% type_inference : 0.149161s : 94.22% event_method : 0.000023s : 0.01% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000513s : 0.32% rewriter_before_opt_a : 0.000095s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000759s : 0.48% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003697s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000662s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.001542s : 0.97% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000480s : 0.30% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000121s : 0.08% Time group info: ------[substitution.] 0.000266 24 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000007s : 4: substitution.graph_param_transform 85.85% : 0.000229s : 4: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000007s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 4.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.149065 2 97.58% : 0.145456s : 1: type_inference.infer 2.42% : 0.003609s : 1: type_inference.specialize ------[replace.] 0.000083 6 69.64% : 0.000058s : 4: replace.inline 30.36% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 95.61% : 0.000226s : 4: match.inline 4.39% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.14% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.89% : 0.000008s : 26: predicate.inline 1.22% : 0.000002s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.89% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.30% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.70% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007043 22 87.35% : 0.006152s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.78% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 11.87% : 0.000836s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.167282 72 0.03% : 0.000053s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000364s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 5.30% : 0.008858s : 1: jit_opt_a 0.10% : 0.000167s : 1: jit_opt_after_cconv 0.03% : 0.000058s : 1: jit_opt_b 0.93% : 0.001554s : 1: loop_unroll 0.40% : 0.000672s : 1: mutable_eliminate 0.60% : 0.001010s : 26: opt.transform.jit_opt_a 0.03% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000488s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000520s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.65% : 0.002757s : 1: renormalize.infer 0.55% : 0.000928s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.06% : 0.000101s : 1: rewriter_before_opt_a 0.05% : 0.000076s : 1: symbol_engine_optimizer 89.18% : 0.149183s : 1: type_inference TotalTime = 0.0323286, [30] [bootstrap]: 0.0002904 [type_inference]: 0.0233609 [event_method]: 1.829e-05 [auto_monad]: 5.694e-05 [graph_reusing]: 5.20001e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00014559 [rewriter_before_opt_a]: 8.399e-05 [expand_dump_flag]: 2.76e-06 [jit_opt_a]: 0.00610197, [2] [Cycle 1]: 0.00206062, [27] [switch_simplify]: 5.356e-05 [loop_unroll]: 3e-05 [a_1]: 0.00053811 [with_stream_mark]: 1.536e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.50002e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.207e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 0.0011128 [add_forward_monad_depend]: 5.29e-06 [auto_monad_grad]: 1.81e-06 [auto_monad_eliminator]: 1.243e-05 [cse]: 2.19e-05 [replace_applicator]: 1.214e-05 [Cycle 2]: 0.00032902, [27] [switch_simplify]: 6.23998e-06 [loop_unroll]: 5.39998e-06 [a_1]: 9.55e-05 [with_stream_mark]: 9.89999e-06 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.56998e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 5.02e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.85002e-06 [cse]: 1.243e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.212e-05 [rewriter_after_opt_a]: 3.355e-05 [convert_after_rewriter]: 6.33e-06 [order_py_execute_after_rewriter]: 4.1e-06 [mutable_eliminate]: 0.00063031 [jit_opt_b]: 5.147e-05, [1] [Cycle 1]: 4.536e-05, [2] [frontend_op_eliminate]: 1.775e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 1.793e-05 [loop_unroll]: 0.00046948 [jit_opt_after_cconv]: 0.00014754, [1] [Cycle 1]: 0.00014166, [11] [c_1]: 2.188e-05 [parameter_eliminate]: 2.65002e-06 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.437e-05 [call_graph_tuple_transform]: 1.902e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.21997e-06 [renormalize]: 8.80013e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.151e-05 [partial_unused_args_eliminate]: 1.72999e-06 [environ_conv]: 5.00999e-06 [add_recomputation]: 3.897e-05 [cse_after_recomputation]: 2.372e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.227e-05 [auto_monad_reorder]: 1.04e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 5.92999e-06 [opt_after_jit_grad]: 0.00049388 [symbol_engine_optimizer]: 7.388e-05, [1] [Cycle 1]: 6.803e-05, [6] [build]: 3.07002e-06 [elim_shapecalc]: 7.61001e-06 [elim_not_effective]: 1.241e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 4.40021e-07 [validate]: 5.951e-05 Sums bootstrap : 0.000290s : 1.04% type_inference : 0.023361s : 83.26% event_method : 0.000018s : 0.07% auto_monad : 0.000057s : 0.20% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000146s : 0.52% rewriter_before_opt_a : 0.000084s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000634s : 2.26% jit_opt_a.with_stream_mark : 0.000025s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001113s : 3.97% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.07% jit_opt_a.cse : 0.000034s : 0.12% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000034s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000630s : 2.25% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000018s : 0.06% loop_unroll : 0.000469s : 1.67% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000012s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000039s : 0.14% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000010s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000494s : 1.76% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.21% Time group info: ------[substitution.] 0.000188 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 1.05% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000004s : 3: substitution.graph_param_transform 84.45% : 0.000159s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000004s : 4: substitution.remove_not_recompute_node 2.05% : 0.000004s : 2: substitution.replace_old_param 5.37% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023301 2 93.74% : 0.021843s : 1: type_inference.infer 6.26% : 0.001458s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.47% : 0.000049s : 4: replace.inline 33.53% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 94.60% : 0.000156s : 4: match.inline 5.40% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.20% : 0.000002s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000002s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.55% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 4.69% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 13.58% : 0.000017s : 53: predicate.switch_simplify 1.09% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000835 13 42.30% : 0.000353s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.12% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.59% : 0.000447s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034333 72 0.12% : 0.000042s : 1: add_recomputation 0.17% : 0.000060s : 1: auto_monad 0.04% : 0.000013s : 1: auto_monad_reorder 0.88% : 0.000302s : 1: bootstrap 0.06% : 0.000021s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.06% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.78% : 0.006106s : 1: jit_opt_a 0.44% : 0.000150s : 1: jit_opt_after_cconv 0.16% : 0.000054s : 1: jit_opt_b 1.39% : 0.000477s : 1: loop_unroll 1.86% : 0.000639s : 1: mutable_eliminate 2.47% : 0.000850s : 26: opt.transform.jit_opt_a 0.14% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000149s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000014s : 1: remove_dup_value 1.84% : 0.000632s : 1: renormalize.infer 1.38% : 0.000473s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000036s : 1: rewriter_after_opt_a 0.26% : 0.000088s : 1: rewriter_before_opt_a 0.22% : 0.000076s : 1: symbol_engine_optimizer 68.08% : 0.023373s : 1: type_inference TotalTime = 0.144863, [30] [bootstrap]: 0.00030533 [type_inference]: 0.121047 [event_method]: 0.00047684 [auto_monad]: 0.00011076 [graph_reusing]: 7.2e-06 [pre_auto_parallel]: 3.08998e-06 [py_interpret_to_execute]: 5.366e-05 [rewriter_before_opt_a]: 0.00013259 [expand_dump_flag]: 3.89002e-06 [jit_opt_a]: 0.0205543, [2] [Cycle 1]: 0.0163587, [27] [switch_simplify]: 8.489e-05 [loop_unroll]: 4.18e-05 [a_1]: 0.00095579 [with_stream_mark]: 3.998e-05 [recompute_prepare]: 2.686e-05 [updatestate_depend_eliminate]: 1.054e-05 [updatestate_assign_eliminate]: 7.70998e-06 [updatestate_loads_eliminate]: 7.07002e-06 [parameter_eliminate]: 3.93001e-06 [specialize_transform]: 1.635e-05 [updatestate_useless_node_eliminater]: 1.435e-05 [accelerated_algorithm]: 1.427e-05 [meta_shard_fg_expand]: 4.49998e-06 [get_grad_eliminate_]: 1.389e-05 [merge_forward]: 1.019e-05 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.097e-05 [j_node_and_user_rematch]: 2.663e-05 [meta_fg_expand]: 0.00221387 [replace_old_param]: 8.736e-05 [inline_without_move]: 7.386e-05 [renormalize]: 0.0123103 [add_forward_monad_depend]: 6.74999e-06 [auto_monad_grad]: 2.90998e-06 [auto_monad_eliminator]: 1.507e-05 [cse]: 2.961e-05 [replace_applicator]: 2.165e-05 [Cycle 2]: 0.00035268, [27] [switch_simplify]: 5.01002e-06 [loop_unroll]: 4.35999e-06 [a_1]: 5.213e-05 [with_stream_mark]: 1.306e-05 [recompute_prepare]: 4.09002e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 3.38999e-06 [updatestate_useless_node_eliminater]: 3.25e-06 [accelerated_algorithm]: 3.59002e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 3.55e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 3.6e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 6.51e-06 [meta_fg_expand]: 6.704e-05 [replace_old_param]: 4.46002e-06 [inline_without_move]: 3.9e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 4.3e-06 [cse]: 9.88998e-06 [replace_applicator]: 3.51001e-06 [py_interpret_to_execute_after_opt_a]: 1.073e-05 [rewriter_after_opt_a]: 3.387e-05 [convert_after_rewriter]: 6.16e-06 [order_py_execute_after_rewriter]: 4.22e-06 [mutable_eliminate]: 0.00064824 [jit_opt_b]: 3.905e-05, [1] [Cycle 1]: 3.214e-05, [2] [frontend_op_eliminate]: 9.46e-06 [inline_after_opt_a]: 1.139e-05 [cconv]: 2.526e-05 [loop_unroll]: 0.00041705 [jit_opt_after_cconv]: 0.00012304, [1] [Cycle 1]: 0.00011693, [11] [c_1]: 1.2e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 4.86002e-06 [updatestate_assign_eliminate]: 1.75001e-06 [updatestate_loads_eliminate]: 1.60001e-06 [cse]: 1.716e-05 [call_graph_tuple_transform]: 1.375e-05 [tuple_list_get_item_eliminator]: 3.46999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 3.53e-06 [remove_dup_value]: 1.399e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 5.12e-06 [add_recomputation]: 3.635e-05 [cse_after_recomputation]: 2.021e-05, [1] [Cycle 1]: 1.473e-05, [1] [cse]: 8.52e-06 [auto_monad_reorder]: 3.077e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.35001e-06 [opt_after_jit_grad]: 0.00044838 [symbol_engine_optimizer]: 6.492e-05, [1] [Cycle 1]: 5.852e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 5.40999e-06 [elim_not_effective]: 1.007e-05 [opt_reshape]: 4e-06 [fold_const_symbol]: 5.69e-06 [renormalize]: 3.09985e-07 [validate]: 3.369e-05 Sums bootstrap : 0.000305s : 0.22% type_inference : 0.121047s : 86.29% event_method : 0.000477s : 0.34% auto_monad : 0.000111s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000054s : 0.04% rewriter_before_opt_a : 0.000133s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.06% jit_opt_a.loop_unroll : 0.000046s : 0.03% jit_opt_a.a_1 : 0.001008s : 0.72% jit_opt_a.with_stream_mark : 0.000053s : 0.04% jit_opt_a.recompute_prepare : 0.000031s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000020s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000014s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000033s : 0.02% jit_opt_a.meta_fg_expand : 0.002281s : 1.63% jit_opt_a.replace_old_param : 0.000092s : 0.07% jit_opt_a.inline_without_move : 0.000078s : 0.06% jit_opt_a.renormalize : 0.012310s : 8.78% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000648s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000009s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000417s : 0.30% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000003s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000031s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000448s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.02% Time group info: ------[substitution.] 0.000326 55 0.50% : 0.000002s : 1: substitution.elim_not_effective 0.31% : 0.000001s : 1: substitution.fold_const_symbol 1.25% : 0.000004s : 1: substitution.graph_param_transform 65.91% : 0.000215s : 6: substitution.inline 8.74% : 0.000028s : 2: substitution.inline_without_move 2.68% : 0.000009s : 9: substitution.j_node_and_user_rematch 1.40% : 0.000005s : 2: substitution.minmaximum_grad 1.33% : 0.000004s : 3: substitution.partial_eliminate 2.54% : 0.000008s : 9: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_applicator 2.66% : 0.000009s : 10: substitution.replace_old_param 1.31% : 0.000004s : 1: substitution.set_cell_output_no_recompute 2.40% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.63% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.39% : 0.000018s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120950 2 97.52% : 0.117953s : 1: type_inference.infer 2.48% : 0.002997s : 1: type_inference.specialize ------[replace.] 0.000080 8 79.13% : 0.000063s : 6: replace.inline 20.87% : 0.000017s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 8 94.51% : 0.000211s : 6: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 1178 1.38% : 0.000003s : 19: predicate.accumulaten_eliminater 0.48% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 19: predicate.addn_check_dump 1.45% : 0.000003s : 19: predicate.addn_zero_filter 1.83% : 0.000003s : 19: predicate.arithmetic_simplify 1.44% : 0.000003s : 19: predicate.cast_eliminate 0.17% : 0.000000s : 1: predicate.check_bprop_eliminate 1.23% : 0.000002s : 19: predicate.compare_switch_simplify 1.38% : 0.000003s : 19: predicate.depend_value_elim 1.19% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 19: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 19: predicate.dict_set_item_eliminator 0.51% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.12% : 0.000000s : 1: predicate.elim_not_effective 0.18% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 19: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 19: predicate.environ_get_depend_swap 1.40% : 0.000003s : 19: predicate.environ_get_eliminate 1.23% : 0.000002s : 19: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.23% : 0.000002s : 13: predicate.get_grad_eliminate 0.12% : 0.000000s : 1: predicate.graph_param_transform 4.56% : 0.000008s : 29: predicate.inline 4.31% : 0.000008s : 41: predicate.inline_without_move 0.56% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.61% : 0.000003s : 13: predicate.less_batch_normalization 1.55% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.55% : 0.000003s : 22: predicate.load_eliminater 0.64% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.90% : 0.000007s : 45: predicate.loop_unroll_before_grad 1.89% : 0.000004s : 20: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 19: predicate.merge_addn 1.30% : 0.000002s : 19: predicate.minmaximum_grad 0.73% : 0.000001s : 1: predicate.mutable_eliminate 0.22% : 0.000000s : 1: predicate.opt_reshape 2.00% : 0.000004s : 22: predicate.partial_eliminate 1.54% : 0.000003s : 19: predicate.print_const_string_wrapper 1.82% : 0.000003s : 19: predicate.reduce_eliminate 1.52% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.93% : 0.000002s : 13: predicate.remove_not_recompute_node 1.77% : 0.000003s : 23: predicate.replace_applicator 2.43% : 0.000005s : 41: predicate.replace_old_param 0.13% : 0.000000s : 1: predicate.reset_defer_inline 1.33% : 0.000002s : 19: predicate.reshape_eliminate 1.52% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.30% : 0.000001s : 1: predicate.row_tensor_eliminate 1.43% : 0.000003s : 19: predicate.same_eliminate 0.65% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.33% : 0.000001s : 2: predicate.special_op_eliminate 1.30% : 0.000002s : 13: predicate.specialize_transform 1.55% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.33% : 0.000004s : 27: predicate.switch_defer_inline 2.17% : 0.000004s : 27: predicate.switch_layer_defer_inline 6.75% : 0.000013s : 73: predicate.switch_simplify 1.57% : 0.000003s : 19: predicate.tile_eliminate 1.41% : 0.000003s : 19: predicate.transpose_eliminate 1.64% : 0.000003s : 19: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 19: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.54% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 3.33% : 0.000006s : 35: predicate.updatestate_useless_node_eliminater 1.58% : 0.000003s : 19: predicate.value_based_eliminate 0.09% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.24% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003208 36 88.33% : 0.002834s : 27: func_graph_cloner_run.FuncGraphClonerGraph 11.67% : 0.000374s : 9: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158656 72 0.02% : 0.000039s : 1: add_recomputation 0.07% : 0.000117s : 1: auto_monad 0.02% : 0.000034s : 1: auto_monad_reorder 0.21% : 0.000336s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.31% : 0.000485s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 12.96% : 0.020558s : 1: jit_opt_a 0.08% : 0.000125s : 1: jit_opt_after_cconv 0.03% : 0.000041s : 1: jit_opt_b 0.27% : 0.000426s : 1: loop_unroll 0.41% : 0.000657s : 1: mutable_eliminate 0.93% : 0.001482s : 26: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000014s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000456s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000057s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 7.42% : 0.011765s : 1: renormalize.infer 0.33% : 0.000530s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.09% : 0.000136s : 1: rewriter_before_opt_a 0.04% : 0.000067s : 1: symbol_engine_optimizer 76.31% : 0.121066s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.689.03 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f700> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.696.41 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.13713, [30] [bootstrap]: 0.00029297 [type_inference]: 0.123527 [event_method]: 2.729e-05 [auto_monad]: 7.822e-05 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 0.0005925 [rewriter_before_opt_a]: 0.00011045 [expand_dump_flag]: 4.38999e-06 [jit_opt_a]: 0.00971955, [2] [Cycle 1]: 0.0052262, [27] [switch_simplify]: 7.18e-05 [loop_unroll]: 3.531e-05 [a_1]: 0.00086917 [with_stream_mark]: 2.603e-05 [recompute_prepare]: 1.24e-05 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.86e-06 [specialize_transform]: 8.50999e-06 [updatestate_useless_node_eliminater]: 6.45002e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 7.01001e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.013e-05 [j_node_and_user_rematch]: 1.406e-05 [meta_fg_expand]: 3.58e-06 [replace_old_param]: 1.161e-05 [inline_without_move]: 7.41999e-06 [renormalize]: 0.00377803 [add_forward_monad_depend]: 1.041e-05 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 2.222e-05 [cse]: 3.958e-05 [replace_applicator]: 2.559e-05 [Cycle 2]: 0.00043173, [27] [switch_simplify]: 8.37e-06 [loop_unroll]: 6.48998e-06 [a_1]: 0.00015487 [with_stream_mark]: 1.609e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 6.51999e-06 [accelerated_algorithm]: 6.86001e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 3.66999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 9.63002e-06 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.98998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.54998e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.84001e-06 [cse]: 1.596e-05 [replace_applicator]: 6.86999e-06 [py_interpret_to_execute_after_opt_a]: 1.729e-05 [rewriter_after_opt_a]: 4.107e-05 [convert_after_rewriter]: 4.234e-05 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00079149 [jit_opt_b]: 7.247e-05, [1] [Cycle 1]: 6.441e-05, [2] [frontend_op_eliminate]: 2.107e-05 [inline_after_opt_a]: 2.122e-05 [cconv]: 3.474e-05 [loop_unroll]: 0.00044957 [jit_opt_after_cconv]: 0.00017856, [1] [Cycle 1]: 0.00017177, [11] [c_1]: 2.76e-05 [parameter_eliminate]: 3.89002e-06 [updatestate_depend_eliminate]: 8.74e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.968e-05 [call_graph_tuple_transform]: 2.453e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.23002e-06 [remove_dup_value]: 1.757e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 9.66e-06 [add_recomputation]: 5.196e-05 [cse_after_recomputation]: 2.719e-05, [1] [Cycle 1]: 2.183e-05, [1] [cse]: 1.404e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 4.36002e-06 [rewriter_after_jit_bprop_graph]: 6.34001e-06 [opt_after_jit_grad]: 0.00047814 [symbol_engine_optimizer]: 8.967e-05, [1] [Cycle 1]: 8.338e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 1.357e-05 [elim_not_effective]: 1.581e-05 [opt_reshape]: 7.61001e-06 [fold_const_symbol]: 1.233e-05 [renormalize]: 3.59985e-07 [validate]: 0.0002202 Sums bootstrap : 0.000293s : 0.22% type_inference : 0.123527s : 93.32% event_method : 0.000027s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000593s : 0.45% rewriter_before_opt_a : 0.000110s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.001024s : 0.77% jit_opt_a.with_stream_mark : 0.000042s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003778s : 2.85% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000042s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000791s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000035s : 0.03% loop_unroll : 0.000450s : 0.34% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000478s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000220s : 0.17% Time group info: ------[substitution.] 0.000372 28 1.24% : 0.000005s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.88% : 0.000007s : 4: substitution.graph_param_transform 84.27% : 0.000313s : 5: substitution.inline 1.43% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.27% : 0.000016s : 3: substitution.reduce_eliminate 1.60% : 0.000006s : 4: substitution.remove_not_recompute_node 1.60% : 0.000006s : 2: substitution.replace_old_param 3.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123426 2 96.54% : 0.119156s : 1: type_inference.infer 3.46% : 0.004270s : 1: type_inference.specialize ------[replace.] 0.000136 7 69.22% : 0.000094s : 5: replace.inline 30.78% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000321 7 96.44% : 0.000310s : 5: match.inline 3.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 2.07% : 0.000004s : 13: predicate.addn_zero_filter 2.72% : 0.000005s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000002s : 13: predicate.compare_switch_simplify 1.43% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.74% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000003s : 13: predicate.environ_add_const_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.41% : 0.000009s : 28: predicate.inline 0.74% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.48% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.69% : 0.000003s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.91% : 0.000003s : 4: predicate.mutable_eliminate 0.39% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000004s : 19: predicate.partial_eliminate 1.66% : 0.000003s : 13: predicate.print_const_string_wrapper 2.62% : 0.000004s : 13: predicate.reduce_eliminate 1.67% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.71% : 0.000003s : 13: predicate.reshape_eliminate 1.37% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000002s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000004s : 20: predicate.switch_defer_inline 1.86% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.95% : 0.000012s : 64: predicate.switch_simplify 1.09% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.18% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.61% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004059 25 64.24% : 0.002607s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.63% : 0.000107s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.13% : 0.001345s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142114 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000308s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.03% : 0.000046s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.84% : 0.009724s : 1: jit_opt_a 0.13% : 0.000181s : 1: jit_opt_after_cconv 0.05% : 0.000075s : 1: jit_opt_b 0.32% : 0.000456s : 1: loop_unroll 0.56% : 0.000801s : 1: mutable_eliminate 0.92% : 0.001308s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000602s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.88% : 0.002672s : 1: renormalize.infer 0.77% : 0.001091s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000117s : 1: rewriter_before_opt_a 0.06% : 0.000092s : 1: symbol_engine_optimizer 86.94% : 0.123551s : 1: type_inference TotalTime = 0.0292444, [30] [bootstrap]: 0.00029063 [type_inference]: 0.0205784 [event_method]: 2.071e-05 [auto_monad]: 6.692e-05 [graph_reusing]: 5.42001e-06 [pre_auto_parallel]: 2.83003e-06 [py_interpret_to_execute]: 9.504e-05 [rewriter_before_opt_a]: 8.147e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.005927, [2] [Cycle 1]: 0.00213055, [27] [switch_simplify]: 5.964e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.00064997 [with_stream_mark]: 2.257e-05 [recompute_prepare]: 8.04997e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00103052 [add_forward_monad_depend]: 5.61e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.664e-05 [replace_applicator]: 1.103e-05 [Cycle 2]: 0.00034532, [27] [switch_simplify]: 5.83002e-06 [loop_unroll]: 5.42999e-06 [a_1]: 8.947e-05 [with_stream_mark]: 9.69999e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 3.20998e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 5.11002e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.00999e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.329e-05 [j_node_and_user_rematch]: 8.27998e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.58001e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.38002e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.28e-06 [cse]: 1.551e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.421e-05 [rewriter_after_opt_a]: 4.048e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 5.16002e-06 [mutable_eliminate]: 0.0006538 [jit_opt_b]: 5.096e-05, [1] [Cycle 1]: 4.343e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.575e-05 [cconv]: 2.876e-05 [loop_unroll]: 0.00037451 [jit_opt_after_cconv]: 0.00014945, [1] [Cycle 1]: 0.00014394, [11] [c_1]: 1.996e-05 [parameter_eliminate]: 2.96999e-06 [updatestate_depend_eliminate]: 6.63e-06 [updatestate_assign_eliminate]: 2.35997e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.757e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 5.12e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.20026e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.631e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 6.405e-05 [cse_after_recomputation]: 2.511e-05, [1] [Cycle 1]: 1.971e-05, [1] [cse]: 1.295e-05 [auto_monad_reorder]: 1.785e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 6.23e-06 [opt_after_jit_grad]: 0.00041539 [symbol_engine_optimizer]: 7.067e-05, [1] [Cycle 1]: 6.461e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 6.79999e-06 [elim_not_effective]: 1.184e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 2.69996e-07 [validate]: 4.196e-05 Sums bootstrap : 0.000291s : 1.15% type_inference : 0.020578s : 81.69% event_method : 0.000021s : 0.08% auto_monad : 0.000067s : 0.27% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000095s : 0.38% rewriter_before_opt_a : 0.000081s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000739s : 2.94% jit_opt_a.with_stream_mark : 0.000032s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001031s : 4.09% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000052s : 0.21% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000654s : 2.60% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000375s : 1.49% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000064s : 0.25% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000415s : 1.65% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.17% Time group info: ------[substitution.] 0.000273 23 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 87.93% : 0.000240s : 4: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000004s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 4.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020502 2 91.92% : 0.018846s : 1: type_inference.infer 8.08% : 0.001656s : 1: type_inference.specialize ------[replace.] 0.000094 6 74.68% : 0.000070s : 4: replace.inline 25.32% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 6 95.51% : 0.000237s : 4: match.inline 4.49% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.82% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.08% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.94% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 2.29% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.98% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.91% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001036 13 38.55% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.53% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.91% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031275 72 0.21% : 0.000067s : 1: add_recomputation 0.23% : 0.000071s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 0.98% : 0.000307s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.96% : 0.005931s : 1: jit_opt_a 0.49% : 0.000152s : 1: jit_opt_after_cconv 0.17% : 0.000054s : 1: jit_opt_b 1.22% : 0.000381s : 1: loop_unroll 2.12% : 0.000664s : 1: mutable_eliminate 3.06% : 0.000958s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.35% : 0.000421s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000098s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.91% : 0.000596s : 1: renormalize.infer 1.37% : 0.000427s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.28% : 0.000086s : 1: rewriter_before_opt_a 0.23% : 0.000073s : 1: symbol_engine_optimizer 65.86% : 0.020597s : 1: type_inference TotalTime = 0.0216546, [30] [bootstrap]: 0.00029321 [type_inference]: 0.00540762 [event_method]: 1.85e-05 [auto_monad]: 6.775e-05 [graph_reusing]: 5.83002e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 4.711e-05 [rewriter_before_opt_a]: 0.00018524 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0133633, [2] [Cycle 1]: 0.00171658, [27] [switch_simplify]: 4.807e-05 [loop_unroll]: 3.089e-05 [a_1]: 0.00050304 [with_stream_mark]: 1.461e-05 [recompute_prepare]: 7.75e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.33998e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 2.84999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.215e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.97998e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00082767 [add_forward_monad_depend]: 4.47003e-06 [auto_monad_grad]: 1.49e-06 [auto_monad_eliminator]: 1.278e-05 [cse]: 1.723e-05 [replace_applicator]: 1.103e-05 [Cycle 2]: 0.00033479, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.63002e-06 [a_1]: 9.312e-05 [with_stream_mark]: 8.72e-06 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 2.49001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 4.95001e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 4.79998e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.329e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 1.46002e-06 [replace_old_param]: 7.55e-06 [inline_without_move]: 4.84e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.97002e-06 [cse]: 1.201e-05 [replace_applicator]: 6.48998e-06 [py_interpret_to_execute_after_opt_a]: 1.032e-05 [rewriter_after_opt_a]: 3.166e-05 [convert_after_rewriter]: 6.22001e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00056506 [jit_opt_b]: 4.868e-05, [1] [Cycle 1]: 4.109e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.489e-05 [cconv]: 1.52e-05 [loop_unroll]: 0.00041736 [jit_opt_after_cconv]: 0.00013349, [1] [Cycle 1]: 0.00012758, [11] [c_1]: 2.081e-05 [parameter_eliminate]: 2.04e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 1.785e-05 [call_graph_tuple_transform]: 1.689e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 8.30012e-07 [renormalize]: 4.09986e-07 [switch_simplify]: 5.04e-06 [remove_dup_value]: 9.05999e-06 [partial_unused_args_eliminate]: 1.82001e-06 [environ_conv]: 4.52e-06 [add_recomputation]: 3.386e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.099e-05 [auto_monad_reorder]: 9.82999e-06 [get_jit_bprop_graph]: 1.52001e-06 [rewriter_after_jit_bprop_graph]: 4.70999e-06 [opt_after_jit_grad]: 0.00062521 [symbol_engine_optimizer]: 7.276e-05, [1] [Cycle 1]: 6.703e-05, [6] [build]: 3.06999e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.324e-05 [opt_reshape]: 6.65998e-06 [fold_const_symbol]: 8.64e-06 [renormalize]: 5.00004e-07 [validate]: 3.113e-05 Sums bootstrap : 0.000293s : 3.01% type_inference : 0.005408s : 55.54% event_method : 0.000018s : 0.19% auto_monad : 0.000068s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000047s : 0.48% rewriter_before_opt_a : 0.000185s : 1.90% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.56% jit_opt_a.loop_unroll : 0.000037s : 0.38% jit_opt_a.a_1 : 0.000596s : 6.12% jit_opt_a.with_stream_mark : 0.000023s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000828s : 8.50% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.20% jit_opt_a.cse : 0.000029s : 0.30% jit_opt_a.replace_applicator : 0.000018s : 0.18% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000032s : 0.33% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000565s : 5.80% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000015s : 0.16% loop_unroll : 0.000417s : 4.29% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000009s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000034s : 0.35% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000010s : 0.10% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000625s : 6.42% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000031s : 0.32% Time group info: ------[substitution.] 0.000170 23 0.87% : 0.000001s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000004s : 3: substitution.graph_param_transform 84.43% : 0.000143s : 4: substitution.inline 2.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000004s : 4: substitution.remove_not_recompute_node 1.88% : 0.000003s : 2: substitution.replace_old_param 5.24% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005339 2 80.82% : 0.004315s : 1: type_inference.infer 19.18% : 0.001024s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.59% : 0.000048s : 4: replace.inline 34.41% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000149 6 94.73% : 0.000141s : 4: match.inline 5.27% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 2.38% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.44% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 4.91% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.39% : 0.000003s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.24% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.27% : 0.000003s : 3: predicate.mutable_eliminate 0.72% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000002s : 15: predicate.partial_eliminate 1.44% : 0.000002s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.62% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.75% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.05% : 0.000008s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.08% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000753 13 52.17% : 0.000393s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.19% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.64% : 0.000328s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023350 72 0.16% : 0.000037s : 1: add_recomputation 0.30% : 0.000071s : 1: auto_monad 0.05% : 0.000012s : 1: auto_monad_reorder 1.35% : 0.000314s : 1: bootstrap 0.08% : 0.000018s : 1: cconv 0.04% : 0.000008s : 1: convert_after_rewriter 0.11% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000007s : 1: environ_conv 0.10% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.09% : 0.000022s : 1: graph_reusing 57.25% : 0.013367s : 1: jit_opt_a 0.64% : 0.000150s : 1: jit_opt_after_cconv 0.22% : 0.000051s : 1: jit_opt_b 1.82% : 0.000424s : 1: loop_unroll 2.46% : 0.000575s : 1: mutable_eliminate 3.45% : 0.000806s : 26: opt.transform.jit_opt_a 0.19% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000024s : 4: opt.transform.jit_opt_b 0.05% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.09% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.71% : 0.000633s : 1: opt_after_jit_grad 0.03% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000050s : 1: py_interpret_to_execute 0.06% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000012s : 1: remove_dup_value 1.78% : 0.000415s : 1: renormalize.infer 1.74% : 0.000407s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000036s : 1: rewriter_after_opt_a 0.81% : 0.000189s : 1: rewriter_before_opt_a 0.32% : 0.000075s : 1: symbol_engine_optimizer 23.23% : 0.005425s : 1: type_inference TotalTime = 0.0164218, [30] [bootstrap]: 0.00030925 [type_inference]: 0.0049826 [event_method]: 2.082e-05 [auto_monad]: 7.112e-05 [graph_reusing]: 5.80002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 4.28e-05 [rewriter_before_opt_a]: 7.691e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.0073971, [2] [Cycle 1]: 0.00355582, [27] [switch_simplify]: 0.00169775 [loop_unroll]: 3.42e-05 [a_1]: 0.00059027 [with_stream_mark]: 2.386e-05 [recompute_prepare]: 7.21999e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 5.31002e-06 [renormalize]: 0.00085084 [add_forward_monad_depend]: 5.72999e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.799e-05 [cse]: 3.457e-05 [replace_applicator]: 1.403e-05 [Cycle 2]: 0.00032837, [27] [switch_simplify]: 6.11998e-06 [loop_unroll]: 5.04998e-06 [a_1]: 9.188e-05 [with_stream_mark]: 9.19e-06 [recompute_prepare]: 4.79e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 4.62e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.87e-06 [inline_without_move]: 5.21998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.075e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 1.195e-05 [rewriter_after_opt_a]: 4.09e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00178991 [jit_opt_b]: 5.758e-05, [1] [Cycle 1]: 4.857e-05, [2] [frontend_op_eliminate]: 1.914e-05 [inline_after_opt_a]: 1.764e-05 [cconv]: 3.402e-05 [loop_unroll]: 0.0004872 [jit_opt_after_cconv]: 0.00017101, [1] [Cycle 1]: 0.00016413, [11] [c_1]: 2.235e-05 [parameter_eliminate]: 5.04e-06 [updatestate_depend_eliminate]: 9.59999e-06 [updatestate_assign_eliminate]: 3.52002e-06 [updatestate_loads_eliminate]: 3.00998e-06 [cse]: 3.182e-05 [call_graph_tuple_transform]: 2.414e-05 [tuple_list_get_item_eliminator]: 5.60001e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 5.81003e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 6.14999e-06 [add_recomputation]: 5.619e-05 [cse_after_recomputation]: 2.271e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.141e-05 [auto_monad_reorder]: 1.651e-05 [get_jit_bprop_graph]: 2.38002e-06 [rewriter_after_jit_bprop_graph]: 7.80998e-06 [opt_after_jit_grad]: 0.00046444 [symbol_engine_optimizer]: 7.441e-05, [1] [Cycle 1]: 6.837e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.337e-05 [opt_reshape]: 5.85002e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 4.00003e-07 [validate]: 4.533e-05 Sums bootstrap : 0.000309s : 2.52% type_inference : 0.004983s : 40.53% event_method : 0.000021s : 0.17% auto_monad : 0.000071s : 0.58% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.35% rewriter_before_opt_a : 0.000077s : 0.63% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.001704s : 13.86% jit_opt_a.loop_unroll : 0.000039s : 0.32% jit_opt_a.a_1 : 0.000682s : 5.55% jit_opt_a.with_stream_mark : 0.000033s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000851s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.20% jit_opt_a.cse : 0.000045s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000041s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.001790s : 14.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.16% jit_opt_b.inline_after_opt_a : 0.000018s : 0.14% cconv : 0.000034s : 0.28% loop_unroll : 0.000487s : 3.96% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000056s : 0.46% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.06% opt_after_jit_grad : 0.000464s : 3.78% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.37% Time group info: ------[substitution.] 0.000257 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.81% : 0.000007s : 3: substitution.graph_param_transform 84.55% : 0.000217s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000006s : 2: substitution.replace_old_param 5.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004912 2 80.70% : 0.003964s : 1: type_inference.infer 19.30% : 0.000948s : 1: type_inference.specialize ------[replace.] 0.000075 6 65.79% : 0.000049s : 4: replace.inline 34.21% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.77% : 0.000215s : 4: match.inline 5.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000003s : 10: predicate.arithmetic_simplify 1.09% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.50% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000002s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.45% : 0.000001s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.83% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.09% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 11.47% : 0.000015s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000721 13 51.35% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.71% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.93% : 0.000295s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019881 72 0.30% : 0.000059s : 1: add_recomputation 0.38% : 0.000075s : 1: auto_monad 0.09% : 0.000019s : 1: auto_monad_reorder 1.66% : 0.000330s : 1: bootstrap 0.19% : 0.000037s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 37.22% : 0.007401s : 1: jit_opt_a 0.87% : 0.000174s : 1: jit_opt_after_cconv 0.31% : 0.000061s : 1: jit_opt_b 2.49% : 0.000495s : 1: loop_unroll 9.08% : 0.001805s : 1: mutable_eliminate 12.81% : 0.002547s : 26: opt.transform.jit_opt_a 0.27% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000030s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000021s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.38% : 0.000472s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000046s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 2.33% : 0.000463s : 1: renormalize.infer 1.91% : 0.000380s : 1: renormalize.specialize 0.05% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000044s : 1: rewriter_after_opt_a 0.40% : 0.000080s : 1: rewriter_before_opt_a 0.39% : 0.000077s : 1: symbol_engine_optimizer 25.15% : 0.005001s : 1: type_inference TotalTime = 0.137254, [30] [bootstrap]: 0.00024163 [type_inference]: 0.115854 [event_method]: 0.00045047 [auto_monad]: 0.00010912 [graph_reusing]: 7.06999e-06 [pre_auto_parallel]: 2.85002e-06 [py_interpret_to_execute]: 8.381e-05 [rewriter_before_opt_a]: 0.00011972 [expand_dump_flag]: 3.57997e-06 [jit_opt_a]: 0.018268, [2] [Cycle 1]: 0.0142176, [27] [switch_simplify]: 7.41e-05 [loop_unroll]: 4.049e-05 [a_1]: 0.00091141 [with_stream_mark]: 3.347e-05 [recompute_prepare]: 1.945e-05 [updatestate_depend_eliminate]: 9.83002e-06 [updatestate_assign_eliminate]: 7.11001e-06 [updatestate_loads_eliminate]: 7.41001e-06 [parameter_eliminate]: 3.40998e-06 [specialize_transform]: 1.49e-05 [updatestate_useless_node_eliminater]: 1.387e-05 [accelerated_algorithm]: 1.394e-05 [meta_shard_fg_expand]: 3.78001e-06 [get_grad_eliminate_]: 1.349e-05 [merge_forward]: 9.22001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.773e-05 [j_node_and_user_rematch]: 2.477e-05 [meta_fg_expand]: 0.00186505 [replace_old_param]: 7.177e-05 [inline_without_move]: 6.089e-05 [renormalize]: 0.0106715 [add_forward_monad_depend]: 8.1e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.451e-05 [cse]: 2.983e-05 [replace_applicator]: 2.059e-05 [Cycle 2]: 0.00034279, [27] [switch_simplify]: 4.89e-06 [loop_unroll]: 4.06001e-06 [a_1]: 4.831e-05 [with_stream_mark]: 1.128e-05 [recompute_prepare]: 3.51001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 3.55e-06 [updatestate_useless_node_eliminater]: 3.97e-06 [accelerated_algorithm]: 3.68999e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 3.34001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 3.54002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.454e-05 [j_node_and_user_rematch]: 6.52001e-06 [meta_fg_expand]: 6.473e-05 [replace_old_param]: 4.4e-06 [inline_without_move]: 3.19001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 4.18999e-06 [cse]: 1.026e-05 [replace_applicator]: 3.43999e-06 [py_interpret_to_execute_after_opt_a]: 1.08e-05 [rewriter_after_opt_a]: 3.447e-05 [convert_after_rewriter]: 5.57999e-06 [order_py_execute_after_rewriter]: 4.08001e-06 [mutable_eliminate]: 0.0006416 [jit_opt_b]: 4.153e-05, [1] [Cycle 1]: 3.389e-05, [2] [frontend_op_eliminate]: 1.082e-05 [inline_after_opt_a]: 1.139e-05 [cconv]: 2.347e-05 [loop_unroll]: 0.00041089 [jit_opt_after_cconv]: 0.00012257, [1] [Cycle 1]: 0.00011614, [11] [c_1]: 1.229e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 1.77999e-06 [updatestate_loads_eliminate]: 1.51002e-06 [cse]: 1.588e-05 [call_graph_tuple_transform]: 1.38e-05 [tuple_list_get_item_eliminator]: 3.82002e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 3.83999e-06 [remove_dup_value]: 1.402e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.39e-06 [add_recomputation]: 3.499e-05 [cse_after_recomputation]: 1.887e-05, [1] [Cycle 1]: 1.363e-05, [1] [cse]: 7.61999e-06 [auto_monad_reorder]: 1.26e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 5.06997e-06 [opt_after_jit_grad]: 0.00042618 [symbol_engine_optimizer]: 6.628e-05, [1] [Cycle 1]: 6.007e-05, [6] [build]: 3.50998e-06 [elim_shapecalc]: 5.66e-06 [elim_not_effective]: 9.97999e-06 [opt_reshape]: 4.38999e-06 [fold_const_symbol]: 6.11e-06 [renormalize]: 5.50004e-07 [validate]: 3.052e-05 Sums bootstrap : 0.000242s : 0.18% type_inference : 0.115854s : 87.21% event_method : 0.000450s : 0.34% auto_monad : 0.000109s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000084s : 0.06% rewriter_before_opt_a : 0.000120s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.000960s : 0.72% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000023s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.01% jit_opt_a.accelerated_algorithm : 0.000018s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000013s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000031s : 0.02% jit_opt_a.meta_fg_expand : 0.001930s : 1.45% jit_opt_a.replace_old_param : 0.000076s : 0.06% jit_opt_a.inline_without_move : 0.000064s : 0.05% jit_opt_a.renormalize : 0.010672s : 8.03% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.01% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000642s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000411s : 0.31% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000426s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000031s : 0.02% Time group info: ------[substitution.] 0.000280 55 0.56% : 0.000002s : 1: substitution.elim_not_effective 0.33% : 0.000001s : 1: substitution.fold_const_symbol 1.47% : 0.000004s : 1: substitution.graph_param_transform 66.72% : 0.000187s : 6: substitution.inline 6.50% : 0.000018s : 2: substitution.inline_without_move 2.73% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.30% : 0.000004s : 2: substitution.minmaximum_grad 1.44% : 0.000004s : 3: substitution.partial_eliminate 2.68% : 0.000008s : 9: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_applicator 2.25% : 0.000006s : 10: substitution.replace_old_param 0.86% : 0.000002s : 1: substitution.set_cell_output_no_recompute 2.96% : 0.000008s : 2: substitution.tuple_list_convert_item_index_to_positive 1.87% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 6.16% : 0.000017s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115751 2 97.43% : 0.112781s : 1: type_inference.infer 2.57% : 0.002971s : 1: type_inference.specialize ------[replace.] 0.000074 8 75.62% : 0.000056s : 6: replace.inline 24.38% : 0.000018s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 8 93.76% : 0.000184s : 6: match.inline 6.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000179 1178 1.39% : 0.000003s : 19: predicate.accumulaten_eliminater 0.47% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 19: predicate.addn_check_dump 1.43% : 0.000003s : 19: predicate.addn_zero_filter 2.09% : 0.000004s : 19: predicate.arithmetic_simplify 1.39% : 0.000002s : 19: predicate.cast_eliminate 0.18% : 0.000000s : 1: predicate.check_bprop_eliminate 1.22% : 0.000002s : 19: predicate.compare_switch_simplify 1.31% : 0.000002s : 19: predicate.depend_value_elim 1.28% : 0.000002s : 19: predicate.dict_get_item_const_eliminator 1.43% : 0.000003s : 19: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 19: predicate.dict_set_item_eliminator 0.45% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.13% : 0.000000s : 1: predicate.elim_not_effective 0.18% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000003s : 19: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 19: predicate.environ_get_add_eliminate 1.24% : 0.000002s : 19: predicate.environ_get_depend_swap 1.51% : 0.000003s : 19: predicate.environ_get_eliminate 1.29% : 0.000002s : 19: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.26% : 0.000002s : 13: predicate.get_grad_eliminate 0.11% : 0.000000s : 1: predicate.graph_param_transform 4.65% : 0.000008s : 29: predicate.inline 3.73% : 0.000007s : 41: predicate.inline_without_move 0.55% : 0.000001s : 13: predicate.j_node_and_user_rematch 1.55% : 0.000003s : 13: predicate.less_batch_normalization 1.80% : 0.000003s : 21: predicate.list_to_tuple_eliminator_ 1.61% : 0.000003s : 22: predicate.load_eliminater 0.90% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.49% : 0.000006s : 45: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 20: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 19: predicate.merge_addn 1.32% : 0.000002s : 19: predicate.minmaximum_grad 0.72% : 0.000001s : 1: predicate.mutable_eliminate 0.21% : 0.000000s : 1: predicate.opt_reshape 2.08% : 0.000004s : 22: predicate.partial_eliminate 1.51% : 0.000003s : 19: predicate.print_const_string_wrapper 1.87% : 0.000003s : 19: predicate.reduce_eliminate 1.54% : 0.000003s : 21: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 13: predicate.remove_not_recompute_node 1.96% : 0.000004s : 23: predicate.replace_applicator 2.11% : 0.000004s : 41: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.34% : 0.000002s : 19: predicate.reshape_eliminate 1.37% : 0.000002s : 19: predicate.row_tensor_add_zeros_like 0.40% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000003s : 19: predicate.same_eliminate 0.66% : 0.000001s : 13: predicate.set_cell_output_no_recompute 0.30% : 0.000001s : 2: predicate.special_op_eliminate 1.25% : 0.000002s : 13: predicate.specialize_transform 1.56% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.13% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.57% : 0.000005s : 27: predicate.switch_defer_inline 2.21% : 0.000004s : 27: predicate.switch_layer_defer_inline 6.70% : 0.000012s : 73: predicate.switch_simplify 1.50% : 0.000003s : 19: predicate.tile_eliminate 1.39% : 0.000002s : 19: predicate.transpose_eliminate 1.71% : 0.000003s : 19: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000003s : 19: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 19: predicate.tuple_list_set_item_eliminator 1.55% : 0.000003s : 21: predicate.tuple_to_list_eliminator_ 1.56% : 0.000003s : 22: predicate.updatestate_pure_node_eliminater 2.82% : 0.000005s : 35: predicate.updatestate_useless_node_eliminater 1.71% : 0.000003s : 19: predicate.value_based_eliminate 0.11% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.37% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003103 36 88.54% : 0.002748s : 27: func_graph_cloner_run.FuncGraphClonerGraph 11.46% : 0.000356s : 9: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149313 72 0.03% : 0.000037s : 1: add_recomputation 0.08% : 0.000116s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.18% : 0.000269s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.31% : 0.000460s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 12.24% : 0.018272s : 1: jit_opt_a 0.08% : 0.000125s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.28% : 0.000419s : 1: loop_unroll 0.44% : 0.000651s : 1: mutable_eliminate 0.92% : 0.001379s : 26: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000434s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000087s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 6.80% : 0.010153s : 1: renormalize.infer 0.34% : 0.000505s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000123s : 1: rewriter_before_opt_a 0.05% : 0.000069s : 1: symbol_engine_optimizer 77.61% : 0.115880s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.215.744 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006ff70> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.216.406 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0449477, [30] [bootstrap]: 0.00029148 [type_inference]: 0.0272828 [event_method]: 2.38e-05 [auto_monad]: 7.027e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00244492 [rewriter_before_opt_a]: 0.00011113 [expand_dump_flag]: 4.4e-06 [jit_opt_a]: 0.00611832, [2] [Cycle 1]: 0.00219452, [27] [switch_simplify]: 6.236e-05 [loop_unroll]: 2.927e-05 [a_1]: 0.00058588 [with_stream_mark]: 2.458e-05 [recompute_prepare]: 8.09002e-06 [updatestate_depend_eliminate]: 4.34002e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.90002e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.36998e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00113607 [add_forward_monad_depend]: 6.40002e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.679e-05 [cse]: 3.538e-05 [replace_applicator]: 1.486e-05 [Cycle 2]: 0.00033379, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.37001e-06 [a_1]: 9.425e-05 [with_stream_mark]: 1.089e-05 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 5.46998e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.78002e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.86997e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.342e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.80002e-06 [cse]: 1.347e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 4.005e-05 [convert_after_rewriter]: 7.02997e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00090413 [jit_opt_b]: 5.306e-05, [1] [Cycle 1]: 4.563e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.686e-05 [cconv]: 3.048e-05 [loop_unroll]: 0.00041381 [jit_opt_after_cconv]: 0.00014633, [1] [Cycle 1]: 0.00014019, [11] [c_1]: 2.029e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.422e-05 [call_graph_tuple_transform]: 1.977e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 0.00563742 [partial_unused_args_eliminate]: 7.04001e-06 [environ_conv]: 1.029e-05 [add_recomputation]: 6.313e-05 [cse_after_recomputation]: 6.345e-05, [1] [Cycle 1]: 5.156e-05, [1] [cse]: 3.118e-05 [auto_monad_reorder]: 2.036e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 8.89e-06 [opt_after_jit_grad]: 0.0007473 [symbol_engine_optimizer]: 8.341e-05, [1] [Cycle 1]: 7.509e-05, [6] [build]: 4.76002e-06 [elim_shapecalc]: 8.52998e-06 [elim_not_effective]: 1.757e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 7.39994e-07 [validate]: 4.081e-05 Sums bootstrap : 0.000291s : 0.72% type_inference : 0.027283s : 67.16% event_method : 0.000024s : 0.06% auto_monad : 0.000070s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.002445s : 6.02% rewriter_before_opt_a : 0.000111s : 0.27% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.17% jit_opt_a.loop_unroll : 0.000035s : 0.09% jit_opt_a.a_1 : 0.000680s : 1.67% jit_opt_a.with_stream_mark : 0.000035s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001136s : 2.80% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000049s : 0.12% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000040s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000904s : 2.23% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000030s : 0.08% loop_unroll : 0.000414s : 1.02% jit_opt_after_cconv.c_1 : 0.000020s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.005637s : 13.88% partial_unused_args_eliminate : 0.000007s : 0.02% environ_conv : 0.000010s : 0.03% add_recomputation : 0.000063s : 0.16% cse_after_recomputation.cse : 0.000031s : 0.08% auto_monad_reorder : 0.000020s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000747s : 1.84% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.10% Time group info: ------[substitution.] 0.000247 23 1.09% : 0.000003s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.50% : 0.000006s : 3: substitution.graph_param_transform 85.08% : 0.000210s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 5.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027201 2 94.08% : 0.025589s : 1: type_inference.infer 5.92% : 0.001611s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.39% : 0.000053s : 4: replace.inline 30.61% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.82% : 0.000208s : 4: match.inline 5.18% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.40% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.88% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.00% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000001s : 10: predicate.minmaximum_grad 2.00% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 2.20% : 0.000003s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.49% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000886 13 45.15% : 0.000400s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.17% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.69% : 0.000432s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047048 72 0.14% : 0.000067s : 1: add_recomputation 0.16% : 0.000074s : 1: auto_monad 0.14% : 0.000065s : 1: auto_monad_reorder 0.66% : 0.000312s : 1: bootstrap 0.07% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000065s : 1: cse_after_recomputation 0.03% : 0.000013s : 1: environ_conv 0.06% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 13.01% : 0.006122s : 1: jit_opt_a 0.32% : 0.000149s : 1: jit_opt_after_cconv 0.12% : 0.000056s : 1: jit_opt_b 0.90% : 0.000421s : 1: loop_unroll 1.94% : 0.000915s : 1: mutable_eliminate 1.93% : 0.000906s : 26: opt.transform.jit_opt_a 0.10% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000039s : 4: opt.transform.symbol_engine_opt 1.61% : 0.000757s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000012s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 5.24% : 0.002464s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 12.04% : 0.005666s : 1: remove_dup_value 1.33% : 0.000627s : 1: renormalize.infer 1.06% : 0.000500s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000117s : 1: rewriter_before_opt_a 0.18% : 0.000086s : 1: symbol_engine_optimizer 58.04% : 0.027307s : 1: type_inference TotalTime = 0.0325722, [30] [bootstrap]: 0.00032841 [type_inference]: 0.0232166 [event_method]: 1.965e-05 [auto_monad]: 4.927e-05 [graph_reusing]: 3.66999e-06 [pre_auto_parallel]: 1.62001e-06 [py_interpret_to_execute]: 0.00014538 [rewriter_before_opt_a]: 7.876e-05 [expand_dump_flag]: 2.64001e-06 [jit_opt_a]: 0.00600023, [2] [Cycle 1]: 0.00199168, [27] [switch_simplify]: 5.154e-05 [loop_unroll]: 3.138e-05 [a_1]: 0.00053192 [with_stream_mark]: 1.456e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 8.58001e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00105743 [add_forward_monad_depend]: 5.12e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 1.063e-05 [cse]: 2.096e-05 [replace_applicator]: 1.282e-05 [Cycle 2]: 0.00032527, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.70001e-06 [a_1]: 9.235e-05 [with_stream_mark]: 8.94998e-06 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 4.99998e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 2.35002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.18e-05 [j_node_and_user_rematch]: 7.70998e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 4.89003e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.376e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.139e-05 [rewriter_after_opt_a]: 3.855e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00103324 [jit_opt_b]: 5.521e-05, [1] [Cycle 1]: 4.67e-05, [2] [frontend_op_eliminate]: 1.824e-05 [inline_after_opt_a]: 1.725e-05 [cconv]: 2.608e-05 [loop_unroll]: 0.000485 [jit_opt_after_cconv]: 0.00015101, [1] [Cycle 1]: 0.00014504, [11] [c_1]: 2.173e-05 [parameter_eliminate]: 3.50998e-06 [updatestate_depend_eliminate]: 6.28e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 2.329e-05 [call_graph_tuple_transform]: 2.165e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.607e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.202e-05 [cse_after_recomputation]: 2.257e-05, [1] [Cycle 1]: 1.707e-05, [1] [cse]: 1.142e-05 [auto_monad_reorder]: 1.752e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.91998e-06 [opt_after_jit_grad]: 0.00048949 [symbol_engine_optimizer]: 7.573e-05, [1] [Cycle 1]: 6.947e-05, [6] [build]: 4.57e-06 [elim_shapecalc]: 7.35998e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 6.74001e-06 [fold_const_symbol]: 9.97999e-06 [renormalize]: 3.39991e-07 [validate]: 4.521e-05 Sums bootstrap : 0.000328s : 1.16% type_inference : 0.023217s : 81.99% event_method : 0.000020s : 0.07% auto_monad : 0.000049s : 0.17% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000145s : 0.51% rewriter_before_opt_a : 0.000079s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.20% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000624s : 2.20% jit_opt_a.with_stream_mark : 0.000024s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001057s : 3.73% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.06% jit_opt_a.cse : 0.000035s : 0.12% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001033s : 3.65% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000026s : 0.09% loop_unroll : 0.000485s : 1.71% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000489s : 1.73% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000197 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 1.42% : 0.000003s : 2: substitution.fold_const_symbol 2.97% : 0.000006s : 3: substitution.graph_param_transform 84.77% : 0.000167s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000003s : 2: substitution.replace_old_param 4.32% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023139 2 92.19% : 0.021332s : 1: type_inference.infer 7.81% : 0.001806s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.29% : 0.000048s : 4: replace.inline 32.71% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 95.76% : 0.000165s : 4: match.inline 4.24% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.24% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.60% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.96% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.39% : 0.000002s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.64% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.15% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.85% : 0.000008s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000968 13 44.20% : 0.000428s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.15% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.64% : 0.000490s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034526 72 0.16% : 0.000055s : 1: add_recomputation 0.15% : 0.000052s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.00% : 0.000344s : 1: bootstrap 0.08% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000006s : 1: graph_reusing 17.39% : 0.006004s : 1: jit_opt_a 0.44% : 0.000154s : 1: jit_opt_after_cconv 0.17% : 0.000058s : 1: jit_opt_b 1.43% : 0.000493s : 1: loop_unroll 3.02% : 0.001044s : 1: mutable_eliminate 2.43% : 0.000839s : 26: opt.transform.jit_opt_a 0.15% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000497s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.43% : 0.000149s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.69% : 0.000584s : 1: renormalize.infer 1.35% : 0.000465s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000041s : 1: rewriter_after_opt_a 0.24% : 0.000083s : 1: rewriter_before_opt_a 0.23% : 0.000078s : 1: symbol_engine_optimizer 67.29% : 0.023232s : 1: type_inference TotalTime = 0.0677072, [30] [bootstrap]: 0.00024288 [type_inference]: 0.0479637 [event_method]: 0.00024987 [auto_monad]: 0.00011198 [graph_reusing]: 7.43999e-06 [pre_auto_parallel]: 3.91001e-06 [py_interpret_to_execute]: 5.253e-05 [rewriter_before_opt_a]: 0.00012139 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.0164818, [2] [Cycle 1]: 0.0123699, [27] [switch_simplify]: 7.736e-05 [loop_unroll]: 4.663e-05 [a_1]: 0.00098594 [with_stream_mark]: 3.829e-05 [recompute_prepare]: 2.688e-05 [updatestate_depend_eliminate]: 9.53002e-06 [updatestate_assign_eliminate]: 7.58999e-06 [updatestate_loads_eliminate]: 6.88e-06 [parameter_eliminate]: 2.73e-06 [specialize_transform]: 1.649e-05 [updatestate_useless_node_eliminater]: 1.43e-05 [accelerated_algorithm]: 1.401e-05 [meta_shard_fg_expand]: 3.46999e-06 [get_grad_eliminate_]: 1.4e-05 [merge_forward]: 9.87001e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.271e-05 [j_node_and_user_rematch]: 2.689e-05 [meta_fg_expand]: 0.00206297 [replace_old_param]: 8.379e-05 [inline_without_move]: 6.693e-05 [renormalize]: 0.00844307 [add_forward_monad_depend]: 1.05e-05 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.721e-05 [cse]: 3.016e-05 [replace_applicator]: 2.373e-05 [Cycle 2]: 0.00038292, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 4.32e-06 [a_1]: 4.697e-05 [with_stream_mark]: 1.606e-05 [recompute_prepare]: 4.60001e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 3.66001e-06 [updatestate_useless_node_eliminater]: 3.52002e-06 [accelerated_algorithm]: 3.59002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 3.12002e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 3.01001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.65e-05 [j_node_and_user_rematch]: 7.05998e-06 [meta_fg_expand]: 6.656e-05 [replace_old_param]: 5.82001e-06 [inline_without_move]: 3.21001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.78e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 6.83e-06 [cse]: 1.553e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.585e-05 [rewriter_after_opt_a]: 4.143e-05 [convert_after_rewriter]: 6.38e-06 [order_py_execute_after_rewriter]: 4.59002e-06 [mutable_eliminate]: 0.00075061 [jit_opt_b]: 4.673e-05, [1] [Cycle 1]: 3.732e-05, [2] [frontend_op_eliminate]: 1.168e-05 [inline_after_opt_a]: 1.272e-05 [cconv]: 3.172e-05 [loop_unroll]: 0.00050157 [jit_opt_after_cconv]: 0.00013749, [1] [Cycle 1]: 0.00012978, [11] [c_1]: 1.207e-05 [parameter_eliminate]: 4.06001e-06 [updatestate_depend_eliminate]: 7.12002e-06 [updatestate_assign_eliminate]: 1.89e-06 [updatestate_loads_eliminate]: 1.72001e-06 [cse]: 2.302e-05 [call_graph_tuple_transform]: 1.668e-05 [tuple_list_get_item_eliminator]: 4.03999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 3.75e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 2.88003e-06 [environ_conv]: 6.31998e-06 [add_recomputation]: 4.155e-05 [cse_after_recomputation]: 2.245e-05, [1] [Cycle 1]: 1.583e-05, [1] [cse]: 8.18001e-06 [auto_monad_reorder]: 1.425e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 7.25e-06 [opt_after_jit_grad]: 0.0004919 [symbol_engine_optimizer]: 6.911e-05, [1] [Cycle 1]: 6.274e-05, [6] [build]: 4.80001e-06 [elim_shapecalc]: 5.81e-06 [elim_not_effective]: 1.158e-05 [opt_reshape]: 4.18001e-06 [fold_const_symbol]: 6.09999e-06 [renormalize]: 6.39993e-07 [validate]: 3.53e-05 Sums bootstrap : 0.000243s : 0.38% type_inference : 0.047964s : 75.91% event_method : 0.000250s : 0.40% auto_monad : 0.000112s : 0.18% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000053s : 0.08% rewriter_before_opt_a : 0.000121s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000083s : 0.13% jit_opt_a.loop_unroll : 0.000051s : 0.08% jit_opt_a.a_1 : 0.001033s : 1.63% jit_opt_a.with_stream_mark : 0.000054s : 0.09% jit_opt_a.recompute_prepare : 0.000031s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000013s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000009s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000020s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000018s : 0.03% jit_opt_a.accelerated_algorithm : 0.000018s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.03% jit_opt_a.merge_forward : 0.000014s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000049s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000034s : 0.05% jit_opt_a.meta_fg_expand : 0.002130s : 3.37% jit_opt_a.replace_old_param : 0.000090s : 0.14% jit_opt_a.inline_without_move : 0.000070s : 0.11% jit_opt_a.renormalize : 0.008443s : 13.36% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000046s : 0.07% jit_opt_a.replace_applicator : 0.000030s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000751s : 1.19% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.02% jit_opt_b.inline_after_opt_a : 0.000013s : 0.02% cconv : 0.000032s : 0.05% loop_unroll : 0.000502s : 0.79% jit_opt_after_cconv.c_1 : 0.000012s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000042s : 0.07% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000492s : 0.78% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000302 55 0.50% : 0.000002s : 1: substitution.elim_not_effective 0.33% : 0.000001s : 1: substitution.fold_const_symbol 1.43% : 0.000004s : 1: substitution.graph_param_transform 66.04% : 0.000200s : 6: substitution.inline 7.38% : 0.000022s : 2: substitution.inline_without_move 2.73% : 0.000008s : 9: substitution.j_node_and_user_rematch 1.23% : 0.000004s : 2: substitution.minmaximum_grad 1.46% : 0.000004s : 3: substitution.partial_eliminate 2.73% : 0.000008s : 9: substitution.remove_not_recompute_node 1.92% : 0.000006s : 2: substitution.replace_applicator 2.70% : 0.000008s : 10: substitution.replace_old_param 1.10% : 0.000003s : 1: substitution.set_cell_output_no_recompute 2.82% : 0.000009s : 2: substitution.tuple_list_convert_item_index_to_positive 1.77% : 0.000005s : 2: substitution.tuple_list_get_item_depend_reorder 5.86% : 0.000018s : 4: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047856 2 95.35% : 0.045629s : 1: type_inference.infer 4.65% : 0.002227s : 1: type_inference.specialize ------[replace.] 0.000075 8 77.50% : 0.000058s : 6: replace.inline 22.50% : 0.000017s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 8 94.12% : 0.000196s : 6: match.inline 5.88% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000199 1285 1.65% : 0.000003s : 21: predicate.accumulaten_eliminater 0.60% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.26% : 0.000003s : 21: predicate.addn_check_dump 1.51% : 0.000003s : 21: predicate.addn_zero_filter 2.04% : 0.000004s : 21: predicate.arithmetic_simplify 1.47% : 0.000003s : 21: predicate.cast_eliminate 0.17% : 0.000000s : 1: predicate.check_bprop_eliminate 1.24% : 0.000002s : 21: predicate.compare_switch_simplify 1.54% : 0.000003s : 21: predicate.depend_value_elim 1.28% : 0.000003s : 21: predicate.dict_get_item_const_eliminator 1.31% : 0.000003s : 21: predicate.dict_get_item_eliminator 1.34% : 0.000003s : 21: predicate.dict_set_item_eliminator 0.48% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 1: predicate.elim_not_effective 0.27% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000003s : 21: predicate.environ_add_const_eliminate 1.30% : 0.000003s : 21: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 21: predicate.environ_get_depend_swap 1.42% : 0.000003s : 21: predicate.environ_get_eliminate 1.22% : 0.000002s : 21: predicate.environ_get_set_eliminate 0.05% : 0.000000s : 1: predicate.fold_const_symbol 1.17% : 0.000002s : 14: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.60% : 0.000009s : 31: predicate.inline 3.51% : 0.000007s : 42: predicate.inline_without_move 0.52% : 0.000001s : 14: predicate.j_node_and_user_rematch 1.31% : 0.000003s : 14: predicate.less_batch_normalization 1.59% : 0.000003s : 23: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 24: predicate.load_eliminater 0.67% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.59% : 0.000007s : 50: predicate.loop_unroll_before_grad 1.88% : 0.000004s : 22: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 21: predicate.merge_addn 1.27% : 0.000003s : 21: predicate.minmaximum_grad 1.25% : 0.000002s : 1: predicate.mutable_eliminate 0.15% : 0.000000s : 1: predicate.opt_reshape 2.07% : 0.000004s : 24: predicate.partial_eliminate 1.35% : 0.000003s : 21: predicate.print_const_string_wrapper 1.99% : 0.000004s : 21: predicate.reduce_eliminate 1.78% : 0.000004s : 23: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000002s : 14: predicate.remove_not_recompute_node 1.68% : 0.000003s : 25: predicate.replace_applicator 2.17% : 0.000004s : 42: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.38% : 0.000003s : 21: predicate.reshape_eliminate 1.39% : 0.000003s : 21: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 1: predicate.row_tensor_eliminate 1.32% : 0.000003s : 21: predicate.same_eliminate 0.72% : 0.000001s : 14: predicate.set_cell_output_no_recompute 0.54% : 0.000001s : 2: predicate.special_op_eliminate 1.19% : 0.000002s : 14: predicate.specialize_transform 1.55% : 0.000003s : 21: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000003s : 21: predicate.stack_unstack_eliminate 0.12% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.40% : 0.000005s : 29: predicate.switch_defer_inline 2.24% : 0.000004s : 29: predicate.switch_layer_defer_inline 6.85% : 0.000014s : 80: predicate.switch_simplify 1.36% : 0.000003s : 21: predicate.tile_eliminate 1.30% : 0.000003s : 21: predicate.transpose_eliminate 1.55% : 0.000003s : 21: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000003s : 21: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000007s : 25: predicate.tuple_list_get_item_eliminator 1.90% : 0.000004s : 21: predicate.tuple_list_set_item_eliminator 1.53% : 0.000003s : 23: predicate.tuple_to_list_eliminator_ 1.49% : 0.000003s : 24: predicate.updatestate_pure_node_eliminater 2.90% : 0.000006s : 38: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 21: predicate.value_based_eliminate 0.08% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.25% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002585 31 84.28% : 0.002179s : 22: func_graph_cloner_run.FuncGraphClonerGraph 15.72% : 0.000406s : 9: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077671 72 0.06% : 0.000045s : 1: add_recomputation 0.15% : 0.000119s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.34% : 0.000265s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.33% : 0.000259s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 21.22% : 0.016485s : 1: jit_opt_a 0.18% : 0.000140s : 1: jit_opt_after_cconv 0.06% : 0.000050s : 1: jit_opt_b 0.66% : 0.000514s : 1: loop_unroll 0.99% : 0.000767s : 1: mutable_eliminate 1.94% : 0.001504s : 26: opt.transform.jit_opt_a 0.04% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000017s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000503s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.07% : 0.000057s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 10.10% : 0.007846s : 1: renormalize.infer 0.75% : 0.000582s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.16% : 0.000125s : 1: rewriter_before_opt_a 0.09% : 0.000072s : 1: symbol_engine_optimizer 61.79% : 0.047993s : 1: type_inference TotalTime = 0.0740727, [30] [bootstrap]: 0.00028712 [type_inference]: 0.0595198 [event_method]: 2.034e-05 [auto_monad]: 5.02e-05 [graph_reusing]: 3.99002e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 7.462e-05 [rewriter_before_opt_a]: 9.338e-05 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.0112744, [2] [Cycle 1]: 0.00469401, [27] [switch_simplify]: 5.963e-05 [loop_unroll]: 3.464e-05 [a_1]: 0.00291585 [with_stream_mark]: 2.061e-05 [recompute_prepare]: 1.737e-05 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 8.13001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 7.26001e-06 [meta_shard_fg_expand]: 4.36002e-06 [get_grad_eliminate_]: 6.98e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 3.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 3.26999e-06 [replace_old_param]: 1.08e-05 [inline_without_move]: 6.43e-06 [renormalize]: 0.00125403 [add_forward_monad_depend]: 6.24999e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 3.229e-05 [cse]: 3.155e-05 [replace_applicator]: 1.889e-05 [Cycle 2]: 0.00039872, [27] [switch_simplify]: 2.257e-05 [loop_unroll]: 6.38e-06 [a_1]: 0.0001055 [with_stream_mark]: 1.109e-05 [recompute_prepare]: 6.00002e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 3.46999e-06 [cell_reuse_recompute_pass]: 2.19999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.809e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 1.17999e-06 [auto_monad_eliminator]: 6.86999e-06 [cse]: 1.867e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.435e-05 [rewriter_after_opt_a]: 3.882e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00080197 [jit_opt_b]: 5.544e-05, [1] [Cycle 1]: 4.832e-05, [2] [frontend_op_eliminate]: 1.959e-05 [inline_after_opt_a]: 1.665e-05 [cconv]: 2.956e-05 [loop_unroll]: 0.00048209 [jit_opt_after_cconv]: 0.00019411, [1] [Cycle 1]: 0.00015735, [11] [c_1]: 2.446e-05 [parameter_eliminate]: 3.97e-06 [updatestate_depend_eliminate]: 6.26998e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 3.027e-05 [call_graph_tuple_transform]: 2.047e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 4.297e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 6.59999e-06 [add_recomputation]: 4.972e-05 [cse_after_recomputation]: 2.853e-05, [1] [Cycle 1]: 2.207e-05, [1] [cse]: 1.484e-05 [auto_monad_reorder]: 1.731e-05 [get_jit_bprop_graph]: 1.88002e-06 [rewriter_after_jit_bprop_graph]: 6.79999e-06 [opt_after_jit_grad]: 0.00061175 [symbol_engine_optimizer]: 8.778e-05, [1] [Cycle 1]: 8.061e-05, [6] [build]: 3.98001e-06 [elim_shapecalc]: 9.74e-06 [elim_not_effective]: 1.652e-05 [opt_reshape]: 8.66997e-06 [fold_const_symbol]: 1.136e-05 [renormalize]: 7.00005e-07 [validate]: 7.182e-05 Sums bootstrap : 0.000287s : 0.43% type_inference : 0.059520s : 88.54% event_method : 0.000020s : 0.03% auto_monad : 0.000050s : 0.07% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000075s : 0.11% rewriter_before_opt_a : 0.000093s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000082s : 0.12% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.003021s : 4.49% jit_opt_a.with_stream_mark : 0.000032s : 0.05% jit_opt_a.recompute_prepare : 0.000023s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001254s : 1.87% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.06% jit_opt_a.cse : 0.000050s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000802s : 1.19% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000030s : 0.04% loop_unroll : 0.000482s : 0.72% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000043s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000612s : 0.91% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000072s : 0.11% Time group info: ------[substitution.] 0.000289 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 1.83% : 0.000005s : 3: substitution.graph_param_transform 85.11% : 0.000246s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 1.63% : 0.000005s : 2: substitution.replace_old_param 6.38% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.059449 2 97.78% : 0.058131s : 1: type_inference.infer 2.22% : 0.001317s : 1: type_inference.specialize ------[replace.] 0.000165 7 44.13% : 0.000073s : 5: replace.inline 55.87% : 0.000092s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 7 93.64% : 0.000243s : 5: match.inline 6.36% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 747 1.64% : 0.000003s : 11: predicate.accumulaten_eliminater 0.97% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 11: predicate.addn_check_dump 2.02% : 0.000003s : 11: predicate.addn_zero_filter 2.75% : 0.000004s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000002s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 0.92% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.89% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 11: predicate.environ_get_depend_swap 1.63% : 0.000003s : 11: predicate.environ_get_eliminate 0.89% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000002s : 6: predicate.get_grad_eliminate 0.17% : 0.000000s : 3: predicate.graph_param_transform 4.18% : 0.000007s : 24: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 2.18% : 0.000004s : 16: predicate.load_eliminater 1.07% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.54% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 11: predicate.merge_addn 1.46% : 0.000002s : 11: predicate.minmaximum_grad 1.22% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 1.68% : 0.000003s : 16: predicate.partial_eliminate 1.38% : 0.000002s : 11: predicate.print_const_string_wrapper 3.26% : 0.000005s : 11: predicate.reduce_eliminate 1.51% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.35% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000001s : 3: predicate.reset_defer_inline 1.56% : 0.000003s : 11: predicate.reshape_eliminate 1.50% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000002s : 6: predicate.special_op_eliminate 0.70% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.29% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.87% : 0.000006s : 18: predicate.switch_defer_inline 1.92% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.20% : 0.000010s : 59: predicate.switch_simplify 2.17% : 0.000003s : 11: predicate.tile_eliminate 1.51% : 0.000002s : 11: predicate.transpose_eliminate 1.68% : 0.000003s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.05% : 0.000005s : 22: predicate.updatestate_useless_node_eliminater 2.15% : 0.000003s : 11: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001082 16 45.39% : 0.000491s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.46% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 48.15% : 0.000521s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.078653 72 0.07% : 0.000053s : 1: add_recomputation 0.07% : 0.000054s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.39% : 0.000304s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 14.34% : 0.011280s : 1: jit_opt_a 0.25% : 0.000197s : 1: jit_opt_after_cconv 0.07% : 0.000058s : 1: jit_opt_b 0.62% : 0.000490s : 1: loop_unroll 1.03% : 0.000810s : 1: mutable_eliminate 4.19% : 0.003294s : 26: opt.transform.jit_opt_a 0.07% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000619s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000078s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000047s : 1: remove_dup_value 0.89% : 0.000702s : 1: renormalize.infer 0.69% : 0.000542s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000096s : 1: rewriter_before_opt_a 0.12% : 0.000091s : 1: symbol_engine_optimizer 75.69% : 0.059531s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.291.409 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00658b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.292.024 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0480465, [30] [bootstrap]: 0.00024554 [type_inference]: 0.0277961 [event_method]: 3.758e-05 [auto_monad]: 0.00014734 [graph_reusing]: 9.86e-06 [pre_auto_parallel]: 3.58e-06 [py_interpret_to_execute]: 4.747e-05 [rewriter_before_opt_a]: 0.00016266 [expand_dump_flag]: 4.89003e-06 [jit_opt_a]: 0.0169234, [3] [Cycle 1]: 0.00853187, [27] [switch_simplify]: 0.00019306 [loop_unroll]: 6.326e-05 [a_1]: 0.00130173 [with_stream_mark]: 3.467e-05 [recompute_prepare]: 2.413e-05 [updatestate_depend_eliminate]: 9.14e-06 [updatestate_assign_eliminate]: 7.27002e-06 [updatestate_loads_eliminate]: 6.54999e-06 [parameter_eliminate]: 3.16999e-06 [specialize_transform]: 1.404e-05 [updatestate_useless_node_eliminater]: 1.287e-05 [accelerated_algorithm]: 1.259e-05 [meta_shard_fg_expand]: 3.86999e-06 [get_grad_eliminate_]: 1.253e-05 [merge_forward]: 9.44998e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.013e-05 [j_node_and_user_rematch]: 2.407e-05 [meta_fg_expand]: 0.00194013 [replace_old_param]: 7.403e-05 [inline_without_move]: 6.176e-05 [renormalize]: 0.00397236 [add_forward_monad_depend]: 1.661e-05 [auto_monad_grad]: 6.81001e-06 [auto_monad_eliminator]: 6.696e-05 [cse]: 0.00022334 [replace_applicator]: 9.076e-05 [Cycle 2]: 0.00408426, [27] [switch_simplify]: 4.233e-05 [loop_unroll]: 3.92e-05 [a_1]: 0.00125034 [with_stream_mark]: 2.466e-05 [recompute_prepare]: 1.348e-05 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.38999e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 8.13999e-06 [updatestate_useless_node_eliminater]: 8.46002e-06 [accelerated_algorithm]: 7.36999e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 7.29001e-06 [merge_forward]: 5.40999e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.062e-05 [j_node_and_user_rematch]: 1.226e-05 [meta_fg_expand]: 0.0002896 [replace_old_param]: 1.771e-05 [inline_without_move]: 8.02e-06 [renormalize]: 0.00189159 [add_forward_monad_depend]: 1.124e-05 [auto_monad_grad]: 2.19999e-06 [auto_monad_eliminator]: 1.833e-05 [cse]: 7.667e-05 [replace_applicator]: 2.273e-05 [Cycle 3]: 0.0002939, [27] [switch_simplify]: 4.67998e-06 [loop_unroll]: 3.98001e-06 [a_1]: 3.923e-05 [with_stream_mark]: 1.604e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 1.92001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 3.31999e-06 [updatestate_useless_node_eliminater]: 3.21001e-06 [accelerated_algorithm]: 3.35e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 2.93998e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.761e-05 [j_node_and_user_rematch]: 5.78002e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 3.07002e-06 [inline_without_move]: 3.26999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 5.80002e-06 [cse]: 1.422e-05 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.719e-05 [rewriter_after_opt_a]: 4.284e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00079668 [jit_opt_b]: 4.836e-05, [1] [Cycle 1]: 3.804e-05, [2] [frontend_op_eliminate]: 1.132e-05 [inline_after_opt_a]: 1.297e-05 [cconv]: 3.222e-05 [loop_unroll]: 0.00054013 [jit_opt_after_cconv]: 0.00015526, [1] [Cycle 1]: 0.00014781, [11] [c_1]: 1.27e-05 [parameter_eliminate]: 5.67001e-06 [updatestate_depend_eliminate]: 8.27998e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 1.97001e-06 [cse]: 2.991e-05 [call_graph_tuple_transform]: 1.977e-05 [tuple_list_get_item_eliminator]: 4.18999e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 3.87998e-06 [remove_dup_value]: 1.65e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 6.06e-06 [add_recomputation]: 4.303e-05 [cse_after_recomputation]: 2.51e-05, [1] [Cycle 1]: 1.746e-05, [1] [cse]: 9.87999e-06 [auto_monad_reorder]: 1.354e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 7.88999e-06 [opt_after_jit_grad]: 0.00053373 [symbol_engine_optimizer]: 7.594e-05, [1] [Cycle 1]: 6.839e-05, [6] [build]: 5.34e-06 [elim_shapecalc]: 7.16999e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 3.90998e-06 [fold_const_symbol]: 6.31e-06 [renormalize]: 1.07e-06 [validate]: 6.486e-05 Sums bootstrap : 0.000246s : 0.57% type_inference : 0.027796s : 64.76% event_method : 0.000038s : 0.09% auto_monad : 0.000147s : 0.34% graph_reusing : 0.000010s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000047s : 0.11% rewriter_before_opt_a : 0.000163s : 0.38% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000240s : 0.56% jit_opt_a.loop_unroll : 0.000106s : 0.25% jit_opt_a.a_1 : 0.002591s : 6.04% jit_opt_a.with_stream_mark : 0.000075s : 0.18% jit_opt_a.recompute_prepare : 0.000043s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000025s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.06% jit_opt_a.accelerated_algorithm : 0.000023s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.05% jit_opt_a.merge_forward : 0.000019s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000068s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.10% jit_opt_a.meta_fg_expand : 0.002231s : 5.20% jit_opt_a.replace_old_param : 0.000095s : 0.22% jit_opt_a.inline_without_move : 0.000073s : 0.17% jit_opt_a.renormalize : 0.005864s : 13.66% jit_opt_a.add_forward_monad_depend : 0.000030s : 0.07% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000091s : 0.21% jit_opt_a.cse : 0.000314s : 0.73% jit_opt_a.replace_applicator : 0.000119s : 0.28% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000043s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000797s : 1.86% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.03% jit_opt_b.inline_after_opt_a : 0.000013s : 0.03% cconv : 0.000032s : 0.08% loop_unroll : 0.000540s : 1.26% jit_opt_after_cconv.c_1 : 0.000013s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000043s : 0.10% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000534s : 1.24% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000065s : 0.15% Time group info: ------[substitution.] 0.000761 112 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.65% : 0.000005s : 1: substitution.graph_param_transform 68.11% : 0.000518s : 19: substitution.inline 2.82% : 0.000021s : 2: substitution.inline_without_move 1.35% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.64% : 0.000012s : 7: substitution.minmaximum_grad 1.20% : 0.000009s : 5: substitution.partial_eliminate 1.69% : 0.000013s : 12: substitution.remove_not_recompute_node 4.62% : 0.000035s : 10: substitution.replace_applicator 0.90% : 0.000007s : 8: substitution.replace_old_param 1.00% : 0.000008s : 1: substitution.reshape_eliminate 0.39% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.47% : 0.000011s : 2: substitution.switch_simplify 0.84% : 0.000006s : 1: substitution.tile_eliminate 3.16% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.29% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.42% : 0.000056s : 15: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027593 2 90.72% : 0.025032s : 1: type_inference.infer 9.28% : 0.002561s : 1: type_inference.specialize ------[replace.] 0.000282 29 55.48% : 0.000156s : 19: replace.inline 19.27% : 0.000054s : 2: replace.switch_simplify 25.24% : 0.000071s : 8: replace.tuple_list_get_item_eliminator ------[match.] 0.000547 29 92.68% : 0.000507s : 19: match.inline 1.84% : 0.000010s : 2: match.switch_simplify 5.48% : 0.000030s : 8: match.tuple_list_get_item_eliminator ------[predicate.] 0.000419 2841 1.59% : 0.000007s : 49: predicate.accumulaten_eliminater 0.29% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000006s : 49: predicate.addn_check_dump 1.52% : 0.000006s : 49: predicate.addn_zero_filter 2.03% : 0.000008s : 49: predicate.arithmetic_simplify 1.59% : 0.000007s : 49: predicate.cast_eliminate 0.05% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000006s : 49: predicate.compare_switch_simplify 1.56% : 0.000007s : 49: predicate.depend_value_elim 1.49% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.49% : 0.000006s : 49: predicate.dict_get_item_eliminator 1.45% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.17% : 0.000001s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.65% : 0.000007s : 49: predicate.environ_add_const_eliminate 1.42% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.43% : 0.000006s : 49: predicate.environ_get_depend_swap 1.47% : 0.000006s : 49: predicate.environ_get_eliminate 1.43% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.68% : 0.000003s : 17: predicate.get_grad_eliminate 0.08% : 0.000000s : 1: predicate.graph_param_transform 4.92% : 0.000021s : 78: predicate.inline 1.86% : 0.000008s : 41: predicate.inline_without_move 0.29% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.84% : 0.000004s : 17: predicate.less_batch_normalization 2.01% : 0.000008s : 57: predicate.list_to_tuple_eliminator_ 1.82% : 0.000008s : 58: predicate.load_eliminater 0.40% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.86% : 0.000016s : 115: predicate.loop_unroll_before_grad 1.65% : 0.000007s : 50: predicate.make_slice_get_slice_eliminator 1.42% : 0.000006s : 49: predicate.merge_addn 1.47% : 0.000006s : 49: predicate.minmaximum_grad 0.56% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.33% : 0.000010s : 58: predicate.partial_eliminate 1.48% : 0.000006s : 49: predicate.print_const_string_wrapper 1.93% : 0.000008s : 49: predicate.reduce_eliminate 1.80% : 0.000008s : 57: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 17: predicate.remove_not_recompute_node 2.51% : 0.000011s : 100: predicate.replace_applicator 1.03% : 0.000004s : 41: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.52% : 0.000006s : 49: predicate.reshape_eliminate 1.51% : 0.000006s : 49: predicate.row_tensor_add_zeros_like 0.33% : 0.000001s : 1: predicate.row_tensor_eliminate 1.60% : 0.000007s : 49: predicate.same_eliminate 0.48% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.25% : 0.000001s : 2: predicate.special_op_eliminate 0.68% : 0.000003s : 17: predicate.specialize_transform 1.65% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.67% : 0.000007s : 49: predicate.stack_unstack_eliminate 0.10% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.90% : 0.000012s : 76: predicate.switch_defer_inline 2.62% : 0.000011s : 76: predicate.switch_layer_defer_inline 7.41% : 0.000031s : 196: predicate.switch_simplify 1.52% : 0.000006s : 49: predicate.tile_eliminate 1.47% : 0.000006s : 49: predicate.transpose_eliminate 1.79% : 0.000007s : 49: predicate.tuple_list_convert_item_index_to_positive 1.60% : 0.000007s : 49: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000015s : 59: predicate.tuple_list_get_item_eliminator 1.87% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.84% : 0.000008s : 57: predicate.tuple_to_list_eliminator_ 1.74% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.53% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.81% : 0.000008s : 49: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002981 40 63.72% : 0.001900s : 17: func_graph_cloner_run.FuncGraphClonerGraph 36.28% : 0.001082s : 23: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057309 87 0.08% : 0.000046s : 1: add_recomputation 0.27% : 0.000154s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.47% : 0.000271s : 1: bootstrap 0.06% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.08% : 0.000044s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 29.54% : 0.016928s : 1: jit_opt_a 0.28% : 0.000158s : 1: jit_opt_after_cconv 0.09% : 0.000051s : 1: jit_opt_b 0.97% : 0.000554s : 1: loop_unroll 1.42% : 0.000813s : 1: mutable_eliminate 5.96% : 0.003413s : 39: opt.transform.jit_opt_a 0.06% : 0.000037s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000017s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000028s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000547s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000050s : 1: py_interpret_to_execute 0.04% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 6.84% : 0.003922s : 2: renormalize.infer 3.35% : 0.001919s : 2: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000047s : 1: rewriter_after_opt_a 0.29% : 0.000168s : 1: rewriter_before_opt_a 0.14% : 0.000079s : 1: symbol_engine_optimizer 48.55% : 0.027824s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.347.098 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065820> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.347.917 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0482815, [30] [bootstrap]: 0.00039035 [type_inference]: 0.0380892 [event_method]: 2.13e-05 [auto_monad]: 7.031e-05 [graph_reusing]: 6.04999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00015026 [rewriter_before_opt_a]: 8.526e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.00685822, [2] [Cycle 1]: 0.00243277, [27] [switch_simplify]: 6.425e-05 [loop_unroll]: 3.039e-05 [a_1]: 0.00063963 [with_stream_mark]: 2.138e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.81998e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00129334 [add_forward_monad_depend]: 2.642e-05 [auto_monad_grad]: 2.75997e-06 [auto_monad_eliminator]: 1.862e-05 [cse]: 3.533e-05 [replace_applicator]: 1.85e-05 [Cycle 2]: 0.00034233, [27] [switch_simplify]: 5.92001e-06 [loop_unroll]: 5.60001e-06 [a_1]: 9.819e-05 [with_stream_mark]: 1.146e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.37999e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.83002e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 2.42001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.73997e-06 [cse]: 1.374e-05 [replace_applicator]: 5.59998e-06 [py_interpret_to_execute_after_opt_a]: 1.505e-05 [rewriter_after_opt_a]: 4.194e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00073722 [jit_opt_b]: 5.249e-05, [1] [Cycle 1]: 4.583e-05, [2] [frontend_op_eliminate]: 1.725e-05 [inline_after_opt_a]: 1.696e-05 [cconv]: 2.981e-05 [loop_unroll]: 0.00045583 [jit_opt_after_cconv]: 0.00022723, [1] [Cycle 1]: 0.00022082, [11] [c_1]: 2.16e-05 [parameter_eliminate]: 3.21999e-06 [updatestate_depend_eliminate]: 7.13998e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 8.859e-05 [call_graph_tuple_transform]: 2.412e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 7.38999e-06 [add_recomputation]: 5.519e-05 [cse_after_recomputation]: 2.508e-05, [1] [Cycle 1]: 1.981e-05, [1] [cse]: 1.371e-05 [auto_monad_reorder]: 1.672e-05 [get_jit_bprop_graph]: 3.03e-06 [rewriter_after_jit_bprop_graph]: 2.98e-05 [opt_after_jit_grad]: 0.00053331 [symbol_engine_optimizer]: 7.556e-05, [1] [Cycle 1]: 6.932e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.449e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 3.39991e-07 [validate]: 8.034e-05 Sums bootstrap : 0.000390s : 0.90% type_inference : 0.038089s : 87.39% event_method : 0.000021s : 0.05% auto_monad : 0.000070s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000150s : 0.34% rewriter_before_opt_a : 0.000085s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.16% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000738s : 1.69% jit_opt_a.with_stream_mark : 0.000033s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001293s : 2.97% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.06% jit_opt_a.cse : 0.000049s : 0.11% jit_opt_a.replace_applicator : 0.000024s : 0.06% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000042s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000737s : 1.69% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000030s : 0.07% loop_unroll : 0.000456s : 1.05% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000089s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.13% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000030s : 0.07% opt_after_jit_grad : 0.000533s : 1.22% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000080s : 0.18% Time group info: ------[substitution.] 0.000294 23 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 87.06% : 0.000256s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 1.49% : 0.000004s : 2: substitution.replace_old_param 4.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037992 2 95.24% : 0.036185s : 1: type_inference.infer 4.76% : 0.001807s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.54% : 0.000053s : 4: replace.inline 31.46% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 6 95.45% : 0.000253s : 4: match.inline 4.55% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.61% : 0.000002s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.95% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.60% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001052 13 43.58% : 0.000458s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.18% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.25% : 0.000539s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050582 72 0.11% : 0.000058s : 1: add_recomputation 0.15% : 0.000074s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.81% : 0.000408s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.57% : 0.006862s : 1: jit_opt_a 0.46% : 0.000230s : 1: jit_opt_after_cconv 0.11% : 0.000055s : 1: jit_opt_b 0.92% : 0.000463s : 1: loop_unroll 1.47% : 0.000746s : 1: mutable_eliminate 1.92% : 0.000973s : 26: opt.transform.jit_opt_a 0.11% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.08% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.07% : 0.000541s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000154s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.43% : 0.000726s : 1: renormalize.infer 1.10% : 0.000558s : 1: renormalize.specialize 0.06% : 0.000032s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.18% : 0.000089s : 1: rewriter_before_opt_a 0.15% : 0.000078s : 1: symbol_engine_optimizer 75.34% : 0.038109s : 1: type_inference TotalTime = 0.0335247, [30] [bootstrap]: 0.0002537 [type_inference]: 0.0104399 [event_method]: 4.325e-05 [auto_monad]: 0.00010115 [graph_reusing]: 7.5e-06 [pre_auto_parallel]: 3.04001e-06 [py_interpret_to_execute]: 2.835e-05 [rewriter_before_opt_a]: 0.00010941 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0198159, [3] [Cycle 1]: 0.0129786, [27] [switch_simplify]: 6.773e-05 [loop_unroll]: 4.097e-05 [a_1]: 0.00084444 [with_stream_mark]: 3.009e-05 [recompute_prepare]: 1.869e-05 [updatestate_depend_eliminate]: 9.24998e-06 [updatestate_assign_eliminate]: 7.30998e-06 [updatestate_loads_eliminate]: 6.89999e-06 [parameter_eliminate]: 3.21001e-06 [specialize_transform]: 1.383e-05 [updatestate_useless_node_eliminater]: 1.232e-05 [accelerated_algorithm]: 1.315e-05 [meta_shard_fg_expand]: 3.79002e-06 [get_grad_eliminate_]: 1.263e-05 [merge_forward]: 9.25999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.779e-05 [j_node_and_user_rematch]: 2.352e-05 [meta_fg_expand]: 0.0016433 [replace_old_param]: 6.515e-05 [inline_without_move]: 5.808e-05 [renormalize]: 0.00936856 [add_forward_monad_depend]: 1.756e-05 [auto_monad_grad]: 6.63998e-06 [auto_monad_eliminator]: 6.285e-05 [cse]: 0.00024979 [replace_applicator]: 9.803e-05 [Cycle 2]: 0.00331322, [27] [switch_simplify]: 4.12e-05 [loop_unroll]: 3.976e-05 [a_1]: 0.00114827 [with_stream_mark]: 1.886e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 7.009e-05 [replace_old_param]: 7.5e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00162736 [add_forward_monad_depend]: 9.93002e-06 [auto_monad_grad]: 3.18998e-06 [auto_monad_eliminator]: 1.639e-05 [cse]: 3.168e-05 [replace_applicator]: 2.016e-05 [Cycle 3]: 0.00030004, [27] [switch_simplify]: 5.02999e-06 [loop_unroll]: 3.68e-06 [a_1]: 4.929e-05 [with_stream_mark]: 1.412e-05 [recompute_prepare]: 3.99002e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 1.86998e-06 [updatestate_loads_eliminate]: 1.92001e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 4.22e-06 [updatestate_useless_node_eliminater]: 3.3e-06 [accelerated_algorithm]: 3.95e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 3.51999e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 3.14001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.642e-05 [j_node_and_user_rematch]: 6.86001e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 3.38999e-06 [inline_without_move]: 3.64002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 6.74999e-06 [cse]: 1.194e-05 [replace_applicator]: 4.36002e-06 [py_interpret_to_execute_after_opt_a]: 1.8e-05 [rewriter_after_opt_a]: 4.158e-05 [convert_after_rewriter]: 8.78001e-06 [order_py_execute_after_rewriter]: 4.47998e-06 [mutable_eliminate]: 0.00084712 [jit_opt_b]: 4.49e-05, [1] [Cycle 1]: 3.682e-05, [2] [frontend_op_eliminate]: 1.128e-05 [inline_after_opt_a]: 1.232e-05 [cconv]: 3.552e-05 [loop_unroll]: 0.00052084 [jit_opt_after_cconv]: 0.0001546, [1] [Cycle 1]: 0.00014623, [11] [c_1]: 1.387e-05 [parameter_eliminate]: 4.40999e-06 [updatestate_depend_eliminate]: 8.08001e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.934e-05 [call_graph_tuple_transform]: 1.756e-05 [tuple_list_get_item_eliminator]: 3.76001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 1.04003e-06 [switch_simplify]: 3.82002e-06 [remove_dup_value]: 1.762e-05 [partial_unused_args_eliminate]: 2.77002e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 4.531e-05 [cse_after_recomputation]: 2.618e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.399e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 8.35001e-06 [opt_after_jit_grad]: 0.00056542 [symbol_engine_optimizer]: 9.93e-05, [1] [Cycle 1]: 9.178e-05, [6] [build]: 5.59e-06 [elim_shapecalc]: 7.16999e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 4.36002e-06 [fold_const_symbol]: 6.94001e-06 [renormalize]: 9.09989e-07 [validate]: 4.076e-05 Sums bootstrap : 0.000254s : 0.87% type_inference : 0.010440s : 35.60% event_method : 0.000043s : 0.15% auto_monad : 0.000101s : 0.34% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000028s : 0.10% rewriter_before_opt_a : 0.000109s : 0.37% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000114s : 0.39% jit_opt_a.loop_unroll : 0.000084s : 0.29% jit_opt_a.a_1 : 0.002042s : 6.96% jit_opt_a.with_stream_mark : 0.000063s : 0.22% jit_opt_a.recompute_prepare : 0.000032s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000024s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000021s : 0.07% jit_opt_a.accelerated_algorithm : 0.000023s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.07% jit_opt_a.merge_forward : 0.000016s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000039s : 0.13% jit_opt_a.meta_fg_expand : 0.001715s : 5.85% jit_opt_a.replace_old_param : 0.000076s : 0.26% jit_opt_a.inline_without_move : 0.000067s : 0.23% jit_opt_a.renormalize : 0.010996s : 37.50% jit_opt_a.add_forward_monad_depend : 0.000029s : 0.10% jit_opt_a.auto_monad_grad : 0.000011s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000086s : 0.29% jit_opt_a.cse : 0.000293s : 1.00% jit_opt_a.replace_applicator : 0.000123s : 0.42% py_interpret_to_execute_after_opt_a : 0.000018s : 0.06% rewriter_after_opt_a : 0.000042s : 0.14% convert_after_rewriter : 0.000009s : 0.03% order_py_execute_after_rewriter : 0.000004s : 0.02% mutable_eliminate : 0.000847s : 2.89% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.04% jit_opt_b.inline_after_opt_a : 0.000012s : 0.04% cconv : 0.000036s : 0.12% loop_unroll : 0.000521s : 1.78% jit_opt_after_cconv.c_1 : 0.000014s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000045s : 0.15% cse_after_recomputation.cse : 0.000010s : 0.04% auto_monad_reorder : 0.000014s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000565s : 1.93% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.14% Time group info: ------[substitution.] 0.000558 101 0.39% : 0.000002s : 1: substitution.elim_not_effective 0.20% : 0.000001s : 1: substitution.fold_const_symbol 0.77% : 0.000004s : 1: substitution.graph_param_transform 63.71% : 0.000356s : 12: substitution.inline 2.96% : 0.000017s : 2: substitution.inline_without_move 1.71% : 0.000010s : 11: substitution.j_node_and_user_rematch 2.11% : 0.000012s : 7: substitution.minmaximum_grad 1.35% : 0.000008s : 5: substitution.partial_eliminate 1.74% : 0.000010s : 11: substitution.remove_not_recompute_node 6.83% : 0.000038s : 10: substitution.replace_applicator 1.16% : 0.000006s : 10: substitution.replace_old_param 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000006s : 1: substitution.tile_eliminate 4.12% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.94% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.50% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010358 2 88.20% : 0.009136s : 1: type_inference.infer 11.80% : 0.001222s : 1: type_inference.specialize ------[replace.] 0.000177 19 63.79% : 0.000113s : 12: replace.inline 36.21% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000373 19 93.47% : 0.000348s : 12: match.inline 6.53% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000351 2324 1.62% : 0.000006s : 40: predicate.accumulaten_eliminater 0.34% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 40: predicate.addn_check_dump 1.65% : 0.000006s : 40: predicate.addn_zero_filter 2.15% : 0.000008s : 40: predicate.arithmetic_simplify 1.55% : 0.000005s : 40: predicate.cast_eliminate 0.14% : 0.000001s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 40: predicate.compare_switch_simplify 1.54% : 0.000005s : 40: predicate.depend_value_elim 1.39% : 0.000005s : 40: predicate.dict_get_item_const_eliminator 1.64% : 0.000006s : 40: predicate.dict_get_item_eliminator 1.47% : 0.000005s : 40: predicate.dict_set_item_eliminator 0.36% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.22% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000005s : 40: predicate.environ_add_const_eliminate 1.38% : 0.000005s : 40: predicate.environ_get_add_eliminate 1.53% : 0.000005s : 40: predicate.environ_get_depend_swap 1.61% : 0.000006s : 40: predicate.environ_get_eliminate 1.39% : 0.000005s : 40: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.88% : 0.000003s : 15: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.38% : 0.000015s : 61: predicate.inline 2.03% : 0.000007s : 43: predicate.inline_without_move 0.30% : 0.000001s : 15: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 15: predicate.less_batch_normalization 1.86% : 0.000007s : 47: predicate.list_to_tuple_eliminator_ 2.02% : 0.000007s : 48: predicate.load_eliminater 0.48% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.38% : 0.000012s : 83: predicate.loop_unroll_before_grad 1.77% : 0.000006s : 41: predicate.make_slice_get_slice_eliminator 1.36% : 0.000005s : 40: predicate.merge_addn 1.56% : 0.000005s : 40: predicate.minmaximum_grad 0.66% : 0.000002s : 1: predicate.mutable_eliminate 0.14% : 0.000000s : 1: predicate.opt_reshape 2.38% : 0.000008s : 48: predicate.partial_eliminate 1.45% : 0.000005s : 40: predicate.print_const_string_wrapper 1.94% : 0.000007s : 40: predicate.reduce_eliminate 1.73% : 0.000006s : 47: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000002s : 15: predicate.remove_not_recompute_node 2.64% : 0.000009s : 88: predicate.replace_applicator 1.09% : 0.000004s : 43: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.50% : 0.000005s : 40: predicate.reshape_eliminate 1.67% : 0.000006s : 40: predicate.row_tensor_add_zeros_like 0.24% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000005s : 40: predicate.same_eliminate 0.45% : 0.000002s : 15: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.80% : 0.000003s : 15: predicate.specialize_transform 1.74% : 0.000006s : 40: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000005s : 40: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.68% : 0.000009s : 59: predicate.switch_defer_inline 2.47% : 0.000009s : 59: predicate.switch_layer_defer_inline 6.59% : 0.000023s : 143: predicate.switch_simplify 1.46% : 0.000005s : 40: predicate.tile_eliminate 1.53% : 0.000005s : 40: predicate.transpose_eliminate 1.89% : 0.000007s : 40: predicate.tuple_list_convert_item_index_to_positive 1.80% : 0.000006s : 40: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000012s : 49: predicate.tuple_list_get_item_eliminator 2.00% : 0.000007s : 40: predicate.tuple_list_set_item_eliminator 1.77% : 0.000006s : 47: predicate.tuple_to_list_eliminator_ 1.83% : 0.000006s : 48: predicate.updatestate_pure_node_eliminater 2.64% : 0.000009s : 63: predicate.updatestate_useless_node_eliminater 1.88% : 0.000007s : 40: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.23% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002274 34 58.12% : 0.001322s : 18: func_graph_cloner_run.FuncGraphClonerGraph 41.88% : 0.000952s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047198 87 0.10% : 0.000049s : 1: add_recomputation 0.22% : 0.000106s : 1: auto_monad 0.04% : 0.000017s : 1: auto_monad_reorder 0.60% : 0.000283s : 1: bootstrap 0.08% : 0.000039s : 1: cconv 0.03% : 0.000012s : 1: convert_after_rewriter 0.06% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.10% : 0.000048s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 41.99% : 0.019820s : 1: jit_opt_a 0.33% : 0.000158s : 1: jit_opt_after_cconv 0.10% : 0.000048s : 1: jit_opt_b 1.13% : 0.000535s : 1: loop_unroll 1.82% : 0.000860s : 1: mutable_eliminate 5.66% : 0.002674s : 39: opt.transform.jit_opt_a 0.07% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000027s : 4: opt.transform.symbol_engine_opt 1.22% : 0.000578s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000031s : 1: py_interpret_to_execute 0.04% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 18.13% : 0.008555s : 2: renormalize.infer 5.12% : 0.002415s : 2: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000046s : 1: rewriter_after_opt_a 0.24% : 0.000112s : 1: rewriter_before_opt_a 0.22% : 0.000102s : 1: symbol_engine_optimizer 22.15% : 0.010455s : 1: type_inference TotalTime = 0.165996, [30] [bootstrap]: 0.00030386 [type_inference]: 0.151866 [event_method]: 2.113e-05 [auto_monad]: 7.891e-05 [graph_reusing]: 5.72999e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00044784 [rewriter_before_opt_a]: 8.71e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.0105655, [2] [Cycle 1]: 0.00510454, [27] [switch_simplify]: 6.758e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00066176 [with_stream_mark]: 2.414e-05 [recompute_prepare]: 1.004e-05 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 2.81e-06 [specialize_transform]: 7.41001e-06 [updatestate_useless_node_eliminater]: 6.89999e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.19999e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.719e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.336e-05 [inline_without_move]: 6.69999e-06 [renormalize]: 0.00389394 [add_forward_monad_depend]: 1.474e-05 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 2.337e-05 [cse]: 3.572e-05 [replace_applicator]: 2.236e-05 [Cycle 2]: 0.00042427, [27] [switch_simplify]: 7.06999e-06 [loop_unroll]: 6.26998e-06 [a_1]: 0.00014652 [with_stream_mark]: 1.655e-05 [recompute_prepare]: 6.54999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.53002e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 3.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.94e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.106e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 8.85999e-06 [cse]: 1.515e-05 [replace_applicator]: 6.61999e-06 [py_interpret_to_execute_after_opt_a]: 1.855e-05 [rewriter_after_opt_a]: 4.217e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.82001e-06 [mutable_eliminate]: 0.00078188 [jit_opt_b]: 5.724e-05, [1] [Cycle 1]: 4.911e-05, [2] [frontend_op_eliminate]: 1.948e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 3.106e-05 [loop_unroll]: 0.00046086 [jit_opt_after_cconv]: 0.00017083, [1] [Cycle 1]: 0.00016418, [11] [c_1]: 2.592e-05 [parameter_eliminate]: 4.80999e-06 [updatestate_depend_eliminate]: 8.56002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 3.168e-05 [call_graph_tuple_transform]: 2.317e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 7.2e-07 [switch_simplify]: 6.56e-06 [remove_dup_value]: 1.671e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.38001e-06 [add_recomputation]: 6.164e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.834e-05, [1] [cse]: 1.221e-05 [auto_monad_reorder]: 1.444e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 8.73001e-06 [opt_after_jit_grad]: 0.00048639 [symbol_engine_optimizer]: 7.837e-05, [1] [Cycle 1]: 7.187e-05, [6] [build]: 3.98999e-06 [elim_shapecalc]: 8.84998e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 6.39993e-07 [validate]: 0.00012954 Sums bootstrap : 0.000304s : 0.19% type_inference : 0.151866s : 94.74% event_method : 0.000021s : 0.01% auto_monad : 0.000079s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000448s : 0.28% rewriter_before_opt_a : 0.000087s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000808s : 0.50% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003894s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000782s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000461s : 0.29% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000062s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000486s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000130s : 0.08% Time group info: ------[substitution.] 0.000281 24 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 4: substitution.graph_param_transform 85.76% : 0.000241s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000007s : 4: substitution.remove_not_recompute_node 2.65% : 0.000007s : 2: substitution.replace_old_param 4.15% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151765 2 97.89% : 0.148565s : 1: type_inference.infer 2.11% : 0.003200s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.05% : 0.000055s : 4: replace.inline 31.95% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 6 95.81% : 0.000238s : 4: match.inline 4.19% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.90% : 0.000001s : 12: predicate.addn_check_dump 1.11% : 0.000002s : 12: predicate.addn_zero_filter 1.62% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 0.88% : 0.000001s : 12: predicate.compare_switch_simplify 0.98% : 0.000002s : 12: predicate.depend_value_elim 0.94% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.97% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.96% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.91% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 12: predicate.environ_get_depend_swap 1.05% : 0.000002s : 12: predicate.environ_get_eliminate 0.87% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 4.88% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.93% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.55% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.22% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 12: predicate.merge_addn 0.90% : 0.000001s : 12: predicate.minmaximum_grad 2.35% : 0.000004s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 12.45% : 0.000020s : 18: predicate.partial_eliminate 1.06% : 0.000002s : 12: predicate.print_const_string_wrapper 2.01% : 0.000003s : 12: predicate.reduce_eliminate 1.29% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.75% : 0.000003s : 22: predicate.replace_applicator 0.91% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.06% : 0.000002s : 12: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.15% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 18: predicate.switch_defer_inline 1.71% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000011s : 58: predicate.switch_simplify 1.07% : 0.000002s : 12: predicate.tile_eliminate 1.05% : 0.000002s : 12: predicate.transpose_eliminate 1.21% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.35% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002533 22 67.62% : 0.001713s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.31% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.07% : 0.000762s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.170948 72 0.04% : 0.000066s : 1: add_recomputation 0.05% : 0.000083s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.19% : 0.000322s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 6.18% : 0.010569s : 1: jit_opt_a 0.10% : 0.000174s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.28% : 0.000471s : 1: loop_unroll 0.46% : 0.000795s : 1: mutable_eliminate 0.63% : 0.001073s : 26: opt.transform.jit_opt_a 0.03% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000454s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.76% : 0.003002s : 1: renormalize.infer 0.51% : 0.000877s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.05% : 0.000093s : 1: rewriter_before_opt_a 0.05% : 0.000081s : 1: symbol_engine_optimizer 88.85% : 0.151889s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.423.969 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065ee0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.424.614 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0345817, [30] [bootstrap]: 0.00037349 [type_inference]: 0.023692 [event_method]: 2.399e-05 [auto_monad]: 9.368e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.0001916 [rewriter_before_opt_a]: 9.607e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00714165, [2] [Cycle 1]: 0.00247713, [27] [switch_simplify]: 6.16e-05 [loop_unroll]: 3.282e-05 [a_1]: 0.00067791 [with_stream_mark]: 4.17e-05 [recompute_prepare]: 1.021e-05 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.612e-05 [j_node_and_user_rematch]: 1.072e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 5.64998e-06 [renormalize]: 0.00125722 [add_forward_monad_depend]: 8.43001e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.962e-05 [cse]: 3.898e-05 [replace_applicator]: 2.056e-05 [Cycle 2]: 0.00042493, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 6.29001e-06 [a_1]: 0.00013749 [with_stream_mark]: 1.465e-05 [recompute_prepare]: 6.41998e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 4.95999e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 3.73999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 8.41002e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 2.029e-05 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 1.06997e-06 [auto_monad_eliminator]: 7.43e-06 [cse]: 1.834e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 1.703e-05 [rewriter_after_opt_a]: 4.27e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00087724 [jit_opt_b]: 6.05e-05, [1] [Cycle 1]: 5.137e-05, [2] [frontend_op_eliminate]: 1.955e-05 [inline_after_opt_a]: 2.02e-05 [cconv]: 3.394e-05 [loop_unroll]: 0.00059557 [jit_opt_after_cconv]: 0.00019293, [1] [Cycle 1]: 0.00018521, [11] [c_1]: 2.461e-05 [parameter_eliminate]: 4.77e-06 [updatestate_depend_eliminate]: 1.063e-05 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.93e-06 [cse]: 3.963e-05 [call_graph_tuple_transform]: 2.908e-05 [tuple_list_get_item_eliminator]: 7e-06 [none_parameter_eliminate]: 1.95001e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 7.58001e-06 [remove_dup_value]: 1.86e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 7.67998e-06 [add_recomputation]: 6.249e-05 [cse_after_recomputation]: 2.434e-05, [1] [Cycle 1]: 1.899e-05, [1] [cse]: 1.294e-05 [auto_monad_reorder]: 1.902e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 1.01e-05 [opt_after_jit_grad]: 0.0006305 [symbol_engine_optimizer]: 8.741e-05, [1] [Cycle 1]: 8.029e-05, [6] [build]: 5.46e-06 [elim_shapecalc]: 9.11002e-06 [elim_not_effective]: 1.708e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 1.083e-05 [renormalize]: 9.39996e-07 [validate]: 5.132e-05 Sums bootstrap : 0.000373s : 1.26% type_inference : 0.023692s : 79.85% event_method : 0.000024s : 0.08% auto_monad : 0.000094s : 0.32% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000192s : 0.65% rewriter_before_opt_a : 0.000096s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.23% jit_opt_a.loop_unroll : 0.000039s : 0.13% jit_opt_a.a_1 : 0.000815s : 2.75% jit_opt_a.with_stream_mark : 0.000056s : 0.19% jit_opt_a.recompute_prepare : 0.000017s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000026s : 0.09% jit_opt_a.renormalize : 0.001257s : 4.24% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.09% jit_opt_a.cse : 0.000057s : 0.19% jit_opt_a.replace_applicator : 0.000026s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000043s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000877s : 2.96% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.07% jit_opt_b.inline_after_opt_a : 0.000020s : 0.07% cconv : 0.000034s : 0.11% loop_unroll : 0.000596s : 2.01% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000040s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000019s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000062s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000630s : 2.12% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.17% Time group info: ------[substitution.] 0.000254 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.99% : 0.000003s : 2: substitution.fold_const_symbol 2.56% : 0.000007s : 3: substitution.graph_param_transform 83.95% : 0.000214s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 2.44% : 0.000006s : 2: substitution.replace_old_param 5.40% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023595 2 91.96% : 0.021698s : 1: type_inference.infer 8.04% : 0.001897s : 1: type_inference.specialize ------[replace.] 0.000102 6 73.63% : 0.000075s : 4: replace.inline 26.37% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.38% : 0.000211s : 4: match.inline 5.62% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 691 1.04% : 0.000002s : 10: predicate.accumulaten_eliminater 1.50% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000002s : 10: predicate.addn_zero_filter 2.17% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.01% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 1.16% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.40% : 0.000008s : 22: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.79% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 15: predicate.load_eliminater 1.87% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 10: predicate.merge_addn 1.05% : 0.000002s : 10: predicate.minmaximum_grad 2.42% : 0.000003s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 2.12% : 0.000003s : 10: predicate.reduce_eliminate 2.01% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.07% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 3: predicate.row_tensor_eliminate 1.14% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.49% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.29% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001018 13 39.23% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.64% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.13% : 0.000571s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036998 72 0.18% : 0.000066s : 1: add_recomputation 0.26% : 0.000098s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.06% : 0.000392s : 1: bootstrap 0.10% : 0.000037s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.31% : 0.007146s : 1: jit_opt_a 0.53% : 0.000196s : 1: jit_opt_after_cconv 0.17% : 0.000063s : 1: jit_opt_b 1.64% : 0.000606s : 1: loop_unroll 2.41% : 0.000890s : 1: mutable_eliminate 2.91% : 0.001078s : 26: opt.transform.jit_opt_a 0.17% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000032s : 4: opt.transform.jit_opt_b 0.05% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000022s : 1: opt.transform.mutable_eliminate 0.08% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000041s : 4: opt.transform.symbol_engine_opt 1.73% : 0.000642s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.53% : 0.000197s : 1: py_interpret_to_execute 0.05% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.79% : 0.000663s : 1: renormalize.infer 1.58% : 0.000584s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.27% : 0.000101s : 1: rewriter_before_opt_a 0.24% : 0.000090s : 1: symbol_engine_optimizer 64.10% : 0.023714s : 1: type_inference TotalTime = 0.0367847, [30] [bootstrap]: 0.00033968 [type_inference]: 0.0238353 [event_method]: 2.158e-05 [auto_monad]: 7.13e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00011128 [rewriter_before_opt_a]: 8.495e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.00612504, [2] [Cycle 1]: 0.00220452, [27] [switch_simplify]: 6.694e-05 [loop_unroll]: 2.911e-05 [a_1]: 0.00058453 [with_stream_mark]: 2.465e-05 [recompute_prepare]: 7.95e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.81999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 5.81998e-06 [renormalize]: 0.00112111 [add_forward_monad_depend]: 7.44002e-06 [auto_monad_grad]: 3.36999e-06 [auto_monad_eliminator]: 1.767e-05 [cse]: 3.521e-05 [replace_applicator]: 1.764e-05 [Cycle 2]: 0.00033199, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 5.28002e-06 [a_1]: 8.863e-05 [with_stream_mark]: 1.18e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.95002e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 2.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.532e-05 [j_node_and_user_rematch]: 8.51002e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.61e-06 [cse]: 1.394e-05 [replace_applicator]: 5.56002e-06 [py_interpret_to_execute_after_opt_a]: 1.481e-05 [rewriter_after_opt_a]: 4.002e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00439966 [jit_opt_b]: 6.002e-05, [1] [Cycle 1]: 5.067e-05, [2] [frontend_op_eliminate]: 1.791e-05 [inline_after_opt_a]: 1.986e-05 [cconv]: 3.5e-05 [loop_unroll]: 0.00047216 [jit_opt_after_cconv]: 0.00017916, [1] [Cycle 1]: 0.00017206, [11] [c_1]: 2.151e-05 [parameter_eliminate]: 5.97999e-06 [updatestate_depend_eliminate]: 9.66003e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [cse]: 4.114e-05 [call_graph_tuple_transform]: 2.489e-05 [tuple_list_get_item_eliminator]: 5.73002e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.30001e-06 [remove_dup_value]: 1.834e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 7.22002e-06 [add_recomputation]: 5.233e-05 [cse_after_recomputation]: 2.382e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.746e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 9.12999e-06 [opt_after_jit_grad]: 0.00046307 [symbol_engine_optimizer]: 7.686e-05, [1] [Cycle 1]: 6.923e-05, [6] [build]: 4.62998e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.415e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 8.86002e-06 [renormalize]: 5.09986e-07 [validate]: 4.668e-05 Sums bootstrap : 0.000340s : 1.04% type_inference : 0.023835s : 73.32% event_method : 0.000022s : 0.07% auto_monad : 0.000071s : 0.22% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000111s : 0.34% rewriter_before_opt_a : 0.000085s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.22% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000673s : 2.07% jit_opt_a.with_stream_mark : 0.000036s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001121s : 3.45% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.07% jit_opt_a.cse : 0.000049s : 0.15% jit_opt_a.replace_applicator : 0.000023s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.004400s : 13.53% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000020s : 0.06% cconv : 0.000035s : 0.11% loop_unroll : 0.000472s : 1.45% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000041s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000463s : 1.42% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.14% Time group info: ------[substitution.] 0.000252 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 86.10% : 0.000217s : 4: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000005s : 2: substitution.replace_old_param 4.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023755 2 93.19% : 0.022138s : 1: type_inference.infer 6.81% : 0.001617s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.08% : 0.000053s : 4: replace.inline 30.92% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 95.20% : 0.000215s : 4: match.inline 4.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 6.15% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.80% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 3.07% : 0.000004s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.63% : 0.000001s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.48% : 0.000002s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000929 13 47.43% : 0.000441s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.92% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.65% : 0.000433s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038831 72 0.14% : 0.000055s : 1: add_recomputation 0.19% : 0.000075s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000360s : 1: bootstrap 0.10% : 0.000038s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 15.78% : 0.006128s : 1: jit_opt_a 0.47% : 0.000182s : 1: jit_opt_after_cconv 0.16% : 0.000063s : 1: jit_opt_b 1.24% : 0.000481s : 1: loop_unroll 11.38% : 0.004419s : 1: mutable_eliminate 2.33% : 0.000906s : 26: opt.transform.jit_opt_a 0.14% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000031s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.21% : 0.000471s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000115s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 1.73% : 0.000673s : 1: renormalize.infer 1.13% : 0.000439s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.23% : 0.000089s : 1: rewriter_before_opt_a 0.20% : 0.000079s : 1: symbol_engine_optimizer 61.44% : 0.023857s : 1: type_inference TotalTime = 0.0368989, [30] [bootstrap]: 0.00037343 [type_inference]: 0.0260534 [event_method]: 2.507e-05 [auto_monad]: 7.664e-05 [graph_reusing]: 5.43002e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00017286 [rewriter_before_opt_a]: 0.00014513 [expand_dump_flag]: 4.42e-06 [jit_opt_a]: 0.00717742, [2] [Cycle 1]: 0.00232278, [27] [switch_simplify]: 6.172e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00061133 [with_stream_mark]: 1.877e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.59998e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.584e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.0012314 [add_forward_monad_depend]: 7.97e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.896e-05 [cse]: 3.718e-05 [replace_applicator]: 1.918e-05 [Cycle 2]: 0.0003571, [27] [switch_simplify]: 6.68998e-06 [loop_unroll]: 5.34998e-06 [a_1]: 0.00010156 [with_stream_mark]: 1.374e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 3.52997e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.04002e-06 [inline_without_move]: 5.01997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 1.42e-06 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.59e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.671e-05 [rewriter_after_opt_a]: 4.322e-05 [convert_after_rewriter]: 6.84001e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.0007225 [jit_opt_b]: 5.604e-05, [1] [Cycle 1]: 4.806e-05, [2] [frontend_op_eliminate]: 1.896e-05 [inline_after_opt_a]: 1.72e-05 [cconv]: 2.772e-05 [loop_unroll]: 0.00056087 [jit_opt_after_cconv]: 0.00016217, [1] [Cycle 1]: 0.00015448, [11] [c_1]: 2.309e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 3.347e-05 [call_graph_tuple_transform]: 2.186e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.664e-05 [partial_unused_args_eliminate]: 3.06001e-06 [environ_conv]: 7.03998e-06 [add_recomputation]: 5.031e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.822e-05, [1] [cse]: 1.223e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 6.58998e-06 [opt_after_jit_grad]: 0.00069141 [symbol_engine_optimizer]: 0.00013537, [1] [Cycle 1]: 0.00012678, [6] [build]: 4.1e-06 [elim_shapecalc]: 9.08002e-06 [elim_not_effective]: 1.701e-05 [opt_reshape]: 7.15003e-06 [fold_const_symbol]: 5.865e-05 [renormalize]: 4.30009e-07 [validate]: 4.848e-05 Sums bootstrap : 0.000373s : 1.18% type_inference : 0.026053s : 82.14% event_method : 0.000025s : 0.08% auto_monad : 0.000077s : 0.24% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000173s : 0.55% rewriter_before_opt_a : 0.000145s : 0.46% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000713s : 2.25% jit_opt_a.with_stream_mark : 0.000033s : 0.10% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001231s : 3.88% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000053s : 0.17% jit_opt_a.replace_applicator : 0.000025s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000043s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000723s : 2.28% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000028s : 0.09% loop_unroll : 0.000561s : 1.77% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000050s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000691s : 2.18% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000059s : 0.18% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.15% Time group info: ------[substitution.] 0.000303 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 16.25% : 0.000049s : 2: substitution.fold_const_symbol 2.25% : 0.000007s : 3: substitution.graph_param_transform 71.38% : 0.000216s : 4: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000006s : 4: substitution.remove_not_recompute_node 1.49% : 0.000005s : 2: substitution.replace_old_param 4.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025948 2 92.00% : 0.023873s : 1: type_inference.infer 8.00% : 0.002076s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.21% : 0.000052s : 4: replace.inline 31.79% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.69% : 0.000214s : 4: match.inline 5.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.45% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 2.29% : 0.000003s : 10: predicate.arithmetic_simplify 1.50% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.45% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 4.95% : 0.000006s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.04% : 0.000001s : 10: predicate.print_const_string_wrapper 2.02% : 0.000003s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000010s : 53: predicate.switch_simplify 1.49% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.11% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001082 13 45.21% : 0.000489s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.97% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.81% : 0.000550s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039199 72 0.14% : 0.000054s : 1: add_recomputation 0.20% : 0.000080s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.00% : 0.000393s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000030s : 1: event_method 0.02% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.32% : 0.007181s : 1: jit_opt_a 0.42% : 0.000165s : 1: jit_opt_after_cconv 0.15% : 0.000059s : 1: jit_opt_b 1.45% : 0.000569s : 1: loop_unroll 1.96% : 0.000767s : 1: mutable_eliminate 2.42% : 0.000949s : 26: opt.transform.jit_opt_a 0.14% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000049s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000087s : 4: opt.transform.symbol_engine_opt 1.80% : 0.000704s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000178s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.75% : 0.000685s : 1: renormalize.infer 1.37% : 0.000538s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000046s : 1: rewriter_after_opt_a 0.42% : 0.000165s : 1: rewriter_before_opt_a 0.35% : 0.000139s : 1: symbol_engine_optimizer 66.52% : 0.026074s : 1: type_inference TotalTime = 0.154816, [30] [bootstrap]: 0.00036177 [type_inference]: 0.139437 [event_method]: 3.128e-05 [auto_monad]: 9.003e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00093385 [rewriter_before_opt_a]: 0.0001228 [expand_dump_flag]: 4.89e-06 [jit_opt_a]: 0.0105242, [2] [Cycle 1]: 0.00540936, [27] [switch_simplify]: 6.953e-05 [loop_unroll]: 3.641e-05 [a_1]: 0.00088029 [with_stream_mark]: 2.654e-05 [recompute_prepare]: 1.129e-05 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 8.07e-06 [updatestate_useless_node_eliminater]: 6.83998e-06 [accelerated_algorithm]: 7.47998e-06 [meta_shard_fg_expand]: 3.21999e-06 [get_grad_eliminate_]: 7.92e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.96e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.99001e-06 [renormalize]: 0.00395823 [add_forward_monad_depend]: 1.082e-05 [auto_monad_grad]: 2.85002e-06 [auto_monad_eliminator]: 2.225e-05 [cse]: 4.045e-05 [replace_applicator]: 2.456e-05 [Cycle 2]: 0.00050134, [27] [switch_simplify]: 8.35001e-06 [loop_unroll]: 8.19002e-06 [a_1]: 0.00015244 [with_stream_mark]: 2.105e-05 [recompute_prepare]: 1.064e-05 [updatestate_depend_eliminate]: 5.23002e-06 [updatestate_assign_eliminate]: 3.87002e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.59001e-06 [specialize_transform]: 8.47e-06 [updatestate_useless_node_eliminater]: 6.71999e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 3.85998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.245e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.2e-05 [inline_without_move]: 7.51001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.52001e-06 [auto_monad_grad]: 1.65001e-06 [auto_monad_eliminator]: 1.222e-05 [cse]: 2.515e-05 [replace_applicator]: 1.016e-05 [py_interpret_to_execute_after_opt_a]: 2.138e-05 [rewriter_after_opt_a]: 5.017e-05 [convert_after_rewriter]: 8.35001e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00085402 [jit_opt_b]: 0.00014729, [1] [Cycle 1]: 0.00013676, [2] [frontend_op_eliminate]: 2.491e-05 [inline_after_opt_a]: 2.596e-05 [cconv]: 3.503e-05 [loop_unroll]: 0.00058636 [jit_opt_after_cconv]: 0.00021026, [1] [Cycle 1]: 0.00020146, [11] [c_1]: 3.189e-05 [parameter_eliminate]: 7.06999e-06 [updatestate_depend_eliminate]: 1.116e-05 [updatestate_assign_eliminate]: 4.4e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 3.841e-05 [call_graph_tuple_transform]: 2.949e-05 [tuple_list_get_item_eliminator]: 7.6e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 7.73001e-06 [remove_dup_value]: 2.095e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 1.18e-05 [add_recomputation]: 5.942e-05 [cse_after_recomputation]: 3.373e-05, [1] [Cycle 1]: 2.468e-05, [1] [cse]: 1.71e-05 [auto_monad_reorder]: 1.989e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 9.67001e-06 [opt_after_jit_grad]: 0.00064452 [symbol_engine_optimizer]: 9.625e-05, [1] [Cycle 1]: 8.88e-05, [6] [build]: 5.28002e-06 [elim_shapecalc]: 1.015e-05 [elim_not_effective]: 1.816e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 1.479e-05 [renormalize]: 6.19999e-07 [validate]: 0.00024114 Sums bootstrap : 0.000362s : 0.24% type_inference : 0.139437s : 93.34% event_method : 0.000031s : 0.02% auto_monad : 0.000090s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000934s : 0.63% rewriter_before_opt_a : 0.000123s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.05% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.001033s : 0.69% jit_opt_a.with_stream_mark : 0.000048s : 0.03% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.003958s : 2.65% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.02% jit_opt_a.cse : 0.000066s : 0.04% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000050s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000854s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000026s : 0.02% cconv : 0.000035s : 0.02% loop_unroll : 0.000586s : 0.39% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000059s : 0.04% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000645s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000241s : 0.16% Time group info: ------[substitution.] 0.000349 25 0.74% : 0.000003s : 2: substitution.elim_not_effective 0.30% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000007s : 4: substitution.graph_param_transform 88.03% : 0.000308s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000006s : 4: substitution.remove_not_recompute_node 1.52% : 0.000005s : 2: substitution.replace_old_param 4.29% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139300 2 96.45% : 0.134349s : 1: type_inference.infer 3.55% : 0.004951s : 1: type_inference.specialize ------[replace.] 0.000133 7 66.89% : 0.000089s : 5: replace.inline 33.11% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000317 7 95.82% : 0.000304s : 5: match.inline 4.18% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 2.33% : 0.000004s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.03% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.29% : 0.000009s : 28: predicate.inline 0.90% : 0.000002s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.51% : 0.000003s : 19: predicate.load_eliminater 2.25% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.33% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 0.90% : 0.000002s : 13: predicate.minmaximum_grad 2.29% : 0.000004s : 4: predicate.mutable_eliminate 0.36% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000004s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000004s : 13: predicate.reduce_eliminate 1.65% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.80% : 0.000003s : 23: predicate.replace_applicator 0.50% : 0.000001s : 8: predicate.replace_old_param 0.57% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.52% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000002s : 8: predicate.specialize_transform 1.81% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000004s : 20: predicate.switch_defer_inline 1.88% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.69% : 0.000013s : 64: predicate.switch_simplify 1.16% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.75% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.46% : 0.000006s : 27: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003128 25 61.14% : 0.001913s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.13% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.72% : 0.001117s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160008 72 0.04% : 0.000063s : 1: add_recomputation 0.06% : 0.000094s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.24% : 0.000379s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000036s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000037s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.58% : 0.010529s : 1: jit_opt_a 0.13% : 0.000214s : 1: jit_opt_after_cconv 0.09% : 0.000151s : 1: jit_opt_b 0.37% : 0.000595s : 1: loop_unroll 0.54% : 0.000866s : 1: mutable_eliminate 0.83% : 0.001333s : 26: opt.transform.jit_opt_a 0.05% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000026s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000653s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.59% : 0.000941s : 1: py_interpret_to_execute 0.02% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.76% : 0.002813s : 1: renormalize.infer 0.71% : 0.001131s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000054s : 1: rewriter_after_opt_a 0.08% : 0.000129s : 1: rewriter_before_opt_a 0.06% : 0.000104s : 1: symbol_engine_optimizer 87.16% : 0.139463s : 1: type_inference TotalTime = 0.138338, [30] [bootstrap]: 0.00023405 [type_inference]: 0.110171 [event_method]: 0.00039371 [auto_monad]: 0.00010161 [graph_reusing]: 6.98e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 6.562e-05 [rewriter_before_opt_a]: 0.00011555 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.0249375, [3] [Cycle 1]: 0.0176368, [27] [switch_simplify]: 7.647e-05 [loop_unroll]: 4.147e-05 [a_1]: 0.00091587 [with_stream_mark]: 3.446e-05 [recompute_prepare]: 2.02e-05 [updatestate_depend_eliminate]: 9.24998e-06 [updatestate_assign_eliminate]: 7.16001e-06 [updatestate_loads_eliminate]: 6.71999e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 1.468e-05 [updatestate_useless_node_eliminater]: 1.343e-05 [accelerated_algorithm]: 1.377e-05 [meta_shard_fg_expand]: 3.76001e-06 [get_grad_eliminate_]: 1.435e-05 [merge_forward]: 8.65999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.998e-05 [j_node_and_user_rematch]: 2.606e-05 [meta_fg_expand]: 0.00187843 [replace_old_param]: 7.493e-05 [inline_without_move]: 6.15e-05 [renormalize]: 0.0135984 [add_forward_monad_depend]: 1.656e-05 [auto_monad_grad]: 7.2e-06 [auto_monad_eliminator]: 6.717e-05 [cse]: 0.00030249 [replace_applicator]: 0.0001058 [Cycle 2]: 0.00357576, [27] [switch_simplify]: 4.323e-05 [loop_unroll]: 4.151e-05 [a_1]: 0.00127592 [with_stream_mark]: 2.335e-05 [recompute_prepare]: 9.66e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 2.72001e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 6.98998e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 8.687e-05 [replace_old_param]: 8.76002e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00174935 [add_forward_monad_depend]: 7.08998e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.405e-05 [cse]: 2.659e-05 [replace_applicator]: 1.471e-05 [Cycle 3]: 0.00025964, [27] [switch_simplify]: 4.12e-06 [loop_unroll]: 4.28001e-06 [a_1]: 4.487e-05 [with_stream_mark]: 1.125e-05 [recompute_prepare]: 3.25e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 1.52001e-06 [updatestate_loads_eliminate]: 1.59e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 3.21999e-06 [updatestate_useless_node_eliminater]: 3.16001e-06 [accelerated_algorithm]: 3.38e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 3.26001e-06 [merge_forward]: 2.45002e-06 [cell_reuse_recompute_pass]: 2.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.129e-05 [j_node_and_user_rematch]: 6.58e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 3.14999e-06 [inline_without_move]: 3.28998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 3.95e-06 [cse]: 8.94e-06 [replace_applicator]: 3.53999e-06 [py_interpret_to_execute_after_opt_a]: 1.321e-05 [rewriter_after_opt_a]: 3.61e-05 [convert_after_rewriter]: 6.03002e-06 [order_py_execute_after_rewriter]: 4.28999e-06 [mutable_eliminate]: 0.00075734 [jit_opt_b]: 4.364e-05, [1] [Cycle 1]: 3.6e-05, [2] [frontend_op_eliminate]: 1.179e-05 [inline_after_opt_a]: 1.182e-05 [cconv]: 2.698e-05 [loop_unroll]: 0.00042438 [jit_opt_after_cconv]: 0.00013432, [1] [Cycle 1]: 0.00012653, [11] [c_1]: 1.211e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.07999e-06 [updatestate_assign_eliminate]: 1.68002e-06 [updatestate_loads_eliminate]: 1.69e-06 [cse]: 2.309e-05 [call_graph_tuple_transform]: 1.596e-05 [tuple_list_get_item_eliminator]: 3.65e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 4.12e-06 [remove_dup_value]: 1.392e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.17001e-06 [add_recomputation]: 3.647e-05 [cse_after_recomputation]: 1.968e-05, [1] [Cycle 1]: 1.478e-05, [1] [cse]: 8.47e-06 [auto_monad_reorder]: 1.291e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00043555 [symbol_engine_optimizer]: 6.399e-05, [1] [Cycle 1]: 5.792e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 5.26998e-06 [elim_not_effective]: 9.95002e-06 [opt_reshape]: 4.3e-06 [fold_const_symbol]: 5.54e-06 [renormalize]: 3.60014e-07 [validate]: 3.635e-05 Sums bootstrap : 0.000234s : 0.17% type_inference : 0.110171s : 82.27% event_method : 0.000394s : 0.29% auto_monad : 0.000102s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000066s : 0.05% rewriter_before_opt_a : 0.000116s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000124s : 0.09% jit_opt_a.loop_unroll : 0.000087s : 0.07% jit_opt_a.a_1 : 0.002237s : 1.67% jit_opt_a.with_stream_mark : 0.000069s : 0.05% jit_opt_a.recompute_prepare : 0.000033s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000024s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000015s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.03% jit_opt_a.meta_fg_expand : 0.001967s : 1.47% jit_opt_a.replace_old_param : 0.000087s : 0.06% jit_opt_a.inline_without_move : 0.000070s : 0.05% jit_opt_a.renormalize : 0.015348s : 11.46% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.06% jit_opt_a.cse : 0.000338s : 0.25% jit_opt_a.replace_applicator : 0.000124s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000757s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000424s : 0.32% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000436s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000601 101 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.78% : 0.000005s : 1: substitution.graph_param_transform 65.57% : 0.000394s : 12: substitution.inline 2.92% : 0.000018s : 2: substitution.inline_without_move 1.74% : 0.000010s : 11: substitution.j_node_and_user_rematch 1.99% : 0.000012s : 7: substitution.minmaximum_grad 1.34% : 0.000008s : 5: substitution.partial_eliminate 1.64% : 0.000010s : 11: substitution.remove_not_recompute_node 6.62% : 0.000040s : 10: substitution.replace_applicator 1.06% : 0.000006s : 10: substitution.replace_old_param 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 0.97% : 0.000006s : 1: substitution.tile_eliminate 4.35% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.72% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.46% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110082 2 97.39% : 0.107209s : 1: type_inference.infer 2.61% : 0.002873s : 1: type_inference.specialize ------[replace.] 0.000191 19 61.92% : 0.000118s : 12: replace.inline 38.08% : 0.000073s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000409 19 94.62% : 0.000387s : 12: match.inline 5.38% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000359 2432 1.51% : 0.000005s : 42: predicate.accumulaten_eliminater 0.28% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 42: predicate.addn_check_dump 1.67% : 0.000006s : 42: predicate.addn_zero_filter 1.94% : 0.000007s : 42: predicate.arithmetic_simplify 1.79% : 0.000006s : 42: predicate.cast_eliminate 0.10% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 42: predicate.compare_switch_simplify 1.52% : 0.000005s : 42: predicate.depend_value_elim 1.42% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.63% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.51% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.17% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000006s : 42: predicate.environ_add_const_eliminate 1.39% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.39% : 0.000005s : 42: predicate.environ_get_depend_swap 1.48% : 0.000005s : 42: predicate.environ_get_eliminate 1.50% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 16: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.52% : 0.000016s : 63: predicate.inline 2.09% : 0.000007s : 44: predicate.inline_without_move 0.36% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.97% : 0.000003s : 16: predicate.less_batch_normalization 1.86% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.89% : 0.000007s : 50: predicate.load_eliminater 0.37% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.50% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.77% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.46% : 0.000005s : 42: predicate.merge_addn 1.53% : 0.000005s : 42: predicate.minmaximum_grad 0.46% : 0.000002s : 1: predicate.mutable_eliminate 0.18% : 0.000001s : 1: predicate.opt_reshape 2.34% : 0.000008s : 50: predicate.partial_eliminate 1.64% : 0.000006s : 42: predicate.print_const_string_wrapper 2.14% : 0.000008s : 42: predicate.reduce_eliminate 1.78% : 0.000006s : 49: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 16: predicate.remove_not_recompute_node 2.79% : 0.000010s : 93: predicate.replace_applicator 1.18% : 0.000004s : 44: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.58% : 0.000006s : 42: predicate.reshape_eliminate 1.53% : 0.000005s : 42: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.50% : 0.000005s : 42: predicate.same_eliminate 0.47% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.73% : 0.000003s : 16: predicate.specialize_transform 1.82% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000005s : 42: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.71% : 0.000010s : 61: predicate.switch_defer_inline 2.52% : 0.000009s : 61: predicate.switch_layer_defer_inline 6.51% : 0.000023s : 149: predicate.switch_simplify 1.51% : 0.000005s : 42: predicate.tile_eliminate 1.51% : 0.000005s : 42: predicate.transpose_eliminate 1.79% : 0.000006s : 42: predicate.tuple_list_convert_item_index_to_positive 1.74% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.79% : 0.000006s : 49: predicate.tuple_to_list_eliminator_ 1.74% : 0.000006s : 50: predicate.updatestate_pure_node_eliminater 2.77% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 2.13% : 0.000008s : 42: predicate.value_based_eliminate 0.08% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003576 43 74.13% : 0.002651s : 27: func_graph_cloner_run.FuncGraphClonerGraph 25.87% : 0.000925s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156546 87 0.03% : 0.000040s : 1: add_recomputation 0.07% : 0.000108s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.16% : 0.000256s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.26% : 0.000402s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.93% : 0.024941s : 1: jit_opt_a 0.09% : 0.000137s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.28% : 0.000432s : 1: loop_unroll 0.49% : 0.000768s : 1: mutable_eliminate 1.85% : 0.002900s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000017s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000443s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000069s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 8.26% : 0.012930s : 2: renormalize.infer 1.53% : 0.002392s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000119s : 1: rewriter_before_opt_a 0.04% : 0.000066s : 1: symbol_engine_optimizer 70.39% : 0.110192s : 1: type_inference TotalTime = 0.0272428, [30] [bootstrap]: 0.00026724 [type_inference]: 0.018941 [event_method]: 1.908e-05 [auto_monad]: 6.4e-05 [graph_reusing]: 6.56999e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 9.417e-05 [rewriter_before_opt_a]: 0.00035321 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00543076, [2] [Cycle 1]: 0.0019319, [27] [switch_simplify]: 5.174e-05 [loop_unroll]: 2.863e-05 [a_1]: 0.00059015 [with_stream_mark]: 1.949e-05 [recompute_prepare]: 7.26001e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 9.97001e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00090717 [add_forward_monad_depend]: 5.76998e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.51e-05 [cse]: 3.37e-05 [replace_applicator]: 1.317e-05 [Cycle 2]: 0.00031309, [27] [switch_simplify]: 5.49998e-06 [loop_unroll]: 4.94e-06 [a_1]: 8.728e-05 [with_stream_mark]: 9.44e-06 [recompute_prepare]: 4.95001e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.77e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 2.61999e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.296e-05 [j_node_and_user_rematch]: 8.61002e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.192e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 1.254e-05 [rewriter_after_opt_a]: 3.642e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.0005497 [jit_opt_b]: 4.669e-05, [1] [Cycle 1]: 3.975e-05, [2] [frontend_op_eliminate]: 1.398e-05 [inline_after_opt_a]: 1.517e-05 [cconv]: 2.549e-05 [loop_unroll]: 0.00039917 [jit_opt_after_cconv]: 0.00013971, [1] [Cycle 1]: 0.00013348, [11] [c_1]: 1.983e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.398e-05 [call_graph_tuple_transform]: 1.743e-05 [tuple_list_get_item_eliminator]: 5.14998e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 6.49976e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 1.93997e-06 [environ_conv]: 5.71998e-06 [add_recomputation]: 4.681e-05 [cse_after_recomputation]: 2.207e-05, [1] [Cycle 1]: 1.727e-05, [1] [cse]: 1.12e-05 [auto_monad_reorder]: 1.614e-05 [get_jit_bprop_graph]: 1.68002e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00043479 [symbol_engine_optimizer]: 6.916e-05, [1] [Cycle 1]: 6.3e-05, [6] [build]: 3.04999e-06 [elim_shapecalc]: 7.03e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.40001e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 4.89992e-07 [validate]: 3.668e-05 Sums bootstrap : 0.000267s : 1.14% type_inference : 0.018941s : 80.67% event_method : 0.000019s : 0.08% auto_monad : 0.000064s : 0.27% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000094s : 0.40% rewriter_before_opt_a : 0.000353s : 1.50% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000057s : 0.24% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000677s : 2.89% jit_opt_a.with_stream_mark : 0.000029s : 0.12% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000907s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000046s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000036s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000550s : 2.34% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000025s : 0.11% loop_unroll : 0.000399s : 1.70% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000047s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000016s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000435s : 1.85% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.16% Time group info: ------[substitution.] 0.000191 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000005s : 3: substitution.graph_param_transform 82.83% : 0.000158s : 4: substitution.inline 2.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000004s : 4: substitution.remove_not_recompute_node 2.30% : 0.000004s : 2: substitution.replace_old_param 6.57% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018871 2 92.03% : 0.017366s : 1: type_inference.infer 7.97% : 0.001504s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.78% : 0.000048s : 4: replace.inline 33.22% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.18% : 0.000156s : 4: match.inline 6.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000182 691 0.99% : 0.000002s : 10: predicate.accumulaten_eliminater 0.66% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.66% : 0.000001s : 10: predicate.addn_check_dump 1.06% : 0.000002s : 10: predicate.addn_zero_filter 1.11% : 0.000002s : 10: predicate.arithmetic_simplify 0.75% : 0.000001s : 10: predicate.cast_eliminate 0.26% : 0.000000s : 3: predicate.check_bprop_eliminate 0.66% : 0.000001s : 10: predicate.compare_switch_simplify 0.77% : 0.000001s : 10: predicate.depend_value_elim 0.72% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.73% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.71% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.44% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.30% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.79% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.66% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.67% : 0.000001s : 10: predicate.environ_get_depend_swap 0.68% : 0.000001s : 10: predicate.environ_get_eliminate 0.67% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.62% : 0.000001s : 6: predicate.get_grad_eliminate 0.15% : 0.000000s : 3: predicate.graph_param_transform 3.54% : 0.000006s : 22: predicate.inline 0.57% : 0.000001s : 6: predicate.inline_without_move 0.25% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.85% : 0.000002s : 6: predicate.less_batch_normalization 0.90% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.12% : 0.000002s : 15: predicate.load_eliminater 0.70% : 0.000001s : 3: predicate.loop_unroll_after_grad 2.47% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.14% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.66% : 0.000001s : 10: predicate.merge_addn 0.68% : 0.000001s : 10: predicate.minmaximum_grad 0.75% : 0.000001s : 3: predicate.mutable_eliminate 0.31% : 0.000001s : 3: predicate.opt_reshape 1.44% : 0.000003s : 15: predicate.partial_eliminate 0.74% : 0.000001s : 10: predicate.print_const_string_wrapper 1.29% : 0.000002s : 10: predicate.reduce_eliminate 1.01% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.13% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 0.74% : 0.000001s : 10: predicate.reshape_eliminate 0.80% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.39% : 0.000001s : 3: predicate.row_tensor_eliminate 0.74% : 0.000001s : 10: predicate.same_eliminate 0.37% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.66% : 0.000001s : 6: predicate.special_op_eliminate 0.59% : 0.000001s : 6: predicate.specialize_transform 0.97% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 40.61% : 0.000074s : 10: predicate.stack_unstack_eliminate 0.27% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.43% : 0.000003s : 16: predicate.switch_defer_inline 1.30% : 0.000002s : 16: predicate.switch_layer_defer_inline 4.47% : 0.000008s : 53: predicate.switch_simplify 0.83% : 0.000002s : 10: predicate.tile_eliminate 0.75% : 0.000001s : 10: predicate.transpose_eliminate 0.81% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 0.75% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 2.41% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 0.96% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.91% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.04% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 1.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 0.95% : 0.000002s : 10: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.37% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000840 13 49.11% : 0.000412s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.65% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.24% : 0.000397s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029073 72 0.17% : 0.000050s : 1: add_recomputation 0.23% : 0.000067s : 1: auto_monad 0.06% : 0.000018s : 1: auto_monad_reorder 0.98% : 0.000284s : 1: bootstrap 0.10% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000023s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.69% : 0.005434s : 1: jit_opt_a 0.49% : 0.000142s : 1: jit_opt_after_cconv 0.17% : 0.000049s : 1: jit_opt_b 1.40% : 0.000407s : 1: loop_unroll 1.92% : 0.000558s : 1: mutable_eliminate 3.04% : 0.000885s : 26: opt.transform.jit_opt_a 0.15% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000023s : 4: opt.transform.jit_opt_b 0.04% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000442s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000098s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.81% : 0.000526s : 1: renormalize.infer 1.28% : 0.000373s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000039s : 1: rewriter_after_opt_a 1.24% : 0.000362s : 1: rewriter_before_opt_a 0.25% : 0.000071s : 1: symbol_engine_optimizer 65.21% : 0.018957s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.583.125 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.583.790 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.149603, [30] [bootstrap]: 0.00033179 [type_inference]: 0.137637 [event_method]: 1.922e-05 [auto_monad]: 6.632e-05 [graph_reusing]: 5.02e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00049574 [rewriter_before_opt_a]: 7.99e-05 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00865913, [2] [Cycle 1]: 0.00470694, [27] [switch_simplify]: 5.897e-05 [loop_unroll]: 2.987e-05 [a_1]: 0.00058743 [with_stream_mark]: 1.824e-05 [recompute_prepare]: 9.02e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 7e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.99999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00367501 [add_forward_monad_depend]: 7.23e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.588e-05 [cse]: 2.204e-05 [replace_applicator]: 1.823e-05 [Cycle 2]: 0.00036593, [27] [switch_simplify]: 6.48998e-06 [loop_unroll]: 5.69999e-06 [a_1]: 0.00012105 [with_stream_mark]: 1.173e-05 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.681e-05 [j_node_and_user_rematch]: 8.74998e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 1.092e-05 [replace_applicator]: 5.84999e-06 [py_interpret_to_execute_after_opt_a]: 1.172e-05 [rewriter_after_opt_a]: 3.265e-05 [convert_after_rewriter]: 7.00998e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00064218 [jit_opt_b]: 5.443e-05, [1] [Cycle 1]: 4.75e-05, [2] [frontend_op_eliminate]: 1.906e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00041152 [jit_opt_after_cconv]: 0.00015284, [1] [Cycle 1]: 0.00014635, [11] [c_1]: 2.418e-05 [parameter_eliminate]: 3.21001e-06 [updatestate_depend_eliminate]: 6.46999e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.255e-05 [call_graph_tuple_transform]: 2.159e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 7.67998e-06 [remove_dup_value]: 1.494e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 8.33999e-06 [add_recomputation]: 4.505e-05 [cse_after_recomputation]: 2.223e-05, [1] [Cycle 1]: 1.672e-05, [1] [cse]: 1.067e-05 [auto_monad_reorder]: 1.531e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 6.33e-06 [opt_after_jit_grad]: 0.00044982 [symbol_engine_optimizer]: 7.68e-05, [1] [Cycle 1]: 7.112e-05, [6] [build]: 3.64002e-06 [elim_shapecalc]: 7.78999e-06 [elim_not_effective]: 1.343e-05 [opt_reshape]: 6.81999e-06 [fold_const_symbol]: 1.039e-05 [renormalize]: 3.69997e-07 [validate]: 0.0001335 Sums bootstrap : 0.000332s : 0.23% type_inference : 0.137637s : 94.64% event_method : 0.000019s : 0.01% auto_monad : 0.000066s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000496s : 0.34% rewriter_before_opt_a : 0.000080s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000708s : 0.49% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003675s : 2.53% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000033s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000033s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000642s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000412s : 0.28% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000450s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000133s : 0.09% Time group info: ------[substitution.] 0.000221 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 1.28% : 0.000003s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 4: substitution.graph_param_transform 84.01% : 0.000186s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 5.49% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.137558 2 97.25% : 0.133770s : 1: type_inference.infer 2.75% : 0.003788s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.94% : 0.000055s : 4: replace.inline 33.06% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.33% : 0.000183s : 4: match.inline 5.67% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000001s : 12: predicate.environ_get_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.48% : 0.000001s : 4: predicate.graph_param_transform 5.67% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 2.19% : 0.000003s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.61% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002593 22 61.70% : 0.001600s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.24% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.06% : 0.000961s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154208 72 0.03% : 0.000048s : 1: add_recomputation 0.04% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000353s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 5.62% : 0.008662s : 1: jit_opt_a 0.10% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.27% : 0.000419s : 1: loop_unroll 0.42% : 0.000651s : 1: mutable_eliminate 0.61% : 0.000946s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000028s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000458s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000502s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.84% : 0.002834s : 1: renormalize.infer 0.54% : 0.000830s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.06% : 0.000085s : 1: rewriter_before_opt_a 0.05% : 0.000079s : 1: symbol_engine_optimizer 89.26% : 0.137650s : 1: type_inference TotalTime = 0.0318318, [30] [bootstrap]: 0.00037508 [type_inference]: 0.0224763 [event_method]: 2.058e-05 [auto_monad]: 6.877e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00011708 [rewriter_before_opt_a]: 8.372e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.0062807, [2] [Cycle 1]: 0.00212892, [27] [switch_simplify]: 6.164e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00058976 [with_stream_mark]: 2.148e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.90002e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.11998e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 8.81997e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.00107594 [add_forward_monad_depend]: 6.53e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.822e-05 [cse]: 3.576e-05 [replace_applicator]: 1.568e-05 [Cycle 2]: 0.00038562, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 5.18002e-06 [a_1]: 9.061e-05 [with_stream_mark]: 1.247e-05 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.81002e-06 [merge_forward]: 3.00998e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 8.08999e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.76001e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 7.36001e-06 [cse]: 5.863e-05 [replace_applicator]: 6.71e-06 [py_interpret_to_execute_after_opt_a]: 1.54e-05 [rewriter_after_opt_a]: 4.178e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00072076 [jit_opt_b]: 5.38e-05, [1] [Cycle 1]: 4.591e-05, [2] [frontend_op_eliminate]: 1.781e-05 [inline_after_opt_a]: 1.631e-05 [cconv]: 2.98e-05 [loop_unroll]: 0.00046017 [jit_opt_after_cconv]: 0.00015358, [1] [Cycle 1]: 0.0001471, [11] [c_1]: 2.222e-05 [parameter_eliminate]: 3.93001e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.557e-05 [call_graph_tuple_transform]: 2.066e-05 [tuple_list_get_item_eliminator]: 5.75001e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 7.08e-06 [add_recomputation]: 5.448e-05 [cse_after_recomputation]: 2.32e-05, [1] [Cycle 1]: 1.757e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.755e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00047802 [symbol_engine_optimizer]: 8.569e-05, [1] [Cycle 1]: 7.938e-05, [6] [build]: 3.52002e-06 [elim_shapecalc]: 7.62002e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 5.39e-06 [fold_const_symbol]: 2.269e-05 [renormalize]: 4.69998e-07 [validate]: 4.222e-05 Sums bootstrap : 0.000375s : 1.37% type_inference : 0.022476s : 81.80% event_method : 0.000021s : 0.07% auto_monad : 0.000069s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000117s : 0.43% rewriter_before_opt_a : 0.000084s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000680s : 2.48% jit_opt_a.with_stream_mark : 0.000034s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001076s : 3.92% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000094s : 0.34% jit_opt_a.replace_applicator : 0.000022s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000721s : 2.62% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000030s : 0.11% loop_unroll : 0.000460s : 1.67% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000054s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000478s : 1.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000023s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.15% Time group info: ------[substitution.] 0.000253 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000007s : 3: substitution.graph_param_transform 86.17% : 0.000218s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000005s : 2: substitution.replace_old_param 4.91% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022393 2 92.21% : 0.020649s : 1: type_inference.infer 7.79% : 0.001744s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.24% : 0.000050s : 4: replace.inline 31.76% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.96% : 0.000215s : 4: match.inline 5.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.84% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 2.00% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.45% : 0.000002s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000963 13 42.55% : 0.000410s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.90% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.55% : 0.000496s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033883 72 0.17% : 0.000057s : 1: add_recomputation 0.21% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.16% : 0.000392s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.55% : 0.006285s : 1: jit_opt_a 0.46% : 0.000156s : 1: jit_opt_after_cconv 0.17% : 0.000056s : 1: jit_opt_b 1.38% : 0.000468s : 1: loop_unroll 2.15% : 0.000729s : 1: mutable_eliminate 2.68% : 0.000908s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000046s : 4: opt.transform.symbol_engine_opt 1.43% : 0.000485s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000120s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.82% : 0.000616s : 1: renormalize.infer 1.33% : 0.000450s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000045s : 1: rewriter_after_opt_a 0.26% : 0.000087s : 1: rewriter_before_opt_a 0.26% : 0.000089s : 1: symbol_engine_optimizer 66.38% : 0.022492s : 1: type_inference TotalTime = 0.128725, [30] [bootstrap]: 0.00032409 [type_inference]: 0.116988 [event_method]: 2.37e-05 [auto_monad]: 7.463e-05 [graph_reusing]: 6.03998e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 0.00049507 [rewriter_before_opt_a]: 9.012e-05 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.00820216, [2] [Cycle 1]: 0.00417497, [27] [switch_simplify]: 5.977e-05 [loop_unroll]: 3.004e-05 [a_1]: 0.00061479 [with_stream_mark]: 2.209e-05 [recompute_prepare]: 8.64998e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 7.04001e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.585e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 6.73e-06 [renormalize]: 0.00308219 [add_forward_monad_depend]: 8.3e-06 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 1.854e-05 [cse]: 3.123e-05 [replace_applicator]: 1.8e-05 [Cycle 2]: 0.00036985, [27] [switch_simplify]: 7.55998e-06 [loop_unroll]: 6.68003e-06 [a_1]: 0.00012208 [with_stream_mark]: 1.347e-05 [recompute_prepare]: 5.87999e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.49998e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.81003e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 8.2e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.237e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 1.206e-05 [rewriter_after_opt_a]: 3.624e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00075271 [jit_opt_b]: 5.694e-05, [1] [Cycle 1]: 4.925e-05, [2] [frontend_op_eliminate]: 1.978e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 2.865e-05 [loop_unroll]: 0.0004607 [jit_opt_after_cconv]: 0.00015424, [1] [Cycle 1]: 0.000148, [11] [c_1]: 2.615e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 2.392e-05 [call_graph_tuple_transform]: 2.184e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 1.571e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 8.27e-06 [add_recomputation]: 4.983e-05 [cse_after_recomputation]: 2.384e-05, [1] [Cycle 1]: 1.891e-05, [1] [cse]: 1.294e-05 [auto_monad_reorder]: 1.613e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 4.98001e-06 [opt_after_jit_grad]: 0.00046814 [symbol_engine_optimizer]: 8.276e-05, [1] [Cycle 1]: 7.666e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 1.121e-05 [elim_not_effective]: 1.525e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 1.131e-05 [renormalize]: 4.69998e-07 [validate]: 0.00012637 Sums bootstrap : 0.000324s : 0.26% type_inference : 0.116988s : 94.00% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000495s : 0.40% rewriter_before_opt_a : 0.000090s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000737s : 0.59% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003082s : 2.48% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000753s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000461s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000468s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000126s : 0.10% Time group info: ------[substitution.] 0.000245 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000006s : 4: substitution.graph_param_transform 85.29% : 0.000209s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 5.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116890 2 97.23% : 0.113649s : 1: type_inference.infer 2.77% : 0.003241s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.77% : 0.000051s : 4: replace.inline 31.23% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 6 94.59% : 0.000206s : 4: match.inline 5.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.76% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.91% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.77% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.64% : 0.000002s : 12: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.56% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.48% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002282 22 66.43% : 0.001516s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.26% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.31% : 0.000715s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132763 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000341s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.18% : 0.008206s : 1: jit_opt_a 0.12% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.35% : 0.000469s : 1: loop_unroll 0.57% : 0.000762s : 1: mutable_eliminate 0.74% : 0.000978s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000502s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.72% : 0.002290s : 1: renormalize.infer 0.59% : 0.000781s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 88.13% : 0.117008s : 1: type_inference TotalTime = 0.440211, [30] [bootstrap]: 0.00037429 [type_inference]: 0.381377 [event_method]: 2.387e-05 [auto_monad]: 7.53e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.96999e-06 [py_interpret_to_execute]: 0.0005687 [rewriter_before_opt_a]: 0.00010538 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.0549257, [2] [Cycle 1]: 0.0509312, [27] [switch_simplify]: 7.103e-05 [loop_unroll]: 3.542e-05 [a_1]: 0.00076912 [with_stream_mark]: 2.364e-05 [recompute_prepare]: 1.04e-05 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 2.50997e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 7.69002e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 1.134e-05 [meta_fg_expand]: 3.03e-06 [replace_old_param]: 1.257e-05 [inline_without_move]: 6.81001e-06 [renormalize]: 0.0496204 [add_forward_monad_depend]: 8.83001e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 2.078e-05 [cse]: 3.899e-05 [replace_applicator]: 2.064e-05 [Cycle 2]: 0.00043834, [27] [switch_simplify]: 7.87e-06 [loop_unroll]: 6.71e-06 [a_1]: 0.00014597 [with_stream_mark]: 1.475e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 7.56001e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.03997e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 4.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.45001e-06 [inline_without_move]: 5.86e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.62002e-06 [cse]: 1.604e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.779e-05 [rewriter_after_opt_a]: 4.305e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 5.50001e-06 [mutable_eliminate]: 0.0007836 [jit_opt_b]: 8.593e-05, [1] [Cycle 1]: 7.517e-05, [2] [frontend_op_eliminate]: 4.232e-05 [inline_after_opt_a]: 1.853e-05 [cconv]: 3.105e-05 [loop_unroll]: 0.00045175 [jit_opt_after_cconv]: 0.00016415, [1] [Cycle 1]: 0.00015608, [11] [c_1]: 2.753e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 4.37e-06 [updatestate_loads_eliminate]: 2.81999e-06 [cse]: 2.587e-05 [call_graph_tuple_transform]: 2.158e-05 [tuple_list_get_item_eliminator]: 6.18002e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.907e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 1.123e-05 [add_recomputation]: 6.36e-05 [cse_after_recomputation]: 2.872e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.375e-05 [auto_monad_reorder]: 1.827e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 6.76999e-06 [opt_after_jit_grad]: 0.00046717 [symbol_engine_optimizer]: 8.942e-05, [1] [Cycle 1]: 8.303e-05, [6] [build]: 4.3e-06 [elim_shapecalc]: 9.15999e-06 [elim_not_effective]: 1.832e-05 [opt_reshape]: 6.89001e-06 [fold_const_symbol]: 1.084e-05 [renormalize]: 4.60015e-07 [validate]: 5.397e-05 Sums bootstrap : 0.000374s : 0.09% type_inference : 0.381377s : 87.52% event_method : 0.000024s : 0.01% auto_monad : 0.000075s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000569s : 0.13% rewriter_before_opt_a : 0.000105s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000915s : 0.21% jit_opt_a.with_stream_mark : 0.000038s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.049621s : 11.39% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000055s : 0.01% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000784s : 0.18% jit_opt_b.frontend_op_eliminate : 0.000042s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000031s : 0.01% loop_unroll : 0.000452s : 0.10% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000064s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000467s : 0.11% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.01% Time group info: ------[substitution.] 0.000304 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 4: substitution.graph_param_transform 83.40% : 0.000253s : 5: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.25% : 0.000013s : 3: substitution.reduce_eliminate 1.88% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000005s : 2: substitution.replace_old_param 4.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.381286 2 99.02% : 0.377543s : 1: type_inference.infer 0.98% : 0.003744s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.71% : 0.000077s : 5: replace.inline 31.29% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 95.57% : 0.000250s : 5: match.inline 4.43% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000003s : 13: predicate.addn_zero_filter 2.20% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.85% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.62% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.02% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.24% : 0.000002s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 20: predicate.switch_defer_inline 1.95% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000011s : 64: predicate.switch_simplify 1.50% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.38% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.01% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003069 25 57.58% : 0.001767s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.43% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.00% : 0.001227s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.491069 72 0.01% : 0.000067s : 1: add_recomputation 0.02% : 0.000078s : 1: auto_monad 0.00% : 0.000024s : 1: auto_monad_reorder 0.08% : 0.000392s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.19% : 0.054930s : 1: jit_opt_a 0.03% : 0.000167s : 1: jit_opt_after_cconv 0.02% : 0.000089s : 1: jit_opt_b 0.09% : 0.000460s : 1: loop_unroll 0.16% : 0.000792s : 1: mutable_eliminate 0.24% : 0.001190s : 26: opt.transform.jit_opt_a 0.01% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000054s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.10% : 0.000474s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.12% : 0.000576s : 1: py_interpret_to_execute 0.00% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 9.84% : 0.048345s : 1: renormalize.infer 0.26% : 0.001262s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.02% : 0.000109s : 1: rewriter_before_opt_a 0.05% : 0.000258s : 1: symbol_engine_optimizer 77.67% : 0.381398s : 1: type_inference TotalTime = 0.031629, [30] [bootstrap]: 0.00030668 [type_inference]: 0.0216518 [event_method]: 2.046e-05 [auto_monad]: 6.714e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00011425 [rewriter_before_opt_a]: 8.267e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00670871, [2] [Cycle 1]: 0.00248631, [27] [switch_simplify]: 5.731e-05 [loop_unroll]: 3.053e-05 [a_1]: 0.00056275 [with_stream_mark]: 2.281e-05 [recompute_prepare]: 9.97999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.73997e-06 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00143145 [add_forward_monad_depend]: 8.79998e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 2.009e-05 [cse]: 3.638e-05 [replace_applicator]: 1.883e-05 [Cycle 2]: 0.0003565, [27] [switch_simplify]: 6.61e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.691e-05 [with_stream_mark]: 1.413e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 3.51999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 8.42998e-06 [cse]: 1.489e-05 [replace_applicator]: 6.62002e-06 [py_interpret_to_execute_after_opt_a]: 1.634e-05 [rewriter_after_opt_a]: 4.363e-05 [convert_after_rewriter]: 8.32e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00077735 [jit_opt_b]: 5.392e-05, [1] [Cycle 1]: 4.467e-05, [2] [frontend_op_eliminate]: 1.764e-05 [inline_after_opt_a]: 1.629e-05 [cconv]: 2.693e-05 [loop_unroll]: 0.00049492 [jit_opt_after_cconv]: 0.00015923, [1] [Cycle 1]: 0.00015163, [11] [c_1]: 2.181e-05 [parameter_eliminate]: 3.06999e-06 [updatestate_depend_eliminate]: 6.15002e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.848e-05 [call_graph_tuple_transform]: 2.131e-05 [tuple_list_get_item_eliminator]: 5.99999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.496e-05 [partial_unused_args_eliminate]: 2.79001e-06 [environ_conv]: 6.93998e-06 [add_recomputation]: 5.646e-05 [cse_after_recomputation]: 2.327e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.225e-05 [auto_monad_reorder]: 1.707e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.91998e-06 [opt_after_jit_grad]: 0.00061183 [symbol_engine_optimizer]: 0.00011227, [1] [Cycle 1]: 0.00010506, [6] [build]: 4.70999e-06 [elim_shapecalc]: 9.19e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 4.137e-05 [renormalize]: 4.2998e-07 [validate]: 4.639e-05 Sums bootstrap : 0.000307s : 1.13% type_inference : 0.021652s : 79.75% event_method : 0.000020s : 0.08% auto_monad : 0.000067s : 0.25% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000114s : 0.42% rewriter_before_opt_a : 0.000083s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000660s : 2.43% jit_opt_a.with_stream_mark : 0.000037s : 0.14% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001432s : 5.27% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.11% jit_opt_a.cse : 0.000051s : 0.19% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000044s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000777s : 2.86% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000495s : 1.82% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000056s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000612s : 2.25% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000041s : 0.15% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.17% Time group info: ------[substitution.] 0.000215 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 3.12% : 0.000007s : 3: substitution.graph_param_transform 82.39% : 0.000177s : 4: substitution.inline 1.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.53% : 0.000005s : 2: substitution.replace_old_param 5.97% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021576 2 92.39% : 0.019933s : 1: type_inference.infer 7.61% : 0.001643s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.23% : 0.000049s : 4: replace.inline 31.77% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 6 93.73% : 0.000174s : 4: match.inline 6.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.78% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.04% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.69% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.64% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000007s : 22: predicate.inline 1.08% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 15: predicate.load_eliminater 1.68% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.51% : 0.000002s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.75% : 0.000001s : 3: predicate.reset_defer_inline 1.04% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.27% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000002s : 10: predicate.transpose_eliminate 1.24% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001171 13 33.24% : 0.000389s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.05% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 63.71% : 0.000746s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034046 72 0.17% : 0.000059s : 1: add_recomputation 0.21% : 0.000070s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 0.95% : 0.000322s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.71% : 0.006712s : 1: jit_opt_a 0.48% : 0.000162s : 1: jit_opt_after_cconv 0.17% : 0.000056s : 1: jit_opt_b 1.48% : 0.000503s : 1: loop_unroll 2.31% : 0.000787s : 1: mutable_eliminate 2.64% : 0.000898s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000066s : 4: opt.transform.symbol_engine_opt 1.82% : 0.000621s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000118s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.92% : 0.000652s : 1: renormalize.infer 2.26% : 0.000770s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000047s : 1: rewriter_after_opt_a 0.25% : 0.000086s : 1: rewriter_before_opt_a 0.34% : 0.000115s : 1: symbol_engine_optimizer 63.64% : 0.021668s : 1: type_inference TotalTime = 0.139173, [30] [bootstrap]: 0.00024015 [type_inference]: 0.112442 [event_method]: 0.00039087 [auto_monad]: 0.00010564 [graph_reusing]: 7.03e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00014505 [rewriter_before_opt_a]: 0.00012041 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.0234335, [3] [Cycle 1]: 0.0161762, [27] [switch_simplify]: 6.999e-05 [loop_unroll]: 4.098e-05 [a_1]: 0.00094471 [with_stream_mark]: 3.277e-05 [recompute_prepare]: 2.101e-05 [updatestate_depend_eliminate]: 9.20999e-06 [updatestate_assign_eliminate]: 7.92998e-06 [updatestate_loads_eliminate]: 7.11001e-06 [parameter_eliminate]: 3.16001e-06 [specialize_transform]: 1.479e-05 [updatestate_useless_node_eliminater]: 1.328e-05 [accelerated_algorithm]: 1.344e-05 [meta_shard_fg_expand]: 3.74002e-06 [get_grad_eliminate_]: 1.353e-05 [merge_forward]: 9.13002e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.765e-05 [j_node_and_user_rematch]: 2.451e-05 [meta_fg_expand]: 0.00174474 [replace_old_param]: 7.206e-05 [inline_without_move]: 5.839e-05 [renormalize]: 0.0123708 [add_forward_monad_depend]: 1.344e-05 [auto_monad_grad]: 5.89e-06 [auto_monad_eliminator]: 6.095e-05 [cse]: 0.00024997 [replace_applicator]: 9.113e-05 [Cycle 2]: 0.00360593, [27] [switch_simplify]: 4.355e-05 [loop_unroll]: 4.174e-05 [a_1]: 0.00117519 [with_stream_mark]: 1.765e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.48998e-06 [specialize_transform]: 7.61999e-06 [updatestate_useless_node_eliminater]: 6.83e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 3.31001e-06 [get_grad_eliminate_]: 6.46e-06 [merge_forward]: 4.54002e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.745e-05 [j_node_and_user_rematch]: 1.144e-05 [meta_fg_expand]: 6.953e-05 [replace_old_param]: 7.83001e-06 [inline_without_move]: 6.84999e-06 [renormalize]: 0.00190139 [add_forward_monad_depend]: 8.50999e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.661e-05 [cse]: 2.869e-05 [replace_applicator]: 1.612e-05 [Cycle 3]: 0.00025638, [27] [switch_simplify]: 3.96001e-06 [loop_unroll]: 3.43e-06 [a_1]: 3.878e-05 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 4.08999e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 1.97999e-06 [updatestate_loads_eliminate]: 1.69998e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 3.46999e-06 [updatestate_useless_node_eliminater]: 3.23e-06 [accelerated_algorithm]: 3.10002e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 3.12002e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.266e-05 [j_node_and_user_rematch]: 5.72999e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 3.45003e-06 [inline_without_move]: 3.08e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 3.9e-06 [cse]: 9.35001e-06 [replace_applicator]: 3.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.282e-05 [rewriter_after_opt_a]: 3.544e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 4.13999e-06 [mutable_eliminate]: 0.00075223 [jit_opt_b]: 4.114e-05, [1] [Cycle 1]: 3.349e-05, [2] [frontend_op_eliminate]: 1.046e-05 [inline_after_opt_a]: 1.099e-05 [cconv]: 2.713e-05 [loop_unroll]: 0.00043235 [jit_opt_after_cconv]: 0.00013154, [1] [Cycle 1]: 0.00012491, [11] [c_1]: 1.19e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 6.46e-06 [updatestate_assign_eliminate]: 1.92001e-06 [updatestate_loads_eliminate]: 1.82999e-06 [cse]: 2.178e-05 [call_graph_tuple_transform]: 1.407e-05 [tuple_list_get_item_eliminator]: 3.6e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 3.79002e-06 [remove_dup_value]: 1.464e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 5.47001e-06 [add_recomputation]: 3.789e-05 [cse_after_recomputation]: 1.985e-05, [1] [Cycle 1]: 1.432e-05, [1] [cse]: 7.88999e-06 [auto_monad_reorder]: 1.303e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 6.53e-06 [opt_after_jit_grad]: 0.00043557 [symbol_engine_optimizer]: 6.405e-05, [1] [Cycle 1]: 5.815e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 5.40001e-06 [elim_not_effective]: 9.37001e-06 [opt_reshape]: 4.77e-06 [fold_const_symbol]: 5.35999e-06 [renormalize]: 3.50003e-07 [validate]: 3.341e-05 Sums bootstrap : 0.000240s : 0.18% type_inference : 0.112442s : 83.36% event_method : 0.000391s : 0.29% auto_monad : 0.000106s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000145s : 0.11% rewriter_before_opt_a : 0.000120s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000118s : 0.09% jit_opt_a.loop_unroll : 0.000086s : 0.06% jit_opt_a.a_1 : 0.002159s : 1.60% jit_opt_a.with_stream_mark : 0.000062s : 0.05% jit_opt_a.recompute_prepare : 0.000034s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.03% jit_opt_a.meta_fg_expand : 0.001816s : 1.35% jit_opt_a.replace_old_param : 0.000083s : 0.06% jit_opt_a.inline_without_move : 0.000068s : 0.05% jit_opt_a.renormalize : 0.014272s : 10.58% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.06% jit_opt_a.cse : 0.000288s : 0.21% jit_opt_a.replace_applicator : 0.000111s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000752s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000432s : 0.32% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000436s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000005s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.02% Time group info: ------[substitution.] 0.000544 104 0.25% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.86% : 0.000005s : 1: substitution.graph_param_transform 61.51% : 0.000334s : 12: substitution.inline 3.03% : 0.000016s : 2: substitution.inline_without_move 1.63% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.09% : 0.000011s : 7: substitution.minmaximum_grad 1.46% : 0.000008s : 5: substitution.partial_eliminate 1.91% : 0.000010s : 12: substitution.remove_not_recompute_node 5.64% : 0.000031s : 10: substitution.replace_applicator 1.85% : 0.000010s : 10: substitution.replace_old_param 1.37% : 0.000007s : 1: substitution.reshape_eliminate 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.10% : 0.000006s : 1: substitution.tile_eliminate 5.81% : 0.000032s : 7: substitution.tuple_list_convert_item_index_to_positive 2.79% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 8.02% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112346 2 97.55% : 0.109595s : 1: type_inference.infer 2.45% : 0.002751s : 1: type_inference.specialize ------[replace.] 0.000166 19 64.37% : 0.000107s : 12: replace.inline 35.63% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000349 19 93.82% : 0.000327s : 12: match.inline 6.18% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000362 2544 1.55% : 0.000006s : 44: predicate.accumulaten_eliminater 0.50% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.48% : 0.000005s : 44: predicate.addn_check_dump 1.71% : 0.000006s : 44: predicate.addn_zero_filter 2.01% : 0.000007s : 44: predicate.arithmetic_simplify 1.65% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.45% : 0.000005s : 44: predicate.compare_switch_simplify 1.50% : 0.000005s : 44: predicate.depend_value_elim 1.51% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.57% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.23% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.51% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.51% : 0.000005s : 44: predicate.environ_get_depend_swap 1.54% : 0.000006s : 44: predicate.environ_get_eliminate 1.46% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.34% : 0.000016s : 65: predicate.inline 1.99% : 0.000007s : 46: predicate.inline_without_move 0.38% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.92% : 0.000003s : 18: predicate.less_batch_normalization 1.87% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.86% : 0.000007s : 52: predicate.load_eliminater 0.27% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.37% : 0.000012s : 89: predicate.loop_unroll_before_grad 1.80% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.46% : 0.000005s : 44: predicate.merge_addn 1.55% : 0.000006s : 44: predicate.minmaximum_grad 0.39% : 0.000001s : 1: predicate.mutable_eliminate 0.20% : 0.000001s : 1: predicate.opt_reshape 2.34% : 0.000008s : 52: predicate.partial_eliminate 1.58% : 0.000006s : 44: predicate.print_const_string_wrapper 2.04% : 0.000007s : 44: predicate.reduce_eliminate 1.92% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000002s : 18: predicate.remove_not_recompute_node 2.82% : 0.000010s : 97: predicate.replace_applicator 1.28% : 0.000005s : 46: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 44: predicate.reshape_eliminate 1.54% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.65% : 0.000006s : 44: predicate.same_eliminate 0.49% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.12% : 0.000000s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 18: predicate.specialize_transform 1.74% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000005s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.85% : 0.000010s : 63: predicate.switch_defer_inline 2.47% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.31% : 0.000023s : 153: predicate.switch_simplify 1.54% : 0.000006s : 44: predicate.tile_eliminate 1.59% : 0.000006s : 44: predicate.transpose_eliminate 1.88% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.92% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.81% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.84% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003378 43 75.46% : 0.002549s : 27: func_graph_cloner_run.FuncGraphClonerGraph 24.54% : 0.000829s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156242 87 0.03% : 0.000041s : 1: add_recomputation 0.07% : 0.000111s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.17% : 0.000267s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.26% : 0.000401s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.00% : 0.023437s : 1: jit_opt_a 0.09% : 0.000134s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.28% : 0.000440s : 1: loop_unroll 0.49% : 0.000762s : 1: mutable_eliminate 1.80% : 0.002805s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000444s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000150s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.78% : 0.012156s : 2: renormalize.infer 1.34% : 0.002095s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000124s : 1: rewriter_before_opt_a 0.04% : 0.000067s : 1: symbol_engine_optimizer 71.98% : 0.112464s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.751.872 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f0d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.752.586 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.013788, [30] [bootstrap]: 0.00033906 [type_inference]: 0.00500501 [event_method]: 1.831e-05 [auto_monad]: 6.371e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 3.383e-05 [rewriter_before_opt_a]: 7.616e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00543425, [2] [Cycle 1]: 0.00168021, [27] [switch_simplify]: 5.885e-05 [loop_unroll]: 3.12e-05 [a_1]: 0.00055031 [with_stream_mark]: 2.069e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 0.00067926 [add_forward_monad_depend]: 5.77001e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.571e-05 [cse]: 3.43e-05 [replace_applicator]: 1.201e-05 [Cycle 2]: 0.0003135, [27] [switch_simplify]: 5.44e-06 [loop_unroll]: 4.79998e-06 [a_1]: 8.588e-05 [with_stream_mark]: 1.017e-05 [recompute_prepare]: 4.75999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.65001e-06 [accelerated_algorithm]: 5.01002e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 4.47e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.251e-05 [j_node_and_user_rematch]: 7.52002e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 6.66e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.298e-05 [replace_applicator]: 5.33002e-06 [py_interpret_to_execute_after_opt_a]: 1.288e-05 [rewriter_after_opt_a]: 4.227e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00055636 [jit_opt_b]: 4.883e-05, [1] [Cycle 1]: 4.146e-05, [2] [frontend_op_eliminate]: 1.495e-05 [inline_after_opt_a]: 1.519e-05 [cconv]: 2.753e-05 [loop_unroll]: 0.00039783 [jit_opt_after_cconv]: 0.00015649, [1] [Cycle 1]: 0.00015008, [11] [c_1]: 1.962e-05 [parameter_eliminate]: 3.36999e-06 [updatestate_depend_eliminate]: 7.34002e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.639e-05 [call_graph_tuple_transform]: 1.963e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.24998e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.633e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 5.184e-05 [cse_after_recomputation]: 2.447e-05, [1] [Cycle 1]: 1.914e-05, [1] [cse]: 1.337e-05 [auto_monad_reorder]: 0.00062468 [get_jit_bprop_graph]: 3.06001e-06 [rewriter_after_jit_bprop_graph]: 6.61e-06 [opt_after_jit_grad]: 0.00050591 [symbol_engine_optimizer]: 7.701e-05, [1] [Cycle 1]: 6.931e-05, [6] [build]: 4.28001e-06 [elim_shapecalc]: 7.38e-06 [elim_not_effective]: 1.447e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 9.48997e-06 [renormalize]: 5.69999e-07 [validate]: 4.088e-05 Sums bootstrap : 0.000339s : 3.48% type_inference : 0.005005s : 51.40% event_method : 0.000018s : 0.19% auto_monad : 0.000064s : 0.65% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.35% rewriter_before_opt_a : 0.000076s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.66% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000636s : 6.53% jit_opt_a.with_stream_mark : 0.000031s : 0.32% jit_opt_a.recompute_prepare : 0.000012s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000679s : 6.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.22% jit_opt_a.cse : 0.000047s : 0.49% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000042s : 0.43% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000556s : 5.71% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000028s : 0.28% loop_unroll : 0.000398s : 4.09% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000052s : 0.53% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000625s : 6.41% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000506s : 5.20% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.42% Time group info: ------[substitution.] 0.000214 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 3: substitution.graph_param_transform 83.98% : 0.000179s : 4: substitution.inline 1.75% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000004s : 4: substitution.remove_not_recompute_node 1.62% : 0.000003s : 2: substitution.replace_old_param 6.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004925 2 83.48% : 0.004111s : 1: type_inference.infer 16.52% : 0.000813s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.06% : 0.000046s : 4: replace.inline 32.94% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.63% : 0.000177s : 4: match.inline 6.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.09% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.27% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.25% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.63% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.59% : 0.000003s : 3: predicate.mutable_eliminate 0.74% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000009s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000658 13 54.86% : 0.000361s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.36% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.78% : 0.000249s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015370 72 0.36% : 0.000055s : 1: add_recomputation 0.43% : 0.000067s : 1: auto_monad 4.14% : 0.000637s : 1: auto_monad_reorder 2.33% : 0.000358s : 1: bootstrap 0.20% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.04% : 0.000007s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.38% : 0.005437s : 1: jit_opt_a 1.03% : 0.000159s : 1: jit_opt_after_cconv 0.33% : 0.000051s : 1: jit_opt_b 2.64% : 0.000406s : 1: loop_unroll 3.69% : 0.000566s : 1: mutable_eliminate 5.52% : 0.000849s : 26: opt.transform.jit_opt_a 0.31% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.16% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000514s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000036s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.40% : 0.000368s : 1: renormalize.infer 1.98% : 0.000304s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000046s : 1: rewriter_after_opt_a 0.52% : 0.000079s : 1: rewriter_before_opt_a 0.52% : 0.000080s : 1: symbol_engine_optimizer 32.68% : 0.005023s : 1: type_inference TotalTime = 0.0313841, [30] [bootstrap]: 0.00038439 [type_inference]: 0.021967 [event_method]: 2.094e-05 [auto_monad]: 0.00021123 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00011946 [rewriter_before_opt_a]: 8.314e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00618112, [2] [Cycle 1]: 0.00207247, [27] [switch_simplify]: 5.846e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00055888 [with_stream_mark]: 1.877e-05 [recompute_prepare]: 8.72e-06 [updatestate_depend_eliminate]: 3.85998e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 9.73002e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00104106 [add_forward_monad_depend]: 6.79999e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.581e-05 [cse]: 3.414e-05 [replace_applicator]: 1.846e-05 [Cycle 2]: 0.00034006, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 5.25999e-06 [a_1]: 9.128e-05 [with_stream_mark]: 1.076e-05 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 7.3e-06 [inline_without_move]: 4.72998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 7.97998e-06 [cse]: 1.408e-05 [replace_applicator]: 6.92002e-06 [py_interpret_to_execute_after_opt_a]: 1.184e-05 [rewriter_after_opt_a]: 4.204e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00067766 [jit_opt_b]: 5.344e-05, [1] [Cycle 1]: 4.559e-05, [2] [frontend_op_eliminate]: 1.629e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 2.66e-05 [loop_unroll]: 0.00049715 [jit_opt_after_cconv]: 0.00015185, [1] [Cycle 1]: 0.00014506, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 3.08998e-06 [updatestate_depend_eliminate]: 6.52001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 3.21001e-06 [cse]: 2.479e-05 [call_graph_tuple_transform]: 2.089e-05 [tuple_list_get_item_eliminator]: 6.03002e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.492e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 6.11998e-06 [add_recomputation]: 4.972e-05 [cse_after_recomputation]: 2.314e-05, [1] [Cycle 1]: 1.726e-05, [1] [cse]: 1.155e-05 [auto_monad_reorder]: 1.889e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 4.16001e-06 [opt_after_jit_grad]: 0.000504 [symbol_engine_optimizer]: 8.66e-05, [1] [Cycle 1]: 6.406e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.192e-05 [opt_reshape]: 5.28002e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 4.50003e-07 [validate]: 4.056e-05 Sums bootstrap : 0.000384s : 1.42% type_inference : 0.021967s : 81.37% event_method : 0.000021s : 0.08% auto_monad : 0.000211s : 0.78% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000119s : 0.44% rewriter_before_opt_a : 0.000083s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000650s : 2.41% jit_opt_a.with_stream_mark : 0.000030s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001041s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000048s : 0.18% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000042s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000678s : 2.51% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000027s : 0.10% loop_unroll : 0.000497s : 1.84% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000504s : 1.87% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.15% Time group info: ------[substitution.] 0.000215 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000006s : 3: substitution.graph_param_transform 83.18% : 0.000179s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 6.76% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021894 2 92.55% : 0.020262s : 1: type_inference.infer 7.45% : 0.001632s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.06% : 0.000052s : 4: replace.inline 32.94% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 92.88% : 0.000176s : 4: match.inline 7.12% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.33% : 0.000003s : 10: predicate.arithmetic_simplify 1.48% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.50% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000006s : 22: predicate.inline 1.08% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.87% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.53% : 0.000002s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 5.10% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000901 13 44.30% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.79% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.91% : 0.000468s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033364 72 0.16% : 0.000052s : 1: add_recomputation 0.65% : 0.000218s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.21% : 0.000402s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.54% : 0.006185s : 1: jit_opt_a 0.47% : 0.000156s : 1: jit_opt_after_cconv 0.17% : 0.000056s : 1: jit_opt_b 1.51% : 0.000505s : 1: loop_unroll 2.06% : 0.000686s : 1: mutable_eliminate 2.63% : 0.000879s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000512s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000123s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.67% : 0.000558s : 1: renormalize.infer 1.42% : 0.000475s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000045s : 1: rewriter_after_opt_a 0.26% : 0.000087s : 1: rewriter_before_opt_a 0.27% : 0.000090s : 1: symbol_engine_optimizer 65.89% : 0.021982s : 1: type_inference TotalTime = 0.0822353, [30] [bootstrap]: 0.00042151 [type_inference]: 0.0706082 [event_method]: 2.492e-05 [auto_monad]: 8.107e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 0.00035522 [rewriter_before_opt_a]: 0.00011569 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.00798401, [2] [Cycle 1]: 0.00386661, [27] [switch_simplify]: 7.065e-05 [loop_unroll]: 3.587e-05 [a_1]: 0.00072291 [with_stream_mark]: 1.933e-05 [recompute_prepare]: 9.31e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.92998e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.75e-06 [updatestate_useless_node_eliminater]: 7e-06 [accelerated_algorithm]: 7.56001e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.94999e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 1.101e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 6.41e-06 [renormalize]: 0.00264451 [add_forward_monad_depend]: 6.68e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.681e-05 [cse]: 3.674e-05 [replace_applicator]: 1.736e-05 [Cycle 2]: 0.00038927, [27] [switch_simplify]: 7.48e-06 [loop_unroll]: 5.99999e-06 [a_1]: 0.00012643 [with_stream_mark]: 1.171e-05 [recompute_prepare]: 6.64999e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.41998e-06 [specialize_transform]: 6.57002e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.13998e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.678e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 6.23998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.523e-05 [replace_applicator]: 6.77002e-06 [py_interpret_to_execute_after_opt_a]: 1.558e-05 [rewriter_after_opt_a]: 4.164e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00069645 [jit_opt_b]: 6.568e-05, [1] [Cycle 1]: 5.753e-05, [2] [frontend_op_eliminate]: 2.152e-05 [inline_after_opt_a]: 2.31e-05 [cconv]: 3.045e-05 [loop_unroll]: 0.00053821 [jit_opt_after_cconv]: 0.00018385, [1] [Cycle 1]: 0.00017711, [11] [c_1]: 2.764e-05 [parameter_eliminate]: 4.33001e-06 [updatestate_depend_eliminate]: 8.03001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 3.533e-05 [call_graph_tuple_transform]: 2.512e-05 [tuple_list_get_item_eliminator]: 6.92002e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 7.92e-06 [remove_dup_value]: 2.08e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 1.052e-05 [add_recomputation]: 5.342e-05 [cse_after_recomputation]: 2.557e-05, [1] [Cycle 1]: 2.01e-05, [1] [cse]: 1.409e-05 [auto_monad_reorder]: 1.826e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 6.34999e-06 [opt_after_jit_grad]: 0.00049034 [symbol_engine_optimizer]: 7.987e-05, [1] [Cycle 1]: 7.389e-05, [6] [build]: 4.13001e-06 [elim_shapecalc]: 9.34e-06 [elim_not_effective]: 1.377e-05 [opt_reshape]: 7.92e-06 [fold_const_symbol]: 1.09e-05 [renormalize]: 4.10015e-07 [validate]: 0.0001449 Sums bootstrap : 0.000422s : 0.54% type_inference : 0.070608s : 90.66% event_method : 0.000025s : 0.03% auto_monad : 0.000081s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000355s : 0.46% rewriter_before_opt_a : 0.000116s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.10% jit_opt_a.loop_unroll : 0.000042s : 0.05% jit_opt_a.a_1 : 0.000849s : 1.09% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002645s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000052s : 0.07% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000042s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000696s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000023s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000538s : 0.69% jit_opt_after_cconv.c_1 : 0.000028s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000053s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000490s : 0.63% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000145s : 0.19% Time group info: ------[substitution.] 0.000261 25 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.93% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000006s : 4: substitution.graph_param_transform 85.88% : 0.000224s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 4.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.070499 2 95.12% : 0.067061s : 1: type_inference.infer 4.88% : 0.003438s : 1: type_inference.specialize ------[replace.] 0.000116 7 66.27% : 0.000077s : 5: replace.inline 33.73% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 7 94.99% : 0.000221s : 5: match.inline 5.01% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 888 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.25% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.70% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.46% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.20% : 0.000002s : 13: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 1.81% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.97% : 0.000004s : 20: predicate.switch_defer_inline 2.34% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.11% : 0.000010s : 65: predicate.switch_simplify 1.15% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.63% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003152 29 71.32% : 0.002248s : 20: func_graph_cloner_run.FuncGraphClonerGraph 1.95% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.73% : 0.000842s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.085984 72 0.07% : 0.000056s : 1: add_recomputation 0.10% : 0.000085s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.51% : 0.000435s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.29% : 0.007988s : 1: jit_opt_a 0.22% : 0.000187s : 1: jit_opt_after_cconv 0.08% : 0.000068s : 1: jit_opt_b 0.64% : 0.000547s : 1: loop_unroll 0.82% : 0.000708s : 1: mutable_eliminate 1.30% : 0.001118s : 26: opt.transform.jit_opt_a 0.07% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000036s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000361s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 2.11% : 0.001812s : 1: renormalize.infer 0.96% : 0.000824s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000045s : 1: rewriter_after_opt_a 0.14% : 0.000122s : 1: rewriter_before_opt_a 0.10% : 0.000082s : 1: symbol_engine_optimizer 82.14% : 0.070628s : 1: type_inference TotalTime = 0.0337577, [30] [bootstrap]: 0.00034337 [type_inference]: 0.0239672 [event_method]: 2.303e-05 [auto_monad]: 7.467e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 0.00011271 [rewriter_before_opt_a]: 8.919e-05 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00643327, [2] [Cycle 1]: 0.00210827, [27] [switch_simplify]: 6.229e-05 [loop_unroll]: 2.948e-05 [a_1]: 0.00056813 [with_stream_mark]: 2.602e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 5.65001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 0.00103907 [add_forward_monad_depend]: 7.98001e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.891e-05 [cse]: 3.834e-05 [replace_applicator]: 2.211e-05 [Cycle 2]: 0.00034456, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.383e-05 [with_stream_mark]: 1.441e-05 [recompute_prepare]: 5.69999e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 3.25e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 8.70999e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 7.35003e-06 [cse]: 1.359e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 1.528e-05 [rewriter_after_opt_a]: 4.259e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00083891 [jit_opt_b]: 5.44e-05, [1] [Cycle 1]: 4.593e-05, [2] [frontend_op_eliminate]: 1.646e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 3.206e-05 [loop_unroll]: 0.00052141 [jit_opt_after_cconv]: 0.00017728, [1] [Cycle 1]: 0.0001708, [11] [c_1]: 2.161e-05 [parameter_eliminate]: 5.66e-06 [updatestate_depend_eliminate]: 1.062e-05 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 3.776e-05 [call_graph_tuple_transform]: 2.503e-05 [tuple_list_get_item_eliminator]: 5.78002e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 4.70027e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 1.629e-05 [partial_unused_args_eliminate]: 3.08998e-06 [environ_conv]: 7.04001e-06 [add_recomputation]: 5.744e-05 [cse_after_recomputation]: 2.345e-05, [1] [Cycle 1]: 1.813e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 7.43e-06 [opt_after_jit_grad]: 0.00052131 [symbol_engine_optimizer]: 0.00012173, [1] [Cycle 1]: 0.0001149, [6] [build]: 5.10999e-06 [elim_shapecalc]: 7.2e-06 [elim_not_effective]: 1.214e-05 [opt_reshape]: 6.92002e-06 [fold_const_symbol]: 5.473e-05 [renormalize]: 2.3999e-07 [validate]: 4.948e-05 Sums bootstrap : 0.000343s : 1.18% type_inference : 0.023967s : 82.18% event_method : 0.000023s : 0.08% auto_monad : 0.000075s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000113s : 0.39% rewriter_before_opt_a : 0.000089s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000662s : 2.27% jit_opt_a.with_stream_mark : 0.000040s : 0.14% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001039s : 3.56% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000028s : 0.10% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000043s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000839s : 2.88% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000032s : 0.11% loop_unroll : 0.000521s : 1.79% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000038s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000057s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000521s : 1.79% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000055s : 0.19% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.17% Time group info: ------[substitution.] 0.000284 23 0.67% : 0.000002s : 2: substitution.elim_not_effective 16.45% : 0.000047s : 2: substitution.fold_const_symbol 2.09% : 0.000006s : 3: substitution.graph_param_transform 71.37% : 0.000203s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000005s : 2: substitution.replace_old_param 4.39% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023881 2 92.02% : 0.021976s : 1: type_inference.infer 7.98% : 0.001906s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.58% : 0.000046s : 4: replace.inline 33.42% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.60% : 0.000200s : 4: match.inline 5.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.11% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.42% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.41% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.59% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.71% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.04% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.68% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.57% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001076 13 39.74% : 0.000428s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.98% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.28% : 0.000595s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035802 72 0.17% : 0.000060s : 1: add_recomputation 0.22% : 0.000077s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.01% : 0.000361s : 1: bootstrap 0.10% : 0.000035s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.98% : 0.006438s : 1: jit_opt_a 0.50% : 0.000180s : 1: jit_opt_after_cconv 0.16% : 0.000058s : 1: jit_opt_b 1.48% : 0.000529s : 1: loop_unroll 2.37% : 0.000850s : 1: mutable_eliminate 2.50% : 0.000897s : 26: opt.transform.jit_opt_a 0.15% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000024s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000078s : 4: opt.transform.symbol_engine_opt 1.48% : 0.000529s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000116s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.68% : 0.000601s : 1: renormalize.infer 1.20% : 0.000430s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000045s : 1: rewriter_after_opt_a 0.26% : 0.000093s : 1: rewriter_before_opt_a 0.35% : 0.000124s : 1: symbol_engine_optimizer 66.99% : 0.023982s : 1: type_inference TotalTime = 0.0834041, [30] [bootstrap]: 0.00025454 [type_inference]: 0.0568915 [event_method]: 0.00025856 [auto_monad]: 0.00010734 [graph_reusing]: 7.85e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 3.605e-05 [rewriter_before_opt_a]: 0.00011613 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.0235315, [3] [Cycle 1]: 0.0161732, [27] [switch_simplify]: 8.059e-05 [loop_unroll]: 4.411e-05 [a_1]: 0.00097473 [with_stream_mark]: 3.888e-05 [recompute_prepare]: 2.741e-05 [updatestate_depend_eliminate]: 1.098e-05 [updatestate_assign_eliminate]: 7.70998e-06 [updatestate_loads_eliminate]: 7.00998e-06 [parameter_eliminate]: 2.81e-06 [specialize_transform]: 1.644e-05 [updatestate_useless_node_eliminater]: 1.419e-05 [accelerated_algorithm]: 1.405e-05 [meta_shard_fg_expand]: 3.65e-06 [get_grad_eliminate_]: 1.436e-05 [merge_forward]: 1.013e-05 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.137e-05 [j_node_and_user_rematch]: 2.629e-05 [meta_fg_expand]: 0.00204883 [replace_old_param]: 8.029e-05 [inline_without_move]: 6.585e-05 [renormalize]: 0.0119277 [add_forward_monad_depend]: 1.312e-05 [auto_monad_grad]: 7.64002e-06 [auto_monad_eliminator]: 6.639e-05 [cse]: 0.00025867 [replace_applicator]: 9.401e-05 [Cycle 2]: 0.00349094, [27] [switch_simplify]: 4.408e-05 [loop_unroll]: 4.242e-05 [a_1]: 0.00115797 [with_stream_mark]: 1.797e-05 [recompute_prepare]: 1.02e-05 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 7.84002e-06 [updatestate_useless_node_eliminater]: 7.21999e-06 [accelerated_algorithm]: 7.23e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 7.46999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.661e-05 [j_node_and_user_rematch]: 1.145e-05 [meta_fg_expand]: 6.794e-05 [replace_old_param]: 7.7e-06 [inline_without_move]: 6.91001e-06 [renormalize]: 0.00183535 [add_forward_monad_depend]: 6.28e-06 [auto_monad_grad]: 1.50001e-06 [auto_monad_eliminator]: 1.086e-05 [cse]: 2.038e-05 [replace_applicator]: 1.316e-05 [Cycle 3]: 0.00024491, [27] [switch_simplify]: 4.41002e-06 [loop_unroll]: 3.46001e-06 [a_1]: 3.972e-05 [with_stream_mark]: 9.14e-06 [recompute_prepare]: 3.5e-06 [updatestate_depend_eliminate]: 2.11e-06 [updatestate_assign_eliminate]: 1.60001e-06 [updatestate_loads_eliminate]: 1.59e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 3.48e-06 [updatestate_useless_node_eliminater]: 3.13998e-06 [accelerated_algorithm]: 3.21001e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 3.03e-06 [merge_forward]: 2.48002e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.067e-05 [j_node_and_user_rematch]: 5.77999e-06 [meta_fg_expand]: 1.22e-06 [replace_old_param]: 3.13e-06 [inline_without_move]: 2.90998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 3.44001e-06 [cse]: 8.35001e-06 [replace_applicator]: 3.27002e-06 [py_interpret_to_execute_after_opt_a]: 1.154e-05 [rewriter_after_opt_a]: 3.461e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00069736 [jit_opt_b]: 4.121e-05, [1] [Cycle 1]: 3.339e-05, [2] [frontend_op_eliminate]: 1.011e-05 [inline_after_opt_a]: 1.135e-05 [cconv]: 2.531e-05 [loop_unroll]: 0.00041626 [jit_opt_after_cconv]: 0.00012251, [1] [Cycle 1]: 0.00011613, [11] [c_1]: 1.193e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 4.56002e-06 [updatestate_assign_eliminate]: 1.72999e-06 [updatestate_loads_eliminate]: 1.50999e-06 [cse]: 1.676e-05 [call_graph_tuple_transform]: 1.432e-05 [tuple_list_get_item_eliminator]: 3.67002e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 3.45e-06 [remove_dup_value]: 1.615e-05 [partial_unused_args_eliminate]: 3.03998e-06 [environ_conv]: 5.29003e-06 [add_recomputation]: 3.666e-05 [cse_after_recomputation]: 1.91e-05, [1] [Cycle 1]: 1.43e-05, [1] [cse]: 8.35001e-06 [auto_monad_reorder]: 1.332e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 4.58999e-06 [opt_after_jit_grad]: 0.00043567 [symbol_engine_optimizer]: 6.544e-05, [1] [Cycle 1]: 5.916e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 5.96e-06 [elim_not_effective]: 9.66998e-06 [opt_reshape]: 4.38001e-06 [fold_const_symbol]: 5.51e-06 [renormalize]: 3.09985e-07 [validate]: 3.284e-05 Sums bootstrap : 0.000255s : 0.32% type_inference : 0.056891s : 72.12% event_method : 0.000259s : 0.33% auto_monad : 0.000107s : 0.14% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000036s : 0.05% rewriter_before_opt_a : 0.000116s : 0.15% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.16% jit_opt_a.loop_unroll : 0.000090s : 0.11% jit_opt_a.a_1 : 0.002172s : 2.75% jit_opt_a.with_stream_mark : 0.000066s : 0.08% jit_opt_a.recompute_prepare : 0.000041s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.02% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000024s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.06% jit_opt_a.meta_fg_expand : 0.002118s : 2.68% jit_opt_a.replace_old_param : 0.000091s : 0.12% jit_opt_a.inline_without_move : 0.000076s : 0.10% jit_opt_a.renormalize : 0.013763s : 17.45% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.03% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.10% jit_opt_a.cse : 0.000287s : 0.36% jit_opt_a.replace_applicator : 0.000110s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000697s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000025s : 0.03% loop_unroll : 0.000416s : 0.53% jit_opt_after_cconv.c_1 : 0.000012s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000037s : 0.05% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000436s : 0.55% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.04% Time group info: ------[substitution.] 0.000555 104 0.25% : 0.000001s : 1: substitution.elim_not_effective 0.15% : 0.000001s : 1: substitution.fold_const_symbol 0.83% : 0.000005s : 1: substitution.graph_param_transform 62.48% : 0.000347s : 12: substitution.inline 3.97% : 0.000022s : 2: substitution.inline_without_move 1.86% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.08% : 0.000012s : 7: substitution.minmaximum_grad 1.40% : 0.000008s : 5: substitution.partial_eliminate 1.97% : 0.000011s : 12: substitution.remove_not_recompute_node 5.61% : 0.000031s : 10: substitution.replace_applicator 1.35% : 0.000008s : 10: substitution.replace_old_param 1.31% : 0.000007s : 1: substitution.reshape_eliminate 0.61% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.01% : 0.000006s : 1: substitution.tile_eliminate 4.14% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.90% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.06% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056774 2 96.09% : 0.054554s : 1: type_inference.infer 3.91% : 0.002220s : 1: type_inference.specialize ------[replace.] 0.000172 19 64.44% : 0.000111s : 12: replace.inline 35.56% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000363 19 93.65% : 0.000340s : 12: match.inline 6.35% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000365 2654 1.51% : 0.000006s : 46: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.57% : 0.000006s : 46: predicate.addn_check_dump 1.62% : 0.000006s : 46: predicate.addn_zero_filter 1.92% : 0.000007s : 46: predicate.arithmetic_simplify 1.55% : 0.000006s : 46: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 46: predicate.compare_switch_simplify 1.64% : 0.000006s : 46: predicate.depend_value_elim 1.54% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.48% : 0.000005s : 46: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000005s : 46: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 46: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 46: predicate.environ_get_depend_swap 1.62% : 0.000006s : 46: predicate.environ_get_eliminate 1.51% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.87% : 0.000003s : 19: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.35% : 0.000016s : 67: predicate.inline 2.12% : 0.000008s : 47: predicate.inline_without_move 0.41% : 0.000002s : 19: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 19: predicate.less_batch_normalization 1.84% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.91% : 0.000007s : 54: predicate.load_eliminater 0.34% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.51% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.65% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.46% : 0.000005s : 46: predicate.merge_addn 1.51% : 0.000005s : 46: predicate.minmaximum_grad 0.47% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.45% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 46: predicate.print_const_string_wrapper 1.89% : 0.000007s : 46: predicate.reduce_eliminate 1.82% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 19: predicate.remove_not_recompute_node 2.91% : 0.000011s : 100: predicate.replace_applicator 1.34% : 0.000005s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.68% : 0.000006s : 46: predicate.reshape_eliminate 1.55% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.53% : 0.000006s : 46: predicate.same_eliminate 0.57% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 19: predicate.specialize_transform 1.87% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000005s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000010s : 65: predicate.switch_defer_inline 2.57% : 0.000009s : 65: predicate.switch_layer_defer_inline 6.60% : 0.000024s : 161: predicate.switch_simplify 1.54% : 0.000006s : 46: predicate.tile_eliminate 1.50% : 0.000005s : 46: predicate.transpose_eliminate 1.93% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.74% : 0.000006s : 46: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.80% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.69% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 46: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003483 44 74.61% : 0.002599s : 28: func_graph_cloner_run.FuncGraphClonerGraph 25.39% : 0.000884s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.100020 87 0.04% : 0.000039s : 1: add_recomputation 0.11% : 0.000115s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.28% : 0.000280s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.27% : 0.000266s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 23.53% : 0.023535s : 1: jit_opt_a 0.12% : 0.000125s : 1: jit_opt_after_cconv 0.04% : 0.000044s : 1: jit_opt_b 0.42% : 0.000424s : 1: loop_unroll 0.71% : 0.000706s : 1: mutable_eliminate 2.86% : 0.002861s : 39: opt.transform.jit_opt_a 0.03% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000443s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000039s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 11.53% : 0.011532s : 2: renormalize.infer 2.21% : 0.002210s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000037s : 1: rewriter_after_opt_a 0.12% : 0.000119s : 1: rewriter_before_opt_a 0.07% : 0.000068s : 1: symbol_engine_optimizer 56.91% : 0.056919s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.870.140 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.870.769 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0253496, [30] [bootstrap]: 0.00027085 [type_inference]: 0.0110881 [event_method]: 2.289e-05 [auto_monad]: 7.429e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 5.618e-05 [rewriter_before_opt_a]: 8.777e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.0113807, [2] [Cycle 1]: 0.00745704, [27] [switch_simplify]: 6.627e-05 [loop_unroll]: 6.822e-05 [a_1]: 0.00381026 [with_stream_mark]: 2.616e-05 [recompute_prepare]: 1.042e-05 [updatestate_depend_eliminate]: 5.71003e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.28998e-06 [specialize_transform]: 7.30003e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 7.06001e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 1.66998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 3.19001e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 6.05002e-06 [renormalize]: 0.00104961 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.587e-05 [cse]: 4.004e-05 [replace_applicator]: 1.244e-05 [Cycle 2]: 0.00033186, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.55001e-06 [a_1]: 9.356e-05 [with_stream_mark]: 8.87e-06 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.28002e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.38002e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.89998e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.266e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 7.63999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.499e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 1.377e-05 [rewriter_after_opt_a]: 3.987e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00071841 [jit_opt_b]: 5.229e-05, [1] [Cycle 1]: 4.499e-05, [2] [frontend_op_eliminate]: 1.701e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.00042606 [jit_opt_after_cconv]: 0.00014932, [1] [Cycle 1]: 0.00014304, [11] [c_1]: 2.269e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 2.394e-05 [call_graph_tuple_transform]: 1.954e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 3.18e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.09001e-06 [add_recomputation]: 5.174e-05 [cse_after_recomputation]: 2.694e-05, [1] [Cycle 1]: 2.078e-05, [1] [cse]: 1.408e-05 [auto_monad_reorder]: 1.922e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.00046023 [symbol_engine_optimizer]: 7.74e-05, [1] [Cycle 1]: 7.094e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 5.8001e-07 [validate]: 3.932e-05 Sums bootstrap : 0.000271s : 1.42% type_inference : 0.011088s : 58.13% event_method : 0.000023s : 0.12% auto_monad : 0.000074s : 0.39% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000056s : 0.29% rewriter_before_opt_a : 0.000088s : 0.46% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.38% jit_opt_a.loop_unroll : 0.000074s : 0.39% jit_opt_a.a_1 : 0.003904s : 20.47% jit_opt_a.with_stream_mark : 0.000035s : 0.18% jit_opt_a.recompute_prepare : 0.000016s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.09% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001050s : 5.50% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.11% jit_opt_a.cse : 0.000055s : 0.29% jit_opt_a.replace_applicator : 0.000018s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.07% rewriter_after_opt_a : 0.000040s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000718s : 3.77% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.09% jit_opt_b.inline_after_opt_a : 0.000017s : 0.09% cconv : 0.000026s : 0.14% loop_unroll : 0.000426s : 2.23% jit_opt_after_cconv.c_1 : 0.000023s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000032s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000052s : 0.27% cse_after_recomputation.cse : 0.000014s : 0.07% auto_monad_reorder : 0.000019s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000460s : 2.41% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.21% Time group info: ------[substitution.] 0.000381 24 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 1.49% : 0.000006s : 3: substitution.graph_param_transform 89.74% : 0.000342s : 5: substitution.inline 1.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.28% : 0.000005s : 4: substitution.remove_not_recompute_node 1.31% : 0.000005s : 2: substitution.replace_old_param 4.05% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011008 2 89.40% : 0.009841s : 1: type_inference.infer 10.60% : 0.001167s : 1: type_inference.specialize ------[replace.] 0.000228 7 82.86% : 0.000189s : 5: replace.inline 17.14% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000353 7 96.03% : 0.000339s : 5: match.inline 3.97% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 747 1.45% : 0.000002s : 11: predicate.accumulaten_eliminater 0.80% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 2.06% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 11: predicate.compare_switch_simplify 1.29% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 11: predicate.environ_get_depend_swap 1.63% : 0.000003s : 11: predicate.environ_get_eliminate 0.97% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.79% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.30% : 0.000008s : 24: predicate.inline 0.65% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 2.49% : 0.000004s : 13: predicate.list_to_tuple_eliminator_ 1.43% : 0.000002s : 16: predicate.load_eliminater 0.93% : 0.000001s : 3: predicate.loop_unroll_after_grad 6.93% : 0.000011s : 38: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 11: predicate.merge_addn 1.18% : 0.000002s : 11: predicate.minmaximum_grad 0.93% : 0.000001s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 4.11% : 0.000006s : 16: predicate.partial_eliminate 1.42% : 0.000002s : 11: predicate.print_const_string_wrapper 1.88% : 0.000003s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000003s : 19: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.51% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000002s : 11: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.63% : 0.000001s : 6: predicate.special_op_eliminate 0.72% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.27% : 0.000005s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.15% : 0.000010s : 59: predicate.switch_simplify 1.14% : 0.000002s : 11: predicate.tile_eliminate 1.07% : 0.000002s : 11: predicate.transpose_eliminate 1.40% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 4.02% : 0.000006s : 22: predicate.updatestate_useless_node_eliminater 1.79% : 0.000003s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.44% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000957 16 47.59% : 0.000455s : 7: func_graph_cloner_run.FuncGraphClonerGraph 11.13% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.28% : 0.000395s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030617 72 0.18% : 0.000055s : 1: add_recomputation 0.26% : 0.000078s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 0.95% : 0.000290s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 37.18% : 0.011385s : 1: jit_opt_a 0.50% : 0.000152s : 1: jit_opt_after_cconv 0.18% : 0.000055s : 1: jit_opt_b 1.42% : 0.000434s : 1: loop_unroll 2.37% : 0.000727s : 1: mutable_eliminate 13.62% : 0.004171s : 26: opt.transform.jit_opt_a 0.17% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000469s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000059s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000035s : 1: remove_dup_value 2.10% : 0.000642s : 1: renormalize.infer 1.30% : 0.000399s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.30% : 0.000091s : 1: rewriter_before_opt_a 0.26% : 0.000080s : 1: symbol_engine_optimizer 36.29% : 0.011110s : 1: type_inference TotalTime = 0.213702, [30] [bootstrap]: 0.00030853 [type_inference]: 0.200662 [event_method]: 1.847e-05 [auto_monad]: 6.748e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00045545 [rewriter_before_opt_a]: 8.089e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.0095049, [2] [Cycle 1]: 0.00414224, [27] [switch_simplify]: 6.39e-05 [loop_unroll]: 3.001e-05 [a_1]: 0.00061383 [with_stream_mark]: 2.2e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 4.1e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 1.118e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 9.75002e-06 [inline_without_move]: 5.84e-06 [renormalize]: 0.00302646 [add_forward_monad_depend]: 9.66e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.846e-05 [cse]: 3.312e-05 [replace_applicator]: 2.093e-05 [Cycle 2]: 0.0003742, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.90002e-06 [a_1]: 0.00012213 [with_stream_mark]: 1.488e-05 [recompute_prepare]: 5.87999e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 8.95001e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.48998e-06 [cse]: 1.152e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.367e-05 [rewriter_after_opt_a]: 3.851e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 4.65999e-06 [mutable_eliminate]: 0.00071807 [jit_opt_b]: 5.47e-05, [1] [Cycle 1]: 4.705e-05, [2] [frontend_op_eliminate]: 1.824e-05 [inline_after_opt_a]: 1.692e-05 [cconv]: 2.66e-05 [loop_unroll]: 0.00042818 [jit_opt_after_cconv]: 0.0001572, [1] [Cycle 1]: 0.00015, [11] [c_1]: 2.577e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 7.71001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.216e-05 [call_graph_tuple_transform]: 2.354e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.53998e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 9.22001e-06 [add_recomputation]: 5.103e-05 [cse_after_recomputation]: 2.26e-05, [1] [Cycle 1]: 1.737e-05, [1] [cse]: 1.145e-05 [auto_monad_reorder]: 1.899e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.39998e-06 [opt_after_jit_grad]: 0.00053364 [symbol_engine_optimizer]: 0.0002296, [1] [Cycle 1]: 0.00022177, [6] [build]: 4.64002e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 0.00015732 [opt_reshape]: 9.09e-06 [fold_const_symbol]: 1.168e-05 [renormalize]: 7.00005e-07 [validate]: 5.736e-05 Sums bootstrap : 0.000309s : 0.15% type_inference : 0.200662s : 96.43% event_method : 0.000018s : 0.01% auto_monad : 0.000067s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000455s : 0.22% rewriter_before_opt_a : 0.000081s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000736s : 0.35% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003027s : 1.45% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000718s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000428s : 0.21% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000534s : 0.26% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000157s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.03% TotalTime = 0.0434827, [30] [bootstrap]: 0.00025992 [type_inference]: 0.0256467 [event_method]: 3.65e-05 [auto_monad]: 0.00013501 [graph_reusing]: 9.84001e-06 [pre_auto_parallel]: 3.26001e-06 [py_interpret_to_execute]: 4.216e-05 [rewriter_before_opt_a]: 0.00020833 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.0148136, [3] [Cycle 1]: 0.00756802, [27] [switch_simplify]: 0.00017591 [loop_unroll]: 6.316e-05 [a_1]: 0.00121446 [with_stream_mark]: 3.277e-05 [recompute_prepare]: 1.825e-05 [updatestate_depend_eliminate]: 9.10001e-06 [updatestate_assign_eliminate]: 6.83e-06 [updatestate_loads_eliminate]: 6.63e-06 [parameter_eliminate]: 3.55e-06 [specialize_transform]: 1.358e-05 [updatestate_useless_node_eliminater]: 1.247e-05 [accelerated_algorithm]: 1.293e-05 [meta_shard_fg_expand]: 4.05e-06 [get_grad_eliminate_]: 1.244e-05 [merge_forward]: 8.79e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.768e-05 [j_node_and_user_rematch]: 2.356e-05 [meta_fg_expand]: 0.00169785 [replace_old_param]: 6.095e-05 [inline_without_move]: 5.607e-05 [renormalize]: 0.00347311 [add_forward_monad_depend]: 1.183e-05 [auto_monad_grad]: 6.07001e-06 [auto_monad_eliminator]: 5.798e-05 [cse]: 0.00020587 [replace_applicator]: 8.255e-05 [Cycle 2]: 0.00350237, [27] [switch_simplify]: 4.022e-05 [loop_unroll]: 3.889e-05 [a_1]: 0.00117091 [with_stream_mark]: 2.105e-05 [recompute_prepare]: 1.049e-05 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.59002e-06 [parameter_eliminate]: 3.27002e-06 [specialize_transform]: 7.67002e-06 [updatestate_useless_node_eliminater]: 7.50998e-06 [accelerated_algorithm]: 6.94999e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 6.71999e-06 [merge_forward]: 4.65999e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.704e-05 [j_node_and_user_rematch]: 1.145e-05 [meta_fg_expand]: 0.00028267 [replace_old_param]: 1.185e-05 [inline_without_move]: 7.43e-06 [renormalize]: 0.0015872 [add_forward_monad_depend]: 7.07002e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.483e-05 [cse]: 2.545e-05 [replace_applicator]: 1.687e-05 [Cycle 3]: 0.00025697, [27] [switch_simplify]: 4.24002e-06 [loop_unroll]: 3.80998e-06 [a_1]: 4.063e-05 [with_stream_mark]: 1.118e-05 [recompute_prepare]: 3.63999e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 1.54998e-06 [updatestate_loads_eliminate]: 1.82999e-06 [parameter_eliminate]: 1.96003e-06 [specialize_transform]: 3.38e-06 [updatestate_useless_node_eliminater]: 3.17002e-06 [accelerated_algorithm]: 3.45998e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 3.11999e-06 [merge_forward]: 2.83998e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 5.96e-06 [meta_fg_expand]: 1.29e-06 [replace_old_param]: 3.18e-06 [inline_without_move]: 2.99999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.24003e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 3.56999e-06 [cse]: 8.28999e-06 [replace_applicator]: 3.32002e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.749e-05 [convert_after_rewriter]: 6.16e-06 [order_py_execute_after_rewriter]: 5.77001e-06 [mutable_eliminate]: 0.00075222 [jit_opt_b]: 4.15e-05, [1] [Cycle 1]: 3.425e-05, [2] [frontend_op_eliminate]: 1.025e-05 [inline_after_opt_a]: 1.183e-05 [cconv]: 2.514e-05 [loop_unroll]: 0.00044629 [jit_opt_after_cconv]: 0.00012976, [1] [Cycle 1]: 0.00012331, [11] [c_1]: 1.231e-05 [parameter_eliminate]: 3.41001e-06 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 1.81003e-06 [updatestate_loads_eliminate]: 1.52001e-06 [cse]: 2.044e-05 [call_graph_tuple_transform]: 1.457e-05 [tuple_list_get_item_eliminator]: 4.31002e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 3.61001e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 5.26002e-06 [add_recomputation]: 3.642e-05 [cse_after_recomputation]: 2.02e-05, [1] [Cycle 1]: 1.501e-05, [1] [cse]: 7.82e-06 [auto_monad_reorder]: 1.326e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 5.23002e-06 [opt_after_jit_grad]: 0.00045045 [symbol_engine_optimizer]: 6.82e-05, [1] [Cycle 1]: 6.17e-05, [6] [build]: 4.59002e-06 [elim_shapecalc]: 5.52001e-06 [elim_not_effective]: 9.37001e-06 [opt_reshape]: 4.16001e-06 [fold_const_symbol]: 6.34001e-06 [renormalize]: 5.79981e-07 [validate]: 4.619e-05 Sums bootstrap : 0.000260s : 0.66% type_inference : 0.025647s : 65.61% event_method : 0.000036s : 0.09% auto_monad : 0.000135s : 0.35% graph_reusing : 0.000010s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000042s : 0.11% rewriter_before_opt_a : 0.000208s : 0.53% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000220s : 0.56% jit_opt_a.loop_unroll : 0.000106s : 0.27% jit_opt_a.a_1 : 0.002426s : 6.21% jit_opt_a.with_stream_mark : 0.000065s : 0.17% jit_opt_a.recompute_prepare : 0.000032s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000009s : 0.02% jit_opt_a.specialize_transform : 0.000025s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.06% jit_opt_a.accelerated_algorithm : 0.000023s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.06% jit_opt_a.merge_forward : 0.000016s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.10% jit_opt_a.meta_fg_expand : 0.001982s : 5.07% jit_opt_a.replace_old_param : 0.000076s : 0.19% jit_opt_a.inline_without_move : 0.000066s : 0.17% jit_opt_a.renormalize : 0.005060s : 12.94% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.05% jit_opt_a.auto_monad_grad : 0.000009s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000076s : 0.20% jit_opt_a.cse : 0.000240s : 0.61% jit_opt_a.replace_applicator : 0.000103s : 0.26% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000752s : 1.92% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000012s : 0.03% cconv : 0.000025s : 0.06% loop_unroll : 0.000446s : 1.14% jit_opt_after_cconv.c_1 : 0.000012s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.09% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000450s : 1.15% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.12% Time group info: ------[substitution.] 0.000614 112 0.25% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.70% : 0.000004s : 1: substitution.graph_param_transform 65.87% : 0.000405s : 19: substitution.inline 3.07% : 0.000019s : 2: substitution.inline_without_move 1.65% : 0.000010s : 12: substitution.j_node_and_user_rematch 1.91% : 0.000012s : 7: substitution.minmaximum_grad 1.19% : 0.000007s : 5: substitution.partial_eliminate 1.72% : 0.000011s : 12: substitution.remove_not_recompute_node 4.71% : 0.000029s : 10: substitution.replace_applicator 0.97% : 0.000006s : 8: substitution.replace_old_param 1.24% : 0.000008s : 1: substitution.reshape_eliminate 0.37% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.60% : 0.000010s : 2: substitution.switch_simplify 0.97% : 0.000006s : 1: substitution.tile_eliminate 3.47% : 0.000021s : 7: substitution.tuple_list_convert_item_index_to_positive 2.63% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.52% : 0.000046s : 15: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025464 2 91.26% : 0.023237s : 1: type_inference.infer 8.74% : 0.002227s : 1: type_inference.specialize ------[replace.] 0.000246 29 54.79% : 0.000135s : 19: replace.inline 20.33% : 0.000050s : 2: replace.switch_simplify 24.88% : 0.000061s : 8: replace.tuple_list_get_item_eliminator ------[match.] 0.000427 29 92.35% : 0.000395s : 19: match.inline 2.03% : 0.000009s : 2: match.switch_simplify 5.62% : 0.000024s : 8: match.tuple_list_get_item_eliminator ------[predicate.] 0.000411 2841 1.59% : 0.000007s : 49: predicate.accumulaten_eliminater 0.28% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.50% : 0.000006s : 49: predicate.addn_check_dump 1.65% : 0.000007s : 49: predicate.addn_zero_filter 1.94% : 0.000008s : 49: predicate.arithmetic_simplify 1.61% : 0.000007s : 49: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.44% : 0.000006s : 49: predicate.compare_switch_simplify 1.52% : 0.000006s : 49: predicate.depend_value_elim 1.44% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 49: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 49: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000006s : 49: predicate.environ_add_const_eliminate 1.45% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 49: predicate.environ_get_depend_swap 1.52% : 0.000006s : 49: predicate.environ_get_eliminate 1.50% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.71% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.57% : 0.000019s : 78: predicate.inline 1.68% : 0.000007s : 41: predicate.inline_without_move 0.32% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.74% : 0.000003s : 17: predicate.less_batch_normalization 1.89% : 0.000008s : 57: predicate.list_to_tuple_eliminator_ 1.89% : 0.000008s : 58: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.86% : 0.000016s : 115: predicate.loop_unroll_before_grad 1.82% : 0.000007s : 50: predicate.make_slice_get_slice_eliminator 1.46% : 0.000006s : 49: predicate.merge_addn 1.50% : 0.000006s : 49: predicate.minmaximum_grad 0.39% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000010s : 58: predicate.partial_eliminate 1.63% : 0.000007s : 49: predicate.print_const_string_wrapper 1.92% : 0.000008s : 49: predicate.reduce_eliminate 1.75% : 0.000007s : 57: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 17: predicate.remove_not_recompute_node 2.72% : 0.000011s : 100: predicate.replace_applicator 1.02% : 0.000004s : 41: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000007s : 49: predicate.reshape_eliminate 1.71% : 0.000007s : 49: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.54% : 0.000006s : 49: predicate.same_eliminate 0.40% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.13% : 0.000001s : 2: predicate.special_op_eliminate 0.66% : 0.000003s : 17: predicate.specialize_transform 1.71% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000006s : 49: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.05% : 0.000013s : 76: predicate.switch_defer_inline 2.79% : 0.000011s : 76: predicate.switch_layer_defer_inline 7.25% : 0.000030s : 196: predicate.switch_simplify 1.66% : 0.000007s : 49: predicate.tile_eliminate 1.53% : 0.000006s : 49: predicate.transpose_eliminate 1.84% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000007s : 49: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000014s : 59: predicate.tuple_list_get_item_eliminator 1.73% : 0.000007s : 49: predicate.tuple_list_set_item_eliminator 1.86% : 0.000008s : 57: predicate.tuple_to_list_eliminator_ 1.81% : 0.000007s : 58: predicate.updatestate_pure_node_eliminater 2.65% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.89% : 0.000008s : 49: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002694 40 63.97% : 0.001723s : 17: func_graph_cloner_run.FuncGraphClonerGraph 36.03% : 0.000971s : 23: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.051695 87 0.08% : 0.000039s : 1: add_recomputation 0.27% : 0.000140s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.55% : 0.000285s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.08% : 0.000041s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 28.66% : 0.014817s : 1: jit_opt_a 0.26% : 0.000132s : 1: jit_opt_after_cconv 0.08% : 0.000044s : 1: jit_opt_b 0.88% : 0.000454s : 1: loop_unroll 1.47% : 0.000761s : 1: mutable_eliminate 6.14% : 0.003172s : 39: opt.transform.jit_opt_a 0.06% : 0.000031s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000011s : 1: opt.transform.mutable_eliminate 0.03% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000045s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 6.40% : 0.003308s : 2: renormalize.infer 3.35% : 0.001733s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.41% : 0.000214s : 1: rewriter_before_opt_a 0.14% : 0.000071s : 1: symbol_engine_optimizer 49.66% : 0.025673s : 1: type_inference TotalTime = 0.0669185, [30] [bootstrap]: 0.00031237 [type_inference]: 0.00930258 [event_method]: 2.279e-05 [auto_monad]: 7.297e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 5.92e-05 [rewriter_before_opt_a]: 8.474e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.0059743, [2] [Cycle 1]: 0.00195412, [27] [switch_simplify]: 6.439e-05 [loop_unroll]: 3.435e-05 [a_1]: 0.00067356 [with_stream_mark]: 1.915e-05 [recompute_prepare]: 8.09002e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.11997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.0008184 [add_forward_monad_depend]: 5.20999e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.563e-05 [cse]: 3.609e-05 [replace_applicator]: 1.214e-05 [Cycle 2]: 0.00032799, [27] [switch_simplify]: 5.71e-06 [loop_unroll]: 4.97e-06 [a_1]: 9.894e-05 [with_stream_mark]: 8.92e-06 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.042e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.62998e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.35001e-06 [cse]: 1.32e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 9.57001e-06 [rewriter_after_opt_a]: 3.86e-05 [convert_after_rewriter]: 7.20998e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00058979 [jit_opt_b]: 5.149e-05, [1] [Cycle 1]: 4.461e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.553e-05 [cconv]: 2.856e-05 [loop_unroll]: 0.0489078 [jit_opt_after_cconv]: 0.00028019, [1] [Cycle 1]: 0.00022337, [11] [c_1]: 3.379e-05 [parameter_eliminate]: 8.18999e-06 [updatestate_depend_eliminate]: 1.779e-05 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.28e-06 [cse]: 5.525e-05 [call_graph_tuple_transform]: 3.148e-05 [tuple_list_get_item_eliminator]: 7.15e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 1.17e-06 [switch_simplify]: 6.73e-06 [remove_dup_value]: 2.062e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 8.67e-06 [add_recomputation]: 6.595e-05 [cse_after_recomputation]: 2.646e-05, [1] [Cycle 1]: 1.984e-05, [1] [cse]: 1.31e-05 [auto_monad_reorder]: 1.913e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 1.203e-05 [opt_after_jit_grad]: 0.00065446 [symbol_engine_optimizer]: 8.204e-05, [1] [Cycle 1]: 7.562e-05, [6] [build]: 4.64998e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.476e-05 [opt_reshape]: 7.74002e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 5.3001e-07 [validate]: 4.951e-05 Sums bootstrap : 0.000312s : 0.50% type_inference : 0.009303s : 14.87% event_method : 0.000023s : 0.04% auto_monad : 0.000073s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000059s : 0.09% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.11% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000773s : 1.24% jit_opt_a.with_stream_mark : 0.000028s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000818s : 1.31% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000049s : 0.08% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000590s : 0.94% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000029s : 0.05% loop_unroll : 0.048908s : 78.20% jit_opt_after_cconv.c_1 : 0.000034s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000018s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000055s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000066s : 0.11% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.02% opt_after_jit_grad : 0.000654s : 1.05% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.08% Time group info: ------[substitution.] 0.000280 27 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.79% : 0.000008s : 3: substitution.graph_param_transform 83.85% : 0.000235s : 5: substitution.inline 0.99% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.56% : 0.000010s : 3: substitution.reduce_eliminate 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000005s : 2: substitution.replace_old_param 3.94% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009217 2 86.79% : 0.007999s : 1: type_inference.infer 13.21% : 0.001218s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.53% : 0.000065s : 5: replace.inline 32.47% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 95.87% : 0.000232s : 5: match.inline 4.13% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 2.09% : 0.000003s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000002s : 11: predicate.compare_switch_simplify 1.08% : 0.000002s : 11: predicate.depend_value_elim 1.00% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000002s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 6.56% : 0.000009s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 16: predicate.load_eliminater 4.86% : 0.000007s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 1.34% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.08% : 0.000001s : 11: predicate.print_const_string_wrapper 2.50% : 0.000003s : 11: predicate.reduce_eliminate 1.30% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 11: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.45% : 0.000010s : 59: predicate.switch_simplify 1.34% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.32% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000978 16 50.10% : 0.000490s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.96% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.94% : 0.000420s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068839 72 0.10% : 0.000069s : 1: add_recomputation 0.11% : 0.000076s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.48% : 0.000331s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 8.68% : 0.005978s : 1: jit_opt_a 0.41% : 0.000285s : 1: jit_opt_after_cconv 0.08% : 0.000054s : 1: jit_opt_b 71.09% : 0.048936s : 1: loop_unroll 0.87% : 0.000598s : 1: mutable_eliminate 1.45% : 0.000999s : 26: opt.transform.jit_opt_a 0.11% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000047s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.96% : 0.000662s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.09% : 0.000062s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000024s : 1: remove_dup_value 0.67% : 0.000459s : 1: renormalize.infer 0.51% : 0.000351s : 1: renormalize.specialize 0.02% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000088s : 1: rewriter_before_opt_a 0.12% : 0.000085s : 1: symbol_engine_optimizer 13.55% : 0.009325s : 1: type_inference Time group info: ------[substitution.] 0.000244 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.63% : 0.000006s : 4: substitution.graph_param_transform 85.16% : 0.000208s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 4.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.200579 2 98.48% : 0.197524s : 1: type_inference.infer 1.52% : 0.003054s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.84% : 0.000053s : 4: replace.inline 31.16% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.99% : 0.000205s : 4: match.inline 5.01% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.53% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 1.71% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.36% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.73% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.40% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000009s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.30% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.27% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002332 22 67.09% : 0.001564s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.06% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.86% : 0.000719s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.217899 72 0.02% : 0.000054s : 1: add_recomputation 0.03% : 0.000071s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.15% : 0.000327s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.36% : 0.009508s : 1: jit_opt_a 0.07% : 0.000160s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.20% : 0.000436s : 1: loop_unroll 0.33% : 0.000727s : 1: mutable_eliminate 0.45% : 0.000981s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000183s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000545s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000462s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.01% : 0.002210s : 1: renormalize.infer 0.37% : 0.000806s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000086s : 1: rewriter_before_opt_a 0.11% : 0.000232s : 1: symbol_engine_optimizer 92.10% : 0.200680s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.924.979 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c3a0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.925.639 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0512665, [30] [bootstrap]: 0.00029607 [type_inference]: 0.0267707 [event_method]: 1.832e-05 [auto_monad]: 6.517e-05 [graph_reusing]: 5.43002e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 9.558e-05 [rewriter_before_opt_a]: 7.745e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00516929, [2] [Cycle 1]: 0.00172417, [27] [switch_simplify]: 5.192e-05 [loop_unroll]: 2.848e-05 [a_1]: 0.00051784 [with_stream_mark]: 1.778e-05 [recompute_prepare]: 7.05e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.465e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 0.0007854 [add_forward_monad_depend]: 5.49e-06 [auto_monad_grad]: 2.16e-06 [auto_monad_eliminator]: 1.473e-05 [cse]: 3.262e-05 [replace_applicator]: 1.099e-05 [Cycle 2]: 0.00030633, [27] [switch_simplify]: 5.83997e-06 [loop_unroll]: 5.05999e-06 [a_1]: 8.74e-05 [with_stream_mark]: 8.37e-06 [recompute_prepare]: 5.09998e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 4.93001e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.19e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 6.69999e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.193e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 1.011e-05 [rewriter_after_opt_a]: 3.649e-05 [convert_after_rewriter]: 6.37001e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.0169839 [jit_opt_b]: 6.372e-05, [1] [Cycle 1]: 5.202e-05, [2] [frontend_op_eliminate]: 1.925e-05 [inline_after_opt_a]: 2.103e-05 [cconv]: 4.483e-05 [loop_unroll]: 0.00047878 [jit_opt_after_cconv]: 0.00019186, [1] [Cycle 1]: 0.00018547, [11] [c_1]: 2.326e-05 [parameter_eliminate]: 7.1e-06 [updatestate_depend_eliminate]: 1.196e-05 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.80997e-06 [cse]: 4.865e-05 [call_graph_tuple_transform]: 2.7e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 9.40025e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.633e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 5.862e-05 [cse_after_recomputation]: 2.4e-05, [1] [Cycle 1]: 1.846e-05, [1] [cse]: 1.257e-05 [auto_monad_reorder]: 1.844e-05 [get_jit_bprop_graph]: 2.73e-06 [rewriter_after_jit_bprop_graph]: 9.81e-06 [opt_after_jit_grad]: 0.00045727 [symbol_engine_optimizer]: 7.254e-05, [1] [Cycle 1]: 6.651e-05, [6] [build]: 4.50001e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 5.54998e-06 [fold_const_symbol]: 8.59e-06 [renormalize]: 3.00002e-07 [validate]: 4.799e-05 Sums bootstrap : 0.000296s : 0.62% type_inference : 0.026771s : 56.35% event_method : 0.000018s : 0.04% auto_monad : 0.000065s : 0.14% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000096s : 0.20% rewriter_before_opt_a : 0.000077s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.12% jit_opt_a.loop_unroll : 0.000034s : 0.07% jit_opt_a.a_1 : 0.000605s : 1.27% jit_opt_a.with_stream_mark : 0.000026s : 0.06% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000785s : 1.65% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000045s : 0.09% jit_opt_a.replace_applicator : 0.000016s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000036s : 0.08% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.016984s : 35.75% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000021s : 0.04% cconv : 0.000045s : 0.09% loop_unroll : 0.000479s : 1.01% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000049s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000059s : 0.12% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.02% opt_after_jit_grad : 0.000457s : 0.96% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.10% Time group info: ------[substitution.] 0.000203 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 3.48% : 0.000007s : 3: substitution.graph_param_transform 82.56% : 0.000168s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026702 2 95.17% : 0.025413s : 1: type_inference.infer 4.83% : 0.001289s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.20% : 0.000045s : 4: replace.inline 31.80% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.24% : 0.000165s : 4: match.inline 6.76% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.60% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.62% : 0.000001s : 3: predicate.graph_param_transform 6.10% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 4.94% : 0.000006s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.97% : 0.000001s : 3: predicate.reset_defer_inline 1.10% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.39% : 0.000002s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.87% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.20% : 0.000008s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.26% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000712 13 47.18% : 0.000336s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.45% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.36% : 0.000337s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052908 72 0.12% : 0.000062s : 1: add_recomputation 0.13% : 0.000069s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.58% : 0.000308s : 1: bootstrap 0.09% : 0.000048s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.78% : 0.005172s : 1: jit_opt_a 0.37% : 0.000194s : 1: jit_opt_after_cconv 0.13% : 0.000067s : 1: jit_opt_b 0.92% : 0.000487s : 1: loop_unroll 32.15% : 0.017010s : 1: mutable_eliminate 1.53% : 0.000810s : 26: opt.transform.jit_opt_a 0.11% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000039s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.88% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000099s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 0.87% : 0.000462s : 1: renormalize.infer 0.60% : 0.000316s : 1: renormalize.specialize 0.02% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000039s : 1: rewriter_after_opt_a 0.15% : 0.000081s : 1: rewriter_before_opt_a 0.14% : 0.000075s : 1: symbol_engine_optimizer 50.63% : 0.026787s : 1: type_inference TotalTime = 0.0335177, [30] [bootstrap]: 0.00026288 [type_inference]: 0.0114375 [event_method]: 5.153e-05 [auto_monad]: 9.555e-05 [graph_reusing]: 8.17e-06 [pre_auto_parallel]: 3.14001e-06 [py_interpret_to_execute]: 2.926e-05 [rewriter_before_opt_a]: 0.00010962 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.0192619, [3] [Cycle 1]: 0.0125811, [27] [switch_simplify]: 6.654e-05 [loop_unroll]: 4.011e-05 [a_1]: 0.00083766 [with_stream_mark]: 2.834e-05 [recompute_prepare]: 1.813e-05 [updatestate_depend_eliminate]: 8.53001e-06 [updatestate_assign_eliminate]: 7.3e-06 [updatestate_loads_eliminate]: 6.45002e-06 [parameter_eliminate]: 2.71999e-06 [specialize_transform]: 1.37e-05 [updatestate_useless_node_eliminater]: 1.213e-05 [accelerated_algorithm]: 1.31e-05 [meta_shard_fg_expand]: 3.53e-06 [get_grad_eliminate_]: 1.225e-05 [merge_forward]: 8.62e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.572e-05 [j_node_and_user_rematch]: 2.327e-05 [meta_fg_expand]: 0.00167131 [replace_old_param]: 7.621e-05 [inline_without_move]: 6.42e-05 [renormalize]: 0.00892042 [add_forward_monad_depend]: 1.667e-05 [auto_monad_grad]: 7.66999e-06 [auto_monad_eliminator]: 6.46e-05 [cse]: 0.00024236 [replace_applicator]: 8.971e-05 [Cycle 2]: 0.00317539, [27] [switch_simplify]: 3.959e-05 [loop_unroll]: 3.895e-05 [a_1]: 0.00107705 [with_stream_mark]: 1.953e-05 [recompute_prepare]: 9.08002e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.54002e-06 [parameter_eliminate]: 2.62001e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.75002e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 7.33e-05 [replace_old_param]: 7.09001e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 0.0015905 [add_forward_monad_depend]: 7.36001e-06 [auto_monad_grad]: 2.40002e-06 [auto_monad_eliminator]: 1.459e-05 [cse]: 2.762e-05 [replace_applicator]: 1.647e-05 [Cycle 3]: 0.00025356, [27] [switch_simplify]: 4.27e-06 [loop_unroll]: 3.56001e-06 [a_1]: 3.979e-05 [with_stream_mark]: 1.153e-05 [recompute_prepare]: 3.43e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 1.97001e-06 [updatestate_loads_eliminate]: 1.45999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 3.23e-06 [updatestate_useless_node_eliminater]: 3.05002e-06 [accelerated_algorithm]: 3.41001e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 3.02002e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 2.05002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.308e-05 [j_node_and_user_rematch]: 6.16998e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 2.92002e-06 [inline_without_move]: 2.99001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 3.33998e-06 [cse]: 8.16002e-06 [replace_applicator]: 3.35e-06 [py_interpret_to_execute_after_opt_a]: 1.226e-05 [rewriter_after_opt_a]: 3.657e-05 [convert_after_rewriter]: 5.88998e-06 [order_py_execute_after_rewriter]: 1.971e-05 [mutable_eliminate]: 0.00073149 [jit_opt_b]: 4.161e-05, [1] [Cycle 1]: 3.367e-05, [2] [frontend_op_eliminate]: 1.043e-05 [inline_after_opt_a]: 1.147e-05 [cconv]: 2.535e-05 [loop_unroll]: 0.00040726 [jit_opt_after_cconv]: 0.00012158, [1] [Cycle 1]: 0.00011542, [11] [c_1]: 1.207e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 1.66e-06 [updatestate_loads_eliminate]: 1.57001e-06 [cse]: 1.785e-05 [call_graph_tuple_transform]: 1.358e-05 [tuple_list_get_item_eliminator]: 3.56001e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 3.43999e-06 [remove_dup_value]: 1.555e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 5.79999e-06 [add_recomputation]: 3.695e-05 [cse_after_recomputation]: 3.084e-05, [1] [Cycle 1]: 2.561e-05, [1] [cse]: 1.901e-05 [auto_monad_reorder]: 1.357e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.00043981 [symbol_engine_optimizer]: 6.934e-05, [1] [Cycle 1]: 6.267e-05, [6] [build]: 4.42998e-06 [elim_shapecalc]: 5.67999e-06 [elim_not_effective]: 1.057e-05 [opt_reshape]: 4.12998e-06 [fold_const_symbol]: 6.37001e-06 [renormalize]: 2.50002e-07 [validate]: 3.534e-05 Sums bootstrap : 0.000263s : 0.90% type_inference : 0.011438s : 38.98% event_method : 0.000052s : 0.18% auto_monad : 0.000096s : 0.33% graph_reusing : 0.000008s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000029s : 0.10% rewriter_before_opt_a : 0.000110s : 0.37% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000110s : 0.38% jit_opt_a.loop_unroll : 0.000083s : 0.28% jit_opt_a.a_1 : 0.001955s : 6.66% jit_opt_a.with_stream_mark : 0.000059s : 0.20% jit_opt_a.recompute_prepare : 0.000031s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000011s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000023s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000020s : 0.07% jit_opt_a.accelerated_algorithm : 0.000022s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000021s : 0.07% jit_opt_a.merge_forward : 0.000015s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000055s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000039s : 0.13% jit_opt_a.meta_fg_expand : 0.001746s : 5.95% jit_opt_a.replace_old_param : 0.000086s : 0.29% jit_opt_a.inline_without_move : 0.000072s : 0.25% jit_opt_a.renormalize : 0.010511s : 35.82% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.09% jit_opt_a.auto_monad_grad : 0.000011s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.28% jit_opt_a.cse : 0.000278s : 0.95% jit_opt_a.replace_applicator : 0.000110s : 0.37% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000020s : 0.07% mutable_eliminate : 0.000731s : 2.49% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.04% jit_opt_b.inline_after_opt_a : 0.000011s : 0.04% cconv : 0.000025s : 0.09% loop_unroll : 0.000407s : 1.39% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000018s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.01% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000037s : 0.13% cse_after_recomputation.cse : 0.000019s : 0.06% auto_monad_reorder : 0.000014s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000440s : 1.50% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.12% Time group info: ------[substitution.] 0.000516 101 0.34% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.86% : 0.000004s : 1: substitution.graph_param_transform 62.41% : 0.000322s : 12: substitution.inline 4.14% : 0.000021s : 2: substitution.inline_without_move 1.84% : 0.000010s : 11: substitution.j_node_and_user_rematch 2.19% : 0.000011s : 7: substitution.minmaximum_grad 1.30% : 0.000007s : 5: substitution.partial_eliminate 1.86% : 0.000010s : 11: substitution.remove_not_recompute_node 6.03% : 0.000031s : 10: substitution.replace_applicator 1.37% : 0.000007s : 10: substitution.replace_old_param 0.42% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.19% : 0.000006s : 1: substitution.tile_eliminate 4.13% : 0.000021s : 7: substitution.tuple_list_convert_item_index_to_positive 3.15% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.59% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011351 2 88.44% : 0.010038s : 1: type_inference.infer 11.56% : 0.001312s : 1: type_inference.specialize ------[replace.] 0.000164 19 64.19% : 0.000106s : 12: replace.inline 35.81% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000339 19 93.16% : 0.000315s : 12: match.inline 6.84% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000341 2324 1.59% : 0.000005s : 40: predicate.accumulaten_eliminater 0.25% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000005s : 40: predicate.addn_check_dump 1.64% : 0.000006s : 40: predicate.addn_zero_filter 2.11% : 0.000007s : 40: predicate.arithmetic_simplify 1.60% : 0.000005s : 40: predicate.cast_eliminate 0.11% : 0.000000s : 1: predicate.check_bprop_eliminate 1.40% : 0.000005s : 40: predicate.compare_switch_simplify 1.46% : 0.000005s : 40: predicate.depend_value_elim 1.44% : 0.000005s : 40: predicate.dict_get_item_const_eliminator 1.60% : 0.000005s : 40: predicate.dict_get_item_eliminator 1.56% : 0.000005s : 40: predicate.dict_set_item_eliminator 0.30% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000005s : 40: predicate.environ_add_const_eliminate 1.48% : 0.000005s : 40: predicate.environ_get_add_eliminate 1.42% : 0.000005s : 40: predicate.environ_get_depend_swap 1.55% : 0.000005s : 40: predicate.environ_get_eliminate 1.43% : 0.000005s : 40: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 15: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.56% : 0.000016s : 61: predicate.inline 2.18% : 0.000007s : 43: predicate.inline_without_move 0.32% : 0.000001s : 15: predicate.j_node_and_user_rematch 0.97% : 0.000003s : 15: predicate.less_batch_normalization 1.81% : 0.000006s : 47: predicate.list_to_tuple_eliminator_ 1.88% : 0.000006s : 48: predicate.load_eliminater 0.35% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.41% : 0.000012s : 83: predicate.loop_unroll_before_grad 1.73% : 0.000006s : 41: predicate.make_slice_get_slice_eliminator 1.47% : 0.000005s : 40: predicate.merge_addn 1.52% : 0.000005s : 40: predicate.minmaximum_grad 0.36% : 0.000001s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.36% : 0.000008s : 48: predicate.partial_eliminate 1.46% : 0.000005s : 40: predicate.print_const_string_wrapper 1.97% : 0.000007s : 40: predicate.reduce_eliminate 1.81% : 0.000006s : 47: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000002s : 15: predicate.remove_not_recompute_node 2.75% : 0.000009s : 88: predicate.replace_applicator 1.25% : 0.000004s : 43: predicate.replace_old_param 0.08% : 0.000000s : 1: predicate.reset_defer_inline 1.55% : 0.000005s : 40: predicate.reshape_eliminate 1.58% : 0.000005s : 40: predicate.row_tensor_add_zeros_like 0.24% : 0.000001s : 1: predicate.row_tensor_eliminate 1.48% : 0.000005s : 40: predicate.same_eliminate 0.41% : 0.000001s : 15: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.81% : 0.000003s : 15: predicate.specialize_transform 1.76% : 0.000006s : 40: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000005s : 40: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.88% : 0.000010s : 59: predicate.switch_defer_inline 2.60% : 0.000009s : 59: predicate.switch_layer_defer_inline 6.46% : 0.000022s : 143: predicate.switch_simplify 1.58% : 0.000005s : 40: predicate.tile_eliminate 1.52% : 0.000005s : 40: predicate.transpose_eliminate 1.90% : 0.000006s : 40: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000006s : 40: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000012s : 49: predicate.tuple_list_get_item_eliminator 1.82% : 0.000006s : 40: predicate.tuple_list_set_item_eliminator 1.82% : 0.000006s : 47: predicate.tuple_to_list_eliminator_ 1.85% : 0.000006s : 48: predicate.updatestate_pure_node_eliminater 2.67% : 0.000009s : 63: predicate.updatestate_useless_node_eliminater 1.99% : 0.000007s : 40: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.27% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002169 34 61.55% : 0.001335s : 18: func_graph_cloner_run.FuncGraphClonerGraph 38.45% : 0.000834s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046595 87 0.08% : 0.000039s : 1: add_recomputation 0.21% : 0.000100s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.63% : 0.000295s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.07% : 0.000033s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.12% : 0.000057s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 41.35% : 0.019265s : 1: jit_opt_a 0.27% : 0.000124s : 1: jit_opt_after_cconv 0.10% : 0.000044s : 1: jit_opt_b 0.89% : 0.000415s : 1: loop_unroll 1.59% : 0.000740s : 1: mutable_eliminate 5.53% : 0.002575s : 39: opt.transform.jit_opt_a 0.06% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000011s : 1: opt.transform.mutable_eliminate 0.03% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.96% : 0.000448s : 1: opt_after_jit_grad 0.05% : 0.000023s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 17.91% : 0.008344s : 2: renormalize.infer 4.60% : 0.002145s : 2: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.24% : 0.000112s : 1: rewriter_before_opt_a 0.15% : 0.000072s : 1: symbol_engine_optimizer 24.60% : 0.011461s : 1: type_inference TotalTime = 0.0572361, [30] [bootstrap]: 0.0003622 [type_inference]: 0.0478754 [event_method]: 2.429e-05 [auto_monad]: 7.217e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00011219 [rewriter_before_opt_a]: 8.661e-05 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.00625321, [2] [Cycle 1]: 0.00210838, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 3.008e-05 [a_1]: 0.00055449 [with_stream_mark]: 2.226e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.454e-05 [j_node_and_user_rematch]: 9.29998e-06 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 6.76e-06 [renormalize]: 0.00103879 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.62e-05 [cse]: 3.439e-05 [replace_applicator]: 1.741e-05 [Cycle 2]: 0.00034025, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.187e-05 [with_stream_mark]: 1.193e-05 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 2.94001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.492e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.523e-05 [replace_applicator]: 6.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.564e-05 [rewriter_after_opt_a]: 4.226e-05 [convert_after_rewriter]: 7.78999e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.0007079 [jit_opt_b]: 5.425e-05, [1] [Cycle 1]: 4.649e-05, [2] [frontend_op_eliminate]: 1.729e-05 [inline_after_opt_a]: 1.789e-05 [cconv]: 3.145e-05 [loop_unroll]: 0.0004557 [jit_opt_after_cconv]: 0.00015705, [1] [Cycle 1]: 0.00015009, [11] [c_1]: 2.072e-05 [parameter_eliminate]: 3.98001e-06 [updatestate_depend_eliminate]: 8.03999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.50002e-06 [cse]: 2.831e-05 [call_graph_tuple_transform]: 2.116e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.61998e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 7.66999e-06 [add_recomputation]: 5.45e-05 [cse_after_recomputation]: 2.488e-05, [1] [Cycle 1]: 1.898e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.739e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 5.27999e-06 [opt_after_jit_grad]: 0.00050692 [symbol_engine_optimizer]: 9.273e-05, [1] [Cycle 1]: 8.629e-05, [6] [build]: 4.95001e-06 [elim_shapecalc]: 7.76001e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 6.11e-06 [fold_const_symbol]: 2.614e-05 [renormalize]: 3.19997e-07 [validate]: 4.753e-05 Sums bootstrap : 0.000362s : 0.69% type_inference : 0.047875s : 90.70% event_method : 0.000024s : 0.05% auto_monad : 0.000072s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000112s : 0.21% rewriter_before_opt_a : 0.000087s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.13% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000646s : 1.22% jit_opt_a.with_stream_mark : 0.000034s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001039s : 1.97% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000050s : 0.09% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000042s : 0.08% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000708s : 1.34% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000031s : 0.06% loop_unroll : 0.000456s : 0.86% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000054s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000507s : 0.96% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000026s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.09% Time group info: ------[substitution.] 0.000230 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.22% : 0.000005s : 3: substitution.graph_param_transform 84.28% : 0.000194s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 2.39% : 0.000006s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047787 2 96.10% : 0.045922s : 1: type_inference.infer 3.90% : 0.001865s : 1: type_inference.specialize ------[replace.] 0.000068 6 69.45% : 0.000047s : 4: replace.inline 30.55% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.11% : 0.000192s : 4: match.inline 5.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.76% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.45% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.47% : 0.000003s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000002s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.71% : 0.000001s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.15% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.18% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.33% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.98% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001020 13 43.10% : 0.000440s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.15% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.76% : 0.000528s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059216 72 0.10% : 0.000057s : 1: add_recomputation 0.13% : 0.000075s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.64% : 0.000379s : 1: bootstrap 0.06% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.57% : 0.006257s : 1: jit_opt_a 0.27% : 0.000160s : 1: jit_opt_after_cconv 0.10% : 0.000057s : 1: jit_opt_b 0.78% : 0.000463s : 1: loop_unroll 1.21% : 0.000717s : 1: mutable_eliminate 1.48% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000116s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.01% : 0.000596s : 1: renormalize.infer 0.73% : 0.000433s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000091s : 1: rewriter_before_opt_a 0.16% : 0.000095s : 1: symbol_engine_optimizer 80.88% : 0.047893s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.967.083 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c040> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:42.967.781 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.195068, [30] [bootstrap]: 0.00034017 [type_inference]: 0.159249 [event_method]: 2.449e-05 [auto_monad]: 8.101e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00057014 [rewriter_before_opt_a]: 9.411e-05 [expand_dump_flag]: 4.04002e-06 [jit_opt_a]: 0.0227525, [2] [Cycle 1]: 0.0145579, [27] [switch_simplify]: 7.539e-05 [loop_unroll]: 3.152e-05 [a_1]: 0.00075398 [with_stream_mark]: 2.486e-05 [recompute_prepare]: 1.054e-05 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.35997e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.58998e-06 [accelerated_algorithm]: 7.48e-06 [meta_shard_fg_expand]: 3.00998e-06 [get_grad_eliminate_]: 7.56001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.897e-05 [j_node_and_user_rematch]: 1.138e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.178e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.0132212 [add_forward_monad_depend]: 1.185e-05 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 2.415e-05 [cse]: 3.765e-05 [replace_applicator]: 2.848e-05 [Cycle 2]: 0.00045081, [27] [switch_simplify]: 8.12e-06 [loop_unroll]: 7.11001e-06 [a_1]: 0.00013695 [with_stream_mark]: 1.809e-05 [recompute_prepare]: 7.29001e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 7.16999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 3.8e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.121e-05 [j_node_and_user_rematch]: 1.086e-05 [meta_fg_expand]: 3.03e-06 [replace_old_param]: 1.223e-05 [inline_without_move]: 6.24999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.89e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 1.073e-05 [cse]: 1.457e-05 [replace_applicator]: 9.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.782e-05 [rewriter_after_opt_a]: 4.283e-05 [convert_after_rewriter]: 8.85001e-06 [order_py_execute_after_rewriter]: 5.69999e-06 [mutable_eliminate]: 0.00085244 [jit_opt_b]: 6.827e-05, [1] [Cycle 1]: 5.665e-05, [2] [frontend_op_eliminate]: 2.528e-05 [inline_after_opt_a]: 1.928e-05 [cconv]: 3.357e-05 [loop_unroll]: 0.00909793 [jit_opt_after_cconv]: 0.00023781, [1] [Cycle 1]: 0.00022581, [11] [c_1]: 3.578e-05 [parameter_eliminate]: 8.29002e-06 [updatestate_depend_eliminate]: 1.401e-05 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.89001e-06 [cse]: 4.812e-05 [call_graph_tuple_transform]: 3.576e-05 [tuple_list_get_item_eliminator]: 8.45001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 7.17002e-06 [remove_dup_value]: 1.842e-05 [partial_unused_args_eliminate]: 4.33001e-06 [environ_conv]: 1.269e-05 [add_recomputation]: 6.738e-05 [cse_after_recomputation]: 2.587e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.303e-05 [auto_monad_reorder]: 1.615e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 1.056e-05 [opt_after_jit_grad]: 0.00073286 [symbol_engine_optimizer]: 9.89e-05, [1] [Cycle 1]: 8.763e-05, [6] [build]: 5.10999e-06 [elim_shapecalc]: 9.27999e-06 [elim_not_effective]: 2.183e-05 [opt_reshape]: 1.151e-05 [fold_const_symbol]: 9.97999e-06 [renormalize]: 7.80012e-07 [validate]: 0.00032554 Sums bootstrap : 0.000340s : 0.18% type_inference : 0.159249s : 85.37% event_method : 0.000024s : 0.01% auto_monad : 0.000081s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000570s : 0.31% rewriter_before_opt_a : 0.000094s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.04% jit_opt_a.loop_unroll : 0.000039s : 0.02% jit_opt_a.a_1 : 0.000891s : 0.48% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.013221s : 7.09% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.02% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000852s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.009098s : 4.88% jit_opt_after_cconv.c_1 : 0.000036s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000067s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000733s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000012s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000326s : 0.17% Time group info: ------[substitution.] 0.000313 24 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 3.45% : 0.000011s : 4: substitution.graph_param_transform 84.35% : 0.000264s : 4: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000007s : 4: substitution.remove_not_recompute_node 2.62% : 0.000008s : 2: substitution.replace_old_param 4.59% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.159142 2 97.62% : 0.155354s : 1: type_inference.infer 2.38% : 0.003787s : 1: type_inference.specialize ------[replace.] 0.000130 6 77.34% : 0.000100s : 4: replace.inline 22.66% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 6 95.20% : 0.000261s : 4: match.inline 4.80% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.06% : 0.000002s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.90% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000003s : 12: predicate.arithmetic_simplify 1.10% : 0.000002s : 12: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 12: predicate.compare_switch_simplify 1.09% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.01% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.15% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.35% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_depend_swap 1.51% : 0.000002s : 12: predicate.environ_get_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 6.60% : 0.000010s : 26: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.66% : 0.000003s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 18: predicate.load_eliminater 4.02% : 0.000006s : 4: predicate.loop_unroll_after_grad 3.41% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.25% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 12: predicate.merge_addn 0.95% : 0.000002s : 12: predicate.minmaximum_grad 2.21% : 0.000003s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 1.94% : 0.000003s : 18: predicate.partial_eliminate 1.33% : 0.000002s : 12: predicate.print_const_string_wrapper 1.50% : 0.000002s : 12: predicate.reduce_eliminate 1.20% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.07% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.05% : 0.000002s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.16% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 18: predicate.switch_defer_inline 1.73% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000012s : 58: predicate.switch_simplify 1.00% : 0.000002s : 12: predicate.tile_eliminate 1.12% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.31% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003117 22 53.68% : 0.001673s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.01% : 0.000063s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.30% : 0.001381s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.209326 72 0.03% : 0.000071s : 1: add_recomputation 0.04% : 0.000085s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.17% : 0.000362s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 10.87% : 0.022756s : 1: jit_opt_a 0.12% : 0.000243s : 1: jit_opt_after_cconv 0.03% : 0.000071s : 1: jit_opt_b 4.36% : 0.009131s : 1: loop_unroll 0.42% : 0.000869s : 1: mutable_eliminate 0.57% : 0.001183s : 26: opt.transform.jit_opt_a 0.04% : 0.000083s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.02% : 0.000043s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000745s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000579s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 5.61% : 0.011746s : 1: renormalize.infer 0.70% : 0.001460s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.05% : 0.000101s : 1: rewriter_before_opt_a 0.05% : 0.000102s : 1: symbol_engine_optimizer 76.09% : 0.159278s : 1: type_inference TotalTime = 0.0250026, [30] [bootstrap]: 0.00029678 [type_inference]: 0.0099977 [event_method]: 2.483e-05 [auto_monad]: 7.452e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 6.9e-05 [rewriter_before_opt_a]: 9.985e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.0114073, [2] [Cycle 1]: 0.00233099, [27] [switch_simplify]: 6.809e-05 [loop_unroll]: 3.723e-05 [a_1]: 0.00072545 [with_stream_mark]: 2.25e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.83999e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 6.35002e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 5.51e-06 [renormalize]: 0.00110443 [add_forward_monad_depend]: 5.86998e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.663e-05 [cse]: 4.29e-05 [replace_applicator]: 1.522e-05 [Cycle 2]: 0.00550842, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 5.44998e-06 [a_1]: 9.653e-05 [with_stream_mark]: 1.147e-05 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.14003e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.31002e-06 [meta_shard_fg_expand]: 1.56998e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 6.589e-05 [meta_fg_expand]: 7.98001e-06 [replace_old_param]: 1.481e-05 [inline_without_move]: 7.55e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.184e-05 [auto_monad_grad]: 3.33e-06 [auto_monad_eliminator]: 3.174e-05 [cse]: 5.245e-05 [replace_applicator]: 7e-06 [py_interpret_to_execute_after_opt_a]: 2.655e-05 [rewriter_after_opt_a]: 5.182e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.72999e-06 [mutable_eliminate]: 0.00080695 [jit_opt_b]: 6.437e-05, [1] [Cycle 1]: 5.498e-05, [2] [frontend_op_eliminate]: 2.207e-05 [inline_after_opt_a]: 2.138e-05 [cconv]: 4.207e-05 [loop_unroll]: 0.00051293 [jit_opt_after_cconv]: 0.00030833, [1] [Cycle 1]: 0.00019001, [11] [c_1]: 3.1e-05 [parameter_eliminate]: 4.50999e-06 [updatestate_depend_eliminate]: 1.106e-05 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.48999e-06 [cse]: 3.531e-05 [call_graph_tuple_transform]: 2.47e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.2e-06 [remove_dup_value]: 9.512e-05 [partial_unused_args_eliminate]: 2.99001e-06 [environ_conv]: 6.68e-06 [add_recomputation]: 6.101e-05 [cse_after_recomputation]: 3.226e-05, [1] [Cycle 1]: 2.397e-05, [1] [cse]: 1.499e-05 [auto_monad_reorder]: 1.941e-05 [get_jit_bprop_graph]: 2.86999e-06 [rewriter_after_jit_bprop_graph]: 7.83001e-06 [opt_after_jit_grad]: 0.0005273 [symbol_engine_optimizer]: 8.59e-05, [1] [Cycle 1]: 7.898e-05, [6] [build]: 5.76998e-06 [elim_shapecalc]: 1.091e-05 [elim_not_effective]: 1.486e-05 [opt_reshape]: 6.37001e-06 [fold_const_symbol]: 1.1e-05 [renormalize]: 3.00002e-07 [validate]: 5.022e-05 Sums bootstrap : 0.000297s : 1.91% type_inference : 0.009998s : 64.25% event_method : 0.000025s : 0.16% auto_monad : 0.000075s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000069s : 0.44% rewriter_before_opt_a : 0.000100s : 0.64% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.48% jit_opt_a.loop_unroll : 0.000043s : 0.27% jit_opt_a.a_1 : 0.000822s : 5.28% jit_opt_a.with_stream_mark : 0.000034s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000076s : 0.49% jit_opt_a.meta_fg_expand : 0.000011s : 0.07% jit_opt_a.replace_old_param : 0.000025s : 0.16% jit_opt_a.inline_without_move : 0.000013s : 0.08% jit_opt_a.renormalize : 0.001104s : 7.10% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.11% jit_opt_a.auto_monad_grad : 0.000006s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000048s : 0.31% jit_opt_a.cse : 0.000095s : 0.61% jit_opt_a.replace_applicator : 0.000022s : 0.14% py_interpret_to_execute_after_opt_a : 0.000027s : 0.17% rewriter_after_opt_a : 0.000052s : 0.33% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000807s : 5.19% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.14% jit_opt_b.inline_after_opt_a : 0.000021s : 0.14% cconv : 0.000042s : 0.27% loop_unroll : 0.000513s : 3.30% jit_opt_after_cconv.c_1 : 0.000031s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000035s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.05% remove_dup_value : 0.000095s : 0.61% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000061s : 0.39% cse_after_recomputation.cse : 0.000015s : 0.10% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.05% opt_after_jit_grad : 0.000527s : 3.39% symbol_engine_optimizer.build : 0.000006s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.32% Time group info: ------[substitution.] 0.000303 24 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 3: substitution.graph_param_transform 84.35% : 0.000256s : 5: substitution.inline 2.91% : 0.000009s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 3.18% : 0.000010s : 2: substitution.replace_old_param 4.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009914 2 84.72% : 0.008399s : 1: type_inference.infer 15.28% : 0.001515s : 1: type_inference.specialize ------[replace.] 0.000108 7 67.68% : 0.000073s : 5: replace.inline 32.32% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 7 95.49% : 0.000253s : 5: match.inline 4.51% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 747 1.21% : 0.000002s : 11: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 11: predicate.addn_check_dump 1.21% : 0.000002s : 11: predicate.addn_zero_filter 1.85% : 0.000003s : 11: predicate.arithmetic_simplify 1.20% : 0.000002s : 11: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 11: predicate.environ_get_depend_swap 1.24% : 0.000002s : 11: predicate.environ_get_eliminate 1.20% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 6.45% : 0.000010s : 24: predicate.inline 1.64% : 0.000002s : 6: predicate.inline_without_move 1.16% : 0.000002s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 16: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000002s : 11: predicate.minmaximum_grad 1.69% : 0.000003s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000002s : 11: predicate.print_const_string_wrapper 1.94% : 0.000003s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 19: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 11: predicate.reshape_eliminate 1.19% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.04% : 0.000002s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 11: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.90% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 2.14% : 0.000003s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001081 16 47.54% : 0.000514s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.73% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.72% : 0.000484s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027269 72 0.23% : 0.000064s : 1: add_recomputation 0.29% : 0.000078s : 1: auto_monad 0.08% : 0.000022s : 1: auto_monad_reorder 1.16% : 0.000317s : 1: bootstrap 0.16% : 0.000045s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000034s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.11% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.22% : 0.000061s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 41.85% : 0.011413s : 1: jit_opt_a 1.14% : 0.000311s : 1: jit_opt_after_cconv 0.24% : 0.000067s : 1: jit_opt_b 1.92% : 0.000524s : 1: loop_unroll 3.00% : 0.000818s : 1: mutable_eliminate 4.14% : 0.001128s : 26: opt.transform.jit_opt_a 0.24% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000035s : 4: opt.transform.jit_opt_b 0.06% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000018s : 1: opt.transform.mutable_eliminate 0.09% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000039s : 4: opt.transform.symbol_engine_opt 1.97% : 0.000537s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000072s : 1: py_interpret_to_execute 0.11% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.37% : 0.000101s : 1: remove_dup_value 2.26% : 0.000617s : 1: renormalize.infer 1.75% : 0.000478s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000055s : 1: rewriter_after_opt_a 0.38% : 0.000103s : 1: rewriter_before_opt_a 0.33% : 0.000089s : 1: symbol_engine_optimizer 36.74% : 0.010018s : 1: type_inference TotalTime = 0.0445793, [30] [bootstrap]: 0.00032248 [type_inference]: 0.0234731 [event_method]: 2.214e-05 [auto_monad]: 6.943e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00012097 [rewriter_before_opt_a]: 8.555e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.0178636, [2] [Cycle 1]: 0.0134558, [27] [switch_simplify]: 6.365e-05 [loop_unroll]: 2.99e-05 [a_1]: 0.00058981 [with_stream_mark]: 2.727e-05 [recompute_prepare]: 1.001e-05 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.66003e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.784e-05 [j_node_and_user_rematch]: 9.26998e-06 [meta_fg_expand]: 3.13e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.0123281 [add_forward_monad_depend]: 1.216e-05 [auto_monad_grad]: 3.13e-06 [auto_monad_eliminator]: 2.659e-05 [cse]: 3.917e-05 [replace_applicator]: 2.755e-05 [Cycle 2]: 0.00038112, [27] [switch_simplify]: 6.95998e-06 [loop_unroll]: 6.75998e-06 [a_1]: 0.00010541 [with_stream_mark]: 1.741e-05 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 5.51002e-06 [merge_forward]: 5.29e-06 [cell_reuse_recompute_pass]: 4.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.007e-05 [j_node_and_user_rematch]: 9.83998e-06 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.73001e-06 [cse]: 1.471e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 2.062e-05 [rewriter_after_opt_a]: 4.426e-05 [convert_after_rewriter]: 7.63999e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00091833 [jit_opt_b]: 5.402e-05, [1] [Cycle 1]: 4.569e-05, [2] [frontend_op_eliminate]: 1.766e-05 [inline_after_opt_a]: 1.697e-05 [cconv]: 2.855e-05 [loop_unroll]: 0.00045804 [jit_opt_after_cconv]: 0.00015014, [1] [Cycle 1]: 0.00014417, [11] [c_1]: 2.14e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 7.65998e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.378e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.589e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.38998e-06 [add_recomputation]: 5.097e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.856e-05, [1] [cse]: 1.238e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 5.49998e-06 [opt_after_jit_grad]: 0.00049218 [symbol_engine_optimizer]: 7.329e-05, [1] [Cycle 1]: 6.684e-05, [6] [build]: 5.14998e-06 [elim_shapecalc]: 7.33e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 3.50003e-07 [validate]: 5.524e-05 Sums bootstrap : 0.000322s : 0.81% type_inference : 0.023473s : 58.78% event_method : 0.000022s : 0.06% auto_monad : 0.000069s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000121s : 0.30% rewriter_before_opt_a : 0.000086s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.18% jit_opt_a.loop_unroll : 0.000037s : 0.09% jit_opt_a.a_1 : 0.000695s : 1.74% jit_opt_a.with_stream_mark : 0.000045s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000010s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.012328s : 30.87% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.09% jit_opt_a.cse : 0.000054s : 0.13% jit_opt_a.replace_applicator : 0.000033s : 0.08% py_interpret_to_execute_after_opt_a : 0.000021s : 0.05% rewriter_after_opt_a : 0.000044s : 0.11% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000918s : 2.30% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000458s : 1.15% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.13% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000492s : 1.23% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.14% Time group info: ------[substitution.] 0.000234 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 3: substitution.graph_param_transform 83.51% : 0.000196s : 4: substitution.inline 2.05% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000006s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023383 2 92.38% : 0.021601s : 1: type_inference.infer 7.62% : 0.001782s : 1: type_inference.specialize ------[replace.] 0.000077 6 66.01% : 0.000051s : 4: replace.inline 33.99% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.31% : 0.000193s : 4: match.inline 5.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.61% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.73% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.57% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.66% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000002s : 10: predicate.environ_get_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.18% : 0.000002s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.20% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 6: predicate.less_batch_normalization 1.90% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000002s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.00% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 2.84% : 0.000004s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000010s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.72% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001071 13 38.63% : 0.000414s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.72% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.65% : 0.000607s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057892 72 0.09% : 0.000054s : 1: add_recomputation 0.13% : 0.000073s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.58% : 0.000336s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 30.86% : 0.017868s : 1: jit_opt_a 0.26% : 0.000153s : 1: jit_opt_after_cconv 0.10% : 0.000056s : 1: jit_opt_b 0.80% : 0.000466s : 1: loop_unroll 1.60% : 0.000928s : 1: mutable_eliminate 1.64% : 0.000948s : 26: opt.transform.jit_opt_a 0.09% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.86% : 0.000500s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000124s : 1: py_interpret_to_execute 0.04% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 20.08% : 0.011625s : 1: renormalize.infer 1.18% : 0.000686s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000047s : 1: rewriter_after_opt_a 0.15% : 0.000089s : 1: rewriter_before_opt_a 0.13% : 0.000076s : 1: symbol_engine_optimizer 40.58% : 0.023496s : 1: type_inference TotalTime = 0.012945, [30] [bootstrap]: 0.00028389 [type_inference]: 0.00484564 [event_method]: 1.822e-05 [auto_monad]: 6.459e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 3.363e-05 [rewriter_before_opt_a]: 7.177e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.00546644, [2] [Cycle 1]: 0.00178989, [27] [switch_simplify]: 5.696e-05 [loop_unroll]: 2.883e-05 [a_1]: 0.00054571 [with_stream_mark]: 2.078e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.77999e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.0007975 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.11998e-06 [auto_monad_eliminator]: 1.574e-05 [cse]: 3.64e-05 [replace_applicator]: 1.35e-05 [Cycle 2]: 0.00031363, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 4.94003e-06 [a_1]: 8.693e-05 [with_stream_mark]: 9.98998e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 4.82e-06 [updatestate_useless_node_eliminater]: 4.79002e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.49998e-06 [get_grad_eliminate_]: 4.43001e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.214e-05 [j_node_and_user_rematch]: 7.89002e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.77e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.287e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.341e-05 [rewriter_after_opt_a]: 3.733e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00055586 [jit_opt_b]: 4.977e-05, [1] [Cycle 1]: 4.22e-05, [2] [frontend_op_eliminate]: 1.494e-05 [inline_after_opt_a]: 1.617e-05 [cconv]: 2.798e-05 [loop_unroll]: 0.00041855 [jit_opt_after_cconv]: 0.00015713, [1] [Cycle 1]: 0.00015044, [11] [c_1]: 2.034e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 7.91001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.60002e-06 [cse]: 2.642e-05 [call_graph_tuple_transform]: 1.949e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 1.288e-05 [remove_dup_value]: 1.716e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 6.28e-06 [add_recomputation]: 5.397e-05 [cse_after_recomputation]: 2.433e-05, [1] [Cycle 1]: 1.899e-05, [1] [cse]: 1.265e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 5.53002e-06 [opt_after_jit_grad]: 0.00046139 [symbol_engine_optimizer]: 6.979e-05, [1] [Cycle 1]: 6.34e-05, [6] [build]: 2.97002e-06 [elim_shapecalc]: 7.33e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.31002e-06 [fold_const_symbol]: 8.29998e-06 [renormalize]: 3.89991e-07 [validate]: 4.086e-05 Sums bootstrap : 0.000284s : 3.15% type_inference : 0.004846s : 53.79% event_method : 0.000018s : 0.20% auto_monad : 0.000065s : 0.72% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000034s : 0.37% rewriter_before_opt_a : 0.000072s : 0.80% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000063s : 0.70% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000633s : 7.02% jit_opt_a.with_stream_mark : 0.000031s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000798s : 8.85% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000049s : 0.55% jit_opt_a.replace_applicator : 0.000019s : 0.21% py_interpret_to_execute_after_opt_a : 0.000013s : 0.15% rewriter_after_opt_a : 0.000037s : 0.41% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000556s : 6.17% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000028s : 0.31% loop_unroll : 0.000419s : 4.65% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000026s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000013s : 0.14% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000054s : 0.60% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000461s : 5.12% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.45% Time group info: ------[substitution.] 0.000220 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 3: substitution.graph_param_transform 84.27% : 0.000186s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000005s : 2: substitution.replace_old_param 5.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004783 2 83.46% : 0.003992s : 1: type_inference.infer 16.54% : 0.000791s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.64% : 0.000045s : 4: replace.inline 33.36% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.85% : 0.000183s : 4: match.inline 6.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.88% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000000s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.64% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000624 13 53.95% : 0.000337s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.46% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.59% : 0.000241s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014646 72 0.39% : 0.000057s : 1: add_recomputation 0.46% : 0.000068s : 1: auto_monad 0.15% : 0.000021s : 1: auto_monad_reorder 2.07% : 0.000303s : 1: bootstrap 0.21% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.35% : 0.005470s : 1: jit_opt_a 1.09% : 0.000160s : 1: jit_opt_after_cconv 0.36% : 0.000052s : 1: jit_opt_b 2.92% : 0.000427s : 1: loop_unroll 3.86% : 0.000565s : 1: mutable_eliminate 5.77% : 0.000845s : 26: opt.transform.jit_opt_a 0.38% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.21% : 0.000470s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000036s : 1: py_interpret_to_execute 0.11% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000020s : 1: remove_dup_value 3.36% : 0.000492s : 1: renormalize.infer 2.03% : 0.000298s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000041s : 1: rewriter_after_opt_a 0.51% : 0.000074s : 1: rewriter_before_opt_a 0.49% : 0.000072s : 1: symbol_engine_optimizer 33.19% : 0.004861s : 1: type_inference TotalTime = 0.129579, [30] [bootstrap]: 0.00041692 [type_inference]: 0.102686 [event_method]: 2.342e-05 [auto_monad]: 7.592e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00029885 [rewriter_before_opt_a]: 0.00011898 [expand_dump_flag]: 4.58001e-06 [jit_opt_a]: 0.023233, [2] [Cycle 1]: 0.0190584, [27] [switch_simplify]: 6.217e-05 [loop_unroll]: 2.96e-05 [a_1]: 0.00062962 [with_stream_mark]: 2.224e-05 [recompute_prepare]: 8.62998e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.81001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.97002e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 1.18e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 1.157e-05 [inline_without_move]: 6.00002e-06 [renormalize]: 0.0178828 [add_forward_monad_depend]: 1.54e-05 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 2.612e-05 [cse]: 3.951e-05 [replace_applicator]: 2.948e-05 [Cycle 2]: 0.00043098, [27] [switch_simplify]: 9.03002e-06 [loop_unroll]: 7.15e-06 [a_1]: 0.00014196 [with_stream_mark]: 1.812e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 4.34997e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 6.33e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 6.23002e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 3.83001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.989e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.075e-05 [inline_without_move]: 5.93002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.343e-05 [replace_applicator]: 6.11998e-06 [py_interpret_to_execute_after_opt_a]: 2.115e-05 [rewriter_after_opt_a]: 4.231e-05 [convert_after_rewriter]: 7.37002e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00086065 [jit_opt_b]: 6.16e-05, [1] [Cycle 1]: 5.299e-05, [2] [frontend_op_eliminate]: 2.161e-05 [inline_after_opt_a]: 2.01e-05 [cconv]: 3.351e-05 [loop_unroll]: 0.00046472 [jit_opt_after_cconv]: 0.00016761, [1] [Cycle 1]: 0.00016053, [11] [c_1]: 2.653e-05 [parameter_eliminate]: 4.35e-06 [updatestate_depend_eliminate]: 7.98999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.756e-05 [call_graph_tuple_transform]: 2.375e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 6.33002e-06 [remove_dup_value]: 1.597e-05 [partial_unused_args_eliminate]: 3.01001e-06 [environ_conv]: 1.107e-05 [add_recomputation]: 5.474e-05 [cse_after_recomputation]: 2.428e-05, [1] [Cycle 1]: 1.852e-05, [1] [cse]: 1.197e-05 [auto_monad_reorder]: 1.575e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 7.53e-06 [opt_after_jit_grad]: 0.00048852 [symbol_engine_optimizer]: 0.00012505, [1] [Cycle 1]: 0.00011874, [6] [build]: 4.63001e-06 [elim_shapecalc]: 8.12998e-06 [elim_not_effective]: 1.538e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 5.385e-05 [renormalize]: 6.00005e-07 [validate]: 5.912e-05 Sums bootstrap : 0.000417s : 0.33% type_inference : 0.102686s : 82.06% event_method : 0.000023s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000299s : 0.24% rewriter_before_opt_a : 0.000119s : 0.10% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000772s : 0.62% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.017883s : 14.29% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.03% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000036s : 0.03% py_interpret_to_execute_after_opt_a : 0.000021s : 0.02% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000861s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000465s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000489s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000054s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.05% Time group info: ------[substitution.] 0.000256 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.89% : 0.000007s : 4: substitution.graph_param_transform 83.13% : 0.000213s : 4: substitution.inline 2.09% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000006s : 4: substitution.remove_not_recompute_node 2.77% : 0.000007s : 2: substitution.replace_old_param 5.41% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102583 2 97.66% : 0.100183s : 1: type_inference.infer 2.34% : 0.002400s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.29% : 0.000054s : 4: replace.inline 31.71% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.29% : 0.000211s : 4: match.inline 5.71% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.33% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 4: predicate.elim_not_effective 0.74% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.73% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.75% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.39% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 12: predicate.merge_addn 0.96% : 0.000001s : 12: predicate.minmaximum_grad 2.22% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.48% : 0.000002s : 12: predicate.print_const_string_wrapper 1.86% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.55% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.99% : 0.000010s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000001s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003641 30 67.74% : 0.002466s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.80% : 0.001121s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148594 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.30% : 0.000445s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 15.64% : 0.023237s : 1: jit_opt_a 0.11% : 0.000171s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.32% : 0.000473s : 1: loop_unroll 0.59% : 0.000872s : 1: mutable_eliminate 0.70% : 0.001039s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000080s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000499s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000305s : 1: py_interpret_to_execute 0.02% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 11.12% : 0.016520s : 1: renormalize.infer 0.90% : 0.001342s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.10% : 0.000147s : 1: rewriter_before_opt_a 0.09% : 0.000128s : 1: symbol_engine_optimizer 69.12% : 0.102711s : 1: type_inference TotalTime = 0.150575, [30] [bootstrap]: 0.00025968 [type_inference]: 0.119611 [event_method]: 0.00053967 [auto_monad]: 0.00012319 [graph_reusing]: 7.4e-06 [pre_auto_parallel]: 3.56001e-06 [py_interpret_to_execute]: 4.01e-05 [rewriter_before_opt_a]: 0.00012468 [expand_dump_flag]: 3.37002e-06 [jit_opt_a]: 0.0272925, [3] [Cycle 1]: 0.0190682, [27] [switch_simplify]: 8.216e-05 [loop_unroll]: 4.139e-05 [a_1]: 0.00097602 [with_stream_mark]: 3.719e-05 [recompute_prepare]: 2.108e-05 [updatestate_depend_eliminate]: 9.62001e-06 [updatestate_assign_eliminate]: 7.05e-06 [updatestate_loads_eliminate]: 6.90002e-06 [parameter_eliminate]: 3.04001e-06 [specialize_transform]: 1.457e-05 [updatestate_useless_node_eliminater]: 1.359e-05 [accelerated_algorithm]: 1.366e-05 [meta_shard_fg_expand]: 4.3e-06 [get_grad_eliminate_]: 1.437e-05 [merge_forward]: 1.112e-05 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.967e-05 [j_node_and_user_rematch]: 2.475e-05 [meta_fg_expand]: 0.00197077 [replace_old_param]: 7.264e-05 [inline_without_move]: 6.222e-05 [renormalize]: 0.0149156 [add_forward_monad_depend]: 1.508e-05 [auto_monad_grad]: 6.83998e-06 [auto_monad_eliminator]: 6.25e-05 [cse]: 0.00027077 [replace_applicator]: 9.546e-05 [Cycle 2]: 0.00373888, [27] [switch_simplify]: 4.178e-05 [loop_unroll]: 4.212e-05 [a_1]: 0.00124371 [with_stream_mark]: 2.736e-05 [recompute_prepare]: 1.12e-05 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.74002e-06 [parameter_eliminate]: 2.93e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.98998e-06 [accelerated_algorithm]: 6.11998e-06 [meta_shard_fg_expand]: 3.46999e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.802e-05 [j_node_and_user_rematch]: 9.66003e-06 [meta_fg_expand]: 0.00010011 [replace_old_param]: 8.35999e-06 [inline_without_move]: 7.20003e-06 [renormalize]: 0.00189421 [add_forward_monad_depend]: 9.66998e-06 [auto_monad_grad]: 2.75997e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 3.063e-05 [replace_applicator]: 2.129e-05 [Cycle 3]: 0.00027604, [27] [switch_simplify]: 4.27998e-06 [loop_unroll]: 4.06001e-06 [a_1]: 4.8e-05 [with_stream_mark]: 1.364e-05 [recompute_prepare]: 3.59002e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 4.15999e-06 [updatestate_useless_node_eliminater]: 3.32002e-06 [accelerated_algorithm]: 4.32e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 3.81001e-06 [merge_forward]: 3.49001e-06 [cell_reuse_recompute_pass]: 2.98998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 6.22001e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 3.55e-06 [inline_without_move]: 3.16999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 4.52e-06 [cse]: 9.00001e-06 [replace_applicator]: 3.25e-06 [py_interpret_to_execute_after_opt_a]: 1.491e-05 [rewriter_after_opt_a]: 3.912e-05 [convert_after_rewriter]: 6.72002e-06 [order_py_execute_after_rewriter]: 4.17e-06 [mutable_eliminate]: 0.00080361 [jit_opt_b]: 4.511e-05, [1] [Cycle 1]: 3.686e-05, [2] [frontend_op_eliminate]: 1.2e-05 [inline_after_opt_a]: 1.21e-05 [cconv]: 3.438e-05 [loop_unroll]: 0.00054041 [jit_opt_after_cconv]: 0.00014097, [1] [Cycle 1]: 0.00013329, [11] [c_1]: 1.397e-05 [parameter_eliminate]: 3.10998e-06 [updatestate_depend_eliminate]: 7.12002e-06 [updatestate_assign_eliminate]: 2.06003e-06 [updatestate_loads_eliminate]: 1.62001e-06 [cse]: 2.62e-05 [call_graph_tuple_transform]: 1.539e-05 [tuple_list_get_item_eliminator]: 4.01001e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 3.5e-06 [remove_dup_value]: 1.668e-05 [partial_unused_args_eliminate]: 2.85002e-06 [environ_conv]: 5.61e-06 [add_recomputation]: 4.135e-05 [cse_after_recomputation]: 2.059e-05, [1] [Cycle 1]: 1.429e-05, [1] [cse]: 7.53e-06 [auto_monad_reorder]: 1.364e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 6.64999e-06 [opt_after_jit_grad]: 0.00048519 [symbol_engine_optimizer]: 9.578e-05, [1] [Cycle 1]: 8.927e-05, [6] [build]: 4.60999e-06 [elim_shapecalc]: 5.61998e-06 [elim_not_effective]: 1.063e-05 [opt_reshape]: 2.938e-05 [fold_const_symbol]: 7.07002e-06 [renormalize]: 7.60017e-07 [validate]: 3.898e-05 Sums bootstrap : 0.000260s : 0.18% type_inference : 0.119611s : 82.26% event_method : 0.000540s : 0.37% auto_monad : 0.000123s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000125s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000128s : 0.09% jit_opt_a.loop_unroll : 0.000088s : 0.06% jit_opt_a.a_1 : 0.002268s : 1.56% jit_opt_a.with_stream_mark : 0.000078s : 0.05% jit_opt_a.recompute_prepare : 0.000036s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.01% jit_opt_a.specialize_transform : 0.000025s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000062s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.03% jit_opt_a.meta_fg_expand : 0.002073s : 1.43% jit_opt_a.replace_old_param : 0.000085s : 0.06% jit_opt_a.inline_without_move : 0.000073s : 0.05% jit_opt_a.renormalize : 0.016810s : 11.56% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.06% jit_opt_a.cse : 0.000310s : 0.21% jit_opt_a.replace_applicator : 0.000120s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000804s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000012s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000540s : 0.37% jit_opt_after_cconv.c_1 : 0.000014s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000041s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000485s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000029s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000621 101 0.36% : 0.000002s : 1: substitution.elim_not_effective 0.19% : 0.000001s : 1: substitution.fold_const_symbol 0.74% : 0.000005s : 1: substitution.graph_param_transform 65.87% : 0.000409s : 12: substitution.inline 3.24% : 0.000020s : 2: substitution.inline_without_move 1.59% : 0.000010s : 11: substitution.j_node_and_user_rematch 1.96% : 0.000012s : 7: substitution.minmaximum_grad 1.27% : 0.000008s : 5: substitution.partial_eliminate 1.77% : 0.000011s : 11: substitution.remove_not_recompute_node 5.85% : 0.000036s : 10: substitution.replace_applicator 1.18% : 0.000007s : 10: substitution.replace_old_param 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.24% : 0.000008s : 1: substitution.tile_eliminate 4.17% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.63% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.49% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119495 2 97.38% : 0.116366s : 1: type_inference.infer 2.62% : 0.003129s : 1: type_inference.specialize ------[replace.] 0.000188 19 63.77% : 0.000120s : 12: replace.inline 36.23% : 0.000068s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000424 19 94.64% : 0.000401s : 12: match.inline 5.36% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000372 2432 1.62% : 0.000006s : 42: predicate.accumulaten_eliminater 0.25% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.37% : 0.000005s : 42: predicate.addn_check_dump 1.70% : 0.000006s : 42: predicate.addn_zero_filter 2.32% : 0.000009s : 42: predicate.arithmetic_simplify 1.61% : 0.000006s : 42: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.40% : 0.000005s : 42: predicate.compare_switch_simplify 1.65% : 0.000006s : 42: predicate.depend_value_elim 1.39% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.47% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.24% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.49% : 0.000006s : 42: predicate.environ_get_add_eliminate 1.49% : 0.000006s : 42: predicate.environ_get_depend_swap 1.53% : 0.000006s : 42: predicate.environ_get_eliminate 1.41% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 1.20% : 0.000004s : 16: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.37% : 0.000016s : 63: predicate.inline 2.12% : 0.000008s : 44: predicate.inline_without_move 0.33% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.93% : 0.000003s : 16: predicate.less_batch_normalization 1.91% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.81% : 0.000007s : 50: predicate.load_eliminater 0.36% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 43: predicate.make_slice_get_slice_eliminator 1.45% : 0.000005s : 42: predicate.merge_addn 1.50% : 0.000006s : 42: predicate.minmaximum_grad 0.56% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.26% : 0.000008s : 50: predicate.partial_eliminate 1.49% : 0.000006s : 42: predicate.print_const_string_wrapper 2.01% : 0.000007s : 42: predicate.reduce_eliminate 1.82% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 16: predicate.remove_not_recompute_node 2.87% : 0.000011s : 93: predicate.replace_applicator 1.18% : 0.000004s : 44: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 42: predicate.reshape_eliminate 1.59% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 1: predicate.row_tensor_eliminate 1.44% : 0.000005s : 42: predicate.same_eliminate 0.43% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.74% : 0.000003s : 16: predicate.specialize_transform 1.80% : 0.000007s : 42: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000011s : 61: predicate.switch_defer_inline 2.55% : 0.000010s : 61: predicate.switch_layer_defer_inline 6.67% : 0.000025s : 149: predicate.switch_simplify 1.60% : 0.000006s : 42: predicate.tile_eliminate 1.85% : 0.000007s : 42: predicate.transpose_eliminate 1.80% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.28% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.83% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.76% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.78% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.58% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.79% : 0.000007s : 42: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004009 43 74.62% : 0.002992s : 27: func_graph_cloner_run.FuncGraphClonerGraph 25.38% : 0.001017s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.170347 87 0.03% : 0.000044s : 1: add_recomputation 0.08% : 0.000132s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.17% : 0.000283s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.32% : 0.000551s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 16.02% : 0.027296s : 1: jit_opt_a 0.08% : 0.000144s : 1: jit_opt_after_cconv 0.03% : 0.000048s : 1: jit_opt_b 0.32% : 0.000550s : 1: loop_unroll 0.48% : 0.000815s : 1: mutable_eliminate 1.72% : 0.002938s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000493s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 8.48% : 0.014451s : 2: renormalize.infer 1.37% : 0.002334s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000128s : 1: rewriter_before_opt_a 0.06% : 0.000098s : 1: symbol_engine_optimizer 70.23% : 0.119636s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.131.580 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda01a60d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.132.329 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0613388, [30] [bootstrap]: 0.00028868 [type_inference]: 0.0513215 [event_method]: 1.936e-05 [auto_monad]: 6.866e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 9.513e-05 [rewriter_before_opt_a]: 8.127e-05 [expand_dump_flag]: 3.27002e-06 [jit_opt_a]: 0.00732078, [2] [Cycle 1]: 0.00206054, [27] [switch_simplify]: 5.819e-05 [loop_unroll]: 2.905e-05 [a_1]: 0.00056389 [with_stream_mark]: 2.308e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.48002e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00101334 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 1.669e-05 [cse]: 4.979e-05 [replace_applicator]: 1.319e-05 [Cycle 2]: 0.00032145, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.23002e-06 [a_1]: 8.87e-05 [with_stream_mark]: 1.027e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.56001e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.51002e-06 [meta_shard_fg_expand]: 1.31998e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.392e-05 [j_node_and_user_rematch]: 7.84002e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.48002e-06 [cse]: 1.236e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 1.209e-05 [rewriter_after_opt_a]: 3.919e-05 [convert_after_rewriter]: 8.25999e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00057954 [jit_opt_b]: 4.857e-05, [1] [Cycle 1]: 4.1e-05, [2] [frontend_op_eliminate]: 1.468e-05 [inline_after_opt_a]: 1.554e-05 [cconv]: 2.642e-05 [loop_unroll]: 0.00041267 [jit_opt_after_cconv]: 0.00013844, [1] [Cycle 1]: 0.00013222, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.062e-05 [call_graph_tuple_transform]: 1.823e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.17999e-06 [remove_dup_value]: 1.645e-05 [partial_unused_args_eliminate]: 2.30002e-06 [environ_conv]: 5.81003e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 3.652e-05, [1] [Cycle 1]: 3.125e-05, [1] [cse]: 2.533e-05 [auto_monad_reorder]: 1.821e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.70999e-06 [opt_after_jit_grad]: 0.00044861 [symbol_engine_optimizer]: 6.937e-05, [1] [Cycle 1]: 6.331e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 7.19001e-06 [elim_not_effective]: 1.242e-05 [opt_reshape]: 5.56e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 3.69997e-07 [validate]: 3.638e-05 Sums bootstrap : 0.000289s : 0.52% type_inference : 0.051321s : 91.95% event_method : 0.000019s : 0.03% auto_monad : 0.000069s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000095s : 0.17% rewriter_before_opt_a : 0.000081s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.12% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000653s : 1.17% jit_opt_a.with_stream_mark : 0.000033s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001013s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000062s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000039s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000580s : 1.04% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000026s : 0.05% loop_unroll : 0.000413s : 0.74% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.09% cse_after_recomputation.cse : 0.000025s : 0.05% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000449s : 0.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.07% Time group info: ------[substitution.] 0.000238 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 84.60% : 0.000201s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.38% : 0.000006s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051247 2 97.37% : 0.049899s : 1: type_inference.infer 2.63% : 0.001347s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.60% : 0.000048s : 4: replace.inline 32.40% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.31% : 0.000198s : 4: match.inline 5.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 2.06% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000009s : 53: predicate.switch_simplify 1.49% : 0.000002s : 10: predicate.tile_eliminate 1.46% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000774 13 47.05% : 0.000364s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.05% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.90% : 0.000355s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063277 72 0.08% : 0.000052s : 1: add_recomputation 0.11% : 0.000072s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.49% : 0.000309s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000039s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.57% : 0.007324s : 1: jit_opt_a 0.22% : 0.000141s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.66% : 0.000421s : 1: loop_unroll 0.93% : 0.000588s : 1: mutable_eliminate 1.38% : 0.000871s : 26: opt.transform.jit_opt_a 0.07% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.16% : 0.000098s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 0.99% : 0.000624s : 1: renormalize.infer 0.60% : 0.000381s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.11% : 0.000072s : 1: symbol_engine_optimizer 81.13% : 0.051338s : 1: type_inference TotalTime = 0.064153, [30] [bootstrap]: 0.00029339 [type_inference]: 0.0504214 [event_method]: 2.23e-05 [auto_monad]: 7.647e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00015621 [rewriter_before_opt_a]: 9.142e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00921683, [2] [Cycle 1]: 0.00458627, [27] [switch_simplify]: 8.55e-05 [loop_unroll]: 3.003e-05 [a_1]: 0.00158775 [with_stream_mark]: 2.765e-05 [recompute_prepare]: 1.246e-05 [updatestate_depend_eliminate]: 5.08002e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 3.66001e-06 [get_grad_eliminate_]: 6.96999e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.799e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.70997e-06 [replace_old_param]: 1.115e-05 [inline_without_move]: 5.91e-06 [renormalize]: 0.00241851 [add_forward_monad_depend]: 1.034e-05 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 2.293e-05 [cse]: 3.925e-05 [replace_applicator]: 2.346e-05 [Cycle 2]: 0.00036534, [27] [switch_simplify]: 6.72002e-06 [loop_unroll]: 5.49998e-06 [a_1]: 0.0001065 [with_stream_mark]: 1.434e-05 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.67999e-06 [updatestate_useless_node_eliminater]: 5.11002e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.762e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 2.23998e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.77999e-06 [cse]: 1.404e-05 [replace_applicator]: 5.14003e-06 [py_interpret_to_execute_after_opt_a]: 1.714e-05 [rewriter_after_opt_a]: 4.174e-05 [convert_after_rewriter]: 7.21001e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00173305 [jit_opt_b]: 6.075e-05, [1] [Cycle 1]: 5.201e-05, [2] [frontend_op_eliminate]: 2.041e-05 [inline_after_opt_a]: 1.902e-05 [cconv]: 3.184e-05 [loop_unroll]: 0.0004883 [jit_opt_after_cconv]: 0.00023254, [1] [Cycle 1]: 0.00022516, [11] [c_1]: 2.558e-05 [parameter_eliminate]: 6.10002e-06 [updatestate_depend_eliminate]: 8.62998e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.81999e-06 [cse]: 7.143e-05 [call_graph_tuple_transform]: 3.061e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 2.16e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.651e-05 [partial_unused_args_eliminate]: 3.25e-06 [environ_conv]: 8.71002e-06 [add_recomputation]: 5.442e-05 [cse_after_recomputation]: 2.591e-05, [1] [Cycle 1]: 2.023e-05, [1] [cse]: 1.368e-05 [auto_monad_reorder]: 1.747e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 7.48e-06 [opt_after_jit_grad]: 0.00052006 [symbol_engine_optimizer]: 0.00032335, [1] [Cycle 1]: 0.00031584, [6] [build]: 4.08999e-06 [elim_shapecalc]: 1.491e-05 [elim_not_effective]: 1.829e-05 [opt_reshape]: 8.23001e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 5.90022e-07 [validate]: 5.181e-05 Sums bootstrap : 0.000293s : 0.50% type_inference : 0.050421s : 85.52% event_method : 0.000022s : 0.04% auto_monad : 0.000076s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000156s : 0.26% rewriter_before_opt_a : 0.000091s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000092s : 0.16% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.001694s : 2.87% jit_opt_a.with_stream_mark : 0.000042s : 0.07% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002419s : 4.10% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.05% jit_opt_a.cse : 0.000053s : 0.09% jit_opt_a.replace_applicator : 0.000029s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000042s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.001733s : 2.94% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000032s : 0.05% loop_unroll : 0.000488s : 0.83% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000071s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000520s : 0.88% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000015s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.09% Time group info: ------[substitution.] 0.000293 23 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.55% : 0.000007s : 3: substitution.graph_param_transform 85.78% : 0.000251s : 4: substitution.inline 1.64% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000006s : 2: substitution.replace_old_param 4.74% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050321 2 95.35% : 0.047981s : 1: type_inference.infer 4.65% : 0.002340s : 1: type_inference.specialize ------[replace.] 0.000996 6 7.38% : 0.000074s : 4: replace.inline 92.62% : 0.000922s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 6 95.11% : 0.000249s : 4: match.inline 4.89% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000003s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.68% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.89% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_depend_swap 1.19% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 10: predicate.merge_addn 1.22% : 0.000002s : 10: predicate.minmaximum_grad 1.32% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 1.85% : 0.000002s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 2.42% : 0.000003s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.46% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 53: predicate.switch_simplify 1.46% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001208 13 38.36% : 0.000463s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.49% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 57.15% : 0.000691s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068605 72 0.08% : 0.000058s : 1: add_recomputation 0.12% : 0.000080s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.46% : 0.000315s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 13.44% : 0.009222s : 1: jit_opt_a 0.34% : 0.000236s : 1: jit_opt_after_cconv 0.09% : 0.000064s : 1: jit_opt_b 0.73% : 0.000498s : 1: loop_unroll 2.55% : 0.001747s : 1: mutable_eliminate 2.87% : 0.001966s : 26: opt.transform.jit_opt_a 0.09% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000529s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000160s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.56% : 0.001070s : 1: renormalize.infer 1.94% : 0.001334s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000045s : 1: rewriter_after_opt_a 0.14% : 0.000095s : 1: rewriter_before_opt_a 0.48% : 0.000327s : 1: symbol_engine_optimizer 73.52% : 0.050441s : 1: type_inference TotalTime = 0.140107, [30] [bootstrap]: 0.00027898 [type_inference]: 0.113995 [event_method]: 0.00043539 [auto_monad]: 0.00011343 [graph_reusing]: 8.49998e-06 [pre_auto_parallel]: 4.03001e-06 [py_interpret_to_execute]: 3.893e-05 [rewriter_before_opt_a]: 0.00012474 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.0228505, [3] [Cycle 1]: 0.0152605, [27] [switch_simplify]: 7.242e-05 [loop_unroll]: 4.056e-05 [a_1]: 0.00088944 [with_stream_mark]: 3.412e-05 [recompute_prepare]: 1.995e-05 [updatestate_depend_eliminate]: 9.04998e-06 [updatestate_assign_eliminate]: 7.23e-06 [updatestate_loads_eliminate]: 6.41998e-06 [parameter_eliminate]: 2.51998e-06 [specialize_transform]: 1.49e-05 [updatestate_useless_node_eliminater]: 1.36e-05 [accelerated_algorithm]: 1.348e-05 [meta_shard_fg_expand]: 3.66999e-06 [get_grad_eliminate_]: 1.329e-05 [merge_forward]: 9.56e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.772e-05 [j_node_and_user_rematch]: 2.503e-05 [meta_fg_expand]: 0.00177048 [replace_old_param]: 6.471e-05 [inline_without_move]: 5.8e-05 [renormalize]: 0.0114997 [add_forward_monad_depend]: 1.203e-05 [auto_monad_grad]: 6.12999e-06 [auto_monad_eliminator]: 6.205e-05 [cse]: 0.00024847 [replace_applicator]: 9.014e-05 [Cycle 2]: 0.00370438, [27] [switch_simplify]: 4.335e-05 [loop_unroll]: 4.192e-05 [a_1]: 0.00119047 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 1.018e-05 [updatestate_depend_eliminate]: 5.72999e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 3.38999e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 7.71999e-06 [updatestate_useless_node_eliminater]: 7.68001e-06 [accelerated_algorithm]: 7.31999e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.761e-05 [j_node_and_user_rematch]: 1.171e-05 [meta_fg_expand]: 8.358e-05 [replace_old_param]: 7.87998e-06 [inline_without_move]: 7.18e-06 [renormalize]: 0.00198137 [add_forward_monad_depend]: 7.71999e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.467e-05 [cse]: 2.503e-05 [replace_applicator]: 1.519e-05 [Cycle 3]: 0.00025191, [27] [switch_simplify]: 4.84e-06 [loop_unroll]: 3.87002e-06 [a_1]: 3.919e-05 [with_stream_mark]: 1.055e-05 [recompute_prepare]: 3.61999e-06 [updatestate_depend_eliminate]: 2.43e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 1.57999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 3.37997e-06 [updatestate_useless_node_eliminater]: 3.3e-06 [accelerated_algorithm]: 3.09999e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 3.21001e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.214e-05 [j_node_and_user_rematch]: 5.79e-06 [meta_fg_expand]: 1.51002e-06 [replace_old_param]: 3.41999e-06 [inline_without_move]: 2.97002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 4.17e-06 [cse]: 8.13999e-06 [replace_applicator]: 3.63e-06 [py_interpret_to_execute_after_opt_a]: 1.323e-05 [rewriter_after_opt_a]: 3.63e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00072688 [jit_opt_b]: 4.103e-05, [1] [Cycle 1]: 3.351e-05, [2] [frontend_op_eliminate]: 9.96998e-06 [inline_after_opt_a]: 1.161e-05 [cconv]: 2.661e-05 [loop_unroll]: 0.00042433 [jit_opt_after_cconv]: 0.00012435, [1] [Cycle 1]: 0.00011824, [11] [c_1]: 1.161e-05 [parameter_eliminate]: 2.38002e-06 [updatestate_depend_eliminate]: 4.66002e-06 [updatestate_assign_eliminate]: 1.79e-06 [updatestate_loads_eliminate]: 1.62001e-06 [cse]: 1.913e-05 [call_graph_tuple_transform]: 1.383e-05 [tuple_list_get_item_eliminator]: 3.86999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 3.45e-06 [remove_dup_value]: 1.467e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 4.62e-06 [add_recomputation]: 3.544e-05 [cse_after_recomputation]: 1.911e-05, [1] [Cycle 1]: 1.371e-05, [1] [cse]: 7.41001e-06 [auto_monad_reorder]: 1.264e-05 [get_jit_bprop_graph]: 2.01003e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00044442 [symbol_engine_optimizer]: 6.339e-05, [1] [Cycle 1]: 5.724e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 5.82999e-06 [elim_not_effective]: 9.32999e-06 [opt_reshape]: 3.75998e-06 [fold_const_symbol]: 6.17999e-06 [renormalize]: 4.00003e-07 [validate]: 4.59e-05 Sums bootstrap : 0.000279s : 0.21% type_inference : 0.113995s : 84.06% event_method : 0.000435s : 0.32% auto_monad : 0.000113s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000039s : 0.03% rewriter_before_opt_a : 0.000125s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000121s : 0.09% jit_opt_a.loop_unroll : 0.000086s : 0.06% jit_opt_a.a_1 : 0.002119s : 1.56% jit_opt_a.with_stream_mark : 0.000064s : 0.05% jit_opt_a.recompute_prepare : 0.000034s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000011s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000057s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001856s : 1.37% jit_opt_a.replace_old_param : 0.000076s : 0.06% jit_opt_a.inline_without_move : 0.000068s : 0.05% jit_opt_a.renormalize : 0.013481s : 9.94% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.06% jit_opt_a.cse : 0.000282s : 0.21% jit_opt_a.replace_applicator : 0.000109s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000424s : 0.31% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000444s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.03% Time group info: ------[substitution.] 0.000554 104 0.29% : 0.000002s : 1: substitution.elim_not_effective 0.24% : 0.000001s : 1: substitution.fold_const_symbol 0.84% : 0.000005s : 1: substitution.graph_param_transform 63.95% : 0.000355s : 12: substitution.inline 3.00% : 0.000017s : 2: substitution.inline_without_move 1.87% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.07% : 0.000011s : 7: substitution.minmaximum_grad 1.40% : 0.000008s : 5: substitution.partial_eliminate 1.90% : 0.000011s : 12: substitution.remove_not_recompute_node 5.42% : 0.000030s : 10: substitution.replace_applicator 1.14% : 0.000006s : 10: substitution.replace_old_param 1.29% : 0.000007s : 1: substitution.reshape_eliminate 0.46% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.18% : 0.000007s : 1: substitution.tile_eliminate 4.21% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.78% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.94% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113894 2 97.52% : 0.111073s : 1: type_inference.infer 2.48% : 0.002821s : 1: type_inference.specialize ------[replace.] 0.000172 19 63.08% : 0.000109s : 12: replace.inline 36.92% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000370 19 93.82% : 0.000347s : 12: match.inline 6.18% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000359 2544 1.64% : 0.000006s : 44: predicate.accumulaten_eliminater 0.29% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000005s : 44: predicate.addn_check_dump 1.58% : 0.000006s : 44: predicate.addn_zero_filter 2.19% : 0.000008s : 44: predicate.arithmetic_simplify 1.53% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 44: predicate.compare_switch_simplify 1.54% : 0.000006s : 44: predicate.depend_value_elim 1.48% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.46% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.48% : 0.000005s : 44: predicate.environ_get_depend_swap 1.53% : 0.000006s : 44: predicate.environ_get_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.84% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.42% : 0.000016s : 65: predicate.inline 2.12% : 0.000008s : 46: predicate.inline_without_move 0.40% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.90% : 0.000003s : 18: predicate.less_batch_normalization 1.84% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.99% : 0.000007s : 52: predicate.load_eliminater 0.31% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.54% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.75% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.49% : 0.000005s : 44: predicate.merge_addn 1.62% : 0.000006s : 44: predicate.minmaximum_grad 0.36% : 0.000001s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.34% : 0.000008s : 52: predicate.partial_eliminate 1.53% : 0.000005s : 44: predicate.print_const_string_wrapper 2.01% : 0.000007s : 44: predicate.reduce_eliminate 1.85% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000002s : 18: predicate.remove_not_recompute_node 2.84% : 0.000010s : 97: predicate.replace_applicator 1.14% : 0.000004s : 46: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 44: predicate.reshape_eliminate 1.55% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 1: predicate.row_tensor_eliminate 1.56% : 0.000006s : 44: predicate.same_eliminate 0.55% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.87% : 0.000003s : 18: predicate.specialize_transform 1.77% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000005s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.79% : 0.000010s : 63: predicate.switch_defer_inline 2.61% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.42% : 0.000023s : 153: predicate.switch_simplify 1.55% : 0.000006s : 44: predicate.tile_eliminate 1.65% : 0.000006s : 44: predicate.transpose_eliminate 1.96% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.67% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.18% : 0.000011s : 53: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.79% : 0.000006s : 51: predicate.tuple_to_list_eliminator_ 1.79% : 0.000006s : 52: predicate.updatestate_pure_node_eliminater 2.82% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.89% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.09% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003377 43 75.53% : 0.002551s : 27: func_graph_cloner_run.FuncGraphClonerGraph 24.47% : 0.000826s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156330 87 0.02% : 0.000038s : 1: add_recomputation 0.08% : 0.000120s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.20% : 0.000307s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.28% : 0.000445s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 14.62% : 0.022854s : 1: jit_opt_a 0.08% : 0.000127s : 1: jit_opt_after_cconv 0.03% : 0.000044s : 1: jit_opt_b 0.28% : 0.000432s : 1: loop_unroll 0.47% : 0.000735s : 1: mutable_eliminate 1.77% : 0.002762s : 39: opt.transform.jit_opt_a 0.02% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000453s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.25% : 0.011335s : 2: renormalize.infer 1.36% : 0.002126s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000128s : 1: rewriter_before_opt_a 0.04% : 0.000066s : 1: symbol_engine_optimizer 72.93% : 0.114016s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.284.492 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d550> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.285.210 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0830982, [30] [bootstrap]: 0.00036366 [type_inference]: 0.0708314 [event_method]: 2.321e-05 [auto_monad]: 8.933e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 0.00035518 [rewriter_before_opt_a]: 9.47e-05 [expand_dump_flag]: 4.18001e-06 [jit_opt_a]: 0.00868967, [2] [Cycle 1]: 0.00429508, [27] [switch_simplify]: 6.916e-05 [loop_unroll]: 3.016e-05 [a_1]: 0.00068368 [with_stream_mark]: 2.493e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 8.02e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 3.10998e-06 [get_grad_eliminate_]: 6.72002e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 1.191e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.128e-05 [inline_without_move]: 6.16998e-06 [renormalize]: 0.00306439 [add_forward_monad_depend]: 1.045e-05 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 2.212e-05 [cse]: 3.584e-05 [replace_applicator]: 2.374e-05 [Cycle 2]: 0.00040632, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012995 [with_stream_mark]: 1.681e-05 [recompute_prepare]: 6.48e-06 [updatestate_depend_eliminate]: 4.66002e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.18002e-06 [updatestate_useless_node_eliminater]: 6.16998e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 4.15e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.796e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.80002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.95001e-06 [auto_monad_grad]: 1.62999e-06 [auto_monad_eliminator]: 7.57998e-06 [cse]: 1.195e-05 [replace_applicator]: 6.70002e-06 [py_interpret_to_execute_after_opt_a]: 1.527e-05 [rewriter_after_opt_a]: 4.006e-05 [convert_after_rewriter]: 6.98998e-06 [order_py_execute_after_rewriter]: 5.81e-06 [mutable_eliminate]: 0.00080474 [jit_opt_b]: 6.054e-05, [1] [Cycle 1]: 5.227e-05, [2] [frontend_op_eliminate]: 2.04e-05 [inline_after_opt_a]: 1.997e-05 [cconv]: 3.324e-05 [loop_unroll]: 0.00048165 [jit_opt_after_cconv]: 0.00017061, [1] [Cycle 1]: 0.00016353, [11] [c_1]: 2.654e-05 [parameter_eliminate]: 4.74e-06 [updatestate_depend_eliminate]: 7.98001e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 3.04e-05 [call_graph_tuple_transform]: 2.235e-05 [tuple_list_get_item_eliminator]: 6.53e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.605e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 1.038e-05 [add_recomputation]: 5.106e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.751e-05, [1] [cse]: 1.129e-05 [auto_monad_reorder]: 1.531e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00049235 [symbol_engine_optimizer]: 0.00013856, [1] [Cycle 1]: 0.00013201, [6] [build]: 3.91999e-06 [elim_shapecalc]: 7.86001e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 6.837e-05 [renormalize]: 5.39992e-07 [validate]: 5.047e-05 Sums bootstrap : 0.000364s : 0.46% type_inference : 0.070831s : 90.31% event_method : 0.000023s : 0.03% auto_monad : 0.000089s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000355s : 0.45% rewriter_before_opt_a : 0.000095s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000814s : 1.04% jit_opt_a.with_stream_mark : 0.000042s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.003064s : 3.91% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.04% jit_opt_a.cse : 0.000048s : 0.06% jit_opt_a.replace_applicator : 0.000030s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000805s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000033s : 0.04% loop_unroll : 0.000482s : 0.61% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000492s : 0.63% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000068s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.06% Time group info: ------[substitution.] 0.000287 24 0.96% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000007s : 4: substitution.graph_param_transform 84.86% : 0.000244s : 4: substitution.inline 1.68% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000006s : 4: substitution.remove_not_recompute_node 2.39% : 0.000007s : 2: substitution.replace_old_param 5.05% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.070717 2 96.68% : 0.068368s : 1: type_inference.infer 3.32% : 0.002349s : 1: type_inference.specialize ------[replace.] 0.000088 6 68.64% : 0.000061s : 4: replace.inline 31.36% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 6 94.71% : 0.000241s : 4: match.inline 5.29% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.68% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.44% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.25% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.63% : 0.000008s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 2.13% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.11% : 0.000002s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 1.89% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.96% : 0.000010s : 58: predicate.switch_simplify 1.82% : 0.000003s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.69% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.82% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002692 26 67.03% : 0.001804s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.17% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.80% : 0.000829s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.087359 72 0.06% : 0.000054s : 1: add_recomputation 0.11% : 0.000094s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000384s : 1: bootstrap 0.04% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.95% : 0.008693s : 1: jit_opt_a 0.20% : 0.000173s : 1: jit_opt_after_cconv 0.07% : 0.000063s : 1: jit_opt_b 0.56% : 0.000490s : 1: loop_unroll 0.94% : 0.000818s : 1: mutable_eliminate 1.24% : 0.001079s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000094s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000502s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000361s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 2.39% : 0.002091s : 1: renormalize.infer 1.10% : 0.000961s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.12% : 0.000101s : 1: rewriter_before_opt_a 0.16% : 0.000141s : 1: symbol_engine_optimizer 81.11% : 0.070856s : 1: type_inference TotalTime = 0.0900916, [30] [bootstrap]: 0.00026388 [type_inference]: 0.0608439 [event_method]: 0.0002264 [auto_monad]: 0.00010944 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 3.743e-05 [rewriter_before_opt_a]: 0.00011128 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.0247646, [3] [Cycle 1]: 0.0180782, [27] [switch_simplify]: 6.661e-05 [loop_unroll]: 4.342e-05 [a_1]: 0.00089668 [with_stream_mark]: 2.664e-05 [recompute_prepare]: 2.045e-05 [updatestate_depend_eliminate]: 8.74e-06 [updatestate_assign_eliminate]: 7.01999e-06 [updatestate_loads_eliminate]: 6.86001e-06 [parameter_eliminate]: 2.75002e-06 [specialize_transform]: 1.523e-05 [updatestate_useless_node_eliminater]: 1.35e-05 [accelerated_algorithm]: 1.397e-05 [meta_shard_fg_expand]: 3.65e-06 [get_grad_eliminate_]: 1.386e-05 [merge_forward]: 8.40999e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.891e-05 [j_node_and_user_rematch]: 2.454e-05 [meta_fg_expand]: 0.00159443 [replace_old_param]: 6.695e-05 [inline_without_move]: 7.157e-05 [renormalize]: 0.0144782 [add_forward_monad_depend]: 1.225e-05 [auto_monad_grad]: 6.06998e-06 [auto_monad_eliminator]: 6.357e-05 [cse]: 0.00025166 [replace_applicator]: 9.067e-05 [Cycle 2]: 0.00336318, [27] [switch_simplify]: 4.375e-05 [loop_unroll]: 4.22e-05 [a_1]: 0.00115193 [with_stream_mark]: 1.702e-05 [recompute_prepare]: 9.00001e-06 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.41001e-06 [updatestate_useless_node_eliminater]: 7.03998e-06 [accelerated_algorithm]: 7.51999e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.81001e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 1.095e-05 [meta_fg_expand]: 6.421e-05 [replace_old_param]: 7.7e-06 [inline_without_move]: 6.84001e-06 [renormalize]: 0.00172953 [add_forward_monad_depend]: 5.21998e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 9.50001e-06 [cse]: 1.823e-05 [replace_applicator]: 1.242e-05 [Cycle 3]: 0.00024428, [27] [switch_simplify]: 4.65001e-06 [loop_unroll]: 3.62002e-06 [a_1]: 3.975e-05 [with_stream_mark]: 8.61002e-06 [recompute_prepare]: 3.64002e-06 [updatestate_depend_eliminate]: 2.24001e-06 [updatestate_assign_eliminate]: 1.67001e-06 [updatestate_loads_eliminate]: 1.38002e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 3.35e-06 [updatestate_useless_node_eliminater]: 3.11999e-06 [accelerated_algorithm]: 3.31001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 3.18e-06 [merge_forward]: 1.97001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.053e-05 [j_node_and_user_rematch]: 5.59e-06 [meta_fg_expand]: 1.29e-06 [replace_old_param]: 2.99999e-06 [inline_without_move]: 3.03e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.40025e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 3.37002e-06 [cse]: 8.33001e-06 [replace_applicator]: 3.23e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 3.322e-05 [convert_after_rewriter]: 6.16e-06 [order_py_execute_after_rewriter]: 4.32e-06 [mutable_eliminate]: 0.0006598 [jit_opt_b]: 4.038e-05, [1] [Cycle 1]: 3.335e-05, [2] [frontend_op_eliminate]: 1.051e-05 [inline_after_opt_a]: 1.135e-05 [cconv]: 2.288e-05 [loop_unroll]: 0.0003957 [jit_opt_after_cconv]: 0.00011786, [1] [Cycle 1]: 0.00011176, [11] [c_1]: 1.16e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 1.70001e-06 [updatestate_loads_eliminate]: 1.54e-06 [cse]: 1.474e-05 [call_graph_tuple_transform]: 1.278e-05 [tuple_list_get_item_eliminator]: 3.38e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 3.66999e-06 [remove_dup_value]: 1.382e-05 [partial_unused_args_eliminate]: 0.00160063 [environ_conv]: 7.29001e-06 [add_recomputation]: 3.809e-05 [cse_after_recomputation]: 2.778e-05, [1] [Cycle 1]: 2.139e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.369e-05 [get_jit_bprop_graph]: 1.71998e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00044758 [symbol_engine_optimizer]: 6.322e-05, [1] [Cycle 1]: 5.7e-05, [6] [build]: 3.34001e-06 [elim_shapecalc]: 5.49e-06 [elim_not_effective]: 9.41e-06 [opt_reshape]: 4.00998e-06 [fold_const_symbol]: 5.54998e-06 [renormalize]: 4.19997e-07 [validate]: 2.831e-05 Sums bootstrap : 0.000264s : 0.31% type_inference : 0.060844s : 70.60% event_method : 0.000226s : 0.26% auto_monad : 0.000109s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.04% rewriter_before_opt_a : 0.000111s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000115s : 0.13% jit_opt_a.loop_unroll : 0.000089s : 0.10% jit_opt_a.a_1 : 0.002088s : 2.42% jit_opt_a.with_stream_mark : 0.000052s : 0.06% jit_opt_a.recompute_prepare : 0.000033s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.03% jit_opt_a.merge_forward : 0.000015s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.05% jit_opt_a.meta_fg_expand : 0.001660s : 1.93% jit_opt_a.replace_old_param : 0.000078s : 0.09% jit_opt_a.inline_without_move : 0.000081s : 0.09% jit_opt_a.renormalize : 0.016208s : 18.81% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000076s : 0.09% jit_opt_a.cse : 0.000278s : 0.32% jit_opt_a.replace_applicator : 0.000106s : 0.12% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000660s : 0.77% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000023s : 0.03% loop_unroll : 0.000396s : 0.46% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000015s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000013s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000003s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.001601s : 1.86% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000038s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000448s : 0.52% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.03% Time group info: ------[substitution.] 0.000501 104 0.27% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.78% : 0.000004s : 1: substitution.graph_param_transform 61.41% : 0.000308s : 12: substitution.inline 3.21% : 0.000016s : 2: substitution.inline_without_move 1.81% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.14% : 0.000011s : 7: substitution.minmaximum_grad 1.65% : 0.000008s : 5: substitution.partial_eliminate 2.00% : 0.000010s : 12: substitution.remove_not_recompute_node 5.91% : 0.000030s : 10: substitution.replace_applicator 1.32% : 0.000007s : 10: substitution.replace_old_param 1.46% : 0.000007s : 1: substitution.reshape_eliminate 0.49% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.21% : 0.000006s : 1: substitution.tile_eliminate 4.36% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 3.13% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.70% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060756 2 96.68% : 0.058739s : 1: type_inference.infer 3.32% : 0.002017s : 1: type_inference.specialize ------[replace.] 0.000159 19 64.00% : 0.000101s : 12: replace.inline 36.00% : 0.000057s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 19 93.31% : 0.000301s : 12: match.inline 6.69% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000364 2654 1.61% : 0.000006s : 46: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.43% : 0.000005s : 46: predicate.addn_check_dump 1.57% : 0.000006s : 46: predicate.addn_zero_filter 2.15% : 0.000008s : 46: predicate.arithmetic_simplify 1.59% : 0.000006s : 46: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 46: predicate.compare_switch_simplify 1.51% : 0.000005s : 46: predicate.depend_value_elim 1.44% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.53% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.55% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.50% : 0.000005s : 46: predicate.environ_get_add_eliminate 1.45% : 0.000005s : 46: predicate.environ_get_depend_swap 1.53% : 0.000006s : 46: predicate.environ_get_eliminate 1.46% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.83% : 0.000003s : 19: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.19% : 0.000015s : 67: predicate.inline 2.03% : 0.000007s : 47: predicate.inline_without_move 0.38% : 0.000001s : 19: predicate.j_node_and_user_rematch 0.97% : 0.000004s : 19: predicate.less_batch_normalization 1.91% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 54: predicate.load_eliminater 0.31% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.55% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.72% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.57% : 0.000006s : 46: predicate.merge_addn 1.51% : 0.000005s : 46: predicate.minmaximum_grad 0.37% : 0.000001s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.49% : 0.000009s : 54: predicate.partial_eliminate 1.66% : 0.000006s : 46: predicate.print_const_string_wrapper 2.01% : 0.000007s : 46: predicate.reduce_eliminate 1.80% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 19: predicate.remove_not_recompute_node 3.06% : 0.000011s : 100: predicate.replace_applicator 1.12% : 0.000004s : 47: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.68% : 0.000006s : 46: predicate.reshape_eliminate 1.62% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.55% : 0.000006s : 46: predicate.same_eliminate 0.53% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 19: predicate.specialize_transform 1.71% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.74% : 0.000010s : 65: predicate.switch_defer_inline 2.51% : 0.000009s : 65: predicate.switch_layer_defer_inline 6.52% : 0.000024s : 161: predicate.switch_simplify 1.57% : 0.000006s : 46: predicate.tile_eliminate 1.52% : 0.000006s : 46: predicate.transpose_eliminate 1.94% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000006s : 46: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.86% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.82% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.77% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 1.82% : 0.000007s : 46: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003855 50 78.77% : 0.003037s : 34: func_graph_cloner_run.FuncGraphClonerGraph 21.23% : 0.000819s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109038 87 0.04% : 0.000041s : 1: add_recomputation 0.11% : 0.000116s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.26% : 0.000285s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.21% : 0.000234s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.71% : 0.024768s : 1: jit_opt_a 0.11% : 0.000120s : 1: jit_opt_after_cconv 0.04% : 0.000043s : 1: jit_opt_b 0.37% : 0.000403s : 1: loop_unroll 0.61% : 0.000668s : 1: mutable_eliminate 2.51% : 0.002740s : 39: opt.transform.jit_opt_a 0.03% : 0.000028s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000010s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000021s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 1.47% : 0.001607s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000040s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 12.87% : 0.014037s : 2: renormalize.infer 1.97% : 0.002151s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.10% : 0.000114s : 1: rewriter_before_opt_a 0.06% : 0.000065s : 1: symbol_engine_optimizer 55.82% : 0.060862s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.388.056 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d8b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.388.754 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0134353, [30] [bootstrap]: 0.00030564 [type_inference]: 0.00507205 [event_method]: 1.766e-05 [auto_monad]: 6.433e-05 [graph_reusing]: 6.06998e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 3.791e-05 [rewriter_before_opt_a]: 7.143e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00551543, [2] [Cycle 1]: 0.00173129, [27] [switch_simplify]: 8.153e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00053805 [with_stream_mark]: 1.907e-05 [recompute_prepare]: 7.10998e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.399e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00072606 [add_forward_monad_depend]: 5.62999e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.468e-05 [cse]: 3.039e-05 [replace_applicator]: 1.313e-05 [Cycle 2]: 0.0003273, [27] [switch_simplify]: 6.24999e-06 [loop_unroll]: 4.75999e-06 [a_1]: 9.089e-05 [with_stream_mark]: 9.14e-06 [recompute_prepare]: 4.82998e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.79e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.24999e-06 [cell_reuse_recompute_pass]: 1.26997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.399e-05 [j_node_and_user_rematch]: 7.56001e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.67e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.151e-05 [replace_applicator]: 5.04003e-06 [py_interpret_to_execute_after_opt_a]: 1.063e-05 [rewriter_after_opt_a]: 3.703e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00059291 [jit_opt_b]: 5.147e-05, [1] [Cycle 1]: 4.406e-05, [2] [frontend_op_eliminate]: 1.629e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 2.633e-05 [loop_unroll]: 0.00043108 [jit_opt_after_cconv]: 0.00014929, [1] [Cycle 1]: 0.00014243, [11] [c_1]: 2.015e-05 [parameter_eliminate]: 3.88001e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 2.146e-05 [call_graph_tuple_transform]: 2.078e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.15001e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 5.125e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.819e-05, [1] [cse]: 1.16e-05 [auto_monad_reorder]: 1.669e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00051847 [symbol_engine_optimizer]: 8.341e-05, [1] [Cycle 1]: 7.559e-05, [6] [build]: 3.45e-06 [elim_shapecalc]: 9.63002e-06 [elim_not_effective]: 1.497e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.78001e-06 [renormalize]: 5.8001e-07 [validate]: 4.13e-05 Sums bootstrap : 0.000306s : 3.29% type_inference : 0.005072s : 54.65% event_method : 0.000018s : 0.19% auto_monad : 0.000064s : 0.69% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.41% rewriter_before_opt_a : 0.000071s : 0.77% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000088s : 0.95% jit_opt_a.loop_unroll : 0.000035s : 0.38% jit_opt_a.a_1 : 0.000629s : 6.78% jit_opt_a.with_stream_mark : 0.000028s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000726s : 7.82% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000042s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000037s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000593s : 6.39% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000026s : 0.28% loop_unroll : 0.000431s : 4.64% jit_opt_after_cconv.c_1 : 0.000020s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000051s : 0.55% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000518s : 5.59% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.44% Time group info: ------[substitution.] 0.000207 23 1.26% : 0.000003s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000006s : 3: substitution.graph_param_transform 83.60% : 0.000173s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 5.88% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005004 2 82.41% : 0.004124s : 1: type_inference.infer 17.59% : 0.000880s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.16% : 0.000047s : 4: replace.inline 32.84% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 94.01% : 0.000171s : 4: match.inline 5.99% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.80% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 2.00% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.89% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.56% : 0.000001s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000657 13 52.79% : 0.000347s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.68% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.52% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015006 72 0.36% : 0.000054s : 1: add_recomputation 0.45% : 0.000068s : 1: auto_monad 0.13% : 0.000019s : 1: auto_monad_reorder 2.17% : 0.000326s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.78% : 0.005519s : 1: jit_opt_a 1.01% : 0.000152s : 1: jit_opt_after_cconv 0.36% : 0.000054s : 1: jit_opt_b 2.92% : 0.000439s : 1: loop_unroll 4.01% : 0.000601s : 1: mutable_eliminate 5.77% : 0.000866s : 26: opt.transform.jit_opt_a 0.32% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.18% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.53% : 0.000530s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000041s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.66% : 0.000399s : 1: renormalize.infer 2.13% : 0.000319s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000040s : 1: rewriter_after_opt_a 0.50% : 0.000075s : 1: rewriter_before_opt_a 0.57% : 0.000086s : 1: symbol_engine_optimizer 33.92% : 0.005089s : 1: type_inference TotalTime = 0.427266, [30] [bootstrap]: 0.00390084 [type_inference]: 0.379651 [event_method]: 2.084e-05 [auto_monad]: 6.849e-05 [graph_reusing]: 6.86999e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00048018 [rewriter_before_opt_a]: 8.546e-05 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.0406584, [2] [Cycle 1]: 0.0368453, [27] [switch_simplify]: 5.841e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00058882 [with_stream_mark]: 1.928e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 6.19999e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 9.44998e-06 [inline_without_move]: 5.93998e-06 [renormalize]: 0.0357752 [add_forward_monad_depend]: 8.79e-06 [auto_monad_grad]: 2.95998e-06 [auto_monad_eliminator]: 1.809e-05 [cse]: 3.198e-05 [replace_applicator]: 2.484e-05 [Cycle 2]: 0.00041193, [27] [switch_simplify]: 7.81001e-06 [loop_unroll]: 6.46e-06 [a_1]: 0.00013136 [with_stream_mark]: 1.621e-05 [recompute_prepare]: 6.73998e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 3.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.811e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 1.072e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 8.07998e-06 [cse]: 1.215e-05 [replace_applicator]: 6.22001e-06 [py_interpret_to_execute_after_opt_a]: 1.278e-05 [rewriter_after_opt_a]: 3.694e-05 [convert_after_rewriter]: 7.30998e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00073371 [jit_opt_b]: 5.852e-05, [1] [Cycle 1]: 5.074e-05, [2] [frontend_op_eliminate]: 2.108e-05 [inline_after_opt_a]: 1.813e-05 [cconv]: 2.844e-05 [loop_unroll]: 0.0004265 [jit_opt_after_cconv]: 0.00015517, [1] [Cycle 1]: 0.00014859, [11] [c_1]: 2.688e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 6.17001e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.305e-05 [call_graph_tuple_transform]: 2.139e-05 [tuple_list_get_item_eliminator]: 6.38998e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 8.34998e-06 [add_recomputation]: 5.269e-05 [cse_after_recomputation]: 2.227e-05, [1] [Cycle 1]: 1.687e-05, [1] [cse]: 1.101e-05 [auto_monad_reorder]: 1.61e-05 [get_jit_bprop_graph]: 2.54999e-06 [rewriter_after_jit_bprop_graph]: 5.52001e-06 [opt_after_jit_grad]: 0.00047855 [symbol_engine_optimizer]: 8.064e-05, [1] [Cycle 1]: 7.436e-05, [6] [build]: 4.11001e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.532e-05 [opt_reshape]: 8.15e-06 [fold_const_symbol]: 1.086e-05 [renormalize]: 2.89991e-07 [validate]: 4.654e-05 Sums bootstrap : 0.003901s : 0.92% type_inference : 0.379651s : 89.70% event_method : 0.000021s : 0.00% auto_monad : 0.000068s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000480s : 0.11% rewriter_before_opt_a : 0.000085s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.02% jit_opt_a.loop_unroll : 0.000037s : 0.01% jit_opt_a.a_1 : 0.000720s : 0.17% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.035775s : 8.45% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000044s : 0.01% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000037s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000734s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000028s : 0.01% loop_unroll : 0.000426s : 0.10% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000053s : 0.01% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000479s : 0.11% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.01% Time group info: ------[substitution.] 0.000235 24 1.08% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000007s : 4: substitution.graph_param_transform 83.86% : 0.000197s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.48% : 0.000006s : 2: substitution.replace_old_param 5.35% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.379566 2 99.06% : 0.375983s : 1: type_inference.infer 0.94% : 0.003583s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.10% : 0.000053s : 4: replace.inline 31.90% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.44% : 0.000195s : 4: match.inline 5.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.36% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.74% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 1.89% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.83% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002670 22 65.04% : 0.001736s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.13% : 0.000884s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.464076 72 0.01% : 0.000056s : 1: add_recomputation 0.02% : 0.000072s : 1: auto_monad 0.00% : 0.000019s : 1: auto_monad_reorder 0.85% : 0.003922s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 8.76% : 0.040663s : 1: jit_opt_a 0.03% : 0.000157s : 1: jit_opt_after_cconv 0.01% : 0.000061s : 1: jit_opt_b 0.09% : 0.000434s : 1: loop_unroll 0.16% : 0.000743s : 1: mutable_eliminate 0.21% : 0.000971s : 26: opt.transform.jit_opt_a 0.01% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000488s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000486s : 1: py_interpret_to_execute 0.00% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000018s : 1: remove_dup_value 7.50% : 0.034826s : 1: renormalize.infer 0.20% : 0.000937s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000040s : 1: rewriter_after_opt_a 0.02% : 0.000090s : 1: rewriter_before_opt_a 0.02% : 0.000083s : 1: symbol_engine_optimizer 81.81% : 0.379671s : 1: type_inference TotalTime = 0.04381, [30] [bootstrap]: 0.00031917 [type_inference]: 0.0269472 [event_method]: 2.028e-05 [auto_monad]: 6.57e-05 [graph_reusing]: 5.09998e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00014455 [rewriter_before_opt_a]: 7.817e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.0135663, [2] [Cycle 1]: 0.00492079, [27] [switch_simplify]: 7.003e-05 [loop_unroll]: 2.971e-05 [a_1]: 0.00061593 [with_stream_mark]: 2.194e-05 [recompute_prepare]: 8.51002e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 2.522e-05 [meta_shard_fg_expand]: 5.66e-06 [get_grad_eliminate_]: 8.92e-06 [merge_forward]: 7.78001e-06 [cell_reuse_recompute_pass]: 1.86998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.193e-05 [j_node_and_user_rematch]: 1.038e-05 [meta_fg_expand]: 3.38999e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 7.09001e-06 [renormalize]: 0.00163668 [add_forward_monad_depend]: 8.69998e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.771e-05 [cse]: 3.385e-05 [replace_applicator]: 1.699e-05 [Cycle 2]: 0.0003547, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 5.47999e-06 [a_1]: 0.00010388 [with_stream_mark]: 1.373e-05 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.85998e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 4.91002e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 2.05002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.571e-05 [j_node_and_user_rematch]: 7.92003e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 7.53999e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.83e-06 [cse]: 1.425e-05 [replace_applicator]: 5.30001e-06 [py_interpret_to_execute_after_opt_a]: 1.705e-05 [rewriter_after_opt_a]: 3.855e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00087966 [jit_opt_b]: 5.47e-05, [1] [Cycle 1]: 4.659e-05, [2] [frontend_op_eliminate]: 1.757e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00047715 [jit_opt_after_cconv]: 0.00016449, [1] [Cycle 1]: 0.00015783, [11] [c_1]: 2.251e-05 [parameter_eliminate]: 4.05e-06 [updatestate_depend_eliminate]: 6.80998e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 3.05e-05 [call_graph_tuple_transform]: 2.173e-05 [tuple_list_get_item_eliminator]: 5.71998e-06 [none_parameter_eliminate]: 1.83002e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 6.26998e-06 [remove_dup_value]: 1.797e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 6.71999e-06 [add_recomputation]: 5.35e-05 [cse_after_recomputation]: 2.485e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.213e-05 [auto_monad_reorder]: 1.692e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 6.66e-06 [opt_after_jit_grad]: 0.0005353 [symbol_engine_optimizer]: 8.064e-05, [1] [Cycle 1]: 7.436e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 9.27001e-06 [elim_not_effective]: 1.471e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 1.079e-05 [renormalize]: 5.39992e-07 [validate]: 4.357e-05 Sums bootstrap : 0.000319s : 0.97% type_inference : 0.026947s : 82.27% event_method : 0.000020s : 0.06% auto_monad : 0.000066s : 0.20% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000145s : 0.44% rewriter_before_opt_a : 0.000078s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000720s : 2.20% jit_opt_a.with_stream_mark : 0.000036s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000031s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.04% jit_opt_a.merge_forward : 0.000011s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001637s : 5.00% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.07% jit_opt_a.cse : 0.000048s : 0.15% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000880s : 2.69% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000029s : 0.09% loop_unroll : 0.000477s : 1.46% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.16% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000535s : 1.63% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.13% Time group info: ------[substitution.] 0.000259 23 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 86.13% : 0.000223s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000005s : 2: substitution.replace_old_param 4.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026869 2 91.69% : 0.024636s : 1: type_inference.infer 8.31% : 0.002234s : 1: type_inference.specialize ------[replace.] 0.000089 6 67.06% : 0.000059s : 4: replace.inline 32.94% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 95.29% : 0.000220s : 4: match.inline 4.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.63% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.21% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.35% : 0.000000s : 3: predicate.fold_const_symbol 1.45% : 0.000002s : 6: predicate.get_grad_eliminate 0.50% : 0.000001s : 3: predicate.graph_param_transform 5.10% : 0.000007s : 22: predicate.inline 1.21% : 0.000002s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.24% : 0.000003s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 1.90% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 1.93% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.40% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 2.16% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.65% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.22% : 0.000011s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.05% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.24% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001143 13 40.78% : 0.000466s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.01% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.21% : 0.000631s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046489 72 0.12% : 0.000056s : 1: add_recomputation 0.15% : 0.000069s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.74% : 0.000342s : 1: bootstrap 0.07% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000007s : 1: graph_reusing 29.19% : 0.013571s : 1: jit_opt_a 0.36% : 0.000167s : 1: jit_opt_after_cconv 0.12% : 0.000058s : 1: jit_opt_b 1.05% : 0.000486s : 1: loop_unroll 1.92% : 0.000891s : 1: mutable_eliminate 2.12% : 0.000985s : 26: opt.transform.jit_opt_a 0.11% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.17% : 0.000544s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000149s : 1: py_interpret_to_execute 0.04% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 2.09% : 0.000971s : 1: renormalize.infer 1.41% : 0.000654s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000042s : 1: rewriter_after_opt_a 0.18% : 0.000082s : 1: rewriter_before_opt_a 0.18% : 0.000084s : 1: symbol_engine_optimizer 58.00% : 0.026962s : 1: type_inference TotalTime = 0.0844411, [30] [bootstrap]: 0.00025201 [type_inference]: 0.0579709 [event_method]: 0.00028831 [auto_monad]: 0.00010314 [graph_reusing]: 7.3e-06 [pre_auto_parallel]: 2.85998e-06 [py_interpret_to_execute]: 3.307e-05 [rewriter_before_opt_a]: 0.0001132 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.0232139, [3] [Cycle 1]: 0.0164489, [27] [switch_simplify]: 7.326e-05 [loop_unroll]: 4.372e-05 [a_1]: 0.00092724 [with_stream_mark]: 3.36e-05 [recompute_prepare]: 2.032e-05 [updatestate_depend_eliminate]: 8.72e-06 [updatestate_assign_eliminate]: 6.66999e-06 [updatestate_loads_eliminate]: 6.59001e-06 [parameter_eliminate]: 3.08998e-06 [specialize_transform]: 1.526e-05 [updatestate_useless_node_eliminater]: 1.369e-05 [accelerated_algorithm]: 1.412e-05 [meta_shard_fg_expand]: 3.46001e-06 [get_grad_eliminate_]: 1.4e-05 [merge_forward]: 8.97e-06 [cell_reuse_recompute_pass]: 8.99978e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.767e-05 [j_node_and_user_rematch]: 2.506e-05 [meta_fg_expand]: 0.00173961 [replace_old_param]: 7.333e-05 [inline_without_move]: 6.163e-05 [renormalize]: 0.0126013 [add_forward_monad_depend]: 1.28e-05 [auto_monad_grad]: 6.32001e-06 [auto_monad_eliminator]: 5.913e-05 [cse]: 0.0002951 [replace_applicator]: 8.992e-05 [Cycle 2]: 0.00305929, [27] [switch_simplify]: 4.182e-05 [loop_unroll]: 4.426e-05 [a_1]: 0.00112517 [with_stream_mark]: 1.367e-05 [recompute_prepare]: 6.89999e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 5.68002e-06 [updatestate_useless_node_eliminater]: 5.41998e-06 [accelerated_algorithm]: 5.78997e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.52997e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 6.825e-05 [replace_old_param]: 6.24999e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00146465 [add_forward_monad_depend]: 5.78002e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 1.253e-05 [cse]: 2.009e-05 [replace_applicator]: 1.263e-05 [Cycle 3]: 0.00024461, [27] [switch_simplify]: 4.38001e-06 [loop_unroll]: 3.46001e-06 [a_1]: 3.853e-05 [with_stream_mark]: 9.24e-06 [recompute_prepare]: 3.53e-06 [updatestate_depend_eliminate]: 2.43e-06 [updatestate_assign_eliminate]: 1.66e-06 [updatestate_loads_eliminate]: 1.59e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 3.81001e-06 [updatestate_useless_node_eliminater]: 3.11999e-06 [accelerated_algorithm]: 3.43e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 2.92002e-06 [merge_forward]: 2.45002e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.111e-05 [j_node_and_user_rematch]: 5.59e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 3.3e-06 [inline_without_move]: 2.94001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.89995e-07 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 3.59002e-06 [cse]: 7.85e-06 [replace_applicator]: 3.36001e-06 [py_interpret_to_execute_after_opt_a]: 1.202e-05 [rewriter_after_opt_a]: 3.506e-05 [convert_after_rewriter]: 5.71998e-06 [order_py_execute_after_rewriter]: 4.57e-06 [mutable_eliminate]: 0.00068289 [jit_opt_b]: 3.956e-05, [1] [Cycle 1]: 3.217e-05, [2] [frontend_op_eliminate]: 9.81e-06 [inline_after_opt_a]: 1.058e-05 [cconv]: 2.512e-05 [loop_unroll]: 0.00067133 [jit_opt_after_cconv]: 0.00012836, [1] [Cycle 1]: 0.00012209, [11] [c_1]: 1.178e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 1.80001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.079e-05 [call_graph_tuple_transform]: 1.466e-05 [tuple_list_get_item_eliminator]: 4.03001e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 3.48999e-06 [remove_dup_value]: 1.417e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 4.99998e-06 [add_recomputation]: 3.647e-05 [cse_after_recomputation]: 1.858e-05, [1] [Cycle 1]: 1.348e-05, [1] [cse]: 7.15e-06 [auto_monad_reorder]: 1.295e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 5.21998e-06 [opt_after_jit_grad]: 0.00044828 [symbol_engine_optimizer]: 7.573e-05, [1] [Cycle 1]: 6.971e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 5.34e-06 [elim_not_effective]: 9.19998e-06 [opt_reshape]: 3.69002e-06 [fold_const_symbol]: 1.741e-05 [renormalize]: 9.49978e-07 [validate]: 3.31e-05 Sums bootstrap : 0.000252s : 0.31% type_inference : 0.057971s : 72.36% event_method : 0.000288s : 0.36% auto_monad : 0.000103s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000033s : 0.04% rewriter_before_opt_a : 0.000113s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000119s : 0.15% jit_opt_a.loop_unroll : 0.000091s : 0.11% jit_opt_a.a_1 : 0.002091s : 2.61% jit_opt_a.with_stream_mark : 0.000057s : 0.07% jit_opt_a.recompute_prepare : 0.000031s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000015s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000011s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000011s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000025s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.03% jit_opt_a.accelerated_algorithm : 0.000023s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.03% jit_opt_a.merge_forward : 0.000015s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000053s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000039s : 0.05% jit_opt_a.meta_fg_expand : 0.001809s : 2.26% jit_opt_a.replace_old_param : 0.000083s : 0.10% jit_opt_a.inline_without_move : 0.000070s : 0.09% jit_opt_a.renormalize : 0.014066s : 17.56% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000075s : 0.09% jit_opt_a.cse : 0.000323s : 0.40% jit_opt_a.replace_applicator : 0.000106s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000035s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000683s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000025s : 0.03% loop_unroll : 0.000671s : 0.84% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000036s : 0.05% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000448s : 0.56% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000017s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000033s : 0.04% Time group info: ------[substitution.] 0.000522 101 0.33% : 0.000002s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.88% : 0.000005s : 1: substitution.graph_param_transform 63.05% : 0.000329s : 12: substitution.inline 3.59% : 0.000019s : 2: substitution.inline_without_move 1.75% : 0.000009s : 11: substitution.j_node_and_user_rematch 2.22% : 0.000012s : 7: substitution.minmaximum_grad 1.36% : 0.000007s : 5: substitution.partial_eliminate 1.83% : 0.000010s : 11: substitution.remove_not_recompute_node 6.13% : 0.000032s : 10: substitution.replace_applicator 1.28% : 0.000007s : 10: substitution.replace_old_param 0.49% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.17% : 0.000006s : 1: substitution.tile_eliminate 4.60% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 3.03% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.07% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057870 2 96.33% : 0.055745s : 1: type_inference.infer 3.67% : 0.002124s : 1: type_inference.specialize ------[replace.] 0.000164 19 64.69% : 0.000106s : 12: replace.inline 35.31% : 0.000058s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000343 19 93.91% : 0.000322s : 12: match.inline 6.09% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000364 2542 1.56% : 0.000006s : 44: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.46% : 0.000005s : 44: predicate.addn_check_dump 1.60% : 0.000006s : 44: predicate.addn_zero_filter 2.00% : 0.000007s : 44: predicate.arithmetic_simplify 1.57% : 0.000006s : 44: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 44: predicate.compare_switch_simplify 1.50% : 0.000005s : 44: predicate.depend_value_elim 1.46% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.63% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.56% : 0.000006s : 44: predicate.environ_get_depend_swap 1.61% : 0.000006s : 44: predicate.environ_get_eliminate 1.56% : 0.000006s : 44: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 0.77% : 0.000003s : 17: predicate.get_grad_eliminate 0.11% : 0.000000s : 1: predicate.graph_param_transform 4.29% : 0.000016s : 65: predicate.inline 2.09% : 0.000008s : 45: predicate.inline_without_move 0.35% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.86% : 0.000003s : 17: predicate.less_batch_normalization 1.91% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.83% : 0.000007s : 52: predicate.load_eliminater 0.46% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.62% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.75% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.51% : 0.000005s : 44: predicate.merge_addn 1.46% : 0.000005s : 44: predicate.minmaximum_grad 0.41% : 0.000001s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.32% : 0.000008s : 52: predicate.partial_eliminate 1.64% : 0.000006s : 44: predicate.print_const_string_wrapper 2.02% : 0.000007s : 44: predicate.reduce_eliminate 1.82% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 17: predicate.remove_not_recompute_node 2.98% : 0.000011s : 96: predicate.replace_applicator 1.14% : 0.000004s : 45: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 44: predicate.reshape_eliminate 1.61% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.53% : 0.000006s : 44: predicate.same_eliminate 0.45% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.33% : 0.000001s : 2: predicate.special_op_eliminate 0.75% : 0.000003s : 17: predicate.specialize_transform 1.87% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.87% : 0.000010s : 63: predicate.switch_defer_inline 2.64% : 0.000010s : 63: predicate.switch_layer_defer_inline 6.48% : 0.000024s : 157: predicate.switch_simplify 1.62% : 0.000006s : 44: predicate.tile_eliminate 1.49% : 0.000005s : 44: predicate.transpose_eliminate 1.91% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.73% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.20% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.83% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.71% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.75% : 0.000006s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003673 50 78.19% : 0.002872s : 34: func_graph_cloner_run.FuncGraphClonerGraph 21.81% : 0.000801s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.101243 87 0.04% : 0.000039s : 1: add_recomputation 0.11% : 0.000109s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.27% : 0.000272s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.30% : 0.000301s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 22.93% : 0.023218s : 1: jit_opt_a 0.13% : 0.000131s : 1: jit_opt_after_cconv 0.04% : 0.000042s : 1: jit_opt_b 0.67% : 0.000682s : 1: loop_unroll 0.68% : 0.000692s : 1: mutable_eliminate 2.69% : 0.002728s : 39: opt.transform.jit_opt_a 0.03% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000014s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000036s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 11.89% : 0.012039s : 2: renormalize.infer 1.98% : 0.002005s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000038s : 1: rewriter_after_opt_a 0.11% : 0.000116s : 1: rewriter_before_opt_a 0.08% : 0.000078s : 1: symbol_engine_optimizer 57.28% : 0.057994s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.507.805 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00655e0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.508.458 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0610362, [30] [bootstrap]: 0.00030327 [type_inference]: 0.0283682 [event_method]: 1.94e-05 [auto_monad]: 6.625e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 9.335e-05 [rewriter_before_opt_a]: 7.883e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.0300181, [2] [Cycle 1]: 0.00194861, [27] [switch_simplify]: 6.066e-05 [loop_unroll]: 2.849e-05 [a_1]: 0.00056491 [with_stream_mark]: 2.223e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.406e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00092782 [add_forward_monad_depend]: 6.06e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.408e-05 [cse]: 4.246e-05 [replace_applicator]: 1.322e-05 [Cycle 2]: 0.0003217, [27] [switch_simplify]: 5.49e-06 [loop_unroll]: 4.75001e-06 [a_1]: 8.998e-05 [with_stream_mark]: 1.062e-05 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.41998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.293e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.248e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 1.236e-05 [rewriter_after_opt_a]: 3.596e-05 [convert_after_rewriter]: 6.78998e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00052875 [jit_opt_b]: 4.804e-05, [1] [Cycle 1]: 4.099e-05, [2] [frontend_op_eliminate]: 1.485e-05 [inline_after_opt_a]: 1.547e-05 [cconv]: 2.512e-05 [loop_unroll]: 0.0004128 [jit_opt_after_cconv]: 0.00013305, [1] [Cycle 1]: 0.00012728, [11] [c_1]: 1.889e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 5.17999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 2.025e-05 [call_graph_tuple_transform]: 1.755e-05 [tuple_list_get_item_eliminator]: 5.31002e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 5.06002e-06 [remove_dup_value]: 1.544e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 5.61e-06 [add_recomputation]: 4.773e-05 [cse_after_recomputation]: 3.069e-05, [1] [Cycle 1]: 2.582e-05, [1] [cse]: 1.115e-05 [auto_monad_reorder]: 1.741e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 4.75001e-06 [opt_after_jit_grad]: 0.00045685 [symbol_engine_optimizer]: 7.284e-05, [1] [Cycle 1]: 6.676e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 7.60998e-06 [elim_not_effective]: 1.314e-05 [opt_reshape]: 5.98998e-06 [fold_const_symbol]: 9.14e-06 [renormalize]: 5.59987e-07 [validate]: 3.591e-05 Sums bootstrap : 0.000303s : 0.93% type_inference : 0.028368s : 86.75% event_method : 0.000019s : 0.06% auto_monad : 0.000066s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000093s : 0.29% rewriter_before_opt_a : 0.000079s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.20% jit_opt_a.loop_unroll : 0.000033s : 0.10% jit_opt_a.a_1 : 0.000655s : 2.00% jit_opt_a.with_stream_mark : 0.000033s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000928s : 2.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.06% jit_opt_a.cse : 0.000055s : 0.17% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000036s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000529s : 1.62% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000015s : 0.05% cconv : 0.000025s : 0.08% loop_unroll : 0.000413s : 1.26% jit_opt_after_cconv.c_1 : 0.000019s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000048s : 0.15% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000457s : 1.40% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.11% Time group info: ------[substitution.] 0.000227 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 3: substitution.graph_param_transform 85.68% : 0.000195s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000004s : 2: substitution.replace_old_param 5.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028291 2 95.31% : 0.026964s : 1: type_inference.infer 4.69% : 0.001326s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.90% : 0.000049s : 4: replace.inline 31.10% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.66% : 0.000192s : 4: match.inline 5.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000001s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.56% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000794 13 47.53% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.39% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.08% : 0.000366s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062891 72 0.08% : 0.000051s : 1: add_recomputation 0.11% : 0.000070s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.52% : 0.000325s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 47.74% : 0.030021s : 1: jit_opt_a 0.22% : 0.000136s : 1: jit_opt_after_cconv 0.08% : 0.000051s : 1: jit_opt_b 0.67% : 0.000420s : 1: loop_unroll 0.85% : 0.000537s : 1: mutable_eliminate 1.39% : 0.000873s : 26: opt.transform.jit_opt_a 0.07% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000097s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.88% : 0.000554s : 1: renormalize.infer 0.58% : 0.000366s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000083s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 45.14% : 0.028388s : 1: type_inference TotalTime = 0.0480634, [30] [bootstrap]: 0.00024351 [type_inference]: 0.0272204 [event_method]: 3.824e-05 [auto_monad]: 0.00014409 [graph_reusing]: 1.043e-05 [pre_auto_parallel]: 3.66999e-06 [py_interpret_to_execute]: 4.84e-05 [rewriter_before_opt_a]: 0.00016498 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.0176008, [3] [Cycle 1]: 0.00887071, [27] [switch_simplify]: 0.00020736 [loop_unroll]: 6.374e-05 [a_1]: 0.0013989 [with_stream_mark]: 3.987e-05 [recompute_prepare]: 2.541e-05 [updatestate_depend_eliminate]: 9.67001e-06 [updatestate_assign_eliminate]: 7.35998e-06 [updatestate_loads_eliminate]: 6.94001e-06 [parameter_eliminate]: 3.38e-06 [specialize_transform]: 1.431e-05 [updatestate_useless_node_eliminater]: 1.254e-05 [accelerated_algorithm]: 1.278e-05 [meta_shard_fg_expand]: 4.67e-06 [get_grad_eliminate_]: 1.307e-05 [merge_forward]: 9.09e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.951e-05 [j_node_and_user_rematch]: 2.747e-05 [meta_fg_expand]: 0.00199834 [replace_old_param]: 6.945e-05 [inline_without_move]: 6.2e-05 [renormalize]: 0.00394491 [add_forward_monad_depend]: 1.359e-05 [auto_monad_grad]: 6.58998e-06 [auto_monad_eliminator]: 6.193e-05 [cse]: 0.0004043 [replace_applicator]: 9.269e-05 [Cycle 2]: 0.00409719, [27] [switch_simplify]: 4.336e-05 [loop_unroll]: 4.081e-05 [a_1]: 0.0012505 [with_stream_mark]: 2.363e-05 [recompute_prepare]: 1.493e-05 [updatestate_depend_eliminate]: 5.34998e-06 [updatestate_assign_eliminate]: 4.22e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 8.67998e-06 [updatestate_useless_node_eliminater]: 7.95998e-06 [accelerated_algorithm]: 8.43999e-06 [meta_shard_fg_expand]: 2.98998e-06 [get_grad_eliminate_]: 7.55e-06 [merge_forward]: 5.14e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.057e-05 [j_node_and_user_rematch]: 1.222e-05 [meta_fg_expand]: 0.00031047 [replace_old_param]: 1.719e-05 [inline_without_move]: 8.75001e-06 [renormalize]: 0.00198306 [add_forward_monad_depend]: 1.087e-05 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.796e-05 [cse]: 2.968e-05 [replace_applicator]: 2.188e-05 [Cycle 3]: 0.00028926, [27] [switch_simplify]: 4.89003e-06 [loop_unroll]: 3.68999e-06 [a_1]: 3.943e-05 [with_stream_mark]: 1.536e-05 [recompute_prepare]: 4.1e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 3.34001e-06 [updatestate_useless_node_eliminater]: 3.14999e-06 [accelerated_algorithm]: 3.63e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 6.17999e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 3.09001e-06 [inline_without_move]: 3.09001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.49999e-06 [cse]: 1.12e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 1.652e-05 [rewriter_after_opt_a]: 4.051e-05 [convert_after_rewriter]: 7.05998e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.00078886 [jit_opt_b]: 4.458e-05, [1] [Cycle 1]: 3.516e-05, [2] [frontend_op_eliminate]: 1.016e-05 [inline_after_opt_a]: 1.218e-05 [cconv]: 3.306e-05 [loop_unroll]: 0.00050717 [jit_opt_after_cconv]: 0.00014869, [1] [Cycle 1]: 0.00013974, [11] [c_1]: 1.164e-05 [parameter_eliminate]: 4.33001e-06 [updatestate_depend_eliminate]: 8.18999e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.804e-05 [call_graph_tuple_transform]: 1.797e-05 [tuple_list_get_item_eliminator]: 3.55e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 4.27e-06 [remove_dup_value]: 1.568e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 5.81998e-06 [add_recomputation]: 4.209e-05 [cse_after_recomputation]: 2.136e-05, [1] [Cycle 1]: 1.505e-05, [1] [cse]: 7.7e-06 [auto_monad_reorder]: 1.336e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 6.88e-06 [opt_after_jit_grad]: 0.00053316 [symbol_engine_optimizer]: 8.242e-05, [1] [Cycle 1]: 7.464e-05, [6] [build]: 5.09e-06 [elim_shapecalc]: 6.22001e-06 [elim_not_effective]: 2.087e-05 [opt_reshape]: 4.47e-06 [fold_const_symbol]: 6.19001e-06 [renormalize]: 6.69999e-07 [validate]: 3.917e-05 Sums bootstrap : 0.000244s : 0.57% type_inference : 0.027220s : 63.81% event_method : 0.000038s : 0.09% auto_monad : 0.000144s : 0.34% graph_reusing : 0.000010s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000048s : 0.11% rewriter_before_opt_a : 0.000165s : 0.39% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000256s : 0.60% jit_opt_a.loop_unroll : 0.000108s : 0.25% jit_opt_a.a_1 : 0.002689s : 6.30% jit_opt_a.with_stream_mark : 0.000079s : 0.18% jit_opt_a.recompute_prepare : 0.000044s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000026s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.06% jit_opt_a.accelerated_algorithm : 0.000025s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.06% jit_opt_a.merge_forward : 0.000018s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000066s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.11% jit_opt_a.meta_fg_expand : 0.002310s : 5.42% jit_opt_a.replace_old_param : 0.000090s : 0.21% jit_opt_a.inline_without_move : 0.000074s : 0.17% jit_opt_a.renormalize : 0.005928s : 13.90% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.06% jit_opt_a.auto_monad_grad : 0.000010s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000086s : 0.20% jit_opt_a.cse : 0.000445s : 1.04% jit_opt_a.replace_applicator : 0.000121s : 0.28% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000041s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000789s : 1.85% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.02% jit_opt_b.inline_after_opt_a : 0.000012s : 0.03% cconv : 0.000033s : 0.08% loop_unroll : 0.000507s : 1.19% jit_opt_after_cconv.c_1 : 0.000012s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000042s : 0.10% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000533s : 1.25% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.09% Time group info: ------[substitution.] 0.000738 112 0.24% : 0.000002s : 1: substitution.elim_not_effective 0.14% : 0.000001s : 1: substitution.fold_const_symbol 0.68% : 0.000005s : 1: substitution.graph_param_transform 66.63% : 0.000492s : 19: substitution.inline 3.07% : 0.000023s : 2: substitution.inline_without_move 1.51% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.84% : 0.000014s : 7: substitution.minmaximum_grad 1.03% : 0.000008s : 5: substitution.partial_eliminate 1.53% : 0.000011s : 12: substitution.remove_not_recompute_node 5.07% : 0.000037s : 10: substitution.replace_applicator 0.93% : 0.000007s : 8: substitution.replace_old_param 1.21% : 0.000009s : 1: substitution.reshape_eliminate 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.75% : 0.000013s : 2: substitution.switch_simplify 0.88% : 0.000006s : 1: substitution.tile_eliminate 3.44% : 0.000025s : 7: substitution.tuple_list_convert_item_index_to_positive 2.33% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.26% : 0.000054s : 15: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027023 2 91.51% : 0.024729s : 1: type_inference.infer 8.49% : 0.002294s : 1: type_inference.specialize ------[replace.] 0.000291 29 54.89% : 0.000160s : 19: replace.inline 19.90% : 0.000058s : 2: replace.switch_simplify 25.21% : 0.000073s : 8: replace.tuple_list_get_item_eliminator ------[match.] 0.000523 29 91.99% : 0.000481s : 19: match.inline 2.24% : 0.000012s : 2: match.switch_simplify 5.76% : 0.000030s : 8: match.tuple_list_get_item_eliminator ------[predicate.] 0.000442 2841 1.60% : 0.000007s : 49: predicate.accumulaten_eliminater 0.26% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.43% : 0.000006s : 49: predicate.addn_check_dump 1.61% : 0.000007s : 49: predicate.addn_zero_filter 2.04% : 0.000009s : 49: predicate.arithmetic_simplify 1.58% : 0.000007s : 49: predicate.cast_eliminate 0.10% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000006s : 49: predicate.compare_switch_simplify 1.57% : 0.000007s : 49: predicate.depend_value_elim 1.44% : 0.000006s : 49: predicate.dict_get_item_const_eliminator 1.49% : 0.000007s : 49: predicate.dict_get_item_eliminator 1.66% : 0.000007s : 49: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000007s : 49: predicate.environ_add_const_eliminate 1.48% : 0.000007s : 49: predicate.environ_get_add_eliminate 1.45% : 0.000006s : 49: predicate.environ_get_depend_swap 1.47% : 0.000006s : 49: predicate.environ_get_eliminate 1.56% : 0.000007s : 49: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.64% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.56% : 0.000020s : 78: predicate.inline 1.78% : 0.000008s : 41: predicate.inline_without_move 0.28% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.91% : 0.000004s : 17: predicate.less_batch_normalization 1.87% : 0.000008s : 57: predicate.list_to_tuple_eliminator_ 1.80% : 0.000008s : 58: predicate.load_eliminater 0.39% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.65% : 0.000016s : 115: predicate.loop_unroll_before_grad 1.98% : 0.000009s : 50: predicate.make_slice_get_slice_eliminator 1.45% : 0.000006s : 49: predicate.merge_addn 1.60% : 0.000007s : 49: predicate.minmaximum_grad 0.44% : 0.000002s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.26% : 0.000010s : 58: predicate.partial_eliminate 1.58% : 0.000007s : 49: predicate.print_const_string_wrapper 2.07% : 0.000009s : 49: predicate.reduce_eliminate 1.84% : 0.000008s : 57: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000002s : 17: predicate.remove_not_recompute_node 2.47% : 0.000011s : 100: predicate.replace_applicator 0.89% : 0.000004s : 41: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000007s : 49: predicate.reshape_eliminate 1.57% : 0.000007s : 49: predicate.row_tensor_add_zeros_like 0.20% : 0.000001s : 1: predicate.row_tensor_eliminate 1.69% : 0.000007s : 49: predicate.same_eliminate 0.42% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.70% : 0.000003s : 17: predicate.specialize_transform 1.70% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.67% : 0.000007s : 49: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.04% : 0.000013s : 76: predicate.switch_defer_inline 2.69% : 0.000012s : 76: predicate.switch_layer_defer_inline 7.45% : 0.000033s : 196: predicate.switch_simplify 1.60% : 0.000007s : 49: predicate.tile_eliminate 1.51% : 0.000007s : 49: predicate.transpose_eliminate 1.85% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.62% : 0.000007s : 49: predicate.tuple_list_get_item_depend_reorder 3.29% : 0.000015s : 59: predicate.tuple_list_get_item_eliminator 1.78% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.86% : 0.000008s : 57: predicate.tuple_to_list_eliminator_ 1.79% : 0.000008s : 58: predicate.updatestate_pure_node_eliminater 2.50% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.78% : 0.000008s : 49: predicate.value_based_eliminate 0.03% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002972 40 64.35% : 0.001913s : 17: func_graph_cloner_run.FuncGraphClonerGraph 35.65% : 0.001060s : 23: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057525 87 0.08% : 0.000045s : 1: add_recomputation 0.26% : 0.000151s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.47% : 0.000271s : 1: bootstrap 0.06% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.08% : 0.000044s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000013s : 1: graph_reusing 30.60% : 0.017604s : 1: jit_opt_a 0.26% : 0.000151s : 1: jit_opt_after_cconv 0.08% : 0.000048s : 1: jit_opt_b 0.90% : 0.000520s : 1: loop_unroll 1.40% : 0.000803s : 1: mutable_eliminate 6.14% : 0.003532s : 39: opt.transform.jit_opt_a 0.06% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000016s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000546s : 1: opt_after_jit_grad 0.02% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.09% : 0.000051s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 6.84% : 0.003934s : 2: renormalize.infer 3.42% : 0.001970s : 2: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000045s : 1: rewriter_after_opt_a 0.30% : 0.000170s : 1: rewriter_before_opt_a 0.15% : 0.000085s : 1: symbol_engine_optimizer 47.36% : 0.027246s : 1: type_inference TotalTime = 0.0146662, [30] [bootstrap]: 0.00030814 [type_inference]: 0.00575535 [event_method]: 1.972e-05 [auto_monad]: 6.714e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 4.538e-05 [rewriter_before_opt_a]: 8.202e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00613544, [2] [Cycle 1]: 0.00203517, [27] [switch_simplify]: 6.115e-05 [loop_unroll]: 2.936e-05 [a_1]: 0.00056757 [with_stream_mark]: 2.033e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 3.82998e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.92999e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 0.00102472 [add_forward_monad_depend]: 5.62001e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.51e-05 [cse]: 3.067e-05 [replace_applicator]: 1.236e-05 [Cycle 2]: 0.00030987, [27] [switch_simplify]: 5.33002e-06 [loop_unroll]: 4.87e-06 [a_1]: 8.854e-05 [with_stream_mark]: 8.99998e-06 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 7.87998e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 6.90002e-06 [inline_without_move]: 4.82e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.023e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 1.088e-05 [rewriter_after_opt_a]: 3.456e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00053917 [jit_opt_b]: 4.952e-05, [1] [Cycle 1]: 4.226e-05, [2] [frontend_op_eliminate]: 1.569e-05 [inline_after_opt_a]: 1.507e-05 [cconv]: 2.401e-05 [loop_unroll]: 0.00045327 [jit_opt_after_cconv]: 0.00014941, [1] [Cycle 1]: 0.00014265, [11] [c_1]: 2.103e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 1.97999e-06 [cse]: 2.498e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.50001e-06 [remove_dup_value]: 1.53e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 6.55002e-06 [add_recomputation]: 6.54e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.869e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.693e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.00052479 [symbol_engine_optimizer]: 7.533e-05, [1] [Cycle 1]: 6.754e-05, [6] [build]: 3.18e-06 [elim_shapecalc]: 7.83001e-06 [elim_not_effective]: 1.324e-05 [opt_reshape]: 6.18998e-06 [fold_const_symbol]: 9.22999e-06 [renormalize]: 3.50003e-07 [validate]: 4.346e-05 Sums bootstrap : 0.000308s : 3.00% type_inference : 0.005755s : 55.94% event_method : 0.000020s : 0.19% auto_monad : 0.000067s : 0.65% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.44% rewriter_before_opt_a : 0.000082s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.65% jit_opt_a.loop_unroll : 0.000034s : 0.33% jit_opt_a.a_1 : 0.000656s : 6.38% jit_opt_a.with_stream_mark : 0.000029s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.001025s : 9.96% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.20% jit_opt_a.cse : 0.000041s : 0.40% jit_opt_a.replace_applicator : 0.000017s : 0.17% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000035s : 0.34% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000539s : 5.24% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000024s : 0.23% loop_unroll : 0.000453s : 4.41% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000065s : 0.64% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000017s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000525s : 5.10% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.42% Time group info: ------[substitution.] 0.000236 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 3: substitution.graph_param_transform 84.92% : 0.000200s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005681 2 80.66% : 0.004583s : 1: type_inference.infer 19.34% : 0.001098s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.15% : 0.000050s : 4: replace.inline 31.85% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.44% : 0.000198s : 4: match.inline 5.56% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.48% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000006s : 22: predicate.inline 1.37% : 0.000002s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.30% : 0.000001s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 2.06% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.47% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.48% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000002s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.83% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000807 13 51.48% : 0.000415s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.13% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.38% : 0.000342s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016613 72 0.41% : 0.000069s : 1: add_recomputation 0.42% : 0.000071s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.98% : 0.000329s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.95% : 0.006139s : 1: jit_opt_a 0.92% : 0.000152s : 1: jit_opt_after_cconv 0.32% : 0.000052s : 1: jit_opt_b 2.78% : 0.000461s : 1: loop_unroll 3.29% : 0.000546s : 1: mutable_eliminate 5.26% : 0.000874s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.21% : 0.000534s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000049s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 3.65% : 0.000607s : 1: renormalize.infer 2.46% : 0.000409s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000037s : 1: rewriter_after_opt_a 0.51% : 0.000085s : 1: rewriter_before_opt_a 0.47% : 0.000078s : 1: symbol_engine_optimizer 34.77% : 0.005776s : 1: type_inference TotalTime = 0.343689, [30] [bootstrap]: 0.00027695 [type_inference]: 0.27089 [event_method]: 6.764e-05 [auto_monad]: 0.00011735 [graph_reusing]: 7.51999e-06 [pre_auto_parallel]: 3.83001e-06 [py_interpret_to_execute]: 0.0010472 [rewriter_before_opt_a]: 0.00014317 [expand_dump_flag]: 4.94e-06 [jit_opt_a]: 0.0493028, [2] [Cycle 1]: 0.00784265, [27] [switch_simplify]: 8.888e-05 [loop_unroll]: 3.582e-05 [a_1]: 0.0009572 [with_stream_mark]: 2.985e-05 [recompute_prepare]: 1.088e-05 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 8.71002e-06 [updatestate_useless_node_eliminater]: 7.11001e-06 [accelerated_algorithm]: 8.25999e-06 [meta_shard_fg_expand]: 3.07002e-06 [get_grad_eliminate_]: 7.92e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.936e-05 [j_node_and_user_rematch]: 1.246e-05 [meta_fg_expand]: 3.20002e-06 [replace_old_param]: 1.278e-05 [inline_without_move]: 7.58999e-06 [renormalize]: 0.00624301 [add_forward_monad_depend]: 1.577e-05 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 2.392e-05 [cse]: 4.72e-05 [replace_applicator]: 2.951e-05 [Cycle 2]: 0.00045483, [27] [switch_simplify]: 8.89e-06 [loop_unroll]: 8.11002e-06 [a_1]: 0.00015496 [with_stream_mark]: 1.65e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 7.03998e-06 [updatestate_useless_node_eliminater]: 6.64999e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.81999e-06 [merge_forward]: 5.23002e-06 [cell_reuse_recompute_pass]: 3.47997e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.016e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 1.148e-05 [inline_without_move]: 6.61e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.84001e-06 [cse]: 1.549e-05 [replace_applicator]: 7.58001e-06 [py_interpret_to_execute_after_opt_a]: 1.808e-05 [rewriter_after_opt_a]: 4.607e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.77999e-06 [mutable_eliminate]: 0.00088174 [jit_opt_b]: 7.07e-05, [1] [Cycle 1]: 6.203e-05, [2] [frontend_op_eliminate]: 2.885e-05 [inline_after_opt_a]: 1.908e-05 [cconv]: 2.938e-05 [loop_unroll]: 0.00045256 [jit_opt_after_cconv]: 0.00016913, [1] [Cycle 1]: 0.00016088, [11] [c_1]: 2.761e-05 [parameter_eliminate]: 2.70002e-06 [updatestate_depend_eliminate]: 6.81999e-06 [updatestate_assign_eliminate]: 5.62001e-06 [updatestate_loads_eliminate]: 2.60997e-06 [cse]: 2.577e-05 [call_graph_tuple_transform]: 2.265e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.41998e-06 [remove_dup_value]: 1.987e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 1.004e-05 [add_recomputation]: 5.427e-05 [cse_after_recomputation]: 2.824e-05, [1] [Cycle 1]: 2.033e-05, [1] [cse]: 1.421e-05 [auto_monad_reorder]: 1.754e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.44e-06 [opt_after_jit_grad]: 0.0143975 [symbol_engine_optimizer]: 0.00101488, [1] [Cycle 1]: 0.00098041, [6] [build]: 8.11002e-06 [elim_shapecalc]: 1.06e-05 [elim_not_effective]: 3.199e-05 [opt_reshape]: 8.29998e-06 [fold_const_symbol]: 0.00043066 [renormalize]: 1.40999e-06 [validate]: 9.148e-05 Sums bootstrap : 0.000277s : 0.09% type_inference : 0.270890s : 91.15% event_method : 0.000068s : 0.02% auto_monad : 0.000117s : 0.04% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.001047s : 0.35% rewriter_before_opt_a : 0.000143s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000098s : 0.03% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.001112s : 0.37% jit_opt_a.with_stream_mark : 0.000046s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.006243s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000063s : 0.02% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000046s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000882s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000029s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000453s : 0.15% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.014398s : 4.84% symbol_engine_optimizer.build : 0.000008s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000032s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000431s : 0.14% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000091s : 0.03% Time group info: ------[substitution.] 0.000392 25 0.66% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.66% : 0.000007s : 4: substitution.graph_param_transform 88.74% : 0.000348s : 5: substitution.inline 1.21% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000007s : 2: substitution.replace_old_param 3.68% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.270761 2 91.93% : 0.248905s : 1: type_inference.infer 8.07% : 0.021856s : 1: type_inference.specialize ------[replace.] 0.000191 7 52.57% : 0.000100s : 5: replace.inline 47.43% : 0.000090s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000357 7 96.34% : 0.000344s : 5: match.inline 3.66% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 2.85% : 0.000005s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.62% : 0.000003s : 13: predicate.addn_zero_filter 2.26% : 0.000004s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.86% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.72% : 0.000001s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.30% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.69% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 0.98% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.47% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 1.04% : 0.000002s : 4: predicate.opt_reshape 2.11% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.86% : 0.000003s : 13: predicate.reduce_eliminate 1.66% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000004s : 20: predicate.switch_defer_inline 1.93% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.77% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.25% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.46% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.85% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003601 25 51.97% : 0.001872s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.99% : 0.000108s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.05% : 0.001622s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.351855 72 0.02% : 0.000057s : 1: add_recomputation 0.03% : 0.000122s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.08% : 0.000290s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.02% : 0.000077s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 14.01% : 0.049307s : 1: jit_opt_a 0.05% : 0.000172s : 1: jit_opt_after_cconv 0.02% : 0.000074s : 1: jit_opt_b 0.13% : 0.000461s : 1: loop_unroll 0.25% : 0.000891s : 1: mutable_eliminate 0.41% : 0.001433s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000042s : 4: opt.transform.jit_opt_b 0.00% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000067s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000478s : 4: opt.transform.symbol_engine_opt 4.10% : 0.014422s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.30% : 0.001056s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.01% : 0.003539s : 1: renormalize.infer 0.76% : 0.002687s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000049s : 1: rewriter_after_opt_a 0.04% : 0.000149s : 1: rewriter_before_opt_a 0.29% : 0.001022s : 1: symbol_engine_optimizer 78.21% : 0.275172s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.581.694 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda0065280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.582.384 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0146234, [30] [bootstrap]: 0.00034101 [type_inference]: 0.00489413 [event_method]: 1.871e-05 [auto_monad]: 6.302e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 3.722e-05 [rewriter_before_opt_a]: 7.165e-05 [expand_dump_flag]: 2.63e-06 [jit_opt_a]: 0.00697685, [2] [Cycle 1]: 0.00328096, [27] [switch_simplify]: 5.6e-05 [loop_unroll]: 2.958e-05 [a_1]: 0.00053058 [with_stream_mark]: 1.665e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.06001e-06 [inline_without_move]: 5.26002e-06 [renormalize]: 0.00231366 [add_forward_monad_depend]: 7.12002e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.59e-05 [cse]: 2.918e-05 [replace_applicator]: 1.609e-05 [Cycle 2]: 0.00035328, [27] [switch_simplify]: 6.28002e-06 [loop_unroll]: 4.77e-06 [a_1]: 0.00011169 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 4.50999e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.59001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 8.37998e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.146e-05 [replace_applicator]: 4.83001e-06 [py_interpret_to_execute_after_opt_a]: 1.192e-05 [rewriter_after_opt_a]: 3.631e-05 [convert_after_rewriter]: 7.37997e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.0006154 [jit_opt_b]: 5.945e-05, [1] [Cycle 1]: 5.181e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.574e-05 [cconv]: 2.821e-05 [loop_unroll]: 0.00041855 [jit_opt_after_cconv]: 0.00017546, [1] [Cycle 1]: 0.0001687, [11] [c_1]: 2.078e-05 [parameter_eliminate]: 3.66001e-06 [updatestate_depend_eliminate]: 6.59999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.129e-05 [call_graph_tuple_transform]: 1.969e-05 [tuple_list_get_item_eliminator]: 5.36002e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 3.374e-05 [remove_dup_value]: 1.501e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 4.73e-05 [cse_after_recomputation]: 2.188e-05, [1] [Cycle 1]: 1.615e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.623e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.00045246 [symbol_engine_optimizer]: 7.143e-05, [1] [Cycle 1]: 6.543e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 7.51001e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 8.74e-06 [renormalize]: 4.19997e-07 [validate]: 3.751e-05 Sums bootstrap : 0.000341s : 3.19% type_inference : 0.004894s : 45.79% event_method : 0.000019s : 0.18% auto_monad : 0.000063s : 0.59% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.35% rewriter_before_opt_a : 0.000072s : 0.67% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.58% jit_opt_a.loop_unroll : 0.000034s : 0.32% jit_opt_a.a_1 : 0.000642s : 6.01% jit_opt_a.with_stream_mark : 0.000027s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.002314s : 21.65% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.21% jit_opt_a.cse : 0.000041s : 0.38% jit_opt_a.replace_applicator : 0.000021s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000036s : 0.34% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000615s : 5.76% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000028s : 0.26% loop_unroll : 0.000419s : 3.92% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000034s : 0.32% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000047s : 0.44% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000452s : 4.23% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.35% Time group info: ------[substitution.] 0.000202 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000005s : 3: substitution.graph_param_transform 82.35% : 0.000166s : 4: substitution.inline 2.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004829 2 82.10% : 0.003965s : 1: type_inference.infer 17.90% : 0.000865s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.98% : 0.000048s : 4: replace.inline 32.02% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.44% : 0.000164s : 4: match.inline 6.56% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 2.12% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.64% : 0.000001s : 3: predicate.graph_param_transform 5.64% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.36% : 0.000003s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 2.02% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.14% : 0.000008s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.97% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.93% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000687 13 51.45% : 0.000353s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.50% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.05% : 0.000303s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017878 72 0.28% : 0.000050s : 1: add_recomputation 0.37% : 0.000066s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 2.01% : 0.000359s : 1: bootstrap 0.17% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 39.05% : 0.006981s : 1: jit_opt_a 1.00% : 0.000178s : 1: jit_opt_after_cconv 0.35% : 0.000062s : 1: jit_opt_b 2.38% : 0.000426s : 1: loop_unroll 3.50% : 0.000626s : 1: mutable_eliminate 4.81% : 0.000861s : 26: opt.transform.jit_opt_a 0.43% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.58% : 0.000460s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 10.75% : 0.001921s : 1: renormalize.infer 2.14% : 0.000382s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000039s : 1: rewriter_after_opt_a 0.42% : 0.000075s : 1: rewriter_before_opt_a 0.41% : 0.000074s : 1: symbol_engine_optimizer 27.47% : 0.004912s : 1: type_inference TotalTime = 0.0341758, [30] [bootstrap]: 0.0002575 [type_inference]: 0.0109663 [event_method]: 5.206e-05 [auto_monad]: 9.474e-05 [graph_reusing]: 7.08998e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 3.016e-05 [rewriter_before_opt_a]: 0.00011334 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.0203361, [3] [Cycle 1]: 0.0135511, [27] [switch_simplify]: 7.952e-05 [loop_unroll]: 4.235e-05 [a_1]: 0.00094157 [with_stream_mark]: 3.677e-05 [recompute_prepare]: 2.39e-05 [updatestate_depend_eliminate]: 9.42999e-06 [updatestate_assign_eliminate]: 7.33999e-06 [updatestate_loads_eliminate]: 7.13998e-06 [parameter_eliminate]: 3.28e-06 [specialize_transform]: 1.493e-05 [updatestate_useless_node_eliminater]: 1.363e-05 [accelerated_algorithm]: 1.438e-05 [meta_shard_fg_expand]: 4.00998e-06 [get_grad_eliminate_]: 1.344e-05 [merge_forward]: 1.075e-05 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.02e-05 [j_node_and_user_rematch]: 2.611e-05 [meta_fg_expand]: 0.00207323 [replace_old_param]: 8.142e-05 [inline_without_move]: 6.8e-05 [renormalize]: 0.00927498 [add_forward_monad_depend]: 1.455e-05 [auto_monad_grad]: 6.20002e-06 [auto_monad_eliminator]: 6.05e-05 [cse]: 0.00024734 [replace_applicator]: 9.142e-05 [Cycle 2]: 0.00294246, [27] [switch_simplify]: 3.952e-05 [loop_unroll]: 3.764e-05 [a_1]: 0.00105644 [with_stream_mark]: 1.77e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 4.21001e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 8.1e-06 [meta_fg_expand]: 6.784e-05 [replace_old_param]: 6.19001e-06 [inline_without_move]: 5.12e-06 [renormalize]: 0.00140739 [add_forward_monad_depend]: 5.41002e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.232e-05 [cse]: 2.41e-05 [replace_applicator]: 1.398e-05 [Cycle 3]: 0.00024399, [27] [switch_simplify]: 4.21001e-06 [loop_unroll]: 3.48e-06 [a_1]: 3.766e-05 [with_stream_mark]: 1.063e-05 [recompute_prepare]: 3.5e-06 [updatestate_depend_eliminate]: 2.31e-06 [updatestate_assign_eliminate]: 1.72001e-06 [updatestate_loads_eliminate]: 1.49e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 3.95e-06 [updatestate_useless_node_eliminater]: 3.23998e-06 [accelerated_algorithm]: 3.42002e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 2.98998e-06 [merge_forward]: 2.84999e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.077e-05 [j_node_and_user_rematch]: 5.51998e-06 [meta_fg_expand]: 1.35999e-06 [replace_old_param]: 3.01001e-06 [inline_without_move]: 3.08e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 3.68999e-06 [cse]: 7.87e-06 [replace_applicator]: 3.32002e-06 [py_interpret_to_execute_after_opt_a]: 1.292e-05 [rewriter_after_opt_a]: 3.512e-05 [convert_after_rewriter]: 5.88002e-06 [order_py_execute_after_rewriter]: 4.40999e-06 [mutable_eliminate]: 0.00074043 [jit_opt_b]: 4.13e-05, [1] [Cycle 1]: 3.34e-05, [2] [frontend_op_eliminate]: 1.009e-05 [inline_after_opt_a]: 1.135e-05 [cconv]: 2.731e-05 [loop_unroll]: 0.00044971 [jit_opt_after_cconv]: 0.00013483, [1] [Cycle 1]: 0.0001281, [11] [c_1]: 1.193e-05 [parameter_eliminate]: 3.86001e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 1.55999e-06 [cse]: 2.253e-05 [call_graph_tuple_transform]: 1.55e-05 [tuple_list_get_item_eliminator]: 3.74002e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 4.08999e-06 [remove_dup_value]: 1.446e-05 [partial_unused_args_eliminate]: 2.83003e-06 [environ_conv]: 5.24e-06 [add_recomputation]: 3.875e-05 [cse_after_recomputation]: 1.997e-05, [1] [Cycle 1]: 1.496e-05, [1] [cse]: 8.64e-06 [auto_monad_reorder]: 1.335e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 7.00002e-06 [opt_after_jit_grad]: 0.00045028 [symbol_engine_optimizer]: 6.645e-05, [1] [Cycle 1]: 6e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 5.77001e-06 [elim_not_effective]: 9.87001e-06 [opt_reshape]: 3.93999e-06 [fold_const_symbol]: 5.84e-06 [renormalize]: 5.90022e-07 [validate]: 3.652e-05 Sums bootstrap : 0.000258s : 0.87% type_inference : 0.010966s : 37.05% event_method : 0.000052s : 0.18% auto_monad : 0.000095s : 0.32% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000030s : 0.10% rewriter_before_opt_a : 0.000113s : 0.38% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000123s : 0.42% jit_opt_a.loop_unroll : 0.000083s : 0.28% jit_opt_a.a_1 : 0.002036s : 6.88% jit_opt_a.with_stream_mark : 0.000065s : 0.22% jit_opt_a.recompute_prepare : 0.000035s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000006s : 0.02% jit_opt_a.specialize_transform : 0.000025s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.08% jit_opt_a.accelerated_algorithm : 0.000023s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.07% jit_opt_a.merge_forward : 0.000017s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.13% jit_opt_a.meta_fg_expand : 0.002142s : 7.24% jit_opt_a.replace_old_param : 0.000091s : 0.31% jit_opt_a.inline_without_move : 0.000076s : 0.26% jit_opt_a.renormalize : 0.010682s : 36.09% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.07% jit_opt_a.auto_monad_grad : 0.000009s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000077s : 0.26% jit_opt_a.cse : 0.000279s : 0.94% jit_opt_a.replace_applicator : 0.000109s : 0.37% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000035s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000740s : 2.50% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.04% cconv : 0.000027s : 0.09% loop_unroll : 0.000450s : 1.52% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000014s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000039s : 0.13% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000013s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000450s : 1.52% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.12% Time group info: ------[substitution.] 0.000559 101 0.25% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.82% : 0.000005s : 1: substitution.graph_param_transform 62.63% : 0.000350s : 12: substitution.inline 4.57% : 0.000026s : 2: substitution.inline_without_move 1.69% : 0.000009s : 11: substitution.j_node_and_user_rematch 2.14% : 0.000012s : 7: substitution.minmaximum_grad 1.48% : 0.000008s : 5: substitution.partial_eliminate 1.79% : 0.000010s : 11: substitution.remove_not_recompute_node 6.16% : 0.000034s : 10: substitution.replace_applicator 1.46% : 0.000008s : 10: substitution.replace_old_param 0.54% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.19% : 0.000007s : 1: substitution.tile_eliminate 4.16% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.85% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.10% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010880 2 87.10% : 0.009477s : 1: type_inference.infer 12.90% : 0.001403s : 1: type_inference.specialize ------[replace.] 0.000169 19 64.43% : 0.000109s : 12: replace.inline 35.57% : 0.000060s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000365 19 93.89% : 0.000343s : 12: match.inline 6.11% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000352 2324 1.65% : 0.000006s : 40: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.37% : 0.000005s : 40: predicate.addn_check_dump 1.66% : 0.000006s : 40: predicate.addn_zero_filter 1.96% : 0.000007s : 40: predicate.arithmetic_simplify 1.64% : 0.000006s : 40: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 40: predicate.compare_switch_simplify 1.70% : 0.000006s : 40: predicate.depend_value_elim 1.43% : 0.000005s : 40: predicate.dict_get_item_const_eliminator 1.52% : 0.000005s : 40: predicate.dict_get_item_eliminator 1.48% : 0.000005s : 40: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000005s : 40: predicate.environ_add_const_eliminate 1.45% : 0.000005s : 40: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 40: predicate.environ_get_depend_swap 1.57% : 0.000006s : 40: predicate.environ_get_eliminate 1.53% : 0.000005s : 40: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000003s : 15: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.37% : 0.000015s : 61: predicate.inline 2.27% : 0.000008s : 43: predicate.inline_without_move 0.33% : 0.000001s : 15: predicate.j_node_and_user_rematch 0.87% : 0.000003s : 15: predicate.less_batch_normalization 1.79% : 0.000006s : 47: predicate.list_to_tuple_eliminator_ 1.84% : 0.000006s : 48: predicate.load_eliminater 0.27% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.44% : 0.000012s : 83: predicate.loop_unroll_before_grad 1.62% : 0.000006s : 41: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 40: predicate.merge_addn 1.51% : 0.000005s : 40: predicate.minmaximum_grad 0.47% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.27% : 0.000008s : 48: predicate.partial_eliminate 1.48% : 0.000005s : 40: predicate.print_const_string_wrapper 2.21% : 0.000008s : 40: predicate.reduce_eliminate 1.76% : 0.000006s : 47: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 15: predicate.remove_not_recompute_node 2.71% : 0.000010s : 88: predicate.replace_applicator 1.24% : 0.000004s : 43: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 40: predicate.reshape_eliminate 1.52% : 0.000005s : 40: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.46% : 0.000005s : 40: predicate.same_eliminate 0.43% : 0.000002s : 15: predicate.set_cell_output_no_recompute 0.27% : 0.000001s : 2: predicate.special_op_eliminate 0.91% : 0.000003s : 15: predicate.specialize_transform 1.71% : 0.000006s : 40: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000006s : 40: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.93% : 0.000010s : 59: predicate.switch_defer_inline 2.60% : 0.000009s : 59: predicate.switch_layer_defer_inline 6.79% : 0.000024s : 143: predicate.switch_simplify 1.57% : 0.000006s : 40: predicate.tile_eliminate 1.55% : 0.000005s : 40: predicate.transpose_eliminate 1.84% : 0.000006s : 40: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000006s : 40: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000012s : 49: predicate.tuple_list_get_item_eliminator 1.85% : 0.000006s : 40: predicate.tuple_list_set_item_eliminator 1.83% : 0.000006s : 47: predicate.tuple_to_list_eliminator_ 1.80% : 0.000006s : 48: predicate.updatestate_pure_node_eliminater 2.78% : 0.000010s : 63: predicate.updatestate_useless_node_eliminater 1.76% : 0.000006s : 40: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002225 34 64.78% : 0.001441s : 18: func_graph_cloner_run.FuncGraphClonerGraph 35.22% : 0.000784s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047531 87 0.09% : 0.000042s : 1: add_recomputation 0.21% : 0.000099s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.59% : 0.000283s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000022s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.12% : 0.000058s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 42.79% : 0.020339s : 1: jit_opt_a 0.29% : 0.000138s : 1: jit_opt_after_cconv 0.09% : 0.000044s : 1: jit_opt_b 0.96% : 0.000458s : 1: loop_unroll 1.58% : 0.000750s : 1: mutable_eliminate 5.65% : 0.002687s : 39: opt.transform.jit_opt_a 0.07% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000033s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 18.24% : 0.008671s : 2: renormalize.infer 4.19% : 0.001991s : 2: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000038s : 1: rewriter_after_opt_a 0.25% : 0.000116s : 1: rewriter_before_opt_a 0.14% : 0.000069s : 1: symbol_engine_optimizer 23.12% : 0.010988s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.627.877 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda001b160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.628.519 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0483872, [30] [bootstrap]: 0.00032422 [type_inference]: 0.0404747 [event_method]: 2.299e-05 [auto_monad]: 7.081e-05 [graph_reusing]: 5.35999e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 4.739e-05 [rewriter_before_opt_a]: 7.576e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.0053381, [2] [Cycle 1]: 0.00160395, [27] [switch_simplify]: 5.462e-05 [loop_unroll]: 2.866e-05 [a_1]: 0.00051475 [with_stream_mark]: 1.995e-05 [recompute_prepare]: 6.78998e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.80003e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.46002e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00066036 [add_forward_monad_depend]: 5.48997e-06 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 1.457e-05 [cse]: 3.543e-05 [replace_applicator]: 1.187e-05 [Cycle 2]: 0.00030909, [27] [switch_simplify]: 5.67001e-06 [loop_unroll]: 4.90999e-06 [a_1]: 8.64e-05 [with_stream_mark]: 9.07999e-06 [recompute_prepare]: 4.88001e-06 [updatestate_depend_eliminate]: 2.90002e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.24003e-06 [specialize_transform]: 4.75999e-06 [updatestate_useless_node_eliminater]: 4.73001e-06 [accelerated_algorithm]: 4.82e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.154e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.92002e-06 [inline_without_move]: 4.84998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.37001e-06 [cse]: 1.145e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.171e-05 [rewriter_after_opt_a]: 3.636e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00048625 [jit_opt_b]: 4.636e-05, [1] [Cycle 1]: 4.001e-05, [2] [frontend_op_eliminate]: 1.422e-05 [inline_after_opt_a]: 1.499e-05 [cconv]: 2.534e-05 [loop_unroll]: 0.00038317 [jit_opt_after_cconv]: 0.00016, [1] [Cycle 1]: 0.0001538, [11] [c_1]: 3.527e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2e-05 [call_graph_tuple_transform]: 2.351e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.51002e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 6.41998e-06 [add_recomputation]: 4.915e-05 [cse_after_recomputation]: 2.213e-05, [1] [Cycle 1]: 1.698e-05, [1] [cse]: 1.163e-05 [auto_monad_reorder]: 1.828e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 5.42999e-06 [opt_after_jit_grad]: 0.00045457 [symbol_engine_optimizer]: 7.335e-05, [1] [Cycle 1]: 6.687e-05, [6] [build]: 2.78e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.268e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 4.69998e-07 [validate]: 3.808e-05 Sums bootstrap : 0.000324s : 0.73% type_inference : 0.040475s : 91.17% event_method : 0.000023s : 0.05% auto_monad : 0.000071s : 0.16% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000047s : 0.11% rewriter_before_opt_a : 0.000076s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.14% jit_opt_a.loop_unroll : 0.000034s : 0.08% jit_opt_a.a_1 : 0.000601s : 1.35% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000012s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000010s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000015s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000660s : 1.49% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000047s : 0.11% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000036s : 0.08% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000486s : 1.10% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.03% jit_opt_b.inline_after_opt_a : 0.000015s : 0.03% cconv : 0.000025s : 0.06% loop_unroll : 0.000383s : 0.86% jit_opt_after_cconv.c_1 : 0.000035s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000455s : 1.02% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.09% Time group info: ------[substitution.] 0.000201 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 3: substitution.graph_param_transform 83.98% : 0.000169s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 6.10% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040396 2 9.17% : 0.003705s : 1: type_inference.infer 90.83% : 0.036691s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.11% : 0.000043s : 4: replace.inline 32.89% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 93.74% : 0.000167s : 4: match.inline 6.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 1.50% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.08% : 0.000001s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 17.18% : 0.000021s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.26% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.61% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.69% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.85% : 0.000008s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.15% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.26% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.036176 13 0.85% : 0.000309s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.10% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 99.04% : 0.035830s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049926 72 0.10% : 0.000052s : 1: add_recomputation 0.15% : 0.000074s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.68% : 0.000341s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.70% : 0.005341s : 1: jit_opt_a 0.33% : 0.000163s : 1: jit_opt_after_cconv 0.10% : 0.000049s : 1: jit_opt_b 0.78% : 0.000391s : 1: loop_unroll 0.99% : 0.000494s : 1: mutable_eliminate 1.61% : 0.000806s : 26: opt.transform.jit_opt_a 0.13% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000024s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.93% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000050s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 0.76% : 0.000381s : 1: renormalize.infer 0.55% : 0.000272s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000039s : 1: rewriter_after_opt_a 0.16% : 0.000078s : 1: rewriter_before_opt_a 0.15% : 0.000076s : 1: symbol_engine_optimizer 81.12% : 0.040499s : 1: type_inference TotalTime = 0.0914699, [30] [bootstrap]: 0.00030925 [type_inference]: 0.0452746 [event_method]: 2.25e-05 [auto_monad]: 6.899e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.0001519 [rewriter_before_opt_a]: 8.527e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.0429308, [2] [Cycle 1]: 0.0388139, [27] [switch_simplify]: 7.051e-05 [loop_unroll]: 3.038e-05 [a_1]: 0.00063606 [with_stream_mark]: 2.323e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 9.23002e-06 [specialize_transform]: 4.581e-05 [updatestate_useless_node_eliminater]: 9.70002e-06 [accelerated_algorithm]: 9.50001e-06 [meta_shard_fg_expand]: 6.46e-06 [get_grad_eliminate_]: 8.75001e-06 [merge_forward]: 1.47e-05 [cell_reuse_recompute_pass]: 3.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.89e-05 [j_node_and_user_rematch]: 1.243e-05 [meta_fg_expand]: 4.28001e-06 [replace_old_param]: 1.447e-05 [inline_without_move]: 7.03e-06 [renormalize]: 0.00175045 [add_forward_monad_depend]: 9.23002e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 2.041e-05 [cse]: 3.677e-05 [replace_applicator]: 1.877e-05 [Cycle 2]: 0.00036009, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00010515 [with_stream_mark]: 1.562e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.734e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 7.66999e-06 [cse]: 1.31e-05 [replace_applicator]: 5.83997e-06 [py_interpret_to_execute_after_opt_a]: 1.629e-05 [rewriter_after_opt_a]: 3.973e-05 [convert_after_rewriter]: 7.52002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.0008415 [jit_opt_b]: 5.636e-05, [1] [Cycle 1]: 4.802e-05, [2] [frontend_op_eliminate]: 1.983e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 3.077e-05 [loop_unroll]: 0.00044912 [jit_opt_after_cconv]: 0.00016113, [1] [Cycle 1]: 0.00015447, [11] [c_1]: 2.288e-05 [parameter_eliminate]: 3.20002e-06 [updatestate_depend_eliminate]: 9.22999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.866e-05 [call_graph_tuple_transform]: 2.124e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.654e-05 [partial_unused_args_eliminate]: 3.03998e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 5.147e-05 [cse_after_recomputation]: 2.498e-05, [1] [Cycle 1]: 1.896e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.708e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 7.38e-06 [opt_after_jit_grad]: 0.00049703 [symbol_engine_optimizer]: 7.977e-05, [1] [Cycle 1]: 7.288e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 8.72e-06 [elim_not_effective]: 1.549e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 1.027e-05 [renormalize]: 5.3001e-07 [validate]: 4.828e-05 Sums bootstrap : 0.000309s : 0.60% type_inference : 0.045275s : 88.42% event_method : 0.000022s : 0.04% auto_monad : 0.000069s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000152s : 0.30% rewriter_before_opt_a : 0.000085s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.15% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000741s : 1.45% jit_opt_a.with_stream_mark : 0.000039s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000011s : 0.02% jit_opt_a.specialize_transform : 0.000051s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.03% jit_opt_a.accelerated_algorithm : 0.000015s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.03% jit_opt_a.merge_forward : 0.000019s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001751s : 3.42% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.05% jit_opt_a.cse : 0.000050s : 0.10% jit_opt_a.replace_applicator : 0.000025s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000040s : 0.08% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000841s : 1.64% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000031s : 0.06% loop_unroll : 0.000449s : 0.88% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000497s : 0.97% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.09% Time group info: ------[substitution.] 0.000266 23 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 83.98% : 0.000223s : 4: substitution.inline 1.81% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 3.01% : 0.000008s : 2: substitution.replace_old_param 5.14% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045189 2 94.91% : 0.042891s : 1: type_inference.infer 5.09% : 0.002298s : 1: type_inference.specialize ------[replace.] 0.000096 6 66.31% : 0.000064s : 4: replace.inline 33.69% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 6 94.67% : 0.000220s : 4: match.inline 5.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.10% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 0.98% : 0.000001s : 10: predicate.addn_zero_filter 2.23% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000002s : 10: predicate.environ_get_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000002s : 6: predicate.get_grad_eliminate 0.61% : 0.000001s : 3: predicate.graph_param_transform 5.18% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 2.20% : 0.000003s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.47% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.91% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 1.91% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000002s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.58% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 4.43% : 0.000006s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000010s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000002s : 10: predicate.transpose_eliminate 1.12% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.86% : 0.000005s : 21: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001198 13 42.69% : 0.000512s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.44% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.87% : 0.000634s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.094321 72 0.06% : 0.000055s : 1: add_recomputation 0.08% : 0.000073s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.35% : 0.000328s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.06% : 0.000061s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 45.52% : 0.042936s : 1: jit_opt_a 0.17% : 0.000164s : 1: jit_opt_after_cconv 0.06% : 0.000059s : 1: jit_opt_b 0.49% : 0.000458s : 1: loop_unroll 0.90% : 0.000852s : 1: mutable_eliminate 1.11% : 0.001048s : 26: opt.transform.jit_opt_a 0.06% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000506s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000156s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.12% : 0.001053s : 1: renormalize.infer 0.73% : 0.000684s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000089s : 1: rewriter_before_opt_a 0.09% : 0.000082s : 1: symbol_engine_optimizer 48.02% : 0.045296s : 1: type_inference TotalTime = 0.582562, [30] [bootstrap]: 0.00036199 [type_inference]: 0.490458 [event_method]: 2.419e-05 [auto_monad]: 7.544e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 0.00054945 [rewriter_before_opt_a]: 0.00010467 [expand_dump_flag]: 3.85e-06 [jit_opt_a]: 0.00783541, [2] [Cycle 1]: 0.00410385, [27] [switch_simplify]: 5.89e-05 [loop_unroll]: 3.464e-05 [a_1]: 0.00068386 [with_stream_mark]: 1.781e-05 [recompute_prepare]: 8.70001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.46001e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00296291 [add_forward_monad_depend]: 5.89e-06 [auto_monad_grad]: 2.12001e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 3.586e-05 [replace_applicator]: 1.513e-05 [Cycle 2]: 0.00037764, [27] [switch_simplify]: 7.11999e-06 [loop_unroll]: 6.58998e-06 [a_1]: 0.00013245 [with_stream_mark]: 1.191e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 2.75997e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.164e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.324e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.056e-05 [rewriter_after_opt_a]: 3.63e-05 [convert_after_rewriter]: 7.45003e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00055277 [jit_opt_b]: 5.578e-05, [1] [Cycle 1]: 4.873e-05, [2] [frontend_op_eliminate]: 1.936e-05 [inline_after_opt_a]: 1.84e-05 [cconv]: 2.568e-05 [loop_unroll]: 0.000402 [jit_opt_after_cconv]: 0.00014883, [1] [Cycle 1]: 0.00014283, [11] [c_1]: 2.654e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.006e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.13998e-06 [remove_dup_value]: 1.67e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 8.06001e-06 [add_recomputation]: 0.080112 [cse_after_recomputation]: 0.00012717, [1] [Cycle 1]: 0.00011159, [1] [cse]: 7.978e-05 [auto_monad_reorder]: 3.339e-05 [get_jit_bprop_graph]: 4.82998e-06 [rewriter_after_jit_bprop_graph]: 1.261e-05 [opt_after_jit_grad]: 0.0009687 [symbol_engine_optimizer]: 9.692e-05, [1] [Cycle 1]: 9.055e-05, [6] [build]: 6.54001e-06 [elim_shapecalc]: 1.182e-05 [elim_not_effective]: 2.308e-05 [opt_reshape]: 7.38999e-06 [fold_const_symbol]: 1.184e-05 [renormalize]: 1.05999e-06 [validate]: 0.00026267 Sums bootstrap : 0.000362s : 0.06% type_inference : 0.490458s : 84.78% event_method : 0.000024s : 0.00% auto_monad : 0.000075s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000549s : 0.09% rewriter_before_opt_a : 0.000105s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000816s : 0.14% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002963s : 0.51% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.00% jit_opt_a.cse : 0.000049s : 0.01% jit_opt_a.replace_applicator : 0.000021s : 0.00% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000036s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000553s : 0.10% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000026s : 0.00% loop_unroll : 0.000402s : 0.07% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.080112s : 13.85% cse_after_recomputation.cse : 0.000080s : 0.01% auto_monad_reorder : 0.000033s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000013s : 0.00% opt_after_jit_grad : 0.000969s : 0.17% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000263s : 0.05% Time group info: ------[substitution.] 0.000257 28 1.51% : 0.000004s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000005s : 4: substitution.graph_param_transform 83.72% : 0.000215s : 5: substitution.inline 1.02% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.89% : 0.000010s : 3: substitution.reduce_eliminate 1.70% : 0.000004s : 4: substitution.remove_not_recompute_node 1.45% : 0.000004s : 2: substitution.replace_old_param 4.15% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.490369 2 99.19% : 0.486373s : 1: type_inference.infer 0.81% : 0.003995s : 1: type_inference.specialize ------[replace.] 0.000098 7 68.26% : 0.000067s : 5: replace.inline 31.74% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 7 95.68% : 0.000212s : 5: match.inline 4.32% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.72% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 2.13% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.52% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.65% : 0.000001s : 4: predicate.elim_not_effective 0.77% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.10% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.23% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.51% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.59% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007634 25 86.69% : 0.006617s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.85% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 12.46% : 0.000951s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.586430 72 13.67% : 0.080144s : 1: add_recomputation 0.01% : 0.000079s : 1: auto_monad 0.01% : 0.000036s : 1: auto_monad_reorder 0.07% : 0.000383s : 1: bootstrap 0.00% : 0.000028s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000133s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 1.34% : 0.007838s : 1: jit_opt_a 0.03% : 0.000151s : 1: jit_opt_after_cconv 0.01% : 0.000058s : 1: jit_opt_b 0.07% : 0.000408s : 1: loop_unroll 0.10% : 0.000560s : 1: mutable_eliminate 0.18% : 0.001057s : 26: opt.transform.jit_opt_a 0.01% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000043s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000976s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000556s : 1: py_interpret_to_execute 0.00% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.36% : 0.002134s : 1: renormalize.infer 0.14% : 0.000820s : 1: renormalize.specialize 0.00% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000039s : 1: rewriter_after_opt_a 0.02% : 0.000109s : 1: rewriter_before_opt_a 0.02% : 0.000099s : 1: symbol_engine_optimizer 83.64% : 0.490475s : 1: type_inference TotalTime = 0.127915, [30] [bootstrap]: 0.00029948 [type_inference]: 0.115884 [event_method]: 2.377e-05 [auto_monad]: 8.013e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 3.18998e-06 [py_interpret_to_execute]: 0.00048299 [rewriter_before_opt_a]: 9.911e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00845028, [2] [Cycle 1]: 0.00416154, [27] [switch_simplify]: 6.737e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00064299 [with_stream_mark]: 2.461e-05 [recompute_prepare]: 8.18001e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.37001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.60002e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00301344 [add_forward_monad_depend]: 7.92e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.879e-05 [cse]: 3.273e-05 [replace_applicator]: 2.119e-05 [Cycle 2]: 0.00037096, [27] [switch_simplify]: 6.69001e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00012206 [with_stream_mark]: 1.3e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.53003e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.63997e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 2.22001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.658e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7e-06 [cse]: 1.095e-05 [replace_applicator]: 5.56998e-06 [py_interpret_to_execute_after_opt_a]: 1.558e-05 [rewriter_after_opt_a]: 3.692e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.0007393 [jit_opt_b]: 5.374e-05, [1] [Cycle 1]: 4.626e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 1.734e-05 [cconv]: 2.841e-05 [loop_unroll]: 0.00042777 [jit_opt_after_cconv]: 0.00015708, [1] [Cycle 1]: 0.00015115, [11] [c_1]: 2.594e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 7.13e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.595e-05 [call_graph_tuple_transform]: 2.072e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.32999e-06 [renormalize]: 6.90023e-07 [switch_simplify]: 6.51e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 8.52e-06 [add_recomputation]: 5.09e-05 [cse_after_recomputation]: 6.637e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.191e-05 [auto_monad_reorder]: 1.568e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 6.49999e-06 [opt_after_jit_grad]: 0.0006213 [symbol_engine_optimizer]: 7.926e-05, [1] [Cycle 1]: 7.305e-05, [6] [build]: 3.36999e-06 [elim_shapecalc]: 9.25001e-06 [elim_not_effective]: 1.499e-05 [opt_reshape]: 6.65998e-06 [fold_const_symbol]: 9.84001e-06 [renormalize]: 7.2e-07 [validate]: 4.572e-05 Sums bootstrap : 0.000299s : 0.24% type_inference : 0.115884s : 93.96% event_method : 0.000024s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000483s : 0.39% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000765s : 0.62% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003014s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000739s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000428s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000621s : 0.50% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000264 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.08% : 0.000006s : 4: substitution.graph_param_transform 85.42% : 0.000226s : 4: substitution.inline 1.70% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.46% : 0.000007s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115777 2 97.34% : 0.112697s : 1: type_inference.infer 2.66% : 0.003080s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.16% : 0.000054s : 4: replace.inline 32.84% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 95.10% : 0.000223s : 4: match.inline 4.90% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.42% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.46% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.99% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 18: predicate.partial_eliminate 1.43% : 0.000002s : 12: predicate.print_const_string_wrapper 1.51% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.92% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002373 22 66.90% : 0.001587s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.34% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.76% : 0.000730s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132015 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000084s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000313s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000069s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.40% : 0.008454s : 1: jit_opt_a 0.12% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.33% : 0.000436s : 1: loop_unroll 0.57% : 0.000749s : 1: mutable_eliminate 0.77% : 0.001017s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000631s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000491s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.67% : 0.002207s : 1: renormalize.infer 0.60% : 0.000795s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 87.80% : 0.115913s : 1: type_inference TotalTime = 0.139596, [30] [bootstrap]: 0.00023289 [type_inference]: 0.112134 [event_method]: 0.00069427 [auto_monad]: 0.00012407 [graph_reusing]: 8.81002e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 0.00010917 [rewriter_before_opt_a]: 0.0001358 [expand_dump_flag]: 4.13001e-06 [jit_opt_a]: 0.023869, [3] [Cycle 1]: 0.0166296, [27] [switch_simplify]: 8.16e-05 [loop_unroll]: 4.016e-05 [a_1]: 0.00094174 [with_stream_mark]: 3.779e-05 [recompute_prepare]: 1.966e-05 [updatestate_depend_eliminate]: 1.065e-05 [updatestate_assign_eliminate]: 7.16001e-06 [updatestate_loads_eliminate]: 6.73e-06 [parameter_eliminate]: 3.04001e-06 [specialize_transform]: 1.476e-05 [updatestate_useless_node_eliminater]: 1.331e-05 [accelerated_algorithm]: 1.455e-05 [meta_shard_fg_expand]: 3.65998e-06 [get_grad_eliminate_]: 1.435e-05 [merge_forward]: 8.59998e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.816e-05 [j_node_and_user_rematch]: 2.483e-05 [meta_fg_expand]: 0.0018946 [replace_old_param]: 7.127e-05 [inline_without_move]: 6.185e-05 [renormalize]: 0.0126417 [add_forward_monad_depend]: 1.307e-05 [auto_monad_grad]: 6.59001e-06 [auto_monad_eliminator]: 5.923e-05 [cse]: 0.00025094 [replace_applicator]: 9.308e-05 [Cycle 2]: 0.00297068, [27] [switch_simplify]: 4.292e-05 [loop_unroll]: 4.286e-05 [a_1]: 0.00111665 [with_stream_mark]: 1.897e-05 [recompute_prepare]: 7.96001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 5.31002e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 9.41003e-06 [meta_fg_expand]: 7.404e-05 [replace_old_param]: 6.53003e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 0.00135761 [add_forward_monad_depend]: 7.11001e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.394e-05 [cse]: 2.478e-05 [replace_applicator]: 1.397e-05 [Cycle 3]: 0.00024858, [27] [switch_simplify]: 4.00998e-06 [loop_unroll]: 3.91999e-06 [a_1]: 3.708e-05 [with_stream_mark]: 1.055e-05 [recompute_prepare]: 3.49001e-06 [updatestate_depend_eliminate]: 2.37001e-06 [updatestate_assign_eliminate]: 1.74e-06 [updatestate_loads_eliminate]: 1.66998e-06 [parameter_eliminate]: 1.54998e-06 [specialize_transform]: 3.46001e-06 [updatestate_useless_node_eliminater]: 3.23e-06 [accelerated_algorithm]: 3.26001e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 3.10002e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.145e-05 [j_node_and_user_rematch]: 6.16998e-06 [meta_fg_expand]: 1.15999e-06 [replace_old_param]: 2.91e-06 [inline_without_move]: 2.88e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.26002e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 3.9e-06 [cse]: 8.52998e-06 [replace_applicator]: 3.50998e-06 [py_interpret_to_execute_after_opt_a]: 1.303e-05 [rewriter_after_opt_a]: 3.745e-05 [convert_after_rewriter]: 6.41998e-06 [order_py_execute_after_rewriter]: 4.41002e-06 [mutable_eliminate]: 0.00073143 [jit_opt_b]: 4.715e-05, [1] [Cycle 1]: 3.939e-05, [2] [frontend_op_eliminate]: 1.66e-05 [inline_after_opt_a]: 1.101e-05 [cconv]: 2.693e-05 [loop_unroll]: 0.00041324 [jit_opt_after_cconv]: 0.00012584, [1] [Cycle 1]: 0.00011967, [11] [c_1]: 1.198e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 5.12999e-06 [updatestate_assign_eliminate]: 1.84e-06 [updatestate_loads_eliminate]: 1.60999e-06 [cse]: 1.977e-05 [call_graph_tuple_transform]: 1.416e-05 [tuple_list_get_item_eliminator]: 3.71999e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 3.5e-06 [remove_dup_value]: 1.53e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 5.20001e-06 [add_recomputation]: 3.419e-05 [cse_after_recomputation]: 1.804e-05, [1] [Cycle 1]: 1.318e-05, [1] [cse]: 7.06999e-06 [auto_monad_reorder]: 1.429e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.0004338 [symbol_engine_optimizer]: 6.732e-05, [1] [Cycle 1]: 6.05e-05, [6] [build]: 3.95998e-06 [elim_shapecalc]: 5.92999e-06 [elim_not_effective]: 1.056e-05 [opt_reshape]: 4.61002e-06 [fold_const_symbol]: 5.35999e-06 [renormalize]: 5.49975e-07 [validate]: 6.85e-05 Sums bootstrap : 0.000233s : 0.17% type_inference : 0.112134s : 83.26% event_method : 0.000694s : 0.52% auto_monad : 0.000124s : 0.09% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000109s : 0.08% rewriter_before_opt_a : 0.000136s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.10% jit_opt_a.loop_unroll : 0.000087s : 0.06% jit_opt_a.a_1 : 0.002095s : 1.56% jit_opt_a.with_stream_mark : 0.000067s : 0.05% jit_opt_a.recompute_prepare : 0.000031s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000011s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000024s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000015s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000054s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.03% jit_opt_a.meta_fg_expand : 0.001970s : 1.46% jit_opt_a.replace_old_param : 0.000081s : 0.06% jit_opt_a.inline_without_move : 0.000070s : 0.05% jit_opt_a.renormalize : 0.013999s : 10.39% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.02% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000077s : 0.06% jit_opt_a.cse : 0.000284s : 0.21% jit_opt_a.replace_applicator : 0.000111s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000731s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000413s : 0.31% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000434s : 0.32% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000005s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.05% Time group info: ------[substitution.] 0.000560 101 0.24% : 0.000001s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.88% : 0.000005s : 1: substitution.graph_param_transform 64.90% : 0.000363s : 12: substitution.inline 3.39% : 0.000019s : 2: substitution.inline_without_move 1.82% : 0.000010s : 11: substitution.j_node_and_user_rematch 2.19% : 0.000012s : 7: substitution.minmaximum_grad 1.40% : 0.000008s : 5: substitution.partial_eliminate 1.77% : 0.000010s : 11: substitution.remove_not_recompute_node 5.62% : 0.000031s : 10: substitution.replace_applicator 1.20% : 0.000007s : 10: substitution.replace_old_param 0.48% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.16% : 0.000006s : 1: substitution.tile_eliminate 4.21% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.78% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.80% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112022 2 97.30% : 0.108998s : 1: type_inference.infer 2.70% : 0.003024s : 1: type_inference.specialize ------[replace.] 0.000173 19 65.34% : 0.000113s : 12: replace.inline 34.66% : 0.000060s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000379 19 94.00% : 0.000356s : 12: match.inline 6.00% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000354 2432 1.48% : 0.000005s : 42: predicate.accumulaten_eliminater 0.22% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.39% : 0.000005s : 42: predicate.addn_check_dump 1.67% : 0.000006s : 42: predicate.addn_zero_filter 1.93% : 0.000007s : 42: predicate.arithmetic_simplify 1.58% : 0.000006s : 42: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.40% : 0.000005s : 42: predicate.compare_switch_simplify 1.47% : 0.000005s : 42: predicate.depend_value_elim 1.44% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.58% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.46% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.30% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.43% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.40% : 0.000005s : 42: predicate.environ_get_depend_swap 1.55% : 0.000005s : 42: predicate.environ_get_eliminate 1.39% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.88% : 0.000003s : 16: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.39% : 0.000016s : 63: predicate.inline 2.05% : 0.000007s : 44: predicate.inline_without_move 0.40% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.95% : 0.000003s : 16: predicate.less_batch_normalization 1.88% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.84% : 0.000007s : 50: predicate.load_eliminater 0.29% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.68% : 0.000013s : 87: predicate.loop_unroll_before_grad 1.74% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.69% : 0.000006s : 42: predicate.merge_addn 1.46% : 0.000005s : 42: predicate.minmaximum_grad 0.46% : 0.000002s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.38% : 0.000008s : 50: predicate.partial_eliminate 1.54% : 0.000005s : 42: predicate.print_const_string_wrapper 1.91% : 0.000007s : 42: predicate.reduce_eliminate 1.91% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 16: predicate.remove_not_recompute_node 3.01% : 0.000011s : 93: predicate.replace_applicator 1.17% : 0.000004s : 44: predicate.replace_old_param 0.04% : 0.000000s : 1: predicate.reset_defer_inline 1.82% : 0.000006s : 42: predicate.reshape_eliminate 1.69% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.66% : 0.000006s : 42: predicate.same_eliminate 0.43% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.24% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 16: predicate.specialize_transform 1.77% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000005s : 42: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.84% : 0.000010s : 61: predicate.switch_defer_inline 2.47% : 0.000009s : 61: predicate.switch_layer_defer_inline 6.66% : 0.000024s : 149: predicate.switch_simplify 1.56% : 0.000006s : 42: predicate.tile_eliminate 1.49% : 0.000005s : 42: predicate.transpose_eliminate 1.83% : 0.000006s : 42: predicate.tuple_list_convert_item_index_to_positive 1.78% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.84% : 0.000006s : 42: predicate.tuple_list_set_item_eliminator 1.91% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.90% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.74% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.80% : 0.000006s : 42: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003418 43 76.62% : 0.002619s : 27: func_graph_cloner_run.FuncGraphClonerGraph 23.38% : 0.000799s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.156300 87 0.02% : 0.000037s : 1: add_recomputation 0.08% : 0.000130s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.17% : 0.000260s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.45% : 0.000709s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 15.27% : 0.023872s : 1: jit_opt_a 0.08% : 0.000128s : 1: jit_opt_after_cconv 0.03% : 0.000050s : 1: jit_opt_b 0.27% : 0.000421s : 1: loop_unroll 0.47% : 0.000740s : 1: mutable_eliminate 1.75% : 0.002740s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000021s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000444s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000112s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 7.56% : 0.011823s : 2: renormalize.infer 1.38% : 0.002154s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000140s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 71.76% : 0.112158s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.777.959 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda004d9d0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.778.617 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0133566, [30] [bootstrap]: 0.00034116 [type_inference]: 0.00507341 [event_method]: 1.809e-05 [auto_monad]: 6.296e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 3.458e-05 [rewriter_before_opt_a]: 7.391e-05 [expand_dump_flag]: 3.13998e-06 [jit_opt_a]: 0.00563247, [2] [Cycle 1]: 0.0015668, [27] [switch_simplify]: 5.265e-05 [loop_unroll]: 3.026e-05 [a_1]: 0.00052289 [with_stream_mark]: 1.802e-05 [recompute_prepare]: 7.78001e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 8.68001e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00061719 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 2.07999e-06 [auto_monad_eliminator]: 1.423e-05 [cse]: 3.327e-05 [replace_applicator]: 1.215e-05 [Cycle 2]: 0.00031063, [27] [switch_simplify]: 5.91998e-06 [loop_unroll]: 5.56e-06 [a_1]: 8.763e-05 [with_stream_mark]: 8.35999e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 4.76002e-06 [updatestate_useless_node_eliminater]: 4.77998e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.47998e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.241e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.88e-06 [inline_without_move]: 4.72e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.31998e-06 [cse]: 1.098e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.12e-05 [rewriter_after_opt_a]: 3.45e-05 [convert_after_rewriter]: 6.41998e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00050394 [jit_opt_b]: 6.119e-05, [1] [Cycle 1]: 5.441e-05, [2] [frontend_op_eliminate]: 1.501e-05 [inline_after_opt_a]: 2.8e-05 [cconv]: 2.528e-05 [loop_unroll]: 0.00042546 [jit_opt_after_cconv]: 0.0001562, [1] [Cycle 1]: 0.00014924, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 6.14001e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 1.127e-05 [cse]: 2.264e-05 [call_graph_tuple_transform]: 1.869e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.841e-05 [partial_unused_args_eliminate]: 2.43002e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.15e-05 [cse_after_recomputation]: 2.377e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.191e-05 [auto_monad_reorder]: 1.82e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.00047185 [symbol_engine_optimizer]: 6.929e-05, [1] [Cycle 1]: 6.316e-05, [6] [build]: 3.07002e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.242e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 7.99002e-06 [renormalize]: 3.80009e-07 [validate]: 3.627e-05 Sums bootstrap : 0.000341s : 3.78% type_inference : 0.005073s : 56.19% event_method : 0.000018s : 0.20% auto_monad : 0.000063s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.38% rewriter_before_opt_a : 0.000074s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.40% jit_opt_a.a_1 : 0.000611s : 6.76% jit_opt_a.with_stream_mark : 0.000026s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000617s : 6.84% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000044s : 0.49% jit_opt_a.replace_applicator : 0.000018s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000035s : 0.38% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000504s : 5.58% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000028s : 0.31% cconv : 0.000025s : 0.28% loop_unroll : 0.000425s : 4.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000011s : 0.12% jit_opt_after_cconv.cse : 0.000023s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000018s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000052s : 0.57% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000472s : 5.23% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.40% Time group info: ------[substitution.] 0.000202 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000005s : 3: substitution.graph_param_transform 84.07% : 0.000170s : 4: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000004s : 2: substitution.replace_old_param 6.04% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005006 2 83.41% : 0.004176s : 1: type_inference.infer 16.59% : 0.000830s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.66% : 0.000045s : 4: replace.inline 33.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.77% : 0.000168s : 4: match.inline 6.23% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.50% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.69% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.83% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000616 13 53.93% : 0.000332s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.85% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.22% : 0.000248s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014859 72 0.37% : 0.000055s : 1: add_recomputation 0.45% : 0.000066s : 1: auto_monad 0.14% : 0.000021s : 1: auto_monad_reorder 2.45% : 0.000363s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.92% : 0.005635s : 1: jit_opt_a 1.07% : 0.000159s : 1: jit_opt_after_cconv 0.43% : 0.000064s : 1: jit_opt_b 2.92% : 0.000434s : 1: loop_unroll 3.44% : 0.000512s : 1: mutable_eliminate 5.51% : 0.000819s : 26: opt.transform.jit_opt_a 0.32% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.25% : 0.000037s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.23% : 0.000480s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000021s : 1: remove_dup_value 2.23% : 0.000332s : 1: renormalize.infer 1.87% : 0.000278s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000037s : 1: rewriter_after_opt_a 0.52% : 0.000077s : 1: rewriter_before_opt_a 0.48% : 0.000072s : 1: symbol_engine_optimizer 34.25% : 0.005090s : 1: type_inference TotalTime = 0.0655666, [30] [bootstrap]: 0.00035228 [type_inference]: 0.0548929 [event_method]: 2.335e-05 [auto_monad]: 7.234e-05 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 2.48002e-06 [py_interpret_to_execute]: 0.00015067 [rewriter_before_opt_a]: 8.543e-05 [expand_dump_flag]: 3.00998e-06 [jit_opt_a]: 0.00717923, [2] [Cycle 1]: 0.002768, [27] [switch_simplify]: 7.381e-05 [loop_unroll]: 3.135e-05 [a_1]: 0.00067878 [with_stream_mark]: 2.522e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 3.09001e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.76e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 5.89e-06 [renormalize]: 0.00157958 [add_forward_monad_depend]: 6.30002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.606e-05 [cse]: 3.656e-05 [replace_applicator]: 1.422e-05 [Cycle 2]: 0.00045524, [27] [switch_simplify]: 5.75001e-06 [loop_unroll]: 5.63002e-06 [a_1]: 9.448e-05 [with_stream_mark]: 1.097e-05 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 3.15998e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 2.68003e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00011241 [j_node_and_user_rematch]: 1.185e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 8.44998e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.59001e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 8.40001e-06 [cse]: 1.877e-05 [replace_applicator]: 5.58002e-06 [py_interpret_to_execute_after_opt_a]: 1.378e-05 [rewriter_after_opt_a]: 4.128e-05 [convert_after_rewriter]: 6.97002e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00078662 [jit_opt_b]: 6.225e-05, [1] [Cycle 1]: 5.212e-05, [2] [frontend_op_eliminate]: 1.876e-05 [inline_after_opt_a]: 2.069e-05 [cconv]: 3.52e-05 [loop_unroll]: 0.00052881 [jit_opt_after_cconv]: 0.00018498, [1] [Cycle 1]: 0.00017724, [11] [c_1]: 2.383e-05 [parameter_eliminate]: 5.94999e-06 [updatestate_depend_eliminate]: 1.057e-05 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 3.777e-05 [call_graph_tuple_transform]: 2.539e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 2.023e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 7.35e-06 [add_recomputation]: 5.682e-05 [cse_after_recomputation]: 2.73e-05, [1] [Cycle 1]: 2.052e-05, [1] [cse]: 1.323e-05 [auto_monad_reorder]: 1.87e-05 [get_jit_bprop_graph]: 2.73998e-06 [rewriter_after_jit_bprop_graph]: 9.14e-06 [opt_after_jit_grad]: 0.00058515 [symbol_engine_optimizer]: 8.98e-05, [1] [Cycle 1]: 8.201e-05, [6] [build]: 4.83001e-06 [elim_shapecalc]: 1.01e-05 [elim_not_effective]: 1.755e-05 [opt_reshape]: 7.42002e-06 [fold_const_symbol]: 1.134e-05 [renormalize]: 9.50007e-07 [validate]: 4.923e-05 Sums bootstrap : 0.000352s : 0.58% type_inference : 0.054893s : 90.15% event_method : 0.000023s : 0.04% auto_monad : 0.000072s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000151s : 0.25% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.13% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000773s : 1.27% jit_opt_a.with_stream_mark : 0.000036s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000130s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001580s : 2.59% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000055s : 0.09% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000787s : 1.29% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000035s : 0.06% loop_unroll : 0.000529s : 0.87% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000057s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000585s : 0.96% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.08% Time group info: ------[substitution.] 0.000390 23 0.82% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.66% : 0.000006s : 3: substitution.graph_param_transform 65.40% : 0.000255s : 4: substitution.inline 0.97% : 0.000004s : 4: substitution.j_node_and_user_rematch 25.65% : 0.000100s : 4: substitution.remove_not_recompute_node 1.62% : 0.000006s : 2: substitution.replace_old_param 3.33% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054796 2 95.52% : 0.052339s : 1: type_inference.infer 4.48% : 0.002457s : 1: type_inference.specialize ------[replace.] 0.000102 6 68.53% : 0.000070s : 4: replace.inline 31.47% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 6 95.50% : 0.000253s : 4: match.inline 4.50% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.49% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 2.63% : 0.000003s : 10: predicate.arithmetic_simplify 1.27% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.42% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.26% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.78% : 0.000001s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 10: predicate.environ_get_depend_swap 1.01% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.00% : 0.000008s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.82% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000002s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 15: predicate.partial_eliminate 1.02% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.08% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001144 13 41.21% : 0.000472s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.19% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.60% : 0.000613s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068281 72 0.09% : 0.000060s : 1: add_recomputation 0.11% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.55% : 0.000374s : 1: bootstrap 0.06% : 0.000038s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.52% : 0.007184s : 1: jit_opt_a 0.28% : 0.000188s : 1: jit_opt_after_cconv 0.10% : 0.000065s : 1: jit_opt_b 0.79% : 0.000538s : 1: loop_unroll 1.17% : 0.000799s : 1: mutable_eliminate 1.64% : 0.001117s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000597s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000155s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 1.42% : 0.000969s : 1: renormalize.infer 0.88% : 0.000601s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.14% : 0.000094s : 1: symbol_engine_optimizer 80.43% : 0.054917s : 1: type_inference TotalTime = 0.13709, [30] [bootstrap]: 0.00022076 [type_inference]: 0.111396 [event_method]: 0.00042045 [auto_monad]: 0.00010439 [graph_reusing]: 7.61999e-06 [pre_auto_parallel]: 2.98998e-06 [py_interpret_to_execute]: 5.06e-05 [rewriter_before_opt_a]: 0.00011594 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.0225178, [3] [Cycle 1]: 0.0155956, [27] [switch_simplify]: 6.976e-05 [loop_unroll]: 4.079e-05 [a_1]: 0.00086334 [with_stream_mark]: 3.136e-05 [recompute_prepare]: 2.003e-05 [updatestate_depend_eliminate]: 9.02999e-06 [updatestate_assign_eliminate]: 7.26001e-06 [updatestate_loads_eliminate]: 6.59999e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 1.446e-05 [updatestate_useless_node_eliminater]: 1.391e-05 [accelerated_algorithm]: 1.37e-05 [meta_shard_fg_expand]: 3.73999e-06 [get_grad_eliminate_]: 1.352e-05 [merge_forward]: 8.90999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.735e-05 [j_node_and_user_rematch]: 2.443e-05 [meta_fg_expand]: 0.0017197 [replace_old_param]: 6.817e-05 [inline_without_move]: 6.007e-05 [renormalize]: 0.0119138 [add_forward_monad_depend]: 1.217e-05 [auto_monad_grad]: 6.67002e-06 [auto_monad_eliminator]: 5.993e-05 [cse]: 0.00024649 [replace_applicator]: 9.075e-05 [Cycle 2]: 0.00325701, [27] [switch_simplify]: 4.407e-05 [loop_unroll]: 4.198e-05 [a_1]: 0.00115184 [with_stream_mark]: 1.664e-05 [recompute_prepare]: 8.58001e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.57997e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 7.80998e-06 [accelerated_algorithm]: 7.06001e-06 [meta_shard_fg_expand]: 2.86e-06 [get_grad_eliminate_]: 6.75002e-06 [merge_forward]: 5.17e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.828e-05 [j_node_and_user_rematch]: 1.218e-05 [meta_fg_expand]: 6.852e-05 [replace_old_param]: 7.61001e-06 [inline_without_move]: 6.83e-06 [renormalize]: 0.00160552 [add_forward_monad_depend]: 5.91998e-06 [auto_monad_grad]: 1.80001e-06 [auto_monad_eliminator]: 1.14e-05 [cse]: 2.251e-05 [replace_applicator]: 1.301e-05 [Cycle 3]: 0.00025984, [27] [switch_simplify]: 4.65001e-06 [loop_unroll]: 3.75e-06 [a_1]: 4.18e-05 [with_stream_mark]: 9.15999e-06 [recompute_prepare]: 3.76999e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 1.69998e-06 [updatestate_loads_eliminate]: 1.72001e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 3.58999e-06 [updatestate_useless_node_eliminater]: 3.5e-06 [accelerated_algorithm]: 3.23e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 3.2e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.195e-05 [j_node_and_user_rematch]: 6.09999e-06 [meta_fg_expand]: 1.61998e-06 [replace_old_param]: 3.28998e-06 [inline_without_move]: 3.2e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 4.03999e-06 [cse]: 8.65999e-06 [replace_applicator]: 3.73001e-06 [py_interpret_to_execute_after_opt_a]: 1.261e-05 [rewriter_after_opt_a]: 3.694e-05 [convert_after_rewriter]: 8.08999e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00071021 [jit_opt_b]: 4.193e-05, [1] [Cycle 1]: 3.433e-05, [2] [frontend_op_eliminate]: 1.016e-05 [inline_after_opt_a]: 1.205e-05 [cconv]: 2.649e-05 [loop_unroll]: 0.00044157 [jit_opt_after_cconv]: 0.00012335, [1] [Cycle 1]: 0.00011712, [11] [c_1]: 1.151e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 1.79998e-06 [updatestate_loads_eliminate]: 1.67001e-06 [cse]: 1.809e-05 [call_graph_tuple_transform]: 1.41e-05 [tuple_list_get_item_eliminator]: 3.87998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 1.14e-06 [switch_simplify]: 3.55998e-06 [remove_dup_value]: 1.446e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 5.25999e-06 [add_recomputation]: 3.388e-05 [cse_after_recomputation]: 1.854e-05, [1] [Cycle 1]: 1.352e-05, [1] [cse]: 7.21999e-06 [auto_monad_reorder]: 1.286e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.27999e-06 [opt_after_jit_grad]: 0.0004448 [symbol_engine_optimizer]: 7.608e-05, [1] [Cycle 1]: 6.989e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 5.55001e-06 [elim_not_effective]: 9.22001e-06 [opt_reshape]: 4.48001e-06 [fold_const_symbol]: 5.79e-06 [renormalize]: 3.89991e-07 [validate]: 3.38e-05 Sums bootstrap : 0.000221s : 0.17% type_inference : 0.111396s : 83.87% event_method : 0.000420s : 0.32% auto_monad : 0.000104s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000051s : 0.04% rewriter_before_opt_a : 0.000116s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000118s : 0.09% jit_opt_a.loop_unroll : 0.000087s : 0.07% jit_opt_a.a_1 : 0.002057s : 1.55% jit_opt_a.with_stream_mark : 0.000057s : 0.04% jit_opt_a.recompute_prepare : 0.000032s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000024s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001790s : 1.35% jit_opt_a.replace_old_param : 0.000079s : 0.06% jit_opt_a.inline_without_move : 0.000070s : 0.05% jit_opt_a.renormalize : 0.013519s : 10.18% jit_opt_a.add_forward_monad_depend : 0.000019s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000075s : 0.06% jit_opt_a.cse : 0.000278s : 0.21% jit_opt_a.replace_applicator : 0.000107s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000710s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000442s : 0.33% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000445s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000009s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000510 104 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.89% : 0.000005s : 1: substitution.graph_param_transform 61.56% : 0.000314s : 12: substitution.inline 3.58% : 0.000018s : 2: substitution.inline_without_move 1.81% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.19% : 0.000011s : 7: substitution.minmaximum_grad 1.40% : 0.000007s : 5: substitution.partial_eliminate 2.01% : 0.000010s : 12: substitution.remove_not_recompute_node 5.93% : 0.000030s : 10: substitution.replace_applicator 1.22% : 0.000006s : 10: substitution.replace_old_param 1.44% : 0.000007s : 1: substitution.reshape_eliminate 0.56% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.43% : 0.000007s : 1: substitution.tile_eliminate 4.32% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.97% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 8.25% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111303 2 97.50% : 0.108516s : 1: type_inference.infer 2.50% : 0.002786s : 1: type_inference.specialize ------[replace.] 0.000162 19 63.71% : 0.000103s : 12: replace.inline 36.29% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000328 19 93.72% : 0.000307s : 12: match.inline 6.28% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000358 2544 1.52% : 0.000005s : 44: predicate.accumulaten_eliminater 0.28% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.44% : 0.000005s : 44: predicate.addn_check_dump 1.58% : 0.000006s : 44: predicate.addn_zero_filter 2.14% : 0.000008s : 44: predicate.arithmetic_simplify 1.66% : 0.000006s : 44: predicate.cast_eliminate 0.06% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000005s : 44: predicate.compare_switch_simplify 1.51% : 0.000005s : 44: predicate.depend_value_elim 1.45% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.61% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.48% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.58% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.44% : 0.000005s : 44: predicate.environ_get_depend_swap 1.46% : 0.000005s : 44: predicate.environ_get_eliminate 1.47% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.25% : 0.000015s : 65: predicate.inline 2.06% : 0.000007s : 46: predicate.inline_without_move 0.41% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.88% : 0.000003s : 18: predicate.less_batch_normalization 1.88% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 52: predicate.load_eliminater 0.27% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.39% : 0.000012s : 89: predicate.loop_unroll_before_grad 1.81% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.47% : 0.000005s : 44: predicate.merge_addn 1.54% : 0.000006s : 44: predicate.minmaximum_grad 0.46% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.52% : 0.000009s : 52: predicate.partial_eliminate 1.56% : 0.000006s : 44: predicate.print_const_string_wrapper 2.17% : 0.000008s : 44: predicate.reduce_eliminate 1.83% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000002s : 18: predicate.remove_not_recompute_node 2.93% : 0.000010s : 97: predicate.replace_applicator 1.20% : 0.000004s : 46: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.65% : 0.000006s : 44: predicate.reshape_eliminate 1.62% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.51% : 0.000005s : 44: predicate.same_eliminate 0.50% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.16% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 18: predicate.specialize_transform 1.78% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000010s : 63: predicate.switch_defer_inline 2.52% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.48% : 0.000023s : 153: predicate.switch_simplify 1.71% : 0.000006s : 44: predicate.tile_eliminate 1.49% : 0.000005s : 44: predicate.transpose_eliminate 1.89% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.18% : 0.000011s : 53: predicate.tuple_list_get_item_eliminator 1.85% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.80% : 0.000006s : 51: predicate.tuple_to_list_eliminator_ 1.82% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.77% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.10% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003330 43 76.58% : 0.002550s : 27: func_graph_cloner_run.FuncGraphClonerGraph 23.42% : 0.000780s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153309 87 0.02% : 0.000036s : 1: add_recomputation 0.07% : 0.000111s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.16% : 0.000245s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.28% : 0.000429s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 14.69% : 0.022521s : 1: jit_opt_a 0.08% : 0.000126s : 1: jit_opt_after_cconv 0.03% : 0.000045s : 1: jit_opt_b 0.29% : 0.000449s : 1: loop_unroll 0.47% : 0.000720s : 1: mutable_eliminate 1.76% : 0.002701s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000454s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000054s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.48% : 0.011468s : 2: renormalize.infer 1.33% : 0.002032s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000119s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 72.67% : 0.111416s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.925.506 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda01a1c10> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:43.926.132 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.267531, [30] [bootstrap]: 0.00027879 [type_inference]: 0.191488 [event_method]: 2.494e-05 [auto_monad]: 8.195e-05 [graph_reusing]: 5.97999e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.00054854 [rewriter_before_opt_a]: 0.00010518 [expand_dump_flag]: 3.78999e-06 [jit_opt_a]: 0.0719008, [2] [Cycle 1]: 0.0185328, [27] [switch_simplify]: 0.00012203 [loop_unroll]: 3.571e-05 [a_1]: 0.00245355 [with_stream_mark]: 2.664e-05 [recompute_prepare]: 1.072e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 8.27e-06 [updatestate_useless_node_eliminater]: 7.25e-06 [accelerated_algorithm]: 7.50998e-06 [meta_shard_fg_expand]: 3.86999e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 4.52998e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.289e-05 [j_node_and_user_rematch]: 2.498e-05 [meta_fg_expand]: 3.64002e-06 [replace_old_param]: 1.343e-05 [inline_without_move]: 6.86001e-06 [renormalize]: 0.0153959 [add_forward_monad_depend]: 8.60999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.384e-05 [cse]: 4.527e-05 [replace_applicator]: 2.272e-05 [Cycle 2]: 0.00045142, [27] [switch_simplify]: 7.87998e-06 [loop_unroll]: 6.89999e-06 [a_1]: 0.00013922 [with_stream_mark]: 1.735e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 6.16998e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.895e-05 [j_node_and_user_rematch]: 3.813e-05 [meta_fg_expand]: 2.73003e-06 [replace_old_param]: 1.078e-05 [inline_without_move]: 6.29001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.825e-05 [replace_applicator]: 6.59999e-06 [py_interpret_to_execute_after_opt_a]: 5.715e-05 [rewriter_after_opt_a]: 5.183e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00076088 [jit_opt_b]: 8.261e-05, [1] [Cycle 1]: 7.375e-05, [2] [frontend_op_eliminate]: 4.113e-05 [inline_after_opt_a]: 2.019e-05 [cconv]: 3.198e-05 [loop_unroll]: 0.00048045 [jit_opt_after_cconv]: 0.00033903, [1] [Cycle 1]: 0.00033178, [11] [c_1]: 2.938e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 8.57e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.63998e-06 [cse]: 0.00010147 [call_graph_tuple_transform]: 3.165e-05 [tuple_list_get_item_eliminator]: 7.5e-06 [none_parameter_eliminate]: 2.32999e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 7.15e-06 [remove_dup_value]: 2.246e-05 [partial_unused_args_eliminate]: 4.32e-06 [environ_conv]: 1.145e-05 [add_recomputation]: 6.794e-05 [cse_after_recomputation]: 3.145e-05, [1] [Cycle 1]: 2.466e-05, [1] [cse]: 1.809e-05 [auto_monad_reorder]: 1.911e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 6.10002e-06 [opt_after_jit_grad]: 0.00053941 [symbol_engine_optimizer]: 9.32e-05, [1] [Cycle 1]: 8.321e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 9.50001e-06 [elim_not_effective]: 2.021e-05 [opt_reshape]: 1.007e-05 [fold_const_symbol]: 1.01e-05 [renormalize]: 3.80009e-07 [validate]: 0.00025967 Sums bootstrap : 0.000279s : 0.13% type_inference : 0.191488s : 89.56% event_method : 0.000025s : 0.01% auto_monad : 0.000082s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000549s : 0.26% rewriter_before_opt_a : 0.000105s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.002593s : 1.21% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000052s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000063s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.015396s : 7.20% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000064s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000057s : 0.03% rewriter_after_opt_a : 0.000052s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000761s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000041s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000480s : 0.22% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000101s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000068s : 0.03% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000539s : 0.25% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000260s : 0.12% Time group info: ------[substitution.] 0.001804 25 0.11% : 0.000002s : 2: substitution.elim_not_effective 0.08% : 0.000001s : 2: substitution.fold_const_symbol 0.56% : 0.000010s : 4: substitution.graph_param_transform 94.92% : 0.001712s : 5: substitution.inline 1.71% : 0.000031s : 4: substitution.j_node_and_user_rematch 0.33% : 0.000006s : 4: substitution.remove_not_recompute_node 0.44% : 0.000008s : 2: substitution.replace_old_param 1.83% : 0.000033s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.191405 2 97.99% : 0.187566s : 1: type_inference.infer 2.01% : 0.003839s : 1: type_inference.specialize ------[replace.] 0.000224 7 65.25% : 0.000146s : 5: replace.inline 34.75% : 0.000078s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001739 7 98.20% : 0.001707s : 5: match.inline 1.80% : 0.000031s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000163 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 0.86% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.21% : 0.000004s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.21% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.81% : 0.000009s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 19: predicate.load_eliminater 0.98% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000003s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 1.43% : 0.000002s : 13: predicate.print_const_string_wrapper 2.71% : 0.000004s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.62% : 0.000003s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.08% : 0.000005s : 20: predicate.switch_defer_inline 1.87% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.24% : 0.000012s : 64: predicate.switch_simplify 1.49% : 0.000002s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.64% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.96% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003409 25 53.18% : 0.001813s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.00% : 0.000136s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.82% : 0.001459s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.285777 72 0.03% : 0.000073s : 1: add_recomputation 0.03% : 0.000085s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.10% : 0.000300s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000034s : 1: cse_after_recomputation 0.00% : 0.000014s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 25.16% : 0.071905s : 1: jit_opt_a 0.12% : 0.000342s : 1: jit_opt_after_cconv 0.03% : 0.000085s : 1: jit_opt_b 0.17% : 0.000489s : 1: loop_unroll 0.27% : 0.000771s : 1: mutable_eliminate 1.04% : 0.002970s : 26: opt.transform.jit_opt_a 0.02% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000054s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000549s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000555s : 1: py_interpret_to_execute 0.02% : 0.000062s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 4.87% : 0.013907s : 1: renormalize.infer 0.51% : 0.001471s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000055s : 1: rewriter_after_opt_a 0.04% : 0.000111s : 1: rewriter_before_opt_a 0.03% : 0.000096s : 1: symbol_engine_optimizer 67.01% : 0.191509s : 1: type_inference TotalTime = 0.0312041, [30] [bootstrap]: 0.00032312 [type_inference]: 0.00475667 [event_method]: 1.9e-05 [auto_monad]: 6.434e-05 [graph_reusing]: 6.04999e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 3.752e-05 [rewriter_before_opt_a]: 7.266e-05 [expand_dump_flag]: 3.40003e-06 [jit_opt_a]: 0.0217847, [2] [Cycle 1]: 0.0180925, [27] [switch_simplify]: 5.85e-05 [loop_unroll]: 2.962e-05 [a_1]: 0.0167902 [with_stream_mark]: 2.45e-05 [recompute_prepare]: 1.181e-05 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.91999e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.036e-05 [inline_without_move]: 5.22999e-06 [renormalize]: 0.00080521 [add_forward_monad_depend]: 6.14001e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 1.694e-05 [cse]: 3.46e-05 [replace_applicator]: 1.279e-05 [Cycle 2]: 0.00034157, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.682e-05 [with_stream_mark]: 1.111e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 4.91002e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.97999e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 1.86998e-06 [replace_old_param]: 7.77e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.43e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.673e-05 [rewriter_after_opt_a]: 4.161e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00074777 [jit_opt_b]: 5.903e-05, [1] [Cycle 1]: 4.962e-05, [2] [frontend_op_eliminate]: 1.975e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.881e-05 [loop_unroll]: 0.00045136 [jit_opt_after_cconv]: 0.00015296, [1] [Cycle 1]: 0.00014635, [11] [c_1]: 2.135e-05 [parameter_eliminate]: 2.91999e-06 [updatestate_depend_eliminate]: 6.49999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.807e-05 [call_graph_tuple_transform]: 1.928e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.694e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.73e-06 [add_recomputation]: 5.032e-05 [cse_after_recomputation]: 2.368e-05, [1] [Cycle 1]: 1.832e-05, [1] [cse]: 1.238e-05 [auto_monad_reorder]: 1.855e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 5.72001e-06 [opt_after_jit_grad]: 0.00216998 [symbol_engine_optimizer]: 9.738e-05, [1] [Cycle 1]: 8.927e-05, [6] [build]: 5.82001e-06 [elim_shapecalc]: 1.542e-05 [elim_not_effective]: 1.564e-05 [opt_reshape]: 6.02999e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 5.69999e-07 [validate]: 4.914e-05 Sums bootstrap : 0.000323s : 1.19% type_inference : 0.004757s : 17.48% event_method : 0.000019s : 0.07% auto_monad : 0.000064s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000038s : 0.14% rewriter_before_opt_a : 0.000073s : 0.27% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.016887s : 62.06% jit_opt_a.with_stream_mark : 0.000036s : 0.13% jit_opt_a.recompute_prepare : 0.000017s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000805s : 2.96% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000049s : 0.18% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000748s : 2.75% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000029s : 0.11% loop_unroll : 0.000451s : 1.66% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000050s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.002170s : 7.97% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000015s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.18% Time group info: ------[substitution.] 0.016365 23 0.01% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000002s : 2: substitution.fold_const_symbol 0.03% : 0.000006s : 3: substitution.graph_param_transform 99.75% : 0.016324s : 4: substitution.inline 0.02% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.04% : 0.000007s : 4: substitution.remove_not_recompute_node 0.04% : 0.000006s : 2: substitution.replace_old_param 0.09% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004693 2 82.16% : 0.003856s : 1: type_inference.infer 17.84% : 0.000837s : 1: type_inference.specialize ------[replace.] 0.000118 6 78.13% : 0.000092s : 4: replace.inline 21.87% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.016333 6 99.91% : 0.016319s : 4: match.inline 0.09% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.87% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.73% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000003s : 10: predicate.arithmetic_simplify 1.93% : 0.000003s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.14% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 1.45% : 0.000002s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 6.57% : 0.000009s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 15: predicate.load_eliminater 0.99% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.52% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 1.94% : 0.000003s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000002s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.16% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.88% : 0.000004s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.49% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.62% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.08% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.43% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.87% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000652 13 50.21% : 0.000327s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.59% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.20% : 0.000269s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049172 72 0.11% : 0.000053s : 1: add_recomputation 0.14% : 0.000067s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.69% : 0.000338s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 44.31% : 0.021789s : 1: jit_opt_a 0.32% : 0.000156s : 1: jit_opt_after_cconv 0.13% : 0.000062s : 1: jit_opt_b 0.93% : 0.000460s : 1: loop_unroll 1.54% : 0.000758s : 1: mutable_eliminate 34.80% : 0.017110s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000042s : 4: opt.transform.symbol_engine_opt 4.44% : 0.002185s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000040s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 0.89% : 0.000436s : 1: renormalize.infer 0.73% : 0.000360s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000075s : 1: rewriter_before_opt_a 0.20% : 0.000100s : 1: symbol_engine_optimizer 9.70% : 0.004772s : 1: type_inference TotalTime = 0.2144, [30] [bootstrap]: 0.00034999 [type_inference]: 0.203248 [event_method]: 2.015e-05 [auto_monad]: 6.843e-05 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.0004907 [rewriter_before_opt_a]: 8.014e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00777667, [2] [Cycle 1]: 0.00430199, [27] [switch_simplify]: 5.431e-05 [loop_unroll]: 3.08e-05 [a_1]: 0.00054485 [with_stream_mark]: 1.906e-05 [recompute_prepare]: 8.33999e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 6.48003e-06 [accelerated_algorithm]: 7.60998e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.84e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.66002e-06 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00329441 [add_forward_monad_depend]: 7.57998e-06 [auto_monad_grad]: 3.42002e-06 [auto_monad_eliminator]: 2.042e-05 [cse]: 3.457e-05 [replace_applicator]: 1.863e-05 [Cycle 2]: 0.0003711, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 6.17001e-06 [a_1]: 0.00012258 [with_stream_mark]: 1.27e-05 [recompute_prepare]: 6.56999e-06 [updatestate_depend_eliminate]: 3.90998e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.655e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.84999e-06 [cse]: 1.092e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.399e-05 [rewriter_after_opt_a]: 3.855e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 6.53e-06 [mutable_eliminate]: 0.00063431 [jit_opt_b]: 5.531e-05, [1] [Cycle 1]: 4.725e-05, [2] [frontend_op_eliminate]: 1.884e-05 [inline_after_opt_a]: 1.697e-05 [cconv]: 2.777e-05 [loop_unroll]: 0.00042831 [jit_opt_after_cconv]: 0.00015321, [1] [Cycle 1]: 0.00014695, [11] [c_1]: 2.482e-05 [parameter_eliminate]: 3.61001e-06 [updatestate_depend_eliminate]: 5.84999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 2.195e-05 [call_graph_tuple_transform]: 2.193e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 1.06002e-06 [switch_simplify]: 6.31998e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 7.71999e-06 [add_recomputation]: 5.283e-05 [cse_after_recomputation]: 2.206e-05, [1] [Cycle 1]: 1.668e-05, [1] [cse]: 1.069e-05 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 7.83001e-06 [opt_after_jit_grad]: 0.00045509 [symbol_engine_optimizer]: 0.00016147, [1] [Cycle 1]: 0.00015477, [6] [build]: 4.43001e-06 [elim_shapecalc]: 8.08001e-06 [elim_not_effective]: 1.505e-05 [opt_reshape]: 6.78998e-06 [fold_const_symbol]: 9.63002e-06 [renormalize]: 6.69999e-07 [validate]: 4.61e-05 Sums bootstrap : 0.000350s : 0.17% type_inference : 0.203248s : 96.50% event_method : 0.000020s : 0.01% auto_monad : 0.000068s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000491s : 0.23% rewriter_before_opt_a : 0.000080s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000667s : 0.32% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003294s : 1.56% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.000634s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000428s : 0.20% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000455s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.02% Time group info: ------[substitution.] 0.000195 24 1.52% : 0.000003s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000006s : 4: substitution.graph_param_transform 80.77% : 0.000158s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.81% : 0.000005s : 2: substitution.replace_old_param 6.41% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.203169 2 97.92% : 0.198941s : 1: type_inference.infer 2.08% : 0.004228s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.63% : 0.000047s : 4: replace.inline 32.37% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.16% : 0.000155s : 4: match.inline 6.84% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.25% : 0.000002s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.55% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000001s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.27% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002436 22 70.00% : 0.001705s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.21% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.80% : 0.000701s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.218653 72 0.03% : 0.000055s : 1: add_recomputation 0.03% : 0.000072s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.17% : 0.000370s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.56% : 0.007780s : 1: jit_opt_a 0.07% : 0.000156s : 1: jit_opt_after_cconv 0.03% : 0.000058s : 1: jit_opt_b 0.20% : 0.000437s : 1: loop_unroll 0.30% : 0.000652s : 1: mutable_eliminate 0.41% : 0.000904s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000464s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000496s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.15% : 0.002514s : 1: renormalize.infer 0.35% : 0.000770s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.04% : 0.000085s : 1: rewriter_before_opt_a 0.08% : 0.000164s : 1: symbol_engine_optimizer 92.96% : 0.203263s : 1: type_inference TotalTime = 0.14047, [30] [bootstrap]: 0.00024485 [type_inference]: 0.113323 [event_method]: 0.00044119 [auto_monad]: 9.872e-05 [graph_reusing]: 7.16001e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 4.471e-05 [rewriter_before_opt_a]: 0.00011364 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.0239585, [3] [Cycle 1]: 0.0172102, [27] [switch_simplify]: 6.989e-05 [loop_unroll]: 4.063e-05 [a_1]: 0.00086356 [with_stream_mark]: 3.027e-05 [recompute_prepare]: 2.033e-05 [updatestate_depend_eliminate]: 9.57999e-06 [updatestate_assign_eliminate]: 7.13e-06 [updatestate_loads_eliminate]: 6.75002e-06 [parameter_eliminate]: 2.78e-06 [specialize_transform]: 1.474e-05 [updatestate_useless_node_eliminater]: 1.333e-05 [accelerated_algorithm]: 1.353e-05 [meta_shard_fg_expand]: 3.61999e-06 [get_grad_eliminate_]: 1.357e-05 [merge_forward]: 8.70999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.797e-05 [j_node_and_user_rematch]: 2.447e-05 [meta_fg_expand]: 0.00168918 [replace_old_param]: 6.843e-05 [inline_without_move]: 6.054e-05 [renormalize]: 0.0135061 [add_forward_monad_depend]: 1.538e-05 [auto_monad_grad]: 7.86001e-06 [auto_monad_eliminator]: 6.204e-05 [cse]: 0.00026887 [replace_applicator]: 9.249e-05 [Cycle 2]: 0.00312494, [27] [switch_simplify]: 0.00010267 [loop_unroll]: 4.094e-05 [a_1]: 0.00112465 [with_stream_mark]: 1.883e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 3.94002e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.58999e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 7.658e-05 [replace_old_param]: 5.69999e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00145605 [add_forward_monad_depend]: 5.04998e-06 [auto_monad_grad]: 1.47001e-06 [auto_monad_eliminator]: 1.05e-05 [cse]: 2.115e-05 [replace_applicator]: 1.247e-05 [Cycle 3]: 0.00024281, [27] [switch_simplify]: 4.02e-06 [loop_unroll]: 3.95998e-06 [a_1]: 3.936e-05 [with_stream_mark]: 8.64e-06 [recompute_prepare]: 3.91001e-06 [updatestate_depend_eliminate]: 2.12999e-06 [updatestate_assign_eliminate]: 1.59998e-06 [updatestate_loads_eliminate]: 1.47001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 3.45e-06 [updatestate_useless_node_eliminater]: 3.59002e-06 [accelerated_algorithm]: 3.11999e-06 [meta_shard_fg_expand]: 1.04998e-06 [get_grad_eliminate_]: 3.41001e-06 [merge_forward]: 1.79998e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.91e-06 [j_node_and_user_rematch]: 5.40001e-06 [meta_fg_expand]: 1.29998e-06 [replace_old_param]: 3.28e-06 [inline_without_move]: 2.99999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 3.76001e-06 [cse]: 8.57e-06 [replace_applicator]: 3.58999e-06 [py_interpret_to_execute_after_opt_a]: 1.125e-05 [rewriter_after_opt_a]: 3.543e-05 [convert_after_rewriter]: 5.89999e-06 [order_py_execute_after_rewriter]: 4.48001e-06 [mutable_eliminate]: 0.00073136 [jit_opt_b]: 3.931e-05, [1] [Cycle 1]: 3.226e-05, [2] [frontend_op_eliminate]: 9.41e-06 [inline_after_opt_a]: 1.116e-05 [cconv]: 2.47e-05 [loop_unroll]: 0.00042152 [jit_opt_after_cconv]: 0.00012147, [1] [Cycle 1]: 0.00011504, [11] [c_1]: 1.152e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 1.75001e-06 [updatestate_loads_eliminate]: 1.53002e-06 [cse]: 1.791e-05 [call_graph_tuple_transform]: 1.35e-05 [tuple_list_get_item_eliminator]: 3.66999e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 3.44001e-06 [remove_dup_value]: 1.675e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 5.20001e-06 [add_recomputation]: 3.508e-05 [cse_after_recomputation]: 1.882e-05, [1] [Cycle 1]: 1.37e-05, [1] [cse]: 7.92e-06 [auto_monad_reorder]: 1.379e-05 [get_jit_bprop_graph]: 1.75001e-06 [rewriter_after_jit_bprop_graph]: 4.44002e-06 [opt_after_jit_grad]: 0.00045013 [symbol_engine_optimizer]: 6.74e-05, [1] [Cycle 1]: 6.101e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 5.41998e-06 [elim_not_effective]: 1.053e-05 [opt_reshape]: 4.53001e-06 [fold_const_symbol]: 6.76999e-06 [renormalize]: 6.39993e-07 [validate]: 3.05e-05 Sums bootstrap : 0.000245s : 0.18% type_inference : 0.113323s : 83.19% event_method : 0.000441s : 0.32% auto_monad : 0.000099s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000045s : 0.03% rewriter_before_opt_a : 0.000114s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000177s : 0.13% jit_opt_a.loop_unroll : 0.000086s : 0.06% jit_opt_a.a_1 : 0.002028s : 1.49% jit_opt_a.with_stream_mark : 0.000058s : 0.04% jit_opt_a.recompute_prepare : 0.000031s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000024s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.02% jit_opt_a.accelerated_algorithm : 0.000022s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.02% jit_opt_a.merge_forward : 0.000014s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000052s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.03% jit_opt_a.meta_fg_expand : 0.001767s : 1.30% jit_opt_a.replace_old_param : 0.000077s : 0.06% jit_opt_a.inline_without_move : 0.000069s : 0.05% jit_opt_a.renormalize : 0.014962s : 10.98% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000076s : 0.06% jit_opt_a.cse : 0.000299s : 0.22% jit_opt_a.replace_applicator : 0.000109s : 0.08% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000731s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000009s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000422s : 0.31% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000013s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000450s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000030s : 0.02% Time group info: ------[substitution.] 0.000524 101 0.32% : 0.000002s : 1: substitution.elim_not_effective 0.27% : 0.000001s : 1: substitution.fold_const_symbol 0.83% : 0.000004s : 1: substitution.graph_param_transform 63.00% : 0.000330s : 12: substitution.inline 3.16% : 0.000017s : 2: substitution.inline_without_move 1.76% : 0.000009s : 11: substitution.j_node_and_user_rematch 2.26% : 0.000012s : 7: substitution.minmaximum_grad 1.38% : 0.000007s : 5: substitution.partial_eliminate 1.83% : 0.000010s : 11: substitution.remove_not_recompute_node 6.23% : 0.000033s : 10: substitution.replace_applicator 1.95% : 0.000010s : 10: substitution.replace_old_param 0.55% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.27% : 0.000007s : 1: substitution.tile_eliminate 4.26% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 3.04% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.88% : 0.000041s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113230 2 97.51% : 0.110410s : 1: type_inference.infer 2.49% : 0.002820s : 1: type_inference.specialize ------[replace.] 0.000169 19 63.29% : 0.000107s : 12: replace.inline 36.71% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000342 19 94.27% : 0.000323s : 12: match.inline 5.73% : 0.000020s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000351 2432 1.61% : 0.000006s : 42: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.45% : 0.000005s : 42: predicate.addn_check_dump 1.71% : 0.000006s : 42: predicate.addn_zero_filter 2.26% : 0.000008s : 42: predicate.arithmetic_simplify 1.65% : 0.000006s : 42: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.41% : 0.000005s : 42: predicate.compare_switch_simplify 1.59% : 0.000006s : 42: predicate.depend_value_elim 1.49% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.74% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.53% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.45% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.43% : 0.000005s : 42: predicate.environ_get_depend_swap 1.48% : 0.000005s : 42: predicate.environ_get_eliminate 1.42% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000003s : 16: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.48% : 0.000016s : 63: predicate.inline 2.12% : 0.000007s : 44: predicate.inline_without_move 0.37% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.88% : 0.000003s : 16: predicate.less_batch_normalization 1.88% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.93% : 0.000007s : 50: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.42% : 0.000012s : 87: predicate.loop_unroll_before_grad 1.71% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 42: predicate.merge_addn 1.51% : 0.000005s : 42: predicate.minmaximum_grad 0.40% : 0.000001s : 1: predicate.mutable_eliminate 0.15% : 0.000001s : 1: predicate.opt_reshape 2.37% : 0.000008s : 50: predicate.partial_eliminate 1.54% : 0.000005s : 42: predicate.print_const_string_wrapper 2.07% : 0.000007s : 42: predicate.reduce_eliminate 1.87% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000001s : 16: predicate.remove_not_recompute_node 2.78% : 0.000010s : 93: predicate.replace_applicator 1.12% : 0.000004s : 44: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.63% : 0.000006s : 42: predicate.reshape_eliminate 1.54% : 0.000005s : 42: predicate.row_tensor_add_zeros_like 0.13% : 0.000000s : 1: predicate.row_tensor_eliminate 1.49% : 0.000005s : 42: predicate.same_eliminate 0.45% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 2: predicate.special_op_eliminate 0.76% : 0.000003s : 16: predicate.specialize_transform 1.68% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.80% : 0.000010s : 61: predicate.switch_defer_inline 2.52% : 0.000009s : 61: predicate.switch_layer_defer_inline 6.55% : 0.000023s : 149: predicate.switch_simplify 1.56% : 0.000005s : 42: predicate.tile_eliminate 1.48% : 0.000005s : 42: predicate.transpose_eliminate 1.91% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.71% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.29% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.97% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.89% : 0.000007s : 49: predicate.tuple_to_list_eliminator_ 1.79% : 0.000006s : 50: predicate.updatestate_pure_node_eliminater 2.71% : 0.000010s : 66: predicate.updatestate_useless_node_eliminater 1.94% : 0.000007s : 42: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003713 43 77.10% : 0.002863s : 27: func_graph_cloner_run.FuncGraphClonerGraph 22.90% : 0.000850s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.158141 87 0.02% : 0.000038s : 1: add_recomputation 0.07% : 0.000105s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.17% : 0.000271s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.28% : 0.000448s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 15.15% : 0.023962s : 1: jit_opt_a 0.08% : 0.000124s : 1: jit_opt_after_cconv 0.03% : 0.000042s : 1: jit_opt_b 0.27% : 0.000430s : 1: loop_unroll 0.47% : 0.000741s : 1: mutable_eliminate 1.71% : 0.002712s : 39: opt.transform.jit_opt_a 0.02% : 0.000029s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000014s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000024s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000458s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000047s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 8.01% : 0.012665s : 2: renormalize.infer 1.44% : 0.002275s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000117s : 1: rewriter_before_opt_a 0.04% : 0.000070s : 1: symbol_engine_optimizer 71.67% : 0.113343s : 1: type_inference TotalTime = 0.0127186, [30] [bootstrap]: 0.00029096 [type_inference]: 0.00493273 [event_method]: 1.733e-05 [auto_monad]: 6.115e-05 [graph_reusing]: 4.95999e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 3.703e-05 [rewriter_before_opt_a]: 7.542e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.00519338, [2] [Cycle 1]: 0.00163737, [27] [switch_simplify]: 5.401e-05 [loop_unroll]: 2.87e-05 [a_1]: 0.00050906 [with_stream_mark]: 1.629e-05 [recompute_prepare]: 6.99001e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.11997e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.04998e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 8.57998e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.43001e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.00071229 [add_forward_monad_depend]: 5.40001e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.395e-05 [cse]: 3.123e-05 [replace_applicator]: 1.163e-05 [Cycle 2]: 0.00031084, [27] [switch_simplify]: 5.67999e-06 [loop_unroll]: 5.07e-06 [a_1]: 8.521e-05 [with_stream_mark]: 8.80001e-06 [recompute_prepare]: 4.88001e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 4.86002e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.307e-05 [j_node_and_user_rematch]: 7.77e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 6.92002e-06 [inline_without_move]: 4.57998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.29998e-06 [cse]: 1.291e-05 [replace_applicator]: 5.08002e-06 [py_interpret_to_execute_after_opt_a]: 1.12e-05 [rewriter_after_opt_a]: 3.649e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.0005415 [jit_opt_b]: 4.774e-05, [1] [Cycle 1]: 4.111e-05, [2] [frontend_op_eliminate]: 1.532e-05 [inline_after_opt_a]: 1.52e-05 [cconv]: 2.478e-05 [loop_unroll]: 0.00043163 [jit_opt_after_cconv]: 0.00014179, [1] [Cycle 1]: 0.00013539, [11] [c_1]: 2.043e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.184e-05 [call_graph_tuple_transform]: 1.773e-05 [tuple_list_get_item_eliminator]: 5.46998e-06 [none_parameter_eliminate]: 1.76003e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.62001e-06 [remove_dup_value]: 1.625e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 6.36e-06 [add_recomputation]: 4.718e-05 [cse_after_recomputation]: 2.247e-05, [1] [Cycle 1]: 1.745e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.28002e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00046315 [symbol_engine_optimizer]: 6.998e-05, [1] [Cycle 1]: 6.373e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 7.41001e-06 [elim_not_effective]: 1.231e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.22e-06 [renormalize]: 4.19997e-07 [validate]: 3.886e-05 Sums bootstrap : 0.000291s : 3.26% type_inference : 0.004933s : 55.29% event_method : 0.000017s : 0.19% auto_monad : 0.000061s : 0.69% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000037s : 0.42% rewriter_before_opt_a : 0.000075s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000060s : 0.67% jit_opt_a.loop_unroll : 0.000034s : 0.38% jit_opt_a.a_1 : 0.000594s : 6.66% jit_opt_a.with_stream_mark : 0.000025s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000712s : 7.98% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.22% jit_opt_a.cse : 0.000044s : 0.49% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000036s : 0.41% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000541s : 6.07% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000025s : 0.28% loop_unroll : 0.000432s : 4.84% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000047s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.19% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000463s : 5.19% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.44% Time group info: ------[substitution.] 0.000194 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000005s : 3: substitution.graph_param_transform 83.22% : 0.000162s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000004s : 2: substitution.replace_old_param 6.34% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004864 2 83.73% : 0.004072s : 1: type_inference.infer 16.27% : 0.000792s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.83% : 0.000045s : 4: replace.inline 32.17% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.37% : 0.000159s : 4: match.inline 6.63% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.69% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.04% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000008s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000590 13 53.42% : 0.000315s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.85% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.73% : 0.000240s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014284 72 0.35% : 0.000050s : 1: add_recomputation 0.45% : 0.000064s : 1: auto_monad 0.14% : 0.000020s : 1: auto_monad_reorder 2.14% : 0.000306s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.38% : 0.005197s : 1: jit_opt_a 1.01% : 0.000144s : 1: jit_opt_after_cconv 0.35% : 0.000050s : 1: jit_opt_b 3.08% : 0.000439s : 1: loop_unroll 3.85% : 0.000550s : 1: mutable_eliminate 5.60% : 0.000800s : 26: opt.transform.jit_opt_a 0.32% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.30% : 0.000471s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.04% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.97% : 0.000424s : 1: renormalize.infer 1.97% : 0.000281s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.55% : 0.000078s : 1: rewriter_before_opt_a 0.51% : 0.000073s : 1: symbol_engine_optimizer 34.63% : 0.004946s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.850.14 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cb80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.857.85 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.177471, [30] [bootstrap]: 0.00033869 [type_inference]: 0.154698 [event_method]: 1.789e-05 [auto_monad]: 7.066e-05 [graph_reusing]: 6.01998e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 0.00045023 [rewriter_before_opt_a]: 9.293e-05 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.0196787, [2] [Cycle 1]: 0.00366755, [27] [switch_simplify]: 5.684e-05 [loop_unroll]: 2.989e-05 [a_1]: 0.00054762 [with_stream_mark]: 1.381e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 6.32001e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.234e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.95001e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00271097 [add_forward_monad_depend]: 5.68997e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.466e-05 [cse]: 2.241e-05 [replace_applicator]: 1.428e-05 [Cycle 2]: 0.00034838, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.0001165 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 5.98002e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.31998e-06 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.26998e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.429e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.012e-05 [replace_applicator]: 5.48002e-06 [py_interpret_to_execute_after_opt_a]: 1.002e-05 [rewriter_after_opt_a]: 3.005e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 4.70001e-06 [mutable_eliminate]: 0.00055217 [jit_opt_b]: 5.141e-05, [1] [Cycle 1]: 4.511e-05, [2] [frontend_op_eliminate]: 1.846e-05 [inline_after_opt_a]: 1.641e-05 [cconv]: 1.999e-05 [loop_unroll]: 0.00040718 [jit_opt_after_cconv]: 0.00016532, [1] [Cycle 1]: 0.00015922, [11] [c_1]: 2.441e-05 [parameter_eliminate]: 2.18998e-06 [updatestate_depend_eliminate]: 2.171e-05 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.847e-05 [call_graph_tuple_transform]: 2.55e-05 [tuple_list_get_item_eliminator]: 6.33e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.199e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.95002e-06 [add_recomputation]: 3.939e-05 [cse_after_recomputation]: 2.061e-05, [1] [Cycle 1]: 1.554e-05, [1] [cse]: 9.92999e-06 [auto_monad_reorder]: 1.126e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.11001e-06 [opt_after_jit_grad]: 0.00044916 [symbol_engine_optimizer]: 6.956e-05, [1] [Cycle 1]: 6.327e-05, [6] [build]: 2.57001e-06 [elim_shapecalc]: 8.04002e-06 [elim_not_effective]: 1.249e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.38001e-06 [renormalize]: 4.10015e-07 [validate]: 6.271e-05 Sums bootstrap : 0.000339s : 0.21% type_inference : 0.154698s : 95.94% event_method : 0.000018s : 0.01% auto_monad : 0.000071s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000450s : 0.28% rewriter_before_opt_a : 0.000093s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000664s : 0.41% jit_opt_a.with_stream_mark : 0.000023s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002711s : 1.68% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000033s : 0.02% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000030s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000552s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000020s : 0.01% loop_unroll : 0.000407s : 0.25% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000022s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000039s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000449s : 0.28% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000063s : 0.04% Time group info: ------[substitution.] 0.000191 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000005s : 4: substitution.graph_param_transform 83.81% : 0.000160s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.79% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 5.14% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.154621 2 98.11% : 0.151702s : 1: type_inference.infer 1.89% : 0.002919s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.53% : 0.000048s : 4: replace.inline 33.47% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 94.82% : 0.000158s : 4: match.inline 5.18% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.39% : 0.000002s : 12: predicate.environ_get_eliminate 1.22% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 4.99% : 0.000006s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.48% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.27% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002234 22 68.09% : 0.001521s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.33% : 0.000678s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.181106 72 0.02% : 0.000042s : 1: add_recomputation 0.04% : 0.000074s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.20% : 0.000361s : 1: bootstrap 0.01% : 0.000022s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 10.87% : 0.019682s : 1: jit_opt_a 0.09% : 0.000168s : 1: jit_opt_after_cconv 0.03% : 0.000054s : 1: jit_opt_b 0.23% : 0.000415s : 1: loop_unroll 0.31% : 0.000561s : 1: mutable_eliminate 0.49% : 0.000887s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000457s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000455s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.10% : 0.001989s : 1: renormalize.infer 0.39% : 0.000712s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000033s : 1: rewriter_after_opt_a 0.05% : 0.000099s : 1: rewriter_before_opt_a 0.04% : 0.000072s : 1: symbol_engine_optimizer 85.43% : 0.154714s : 1: type_inference TotalTime = 0.0346778, [30] [bootstrap]: 0.00030714 [type_inference]: 0.0236747 [event_method]: 2.232e-05 [auto_monad]: 7.491e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00014892 [rewriter_before_opt_a]: 8.494e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00667742, [2] [Cycle 1]: 0.00272613, [27] [switch_simplify]: 6.589e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.00067152 [with_stream_mark]: 2.362e-05 [recompute_prepare]: 8.50001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.18998e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00155044 [add_forward_monad_depend]: 8.67e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.933e-05 [cse]: 3.82e-05 [replace_applicator]: 1.967e-05 [Cycle 2]: 0.00035803, [27] [switch_simplify]: 6.57002e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00010136 [with_stream_mark]: 1.454e-05 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.05001e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.81e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.91e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.79001e-06 [cse]: 1.325e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 1.59e-05 [rewriter_after_opt_a]: 3.911e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00070656 [jit_opt_b]: 5.28e-05, [1] [Cycle 1]: 4.547e-05, [2] [frontend_op_eliminate]: 1.661e-05 [inline_after_opt_a]: 1.801e-05 [cconv]: 3.126e-05 [loop_unroll]: 0.00149395 [jit_opt_after_cconv]: 0.00018256, [1] [Cycle 1]: 0.00017521, [11] [c_1]: 2.431e-05 [parameter_eliminate]: 5.96e-06 [updatestate_depend_eliminate]: 9.25999e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 3.621e-05 [call_graph_tuple_transform]: 2.463e-05 [tuple_list_get_item_eliminator]: 7.1e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.605e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 7.49002e-06 [add_recomputation]: 5.67e-05 [cse_after_recomputation]: 2.941e-05, [1] [Cycle 1]: 2.221e-05, [1] [cse]: 1.544e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 8.45001e-06 [opt_after_jit_grad]: 0.00060575 [symbol_engine_optimizer]: 8.837e-05, [1] [Cycle 1]: 8e-05, [6] [build]: 5.42001e-06 [elim_shapecalc]: 8.55999e-06 [elim_not_effective]: 1.707e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.005e-05 [renormalize]: 6.50005e-07 [validate]: 5.336e-05 Sums bootstrap : 0.000307s : 1.01% type_inference : 0.023675s : 77.92% event_method : 0.000022s : 0.07% auto_monad : 0.000075s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000149s : 0.49% rewriter_before_opt_a : 0.000085s : 0.28% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000773s : 2.54% jit_opt_a.with_stream_mark : 0.000038s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001551s : 5.10% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000051s : 0.17% jit_opt_a.replace_applicator : 0.000025s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000707s : 2.33% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000031s : 0.10% loop_unroll : 0.001494s : 4.92% jit_opt_after_cconv.c_1 : 0.000024s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000057s : 0.19% cse_after_recomputation.cse : 0.000015s : 0.05% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000606s : 1.99% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.18% Time group info: ------[substitution.] 0.000317 23 0.91% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000006s : 3: substitution.graph_param_transform 87.51% : 0.000277s : 4: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 1.75% : 0.000006s : 2: substitution.replace_old_param 4.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023587 2 91.17% : 0.021505s : 1: type_inference.infer 8.83% : 0.002082s : 1: type_inference.specialize ------[replace.] 0.000086 6 69.09% : 0.000059s : 4: replace.inline 30.91% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 6 95.71% : 0.000275s : 4: match.inline 4.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.35% : 0.000002s : 10: predicate.addn_check_dump 1.48% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000003s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.02% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 10: predicate.environ_get_depend_swap 0.97% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 6.22% : 0.000008s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.18% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 2.55% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.40% : 0.000002s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.88% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.50% : 0.000002s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.10% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.11% : 0.000004s : 16: predicate.switch_defer_inline 2.08% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.93% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000002s : 10: predicate.tile_eliminate 1.10% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001057 13 39.74% : 0.000420s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.26% : 0.000584s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037300 72 0.16% : 0.000061s : 1: add_recomputation 0.21% : 0.000078s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.88% : 0.000327s : 1: bootstrap 0.09% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000031s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.91% : 0.006681s : 1: jit_opt_a 0.50% : 0.000186s : 1: jit_opt_after_cconv 0.15% : 0.000055s : 1: jit_opt_b 4.04% : 0.001508s : 1: loop_unroll 1.92% : 0.000717s : 1: mutable_eliminate 2.72% : 0.001013s : 26: opt.transform.jit_opt_a 0.16% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.66% : 0.000619s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000154s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000051s : 1: remove_dup_value 2.44% : 0.000911s : 1: renormalize.infer 1.68% : 0.000628s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.24% : 0.000089s : 1: rewriter_before_opt_a 0.24% : 0.000091s : 1: symbol_engine_optimizer 63.53% : 0.023696s : 1: type_inference TotalTime = 0.0926522, [30] [bootstrap]: 0.00025527 [type_inference]: 0.063709 [event_method]: 0.00027923 [auto_monad]: 0.00010293 [graph_reusing]: 6.91999e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 3.266e-05 [rewriter_before_opt_a]: 0.0001154 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0259187, [3] [Cycle 1]: 0.0182462, [27] [switch_simplify]: 8.008e-05 [loop_unroll]: 4.392e-05 [a_1]: 0.00097256 [with_stream_mark]: 3.473e-05 [recompute_prepare]: 2.019e-05 [updatestate_depend_eliminate]: 9.61e-06 [updatestate_assign_eliminate]: 7.45998e-06 [updatestate_loads_eliminate]: 6.61e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 1.495e-05 [updatestate_useless_node_eliminater]: 1.348e-05 [accelerated_algorithm]: 1.41e-05 [meta_shard_fg_expand]: 3.3e-06 [get_grad_eliminate_]: 1.367e-05 [merge_forward]: 9.38002e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.932e-05 [j_node_and_user_rematch]: 2.432e-05 [meta_fg_expand]: 0.0018993 [replace_old_param]: 7.974e-05 [inline_without_move]: 6.103e-05 [renormalize]: 0.0142017 [add_forward_monad_depend]: 1.216e-05 [auto_monad_grad]: 6.60002e-06 [auto_monad_eliminator]: 6.109e-05 [cse]: 0.00026712 [replace_applicator]: 9.137e-05 [Cycle 2]: 0.00371327, [27] [switch_simplify]: 4.415e-05 [loop_unroll]: 4.287e-05 [a_1]: 0.00124299 [with_stream_mark]: 1.93e-05 [recompute_prepare]: 1.091e-05 [updatestate_depend_eliminate]: 6.65002e-06 [updatestate_assign_eliminate]: 3.70998e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 7.2e-06 [accelerated_algorithm]: 7.41999e-06 [meta_shard_fg_expand]: 3.84002e-06 [get_grad_eliminate_]: 6.88e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.742e-05 [j_node_and_user_rematch]: 1.134e-05 [meta_fg_expand]: 7.789e-05 [replace_old_param]: 7.18e-06 [inline_without_move]: 6.93e-06 [renormalize]: 0.00192581 [add_forward_monad_depend]: 7.04001e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.413e-05 [cse]: 2.857e-05 [replace_applicator]: 1.682e-05 [Cycle 3]: 0.00025616, [27] [switch_simplify]: 4.57e-06 [loop_unroll]: 3.61999e-06 [a_1]: 4.242e-05 [with_stream_mark]: 1.083e-05 [recompute_prepare]: 3.77998e-06 [updatestate_depend_eliminate]: 2.65002e-06 [updatestate_assign_eliminate]: 2.01e-06 [updatestate_loads_eliminate]: 1.59998e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 3.36999e-06 [updatestate_useless_node_eliminater]: 3.11001e-06 [accelerated_algorithm]: 3.51001e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 3.24001e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.268e-05 [j_node_and_user_rematch]: 5.78002e-06 [meta_fg_expand]: 1.37e-06 [replace_old_param]: 3.21001e-06 [inline_without_move]: 2.99999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 3.41001e-06 [cse]: 8.89998e-06 [replace_applicator]: 3.56001e-06 [py_interpret_to_execute_after_opt_a]: 1.131e-05 [rewriter_after_opt_a]: 3.788e-05 [convert_after_rewriter]: 5.67001e-06 [order_py_execute_after_rewriter]: 4.45999e-06 [mutable_eliminate]: 0.00070278 [jit_opt_b]: 6.253e-05, [1] [Cycle 1]: 3.495e-05, [2] [frontend_op_eliminate]: 1.06e-05 [inline_after_opt_a]: 1.153e-05 [cconv]: 2.592e-05 [loop_unroll]: 0.00042604 [jit_opt_after_cconv]: 0.00012261, [1] [Cycle 1]: 0.00011647, [11] [c_1]: 1.2e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 1.69e-06 [updatestate_loads_eliminate]: 1.52999e-06 [cse]: 1.646e-05 [call_graph_tuple_transform]: 1.342e-05 [tuple_list_get_item_eliminator]: 4.07e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 1.00999e-06 [switch_simplify]: 3.73001e-06 [remove_dup_value]: 1.452e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 4.80999e-06 [add_recomputation]: 3.449e-05 [cse_after_recomputation]: 1.917e-05, [1] [Cycle 1]: 1.445e-05, [1] [cse]: 7.83001e-06 [auto_monad_reorder]: 1.292e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00043833 [symbol_engine_optimizer]: 6.736e-05, [1] [Cycle 1]: 6.102e-05, [6] [build]: 4.18999e-06 [elim_shapecalc]: 5.61e-06 [elim_not_effective]: 1.004e-05 [opt_reshape]: 4.62998e-06 [fold_const_symbol]: 5.74999e-06 [renormalize]: 4.10015e-07 [validate]: 3.036e-05 Sums bootstrap : 0.000255s : 0.29% type_inference : 0.063709s : 72.36% event_method : 0.000279s : 0.32% auto_monad : 0.000103s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000033s : 0.04% rewriter_before_opt_a : 0.000115s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.15% jit_opt_a.loop_unroll : 0.000090s : 0.10% jit_opt_a.a_1 : 0.002258s : 2.56% jit_opt_a.with_stream_mark : 0.000065s : 0.07% jit_opt_a.recompute_prepare : 0.000035s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.03% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000041s : 0.05% jit_opt_a.meta_fg_expand : 0.001979s : 2.25% jit_opt_a.replace_old_param : 0.000090s : 0.10% jit_opt_a.inline_without_move : 0.000071s : 0.08% jit_opt_a.renormalize : 0.016128s : 18.32% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000079s : 0.09% jit_opt_a.cse : 0.000305s : 0.35% jit_opt_a.replace_applicator : 0.000112s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000703s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000026s : 0.03% loop_unroll : 0.000426s : 0.48% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000016s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000013s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000034s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000438s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.03% Time group info: ------[substitution.] 0.000564 104 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.81% : 0.000005s : 1: substitution.graph_param_transform 63.81% : 0.000360s : 12: substitution.inline 3.31% : 0.000019s : 2: substitution.inline_without_move 1.60% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.10% : 0.000012s : 7: substitution.minmaximum_grad 1.27% : 0.000007s : 5: substitution.partial_eliminate 1.89% : 0.000011s : 12: substitution.remove_not_recompute_node 5.60% : 0.000032s : 10: substitution.replace_applicator 1.34% : 0.000008s : 10: substitution.replace_old_param 1.44% : 0.000008s : 1: substitution.reshape_eliminate 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.20% : 0.000007s : 1: substitution.tile_eliminate 4.06% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.96% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 7.76% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063617 2 96.64% : 0.061481s : 1: type_inference.infer 3.36% : 0.002135s : 1: type_inference.specialize ------[replace.] 0.000179 19 65.89% : 0.000118s : 12: replace.inline 34.11% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000376 19 93.97% : 0.000353s : 12: match.inline 6.03% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000377 2654 1.50% : 0.000006s : 46: predicate.accumulaten_eliminater 0.21% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.54% : 0.000006s : 46: predicate.addn_check_dump 1.61% : 0.000006s : 46: predicate.addn_zero_filter 1.94% : 0.000007s : 46: predicate.arithmetic_simplify 1.85% : 0.000007s : 46: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.49% : 0.000006s : 46: predicate.compare_switch_simplify 1.50% : 0.000006s : 46: predicate.depend_value_elim 1.45% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.55% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.52% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.21% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.11% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.46% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.46% : 0.000006s : 46: predicate.environ_get_depend_swap 1.53% : 0.000006s : 46: predicate.environ_get_eliminate 1.47% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.91% : 0.000003s : 19: predicate.get_grad_eliminate 0.06% : 0.000000s : 1: predicate.graph_param_transform 4.30% : 0.000016s : 67: predicate.inline 2.05% : 0.000008s : 47: predicate.inline_without_move 0.38% : 0.000001s : 19: predicate.j_node_and_user_rematch 0.94% : 0.000004s : 19: predicate.less_batch_normalization 2.09% : 0.000008s : 53: predicate.list_to_tuple_eliminator_ 1.89% : 0.000007s : 54: predicate.load_eliminater 0.34% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.38% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.62% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.39% : 0.000005s : 46: predicate.merge_addn 1.48% : 0.000006s : 46: predicate.minmaximum_grad 0.39% : 0.000001s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.29% : 0.000009s : 54: predicate.partial_eliminate 1.48% : 0.000006s : 46: predicate.print_const_string_wrapper 2.09% : 0.000008s : 46: predicate.reduce_eliminate 1.80% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000002s : 19: predicate.remove_not_recompute_node 3.04% : 0.000011s : 100: predicate.replace_applicator 1.19% : 0.000005s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 46: predicate.reshape_eliminate 1.67% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.60% : 0.000006s : 46: predicate.same_eliminate 0.51% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.18% : 0.000001s : 2: predicate.special_op_eliminate 0.89% : 0.000003s : 19: predicate.specialize_transform 1.79% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.75% : 0.000010s : 65: predicate.switch_defer_inline 2.45% : 0.000009s : 65: predicate.switch_layer_defer_inline 6.60% : 0.000025s : 161: predicate.switch_simplify 1.58% : 0.000006s : 46: predicate.tile_eliminate 1.50% : 0.000006s : 46: predicate.transpose_eliminate 1.99% : 0.000008s : 46: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000007s : 46: predicate.tuple_list_get_item_depend_reorder 3.21% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.91% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.76% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.72% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 1.78% : 0.000007s : 46: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.20% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004217 56 80.29% : 0.003385s : 40: func_graph_cloner_run.FuncGraphClonerGraph 19.71% : 0.000831s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111709 87 0.03% : 0.000037s : 1: add_recomputation 0.10% : 0.000108s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000280s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.26% : 0.000289s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 23.20% : 0.025922s : 1: jit_opt_a 0.11% : 0.000125s : 1: jit_opt_after_cconv 0.06% : 0.000065s : 1: jit_opt_b 0.39% : 0.000434s : 1: loop_unroll 0.64% : 0.000712s : 1: mutable_eliminate 2.63% : 0.002935s : 39: opt.transform.jit_opt_a 0.03% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000035s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 12.47% : 0.013925s : 2: renormalize.infer 1.95% : 0.002180s : 2: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.11% : 0.000118s : 1: rewriter_before_opt_a 0.06% : 0.000070s : 1: symbol_engine_optimizer 57.05% : 0.063731s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.187.889 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.188.624 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0403457, [30] [bootstrap]: 0.00031717 [type_inference]: 0.0276475 [event_method]: 2.334e-05 [auto_monad]: 7.625e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.95002e-06 [py_interpret_to_execute]: 0.00015508 [rewriter_before_opt_a]: 9.019e-05 [expand_dump_flag]: 3.64002e-06 [jit_opt_a]: 0.00876496, [2] [Cycle 1]: 0.00342313, [27] [switch_simplify]: 8.902e-05 [loop_unroll]: 3.311e-05 [a_1]: 0.00086913 [with_stream_mark]: 3.176e-05 [recompute_prepare]: 1.147e-05 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 6.18998e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 7e-06 [merge_forward]: 5.17e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.794e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.78003e-06 [replace_old_param]: 1.209e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.0019282 [add_forward_monad_depend]: 1.047e-05 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 2.307e-05 [cse]: 4.192e-05 [replace_applicator]: 2.378e-05 [Cycle 2]: 0.00040432, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 6.53e-06 [a_1]: 0.0001234 [with_stream_mark]: 2.014e-05 [recompute_prepare]: 6.29999e-06 [updatestate_depend_eliminate]: 3.90998e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 6.11998e-06 [meta_shard_fg_expand]: 2.65002e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 3.78999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.824e-05 [j_node_and_user_rematch]: 9.51998e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 7.75e-06 [cse]: 1.671e-05 [replace_applicator]: 7.22997e-06 [py_interpret_to_execute_after_opt_a]: 2.016e-05 [rewriter_after_opt_a]: 4.567e-05 [convert_after_rewriter]: 7.55e-06 [order_py_execute_after_rewriter]: 5.91e-06 [mutable_eliminate]: 0.00096427 [jit_opt_b]: 6.233e-05, [1] [Cycle 1]: 5.353e-05, [2] [frontend_op_eliminate]: 1.965e-05 [inline_after_opt_a]: 2.129e-05 [cconv]: 4.123e-05 [loop_unroll]: 0.00060539 [jit_opt_after_cconv]: 0.00020132, [1] [Cycle 1]: 0.0001938, [11] [c_1]: 2.515e-05 [parameter_eliminate]: 6.53998e-06 [updatestate_depend_eliminate]: 1.249e-05 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 4.818e-05 [call_graph_tuple_transform]: 2.597e-05 [tuple_list_get_item_eliminator]: 7.26999e-06 [none_parameter_eliminate]: 1.89999e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 5.794e-05 [partial_unused_args_eliminate]: 3.04999e-06 [environ_conv]: 9.30001e-06 [add_recomputation]: 6.674e-05 [cse_after_recomputation]: 3.251e-05, [1] [Cycle 1]: 2.42e-05, [1] [cse]: 1.747e-05 [auto_monad_reorder]: 2.116e-05 [get_jit_bprop_graph]: 3.45e-06 [rewriter_after_jit_bprop_graph]: 1.158e-05 [opt_after_jit_grad]: 0.00070686 [symbol_engine_optimizer]: 9.331e-05, [1] [Cycle 1]: 8.459e-05, [6] [build]: 6.22001e-06 [elim_shapecalc]: 9.21998e-06 [elim_not_effective]: 1.828e-05 [opt_reshape]: 7.75998e-06 [fold_const_symbol]: 1.105e-05 [renormalize]: 7.39994e-07 [validate]: 5.54e-05 Sums bootstrap : 0.000317s : 0.92% type_inference : 0.027648s : 79.78% event_method : 0.000023s : 0.07% auto_monad : 0.000076s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000155s : 0.45% rewriter_before_opt_a : 0.000090s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000096s : 0.28% jit_opt_a.loop_unroll : 0.000040s : 0.11% jit_opt_a.a_1 : 0.000993s : 2.86% jit_opt_a.with_stream_mark : 0.000052s : 0.15% jit_opt_a.recompute_prepare : 0.000018s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001928s : 5.56% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.09% jit_opt_a.cse : 0.000059s : 0.17% jit_opt_a.replace_applicator : 0.000031s : 0.09% py_interpret_to_execute_after_opt_a : 0.000020s : 0.06% rewriter_after_opt_a : 0.000046s : 0.13% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000964s : 2.78% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000041s : 0.12% loop_unroll : 0.000605s : 1.75% jit_opt_after_cconv.c_1 : 0.000025s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000048s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000058s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.03% add_recomputation : 0.000067s : 0.19% cse_after_recomputation.cse : 0.000017s : 0.05% auto_monad_reorder : 0.000021s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.03% opt_after_jit_grad : 0.000707s : 2.04% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.16% Time group info: ------[substitution.] 0.000366 23 0.83% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 3: substitution.graph_param_transform 86.40% : 0.000316s : 4: substitution.inline 1.29% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000007s : 4: substitution.remove_not_recompute_node 1.92% : 0.000007s : 2: substitution.replace_old_param 5.19% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027543 2 89.16% : 0.024559s : 1: type_inference.infer 10.84% : 0.002985s : 1: type_inference.specialize ------[replace.] 0.000122 6 68.50% : 0.000084s : 4: replace.inline 31.50% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000331 6 94.67% : 0.000313s : 4: match.inline 5.33% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 691 1.18% : 0.000002s : 10: predicate.accumulaten_eliminater 1.55% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 10: predicate.addn_check_dump 1.17% : 0.000002s : 10: predicate.addn_zero_filter 2.77% : 0.000004s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.82% : 0.000001s : 10: predicate.compare_switch_simplify 1.63% : 0.000002s : 10: predicate.depend_value_elim 0.82% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.86% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 0.84% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.30% : 0.000002s : 6: predicate.get_grad_eliminate 0.34% : 0.000001s : 3: predicate.graph_param_transform 5.13% : 0.000008s : 22: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.74% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.43% : 0.000002s : 15: predicate.load_eliminater 2.38% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.87% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000002s : 10: predicate.minmaximum_grad 2.25% : 0.000003s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 1.85% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000002s : 10: predicate.print_const_string_wrapper 2.25% : 0.000003s : 10: predicate.reduce_eliminate 1.68% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000003s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.04% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.92% : 0.000003s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.17% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.88% : 0.000004s : 16: predicate.switch_defer_inline 1.88% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.11% : 0.000011s : 53: predicate.switch_simplify 1.15% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.27% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001163 13 41.14% : 0.000479s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.06% : 0.000071s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.80% : 0.000614s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.043618 72 0.16% : 0.000071s : 1: add_recomputation 0.18% : 0.000080s : 1: auto_monad 0.06% : 0.000024s : 1: auto_monad_reorder 0.78% : 0.000341s : 1: bootstrap 0.10% : 0.000044s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000035s : 1: cse_after_recomputation 0.03% : 0.000012s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 20.11% : 0.008770s : 1: jit_opt_a 0.47% : 0.000204s : 1: jit_opt_after_cconv 0.15% : 0.000065s : 1: jit_opt_b 1.42% : 0.000618s : 1: loop_unroll 2.25% : 0.000981s : 1: mutable_eliminate 2.93% : 0.001280s : 26: opt.transform.jit_opt_a 0.14% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000032s : 4: opt.transform.jit_opt_b 0.05% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000024s : 1: opt.transform.mutable_eliminate 0.07% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000722s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000159s : 1: py_interpret_to_execute 0.05% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000061s : 1: remove_dup_value 2.73% : 0.001193s : 1: renormalize.infer 1.65% : 0.000721s : 1: renormalize.specialize 0.03% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000049s : 1: rewriter_after_opt_a 0.22% : 0.000095s : 1: rewriter_before_opt_a 0.22% : 0.000097s : 1: symbol_engine_optimizer 63.44% : 0.027670s : 1: type_inference TotalTime = 0.174716, [30] [bootstrap]: 0.00028028 [type_inference]: 0.160188 [event_method]: 2.728e-05 [auto_monad]: 8.044e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 3.11999e-06 [py_interpret_to_execute]: 0.00029658 [rewriter_before_opt_a]: 0.00011849 [expand_dump_flag]: 4.2e-06 [jit_opt_a]: 0.0075179, [2] [Cycle 1]: 0.0033333, [27] [switch_simplify]: 6.736e-05 [loop_unroll]: 3.668e-05 [a_1]: 0.00073214 [with_stream_mark]: 2.085e-05 [recompute_prepare]: 9.44998e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.48e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 7.64002e-06 [updatestate_useless_node_eliminater]: 6.82002e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 6.75002e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.645e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 6.70002e-06 [renormalize]: 0.00210641 [add_forward_monad_depend]: 6.21998e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.724e-05 [cse]: 3.481e-05 [replace_applicator]: 1.585e-05 [Cycle 2]: 0.00037593, [27] [switch_simplify]: 7.23999e-06 [loop_unroll]: 6.44001e-06 [a_1]: 0.00012616 [with_stream_mark]: 1.042e-05 [recompute_prepare]: 6.49001e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 6.18998e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.37e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.37999e-06 [cse]: 1.452e-05 [replace_applicator]: 6.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.324e-05 [rewriter_after_opt_a]: 4.011e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00435648 [jit_opt_b]: 6.308e-05, [1] [Cycle 1]: 5.434e-05, [2] [frontend_op_eliminate]: 2.178e-05 [inline_after_opt_a]: 2.07e-05 [cconv]: 3.416e-05 [loop_unroll]: 0.00050314 [jit_opt_after_cconv]: 0.00018383, [1] [Cycle 1]: 0.00017684, [11] [c_1]: 2.9e-05 [parameter_eliminate]: 5.20001e-06 [updatestate_depend_eliminate]: 9.76e-06 [updatestate_assign_eliminate]: 4.01001e-06 [updatestate_loads_eliminate]: 2.71999e-06 [cse]: 3.39e-05 [call_graph_tuple_transform]: 2.595e-05 [tuple_list_get_item_eliminator]: 6.97002e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.78998e-06 [remove_dup_value]: 1.993e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 8.74e-06 [add_recomputation]: 5.362e-05 [cse_after_recomputation]: 2.581e-05, [1] [Cycle 1]: 2.008e-05, [1] [cse]: 1.424e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 6.83e-06 [opt_after_jit_grad]: 0.00048536 [symbol_engine_optimizer]: 0.00011588, [1] [Cycle 1]: 0.00010956, [6] [build]: 3.56001e-06 [elim_shapecalc]: 9.19e-06 [elim_not_effective]: 4.853e-05 [opt_reshape]: 7.62002e-06 [fold_const_symbol]: 1.118e-05 [renormalize]: 3.80009e-07 [validate]: 4.658e-05 Sums bootstrap : 0.000280s : 0.16% type_inference : 0.160188s : 94.07% event_method : 0.000027s : 0.02% auto_monad : 0.000080s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000297s : 0.17% rewriter_before_opt_a : 0.000118s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000858s : 0.50% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002106s : 1.24% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000049s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.004356s : 2.56% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000503s : 0.30% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000485s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000049s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.03% Time group info: ------[substitution.] 0.000284 25 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.56% : 0.000007s : 4: substitution.graph_param_transform 86.72% : 0.000247s : 5: substitution.inline 1.35% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 1.46% : 0.000004s : 2: substitution.replace_old_param 4.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.160092 2 94.38% : 0.151089s : 1: type_inference.infer 5.62% : 0.009003s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.13% : 0.000072s : 5: replace.inline 31.87% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.23% : 0.000243s : 5: match.inline 4.77% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 888 1.15% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.21% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.45% : 0.000008s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 3.19% : 0.000005s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.71% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.21% : 0.000011s : 65: predicate.switch_simplify 1.49% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.008608 21 14.09% : 0.001213s : 12: func_graph_cloner_run.FuncGraphClonerGraph 0.92% : 0.000079s : 2: func_graph_cloner_run.FuncGraphClonerNode 84.99% : 0.007316s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178074 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000084s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.17% : 0.000294s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.22% : 0.007521s : 1: jit_opt_a 0.10% : 0.000187s : 1: jit_opt_after_cconv 0.04% : 0.000066s : 1: jit_opt_b 0.29% : 0.000512s : 1: loop_unroll 2.46% : 0.004375s : 1: mutable_eliminate 0.63% : 0.001119s : 26: opt.transform.jit_opt_a 0.04% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000029s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000073s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000304s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.68% : 0.001219s : 1: renormalize.infer 0.49% : 0.000878s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000125s : 1: rewriter_before_opt_a 0.07% : 0.000119s : 1: symbol_engine_optimizer 89.97% : 0.160213s : 1: type_inference TotalTime = 0.0898675, [30] [bootstrap]: 0.00026325 [type_inference]: 0.0607201 [event_method]: 0.0002625 [auto_monad]: 0.00010112 [graph_reusing]: 7.70998e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 3.245e-05 [rewriter_before_opt_a]: 0.00011532 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.0258364, [3] [Cycle 1]: 0.0185134, [27] [switch_simplify]: 8.022e-05 [loop_unroll]: 4.445e-05 [a_1]: 0.00096557 [with_stream_mark]: 3.459e-05 [recompute_prepare]: 2.299e-05 [updatestate_depend_eliminate]: 9.79999e-06 [updatestate_assign_eliminate]: 7.16999e-06 [updatestate_loads_eliminate]: 6.58998e-06 [parameter_eliminate]: 3.38e-06 [specialize_transform]: 1.658e-05 [updatestate_useless_node_eliminater]: 1.431e-05 [accelerated_algorithm]: 1.411e-05 [meta_shard_fg_expand]: 3.61001e-06 [get_grad_eliminate_]: 1.399e-05 [merge_forward]: 9.70002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.007e-05 [j_node_and_user_rematch]: 2.606e-05 [meta_fg_expand]: 0.00186354 [replace_old_param]: 8.809e-05 [inline_without_move]: 6.302e-05 [renormalize]: 0.0144643 [add_forward_monad_depend]: 1.664e-05 [auto_monad_grad]: 6.79001e-06 [auto_monad_eliminator]: 6.316e-05 [cse]: 0.0002659 [replace_applicator]: 9.606e-05 [Cycle 2]: 0.00351759, [27] [switch_simplify]: 4.286e-05 [loop_unroll]: 4.15e-05 [a_1]: 0.00123606 [with_stream_mark]: 2.422e-05 [recompute_prepare]: 1.03e-05 [updatestate_depend_eliminate]: 4.37998e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.56998e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.58e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 8.04e-05 [replace_old_param]: 8.03999e-06 [inline_without_move]: 6.13002e-06 [renormalize]: 0.00172179 [add_forward_monad_depend]: 9.97999e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.479e-05 [cse]: 3.035e-05 [replace_applicator]: 2.011e-05 [Cycle 3]: 0.00027826, [27] [switch_simplify]: 4.73001e-06 [loop_unroll]: 4.25999e-06 [a_1]: 4.526e-05 [with_stream_mark]: 1.247e-05 [recompute_prepare]: 3.51001e-06 [updatestate_depend_eliminate]: 2.53e-06 [updatestate_assign_eliminate]: 1.99e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 3.78999e-06 [updatestate_useless_node_eliminater]: 3.65998e-06 [accelerated_algorithm]: 3.55998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 3.52002e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.392e-05 [j_node_and_user_rematch]: 6.26e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 3.73001e-06 [inline_without_move]: 3.10998e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 4.65999e-06 [cse]: 9.36e-06 [replace_applicator]: 4.60001e-06 [py_interpret_to_execute_after_opt_a]: 1.358e-05 [rewriter_after_opt_a]: 3.982e-05 [convert_after_rewriter]: 6.26998e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.00075879 [jit_opt_b]: 4.486e-05, [1] [Cycle 1]: 3.57e-05, [2] [frontend_op_eliminate]: 1.008e-05 [inline_after_opt_a]: 1.314e-05 [cconv]: 3.401e-05 [loop_unroll]: 0.00055408 [jit_opt_after_cconv]: 0.0001506, [1] [Cycle 1]: 0.00014277, [11] [c_1]: 1.343e-05 [parameter_eliminate]: 4.05998e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 1.90001e-06 [cse]: 2.934e-05 [call_graph_tuple_transform]: 1.833e-05 [tuple_list_get_item_eliminator]: 3.95998e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 7.2e-07 [switch_simplify]: 3.7e-06 [remove_dup_value]: 1.378e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 6.19999e-06 [add_recomputation]: 4.046e-05 [cse_after_recomputation]: 2.044e-05, [1] [Cycle 1]: 1.471e-05, [1] [cse]: 8.51002e-06 [auto_monad_reorder]: 1.32e-05 [get_jit_bprop_graph]: 2.49001e-06 [rewriter_after_jit_bprop_graph]: 6.32001e-06 [opt_after_jit_grad]: 0.00049119 [symbol_engine_optimizer]: 7.254e-05, [1] [Cycle 1]: 6.6e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 5.91e-06 [elim_not_effective]: 1.12e-05 [opt_reshape]: 4.77e-06 [fold_const_symbol]: 6.02001e-06 [renormalize]: 6.19999e-07 [validate]: 3.743e-05 Sums bootstrap : 0.000263s : 0.31% type_inference : 0.060720s : 71.11% event_method : 0.000262s : 0.31% auto_monad : 0.000101s : 0.12% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000032s : 0.04% rewriter_before_opt_a : 0.000115s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000128s : 0.15% jit_opt_a.loop_unroll : 0.000090s : 0.11% jit_opt_a.a_1 : 0.002247s : 2.63% jit_opt_a.with_stream_mark : 0.000071s : 0.08% jit_opt_a.recompute_prepare : 0.000037s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.03% jit_opt_a.accelerated_algorithm : 0.000023s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.03% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.05% jit_opt_a.meta_fg_expand : 0.001946s : 2.28% jit_opt_a.replace_old_param : 0.000100s : 0.12% jit_opt_a.inline_without_move : 0.000072s : 0.08% jit_opt_a.renormalize : 0.016186s : 18.96% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.03% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.10% jit_opt_a.cse : 0.000306s : 0.36% jit_opt_a.replace_applicator : 0.000121s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000759s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.02% cconv : 0.000034s : 0.04% loop_unroll : 0.000554s : 0.65% jit_opt_after_cconv.c_1 : 0.000013s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000040s : 0.05% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000491s : 0.58% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.04% Time group info: ------[substitution.] 0.000574 101 0.27% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.97% : 0.000006s : 1: substitution.graph_param_transform 63.11% : 0.000362s : 12: substitution.inline 3.42% : 0.000020s : 2: substitution.inline_without_move 1.77% : 0.000010s : 11: substitution.j_node_and_user_rematch 2.04% : 0.000012s : 7: substitution.minmaximum_grad 1.42% : 0.000008s : 5: substitution.partial_eliminate 1.90% : 0.000011s : 11: substitution.remove_not_recompute_node 6.35% : 0.000036s : 10: substitution.replace_applicator 1.18% : 0.000007s : 10: substitution.replace_old_param 0.44% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.35% : 0.000008s : 1: substitution.tile_eliminate 4.58% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.86% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 8.15% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060621 2 96.58% : 0.058547s : 1: type_inference.infer 3.42% : 0.002074s : 1: type_inference.specialize ------[replace.] 0.000180 19 64.92% : 0.000117s : 12: replace.inline 35.08% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000380 19 93.59% : 0.000355s : 12: match.inline 6.41% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000379 2542 1.65% : 0.000006s : 44: predicate.accumulaten_eliminater 0.29% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000005s : 44: predicate.addn_check_dump 1.65% : 0.000006s : 44: predicate.addn_zero_filter 2.26% : 0.000009s : 44: predicate.arithmetic_simplify 1.59% : 0.000006s : 44: predicate.cast_eliminate 0.10% : 0.000000s : 1: predicate.check_bprop_eliminate 1.38% : 0.000005s : 44: predicate.compare_switch_simplify 1.44% : 0.000005s : 44: predicate.depend_value_elim 1.37% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.50% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.33% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.08% : 0.000000s : 1: predicate.elim_not_effective 0.17% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.52% : 0.000006s : 44: predicate.environ_get_depend_swap 1.52% : 0.000006s : 44: predicate.environ_get_eliminate 1.40% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.04% : 0.000000s : 1: predicate.fold_const_symbol 0.79% : 0.000003s : 17: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 5.00% : 0.000019s : 65: predicate.inline 2.07% : 0.000008s : 45: predicate.inline_without_move 0.33% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.87% : 0.000003s : 17: predicate.less_batch_normalization 1.84% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.88% : 0.000007s : 52: predicate.load_eliminater 0.52% : 0.000002s : 1: predicate.loop_unroll_after_grad 3.40% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.59% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.54% : 0.000006s : 44: predicate.merge_addn 1.56% : 0.000006s : 44: predicate.minmaximum_grad 0.62% : 0.000002s : 1: predicate.mutable_eliminate 0.19% : 0.000001s : 1: predicate.opt_reshape 2.29% : 0.000009s : 52: predicate.partial_eliminate 1.49% : 0.000006s : 44: predicate.print_const_string_wrapper 2.00% : 0.000008s : 44: predicate.reduce_eliminate 1.85% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 17: predicate.remove_not_recompute_node 3.02% : 0.000011s : 96: predicate.replace_applicator 1.22% : 0.000005s : 45: predicate.replace_old_param 0.11% : 0.000000s : 1: predicate.reset_defer_inline 1.57% : 0.000006s : 44: predicate.reshape_eliminate 1.57% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.44% : 0.000005s : 44: predicate.same_eliminate 0.50% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.20% : 0.000001s : 2: predicate.special_op_eliminate 0.78% : 0.000003s : 17: predicate.specialize_transform 1.69% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.72% : 0.000010s : 63: predicate.switch_defer_inline 2.45% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.56% : 0.000025s : 157: predicate.switch_simplify 1.67% : 0.000006s : 44: predicate.tile_eliminate 1.48% : 0.000006s : 44: predicate.transpose_eliminate 1.81% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.77% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.77% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.81% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.77% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.54% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.78% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003956 50 77.38% : 0.003061s : 34: func_graph_cloner_run.FuncGraphClonerGraph 22.62% : 0.000895s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108994 87 0.04% : 0.000044s : 1: add_recomputation 0.10% : 0.000108s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.27% : 0.000289s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.25% : 0.000270s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 23.71% : 0.025840s : 1: jit_opt_a 0.14% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000048s : 1: jit_opt_b 0.52% : 0.000565s : 1: loop_unroll 0.71% : 0.000772s : 1: mutable_eliminate 2.70% : 0.002938s : 39: opt.transform.jit_opt_a 0.03% : 0.000036s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000025s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000500s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000035s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 12.59% : 0.013726s : 2: renormalize.infer 2.23% : 0.002435s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.11% : 0.000119s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 55.73% : 0.060739s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.290.117 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007cf70> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.290.805 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0121003, [30] [bootstrap]: 0.00026292 [type_inference]: 0.00430374 [event_method]: 1.663e-05 [auto_monad]: 7.653e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 3.207e-05 [rewriter_before_opt_a]: 7.523e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00523191, [2] [Cycle 1]: 0.0018146, [27] [switch_simplify]: 5.107e-05 [loop_unroll]: 2.877e-05 [a_1]: 0.0007845 [with_stream_mark]: 1.973e-05 [recompute_prepare]: 8.77e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.92002e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.28002e-06 [get_grad_eliminate_]: 5.66998e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.24e-06 [renormalize]: 0.00058358 [add_forward_monad_depend]: 6.24999e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.521e-05 [cse]: 3.644e-05 [replace_applicator]: 1.315e-05 [Cycle 2]: 0.00032791, [27] [switch_simplify]: 6.10002e-06 [loop_unroll]: 4.84e-06 [a_1]: 9.052e-05 [with_stream_mark]: 1.018e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.85999e-06 [accelerated_algorithm]: 5.02999e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 4.79998e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.66998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 8.00999e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 7.56001e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.52001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.476e-05 [replace_applicator]: 4.84e-06 [py_interpret_to_execute_after_opt_a]: 1.042e-05 [rewriter_after_opt_a]: 3.621e-05 [convert_after_rewriter]: 6.98998e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00052256 [jit_opt_b]: 5.493e-05, [1] [Cycle 1]: 4.672e-05, [2] [frontend_op_eliminate]: 1.807e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.772e-05 [loop_unroll]: 0.00041543 [jit_opt_after_cconv]: 0.00015159, [1] [Cycle 1]: 0.00014475, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 3.78999e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.416e-05 [call_graph_tuple_transform]: 2.019e-05 [tuple_list_get_item_eliminator]: 5.54998e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.72e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 6.22001e-06 [add_recomputation]: 5.117e-05 [cse_after_recomputation]: 2.421e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.908e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.91998e-06 [opt_after_jit_grad]: 0.00045263 [symbol_engine_optimizer]: 7.087e-05, [1] [Cycle 1]: 6.504e-05, [6] [build]: 3.08998e-06 [elim_shapecalc]: 7.52002e-06 [elim_not_effective]: 1.237e-05 [opt_reshape]: 5.59e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 3.30008e-07 [validate]: 4.004e-05 Sums bootstrap : 0.000263s : 3.12% type_inference : 0.004304s : 51.03% event_method : 0.000017s : 0.20% auto_monad : 0.000077s : 0.91% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000032s : 0.38% rewriter_before_opt_a : 0.000075s : 0.89% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000057s : 0.68% jit_opt_a.loop_unroll : 0.000034s : 0.40% jit_opt_a.a_1 : 0.000875s : 10.38% jit_opt_a.with_stream_mark : 0.000030s : 0.35% jit_opt_a.recompute_prepare : 0.000014s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.39% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000584s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000051s : 0.61% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000036s : 0.43% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000523s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.21% jit_opt_b.inline_after_opt_a : 0.000017s : 0.20% cconv : 0.000028s : 0.33% loop_unroll : 0.000415s : 4.93% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000024s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000017s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000051s : 0.61% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000019s : 0.23% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000453s : 5.37% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.47% Time group info: ------[substitution.] 0.000192 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000002s : 2: substitution.fold_const_symbol 3.23% : 0.000006s : 3: substitution.graph_param_transform 81.17% : 0.000156s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.64% : 0.000005s : 2: substitution.replace_old_param 6.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004244 2 82.26% : 0.003491s : 1: type_inference.infer 17.74% : 0.000753s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.86% : 0.000043s : 4: replace.inline 32.14% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.08% : 0.000154s : 4: match.inline 6.92% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.53% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.18% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 2.03% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 3.01% : 0.000004s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.64% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.11% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000579 13 54.76% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.32% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.92% : 0.000231s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013833 72 0.39% : 0.000054s : 1: add_recomputation 0.58% : 0.000080s : 1: auto_monad 0.16% : 0.000022s : 1: auto_monad_reorder 2.04% : 0.000282s : 1: bootstrap 0.22% : 0.000030s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.84% : 0.005235s : 1: jit_opt_a 1.12% : 0.000154s : 1: jit_opt_after_cconv 0.42% : 0.000058s : 1: jit_opt_b 3.06% : 0.000424s : 1: loop_unroll 3.84% : 0.000531s : 1: mutable_eliminate 7.88% : 0.001089s : 26: opt.transform.jit_opt_a 0.35% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000028s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.33% : 0.000461s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000035s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000020s : 1: remove_dup_value 2.19% : 0.000303s : 1: renormalize.infer 1.96% : 0.000272s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000039s : 1: rewriter_after_opt_a 0.56% : 0.000078s : 1: rewriter_before_opt_a 0.53% : 0.000073s : 1: symbol_engine_optimizer 31.20% : 0.004316s : 1: type_inference TotalTime = 0.0335712, [30] [bootstrap]: 0.00037884 [type_inference]: 0.0230266 [event_method]: 2.517e-05 [auto_monad]: 9.206e-05 [graph_reusing]: 6.11998e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00015954 [rewriter_before_opt_a]: 9.015e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00707222, [2] [Cycle 1]: 0.00277821, [27] [switch_simplify]: 6.911e-05 [loop_unroll]: 3.178e-05 [a_1]: 0.00070903 [with_stream_mark]: 2.581e-05 [recompute_prepare]: 9.02e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 6.18998e-06 [renormalize]: 0.00155001 [add_forward_monad_depend]: 7.47002e-06 [auto_monad_grad]: 2.78998e-06 [auto_monad_eliminator]: 1.897e-05 [cse]: 4.032e-05 [replace_applicator]: 1.834e-05 [Cycle 2]: 0.00035377, [27] [switch_simplify]: 6.57002e-06 [loop_unroll]: 5.63997e-06 [a_1]: 9.619e-05 [with_stream_mark]: 1.286e-05 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 4.81002e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 1.49003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.39998e-06 [inline_without_move]: 5.78002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 7.5e-06 [cse]: 1.68e-05 [replace_applicator]: 6.59001e-06 [py_interpret_to_execute_after_opt_a]: 1.74e-05 [rewriter_after_opt_a]: 4.499e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00077313 [jit_opt_b]: 5.454e-05, [1] [Cycle 1]: 4.585e-05, [2] [frontend_op_eliminate]: 1.643e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 3.426e-05 [loop_unroll]: 0.00051678 [jit_opt_after_cconv]: 0.00017731, [1] [Cycle 1]: 0.0001697, [11] [c_1]: 2.218e-05 [parameter_eliminate]: 4.55999e-06 [updatestate_depend_eliminate]: 9.22001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.64e-05 [call_graph_tuple_transform]: 2.503e-05 [tuple_list_get_item_eliminator]: 5.78002e-06 [none_parameter_eliminate]: 2.12999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.94001e-06 [remove_dup_value]: 1.579e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 5.996e-05 [cse_after_recomputation]: 2.802e-05, [1] [Cycle 1]: 2.226e-05, [1] [cse]: 1.499e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 7.79002e-06 [opt_after_jit_grad]: 0.00054794 [symbol_engine_optimizer]: 8.589e-05, [1] [Cycle 1]: 7.766e-05, [6] [build]: 5.71003e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.529e-05 [opt_reshape]: 7.56999e-06 [fold_const_symbol]: 9.29998e-06 [renormalize]: 5.89993e-07 [validate]: 4.934e-05 Sums bootstrap : 0.000379s : 1.31% type_inference : 0.023027s : 79.62% event_method : 0.000025s : 0.09% auto_monad : 0.000092s : 0.32% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000160s : 0.55% rewriter_before_opt_a : 0.000090s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000805s : 2.78% jit_opt_a.with_stream_mark : 0.000039s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001550s : 5.36% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000057s : 0.20% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000045s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000773s : 2.67% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000034s : 0.12% loop_unroll : 0.000517s : 1.79% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000060s : 0.21% cse_after_recomputation.cse : 0.000015s : 0.05% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000548s : 1.89% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.17% TotalTime = 0.116197, [30] [bootstrap]: 0.00036208 [type_inference]: 0.105245 [event_method]: 1.91e-05 [auto_monad]: 0.00017105 [graph_reusing]: 4.55001e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 0.00033961 [rewriter_before_opt_a]: 8.023e-05 [expand_dump_flag]: 3.03998e-06 [jit_opt_a]: 0.00762596, [2] [Cycle 1]: 0.00385224, [27] [switch_simplify]: 5.327e-05 [loop_unroll]: 3.173e-05 [a_1]: 0.00059079 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 8.72998e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 8.784e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 0.00275265 [add_forward_monad_depend]: 6.44001e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.583e-05 [cse]: 2.364e-05 [replace_applicator]: 1.571e-05 [Cycle 2]: 0.00036179, [27] [switch_simplify]: 6.71999e-06 [loop_unroll]: 6.13002e-06 [a_1]: 0.0001228 [with_stream_mark]: 1.084e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 1.98002e-06 [parameter_eliminate]: 1.23002e-06 [specialize_transform]: 5.71003e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.57002e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.36002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.127e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.178e-05 [rewriter_after_opt_a]: 3.446e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00063051 [jit_opt_b]: 0.00015437, [1] [Cycle 1]: 4.567e-05, [2] [frontend_op_eliminate]: 1.799e-05 [inline_after_opt_a]: 1.675e-05 [cconv]: 2.22e-05 [loop_unroll]: 0.00045326 [jit_opt_after_cconv]: 0.00014682, [1] [Cycle 1]: 0.00014034, [11] [c_1]: 2.571e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.26002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 1.941e-05 [call_graph_tuple_transform]: 2.026e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.87999e-06 [remove_dup_value]: 1.407e-05 [partial_unused_args_eliminate]: 1.92001e-06 [environ_conv]: 7.64002e-06 [add_recomputation]: 3.981e-05 [cse_after_recomputation]: 2.158e-05, [1] [Cycle 1]: 1.662e-05, [1] [cse]: 1.116e-05 [auto_monad_reorder]: 1.425e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00045746 [symbol_engine_optimizer]: 7.245e-05, [1] [Cycle 1]: 6.683e-05, [6] [build]: 2.79999e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.367e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 9.07001e-06 [renormalize]: 4.30009e-07 [validate]: 5.527e-05 Sums bootstrap : 0.000362s : 0.32% type_inference : 0.105245s : 93.89% event_method : 0.000019s : 0.02% auto_monad : 0.000171s : 0.15% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000340s : 0.30% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000714s : 0.64% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000103s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002753s : 2.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000631s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000022s : 0.02% loop_unroll : 0.000453s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000040s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000457s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.05% Time group info: ------[substitution.] 0.000338 23 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.75% : 0.000006s : 3: substitution.graph_param_transform 88.59% : 0.000299s : 4: substitution.inline 1.46% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.49% : 0.000005s : 4: substitution.remove_not_recompute_node 1.62% : 0.000005s : 2: substitution.replace_old_param 4.11% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022928 2 90.98% : 0.020859s : 1: type_inference.infer 9.02% : 0.002069s : 1: type_inference.specialize ------[replace.] 0.000090 6 67.76% : 0.000061s : 4: replace.inline 32.24% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000309 6 95.93% : 0.000297s : 4: match.inline 4.07% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.21% : 0.000002s : 10: predicate.accumulaten_eliminater 1.55% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000002s : 10: predicate.addn_zero_filter 1.61% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.48% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.65% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.77% : 0.000001s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.52% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.75% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.49% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.23% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001069 13 42.52% : 0.000455s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.55% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.93% : 0.000555s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036231 72 0.18% : 0.000064s : 1: add_recomputation 0.27% : 0.000097s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.10% : 0.000400s : 1: bootstrap 0.10% : 0.000037s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000030s : 1: cse_after_recomputation 0.11% : 0.000039s : 1: environ_conv 0.09% : 0.000031s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.53% : 0.007077s : 1: jit_opt_a 0.50% : 0.000180s : 1: jit_opt_after_cconv 0.16% : 0.000057s : 1: jit_opt_b 1.46% : 0.000529s : 1: loop_unroll 2.17% : 0.000785s : 1: mutable_eliminate 2.91% : 0.001053s : 26: opt.transform.jit_opt_a 0.15% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000023s : 1: opt.transform.mutable_eliminate 0.08% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000560s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.000163s : 1: py_interpret_to_execute 0.06% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.63% : 0.000951s : 1: renormalize.infer 1.62% : 0.000588s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000049s : 1: rewriter_after_opt_a 0.26% : 0.000096s : 1: rewriter_before_opt_a 0.25% : 0.000089s : 1: symbol_engine_optimizer 63.63% : 0.023055s : 1: type_inference Time group info: ------[substitution.] 0.000213 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.81% : 0.000006s : 4: substitution.graph_param_transform 83.97% : 0.000179s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 5.35% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105169 2 97.77% : 0.102818s : 1: type_inference.infer 2.23% : 0.002350s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.87% : 0.000050s : 4: replace.inline 32.13% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 94.54% : 0.000177s : 4: match.inline 5.46% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.84% : 0.000002s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.24% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.16% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.41% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.90% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.86% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003018 26 74.44% : 0.002247s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.44% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.12% : 0.000728s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120023 72 0.04% : 0.000043s : 1: add_recomputation 0.15% : 0.000178s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.32% : 0.000383s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.36% : 0.007630s : 1: jit_opt_a 0.12% : 0.000149s : 1: jit_opt_after_cconv 0.13% : 0.000160s : 1: jit_opt_b 0.38% : 0.000461s : 1: loop_unroll 0.53% : 0.000639s : 1: mutable_eliminate 0.85% : 0.001021s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000345s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.64% : 0.001964s : 1: renormalize.infer 0.65% : 0.000779s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 87.70% : 0.105260s : 1: type_inference TotalTime = 0.0455749, [30] [bootstrap]: 0.00025406 [type_inference]: 0.0276705 [event_method]: 3.704e-05 [auto_monad]: 0.00013962 [graph_reusing]: 1.013e-05 [pre_auto_parallel]: 4.32e-06 [py_interpret_to_execute]: 4.447e-05 [rewriter_before_opt_a]: 0.00016839 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.0149943, [3] [Cycle 1]: 0.00770213, [27] [switch_simplify]: 0.00017868 [loop_unroll]: 6.612e-05 [a_1]: 0.00124992 [with_stream_mark]: 3.509e-05 [recompute_prepare]: 2.088e-05 [updatestate_depend_eliminate]: 9.12999e-06 [updatestate_assign_eliminate]: 7.69002e-06 [updatestate_loads_eliminate]: 6.56999e-06 [parameter_eliminate]: 3.01999e-06 [specialize_transform]: 1.395e-05 [updatestate_useless_node_eliminater]: 1.302e-05 [accelerated_algorithm]: 1.298e-05 [meta_shard_fg_expand]: 4.35999e-06 [get_grad_eliminate_]: 1.297e-05 [merge_forward]: 9.07999e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.933e-05 [j_node_and_user_rematch]: 2.549e-05 [meta_fg_expand]: 0.00180064 [replace_old_param]: 6.472e-05 [inline_without_move]: 5.709e-05 [renormalize]: 0.00343561 [add_forward_monad_depend]: 1.271e-05 [auto_monad_grad]: 6.09001e-06 [auto_monad_eliminator]: 5.98e-05 [cse]: 0.00021029 [replace_applicator]: 8.231e-05 [Cycle 2]: 0.00345499, [27] [switch_simplify]: 3.984e-05 [loop_unroll]: 3.87e-05 [a_1]: 0.00112151 [with_stream_mark]: 1.949e-05 [recompute_prepare]: 9.61e-06 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 3.64002e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 8.69e-06 [updatestate_useless_node_eliminater]: 8.33001e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 7.14001e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.774e-05 [j_node_and_user_rematch]: 1.154e-05 [meta_fg_expand]: 0.00025577 [replace_old_param]: 1.227e-05 [inline_without_move]: 7.36001e-06 [renormalize]: 0.00162767 [add_forward_monad_depend]: 6.21998e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.219e-05 [cse]: 2.337e-05 [replace_applicator]: 1.306e-05 [Cycle 3]: 0.00024832, [27] [switch_simplify]: 4.03999e-06 [loop_unroll]: 3.83001e-06 [a_1]: 3.638e-05 [with_stream_mark]: 1.072e-05 [recompute_prepare]: 3.61999e-06 [updatestate_depend_eliminate]: 2.03002e-06 [updatestate_assign_eliminate]: 1.80001e-06 [updatestate_loads_eliminate]: 1.66e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 3.29001e-06 [updatestate_useless_node_eliminater]: 3.30998e-06 [accelerated_algorithm]: 3.23e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 3.11999e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.201e-05 [j_node_and_user_rematch]: 6.07001e-06 [meta_fg_expand]: 1.02e-06 [replace_old_param]: 3.04001e-06 [inline_without_move]: 3.13e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 3.79002e-06 [cse]: 7.92e-06 [replace_applicator]: 3.60998e-06 [py_interpret_to_execute_after_opt_a]: 1.35e-05 [rewriter_after_opt_a]: 3.813e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.0007188 [jit_opt_b]: 4.125e-05, [1] [Cycle 1]: 3.399e-05, [2] [frontend_op_eliminate]: 1.042e-05 [inline_after_opt_a]: 1.118e-05 [cconv]: 2.628e-05 [loop_unroll]: 0.00041725 [jit_opt_after_cconv]: 0.00012707, [1] [Cycle 1]: 0.00012062, [11] [c_1]: 1.14e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 1.86998e-06 [updatestate_loads_eliminate]: 1.84998e-06 [cse]: 2.086e-05 [call_graph_tuple_transform]: 1.451e-05 [tuple_list_get_item_eliminator]: 3.88001e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 3.4e-06 [remove_dup_value]: 1.436e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 4.82e-06 [add_recomputation]: 3.796e-05 [cse_after_recomputation]: 1.956e-05, [1] [Cycle 1]: 1.458e-05, [1] [cse]: 7.82e-06 [auto_monad_reorder]: 1.309e-05 [get_jit_bprop_graph]: 2.73e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00045015 [symbol_engine_optimizer]: 6.346e-05, [1] [Cycle 1]: 5.76e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 5.55001e-06 [elim_not_effective]: 9.61e-06 [opt_reshape]: 4.24997e-06 [fold_const_symbol]: 5.76998e-06 [renormalize]: 2.89991e-07 [validate]: 4.25e-05 Sums bootstrap : 0.000254s : 0.62% type_inference : 0.027671s : 67.35% event_method : 0.000037s : 0.09% auto_monad : 0.000140s : 0.34% graph_reusing : 0.000010s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000044s : 0.11% rewriter_before_opt_a : 0.000168s : 0.41% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000223s : 0.54% jit_opt_a.loop_unroll : 0.000109s : 0.26% jit_opt_a.a_1 : 0.002408s : 5.86% jit_opt_a.with_stream_mark : 0.000065s : 0.16% jit_opt_a.recompute_prepare : 0.000034s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.03% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000026s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.06% jit_opt_a.accelerated_algorithm : 0.000023s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.06% jit_opt_a.merge_forward : 0.000016s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000059s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.10% jit_opt_a.meta_fg_expand : 0.002057s : 5.01% jit_opt_a.replace_old_param : 0.000080s : 0.19% jit_opt_a.inline_without_move : 0.000068s : 0.16% jit_opt_a.renormalize : 0.005063s : 12.32% jit_opt_a.add_forward_monad_depend : 0.000020s : 0.05% jit_opt_a.auto_monad_grad : 0.000009s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000076s : 0.18% jit_opt_a.cse : 0.000242s : 0.59% jit_opt_a.replace_applicator : 0.000099s : 0.24% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000038s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000719s : 1.75% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000011s : 0.03% cconv : 0.000026s : 0.06% loop_unroll : 0.000417s : 1.02% jit_opt_after_cconv.c_1 : 0.000011s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000038s : 0.09% cse_after_recomputation.cse : 0.000008s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000450s : 1.10% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.10% Time group info: ------[substitution.] 0.000618 112 0.28% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.73% : 0.000005s : 1: substitution.graph_param_transform 65.25% : 0.000403s : 19: substitution.inline 2.95% : 0.000018s : 2: substitution.inline_without_move 1.86% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.86% : 0.000012s : 7: substitution.minmaximum_grad 1.18% : 0.000007s : 5: substitution.partial_eliminate 1.64% : 0.000010s : 12: substitution.remove_not_recompute_node 4.98% : 0.000031s : 10: substitution.replace_applicator 1.10% : 0.000007s : 8: substitution.replace_old_param 1.20% : 0.000007s : 1: substitution.reshape_eliminate 0.45% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.66% : 0.000010s : 2: substitution.switch_simplify 0.88% : 0.000005s : 1: substitution.tile_eliminate 3.56% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.62% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.65% : 0.000047s : 15: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027492 2 91.43% : 0.025136s : 1: type_inference.infer 8.57% : 0.002355s : 1: type_inference.specialize ------[replace.] 0.000249 29 55.71% : 0.000139s : 19: replace.inline 19.22% : 0.000048s : 2: replace.switch_simplify 25.07% : 0.000062s : 8: replace.tuple_list_get_item_eliminator ------[match.] 0.000427 29 91.96% : 0.000393s : 19: match.inline 2.15% : 0.000009s : 2: match.switch_simplify 5.90% : 0.000025s : 8: match.tuple_list_get_item_eliminator ------[predicate.] 0.000421 2841 1.64% : 0.000007s : 49: predicate.accumulaten_eliminater 0.19% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.49% : 0.000006s : 49: predicate.addn_check_dump 1.78% : 0.000007s : 49: predicate.addn_zero_filter 1.91% : 0.000008s : 49: predicate.arithmetic_simplify 1.62% : 0.000007s : 49: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.47% : 0.000006s : 49: predicate.compare_switch_simplify 1.58% : 0.000007s : 49: predicate.depend_value_elim 1.56% : 0.000007s : 49: predicate.dict_get_item_const_eliminator 1.52% : 0.000006s : 49: predicate.dict_get_item_eliminator 1.58% : 0.000007s : 49: predicate.dict_set_item_eliminator 0.19% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.05% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000007s : 49: predicate.environ_add_const_eliminate 1.49% : 0.000006s : 49: predicate.environ_get_add_eliminate 1.50% : 0.000006s : 49: predicate.environ_get_depend_swap 1.55% : 0.000007s : 49: predicate.environ_get_eliminate 1.51% : 0.000006s : 49: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.70% : 0.000003s : 17: predicate.get_grad_eliminate 0.05% : 0.000000s : 1: predicate.graph_param_transform 4.27% : 0.000018s : 78: predicate.inline 1.76% : 0.000007s : 41: predicate.inline_without_move 0.29% : 0.000001s : 17: predicate.j_node_and_user_rematch 0.69% : 0.000003s : 17: predicate.less_batch_normalization 1.84% : 0.000008s : 57: predicate.list_to_tuple_eliminator_ 1.89% : 0.000008s : 58: predicate.load_eliminater 0.33% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.93% : 0.000017s : 115: predicate.loop_unroll_before_grad 1.71% : 0.000007s : 50: predicate.make_slice_get_slice_eliminator 1.58% : 0.000007s : 49: predicate.merge_addn 1.60% : 0.000007s : 49: predicate.minmaximum_grad 0.31% : 0.000001s : 1: predicate.mutable_eliminate 0.09% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000010s : 58: predicate.partial_eliminate 1.62% : 0.000007s : 49: predicate.print_const_string_wrapper 1.93% : 0.000008s : 49: predicate.reduce_eliminate 1.89% : 0.000008s : 57: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000002s : 17: predicate.remove_not_recompute_node 2.45% : 0.000010s : 100: predicate.replace_applicator 0.98% : 0.000004s : 41: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000007s : 49: predicate.reshape_eliminate 1.65% : 0.000007s : 49: predicate.row_tensor_add_zeros_like 0.35% : 0.000001s : 1: predicate.row_tensor_eliminate 1.57% : 0.000007s : 49: predicate.same_eliminate 0.46% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.10% : 0.000000s : 2: predicate.special_op_eliminate 0.71% : 0.000003s : 17: predicate.specialize_transform 1.69% : 0.000007s : 49: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000007s : 49: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.95% : 0.000012s : 76: predicate.switch_defer_inline 2.73% : 0.000011s : 76: predicate.switch_layer_defer_inline 7.31% : 0.000031s : 196: predicate.switch_simplify 1.55% : 0.000007s : 49: predicate.tile_eliminate 1.52% : 0.000006s : 49: predicate.transpose_eliminate 1.84% : 0.000008s : 49: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000007s : 49: predicate.tuple_list_get_item_depend_reorder 3.19% : 0.000013s : 59: predicate.tuple_list_get_item_eliminator 1.90% : 0.000008s : 49: predicate.tuple_list_set_item_eliminator 1.84% : 0.000008s : 57: predicate.tuple_to_list_eliminator_ 1.82% : 0.000008s : 58: predicate.updatestate_pure_node_eliminater 2.69% : 0.000011s : 75: predicate.updatestate_useless_node_eliminater 1.76% : 0.000007s : 49: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.18% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002809 40 63.24% : 0.001776s : 17: func_graph_cloner_run.FuncGraphClonerGraph 36.76% : 0.001032s : 23: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053793 87 0.08% : 0.000041s : 1: add_recomputation 0.27% : 0.000145s : 1: auto_monad 0.03% : 0.000015s : 1: auto_monad_reorder 0.53% : 0.000283s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.08% : 0.000042s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000013s : 1: graph_reusing 27.88% : 0.014998s : 1: jit_opt_a 0.24% : 0.000130s : 1: jit_opt_after_cconv 0.08% : 0.000044s : 1: jit_opt_b 0.79% : 0.000426s : 1: loop_unroll 1.35% : 0.000728s : 1: mutable_eliminate 5.89% : 0.003168s : 39: opt.transform.jit_opt_a 0.06% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000011s : 1: opt.transform.mutable_eliminate 0.03% : 0.000014s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.85% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.09% : 0.000047s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 6.14% : 0.003302s : 2: renormalize.infer 3.24% : 0.001743s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000041s : 1: rewriter_after_opt_a 0.32% : 0.000172s : 1: rewriter_before_opt_a 0.12% : 0.000066s : 1: symbol_engine_optimizer 51.48% : 0.027695s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.344.253 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f160> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.344.918 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0357078, [30] [bootstrap]: 0.0002586 [type_inference]: 0.0113935 [event_method]: 5.01e-05 [auto_monad]: 9.688e-05 [graph_reusing]: 7.03e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 2.906e-05 [rewriter_before_opt_a]: 0.00011202 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0214152, [3] [Cycle 1]: 0.014456, [27] [switch_simplify]: 7.401e-05 [loop_unroll]: 3.934e-05 [a_1]: 0.00093192 [with_stream_mark]: 3.596e-05 [recompute_prepare]: 2.116e-05 [updatestate_depend_eliminate]: 9.88002e-06 [updatestate_assign_eliminate]: 8.08999e-06 [updatestate_loads_eliminate]: 7.11001e-06 [parameter_eliminate]: 2.89001e-06 [specialize_transform]: 1.366e-05 [updatestate_useless_node_eliminater]: 1.275e-05 [accelerated_algorithm]: 1.327e-05 [meta_shard_fg_expand]: 5.25999e-06 [get_grad_eliminate_]: 1.267e-05 [merge_forward]: 8.87999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.767e-05 [j_node_and_user_rematch]: 2.453e-05 [meta_fg_expand]: 0.00207754 [replace_old_param]: 8.093e-05 [inline_without_move]: 6.717e-05 [renormalize]: 0.0102306 [add_forward_monad_depend]: 1.791e-05 [auto_monad_grad]: 6.83e-06 [auto_monad_eliminator]: 6.465e-05 [cse]: 0.00025211 [replace_applicator]: 9.59e-05 [Cycle 2]: 0.00308408, [27] [switch_simplify]: 4.266e-05 [loop_unroll]: 4.009e-05 [a_1]: 0.00113891 [with_stream_mark]: 2.097e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 6.712e-05 [replace_old_param]: 6.51999e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 0.00142568 [add_forward_monad_depend]: 7.2e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.437e-05 [cse]: 2.492e-05 [replace_applicator]: 1.661e-05 [Cycle 3]: 0.00026529, [27] [switch_simplify]: 4.37e-06 [loop_unroll]: 3.86999e-06 [a_1]: 4.116e-05 [with_stream_mark]: 1.171e-05 [recompute_prepare]: 3.48e-06 [updatestate_depend_eliminate]: 2.44999e-06 [updatestate_assign_eliminate]: 1.83002e-06 [updatestate_loads_eliminate]: 1.64e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 3.39001e-06 [updatestate_useless_node_eliminater]: 3.08e-06 [accelerated_algorithm]: 3.28e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 3.25002e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 2.61e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.295e-05 [j_node_and_user_rematch]: 6.17999e-06 [meta_fg_expand]: 1.40999e-06 [replace_old_param]: 3.35998e-06 [inline_without_move]: 3.43e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 3.53999e-06 [cse]: 9.52999e-06 [replace_applicator]: 3.73999e-06 [py_interpret_to_execute_after_opt_a]: 1.333e-05 [rewriter_after_opt_a]: 3.713e-05 [convert_after_rewriter]: 6.46999e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00075516 [jit_opt_b]: 4.314e-05, [1] [Cycle 1]: 3.476e-05, [2] [frontend_op_eliminate]: 1.048e-05 [inline_after_opt_a]: 1.189e-05 [cconv]: 2.829e-05 [loop_unroll]: 0.00043878 [jit_opt_after_cconv]: 0.00013273, [1] [Cycle 1]: 0.00012622, [11] [c_1]: 1.189e-05 [parameter_eliminate]: 2.93998e-06 [updatestate_depend_eliminate]: 5.04998e-06 [updatestate_assign_eliminate]: 2.02001e-06 [updatestate_loads_eliminate]: 1.77999e-06 [cse]: 2.048e-05 [call_graph_tuple_transform]: 1.551e-05 [tuple_list_get_item_eliminator]: 3.85e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 1.25001e-06 [switch_simplify]: 4.42e-06 [remove_dup_value]: 1.373e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.05001e-06 [add_recomputation]: 3.821e-05 [cse_after_recomputation]: 2.834e-05, [1] [Cycle 1]: 2.272e-05, [1] [cse]: 8.50999e-06 [auto_monad_reorder]: 1.409e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 6.14999e-06 [opt_after_jit_grad]: 0.00046848 [symbol_engine_optimizer]: 6.857e-05, [1] [Cycle 1]: 6.25e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 6.48e-06 [elim_not_effective]: 1.02e-05 [opt_reshape]: 4.17e-06 [fold_const_symbol]: 6.11e-06 [renormalize]: 3.29979e-07 [validate]: 3.368e-05 Sums bootstrap : 0.000259s : 0.83% type_inference : 0.011394s : 36.60% event_method : 0.000050s : 0.16% auto_monad : 0.000097s : 0.31% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000029s : 0.09% rewriter_before_opt_a : 0.000112s : 0.36% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000121s : 0.39% jit_opt_a.loop_unroll : 0.000083s : 0.27% jit_opt_a.a_1 : 0.002112s : 6.78% jit_opt_a.with_stream_mark : 0.000069s : 0.22% jit_opt_a.recompute_prepare : 0.000034s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.04% jit_opt_a.parameter_eliminate : 0.000007s : 0.02% jit_opt_a.specialize_transform : 0.000023s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000021s : 0.07% jit_opt_a.accelerated_algorithm : 0.000023s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000009s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000022s : 0.07% jit_opt_a.merge_forward : 0.000016s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000055s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.13% jit_opt_a.meta_fg_expand : 0.002146s : 6.89% jit_opt_a.replace_old_param : 0.000091s : 0.29% jit_opt_a.inline_without_move : 0.000076s : 0.24% jit_opt_a.renormalize : 0.011656s : 37.45% jit_opt_a.add_forward_monad_depend : 0.000026s : 0.08% jit_opt_a.auto_monad_grad : 0.000010s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000083s : 0.27% jit_opt_a.cse : 0.000287s : 0.92% jit_opt_a.replace_applicator : 0.000116s : 0.37% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000755s : 2.43% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.03% jit_opt_b.inline_after_opt_a : 0.000012s : 0.04% cconv : 0.000028s : 0.09% loop_unroll : 0.000439s : 1.41% jit_opt_after_cconv.c_1 : 0.000012s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.01% remove_dup_value : 0.000014s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000038s : 0.12% cse_after_recomputation.cse : 0.000009s : 0.03% auto_monad_reorder : 0.000014s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000468s : 1.51% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.11% Time group info: ------[substitution.] 0.000562 101 0.30% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.81% : 0.000005s : 1: substitution.graph_param_transform 62.88% : 0.000353s : 12: substitution.inline 4.20% : 0.000024s : 2: substitution.inline_without_move 1.68% : 0.000009s : 11: substitution.j_node_and_user_rematch 2.08% : 0.000012s : 7: substitution.minmaximum_grad 1.51% : 0.000008s : 5: substitution.partial_eliminate 1.82% : 0.000010s : 11: substitution.remove_not_recompute_node 6.32% : 0.000035s : 10: substitution.replace_applicator 1.38% : 0.000008s : 10: substitution.replace_old_param 0.52% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.26% : 0.000007s : 1: substitution.tile_eliminate 4.08% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.97% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 8.02% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011301 2 88.53% : 0.010005s : 1: type_inference.infer 11.47% : 0.001296s : 1: type_inference.specialize ------[replace.] 0.000175 19 64.43% : 0.000113s : 12: replace.inline 35.57% : 0.000062s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000367 19 94.02% : 0.000345s : 12: match.inline 5.98% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000353 2324 1.57% : 0.000006s : 40: predicate.accumulaten_eliminater 0.23% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 40: predicate.addn_check_dump 1.52% : 0.000005s : 40: predicate.addn_zero_filter 1.97% : 0.000007s : 40: predicate.arithmetic_simplify 1.58% : 0.000006s : 40: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.43% : 0.000005s : 40: predicate.compare_switch_simplify 1.49% : 0.000005s : 40: predicate.depend_value_elim 1.44% : 0.000005s : 40: predicate.dict_get_item_const_eliminator 1.50% : 0.000005s : 40: predicate.dict_get_item_eliminator 1.46% : 0.000005s : 40: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.09% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000005s : 40: predicate.environ_add_const_eliminate 1.45% : 0.000005s : 40: predicate.environ_get_add_eliminate 1.49% : 0.000005s : 40: predicate.environ_get_depend_swap 1.55% : 0.000005s : 40: predicate.environ_get_eliminate 1.44% : 0.000005s : 40: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 15: predicate.get_grad_eliminate 0.09% : 0.000000s : 1: predicate.graph_param_transform 4.49% : 0.000016s : 61: predicate.inline 2.32% : 0.000008s : 43: predicate.inline_without_move 0.31% : 0.000001s : 15: predicate.j_node_and_user_rematch 0.94% : 0.000003s : 15: predicate.less_batch_normalization 1.91% : 0.000007s : 47: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 48: predicate.load_eliminater 0.34% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.29% : 0.000012s : 83: predicate.loop_unroll_before_grad 1.77% : 0.000006s : 41: predicate.make_slice_get_slice_eliminator 1.37% : 0.000005s : 40: predicate.merge_addn 1.45% : 0.000005s : 40: predicate.minmaximum_grad 0.50% : 0.000002s : 1: predicate.mutable_eliminate 0.11% : 0.000000s : 1: predicate.opt_reshape 2.41% : 0.000009s : 48: predicate.partial_eliminate 1.45% : 0.000005s : 40: predicate.print_const_string_wrapper 1.97% : 0.000007s : 40: predicate.reduce_eliminate 1.81% : 0.000006s : 47: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 15: predicate.remove_not_recompute_node 2.79% : 0.000010s : 88: predicate.replace_applicator 1.22% : 0.000004s : 43: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.59% : 0.000006s : 40: predicate.reshape_eliminate 1.49% : 0.000005s : 40: predicate.row_tensor_add_zeros_like 0.16% : 0.000001s : 1: predicate.row_tensor_eliminate 1.47% : 0.000005s : 40: predicate.same_eliminate 0.42% : 0.000001s : 15: predicate.set_cell_output_no_recompute 0.17% : 0.000001s : 2: predicate.special_op_eliminate 0.82% : 0.000003s : 15: predicate.specialize_transform 1.71% : 0.000006s : 40: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000005s : 40: predicate.stack_unstack_eliminate 0.08% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.92% : 0.000010s : 59: predicate.switch_defer_inline 2.48% : 0.000009s : 59: predicate.switch_layer_defer_inline 6.75% : 0.000024s : 143: predicate.switch_simplify 1.54% : 0.000005s : 40: predicate.tile_eliminate 1.52% : 0.000005s : 40: predicate.transpose_eliminate 1.83% : 0.000006s : 40: predicate.tuple_list_convert_item_index_to_positive 2.18% : 0.000008s : 40: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000013s : 49: predicate.tuple_list_get_item_eliminator 2.15% : 0.000008s : 40: predicate.tuple_list_set_item_eliminator 1.78% : 0.000006s : 47: predicate.tuple_to_list_eliminator_ 1.79% : 0.000006s : 48: predicate.updatestate_pure_node_eliminater 2.67% : 0.000009s : 63: predicate.updatestate_useless_node_eliminater 1.75% : 0.000006s : 40: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002272 34 63.44% : 0.001441s : 18: func_graph_cloner_run.FuncGraphClonerGraph 36.56% : 0.000831s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050129 87 0.08% : 0.000041s : 1: add_recomputation 0.20% : 0.000102s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.57% : 0.000284s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.11% : 0.000055s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 42.73% : 0.021419s : 1: jit_opt_a 0.27% : 0.000135s : 1: jit_opt_after_cconv 0.09% : 0.000046s : 1: jit_opt_b 0.89% : 0.000447s : 1: loop_unroll 1.53% : 0.000766s : 1: mutable_eliminate 5.52% : 0.002765s : 39: opt.transform.jit_opt_a 0.06% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000015s : 4: opt.transform.jit_opt_b 0.02% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000015s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000032s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 18.67% : 0.009357s : 2: renormalize.infer 4.54% : 0.002277s : 2: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000040s : 1: rewriter_after_opt_a 0.23% : 0.000115s : 1: rewriter_before_opt_a 0.14% : 0.000071s : 1: symbol_engine_optimizer 22.78% : 0.011418s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.388.815 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006fb80> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.389.529 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0201021, [30] [bootstrap]: 0.00031499 [type_inference]: 0.0106692 [event_method]: 2.43e-05 [auto_monad]: 7.106e-05 [graph_reusing]: 6.53003e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 5.188e-05 [rewriter_before_opt_a]: 8.764e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00659512, [2] [Cycle 1]: 0.00217368, [27] [switch_simplify]: 6.972e-05 [loop_unroll]: 3.418e-05 [a_1]: 0.00071916 [with_stream_mark]: 2.281e-05 [recompute_prepare]: 8.70999e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 3.25e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00095932 [add_forward_monad_depend]: 6.74999e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 3.864e-05 [replace_applicator]: 1.536e-05 [Cycle 2]: 0.00036139, [27] [switch_simplify]: 6.26998e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.437e-05 [with_stream_mark]: 1.042e-05 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 3.46001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 4.98001e-06 [merge_forward]: 3.45998e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 8.43999e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.66999e-06 [inline_without_move]: 4.92e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.75998e-06 [cse]: 1.723e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.499e-05 [rewriter_after_opt_a]: 4.469e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00061246 [jit_opt_b]: 5.271e-05, [1] [Cycle 1]: 4.529e-05, [2] [frontend_op_eliminate]: 1.713e-05 [inline_after_opt_a]: 1.656e-05 [cconv]: 2.744e-05 [loop_unroll]: 0.00042151 [jit_opt_after_cconv]: 0.00015532, [1] [Cycle 1]: 0.00014931, [11] [c_1]: 2.215e-05 [parameter_eliminate]: 3.08998e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.89999e-06 [cse]: 2.932e-05 [call_graph_tuple_transform]: 1.967e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 3.786e-05 [partial_unused_args_eliminate]: 2.60997e-06 [environ_conv]: 7.88001e-06 [add_recomputation]: 5.175e-05 [cse_after_recomputation]: 2.505e-05, [1] [Cycle 1]: 1.967e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.57001e-06 [opt_after_jit_grad]: 0.0004686 [symbol_engine_optimizer]: 7.395e-05, [1] [Cycle 1]: 6.775e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 7.98001e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 6.19999e-07 [validate]: 4.153e-05 Sums bootstrap : 0.000315s : 2.05% type_inference : 0.010669s : 69.27% event_method : 0.000024s : 0.16% auto_monad : 0.000071s : 0.46% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000052s : 0.34% rewriter_before_opt_a : 0.000088s : 0.57% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.49% jit_opt_a.loop_unroll : 0.000039s : 0.26% jit_opt_a.a_1 : 0.000814s : 5.28% jit_opt_a.with_stream_mark : 0.000033s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000959s : 6.23% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.15% jit_opt_a.cse : 0.000056s : 0.36% jit_opt_a.replace_applicator : 0.000022s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000045s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000612s : 3.98% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000027s : 0.18% loop_unroll : 0.000422s : 2.74% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000038s : 0.25% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000052s : 0.34% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000469s : 3.04% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.27% Time group info: ------[substitution.] 0.000300 24 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.81% : 0.000005s : 3: substitution.graph_param_transform 88.16% : 0.000265s : 5: substitution.inline 1.35% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 4.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010589 2 89.11% : 0.009435s : 1: type_inference.infer 10.89% : 0.001154s : 1: type_inference.specialize ------[replace.] 0.000108 7 67.45% : 0.000073s : 5: replace.inline 32.55% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 95.75% : 0.000261s : 5: match.inline 4.25% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.41% : 0.000002s : 11: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.39% : 0.000002s : 11: predicate.addn_zero_filter 1.96% : 0.000003s : 11: predicate.arithmetic_simplify 1.43% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.43% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_depend_swap 1.15% : 0.000001s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.09% : 0.000008s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.36% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.35% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 1.67% : 0.000002s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.77% : 0.000010s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.17% : 0.000001s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000970 16 48.72% : 0.000473s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.19% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.09% : 0.000408s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022169 72 0.25% : 0.000055s : 1: add_recomputation 0.34% : 0.000075s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.50% : 0.000333s : 1: bootstrap 0.14% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.13% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.77% : 0.006599s : 1: jit_opt_a 0.71% : 0.000158s : 1: jit_opt_after_cconv 0.25% : 0.000055s : 1: jit_opt_b 1.94% : 0.000429s : 1: loop_unroll 2.81% : 0.000623s : 1: mutable_eliminate 4.76% : 0.001056s : 26: opt.transform.jit_opt_a 0.23% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.15% : 0.000478s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000055s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.23% : 0.000051s : 1: remove_dup_value 2.58% : 0.000571s : 1: renormalize.infer 1.70% : 0.000378s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000048s : 1: rewriter_after_opt_a 0.41% : 0.000090s : 1: rewriter_before_opt_a 0.35% : 0.000076s : 1: symbol_engine_optimizer 48.21% : 0.010688s : 1: type_inference TotalTime = 0.267563, [30] [bootstrap]: 0.00032221 [type_inference]: 0.241034 [event_method]: 2.306e-05 [auto_monad]: 7.679e-05 [graph_reusing]: 6.51999e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.0154245 [rewriter_before_opt_a]: 0.00012795 [expand_dump_flag]: 6.17999e-06 [jit_opt_a]: 0.00802635, [2] [Cycle 1]: 0.00395007, [27] [switch_simplify]: 5.88e-05 [loop_unroll]: 2.982e-05 [a_1]: 0.00063097 [with_stream_mark]: 4.932e-05 [recompute_prepare]: 9.02e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.45002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 9.46003e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 6.32001e-06 [renormalize]: 0.00282007 [add_forward_monad_depend]: 7.05e-06 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 1.8e-05 [cse]: 3.575e-05 [replace_applicator]: 1.409e-05 [Cycle 2]: 0.00036238, [27] [switch_simplify]: 6.54999e-06 [loop_unroll]: 5.87999e-06 [a_1]: 0.00012035 [with_stream_mark]: 1.215e-05 [recompute_prepare]: 5.83002e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.49998e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.168e-05 [replace_applicator]: 5.93998e-06 [py_interpret_to_execute_after_opt_a]: 1.444e-05 [rewriter_after_opt_a]: 3.973e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00070976 [jit_opt_b]: 5.908e-05, [1] [Cycle 1]: 5.224e-05, [2] [frontend_op_eliminate]: 2.047e-05 [inline_after_opt_a]: 1.971e-05 [cconv]: 2.691e-05 [loop_unroll]: 0.00042792 [jit_opt_after_cconv]: 0.00015772, [1] [Cycle 1]: 0.00015112, [11] [c_1]: 2.601e-05 [parameter_eliminate]: 2.81999e-06 [updatestate_depend_eliminate]: 6.39999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 2.419e-05 [call_graph_tuple_transform]: 2.176e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.631e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 9.19e-06 [add_recomputation]: 5.462e-05 [cse_after_recomputation]: 2.382e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.587e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 5.20999e-06 [opt_after_jit_grad]: 0.00049013 [symbol_engine_optimizer]: 0.00015925, [1] [Cycle 1]: 0.00015181, [6] [build]: 4.22e-06 [elim_shapecalc]: 1.086e-05 [elim_not_effective]: 8.86e-05 [opt_reshape]: 6.75998e-06 [fold_const_symbol]: 1.084e-05 [renormalize]: 7.29982e-07 [validate]: 5.147e-05 Sums bootstrap : 0.000322s : 0.12% type_inference : 0.241034s : 91.58% event_method : 0.000023s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.015424s : 5.86% rewriter_before_opt_a : 0.000128s : 0.05% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.02% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.000751s : 0.29% jit_opt_a.with_stream_mark : 0.000061s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002820s : 1.07% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000047s : 0.02% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000710s : 0.27% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000428s : 0.16% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.00% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000490s : 0.19% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000089s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.02% Time group info: ------[substitution.] 0.000260 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 4: substitution.graph_param_transform 86.08% : 0.000224s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000005s : 2: substitution.replace_old_param 4.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.240945 2 98.72% : 0.237863s : 1: type_inference.infer 1.28% : 0.003082s : 1: type_inference.specialize ------[replace.] 0.000082 6 70.12% : 0.000057s : 4: replace.inline 29.88% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000234 6 94.93% : 0.000222s : 4: match.inline 5.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.47% : 0.000002s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000001s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 5.54% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.54% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.81% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.63% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002239 22 67.25% : 0.001506s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.42% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.33% : 0.000679s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.271494 72 0.02% : 0.000057s : 1: add_recomputation 0.03% : 0.000081s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.13% : 0.000344s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.96% : 0.008030s : 1: jit_opt_a 0.06% : 0.000160s : 1: jit_opt_after_cconv 0.02% : 0.000062s : 1: jit_opt_b 0.16% : 0.000436s : 1: loop_unroll 0.26% : 0.000719s : 1: mutable_eliminate 0.36% : 0.000982s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000114s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000499s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 5.69% : 0.015450s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.77% : 0.002084s : 1: renormalize.infer 0.27% : 0.000725s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000135s : 1: rewriter_before_opt_a 0.06% : 0.000162s : 1: symbol_engine_optimizer 88.79% : 0.241062s : 1: type_inference TotalTime = 0.139891, [30] [bootstrap]: 0.0002412 [type_inference]: 0.112434 [event_method]: 0.00039729 [auto_monad]: 0.0001116 [graph_reusing]: 7.67002e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 6.425e-05 [rewriter_before_opt_a]: 0.00011751 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.024022, [3] [Cycle 1]: 0.0167702, [27] [switch_simplify]: 7.554e-05 [loop_unroll]: 4.143e-05 [a_1]: 0.00090087 [with_stream_mark]: 3.634e-05 [recompute_prepare]: 2.072e-05 [updatestate_depend_eliminate]: 9.47999e-06 [updatestate_assign_eliminate]: 7.46001e-06 [updatestate_loads_eliminate]: 7.05e-06 [parameter_eliminate]: 2.57001e-06 [specialize_transform]: 1.451e-05 [updatestate_useless_node_eliminater]: 1.33e-05 [accelerated_algorithm]: 1.368e-05 [meta_shard_fg_expand]: 3.6e-06 [get_grad_eliminate_]: 1.361e-05 [merge_forward]: 8.92999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.736e-05 [j_node_and_user_rematch]: 2.463e-05 [meta_fg_expand]: 0.0018207 [replace_old_param]: 7.183e-05 [inline_without_move]: 6.274e-05 [renormalize]: 0.0128932 [add_forward_monad_depend]: 1.394e-05 [auto_monad_grad]: 6.93e-06 [auto_monad_eliminator]: 6.051e-05 [cse]: 0.00025168 [replace_applicator]: 9.348e-05 [Cycle 2]: 0.00323687, [27] [switch_simplify]: 4.242e-05 [loop_unroll]: 4.163e-05 [a_1]: 0.00111229 [with_stream_mark]: 2.381e-05 [recompute_prepare]: 9.01002e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.68998e-06 [specialize_transform]: 5.63002e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.93002e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.612e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 7.783e-05 [replace_old_param]: 7.07002e-06 [inline_without_move]: 5.22e-06 [renormalize]: 0.00158123 [add_forward_monad_depend]: 7.73999e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.579e-05 [cse]: 2.861e-05 [replace_applicator]: 1.854e-05 [Cycle 3]: 0.0002633, [27] [switch_simplify]: 4.13001e-06 [loop_unroll]: 3.46001e-06 [a_1]: 4.13e-05 [with_stream_mark]: 1.334e-05 [recompute_prepare]: 3.71999e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 1.87999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 3.45e-06 [updatestate_useless_node_eliminater]: 3.04999e-06 [accelerated_algorithm]: 3.18998e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 3.12002e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 2.36998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.462e-05 [j_node_and_user_rematch]: 6.02999e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 3.53999e-06 [inline_without_move]: 2.99001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 4.2e-06 [cse]: 8.80999e-06 [replace_applicator]: 3.57002e-06 [py_interpret_to_execute_after_opt_a]: 1.349e-05 [rewriter_after_opt_a]: 3.726e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 4.45e-06 [mutable_eliminate]: 0.00080208 [jit_opt_b]: 4.405e-05, [1] [Cycle 1]: 3.512e-05, [2] [frontend_op_eliminate]: 1.068e-05 [inline_after_opt_a]: 1.222e-05 [cconv]: 3.08e-05 [loop_unroll]: 0.00046626 [jit_opt_after_cconv]: 0.0001463, [1] [Cycle 1]: 0.00013926, [11] [c_1]: 1.218e-05 [parameter_eliminate]: 4.37998e-06 [updatestate_depend_eliminate]: 8.2e-06 [updatestate_assign_eliminate]: 1.97001e-06 [updatestate_loads_eliminate]: 1.94e-06 [cse]: 2.892e-05 [call_graph_tuple_transform]: 1.74e-05 [tuple_list_get_item_eliminator]: 3.66001e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 1.22e-06 [switch_simplify]: 3.50003e-06 [remove_dup_value]: 1.641e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 4.147e-05 [cse_after_recomputation]: 1.926e-05, [1] [Cycle 1]: 1.401e-05, [1] [cse]: 7.75998e-06 [auto_monad_reorder]: 1.353e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 6.66999e-06 [opt_after_jit_grad]: 0.00049052 [symbol_engine_optimizer]: 6.66e-05, [1] [Cycle 1]: 6.027e-05, [6] [build]: 4.22e-06 [elim_shapecalc]: 5.24e-06 [elim_not_effective]: 1.046e-05 [opt_reshape]: 4.08999e-06 [fold_const_symbol]: 6.01e-06 [renormalize]: 6.10016e-07 [validate]: 4.118e-05 Sums bootstrap : 0.000241s : 0.18% type_inference : 0.112434s : 83.17% event_method : 0.000397s : 0.29% auto_monad : 0.000112s : 0.08% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000064s : 0.05% rewriter_before_opt_a : 0.000118s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000122s : 0.09% jit_opt_a.loop_unroll : 0.000087s : 0.06% jit_opt_a.a_1 : 0.002054s : 1.52% jit_opt_a.with_stream_mark : 0.000073s : 0.05% jit_opt_a.recompute_prepare : 0.000033s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000024s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000022s : 0.02% jit_opt_a.accelerated_algorithm : 0.000023s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000016s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000058s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000040s : 0.03% jit_opt_a.meta_fg_expand : 0.001900s : 1.41% jit_opt_a.replace_old_param : 0.000082s : 0.06% jit_opt_a.inline_without_move : 0.000071s : 0.05% jit_opt_a.renormalize : 0.014475s : 10.71% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.02% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000081s : 0.06% jit_opt_a.cse : 0.000289s : 0.21% jit_opt_a.replace_applicator : 0.000116s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000802s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000466s : 0.34% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000041s : 0.03% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000491s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000546 101 0.26% : 0.000001s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.88% : 0.000005s : 1: substitution.graph_param_transform 63.82% : 0.000349s : 12: substitution.inline 3.60% : 0.000020s : 2: substitution.inline_without_move 1.69% : 0.000009s : 11: substitution.j_node_and_user_rematch 2.23% : 0.000012s : 7: substitution.minmaximum_grad 1.33% : 0.000007s : 5: substitution.partial_eliminate 1.95% : 0.000011s : 11: substitution.remove_not_recompute_node 6.03% : 0.000033s : 10: substitution.replace_applicator 1.29% : 0.000007s : 10: substitution.replace_old_param 0.48% : 0.000003s : 1: substitution.set_cell_output_no_recompute 1.31% : 0.000007s : 1: substitution.tile_eliminate 4.40% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.78% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.74% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112332 2 97.46% : 0.109474s : 1: type_inference.infer 2.54% : 0.002858s : 1: type_inference.specialize ------[replace.] 0.000170 19 64.33% : 0.000109s : 12: replace.inline 35.67% : 0.000061s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000362 19 94.26% : 0.000341s : 12: match.inline 5.74% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000355 2432 1.55% : 0.000006s : 42: predicate.accumulaten_eliminater 0.33% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.40% : 0.000005s : 42: predicate.addn_check_dump 1.70% : 0.000006s : 42: predicate.addn_zero_filter 1.99% : 0.000007s : 42: predicate.arithmetic_simplify 1.66% : 0.000006s : 42: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 42: predicate.compare_switch_simplify 1.53% : 0.000005s : 42: predicate.depend_value_elim 1.44% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.48% : 0.000005s : 42: predicate.dict_get_item_eliminator 1.53% : 0.000005s : 42: predicate.dict_set_item_eliminator 0.29% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.07% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000005s : 42: predicate.environ_add_const_eliminate 1.40% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.42% : 0.000005s : 42: predicate.environ_get_depend_swap 1.49% : 0.000005s : 42: predicate.environ_get_eliminate 1.42% : 0.000005s : 42: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.75% : 0.000003s : 16: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.38% : 0.000016s : 63: predicate.inline 2.05% : 0.000007s : 44: predicate.inline_without_move 0.37% : 0.000001s : 16: predicate.j_node_and_user_rematch 0.92% : 0.000003s : 16: predicate.less_batch_normalization 1.84% : 0.000007s : 49: predicate.list_to_tuple_eliminator_ 1.83% : 0.000006s : 50: predicate.load_eliminater 0.41% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.52% : 0.000012s : 87: predicate.loop_unroll_before_grad 1.70% : 0.000006s : 43: predicate.make_slice_get_slice_eliminator 1.42% : 0.000005s : 42: predicate.merge_addn 1.53% : 0.000005s : 42: predicate.minmaximum_grad 0.72% : 0.000003s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000008s : 50: predicate.partial_eliminate 1.53% : 0.000005s : 42: predicate.print_const_string_wrapper 2.05% : 0.000007s : 42: predicate.reduce_eliminate 1.80% : 0.000006s : 49: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000002s : 16: predicate.remove_not_recompute_node 2.95% : 0.000010s : 93: predicate.replace_applicator 1.44% : 0.000005s : 44: predicate.replace_old_param 0.10% : 0.000000s : 1: predicate.reset_defer_inline 1.67% : 0.000006s : 42: predicate.reshape_eliminate 1.55% : 0.000006s : 42: predicate.row_tensor_add_zeros_like 0.33% : 0.000001s : 1: predicate.row_tensor_eliminate 1.49% : 0.000005s : 42: predicate.same_eliminate 0.45% : 0.000002s : 16: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.79% : 0.000003s : 16: predicate.specialize_transform 1.72% : 0.000006s : 42: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000006s : 42: predicate.stack_unstack_eliminate 0.11% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.69% : 0.000010s : 61: predicate.switch_defer_inline 2.53% : 0.000009s : 61: predicate.switch_layer_defer_inline 6.53% : 0.000023s : 149: predicate.switch_simplify 1.57% : 0.000006s : 42: predicate.tile_eliminate 1.56% : 0.000006s : 42: predicate.transpose_eliminate 1.88% : 0.000007s : 42: predicate.tuple_list_convert_item_index_to_positive 1.66% : 0.000006s : 42: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000012s : 51: predicate.tuple_list_get_item_eliminator 1.86% : 0.000007s : 42: predicate.tuple_list_set_item_eliminator 1.81% : 0.000006s : 49: predicate.tuple_to_list_eliminator_ 1.89% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.65% : 0.000009s : 66: predicate.updatestate_useless_node_eliminater 1.84% : 0.000007s : 42: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.14% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003422 43 75.43% : 0.002581s : 27: func_graph_cloner_run.FuncGraphClonerGraph 24.57% : 0.000841s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.157051 87 0.03% : 0.000044s : 1: add_recomputation 0.08% : 0.000119s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.17% : 0.000269s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.26% : 0.000406s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 15.30% : 0.024025s : 1: jit_opt_a 0.09% : 0.000149s : 1: jit_opt_after_cconv 0.03% : 0.000047s : 1: jit_opt_b 0.30% : 0.000476s : 1: loop_unroll 0.52% : 0.000814s : 1: mutable_eliminate 1.72% : 0.002704s : 39: opt.transform.jit_opt_a 0.02% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000500s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000067s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 7.83% : 0.012293s : 2: renormalize.infer 1.37% : 0.002157s : 2: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000122s : 1: rewriter_before_opt_a 0.04% : 0.000069s : 1: symbol_engine_optimizer 71.61% : 0.112462s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.539.577 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f670> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.540.299 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.120599, [30] [bootstrap]: 0.00033787 [type_inference]: 0.105005 [event_method]: 0.0005791 [auto_monad]: 0.00017887 [graph_reusing]: 9.99001e-06 [pre_auto_parallel]: 3.82002e-06 [py_interpret_to_execute]: 5.107e-05 [rewriter_before_opt_a]: 0.0001701 [expand_dump_flag]: 4.94e-06 [jit_opt_a]: 0.0113975, [2] [Cycle 1]: 0.00611329, [27] [switch_simplify]: 0.00027387 [loop_unroll]: 7.688e-05 [a_1]: 0.00168675 [with_stream_mark]: 2.484e-05 [recompute_prepare]: 1.061e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 7.08998e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.678e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.121e-05 [inline_without_move]: 6.96001e-06 [renormalize]: 0.00362591 [add_forward_monad_depend]: 8.22e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.966e-05 [cse]: 4.009e-05 [replace_applicator]: 1.925e-05 [Cycle 2]: 0.00036513, [27] [switch_simplify]: 6.43998e-06 [loop_unroll]: 5.99e-06 [a_1]: 0.00010459 [with_stream_mark]: 1.321e-05 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 5.19998e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 2.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.795e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.84e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 6.89001e-06 [cse]: 1.444e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.866e-05 [rewriter_after_opt_a]: 4.178e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00090882 [jit_opt_b]: 5.966e-05, [1] [Cycle 1]: 5.112e-05, [2] [frontend_op_eliminate]: 2.02e-05 [inline_after_opt_a]: 1.908e-05 [cconv]: 3.297e-05 [loop_unroll]: 0.00046206 [jit_opt_after_cconv]: 0.00017052, [1] [Cycle 1]: 0.0001637, [11] [c_1]: 2.333e-05 [parameter_eliminate]: 3.34001e-06 [updatestate_depend_eliminate]: 8.56002e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.969e-05 [call_graph_tuple_transform]: 2.437e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.23e-06 [remove_dup_value]: 1.808e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.90002e-06 [add_recomputation]: 5.604e-05 [cse_after_recomputation]: 2.532e-05, [1] [Cycle 1]: 1.891e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 8.56002e-06 [opt_after_jit_grad]: 0.00048725 [symbol_engine_optimizer]: 0.00025097, [1] [Cycle 1]: 0.00024343, [6] [build]: 4.47e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.816e-05 [opt_reshape]: 6.09999e-06 [fold_const_symbol]: 0.00017479 [renormalize]: 6.59988e-07 [validate]: 5.005e-05 Sums bootstrap : 0.000338s : 0.29% type_inference : 0.105005s : 91.33% event_method : 0.000579s : 0.50% auto_monad : 0.000179s : 0.16% graph_reusing : 0.000010s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000051s : 0.04% rewriter_before_opt_a : 0.000170s : 0.15% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000280s : 0.24% jit_opt_a.loop_unroll : 0.000083s : 0.07% jit_opt_a.a_1 : 0.001791s : 1.56% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003626s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000055s : 0.05% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000909s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000462s : 0.40% jit_opt_after_cconv.c_1 : 0.000023s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000056s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000487s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000175s : 0.15% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000764 35 0.26% : 0.000002s : 2: substitution.elim_not_effective 0.26% : 0.000002s : 2: substitution.fold_const_symbol 0.80% : 0.000006s : 3: substitution.graph_param_transform 91.28% : 0.000698s : 12: substitution.inline 0.69% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.72% : 0.000006s : 4: substitution.remove_not_recompute_node 0.69% : 0.000005s : 2: substitution.replace_old_param 1.31% : 0.000010s : 1: substitution.reshape_eliminate 2.34% : 0.000018s : 3: substitution.switch_simplify 1.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104865 2 95.24% : 0.099871s : 1: type_inference.infer 4.76% : 0.004994s : 1: type_inference.specialize ------[replace.] 0.000402 18 48.72% : 0.000196s : 12: replace.inline 1.26% : 0.000005s : 1: replace.reshape_eliminate 23.85% : 0.000096s : 3: replace.switch_simplify 26.17% : 0.000105s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000727 18 95.07% : 0.000692s : 12: match.inline 1.21% : 0.000009s : 1: match.reshape_eliminate 2.16% : 0.000016s : 3: match.switch_simplify 1.57% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000209 1212 1.34% : 0.000003s : 19: predicate.accumulaten_eliminater 0.75% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000003s : 19: predicate.addn_check_dump 1.54% : 0.000003s : 19: predicate.addn_zero_filter 1.91% : 0.000004s : 19: predicate.arithmetic_simplify 1.36% : 0.000003s : 20: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 19: predicate.compare_switch_simplify 1.39% : 0.000003s : 19: predicate.depend_value_elim 1.46% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.59% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 3: predicate.elim_not_effective 0.37% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.37% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.32% : 0.000003s : 20: predicate.environ_get_depend_swap 1.41% : 0.000003s : 20: predicate.environ_get_eliminate 1.32% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.72% : 0.000001s : 6: predicate.get_grad_eliminate 0.19% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000011s : 40: predicate.inline 0.56% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.65% : 0.000003s : 25: predicate.load_eliminater 0.76% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.44% : 0.000009s : 64: predicate.loop_unroll_before_grad 2.16% : 0.000005s : 23: predicate.make_slice_get_slice_eliminator 1.24% : 0.000003s : 19: predicate.merge_addn 1.33% : 0.000003s : 19: predicate.minmaximum_grad 1.28% : 0.000003s : 3: predicate.mutable_eliminate 0.29% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000005s : 25: predicate.partial_eliminate 1.39% : 0.000003s : 19: predicate.print_const_string_wrapper 1.75% : 0.000004s : 19: predicate.reduce_eliminate 1.54% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.32% : 0.000001s : 6: predicate.remove_not_recompute_node 1.55% : 0.000003s : 28: predicate.replace_applicator 0.33% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.90% : 0.000004s : 20: predicate.reshape_eliminate 1.32% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.39% : 0.000001s : 3: predicate.row_tensor_eliminate 1.63% : 0.000003s : 19: predicate.same_eliminate 0.30% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.49% : 0.000001s : 6: predicate.special_op_eliminate 0.53% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.23% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.56% : 0.000007s : 34: predicate.switch_defer_inline 2.51% : 0.000005s : 34: predicate.switch_layer_defer_inline 9.14% : 0.000019s : 107: predicate.switch_simplify 1.26% : 0.000003s : 19: predicate.tile_eliminate 1.48% : 0.000003s : 19: predicate.transpose_eliminate 1.66% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.62% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.81% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.54% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.57% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.50% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 19: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004140 40 60.74% : 0.002515s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.50% : 0.000393s : 5: func_graph_cloner_run.FuncGraphClonerNode 29.76% : 0.001232s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126734 72 0.05% : 0.000059s : 1: add_recomputation 0.15% : 0.000189s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.28% : 0.000355s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.47% : 0.000591s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000013s : 1: graph_reusing 9.00% : 0.011403s : 1: jit_opt_a 0.14% : 0.000173s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.37% : 0.000470s : 1: loop_unroll 0.73% : 0.000922s : 1: mutable_eliminate 1.81% : 0.002293s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000204s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000054s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 2.15% : 0.002727s : 1: renormalize.infer 0.70% : 0.000885s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.14% : 0.000174s : 1: rewriter_before_opt_a 0.20% : 0.000254s : 1: symbol_engine_optimizer 82.88% : 0.105034s : 1: type_inference TotalTime = 0.0220912, [30] [bootstrap]: 0.00029274 [type_inference]: 0.0125369 [event_method]: 2.668e-05 [auto_monad]: 8.008e-05 [graph_reusing]: 6.83e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 6.899e-05 [rewriter_before_opt_a]: 9.559e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00675684, [2] [Cycle 1]: 0.00221887, [27] [switch_simplify]: 6.773e-05 [loop_unroll]: 3.684e-05 [a_1]: 0.00069437 [with_stream_mark]: 2.152e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.61001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 0.00102901 [add_forward_monad_depend]: 5.48002e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.534e-05 [cse]: 3.969e-05 [replace_applicator]: 1.312e-05 [Cycle 2]: 0.00032798, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.20999e-06 [a_1]: 9.254e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 7.90998e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.23998e-06 [cse]: 1.498e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 1.35e-05 [rewriter_after_opt_a]: 3.865e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00053616 [jit_opt_b]: 4.983e-05, [1] [Cycle 1]: 4.327e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.683e-05 [cconv]: 2.615e-05 [loop_unroll]: 0.00041341 [jit_opt_after_cconv]: 0.00015041, [1] [Cycle 1]: 0.00014435, [11] [c_1]: 2.119e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 6.60002e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 2.701e-05 [call_graph_tuple_transform]: 1.944e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 4.49974e-07 [switch_simplify]: 5.63002e-06 [remove_dup_value]: 3.478e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 5.56e-06 [add_recomputation]: 5.04e-05 [cse_after_recomputation]: 2.299e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.253e-05 [auto_monad_reorder]: 1.735e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00052249 [symbol_engine_optimizer]: 7.333e-05, [1] [Cycle 1]: 6.728e-05, [6] [build]: 4.33001e-06 [elim_shapecalc]: 8.29998e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 5.69999e-07 [validate]: 4.021e-05 Sums bootstrap : 0.000293s : 1.70% type_inference : 0.012537s : 72.65% event_method : 0.000027s : 0.15% auto_monad : 0.000080s : 0.46% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000069s : 0.40% rewriter_before_opt_a : 0.000096s : 0.55% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.43% jit_opt_a.loop_unroll : 0.000042s : 0.24% jit_opt_a.a_1 : 0.000787s : 4.56% jit_opt_a.with_stream_mark : 0.000031s : 0.18% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.09% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.001029s : 5.96% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.13% jit_opt_a.cse : 0.000055s : 0.32% jit_opt_a.replace_applicator : 0.000019s : 0.11% py_interpret_to_execute_after_opt_a : 0.000014s : 0.08% rewriter_after_opt_a : 0.000039s : 0.22% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000536s : 3.11% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.09% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000026s : 0.15% loop_unroll : 0.000413s : 2.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000035s : 0.20% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000050s : 0.29% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000017s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000522s : 3.03% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.23% Time group info: ------[substitution.] 0.000286 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000006s : 3: substitution.graph_param_transform 88.33% : 0.000252s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.52% : 0.000004s : 4: substitution.remove_not_recompute_node 1.46% : 0.000004s : 2: substitution.replace_old_param 4.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012423 2 85.78% : 0.010657s : 1: type_inference.infer 14.22% : 0.001766s : 1: type_inference.specialize ------[replace.] 0.000104 7 68.88% : 0.000072s : 5: replace.inline 31.12% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 7 95.66% : 0.000250s : 5: match.inline 4.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.18% : 0.000001s : 11: predicate.accumulaten_eliminater 1.22% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 2.05% : 0.000003s : 11: predicate.arithmetic_simplify 1.38% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.38% : 0.000002s : 11: predicate.depend_value_elim 1.25% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 16: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 1.91% : 0.000002s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.72% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.23% : 0.000010s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001154 16 46.98% : 0.000542s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.42% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.60% : 0.000526s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024180 72 0.22% : 0.000053s : 1: add_recomputation 0.35% : 0.000084s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.28% : 0.000310s : 1: bootstrap 0.12% : 0.000029s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.13% : 0.000032s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 27.96% : 0.006760s : 1: jit_opt_a 0.63% : 0.000153s : 1: jit_opt_after_cconv 0.22% : 0.000053s : 1: jit_opt_b 1.74% : 0.000421s : 1: loop_unroll 2.25% : 0.000545s : 1: mutable_eliminate 4.23% : 0.001022s : 26: opt.transform.jit_opt_a 0.20% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.20% : 0.000531s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000073s : 1: py_interpret_to_execute 0.07% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.16% : 0.000038s : 1: remove_dup_value 2.39% : 0.000578s : 1: renormalize.infer 1.83% : 0.000442s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000041s : 1: rewriter_after_opt_a 0.41% : 0.000100s : 1: rewriter_before_opt_a 0.31% : 0.000076s : 1: symbol_engine_optimizer 51.95% : 0.012561s : 1: type_inference TotalTime = 0.0299904, [30] [bootstrap]: 0.00030976 [type_inference]: 0.0207746 [event_method]: 1.941e-05 [auto_monad]: 6.865e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 9.569e-05 [rewriter_before_opt_a]: 8.042e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00539445, [2] [Cycle 1]: 0.00177546, [27] [switch_simplify]: 5.492e-05 [loop_unroll]: 2.879e-05 [a_1]: 0.00053078 [with_stream_mark]: 1.869e-05 [recompute_prepare]: 7.53999e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.83997e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00081931 [add_forward_monad_depend]: 5.51e-06 [auto_monad_grad]: 2.73998e-06 [auto_monad_eliminator]: 1.422e-05 [cse]: 3.482e-05 [replace_applicator]: 1.075e-05 [Cycle 2]: 0.0003082, [27] [switch_simplify]: 5.60001e-06 [loop_unroll]: 5.15001e-06 [a_1]: 8.711e-05 [with_stream_mark]: 8.2e-06 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.90999e-06 [updatestate_useless_node_eliminater]: 4.78001e-06 [accelerated_algorithm]: 5.11002e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.29e-05 [j_node_and_user_rematch]: 7.62002e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.99001e-06 [inline_without_move]: 4.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.35001e-06 [cse]: 1.189e-05 [replace_applicator]: 4.79e-06 [py_interpret_to_execute_after_opt_a]: 1.067e-05 [rewriter_after_opt_a]: 3.552e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00165869 [jit_opt_b]: 4.786e-05, [1] [Cycle 1]: 4.077e-05, [2] [frontend_op_eliminate]: 1.456e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 2.706e-05 [loop_unroll]: 0.00044216 [jit_opt_after_cconv]: 0.00013852, [1] [Cycle 1]: 0.00013246, [11] [c_1]: 1.969e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.91998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.177e-05 [call_graph_tuple_transform]: 1.717e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.12999e-06 [remove_dup_value]: 1.566e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 5.247e-05 [cse_after_recomputation]: 2.334e-05, [1] [Cycle 1]: 1.763e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00043577 [symbol_engine_optimizer]: 6.805e-05, [1] [Cycle 1]: 6.216e-05, [6] [build]: 2.75002e-06 [elim_shapecalc]: 7.23e-06 [elim_not_effective]: 1.225e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.27e-06 [renormalize]: 3.19997e-07 [validate]: 3.88e-05 Sums bootstrap : 0.000310s : 1.19% type_inference : 0.020775s : 79.60% event_method : 0.000019s : 0.07% auto_monad : 0.000069s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000096s : 0.37% rewriter_before_opt_a : 0.000080s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.23% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000618s : 2.37% jit_opt_a.with_stream_mark : 0.000027s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000819s : 3.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000047s : 0.18% jit_opt_a.replace_applicator : 0.000016s : 0.06% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000036s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001659s : 6.36% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000442s : 1.69% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000436s : 1.67% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.15% Time group info: ------[substitution.] 0.000211 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000005s : 3: substitution.graph_param_transform 85.42% : 0.000181s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 5.59% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020700 2 93.49% : 0.019353s : 1: type_inference.infer 6.51% : 0.001347s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.83% : 0.000047s : 4: replace.inline 31.17% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 94.31% : 0.000178s : 4: match.inline 5.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.31% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.59% : 0.000002s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000003s : 15: predicate.partial_eliminate 1.34% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000008s : 53: predicate.switch_simplify 1.33% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000758 13 48.32% : 0.000366s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.92% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.76% : 0.000347s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031668 72 0.17% : 0.000055s : 1: add_recomputation 0.23% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.04% : 0.000330s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.04% : 0.005398s : 1: jit_opt_a 0.45% : 0.000141s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.42% : 0.000450s : 1: loop_unroll 5.27% : 0.001670s : 1: mutable_eliminate 2.60% : 0.000825s : 26: opt.transform.jit_opt_a 0.14% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000443s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000099s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.52% : 0.000480s : 1: renormalize.infer 1.05% : 0.000332s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000039s : 1: rewriter_after_opt_a 0.26% : 0.000084s : 1: rewriter_before_opt_a 0.22% : 0.000070s : 1: symbol_engine_optimizer 65.66% : 0.020795s : 1: type_inference TotalTime = 0.158545, [30] [bootstrap]: 0.00025857 [type_inference]: 0.128371 [event_method]: 0.00075267 [auto_monad]: 0.00011101 [graph_reusing]: 7.2e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 3.965e-05 [rewriter_before_opt_a]: 0.00011623 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.0263218, [3] [Cycle 1]: 0.0181558, [27] [switch_simplify]: 7.679e-05 [loop_unroll]: 4.113e-05 [a_1]: 0.00092742 [with_stream_mark]: 3.953e-05 [recompute_prepare]: 2.383e-05 [updatestate_depend_eliminate]: 1.001e-05 [updatestate_assign_eliminate]: 6.94001e-06 [updatestate_loads_eliminate]: 7.55998e-06 [parameter_eliminate]: 3.16999e-06 [specialize_transform]: 1.616e-05 [updatestate_useless_node_eliminater]: 1.397e-05 [accelerated_algorithm]: 1.389e-05 [meta_shard_fg_expand]: 3.63e-06 [get_grad_eliminate_]: 1.358e-05 [merge_forward]: 9.72999e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 3.018e-05 [j_node_and_user_rematch]: 2.664e-05 [meta_fg_expand]: 0.00215201 [replace_old_param]: 8.654e-05 [inline_without_move]: 6.673e-05 [renormalize]: 0.0138301 [add_forward_monad_depend]: 1.602e-05 [auto_monad_grad]: 6.99001e-06 [auto_monad_eliminator]: 6.476e-05 [cse]: 0.00026532 [replace_applicator]: 9.62e-05 [Cycle 2]: 0.00422366, [27] [switch_simplify]: 4.444e-05 [loop_unroll]: 4.235e-05 [a_1]: 0.00131856 [with_stream_mark]: 2.748e-05 [recompute_prepare]: 1.387e-05 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 3.88001e-06 [updatestate_loads_eliminate]: 3.48999e-06 [parameter_eliminate]: 2.79001e-06 [specialize_transform]: 7.68999e-06 [updatestate_useless_node_eliminater]: 8.37e-06 [accelerated_algorithm]: 2.864e-05 [meta_shard_fg_expand]: 4.55001e-06 [get_grad_eliminate_]: 7.2e-06 [merge_forward]: 5.16002e-06 [cell_reuse_recompute_pass]: 2.06998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.114e-05 [j_node_and_user_rematch]: 1.342e-05 [meta_fg_expand]: 9.807e-05 [replace_old_param]: 1.002e-05 [inline_without_move]: 7.71001e-06 [renormalize]: 0.00224845 [add_forward_monad_depend]: 1.011e-05 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.674e-05 [cse]: 3.045e-05 [replace_applicator]: 2.129e-05 [Cycle 3]: 0.00027635, [27] [switch_simplify]: 5.02999e-06 [loop_unroll]: 3.96001e-06 [a_1]: 4.733e-05 [with_stream_mark]: 1.446e-05 [recompute_prepare]: 4.02998e-06 [updatestate_depend_eliminate]: 2.61999e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 3.60998e-06 [updatestate_useless_node_eliminater]: 3.29001e-06 [accelerated_algorithm]: 3.5e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 3.37002e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 6.59001e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 3.38999e-06 [inline_without_move]: 3.30003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 4.65001e-06 [cse]: 9.37999e-06 [replace_applicator]: 3.48e-06 [py_interpret_to_execute_after_opt_a]: 1.466e-05 [rewriter_after_opt_a]: 3.949e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 4.16001e-06 [mutable_eliminate]: 0.00081782 [jit_opt_b]: 4.999e-05, [1] [Cycle 1]: 4.137e-05, [2] [frontend_op_eliminate]: 1.321e-05 [inline_after_opt_a]: 1.416e-05 [cconv]: 3.388e-05 [loop_unroll]: 0.00047937 [jit_opt_after_cconv]: 0.00014163, [1] [Cycle 1]: 0.00013506, [11] [c_1]: 1.259e-05 [parameter_eliminate]: 3.19001e-06 [updatestate_depend_eliminate]: 6.84001e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 1.89e-06 [cse]: 2.721e-05 [call_graph_tuple_transform]: 1.767e-05 [tuple_list_get_item_eliminator]: 3.64002e-06 [none_parameter_eliminate]: 1.34998e-06 [renormalize]: 1.03001e-06 [switch_simplify]: 3.75998e-06 [remove_dup_value]: 1.434e-05 [partial_unused_args_eliminate]: 2.79001e-06 [environ_conv]: 6.12001e-06 [add_recomputation]: 3.757e-05 [cse_after_recomputation]: 1.896e-05, [1] [Cycle 1]: 1.381e-05, [1] [cse]: 7.61999e-06 [auto_monad_reorder]: 1.299e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 6.53e-06 [opt_after_jit_grad]: 0.00053225 [symbol_engine_optimizer]: 8.063e-05, [1] [Cycle 1]: 7.408e-05, [6] [build]: 4.21001e-06 [elim_shapecalc]: 5.45001e-06 [elim_not_effective]: 9.74e-06 [opt_reshape]: 3.71001e-06 [fold_const_symbol]: 1.978e-05 [renormalize]: 5.59987e-07 [validate]: 3.463e-05 Sums bootstrap : 0.000259s : 0.17% type_inference : 0.128371s : 83.42% event_method : 0.000753s : 0.49% auto_monad : 0.000111s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000040s : 0.03% rewriter_before_opt_a : 0.000116s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000087s : 0.06% jit_opt_a.a_1 : 0.002293s : 1.49% jit_opt_a.with_stream_mark : 0.000081s : 0.05% jit_opt_a.recompute_prepare : 0.000042s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.00% jit_opt_a.specialize_transform : 0.000027s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000026s : 0.02% jit_opt_a.accelerated_algorithm : 0.000046s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000047s : 0.03% jit_opt_a.meta_fg_expand : 0.002252s : 1.46% jit_opt_a.replace_old_param : 0.000100s : 0.06% jit_opt_a.inline_without_move : 0.000078s : 0.05% jit_opt_a.renormalize : 0.016079s : 10.45% jit_opt_a.add_forward_monad_depend : 0.000028s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000086s : 0.06% jit_opt_a.cse : 0.000305s : 0.20% jit_opt_a.replace_applicator : 0.000121s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000818s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000013s : 0.01% jit_opt_b.inline_after_opt_a : 0.000014s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000479s : 0.31% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000038s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000532s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000005s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000020s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.02% Time group info: ------[substitution.] 0.000664 104 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.18% : 0.000001s : 1: substitution.fold_const_symbol 0.76% : 0.000005s : 1: substitution.graph_param_transform 60.48% : 0.000401s : 12: substitution.inline 3.60% : 0.000024s : 2: substitution.inline_without_move 1.60% : 0.000011s : 12: substitution.j_node_and_user_rematch 1.89% : 0.000013s : 7: substitution.minmaximum_grad 1.21% : 0.000008s : 5: substitution.partial_eliminate 1.80% : 0.000012s : 12: substitution.remove_not_recompute_node 5.03% : 0.000033s : 10: substitution.replace_applicator 1.23% : 0.000008s : 10: substitution.replace_old_param 1.22% : 0.000008s : 1: substitution.reshape_eliminate 0.69% : 0.000005s : 1: substitution.set_cell_output_no_recompute 6.94% : 0.000046s : 1: substitution.tile_eliminate 3.85% : 0.000026s : 7: substitution.tuple_list_convert_item_index_to_positive 2.50% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.80% : 0.000045s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128264 2 97.78% : 0.125422s : 1: type_inference.infer 2.22% : 0.002842s : 1: type_inference.specialize ------[replace.] 0.000195 19 62.84% : 0.000123s : 12: replace.inline 37.16% : 0.000072s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000417 19 94.58% : 0.000394s : 12: match.inline 5.42% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000406 2544 1.37% : 0.000006s : 44: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.27% : 0.000005s : 44: predicate.addn_check_dump 1.48% : 0.000006s : 44: predicate.addn_zero_filter 1.87% : 0.000008s : 44: predicate.arithmetic_simplify 1.48% : 0.000006s : 44: predicate.cast_eliminate 0.12% : 0.000000s : 1: predicate.check_bprop_eliminate 1.28% : 0.000005s : 44: predicate.compare_switch_simplify 1.36% : 0.000006s : 44: predicate.depend_value_elim 1.37% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.38% : 0.000006s : 44: predicate.dict_get_item_eliminator 9.05% : 0.000037s : 44: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.28% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.31% : 0.000005s : 44: predicate.environ_get_depend_swap 1.37% : 0.000006s : 44: predicate.environ_get_eliminate 1.27% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.78% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 3.99% : 0.000016s : 65: predicate.inline 1.97% : 0.000008s : 46: predicate.inline_without_move 0.34% : 0.000001s : 18: predicate.j_node_and_user_rematch 0.98% : 0.000004s : 18: predicate.less_batch_normalization 1.69% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.79% : 0.000007s : 52: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.14% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.56% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.30% : 0.000005s : 44: predicate.merge_addn 1.43% : 0.000006s : 44: predicate.minmaximum_grad 0.72% : 0.000003s : 1: predicate.mutable_eliminate 0.05% : 0.000000s : 1: predicate.opt_reshape 2.15% : 0.000009s : 52: predicate.partial_eliminate 1.57% : 0.000006s : 44: predicate.print_const_string_wrapper 1.81% : 0.000007s : 44: predicate.reduce_eliminate 1.76% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000002s : 18: predicate.remove_not_recompute_node 2.59% : 0.000011s : 97: predicate.replace_applicator 1.36% : 0.000006s : 46: predicate.replace_old_param 0.20% : 0.000001s : 1: predicate.reset_defer_inline 1.44% : 0.000006s : 44: predicate.reshape_eliminate 1.43% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.25% : 0.000001s : 1: predicate.row_tensor_eliminate 1.35% : 0.000005s : 44: predicate.same_eliminate 0.50% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.22% : 0.000001s : 2: predicate.special_op_eliminate 0.77% : 0.000003s : 18: predicate.specialize_transform 1.54% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.54% : 0.000010s : 63: predicate.switch_defer_inline 2.22% : 0.000009s : 63: predicate.switch_layer_defer_inline 5.72% : 0.000023s : 153: predicate.switch_simplify 1.45% : 0.000006s : 44: predicate.tile_eliminate 1.55% : 0.000006s : 44: predicate.transpose_eliminate 1.76% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000013s : 53: predicate.tuple_list_get_item_eliminator 1.81% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.66% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.59% : 0.000006s : 52: predicate.updatestate_pure_node_eliminater 2.49% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.75% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.21% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003827 43 75.32% : 0.002882s : 27: func_graph_cloner_run.FuncGraphClonerGraph 24.68% : 0.000945s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.177668 87 0.02% : 0.000041s : 1: add_recomputation 0.07% : 0.000116s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.16% : 0.000290s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000021s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.43% : 0.000767s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 14.82% : 0.026326s : 1: jit_opt_a 0.08% : 0.000144s : 1: jit_opt_after_cconv 0.03% : 0.000053s : 1: jit_opt_b 0.28% : 0.000489s : 1: loop_unroll 0.47% : 0.000832s : 1: mutable_eliminate 1.70% : 0.003026s : 39: opt.transform.jit_opt_a 0.02% : 0.000034s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000020s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000018s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000542s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000042s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 7.63% : 0.013548s : 2: renormalize.infer 1.41% : 0.002503s : 2: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000119s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 72.27% : 0.128399s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.711.382 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00658b0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:44.712.187 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.967627, [30] [bootstrap]: 0.00028965 [type_inference]: 0.955593 [event_method]: 2.698e-05 [auto_monad]: 8.246e-05 [graph_reusing]: 6.81999e-06 [pre_auto_parallel]: 3.25e-06 [py_interpret_to_execute]: 0.0006307 [rewriter_before_opt_a]: 0.00010478 [expand_dump_flag]: 4.07e-06 [jit_opt_a]: 0.00869814, [2] [Cycle 1]: 0.00446166, [27] [switch_simplify]: 6.36e-05 [loop_unroll]: 3.471e-05 [a_1]: 0.0007185 [with_stream_mark]: 1.993e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 7.46001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.75998e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 3.21001e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.35002e-06 [renormalize]: 0.00327586 [add_forward_monad_depend]: 5.66998e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 3.524e-05 [replace_applicator]: 1.483e-05 [Cycle 2]: 0.00037827, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 6.35002e-06 [a_1]: 0.00013143 [with_stream_mark]: 1.084e-05 [recompute_prepare]: 6.68998e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 6.53003e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.208e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.56998e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.372e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 1.055e-05 [rewriter_after_opt_a]: 3.644e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00059209 [jit_opt_b]: 5.818e-05, [1] [Cycle 1]: 5.154e-05, [2] [frontend_op_eliminate]: 2.156e-05 [inline_after_opt_a]: 1.845e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00041324 [jit_opt_after_cconv]: 0.00015212, [1] [Cycle 1]: 0.00014556, [11] [c_1]: 2.592e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 5.97001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.025e-05 [call_graph_tuple_transform]: 2.204e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 8.74e-06 [add_recomputation]: 5.226e-05 [cse_after_recomputation]: 2.315e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.248e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00044994 [symbol_engine_optimizer]: 7.748e-05, [1] [Cycle 1]: 7.063e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 9.11002e-06 [elim_not_effective]: 1.365e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 9.39998e-06 [renormalize]: 3.89991e-07 [validate]: 4.419e-05 Sums bootstrap : 0.000290s : 0.03% type_inference : 0.955593s : 99.21% event_method : 0.000027s : 0.00% auto_monad : 0.000082s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000631s : 0.07% rewriter_before_opt_a : 0.000105s : 0.01% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.00% jit_opt_a.a_1 : 0.000850s : 0.09% jit_opt_a.with_stream_mark : 0.000031s : 0.00% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003276s : 0.34% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.00% jit_opt_a.cse : 0.000049s : 0.01% jit_opt_a.replace_applicator : 0.000021s : 0.00% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000036s : 0.00% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000592s : 0.06% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000026s : 0.00% loop_unroll : 0.000413s : 0.04% jit_opt_after_cconv.c_1 : 0.000026s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000052s : 0.01% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000450s : 0.05% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.00% Time group info: ------[substitution.] 0.000275 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 4: substitution.graph_param_transform 84.23% : 0.000232s : 5: substitution.inline 1.06% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.93% : 0.000011s : 3: substitution.reduce_eliminate 1.58% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000004s : 2: substitution.replace_old_param 4.24% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.955484 2 99.57% : 0.951351s : 1: type_inference.infer 0.43% : 0.004133s : 1: type_inference.specialize ------[replace.] 0.000108 7 69.90% : 0.000076s : 5: replace.inline 30.10% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 95.62% : 0.000229s : 5: match.inline 4.38% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 2.19% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.36% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.38% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 19: predicate.load_eliminater 1.01% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.35% : 0.000003s : 13: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 20: predicate.switch_defer_inline 2.28% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 64: predicate.switch_simplify 1.55% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.64% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002766 25 61.54% : 0.001702s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.54% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.92% : 0.000994s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.972069 72 0.01% : 0.000055s : 1: add_recomputation 0.01% : 0.000086s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.03% : 0.000307s : 1: bootstrap 0.00% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.00% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 0.90% : 0.008702s : 1: jit_opt_a 0.02% : 0.000155s : 1: jit_opt_after_cconv 0.01% : 0.000061s : 1: jit_opt_b 0.04% : 0.000420s : 1: loop_unroll 0.06% : 0.000599s : 1: mutable_eliminate 0.11% : 0.001097s : 26: opt.transform.jit_opt_a 0.01% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.00% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.00% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.05% : 0.000456s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000637s : 1: py_interpret_to_execute 0.00% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 0.25% : 0.002390s : 1: renormalize.infer 0.09% : 0.000877s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.00% : 0.000039s : 1: rewriter_after_opt_a 0.01% : 0.000109s : 1: rewriter_before_opt_a 0.01% : 0.000080s : 1: symbol_engine_optimizer 98.31% : 0.955614s : 1: type_inference TotalTime = 0.0802144, [30] [bootstrap]: 0.00030042 [type_inference]: 0.0514944 [event_method]: 1.956e-05 [auto_monad]: 6.784e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 8.995e-05 [rewriter_before_opt_a]: 8.044e-05 [expand_dump_flag]: 3.15002e-06 [jit_opt_a]: 0.0256419, [2] [Cycle 1]: 0.00184761, [27] [switch_simplify]: 5.647e-05 [loop_unroll]: 2.903e-05 [a_1]: 0.00054112 [with_stream_mark]: 2.105e-05 [recompute_prepare]: 7.58001e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.78002e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00086601 [add_forward_monad_depend]: 5.72999e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.623e-05 [cse]: 3.374e-05 [replace_applicator]: 1.25e-05 [Cycle 2]: 0.0205516, [27] [switch_simplify]: 5.88002e-06 [loop_unroll]: 5.14998e-06 [a_1]: 8.834e-05 [with_stream_mark]: 9.27001e-06 [recompute_prepare]: 4.93001e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.79998e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 9.65002e-06 [get_grad_eliminate_]: 3.501e-05 [merge_forward]: 1.669e-05 [cell_reuse_recompute_pass]: 4.03999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.82e-05 [j_node_and_user_rematch]: 1.12e-05 [meta_fg_expand]: 3.11999e-06 [replace_old_param]: 1.195e-05 [inline_without_move]: 5.56002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.70002e-06 [auto_monad_grad]: 3.2e-06 [auto_monad_eliminator]: 2.318e-05 [cse]: 4.506e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 2.5e-05 [rewriter_after_opt_a]: 4.9e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00080456 [jit_opt_b]: 5.634e-05, [1] [Cycle 1]: 4.651e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.634e-05 [cconv]: 3.949e-05 [loop_unroll]: 0.00042726 [jit_opt_after_cconv]: 0.00015778, [1] [Cycle 1]: 0.00015027, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 4.41002e-06 [updatestate_depend_eliminate]: 7.41999e-06 [updatestate_assign_eliminate]: 4.28999e-06 [updatestate_loads_eliminate]: 2.97002e-06 [cse]: 2.655e-05 [call_graph_tuple_transform]: 2.197e-05 [tuple_list_get_item_eliminator]: 5.20999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.82e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 7.62998e-06 [add_recomputation]: 6.004e-05 [cse_after_recomputation]: 2.635e-05, [1] [Cycle 1]: 2.034e-05, [1] [cse]: 1.401e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 2.73e-06 [rewriter_after_jit_bprop_graph]: 7.21999e-06 [opt_after_jit_grad]: 0.00046481 [symbol_engine_optimizer]: 7.434e-05, [1] [Cycle 1]: 6.795e-05, [6] [build]: 4.31002e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.358e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 4.00003e-07 [validate]: 4.814e-05 Sums bootstrap : 0.000300s : 0.53% type_inference : 0.051494s : 91.52% event_method : 0.000020s : 0.03% auto_monad : 0.000068s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000090s : 0.16% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.11% jit_opt_a.loop_unroll : 0.000034s : 0.06% jit_opt_a.a_1 : 0.000629s : 1.12% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000012s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000041s : 0.07% jit_opt_a.merge_forward : 0.000021s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000866s : 1.54% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.03% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.07% jit_opt_a.cse : 0.000079s : 0.14% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000025s : 0.04% rewriter_after_opt_a : 0.000049s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000805s : 1.43% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000039s : 0.07% loop_unroll : 0.000427s : 0.76% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000060s : 0.11% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000465s : 0.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.09% Time group info: ------[substitution.] 0.000227 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.89% : 0.000007s : 3: substitution.graph_param_transform 82.24% : 0.000186s : 4: substitution.inline 2.16% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000006s : 4: substitution.remove_not_recompute_node 3.67% : 0.000008s : 2: substitution.replace_old_param 4.92% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051418 2 97.56% : 0.050165s : 1: type_inference.infer 2.44% : 0.001253s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.52% : 0.000048s : 4: replace.inline 31.48% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.77% : 0.000184s : 4: match.inline 5.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.66% : 0.000002s : 10: predicate.cast_eliminate 0.75% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.75% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000007s : 22: predicate.inline 1.32% : 0.000002s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.42% : 0.000002s : 10: predicate.reduce_eliminate 1.66% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.11% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.11% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.35% : 0.000002s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.23% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.70% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000743 13 47.38% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.31% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.30% : 0.000344s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.082014 72 0.08% : 0.000063s : 1: add_recomputation 0.09% : 0.000072s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.39% : 0.000319s : 1: bootstrap 0.05% : 0.000042s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000035s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 31.27% : 0.025646s : 1: jit_opt_a 0.20% : 0.000160s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.53% : 0.000436s : 1: loop_unroll 0.99% : 0.000813s : 1: mutable_eliminate 1.08% : 0.000887s : 26: opt.transform.jit_opt_a 0.06% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000093s : 1: py_interpret_to_execute 0.03% : 0.000027s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.62% : 0.000507s : 1: renormalize.infer 0.43% : 0.000351s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000052s : 1: rewriter_after_opt_a 0.10% : 0.000084s : 1: rewriter_before_opt_a 0.09% : 0.000077s : 1: symbol_engine_optimizer 62.81% : 0.051513s : 1: type_inference TotalTime = 0.251884, [30] [bootstrap]: 0.00028936 [type_inference]: 0.143911 [event_method]: 0.00081148 [auto_monad]: 0.00013013 [graph_reusing]: 7.16999e-06 [pre_auto_parallel]: 3.63999e-06 [py_interpret_to_execute]: 9.96e-05 [rewriter_before_opt_a]: 0.0001418 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.0856099, [3] [Cycle 1]: 0.0558495, [27] [switch_simplify]: 0.00010126 [loop_unroll]: 4.447e-05 [a_1]: 0.00113199 [with_stream_mark]: 4.67e-05 [recompute_prepare]: 3.492e-05 [updatestate_depend_eliminate]: 1.304e-05 [updatestate_assign_eliminate]: 7.55e-06 [updatestate_loads_eliminate]: 6.69999e-06 [parameter_eliminate]: 3.76001e-06 [specialize_transform]: 1.849e-05 [updatestate_useless_node_eliminater]: 1.486e-05 [accelerated_algorithm]: 1.653e-05 [meta_shard_fg_expand]: 9.52001e-06 [get_grad_eliminate_]: 1.63e-05 [merge_forward]: 9.61998e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.487e-05 [j_node_and_user_rematch]: 3.275e-05 [meta_fg_expand]: 0.00288567 [replace_old_param]: 0.00010133 [inline_without_move]: 7.876e-05 [renormalize]: 0.0502495 [add_forward_monad_depend]: 1.775e-05 [auto_monad_grad]: 9.39998e-06 [auto_monad_eliminator]: 6.887e-05 [cse]: 0.00039475 [replace_applicator]: 0.00011459 [Cycle 2]: 0.00489399, [27] [switch_simplify]: 4.757e-05 [loop_unroll]: 4.75e-05 [a_1]: 0.00144035 [with_stream_mark]: 2.662e-05 [recompute_prepare]: 1.275e-05 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 4.50001e-06 [parameter_eliminate]: 2.75002e-06 [specialize_transform]: 8.75001e-06 [updatestate_useless_node_eliminater]: 6.82002e-06 [accelerated_algorithm]: 7.86001e-06 [meta_shard_fg_expand]: 4.01001e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.702e-05 [j_node_and_user_rematch]: 1.193e-05 [meta_fg_expand]: 0.00015793 [replace_old_param]: 9.64e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.0027001 [add_forward_monad_depend]: 1.345e-05 [auto_monad_grad]: 2.80002e-06 [auto_monad_eliminator]: 2.268e-05 [cse]: 3.901e-05 [replace_applicator]: 2.582e-05 [Cycle 3]: 0.00035217, [27] [switch_simplify]: 6.62002e-06 [loop_unroll]: 4.54998e-06 [a_1]: 7.066e-05 [with_stream_mark]: 1.877e-05 [recompute_prepare]: 4.48999e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.88997e-06 [specialize_transform]: 4.43001e-06 [updatestate_useless_node_eliminater]: 3.52002e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 3.6e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 4.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.685e-05 [j_node_and_user_rematch]: 9.04998e-06 [meta_fg_expand]: 3.28e-06 [replace_old_param]: 3.83001e-06 [inline_without_move]: 4.00998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.97999e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 6.95002e-06 [cse]: 1.44e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 2.123e-05 [rewriter_after_opt_a]: 4.778e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00101774 [jit_opt_b]: 6.216e-05, [1] [Cycle 1]: 5.12e-05, [2] [frontend_op_eliminate]: 1.882e-05 [inline_after_opt_a]: 1.877e-05 [cconv]: 4.112e-05 [loop_unroll]: 0.0181041 [jit_opt_after_cconv]: 0.0002035, [1] [Cycle 1]: 0.00019275, [11] [c_1]: 2.693e-05 [parameter_eliminate]: 6.38998e-06 [updatestate_depend_eliminate]: 1.133e-05 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 4.259e-05 [call_graph_tuple_transform]: 2.211e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 1.19e-06 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.828e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.57002e-06 [add_recomputation]: 4.663e-05 [cse_after_recomputation]: 2.15e-05, [1] [Cycle 1]: 1.548e-05, [1] [cse]: 8.29998e-06 [auto_monad_reorder]: 1.517e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 9.84001e-06 [opt_after_jit_grad]: 0.0007501 [symbol_engine_optimizer]: 0.00018079, [1] [Cycle 1]: 0.00017241, [6] [build]: 4.43001e-06 [elim_shapecalc]: 6.74999e-06 [elim_not_effective]: 1.186e-05 [opt_reshape]: 6.41998e-06 [fold_const_symbol]: 6.71e-06 [renormalize]: 5.99975e-07 [validate]: 4.237e-05 Sums bootstrap : 0.000289s : 0.13% type_inference : 0.143911s : 63.66% event_method : 0.000811s : 0.36% auto_monad : 0.000130s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000100s : 0.04% rewriter_before_opt_a : 0.000142s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000155s : 0.07% jit_opt_a.loop_unroll : 0.000097s : 0.04% jit_opt_a.a_1 : 0.002643s : 1.17% jit_opt_a.with_stream_mark : 0.000092s : 0.04% jit_opt_a.recompute_prepare : 0.000052s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000021s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000014s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000013s : 0.01% jit_opt_a.parameter_eliminate : 0.000008s : 0.00% jit_opt_a.specialize_transform : 0.000032s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.01% jit_opt_a.accelerated_algorithm : 0.000030s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000016s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.01% jit_opt_a.merge_forward : 0.000018s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000069s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000054s : 0.02% jit_opt_a.meta_fg_expand : 0.003047s : 1.35% jit_opt_a.replace_old_param : 0.000115s : 0.05% jit_opt_a.inline_without_move : 0.000089s : 0.04% jit_opt_a.renormalize : 0.052950s : 23.42% jit_opt_a.add_forward_monad_depend : 0.000033s : 0.01% jit_opt_a.auto_monad_grad : 0.000013s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000099s : 0.04% jit_opt_a.cse : 0.000448s : 0.20% jit_opt_a.replace_applicator : 0.000146s : 0.06% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000048s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001018s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000041s : 0.02% loop_unroll : 0.018104s : 8.01% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000047s : 0.02% cse_after_recomputation.cse : 0.000008s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000750s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000007s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.02% Time group info: ------[substitution.] 0.000810 101 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.16% : 0.000001s : 1: substitution.fold_const_symbol 0.71% : 0.000006s : 1: substitution.graph_param_transform 66.99% : 0.000543s : 12: substitution.inline 3.80% : 0.000031s : 2: substitution.inline_without_move 1.64% : 0.000013s : 11: substitution.j_node_and_user_rematch 1.69% : 0.000014s : 7: substitution.minmaximum_grad 1.15% : 0.000009s : 5: substitution.partial_eliminate 1.28% : 0.000010s : 11: substitution.remove_not_recompute_node 5.71% : 0.000046s : 10: substitution.replace_applicator 1.05% : 0.000009s : 10: substitution.replace_old_param 0.73% : 0.000006s : 1: substitution.set_cell_output_no_recompute 1.25% : 0.000010s : 1: substitution.tile_eliminate 3.83% : 0.000031s : 7: substitution.tuple_list_convert_item_index_to_positive 2.24% : 0.000018s : 7: substitution.tuple_list_get_item_depend_reorder 7.53% : 0.000061s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.143776 2 96.55% : 0.138810s : 1: type_inference.infer 3.45% : 0.004966s : 1: type_inference.specialize ------[replace.] 0.000262 19 62.08% : 0.000162s : 12: replace.inline 37.92% : 0.000099s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000566 19 94.10% : 0.000532s : 12: match.inline 5.90% : 0.000033s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000447 2432 1.41% : 0.000006s : 42: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.30% : 0.000006s : 42: predicate.addn_check_dump 1.93% : 0.000009s : 42: predicate.addn_zero_filter 2.24% : 0.000010s : 42: predicate.arithmetic_simplify 1.78% : 0.000008s : 42: predicate.cast_eliminate 0.13% : 0.000001s : 1: predicate.check_bprop_eliminate 1.39% : 0.000006s : 42: predicate.compare_switch_simplify 1.34% : 0.000006s : 42: predicate.depend_value_elim 1.17% : 0.000005s : 42: predicate.dict_get_item_const_eliminator 1.32% : 0.000006s : 42: predicate.dict_get_item_eliminator 1.63% : 0.000007s : 42: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.10% : 0.000000s : 1: predicate.elim_not_effective 0.14% : 0.000001s : 1: predicate.elim_shapecalc_of_broadcastargs 1.70% : 0.000008s : 42: predicate.environ_add_const_eliminate 1.20% : 0.000005s : 42: predicate.environ_get_add_eliminate 1.20% : 0.000005s : 42: predicate.environ_get_depend_swap 1.46% : 0.000007s : 42: predicate.environ_get_eliminate 1.25% : 0.000006s : 42: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.93% : 0.000004s : 16: predicate.get_grad_eliminate 0.07% : 0.000000s : 1: predicate.graph_param_transform 4.39% : 0.000020s : 63: predicate.inline 1.90% : 0.000009s : 44: predicate.inline_without_move 0.27% : 0.000001s : 16: predicate.j_node_and_user_rematch 1.23% : 0.000006s : 16: predicate.less_batch_normalization 2.12% : 0.000009s : 49: predicate.list_to_tuple_eliminator_ 1.81% : 0.000008s : 50: predicate.load_eliminater 1.11% : 0.000005s : 1: predicate.loop_unroll_after_grad 3.35% : 0.000015s : 87: predicate.loop_unroll_before_grad 2.01% : 0.000009s : 43: predicate.make_slice_get_slice_eliminator 1.28% : 0.000006s : 42: predicate.merge_addn 1.25% : 0.000006s : 42: predicate.minmaximum_grad 0.74% : 0.000003s : 1: predicate.mutable_eliminate 0.06% : 0.000000s : 1: predicate.opt_reshape 1.94% : 0.000009s : 50: predicate.partial_eliminate 2.13% : 0.000010s : 42: predicate.print_const_string_wrapper 2.19% : 0.000010s : 42: predicate.reduce_eliminate 1.61% : 0.000007s : 49: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000002s : 16: predicate.remove_not_recompute_node 2.41% : 0.000011s : 93: predicate.replace_applicator 1.19% : 0.000005s : 44: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.85% : 0.000008s : 42: predicate.reshape_eliminate 1.63% : 0.000007s : 42: predicate.row_tensor_add_zeros_like 0.23% : 0.000001s : 1: predicate.row_tensor_eliminate 1.58% : 0.000007s : 42: predicate.same_eliminate 0.58% : 0.000003s : 16: predicate.set_cell_output_no_recompute 0.29% : 0.000001s : 2: predicate.special_op_eliminate 0.76% : 0.000003s : 16: predicate.specialize_transform 1.70% : 0.000008s : 42: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000007s : 42: predicate.stack_unstack_eliminate 0.08% : 0.000000s : 1: predicate.switch_call_monad_eliminater 3.45% : 0.000015s : 61: predicate.switch_defer_inline 2.36% : 0.000011s : 61: predicate.switch_layer_defer_inline 6.04% : 0.000027s : 149: predicate.switch_simplify 1.60% : 0.000007s : 42: predicate.tile_eliminate 1.46% : 0.000007s : 42: predicate.transpose_eliminate 1.86% : 0.000008s : 42: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000007s : 42: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000017s : 51: predicate.tuple_list_get_item_eliminator 1.94% : 0.000009s : 42: predicate.tuple_list_set_item_eliminator 1.69% : 0.000008s : 49: predicate.tuple_to_list_eliminator_ 1.54% : 0.000007s : 50: predicate.updatestate_pure_node_eliminater 2.51% : 0.000011s : 66: predicate.updatestate_useless_node_eliminater 1.83% : 0.000008s : 42: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.19% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004895 43 71.03% : 0.003477s : 27: func_graph_cloner_run.FuncGraphClonerGraph 28.97% : 0.001418s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.308336 87 0.02% : 0.000050s : 1: add_recomputation 0.04% : 0.000138s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.10% : 0.000316s : 1: bootstrap 0.01% : 0.000044s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.27% : 0.000825s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 27.77% : 0.085616s : 1: jit_opt_a 0.07% : 0.000207s : 1: jit_opt_after_cconv 0.02% : 0.000066s : 1: jit_opt_b 5.88% : 0.018125s : 1: loop_unroll 0.33% : 0.001033s : 1: mutable_eliminate 1.12% : 0.003462s : 39: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000032s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000024s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000028s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000760s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000103s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 15.99% : 0.049313s : 2: renormalize.infer 1.17% : 0.003604s : 2: renormalize.specialize 0.00% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000054s : 1: rewriter_after_opt_a 0.05% : 0.000145s : 1: rewriter_before_opt_a 0.06% : 0.000184s : 1: symbol_engine_optimizer 46.68% : 0.143940s : 1: type_inference TotalTime = 0.169915, [30] [bootstrap]: 0.00037904 [type_inference]: 0.155294 [event_method]: 2.602e-05 [auto_monad]: 8.14e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.00052042 [rewriter_before_opt_a]: 0.00011563 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.0109761, [2] [Cycle 1]: 0.00470698, [27] [switch_simplify]: 6.551e-05 [loop_unroll]: 3.786e-05 [a_1]: 0.00076002 [with_stream_mark]: 1.96e-05 [recompute_prepare]: 9.94001e-06 [updatestate_depend_eliminate]: 4.95999e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 9.07001e-06 [updatestate_useless_node_eliminater]: 7.08e-06 [accelerated_algorithm]: 7.93999e-06 [meta_shard_fg_expand]: 2.68998e-06 [get_grad_eliminate_]: 7.27002e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.789e-05 [j_node_and_user_rematch]: 1.094e-05 [meta_fg_expand]: 2.90998e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 7.28e-06 [renormalize]: 0.00343193 [add_forward_monad_depend]: 8.22003e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.849e-05 [cse]: 3.594e-05 [replace_applicator]: 2.177e-05 [Cycle 2]: 0.00041695, [27] [switch_simplify]: 8.52e-06 [loop_unroll]: 6.81001e-06 [a_1]: 0.00013226 [with_stream_mark]: 1.404e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.49999e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 2.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.66e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.67001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.78002e-06 [cse]: 1.762e-05 [replace_applicator]: 7.03998e-06 [py_interpret_to_execute_after_opt_a]: 1.655e-05 [rewriter_after_opt_a]: 3.975e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00069191 [jit_opt_b]: 5.932e-05, [1] [Cycle 1]: 5.095e-05, [2] [frontend_op_eliminate]: 2.016e-05 [inline_after_opt_a]: 1.916e-05 [cconv]: 2.723e-05 [loop_unroll]: 0.0004235 [jit_opt_after_cconv]: 0.00016534, [1] [Cycle 1]: 0.00015821, [11] [c_1]: 2.715e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [cse]: 2.675e-05 [call_graph_tuple_transform]: 2.343e-05 [tuple_list_get_item_eliminator]: 6.60002e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 7.05e-06 [remove_dup_value]: 1.826e-05 [partial_unused_args_eliminate]: 2.05002e-06 [environ_conv]: 8.39002e-06 [add_recomputation]: 5.018e-05 [cse_after_recomputation]: 2.528e-05, [1] [Cycle 1]: 1.974e-05, [1] [cse]: 1.391e-05 [auto_monad_reorder]: 1.718e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 5.007e-05 [opt_after_jit_grad]: 0.00048153 [symbol_engine_optimizer]: 7.963e-05, [1] [Cycle 1]: 7.328e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 7.68001e-06 [fold_const_symbol]: 9.82001e-06 [renormalize]: 4.39992e-07 [validate]: 0.00013128 Sums bootstrap : 0.000379s : 0.23% type_inference : 0.155294s : 95.03% event_method : 0.000026s : 0.02% auto_monad : 0.000081s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000520s : 0.32% rewriter_before_opt_a : 0.000116s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.000892s : 0.55% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003432s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000692s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000423s : 0.26% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000050s : 0.03% opt_after_jit_grad : 0.000482s : 0.29% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000131s : 0.08% Time group info: ------[substitution.] 0.000273 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.52% : 0.000007s : 4: substitution.graph_param_transform 86.25% : 0.000236s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000006s : 4: substitution.remove_not_recompute_node 1.81% : 0.000005s : 2: substitution.replace_old_param 4.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.155195 2 97.76% : 0.151721s : 1: type_inference.infer 2.24% : 0.003474s : 1: type_inference.specialize ------[replace.] 0.000114 7 69.21% : 0.000079s : 5: replace.inline 30.79% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 7 95.26% : 0.000232s : 5: match.inline 4.74% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.36% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.16% : 0.000003s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.44% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.02% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 0.85% : 0.000001s : 4: predicate.opt_reshape 2.03% : 0.000003s : 19: predicate.partial_eliminate 1.36% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.59% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.20% : 0.000011s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.64% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.05% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.90% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002893 25 65.64% : 0.001899s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.29% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.07% : 0.000928s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.174500 72 0.03% : 0.000053s : 1: add_recomputation 0.05% : 0.000085s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000407s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.29% : 0.010980s : 1: jit_opt_a 0.10% : 0.000168s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.25% : 0.000432s : 1: loop_unroll 0.40% : 0.000702s : 1: mutable_eliminate 0.67% : 0.001167s : 26: opt.transform.jit_opt_a 0.03% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000490s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000528s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.41% : 0.002457s : 1: renormalize.infer 0.55% : 0.000963s : 1: renormalize.specialize 0.03% : 0.000053s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000121s : 1: rewriter_before_opt_a 0.05% : 0.000082s : 1: symbol_engine_optimizer 89.01% : 0.155314s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.696. [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda00655e0> should be wrapped by jit only once. .[WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.152.8 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.236891, [30] [bootstrap]: 0.00036379 [type_inference]: 0.22468 [event_method]: 2.063e-05 [auto_monad]: 7.136e-05 [graph_reusing]: 5.57001e-06 [pre_auto_parallel]: 2.28998e-06 [py_interpret_to_execute]: 0.00048574 [rewriter_before_opt_a]: 8.697e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0084334, [2] [Cycle 1]: 0.00420257, [27] [switch_simplify]: 6.764e-05 [loop_unroll]: 3.245e-05 [a_1]: 0.00064455 [with_stream_mark]: 2.47e-05 [recompute_prepare]: 9.49e-06 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 7.43999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.76999e-06 [get_grad_eliminate_]: 6.67002e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 1.071e-05 [inline_without_move]: 6.20002e-06 [renormalize]: 0.00303775 [add_forward_monad_depend]: 8.57e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.936e-05 [cse]: 3.328e-05 [replace_applicator]: 2.112e-05 [Cycle 2]: 0.00038001, [27] [switch_simplify]: 6.79999e-06 [loop_unroll]: 6.22001e-06 [a_1]: 0.00012491 [with_stream_mark]: 1.504e-05 [recompute_prepare]: 6.02999e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.86003e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 3.11001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 9.98998e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.38002e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.63998e-06 [cse]: 1.041e-05 [replace_applicator]: 5.96998e-06 [py_interpret_to_execute_after_opt_a]: 4.117e-05 [rewriter_after_opt_a]: 4.428e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 5.72999e-06 [mutable_eliminate]: 0.0007539 [jit_opt_b]: 5.58e-05, [1] [Cycle 1]: 4.78e-05, [2] [frontend_op_eliminate]: 1.871e-05 [inline_after_opt_a]: 1.79e-05 [cconv]: 3.06e-05 [loop_unroll]: 0.00045906 [jit_opt_after_cconv]: 0.00017008, [1] [Cycle 1]: 0.00016239, [11] [c_1]: 2.662e-05 [parameter_eliminate]: 4.07e-06 [updatestate_depend_eliminate]: 7.7e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.038e-05 [call_graph_tuple_transform]: 2.323e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.561e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 9.62001e-06 [add_recomputation]: 6.005e-05 [cse_after_recomputation]: 2.43e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.467e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 7.58001e-06 [opt_after_jit_grad]: 0.00051456 [symbol_engine_optimizer]: 0.00025222, [1] [Cycle 1]: 0.00024539, [6] [build]: 5.62001e-06 [elim_shapecalc]: 8.65001e-06 [elim_not_effective]: 0.00017241 [opt_reshape]: 8.89998e-06 [fold_const_symbol]: 1.279e-05 [renormalize]: 9.00007e-07 [validate]: 5.674e-05 Sums bootstrap : 0.000364s : 0.16% type_inference : 0.224680s : 96.69% event_method : 0.000021s : 0.01% auto_monad : 0.000071s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000486s : 0.21% rewriter_before_opt_a : 0.000087s : 0.04% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.03% jit_opt_a.loop_unroll : 0.000039s : 0.02% jit_opt_a.a_1 : 0.000769s : 0.33% jit_opt_a.with_stream_mark : 0.000040s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003038s : 1.31% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000041s : 0.02% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000754s : 0.32% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000459s : 0.20% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000515s : 0.22% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000172s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.02% Time group info: ------[substitution.] 0.000427 24 37.29% : 0.000159s : 2: substitution.elim_not_effective 0.46% : 0.000002s : 2: substitution.fold_const_symbol 1.49% : 0.000006s : 4: substitution.graph_param_transform 53.76% : 0.000229s : 4: substitution.inline 1.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.39% : 0.000006s : 4: substitution.remove_not_recompute_node 1.43% : 0.000006s : 2: substitution.replace_old_param 3.13% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.224562 2 98.64% : 0.221507s : 1: type_inference.infer 1.36% : 0.003055s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.52% : 0.000057s : 4: replace.inline 30.48% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 6 94.86% : 0.000227s : 4: match.inline 5.14% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.56% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.51% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.89% : 0.000003s : 4: predicate.mutable_eliminate 0.90% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.50% : 0.000002s : 12: predicate.print_const_string_wrapper 1.85% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.43% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002428 22 68.11% : 0.001654s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.29% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.60% : 0.000719s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.241171 72 0.03% : 0.000064s : 1: add_recomputation 0.03% : 0.000075s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.16% : 0.000385s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.50% : 0.008437s : 1: jit_opt_a 0.07% : 0.000173s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.19% : 0.000469s : 1: loop_unroll 0.32% : 0.000764s : 1: mutable_eliminate 0.43% : 0.001027s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000199s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000526s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000493s : 1: py_interpret_to_execute 0.02% : 0.000044s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.94% : 0.002261s : 1: renormalize.infer 0.32% : 0.000765s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.04% : 0.000092s : 1: rewriter_before_opt_a 0.11% : 0.000255s : 1: symbol_engine_optimizer 93.17% : 0.224701s : 1: type_inference TotalTime = 0.156157, [30] [bootstrap]: 0.00026434 [type_inference]: 0.128967 [event_method]: 0.00045835 [auto_monad]: 0.0001165 [graph_reusing]: 7.28999e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 4.476e-05 [rewriter_before_opt_a]: 0.00012032 [expand_dump_flag]: 3.82998e-06 [jit_opt_a]: 0.023855, [3] [Cycle 1]: 0.0163023, [27] [switch_simplify]: 7.47e-05 [loop_unroll]: 4.464e-05 [a_1]: 0.00090585 [with_stream_mark]: 3.541e-05 [recompute_prepare]: 2.055e-05 [updatestate_depend_eliminate]: 9.44e-06 [updatestate_assign_eliminate]: 6.80002e-06 [updatestate_loads_eliminate]: 6.72002e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 1.476e-05 [updatestate_useless_node_eliminater]: 1.355e-05 [accelerated_algorithm]: 1.387e-05 [meta_shard_fg_expand]: 3.88001e-06 [get_grad_eliminate_]: 1.313e-05 [merge_forward]: 9.19e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.756e-05 [j_node_and_user_rematch]: 2.462e-05 [meta_fg_expand]: 0.0019142 [replace_old_param]: 7.52e-05 [inline_without_move]: 5.956e-05 [renormalize]: 0.012337 [add_forward_monad_depend]: 1.315e-05 [auto_monad_grad]: 5.84999e-06 [auto_monad_eliminator]: 6.37e-05 [cse]: 0.00025416 [replace_applicator]: 9.143e-05 [Cycle 2]: 0.00352673, [27] [switch_simplify]: 4.355e-05 [loop_unroll]: 4.248e-05 [a_1]: 0.00115428 [with_stream_mark]: 1.891e-05 [recompute_prepare]: 1.009e-05 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 7.13998e-06 [accelerated_algorithm]: 7.73999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 7.41001e-06 [merge_forward]: 4.97e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.714e-05 [j_node_and_user_rematch]: 1.172e-05 [meta_fg_expand]: 7.695e-05 [replace_old_param]: 7.76001e-06 [inline_without_move]: 7.45e-06 [renormalize]: 0.00181991 [add_forward_monad_depend]: 8.57e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.471e-05 [cse]: 2.695e-05 [replace_applicator]: 1.764e-05 [Cycle 3]: 0.000257, [27] [switch_simplify]: 4.67e-06 [loop_unroll]: 3.5e-06 [a_1]: 3.999e-05 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 3.83001e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.01e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 3.58e-06 [updatestate_useless_node_eliminater]: 3.2e-06 [accelerated_algorithm]: 3.45e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 3.15998e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 2.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.16e-05 [j_node_and_user_rematch]: 6.19999e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 2.89001e-06 [inline_without_move]: 3.11001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 3.9e-06 [cse]: 8.55001e-06 [replace_applicator]: 3.34001e-06 [py_interpret_to_execute_after_opt_a]: 1.324e-05 [rewriter_after_opt_a]: 3.535e-05 [convert_after_rewriter]: 6.20002e-06 [order_py_execute_after_rewriter]: 4.11001e-06 [mutable_eliminate]: 0.00071659 [jit_opt_b]: 4.055e-05, [1] [Cycle 1]: 3.23e-05, [2] [frontend_op_eliminate]: 9.87001e-06 [inline_after_opt_a]: 1.068e-05 [cconv]: 2.634e-05 [loop_unroll]: 0.00041267 [jit_opt_after_cconv]: 0.00012664, [1] [Cycle 1]: 0.0001207, [11] [c_1]: 1.202e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 1.79e-06 [updatestate_loads_eliminate]: 1.70001e-06 [cse]: 2.087e-05 [call_graph_tuple_transform]: 1.38e-05 [tuple_list_get_item_eliminator]: 4.14002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 1.10999e-06 [switch_simplify]: 3.53999e-06 [remove_dup_value]: 1.424e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 4.86002e-06 [add_recomputation]: 3.642e-05 [cse_after_recomputation]: 1.826e-05, [1] [Cycle 1]: 1.343e-05, [1] [cse]: 7.38e-06 [auto_monad_reorder]: 1.265e-05 [get_jit_bprop_graph]: 2.53e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00052567 [symbol_engine_optimizer]: 6.337e-05, [1] [Cycle 1]: 5.738e-05, [6] [build]: 3.5e-06 [elim_shapecalc]: 5.84e-06 [elim_not_effective]: 9.93002e-06 [opt_reshape]: 3.63999e-06 [fold_const_symbol]: 5.84e-06 [renormalize]: 5.09986e-07 [validate]: 4.827e-05 Sums bootstrap : 0.000264s : 0.17% type_inference : 0.128967s : 85.13% event_method : 0.000458s : 0.30% auto_monad : 0.000117s : 0.08% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000045s : 0.03% rewriter_before_opt_a : 0.000120s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000123s : 0.08% jit_opt_a.loop_unroll : 0.000091s : 0.06% jit_opt_a.a_1 : 0.002100s : 1.39% jit_opt_a.with_stream_mark : 0.000067s : 0.04% jit_opt_a.recompute_prepare : 0.000034s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000012s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000026s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000024s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000056s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000043s : 0.03% jit_opt_a.meta_fg_expand : 0.001993s : 1.32% jit_opt_a.replace_old_param : 0.000086s : 0.06% jit_opt_a.inline_without_move : 0.000070s : 0.05% jit_opt_a.renormalize : 0.014157s : 9.35% jit_opt_a.add_forward_monad_depend : 0.000023s : 0.01% jit_opt_a.auto_monad_grad : 0.000009s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.05% jit_opt_a.cse : 0.000290s : 0.19% jit_opt_a.replace_applicator : 0.000112s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000717s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000413s : 0.27% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000014s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000036s : 0.02% cse_after_recomputation.cse : 0.000007s : 0.00% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000526s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.03% Time group info: ------[substitution.] 0.000540 104 0.35% : 0.000002s : 1: substitution.elim_not_effective 0.17% : 0.000001s : 1: substitution.fold_const_symbol 0.76% : 0.000004s : 1: substitution.graph_param_transform 63.24% : 0.000341s : 12: substitution.inline 3.26% : 0.000018s : 2: substitution.inline_without_move 1.73% : 0.000009s : 12: substitution.j_node_and_user_rematch 2.06% : 0.000011s : 7: substitution.minmaximum_grad 1.41% : 0.000008s : 5: substitution.partial_eliminate 1.95% : 0.000010s : 12: substitution.remove_not_recompute_node 5.99% : 0.000032s : 10: substitution.replace_applicator 1.25% : 0.000007s : 10: substitution.replace_old_param 1.28% : 0.000007s : 1: substitution.reshape_eliminate 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.34% : 0.000007s : 1: substitution.tile_eliminate 4.12% : 0.000022s : 7: substitution.tuple_list_convert_item_index_to_positive 2.86% : 0.000015s : 7: substitution.tuple_list_get_item_depend_reorder 7.81% : 0.000042s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128861 2 97.68% : 0.125865s : 1: type_inference.infer 2.32% : 0.002996s : 1: type_inference.specialize ------[replace.] 0.000169 19 64.96% : 0.000110s : 12: replace.inline 35.04% : 0.000059s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000355 19 94.14% : 0.000334s : 12: match.inline 5.86% : 0.000021s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000362 2544 1.49% : 0.000005s : 44: predicate.accumulaten_eliminater 0.37% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.54% : 0.000006s : 44: predicate.addn_check_dump 1.60% : 0.000006s : 44: predicate.addn_zero_filter 2.00% : 0.000007s : 44: predicate.arithmetic_simplify 1.65% : 0.000006s : 44: predicate.cast_eliminate 0.08% : 0.000000s : 1: predicate.check_bprop_eliminate 1.42% : 0.000005s : 44: predicate.compare_switch_simplify 1.49% : 0.000005s : 44: predicate.depend_value_elim 1.48% : 0.000005s : 44: predicate.dict_get_item_const_eliminator 1.56% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.53% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.25% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.12% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.49% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.45% : 0.000005s : 44: predicate.environ_get_depend_swap 1.50% : 0.000005s : 44: predicate.environ_get_eliminate 1.46% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.82% : 0.000003s : 18: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.18% : 0.000015s : 65: predicate.inline 2.13% : 0.000008s : 46: predicate.inline_without_move 0.37% : 0.000001s : 18: predicate.j_node_and_user_rematch 1.05% : 0.000004s : 18: predicate.less_batch_normalization 1.77% : 0.000006s : 51: predicate.list_to_tuple_eliminator_ 1.86% : 0.000007s : 52: predicate.load_eliminater 0.31% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.62% : 0.000013s : 89: predicate.loop_unroll_before_grad 1.73% : 0.000006s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 44: predicate.merge_addn 1.50% : 0.000005s : 44: predicate.minmaximum_grad 0.58% : 0.000002s : 1: predicate.mutable_eliminate 0.07% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000009s : 52: predicate.partial_eliminate 1.53% : 0.000006s : 44: predicate.print_const_string_wrapper 1.98% : 0.000007s : 44: predicate.reduce_eliminate 1.86% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000002s : 18: predicate.remove_not_recompute_node 2.91% : 0.000011s : 97: predicate.replace_applicator 1.20% : 0.000004s : 46: predicate.replace_old_param 0.07% : 0.000000s : 1: predicate.reset_defer_inline 1.64% : 0.000006s : 44: predicate.reshape_eliminate 1.59% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.14% : 0.000001s : 1: predicate.row_tensor_eliminate 1.57% : 0.000006s : 44: predicate.same_eliminate 0.52% : 0.000002s : 18: predicate.set_cell_output_no_recompute 0.26% : 0.000001s : 2: predicate.special_op_eliminate 0.89% : 0.000003s : 18: predicate.specialize_transform 1.77% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.71% : 0.000010s : 63: predicate.switch_defer_inline 2.54% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.28% : 0.000023s : 153: predicate.switch_simplify 1.60% : 0.000006s : 44: predicate.tile_eliminate 1.51% : 0.000005s : 44: predicate.transpose_eliminate 1.84% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.96% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.88% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.85% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.73% : 0.000010s : 70: predicate.updatestate_useless_node_eliminater 1.91% : 0.000007s : 44: predicate.value_based_eliminate 0.04% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003620 43 77.47% : 0.002805s : 27: func_graph_cloner_run.FuncGraphClonerGraph 22.53% : 0.000816s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173053 87 0.02% : 0.000039s : 1: add_recomputation 0.07% : 0.000123s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.17% : 0.000291s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.00% : 0.000008s : 1: convert_after_rewriter 0.01% : 0.000020s : 1: cse_after_recomputation 0.00% : 0.000007s : 1: environ_conv 0.27% : 0.000468s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 13.79% : 0.023858s : 1: jit_opt_a 0.07% : 0.000129s : 1: jit_opt_after_cconv 0.02% : 0.000043s : 1: jit_opt_b 0.24% : 0.000420s : 1: loop_unroll 0.42% : 0.000726s : 1: mutable_eliminate 1.60% : 0.002763s : 39: opt.transform.jit_opt_a 0.02% : 0.000030s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000534s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000047s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 6.96% : 0.012047s : 2: renormalize.infer 1.21% : 0.002087s : 2: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000124s : 1: rewriter_before_opt_a 0.04% : 0.000066s : 1: symbol_engine_optimizer 74.54% : 0.128989s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.166.690 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda001b280> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.167.469 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.111699, [30] [bootstrap]: 0.00029548 [type_inference]: 0.0510946 [event_method]: 1.848e-05 [auto_monad]: 0.0001349 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 9.414e-05 [rewriter_before_opt_a]: 7.747e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.0576271, [2] [Cycle 1]: 0.0541017, [27] [switch_simplify]: 5.543e-05 [loop_unroll]: 2.884e-05 [a_1]: 0.05271 [with_stream_mark]: 2.588e-05 [recompute_prepare]: 1.339e-05 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 3.38999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.46002e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 3.3e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 3.31999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00090538 [add_forward_monad_depend]: 5.95002e-06 [auto_monad_grad]: 2.13998e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 3.235e-05 [replace_applicator]: 1.192e-05 [Cycle 2]: 0.0003166, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.66e-06 [a_1]: 8.917e-05 [with_stream_mark]: 1.043e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.03002e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 7.68999e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.71999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.172e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.217e-05 [rewriter_after_opt_a]: 3.703e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00073847 [jit_opt_b]: 5.154e-05, [1] [Cycle 1]: 4.331e-05, [2] [frontend_op_eliminate]: 1.624e-05 [inline_after_opt_a]: 1.65e-05 [cconv]: 2.705e-05 [loop_unroll]: 0.0004069 [jit_opt_after_cconv]: 0.00014324, [1] [Cycle 1]: 0.00013742, [11] [c_1]: 2.015e-05 [parameter_eliminate]: 2.99001e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.482e-05 [call_graph_tuple_transform]: 1.86e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.463e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 4.958e-05 [cse_after_recomputation]: 3.095e-05, [1] [Cycle 1]: 2.584e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 4.44002e-06 [opt_after_jit_grad]: 0.00050106 [symbol_engine_optimizer]: 7.274e-05, [1] [Cycle 1]: 6.655e-05, [6] [build]: 3.08998e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 4.10015e-07 [validate]: 3.968e-05 Sums bootstrap : 0.000295s : 0.27% type_inference : 0.051095s : 47.36% event_method : 0.000018s : 0.02% auto_monad : 0.000135s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000094s : 0.09% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.052799s : 48.94% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000905s : 0.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000738s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000407s : 0.38% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000501s : 0.46% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.052264 23 0.00% : 0.000002s : 2: substitution.elim_not_effective 0.00% : 0.000002s : 2: substitution.fold_const_symbol 0.01% : 0.000006s : 3: substitution.graph_param_transform 99.93% : 0.052226s : 4: substitution.inline 0.01% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.01% : 0.000005s : 4: substitution.remove_not_recompute_node 0.01% : 0.000005s : 2: substitution.replace_old_param 0.03% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051024 2 97.39% : 0.049693s : 1: type_inference.infer 2.61% : 0.001331s : 1: type_inference.specialize ------[replace.] 0.000127 6 69.83% : 0.000089s : 4: replace.inline 30.17% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.052236 6 99.97% : 0.052222s : 4: match.inline 0.03% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.75% : 0.000002s : 10: predicate.addn_zero_filter 2.08% : 0.000003s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 6.12% : 0.000008s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.71% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 15: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.30% : 0.000003s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 2.22% : 0.000003s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.59% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.28% : 0.000004s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.90% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.29% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.78% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.052801 13 0.69% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 98.62% : 0.052072s : 1: func_graph_cloner_run.FuncGraphClonerNode 0.69% : 0.000364s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.165737 72 0.03% : 0.000052s : 1: add_recomputation 0.08% : 0.000139s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.19% : 0.000313s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000033s : 1: cse_after_recomputation 0.00% : 0.000008s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 34.77% : 0.057630s : 1: jit_opt_a 0.09% : 0.000146s : 1: jit_opt_after_cconv 0.03% : 0.000054s : 1: jit_opt_b 0.25% : 0.000415s : 1: loop_unroll 0.45% : 0.000748s : 1: mutable_eliminate 31.99% : 0.053019s : 26: opt.transform.jit_opt_a 0.03% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.05% : 0.000084s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000509s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000097s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.31% : 0.000520s : 1: renormalize.infer 0.23% : 0.000377s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.05% : 0.000081s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 30.84% : 0.051111s : 1: type_inference TotalTime = 0.156201, [30] [bootstrap]: 0.0003075 [type_inference]: 0.14411 [event_method]: 2.068e-05 [auto_monad]: 7.414e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 0.00048779 [rewriter_before_opt_a]: 9.729e-05 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.0084123, [2] [Cycle 1]: 0.00439749, [27] [switch_simplify]: 5.855e-05 [loop_unroll]: 3.378e-05 [a_1]: 0.00078224 [with_stream_mark]: 1.909e-05 [recompute_prepare]: 1.139e-05 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 7.58999e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 1.145e-05 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00311953 [add_forward_monad_depend]: 7.15e-06 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 1.993e-05 [cse]: 3.212e-05 [replace_applicator]: 2.158e-05 [Cycle 2]: 0.00045793, [27] [switch_simplify]: 7.64002e-06 [loop_unroll]: 6.87002e-06 [a_1]: 0.00012609 [with_stream_mark]: 1.556e-05 [recompute_prepare]: 7.11001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 2.61e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.757e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.86e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 5.653e-05 [auto_monad_eliminator]: 7.51999e-06 [cse]: 1.748e-05 [replace_applicator]: 7.46001e-06 [py_interpret_to_execute_after_opt_a]: 1.629e-05 [rewriter_after_opt_a]: 4.16e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00070226 [jit_opt_b]: 5.84e-05, [1] [Cycle 1]: 5.065e-05, [2] [frontend_op_eliminate]: 2.002e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 3.07e-05 [loop_unroll]: 0.00043154 [jit_opt_after_cconv]: 0.00017649, [1] [Cycle 1]: 0.00017016, [11] [c_1]: 2.7e-05 [parameter_eliminate]: 4.60999e-06 [updatestate_depend_eliminate]: 8.55001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 3.287e-05 [call_graph_tuple_transform]: 2.335e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.26998e-06 [remove_dup_value]: 1.793e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 9.19e-06 [add_recomputation]: 4.968e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.019e-05, [1] [cse]: 1.421e-05 [auto_monad_reorder]: 1.756e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 4.58999e-06 [opt_after_jit_grad]: 0.00075979 [symbol_engine_optimizer]: 8.108e-05, [1] [Cycle 1]: 7.403e-05, [6] [build]: 4.65001e-06 [elim_shapecalc]: 9.82999e-06 [elim_not_effective]: 1.461e-05 [opt_reshape]: 6.62002e-06 [fold_const_symbol]: 9.87999e-06 [renormalize]: 3.80009e-07 [validate]: 5.095e-05 Sums bootstrap : 0.000307s : 0.20% type_inference : 0.144110s : 94.80% event_method : 0.000021s : 0.01% auto_monad : 0.000074s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000488s : 0.32% rewriter_before_opt_a : 0.000097s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000908s : 0.60% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003120s : 2.05% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000059s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000702s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000432s : 0.28% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000760s : 0.50% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.03% Time group info: ------[substitution.] 0.000274 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.41% : 0.000007s : 4: substitution.graph_param_transform 86.94% : 0.000238s : 5: substitution.inline 1.75% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000005s : 2: substitution.replace_old_param 3.98% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.144025 2 97.85% : 0.140927s : 1: type_inference.infer 2.15% : 0.003099s : 1: type_inference.specialize ------[replace.] 0.000174 7 41.28% : 0.000072s : 5: replace.inline 58.72% : 0.000102s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 96.05% : 0.000235s : 5: match.inline 3.95% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.83% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.79% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.98% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.98% : 0.000010s : 64: predicate.switch_simplify 1.60% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.52% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002756 25 65.16% : 0.001796s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.92% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.93% : 0.000880s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160530 72 0.03% : 0.000052s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000327s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.24% : 0.008416s : 1: jit_opt_a 0.11% : 0.000179s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.27% : 0.000439s : 1: loop_unroll 0.44% : 0.000713s : 1: mutable_eliminate 0.73% : 0.001168s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000772s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000495s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.34% : 0.002152s : 1: renormalize.infer 0.57% : 0.000920s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.06% : 0.000102s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 89.78% : 0.144123s : 1: type_inference TotalTime = 0.113811, [30] [bootstrap]: 0.00027532 [type_inference]: 0.0798783 [event_method]: 0.00029247 [auto_monad]: 0.00011609 [graph_reusing]: 7.78001e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 3.695e-05 [rewriter_before_opt_a]: 0.00012029 [expand_dump_flag]: 3.75998e-06 [jit_opt_a]: 0.0303843, [3] [Cycle 1]: 0.0218577, [27] [switch_simplify]: 8.122e-05 [loop_unroll]: 4.378e-05 [a_1]: 0.00102519 [with_stream_mark]: 4.165e-05 [recompute_prepare]: 2.599e-05 [updatestate_depend_eliminate]: 9.15999e-06 [updatestate_assign_eliminate]: 6.87002e-06 [updatestate_loads_eliminate]: 6.83e-06 [parameter_eliminate]: 2.80002e-06 [specialize_transform]: 1.53e-05 [updatestate_useless_node_eliminater]: 1.441e-05 [accelerated_algorithm]: 1.639e-05 [meta_shard_fg_expand]: 3.83999e-06 [get_grad_eliminate_]: 1.468e-05 [merge_forward]: 1.066e-05 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.163e-05 [j_node_and_user_rematch]: 2.705e-05 [meta_fg_expand]: 0.00194602 [replace_old_param]: 7.582e-05 [inline_without_move]: 6.212e-05 [renormalize]: 0.0176277 [add_forward_monad_depend]: 1.678e-05 [auto_monad_grad]: 6.92002e-06 [auto_monad_eliminator]: 6.573e-05 [cse]: 0.00028334 [replace_applicator]: 9.413e-05 [Cycle 2]: 0.0041092, [27] [switch_simplify]: 4.374e-05 [loop_unroll]: 4.288e-05 [a_1]: 0.00119143 [with_stream_mark]: 2.698e-05 [recompute_prepare]: 1.232e-05 [updatestate_depend_eliminate]: 5.62001e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 8.52998e-06 [updatestate_useless_node_eliminater]: 7.28e-06 [accelerated_algorithm]: 7.83001e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 6.81001e-06 [merge_forward]: 5.15999e-06 [cell_reuse_recompute_pass]: 2.07001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.038e-05 [j_node_and_user_rematch]: 1.288e-05 [meta_fg_expand]: 8.129e-05 [replace_old_param]: 9.81e-06 [inline_without_move]: 6.54999e-06 [renormalize]: 0.0023031 [add_forward_monad_depend]: 1.276e-05 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.919e-05 [cse]: 3.209e-05 [replace_applicator]: 2.196e-05 [Cycle 3]: 0.00028674, [27] [switch_simplify]: 4.94998e-06 [loop_unroll]: 3.96001e-06 [a_1]: 3.965e-05 [with_stream_mark]: 1.467e-05 [recompute_prepare]: 3.93999e-06 [updatestate_depend_eliminate]: 2.55002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 4.03999e-06 [updatestate_useless_node_eliminater]: 3.25e-06 [accelerated_algorithm]: 3.48e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 3.07002e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 3.33e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 6.49999e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 3.47002e-06 [inline_without_move]: 2.94999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 1.42e-06 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.419e-05 [replace_applicator]: 4.37e-06 [py_interpret_to_execute_after_opt_a]: 1.588e-05 [rewriter_after_opt_a]: 4.065e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00080973 [jit_opt_b]: 4.369e-05, [1] [Cycle 1]: 3.538e-05, [2] [frontend_op_eliminate]: 9.97999e-06 [inline_after_opt_a]: 1.242e-05 [cconv]: 3.304e-05 [loop_unroll]: 0.0005297 [jit_opt_after_cconv]: 0.00015007, [1] [Cycle 1]: 0.00014275, [11] [c_1]: 1.238e-05 [parameter_eliminate]: 5.38002e-06 [updatestate_depend_eliminate]: 8.49998e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 1.91e-06 [cse]: 3.06e-05 [call_graph_tuple_transform]: 1.655e-05 [tuple_list_get_item_eliminator]: 3.61001e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 7.79983e-07 [switch_simplify]: 3.66001e-06 [remove_dup_value]: 1.68e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 5.72001e-06 [add_recomputation]: 4.161e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 8.57e-06 [auto_monad_reorder]: 1.387e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 9.18002e-06 [opt_after_jit_grad]: 0.00057929 [symbol_engine_optimizer]: 8.191e-05, [1] [Cycle 1]: 7.406e-05, [6] [build]: 6.44999e-06 [elim_shapecalc]: 1.235e-05 [elim_not_effective]: 1.236e-05 [opt_reshape]: 3.71999e-06 [fold_const_symbol]: 6.31e-06 [renormalize]: 6.39993e-07 [validate]: 4.079e-05 Sums bootstrap : 0.000275s : 0.25% type_inference : 0.079878s : 73.52% event_method : 0.000292s : 0.27% auto_monad : 0.000116s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000037s : 0.03% rewriter_before_opt_a : 0.000120s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000130s : 0.12% jit_opt_a.loop_unroll : 0.000091s : 0.08% jit_opt_a.a_1 : 0.002256s : 2.08% jit_opt_a.with_stream_mark : 0.000083s : 0.08% jit_opt_a.recompute_prepare : 0.000042s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000017s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.02% jit_opt_a.accelerated_algorithm : 0.000028s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.02% jit_opt_a.merge_forward : 0.000019s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000067s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000046s : 0.04% jit_opt_a.meta_fg_expand : 0.002029s : 1.87% jit_opt_a.replace_old_param : 0.000089s : 0.08% jit_opt_a.inline_without_move : 0.000072s : 0.07% jit_opt_a.renormalize : 0.019931s : 18.34% jit_opt_a.add_forward_monad_depend : 0.000031s : 0.03% jit_opt_a.auto_monad_grad : 0.000011s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000091s : 0.08% jit_opt_a.cse : 0.000330s : 0.30% jit_opt_a.replace_applicator : 0.000120s : 0.11% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000810s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000033s : 0.03% loop_unroll : 0.000530s : 0.49% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000042s : 0.04% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000579s : 0.53% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000588 104 0.33% : 0.000002s : 1: substitution.elim_not_effective 0.22% : 0.000001s : 1: substitution.fold_const_symbol 0.80% : 0.000005s : 1: substitution.graph_param_transform 63.07% : 0.000371s : 12: substitution.inline 3.33% : 0.000020s : 2: substitution.inline_without_move 2.00% : 0.000012s : 12: substitution.j_node_and_user_rematch 2.02% : 0.000012s : 7: substitution.minmaximum_grad 1.31% : 0.000008s : 5: substitution.partial_eliminate 2.00% : 0.000012s : 12: substitution.remove_not_recompute_node 5.69% : 0.000033s : 10: substitution.replace_applicator 1.18% : 0.000007s : 10: substitution.replace_old_param 1.32% : 0.000008s : 1: substitution.reshape_eliminate 0.71% : 0.000004s : 1: substitution.set_cell_output_no_recompute 1.19% : 0.000007s : 1: substitution.tile_eliminate 4.10% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.77% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.97% : 0.000047s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.079744 2 96.78% : 0.077175s : 1: type_inference.infer 3.22% : 0.002569s : 1: type_inference.specialize ------[replace.] 0.000178 19 64.38% : 0.000114s : 12: replace.inline 35.62% : 0.000063s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000388 19 93.74% : 0.000364s : 12: match.inline 6.26% : 0.000024s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000389 2654 1.50% : 0.000006s : 46: predicate.accumulaten_eliminater 0.48% : 0.000002s : 1: predicate.ad_related_special_op_eliminate 1.52% : 0.000006s : 46: predicate.addn_check_dump 1.70% : 0.000007s : 46: predicate.addn_zero_filter 1.92% : 0.000007s : 46: predicate.arithmetic_simplify 1.69% : 0.000007s : 46: predicate.cast_eliminate 0.13% : 0.000001s : 1: predicate.check_bprop_eliminate 1.43% : 0.000006s : 46: predicate.compare_switch_simplify 1.49% : 0.000006s : 46: predicate.depend_value_elim 1.43% : 0.000006s : 46: predicate.dict_get_item_const_eliminator 1.50% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.57% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.54% : 0.000002s : 1: predicate.dumpgradient_eliminate 0.11% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.45% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.43% : 0.000006s : 46: predicate.environ_get_depend_swap 1.51% : 0.000006s : 46: predicate.environ_get_eliminate 1.42% : 0.000006s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.81% : 0.000003s : 19: predicate.get_grad_eliminate 0.10% : 0.000000s : 1: predicate.graph_param_transform 4.20% : 0.000016s : 67: predicate.inline 1.94% : 0.000008s : 47: predicate.inline_without_move 0.38% : 0.000001s : 19: predicate.j_node_and_user_rematch 1.21% : 0.000005s : 19: predicate.less_batch_normalization 1.78% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.90% : 0.000007s : 54: predicate.load_eliminater 0.82% : 0.000003s : 1: predicate.loop_unroll_after_grad 3.31% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.81% : 0.000007s : 47: predicate.make_slice_get_slice_eliminator 1.43% : 0.000006s : 46: predicate.merge_addn 1.48% : 0.000006s : 46: predicate.minmaximum_grad 0.66% : 0.000003s : 1: predicate.mutable_eliminate 0.06% : 0.000000s : 1: predicate.opt_reshape 2.33% : 0.000009s : 54: predicate.partial_eliminate 1.51% : 0.000006s : 46: predicate.print_const_string_wrapper 1.94% : 0.000008s : 46: predicate.reduce_eliminate 1.74% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000002s : 19: predicate.remove_not_recompute_node 2.97% : 0.000012s : 100: predicate.replace_applicator 1.35% : 0.000005s : 47: predicate.replace_old_param 0.06% : 0.000000s : 1: predicate.reset_defer_inline 1.57% : 0.000006s : 46: predicate.reshape_eliminate 1.50% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.25% : 0.000001s : 1: predicate.row_tensor_eliminate 1.46% : 0.000006s : 46: predicate.same_eliminate 0.52% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 19: predicate.specialize_transform 1.72% : 0.000007s : 46: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.80% : 0.000011s : 65: predicate.switch_defer_inline 2.46% : 0.000010s : 65: predicate.switch_layer_defer_inline 6.51% : 0.000025s : 161: predicate.switch_simplify 1.60% : 0.000006s : 46: predicate.tile_eliminate 1.46% : 0.000006s : 46: predicate.transpose_eliminate 1.81% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000006s : 46: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000013s : 55: predicate.tuple_list_get_item_eliminator 1.79% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.74% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.82% : 0.000011s : 73: predicate.updatestate_useless_node_eliminater 1.81% : 0.000007s : 46: predicate.value_based_eliminate 0.07% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.12% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005592 62 83.13% : 0.004649s : 46: func_graph_cloner_run.FuncGraphClonerGraph 16.87% : 0.000943s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136740 87 0.03% : 0.000045s : 1: add_recomputation 0.09% : 0.000126s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000303s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.22% : 0.000302s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 22.22% : 0.030388s : 1: jit_opt_a 0.11% : 0.000153s : 1: jit_opt_after_cconv 0.03% : 0.000046s : 1: jit_opt_b 0.40% : 0.000543s : 1: loop_unroll 0.60% : 0.000821s : 1: mutable_eliminate 2.17% : 0.002962s : 39: opt.transform.jit_opt_a 0.02% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000053s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000592s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000041s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 12.76% : 0.017442s : 2: renormalize.infer 1.80% : 0.002464s : 2: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000125s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 58.44% : 0.079911s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.291.565 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f4c0> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.292.377 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.189817, [30] [bootstrap]: 0.00039877 [type_inference]: 0.131893 [event_method]: 2.11e-05 [auto_monad]: 7.301e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00029743 [rewriter_before_opt_a]: 8.778e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.0440517, [2] [Cycle 1]: 0.00679642, [27] [switch_simplify]: 6.059e-05 [loop_unroll]: 3.006e-05 [a_1]: 0.00059251 [with_stream_mark]: 1.835e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 3.53999e-06 [updatestate_assign_eliminate]: 4.43001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 6.28998e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 1.031e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.96e-06 [renormalize]: 0.00564001 [add_forward_monad_depend]: 4.096e-05 [auto_monad_grad]: 3.52002e-06 [auto_monad_eliminator]: 2.65e-05 [cse]: 3.778e-05 [replace_applicator]: 2.63e-05 [Cycle 2]: 0.00041298, [27] [switch_simplify]: 7.63999e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00013283 [with_stream_mark]: 1.721e-05 [recompute_prepare]: 7.56999e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 4.43001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.931e-05 [j_node_and_user_rematch]: 9.71998e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 1.072e-05 [inline_without_move]: 6.86999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.368e-05 [replace_applicator]: 6.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.809e-05 [rewriter_after_opt_a]: 4.346e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00081999 [jit_opt_b]: 6.384e-05, [1] [Cycle 1]: 5.525e-05, [2] [frontend_op_eliminate]: 2.179e-05 [inline_after_opt_a]: 1.98e-05 [cconv]: 3.656e-05 [loop_unroll]: 0.00048772 [jit_opt_after_cconv]: 0.00017668, [1] [Cycle 1]: 0.00016969, [11] [c_1]: 2.612e-05 [parameter_eliminate]: 5.06002e-06 [updatestate_depend_eliminate]: 7.90998e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 3.53999e-06 [cse]: 3.466e-05 [call_graph_tuple_transform]: 2.283e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 1.01002e-06 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 1.097e-05 [add_recomputation]: 5.287e-05 [cse_after_recomputation]: 0.00604078, [1] [Cycle 1]: 0.00503476, [1] [cse]: 0.00499231 [auto_monad_reorder]: 5.452e-05 [get_jit_bprop_graph]: 6.75998e-06 [rewriter_after_jit_bprop_graph]: 6.213e-05 [opt_after_jit_grad]: 0.00350556 [symbol_engine_optimizer]: 0.00014538, [1] [Cycle 1]: 0.00011662, [6] [build]: 8.60999e-06 [elim_shapecalc]: 1.125e-05 [elim_not_effective]: 4.34e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 1.04e-05 [renormalize]: 9.10019e-07 [validate]: 0.00011483 Sums bootstrap : 0.000399s : 0.27% type_inference : 0.131893s : 87.85% event_method : 0.000021s : 0.01% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000297s : 0.20% rewriter_before_opt_a : 0.000088s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000725s : 0.48% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005640s : 3.76% jit_opt_a.add_forward_monad_depend : 0.000043s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000820s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000037s : 0.02% loop_unroll : 0.000488s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.004992s : 3.33% auto_monad_reorder : 0.000055s : 0.04% get_jit_bprop_graph : 0.000007s : 0.00% rewriter_after_jit_bprop_graph : 0.000062s : 0.04% opt_after_jit_grad : 0.003506s : 2.33% symbol_engine_optimizer.build : 0.000009s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000043s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000115s : 0.08% Time group info: ------[substitution.] 0.000220 24 1.71% : 0.000004s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 4: substitution.graph_param_transform 81.13% : 0.000179s : 4: substitution.inline 2.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000006s : 4: substitution.remove_not_recompute_node 3.00% : 0.000007s : 2: substitution.replace_old_param 6.14% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131800 2 98.37% : 0.129649s : 1: type_inference.infer 1.63% : 0.002151s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.50% : 0.000052s : 4: replace.inline 32.50% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 93.48% : 0.000176s : 4: match.inline 6.52% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 2.44% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.46% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.81% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.13% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.57% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 2.15% : 0.000003s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.42% : 0.000002s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.08% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.82% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.28% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.021844 34 95.50% : 0.020861s : 27: func_graph_cloner_run.FuncGraphClonerGraph 0.14% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 4.35% : 0.000951s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.195867 72 0.03% : 0.000056s : 1: add_recomputation 0.04% : 0.000076s : 1: auto_monad 0.03% : 0.000068s : 1: auto_monad_reorder 0.21% : 0.000415s : 1: bootstrap 0.02% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 3.32% : 0.006496s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000010s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 22.49% : 0.044056s : 1: jit_opt_a 0.09% : 0.000179s : 1: jit_opt_after_cconv 0.03% : 0.000067s : 1: jit_opt_b 0.25% : 0.000497s : 1: loop_unroll 0.43% : 0.000839s : 1: mutable_eliminate 0.50% : 0.000982s : 26: opt.transform.jit_opt_a 0.03% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000048s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000068s : 4: opt.transform.symbol_engine_opt 1.80% : 0.003532s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000303s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.30% : 0.004500s : 1: renormalize.infer 0.57% : 0.001126s : 1: renormalize.specialize 0.03% : 0.000065s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.05% : 0.000093s : 1: rewriter_before_opt_a 0.08% : 0.000149s : 1: symbol_engine_optimizer 67.35% : 0.131912s : 1: type_inference TotalTime = 0.106218, [30] [bootstrap]: 0.00028427 [type_inference]: 0.0723191 [event_method]: 0.00039128 [auto_monad]: 0.00011464 [graph_reusing]: 7.90998e-06 [pre_auto_parallel]: 4.50001e-06 [py_interpret_to_execute]: 3.969e-05 [rewriter_before_opt_a]: 0.000123 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.0305152, [3] [Cycle 1]: 0.0224486, [27] [switch_simplify]: 9.516e-05 [loop_unroll]: 4.474e-05 [a_1]: 0.00103417 [with_stream_mark]: 4.636e-05 [recompute_prepare]: 3.032e-05 [updatestate_depend_eliminate]: 1.181e-05 [updatestate_assign_eliminate]: 7.63001e-06 [updatestate_loads_eliminate]: 7.16001e-06 [parameter_eliminate]: 3.26001e-06 [specialize_transform]: 1.64e-05 [updatestate_useless_node_eliminater]: 1.445e-05 [accelerated_algorithm]: 1.585e-05 [meta_shard_fg_expand]: 5.99e-06 [get_grad_eliminate_]: 1.686e-05 [merge_forward]: 1.087e-05 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.333e-05 [j_node_and_user_rematch]: 2.824e-05 [meta_fg_expand]: 0.00274632 [replace_old_param]: 0.00010588 [inline_without_move]: 8.332e-05 [renormalize]: 0.0172701 [add_forward_monad_depend]: 1.733e-05 [auto_monad_grad]: 6.89001e-06 [auto_monad_eliminator]: 6.516e-05 [cse]: 0.00026294 [replace_applicator]: 9.513e-05 [Cycle 2]: 0.00345799, [27] [switch_simplify]: 4.345e-05 [loop_unroll]: 4.11e-05 [a_1]: 0.00123251 [with_stream_mark]: 2.323e-05 [recompute_prepare]: 9.99999e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 7.878e-05 [replace_old_param]: 7.59002e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00168961 [add_forward_monad_depend]: 8.58001e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.303e-05 [cse]: 2.718e-05 [replace_applicator]: 1.65e-05 [Cycle 3]: 0.00026397, [27] [switch_simplify]: 4.72e-06 [loop_unroll]: 3.71999e-06 [a_1]: 4.117e-05 [with_stream_mark]: 1.195e-05 [recompute_prepare]: 3.33e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 2.02999e-06 [updatestate_loads_eliminate]: 1.79998e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 3.55e-06 [updatestate_useless_node_eliminater]: 3.38e-06 [accelerated_algorithm]: 3.48e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 3.45e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 2.90002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.272e-05 [j_node_and_user_rematch]: 6.27001e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 3.28e-06 [inline_without_move]: 2.99001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 3.46999e-06 [cse]: 8.09997e-06 [replace_applicator]: 4.19002e-06 [py_interpret_to_execute_after_opt_a]: 1.308e-05 [rewriter_after_opt_a]: 3.514e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 4.57e-06 [mutable_eliminate]: 0.00077549 [jit_opt_b]: 4.443e-05, [1] [Cycle 1]: 3.59e-05, [2] [frontend_op_eliminate]: 1.039e-05 [inline_after_opt_a]: 1.239e-05 [cconv]: 2.916e-05 [loop_unroll]: 0.00045626 [jit_opt_after_cconv]: 0.00014098, [1] [Cycle 1]: 0.00013357, [11] [c_1]: 1.318e-05 [parameter_eliminate]: 3.39001e-06 [updatestate_depend_eliminate]: 7.13998e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 2.382e-05 [call_graph_tuple_transform]: 1.654e-05 [tuple_list_get_item_eliminator]: 3.66999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 9.89996e-07 [switch_simplify]: 3.46001e-06 [remove_dup_value]: 1.385e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 4.70999e-06 [add_recomputation]: 3.885e-05 [cse_after_recomputation]: 1.885e-05, [1] [Cycle 1]: 1.323e-05, [1] [cse]: 7.46999e-06 [auto_monad_reorder]: 1.427e-05 [get_jit_bprop_graph]: 2.08998e-06 [rewriter_after_jit_bprop_graph]: 6.68e-06 [opt_after_jit_grad]: 0.00048833 [symbol_engine_optimizer]: 6.749e-05, [1] [Cycle 1]: 6.171e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 5.64e-06 [elim_not_effective]: 1.07e-05 [opt_reshape]: 4.05e-06 [fold_const_symbol]: 6.16e-06 [renormalize]: 3.80009e-07 [validate]: 3.281e-05 Sums bootstrap : 0.000284s : 0.28% type_inference : 0.072319s : 71.72% event_method : 0.000391s : 0.39% auto_monad : 0.000115s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000005s : 0.00% py_interpret_to_execute : 0.000040s : 0.04% rewriter_before_opt_a : 0.000123s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000143s : 0.14% jit_opt_a.loop_unroll : 0.000090s : 0.09% jit_opt_a.a_1 : 0.002308s : 2.29% jit_opt_a.with_stream_mark : 0.000082s : 0.08% jit_opt_a.recompute_prepare : 0.000044s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000027s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.02% jit_opt_a.accelerated_algorithm : 0.000025s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000010s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000026s : 0.03% jit_opt_a.merge_forward : 0.000018s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000063s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.04% jit_opt_a.meta_fg_expand : 0.002827s : 2.80% jit_opt_a.replace_old_param : 0.000117s : 0.12% jit_opt_a.inline_without_move : 0.000092s : 0.09% jit_opt_a.renormalize : 0.018960s : 18.80% jit_opt_a.add_forward_monad_depend : 0.000027s : 0.03% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000082s : 0.08% jit_opt_a.cse : 0.000298s : 0.30% jit_opt_a.replace_applicator : 0.000116s : 0.11% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000775s : 0.77% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000012s : 0.01% cconv : 0.000029s : 0.03% loop_unroll : 0.000456s : 0.45% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000003s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000007s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000488s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000718 101 0.23% : 0.000002s : 1: substitution.elim_not_effective 0.13% : 0.000001s : 1: substitution.fold_const_symbol 0.70% : 0.000005s : 1: substitution.graph_param_transform 67.56% : 0.000485s : 12: substitution.inline 4.60% : 0.000033s : 2: substitution.inline_without_move 1.45% : 0.000010s : 11: substitution.j_node_and_user_rematch 1.76% : 0.000013s : 7: substitution.minmaximum_grad 1.09% : 0.000008s : 5: substitution.partial_eliminate 1.56% : 0.000011s : 11: substitution.remove_not_recompute_node 4.81% : 0.000035s : 10: substitution.replace_applicator 1.37% : 0.000010s : 10: substitution.replace_old_param 0.61% : 0.000004s : 1: substitution.set_cell_output_no_recompute 1.17% : 0.000008s : 1: substitution.tile_eliminate 3.71% : 0.000027s : 7: substitution.tuple_list_convert_item_index_to_positive 2.43% : 0.000017s : 7: substitution.tuple_list_get_item_depend_reorder 6.83% : 0.000049s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.072190 2 96.61% : 0.069745s : 1: type_inference.infer 3.39% : 0.002445s : 1: type_inference.specialize ------[replace.] 0.000182 19 64.70% : 0.000117s : 12: replace.inline 35.30% : 0.000064s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000502 19 95.10% : 0.000477s : 12: match.inline 4.90% : 0.000025s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2542 1.77% : 0.000007s : 44: predicate.accumulaten_eliminater 0.27% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.38% : 0.000005s : 44: predicate.addn_check_dump 1.63% : 0.000006s : 44: predicate.addn_zero_filter 2.01% : 0.000008s : 44: predicate.arithmetic_simplify 1.63% : 0.000006s : 44: predicate.cast_eliminate 0.07% : 0.000000s : 1: predicate.check_bprop_eliminate 1.40% : 0.000005s : 44: predicate.compare_switch_simplify 1.59% : 0.000006s : 44: predicate.depend_value_elim 1.60% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.54% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.45% : 0.000005s : 44: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.09% : 0.000000s : 1: predicate.elim_not_effective 0.08% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000005s : 44: predicate.environ_add_const_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_add_eliminate 1.37% : 0.000005s : 44: predicate.environ_get_depend_swap 1.50% : 0.000006s : 44: predicate.environ_get_eliminate 1.39% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.76% : 0.000003s : 17: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.64% : 0.000017s : 65: predicate.inline 2.27% : 0.000009s : 45: predicate.inline_without_move 0.35% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.00% : 0.000004s : 17: predicate.less_batch_normalization 1.92% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 2.04% : 0.000008s : 52: predicate.load_eliminater 0.32% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.36% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.75% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.43% : 0.000005s : 44: predicate.merge_addn 1.46% : 0.000005s : 44: predicate.minmaximum_grad 0.48% : 0.000002s : 1: predicate.mutable_eliminate 0.10% : 0.000000s : 1: predicate.opt_reshape 2.26% : 0.000009s : 52: predicate.partial_eliminate 1.48% : 0.000006s : 44: predicate.print_const_string_wrapper 2.05% : 0.000008s : 44: predicate.reduce_eliminate 1.73% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000002s : 17: predicate.remove_not_recompute_node 3.01% : 0.000011s : 96: predicate.replace_applicator 1.26% : 0.000005s : 45: predicate.replace_old_param 0.09% : 0.000000s : 1: predicate.reset_defer_inline 1.53% : 0.000006s : 44: predicate.reshape_eliminate 1.63% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.17% : 0.000001s : 1: predicate.row_tensor_eliminate 1.44% : 0.000005s : 44: predicate.same_eliminate 0.52% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.19% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 17: predicate.specialize_transform 1.64% : 0.000006s : 44: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000005s : 44: predicate.stack_unstack_eliminate 0.07% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.82% : 0.000011s : 63: predicate.switch_defer_inline 2.40% : 0.000009s : 63: predicate.switch_layer_defer_inline 6.81% : 0.000026s : 157: predicate.switch_simplify 1.66% : 0.000006s : 44: predicate.tile_eliminate 1.47% : 0.000006s : 44: predicate.transpose_eliminate 1.80% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000006s : 44: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000012s : 53: predicate.tuple_list_get_item_eliminator 1.94% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 2.00% : 0.000008s : 51: predicate.tuple_to_list_eliminator_ 1.77% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.66% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.83% : 0.000007s : 44: predicate.value_based_eliminate 0.06% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000000s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004808 50 80.89% : 0.003889s : 34: func_graph_cloner_run.FuncGraphClonerGraph 19.11% : 0.000919s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128231 87 0.03% : 0.000042s : 1: add_recomputation 0.10% : 0.000122s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000311s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.32% : 0.000405s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 23.80% : 0.030519s : 1: jit_opt_a 0.11% : 0.000143s : 1: jit_opt_after_cconv 0.04% : 0.000047s : 1: jit_opt_b 0.36% : 0.000466s : 1: loop_unroll 0.61% : 0.000785s : 1: mutable_eliminate 2.38% : 0.003054s : 39: opt.transform.jit_opt_a 0.03% : 0.000033s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000016s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000497s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000043s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 12.96% : 0.016619s : 2: renormalize.infer 1.80% : 0.002314s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.10% : 0.000127s : 1: rewriter_before_opt_a 0.05% : 0.000070s : 1: symbol_engine_optimizer 56.42% : 0.072350s : 1: type_inference TotalTime = 0.0404417, [30] [bootstrap]: 0.00033146 [type_inference]: 0.031639 [event_method]: 2.207e-05 [auto_monad]: 7.005e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 0.0001025 [rewriter_before_opt_a]: 8.341e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00591274, [2] [Cycle 1]: 0.00205271, [27] [switch_simplify]: 5.905e-05 [loop_unroll]: 3.012e-05 [a_1]: 0.00056535 [with_stream_mark]: 2.077e-05 [recompute_prepare]: 8.83001e-06 [updatestate_depend_eliminate]: 3.92998e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.82002e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 5.36998e-06 [renormalize]: 0.00102336 [add_forward_monad_depend]: 7.07002e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.606e-05 [cse]: 3.359e-05 [replace_applicator]: 1.603e-05 [Cycle 2]: 0.00032873, [27] [switch_simplify]: 5.91998e-06 [loop_unroll]: 5.19e-06 [a_1]: 8.857e-05 [with_stream_mark]: 1.211e-05 [recompute_prepare]: 4.99e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 5.04003e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 7.31999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.366e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.158e-05 [rewriter_after_opt_a]: 3.921e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00062023 [jit_opt_b]: 4.941e-05, [1] [Cycle 1]: 4.23e-05, [2] [frontend_op_eliminate]: 1.529e-05 [inline_after_opt_a]: 1.614e-05 [cconv]: 2.947e-05 [loop_unroll]: 0.00040877 [jit_opt_after_cconv]: 0.00015352, [1] [Cycle 1]: 0.00014684, [11] [c_1]: 2.14e-05 [parameter_eliminate]: 2.95002e-06 [updatestate_depend_eliminate]: 7.41999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.878e-05 [call_graph_tuple_transform]: 1.823e-05 [tuple_list_get_item_eliminator]: 5.71003e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.495e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 6.04001e-06 [add_recomputation]: 5.067e-05 [cse_after_recomputation]: 2.342e-05, [1] [Cycle 1]: 1.782e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.818e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.07999e-06 [opt_after_jit_grad]: 0.000492 [symbol_engine_optimizer]: 7.635e-05, [1] [Cycle 1]: 6.848e-05, [6] [build]: 4.40999e-06 [elim_shapecalc]: 8.31002e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 6.09987e-07 [validate]: 4.525e-05 Sums bootstrap : 0.000331s : 0.91% type_inference : 0.031639s : 87.20% event_method : 0.000022s : 0.06% auto_monad : 0.000070s : 0.19% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.28% rewriter_before_opt_a : 0.000083s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.18% jit_opt_a.loop_unroll : 0.000035s : 0.10% jit_opt_a.a_1 : 0.000654s : 1.80% jit_opt_a.with_stream_mark : 0.000033s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001023s : 2.82% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000047s : 0.13% jit_opt_a.replace_applicator : 0.000022s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000039s : 0.11% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000620s : 1.71% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000029s : 0.08% loop_unroll : 0.000409s : 1.13% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.14% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000492s : 1.36% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.12% Time group info: ------[substitution.] 0.000233 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000005s : 3: substitution.graph_param_transform 84.90% : 0.000198s : 4: substitution.inline 2.06% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 5.84% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031556 2 94.73% : 0.029892s : 1: type_inference.infer 5.27% : 0.001664s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.66% : 0.000052s : 4: replace.inline 30.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.04% : 0.000195s : 4: match.inline 5.96% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.27% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.87% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.44% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.23% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.10% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.06% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000908 13 45.76% : 0.000416s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.50% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.73% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042377 72 0.13% : 0.000053s : 1: add_recomputation 0.17% : 0.000074s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.83% : 0.000353s : 1: bootstrap 0.08% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.96% : 0.005916s : 1: jit_opt_a 0.37% : 0.000156s : 1: jit_opt_after_cconv 0.12% : 0.000052s : 1: jit_opt_b 0.98% : 0.000417s : 1: loop_unroll 1.49% : 0.000631s : 1: mutable_eliminate 2.07% : 0.000877s : 26: opt.transform.jit_opt_a 0.11% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.18% : 0.000502s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000106s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.37% : 0.000581s : 1: renormalize.infer 1.02% : 0.000434s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.21% : 0.000088s : 1: rewriter_before_opt_a 0.19% : 0.000080s : 1: symbol_engine_optimizer 74.71% : 0.031659s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.407.397 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda006f820> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.408.169 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.151855, [30] [bootstrap]: 0.00034226 [type_inference]: 0.110053 [event_method]: 2.568e-05 [auto_monad]: 7.312e-05 [graph_reusing]: 6.36998e-06 [pre_auto_parallel]: 3.08998e-06 [py_interpret_to_execute]: 0.00029339 [rewriter_before_opt_a]: 0.00010896 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.0383474, [2] [Cycle 1]: 0.0341214, [27] [switch_simplify]: 7.616e-05 [loop_unroll]: 3.778e-05 [a_1]: 0.00083972 [with_stream_mark]: 2.644e-05 [recompute_prepare]: 1.215e-05 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.65e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 9.05001e-06 [updatestate_useless_node_eliminater]: 7.09001e-06 [accelerated_algorithm]: 7.99002e-06 [meta_shard_fg_expand]: 2.92002e-06 [get_grad_eliminate_]: 7.11999e-06 [merge_forward]: 4.66002e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.864e-05 [j_node_and_user_rematch]: 1.206e-05 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 1.262e-05 [inline_without_move]: 8.95001e-06 [renormalize]: 0.0326374 [add_forward_monad_depend]: 1.323e-05 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 2.604e-05 [cse]: 4.356e-05 [replace_applicator]: 2.976e-05 [Cycle 2]: 0.00048961, [27] [switch_simplify]: 8.86997e-06 [loop_unroll]: 7.23999e-06 [a_1]: 0.00013906 [with_stream_mark]: 1.592e-05 [recompute_prepare]: 7.25998e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 6.453e-05 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 4.61002e-06 [cell_reuse_recompute_pass]: 3.88001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.175e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 3.5e-06 [replace_old_param]: 1.172e-05 [inline_without_move]: 6.38e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 7.45e-06 [cse]: 1.622e-05 [replace_applicator]: 6.41e-06 [py_interpret_to_execute_after_opt_a]: 1.99e-05 [rewriter_after_opt_a]: 4.418e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00085285 [jit_opt_b]: 6.179e-05, [1] [Cycle 1]: 5.335e-05, [2] [frontend_op_eliminate]: 2.065e-05 [inline_after_opt_a]: 2.03e-05 [cconv]: 3.079e-05 [loop_unroll]: 0.0004487 [jit_opt_after_cconv]: 0.00017512, [1] [Cycle 1]: 0.00016809, [11] [c_1]: 2.741e-05 [parameter_eliminate]: 4.13001e-06 [updatestate_depend_eliminate]: 8.22e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 2.923e-05 [call_graph_tuple_transform]: 2.325e-05 [tuple_list_get_item_eliminator]: 7.54002e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.97002e-06 [remove_dup_value]: 2.003e-05 [partial_unused_args_eliminate]: 2.61999e-06 [environ_conv]: 9.82001e-06 [add_recomputation]: 5.689e-05 [cse_after_recomputation]: 2.992e-05, [1] [Cycle 1]: 2.366e-05, [1] [cse]: 1.637e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 2.94999e-06 [rewriter_after_jit_bprop_graph]: 6.39001e-06 [opt_after_jit_grad]: 0.00047736 [symbol_engine_optimizer]: 8.189e-05, [1] [Cycle 1]: 7.554e-05, [6] [build]: 4.73001e-06 [elim_shapecalc]: 9.59e-06 [elim_not_effective]: 1.596e-05 [opt_reshape]: 7.02002e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 3.80009e-07 [validate]: 5.61e-05 Sums bootstrap : 0.000342s : 0.23% type_inference : 0.110053s : 74.66% event_method : 0.000026s : 0.02% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000293s : 0.20% rewriter_before_opt_a : 0.000109s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000085s : 0.06% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.000979s : 0.66% jit_opt_a.with_stream_mark : 0.000042s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000072s : 0.05% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.032637s : 22.14% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000060s : 0.04% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000853s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000449s : 0.30% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000477s : 0.32% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.04% Time group info: ------[substitution.] 0.000327 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 2.03% : 0.000007s : 4: substitution.graph_param_transform 86.97% : 0.000284s : 5: substitution.inline 1.51% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000007s : 4: substitution.remove_not_recompute_node 2.27% : 0.000007s : 2: substitution.replace_old_param 4.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109958 2 97.92% : 0.107665s : 1: type_inference.infer 2.08% : 0.002292s : 1: type_inference.specialize ------[replace.] 0.000120 7 68.07% : 0.000082s : 5: replace.inline 31.93% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000293 7 95.88% : 0.000281s : 5: match.inline 4.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000223 888 1.03% : 0.000002s : 13: predicate.accumulaten_eliminater 0.65% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.78% : 0.000002s : 13: predicate.addn_check_dump 1.11% : 0.000002s : 13: predicate.addn_zero_filter 1.52% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000003s : 13: predicate.cast_eliminate 0.29% : 0.000001s : 4: predicate.check_bprop_eliminate 0.85% : 0.000002s : 13: predicate.compare_switch_simplify 0.88% : 0.000002s : 13: predicate.depend_value_elim 0.80% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.01% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.47% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.24% : 0.000001s : 4: predicate.elim_not_effective 0.34% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.77% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.83% : 0.000002s : 13: predicate.environ_get_depend_swap 0.84% : 0.000002s : 13: predicate.environ_get_eliminate 0.78% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 4: predicate.fold_const_symbol 0.69% : 0.000002s : 8: predicate.get_grad_eliminate 0.17% : 0.000000s : 4: predicate.graph_param_transform 4.54% : 0.000010s : 28: predicate.inline 0.71% : 0.000002s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000003s : 8: predicate.less_batch_normalization 1.24% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.30% : 0.000003s : 19: predicate.load_eliminater 0.68% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.67% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.38% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.80% : 0.000002s : 13: predicate.merge_addn 0.85% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000003s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 1.67% : 0.000004s : 19: predicate.partial_eliminate 0.91% : 0.000002s : 13: predicate.print_const_string_wrapper 1.42% : 0.000003s : 13: predicate.reduce_eliminate 1.29% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 8: predicate.remove_not_recompute_node 1.46% : 0.000003s : 23: predicate.replace_applicator 0.48% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 0.95% : 0.000002s : 13: predicate.reshape_eliminate 0.98% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 4: predicate.row_tensor_eliminate 0.87% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.65% : 0.000001s : 8: predicate.special_op_eliminate 0.66% : 0.000001s : 8: predicate.specialize_transform 1.04% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.89% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.28% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.85% : 0.000004s : 20: predicate.switch_defer_inline 1.58% : 0.000004s : 20: predicate.switch_layer_defer_inline 5.61% : 0.000012s : 65: predicate.switch_simplify 1.04% : 0.000002s : 13: predicate.tile_eliminate 0.94% : 0.000002s : 13: predicate.transpose_eliminate 1.01% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.99% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.87% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.03% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.17% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.18% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 27.88% : 0.000062s : 27: predicate.updatestate_useless_node_eliminater 1.39% : 0.000003s : 13: predicate.value_based_eliminate 0.24% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002675 25 60.35% : 0.001614s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.56% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.08% : 0.000965s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.185901 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000077s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.19% : 0.000356s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 20.63% : 0.038352s : 1: jit_opt_a 0.10% : 0.000178s : 1: jit_opt_after_cconv 0.03% : 0.000065s : 1: jit_opt_b 0.25% : 0.000457s : 1: loop_unroll 0.46% : 0.000864s : 1: mutable_eliminate 0.72% : 0.001346s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000486s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000300s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 16.94% : 0.031493s : 1: renormalize.infer 0.61% : 0.001126s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.06% : 0.000114s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 59.21% : 0.110072s : 1: type_inference TotalTime = 0.0947992, [30] [bootstrap]: 0.00025146 [type_inference]: 0.0665681 [event_method]: 0.00027811 [auto_monad]: 0.00011388 [graph_reusing]: 7.84002e-06 [pre_auto_parallel]: 3.21001e-06 [py_interpret_to_execute]: 3.617e-05 [rewriter_before_opt_a]: 0.00012609 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.0250942, [3] [Cycle 1]: 0.01733, [27] [switch_simplify]: 7.713e-05 [loop_unroll]: 4.402e-05 [a_1]: 0.00097561 [with_stream_mark]: 3.521e-05 [recompute_prepare]: 2.213e-05 [updatestate_depend_eliminate]: 9.86e-06 [updatestate_assign_eliminate]: 7.38999e-06 [updatestate_loads_eliminate]: 6.63e-06 [parameter_eliminate]: 3.01001e-06 [specialize_transform]: 1.633e-05 [updatestate_useless_node_eliminater]: 1.413e-05 [accelerated_algorithm]: 1.437e-05 [meta_shard_fg_expand]: 3.55e-06 [get_grad_eliminate_]: 1.455e-05 [merge_forward]: 9.07999e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.895e-05 [j_node_and_user_rematch]: 2.517e-05 [meta_fg_expand]: 0.00188525 [replace_old_param]: 7.126e-05 [inline_without_move]: 6.136e-05 [renormalize]: 0.0132928 [add_forward_monad_depend]: 1.201e-05 [auto_monad_grad]: 6.83e-06 [auto_monad_eliminator]: 6.156e-05 [cse]: 0.00025972 [replace_applicator]: 9.363e-05 [Cycle 2]: 0.0037363, [27] [switch_simplify]: 4.352e-05 [loop_unroll]: 4.232e-05 [a_1]: 0.00122465 [with_stream_mark]: 1.86e-05 [recompute_prepare]: 1.009e-05 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 3.82002e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.83999e-06 [updatestate_useless_node_eliminater]: 7.3e-06 [accelerated_algorithm]: 7.31001e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.861e-05 [j_node_and_user_rematch]: 1.199e-05 [meta_fg_expand]: 7.126e-05 [replace_old_param]: 7.6e-06 [inline_without_move]: 7.21001e-06 [renormalize]: 0.00197982 [add_forward_monad_depend]: 8.97e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.294e-05 [cse]: 2.533e-05 [replace_applicator]: 1.62e-05 [Cycle 3]: 0.00025914, [27] [switch_simplify]: 4.25e-06 [loop_unroll]: 3.63999e-06 [a_1]: 4.287e-05 [with_stream_mark]: 1.25e-05 [recompute_prepare]: 3.68e-06 [updatestate_depend_eliminate]: 2.22001e-06 [updatestate_assign_eliminate]: 1.94e-06 [updatestate_loads_eliminate]: 1.60999e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 3.53999e-06 [updatestate_useless_node_eliminater]: 3.28998e-06 [accelerated_algorithm]: 3.52002e-06 [meta_shard_fg_expand]: 1.76003e-06 [get_grad_eliminate_]: 3.41001e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 6.59001e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 3.08998e-06 [inline_without_move]: 2.98998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 3.67998e-06 [cse]: 7.85e-06 [replace_applicator]: 3.30998e-06 [py_interpret_to_execute_after_opt_a]: 1.073e-05 [rewriter_after_opt_a]: 6.561e-05 [convert_after_rewriter]: 6.10002e-06 [order_py_execute_after_rewriter]: 4.15999e-06 [mutable_eliminate]: 0.00075086 [jit_opt_b]: 4.106e-05, [1] [Cycle 1]: 3.258e-05, [2] [frontend_op_eliminate]: 9.89001e-06 [inline_after_opt_a]: 1.098e-05 [cconv]: 2.693e-05 [loop_unroll]: 0.00042111 [jit_opt_after_cconv]: 0.0001278, [1] [Cycle 1]: 0.00012114, [11] [c_1]: 1.223e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 1.99e-06 [updatestate_loads_eliminate]: 1.64e-06 [cse]: 1.785e-05 [call_graph_tuple_transform]: 1.534e-05 [tuple_list_get_item_eliminator]: 3.9e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 3.75e-06 [remove_dup_value]: 1.498e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 4.88001e-06 [add_recomputation]: 3.8e-05 [cse_after_recomputation]: 1.937e-05, [1] [Cycle 1]: 1.402e-05, [1] [cse]: 7.94002e-06 [auto_monad_reorder]: 1.348e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 5.59e-06 [opt_after_jit_grad]: 0.00045407 [symbol_engine_optimizer]: 6.645e-05, [1] [Cycle 1]: 6.056e-05, [6] [build]: 4.56002e-06 [elim_shapecalc]: 5.71e-06 [elim_not_effective]: 9.76998e-06 [opt_reshape]: 4e-06 [fold_const_symbol]: 6.26998e-06 [renormalize]: 3.59985e-07 [validate]: 3.238e-05 Sums bootstrap : 0.000251s : 0.28% type_inference : 0.066568s : 73.87% event_method : 0.000278s : 0.31% auto_monad : 0.000114s : 0.13% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000036s : 0.04% rewriter_before_opt_a : 0.000126s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000125s : 0.14% jit_opt_a.loop_unroll : 0.000090s : 0.10% jit_opt_a.a_1 : 0.002243s : 2.49% jit_opt_a.with_stream_mark : 0.000066s : 0.07% jit_opt_a.recompute_prepare : 0.000036s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000006s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000025s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000025s : 0.03% jit_opt_a.merge_forward : 0.000016s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000060s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000044s : 0.05% jit_opt_a.meta_fg_expand : 0.001958s : 2.17% jit_opt_a.replace_old_param : 0.000082s : 0.09% jit_opt_a.inline_without_move : 0.000072s : 0.08% jit_opt_a.renormalize : 0.015273s : 16.95% jit_opt_a.add_forward_monad_depend : 0.000022s : 0.02% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000078s : 0.09% jit_opt_a.cse : 0.000293s : 0.33% jit_opt_a.replace_applicator : 0.000113s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000066s : 0.07% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000751s : 0.83% jit_opt_b.frontend_op_eliminate : 0.000010s : 0.01% jit_opt_b.inline_after_opt_a : 0.000011s : 0.01% cconv : 0.000027s : 0.03% loop_unroll : 0.000421s : 0.47% jit_opt_after_cconv.c_1 : 0.000012s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000038s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000454s : 0.50% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000004s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.04% Time group info: ------[substitution.] 0.000557 104 0.27% : 0.000001s : 1: substitution.elim_not_effective 0.22% : 0.000001s : 1: substitution.fold_const_symbol 0.76% : 0.000004s : 1: substitution.graph_param_transform 61.02% : 0.000340s : 12: substitution.inline 3.27% : 0.000018s : 2: substitution.inline_without_move 1.71% : 0.000010s : 12: substitution.j_node_and_user_rematch 2.16% : 0.000012s : 7: substitution.minmaximum_grad 1.39% : 0.000008s : 5: substitution.partial_eliminate 2.00% : 0.000011s : 12: substitution.remove_not_recompute_node 5.78% : 0.000032s : 10: substitution.replace_applicator 1.14% : 0.000006s : 10: substitution.replace_old_param 3.62% : 0.000020s : 1: substitution.reshape_eliminate 0.43% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.30% : 0.000007s : 1: substitution.tile_eliminate 4.19% : 0.000023s : 7: substitution.tuple_list_convert_item_index_to_positive 2.84% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.89% : 0.000044s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066443 2 96.37% : 0.064028s : 1: type_inference.infer 3.63% : 0.002415s : 1: type_inference.specialize ------[replace.] 0.000210 19 71.42% : 0.000150s : 12: replace.inline 28.58% : 0.000060s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000356 19 93.69% : 0.000333s : 12: match.inline 6.31% : 0.000022s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000376 2654 1.54% : 0.000006s : 46: predicate.accumulaten_eliminater 0.36% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.54% : 0.000006s : 46: predicate.addn_check_dump 1.62% : 0.000006s : 46: predicate.addn_zero_filter 1.94% : 0.000007s : 46: predicate.arithmetic_simplify 1.59% : 0.000006s : 46: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.46% : 0.000005s : 46: predicate.compare_switch_simplify 1.52% : 0.000006s : 46: predicate.depend_value_elim 1.44% : 0.000005s : 46: predicate.dict_get_item_const_eliminator 1.57% : 0.000006s : 46: predicate.dict_get_item_eliminator 1.48% : 0.000006s : 46: predicate.dict_set_item_eliminator 0.26% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.13% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.61% : 0.000006s : 46: predicate.environ_add_const_eliminate 1.47% : 0.000006s : 46: predicate.environ_get_add_eliminate 1.48% : 0.000006s : 46: predicate.environ_get_depend_swap 1.49% : 0.000006s : 46: predicate.environ_get_eliminate 1.43% : 0.000005s : 46: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 1: predicate.fold_const_symbol 0.92% : 0.000003s : 19: predicate.get_grad_eliminate 0.04% : 0.000000s : 1: predicate.graph_param_transform 4.44% : 0.000017s : 67: predicate.inline 2.06% : 0.000008s : 47: predicate.inline_without_move 0.41% : 0.000002s : 19: predicate.j_node_and_user_rematch 1.01% : 0.000004s : 19: predicate.less_batch_normalization 1.97% : 0.000007s : 53: predicate.list_to_tuple_eliminator_ 1.84% : 0.000007s : 54: predicate.load_eliminater 0.31% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.41% : 0.000013s : 95: predicate.loop_unroll_before_grad 1.69% : 0.000006s : 47: predicate.make_slice_get_slice_eliminator 1.40% : 0.000005s : 46: predicate.merge_addn 1.51% : 0.000006s : 46: predicate.minmaximum_grad 0.35% : 0.000001s : 1: predicate.mutable_eliminate 0.12% : 0.000000s : 1: predicate.opt_reshape 2.37% : 0.000009s : 54: predicate.partial_eliminate 1.58% : 0.000006s : 46: predicate.print_const_string_wrapper 2.08% : 0.000008s : 46: predicate.reduce_eliminate 1.86% : 0.000007s : 53: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000002s : 19: predicate.remove_not_recompute_node 2.96% : 0.000011s : 100: predicate.replace_applicator 1.29% : 0.000005s : 47: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.61% : 0.000006s : 46: predicate.reshape_eliminate 1.50% : 0.000006s : 46: predicate.row_tensor_add_zeros_like 0.15% : 0.000001s : 1: predicate.row_tensor_eliminate 1.61% : 0.000006s : 46: predicate.same_eliminate 0.54% : 0.000002s : 19: predicate.set_cell_output_no_recompute 0.14% : 0.000001s : 2: predicate.special_op_eliminate 0.83% : 0.000003s : 19: predicate.specialize_transform 1.71% : 0.000006s : 46: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000006s : 46: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.69% : 0.000010s : 65: predicate.switch_defer_inline 2.51% : 0.000009s : 65: predicate.switch_layer_defer_inline 6.50% : 0.000024s : 161: predicate.switch_simplify 1.60% : 0.000006s : 46: predicate.tile_eliminate 1.59% : 0.000006s : 46: predicate.transpose_eliminate 1.92% : 0.000007s : 46: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000006s : 46: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000012s : 55: predicate.tuple_list_get_item_eliminator 1.88% : 0.000007s : 46: predicate.tuple_list_set_item_eliminator 1.80% : 0.000007s : 53: predicate.tuple_to_list_eliminator_ 1.75% : 0.000007s : 54: predicate.updatestate_pure_node_eliminater 2.72% : 0.000010s : 73: predicate.updatestate_useless_node_eliminater 1.93% : 0.000007s : 46: predicate.value_based_eliminate 0.08% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.13% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004176 50 78.50% : 0.003278s : 34: func_graph_cloner_run.FuncGraphClonerGraph 21.50% : 0.000898s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112984 87 0.04% : 0.000040s : 1: add_recomputation 0.11% : 0.000122s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000273s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.25% : 0.000288s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 22.21% : 0.025097s : 1: jit_opt_a 0.12% : 0.000130s : 1: jit_opt_after_cconv 0.04% : 0.000043s : 1: jit_opt_b 0.38% : 0.000430s : 1: loop_unroll 0.67% : 0.000761s : 1: mutable_eliminate 2.58% : 0.002916s : 39: opt.transform.jit_opt_a 0.03% : 0.000032s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000015s : 4: opt.transform.jit_opt_b 0.01% : 0.000009s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000011s : 1: opt.transform.mutable_eliminate 0.01% : 0.000016s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000023s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000039s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 11.51% : 0.013009s : 2: renormalize.infer 1.98% : 0.002241s : 2: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000070s : 1: rewriter_after_opt_a 0.11% : 0.000129s : 1: rewriter_before_opt_a 0.06% : 0.000069s : 1: symbol_engine_optimizer 58.95% : 0.066601s : 1: type_inference [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.515.196 [mindspore/graph/api.py:1147] The func .after_grad at 0xfffda007c790> should be wrapped by jit only once. [WARNING] ME(148002:281473331179312,ForkProcess-6):2026-01-29-17:45:45.515.944 [mindspore/graph/api.py:128] The function "after_grad" at the file "/home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/graph/api.py", line 1152 has been compiled again. Try to reuse the function object decorated by @jit to reduce the compile time. For more details, get instructions about `jit` at https://www.mindspore.cn/search?inputValue=jit. TotalTime = 0.0259671, [30] [bootstrap]: 0.00043863 [type_inference]: 0.0101094 [event_method]: 2.324e-05 [auto_monad]: 7.48e-05 [graph_reusing]: 7.1e-06 [pre_auto_parallel]: 3.09001e-06 [py_interpret_to_execute]: 5.502e-05 [rewriter_before_opt_a]: 8.679e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.0124572, [2] [Cycle 1]: 0.0025707, [27] [switch_simplify]: 8.108e-05 [loop_unroll]: 3.48e-05 [a_1]: 0.00082109 [with_stream_mark]: 2.856e-05 [recompute_prepare]: 9.61e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.69002e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 7.07002e-06 [meta_shard_fg_expand]: 2.94001e-06 [get_grad_eliminate_]: 6.01998e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.837e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.117e-05 [inline_without_move]: 5.89e-06 [renormalize]: 0.00119023 [add_forward_monad_depend]: 6.22001e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 3.004e-05 [cse]: 3.915e-05 [replace_applicator]: 1.495e-05 [Cycle 2]: 0.00034334, [27] [switch_simplify]: 6.06e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00010214 [with_stream_mark]: 1.245e-05 [recompute_prepare]: 5.29998e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.54998e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.204e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 7.78999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.323e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.467e-05 [rewriter_after_opt_a]: 4.122e-05 [convert_after_rewriter]: 6.69999e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00070714 [jit_opt_b]: 5.267e-05, [1] [Cycle 1]: 4.563e-05, [2] [frontend_op_eliminate]: 1.833e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 2.828e-05 [loop_unroll]: 0.00072117 [jit_opt_after_cconv]: 0.00018342, [1] [Cycle 1]: 0.00017695, [11] [c_1]: 2.519e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 8.13999e-06 [updatestate_assign_eliminate]: 1.965e-05 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 2.81e-05 [call_graph_tuple_transform]: 2.203e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 6.15002e-06 [remove_dup_value]: 1.779e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 7.08e-06 [add_recomputation]: 5.368e-05 [cse_after_recomputation]: 2.383e-05, [1] [Cycle 1]: 1.845e-05, [1] [cse]: 1.259e-05 [auto_monad_reorder]: 2.011e-05 [get_jit_bprop_graph]: 2.36998e-06 [rewriter_after_jit_bprop_graph]: 6.72002e-06 [opt_after_jit_grad]: 0.00049571 [symbol_engine_optimizer]: 7.788e-05, [1] [Cycle 1]: 7.199e-05, [6] [build]: 4.43001e-06 [elim_shapecalc]: 8.72998e-06 [elim_not_effective]: 1.443e-05 [opt_reshape]: 6.15002e-06 [fold_const_symbol]: 9.53997e-06 [renormalize]: 2.19996e-07 [validate]: 4.482e-05 Sums bootstrap : 0.000439s : 2.78% type_inference : 0.010109s : 64.08% event_method : 0.000023s : 0.15% auto_monad : 0.000075s : 0.47% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000055s : 0.35% rewriter_before_opt_a : 0.000087s : 0.55% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000087s : 0.55% jit_opt_a.loop_unroll : 0.000041s : 0.26% jit_opt_a.a_1 : 0.000923s : 5.85% jit_opt_a.with_stream_mark : 0.000041s : 0.26% jit_opt_a.recompute_prepare : 0.000015s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000013s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001190s : 7.54% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.23% jit_opt_a.cse : 0.000052s : 0.33% jit_opt_a.replace_applicator : 0.000020s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.09% rewriter_after_opt_a : 0.000041s : 0.26% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000707s : 4.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000028s : 0.18% loop_unroll : 0.000721s : 4.57% jit_opt_after_cconv.c_1 : 0.000025s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000020s : 0.12% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000054s : 0.34% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000020s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000496s : 3.14% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.28% Time group info: ------[substitution.] 0.000378 27 0.76% : 0.000003s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.66% : 0.000006s : 3: substitution.graph_param_transform 86.72% : 0.000327s : 5: substitution.inline 0.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.48% : 0.000013s : 3: substitution.reduce_eliminate 1.40% : 0.000005s : 4: substitution.remove_not_recompute_node 1.43% : 0.000005s : 2: substitution.replace_old_param 3.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010027 2 80.31% : 0.008053s : 1: type_inference.infer 19.69% : 0.001974s : 1: type_inference.specialize ------[replace.] 0.000117 7 68.30% : 0.000080s : 5: replace.inline 31.70% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000335 7 96.76% : 0.000325s : 5: match.inline 3.24% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 747 1.28% : 0.000002s : 11: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 11: predicate.addn_check_dump 1.39% : 0.000002s : 11: predicate.addn_zero_filter 2.99% : 0.000004s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 11: predicate.compare_switch_simplify 1.16% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 5.58% : 0.000008s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 16: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000002s : 11: predicate.print_const_string_wrapper 2.33% : 0.000003s : 11: predicate.reduce_eliminate 1.55% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.49% : 0.000002s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.58% : 0.000010s : 59: predicate.switch_simplify 1.60% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.63% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001839 16 27.96% : 0.000514s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.75% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 66.29% : 0.001219s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028384 72 0.20% : 0.000056s : 1: add_recomputation 0.28% : 0.000078s : 1: auto_monad 0.08% : 0.000023s : 1: auto_monad_reorder 1.64% : 0.000467s : 1: bootstrap 0.11% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 43.91% : 0.012463s : 1: jit_opt_a 0.66% : 0.000187s : 1: jit_opt_after_cconv 0.19% : 0.000055s : 1: jit_opt_b 2.57% : 0.000729s : 1: loop_unroll 2.52% : 0.000715s : 1: mutable_eliminate 4.15% : 0.001178s : 26: opt.transform.jit_opt_a 0.19% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.77% : 0.000503s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000058s : 1: py_interpret_to_execute 0.06% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 2.52% : 0.000715s : 1: renormalize.infer 1.64% : 0.000465s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000044s : 1: rewriter_after_opt_a 0.32% : 0.000090s : 1: rewriter_before_opt_a 0.28% : 0.000080s : 1: symbol_engine_optimizer 35.67% : 0.010125s : 1: type_inference op_name: mint.mean, mode:pynative, test_op_reference... op_name: mint.mean, mode:pynative, test_op_reference... op_name: mint.argmax, mode:pynative, test_op_reference... op_name: mint.argmin, mode:pynative, test_op_reference... op_name: mint.count_nonzero, mode:pynative, test_op_reference... op_name: Tensor.sum, mode:pynative, test_op_reference... op_name: Tensor.argmax, mode:pynative, test_op_reference... op_name: mint.sum, mode:pynative, test_op_reference... op_name: mint.max, mode:pynative, test_op_reference... op_name: mint.min, mode:pynative, test_op_reference... op_name: Tensor.max, mode:pynative, test_op_reference... op_name: mint.all, mode:pynative, test_op_reference... op_name: mint.count_nonzero, mode:kbk, test_op_reference... TotalTime = 0.0348451, [30] [bootstrap]: 0.0002935 [type_inference]: 0.0264509 [event_method]: 1.689e-05 [auto_monad]: 6.256e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.50997e-06 [py_interpret_to_execute]: 3.611e-05 [rewriter_before_opt_a]: 7.213e-05 [expand_dump_flag]: 2.92002e-06 [jit_opt_a]: 0.00564842, [2] [Cycle 1]: 0.00183794, [27] [switch_simplify]: 6.027e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00058079 [with_stream_mark]: 2.512e-05 [recompute_prepare]: 8.90001e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.474e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 0.00077821 [add_forward_monad_depend]: 6.09999e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.638e-05 [cse]: 3.329e-05 [replace_applicator]: 1.547e-05 [Cycle 2]: 0.00032711, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.32001e-06 [a_1]: 8.751e-05 [with_stream_mark]: 1.175e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.65999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 7.68001e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 7.32002e-06 [inline_without_move]: 4.55999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.293e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.418e-05 [rewriter_after_opt_a]: 3.895e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00064521 [jit_opt_b]: 5.058e-05, [1] [Cycle 1]: 4.256e-05, [2] [frontend_op_eliminate]: 1.55e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 2.945e-05 [loop_unroll]: 0.00041538 [jit_opt_after_cconv]: 0.00015927, [1] [Cycle 1]: 0.00014643, [11] [c_1]: 1.961e-05 [parameter_eliminate]: 3.40998e-06 [updatestate_depend_eliminate]: 7.83001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.819e-05 [call_graph_tuple_transform]: 2.057e-05 [tuple_list_get_item_eliminator]: 5.14e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 7.01999e-06 [add_recomputation]: 5.227e-05 [cse_after_recomputation]: 2.666e-05, [1] [Cycle 1]: 1.964e-05, [1] [cse]: 1.276e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 7.96001e-06 [opt_after_jit_grad]: 0.00046181 [symbol_engine_optimizer]: 7.185e-05, [1] [Cycle 1]: 6.561e-05, [6] [build]: 3.04001e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.277e-05 [opt_reshape]: 5.67001e-06 [fold_const_symbol]: 9.15001e-06 [renormalize]: 3.4002e-07 [validate]: 4.339e-05 Sums bootstrap : 0.000294s : 0.95% type_inference : 0.026451s : 86.03% event_method : 0.000017s : 0.05% auto_monad : 0.000063s : 0.20% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000036s : 0.12% rewriter_before_opt_a : 0.000072s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000668s : 2.17% jit_opt_a.with_stream_mark : 0.000037s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000778s : 2.53% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000046s : 0.15% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000645s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000029s : 0.10% loop_unroll : 0.000415s : 1.35% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000462s : 1.50% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.14% Time group info: ------[substitution.] 0.000238 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 85.33% : 0.000203s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026386 2 96.75% : 0.025530s : 1: type_inference.infer 3.25% : 0.000856s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.12% : 0.000050s : 4: replace.inline 30.88% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.37% : 0.000201s : 4: match.inline 5.63% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.23% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.93% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.75% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000697 13 54.08% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.45% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.47% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036565 72 0.15% : 0.000055s : 1: add_recomputation 0.18% : 0.000066s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.86% : 0.000313s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.06% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.46% : 0.005652s : 1: jit_opt_a 0.44% : 0.000163s : 1: jit_opt_after_cconv 0.15% : 0.000053s : 1: jit_opt_b 1.16% : 0.000424s : 1: loop_unroll 1.79% : 0.000656s : 1: mutable_eliminate 2.45% : 0.000894s : 26: opt.transform.jit_opt_a 0.13% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.29% : 0.000470s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000039s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.19% : 0.000434s : 1: renormalize.infer 0.92% : 0.000335s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.21% : 0.000075s : 1: rewriter_before_opt_a 0.20% : 0.000075s : 1: symbol_engine_optimizer 72.38% : 0.026467s : 1: type_inference TotalTime = 0.0176425, [30] [bootstrap]: 0.00027724 [type_inference]: 0.0089633 [event_method]: 2.089e-05 [auto_monad]: 6.967e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 5.092e-05 [rewriter_before_opt_a]: 8.567e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00580469, [2] [Cycle 1]: 0.00189943, [27] [switch_simplify]: 5.992e-05 [loop_unroll]: 3.481e-05 [a_1]: 0.00062785 [with_stream_mark]: 1.791e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 0.00079106 [add_forward_monad_depend]: 5.69e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.595e-05 [cse]: 4.018e-05 [replace_applicator]: 1.448e-05 [Cycle 2]: 0.00033523, [27] [switch_simplify]: 6.50002e-06 [loop_unroll]: 5.59998e-06 [a_1]: 9.266e-05 [with_stream_mark]: 9.56e-06 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.84003e-06 [merge_forward]: 3.25998e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 8.22e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 7.61999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 6.65002e-06 [cse]: 1.591e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.255e-05 [rewriter_after_opt_a]: 9.945e-05 [convert_after_rewriter]: 7.92003e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.00061611 [jit_opt_b]: 5.433e-05, [1] [Cycle 1]: 4.656e-05, [2] [frontend_op_eliminate]: 1.754e-05 [inline_after_opt_a]: 1.75e-05 [cconv]: 2.819e-05 [loop_unroll]: 0.00043469 [jit_opt_after_cconv]: 0.0001591, [1] [Cycle 1]: 0.00015238, [11] [c_1]: 2.228e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 5.92999e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 3.198e-05 [call_graph_tuple_transform]: 1.849e-05 [tuple_list_get_item_eliminator]: 5.58002e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 3.845e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 6.508e-05 [cse_after_recomputation]: 2.647e-05, [1] [Cycle 1]: 2.061e-05, [1] [cse]: 1.374e-05 [auto_monad_reorder]: 1.858e-05 [get_jit_bprop_graph]: 2.63998e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00046569 [symbol_engine_optimizer]: 7.885e-05, [1] [Cycle 1]: 7.205e-05, [6] [build]: 4.4e-06 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 9.49e-06 [renormalize]: 4.40021e-07 [validate]: 4.394e-05 Sums bootstrap : 0.000277s : 2.06% type_inference : 0.008963s : 66.63% event_method : 0.000021s : 0.16% auto_monad : 0.000070s : 0.52% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000051s : 0.38% rewriter_before_opt_a : 0.000086s : 0.64% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.49% jit_opt_a.loop_unroll : 0.000040s : 0.30% jit_opt_a.a_1 : 0.000721s : 5.36% jit_opt_a.with_stream_mark : 0.000027s : 0.20% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000791s : 5.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.17% jit_opt_a.cse : 0.000056s : 0.42% jit_opt_a.replace_applicator : 0.000021s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000099s : 0.74% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000616s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.13% cconv : 0.000028s : 0.21% loop_unroll : 0.000435s : 3.23% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000038s : 0.29% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000065s : 0.48% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000466s : 3.46% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.33% Time group info: ------[substitution.] 0.000217 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000005s : 3: substitution.graph_param_transform 85.54% : 0.000185s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000004s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 5.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008890 2 87.71% : 0.007797s : 1: type_inference.infer 12.29% : 0.001093s : 1: type_inference.specialize ------[replace.] 0.000094 7 66.85% : 0.000063s : 5: replace.inline 33.15% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 7 94.68% : 0.000182s : 5: match.inline 5.32% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.40% : 0.000002s : 11: predicate.addn_zero_filter 2.04% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_depend_swap 1.32% : 0.000002s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 24: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 16: predicate.load_eliminater 1.00% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.32% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.36% : 0.000002s : 11: predicate.print_const_string_wrapper 1.81% : 0.000002s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.17% : 0.000010s : 59: predicate.switch_simplify 1.23% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.93% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000833 16 52.11% : 0.000434s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.33% : 0.000053s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.56% : 0.000346s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019443 72 0.35% : 0.000068s : 1: add_recomputation 0.38% : 0.000073s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.53% : 0.000297s : 1: bootstrap 0.16% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 29.87% : 0.005808s : 1: jit_opt_a 0.83% : 0.000162s : 1: jit_opt_after_cconv 0.30% : 0.000058s : 1: jit_opt_b 2.27% : 0.000442s : 1: loop_unroll 3.24% : 0.000629s : 1: mutable_eliminate 4.89% : 0.000951s : 26: opt.transform.jit_opt_a 0.25% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000028s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.44% : 0.000475s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000054s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000041s : 1: remove_dup_value 2.21% : 0.000430s : 1: renormalize.infer 1.81% : 0.000352s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.53% : 0.000103s : 1: rewriter_after_opt_a 0.45% : 0.000088s : 1: rewriter_before_opt_a 0.42% : 0.000082s : 1: symbol_engine_optimizer 46.19% : 0.008981s : 1: type_inference TotalTime = 0.0969104, [30] [bootstrap]: 0.00027392 [type_inference]: 0.0684155 [event_method]: 0.00029496 [auto_monad]: 0.00020145 [graph_reusing]: 7.55998e-06 [pre_auto_parallel]: 3.40998e-06 [py_interpret_to_execute]: 3.524e-05 [rewriter_before_opt_a]: 0.00011834 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.0251224, [3] [Cycle 1]: 0.017365, [27] [switch_simplify]: 7.601e-05 [loop_unroll]: 9.937e-05 [a_1]: 0.00095259 [with_stream_mark]: 3.304e-05 [recompute_prepare]: 2.045e-05 [updatestate_depend_eliminate]: 9.84001e-06 [updatestate_assign_eliminate]: 6.98998e-06 [updatestate_loads_eliminate]: 7.56001e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 1.623e-05 [updatestate_useless_node_eliminater]: 1.399e-05 [accelerated_algorithm]: 1.479e-05 [meta_shard_fg_expand]: 4.02e-06 [get_grad_eliminate_]: 1.407e-05 [merge_forward]: 9.49e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.995e-05 [j_node_and_user_rematch]: 2.553e-05 [meta_fg_expand]: 0.00181014 [replace_old_param]: 6.914e-05 [inline_without_move]: 6.103e-05 [renormalize]: 0.0133429 [add_forward_monad_depend]: 1.387e-05 [auto_monad_grad]: 6.98e-06 [auto_monad_eliminator]: 6.372e-05 [cse]: 0.00028588 [replace_applicator]: 0.000104 [Cycle 2]: 0.00392134, [27] [switch_simplify]: 4.365e-05 [loop_unroll]: 4.145e-05 [a_1]: 0.00123956 [with_stream_mark]: 2.932e-05 [recompute_prepare]: 1.096e-05 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.58998e-06 [specialize_transform]: 7.98001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.683e-05 [j_node_and_user_rematch]: 9.63002e-06 [meta_fg_expand]: 8.986e-05 [replace_old_param]: 9.91e-06 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00207643 [add_forward_monad_depend]: 9.72999e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.76e-05 [cse]: 3.177e-05 [replace_applicator]: 2.181e-05 [Cycle 3]: 0.00028578, [27] [switch_simplify]: 4.94e-06 [loop_unroll]: 4.37998e-06 [a_1]: 4.92e-05 [with_stream_mark]: 1.472e-05 [recompute_prepare]: 3.8e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 1.71998e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 3.96001e-06 [updatestate_useless_node_eliminater]: 3.56999e-06 [accelerated_algorithm]: 3.88001e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 3.21001e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 3.26999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 6.75002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 3.48e-06 [inline_without_move]: 3.04001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 3.93999e-06 [cse]: 9.36e-06 [replace_applicator]: 3.6e-06 [py_interpret_to_execute_after_opt_a]: 1.395e-05 [rewriter_after_opt_a]: 3.936e-05 [convert_after_rewriter]: 5.84999e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00081839 [jit_opt_b]: 4.494e-05, [1] [Cycle 1]: 3.72e-05, [2] [frontend_op_eliminate]: 1.138e-05 [inline_after_opt_a]: 1.316e-05 [cconv]: 2.846e-05 [loop_unroll]: 0.00045922 [jit_opt_after_cconv]: 0.00013381, [1] [Cycle 1]: 0.00012758, [11] [c_1]: 1.3e-05 [parameter_eliminate]: 3.28998e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 1.94999e-06 [updatestate_loads_eliminate]: 1.55001e-06 [cse]: 2.046e-05 [call_graph_tuple_transform]: 1.647e-05 [tuple_list_get_item_eliminator]: 3.93001e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 4.43001e-06 [remove_dup_value]: 1.378e-05 [partial_unused_args_eliminate]: 1.88002e-06 [environ_conv]: 5.13002e-06 [add_recomputation]: 3.854e-05 [cse_after_recomputation]: 1.866e-05, [1] [Cycle 1]: 1.361e-05, [1] [cse]: 7.6e-06 [auto_monad_reorder]: 1.313e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 6.78e-06 [opt_after_jit_grad]: 0.00047744 [symbol_engine_optimizer]: 6.779e-05, [1] [Cycle 1]: 6.013e-05, [6] [build]: 3.93999e-06 [elim_shapecalc]: 5.96998e-06 [elim_not_effective]: 9.69999e-06 [opt_reshape]: 4.76997e-06 [fold_const_symbol]: 6.21998e-06 [renormalize]: 4.7998e-07 [validate]: 3.531e-05 Sums bootstrap : 0.000274s : 0.30% type_inference : 0.068415s : 74.03% event_method : 0.000295s : 0.32% auto_monad : 0.000201s : 0.22% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000035s : 0.04% rewriter_before_opt_a : 0.000118s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000125s : 0.13% jit_opt_a.loop_unroll : 0.000145s : 0.16% jit_opt_a.a_1 : 0.002241s : 2.43% jit_opt_a.with_stream_mark : 0.000077s : 0.08% jit_opt_a.recompute_prepare : 0.000035s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000018s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000013s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000028s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000023s : 0.03% jit_opt_a.accelerated_algorithm : 0.000025s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000023s : 0.02% jit_opt_a.merge_forward : 0.000017s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000061s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000042s : 0.05% jit_opt_a.meta_fg_expand : 0.001902s : 2.06% jit_opt_a.replace_old_param : 0.000083s : 0.09% jit_opt_a.inline_without_move : 0.000070s : 0.08% jit_opt_a.renormalize : 0.015419s : 16.69% jit_opt_a.add_forward_monad_depend : 0.000025s : 0.03% jit_opt_a.auto_monad_grad : 0.000010s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000085s : 0.09% jit_opt_a.cse : 0.000327s : 0.35% jit_opt_a.replace_applicator : 0.000129s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000818s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000011s : 0.01% jit_opt_b.inline_after_opt_a : 0.000013s : 0.01% cconv : 0.000028s : 0.03% loop_unroll : 0.000459s : 0.50% jit_opt_after_cconv.c_1 : 0.000013s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000004s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000004s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000008s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000477s : 0.52% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000006s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000010s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000006s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.04% Time group info: ------[substitution.] 0.000590 101 0.24% : 0.000001s : 1: substitution.elim_not_effective 0.21% : 0.000001s : 1: substitution.fold_const_symbol 0.84% : 0.000005s : 1: substitution.graph_param_transform 64.98% : 0.000384s : 12: substitution.inline 2.97% : 0.000018s : 2: substitution.inline_without_move 1.67% : 0.000010s : 11: substitution.j_node_and_user_rematch 2.25% : 0.000013s : 7: substitution.minmaximum_grad 1.35% : 0.000008s : 5: substitution.partial_eliminate 1.99% : 0.000012s : 11: substitution.remove_not_recompute_node 6.06% : 0.000036s : 10: substitution.replace_applicator 1.14% : 0.000007s : 10: substitution.replace_old_param 0.41% : 0.000002s : 1: substitution.set_cell_output_no_recompute 1.21% : 0.000007s : 1: substitution.tile_eliminate 4.12% : 0.000024s : 7: substitution.tuple_list_convert_item_index_to_positive 2.76% : 0.000016s : 7: substitution.tuple_list_get_item_depend_reorder 7.82% : 0.000046s : 14: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068310 2 96.79% : 0.066118s : 1: type_inference.infer 3.21% : 0.002192s : 1: type_inference.specialize ------[replace.] 0.000192 19 63.03% : 0.000121s : 12: replace.inline 36.97% : 0.000071s : 7: replace.tuple_list_get_item_eliminator ------[match.] 0.000399 19 94.14% : 0.000376s : 12: match.inline 5.86% : 0.000023s : 7: match.tuple_list_get_item_eliminator ------[predicate.] 0.000383 2542 1.51% : 0.000006s : 44: predicate.accumulaten_eliminater 0.24% : 0.000001s : 1: predicate.ad_related_special_op_eliminate 1.41% : 0.000005s : 44: predicate.addn_check_dump 1.71% : 0.000007s : 44: predicate.addn_zero_filter 2.07% : 0.000008s : 44: predicate.arithmetic_simplify 1.66% : 0.000006s : 44: predicate.cast_eliminate 0.09% : 0.000000s : 1: predicate.check_bprop_eliminate 1.39% : 0.000005s : 44: predicate.compare_switch_simplify 1.61% : 0.000006s : 44: predicate.depend_value_elim 1.51% : 0.000006s : 44: predicate.dict_get_item_const_eliminator 1.49% : 0.000006s : 44: predicate.dict_get_item_eliminator 1.49% : 0.000006s : 44: predicate.dict_set_item_eliminator 0.20% : 0.000001s : 1: predicate.dumpgradient_eliminate 0.06% : 0.000000s : 1: predicate.elim_not_effective 0.10% : 0.000000s : 1: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000006s : 44: predicate.environ_add_const_eliminate 1.45% : 0.000006s : 44: predicate.environ_get_add_eliminate 1.38% : 0.000005s : 44: predicate.environ_get_depend_swap 1.51% : 0.000006s : 44: predicate.environ_get_eliminate 1.42% : 0.000005s : 44: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 1: predicate.fold_const_symbol 0.80% : 0.000003s : 17: predicate.get_grad_eliminate 0.03% : 0.000000s : 1: predicate.graph_param_transform 4.39% : 0.000017s : 65: predicate.inline 1.96% : 0.000007s : 45: predicate.inline_without_move 0.34% : 0.000001s : 17: predicate.j_node_and_user_rematch 1.18% : 0.000005s : 17: predicate.less_batch_normalization 1.84% : 0.000007s : 51: predicate.list_to_tuple_eliminator_ 1.87% : 0.000007s : 52: predicate.load_eliminater 0.28% : 0.000001s : 1: predicate.loop_unroll_after_grad 3.36% : 0.000013s : 93: predicate.loop_unroll_before_grad 1.71% : 0.000007s : 45: predicate.make_slice_get_slice_eliminator 1.40% : 0.000005s : 44: predicate.merge_addn 1.62% : 0.000006s : 44: predicate.minmaximum_grad 0.36% : 0.000001s : 1: predicate.mutable_eliminate 0.08% : 0.000000s : 1: predicate.opt_reshape 2.51% : 0.000010s : 52: predicate.partial_eliminate 1.47% : 0.000006s : 44: predicate.print_const_string_wrapper 1.97% : 0.000008s : 44: predicate.reduce_eliminate 1.93% : 0.000007s : 51: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000002s : 17: predicate.remove_not_recompute_node 3.08% : 0.000012s : 96: predicate.replace_applicator 1.17% : 0.000004s : 45: predicate.replace_old_param 0.05% : 0.000000s : 1: predicate.reset_defer_inline 1.62% : 0.000006s : 44: predicate.reshape_eliminate 1.53% : 0.000006s : 44: predicate.row_tensor_add_zeros_like 0.18% : 0.000001s : 1: predicate.row_tensor_eliminate 1.55% : 0.000006s : 44: predicate.same_eliminate 0.43% : 0.000002s : 17: predicate.set_cell_output_no_recompute 0.21% : 0.000001s : 2: predicate.special_op_eliminate 0.85% : 0.000003s : 17: predicate.specialize_transform 1.74% : 0.000007s : 44: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000006s : 44: predicate.stack_unstack_eliminate 0.05% : 0.000000s : 1: predicate.switch_call_monad_eliminater 2.86% : 0.000011s : 63: predicate.switch_defer_inline 2.50% : 0.000010s : 63: predicate.switch_layer_defer_inline 6.39% : 0.000024s : 157: predicate.switch_simplify 1.60% : 0.000006s : 44: predicate.tile_eliminate 1.63% : 0.000006s : 44: predicate.transpose_eliminate 1.90% : 0.000007s : 44: predicate.tuple_list_convert_item_index_to_positive 1.75% : 0.000007s : 44: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000014s : 53: predicate.tuple_list_get_item_eliminator 1.89% : 0.000007s : 44: predicate.tuple_list_set_item_eliminator 1.78% : 0.000007s : 51: predicate.tuple_to_list_eliminator_ 1.80% : 0.000007s : 52: predicate.updatestate_pure_node_eliminater 2.68% : 0.000010s : 69: predicate.updatestate_useless_node_eliminater 1.81% : 0.000007s : 44: predicate.value_based_eliminate 0.05% : 0.000000s : 1: predicate.virtual_view_grad_eliminate 0.15% : 0.000001s : 1: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004312 50 78.10% : 0.003368s : 34: func_graph_cloner_run.FuncGraphClonerGraph 21.90% : 0.000944s : 16: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115305 87 0.04% : 0.000042s : 1: add_recomputation 0.18% : 0.000210s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.26% : 0.000298s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000021s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.26% : 0.000303s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 21.79% : 0.025126s : 1: jit_opt_a 0.12% : 0.000136s : 1: jit_opt_after_cconv 0.04% : 0.000047s : 1: jit_opt_b 0.41% : 0.000467s : 1: loop_unroll 0.72% : 0.000829s : 1: mutable_eliminate 2.58% : 0.002976s : 39: opt.transform.jit_opt_a 0.03% : 0.000035s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000018s : 4: opt.transform.jit_opt_b 0.01% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000017s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000022s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000038s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 11.17% : 0.012884s : 2: renormalize.infer 2.18% : 0.002511s : 2: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.11% : 0.000121s : 1: rewriter_before_opt_a 0.06% : 0.000070s : 1: symbol_engine_optimizer 59.36% : 0.068440s : 1: type_inference TotalTime = 0.123728, [30] [bootstrap]: 0.00035515 [type_inference]: 0.112178 [event_method]: 2.123e-05 [auto_monad]: 0.00010907 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.24001e-06 [py_interpret_to_execute]: 0.00026966 [rewriter_before_opt_a]: 8.41e-05 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00802916, [2] [Cycle 1]: 0.00372805, [27] [switch_simplify]: 6.156e-05 [loop_unroll]: 2.975e-05 [a_1]: 0.00071998 [with_stream_mark]: 2.55e-05 [recompute_prepare]: 1.004e-05 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.35002e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 7.77e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.688e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00248216 [add_forward_monad_depend]: 7.96001e-06 [auto_monad_grad]: 2.93998e-06 [auto_monad_eliminator]: 2.09e-05 [cse]: 3.768e-05 [replace_applicator]: 2.16e-05 [Cycle 2]: 0.00038379, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00012013 [with_stream_mark]: 1.569e-05 [recompute_prepare]: 5.68002e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.90002e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.83e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.756e-05 [j_node_and_user_rematch]: 9.31002e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 8.33001e-06 [cse]: 1.41e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.508e-05 [rewriter_after_opt_a]: 3.946e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00076483 [jit_opt_b]: 5.927e-05, [1] [Cycle 1]: 5.064e-05, [2] [frontend_op_eliminate]: 2.128e-05 [inline_after_opt_a]: 1.792e-05 [cconv]: 3.562e-05 [loop_unroll]: 0.00047037 [jit_opt_after_cconv]: 0.00018023, [1] [Cycle 1]: 0.00017218, [11] [c_1]: 2.626e-05 [parameter_eliminate]: 4.87e-06 [updatestate_depend_eliminate]: 8.37e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.364e-05 [call_graph_tuple_transform]: 2.523e-05 [tuple_list_get_item_eliminator]: 6.99001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 1.80007e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.66e-05 [partial_unused_args_eliminate]: 2.79999e-06 [environ_conv]: 1.04e-05 [add_recomputation]: 5.495e-05 [cse_after_recomputation]: 2.528e-05, [1] [Cycle 1]: 1.918e-05, [1] [cse]: 1.271e-05 [auto_monad_reorder]: 1.617e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 8.28999e-06 [opt_after_jit_grad]: 0.00055793 [symbol_engine_optimizer]: 0.00012999, [1] [Cycle 1]: 0.00012295, [6] [build]: 4.56002e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 5.948e-05 [renormalize]: 6.69999e-07 [validate]: 5.651e-05 Sums bootstrap : 0.000355s : 0.30% type_inference : 0.112178s : 94.15% event_method : 0.000021s : 0.02% auto_monad : 0.000109s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000270s : 0.23% rewriter_before_opt_a : 0.000084s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000840s : 0.71% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002482s : 2.08% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000765s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000470s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000558s : 0.47% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000059s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.05% Time group info: ------[substitution.] 0.000286 24 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.07% : 0.000006s : 4: substitution.graph_param_transform 86.57% : 0.000248s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000006s : 4: substitution.remove_not_recompute_node 2.11% : 0.000006s : 2: substitution.replace_old_param 4.62% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112087 2 98.15% : 0.110009s : 1: type_inference.infer 1.85% : 0.002079s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.65% : 0.000054s : 4: replace.inline 33.35% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 6 95.29% : 0.000245s : 4: match.inline 4.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.08% : 0.000001s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 1.76% : 0.000002s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000001s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.60% : 0.000001s : 4: predicate.graph_param_transform 6.08% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.63% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.97% : 0.000003s : 4: predicate.mutable_eliminate 0.75% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.28% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.19% : 0.000002s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.19% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.25% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002472 26 72.54% : 0.001793s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.33% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.13% : 0.000621s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127407 72 0.05% : 0.000059s : 1: add_recomputation 0.09% : 0.000114s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.30% : 0.000377s : 1: bootstrap 0.03% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.31% : 0.008033s : 1: jit_opt_a 0.14% : 0.000183s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.38% : 0.000483s : 1: loop_unroll 0.61% : 0.000778s : 1: mutable_eliminate 0.85% : 0.001089s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000568s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000275s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.36% : 0.001733s : 1: renormalize.infer 0.58% : 0.000737s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000089s : 1: rewriter_before_opt_a 0.10% : 0.000133s : 1: symbol_engine_optimizer 88.06% : 0.112200s : 1: type_inference TotalTime = 0.0286321, [30] [bootstrap]: 0.00029052 [type_inference]: 0.0201532 [event_method]: 2.302e-05 [auto_monad]: 6.985e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00010181 [rewriter_before_opt_a]: 8.187e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00575909, [2] [Cycle 1]: 0.00197925, [27] [switch_simplify]: 5.843e-05 [loop_unroll]: 3.041e-05 [a_1]: 0.0005496 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.08998e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00098747 [add_forward_monad_depend]: 6.21e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.438e-05 [cse]: 3.371e-05 [replace_applicator]: 1.345e-05 [Cycle 2]: 0.00031288, [27] [switch_simplify]: 5.72999e-06 [loop_unroll]: 5.02999e-06 [a_1]: 8.715e-05 [with_stream_mark]: 1.148e-05 [recompute_prepare]: 5.01002e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.61002e-06 [merge_forward]: 2.63998e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 8.04002e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 6.54999e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 5.3001e-07 [auto_monad_eliminator]: 5.15001e-06 [cse]: 1.215e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 1.211e-05 [rewriter_after_opt_a]: 3.793e-05 [convert_after_rewriter]: 7.69002e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.000552 [jit_opt_b]: 4.903e-05, [1] [Cycle 1]: 4.171e-05, [2] [frontend_op_eliminate]: 1.534e-05 [inline_after_opt_a]: 1.553e-05 [cconv]: 2.635e-05 [loop_unroll]: 0.00040831 [jit_opt_after_cconv]: 0.00013815, [1] [Cycle 1]: 0.00013238, [11] [c_1]: 2.027e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.72999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.188e-05 [call_graph_tuple_transform]: 1.812e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.445e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 5.98002e-06 [add_recomputation]: 4.899e-05 [cse_after_recomputation]: 2.149e-05, [1] [Cycle 1]: 1.66e-05, [1] [cse]: 1.113e-05 [auto_monad_reorder]: 1.69e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00045434 [symbol_engine_optimizer]: 7.903e-05, [1] [Cycle 1]: 7.242e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 7.70998e-06 [elim_not_effective]: 1.16e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 1.679e-05 [renormalize]: 3.89991e-07 [validate]: 4.003e-05 Sums bootstrap : 0.000291s : 1.18% type_inference : 0.020153s : 82.07% event_method : 0.000023s : 0.09% auto_monad : 0.000070s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.41% rewriter_before_opt_a : 0.000082s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000637s : 2.59% jit_opt_a.with_stream_mark : 0.000033s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000988s : 4.02% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.08% jit_opt_a.cse : 0.000046s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000552s : 2.25% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.11% loop_unroll : 0.000408s : 1.66% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000014s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000454s : 1.85% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000017s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.16% Time group info: ------[substitution.] 0.000222 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.38% : 0.000005s : 3: substitution.graph_param_transform 85.84% : 0.000191s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.81% : 0.000004s : 4: substitution.remove_not_recompute_node 1.81% : 0.000004s : 2: substitution.replace_old_param 5.12% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020071 2 92.14% : 0.018494s : 1: type_inference.infer 7.86% : 0.001577s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.85% : 0.000050s : 4: replace.inline 31.15% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.80% : 0.000188s : 4: match.inline 5.20% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.25% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.70% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.44% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.47% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.79% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.07% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.94% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000827 13 42.28% : 0.000350s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.13% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.59% : 0.000427s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030530 72 0.17% : 0.000052s : 1: add_recomputation 0.24% : 0.000073s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.01% : 0.000309s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.87% : 0.005762s : 1: jit_opt_a 0.46% : 0.000141s : 1: jit_opt_after_cconv 0.17% : 0.000051s : 1: jit_opt_b 1.36% : 0.000415s : 1: loop_unroll 1.84% : 0.000561s : 1: mutable_eliminate 2.79% : 0.000852s : 26: opt.transform.jit_opt_a 0.15% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000039s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000462s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000105s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.89% : 0.000576s : 1: renormalize.infer 1.32% : 0.000403s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000080s : 1: rewriter_after_opt_a 0.28% : 0.000086s : 1: rewriter_before_opt_a 0.27% : 0.000082s : 1: symbol_engine_optimizer 66.08% : 0.020173s : 1: type_inference TotalTime = 0.0199493, [30] [bootstrap]: 0.00039279 [type_inference]: 0.0112444 [event_method]: 2.364e-05 [auto_monad]: 7.41e-05 [graph_reusing]: 6.28002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 6.382e-05 [rewriter_before_opt_a]: 9.076e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00578453, [2] [Cycle 1]: 0.00208211, [27] [switch_simplify]: 6.308e-05 [loop_unroll]: 3.521e-05 [a_1]: 0.00069396 [with_stream_mark]: 1.921e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.44002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 3.21999e-06 [replace_old_param]: 8.91997e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00091235 [add_forward_monad_depend]: 5.12999e-06 [auto_monad_grad]: 2.14e-06 [auto_monad_eliminator]: 1.508e-05 [cse]: 4.083e-05 [replace_applicator]: 1.413e-05 [Cycle 2]: 0.00032594, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.42999e-06 [a_1]: 9.175e-05 [with_stream_mark]: 8.74e-06 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 4.89e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.309e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.42999e-06 [cse]: 1.551e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.176e-05 [rewriter_after_opt_a]: 3.713e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00057792 [jit_opt_b]: 5.273e-05, [1] [Cycle 1]: 4.473e-05, [2] [frontend_op_eliminate]: 1.672e-05 [inline_after_opt_a]: 1.641e-05 [cconv]: 2.316e-05 [loop_unroll]: 0.00042361 [jit_opt_after_cconv]: 0.00014965, [1] [Cycle 1]: 0.00014308, [11] [c_1]: 2.105e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.58003e-06 [cse]: 2.724e-05 [call_graph_tuple_transform]: 1.812e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 3.49e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 5.31002e-06 [add_recomputation]: 4.741e-05 [cse_after_recomputation]: 3.98e-05, [1] [Cycle 1]: 3.423e-05, [1] [cse]: 2.741e-05 [auto_monad_reorder]: 1.878e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.73003e-06 [opt_after_jit_grad]: 0.00047429 [symbol_engine_optimizer]: 7.399e-05, [1] [Cycle 1]: 6.695e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 5.89999e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 4.50003e-07 [validate]: 3.807e-05 Sums bootstrap : 0.000393s : 2.47% type_inference : 0.011244s : 70.62% event_method : 0.000024s : 0.15% auto_monad : 0.000074s : 0.47% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000064s : 0.40% rewriter_before_opt_a : 0.000091s : 0.57% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.44% jit_opt_a.loop_unroll : 0.000041s : 0.26% jit_opt_a.a_1 : 0.000786s : 4.93% jit_opt_a.with_stream_mark : 0.000028s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.000912s : 5.73% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.13% jit_opt_a.cse : 0.000056s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.07% rewriter_after_opt_a : 0.000037s : 0.23% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000578s : 3.63% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000023s : 0.15% loop_unroll : 0.000424s : 2.66% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000035s : 0.22% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000005s : 0.03% add_recomputation : 0.000047s : 0.30% cse_after_recomputation.cse : 0.000027s : 0.17% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000474s : 2.98% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.24% Time group info: ------[substitution.] 0.000251 24 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 3: substitution.graph_param_transform 86.54% : 0.000217s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 4.88% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011164 2 86.84% : 0.009694s : 1: type_inference.infer 13.16% : 0.001469s : 1: type_inference.specialize ------[replace.] 0.000097 7 69.09% : 0.000067s : 5: replace.inline 30.91% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 95.06% : 0.000214s : 5: match.inline 4.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.40% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.22% : 0.000002s : 11: predicate.addn_zero_filter 1.92% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.20% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.28% : 0.000002s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 16: predicate.load_eliminater 1.11% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.50% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 1.74% : 0.000002s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 2.08% : 0.000003s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.94% : 0.000004s : 18: predicate.switch_defer_inline 2.27% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.05% : 0.000010s : 59: predicate.switch_simplify 1.22% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.63% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001099 16 51.72% : 0.000569s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.61% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.67% : 0.000458s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021932 72 0.23% : 0.000050s : 1: add_recomputation 0.35% : 0.000078s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 2.09% : 0.000458s : 1: bootstrap 0.12% : 0.000026s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000042s : 1: cse_after_recomputation 0.03% : 0.000007s : 1: environ_conv 0.13% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 26.39% : 0.005788s : 1: jit_opt_a 0.69% : 0.000152s : 1: jit_opt_after_cconv 0.25% : 0.000055s : 1: jit_opt_b 1.97% : 0.000432s : 1: loop_unroll 2.68% : 0.000587s : 1: mutable_eliminate 4.62% : 0.001014s : 26: opt.transform.jit_opt_a 0.21% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.20% : 0.000483s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000067s : 1: py_interpret_to_execute 0.06% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000038s : 1: remove_dup_value 2.16% : 0.000473s : 1: renormalize.infer 1.97% : 0.000432s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000040s : 1: rewriter_after_opt_a 0.43% : 0.000094s : 1: rewriter_before_opt_a 0.35% : 0.000077s : 1: symbol_engine_optimizer 51.36% : 0.011265s : 1: type_inference TotalTime = 0.233096, [30] [bootstrap]: 0.00042253 [type_inference]: 0.201667 [event_method]: 0.00056878 [auto_monad]: 0.00014327 [graph_reusing]: 9.45001e-06 [pre_auto_parallel]: 3.45e-06 [py_interpret_to_execute]: 5.019e-05 [rewriter_before_opt_a]: 0.00016022 [expand_dump_flag]: 4.22998e-06 [jit_opt_a]: 0.0106811, [2] [Cycle 1]: 0.00613726, [27] [switch_simplify]: 0.00024574 [loop_unroll]: 7.249e-05 [a_1]: 0.00163579 [with_stream_mark]: 2.447e-05 [recompute_prepare]: 1.113e-05 [updatestate_depend_eliminate]: 4.83001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.857e-05 [j_node_and_user_rematch]: 1.163e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.129e-05 [inline_without_move]: 6.54001e-06 [renormalize]: 0.0037222 [add_forward_monad_depend]: 8.92e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 2.069e-05 [cse]: 3.914e-05 [replace_applicator]: 2.36e-05 [Cycle 2]: 0.00039247, [27] [switch_simplify]: 6.83998e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00011221 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.98997e-06 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.925e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 9.77001e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 1.30007e-07 [add_forward_monad_depend]: 1.62001e-06 [auto_monad_grad]: 1.31002e-06 [auto_monad_eliminator]: 7.7e-06 [cse]: 1.712e-05 [replace_applicator]: 6.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.818e-05 [rewriter_after_opt_a]: 4.159e-05 [convert_after_rewriter]: 7.93001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00082063 [jit_opt_b]: 5.936e-05, [1] [Cycle 1]: 5.074e-05, [2] [frontend_op_eliminate]: 2.1e-05 [inline_after_opt_a]: 1.77e-05 [cconv]: 3.744e-05 [loop_unroll]: 0.0005023 [jit_opt_after_cconv]: 0.0163586, [1] [Cycle 1]: 0.0163474, [11] [c_1]: 0.0160886 [parameter_eliminate]: 8.05e-06 [updatestate_depend_eliminate]: 1.637e-05 [updatestate_assign_eliminate]: 4.13001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [cse]: 5.264e-05 [call_graph_tuple_transform]: 4.192e-05 [tuple_list_get_item_eliminator]: 9.96998e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 8.28999e-06 [remove_dup_value]: 2.276e-05 [partial_unused_args_eliminate]: 3.31001e-06 [environ_conv]: 8.41002e-06 [add_recomputation]: 6.185e-05 [cse_after_recomputation]: 3.67e-05, [1] [Cycle 1]: 2.53e-05, [1] [cse]: 1.519e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 5.21002e-06 [rewriter_after_jit_bprop_graph]: 1.167e-05 [opt_after_jit_grad]: 0.00095071 [symbol_engine_optimizer]: 0.00010744, [1] [Cycle 1]: 9.823e-05, [6] [build]: 7.85e-06 [elim_shapecalc]: 1.091e-05 [elim_not_effective]: 2.133e-05 [opt_reshape]: 8.75999e-06 [fold_const_symbol]: 1.275e-05 [renormalize]: 1.05999e-06 [validate]: 5.224e-05 Sums bootstrap : 0.000423s : 0.19% type_inference : 0.201667s : 88.40% event_method : 0.000569s : 0.25% auto_monad : 0.000143s : 0.06% graph_reusing : 0.000009s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000050s : 0.02% rewriter_before_opt_a : 0.000160s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000253s : 0.11% jit_opt_a.loop_unroll : 0.000079s : 0.03% jit_opt_a.a_1 : 0.001748s : 0.77% jit_opt_a.with_stream_mark : 0.000040s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003722s : 1.63% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000821s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000037s : 0.02% loop_unroll : 0.000502s : 0.22% jit_opt_after_cconv.c_1 : 0.016089s : 7.05% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000053s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000042s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000062s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000951s : 0.42% symbol_engine_optimizer.build : 0.000008s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.02% Time group info: ------[substitution.] 0.000733 35 0.51% : 0.000004s : 2: substitution.elim_not_effective 0.20% : 0.000001s : 2: substitution.fold_const_symbol 1.13% : 0.000008s : 3: substitution.graph_param_transform 90.61% : 0.000664s : 12: substitution.inline 0.71% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.83% : 0.000006s : 4: substitution.remove_not_recompute_node 0.89% : 0.000007s : 2: substitution.replace_old_param 1.34% : 0.000010s : 1: substitution.reshape_eliminate 2.19% : 0.000016s : 3: substitution.switch_simplify 1.58% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.201546 2 89.67% : 0.180724s : 1: type_inference.infer 10.33% : 0.020822s : 1: type_inference.specialize ------[replace.] 0.000392 18 47.87% : 0.000188s : 12: replace.inline 1.28% : 0.000005s : 1: replace.reshape_eliminate 24.40% : 0.000096s : 3: replace.switch_simplify 26.45% : 0.000104s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000691 18 95.12% : 0.000657s : 12: match.inline 1.27% : 0.000009s : 1: match.reshape_eliminate 2.08% : 0.000014s : 3: match.switch_simplify 1.53% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000216 1212 1.29% : 0.000003s : 19: predicate.accumulaten_eliminater 1.02% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.29% : 0.000003s : 19: predicate.addn_check_dump 1.35% : 0.000003s : 19: predicate.addn_zero_filter 2.16% : 0.000005s : 19: predicate.arithmetic_simplify 1.47% : 0.000003s : 20: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000003s : 19: predicate.compare_switch_simplify 1.22% : 0.000003s : 19: predicate.depend_value_elim 1.22% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.44% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.40% : 0.000003s : 20: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.21% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.27% : 0.000003s : 20: predicate.environ_get_depend_swap 1.34% : 0.000003s : 20: predicate.environ_get_eliminate 1.20% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.70% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.30% : 0.000011s : 40: predicate.inline 0.46% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.86% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.74% : 0.000004s : 25: predicate.load_eliminater 0.81% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.90% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.21% : 0.000003s : 19: predicate.merge_addn 1.49% : 0.000003s : 19: predicate.minmaximum_grad 1.32% : 0.000003s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.71% : 0.000006s : 25: predicate.partial_eliminate 1.49% : 0.000003s : 19: predicate.print_const_string_wrapper 1.53% : 0.000003s : 19: predicate.reduce_eliminate 1.68% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000004s : 28: predicate.replace_applicator 0.32% : 0.000001s : 6: predicate.replace_old_param 0.18% : 0.000000s : 3: predicate.reset_defer_inline 1.60% : 0.000003s : 20: predicate.reshape_eliminate 1.32% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.44% : 0.000003s : 19: predicate.same_eliminate 0.29% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.64% : 0.000001s : 6: predicate.special_op_eliminate 0.52% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.20% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.34% : 0.000007s : 34: predicate.switch_defer_inline 2.37% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.85% : 0.000019s : 107: predicate.switch_simplify 1.28% : 0.000003s : 19: predicate.tile_eliminate 1.22% : 0.000003s : 19: predicate.transpose_eliminate 1.84% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.69% : 0.000004s : 20: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.69% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.56% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.48% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.49% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.47% : 0.000003s : 19: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.020342 40 91.87% : 0.018687s : 21: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000379s : 5: func_graph_cloner_run.FuncGraphClonerNode 6.27% : 0.001275s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.255191 72 0.03% : 0.000065s : 1: add_recomputation 0.06% : 0.000150s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.18% : 0.000448s : 1: bootstrap 0.02% : 0.000040s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000039s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.23% : 0.000578s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000012s : 1: graph_reusing 4.19% : 0.010686s : 1: jit_opt_a 6.41% : 0.016366s : 1: jit_opt_after_cconv 0.02% : 0.000062s : 1: jit_opt_b 0.20% : 0.000512s : 1: loop_unroll 0.33% : 0.000836s : 1: mutable_eliminate 0.87% : 0.002230s : 26: opt.transform.jit_opt_a 6.32% : 0.016137s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000967s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.02% : 0.000053s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000026s : 1: remove_dup_value 1.04% : 0.002644s : 1: renormalize.infer 0.42% : 0.001063s : 1: renormalize.specialize 0.01% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.06% : 0.000164s : 1: rewriter_before_opt_a 0.04% : 0.000110s : 1: symbol_engine_optimizer 79.03% : 0.201688s : 1: type_inference TotalTime = 0.0389404, [30] [bootstrap]: 0.000388 [type_inference]: 0.0289398 [event_method]: 2.175e-05 [auto_monad]: 7.169e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00017407 [rewriter_before_opt_a]: 8.953e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00688826, [2] [Cycle 1]: 0.0022143, [27] [switch_simplify]: 6.429e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00057631 [with_stream_mark]: 2.219e-05 [recompute_prepare]: 7.67998e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.415e-05 [j_node_and_user_rematch]: 9.52999e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00116515 [add_forward_monad_depend]: 1.34e-05 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.516e-05 [cse]: 3.424e-05 [replace_applicator]: 1.309e-05 [Cycle 2]: 0.00035133, [27] [switch_simplify]: 6.05002e-06 [loop_unroll]: 5.69e-06 [a_1]: 9.082e-05 [with_stream_mark]: 9.56998e-06 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.83998e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.566e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.05999e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.16999e-06 [cse]: 2.103e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.364e-05 [rewriter_after_opt_a]: 8.69e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00064148 [jit_opt_b]: 5.067e-05, [1] [Cycle 1]: 4.273e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.628e-05 [cconv]: 2.824e-05 [loop_unroll]: 0.00043834 [jit_opt_after_cconv]: 0.00015002, [1] [Cycle 1]: 0.00014354, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.696e-05 [call_graph_tuple_transform]: 2.047e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.53998e-06 [environ_conv]: 6.14999e-06 [add_recomputation]: 6.133e-05 [cse_after_recomputation]: 2.214e-05, [1] [Cycle 1]: 1.701e-05, [1] [cse]: 1.148e-05 [auto_monad_reorder]: 1.759e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 5.04998e-06 [opt_after_jit_grad]: 0.0004575 [symbol_engine_optimizer]: 0.00010479, [1] [Cycle 1]: 9.822e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 3.607e-05 [elim_not_effective]: 1.391e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 9.92999e-06 [renormalize]: 5.19998e-07 [validate]: 4.48e-05 Sums bootstrap : 0.000388s : 1.14% type_inference : 0.028940s : 85.10% event_method : 0.000022s : 0.06% auto_monad : 0.000072s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000174s : 0.51% rewriter_before_opt_a : 0.000090s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.21% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000667s : 1.96% jit_opt_a.with_stream_mark : 0.000032s : 0.09% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001165s : 3.43% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000055s : 0.16% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000087s : 0.26% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000641s : 1.89% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000028s : 0.08% loop_unroll : 0.000438s : 1.29% jit_opt_after_cconv.c_1 : 0.000020s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000061s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.03% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000457s : 1.35% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000036s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.13% Time group info: ------[substitution.] 0.000236 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000006s : 3: substitution.graph_param_transform 85.22% : 0.000201s : 4: substitution.inline 1.58% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 5.24% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028844 2 93.31% : 0.026914s : 1: type_inference.infer 6.69% : 0.001931s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.66% : 0.000052s : 4: replace.inline 30.34% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.65% : 0.000199s : 4: match.inline 5.35% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.06% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.99% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.33% : 0.000002s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004678 13 88.11% : 0.004122s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.09% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 10.80% : 0.000505s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041086 72 0.16% : 0.000065s : 1: add_recomputation 0.18% : 0.000075s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 1.00% : 0.000409s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 16.77% : 0.006892s : 1: jit_opt_a 0.37% : 0.000153s : 1: jit_opt_after_cconv 0.13% : 0.000053s : 1: jit_opt_b 1.09% : 0.000447s : 1: loop_unroll 1.58% : 0.000651s : 1: mutable_eliminate 2.21% : 0.000908s : 26: opt.transform.jit_opt_a 0.12% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000063s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000465s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000178s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.60% : 0.000659s : 1: renormalize.infer 1.21% : 0.000498s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000090s : 1: rewriter_after_opt_a 0.23% : 0.000094s : 1: rewriter_before_opt_a 0.26% : 0.000107s : 1: symbol_engine_optimizer 70.49% : 0.028961s : 1: type_inference TotalTime = 0.11769, [30] [bootstrap]: 0.00030897 [type_inference]: 0.107169 [event_method]: 2.225e-05 [auto_monad]: 7.151e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.78998e-06 [py_interpret_to_execute]: 0.00028378 [rewriter_before_opt_a]: 8.556e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0073934, [2] [Cycle 1]: 0.00349092, [27] [switch_simplify]: 6.111e-05 [loop_unroll]: 2.925e-05 [a_1]: 0.0006297 [with_stream_mark]: 2.337e-05 [recompute_prepare]: 1.023e-05 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 7.23999e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 1.265e-05 [inline_without_move]: 6.86001e-06 [renormalize]: 0.00235186 [add_forward_monad_depend]: 8.80999e-06 [auto_monad_grad]: 3.2e-06 [auto_monad_eliminator]: 1.779e-05 [cse]: 3.16e-05 [replace_applicator]: 1.984e-05 [Cycle 2]: 0.00038069, [27] [switch_simplify]: 7.16001e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.00012017 [with_stream_mark]: 1.242e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 9.93998e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.38997e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 6.55002e-06 [cse]: 1.273e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.262e-05 [rewriter_after_opt_a]: 3.843e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00066669 [jit_opt_b]: 5.491e-05, [1] [Cycle 1]: 4.723e-05, [2] [frontend_op_eliminate]: 1.941e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 2.985e-05 [loop_unroll]: 0.00044835 [jit_opt_after_cconv]: 0.0001561, [1] [Cycle 1]: 0.0001494, [11] [c_1]: 2.464e-05 [parameter_eliminate]: 3.24001e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.7e-05 [call_graph_tuple_transform]: 2.064e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 7.71999e-06 [add_recomputation]: 5.076e-05 [cse_after_recomputation]: 2.335e-05, [1] [Cycle 1]: 1.777e-05, [1] [cse]: 1.175e-05 [auto_monad_reorder]: 1.484e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.14e-06 [opt_after_jit_grad]: 0.0004927 [symbol_engine_optimizer]: 7.938e-05, [1] [Cycle 1]: 7.228e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 8.00006e-07 [validate]: 3.999e-05 Sums bootstrap : 0.000309s : 0.27% type_inference : 0.107169s : 94.40% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000284s : 0.25% rewriter_before_opt_a : 0.000086s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000750s : 0.66% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002352s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000667s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000448s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000493s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000255 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 4: substitution.graph_param_transform 85.43% : 0.000218s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 2.48% : 0.000006s : 2: substitution.replace_old_param 4.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107072 2 97.94% : 0.104863s : 1: type_inference.infer 2.06% : 0.002209s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.63% : 0.000053s : 4: replace.inline 31.37% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 95.15% : 0.000215s : 4: match.inline 4.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.33% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.35% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 6.28% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.11% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000001s : 12: predicate.print_const_string_wrapper 2.15% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.92% : 0.000004s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002468 26 70.76% : 0.001747s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.25% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.99% : 0.000666s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121108 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.27% : 0.000324s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.11% : 0.007397s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.38% : 0.000457s : 1: loop_unroll 0.56% : 0.000676s : 1: mutable_eliminate 0.82% : 0.000999s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000502s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000290s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.32% : 0.001601s : 1: renormalize.infer 0.61% : 0.000739s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.51% : 0.107197s : 1: type_inference TotalTime = 0.0319491, [30] [bootstrap]: 0.00031642 [type_inference]: 0.0220198 [event_method]: 2.177e-05 [auto_monad]: 0.00010099 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00013753 [rewriter_before_opt_a]: 8.76e-05 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.00623183, [2] [Cycle 1]: 0.00233945, [27] [switch_simplify]: 6.17e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00064969 [with_stream_mark]: 2.204e-05 [recompute_prepare]: 8.44002e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00121216 [add_forward_monad_depend]: 8.10999e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.793e-05 [cse]: 2.552e-05 [replace_applicator]: 2.06e-05 [Cycle 2]: 0.00034884, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.84e-06 [a_1]: 9.795e-05 [with_stream_mark]: 1.433e-05 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 8.51002e-06 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 4.82e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 1.15001e-06 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.301e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.54e-05 [rewriter_after_opt_a]: 3.87e-05 [convert_after_rewriter]: 6.43e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00076605 [jit_opt_b]: 5.544e-05, [1] [Cycle 1]: 4.809e-05, [2] [frontend_op_eliminate]: 1.786e-05 [inline_after_opt_a]: 1.829e-05 [cconv]: 2.783e-05 [loop_unroll]: 0.0008416 [jit_opt_after_cconv]: 0.00017424, [1] [Cycle 1]: 0.00016614, [11] [c_1]: 2.459e-05 [parameter_eliminate]: 4.43999e-06 [updatestate_depend_eliminate]: 7.82e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 3.592e-05 [call_graph_tuple_transform]: 2.291e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.46002e-06 [remove_dup_value]: 1.804e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 6.96001e-06 [add_recomputation]: 5.109e-05 [cse_after_recomputation]: 5.703e-05, [1] [Cycle 1]: 1.788e-05, [1] [cse]: 1.244e-05 [auto_monad_reorder]: 1.956e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 7.31001e-06 [opt_after_jit_grad]: 0.00061515 [symbol_engine_optimizer]: 8.053e-05, [1] [Cycle 1]: 7.293e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 8.78001e-06 [elim_not_effective]: 1.527e-05 [opt_reshape]: 6.36998e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 5.39992e-07 [validate]: 4.489e-05 Sums bootstrap : 0.000316s : 1.14% type_inference : 0.022020s : 79.34% event_method : 0.000022s : 0.08% auto_monad : 0.000101s : 0.36% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000138s : 0.50% rewriter_before_opt_a : 0.000088s : 0.32% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000748s : 2.69% jit_opt_a.with_stream_mark : 0.000036s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001212s : 4.37% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000039s : 0.14% jit_opt_a.replace_applicator : 0.000026s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000766s : 2.76% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000028s : 0.10% loop_unroll : 0.000842s : 3.03% jit_opt_after_cconv.c_1 : 0.000025s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000051s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000615s : 2.22% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000252 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000006s : 3: substitution.graph_param_transform 85.04% : 0.000215s : 4: substitution.inline 1.75% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 2.08% : 0.000005s : 2: substitution.replace_old_param 4.99% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021942 2 92.71% : 0.020341s : 1: type_inference.infer 7.29% : 0.001600s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.63% : 0.000055s : 4: replace.inline 29.37% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.89% : 0.000212s : 4: match.inline 5.11% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 2.20% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.35% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.22% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.31% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.82% : 0.000007s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.71% : 0.000002s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 10: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.16% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.82% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000893 13 42.84% : 0.000383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.72% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.44% : 0.000460s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034540 72 0.16% : 0.000054s : 1: add_recomputation 0.31% : 0.000105s : 1: auto_monad 0.07% : 0.000023s : 1: auto_monad_reorder 0.97% : 0.000334s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000059s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.05% : 0.006236s : 1: jit_opt_a 0.51% : 0.000177s : 1: jit_opt_after_cconv 0.17% : 0.000058s : 1: jit_opt_b 2.47% : 0.000852s : 1: loop_unroll 2.25% : 0.000776s : 1: mutable_eliminate 2.85% : 0.000984s : 26: opt.transform.jit_opt_a 0.16% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.99% : 0.000342s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.81% : 0.000625s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000142s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.92% : 0.000665s : 1: renormalize.infer 1.56% : 0.000537s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000041s : 1: rewriter_after_opt_a 0.26% : 0.000091s : 1: rewriter_before_opt_a 0.24% : 0.000083s : 1: symbol_engine_optimizer 63.79% : 0.022035s : 1: type_inference TotalTime = 0.0304399, [30] [bootstrap]: 0.0003592 [type_inference]: 0.0218902 [event_method]: 1.987e-05 [auto_monad]: 7.324e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 0.00011019 [rewriter_before_opt_a]: 8.238e-05 [expand_dump_flag]: 2.87002e-06 [jit_opt_a]: 0.00578028, [2] [Cycle 1]: 0.00204768, [27] [switch_simplify]: 5.662e-05 [loop_unroll]: 3.243e-05 [a_1]: 0.00057112 [with_stream_mark]: 2.16e-05 [recompute_prepare]: 8.33001e-06 [updatestate_depend_eliminate]: 3.60998e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.534e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00102375 [add_forward_monad_depend]: 5.44998e-06 [auto_monad_grad]: 2.19999e-06 [auto_monad_eliminator]: 1.479e-05 [cse]: 3.376e-05 [replace_applicator]: 1.292e-05 [Cycle 2]: 0.00032475, [27] [switch_simplify]: 6.10002e-06 [loop_unroll]: 5.09e-06 [a_1]: 8.993e-05 [with_stream_mark]: 8.77e-06 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.316e-05 [j_node_and_user_rematch]: 7.75998e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 7.21001e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.355e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.206e-05 [rewriter_after_opt_a]: 4.043e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 4.84998e-06 [mutable_eliminate]: 0.00054477 [jit_opt_b]: 5.21e-05, [1] [Cycle 1]: 4.458e-05, [2] [frontend_op_eliminate]: 1.593e-05 [inline_after_opt_a]: 1.697e-05 [cconv]: 2.548e-05 [loop_unroll]: 0.00042839 [jit_opt_after_cconv]: 0.00014096, [1] [Cycle 1]: 0.00013494, [11] [c_1]: 2.071e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.31998e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.218e-05 [call_graph_tuple_transform]: 1.846e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.51002e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.567e-05 [partial_unused_args_eliminate]: 1.97999e-06 [environ_conv]: 5.97001e-06 [add_recomputation]: 5.524e-05 [cse_after_recomputation]: 2.215e-05, [1] [Cycle 1]: 1.699e-05, [1] [cse]: 1.132e-05 [auto_monad_reorder]: 1.718e-05 [get_jit_bprop_graph]: 1.86003e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.00044466 [symbol_engine_optimizer]: 6.988e-05, [1] [Cycle 1]: 6.407e-05, [6] [build]: 3.48999e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.179e-05 [opt_reshape]: 6.07001e-06 [fold_const_symbol]: 8.73001e-06 [renormalize]: 4.00003e-07 [validate]: 3.683e-05 Sums bootstrap : 0.000359s : 1.36% type_inference : 0.021890s : 82.79% event_method : 0.000020s : 0.08% auto_monad : 0.000073s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000110s : 0.42% rewriter_before_opt_a : 0.000082s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.24% jit_opt_a.loop_unroll : 0.000038s : 0.14% jit_opt_a.a_1 : 0.000661s : 2.50% jit_opt_a.with_stream_mark : 0.000030s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001024s : 3.87% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000047s : 0.18% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000545s : 2.06% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000025s : 0.10% loop_unroll : 0.000428s : 1.62% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000055s : 0.21% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000445s : 1.68% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.14% Time group info: ------[substitution.] 0.000218 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000005s : 3: substitution.graph_param_transform 85.03% : 0.000185s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 5.68% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021816 2 92.63% : 0.020208s : 1: type_inference.infer 7.37% : 0.001608s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.00% : 0.000050s : 4: replace.inline 31.00% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.16% : 0.000182s : 4: match.inline 5.84% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.40% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.23% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.74% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.99% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000911 13 46.85% : 0.000427s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.16% : 0.000439s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032400 72 0.18% : 0.000058s : 1: add_recomputation 0.24% : 0.000077s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.18% : 0.000383s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.85% : 0.005784s : 1: jit_opt_a 0.44% : 0.000143s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.35% : 0.000436s : 1: loop_unroll 1.71% : 0.000553s : 1: mutable_eliminate 2.72% : 0.000881s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000452s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000114s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.84% : 0.000597s : 1: renormalize.infer 1.29% : 0.000419s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.27% : 0.000086s : 1: rewriter_before_opt_a 0.22% : 0.000072s : 1: symbol_engine_optimizer 67.62% : 0.021908s : 1: type_inference TotalTime = 0.141844, [30] [bootstrap]: 0.00031217 [type_inference]: 0.128065 [event_method]: 2.186e-05 [auto_monad]: 6.889e-05 [graph_reusing]: 6.28998e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00047813 [rewriter_before_opt_a]: 0.0001063 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00894823, [2] [Cycle 1]: 0.00514454, [27] [switch_simplify]: 6.161e-05 [loop_unroll]: 0.00078805 [a_1]: 0.00072125 [with_stream_mark]: 1.752e-05 [recompute_prepare]: 9.42999e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 6.96001e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.83e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.612e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.52001e-06 [renormalize]: 0.00313251 [add_forward_monad_depend]: 1.056e-05 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.153e-05 [cse]: 4.094e-05 [replace_applicator]: 2.354e-05 [Cycle 2]: 0.00043155, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 6.75002e-06 [a_1]: 0.00013352 [with_stream_mark]: 1.633e-05 [recompute_prepare]: 7.15e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 5.38002e-06 [cell_reuse_recompute_pass]: 3.26999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.022e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 5.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 1.35999e-06 [auto_monad_eliminator]: 8.62e-06 [cse]: 1.869e-05 [replace_applicator]: 7.23e-06 [py_interpret_to_execute_after_opt_a]: 1.955e-05 [rewriter_after_opt_a]: 4.388e-05 [convert_after_rewriter]: 8.26002e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00084258 [jit_opt_b]: 0.0001465, [1] [Cycle 1]: 0.0001355, [2] [frontend_op_eliminate]: 9.646e-05 [inline_after_opt_a]: 2.068e-05 [cconv]: 6.835e-05 [loop_unroll]: 0.00052292 [jit_opt_after_cconv]: 0.00018847, [1] [Cycle 1]: 0.00017918, [11] [c_1]: 2.784e-05 [parameter_eliminate]: 3.5e-06 [updatestate_depend_eliminate]: 8.72998e-06 [updatestate_assign_eliminate]: 4.75999e-06 [updatestate_loads_eliminate]: 3.09999e-06 [cse]: 3.68e-05 [call_graph_tuple_transform]: 2.379e-05 [tuple_list_get_item_eliminator]: 7.08998e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 1.29e-06 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.927e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 1.053e-05 [add_recomputation]: 5.364e-05 [cse_after_recomputation]: 2.825e-05, [1] [Cycle 1]: 2.125e-05, [1] [cse]: 1.513e-05 [auto_monad_reorder]: 1.824e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.64999e-06 [opt_after_jit_grad]: 0.00053633 [symbol_engine_optimizer]: 8.434e-05, [1] [Cycle 1]: 7.832e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 9.34e-06 [elim_not_effective]: 1.555e-05 [opt_reshape]: 6.91999e-06 [fold_const_symbol]: 1.09e-05 [renormalize]: 5.79981e-07 [validate]: 0.00095004 Sums bootstrap : 0.000312s : 0.23% type_inference : 0.128065s : 93.00% event_method : 0.000022s : 0.02% auto_monad : 0.000069s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000478s : 0.35% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000795s : 0.58% jit_opt_a.a_1 : 0.000855s : 0.62% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003133s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000060s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000843s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000096s : 0.07% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000068s : 0.05% loop_unroll : 0.000523s : 0.38% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000536s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000950s : 0.69% Time group info: ------[substitution.] 0.000269 25 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000007s : 4: substitution.graph_param_transform 85.64% : 0.000230s : 5: substitution.inline 1.97% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 4.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127985 2 97.67% : 0.125008s : 1: type_inference.infer 2.33% : 0.002977s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.45% : 0.000074s : 5: replace.inline 31.55% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 7 95.23% : 0.000227s : 5: match.inline 4.77% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 19: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 5.26% : 0.000008s : 40: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 1.73% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.70% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.43% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.86% : 0.000010s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.91% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002602 25 63.31% : 0.001647s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.52% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.18% : 0.000889s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146093 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000072s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.23% : 0.000333s : 1: bootstrap 0.05% : 0.000072s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.13% : 0.008952s : 1: jit_opt_a 0.13% : 0.000191s : 1: jit_opt_after_cconv 0.10% : 0.000150s : 1: jit_opt_b 0.36% : 0.000531s : 1: loop_unroll 0.59% : 0.000856s : 1: mutable_eliminate 1.28% : 0.001875s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000110s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.05% : 0.000078s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000545s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000487s : 1: py_interpret_to_execute 0.02% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.47% : 0.002147s : 1: renormalize.infer 0.67% : 0.000973s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.06% : 0.000091s : 1: symbol_engine_optimizer 87.67% : 0.128082s : 1: type_inference TotalTime = 0.0318257, [30] [bootstrap]: 0.00029539 [type_inference]: 0.0235601 [event_method]: 2.011e-05 [auto_monad]: 6.621e-05 [graph_reusing]: 5.45001e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00010802 [rewriter_before_opt_a]: 8.203e-05 [expand_dump_flag]: 3.37997e-06 [jit_opt_a]: 0.00542793, [2] [Cycle 1]: 0.00186695, [27] [switch_simplify]: 5.206e-05 [loop_unroll]: 2.932e-05 [a_1]: 0.00051503 [with_stream_mark]: 1.902e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.63e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.88998e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00091653 [add_forward_monad_depend]: 5.84999e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 3.309e-05 [replace_applicator]: 1.202e-05 [Cycle 2]: 0.00032139, [27] [switch_simplify]: 5.58997e-06 [loop_unroll]: 4.92e-06 [a_1]: 8.838e-05 [with_stream_mark]: 9.32999e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.06002e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.348e-05 [j_node_and_user_rematch]: 7.83001e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.20002e-06 [cse]: 1.373e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.233e-05 [rewriter_after_opt_a]: 3.842e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00060605 [jit_opt_b]: 4.981e-05, [1] [Cycle 1]: 4.307e-05, [2] [frontend_op_eliminate]: 1.559e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.682e-05 [loop_unroll]: 0.00042036 [jit_opt_after_cconv]: 0.00014276, [1] [Cycle 1]: 0.00013646, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 2.79999e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.29e-05 [call_graph_tuple_transform]: 1.806e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.455e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 5.69999e-06 [add_recomputation]: 7.926e-05 [cse_after_recomputation]: 2.405e-05, [1] [Cycle 1]: 1.863e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 2.28002e-06 [rewriter_after_jit_bprop_graph]: 5.13002e-06 [opt_after_jit_grad]: 0.00049743 [symbol_engine_optimizer]: 6.963e-05, [1] [Cycle 1]: 6.365e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 7.57998e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 5.53002e-06 [fold_const_symbol]: 7.95998e-06 [renormalize]: 2.50002e-07 [validate]: 5.058e-05 Sums bootstrap : 0.000295s : 1.05% type_inference : 0.023560s : 84.12% event_method : 0.000020s : 0.07% auto_monad : 0.000066s : 0.24% graph_reusing : 0.000005s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000108s : 0.39% rewriter_before_opt_a : 0.000082s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.21% jit_opt_a.loop_unroll : 0.000034s : 0.12% jit_opt_a.a_1 : 0.000603s : 2.15% jit_opt_a.with_stream_mark : 0.000028s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000917s : 3.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000047s : 0.17% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000038s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000606s : 2.16% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000420s : 1.50% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000079s : 0.28% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000497s : 1.78% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.18% Time group info: ------[substitution.] 0.000196 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 3: substitution.graph_param_transform 82.80% : 0.000162s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.58% : 0.000005s : 2: substitution.replace_old_param 6.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023486 2 93.08% : 0.021861s : 1: type_inference.infer 6.92% : 0.001625s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.14% : 0.000046s : 4: replace.inline 31.86% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 93.53% : 0.000159s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.64% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.52% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.99% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.87% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000848 13 45.27% : 0.000384s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.36% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.37% : 0.000427s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033598 72 0.25% : 0.000083s : 1: add_recomputation 0.21% : 0.000069s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.94% : 0.000315s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.16% : 0.005431s : 1: jit_opt_a 0.43% : 0.000145s : 1: jit_opt_after_cconv 0.16% : 0.000052s : 1: jit_opt_b 1.28% : 0.000429s : 1: loop_unroll 1.83% : 0.000615s : 1: mutable_eliminate 2.43% : 0.000815s : 26: opt.transform.jit_opt_a 0.14% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000030s : 4: opt.transform.symbol_engine_opt 1.50% : 0.000505s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000112s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.59% : 0.000533s : 1: renormalize.infer 1.12% : 0.000375s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000041s : 1: rewriter_after_opt_a 0.26% : 0.000086s : 1: rewriter_before_opt_a 0.22% : 0.000072s : 1: symbol_engine_optimizer 70.17% : 0.023576s : 1: type_inference TotalTime = 0.116201, [30] [bootstrap]: 0.0003618 [type_inference]: 0.0961868 [event_method]: 0.0004768 [auto_monad]: 0.00018104 [graph_reusing]: 2.554e-05 [pre_auto_parallel]: 3.95e-06 [py_interpret_to_execute]: 5.316e-05 [rewriter_before_opt_a]: 0.00016076 [expand_dump_flag]: 4.16001e-06 [jit_opt_a]: 0.0162953, [2] [Cycle 1]: 0.0115871, [27] [switch_simplify]: 0.00019956 [loop_unroll]: 5.316e-05 [a_1]: 0.00157 [with_stream_mark]: 1.675e-05 [recompute_prepare]: 8.79998e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 9.76998e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00932493 [add_forward_monad_depend]: 9.20001e-06 [auto_monad_grad]: 3.17002e-06 [auto_monad_eliminator]: 1.869e-05 [cse]: 3.521e-05 [replace_applicator]: 2.269e-05 [Cycle 2]: 0.00038527, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 6.39001e-06 [a_1]: 0.00011581 [with_stream_mark]: 1.518e-05 [recompute_prepare]: 5.70001e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.54998e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 3.33e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.952e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.327e-05 [replace_applicator]: 5.94999e-06 [py_interpret_to_execute_after_opt_a]: 1.428e-05 [rewriter_after_opt_a]: 3.985e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00077867 [jit_opt_b]: 5.641e-05, [1] [Cycle 1]: 4.887e-05, [2] [frontend_op_eliminate]: 1.947e-05 [inline_after_opt_a]: 1.702e-05 [cconv]: 2.787e-05 [loop_unroll]: 0.00045806 [jit_opt_after_cconv]: 0.0001599, [1] [Cycle 1]: 0.00015276, [11] [c_1]: 2.424e-05 [parameter_eliminate]: 3.45e-06 [updatestate_depend_eliminate]: 5.82001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.579e-05 [call_graph_tuple_transform]: 2.015e-05 [tuple_list_get_item_eliminator]: 5.66998e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 7.90023e-07 [switch_simplify]: 7.28999e-06 [remove_dup_value]: 1.616e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 6.46999e-06 [add_recomputation]: 4.984e-05 [cse_after_recomputation]: 2.502e-05, [1] [Cycle 1]: 1.988e-05, [1] [cse]: 1.389e-05 [auto_monad_reorder]: 1.768e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 5.61998e-06 [opt_after_jit_grad]: 0.00046874 [symbol_engine_optimizer]: 8.047e-05, [1] [Cycle 1]: 7.41e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.74998e-06 [elim_not_effective]: 1.409e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 1.037e-05 [renormalize]: 4.09986e-07 [validate]: 3.895e-05 Sums bootstrap : 0.000362s : 0.33% type_inference : 0.096187s : 86.50% event_method : 0.000477s : 0.43% auto_monad : 0.000181s : 0.16% graph_reusing : 0.000026s : 0.02% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000053s : 0.05% rewriter_before_opt_a : 0.000161s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000206s : 0.19% jit_opt_a.loop_unroll : 0.000060s : 0.05% jit_opt_a.a_1 : 0.001686s : 1.52% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.009325s : 8.39% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000779s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000458s : 0.41% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000469s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000674 35 0.32% : 0.000002s : 2: substitution.elim_not_effective 0.34% : 0.000002s : 2: substitution.fold_const_symbol 0.86% : 0.000006s : 3: substitution.graph_param_transform 91.28% : 0.000615s : 12: substitution.inline 0.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.73% : 0.000005s : 4: substitution.remove_not_recompute_node 0.60% : 0.000004s : 2: substitution.replace_old_param 1.47% : 0.000010s : 1: substitution.reshape_eliminate 2.08% : 0.000014s : 3: substitution.switch_simplify 1.68% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.096092 2 95.39% : 0.091663s : 1: type_inference.infer 4.61% : 0.004429s : 1: type_inference.specialize ------[replace.] 0.000356 18 51.25% : 0.000183s : 12: replace.inline 1.31% : 0.000005s : 1: replace.reshape_eliminate 19.12% : 0.000068s : 3: replace.switch_simplify 28.32% : 0.000101s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000640 18 95.13% : 0.000609s : 12: match.inline 1.40% : 0.000009s : 1: match.reshape_eliminate 1.88% : 0.000012s : 3: match.switch_simplify 1.60% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000208 1212 1.49% : 0.000003s : 19: predicate.accumulaten_eliminater 0.66% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 19: predicate.addn_check_dump 1.45% : 0.000003s : 19: predicate.addn_zero_filter 2.10% : 0.000004s : 19: predicate.arithmetic_simplify 1.50% : 0.000003s : 20: predicate.cast_eliminate 0.24% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000003s : 19: predicate.compare_switch_simplify 1.23% : 0.000003s : 19: predicate.depend_value_elim 1.31% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.47% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.56% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.50% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.41% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.24% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.37% : 0.000003s : 20: predicate.environ_get_depend_swap 1.61% : 0.000003s : 20: predicate.environ_get_eliminate 1.42% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.73% : 0.000002s : 6: predicate.get_grad_eliminate 0.13% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000011s : 40: predicate.inline 0.52% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.90% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.80% : 0.000004s : 25: predicate.load_eliminater 0.74% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.98% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 19: predicate.merge_addn 1.18% : 0.000002s : 19: predicate.minmaximum_grad 1.14% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000005s : 25: predicate.partial_eliminate 1.54% : 0.000003s : 19: predicate.print_const_string_wrapper 1.84% : 0.000004s : 19: predicate.reduce_eliminate 1.45% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.37% : 0.000001s : 6: predicate.remove_not_recompute_node 1.55% : 0.000003s : 28: predicate.replace_applicator 0.39% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.74% : 0.000004s : 20: predicate.reshape_eliminate 1.39% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.76% : 0.000002s : 3: predicate.row_tensor_eliminate 1.28% : 0.000003s : 19: predicate.same_eliminate 0.28% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.68% : 0.000001s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.85% : 0.000004s : 19: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.25% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.71% : 0.000008s : 34: predicate.switch_defer_inline 2.53% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.23% : 0.000017s : 107: predicate.switch_simplify 1.54% : 0.000003s : 19: predicate.tile_eliminate 1.25% : 0.000003s : 19: predicate.transpose_eliminate 2.07% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.07% : 0.000006s : 28: predicate.tuple_list_get_item_eliminator 1.86% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.67% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.65% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.48% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.94% : 0.000004s : 19: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.006808 40 74.23% : 0.005054s : 21: func_graph_cloner_run.FuncGraphClonerGraph 5.06% : 0.000344s : 5: func_graph_cloner_run.FuncGraphClonerNode 20.71% : 0.001410s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127680 72 0.04% : 0.000052s : 1: add_recomputation 0.15% : 0.000188s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.30% : 0.000378s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.38% : 0.000485s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000029s : 1: graph_reusing 12.77% : 0.016300s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000466s : 1: loop_unroll 0.62% : 0.000788s : 1: mutable_eliminate 1.64% : 0.002091s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000057s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 6.37% : 0.008135s : 1: renormalize.infer 0.92% : 0.001177s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.13% : 0.000165s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 75.35% : 0.096204s : 1: type_inference TotalTime = 0.0679339, [30] [bootstrap]: 0.00032038 [type_inference]: 0.057599 [event_method]: 1.97e-05 [auto_monad]: 6.725e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00029542 [rewriter_before_opt_a]: 8.37e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00721522, [2] [Cycle 1]: 0.0034109, [27] [switch_simplify]: 6.007e-05 [loop_unroll]: 2.962e-05 [a_1]: 0.000602 [with_stream_mark]: 2.098e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.86999e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.78002e-06 [inline_without_move]: 6.33e-06 [renormalize]: 0.00233875 [add_forward_monad_depend]: 7.14001e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.809e-05 [cse]: 3.16e-05 [replace_applicator]: 1.902e-05 [Cycle 2]: 0.00037711, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00012486 [with_stream_mark]: 1.277e-05 [recompute_prepare]: 6.64001e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.58997e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.15998e-06 [cell_reuse_recompute_pass]: 3.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.654e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.56997e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.072e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.356e-05 [rewriter_after_opt_a]: 3.562e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00068495 [jit_opt_b]: 5.701e-05, [1] [Cycle 1]: 4.915e-05, [2] [frontend_op_eliminate]: 1.969e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 2.665e-05 [loop_unroll]: 0.0004224 [jit_opt_after_cconv]: 0.000151, [1] [Cycle 1]: 0.00014512, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 3.11001e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 2.214e-05 [call_graph_tuple_transform]: 2.04e-05 [tuple_list_get_item_eliminator]: 6.15002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.533e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 8.48001e-06 [add_recomputation]: 4.798e-05 [cse_after_recomputation]: 2.179e-05, [1] [Cycle 1]: 1.709e-05, [1] [cse]: 1.152e-05 [auto_monad_reorder]: 1.475e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00045066 [symbol_engine_optimizer]: 0.00010173, [1] [Cycle 1]: 9.547e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 9.58002e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 8.99e-06 [renormalize]: 2.80008e-07 [validate]: 6.576e-05 Sums bootstrap : 0.000320s : 0.50% type_inference : 0.057599s : 90.16% event_method : 0.000020s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000295s : 0.46% rewriter_before_opt_a : 0.000084s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000727s : 1.14% jit_opt_a.with_stream_mark : 0.000034s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002339s : 3.66% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000685s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000422s : 0.66% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000451s : 0.71% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000066s : 0.10% Time group info: ------[substitution.] 0.000234 24 1.08% : 0.000003s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 4: substitution.graph_param_transform 84.50% : 0.000198s : 4: substitution.inline 1.83% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 5.10% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057521 2 96.21% : 0.055339s : 1: type_inference.infer 3.79% : 0.002182s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.16% : 0.000052s : 4: replace.inline 30.84% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.73% : 0.000195s : 4: match.inline 5.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.73% : 0.000002s : 12: predicate.arithmetic_simplify 1.48% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.49% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.81% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.61% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.74% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.56% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.14% : 0.000010s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002390 26 68.65% : 0.001641s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.10% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.26% : 0.000699s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071279 72 0.07% : 0.000051s : 1: add_recomputation 0.10% : 0.000071s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.48% : 0.000339s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.13% : 0.007218s : 1: jit_opt_a 0.22% : 0.000153s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.60% : 0.000430s : 1: loop_unroll 0.97% : 0.000695s : 1: mutable_eliminate 1.36% : 0.000967s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.64% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000301s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.28% : 0.001623s : 1: renormalize.infer 0.99% : 0.000705s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000038s : 1: rewriter_after_opt_a 0.12% : 0.000089s : 1: rewriter_before_opt_a 0.15% : 0.000104s : 1: symbol_engine_optimizer 80.83% : 0.057615s : 1: type_inference TotalTime = 0.0146185, [30] [bootstrap]: 0.00032408 [type_inference]: 0.00646587 [event_method]: 1.974e-05 [auto_monad]: 6.625e-05 [graph_reusing]: 5.25999e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 3.754e-05 [rewriter_before_opt_a]: 7.303e-05 [expand_dump_flag]: 2.91e-06 [jit_opt_a]: 0.00549068, [2] [Cycle 1]: 0.00175892, [27] [switch_simplify]: 9.634e-05 [loop_unroll]: 2.992e-05 [a_1]: 0.00055765 [with_stream_mark]: 2.194e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.12e-06 [renormalize]: 0.00072251 [add_forward_monad_depend]: 5.49e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.375e-05 [cse]: 3.301e-05 [replace_applicator]: 1.111e-05 [Cycle 2]: 0.00031101, [27] [switch_simplify]: 5.39e-06 [loop_unroll]: 5.11002e-06 [a_1]: 8.686e-05 [with_stream_mark]: 9.04e-06 [recompute_prepare]: 4.77e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 8.49977e-07 [specialize_transform]: 4.82e-06 [updatestate_useless_node_eliminater]: 4.68001e-06 [accelerated_algorithm]: 5.23002e-06 [meta_shard_fg_expand]: 1.11002e-06 [get_grad_eliminate_]: 4.42998e-06 [merge_forward]: 2.44999e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.216e-05 [j_node_and_user_rematch]: 7.65998e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 6.98998e-06 [inline_without_move]: 4.67e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.12001e-06 [cse]: 1.238e-05 [replace_applicator]: 5.46998e-06 [py_interpret_to_execute_after_opt_a]: 1.211e-05 [rewriter_after_opt_a]: 3.543e-05 [convert_after_rewriter]: 6.24001e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00056208 [jit_opt_b]: 4.788e-05, [1] [Cycle 1]: 4.046e-05, [2] [frontend_op_eliminate]: 1.459e-05 [inline_after_opt_a]: 1.562e-05 [cconv]: 2.741e-05 [loop_unroll]: 0.0003989 [jit_opt_after_cconv]: 0.00014527, [1] [Cycle 1]: 0.00013915, [11] [c_1]: 1.983e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 7.59002e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.484e-05 [call_graph_tuple_transform]: 1.879e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.07e-06 [remove_dup_value]: 1.534e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 5.38002e-06 [add_recomputation]: 5.471e-05 [cse_after_recomputation]: 2.332e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.736e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.00042609 [symbol_engine_optimizer]: 6.991e-05, [1] [Cycle 1]: 6.415e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 7.15e-06 [elim_not_effective]: 1.291e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 5.39992e-07 [validate]: 9.274e-05 Sums bootstrap : 0.000324s : 3.05% type_inference : 0.006466s : 60.87% event_method : 0.000020s : 0.19% auto_monad : 0.000066s : 0.62% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.35% rewriter_before_opt_a : 0.000073s : 0.69% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000102s : 0.96% jit_opt_a.loop_unroll : 0.000035s : 0.33% jit_opt_a.a_1 : 0.000645s : 6.07% jit_opt_a.with_stream_mark : 0.000031s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000723s : 6.80% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.19% jit_opt_a.cse : 0.000045s : 0.43% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000035s : 0.33% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000562s : 5.29% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000027s : 0.26% loop_unroll : 0.000399s : 3.76% jit_opt_after_cconv.c_1 : 0.000020s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000055s : 0.52% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000426s : 4.01% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000093s : 0.87% Time group info: ------[substitution.] 0.000229 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 3: substitution.graph_param_transform 85.50% : 0.000196s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.42% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006399 2 84.63% : 0.005416s : 1: type_inference.infer 15.37% : 0.000983s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.99% : 0.000049s : 4: replace.inline 32.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.49% : 0.000194s : 4: match.inline 5.51% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.53% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.56% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.23% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.88% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.27% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000658 13 51.27% : 0.000337s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.35% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.38% : 0.000272s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016227 72 0.36% : 0.000058s : 1: add_recomputation 0.43% : 0.000070s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 2.11% : 0.000342s : 1: bootstrap 0.18% : 0.000030s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 33.86% : 0.005494s : 1: jit_opt_a 0.91% : 0.000148s : 1: jit_opt_after_cconv 0.31% : 0.000050s : 1: jit_opt_b 2.51% : 0.000407s : 1: loop_unroll 3.52% : 0.000571s : 1: mutable_eliminate 5.51% : 0.000894s : 26: opt.transform.jit_opt_a 0.28% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.68% : 0.000434s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.51% : 0.000407s : 1: renormalize.infer 1.90% : 0.000308s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000039s : 1: rewriter_after_opt_a 0.47% : 0.000076s : 1: rewriter_before_opt_a 0.45% : 0.000072s : 1: symbol_engine_optimizer 39.95% : 0.006482s : 1: type_inference TotalTime = 0.0327015, [30] [bootstrap]: 0.00036759 [type_inference]: 0.0232076 [event_method]: 2.402e-05 [auto_monad]: 7.95e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00011752 [rewriter_before_opt_a]: 8.661e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.0064205, [2] [Cycle 1]: 0.00224757, [27] [switch_simplify]: 6.447e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.00058799 [with_stream_mark]: 2.357e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.37997e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.489e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00117737 [add_forward_monad_depend]: 7.21001e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.693e-05 [cse]: 3.65e-05 [replace_applicator]: 1.521e-05 [Cycle 2]: 0.00034348, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.475e-05 [with_stream_mark]: 1.233e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 8.86997e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.33998e-06 [cse]: 1.472e-05 [replace_applicator]: 5.14003e-06 [py_interpret_to_execute_after_opt_a]: 1.493e-05 [rewriter_after_opt_a]: 4.007e-05 [convert_after_rewriter]: 7.12002e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00072269 [jit_opt_b]: 5.598e-05, [1] [Cycle 1]: 4.655e-05, [2] [frontend_op_eliminate]: 1.716e-05 [inline_after_opt_a]: 1.789e-05 [cconv]: 2.815e-05 [loop_unroll]: 0.00044725 [jit_opt_after_cconv]: 0.00015229, [1] [Cycle 1]: 0.00014613, [11] [c_1]: 2.124e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 6.54001e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.93e-06 [cse]: 2.607e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 5.59998e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.74e-06 [remove_dup_value]: 1.732e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.43e-06 [add_recomputation]: 5.319e-05 [cse_after_recomputation]: 2.296e-05, [1] [Cycle 1]: 1.727e-05, [1] [cse]: 1.155e-05 [auto_monad_reorder]: 1.726e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.18002e-06 [opt_after_jit_grad]: 0.0004657 [symbol_engine_optimizer]: 7.223e-05, [1] [Cycle 1]: 6.648e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 7.93999e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.84998e-06 [renormalize]: 3.69997e-07 [validate]: 5.698e-05 Sums bootstrap : 0.000368s : 1.30% type_inference : 0.023208s : 82.14% event_method : 0.000024s : 0.09% auto_monad : 0.000079s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000118s : 0.42% rewriter_before_opt_a : 0.000087s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000683s : 2.42% jit_opt_a.with_stream_mark : 0.000036s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001177s : 4.17% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000051s : 0.18% jit_opt_a.replace_applicator : 0.000020s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000723s : 2.56% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000028s : 0.10% loop_unroll : 0.000447s : 1.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000466s : 1.65% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.20% Time group info: ------[substitution.] 0.000248 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.15% : 0.000005s : 3: substitution.graph_param_transform 85.56% : 0.000212s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 5.20% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023100 2 91.13% : 0.021051s : 1: type_inference.infer 8.87% : 0.002049s : 1: type_inference.specialize ------[replace.] 0.000075 6 70.26% : 0.000052s : 4: replace.inline 29.74% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.70% : 0.000210s : 4: match.inline 5.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.25% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.87% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.71% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 2.23% : 0.000003s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.52% : 0.000003s : 15: predicate.partial_eliminate 1.34% : 0.000002s : 10: predicate.print_const_string_wrapper 2.15% : 0.000003s : 10: predicate.reduce_eliminate 1.61% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.34% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000002s : 10: predicate.transpose_eliminate 1.23% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000975 13 42.03% : 0.000410s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.49% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.49% : 0.000512s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034833 72 0.16% : 0.000056s : 1: add_recomputation 0.24% : 0.000083s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.11% : 0.000388s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 18.44% : 0.006424s : 1: jit_opt_a 0.44% : 0.000155s : 1: jit_opt_after_cconv 0.17% : 0.000059s : 1: jit_opt_b 1.31% : 0.000455s : 1: loop_unroll 2.10% : 0.000733s : 1: mutable_eliminate 2.62% : 0.000913s : 26: opt.transform.jit_opt_a 0.14% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.36% : 0.000473s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000121s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.97% : 0.000686s : 1: renormalize.infer 1.38% : 0.000482s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.26% : 0.000091s : 1: rewriter_before_opt_a 0.21% : 0.000075s : 1: symbol_engine_optimizer 66.70% : 0.023234s : 1: type_inference TotalTime = 0.0356385, [30] [bootstrap]: 0.00034911 [type_inference]: 0.0268765 [event_method]: 2.059e-05 [auto_monad]: 6.589e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 9.588e-05 [rewriter_before_opt_a]: 7.731e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00573264, [2] [Cycle 1]: 0.00210602, [27] [switch_simplify]: 5.968e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00055641 [with_stream_mark]: 2.142e-05 [recompute_prepare]: 7.63999e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.73001e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.454e-05 [j_node_and_user_rematch]: 9.13002e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.56998e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00107371 [add_forward_monad_depend]: 8.32e-06 [auto_monad_grad]: 2.91999e-06 [auto_monad_eliminator]: 1.787e-05 [cse]: 3.963e-05 [replace_applicator]: 1.678e-05 [Cycle 2]: 0.00032944, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.39e-06 [a_1]: 8.798e-05 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.23002e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 3.31001e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.11999e-06 [inline_without_move]: 4.72e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.395e-05 [replace_applicator]: 5.01002e-06 [py_interpret_to_execute_after_opt_a]: 1.368e-05 [rewriter_after_opt_a]: 4.028e-05 [convert_after_rewriter]: 7.27002e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00074237 [jit_opt_b]: 5.077e-05, [1] [Cycle 1]: 4.317e-05, [2] [frontend_op_eliminate]: 1.593e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.917e-05 [loop_unroll]: 0.00044513 [jit_opt_after_cconv]: 0.00016283, [1] [Cycle 1]: 0.00015606, [11] [c_1]: 2.111e-05 [parameter_eliminate]: 4.27998e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [cse]: 3.297e-05 [call_graph_tuple_transform]: 2.12e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.569e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 7.146e-05 [cse_after_recomputation]: 2.615e-05, [1] [Cycle 1]: 1.976e-05, [1] [cse]: 1.316e-05 [auto_monad_reorder]: 1.859e-05 [get_jit_bprop_graph]: 2.43002e-06 [rewriter_after_jit_bprop_graph]: 6.74001e-06 [opt_after_jit_grad]: 0.0004524 [symbol_engine_optimizer]: 7.609e-05, [1] [Cycle 1]: 6.871e-05, [6] [build]: 4.34002e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 4.19997e-07 [validate]: 4.788e-05 Sums bootstrap : 0.000349s : 1.10% type_inference : 0.026877s : 84.69% event_method : 0.000021s : 0.06% auto_monad : 0.000066s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000096s : 0.30% rewriter_before_opt_a : 0.000077s : 0.24% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.21% jit_opt_a.loop_unroll : 0.000035s : 0.11% jit_opt_a.a_1 : 0.000644s : 2.03% jit_opt_a.with_stream_mark : 0.000033s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001074s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000054s : 0.17% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000040s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000742s : 2.34% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000029s : 0.09% loop_unroll : 0.000445s : 1.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000071s : 0.23% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000452s : 1.43% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.15% Time group info: ------[substitution.] 0.000230 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 3: substitution.graph_param_transform 84.89% : 0.000195s : 4: substitution.inline 1.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000005s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 5.26% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026800 2 94.50% : 0.025326s : 1: type_inference.infer 5.50% : 0.001474s : 1: type_inference.specialize ------[replace.] 0.000075 6 70.24% : 0.000053s : 4: replace.inline 29.76% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.56% : 0.000193s : 4: match.inline 5.44% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.40% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.29% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.58% : 0.000003s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000821 13 43.72% : 0.000359s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.19% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.09% : 0.000411s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037628 72 0.20% : 0.000075s : 1: add_recomputation 0.18% : 0.000069s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.97% : 0.000366s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.24% : 0.005736s : 1: jit_opt_a 0.44% : 0.000166s : 1: jit_opt_after_cconv 0.14% : 0.000054s : 1: jit_opt_b 1.21% : 0.000454s : 1: loop_unroll 2.01% : 0.000757s : 1: mutable_eliminate 2.31% : 0.000868s : 26: opt.transform.jit_opt_a 0.13% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.23% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000100s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.65% : 0.000620s : 1: renormalize.infer 1.18% : 0.000445s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000043s : 1: rewriter_after_opt_a 0.22% : 0.000081s : 1: rewriter_before_opt_a 0.21% : 0.000078s : 1: symbol_engine_optimizer 71.47% : 0.026893s : 1: type_inference TotalTime = 0.112186, [30] [bootstrap]: 0.00034492 [type_inference]: 0.0985121 [event_method]: 0.00054971 [auto_monad]: 0.00014247 [graph_reusing]: 9.17999e-06 [pre_auto_parallel]: 3.56999e-06 [py_interpret_to_execute]: 4.715e-05 [rewriter_before_opt_a]: 0.00016995 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00975902, [2] [Cycle 1]: 0.00564603, [27] [switch_simplify]: 0.00028807 [loop_unroll]: 5.486e-05 [a_1]: 0.00155169 [with_stream_mark]: 2.044e-05 [recompute_prepare]: 9.05999e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 6.60002e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 6.56999e-06 [renormalize]: 0.0033424 [add_forward_monad_depend]: 7.48999e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.713e-05 [cse]: 3.701e-05 [replace_applicator]: 1.686e-05 [Cycle 2]: 0.00034402, [27] [switch_simplify]: 6.65998e-06 [loop_unroll]: 5.99e-06 [a_1]: 9.865e-05 [with_stream_mark]: 1.176e-05 [recompute_prepare]: 5.47999e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.07999e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 7.51999e-06 [inline_without_move]: 5.16998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.43e-05 [replace_applicator]: 5.00999e-06 [py_interpret_to_execute_after_opt_a]: 1.363e-05 [rewriter_after_opt_a]: 3.705e-05 [convert_after_rewriter]: 3.047e-05 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00066421 [jit_opt_b]: 5.329e-05, [1] [Cycle 1]: 4.612e-05, [2] [frontend_op_eliminate]: 1.767e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 2.421e-05 [loop_unroll]: 0.00042386 [jit_opt_after_cconv]: 0.00015213, [1] [Cycle 1]: 0.00014513, [11] [c_1]: 2.279e-05 [parameter_eliminate]: 2.98998e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 3.3e-06 [cse]: 2.478e-05 [call_graph_tuple_transform]: 1.816e-05 [tuple_list_get_item_eliminator]: 6.97002e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.66e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.21998e-06 [add_recomputation]: 4.947e-05 [cse_after_recomputation]: 2.449e-05, [1] [Cycle 1]: 1.911e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.752e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.64e-06 [opt_after_jit_grad]: 0.00045158 [symbol_engine_optimizer]: 0.00042093, [1] [Cycle 1]: 0.00036402, [6] [build]: 3.56999e-06 [elim_shapecalc]: 9.98998e-06 [elim_not_effective]: 1.384e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 0.00029811 [renormalize]: 3.50003e-07 [validate]: 4.043e-05 Sums bootstrap : 0.000345s : 0.32% type_inference : 0.098512s : 91.45% event_method : 0.000550s : 0.51% auto_monad : 0.000142s : 0.13% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000047s : 0.04% rewriter_before_opt_a : 0.000170s : 0.16% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000295s : 0.27% jit_opt_a.loop_unroll : 0.000061s : 0.06% jit_opt_a.a_1 : 0.001650s : 1.53% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003342s : 3.10% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000051s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000030s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000664s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000424s : 0.39% jit_opt_after_cconv.c_1 : 0.000023s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000452s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000298s : 0.28% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000655 35 0.27% : 0.000002s : 2: substitution.elim_not_effective 0.18% : 0.000001s : 2: substitution.fold_const_symbol 0.84% : 0.000005s : 3: substitution.graph_param_transform 90.97% : 0.000596s : 12: substitution.inline 0.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.72% : 0.000005s : 4: substitution.remove_not_recompute_node 0.68% : 0.000004s : 2: substitution.replace_old_param 1.45% : 0.000010s : 1: substitution.reshape_eliminate 2.44% : 0.000016s : 3: substitution.switch_simplify 1.77% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098408 2 95.28% : 0.093759s : 1: type_inference.infer 4.72% : 0.004648s : 1: type_inference.specialize ------[replace.] 0.000345 18 52.63% : 0.000182s : 12: replace.inline 1.32% : 0.000005s : 1: replace.reshape_eliminate 17.88% : 0.000062s : 3: replace.switch_simplify 28.17% : 0.000097s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000622 18 94.70% : 0.000589s : 12: match.inline 1.35% : 0.000008s : 1: match.reshape_eliminate 2.26% : 0.000014s : 3: match.switch_simplify 1.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000200 1212 1.39% : 0.000003s : 19: predicate.accumulaten_eliminater 0.69% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.33% : 0.000003s : 19: predicate.addn_check_dump 1.62% : 0.000003s : 19: predicate.addn_zero_filter 2.14% : 0.000004s : 19: predicate.arithmetic_simplify 1.40% : 0.000003s : 20: predicate.cast_eliminate 0.30% : 0.000001s : 3: predicate.check_bprop_eliminate 1.27% : 0.000003s : 19: predicate.compare_switch_simplify 1.32% : 0.000003s : 19: predicate.depend_value_elim 1.30% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.47% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.40% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.50% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000001s : 3: predicate.elim_not_effective 0.34% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.63% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.34% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.30% : 0.000003s : 20: predicate.environ_get_depend_swap 1.45% : 0.000003s : 20: predicate.environ_get_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.68% : 0.000001s : 6: predicate.get_grad_eliminate 0.15% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000011s : 40: predicate.inline 0.54% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.78% : 0.000004s : 25: predicate.load_eliminater 0.62% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.74% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.95% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.71% : 0.000003s : 19: predicate.merge_addn 1.28% : 0.000003s : 19: predicate.minmaximum_grad 1.02% : 0.000002s : 3: predicate.mutable_eliminate 0.33% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000004s : 25: predicate.partial_eliminate 1.36% : 0.000003s : 19: predicate.print_const_string_wrapper 1.71% : 0.000003s : 19: predicate.reduce_eliminate 1.57% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000003s : 28: predicate.replace_applicator 0.31% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.86% : 0.000004s : 20: predicate.reshape_eliminate 1.42% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000003s : 19: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000002s : 6: predicate.special_op_eliminate 0.55% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.65% : 0.000007s : 34: predicate.switch_defer_inline 2.64% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.95% : 0.000018s : 107: predicate.switch_simplify 1.48% : 0.000003s : 19: predicate.tile_eliminate 1.29% : 0.000003s : 19: predicate.transpose_eliminate 1.65% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.14% : 0.000006s : 28: predicate.tuple_list_get_item_eliminator 1.58% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.62% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.84% : 0.000004s : 25: predicate.updatestate_pure_node_eliminater 2.30% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.59% : 0.000003s : 19: predicate.value_based_eliminate 0.18% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.32% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004155 40 62.59% : 0.002601s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.10% : 0.000337s : 5: func_graph_cloner_run.FuncGraphClonerNode 29.31% : 0.001218s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117717 72 0.04% : 0.000052s : 1: add_recomputation 0.13% : 0.000150s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000364s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.03% : 0.000033s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.48% : 0.000560s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 8.29% : 0.009763s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000432s : 1: loop_unroll 0.57% : 0.000674s : 1: mutable_eliminate 1.81% : 0.002136s : 26: opt.transform.jit_opt_a 0.04% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000050s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 2.10% : 0.002477s : 1: renormalize.infer 0.73% : 0.000856s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.15% : 0.000174s : 1: rewriter_before_opt_a 0.36% : 0.000424s : 1: symbol_engine_optimizer 83.70% : 0.098531s : 1: type_inference TotalTime = 0.0322019, [30] [bootstrap]: 0.00041138 [type_inference]: 0.02219 [event_method]: 2.594e-05 [auto_monad]: 7.927e-05 [graph_reusing]: 6.33998e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00012865 [rewriter_before_opt_a]: 8.959e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00664447, [2] [Cycle 1]: 0.00235648, [27] [switch_simplify]: 6.602e-05 [loop_unroll]: 3.035e-05 [a_1]: 0.00061148 [with_stream_mark]: 2.658e-05 [recompute_prepare]: 9.74e-06 [updatestate_depend_eliminate]: 4.69998e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 3.01001e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.646e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.088e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00122206 [add_forward_monad_depend]: 7.41999e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.778e-05 [cse]: 3.955e-05 [replace_applicator]: 1.722e-05 [Cycle 2]: 0.00034799, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.34e-06 [a_1]: 9.149e-05 [with_stream_mark]: 1.151e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.46998e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 2.01998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 4.87e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 7.68001e-06 [cse]: 1.659e-05 [replace_applicator]: 6.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.662e-05 [rewriter_after_opt_a]: 4.012e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00075114 [jit_opt_b]: 5.236e-05, [1] [Cycle 1]: 4.43e-05, [2] [frontend_op_eliminate]: 1.621e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 2.884e-05 [loop_unroll]: 0.00047311 [jit_opt_after_cconv]: 0.00017108, [1] [Cycle 1]: 0.00016393, [11] [c_1]: 2.158e-05 [parameter_eliminate]: 4.64998e-06 [updatestate_depend_eliminate]: 7.71999e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 3.476e-05 [call_graph_tuple_transform]: 2.17e-05 [tuple_list_get_item_eliminator]: 5.43002e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.601e-05 [partial_unused_args_eliminate]: 2.36998e-06 [environ_conv]: 6.12999e-06 [add_recomputation]: 5.491e-05 [cse_after_recomputation]: 2.701e-05, [1] [Cycle 1]: 2.105e-05, [1] [cse]: 1.302e-05 [auto_monad_reorder]: 1.903e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 8.25999e-06 [opt_after_jit_grad]: 0.00055146 [symbol_engine_optimizer]: 7.796e-05, [1] [Cycle 1]: 7.031e-05, [6] [build]: 5.87001e-06 [elim_shapecalc]: 8.55001e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.51002e-06 [renormalize]: 3.39991e-07 [validate]: 6.051e-05 Sums bootstrap : 0.000411s : 1.49% type_inference : 0.022190s : 80.54% event_method : 0.000026s : 0.09% auto_monad : 0.000079s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000129s : 0.47% rewriter_before_opt_a : 0.000090s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000703s : 2.55% jit_opt_a.with_stream_mark : 0.000038s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001222s : 4.44% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000056s : 0.20% jit_opt_a.replace_applicator : 0.000024s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000751s : 2.73% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.000473s : 1.72% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000035s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000551s : 2.00% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.22% Time group info: ------[substitution.] 0.000266 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 3: substitution.graph_param_transform 85.73% : 0.000228s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.42% : 0.000006s : 2: substitution.replace_old_param 4.67% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022096 2 91.90% : 0.020306s : 1: type_inference.infer 8.10% : 0.001791s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.24% : 0.000054s : 4: replace.inline 31.76% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 95.25% : 0.000225s : 4: match.inline 4.75% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.35% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.64% : 0.000002s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.49% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.66% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 6: predicate.less_batch_normalization 1.25% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.59% : 0.000003s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000002s : 10: predicate.minmaximum_grad 2.79% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 2.32% : 0.000003s : 10: predicate.row_tensor_add_zeros_like 1.33% : 0.000002s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.52% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.38% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000961 13 43.31% : 0.000416s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.33% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.36% : 0.000484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034408 72 0.17% : 0.000058s : 1: add_recomputation 0.24% : 0.000084s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.27% : 0.000436s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.09% : 0.000032s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.32% : 0.006648s : 1: jit_opt_a 0.51% : 0.000174s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.40% : 0.000482s : 1: loop_unroll 2.22% : 0.000762s : 1: mutable_eliminate 2.74% : 0.000944s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000019s : 1: opt.transform.mutable_eliminate 0.08% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.64% : 0.000563s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000133s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.16% : 0.000744s : 1: renormalize.infer 1.36% : 0.000468s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.27% : 0.000093s : 1: rewriter_before_opt_a 0.24% : 0.000081s : 1: symbol_engine_optimizer 64.67% : 0.022252s : 1: type_inference TotalTime = 0.129327, [30] [bootstrap]: 0.00029249 [type_inference]: 0.117523 [event_method]: 2.512e-05 [auto_monad]: 7.475e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00050549 [rewriter_before_opt_a]: 0.00010297 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00828571, [2] [Cycle 1]: 0.00416239, [27] [switch_simplify]: 5.867e-05 [loop_unroll]: 3.46e-05 [a_1]: 0.00068535 [with_stream_mark]: 2.055e-05 [recompute_prepare]: 9.76e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 7.15998e-06 [updatestate_useless_node_eliminater]: 6.79999e-06 [accelerated_algorithm]: 7.75e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 7.17997e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 6.80998e-06 [renormalize]: 0.00299364 [add_forward_monad_depend]: 6.92002e-06 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 1.706e-05 [cse]: 3.68e-05 [replace_applicator]: 1.674e-05 [Cycle 2]: 0.00037873, [27] [switch_simplify]: 7.6e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00012388 [with_stream_mark]: 1.141e-05 [recompute_prepare]: 6.43998e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 6.16998e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 2.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.377e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 8.91002e-06 [inline_without_move]: 6.20002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.624e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.654e-05 [rewriter_after_opt_a]: 4.035e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00069044 [jit_opt_b]: 6.047e-05, [1] [Cycle 1]: 5.378e-05, [2] [frontend_op_eliminate]: 2.312e-05 [inline_after_opt_a]: 1.943e-05 [cconv]: 2.676e-05 [loop_unroll]: 0.0004868 [jit_opt_after_cconv]: 0.00016534, [1] [Cycle 1]: 0.00015853, [11] [c_1]: 2.609e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 6.79999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.601e-05 [call_graph_tuple_transform]: 2.197e-05 [tuple_list_get_item_eliminator]: 6.58003e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 8.08001e-06 [remove_dup_value]: 1.758e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 8.48001e-06 [add_recomputation]: 4.805e-05 [cse_after_recomputation]: 2.479e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 5.40999e-06 [opt_after_jit_grad]: 0.00047106 [symbol_engine_optimizer]: 8.307e-05, [1] [Cycle 1]: 7.715e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 9.16998e-06 [elim_not_effective]: 1.371e-05 [opt_reshape]: 9.76e-06 [fold_const_symbol]: 1.028e-05 [renormalize]: 4.40021e-07 [validate]: 0.00012572 Sums bootstrap : 0.000292s : 0.23% type_inference : 0.117523s : 94.05% event_method : 0.000025s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000505s : 0.40% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000809s : 0.65% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002994s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000690s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000487s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000471s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000126s : 0.10% Time group info: ------[substitution.] 0.000252 25 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.93% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 4: substitution.graph_param_transform 87.84% : 0.000222s : 5: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000004s : 4: substitution.remove_not_recompute_node 1.65% : 0.000004s : 2: substitution.replace_old_param 3.28% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117429 2 96.98% : 0.113883s : 1: type_inference.infer 3.02% : 0.003546s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.49% : 0.000069s : 5: replace.inline 31.51% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 96.91% : 0.000218s : 5: match.inline 3.09% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 1.96% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.27% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.75% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.32% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.84% : 0.000003s : 13: predicate.reduce_eliminate 1.58% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.42% : 0.000002s : 13: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.75% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.83% : 0.000009s : 64: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.89% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002431 25 62.63% : 0.001522s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.51% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.86% : 0.000823s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133374 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000312s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.22% : 0.008289s : 1: jit_opt_a 0.13% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.37% : 0.000495s : 1: loop_unroll 0.52% : 0.000699s : 1: mutable_eliminate 0.80% : 0.001061s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000512s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.60% : 0.002128s : 1: renormalize.infer 0.64% : 0.000855s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000108s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 88.13% : 0.117548s : 1: type_inference TotalTime = 0.0302084, [30] [bootstrap]: 0.00040567 [type_inference]: 0.022102 [event_method]: 1.964e-05 [auto_monad]: 6.418e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 9.98e-05 [rewriter_before_opt_a]: 8.183e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00538591, [2] [Cycle 1]: 0.00192414, [27] [switch_simplify]: 5.332e-05 [loop_unroll]: 2.924e-05 [a_1]: 0.00060873 [with_stream_mark]: 1.902e-05 [recompute_prepare]: 7.63999e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.33998e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 4.04997e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 0.00088642 [add_forward_monad_depend]: 4.52e-06 [auto_monad_grad]: 2.18002e-06 [auto_monad_eliminator]: 1.469e-05 [cse]: 3.433e-05 [replace_applicator]: 1.227e-05 [Cycle 2]: 0.00031425, [27] [switch_simplify]: 6.08002e-06 [loop_unroll]: 4.97999e-06 [a_1]: 8.701e-05 [with_stream_mark]: 8.97e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 5.06002e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.77998e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 7.56001e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.3e-06 [inline_without_move]: 4.84e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.44001e-06 [cse]: 1.241e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.211e-05 [rewriter_after_opt_a]: 3.719e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00049937 [jit_opt_b]: 4.848e-05, [1] [Cycle 1]: 4.214e-05, [2] [frontend_op_eliminate]: 1.499e-05 [inline_after_opt_a]: 1.616e-05 [cconv]: 2.543e-05 [loop_unroll]: 0.00040742 [jit_opt_after_cconv]: 0.00014042, [1] [Cycle 1]: 0.00013415, [11] [c_1]: 2.022e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.305e-05 [call_graph_tuple_transform]: 1.811e-05 [tuple_list_get_item_eliminator]: 5.36002e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 5.27001e-06 [add_recomputation]: 4.535e-05 [cse_after_recomputation]: 2.185e-05, [1] [Cycle 1]: 1.657e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.649e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00043727 [symbol_engine_optimizer]: 8.722e-05, [1] [Cycle 1]: 8.113e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.30001e-06 [fold_const_symbol]: 2.576e-05 [renormalize]: 4.90021e-07 [validate]: 3.797e-05 Sums bootstrap : 0.000406s : 1.53% type_inference : 0.022102s : 83.43% event_method : 0.000020s : 0.07% auto_monad : 0.000064s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000100s : 0.38% rewriter_before_opt_a : 0.000082s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.22% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000696s : 2.63% jit_opt_a.with_stream_mark : 0.000028s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000886s : 3.35% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000047s : 0.18% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000037s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000499s : 1.88% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000025s : 0.10% loop_unroll : 0.000407s : 1.54% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000045s : 0.17% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000016s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000437s : 1.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000026s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.14% Time group info: ------[substitution.] 0.000308 23 0.65% : 0.000002s : 2: substitution.elim_not_effective 5.82% : 0.000018s : 2: substitution.fold_const_symbol 1.71% : 0.000005s : 3: substitution.graph_param_transform 83.62% : 0.000258s : 4: substitution.inline 1.11% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.50% : 0.000005s : 4: substitution.remove_not_recompute_node 1.48% : 0.000005s : 2: substitution.replace_old_param 4.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022016 2 92.73% : 0.020416s : 1: type_inference.infer 7.27% : 0.001601s : 1: type_inference.specialize ------[replace.] 0.000068 6 69.46% : 0.000047s : 4: replace.inline 30.54% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 6 95.68% : 0.000255s : 4: match.inline 4.32% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.70% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.59% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 2.09% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.05% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000854 13 47.96% : 0.000410s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.97% : 0.000401s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032067 72 0.15% : 0.000048s : 1: add_recomputation 0.21% : 0.000067s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.34% : 0.000431s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.80% : 0.005388s : 1: jit_opt_a 0.45% : 0.000143s : 1: jit_opt_after_cconv 0.16% : 0.000051s : 1: jit_opt_b 1.29% : 0.000415s : 1: loop_unroll 1.58% : 0.000507s : 1: mutable_eliminate 2.83% : 0.000906s : 26: opt.transform.jit_opt_a 0.14% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000049s : 4: opt.transform.symbol_engine_opt 1.39% : 0.000446s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000103s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.62% : 0.000521s : 1: renormalize.infer 1.12% : 0.000358s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000040s : 1: rewriter_after_opt_a 0.27% : 0.000086s : 1: rewriter_before_opt_a 0.28% : 0.000090s : 1: symbol_engine_optimizer 68.98% : 0.022119s : 1: type_inference TotalTime = 0.0140658, [30] [bootstrap]: 0.00035498 [type_inference]: 0.00503969 [event_method]: 1.787e-05 [auto_monad]: 7.092e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 2.292e-05 [rewriter_before_opt_a]: 7.117e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00626056, [2] [Cycle 1]: 0.00252674, [27] [switch_simplify]: 5.564e-05 [loop_unroll]: 2.916e-05 [a_1]: 0.00054524 [with_stream_mark]: 2.087e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 0.00152133 [add_forward_monad_depend]: 7.4e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.648e-05 [cse]: 2.797e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.0003338, [27] [switch_simplify]: 6.11998e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.126e-05 [with_stream_mark]: 1.104e-05 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.80001e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 4.55001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.054e-05 [replace_applicator]: 5.30001e-06 [py_interpret_to_execute_after_opt_a]: 1.193e-05 [rewriter_after_opt_a]: 3.579e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00064373 [jit_opt_b]: 5.52e-05, [1] [Cycle 1]: 4.8e-05, [2] [frontend_op_eliminate]: 1.617e-05 [inline_after_opt_a]: 1.483e-05 [cconv]: 2.756e-05 [loop_unroll]: 0.00042098 [jit_opt_after_cconv]: 0.00014699, [1] [Cycle 1]: 0.00014112, [11] [c_1]: 2.036e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.194e-05 [call_graph_tuple_transform]: 1.999e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.417e-05 [partial_unused_args_eliminate]: 1.92999e-06 [environ_conv]: 5.20999e-06 [add_recomputation]: 5.197e-05 [cse_after_recomputation]: 2.151e-05, [1] [Cycle 1]: 1.611e-05, [1] [cse]: 1.041e-05 [auto_monad_reorder]: 1.508e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 4.12e-06 [opt_after_jit_grad]: 0.00044931 [symbol_engine_optimizer]: 7.371e-05, [1] [Cycle 1]: 6.767e-05, [6] [build]: 3.19001e-06 [elim_shapecalc]: 7.58999e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 3.39991e-07 [validate]: 3.829e-05 Sums bootstrap : 0.000355s : 3.54% type_inference : 0.005040s : 50.20% event_method : 0.000018s : 0.18% auto_monad : 0.000071s : 0.71% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000023s : 0.23% rewriter_before_opt_a : 0.000071s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.62% jit_opt_a.loop_unroll : 0.000034s : 0.34% jit_opt_a.a_1 : 0.000637s : 6.34% jit_opt_a.with_stream_mark : 0.000032s : 0.32% jit_opt_a.recompute_prepare : 0.000012s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.001521s : 15.15% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000039s : 0.38% jit_opt_a.replace_applicator : 0.000022s : 0.22% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000036s : 0.36% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000644s : 6.41% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000028s : 0.27% loop_unroll : 0.000421s : 4.19% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000014s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000052s : 0.52% cse_after_recomputation.cse : 0.000010s : 0.10% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000449s : 4.48% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.38% Time group info: ------[substitution.] 0.000222 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000005s : 3: substitution.graph_param_transform 84.86% : 0.000189s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 5.47% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004973 2 82.08% : 0.004082s : 1: type_inference.infer 17.92% : 0.000891s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.34% : 0.000047s : 4: replace.inline 31.66% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.41% : 0.000186s : 4: match.inline 5.59% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.58% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.67% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.43% : 0.000002s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.71% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.99% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.44% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000700 13 50.88% : 0.000356s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.62% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.50% : 0.000298s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016492 72 0.33% : 0.000055s : 1: add_recomputation 0.45% : 0.000075s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 2.28% : 0.000376s : 1: bootstrap 0.18% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000023s : 1: cse_after_recomputation 0.11% : 0.000017s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.98% : 0.006264s : 1: jit_opt_a 0.91% : 0.000150s : 1: jit_opt_after_cconv 0.35% : 0.000058s : 1: jit_opt_b 2.60% : 0.000429s : 1: loop_unroll 3.96% : 0.000653s : 1: mutable_eliminate 5.17% : 0.000852s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000457s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000025s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000016s : 1: remove_dup_value 6.74% : 0.001112s : 1: renormalize.infer 2.43% : 0.000401s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000039s : 1: rewriter_after_opt_a 0.45% : 0.000074s : 1: rewriter_before_opt_a 0.46% : 0.000076s : 1: symbol_engine_optimizer 30.65% : 0.005056s : 1: type_inference TotalTime = 0.0312168, [30] [bootstrap]: 0.00027836 [type_inference]: 0.0216122 [event_method]: 2.109e-05 [auto_monad]: 7.03e-05 [graph_reusing]: 6.06998e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 9.552e-05 [rewriter_before_opt_a]: 8.093e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00696234, [2] [Cycle 1]: 0.0021067, [27] [switch_simplify]: 6.112e-05 [loop_unroll]: 2.93e-05 [a_1]: 0.00057399 [with_stream_mark]: 2.258e-05 [recompute_prepare]: 6.96999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.72002e-06 [cell_reuse_recompute_pass]: 1.11997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.398e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.66998e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00107344 [add_forward_monad_depend]: 7.58001e-06 [auto_monad_grad]: 3.08998e-06 [auto_monad_eliminator]: 1.57e-05 [cse]: 3.525e-05 [replace_applicator]: 1.465e-05 [Cycle 2]: 0.00031506, [27] [switch_simplify]: 5.81998e-06 [loop_unroll]: 5.12e-06 [a_1]: 8.645e-05 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 3.40998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.27002e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.63997e-06 [cse]: 1.269e-05 [replace_applicator]: 5.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 3.666e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.000551 [jit_opt_b]: 4.727e-05, [1] [Cycle 1]: 4.018e-05, [2] [frontend_op_eliminate]: 1.479e-05 [inline_after_opt_a]: 1.511e-05 [cconv]: 2.695e-05 [loop_unroll]: 0.00040102 [jit_opt_after_cconv]: 0.00014123, [1] [Cycle 1]: 0.00013482, [11] [c_1]: 1.995e-05 [parameter_eliminate]: 2.75002e-06 [updatestate_depend_eliminate]: 6.19999e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.306e-05 [call_graph_tuple_transform]: 1.841e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.38002e-06 [remove_dup_value]: 1.48e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.31e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.211e-05, [1] [Cycle 1]: 1.725e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.748e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 4.78001e-06 [opt_after_jit_grad]: 0.00044468 [symbol_engine_optimizer]: 7.26e-05, [1] [Cycle 1]: 6.629e-05, [6] [build]: 4.52e-06 [elim_shapecalc]: 7.77002e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 5.56998e-06 [fold_const_symbol]: 8.73001e-06 [renormalize]: 3.30008e-07 [validate]: 4.032e-05 Sums bootstrap : 0.000278s : 1.07% type_inference : 0.021612s : 82.82% event_method : 0.000021s : 0.08% auto_monad : 0.000070s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000096s : 0.37% rewriter_before_opt_a : 0.000081s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.26% jit_opt_a.loop_unroll : 0.000034s : 0.13% jit_opt_a.a_1 : 0.000660s : 2.53% jit_opt_a.with_stream_mark : 0.000033s : 0.13% jit_opt_a.recompute_prepare : 0.000012s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001074s : 4.11% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000048s : 0.18% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000037s : 0.14% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000551s : 2.11% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000401s : 1.54% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000445s : 1.70% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.15% Time group info: ------[substitution.] 0.000246 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000005s : 3: substitution.graph_param_transform 85.93% : 0.000211s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000005s : 2: substitution.replace_old_param 5.18% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021538 2 93.03% : 0.020037s : 1: type_inference.infer 6.97% : 0.001501s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.20% : 0.000050s : 4: replace.inline 31.80% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.73% : 0.000209s : 4: match.inline 5.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.36% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.39% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.01% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000008s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000895 13 44.51% : 0.000398s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.07% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.42% : 0.000442s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033216 72 0.16% : 0.000054s : 1: add_recomputation 0.22% : 0.000074s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.89% : 0.000297s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 20.97% : 0.006965s : 1: jit_opt_a 0.43% : 0.000144s : 1: jit_opt_after_cconv 0.15% : 0.000050s : 1: jit_opt_b 1.23% : 0.000409s : 1: loop_unroll 1.68% : 0.000560s : 1: mutable_eliminate 2.65% : 0.000879s : 26: opt.transform.jit_opt_a 0.14% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.37% : 0.000454s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000099s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.84% : 0.000612s : 1: renormalize.infer 1.36% : 0.000453s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000039s : 1: rewriter_after_opt_a 0.26% : 0.000085s : 1: rewriter_before_opt_a 0.23% : 0.000075s : 1: symbol_engine_optimizer 65.12% : 0.021632s : 1: type_inference TotalTime = 0.0295488, [30] [bootstrap]: 0.0003193 [type_inference]: 0.0202958 [event_method]: 2.18e-05 [auto_monad]: 7.622e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00011842 [rewriter_before_opt_a]: 8.762e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00651428, [2] [Cycle 1]: 0.0021288, [27] [switch_simplify]: 6.537e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.00062189 [with_stream_mark]: 2.306e-05 [recompute_prepare]: 7.96001e-06 [updatestate_depend_eliminate]: 4.09997e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.494e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 5.64e-06 [renormalize]: 0.00104193 [add_forward_monad_depend]: 5.05999e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.526e-05 [cse]: 3.493e-05 [replace_applicator]: 1.256e-05 [Cycle 2]: 0.00031483, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 4.85001e-06 [a_1]: 8.859e-05 [with_stream_mark]: 9.04e-06 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 2.93998e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.08002e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.26997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.228e-05 [j_node_and_user_rematch]: 7.95998e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 6.84999e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.234e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.221e-05 [rewriter_after_opt_a]: 3.962e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00053268 [jit_opt_b]: 4.846e-05, [1] [Cycle 1]: 4.2e-05, [2] [frontend_op_eliminate]: 1.577e-05 [inline_after_opt_a]: 1.517e-05 [cconv]: 2.433e-05 [loop_unroll]: 0.00040366 [jit_opt_after_cconv]: 0.00014381, [1] [Cycle 1]: 0.00013727, [11] [c_1]: 2.058e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 2.344e-05 [call_graph_tuple_transform]: 1.813e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.56002e-06 [remove_dup_value]: 1.51e-05 [partial_unused_args_eliminate]: 1.81e-06 [environ_conv]: 6.32001e-06 [add_recomputation]: 4.982e-05 [cse_after_recomputation]: 2.143e-05, [1] [Cycle 1]: 1.646e-05, [1] [cse]: 1.097e-05 [auto_monad_reorder]: 1.707e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 4.33999e-06 [opt_after_jit_grad]: 0.00044305 [symbol_engine_optimizer]: 7.158e-05, [1] [Cycle 1]: 6.531e-05, [6] [build]: 4.02e-06 [elim_shapecalc]: 8.13001e-06 [elim_not_effective]: 1.253e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 8.18001e-06 [renormalize]: 6.00005e-07 [validate]: 7.058e-05 Sums bootstrap : 0.000319s : 1.28% type_inference : 0.020296s : 81.56% event_method : 0.000022s : 0.09% auto_monad : 0.000076s : 0.31% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000118s : 0.48% rewriter_before_opt_a : 0.000088s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.29% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000710s : 2.85% jit_opt_a.with_stream_mark : 0.000032s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001042s : 4.19% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000047s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000533s : 2.14% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000024s : 0.10% loop_unroll : 0.000404s : 1.62% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000050s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000443s : 1.78% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000071s : 0.28% Time group info: ------[substitution.] 0.000243 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 86.80% : 0.000211s : 4: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 4.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020215 2 91.26% : 0.018449s : 1: type_inference.infer 8.74% : 0.001766s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.44% : 0.000053s : 4: replace.inline 32.56% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 95.21% : 0.000209s : 4: match.inline 4.79% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.60% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.66% : 0.000002s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.27% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 6.06% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.15% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.48% : 0.000010s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000898 13 42.83% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.29% : 0.000461s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031538 72 0.17% : 0.000053s : 1: add_recomputation 0.25% : 0.000080s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.07% : 0.000339s : 1: bootstrap 0.08% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000023s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 20.66% : 0.006517s : 1: jit_opt_a 0.47% : 0.000147s : 1: jit_opt_after_cconv 0.16% : 0.000051s : 1: jit_opt_b 1.30% : 0.000411s : 1: loop_unroll 1.71% : 0.000541s : 1: mutable_eliminate 2.95% : 0.000932s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.43% : 0.000451s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000123s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.96% : 0.000618s : 1: renormalize.infer 1.32% : 0.000416s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.29% : 0.000092s : 1: rewriter_before_opt_a 0.23% : 0.000074s : 1: symbol_engine_optimizer 64.42% : 0.020317s : 1: type_inference TotalTime = 0.031574, [30] [bootstrap]: 0.00030081 [type_inference]: 0.0225928 [event_method]: 2.041e-05 [auto_monad]: 6.879e-05 [graph_reusing]: 6.30002e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.0001093 [rewriter_before_opt_a]: 8.587e-05 [expand_dump_flag]: 3.89002e-06 [jit_opt_a]: 0.00597942, [2] [Cycle 1]: 0.00218088, [27] [switch_simplify]: 6.128e-05 [loop_unroll]: 3.072e-05 [a_1]: 0.00056657 [with_stream_mark]: 2.331e-05 [recompute_prepare]: 9.37999e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 4.07e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.632e-05 [j_node_and_user_rematch]: 9.16002e-06 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.95002e-06 [renormalize]: 0.00112047 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.692e-05 [cse]: 3.529e-05 [replace_applicator]: 1.681e-05 [Cycle 2]: 0.00033375, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.52001e-06 [a_1]: 9.107e-05 [with_stream_mark]: 1.187e-05 [recompute_prepare]: 5.67001e-06 [updatestate_depend_eliminate]: 3.30003e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 4.99998e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 3.32002e-06 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 7.74002e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.427e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.361e-05 [rewriter_after_opt_a]: 4.202e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00069106 [jit_opt_b]: 5.002e-05, [1] [Cycle 1]: 4.216e-05, [2] [frontend_op_eliminate]: 1.509e-05 [inline_after_opt_a]: 1.583e-05 [cconv]: 2.762e-05 [loop_unroll]: 0.0004483 [jit_opt_after_cconv]: 0.00015741, [1] [Cycle 1]: 0.00015071, [11] [c_1]: 2.08e-05 [parameter_eliminate]: 3.51999e-06 [updatestate_depend_eliminate]: 7.01001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.932e-05 [call_graph_tuple_transform]: 2.199e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 1.10001e-06 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 3.22002e-06 [environ_conv]: 6.98998e-06 [add_recomputation]: 5.131e-05 [cse_after_recomputation]: 2.163e-05, [1] [Cycle 1]: 1.663e-05, [1] [cse]: 1.109e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 6.45002e-06 [opt_after_jit_grad]: 0.00048878 [symbol_engine_optimizer]: 7.498e-05, [1] [Cycle 1]: 6.752e-05, [6] [build]: 3.53e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 1.345e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 4.30009e-07 [validate]: 6.779e-05 Sums bootstrap : 0.000301s : 1.09% type_inference : 0.022593s : 82.23% event_method : 0.000020s : 0.07% auto_monad : 0.000069s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000109s : 0.40% rewriter_before_opt_a : 0.000086s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000658s : 2.39% jit_opt_a.with_stream_mark : 0.000035s : 0.13% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001121s : 4.08% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000050s : 0.18% jit_opt_a.replace_applicator : 0.000022s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000691s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.10% loop_unroll : 0.000448s : 1.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000051s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000489s : 1.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000068s : 0.25% Time group info: ------[substitution.] 0.000234 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000007s : 3: substitution.graph_param_transform 83.84% : 0.000196s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000006s : 2: substitution.replace_old_param 5.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022518 2 92.65% : 0.020863s : 1: type_inference.infer 7.35% : 0.001655s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.31% : 0.000052s : 4: replace.inline 32.69% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.17% : 0.000194s : 4: match.inline 5.83% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.60% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000929 13 42.49% : 0.000395s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.21% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.31% : 0.000486s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033611 72 0.16% : 0.000055s : 1: add_recomputation 0.22% : 0.000073s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.95% : 0.000320s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.84% : 0.005996s : 1: jit_opt_a 0.48% : 0.000160s : 1: jit_opt_after_cconv 0.16% : 0.000052s : 1: jit_opt_b 1.36% : 0.000457s : 1: loop_unroll 2.08% : 0.000701s : 1: mutable_eliminate 2.65% : 0.000892s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.48% : 0.000498s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000114s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.98% : 0.000665s : 1: renormalize.infer 1.32% : 0.000445s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000046s : 1: rewriter_after_opt_a 0.27% : 0.000090s : 1: rewriter_before_opt_a 0.23% : 0.000077s : 1: symbol_engine_optimizer 67.28% : 0.022613s : 1: type_inference TotalTime = 0.0315459, [30] [bootstrap]: 0.00031457 [type_inference]: 0.0218489 [event_method]: 2.279e-05 [auto_monad]: 7.284e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00012628 [rewriter_before_opt_a]: 9.28e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.00647062, [2] [Cycle 1]: 0.00232995, [27] [switch_simplify]: 6.613e-05 [loop_unroll]: 3.118e-05 [a_1]: 0.00065892 [with_stream_mark]: 2.538e-05 [recompute_prepare]: 9.47001e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.134e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00115293 [add_forward_monad_depend]: 8.02998e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.896e-05 [cse]: 3.86e-05 [replace_applicator]: 2.001e-05 [Cycle 2]: 0.00034998, [27] [switch_simplify]: 6.66999e-06 [loop_unroll]: 5.45001e-06 [a_1]: 9.253e-05 [with_stream_mark]: 1.459e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.32002e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 4.94998e-06 [merge_forward]: 3.89997e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.87e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 8.02e-06 [cse]: 1.423e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.444e-05 [rewriter_after_opt_a]: 4.012e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00073414 [jit_opt_b]: 5.66e-05, [1] [Cycle 1]: 4.698e-05, [2] [frontend_op_eliminate]: 1.683e-05 [inline_after_opt_a]: 1.82e-05 [cconv]: 3.61e-05 [loop_unroll]: 0.00046798 [jit_opt_after_cconv]: 0.00017087, [1] [Cycle 1]: 0.00016434, [11] [c_1]: 2.044e-05 [parameter_eliminate]: 4.70999e-06 [updatestate_depend_eliminate]: 9.81e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.75002e-06 [cse]: 3.702e-05 [call_graph_tuple_transform]: 2.104e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 1.04e-06 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.569e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 6.06e-06 [add_recomputation]: 5.286e-05 [cse_after_recomputation]: 2.31e-05, [1] [Cycle 1]: 1.781e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.839e-05 [get_jit_bprop_graph]: 2.49999e-06 [rewriter_after_jit_bprop_graph]: 6.84999e-06 [opt_after_jit_grad]: 0.00055707 [symbol_engine_optimizer]: 0.00010045, [1] [Cycle 1]: 9.313e-05, [6] [build]: 5.08002e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 3.09e-05 [opt_reshape]: 7.09001e-06 [fold_const_symbol]: 1.018e-05 [renormalize]: 5.59987e-07 [validate]: 4.968e-05 Sums bootstrap : 0.000315s : 1.16% type_inference : 0.021849s : 80.67% event_method : 0.000023s : 0.08% auto_monad : 0.000073s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000126s : 0.47% rewriter_before_opt_a : 0.000093s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.27% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000751s : 2.77% jit_opt_a.with_stream_mark : 0.000040s : 0.15% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001153s : 4.26% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.10% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000734s : 2.71% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000036s : 0.13% loop_unroll : 0.000468s : 1.73% jit_opt_after_cconv.c_1 : 0.000020s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000557s : 2.06% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000031s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.18% Time group info: ------[substitution.] 0.000262 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000005s : 3: substitution.graph_param_transform 85.10% : 0.000223s : 4: substitution.inline 1.92% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 2.81% : 0.000007s : 2: substitution.replace_old_param 4.80% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021759 2 91.49% : 0.019907s : 1: type_inference.infer 8.51% : 0.001851s : 1: type_inference.specialize ------[replace.] 0.000085 6 66.58% : 0.000057s : 4: replace.inline 33.42% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 95.08% : 0.000220s : 4: match.inline 4.92% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.50% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.69% : 0.000007s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.05% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 2.03% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000010s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.74% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000967 13 40.88% : 0.000395s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.25% : 0.000515s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033764 72 0.17% : 0.000056s : 1: add_recomputation 0.23% : 0.000077s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.00% : 0.000336s : 1: bootstrap 0.12% : 0.000039s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.18% : 0.006474s : 1: jit_opt_a 0.51% : 0.000174s : 1: jit_opt_after_cconv 0.18% : 0.000059s : 1: jit_opt_b 1.42% : 0.000478s : 1: loop_unroll 2.22% : 0.000749s : 1: mutable_eliminate 2.95% : 0.000996s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000022s : 1: opt.transform.mutable_eliminate 0.08% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000053s : 4: opt.transform.symbol_engine_opt 1.69% : 0.000569s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000131s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.98% : 0.000669s : 1: renormalize.infer 1.40% : 0.000473s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.29% : 0.000098s : 1: rewriter_before_opt_a 0.30% : 0.000103s : 1: symbol_engine_optimizer 64.79% : 0.021875s : 1: type_inference TotalTime = 0.0380085, [30] [bootstrap]: 0.00041707 [type_inference]: 0.0230079 [event_method]: 1.91e-05 [auto_monad]: 6.404e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 4.317e-05 [rewriter_before_opt_a]: 7.609e-05 [expand_dump_flag]: 2.89999e-06 [jit_opt_a]: 0.0118416, [2] [Cycle 1]: 0.00467406, [27] [switch_simplify]: 6.535e-05 [loop_unroll]: 2.942e-05 [a_1]: 0.00060266 [with_stream_mark]: 2.387e-05 [recompute_prepare]: 8.58001e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 3.46999e-06 [get_grad_eliminate_]: 7.27002e-06 [merge_forward]: 4.99003e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 5.22999e-06 [renormalize]: 0.00350482 [add_forward_monad_depend]: 1.13e-05 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 2.354e-05 [cse]: 3.286e-05 [replace_applicator]: 2.679e-05 [Cycle 2]: 0.00035965, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00010389 [with_stream_mark]: 1.515e-05 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.77e-06 [accelerated_algorithm]: 5.41002e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 3.83999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 4.81002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 7.26001e-06 [cse]: 1.191e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.828e-05 [rewriter_after_opt_a]: 3.921e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00078285 [jit_opt_b]: 5.609e-05, [1] [Cycle 1]: 4.754e-05, [2] [frontend_op_eliminate]: 1.74e-05 [inline_after_opt_a]: 1.751e-05 [cconv]: 3.106e-05 [loop_unroll]: 0.00046859 [jit_opt_after_cconv]: 0.00016086, [1] [Cycle 1]: 0.00015332, [11] [c_1]: 2.089e-05 [parameter_eliminate]: 4.63001e-06 [updatestate_depend_eliminate]: 9.97999e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.736e-05 [call_graph_tuple_transform]: 2.331e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.05999e-06 [remove_dup_value]: 1.718e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 6.63998e-06 [add_recomputation]: 5.545e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.78e-05, [1] [cse]: 1.12e-05 [auto_monad_reorder]: 1.572e-05 [get_jit_bprop_graph]: 1.876e-05 [rewriter_after_jit_bprop_graph]: 6.92002e-06 [opt_after_jit_grad]: 0.00050533 [symbol_engine_optimizer]: 7.687e-05, [1] [Cycle 1]: 6.93e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.4e-06 [elim_not_effective]: 1.479e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 3.59985e-07 [validate]: 4.234e-05 Sums bootstrap : 0.000417s : 1.37% type_inference : 0.023008s : 75.38% event_method : 0.000019s : 0.06% auto_monad : 0.000064s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000043s : 0.14% rewriter_before_opt_a : 0.000076s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000707s : 2.31% jit_opt_a.with_stream_mark : 0.000039s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.003505s : 11.48% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.10% jit_opt_a.cse : 0.000045s : 0.15% jit_opt_a.replace_applicator : 0.000032s : 0.10% py_interpret_to_execute_after_opt_a : 0.000018s : 0.06% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000783s : 2.56% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000031s : 0.10% loop_unroll : 0.000469s : 1.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000016s : 0.05% get_jit_bprop_graph : 0.000019s : 0.06% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000505s : 1.66% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.14% Time group info: ------[substitution.] 0.000260 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 84.15% : 0.000219s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 2.64% : 0.000007s : 2: substitution.replace_old_param 5.43% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022934 2 93.84% : 0.021521s : 1: type_inference.infer 6.16% : 0.001412s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.46% : 0.000051s : 4: replace.inline 32.54% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.28% : 0.000217s : 4: match.inline 5.72% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.63% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000002s : 10: predicate.depend_value_elim 1.35% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.62% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.62% : 0.000002s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 15: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.79% : 0.000004s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.45% : 0.000002s : 10: predicate.print_const_string_wrapper 2.02% : 0.000003s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000003s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.57% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.48% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.13% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 16: predicate.switch_defer_inline 1.86% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000010s : 53: predicate.switch_simplify 1.71% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000002s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001202 13 39.06% : 0.000470s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.71% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.23% : 0.000676s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.042523 72 0.14% : 0.000058s : 1: add_recomputation 0.16% : 0.000067s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 1.03% : 0.000436s : 1: bootstrap 0.08% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.05% : 0.000021s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 27.86% : 0.011845s : 1: jit_opt_a 0.38% : 0.000163s : 1: jit_opt_after_cconv 0.14% : 0.000059s : 1: jit_opt_b 1.12% : 0.000478s : 1: loop_unroll 1.87% : 0.000795s : 1: mutable_eliminate 2.24% : 0.000952s : 26: opt.transform.jit_opt_a 0.12% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.06% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.21% : 0.000516s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.11% : 0.000046s : 1: py_interpret_to_execute 0.05% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 6.82% : 0.002900s : 1: renormalize.infer 1.38% : 0.000589s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.19% : 0.000079s : 1: rewriter_before_opt_a 0.19% : 0.000079s : 1: symbol_engine_optimizer 54.15% : 0.023025s : 1: type_inference TotalTime = 0.0280915, [30] [bootstrap]: 0.0002731 [type_inference]: 0.00445889 [event_method]: 1.686e-05 [auto_monad]: 6.079e-05 [graph_reusing]: 5.60001e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 3.107e-05 [rewriter_before_opt_a]: 7.227e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.0205989, [2] [Cycle 1]: 0.00176477, [27] [switch_simplify]: 6.131e-05 [loop_unroll]: 2.863e-05 [a_1]: 0.00056417 [with_stream_mark]: 2.536e-05 [recompute_prepare]: 8.25999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.22e-06 [renormalize]: 0.00074844 [add_forward_monad_depend]: 5.12e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.465e-05 [cse]: 3.541e-05 [replace_applicator]: 1.175e-05 [Cycle 2]: 0.00037881, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 4.98001e-06 [a_1]: 0.00013718 [with_stream_mark]: 1.021e-05 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.29003e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 8.41002e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.62002e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.363e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.372e-05 [rewriter_after_opt_a]: 3.838e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.49998e-06 [mutable_eliminate]: 0.0005578 [jit_opt_b]: 4.832e-05, [1] [Cycle 1]: 4.145e-05, [2] [frontend_op_eliminate]: 1.537e-05 [inline_after_opt_a]: 1.51e-05 [cconv]: 2.675e-05 [loop_unroll]: 0.00083515 [jit_opt_after_cconv]: 0.00016137, [1] [Cycle 1]: 0.00015438, [11] [c_1]: 2.21e-05 [parameter_eliminate]: 3.41001e-06 [updatestate_depend_eliminate]: 6.96001e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.443e-05 [call_graph_tuple_transform]: 1.87e-05 [tuple_list_get_item_eliminator]: 1.597e-05 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.699e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 6.44999e-06 [add_recomputation]: 5.41e-05 [cse_after_recomputation]: 2.469e-05, [1] [Cycle 1]: 1.93e-05, [1] [cse]: 1.301e-05 [auto_monad_reorder]: 1.768e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 5.69999e-06 [opt_after_jit_grad]: 0.00046011 [symbol_engine_optimizer]: 7.318e-05, [1] [Cycle 1]: 6.692e-05, [6] [build]: 3.37997e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 6.11e-06 [fold_const_symbol]: 9.05001e-06 [renormalize]: 3.10014e-07 [validate]: 3.988e-05 Sums bootstrap : 0.000273s : 3.02% type_inference : 0.004459s : 49.25% event_method : 0.000017s : 0.19% auto_monad : 0.000061s : 0.67% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000031s : 0.34% rewriter_before_opt_a : 0.000072s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000067s : 0.74% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000701s : 7.75% jit_opt_a.with_stream_mark : 0.000036s : 0.39% jit_opt_a.recompute_prepare : 0.000014s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000012s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000749s : 8.27% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.23% jit_opt_a.cse : 0.000049s : 0.54% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000038s : 0.42% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000558s : 6.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000027s : 0.30% loop_unroll : 0.000835s : 9.22% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000024s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000016s : 0.18% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000054s : 0.60% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000460s : 5.08% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.44% Time group info: ------[substitution.] 0.000239 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000006s : 3: substitution.graph_param_transform 85.06% : 0.000203s : 4: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000006s : 4: substitution.remove_not_recompute_node 2.19% : 0.000005s : 2: substitution.replace_old_param 5.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004403 2 82.40% : 0.003628s : 1: type_inference.infer 17.60% : 0.000775s : 1: type_inference.specialize ------[replace.] 0.000071 6 69.00% : 0.000049s : 4: replace.inline 31.00% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.51% : 0.000201s : 4: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.94% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000004s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.73% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.23% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000620 13 51.78% : 0.000321s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.52% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.71% : 0.000246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029827 72 0.19% : 0.000057s : 1: add_recomputation 0.22% : 0.000064s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 0.97% : 0.000291s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000021s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 69.07% : 0.020602s : 1: jit_opt_a 0.55% : 0.000164s : 1: jit_opt_after_cconv 0.17% : 0.000051s : 1: jit_opt_b 2.84% : 0.000846s : 1: loop_unroll 1.90% : 0.000567s : 1: mutable_eliminate 3.09% : 0.000921s : 26: opt.transform.jit_opt_a 0.20% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.57% : 0.000468s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000034s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 1.42% : 0.000424s : 1: renormalize.infer 1.06% : 0.000317s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000041s : 1: rewriter_after_opt_a 0.25% : 0.000075s : 1: rewriter_before_opt_a 0.25% : 0.000076s : 1: symbol_engine_optimizer 14.99% : 0.004473s : 1: type_inference TotalTime = 0.0363185, [30] [bootstrap]: 0.00033848 [type_inference]: 0.0264253 [event_method]: 1.927e-05 [auto_monad]: 6.609e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00011087 [rewriter_before_opt_a]: 8.056e-05 [expand_dump_flag]: 3.03998e-06 [jit_opt_a]: 0.00688346, [2] [Cycle 1]: 0.00213917, [27] [switch_simplify]: 7.56e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.00058657 [with_stream_mark]: 2.197e-05 [recompute_prepare]: 7.4e-06 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00105887 [add_forward_monad_depend]: 7.01001e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.596e-05 [cse]: 3.802e-05 [replace_applicator]: 1.676e-05 [Cycle 2]: 0.00035823, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.04e-06 [a_1]: 9.087e-05 [with_stream_mark]: 1.294e-05 [recompute_prepare]: 6.01998e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 4.94003e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 7.93999e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.46998e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 6.43e-06 [cse]: 3.396e-05 [replace_applicator]: 6.63003e-06 [py_interpret_to_execute_after_opt_a]: 1.451e-05 [rewriter_after_opt_a]: 3.957e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00066394 [jit_opt_b]: 5.173e-05, [1] [Cycle 1]: 4.461e-05, [2] [frontend_op_eliminate]: 1.669e-05 [inline_after_opt_a]: 1.698e-05 [cconv]: 2.866e-05 [loop_unroll]: 0.00043142 [jit_opt_after_cconv]: 0.00015499, [1] [Cycle 1]: 0.00014897, [11] [c_1]: 2.05e-05 [parameter_eliminate]: 2.95998e-06 [updatestate_depend_eliminate]: 6.99001e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 3.213e-05 [call_graph_tuple_transform]: 1.98e-05 [tuple_list_get_item_eliminator]: 5.46998e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.43002e-06 [remove_dup_value]: 1.495e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 5.89e-06 [add_recomputation]: 5.134e-05 [cse_after_recomputation]: 7.826e-05, [1] [Cycle 1]: 2.163e-05, [1] [cse]: 1.469e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.56e-06 [opt_after_jit_grad]: 0.00049259 [symbol_engine_optimizer]: 8.809e-05, [1] [Cycle 1]: 8.157e-05, [6] [build]: 4.12e-06 [elim_shapecalc]: 7.31999e-06 [elim_not_effective]: 2.539e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 6.29982e-07 [validate]: 4.247e-05 Sums bootstrap : 0.000338s : 1.08% type_inference : 0.026425s : 84.50% event_method : 0.000019s : 0.06% auto_monad : 0.000066s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000111s : 0.35% rewriter_before_opt_a : 0.000081s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000082s : 0.26% jit_opt_a.loop_unroll : 0.000039s : 0.13% jit_opt_a.a_1 : 0.000677s : 2.17% jit_opt_a.with_stream_mark : 0.000035s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001059s : 3.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000072s : 0.23% jit_opt_a.replace_applicator : 0.000023s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000664s : 2.12% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000029s : 0.09% loop_unroll : 0.000431s : 1.38% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.16% cse_after_recomputation.cse : 0.000015s : 0.05% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000493s : 1.58% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.14% Time group info: ------[substitution.] 0.000251 23 5.49% : 0.000014s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 3: substitution.graph_param_transform 81.10% : 0.000204s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 5.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026343 2 93.76% : 0.024700s : 1: type_inference.infer 6.24% : 0.001643s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.22% : 0.000052s : 4: replace.inline 30.78% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.51% : 0.000201s : 4: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.27% : 0.000002s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000002s : 10: predicate.print_const_string_wrapper 2.06% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.64% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 2.23% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000010s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000900 13 44.87% : 0.000404s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.50% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.63% : 0.000447s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038367 72 0.14% : 0.000054s : 1: add_recomputation 0.18% : 0.000070s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.94% : 0.000360s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.21% : 0.000080s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.95% : 0.006887s : 1: jit_opt_a 0.41% : 0.000158s : 1: jit_opt_after_cconv 0.14% : 0.000054s : 1: jit_opt_b 1.15% : 0.000440s : 1: loop_unroll 1.76% : 0.000674s : 1: mutable_eliminate 2.41% : 0.000924s : 26: opt.transform.jit_opt_a 0.12% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000045s : 4: opt.transform.symbol_engine_opt 1.31% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000114s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.60% : 0.000614s : 1: renormalize.infer 1.14% : 0.000436s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.22% : 0.000084s : 1: rewriter_before_opt_a 0.24% : 0.000091s : 1: symbol_engine_optimizer 68.92% : 0.026443s : 1: type_inference TotalTime = 0.029393, [30] [bootstrap]: 0.00032754 [type_inference]: 0.0205155 [event_method]: 2.259e-05 [auto_monad]: 7.13e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00011407 [rewriter_before_opt_a]: 8.613e-05 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.00601289, [2] [Cycle 1]: 0.00208003, [27] [switch_simplify]: 5.89e-05 [loop_unroll]: 3.06e-05 [a_1]: 0.00057295 [with_stream_mark]: 2.44e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.581e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.88998e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.0010371 [add_forward_monad_depend]: 6.33e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.592e-05 [cse]: 3.916e-05 [replace_applicator]: 1.352e-05 [Cycle 2]: 0.00033574, [27] [switch_simplify]: 6.15002e-06 [loop_unroll]: 5.35001e-06 [a_1]: 9.819e-05 [with_stream_mark]: 1.012e-05 [recompute_prepare]: 5.40999e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.49998e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.37e-05 [j_node_and_user_rematch]: 8.39998e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 6.17001e-06 [cse]: 1.368e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.451e-05 [rewriter_after_opt_a]: 4.056e-05 [convert_after_rewriter]: 7.56999e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00058592 [jit_opt_b]: 4.946e-05, [1] [Cycle 1]: 4.309e-05, [2] [frontend_op_eliminate]: 1.623e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 2.541e-05 [loop_unroll]: 0.00042952 [jit_opt_after_cconv]: 0.00014457, [1] [Cycle 1]: 0.00013847, [11] [c_1]: 2.106e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.468e-05 [call_graph_tuple_transform]: 1.964e-05 [tuple_list_get_item_eliminator]: 5.91e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.594e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.29999e-06 [add_recomputation]: 5.399e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.255e-05 [auto_monad_reorder]: 1.78e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.96e-06 [opt_after_jit_grad]: 0.0004748 [symbol_engine_optimizer]: 9.395e-05, [1] [Cycle 1]: 8.728e-05, [6] [build]: 4.23001e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 3.063e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 4.59986e-07 [validate]: 4.345e-05 Sums bootstrap : 0.000328s : 1.30% type_inference : 0.020516s : 81.42% event_method : 0.000023s : 0.09% auto_monad : 0.000071s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000114s : 0.45% rewriter_before_opt_a : 0.000086s : 0.34% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000671s : 2.66% jit_opt_a.with_stream_mark : 0.000035s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001037s : 4.12% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000053s : 0.21% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000041s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000586s : 2.33% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000025s : 0.10% loop_unroll : 0.000430s : 1.70% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000054s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000475s : 1.88% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000031s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.17% Time group info: ------[substitution.] 0.000238 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 3: substitution.graph_param_transform 84.78% : 0.000202s : 4: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000005s : 2: substitution.replace_old_param 5.61% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020431 2 91.75% : 0.018744s : 1: type_inference.infer 8.25% : 0.001686s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.83% : 0.000050s : 4: replace.inline 31.17% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.20% : 0.000199s : 4: match.inline 5.80% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.51% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.85% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.16% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 22: predicate.inline 1.07% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.59% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.45% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.52% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000876 13 42.22% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.92% : 0.000455s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031395 72 0.18% : 0.000057s : 1: add_recomputation 0.24% : 0.000075s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.10% : 0.000347s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.16% : 0.006016s : 1: jit_opt_a 0.47% : 0.000147s : 1: jit_opt_after_cconv 0.17% : 0.000052s : 1: jit_opt_b 1.39% : 0.000437s : 1: loop_unroll 1.89% : 0.000595s : 1: mutable_eliminate 2.85% : 0.000895s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.08% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000051s : 4: opt.transform.symbol_engine_opt 1.54% : 0.000484s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000119s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.89% : 0.000593s : 1: renormalize.infer 1.39% : 0.000436s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.29% : 0.000090s : 1: rewriter_before_opt_a 0.31% : 0.000097s : 1: symbol_engine_optimizer 65.41% : 0.020535s : 1: type_inference TotalTime = 0.175393, [30] [bootstrap]: 0.00035865 [type_inference]: 0.134833 [event_method]: 2.655e-05 [auto_monad]: 8.026e-05 [graph_reusing]: 5.96998e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00030366 [rewriter_before_opt_a]: 0.0001073 [expand_dump_flag]: 3.81999e-06 [jit_opt_a]: 0.0370971, [2] [Cycle 1]: 0.0328497, [27] [switch_simplify]: 7.184e-05 [loop_unroll]: 3.584e-05 [a_1]: 0.00076218 [with_stream_mark]: 2.364e-05 [recompute_prepare]: 1.001e-05 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 7.27002e-06 [updatestate_useless_node_eliminater]: 6.63003e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 6.94001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 1.157e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.083e-05 [inline_without_move]: 6.58998e-06 [renormalize]: 0.00258745 [add_forward_monad_depend]: 9.42001e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.885e-05 [cse]: 3.926e-05 [replace_applicator]: 2.431e-05 [Cycle 2]: 0.00046904, [27] [switch_simplify]: 7.44002e-06 [loop_unroll]: 6.58e-06 [a_1]: 0.00013487 [with_stream_mark]: 1.415e-05 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.625e-05 [cell_reuse_handle_not_recompute_node_pass]: 2.066e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.135e-05 [inline_without_move]: 6.01e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.26002e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 7.01999e-06 [cse]: 1.745e-05 [replace_applicator]: 4.293e-05 [py_interpret_to_execute_after_opt_a]: 1.603e-05 [rewriter_after_opt_a]: 4.325e-05 [convert_after_rewriter]: 8.08001e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00078467 [jit_opt_b]: 6.074e-05, [1] [Cycle 1]: 5.188e-05, [2] [frontend_op_eliminate]: 1.997e-05 [inline_after_opt_a]: 2.014e-05 [cconv]: 2.928e-05 [loop_unroll]: 0.00044679 [jit_opt_after_cconv]: 0.00017839, [1] [Cycle 1]: 0.00017195, [11] [c_1]: 3.003e-05 [parameter_eliminate]: 4.05e-06 [updatestate_depend_eliminate]: 8.15e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.23998e-06 [cse]: 3.386e-05 [call_graph_tuple_transform]: 2.293e-05 [tuple_list_get_item_eliminator]: 6.89001e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 1.60013e-07 [switch_simplify]: 6.55002e-06 [remove_dup_value]: 1.976e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 1.036e-05 [add_recomputation]: 5.363e-05 [cse_after_recomputation]: 2.667e-05, [1] [Cycle 1]: 2.129e-05, [1] [cse]: 1.494e-05 [auto_monad_reorder]: 1.782e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 5.59e-06 [opt_after_jit_grad]: 0.00047741 [symbol_engine_optimizer]: 7.918e-05, [1] [Cycle 1]: 7.274e-05, [6] [build]: 4.57e-06 [elim_shapecalc]: 9.79e-06 [elim_not_effective]: 1.393e-05 [opt_reshape]: 6.91001e-06 [fold_const_symbol]: 1.028e-05 [renormalize]: 3.00002e-07 [validate]: 7.385e-05 Sums bootstrap : 0.000359s : 0.25% type_inference : 0.134833s : 94.97% event_method : 0.000027s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000304s : 0.21% rewriter_before_opt_a : 0.000107s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000897s : 0.63% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000017s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002588s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000057s : 0.04% jit_opt_a.replace_applicator : 0.000067s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000785s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000447s : 0.31% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000477s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000074s : 0.05% Time group info: ------[substitution.] 0.000305 25 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 4: substitution.graph_param_transform 87.11% : 0.000266s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000006s : 4: substitution.remove_not_recompute_node 2.13% : 0.000006s : 2: substitution.replace_old_param 4.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.134720 2 98.16% : 0.132234s : 1: type_inference.infer 1.84% : 0.002485s : 1: type_inference.specialize ------[replace.] 0.000110 7 69.80% : 0.000077s : 5: replace.inline 30.20% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 95.80% : 0.000262s : 5: match.inline 4.20% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 888 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 2.20% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.90% : 0.000009s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.18% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.82% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 19: predicate.partial_eliminate 1.42% : 0.000002s : 13: predicate.print_const_string_wrapper 2.10% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000011s : 65: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.77% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002931 29 69.58% : 0.002039s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.98% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.43% : 0.000804s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.179231 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000085s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.21% : 0.000382s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 20.70% : 0.037101s : 1: jit_opt_a 0.10% : 0.000181s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.25% : 0.000455s : 1: loop_unroll 0.44% : 0.000796s : 1: mutable_eliminate 0.68% : 0.001213s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000311s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.96% : 0.001716s : 1: renormalize.infer 0.47% : 0.000850s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000066s : 1: rewriter_after_opt_a 0.06% : 0.000113s : 1: rewriter_before_opt_a 0.05% : 0.000082s : 1: symbol_engine_optimizer 75.24% : 0.134857s : 1: type_inference TotalTime = 0.275259, [30] [bootstrap]: 0.00038121 [type_inference]: 0.238076 [event_method]: 0.00727022 [auto_monad]: 0.00021027 [graph_reusing]: 1.078e-05 [pre_auto_parallel]: 4.23999e-06 [py_interpret_to_execute]: 6.831e-05 [rewriter_before_opt_a]: 0.00019727 [expand_dump_flag]: 4.43001e-06 [jit_opt_a]: 0.026245, [2] [Cycle 1]: 0.00650139, [27] [switch_simplify]: 0.00025152 [loop_unroll]: 5.578e-05 [a_1]: 0.00172288 [with_stream_mark]: 2.62e-05 [recompute_prepare]: 9.91e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 7.16001e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 6.48998e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.747e-05 [j_node_and_user_rematch]: 1.149e-05 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.189e-05 [inline_without_move]: 6.37001e-06 [renormalize]: 0.00401465 [add_forward_monad_depend]: 1.014e-05 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 2.069e-05 [cse]: 4.083e-05 [replace_applicator]: 2.24e-05 [Cycle 2]: 0.0003779, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.97001e-06 [a_1]: 0.00011048 [with_stream_mark]: 1.543e-05 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.71998e-06 [updatestate_useless_node_eliminater]: 5.41998e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.05001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.78998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.37002e-06 [cse]: 1.372e-05 [replace_applicator]: 6.06998e-06 [py_interpret_to_execute_after_opt_a]: 1.838e-05 [rewriter_after_opt_a]: 4.32e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00091915 [jit_opt_b]: 6.049e-05, [1] [Cycle 1]: 5.122e-05, [2] [frontend_op_eliminate]: 2.04e-05 [inline_after_opt_a]: 1.839e-05 [cconv]: 3.168e-05 [loop_unroll]: 0.00046611 [jit_opt_after_cconv]: 0.00017166, [1] [Cycle 1]: 0.00016512, [11] [c_1]: 2.235e-05 [parameter_eliminate]: 3.66001e-06 [updatestate_depend_eliminate]: 8.33001e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 3.186e-05 [call_graph_tuple_transform]: 2.484e-05 [tuple_list_get_item_eliminator]: 5.96998e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.833e-05 [partial_unused_args_eliminate]: 3.46999e-06 [environ_conv]: 6.81001e-06 [add_recomputation]: 5.174e-05 [cse_after_recomputation]: 2.461e-05, [1] [Cycle 1]: 1.896e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.899e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 7.75998e-06 [opt_after_jit_grad]: 0.00054104 [symbol_engine_optimizer]: 8.313e-05, [1] [Cycle 1]: 7.517e-05, [6] [build]: 4.08001e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.525e-05 [opt_reshape]: 7.55e-06 [fold_const_symbol]: 8.96002e-06 [renormalize]: 7.39994e-07 [validate]: 4.571e-05 Sums bootstrap : 0.000381s : 0.15% type_inference : 0.238076s : 93.31% event_method : 0.007270s : 2.85% auto_monad : 0.000210s : 0.08% graph_reusing : 0.000011s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000068s : 0.03% rewriter_before_opt_a : 0.000197s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000258s : 0.10% jit_opt_a.loop_unroll : 0.000062s : 0.02% jit_opt_a.a_1 : 0.001833s : 0.72% jit_opt_a.with_stream_mark : 0.000042s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004015s : 1.57% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000055s : 0.02% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000919s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000466s : 0.18% jit_opt_after_cconv.c_1 : 0.000022s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000052s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000541s : 0.21% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.02% Time group info: ------[substitution.] 0.000795 35 0.23% : 0.000002s : 2: substitution.elim_not_effective 0.18% : 0.000001s : 2: substitution.fold_const_symbol 0.91% : 0.000007s : 3: substitution.graph_param_transform 91.51% : 0.000727s : 12: substitution.inline 0.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.81% : 0.000006s : 4: substitution.remove_not_recompute_node 0.89% : 0.000007s : 2: substitution.replace_old_param 1.32% : 0.000010s : 1: substitution.reshape_eliminate 2.02% : 0.000016s : 3: substitution.switch_simplify 1.47% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.237949 2 97.92% : 0.232990s : 1: type_inference.infer 2.08% : 0.004959s : 1: type_inference.specialize ------[replace.] 0.000394 18 49.96% : 0.000197s : 12: replace.inline 1.15% : 0.000005s : 1: replace.reshape_eliminate 22.45% : 0.000088s : 3: replace.switch_simplify 26.45% : 0.000104s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000756 18 95.44% : 0.000721s : 12: match.inline 1.28% : 0.000010s : 1: match.reshape_eliminate 1.87% : 0.000014s : 3: match.switch_simplify 1.41% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000215 1212 1.41% : 0.000003s : 19: predicate.accumulaten_eliminater 0.75% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000003s : 19: predicate.addn_check_dump 1.63% : 0.000003s : 19: predicate.addn_zero_filter 1.97% : 0.000004s : 19: predicate.arithmetic_simplify 1.64% : 0.000004s : 20: predicate.cast_eliminate 0.22% : 0.000000s : 3: predicate.check_bprop_eliminate 1.24% : 0.000003s : 19: predicate.compare_switch_simplify 1.36% : 0.000003s : 19: predicate.depend_value_elim 1.36% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.47% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.51% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.56% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.20% : 0.000000s : 3: predicate.elim_not_effective 0.36% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.53% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_depend_swap 1.48% : 0.000003s : 20: predicate.environ_get_eliminate 1.33% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.69% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000001s : 3: predicate.graph_param_transform 5.07% : 0.000011s : 40: predicate.inline 0.47% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000002s : 6: predicate.less_batch_normalization 1.71% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.79% : 0.000004s : 25: predicate.load_eliminater 0.74% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.77% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.25% : 0.000003s : 19: predicate.merge_addn 1.29% : 0.000003s : 19: predicate.minmaximum_grad 1.16% : 0.000003s : 3: predicate.mutable_eliminate 0.32% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000004s : 25: predicate.partial_eliminate 1.38% : 0.000003s : 19: predicate.print_const_string_wrapper 1.99% : 0.000004s : 19: predicate.reduce_eliminate 1.68% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000003s : 28: predicate.replace_applicator 0.28% : 0.000001s : 6: predicate.replace_old_param 0.20% : 0.000000s : 3: predicate.reset_defer_inline 1.78% : 0.000004s : 20: predicate.reshape_eliminate 1.57% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000003s : 19: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000002s : 6: predicate.special_op_eliminate 0.54% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.22% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.13% : 0.000007s : 34: predicate.switch_defer_inline 2.47% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.91% : 0.000019s : 107: predicate.switch_simplify 1.40% : 0.000003s : 19: predicate.tile_eliminate 1.44% : 0.000003s : 19: predicate.transpose_eliminate 1.69% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000004s : 20: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.79% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.62% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.64% : 0.000004s : 25: predicate.updatestate_pure_node_eliminater 2.21% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.88% : 0.000004s : 19: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004382 40 56.94% : 0.002495s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.80% : 0.000430s : 5: func_graph_cloner_run.FuncGraphClonerNode 33.26% : 0.001457s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.281614 72 0.02% : 0.000055s : 1: add_recomputation 0.08% : 0.000219s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.14% : 0.000402s : 1: bootstrap 0.01% : 0.000034s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 2.59% : 0.007305s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000013s : 1: graph_reusing 9.32% : 0.026250s : 1: jit_opt_a 0.06% : 0.000174s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.17% : 0.000475s : 1: loop_unroll 0.33% : 0.000929s : 1: mutable_eliminate 0.82% : 0.002300s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000550s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.03% : 0.000071s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.02% : 0.002867s : 1: renormalize.infer 0.40% : 0.001136s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.07% : 0.000201s : 1: rewriter_before_opt_a 0.03% : 0.000086s : 1: symbol_engine_optimizer 84.55% : 0.238109s : 1: type_inference TotalTime = 0.0328322, [30] [bootstrap]: 0.00028573 [type_inference]: 0.0222546 [event_method]: 2.263e-05 [auto_monad]: 7.48e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.00012057 [rewriter_before_opt_a]: 8.707e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00751204, [2] [Cycle 1]: 0.00350288, [27] [switch_simplify]: 6.323e-05 [loop_unroll]: 3.051e-05 [a_1]: 0.00059575 [with_stream_mark]: 2.387e-05 [recompute_prepare]: 7.78999e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.91999e-06 [get_grad_eliminate_]: 5.78997e-06 [merge_forward]: 3.82002e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.052e-05 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00240935 [add_forward_monad_depend]: 7.68999e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.916e-05 [cse]: 3.81e-05 [replace_applicator]: 1.765e-05 [Cycle 2]: 0.00034169, [27] [switch_simplify]: 6.04999e-06 [loop_unroll]: 5.72001e-06 [a_1]: 9.235e-05 [with_stream_mark]: 1.363e-05 [recompute_prepare]: 5.27999e-06 [updatestate_depend_eliminate]: 3.65998e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.616e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 5.07e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.68e-06 [cse]: 1.301e-05 [replace_applicator]: 5.31002e-06 [py_interpret_to_execute_after_opt_a]: 1.478e-05 [rewriter_after_opt_a]: 4.098e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 4.75001e-06 [mutable_eliminate]: 0.00070696 [jit_opt_b]: 5.466e-05, [1] [Cycle 1]: 4.686e-05, [2] [frontend_op_eliminate]: 1.739e-05 [inline_after_opt_a]: 1.813e-05 [cconv]: 2.93e-05 [loop_unroll]: 0.00044287 [jit_opt_after_cconv]: 0.00020805, [1] [Cycle 1]: 0.00020129, [11] [c_1]: 2.214e-05 [parameter_eliminate]: 3.28e-06 [updatestate_depend_eliminate]: 8.17003e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.001e-05 [call_graph_tuple_transform]: 2.113e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.48998e-06 [add_recomputation]: 5.572e-05 [cse_after_recomputation]: 2.333e-05, [1] [Cycle 1]: 1.752e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.856e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 6.13998e-06 [opt_after_jit_grad]: 0.00049526 [symbol_engine_optimizer]: 9.908e-05, [1] [Cycle 1]: 9.278e-05, [6] [build]: 4.25999e-06 [elim_shapecalc]: 9.13002e-06 [elim_not_effective]: 2.995e-05 [opt_reshape]: 6.45997e-06 [fold_const_symbol]: 1.05e-05 [renormalize]: 9.89996e-07 [validate]: 4.32e-05 Sums bootstrap : 0.000286s : 1.00% type_inference : 0.022255s : 78.09% event_method : 0.000023s : 0.08% auto_monad : 0.000075s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000121s : 0.42% rewriter_before_opt_a : 0.000087s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000688s : 2.41% jit_opt_a.with_stream_mark : 0.000038s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.002409s : 8.45% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000051s : 0.18% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000041s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000707s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.000443s : 1.55% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000056s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000495s : 1.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000030s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.15% Time group info: ------[substitution.] 0.000258 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 3: substitution.graph_param_transform 84.89% : 0.000219s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 5.25% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022165 2 91.64% : 0.020311s : 1: type_inference.infer 8.36% : 0.001854s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.63% : 0.000051s : 4: replace.inline 32.37% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.67% : 0.000216s : 4: match.inline 5.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.45% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.17% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.53% : 0.000003s : 15: predicate.partial_eliminate 1.34% : 0.000002s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.57% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.58% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.11% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000974 13 40.48% : 0.000394s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.95% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.57% : 0.000522s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036239 72 0.16% : 0.000059s : 1: add_recomputation 0.22% : 0.000078s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.84% : 0.000304s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 20.74% : 0.007515s : 1: jit_opt_a 0.58% : 0.000211s : 1: jit_opt_after_cconv 0.16% : 0.000057s : 1: jit_opt_b 1.24% : 0.000451s : 1: loop_unroll 1.98% : 0.000717s : 1: mutable_eliminate 2.55% : 0.000924s : 26: opt.transform.jit_opt_a 0.14% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000053s : 4: opt.transform.symbol_engine_opt 1.39% : 0.000504s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000125s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 5.30% : 0.001919s : 1: renormalize.infer 1.32% : 0.000480s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000044s : 1: rewriter_after_opt_a 0.25% : 0.000091s : 1: rewriter_before_opt_a 0.28% : 0.000102s : 1: symbol_engine_optimizer 61.47% : 0.022275s : 1: type_inference TotalTime = 0.0304702, [30] [bootstrap]: 0.00028342 [type_inference]: 0.0221046 [event_method]: 2.183e-05 [auto_monad]: 7.194e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00010605 [rewriter_before_opt_a]: 8.376e-05 [expand_dump_flag]: 2.99999e-06 [jit_opt_a]: 0.00560306, [2] [Cycle 1]: 0.00194042, [27] [switch_simplify]: 5.561e-05 [loop_unroll]: 2.974e-05 [a_1]: 0.00054029 [with_stream_mark]: 2.179e-05 [recompute_prepare]: 7.58999e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.37002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.51998e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00095514 [add_forward_monad_depend]: 4.87998e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.534e-05 [cse]: 3.77e-05 [replace_applicator]: 1.185e-05 [Cycle 2]: 0.00031645, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.19e-06 [a_1]: 8.891e-05 [with_stream_mark]: 9.26998e-06 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 7.98999e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 6.86999e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 5.57999e-06 [cse]: 1.223e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.134e-05 [rewriter_after_opt_a]: 3.631e-05 [convert_after_rewriter]: 6.33002e-06 [order_py_execute_after_rewriter]: 5.47999e-06 [mutable_eliminate]: 0.00054345 [jit_opt_b]: 4.777e-05, [1] [Cycle 1]: 4.111e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.473e-05 [cconv]: 2.916e-05 [loop_unroll]: 0.00044996 [jit_opt_after_cconv]: 0.00014402, [1] [Cycle 1]: 0.00013753, [11] [c_1]: 2.081e-05 [parameter_eliminate]: 3.22002e-06 [updatestate_depend_eliminate]: 6.19999e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.186e-05 [call_graph_tuple_transform]: 1.93e-05 [tuple_list_get_item_eliminator]: 5.69999e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.15001e-06 [remove_dup_value]: 1.651e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 5.86998e-06 [add_recomputation]: 5.315e-05 [cse_after_recomputation]: 2.487e-05, [1] [Cycle 1]: 1.921e-05, [1] [cse]: 1.331e-05 [auto_monad_reorder]: 1.956e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.62001e-06 [opt_after_jit_grad]: 0.00046353 [symbol_engine_optimizer]: 7.26e-05, [1] [Cycle 1]: 6.542e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 5.60001e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 5.10016e-07 [validate]: 3.944e-05 Sums bootstrap : 0.000283s : 1.07% type_inference : 0.022105s : 83.35% event_method : 0.000022s : 0.08% auto_monad : 0.000072s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000106s : 0.40% rewriter_before_opt_a : 0.000084s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.23% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000629s : 2.37% jit_opt_a.with_stream_mark : 0.000031s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000955s : 3.60% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000036s : 0.14% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000543s : 2.05% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000015s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000450s : 1.70% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000464s : 1.75% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.15% Time group info: ------[substitution.] 0.000218 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000005s : 3: substitution.graph_param_transform 84.85% : 0.000185s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000004s : 2: substitution.replace_old_param 5.71% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022018 2 91.42% : 0.020128s : 1: type_inference.infer 8.58% : 0.001890s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.84% : 0.000048s : 4: replace.inline 32.16% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.15% : 0.000183s : 4: match.inline 5.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.87% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.67% : 0.000001s : 3: predicate.graph_param_transform 5.54% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.53% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000854 13 46.71% : 0.000399s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.34% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.95% : 0.000410s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032318 72 0.23% : 0.000074s : 1: add_recomputation 0.23% : 0.000075s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 0.94% : 0.000303s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.35% : 0.005606s : 1: jit_opt_a 0.45% : 0.000147s : 1: jit_opt_after_cconv 0.16% : 0.000050s : 1: jit_opt_b 1.42% : 0.000459s : 1: loop_unroll 1.71% : 0.000552s : 1: mutable_eliminate 2.61% : 0.000843s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000472s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000110s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.73% : 0.000559s : 1: renormalize.infer 1.20% : 0.000388s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000039s : 1: rewriter_after_opt_a 0.27% : 0.000087s : 1: rewriter_before_opt_a 0.23% : 0.000075s : 1: symbol_engine_optimizer 68.47% : 0.022128s : 1: type_inference TotalTime = 0.0327974, [30] [bootstrap]: 0.00038252 [type_inference]: 0.0231913 [event_method]: 2.311e-05 [auto_monad]: 7.529e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00012389 [rewriter_before_opt_a]: 8.752e-05 [expand_dump_flag]: 3.03998e-06 [jit_opt_a]: 0.00638395, [2] [Cycle 1]: 0.00229652, [27] [switch_simplify]: 6.31e-05 [loop_unroll]: 3.061e-05 [a_1]: 0.00062974 [with_stream_mark]: 2.635e-05 [recompute_prepare]: 1.142e-05 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 3.14001e-06 [replace_old_param]: 1.066e-05 [inline_without_move]: 5.44e-06 [renormalize]: 0.00112117 [add_forward_monad_depend]: 8.64998e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 2.002e-05 [cse]: 3.975e-05 [replace_applicator]: 1.904e-05 [Cycle 2]: 0.00035523, [27] [switch_simplify]: 6.39999e-06 [loop_unroll]: 5.62001e-06 [a_1]: 9.203e-05 [with_stream_mark]: 1.362e-05 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.45001e-06 [specialize_transform]: 5.71998e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 4.86997e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.739e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 4.99e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.45001e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 7.87003e-06 [cse]: 1.539e-05 [replace_applicator]: 5.51998e-06 [py_interpret_to_execute_after_opt_a]: 1.718e-05 [rewriter_after_opt_a]: 4.582e-05 [convert_after_rewriter]: 8.89998e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00071406 [jit_opt_b]: 5.387e-05, [1] [Cycle 1]: 4.519e-05, [2] [frontend_op_eliminate]: 1.648e-05 [inline_after_opt_a]: 1.699e-05 [cconv]: 3.155e-05 [loop_unroll]: 0.00052835 [jit_opt_after_cconv]: 0.00016184, [1] [Cycle 1]: 0.0001549, [11] [c_1]: 2.198e-05 [parameter_eliminate]: 3.98001e-06 [updatestate_depend_eliminate]: 7.16999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.98e-06 [cse]: 3.063e-05 [call_graph_tuple_transform]: 2.175e-05 [tuple_list_get_item_eliminator]: 5.53002e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 6.00002e-06 [remove_dup_value]: 1.759e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 5.003e-05 [cse_after_recomputation]: 2.138e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.071e-05 [auto_monad_reorder]: 1.73e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 6.63e-06 [opt_after_jit_grad]: 0.0005045 [symbol_engine_optimizer]: 7.444e-05, [1] [Cycle 1]: 6.819e-05, [6] [build]: 4.21001e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 5.99999e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 5.89993e-07 [validate]: 4.16e-05 Sums bootstrap : 0.000383s : 1.35% type_inference : 0.023191s : 81.70% event_method : 0.000023s : 0.08% auto_monad : 0.000075s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000124s : 0.44% rewriter_before_opt_a : 0.000088s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000722s : 2.54% jit_opt_a.with_stream_mark : 0.000040s : 0.14% jit_opt_a.recompute_prepare : 0.000018s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001121s : 3.95% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.10% jit_opt_a.cse : 0.000055s : 0.19% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000046s : 0.16% convert_after_rewriter : 0.000009s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000714s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000032s : 0.11% loop_unroll : 0.000528s : 1.86% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000504s : 1.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.15% Time group info: ------[substitution.] 0.000267 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 85.10% : 0.000228s : 4: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000006s : 4: substitution.remove_not_recompute_node 2.64% : 0.000007s : 2: substitution.replace_old_param 5.13% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023101 2 91.78% : 0.021201s : 1: type_inference.infer 8.22% : 0.001899s : 1: type_inference.specialize ------[replace.] 0.000088 6 67.05% : 0.000059s : 4: replace.inline 32.95% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 94.74% : 0.000225s : 4: match.inline 5.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.98% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 2.11% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.44% : 0.000002s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001035 13 45.70% : 0.000473s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.62% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.68% : 0.000504s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034947 72 0.15% : 0.000053s : 1: add_recomputation 0.23% : 0.000079s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.16% : 0.000406s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.07% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 18.28% : 0.006387s : 1: jit_opt_a 0.47% : 0.000165s : 1: jit_opt_after_cconv 0.16% : 0.000057s : 1: jit_opt_b 1.54% : 0.000539s : 1: loop_unroll 2.08% : 0.000727s : 1: mutable_eliminate 2.77% : 0.000967s : 26: opt.transform.jit_opt_a 0.15% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.47% : 0.000514s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000128s : 1: py_interpret_to_execute 0.06% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.84% : 0.000644s : 1: renormalize.infer 1.34% : 0.000467s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000050s : 1: rewriter_after_opt_a 0.26% : 0.000092s : 1: rewriter_before_opt_a 0.22% : 0.000077s : 1: symbol_engine_optimizer 66.43% : 0.023215s : 1: type_inference TotalTime = 0.0292193, [30] [bootstrap]: 0.00026131 [type_inference]: 0.0207543 [event_method]: 2.052e-05 [auto_monad]: 8.223e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00011915 [rewriter_before_opt_a]: 8.672e-05 [expand_dump_flag]: 3.62002e-06 [jit_opt_a]: 0.00574422, [2] [Cycle 1]: 0.00205898, [27] [switch_simplify]: 5.907e-05 [loop_unroll]: 3.148e-05 [a_1]: 0.00062663 [with_stream_mark]: 1.991e-05 [recompute_prepare]: 7.83001e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00098323 [add_forward_monad_depend]: 5.10999e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.552e-05 [cse]: 3.495e-05 [replace_applicator]: 1.29e-05 [Cycle 2]: 0.00032462, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.177e-05 [with_stream_mark]: 9.49e-06 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.239e-05 [j_node_and_user_rematch]: 7.92998e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 5.29e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.339e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.092e-05 [rewriter_after_opt_a]: 3.661e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00052351 [jit_opt_b]: 4.965e-05, [1] [Cycle 1]: 4.318e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.651e-05 [cconv]: 2.418e-05 [loop_unroll]: 0.0004154 [jit_opt_after_cconv]: 0.00014274, [1] [Cycle 1]: 0.00013683, [11] [c_1]: 2.188e-05 [parameter_eliminate]: 2.48998e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.33998e-06 [cse]: 2.196e-05 [call_graph_tuple_transform]: 1.868e-05 [tuple_list_get_item_eliminator]: 5.58002e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 5.59e-06 [add_recomputation]: 4.925e-05 [cse_after_recomputation]: 2.276e-05, [1] [Cycle 1]: 1.69e-05, [1] [cse]: 1.109e-05 [auto_monad_reorder]: 1.683e-05 [get_jit_bprop_graph]: 1.805e-05 [rewriter_after_jit_bprop_graph]: 4.82998e-06 [opt_after_jit_grad]: 0.00046497 [symbol_engine_optimizer]: 7.328e-05, [1] [Cycle 1]: 6.713e-05, [6] [build]: 5.12e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 8.51002e-06 [renormalize]: 3.50003e-07 [validate]: 6.921e-05 Sums bootstrap : 0.000261s : 1.03% type_inference : 0.020754s : 82.10% event_method : 0.000021s : 0.08% auto_monad : 0.000082s : 0.33% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000119s : 0.47% rewriter_before_opt_a : 0.000087s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.15% jit_opt_a.a_1 : 0.000718s : 2.84% jit_opt_a.with_stream_mark : 0.000029s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.000983s : 3.89% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000048s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000037s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000524s : 2.07% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000024s : 0.10% loop_unroll : 0.000415s : 1.64% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000018s : 0.07% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000465s : 1.84% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000069s : 0.27% Time group info: ------[substitution.] 0.000221 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 3: substitution.graph_param_transform 85.21% : 0.000188s : 4: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000004s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.84% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020676 2 91.80% : 0.018980s : 1: type_inference.infer 8.20% : 0.001696s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.69% : 0.000052s : 4: replace.inline 31.31% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.04% : 0.000186s : 4: match.inline 5.96% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.54% : 0.000002s : 10: predicate.print_const_string_wrapper 1.94% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.45% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000881 13 44.14% : 0.000389s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.42% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.43% : 0.000444s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031165 72 0.17% : 0.000052s : 1: add_recomputation 0.28% : 0.000087s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 0.90% : 0.000279s : 1: bootstrap 0.09% : 0.000027s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.07% : 0.000021s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.44% : 0.005747s : 1: jit_opt_a 0.47% : 0.000146s : 1: jit_opt_after_cconv 0.17% : 0.000052s : 1: jit_opt_b 1.36% : 0.000423s : 1: loop_unroll 1.71% : 0.000532s : 1: mutable_eliminate 3.02% : 0.000940s : 26: opt.transform.jit_opt_a 0.16% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000474s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000123s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.83% : 0.000571s : 1: renormalize.infer 1.30% : 0.000404s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000039s : 1: rewriter_after_opt_a 0.29% : 0.000090s : 1: rewriter_before_opt_a 0.24% : 0.000076s : 1: symbol_engine_optimizer 66.65% : 0.020773s : 1: type_inference TotalTime = 0.810401, [30] [bootstrap]: 0.00039197 [type_inference]: 0.68818 [event_method]: 2.316e-05 [auto_monad]: 6.884e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.58998e-06 [py_interpret_to_execute]: 0.00052491 [rewriter_before_opt_a]: 0.00010509 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.118338, [2] [Cycle 1]: 0.114465, [27] [switch_simplify]: 6.257e-05 [loop_unroll]: 3.516e-05 [a_1]: 0.0007273 [with_stream_mark]: 1.813e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.99001e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 6.60002e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.534e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.36002e-06 [inline_without_move]: 6.41998e-06 [renormalize]: 0.113221 [add_forward_monad_depend]: 1.053e-05 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 2.05e-05 [cse]: 4.034e-05 [replace_applicator]: 2.631e-05 [Cycle 2]: 0.00043148, [27] [switch_simplify]: 8.02998e-06 [loop_unroll]: 7.11001e-06 [a_1]: 0.0001552 [with_stream_mark]: 1.706e-05 [recompute_prepare]: 6.34001e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.60997e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 7.3e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 3.81999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.68998e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 6.07001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.436e-05 [replace_applicator]: 6.36e-06 [py_interpret_to_execute_after_opt_a]: 1.719e-05 [rewriter_after_opt_a]: 4.276e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00085046 [jit_opt_b]: 0.00010444, [1] [Cycle 1]: 9.653e-05, [2] [frontend_op_eliminate]: 6.23e-05 [inline_after_opt_a]: 1.995e-05 [cconv]: 2.887e-05 [loop_unroll]: 0.00043411 [jit_opt_after_cconv]: 0.00019073, [1] [Cycle 1]: 0.00018452, [11] [c_1]: 2.853e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 6.66e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.452e-05 [call_graph_tuple_transform]: 2.163e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 7.15e-06 [remove_dup_value]: 1.802e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 9.44e-06 [add_recomputation]: 5.353e-05 [cse_after_recomputation]: 2.604e-05, [1] [Cycle 1]: 2.073e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 5.17e-06 [rewriter_after_jit_bprop_graph]: 7.28e-06 [opt_after_jit_grad]: 0.00045949 [symbol_engine_optimizer]: 8.616e-05, [1] [Cycle 1]: 8.037e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 1.151e-05 [elim_not_effective]: 1.511e-05 [opt_reshape]: 7.51999e-06 [fold_const_symbol]: 1.229e-05 [renormalize]: 3.29979e-07 [validate]: 0.00019197 Sums bootstrap : 0.000392s : 0.05% type_inference : 0.688180s : 85.35% event_method : 0.000023s : 0.00% auto_monad : 0.000069s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000525s : 0.07% rewriter_before_opt_a : 0.000105s : 0.01% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.01% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000882s : 0.11% jit_opt_a.with_stream_mark : 0.000035s : 0.00% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.113221s : 14.04% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.00% jit_opt_a.cse : 0.000055s : 0.01% jit_opt_a.replace_applicator : 0.000033s : 0.00% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000850s : 0.11% jit_opt_b.frontend_op_eliminate : 0.000062s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.00% cconv : 0.000029s : 0.00% loop_unroll : 0.000434s : 0.05% jit_opt_after_cconv.c_1 : 0.000029s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000054s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000459s : 0.06% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000192s : 0.02% Time group info: ------[substitution.] 0.000284 28 1.25% : 0.000004s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 4: substitution.graph_param_transform 81.62% : 0.000232s : 5: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.38% : 0.000015s : 3: substitution.reduce_eliminate 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_old_param 4.01% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.688100 2 99.46% : 0.684411s : 1: type_inference.infer 0.54% : 0.003689s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.72% : 0.000071s : 5: replace.inline 31.28% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 7 95.84% : 0.000229s : 5: match.inline 4.16% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.53% : 0.000002s : 13: predicate.accumulaten_eliminater 0.83% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.45% : 0.000004s : 13: predicate.arithmetic_simplify 1.61% : 0.000003s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.37% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.60% : 0.000003s : 13: predicate.environ_get_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.01% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 2.40% : 0.000004s : 13: predicate.reduce_eliminate 1.57% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 13: predicate.reshape_eliminate 1.56% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000004s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.74% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003368 25 56.92% : 0.001917s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.37% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.71% : 0.001371s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.924720 72 0.01% : 0.000056s : 1: add_recomputation 0.01% : 0.000072s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.04% : 0.000411s : 1: bootstrap 0.00% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.00% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 12.80% : 0.118342s : 1: jit_opt_a 0.02% : 0.000193s : 1: jit_opt_after_cconv 0.01% : 0.000107s : 1: jit_opt_b 0.05% : 0.000441s : 1: loop_unroll 0.09% : 0.000859s : 1: mutable_eliminate 0.12% : 0.001142s : 26: opt.transform.jit_opt_a 0.01% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000075s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.00% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.00% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.05% : 0.000466s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000532s : 1: py_interpret_to_execute 0.00% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000020s : 1: remove_dup_value 12.08% : 0.111710s : 1: renormalize.infer 0.16% : 0.001496s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.00% : 0.000046s : 1: rewriter_after_opt_a 0.01% : 0.000110s : 1: rewriter_before_opt_a 0.01% : 0.000089s : 1: symbol_engine_optimizer 74.42% : 0.688198s : 1: type_inference TotalTime = 0.224387, [30] [bootstrap]: 0.00034041 [type_inference]: 0.213626 [event_method]: 2.266e-05 [auto_monad]: 6.984e-05 [graph_reusing]: 5.98002e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00040254 [rewriter_before_opt_a]: 8.579e-05 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.00735629, [2] [Cycle 1]: 0.00351797, [27] [switch_simplify]: 6.075e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00061663 [with_stream_mark]: 2.242e-05 [recompute_prepare]: 9.54e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 4.44998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.0024172 [add_forward_monad_depend]: 7.92e-06 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 1.828e-05 [cse]: 3.345e-05 [replace_applicator]: 1.797e-05 [Cycle 2]: 0.00035976, [27] [switch_simplify]: 6.44001e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00011723 [with_stream_mark]: 1.211e-05 [recompute_prepare]: 6.10002e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 5.65001e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.83997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 8.68001e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.107e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.24e-05 [rewriter_after_opt_a]: 3.623e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 4.82998e-06 [mutable_eliminate]: 0.00066389 [jit_opt_b]: 6.583e-05, [1] [Cycle 1]: 5.784e-05, [2] [frontend_op_eliminate]: 1.776e-05 [inline_after_opt_a]: 1.722e-05 [cconv]: 2.744e-05 [loop_unroll]: 0.00044374 [jit_opt_after_cconv]: 0.0001565, [1] [Cycle 1]: 0.00014916, [11] [c_1]: 2.575e-05 [parameter_eliminate]: 2.80002e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.693e-05 [call_graph_tuple_transform]: 2.034e-05 [tuple_list_get_item_eliminator]: 6.08002e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.569e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 7.93999e-06 [add_recomputation]: 5.071e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.752e-05, [1] [cse]: 1.104e-05 [auto_monad_reorder]: 1.553e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00048689 [symbol_engine_optimizer]: 8.235e-05, [1] [Cycle 1]: 7.416e-05, [6] [build]: 4.23999e-06 [elim_shapecalc]: 8.12998e-06 [elim_not_effective]: 1.729e-05 [opt_reshape]: 7.71999e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 4.39992e-07 [validate]: 0.00014082 Sums bootstrap : 0.000340s : 0.15% type_inference : 0.213626s : 96.99% event_method : 0.000023s : 0.01% auto_monad : 0.000070s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000403s : 0.18% rewriter_before_opt_a : 0.000086s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.03% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000734s : 0.33% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002417s : 1.10% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000045s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000664s : 0.30% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000444s : 0.20% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000051s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000487s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000141s : 0.06% Time group info: ------[substitution.] 0.000222 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 83.51% : 0.000185s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000005s : 2: substitution.replace_old_param 6.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.213538 2 98.78% : 0.210925s : 1: type_inference.infer 1.22% : 0.002613s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.31% : 0.000050s : 4: replace.inline 31.69% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.75% : 0.000183s : 4: match.inline 6.25% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.67% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 4.91% : 0.000006s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.14% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.50% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.30% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.58% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002303 22 71.51% : 0.001647s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.86% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.63% : 0.000613s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.227740 72 0.02% : 0.000054s : 1: add_recomputation 0.03% : 0.000073s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.16% : 0.000361s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.23% : 0.007360s : 1: jit_opt_a 0.07% : 0.000159s : 1: jit_opt_after_cconv 0.03% : 0.000069s : 1: jit_opt_b 0.20% : 0.000452s : 1: loop_unroll 0.30% : 0.000672s : 1: mutable_eliminate 0.43% : 0.000971s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000409s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.76% : 0.001722s : 1: renormalize.infer 0.30% : 0.000686s : 1: renormalize.specialize 0.01% : 0.000034s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.04% : 0.000092s : 1: rewriter_before_opt_a 0.04% : 0.000085s : 1: symbol_engine_optimizer 93.81% : 0.213647s : 1: type_inference TotalTime = 0.0333164, [30] [bootstrap]: 0.00037272 [type_inference]: 0.0230457 [event_method]: 2.171e-05 [auto_monad]: 7.324e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.98998e-06 [py_interpret_to_execute]: 0.00012995 [rewriter_before_opt_a]: 9.235e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00670413, [2] [Cycle 1]: 0.00242707, [27] [switch_simplify]: 7.732e-05 [loop_unroll]: 3.145e-05 [a_1]: 0.00062558 [with_stream_mark]: 2.779e-05 [recompute_prepare]: 9.50001e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.67001e-06 [specialize_transform]: 7.71999e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.721e-05 [j_node_and_user_rematch]: 1.102e-05 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 1.075e-05 [inline_without_move]: 5.74999e-06 [renormalize]: 0.00124333 [add_forward_monad_depend]: 8.47e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.858e-05 [cse]: 4.033e-05 [replace_applicator]: 1.919e-05 [Cycle 2]: 0.00046654, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.25001e-06 [a_1]: 9.422e-05 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 5.63002e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 3.93999e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.724e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.94e-06 [auto_monad_grad]: 1.17999e-06 [auto_monad_eliminator]: 8.52998e-06 [cse]: 1.823e-05 [replace_applicator]: 5.98998e-06 [py_interpret_to_execute_after_opt_a]: 1.767e-05 [rewriter_after_opt_a]: 4.015e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00078528 [jit_opt_b]: 6.257e-05, [1] [Cycle 1]: 5.311e-05, [2] [frontend_op_eliminate]: 1.928e-05 [inline_after_opt_a]: 2.047e-05 [cconv]: 3.472e-05 [loop_unroll]: 0.00056273 [jit_opt_after_cconv]: 0.00019247, [1] [Cycle 1]: 0.00018392, [11] [c_1]: 2.449e-05 [parameter_eliminate]: 5.05001e-06 [updatestate_depend_eliminate]: 1.029e-05 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.75002e-06 [cse]: 4.419e-05 [call_graph_tuple_transform]: 2.448e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 1.89e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.956e-05 [cse_after_recomputation]: 2.686e-05, [1] [Cycle 1]: 2.045e-05, [1] [cse]: 1.361e-05 [auto_monad_reorder]: 2.054e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 1.073e-05 [opt_after_jit_grad]: 0.00062345 [symbol_engine_optimizer]: 8.399e-05, [1] [Cycle 1]: 7.666e-05, [6] [build]: 5.49e-06 [elim_shapecalc]: 8.49002e-06 [elim_not_effective]: 1.605e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 1.10999e-06 [validate]: 5.05e-05 Sums bootstrap : 0.000373s : 1.30% type_inference : 0.023046s : 80.37% event_method : 0.000022s : 0.08% auto_monad : 0.000073s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000130s : 0.45% rewriter_before_opt_a : 0.000092s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000084s : 0.29% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000720s : 2.51% jit_opt_a.with_stream_mark : 0.000043s : 0.15% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000015s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001243s : 4.34% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.09% jit_opt_a.cse : 0.000059s : 0.20% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000018s : 0.06% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000785s : 2.74% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.07% jit_opt_b.inline_after_opt_a : 0.000020s : 0.07% cconv : 0.000035s : 0.12% loop_unroll : 0.000563s : 1.96% jit_opt_after_cconv.c_1 : 0.000024s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000044s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000060s : 0.21% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000021s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.04% opt_after_jit_grad : 0.000623s : 2.17% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.18% Time group info: ------[substitution.] 0.000267 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.44% : 0.000007s : 3: substitution.graph_param_transform 84.89% : 0.000226s : 4: substitution.inline 1.87% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 2.01% : 0.000005s : 2: substitution.replace_old_param 5.45% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022958 2 92.04% : 0.021132s : 1: type_inference.infer 7.96% : 0.001826s : 1: type_inference.specialize ------[replace.] 0.000086 6 70.38% : 0.000061s : 4: replace.inline 29.62% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 94.39% : 0.000223s : 4: match.inline 5.61% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.08% : 0.000001s : 10: predicate.accumulaten_eliminater 1.73% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 2.29% : 0.000003s : 10: predicate.arithmetic_simplify 1.19% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.66% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.71% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.16% : 0.000001s : 6: predicate.get_grad_eliminate 0.58% : 0.000001s : 3: predicate.graph_param_transform 6.14% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.22% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 2.22% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 3.43% : 0.000004s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.44% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000010s : 53: predicate.switch_simplify 1.08% : 0.000001s : 10: predicate.tile_eliminate 1.08% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001021 13 44.20% : 0.000451s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.60% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.19% : 0.000512s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035607 72 0.18% : 0.000064s : 1: add_recomputation 0.22% : 0.000077s : 1: auto_monad 0.07% : 0.000024s : 1: auto_monad_reorder 1.11% : 0.000397s : 1: bootstrap 0.11% : 0.000038s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000046s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.84% : 0.006708s : 1: jit_opt_a 0.55% : 0.000195s : 1: jit_opt_after_cconv 0.19% : 0.000066s : 1: jit_opt_b 1.62% : 0.000575s : 1: loop_unroll 2.25% : 0.000801s : 1: mutable_eliminate 2.74% : 0.000974s : 26: opt.transform.jit_opt_a 0.16% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000031s : 4: opt.transform.jit_opt_b 0.05% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000024s : 1: opt.transform.mutable_eliminate 0.09% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.79% : 0.000638s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000135s : 1: py_interpret_to_execute 0.06% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000022s : 1: remove_dup_value 2.05% : 0.000729s : 1: renormalize.infer 1.41% : 0.000503s : 1: renormalize.specialize 0.04% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000044s : 1: rewriter_after_opt_a 0.27% : 0.000097s : 1: rewriter_before_opt_a 0.24% : 0.000087s : 1: symbol_engine_optimizer 64.80% : 0.023074s : 1: type_inference TotalTime = 0.102811, [30] [bootstrap]: 0.00036557 [type_inference]: 0.0768968 [event_method]: 2.523e-05 [auto_monad]: 7.935e-05 [graph_reusing]: 6.13998e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 0.00036175 [rewriter_before_opt_a]: 0.00010845 [expand_dump_flag]: 3.85e-06 [jit_opt_a]: 0.0222503, [2] [Cycle 1]: 0.0179412, [27] [switch_simplify]: 7.066e-05 [loop_unroll]: 3.496e-05 [a_1]: 0.00074895 [with_stream_mark]: 2.353e-05 [recompute_prepare]: 9.46e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 7.53999e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 7.17002e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.86001e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.733e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.081e-05 [inline_without_move]: 7.16999e-06 [renormalize]: 0.0165685 [add_forward_monad_depend]: 1.461e-05 [auto_monad_grad]: 3.01001e-06 [auto_monad_eliminator]: 3.109e-05 [cse]: 6.524e-05 [replace_applicator]: 3.461e-05 [Cycle 2]: 0.00046077, [27] [switch_simplify]: 8.99e-06 [loop_unroll]: 8.23999e-06 [a_1]: 0.00015386 [with_stream_mark]: 1.902e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 4.60001e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 7.53999e-06 [meta_shard_fg_expand]: 2.38002e-06 [get_grad_eliminate_]: 7.1e-06 [merge_forward]: 4.70999e-06 [cell_reuse_recompute_pass]: 3.78001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.615e-05 [j_node_and_user_rematch]: 1.173e-05 [meta_fg_expand]: 2.90002e-06 [replace_old_param]: 1.158e-05 [inline_without_move]: 6.58998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 7.05e-06 [cse]: 1.898e-05 [replace_applicator]: 6.98998e-06 [py_interpret_to_execute_after_opt_a]: 2.325e-05 [rewriter_after_opt_a]: 5.022e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.0008736 [jit_opt_b]: 6.141e-05, [1] [Cycle 1]: 5.352e-05, [2] [frontend_op_eliminate]: 2.185e-05 [inline_after_opt_a]: 2.025e-05 [cconv]: 3.352e-05 [loop_unroll]: 0.00045835 [jit_opt_after_cconv]: 0.00018057, [1] [Cycle 1]: 0.00017396, [11] [c_1]: 2.833e-05 [parameter_eliminate]: 3.49001e-06 [updatestate_depend_eliminate]: 7.78001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 3.507e-05 [call_graph_tuple_transform]: 2.413e-05 [tuple_list_get_item_eliminator]: 7.07002e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 7.18e-06 [remove_dup_value]: 2.045e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 1.105e-05 [add_recomputation]: 5.449e-05 [cse_after_recomputation]: 2.827e-05, [1] [Cycle 1]: 2.128e-05, [1] [cse]: 1.518e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 6.19999e-06 [opt_after_jit_grad]: 0.00047933 [symbol_engine_optimizer]: 8.242e-05, [1] [Cycle 1]: 7.621e-05, [6] [build]: 4.52e-06 [elim_shapecalc]: 9.54e-06 [elim_not_effective]: 1.615e-05 [opt_reshape]: 8.32e-06 [fold_const_symbol]: 1.036e-05 [renormalize]: 3.00002e-07 [validate]: 0.00010798 Sums bootstrap : 0.000366s : 0.37% type_inference : 0.076897s : 78.25% event_method : 0.000025s : 0.03% auto_monad : 0.000079s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000362s : 0.37% rewriter_before_opt_a : 0.000108s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.08% jit_opt_a.loop_unroll : 0.000043s : 0.04% jit_opt_a.a_1 : 0.000903s : 0.92% jit_opt_a.with_stream_mark : 0.000043s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.016569s : 16.86% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.04% jit_opt_a.cse : 0.000084s : 0.09% jit_opt_a.replace_applicator : 0.000042s : 0.04% py_interpret_to_execute_after_opt_a : 0.000023s : 0.02% rewriter_after_opt_a : 0.000050s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000874s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000458s : 0.47% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.06% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000479s : 0.49% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000108s : 0.11% Time group info: ------[substitution.] 0.000305 25 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.39% : 0.000007s : 4: substitution.graph_param_transform 85.90% : 0.000262s : 5: substitution.inline 1.71% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000007s : 2: substitution.replace_old_param 4.41% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076794 2 96.78% : 0.074322s : 1: type_inference.infer 3.22% : 0.002473s : 1: type_inference.specialize ------[replace.] 0.000111 7 69.17% : 0.000076s : 5: replace.inline 30.83% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000271 7 95.52% : 0.000259s : 5: match.inline 4.48% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 888 1.88% : 0.000003s : 13: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000003s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.73% : 0.000003s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.89% : 0.000003s : 13: predicate.reduce_eliminate 1.61% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.66% : 0.000003s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.83% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.99% : 0.000011s : 65: predicate.switch_simplify 1.51% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.67% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002957 29 69.57% : 0.002057s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.93% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.49% : 0.000813s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120593 72 0.05% : 0.000057s : 1: add_recomputation 0.07% : 0.000083s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.32% : 0.000384s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 18.45% : 0.022255s : 1: jit_opt_a 0.15% : 0.000183s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.39% : 0.000466s : 1: loop_unroll 0.73% : 0.000884s : 1: mutable_eliminate 1.00% : 0.001206s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000368s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.53% : 0.001842s : 1: renormalize.infer 12.20% : 0.014709s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000053s : 1: rewriter_after_opt_a 0.09% : 0.000114s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 63.78% : 0.076918s : 1: type_inference TotalTime = 0.0321434, [30] [bootstrap]: 0.00031138 [type_inference]: 0.023284 [event_method]: 2.114e-05 [auto_monad]: 7.342e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00011413 [rewriter_before_opt_a]: 8.821e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00582413, [2] [Cycle 1]: 0.00207593, [27] [switch_simplify]: 5.86e-05 [loop_unroll]: 3.323e-05 [a_1]: 0.00056897 [with_stream_mark]: 2.093e-05 [recompute_prepare]: 8.31002e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.77998e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.641e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.49e-06 [renormalize]: 0.00103201 [add_forward_monad_depend]: 6.16e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.791e-05 [cse]: 3.692e-05 [replace_applicator]: 1.492e-05 [Cycle 2]: 0.00034078, [27] [switch_simplify]: 6.62002e-06 [loop_unroll]: 5.64e-06 [a_1]: 9.234e-05 [with_stream_mark]: 1.021e-05 [recompute_prepare]: 5.49998e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.33998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.06997e-06 [accelerated_algorithm]: 5.31002e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.406e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 7.92e-06 [cse]: 1.402e-05 [replace_applicator]: 5.95002e-06 [py_interpret_to_execute_after_opt_a]: 1.545e-05 [rewriter_after_opt_a]: 4.246e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00061681 [jit_opt_b]: 5.317e-05, [1] [Cycle 1]: 4.518e-05, [2] [frontend_op_eliminate]: 1.693e-05 [inline_after_opt_a]: 1.649e-05 [cconv]: 2.812e-05 [loop_unroll]: 0.00054021 [jit_opt_after_cconv]: 0.00015952, [1] [Cycle 1]: 0.00015273, [11] [c_1]: 2.171e-05 [parameter_eliminate]: 3.47002e-06 [updatestate_depend_eliminate]: 7.95e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 3.001e-05 [call_graph_tuple_transform]: 2.2e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.88e-06 [add_recomputation]: 5.256e-05 [cse_after_recomputation]: 2.294e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.626e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 6.48e-06 [opt_after_jit_grad]: 0.00050787 [symbol_engine_optimizer]: 7.525e-05, [1] [Cycle 1]: 6.893e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 8.89998e-06 [renormalize]: 4.60015e-07 [validate]: 4.295e-05 Sums bootstrap : 0.000311s : 1.11% type_inference : 0.023284s : 82.81% event_method : 0.000021s : 0.08% auto_monad : 0.000073s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000114s : 0.41% rewriter_before_opt_a : 0.000088s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.23% jit_opt_a.loop_unroll : 0.000039s : 0.14% jit_opt_a.a_1 : 0.000661s : 2.35% jit_opt_a.with_stream_mark : 0.000031s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001032s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000051s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000617s : 2.19% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.10% loop_unroll : 0.000540s : 1.92% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000016s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000508s : 1.81% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.15% Time group info: ------[substitution.] 0.000233 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 83.88% : 0.000196s : 4: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.52% : 0.000006s : 2: substitution.replace_old_param 5.37% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023204 2 92.61% : 0.021490s : 1: type_inference.infer 7.39% : 0.001714s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.64% : 0.000051s : 4: replace.inline 32.36% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.44% : 0.000193s : 4: match.inline 5.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.76% : 0.000001s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.79% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.98% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.22% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.48% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.40% : 0.000002s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000950 13 46.68% : 0.000443s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.32% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.00% : 0.000456s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034130 72 0.16% : 0.000055s : 1: add_recomputation 0.23% : 0.000078s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 0.98% : 0.000334s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.07% : 0.005828s : 1: jit_opt_a 0.47% : 0.000162s : 1: jit_opt_after_cconv 0.16% : 0.000056s : 1: jit_opt_b 1.61% : 0.000550s : 1: loop_unroll 1.84% : 0.000629s : 1: mutable_eliminate 2.61% : 0.000892s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000517s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000118s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.74% : 0.000594s : 1: renormalize.infer 1.26% : 0.000428s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000045s : 1: rewriter_after_opt_a 0.27% : 0.000092s : 1: rewriter_before_opt_a 0.23% : 0.000078s : 1: symbol_engine_optimizer 68.28% : 0.023304s : 1: type_inference TotalTime = 0.0321489, [30] [bootstrap]: 0.00033432 [type_inference]: 0.0227941 [event_method]: 2.249e-05 [auto_monad]: 7.575e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00012052 [rewriter_before_opt_a]: 8.828e-05 [expand_dump_flag]: 3.20002e-06 [jit_opt_a]: 0.00608043, [2] [Cycle 1]: 0.00213969, [27] [switch_simplify]: 6.038e-05 [loop_unroll]: 3.222e-05 [a_1]: 0.00058309 [with_stream_mark]: 2.339e-05 [recompute_prepare]: 8.87999e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.70002e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.91999e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 3.23e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00105682 [add_forward_monad_depend]: 6.58e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.783e-05 [cse]: 3.892e-05 [replace_applicator]: 1.576e-05 [Cycle 2]: 0.00034777, [27] [switch_simplify]: 7.20998e-06 [loop_unroll]: 5.92001e-06 [a_1]: 9.228e-05 [with_stream_mark]: 1.099e-05 [recompute_prepare]: 5.62999e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.47002e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.25e-06 [inline_without_move]: 4.87e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.57002e-06 [cse]: 1.601e-05 [replace_applicator]: 6.81999e-06 [py_interpret_to_execute_after_opt_a]: 1.537e-05 [rewriter_after_opt_a]: 4.174e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.36998e-06 [mutable_eliminate]: 0.0006735 [jit_opt_b]: 5.55e-05, [1] [Cycle 1]: 4.669e-05, [2] [frontend_op_eliminate]: 1.749e-05 [inline_after_opt_a]: 1.744e-05 [cconv]: 3.191e-05 [loop_unroll]: 0.00051659 [jit_opt_after_cconv]: 0.00018685, [1] [Cycle 1]: 0.00017955, [11] [c_1]: 2.223e-05 [parameter_eliminate]: 3.88001e-06 [updatestate_depend_eliminate]: 9.01002e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 4.858e-05 [call_graph_tuple_transform]: 2.155e-05 [tuple_list_get_item_eliminator]: 6.00002e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.766e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 6.17001e-06 [add_recomputation]: 5.646e-05 [cse_after_recomputation]: 2.734e-05, [1] [Cycle 1]: 2.088e-05, [1] [cse]: 1.288e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 7.98001e-06 [opt_after_jit_grad]: 0.00058336 [symbol_engine_optimizer]: 9.822e-05, [1] [Cycle 1]: 9.04e-05, [6] [build]: 7.15e-06 [elim_shapecalc]: 9.20999e-06 [elim_not_effective]: 1.486e-05 [opt_reshape]: 2.063e-05 [fold_const_symbol]: 9.59e-06 [renormalize]: 7.50006e-07 [validate]: 4.698e-05 Sums bootstrap : 0.000334s : 1.20% type_inference : 0.022794s : 81.75% event_method : 0.000022s : 0.08% auto_monad : 0.000076s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000121s : 0.43% rewriter_before_opt_a : 0.000088s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.24% jit_opt_a.loop_unroll : 0.000038s : 0.14% jit_opt_a.a_1 : 0.000675s : 2.42% jit_opt_a.with_stream_mark : 0.000034s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001057s : 3.79% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000055s : 0.20% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000674s : 2.42% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000032s : 0.11% loop_unroll : 0.000517s : 1.85% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000049s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000056s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000583s : 2.09% symbol_engine_optimizer.build : 0.000007s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000021s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.17% Time group info: ------[substitution.] 0.000240 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.20% : 0.000005s : 3: substitution.graph_param_transform 85.66% : 0.000206s : 4: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000004s : 4: substitution.remove_not_recompute_node 2.01% : 0.000005s : 2: substitution.replace_old_param 5.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022659 2 92.05% : 0.020857s : 1: type_inference.infer 7.95% : 0.001802s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.01% : 0.000052s : 4: replace.inline 30.99% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.74% : 0.000203s : 4: match.inline 5.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.25% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.36% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.15% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.99% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 2.86% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 3.15% : 0.000004s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 1.97% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.44% : 0.000010s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.05% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001011 13 47.14% : 0.000477s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.86% : 0.000484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034200 72 0.17% : 0.000060s : 1: add_recomputation 0.23% : 0.000079s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.04% : 0.000356s : 1: bootstrap 0.10% : 0.000035s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000030s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.79% : 0.006084s : 1: jit_opt_a 0.56% : 0.000190s : 1: jit_opt_after_cconv 0.17% : 0.000059s : 1: jit_opt_b 1.54% : 0.000528s : 1: loop_unroll 2.01% : 0.000687s : 1: mutable_eliminate 2.67% : 0.000913s : 26: opt.transform.jit_opt_a 0.15% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000020s : 1: opt.transform.mutable_eliminate 0.08% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000051s : 4: opt.transform.symbol_engine_opt 1.75% : 0.000598s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000125s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.79% : 0.000612s : 1: renormalize.infer 1.27% : 0.000436s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000045s : 1: rewriter_after_opt_a 0.27% : 0.000093s : 1: rewriter_before_opt_a 0.30% : 0.000101s : 1: symbol_engine_optimizer 66.73% : 0.022820s : 1: type_inference TotalTime = 0.0329042, [30] [bootstrap]: 0.00033308 [type_inference]: 0.0208375 [event_method]: 2.241e-05 [auto_monad]: 7.217e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 0.00010061 [rewriter_before_opt_a]: 8.775e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.00872917, [2] [Cycle 1]: 0.00234742, [27] [switch_simplify]: 7.103e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00066892 [with_stream_mark]: 2.476e-05 [recompute_prepare]: 9.47999e-06 [updatestate_depend_eliminate]: 4.83001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 5.58002e-06 [renormalize]: 0.0011629 [add_forward_monad_depend]: 8.30999e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.877e-05 [cse]: 3.599e-05 [replace_applicator]: 1.965e-05 [Cycle 2]: 0.00034001, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.15999e-06 [a_1]: 8.912e-05 [with_stream_mark]: 1.358e-05 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.79e-06 [inline_without_move]: 4.94998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.01998e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 6.51e-06 [cse]: 1.374e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.579e-05 [rewriter_after_opt_a]: 4.242e-05 [convert_after_rewriter]: 7.00998e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00076764 [jit_opt_b]: 5.568e-05, [1] [Cycle 1]: 4.656e-05, [2] [frontend_op_eliminate]: 1.598e-05 [inline_after_opt_a]: 1.858e-05 [cconv]: 3.694e-05 [loop_unroll]: 0.0004929 [jit_opt_after_cconv]: 0.00021128, [1] [Cycle 1]: 0.00020394, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 6.39001e-06 [updatestate_depend_eliminate]: 1.056e-05 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.935e-05 [call_graph_tuple_transform]: 2.414e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.24e-06 [remove_dup_value]: 1.619e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 6.86001e-06 [add_recomputation]: 5.652e-05 [cse_after_recomputation]: 2.768e-05, [1] [Cycle 1]: 2.067e-05, [1] [cse]: 1.345e-05 [auto_monad_reorder]: 1.85e-05 [get_jit_bprop_graph]: 2.70997e-06 [rewriter_after_jit_bprop_graph]: 8.97e-06 [opt_after_jit_grad]: 0.00058427 [symbol_engine_optimizer]: 8.334e-05, [1] [Cycle 1]: 7.408e-05, [6] [build]: 5.88002e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.536e-05 [opt_reshape]: 6.78e-06 [fold_const_symbol]: 9.30001e-06 [renormalize]: 6.09987e-07 [validate]: 4.904e-05 Sums bootstrap : 0.000333s : 1.27% type_inference : 0.020838s : 79.65% event_method : 0.000022s : 0.09% auto_monad : 0.000072s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000101s : 0.38% rewriter_before_opt_a : 0.000088s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.30% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000758s : 2.90% jit_opt_a.with_stream_mark : 0.000038s : 0.15% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001163s : 4.45% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.10% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000025s : 0.10% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000042s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000768s : 2.93% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000019s : 0.07% cconv : 0.000037s : 0.14% loop_unroll : 0.000493s : 1.88% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000039s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000057s : 0.22% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000584s : 2.23% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.19% Time group info: ------[substitution.] 0.000318 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.94% : 0.000006s : 3: substitution.graph_param_transform 87.97% : 0.000280s : 4: substitution.inline 1.42% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.48% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000006s : 2: substitution.replace_old_param 4.05% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020755 2 92.27% : 0.019150s : 1: type_inference.infer 7.73% : 0.001605s : 1: type_inference.specialize ------[replace.] 0.000084 6 69.86% : 0.000059s : 4: replace.inline 30.14% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 6 95.92% : 0.000277s : 4: match.inline 4.08% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.93% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000003s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.05% : 0.000001s : 10: predicate.dict_set_item_eliminator 2.03% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.62% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 7.47% : 0.000010s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.18% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 3.26% : 0.000004s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.43% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.42% : 0.000001s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.84% : 0.000010s : 53: predicate.switch_simplify 1.06% : 0.000001s : 10: predicate.tile_eliminate 1.08% : 0.000001s : 10: predicate.transpose_eliminate 1.20% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000919 13 45.37% : 0.000417s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.54% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.09% : 0.000442s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035124 72 0.17% : 0.000060s : 1: add_recomputation 0.22% : 0.000076s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.00% : 0.000350s : 1: bootstrap 0.11% : 0.000040s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000030s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 24.86% : 0.008732s : 1: jit_opt_a 0.61% : 0.000214s : 1: jit_opt_after_cconv 0.17% : 0.000058s : 1: jit_opt_b 1.43% : 0.000504s : 1: loop_unroll 2.24% : 0.000788s : 1: mutable_eliminate 2.85% : 0.001001s : 26: opt.transform.jit_opt_a 0.15% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000022s : 1: opt.transform.mutable_eliminate 0.09% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.70% : 0.000596s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000104s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.90% : 0.000669s : 1: renormalize.infer 1.38% : 0.000486s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000046s : 1: rewriter_after_opt_a 0.26% : 0.000091s : 1: rewriter_before_opt_a 0.24% : 0.000086s : 1: symbol_engine_optimizer 59.39% : 0.020859s : 1: type_inference TotalTime = 0.0415349, [30] [bootstrap]: 0.00045864 [type_inference]: 0.0283614 [event_method]: 2.15e-05 [auto_monad]: 8.006e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 1.065e-05 [py_interpret_to_execute]: 0.00034558 [rewriter_before_opt_a]: 0.0001116 [expand_dump_flag]: 4.07e-06 [jit_opt_a]: 0.00852015, [2] [Cycle 1]: 0.00392327, [27] [switch_simplify]: 7.212e-05 [loop_unroll]: 3.029e-05 [a_1]: 0.00065535 [with_stream_mark]: 2.514e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.70002e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.102e-05 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00274991 [add_forward_monad_depend]: 7.53999e-06 [auto_monad_grad]: 1.92999e-06 [auto_monad_eliminator]: 2.006e-05 [cse]: 3.999e-05 [replace_applicator]: 1.805e-05 [Cycle 2]: 0.00037018, [27] [switch_simplify]: 7.65e-06 [loop_unroll]: 6.66e-06 [a_1]: 0.00010917 [with_stream_mark]: 1.287e-05 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.81003e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 8.79998e-06 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 7.14001e-06 [cse]: 1.405e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.437e-05 [rewriter_after_opt_a]: 4.866e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00078009 [jit_opt_b]: 5.846e-05, [1] [Cycle 1]: 4.84e-05, [2] [frontend_op_eliminate]: 1.967e-05 [inline_after_opt_a]: 1.725e-05 [cconv]: 2.732e-05 [loop_unroll]: 0.00052598 [jit_opt_after_cconv]: 0.00016778, [1] [Cycle 1]: 0.00015994, [11] [c_1]: 2.358e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 7.34002e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.974e-05 [call_graph_tuple_transform]: 2.16e-05 [tuple_list_get_item_eliminator]: 5.92001e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 6.26998e-06 [remove_dup_value]: 1.701e-05 [partial_unused_args_eliminate]: 3.33e-06 [environ_conv]: 7e-06 [add_recomputation]: 6.06e-05 [cse_after_recomputation]: 2.604e-05, [1] [Cycle 1]: 1.991e-05, [1] [cse]: 1.37e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 6.97002e-06 [opt_after_jit_grad]: 0.0005022 [symbol_engine_optimizer]: 8.478e-05, [1] [Cycle 1]: 7.814e-05, [6] [build]: 5.00999e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.34e-05 [opt_reshape]: 8.55999e-06 [fold_const_symbol]: 1.094e-05 [renormalize]: 6.89994e-07 [validate]: 4.506e-05 Sums bootstrap : 0.000459s : 1.29% type_inference : 0.028361s : 79.56% event_method : 0.000021s : 0.06% auto_monad : 0.000080s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000011s : 0.03% py_interpret_to_execute : 0.000346s : 0.97% rewriter_before_opt_a : 0.000112s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000080s : 0.22% jit_opt_a.loop_unroll : 0.000037s : 0.10% jit_opt_a.a_1 : 0.000765s : 2.14% jit_opt_a.with_stream_mark : 0.000038s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.002750s : 7.71% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.08% jit_opt_a.cse : 0.000054s : 0.15% jit_opt_a.replace_applicator : 0.000024s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000049s : 0.14% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000780s : 2.19% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000027s : 0.08% loop_unroll : 0.000526s : 1.48% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000061s : 0.17% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000502s : 1.41% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.13% Time group info: ------[substitution.] 0.000286 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 1.00% : 0.000003s : 2: substitution.fold_const_symbol 2.44% : 0.000007s : 3: substitution.graph_param_transform 84.84% : 0.000243s : 4: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.83% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000006s : 2: substitution.replace_old_param 5.52% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028253 2 90.74% : 0.025637s : 1: type_inference.infer 9.26% : 0.002616s : 1: type_inference.specialize ------[replace.] 0.000101 6 67.32% : 0.000068s : 4: replace.inline 32.68% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 94.27% : 0.000240s : 4: match.inline 5.73% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.12% : 0.000003s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000002s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.79% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.55% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.42% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.05% : 0.000010s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.96% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001329 13 41.43% : 0.000551s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.16% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.41% : 0.000723s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045357 72 0.14% : 0.000064s : 1: add_recomputation 0.19% : 0.000084s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 1.07% : 0.000485s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 2.20% : 0.000999s : 1: graph_reusing 18.80% : 0.008525s : 1: jit_opt_a 0.38% : 0.000170s : 1: jit_opt_after_cconv 0.13% : 0.000061s : 1: jit_opt_b 1.18% : 0.000535s : 1: loop_unroll 1.74% : 0.000790s : 1: mutable_eliminate 2.24% : 0.001017s : 26: opt.transform.jit_opt_a 0.12% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.13% : 0.000511s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000015s : 1: pre_auto_parallel 0.78% : 0.000353s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 4.37% : 0.001982s : 1: renormalize.infer 1.66% : 0.000755s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000052s : 1: rewriter_after_opt_a 0.26% : 0.000119s : 1: rewriter_before_opt_a 0.19% : 0.000087s : 1: symbol_engine_optimizer 62.57% : 0.028382s : 1: type_inference TotalTime = 0.0202696, [30] [bootstrap]: 0.00031663 [type_inference]: 0.0116891 [event_method]: 2.267e-05 [auto_monad]: 7.221e-05 [graph_reusing]: 6.87002e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 5.226e-05 [rewriter_before_opt_a]: 8.416e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00575071, [2] [Cycle 1]: 0.00190071, [27] [switch_simplify]: 5.479e-05 [loop_unroll]: 3.371e-05 [a_1]: 0.00064992 [with_stream_mark]: 1.62e-05 [recompute_prepare]: 8.10999e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.55002e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 4.02002e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.427e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.94998e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.00082069 [add_forward_monad_depend]: 5.81e-06 [auto_monad_grad]: 2.45997e-06 [auto_monad_eliminator]: 1.398e-05 [cse]: 2.82e-05 [replace_applicator]: 1.228e-05 [Cycle 2]: 0.00033626, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.49998e-06 [a_1]: 9.621e-05 [with_stream_mark]: 1.07e-05 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.38002e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 4.78001e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 4.64998e-06 [merge_forward]: 3.18998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 8e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 7.81001e-06 [inline_without_move]: 4.94e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.57e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.241e-05 [rewriter_after_opt_a]: 3.86e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00060893 [jit_opt_b]: 5.081e-05, [1] [Cycle 1]: 4.4e-05, [2] [frontend_op_eliminate]: 1.6e-05 [inline_after_opt_a]: 1.623e-05 [cconv]: 2.622e-05 [loop_unroll]: 0.0004373 [jit_opt_after_cconv]: 0.00015582, [1] [Cycle 1]: 0.00014922, [11] [c_1]: 2.15e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 7.11999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 2.818e-05 [call_graph_tuple_transform]: 1.97e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 3.506e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 6.64999e-06 [add_recomputation]: 4.61e-05 [cse_after_recomputation]: 2.643e-05, [1] [Cycle 1]: 2.072e-05, [1] [cse]: 1.388e-05 [auto_monad_reorder]: 1.782e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 4.60999e-06 [opt_after_jit_grad]: 0.0004885 [symbol_engine_optimizer]: 7.42e-05, [1] [Cycle 1]: 6.761e-05, [6] [build]: 3.02002e-06 [elim_shapecalc]: 7.68999e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 6.09987e-07 [validate]: 3.786e-05 Sums bootstrap : 0.000317s : 1.96% type_inference : 0.011689s : 72.32% event_method : 0.000023s : 0.14% auto_monad : 0.000072s : 0.45% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000052s : 0.32% rewriter_before_opt_a : 0.000084s : 0.52% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000061s : 0.38% jit_opt_a.loop_unroll : 0.000039s : 0.24% jit_opt_a.a_1 : 0.000746s : 4.62% jit_opt_a.with_stream_mark : 0.000027s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000010s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.000821s : 5.08% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.12% jit_opt_a.cse : 0.000044s : 0.27% jit_opt_a.replace_applicator : 0.000018s : 0.11% py_interpret_to_execute_after_opt_a : 0.000012s : 0.08% rewriter_after_opt_a : 0.000039s : 0.24% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000609s : 3.77% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000026s : 0.16% loop_unroll : 0.000437s : 2.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000035s : 0.22% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000046s : 0.29% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000018s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000489s : 3.02% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.23% Time group info: ------[substitution.] 0.000252 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000005s : 3: substitution.graph_param_transform 86.42% : 0.000218s : 5: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000004s : 2: substitution.replace_old_param 5.18% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011619 2 90.69% : 0.010537s : 1: type_inference.infer 9.31% : 0.001081s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.39% : 0.000070s : 5: replace.inline 31.61% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 94.79% : 0.000215s : 5: match.inline 5.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.50% : 0.000002s : 11: predicate.addn_zero_filter 2.55% : 0.000003s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000006s : 24: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 16: predicate.load_eliminater 1.75% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.29% : 0.000002s : 11: predicate.print_const_string_wrapper 2.06% : 0.000003s : 11: predicate.reduce_eliminate 1.65% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 59: predicate.switch_simplify 1.16% : 0.000001s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.54% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.91% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000926 16 54.61% : 0.000506s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.00% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.39% : 0.000356s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022108 72 0.22% : 0.000049s : 1: add_recomputation 0.34% : 0.000076s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.52% : 0.000337s : 1: bootstrap 0.13% : 0.000029s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 26.03% : 0.005754s : 1: jit_opt_a 0.72% : 0.000158s : 1: jit_opt_after_cconv 0.24% : 0.000053s : 1: jit_opt_b 2.02% : 0.000446s : 1: loop_unroll 2.80% : 0.000618s : 1: mutable_eliminate 4.37% : 0.000966s : 26: opt.transform.jit_opt_a 0.22% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.26% : 0.000499s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000055s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000038s : 1: remove_dup_value 2.07% : 0.000459s : 1: renormalize.infer 1.59% : 0.000352s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000041s : 1: rewriter_after_opt_a 0.39% : 0.000087s : 1: rewriter_before_opt_a 0.35% : 0.000077s : 1: symbol_engine_optimizer 52.93% : 0.011703s : 1: type_inference TotalTime = 0.0285189, [30] [bootstrap]: 0.00025878 [type_inference]: 0.0202825 [event_method]: 2.306e-05 [auto_monad]: 7.285e-05 [graph_reusing]: 7.23999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00011709 [rewriter_before_opt_a]: 8.573e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00554469, [2] [Cycle 1]: 0.00192277, [27] [switch_simplify]: 5.518e-05 [loop_unroll]: 3.085e-05 [a_1]: 0.00053772 [with_stream_mark]: 1.781e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 6.27001e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.43002e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00094552 [add_forward_monad_depend]: 5.54e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.481e-05 [cse]: 3.522e-05 [replace_applicator]: 1.278e-05 [Cycle 2]: 0.00033511, [27] [switch_simplify]: 6.09999e-06 [loop_unroll]: 5.35999e-06 [a_1]: 9.755e-05 [with_stream_mark]: 1.057e-05 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 7.89002e-06 [inline_without_move]: 5.12e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.255e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.064e-05 [rewriter_after_opt_a]: 4.037e-05 [convert_after_rewriter]: 8.22e-06 [order_py_execute_after_rewriter]: 5.77999e-06 [mutable_eliminate]: 0.00052793 [jit_opt_b]: 5.367e-05, [1] [Cycle 1]: 4.648e-05, [2] [frontend_op_eliminate]: 1.782e-05 [inline_after_opt_a]: 1.693e-05 [cconv]: 2.559e-05 [loop_unroll]: 0.00041857 [jit_opt_after_cconv]: 0.00014697, [1] [Cycle 1]: 0.00014033, [11] [c_1]: 2.276e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.091e-05 [call_graph_tuple_transform]: 1.976e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 3.70026e-07 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 1.482e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 5.049e-05 [cse_after_recomputation]: 2.244e-05, [1] [Cycle 1]: 1.731e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.7e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.39002e-06 [opt_after_jit_grad]: 0.00047334 [symbol_engine_optimizer]: 7.263e-05, [1] [Cycle 1]: 6.661e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 7.52002e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 3.50003e-07 [validate]: 3.726e-05 Sums bootstrap : 0.000259s : 1.05% type_inference : 0.020282s : 82.30% event_method : 0.000023s : 0.09% auto_monad : 0.000073s : 0.30% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000117s : 0.48% rewriter_before_opt_a : 0.000086s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.15% jit_opt_a.a_1 : 0.000635s : 2.58% jit_opt_a.with_stream_mark : 0.000028s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.000946s : 3.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000048s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000528s : 2.14% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000026s : 0.10% loop_unroll : 0.000419s : 1.70% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000473s : 1.92% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000208 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000005s : 3: substitution.graph_param_transform 84.24% : 0.000176s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000005s : 2: substitution.replace_old_param 5.71% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020198 2 91.52% : 0.018486s : 1: type_inference.infer 8.48% : 0.001713s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.31% : 0.000048s : 4: replace.inline 31.69% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 94.13% : 0.000173s : 4: match.inline 5.87% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 2.09% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 2.02% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.99% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.58% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000867 13 42.68% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.85% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.47% : 0.000455s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030379 72 0.18% : 0.000053s : 1: add_recomputation 0.25% : 0.000077s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 0.91% : 0.000277s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 18.26% : 0.005547s : 1: jit_opt_a 0.49% : 0.000150s : 1: jit_opt_after_cconv 0.19% : 0.000056s : 1: jit_opt_b 1.40% : 0.000426s : 1: loop_unroll 1.76% : 0.000536s : 1: mutable_eliminate 2.81% : 0.000855s : 26: opt.transform.jit_opt_a 0.17% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000481s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000121s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000017s : 1: remove_dup_value 1.67% : 0.000509s : 1: renormalize.infer 1.41% : 0.000428s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.29% : 0.000089s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 66.83% : 0.020302s : 1: type_inference TotalTime = 0.0139248, [30] [bootstrap]: 0.00027538 [type_inference]: 0.00549732 [event_method]: 2.192e-05 [auto_monad]: 6.762e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.38998e-06 [py_interpret_to_execute]: 4.033e-05 [rewriter_before_opt_a]: 7.536e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00562969, [2] [Cycle 1]: 0.00179759, [27] [switch_simplify]: 6.244e-05 [loop_unroll]: 2.881e-05 [a_1]: 0.00058351 [with_stream_mark]: 2.444e-05 [recompute_prepare]: 9.00999e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 5.67999e-06 [renormalize]: 0.00073633 [add_forward_monad_depend]: 6.16e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.557e-05 [cse]: 3.582e-05 [replace_applicator]: 1.375e-05 [Cycle 2]: 0.00034343, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.29e-06 [a_1]: 0.00010244 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 5.83002e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.418e-05 [replace_applicator]: 4.89003e-06 [py_interpret_to_execute_after_opt_a]: 1.346e-05 [rewriter_after_opt_a]: 3.931e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00066398 [jit_opt_b]: 5.003e-05, [1] [Cycle 1]: 4.259e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.594e-05 [cconv]: 2.883e-05 [loop_unroll]: 0.0004386 [jit_opt_after_cconv]: 0.0001513, [1] [Cycle 1]: 0.00014449, [11] [c_1]: 1.987e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.792e-05 [call_graph_tuple_transform]: 2.001e-05 [tuple_list_get_item_eliminator]: 5.06997e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 1.07998e-06 [switch_simplify]: 5.00999e-06 [remove_dup_value]: 2.525e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 5.459e-05 [cse_after_recomputation]: 2.428e-05, [1] [Cycle 1]: 1.904e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.842e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 5.61998e-06 [opt_after_jit_grad]: 0.00047207 [symbol_engine_optimizer]: 7.271e-05, [1] [Cycle 1]: 6.658e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 7.71999e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 1.8999e-07 [validate]: 4.469e-05 Sums bootstrap : 0.000275s : 2.80% type_inference : 0.005497s : 55.90% event_method : 0.000022s : 0.22% auto_monad : 0.000068s : 0.69% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.41% rewriter_before_opt_a : 0.000075s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.70% jit_opt_a.loop_unroll : 0.000034s : 0.35% jit_opt_a.a_1 : 0.000686s : 6.97% jit_opt_a.with_stream_mark : 0.000035s : 0.36% jit_opt_a.recompute_prepare : 0.000015s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000736s : 7.49% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000050s : 0.51% jit_opt_a.replace_applicator : 0.000019s : 0.19% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000039s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000664s : 6.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000029s : 0.29% loop_unroll : 0.000439s : 4.46% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000028s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000025s : 0.26% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000055s : 0.56% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000472s : 4.80% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.45% Time group info: ------[substitution.] 0.000256 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.08% : 0.000005s : 3: substitution.graph_param_transform 85.48% : 0.000219s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_old_param 5.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005422 2 82.90% : 0.004495s : 1: type_inference.infer 17.10% : 0.000927s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.45% : 0.000049s : 4: replace.inline 32.55% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 6 94.62% : 0.000216s : 4: match.inline 5.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.68% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.57% : 0.000001s : 3: predicate.elim_not_effective 0.80% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.84% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.08% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.41% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.14% : 0.000009s : 53: predicate.switch_simplify 1.46% : 0.000002s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000694 13 51.56% : 0.000358s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.21% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.23% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015624 72 0.37% : 0.000057s : 1: add_recomputation 0.45% : 0.000071s : 1: auto_monad 0.14% : 0.000021s : 1: auto_monad_reorder 1.89% : 0.000295s : 1: bootstrap 0.21% : 0.000032s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.17% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.05% : 0.005633s : 1: jit_opt_a 0.98% : 0.000154s : 1: jit_opt_after_cconv 0.34% : 0.000053s : 1: jit_opt_b 2.86% : 0.000446s : 1: loop_unroll 4.31% : 0.000674s : 1: mutable_eliminate 5.83% : 0.000911s : 26: opt.transform.jit_opt_a 0.30% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.08% : 0.000481s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000043s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000028s : 1: remove_dup_value 2.56% : 0.000400s : 1: renormalize.infer 2.10% : 0.000328s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000042s : 1: rewriter_after_opt_a 0.50% : 0.000078s : 1: rewriter_before_opt_a 0.48% : 0.000075s : 1: symbol_engine_optimizer 35.30% : 0.005516s : 1: type_inference TotalTime = 0.029975, [30] [bootstrap]: 0.00028824 [type_inference]: 0.0208185 [event_method]: 2.122e-05 [auto_monad]: 7.398e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 0.00012305 [rewriter_before_opt_a]: 8.539e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.00631009, [2] [Cycle 1]: 0.00227096, [27] [switch_simplify]: 6.479e-05 [loop_unroll]: 3.286e-05 [a_1]: 0.00060416 [with_stream_mark]: 2.535e-05 [recompute_prepare]: 9.41998e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.40998e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.71998e-06 [renormalize]: 0.00114719 [add_forward_monad_depend]: 8.28999e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.979e-05 [cse]: 3.785e-05 [replace_applicator]: 1.967e-05 [Cycle 2]: 0.00034734, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.49e-06 [a_1]: 9.152e-05 [with_stream_mark]: 1.426e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 2.49999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.12e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.60997e-06 [cse]: 1.475e-05 [replace_applicator]: 7.31999e-06 [py_interpret_to_execute_after_opt_a]: 1.522e-05 [rewriter_after_opt_a]: 4.228e-05 [convert_after_rewriter]: 7.37002e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.0006455 [jit_opt_b]: 5.181e-05, [1] [Cycle 1]: 4.445e-05, [2] [frontend_op_eliminate]: 1.689e-05 [inline_after_opt_a]: 1.604e-05 [cconv]: 2.811e-05 [loop_unroll]: 0.00041855 [jit_opt_after_cconv]: 0.00014716, [1] [Cycle 1]: 0.00014061, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 3.45e-06 [updatestate_depend_eliminate]: 7.15e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.443e-05 [call_graph_tuple_transform]: 1.893e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 4.905e-05 [cse_after_recomputation]: 2.233e-05, [1] [Cycle 1]: 1.718e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 1.753e-05 [get_jit_bprop_graph]: 1.379e-05 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.00045345 [symbol_engine_optimizer]: 7.257e-05, [1] [Cycle 1]: 6.581e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 7.83999e-06 [elim_not_effective]: 1.293e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 8.47998e-06 [renormalize]: 4.60015e-07 [validate]: 3.962e-05 Sums bootstrap : 0.000288s : 1.12% type_inference : 0.020818s : 81.11% event_method : 0.000021s : 0.08% auto_monad : 0.000074s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000123s : 0.48% rewriter_before_opt_a : 0.000085s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.28% jit_opt_a.loop_unroll : 0.000038s : 0.15% jit_opt_a.a_1 : 0.000696s : 2.71% jit_opt_a.with_stream_mark : 0.000040s : 0.15% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001147s : 4.47% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000027s : 0.11% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000042s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000645s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.11% loop_unroll : 0.000419s : 1.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000014s : 0.05% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000453s : 1.77% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.15% Time group info: ------[substitution.] 0.000254 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000005s : 3: substitution.graph_param_transform 85.51% : 0.000217s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 2.33% : 0.000006s : 2: substitution.replace_old_param 5.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020737 2 92.02% : 0.019083s : 1: type_inference.infer 7.98% : 0.001654s : 1: type_inference.specialize ------[replace.] 0.000080 6 69.19% : 0.000055s : 4: replace.inline 30.81% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.67% : 0.000215s : 4: match.inline 5.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.53% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.58% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.04% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.92% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.12% : 0.000001s : 6: predicate.remove_not_recompute_node 2.21% : 0.000003s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.96% : 0.000004s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.50% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000930 13 42.60% : 0.000396s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.88% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.52% : 0.000479s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032112 72 0.16% : 0.000052s : 1: add_recomputation 0.24% : 0.000078s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.95% : 0.000307s : 1: bootstrap 0.10% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.05% : 0.000016s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.66% : 0.006313s : 1: jit_opt_a 0.47% : 0.000150s : 1: jit_opt_after_cconv 0.17% : 0.000054s : 1: jit_opt_b 1.33% : 0.000426s : 1: loop_unroll 2.04% : 0.000655s : 1: mutable_eliminate 2.93% : 0.000940s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000128s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 2.09% : 0.000670s : 1: renormalize.infer 1.45% : 0.000465s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000046s : 1: rewriter_after_opt_a 0.28% : 0.000089s : 1: rewriter_before_opt_a 0.23% : 0.000075s : 1: symbol_engine_optimizer 64.89% : 0.020837s : 1: type_inference TotalTime = 0.029605, [30] [bootstrap]: 0.00027345 [type_inference]: 0.0207915 [event_method]: 2.222e-05 [auto_monad]: 7.209e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00013269 [rewriter_before_opt_a]: 8.762e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.005967, [2] [Cycle 1]: 0.0020916, [27] [switch_simplify]: 5.724e-05 [loop_unroll]: 3.035e-05 [a_1]: 0.00056472 [with_stream_mark]: 2.164e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 4.09997e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.406e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.00107652 [add_forward_monad_depend]: 6.01998e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.572e-05 [cse]: 3.499e-05 [replace_applicator]: 1.397e-05 [Cycle 2]: 0.00033051, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.394e-05 [with_stream_mark]: 9.79e-06 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.25998e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.406e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.24998e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.324e-05 [replace_applicator]: 5.16002e-06 [py_interpret_to_execute_after_opt_a]: 1.271e-05 [rewriter_after_opt_a]: 3.821e-05 [convert_after_rewriter]: 8.45999e-06 [order_py_execute_after_rewriter]: 5.64998e-06 [mutable_eliminate]: 0.0005806 [jit_opt_b]: 5.049e-05, [1] [Cycle 1]: 4.381e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.683e-05 [cconv]: 2.442e-05 [loop_unroll]: 0.00042843 [jit_opt_after_cconv]: 0.00014291, [1] [Cycle 1]: 0.00013669, [11] [c_1]: 2.158e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.236e-05 [call_graph_tuple_transform]: 1.853e-05 [tuple_list_get_item_eliminator]: 5.58002e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.579e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 5.99999e-06 [add_recomputation]: 4.887e-05 [cse_after_recomputation]: 2.331e-05, [1] [Cycle 1]: 1.796e-05, [1] [cse]: 1.203e-05 [auto_monad_reorder]: 1.72e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 4.58999e-06 [opt_after_jit_grad]: 0.00047637 [symbol_engine_optimizer]: 8.007e-05, [1] [Cycle 1]: 7.375e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 8.47998e-06 [elim_not_effective]: 1.41e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 1.025e-05 [renormalize]: 4.00003e-07 [validate]: 4.201e-05 Sums bootstrap : 0.000273s : 1.08% type_inference : 0.020791s : 81.80% event_method : 0.000022s : 0.09% auto_monad : 0.000072s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000133s : 0.52% rewriter_before_opt_a : 0.000088s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000659s : 2.59% jit_opt_a.with_stream_mark : 0.000031s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001077s : 4.24% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000048s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000581s : 2.28% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000024s : 0.10% loop_unroll : 0.000428s : 1.69% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000476s : 1.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.17% Time group info: ------[substitution.] 0.000225 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 85.12% : 0.000192s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000005s : 2: substitution.replace_old_param 5.22% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020704 2 90.83% : 0.018806s : 1: type_inference.infer 9.17% : 0.001898s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.39% : 0.000052s : 4: replace.inline 31.61% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.72% : 0.000189s : 4: match.inline 5.28% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.82% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.13% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.80% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.44% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.86% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000984 13 42.10% : 0.000414s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.20% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.70% : 0.000518s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031565 72 0.16% : 0.000052s : 1: add_recomputation 0.24% : 0.000076s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.92% : 0.000291s : 1: bootstrap 0.09% : 0.000027s : 1: cconv 0.04% : 0.000012s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.91% : 0.005970s : 1: jit_opt_a 0.46% : 0.000145s : 1: jit_opt_after_cconv 0.17% : 0.000053s : 1: jit_opt_b 1.38% : 0.000436s : 1: loop_unroll 1.86% : 0.000589s : 1: mutable_eliminate 2.78% : 0.000879s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000484s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000138s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.96% : 0.000619s : 1: renormalize.infer 1.42% : 0.000449s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.29% : 0.000091s : 1: rewriter_before_opt_a 0.26% : 0.000083s : 1: symbol_engine_optimizer 65.95% : 0.020816s : 1: type_inference TotalTime = 0.172721, [30] [bootstrap]: 0.00032323 [type_inference]: 0.156252 [event_method]: 2.401e-05 [auto_monad]: 8.029e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00045416 [rewriter_before_opt_a]: 9.169e-05 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.0130374, [2] [Cycle 1]: 0.00588157, [27] [switch_simplify]: 6.067e-05 [loop_unroll]: 2.91e-05 [a_1]: 0.00061609 [with_stream_mark]: 2.032e-05 [recompute_prepare]: 8.54998e-06 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.46001e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.00002e-06 [renormalize]: 0.00476421 [add_forward_monad_depend]: 1.124e-05 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.265e-05 [cse]: 3.524e-05 [replace_applicator]: 1.576e-05 [Cycle 2]: 0.00039034, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 5.78002e-06 [a_1]: 0.00013035 [with_stream_mark]: 1.678e-05 [recompute_prepare]: 5.88002e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 5.78002e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 3.23e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 9.06002e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.168e-05 [replace_applicator]: 5.51e-06 [py_interpret_to_execute_after_opt_a]: 1.526e-05 [rewriter_after_opt_a]: 3.84e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00068803 [jit_opt_b]: 5.734e-05, [1] [Cycle 1]: 4.938e-05, [2] [frontend_op_eliminate]: 1.936e-05 [inline_after_opt_a]: 1.808e-05 [cconv]: 2.862e-05 [loop_unroll]: 0.00051894 [jit_opt_after_cconv]: 0.0001652, [1] [Cycle 1]: 0.0001585, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.884e-05 [call_graph_tuple_transform]: 2.516e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.619e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 9.78998e-06 [add_recomputation]: 5.296e-05 [cse_after_recomputation]: 2.26e-05, [1] [Cycle 1]: 1.759e-05, [1] [cse]: 1.147e-05 [auto_monad_reorder]: 1.612e-05 [get_jit_bprop_graph]: 2.33002e-06 [rewriter_after_jit_bprop_graph]: 6.81001e-06 [opt_after_jit_grad]: 0.0004655 [symbol_engine_optimizer]: 7.445e-05, [1] [Cycle 1]: 6.863e-05, [6] [build]: 3.58e-06 [elim_shapecalc]: 8.83001e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 9.39998e-06 [renormalize]: 6.39993e-07 [validate]: 6.286e-05 Sums bootstrap : 0.000323s : 0.20% type_inference : 0.156252s : 94.51% event_method : 0.000024s : 0.01% auto_monad : 0.000080s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000454s : 0.27% rewriter_before_opt_a : 0.000092s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.04% jit_opt_a.loop_unroll : 0.000035s : 0.02% jit_opt_a.a_1 : 0.000746s : 0.45% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.004764s : 2.88% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000047s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000688s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000519s : 0.31% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000466s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.04% Time group info: ------[substitution.] 0.000246 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.80% : 0.000007s : 4: substitution.graph_param_transform 84.31% : 0.000207s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 2.52% : 0.000006s : 2: substitution.replace_old_param 5.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.156154 2 98.10% : 0.153186s : 1: type_inference.infer 1.90% : 0.002967s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.02% : 0.000054s : 4: replace.inline 31.98% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.61% : 0.000205s : 4: match.inline 5.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.57% : 0.000002s : 12: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.08% : 0.000001s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 5.62% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 2.68% : 0.000004s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000010s : 58: predicate.switch_simplify 1.44% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.30% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.78% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.89% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002430 22 62.28% : 0.001513s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.88% : 0.000872s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.178517 72 0.03% : 0.000056s : 1: add_recomputation 0.05% : 0.000084s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.19% : 0.000340s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.31% : 0.013041s : 1: jit_opt_a 0.09% : 0.000168s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.29% : 0.000526s : 1: loop_unroll 0.39% : 0.000697s : 1: mutable_eliminate 0.55% : 0.000987s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000473s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000461s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.10% : 0.003747s : 1: renormalize.infer 0.56% : 0.001003s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.05% : 0.000097s : 1: rewriter_before_opt_a 0.04% : 0.000077s : 1: symbol_engine_optimizer 87.54% : 0.156276s : 1: type_inference TotalTime = 0.0371005, [30] [bootstrap]: 0.00039113 [type_inference]: 0.0262851 [event_method]: 2.086e-05 [auto_monad]: 8.051e-05 [graph_reusing]: 6.77002e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00019867 [rewriter_before_opt_a]: 9.053e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00764359, [2] [Cycle 1]: 0.00333546, [27] [switch_simplify]: 6.617e-05 [loop_unroll]: 3.072e-05 [a_1]: 0.00059458 [with_stream_mark]: 1.643e-05 [recompute_prepare]: 7.70998e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 6.66999e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.315e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.70001e-06 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00228945 [add_forward_monad_depend]: 8.48999e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.651e-05 [cse]: 2.75e-05 [replace_applicator]: 1.531e-05 [Cycle 2]: 0.00035404, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.57999e-06 [a_1]: 0.00010881 [with_stream_mark]: 1.264e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.59998e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 8.91997e-06 [inline_without_move]: 4.97e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.304e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.497e-05 [rewriter_after_opt_a]: 3.88e-05 [convert_after_rewriter]: 6.36998e-06 [order_py_execute_after_rewriter]: 5.26002e-06 [mutable_eliminate]: 0.00067259 [jit_opt_b]: 5.255e-05, [1] [Cycle 1]: 4.536e-05, [2] [frontend_op_eliminate]: 1.829e-05 [inline_after_opt_a]: 1.616e-05 [cconv]: 2.667e-05 [loop_unroll]: 0.00043047 [jit_opt_after_cconv]: 0.00015389, [1] [Cycle 1]: 0.00014766, [11] [c_1]: 2.328e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 6.66999e-06 [updatestate_assign_eliminate]: 2.43998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.506e-05 [call_graph_tuple_transform]: 1.939e-05 [tuple_list_get_item_eliminator]: 5.82001e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.59999e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 5.46e-06 [add_recomputation]: 4.367e-05 [cse_after_recomputation]: 2.671e-05, [1] [Cycle 1]: 2.069e-05, [1] [cse]: 1.403e-05 [auto_monad_reorder]: 1.728e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 5.63002e-06 [opt_after_jit_grad]: 0.00050442 [symbol_engine_optimizer]: 7.962e-05, [1] [Cycle 1]: 7.189e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.455e-05 [opt_reshape]: 8.02998e-06 [fold_const_symbol]: 8.17e-06 [renormalize]: 5.50004e-07 [validate]: 7.696e-05 Sums bootstrap : 0.000391s : 1.20% type_inference : 0.026285s : 80.79% event_method : 0.000021s : 0.06% auto_monad : 0.000081s : 0.25% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000199s : 0.61% rewriter_before_opt_a : 0.000091s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000703s : 2.16% jit_opt_a.with_stream_mark : 0.000029s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.002290s : 7.04% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000041s : 0.12% jit_opt_a.replace_applicator : 0.000020s : 0.06% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000673s : 2.07% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000027s : 0.08% loop_unroll : 0.000430s : 1.32% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000044s : 0.13% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000504s : 1.55% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000077s : 0.24% Time group info: ------[substitution.] 0.000241 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000006s : 3: substitution.graph_param_transform 85.45% : 0.000206s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.20% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026194 2 87.53% : 0.022927s : 1: type_inference.infer 12.47% : 0.003267s : 1: type_inference.specialize ------[replace.] 0.000087 6 68.91% : 0.000060s : 4: replace.inline 31.09% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.67% : 0.000203s : 4: match.inline 5.33% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.21% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 2.13% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.46% : 0.000002s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.50% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 15: predicate.partial_eliminate 1.55% : 0.000002s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.93% : 0.000004s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.67% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.84% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001597 13 30.52% : 0.000487s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.40% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 67.08% : 0.001071s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040344 72 0.12% : 0.000048s : 1: add_recomputation 0.21% : 0.000084s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 1.03% : 0.000415s : 1: bootstrap 0.07% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 18.96% : 0.007648s : 1: jit_opt_a 0.39% : 0.000156s : 1: jit_opt_after_cconv 0.14% : 0.000055s : 1: jit_opt_b 1.09% : 0.000438s : 1: loop_unroll 1.69% : 0.000681s : 1: mutable_eliminate 2.33% : 0.000940s : 26: opt.transform.jit_opt_a 0.13% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.27% : 0.000513s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000202s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.78% : 0.001121s : 1: renormalize.infer 2.87% : 0.001158s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.23% : 0.000095s : 1: rewriter_before_opt_a 0.20% : 0.000082s : 1: symbol_engine_optimizer 65.19% : 0.026301s : 1: type_inference TotalTime = 0.0347028, [30] [bootstrap]: 0.00029032 [type_inference]: 0.020483 [event_method]: 2.34e-05 [auto_monad]: 7.34e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.00012555 [rewriter_before_opt_a]: 9.117e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.0108357, [2] [Cycle 1]: 0.00689814, [27] [switch_simplify]: 6.203e-05 [loop_unroll]: 3.08e-05 [a_1]: 0.00058598 [with_stream_mark]: 2.384e-05 [recompute_prepare]: 9.15999e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.28998e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 3.03998e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00575157 [add_forward_monad_depend]: 1.501e-05 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 2.76e-05 [cse]: 4.661e-05 [replace_applicator]: 2.913e-05 [Cycle 2]: 0.00040465, [27] [switch_simplify]: 6.77002e-06 [loop_unroll]: 7.03e-06 [a_1]: 0.00012292 [with_stream_mark]: 1.853e-05 [recompute_prepare]: 5.55001e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 7.00002e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 3.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.112e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.083e-05 [inline_without_move]: 5.05001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.36998e-06 [cse]: 1.458e-05 [replace_applicator]: 5.72001e-06 [py_interpret_to_execute_after_opt_a]: 1.909e-05 [rewriter_after_opt_a]: 4.626e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00092559 [jit_opt_b]: 5.503e-05, [1] [Cycle 1]: 4.638e-05, [2] [frontend_op_eliminate]: 1.739e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 3.168e-05 [loop_unroll]: 0.00048386 [jit_opt_after_cconv]: 0.00016777, [1] [Cycle 1]: 0.00016136, [11] [c_1]: 2.318e-05 [parameter_eliminate]: 3.98001e-06 [updatestate_depend_eliminate]: 7.4e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 3.31999e-06 [cse]: 3.234e-05 [call_graph_tuple_transform]: 2.335e-05 [tuple_list_get_item_eliminator]: 6.64001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.84999e-06 [remove_dup_value]: 1.797e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.73998e-06 [add_recomputation]: 6.111e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.862e-05, [1] [cse]: 1.255e-05 [auto_monad_reorder]: 1.905e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.69999e-06 [opt_after_jit_grad]: 0.00056375 [symbol_engine_optimizer]: 8.065e-05, [1] [Cycle 1]: 7.388e-05, [6] [build]: 5.27001e-06 [elim_shapecalc]: 9.29e-06 [elim_not_effective]: 1.462e-05 [opt_reshape]: 6.75002e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 5.59987e-07 [validate]: 4.691e-05 Sums bootstrap : 0.000290s : 0.95% type_inference : 0.020483s : 67.13% event_method : 0.000023s : 0.08% auto_monad : 0.000073s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000126s : 0.41% rewriter_before_opt_a : 0.000091s : 0.30% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.23% jit_opt_a.loop_unroll : 0.000038s : 0.12% jit_opt_a.a_1 : 0.000709s : 2.32% jit_opt_a.with_stream_mark : 0.000042s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.005752s : 18.85% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.11% jit_opt_a.cse : 0.000061s : 0.20% jit_opt_a.replace_applicator : 0.000035s : 0.11% py_interpret_to_execute_after_opt_a : 0.000019s : 0.06% rewriter_after_opt_a : 0.000046s : 0.15% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000926s : 3.03% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000032s : 0.10% loop_unroll : 0.000484s : 1.59% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000061s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000564s : 1.85% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.15% Time group info: ------[substitution.] 0.000246 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 83.11% : 0.000204s : 4: substitution.inline 2.00% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.71% : 0.000007s : 4: substitution.remove_not_recompute_node 2.82% : 0.000007s : 2: substitution.replace_old_param 5.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020391 2 91.09% : 0.018574s : 1: type_inference.infer 8.91% : 0.001818s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.41% : 0.000054s : 4: replace.inline 31.59% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.32% : 0.000202s : 4: match.inline 5.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 0.97% : 0.000001s : 10: predicate.addn_zero_filter 4.49% : 0.000007s : 10: predicate.arithmetic_simplify 1.87% : 0.000003s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 1.08% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.83% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000002s : 10: predicate.environ_get_eliminate 0.88% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.32% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.09% : 0.000008s : 22: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.75% : 0.000003s : 6: predicate.less_batch_normalization 2.06% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 15: predicate.load_eliminater 1.07% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.56% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.95% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.02% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 3.41% : 0.000005s : 10: predicate.reduce_eliminate 1.28% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000003s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.64% : 0.000002s : 10: predicate.reshape_eliminate 1.59% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.55% : 0.000002s : 10: predicate.same_eliminate 0.44% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.94% : 0.000003s : 16: predicate.switch_defer_inline 1.74% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.32% : 0.000009s : 53: predicate.switch_simplify 1.01% : 0.000002s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.22% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 2.02% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.36% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.33% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.53% : 0.000004s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001047 13 36.98% : 0.000387s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.84% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 58.18% : 0.000609s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041480 72 0.16% : 0.000064s : 1: add_recomputation 0.19% : 0.000077s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.74% : 0.000308s : 1: bootstrap 0.08% : 0.000035s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 26.13% : 0.010840s : 1: jit_opt_a 0.41% : 0.000171s : 1: jit_opt_after_cconv 0.14% : 0.000058s : 1: jit_opt_b 1.18% : 0.000491s : 1: loop_unroll 2.26% : 0.000936s : 1: mutable_eliminate 2.33% : 0.000966s : 26: opt.transform.jit_opt_a 0.13% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000021s : 1: opt.transform.mutable_eliminate 0.06% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.38% : 0.000573s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000130s : 1: py_interpret_to_execute 0.05% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 12.16% : 0.005044s : 1: renormalize.infer 1.67% : 0.000693s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000050s : 1: rewriter_after_opt_a 0.23% : 0.000095s : 1: rewriter_before_opt_a 0.20% : 0.000083s : 1: symbol_engine_optimizer 49.43% : 0.020502s : 1: type_inference TotalTime = 0.021528, [30] [bootstrap]: 0.00033981 [type_inference]: 0.010187 [event_method]: 2.355e-05 [auto_monad]: 7.135e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 5.983e-05 [rewriter_before_opt_a]: 9.356e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00817101, [2] [Cycle 1]: 0.0038446, [27] [switch_simplify]: 6.959e-05 [loop_unroll]: 3.458e-05 [a_1]: 0.00075373 [with_stream_mark]: 2.717e-05 [recompute_prepare]: 8.50999e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.38002e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.662e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00255287 [add_forward_monad_depend]: 9.54999e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 2.259e-05 [cse]: 4.498e-05 [replace_applicator]: 2.061e-05 [Cycle 2]: 0.00037492, [27] [switch_simplify]: 6.72002e-06 [loop_unroll]: 5.67999e-06 [a_1]: 0.0001066 [with_stream_mark]: 1.638e-05 [recompute_prepare]: 5.86003e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 4.81002e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 2.16e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.12e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 7.87e-06 [cse]: 1.755e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.75e-05 [rewriter_after_opt_a]: 4.191e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00081671 [jit_opt_b]: 5.288e-05, [1] [Cycle 1]: 4.549e-05, [2] [frontend_op_eliminate]: 1.683e-05 [inline_after_opt_a]: 1.763e-05 [cconv]: 3.114e-05 [loop_unroll]: 0.00045294 [jit_opt_after_cconv]: 0.00016457, [1] [Cycle 1]: 0.00015807, [11] [c_1]: 2.164e-05 [parameter_eliminate]: 4.2e-06 [updatestate_depend_eliminate]: 8.13001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.074e-05 [call_graph_tuple_transform]: 2.304e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 4.639e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 6.33e-06 [add_recomputation]: 5.616e-05 [cse_after_recomputation]: 2.562e-05, [1] [Cycle 1]: 2.006e-05, [1] [cse]: 1.359e-05 [auto_monad_reorder]: 1.931e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 7.23999e-06 [opt_after_jit_grad]: 0.00048641 [symbol_engine_optimizer]: 7.586e-05, [1] [Cycle 1]: 6.965e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.76e-06 [renormalize]: 4.70027e-07 [validate]: 4.829e-05 Sums bootstrap : 0.000340s : 2.01% type_inference : 0.010187s : 60.17% event_method : 0.000024s : 0.14% auto_monad : 0.000071s : 0.42% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000060s : 0.35% rewriter_before_opt_a : 0.000094s : 0.55% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.45% jit_opt_a.loop_unroll : 0.000040s : 0.24% jit_opt_a.a_1 : 0.000860s : 5.08% jit_opt_a.with_stream_mark : 0.000044s : 0.26% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.002553s : 15.08% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.18% jit_opt_a.cse : 0.000063s : 0.37% jit_opt_a.replace_applicator : 0.000027s : 0.16% py_interpret_to_execute_after_opt_a : 0.000017s : 0.10% rewriter_after_opt_a : 0.000042s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000817s : 4.82% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000031s : 0.18% loop_unroll : 0.000453s : 2.68% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000046s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000056s : 0.33% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000019s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000486s : 2.87% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.29% Time group info: ------[substitution.] 0.000310 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000007s : 3: substitution.graph_param_transform 86.85% : 0.000269s : 5: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000006s : 4: substitution.remove_not_recompute_node 2.07% : 0.000006s : 2: substitution.replace_old_param 4.37% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010108 2 86.06% : 0.008699s : 1: type_inference.infer 13.94% : 0.001409s : 1: type_inference.specialize ------[replace.] 0.000142 7 76.18% : 0.000108s : 5: replace.inline 23.82% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 95.55% : 0.000266s : 5: match.inline 4.45% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.43% : 0.000002s : 11: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.56% : 0.000002s : 11: predicate.addn_zero_filter 2.28% : 0.000003s : 11: predicate.arithmetic_simplify 1.47% : 0.000002s : 11: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.37% : 0.000002s : 11: predicate.depend_value_elim 1.21% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.74% : 0.000008s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.06% : 0.000001s : 11: predicate.minmaximum_grad 2.09% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000001s : 11: predicate.print_const_string_wrapper 1.69% : 0.000002s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 2.14% : 0.000003s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.15% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.97% : 0.000011s : 59: predicate.switch_simplify 1.48% : 0.000002s : 11: predicate.tile_eliminate 1.14% : 0.000002s : 11: predicate.transpose_eliminate 1.55% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001099 16 47.58% : 0.000523s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.48% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.94% : 0.000483s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025245 72 0.23% : 0.000059s : 1: add_recomputation 0.30% : 0.000075s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.40% : 0.000352s : 1: bootstrap 0.13% : 0.000034s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.11% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.09% : 0.000024s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.38% : 0.008175s : 1: jit_opt_a 0.66% : 0.000167s : 1: jit_opt_after_cconv 0.22% : 0.000056s : 1: jit_opt_b 1.83% : 0.000461s : 1: loop_unroll 3.28% : 0.000829s : 1: mutable_eliminate 4.41% : 0.001113s : 26: opt.transform.jit_opt_a 0.21% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000018s : 1: opt.transform.mutable_eliminate 0.09% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.96% : 0.000496s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000063s : 1: py_interpret_to_execute 0.08% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000049s : 1: remove_dup_value 7.95% : 0.002007s : 1: renormalize.infer 2.11% : 0.000532s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000045s : 1: rewriter_after_opt_a 0.39% : 0.000098s : 1: rewriter_before_opt_a 0.31% : 0.000078s : 1: symbol_engine_optimizer 40.43% : 0.010207s : 1: type_inference TotalTime = 0.033882, [30] [bootstrap]: 0.00034832 [type_inference]: 0.023861 [event_method]: 2.273e-05 [auto_monad]: 7.533e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.0001432 [rewriter_before_opt_a]: 9.062e-05 [expand_dump_flag]: 3.63999e-06 [jit_opt_a]: 0.00657322, [2] [Cycle 1]: 0.00235205, [27] [switch_simplify]: 6.621e-05 [loop_unroll]: 3.115e-05 [a_1]: 0.00062318 [with_stream_mark]: 2.519e-05 [recompute_prepare]: 8.97e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 6.43998e-06 [meta_shard_fg_expand]: 2.66999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 0.00120962 [add_forward_monad_depend]: 6.85002e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.95e-05 [cse]: 3.618e-05 [replace_applicator]: 1.682e-05 [Cycle 2]: 0.0003577, [27] [switch_simplify]: 6.43998e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.678e-05 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 4.00998e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 3.01999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.21002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.95001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.44001e-06 [cse]: 1.535e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.689e-05 [rewriter_after_opt_a]: 4.14e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00081278 [jit_opt_b]: 5.75e-05, [1] [Cycle 1]: 4.82e-05, [2] [frontend_op_eliminate]: 1.646e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 3.562e-05 [loop_unroll]: 0.00050484 [jit_opt_after_cconv]: 0.00018968, [1] [Cycle 1]: 0.00018168, [11] [c_1]: 2.191e-05 [parameter_eliminate]: 5.02e-06 [updatestate_depend_eliminate]: 1.112e-05 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 4.312e-05 [call_graph_tuple_transform]: 2.441e-05 [tuple_list_get_item_eliminator]: 6.64999e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 1.47001e-06 [switch_simplify]: 6.47001e-06 [remove_dup_value]: 1.858e-05 [partial_unused_args_eliminate]: 3.06999e-06 [environ_conv]: 7.62002e-06 [add_recomputation]: 6.24e-05 [cse_after_recomputation]: 2.725e-05, [1] [Cycle 1]: 2.123e-05, [1] [cse]: 1.298e-05 [auto_monad_reorder]: 2.052e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 9.66e-06 [opt_after_jit_grad]: 0.00056564 [symbol_engine_optimizer]: 0.00010776, [1] [Cycle 1]: 9.96e-05, [6] [build]: 6.11e-06 [elim_shapecalc]: 3.138e-05 [elim_not_effective]: 1.625e-05 [opt_reshape]: 6.46e-06 [fold_const_symbol]: 9.48002e-06 [renormalize]: 6.89994e-07 [validate]: 4.829e-05 Sums bootstrap : 0.000348s : 1.19% type_inference : 0.023861s : 81.32% event_method : 0.000023s : 0.08% auto_monad : 0.000075s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000143s : 0.49% rewriter_before_opt_a : 0.000091s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000720s : 2.45% jit_opt_a.with_stream_mark : 0.000039s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001210s : 4.12% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000041s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000813s : 2.77% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000036s : 0.12% loop_unroll : 0.000505s : 1.72% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000043s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000062s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000021s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.03% opt_after_jit_grad : 0.000566s : 1.93% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000031s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.16% Time group info: ------[substitution.] 0.000261 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000006s : 3: substitution.graph_param_transform 85.14% : 0.000222s : 4: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000006s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023774 2 92.19% : 0.021918s : 1: type_inference.infer 7.81% : 0.001856s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.85% : 0.000056s : 4: replace.inline 31.15% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.78% : 0.000220s : 4: match.inline 5.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.53% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 2.28% : 0.000003s : 10: predicate.arithmetic_simplify 1.27% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.86% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.48% : 0.000007s : 22: predicate.inline 1.45% : 0.000002s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.24% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 2.07% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.33% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.80% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000001s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.08% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.45% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.45% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000960 13 43.02% : 0.000413s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.64% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.34% : 0.000493s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036143 72 0.18% : 0.000067s : 1: add_recomputation 0.22% : 0.000080s : 1: auto_monad 0.07% : 0.000024s : 1: auto_monad_reorder 1.01% : 0.000366s : 1: bootstrap 0.11% : 0.000038s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.20% : 0.006577s : 1: jit_opt_a 0.53% : 0.000193s : 1: jit_opt_after_cconv 0.17% : 0.000061s : 1: jit_opt_b 1.43% : 0.000516s : 1: loop_unroll 2.29% : 0.000827s : 1: mutable_eliminate 2.66% : 0.000963s : 26: opt.transform.jit_opt_a 0.15% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000021s : 1: opt.transform.mutable_eliminate 0.08% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000060s : 4: opt.transform.symbol_engine_opt 1.59% : 0.000576s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000148s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.94% : 0.000700s : 1: renormalize.infer 1.38% : 0.000499s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000045s : 1: rewriter_after_opt_a 0.26% : 0.000094s : 1: rewriter_before_opt_a 0.31% : 0.000112s : 1: symbol_engine_optimizer 66.07% : 0.023881s : 1: type_inference TotalTime = 0.0492626, [30] [bootstrap]: 0.00029647 [type_inference]: 0.0268317 [event_method]: 2.048e-05 [auto_monad]: 6.691e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00010311 [rewriter_before_opt_a]: 8.135e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00654398, [2] [Cycle 1]: 0.00202655, [27] [switch_simplify]: 6.543e-05 [loop_unroll]: 2.88e-05 [a_1]: 0.00058376 [with_stream_mark]: 2.501e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.28998e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00095835 [add_forward_monad_depend]: 5.81998e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.703e-05 [cse]: 3.776e-05 [replace_applicator]: 1.667e-05 [Cycle 2]: 0.00035328, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 2.129e-05 [a_1]: 9.052e-05 [with_stream_mark]: 1.327e-05 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 2.51e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.58e-05 [j_node_and_user_rematch]: 7.98001e-06 [meta_fg_expand]: 1.91998e-06 [replace_old_param]: 8.07e-06 [inline_without_move]: 4.79e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 7.33e-06 [cse]: 1.436e-05 [replace_applicator]: 4.94e-06 [py_interpret_to_execute_after_opt_a]: 1.493e-05 [rewriter_after_opt_a]: 3.942e-05 [convert_after_rewriter]: 7.58001e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.0118033 [jit_opt_b]: 6.148e-05, [1] [Cycle 1]: 5.029e-05, [2] [frontend_op_eliminate]: 1.819e-05 [inline_after_opt_a]: 1.99e-05 [cconv]: 3.389e-05 [loop_unroll]: 0.0006743 [jit_opt_after_cconv]: 0.00017551, [1] [Cycle 1]: 0.00016772, [11] [c_1]: 2.194e-05 [parameter_eliminate]: 3.61999e-06 [updatestate_depend_eliminate]: 9.17001e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.2e-06 [cse]: 4.093e-05 [call_graph_tuple_transform]: 2.301e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.887e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.43e-06 [add_recomputation]: 0.00010022 [cse_after_recomputation]: 2.797e-05, [1] [Cycle 1]: 2.16e-05, [1] [cse]: 1.476e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 1.78002e-06 [rewriter_after_jit_bprop_graph]: 7.22002e-06 [opt_after_jit_grad]: 0.00051952 [symbol_engine_optimizer]: 0.00153025, [1] [Cycle 1]: 0.00152024, [6] [build]: 5.15999e-06 [elim_shapecalc]: 0.00141694 [elim_not_effective]: 2.637e-05 [opt_reshape]: 7.16999e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 3.69997e-07 [validate]: 5.669e-05 Sums bootstrap : 0.000296s : 0.67% type_inference : 0.026832s : 60.38% event_method : 0.000020s : 0.05% auto_monad : 0.000067s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.23% rewriter_before_opt_a : 0.000081s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.16% jit_opt_a.loop_unroll : 0.000050s : 0.11% jit_opt_a.a_1 : 0.000674s : 1.52% jit_opt_a.with_stream_mark : 0.000038s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000958s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.05% jit_opt_a.cse : 0.000052s : 0.12% jit_opt_a.replace_applicator : 0.000022s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000039s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.011803s : 26.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.04% cconv : 0.000034s : 0.08% loop_unroll : 0.000674s : 1.52% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000041s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000100s : 0.23% cse_after_recomputation.cse : 0.000015s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000520s : 1.17% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.001417s : 3.19% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.13% Time group info: ------[substitution.] 0.000254 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000007s : 3: substitution.graph_param_transform 85.00% : 0.000216s : 4: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 2.59% : 0.000007s : 2: substitution.replace_old_param 5.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026754 2 94.28% : 0.025224s : 1: type_inference.infer 5.72% : 0.001530s : 1: type_inference.specialize ------[replace.] 0.000077 6 69.41% : 0.000053s : 4: replace.inline 30.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.72% : 0.000213s : 4: match.inline 5.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.10% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.21% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 3.04% : 0.000004s : 3: predicate.mutable_eliminate 0.90% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.01% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.09% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.50% : 0.000002s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.02% : 0.000010s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000812 13 46.56% : 0.000378s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.41% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.02% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052616 72 0.20% : 0.000104s : 1: add_recomputation 0.13% : 0.000070s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.60% : 0.000315s : 1: bootstrap 0.07% : 0.000037s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.44% : 0.006548s : 1: jit_opt_a 0.34% : 0.000178s : 1: jit_opt_after_cconv 0.12% : 0.000065s : 1: jit_opt_b 1.30% : 0.000684s : 1: loop_unroll 22.47% : 0.011822s : 1: mutable_eliminate 1.75% : 0.000920s : 26: opt.transform.jit_opt_a 0.10% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000029s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 2.76% : 0.001452s : 4: opt.transform.symbol_engine_opt 1.00% : 0.000528s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000107s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.00% : 0.000526s : 1: renormalize.infer 0.80% : 0.000423s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.16% : 0.000085s : 1: rewriter_before_opt_a 2.92% : 0.001534s : 1: symbol_engine_optimizer 51.03% : 0.026850s : 1: type_inference TotalTime = 0.0343023, [30] [bootstrap]: 0.00032428 [type_inference]: 0.0241075 [event_method]: 2.255e-05 [auto_monad]: 7.903e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00019595 [rewriter_before_opt_a]: 8.981e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00697053, [2] [Cycle 1]: 0.0027155, [27] [switch_simplify]: 6.362e-05 [loop_unroll]: 2.936e-05 [a_1]: 0.00062006 [with_stream_mark]: 2.135e-05 [recompute_prepare]: 8.12998e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.71999e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 3.25e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.743e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 9.93998e-06 [inline_without_move]: 5.96e-06 [renormalize]: 0.00162299 [add_forward_monad_depend]: 6.76e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.702e-05 [cse]: 3.393e-05 [replace_applicator]: 1.813e-05 [Cycle 2]: 0.00037734, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 5.30999e-06 [a_1]: 0.0001227 [with_stream_mark]: 1.257e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.48002e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.666e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 8.14997e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.46002e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 7.21001e-06 [cse]: 1.58e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.499e-05 [rewriter_after_opt_a]: 3.941e-05 [convert_after_rewriter]: 6.43e-06 [order_py_execute_after_rewriter]: 5.48002e-06 [mutable_eliminate]: 0.0007685 [jit_opt_b]: 5.432e-05, [1] [Cycle 1]: 4.644e-05, [2] [frontend_op_eliminate]: 1.752e-05 [inline_after_opt_a]: 1.793e-05 [cconv]: 2.855e-05 [loop_unroll]: 0.00045818 [jit_opt_after_cconv]: 0.00015851, [1] [Cycle 1]: 0.00015151, [11] [c_1]: 2.284e-05 [parameter_eliminate]: 3.12002e-06 [updatestate_depend_eliminate]: 6.45002e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 2.563e-05 [call_graph_tuple_transform]: 2.221e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 7.63001e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 6.09001e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.448e-05, [1] [Cycle 1]: 1.893e-05, [1] [cse]: 1.228e-05 [auto_monad_reorder]: 1.769e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 7.65e-06 [opt_after_jit_grad]: 0.00049264 [symbol_engine_optimizer]: 7.778e-05, [1] [Cycle 1]: 7.142e-05, [6] [build]: 3.58e-06 [elim_shapecalc]: 7.77998e-06 [elim_not_effective]: 1.341e-05 [opt_reshape]: 7.71001e-06 [fold_const_symbol]: 9.29998e-06 [renormalize]: 6.19999e-07 [validate]: 8.36e-05 Sums bootstrap : 0.000324s : 1.09% type_inference : 0.024108s : 80.83% event_method : 0.000023s : 0.08% auto_monad : 0.000079s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000196s : 0.66% rewriter_before_opt_a : 0.000090s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.12% jit_opt_a.a_1 : 0.000743s : 2.49% jit_opt_a.with_stream_mark : 0.000034s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001623s : 5.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.08% jit_opt_a.cse : 0.000050s : 0.17% jit_opt_a.replace_applicator : 0.000024s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000039s : 0.13% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000769s : 2.58% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000029s : 0.10% loop_unroll : 0.000458s : 1.54% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.03% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000493s : 1.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000084s : 0.28% Time group info: ------[substitution.] 0.000259 23 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.87% : 0.000002s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 85.15% : 0.000220s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000006s : 4: substitution.remove_not_recompute_node 1.84% : 0.000005s : 2: substitution.replace_old_param 5.24% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024022 2 90.73% : 0.021795s : 1: type_inference.infer 9.27% : 0.002227s : 1: type_inference.specialize ------[replace.] 0.000089 6 65.03% : 0.000058s : 4: replace.inline 34.97% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.61% : 0.000218s : 4: match.inline 5.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 2.46% : 0.000003s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.24% : 0.000006s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 15: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.24% : 0.000002s : 3: predicate.mutable_eliminate 0.70% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.92% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 1.87% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.34% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.91% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 2.14% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.93% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.64% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001117 13 40.21% : 0.000449s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.42% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.37% : 0.000619s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036922 72 0.15% : 0.000054s : 1: add_recomputation 0.22% : 0.000083s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.92% : 0.000338s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 18.89% : 0.006976s : 1: jit_opt_a 0.44% : 0.000161s : 1: jit_opt_after_cconv 0.15% : 0.000057s : 1: jit_opt_b 1.27% : 0.000467s : 1: loop_unroll 2.11% : 0.000778s : 1: mutable_eliminate 2.66% : 0.000983s : 26: opt.transform.jit_opt_a 0.15% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.36% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.54% : 0.000200s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.64% : 0.000974s : 1: renormalize.infer 1.73% : 0.000639s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000042s : 1: rewriter_after_opt_a 0.26% : 0.000094s : 1: rewriter_before_opt_a 0.22% : 0.000080s : 1: symbol_engine_optimizer 65.33% : 0.024123s : 1: type_inference TotalTime = 0.0304008, [30] [bootstrap]: 0.00031502 [type_inference]: 0.0216369 [event_method]: 2.1e-05 [auto_monad]: 6.853e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00012307 [rewriter_before_opt_a]: 8.635e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00580133, [2] [Cycle 1]: 0.00208097, [27] [switch_simplify]: 5.847e-05 [loop_unroll]: 3.115e-05 [a_1]: 0.00056698 [with_stream_mark]: 1.896e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.48002e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00105768 [add_forward_monad_depend]: 5.13002e-06 [auto_monad_grad]: 2.18002e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 3.647e-05 [replace_applicator]: 1.346e-05 [Cycle 2]: 0.00034511, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.92999e-06 [a_1]: 9.499e-05 [with_stream_mark]: 1.083e-05 [recompute_prepare]: 5.41002e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.26002e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.66999e-06 [cse]: 1.376e-05 [replace_applicator]: 5.53002e-06 [py_interpret_to_execute_after_opt_a]: 1.313e-05 [rewriter_after_opt_a]: 4.057e-05 [convert_after_rewriter]: 7.28999e-06 [order_py_execute_after_rewriter]: 6.08002e-06 [mutable_eliminate]: 0.00058413 [jit_opt_b]: 5.367e-05, [1] [Cycle 1]: 4.705e-05, [2] [frontend_op_eliminate]: 1.732e-05 [inline_after_opt_a]: 1.818e-05 [cconv]: 2.627e-05 [loop_unroll]: 0.00051567 [jit_opt_after_cconv]: 0.00015063, [1] [Cycle 1]: 0.00014404, [11] [c_1]: 2.199e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.85002e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.397e-05 [call_graph_tuple_transform]: 2.027e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.61e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 5.38002e-06 [add_recomputation]: 5.18e-05 [cse_after_recomputation]: 2.242e-05, [1] [Cycle 1]: 1.725e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.673e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.72001e-06 [opt_after_jit_grad]: 0.00048981 [symbol_engine_optimizer]: 9.94e-05, [1] [Cycle 1]: 9.32e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 3.55e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 9.56e-06 [renormalize]: 5.00004e-07 [validate]: 4.152e-05 Sums bootstrap : 0.000315s : 1.19% type_inference : 0.021637s : 81.89% event_method : 0.000021s : 0.08% auto_monad : 0.000069s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000123s : 0.47% rewriter_before_opt_a : 0.000086s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000662s : 2.51% jit_opt_a.with_stream_mark : 0.000030s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001058s : 4.00% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000584s : 2.21% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000026s : 0.10% loop_unroll : 0.000516s : 1.95% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000052s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000490s : 1.85% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000036s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.16% Time group info: ------[substitution.] 0.000237 23 9.88% : 0.000023s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 3: substitution.graph_param_transform 76.68% : 0.000182s : 4: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 5.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021559 2 91.72% : 0.019775s : 1: type_inference.infer 8.28% : 0.001784s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.10% : 0.000051s : 4: replace.inline 31.90% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.86% : 0.000179s : 4: match.inline 6.14% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.54% : 0.000002s : 10: predicate.addn_zero_filter 2.55% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.71% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000963 13 47.02% : 0.000453s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.55% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.43% : 0.000466s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032429 72 0.17% : 0.000055s : 1: add_recomputation 0.22% : 0.000072s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.03% : 0.000334s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.90% : 0.005805s : 1: jit_opt_a 0.47% : 0.000153s : 1: jit_opt_after_cconv 0.17% : 0.000056s : 1: jit_opt_b 1.62% : 0.000525s : 1: loop_unroll 1.83% : 0.000594s : 1: mutable_eliminate 2.74% : 0.000890s : 26: opt.transform.jit_opt_a 0.16% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000057s : 4: opt.transform.symbol_engine_opt 1.54% : 0.000498s : 1: opt_after_jit_grad 0.03% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000127s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.86% : 0.000602s : 1: renormalize.infer 1.38% : 0.000448s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.28% : 0.000090s : 1: rewriter_before_opt_a 0.31% : 0.000102s : 1: symbol_engine_optimizer 66.77% : 0.021653s : 1: type_inference TotalTime = 0.121609, [30] [bootstrap]: 0.00035367 [type_inference]: 0.0802712 [event_method]: 1.918e-05 [auto_monad]: 7.345e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00023467 [rewriter_before_opt_a]: 8.221e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.03795, [2] [Cycle 1]: 0.0336447, [27] [switch_simplify]: 6.361e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00062082 [with_stream_mark]: 2.43e-05 [recompute_prepare]: 8.95999e-06 [updatestate_depend_eliminate]: 5.39998e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 6.16998e-06 [renormalize]: 0.0324722 [add_forward_monad_depend]: 1.492e-05 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 2.762e-05 [cse]: 3.63e-05 [replace_applicator]: 2.889e-05 [Cycle 2]: 0.0004107, [27] [switch_simplify]: 7.36999e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00013428 [with_stream_mark]: 1.612e-05 [recompute_prepare]: 6.58e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 3.33e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.978e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.149e-05 [inline_without_move]: 5.62001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.52999e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 7.59002e-06 [cse]: 1.332e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.783e-05 [rewriter_after_opt_a]: 4.189e-05 [convert_after_rewriter]: 2.479e-05 [order_py_execute_after_rewriter]: 5.74e-06 [mutable_eliminate]: 0.00082548 [jit_opt_b]: 6.085e-05, [1] [Cycle 1]: 5.221e-05, [2] [frontend_op_eliminate]: 2.108e-05 [inline_after_opt_a]: 1.915e-05 [cconv]: 3.437e-05 [loop_unroll]: 0.00046506 [jit_opt_after_cconv]: 0.00016784, [1] [Cycle 1]: 0.00015807, [11] [c_1]: 2.577e-05 [parameter_eliminate]: 4.23999e-06 [updatestate_depend_eliminate]: 9.74e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.512e-05 [call_graph_tuple_transform]: 2.43e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 1.69995e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 1.669e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 8.64998e-06 [add_recomputation]: 5.143e-05 [cse_after_recomputation]: 2.439e-05, [1] [Cycle 1]: 1.703e-05, [1] [cse]: 1.081e-05 [auto_monad_reorder]: 1.715e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 4.97999e-06 [opt_after_jit_grad]: 0.00050393 [symbol_engine_optimizer]: 8.347e-05, [1] [Cycle 1]: 7.658e-05, [6] [build]: 4.00998e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.486e-05 [opt_reshape]: 7.67998e-06 [fold_const_symbol]: 1.065e-05 [renormalize]: 4.69998e-07 [validate]: 4.62e-05 Sums bootstrap : 0.000354s : 0.30% type_inference : 0.080271s : 68.59% event_method : 0.000019s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000235s : 0.20% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000755s : 0.65% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.032472s : 27.75% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.03% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000035s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000025s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000825s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000465s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000504s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000258 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000007s : 4: substitution.graph_param_transform 84.51% : 0.000218s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000006s : 4: substitution.remove_not_recompute_node 2.68% : 0.000007s : 2: substitution.replace_old_param 4.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.080187 2 97.47% : 0.078155s : 1: type_inference.infer 2.53% : 0.002032s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.93% : 0.000051s : 4: replace.inline 32.07% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.91% : 0.000215s : 4: match.inline 5.09% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.49% : 0.000002s : 12: predicate.accumulaten_eliminater 0.86% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.59% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.55% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.29% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.83% : 0.000008s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.67% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.72% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 2.22% : 0.000003s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 1.82% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 58: predicate.switch_simplify 1.76% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.032674 18 4.59% : 0.001500s : 11: func_graph_cloner_run.FuncGraphClonerGraph 0.17% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 95.24% : 0.031119s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155164 72 0.04% : 0.000055s : 1: add_recomputation 0.05% : 0.000077s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000377s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.02% : 0.000028s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 24.46% : 0.037954s : 1: jit_opt_a 0.11% : 0.000170s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.31% : 0.000474s : 1: loop_unroll 0.54% : 0.000839s : 1: mutable_eliminate 0.65% : 0.001016s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000512s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000240s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.73% : 0.001138s : 1: renormalize.infer 20.19% : 0.031322s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.06% : 0.000088s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 51.75% : 0.080290s : 1: type_inference TotalTime = 0.0309756, [30] [bootstrap]: 0.00029879 [type_inference]: 0.0219768 [event_method]: 2.106e-05 [auto_monad]: 6.736e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.00012325 [rewriter_before_opt_a]: 8.343e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00579893, [2] [Cycle 1]: 0.00210372, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 3.161e-05 [a_1]: 0.00057485 [with_stream_mark]: 2.233e-05 [recompute_prepare]: 8.14997e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.62002e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00105757 [add_forward_monad_depend]: 6.89001e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.666e-05 [cse]: 3.803e-05 [replace_applicator]: 1.527e-05 [Cycle 2]: 0.00033716, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.30999e-06 [a_1]: 9.328e-05 [with_stream_mark]: 1.101e-05 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 7.47002e-06 [cse]: 1.449e-05 [replace_applicator]: 5.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.396e-05 [rewriter_after_opt_a]: 4e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00067083 [jit_opt_b]: 5.716e-05, [1] [Cycle 1]: 4.856e-05, [2] [frontend_op_eliminate]: 1.65e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 3.203e-05 [loop_unroll]: 0.00058375 [jit_opt_after_cconv]: 0.00016796, [1] [Cycle 1]: 0.00016037, [11] [c_1]: 2.276e-05 [parameter_eliminate]: 3.62002e-06 [updatestate_depend_eliminate]: 9.05999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 3.14001e-06 [cse]: 3.215e-05 [call_graph_tuple_transform]: 2.19e-05 [tuple_list_get_item_eliminator]: 6.10002e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.794e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 6.59999e-06 [add_recomputation]: 5.505e-05 [cse_after_recomputation]: 2.314e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 3.09999e-06 [rewriter_after_jit_bprop_graph]: 7.29001e-06 [opt_after_jit_grad]: 0.00053175 [symbol_engine_optimizer]: 0.00010057, [1] [Cycle 1]: 9.35e-05, [6] [build]: 4.90999e-06 [elim_shapecalc]: 9.27001e-06 [elim_not_effective]: 1.484e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 8.99998e-06 [renormalize]: 7.99977e-07 [validate]: 4.528e-05 Sums bootstrap : 0.000299s : 1.11% type_inference : 0.021977s : 81.49% event_method : 0.000021s : 0.08% auto_monad : 0.000067s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000123s : 0.46% rewriter_before_opt_a : 0.000083s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000668s : 2.48% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001058s : 3.92% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000053s : 0.19% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000671s : 2.49% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000032s : 0.12% loop_unroll : 0.000584s : 2.16% jit_opt_after_cconv.c_1 : 0.000023s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000532s : 1.97% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.17% Time group info: ------[substitution.] 0.000235 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000007s : 3: substitution.graph_param_transform 84.53% : 0.000199s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021896 2 92.26% : 0.020202s : 1: type_inference.infer 7.74% : 0.001694s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.16% : 0.000051s : 4: replace.inline 31.84% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.27% : 0.000196s : 4: match.inline 5.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000003s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.47% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.34% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 6.08% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 2.41% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.34% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.51% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000966 13 47.16% : 0.000455s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.10% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.74% : 0.000461s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032993 72 0.18% : 0.000058s : 1: add_recomputation 0.21% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.97% : 0.000319s : 1: bootstrap 0.11% : 0.000035s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.59% : 0.005803s : 1: jit_opt_a 0.52% : 0.000171s : 1: jit_opt_after_cconv 0.18% : 0.000060s : 1: jit_opt_b 1.81% : 0.000596s : 1: loop_unroll 2.07% : 0.000683s : 1: mutable_eliminate 2.71% : 0.000896s : 26: opt.transform.jit_opt_a 0.16% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000544s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000128s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.84% : 0.000607s : 1: renormalize.infer 1.34% : 0.000443s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.26% : 0.000087s : 1: rewriter_before_opt_a 0.31% : 0.000103s : 1: symbol_engine_optimizer 66.67% : 0.021995s : 1: type_inference TotalTime = 0.0316177, [30] [bootstrap]: 0.00031999 [type_inference]: 0.0227495 [event_method]: 2.036e-05 [auto_monad]: 6.882e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.00011836 [rewriter_before_opt_a]: 9.024e-05 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00599495, [2] [Cycle 1]: 0.00212917, [27] [switch_simplify]: 6.047e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00058312 [with_stream_mark]: 2.146e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.29002e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 5.76e-06 [renormalize]: 0.0010739 [add_forward_monad_depend]: 6.26998e-06 [auto_monad_grad]: 3.46999e-06 [auto_monad_eliminator]: 1.674e-05 [cse]: 3.739e-05 [replace_applicator]: 1.585e-05 [Cycle 2]: 0.00034308, [27] [switch_simplify]: 7.43e-06 [loop_unroll]: 5.97999e-06 [a_1]: 9.381e-05 [with_stream_mark]: 1.125e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.63997e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.403e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 5.39e-06 [renormalize]: 1.20024e-07 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.86999e-06 [cse]: 1.51e-05 [replace_applicator]: 5.58002e-06 [py_interpret_to_execute_after_opt_a]: 1.361e-05 [rewriter_after_opt_a]: 4.044e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.04998e-06 [mutable_eliminate]: 0.00061665 [jit_opt_b]: 5.114e-05, [1] [Cycle 1]: 4.428e-05, [2] [frontend_op_eliminate]: 1.654e-05 [inline_after_opt_a]: 1.657e-05 [cconv]: 2.68e-05 [loop_unroll]: 0.00042435 [jit_opt_after_cconv]: 0.00015893, [1] [Cycle 1]: 0.00015248, [11] [c_1]: 2.196e-05 [parameter_eliminate]: 9.87999e-06 [updatestate_depend_eliminate]: 5.63002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.26003e-06 [cse]: 2.247e-05 [call_graph_tuple_transform]: 2.113e-05 [tuple_list_get_item_eliminator]: 6.28998e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 5.89999e-06 [add_recomputation]: 4.975e-05 [cse_after_recomputation]: 2.336e-05, [1] [Cycle 1]: 1.799e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.758e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.24e-06 [opt_after_jit_grad]: 0.00046031 [symbol_engine_optimizer]: 9.058e-05, [1] [Cycle 1]: 8.374e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 2.797e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 5.79981e-07 [validate]: 4.21e-05 Sums bootstrap : 0.000320s : 1.16% type_inference : 0.022750s : 82.76% event_method : 0.000020s : 0.07% auto_monad : 0.000069s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000118s : 0.43% rewriter_before_opt_a : 0.000090s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.25% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000677s : 2.46% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001074s : 3.91% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000052s : 0.19% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000617s : 2.24% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000424s : 1.54% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000010s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000460s : 1.67% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000028s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.15% Time group info: ------[substitution.] 0.000237 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 85.42% : 0.000202s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 5.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022670 2 92.56% : 0.020984s : 1: type_inference.infer 7.44% : 0.001686s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.50% : 0.000053s : 4: replace.inline 30.50% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.39% : 0.000200s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.20% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.30% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.87% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.26% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000902 13 42.32% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.94% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.73% : 0.000467s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033656 72 0.16% : 0.000052s : 1: add_recomputation 0.21% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.01% : 0.000339s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.82% : 0.005998s : 1: jit_opt_a 0.48% : 0.000162s : 1: jit_opt_after_cconv 0.16% : 0.000054s : 1: jit_opt_b 1.28% : 0.000432s : 1: loop_unroll 1.86% : 0.000626s : 1: mutable_eliminate 2.70% : 0.000908s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.39% : 0.000469s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000122s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.85% : 0.000623s : 1: renormalize.infer 1.31% : 0.000442s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.28% : 0.000094s : 1: rewriter_before_opt_a 0.28% : 0.000093s : 1: symbol_engine_optimizer 67.65% : 0.022767s : 1: type_inference TotalTime = 0.0318379, [30] [bootstrap]: 0.00030037 [type_inference]: 0.0222816 [event_method]: 2.274e-05 [auto_monad]: 7.48e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00012239 [rewriter_before_opt_a]: 8.835e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.00644045, [2] [Cycle 1]: 0.00237681, [27] [switch_simplify]: 6.255e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.00060602 [with_stream_mark]: 2.517e-05 [recompute_prepare]: 1.077e-05 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.751e-05 [j_node_and_user_rematch]: 9.43002e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.052e-05 [inline_without_move]: 5.85002e-06 [renormalize]: 0.00123737 [add_forward_monad_depend]: 8.87999e-06 [auto_monad_grad]: 3.28e-06 [auto_monad_eliminator]: 2.172e-05 [cse]: 4.123e-05 [replace_applicator]: 2.323e-05 [Cycle 2]: 0.00035944, [27] [switch_simplify]: 6.23e-06 [loop_unroll]: 5.55001e-06 [a_1]: 9.425e-05 [with_stream_mark]: 1.371e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 4.77998e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.969e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.67998e-06 [inline_without_move]: 5.17e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.93001e-06 [cse]: 1.515e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.681e-05 [rewriter_after_opt_a]: 4.236e-05 [convert_after_rewriter]: 7.45998e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00078745 [jit_opt_b]: 5.38e-05, [1] [Cycle 1]: 4.637e-05, [2] [frontend_op_eliminate]: 1.697e-05 [inline_after_opt_a]: 1.777e-05 [cconv]: 3.11e-05 [loop_unroll]: 0.00044643 [jit_opt_after_cconv]: 0.00016226, [1] [Cycle 1]: 0.00015571, [11] [c_1]: 2.249e-05 [parameter_eliminate]: 3.75e-06 [updatestate_depend_eliminate]: 8.02e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.028e-05 [call_graph_tuple_transform]: 2.238e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.794e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.34999e-06 [add_recomputation]: 5.806e-05 [cse_after_recomputation]: 2.346e-05, [1] [Cycle 1]: 1.777e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.73e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 6.45002e-06 [opt_after_jit_grad]: 0.00046302 [symbol_engine_optimizer]: 0.00010331, [1] [Cycle 1]: 9.674e-05, [6] [build]: 4.80001e-06 [elim_shapecalc]: 3.372e-05 [elim_not_effective]: 1.437e-05 [opt_reshape]: 6.33002e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 5.3001e-07 [validate]: 4.462e-05 Sums bootstrap : 0.000300s : 1.09% type_inference : 0.022282s : 81.07% event_method : 0.000023s : 0.08% auto_monad : 0.000075s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000122s : 0.45% rewriter_before_opt_a : 0.000088s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000700s : 2.55% jit_opt_a.with_stream_mark : 0.000039s : 0.14% jit_opt_a.recompute_prepare : 0.000017s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001237s : 4.50% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.11% jit_opt_a.cse : 0.000056s : 0.21% jit_opt_a.replace_applicator : 0.000030s : 0.11% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000042s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000787s : 2.87% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000031s : 0.11% loop_unroll : 0.000446s : 1.62% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000058s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000463s : 1.68% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000034s : 0.12% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000254 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 84.93% : 0.000216s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 5.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022191 2 91.90% : 0.020395s : 1: type_inference.infer 8.10% : 0.001797s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.50% : 0.000055s : 4: replace.inline 32.50% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.83% : 0.000213s : 4: match.inline 5.17% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000002s : 10: predicate.depend_value_elim 1.25% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000007s : 22: predicate.inline 1.06% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.71% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 2.14% : 0.000003s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000987 13 43.68% : 0.000431s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.61% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.71% : 0.000501s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034082 72 0.18% : 0.000061s : 1: add_recomputation 0.23% : 0.000079s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.94% : 0.000321s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.91% : 0.006444s : 1: jit_opt_a 0.48% : 0.000165s : 1: jit_opt_after_cconv 0.17% : 0.000056s : 1: jit_opt_b 1.34% : 0.000455s : 1: loop_unroll 2.34% : 0.000798s : 1: mutable_eliminate 2.78% : 0.000948s : 26: opt.transform.jit_opt_a 0.16% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.38% : 0.000471s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000127s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 2.11% : 0.000720s : 1: renormalize.infer 1.49% : 0.000506s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000046s : 1: rewriter_after_opt_a 0.27% : 0.000092s : 1: rewriter_before_opt_a 0.31% : 0.000106s : 1: symbol_engine_optimizer 65.44% : 0.022305s : 1: type_inference TotalTime = 0.0148714, [30] [bootstrap]: 0.00033474 [type_inference]: 0.00517855 [event_method]: 1.942e-05 [auto_monad]: 0.00019988 [graph_reusing]: 8.05999e-06 [pre_auto_parallel]: 4.00998e-06 [py_interpret_to_execute]: 8.161e-05 [rewriter_before_opt_a]: 0.00010519 [expand_dump_flag]: 2.99999e-06 [jit_opt_a]: 0.00638217, [2] [Cycle 1]: 0.00200772, [27] [switch_simplify]: 6.598e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00060277 [with_stream_mark]: 2.593e-05 [recompute_prepare]: 8.71002e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 5.06997e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.03998e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 3.2e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 5.20001e-06 [renormalize]: 0.00087919 [add_forward_monad_depend]: 7.48e-06 [auto_monad_grad]: 2.38998e-06 [auto_monad_eliminator]: 1.758e-05 [cse]: 3.378e-05 [replace_applicator]: 1.689e-05 [Cycle 2]: 0.00033835, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 4.87998e-06 [a_1]: 9.068e-05 [with_stream_mark]: 1.192e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 4.75999e-06 [updatestate_useless_node_eliminater]: 4.79002e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 2.42001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.613e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.59002e-06 [inline_without_move]: 4.99e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 6.51999e-06 [cse]: 1.251e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.275e-05 [rewriter_after_opt_a]: 3.925e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00075428 [jit_opt_b]: 5.28e-05, [1] [Cycle 1]: 4.459e-05, [2] [frontend_op_eliminate]: 1.627e-05 [inline_after_opt_a]: 1.613e-05 [cconv]: 3.26e-05 [loop_unroll]: 0.00046033 [jit_opt_after_cconv]: 0.00016454, [1] [Cycle 1]: 0.00015742, [11] [c_1]: 2.007e-05 [parameter_eliminate]: 4.18001e-06 [updatestate_depend_eliminate]: 9.05999e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.45997e-06 [cse]: 3.213e-05 [call_graph_tuple_transform]: 2.078e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.587e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.58998e-06 [add_recomputation]: 5.681e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.714e-05, [1] [cse]: 1.078e-05 [auto_monad_reorder]: 1.601e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 7.43e-06 [opt_after_jit_grad]: 0.00052019 [symbol_engine_optimizer]: 8.432e-05, [1] [Cycle 1]: 7.72e-05, [6] [build]: 4.79e-06 [elim_shapecalc]: 9.35001e-06 [elim_not_effective]: 1.401e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 7.39994e-07 [validate]: 4.614e-05 Sums bootstrap : 0.000335s : 3.31% type_inference : 0.005179s : 51.14% event_method : 0.000019s : 0.19% auto_monad : 0.000200s : 1.97% graph_reusing : 0.000008s : 0.08% pre_auto_parallel : 0.000004s : 0.04% py_interpret_to_execute : 0.000082s : 0.81% rewriter_before_opt_a : 0.000105s : 1.04% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000072s : 0.71% jit_opt_a.loop_unroll : 0.000034s : 0.34% jit_opt_a.a_1 : 0.000693s : 6.85% jit_opt_a.with_stream_mark : 0.000038s : 0.37% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000048s : 0.48% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000879s : 8.68% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.24% jit_opt_a.cse : 0.000046s : 0.46% jit_opt_a.replace_applicator : 0.000022s : 0.22% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000039s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000754s : 7.45% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000033s : 0.32% loop_unroll : 0.000460s : 4.55% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.32% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000057s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000520s : 5.14% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000046s : 0.46% Time group info: ------[substitution.] 0.000280 23 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 3: substitution.graph_param_transform 80.66% : 0.000226s : 4: substitution.inline 1.73% : 0.000005s : 4: substitution.j_node_and_user_rematch 7.68% : 0.000021s : 4: substitution.remove_not_recompute_node 2.08% : 0.000006s : 2: substitution.replace_old_param 4.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005105 2 82.14% : 0.004193s : 1: type_inference.infer 17.86% : 0.000912s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.21% : 0.000052s : 4: replace.inline 31.79% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.94% : 0.000223s : 4: match.inline 5.06% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.68% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.41% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 1.02% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.33% : 0.000008s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 2.37% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.16% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.33% : 0.000002s : 6: predicate.specialize_transform 1.22% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000010s : 53: predicate.switch_simplify 1.83% : 0.000002s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.44% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000773 13 54.65% : 0.000422s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.19% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.16% : 0.000295s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016720 72 0.36% : 0.000060s : 1: add_recomputation 1.37% : 0.000230s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 2.15% : 0.000359s : 1: bootstrap 0.21% : 0.000035s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.08% : 0.000013s : 1: graph_reusing 38.19% : 0.006385s : 1: jit_opt_a 1.00% : 0.000167s : 1: jit_opt_after_cconv 0.33% : 0.000056s : 1: jit_opt_b 2.80% : 0.000469s : 1: loop_unroll 4.59% : 0.000767s : 1: mutable_eliminate 5.63% : 0.000941s : 26: opt.transform.jit_opt_a 0.29% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000018s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.18% : 0.000532s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.04% : 0.000006s : 1: pre_auto_parallel 0.51% : 0.000085s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.97% : 0.000497s : 1: renormalize.infer 2.22% : 0.000372s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000042s : 1: rewriter_after_opt_a 0.66% : 0.000110s : 1: rewriter_before_opt_a 0.52% : 0.000087s : 1: symbol_engine_optimizer 31.06% : 0.005194s : 1: type_inference TotalTime = 0.0311376, [30] [bootstrap]: 0.00030193 [type_inference]: 0.0212138 [event_method]: 2.181e-05 [auto_monad]: 7.322e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00012988 [rewriter_before_opt_a]: 8.736e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00662615, [2] [Cycle 1]: 0.00239891, [27] [switch_simplify]: 6.723e-05 [loop_unroll]: 3.132e-05 [a_1]: 0.00061995 [with_stream_mark]: 2.357e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 7.549e-05 [get_grad_eliminate_]: 7.90998e-06 [merge_forward]: 5.28002e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 1.11e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.229e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00116277 [add_forward_monad_depend]: 1.539e-05 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.911e-05 [cse]: 3.849e-05 [replace_applicator]: 1.917e-05 [Cycle 2]: 0.00036361, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 5.51e-06 [a_1]: 9.79e-05 [with_stream_mark]: 1.309e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 5.49998e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 7.32997e-06 [cse]: 1.671e-05 [replace_applicator]: 6.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.666e-05 [rewriter_after_opt_a]: 4.484e-05 [convert_after_rewriter]: 7.62002e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00075083 [jit_opt_b]: 5.559e-05, [1] [Cycle 1]: 4.707e-05, [2] [frontend_op_eliminate]: 1.756e-05 [inline_after_opt_a]: 1.763e-05 [cconv]: 3.167e-05 [loop_unroll]: 0.00049137 [jit_opt_after_cconv]: 0.00016444, [1] [Cycle 1]: 0.00015707, [11] [c_1]: 2.264e-05 [parameter_eliminate]: 4.48001e-06 [updatestate_depend_eliminate]: 7.68999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 3.092e-05 [call_graph_tuple_transform]: 2.166e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.732e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.54001e-06 [add_recomputation]: 5.595e-05 [cse_after_recomputation]: 2.718e-05, [1] [Cycle 1]: 2.086e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.33e-06 [opt_after_jit_grad]: 0.00060076 [symbol_engine_optimizer]: 0.00010124, [1] [Cycle 1]: 9.374e-05, [6] [build]: 5.25999e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 2.332e-05 [fold_const_symbol]: 9.89001e-06 [renormalize]: 5.3001e-07 [validate]: 4.549e-05 Sums bootstrap : 0.000302s : 1.14% type_inference : 0.021214s : 79.81% event_method : 0.000022s : 0.08% auto_monad : 0.000073s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000130s : 0.49% rewriter_before_opt_a : 0.000087s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.28% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000718s : 2.70% jit_opt_a.with_stream_mark : 0.000037s : 0.14% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000077s : 0.29% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.08% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.001163s : 4.37% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000055s : 0.21% jit_opt_a.replace_applicator : 0.000025s : 0.10% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000045s : 0.17% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000751s : 2.82% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000032s : 0.12% loop_unroll : 0.000491s : 1.85% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000056s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000601s : 2.26% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000023s : 0.09% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.17% Time group info: ------[substitution.] 0.000267 23 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 3: substitution.graph_param_transform 85.40% : 0.000228s : 4: substitution.inline 1.79% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000006s : 4: substitution.remove_not_recompute_node 2.73% : 0.000007s : 2: substitution.replace_old_param 4.62% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021126 2 91.66% : 0.019363s : 1: type_inference.infer 8.34% : 0.001762s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.46% : 0.000056s : 4: replace.inline 30.54% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 6 95.35% : 0.000226s : 4: match.inline 4.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.40% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000002s : 10: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.39% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.30% : 0.000002s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 15: predicate.load_eliminater 2.16% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.43% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.73% : 0.000001s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.08% : 0.000001s : 3: predicate.row_tensor_eliminate 1.40% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000010s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.28% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000976 13 44.93% : 0.000439s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.79% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.28% : 0.000481s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033352 72 0.18% : 0.000060s : 1: add_recomputation 0.23% : 0.000078s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.96% : 0.000321s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000030s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 19.88% : 0.006631s : 1: jit_opt_a 0.50% : 0.000167s : 1: jit_opt_after_cconv 0.18% : 0.000058s : 1: jit_opt_b 1.51% : 0.000504s : 1: loop_unroll 2.30% : 0.000766s : 1: mutable_eliminate 2.91% : 0.000970s : 26: opt.transform.jit_opt_a 0.16% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000021s : 1: opt.transform.mutable_eliminate 0.09% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000053s : 4: opt.transform.symbol_engine_opt 1.84% : 0.000614s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000135s : 1: py_interpret_to_execute 0.06% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.03% : 0.000676s : 1: renormalize.infer 1.43% : 0.000476s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000049s : 1: rewriter_after_opt_a 0.27% : 0.000092s : 1: rewriter_before_opt_a 0.31% : 0.000104s : 1: symbol_engine_optimizer 63.67% : 0.021236s : 1: type_inference TotalTime = 0.541418, [30] [bootstrap]: 0.00032844 [type_inference]: 0.521068 [event_method]: 2.809e-05 [auto_monad]: 8.115e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.00057399 [rewriter_before_opt_a]: 0.00010122 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.015997, [2] [Cycle 1]: 0.0117342, [27] [switch_simplify]: 6.369e-05 [loop_unroll]: 3.519e-05 [a_1]: 0.00072487 [with_stream_mark]: 2.043e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 7.29001e-06 [updatestate_useless_node_eliminater]: 6.61e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 2.68998e-06 [get_grad_eliminate_]: 6.98998e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.616e-05 [j_node_and_user_rematch]: 1.083e-05 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.25002e-06 [renormalize]: 0.010506 [add_forward_monad_depend]: 8.47e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.891e-05 [cse]: 3.904e-05 [replace_applicator]: 2.204e-05 [Cycle 2]: 0.00042066, [27] [switch_simplify]: 8.00999e-06 [loop_unroll]: 6.83998e-06 [a_1]: 0.00014889 [with_stream_mark]: 1.581e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.66999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 6.08998e-06 [accelerated_algorithm]: 6.96999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 3.64002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 5.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.94999e-06 [cse]: 1.601e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 1.919e-05 [rewriter_after_opt_a]: 4.475e-05 [convert_after_rewriter]: 7.10998e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.0008968 [jit_opt_b]: 6.721e-05, [1] [Cycle 1]: 5.795e-05, [2] [frontend_op_eliminate]: 2.387e-05 [inline_after_opt_a]: 2.111e-05 [cconv]: 3.379e-05 [loop_unroll]: 0.00058934 [jit_opt_after_cconv]: 0.00019495, [1] [Cycle 1]: 0.00018669, [11] [c_1]: 3.038e-05 [parameter_eliminate]: 3.93001e-06 [updatestate_depend_eliminate]: 8.79e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 3.643e-05 [call_graph_tuple_transform]: 3.093e-05 [tuple_list_get_item_eliminator]: 7.63001e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.69999e-06 [remove_dup_value]: 2.189e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 1.098e-05 [add_recomputation]: 6.074e-05 [cse_after_recomputation]: 2.842e-05, [1] [Cycle 1]: 2.062e-05, [1] [cse]: 1.42e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 8.55001e-06 [opt_after_jit_grad]: 0.00067854 [symbol_engine_optimizer]: 9.09e-05, [1] [Cycle 1]: 8.34e-05, [6] [build]: 5.02999e-06 [elim_shapecalc]: 9.79e-06 [elim_not_effective]: 1.764e-05 [opt_reshape]: 7.66999e-06 [fold_const_symbol]: 1.074e-05 [renormalize]: 4.40021e-07 [validate]: 0.00021122 Sums bootstrap : 0.000328s : 0.06% type_inference : 0.521068s : 97.05% event_method : 0.000028s : 0.01% auto_monad : 0.000081s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000574s : 0.11% rewriter_before_opt_a : 0.000101s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.01% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000874s : 0.16% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.010506s : 1.96% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.00% jit_opt_a.cse : 0.000055s : 0.01% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000045s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000897s : 0.17% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.00% jit_opt_b.inline_after_opt_a : 0.000021s : 0.00% cconv : 0.000034s : 0.01% loop_unroll : 0.000589s : 0.11% jit_opt_after_cconv.c_1 : 0.000030s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000061s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000019s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000679s : 0.13% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000211s : 0.04% Time group info: ------[substitution.] 0.000290 28 1.08% : 0.000003s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.75% : 0.000008s : 4: substitution.graph_param_transform 81.65% : 0.000237s : 5: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.86% : 0.000014s : 3: substitution.reduce_eliminate 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 4.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.520970 2 99.26% : 0.517124s : 1: type_inference.infer 0.74% : 0.003846s : 1: type_inference.specialize ------[replace.] 0.000104 7 68.57% : 0.000071s : 5: replace.inline 31.43% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 95.69% : 0.000234s : 5: match.inline 4.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 1.35% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 2.08% : 0.000003s : 13: predicate.arithmetic_simplify 1.47% : 0.000002s : 13: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000002s : 13: predicate.compare_switch_simplify 1.04% : 0.000002s : 13: predicate.depend_value_elim 0.99% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.66% : 0.000003s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.09% : 0.000008s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.71% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 2.52% : 0.000004s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000004s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 2.45% : 0.000004s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.77% : 0.000003s : 23: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.07% : 0.000002s : 13: predicate.reshape_eliminate 1.73% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.52% : 0.000010s : 64: predicate.switch_simplify 1.53% : 0.000002s : 13: predicate.tile_eliminate 1.59% : 0.000003s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002845 25 60.48% : 0.001721s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.65% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.86% : 0.001049s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.552994 72 0.01% : 0.000064s : 1: add_recomputation 0.02% : 0.000085s : 1: auto_monad 0.00% : 0.000021s : 1: auto_monad_reorder 0.06% : 0.000343s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.89% : 0.016001s : 1: jit_opt_a 0.04% : 0.000198s : 1: jit_opt_after_cconv 0.01% : 0.000070s : 1: jit_opt_b 0.11% : 0.000601s : 1: loop_unroll 0.16% : 0.000910s : 1: mutable_eliminate 0.21% : 0.001135s : 26: opt.transform.jit_opt_a 0.01% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.13% : 0.000691s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.10% : 0.000579s : 1: py_interpret_to_execute 0.00% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000025s : 1: remove_dup_value 1.71% : 0.009467s : 1: renormalize.infer 0.19% : 0.001029s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.02% : 0.000106s : 1: rewriter_before_opt_a 0.02% : 0.000093s : 1: symbol_engine_optimizer 94.23% : 0.521106s : 1: type_inference TotalTime = 0.0171085, [30] [bootstrap]: 0.00037708 [type_inference]: 0.0063068 [event_method]: 2.127e-05 [auto_monad]: 7.041e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 5.373e-05 [rewriter_before_opt_a]: 8.029e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00748978, [2] [Cycle 1]: 0.0021855, [27] [switch_simplify]: 6.845e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00064121 [with_stream_mark]: 2.644e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.50002e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.80998e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00103848 [add_forward_monad_depend]: 7.46001e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.989e-05 [cse]: 3.349e-05 [replace_applicator]: 1.665e-05 [Cycle 2]: 0.00033693, [27] [switch_simplify]: 6.55002e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.678e-05 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 1.94999e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 2.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.178e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.33e-05 [rewriter_after_opt_a]: 3.907e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 5.33002e-06 [mutable_eliminate]: 0.00082577 [jit_opt_b]: 5.793e-05, [1] [Cycle 1]: 4.826e-05, [2] [frontend_op_eliminate]: 1.766e-05 [inline_after_opt_a]: 1.891e-05 [cconv]: 3.765e-05 [loop_unroll]: 0.00051481 [jit_opt_after_cconv]: 0.00016658, [1] [Cycle 1]: 0.0001598, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 4.28001e-06 [updatestate_depend_eliminate]: 9.24e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.50002e-06 [cse]: 3.487e-05 [call_graph_tuple_transform]: 2.136e-05 [tuple_list_get_item_eliminator]: 5.67001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 1.15001e-06 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.551e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 5.637e-05 [cse_after_recomputation]: 2.174e-05, [1] [Cycle 1]: 1.631e-05, [1] [cse]: 1.066e-05 [auto_monad_reorder]: 1.466e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 8.22e-06 [opt_after_jit_grad]: 0.00053966 [symbol_engine_optimizer]: 8.035e-05, [1] [Cycle 1]: 7.332e-05, [6] [build]: 5.88002e-06 [elim_shapecalc]: 8.12003e-06 [elim_not_effective]: 1.46e-05 [opt_reshape]: 7.01999e-06 [fold_const_symbol]: 9.38997e-06 [renormalize]: 6.89994e-07 [validate]: 4.794e-05 Sums bootstrap : 0.000377s : 3.29% type_inference : 0.006307s : 54.99% event_method : 0.000021s : 0.19% auto_monad : 0.000070s : 0.61% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000054s : 0.47% rewriter_before_opt_a : 0.000080s : 0.70% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000075s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.31% jit_opt_a.a_1 : 0.000738s : 6.43% jit_opt_a.with_stream_mark : 0.000039s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001039s : 9.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.22% jit_opt_a.cse : 0.000045s : 0.39% jit_opt_a.replace_applicator : 0.000022s : 0.19% py_interpret_to_execute_after_opt_a : 0.000013s : 0.12% rewriter_after_opt_a : 0.000039s : 0.34% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000826s : 7.20% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.15% jit_opt_b.inline_after_opt_a : 0.000019s : 0.16% cconv : 0.000038s : 0.33% loop_unroll : 0.000515s : 4.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000035s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000056s : 0.49% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000015s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.07% opt_after_jit_grad : 0.000540s : 4.71% symbol_engine_optimizer.build : 0.000006s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000048s : 0.42% Time group info: ------[substitution.] 0.000281 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 3: substitution.graph_param_transform 86.63% : 0.000243s : 4: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000005s : 2: substitution.replace_old_param 4.63% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006223 2 81.41% : 0.005066s : 1: type_inference.infer 18.59% : 0.001157s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.23% : 0.000056s : 4: replace.inline 31.77% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 95.30% : 0.000241s : 4: match.inline 4.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.52% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.84% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.77% : 0.000004s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 2.06% : 0.000003s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 1.88% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.45% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.91% : 0.000002s : 10: predicate.value_based_eliminate 0.46% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000859 13 49.39% : 0.000424s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.77% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.84% : 0.000377s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019145 72 0.31% : 0.000059s : 1: add_recomputation 0.39% : 0.000074s : 1: auto_monad 0.09% : 0.000017s : 1: auto_monad_reorder 2.11% : 0.000403s : 1: bootstrap 0.21% : 0.000040s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 39.14% : 0.007494s : 1: jit_opt_a 0.88% : 0.000169s : 1: jit_opt_after_cconv 0.32% : 0.000061s : 1: jit_opt_b 2.74% : 0.000524s : 1: loop_unroll 4.38% : 0.000839s : 1: mutable_eliminate 5.08% : 0.000973s : 26: opt.transform.jit_opt_a 0.26% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000019s : 1: opt.transform.mutable_eliminate 0.13% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.88% : 0.000551s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000057s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.79% : 0.000534s : 1: renormalize.infer 2.58% : 0.000495s : 1: renormalize.specialize 0.06% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000043s : 1: rewriter_after_opt_a 0.43% : 0.000083s : 1: rewriter_before_opt_a 0.43% : 0.000083s : 1: symbol_engine_optimizer 33.05% : 0.006328s : 1: type_inference TotalTime = 0.102807, [30] [bootstrap]: 0.00034749 [type_inference]: 0.0250688 [event_method]: 2.047e-05 [auto_monad]: 6.772e-05 [graph_reusing]: 6.04999e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 9.398e-05 [rewriter_before_opt_a]: 8.721e-05 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.0746883, [2] [Cycle 1]: 0.0710484, [27] [switch_simplify]: 5.968e-05 [loop_unroll]: 2.853e-05 [a_1]: 0.00056174 [with_stream_mark]: 2.362e-05 [recompute_prepare]: 8.26002e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.71002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 0.0699236 [add_forward_monad_depend]: 1.264e-05 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.631e-05 [cse]: 3.808e-05 [replace_applicator]: 6.847e-05 [Cycle 2]: 0.00037817, [27] [switch_simplify]: 7.53999e-06 [loop_unroll]: 5.51e-06 [a_1]: 0.00010877 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 3.58999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.057e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.13002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.76e-06 [auto_monad_grad]: 1.39998e-06 [auto_monad_eliminator]: 7.75e-06 [cse]: 1.49e-05 [replace_applicator]: 5.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.815e-05 [rewriter_after_opt_a]: 4.223e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00074664 [jit_opt_b]: 5.377e-05, [1] [Cycle 1]: 4.477e-05, [2] [frontend_op_eliminate]: 1.665e-05 [inline_after_opt_a]: 1.659e-05 [cconv]: 3.028e-05 [loop_unroll]: 0.00044759 [jit_opt_after_cconv]: 0.00015127, [1] [Cycle 1]: 0.00014465, [11] [c_1]: 2.035e-05 [parameter_eliminate]: 2.99001e-06 [updatestate_depend_eliminate]: 7.31001e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.657e-05 [call_graph_tuple_transform]: 1.982e-05 [tuple_list_get_item_eliminator]: 5.14998e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.703e-05 [partial_unused_args_eliminate]: 3.63e-06 [environ_conv]: 6.44999e-06 [add_recomputation]: 5.196e-05 [cse_after_recomputation]: 2.392e-05, [1] [Cycle 1]: 1.859e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 6.61999e-06 [opt_after_jit_grad]: 0.00048497 [symbol_engine_optimizer]: 7.626e-05, [1] [Cycle 1]: 6.929e-05, [6] [build]: 4.19997e-06 [elim_shapecalc]: 8.19998e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 6.09999e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 5.69999e-07 [validate]: 4.346e-05 Sums bootstrap : 0.000347s : 0.35% type_inference : 0.025069s : 25.34% event_method : 0.000020s : 0.02% auto_monad : 0.000068s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000094s : 0.10% rewriter_before_opt_a : 0.000087s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.07% jit_opt_a.loop_unroll : 0.000034s : 0.03% jit_opt_a.a_1 : 0.000671s : 0.68% jit_opt_a.with_stream_mark : 0.000041s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.069924s : 70.69% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.03% jit_opt_a.cse : 0.000053s : 0.05% jit_opt_a.replace_applicator : 0.000074s : 0.07% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000747s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000448s : 0.45% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000485s : 0.49% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000234 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.57% : 0.000006s : 3: substitution.graph_param_transform 83.53% : 0.000195s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000006s : 4: substitution.remove_not_recompute_node 2.71% : 0.000006s : 2: substitution.replace_old_param 5.28% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024996 2 94.45% : 0.023608s : 1: type_inference.infer 5.55% : 0.001388s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.91% : 0.000049s : 4: replace.inline 31.09% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.49% : 0.000193s : 4: match.inline 5.51% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.07% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.86% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 2.49% : 0.000003s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 2.50% : 0.000003s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.15% : 0.000009s : 53: predicate.switch_simplify 1.09% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.21% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.89% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.87% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.63% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000904 13 37.57% : 0.000340s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.77% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.66% : 0.000512s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173720 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000071s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000365s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 43.00% : 0.074691s : 1: jit_opt_a 0.09% : 0.000154s : 1: jit_opt_after_cconv 0.03% : 0.000056s : 1: jit_opt_b 0.26% : 0.000455s : 1: loop_unroll 0.44% : 0.000757s : 1: mutable_eliminate 0.55% : 0.000948s : 26: opt.transform.jit_opt_a 0.03% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000027s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000493s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.06% : 0.000097s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 39.90% : 0.069309s : 1: renormalize.infer 0.34% : 0.000598s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.05% : 0.000092s : 1: rewriter_before_opt_a 0.05% : 0.000079s : 1: symbol_engine_optimizer 14.44% : 0.025089s : 1: type_inference TotalTime = 0.346561, [30] [bootstrap]: 0.00031177 [type_inference]: 0.231153 [event_method]: 2.451e-05 [auto_monad]: 7.6e-05 [graph_reusing]: 7.66999e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 0.0006396 [rewriter_before_opt_a]: 0.00010401 [expand_dump_flag]: 4.25e-06 [jit_opt_a]: 0.111398, [2] [Cycle 1]: 0.107181, [27] [switch_simplify]: 6.378e-05 [loop_unroll]: 3.524e-05 [a_1]: 0.00072547 [with_stream_mark]: 2.044e-05 [recompute_prepare]: 9.03002e-06 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 7.24001e-06 [accelerated_algorithm]: 6.96999e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 1.073e-05 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.81e-06 [inline_without_move]: 6.53e-06 [renormalize]: 0.1059 [add_forward_monad_depend]: 1.338e-05 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 2.716e-05 [cse]: 4.593e-05 [replace_applicator]: 3.219e-05 [Cycle 2]: 0.00044167, [27] [switch_simplify]: 9.09e-06 [loop_unroll]: 8.32998e-06 [a_1]: 0.00015314 [with_stream_mark]: 1.72e-05 [recompute_prepare]: 6.78e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 4.58999e-06 [cell_reuse_recompute_pass]: 4.33001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.928e-05 [j_node_and_user_rematch]: 1.133e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 6.01998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.495e-05 [replace_applicator]: 6.36998e-06 [py_interpret_to_execute_after_opt_a]: 2.137e-05 [rewriter_after_opt_a]: 4.522e-05 [convert_after_rewriter]: 7.70998e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00090292 [jit_opt_b]: 9.109e-05, [1] [Cycle 1]: 8.392e-05, [2] [frontend_op_eliminate]: 5.168e-05 [inline_after_opt_a]: 1.862e-05 [cconv]: 3.086e-05 [loop_unroll]: 0.0004383 [jit_opt_after_cconv]: 0.00016644, [1] [Cycle 1]: 0.0001602, [11] [c_1]: 2.776e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.40997e-06 [cse]: 2.403e-05 [call_graph_tuple_transform]: 2.272e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.69001e-06 [remove_dup_value]: 1.936e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 9.86998e-06 [add_recomputation]: 5.285e-05 [cse_after_recomputation]: 2.965e-05, [1] [Cycle 1]: 2.423e-05, [1] [cse]: 1.599e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 3.63e-06 [rewriter_after_jit_bprop_graph]: 5.82001e-06 [opt_after_jit_grad]: 0.00047886 [symbol_engine_optimizer]: 9.199e-05, [1] [Cycle 1]: 8.559e-05, [6] [build]: 4.41002e-06 [elim_shapecalc]: 1.404e-05 [elim_not_effective]: 1.977e-05 [opt_reshape]: 7.17002e-06 [fold_const_symbol]: 1.119e-05 [renormalize]: 3.9002e-07 [validate]: 0.00019294 Sums bootstrap : 0.000312s : 0.09% type_inference : 0.231153s : 67.57% event_method : 0.000025s : 0.01% auto_monad : 0.000076s : 0.02% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000640s : 0.19% rewriter_before_opt_a : 0.000104s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.02% jit_opt_a.loop_unroll : 0.000044s : 0.01% jit_opt_a.a_1 : 0.000879s : 0.26% jit_opt_a.with_stream_mark : 0.000038s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.105900s : 30.96% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000061s : 0.02% jit_opt_a.replace_applicator : 0.000039s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000045s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000903s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000052s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000438s : 0.13% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000479s : 0.14% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000193s : 0.06% Time group info: ------[substitution.] 0.000286 25 2.42% : 0.000007s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000007s : 4: substitution.graph_param_transform 84.49% : 0.000242s : 5: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000006s : 2: substitution.replace_old_param 4.72% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.231053 2 97.87% : 0.226142s : 1: type_inference.infer 2.13% : 0.004910s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.56% : 0.000072s : 5: replace.inline 31.44% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.13% : 0.000238s : 5: match.inline 4.87% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 886 1.44% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.70% : 0.000003s : 13: predicate.addn_zero_filter 1.78% : 0.000003s : 13: predicate.arithmetic_simplify 1.73% : 0.000003s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.83% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.61% : 0.000003s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 4.89% : 0.000008s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 0.95% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.32% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.37% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.29% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.39% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.58% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.81% : 0.000011s : 64: predicate.switch_simplify 1.51% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.76% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.68% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.97% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.104928 25 1.76% : 0.001850s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.07% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 98.16% : 0.103000s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.453570 72 0.01% : 0.000056s : 1: add_recomputation 0.02% : 0.000080s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.07% : 0.000333s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 24.56% : 0.111404s : 1: jit_opt_a 0.04% : 0.000169s : 1: jit_opt_after_cconv 0.02% : 0.000094s : 1: jit_opt_b 0.10% : 0.000445s : 1: loop_unroll 0.20% : 0.000910s : 1: mutable_eliminate 0.26% : 0.001158s : 26: opt.transform.jit_opt_a 0.01% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000064s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000647s : 1: py_interpret_to_execute 0.01% : 0.000038s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000022s : 1: remove_dup_value 0.60% : 0.002716s : 1: renormalize.infer 22.75% : 0.103172s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000048s : 1: rewriter_after_opt_a 0.02% : 0.000108s : 1: rewriter_before_opt_a 0.02% : 0.000095s : 1: symbol_engine_optimizer 50.97% : 0.231175s : 1: type_inference TotalTime = 0.0330227, [30] [bootstrap]: 0.00032724 [type_inference]: 0.0242066 [event_method]: 2.09e-05 [auto_monad]: 6.729e-05 [graph_reusing]: 5.703e-05 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 0.00013528 [rewriter_before_opt_a]: 8.531e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00573821, [2] [Cycle 1]: 0.00207387, [27] [switch_simplify]: 5.726e-05 [loop_unroll]: 3.088e-05 [a_1]: 0.00057949 [with_stream_mark]: 2.198e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.36998e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.16002e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00102703 [add_forward_monad_depend]: 5.72999e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.539e-05 [cse]: 3.499e-05 [replace_applicator]: 1.287e-05 [Cycle 2]: 0.00032549, [27] [switch_simplify]: 5.98002e-06 [loop_unroll]: 5.25001e-06 [a_1]: 9.162e-05 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.323e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.23999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.371e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 1.281e-05 [rewriter_after_opt_a]: 3.945e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 5.77999e-06 [mutable_eliminate]: 0.00055555 [jit_opt_b]: 5.261e-05, [1] [Cycle 1]: 4.563e-05, [2] [frontend_op_eliminate]: 1.744e-05 [inline_after_opt_a]: 1.631e-05 [cconv]: 2.764e-05 [loop_unroll]: 0.00044332 [jit_opt_after_cconv]: 0.00015132, [1] [Cycle 1]: 0.00014476, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 3.31001e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.53998e-06 [cse]: 2.687e-05 [call_graph_tuple_transform]: 2.037e-05 [tuple_list_get_item_eliminator]: 5.83002e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.62001e-06 [remove_dup_value]: 1.728e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 0.00016771 [cse_after_recomputation]: 3.1e-05, [1] [Cycle 1]: 2.457e-05, [1] [cse]: 1.613e-05 [auto_monad_reorder]: 1.853e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 5.59998e-06 [opt_after_jit_grad]: 0.00049581 [symbol_engine_optimizer]: 9.166e-05, [1] [Cycle 1]: 8.553e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 2.909e-05 [opt_reshape]: 6.87002e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 4.00003e-07 [validate]: 4.518e-05 Sums bootstrap : 0.000327s : 1.13% type_inference : 0.024207s : 83.30% event_method : 0.000021s : 0.07% auto_monad : 0.000067s : 0.23% graph_reusing : 0.000057s : 0.20% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000135s : 0.47% rewriter_before_opt_a : 0.000085s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000671s : 2.31% jit_opt_a.with_stream_mark : 0.000032s : 0.11% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001027s : 3.53% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.07% jit_opt_a.cse : 0.000049s : 0.17% jit_opt_a.replace_applicator : 0.000019s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000556s : 1.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.10% loop_unroll : 0.000443s : 1.53% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000168s : 0.58% cse_after_recomputation.cse : 0.000016s : 0.06% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000496s : 1.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000029s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.16% Time group info: ------[substitution.] 0.000242 23 6.91% : 0.000017s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 3: substitution.graph_param_transform 79.98% : 0.000194s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 4.88% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024127 2 93.20% : 0.022485s : 1: type_inference.infer 6.80% : 0.001642s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.47% : 0.000050s : 4: replace.inline 32.53% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.67% : 0.000191s : 4: match.inline 5.33% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.17% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 1.06% : 0.000001s : 10: predicate.addn_zero_filter 1.69% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.02% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000007s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000001s : 6: predicate.less_batch_normalization 1.25% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 15: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 2.07% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.46% : 0.000002s : 10: predicate.reduce_eliminate 1.24% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.59% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.06% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 16: predicate.switch_defer_inline 11.95% : 0.000016s : 16: predicate.switch_layer_defer_inline 6.71% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000911 13 45.29% : 0.000413s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.29% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.42% : 0.000450s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035005 72 0.50% : 0.000174s : 1: add_recomputation 0.20% : 0.000070s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.00% : 0.000351s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000033s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.17% : 0.000060s : 1: graph_reusing 16.40% : 0.005741s : 1: jit_opt_a 0.44% : 0.000154s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.29% : 0.000452s : 1: loop_unroll 1.61% : 0.000564s : 1: mutable_eliminate 2.55% : 0.000891s : 26: opt.transform.jit_opt_a 0.14% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000050s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000505s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000140s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.69% : 0.000592s : 1: renormalize.infer 1.22% : 0.000427s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000089s : 1: rewriter_before_opt_a 0.27% : 0.000094s : 1: symbol_engine_optimizer 69.21% : 0.024225s : 1: type_inference TotalTime = 0.0659257, [30] [bootstrap]: 0.00042974 [type_inference]: 0.0553449 [event_method]: 3.45e-05 [auto_monad]: 0.00011025 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.0004231 [rewriter_before_opt_a]: 0.00011055 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00712386, [2] [Cycle 1]: 0.00281786, [27] [switch_simplify]: 6.488e-05 [loop_unroll]: 2.928e-05 [a_1]: 0.00062795 [with_stream_mark]: 2.329e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.36998e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.74999e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.631e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00170855 [add_forward_monad_depend]: 6.26e-06 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 1.71e-05 [cse]: 3.95e-05 [replace_applicator]: 1.429e-05 [Cycle 2]: 0.00038664, [27] [switch_simplify]: 6.89001e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.398e-05 [with_stream_mark]: 5.688e-05 [recompute_prepare]: 6.15002e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 8.48001e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.24e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.09989e-07 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 6.70002e-06 [cse]: 1.55e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.456e-05 [rewriter_after_opt_a]: 3.865e-05 [convert_after_rewriter]: 6.68998e-06 [order_py_execute_after_rewriter]: 5.21998e-06 [mutable_eliminate]: 0.00066035 [jit_opt_b]: 5.431e-05, [1] [Cycle 1]: 4.677e-05, [2] [frontend_op_eliminate]: 1.785e-05 [inline_after_opt_a]: 1.649e-05 [cconv]: 3.002e-05 [loop_unroll]: 0.00044136 [jit_opt_after_cconv]: 0.00015563, [1] [Cycle 1]: 0.00014876, [11] [c_1]: 2.304e-05 [parameter_eliminate]: 3.40998e-06 [updatestate_depend_eliminate]: 7.36001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.742e-05 [call_graph_tuple_transform]: 2.052e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.561e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 5.578e-05 [cse_after_recomputation]: 2.474e-05, [1] [Cycle 1]: 1.794e-05, [1] [cse]: 1.19e-05 [auto_monad_reorder]: 1.748e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.88998e-06 [opt_after_jit_grad]: 0.00046899 [symbol_engine_optimizer]: 7.562e-05, [1] [Cycle 1]: 6.903e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 8.05e-06 TotalTime = 0.0315756, [30] [bootstrap]: 0.00029644 [type_inference]: 0.0225711 [event_method]: 2.139e-05 [auto_monad]: 6.829e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00012505 [rewriter_before_opt_a]: 9.033e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00609693, [2] [Cycle 1]: 0.00218217, [27] [switch_simplify]: 6.037e-05 [loop_unroll]: 3.221e-05 [a_1]: 0.00058715 [with_stream_mark]: 2.203e-05 [recompute_prepare]: 9.22001e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00108089 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.599e-05 [cse]: 7.514e-05 [replace_applicator]: 1.456e-05 [Cycle 2]: 0.00033744, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.23002e-06 [a_1]: 9.32e-05 [with_stream_mark]: 1.262e-05 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 4.89003e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.35e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.17998e-06 [inline_without_move]: 5.22e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 7.09001e-06 [cse]: 1.372e-05 [replace_applicator]: 6.06998e-06 [py_interpret_to_execute_after_opt_a]: 1.305e-05 [rewriter_after_opt_a]: 3.96e-05 [convert_after_rewriter]: 7.49002e-06 [order_py_execute_after_rewriter]: 4.81997e-06 [mutable_eliminate]: 0.00062738 [jit_opt_b]: 5.263e-05, [1] [Cycle 1]: 4.479e-05, [2] [frontend_op_eliminate]: 1.604e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.779e-05 [loop_unroll]: 0.00044535 [jit_opt_after_cconv]: 0.0001554, [1] [Cycle 1]: 0.00014831, [11] [c_1]: 2.178e-05 [parameter_eliminate]: 3.05998e-06 [updatestate_depend_eliminate]: 6.16998e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.988e-05 [call_graph_tuple_transform]: 1.997e-05 [tuple_list_get_item_eliminator]: 5.76998e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.99999e-06 [remove_dup_value]: 1.505e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 6.18998e-06 [add_recomputation]: 5.13e-05 [cse_after_recomputation]: 2.267e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.153e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 6.29999e-06 [opt_after_jit_grad]: 0.00047411 [symbol_engine_optimizer]: 8.946e-05, [1] [Cycle 1]: 8.318e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 8e-0 [elim_not_effective]: 1.293e-05 [opt_reshape]: 5.64e-06 [fold_const_symbol]: 9.79e-06 [renormalize]: 3.69997e-07 [validate]: 4.509e-05 Sums bootstrap : 0.000430s : 0.70% type_inference : 0.055345s : 90.17% event_method : 0.000035s : 0.06% auto_monad : 0.000110s : 0.18% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000423s : 0.69% rewriter_before_opt_a : 0.000111s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.12% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000722s : 1.18% jit_opt_a.with_stream_mark : 0.000080s : 0.13% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001709s : 2.78% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000055s : 0.09% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000660s : 1.08% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000030s : 0.05% loop_unroll : 0.000441s : 0.72% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.6 [elim_not_effective]: 1.381e-05 [opt_reshape]: 6.32001e-06 [fold_const_symbol]: 2.294e-05 [renormalize]: 3.80009e-07 [validate]: 4.388e-05 Sums bootstrap : 0.000296s : 1.08% type_inference : 0.022571s : 82.41% event_method : 0.000021s : 0.08% auto_monad : 0.000068s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000125s : 0.46% rewriter_before_opt_a : 0.000090s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000680s : 2.48% jit_opt_a.with_stream_mark : 0.000035s : 0.13% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001081s : 3.95% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000089s : 0.32% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000627s : 2.29% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000028s : 0.10% loop_unroll : 0.000445s : 1.63% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s 00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000469s : 0.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.07% : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000474s : 1.73% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000023s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.16% Time group info: ------[substitution.] 0.000255 23 0.64% : 0.000002s : 2: substitution.elim_not_effective 6.01% : 0.000015s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 81.05% : 0.000207s : 4: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000004s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 4.86% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022492 2 92.65% : 0.020837s : 1: type_inference.infer 7.35% : 0.001654s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.45% : 0.000052s : 4: replace.inline 31.55% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.79% : 0.000203s : 4: match.inline 5.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.88% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 6.22% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.88% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: Time group info: ------[substitution.] 0.000278 23 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.12% : 0.000006s : 3: substitution.graph_param_transform 86.78% : 0.000241s : 4: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000006s : 2: substitution.replace_old_param 4.50% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055185 2 37.42% : 0.020650s : 1: type_inference.infer 62.58% : 0.034535s : 1: type_inference.specialize ------[replace.] 0.000086 6 67.64% : 0.000058s : 4: replace.inline 32.36% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 6 95.45% : 0.000238s : 4: match.inline 4.55% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.49% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000002s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.35% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.30% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.67% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000895 13 42.53% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.81% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.67% : 0.000462s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033630 72 0.16% : 0.000054s : 1: add_recomputation 0.21% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.94% : 0.000317s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.14% : 0.006100s : 1: jit_opt_a 0.47% : 0.000158s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.35% : 0.000454s : 1: loop_unroll 1.89% : 0.000636s : 1: mutable_eliminate 2.70% : 0.000909s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000048s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000483s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000129s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.87% : 0.000628s : 1: renormalize.infer 1.32% : 0.000444s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.28% : 0.000094s : 1: rewriter_before_opt_a 0.27% : 0.000092s : 1: symbol_engine_optimizer 67.17% : 0.022591s : 1: type_inference predicate.row_tensor_eliminate 1.32% : 0.000002s : 10: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.71% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.07% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.14% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001215 13 39.39% : 0.000479s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.08% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.53% : 0.000675s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068635 72 0.09% : 0.000058s : 1: add_recomputation 0.17% : 0.000114s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.66% : 0.000450s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.06% : 0.000040s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 10.39% : 0.007129s : 1: jit_opt_a 0.23% : 0.000158s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.66% : 0.000450s : 1: loop_unroll 0.98% : 0.000670s : 1: mutable_eliminate 1.39% : 0.000956s : 26: opt.transform.jit_opt_a 0.07% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.62% : 0.000428s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.48% : 0.001015s : 1: renormalize.infer 1.00% : 0.000684s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.17% : 0.000115s : 1: rewriter_before_opt_a 0.11% : 0.000078s : 1: symbol_engine_optimizer 80.68% : 0.055372s : 1: type_inference TotalTime = 0.0307726, [30] [bootstrap]: 0.00030598 [type_inference]: 0.0221461 [event_method]: 2.052e-05 [auto_monad]: 7.144e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00011616 [rewriter_before_opt_a]: 8.702e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00580314, [2] [Cycle 1]: 0.00208052, [27] [switch_simplify]: 7.286e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.0005669 [with_stream_mark]: 2.284e-05 [recompute_prepare]: 7.81001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.00104262 [add_forward_monad_depend]: 5.35001e-06 [auto_monad_grad]: 2.07999e-06 [auto_monad_eliminator]: 1.475e-05 [cse]: 3.803e-05 [replace_applicator]: 1.271e-05 [Cycle 2]: 0.00032882, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.25999e-06 [a_1]: 9.261e-05 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.379e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.26999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.52001e-06 [cse]: 1.315e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.447e-05 [rewriter_after_opt_a]: 3.74e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00057103 [jit_opt_b]: 5e-05, [1] [Cycle 1]: 4.325e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.635e-05 [cconv]: 2.457e-05 [loop_unroll]: 0.00042902 [jit_opt_after_cconv]: 0.00015089, [1] [Cycle 1]: 0.00014462, [11] [c_1]: 2.221e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.277e-05 [call_graph_tuple_transform]: 2.034e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 4.982e-05 [cse_after_recomputation]: 2.242e-05, [1] [Cycle 1]: 1.726e-05, [1] [cse]: 1.165e-05 [auto_monad_reorder]: 1.804e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00047181 [symbol_engine_optimizer]: 7.219e-05, [1] [Cycle 1]: 6.599e-05, [6] [build]: 3.53999e-06 [elim_shapecalc]: 7.68001e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 6.15002e-06 [fold_const_symbol]: 8.64998e-06 [renormalize]: 4.80009e-07 [validate]: 5.534e-05 Sums bootstrap : 0.000306s : 1.14% type_inference : 0.022146s : 82.72% event_method : 0.000021s : 0.08% auto_monad : 0.000071s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000116s : 0.43% rewriter_before_opt_a : 0.000087s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.30% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000660s : 2.46% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001043s : 3.89% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000051s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000037s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000571s : 2.13% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000025s : 0.09% loop_unroll : 0.000429s : 1.60% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000472s : 1.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.21% Time group info: ------[substitution.] 0.000224 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 3: substitution.graph_param_transform 84.54% : 0.000189s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 5.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022067 2 92.24% : 0.020355s : 1: type_inference.infer 7.76% : 0.001712s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.49% : 0.000051s : 4: replace.inline 31.51% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.21% : 0.000187s : 4: match.inline 5.79% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.10% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000001s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.42% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.03% : 0.000006s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.21% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.62% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.98% : 0.000003s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 0.98% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.12% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 16.05% : 0.000020s : 53: predicate.switch_simplify 1.19% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000953 13 46.10% : 0.000439s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.86% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.04% : 0.000467s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032734 72 0.16% : 0.000053s : 1: add_recomputation 0.23% : 0.000075s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.00% : 0.000326s : 1: bootstrap 0.08% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.74% : 0.005806s : 1: jit_opt_a 0.47% : 0.000153s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.34% : 0.000437s : 1: loop_unroll 1.77% : 0.000579s : 1: mutable_eliminate 2.73% : 0.000894s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.47% : 0.000480s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000120s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.83% : 0.000600s : 1: renormalize.infer 1.32% : 0.000434s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000040s : 1: rewriter_after_opt_a 0.28% : 0.000091s : 1: rewriter_before_opt_a 0.23% : 0.000075s : 1: symbol_engine_optimizer 67.72% : 0.022166s : 1: type_inference TotalTime = 0.0304452, [30] [bootstrap]: 0.00030928 [type_inference]: 0.0216841 [event_method]: 2.069e-05 [auto_monad]: 6.841e-05 [graph_reusing]: 5.50001e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 0.00011849 [rewriter_before_opt_a]: 8.756e-05 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00589185, [2] [Cycle 1]: 0.0020875, [27] [switch_simplify]: 5.852e-05 [loop_unroll]: 3.044e-05 [a_1]: 0.00057835 [with_stream_mark]: 1.968e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 9.80002e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00105169 [add_forward_monad_depend]: 5.77001e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.764e-05 [cse]: 3.505e-05 [replace_applicator]: 1.271e-05 [Cycle 2]: 0.00034195, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.68e-05 [with_stream_mark]: 9.91998e-06 [recompute_prepare]: 5.76998e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.331e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 6.17999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.52999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.471e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 1.262e-05 [rewriter_after_opt_a]: 3.869e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00059638 [jit_opt_b]: 5.254e-05, [1] [Cycle 1]: 4.47e-05, [2] [frontend_op_eliminate]: 1.675e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 2.581e-05 [loop_unroll]: 0.00044744 [jit_opt_after_cconv]: 0.00015104, [1] [Cycle 1]: 0.00014452, [11] [c_1]: 2.111e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.571e-05 [call_graph_tuple_transform]: 1.917e-05 [tuple_list_get_item_eliminator]: 5.91998e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.578e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.267e-05 [cse_after_recomputation]: 2.322e-05, [1] [Cycle 1]: 1.789e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.765e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.0004697 [symbol_engine_optimizer]: 9.223e-05, [1] [Cycle 1]: 8.538e-05, [6] [build]: 3.60998e-06 [elim_shapecalc]: 7.91001e-06 [elim_not_effective]: 2.91e-05 [opt_reshape]: 6.66999e-06 [fold_const_symbol]: 9.61e-06 [renormalize]: 3.50003e-07 [validate]: 4.102e-05 Sums bootstrap : 0.000309s : 1.17% type_inference : 0.021684s : 82.20% event_method : 0.000021s : 0.08% auto_monad : 0.000068s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000118s : 0.45% rewriter_before_opt_a : 0.000088s : 0.33% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000675s : 2.56% jit_opt_a.with_stream_mark : 0.000030s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.05% jit_opt_a.renormalize : 0.001052s : 3.99% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000039s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000596s : 2.26% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000447s : 1.70% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000470s : 1.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000029s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.16% Time group info: ------[substitution.] 0.000221 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.63% : 0.000006s : 3: substitution.graph_param_transform 84.47% : 0.000186s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000004s : 4: substitution.remove_not_recompute_node 2.10% : 0.000005s : 2: substitution.replace_old_param 5.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021603 2 91.82% : 0.019835s : 1: type_inference.infer 8.18% : 0.001768s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.98% : 0.000050s : 4: replace.inline 32.02% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.08% : 0.000184s : 4: match.inline 5.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.09% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.29% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.28% : 0.000002s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.93% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000915 13 41.23% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.73% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.04% : 0.000494s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032450 72 0.17% : 0.000056s : 1: add_recomputation 0.22% : 0.000072s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.02% : 0.000330s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.17% : 0.005895s : 1: jit_opt_a 0.47% : 0.000154s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.40% : 0.000456s : 1: loop_unroll 1.87% : 0.000607s : 1: mutable_eliminate 2.77% : 0.000898s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.47% : 0.000478s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000122s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.88% : 0.000612s : 1: renormalize.infer 1.33% : 0.000431s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000042s : 1: rewriter_after_opt_a 0.28% : 0.000092s : 1: rewriter_before_opt_a 0.29% : 0.000095s : 1: symbol_engine_optimizer 66.88% : 0.021702s : 1: type_inference TotalTime = 0.0976232, [30] [bootstrap]: 0.00030142 [type_inference]: 0.0460892 [event_method]: 2.09e-05 [auto_monad]: 6.706e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00010927 [rewriter_before_opt_a]: 8.117e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.0485975, [2] [Cycle 1]: 0.0449078, [27] [switch_simplify]: 5.443e-05 [loop_unroll]: 2.986e-05 [a_1]: 0.0005326 [with_stream_mark]: 1.748e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.62002e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.415e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.76998e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 0.0439017 [add_forward_monad_depend]: 7.97003e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.791e-05 [cse]: 3.508e-05 [replace_applicator]: 2.454e-05 [Cycle 2]: 0.00035747, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.51e-06 [a_1]: 9.93e-05 [with_stream_mark]: 1.36e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.01997e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.858e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 5.71e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.37e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.356e-05 [rewriter_after_opt_a]: 3.793e-05 [convert_after_rewriter]: 6.40002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00074247 [jit_opt_b]: 5.122e-05, [1] [Cycle 1]: 4.288e-05, [2] [frontend_op_eliminate]: 1.578e-05 [inline_after_opt_a]: 1.592e-05 [cconv]: 2.684e-05 [loop_unroll]: 0.00043197 [jit_opt_after_cconv]: 0.00014115, [1] [Cycle 1]: 0.00013411, [11] [c_1]: 2.066e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.195e-05 [call_graph_tuple_transform]: 1.759e-05 [tuple_list_get_item_eliminator]: 5.34998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.09984e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.596e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 6.53e-06 [add_recomputation]: 5.08e-05 [cse_after_recomputation]: 2.269e-05, [1] [Cycle 1]: 1.731e-05, [1] [cse]: 1.131e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.49001e-06 [rewriter_after_jit_bprop_graph]: 5.31998e-06 [opt_after_jit_grad]: 0.00045582 [symbol_engine_optimizer]: 7.395e-05, [1] [Cycle 1]: 6.723e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 5.20027e-07 [validate]: 4.172e-05 Sums bootstrap : 0.000301s : 0.32% type_inference : 0.046089s : 49.20% event_method : 0.000021s : 0.02% auto_monad : 0.000067s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000109s : 0.12% rewriter_before_opt_a : 0.000081s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.07% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000632s : 0.67% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.043902s : 46.87% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000049s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000742s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000432s : 0.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 0.49% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000210 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.44% : 0.000005s : 3: substitution.graph_param_transform 82.45% : 0.000173s : 4: substitution.inline 2.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000005s : 4: substitution.remove_not_recompute_node 2.83% : 0.000006s : 2: substitution.replace_old_param 5.94% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046014 2 46.19% : 0.021255s : 1: type_inference.infer 53.81% : 0.024759s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.02% : 0.000050s : 4: replace.inline 30.98% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.73% : 0.000170s : 4: match.inline 6.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.34% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.96% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000002s : 18: predicate.replace_applicator 0.92% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000935 13 41.37% : 0.000387s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.14% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.50% : 0.000509s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142438 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000070s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000322s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000042s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 34.12% : 0.048601s : 1: jit_opt_a 0.10% : 0.000144s : 1: jit_opt_after_cconv 0.04% : 0.000054s : 1: jit_opt_b 0.31% : 0.000440s : 1: loop_unroll 0.53% : 0.000753s : 1: mutable_eliminate 0.61% : 0.000866s : 26: opt.transform.jit_opt_a 0.03% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000112s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 30.44% : 0.043352s : 1: renormalize.infer 0.38% : 0.000537s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000085s : 1: rewriter_before_opt_a 0.05% : 0.000076s : 1: symbol_engine_optimizer 32.37% : 0.046104s : 1: type_inference TotalTime = 0.0311868, [30] [bootstrap]: 0.0003386 [type_inference]: 0.0217335 [event_method]: 2.301e-05 [auto_monad]: 7.629e-05 [graph_reusing]: 6.49999e-06 [pre_auto_parallel]: 3.23e-06 [py_interpret_to_execute]: 0.0001412 [rewriter_before_opt_a]: 9.61e-05 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00626107, [2] [Cycle 1]: 0.00225345, [27] [switch_simplify]: 6.757e-05 [loop_unroll]: 3.589e-05 [a_1]: 0.00060321 [with_stream_mark]: 2.282e-05 [recompute_prepare]: 8.66002e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 6.38003e-06 [updatestate_useless_node_eliminater]: 5.68997e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00115264 [add_forward_monad_depend]: 6.73998e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.837e-05 [cse]: 3.853e-05 [replace_applicator]: 1.481e-05 [Cycle 2]: 0.00034811, [27] [switch_simplify]: 6.32001e-06 [loop_unroll]: 5.72999e-06 [a_1]: 0.00010108 [with_stream_mark]: 1.09e-05 [recompute_prepare]: 5.29998e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.41002e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 3.05002e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 8.33001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 4.99e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.47001e-06 [auto_monad_eliminator]: 6.48998e-06 [cse]: 1.52e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.441e-05 [rewriter_after_opt_a]: 4.098e-05 [convert_after_rewriter]: 7.27002e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00073165 [jit_opt_b]: 5.652e-05, [1] [Cycle 1]: 4.891e-05, [2] [frontend_op_eliminate]: 1.807e-05 [inline_after_opt_a]: 1.901e-05 [cconv]: 3.013e-05 [loop_unroll]: 0.00046663 [jit_opt_after_cconv]: 0.00016579, [1] [Cycle 1]: 0.0001589, [11] [c_1]: 2.198e-05 [parameter_eliminate]: 4.18999e-06 [updatestate_depend_eliminate]: 8.21002e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 3.272e-05 [call_graph_tuple_transform]: 2.097e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.865e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.38e-06 [add_recomputation]: 5.305e-05 [cse_after_recomputation]: 2.403e-05, [1] [Cycle 1]: 1.88e-05, [1] [cse]: 1.314e-05 [auto_monad_reorder]: 1.753e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 6.93e-06 [opt_after_jit_grad]: 0.00051393 [symbol_engine_optimizer]: 7.807e-05, [1] [Cycle 1]: 7.188e-05, [6] [build]: 4.12998e-06 [elim_shapecalc]: 8.33001e-06 [elim_not_effective]: 1.484e-05 [opt_reshape]: 7.05998e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 4.19997e-07 [validate]: 4.493e-05 Sums bootstrap : 0.000339s : 1.26% type_inference : 0.021734s : 80.84% event_method : 0.000023s : 0.09% auto_monad : 0.000076s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000141s : 0.53% rewriter_before_opt_a : 0.000096s : 0.36% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.27% jit_opt_a.loop_unroll : 0.000042s : 0.15% jit_opt_a.a_1 : 0.000704s : 2.62% jit_opt_a.with_stream_mark : 0.000034s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001153s : 4.29% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000054s : 0.20% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000732s : 2.72% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000019s : 0.07% cconv : 0.000030s : 0.11% loop_unroll : 0.000467s : 1.74% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000514s : 1.91% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.17% Time group info: ------[substitution.] 0.000249 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 3: substitution.graph_param_transform 85.87% : 0.000214s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021644 2 91.28% : 0.019756s : 1: type_inference.infer 8.72% : 0.001888s : 1: type_inference.specialize ------[replace.] 0.000079 6 70.27% : 0.000056s : 4: replace.inline 29.73% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.98% : 0.000212s : 4: match.inline 5.02% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.15% : 0.000003s : 10: predicate.arithmetic_simplify 1.19% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000008s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.26% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.77% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.59% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.02% : 0.000003s : 3: predicate.mutable_eliminate 0.70% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.65% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.73% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.77% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 2.02% : 0.000003s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.98% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000953 13 43.23% : 0.000412s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.49% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.28% : 0.000489s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033344 72 0.17% : 0.000056s : 1: add_recomputation 0.24% : 0.000080s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.08% : 0.000361s : 1: bootstrap 0.10% : 0.000033s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.07% : 0.000022s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.79% : 0.006265s : 1: jit_opt_a 0.51% : 0.000169s : 1: jit_opt_after_cconv 0.18% : 0.000059s : 1: jit_opt_b 1.42% : 0.000475s : 1: loop_unroll 2.23% : 0.000742s : 1: mutable_eliminate 2.84% : 0.000946s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000030s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.57% : 0.000523s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.44% : 0.000146s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 2.00% : 0.000666s : 1: renormalize.infer 1.43% : 0.000477s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.30% : 0.000101s : 1: rewriter_before_opt_a 0.24% : 0.000080s : 1: symbol_engine_optimizer 65.24% : 0.021755s : 1: type_inference TotalTime = 0.0253985, [30] [bootstrap]: 0.00039315 [type_inference]: 0.00943872 [event_method]: 2.14e-05 [auto_monad]: 7.172e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 5.36e-05 [rewriter_before_opt_a]: 8.571e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0132406, [2] [Cycle 1]: 0.00202636, [27] [switch_simplify]: 6.348e-05 [loop_unroll]: 3.36e-05 [a_1]: 0.00068509 [with_stream_mark]: 1.882e-05 [recompute_prepare]: 8.16002e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.65002e-06 [get_grad_eliminate_]: 6.59001e-06 [merge_forward]: 4.12003e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00087788 [add_forward_monad_depend]: 5.21998e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.619e-05 [cse]: 3.687e-05 [replace_applicator]: 1.296e-05 [Cycle 2]: 0.00034647, [27] [switch_simplify]: 7.03998e-06 [loop_unroll]: 5.49e-06 [a_1]: 0.00010525 [with_stream_mark]: 9.04998e-06 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 2.75997e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 5.49998e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.063e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 7.39002e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.324e-05 [replace_applicator]: 5.64998e-06 [py_interpret_to_execute_after_opt_a]: 1.116e-05 [rewriter_after_opt_a]: 3.819e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00051751 [jit_opt_b]: 5.323e-05, [1] [Cycle 1]: 4.72e-05, [2] [frontend_op_eliminate]: 1.764e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 2.649e-05 [loop_unroll]: 0.00041182 [jit_opt_after_cconv]: 0.00015372, [1] [Cycle 1]: 0.00014747, [11] [c_1]: 2.139e-05 [parameter_eliminate]: 2.74999e-06 [updatestate_depend_eliminate]: 5.80002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 1.97e-05 [call_graph_tuple_transform]: 2.976e-05 [tuple_list_get_item_eliminator]: 5.70001e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.79999e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 6.32001e-06 [add_recomputation]: 5.227e-05 [cse_after_recomputation]: 2.396e-05, [1] [Cycle 1]: 1.878e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.755e-05 [get_jit_bprop_graph]: 1.40001e-06 [rewriter_after_jit_bprop_graph]: 4.40999e-06 [opt_after_jit_grad]: 0.00044202 [symbol_engine_optimizer]: 7.501e-05, [1] [Cycle 1]: 6.815e-05, [6] [build]: 4e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 5.74999e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 2.60014e-07 [validate]: 4.001e-05 Sums bootstrap : 0.000393s : 2.82% type_inference : 0.009439s : 67.70% event_method : 0.000021s : 0.15% auto_monad : 0.000072s : 0.51% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000054s : 0.38% rewriter_before_opt_a : 0.000086s : 0.61% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.51% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000790s : 5.67% jit_opt_a.with_stream_mark : 0.000028s : 0.20% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000878s : 6.30% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000050s : 0.36% jit_opt_a.replace_applicator : 0.000019s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.08% rewriter_after_opt_a : 0.000038s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000518s : 3.71% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000026s : 0.19% loop_unroll : 0.000412s : 2.95% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000052s : 0.37% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000442s : 3.17% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.29% Time group info: ------[substitution.] 0.000278 27 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 3: substitution.graph_param_transform 84.50% : 0.000235s : 5: substitution.inline 1.04% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.06% : 0.000011s : 3: substitution.reduce_eliminate 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.36% : 0.000004s : 2: substitution.replace_old_param 4.07% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009359 2 87.63% : 0.008201s : 1: type_inference.infer 12.37% : 0.001158s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.26% : 0.000068s : 5: replace.inline 31.74% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 95.80% : 0.000232s : 5: match.inline 4.20% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.36% : 0.000002s : 11: predicate.addn_zero_filter 2.27% : 0.000003s : 11: predicate.arithmetic_simplify 1.41% : 0.000002s : 11: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.38% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000007s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.11% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 11: predicate.merge_addn 1.20% : 0.000002s : 11: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 16: predicate.partial_eliminate 1.14% : 0.000001s : 11: predicate.print_const_string_wrapper 2.56% : 0.000003s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 19: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.40% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.79% : 0.000010s : 59: predicate.switch_simplify 1.55% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.49% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000989 16 51.61% : 0.000510s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.28% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.11% : 0.000406s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027359 72 0.20% : 0.000055s : 1: add_recomputation 0.27% : 0.000075s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.51% : 0.000413s : 1: bootstrap 0.11% : 0.000029s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 48.41% : 0.013244s : 1: jit_opt_a 0.57% : 0.000156s : 1: jit_opt_after_cconv 0.20% : 0.000056s : 1: jit_opt_b 1.53% : 0.000418s : 1: loop_unroll 1.92% : 0.000525s : 1: mutable_eliminate 3.73% : 0.001020s : 26: opt.transform.jit_opt_a 0.22% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000013s : 1: opt.transform.mutable_eliminate 0.08% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.64% : 0.000449s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000057s : 1: py_interpret_to_execute 0.05% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000019s : 1: remove_dup_value 1.79% : 0.000491s : 1: renormalize.infer 1.38% : 0.000378s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000041s : 1: rewriter_after_opt_a 0.32% : 0.000089s : 1: rewriter_before_opt_a 0.28% : 0.000078s : 1: symbol_engine_optimizer 34.56% : 0.009454s : 1: type_inference TotalTime = 0.108872, [30] [bootstrap]: 0.00035508 [type_inference]: 0.0543406 [event_method]: 2.048e-05 [auto_monad]: 6.767e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.60997e-06 [py_interpret_to_execute]: 0.00015225 [rewriter_before_opt_a]: 8.139e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.0511087, [2] [Cycle 1]: 0.0471074, [27] [switch_simplify]: 6.186e-05 [loop_unroll]: 3.197e-05 [a_1]: 0.00060786 [with_stream_mark]: 2.104e-05 [recompute_prepare]: 8.13001e-06 [updatestate_depend_eliminate]: 3.87002e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.19999e-06 [merge_forward]: 3.74002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.446e-05 [j_node_and_user_rematch]: 9.23002e-06 [meta_fg_expand]: 3.13998e-06 [replace_old_param]: 9.38002e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 0.00161346 [add_forward_monad_depend]: 6.85998e-06 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 1.712e-05 [cse]: 2.449e-05 [replace_applicator]: 5.505e-05 [Cycle 2]: 0.00055942, [27] [switch_simplify]: 1.238e-05 [loop_unroll]: 8.40001e-06 [a_1]: 0.00014219 [with_stream_mark]: 3.727e-05 [recompute_prepare]: 6.88998e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.42997e-06 [parameter_eliminate]: 2.78e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 6.58e-06 [accelerated_algorithm]: 8.65001e-06 [meta_shard_fg_expand]: 3.83001e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.79002e-06 [cell_reuse_recompute_pass]: 3.04001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.798e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 3.91999e-06 [replace_old_param]: 1.172e-05 [inline_without_move]: 5.96e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 3.56999e-06 [auto_monad_eliminator]: 2.153e-05 [cse]: 5.281e-05 [replace_applicator]: 6.19001e-06 [py_interpret_to_execute_after_opt_a]: 2.771e-05 [rewriter_after_opt_a]: 5.027e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00089781 [jit_opt_b]: 6.017e-05, [1] [Cycle 1]: 5.175e-05, [2] [frontend_op_eliminate]: 2.123e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 3.779e-05 [loop_unroll]: 0.00043206 [jit_opt_after_cconv]: 0.00017186, [1] [Cycle 1]: 0.00016462, [11] [c_1]: 3.299e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 6.76e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 4.08999e-06 [cse]: 2.549e-05 [call_graph_tuple_transform]: 2.164e-05 [tuple_list_get_item_eliminator]: 7.46999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 6.35002e-06 [remove_dup_value]: 1.909e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 7.03998e-06 [add_recomputation]: 5.879e-05 [cse_after_recomputation]: 2.728e-05, [1] [Cycle 1]: 2.115e-05, [1] [cse]: 1.43e-05 [auto_monad_reorder]: 1.87e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 7.18e-06 [opt_after_jit_grad]: 0.00046864 [symbol_engine_optimizer]: 8.084e-05, [1] [Cycle 1]: 7.438e-05, [6] [build]: 5.17999e-06 [elim_shapecalc]: 9.98002e-06 [elim_not_effective]: 1.491e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 1.015e-05 [renormalize]: 5.00004e-07 [validate]: 0.00013641 Sums bootstrap : 0.000355s : 0.59% type_inference : 0.054341s : 90.02% event_method : 0.000020s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000152s : 0.25% rewriter_before_opt_a : 0.000081s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.12% jit_opt_a.loop_unroll : 0.000040s : 0.07% jit_opt_a.a_1 : 0.000750s : 1.24% jit_opt_a.with_stream_mark : 0.000058s : 0.10% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000042s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001614s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000006s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.06% jit_opt_a.cse : 0.000077s : 0.13% jit_opt_a.replace_applicator : 0.000061s : 0.10% py_interpret_to_execute_after_opt_a : 0.000028s : 0.05% rewriter_after_opt_a : 0.000050s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000898s : 1.49% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000038s : 0.06% loop_unroll : 0.000432s : 0.72% jit_opt_after_cconv.c_1 : 0.000033s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000059s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000469s : 0.78% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000136s : 0.23% Time group info: ------[substitution.] 0.000255 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 84.09% : 0.000214s : 4: substitution.inline 1.75% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 3.01% : 0.000008s : 2: substitution.replace_old_param 5.03% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054258 2 95.81% : 0.051987s : 1: type_inference.infer 4.19% : 0.002272s : 1: type_inference.specialize ------[replace.] 0.000089 6 68.49% : 0.000061s : 4: replace.inline 31.51% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.76% : 0.000212s : 4: match.inline 5.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 691 1.57% : 0.000002s : 10: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 10: predicate.addn_check_dump 1.13% : 0.000002s : 10: predicate.addn_zero_filter 2.09% : 0.000003s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.30% : 0.000002s : 10: predicate.environ_get_depend_swap 1.20% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 15: predicate.load_eliminater 1.21% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000002s : 10: predicate.minmaximum_grad 1.28% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 1.96% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 2.10% : 0.000003s : 10: predicate.reduce_eliminate 1.75% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 2.20% : 0.000003s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 10: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 16: predicate.switch_defer_inline 2.36% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.06% : 0.000011s : 53: predicate.switch_simplify 1.19% : 0.000002s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.82% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001167 13 38.92% : 0.000454s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.83% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 57.24% : 0.000668s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111491 72 0.06% : 0.000062s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.34% : 0.000377s : 1: bootstrap 0.04% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 45.85% : 0.051116s : 1: jit_opt_a 0.16% : 0.000176s : 1: jit_opt_after_cconv 0.06% : 0.000063s : 1: jit_opt_b 0.39% : 0.000440s : 1: loop_unroll 0.81% : 0.000908s : 1: mutable_eliminate 0.94% : 0.001044s : 26: opt.transform.jit_opt_a 0.06% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.14% : 0.000156s : 1: py_interpret_to_execute 0.03% : 0.000036s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 0.84% : 0.000937s : 1: renormalize.infer 0.60% : 0.000667s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000054s : 1: rewriter_after_opt_a 0.08% : 0.000086s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 48.75% : 0.054355s : 1: type_inference TotalTime = 0.0395397, [30] [bootstrap]: 0.00029563 [type_inference]: 0.0291284 [event_method]: 2.334e-05 [auto_monad]: 7.542e-05 [graph_reusing]: 5.80002e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00014242 [rewriter_before_opt_a]: 9.093e-05 [expand_dump_flag]: 4.01001e-06 [jit_opt_a]: 0.00688287, [2] [Cycle 1]: 0.00254726, [27] [switch_simplify]: 7.241e-05 [loop_unroll]: 3.147e-05 [a_1]: 0.00066774 [with_stream_mark]: 2.863e-05 [recompute_prepare]: 9.27999e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.83e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.658e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 1.127e-05 [inline_without_move]: 5.78002e-06 [renormalize]: 0.00132166 [add_forward_monad_depend]: 9.64999e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 2.124e-05 [cse]: 4.933e-05 [replace_applicator]: 1.935e-05 [Cycle 2]: 0.00037328, [27] [switch_simplify]: 6.68998e-06 [loop_unroll]: 5.92001e-06 [a_1]: 9.791e-05 [with_stream_mark]: 1.45e-05 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.73e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.26998e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 7.92003e-06 [cse]: 1.793e-05 [replace_applicator]: 6.19001e-06 [py_interpret_to_execute_after_opt_a]: 1.702e-05 [rewriter_after_opt_a]: 5.196e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00084309 [jit_opt_b]: 5.907e-05, [1] [Cycle 1]: 5.014e-05, [2] [frontend_op_eliminate]: 1.817e-05 [inline_after_opt_a]: 1.886e-05 [cconv]: 3.472e-05 [loop_unroll]: 0.00052426 [jit_opt_after_cconv]: 0.00018759, [1] [Cycle 1]: 0.00017856, [11] [c_1]: 2.398e-05 [parameter_eliminate]: 4.65001e-06 [updatestate_depend_eliminate]: 9.94999e-06 [updatestate_assign_eliminate]: 3.91999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [cse]: 4.189e-05 [call_graph_tuple_transform]: 2.365e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 2.035e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 7.43999e-06 [add_recomputation]: 6.539e-05 [cse_after_recomputation]: 2.647e-05, [1] [Cycle 1]: 2.024e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 2.016e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 8.25e-06 [opt_after_jit_grad]: 0.0005928 [symbol_engine_optimizer]: 0.00014246, [1] [Cycle 1]: 0.00013501, [6] [build]: 6.21e-06 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.818e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 1.029e-05 [renormalize]: 5.3001e-07 [validate]: 5.35e-05 Sums bootstrap : 0.000296s : 0.85% type_inference : 0.029128s : 83.63% event_method : 0.000023s : 0.07% auto_monad : 0.000075s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000142s : 0.41% rewriter_before_opt_a : 0.000091s : 0.26% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.23% jit_opt_a.loop_unroll : 0.000037s : 0.11% jit_opt_a.a_1 : 0.000766s : 2.20% jit_opt_a.with_stream_mark : 0.000043s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000021s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001322s : 3.79% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.08% jit_opt_a.cse : 0.000067s : 0.19% jit_opt_a.replace_applicator : 0.000026s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000052s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000843s : 2.42% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.05% cconv : 0.000035s : 0.10% loop_unroll : 0.000524s : 1.51% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000065s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000593s : 1.70% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.15% Time group info: ------[substitution.] 0.000294 23 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 3: substitution.graph_param_transform 85.87% : 0.000253s : 4: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000006s : 4: substitution.remove_not_recompute_node 2.54% : 0.000007s : 2: substitution.replace_old_param 5.00% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.029029 2 93.54% : 0.027153s : 1: type_inference.infer 6.46% : 0.001876s : 1: type_inference.specialize ------[replace.] 0.000089 6 68.35% : 0.000061s : 4: replace.inline 31.65% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000263 6 94.89% : 0.000250s : 4: match.inline 5.11% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.04% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.21% : 0.000008s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 2.14% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 2.57% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.49% : 0.000002s : 10: predicate.print_const_string_wrapper 1.91% : 0.000003s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.48% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000001s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.16% : 0.000011s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.007800 13 92.69% : 0.007229s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.77% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 6.54% : 0.000510s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041947 72 0.17% : 0.000070s : 1: add_recomputation 0.19% : 0.000079s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.75% : 0.000314s : 1: bootstrap 0.09% : 0.000037s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.07% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.42% : 0.006887s : 1: jit_opt_a 0.46% : 0.000191s : 1: jit_opt_after_cconv 0.15% : 0.000062s : 1: jit_opt_b 1.27% : 0.000535s : 1: loop_unroll 2.05% : 0.000859s : 1: mutable_eliminate 2.43% : 0.001020s : 26: opt.transform.jit_opt_a 0.13% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000024s : 1: opt.transform.mutable_eliminate 0.07% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000040s : 4: opt.transform.symbol_engine_opt 1.44% : 0.000605s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000146s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000023s : 1: remove_dup_value 1.77% : 0.000742s : 1: renormalize.infer 1.36% : 0.000569s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000055s : 1: rewriter_after_opt_a 0.23% : 0.000095s : 1: rewriter_before_opt_a 0.35% : 0.000145s : 1: symbol_engine_optimizer 69.50% : 0.029152s : 1: type_inference TotalTime = 0.0155267, [30] [bootstrap]: 0.00033474 [type_inference]: 0.00472816 [event_method]: 1.75e-05 [auto_monad]: 6.357e-05 [graph_reusing]: 5.80002e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 3.436e-05 [rewriter_before_opt_a]: 7.389e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00698497, [2] [Cycle 1]: 0.00181034, [27] [switch_simplify]: 6.096e-05 [loop_unroll]: 3.029e-05 [a_1]: 0.00055765 [with_stream_mark]: 2.353e-05 [recompute_prepare]: 7.36001e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.81998e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.447e-05 [j_node_and_user_rematch]: 9.46003e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 9.31998e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 0.00078651 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.544e-05 [cse]: 3.606e-05 [replace_applicator]: 1.243e-05 [Cycle 2]: 0.00032382, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.29998e-06 [a_1]: 9.086e-05 [with_stream_mark]: 1.009e-05 [recompute_prepare]: 5.35001e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.31998e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.69002e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.19001e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.33002e-06 [cse]: 1.347e-05 [replace_applicator]: 5.26998e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 4.163e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00155193 [jit_opt_b]: 5.128e-05, [1] [Cycle 1]: 4.335e-05, [2] [frontend_op_eliminate]: 1.57e-05 [inline_after_opt_a]: 1.626e-05 [cconv]: 2.873e-05 [loop_unroll]: 0.00046344 [jit_opt_after_cconv]: 0.00022532, [1] [Cycle 1]: 0.00021849, [11] [c_1]: 2.215e-05 [parameter_eliminate]: 4.15e-06 [updatestate_depend_eliminate]: 5.904e-05 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 3.559e-05 [call_graph_tuple_transform]: 2.131e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 2.21e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.858e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.44001e-06 [add_recomputation]: 5.161e-05 [cse_after_recomputation]: 2.352e-05, [1] [Cycle 1]: 1.76e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.831e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 4.72998e-06 [opt_after_jit_grad]: 0.00047108 [symbol_engine_optimizer]: 7.184e-05, [1] [Cycle 1]: 6.543e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 7.4e-06 [elim_not_effective]: 1.271e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 4.39992e-07 [validate]: 4.339e-05 Sums bootstrap : 0.000335s : 3.32% type_inference : 0.004728s : 46.92% event_method : 0.000017s : 0.17% auto_monad : 0.000064s : 0.63% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.34% rewriter_before_opt_a : 0.000074s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000067s : 0.66% jit_opt_a.loop_unroll : 0.000036s : 0.35% jit_opt_a.a_1 : 0.000649s : 6.44% jit_opt_a.with_stream_mark : 0.000034s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000787s : 7.81% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000050s : 0.49% jit_opt_a.replace_applicator : 0.000018s : 0.18% py_interpret_to_execute_after_opt_a : 0.000014s : 0.14% rewriter_after_opt_a : 0.000042s : 0.41% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.001552s : 15.40% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000029s : 0.29% loop_unroll : 0.000463s : 4.60% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000059s : 0.59% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000036s : 0.35% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000019s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.51% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000018s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000471s : 4.67% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.43% Time group info: ------[substitution.] 0.000221 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 83.71% : 0.000185s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000005s : 2: substitution.replace_old_param 6.15% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004663 2 82.78% : 0.003860s : 1: type_inference.infer 17.22% : 0.000803s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.54% : 0.000046s : 4: replace.inline 32.46% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.63% : 0.000183s : 4: match.inline 6.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 2.12% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 6.20% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.39% : 0.000002s : 10: predicate.reduce_eliminate 1.64% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.56% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000652 13 53.45% : 0.000348s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.08% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.47% : 0.000251s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017234 72 0.32% : 0.000055s : 1: add_recomputation 0.39% : 0.000067s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 2.06% : 0.000355s : 1: bootstrap 0.18% : 0.000031s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.12% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 40.55% : 0.006988s : 1: jit_opt_a 1.33% : 0.000228s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.74% : 0.000472s : 1: loop_unroll 9.07% : 0.001563s : 1: mutable_eliminate 5.04% : 0.000869s : 26: opt.transform.jit_opt_a 0.30% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.78% : 0.000479s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.54% : 0.000438s : 1: renormalize.infer 1.98% : 0.000341s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000045s : 1: rewriter_after_opt_a 0.45% : 0.000077s : 1: rewriter_before_opt_a 0.43% : 0.000074s : 1: symbol_engine_optimizer 27.52% : 0.004742s : 1: type_inference TotalTime = 0.0603074, [30] [bootstrap]: 0.00031512 [type_inference]: 0.0367545 [event_method]: 2.167e-05 [auto_monad]: 7.405e-05 [graph_reusing]: 5.98998e-06 [pre_auto_parallel]: 3.11999e-06 [py_interpret_to_execute]: 0.00014906 [rewriter_before_opt_a]: 8.875e-05 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.0202748, [2] [Cycle 1]: 0.0163075, [27] [switch_simplify]: 5.968e-05 [loop_unroll]: 3.249e-05 [a_1]: 0.0138811 [with_stream_mark]: 3.901e-05 [recompute_prepare]: 1.485e-05 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.37997e-06 [parameter_eliminate]: 2.94999e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 6.69001e-06 [accelerated_algorithm]: 7.95e-06 [meta_shard_fg_expand]: 5.01002e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 5.02e-06 [cell_reuse_recompute_pass]: 4.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.829e-05 [j_node_and_user_rematch]: 1.334e-05 [meta_fg_expand]: 4.07998e-06 [replace_old_param]: 1.269e-05 [inline_without_move]: 6.61999e-06 [renormalize]: 0.00186103 [add_forward_monad_depend]: 8.84e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.764e-05 [cse]: 4.118e-05 [replace_applicator]: 1.289e-05 [Cycle 2]: 0.00034746, [27] [switch_simplify]: 7.04001e-06 [loop_unroll]: 6.17999e-06 [a_1]: 0.00010011 [with_stream_mark]: 1.038e-05 [recompute_prepare]: 6.65002e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.04003e-06 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 2.59001e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.33e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.425e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.513e-05 [rewriter_after_opt_a]: 4.323e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00092925 [jit_opt_b]: 5.517e-05, [1] [Cycle 1]: 4.778e-05, [2] [frontend_op_eliminate]: 1.824e-05 [inline_after_opt_a]: 1.775e-05 [cconv]: 2.825e-05 [loop_unroll]: 0.0004381 [jit_opt_after_cconv]: 0.00015218, [1] [Cycle 1]: 0.00014529, [11] [c_1]: 2.42e-05 [parameter_eliminate]: 2.50997e-06 [updatestate_depend_eliminate]: 6.14001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 2.378e-05 [call_graph_tuple_transform]: 2.052e-05 [tuple_list_get_item_eliminator]: 6.58998e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.09984e-07 [switch_simplify]: 5.82999e-06 [remove_dup_value]: 1.655e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.91001e-06 [add_recomputation]: 5.286e-05 [cse_after_recomputation]: 4.404e-05, [1] [Cycle 1]: 1.755e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.973e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.00047368 [symbol_engine_optimizer]: 8.07e-05, [1] [Cycle 1]: 7.357e-05, [6] [build]: 4.25e-06 [elim_shapecalc]: 9.79e-06 [elim_not_effective]: 1.485e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 9.82001e-06 [renormalize]: 3.39991e-07 [validate]: 4.519e-05 Sums bootstrap : 0.000315s : 0.56% type_inference : 0.036754s : 65.62% event_method : 0.000022s : 0.04% auto_monad : 0.000074s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000149s : 0.27% rewriter_before_opt_a : 0.000089s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.12% jit_opt_a.loop_unroll : 0.000039s : 0.07% jit_opt_a.a_1 : 0.013981s : 24.96% jit_opt_a.with_stream_mark : 0.000049s : 0.09% jit_opt_a.recompute_prepare : 0.000022s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001861s : 3.32% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000055s : 0.10% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000043s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000929s : 1.66% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000438s : 0.78% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000020s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000474s : 0.85% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.013295 23 0.02% : 0.000002s : 2: substitution.elim_not_effective 0.01% : 0.000002s : 2: substitution.fold_const_symbol 0.05% : 0.000006s : 3: substitution.graph_param_transform 99.65% : 0.013248s : 4: substitution.inline 0.04% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.04% : 0.000005s : 4: substitution.remove_not_recompute_node 0.04% : 0.000006s : 2: substitution.replace_old_param 0.16% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036670 2 94.07% : 0.034496s : 1: type_inference.infer 5.93% : 0.002174s : 1: type_inference.specialize ------[replace.] 0.000199 6 69.21% : 0.000138s : 4: replace.inline 30.79% : 0.000061s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.013257 6 99.86% : 0.013239s : 4: match.inline 0.14% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 2.64% : 0.000004s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.17% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 10: predicate.environ_get_depend_swap 1.70% : 0.000003s : 10: predicate.environ_get_eliminate 0.98% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000002s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 6.04% : 0.000010s : 22: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.81% : 0.000003s : 6: predicate.less_batch_normalization 1.72% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.03% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.58% : 0.000006s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000002s : 10: predicate.merge_addn 0.94% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000003s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 1.76% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 2.70% : 0.000004s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.43% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.71% : 0.000001s : 6: predicate.specialize_transform 1.66% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.94% : 0.000005s : 16: predicate.switch_defer_inline 2.43% : 0.000004s : 16: predicate.switch_layer_defer_inline 5.97% : 0.000010s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.21% : 0.000004s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.50% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001252 13 39.43% : 0.000494s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.02% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 57.55% : 0.000720s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076442 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000078s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.44% : 0.000336s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000046s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 26.53% : 0.020280s : 1: jit_opt_a 0.20% : 0.000156s : 1: jit_opt_after_cconv 0.08% : 0.000058s : 1: jit_opt_b 0.58% : 0.000445s : 1: loop_unroll 1.23% : 0.000936s : 1: mutable_eliminate 18.61% : 0.014226s : 26: opt.transform.jit_opt_a 0.07% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000153s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.53% : 0.001169s : 1: renormalize.infer 0.89% : 0.000679s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000046s : 1: rewriter_after_opt_a 0.12% : 0.000093s : 1: rewriter_before_opt_a 0.11% : 0.000083s : 1: symbol_engine_optimizer 48.10% : 0.036771s : 1: type_inference TotalTime = 0.181948, [30] [bootstrap]: 0.00035098 [type_inference]: 0.168949 [event_method]: 2.098e-05 [auto_monad]: 6.995e-05 [graph_reusing]: 6.23998e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00043166 [rewriter_before_opt_a]: 9.372e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00960594, [2] [Cycle 1]: 0.00520149, [27] [switch_simplify]: 6.352e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00058205 [with_stream_mark]: 2.042e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 6.90002e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 6.14001e-06 [renormalize]: 0.00415017 [add_forward_monad_depend]: 7.77e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.775e-05 [cse]: 3.335e-05 [replace_applicator]: 1.563e-05 [Cycle 2]: 0.0007512, [27] [switch_simplify]: 6.94001e-06 [loop_unroll]: 5.71998e-06 [a_1]: 0.0001506 [with_stream_mark]: 1.085e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.54998e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 2.44001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 0.00027459 [meta_fg_expand]: 3.16001e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 5.92999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.41e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 1.076e-05 [cse]: 1.735e-05 [replace_applicator]: 6.06998e-06 [py_interpret_to_execute_after_opt_a]: 1.474e-05 [rewriter_after_opt_a]: 3.924e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.00073114 [jit_opt_b]: 5.497e-05, [1] [Cycle 1]: 4.685e-05, [2] [frontend_op_eliminate]: 1.828e-05 [inline_after_opt_a]: 1.712e-05 [cconv]: 2.853e-05 [loop_unroll]: 0.00042594 [jit_opt_after_cconv]: 0.0001495, [1] [Cycle 1]: 0.00014222, [11] [c_1]: 2.498e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.098e-05 [call_graph_tuple_transform]: 2.027e-05 [tuple_list_get_item_eliminator]: 5.98002e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 1.50001e-07 [switch_simplify]: 6.02999e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 8.82999e-06 [add_recomputation]: 5.028e-05 [cse_after_recomputation]: 2.151e-05, [1] [Cycle 1]: 1.592e-05, [1] [cse]: 1.042e-05 [auto_monad_reorder]: 1.602e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00044924 [symbol_engine_optimizer]: 7.393e-05, [1] [Cycle 1]: 6.821e-05, [6] [build]: 2.91999e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.342e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.52999e-06 [renormalize]: 3.09985e-07 [validate]: 0.00012828 Sums bootstrap : 0.000351s : 0.20% type_inference : 0.168949s : 95.11% event_method : 0.000021s : 0.01% auto_monad : 0.000070s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000432s : 0.24% rewriter_before_opt_a : 0.000094s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000733s : 0.41% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000284s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004150s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000731s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000426s : 0.24% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000449s : 0.25% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000128s : 0.07% TotalTime = 0.0520031, [30] [bootstrap]: 0.00030838 [type_inference]: 0.0244117 [event_method]: 2.258e-05 [auto_monad]: 0.0161408 [graph_reusing]: 1.027e-05 [pre_auto_parallel]: 3.9e-06 [py_interpret_to_execute]: 0.00046104 [rewriter_before_opt_a]: 0.00011203 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.0083281, [2] [Cycle 1]: 0.00459146, [27] [switch_simplify]: 5.711e-05 [loop_unroll]: 3.096e-05 [a_1]: 0.00253444 [with_stream_mark]: 2.001e-05 [recompute_prepare]: 1.033e-05 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 6.88998e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.93998e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 3.52002e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.437e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00160604 [add_forward_monad_depend]: 4.96002e-06 [auto_monad_grad]: 1.15999e-06 [auto_monad_eliminator]: 1.137e-05 [cse]: 2.331e-05 [replace_applicator]: 1.319e-05 [Cycle 2]: 0.00032812, [27] [switch_simplify]: 6.42001e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.322e-05 [with_stream_mark]: 9.30001e-06 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 2.98003e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 5.12999e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.332e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 7.46999e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 1.382e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.12e-05 [rewriter_after_opt_a]: 2.967e-05 [convert_after_rewriter]: 5.64e-06 [order_py_execute_after_rewriter]: 4.17998e-06 [mutable_eliminate]: 0.00060782 [jit_opt_b]: 5.328e-05, [1] [Cycle 1]: 4.684e-05, [2] [frontend_op_eliminate]: 1.752e-05 [inline_after_opt_a]: 1.73e-05 [cconv]: 1.692e-05 [loop_unroll]: 0.00042975 [jit_opt_after_cconv]: 0.0001489, [1] [Cycle 1]: 0.00014237, [11] [c_1]: 2.251e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 6.13998e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 2.433e-05 [call_graph_tuple_transform]: 1.729e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.73002e-06 [remove_dup_value]: 1.063e-05 [partial_unused_args_eliminate]: 1.50001e-06 [environ_conv]: 4.09002e-06 [add_recomputation]: 3.296e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.842e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.202e-05 [get_jit_bprop_graph]: 1.58002e-06 [rewriter_after_jit_bprop_graph]: 5.01002e-06 [opt_after_jit_grad]: 0.00046319 [symbol_engine_optimizer]: 9.827e-05, [1] [Cycle 1]: 9.143e-05, [6] [build]: 2.64001e-06 [elim_shapecalc] Time group info: ------[substitution.] 0.000225 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 4: substitution.graph_param_transform 83.56% : 0.000188s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000006s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 5.71% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.168863 2 97.67% : 0.164932s : 1: type_inference.infer 2.33% : 0.003931s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.00% : 0.000051s : 4: replace.inline 32.00% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.07% : 0.000185s : 4: match.inline 5.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.15% : 0.000001s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.95% : 0.000006s : 26: predicate.inline 1.15% : 0.000002s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.82% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.04% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.44% : 0.000002s : 12: predicate.print_const_string_wrapper 1.52% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4:: 8.47e-06 [elim_not_effective]: 1.252e-05 [opt_reshape]: 6.18998e-06 [fold_const_symbol]: 3.343e-05 [renormalize]: 4.00003e-07 [validate]: 3.272e-05 Sums bootstrap : 0.000308s : 0.64% type_inference : 0.024412s : 50.89% event_method : 0.000023s : 0.05% auto_monad : 0.016141s : 33.65% graph_reusing : 0.000010s : 0.02% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000461s : 0.96% rewriter_before_opt_a : 0.000112s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.13% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.002628s : 5.48% jit_opt_a.with_stream_mark : 0.000029s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001606s : 3.35% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.04% jit_opt_a.cse : 0.000037s : 0.08% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000608s : 1.27% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000017s : 0.04% loop_unroll : 0.000430s : 0.90% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0 predicate.row_tensor_eliminate 1.43% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.58% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.24% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002246 22 65.70% : 0.001476s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.47% : 0.000729s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.187307 72 0.03% : 0.000053s : 1: add_recomputation 0.04% : 0.000073s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.20% : 0.000371s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 5.13% : 0.009610s : 1: jit_opt_a 0.08% : 0.000152s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.23% : 0.000434s : 1: loop_unroll 0.39% : 0.000739s : 1: mutable_eliminate 0.66% : 0.001237s : 26: opt.transform.jit_opt_a 0.03% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000457s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000437s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.78% : 0.003333s : 1: renormalize.infer 0.43% : 0.000806s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000099s : 1: rewriter_before_opt_a 0.04% : 0.000077s : 1: symbol_engine_optimizer 90.21% : 0.168967s : 1: type_inference .000002s : 0.00% environ_conv : 0.000004s : 0.01% add_recomputation : 0.000033s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000012s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000463s : 0.97% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000033s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.07% Time group info: ------[substitution.] 0.000248 23 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 1.64% : 0.000004s : 3: substitution.graph_param_transform 86.36% : 0.000214s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 5.56% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024328 2 90.41% : 0.021996s : 1: type_inference.infer 9.59% : 0.002332s : 1: type_inference.specialize ------[replace.] 0.000134 6 73.22% : 0.000098s : 4: replace.inline 26.78% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.43% : 0.000211s : 4: match.inline 5.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.32% : 0.000003s : 10: predicate.arithmetic_simplify 1.61% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 1.20% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.49% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 6: predicate.less_batch_normalization 1.81% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 15: predicate.partial_eliminate 1.45% : 0.000002s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.68% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.93% : 0.000004s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.42% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001219 13 35.08% : 0.000428s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.56% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 60.36% : 0.000736s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056543 72 0.06% : 0.000036s : 1: add_recomputation 28.58% : 0.016159s : 1: auto_monad 0.03% : 0.000015s : 1: auto_monad_reorder 0.57% : 0.000322s : 1: bootstrap 0.04% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000016s : 1: graph_reusing 14.74% : 0.008332s : 1: jit_opt_a 0.27% : 0.000152s : 1: jit_opt_after_cconv 0.10% : 0.000056s : 1: jit_opt_b 0.77% : 0.000438s : 1: loop_unroll 1.09% : 0.000616s : 1: mutable_eliminate 5.05% : 0.002855s : 26: opt.transform.jit_opt_a 0.09% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000057s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.83% : 0.000467s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.59% : 0.000901s : 1: renormalize.infer 1.23% : 0.000696s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000032s : 1: rewriter_after_opt_a 0.21% : 0.000116s : 1: rewriter_before_opt_a 0.18% : 0.000101s : 1: symbol_engine_optimizer 43.21% : 0.024432s : 1: type_inference TotalTime = 0.268592, [30] [bootstrap]: 0.00039189 [type_inference]: 0.25572 [event_method]: 2.262e-05 [auto_monad]: 7.319e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00047238 [rewriter_before_opt_a]: 0.00010266 [expand_dump_flag]: 4.27e-06 [jit_opt_a]: 0.00926359, [2] [Cycle 1]: 0.00514851, [27] [switch_simplify]: 6.924e-05 [loop_unroll]: 3.531e-05 [a_1]: 0.00071354 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 9.03002e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.45002e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 6.75002e-06 [merge_forward]: 4.47003e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.536e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 3.23e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 6.49999e-06 [renormalize]: 0.00392182 [add_forward_monad_depend]: 7.42002e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.973e-05 [cse]: 3.964e-05 [replace_applicator]: 1.986e-05 [Cycle 2]: 0.00038645, [27] [switch_simplify]: 6.91001e-06 [loop_unroll]: 6.08002e-06 [a_1]: 0.00012917 [with_stream_mark]: 1.213e-05 [recompute_prepare]: 6.81999e-06 [updatestate_depend_eliminate]: 3.92002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.77999e-06 [cse]: 1.503e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.48e-05 [rewriter_after_opt_a]: 4.167e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00071115 [jit_opt_b]: 6.152e-05, [1] [Cycle 1]: 5.42e-05, [2] [frontend_op_eliminate]: 2.226e-05 [inline_after_opt_a]: 1.975e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.00044302 [jit_opt_after_cconv]: 0.00016723, [1] [Cycle 1]: 0.00016029, [11] [c_1]: 2.668e-05 [parameter_eliminate]: 3.14001e-06 [updatestate_depend_eliminate]: 8.18001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.675e-05 [call_graph_tuple_transform]: 2.302e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 7.27002e-06 [remove_dup_value]: 1.922e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 9.02999e-06 [add_recomputation]: 5.508e-05 [cse_after_recomputation]: 2.574e-05, [1] [Cycle 1]: 2.01e-05, [1] [cse]: 1.404e-05 [auto_monad_reorder]: 1.826e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.06e-06 [opt_after_jit_grad]: 0.00047986 [symbol_engine_optimizer]: 8.44e-05, [1] [Cycle 1]: 7.815e-05, [6] [build]: 3.63999e-06 [elim_shapecalc]: 9.09998e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 9.32001e-06 [fold_const_symbol]: 1.092e-05 [renormalize]: 3.9002e-07 [validate]: 0.00015131 Sums bootstrap : 0.000392s : 0.15% type_inference : 0.255720s : 96.78% event_method : 0.000023s : 0.01% auto_monad : 0.000073s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000472s : 0.18% rewriter_before_opt_a : 0.000103s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000843s : 0.32% jit_opt_a.with_stream_mark : 0.000032s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003922s : 1.48% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000055s : 0.02% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000711s : 0.27% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000443s : 0.17% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000480s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000151s : 0.06% Time group info: ------[substitution.] 0.000273 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.95% : 0.000003s : 2: substitution.fold_const_symbol 2.42% : 0.000007s : 4: substitution.graph_param_transform 85.60% : 0.000234s : 5: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000005s : 2: substitution.replace_old_param 4.97% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.255628 2 98.79% : 0.252546s : 1: type_inference.infer 1.21% : 0.003082s : 1: type_inference.specialize ------[replace.] 0.000111 7 67.89% : 0.000076s : 5: replace.inline 32.11% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 94.93% : 0.000230s : 5: match.inline 5.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.62% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.60% : 0.000002s : 13: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.20% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.85% : 0.000003s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.31% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.70% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000010s : 64: predicate.switch_simplify 1.50% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.57% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 13: predicate.value_based_eliminate 0.47% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.019381 25 95.29% : 0.018467s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.33% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 4.39% : 0.000850s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.273585 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000077s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.15% : 0.000417s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.39% : 0.009267s : 1: jit_opt_a 0.06% : 0.000170s : 1: jit_opt_after_cconv 0.02% : 0.000064s : 1: jit_opt_b 0.16% : 0.000451s : 1: loop_unroll 0.26% : 0.000720s : 1: mutable_eliminate 0.40% : 0.001106s : 26: opt.transform.jit_opt_a 0.02% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000488s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000478s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.10% : 0.003018s : 1: renormalize.infer 0.33% : 0.000893s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.04% : 0.000108s : 1: rewriter_before_opt_a 0.03% : 0.000087s : 1: symbol_engine_optimizer 93.48% : 0.255738s : 1: type_inference TotalTime = 0.0339128, [30] [bootstrap]: 0.00028101 [type_inference]: 0.0258348 [event_method]: 1.887e-05 [auto_monad]: 6.909e-05 [graph_reusing]: 6.04999e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 9.198e-05 [rewriter_before_opt_a]: 7.845e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00550547, [2] [Cycle 1]: 0.00169251, [27] [switch_simplify]: 5.35e-05 [loop_unroll]: 2.887e-05 [a_1]: 0.00050118 [with_stream_mark]: 1.802e-05 [recompute_prepare]: 6.97002e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 8.51002e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00077575 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.458e-05 [cse]: 3.15e-05 [replace_applicator]: 1.159e-05 [Cycle 2]: 0.00030711, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 5.01002e-06 [a_1]: 8.596e-05 [with_stream_mark]: 8.14002e-06 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.48002e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.216e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 7.00998e-06 [inline_without_move]: 4.77e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.60001e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 5.66998e-06 [cse]: 1.138e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.294e-05 [rewriter_after_opt_a]: 3.652e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00047577 [jit_opt_b]: 6.227e-05, [1] [Cycle 1]: 5.563e-05, [2] [frontend_op_eliminate]: 1.425e-05 [inline_after_opt_a]: 2.981e-05 [cconv]: 2.757e-05 [loop_unroll]: 0.00039939 [jit_opt_after_cconv]: 0.00013684, [1] [Cycle 1]: 0.00012987, [11] [c_1]: 1.99e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.006e-05 [call_graph_tuple_transform]: 1.78e-05 [tuple_list_get_item_eliminator]: 5.28002e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 6.28e-06 [add_recomputation]: 4.986e-05 [cse_after_recomputation]: 3.685e-05, [1] [Cycle 1]: 1.91e-05, [1] [cse]: 1.306e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.00044219 [symbol_engine_optimizer]: 7.12e-05, [1] [Cycle 1]: 6.482e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 7.38e-06 [elim_not_effective]: 1.232e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 8.40999e-06 [renormalize]: 5.00004e-07 [validate]: 3.794e-05 Sums bootstrap : 0.000281s : 0.94% type_inference : 0.025835s : 86.58% event_method : 0.000019s : 0.06% auto_monad : 0.000069s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000092s : 0.31% rewriter_before_opt_a : 0.000078s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.20% jit_opt_a.loop_unroll : 0.000034s : 0.11% jit_opt_a.a_1 : 0.000587s : 1.97% jit_opt_a.with_stream_mark : 0.000026s : 0.09% jit_opt_a.recompute_prepare : 0.000012s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.05% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.000776s : 2.60% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000043s : 0.14% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000476s : 1.59% jit_opt_b.frontend_op_eliminate : 0.000014s : 0.05% jit_opt_b.inline_after_opt_a : 0.000030s : 0.10% cconv : 0.000028s : 0.09% loop_unroll : 0.000399s : 1.34% jit_opt_after_cconv.c_1 : 0.000020s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000020s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.17% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000442s : 1.48% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.13% Time group info: ------[substitution.] 0.000189 23 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000005s : 3: substitution.graph_param_transform 83.25% : 0.000157s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000004s : 4: substitution.remove_not_recompute_node 2.10% : 0.000004s : 2: substitution.replace_old_param 6.63% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025768 2 94.64% : 0.024388s : 1: type_inference.infer 5.36% : 0.001381s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.63% : 0.000043s : 4: replace.inline 32.37% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.13% : 0.000155s : 4: match.inline 6.87% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.34% : 0.000001s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000000s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.42% : 0.000009s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000769 13 45.77% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.38% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.85% : 0.000376s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035546 72 0.15% : 0.000053s : 1: add_recomputation 0.20% : 0.000073s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 0.84% : 0.000300s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000039s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.50% : 0.005508s : 1: jit_opt_a 0.39% : 0.000139s : 1: jit_opt_after_cconv 0.18% : 0.000065s : 1: jit_opt_b 1.15% : 0.000407s : 1: loop_unroll 1.36% : 0.000484s : 1: mutable_eliminate 2.23% : 0.000792s : 26: opt.transform.jit_opt_a 0.13% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000038s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.27% : 0.000450s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000095s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.16% : 0.000414s : 1: renormalize.infer 1.00% : 0.000355s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000039s : 1: rewriter_after_opt_a 0.23% : 0.000082s : 1: rewriter_before_opt_a 0.21% : 0.000074s : 1: symbol_engine_optimizer 72.73% : 0.025852s : 1: type_inference TotalTime = 0.0298776, [30] [bootstrap]: 0.00031097 [type_inference]: 0.0212107 [event_method]: 2.102e-05 [auto_monad]: 7.224e-05 [graph_reusing]: 5.50001e-06 [pre_auto_parallel]: 2.73998e-06 [py_interpret_to_execute]: 0.00012101 [rewriter_before_opt_a]: 8.405e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.0057319, [2] [Cycle 1]: 0.00202359, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 3.143e-05 [a_1]: 0.00057495 [with_stream_mark]: 1.938e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00099246 [add_forward_monad_depend]: 5.34998e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.524e-05 [cse]: 3.511e-05 [replace_applicator]: 1.255e-05 [Cycle 2]: 0.00033029, [27] [switch_simplify]: 5.85002e-06 [loop_unroll]: 5.49e-06 [a_1]: 9.323e-05 [with_stream_mark]: 8.43001e-06 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 2.93998e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.34e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 1.294e-05 [rewriter_after_opt_a]: 3.821e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 4.96002e-06 [mutable_eliminate]: 0.00054578 [jit_opt_b]: 6.323e-05, [1] [Cycle 1]: 5.383e-05, [2] [frontend_op_eliminate]: 2.076e-05 [inline_after_opt_a]: 1.704e-05 [cconv]: 2.59e-05 [loop_unroll]: 0.000444 [jit_opt_after_cconv]: 0.00015227, [1] [Cycle 1]: 0.00014601, [11] [c_1]: 2.151e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.329e-05 [call_graph_tuple_transform]: 1.883e-05 [tuple_list_get_item_eliminator]: 5.67001e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.558e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 5.89e-06 [add_recomputation]: 4.731e-05 [cse_after_recomputation]: 2.213e-05, [1] [Cycle 1]: 1.686e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.736e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.00045353 [symbol_engine_optimizer]: 7.572e-05, [1] [Cycle 1]: 6.969e-05, [6] [build]: 4.24002e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.332e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 5.89993e-07 [validate]: 3.929e-05 Sums bootstrap : 0.000311s : 1.21% type_inference : 0.021211s : 82.40% event_method : 0.000021s : 0.08% auto_monad : 0.000072s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000121s : 0.47% rewriter_before_opt_a : 0.000084s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000668s : 2.60% jit_opt_a.with_stream_mark : 0.000028s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000993s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000049s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000546s : 2.12% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.08% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000026s : 0.10% loop_unroll : 0.000444s : 1.72% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000047s : 0.18% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000454s : 1.76% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.15% Time group info: ------[substitution.] 0.000228 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000005s : 3: substitution.graph_param_transform 84.85% : 0.000193s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.66% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021129 2 91.76% : 0.019388s : 1: type_inference.infer 8.24% : 0.001741s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.03% : 0.000054s : 4: replace.inline 31.97% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.18% : 0.000191s : 4: match.inline 5.82% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.67% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.93% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.10% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000909 13 43.72% : 0.000397s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.10% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.19% : 0.000465s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031794 72 0.16% : 0.000051s : 1: add_recomputation 0.24% : 0.000076s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.05% : 0.000333s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.04% : 0.005735s : 1: jit_opt_a 0.49% : 0.000155s : 1: jit_opt_after_cconv 0.21% : 0.000066s : 1: jit_opt_b 1.42% : 0.000452s : 1: loop_unroll 2.11% : 0.000672s : 1: mutable_eliminate 2.81% : 0.000895s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000031s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.45% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000125s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.81% : 0.000574s : 1: renormalize.infer 1.29% : 0.000410s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000088s : 1: rewriter_before_opt_a 0.25% : 0.000078s : 1: symbol_engine_optimizer 66.77% : 0.021229s : 1: type_inference TotalTime = 0.0521124, [30] [bootstrap]: 0.00031532 [type_inference]: 0.042164 [event_method]: 2.412e-05 [auto_monad]: 7.454e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00020022 [rewriter_before_opt_a]: 9.471e-05 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.00679494, [2] [Cycle 1]: 0.00274403, [27] [switch_simplify]: 6.849e-05 [loop_unroll]: 3.369e-05 [a_1]: 0.00063313 [with_stream_mark]: 2.053e-05 [recompute_prepare]: 9.42001e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.70002e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00158964 [add_forward_monad_depend]: 6.80998e-06 [auto_monad_grad]: 3.00998e-06 [auto_monad_eliminator]: 1.841e-05 [cse]: 4.059e-05 [replace_applicator]: 1.769e-05 [Cycle 2]: 0.00035769, [27] [switch_simplify]: 6.81999e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.00010301 [with_stream_mark]: 1.08e-05 [recompute_prepare]: 6.20002e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.08002e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.69002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.69998e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.402e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.486e-05 [rewriter_after_opt_a]: 4.176e-05 [convert_after_rewriter]: 7.10998e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.00071958 [jit_opt_b]: 5.337e-05, [1] [Cycle 1]: 4.61e-05, [2] [frontend_op_eliminate]: 1.721e-05 [inline_after_opt_a]: 1.777e-05 [cconv]: 2.93e-05 [loop_unroll]: 0.00045026 [jit_opt_after_cconv]: 0.00015521, [1] [Cycle 1]: 0.00014855, [11] [c_1]: 2.255e-05 [parameter_eliminate]: 2.97002e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 2.622e-05 [call_graph_tuple_transform]: 2.067e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.61003e-06 [remove_dup_value]: 1.68e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 5.45e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.729e-05, [1] [cse]: 1.172e-05 [auto_monad_reorder]: 1.915e-05 [get_jit_bprop_graph]: 1.66002e-06 [rewriter_after_jit_bprop_graph]: 5.81003e-06 [opt_after_jit_grad]: 0.00046689 [symbol_engine_optimizer]: 0.00011791, [1] [Cycle 1]: 0.00011091, [6] [build]: 4.62e-06 [elim_shapecalc]: 7.68001e-06 [elim_not_effective]: 1.397e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 5.014e-05 [renormalize]: 5.19998e-07 [validate]: 4.546e-05 Sums bootstrap : 0.000315s : 0.66% type_inference : 0.042164s : 88.26% event_method : 0.000024s : 0.05% auto_monad : 0.000075s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000200s : 0.42% rewriter_before_opt_a : 0.000095s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.16% jit_opt_a.loop_unroll : 0.000040s : 0.08% jit_opt_a.a_1 : 0.000736s : 1.54% jit_opt_a.with_stream_mark : 0.000031s : 0.07% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001590s : 3.33% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.05% jit_opt_a.cse : 0.000055s : 0.11% jit_opt_a.replace_applicator : 0.000023s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000042s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000720s : 1.51% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000029s : 0.06% loop_unroll : 0.000450s : 0.94% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000467s : 0.98% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000050s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.10% Time group info: ------[substitution.] 0.000257 23 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 85.32% : 0.000220s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000005s : 2: substitution.replace_old_param 5.39% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042056 2 46.12% : 0.019398s : 1: type_inference.infer 53.88% : 0.022658s : 1: type_inference.specialize ------[replace.] 0.000085 6 66.42% : 0.000057s : 4: replace.inline 33.58% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.43% : 0.000217s : 4: match.inline 5.57% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.07% : 0.000001s : 10: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.28% : 0.000002s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.22% : 0.000002s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.45% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.22% : 0.000003s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.86% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.70% : 0.000011s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.80% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001129 13 40.35% : 0.000456s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.38% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.27% : 0.000624s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054770 72 0.10% : 0.000057s : 1: add_recomputation 0.14% : 0.000078s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.61% : 0.000335s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.41% : 0.006799s : 1: jit_opt_a 0.29% : 0.000158s : 1: jit_opt_after_cconv 0.10% : 0.000056s : 1: jit_opt_b 0.84% : 0.000458s : 1: loop_unroll 1.33% : 0.000731s : 1: mutable_eliminate 1.79% : 0.000982s : 26: opt.transform.jit_opt_a 0.09% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000075s : 4: opt.transform.symbol_engine_opt 0.87% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000204s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 1.74% : 0.000951s : 1: renormalize.infer 1.15% : 0.000628s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000045s : 1: rewriter_after_opt_a 0.18% : 0.000098s : 1: rewriter_before_opt_a 0.22% : 0.000121s : 1: symbol_engine_optimizer 77.02% : 0.042183s : 1: type_inference TotalTime = 0.032967, [30] [bootstrap]: 0.00029109 [type_inference]: 0.0220231 [event_method]: 2.326e-05 [auto_monad]: 7.634e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00014132 [rewriter_before_opt_a]: 9.013e-05 [expand_dump_flag]: 3.20002e-06 [jit_opt_a]: 0.00738698, [2] [Cycle 1]: 0.00272339, [27] [switch_simplify]: 7.348e-05 [loop_unroll]: 3.417e-05 [a_1]: 0.00068773 [with_stream_mark]: 2.899e-05 [recompute_prepare]: 1.165e-05 [updatestate_depend_eliminate]: 5.20001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 3.14999e-06 [specialize_transform]: 8e-06 [updatestate_useless_node_eliminater]: 6.38998e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 3.14999e-06 [get_grad_eliminate_]: 7.1e-06 [merge_forward]: 4.97e-06 [cell_reuse_recompute_pass]: 2.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.741e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 6.99001e-06 [renormalize]: 0.00143184 [add_forward_monad_depend]: 9.99999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 2.452e-05 [cse]: 4.473e-05 [replace_applicator]: 2.336e-05 [Cycle 2]: 0.00040635, [27] [switch_simplify]: 6.79999e-06 [loop_unroll]: 5.64e-06 [a_1]: 9.934e-05 [with_stream_mark]: 1.852e-05 [recompute_prepare]: 6.92002e-06 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.77998e-06 [cell_reuse_recompute_pass]: 2.98998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.133e-05 [j_node_and_user_rematch]: 9.99001e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.101e-05 [inline_without_move]: 5.21998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.92999e-06 [auto_monad_grad]: 1.54998e-06 [auto_monad_eliminator]: 1.066e-05 [cse]: 1.823e-05 [replace_applicator]: 7.38999e-06 [py_interpret_to_execute_after_opt_a]: 2.28e-05 [rewriter_after_opt_a]: 4.936e-05 [convert_after_rewriter]: 7.93001e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.0008152 [jit_opt_b]: 5.994e-05, [1] [Cycle 1]: 5.149e-05, [2] [frontend_op_eliminate]: 1.95e-05 [inline_after_opt_a]: 1.915e-05 [cconv]: 3.559e-05 [loop_unroll]: 0.0005626 [jit_opt_after_cconv]: 0.0001965, [1] [Cycle 1]: 0.00018925, [11] [c_1]: 2.412e-05 [parameter_eliminate]: 6.14999e-06 [updatestate_depend_eliminate]: 1.038e-05 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.37002e-06 [cse]: 4.286e-05 [call_graph_tuple_transform]: 2.753e-05 [tuple_list_get_item_eliminator]: 7.63999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 1.02e-06 [switch_simplify]: 6.00002e-06 [remove_dup_value]: 1.715e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 7.77998e-06 [add_recomputation]: 7.664e-05 [cse_after_recomputation]: 2.785e-05, [1] [Cycle 1]: 2.159e-05, [1] [cse]: 1.436e-05 [auto_monad_reorder]: 1.96e-05 [get_jit_bprop_graph]: 2.64999e-06 [rewriter_after_jit_bprop_graph]: 8.28999e-06 [opt_after_jit_grad]: 0.00063513 [symbol_engine_optimizer]: 8.602e-05, [1] [Cycle 1]: 7.819e-05, [6] [build]: 6.06e-06 [elim_shapecalc]: 9.00001e-06 [elim_not_effective]: 1.657e-05 [opt_reshape]: 6.78e-06 [fold_const_symbol]: 9.30001e-06 [renormalize]: 3.30008e-07 [validate]: 5.144e-05 Sums bootstrap : 0.000291s : 1.04% type_inference : 0.022023s : 78.77% event_method : 0.000023s : 0.08% auto_monad : 0.000076s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000141s : 0.51% rewriter_before_opt_a : 0.000090s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000080s : 0.29% jit_opt_a.loop_unroll : 0.000040s : 0.14% jit_opt_a.a_1 : 0.000787s : 2.82% jit_opt_a.with_stream_mark : 0.000048s : 0.17% jit_opt_a.recompute_prepare : 0.000019s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.05% jit_opt_a.merge_forward : 0.000010s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000023s : 0.08% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001432s : 5.12% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.13% jit_opt_a.cse : 0.000063s : 0.23% jit_opt_a.replace_applicator : 0.000031s : 0.11% py_interpret_to_execute_after_opt_a : 0.000023s : 0.08% rewriter_after_opt_a : 0.000049s : 0.18% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000815s : 2.92% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.07% jit_opt_b.inline_after_opt_a : 0.000019s : 0.07% cconv : 0.000036s : 0.13% loop_unroll : 0.000563s : 2.01% jit_opt_after_cconv.c_1 : 0.000024s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000043s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.03% add_recomputation : 0.000077s : 0.27% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000635s : 2.27% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.18% Time group info: ------[substitution.] 0.000294 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000007s : 3: substitution.graph_param_transform 85.14% : 0.000250s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 2.52% : 0.000007s : 2: substitution.replace_old_param 5.03% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021923 2 90.82% : 0.019912s : 1: type_inference.infer 9.18% : 0.002012s : 1: type_inference.specialize ------[replace.] 0.000096 6 64.61% : 0.000062s : 4: replace.inline 35.39% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 6 94.79% : 0.000247s : 4: match.inline 5.21% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.90% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000002s : 10: predicate.addn_zero_filter 1.46% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000002s : 10: predicate.depend_value_elim 1.31% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.35% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.96% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.01% : 0.000001s : 10: predicate.environ_get_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.25% : 0.000002s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000008s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 15: predicate.load_eliminater 2.76% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.89% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 3.03% : 0.000004s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000002s : 10: predicate.print_const_string_wrapper 1.76% : 0.000003s : 10: predicate.reduce_eliminate 1.62% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.17% : 0.000002s : 6: predicate.remove_not_recompute_node 1.96% : 0.000003s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000001s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.06% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 0.99% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.19% : 0.000002s : 6: predicate.specialize_transform 1.15% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.01% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.03% : 0.000004s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.33% : 0.000011s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000002s : 10: predicate.transpose_eliminate 1.64% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.22% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.44% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001093 13 43.16% : 0.000472s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.52% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.33% : 0.000561s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035536 72 0.23% : 0.000081s : 1: add_recomputation 0.23% : 0.000080s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.87% : 0.000311s : 1: bootstrap 0.11% : 0.000038s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.09% : 0.000030s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 20.80% : 0.007392s : 1: jit_opt_a 0.57% : 0.000201s : 1: jit_opt_after_cconv 0.18% : 0.000063s : 1: jit_opt_b 1.62% : 0.000576s : 1: loop_unroll 2.35% : 0.000835s : 1: mutable_eliminate 2.99% : 0.001062s : 26: opt.transform.jit_opt_a 0.17% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000031s : 4: opt.transform.jit_opt_b 0.06% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000024s : 1: opt.transform.mutable_eliminate 0.09% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.82% : 0.000648s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000146s : 1: py_interpret_to_execute 0.07% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.42% : 0.000859s : 1: renormalize.infer 1.58% : 0.000560s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000054s : 1: rewriter_after_opt_a 0.27% : 0.000095s : 1: rewriter_before_opt_a 0.25% : 0.000089s : 1: symbol_engine_optimizer 62.04% : 0.022046s : 1: type_inference TotalTime = 0.139512, [30] [bootstrap]: 0.00025158 [type_inference]: 0.128542 [event_method]: 1.919e-05 [auto_monad]: 7.229e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.00039651 [rewriter_before_opt_a]: 7.999e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00780526, [2] [Cycle 1]: 0.00392277, [27] [switch_simplify]: 5.873e-05 [loop_unroll]: 3.202e-05 [a_1]: 0.00061308 [with_stream_mark]: 1.939e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 7.1e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.43003e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 6.10002e-06 [renormalize]: 0.00284287 [add_forward_monad_depend]: 7.89002e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 1.687e-05 [cse]: 2.147e-05 [replace_applicator]: 1.784e-05 [Cycle 2]: 0.00036519, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00012065 [with_stream_mark]: 1.232e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.55003e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 2.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.632e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.063e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.185e-05 [rewriter_after_opt_a]: 3.41e-05 [convert_after_rewriter]: 2.78e-05 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00071832 [jit_opt_b]: 5.668e-05, [1] [Cycle 1]: 4.927e-05, [2] [frontend_op_eliminate]: 1.903e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 2.731e-05 [loop_unroll]: 0.00043585 [jit_opt_after_cconv]: 0.00014566, [1] [Cycle 1]: 0.00013971, [11] [c_1]: 2.464e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 1.947e-05 [call_graph_tuple_transform]: 2.049e-05 [tuple_list_get_item_eliminator]: 6.12999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.508e-05 [partial_unused_args_eliminate]: 1.98002e-06 [environ_conv]: 8.45001e-06 [add_recomputation]: 4.625e-05 [cse_after_recomputation]: 2.153e-05, [1] [Cycle 1]: 1.662e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.51e-05 [get_jit_bprop_graph]: 3.00998e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00045562 [symbol_engine_optimizer]: 7.272e-05, [1] [Cycle 1]: 6.634e-05, [6] [build]: 3.34001e-06 [elim_shapecalc]: 8.42998e-06 [elim_not_effective]: 1.349e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 4.09986e-07 [validate]: 6.006e-05 Sums bootstrap : 0.000252s : 0.19% type_inference : 0.128542s : 94.92% event_method : 0.000019s : 0.01% auto_monad : 0.000072s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000397s : 0.29% rewriter_before_opt_a : 0.000080s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000734s : 0.54% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002843s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000032s : 0.02% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000028s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000718s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000436s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000456s : 0.34% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.04% Time group info: ------[substitution.] 0.000248 24 1.16% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000006s : 4: substitution.graph_param_transform 85.21% : 0.000211s : 4: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.22% : 0.000006s : 2: substitution.replace_old_param 4.90% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128471 2 97.89% : 0.125760s : 1: type_inference.infer 2.11% : 0.002711s : 1: type_inference.specialize ------[replace.] 0.000079 6 65.92% : 0.000052s : 4: replace.inline 34.08% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.97% : 0.000209s : 4: match.inline 5.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.78% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.59% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.71% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.72% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.07% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.40% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002191 22 67.81% : 0.001486s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.36% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.83% : 0.000654s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143375 72 0.03% : 0.000049s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.18% : 0.000263s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.02% : 0.000031s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.45% : 0.007809s : 1: jit_opt_a 0.10% : 0.000148s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.31% : 0.000443s : 1: loop_unroll 0.51% : 0.000727s : 1: mutable_eliminate 0.68% : 0.000974s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000402s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.47% : 0.002103s : 1: renormalize.infer 0.51% : 0.000729s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.06% : 0.000085s : 1: rewriter_before_opt_a 0.05% : 0.000075s : 1: symbol_engine_optimizer 89.66% : 0.128555s : 1: type_inference TotalTime = 0.0363413, [30] [bootstrap]: 0.00028602 [type_inference]: 0.0207311 [event_method]: 0.00574553 [auto_monad]: 0.00022402 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.037e-05 [py_interpret_to_execute]: 0.0005133 [rewriter_before_opt_a]: 0.00015057 [expand_dump_flag]: 3.81001e-06 [jit_opt_a]: 0.00643883, [2] [Cycle 1]: 0.00217391, [27] [switch_simplify]: 5.779e-05 [loop_unroll]: 3.057e-05 [a_1]: 0.00058189 [with_stream_mark]: 2.074e-05 [recompute_prepare]: 7.66001e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00114381 [add_forward_monad_depend]: 6.26e-06 [auto_monad_grad]: 2.16998e-06 [auto_monad_eliminator]: 1.589e-05 [cse]: 3.408e-05 [replace_applicator]: 1.211e-05 [Cycle 2]: 0.00032835, [27] [switch_simplify]: 6.30002e-06 [loop_unroll]: 5.25001e-06 [a_1]: 9.327e-05 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.48002e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.11002e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.333e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.61999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.25002e-06 [cse]: 1.367e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.217e-05 [rewriter_after_opt_a]: 3.735e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00053643 [jit_opt_b]: 5.074e-05, [1] [Cycle 1]: 4.392e-05, [2] [frontend_op_eliminate]: 1.587e-05 [inline_after_opt_a]: 1.633e-05 [cconv]: 2.412e-05 [loop_unroll]: 0.00042005 [jit_opt_after_cconv]: 0.00014302, [1] [Cycle 1]: 0.00013672, [11] [c_1]: 2.216e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 2.15e-05 [call_graph_tuple_transform]: 1.813e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.33002e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 4.893e-05 [cse_after_recomputation]: 3.917e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.337e-05 [auto_monad_reorder]: 1.74e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 4.51002e-06 [opt_after_jit_grad]: 0.00046581 [symbol_engine_optimizer]: 7.549e-05, [1] [Cycle 1]: 6.933e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 8.60001e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 4.50003e-07 [validate]: 4.162e-05 Sums bootstrap : 0.000286s : 0.90% type_inference : 0.020731s : 65.36% event_method : 0.005746s : 18.11% auto_monad : 0.000224s : 0.71% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000020s : 0.06% py_interpret_to_execute : 0.000513s : 1.62% rewriter_before_opt_a : 0.000151s : 0.47% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.20% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000675s : 2.13% jit_opt_a.with_stream_mark : 0.000031s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001144s : 3.61% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.07% jit_opt_a.cse : 0.000048s : 0.15% jit_opt_a.replace_applicator : 0.000018s : 0.06% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000037s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000536s : 1.69% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000024s : 0.08% loop_unroll : 0.000420s : 1.32% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.15% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000466s : 1.47% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.13% Time group info: ------[substitution.] 0.000236 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.05% : 0.000005s : 3: substitution.graph_param_transform 85.94% : 0.000203s : 4: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000004s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020649 2 91.57% : 0.018908s : 1: type_inference.infer 8.43% : 0.001741s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.01% : 0.000053s : 4: replace.inline 30.99% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.23% : 0.000200s : 4: match.inline 5.77% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.00% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000934 13 42.28% : 0.000395s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.42% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.30% : 0.000489s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038385 72 0.13% : 0.000052s : 1: add_recomputation 0.60% : 0.000231s : 1: auto_monad 0.05% : 0.000020s : 1: auto_monad_reorder 0.80% : 0.000306s : 1: bootstrap 0.07% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000041s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 15.05% : 0.005777s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000014s : 1: graph_reusing 16.78% : 0.006442s : 1: jit_opt_a 0.38% : 0.000146s : 1: jit_opt_after_cconv 0.14% : 0.000053s : 1: jit_opt_b 1.12% : 0.000428s : 1: loop_unroll 1.42% : 0.000545s : 1: mutable_eliminate 2.33% : 0.000893s : 26: opt.transform.jit_opt_a 0.13% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.24% : 0.000475s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.06% : 0.000023s : 1: pre_auto_parallel 1.35% : 0.000519s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.77% : 0.000680s : 1: renormalize.infer 1.18% : 0.000454s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000040s : 1: rewriter_after_opt_a 0.41% : 0.000156s : 1: rewriter_before_opt_a 0.20% : 0.000078s : 1: symbol_engine_optimizer 54.06% : 0.020749s : 1: type_inference TotalTime = 0.119382, [30] [bootstrap]: 0.0002913 [type_inference]: 0.107743 [event_method]: 2.107e-05 [auto_monad]: 5.732e-05 [graph_reusing]: 6.70998e-06 [pre_auto_parallel]: 3.06999e-06 [py_interpret_to_execute]: 0.00046699 [rewriter_before_opt_a]: 0.00010102 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.00826785, [2] [Cycle 1]: 0.00422908, [27] [switch_simplify]: 6.401e-05 [loop_unroll]: 3.455e-05 [a_1]: 0.000715 [with_stream_mark]: 2.346e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.93999e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 8.1e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 7.28999e-06 [meta_shard_fg_expand]: 3.06999e-06 [get_grad_eliminate_]: 6.67002e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.673e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.96999e-06 [replace_old_param]: 1.157e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00300924 [add_forward_monad_depend]: 7.03e-06 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 1.739e-05 [cse]: 3.778e-05 [replace_applicator]: 1.863e-05 [Cycle 2]: 0.00038211, [27] [switch_simplify]: 6.63e-06 [loop_unroll]: 6.33002e-06 [a_1]: 0.00012529 [with_stream_mark]: 1.265e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.94997e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.66002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 8.40001e-06 [inline_without_move]: 5.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.461e-05 [replace_applicator]: 6.94999e-06 [py_interpret_to_execute_after_opt_a]: 1.453e-05 [rewriter_after_opt_a]: 4.34e-05 [convert_after_rewriter]: 7.12002e-06 [order_py_execute_after_rewriter]: 6.07001e-06 [mutable_eliminate]: 0.00060608 [jit_opt_b]: 5.544e-05, [1] [Cycle 1]: 4.866e-05, [2] [frontend_op_eliminate]: 1.919e-05 [inline_after_opt_a]: 1.805e-05 [cconv]: 2.77e-05 [loop_unroll]: 0.00045049 [jit_opt_after_cconv]: 0.00022455, [1] [Cycle 1]: 0.000218, [11] [c_1]: 2.918e-05 [parameter_eliminate]: 2.75002e-06 [updatestate_depend_eliminate]: 6.54999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 8.173e-05 [call_graph_tuple_transform]: 2.196e-05 [tuple_list_get_item_eliminator]: 6.98e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 3.99974e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.863e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 8.55001e-06 [add_recomputation]: 5.141e-05 [cse_after_recomputation]: 2.577e-05, [1] [Cycle 1]: 1.975e-05, [1] [cse]: 1.395e-05 [auto_monad_reorder]: 1.92e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.24e-06 [opt_after_jit_grad]: 0.00047664 [symbol_engine_optimizer]: 8.276e-05, [1] [Cycle 1]: 7.604e-05, [6] [build]: 3.21001e-06 [elim_shapecalc]: 9.67999e-06 [elim_not_effective]: 1.627e-05 [opt_reshape]: 8.97e-06 [fold_const_symbol]: 9.97999e-06 [renormalize]: 4.80009e-07 [validate]: 0.00010893 Sums bootstrap : 0.000291s : 0.25% type_inference : 0.107743s : 93.60% event_method : 0.000021s : 0.02% auto_monad : 0.000057s : 0.05% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000467s : 0.41% rewriter_before_opt_a : 0.000101s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000840s : 0.73% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003009s : 2.61% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000052s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000606s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000450s : 0.39% jit_opt_after_cconv.c_1 : 0.000029s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000082s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000477s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000109s : 0.09% Time group info: ------[substitution.] 0.000282 25 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 4: substitution.graph_param_transform 86.81% : 0.000244s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 4.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107676 2 97.20% : 0.104661s : 1: type_inference.infer 2.80% : 0.003016s : 1: type_inference.specialize ------[replace.] 0.000102 7 69.43% : 0.000071s : 5: replace.inline 30.57% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 7 95.22% : 0.000242s : 5: match.inline 4.78% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.46% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.84% : 0.000008s : 28: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.61% : 0.000002s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 20: predicate.switch_defer_inline 2.28% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 64: predicate.switch_simplify 1.47% : 0.000002s : 13: predicate.tile_eliminate 1.13% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002334 25 64.39% : 0.001502s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.50% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.12% : 0.000749s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123501 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000310s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.70% : 0.008271s : 1: jit_opt_a 0.18% : 0.000227s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000459s : 1: loop_unroll 0.50% : 0.000614s : 1: mutable_eliminate 0.89% : 0.001099s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.79% : 0.002212s : 1: renormalize.infer 0.64% : 0.000787s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000106s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 87.25% : 0.107758s : 1: type_inference TotalTime = 0.0362749, [30] [bootstrap]: 0.0003204 [type_inference]: 0.0259232 [event_method]: 2.399e-05 [auto_monad]: 7.741e-05 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00017003 [rewriter_before_opt_a]: 9.233e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0067797, [2] [Cycle 1]: 0.00240923, [27] [switch_simplify]: 6.656e-05 [loop_unroll]: 3.131e-05 [a_1]: 0.00063608 [with_stream_mark]: 2.629e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 5.73002e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 5.99999e-06 [renormalize]: 0.00124625 [add_forward_monad_depend]: 8.75001e-06 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 2.124e-05 [cse]: 3.996e-05 [replace_applicator]: 2.054e-05 [Cycle 2]: 0.00042989, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.58002e-06 [a_1]: 9.731e-05 [with_stream_mark]: 1.551e-05 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.53003e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 4.98001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 6.409e-05 [j_node_and_user_rematch]: 1.056e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.038e-05 [inline_without_move]: 5.26002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.24001e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 1.067e-05 [cse]: 1.756e-05 [replace_applicator]: 6.47001e-06 [py_interpret_to_execute_after_opt_a]: 2.185e-05 [rewriter_after_opt_a]: 4.684e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 5.33002e-06 [mutable_eliminate]: 0.00079623 [jit_opt_b]: 5.522e-05, [1] [Cycle 1]: 4.736e-05, [2] [frontend_op_eliminate]: 1.743e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 3.491e-05 [loop_unroll]: 0.00050198 [jit_opt_after_cconv]: 0.00018594, [1] [Cycle 1]: 0.00017852, [11] [c_1]: 2.298e-05 [parameter_eliminate]: 5.59998e-06 [updatestate_depend_eliminate]: 1.055e-05 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.38998e-06 [cse]: 4.16e-05 [call_graph_tuple_transform]: 2.442e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 9.29984e-07 [switch_simplify]: 6.30002e-06 [remove_dup_value]: 1.905e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 9.061e-05 [cse_after_recomputation]: 2.84e-05, [1] [Cycle 1]: 2.152e-05, [1] [cse]: 1.434e-05 [auto_monad_reorder]: 4.389e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 9.47001e-06 [opt_after_jit_grad]: 0.00063524 [symbol_engine_optimizer]: 9.382e-05, [1] [Cycle 1]: 8.477e-05, [6] [build]: 6.37001e-06 [elim_shapecalc]: 9.86e-06 [elim_not_effective]: 1.813e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 1.018e-05 [renormalize]: 9.70002e-07 [validate]: 5.517e-05 Sums bootstrap : 0.000320s : 1.01% type_inference : 0.025923s : 81.97% event_method : 0.000024s : 0.08% auto_monad : 0.000077s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000170s : 0.54% rewriter_before_opt_a : 0.000092s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.23% jit_opt_a.loop_unroll : 0.000037s : 0.12% jit_opt_a.a_1 : 0.000733s : 2.32% jit_opt_a.with_stream_mark : 0.000042s : 0.13% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000079s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001246s : 3.94% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.10% jit_opt_a.cse : 0.000058s : 0.18% jit_opt_a.replace_applicator : 0.000027s : 0.09% py_interpret_to_execute_after_opt_a : 0.000022s : 0.07% rewriter_after_opt_a : 0.000047s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000796s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000035s : 0.11% loop_unroll : 0.000502s : 1.59% jit_opt_after_cconv.c_1 : 0.000023s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000091s : 0.29% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000044s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.000635s : 2.01% symbol_engine_optimizer.build : 0.000006s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.17% Time group info: ------[substitution.] 0.000271 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000007s : 3: substitution.graph_param_transform 84.45% : 0.000229s : 4: substitution.inline 1.70% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 2.68% : 0.000007s : 2: substitution.replace_old_param 5.16% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025826 2 92.00% : 0.023760s : 1: type_inference.infer 8.00% : 0.002066s : 1: type_inference.specialize ------[replace.] 0.000085 6 69.86% : 0.000060s : 4: replace.inline 30.14% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 94.62% : 0.000225s : 4: match.inline 5.38% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.08% : 0.000001s : 10: predicate.accumulaten_eliminater 1.57% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 2.16% : 0.000003s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 1.23% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 2.02% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.72% : 0.000001s : 3: predicate.elim_not_effective 0.80% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 2.05% : 0.000003s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.09% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.05% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001007 13 42.41% : 0.000427s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.80% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.78% : 0.000521s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038615 72 0.25% : 0.000096s : 1: add_recomputation 0.21% : 0.000081s : 1: auto_monad 0.12% : 0.000048s : 1: auto_monad_reorder 0.88% : 0.000341s : 1: bootstrap 0.10% : 0.000038s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000031s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000030s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.57% : 0.006783s : 1: jit_opt_a 0.49% : 0.000189s : 1: jit_opt_after_cconv 0.15% : 0.000058s : 1: jit_opt_b 1.32% : 0.000511s : 1: loop_unroll 2.09% : 0.000809s : 1: mutable_eliminate 2.67% : 0.001029s : 26: opt.transform.jit_opt_a 0.14% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.09% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.69% : 0.000653s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.000176s : 1: py_interpret_to_execute 0.06% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000022s : 1: remove_dup_value 1.86% : 0.000720s : 1: renormalize.infer 1.34% : 0.000517s : 1: renormalize.specialize 0.03% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000050s : 1: rewriter_after_opt_a 0.25% : 0.000096s : 1: rewriter_before_opt_a 0.25% : 0.000097s : 1: symbol_engine_optimizer 67.20% : 0.025951s : 1: type_inference TotalTime = 0.133475, [30] [bootstrap]: 0.00027552 [type_inference]: 0.0858425 [event_method]: 1.931e-05 [auto_monad]: 0.0373199 [graph_reusing]: 6.76999e-06 [pre_auto_parallel]: 4.12998e-06 [py_interpret_to_execute]: 0.00048781 [rewriter_before_opt_a]: 9.678e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00718382, [2] [Cycle 1]: 0.00329446, [27] [switch_simplify]: 5.819e-05 [loop_unroll]: 2.938e-05 [a_1]: 0.00059697 [with_stream_mark]: 2.118e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.83003e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.10998e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.447e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 6.48e-06 [renormalize]: 0.00224409 [add_forward_monad_depend]: 7.46001e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.657e-05 [cse]: 2.909e-05 [replace_applicator]: 1.41e-05 [Cycle 2]: 0.00035411, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 5.55001e-06 [a_1]: 0.00011704 [with_stream_mark]: 1.016e-05 [recompute_prepare]: 5.51002e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 1.92999e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 1.47001e-06 [replace_old_param]: 8.29002e-06 [inline_without_move]: 5.12e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.063e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 1.22e-05 [rewriter_after_opt_a]: 3.482e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00062168 [jit_opt_b]: 5.309e-05, [1] [Cycle 1]: 4.571e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 1.651e-05 [cconv]: 2.595e-05 [loop_unroll]: 0.00041821 [jit_opt_after_cconv]: 0.00014572, [1] [Cycle 1]: 0.00013902, [11] [c_1]: 2.415e-05 [parameter_eliminate]: 3.33998e-06 [updatestate_depend_eliminate]: 6.93e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 1.853e-05 [call_graph_tuple_transform]: 1.968e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 7.93999e-06 [add_recomputation]: 4.984e-05 [cse_after_recomputation]: 2.134e-05, [1] [Cycle 1]: 1.615e-05, [1] [cse]: 1.07e-05 [auto_monad_reorder]: 1.545e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 4.20999e-06 [opt_after_jit_grad]: 0.00045603 [symbol_engine_optimizer]: 8.544e-05, [1] [Cycle 1]: 7.935e-05, [6] [build]: 3.90998e-06 [elim_shapecalc]: 8.39998e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 1.69e-05 [fold_const_symbol]: 9.99001e-06 [renormalize]: 3.39991e-07 [validate]: 4.521e-05 Sums bootstrap : 0.000276s : 0.21% type_inference : 0.085843s : 66.38% event_method : 0.000019s : 0.01% auto_monad : 0.037320s : 28.86% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000488s : 0.38% rewriter_before_opt_a : 0.000097s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000714s : 0.55% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002244s : 1.74% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000622s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000418s : 0.32% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000456s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000017s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000244 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 4: substitution.graph_param_transform 85.58% : 0.000209s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.05% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.085673 2 97.76% : 0.083752s : 1: type_inference.infer 2.24% : 0.001921s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.57% : 0.000050s : 4: replace.inline 31.43% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.85% : 0.000206s : 4: match.inline 5.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.18% : 0.000001s : 12: predicate.addn_zero_filter 1.97% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000001s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.35% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.93% : 0.000002s : 4: predicate.mutable_eliminate 0.93% : 0.000001s : 4: predicate.opt_reshape 2.52% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000001s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.64% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005896 22 90.19% : 0.005317s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.90% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 8.91% : 0.000525s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136722 72 0.04% : 0.000053s : 1: add_recomputation 27.31% : 0.037337s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000294s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 5.26% : 0.007188s : 1: jit_opt_a 0.11% : 0.000148s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.31% : 0.000426s : 1: loop_unroll 0.46% : 0.000630s : 1: mutable_eliminate 0.69% : 0.000943s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.36% : 0.000494s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.20% : 0.001642s : 1: renormalize.infer 0.43% : 0.000592s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000088s : 1: symbol_engine_optimizer 62.80% : 0.085863s : 1: type_inference TotalTime = 0.0857873, [30] [bootstrap]: 0.00032101 [type_inference]: 0.031497 [event_method]: 1.931e-05 [auto_monad]: 6.887e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 3.25e-06 [py_interpret_to_execute]: 0.00010158 [rewriter_before_opt_a]: 8.051e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00543855, [2] [Cycle 1]: 0.00192694, [27] [switch_simplify]: 5.681e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00054865 [with_stream_mark]: 2.222e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 9.31998e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00094342 [add_forward_monad_depend]: 5.96e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.447e-05 [cse]: 3.212e-05 [replace_applicator]: 1.198e-05 [Cycle 2]: 0.00031279, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.02e-06 [a_1]: 8.848e-05 [with_stream_mark]: 8.91002e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 4.99998e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.223e-05 [j_node_and_user_rematch]: 7.65e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 8.99978e-07 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.47999e-06 [cse]: 1.234e-05 [replace_applicator]: 5.26002e-06 [py_interpret_to_execute_after_opt_a]: 1.124e-05 [rewriter_after_opt_a]: 4.194e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00056151 [jit_opt_b]: 4.777e-05, [1] [Cycle 1]: 4.11e-05, [2] [frontend_op_eliminate]: 1.511e-05 [inline_after_opt_a]: 1.539e-05 [cconv]: 2.661e-05 [loop_unroll]: 0.000413 [jit_opt_after_cconv]: 0.00013674, [1] [Cycle 1]: 0.00013025, [11] [c_1]: 2.008e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.052e-05 [call_graph_tuple_transform]: 1.76e-05 [tuple_list_get_item_eliminator]: 5.14e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.50001e-06 [remove_dup_value]: 1.672e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 5.429e-05 [cse_after_recomputation]: 2.245e-05, [1] [Cycle 1]: 1.725e-05, [1] [cse]: 1.15e-05 [auto_monad_reorder]: 1.703e-05 [get_jit_bprop_graph]: 1.32999e-06 [rewriter_after_jit_bprop_graph]: 4.58001e-06 [opt_after_jit_grad]: 0.0465045 [symbol_engine_optimizer]: 9.657e-05, [1] [Cycle 1]: 8.551e-05, [6] [build]: 6.83998e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 2.387e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 9.92999e-06 [renormalize]: 1.10999e-06 [validate]: 5.343e-05 Sums bootstrap : 0.000321s : 0.39% type_inference : 0.031497s : 38.42% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000102s : 0.12% rewriter_before_opt_a : 0.000081s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.08% jit_opt_a.loop_unroll : 0.000035s : 0.04% jit_opt_a.a_1 : 0.000637s : 0.78% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000012s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000010s : 0.01% jit_opt_a.renormalize : 0.000943s : 1.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000044s : 0.05% jit_opt_a.replace_applicator : 0.000017s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000042s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000562s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000015s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000413s : 0.50% jit_opt_after_cconv.c_1 : 0.000020s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.046504s : 56.73% symbol_engine_optimizer.build : 0.000007s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.07% Time group info: ------[substitution.] 0.000219 23 1.47% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 84.41% : 0.000185s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000004s : 4: substitution.remove_not_recompute_node 1.99% : 0.000004s : 2: substitution.replace_old_param 5.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.031426 2 95.58% : 0.030037s : 1: type_inference.infer 4.42% : 0.001389s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.43% : 0.000050s : 4: replace.inline 31.57% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.08% : 0.000182s : 4: match.inline 5.92% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 2.21% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 2.33% : 0.000003s : 3: predicate.dumpgradient_eliminate 0.68% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000779 13 43.12% : 0.000336s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.77% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.10% : 0.000398s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.087652 72 0.07% : 0.000057s : 1: add_recomputation 0.08% : 0.000072s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.39% : 0.000340s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.04% : 0.000034s : 1: graph_reusing 6.21% : 0.005442s : 1: jit_opt_a 0.16% : 0.000139s : 1: jit_opt_after_cconv 0.06% : 0.000050s : 1: jit_opt_b 0.48% : 0.000421s : 1: loop_unroll 0.65% : 0.000570s : 1: mutable_eliminate 0.97% : 0.000850s : 26: opt.transform.jit_opt_a 0.05% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000025s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000050s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000045s : 4: opt.transform.symbol_engine_opt 53.08% : 0.046528s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.12% : 0.000105s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.63% : 0.000551s : 1: renormalize.infer 0.44% : 0.000384s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000045s : 1: rewriter_after_opt_a 0.10% : 0.000084s : 1: rewriter_before_opt_a 0.11% : 0.000100s : 1: symbol_engine_optimizer 35.95% : 0.031509s : 1: type_inference TotalTime = 0.067717, [30] [bootstrap]: 0.00030158 [type_inference]: 0.0580304 [event_method]: 2.647e-05 [auto_monad]: 8.535e-05 [graph_reusing]: 6.05002e-06 [pre_auto_parallel]: 2.38002e-06 [py_interpret_to_execute]: 0.00026251 [rewriter_before_opt_a]: 9.931e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00664154, [2] [Cycle 1]: 0.00244892, [27] [switch_simplify]: 5.428e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00056365 [with_stream_mark]: 2.089e-05 [recompute_prepare]: 6.96001e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.13998e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.44e-06 [renormalize]: 0.00144493 [add_forward_monad_depend]: 7.15e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.753e-05 [replace_applicator]: 1.244e-05 [Cycle 2]: 0.00032356, [27] [switch_simplify]: 5.96998e-06 [loop_unroll]: 5.29003e-06 [a_1]: 9.012e-05 [with_stream_mark]: 9.15001e-06 [recompute_prepare]: 5.70001e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 2.52001e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.349e-05 [j_node_and_user_rematch]: 7.43999e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.33e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 2.142e-05 [rewriter_after_opt_a]: 4.09e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00056732 [jit_opt_b]: 5.486e-05, [1] [Cycle 1]: 4.695e-05, [2] [frontend_op_eliminate]: 1.784e-05 [inline_after_opt_a]: 1.724e-05 [cconv]: 2.852e-05 [loop_unroll]: 0.00044122 [jit_opt_after_cconv]: 0.00015542, [1] [Cycle 1]: 0.00014843, [11] [c_1]: 2.146e-05 [parameter_eliminate]: 3.6e-06 [updatestate_depend_eliminate]: 7.63001e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.679e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.804e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 7.7e-06 [add_recomputation]: 5.314e-05 [cse_after_recomputation]: 2.311e-05, [1] [Cycle 1]: 1.735e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.815e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00046214 [symbol_engine_optimizer]: 0.00011085, [1] [Cycle 1]: 0.00010456, [6] [build]: 3.65998e-06 [elim_shapecalc]: 9.26998e-06 [elim_not_effective]: 1.465e-05 [opt_reshape]: 7.24001e-06 [fold_const_symbol]: 1.15e-05 [renormalize]: 6.30011e-07 [validate]: 4.562e-05 Sums bootstrap : 0.000302s : 0.48% type_inference : 0.058030s : 91.78% event_method : 0.000026s : 0.04% auto_monad : 0.000085s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000263s : 0.42% rewriter_before_opt_a : 0.000099s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000654s : 1.03% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001445s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000051s : 0.08% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000021s : 0.03% rewriter_after_opt_a : 0.000041s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000567s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000441s : 0.70% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000462s : 0.73% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.07% Time group info: ------[substitution.] 0.000237 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000002s : 2: substitution.fold_const_symbol 2.71% : 0.000006s : 3: substitution.graph_param_transform 85.48% : 0.000203s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 5.16% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057917 2 40.36% : 0.023377s : 1: type_inference.infer 59.64% : 0.034540s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.40% : 0.000048s : 4: replace.inline 31.60% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.70% : 0.000200s : 4: match.inline 5.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.41% : 0.000003s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001101 13 38.29% : 0.000422s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.94% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.78% : 0.000625s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070087 72 0.08% : 0.000056s : 1: add_recomputation 0.13% : 0.000089s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.45% : 0.000315s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.48% : 0.006644s : 1: jit_opt_a 0.23% : 0.000158s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.64% : 0.000450s : 1: loop_unroll 0.82% : 0.000578s : 1: mutable_eliminate 1.23% : 0.000866s : 26: opt.transform.jit_opt_a 0.07% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000470s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000267s : 1: py_interpret_to_execute 0.03% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.23% : 0.000862s : 1: renormalize.infer 0.82% : 0.000573s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.15% : 0.000103s : 1: rewriter_before_opt_a 0.16% : 0.000113s : 1: symbol_engine_optimizer 82.84% : 0.058057s : 1: type_inference TotalTime = 0.0383368, [30] [bootstrap]: 0.00050888 [type_inference]: 0.025616 [event_method]: 2.319e-05 [auto_monad]: 7.774e-05 [graph_reusing]: 6.28002e-06 [pre_auto_parallel]: 3.30998e-06 [py_interpret_to_execute]: 0.00014088 [rewriter_before_opt_a]: 9.282e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00726055, [2] [Cycle 1]: 0.00263, [27] [switch_simplify]: 7.181e-05 [loop_unroll]: 3.232e-05 [a_1]: 0.00066135 [with_stream_mark]: 2.69e-05 [recompute_prepare]: 1.205e-05 [updatestate_depend_eliminate]: 5.46998e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.37002e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 7.34002e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.83998e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 4.74998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.887e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1.098e-05 [inline_without_move]: 5.56e-06 [renormalize]: 0.00139122 [add_forward_monad_depend]: 1.127e-05 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 2.286e-05 [cse]: 4.394e-05 [replace_applicator]: 2.33e-05 [Cycle 2]: 0.00038597, [27] [switch_simplify]: 7.08998e-06 [loop_unroll]: 5.49998e-06 [a_1]: 0.00010034 [with_stream_mark]: 1.743e-05 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 4.76002e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.913e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.89001e-06 [inline_without_move]: 5.29e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.99999e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 1.015e-05 [cse]: 1.7e-05 [replace_applicator]: 6.81001e-06 [py_interpret_to_execute_after_opt_a]: 2.171e-05 [rewriter_after_opt_a]: 5.2e-05 [convert_after_rewriter]: 7.82002e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00086929 [jit_opt_b]: 8.706e-05, [1] [Cycle 1]: 7.809e-05, [2] [frontend_op_eliminate]: 1.855e-05 [inline_after_opt_a]: 2.132e-05 [cconv]: 3.667e-05 [loop_unroll]: 0.0005884 [jit_opt_after_cconv]: 0.00020267, [1] [Cycle 1]: 0.00019461, [11] [c_1]: 2.384e-05 [parameter_eliminate]: 6.48e-06 [updatestate_depend_eliminate]: 1.033e-05 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.50998e-06 [cse]: 4.51e-05 [call_graph_tuple_transform]: 2.825e-05 [tuple_list_get_item_eliminator]: 8.13001e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 8.89995e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 2.116e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 8.86997e-06 [add_recomputation]: 6.207e-05 [cse_after_recomputation]: 3.05e-05, [1] [Cycle 1]: 2.342e-05, [1] [cse]: 1.488e-05 [auto_monad_reorder]: 1.978e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 9.01002e-06 [opt_after_jit_grad]: 0.00211305 [symbol_engine_optimizer]: 0.00014121, [1] [Cycle 1]: 0.00013013, [6] [build]: 7.21999e-06 [elim_shapecalc]: 9.61e-06 [elim_not_effective]: 2.046e-05 [opt_reshape]: 4.63e-05 [fold_const_symbol]: 1.222e-05 [renormalize]: 8.89995e-07 [validate]: 5.809e-05 Sums bootstrap : 0.000509s : 1.53% type_inference : 0.025616s : 76.93% event_method : 0.000023s : 0.07% auto_monad : 0.000078s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000141s : 0.42% rewriter_before_opt_a : 0.000093s : 0.28% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.24% jit_opt_a.loop_unroll : 0.000038s : 0.11% jit_opt_a.a_1 : 0.000762s : 2.29% jit_opt_a.with_stream_mark : 0.000044s : 0.13% jit_opt_a.recompute_prepare : 0.000018s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001391s : 4.18% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.10% jit_opt_a.cse : 0.000061s : 0.18% jit_opt_a.replace_applicator : 0.000030s : 0.09% py_interpret_to_execute_after_opt_a : 0.000022s : 0.07% rewriter_after_opt_a : 0.000052s : 0.16% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000869s : 2.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.06% cconv : 0.000037s : 0.11% loop_unroll : 0.000588s : 1.77% jit_opt_after_cconv.c_1 : 0.000024s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000045s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000021s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.03% add_recomputation : 0.000062s : 0.19% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000020s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.002113s : 6.35% symbol_engine_optimizer.build : 0.000007s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000046s : 0.14% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.17% Time group info: ------[substitution.] 0.000289 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000007s : 3: substitution.graph_param_transform 85.50% : 0.000247s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.64% : 0.000008s : 2: substitution.replace_old_param 4.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025517 2 91.70% : 0.023399s : 1: type_inference.infer 8.30% : 0.002118s : 1: type_inference.specialize ------[replace.] 0.000092 6 66.65% : 0.000061s : 4: replace.inline 33.35% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 6 95.27% : 0.000244s : 4: match.inline 4.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.94% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.16% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.53% : 0.000002s : 10: predicate.depend_value_elim 1.31% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.03% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.02% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.74% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.04% : 0.000001s : 10: predicate.environ_get_eliminate 0.90% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.68% : 0.000001s : 3: predicate.graph_param_transform 6.03% : 0.000008s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.13% : 0.000003s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 0.92% : 0.000001s : 10: predicate.minmaximum_grad 2.98% : 0.000004s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000003s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.68% : 0.000001s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.10% : 0.000002s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.16% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.02% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.05% : 0.000003s : 16: predicate.switch_defer_inline 1.81% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.15% : 0.000010s : 53: predicate.switch_simplify 1.01% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.91% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.41% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.48% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001143 13 43.41% : 0.000496s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.17% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.42% : 0.000587s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040879 72 0.16% : 0.000066s : 1: add_recomputation 0.20% : 0.000083s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 1.32% : 0.000538s : 1: bootstrap 0.10% : 0.000039s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000033s : 1: cse_after_recomputation 0.03% : 0.000013s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.77% : 0.007264s : 1: jit_opt_a 0.51% : 0.000207s : 1: jit_opt_after_cconv 0.22% : 0.000090s : 1: jit_opt_b 1.47% : 0.000603s : 1: loop_unroll 2.17% : 0.000888s : 1: mutable_eliminate 2.51% : 0.001025s : 26: opt.transform.jit_opt_a 0.15% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000031s : 4: opt.transform.jit_opt_b 0.05% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000029s : 1: opt.transform.mutable_eliminate 0.11% : 0.000045s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000084s : 4: opt.transform.symbol_engine_opt 5.23% : 0.002137s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000146s : 1: py_interpret_to_execute 0.06% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000024s : 1: remove_dup_value 1.97% : 0.000807s : 1: renormalize.infer 1.40% : 0.000570s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000057s : 1: rewriter_after_opt_a 0.24% : 0.000096s : 1: rewriter_before_opt_a 0.35% : 0.000145s : 1: symbol_engine_optimizer 62.73% : 0.025642s : 1: type_inference TotalTime = 0.0282073, [30] [bootstrap]: 0.00027352 [type_inference]: 0.00452055 [event_method]: 1.708e-05 [auto_monad]: 0.0132894 [graph_reusing]: 9.54e-06 [pre_auto_parallel]: 4.03999e-06 [py_interpret_to_execute]: 8.257e-05 [rewriter_before_opt_a]: 0.00010634 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00647047, [2] [Cycle 1]: 0.00183047, [27] [switch_simplify]: 5.63e-05 [loop_unroll]: 2.88e-05 [a_1]: 0.00056788 [with_stream_mark]: 2.206e-05 [recompute_prepare]: 7.48e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 4.97e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.489e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 0.00081812 [add_forward_monad_depend]: 6.78e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.415e-05 [cse]: 3.037e-05 [replace_applicator]: 1.154e-05 [Cycle 2]: 0.00033521, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.90001e-06 [a_1]: 9.827e-05 [with_stream_mark]: 9.44e-06 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.66002e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.49999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.243e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.228e-05 [replace_applicator]: 5.06997e-06 [py_interpret_to_execute_after_opt_a]: 1.022e-05 [rewriter_after_opt_a]: 4.096e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00048868 [jit_opt_b]: 4.814e-05, [1] [Cycle 1]: 4.135e-05, [2] [frontend_op_eliminate]: 1.507e-05 [inline_after_opt_a]: 1.427e-05 [cconv]: 2.539e-05 [loop_unroll]: 0.00175087 [jit_opt_after_cconv]: 0.00016076, [1] [Cycle 1]: 0.00015322, [11] [c_1]: 2.316e-05 [parameter_eliminate]: 3.61001e-06 [updatestate_depend_eliminate]: 6.36e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.206e-05 [call_graph_tuple_transform]: 1.801e-05 [tuple_list_get_item_eliminator]: 5.36002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 1.247e-05 [remove_dup_value]: 1.64e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 6.07999e-06 [add_recomputation]: 5.598e-05 [cse_after_recomputation]: 2.244e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.108e-05 [auto_monad_reorder]: 1.529e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 4.98001e-06 [opt_after_jit_grad]: 0.00044495 [symbol_engine_optimizer]: 7.29e-05, [1] [Cycle 1]: 6.667e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.251e-05 [opt_reshape]: 5.30999e-06 [fold_const_symbol]: 8.54998e-06 [renormalize]: 5.39992e-07 [validate]: 4.021e-05 Sums bootstrap : 0.000274s : 1.18% type_inference : 0.004521s : 19.43% event_method : 0.000017s : 0.07% auto_monad : 0.013289s : 57.12% graph_reusing : 0.000010s : 0.04% pre_auto_parallel : 0.000004s : 0.02% py_interpret_to_execute : 0.000083s : 0.35% rewriter_before_opt_a : 0.000106s : 0.46% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.27% jit_opt_a.loop_unroll : 0.000034s : 0.14% jit_opt_a.a_1 : 0.000666s : 2.86% jit_opt_a.with_stream_mark : 0.000032s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000818s : 3.52% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.09% jit_opt_a.cse : 0.000043s : 0.18% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000041s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000489s : 2.10% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000014s : 0.06% cconv : 0.000025s : 0.11% loop_unroll : 0.001751s : 7.53% jit_opt_after_cconv.c_1 : 0.000023s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000012s : 0.05% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000056s : 0.24% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000015s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000445s : 1.91% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.17% Time group info: ------[substitution.] 0.000241 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000005s : 3: substitution.graph_param_transform 86.11% : 0.000208s : 4: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 4.94% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004458 2 82.12% : 0.003661s : 1: type_inference.infer 17.88% : 0.000797s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.23% : 0.000048s : 4: replace.inline 31.77% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 95.01% : 0.000205s : 4: match.inline 4.99% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.22% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.40% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000002s : 15: predicate.load_eliminater 2.34% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.46% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000637 13 50.90% : 0.000324s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.76% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.34% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029951 72 0.20% : 0.000059s : 1: add_recomputation 44.47% : 0.013318s : 1: auto_monad 0.06% : 0.000018s : 1: auto_monad_reorder 0.97% : 0.000291s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.07% : 0.000021s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000015s : 1: graph_reusing 21.62% : 0.006474s : 1: jit_opt_a 0.55% : 0.000164s : 1: jit_opt_after_cconv 0.17% : 0.000051s : 1: jit_opt_b 5.88% : 0.001762s : 1: loop_unroll 1.66% : 0.000497s : 1: mutable_eliminate 2.92% : 0.000874s : 26: opt.transform.jit_opt_a 0.18% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000024s : 4: opt.transform.jit_opt_b 0.06% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000453s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000006s : 1: pre_auto_parallel 0.29% : 0.000086s : 1: py_interpret_to_execute 0.04% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.58% : 0.000474s : 1: renormalize.infer 1.12% : 0.000336s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000044s : 1: rewriter_after_opt_a 0.37% : 0.000110s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 15.13% : 0.004532s : 1: type_inference TotalTime = 0.512847, [30] [bootstrap]: 0.00035658 [type_inference]: 0.460741 [event_method]: 2.411e-05 [auto_monad]: 0.00010448 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 0.00051751 [rewriter_before_opt_a]: 9.881e-05 [expand_dump_flag]: 3.74002e-06 [jit_opt_a]: 0.0484901, [2] [Cycle 1]: 0.0433462, [27] [switch_simplify]: 6.273e-05 [loop_unroll]: 3.56e-05 [a_1]: 0.00070555 [with_stream_mark]: 7.3e-05 [recompute_prepare]: 1.593e-05 [updatestate_depend_eliminate]: 7.13998e-06 [updatestate_assign_eliminate]: 4.05998e-06 [updatestate_loads_eliminate]: 4.13001e-06 [parameter_eliminate]: 3.28e-06 [specialize_transform]: 8.94003e-06 [updatestate_useless_node_eliminater]: 8.18001e-06 [accelerated_algorithm]: 8.12998e-06 [meta_shard_fg_expand]: 2.80997e-06 [get_grad_eliminate_]: 7.13e-06 [merge_forward]: 4.04997e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.891e-05 [j_node_and_user_rematch]: 1.173e-05 [meta_fg_expand]: 2.95002e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 6.70002e-06 [renormalize]: 0.041896 [add_forward_monad_depend]: 1.203e-05 [auto_monad_grad]: 2.77002e-06 [auto_monad_eliminator]: 2.516e-05 [cse]: 3.94e-05 [replace_applicator]: 2.563e-05 [Cycle 2]: 0.00045286, [27] [switch_simplify]: 8.18001e-06 [loop_unroll]: 7.01001e-06 [a_1]: 0.00016483 [with_stream_mark]: 1.852e-05 [recompute_prepare]: 7.51999e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.42002e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 7.54002e-06 [updatestate_useless_node_eliminater]: 6.89999e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.33998e-06 [merge_forward]: 4.22003e-06 [cell_reuse_recompute_pass]: 4.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 5.78997e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.424e-05 [replace_applicator]: 6.26998e-06 [py_interpret_to_execute_after_opt_a]: 3.46e-05 [rewriter_after_opt_a]: 5.986e-05 [convert_after_rewriter]: 7.40003e-06 [order_py_execute_after_rewriter]: 1.403e-05 [mutable_eliminate]: 0.00081411 [jit_opt_b]: 6.023e-05, [1] [Cycle 1]: 5.254e-05, [2] [frontend_op_eliminate]: 2.11e-05 [inline_after_opt_a]: 1.918e-05 [cconv]: 2.652e-05 [loop_unroll]: 0.00041785 [jit_opt_after_cconv]: 0.0001572, [1] [Cycle 1]: 0.00015102, [11] [c_1]: 2.726e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 6.53e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.065e-05 [call_graph_tuple_transform]: 2.147e-05 [tuple_list_get_item_eliminator]: 6.53e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 2.09984e-07 [switch_simplify]: 6.51e-06 [remove_dup_value]: 1.843e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 7.82002e-06 [add_recomputation]: 5.676e-05 [cse_after_recomputation]: 2.539e-05, [1] [Cycle 1]: 1.965e-05, [1] [cse]: 1.354e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.35999e-06 [opt_after_jit_grad]: 0.00044165 [symbol_engine_optimizer]: 0.0001007, [1] [Cycle 1]: 9.5e-05, [6] [build]: 5.02999e-06 [elim_shapecalc]: 2.763e-05 [elim_not_effective]: 1.381e-05 [opt_reshape]: 7.54002e-06 [fold_const_symbol]: 1.071e-05 [renormalize]: 3.30008e-07 [validate]: 4.574e-05 Sums bootstrap : 0.000357s : 0.07% type_inference : 0.460741s : 90.81% event_method : 0.000024s : 0.00% auto_monad : 0.000104s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000518s : 0.10% rewriter_before_opt_a : 0.000099s : 0.02% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.01% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.000870s : 0.17% jit_opt_a.with_stream_mark : 0.000092s : 0.02% jit_opt_a.recompute_prepare : 0.000023s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000008s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.00% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.041896s : 8.26% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000054s : 0.01% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000035s : 0.01% rewriter_after_opt_a : 0.000060s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000014s : 0.00% mutable_eliminate : 0.000814s : 0.16% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.00% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000027s : 0.01% loop_unroll : 0.000418s : 0.08% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000057s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000442s : 0.09% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000028s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.01% Time group info: ------[substitution.] 0.000275 28 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.16% : 0.000006s : 4: substitution.graph_param_transform 80.94% : 0.000223s : 5: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 5.40% : 0.000015s : 3: substitution.reduce_eliminate 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 4.03% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.460648 2 99.19% : 0.456907s : 1: type_inference.infer 0.81% : 0.003741s : 1: type_inference.specialize ------[replace.] 0.000103 7 69.27% : 0.000071s : 5: replace.inline 30.73% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 95.68% : 0.000220s : 5: match.inline 4.32% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.35% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000008s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.74% : 0.000003s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 0.91% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.29% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.22% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.72% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 23: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.46% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000004s : 20: predicate.switch_defer_inline 1.96% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.92% : 0.000011s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.56% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.85% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003623 25 52.69% : 0.001909s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.48% : 0.001648s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.555973 72 0.01% : 0.000060s : 1: add_recomputation 0.02% : 0.000108s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.07% : 0.000376s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.00% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 8.72% : 0.048494s : 1: jit_opt_a 0.03% : 0.000160s : 1: jit_opt_after_cconv 0.01% : 0.000063s : 1: jit_opt_b 0.08% : 0.000425s : 1: loop_unroll 0.15% : 0.000821s : 1: mutable_eliminate 0.21% : 0.001154s : 26: opt.transform.jit_opt_a 0.01% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.00% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000055s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000448s : 1: opt_after_jit_grad 0.00% : 0.000017s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000523s : 1: py_interpret_to_execute 0.01% : 0.000038s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 7.22% : 0.040135s : 1: renormalize.infer 0.31% : 0.001744s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000063s : 1: rewriter_after_opt_a 0.02% : 0.000103s : 1: rewriter_before_opt_a 0.02% : 0.000103s : 1: symbol_engine_optimizer 82.87% : 0.460758s : 1: type_inference TotalTime = 0.030036, [30] [bootstrap]: 0.00032228 [type_inference]: 0.0214248 [event_method]: 2.02e-05 [auto_monad]: 0.00010545 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00012802 [rewriter_before_opt_a]: 8.803e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00557763, [2] [Cycle 1]: 0.00200918, [27] [switch_simplify]: 5.406e-05 [loop_unroll]: 3.002e-05 [a_1]: 0.00057497 [with_stream_mark]: 1.963e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.70002e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00098668 [add_forward_monad_depend]: 5.34e-06 [auto_monad_grad]: 2.13002e-06 [auto_monad_eliminator]: 1.646e-05 [cse]: 3.584e-05 [replace_applicator]: 1.263e-05 [Cycle 2]: 0.00034295, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.59e-06 [a_1]: 9.426e-05 [with_stream_mark]: 1.003e-05 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 2.90998e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.61998e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.34002e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.16997e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 7.13998e-06 [cse]: 1.476e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 1.26e-05 [rewriter_after_opt_a]: 3.867e-05 [convert_after_rewriter]: 7.30998e-06 [order_py_execute_after_rewriter]: 5.49998e-06 [mutable_eliminate]: 0.00057416 [jit_opt_b]: 5.231e-05, [1] [Cycle 1]: 4.456e-05, [2] [frontend_op_eliminate]: 1.659e-05 [inline_after_opt_a]: 1.659e-05 [cconv]: 2.556e-05 [loop_unroll]: 0.00045516 [jit_opt_after_cconv]: 0.00015996, [1] [Cycle 1]: 0.00015289, [11] [c_1]: 2.252e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 7.03e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.654e-05 [call_graph_tuple_transform]: 2.147e-05 [tuple_list_get_item_eliminator]: 6.03002e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 1.458e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 6.89999e-06 [add_recomputation]: 5.259e-05 [cse_after_recomputation]: 2.409e-05, [1] [Cycle 1]: 1.852e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.786e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 5.19998e-06 [opt_after_jit_grad]: 0.0005099 [symbol_engine_optimizer]: 0.0001493, [1] [Cycle 1]: 0.00014257, [6] [build]: 3.90998e-06 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 8.292e-05 [opt_reshape]: 7.1e-06 [fold_const_symbol]: 9.98002e-06 [renormalize]: 4.20026e-07 [validate]: 4.25e-05 Sums bootstrap : 0.000322s : 1.23% type_inference : 0.021425s : 81.79% event_method : 0.000020s : 0.08% auto_monad : 0.000105s : 0.40% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000128s : 0.49% rewriter_before_opt_a : 0.000088s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.23% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000669s : 2.55% jit_opt_a.with_stream_mark : 0.000030s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000987s : 3.77% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000051s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000039s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000574s : 2.19% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000455s : 1.74% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000510s : 1.95% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000083s : 0.32% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.16% Time group info: ------[substitution.] 0.000234 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 85.57% : 0.000200s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021345 2 91.83% : 0.019601s : 1: type_inference.infer 8.17% : 0.001744s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.76% : 0.000051s : 4: replace.inline 32.24% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.86% : 0.000197s : 4: match.inline 5.14% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.81% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.63% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.10% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.41% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000975 13 41.62% : 0.000406s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.78% : 0.000066s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.60% : 0.000503s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032033 72 0.17% : 0.000056s : 1: add_recomputation 0.34% : 0.000110s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.06% : 0.000341s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.42% : 0.005582s : 1: jit_opt_a 0.51% : 0.000163s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.45% : 0.000464s : 1: loop_unroll 1.82% : 0.000583s : 1: mutable_eliminate 2.79% : 0.000893s : 26: opt.transform.jit_opt_a 0.16% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.33% : 0.000104s : 4: opt.transform.symbol_engine_opt 1.62% : 0.000518s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000133s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000017s : 1: remove_dup_value 1.70% : 0.000546s : 1: renormalize.infer 1.35% : 0.000432s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000042s : 1: rewriter_after_opt_a 0.29% : 0.000092s : 1: rewriter_before_opt_a 0.47% : 0.000152s : 1: symbol_engine_optimizer 66.95% : 0.021445s : 1: type_inference TotalTime = 0.0711679, [30] [bootstrap]: 0.00032483 [type_inference]: 0.0606311 [event_method]: 2.285e-05 [auto_monad]: 7.1e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00028034 [rewriter_before_opt_a]: 9.837e-05 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.00743973, [2] [Cycle 1]: 0.00374705, [27] [switch_simplify]: 6.221e-05 [loop_unroll]: 3.809e-05 [a_1]: 0.0006592 [with_stream_mark]: 1.65e-05 [recompute_prepare]: 8.50001e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 8.45001e-06 [updatestate_useless_node_eliminater]: 7.26001e-06 [accelerated_algorithm]: 7.26001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.55002e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.617e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 3.12997e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 7.4e-06 [renormalize]: 0.00259247 [add_forward_monad_depend]: 6.12999e-06 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 1.81e-05 [cse]: 4.385e-05 [replace_applicator]: 1.802e-05 [Cycle 2]: 0.00039465, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 6.83e-06 [a_1]: 0.00012373 [with_stream_mark]: 1.302e-05 [recompute_prepare]: 6.74999e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 4.14002e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 1.50001e-06 [auto_monad_eliminator]: 7.1e-06 [cse]: 1.837e-05 [replace_applicator]: 6.55002e-06 [py_interpret_to_execute_after_opt_a]: 1.697e-05 [rewriter_after_opt_a]: 4.417e-05 [convert_after_rewriter]: 8.35001e-06 [order_py_execute_after_rewriter]: 5.49998e-06 [mutable_eliminate]: 0.00069745 [jit_opt_b]: 5.399e-05, [1] [Cycle 1]: 4.761e-05, [2] [frontend_op_eliminate]: 1.803e-05 [inline_after_opt_a]: 1.83e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00039683 [jit_opt_after_cconv]: 0.00015571, [1] [Cycle 1]: 0.00014952, [11] [c_1]: 2.635e-05 [parameter_eliminate]: 3.33e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.549e-05 [call_graph_tuple_transform]: 2.049e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.15002e-06 [remove_dup_value]: 1.991e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 5.333e-05 [cse_after_recomputation]: 2.594e-05, [1] [Cycle 1]: 2.044e-05, [1] [cse]: 1.441e-05 [auto_monad_reorder]: 1.973e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00043084 [symbol_engine_optimizer]: 7.534e-05, [1] [Cycle 1]: 6.949e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.27998e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 7.06001e-06 [fold_const_symbol]: 9.85002e-06 [renormalize]: 3.60014e-07 [validate]: 6.85e-05 Sums bootstrap : 0.000325s : 0.48% type_inference : 0.060631s : 90.11% event_method : 0.000023s : 0.03% auto_monad : 0.000071s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000280s : 0.42% rewriter_before_opt_a : 0.000098s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.10% jit_opt_a.loop_unroll : 0.000045s : 0.07% jit_opt_a.a_1 : 0.000783s : 1.16% jit_opt_a.with_stream_mark : 0.000030s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002593s : 3.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000062s : 0.09% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000044s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000697s : 1.04% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000397s : 0.59% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000431s : 0.64% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000068s : 0.10% Time group info: ------[substitution.] 0.000238 25 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000006s : 4: substitution.graph_param_transform 84.98% : 0.000202s : 5: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 5.40% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060554 2 96.33% : 0.058331s : 1: type_inference.infer 3.67% : 0.002223s : 1: type_inference.specialize ------[replace.] 0.000095 7 68.06% : 0.000065s : 5: replace.inline 31.94% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 7 94.55% : 0.000199s : 5: match.inline 5.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.67% : 0.000008s : 28: predicate.inline 1.06% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.40% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.80% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.53% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.87% : 0.000011s : 65: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.48% : 0.000002s : 13: predicate.transpose_eliminate 1.67% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002795 33 70.85% : 0.001980s : 24: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.02% : 0.000755s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.074850 72 0.07% : 0.000056s : 1: add_recomputation 0.10% : 0.000074s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.45% : 0.000337s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.94% : 0.007443s : 1: jit_opt_a 0.21% : 0.000158s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.54% : 0.000405s : 1: loop_unroll 0.94% : 0.000704s : 1: mutable_eliminate 1.40% : 0.001047s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000437s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000286s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 2.34% : 0.001748s : 1: renormalize.infer 1.12% : 0.000835s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000048s : 1: rewriter_after_opt_a 0.14% : 0.000104s : 1: rewriter_before_opt_a 0.10% : 0.000078s : 1: symbol_engine_optimizer 81.02% : 0.060647s : 1: type_inference TotalTime = 0.0425544, [30] [bootstrap]: 0.00032619 [type_inference]: 0.0339212 [event_method]: 1.75e-05 [auto_monad]: 4.428e-05 [graph_reusing]: 3.29001e-06 [pre_auto_parallel]: 1.75001e-06 [py_interpret_to_execute]: 0.00013049 [rewriter_before_opt_a]: 7.276e-05 [expand_dump_flag]: 2.61e-06 [jit_opt_a]: 0.00597062, [2] [Cycle 1]: 0.00246453, [27] [switch_simplify]: 5.419e-05 [loop_unroll]: 2.992e-05 [a_1]: 0.00055328 [with_stream_mark]: 1.561e-05 [recompute_prepare]: 8.03999e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 6.72002e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.93002e-06 [get_grad_eliminate_]: 6.23998e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.315e-05 [j_node_and_user_rematch]: 8.58001e-06 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 6.66999e-06 [renormalize]: 0.00149894 [add_forward_monad_depend]: 5.71998e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 1.14e-05 [cse]: 1.901e-05 [replace_applicator]: 1.184e-05 [Cycle 2]: 0.00033267, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 5.91e-06 [a_1]: 9.757e-05 [with_stream_mark]: 1.096e-05 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.41002e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.41998e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.23e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 5.14e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.274e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.014e-05 [rewriter_after_opt_a]: 2.858e-05 [convert_after_rewriter]: 5.56e-06 [order_py_execute_after_rewriter]: 3.95998e-06 [mutable_eliminate]: 0.00055959 [jit_opt_b]: 4.85e-05, [1] [Cycle 1]: 4.289e-05, [2] [frontend_op_eliminate]: 1.534e-05 [inline_after_opt_a]: 1.651e-05 [cconv]: 1.583e-05 [loop_unroll]: 0.00042535 [jit_opt_after_cconv]: 0.00013747, [1] [Cycle 1]: 0.00013166, [11] [c_1]: 2.154e-05 [parameter_eliminate]: 2.10002e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 1.937e-05 [call_graph_tuple_transform]: 1.662e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 9.79984e-07 [renormalize]: 2.10013e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 9.12001e-06 [partial_unused_args_eliminate]: 1.46002e-06 [environ_conv]: 4.02998e-06 [add_recomputation]: 3.377e-05 [cse_after_recomputation]: 2.38e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.16e-05 [auto_monad_reorder]: 1.082e-05 [get_jit_bprop_graph]: 1.35001e-06 [rewriter_after_jit_bprop_graph]: 4.1e-06 [opt_after_jit_grad]: 0.00045075 [symbol_engine_optimizer]: 6.932e-05, [1] [Cycle 1]: 6.38e-05, [6] [build]: 2.58e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.168e-05 [opt_reshape]: 5.93998e-06 [fold_const_symbol]: 8.22e-06 [renormalize]: 5.8001e-07 [validate]: 5.258e-05 Sums bootstrap : 0.000326s : 0.84% type_inference : 0.033921s : 87.39% event_method : 0.000017s : 0.05% auto_monad : 0.000044s : 0.11% graph_reusing : 0.000003s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000130s : 0.34% rewriter_before_opt_a : 0.000073s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.16% jit_opt_a.loop_unroll : 0.000036s : 0.09% jit_opt_a.a_1 : 0.000651s : 1.68% jit_opt_a.with_stream_mark : 0.000027s : 0.07% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001499s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.05% jit_opt_a.cse : 0.000032s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.03% rewriter_after_opt_a : 0.000029s : 0.07% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000560s : 1.44% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000016s : 0.04% loop_unroll : 0.000425s : 1.10% jit_opt_after_cconv.c_1 : 0.000022s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000009s : 0.02% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000004s : 0.01% add_recomputation : 0.000034s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000011s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000451s : 1.16% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.14% TotalTime = 0.0315471, [30] [bootstrap]: 0.00030904 [type_inference]: 0.022383 [event_method]: 2.264e-05 [auto_monad]: 7.116e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.97002e-06 [py_interpret_to_execute]: 0.00013001 [rewriter_before_opt_a]: 8.966e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00616127, [2] [Cycle 1]: 0.00214742, [27] [switch_simplify]: 5.899e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.00058169 [with_stream_mark]: 2.285e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.52001e-06 [specialize_transform]: 6.55997e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.62999e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00108888 [add_forward_monad_depend]: 6.36e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 3.638e-05 [replace_applicator]: 1.616e-05 [Cycle 2]: 0.00033522, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.29e-06 [a_1]: 9.383e-05 [with_stream_mark]: 1.106e-05 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.455e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 5.09e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.54999e-06 [cse]: 1.382e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 1.426e-05 [rewriter_after_opt_a]: 3.738e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.53002e-06 [mutable_eliminate]: 0.00070657 [jit_opt_b]: 5.168e-05, [1] [Cycle 1]: 4.459e-05, [2] [frontend_op_eliminate]: 1.658e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.669e-05 [loop_unroll]: 0.00043658 [jit_opt_after_cconv]: 0.00014865, [1] [Cycle 1]: 0.00014213, [11] [c_1]: 2.132e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 6.93e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.501e-05 [call_graph_tuple_transform]: 1.915e-05 [tuple_list_get_item_eliminator]: 5.81998e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.712e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 5.59998e-06 [add_recomputation]: 5.072e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.22e-05 [auto_monad_reorder]: 1.821e-05 [get_jit_bprop_graph]: 2.74001e-06 [rewriter_after_jit_bprop_graph]: 6.64001e-06 [opt_after_jit_grad]: 0.00047778 [symbol_engine_optimizer]: 7.531e-05, [1] [Cycle 1]: 6.848e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.404e-05 [opt_reshape]: 6.12001e-06 [fold_const_symbol]: 8.95999e-06 [renormalize]: 3.00002e-07 [validate]: 4.22e-05 Sums bootstrap : 0.000309s : 1.13% type_inference : 0.022383s : 82.18% event_method : 0.000023s : 0.08% auto_monad : 0.000071s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000130s : 0.48% rewriter_before_opt_a : 0.000090s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000676s : 2.48% jit_opt_a.with_stream_mark : 0.000034s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001089s : 4.00% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.08% jit_opt_a.cse : 0.000050s : 0.18% jit_opt_a.replace_applicator : 0.000022s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000037s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000707s : 2.59% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000437s : 1.60% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000478s : 1.75% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.15% Time group info: ------[substitution.] 0.000207 23 0.64% : 0.000001s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 1.80% : 0.000004s : 3: substitution.graph_param_transform 87.14% : 0.000181s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000004s : 4: substitution.remove_not_recompute_node 2.05% : 0.000004s : 2: substitution.replace_old_param 4.56% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.033857 2 91.91% : 0.031119s : 1: type_inference.infer 8.09% : 0.002738s : 1: type_inference.specialize ------[replace.] 0.000077 6 66.60% : 0.000051s : 4: replace.inline 33.40% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 95.49% : 0.000178s : 4: match.inline 4.51% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.82% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.76% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.97% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.93% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.66% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.09% : 0.000010s : 53: predicate.switch_simplify 1.53% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001547 13 27.30% : 0.000422s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 70.23% : 0.001087s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044955 72 0.08% : 0.000036s : 1: add_recomputation 0.11% : 0.000048s : 1: auto_monad 0.03% : 0.000013s : 1: auto_monad_reorder 0.77% : 0.000345s : 1: bootstrap 0.04% : 0.000018s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000006s : 1: environ_conv 0.05% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 13.29% : 0.005975s : 1: jit_opt_a 0.31% : 0.000140s : 1: jit_opt_after_cconv 0.11% : 0.000051s : 1: jit_opt_b 0.96% : 0.000432s : 1: loop_unroll 1.26% : 0.000568s : 1: mutable_eliminate 1.93% : 0.000867s : 26: opt.transform.jit_opt_a 0.10% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.02% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000134s : 1: py_interpret_to_execute 0.03% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000011s : 1: remove_dup_value 1.92% : 0.000861s : 1: renormalize.infer 1.40% : 0.000630s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000031s : 1: rewriter_after_opt_a 0.17% : 0.000077s : 1: rewriter_before_opt_a 0.16% : 0.000071s : 1: symbol_engine_optimizer 75.48% : 0.033933s : 1: type_inference Time group info: ------[substitution.] 0.000239 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 3: substitution.graph_param_transform 85.20% : 0.000204s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000005s : 4: substitution.remove_not_recompute_node 2.01% : 0.000005s : 2: substitution.replace_old_param 5.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022294 2 91.57% : 0.020414s : 1: type_inference.infer 8.43% : 0.001880s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.90% : 0.000052s : 4: replace.inline 32.10% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.62% : 0.000201s : 4: match.inline 5.38% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 2.27% : 0.000003s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.40% : 0.000002s : 10: predicate.environ_get_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.61% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.67% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 2.18% : 0.000003s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.42% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.83% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000950 13 42.50% : 0.000404s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.35% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.15% : 0.000495s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033574 72 0.16% : 0.000054s : 1: add_recomputation 0.22% : 0.000075s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.98% : 0.000331s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.36% : 0.006165s : 1: jit_opt_a 0.45% : 0.000151s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.33% : 0.000445s : 1: loop_unroll 2.13% : 0.000716s : 1: mutable_eliminate 2.69% : 0.000902s : 26: opt.transform.jit_opt_a 0.14% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.45% : 0.000487s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000134s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.86% : 0.000623s : 1: renormalize.infer 1.36% : 0.000456s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000040s : 1: rewriter_after_opt_a 0.28% : 0.000094s : 1: rewriter_before_opt_a 0.23% : 0.000078s : 1: symbol_engine_optimizer 66.73% : 0.022404s : 1: type_inference TotalTime = 0.0139263, [30] [bootstrap]: 0.00025444 [type_inference]: 0.00479843 [event_method]: 1.74e-05 [auto_monad]: 6.505e-05 [graph_reusing]: 6.69001e-06 [pre_auto_parallel]: 2.96999e-06 [py_interpret_to_execute]: 3.795e-05 [rewriter_before_opt_a]: 7.553e-05 [expand_dump_flag]: 3.62002e-06 [jit_opt_a]: 0.00671187, [2] [Cycle 1]: 0.00181817, [27] [switch_simplify]: 5.725e-05 [loop_unroll]: 2.905e-05 [a_1]: 0.00054767 [with_stream_mark]: 1.897e-05 [recompute_prepare]: 7.35998e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.55002e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 9.06002e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.33001e-06 [inline_without_move]: 5.02e-06 [renormalize]: 0.00084317 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.509e-05 [cse]: 2.828e-05 [replace_applicator]: 1.188e-05 [Cycle 2]: 0.00030552, [27] [switch_simplify]: 5.47999e-06 [loop_unroll]: 4.61002e-06 [a_1]: 8.818e-05 [with_stream_mark]: 8.59e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 4.68001e-06 [updatestate_useless_node_eliminater]: 4.74998e-06 [accelerated_algorithm]: 4.68001e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 2.65997e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.243e-05 [j_node_and_user_rematch]: 7.43e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.74002e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.21002e-06 [cse]: 1.011e-05 [replace_applicator]: 4.81002e-06 [py_interpret_to_execute_after_opt_a]: 1.06e-05 [rewriter_after_opt_a]: 3.562e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00049038 [jit_opt_b]: 4.763e-05, [1] [Cycle 1]: 4.03e-05, [2] [frontend_op_eliminate]: 1.478e-05 [inline_after_opt_a]: 1.474e-05 [cconv]: 2.37e-05 [loop_unroll]: 0.00039702 [jit_opt_after_cconv]: 0.00013145, [1] [Cycle 1]: 0.00012474, [11] [c_1]: 1.931e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 1.666e-05 [call_graph_tuple_transform]: 1.723e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.10001e-06 [remove_dup_value]: 1.475e-05 [partial_unused_args_eliminate]: 1.92001e-06 [environ_conv]: 5.68002e-06 [add_recomputation]: 5.56e-05 [cse_after_recomputation]: 2.116e-05, [1] [Cycle 1]: 1.59e-05, [1] [cse]: 1.027e-05 [auto_monad_reorder]: 1.564e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 4.12e-06 [opt_after_jit_grad]: 0.00042781 [symbol_engine_optimizer]: 6.756e-05, [1] [Cycle 1]: 6.141e-05, [6] [build]: 3.04999e-06 [elim_shapecalc]: 7.09001e-06 [elim_not_effective]: 1.198e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 8.09002e-06 [renormalize]: 3.39991e-07 [validate]: 3.502e-05 Sums bootstrap : 0.000254s : 2.89% type_inference : 0.004798s : 54.55% event_method : 0.000017s : 0.20% auto_monad : 0.000065s : 0.74% graph_reusing : 0.000007s : 0.08% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000038s : 0.43% rewriter_before_opt_a : 0.000076s : 0.86% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000063s : 0.71% jit_opt_a.loop_unroll : 0.000034s : 0.38% jit_opt_a.a_1 : 0.000636s : 7.23% jit_opt_a.with_stream_mark : 0.000028s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000843s : 9.59% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000038s : 0.44% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000036s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000490s : 5.57% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000024s : 0.27% loop_unroll : 0.000397s : 4.51% jit_opt_after_cconv.c_1 : 0.000019s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000017s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000056s : 0.63% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000428s : 4.86% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.40% Time group info: ------[substitution.] 0.000219 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000005s : 3: substitution.graph_param_transform 85.09% : 0.000186s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 5.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004738 2 79.57% : 0.003770s : 1: type_inference.infer 20.43% : 0.000968s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.42% : 0.000047s : 4: replace.inline 32.58% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.04% : 0.000184s : 4: match.inline 5.96% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.83% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.27% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.44% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 2.02% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.43% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000688 13 48.61% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.48% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.91% : 0.000309s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015663 72 0.38% : 0.000059s : 1: add_recomputation 0.44% : 0.000068s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 1.70% : 0.000266s : 1: bootstrap 0.17% : 0.000026s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 42.87% : 0.006715s : 1: jit_opt_a 0.85% : 0.000134s : 1: jit_opt_after_cconv 0.32% : 0.000050s : 1: jit_opt_b 2.58% : 0.000405s : 1: loop_unroll 3.18% : 0.000498s : 1: mutable_eliminate 5.38% : 0.000843s : 26: opt.transform.jit_opt_a 0.28% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.07% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000012s : 1: opt.transform.mutable_eliminate 0.12% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000029s : 4: opt.transform.symbol_engine_opt 2.78% : 0.000435s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 2.98% : 0.000467s : 1: renormalize.infer 2.34% : 0.000367s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.50% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000070s : 1: symbol_engine_optimizer 30.73% : 0.004813s : 1: type_inference TotalTime = 0.0290882, [30] [bootstrap]: 0.00029906 [type_inference]: 0.0201814 [event_method]: 2.007e-05 [auto_monad]: 6.786e-05 [graph_reusing]: 5.58002e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00011741 [rewriter_before_opt_a]: 8.353e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00585693, [2] [Cycle 1]: 0.0022177, [27] [switch_simplify]: 5.932e-05 [loop_unroll]: 3.106e-05 [a_1]: 0.00059868 [with_stream_mark]: 2.132e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.108e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 0.00112496 [add_forward_monad_depend]: 7.61001e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.709e-05 [cse]: 3.872e-05 [replace_applicator]: 1.744e-05 [Cycle 2]: 0.0003509, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 5.44998e-06 [a_1]: 9.533e-05 [with_stream_mark]: 1.277e-05 [recompute_prepare]: 6.34999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.33998e-06 [cell_reuse_recompute_pass]: 2.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.697e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.00999e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.56002e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.361e-05 [replace_applicator]: 5.64998e-06 [py_interpret_to_execute_after_opt_a]: 1.508e-05 [rewriter_after_opt_a]: 4.077e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00071172 [jit_opt_b]: 5.178e-05, [1] [Cycle 1]: 4.447e-05, [2] [frontend_op_eliminate]: 1.635e-05 [inline_after_opt_a]: 1.667e-05 [cconv]: 2.612e-05 [loop_unroll]: 0.00048349 [jit_opt_after_cconv]: 0.00015233, [1] [Cycle 1]: 0.00014488, [11] [c_1]: 2.16e-05 [parameter_eliminate]: 2.98998e-06 [updatestate_depend_eliminate]: 6.51e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.622e-05 [call_graph_tuple_transform]: 2.005e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.625e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 6.34999e-06 [add_recomputation]: 5.015e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.7e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.767e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.00049151 [symbol_engine_optimizer]: 0.00011585, [1] [Cycle 1]: 0.0001094, [6] [build]: 4.05998e-06 [elim_shapecalc]: 7.87003e-06 [elim_not_effective]: 5.317e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 3.69997e-07 [validate]: 4.4e-05 Sums bootstrap : 0.000299s : 1.19% type_inference : 0.020181s : 80.14% event_method : 0.000020s : 0.08% auto_monad : 0.000068s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000117s : 0.47% rewriter_before_opt_a : 0.000084s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000694s : 2.76% jit_opt_a.with_stream_mark : 0.000034s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001125s : 4.47% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000052s : 0.21% jit_opt_a.replace_applicator : 0.000023s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000041s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000712s : 2.83% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000026s : 0.10% loop_unroll : 0.000483s : 1.92% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000050s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000492s : 1.95% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000053s : 0.21% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.17% Time group info: ------[substitution.] 0.000246 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 3: substitution.graph_param_transform 85.39% : 0.000210s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.05% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020106 2 91.59% : 0.018414s : 1: type_inference.infer 8.41% : 0.001692s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.75% : 0.000055s : 4: replace.inline 32.25% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.87% : 0.000208s : 4: match.inline 5.13% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.11% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 6: predicate.less_batch_normalization 1.80% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.07% : 0.000003s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.21% : 0.000001s : 10: predicate.merge_addn 1.24% : 0.000002s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.05% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.64% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000854 13 43.22% : 0.000369s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.67% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.11% : 0.000436s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031236 72 0.17% : 0.000053s : 1: add_recomputation 0.23% : 0.000071s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.01% : 0.000316s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.76% : 0.005861s : 1: jit_opt_a 0.50% : 0.000155s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.57% : 0.000491s : 1: loop_unroll 2.31% : 0.000721s : 1: mutable_eliminate 2.98% : 0.000931s : 26: opt.transform.jit_opt_a 0.16% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000073s : 4: opt.transform.symbol_engine_opt 1.60% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000122s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 2.08% : 0.000648s : 1: renormalize.infer 1.49% : 0.000466s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.28% : 0.000087s : 1: rewriter_before_opt_a 0.38% : 0.000118s : 1: symbol_engine_optimizer 64.66% : 0.020198s : 1: type_inference TotalTime = 0.0644112, [30] [bootstrap]: 0.00030755 [type_inference]: 0.0563095 [event_method]: 2.059e-05 [auto_monad]: 6.863e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 9.467e-05 [rewriter_before_opt_a]: 8.224e-05 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.00536777, [2] [Cycle 1]: 0.00190988, [27] [switch_simplify]: 0.00013593 [loop_unroll]: 3.279e-05 [a_1]: 0.00052624 [with_stream_mark]: 1.796e-05 [recompute_prepare]: 8.03999e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.24e-06 [renormalize]: 0.00085737 [add_forward_monad_depend]: 1.066e-05 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.542e-05 [cse]: 3.484e-05 [replace_applicator]: 1.172e-05 [Cycle 2]: 0.00032086, [27] [switch_simplify]: 5.52001e-06 [loop_unroll]: 5.09e-06 [a_1]: 8.857e-05 [with_stream_mark]: 9.27001e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 3.02002e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.295e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 6.98e-06 [inline_without_move]: 4.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.283e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.286e-05 [rewriter_after_opt_a]: 3.689e-05 [convert_after_rewriter]: 7.18998e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.0005479 [jit_opt_b]: 4.924e-05, [1] [Cycle 1]: 4.244e-05, [2] [frontend_op_eliminate]: 1.598e-05 [inline_after_opt_a]: 1.581e-05 [cconv]: 2.595e-05 [loop_unroll]: 0.00041387 [jit_opt_after_cconv]: 0.00013786, [1] [Cycle 1]: 0.00013188, [11] [c_1]: 2.039e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 5.14998e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.08e-05 [call_graph_tuple_transform]: 1.823e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 2.30008e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 1.618e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 5.62001e-06 [add_recomputation]: 5.05e-05 [cse_after_recomputation]: 2.146e-05, [1] [Cycle 1]: 1.668e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00046941 [symbol_engine_optimizer]: 7.122e-05, [1] [Cycle 1]: 6.504e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 7.3e-06 [elim_not_effective]: 1.246e-05 [opt_reshape]: 6.03998e-06 [fold_const_symbol]: 8.91997e-06 [renormalize]: 5.09986e-07 [validate]: 3.773e-05 Sums bootstrap : 0.000308s : 0.51% type_inference : 0.056309s : 92.82% event_method : 0.000021s : 0.03% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000095s : 0.16% rewriter_before_opt_a : 0.000082s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000141s : 0.23% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000615s : 1.01% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000857s : 1.41% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000048s : 0.08% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000548s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000414s : 0.68% jit_opt_after_cconv.c_1 : 0.000020s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000469s : 0.77% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.06% Time group info: ------[substitution.] 0.000195 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.98% : 0.000006s : 3: substitution.graph_param_transform 82.90% : 0.000162s : 4: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 6.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056242 2 97.48% : 0.054824s : 1: type_inference.infer 2.52% : 0.001418s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.70% : 0.000049s : 4: replace.inline 31.30% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.48% : 0.000159s : 4: match.inline 6.52% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.43% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.57% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.45% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.31% : 0.000010s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.78% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000813 13 48.30% : 0.000393s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.84% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.86% : 0.000389s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066218 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000072s : 1: auto_monad 0.07% : 0.000045s : 1: auto_monad_reorder 0.49% : 0.000325s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.11% : 0.005371s : 1: jit_opt_a 0.21% : 0.000140s : 1: jit_opt_after_cconv 0.08% : 0.000052s : 1: jit_opt_b 0.64% : 0.000422s : 1: loop_unroll 0.84% : 0.000557s : 1: mutable_eliminate 1.38% : 0.000911s : 26: opt.transform.jit_opt_a 0.07% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000098s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 0.69% : 0.000459s : 1: renormalize.infer 0.59% : 0.000390s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.11% : 0.000074s : 1: symbol_engine_optimizer 85.06% : 0.056325s : 1: type_inference TotalTime = 0.0923627, [30] [bootstrap]: 0.00028591 [type_inference]: 0.0716071 [event_method]: 2.507e-05 [auto_monad]: 8.199e-05 [graph_reusing]: 6.79999e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00044165 [rewriter_before_opt_a]: 0.00011333 [expand_dump_flag]: 4.39002e-06 [jit_opt_a]: 0.016482, [2] [Cycle 1]: 0.0106393, [27] [switch_simplify]: 9.116e-05 [loop_unroll]: 3.837e-05 [a_1]: 0.00091182 [with_stream_mark]: 2.493e-05 [recompute_prepare]: 1.156e-05 [updatestate_depend_eliminate]: 4.94998e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 3.51999e-06 [specialize_transform]: 9.81e-06 [updatestate_useless_node_eliminater]: 7.08e-06 [accelerated_algorithm]: 8.13001e-06 [meta_shard_fg_expand]: 3.16999e-06 [get_grad_eliminate_]: 8.05e-06 [merge_forward]: 5.07e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.848e-05 [j_node_and_user_rematch]: 1.314e-05 [meta_fg_expand]: 3.08e-06 [replace_old_param]: 1.404e-05 [inline_without_move]: 7.46999e-06 [renormalize]: 0.00902655 [add_forward_monad_depend]: 1.511e-05 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 3.066e-05 [cse]: 5.252e-05 [replace_applicator]: 4.155e-05 [Cycle 2]: 0.00054552, [27] [switch_simplify]: 1.12e-05 [loop_unroll]: 9.36e-06 [a_1]: 0.00019327 [with_stream_mark]: 1.93e-05 [recompute_prepare]: 8.50999e-06 [updatestate_depend_eliminate]: 5.28002e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 3.86001e-06 [specialize_transform]: 7.81001e-06 [updatestate_useless_node_eliminater]: 7.68999e-06 [accelerated_algorithm]: 9.57999e-06 [meta_shard_fg_expand]: 4.68999e-06 [get_grad_eliminate_]: 7.33999e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 5.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.405e-05 [j_node_and_user_rematch]: 1.337e-05 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 1.244e-05 [inline_without_move]: 6.28e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.03002e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 8.70001e-06 [cse]: 2.279e-05 [replace_applicator]: 7.24001e-06 [py_interpret_to_execute_after_opt_a]: 2.368e-05 [rewriter_after_opt_a]: 7.062e-05 [convert_after_rewriter]: 9.57001e-06 [order_py_execute_after_rewriter]: 5.90002e-06 [mutable_eliminate]: 0.00101559 [jit_opt_b]: 7.34e-05, [1] [Cycle 1]: 6.373e-05, [2] [frontend_op_eliminate]: 2.681e-05 [inline_after_opt_a]: 2.307e-05 [cconv]: 3.684e-05 [loop_unroll]: 0.00053934 [jit_opt_after_cconv]: 0.00020234, [1] [Cycle 1]: 0.0001949, [11] [c_1]: 3.072e-05 [parameter_eliminate]: 4.93001e-06 [updatestate_depend_eliminate]: 1.025e-05 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 4.13001e-06 [cse]: 4.064e-05 [call_graph_tuple_transform]: 2.656e-05 [tuple_list_get_item_eliminator]: 7.98999e-06 [none_parameter_eliminate]: 2.57001e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 8.72998e-06 [remove_dup_value]: 2.429e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 1.283e-05 [add_recomputation]: 5.879e-05 [cse_after_recomputation]: 3.452e-05, [1] [Cycle 1]: 2.901e-05, [1] [cse]: 2.143e-05 [auto_monad_reorder]: 2.145e-05 [get_jit_bprop_graph]: 3.28e-06 [rewriter_after_jit_bprop_graph]: 1.052e-05 [opt_after_jit_grad]: 0.00062195 [symbol_engine_optimizer]: 0.00010234, [1] [Cycle 1]: 9.496e-05, [6] [build]: 6.22001e-06 [elim_shapecalc]: 1.258e-05 [elim_not_effective]: 2.04e-05 [opt_reshape]: 8.47e-06 [fold_const_symbol]: 1.521e-05 [renormalize]: 3.89991e-07 [validate]: 0.00020558 Sums bootstrap : 0.000286s : 0.33% type_inference : 0.071607s : 83.00% event_method : 0.000025s : 0.03% auto_monad : 0.000082s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000442s : 0.51% rewriter_before_opt_a : 0.000113s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000102s : 0.12% jit_opt_a.loop_unroll : 0.000048s : 0.06% jit_opt_a.a_1 : 0.001105s : 1.28% jit_opt_a.with_stream_mark : 0.000044s : 0.05% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000007s : 0.01% jit_opt_a.specialize_transform : 0.000018s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.02% jit_opt_a.accelerated_algorithm : 0.000018s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000026s : 0.03% jit_opt_a.inline_without_move : 0.000014s : 0.02% jit_opt_a.renormalize : 0.009027s : 10.46% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.05% jit_opt_a.cse : 0.000075s : 0.09% jit_opt_a.replace_applicator : 0.000049s : 0.06% py_interpret_to_execute_after_opt_a : 0.000024s : 0.03% rewriter_after_opt_a : 0.000071s : 0.08% convert_after_rewriter : 0.000010s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.001016s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.03% jit_opt_b.inline_after_opt_a : 0.000023s : 0.03% cconv : 0.000037s : 0.04% loop_unroll : 0.000539s : 0.63% jit_opt_after_cconv.c_1 : 0.000031s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000024s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000059s : 0.07% cse_after_recomputation.cse : 0.000021s : 0.02% auto_monad_reorder : 0.000021s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000622s : 0.72% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000206s : 0.24% Time group info: ------[substitution.] 0.000381 25 0.66% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.05% : 0.000008s : 4: substitution.graph_param_transform 87.83% : 0.000335s : 5: substitution.inline 1.61% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000006s : 4: substitution.remove_not_recompute_node 1.79% : 0.000007s : 2: substitution.replace_old_param 4.00% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071492 2 95.13% : 0.068013s : 1: type_inference.infer 4.87% : 0.003479s : 1: type_inference.specialize ------[replace.] 0.000147 7 68.01% : 0.000100s : 5: replace.inline 31.99% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000346 7 96.01% : 0.000332s : 5: match.inline 3.99% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000190 888 1.33% : 0.000003s : 13: predicate.accumulaten_eliminater 1.49% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.53% : 0.000003s : 13: predicate.addn_zero_filter 2.22% : 0.000004s : 13: predicate.arithmetic_simplify 1.41% : 0.000003s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 0.81% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.27% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.39% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.99% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_depend_swap 1.44% : 0.000003s : 13: predicate.environ_get_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.20% : 0.000000s : 4: predicate.graph_param_transform 4.93% : 0.000009s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.24% : 0.000004s : 8: predicate.less_batch_normalization 1.81% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.42% : 0.000003s : 19: predicate.load_eliminater 1.43% : 0.000003s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000008s : 41: predicate.loop_unroll_before_grad 2.15% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.45% : 0.000003s : 13: predicate.merge_addn 0.82% : 0.000002s : 13: predicate.minmaximum_grad 1.77% : 0.000003s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 1.96% : 0.000004s : 19: predicate.partial_eliminate 1.68% : 0.000003s : 13: predicate.print_const_string_wrapper 2.07% : 0.000004s : 13: predicate.reduce_eliminate 1.38% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.73% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000002s : 8: predicate.special_op_eliminate 0.72% : 0.000001s : 8: predicate.specialize_transform 1.61% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.06% : 0.000006s : 20: predicate.switch_defer_inline 1.90% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.35% : 0.000014s : 65: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000003s : 13: predicate.transpose_eliminate 1.09% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.63% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.24% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 13: predicate.value_based_eliminate 0.27% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003687 29 58.71% : 0.002164s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.88% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.42% : 0.001416s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.102784 72 0.06% : 0.000062s : 1: add_recomputation 0.08% : 0.000086s : 1: auto_monad 0.02% : 0.000025s : 1: auto_monad_reorder 0.29% : 0.000295s : 1: bootstrap 0.04% : 0.000039s : 1: cconv 0.01% : 0.000013s : 1: convert_after_rewriter 0.04% : 0.000037s : 1: cse_after_recomputation 0.02% : 0.000018s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 16.04% : 0.016487s : 1: jit_opt_a 0.20% : 0.000208s : 1: jit_opt_after_cconv 0.07% : 0.000076s : 1: jit_opt_b 0.54% : 0.000550s : 1: loop_unroll 1.00% : 0.001032s : 1: mutable_eliminate 1.42% : 0.001459s : 26: opt.transform.jit_opt_a 0.07% : 0.000070s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000041s : 4: opt.transform.jit_opt_b 0.02% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000026s : 1: opt.transform.mutable_eliminate 0.04% : 0.000039s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000634s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.44% : 0.000449s : 1: py_interpret_to_execute 0.03% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000027s : 1: remove_dup_value 6.99% : 0.007184s : 1: renormalize.infer 1.77% : 0.001823s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000076s : 1: rewriter_after_opt_a 0.12% : 0.000119s : 1: rewriter_before_opt_a 0.10% : 0.000105s : 1: symbol_engine_optimizer 69.69% : 0.071627s : 1: type_inference TotalTime = 0.0307086, [30] [bootstrap]: 0.00036785 [type_inference]: 0.0215021 [event_method]: 2.125e-05 [auto_monad]: 6.72e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00012822 [rewriter_before_opt_a]: 8.472e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.00627129, [2] [Cycle 1]: 0.00267417, [27] [switch_simplify]: 5.736e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.00083055 [with_stream_mark]: 2.292e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.50997e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.532e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 5.46e-06 [renormalize]: 0.00138452 [add_forward_monad_depend]: 5.65001e-06 [auto_monad_grad]: 2.00002e-06 [auto_monad_eliminator]: 1.578e-05 [cse]: 3.651e-05 [replace_applicator]: 1.303e-05 [Cycle 2]: 0.00033072, [27] [switch_simplify]: 6.05002e-06 [loop_unroll]: 5.59e-06 [a_1]: 9.069e-05 [with_stream_mark]: 9.94001e-06 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 3.20998e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.35e-05 [j_node_and_user_rematch]: 7.78001e-06 [meta_fg_expand]: 1.81998e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.13e-06 [cse]: 1.587e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.323e-05 [rewriter_after_opt_a]: 3.99e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00059176 [jit_opt_b]: 4.997e-05, [1] [Cycle 1]: 4.304e-05, [2] [frontend_op_eliminate]: 1.625e-05 [inline_after_opt_a]: 1.579e-05 [cconv]: 2.708e-05 [loop_unroll]: 0.00041944 [jit_opt_after_cconv]: 0.00014864, [1] [Cycle 1]: 0.00014243, [11] [c_1]: 2.207e-05 [parameter_eliminate]: 2.81999e-06 [updatestate_depend_eliminate]: 6.36e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 2.468e-05 [call_graph_tuple_transform]: 1.889e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.13002e-06 [remove_dup_value]: 1.888e-05 [partial_unused_args_eliminate]: 2.43002e-06 [environ_conv]: 5.79e-06 [add_recomputation]: 5.232e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.85e-05, [1] [cse]: 1.223e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 4.19997e-06 [opt_after_jit_grad]: 0.00052131 [symbol_engine_optimizer]: 7.683e-05, [1] [Cycle 1]: 7.006e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 8.03001e-06 [elim_not_effective]: 1.364e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.61e-06 [renormalize]: 5.39992e-07 [validate]: 4.412e-05 Sums bootstrap : 0.000368s : 1.37% type_inference : 0.021502s : 80.08% event_method : 0.000021s : 0.08% auto_monad : 0.000067s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000128s : 0.48% rewriter_before_opt_a : 0.000085s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.24% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000921s : 3.43% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001385s : 5.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000052s : 0.20% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000592s : 2.20% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000419s : 1.56% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000521s : 1.94% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.16% Time group info: ------[substitution.] 0.000230 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 3: substitution.graph_param_transform 82.18% : 0.000189s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 2.44% : 0.000006s : 2: substitution.replace_old_param 8.00% : 0.000018s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021427 2 90.77% : 0.019450s : 1: type_inference.infer 9.23% : 0.001977s : 1: type_inference.specialize ------[replace.] 0.000087 6 61.08% : 0.000053s : 4: replace.inline 38.92% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 92.00% : 0.000187s : 4: match.inline 8.00% : 0.000016s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 2.08% : 0.000002s : 10: predicate.arithmetic_simplify 1.48% : 0.000002s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.00% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.55% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001066 13 40.95% : 0.000436s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.19% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.86% : 0.000585s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033285 72 0.17% : 0.000055s : 1: add_recomputation 0.21% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.15% : 0.000384s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.85% : 0.006275s : 1: jit_opt_a 0.46% : 0.000152s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.28% : 0.000427s : 1: loop_unroll 1.81% : 0.000601s : 1: mutable_eliminate 3.43% : 0.001143s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.59% : 0.000530s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000132s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 2.54% : 0.000844s : 1: renormalize.infer 1.60% : 0.000532s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.27% : 0.000089s : 1: rewriter_before_opt_a 0.24% : 0.000079s : 1: symbol_engine_optimizer 64.65% : 0.021519s : 1: type_inference TotalTime = 0.0308325, [30] [bootstrap]: 0.00028991 [type_inference]: 0.0211273 [event_method]: 2.351e-05 [auto_monad]: 7.626e-05 [graph_reusing]: 6.40002e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00012686 [rewriter_before_opt_a]: 8.986e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00652584, [2] [Cycle 1]: 0.00229784, [27] [switch_simplify]: 6.747e-05 [loop_unroll]: 3.183e-05 [a_1]: 0.00065904 [with_stream_mark]: 2.108e-05 [recompute_prepare]: 8.1e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.92002e-06 [replace_old_param]: 9.63002e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00114739 [add_forward_monad_depend]: 5.46e-06 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.655e-05 [cse]: 3.905e-05 [replace_applicator]: 1.472e-05 [Cycle 2]: 0.00034315, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 6.17999e-06 [a_1]: 9.527e-05 [with_stream_mark]: 1.049e-05 [recompute_prepare]: 6.09999e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.58001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.482e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.505e-05 [rewriter_after_opt_a]: 3.996e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00071273 [jit_opt_b]: 5.416e-05, [1] [Cycle 1]: 4.652e-05, [2] [frontend_op_eliminate]: 1.698e-05 [inline_after_opt_a]: 1.75e-05 [cconv]: 4.56e-05 [loop_unroll]: 0.00048993 [jit_opt_after_cconv]: 0.00016893, [1] [Cycle 1]: 0.00016048, [11] [c_1]: 2.343e-05 [parameter_eliminate]: 3.51001e-06 [updatestate_depend_eliminate]: 8.11002e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 3.007e-05 [call_graph_tuple_transform]: 2.322e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.55002e-06 [remove_dup_value]: 1.808e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 6.56e-06 [add_recomputation]: 5.512e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.851e-05, [1] [cse]: 1.25e-05 [auto_monad_reorder]: 1.76e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 7.33e-06 [opt_after_jit_grad]: 0.00051731 [symbol_engine_optimizer]: 0.00010456, [1] [Cycle 1]: 9.793e-05, [6] [build]: 5.45001e-06 [elim_shapecalc]: 9.00999e-06 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.39999e-06 [fold_const_symbol]: 3.274e-05 [renormalize]: 5.39992e-07 [validate]: 4.802e-05 Sums bootstrap : 0.000290s : 1.10% type_inference : 0.021127s : 80.36% event_method : 0.000024s : 0.09% auto_monad : 0.000076s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000127s : 0.48% rewriter_before_opt_a : 0.000090s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.28% jit_opt_a.loop_unroll : 0.000038s : 0.14% jit_opt_a.a_1 : 0.000754s : 2.87% jit_opt_a.with_stream_mark : 0.000032s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001147s : 4.36% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000054s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000713s : 2.71% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000046s : 0.17% loop_unroll : 0.000490s : 1.86% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000517s : 1.97% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000033s : 0.12% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.18% Time group info: ------[substitution.] 0.000297 23 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.09% : 0.000006s : 3: substitution.graph_param_transform 87.53% : 0.000260s : 4: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.72% : 0.000005s : 2: substitution.replace_old_param 4.63% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021035 2 90.74% : 0.019088s : 1: type_inference.infer 9.26% : 0.001947s : 1: type_inference.specialize ------[replace.] 0.000082 6 69.65% : 0.000057s : 4: replace.inline 30.35% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000269 6 95.33% : 0.000257s : 4: match.inline 4.67% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.80% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.18% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.40% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.90% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.23% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.19% : 0.000002s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.49% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.33% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.77% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000947 13 41.10% : 0.000389s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.91% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.99% : 0.000502s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033054 72 0.18% : 0.000058s : 1: add_recomputation 0.24% : 0.000080s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.93% : 0.000309s : 1: bootstrap 0.15% : 0.000049s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.75% : 0.006530s : 1: jit_opt_a 0.52% : 0.000172s : 1: jit_opt_after_cconv 0.17% : 0.000057s : 1: jit_opt_b 1.51% : 0.000500s : 1: loop_unroll 2.19% : 0.000723s : 1: mutable_eliminate 3.01% : 0.000993s : 26: opt.transform.jit_opt_a 0.17% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000059s : 4: opt.transform.symbol_engine_opt 1.60% : 0.000529s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000131s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 2.04% : 0.000673s : 1: renormalize.infer 1.41% : 0.000466s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.28% : 0.000094s : 1: rewriter_before_opt_a 0.32% : 0.000107s : 1: symbol_engine_optimizer 64.02% : 0.021162s : 1: type_inference TotalTime = 0.0333016, [30] [bootstrap]: 0.00026636 [type_inference]: 0.0233671 [event_method]: 2.176e-05 [auto_monad]: 7.472e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00013329 [rewriter_before_opt_a]: 8.806e-05 [expand_dump_flag]: 4.17003e-06 [jit_opt_a]: 0.00686254, [2] [Cycle 1]: 0.0023604, [27] [switch_simplify]: 6.683e-05 [loop_unroll]: 3.142e-05 [a_1]: 0.00061987 [with_stream_mark]: 2.433e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.93001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 5.76e-06 [renormalize]: 0.0012365 [add_forward_monad_depend]: 7.23e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.86e-05 [cse]: 3.856e-05 [replace_applicator]: 1.733e-05 [Cycle 2]: 0.00035033, [27] [switch_simplify]: 6.46999e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.732e-05 [with_stream_mark]: 1.186e-05 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.78002e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 2.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.658e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.19e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 1.13001e-06 [auto_monad_eliminator]: 6.53003e-06 [cse]: 1.386e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.479e-05 [rewriter_after_opt_a]: 4.263e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00070986 [jit_opt_b]: 5.263e-05, [1] [Cycle 1]: 4.502e-05, [2] [frontend_op_eliminate]: 1.613e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 3.043e-05 [loop_unroll]: 0.0004679 [jit_opt_after_cconv]: 0.00016532, [1] [Cycle 1]: 0.00015784, [11] [c_1]: 2.222e-05 [parameter_eliminate]: 4.13001e-06 [updatestate_depend_eliminate]: 8.22e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.972e-05 [call_graph_tuple_transform]: 2.316e-05 [tuple_list_get_item_eliminator]: 5.89999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 8.29983e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.12999e-06 [add_recomputation]: 5.43e-05 [cse_after_recomputation]: 2.372e-05, [1] [Cycle 1]: 1.83e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 2.38998e-06 [rewriter_after_jit_bprop_graph]: 6.42001e-06 [opt_after_jit_grad]: 0.00049711 [symbol_engine_optimizer]: 0.00010537, [1] [Cycle 1]: 9.886e-05, [6] [build]: 4.72998e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 1.366e-05 [opt_reshape]: 3.232e-05 [fold_const_symbol]: 9.92001e-06 [renormalize]: 6.60017e-07 [validate]: 4.881e-05 Sums bootstrap : 0.000266s : 0.93% type_inference : 0.023367s : 81.94% event_method : 0.000022s : 0.08% auto_monad : 0.000075s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000133s : 0.47% rewriter_before_opt_a : 0.000088s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000717s : 2.51% jit_opt_a.with_stream_mark : 0.000036s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001237s : 4.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000052s : 0.18% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000043s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000710s : 2.49% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000030s : 0.11% loop_unroll : 0.000468s : 1.64% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000054s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000497s : 1.74% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000032s : 0.11% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.17% Time group info: ------[substitution.] 0.000262 23 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000007s : 3: substitution.graph_param_transform 85.54% : 0.000224s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000006s : 4: substitution.remove_not_recompute_node 2.11% : 0.000006s : 2: substitution.replace_old_param 4.82% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023282 2 92.04% : 0.021428s : 1: type_inference.infer 7.96% : 0.001853s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.33% : 0.000055s : 4: replace.inline 32.67% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 6 95.15% : 0.000222s : 4: match.inline 4.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.40% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.54% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.84% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.61% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.13% : 0.000003s : 3: predicate.mutable_eliminate 0.66% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000002s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.56% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.74% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.95% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000951 13 39.32% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.87% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.82% : 0.000521s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035579 72 0.16% : 0.000058s : 1: add_recomputation 0.22% : 0.000079s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.80% : 0.000283s : 1: bootstrap 0.09% : 0.000033s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 19.30% : 0.006866s : 1: jit_opt_a 0.47% : 0.000168s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.34% : 0.000478s : 1: loop_unroll 2.02% : 0.000720s : 1: mutable_eliminate 2.70% : 0.000961s : 26: opt.transform.jit_opt_a 0.15% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000061s : 4: opt.transform.symbol_engine_opt 1.42% : 0.000507s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000138s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.89% : 0.000673s : 1: renormalize.infer 1.55% : 0.000553s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000046s : 1: rewriter_after_opt_a 0.26% : 0.000092s : 1: rewriter_before_opt_a 0.30% : 0.000108s : 1: symbol_engine_optimizer 65.74% : 0.023390s : 1: type_inference TotalTime = 0.051885, [30] [bootstrap]: 0.00027827 [type_inference]: 0.00917382 [event_method]: 2.027e-05 [auto_monad]: 6.856e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.96999e-06 [py_interpret_to_execute]: 4.935e-05 [rewriter_before_opt_a]: 8.457e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.0397338, [2] [Cycle 1]: 0.00226024, [27] [switch_simplify]: 7.111e-05 [loop_unroll]: 3.372e-05 [a_1]: 0.00075471 [with_stream_mark]: 2.628e-05 [recompute_prepare]: 9.20999e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.73003e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.59001e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 1.119e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00098191 [add_forward_monad_depend]: 7.12002e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.804e-05 [cse]: 4.525e-05 [replace_applicator]: 1.588e-05 [Cycle 2]: 0.00159035, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00010086 [with_stream_mark]: 1.15e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 3.40998e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.76998e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 0.00111597 [meta_fg_expand]: 6.00002e-06 [replace_old_param]: 1.909e-05 [inline_without_move]: 6.58e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.91e-06 [auto_monad_grad]: 3.39001e-06 [auto_monad_eliminator]: 2.531e-05 [cse]: 4.796e-05 [replace_applicator]: 7.46001e-06 [py_interpret_to_execute_after_opt_a]: 1.929e-05 [rewriter_after_opt_a]: 4.793e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 5.21998e-06 [mutable_eliminate]: 0.0006993 [jit_opt_b]: 5.897e-05, [1] [Cycle 1]: 5.142e-05, [2] [frontend_op_eliminate]: 1.815e-05 [inline_after_opt_a]: 2.029e-05 [cconv]: 3.539e-05 [loop_unroll]: 0.00044326 [jit_opt_after_cconv]: 0.00016539, [1] [Cycle 1]: 0.00015903, [11] [c_1]: 2.215e-05 [parameter_eliminate]: 3.64002e-06 [updatestate_depend_eliminate]: 7.46999e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 4.42e-06 [cse]: 2.794e-05 [call_graph_tuple_transform]: 2.229e-05 [tuple_list_get_item_eliminator]: 7.36999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.89999e-06 [remove_dup_value]: 3.81e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 8.13999e-06 [add_recomputation]: 5.369e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.939e-05 [get_jit_bprop_graph]: 2.69999e-06 [rewriter_after_jit_bprop_graph]: 5.22e-06 [opt_after_jit_grad]: 0.00049888 [symbol_engine_optimizer]: 8.145e-05, [1] [Cycle 1]: 7.427e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 8.83001e-06 [elim_not_effective]: 1.498e-05 [opt_reshape]: 6.94001e-06 [fold_const_symbol]: 9.95002e-06 [renormalize]: 5.60016e-07 [validate]: 4.414e-05 Sums bootstrap : 0.000278s : 1.82% type_inference : 0.009174s : 59.93% event_method : 0.000020s : 0.13% auto_monad : 0.000069s : 0.45% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.32% rewriter_before_opt_a : 0.000085s : 0.55% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000078s : 0.51% jit_opt_a.loop_unroll : 0.000040s : 0.26% jit_opt_a.a_1 : 0.000856s : 5.59% jit_opt_a.with_stream_mark : 0.000038s : 0.25% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.001126s : 7.36% jit_opt_a.meta_fg_expand : 0.000009s : 0.06% jit_opt_a.replace_old_param : 0.000030s : 0.20% jit_opt_a.inline_without_move : 0.000013s : 0.08% jit_opt_a.renormalize : 0.000982s : 6.42% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.11% jit_opt_a.auto_monad_grad : 0.000006s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000043s : 0.28% jit_opt_a.cse : 0.000093s : 0.61% jit_opt_a.replace_applicator : 0.000023s : 0.15% py_interpret_to_execute_after_opt_a : 0.000019s : 0.13% rewriter_after_opt_a : 0.000048s : 0.31% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000699s : 4.57% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000020s : 0.13% cconv : 0.000035s : 0.23% loop_unroll : 0.000443s : 2.90% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.cse : 0.000028s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000038s : 0.25% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000054s : 0.35% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000499s : 3.26% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.29% Time group info: ------[substitution.] 0.000350 24 0.73% : 0.000003s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 1.79% : 0.000006s : 3: substitution.graph_param_transform 86.78% : 0.000304s : 5: substitution.inline 2.28% : 0.000008s : 4: substitution.j_node_and_user_rematch 1.57% : 0.000005s : 4: substitution.remove_not_recompute_node 2.53% : 0.000009s : 2: substitution.replace_old_param 3.80% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009109 2 89.02% : 0.008109s : 1: type_inference.infer 10.98% : 0.001000s : 1: type_inference.specialize ------[replace.] 0.000108 7 67.68% : 0.000073s : 5: replace.inline 32.32% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000313 7 96.11% : 0.000301s : 5: match.inline 3.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 747 1.36% : 0.000002s : 11: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 2.07% : 0.000003s : 11: predicate.arithmetic_simplify 1.48% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_depend_swap 1.17% : 0.000002s : 11: predicate.environ_get_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000007s : 24: predicate.inline 1.32% : 0.000002s : 6: predicate.inline_without_move 1.58% : 0.000002s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 16: predicate.load_eliminater 1.08% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 1.61% : 0.000002s : 11: predicate.reduce_eliminate 1.57% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 11: predicate.reshape_eliminate 1.60% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.29% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.91% : 0.000010s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.63% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000829 16 48.80% : 0.000404s : 7: func_graph_cloner_run.FuncGraphClonerGraph 11.23% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.98% : 0.000331s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055128 72 0.10% : 0.000056s : 1: add_recomputation 0.13% : 0.000072s : 1: auto_monad 0.04% : 0.000022s : 1: auto_monad_reorder 0.54% : 0.000298s : 1: bootstrap 0.07% : 0.000038s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 72.08% : 0.039738s : 1: jit_opt_a 0.31% : 0.000169s : 1: jit_opt_after_cconv 0.11% : 0.000062s : 1: jit_opt_b 0.82% : 0.000451s : 1: loop_unroll 1.29% : 0.000709s : 1: mutable_eliminate 4.03% : 0.002224s : 26: opt.transform.jit_opt_a 0.10% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.92% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.09% : 0.000052s : 1: py_interpret_to_execute 0.04% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000041s : 1: remove_dup_value 1.05% : 0.000579s : 1: renormalize.infer 0.71% : 0.000394s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000051s : 1: rewriter_after_opt_a 0.16% : 0.000087s : 1: rewriter_before_opt_a 0.15% : 0.000084s : 1: symbol_engine_optimizer 16.66% : 0.009185s : 1: type_inference TotalTime = 0.0675769, [30] [bootstrap]: 0.00027069 [type_inference]: 0.0392871 [event_method]: 1.997e-05 [auto_monad]: 6.798e-05 [graph_reusing]: 7e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00010099 [rewriter_before_opt_a]: 8.176e-05 [expand_dump_flag]: 3.07002e-06 [jit_opt_a]: 0.025533, [2] [Cycle 1]: 0.0221786, [27] [switch_simplify]: 5.309e-05 [loop_unroll]: 2.973e-05 [a_1]: 0.0207278 [with_stream_mark]: 2.278e-05 [recompute_prepare]: 1.062e-05 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 3.31001e-06 [get_grad_eliminate_]: 5.81003e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 8.70999e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.44998e-06 [inline_without_move]: 5.76e-06 [renormalize]: 0.00099369 [add_forward_monad_depend]: 5.22999e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.563e-05 [cse]: 3.03e-05 [replace_applicator]: 1.228e-05 [Cycle 2]: 0.00031343, [27] [switch_simplify]: 6.04001e-06 [loop_unroll]: 5.46002e-06 [a_1]: 8.843e-05 [with_stream_mark]: 8.32998e-06 [recompute_prepare]: 5.31002e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 5.14003e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.199e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.22002e-06 [inline_without_move]: 5.02e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.27001e-06 [cse]: 1.204e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.18e-05 [rewriter_after_opt_a]: 3.557e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00068774 [jit_opt_b]: 5.061e-05, [1] [Cycle 1]: 4.33e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 2.611e-05 [loop_unroll]: 0.00039725 [jit_opt_after_cconv]: 0.00013628, [1] [Cycle 1]: 0.00012982, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 1.877e-05 [call_graph_tuple_transform]: 1.833e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.38002e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.649e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 5.57001e-06 [add_recomputation]: 4.662e-05 [cse_after_recomputation]: 2.205e-05, [1] [Cycle 1]: 1.695e-05, [1] [cse]: 1.164e-05 [auto_monad_reorder]: 1.679e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 3.90998e-06 [opt_after_jit_grad]: 0.00045113 [symbol_engine_optimizer]: 8.061e-05, [1] [Cycle 1]: 7.415e-05, [6] [build]: 2.96001e-06 [elim_shapecalc]: 1.652e-05 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.70999e-06 [renormalize]: 3.50003e-07 [validate]: 3.765e-05 Sums bootstrap : 0.000271s : 0.42% type_inference : 0.039287s : 61.42% event_method : 0.000020s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000101s : 0.16% rewriter_before_opt_a : 0.000082s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.020816s : 32.54% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.000994s : 1.55% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000688s : 1.08% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.000397s : 0.62% jit_opt_after_cconv.c_1 : 0.000021s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000047s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000451s : 0.71% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000017s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.06% Time group info: ------[substitution.] 0.000256 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000005s : 3: substitution.graph_param_transform 85.94% : 0.000220s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 5.63% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039221 2 96.29% : 0.037764s : 1: type_inference.infer 3.71% : 0.001457s : 1: type_inference.specialize ------[replace.] 0.020150 6 99.83% : 0.020115s : 4: replace.inline 0.17% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.31% : 0.000218s : 4: match.inline 5.69% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.50% : 0.000002s : 10: predicate.accumulaten_eliminater 0.83% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000003s : 10: predicate.arithmetic_simplify 1.27% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000002s : 10: predicate.depend_value_elim 0.93% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.04% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 0.92% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.14% : 0.000008s : 22: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 7.21% : 0.000010s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 15: predicate.load_eliminater 1.13% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.50% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.63% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.93% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 1.11% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000003s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.69% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 4.59% : 0.000006s : 16: predicate.switch_defer_inline 2.57% : 0.000004s : 16: predicate.switch_layer_defer_inline 6.30% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000002s : 10: predicate.tile_eliminate 1.10% : 0.000002s : 10: predicate.transpose_eliminate 1.22% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.49% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.44% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000817 13 40.45% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.57% : 0.000070s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.98% : 0.000417s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.089666 72 0.06% : 0.000049s : 1: add_recomputation 0.08% : 0.000071s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.31% : 0.000282s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 28.48% : 0.025537s : 1: jit_opt_a 0.16% : 0.000139s : 1: jit_opt_after_cconv 0.06% : 0.000053s : 1: jit_opt_b 0.45% : 0.000405s : 1: loop_unroll 0.78% : 0.000695s : 1: mutable_eliminate 23.45% : 0.021029s : 26: opt.transform.jit_opt_a 0.05% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000105s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 0.64% : 0.000573s : 1: renormalize.infer 0.46% : 0.000412s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000039s : 1: rewriter_after_opt_a 0.10% : 0.000085s : 1: rewriter_before_opt_a 0.09% : 0.000083s : 1: symbol_engine_optimizer 43.83% : 0.039304s : 1: type_inference TotalTime = 0.0316329, [30] [bootstrap]: 0.00031814 [type_inference]: 0.0218115 [event_method]: 2.339e-05 [auto_monad]: 7.411e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00013208 [rewriter_before_opt_a]: 9.226e-05 [expand_dump_flag]: 3.75998e-06 [jit_opt_a]: 0.00668833, [2] [Cycle 1]: 0.00236059, [27] [switch_simplify]: 6.591e-05 [loop_unroll]: 3.092e-05 [a_1]: 0.00061939 [with_stream_mark]: 2.535e-05 [recompute_prepare]: 7.85998e-06 [updatestate_depend_eliminate]: 4.99e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.96001e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.569e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00123325 [add_forward_monad_depend]: 7.1e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.718e-05 [cse]: 3.954e-05 [replace_applicator]: 1.84e-05 [Cycle 2]: 0.00034282, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.445e-05 [with_stream_mark]: 1.296e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.69999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 8.44998e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.93001e-06 [inline_without_move]: 5.14e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.61999e-06 [cse]: 1.44e-05 [replace_applicator]: 5.51e-06 [py_interpret_to_execute_after_opt_a]: 1.47e-05 [rewriter_after_opt_a]: 4.057e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 5.43997e-06 [mutable_eliminate]: 0.00072989 [jit_opt_b]: 5.217e-05, [1] [Cycle 1]: 4.501e-05, [2] [frontend_op_eliminate]: 1.647e-05 [inline_after_opt_a]: 1.656e-05 [cconv]: 2.868e-05 [loop_unroll]: 0.0004668 [jit_opt_after_cconv]: 0.0001582, [1] [Cycle 1]: 0.00015167, [11] [c_1]: 2.207e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 7.26001e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.821e-05 [call_graph_tuple_transform]: 2.092e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.739e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 6.59001e-06 [add_recomputation]: 5.289e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.137e-05 [auto_monad_reorder]: 1.774e-05 [get_jit_bprop_graph]: 2.66999e-06 [rewriter_after_jit_bprop_graph]: 6.90002e-06 [opt_after_jit_grad]: 0.00051958 [symbol_engine_optimizer]: 8.235e-05, [1] [Cycle 1]: 7.565e-05, [6] [build]: 4.74e-06 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.575e-05 [opt_reshape]: 6.69999e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 8.70001e-07 [validate]: 4.786e-05 Sums bootstrap : 0.000318s : 1.18% type_inference : 0.021811s : 80.75% event_method : 0.000023s : 0.09% auto_monad : 0.000074s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000132s : 0.49% rewriter_before_opt_a : 0.000092s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.27% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000714s : 2.64% jit_opt_a.with_stream_mark : 0.000038s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001233s : 4.57% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000054s : 0.20% jit_opt_a.replace_applicator : 0.000024s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000730s : 2.70% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000467s : 1.73% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000520s : 1.92% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.18% Time group info: ------[substitution.] 0.000260 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.18% : 0.000006s : 3: substitution.graph_param_transform 85.49% : 0.000223s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_old_param 5.31% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021725 2 91.83% : 0.019949s : 1: type_inference.infer 8.17% : 0.001775s : 1: type_inference.specialize ------[replace.] 0.000085 6 69.62% : 0.000059s : 4: replace.inline 30.38% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.56% : 0.000220s : 4: match.inline 5.44% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.66% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.11% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.00% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.40% : 0.000002s : 10: predicate.print_const_string_wrapper 2.02% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000934 13 41.79% : 0.000390s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.81% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.40% : 0.000489s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033891 72 0.16% : 0.000056s : 1: add_recomputation 0.23% : 0.000078s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.99% : 0.000336s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 19.74% : 0.006691s : 1: jit_opt_a 0.47% : 0.000161s : 1: jit_opt_after_cconv 0.16% : 0.000055s : 1: jit_opt_b 1.40% : 0.000476s : 1: loop_unroll 2.18% : 0.000740s : 1: mutable_eliminate 2.81% : 0.000953s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000048s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000037s : 4: opt.transform.symbol_engine_opt 1.56% : 0.000529s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000136s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.15% : 0.000730s : 1: renormalize.infer 1.46% : 0.000494s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.29% : 0.000097s : 1: rewriter_before_opt_a 0.25% : 0.000085s : 1: symbol_engine_optimizer 64.42% : 0.021834s : 1: type_inference TotalTime = 0.0338041, [30] [bootstrap]: 0.00033136 [type_inference]: 0.0228085 [event_method]: 2.354e-05 [auto_monad]: 7.131e-05 [graph_reusing]: 6.59001e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 0.0001411 [rewriter_before_opt_a]: 9.269e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00783224, [2] [Cycle 1]: 0.00371773, [27] [switch_simplify]: 6.257e-05 [loop_unroll]: 3.144e-05 [a_1]: 0.0005864 [with_stream_mark]: 2.083e-05 [recompute_prepare]: 8.37998e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.57002e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 3.04001e-06 [replace_old_param]: 1.072e-05 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00109019 [add_forward_monad_depend]: 6.59001e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 0.0015552 [cse]: 4.223e-05 [replace_applicator]: 2.098e-05 [Cycle 2]: 0.00035944, [27] [switch_simplify]: 6.49999e-06 [loop_unroll]: 5.85002e-06 [a_1]: 9.919e-05 [with_stream_mark]: 1.5e-05 [recompute_prepare]: 5.74999e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 2.03997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.756e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.46e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.69001e-06 [auto_monad_grad]: 1.51002e-06 [auto_monad_eliminator]: 5.98998e-06 [cse]: 1.361e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.552e-05 [rewriter_after_opt_a]: 4.087e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.85002e-06 [mutable_eliminate]: 0.00074149 [jit_opt_b]: 5.336e-05, [1] [Cycle 1]: 4.59e-05, [2] [frontend_op_eliminate]: 1.701e-05 [inline_after_opt_a]: 1.756e-05 [cconv]: 3.142e-05 [loop_unroll]: 0.00044968 [jit_opt_after_cconv]: 0.00015359, [1] [Cycle 1]: 0.00014689, [11] [c_1]: 2.242e-05 [parameter_eliminate]: 3.22002e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.534e-05 [call_graph_tuple_transform]: 2.088e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 5.161e-05 [cse_after_recomputation]: 2.28e-05, [1] [Cycle 1]: 1.752e-05, [1] [cse]: 1.182e-05 [auto_monad_reorder]: 1.984e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 5.96998e-06 [opt_after_jit_grad]: 0.00050472 [symbol_engine_optimizer]: 7.854e-05, [1] [Cycle 1]: 7.184e-05, [6] [build]: 5.08002e-06 [elim_shapecalc]: 7.86001e-06 [elim_not_effective]: 1.382e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.61e-06 [renormalize]: 2.50002e-07 [validate]: 4.574e-05 Sums bootstrap : 0.000331s : 1.13% type_inference : 0.022808s : 77.65% event_method : 0.000024s : 0.08% auto_monad : 0.000071s : 0.24% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000141s : 0.48% rewriter_before_opt_a : 0.000093s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.13% jit_opt_a.a_1 : 0.000686s : 2.33% jit_opt_a.with_stream_mark : 0.000036s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001090s : 3.71% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.001561s : 5.31% jit_opt_a.cse : 0.000056s : 0.19% jit_opt_a.replace_applicator : 0.000026s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000041s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000741s : 2.52% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.06% cconv : 0.000031s : 0.11% loop_unroll : 0.000450s : 1.53% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000505s : 1.72% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.16% Time group info: ------[substitution.] 0.000242 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 3: substitution.graph_param_transform 84.09% : 0.000203s : 4: substitution.inline 1.71% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.60% : 0.000006s : 2: substitution.replace_old_param 5.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022720 2 91.42% : 0.020769s : 1: type_inference.infer 8.58% : 0.001950s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.09% : 0.000052s : 4: replace.inline 31.91% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.60% : 0.000201s : 4: match.inline 5.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.37% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.62% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.35% : 0.000002s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.85% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.27% : 0.000002s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 2.09% : 0.000003s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.17% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000955 13 43.99% : 0.000420s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.27% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.74% : 0.000484s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035837 72 0.15% : 0.000055s : 1: add_recomputation 0.21% : 0.000075s : 1: auto_monad 0.06% : 0.000023s : 1: auto_monad_reorder 0.99% : 0.000353s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 21.86% : 0.007835s : 1: jit_opt_a 0.44% : 0.000156s : 1: jit_opt_after_cconv 0.16% : 0.000056s : 1: jit_opt_b 1.28% : 0.000458s : 1: loop_unroll 2.10% : 0.000751s : 1: mutable_eliminate 2.59% : 0.000929s : 26: opt.transform.jit_opt_a 0.14% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.43% : 0.000513s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000147s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.77% : 0.000636s : 1: renormalize.infer 1.24% : 0.000446s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000044s : 1: rewriter_after_opt_a 0.27% : 0.000096s : 1: rewriter_before_opt_a 0.23% : 0.000081s : 1: symbol_engine_optimizer 63.71% : 0.022831s : 1: type_inference TotalTime = 0.0244738, [30] [bootstrap]: 0.0002816 [type_inference]: 0.0135601 [event_method]: 2.312e-05 [auto_monad]: 7.421e-05 [graph_reusing]: 7.08e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 5.955e-05 [rewriter_before_opt_a]: 9.22e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00777355, [2] [Cycle 1]: 0.00346998, [27] [switch_simplify]: 6.615e-05 [loop_unroll]: 3.712e-05 [a_1]: 0.00160534 [with_stream_mark]: 3.143e-05 [recompute_prepare]: 1.11e-05 [updatestate_depend_eliminate]: 4.57998e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 6.28002e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 4e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 5.27999e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 3.21999e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00128505 [add_forward_monad_depend]: 7.01999e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 2.029e-05 [cse]: 4.763e-05 [replace_applicator]: 1.527e-05 [Cycle 2]: 0.00034925, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 5.80002e-06 [a_1]: 9.883e-05 [with_stream_mark]: 1.386e-05 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 3.25002e-06 [replace_old_param]: 7.16999e-06 [inline_without_move]: 5.03002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.19999e-06 [cse]: 1.585e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.611e-05 [rewriter_after_opt_a]: 4.237e-05 [convert_after_rewriter]: 7.22997e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00080581 [jit_opt_b]: 5.45e-05, [1] [Cycle 1]: 4.602e-05, [2] [frontend_op_eliminate]: 1.819e-05 [inline_after_opt_a]: 1.607e-05 [cconv]: 3.036e-05 [loop_unroll]: 0.00046341 [jit_opt_after_cconv]: 0.00015674, [1] [Cycle 1]: 0.00015018, [11] [c_1]: 2.123e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.825e-05 [call_graph_tuple_transform]: 2.086e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 4.165e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 6.05002e-06 [add_recomputation]: 5.478e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.236e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 2.94001e-06 [rewriter_after_jit_bprop_graph]: 4.75999e-06 [opt_after_jit_grad]: 0.00050076 [symbol_engine_optimizer]: 0.00012158, [1] [Cycle 1]: 0.00011436, [6] [build]: 4.47e-06 [elim_shapecalc]: 4.964e-05 [elim_not_effective]: 1.494e-05 [opt_reshape]: 6.64001e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 2.3999e-07 [validate]: 4.835e-05 Sums bootstrap : 0.000282s : 1.42% type_inference : 0.013560s : 68.31% event_method : 0.000023s : 0.12% auto_monad : 0.000074s : 0.37% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000060s : 0.30% rewriter_before_opt_a : 0.000092s : 0.46% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.37% jit_opt_a.loop_unroll : 0.000043s : 0.22% jit_opt_a.a_1 : 0.001704s : 8.58% jit_opt_a.with_stream_mark : 0.000045s : 0.23% jit_opt_a.recompute_prepare : 0.000016s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.10% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.09% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.001285s : 6.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.13% jit_opt_a.cse : 0.000063s : 0.32% jit_opt_a.replace_applicator : 0.000021s : 0.11% py_interpret_to_execute_after_opt_a : 0.000016s : 0.08% rewriter_after_opt_a : 0.000042s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000806s : 4.06% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.09% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000030s : 0.15% loop_unroll : 0.000463s : 2.33% jit_opt_after_cconv.c_1 : 0.000021s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000042s : 0.21% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000055s : 0.28% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000019s : 0.09% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000501s : 2.52% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000050s : 0.25% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.24% Time group info: ------[substitution.] 0.000301 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 3: substitution.graph_param_transform 86.14% : 0.000259s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000005s : 2: substitution.replace_old_param 5.68% : 0.000017s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013483 2 89.38% : 0.012051s : 1: type_inference.infer 10.62% : 0.001432s : 1: type_inference.specialize ------[replace.] 0.000140 7 52.18% : 0.000073s : 5: replace.inline 47.82% : 0.000067s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000272 7 94.38% : 0.000256s : 5: match.inline 5.62% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 747 1.28% : 0.000002s : 11: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.05% : 0.000003s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000002s : 11: predicate.depend_value_elim 1.05% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 11: predicate.environ_get_depend_swap 1.37% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.24% : 0.000007s : 24: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.05% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 0.99% : 0.000001s : 11: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.99% : 0.000004s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 1.92% : 0.000003s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.79% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.39% : 0.000005s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 59: predicate.switch_simplify 1.12% : 0.000002s : 11: predicate.tile_eliminate 1.45% : 0.000002s : 11: predicate.transpose_eliminate 1.33% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.75% : 0.000005s : 22: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001113 16 45.11% : 0.000502s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.85% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 47.04% : 0.000524s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027800 72 0.21% : 0.000057s : 1: add_recomputation 0.28% : 0.000078s : 1: auto_monad 0.08% : 0.000021s : 1: auto_monad_reorder 1.08% : 0.000300s : 1: bootstrap 0.12% : 0.000033s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.10% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 27.97% : 0.007777s : 1: jit_opt_a 0.57% : 0.000160s : 1: jit_opt_after_cconv 0.21% : 0.000057s : 1: jit_opt_b 1.70% : 0.000471s : 1: loop_unroll 2.94% : 0.000816s : 1: mutable_eliminate 7.01% : 0.001950s : 26: opt.transform.jit_opt_a 0.18% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000019s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.28% : 0.000077s : 4: opt.transform.symbol_engine_opt 1.83% : 0.000510s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000062s : 1: py_interpret_to_execute 0.07% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.16% : 0.000044s : 1: remove_dup_value 2.54% : 0.000707s : 1: renormalize.infer 2.04% : 0.000567s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000046s : 1: rewriter_after_opt_a 0.34% : 0.000095s : 1: rewriter_before_opt_a 0.45% : 0.000124s : 1: symbol_engine_optimizer 48.85% : 0.013581s : 1: type_inference TotalTime = 0.381314, [30] [bootstrap]: 0.00029345 [type_inference]: 0.339333 [event_method]: 2.552e-05 [auto_monad]: 7.927e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 0.00062217 [rewriter_before_opt_a]: 0.00012725 [expand_dump_flag]: 4.60999e-06 [jit_opt_a]: 0.0382047, [2] [Cycle 1]: 0.0341329, [27] [switch_simplify]: 6.898e-05 [loop_unroll]: 3.57e-05 [a_1]: 0.0295274 [with_stream_mark]: 2.924e-05 [recompute_prepare]: 1.522e-05 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 8e-06 [updatestate_useless_node_eliminater]: 6.73998e-06 [accelerated_algorithm]: 9.15999e-06 [meta_shard_fg_expand]: 4.48999e-06 [get_grad_eliminate_]: 8.05e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.774e-05 [j_node_and_user_rematch]: 1.246e-05 [meta_fg_expand]: 3.91001e-06 [replace_old_param]: 1.325e-05 [inline_without_move]: 7.43999e-06 [renormalize]: 0.00400618 [add_forward_monad_depend]: 1.353e-05 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 2.026e-05 [cse]: 4.105e-05 [replace_applicator]: 1.805e-05 [Cycle 2]: 0.00040513, [27] [switch_simplify]: 7.3e-06 [loop_unroll]: 6.73998e-06 [a_1]: 0.00014212 [with_stream_mark]: 1.329e-05 [recompute_prepare]: 6.74001e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 7.56001e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 2.96999e-06 [cell_reuse_recompute_pass]: 2.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.351e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.91e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.423e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.709e-05 [rewriter_after_opt_a]: 4.355e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.00082859 [jit_opt_b]: 8.834e-05, [1] [Cycle 1]: 8.042e-05, [2] [frontend_op_eliminate]: 4.822e-05 [inline_after_opt_a]: 2.035e-05 [cconv]: 2.933e-05 [loop_unroll]: 0.00044937 [jit_opt_after_cconv]: 0.00016846, [1] [Cycle 1]: 0.00016189, [11] [c_1]: 2.745e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 6.33e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.49e-05 [call_graph_tuple_transform]: 2.482e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.68997e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 2.081e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 9.56e-06 [add_recomputation]: 5.811e-05 [cse_after_recomputation]: 2.665e-05, [1] [Cycle 1]: 1.984e-05, [1] [cse]: 1.38e-05 [auto_monad_reorder]: 1.78e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 7.45998e-06 [opt_after_jit_grad]: 0.0004649 [symbol_engine_optimizer]: 9.208e-05, [1] [Cycle 1]: 8.616e-05, [6] [build]: 4.21001e-06 [elim_shapecalc]: 9.30001e-06 [elim_not_effective]: 1.743e-05 [opt_reshape]: 7.92998e-06 [fold_const_symbol]: 1.327e-05 [renormalize]: 3.19997e-07 [validate]: 5.373e-05 Sums bootstrap : 0.000293s : 0.08% type_inference : 0.339333s : 90.02% event_method : 0.000026s : 0.01% auto_monad : 0.000079s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000622s : 0.17% rewriter_before_opt_a : 0.000127s : 0.03% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.029670s : 7.87% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000017s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004006s : 1.06% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000055s : 0.01% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.00% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000829s : 0.22% jit_opt_b.frontend_op_eliminate : 0.000048s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000449s : 0.12% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000018s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000465s : 0.12% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.01% Time group info: ------[substitution.] 0.028938 28 0.02% : 0.000005s : 2: substitution.elim_not_effective 0.00% : 0.000001s : 2: substitution.fold_const_symbol 0.02% : 0.000007s : 4: substitution.graph_param_transform 99.80% : 0.028880s : 5: substitution.inline 0.01% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.05% : 0.000015s : 3: substitution.reduce_eliminate 0.02% : 0.000006s : 4: substitution.remove_not_recompute_node 0.02% : 0.000006s : 2: substitution.replace_old_param 0.05% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.339239 2 98.84% : 0.335314s : 1: type_inference.infer 1.16% : 0.003925s : 1: type_inference.specialize ------[replace.] 0.000163 7 71.49% : 0.000117s : 5: replace.inline 28.51% : 0.000046s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.028884 7 99.95% : 0.028871s : 5: match.inline 0.05% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000003s : 13: predicate.addn_zero_filter 2.49% : 0.000004s : 13: predicate.arithmetic_simplify 1.56% : 0.000003s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.46% : 0.000003s : 13: predicate.depend_value_elim 1.00% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.47% : 0.000003s : 13: predicate.environ_get_eliminate 1.30% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 5.95% : 0.000010s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000003s : 8: predicate.less_batch_normalization 1.54% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000004s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.33% : 0.000004s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 1.68% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.50% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.52% : 0.000003s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 0.73% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.55% : 0.000006s : 20: predicate.switch_defer_inline 2.07% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.58% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.43% : 0.000002s : 13: predicate.transpose_eliminate 1.64% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.52% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002928 25 59.77% : 0.001750s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.74% : 0.000110s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.48% : 0.001068s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.415356 72 0.01% : 0.000061s : 1: add_recomputation 0.02% : 0.000082s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.07% : 0.000309s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 9.20% : 0.038209s : 1: jit_opt_a 0.05% : 0.000191s : 1: jit_opt_after_cconv 0.02% : 0.000091s : 1: jit_opt_b 0.11% : 0.000456s : 1: loop_unroll 0.20% : 0.000837s : 1: mutable_eliminate 7.21% : 0.029944s : 26: opt.transform.jit_opt_a 0.01% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000061s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.11% : 0.000471s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000629s : 1: py_interpret_to_execute 0.00% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 0.70% : 0.002920s : 1: renormalize.infer 0.26% : 0.001075s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.03% : 0.000134s : 1: rewriter_before_opt_a 0.02% : 0.000095s : 1: symbol_engine_optimizer 81.70% : 0.339355s : 1: type_inference TotalTime = 0.0294123, [30] [bootstrap]: 0.00029776 [type_inference]: 0.0207179 [event_method]: 2.062e-05 [auto_monad]: 5.787e-05 [graph_reusing]: 4.43001e-06 [pre_auto_parallel]: 2.01e-06 [py_interpret_to_execute]: 0.00013153 [rewriter_before_opt_a]: 7.711e-05 [expand_dump_flag]: 2.77002e-06 [jit_opt_a]: 0.00600988, [2] [Cycle 1]: 0.00233344, [27] [switch_simplify]: 5.75e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00057126 [with_stream_mark]: 2.115e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 9.04998e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.84999e-06 [renormalize]: 0.0013154 [add_forward_monad_depend]: 5.74999e-06 [auto_monad_grad]: 2.16998e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 3.64e-05 [replace_applicator]: 1.249e-05 [Cycle 2]: 0.00032042, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 5.36998e-06 [a_1]: 9.092e-05 [with_stream_mark]: 8.19002e-06 [recompute_prepare]: 5.21002e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 3.12002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.35e-05 [j_node_and_user_rematch]: 8.20999e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.36001e-06 [inline_without_move]: 5.02e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 9.49978e-07 [auto_monad_eliminator]: 5.44998e-06 [cse]: 1.254e-05 [replace_applicator]: 5.27999e-06 [py_interpret_to_execute_after_opt_a]: 1.099e-05 [rewriter_after_opt_a]: 4.027e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00051395 [jit_opt_b]: 4.873e-05, [1] [Cycle 1]: 4.178e-05, [2] [frontend_op_eliminate]: 1.551e-05 [inline_after_opt_a]: 1.584e-05 [cconv]: 2.609e-05 [loop_unroll]: 0.00041137 [jit_opt_after_cconv]: 0.00014176, [1] [Cycle 1]: 0.00013545, [11] [c_1]: 2.143e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.37999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.212e-05 [call_graph_tuple_transform]: 1.829e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.543e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 5.335e-05 [cse_after_recomputation]: 2.265e-05, [1] [Cycle 1]: 1.716e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 2.029e-05 [opt_after_jit_grad]: 0.00045334 [symbol_engine_optimizer]: 7.437e-05, [1] [Cycle 1]: 6.848e-05, [6] [build]: 4.58999e-06 [elim_shapecalc]: 8.10999e-06 [elim_not_effective]: 1.319e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 4.00003e-07 [validate]: 4.306e-05 Sums bootstrap : 0.000298s : 1.17% type_inference : 0.020718s : 81.30% event_method : 0.000021s : 0.08% auto_monad : 0.000058s : 0.23% graph_reusing : 0.000004s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000132s : 0.52% rewriter_before_opt_a : 0.000077s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000662s : 2.60% jit_opt_a.with_stream_mark : 0.000029s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001315s : 5.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000049s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000011s : 0.04% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000514s : 2.02% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000411s : 1.61% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.21% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000020s : 0.08% opt_after_jit_grad : 0.000453s : 1.78% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.17% Time group info: ------[substitution.] 0.000220 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000005s : 3: substitution.graph_param_transform 84.48% : 0.000185s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 6.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020645 2 90.10% : 0.018601s : 1: type_inference.infer 9.90% : 0.002044s : 1: type_inference.specialize ------[replace.] 0.000080 6 68.36% : 0.000054s : 4: replace.inline 31.64% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.69% : 0.000183s : 4: match.inline 6.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.54% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.89% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.06% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.48% : 0.000002s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.71% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.84% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001014 13 40.88% : 0.000414s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.12% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.00% : 0.000558s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031654 72 0.18% : 0.000056s : 1: add_recomputation 0.19% : 0.000062s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 0.99% : 0.000313s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000007s : 1: graph_reusing 19.00% : 0.006014s : 1: jit_opt_a 0.46% : 0.000144s : 1: jit_opt_after_cconv 0.16% : 0.000051s : 1: jit_opt_b 1.32% : 0.000419s : 1: loop_unroll 1.65% : 0.000523s : 1: mutable_eliminate 2.78% : 0.000879s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.46% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000136s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 2.49% : 0.000788s : 1: renormalize.infer 1.64% : 0.000518s : 1: renormalize.specialize 0.07% : 0.000023s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.26% : 0.000081s : 1: rewriter_before_opt_a 0.24% : 0.000077s : 1: symbol_engine_optimizer 65.49% : 0.020731s : 1: type_inference TotalTime = 0.310833, [30] [bootstrap]: 0.00031413 [type_inference]: 0.288567 [event_method]: 1.902e-05 [auto_monad]: 6.864e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00037724 [rewriter_before_opt_a]: 8.131e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.0193233, [2] [Cycle 1]: 0.00349112, [27] [switch_simplify]: 5.174e-05 [loop_unroll]: 2.97e-05 [a_1]: 0.00054284 [with_stream_mark]: 1.375e-05 [recompute_prepare]: 8.10999e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.88002e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.203e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.98002e-06 [renormalize]: 0.00254651 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.432e-05 [cse]: 1.832e-05 [replace_applicator]: 1.466e-05 [Cycle 2]: 0.00034981, [27] [switch_simplify]: 6.56e-06 [loop_unroll]: 5.69999e-06 [a_1]: 0.00011771 [with_stream_mark]: 1.01e-05 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 2.68003e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.327e-05 [j_node_and_user_rematch]: 8.76002e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 5.18002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.04e-05 [replace_applicator]: 5.58002e-06 [py_interpret_to_execute_after_opt_a]: 1.191e-05 [rewriter_after_opt_a]: 3.314e-05 [convert_after_rewriter]: 6.49999e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00055835 [jit_opt_b]: 5.189e-05, [1] [Cycle 1]: 4.462e-05, [2] [frontend_op_eliminate]: 1.773e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.185e-05 [loop_unroll]: 0.0004026 [jit_opt_after_cconv]: 0.00014114, [1] [Cycle 1]: 0.00013479, [11] [c_1]: 2.47e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 1.782e-05 [call_graph_tuple_transform]: 1.953e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 1.38002e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.66003e-06 [remove_dup_value]: 1.355e-05 [partial_unused_args_eliminate]: 1.86e-06 [environ_conv]: 7.49002e-06 [add_recomputation]: 3.849e-05 [cse_after_recomputation]: 2.133e-05, [1] [Cycle 1]: 1.574e-05, [1] [cse]: 1.014e-05 [auto_monad_reorder]: 1.437e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 3.91001e-06 [opt_after_jit_grad]: 0.00045272 [symbol_engine_optimizer]: 7.178e-05, [1] [Cycle 1]: 6.579e-05, [6] [build]: 2.83998e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 4.89992e-07 [validate]: 3.482e-05 Sums bootstrap : 0.000314s : 0.11% type_inference : 0.288567s : 97.89% event_method : 0.000019s : 0.01% auto_monad : 0.000069s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000377s : 0.13% rewriter_before_opt_a : 0.000081s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.02% jit_opt_a.loop_unroll : 0.000035s : 0.01% jit_opt_a.a_1 : 0.000661s : 0.22% jit_opt_a.with_stream_mark : 0.000024s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002547s : 0.86% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000029s : 0.01% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000033s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000558s : 0.19% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000016s : 0.01% cconv : 0.000022s : 0.01% loop_unroll : 0.000403s : 0.14% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000038s : 0.01% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000014s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000453s : 0.15% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.01% Time group info: ------[substitution.] 0.000187 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 3.19% : 0.000006s : 4: substitution.graph_param_transform 84.24% : 0.000157s : 4: substitution.inline 1.84% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000004s : 4: substitution.remove_not_recompute_node 1.70% : 0.000003s : 2: substitution.replace_old_param 5.11% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.288492 2 99.05% : 0.285740s : 1: type_inference.infer 0.95% : 0.002753s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.26% : 0.000049s : 4: replace.inline 32.74% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 94.81% : 0.000155s : 4: match.inline 5.19% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000002s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000001s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000006s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.89% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000001s : 12: predicate.print_const_string_wrapper 2.02% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000001s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.74% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000001s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002160 22 65.81% : 0.001422s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.51% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.68% : 0.000706s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.314330 72 0.01% : 0.000041s : 1: add_recomputation 0.02% : 0.000072s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.11% : 0.000334s : 1: bootstrap 0.01% : 0.000024s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 6.15% : 0.019327s : 1: jit_opt_a 0.05% : 0.000144s : 1: jit_opt_after_cconv 0.02% : 0.000054s : 1: jit_opt_b 0.13% : 0.000410s : 1: loop_unroll 0.18% : 0.000567s : 1: mutable_eliminate 0.28% : 0.000882s : 26: opt.transform.jit_opt_a 0.02% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000028s : 4: opt.transform.jit_opt_b 0.00% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000460s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.12% : 0.000383s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000016s : 1: remove_dup_value 0.59% : 0.001847s : 1: renormalize.infer 0.22% : 0.000692s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000036s : 1: rewriter_after_opt_a 0.03% : 0.000086s : 1: rewriter_before_opt_a 0.02% : 0.000074s : 1: symbol_engine_optimizer 91.81% : 0.288584s : 1: type_inference TotalTime = 0.0311444, [30] [bootstrap]: 0.00027121 [type_inference]: 0.0211123 [event_method]: 2.281e-05 [auto_monad]: 7.455e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00016473 [rewriter_before_opt_a]: 9.35e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00696181, [2] [Cycle 1]: 0.00231594, [27] [switch_simplify]: 6.733e-05 [loop_unroll]: 3.528e-05 [a_1]: 0.00065099 [with_stream_mark]: 2.569e-05 [recompute_prepare]: 8.80001e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.77002e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.685e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 5.70001e-06 [renormalize]: 0.00115721 [add_forward_monad_depend]: 5.89e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.818e-05 [cse]: 3.811e-05 [replace_applicator]: 1.615e-05 [Cycle 2]: 0.00035714, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.01e-06 [a_1]: 0.00010186 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.58003e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.78002e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.68002e-06 [get_grad_eliminate_]: 4.82998e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.44e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.61e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.00002e-06 [cse]: 1.393e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 4.468e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 5.63002e-06 [mutable_eliminate]: 0.00064997 [jit_opt_b]: 6.982e-05, [1] [Cycle 1]: 6.138e-05, [2] [frontend_op_eliminate]: 3.158e-05 [inline_after_opt_a]: 1.734e-05 [cconv]: 2.836e-05 [loop_unroll]: 0.00044848 [jit_opt_after_cconv]: 0.00015704, [1] [Cycle 1]: 0.00014992, [11] [c_1]: 2.358e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 6.81001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.587e-05 [call_graph_tuple_transform]: 1.912e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 6.37001e-06 [remove_dup_value]: 1.699e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 6.65998e-06 [add_recomputation]: 5.451e-05 [cse_after_recomputation]: 2.637e-05, [1] [Cycle 1]: 1.997e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00051771 [symbol_engine_optimizer]: 8.058e-05, [1] [Cycle 1]: 7.382e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.416e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 4.90021e-07 [validate]: 4.201e-05 Sums bootstrap : 0.000271s : 1.04% type_inference : 0.021112s : 80.66% event_method : 0.000023s : 0.09% auto_monad : 0.000075s : 0.28% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000165s : 0.63% rewriter_before_opt_a : 0.000094s : 0.36% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.28% jit_opt_a.loop_unroll : 0.000041s : 0.16% jit_opt_a.a_1 : 0.000753s : 2.88% jit_opt_a.with_stream_mark : 0.000039s : 0.15% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001157s : 4.42% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.10% jit_opt_a.cse : 0.000052s : 0.20% jit_opt_a.replace_applicator : 0.000022s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000045s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000650s : 2.48% jit_opt_b.frontend_op_eliminate : 0.000032s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000028s : 0.11% loop_unroll : 0.000448s : 1.71% jit_opt_after_cconv.c_1 : 0.000024s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000518s : 1.98% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.16% Time group info: ------[substitution.] 0.000267 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 3: substitution.graph_param_transform 85.83% : 0.000229s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000006s : 2: substitution.replace_old_param 5.09% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021024 2 91.66% : 0.019271s : 1: type_inference.infer 8.34% : 0.001753s : 1: type_inference.specialize ------[replace.] 0.000083 6 69.39% : 0.000057s : 4: replace.inline 30.61% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 6 94.82% : 0.000226s : 4: match.inline 5.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.29% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000003s : 10: predicate.arithmetic_simplify 1.50% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.48% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 10: predicate.merge_addn 1.17% : 0.000002s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000002s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 2.26% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.16% : 0.000011s : 53: predicate.switch_simplify 1.19% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000002s : 10: predicate.transpose_eliminate 1.33% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000934 13 41.30% : 0.000386s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.14% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.56% : 0.000491s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033373 72 0.17% : 0.000057s : 1: add_recomputation 0.24% : 0.000079s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.87% : 0.000290s : 1: bootstrap 0.09% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 20.97% : 0.007000s : 1: jit_opt_a 0.48% : 0.000160s : 1: jit_opt_after_cconv 0.22% : 0.000072s : 1: jit_opt_b 1.37% : 0.000457s : 1: loop_unroll 1.98% : 0.000660s : 1: mutable_eliminate 2.99% : 0.000998s : 26: opt.transform.jit_opt_a 0.15% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000042s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000527s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.51% : 0.000171s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.01% : 0.000671s : 1: renormalize.infer 1.43% : 0.000476s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000048s : 1: rewriter_after_opt_a 0.29% : 0.000098s : 1: rewriter_before_opt_a 0.25% : 0.000083s : 1: symbol_engine_optimizer 63.33% : 0.021136s : 1: type_inference TotalTime = 0.0302143, [30] [bootstrap]: 0.00028969 [type_inference]: 0.0216222 [event_method]: 1.994e-05 [auto_monad]: 6.829e-05 [graph_reusing]: 6.03002e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 0.00013346 [rewriter_before_opt_a]: 8.783e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.00571362, [2] [Cycle 1]: 0.00210639, [27] [switch_simplify]: 7.414e-05 [loop_unroll]: 3.138e-05 [a_1]: 0.00055805 [with_stream_mark]: 1.734e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.83998e-06 [updatestate_useless_node_eliminater]: 5.81003e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 2.60002e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00107576 [add_forward_monad_depend]: 5.99e-06 [auto_monad_grad]: 2.50002e-06 [auto_monad_eliminator]: 1.671e-05 [cse]: 3.527e-05 [replace_applicator]: 1.473e-05 [Cycle 2]: 0.00034286, [27] [switch_simplify]: 6.29001e-06 [loop_unroll]: 6.28e-06 [a_1]: 9.541e-05 [with_stream_mark]: 1.082e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 4.95999e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 2.08998e-06 [replace_old_param]: 7.28999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.73e-06 [cse]: 1.42e-05 [replace_applicator]: 5.72001e-06 [py_interpret_to_execute_after_opt_a]: 1.305e-05 [rewriter_after_opt_a]: 3.987e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00059396 [jit_opt_b]: 5.199e-05, [1] [Cycle 1]: 4.517e-05, [2] [frontend_op_eliminate]: 1.738e-05 [inline_after_opt_a]: 1.662e-05 [cconv]: 2.741e-05 [loop_unroll]: 0.00043771 [jit_opt_after_cconv]: 0.00015095, [1] [Cycle 1]: 0.00014431, [11] [c_1]: 2.282e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.381e-05 [call_graph_tuple_transform]: 2.014e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 6.71999e-06 [add_recomputation]: 4.881e-05 [cse_after_recomputation]: 2.51e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.23e-05 [auto_monad_reorder]: 1.664e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 4.80999e-06 [opt_after_jit_grad]: 0.00049874 [symbol_engine_optimizer]: 7.719e-05, [1] [Cycle 1]: 7.091e-05, [6] [build]: 4.28001e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 9.69e-06 [renormalize]: 4.39992e-07 [validate]: 4.015e-05 Sums bootstrap : 0.000290s : 1.10% type_inference : 0.021622s : 82.11% event_method : 0.000020s : 0.08% auto_monad : 0.000068s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000133s : 0.51% rewriter_before_opt_a : 0.000088s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000080s : 0.31% jit_opt_a.loop_unroll : 0.000038s : 0.14% jit_opt_a.a_1 : 0.000653s : 2.48% jit_opt_a.with_stream_mark : 0.000028s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001076s : 4.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000049s : 0.19% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000594s : 2.26% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000027s : 0.10% loop_unroll : 0.000438s : 1.66% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000049s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000017s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000499s : 1.89% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.15% Time group info: ------[substitution.] 0.000216 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000005s : 3: substitution.graph_param_transform 84.54% : 0.000183s : 4: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000003s : 2: substitution.replace_old_param 5.74% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021546 2 91.79% : 0.019777s : 1: type_inference.infer 8.21% : 0.001769s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.35% : 0.000051s : 4: replace.inline 32.65% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 94.18% : 0.000180s : 4: match.inline 5.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.29% : 0.000002s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 2.08% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.59% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.50% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000002s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000953 13 44.41% : 0.000423s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.61% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.97% : 0.000486s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032213 72 0.16% : 0.000051s : 1: add_recomputation 0.22% : 0.000072s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 0.96% : 0.000309s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.75% : 0.005717s : 1: jit_opt_a 0.48% : 0.000154s : 1: jit_opt_after_cconv 0.17% : 0.000054s : 1: jit_opt_b 1.38% : 0.000446s : 1: loop_unroll 1.87% : 0.000602s : 1: mutable_eliminate 2.73% : 0.000880s : 26: opt.transform.jit_opt_a 0.16% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000507s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000138s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.89% : 0.000609s : 1: renormalize.infer 1.42% : 0.000458s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000043s : 1: rewriter_after_opt_a 0.28% : 0.000091s : 1: rewriter_before_opt_a 0.25% : 0.000080s : 1: symbol_engine_optimizer 67.18% : 0.021640s : 1: type_inference TotalTime = 0.0304592, [30] [bootstrap]: 0.00032298 [type_inference]: 0.0217268 [event_method]: 2.199e-05 [auto_monad]: 6.958e-05 [graph_reusing]: 6.21998e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00013046 [rewriter_before_opt_a]: 9.081e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00577323, [2] [Cycle 1]: 0.0020416, [27] [switch_simplify]: 6.264e-05 [loop_unroll]: 3.096e-05 [a_1]: 0.00055581 [with_stream_mark]: 2.242e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 5.36002e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.30001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 0.00101745 [add_forward_monad_depend]: 6.33e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.543e-05 [cse]: 3.46e-05 [replace_applicator]: 1.547e-05 [Cycle 2]: 0.00034155, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 5.81e-06 [a_1]: 9.234e-05 [with_stream_mark]: 9.54999e-06 [recompute_prepare]: 5.71003e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 5.41002e-06 [merge_forward]: 3.49001e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.414e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 7.72998e-06 [inline_without_move]: 5.14e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.368e-05 [replace_applicator]: 5.53002e-06 [py_interpret_to_execute_after_opt_a]: 1.393e-05 [rewriter_after_opt_a]: 3.789e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00061684 [jit_opt_b]: 5.258e-05, [1] [Cycle 1]: 4.532e-05, [2] [frontend_op_eliminate]: 1.672e-05 [inline_after_opt_a]: 1.739e-05 [cconv]: 2.71e-05 [loop_unroll]: 0.00043764 [jit_opt_after_cconv]: 0.00015136, [1] [Cycle 1]: 0.00014527, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 2.94999e-06 [updatestate_depend_eliminate]: 6.58e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.616e-05 [call_graph_tuple_transform]: 2.108e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.622e-05 [partial_unused_args_eliminate]: 2.53998e-06 [environ_conv]: 5.82001e-06 [add_recomputation]: 5.212e-05 [cse_after_recomputation]: 2.334e-05, [1] [Cycle 1]: 1.732e-05, [1] [cse]: 1.113e-05 [auto_monad_reorder]: 1.769e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.28998e-06 [opt_after_jit_grad]: 0.00049743 [symbol_engine_optimizer]: 9.952e-05, [1] [Cycle 1]: 9.331e-05, [6] [build]: 4.54998e-06 [elim_shapecalc]: 9.02e-06 [elim_not_effective]: 1.636e-05 [opt_reshape]: 7.19001e-06 [fold_const_symbol]: 9.09998e-06 [renormalize]: 5.39992e-07 [validate]: 4.225e-05 Sums bootstrap : 0.000323s : 1.22% type_inference : 0.021727s : 82.20% event_method : 0.000022s : 0.08% auto_monad : 0.000070s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000130s : 0.49% rewriter_before_opt_a : 0.000091s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.26% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000648s : 2.45% jit_opt_a.with_stream_mark : 0.000032s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001018s : 3.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.08% jit_opt_a.cse : 0.000048s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000038s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000617s : 2.33% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000027s : 0.10% loop_unroll : 0.000438s : 1.66% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000497s : 1.88% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.16% Time group info: ------[substitution.] 0.000221 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000007s : 3: substitution.graph_param_transform 84.00% : 0.000185s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000005s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021648 2 92.04% : 0.019925s : 1: type_inference.infer 7.96% : 0.001722s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.88% : 0.000050s : 4: replace.inline 31.12% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.19% : 0.000183s : 4: match.inline 5.81% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.24% : 0.000006s : 22: predicate.inline 1.02% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.90% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.19% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.40% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000936 13 42.98% : 0.000402s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.98% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.04% : 0.000487s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032411 72 0.17% : 0.000055s : 1: add_recomputation 0.23% : 0.000073s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.06% : 0.000343s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.82% : 0.005777s : 1: jit_opt_a 0.47% : 0.000154s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.38% : 0.000446s : 1: loop_unroll 1.94% : 0.000628s : 1: mutable_eliminate 2.70% : 0.000876s : 26: opt.transform.jit_opt_a 0.16% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000038s : 4: opt.transform.symbol_engine_opt 1.56% : 0.000507s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000136s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.81% : 0.000586s : 1: renormalize.infer 1.31% : 0.000423s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.29% : 0.000095s : 1: rewriter_before_opt_a 0.32% : 0.000103s : 1: symbol_engine_optimizer 67.10% : 0.021748s : 1: type_inference TotalTime = 0.0118942, [30] [bootstrap]: 0.00031256 [type_inference]: 0.0044686 [event_method]: 1.697e-05 [auto_monad]: 6.728e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 3.397e-05 [rewriter_before_opt_a]: 7.403e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0048906, [2] [Cycle 1]: 0.00144809, [27] [switch_simplify]: 5.578e-05 [loop_unroll]: 3.011e-05 [a_1]: 0.00050142 [with_stream_mark]: 1.63e-05 [recompute_prepare]: 7.45003e-06 [updatestate_depend_eliminate]: 4.18999e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.414e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00052147 [add_forward_monad_depend]: 5.09998e-06 [auto_monad_grad]: 2.20002e-06 [auto_monad_eliminator]: 1.353e-05 [cse]: 3.367e-05 [replace_applicator]: 1.098e-05 [Cycle 2]: 0.00031145, [27] [switch_simplify]: 5.62001e-06 [loop_unroll]: 5.20001e-06 [a_1]: 8.683e-05 [with_stream_mark]: 8.62998e-06 [recompute_prepare]: 4.83001e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.239e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.65999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.23002e-06 [cse]: 1.263e-05 [replace_applicator]: 4.95999e-06 [py_interpret_to_execute_after_opt_a]: 1.096e-05 [rewriter_after_opt_a]: 4.103e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.26002e-06 [mutable_eliminate]: 0.00046449 [jit_opt_b]: 4.726e-05, [1] [Cycle 1]: 4.038e-05, [2] [frontend_op_eliminate]: 1.516e-05 [inline_after_opt_a]: 1.478e-05 [cconv]: 2.409e-05 [loop_unroll]: 0.00039473 [jit_opt_after_cconv]: 0.0001475, [1] [Cycle 1]: 0.00013464, [11] [c_1]: 1.97e-05 [parameter_eliminate]: 2.38998e-06 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.037e-05 [call_graph_tuple_transform]: 1.867e-05 [tuple_list_get_item_eliminator]: 5.83002e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 1.626e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 5.49e-06 [add_recomputation]: 7.295e-05 [cse_after_recomputation]: 2.721e-05, [1] [Cycle 1]: 2.114e-05, [1] [cse]: 1.408e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 4.54998e-06 [opt_after_jit_grad]: 0.00045021 [symbol_engine_optimizer]: 7.165e-05, [1] [Cycle 1]: 6.581e-05, [6] [build]: 4.08999e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 5.49e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.30008e-07 [validate]: 4.319e-05 Sums bootstrap : 0.000313s : 3.81% type_inference : 0.004469s : 54.51% event_method : 0.000017s : 0.21% auto_monad : 0.000067s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.41% rewriter_before_opt_a : 0.000074s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000061s : 0.75% jit_opt_a.loop_unroll : 0.000035s : 0.43% jit_opt_a.a_1 : 0.000588s : 7.18% jit_opt_a.with_stream_mark : 0.000025s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000522s : 6.36% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000046s : 0.56% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000041s : 0.50% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000464s : 5.67% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000024s : 0.29% loop_unroll : 0.000395s : 4.82% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000016s : 0.20% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000073s : 0.89% cse_after_recomputation.cse : 0.000014s : 0.17% auto_monad_reorder : 0.000018s : 0.22% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000450s : 5.49% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.53% Time group info: ------[substitution.] 0.000181 23 1.23% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000006s : 3: substitution.graph_param_transform 82.38% : 0.000149s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000003s : 2: substitution.replace_old_param 6.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004410 2 82.39% : 0.003633s : 1: type_inference.infer 17.61% : 0.000776s : 1: type_inference.specialize ------[replace.] 0.000063 6 65.12% : 0.000041s : 4: replace.inline 34.88% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.07% : 0.000147s : 4: match.inline 6.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.31% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.33% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.10% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000586 13 55.18% : 0.000323s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.36% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.47% : 0.000231s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013261 72 0.58% : 0.000077s : 1: add_recomputation 0.53% : 0.000070s : 1: auto_monad 0.15% : 0.000020s : 1: auto_monad_reorder 2.50% : 0.000332s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.22% : 0.000029s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.90% : 0.004893s : 1: jit_opt_a 1.13% : 0.000150s : 1: jit_opt_after_cconv 0.37% : 0.000050s : 1: jit_opt_b 3.03% : 0.000402s : 1: loop_unroll 3.56% : 0.000472s : 1: mutable_eliminate 6.01% : 0.000797s : 26: opt.transform.jit_opt_a 0.35% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.46% : 0.000459s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000037s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000019s : 1: remove_dup_value 1.99% : 0.000264s : 1: renormalize.infer 1.89% : 0.000250s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.33% : 0.000044s : 1: rewriter_after_opt_a 0.58% : 0.000077s : 1: rewriter_before_opt_a 0.56% : 0.000074s : 1: symbol_engine_optimizer 33.78% : 0.004480s : 1: type_inference TotalTime = 0.0311971, [30] [bootstrap]: 0.00031422 [type_inference]: 0.0223486 [event_method]: 2.016e-05 [auto_monad]: 6.899e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.00014231 [rewriter_before_opt_a]: 8.132e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00605452, [2] [Cycle 1]: 0.00232851, [27] [switch_simplify]: 5.452e-05 [loop_unroll]: 3.045e-05 [a_1]: 0.0005689 [with_stream_mark]: 1.803e-05 [recompute_prepare]: 7.45998e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 4.62998e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00133251 [add_forward_monad_depend]: 6.09999e-06 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 2.31e-05 [replace_applicator]: 1.189e-05 [Cycle 2]: 0.00032595, [27] [switch_simplify]: 6.38998e-06 [loop_unroll]: 5.03002e-06 [a_1]: 9.352e-05 [with_stream_mark]: 9.52001e-06 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.51002e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.48e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 8.02e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.309e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.294e-05 [rewriter_after_opt_a]: 3.413e-05 [convert_after_rewriter]: 7.49002e-06 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.0005552 [jit_opt_b]: 5.08e-05, [1] [Cycle 1]: 4.382e-05, [2] [frontend_op_eliminate]: 1.627e-05 [inline_after_opt_a]: 1.647e-05 [cconv]: 2.631e-05 [loop_unroll]: 0.00041678 [jit_opt_after_cconv]: 0.00014288, [1] [Cycle 1]: 0.00013628, [11] [c_1]: 2.131e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.203e-05 [call_graph_tuple_transform]: 1.929e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.32999e-06 [remove_dup_value]: 1.575e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 5.71998e-06 [add_recomputation]: 5.211e-05 [cse_after_recomputation]: 2.185e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.123e-05 [auto_monad_reorder]: 1.768e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00045898 [symbol_engine_optimizer]: 9.983e-05, [1] [Cycle 1]: 9.357e-05, [6] [build]: 3.86001e-06 [elim_shapecalc]: 3.122e-05 [elim_not_effective]: 1.408e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 3.60014e-07 [validate]: 3.892e-05 Sums bootstrap : 0.000314s : 1.15% type_inference : 0.022349s : 82.13% event_method : 0.000020s : 0.07% auto_monad : 0.000069s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000142s : 0.52% rewriter_before_opt_a : 0.000081s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.22% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000662s : 2.43% jit_opt_a.with_stream_mark : 0.000028s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001333s : 4.90% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000036s : 0.13% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000034s : 0.13% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000555s : 2.04% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000417s : 1.53% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000459s : 1.69% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000031s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.14% Time group info: ------[substitution.] 0.000224 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000005s : 3: substitution.graph_param_transform 85.58% : 0.000192s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 1.44% : 0.000003s : 2: substitution.replace_old_param 5.61% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022277 2 90.27% : 0.020111s : 1: type_inference.infer 9.73% : 0.002167s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.46% : 0.000053s : 4: replace.inline 33.54% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.31% : 0.000189s : 4: match.inline 5.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.59% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.81% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.47% : 0.000002s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001097 13 43.22% : 0.000474s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.20% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.58% : 0.000577s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033482 72 0.16% : 0.000055s : 1: add_recomputation 0.22% : 0.000073s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.01% : 0.000339s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.09% : 0.006058s : 1: jit_opt_a 0.43% : 0.000146s : 1: jit_opt_after_cconv 0.16% : 0.000053s : 1: jit_opt_b 1.27% : 0.000425s : 1: loop_unroll 1.68% : 0.000564s : 1: mutable_eliminate 2.62% : 0.000876s : 26: opt.transform.jit_opt_a 0.14% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000057s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000467s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000147s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 2.34% : 0.000784s : 1: renormalize.infer 1.61% : 0.000539s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000037s : 1: rewriter_after_opt_a 0.25% : 0.000085s : 1: rewriter_before_opt_a 0.31% : 0.000102s : 1: symbol_engine_optimizer 66.79% : 0.022363s : 1: type_inference TotalTime = 0.240809, [30] [bootstrap]: 0.00026 [type_inference]: 0.227193 [event_method]: 2.315e-05 [auto_monad]: 6.911e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 0.00041505 [rewriter_before_opt_a]: 9.674e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.0104964, [2] [Cycle 1]: 0.00454255, [27] [switch_simplify]: 6.064e-05 [loop_unroll]: 3.478e-05 [a_1]: 0.00067684 [with_stream_mark]: 1.682e-05 [recompute_prepare]: 8.31002e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.56999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.615e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 6.33998e-06 [renormalize]: 0.00338078 [add_forward_monad_depend]: 5.98998e-06 [auto_monad_grad]: 1.002e-05 [auto_monad_eliminator]: 1.728e-05 [cse]: 3.801e-05 [replace_applicator]: 1.743e-05 [Cycle 2]: 0.00039787, [27] [switch_simplify]: 7.58001e-06 [loop_unroll]: 6.03002e-06 [a_1]: 0.00012152 [with_stream_mark]: 1.085e-05 [recompute_prepare]: 1.249e-05 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.73998e-06 [inline_without_move]: 6.16e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 7.03e-06 [cse]: 1.499e-05 [replace_applicator]: 6.91001e-06 [py_interpret_to_execute_after_opt_a]: 1.459e-05 [rewriter_after_opt_a]: 4.023e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00058165 [jit_opt_b]: 5.446e-05, [1] [Cycle 1]: 4.715e-05, [2] [frontend_op_eliminate]: 1.867e-05 [inline_after_opt_a]: 1.759e-05 [cconv]: 2.567e-05 [loop_unroll]: 0.00041605 [jit_opt_after_cconv]: 0.00015515, [1] [Cycle 1]: 0.00014831, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 6.17001e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.283e-05 [call_graph_tuple_transform]: 2.174e-05 [tuple_list_get_item_eliminator]: 6.90002e-06 [none_parameter_eliminate]: 1.96e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 6.50002e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 8.27003e-06 [add_recomputation]: 4.753e-05 [cse_after_recomputation]: 2.445e-05, [1] [Cycle 1]: 1.905e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.975e-05 [get_jit_bprop_graph]: 1.52001e-06 [rewriter_after_jit_bprop_graph]: 4.99e-06 [opt_after_jit_grad]: 0.00046528 [symbol_engine_optimizer]: 7.747e-05, [1] [Cycle 1]: 7.075e-05, [6] [build]: 3.03998e-06 [elim_shapecalc]: 8.76002e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 7.52002e-06 [fold_const_symbol]: 9.91998e-06 [renormalize]: 4.30009e-07 [validate]: 8.782e-05 Sums bootstrap : 0.000260s : 0.11% type_inference : 0.227193s : 96.82% event_method : 0.000023s : 0.01% auto_monad : 0.000069s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000415s : 0.18% rewriter_before_opt_a : 0.000097s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000798s : 0.34% jit_opt_a.with_stream_mark : 0.000028s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003381s : 1.44% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000011s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000053s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000582s : 0.25% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000416s : 0.18% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000048s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000465s : 0.20% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000088s : 0.04% Time group info: ------[substitution.] 0.000255 25 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 4: substitution.graph_param_transform 85.87% : 0.000219s : 5: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000006s : 4: substitution.remove_not_recompute_node 1.87% : 0.000005s : 2: substitution.replace_old_param 4.95% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.227117 2 98.71% : 0.224194s : 1: type_inference.infer 1.29% : 0.002923s : 1: type_inference.specialize ------[replace.] 0.000096 7 69.72% : 0.000067s : 5: replace.inline 30.28% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 94.97% : 0.000216s : 5: match.inline 5.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.63% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 28: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.78% : 0.000002s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 20: predicate.switch_defer_inline 2.23% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.73% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002474 25 66.63% : 0.001648s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.02% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.35% : 0.000751s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.245271 72 0.02% : 0.000050s : 1: add_recomputation 0.03% : 0.000072s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.11% : 0.000279s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.28% : 0.010500s : 1: jit_opt_a 0.06% : 0.000158s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.17% : 0.000424s : 1: loop_unroll 0.24% : 0.000590s : 1: mutable_eliminate 0.43% : 0.001061s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000473s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000421s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.07% : 0.002626s : 1: renormalize.infer 0.30% : 0.000745s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000102s : 1: rewriter_before_opt_a 0.03% : 0.000080s : 1: symbol_engine_optimizer 92.64% : 0.227212s : 1: type_inference TotalTime = 0.0341215, [30] [bootstrap]: 0.00030554 [type_inference]: 0.0220383 [event_method]: 2.58e-05 [auto_monad]: 7.531e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.65997e-06 [py_interpret_to_execute]: 0.00017493 [rewriter_before_opt_a]: 9.274e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00879592, [2] [Cycle 1]: 0.00409544, [27] [switch_simplify]: 6.684e-05 [loop_unroll]: 3.277e-05 [a_1]: 0.00062035 [with_stream_mark]: 2.587e-05 [recompute_prepare]: 7.8e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.6e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 3.04999e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 6.89999e-06 [renormalize]: 0.00128243 [add_forward_monad_depend]: 9.49e-06 [auto_monad_grad]: 3.13998e-06 [auto_monad_eliminator]: 0.00160938 [cse]: 5.801e-05 [replace_applicator]: 3.172e-05 [Cycle 2]: 0.00040915, [27] [switch_simplify]: 8.38001e-06 [loop_unroll]: 6.55997e-06 [a_1]: 0.00011038 [with_stream_mark]: 2.336e-05 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 5.59998e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 6.92002e-06 [meta_shard_fg_expand]: 3.22002e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 3.41001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.068e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.78003e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 5.56e-06 [renormalize]: 1.8999e-07 [add_forward_monad_depend]: 3.68e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 9.12001e-06 [cse]: 1.4e-05 [replace_applicator]: 6.00002e-06 [py_interpret_to_execute_after_opt_a]: 2.146e-05 [rewriter_after_opt_a]: 4.549e-05 [convert_after_rewriter]: 1.356e-05 [order_py_execute_after_rewriter]: 5.87001e-06 [mutable_eliminate]: 0.00081251 [jit_opt_b]: 5.477e-05, [1] [Cycle 1]: 4.702e-05, [2] [frontend_op_eliminate]: 1.788e-05 [inline_after_opt_a]: 1.702e-05 [cconv]: 3.481e-05 [loop_unroll]: 0.00044261 [jit_opt_after_cconv]: 0.00015571, [1] [Cycle 1]: 0.00014943, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 3.45e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 2.742e-05 [call_graph_tuple_transform]: 2.065e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.799e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 6.11998e-06 [add_recomputation]: 5.622e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.214e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 6.28e-06 [opt_after_jit_grad]: 0.00047826 [symbol_engine_optimizer]: 0.00015789, [1] [Cycle 1]: 0.00015141, [6] [build]: 4.75001e-06 [elim_shapecalc]: 8.448e-05 [elim_not_effective]: 1.518e-05 [opt_reshape]: 6.82002e-06 [fold_const_symbol]: 9.52999e-06 [renormalize]: 3.59985e-07 [validate]: 4.499e-05 Sums bootstrap : 0.000306s : 1.05% type_inference : 0.022038s : 75.66% event_method : 0.000026s : 0.09% auto_monad : 0.000075s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000175s : 0.60% rewriter_before_opt_a : 0.000093s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.26% jit_opt_a.loop_unroll : 0.000039s : 0.14% jit_opt_a.a_1 : 0.000731s : 2.51% jit_opt_a.with_stream_mark : 0.000049s : 0.17% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001283s : 4.40% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.05% jit_opt_a.auto_monad_grad : 0.000006s : 0.02% jit_opt_a.auto_monad_eliminator : 0.001619s : 5.56% jit_opt_a.cse : 0.000072s : 0.25% jit_opt_a.replace_applicator : 0.000038s : 0.13% py_interpret_to_execute_after_opt_a : 0.000021s : 0.07% rewriter_after_opt_a : 0.000045s : 0.16% convert_after_rewriter : 0.000014s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000813s : 2.79% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000035s : 0.12% loop_unroll : 0.000443s : 1.52% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000056s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000478s : 1.64% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000084s : 0.29% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.15% Time group info: ------[substitution.] 0.000261 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 84.72% : 0.000221s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 2.59% : 0.000007s : 2: substitution.replace_old_param 5.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021944 2 91.03% : 0.019976s : 1: type_inference.infer 8.97% : 0.001968s : 1: type_inference.specialize ------[replace.] 0.000084 6 68.15% : 0.000057s : 4: replace.inline 31.85% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.77% : 0.000219s : 4: match.inline 5.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 2.29% : 0.000003s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.72% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.35% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.43% : 0.000002s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.43% : 0.000007s : 22: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.31% : 0.000002s : 10: predicate.minmaximum_grad 1.96% : 0.000003s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000002s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.56% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 2.10% : 0.000003s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 1.93% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.91% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000002s : 10: predicate.transpose_eliminate 1.65% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.04% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.50% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.97% : 0.000003s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000992 13 38.87% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.57% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.56% : 0.000551s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036530 72 0.16% : 0.000059s : 1: add_recomputation 0.22% : 0.000079s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.89% : 0.000324s : 1: bootstrap 0.10% : 0.000037s : 1: cconv 0.04% : 0.000016s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000031s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 24.09% : 0.008800s : 1: jit_opt_a 0.43% : 0.000159s : 1: jit_opt_after_cconv 0.16% : 0.000058s : 1: jit_opt_b 1.24% : 0.000452s : 1: loop_unroll 2.25% : 0.000823s : 1: mutable_eliminate 2.73% : 0.000997s : 26: opt.transform.jit_opt_a 0.14% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.31% : 0.000112s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000487s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.49% : 0.000179s : 1: py_interpret_to_execute 0.07% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.96% : 0.000716s : 1: renormalize.infer 1.52% : 0.000554s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000048s : 1: rewriter_after_opt_a 0.27% : 0.000097s : 1: rewriter_before_opt_a 0.44% : 0.000161s : 1: symbol_engine_optimizer 60.39% : 0.022062s : 1: type_inference TotalTime = 0.0313419, [30] [bootstrap]: 0.00036898 [type_inference]: 0.021884 [event_method]: 2.242e-05 [auto_monad]: 7.487e-05 [graph_reusing]: 5.73002e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.00012458 [rewriter_before_opt_a]: 8.868e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00626658, [2] [Cycle 1]: 0.00222186, [27] [switch_simplify]: 5.999e-05 [loop_unroll]: 3.106e-05 [a_1]: 0.00060509 [with_stream_mark]: 2.307e-05 [recompute_prepare]: 1.001e-05 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.73001e-06 [updatestate_loads_eliminate]: 3.48e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.58998e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 5.86998e-06 [renormalize]: 0.00112153 [add_forward_monad_depend]: 7.65998e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.741e-05 [cse]: 3.868e-05 [replace_applicator]: 1.72e-05 [Cycle 2]: 0.00034807, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.69999e-06 [a_1]: 9.45e-05 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 5.45001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.71998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.58e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 8.43001e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 7.35e-06 [cse]: 1.431e-05 [replace_applicator]: 6.22001e-06 [py_interpret_to_execute_after_opt_a]: 1.656e-05 [rewriter_after_opt_a]: 4.07e-05 [convert_after_rewriter]: 7.92e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00077205 [jit_opt_b]: 5.385e-05, [1] [Cycle 1]: 4.58e-05, [2] [frontend_op_eliminate]: 1.719e-05 [inline_after_opt_a]: 1.702e-05 [cconv]: 3.144e-05 [loop_unroll]: 0.0004555 [jit_opt_after_cconv]: 0.00016372, [1] [Cycle 1]: 0.00015749, [11] [c_1]: 2.176e-05 [parameter_eliminate]: 3.6e-06 [updatestate_depend_eliminate]: 8.40999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 3.114e-05 [call_graph_tuple_transform]: 2.246e-05 [tuple_list_get_item_eliminator]: 5.73002e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.99975e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 1.627e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 7.13e-06 [add_recomputation]: 5.519e-05 [cse_after_recomputation]: 2.242e-05, [1] [Cycle 1]: 1.767e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 6.90002e-06 [opt_after_jit_grad]: 0.00048531 [symbol_engine_optimizer]: 7.783e-05, [1] [Cycle 1]: 7.064e-05, [6] [build]: 4.92999e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 5.10016e-07 [validate]: 4.491e-05 Sums bootstrap : 0.000369s : 1.37% type_inference : 0.021884s : 81.06% event_method : 0.000022s : 0.08% auto_monad : 0.000075s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000125s : 0.46% rewriter_before_opt_a : 0.000089s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.25% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000700s : 2.59% jit_opt_a.with_stream_mark : 0.000036s : 0.13% jit_opt_a.recompute_prepare : 0.000015s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001122s : 4.15% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.09% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000023s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.06% rewriter_after_opt_a : 0.000041s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000772s : 2.86% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000031s : 0.12% loop_unroll : 0.000456s : 1.69% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000485s : 1.80% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.17% Time group info: ------[substitution.] 0.000257 23 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000007s : 3: substitution.graph_param_transform 84.74% : 0.000218s : 4: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 2.38% : 0.000006s : 2: substitution.replace_old_param 5.33% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021795 2 91.41% : 0.019923s : 1: type_inference.infer 8.59% : 0.001872s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.82% : 0.000054s : 4: replace.inline 32.18% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.53% : 0.000215s : 4: match.inline 5.47% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.28% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000002s : 10: predicate.addn_zero_filter 1.67% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.74% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.41% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.64% : 0.000002s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.59% : 0.000001s : 3: predicate.graph_param_transform 5.67% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.57% : 0.000003s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 2.05% : 0.000003s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.71% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000944 13 41.97% : 0.000396s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.01% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.03% : 0.000491s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033442 72 0.18% : 0.000059s : 1: add_recomputation 0.24% : 0.000079s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.17% : 0.000390s : 1: bootstrap 0.10% : 0.000034s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 18.75% : 0.006270s : 1: jit_opt_a 0.50% : 0.000166s : 1: jit_opt_after_cconv 0.17% : 0.000057s : 1: jit_opt_b 1.39% : 0.000464s : 1: loop_unroll 2.34% : 0.000784s : 1: mutable_eliminate 2.80% : 0.000936s : 26: opt.transform.jit_opt_a 0.16% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.48% : 0.000495s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000129s : 1: py_interpret_to_execute 0.06% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.92% : 0.000644s : 1: renormalize.infer 1.40% : 0.000468s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.28% : 0.000092s : 1: rewriter_before_opt_a 0.24% : 0.000081s : 1: symbol_engine_optimizer 65.50% : 0.021906s : 1: type_inference TotalTime = 0.0580424, [30] [bootstrap]: 0.00033421 [type_inference]: 0.0477597 [event_method]: 2.301e-05 [auto_monad]: 7.201e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 0.00016045 [rewriter_before_opt_a]: 9.125e-05 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.00634348, [2] [Cycle 1]: 0.00231949, [27] [switch_simplify]: 5.938e-05 [loop_unroll]: 3.139e-05 [a_1]: 0.0005596 [with_stream_mark]: 2.024e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.58002e-06 [renormalize]: 0.00130308 [add_forward_monad_depend]: 5.71e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.63e-05 [cse]: 3.594e-05 [replace_applicator]: 1.299e-05 [Cycle 2]: 0.00033036, [27] [switch_simplify]: 6.60002e-06 [loop_unroll]: 5.58997e-06 [a_1]: 9.426e-05 [with_stream_mark]: 1.057e-05 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 3.14001e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.378e-05 [j_node_and_user_rematch]: 7.95e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 7.49002e-06 [inline_without_move]: 5.05001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.394e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.199e-05 [rewriter_after_opt_a]: 3.997e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00055724 [jit_opt_b]: 5.049e-05, [1] [Cycle 1]: 4.342e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.683e-05 [loop_unroll]: 0.00042079 [jit_opt_after_cconv]: 0.00014736, [1] [Cycle 1]: 0.00014116, [11] [c_1]: 2.175e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.51002e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.243e-05 [call_graph_tuple_transform]: 2.039e-05 [tuple_list_get_item_eliminator]: 5.87001e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.69999e-06 [remove_dup_value]: 1.644e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 5.412e-05 [cse_after_recomputation]: 2.257e-05, [1] [Cycle 1]: 1.699e-05, [1] [cse]: 1.124e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00045173 [symbol_engine_optimizer]: 0.00114827, [1] [Cycle 1]: 0.00114053, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.33999e-06 [elim_not_effective]: 4.481e-05 [opt_reshape]: 6.38003e-06 [fold_const_symbol]: 2.987e-05 [renormalize]: 1.82001e-06 [validate]: 4.946e-05 Sums bootstrap : 0.000334s : 0.63% type_inference : 0.047760s : 90.59% event_method : 0.000023s : 0.04% auto_monad : 0.000072s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000160s : 0.30% rewriter_before_opt_a : 0.000091s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.13% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000654s : 1.24% jit_opt_a.with_stream_mark : 0.000031s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001303s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000050s : 0.09% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000040s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000557s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000421s : 0.80% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000054s : 0.10% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000452s : 0.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000045s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000030s : 0.06% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000049s : 0.09% Time group info: ------[substitution.] 0.000208 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.95% : 0.000002s : 2: substitution.fold_const_symbol 3.12% : 0.000006s : 3: substitution.graph_param_transform 83.30% : 0.000173s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000004s : 4: substitution.remove_not_recompute_node 1.75% : 0.000004s : 2: substitution.replace_old_param 6.38% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047664 2 94.68% : 0.045128s : 1: type_inference.infer 5.32% : 0.002536s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.43% : 0.000053s : 4: replace.inline 31.57% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.32% : 0.000170s : 4: match.inline 6.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.63% : 0.000001s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.83% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.05% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001131 13 40.57% : 0.000459s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.65% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.78% : 0.000642s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060302 72 0.09% : 0.000057s : 1: add_recomputation 0.13% : 0.000076s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.59% : 0.000357s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 10.53% : 0.006348s : 1: jit_opt_a 0.25% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 0.71% : 0.000429s : 1: loop_unroll 0.94% : 0.000566s : 1: mutable_eliminate 1.45% : 0.000876s : 26: opt.transform.jit_opt_a 0.08% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000082s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000165s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.26% : 0.000759s : 1: renormalize.infer 0.89% : 0.000535s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000043s : 1: rewriter_after_opt_a 0.16% : 0.000095s : 1: rewriter_before_opt_a 1.91% : 0.001152s : 1: symbol_engine_optimizer 79.23% : 0.047779s : 1: type_inference TotalTime = 0.330162, [30] [bootstrap]: 0.00040322 [type_inference]: 0.285393 [event_method]: 2.539e-05 [auto_monad]: 8.878e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.00074132 [rewriter_before_opt_a]: 0.00010941 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.0403473, [2] [Cycle 1]: 0.034984, [27] [switch_simplify]: 7.83e-05 [loop_unroll]: 3.633e-05 [a_1]: 0.00086989 [with_stream_mark]: 2.551e-05 [recompute_prepare]: 9.66e-06 [updatestate_depend_eliminate]: 4.59998e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 2.54001e-06 [specialize_transform]: 7.95998e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 7.36999e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.998e-05 [j_node_and_user_rematch]: 1.359e-05 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 1.368e-05 [inline_without_move]: 7.13e-06 [renormalize]: 0.0334947 [add_forward_monad_depend]: 1.265e-05 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 2.705e-05 [cse]: 4.306e-05 [replace_applicator]: 3.045e-05 [Cycle 2]: 0.00049591, [27] [switch_simplify]: 8.47998e-06 [loop_unroll]: 8.33001e-06 [a_1]: 0.00016381 [with_stream_mark]: 1.83e-05 [recompute_prepare]: 8.13001e-06 [updatestate_depend_eliminate]: 4.24997e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 3.66999e-06 [parameter_eliminate]: 2.83e-06 [specialize_transform]: 6.70002e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 7.97e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 5.79e-06 [cell_reuse_recompute_pass]: 4.43001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.985e-05 [j_node_and_user_rematch]: 1.235e-05 [meta_fg_expand]: 3.80998e-06 [replace_old_param]: 1.207e-05 [inline_without_move]: 7.25e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.57001e-06 [auto_monad_grad]: 1.15001e-06 [auto_monad_eliminator]: 1.143e-05 [cse]: 2.058e-05 [replace_applicator]: 9.49e-06 [py_interpret_to_execute_after_opt_a]: 2.179e-05 [rewriter_after_opt_a]: 5.401e-05 [convert_after_rewriter]: 8e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.000929 [jit_opt_b]: 6.933e-05, [1] [Cycle 1]: 5.97e-05, [2] [frontend_op_eliminate]: 2.42e-05 [inline_after_opt_a]: 2.088e-05 [cconv]: 3.673e-05 [loop_unroll]: 0.00054771 [jit_opt_after_cconv]: 0.00019529, [1] [Cycle 1]: 0.00018658, [11] [c_1]: 3.153e-05 [parameter_eliminate]: 4.60001e-06 [updatestate_depend_eliminate]: 9.86998e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 3.672e-05 [call_graph_tuple_transform]: 2.855e-05 [tuple_list_get_item_eliminator]: 7.08998e-06 [none_parameter_eliminate]: 1.93002e-06 [renormalize]: 7.59988e-07 [switch_simplify]: 7.03998e-06 [remove_dup_value]: 1.706e-05 [partial_unused_args_eliminate]: 2.85002e-06 [environ_conv]: 1.042e-05 [add_recomputation]: 6.672e-05 [cse_after_recomputation]: 2.779e-05, [1] [Cycle 1]: 2.167e-05, [1] [cse]: 1.554e-05 [auto_monad_reorder]: 1.938e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 7.83999e-06 [opt_after_jit_grad]: 0.00057257 [symbol_engine_optimizer]: 0.00014635, [1] [Cycle 1]: 8.104e-05, [6] [build]: 4.4e-06 [elim_shapecalc]: 9.49e-06 [elim_not_effective]: 1.644e-05 [opt_reshape]: 8.08999e-06 [fold_const_symbol]: 1.036e-05 [renormalize]: 4.69998e-07 [validate]: 5.999e-05 Sums bootstrap : 0.000403s : 0.12% type_inference : 0.285393s : 87.95% event_method : 0.000025s : 0.01% auto_monad : 0.000089s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000741s : 0.23% rewriter_before_opt_a : 0.000109s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.03% jit_opt_a.loop_unroll : 0.000045s : 0.01% jit_opt_a.a_1 : 0.001034s : 0.32% jit_opt_a.with_stream_mark : 0.000044s : 0.01% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.033495s : 10.32% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.01% jit_opt_a.cse : 0.000064s : 0.02% jit_opt_a.replace_applicator : 0.000040s : 0.01% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000054s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000929s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000037s : 0.01% loop_unroll : 0.000548s : 0.17% jit_opt_after_cconv.c_1 : 0.000032s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000067s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000573s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.02% Time group info: ------[substitution.] 0.000378 28 0.54% : 0.000002s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.88% : 0.000007s : 4: substitution.graph_param_transform 84.02% : 0.000318s : 5: substitution.inline 1.39% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.54% : 0.000017s : 3: substitution.reduce_eliminate 1.76% : 0.000007s : 4: substitution.remove_not_recompute_node 2.13% : 0.000008s : 2: substitution.replace_old_param 3.38% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.285281 2 93.91% : 0.267901s : 1: type_inference.infer 6.09% : 0.017379s : 1: type_inference.specialize ------[replace.] 0.000129 7 68.56% : 0.000088s : 5: replace.inline 31.44% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000326 7 96.44% : 0.000315s : 5: match.inline 3.56% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000003s : 13: predicate.addn_zero_filter 2.24% : 0.000004s : 13: predicate.arithmetic_simplify 1.56% : 0.000003s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 13: predicate.compare_switch_simplify 1.10% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.62% : 0.000003s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000009s : 28: predicate.inline 0.91% : 0.000002s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000003s : 8: predicate.less_batch_normalization 1.60% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 19: predicate.load_eliminater 1.53% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.30% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 0.94% : 0.000002s : 13: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.02% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 2.53% : 0.000004s : 13: predicate.reduce_eliminate 1.74% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.82% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.12% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.69% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 1.98% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.75% : 0.000011s : 64: predicate.switch_simplify 1.15% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.14% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.51% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.046533 25 96.52% : 0.044913s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.22% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 3.26% : 0.001519s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.365079 72 0.02% : 0.000070s : 1: add_recomputation 0.03% : 0.000093s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.12% : 0.000428s : 1: bootstrap 0.01% : 0.000040s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.05% : 0.040353s : 1: jit_opt_a 0.05% : 0.000199s : 1: jit_opt_after_cconv 0.02% : 0.000072s : 1: jit_opt_b 0.15% : 0.000560s : 1: loop_unroll 0.26% : 0.000944s : 1: mutable_eliminate 0.37% : 0.001345s : 26: opt.transform.jit_opt_a 0.02% : 0.000070s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000026s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000582s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000753s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 8.65% : 0.031577s : 1: renormalize.infer 0.52% : 0.001901s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000059s : 1: rewriter_after_opt_a 0.03% : 0.000115s : 1: rewriter_before_opt_a 0.04% : 0.000150s : 1: symbol_engine_optimizer 78.18% : 0.285419s : 1: type_inference TotalTime = 0.116412, [30] [bootstrap]: 0.00028176 [type_inference]: 0.10623 [event_method]: 1.913e-05 [auto_monad]: 6.568e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00039347 [rewriter_before_opt_a]: 8.132e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00717352, [2] [Cycle 1]: 0.00358784, [27] [switch_simplify]: 5.515e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.00055456 [with_stream_mark]: 1.692e-05 [recompute_prepare]: 8.09997e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 9.46998e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.49999e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 0.0025985 [add_forward_monad_depend]: 6.19999e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 2.873e-05 [replace_applicator]: 1.435e-05 [Cycle 2]: 0.00035448, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.84999e-06 [a_1]: 0.00012041 [with_stream_mark]: 1.002e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.74999e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 2.23998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 8.51002e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.76001e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.61998e-06 [cse]: 1.063e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.052e-05 [rewriter_after_opt_a]: 3.528e-05 [convert_after_rewriter]: 6.34999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00055438 [jit_opt_b]: 5.163e-05, [1] [Cycle 1]: 4.533e-05, [2] [frontend_op_eliminate]: 1.711e-05 [inline_after_opt_a]: 1.753e-05 [cconv]: 2.496e-05 [loop_unroll]: 0.00041236 [jit_opt_after_cconv]: 0.00014422, [1] [Cycle 1]: 0.00013804, [11] [c_1]: 2.5e-05 [parameter_eliminate]: 2.30002e-06 [updatestate_depend_eliminate]: 5.12e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.03002e-06 [cse]: 1.827e-05 [call_graph_tuple_transform]: 2.128e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.76003e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 7.89002e-06 [add_recomputation]: 4.912e-05 [cse_after_recomputation]: 2.014e-05, [1] [Cycle 1]: 1.526e-05, [1] [cse]: 9.89999e-06 [auto_monad_reorder]: 1.56e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 4.43001e-06 [opt_after_jit_grad]: 0.00044562 [symbol_engine_optimizer]: 0.00012068, [1] [Cycle 1]: 0.00011445, [6] [build]: 3.09999e-06 [elim_shapecalc]: 7.91001e-06 [elim_not_effective]: 1.272e-05 [opt_reshape]: 5.89999e-06 [fold_const_symbol]: 5.708e-05 [renormalize]: 5.59987e-07 [validate]: 4.328e-05 Sums bootstrap : 0.000282s : 0.25% type_inference : 0.106230s : 94.34% event_method : 0.000019s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000393s : 0.35% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000675s : 0.60% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002599s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000554s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000412s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000057s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000198 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 3.27% : 0.000006s : 4: substitution.graph_param_transform 83.41% : 0.000165s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000004s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 5.94% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106162 2 97.27% : 0.103268s : 1: type_inference.infer 2.73% : 0.002894s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.35% : 0.000047s : 4: replace.inline 33.65% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.84% : 0.000163s : 4: match.inline 6.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.66% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000001s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.48% : 0.000001s : 4: predicate.graph_param_transform 5.14% : 0.000006s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000001s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.71% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000001s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002139 22 68.80% : 0.001472s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.50% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.69% : 0.000635s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120006 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000301s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.98% : 0.007177s : 1: jit_opt_a 0.12% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.35% : 0.000420s : 1: loop_unroll 0.47% : 0.000562s : 1: mutable_eliminate 0.75% : 0.000900s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000399s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.59% : 0.001908s : 1: renormalize.infer 0.57% : 0.000682s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.10% : 0.000123s : 1: symbol_engine_optimizer 88.53% : 0.106243s : 1: type_inference TotalTime = 0.0274746, [30] [bootstrap]: 0.00028914 [type_inference]: 0.018844 [event_method]: 1.868e-05 [auto_monad]: 6.823e-05 [graph_reusing]: 5.71998e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 9.828e-05 [rewriter_before_opt_a]: 7.891e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.00587819, [2] [Cycle 1]: 0.00183835, [27] [switch_simplify]: 5.961e-05 [loop_unroll]: 2.956e-05 [a_1]: 0.00053681 [with_stream_mark]: 2.028e-05 [recompute_prepare]: 7.38999e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.397e-05 [j_node_and_user_rematch]: 9.19998e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00086593 [add_forward_monad_depend]: 5.83002e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.429e-05 [cse]: 3.237e-05 [replace_applicator]: 1.177e-05 [Cycle 2]: 0.00033644, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.15001e-06 [a_1]: 8.966e-05 [with_stream_mark]: 9.00999e-06 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.56998e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.266e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 1.71998e-06 [replace_old_param]: 8.13001e-06 [inline_without_move]: 5.00999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.85998e-06 [cse]: 1.562e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.239e-05 [rewriter_after_opt_a]: 3.733e-05 [convert_after_rewriter]: 6.49001e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00055669 [jit_opt_b]: 5.005e-05, [1] [Cycle 1]: 4.329e-05, [2] [frontend_op_eliminate]: 1.578e-05 [inline_after_opt_a]: 1.708e-05 [cconv]: 2.737e-05 [loop_unroll]: 0.00045339 [jit_opt_after_cconv]: 0.00015206, [1] [Cycle 1]: 0.00014508, [11] [c_1]: 2.33e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.169e-05 [call_graph_tuple_transform]: 1.988e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.663e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 5.87001e-06 [add_recomputation]: 5.174e-05 [cse_after_recomputation]: 4.097e-05, [1] [Cycle 1]: 1.869e-05, [1] [cse]: 1.311e-05 [auto_monad_reorder]: 1.868e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 5.36998e-06 [opt_after_jit_grad]: 0.0004628 [symbol_engine_optimizer]: 7.275e-05, [1] [Cycle 1]: 6.652e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 7.78999e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 4.10015e-07 [validate]: 3.74e-05 Sums bootstrap : 0.000289s : 1.25% type_inference : 0.018844s : 81.32% event_method : 0.000019s : 0.08% auto_monad : 0.000068s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000098s : 0.42% rewriter_before_opt_a : 0.000079s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.15% jit_opt_a.a_1 : 0.000626s : 2.70% jit_opt_a.with_stream_mark : 0.000029s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000866s : 3.74% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000048s : 0.21% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000037s : 0.16% convert_after_rewriter : 0.000006s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000557s : 2.40% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000027s : 0.12% loop_unroll : 0.000453s : 1.96% jit_opt_after_cconv.c_1 : 0.000023s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000052s : 0.22% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000463s : 2.00% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.16% Time group info: ------[substitution.] 0.000211 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 3: substitution.graph_param_transform 84.61% : 0.000178s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000004s : 4: substitution.remove_not_recompute_node 1.66% : 0.000004s : 2: substitution.replace_old_param 5.83% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018776 2 92.84% : 0.017431s : 1: type_inference.infer 7.16% : 0.001345s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.79% : 0.000048s : 4: replace.inline 32.21% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 94.09% : 0.000176s : 4: match.inline 5.91% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.51% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.21% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.88% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.92% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000750 13 43.85% : 0.000329s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.12% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.04% : 0.000375s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029247 72 0.19% : 0.000054s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.04% : 0.000304s : 1: bootstrap 0.10% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000043s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 20.11% : 0.005882s : 1: jit_opt_a 0.53% : 0.000155s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 1.58% : 0.000461s : 1: loop_unroll 1.93% : 0.000565s : 1: mutable_eliminate 2.88% : 0.000843s : 26: opt.transform.jit_opt_a 0.18% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.61% : 0.000471s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000102s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.73% : 0.000505s : 1: renormalize.infer 1.20% : 0.000352s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000040s : 1: rewriter_after_opt_a 0.28% : 0.000083s : 1: rewriter_before_opt_a 0.26% : 0.000075s : 1: symbol_engine_optimizer 64.48% : 0.018860s : 1: type_inference TotalTime = 0.0312019, [30] [bootstrap]: 0.00029704 [type_inference]: 0.0216544 [event_method]: 2.394e-05 [auto_monad]: 9.929e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.00015966 [rewriter_before_opt_a]: 9.629e-05 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.00635708, [2] [Cycle 1]: 0.0022519, [27] [switch_simplify]: 6.013e-05 [loop_unroll]: 3.066e-05 [a_1]: 0.00059667 [with_stream_mark]: 2.399e-05 [recompute_prepare]: 8.90001e-06 [updatestate_depend_eliminate]: 4.12003e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.45002e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 6.83998e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 5.44e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.727e-05 [j_node_and_user_rematch]: 1.054e-05 [meta_fg_expand]: 3.16999e-06 [replace_old_param]: 1.141e-05 [inline_without_move]: 6.76999e-06 [renormalize]: 0.0011597 [add_forward_monad_depend]: 6.44999e-06 [auto_monad_grad]: 2.75002e-06 [auto_monad_eliminator]: 2.196e-05 [cse]: 3.759e-05 [replace_applicator]: 1.546e-05 [Cycle 2]: 0.000358, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 5.11002e-06 [a_1]: 0.00010195 [with_stream_mark]: 1.307e-05 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.677e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.74002e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 6.94001e-06 [cse]: 1.503e-05 [replace_applicator]: 6.28998e-06 [py_interpret_to_execute_after_opt_a]: 1.551e-05 [rewriter_after_opt_a]: 4.53e-05 [convert_after_rewriter]: 7.71001e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00071164 [jit_opt_b]: 5.696e-05, [1] [Cycle 1]: 4.863e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.791e-05 [cconv]: 2.913e-05 [loop_unroll]: 0.00044214 [jit_opt_after_cconv]: 0.00015552, [1] [Cycle 1]: 0.00014898, [11] [c_1]: 2.219e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 6.33002e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 2.68e-05 [call_graph_tuple_transform]: 2.208e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.49003e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 5.66998e-06 [remove_dup_value]: 1.681e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 4.933e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.772e-05, [1] [cse]: 1.195e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 1.80001e-06 [rewriter_after_jit_bprop_graph]: 5.56e-06 [opt_after_jit_grad]: 0.00057486 [symbol_engine_optimizer]: 7.952e-05, [1] [Cycle 1]: 7.301e-05, [6] [build]: 5.04003e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.485e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 4.50003e-07 [validate]: 4.688e-05 Sums bootstrap : 0.000297s : 1.11% type_inference : 0.021654s : 80.74% event_method : 0.000024s : 0.09% auto_monad : 0.000099s : 0.37% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000160s : 0.60% rewriter_before_opt_a : 0.000096s : 0.36% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000699s : 2.61% jit_opt_a.with_stream_mark : 0.000037s : 0.14% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000012s : 0.04% jit_opt_a.renormalize : 0.001160s : 4.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.11% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000022s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000045s : 0.17% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000712s : 2.65% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000029s : 0.11% loop_unroll : 0.000442s : 1.65% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000575s : 2.14% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.17% Time group info: ------[substitution.] 0.000238 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000007s : 3: substitution.graph_param_transform 83.76% : 0.000199s : 4: substitution.inline 1.81% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000005s : 2: substitution.replace_old_param 5.35% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021563 2 91.48% : 0.019726s : 1: type_inference.infer 8.52% : 0.001837s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.31% : 0.000053s : 4: replace.inline 32.69% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.50% : 0.000196s : 4: match.inline 5.50% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000003s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.50% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.18% : 0.000003s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.23% : 0.000003s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.94% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 2.11% : 0.000003s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000959 13 45.25% : 0.000434s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.22% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.53% : 0.000475s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033353 72 0.16% : 0.000052s : 1: add_recomputation 0.31% : 0.000104s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.95% : 0.000318s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000011s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 19.07% : 0.006361s : 1: jit_opt_a 0.48% : 0.000158s : 1: jit_opt_after_cconv 0.18% : 0.000060s : 1: jit_opt_b 1.35% : 0.000451s : 1: loop_unroll 2.16% : 0.000721s : 1: mutable_eliminate 2.81% : 0.000938s : 26: opt.transform.jit_opt_a 0.16% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.75% : 0.000585s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.49% : 0.000165s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.95% : 0.000651s : 1: renormalize.infer 1.49% : 0.000498s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000048s : 1: rewriter_after_opt_a 0.30% : 0.000101s : 1: rewriter_before_opt_a 0.25% : 0.000082s : 1: symbol_engine_optimizer 65.00% : 0.021681s : 1: type_inference TotalTime = 0.0201027, [30] [bootstrap]: 0.00033812 [type_inference]: 0.0093631 [event_method]: 2.303e-05 [auto_monad]: 7.32e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 5.673e-05 [rewriter_before_opt_a]: 8.646e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00737689, [2] [Cycle 1]: 0.003003, [27] [switch_simplify]: 7.934e-05 [loop_unroll]: 3.466e-05 [a_1]: 0.00082859 [with_stream_mark]: 2.119e-05 [recompute_prepare]: 9.14998e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.69001e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 6.88e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 1.108e-05 [meta_fg_expand]: 2.96001e-06 [replace_old_param]: 1.159e-05 [inline_without_move]: 5.70001e-06 [renormalize]: 0.00163524 [add_forward_monad_depend]: 7.88001e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.843e-05 [cse]: 3.871e-05 [replace_applicator]: 1.792e-05 [Cycle 2]: 0.00036784, [27] [switch_simplify]: 6.62002e-06 [loop_unroll]: 5.47001e-06 [a_1]: 0.00011465 [with_stream_mark]: 1.251e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.34e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 2.71999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.124e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 7.84002e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.39e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.684e-05 [rewriter_after_opt_a]: 4.119e-05 [convert_after_rewriter]: 7.20003e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00086624 [jit_opt_b]: 5.891e-05, [1] [Cycle 1]: 5.055e-05, [2] [frontend_op_eliminate]: 2.126e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 3.399e-05 [loop_unroll]: 0.0005326 [jit_opt_after_cconv]: 0.0001807, [1] [Cycle 1]: 0.00017191, [11] [c_1]: 2.514e-05 [parameter_eliminate]: 4.1e-06 [updatestate_depend_eliminate]: 6.98e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 3.588e-05 [call_graph_tuple_transform]: 2.443e-05 [tuple_list_get_item_eliminator]: 5.69999e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 6.81999e-06 [remove_dup_value]: 1.934e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 7.75998e-06 [add_recomputation]: 5.517e-05 [cse_after_recomputation]: 2.737e-05, [1] [Cycle 1]: 2.081e-05, [1] [cse]: 1.434e-05 [auto_monad_reorder]: 1.814e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 7.88999e-06 [opt_after_jit_grad]: 0.0005479 [symbol_engine_optimizer]: 8.429e-05, [1] [Cycle 1]: 7.77e-05, [6] [build]: 4.70999e-06 [elim_shapecalc]: 9.19e-06 [elim_not_effective]: 1.637e-05 [opt_reshape]: 6.94001e-06 [fold_const_symbol]: 9.92999e-06 [renormalize]: 6.59988e-07 [validate]: 4.723e-05 Sums bootstrap : 0.000338s : 2.19% type_inference : 0.009363s : 60.72% event_method : 0.000023s : 0.15% auto_monad : 0.000073s : 0.47% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.37% rewriter_before_opt_a : 0.000086s : 0.56% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000086s : 0.56% jit_opt_a.loop_unroll : 0.000040s : 0.26% jit_opt_a.a_1 : 0.000943s : 6.12% jit_opt_a.with_stream_mark : 0.000034s : 0.22% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001635s : 10.61% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.16% jit_opt_a.cse : 0.000053s : 0.34% jit_opt_a.replace_applicator : 0.000024s : 0.15% py_interpret_to_execute_after_opt_a : 0.000017s : 0.11% rewriter_after_opt_a : 0.000041s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000866s : 5.62% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000034s : 0.22% loop_unroll : 0.000533s : 3.45% jit_opt_after_cconv.c_1 : 0.000025s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.04% remove_dup_value : 0.000019s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000055s : 0.36% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.05% opt_after_jit_grad : 0.000548s : 3.55% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.31% Time group info: ------[substitution.] 0.000344 27 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.70% : 0.000006s : 3: substitution.graph_param_transform 85.35% : 0.000294s : 5: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.67% : 0.000013s : 3: substitution.reduce_eliminate 1.32% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000006s : 2: substitution.replace_old_param 3.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009282 2 86.76% : 0.008054s : 1: type_inference.infer 13.24% : 0.001228s : 1: type_inference.specialize ------[replace.] 0.000115 7 66.62% : 0.000077s : 5: replace.inline 33.38% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000301 7 96.49% : 0.000291s : 5: match.inline 3.51% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000194 747 0.84% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.82% : 0.000002s : 11: predicate.addn_check_dump 0.89% : 0.000002s : 11: predicate.addn_zero_filter 1.48% : 0.000003s : 11: predicate.arithmetic_simplify 0.89% : 0.000002s : 11: predicate.cast_eliminate 0.33% : 0.000001s : 3: predicate.check_bprop_eliminate 0.68% : 0.000001s : 11: predicate.compare_switch_simplify 0.89% : 0.000002s : 11: predicate.depend_value_elim 0.91% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 26.67% : 0.000052s : 11: predicate.dict_get_item_eliminator 1.02% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.81% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.76% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.77% : 0.000001s : 11: predicate.environ_get_depend_swap 0.87% : 0.000002s : 11: predicate.environ_get_eliminate 0.71% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 4.63% : 0.000009s : 24: predicate.inline 0.63% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 6: predicate.less_batch_normalization 1.27% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.22% : 0.000002s : 16: predicate.load_eliminater 0.95% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.78% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.52% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.75% : 0.000001s : 11: predicate.merge_addn 0.75% : 0.000001s : 11: predicate.minmaximum_grad 1.39% : 0.000003s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 1.58% : 0.000003s : 16: predicate.partial_eliminate 0.83% : 0.000002s : 11: predicate.print_const_string_wrapper 2.02% : 0.000004s : 11: predicate.reduce_eliminate 1.17% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.36% : 0.000001s : 6: predicate.remove_not_recompute_node 1.36% : 0.000003s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.00% : 0.000002s : 11: predicate.reshape_eliminate 0.87% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 0.88% : 0.000002s : 11: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000002s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.10% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 0.97% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.27% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.86% : 0.000004s : 18: predicate.switch_defer_inline 1.89% : 0.000004s : 18: predicate.switch_layer_defer_inline 5.53% : 0.000011s : 59: predicate.switch_simplify 1.00% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000003s : 11: predicate.transpose_eliminate 1.17% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 0.90% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 2.32% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.12% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.12% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.34% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 2.07% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.18% : 0.000002s : 11: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001050 16 46.18% : 0.000485s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.24% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.58% : 0.000468s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023001 72 0.26% : 0.000059s : 1: add_recomputation 0.33% : 0.000077s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.55% : 0.000357s : 1: bootstrap 0.16% : 0.000037s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000030s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.12% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.09% : 0.007382s : 1: jit_opt_a 0.80% : 0.000184s : 1: jit_opt_after_cconv 0.27% : 0.000062s : 1: jit_opt_b 2.36% : 0.000543s : 1: loop_unroll 3.82% : 0.000879s : 1: mutable_eliminate 5.22% : 0.001201s : 26: opt.transform.jit_opt_a 0.25% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000032s : 4: opt.transform.jit_opt_b 0.07% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000018s : 1: opt.transform.mutable_eliminate 0.11% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000558s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000060s : 1: py_interpret_to_execute 0.09% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000023s : 1: remove_dup_value 4.83% : 0.001112s : 1: renormalize.infer 2.23% : 0.000513s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000045s : 1: rewriter_after_opt_a 0.39% : 0.000090s : 1: rewriter_before_opt_a 0.38% : 0.000087s : 1: symbol_engine_optimizer 40.78% : 0.009380s : 1: type_inference TotalTime = 0.0606471, [30] [bootstrap]: 0.00030134 [type_inference]: 0.0364463 [event_method]: 2.56e-05 [auto_monad]: 8.711e-05 [graph_reusing]: 7.67998e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00020345 [rewriter_before_opt_a]: 0.00010012 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0210312, [2] [Cycle 1]: 0.0167814, [27] [switch_simplify]: 6.044e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00058167 [with_stream_mark]: 2.173e-05 [recompute_prepare]: 7.38999e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.65998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.0156998 [add_forward_monad_depend]: 9.29998e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.994e-05 [cse]: 3.69e-05 [replace_applicator]: 2.611e-05 [Cycle 2]: 0.00038537, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.83e-06 [a_1]: 0.00011637 [with_stream_mark]: 1.639e-05 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 2.89001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.872e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.42999e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.59999e-06 [cse]: 1.429e-05 [replace_applicator]: 5.66998e-06 [py_interpret_to_execute_after_opt_a]: 1.699e-05 [rewriter_after_opt_a]: 3.905e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00079336 [jit_opt_b]: 5.505e-05, [1] [Cycle 1]: 4.704e-05, [2] [frontend_op_eliminate]: 1.895e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00043031 [jit_opt_after_cconv]: 0.0001492, [1] [Cycle 1]: 0.00014288, [11] [c_1]: 2.292e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 6.11e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.313e-05 [call_graph_tuple_transform]: 1.955e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 1.59984e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 1.649e-05 [partial_unused_args_eliminate]: 2.86999e-06 [environ_conv]: 5.67999e-06 [add_recomputation]: 5.218e-05 [cse_after_recomputation]: 2.174e-05, [1] [Cycle 1]: 1.683e-05, [1] [cse]: 1.143e-05 [auto_monad_reorder]: 1.871e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00045286 [symbol_engine_optimizer]: 9.369e-05, [1] [Cycle 1]: 8.743e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 2.583e-05 [elim_not_effective]: 1.398e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 3.69997e-07 [validate]: 4.25e-05 Sums bootstrap : 0.000301s : 0.54% type_inference : 0.036446s : 64.91% event_method : 0.000026s : 0.05% auto_monad : 0.000087s : 0.16% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000203s : 0.36% rewriter_before_opt_a : 0.000100s : 0.18% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.12% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000698s : 1.24% jit_opt_a.with_stream_mark : 0.000038s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.015700s : 27.96% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.05% jit_opt_a.cse : 0.000051s : 0.09% jit_opt_a.replace_applicator : 0.000032s : 0.06% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000039s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000793s : 1.41% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000026s : 0.05% loop_unroll : 0.000430s : 0.77% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000453s : 0.81% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000026s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.08% Time group info: ------[substitution.] 0.000240 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.57% : 0.000006s : 3: substitution.graph_param_transform 84.79% : 0.000203s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 5.14% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036334 2 91.58% : 0.033274s : 1: type_inference.infer 8.42% : 0.003060s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.75% : 0.000053s : 4: replace.inline 31.25% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 94.75% : 0.000201s : 4: match.inline 5.25% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000003s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.02% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.61% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.81% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 0.97% : 0.000001s : 10: predicate.minmaximum_grad 1.96% : 0.000003s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000002s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.83% : 0.000002s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.08% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.34% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.72% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001590 13 28.08% : 0.000446s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.23% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 68.69% : 0.001092s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077334 72 0.07% : 0.000055s : 1: add_recomputation 0.12% : 0.000092s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.41% : 0.000320s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000032s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 27.20% : 0.021036s : 1: jit_opt_a 0.20% : 0.000152s : 1: jit_opt_after_cconv 0.08% : 0.000058s : 1: jit_opt_b 0.57% : 0.000438s : 1: loop_unroll 1.04% : 0.000802s : 1: mutable_eliminate 1.22% : 0.000942s : 26: opt.transform.jit_opt_a 0.06% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000208s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 19.07% : 0.014751s : 1: renormalize.infer 1.20% : 0.000931s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.14% : 0.000106s : 1: rewriter_before_opt_a 0.12% : 0.000096s : 1: symbol_engine_optimizer 47.16% : 0.036472s : 1: type_inference TotalTime = 0.0125018, [30] [bootstrap]: 0.00031015 [type_inference]: 0.00504207 [event_method]: 1.783e-05 [auto_monad]: 6.468e-05 [graph_reusing]: 7.18e-06 [pre_auto_parallel]: 2.73998e-06 [py_interpret_to_execute]: 3.44e-05 [rewriter_before_opt_a]: 7.401e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00488951, [2] [Cycle 1]: 0.00147837, [27] [switch_simplify]: 5.351e-05 [loop_unroll]: 3e-05 [a_1]: 0.00051269 [with_stream_mark]: 1.744e-05 [recompute_prepare]: 7.4e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.443e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.47998e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00053973 [add_forward_monad_depend]: 5.51998e-06 [auto_monad_grad]: 2.05002e-06 [auto_monad_eliminator]: 1.485e-05 [cse]: 3.383e-05 [replace_applicator]: 1.191e-05 [Cycle 2]: 0.00031524, [27] [switch_simplify]: 5.76003e-06 [loop_unroll]: 5.25001e-06 [a_1]: 8.858e-05 [with_stream_mark]: 7.70998e-06 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 3.10002e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 2.46998e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.247e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 6.73e-06 [inline_without_move]: 4.79e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.37001e-06 [cse]: 1.306e-05 [replace_applicator]: 5.06002e-06 [py_interpret_to_execute_after_opt_a]: 1.026e-05 [rewriter_after_opt_a]: 3.553e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.43002e-06 [mutable_eliminate]: 0.00049371 [jit_opt_b]: 4.761e-05, [1] [Cycle 1]: 4.134e-05, [2] [frontend_op_eliminate]: 1.505e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.406e-05 [loop_unroll]: 0.00044466 [jit_opt_after_cconv]: 0.00015075, [1] [Cycle 1]: 0.00014439, [11] [c_1]: 2.025e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 5.89e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.171e-05 [call_graph_tuple_transform]: 1.913e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.43002e-06 [remove_dup_value]: 1.641e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 4.878e-05 [cse_after_recomputation]: 2.307e-05, [1] [Cycle 1]: 1.764e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.35999e-06 [opt_after_jit_grad]: 0.0004418 [symbol_engine_optimizer]: 7.245e-05, [1] [Cycle 1]: 6.616e-05, [6] [build]: 3.30998e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.306e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.69997e-07 [validate]: 3.774e-05 Sums bootstrap : 0.000310s : 3.51% type_inference : 0.005042s : 57.04% event_method : 0.000018s : 0.20% auto_monad : 0.000065s : 0.73% graph_reusing : 0.000007s : 0.08% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.39% rewriter_before_opt_a : 0.000074s : 0.84% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000601s : 6.80% jit_opt_a.with_stream_mark : 0.000025s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000540s : 6.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000047s : 0.53% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000036s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000494s : 5.59% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000024s : 0.27% loop_unroll : 0.000445s : 5.03% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000049s : 0.55% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000442s : 5.00% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.43% Time group info: ------[substitution.] 0.000188 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000005s : 3: substitution.graph_param_transform 83.32% : 0.000156s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000004s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 6.19% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004979 2 83.51% : 0.004158s : 1: type_inference.infer 16.49% : 0.000821s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.29% : 0.000043s : 4: replace.inline 32.71% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 6 93.58% : 0.000154s : 4: match.inline 6.42% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.24% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.33% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.72% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.37% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.32% : 0.000001s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.39% : 0.000002s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.37% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000593 13 53.48% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.82% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.70% : 0.000242s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013906 72 0.37% : 0.000052s : 1: add_recomputation 0.49% : 0.000068s : 1: auto_monad 0.15% : 0.000020s : 1: auto_monad_reorder 2.37% : 0.000329s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.07% : 0.000009s : 1: graph_reusing 35.18% : 0.004892s : 1: jit_opt_a 1.11% : 0.000154s : 1: jit_opt_after_cconv 0.36% : 0.000050s : 1: jit_opt_b 3.25% : 0.000452s : 1: loop_unroll 3.61% : 0.000502s : 1: mutable_eliminate 5.82% : 0.000810s : 26: opt.transform.jit_opt_a 0.34% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.23% : 0.000449s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000019s : 1: remove_dup_value 2.01% : 0.000280s : 1: renormalize.infer 1.82% : 0.000253s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000038s : 1: rewriter_after_opt_a 0.55% : 0.000077s : 1: rewriter_before_opt_a 0.54% : 0.000075s : 1: symbol_engine_optimizer 36.36% : 0.005056s : 1: type_inference TotalTime = 0.299241, [30] [bootstrap]: 0.00027494 [type_inference]: 0.262794 [event_method]: 2.334e-05 [auto_monad]: 9.858e-05 [graph_reusing]: 6.19999e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.0005543 [rewriter_before_opt_a]: 0.00012847 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.0329817, [2] [Cycle 1]: 0.0293161, [27] [switch_simplify]: 6.117e-05 [loop_unroll]: 3.402e-05 [a_1]: 0.00073875 [with_stream_mark]: 2.087e-05 [recompute_prepare]: 9.86e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 3.97002e-06 [updatestate_loads_eliminate]: 3.57002e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 8.07998e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 7.03e-06 [merge_forward]: 4.81997e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 1.22e-05 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 1.149e-05 [inline_without_move]: 7.76001e-06 [renormalize]: 0.0281008 [add_forward_monad_depend]: 6.71999e-06 [auto_monad_grad]: 1.90001e-06 [auto_monad_eliminator]: 1.442e-05 [cse]: 2.317e-05 [replace_applicator]: 1.697e-05 [Cycle 2]: 0.00038508, [27] [switch_simplify]: 7.7e-06 [loop_unroll]: 6.61999e-06 [a_1]: 0.00012819 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.453e-05 [replace_applicator]: 6.64001e-06 [py_interpret_to_execute_after_opt_a]: 1.104e-05 [rewriter_after_opt_a]: 3.342e-05 [convert_after_rewriter]: 6.09001e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00062193 [jit_opt_b]: 5.757e-05, [1] [Cycle 1]: 5.048e-05, [2] [frontend_op_eliminate]: 2.013e-05 [inline_after_opt_a]: 1.859e-05 [cconv]: 2.097e-05 [loop_unroll]: 0.00044755 [jit_opt_after_cconv]: 0.00016002, [1] [Cycle 1]: 0.0001526, [11] [c_1]: 2.638e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.87001e-06 [updatestate_assign_eliminate]: 3.75998e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 2.619e-05 [call_graph_tuple_transform]: 2.003e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 1.17e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.81001e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 8.05999e-06 [add_recomputation]: 3.984e-05 [cse_after_recomputation]: 2.596e-05, [1] [Cycle 1]: 1.997e-05, [1] [cse]: 1.402e-05 [auto_monad_reorder]: 1.388e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00048397 [symbol_engine_optimizer]: 0.00018616, [1] [Cycle 1]: 0.00017908, [6] [build]: 3.25e-06 [elim_shapecalc]: 8.98002e-06 [elim_not_effective]: 1.481e-05 [opt_reshape]: 6.51999e-06 [fold_const_symbol]: 0.00011425 [renormalize]: 4.59986e-07 [validate]: 4.418e-05 Sums bootstrap : 0.000275s : 0.09% type_inference : 0.262794s : 88.98% event_method : 0.000023s : 0.01% auto_monad : 0.000099s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000554s : 0.19% rewriter_before_opt_a : 0.000128s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000867s : 0.29% jit_opt_a.with_stream_mark : 0.000033s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.028101s : 9.51% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000038s : 0.01% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000033s : 0.01% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000622s : 0.21% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000021s : 0.01% loop_unroll : 0.000448s : 0.15% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000015s : 0.00% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000040s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000014s : 0.00% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000484s : 0.16% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000114s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.01% Time group info: ------[substitution.] 0.000287 25 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.62% : 0.000005s : 4: substitution.graph_param_transform 87.46% : 0.000251s : 5: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 4.78% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.262713 2 98.19% : 0.257946s : 1: type_inference.infer 1.81% : 0.004767s : 1: type_inference.specialize ------[replace.] 0.000109 7 69.26% : 0.000076s : 5: replace.inline 30.74% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 7 95.23% : 0.000248s : 5: match.inline 4.77% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.34% : 0.000001s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.62% : 0.000008s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.37% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 2.07% : 0.000003s : 13: predicate.reduce_eliminate 1.52% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.014723 25 92.47% : 0.013615s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.51% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 7.02% : 0.001033s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.328650 72 0.01% : 0.000043s : 1: add_recomputation 0.03% : 0.000103s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.09% : 0.000290s : 1: bootstrap 0.01% : 0.000024s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 10.04% : 0.032985s : 1: jit_opt_a 0.05% : 0.000163s : 1: jit_opt_after_cconv 0.02% : 0.000060s : 1: jit_opt_b 0.14% : 0.000455s : 1: loop_unroll 0.19% : 0.000631s : 1: mutable_eliminate 0.34% : 0.001126s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000141s : 4: opt.transform.symbol_engine_opt 0.15% : 0.000493s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000563s : 1: py_interpret_to_execute 0.00% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 8.23% : 0.027044s : 1: renormalize.infer 0.32% : 0.001047s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000036s : 1: rewriter_after_opt_a 0.04% : 0.000136s : 1: rewriter_before_opt_a 0.06% : 0.000189s : 1: symbol_engine_optimizer 79.97% : 0.262812s : 1: type_inference TotalTime = 0.0244193, [30] [bootstrap]: 0.00046644 [type_inference]: 0.00918973 [event_method]: 2.307e-05 [auto_monad]: 7.08e-05 [graph_reusing]: 5.88998e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 5.629e-05 [rewriter_before_opt_a]: 0.00011041 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0121468, [2] [Cycle 1]: 0.00230592, [27] [switch_simplify]: 7.317e-05 [loop_unroll]: 3.81e-05 [a_1]: 0.00077327 [with_stream_mark]: 2.174e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.66998e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 6.33e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.599e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00103433 [add_forward_monad_depend]: 1.088e-05 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 3.567e-05 [replace_applicator]: 1.421e-05 [Cycle 2]: 0.00043603, [27] [switch_simplify]: 6.14999e-06 [loop_unroll]: 5.22999e-06 [a_1]: 9.355e-05 [with_stream_mark]: 1e-05 [recompute_prepare]: 5.78002e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.99001e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.61002e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.61998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.23002e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 1.477e-05 [inline_without_move]: 5.27999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.45001e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 7.83999e-06 [cse]: 1.567e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.531e-05 [rewriter_after_opt_a]: 4.605e-05 [convert_after_rewriter]: 7.71001e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.00061857 [jit_opt_b]: 5.124e-05, [1] [Cycle 1]: 4.447e-05, [2] [frontend_op_eliminate]: 1.629e-05 [inline_after_opt_a]: 1.664e-05 [cconv]: 2.596e-05 [loop_unroll]: 0.00048831 [jit_opt_after_cconv]: 0.00014453, [1] [Cycle 1]: 0.00013836, [11] [c_1]: 2.142e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 6.61999e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.209e-05 [call_graph_tuple_transform]: 1.838e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 9.86998e-06 [add_recomputation]: 5.775e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.861e-05, [1] [cse]: 1.234e-05 [auto_monad_reorder]: 1.696e-05 [get_jit_bprop_graph]: 2.54999e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00046145 [symbol_engine_optimizer]: 9.893e-05, [1] [Cycle 1]: 9.276e-05, [6] [build]: 1.064e-05 [elim_shapecalc]: 9.44e-06 [elim_not_effective]: 1.364e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 9.51998e-06 [renormalize]: 4.69998e-07 [validate]: 4.665e-05 Sums bootstrap : 0.000466s : 3.26% type_inference : 0.009190s : 64.29% event_method : 0.000023s : 0.16% auto_monad : 0.000071s : 0.50% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000056s : 0.39% rewriter_before_opt_a : 0.000110s : 0.77% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000079s : 0.55% jit_opt_a.loop_unroll : 0.000043s : 0.30% jit_opt_a.a_1 : 0.000867s : 6.06% jit_opt_a.with_stream_mark : 0.000032s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000014s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000025s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001034s : 7.24% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.17% jit_opt_a.cse : 0.000051s : 0.36% jit_opt_a.replace_applicator : 0.000020s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000046s : 0.32% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000619s : 4.33% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000026s : 0.18% loop_unroll : 0.000488s : 3.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000015s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000010s : 0.07% add_recomputation : 0.000058s : 0.40% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000461s : 3.23% symbol_engine_optimizer.build : 0.000011s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.33% Time group info: ------[substitution.] 0.000316 25 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 1.71% : 0.000005s : 3: substitution.graph_param_transform 85.97% : 0.000271s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.59% : 0.000005s : 4: substitution.remove_not_recompute_node 3.82% : 0.000012s : 2: substitution.replace_old_param 4.57% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009102 2 84.42% : 0.007684s : 1: type_inference.infer 15.58% : 0.001418s : 1: type_inference.specialize ------[replace.] 0.000119 8 65.71% : 0.000078s : 5: replace.inline 34.29% : 0.000041s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 8 95.43% : 0.000268s : 5: match.inline 4.57% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 810 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 0.81% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 1.37% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000008s : 26: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.28% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000003s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 21: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.18% : 0.000002s : 6: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.86% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.53% : 0.000002s : 12: predicate.transpose_eliminate 1.64% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001130 16 53.80% : 0.000608s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.93% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.27% : 0.000432s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026614 72 0.23% : 0.000061s : 1: add_recomputation 0.28% : 0.000074s : 1: auto_monad 0.07% : 0.000019s : 1: auto_monad_reorder 1.83% : 0.000488s : 1: bootstrap 0.11% : 0.000029s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000012s : 1: environ_conv 0.10% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 45.66% : 0.012151s : 1: jit_opt_a 0.55% : 0.000147s : 1: jit_opt_after_cconv 0.20% : 0.000054s : 1: jit_opt_b 1.87% : 0.000496s : 1: loop_unroll 2.36% : 0.000628s : 1: mutable_eliminate 4.24% : 0.001128s : 26: opt.transform.jit_opt_a 0.18% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.76% : 0.000469s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000059s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000018s : 1: remove_dup_value 2.21% : 0.000588s : 1: renormalize.infer 1.64% : 0.000438s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000049s : 1: rewriter_after_opt_a 0.43% : 0.000114s : 1: rewriter_before_opt_a 0.38% : 0.000102s : 1: symbol_engine_optimizer 34.59% : 0.009205s : 1: type_inference TotalTime = 0.104935, [30] [bootstrap]: 0.00029138 [type_inference]: 0.0929768 [event_method]: 2.321e-05 [auto_monad]: 7.606e-05 [graph_reusing]: 7.17002e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 0.00025041 [rewriter_before_opt_a]: 9.132e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00782423, [2] [Cycle 1]: 0.00348529, [27] [switch_simplify]: 6.48e-05 [loop_unroll]: 3.005e-05 [a_1]: 0.00063217 [with_stream_mark]: 2.567e-05 [recompute_prepare]: 9.41998e-06 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 6.27001e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 1.04003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 1.055e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 6.71999e-06 [renormalize]: 0.00234937 [add_forward_monad_depend]: 9.19998e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.958e-05 [cse]: 3.22e-05 [replace_applicator]: 1.997e-05 [Cycle 2]: 0.00038379, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 5.99999e-06 [a_1]: 0.00012641 [with_stream_mark]: 1.452e-05 [recompute_prepare]: 6.22001e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.23002e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.692e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 3.4e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 7.13998e-06 [cse]: 1.322e-05 [replace_applicator]: 5.47999e-06 [py_interpret_to_execute_after_opt_a]: 1.406e-05 [rewriter_after_opt_a]: 4.175e-05 [convert_after_rewriter]: 7.97e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00073048 [jit_opt_b]: 5.558e-05, [1] [Cycle 1]: 4.752e-05, [2] [frontend_op_eliminate]: 1.802e-05 [inline_after_opt_a]: 1.779e-05 [cconv]: 3.138e-05 [loop_unroll]: 0.00045078 [jit_opt_after_cconv]: 0.00016857, [1] [Cycle 1]: 0.00016176, [11] [c_1]: 2.631e-05 [parameter_eliminate]: 4.15e-06 [updatestate_depend_eliminate]: 7.3e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.776e-05 [call_graph_tuple_transform]: 2.335e-05 [tuple_list_get_item_eliminator]: 6.39001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.823e-05 [partial_unused_args_eliminate]: 2.83e-06 [environ_conv]: 9.96e-06 [add_recomputation]: 5.352e-05 [cse_after_recomputation]: 2.36e-05, [1] [Cycle 1]: 1.801e-05, [1] [cse]: 1.158e-05 [auto_monad_reorder]: 1.602e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00136532 [symbol_engine_optimizer]: 0.00012204, [1] [Cycle 1]: 0.00011417, [6] [build]: 5.85002e-06 [elim_shapecalc]: 9.63997e-06 [elim_not_effective]: 4.866e-05 [opt_reshape]: 7.66999e-06 [fold_const_symbol]: 1.053e-05 [renormalize]: 9.40025e-07 [validate]: 5.236e-05 Sums bootstrap : 0.000291s : 0.29% type_inference : 0.092977s : 92.67% event_method : 0.000023s : 0.02% auto_monad : 0.000076s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000250s : 0.25% rewriter_before_opt_a : 0.000091s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.07% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000759s : 0.76% jit_opt_a.with_stream_mark : 0.000040s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002349s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000045s : 0.05% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000730s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000451s : 0.45% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.001365s : 1.36% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000049s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.05% Time group info: ------[substitution.] 0.000266 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000007s : 4: substitution.graph_param_transform 84.89% : 0.000226s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.092878 2 97.15% : 0.090235s : 1: type_inference.infer 2.85% : 0.002644s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.59% : 0.000055s : 4: replace.inline 29.41% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000236 6 94.48% : 0.000223s : 4: match.inline 5.52% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.49% : 0.000002s : 12: predicate.accumulaten_eliminater 1.41% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.69% : 0.000008s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.53% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.26% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.58% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.10% : 0.000003s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.42% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.42% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002550 26 72.94% : 0.001860s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.22% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.84% : 0.000633s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108387 72 0.05% : 0.000056s : 1: add_recomputation 0.07% : 0.000080s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.29% : 0.000310s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.22% : 0.007828s : 1: jit_opt_a 0.16% : 0.000171s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.42% : 0.000460s : 1: loop_unroll 0.68% : 0.000740s : 1: mutable_eliminate 0.93% : 0.001008s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000072s : 4: opt.transform.symbol_engine_opt 1.27% : 0.001379s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000256s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.48% : 0.001607s : 1: renormalize.infer 0.67% : 0.000731s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000096s : 1: rewriter_before_opt_a 0.12% : 0.000125s : 1: symbol_engine_optimizer 85.81% : 0.093006s : 1: type_inference TotalTime = 0.0374514, [30] [bootstrap]: 0.00033508 [type_inference]: 0.025228 [event_method]: 2.374e-05 [auto_monad]: 7.192e-05 [graph_reusing]: 5.68997e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00016227 [rewriter_before_opt_a]: 8.924e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00903168, [2] [Cycle 1]: 0.00465191, [27] [switch_simplify]: 6.841e-05 [loop_unroll]: 3.06e-05 [a_1]: 0.00061459 [with_stream_mark]: 2.086e-05 [recompute_prepare]: 9.66e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 1.658e-05 [get_grad_eliminate_]: 7.17002e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.64e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 3.50003e-06 [replace_old_param]: 9.71998e-06 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00349006 [add_forward_monad_depend]: 9.69e-06 [auto_monad_grad]: 3.19001e-06 [auto_monad_eliminator]: 2.273e-05 [cse]: 4.197e-05 [replace_applicator]: 1.986e-05 [Cycle 2]: 0.00042523, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00010513 [with_stream_mark]: 1.393e-05 [recompute_prepare]: 5.85002e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.93997e-06 [specialize_transform]: 5.44998e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 2.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.64001e-06 [cse]: 1.376e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.725e-05 [rewriter_after_opt_a]: 3.929e-05 [convert_after_rewriter]: 6.60997e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00075845 [jit_opt_b]: 5.402e-05, [1] [Cycle 1]: 4.586e-05, [2] [frontend_op_eliminate]: 1.667e-05 [inline_after_opt_a]: 1.678e-05 [cconv]: 2.996e-05 [loop_unroll]: 0.00044831 [jit_opt_after_cconv]: 0.00015659, [1] [Cycle 1]: 0.00014922, [11] [c_1]: 2.132e-05 [parameter_eliminate]: 3.48e-06 [updatestate_depend_eliminate]: 7.14001e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 3.36001e-06 [cse]: 2.605e-05 [call_graph_tuple_transform]: 1.941e-05 [tuple_list_get_item_eliminator]: 6.83998e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.89e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 6.94999e-06 [add_recomputation]: 5.299e-05 [cse_after_recomputation]: 2.586e-05, [1] [Cycle 1]: 2.019e-05, [1] [cse]: 1.362e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 4.56002e-06 [opt_after_jit_grad]: 0.00049395 [symbol_engine_optimizer]: 7.978e-05, [1] [Cycle 1]: 7.339e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 9.20001e-06 [elim_not_effective]: 1.489e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 6.89994e-07 [validate]: 4.605e-05 Sums bootstrap : 0.000335s : 1.02% type_inference : 0.025228s : 77.03% event_method : 0.000024s : 0.07% auto_monad : 0.000072s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000162s : 0.50% rewriter_before_opt_a : 0.000089s : 0.27% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.23% jit_opt_a.loop_unroll : 0.000037s : 0.11% jit_opt_a.a_1 : 0.000720s : 2.20% jit_opt_a.with_stream_mark : 0.000035s : 0.11% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000018s : 0.06% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.003490s : 10.66% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.09% jit_opt_a.cse : 0.000056s : 0.17% jit_opt_a.replace_applicator : 0.000025s : 0.08% py_interpret_to_execute_after_opt_a : 0.000017s : 0.05% rewriter_after_opt_a : 0.000039s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000758s : 2.32% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000030s : 0.09% loop_unroll : 0.000448s : 1.37% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000053s : 0.16% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000494s : 1.51% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.14% Time group info: ------[substitution.] 0.000250 23 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 84.27% : 0.000210s : 4: substitution.inline 1.82% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 2.44% : 0.000006s : 2: substitution.replace_old_param 5.41% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025135 2 90.77% : 0.022814s : 1: type_inference.infer 9.23% : 0.002321s : 1: type_inference.specialize ------[replace.] 0.000093 6 66.15% : 0.000061s : 4: replace.inline 33.85% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.39% : 0.000208s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.62% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.69% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.32% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 5.42% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.70% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.94% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002915 13 15.95% : 0.000465s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 82.37% : 0.002401s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041929 72 0.13% : 0.000056s : 1: add_recomputation 0.18% : 0.000076s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.84% : 0.000352s : 1: bootstrap 0.08% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 21.55% : 0.009037s : 1: jit_opt_a 0.38% : 0.000160s : 1: jit_opt_after_cconv 0.14% : 0.000057s : 1: jit_opt_b 1.09% : 0.000458s : 1: loop_unroll 1.84% : 0.000770s : 1: mutable_eliminate 2.31% : 0.000970s : 26: opt.transform.jit_opt_a 0.12% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.20% : 0.000502s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000167s : 1: py_interpret_to_execute 0.05% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 2.35% : 0.000984s : 1: renormalize.infer 5.95% : 0.002493s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000042s : 1: rewriter_after_opt_a 0.22% : 0.000093s : 1: rewriter_before_opt_a 0.20% : 0.000082s : 1: symbol_engine_optimizer 60.22% : 0.025248s : 1: type_inference TotalTime = 0.0202921, [30] [bootstrap]: 0.00029618 [type_inference]: 0.0104914 [event_method]: 2.826e-05 [auto_monad]: 9.176e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 8.321e-05 [rewriter_before_opt_a]: 0.0001099 [expand_dump_flag]: 3.90998e-06 [jit_opt_a]: 0.00678917, [2] [Cycle 1]: 0.00237693, [27] [switch_simplify]: 7.421e-05 [loop_unroll]: 3.763e-05 [a_1]: 0.00076624 [with_stream_mark]: 2.85e-05 [recompute_prepare]: 8.70999e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 0.00110179 [add_forward_monad_depend]: 7.06001e-06 [auto_monad_grad]: 2.80002e-06 [auto_monad_eliminator]: 1.71e-05 [cse]: 3.796e-05 [replace_applicator]: 1.666e-05 [Cycle 2]: 0.00034929, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 5.33002e-06 [a_1]: 9.277e-05 [with_stream_mark]: 1.078e-05 [recompute_prepare]: 5.21998e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 2.73998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 5.01997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.451e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 1.423e-05 [rewriter_after_opt_a]: 4.665e-05 [convert_after_rewriter]: 7.36999e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00067321 [jit_opt_b]: 5.149e-05, [1] [Cycle 1]: 4.44e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.687e-05 [cconv]: 2.757e-05 [loop_unroll]: 0.00044754 [jit_opt_after_cconv]: 0.00016062, [1] [Cycle 1]: 0.00015317, [11] [c_1]: 2.182e-05 [parameter_eliminate]: 3.66001e-06 [updatestate_depend_eliminate]: 7.05998e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.924e-05 [call_graph_tuple_transform]: 2.067e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 5.60001e-06 [remove_dup_value]: 1.699e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 1.043e-05 [add_recomputation]: 5.61e-05 [cse_after_recomputation]: 2.531e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.313e-05 [auto_monad_reorder]: 1.665e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.93998e-06 [opt_after_jit_grad]: 0.00048008 [symbol_engine_optimizer]: 8.513e-05, [1] [Cycle 1]: 7.872e-05, [6] [build]: 1.153e-05 [elim_shapecalc]: 8.72998e-06 [elim_not_effective]: 1.435e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 8.77999e-06 [renormalize]: 4.7998e-07 [validate]: 4.849e-05 Sums bootstrap : 0.000296s : 1.90% type_inference : 0.010491s : 67.32% event_method : 0.000028s : 0.18% auto_monad : 0.000092s : 0.59% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000083s : 0.53% rewriter_before_opt_a : 0.000110s : 0.71% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000081s : 0.52% jit_opt_a.loop_unroll : 0.000043s : 0.28% jit_opt_a.a_1 : 0.000859s : 5.51% jit_opt_a.with_stream_mark : 0.000039s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001102s : 7.07% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.15% jit_opt_a.cse : 0.000052s : 0.34% jit_opt_a.replace_applicator : 0.000022s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.09% rewriter_after_opt_a : 0.000047s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000673s : 4.32% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000028s : 0.18% loop_unroll : 0.000448s : 2.87% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000010s : 0.07% add_recomputation : 0.000056s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000017s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000480s : 3.08% symbol_engine_optimizer.build : 0.000012s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.31% Time group info: ------[substitution.] 0.000312 25 0.82% : 0.000003s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000006s : 3: substitution.graph_param_transform 87.89% : 0.000274s : 5: substitution.inline 1.48% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.51% : 0.000005s : 4: substitution.remove_not_recompute_node 1.43% : 0.000004s : 2: substitution.replace_old_param 4.59% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010369 2 46.52% : 0.004823s : 1: type_inference.infer 53.48% : 0.005546s : 1: type_inference.specialize ------[replace.] 0.000116 8 65.88% : 0.000076s : 5: replace.inline 34.12% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 8 95.60% : 0.000271s : 5: match.inline 4.40% : 0.000012s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 810 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.42% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.09% : 0.000009s : 26: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.95% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 18: predicate.load_eliminater 1.09% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 21: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.47% : 0.000012s : 64: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001002 16 47.91% : 0.000480s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.03% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.06% : 0.000431s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022550 72 0.26% : 0.000059s : 1: add_recomputation 0.42% : 0.000095s : 1: auto_monad 0.09% : 0.000019s : 1: auto_monad_reorder 1.41% : 0.000317s : 1: bootstrap 0.13% : 0.000030s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000013s : 1: environ_conv 0.15% : 0.000035s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.12% : 0.006792s : 1: jit_opt_a 0.72% : 0.000163s : 1: jit_opt_after_cconv 0.24% : 0.000054s : 1: jit_opt_b 2.02% : 0.000456s : 1: loop_unroll 3.03% : 0.000683s : 1: mutable_eliminate 4.92% : 0.001110s : 26: opt.transform.jit_opt_a 0.22% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.17% : 0.000489s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000086s : 1: py_interpret_to_execute 0.07% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000020s : 1: remove_dup_value 2.68% : 0.000605s : 1: renormalize.infer 2.16% : 0.000488s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000051s : 1: rewriter_after_opt_a 0.50% : 0.000114s : 1: rewriter_before_opt_a 0.39% : 0.000088s : 1: symbol_engine_optimizer 46.67% : 0.010523s : 1: type_inference TotalTime = 0.0516536, [30] [bootstrap]: 0.00035147 [type_inference]: 0.041238 [event_method]: 2.088e-05 [auto_monad]: 7.137e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00010915 [rewriter_before_opt_a]: 8.238e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00739063, [2] [Cycle 1]: 0.00198173, [27] [switch_simplify]: 5.974e-05 [loop_unroll]: 2.979e-05 [a_1]: 0.00055972 [with_stream_mark]: 2.158e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.68998e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00095934 [add_forward_monad_depend]: 6.82002e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 3.641e-05 [replace_applicator]: 1.437e-05 [Cycle 2]: 0.0003271, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.22e-06 [a_1]: 9.105e-05 [with_stream_mark]: 9.61998e-06 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.24001e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.48e-06 [inline_without_move]: 5.04e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.34e-05 [replace_applicator]: 5.77999e-06 [py_interpret_to_execute_after_opt_a]: 1.308e-05 [rewriter_after_opt_a]: 3.913e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00060346 [jit_opt_b]: 5.35e-05, [1] [Cycle 1]: 4.611e-05, [2] [frontend_op_eliminate]: 1.703e-05 [inline_after_opt_a]: 1.735e-05 [cconv]: 2.731e-05 [loop_unroll]: 0.00047204 [jit_opt_after_cconv]: 0.00016924, [1] [Cycle 1]: 0.00016267, [11] [c_1]: 2.302e-05 [parameter_eliminate]: 3.21001e-06 [updatestate_depend_eliminate]: 6.51999e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.98e-06 [cse]: 2.612e-05 [call_graph_tuple_transform]: 1.991e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 7.50998e-06 [add_recomputation]: 5.793e-05 [cse_after_recomputation]: 2.573e-05, [1] [Cycle 1]: 1.972e-05, [1] [cse]: 1.323e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 5.97001e-06 [opt_after_jit_grad]: 0.00051992 [symbol_engine_optimizer]: 7.906e-05, [1] [Cycle 1]: 7.274e-05, [6] [build]: 3.58999e-06 [elim_shapecalc]: 9.12999e-06 [elim_not_effective]: 1.424e-05 [opt_reshape]: 6.66999e-06 [fold_const_symbol]: 9.67999e-06 [renormalize]: 3.80009e-07 [validate]: 4.316e-05 Sums bootstrap : 0.000351s : 0.77% type_inference : 0.041238s : 89.78% event_method : 0.000021s : 0.05% auto_monad : 0.000071s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000109s : 0.24% rewriter_before_opt_a : 0.000082s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.14% jit_opt_a.loop_unroll : 0.000035s : 0.08% jit_opt_a.a_1 : 0.000651s : 1.42% jit_opt_a.with_stream_mark : 0.000031s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000959s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000050s : 0.11% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000039s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000603s : 1.31% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000027s : 0.06% loop_unroll : 0.000472s : 1.03% jit_opt_after_cconv.c_1 : 0.000023s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000058s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000520s : 1.13% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.09% Time group info: ------[substitution.] 0.000220 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 3: substitution.graph_param_transform 84.24% : 0.000185s : 4: substitution.inline 1.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000004s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 5.93% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041162 2 95.48% : 0.039299s : 1: type_inference.infer 4.52% : 0.001862s : 1: type_inference.specialize ------[replace.] 0.000078 6 69.02% : 0.000054s : 4: replace.inline 30.98% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.90% : 0.000183s : 4: match.inline 6.10% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 2.13% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.24% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.99% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.94% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001198 13 33.66% : 0.000403s : 6: func_graph_cloner_run.FuncGraphClonerGraph 2.98% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 63.36% : 0.000759s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053544 72 0.11% : 0.000061s : 1: add_recomputation 0.14% : 0.000075s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.70% : 0.000374s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.81% : 0.007394s : 1: jit_opt_a 0.32% : 0.000172s : 1: jit_opt_after_cconv 0.10% : 0.000056s : 1: jit_opt_b 0.90% : 0.000481s : 1: loop_unroll 1.15% : 0.000614s : 1: mutable_eliminate 1.63% : 0.000874s : 26: opt.transform.jit_opt_a 0.10% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.99% : 0.000528s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000113s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000034s : 1: remove_dup_value 1.03% : 0.000550s : 1: renormalize.infer 0.75% : 0.000401s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.16% : 0.000086s : 1: rewriter_before_opt_a 0.15% : 0.000082s : 1: symbol_engine_optimizer 77.05% : 0.041258s : 1: type_inference TotalTime = 0.0664231, [30] [bootstrap]: 0.00034396 [type_inference]: 0.0557727 [event_method]: 1.886e-05 [auto_monad]: 6.987e-05 [graph_reusing]: 7.18e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00024077 [rewriter_before_opt_a]: 8.143e-05 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.00728344, [2] [Cycle 1]: 0.00333622, [27] [switch_simplify]: 6.008e-05 [loop_unroll]: 2.915e-05 [a_1]: 0.0006152 [with_stream_mark]: 2.375e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 1.119e-05 [inline_without_move]: 5.96e-06 [renormalize]: 0.00223051 [add_forward_monad_depend]: 7.10002e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 3.568e-05 [replace_applicator]: 1.844e-05 [Cycle 2]: 0.00037976, [27] [switch_simplify]: 6.34001e-06 [loop_unroll]: 1.682e-05 [a_1]: 0.00011699 [with_stream_mark]: 1.537e-05 [recompute_prepare]: 5.91998e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.51998e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 9.51998e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.2e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 6.05002e-06 [cse]: 1.176e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.234e-05 [rewriter_after_opt_a]: 3.757e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00070857 [jit_opt_b]: 5.391e-05, [1] [Cycle 1]: 4.596e-05, [2] [frontend_op_eliminate]: 1.794e-05 [inline_after_opt_a]: 1.726e-05 [cconv]: 2.732e-05 [loop_unroll]: 0.00070345 [jit_opt_after_cconv]: 0.00015143, [1] [Cycle 1]: 0.00014452, [11] [c_1]: 2.404e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 1.98002e-06 [cse]: 2.38e-05 [call_graph_tuple_transform]: 2.105e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.526e-05 [partial_unused_args_eliminate]: 2.70002e-06 [environ_conv]: 9.42999e-06 [add_recomputation]: 5.081e-05 [cse_after_recomputation]: 2.056e-05, [1] [Cycle 1]: 1.553e-05, [1] [cse]: 1.006e-05 [auto_monad_reorder]: 1.717e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 5.35001e-06 [opt_after_jit_grad]: 0.00046401 [symbol_engine_optimizer]: 7.376e-05, [1] [Cycle 1]: 6.766e-05, [6] [build]: 3.66001e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.04e-06 [renormalize]: 3.80009e-07 [validate]: 5.54e-05 Sums bootstrap : 0.000344s : 0.55% type_inference : 0.055773s : 89.59% event_method : 0.000019s : 0.03% auto_monad : 0.000070s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000241s : 0.39% rewriter_before_opt_a : 0.000081s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.11% jit_opt_a.loop_unroll : 0.000046s : 0.07% jit_opt_a.a_1 : 0.000732s : 1.18% jit_opt_a.with_stream_mark : 0.000039s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002231s : 3.58% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000047s : 0.08% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000709s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000703s : 1.13% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000464s : 0.75% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.09% Time group info: ------[substitution.] 0.000251 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 4: substitution.graph_param_transform 84.96% : 0.000213s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 5.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055691 2 96.55% : 0.053768s : 1: type_inference.infer 3.45% : 0.001923s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.07% : 0.000052s : 4: replace.inline 31.93% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.61% : 0.000211s : 4: match.inline 5.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000002s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000001s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.75% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.71% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.62% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002312 26 73.18% : 0.001692s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.40% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.43% : 0.000565s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.069688 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000073s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.51% : 0.000357s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.46% : 0.007287s : 1: jit_opt_a 0.22% : 0.000154s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 1.02% : 0.000712s : 1: loop_unroll 1.03% : 0.000718s : 1: mutable_eliminate 1.41% : 0.000984s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000246s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.26% : 0.001577s : 1: renormalize.infer 0.92% : 0.000643s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.12% : 0.000086s : 1: rewriter_before_opt_a 0.11% : 0.000076s : 1: symbol_engine_optimizer 80.06% : 0.055790s : 1: type_inference TotalTime = 0.0194416, [30] [bootstrap]: 0.00037291 [type_inference]: 0.00784989 [event_method]: 2.804e-05 [auto_monad]: 8.267e-05 [graph_reusing]: 6.43998e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 7.396e-05 [rewriter_before_opt_a]: 0.00010717 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00756056, [2] [Cycle 1]: 0.00303659, [27] [switch_simplify]: 9.075e-05 [loop_unroll]: 4.104e-05 [a_1]: 0.00090273 [with_stream_mark]: 3.33e-05 [recompute_prepare]: 1.887e-05 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 3.31001e-06 [specialize_transform]: 8.94998e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 1.81e-05 [meta_shard_fg_expand]: 3.45e-06 [get_grad_eliminate_]: 6.70002e-06 [merge_forward]: 5.40001e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.198e-05 [j_node_and_user_rematch]: 1.143e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.303e-05 [inline_without_move]: 6.31e-06 [renormalize]: 0.00142241 [add_forward_monad_depend]: 1.199e-05 [auto_monad_grad]: 3.25e-06 [auto_monad_eliminator]: 2.778e-05 [cse]: 4.379e-05 [replace_applicator]: 2.594e-05 [Cycle 2]: 0.00043453, [27] [switch_simplify]: 8.07e-06 [loop_unroll]: 6.73e-06 [a_1]: 0.00010849 [with_stream_mark]: 2.263e-05 [recompute_prepare]: 7.33e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 6.39999e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 3.08998e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 4.74998e-06 [cell_reuse_recompute_pass]: 3.51001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.138e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 1.132e-05 [inline_without_move]: 5.40999e-06 [renormalize]: 1.50001e-07 [add_forward_monad_depend]: 2.30002e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.141e-05 [cse]: 1.964e-05 [replace_applicator]: 7.31999e-06 [py_interpret_to_execute_after_opt_a]: 2.235e-05 [rewriter_after_opt_a]: 5.118e-05 [convert_after_rewriter]: 9.19e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00099355 [jit_opt_b]: 8.129e-05, [1] [Cycle 1]: 5.466e-05, [2] [frontend_op_eliminate]: 1.842e-05 [inline_after_opt_a]: 2.142e-05 [cconv]: 4.469e-05 [loop_unroll]: 0.0006235 [jit_opt_after_cconv]: 0.0002265, [1] [Cycle 1]: 0.00021784, [11] [c_1]: 2.392e-05 [parameter_eliminate]: 7.46999e-06 [updatestate_depend_eliminate]: 1.234e-05 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.98e-06 [cse]: 5.385e-05 [call_graph_tuple_transform]: 3.952e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 1.07e-06 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.892e-05 [partial_unused_args_eliminate]: 2.88998e-06 [environ_conv]: 1.404e-05 [add_recomputation]: 6.598e-05 [cse_after_recomputation]: 3.016e-05, [1] [Cycle 1]: 2.312e-05, [1] [cse]: 1.505e-05 [auto_monad_reorder]: 1.89e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 1.143e-05 [opt_after_jit_grad]: 0.00071151 [symbol_engine_optimizer]: 0.00010436, [1] [Cycle 1]: 9.621e-05, [6] [build]: 1.748e-05 [elim_shapecalc]: 1.069e-05 [elim_not_effective]: 1.827e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 1.034e-05 [renormalize]: 8.79983e-07 [validate]: 6.023e-05 Sums bootstrap : 0.000373s : 2.57% type_inference : 0.007850s : 54.12% event_method : 0.000028s : 0.19% auto_monad : 0.000083s : 0.57% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000074s : 0.51% rewriter_before_opt_a : 0.000107s : 0.74% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000099s : 0.68% jit_opt_a.loop_unroll : 0.000048s : 0.33% jit_opt_a.a_1 : 0.001011s : 6.97% jit_opt_a.with_stream_mark : 0.000056s : 0.39% jit_opt_a.recompute_prepare : 0.000026s : 0.18% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.05% jit_opt_a.parameter_eliminate : 0.000006s : 0.04% jit_opt_a.specialize_transform : 0.000015s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.09% jit_opt_a.accelerated_algorithm : 0.000025s : 0.17% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.08% jit_opt_a.merge_forward : 0.000010s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000043s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000024s : 0.17% jit_opt_a.inline_without_move : 0.000012s : 0.08% jit_opt_a.renormalize : 0.001423s : 9.81% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.10% jit_opt_a.auto_monad_grad : 0.000006s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.27% jit_opt_a.cse : 0.000063s : 0.44% jit_opt_a.replace_applicator : 0.000033s : 0.23% py_interpret_to_execute_after_opt_a : 0.000022s : 0.15% rewriter_after_opt_a : 0.000051s : 0.35% convert_after_rewriter : 0.000009s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000994s : 6.85% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000021s : 0.15% cconv : 0.000045s : 0.31% loop_unroll : 0.000624s : 4.30% jit_opt_after_cconv.c_1 : 0.000024s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000054s : 0.37% jit_opt_after_cconv.call_graph_tuple_transform : 0.000040s : 0.27% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000019s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000014s : 0.10% add_recomputation : 0.000066s : 0.45% cse_after_recomputation.cse : 0.000015s : 0.10% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000011s : 0.08% opt_after_jit_grad : 0.000712s : 4.91% symbol_engine_optimizer.build : 0.000017s : 0.12% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000060s : 0.42% Time group info: ------[substitution.] 0.000392 25 0.65% : 0.000003s : 2: substitution.elim_not_effective 0.42% : 0.000002s : 2: substitution.fold_const_symbol 4.85% : 0.000019s : 3: substitution.graph_param_transform 83.48% : 0.000327s : 5: substitution.inline 1.48% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000007s : 4: substitution.remove_not_recompute_node 2.49% : 0.000010s : 2: substitution.replace_old_param 4.73% : 0.000019s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007748 2 77.87% : 0.006033s : 1: type_inference.infer 22.13% : 0.001715s : 1: type_inference.specialize ------[replace.] 0.000138 8 64.74% : 0.000090s : 5: replace.inline 35.26% : 0.000049s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000338 8 95.22% : 0.000322s : 5: match.inline 4.78% : 0.000016s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 810 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 12: predicate.addn_check_dump 1.60% : 0.000003s : 12: predicate.addn_zero_filter 2.05% : 0.000004s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000002s : 12: predicate.compare_switch_simplify 1.37% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000002s : 6: predicate.get_grad_eliminate 0.37% : 0.000001s : 3: predicate.graph_param_transform 6.14% : 0.000011s : 26: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.84% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 18: predicate.load_eliminater 2.35% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000007s : 41: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 2.59% : 0.000004s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000004s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 2.21% : 0.000004s : 12: predicate.reduce_eliminate 1.28% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000003s : 21: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.44% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000002s : 6: predicate.special_op_eliminate 0.69% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.74% : 0.000005s : 20: predicate.switch_defer_inline 1.86% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.97% : 0.000012s : 64: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000007s : 21: predicate.tuple_list_get_item_eliminator 1.61% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.43% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.50% : 0.000003s : 12: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001299 16 46.04% : 0.000598s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.04% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.92% : 0.000597s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022292 72 0.31% : 0.000070s : 1: add_recomputation 0.39% : 0.000087s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.77% : 0.000395s : 1: bootstrap 0.22% : 0.000049s : 1: cconv 0.05% : 0.000012s : 1: convert_after_rewriter 0.15% : 0.000033s : 1: cse_after_recomputation 0.07% : 0.000016s : 1: environ_conv 0.15% : 0.000034s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 33.94% : 0.007566s : 1: jit_opt_a 1.03% : 0.000230s : 1: jit_opt_after_cconv 0.38% : 0.000085s : 1: jit_opt_b 2.87% : 0.000639s : 1: loop_unroll 4.57% : 0.001018s : 1: mutable_eliminate 6.02% : 0.001343s : 26: opt.transform.jit_opt_a 0.32% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000030s : 4: opt.transform.jit_opt_b 0.11% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.15% : 0.000033s : 1: opt.transform.mutable_eliminate 0.15% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000042s : 4: opt.transform.symbol_engine_opt 3.26% : 0.000728s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000078s : 1: py_interpret_to_execute 0.11% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000022s : 1: remove_dup_value 3.31% : 0.000738s : 1: renormalize.infer 3.00% : 0.000669s : 1: renormalize.specialize 0.06% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000056s : 1: rewriter_after_opt_a 0.50% : 0.000110s : 1: rewriter_before_opt_a 0.48% : 0.000108s : 1: symbol_engine_optimizer 35.33% : 0.007877s : 1: type_inference TotalTime = 0.0156128, [30] [bootstrap]: 0.00028262 [type_inference]: 0.00622222 [event_method]: 2.249e-05 [auto_monad]: 7.053e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 7.368e-05 [rewriter_before_opt_a]: 0.00010417 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00635539, [2] [Cycle 1]: 0.00239393, [27] [switch_simplify]: 7.067e-05 [loop_unroll]: 3.913e-05 [a_1]: 0.0008301 [with_stream_mark]: 2.349e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00104623 [add_forward_monad_depend]: 5.84999e-06 [auto_monad_grad]: 2.14e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.635e-05 [replace_applicator]: 1.569e-05 [Cycle 2]: 0.00035576, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 5.69e-06 [a_1]: 9.806e-05 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 5.54998e-06 [updatestate_useless_node_eliminater]: 5.53002e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.489e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.78002e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 6.84999e-06 [cse]: 1.573e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.4e-05 [rewriter_after_opt_a]: 4.3e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00069293 [jit_opt_b]: 5.403e-05, [1] [Cycle 1]: 4.553e-05, [2] [frontend_op_eliminate]: 1.694e-05 [inline_after_opt_a]: 1.688e-05 [cconv]: 3.306e-05 [loop_unroll]: 0.00047243 [jit_opt_after_cconv]: 0.00021448, [1] [Cycle 1]: 0.00020674, [11] [c_1]: 2.398e-05 [parameter_eliminate]: 4.89998e-06 [updatestate_depend_eliminate]: 1.71e-05 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.46998e-06 [cse]: 3.331e-05 [call_graph_tuple_transform]: 2.377e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.743e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 1.012e-05 [add_recomputation]: 5.068e-05 [cse_after_recomputation]: 2.394e-05, [1] [Cycle 1]: 1.815e-05, [1] [cse]: 1.222e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 7.03e-06 [opt_after_jit_grad]: 0.00047325 [symbol_engine_optimizer]: 8.285e-05, [1] [Cycle 1]: 7.602e-05, [6] [build]: 1.161e-05 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.297e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 8.55001e-06 [renormalize]: 4.09986e-07 [validate]: 4.685e-05 Sums bootstrap : 0.000283s : 2.50% type_inference : 0.006222s : 54.95% event_method : 0.000022s : 0.20% auto_monad : 0.000071s : 0.62% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000074s : 0.65% rewriter_before_opt_a : 0.000104s : 0.92% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000077s : 0.68% jit_opt_a.loop_unroll : 0.000045s : 0.40% jit_opt_a.a_1 : 0.000928s : 8.20% jit_opt_a.with_stream_mark : 0.000034s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.001046s : 9.24% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.21% jit_opt_a.cse : 0.000052s : 0.46% jit_opt_a.replace_applicator : 0.000022s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000043s : 0.38% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000693s : 6.12% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000033s : 0.29% loop_unroll : 0.000472s : 4.17% jit_opt_after_cconv.c_1 : 0.000024s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000017s : 0.15% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000010s : 0.09% add_recomputation : 0.000051s : 0.45% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000019s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000473s : 4.18% symbol_engine_optimizer.build : 0.000012s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.41% Time group info: ------[substitution.] 0.000306 25 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000006s : 3: substitution.graph_param_transform 87.12% : 0.000266s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_old_param 4.87% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006150 2 77.89% : 0.004790s : 1: type_inference.infer 22.11% : 0.001360s : 1: type_inference.specialize ------[replace.] 0.000120 8 65.08% : 0.000078s : 5: replace.inline 34.92% : 0.000042s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000276 8 95.35% : 0.000263s : 5: match.inline 4.65% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 810 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.66% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.57% : 0.000002s : 12: predicate.cast_eliminate 0.34% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.28% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000008s : 26: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000001s : 6: predicate.less_batch_normalization 1.80% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000002s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.63% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000003s : 21: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000004s : 20: predicate.switch_defer_inline 2.28% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.43% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.55% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 2.09% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001001 16 49.41% : 0.000495s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.70% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.89% : 0.000419s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017895 72 0.30% : 0.000054s : 1: add_recomputation 0.41% : 0.000074s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.69% : 0.000302s : 1: bootstrap 0.20% : 0.000036s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.07% : 0.000012s : 1: environ_conv 0.15% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 35.54% : 0.006359s : 1: jit_opt_a 1.22% : 0.000218s : 1: jit_opt_after_cconv 0.32% : 0.000057s : 1: jit_opt_b 2.69% : 0.000481s : 1: loop_unroll 3.94% : 0.000705s : 1: mutable_eliminate 6.60% : 0.001182s : 26: opt.transform.jit_opt_a 0.32% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000018s : 1: opt.transform.mutable_eliminate 0.13% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.69% : 0.000481s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000078s : 1: py_interpret_to_execute 0.09% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 3.18% : 0.000570s : 1: renormalize.infer 2.61% : 0.000468s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000047s : 1: rewriter_after_opt_a 0.60% : 0.000108s : 1: rewriter_before_opt_a 0.48% : 0.000085s : 1: symbol_engine_optimizer 34.87% : 0.006241s : 1: type_inference TotalTime = 0.212474, [30] [bootstrap]: 0.0003195 [type_inference]: 0.197376 [event_method]: 2.319e-05 [auto_monad]: 7.248e-05 [graph_reusing]: 5.67999e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00065839 [rewriter_before_opt_a]: 0.00010378 [expand_dump_flag]: 3.87998e-06 [jit_opt_a]: 0.0106248, [2] [Cycle 1]: 0.00663607, [27] [switch_simplify]: 7.029e-05 [loop_unroll]: 3.431e-05 [a_1]: 0.00073366 [with_stream_mark]: 1.969e-05 [recompute_prepare]: 1.058e-05 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 7.08998e-06 [meta_shard_fg_expand]: 2.60002e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.834e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 6.84999e-06 [renormalize]: 0.00535397 [add_forward_monad_depend]: 8.88002e-06 [auto_monad_grad]: 3.12002e-06 [auto_monad_eliminator]: 2.054e-05 [cse]: 4.167e-05 [replace_applicator]: 2.654e-05 [Cycle 2]: 0.000408, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 6.84001e-06 [a_1]: 0.00013381 [with_stream_mark]: 1.562e-05 [recompute_prepare]: 6.21998e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 2.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.112e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.501e-05 [replace_applicator]: 5.99e-06 [py_interpret_to_execute_after_opt_a]: 1.635e-05 [rewriter_after_opt_a]: 4.191e-05 [convert_after_rewriter]: 8.35999e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.0007248 [jit_opt_b]: 5.776e-05, [1] [Cycle 1]: 5.017e-05, [2] [frontend_op_eliminate]: 2.069e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 2.574e-05 [loop_unroll]: 0.00127534 [jit_opt_after_cconv]: 0.00016427, [1] [Cycle 1]: 0.00015757, [11] [c_1]: 2.627e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 6.56e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 2.767e-05 [call_graph_tuple_transform]: 2.325e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.71999e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 3.43e-06 [environ_conv]: 9.34998e-06 [add_recomputation]: 5.12e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.875e-05, [1] [cse]: 1.343e-05 [auto_monad_reorder]: 1.883e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 5.21002e-06 [opt_after_jit_grad]: 0.00047132 [symbol_engine_optimizer]: 7.957e-05, [1] [Cycle 1]: 7.264e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 8.85001e-06 [elim_not_effective]: 1.457e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 9.66e-06 [renormalize]: 4.90021e-07 [validate]: 8.875e-05 Sums bootstrap : 0.000319s : 0.15% type_inference : 0.197376s : 94.78% event_method : 0.000023s : 0.01% auto_monad : 0.000072s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000658s : 0.32% rewriter_before_opt_a : 0.000104s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000867s : 0.42% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005354s : 2.57% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000057s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000725s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.001275s : 0.61% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000471s : 0.23% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.04% Time group info: ------[substitution.] 0.000288 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000008s : 4: substitution.graph_param_transform 86.06% : 0.000248s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 4.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.197289 2 98.50% : 0.194326s : 1: type_inference.infer 1.50% : 0.002963s : 1: type_inference.specialize ------[replace.] 0.000114 7 69.19% : 0.000079s : 5: replace.inline 30.81% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 95.35% : 0.000245s : 5: match.inline 4.65% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.50% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.98% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.37% : 0.000001s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.73% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.30% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.29% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.14% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.46% : 0.000004s : 23: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.50% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002531 25 64.94% : 0.001644s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.84% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.22% : 0.000816s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.219018 72 0.03% : 0.000055s : 1: add_recomputation 0.03% : 0.000076s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.15% : 0.000334s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.85% : 0.010629s : 1: jit_opt_a 0.08% : 0.000167s : 1: jit_opt_after_cconv 0.03% : 0.000061s : 1: jit_opt_b 0.59% : 0.001286s : 1: loop_unroll 0.34% : 0.000734s : 1: mutable_eliminate 0.52% : 0.001149s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000479s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000670s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.93% : 0.002044s : 1: renormalize.infer 1.51% : 0.003298s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.05% : 0.000109s : 1: rewriter_before_opt_a 0.04% : 0.000082s : 1: symbol_engine_optimizer 90.13% : 0.197394s : 1: type_inference TotalTime = 0.252854, [30] [bootstrap]: 0.00037806 [type_inference]: 0.236331 [event_method]: 2.905e-05 [auto_monad]: 8.719e-05 [graph_reusing]: 7.53999e-06 [pre_auto_parallel]: 2.78998e-06 [py_interpret_to_execute]: 0.00083882 [rewriter_before_opt_a]: 0.00012599 [expand_dump_flag]: 4.32e-06 [jit_opt_a]: 0.0117038, [2] [Cycle 1]: 0.00617578, [27] [switch_simplify]: 8.062e-05 [loop_unroll]: 3.706e-05 [a_1]: 0.00087461 [with_stream_mark]: 2.576e-05 [recompute_prepare]: 1.216e-05 [updatestate_depend_eliminate]: 4.54998e-06 [updatestate_assign_eliminate]: 3.73999e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 9.05999e-06 [updatestate_useless_node_eliminater]: 7.56001e-06 [accelerated_algorithm]: 8.47998e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 7.87003e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.759e-05 [j_node_and_user_rematch]: 1.154e-05 [meta_fg_expand]: 2.83998e-06 [replace_old_param]: 1.25e-05 [inline_without_move]: 7.1e-06 [renormalize]: 0.00467446 [add_forward_monad_depend]: 1.307e-05 [auto_monad_grad]: 2.51998e-06 [auto_monad_eliminator]: 2.679e-05 [cse]: 4.781e-05 [replace_applicator]: 3.202e-05 [Cycle 2]: 0.0005073, [27] [switch_simplify]: 9.91e-06 [loop_unroll]: 7.82e-06 [a_1]: 0.00016819 [with_stream_mark]: 2.031e-05 [recompute_prepare]: 6.66e-06 [updatestate_depend_eliminate]: 4.59998e-06 [updatestate_assign_eliminate]: 3.88001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.99001e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 7.51001e-06 [accelerated_algorithm]: 7.70998e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.93e-06 [merge_forward]: 5.16998e-06 [cell_reuse_recompute_pass]: 4.68999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.76e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 3.90998e-06 [replace_old_param]: 1.212e-05 [inline_without_move]: 7.13e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.04e-06 [auto_monad_grad]: 1.45999e-06 [auto_monad_eliminator]: 1.232e-05 [cse]: 2.366e-05 [replace_applicator]: 8.64e-06 [py_interpret_to_execute_after_opt_a]: 2.476e-05 [rewriter_after_opt_a]: 4.979e-05 [convert_after_rewriter]: 7.92e-06 [order_py_execute_after_rewriter]: 6.43998e-06 [mutable_eliminate]: 0.00110365 [jit_opt_b]: 7.63e-05, [1] [Cycle 1]: 6.505e-05, [2] [frontend_op_eliminate]: 2.643e-05 [inline_after_opt_a]: 2.354e-05 [cconv]: 4.432e-05 [loop_unroll]: 0.00058282 [jit_opt_after_cconv]: 0.000215, [1] [Cycle 1]: 0.00020606, [11] [c_1]: 3.055e-05 [parameter_eliminate]: 7.46001e-06 [updatestate_depend_eliminate]: 1.394e-05 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.26999e-06 [cse]: 4.555e-05 [call_graph_tuple_transform]: 3.089e-05 [tuple_list_get_item_eliminator]: 7.65e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 1.24e-06 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.898e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.112e-05 [add_recomputation]: 5.98e-05 [cse_after_recomputation]: 3.232e-05, [1] [Cycle 1]: 2.516e-05, [1] [cse]: 1.801e-05 [auto_monad_reorder]: 2.004e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 1.092e-05 [opt_after_jit_grad]: 0.0006075 [symbol_engine_optimizer]: 0.00014637, [1] [Cycle 1]: 0.00013929, [6] [build]: 5.74e-06 [elim_shapecalc]: 1.095e-05 [elim_not_effective]: 6.768e-05 [opt_reshape]: 9.87999e-06 [fold_const_symbol]: 1.245e-05 [renormalize]: 7.29982e-07 [validate]: 6.632e-05 Sums bootstrap : 0.000378s : 0.15% type_inference : 0.236331s : 95.66% event_method : 0.000029s : 0.01% auto_monad : 0.000087s : 0.04% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000839s : 0.34% rewriter_before_opt_a : 0.000126s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.04% jit_opt_a.loop_unroll : 0.000045s : 0.02% jit_opt_a.a_1 : 0.001043s : 0.42% jit_opt_a.with_stream_mark : 0.000046s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004675s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.02% jit_opt_a.cse : 0.000071s : 0.03% jit_opt_a.replace_applicator : 0.000041s : 0.02% py_interpret_to_execute_after_opt_a : 0.000025s : 0.01% rewriter_after_opt_a : 0.000050s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001104s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000024s : 0.01% cconv : 0.000044s : 0.02% loop_unroll : 0.000583s : 0.24% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000046s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000060s : 0.02% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.00% opt_after_jit_grad : 0.000607s : 0.25% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000068s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000066s : 0.03% Time group info: ------[substitution.] 0.000434 28 11.34% : 0.000049s : 2: substitution.elim_not_effective 0.38% : 0.000002s : 2: substitution.fold_const_symbol 1.62% : 0.000007s : 4: substitution.graph_param_transform 75.13% : 0.000326s : 5: substitution.inline 1.29% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.03% : 0.000017s : 3: substitution.reduce_eliminate 1.24% : 0.000005s : 4: substitution.remove_not_recompute_node 1.72% : 0.000007s : 2: substitution.replace_old_param 3.24% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.236204 2 97.92% : 0.231286s : 1: type_inference.infer 2.08% : 0.004919s : 1: type_inference.specialize ------[replace.] 0.000128 7 67.07% : 0.000086s : 5: replace.inline 32.93% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000335 7 96.39% : 0.000323s : 5: match.inline 3.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000170 886 1.44% : 0.000002s : 13: predicate.accumulaten_eliminater 1.38% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.52% : 0.000004s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_depend_swap 1.05% : 0.000002s : 13: predicate.environ_get_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000003s : 8: predicate.less_batch_normalization 1.58% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.66% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.39% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.28% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 2.57% : 0.000004s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 1.99% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 2.60% : 0.000004s : 13: predicate.reduce_eliminate 1.59% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 1.11% : 0.000002s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.48% : 0.000011s : 64: predicate.switch_simplify 1.50% : 0.000003s : 13: predicate.tile_eliminate 1.13% : 0.000002s : 13: predicate.transpose_eliminate 1.30% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.99% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.00% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003737 25 55.83% : 0.002086s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.83% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.34% : 0.001545s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.259012 72 0.02% : 0.000064s : 1: add_recomputation 0.04% : 0.000091s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.15% : 0.000398s : 1: bootstrap 0.02% : 0.000047s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 4.52% : 0.011709s : 1: jit_opt_a 0.08% : 0.000218s : 1: jit_opt_after_cconv 0.03% : 0.000080s : 1: jit_opt_b 0.23% : 0.000595s : 1: loop_unroll 0.43% : 0.001123s : 1: mutable_eliminate 0.52% : 0.001355s : 26: opt.transform.jit_opt_a 0.03% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000031s : 1: opt.transform.mutable_eliminate 0.01% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000096s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000619s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000853s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.23% : 0.003184s : 1: renormalize.infer 0.57% : 0.001475s : 1: renormalize.specialize 0.01% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000054s : 1: rewriter_after_opt_a 0.05% : 0.000133s : 1: rewriter_before_opt_a 0.06% : 0.000150s : 1: symbol_engine_optimizer 91.25% : 0.236358s : 1: type_inference TotalTime = 0.0299873, [30] [bootstrap]: 0.00026749 [type_inference]: 0.0208573 [event_method]: 2.023e-05 [auto_monad]: 6.816e-05 [graph_reusing]: 6.51999e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00010243 [rewriter_before_opt_a]: 7.96e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.00607003, [2] [Cycle 1]: 0.00205737, [27] [switch_simplify]: 5.914e-05 [loop_unroll]: 3.02e-05 [a_1]: 0.00057449 [with_stream_mark]: 2.234e-05 [recompute_prepare]: 1.188e-05 [updatestate_depend_eliminate]: 4.98001e-06 [updatestate_assign_eliminate]: 3.97998e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.58998e-06 [updatestate_useless_node_eliminater]: 5.33002e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.754e-05 [j_node_and_user_rematch]: 9.74999e-06 [meta_fg_expand]: 3.06001e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.00096023 [add_forward_monad_depend]: 9.12001e-06 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 2.112e-05 [cse]: 3.755e-05 [replace_applicator]: 2.048e-05 [Cycle 2]: 0.00036473, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.07999e-06 [a_1]: 9.294e-05 [with_stream_mark]: 1.633e-05 [recompute_prepare]: 7.33999e-06 [updatestate_depend_eliminate]: 4.68001e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 2.26998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.907e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.22001e-06 [auto_monad_grad]: 1.24998e-06 [auto_monad_eliminator]: 9.82001e-06 [cse]: 1.459e-05 [replace_applicator]: 7.06999e-06 [py_interpret_to_execute_after_opt_a]: 1.716e-05 [rewriter_after_opt_a]: 4.611e-05 [convert_after_rewriter]: 7.90998e-06 [order_py_execute_after_rewriter]: 5.71003e-06 [mutable_eliminate]: 0.00078118 [jit_opt_b]: 5.5e-05, [1] [Cycle 1]: 4.563e-05, [2] [frontend_op_eliminate]: 1.547e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 2.944e-05 [loop_unroll]: 0.00048153 [jit_opt_after_cconv]: 0.00016789, [1] [Cycle 1]: 0.00016042, [11] [c_1]: 2.151e-05 [parameter_eliminate]: 4.01001e-06 [updatestate_depend_eliminate]: 9.97001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.307e-05 [call_graph_tuple_transform]: 2.162e-05 [tuple_list_get_item_eliminator]: 5.91e-06 [none_parameter_eliminate]: 2.10002e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.655e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 7.31001e-06 [add_recomputation]: 5.125e-05 [cse_after_recomputation]: 2.291e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.159e-05 [auto_monad_reorder]: 1.932e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 5.81998e-06 [opt_after_jit_grad]: 0.00048034 [symbol_engine_optimizer]: 7.309e-05, [1] [Cycle 1]: 6.693e-05, [6] [build]: 3.72002e-06 [elim_shapecalc]: 7.75e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 5.90002e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 5.50004e-07 [validate]: 4.407e-05 Sums bootstrap : 0.000267s : 1.04% type_inference : 0.020857s : 81.19% event_method : 0.000020s : 0.08% auto_monad : 0.000068s : 0.27% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000102s : 0.40% rewriter_before_opt_a : 0.000080s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000667s : 2.60% jit_opt_a.with_stream_mark : 0.000039s : 0.15% jit_opt_a.recompute_prepare : 0.000019s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000960s : 3.74% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.12% jit_opt_a.cse : 0.000052s : 0.20% jit_opt_a.replace_applicator : 0.000028s : 0.11% py_interpret_to_execute_after_opt_a : 0.000017s : 0.07% rewriter_after_opt_a : 0.000046s : 0.18% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000781s : 3.04% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000029s : 0.11% loop_unroll : 0.000482s : 1.87% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000033s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000051s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000480s : 1.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.17% Time group info: ------[substitution.] 0.000225 23 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 3: substitution.graph_param_transform 82.51% : 0.000186s : 4: substitution.inline 1.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.51% : 0.000006s : 2: substitution.replace_old_param 6.58% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020784 2 93.59% : 0.019453s : 1: type_inference.infer 6.41% : 0.001332s : 1: type_inference.specialize ------[replace.] 0.000079 6 65.00% : 0.000051s : 4: replace.inline 35.00% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 93.36% : 0.000183s : 4: match.inline 6.64% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.20% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 2.64% : 0.000003s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.10% : 0.000001s : 10: predicate.environ_get_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.81% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 2.01% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.66% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.83% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.52% : 0.000003s : 15: predicate.partial_eliminate 1.03% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.88% : 0.000001s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 1.17% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.87% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000754 13 43.47% : 0.000328s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.44% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.09% : 0.000385s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031908 72 0.17% : 0.000054s : 1: add_recomputation 0.22% : 0.000072s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 0.87% : 0.000279s : 1: bootstrap 0.10% : 0.000033s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.03% : 0.006074s : 1: jit_opt_a 0.54% : 0.000171s : 1: jit_opt_after_cconv 0.18% : 0.000058s : 1: jit_opt_b 1.54% : 0.000490s : 1: loop_unroll 2.49% : 0.000796s : 1: mutable_eliminate 2.85% : 0.000908s : 26: opt.transform.jit_opt_a 0.16% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.53% : 0.000489s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000106s : 1: py_interpret_to_execute 0.06% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.68% : 0.000536s : 1: renormalize.infer 1.30% : 0.000414s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000052s : 1: rewriter_after_opt_a 0.26% : 0.000083s : 1: rewriter_before_opt_a 0.24% : 0.000076s : 1: symbol_engine_optimizer 65.42% : 0.020875s : 1: type_inference TotalTime = 0.0157005, [30] [bootstrap]: 0.00031319 [type_inference]: 0.00663207 [event_method]: 2.367e-05 [auto_monad]: 8.861e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 5.833e-05 [rewriter_before_opt_a]: 0.00010033 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00615111, [2] [Cycle 1]: 0.00231357, [27] [switch_simplify]: 7.367e-05 [loop_unroll]: 3.749e-05 [a_1]: 0.00080818 [with_stream_mark]: 2.352e-05 [recompute_prepare]: 9.25999e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.496e-05 [j_node_and_user_rematch]: 1.061e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00100337 [add_forward_monad_depend]: 7.77e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.632e-05 [cse]: 3.584e-05 [replace_applicator]: 1.542e-05 [Cycle 2]: 0.00033614, [27] [switch_simplify]: 6.37001e-06 [loop_unroll]: 5.69999e-06 [a_1]: 9.066e-05 [with_stream_mark]: 1.127e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.19998e-06 [updatestate_useless_node_eliminater]: 5.51998e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 7.58999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.442e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.397e-05 [rewriter_after_opt_a]: 4.182e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00064117 [jit_opt_b]: 5.085e-05, [1] [Cycle 1]: 4.359e-05, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 1.674e-05 [cconv]: 2.906e-05 [loop_unroll]: 0.00043082 [jit_opt_after_cconv]: 0.00016052, [1] [Cycle 1]: 0.00014825, [11] [c_1]: 2.221e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 7.36001e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 2.662e-05 [call_graph_tuple_transform]: 1.993e-05 [tuple_list_get_item_eliminator]: 6.16998e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.655e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 9.75002e-06 [add_recomputation]: 5.051e-05 [cse_after_recomputation]: 2.572e-05, [1] [Cycle 1]: 1.984e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.736e-05 [get_jit_bprop_graph]: 2.68e-06 [rewriter_after_jit_bprop_graph]: 6.12001e-06 [opt_after_jit_grad]: 0.00048697 [symbol_engine_optimizer]: 8.309e-05, [1] [Cycle 1]: 7.63e-05, [6] [build]: 1.085e-05 [elim_shapecalc]: 8.80999e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.65999e-06 [renormalize]: 5.50004e-07 [validate]: 4.685e-05 Sums bootstrap : 0.000313s : 2.71% type_inference : 0.006632s : 57.29% event_method : 0.000024s : 0.20% auto_monad : 0.000089s : 0.77% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000058s : 0.50% rewriter_before_opt_a : 0.000100s : 0.87% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000080s : 0.69% jit_opt_a.loop_unroll : 0.000043s : 0.37% jit_opt_a.a_1 : 0.000899s : 7.77% jit_opt_a.with_stream_mark : 0.000035s : 0.30% jit_opt_a.recompute_prepare : 0.000015s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001003s : 8.67% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.20% jit_opt_a.cse : 0.000050s : 0.43% jit_opt_a.replace_applicator : 0.000021s : 0.18% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000042s : 0.36% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000641s : 5.54% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000029s : 0.25% loop_unroll : 0.000431s : 3.72% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000010s : 0.08% add_recomputation : 0.000051s : 0.44% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000487s : 4.21% symbol_engine_optimizer.build : 0.000011s : 0.09% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.40% Time group info: ------[substitution.] 0.000356 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.72% : 0.000006s : 3: substitution.graph_param_transform 88.73% : 0.000316s : 5: substitution.inline 1.32% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.39% : 0.000005s : 4: substitution.remove_not_recompute_node 1.45% : 0.000005s : 2: substitution.replace_old_param 4.38% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006550 2 77.87% : 0.005100s : 1: type_inference.infer 22.13% : 0.001449s : 1: type_inference.specialize ------[replace.] 0.000113 8 65.20% : 0.000074s : 5: replace.inline 34.80% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000326 8 95.81% : 0.000313s : 5: match.inline 4.19% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 810 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.58% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000008s : 26: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.54% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.24% : 0.000002s : 12: predicate.minmaximum_grad 1.32% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000003s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000003s : 21: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.54% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.83% : 0.000011s : 64: predicate.switch_simplify 1.56% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001032 16 49.12% : 0.000507s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.39% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.49% : 0.000438s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017899 72 0.30% : 0.000054s : 1: add_recomputation 0.52% : 0.000093s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.87% : 0.000334s : 1: bootstrap 0.18% : 0.000031s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000028s : 1: cse_after_recomputation 0.07% : 0.000012s : 1: environ_conv 0.16% : 0.000028s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 34.38% : 0.006154s : 1: jit_opt_a 0.91% : 0.000163s : 1: jit_opt_after_cconv 0.30% : 0.000053s : 1: jit_opt_b 2.45% : 0.000439s : 1: loop_unroll 3.64% : 0.000651s : 1: mutable_eliminate 6.43% : 0.001150s : 26: opt.transform.jit_opt_a 0.28% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000495s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000062s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 3.05% : 0.000546s : 1: renormalize.infer 2.50% : 0.000448s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000045s : 1: rewriter_after_opt_a 0.58% : 0.000104s : 1: rewriter_before_opt_a 0.48% : 0.000086s : 1: symbol_engine_optimizer 37.17% : 0.006653s : 1: type_inference TotalTime = 0.0569417, [30] [bootstrap]: 0.00031054 [type_inference]: 0.0449625 [event_method]: 2.045e-05 [auto_monad]: 7.325e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 0.00015128 [rewriter_before_opt_a]: 8.663e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00720723, [2] [Cycle 1]: 0.00293832, [27] [switch_simplify]: 7.463e-05 [loop_unroll]: 3.211e-05 [a_1]: 0.00066326 [with_stream_mark]: 2.238e-05 [recompute_prepare]: 1.148e-05 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.57002e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 3.3e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.621e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 3.56999e-06 [replace_old_param]: 1.189e-05 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00172416 [add_forward_monad_depend]: 8.67e-06 [auto_monad_grad]: 3.31999e-06 [auto_monad_eliminator]: 1.929e-05 [cse]: 3.774e-05 [replace_applicator]: 2.153e-05 [Cycle 2]: 0.00039721, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.00011013 [with_stream_mark]: 1.455e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.843e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.94e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 2.69001e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 8.53001e-06 [cse]: 1.872e-05 [replace_applicator]: 7.48e-06 [py_interpret_to_execute_after_opt_a]: 1.849e-05 [rewriter_after_opt_a]: 4.476e-05 [convert_after_rewriter]: 7.87e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00078072 [jit_opt_b]: 6.496e-05, [1] [Cycle 1]: 5.628e-05, [2] [frontend_op_eliminate]: 2.177e-05 [inline_after_opt_a]: 2.094e-05 [cconv]: 3.284e-05 [loop_unroll]: 0.00054932 [jit_opt_after_cconv]: 0.00017714, [1] [Cycle 1]: 0.00016877, [11] [c_1]: 2.483e-05 [parameter_eliminate]: 4.87e-06 [updatestate_depend_eliminate]: 8.98002e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.29e-05 [call_graph_tuple_transform]: 2.251e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 2.03002e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 5.64998e-06 [remove_dup_value]: 1.926e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 7.16999e-06 [add_recomputation]: 5.531e-05 [cse_after_recomputation]: 2.905e-05, [1] [Cycle 1]: 2.202e-05, [1] [cse]: 1.362e-05 [auto_monad_reorder]: 1.985e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 7.92e-06 [opt_after_jit_grad]: 0.00184883 [symbol_engine_optimizer]: 0.00016789, [1] [Cycle 1]: 0.00015882, [6] [build]: 5.31998e-06 [elim_shapecalc]: 1.022e-05 [elim_not_effective]: 2.126e-05 [opt_reshape]: 8.79e-06 [fold_const_symbol]: 1.365e-05 [renormalize]: 6.40022e-07 [validate]: 5.151e-05 Sums bootstrap : 0.000311s : 0.59% type_inference : 0.044963s : 85.99% event_method : 0.000020s : 0.04% auto_monad : 0.000073s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000151s : 0.29% rewriter_before_opt_a : 0.000087s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.16% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000773s : 1.48% jit_opt_a.with_stream_mark : 0.000037s : 0.07% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001724s : 3.30% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.05% jit_opt_a.cse : 0.000056s : 0.11% jit_opt_a.replace_applicator : 0.000029s : 0.06% py_interpret_to_execute_after_opt_a : 0.000018s : 0.04% rewriter_after_opt_a : 0.000045s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000781s : 1.49% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.04% jit_opt_b.inline_after_opt_a : 0.000021s : 0.04% cconv : 0.000033s : 0.06% loop_unroll : 0.000549s : 1.05% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.11% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000020s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.001849s : 3.54% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.10% Time group info: ------[substitution.] 0.000263 23 1.26% : 0.000003s : 2: substitution.elim_not_effective 0.96% : 0.000003s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 3: substitution.graph_param_transform 83.69% : 0.000220s : 4: substitution.inline 1.76% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 5.70% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.044875 2 92.54% : 0.041528s : 1: type_inference.infer 7.46% : 0.003347s : 1: type_inference.specialize ------[replace.] 0.000106 6 66.33% : 0.000071s : 4: replace.inline 33.67% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.42% : 0.000217s : 4: match.inline 5.58% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 691 1.12% : 0.000002s : 10: predicate.accumulaten_eliminater 1.84% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.31% : 0.000002s : 10: predicate.addn_check_dump 1.00% : 0.000001s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.92% : 0.000003s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 10: predicate.compare_switch_simplify 0.99% : 0.000001s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.80% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.71% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 0.91% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000007s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000002s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 1.86% : 0.000003s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.29% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000003s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 2.22% : 0.000003s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 10: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.60% : 0.000004s : 16: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.80% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.23% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002114 13 65.00% : 0.001374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.06% : 0.000699s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059780 72 0.10% : 0.000059s : 1: add_recomputation 0.13% : 0.000077s : 1: auto_monad 0.04% : 0.000023s : 1: auto_monad_reorder 0.55% : 0.000326s : 1: bootstrap 0.06% : 0.000036s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.07% : 0.007213s : 1: jit_opt_a 0.30% : 0.000181s : 1: jit_opt_after_cconv 0.11% : 0.000068s : 1: jit_opt_b 0.94% : 0.000562s : 1: loop_unroll 1.33% : 0.000795s : 1: mutable_eliminate 1.74% : 0.001039s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000034s : 4: opt.transform.jit_opt_b 0.03% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.06% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000048s : 4: opt.transform.symbol_engine_opt 3.12% : 0.001867s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000155s : 1: py_interpret_to_execute 0.04% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 1.64% : 0.000983s : 1: renormalize.infer 1.22% : 0.000728s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000049s : 1: rewriter_after_opt_a 0.15% : 0.000090s : 1: rewriter_before_opt_a 0.29% : 0.000171s : 1: symbol_engine_optimizer 75.25% : 0.044982s : 1: type_inference TotalTime = 0.0139362, [30] [bootstrap]: 0.00029867 [type_inference]: 0.00456135 [event_method]: 1.675e-05 [auto_monad]: 6.603e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 3.533e-05 [rewriter_before_opt_a]: 6.93e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00563558, [2] [Cycle 1]: 0.00182561, [27] [switch_simplify]: 5.772e-05 [loop_unroll]: 2.865e-05 [a_1]: 0.00059622 [with_stream_mark]: 2.306e-05 [recompute_prepare]: 9.64e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 2.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.621e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 6.26e-06 [renormalize]: 0.00075521 [add_forward_monad_depend]: 1.099e-05 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.595e-05 [cse]: 2.798e-05 [replace_applicator]: 1.462e-05 [Cycle 2]: 0.00032364, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 4.99e-06 [a_1]: 8.892e-05 [with_stream_mark]: 1.061e-05 [recompute_prepare]: 4.77998e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.72998e-06 [updatestate_useless_node_eliminater]: 4.70999e-06 [accelerated_algorithm]: 4.55001e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.323e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.78002e-06 [replace_old_param]: 6.66e-06 [inline_without_move]: 4.59998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 5.30001e-06 [cse]: 1.075e-05 [replace_applicator]: 5.14998e-06 [py_interpret_to_execute_after_opt_a]: 1.158e-05 [rewriter_after_opt_a]: 3.592e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00063776 [jit_opt_b]: 0.00092153, [1] [Cycle 1]: 0.00091308, [2] [frontend_op_eliminate]: 1.655e-05 [inline_after_opt_a]: 0.00087708 [cconv]: 3.065e-05 [loop_unroll]: 0.00051358 [jit_opt_after_cconv]: 0.00016068, [1] [Cycle 1]: 0.00015332, [11] [c_1]: 2.194e-05 [parameter_eliminate]: 2.86999e-06 [updatestate_depend_eliminate]: 7.51001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.805e-05 [call_graph_tuple_transform]: 2.114e-05 [tuple_list_get_item_eliminator]: 5.11997e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 3.20026e-07 [switch_simplify]: 5.22999e-06 [remove_dup_value]: 1.562e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.69001e-06 [add_recomputation]: 5.072e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.718e-05, [1] [cse]: 1.065e-05 [auto_monad_reorder]: 1.737e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 6.62002e-06 [opt_after_jit_grad]: 0.00049305 [symbol_engine_optimizer]: 7.82e-05, [1] [Cycle 1]: 7.164e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.458e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 9.55001e-06 [renormalize]: 3.29979e-07 [validate]: 4.206e-05 Sums bootstrap : 0.000299s : 3.04% type_inference : 0.004561s : 46.45% event_method : 0.000017s : 0.17% auto_monad : 0.000066s : 0.67% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.36% rewriter_before_opt_a : 0.000069s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.65% jit_opt_a.loop_unroll : 0.000034s : 0.34% jit_opt_a.a_1 : 0.000685s : 6.98% jit_opt_a.with_stream_mark : 0.000034s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000755s : 7.69% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.13% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.22% jit_opt_a.cse : 0.000039s : 0.39% jit_opt_a.replace_applicator : 0.000020s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000036s : 0.37% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000638s : 6.50% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000877s : 8.93% cconv : 0.000031s : 0.31% loop_unroll : 0.000514s : 5.23% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000051s : 0.52% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000493s : 5.02% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.43% Time group info: ------[substitution.] 0.000261 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 3: substitution.graph_param_transform 86.29% : 0.000226s : 4: substitution.inline 1.49% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.51% : 0.000004s : 2: substitution.replace_old_param 4.99% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004501 2 81.19% : 0.003654s : 1: type_inference.infer 18.81% : 0.000847s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.36% : 0.000044s : 4: replace.inline 33.64% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 6 94.92% : 0.000223s : 4: match.inline 5.08% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.50% : 0.000002s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.16% : 0.000001s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.21% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.98% : 0.000008s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.84% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.14% : 0.000008s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000617 13 48.98% : 0.000302s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.04% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.98% : 0.000271s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015666 72 0.34% : 0.000053s : 1: add_recomputation 0.44% : 0.000069s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 1.98% : 0.000310s : 1: bootstrap 0.21% : 0.000033s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.28% : 0.000044s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.13% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.00% : 0.005639s : 1: jit_opt_a 1.05% : 0.000164s : 1: jit_opt_after_cconv 5.90% : 0.000924s : 1: jit_opt_b 3.34% : 0.000523s : 1: loop_unroll 4.14% : 0.000648s : 1: mutable_eliminate 5.76% : 0.000903s : 26: opt.transform.jit_opt_a 0.32% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000032s : 4: opt.transform.jit_opt_b 0.10% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.20% : 0.000501s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000038s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.58% : 0.000404s : 1: renormalize.infer 2.19% : 0.000344s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.46% : 0.000072s : 1: rewriter_before_opt_a 0.52% : 0.000081s : 1: symbol_engine_optimizer 29.20% : 0.004574s : 1: type_inference TotalTime = 0.0174428, [30] [bootstrap]: 0.00029676 [type_inference]: 0.00910768 [event_method]: 2.278e-05 [auto_monad]: 7.094e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 5.636e-05 [rewriter_before_opt_a]: 9.441e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00568357, [2] [Cycle 1]: 0.00194732, [27] [switch_simplify]: 6.212e-05 [loop_unroll]: 3.66e-05 [a_1]: 0.00068368 [with_stream_mark]: 1.784e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 2.25002e-06 [specialize_transform]: 6.36998e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 0.00081376 [add_forward_monad_depend]: 5.61998e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 1.504e-05 [cse]: 3.438e-05 [replace_applicator]: 1.238e-05 [Cycle 2]: 0.00032773, [27] [switch_simplify]: 6.45002e-06 [loop_unroll]: 5.27001e-06 [a_1]: 9.121e-05 [with_stream_mark]: 9.57999e-06 [recompute_prepare]: 5.19998e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.46998e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.29e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 7.62998e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.23998e-06 [cse]: 1.447e-05 [replace_applicator]: 5.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.194e-05 [rewriter_after_opt_a]: 3.804e-05 [convert_after_rewriter]: 6.75002e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.0005157 [jit_opt_b]: 5.003e-05, [1] [Cycle 1]: 4.362e-05, [2] [frontend_op_eliminate]: 1.625e-05 [inline_after_opt_a]: 1.625e-05 [cconv]: 2.488e-05 [loop_unroll]: 0.00041358 [jit_opt_after_cconv]: 0.0001432, [1] [Cycle 1]: 0.00013717, [11] [c_1]: 2.119e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.305e-05 [call_graph_tuple_transform]: 1.832e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.58e-05 [partial_unused_args_eliminate]: 2.94001e-06 [environ_conv]: 8.82e-06 [add_recomputation]: 4.77e-05 [cse_after_recomputation]: 2.337e-05, [1] [Cycle 1]: 1.822e-05, [1] [cse]: 1.213e-05 [auto_monad_reorder]: 1.698e-05 [get_jit_bprop_graph]: 1.51998e-06 [rewriter_after_jit_bprop_graph]: 4.48999e-06 [opt_after_jit_grad]: 0.00045013 [symbol_engine_optimizer]: 9.069e-05, [1] [Cycle 1]: 8.46e-05, [6] [build]: 1.062e-05 [elim_shapec TotalTime = 0.0125681, [30] [bootstrap]: 0.00031916 [type_inference]: 0.00464794 [event_method]: 1.791e-05 [auto_monad]: 6.479e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 3.604e-05 [rewriter_before_opt_a]: 7.522e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00526391, [2] [Cycle 1]: 0.0017405, [27] [switch_simplify]: 5.615e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00055078 [with_stream_mark]: 2.146e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.06998e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.54002e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 9.40001e-06 [meta_fg_expand]: 2.78998e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 0.00074057 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 1.92999e-06 [auto_monad_eliminator]: 1.459e-05 [cse]: 3.513e-05 [replace_applicator]: 1.304e-05 [Cycle 2]: 0.00032488, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.043e-05 [with_stream_mark]: 1.08e-05 [recompute_prepare]: 5.41998e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.28002e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.56002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.347e-05 [j_node_and_user_rematch]: 7.46001e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.36001e-06 [inline_without_move]: 4.87e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.22e-06 [cse]: 1.359e-05 [replace_applicator]: 5.59998e-06 [py_interpret_to_execute_after_opt_a]: 1.287e-05 [rewriter_after_opt_a]: 3.84e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00056335 [jit_opt_b]: 4.785e-05, [1] [Cycle 1]: 4.143e-05, [2] [frontend_op_eliminate]: 1.508e-05 [inline_after_opt_a]: 1.53e-05 [cconv]: 2.642e-05 [loop_unroll]: 0.00041604 [jit_opt_after_cconv]: 0.00015305, [1] [Cycle 1]: 0.00014658, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.73998e-06 [cse]: 2.265e-05 [call_graph_tuple_transform]: 1.792e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 9.49978e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 6.49999e-06 [add_recomputation]: 5.152e-05 [cse_after_recomputation]: 2.405e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.255e-05 [auto_monad_reorder]: 1.801e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.00045416 [symbol_engine_optimizer]: 7.217e-05, [1] [Cycle 1]: 6.598e-05, [6] [build]: 3.85e-06 [elim_shapecalc]: 7.48999e-06 [elim_not_alc]: 7.53e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 2.067e-05 [renormalize]: 4.10015e-07 [validate]: 4.436e-05 Sums bootstrap : 0.000297s : 2.21% type_inference : 0.009108s : 67.71% event_method : 0.000023s : 0.17% auto_monad : 0.000071s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000056s : 0.42% rewriter_before_opt_a : 0.000094s : 0.70% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.51% jit_opt_a.loop_unroll : 0.000042s : 0.31% jit_opt_a.a_1 : 0.000775s : 5.76% jit_opt_a.with_stream_mark : 0.000027s : 0.20% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000814s : 6.05% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000049s : 0.36% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000038s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000516s : 3.83% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.18% loop_unroll : 0.000414s : 3.07% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : effective]: 1.287e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 4.69998e-07 [validate]: 4.299e-05 Sums bootstrap : 0.000319s : 3.63% type_inference : 0.004648s : 52.88% event_method : 0.000018s : 0.20% auto_monad : 0.000065s : 0.74% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.41% rewriter_before_opt_a : 0.000075s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000641s : 7.29% jit_opt_a.with_stream_mark : 0.000032s : 0.37% jit_opt_a.recompute_prepare : 0.000014s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000741s : 8.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000049s : 0.55% jit_opt_a.replace_applicator : 0.000019s : 0.21% py_interpret_to_execute_after_opt_a : 0.000013s : 0.15% rewriter_after_opt_a : 0.000038s : 0.44% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000563s : 6.41% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.30% loop_unroll : 0.000416s : 4.73% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_ 0.000003s : 0.02% environ_conv : 0.000009s : 0.07% add_recomputation : 0.000048s : 0.35% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000450s : 3.35% symbol_engine_optimizer.build : 0.000011s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000021s : 0.15% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.33% conv : 0.000006s : 0.07% add_recomputation : 0.000052s : 0.59% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000454s : 5.17% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000043s : 0.49% Time group info: ------[substitution.] 0.000223 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000005s : 3: substitution.graph_param_transform 84.93% : 0.000190s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.54% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004591 2 82.61% : 0.003792s : 1: type_inference.infer 17.39% : 0.000798s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.51% : 0.000045s : 4: replace.inline 33.49% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.34% : 0.000187s : 4: match.inline 5.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.32% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.59% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.36% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: Time group info: ------[substitution.] 0.000250 25 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 86.20% : 0.000216s : 5: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000004s : 4: substitution.remove_not_recompute_node 1.81% : 0.000005s : 2: substitution.replace_old_param 5.52% : 0.000014s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009031 2 84.98% : 0.007675s : 1: type_inference.infer 15.02% : 0.001357s : 1: type_inference.specialize ------[replace.] 0.000102 8 64.16% : 0.000066s : 5: replace.inline 35.84% : 0.000037s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 8 94.60% : 0.000213s : 5: match.inline 5.40% : 0.000012s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 810 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.33% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.37% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 21: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.61% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.78% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.18% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.58% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000626 13 51.93% : 0.000325s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.00% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.07% : 0.000251s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014213 72 0.38% : 0.000054s : 1: add_recomputation 0.48% : 0.000068s : 1: auto_monad 0.15% : 0.000021s : 1: auto_monad_reorder 2.36% : 0.000336s : 1: bootstrap 0.20% : 0.000029s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 37.06% : 0.005267s : 1: jit_opt_a 1.10% : 0.000156s : 1: jit_opt_after_cconv 0.35% : 0.000050s : 1: jit_opt_b 2.98% : 0.000424s : 1: loop_unroll 4.03% : 0.000572s : 1: mutable_eliminate 6.03% : 0.000857s : 26: opt.transform.jit_opt_a 0.33% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.26% : 0.000463s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000039s : 1: py_interpret_to_execute 0.11% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000019s : 1: remove_dup_value 2.98% : 0.000424s : 1: renormalize.infer 2.17% : 0.000308s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000041s : 1: rewriter_after_opt_a 0.55% : 0.000078s : 1: rewriter_before_opt_a 0.52% : 0.000074s : 1: symbol_engine_optimizer 32.79% : 0.004660s : 1: type_inference predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.67% : 0.000004s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.58% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001050 16 53.47% : 0.000562s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.07% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.45% : 0.000425s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019317 72 0.26% : 0.000051s : 1: add_recomputation 0.39% : 0.000074s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.65% : 0.000319s : 1: bootstrap 0.14% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000011s : 1: environ_conv 0.14% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.44% : 0.005687s : 1: jit_opt_a 0.76% : 0.000146s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.19% : 0.000422s : 1: loop_unroll 2.71% : 0.000524s : 1: mutable_eliminate 5.20% : 0.001004s : 26: opt.transform.jit_opt_a 0.25% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000043s : 4: opt.transform.symbol_engine_opt 2.37% : 0.000459s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000061s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.32% : 0.000449s : 1: renormalize.infer 1.85% : 0.000357s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000041s : 1: rewriter_after_opt_a 0.50% : 0.000097s : 1: rewriter_before_opt_a 0.48% : 0.000093s : 1: symbol_engine_optimizer 47.24% : 0.009125s : 1: type_inference TotalTime = 0.0168485, [30] [bootstrap]: 0.0002763 [type_inference]: 0.0064145 [event_method]: 2.514e-05 [auto_monad]: 7.183e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 5.653e-05 [rewriter_before_opt_a]: 0.00010251 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.00746137, [2] [Cycle 1]: 0.0035681, [27] [switch_simplify]: 7.17e-05 [loop_unroll]: 3.757e-05 [a_1]: 0.001988 [with_stream_mark]: 2.875e-05 [recompute_prepare]: 1.028e-05 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 1.101e-05 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 4.58001e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.966e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 1.09e-05 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00105589 [add_forward_monad_depend]: 6.56999e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.723e-05 [cse]: 3.509e-05 [replace_applicator]: 1.515e-05 [Cycle 2]: 0.00033123, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.39e-06 [a_1]: 9.277e-05 [with_stream_mark]: 1.015e-05 [recompute_prepare]: 5.43002e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.28002e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.74002e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.85e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.366e-05 [replace_applicator]: 5.44998e-06 [py_interpret_to_execute_after_opt_a]: 1.965e-05 [rewriter_after_opt_a]: 3.993e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00069663 [jit_opt_b]: 5.916e-05, [1] [Cycle 1]: 4.442e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.768e-05 [loop_unroll]: 0.00044779 [jit_opt_after_cconv]: 0.00016828, [1] [Cycle 1]: 0.00015601, [11] [c_1]: 2.091e-05 [parameter_eliminate]: 3.67002e-06 [updatestate_depend_eliminate]: 6.96999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.629e-05 [call_graph_tuple_transform]: 2.75e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.71998e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 9.29e-06 [add_recomputation]: 5.25e-05 [cse_after_recomputation]: 2.655e-05, [1] [Cycle 1]: 2.078e-05, [1] [cse]: 1.407e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.11998e-06 [rewriter_after_jit_bprop_graph]: 6.66999e-06 [opt_after_jit_grad]: 0.00050669 [symbol_engine_optimizer]: 8.128e-05, [1] [Cycle 1]: 7.496e-05, [6] [build]: 1.109e-05 [elim_shapecalc]: 8.24002e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.70001e-06 [renormalize]: 3.99974e-07 [validate]: 4.889e-05 Sums bootstrap : 0.000276s : 2.18% type_inference : 0.006415s : 50.70% event_method : 0.000025s : 0.20% auto_monad : 0.000072s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.45% rewriter_before_opt_a : 0.000103s : 0.81% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000078s : 0.62% jit_opt_a.loop_unroll : 0.000043s : 0.34% jit_opt_a.a_1 : 0.002081s : 16.45% jit_opt_a.with_stream_mark : 0.000039s : 0.31% jit_opt_a.recompute_prepare : 0.000016s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.13% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.001056s : 8.35% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.19% jit_opt_a.cse : 0.000049s : 0.39% jit_opt_a.replace_applicator : 0.000021s : 0.16% py_interpret_to_execute_after_opt_a : 0.000020s : 0.16% rewriter_after_opt_a : 0.000040s : 0.32% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000697s : 5.51% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.13% cconv : 0.000028s : 0.22% loop_unroll : 0.000448s : 3.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.07% add_recomputation : 0.000053s : 0.41% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000507s : 4.00% symbol_engine_optimizer.build : 0.000011s : 0.09% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.39% Time group info: ------[substitution.] 0.000301 25 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 4.18% : 0.000013s : 3: substitution.graph_param_transform 84.89% : 0.000255s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000006s : 2: substitution.replace_old_param 4.83% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006335 2 76.60% : 0.004853s : 1: type_inference.infer 23.40% : 0.001483s : 1: type_inference.specialize ------[replace.] 0.000108 8 64.53% : 0.000070s : 5: replace.inline 35.47% : 0.000038s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 8 95.15% : 0.000252s : 5: match.inline 4.85% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 810 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.34% : 0.000000s : 3: predicate.check_bprop_eliminate 1.07% : 0.000002s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.36% : 0.000009s : 26: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 18: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000004s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000003s : 21: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.78% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.69% : 0.000005s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001046 16 49.25% : 0.000515s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.11% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.64% : 0.000446s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020288 72 0.27% : 0.000056s : 1: add_recomputation 0.37% : 0.000075s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.46% : 0.000296s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000029s : 1: cse_after_recomputation 0.06% : 0.000012s : 1: environ_conv 0.15% : 0.000030s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 36.79% : 0.007465s : 1: jit_opt_a 0.84% : 0.000171s : 1: jit_opt_after_cconv 0.30% : 0.000062s : 1: jit_opt_b 2.25% : 0.000456s : 1: loop_unroll 3.48% : 0.000706s : 1: mutable_eliminate 11.50% : 0.002333s : 26: opt.transform.jit_opt_a 0.28% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.54% : 0.000515s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000060s : 1: py_interpret_to_execute 0.11% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000019s : 1: remove_dup_value 2.83% : 0.000574s : 1: renormalize.infer 2.31% : 0.000470s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000043s : 1: rewriter_after_opt_a 0.52% : 0.000106s : 1: rewriter_before_opt_a 0.41% : 0.000084s : 1: symbol_engine_optimizer 31.71% : 0.006433s : 1: type_inference TotalTime = 0.0422622, [30] [bootstrap]: 0.00033815 [type_inference]: 0.0288078 [event_method]: 2.265e-05 [auto_monad]: 7.651e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00017438 [rewriter_before_opt_a]: 9.202e-05 [expand_dump_flag]: 3.72002e-06 [jit_opt_a]: 0.0100446, [2] [Cycle 1]: 0.00268323, [27] [switch_simplify]: 7.21e-05 [loop_unroll]: 3.174e-05 [a_1]: 0.00063034 [with_stream_mark]: 1.807e-05 [recompute_prepare]: 8.25999e-06 [updatestate_depend_eliminate]: 3.62002e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.61997e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 0.0015535 [add_forward_monad_depend]: 7.89002e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.515e-05 [cse]: 3.589e-05 [replace_applicator]: 1.562e-05 [Cycle 2]: 0.00156481, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 6.08002e-06 [a_1]: 9.965e-05 [with_stream_mark]: 2.659e-05 [recompute_prepare]: 1.491e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.57002e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.842e-05 [j_node_and_user_rematch]: 9.96998e-06 [meta_fg_expand]: 3.37002e-06 [replace_old_param]: 9.70002e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.41e-06 [auto_monad_grad]: 1.43002e-06 [auto_monad_eliminator]: 1.028e-05 [cse]: 2.411e-05 [replace_applicator]: 6.63e-06 [py_interpret_to_execute_after_opt_a]: 1.42e-05 [rewriter_after_opt_a]: 4.006e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 5.67001e-06 [mutable_eliminate]: 0.00079488 [jit_opt_b]: 5.87e-05, [1] [Cycle 1]: 4.947e-05, [2] [frontend_op_eliminate]: 1.959e-05 [inline_after_opt_a]: 1.713e-05 [cconv]: 3.176e-05 [loop_unroll]: 0.00046848 [jit_opt_after_cconv]: 0.00016647, [1] [Cycle 1]: 0.00015944, [11] [c_1]: 2.574e-05 [parameter_eliminate]: 3.78999e-06 [updatestate_depend_eliminate]: 6.59999e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.664e-05 [call_graph_tuple_transform]: 2.321e-05 [tuple_list_get_item_eliminator]: 6.03998e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 5.92999e-06 [add_recomputation]: 5.316e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.834e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 5.804e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 6.88e-06 [opt_after_jit_grad]: 0.00058753 [symbol_engine_optimizer]: 9.403e-05, [1] [Cycle 1]: 8.571e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 9.80002e-06 [elim_not_effective]: 1.805e-05 [opt_reshape]: 8.1e-06 [fold_const_symbol]: 1.234e-05 [renormalize]: 1.12e-06 [validate]: 4.749e-05 Sums bootstrap : 0.000338s : 0.98% type_inference : 0.028808s : 83.15% event_method : 0.000023s : 0.07% auto_monad : 0.000077s : 0.22% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000174s : 0.50% rewriter_before_opt_a : 0.000092s : 0.27% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000078s : 0.23% jit_opt_a.loop_unroll : 0.000038s : 0.11% jit_opt_a.a_1 : 0.000730s : 2.11% jit_opt_a.with_stream_mark : 0.000045s : 0.13% jit_opt_a.recompute_prepare : 0.000023s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.06% jit_opt_a.meta_fg_expand : 0.000006s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001554s : 4.48% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.07% jit_opt_a.cse : 0.000060s : 0.17% jit_opt_a.replace_applicator : 0.000022s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000040s : 0.12% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000795s : 2.29% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000032s : 0.09% loop_unroll : 0.000468s : 1.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.05% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.15% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000058s : 0.17% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000588s : 1.70% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.14% Time group info: ------[substitution.] 0.000251 23 1.12% : 0.000003s : 2: substitution.elim_not_effective 1.00% : 0.000003s : 2: substitution.fold_const_symbol 2.81% : 0.000007s : 3: substitution.graph_param_transform 84.07% : 0.000211s : 4: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.40% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.028713 2 85.74% : 0.024617s : 1: type_inference.infer 14.26% : 0.004096s : 1: type_inference.specialize ------[replace.] 0.000096 6 67.18% : 0.000064s : 4: replace.inline 32.82% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 6 94.39% : 0.000209s : 4: match.inline 5.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000181 691 0.93% : 0.000002s : 10: predicate.accumulaten_eliminater 26.99% : 0.000049s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 10: predicate.addn_check_dump 1.02% : 0.000002s : 10: predicate.addn_zero_filter 1.39% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 0.87% : 0.000002s : 10: predicate.compare_switch_simplify 0.92% : 0.000002s : 10: predicate.depend_value_elim 0.94% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.00% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.24% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.84% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.83% : 0.000002s : 10: predicate.environ_get_depend_swap 1.05% : 0.000002s : 10: predicate.environ_get_eliminate 0.79% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000002s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 3.58% : 0.000006s : 22: predicate.inline 0.67% : 0.000001s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000003s : 12: predicate.list_to_tuple_eliminator_ 1.28% : 0.000002s : 15: predicate.load_eliminater 0.91% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.14% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.59% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000002s : 10: predicate.merge_addn 0.84% : 0.000002s : 10: predicate.minmaximum_grad 0.91% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 1.34% : 0.000002s : 15: predicate.partial_eliminate 0.77% : 0.000001s : 10: predicate.print_const_string_wrapper 1.23% : 0.000002s : 10: predicate.reduce_eliminate 0.98% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.17% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.10% : 0.000002s : 10: predicate.reshape_eliminate 0.93% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 0.89% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.72% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000002s : 6: predicate.specialize_transform 1.14% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.75% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.28% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.50% : 0.000003s : 16: predicate.switch_defer_inline 1.71% : 0.000003s : 16: predicate.switch_layer_defer_inline 5.14% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000002s : 10: predicate.tile_eliminate 0.99% : 0.000002s : 10: predicate.transpose_eliminate 1.03% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 2.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.09% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.16% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.28% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.16% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.21% : 0.000002s : 10: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001118 13 41.34% : 0.000462s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.21% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 55.45% : 0.000620s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044922 72 0.13% : 0.000057s : 1: add_recomputation 0.18% : 0.000081s : 1: auto_monad 0.14% : 0.000062s : 1: auto_monad_reorder 0.80% : 0.000358s : 1: bootstrap 0.08% : 0.000034s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 22.37% : 0.010049s : 1: jit_opt_a 0.38% : 0.000169s : 1: jit_opt_after_cconv 0.14% : 0.000061s : 1: jit_opt_b 1.06% : 0.000477s : 1: loop_unroll 1.79% : 0.000805s : 1: mutable_eliminate 2.21% : 0.000991s : 26: opt.transform.jit_opt_a 0.13% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.17% : 0.000076s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000044s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000598s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000179s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 2.06% : 0.000926s : 1: renormalize.infer 1.37% : 0.000617s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000043s : 1: rewriter_after_opt_a 0.21% : 0.000095s : 1: rewriter_before_opt_a 0.22% : 0.000098s : 1: symbol_engine_optimizer 64.17% : 0.028828s : 1: type_inference TotalTime = 0.0156493, [30] [bootstrap]: 0.00030132 [type_inference]: 0.00611292 [event_method]: 1.821e-05 [auto_monad]: 6.79e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 3.995e-05 [rewriter_before_opt_a]: 7.754e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00670782, [2] [Cycle 1]: 0.00181319, [27] [switch_simplify]: 5.396e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00054106 [with_stream_mark]: 1.882e-05 [recompute_prepare]: 1.014e-05 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.415e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.00083485 [add_forward_monad_depend]: 7.2e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.524e-05 [cse]: 2.718e-05 [replace_applicator]: 1.394e-05 [Cycle 2]: 0.00031556, [27] [switch_simplify]: 5.34998e-06 [loop_unroll]: 4.63001e-06 [a_1]: 8.831e-05 [with_stream_mark]: 9.31e-06 [recompute_prepare]: 5.21002e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 4.75001e-06 [updatestate_useless_node_eliminater]: 4.71002e-06 [accelerated_algorithm]: 4.47998e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 4.37e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 2.16003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.391e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 6.86001e-06 [inline_without_move]: 4.48001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.80002e-06 [cse]: 1.083e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.225e-05 [rewriter_after_opt_a]: 3.405e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00065248 [jit_opt_b]: 4.908e-05, [1] [Cycle 1]: 4.244e-05, [2] [frontend_op_eliminate]: 1.564e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 2.652e-05 [loop_unroll]: 0.00047155 [jit_opt_after_cconv]: 0.00014747, [1] [Cycle 1]: 0.00014027, [11] [c_1]: 2.056e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.443e-05 [call_graph_tuple_transform]: 1.851e-05 [tuple_list_get_item_eliminator]: 5.15999e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 1.45e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 6.78998e-06 [add_recomputation]: 4.698e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.714e-05, [1] [cse]: 1.1e-05 [auto_monad_reorder]: 1.432e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00049814 [symbol_engine_optimizer]: 7.309e-05, [1] [Cycle 1]: 6.607e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.07998e-06 [renormalize]: 5.50004e-07 [validate]: 3.763e-05 Sums bootstrap : 0.000301s : 2.88% type_inference : 0.006113s : 58.34% event_method : 0.000018s : 0.17% auto_monad : 0.000068s : 0.65% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000040s : 0.38% rewriter_before_opt_a : 0.000078s : 0.74% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.57% jit_opt_a.loop_unroll : 0.000034s : 0.33% jit_opt_a.a_1 : 0.000629s : 6.01% jit_opt_a.with_stream_mark : 0.000028s : 0.27% jit_opt_a.recompute_prepare : 0.000015s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000835s : 7.97% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.20% jit_opt_a.cse : 0.000038s : 0.36% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000034s : 0.32% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000652s : 6.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000027s : 0.25% loop_unroll : 0.000472s : 4.50% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000014s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000047s : 0.45% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000014s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000498s : 4.75% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000038s : 0.36% Time group info: ------[substitution.] 0.000206 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000006s : 3: substitution.graph_param_transform 83.64% : 0.000172s : 4: substitution.inline 1.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 6.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006048 2 82.88% : 0.005012s : 1: type_inference.infer 17.12% : 0.001035s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.29% : 0.000049s : 4: replace.inline 33.71% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.71% : 0.000169s : 4: match.inline 6.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.65% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.36% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.51% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.01% : 0.000002s : 15: predicate.load_eliminater 1.85% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.33% : 0.000002s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.90% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.55% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.54% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000699 13 48.71% : 0.000341s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.32% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.97% : 0.000329s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017375 72 0.29% : 0.000050s : 1: add_recomputation 0.41% : 0.000071s : 1: auto_monad 0.10% : 0.000017s : 1: auto_monad_reorder 1.84% : 0.000319s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 38.62% : 0.006711s : 1: jit_opt_a 0.86% : 0.000150s : 1: jit_opt_after_cconv 0.30% : 0.000052s : 1: jit_opt_b 2.77% : 0.000480s : 1: loop_unroll 3.81% : 0.000663s : 1: mutable_eliminate 4.84% : 0.000841s : 26: opt.transform.jit_opt_a 0.27% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.13% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.92% : 0.000508s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000043s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.52% : 0.000437s : 1: renormalize.infer 2.24% : 0.000389s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000038s : 1: rewriter_after_opt_a 0.46% : 0.000080s : 1: rewriter_before_opt_a 0.43% : 0.000075s : 1: symbol_engine_optimizer 35.25% : 0.006125s : 1: type_inference TotalTime = 0.15764, [30] [bootstrap]: 0.00027894 [type_inference]: 0.143703 [event_method]: 2.634e-05 [auto_monad]: 7.685e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 0.00047337 [rewriter_before_opt_a]: 0.00010158 [expand_dump_flag]: 3.72002e-06 [jit_opt_a]: 0.0103346, [2] [Cycle 1]: 0.00398249, [27] [switch_simplify]: 6.675e-05 [loop_unroll]: 3.359e-05 [a_1]: 0.00068437 [with_stream_mark]: 1.801e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.26998e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.72002e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.013e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.00279996 [add_forward_monad_depend]: 8.12e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.031e-05 [cse]: 3.777e-05 [replace_applicator]: 1.981e-05 [Cycle 2]: 0.00039511, [27] [switch_simplify]: 7.65e-06 [loop_unroll]: 6.58998e-06 [a_1]: 0.00012094 [with_stream_mark]: 1.443e-05 [recompute_prepare]: 6.76999e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 2.97002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.895e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 9.74999e-06 [inline_without_move]: 6.41998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 7.41999e-06 [cse]: 1.621e-05 [replace_applicator]: 6.33998e-06 [py_interpret_to_execute_after_opt_a]: 1.451e-05 [rewriter_after_opt_a]: 4.119e-05 [convert_after_rewriter]: 7.54002e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00072451 [jit_opt_b]: 6.457e-05, [1] [Cycle 1]: 5.527e-05, [2] [frontend_op_eliminate]: 2.47e-05 [inline_after_opt_a]: 1.8e-05 [cconv]: 3.135e-05 [loop_unroll]: 0.00048264 [jit_opt_after_cconv]: 0.00017886, [1] [Cycle 1]: 0.00017101, [11] [c_1]: 2.591e-05 [parameter_eliminate]: 4.15e-06 [updatestate_depend_eliminate]: 9.49e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [cse]: 3.556e-05 [call_graph_tuple_transform]: 2.401e-05 [tuple_list_get_item_eliminator]: 6.74001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.06998e-06 [remove_dup_value]: 1.903e-05 [partial_unused_args_eliminate]: 2.76999e-06 [environ_conv]: 1.034e-05 [add_recomputation]: 5.956e-05 [cse_after_recomputation]: 2.694e-05, [1] [Cycle 1]: 2.143e-05, [1] [cse]: 1.564e-05 [auto_monad_reorder]: 1.944e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 5.99e-06 [opt_after_jit_grad]: 0.00049124 [symbol_engine_optimizer]: 8.557e-05, [1] [Cycle 1]: 7.784e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 8.74e-06 [elim_not_effective]: 1.729e-05 [opt_reshape]: 1.019e-05 [fold_const_symbol]: 9.10999e-06 [renormalize]: 6.10016e-07 [validate]: 0.00015651 Sums bootstrap : 0.000279s : 0.18% type_inference : 0.143703s : 95.14% event_method : 0.000026s : 0.02% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000473s : 0.31% rewriter_before_opt_a : 0.000102s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000805s : 0.53% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002800s : 1.85% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000725s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000483s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000060s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000491s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000157s : 0.10% Time group info: ------[substitution.] 0.000255 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000007s : 4: substitution.graph_param_transform 84.15% : 0.000214s : 5: substitution.inline 1.86% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 5.48% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.143615 2 97.85% : 0.140530s : 1: type_inference.infer 2.15% : 0.003086s : 1: type_inference.specialize ------[replace.] 0.000108 7 69.25% : 0.000075s : 5: replace.inline 30.75% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 7 94.32% : 0.000212s : 5: match.inline 5.68% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.25% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000002s : 13: predicate.arithmetic_simplify 1.48% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.38% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.64% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.80% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 1.11% : 0.000002s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002417 25 62.21% : 0.001504s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.41% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.38% : 0.000855s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.161485 72 0.04% : 0.000063s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.18% : 0.000297s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.40% : 0.010338s : 1: jit_opt_a 0.11% : 0.000181s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.30% : 0.000492s : 1: loop_unroll 0.46% : 0.000736s : 1: mutable_eliminate 0.66% : 0.001069s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000501s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000480s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.21% : 0.001961s : 1: renormalize.infer 0.51% : 0.000829s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000107s : 1: rewriter_before_opt_a 0.05% : 0.000088s : 1: symbol_engine_optimizer 89.00% : 0.143728s : 1: type_inference TotalTime = 0.0140828, [30] [bootstrap]: 0.00033443 [type_inference]: 0.00533694 [event_method]: 1.817e-05 [auto_monad]: 6.624e-05 [graph_reusing]: 5.49998e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 3.631e-05 [rewriter_before_opt_a]: 7.241e-05 [expand_dump_flag]: 3.67002e-06 [jit_opt_a]: 0.0057903, [2] [Cycle 1]: 0.00197654, [27] [switch_simplify]: 4.933e-05 [loop_unroll]: 3.042e-05 [a_1]: 0.00057064 [with_stream_mark]: 1.956e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.78998e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 1.86e-05 [meta_fg_expand]: 3.16999e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00077868 [add_forward_monad_depend]: 6.78998e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 1.571e-05 [cse]: 2.918e-05 [replace_applicator]: 1.42e-05 [Cycle 2]: 0.00034239, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.128e-05 [with_stream_mark]: 1.063e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 4.98001e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.41999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 1.61998e-06 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.351e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.497e-05 [rewriter_after_opt_a]: 4.151e-05 [convert_after_rewriter]: 8.58001e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00064885 [jit_opt_b]: 5.299e-05, [1] [Cycle 1]: 4.539e-05, [2] [frontend_op_eliminate]: 1.602e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.9e-05 [loop_unroll]: 0.00045893 [jit_opt_after_cconv]: 0.00017482, [1] [Cycle 1]: 0.00016737, [11] [c_1]: 2.282e-05 [parameter_eliminate]: 4.65999e-06 [updatestate_depend_eliminate]: 6.98e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.63003e-06 [cse]: 3.068e-05 [call_graph_tuple_transform]: 2.858e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.671e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 6.33e-06 [add_recomputation]: 4.855e-05 [cse_after_recomputation]: 2.585e-05, [1] [Cycle 1]: 1.976e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.672e-05 [get_jit_bprop_graph]: 2.74001e-06 [rewriter_after_jit_bprop_graph]: 5.18002e-06 [opt_after_jit_grad]: 0.00054677 [symbol_engine_optimizer]: 7.794e-05, [1] [Cycle 1]: 7.123e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.501e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.36998e-06 [renormalize]: 8.30012e-07 [validate]: 4.379e-05 Sums bootstrap : 0.000334s : 3.41% type_inference : 0.005337s : 54.35% event_method : 0.000018s : 0.19% auto_monad : 0.000066s : 0.67% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.37% rewriter_before_opt_a : 0.000072s : 0.74% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.56% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000662s : 6.74% jit_opt_a.with_stream_mark : 0.000030s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000012s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000028s : 0.28% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000779s : 7.93% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.05% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000043s : 0.43% jit_opt_a.replace_applicator : 0.000020s : 0.20% py_interpret_to_execute_after_opt_a : 0.000015s : 0.15% rewriter_after_opt_a : 0.000042s : 0.42% convert_after_rewriter : 0.000009s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000649s : 6.61% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000018s : 0.18% cconv : 0.000029s : 0.30% loop_unroll : 0.000459s : 4.67% jit_opt_after_cconv.c_1 : 0.000023s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000031s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.29% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000049s : 0.49% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000017s : 0.17% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000547s : 5.57% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.45% Time group info: ------[substitution.] 0.000231 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 5.60% : 0.000013s : 3: substitution.graph_param_transform 81.48% : 0.000188s : 4: substitution.inline 2.12% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000004s : 2: substitution.replace_old_param 5.31% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005273 2 85.35% : 0.004500s : 1: type_inference.infer 14.65% : 0.000773s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.06% : 0.000047s : 4: replace.inline 33.94% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.36% : 0.000186s : 4: match.inline 5.64% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.06% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.57% : 0.000001s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000006s : 22: predicate.inline 1.07% : 0.000001s : 6: predicate.inline_without_move 0.76% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.30% : 0.000002s : 3: predicate.mutable_eliminate 0.81% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 1.00% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 2.03% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000607 13 48.98% : 0.000297s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.06% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.96% : 0.000261s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015809 72 0.33% : 0.000052s : 1: add_recomputation 0.44% : 0.000069s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 2.23% : 0.000353s : 1: bootstrap 0.20% : 0.000032s : 1: cconv 0.07% : 0.000011s : 1: convert_after_rewriter 0.18% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.65% : 0.005794s : 1: jit_opt_a 1.12% : 0.000178s : 1: jit_opt_after_cconv 0.35% : 0.000056s : 1: jit_opt_b 2.95% : 0.000467s : 1: loop_unroll 4.17% : 0.000659s : 1: mutable_eliminate 5.61% : 0.000886s : 26: opt.transform.jit_opt_a 0.38% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000018s : 1: opt.transform.mutable_eliminate 0.16% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.51% : 0.000555s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000039s : 1: py_interpret_to_execute 0.11% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.73% : 0.000431s : 1: renormalize.infer 2.14% : 0.000339s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000045s : 1: rewriter_after_opt_a 0.48% : 0.000075s : 1: rewriter_before_opt_a 0.51% : 0.000081s : 1: symbol_engine_optimizer 33.85% : 0.005351s : 1: type_inference TotalTime = 0.023574, [30] [bootstrap]: 0.00028848 [type_inference]: 0.0135896 [event_method]: 2.589e-05 [auto_monad]: 7.658e-05 [graph_reusing]: 7.18e-06 [pre_auto_parallel]: 3.31001e-06 [py_interpret_to_execute]: 6.064e-05 [rewriter_before_opt_a]: 0.00010015 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.006774, [2] [Cycle 1]: 0.00250225, [27] [switch_simplify]: 7.17e-05 [loop_unroll]: 3.803e-05 [a_1]: 0.00091616 [with_stream_mark]: 2.577e-05 [recompute_prepare]: 1.022e-05 [updatestate_depend_eliminate]: 4.45999e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.53e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.54e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.105e-05 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00105139 [add_forward_monad_depend]: 9.22001e-06 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 1.932e-05 [cse]: 3.668e-05 [replace_applicator]: 1.979e-05 [Cycle 2]: 0.00039016, [27] [switch_simplify]: 6.57002e-06 [loop_unroll]: 5.54e-06 [a_1]: 9.221e-05 [with_stream_mark]: 1.471e-05 [recompute_prepare]: 7.21001e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.66999e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 2.20002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.707e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 4.92999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.24001e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 2.388e-05 [cse]: 2.247e-05 [replace_applicator]: 6.88e-06 [py_interpret_to_execute_after_opt_a]: 1.775e-05 [rewriter_after_opt_a]: 4.686e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00071958 [jit_opt_b]: 5.591e-05, [1] [Cycle 1]: 4.736e-05, [2] [frontend_op_eliminate]: 1.718e-05 [inline_after_opt_a]: 1.784e-05 [cconv]: 3.291e-05 [loop_unroll]: 0.00051372 [jit_opt_after_cconv]: 0.00017885, [1] [Cycle 1]: 0.00017081, [11] [c_1]: 2.164e-05 [parameter_eliminate]: 5.88998e-06 [updatestate_depend_eliminate]: 8.48999e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.655e-05 [call_graph_tuple_transform]: 2.46e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.97999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 6.39001e-06 [remove_dup_value]: 1.841e-05 [partial_unused_args_eliminate]: 3.16999e-06 [environ_conv]: 1.181e-05 [add_recomputation]: 5.604e-05 [cse_after_recomputation]: 2.854e-05, [1] [Cycle 1]: 2.187e-05, [1] [cse]: 1.435e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 7.44002e-06 [opt_after_jit_grad]: 0.00054968 [symbol_engine_optimizer]: 9.93e-05, [1] [Cycle 1]: 9.209e-05, [6] [build]: 1.081e-05 [elim_shapecalc]: 9.04998e-06 [elim_not_effective]: 1.52e-05 [opt_reshape]: 6.02999e-06 [fold_const_symbol]: 2.098e-05 [renormalize]: 8.70001e-07 [validate]: 4.831e-05 Sums bootstrap : 0.000288s : 1.52% type_inference : 0.013590s : 71.52% event_method : 0.000026s : 0.14% auto_monad : 0.000077s : 0.40% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000061s : 0.32% rewriter_before_opt_a : 0.000100s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000078s : 0.41% jit_opt_a.loop_unroll : 0.000044s : 0.23% jit_opt_a.a_1 : 0.001008s : 5.31% jit_opt_a.with_stream_mark : 0.000040s : 0.21% jit_opt_a.recompute_prepare : 0.000017s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.001051s : 5.53% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000043s : 0.23% jit_opt_a.cse : 0.000059s : 0.31% jit_opt_a.replace_applicator : 0.000027s : 0.14% py_interpret_to_execute_after_opt_a : 0.000018s : 0.09% rewriter_after_opt_a : 0.000047s : 0.25% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000720s : 3.79% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.09% jit_opt_b.inline_after_opt_a : 0.000018s : 0.09% cconv : 0.000033s : 0.17% loop_unroll : 0.000514s : 2.70% jit_opt_after_cconv.c_1 : 0.000022s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000018s : 0.10% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000012s : 0.06% add_recomputation : 0.000056s : 0.29% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000018s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000550s : 2.89% symbol_engine_optimizer.build : 0.000011s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000021s : 0.11% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.25% Time group info: ------[substitution.] 0.000439 25 0.47% : 0.000002s : 2: substitution.elim_not_effective 2.91% : 0.000013s : 2: substitution.fold_const_symbol 1.38% : 0.000006s : 3: substitution.graph_param_transform 61.33% : 0.000269s : 5: substitution.inline 1.14% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.17% : 0.000005s : 4: substitution.remove_not_recompute_node 1.39% : 0.000006s : 2: substitution.replace_old_param 30.21% : 0.000133s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013501 2 88.54% : 0.011955s : 1: type_inference.infer 11.46% : 0.001547s : 1: type_inference.specialize ------[replace.] 0.000136 8 57.58% : 0.000078s : 5: replace.inline 42.42% : 0.000058s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000396 8 67.23% : 0.000266s : 5: match.inline 32.77% : 0.000130s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 810 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.56% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.39% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.56% : 0.000009s : 26: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 18: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.75% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000002s : 12: predicate.minmaximum_grad 2.20% : 0.000003s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000003s : 21: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.57% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.71% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.48% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001118 16 51.78% : 0.000579s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.55% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.68% : 0.000455s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025974 72 0.23% : 0.000060s : 1: add_recomputation 0.31% : 0.000081s : 1: auto_monad 0.08% : 0.000021s : 1: auto_monad_reorder 1.19% : 0.000308s : 1: bootstrap 0.14% : 0.000036s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.12% : 0.000031s : 1: cse_after_recomputation 0.05% : 0.000014s : 1: environ_conv 0.15% : 0.000040s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 26.10% : 0.006778s : 1: jit_opt_a 0.70% : 0.000182s : 1: jit_opt_after_cconv 0.23% : 0.000059s : 1: jit_opt_b 2.02% : 0.000525s : 1: loop_unroll 2.83% : 0.000734s : 1: mutable_eliminate 4.89% : 0.001269s : 26: opt.transform.jit_opt_a 0.21% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000023s : 1: opt.transform.mutable_eliminate 0.11% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000048s : 4: opt.transform.symbol_engine_opt 2.16% : 0.000561s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000064s : 1: py_interpret_to_execute 0.08% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000022s : 1: remove_dup_value 2.20% : 0.000572s : 1: renormalize.infer 1.81% : 0.000470s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000051s : 1: rewriter_after_opt_a 0.40% : 0.000104s : 1: rewriter_before_opt_a 0.39% : 0.000102s : 1: symbol_engine_optimizer 52.41% : 0.013613s : 1: type_inference TotalTime = 0.0158677, [30] [bootstrap]: 0.00028203 [type_inference]: 0.00654661 [event_method]: 2.202e-05 [auto_monad]: 6.915e-05 [graph_reusing]: 6.18002e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 5.734e-05 [rewriter_before_opt_a]: 9.615e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00664691, [2] [Cycle 1]: 0.00222531, [27] [switch_simplify]: 7.295e-05 [loop_unroll]: 3.728e-05 [a_1]: 0.0007492 [with_stream_mark]: 2.229e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.79999e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 5.49998e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.50998e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 5.53002e-06 [renormalize]: 0.00099928 [add_forward_monad_depend]: 5.96e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.59e-05 [cse]: 3.542e-05 [replace_applicator]: 1.25e-05 [Cycle 2]: 0.00032676, [27] [switch_simplify]: 6.50002e-06 [loop_unroll]: 5.46e-06 [a_1]: 9.091e-05 [with_stream_mark]: 8.87e-06 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.08002e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.321e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.276e-05 [rewriter_after_opt_a]: 3.921e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00055654 [jit_opt_b]: 5.025e-05, [1] [Cycle 1]: 4.31e-05, [2] [frontend_op_eliminate]: 1.616e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 2.565e-05 [loop_unroll]: 0.00042022 [jit_opt_after_cconv]: 0.00014053, [1] [Cycle 1]: 0.00013452, [11] [c_1]: 2.062e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.34e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.208e-05 [call_graph_tuple_transform]: 1.852e-05 [tuple_list_get_item_eliminator]: 5.41998e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.427e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 9.03002e-06 [add_recomputation]: 4.68e-05 [cse_after_recomputation]: 2.277e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.725e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00045001 [symbol_engine_optimizer]: 9.18e-05, [1] [Cycle 1]: 8.588e-05, [6] [build]: 8.77999e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 2.549e-05 [opt_reshape]: 6.26998e-06 [fold_const_symbol]: 9.14e-06 [renormalize]: 6.19999e-07 [validate]: 4.358e-05 Sums bootstrap : 0.000282s : 2.52% type_inference : 0.006547s : 58.49% event_method : 0.000022s : 0.20% auto_monad : 0.000069s : 0.62% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.51% rewriter_before_opt_a : 0.000096s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000079s : 0.71% jit_opt_a.loop_unroll : 0.000043s : 0.38% jit_opt_a.a_1 : 0.000840s : 7.51% jit_opt_a.with_stream_mark : 0.000031s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000999s : 8.93% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.20% jit_opt_a.cse : 0.000049s : 0.43% jit_opt_a.replace_applicator : 0.000018s : 0.16% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000039s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000557s : 4.97% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000026s : 0.23% loop_unroll : 0.000420s : 3.75% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000014s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000047s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000450s : 4.02% symbol_engine_optimizer.build : 0.000009s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.23% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.39% Time group info: ------[substitution.] 0.000296 25 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.79% : 0.000005s : 3: substitution.graph_param_transform 87.45% : 0.000259s : 5: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.45% : 0.000004s : 2: substitution.replace_old_param 5.24% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006471 2 78.30% : 0.005067s : 1: type_inference.infer 21.70% : 0.001404s : 1: type_inference.specialize ------[replace.] 0.000112 8 65.32% : 0.000073s : 5: replace.inline 34.68% : 0.000039s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000269 8 95.01% : 0.000255s : 5: match.inline 4.99% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 810 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.42% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000008s : 26: predicate.inline 0.76% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.11% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.25% : 0.000002s : 12: predicate.minmaximum_grad 1.32% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.69% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 21: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.45% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 20: predicate.switch_defer_inline 2.29% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.55% : 0.000012s : 64: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 2.20% : 0.000003s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001006 16 49.39% : 0.000497s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.22% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.38% : 0.000426s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018007 72 0.28% : 0.000050s : 1: add_recomputation 0.40% : 0.000073s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.67% : 0.000301s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000011s : 1: environ_conv 0.15% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.93% : 0.006650s : 1: jit_opt_a 0.79% : 0.000143s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.37% : 0.000427s : 1: loop_unroll 3.14% : 0.000566s : 1: mutable_eliminate 6.02% : 0.001083s : 26: opt.transform.jit_opt_a 0.26% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000046s : 4: opt.transform.symbol_engine_opt 2.54% : 0.000458s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000060s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000017s : 1: remove_dup_value 3.20% : 0.000576s : 1: renormalize.infer 2.30% : 0.000415s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.55% : 0.000099s : 1: rewriter_before_opt_a 0.52% : 0.000094s : 1: symbol_engine_optimizer 36.45% : 0.006563s : 1: type_inference TotalTime = 0.0110763, [30] [bootstrap]: 0.00025546 [type_inference]: 0.00408764 [event_method]: 1.589e-05 [auto_monad]: 4.132e-05 [graph_reusing]: 3.46999e-06 [pre_auto_parallel]: 1.71e-06 [py_interpret_to_execute]: 4.708e-05 [rewriter_before_opt_a]: 6.7e-05 [expand_dump_flag]: 2.04999e-06 [jit_opt_a]: 0.00452663, [2] [Cycle 1]: 0.00136401, [27] [switch_simplify]: 4.462e-05 [loop_unroll]: 3.025e-05 [a_1]: 0.00046611 [with_stream_mark]: 1.216e-05 [recompute_prepare]: 7.80998e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 8.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.112e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00050524 [add_forward_monad_depend]: 5.28002e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.352e-05 [cse]: 3.173e-05 [replace_applicator]: 1.116e-05 [Cycle 2]: 0.00032137, [27] [switch_simplify]: 5.81e-06 [loop_unroll]: 4.96002e-06 [a_1]: 8.781e-05 [with_stream_mark]: 8.56002e-06 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.28002e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.25999e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.49998e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.201e-05 [j_node_and_user_rematch]: 7.87e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 4.94998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.244e-05 [replace_applicator]: 5.30001e-06 [py_interpret_to_execute_after_opt_a]: 1.037e-05 [rewriter_after_opt_a]: 3.488e-05 [convert_after_rewriter]: 9.00001e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00045971 [jit_opt_b]: 5.031e-05, [1] [Cycle 1]: 4.339e-05, [2] [frontend_op_eliminate]: 1.527e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 2.366e-05 [loop_unroll]: 0.00047186 [jit_opt_after_cconv]: 0.00014158, [1] [Cycle 1]: 0.00013526, [11] [c_1]: 2.075e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 2.053e-05 [call_graph_tuple_transform]: 1.805e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.526e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 6.17999e-06 [add_recomputation]: 4.773e-05 [cse_after_recomputation]: 2.318e-05, [1] [Cycle 1]: 1.812e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.73e-05 [get_jit_bprop_graph]: 1.81998e-06 [rewriter_after_jit_bprop_graph]: 4.84998e-06 [opt_after_jit_grad]: 0.00044293 [symbol_engine_optimizer]: 7.024e-05, [1] [Cycle 1]: 6.425e-05, [6] [build]: 2.89999e-06 [elim_shapecalc]: 7.59002e-06 [elim_not_effective]: 1.204e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 4.09986e-07 [validate]: 3.469e-05 Sums bootstrap : 0.000255s : 3.33% type_inference : 0.004088s : 53.21% event_method : 0.000016s : 0.21% auto_monad : 0.000041s : 0.54% graph_reusing : 0.000003s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000047s : 0.61% rewriter_before_opt_a : 0.000067s : 0.87% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000050s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.46% jit_opt_a.a_1 : 0.000554s : 7.21% jit_opt_a.with_stream_mark : 0.000021s : 0.27% jit_opt_a.recompute_prepare : 0.000013s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000505s : 6.58% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000044s : 0.57% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000010s : 0.13% rewriter_after_opt_a : 0.000035s : 0.45% convert_after_rewriter : 0.000009s : 0.12% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000460s : 5.98% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000024s : 0.31% loop_unroll : 0.000472s : 6.14% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000015s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000048s : 0.62% cse_after_recomputation.cse : 0.000012s : 0.15% auto_monad_reorder : 0.000017s : 0.23% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000443s : 5.77% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000035s : 0.45% TotalTime = 0.0558784, [30] [bootstrap]: 0.00034032 [type_inference]: 0.0472518 [event_method]: 2.003e-05 [auto_monad]: 6.902e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.00013905 [rewriter_before_opt_a]: 8.157e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00593499, [2] [Cycle 1]: 0.00218023, [27] [switch_simplify]: 5.813e-05 [loop_unroll]: 3.03e-05 [a_1]: 0.00054825 [with_stream_mark]: 1.698e-05 [recompute_prepare]: 7.33e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.80998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.09998e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.00120847 [add_forward_monad_depend]: 4.68999e-06 [auto_monad_grad]: 1.69e-06 [auto_monad_eliminator]: 1.144e-05 [cse]: 2.092e-05 [replace_applicator]: 1.213e-05 [Cycle 2]: 0.00032341, [27] [switch_simplify]: 5.72001e-06 [loop_unroll]: 5.29e-06 [a_1]: 9.582e-05 [with_stream_mark]: 8.39998e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 8.15e-06 [meta_fg_expand]: 1.81003e-06 [replace_old_param]: 7.12002e-06 [inline_without_move]: 4.99998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.66998e-06 [cse]: 1.238e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 1.004e-05 [rewriter_after_opt_a]: 2.756e-05 [convert_after_rewriter]: 5.40001e-06 [order_py_execute_after_rewriter]: 4.25e-06 [mutable_eliminate]: 0.00049844 [jit_opt_b]: 4.942e-05, [1] [Cycle 1]: 4.313e-05, [2] [frontend_op_eliminate]: 1.613e-05 [inline_after_opt_a]: 1.592e-05 [cconv]: 1.592e-05 [loop_unroll]: 0.00042262 [jit_opt_after_cconv]: 0.00017804, [1] [Cycle 1]: 0.00017134, [11] [c_1]: 2.243e-05 [parameter_eliminate]: 2.65997e-06 [updatestate_depend_eliminate]: 6.00002e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.12e-05 [call_graph_tuple_transform]: 4.891e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.30999e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.71003e-06 [remove_dup_value]: 9.51e-06 [partial_unused_args_eliminate]: 1.31998e-06 [environ_conv]: 3.9e-06 [add_recomputation]: 3.416e-05 [cse_after_recomputation]: 2.553e-05, [1] [Cycle 1]: 1.967e-05, [1] [cse]: 1.399e-05 [auto_monad_reorder]: 1.101e-05 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00045938 [symbol_engine_optimizer]: 7.252e-05, [1] [Cycle 1]: 6.63e-05, [6] [build]: 2.94001e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.99999e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 5.19998e-07 [validate]: 2.949e-05 Sums bootstrap : 0.000340s : 0.66% type_inference : 0.047252s : 91.08% event_method : 0.000020s : 0.04% auto_monad : 0.000069s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000139s : 0.27% rewriter_before_opt_a : 0.000082s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000644s : 1.24% jit_opt_a.with_stream_mark : 0.000025s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001209s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.03% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000028s : 0.05% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000498s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000423s : 0.81% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000049s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000004s : 0.01% add_recomputation : 0.000034s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000459s : 0.89% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000029s : 0.06% Time group info: ------[substitution.] 0.000145 23 1.21% : 0.000002s : 2: substitution.elim_not_effective 0.91% : 0.000001s : 2: substitution.fold_const_symbol 3.73% : 0.000005s : 3: substitution.graph_param_transform 82.63% : 0.000120s : 4: substitution.inline 1.68% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 5.08% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004042 2 82.32% : 0.003327s : 1: type_inference.infer 17.68% : 0.000714s : 1: type_inference.specialize ------[replace.] 0.000062 6 65.86% : 0.000041s : 4: replace.inline 34.14% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000124 6 94.89% : 0.000118s : 4: match.inline 5.11% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.33% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.44% : 0.000002s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.72% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000002s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000008s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.33% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000529 13 52.57% : 0.000278s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.86% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.57% : 0.000225s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012398 72 0.41% : 0.000050s : 1: add_recomputation 0.36% : 0.000045s : 1: auto_monad 0.16% : 0.000020s : 1: auto_monad_reorder 2.20% : 0.000273s : 1: bootstrap 0.21% : 0.000026s : 1: cconv 0.09% : 0.000011s : 1: convert_after_rewriter 0.20% : 0.000025s : 1: cse_after_recomputation 0.07% : 0.000008s : 1: environ_conv 0.16% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 36.53% : 0.004529s : 1: jit_opt_a 1.16% : 0.000144s : 1: jit_opt_after_cconv 0.43% : 0.000053s : 1: jit_opt_b 3.87% : 0.000480s : 1: loop_unroll 3.77% : 0.000468s : 1: mutable_eliminate 6.07% : 0.000753s : 26: opt.transform.jit_opt_a 0.37% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.64% : 0.000451s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000050s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000017s : 1: remove_dup_value 1.86% : 0.000231s : 1: renormalize.infer 2.17% : 0.000269s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000038s : 1: rewriter_after_opt_a 0.57% : 0.000070s : 1: rewriter_before_opt_a 0.59% : 0.000073s : 1: symbol_engine_optimizer 33.05% : 0.004098s : 1: type_inference Time group info: ------[substitution.] 0.000233 23 0.60% : 0.000001s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 15.16% : 0.000035s : 3: substitution.graph_param_transform 73.96% : 0.000173s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000004s : 4: substitution.remove_not_recompute_node 1.61% : 0.000004s : 2: substitution.replace_old_param 5.13% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047176 2 92.43% : 0.043605s : 1: type_inference.infer 7.57% : 0.003571s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.09% : 0.000051s : 4: replace.inline 32.91% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 94.06% : 0.000170s : 4: match.inline 5.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.57% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.24% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000933 13 43.40% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.72% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.89% : 0.000494s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058046 72 0.06% : 0.000037s : 1: add_recomputation 0.12% : 0.000072s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.61% : 0.000353s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000006s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.23% : 0.005938s : 1: jit_opt_a 0.31% : 0.000181s : 1: jit_opt_after_cconv 0.09% : 0.000052s : 1: jit_opt_b 0.74% : 0.000431s : 1: loop_unroll 0.87% : 0.000507s : 1: mutable_eliminate 1.49% : 0.000862s : 26: opt.transform.jit_opt_a 0.14% : 0.000079s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000143s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 1.15% : 0.000666s : 1: renormalize.infer 0.92% : 0.000534s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000030s : 1: rewriter_after_opt_a 0.15% : 0.000085s : 1: rewriter_before_opt_a 0.13% : 0.000075s : 1: symbol_engine_optimizer 81.43% : 0.047264s : 1: type_inference TotalTime = 0.215794, [30] [bootstrap]: 0.0004063 [type_inference]: 0.200679 [event_method]: 2.756e-05 [auto_monad]: 8.458e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00072769 [rewriter_before_opt_a]: 0.00011738 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.0108399, [2] [Cycle 1]: 0.00571833, [27] [switch_simplify]: 8.618e-05 [loop_unroll]: 3.779e-05 [a_1]: 0.00086259 [with_stream_mark]: 2.498e-05 [recompute_prepare]: 1.075e-05 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.59002e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 8.03999e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 7.66001e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 8.17e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.759e-05 [j_node_and_user_rematch]: 1.158e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.304e-05 [inline_without_move]: 7.67002e-06 [renormalize]: 0.00425599 [add_forward_monad_depend]: 1.044e-05 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 2.206e-05 [cse]: 4.091e-05 [replace_applicator]: 2.542e-05 [Cycle 2]: 0.00042739, [27] [switch_simplify]: 7.21999e-06 [loop_unroll]: 6.64999e-06 [a_1]: 0.00015079 [with_stream_mark]: 1.573e-05 [recompute_prepare]: 6.58e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 6.60002e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 3.91999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.65997e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 5.82001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 6.71999e-06 [cse]: 1.611e-05 [replace_applicator]: 6.50002e-06 [py_interpret_to_execute_after_opt_a]: 1.812e-05 [rewriter_after_opt_a]: 4.022e-05 [convert_after_rewriter]: 7.58001e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00084088 [jit_opt_b]: 6.482e-05, [1] [Cycle 1]: 5.628e-05, [2] [frontend_op_eliminate]: 2.242e-05 [inline_after_opt_a]: 2.143e-05 [cconv]: 3.2e-05 [loop_unroll]: 0.00052801 [jit_opt_after_cconv]: 0.00027515, [1] [Cycle 1]: 0.00026737, [11] [c_1]: 2.938e-05 [parameter_eliminate]: 4.00998e-06 [updatestate_depend_eliminate]: 9.07001e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.595e-05 [call_graph_tuple_transform]: 2.858e-05 [tuple_list_get_item_eliminator]: 7.75e-06 [none_parameter_eliminate]: 2.37999e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.64999e-06 [remove_dup_value]: 1.862e-05 [partial_unused_args_eliminate]: 2.33002e-06 [environ_conv]: 9.81998e-06 [add_recomputation]: 5.7e-05 [cse_after_recomputation]: 2.76e-05, [1] [Cycle 1]: 2.082e-05, [1] [cse]: 1.451e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 6.63998e-06 [opt_after_jit_grad]: 0.00052384 [symbol_engine_optimizer]: 8.784e-05, [1] [Cycle 1]: 8.054e-05, [6] [build]: 4.58001e-06 [elim_shapecalc]: 9.46e-06 [elim_not_effective]: 1.547e-05 [opt_reshape]: 7.36999e-06 [fold_const_symbol]: 1.173e-05 [renormalize]: 3.7998e-07 [validate]: 0.00010457 Sums bootstrap : 0.000406s : 0.19% type_inference : 0.200679s : 95.42% event_method : 0.000028s : 0.01% auto_monad : 0.000085s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000728s : 0.35% rewriter_before_opt_a : 0.000117s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.04% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.001013s : 0.48% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004256s : 2.02% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000057s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000841s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000528s : 0.25% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000057s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000524s : 0.25% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000105s : 0.05% Time group info: ------[substitution.] 0.000371 28 0.86% : 0.000003s : 2: substitution.elim_not_effective 0.45% : 0.000002s : 2: substitution.fold_const_symbol 1.85% : 0.000007s : 4: substitution.graph_param_transform 84.85% : 0.000315s : 5: substitution.inline 1.13% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.08% : 0.000015s : 3: substitution.reduce_eliminate 1.48% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000006s : 2: substitution.replace_old_param 3.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.200561 2 97.83% : 0.196214s : 1: type_inference.infer 2.17% : 0.004347s : 1: type_inference.specialize ------[replace.] 0.000126 7 69.66% : 0.000088s : 5: replace.inline 30.34% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000323 7 96.31% : 0.000311s : 5: match.inline 3.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.50% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000003s : 13: predicate.addn_zero_filter 2.17% : 0.000003s : 13: predicate.arithmetic_simplify 1.48% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.13% : 0.000002s : 13: predicate.environ_get_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.53% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.52% : 0.000009s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.71% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000007s : 40: predicate.loop_unroll_before_grad 2.19% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 1.93% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 1.94% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.57% : 0.000004s : 13: predicate.reduce_eliminate 1.69% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.59% : 0.000012s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.71% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003319 25 62.05% : 0.002059s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.08% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.87% : 0.001157s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.221380 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000089s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.19% : 0.000429s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.90% : 0.010845s : 1: jit_opt_a 0.13% : 0.000278s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.24% : 0.000537s : 1: loop_unroll 0.39% : 0.000853s : 1: mutable_eliminate 0.59% : 0.001308s : 26: opt.transform.jit_opt_a 0.03% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000534s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000737s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.39% : 0.003070s : 1: renormalize.infer 0.53% : 0.001172s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000124s : 1: rewriter_before_opt_a 0.04% : 0.000090s : 1: symbol_engine_optimizer 90.66% : 0.200705s : 1: type_inference TotalTime = 0.0873185, [30] [bootstrap]: 0.00025373 [type_inference]: 0.0760927 [event_method]: 2.302e-05 [auto_monad]: 7.076e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00028067 [rewriter_before_opt_a]: 9.707e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00828621, [2] [Cycle 1]: 0.00481182, [27] [switch_simplify]: 5.966e-05 [loop_unroll]: 3.514e-05 [a_1]: 0.00194975 [with_stream_mark]: 1.815e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 4.19002e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 7.32997e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00240094 [add_forward_monad_depend]: 6.26998e-06 [auto_monad_grad]: 2.18002e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 3.447e-05 [replace_applicator]: 1.394e-05 [Cycle 2]: 0.00036527, [27] [switch_simplify]: 6.95002e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00011789 [with_stream_mark]: 9.73998e-06 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.311e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 8.50001e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.378e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.123e-05 [rewriter_after_opt_a]: 3.627e-05 [convert_after_rewriter]: 7.21999e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00052544 [jit_opt_b]: 5.587e-05, [1] [Cycle 1]: 4.897e-05, [2] [frontend_op_eliminate]: 1.987e-05 [inline_after_opt_a]: 1.805e-05 [cconv]: 2.417e-05 [loop_unroll]: 0.00042574 [jit_opt_after_cconv]: 0.00015636, [1] [Cycle 1]: 0.00015025, [11] [c_1]: 2.583e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 2.218e-05 [call_graph_tuple_transform]: 2.015e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 2.00002e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 7.00998e-06 [remove_dup_value]: 1.761e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 8.48999e-06 [add_recomputation]: 6.096e-05 [cse_after_recomputation]: 2.689e-05, [1] [Cycle 1]: 2.141e-05, [1] [cse]: 1.516e-05 [auto_monad_reorder]: 1.868e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00049054 [symbol_engine_optimizer]: 0.0001075, [1] [Cycle 1]: 7.174e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 6.71999e-06 [fold_const_symbol]: 9.92001e-06 [renormalize]: 3.29979e-07 [validate]: 4.548e-05 Sums bootstrap : 0.000254s : 0.30% type_inference : 0.076093s : 91.02% event_method : 0.000023s : 0.03% auto_monad : 0.000071s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000281s : 0.34% rewriter_before_opt_a : 0.000097s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.08% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.002068s : 2.47% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002401s : 2.87% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000048s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000036s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000525s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.03% loop_unroll : 0.000426s : 0.51% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000061s : 0.07% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000491s : 0.59% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.05% Time group info: ------[substitution.] 0.000241 25 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 4: substitution.graph_param_transform 86.44% : 0.000209s : 5: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000004s : 4: substitution.remove_not_recompute_node 1.44% : 0.000003s : 2: substitution.replace_old_param 5.07% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076015 2 97.00% : 0.073735s : 1: type_inference.infer 3.00% : 0.002280s : 1: type_inference.specialize ------[replace.] 0.001360 7 97.71% : 0.001329s : 5: replace.inline 2.29% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 94.93% : 0.000205s : 5: match.inline 5.07% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.55% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.87% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.03% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 19: predicate.partial_eliminate 1.59% : 0.000002s : 13: predicate.print_const_string_wrapper 1.76% : 0.000002s : 13: predicate.reduce_eliminate 1.57% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.02% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000011s : 65: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002947 37 72.77% : 0.002145s : 28: func_graph_cloner_run.FuncGraphClonerGraph 2.02% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 25.22% : 0.000743s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.092104 72 0.07% : 0.000064s : 1: add_recomputation 0.08% : 0.000074s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.29% : 0.000265s : 1: bootstrap 0.03% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.00% : 0.008289s : 1: jit_opt_a 0.17% : 0.000159s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.47% : 0.000433s : 1: loop_unroll 0.58% : 0.000534s : 1: mutable_eliminate 2.51% : 0.002310s : 26: opt.transform.jit_opt_a 0.06% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000287s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.80% : 0.001662s : 1: renormalize.infer 0.79% : 0.000730s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000039s : 1: rewriter_after_opt_a 0.11% : 0.000102s : 1: rewriter_before_opt_a 0.12% : 0.000110s : 1: symbol_engine_optimizer 82.63% : 0.076109s : 1: type_inference TotalTime = 0.016844, [30] [bootstrap]: 0.00031113 [type_inference]: 0.00638081 [event_method]: 2.397e-05 [auto_monad]: 0.00010141 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 5.692e-05 [rewriter_before_opt_a]: 9.807e-05 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.00733802, [2] [Cycle 1]: 0.0023023, [27] [switch_simplify]: 6.999e-05 [loop_unroll]: 3.732e-05 [a_1]: 0.00079797 [with_stream_mark]: 2.402e-05 [recompute_prepare]: 8.50001e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.95002e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.00102267 [add_forward_monad_depend]: 6.61e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 3.57e-05 [replace_applicator]: 1.449e-05 [Cycle 2]: 0.00034488, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.54e-06 [a_1]: 9.923e-05 [with_stream_mark]: 1.135e-05 [recompute_prepare]: 5.62001e-06 [updatestate_depend_eliminate]: 3.46001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.36002e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 5.07999e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.317e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.00999e-06 [inline_without_move]: 4.89003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.56999e-06 [cse]: 1.501e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 2.012e-05 [rewriter_after_opt_a]: 4.013e-05 [convert_after_rewriter]: 6.69999e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00065036 [jit_opt_b]: 6.708e-05, [1] [Cycle 1]: 5.868e-05, [2] [frontend_op_eliminate]: 2.74e-05 [inline_after_opt_a]: 1.716e-05 [cconv]: 2.746e-05 [loop_unroll]: 0.0005297 [jit_opt_after_cconv]: 0.00017021, [1] [Cycle 1]: 0.00016331, [11] [c_1]: 2.298e-05 [parameter_eliminate]: 3.76001e-06 [updatestate_depend_eliminate]: 6.88e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.86999e-06 [cse]: 2.61e-05 [call_graph_tuple_transform]: 2.161e-05 [tuple_list_get_item_eliminator]: 5.93002e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 9.39e-06 [add_recomputation]: 5.295e-05 [cse_after_recomputation]: 2.523e-05, [1] [Cycle 1]: 1.954e-05, [1] [cse]: 1.299e-05 [auto_monad_reorder]: 1.889e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.73e-06 [opt_after_jit_grad]: 0.00050237 [symbol_engine_optimizer]: 9.049e-05, [1] [Cycle 1]: 8.331e-05, [6] [build]: 1.394e-05 [elim_shapecalc]: 9.32001e-06 [elim_not_effective]: 1.47e-05 [opt_reshape]: 6.04999e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 4.7998e-07 [validate]: 5.088e-05 Sums bootstrap : 0.000311s : 2.71% type_inference : 0.006381s : 55.53% event_method : 0.000024s : 0.21% auto_monad : 0.000101s : 0.88% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.50% rewriter_before_opt_a : 0.000098s : 0.85% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000076s : 0.66% jit_opt_a.loop_unroll : 0.000043s : 0.37% jit_opt_a.a_1 : 0.000897s : 7.81% jit_opt_a.with_stream_mark : 0.000035s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001023s : 8.90% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.19% jit_opt_a.cse : 0.000051s : 0.44% jit_opt_a.replace_applicator : 0.000020s : 0.17% py_interpret_to_execute_after_opt_a : 0.000020s : 0.18% rewriter_after_opt_a : 0.000040s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000650s : 5.66% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.24% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000027s : 0.24% loop_unroll : 0.000530s : 4.61% jit_opt_after_cconv.c_1 : 0.000023s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000053s : 0.46% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000019s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000502s : 4.37% symbol_engine_optimizer.build : 0.000014s : 0.12% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.44% Time group info: ------[substitution.] 0.000345 25 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 3: substitution.graph_param_transform 88.61% : 0.000305s : 5: substitution.inline 1.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.44% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000005s : 2: substitution.replace_old_param 4.58% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006298 2 77.74% : 0.004896s : 1: type_inference.infer 22.26% : 0.001402s : 1: type_inference.specialize ------[replace.] 0.000114 8 67.07% : 0.000076s : 5: replace.inline 32.93% : 0.000038s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000316 8 95.55% : 0.000302s : 5: match.inline 4.45% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 810 1.47% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.24% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.73% : 0.000008s : 26: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.90% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000003s : 21: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.82% : 0.000003s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.93% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.47% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 21: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.03% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001011 16 46.87% : 0.000474s : 7: func_graph_cloner_run.FuncGraphClonerGraph 11.15% : 0.000113s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.99% : 0.000425s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019063 72 0.30% : 0.000057s : 1: add_recomputation 0.56% : 0.000106s : 1: auto_monad 0.12% : 0.000022s : 1: auto_monad_reorder 1.73% : 0.000329s : 1: bootstrap 0.16% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000012s : 1: environ_conv 0.15% : 0.000029s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 38.51% : 0.007341s : 1: jit_opt_a 0.91% : 0.000173s : 1: jit_opt_after_cconv 0.37% : 0.000070s : 1: jit_opt_b 2.83% : 0.000539s : 1: loop_unroll 3.62% : 0.000689s : 1: mutable_eliminate 5.98% : 0.001139s : 26: opt.transform.jit_opt_a 0.27% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000038s : 4: opt.transform.jit_opt_b 0.08% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.68% : 0.000512s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000060s : 1: py_interpret_to_execute 0.12% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 3.01% : 0.000574s : 1: renormalize.infer 2.31% : 0.000440s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000043s : 1: rewriter_after_opt_a 0.53% : 0.000101s : 1: rewriter_before_opt_a 0.49% : 0.000093s : 1: symbol_engine_optimizer 33.57% : 0.006399s : 1: type_inference TotalTime = 0.114588, [30] [bootstrap]: 0.00026134 [type_inference]: 0.104495 [event_method]: 1.908e-05 [auto_monad]: 6.808e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00038604 [rewriter_before_opt_a]: 8.066e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00712919, [2] [Cycle 1]: 0.00345203, [27] [switch_simplify]: 6.596e-05 [loop_unroll]: 3.1e-05 [a_1]: 0.00057068 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.0024275 [add_forward_monad_depend]: 6.07001e-06 [auto_monad_grad]: 2.88003e-06 [auto_monad_eliminator]: 1.581e-05 [cse]: 2.973e-05 [replace_applicator]: 1.416e-05 [Cycle 2]: 0.00034794, [27] [switch_simplify]: 6.40002e-06 [loop_unroll]: 5.58997e-06 [a_1]: 0.00011715 [with_stream_mark]: 9.47999e-06 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 5.44998e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.357e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 8.05999e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.122e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 1.165e-05 [rewriter_after_opt_a]: 3.608e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.0005541 [jit_opt_b]: 5.438e-05, [1] [Cycle 1]: 4.733e-05, [2] [frontend_op_eliminate]: 1.892e-05 [inline_after_opt_a]: 1.657e-05 [cconv]: 2.443e-05 [loop_unroll]: 0.00040842 [jit_opt_after_cconv]: 0.00014385, [1] [Cycle 1]: 0.00013731, [11] [c_1]: 2.376e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.854e-05 [call_graph_tuple_transform]: 2.044e-05 [tuple_list_get_item_eliminator]: 5.75001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.74e-06 [remove_dup_value]: 1.507e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.92e-06 [add_recomputation]: 4.896e-05 [cse_after_recomputation]: 2.215e-05, [1] [Cycle 1]: 1.608e-05, [1] [cse]: 1.057e-05 [auto_monad_reorder]: 1.616e-05 [get_jit_bprop_graph]: 1.64e-06 [rewriter_after_jit_bprop_graph]: 4.49002e-06 [opt_after_jit_grad]: 0.0004442 [symbol_engine_optimizer]: 0.00011934, [1] [Cycle 1]: 0.0001133, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 5.614e-05 [renormalize]: 4.09986e-07 [validate]: 4.025e-05 Sums bootstrap : 0.000261s : 0.24% type_inference : 0.104495s : 94.40% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000386s : 0.35% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.07% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000688s : 0.62% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002428s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000554s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000408s : 0.37% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000444s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000056s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000223 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 4: substitution.graph_param_transform 84.69% : 0.000188s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.19% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104426 2 97.57% : 0.101894s : 1: type_inference.infer 2.43% : 0.002532s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.85% : 0.000045s : 4: replace.inline 32.15% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.71% : 0.000186s : 4: match.inline 5.29% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 1.67% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.17% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.87% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000001s : 12: predicate.print_const_string_wrapper 1.92% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.83% : 0.000010s : 58: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001952 22 66.28% : 0.001294s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.35% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.37% : 0.000612s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118037 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000272s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.04% : 0.007132s : 1: jit_opt_a 0.12% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.35% : 0.000417s : 1: loop_unroll 0.48% : 0.000562s : 1: mutable_eliminate 0.77% : 0.000913s : 26: opt.transform.jit_opt_a 0.04% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000392s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.50% : 0.001767s : 1: renormalize.infer 0.55% : 0.000652s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.10% : 0.000122s : 1: symbol_engine_optimizer 88.54% : 0.104511s : 1: type_inference TotalTime = 0.0122425, [30] [bootstrap]: 0.00030484 [type_inference]: 0.00454281 [event_method]: 1.798e-05 [auto_monad]: 6.765e-05 [graph_reusing]: 5.49998e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 3.8e-05 [rewriter_before_opt_a]: 7.523e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.00513192, [2] [Cycle 1]: 0.0015165, [27] [switch_simplify]: 5.72e-05 [loop_unroll]: 3.323e-05 [a_1]: 0.00052431 [with_stream_mark]: 1.677e-05 [recompute_prepare]: 7.56999e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.51002e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.423e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00056229 [add_forward_monad_depend]: 6.57002e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 1.514e-05 [cse]: 3.212e-05 [replace_applicator]: 1.099e-05 [Cycle 2]: 0.00032747, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.49998e-06 [a_1]: 9.49e-05 [with_stream_mark]: 8.62e-06 [recompute_prepare]: 4.85999e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.95999e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.232e-05 [j_node_and_user_rematch]: 7.72002e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 7.46001e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.245e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 1.028e-05 [rewriter_after_opt_a]: 3.294e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00046508 [jit_opt_b]: 4.929e-05, [1] [Cycle 1]: 4.304e-05, [2] [frontend_op_eliminate]: 1.624e-05 [inline_after_opt_a]: 1.603e-05 [cconv]: 2.513e-05 [loop_unroll]: 0.00040257 [jit_opt_after_cconv]: 0.00021293, [1] [Cycle 1]: 0.00020614, [11] [c_1]: 2.039e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.50002e-06 [cse]: 2.055e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.20026e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.607e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.27001e-06 [add_recomputation]: 4.765e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.793e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 4.38001e-06 [opt_after_jit_grad]: 0.00046086 [symbol_engine_optimizer]: 7.341e-05, [1] [Cycle 1]: 6.746e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.68002e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 3.10014e-07 [validate]: 3.454e-05 Sums bootstrap : 0.000305s : 3.66% type_inference : 0.004543s : 54.52% event_method : 0.000018s : 0.22% auto_monad : 0.000068s : 0.81% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000038s : 0.46% rewriter_before_opt_a : 0.000075s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000063s : 0.76% jit_opt_a.loop_unroll : 0.000039s : 0.46% jit_opt_a.a_1 : 0.000619s : 7.43% jit_opt_a.with_stream_mark : 0.000025s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000562s : 6.75% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000045s : 0.53% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000033s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000465s : 5.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000025s : 0.30% loop_unroll : 0.000403s : 4.83% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000048s : 0.57% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000019s : 0.23% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000461s : 5.53% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.41% Time group info: ------[substitution.] 0.000192 23 1.10% : 0.000002s : 2: substitution.elim_not_effective 0.88% : 0.000002s : 2: substitution.fold_const_symbol 2.69% : 0.000005s : 3: substitution.graph_param_transform 82.86% : 0.000159s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000005s : 2: substitution.replace_old_param 6.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004486 2 82.42% : 0.003697s : 1: type_inference.infer 17.58% : 0.000789s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.35% : 0.000046s : 4: replace.inline 32.65% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.64% : 0.000156s : 4: match.inline 6.36% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.33% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.56% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.65% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000582 13 54.61% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.44% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.95% : 0.000233s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013704 72 0.37% : 0.000050s : 1: add_recomputation 0.52% : 0.000071s : 1: auto_monad 0.16% : 0.000021s : 1: auto_monad_reorder 2.32% : 0.000318s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.47% : 0.005135s : 1: jit_opt_a 1.57% : 0.000216s : 1: jit_opt_after_cconv 0.38% : 0.000052s : 1: jit_opt_b 2.99% : 0.000410s : 1: loop_unroll 3.45% : 0.000473s : 1: mutable_eliminate 6.08% : 0.000834s : 26: opt.transform.jit_opt_a 0.35% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000469s : 1: opt_after_jit_grad 0.06% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000041s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000019s : 1: remove_dup_value 2.07% : 0.000284s : 1: renormalize.infer 1.98% : 0.000271s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.57% : 0.000078s : 1: rewriter_before_opt_a 0.55% : 0.000076s : 1: symbol_engine_optimizer 33.23% : 0.004554s : 1: type_inference TotalTime = 0.0285057, [30] [bootstrap]: 0.0002883 [type_inference]: 0.0205173 [event_method]: 2.111e-05 [auto_monad]: 6.667e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 3.21001e-06 [py_interpret_to_execute]: 0.00013745 [rewriter_before_opt_a]: 8.008e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.00534238, [2] [Cycle 1]: 0.001867, [27] [switch_simplify]: 5.3e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.00053406 [with_stream_mark]: 1.615e-05 [recompute_prepare]: 7.73001e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 5.31998e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 0.00090903 [add_forward_monad_depend]: 5.35999e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 3.318e-05 [replace_applicator]: 1.172e-05 [Cycle 2]: 0.00032128, [27] [switch_simplify]: 6.03998e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.271e-05 [with_stream_mark]: 8.06001e-06 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.17002e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.295e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 9.53997e-06 [rewriter_after_opt_a]: 3.675e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.62001e-06 [mutable_eliminate]: 0.00047793 [jit_opt_b]: 5.12e-05, [1] [Cycle 1]: 4.47e-05, [2] [frontend_op_eliminate]: 1.681e-05 [inline_after_opt_a]: 1.657e-05 [cconv]: 2.479e-05 [loop_unroll]: 0.00041343 [jit_opt_after_cconv]: 0.00014294, [1] [Cycle 1]: 0.00013672, [11] [c_1]: 2.134e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.54998e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.083e-05 [call_graph_tuple_transform]: 1.819e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.703e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 5.39e-06 [add_recomputation]: 4.909e-05 [cse_after_recomputation]: 2.332e-05, [1] [Cycle 1]: 1.794e-05, [1] [cse]: 1.204e-05 [auto_monad_reorder]: 1.885e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00045019 [symbol_engine_optimizer]: 7.186e-05, [1] [Cycle 1]: 6.564e-05, [6] [build]: 3.06999e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 8.61002e-06 [renormalize]: 3.89991e-07 [validate]: 3.747e-05 Sums bootstrap : 0.000288s : 1.16% type_inference : 0.020517s : 82.84% event_method : 0.000021s : 0.09% auto_monad : 0.000067s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000137s : 0.55% rewriter_before_opt_a : 0.000080s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000627s : 2.53% jit_opt_a.with_stream_mark : 0.000024s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000909s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000046s : 0.19% jit_opt_a.replace_applicator : 0.000017s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000037s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000478s : 1.93% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000025s : 0.10% loop_unroll : 0.000413s : 1.67% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000049s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000450s : 1.82% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.15% Time group info: ------[substitution.] 0.000191 23 1.23% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000005s : 3: substitution.graph_param_transform 82.90% : 0.000158s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000004s : 4: substitution.remove_not_recompute_node 2.11% : 0.000004s : 2: substitution.replace_old_param 6.48% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020445 2 91.09% : 0.018623s : 1: type_inference.infer 8.91% : 0.001822s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.03% : 0.000048s : 4: replace.inline 31.97% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.32% : 0.000155s : 4: match.inline 6.68% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.15% : 0.000003s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000938 13 42.37% : 0.000397s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.29% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 54.33% : 0.000509s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030296 72 0.17% : 0.000052s : 1: add_recomputation 0.23% : 0.000070s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.00% : 0.000304s : 1: bootstrap 0.09% : 0.000027s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 17.64% : 0.005345s : 1: jit_opt_a 0.48% : 0.000146s : 1: jit_opt_after_cconv 0.18% : 0.000054s : 1: jit_opt_b 1.39% : 0.000422s : 1: loop_unroll 1.61% : 0.000487s : 1: mutable_eliminate 2.76% : 0.000837s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000458s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000142s : 1: py_interpret_to_execute 0.04% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.71% : 0.000517s : 1: renormalize.infer 1.27% : 0.000384s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000040s : 1: rewriter_after_opt_a 0.28% : 0.000084s : 1: rewriter_before_opt_a 0.25% : 0.000075s : 1: symbol_engine_optimizer 67.78% : 0.020534s : 1: type_inference TotalTime = 0.0183771, [30] [bootstrap]: 0.0003701 [type_inference]: 0.00721325 [event_method]: 2.45e-05 [auto_monad]: 7.474e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 6.926e-05 [rewriter_before_opt_a]: 9.847e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00816938, [2] [Cycle 1]: 0.00233026, [27] [switch_simplify]: 7.531e-05 [loop_unroll]: 3.756e-05 [a_1]: 0.00077832 [with_stream_mark]: 2.652e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 2.13002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.672e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 5.71e-06 [renormalize]: 0.00103348 [add_forward_monad_depend]: 1.167e-05 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.75e-05 [cse]: 3.83e-05 [replace_applicator]: 1.486e-05 [Cycle 2]: 0.00033012, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.16002e-06 [a_1]: 9.292e-05 [with_stream_mark]: 1.026e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 4.79998e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.76001e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.49e-06 [cse]: 1.332e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.372e-05 [rewriter_after_opt_a]: 3.96e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00070788 [jit_opt_b]: 5.136e-05, [1] [Cycle 1]: 4.456e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.721e-05 [cconv]: 2.635e-05 [loop_unroll]: 0.00043194 [jit_opt_after_cconv]: 0.00014867, [1] [Cycle 1]: 0.0001423, [11] [c_1]: 2.249e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.657e-05 [call_graph_tuple_transform]: 1.808e-05 [tuple_list_get_item_eliminator]: 5.53002e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 1.011e-05 [add_recomputation]: 5.241e-05 [cse_after_recomputation]: 2.358e-05, [1] [Cycle 1]: 1.828e-05, [1] [cse]: 1.265e-05 [auto_monad_reorder]: 1.758e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 4.84003e-06 [opt_after_jit_grad]: 0.00045009 [symbol_engine_optimizer]: 9.279e-05, [1] [Cycle 1]: 8.683e-05, [6] [build]: 1.001e-05 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 2.182e-05 [renormalize]: 4.19997e-07 [validate]: 4.692e-05 Sums bootstrap : 0.000370s : 3.02% type_inference : 0.007213s : 58.87% event_method : 0.000025s : 0.20% auto_monad : 0.000075s : 0.61% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000069s : 0.57% rewriter_before_opt_a : 0.000098s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000082s : 0.67% jit_opt_a.loop_unroll : 0.000043s : 0.35% jit_opt_a.a_1 : 0.000871s : 7.11% jit_opt_a.with_stream_mark : 0.000037s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001034s : 8.44% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.11% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.19% jit_opt_a.cse : 0.000052s : 0.42% jit_opt_a.replace_applicator : 0.000020s : 0.17% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000040s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000708s : 5.78% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000026s : 0.22% loop_unroll : 0.000432s : 3.53% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000010s : 0.08% add_recomputation : 0.000052s : 0.43% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000450s : 3.67% symbol_engine_optimizer.build : 0.000010s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000022s : 0.18% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.38% Time group info: ------[substitution.] 0.000321 25 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.58% : 0.000005s : 3: substitution.graph_param_transform 88.42% : 0.000284s : 5: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.51% : 0.000005s : 2: substitution.replace_old_param 4.69% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007121 2 78.34% : 0.005579s : 1: type_inference.infer 21.66% : 0.001542s : 1: type_inference.specialize ------[replace.] 0.000117 8 66.06% : 0.000078s : 5: replace.inline 33.94% : 0.000040s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 8 95.44% : 0.000281s : 5: match.inline 4.56% : 0.000013s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 810 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 6.00% : 0.000008s : 26: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.09% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.46% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.25% : 0.000002s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 21: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.79% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.29% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.23% : 0.000011s : 64: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001088 16 50.00% : 0.000544s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.30% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.70% : 0.000454s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020585 72 0.27% : 0.000055s : 1: add_recomputation 0.38% : 0.000078s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.92% : 0.000395s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000012s : 1: environ_conv 0.14% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 39.70% : 0.008173s : 1: jit_opt_a 0.73% : 0.000151s : 1: jit_opt_after_cconv 0.26% : 0.000054s : 1: jit_opt_b 2.13% : 0.000439s : 1: loop_unroll 3.48% : 0.000717s : 1: mutable_eliminate 5.45% : 0.001122s : 26: opt.transform.jit_opt_a 0.23% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000046s : 4: opt.transform.symbol_engine_opt 2.23% : 0.000458s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000074s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000019s : 1: remove_dup_value 2.91% : 0.000599s : 1: renormalize.infer 2.07% : 0.000426s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000043s : 1: rewriter_after_opt_a 0.49% : 0.000101s : 1: rewriter_before_opt_a 0.46% : 0.000095s : 1: symbol_engine_optimizer 35.14% : 0.007234s : 1: type_inference TotalTime = 0.0874396, [30] [bootstrap]: 0.00025837 [type_inference]: 0.0769767 [event_method]: 2.414e-05 [auto_monad]: 7.237e-05 [graph_reusing]: 5.97999e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00029097 [rewriter_before_opt_a]: 0.00010169 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00740567, [2] [Cycle 1]: 0.00355257, [27] [switch_simplify]: 6.678e-05 [loop_unroll]: 3.452e-05 [a_1]: 0.00067902 [with_stream_mark]: 1.748e-05 [recompute_prepare]: 9.17999e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.62001e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 6.78003e-06 [merge_forward]: 4.27998e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.679e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 6.66e-06 [renormalize]: 0.00239544 [add_forward_monad_depend]: 7.51999e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.72e-05 [cse]: 2.872e-05 [replace_applicator]: 1.816e-05 [Cycle 2]: 0.00037704, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00012361 [with_stream_mark]: 1.19e-05 [recompute_prepare]: 5.87999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 1.98002e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.648e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 8.18999e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.04003e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.474e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.517e-05 [rewriter_after_opt_a]: 3.895e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.0006482 [jit_opt_b]: 5.68e-05, [1] [Cycle 1]: 4.932e-05, [2] [frontend_op_eliminate]: 1.907e-05 [inline_after_opt_a]: 1.897e-05 [cconv]: 2.572e-05 [loop_unroll]: 0.00044024 [jit_opt_after_cconv]: 0.00016059, [1] [Cycle 1]: 0.00015353, [11] [c_1]: 2.623e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 6.01998e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 3.18998e-06 [cse]: 2.527e-05 [call_graph_tuple_transform]: 2.267e-05 [tuple_list_get_item_eliminator]: 7.25998e-06 [none_parameter_eliminate]: 1.97999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 1.89e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 8.48999e-06 [add_recomputation]: 4.949e-05 [cse_after_recomputation]: 2.483e-05, [1] [Cycle 1]: 1.959e-05, [1] [cse]: 1.413e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.00047113 [symbol_engine_optimizer]: 7.568e-05, [1] [Cycle 1]: 6.988e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 9.02999e-06 [elim_not_effective]: 1.442e-05 [opt_reshape]: 6.98e-06 [fold_const_symbol]: 9.31998e-06 [renormalize]: 3.80009e-07 [validate]: 4.611e-05 Sums bootstrap : 0.000258s : 0.31% type_inference : 0.076977s : 92.33% event_method : 0.000024s : 0.03% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000291s : 0.35% rewriter_before_opt_a : 0.000102s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000803s : 0.96% jit_opt_a.with_stream_mark : 0.000029s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002396s : 2.87% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000043s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000648s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000440s : 0.53% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000471s : 0.57% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.06% Time group info: ------[substitution.] 0.000251 25 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000007s : 4: substitution.graph_param_transform 85.84% : 0.000215s : 5: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 1.84% : 0.000005s : 2: substitution.replace_old_param 4.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.076894 2 94.51% : 0.072673s : 1: type_inference.infer 5.49% : 0.004221s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.91% : 0.000069s : 5: replace.inline 31.09% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 95.14% : 0.000213s : 5: match.inline 4.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.70% : 0.000002s : 13: predicate.addn_zero_filter 1.60% : 0.000002s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.74% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.93% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.77% : 0.000002s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.51% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.03% : 0.000011s : 65: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.41% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004274 29 39.35% : 0.001682s : 20: func_graph_cloner_run.FuncGraphClonerGraph 1.73% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 58.92% : 0.002519s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.090965 72 0.06% : 0.000052s : 1: add_recomputation 0.08% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.30% : 0.000270s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.15% : 0.007409s : 1: jit_opt_a 0.18% : 0.000164s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.49% : 0.000448s : 1: loop_unroll 0.72% : 0.000657s : 1: mutable_eliminate 1.16% : 0.001059s : 26: opt.transform.jit_opt_a 0.06% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.53% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000297s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.77% : 0.001613s : 1: renormalize.infer 0.85% : 0.000772s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000107s : 1: rewriter_before_opt_a 0.09% : 0.000078s : 1: symbol_engine_optimizer 84.64% : 0.076996s : 1: type_inference TotalTime = 0.0162484, [30] [bootstrap]: 0.00028988 [type_inference]: 0.00633886 [event_method]: 2.544e-05 [auto_monad]: 7.477e-05 [graph_reusing]: 7.38e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 6.868e-05 [rewriter_before_opt_a]: 0.00010465 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00691357, [2] [Cycle 1]: 0.00255878, [27] [switch_simplify]: 7.528e-05 [loop_unroll]: 3.86e-05 [a_1]: 0.00080761 [with_stream_mark]: 2.359e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 4.67998e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.05998e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.68997e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.74999e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.91998e-06 [renormalize]: 0.00121856 [add_forward_monad_depend]: 9.46998e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 2.015e-05 [cse]: 3.919e-05 [replace_applicator]: 2.023e-05 [Cycle 2]: 0.00036622, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.76e-06 [a_1]: 0.00010455 [with_stream_mark]: 1.548e-05 [recompute_prepare]: 5.70001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 2.17001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.77e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.07999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.33998e-06 [cse]: 1.454e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 2.27e-05 [rewriter_after_opt_a]: 4.517e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.79999e-06 [mutable_eliminate]: 0.00074562 [jit_opt_b]: 6.128e-05, [1] [Cycle 1]: 5.314e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 2.395e-05 [cconv]: 3.193e-05 [loop_unroll]: 0.00043459 [jit_opt_after_cconv]: 0.00015946, [1] [Cycle 1]: 0.00015241, [11] [c_1]: 2.172e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.459e-05 [call_graph_tuple_transform]: 2.654e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 9.41e-06 [add_recomputation]: 4.958e-05 [cse_after_recomputation]: 2.447e-05, [1] [Cycle 1]: 1.834e-05, [1] [cse]: 1.257e-05 [auto_monad_reorder]: 1.729e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 6.14001e-06 [opt_after_jit_grad]: 0.00045741 [symbol_engine_optimizer]: 8.515e-05, [1] [Cycle 1]: 7.87e-05, [6] [build]: 1.294e-05 [elim_shapecalc]: 8.01001e-06 [elim_not_effective]: 1.395e-05 [opt_reshape]: 6.11998e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 3.19997e-07 [validate]: 4.836e-05 Sums bootstrap : 0.000290s : 2.49% type_inference : 0.006339s : 54.53% event_method : 0.000025s : 0.22% auto_monad : 0.000075s : 0.64% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000069s : 0.59% rewriter_before_opt_a : 0.000105s : 0.90% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000082s : 0.70% jit_opt_a.loop_unroll : 0.000044s : 0.38% jit_opt_a.a_1 : 0.000912s : 7.85% jit_opt_a.with_stream_mark : 0.000039s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001219s : 10.48% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.23% jit_opt_a.cse : 0.000054s : 0.46% jit_opt_a.replace_applicator : 0.000026s : 0.22% py_interpret_to_execute_after_opt_a : 0.000023s : 0.20% rewriter_after_opt_a : 0.000045s : 0.39% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000746s : 6.41% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.15% jit_opt_b.inline_after_opt_a : 0.000024s : 0.21% cconv : 0.000032s : 0.27% loop_unroll : 0.000435s : 3.74% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.08% add_recomputation : 0.000050s : 0.43% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000457s : 3.93% symbol_engine_optimizer.build : 0.000013s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.42% Time group info: ------[substitution.] 0.000337 25 0.76% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.85% : 0.000006s : 3: substitution.graph_param_transform 87.57% : 0.000295s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.94% : 0.000007s : 4: substitution.remove_not_recompute_node 1.71% : 0.000006s : 2: substitution.replace_old_param 4.67% : 0.000016s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006254 2 75.62% : 0.004729s : 1: type_inference.infer 24.38% : 0.001525s : 1: type_inference.specialize ------[replace.] 0.000123 8 66.81% : 0.000082s : 5: replace.inline 33.19% : 0.000041s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000306 8 95.36% : 0.000292s : 5: match.inline 4.64% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 810 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000008s : 26: predicate.inline 0.69% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 18: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.34% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000003s : 21: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.45% : 0.000002s : 12: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.44% : 0.000002s : 12: predicate.transpose_eliminate 1.69% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 2.12% : 0.000003s : 12: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001056 16 44.10% : 0.000466s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.27% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.62% : 0.000493s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018700 72 0.28% : 0.000053s : 1: add_recomputation 0.42% : 0.000079s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.65% : 0.000308s : 1: bootstrap 0.18% : 0.000034s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000012s : 1: environ_conv 0.16% : 0.000030s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000010s : 1: graph_reusing 36.99% : 0.006918s : 1: jit_opt_a 0.87% : 0.000162s : 1: jit_opt_after_cconv 0.34% : 0.000064s : 1: jit_opt_b 2.37% : 0.000443s : 1: loop_unroll 4.04% : 0.000755s : 1: mutable_eliminate 6.27% : 0.001173s : 26: opt.transform.jit_opt_a 0.30% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000035s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.49% : 0.000466s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000072s : 1: py_interpret_to_execute 0.14% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 3.52% : 0.000658s : 1: renormalize.infer 2.94% : 0.000550s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000048s : 1: rewriter_after_opt_a 0.58% : 0.000108s : 1: rewriter_before_opt_a 0.47% : 0.000088s : 1: symbol_engine_optimizer 34.00% : 0.006358s : 1: type_inference TotalTime = 0.0120946, [30] [bootstrap]: 0.0002723 [type_inference]: 0.00436848 [event_method]: 1.762e-05 [auto_monad]: 6.433e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.60997e-06 [py_interpret_to_execute]: 3.422e-05 [rewriter_before_opt_a]: 7.51e-05 [expand_dump_flag]: 3.00002e-06 [jit_opt_a]: 0.00504601, [2] [Cycle 1]: 0.0015066, [27] [switch_simplify]: 5.28e-05 [loop_unroll]: 3.026e-05 [a_1]: 0.00051175 [with_stream_mark]: 1.64e-05 [recompute_prepare]: 7.78999e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.26002e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00057325 [add_forward_monad_depend]: 4.99e-06 [auto_monad_grad]: 2.09e-06 [auto_monad_eliminator]: 1.475e-05 [cse]: 3.24e-05 [replace_applicator]: 1.141e-05 [Cycle 2]: 0.00032705, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.17999e-06 [a_1]: 8.919e-05 [with_stream_mark]: 9.26998e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.37002e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.193e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.25e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.424e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 9.89001e-06 [rewriter_after_opt_a]: 3.472e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.00047285 [jit_opt_b]: 5.017e-05, [1] [Cycle 1]: 4.402e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.731e-05 [cconv]: 2.517e-05 [loop_unroll]: 0.00061228 [jit_opt_after_cconv]: 0.00014451, [1] [Cycle 1]: 0.0001377, [11] [c_1]: 2.125e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 2.084e-05 [call_graph_tuple_transform]: 1.88e-05 [tuple_list_get_item_eliminator]: 5.51e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.453e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 5.95002e-06 [add_recomputation]: 5.033e-05 [cse_after_recomputation]: 2.266e-05, [1] [Cycle 1]: 1.73e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.787e-05 [get_jit_bprop_graph]: 1.49998e-06 [rewriter_after_jit_bprop_graph]: 4.61002e-06 [opt_after_jit_grad]: 0.00044761 [symbol_engine_optimizer]: 7.157e-05, [1] [Cycle 1]: 6.517e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.228e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 2.80008e-07 [validate]: 3.728e-05 Sums bootstrap : 0.000272s : 3.28% type_inference : 0.004368s : 52.55% event_method : 0.000018s : 0.21% auto_monad : 0.000064s : 0.77% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.41% rewriter_before_opt_a : 0.000075s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.43% jit_opt_a.a_1 : 0.000601s : 7.23% jit_opt_a.with_stream_mark : 0.000026s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000573s : 6.90% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.25% jit_opt_a.cse : 0.000047s : 0.56% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000035s : 0.42% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000473s : 5.69% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000017s : 0.21% cconv : 0.000025s : 0.30% loop_unroll : 0.000612s : 7.36% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000050s : 0.61% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000018s : 0.21% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000448s : 5.38% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.45% Time group info: ------[substitution.] 0.000188 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000005s : 3: substitution.graph_param_transform 83.37% : 0.000157s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 6.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004313 2 81.90% : 0.003532s : 1: type_inference.infer 18.10% : 0.000781s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.22% : 0.000045s : 4: replace.inline 33.78% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.40% : 0.000154s : 4: match.inline 6.60% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.79% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.72% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.97% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000578 13 54.22% : 0.000314s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.45% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.33% : 0.000233s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013536 72 0.39% : 0.000053s : 1: add_recomputation 0.50% : 0.000068s : 1: auto_monad 0.15% : 0.000020s : 1: auto_monad_reorder 2.15% : 0.000291s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.30% : 0.005049s : 1: jit_opt_a 1.09% : 0.000147s : 1: jit_opt_after_cconv 0.39% : 0.000053s : 1: jit_opt_b 4.60% : 0.000622s : 1: loop_unroll 3.55% : 0.000481s : 1: mutable_eliminate 5.98% : 0.000809s : 26: opt.transform.jit_opt_a 0.35% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.11% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.36% : 0.000455s : 1: opt_after_jit_grad 0.06% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.12% : 0.000286s : 1: renormalize.infer 2.06% : 0.000279s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000038s : 1: rewriter_after_opt_a 0.58% : 0.000078s : 1: rewriter_before_opt_a 0.55% : 0.000074s : 1: symbol_engine_optimizer 32.37% : 0.004382s : 1: type_inference TotalTime = 0.0163747, [30] [bootstrap]: 0.00026791 [type_inference]: 0.00653381 [event_method]: 2.634e-05 [auto_monad]: 7.299e-05 [graph_reusing]: 5.83997e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 6.553e-05 [rewriter_before_opt_a]: 9.862e-05 [expand_dump_flag]: 3.60998e-06 [jit_opt_a]: 0.00674431, [2] [Cycle 1]: 0.00250797, [27] [switch_simplify]: 7.672e-05 [loop_unroll]: 3.812e-05 [a_1]: 0.00079137 [with_stream_mark]: 2.82e-05 [recompute_prepare]: 1.102e-05 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.748e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00116263 [add_forward_monad_depend]: 9.51e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.939e-05 [cse]: 4.005e-05 [replace_applicator]: 1.799e-05 [Cycle 2]: 0.00036948, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.90002e-06 [a_1]: 9.461e-05 [with_stream_mark]: 1.427e-05 [recompute_prepare]: 5.68002e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 2.51e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.637e-05 [j_node_and_user_rematch]: 8.66002e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 1.873e-05 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.83e-06 [cse]: 1.66e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.736e-05 [rewriter_after_opt_a]: 4.159e-05 [convert_after_rewriter]: 7.05998e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00080378 [jit_opt_b]: 5.626e-05, [1] [Cycle 1]: 4.702e-05, [2] [frontend_op_eliminate]: 1.745e-05 [inline_after_opt_a]: 1.755e-05 [cconv]: 3.222e-05 [loop_unroll]: 0.00046547 [jit_opt_after_cconv]: 0.00015841, [1] [Cycle 1]: 0.00015193, [11] [c_1]: 2.192e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 7.06999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 3.037e-05 [call_graph_tuple_transform]: 2.039e-05 [tuple_list_get_item_eliminator]: 5.88002e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.61003e-06 [remove_dup_value]: 1.604e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 1.059e-05 [add_recomputation]: 5.389e-05 [cse_after_recomputation]: 2.519e-05, [1] [Cycle 1]: 1.942e-05, [1] [cse]: 1.299e-05 [auto_monad_reorder]: 2.014e-05 [get_jit_bprop_graph]: 2.96999e-06 [rewriter_after_jit_bprop_graph]: 7.85e-06 [opt_after_jit_grad]: 0.000489 [symbol_engine_optimizer]: 8.702e-05, [1] [Cycle 1]: 8.022e-05, [6] [build]: 1.259e-05 [elim_shapecalc]: 9.29e-06 [elim_not_effective]: 1.342e-05 [opt_reshape]: 5.70001e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 7.59988e-07 [validate]: 5.474e-05 Sums bootstrap : 0.000268s : 2.26% type_inference : 0.006534s : 55.13% event_method : 0.000026s : 0.22% auto_monad : 0.000073s : 0.62% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000066s : 0.55% rewriter_before_opt_a : 0.000099s : 0.83% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000083s : 0.70% jit_opt_a.loop_unroll : 0.000044s : 0.37% jit_opt_a.a_1 : 0.000886s : 7.48% jit_opt_a.with_stream_mark : 0.000042s : 0.36% jit_opt_a.recompute_prepare : 0.000017s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.16% jit_opt_a.inline_without_move : 0.000025s : 0.21% jit_opt_a.renormalize : 0.001163s : 9.81% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.22% jit_opt_a.cse : 0.000057s : 0.48% jit_opt_a.replace_applicator : 0.000023s : 0.20% py_interpret_to_execute_after_opt_a : 0.000017s : 0.15% rewriter_after_opt_a : 0.000042s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000804s : 6.78% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.15% cconv : 0.000032s : 0.27% loop_unroll : 0.000465s : 3.93% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000011s : 0.09% add_recomputation : 0.000054s : 0.45% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000020s : 0.17% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000008s : 0.07% opt_after_jit_grad : 0.000489s : 4.13% symbol_engine_optimizer.build : 0.000013s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000055s : 0.46% Time group info: ------[substitution.] 0.000327 25 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.69% : 0.000006s : 3: substitution.graph_param_transform 87.79% : 0.000287s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.54% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000006s : 2: substitution.replace_old_param 4.68% : 0.000015s : 3: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006451 2 76.70% : 0.004948s : 1: type_inference.infer 23.30% : 0.001503s : 1: type_inference.specialize ------[replace.] 0.000120 8 65.24% : 0.000079s : 5: replace.inline 34.76% : 0.000042s : 3: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 8 95.38% : 0.000283s : 5: match.inline 4.62% : 0.000014s : 3: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 810 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000003s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.26% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.11% : 0.000009s : 26: predicate.inline 1.06% : 0.000002s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 18: predicate.load_eliminater 1.07% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 15: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.94% : 0.000003s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.70% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000003s : 21: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.81% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.93% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 21: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 24: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001035 16 46.73% : 0.000484s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.86% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.41% : 0.000460s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018733 72 0.30% : 0.000057s : 1: add_recomputation 0.41% : 0.000076s : 1: auto_monad 0.12% : 0.000023s : 1: auto_monad_reorder 1.53% : 0.000286s : 1: bootstrap 0.19% : 0.000035s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.07% : 0.000013s : 1: environ_conv 0.17% : 0.000031s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 36.03% : 0.006749s : 1: jit_opt_a 0.86% : 0.000161s : 1: jit_opt_after_cconv 0.32% : 0.000059s : 1: jit_opt_b 2.53% : 0.000475s : 1: loop_unroll 4.36% : 0.000816s : 1: mutable_eliminate 6.15% : 0.001152s : 26: opt.transform.jit_opt_a 0.27% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000020s : 1: opt.transform.mutable_eliminate 0.13% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000498s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000069s : 1: py_interpret_to_execute 0.10% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 3.47% : 0.000651s : 1: renormalize.infer 2.67% : 0.000501s : 1: renormalize.specialize 0.05% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000045s : 1: rewriter_after_opt_a 0.55% : 0.000102s : 1: rewriter_before_opt_a 0.48% : 0.000089s : 1: symbol_engine_optimizer 34.99% : 0.006555s : 1: type_inference TotalTime = 0.122146, [30] [bootstrap]: 0.0002645 [type_inference]: 0.108856 [event_method]: 1.818e-05 [auto_monad]: 7.227e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00037963 [rewriter_before_opt_a]: 7.868e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.0101607, [2] [Cycle 1]: 0.00593978, [27] [switch_simplify]: 5.658e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00061006 [with_stream_mark]: 1.699e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.35002e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00487976 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 1.827e-05 [cse]: 3.02e-05 [replace_applicator]: 1.743e-05 [Cycle 2]: 0.0003869, [27] [switch_simplify]: 6.78998e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.0001259 [with_stream_mark]: 1.136e-05 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 6.35002e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 2.83003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.209e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 1.116e-05 [rewriter_after_opt_a]: 4.34e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 1.745e-05 [mutable_eliminate]: 0.00061548 [jit_opt_b]: 5.628e-05, [1] [Cycle 1]: 4.884e-05, [2] [frontend_op_eliminate]: 1.982e-05 [inline_after_opt_a]: 1.806e-05 [cconv]: 2.423e-05 [loop_unroll]: 0.0004178 [jit_opt_after_cconv]: 0.00014898, [1] [Cycle 1]: 0.00014242, [11] [c_1]: 2.501e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 1.94999e-06 [cse]: 1.826e-05 [call_graph_tuple_transform]: 2.164e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 7.05e-06 [remove_dup_value]: 1.611e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 7.68001e-06 [add_recomputation]: 5.342e-05 [cse_after_recomputation]: 2.275e-05, [1] [Cycle 1]: 1.76e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.586e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.77001e-06 [opt_after_jit_grad]: 0.00045261 [symbol_engine_optimizer]: 0.00017392, [1] [Cycle 1]: 0.00016716, [6] [build]: 3.43999e-06 [elim_shapecalc]: 8.78001e-06 [elim_not_effective]: 1.192e-05 [opt_reshape]: 0.00010003 [fold_const_symbol]: 1.147e-05 [renormalize]: 4.50003e-07 [validate]: 4.466e-05 Sums bootstrap : 0.000265s : 0.22% type_inference : 0.108856s : 92.46% event_method : 0.000018s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000380s : 0.32% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000736s : 0.63% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.004880s : 4.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000017s : 0.01% mutable_eliminate : 0.000615s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000418s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000453s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000100s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000210 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 4: substitution.graph_param_transform 83.14% : 0.000174s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000006s : 4: substitution.remove_not_recompute_node 2.36% : 0.000005s : 2: substitution.replace_old_param 5.94% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108792 2 97.74% : 0.106328s : 1: type_inference.infer 2.26% : 0.002463s : 1: type_inference.specialize ------[replace.] 0.000082 6 72.39% : 0.000059s : 4: replace.inline 27.61% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.79% : 0.000172s : 4: match.inline 6.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.36% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000001s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.18% : 0.000002s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.74% : 0.000004s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 2.18% : 0.000003s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002014 22 66.65% : 0.001343s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.53% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.82% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128158 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000278s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.93% : 0.010165s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.33% : 0.000426s : 1: loop_unroll 0.49% : 0.000622s : 1: mutable_eliminate 0.76% : 0.000971s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000129s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000461s : 1: opt_after_jit_grad 0.02% : 0.000020s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000385s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 3.24% : 0.004156s : 1: renormalize.infer 0.56% : 0.000713s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.14% : 0.000177s : 1: symbol_engine_optimizer 84.95% : 0.108869s : 1: type_inference TotalTime = 0.0293329, [30] [bootstrap]: 0.0003096 [type_inference]: 0.0206973 [event_method]: 2.064e-05 [auto_monad]: 6.987e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00013357 [rewriter_before_opt_a]: 8.606e-05 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.00586878, [2] [Cycle 1]: 0.00216601, [27] [switch_simplify]: 6.067e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.00054896 [with_stream_mark]: 1.732e-05 [recompute_prepare]: 8.02003e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.483e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 6.03002e-06 [renormalize]: 0.00116437 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.65997e-06 [auto_monad_eliminator]: 1.55e-05 [cse]: 3.49e-05 [replace_applicator]: 1.432e-05 [Cycle 2]: 0.00035151, [27] [switch_simplify]: 6.69001e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.0001035 [with_stream_mark]: 1.02e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.81003e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 8.05e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.46001e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.72999e-06 [cse]: 1.31e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.248e-05 [rewriter_after_opt_a]: 3.977e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.000527 [jit_opt_b]: 5.18e-05, [1] [Cycle 1]: 4.463e-05, [2] [frontend_op_eliminate]: 1.694e-05 [inline_after_opt_a]: 1.679e-05 [cconv]: 2.514e-05 [loop_unroll]: 0.00042614 [jit_opt_after_cconv]: 0.0001441, [1] [Cycle 1]: 0.00013797, [11] [c_1]: 2.166e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.221e-05 [call_graph_tuple_transform]: 1.89e-05 [tuple_list_get_item_eliminator]: 5.61998e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.54e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.435e-05, [1] [Cycle 1]: 1.867e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.882e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 4.33999e-06 [opt_after_jit_grad]: 0.00046963 [symbol_engine_optimizer]: 7.5e-05, [1] [Cycle 1]: 6.855e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 5.97999e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 5.90022e-07 [validate]: 4.118e-05 Sums bootstrap : 0.000310s : 1.22% type_inference : 0.020697s : 81.54% event_method : 0.000021s : 0.08% auto_monad : 0.000070s : 0.28% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000134s : 0.53% rewriter_before_opt_a : 0.000086s : 0.34% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.27% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000652s : 2.57% jit_opt_a.with_stream_mark : 0.000028s : 0.11% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001164s : 4.59% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000048s : 0.19% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000527s : 2.08% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000025s : 0.10% loop_unroll : 0.000426s : 1.68% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000051s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000470s : 1.85% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.16% Time group info: ------[substitution.] 0.000202 23 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.95% : 0.000002s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 3: substitution.graph_param_transform 83.38% : 0.000168s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000004s : 4: substitution.remove_not_recompute_node 1.61% : 0.000003s : 2: substitution.replace_old_param 6.58% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020619 2 90.90% : 0.018742s : 1: type_inference.infer 9.10% : 0.001877s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.85% : 0.000051s : 4: replace.inline 33.15% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 93.20% : 0.000166s : 4: match.inline 6.80% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 10: predicate.environ_get_depend_swap 1.34% : 0.000002s : 10: predicate.environ_get_eliminate 1.31% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.66% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000941 13 40.44% : 0.000381s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.17% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.38% : 0.000531s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031415 72 0.17% : 0.000054s : 1: add_recomputation 0.23% : 0.000073s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.02% : 0.000319s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.69% : 0.005873s : 1: jit_opt_a 0.47% : 0.000147s : 1: jit_opt_after_cconv 0.17% : 0.000054s : 1: jit_opt_b 1.38% : 0.000434s : 1: loop_unroll 1.70% : 0.000535s : 1: mutable_eliminate 2.79% : 0.000877s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000477s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000138s : 1: py_interpret_to_execute 0.05% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 2.16% : 0.000680s : 1: renormalize.infer 1.52% : 0.000477s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000043s : 1: rewriter_after_opt_a 0.29% : 0.000090s : 1: rewriter_before_opt_a 0.25% : 0.000077s : 1: symbol_engine_optimizer 65.93% : 0.020713s : 1: type_inference TotalTime = 0.174847, [30] [bootstrap]: 0.00041839 [type_inference]: 0.159011 [event_method]: 2.855e-05 [auto_monad]: 8.075e-05 [graph_reusing]: 6.18002e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00071111 [rewriter_before_opt_a]: 0.00043768 [expand_dump_flag]: 4.71002e-06 [jit_opt_a]: 0.0112981, [2] [Cycle 1]: 0.00624958, [27] [switch_simplify]: 8.456e-05 [loop_unroll]: 3.542e-05 [a_1]: 0.00086327 [with_stream_mark]: 2.703e-05 [recompute_prepare]: 1.025e-05 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.47001e-06 [specialize_transform]: 8.55999e-06 [updatestate_useless_node_eliminater]: 7.16001e-06 [accelerated_algorithm]: 7.75e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.779e-05 [j_node_and_user_rematch]: 1.303e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 1.264e-05 [inline_without_move]: 7.87e-06 [renormalize]: 0.00478642 [add_forward_monad_depend]: 1.281e-05 [auto_monad_grad]: 2.90998e-06 [auto_monad_eliminator]: 2.409e-05 [cse]: 4.1e-05 [replace_applicator]: 2.869e-05 [Cycle 2]: 0.00046965, [27] [switch_simplify]: 9.69999e-06 [loop_unroll]: 7.77998e-06 [a_1]: 0.00017348 [with_stream_mark]: 1.759e-05 [recompute_prepare]: 7.78001e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 7.41999e-06 [accelerated_algorithm]: 7.56999e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.40002e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 4.26001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 3.58e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.23998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 7.33999e-06 [cse]: 1.629e-05 [replace_applicator]: 7.00998e-06 [py_interpret_to_execute_after_opt_a]: 2.282e-05 [rewriter_after_opt_a]: 4.362e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00088801 [jit_opt_b]: 6.634e-05, [1] [Cycle 1]: 5.68e-05, [2] [frontend_op_eliminate]: 2.317e-05 [inline_after_opt_a]: 2.067e-05 [cconv]: 3.332e-05 [loop_unroll]: 0.00049714 [jit_opt_after_cconv]: 0.00019022, [1] [Cycle 1]: 0.00018165, [11] [c_1]: 2.981e-05 [parameter_eliminate]: 4.57e-06 [updatestate_depend_eliminate]: 8.80999e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.66999e-06 [cse]: 3.488e-05 [call_graph_tuple_transform]: 2.847e-05 [tuple_list_get_item_eliminator]: 6.79999e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 7.36001e-06 [remove_dup_value]: 2.027e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 1.114e-05 [add_recomputation]: 5.662e-05 [cse_after_recomputation]: 2.713e-05, [1] [Cycle 1]: 2.106e-05, [1] [cse]: 1.489e-05 [auto_monad_reorder]: 2.014e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 9.00999e-06 [opt_after_jit_grad]: 0.00055832 [symbol_engine_optimizer]: 8.706e-05, [1] [Cycle 1]: 8.01e-05, [6] [build]: 4.88001e-06 [elim_shapecalc]: 9.51e-06 [elim_not_effective]: 1.612e-05 [opt_reshape]: 8.21002e-06 [fold_const_symbol]: 1.064e-05 [renormalize]: 4.39992e-07 [validate]: 5.943e-05 Sums bootstrap : 0.000418s : 0.25% type_inference : 0.159011s : 93.79% event_method : 0.000029s : 0.02% auto_monad : 0.000081s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000711s : 0.42% rewriter_before_opt_a : 0.000438s : 0.26% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000094s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001037s : 0.61% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000015s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004786s : 2.82% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000057s : 0.03% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000023s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000888s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000497s : 0.29% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000057s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000558s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.04% Time group info: ------[substitution.] 0.000376 28 0.50% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000007s : 4: substitution.graph_param_transform 84.11% : 0.000316s : 5: substitution.inline 1.29% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.71% : 0.000018s : 3: substitution.reduce_eliminate 1.56% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000007s : 2: substitution.replace_old_param 3.74% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.158892 2 97.26% : 0.154541s : 1: type_inference.infer 2.74% : 0.004351s : 1: type_inference.specialize ------[replace.] 0.000129 7 69.97% : 0.000090s : 5: replace.inline 30.03% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000326 7 96.12% : 0.000313s : 5: match.inline 3.88% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.53% : 0.000003s : 13: predicate.accumulaten_eliminater 0.95% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.63% : 0.000003s : 13: predicate.addn_zero_filter 2.34% : 0.000004s : 13: predicate.arithmetic_simplify 1.68% : 0.000003s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.51% : 0.000009s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.63% : 0.000003s : 8: predicate.less_batch_normalization 1.57% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.24% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 2.15% : 0.000004s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 19: predicate.partial_eliminate 1.52% : 0.000003s : 13: predicate.print_const_string_wrapper 2.19% : 0.000004s : 13: predicate.reduce_eliminate 1.63% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000001s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 13: predicate.reshape_eliminate 1.39% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 1.94% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.89% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.85% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.03% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.006372 25 78.24% : 0.004985s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.62% : 0.000103s : 2: func_graph_cloner_run.FuncGraphClonerNode 20.14% : 0.001283s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.181025 72 0.03% : 0.000060s : 1: add_recomputation 0.05% : 0.000084s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.24% : 0.000438s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.24% : 0.011303s : 1: jit_opt_a 0.11% : 0.000193s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.28% : 0.000506s : 1: loop_unroll 0.50% : 0.000898s : 1: mutable_eliminate 0.74% : 0.001335s : 26: opt.transform.jit_opt_a 0.04% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000568s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000722s : 1: py_interpret_to_execute 0.01% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.77% : 0.003212s : 1: renormalize.infer 0.86% : 0.001559s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.25% : 0.000450s : 1: rewriter_before_opt_a 0.05% : 0.000090s : 1: symbol_engine_optimizer 87.85% : 0.159037s : 1: type_inference TotalTime = 0.0710357, [30] [bootstrap]: 0.00025955 [type_inference]: 0.0587247 [event_method]: 2.437e-05 [auto_monad]: 7.713e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00029813 [rewriter_before_opt_a]: 0.00010966 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00874258, [2] [Cycle 1]: 0.00441514, [27] [switch_simplify]: 7.208e-05 [loop_unroll]: 3.737e-05 [a_1]: 0.0007363 [with_stream_mark]: 2.338e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 7.62002e-06 [updatestate_useless_node_eliminater]: 6.69001e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.81999e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.666e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.096e-05 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00315622 [add_forward_monad_depend]: 9.22001e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.922e-05 [cse]: 3.673e-05 [replace_applicator]: 2.007e-05 [Cycle 2]: 0.00039378, [27] [switch_simplify]: 7.41001e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00012553 [with_stream_mark]: 1.356e-05 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 6.23002e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 2.93e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.798e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 5.71e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.02999e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.603e-05 [replace_applicator]: 6.83e-06 [py_interpret_to_execute_after_opt_a]: 1.729e-05 [rewriter_after_opt_a]: 4.112e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00082015 [jit_opt_b]: 6.013e-05, [1] [Cycle 1]: 5.108e-05, [2] [frontend_op_eliminate]: 1.93e-05 [inline_after_opt_a]: 2.058e-05 [cconv]: 3.475e-05 [loop_unroll]: 0.00050918 [jit_opt_after_cconv]: 0.00018375, [1] [Cycle 1]: 0.00017616, [11] [c_1]: 2.681e-05 [parameter_eliminate]: 4.72e-06 [updatestate_depend_eliminate]: 9.44998e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.97e-06 [cse]: 3.666e-05 [call_graph_tuple_transform]: 2.412e-05 [tuple_list_get_item_eliminator]: 7.41001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.63998e-06 [remove_dup_value]: 2.247e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 1.044e-05 [add_recomputation]: 5.905e-05 [cse_after_recomputation]: 2.662e-05, [1] [Cycle 1]: 2.075e-05, [1] [cse]: 1.4e-05 [auto_monad_reorder]: 1.88e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 7.62998e-06 [opt_after_jit_grad]: 0.00051018 [symbol_engine_optimizer]: 8.179e-05, [1] [Cycle 1]: 7.53e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 1.011e-05 [elim_not_effective]: 1.625e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 5.59987e-07 [validate]: 0.00015736 Sums bootstrap : 0.000260s : 0.39% type_inference : 0.058725s : 88.36% event_method : 0.000024s : 0.04% auto_monad : 0.000077s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000298s : 0.45% rewriter_before_opt_a : 0.000110s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.12% jit_opt_a.loop_unroll : 0.000044s : 0.07% jit_opt_a.a_1 : 0.000862s : 1.30% jit_opt_a.with_stream_mark : 0.000037s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.003156s : 4.75% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000053s : 0.08% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000041s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000820s : 1.23% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000035s : 0.05% loop_unroll : 0.000509s : 0.77% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000037s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000022s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000059s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000510s : 0.77% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000157s : 0.24% Time group info: ------[substitution.] 0.000300 25 0.87% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000007s : 4: substitution.graph_param_transform 86.48% : 0.000259s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 4.71% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058633 2 96.06% : 0.056324s : 1: type_inference.infer 3.94% : 0.002309s : 1: type_inference.specialize ------[replace.] 0.000105 7 69.90% : 0.000073s : 5: replace.inline 30.10% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000270 7 95.20% : 0.000257s : 5: match.inline 4.80% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 888 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 1.98% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 6.50% : 0.000009s : 28: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.16% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 2.14% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.73% : 0.000011s : 65: predicate.switch_simplify 1.48% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002504 29 68.07% : 0.001704s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.51% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.42% : 0.000712s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075289 72 0.08% : 0.000062s : 1: add_recomputation 0.11% : 0.000081s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.37% : 0.000276s : 1: bootstrap 0.05% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.62% : 0.008746s : 1: jit_opt_a 0.25% : 0.000187s : 1: jit_opt_after_cconv 0.08% : 0.000063s : 1: jit_opt_b 0.69% : 0.000520s : 1: loop_unroll 1.11% : 0.000834s : 1: mutable_eliminate 1.50% : 0.001132s : 26: opt.transform.jit_opt_a 0.08% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000022s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000520s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000304s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000025s : 1: remove_dup_value 3.16% : 0.002379s : 1: renormalize.infer 1.02% : 0.000765s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.15% : 0.000115s : 1: rewriter_before_opt_a 0.11% : 0.000084s : 1: symbol_engine_optimizer 78.03% : 0.058746s : 1: type_inference TotalTime = 0.0309709, [30] [bootstrap]: 0.00033089 [type_inference]: 0.0218093 [event_method]: 2.194e-05 [auto_monad]: 7.183e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.90002e-06 [py_interpret_to_execute]: 0.0001079 [rewriter_before_opt_a]: 8.356e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00602721, [2] [Cycle 1]: 0.00206149, [27] [switch_simplify]: 6.298e-05 [loop_unroll]: 3.05e-05 [a_1]: 0.00058409 [with_stream_mark]: 2.415e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 7.20998e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 5.94e-06 [renormalize]: 0.00098467 [add_forward_monad_depend]: 6.54999e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.502e-05 [cse]: 3.642e-05 [replace_applicator]: 1.828e-05 [Cycle 2]: 0.00036603, [27] [switch_simplify]: 6.36e-06 [loop_unroll]: 5.35999e-06 [a_1]: 9.467e-05 [with_stream_mark]: 1.422e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.30003e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.24998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.21e-06 [auto_monad_grad]: 1.55999e-06 [auto_monad_eliminator]: 7.95998e-06 [cse]: 1.663e-05 [replace_applicator]: 6.96999e-06 [py_interpret_to_execute_after_opt_a]: 1.467e-05 [rewriter_after_opt_a]: 4.021e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.0007133 [jit_opt_b]: 5.519e-05, [1] [Cycle 1]: 4.635e-05, [2] [frontend_op_eliminate]: 1.735e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00048527 [jit_opt_after_cconv]: 0.00016693, [1] [Cycle 1]: 0.00015993, [11] [c_1]: 2.238e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 7.87e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [cse]: 3.095e-05 [call_graph_tuple_transform]: 2.225e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.912e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 7.30998e-06 [add_recomputation]: 5.45e-05 [cse_after_recomputation]: 2.61e-05, [1] [Cycle 1]: 2.038e-05, [1] [cse]: 1.389e-05 [auto_monad_reorder]: 1.974e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 6.28e-06 [opt_after_jit_grad]: 0.00051943 [symbol_engine_optimizer]: 7.665e-05, [1] [Cycle 1]: 6.928e-05, [6] [build]: 4.01001e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.05999e-06 [renormalize]: 6.10016e-07 [validate]: 4.566e-05 Sums bootstrap : 0.000331s : 1.24% type_inference : 0.021809s : 81.65% event_method : 0.000022s : 0.08% auto_monad : 0.000072s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000108s : 0.40% rewriter_before_opt_a : 0.000084s : 0.31% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.13% jit_opt_a.a_1 : 0.000679s : 2.54% jit_opt_a.with_stream_mark : 0.000038s : 0.14% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000985s : 3.69% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000040s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000713s : 2.67% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000026s : 0.10% loop_unroll : 0.000485s : 1.82% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000014s : 0.05% auto_monad_reorder : 0.000020s : 0.07% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000519s : 1.94% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.17% Time group info: ------[substitution.] 0.000246 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 3: substitution.graph_param_transform 84.66% : 0.000208s : 4: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000006s : 4: substitution.remove_not_recompute_node 2.43% : 0.000006s : 2: substitution.replace_old_param 5.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021731 2 93.56% : 0.020331s : 1: type_inference.infer 6.44% : 0.001401s : 1: type_inference.specialize ------[replace.] 0.000077 6 66.53% : 0.000051s : 4: replace.inline 33.47% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.72% : 0.000205s : 4: match.inline 5.28% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.98% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.26% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.92% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 6: predicate.remove_not_recompute_node 2.05% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.09% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 10: predicate.same_eliminate 0.76% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000001s : 6: predicate.special_op_eliminate 1.13% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.57% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000775 13 47.60% : 0.000369s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.55% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.85% : 0.000355s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032935 72 0.18% : 0.000058s : 1: add_recomputation 0.23% : 0.000076s : 1: auto_monad 0.07% : 0.000023s : 1: auto_monad_reorder 1.07% : 0.000352s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000042s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.31% : 0.006031s : 1: jit_opt_a 0.52% : 0.000170s : 1: jit_opt_after_cconv 0.18% : 0.000058s : 1: jit_opt_b 1.51% : 0.000497s : 1: loop_unroll 2.19% : 0.000722s : 1: mutable_eliminate 2.79% : 0.000919s : 26: opt.transform.jit_opt_a 0.16% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.61% : 0.000532s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000112s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 1.77% : 0.000581s : 1: renormalize.infer 1.20% : 0.000394s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000044s : 1: rewriter_after_opt_a 0.26% : 0.000087s : 1: rewriter_before_opt_a 0.24% : 0.000080s : 1: symbol_engine_optimizer 66.28% : 0.021828s : 1: type_inference TotalTime = 0.0268496, [30] [bootstrap]: 0.00039684 [type_inference]: 0.00818957 [event_method]: 2.074e-05 [auto_monad]: 7.268e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 5.767e-05 [rewriter_before_opt_a]: 0.00013913 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00738216, [2] [Cycle 1]: 0.00210746, [27] [switch_simplify]: 6.497e-05 [loop_unroll]: 3.086e-05 [a_1]: 0.000599 [with_stream_mark]: 2.323e-05 [recompute_prepare]: 8.74998e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 9.48002e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 8.55999e-06 [renormalize]: 0.00102478 [add_forward_monad_depend]: 1.225e-05 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.743e-05 [cse]: 3.859e-05 [replace_applicator]: 1.462e-05 [Cycle 2]: 0.00034515, [27] [switch_simplify]: 6.75002e-06 [loop_unroll]: 5.62999e-06 [a_1]: 9.6e-05 [with_stream_mark]: 1.102e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.431e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.476e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.376e-05 [rewriter_after_opt_a]: 4.01e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 5.65001e-06 [mutable_eliminate]: 0.00727205 [jit_opt_b]: 7.237e-05, [1] [Cycle 1]: 5.249e-05, [2] [frontend_op_eliminate]: 1.877e-05 [inline_after_opt_a]: 2.006e-05 [cconv]: 3.947e-05 [loop_unroll]: 0.00056029 [jit_opt_after_cconv]: 0.0002, [1] [Cycle 1]: 0.00019286, [11] [c_1]: 2.677e-05 [parameter_eliminate]: 6.50002e-06 [updatestate_depend_eliminate]: 1.097e-05 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.16999e-06 [cse]: 4.667e-05 [call_graph_tuple_transform]: 2.679e-05 [tuple_list_get_item_eliminator]: 6.01998e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.84999e-06 [remove_dup_value]: 1.807e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 1.156e-05 [add_recomputation]: 6.278e-05 [cse_after_recomputation]: 2.544e-05, [1] [Cycle 1]: 1.965e-05, [1] [cse]: 1.386e-05 [auto_monad_reorder]: 1.752e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 1.191e-05 [opt_after_jit_grad]: 0.0018317 [symbol_engine_optimizer]: 9.423e-05, [1] [Cycle 1]: 8.731e-05, [6] [build]: 1.425e-05 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.567e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 1.30999e-06 [validate]: 6.274e-05 Sums bootstrap : 0.000397s : 1.87% type_inference : 0.008190s : 38.54% event_method : 0.000021s : 0.10% auto_monad : 0.000073s : 0.34% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000058s : 0.27% rewriter_before_opt_a : 0.000139s : 0.65% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.34% jit_opt_a.loop_unroll : 0.000036s : 0.17% jit_opt_a.a_1 : 0.000695s : 3.27% jit_opt_a.with_stream_mark : 0.000034s : 0.16% jit_opt_a.recompute_prepare : 0.000015s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.09% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.09% jit_opt_a.inline_without_move : 0.000014s : 0.07% jit_opt_a.renormalize : 0.001025s : 4.82% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.11% jit_opt_a.cse : 0.000053s : 0.25% jit_opt_a.replace_applicator : 0.000020s : 0.09% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000040s : 0.19% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.007272s : 34.22% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.09% jit_opt_b.inline_after_opt_a : 0.000020s : 0.09% cconv : 0.000039s : 0.19% loop_unroll : 0.000560s : 2.64% jit_opt_after_cconv.c_1 : 0.000027s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000047s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000018s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000012s : 0.05% add_recomputation : 0.000063s : 0.30% cse_after_recomputation.cse : 0.000014s : 0.07% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.06% opt_after_jit_grad : 0.001832s : 8.62% symbol_engine_optimizer.build : 0.000014s : 0.07% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000063s : 0.30% Time group info: ------[substitution.] 0.000254 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 85.75% : 0.000218s : 4: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 4.90% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008096 2 82.50% : 0.006679s : 1: type_inference.infer 17.50% : 0.001417s : 1: type_inference.specialize ------[replace.] 0.000082 6 70.73% : 0.000058s : 4: replace.inline 29.27% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 95.02% : 0.000215s : 4: match.inline 4.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 1.58% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.68% : 0.000002s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.60% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000008s : 22: predicate.inline 1.03% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.25% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 15: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 4.77% : 0.000006s : 3: predicate.mutable_eliminate 0.74% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.62% : 0.000001s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.62% : 0.000002s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 1.88% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.23% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000002s : 10: predicate.tile_eliminate 1.07% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.51% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001049 13 55.04% : 0.000577s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.08% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.88% : 0.000418s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028881 72 0.23% : 0.000066s : 1: add_recomputation 0.26% : 0.000076s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.44% : 0.000417s : 1: bootstrap 0.14% : 0.000042s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000014s : 1: environ_conv 0.09% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 25.57% : 0.007386s : 1: jit_opt_a 0.70% : 0.000203s : 1: jit_opt_after_cconv 0.26% : 0.000076s : 1: jit_opt_b 1.97% : 0.000568s : 1: loop_unroll 25.28% : 0.007300s : 1: mutable_eliminate 3.23% : 0.000934s : 26: opt.transform.jit_opt_a 0.20% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000031s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.16% : 0.000045s : 1: opt.transform.mutable_eliminate 0.10% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000038s : 4: opt.transform.symbol_engine_opt 6.39% : 0.001844s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000061s : 1: py_interpret_to_execute 0.06% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000021s : 1: remove_dup_value 1.98% : 0.000573s : 1: renormalize.infer 1.54% : 0.000444s : 1: renormalize.specialize 0.05% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000043s : 1: rewriter_after_opt_a 0.49% : 0.000143s : 1: rewriter_before_opt_a 0.34% : 0.000097s : 1: symbol_engine_optimizer 28.43% : 0.008211s : 1: type_inference TotalTime = 0.0920822, [30] [bootstrap]: 0.0003001 [type_inference]: 0.0806075 [event_method]: 2.739e-05 [auto_monad]: 7.91e-05 [graph_reusing]: 5.71998e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 0.00030729 [rewriter_before_opt_a]: 0.00010782 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.00816149, [2] [Cycle 1]: 0.00395423, [27] [switch_simplify]: 6.006e-05 [loop_unroll]: 3.56e-05 [a_1]: 0.00072637 [with_stream_mark]: 2.179e-05 [recompute_prepare]: 1.182e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.58998e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.93999e-06 [updatestate_useless_node_eliminater]: 6.97002e-06 [accelerated_algorithm]: 6.68998e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 6.94999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.666e-05 [j_node_and_user_rematch]: 1.085e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.114e-05 [inline_without_move]: 6.93e-06 [renormalize]: 0.00274702 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 1.437e-05 [cse]: 2.26e-05 [replace_applicator]: 1.554e-05 [Cycle 2]: 0.00038077, [27] [switch_simplify]: 6.97002e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.00012072 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 6.26998e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.25998e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.38e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 7.43e-06 [cse]: 1.742e-05 [replace_applicator]: 6.66e-06 [py_interpret_to_execute_after_opt_a]: 9.96998e-06 [rewriter_after_opt_a]: 3.121e-05 [convert_after_rewriter]: 5.67999e-06 [order_py_execute_after_rewriter]: 4.44998e-06 [mutable_eliminate]: 0.00063528 [jit_opt_b]: 5.626e-05, [1] [Cycle 1]: 4.861e-05, [2] [frontend_op_eliminate]: 1.792e-05 [inline_after_opt_a]: 1.908e-05 [cconv]: 2.926e-05 [loop_unroll]: 0.00048122 [jit_opt_after_cconv]: 0.00017352, [1] [Cycle 1]: 0.00016603, [11] [c_1]: 2.743e-05 [parameter_eliminate]: 4.17003e-06 [updatestate_depend_eliminate]: 7.72002e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 3.05002e-06 [cse]: 3.126e-05 [call_graph_tuple_transform]: 2.339e-05 [tuple_list_get_item_eliminator]: 7.13e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.774e-05 [partial_unused_args_eliminate]: 1.77001e-06 [environ_conv]: 9.75002e-06 [add_recomputation]: 5.193e-05 [cse_after_recomputation]: 2.723e-05, [1] [Cycle 1]: 2.142e-05, [1] [cse]: 1.5e-05 [auto_monad_reorder]: 1.829e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.00056716 [symbol_engine_optimizer]: 8.405e-05, [1] [Cycle 1]: 7.714e-05, [6] [build]: 5.22999e-06 [elim_shapecalc]: 9 TotalTime = 0.116728, [30] [bootstrap]: 0.00032863 [type_inference]: 0.101928 [event_method]: 0.00046675 [auto_monad]: 0.00019664 [graph_reusing]: 9.42999e-06 [pre_auto_parallel]: 4.05e-06 [py_interpret_to_execute]: 5.125e-05 [rewriter_before_opt_a]: 0.00015906 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.0109142, [2] [Cycle 1]: 0.00608008, [27] [switch_simplify]: 0.00021692 [loop_unroll]: 8.082e-05 [a_1]: 0.00180712 [with_stream_mark]: 3.021e-05 [recompute_prepare]: 1.413e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 3.02002e-06 [specialize_transform]: 8.13001e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.942e-05 [j_node_and_user_rematch]: 1.33e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.358e-05 [inline_without_move]: 8.20999e-06 [renormalize]: 0.00347888 [add_forward_monad_depend]: 9.64e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.9e-05 [cse]: 3.967e-05 [replace_applicator]: 2.122e-05 [Cycle 2]: 0.00039699, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.21998e-06 [a_1]: 0.0001199 [with_stream_mark]: 1.473e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.96e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 6.01003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.84999e-06 [cse]: 1.556e-05 [replace_applicator]: 6.45002e-06 [py_interpret_to_execute_after_opt_a]: 1.807e-05 [rewriter_after_opt_a]: 4.254e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00074856 [jit_opt_b]: 5.855e-05, [1] [Cycle 1]: 4.962e-05, [2] [frontend_op_eliminate]: 1.998e-05 [inline_after_opt_a]: 1.734e-05 [cconv]: 2.719e-05 [loop_unroll]: 0.00048045 [jit_opt_after_cconv]: 0.0001751, [1] [Cycle 1]: 0.000167, [11] [c_1]: 2.613e-05 [parameter_eliminate]: 4.38999e-06 [updatestate_depend_eliminate]: 7.2e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 3.009e-05 [call_graph_tuple_transform]: 2.3e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.54001e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 7.36999e-06 [add_recomputation]: 5.353e-05 [cse_after_recomputation]: 2.695e-05, [1] [Cycle 1]: 2.027e-05, [1] [cse]: 1.387e-05 [auto_monad_reorder]: 1.763e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 6.07001e-06 [opt_after_jit_grad]: 0.00056537 [symbol_engine_optimizer]: 8.673e-05, [1] [Cycle 1]: 7.967e-05, [6] [build]: 5.44e-06 [elim_shapecalc]: 8.79e-0.15001e-06 [elim_not_effective]: 1.589e-05 [opt_reshape]: 7.4e-06 [fold_const_symbol]: 1.005e-05 [renormalize]: 4.80009e-07 [validate]: 5.078e-05 Sums bootstrap : 0.000300s : 0.34% type_inference : 0.080607s : 92.02% event_method : 0.000027s : 0.03% auto_monad : 0.000079s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000307s : 0.35% rewriter_before_opt_a : 0.000108s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.08% jit_opt_a.loop_unroll : 0.000042s : 0.05% jit_opt_a.a_1 : 0.000847s : 0.97% jit_opt_a.with_stream_mark : 0.000032s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002747s : 3.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000040s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000635s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000481s : 0.55% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.0006 [elim_not_effective]: 1.609e-05 [opt_reshape]: 7.1e-06 [fold_const_symbol]: 1.072e-05 [renormalize]: 4.2998e-07 [validate]: 8.895e-05 Sums bootstrap : 0.000329s : 0.29% type_inference : 0.101928s : 91.37% event_method : 0.000467s : 0.42% auto_monad : 0.000197s : 0.18% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000051s : 0.05% rewriter_before_opt_a : 0.000159s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000224s : 0.20% jit_opt_a.loop_unroll : 0.000087s : 0.08% jit_opt_a.a_1 : 0.001927s : 1.73% jit_opt_a.with_stream_mark : 0.000045s : 0.04% jit_opt_a.recompute_prepare : 0.000020s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003479s : 3.12% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000055s : 0.05% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000749s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000480s : 0.43% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000567s : 0.65% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.06% 00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000565s : 0.51% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.08% Time group info: ------[substitution.] 0.000269 25 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 4: substitution.graph_param_transform 87.04% : 0.000234s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000005s : 2: substitution.replace_old_param 3.91% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.080502 2 96.84% : 0.077960s : 1: type_inference.infer 3.16% : 0.002542s : 1: type_inference.specialize ------[replace.] 0.000110 7 67.40% : 0.000074s : 5: replace.inline 32.60% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 96.26% : 0.000231s : 5: match.inline 3.74% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.45% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 13: predicate.compare_switch_simplify 1.44% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 6.04% : 0.000008s : 28: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.86% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.66% : 0.000002s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.98% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 65: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.31% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.87% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002732 29 70.11% : 0.001916s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.94% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.94% : 0.000736s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.096006 72 0.06% : 0.000055s : 1: add_recomputation 0.09% : 0.000082s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.33% : 0.000319s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000033s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.50% : 0.008165s : 1: jit_opt_a 0.18% : 0.000177s : 1: jit_opt_after_cconv 0.06% : 0.000059s : 1: jit_opt_b 0.51% : 0.000491s : 1: loop_unroll 0.67% : 0.000648s : 1: mutable_eliminate 1.15% : 0.001105s : 26: opt.transform.jit_opt_a 0.06% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000580s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000315s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 2.12% : 0.002036s : 1: renormalize.infer 0.73% : 0.000700s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000115s : 1: rewriter_before_opt_a 0.09% : 0.000087s : 1: symbol_engine_optimizer 83.99% : 0.080632s : 1: type_inference Time group info: ------[substitution.] 0.000776 35 0.22% : 0.000002s : 2: substitution.elim_not_effective 0.15% : 0.000001s : 2: substitution.fold_const_symbol 0.76% : 0.000006s : 3: substitution.graph_param_transform 90.96% : 0.000706s : 12: substitution.inline 0.76% : 0.000006s : 4: substitution.j_node_and_user_rematch 0.82% : 0.000006s : 4: substitution.remove_not_recompute_node 0.83% : 0.000006s : 2: substitution.replace_old_param 1.53% : 0.000012s : 1: substitution.reshape_eliminate 2.08% : 0.000016s : 3: substitution.switch_simplify 1.89% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101812 2 95.95% : 0.097692s : 1: type_inference.infer 4.05% : 0.004120s : 1: type_inference.specialize ------[replace.] 0.000375 18 53.21% : 0.000200s : 12: replace.inline 1.81% : 0.000007s : 1: replace.reshape_eliminate 19.76% : 0.000074s : 3: replace.switch_simplify 25.21% : 0.000095s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000736 18 94.84% : 0.000698s : 12: match.inline 1.40% : 0.000010s : 1: match.reshape_eliminate 1.97% : 0.000014s : 3: match.switch_simplify 1.79% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000232 1212 1.38% : 0.000003s : 19: predicate.accumulaten_eliminater 0.69% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000003s : 19: predicate.addn_check_dump 1.32% : 0.000003s : 19: predicate.addn_zero_filter 2.82% : 0.000007s : 19: predicate.arithmetic_simplify 1.45% : 0.000003s : 20: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000003s : 19: predicate.compare_switch_simplify 1.22% : 0.000003s : 19: predicate.depend_value_elim 1.34% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.68% : 0.000004s : 20: predicate.dict_get_item_eliminator 1.39% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.44% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.41% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.28% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.58% : 0.000004s : 20: predicate.environ_get_depend_swap 1.56% : 0.000004s : 20: predicate.environ_get_eliminate 1.39% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.66% : 0.000002s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.75% : 0.000013s : 40: predicate.inline 0.54% : 0.000001s : 6: predicate.inline_without_move 0.21% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.64% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 2.05% : 0.000005s : 25: predicate.load_eliminater 0.94% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.73% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.36% : 0.000003s : 19: predicate.merge_addn 1.27% : 0.000003s : 19: predicate.minmaximum_grad 0.95% : 0.000002s : 3: predicate.mutable_eliminate 0.26% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000005s : 25: predicate.partial_eliminate 1.52% : 0.000004s : 19: predicate.print_const_string_wrapper 2.29% : 0.000005s : 19: predicate.reduce_eliminate 2.24% : 0.000005s : 22: predicate.redundant_stop_gradient_eliminater 0.27% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000004s : 28: predicate.replace_applicator 0.29% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.76% : 0.000004s : 20: predicate.reshape_eliminate 1.26% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000003s : 19: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.52% : 0.000001s : 6: predicate.special_op_eliminate 0.47% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.86% : 0.000004s : 19: predicate.stack_unstack_eliminate 0.22% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.41% : 0.000008s : 34: predicate.switch_defer_inline 2.54% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.27% : 0.000019s : 107: predicate.switch_simplify 1.30% : 0.000003s : 19: predicate.tile_eliminate 1.27% : 0.000003s : 19: predicate.transpose_eliminate 1.69% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.76% : 0.000004s : 20: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000009s : 28: predicate.tuple_list_get_item_eliminator 1.77% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.59% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.58% : 0.000004s : 25: predicate.updatestate_pure_node_eliminater 2.33% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.95% : 0.000005s : 19: predicate.value_based_eliminate 0.17% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004542 40 64.98% : 0.002951s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.76% : 0.000398s : 5: func_graph_cloner_run.FuncGraphClonerNode 26.27% : 0.001193s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122618 72 0.05% : 0.000057s : 1: add_recomputation 0.17% : 0.000208s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.28% : 0.000349s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.39% : 0.000480s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000013s : 1: graph_reusing 8.90% : 0.010919s : 1: jit_opt_a 0.15% : 0.000178s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.40% : 0.000490s : 1: loop_unroll 0.62% : 0.000761s : 1: mutable_eliminate 1.95% : 0.002397s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000577s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000055s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 2.03% : 0.002487s : 1: renormalize.infer 0.80% : 0.000976s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.13% : 0.000164s : 1: rewriter_before_opt_a 0.07% : 0.000090s : 1: symbol_engine_optimizer 83.14% : 0.101947s : 1: type_inference TotalTime = 0.161377, [30] [bootstrap]: 0.00048407 [type_inference]: 0.145042 [event_method]: 2.875e-05 [auto_monad]: 8.732e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 0.00080013 [rewriter_before_opt_a]: 0.00012012 [expand_dump_flag]: 4.75999e-06 [jit_opt_a]: 0.0112838, [2] [Cycle 1]: 0.00620628, [27] [switch_simplify]: 7.91e-05 [loop_unroll]: 3.694e-05 [a_1]: 0.00118412 [with_stream_mark]: 2.811e-05 [recompute_prepare]: 1.126e-05 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 9.07001e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 8.86002e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 7.39002e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.719e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.352e-05 [inline_without_move]: 7e-06 [renormalize]: 0.0044065 [add_forward_monad_depend]: 1.046e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.158e-05 [cse]: 3.968e-05 [replace_applicator]: 2.767e-05 [Cycle 2]: 0.00045595, [27] [switch_simplify]: 8.2e-06 [loop_unroll]: 7.66999e-06 [a_1]: 0.00015952 [with_stream_mark]: 1.733e-05 [recompute_prepare]: 7.46999e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 7.88999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.87e-06 [cell_reuse_recompute_pass]: 4.62998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.672e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 3.08e-06 [replace_old_param]: 1.052e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.14e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 8.13999e-06 [cse]: 1.786e-05 [replace_applicator]: 7.1e-06 [py_interpret_to_execute_after_opt_a]: 1.927e-05 [rewriter_after_opt_a]: 4.451e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.48002e-06 [mutable_eliminate]: 0.00088837 [jit_opt_b]: 7.023e-05, [1] [Cycle 1]: 5.948e-05, [2] [frontend_op_eliminate]: 2.456e-05 [inline_after_opt_a]: 2.112e-05 [cconv]: 3.445e-05 [loop_unroll]: 0.0005153 [jit_opt_after_cconv]: 0.0002006, [1] [Cycle 1]: 0.00019218, [11] [c_1]: 3.031e-05 [parameter_eliminate]: 5.40001e-06 [updatestate_depend_eliminate]: 9.86e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.73998e-06 [cse]: 3.901e-05 [call_graph_tuple_transform]: 2.844e-05 [tuple_list_get_item_eliminator]: 7.10998e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 7.33999e-06 [remove_dup_value]: 1.821e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 1.025e-05 [add_recomputation]: 7.739e-05 [cse_after_recomputation]: 2.995e-05, [1] [Cycle 1]: 2.356e-05, [1] [cse]: 1.608e-05 [auto_monad_reorder]: 1.91e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 9.09e-06 [opt_after_jit_grad]: 0.00094192 [symbol_engine_optimizer]: 0.00013847, [1] [Cycle 1]: 0.00012773, [6] [build]: 5.82001e-06 [elim_shapecalc]: 1.175e-05 [elim_not_effective]: 3.3e-05 [opt_reshape]: 1.049e-05 [fold_const_symbol]: 1.018e-05 [renormalize]: 7.09988e-07 [validate]: 0.00023108 Sums bootstrap : 0.000484s : 0.31% type_inference : 0.145042s : 93.00% event_method : 0.000029s : 0.02% auto_monad : 0.000087s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000800s : 0.51% rewriter_before_opt_a : 0.000120s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.06% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.001344s : 0.86% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004407s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000888s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000515s : 0.33% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000039s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000077s : 0.05% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000942s : 0.60% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000033s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000231s : 0.15% Time group info: ------[substitution.] 0.000681 28 0.29% : 0.000002s : 2: substitution.elim_not_effective 0.18% : 0.000001s : 2: substitution.fold_const_symbol 1.03% : 0.000007s : 4: substitution.graph_param_transform 91.52% : 0.000623s : 5: substitution.inline 0.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000016s : 3: substitution.reduce_eliminate 0.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.11% : 0.000008s : 2: substitution.replace_old_param 2.05% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.144918 2 96.38% : 0.139679s : 1: type_inference.infer 3.62% : 0.005239s : 1: type_inference.specialize ------[replace.] 0.000132 7 69.11% : 0.000091s : 5: replace.inline 30.89% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000632 7 98.05% : 0.000620s : 5: match.inline 1.95% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 886 1.62% : 0.000003s : 13: predicate.accumulaten_eliminater 2.03% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000003s : 13: predicate.addn_zero_filter 2.34% : 0.000004s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.88% : 0.000002s : 13: predicate.compare_switch_simplify 1.05% : 0.000002s : 13: predicate.depend_value_elim 0.94% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.01% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 4: predicate.dumpgradient_eliminate 7.11% : 0.000013s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.86% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.88% : 0.000002s : 13: predicate.environ_get_depend_swap 1.09% : 0.000002s : 13: predicate.environ_get_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 5.13% : 0.000010s : 28: predicate.inline 0.72% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.83% : 0.000003s : 8: predicate.less_batch_normalization 1.42% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.54% : 0.000003s : 19: predicate.load_eliminater 1.43% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.31% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.69% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 13: predicate.merge_addn 0.91% : 0.000002s : 13: predicate.minmaximum_grad 1.84% : 0.000003s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 1.83% : 0.000003s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 2.63% : 0.000005s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.64% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.08% : 0.000002s : 13: predicate.reshape_eliminate 1.13% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000002s : 8: predicate.special_op_eliminate 0.67% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.02% : 0.000004s : 20: predicate.switch_defer_inline 1.94% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.06% : 0.000011s : 64: predicate.switch_simplify 1.49% : 0.000003s : 13: predicate.tile_eliminate 1.11% : 0.000002s : 13: predicate.transpose_eliminate 1.12% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.52% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.56% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.40% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003410 25 61.38% : 0.002093s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.21% : 0.000109s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.41% : 0.001208s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.167683 72 0.05% : 0.000082s : 1: add_recomputation 0.05% : 0.000091s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.30% : 0.000506s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.73% : 0.011288s : 1: jit_opt_a 0.12% : 0.000203s : 1: jit_opt_after_cconv 0.04% : 0.000073s : 1: jit_opt_b 0.31% : 0.000524s : 1: loop_unroll 0.54% : 0.000904s : 1: mutable_eliminate 0.98% : 0.001642s : 26: opt.transform.jit_opt_a 0.04% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.22% : 0.000373s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000061s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000958s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000811s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.89% : 0.003163s : 1: renormalize.infer 0.73% : 0.001229s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000126s : 1: rewriter_before_opt_a 0.08% : 0.000142s : 1: symbol_engine_optimizer 86.52% : 0.145073s : 1: type_inference TotalTime = 0.0173279, [30] [bootstrap]: 0.00028905 [type_inference]: 0.00825817 [event_method]: 2.212e-05 [auto_monad]: 7.213e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 5.78e-05 [rewriter_before_opt_a]: 8.462e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00622484, [2] [Cycle 1]: 0.00214375, [27] [switch_simplify]: 6.612e-05 [loop_unroll]: 3.258e-05 [a_1]: 0.00061235 [with_stream_mark]: 2.337e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.49998e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 8.83001e-06 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 1.023e-05 [inline_without_move]: 5.46e-06 [renormalize]: 0.00100454 [add_forward_monad_depend]: 5.85002e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.592e-05 [cse]: 3.623e-05 [replace_applicator]: 1.277e-05 [Cycle 2]: 0.00034614, [27] [switch_simplify]: 6.14001e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.224e-05 [with_stream_mark]: 1.044e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 1.128e-05 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.298e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 7.86001e-06 [inline_without_move]: 5.00999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.43e-06 [cse]: 1.459e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 1.89e-05 [rewriter_after_opt_a]: 4.076e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00060101 [jit_opt_b]: 5.587e-05, [1] [Cycle 1]: 4.861e-05, [2] [frontend_op_eliminate]: 2.174e-05 [inline_after_opt_a]: 1.604e-05 [cconv]: 2.461e-05 [loop_unroll]: 0.00042275 [jit_opt_after_cconv]: 0.00015143, [1] [Cycle 1]: 0.00014487, [11] [c_1]: 2.137e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.70001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.65997e-06 [cse]: 2.198e-05 [call_graph_tuple_transform]: 1.828e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.667e-05 [partial_unused_args_eliminate]: 2.87002e-06 [environ_conv]: 8.52e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 2.38e-05, [1] [Cycle 1]: 1.847e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.737e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00051831 [symbol_engine_optimizer]: 8.468e-05, [1] [Cycle 1]: 7.8e-05, [6] [build]: 1.035e-05 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 1.337e-05 [opt_reshape]: 6.03998e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 4.00003e-07 [validate]: 4.557e-05 Sums bootstrap : 0.000289s : 2.24% type_inference : 0.008258s : 64.00% event_method : 0.000022s : 0.17% auto_monad : 0.000072s : 0.56% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000058s : 0.45% rewriter_before_opt_a : 0.000085s : 0.66% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.56% jit_opt_a.loop_unroll : 0.000038s : 0.29% jit_opt_a.a_1 : 0.000705s : 5.46% jit_opt_a.with_stream_mark : 0.000034s : 0.26% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000016s : 0.12% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.001005s : 7.79% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000051s : 0.39% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000019s : 0.15% rewriter_after_opt_a : 0.000041s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000601s : 4.66% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.19% loop_unroll : 0.000423s : 3.28% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.07% add_recomputation : 0.000050s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000518s : 4.02% symbol_engine_optimizer.build : 0.000010s : 0.08% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.35% Time group info: ------[substitution.] 0.000265 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000005s : 3: substitution.graph_param_transform 86.91% : 0.000230s : 4: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000005s : 2: substitution.replace_old_param 4.46% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008173 2 82.80% : 0.006767s : 1: type_inference.infer 17.20% : 0.001405s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.77% : 0.000053s : 4: replace.inline 32.23% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.52% : 0.000227s : 4: match.inline 4.48% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.51% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.26% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.08% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.85% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000920 13 49.08% : 0.000451s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.53% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.39% : 0.000408s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019319 72 0.27% : 0.000053s : 1: add_recomputation 0.39% : 0.000076s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.61% : 0.000312s : 1: bootstrap 0.14% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000011s : 1: environ_conv 0.14% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.12% : 0.000023s : 1: graph_reusing 32.24% : 0.006228s : 1: jit_opt_a 0.80% : 0.000154s : 1: jit_opt_after_cconv 0.30% : 0.000058s : 1: jit_opt_b 2.23% : 0.000430s : 1: loop_unroll 3.15% : 0.000609s : 1: mutable_eliminate 4.84% : 0.000935s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000032s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000527s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000061s : 1: py_interpret_to_execute 0.11% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.87% : 0.000555s : 1: renormalize.infer 2.28% : 0.000440s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000044s : 1: rewriter_after_opt_a 0.46% : 0.000088s : 1: rewriter_before_opt_a 0.45% : 0.000087s : 1: symbol_engine_optimizer 42.87% : 0.008282s : 1: type_inference TotalTime = 0.181453, [30] [bootstrap]: 0.00031263 [type_inference]: 0.169554 [event_method]: 1.887e-05 [auto_monad]: 7.347e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00049444 [rewriter_before_opt_a]: 8.855e-05 [expand_dump_flag]: 3.79002e-06 [jit_opt_a]: 0.00865062, [2] [Cycle 1]: 0.00358241, [27] [switch_simplify]: 6.368e-05 [loop_unroll]: 2.994e-05 [a_1]: 0.00061541 [with_stream_mark]: 2.016e-05 [recompute_prepare]: 9.20999e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.75998e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 6.13998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 9.73998e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00250441 [add_forward_monad_depend]: 5.93998e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.606e-05 [cse]: 3.205e-05 [replace_applicator]: 1.45e-05 [Cycle 2]: 0.00034778, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.0001184 [with_stream_mark]: 1.01e-05 [recompute_prepare]: 5.76003e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.09e-06 [updatestate_loads_eliminate]: 1.89e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.43002e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.359e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 8.22e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.086e-05 [replace_applicator]: 5.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.187e-05 [rewriter_after_opt_a]: 3.62e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00062297 [jit_opt_b]: 5.321e-05, [1] [Cycle 1]: 4.633e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 1.651e-05 [cconv]: 2.518e-05 [loop_unroll]: 0.00041308 [jit_opt_after_cconv]: 0.00014166, [1] [Cycle 1]: 0.0001358, [11] [c_1]: 2.448e-05 [parameter_eliminate]: 2.11e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 1.94999e-06 [cse]: 1.861e-05 [call_graph_tuple_transform]: 2.046e-05 [tuple_list_get_item_eliminator]: 5.89999e-06 [none_parameter_eliminate]: 1.78997e-06 [renormalize]: 3.99974e-07 [switch_simplify]: 5.66998e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.96999e-06 [environ_conv]: 7.96001e-06 [add_recomputation]: 5.761e-05 [cse_after_recomputation]: 2.202e-05, [1] [Cycle 1]: 1.681e-05, [1] [cse]: 1.133e-05 [auto_monad_reorder]: 1.601e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 4.49998e-06 [opt_after_jit_grad]: 0.00045714 [symbol_engine_optimizer]: 0.00012028, [1] [Cycle 1]: 0.00011395, [6] [build]: 3.68e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 5.719e-05 [opt_reshape]: 6.91001e-06 [fold_const_symbol]: 9.16998e-06 [renormalize]: 4.50003e-07 [validate]: 4.249e-05 Sums bootstrap : 0.000313s : 0.18% type_inference : 0.169554s : 96.26% event_method : 0.000019s : 0.01% auto_monad : 0.000073s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000494s : 0.28% rewriter_before_opt_a : 0.000089s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000734s : 0.42% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002505s : 1.42% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000043s : 0.02% jit_opt_a.replace_applicator : 0.000020s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000623s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000025s : 0.01% loop_unroll : 0.000413s : 0.23% jit_opt_after_cconv.c_1 : 0.000024s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000058s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000457s : 0.26% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000057s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.02% Time group info: ------[substitution.] 0.000242 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000007s : 4: substitution.graph_param_transform 85.31% : 0.000206s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000004s : 2: substitution.replace_old_param 5.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.169479 2 98.42% : 0.166803s : 1: type_inference.infer 1.58% : 0.002676s : 1: type_inference.specialize ------[replace.] 0.000078 6 70.07% : 0.000055s : 4: replace.inline 29.93% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.59% : 0.000204s : 4: match.inline 5.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.78% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.50% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.73% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.69% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.86% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.23% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002317 22 70.37% : 0.001630s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.96% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.68% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.184986 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000077s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.18% : 0.000331s : 1: bootstrap 0.01% : 0.000028s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.68% : 0.008654s : 1: jit_opt_a 0.08% : 0.000144s : 1: jit_opt_after_cconv 0.03% : 0.000056s : 1: jit_opt_b 0.23% : 0.000420s : 1: loop_unroll 0.34% : 0.000631s : 1: mutable_eliminate 0.52% : 0.000969s : 26: opt.transform.jit_opt_a 0.03% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000465s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000503s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.98% : 0.001810s : 1: renormalize.infer 0.37% : 0.000684s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.05% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000123s : 1: symbol_engine_optimizer 91.67% : 0.169570s : 1: type_inference TotalTime = 0.0349594, [30] [bootstrap]: 0.00031691 [type_inference]: 0.0238254 [event_method]: 1.83e-05 [auto_monad]: 7.081e-05 [graph_reusing]: 5.90002e-06 [pre_auto_parallel]: 2.68998e-06 [py_interpret_to_execute]: 0.00010293 [rewriter_before_opt_a]: 8.64e-05 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.00832028, [2] [Cycle 1]: 0.0046451, [27] [switch_simplify]: 6.123e-05 [loop_unroll]: 2.982e-05 [a_1]: 0.00054322 [with_stream_mark]: 2.081e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 8.34998e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00079595 [add_forward_monad_depend]: 9.20001e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 2.115e-05 [cse]: 3.712e-05 [replace_applicator]: 1.808e-05 [Cycle 2]: 0.00034339, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.46e-06 [a_1]: 9.702e-05 [with_stream_mark]: 1.315e-05 [recompute_prepare]: 5.35001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.71998e-06 [get_grad_eliminate_]: 4.97e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.4e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.441e-05 [rewriter_after_opt_a]: 4.008e-05 [convert_after_rewriter]: 7.5e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00059369 [jit_opt_b]: 5.231e-05, [1] [Cycle 1]: 4.515e-05, [2] [frontend_op_eliminate]: 1.686e-05 [inline_after_opt_a]: 1.645e-05 [cconv]: 2.633e-05 [loop_unroll]: 0.00042617 [jit_opt_after_cconv]: 0.00014867, [1] [Cycle 1]: 0.00014219, [11] [c_1]: 2.225e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.75001e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.28e-05 [call_graph_tuple_transform]: 1.98e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.697e-05 [partial_unused_args_eliminate]: 2.73003e-06 [environ_conv]: 5.73997e-06 [add_recomputation]: 4.924e-05 [cse_after_recomputation]: 2.223e-05, [1] [Cycle 1]: 1.729e-05, [1] [cse]: 1.19e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 5.09998e-06 [opt_after_jit_grad]: 0.00045047 [symbol_engine_optimizer]: 8.821e-05, [1] [Cycle 1]: 8.195e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 5.84999e-06 [fold_const_symbol]: 1.008e-05 [renormalize]: 1.8999e-07 [validate]: 3.862e-05 Sums bootstrap : 0.000317s : 1.12% type_inference : 0.023825s : 84.56% event_method : 0.000018s : 0.06% auto_monad : 0.000071s : 0.25% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000103s : 0.37% rewriter_before_opt_a : 0.000086s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.24% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000640s : 2.27% jit_opt_a.with_stream_mark : 0.000034s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000796s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.10% jit_opt_a.cse : 0.000051s : 0.18% jit_opt_a.replace_applicator : 0.000023s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000594s : 2.11% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.09% loop_unroll : 0.000426s : 1.51% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000049s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000450s : 1.60% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.14% Time group info: ------[substitution.] 0.000213 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000006s : 3: substitution.graph_param_transform 83.80% : 0.000179s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 6.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023750 2 94.01% : 0.022328s : 1: type_inference.infer 5.99% : 0.001422s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.03% : 0.000046s : 4: replace.inline 32.97% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 93.72% : 0.000176s : 4: match.inline 6.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 2.03% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.38% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 2.28% : 0.000003s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 10: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000728 13 46.06% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.21% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.73% : 0.000347s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036663 72 0.14% : 0.000053s : 1: add_recomputation 0.20% : 0.000074s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.91% : 0.000334s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000023s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 22.70% : 0.008323s : 1: jit_opt_a 0.41% : 0.000151s : 1: jit_opt_after_cconv 0.15% : 0.000055s : 1: jit_opt_b 1.18% : 0.000434s : 1: loop_unroll 1.64% : 0.000603s : 1: mutable_eliminate 2.36% : 0.000864s : 26: opt.transform.jit_opt_a 0.14% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.25% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000106s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 1.28% : 0.000468s : 1: renormalize.infer 0.87% : 0.000320s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.25% : 0.000091s : 1: rewriter_before_opt_a 0.25% : 0.000091s : 1: symbol_engine_optimizer 65.03% : 0.023842s : 1: type_inference TotalTime = 0.0161399, [30] [bootstrap]: 0.00035299 [type_inference]: 0.00657492 [event_method]: 2.293e-05 [auto_monad]: 7.108e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.87002e-06 [py_interpret_to_execute]: 9.971e-05 [rewriter_before_opt_a]: 8.964e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.0063745, [2] [Cycle 1]: 0.0021216, [27] [switch_simplify]: 6.41e-05 [loop_unroll]: 3.078e-05 [a_1]: 0.00060032 [with_stream_mark]: 2.38e-05 [recompute_prepare]: 8.82999e-06 [updatestate_depend_eliminate]: 4.22003e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 5.81998e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.569e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00102625 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 3.12002e-06 [auto_monad_eliminator]: 1.801e-05 [cse]: 3.928e-05 [replace_applicator]: 1.496e-05 [Cycle 2]: 0.00038611, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.00010883 [with_stream_mark]: 1.213e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.30001e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 5.16998e-06 [merge_forward]: 3.05002e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 8.28001e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.08002e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.26999e-06 [cse]: 1.568e-05 [replace_applicator]: 5.41002e-06 [py_interpret_to_execute_after_opt_a]: 1.97e-05 [rewriter_after_opt_a]: 4.383e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00069196 [jit_opt_b]: 6.094e-05, [1] [Cycle 1]: 4.654e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 1.688e-05 [cconv]: 3.137e-05 [loop_unroll]: 0.00047834 [jit_opt_after_cconv]: 0.00017391, [1] [Cycle 1]: 0.00016083, [11] [c_1]: 2.229e-05 [parameter_eliminate]: 4.05e-06 [updatestate_depend_eliminate]: 8.27e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 3.582e-05 [call_graph_tuple_transform]: 2.079e-05 [tuple_list_get_item_eliminator]: 5.64998e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.43002e-06 [remove_dup_value]: 1.784e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 1.185e-05 [add_recomputation]: 5.367e-05 [cse_after_recomputation]: 2.519e-05, [1] [Cycle 1]: 1.914e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 7.3e-06 [opt_after_jit_grad]: 0.00053022 [symbol_engine_optimizer]: 8.893e-05, [1] [Cycle 1]: 8.162e-05, [6] [build]: 1.358e-05 [elim_shapecalc]: 8.08001e-06 [elim_not_effective]: 1.579e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 6.80011e-07 [validate]: 5.318e-05 Sums bootstrap : 0.000353s : 3.05% type_inference : 0.006575s : 56.78% event_method : 0.000023s : 0.20% auto_monad : 0.000071s : 0.61% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000100s : 0.86% rewriter_before_opt_a : 0.000090s : 0.77% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.61% jit_opt_a.loop_unroll : 0.000037s : 0.32% jit_opt_a.a_1 : 0.000709s : 6.12% jit_opt_a.with_stream_mark : 0.000036s : 0.31% jit_opt_a.recompute_prepare : 0.000015s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001026s : 8.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.22% jit_opt_a.cse : 0.000055s : 0.47% jit_opt_a.replace_applicator : 0.000020s : 0.18% py_interpret_to_execute_after_opt_a : 0.000020s : 0.17% rewriter_after_opt_a : 0.000044s : 0.38% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000692s : 5.98% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.16% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000031s : 0.27% loop_unroll : 0.000478s : 4.13% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000012s : 0.10% add_recomputation : 0.000054s : 0.46% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000530s : 4.58% symbol_engine_optimizer.build : 0.000014s : 0.12% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000053s : 0.46% Time group info: ------[substitution.] 0.000260 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 85.66% : 0.000223s : 4: substitution.inline 1.35% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 2.45% : 0.000006s : 2: substitution.replace_old_param 5.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006486 2 78.35% : 0.005082s : 1: type_inference.infer 21.65% : 0.001404s : 1: type_inference.specialize ------[replace.] 0.000078 6 69.23% : 0.000054s : 4: replace.inline 30.77% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.85% : 0.000220s : 4: match.inline 5.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.97% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000003s : 10: predicate.arithmetic_simplify 1.23% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000002s : 10: predicate.depend_value_elim 1.26% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.81% : 0.000001s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 6.29% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 1.89% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.21% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000926 13 46.05% : 0.000426s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.98% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.97% : 0.000444s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018161 72 0.31% : 0.000057s : 1: add_recomputation 0.42% : 0.000076s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 2.08% : 0.000378s : 1: bootstrap 0.19% : 0.000034s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.08% : 0.000014s : 1: environ_conv 0.15% : 0.000028s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 35.12% : 0.006378s : 1: jit_opt_a 0.97% : 0.000177s : 1: jit_opt_after_cconv 0.35% : 0.000064s : 1: jit_opt_b 2.68% : 0.000487s : 1: loop_unroll 3.89% : 0.000706s : 1: mutable_eliminate 5.20% : 0.000945s : 26: opt.transform.jit_opt_a 0.28% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000028s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000019s : 1: opt.transform.mutable_eliminate 0.16% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.98% : 0.000542s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.58% : 0.000105s : 1: py_interpret_to_execute 0.12% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000021s : 1: remove_dup_value 3.07% : 0.000558s : 1: renormalize.infer 2.53% : 0.000460s : 1: renormalize.specialize 0.05% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000047s : 1: rewriter_after_opt_a 0.52% : 0.000094s : 1: rewriter_before_opt_a 0.51% : 0.000092s : 1: symbol_engine_optimizer 36.33% : 0.006597s : 1: type_inference TotalTime = 0.0294985, [30] [bootstrap]: 0.00026944 [type_inference]: 0.00815794 [event_method]: 1.863e-05 [auto_monad]: 6.714e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.21998e-06 [py_interpret_to_execute]: 4.184e-05 [rewriter_before_opt_a]: 7.981e-05 [expand_dump_flag]: 3.59002e-06 [jit_opt_a]: 0.0183515, [2] [Cycle 1]: 0.0148121, [27] [switch_simplify]: 5.576e-05 [loop_unroll]: 3.347e-05 [a_1]: 0.00062569 [with_stream_mark]: 2.058e-05 [recompute_prepare]: 7.69002e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 0.0136379 [add_forward_monad_depend]: 1.652e-05 [auto_monad_grad]: 3.30998e-06 [auto_monad_eliminator]: 3.229e-05 [cse]: 5.14e-05 [replace_applicator]: 3.111e-05 [Cycle 2]: 0.00039355, [27] [switch_simplify]: 7.55e-06 [loop_unroll]: 5.86e-06 [a_1]: 0.00011016 [with_stream_mark]: 1.89e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 2.94999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.424e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.074e-05 [inline_without_move]: 5.51e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.52001e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.493e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 2.11e-05 [rewriter_after_opt_a]: 4.937e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 5.01997e-06 [mutable_eliminate]: 0.00080435 [jit_opt_b]: 5.461e-05, [1] [Cycle 1]: 4.583e-05, [2] [frontend_op_eliminate]: 1.695e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 3.466e-05 [loop_unroll]: 0.00043257 [jit_opt_after_cconv]: 0.00015738, [1] [Cycle 1]: 0.0001496, [11] [c_1]: 2.253e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 6.85998e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.474e-05 [call_graph_tuple_transform]: 2.144e-05 [tuple_list_get_item_eliminator]: 6.11998e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 4.433e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 6.32001e-06 [add_recomputation]: 5.474e-05 [cse_after_recomputation]: 2.494e-05, [1] [Cycle 1]: 1.974e-05, [1] [cse]: 1.344e-05 [auto_monad_reorder]: 1.881e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.77001e-06 [opt_after_jit_grad]: 0.00048684 [symbol_engine_optimizer]: 7.877e-05, [1] [Cycle 1]: 7.223e-05, [6] [build]: 4.36002e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.422e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 5.60016e-07 [validate]: 4.567e-05 Sums bootstrap : 0.000269s : 1.05% type_inference : 0.008158s : 31.70% event_method : 0.000019s : 0.07% auto_monad : 0.000067s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000042s : 0.16% rewriter_before_opt_a : 0.000080s : 0.31% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.25% jit_opt_a.loop_unroll : 0.000039s : 0.15% jit_opt_a.a_1 : 0.000736s : 2.86% jit_opt_a.with_stream_mark : 0.000039s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000020s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.013638s : 52.99% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.15% jit_opt_a.cse : 0.000066s : 0.26% jit_opt_a.replace_applicator : 0.000037s : 0.14% py_interpret_to_execute_after_opt_a : 0.000021s : 0.08% rewriter_after_opt_a : 0.000049s : 0.19% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000804s : 3.13% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000035s : 0.13% loop_unroll : 0.000433s : 1.68% jit_opt_after_cconv.c_1 : 0.000023s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000044s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000055s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000487s : 1.89% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.18% Time group info: ------[substitution.] 0.000250 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 84.61% : 0.000212s : 5: substitution.inline 1.96% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.76% : 0.000007s : 2: substitution.replace_old_param 4.60% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008103 2 88.11% : 0.007140s : 1: type_inference.infer 11.89% : 0.000963s : 1: type_inference.specialize ------[replace.] 0.000090 7 67.36% : 0.000061s : 5: replace.inline 32.64% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 7 95.29% : 0.000209s : 5: match.inline 4.71% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 747 1.38% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 11: predicate.addn_check_dump 1.64% : 0.000002s : 11: predicate.addn_zero_filter 1.92% : 0.000003s : 11: predicate.arithmetic_simplify 1.39% : 0.000002s : 11: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.42% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000008s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.56% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.64% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 16: predicate.partial_eliminate 1.42% : 0.000002s : 11: predicate.print_const_string_wrapper 1.66% : 0.000002s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 2.23% : 0.000003s : 19: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.45% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.64% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000756 16 49.73% : 0.000376s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.46% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.81% : 0.000309s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.044179 72 0.13% : 0.000058s : 1: add_recomputation 0.16% : 0.000070s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.64% : 0.000281s : 1: bootstrap 0.09% : 0.000038s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 41.55% : 0.018356s : 1: jit_opt_a 0.36% : 0.000160s : 1: jit_opt_after_cconv 0.13% : 0.000058s : 1: jit_opt_b 1.00% : 0.000441s : 1: loop_unroll 1.84% : 0.000814s : 1: mutable_eliminate 2.24% : 0.000990s : 26: opt.transform.jit_opt_a 0.12% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.12% : 0.000495s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000045s : 1: py_interpret_to_execute 0.05% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000047s : 1: remove_dup_value 1.01% : 0.000445s : 1: renormalize.infer 29.83% : 0.013178s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000052s : 1: rewriter_after_opt_a 0.19% : 0.000083s : 1: rewriter_before_opt_a 0.18% : 0.000081s : 1: symbol_engine_optimizer 18.49% : 0.008168s : 1: type_inference TotalTime = 0.0147908, [30] [bootstrap]: 0.00031308 [type_inference]: 0.00609833 [event_method]: 1.91e-05 [auto_monad]: 6.681e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 5.528e-05 [rewriter_before_opt_a]: 8.367e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00587852, [2] [Cycle 1]: 0.00200371, [27] [switch_simplify]: 6.365e-05 [loop_unroll]: 3.142e-05 [a_1]: 0.00058126 [with_stream_mark]: 2.295e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 5.61003e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.40997e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00096027 [add_forward_monad_depend]: 6.21e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.573e-05 [cse]: 3.566e-05 [replace_applicator]: 1.321e-05 [Cycle 2]: 0.00033518, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.52001e-06 [a_1]: 9.764e-05 [with_stream_mark]: 9.82999e-06 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.05998e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.36e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.91001e-06 [inline_without_move]: 5.09998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.56002e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.371e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.339e-05 [rewriter_after_opt_a]: 5.777e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00060842 [jit_opt_b]: 4.969e-05, [1] [Cycle 1]: 4.307e-05, [2] [frontend_op_eliminate]: 1.592e-05 [inline_after_opt_a]: 1.656e-05 [cconv]: 2.659e-05 [loop_unroll]: 0.00043922 [jit_opt_after_cconv]: 0.00014393, [1] [Cycle 1]: 0.00013792, [11] [c_1]: 2.069e-05 [parameter_eliminate]: 2.43002e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.294e-05 [call_graph_tuple_transform]: 1.869e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.58e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 9.21002e-06 [add_recomputation]: 5.04e-05 [cse_after_recomputation]: 2.37e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.242e-05 [auto_monad_reorder]: 1.923e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.22e-06 [opt_after_jit_grad]: 0.00046771 [symbol_engine_optimizer]: 8.167e-05, [1] [Cycle 1]: 7.536e-05, [6] [build]: 1.071e-05 [elim_shapecalc]: 8.29998e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 3.29979e-07 [validate]: 4.748e-05 Sums bootstrap : 0.000313s : 2.94% type_inference : 0.006098s : 57.23% event_method : 0.000019s : 0.18% auto_monad : 0.000067s : 0.63% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000055s : 0.52% rewriter_before_opt_a : 0.000084s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.65% jit_opt_a.loop_unroll : 0.000037s : 0.35% jit_opt_a.a_1 : 0.000679s : 6.37% jit_opt_a.with_stream_mark : 0.000033s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000960s : 9.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.21% jit_opt_a.cse : 0.000049s : 0.46% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000058s : 0.54% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000608s : 5.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000027s : 0.25% loop_unroll : 0.000439s : 4.12% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.09% add_recomputation : 0.000050s : 0.47% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000019s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000468s : 4.39% symbol_engine_optimizer.build : 0.000011s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.45% Time group info: ------[substitution.] 0.000242 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000005s : 3: substitution.graph_param_transform 85.92% : 0.000208s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 5.10% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006027 2 78.88% : 0.004754s : 1: type_inference.infer 21.12% : 0.001273s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.93% : 0.000051s : 4: replace.inline 33.07% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.84% : 0.000206s : 4: match.inline 5.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.87% : 0.000001s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.96% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.04% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.81% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.92% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000814 13 47.32% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.18% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.50% : 0.000378s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016701 72 0.32% : 0.000053s : 1: add_recomputation 0.42% : 0.000070s : 1: auto_monad 0.13% : 0.000022s : 1: auto_monad_reorder 2.01% : 0.000335s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.07% : 0.000011s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 35.22% : 0.005882s : 1: jit_opt_a 0.88% : 0.000146s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.68% : 0.000447s : 1: loop_unroll 3.70% : 0.000618s : 1: mutable_eliminate 5.43% : 0.000907s : 26: opt.transform.jit_opt_a 0.28% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.85% : 0.000476s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000059s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 3.11% : 0.000519s : 1: renormalize.infer 2.59% : 0.000433s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.37% : 0.000061s : 1: rewriter_after_opt_a 0.52% : 0.000087s : 1: rewriter_before_opt_a 0.50% : 0.000084s : 1: symbol_engine_optimizer 36.62% : 0.006116s : 1: type_inference TotalTime = 0.15771, [30] [bootstrap]: 0.00038238 [type_inference]: 0.142843 [event_method]: 2.799e-05 [auto_monad]: 8.763e-05 [graph_reusing]: 7.26001e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.0008011 [rewriter_before_opt_a]: 0.00013316 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.0104647, [2] [Cycle 1]: 0.00555462, [27] [switch_simplify]: 7.465e-05 [loop_unroll]: 3.628e-05 [a_1]: 0.00084698 [with_stream_mark]: 2.539e-05 [recompute_prepare]: 1.014e-05 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.58e-06 [specialize_transform]: 8.15999e-06 [updatestate_useless_node_eliminater]: 7.07002e-06 [accelerated_algorithm]: 7.44002e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 7.46001e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.732e-05 [j_node_and_user_rematch]: 1.183e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.191e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.0041242 [add_forward_monad_depend]: 1.112e-05 [auto_monad_grad]: 2.84999e-06 [auto_monad_eliminator]: 2.38e-05 [cse]: 4.192e-05 [replace_applicator]: 2.518e-05 [Cycle 2]: 0.00045759, [27] [switch_simplify]: 7.95e-06 [loop_unroll]: 7.17997e-06 [a_1]: 0.00015463 [with_stream_mark]: 1.906e-05 [recompute_prepare]: 7.82e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 7.45e-06 [meta_shard_fg_expand]: 2.86e-06 [get_grad_eliminate_]: 7.18998e-06 [merge_forward]: 5.34e-06 [cell_reuse_recompute_pass]: 4.63999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.89001e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.42001e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 7.41999e-06 [cse]: 1.661e-05 [replace_applicator]: 7.18e-06 [py_interpret_to_execute_after_opt_a]: 2.078e-05 [rewriter_after_opt_a]: 4.307e-05 [convert_after_rewriter]: 7.00998e-06 [order_py_execute_after_rewriter]: 5.56002e-06 [mutable_eliminate]: 0.00087958 [jit_opt_b]: 6.159e-05, [1] [Cycle 1]: 5.361e-05, [2] [frontend_op_eliminate]: 2.223e-05 [inline_after_opt_a]: 2.001e-05 [cconv]: 3.24e-05 [loop_unroll]: 0.00053482 [jit_opt_after_cconv]: 0.00018372, [1] [Cycle 1]: 0.00017726, [11] [c_1]: 2.843e-05 [parameter_eliminate]: 4.38001e-06 [updatestate_depend_eliminate]: 9.28002e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 3.637e-05 [call_graph_tuple_transform]: 2.559e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 7.30998e-06 [remove_dup_value]: 1.611e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 1.051e-05 [add_recomputation]: 5.761e-05 [cse_after_recomputation]: 2.463e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.756e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 9.81e-06 [opt_after_jit_grad]: 0.00052717 [symbol_engine_optimizer]: 0.00021241, [1] [Cycle 1]: 0.00020405, [6] [build]: 4.82e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.403e-05 [opt_reshape]: 8.06001e-06 [fold_const_symbol]: 0.0001335 [renormalize]: 3.99974e-07 [validate]: 6.125e-05 Sums bootstrap : 0.000382s : 0.25% type_inference : 0.142843s : 93.65% event_method : 0.000028s : 0.02% auto_monad : 0.000088s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000801s : 0.53% rewriter_before_opt_a : 0.000133s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001002s : 0.66% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004124s : 2.70% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000059s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000880s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000535s : 0.35% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000058s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000527s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000133s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.04% Time group info: ------[substitution.] 0.000352 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 1.73% : 0.000006s : 4: substitution.graph_param_transform 83.91% : 0.000296s : 5: substitution.inline 1.50% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.26% : 0.000015s : 3: substitution.reduce_eliminate 1.78% : 0.000006s : 4: substitution.remove_not_recompute_node 1.90% : 0.000007s : 2: substitution.replace_old_param 3.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.142716 2 96.89% : 0.138273s : 1: type_inference.infer 3.11% : 0.004443s : 1: type_inference.specialize ------[replace.] 0.000129 7 70.37% : 0.000091s : 5: replace.inline 29.63% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000305 7 96.02% : 0.000292s : 5: match.inline 3.98% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000003s : 13: predicate.addn_zero_filter 2.33% : 0.000004s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.04% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.82% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.75% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.54% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.75% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000004s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.41% : 0.000004s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.08% : 0.000011s : 64: predicate.switch_simplify 1.49% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.95% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.81% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003171 25 63.63% : 0.002018s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.97% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.40% : 0.001059s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.163305 72 0.04% : 0.000061s : 1: add_recomputation 0.06% : 0.000092s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000405s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.41% : 0.010470s : 1: jit_opt_a 0.11% : 0.000186s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.33% : 0.000544s : 1: loop_unroll 0.54% : 0.000890s : 1: mutable_eliminate 0.79% : 0.001290s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000162s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000536s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000814s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.83% : 0.002986s : 1: renormalize.infer 0.69% : 0.001123s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.09% : 0.000143s : 1: rewriter_before_opt_a 0.13% : 0.000216s : 1: symbol_engine_optimizer 87.49% : 0.142878s : 1: type_inference TotalTime = 0.0857434, [30] [bootstrap]: 0.00032067 [type_inference]: 0.0747966 [event_method]: 2.024e-05 [auto_monad]: 7.198e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00025599 [rewriter_before_opt_a]: 8.56e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00769513, [2] [Cycle 1]: 0.00338463, [27] [switch_simplify]: 6.168e-05 [loop_unroll]: 3.288e-05 [a_1]: 0.00062553 [with_stream_mark]: 2.447e-05 [recompute_prepare]: 8.64998e-06 [updatestate_depend_eliminate]: 5.02999e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.48998e-06 [specialize_transform]: 7.50998e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.93002e-06 [merge_forward]: 4.51002e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.118e-05 [inline_without_move]: 5.81998e-06 [renormalize]: 0.00224884 [add_forward_monad_depend]: 8.75001e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 2.027e-05 [cse]: 3.52e-05 [replace_applicator]: 1.924e-05 [Cycle 2]: 0.00058234, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.00011657 [with_stream_mark]: 0.00017789 [recompute_prepare]: 1.297e-05 [updatestate_depend_eliminate]: 4.64998e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.80002e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 2.53003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.762e-05 [j_node_and_user_rematch]: 8.84003e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.29e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.98002e-06 [auto_monad_grad]: 1.69e-06 [auto_monad_eliminator]: 1.132e-05 [cse]: 2.031e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.376e-05 [rewriter_after_opt_a]: 3.98e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 4.68001e-06 [mutable_eliminate]: 0.00072635 [jit_opt_b]: 5.561e-05, [1] [Cycle 1]: 4.719e-05, [2] [frontend_op_eliminate]: 1.733e-05 [inline_after_opt_a]: 1.881e-05 [cconv]: 3.028e-05 [loop_unroll]: 0.00048177 [jit_opt_after_cconv]: 0.00016271, [1] [Cycle 1]: 0.00015544, [11] [c_1]: 2.506e-05 [parameter_eliminate]: 3.41999e-06 [updatestate_depend_eliminate]: 7.31999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.68998e-06 [cse]: 2.607e-05 [call_graph_tuple_transform]: 2.181e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.02999e-06 [remove_dup_value]: 1.529e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 8.90001e-06 [add_recomputation]: 5.382e-05 [cse_after_recomputation]: 2.259e-05, [1] [Cycle 1]: 1.764e-05, [1] [cse]: 1.16e-05 [auto_monad_reorder]: 1.675e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 5.77001e-06 [opt_after_jit_grad]: 0.00049649 [symbol_engine_optimizer]: 7.572e-05, [1] [Cycle 1]: 6.919e-05, [6] [build]: 4.91002e-06 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 1.38e-05 [opt_reshape]: 5.95002e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 3.19997e-07 [validate]: 6.618e-05 Sums bootstrap : 0.000321s : 0.39% type_inference : 0.074797s : 91.94% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000256s : 0.31% rewriter_before_opt_a : 0.000086s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.08% jit_opt_a.loop_unroll : 0.000039s : 0.05% jit_opt_a.a_1 : 0.000742s : 0.91% jit_opt_a.with_stream_mark : 0.000202s : 0.25% jit_opt_a.recompute_prepare : 0.000022s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002249s : 2.76% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.04% jit_opt_a.cse : 0.000056s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000726s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.04% loop_unroll : 0.000482s : 0.59% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000496s : 0.61% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000066s : 0.08% Time group info: ------[substitution.] 0.000249 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 84.40% : 0.000210s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 2.50% : 0.000006s : 2: substitution.replace_old_param 5.63% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.074713 2 97.39% : 0.072762s : 1: type_inference.infer 2.61% : 0.001951s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.74% : 0.000050s : 4: replace.inline 32.26% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.11% : 0.000207s : 4: match.inline 5.89% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.07% : 0.000001s : 12: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.39% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.10% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 6.41% : 0.000009s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.43% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 2.52% : 0.000004s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.07% : 0.000001s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.67% : 0.000011s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002628 30 75.98% : 0.001997s : 23: func_graph_cloner_run.FuncGraphClonerGraph 2.00% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 22.02% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.089031 72 0.07% : 0.000058s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.38% : 0.000339s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.65% : 0.007698s : 1: jit_opt_a 0.19% : 0.000166s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.55% : 0.000493s : 1: loop_unroll 0.83% : 0.000739s : 1: mutable_eliminate 1.12% : 0.000997s : 26: opt.transform.jit_opt_a 0.06% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000506s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000261s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.79% : 0.001597s : 1: renormalize.infer 0.72% : 0.000641s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.10% : 0.000090s : 1: rewriter_before_opt_a 0.09% : 0.000078s : 1: symbol_engine_optimizer 84.03% : 0.074814s : 1: type_inference TotalTime = 0.0177518, [30] [bootstrap]: 0.00039979 [type_inference]: 0.00697172 [event_method]: 2.087e-05 [auto_monad]: 7.352e-05 [graph_reusing]: 6.53003e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 6.759e-05 [rewriter_before_opt_a]: 8.521e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00769339, [2] [Cycle 1]: 0.00228891, [27] [switch_simplify]: 6.847e-05 [loop_unroll]: 3.109e-05 [a_1]: 0.00064065 [with_stream_mark]: 2.456e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.48998e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 5.81998e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.13002e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 8.37e-06 [renormalize]: 0.00114753 [add_forward_monad_depend]: 7.3e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.738e-05 [cse]: 3.969e-05 [replace_applicator]: 1.474e-05 [Cycle 2]: 0.00033618, [27] [switch_simplify]: 6.19999e-06 [loop_unroll]: 5.60001e-06 [a_1]: 9.265e-05 [with_stream_mark]: 1.129e-05 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.38999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.455e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.41998e-06 [cse]: 1.382e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.395e-05 [rewriter_after_opt_a]: 4.086e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00068478 [jit_opt_b]: 5.383e-05, [1] [Cycle 1]: 4.648e-05, [2] [frontend_op_eliminate]: 1.646e-05 [inline_after_opt_a]: 1.752e-05 [cconv]: 2.695e-05 [loop_unroll]: 0.00045051 [jit_opt_after_cconv]: 0.00016273, [1] [Cycle 1]: 0.00015672, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 3.61001e-06 [updatestate_depend_eliminate]: 7.06999e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 3.143e-05 [call_graph_tuple_transform]: 2.258e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 1.869e-05 [partial_unused_args_eliminate]: 2.76999e-06 [environ_conv]: 1.026e-05 [add_recomputation]: 6.332e-05 [cse_after_recomputation]: 2.71e-05, [1] [Cycle 1]: 2.096e-05, [1] [cse]: 1.377e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.17999e-06 [opt_after_jit_grad]: 0.00048846 [symbol_engine_optimizer]: 8.72e-05, [1] [Cycle 1]: 8.051e-05, [6] [build]: 1.243e-05 [elim_shapecalc]: 8.50999e-06 [elim_not_effective]: 1.42e-05 [opt_reshape]: 6.58e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 4.89992e-07 [validate]: 5.137e-05 Sums bootstrap : 0.000400s : 3.32% type_inference : 0.006972s : 57.90% event_method : 0.000021s : 0.17% auto_monad : 0.000074s : 0.61% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000068s : 0.56% rewriter_before_opt_a : 0.000085s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000075s : 0.62% jit_opt_a.loop_unroll : 0.000037s : 0.30% jit_opt_a.a_1 : 0.000733s : 6.09% jit_opt_a.with_stream_mark : 0.000036s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000014s : 0.11% jit_opt_a.renormalize : 0.001148s : 9.53% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.20% jit_opt_a.cse : 0.000054s : 0.44% jit_opt_a.replace_applicator : 0.000020s : 0.17% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000041s : 0.34% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000685s : 5.69% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000018s : 0.15% cconv : 0.000027s : 0.22% loop_unroll : 0.000451s : 3.74% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000019s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000010s : 0.09% add_recomputation : 0.000063s : 0.53% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000488s : 4.06% symbol_engine_optimizer.build : 0.000012s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.43% Time group info: ------[substitution.] 0.000282 23 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000007s : 3: substitution.graph_param_transform 86.58% : 0.000244s : 4: substitution.inline 1.30% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000006s : 2: substitution.replace_old_param 4.54% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006888 2 79.71% : 0.005490s : 1: type_inference.infer 20.29% : 0.001397s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.28% : 0.000060s : 4: replace.inline 30.72% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 95.40% : 0.000241s : 4: match.inline 4.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.79% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 2.02% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.45% : 0.000002s : 3: predicate.mutable_eliminate 0.83% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000003s : 10: predicate.reduce_eliminate 1.32% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.52% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.10% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001014 13 50.65% : 0.000513s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.03% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.32% : 0.000439s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019911 72 0.34% : 0.000067s : 1: add_recomputation 0.39% : 0.000077s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 2.14% : 0.000426s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000029s : 1: cse_after_recomputation 0.06% : 0.000013s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 38.66% : 0.007697s : 1: jit_opt_a 0.83% : 0.000166s : 1: jit_opt_after_cconv 0.28% : 0.000056s : 1: jit_opt_b 2.32% : 0.000462s : 1: loop_unroll 3.49% : 0.000694s : 1: mutable_eliminate 4.88% : 0.000973s : 26: opt.transform.jit_opt_a 0.26% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.50% : 0.000497s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000072s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000021s : 1: remove_dup_value 3.23% : 0.000643s : 1: renormalize.infer 2.49% : 0.000495s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000044s : 1: rewriter_after_opt_a 0.45% : 0.000089s : 1: rewriter_before_opt_a 0.45% : 0.000090s : 1: symbol_engine_optimizer 35.12% : 0.006992s : 1: type_inference TotalTime = 0.0281847, [30] [bootstrap]: 0.00029479 [type_inference]: 0.0193002 [event_method]: 2.027e-05 [auto_monad]: 6.684e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.0001059 [rewriter_before_opt_a]: 8.156e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.00620863, [2] [Cycle 1]: 0.00248832, [27] [switch_simplify]: 5.839e-05 [loop_unroll]: 3.067e-05 [a_1]: 0.00056552 [with_stream_mark]: 2.119e-05 [recompute_prepare]: 7.53999e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.31e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.71999e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.65001e-06 [renormalize]: 0.00145252 [add_forward_monad_depend]: 6.77002e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.858e-05 [cse]: 3.5e-05 [replace_applicator]: 1.632e-05 [Cycle 2]: 0.00033366, [27] [switch_simplify]: 6.36998e-06 [loop_unroll]: 5.44e-06 [a_1]: 9.418e-05 [with_stream_mark]: 1.055e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.01002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 2.10002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.492e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 1.242e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 1.339e-05 [rewriter_after_opt_a]: 3.828e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00051357 [jit_opt_b]: 5.007e-05, [1] [Cycle 1]: 4.354e-05, [2] [frontend_op_eliminate]: 1.596e-05 [inline_after_opt_a]: 1.622e-05 [cconv]: 2.56e-05 [loop_unroll]: 0.00040562 [jit_opt_after_cconv]: 0.00014297, [1] [Cycle 1]: 0.0001365, [11] [c_1]: 2.153e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.23002e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.216e-05 [call_graph_tuple_transform]: 1.788e-05 [tuple_list_get_item_eliminator]: 5.99e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 3.70026e-07 [switch_simplify]: 5.87999e-06 [remove_dup_value]: 1.606e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 5.21002e-06 [add_recomputation]: 5.115e-05 [cse_after_recomputation]: 2.467e-05, [1] [Cycle 1]: 1.888e-05, [1] [cse]: 1.298e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.63002e-06 [opt_after_jit_grad]: 0.00046778 [symbol_engine_optimizer]: 7.444e-05, [1] [Cycle 1]: 6.835e-05, [6] [build]: 4.12e-06 [elim_shapecalc]: 7.8e-06 [elim_not_effective]: 1.326e-05 [opt_reshape]: 6.28e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 3.80009e-07 [validate]: 4.264e-05 Sums bootstrap : 0.000295s : 1.22% type_inference : 0.019300s : 79.74% event_method : 0.000020s : 0.08% auto_monad : 0.000067s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000106s : 0.44% rewriter_before_opt_a : 0.000082s : 0.34% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.27% jit_opt_a.loop_unroll : 0.000036s : 0.15% jit_opt_a.a_1 : 0.000660s : 2.73% jit_opt_a.with_stream_mark : 0.000032s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001453s : 6.00% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.10% jit_opt_a.cse : 0.000047s : 0.20% jit_opt_a.replace_applicator : 0.000022s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000514s : 2.12% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000026s : 0.11% loop_unroll : 0.000406s : 1.68% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000051s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000468s : 1.93% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.18% Time group info: ------[substitution.] 0.000225 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000005s : 3: substitution.graph_param_transform 84.87% : 0.000191s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000005s : 2: substitution.replace_old_param 5.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019227 2 93.36% : 0.017950s : 1: type_inference.infer 6.64% : 0.001277s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.87% : 0.000049s : 4: replace.inline 33.13% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.07% : 0.000188s : 4: match.inline 5.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.54% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 2.08% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.90% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.04% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000733 13 45.09% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.59% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.32% : 0.000354s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030565 72 0.18% : 0.000054s : 1: add_recomputation 0.23% : 0.000070s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.01% : 0.000309s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 20.32% : 0.006212s : 1: jit_opt_a 0.48% : 0.000146s : 1: jit_opt_after_cconv 0.17% : 0.000053s : 1: jit_opt_b 1.35% : 0.000413s : 1: loop_unroll 1.71% : 0.000521s : 1: mutable_eliminate 2.91% : 0.000888s : 26: opt.transform.jit_opt_a 0.16% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.56% : 0.000477s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000110s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.84% : 0.000562s : 1: renormalize.infer 2.88% : 0.000879s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.28% : 0.000085s : 1: rewriter_before_opt_a 0.25% : 0.000077s : 1: symbol_engine_optimizer 63.20% : 0.019318s : 1: type_inference TotalTime = 0.144095, [30] [bootstrap]: 0.0002775 [type_inference]: 0.132719 [event_method]: 2.562e-05 [auto_monad]: 7.451e-05 [graph_reusing]: 5.52001e-06 [pre_auto_parallel]: 2.16998e-06 [py_interpret_to_execute]: 0.00047181 [rewriter_before_opt_a]: 9.538e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.0078965, [2] [Cycle 1]: 0.00400129, [27] [switch_simplify]: 5.732e-05 [loop_unroll]: 3.36e-05 [a_1]: 0.0006787 [with_stream_mark]: 1.573e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.366e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 9.28002e-06 [inline_without_move]: 6.68e-06 [renormalize]: 0.00286958 [add_forward_monad_depend]: 6.20002e-06 [auto_monad_grad]: 1.86e-06 [auto_monad_eliminator]: 1.553e-05 [cse]: 2.769e-05 [replace_applicator]: 1.923e-05 [Cycle 2]: 0.00038241, [27] [switch_simplify]: 7.55e-06 [loop_unroll]: 6.55997e-06 [a_1]: 0.00012645 [with_stream_mark]: 1.146e-05 [recompute_prepare]: 6.44999e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.46998e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 2.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.373e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.303e-05 [rewriter_after_opt_a]: 3.68e-05 [convert_after_rewriter]: 6.21e-06 [order_py_execute_after_rewriter]: 7.43e-06 [mutable_eliminate]: 0.00064286 [jit_opt_b]: 5.726e-05, [1] [Cycle 1]: 5.066e-05, [2] [frontend_op_eliminate]: 2.003e-05 [inline_after_opt_a]: 1.988e-05 [cconv]: 2.344e-05 [loop_unroll]: 0.00043649 [jit_opt_after_cconv]: 0.00015704, [1] [Cycle 1]: 0.00015074, [11] [c_1]: 2.635e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 6.02001e-06 [updatestate_assign_eliminate]: 2.78003e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.345e-05 [call_graph_tuple_transform]: 2.193e-05 [tuple_list_get_item_eliminator]: 6.08002e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.60002e-06 [remove_dup_value]: 1.814e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 4.644e-05 [cse_after_recomputation]: 2.714e-05, [1] [Cycle 1]: 1.96e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.533e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00055899 [symbol_engine_optimizer]: 0.00021094, [1] [Cycle 1]: 0.00020406, [6] [build]: 4.03001e-06 [elim_shapecalc]: 8.92e-06 [elim_not_effective]: 1.503e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 0.0001374 [renormalize]: 4.39992e-07 [validate]: 5.089e-05 Sums bootstrap : 0.000277s : 0.20% type_inference : 0.132719s : 94.82% event_method : 0.000026s : 0.02% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000472s : 0.34% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000805s : 0.58% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002870s : 2.05% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000643s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000436s : 0.31% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000559s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000137s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000242 25 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.12% : 0.000005s : 4: substitution.graph_param_transform 86.96% : 0.000210s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.37% : 0.000003s : 2: substitution.replace_old_param 4.21% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132635 2 97.92% : 0.129874s : 1: type_inference.infer 2.08% : 0.002761s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.05% : 0.000070s : 5: replace.inline 31.95% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 95.84% : 0.000207s : 5: match.inline 4.16% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.48% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.77% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.35% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.36% : 0.000002s : 13: predicate.print_const_string_wrapper 1.63% : 0.000002s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000003s : 23: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.20% : 0.000010s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.51% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.80% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002407 25 65.02% : 0.001565s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.75% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.23% : 0.000776s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148210 72 0.03% : 0.000050s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.20% : 0.000296s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.33% : 0.007901s : 1: jit_opt_a 0.11% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.30% : 0.000445s : 1: loop_unroll 0.44% : 0.000651s : 1: mutable_eliminate 0.71% : 0.001056s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000165s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000569s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000479s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.37% : 0.002031s : 1: renormalize.infer 0.56% : 0.000828s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.14% : 0.000214s : 1: symbol_engine_optimizer 89.56% : 0.132737s : 1: type_inference TotalTime = 0.0143748, [30] [bootstrap]: 0.00031171 [type_inference]: 0.00590263 [event_method]: 1.896e-05 [auto_monad]: 6.566e-05 [graph_reusing]: 5.70001e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 5.856e-05 [rewriter_before_opt_a]: 8.204e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.0056751, [2] [Cycle 1]: 0.00196579, [27] [switch_simplify]: 5.58e-05 [loop_unroll]: 3.126e-05 [a_1]: 0.00055639 [with_stream_mark]: 1.829e-05 [recompute_prepare]: 8.07e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 8.86997e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.185e-05 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00096336 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.551e-05 [cse]: 3.605e-05 [replace_applicator]: 1.264e-05 [Cycle 2]: 0.00034401, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.33002e-06 [a_1]: 9.242e-05 [with_stream_mark]: 1.012e-05 [recompute_prepare]: 5.87001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.23002e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.42999e-06 [updatestate_useless_node_eliminater]: 5.24998e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 1.86998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 7.85e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.99002e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.88998e-06 [cse]: 1.531e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.26e-05 [rewriter_after_opt_a]: 3.932e-05 [convert_after_rewriter]: 7.20003e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.0005927 [jit_opt_b]: 4.987e-05, [1] [Cycle 1]: 4.258e-05, [2] [frontend_op_eliminate]: 1.56e-05 [inline_after_opt_a]: 1.569e-05 [cconv]: 2.511e-05 [loop_unroll]: 0.00045011 [jit_opt_after_cconv]: 0.00015063, [1] [Cycle 1]: 0.00014397, [11] [c_1]: 2.197e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 6.02999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.257e-05 [call_graph_tuple_transform]: 2.149e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.19001e-06 [remove_dup_value]: 1.715e-05 [partial_unused_args_eliminate]: 2.79001e-06 [environ_conv]: 9.28002e-06 [add_recomputation]: 4.897e-05 [cse_after_recomputation]: 2.514e-05, [1] [Cycle 1]: 1.942e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.923e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 4.41002e-06 [opt_after_jit_grad]: 0.00047556 [symbol_engine_optimizer]: 8.189e-05, [1] [Cycle 1]: 7.521e-05, [6] [build]: 9.97001e-06 [elim_shapecalc]: 8.67998e-06 [elim_not_effective]: 1.314e-05 [opt_reshape]: 5.94999e-06 [fold_const_symbol]: 8.69003e-06 [renormalize]: 3.69997e-07 [validate]: 4.599e-05 Sums bootstrap : 0.000312s : 2.99% type_inference : 0.005903s : 56.68% event_method : 0.000019s : 0.18% auto_monad : 0.000066s : 0.63% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000059s : 0.56% rewriter_before_opt_a : 0.000082s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.60% jit_opt_a.loop_unroll : 0.000037s : 0.35% jit_opt_a.a_1 : 0.000649s : 6.23% jit_opt_a.with_stream_mark : 0.000028s : 0.27% jit_opt_a.recompute_prepare : 0.000014s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000963s : 9.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000051s : 0.49% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.12% rewriter_after_opt_a : 0.000039s : 0.38% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000593s : 5.69% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000025s : 0.24% loop_unroll : 0.000450s : 4.32% jit_opt_after_cconv.c_1 : 0.000022s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000009s : 0.09% add_recomputation : 0.000049s : 0.47% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000019s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000476s : 4.57% symbol_engine_optimizer.build : 0.000010s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.44% Time group info: ------[substitution.] 0.000225 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.94% : 0.000007s : 3: substitution.graph_param_transform 84.91% : 0.000191s : 4: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.27% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005828 2 77.60% : 0.004522s : 1: type_inference.infer 22.40% : 0.001305s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.44% : 0.000049s : 4: replace.inline 32.56% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.62% : 0.000188s : 4: match.inline 5.38% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.56% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.26% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.09% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.95% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.69% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.67% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000825 13 47.58% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.95% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.47% : 0.000383s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016263 72 0.32% : 0.000052s : 1: add_recomputation 0.43% : 0.000069s : 1: auto_monad 0.13% : 0.000022s : 1: auto_monad_reorder 2.04% : 0.000332s : 1: bootstrap 0.17% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000027s : 1: cse_after_recomputation 0.07% : 0.000012s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 34.92% : 0.005679s : 1: jit_opt_a 0.94% : 0.000153s : 1: jit_opt_after_cconv 0.32% : 0.000052s : 1: jit_opt_b 2.82% : 0.000458s : 1: loop_unroll 3.70% : 0.000602s : 1: mutable_eliminate 5.37% : 0.000873s : 26: opt.transform.jit_opt_a 0.32% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.15% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.97% : 0.000484s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000062s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 3.43% : 0.000558s : 1: renormalize.infer 2.44% : 0.000397s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000042s : 1: rewriter_after_opt_a 0.52% : 0.000085s : 1: rewriter_before_opt_a 0.52% : 0.000085s : 1: symbol_engine_optimizer 36.39% : 0.005918s : 1: type_inference TotalTime = 0.0697315, [30] [bootstrap]: 0.00026065 [type_inference]: 0.0592719 [event_method]: 2.468e-05 [auto_monad]: 7.439e-05 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.0002998 [rewriter_before_opt_a]: 0.00010184 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.007276, [2] [Cycle 1]: 0.00353223, [27] [switch_simplify]: 6.191e-05 [loop_unroll]: 3.401e-05 [a_1]: 0.00077172 [with_stream_mark]: 1.869e-05 [recompute_prepare]: 9.55001e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.58999e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.36998e-06 [merge_forward]: 3.94997e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 6.33e-06 [renormalize]: 0.00227275 [add_forward_monad_depend]: 6.98e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.628e-05 [cse]: 3.803e-05 [replace_applicator]: 1.92e-05 [Cycle 2]: 0.00040317, [27] [switch_simplify]: 7.41001e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00013446 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 6.53998e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.691e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 9.46003e-06 [inline_without_move]: 6.16e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 6.89999e-06 [cse]: 1.574e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 4.172e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00066506 [jit_opt_b]: 6e-05, [1] [Cycle 1]: 5.206e-05, [2] [frontend_op_eliminate]: 2.009e-05 [inline_after_opt_a]: 1.991e-05 [cconv]: 2.645e-05 [loop_unroll]: 0.00045037 [jit_opt_after_cconv]: 0.00016745, [1] [Cycle 1]: 0.00016002, [11] [c_1]: 2.848e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.91999e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 2.567e-05 [call_graph_tuple_transform]: 2.384e-05 [tuple_list_get_item_eliminator]: 6.71999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 2.082e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 9.35001e-06 [add_recomputation]: 5.39e-05 [cse_after_recomputation]: 2.576e-05, [1] [Cycle 1]: 2.016e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 5.14e-06 [opt_after_jit_grad]: 0.00051685 [symbol_engine_optimizer]: 7.873e-05, [1] [Cycle 1]: 7.22e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.424e-05 [opt_reshape]: 7.13e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 4.00003e-07 [validate]: 4.945e-05 Sums bootstrap : 0.000261s : 0.40% type_inference : 0.059272s : 90.12% event_method : 0.000025s : 0.04% auto_monad : 0.000074s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000300s : 0.46% rewriter_before_opt_a : 0.000102s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.11% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000906s : 1.38% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002273s : 3.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000054s : 0.08% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000042s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000665s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000450s : 0.68% jit_opt_after_cconv.c_1 : 0.000028s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000517s : 0.79% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.08% Time group info: ------[substitution.] 0.000248 25 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.97% : 0.000007s : 4: substitution.graph_param_transform 84.91% : 0.000210s : 5: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000006s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 5.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.059178 2 95.90% : 0.056750s : 1: type_inference.infer 4.10% : 0.002428s : 1: type_inference.specialize ------[replace.] 0.000100 7 67.99% : 0.000068s : 5: replace.inline 32.01% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 7 94.63% : 0.000207s : 5: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 888 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 2.12% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 2.59% : 0.000004s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.95% : 0.000009s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.80% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.49% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.30% : 0.000011s : 65: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002520 29 66.17% : 0.001667s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.34% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.49% : 0.000793s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073243 72 0.08% : 0.000057s : 1: add_recomputation 0.11% : 0.000078s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.38% : 0.000276s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.94% : 0.007279s : 1: jit_opt_a 0.23% : 0.000170s : 1: jit_opt_after_cconv 0.09% : 0.000063s : 1: jit_opt_b 0.63% : 0.000459s : 1: loop_unroll 0.92% : 0.000674s : 1: mutable_eliminate 1.59% : 0.001164s : 26: opt.transform.jit_opt_a 0.08% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000525s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000010s : 1: pre_auto_parallel 0.42% : 0.000306s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 1.96% : 0.001437s : 1: renormalize.infer 1.13% : 0.000826s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000107s : 1: rewriter_before_opt_a 0.11% : 0.000081s : 1: symbol_engine_optimizer 80.95% : 0.059290s : 1: type_inference TotalTime = 0.0158772, [30] [bootstrap]: 0.00029665 [type_inference]: 0.00664016 [event_method]: 2.06e-05 [auto_monad]: 6.996e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 5.771e-05 [rewriter_before_opt_a]: 9.701e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00595542, [2] [Cycle 1]: 0.00197629, [27] [switch_simplify]: 5.847e-05 [loop_unroll]: 3.07e-05 [a_1]: 0.00059489 [with_stream_mark]: 1.888e-05 [recompute_prepare]: 7.49002e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.05999e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.00093603 [add_forward_monad_depend]: 5.86003e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.722e-05 [cse]: 3.529e-05 [replace_applicator]: 1.22e-05 [Cycle 2]: 0.00032878, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.165e-05 [with_stream_mark]: 9.61e-06 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.98001e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.21997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.33e-05 [j_node_and_user_rematch]: 8.07998e-06 [meta_fg_expand]: 1.91003e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.09e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.01002e-06 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.388e-05 [replace_applicator]: 5.34998e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.87e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00059598 [jit_opt_b]: 5.237e-05, [1] [Cycle 1]: 4.475e-05, [2] [frontend_op_eliminate]: 1.709e-05 [inline_after_opt_a]: 1.634e-05 [cconv]: 2.708e-05 [loop_unroll]: 0.00086103 [jit_opt_after_cconv]: 0.00015777, [1] [Cycle 1]: 0.00015078, [11] [c_1]: 2.136e-05 [parameter_eliminate]: 3.95e-06 [updatestate_depend_eliminate]: 7.12002e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.037e-05 [call_graph_tuple_transform]: 1.993e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.60001e-06 [remove_dup_value]: 1.814e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 9.60001e-06 [add_recomputation]: 5.226e-05 [cse_after_recomputation]: 2.366e-05, [1] [Cycle 1]: 1.798e-05, [1] [cse]: 1.24e-05 [auto_monad_reorder]: 1.844e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.75001e-06 [opt_after_jit_grad]: 0.0005088 [symbol_engine_optimizer]: 9.094e-05, [1] [Cycle 1]: 8.48e-05, [6] [build]: 1.158e-05 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 2.032e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.94998e-06 [renormalize]: 4.39992e-07 [validate]: 4.566e-05 Sums bootstrap : 0.000297s : 2.55% type_inference : 0.006640s : 57.10% event_method : 0.000021s : 0.18% auto_monad : 0.000070s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000058s : 0.50% rewriter_before_opt_a : 0.000097s : 0.83% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.55% jit_opt_a.loop_unroll : 0.000036s : 0.31% jit_opt_a.a_1 : 0.000687s : 5.90% jit_opt_a.with_stream_mark : 0.000028s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000936s : 8.05% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.20% jit_opt_a.cse : 0.000049s : 0.42% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000039s : 0.33% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000596s : 5.13% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000027s : 0.23% loop_unroll : 0.000861s : 7.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000018s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000010s : 0.08% add_recomputation : 0.000052s : 0.45% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000509s : 4.38% symbol_engine_optimizer.build : 0.000012s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.39% Time group info: ------[substitution.] 0.000233 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 3: substitution.graph_param_transform 85.01% : 0.000198s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 2.27% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006561 2 73.72% : 0.004837s : 1: type_inference.infer 26.28% : 0.001724s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.24% : 0.000051s : 4: replace.inline 31.76% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 94.58% : 0.000196s : 4: match.inline 5.42% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.91% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.98% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.43% : 0.000002s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.97% : 0.000004s : 16: predicate.switch_defer_inline 2.36% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.49% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.58% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000850 13 49.71% : 0.000422s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.32% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.98% : 0.000382s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017779 72 0.31% : 0.000055s : 1: add_recomputation 0.41% : 0.000074s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.78% : 0.000317s : 1: bootstrap 0.17% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.07% : 0.000012s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 33.52% : 0.005960s : 1: jit_opt_a 0.90% : 0.000160s : 1: jit_opt_after_cconv 0.31% : 0.000055s : 1: jit_opt_b 4.90% : 0.000871s : 1: loop_unroll 3.40% : 0.000605s : 1: mutable_eliminate 5.10% : 0.000906s : 26: opt.transform.jit_opt_a 0.28% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.91% : 0.000517s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000061s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.88% : 0.000512s : 1: renormalize.infer 2.34% : 0.000416s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000042s : 1: rewriter_after_opt_a 0.57% : 0.000102s : 1: rewriter_before_opt_a 0.53% : 0.000094s : 1: symbol_engine_optimizer 37.46% : 0.006661s : 1: type_inference TotalTime = 0.125163, [30] [bootstrap]: 0.00028479 [type_inference]: 0.0944887 [event_method]: 1.971e-05 [auto_monad]: 7.069e-05 [graph_reusing]: 6.35002e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00025265 [rewriter_before_opt_a]: 8.162e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.0275846, [2] [Cycle 1]: 0.00347302, [27] [switch_simplify]: 9.309e-05 [loop_unroll]: 3.196e-05 [a_1]: 0.00069468 [with_stream_mark]: 2.512e-05 [recompute_prepare]: 8.42998e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 2.65002e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.41998e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 6.21998e-06 [merge_forward]: 4.53001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.718e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 1.206e-05 [inline_without_move]: 6.63e-06 [renormalize]: 0.00224371 [add_forward_monad_depend]: 7.55e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.769e-05 [cse]: 3.48e-05 [replace_applicator]: 1.709e-05 [Cycle 2]: 0.00038708, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.81003e-06 [a_1]: 0.00014195 [with_stream_mark]: 1.187e-05 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.08998e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 2.11003e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 2.78998e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.33999e-06 [inline_without_move]: 5.24e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.203e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.293e-05 [rewriter_after_opt_a]: 3.976e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00079594 [jit_opt_b]: 5.373e-05, [1] [Cycle 1]: 4.592e-05, [2] [frontend_op_eliminate]: 1.852e-05 [inline_after_opt_a]: 1.678e-05 [cconv]: 2.747e-05 [loop_unroll]: 0.00041395 [jit_opt_after_cconv]: 0.00014822, [1] [Cycle 1]: 0.00014185, [11] [c_1]: 2.483e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 6.37001e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.047e-05 [call_graph_tuple_transform]: 2.089e-05 [tuple_list_get_item_eliminator]: 5.79999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 1.30007e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.482e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 8.13001e-06 [add_recomputation]: 5.016e-05 [cse_after_recomputation]: 2.212e-05, [1] [Cycle 1]: 1.649e-05, [1] [cse]: 1.061e-05 [auto_monad_reorder]: 1.633e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.71e-06 [opt_after_jit_grad]: 0.0004363 [symbol_engine_optimizer]: 7.286e-05, [1] [Cycle 1]: 6.647e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 9.00001e-06 [renormalize]: 3.09985e-07 [validate]: 5.445e-05 Sums bootstrap : 0.000285s : 0.28% type_inference : 0.094489s : 93.71% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000253s : 0.25% rewriter_before_opt_a : 0.000082s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000100s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.04% jit_opt_a.a_1 : 0.000837s : 0.83% jit_opt_a.with_stream_mark : 0.000037s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002244s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000047s : 0.05% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000796s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000414s : 0.41% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000436s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.05% Time group info: ------[substitution.] 0.000299 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.04% : 0.000006s : 4: substitution.graph_param_transform 86.58% : 0.000259s : 4: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000006s : 2: substitution.replace_old_param 4.97% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.094398 2 97.96% : 0.092477s : 1: type_inference.infer 2.04% : 0.001921s : 1: type_inference.specialize ------[replace.] 0.000082 6 70.14% : 0.000057s : 4: replace.inline 29.86% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000270 6 94.90% : 0.000256s : 4: match.inline 5.10% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.71% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.10% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.53% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 0.98% : 0.000001s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.72% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.12% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 13.30% : 0.000020s : 58: predicate.switch_simplify 1.07% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002462 26 74.12% : 0.001824s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.36% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.52% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128566 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000303s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 21.46% : 0.027588s : 1: jit_opt_a 0.12% : 0.000151s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.33% : 0.000422s : 1: loop_unroll 0.63% : 0.000805s : 1: mutable_eliminate 0.86% : 0.001109s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000258s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.21% : 0.001551s : 1: renormalize.infer 0.53% : 0.000683s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 73.51% : 0.094506s : 1: type_inference TotalTime = 0.0147195, [30] [bootstrap]: 0.00029093 [type_inference]: 0.00621653 [event_method]: 2.02e-05 [auto_monad]: 6.827e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 5.68e-05 [rewriter_before_opt_a]: 8.1e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.0057709, [2] [Cycle 1]: 0.00204008, [27] [switch_simplify]: 9.849e-05 [loop_unroll]: 3.131e-05 [a_1]: 0.00057987 [with_stream_mark]: 6.753e-05 [recompute_prepare]: 1.161e-05 [updatestate_depend_eliminate]: 5.52001e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.72001e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00090063 [add_forward_monad_depend]: 6.01998e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 3.665e-05 [replace_applicator]: 1.327e-05 [Cycle 2]: 0.00033284, [27] [switch_simplify]: 6.12001e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.123e-05 [with_stream_mark]: 9.57001e-06 [recompute_prepare]: 5.47001e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.47999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.316e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 7.91001e-06 [inline_without_move]: 5.14003e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.444e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.368e-05 [rewriter_after_opt_a]: 3.802e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 4.94003e-06 [mutable_eliminate]: 0.00053008 [jit_opt_b]: 4.953e-05, [1] [Cycle 1]: 4.224e-05, [2] [frontend_op_eliminate]: 1.546e-05 [inline_after_opt_a]: 1.574e-05 [cconv]: 2.567e-05 [loop_unroll]: 0.00043755 [jit_opt_after_cconv]: 0.00014474, [1] [Cycle 1]: 0.00013831, [11] [c_1]: 2.115e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 3.16001e-06 [cse]: 2.24e-05 [call_graph_tuple_transform]: 1.91e-05 [tuple_list_get_item_eliminator]: 6.15002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 9.17001e-06 [add_recomputation]: 5.055e-05 [cse_after_recomputation]: 2.49e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.756e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 4.47998e-06 [opt_after_jit_grad]: 0.00050842 [symbol_engine_optimizer]: 8.217e-05, [1] [Cycle 1]: 7.584e-05, [6] [build]: 1.082e-05 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.353e-05 [opt_reshape]: 6.07999e-06 [fold_const_symbol]: 8.69998e-06 [renormalize]: 5.69999e-07 [validate]: 4.421e-05 Sums bootstrap : 0.000291s : 2.72% type_inference : 0.006217s : 58.04% event_method : 0.000020s : 0.19% auto_monad : 0.000068s : 0.64% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000057s : 0.53% rewriter_before_opt_a : 0.000081s : 0.76% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000105s : 0.98% jit_opt_a.loop_unroll : 0.000036s : 0.34% jit_opt_a.a_1 : 0.000671s : 6.27% jit_opt_a.with_stream_mark : 0.000077s : 0.72% jit_opt_a.recompute_prepare : 0.000017s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000901s : 8.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.20% jit_opt_a.cse : 0.000051s : 0.48% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000014s : 0.13% rewriter_after_opt_a : 0.000038s : 0.35% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000530s : 4.95% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000026s : 0.24% loop_unroll : 0.000438s : 4.09% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.09% add_recomputation : 0.000051s : 0.47% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000508s : 4.75% symbol_engine_optimizer.build : 0.000011s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.41% Time group info: ------[substitution.] 0.000225 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 85.22% : 0.000192s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006142 2 78.50% : 0.004822s : 1: type_inference.infer 21.50% : 0.001320s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.88% : 0.000051s : 4: replace.inline 30.12% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.61% : 0.000189s : 4: match.inline 5.39% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.51% : 0.000002s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.05% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 2.16% : 0.000003s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 1.16% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.48% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.65% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.62% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000853 13 51.51% : 0.000440s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.17% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.31% : 0.000370s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016607 72 0.32% : 0.000053s : 1: add_recomputation 0.43% : 0.000072s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.87% : 0.000311s : 1: bootstrap 0.17% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.10% : 0.000016s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 34.77% : 0.005774s : 1: jit_opt_a 0.89% : 0.000148s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.69% : 0.000446s : 1: loop_unroll 3.25% : 0.000539s : 1: mutable_eliminate 5.65% : 0.000938s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.12% : 0.000518s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000060s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.90% : 0.000481s : 1: renormalize.infer 2.48% : 0.000411s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000041s : 1: rewriter_after_opt_a 0.50% : 0.000084s : 1: rewriter_before_opt_a 0.51% : 0.000085s : 1: symbol_engine_optimizer 37.54% : 0.006235s : 1: type_inference TotalTime = 0.149286, [30] [bootstrap]: 0.00033748 [type_inference]: 0.13472 [event_method]: 7.772e-05 [auto_monad]: 8.665e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 0.00070138 [rewriter_before_opt_a]: 0.00011003 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.00988915, [2] [Cycle 1]: 0.0053181, [27] [switch_simplify]: 7.193e-05 [loop_unroll]: 3.464e-05 [a_1]: 0.00083163 [with_stream_mark]: 2.421e-05 [recompute_prepare]: 1.045e-05 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 7.35003e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 6.92002e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 7.75e-06 [merge_forward]: 4.59002e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 1.212e-05 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 1.135e-05 [inline_without_move]: 6.46e-06 [renormalize]: 0.00393019 [add_forward_monad_depend]: 1.129e-05 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 2.271e-05 [cse]: 3.757e-05 [replace_applicator]: 2.542e-05 [Cycle 2]: 0.00042157, [27] [switch_simplify]: 7.10998e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00014652 [with_stream_mark]: 1.644e-05 [recompute_prepare]: 6.45997e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 3.73001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.70002e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.502e-05 [replace_applicator]: 6.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.892e-05 [rewriter_after_opt_a]: 4.129e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00082896 [jit_opt_b]: 6.433e-05, [1] [Cycle 1]: 5.546e-05, [2] [frontend_op_eliminate]: 2.205e-05 [inline_after_opt_a]: 2.046e-05 [cconv]: 3.244e-05 [loop_unroll]: 0.00057993 [jit_opt_after_cconv]: 0.00018905, [1] [Cycle 1]: 0.00018086, [11] [c_1]: 2.84e-05 [parameter_eliminate]: 4.72e-06 [updatestate_depend_eliminate]: 1.027e-05 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 3.771e-05 [call_graph_tuple_transform]: 2.472e-05 [tuple_list_get_item_eliminator]: 6.57002e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 7.82e-06 [remove_dup_value]: 1.684e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 9.86e-06 [add_recomputation]: 5.353e-05 [cse_after_recomputation]: 2.674e-05, [1] [Cycle 1]: 2.016e-05, [1] [cse]: 1.437e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.68e-06 [rewriter_after_jit_bprop_graph]: 8.85001e-06 [opt_after_jit_grad]: 0.00056819 [symbol_engine_optimizer]: 9.283e-05, [1] [Cycle 1]: 8.571e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 1.036e-05 [elim_not_effective]: 1.625e-05 [opt_reshape]: 8.23999e-06 [fold_const_symbol]: 1.439e-05 [renormalize]: 4.7998e-07 [validate]: 5.908e-05 Sums bootstrap : 0.000337s : 0.23% type_inference : 0.134720s : 93.59% event_method : 0.000078s : 0.05% auto_monad : 0.000087s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000701s : 0.49% rewriter_before_opt_a : 0.000110s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000978s : 0.68% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003930s : 2.73% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000829s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000580s : 0.40% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000568s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.04% Time group info: ------[substitution.] 0.000357 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 1.81% : 0.000006s : 4: substitution.graph_param_transform 84.68% : 0.000302s : 5: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.28% : 0.000015s : 3: substitution.reduce_eliminate 1.75% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000007s : 2: substitution.replace_old_param 3.09% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.134605 2 97.04% : 0.130625s : 1: type_inference.infer 2.96% : 0.003981s : 1: type_inference.specialize ------[replace.] 0.000120 7 69.72% : 0.000084s : 5: replace.inline 30.28% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000308 7 96.83% : 0.000299s : 5: match.inline 3.17% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.90% : 0.000003s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.71% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.50% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.81% : 0.000009s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.65% : 0.000003s : 19: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.35% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000004s : 19: predicate.partial_eliminate 1.35% : 0.000002s : 13: predicate.print_const_string_wrapper 2.11% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.72% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.78% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.97% : 0.000011s : 64: predicate.switch_simplify 1.51% : 0.000002s : 13: predicate.tile_eliminate 1.49% : 0.000002s : 13: predicate.transpose_eliminate 1.62% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.61% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.03% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003068 25 62.01% : 0.001902s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.21% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.78% : 0.001067s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154532 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000091s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.55% : 0.000857s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.05% : 0.000085s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.40% : 0.009894s : 1: jit_opt_a 0.12% : 0.000192s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.38% : 0.000590s : 1: loop_unroll 0.54% : 0.000841s : 1: mutable_eliminate 0.81% : 0.001253s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000576s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.46% : 0.000709s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.82% : 0.002815s : 1: renormalize.infer 0.71% : 0.001100s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000116s : 1: rewriter_before_opt_a 0.06% : 0.000096s : 1: symbol_engine_optimizer 87.20% : 0.134747s : 1: type_inference TotalTime = 0.0168514, [30] [bootstrap]: 0.000256 [type_inference]: 0.00849731 [event_method]: 2.072e-05 [auto_monad]: 6.975e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 4.728e-05 [rewriter_before_opt_a]: 8.427e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00570431, [2] [Cycle 1]: 0.00213124, [27] [switch_simplify]: 6.11e-05 [loop_unroll]: 3.339e-05 [a_1]: 0.00062858 [with_stream_mark]: 1.821e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.58e-06 [parameter_eliminate]: 1.86003e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.18999e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.00070998 [add_forward_monad_depend]: 5.47001e-06 [auto_monad_grad]: 4.23001e-06 [auto_monad_eliminator]: 1.675e-05 [cse]: 4.131e-05 [replace_applicator]: 1.379e-05 [Cycle 2]: 0.00032699, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.22e-06 [a_1]: 9.012e-05 [with_stream_mark]: 9.39e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 3.25998e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.375e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.552e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 9.02999e-06 [rewriter_after_opt_a]: 3.655e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 5.24003e-06 [mutable_eliminate]: 0.00054593 [jit_opt_b]: 4.938e-05, [1] [Cycle 1]: 4.29e-05, [2] [frontend_op_eliminate]: 1.609e-05 [inline_after_opt_a]: 1.552e-05 [cconv]: 2.538e-05 [loop_unroll]: 0.00043052 [jit_opt_after_cconv]: 0.00014888, [1] [Cycle 1]: 0.00014248, [11] [c_1]: 2.14e-05 [parameter_eliminate]: 3.01001e-06 [updatestate_depend_eliminate]: 5.96998e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.619e-05 [call_graph_tuple_transform]: 1.861e-05 [tuple_list_get_item_eliminator]: 5.20999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.14998e-06 [remove_dup_value]: 3.54e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 4.965e-05 [cse_after_recomputation]: 3.611e-05, [1] [Cycle 1]: 1.982e-05, [1] [cse]: 1.362e-05 [auto_monad_reorder]: 1.915e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 5.03002e-06 [opt_after_jit_grad]: 0.00046218 [symbol_engine_optimizer]: 7.309e-05, [1] [Cycle 1]: 6.655e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 2.69996e-07 [validate]: 4.021e-05 Sums bootstrap : 0.000256s : 2.02% type_inference : 0.008497s : 66.97% event_method : 0.000021s : 0.16% auto_monad : 0.000070s : 0.55% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.37% rewriter_before_opt_a : 0.000084s : 0.66% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000067s : 0.53% jit_opt_a.loop_unroll : 0.000039s : 0.30% jit_opt_a.a_1 : 0.000719s : 5.66% jit_opt_a.with_stream_mark : 0.000028s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000710s : 5.60% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000005s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.18% jit_opt_a.cse : 0.000057s : 0.45% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.07% rewriter_after_opt_a : 0.000037s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000546s : 4.30% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.20% loop_unroll : 0.000431s : 3.39% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000035s : 0.28% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000462s : 3.64% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.32% Time group info: ------[substitution.] 0.000242 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000005s : 3: substitution.graph_param_transform 86.55% : 0.000209s : 5: substitution.inline 1.16% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.34% : 0.000003s : 2: substitution.replace_old_param 5.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008426 2 87.78% : 0.007397s : 1: type_inference.infer 12.22% : 0.001030s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.17% : 0.000061s : 5: replace.inline 32.83% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 7 94.46% : 0.000206s : 5: match.inline 5.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 1.82% : 0.000002s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000002s : 11: predicate.environ_get_eliminate 1.21% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 16: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.53% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.33% : 0.000002s : 11: predicate.print_const_string_wrapper 1.63% : 0.000002s : 11: predicate.reduce_eliminate 1.57% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.81% : 0.000010s : 59: predicate.switch_simplify 1.17% : 0.000001s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.75% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000814 16 51.73% : 0.000421s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.42% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.85% : 0.000324s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018559 72 0.28% : 0.000052s : 1: add_recomputation 0.39% : 0.000073s : 1: auto_monad 0.12% : 0.000022s : 1: auto_monad_reorder 1.47% : 0.000272s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.21% : 0.000038s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.76% : 0.005708s : 1: jit_opt_a 0.82% : 0.000152s : 1: jit_opt_after_cconv 0.28% : 0.000052s : 1: jit_opt_b 2.36% : 0.000439s : 1: loop_unroll 2.98% : 0.000554s : 1: mutable_eliminate 5.08% : 0.000943s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000050s : 1: py_interpret_to_execute 0.06% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000038s : 1: remove_dup_value 2.12% : 0.000394s : 1: renormalize.infer 1.66% : 0.000309s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.47% : 0.000087s : 1: rewriter_before_opt_a 0.41% : 0.000076s : 1: symbol_engine_optimizer 45.88% : 0.008515s : 1: type_inference TotalTime = 0.0309398, [30] [bootstrap]: 0.00033082 [type_inference]: 0.0227395 [event_method]: 1.983e-05 [auto_monad]: 6.441e-05 [graph_reusing]: 5.75001e-06 [pre_auto_parallel]: 2.02999e-06 [py_interpret_to_execute]: 0.00010918 [rewriter_before_opt_a]: 7.994e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.0053759, [2] [Cycle 1]: 0.00189015, [27] [switch_simplify]: 7.763e-05 [loop_unroll]: 3.189e-05 [a_1]: 0.00053334 [with_stream_mark]: 1.667e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 6.68998e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.41998e-06 [renormalize]: 0.00091913 [add_forward_monad_depend]: 4.93001e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.421e-05 [cse]: 2.409e-05 [replace_applicator]: 1.238e-05 [Cycle 2]: 0.00032939, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.43002e-06 [a_1]: 9.511e-05 [with_stream_mark]: 1.049e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 5.42999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.295e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 7.74002e-06 [inline_without_move]: 5.04e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.273e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.238e-05 [rewriter_after_opt_a]: 3.426e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00056421 [jit_opt_b]: 4.996e-05, [1] [Cycle 1]: 4.292e-05, [2] [frontend_op_eliminate]: 1.642e-05 [inline_after_opt_a]: 1.612e-05 [cconv]: 2.324e-05 [loop_unroll]: 0.00042839 [jit_opt_after_cconv]: 0.00014331, [1] [Cycle 1]: 0.00013702, [11] [c_1]: 2.183e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.57999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.129e-05 [call_graph_tuple_transform]: 1.809e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.56e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 5.76e-06 [add_recomputation]: 4.449e-05 [cse_after_recomputation]: 2.516e-05, [1] [Cycle 1]: 1.946e-05, [1] [cse]: 1.317e-05 [auto_monad_reorder]: 1.623e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 4.65999e-06 [opt_after_jit_grad]: 0.00050773 [symbol_engine_optimizer]: 7.479e-05, [1] [Cycle 1]: 6.836e-05, [6] [build]: 3.73999e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 6.35002e-06 [fold_const_symbol]: 9.21002e-06 [renormalize]: 3.60014e-07 [validate]: 3.651e-05 Sums bootstrap : 0.000331s : 1.22% type_inference : 0.022740s : 83.66% event_method : 0.000020s : 0.07% auto_monad : 0.000064s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000109s : 0.40% rewriter_before_opt_a : 0.000080s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000084s : 0.31% jit_opt_a.loop_unroll : 0.000037s : 0.14% jit_opt_a.a_1 : 0.000628s : 2.31% jit_opt_a.with_stream_mark : 0.000027s : 0.10% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000919s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000037s : 0.14% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000012s : 0.05% rewriter_after_opt_a : 0.000034s : 0.13% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000564s : 2.08% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000023s : 0.09% loop_unroll : 0.000428s : 1.58% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000044s : 0.16% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000016s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000508s : 1.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.13% Time group info: ------[substitution.] 0.000192 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.96% : 0.000006s : 3: substitution.graph_param_transform 84.29% : 0.000162s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000003s : 2: substitution.replace_old_param 5.77% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022675 2 93.67% : 0.021239s : 1: type_inference.infer 6.33% : 0.001436s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.95% : 0.000050s : 4: replace.inline 33.05% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 94.16% : 0.000160s : 4: match.inline 5.84% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.38% : 0.000002s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.76% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.40% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.94% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 10: predicate.value_based_eliminate 0.47% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000808 13 48.33% : 0.000391s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.26% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.40% : 0.000375s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032772 72 0.15% : 0.000048s : 1: add_recomputation 0.21% : 0.000068s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.10% : 0.000361s : 1: bootstrap 0.08% : 0.000026s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 16.41% : 0.005379s : 1: jit_opt_a 0.45% : 0.000146s : 1: jit_opt_after_cconv 0.16% : 0.000052s : 1: jit_opt_b 1.33% : 0.000436s : 1: loop_unroll 1.75% : 0.000573s : 1: mutable_eliminate 2.65% : 0.000869s : 26: opt.transform.jit_opt_a 0.15% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000517s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000113s : 1: py_interpret_to_execute 0.04% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.54% : 0.000505s : 1: renormalize.infer 1.24% : 0.000406s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000037s : 1: rewriter_after_opt_a 0.26% : 0.000084s : 1: rewriter_before_opt_a 0.24% : 0.000078s : 1: symbol_engine_optimizer 69.43% : 0.022753s : 1: type_inference TotalTime = 0.0200547, [30] [bootstrap]: 0.00040678 [type_inference]: 0.00959604 [event_method]: 2.614e-05 [auto_monad]: 8.269e-05 [graph_reusing]: 6.89999e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 6.817e-05 [rewriter_before_opt_a]: 9.358e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00724413, [2] [Cycle 1]: 0.00234681, [27] [switch_simplify]: 7.646e-05 [loop_unroll]: 3.42e-05 [a_1]: 0.00075355 [with_stream_mark]: 2.5e-05 [recompute_prepare]: 8.15e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 6.80998e-06 [updatestate_useless_node_eliminater]: 5.46002e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.73003e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.694e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.066e-05 [inline_without_move]: 5.96e-06 [renormalize]: 0.00108831 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 1.647e-05 [cse]: 3.694e-05 [replace_applicator]: 1.568e-05 [Cycle 2]: 0.00035411, [27] [switch_simplify]: 6.25002e-06 [loop_unroll]: 5.46998e-06 [a_1]: 0.00010455 [with_stream_mark]: 1.116e-05 [recompute_prepare]: 5.66998e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.56998e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.211e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 7.03998e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.02001e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.79999e-06 [cse]: 1.49e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.528e-05 [rewriter_after_opt_a]: 3.957e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00078034 [jit_opt_b]: 5.821e-05, [1] [Cycle 1]: 4.997e-05, [2] [frontend_op_eliminate]: 2.004e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 3.32e-05 [loop_unroll]: 0.00048549 [jit_opt_after_cconv]: 0.0001664, [1] [Cycle 1]: 0.00015969, [11] [c_1]: 2.366e-05 [parameter_eliminate]: 3.83001e-06 [updatestate_depend_eliminate]: 7.65e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.973e-05 [call_graph_tuple_transform]: 2.194e-05 [tuple_list_get_item_eliminator]: 6.18998e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 1.17e-06 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.623e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 7.01001e-06 [add_recomputation]: 5.292e-05 [cse_after_recomputation]: 2.457e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.762e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.59998e-06 [opt_after_jit_grad]: 0.00047904 [symbol_engine_optimizer]: 7.876e-05, [1] [Cycle 1]: 7.197e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 9.32999e-06 [elim_not_effective]: 1.473e-05 [opt_reshape]: 6.56999e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 2.80008e-07 [validate]: 4.314e-05 Sums bootstrap : 0.000407s : 2.74% type_inference : 0.009596s : 64.52% event_method : 0.000026s : 0.18% auto_monad : 0.000083s : 0.56% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000068s : 0.46% rewriter_before_opt_a : 0.000094s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000083s : 0.56% jit_opt_a.loop_unroll : 0.000040s : 0.27% jit_opt_a.a_1 : 0.000858s : 5.77% jit_opt_a.with_stream_mark : 0.000036s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001088s : 7.32% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.16% jit_opt_a.cse : 0.000052s : 0.35% jit_opt_a.replace_applicator : 0.000021s : 0.14% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000040s : 0.27% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000780s : 5.25% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000033s : 0.22% loop_unroll : 0.000485s : 3.26% jit_opt_after_cconv.c_1 : 0.000024s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000053s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000479s : 3.22% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.29% Time group info: ------[substitution.] 0.000327 27 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.81% : 0.000006s : 3: substitution.graph_param_transform 85.46% : 0.000279s : 5: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.61% : 0.000012s : 3: substitution.reduce_eliminate 1.57% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 3.49% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009499 2 85.44% : 0.008116s : 1: type_inference.infer 14.56% : 0.001383s : 1: type_inference.specialize ------[replace.] 0.000109 7 67.54% : 0.000074s : 5: replace.inline 32.46% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 7 96.42% : 0.000276s : 5: match.inline 3.58% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.52% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 2.24% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 11: predicate.compare_switch_simplify 1.14% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.42% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_depend_swap 1.13% : 0.000002s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000008s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.75% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 16: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 1.92% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.37% : 0.000002s : 11: predicate.print_const_string_wrapper 2.39% : 0.000003s : 11: predicate.reduce_eliminate 1.53% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.08% : 0.000002s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.78% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.42% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.28% : 0.000012s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.92% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001054 16 46.71% : 0.000492s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.69% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.61% : 0.000470s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022304 72 0.25% : 0.000056s : 1: add_recomputation 0.39% : 0.000087s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.91% : 0.000426s : 1: bootstrap 0.16% : 0.000036s : 1: cconv 0.05% : 0.000011s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.14% : 0.000032s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.50% : 0.007248s : 1: jit_opt_a 0.76% : 0.000170s : 1: jit_opt_after_cconv 0.27% : 0.000061s : 1: jit_opt_b 2.21% : 0.000493s : 1: loop_unroll 3.55% : 0.000792s : 1: mutable_eliminate 4.95% : 0.001105s : 26: opt.transform.jit_opt_a 0.24% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000030s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.18% : 0.000487s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000071s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000019s : 1: remove_dup_value 2.90% : 0.000647s : 1: renormalize.infer 1.94% : 0.000432s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000043s : 1: rewriter_after_opt_a 0.44% : 0.000098s : 1: rewriter_before_opt_a 0.37% : 0.000081s : 1: symbol_engine_optimizer 43.13% : 0.009619s : 1: type_inference TotalTime = 0.0143166, [30] [bootstrap]: 0.00027795 [type_inference]: 0.0057284 [event_method]: 1.915e-05 [auto_monad]: 6.527e-05 [graph_reusing]: 5.58002e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 5.69e-05 [rewriter_before_opt_a]: 8.095e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00579814, [2] [Cycle 1]: 0.00194113, [27] [switch_simplify]: 5.969e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00058223 [with_stream_mark]: 2.192e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.92001e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 0.0008973 [add_forward_monad_depend]: 5.64998e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.566e-05 [cse]: 3.412e-05 [replace_applicator]: 1.192e-05 [Cycle 2]: 0.0003247, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.019e-05 [with_stream_mark]: 9.49e-06 [recompute_prepare]: 5.43997e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 2.78003e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 8.25999e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.75e-06 [inline_without_move]: 4.94998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 6.02999e-06 [cse]: 1.253e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.66e-05 [rewriter_after_opt_a]: 4.04e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00054937 [jit_opt_b]: 5.041e-05, [1] [Cycle 1]: 4.354e-05, [2] [frontend_op_eliminate]: 1.612e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 2.417e-05 [loop_unroll]: 0.00045745 [jit_opt_after_cconv]: 0.00015829, [1] [Cycle 1]: 0.00015115, [11] [c_1]: 2.251e-05 [parameter_eliminate]: 3.60003e-06 [updatestate_depend_eliminate]: 6.48998e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.95e-05 [call_graph_tuple_transform]: 2.037e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.20027e-07 [switch_simplify]: 5.87999e-06 [remove_dup_value]: 1.668e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 1.568e-05 [add_recomputation]: 5.228e-05 [cse_after_recomputation]: 2.817e-05, [1] [Cycle 1]: 2.168e-05, [1] [cse]: 1.481e-05 [auto_monad_reorder]: 1.924e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 7.56999e-06 [opt_after_jit_grad]: 0.00050594 [symbol_engine_optimizer]: 8.494e-05, [1] [Cycle 1]: 7.83e-05, [6] [build]: 1.104e-05 [elim_shapecalc]: 8.43999e-06 [elim_not_effective]: 1.368e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.14e-06 [renormalize]: 6.00005e-07 [validate]: 4.984e-05 Sums bootstrap : 0.000278s : 2.73% type_inference : 0.005728s : 56.29% event_method : 0.000019s : 0.19% auto_monad : 0.000065s : 0.64% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000057s : 0.56% rewriter_before_opt_a : 0.000081s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.35% jit_opt_a.a_1 : 0.000672s : 6.61% jit_opt_a.with_stream_mark : 0.000031s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000897s : 8.82% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.21% jit_opt_a.cse : 0.000047s : 0.46% jit_opt_a.replace_applicator : 0.000018s : 0.17% py_interpret_to_execute_after_opt_a : 0.000017s : 0.16% rewriter_after_opt_a : 0.000040s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000549s : 5.40% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000024s : 0.24% loop_unroll : 0.000457s : 4.49% jit_opt_after_cconv.c_1 : 0.000023s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000016s : 0.15% add_recomputation : 0.000052s : 0.51% cse_after_recomputation.cse : 0.000015s : 0.15% auto_monad_reorder : 0.000019s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.07% opt_after_jit_grad : 0.000506s : 4.97% symbol_engine_optimizer.build : 0.000011s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000050s : 0.49% Time group info: ------[substitution.] 0.000249 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 85.49% : 0.000213s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000005s : 2: substitution.replace_old_param 5.56% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005659 2 77.79% : 0.004402s : 1: type_inference.infer 22.21% : 0.001257s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.19% : 0.000051s : 4: replace.inline 30.81% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.29% : 0.000210s : 4: match.inline 5.71% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 6.15% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 2.09% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.60% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.08% : 0.000001s : 10: predicate.same_eliminate 0.84% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000788 13 48.14% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.33% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.54% : 0.000359s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016154 72 0.35% : 0.000056s : 1: add_recomputation 0.42% : 0.000068s : 1: auto_monad 0.14% : 0.000022s : 1: auto_monad_reorder 1.83% : 0.000296s : 1: bootstrap 0.17% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000030s : 1: cse_after_recomputation 0.11% : 0.000018s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.92% : 0.005802s : 1: jit_opt_a 1.00% : 0.000161s : 1: jit_opt_after_cconv 0.33% : 0.000053s : 1: jit_opt_b 2.89% : 0.000467s : 1: loop_unroll 3.46% : 0.000558s : 1: mutable_eliminate 5.53% : 0.000894s : 26: opt.transform.jit_opt_a 0.31% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.20% : 0.000516s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000061s : 1: py_interpret_to_execute 0.12% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 3.10% : 0.000501s : 1: renormalize.infer 2.40% : 0.000388s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000043s : 1: rewriter_after_opt_a 0.52% : 0.000084s : 1: rewriter_before_opt_a 0.54% : 0.000087s : 1: symbol_engine_optimizer 35.56% : 0.005744s : 1: type_inference TotalTime = 0.0139102, [30] [bootstrap]: 0.00027817 [type_inference]: 0.00564713 [event_method]: 1.919e-05 [auto_monad]: 6.435e-05 [graph_reusing]: 5.96998e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 5.64e-05 [rewriter_before_opt_a]: 8.196e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00557274, [2] [Cycle 1]: 0.00183376, [27] [switch_simplify]: 5.613e-05 [loop_unroll]: 3.066e-05 [a_1]: 0.00054723 [with_stream_mark]: 2.025e-05 [recompute_prepare]: 7.51999e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 0.00084203 [add_forward_monad_depend]: 5.97001e-06 [auto_monad_grad]: 2.12001e-06 [auto_monad_eliminator]: 1.636e-05 [cse]: 3.343e-05 [replace_applicator]: 1.455e-05 [Cycle 2]: 0.00039302, [27] [switch_simplify]: 3.056e-05 [loop_unroll]: 5.64e-06 [a_1]: 0.00010558 [with_stream_mark]: 1.046e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 3.50998e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 5.68997e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 8.26002e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 6.98e-06 [cse]: 1.587e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.314e-05 [rewriter_after_opt_a]: 3.844e-05 [convert_after_rewriter]: 6.77002e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00056423 [jit_opt_b]: 4.857e-05, [1] [Cycle 1]: 4.215e-05, [2] [frontend_op_eliminate]: 1.538e-05 [inline_after_opt_a]: 1.628e-05 [cconv]: 2.479e-05 [loop_unroll]: 0.0004203 [jit_opt_after_cconv]: 0.00014722, [1] [Cycle 1]: 0.0001409, [11] [c_1]: 2.077e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 5.77999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.339e-05 [call_graph_tuple_transform]: 1.873e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 7.47002e-06 [environ_conv]: 8.33001e-06 [add_recomputation]: 4.898e-05 [cse_after_recomputation]: 2.513e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 1.711e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 4.82e-06 [opt_after_jit_grad]: 0.00047112 [symbol_engine_optimizer]: 8.233e-05, [1] [Cycle 1]: 7.62e-05, [6] [build]: 9.64e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.399e-05 [opt_reshape]: 6.78998e-06 [fold_const_symbol]: 8.52998e-06 [renormalize]: 4.89992e-07 [validate]: 4.5e-05 Sums bootstrap : 0.000278s : 2.79% type_inference : 0.005647s : 56.70% event_method : 0.000019s : 0.19% auto_monad : 0.000064s : 0.65% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000056s : 0.57% rewriter_before_opt_a : 0.000082s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000087s : 0.87% jit_opt_a.loop_unroll : 0.000036s : 0.36% jit_opt_a.a_1 : 0.000653s : 6.55% jit_opt_a.with_stream_mark : 0.000031s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000842s : 8.46% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.23% jit_opt_a.cse : 0.000049s : 0.50% jit_opt_a.replace_applicator : 0.000020s : 0.20% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000038s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000564s : 5.67% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000025s : 0.25% loop_unroll : 0.000420s : 4.22% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000007s : 0.08% environ_conv : 0.000008s : 0.08% add_recomputation : 0.000049s : 0.49% cse_after_recomputation.cse : 0.000013s : 0.13% auto_monad_reorder : 0.000017s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000471s : 4.73% symbol_engine_optimizer.build : 0.000010s : 0.10% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.45% Time group info: ------[substitution.] 0.000216 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 3: substitution.graph_param_transform 83.95% : 0.000181s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000005s : 4: substitution.remove_not_recompute_node 2.54% : 0.000005s : 2: substitution.replace_old_param 5.66% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005582 2 77.65% : 0.004334s : 1: type_inference.infer 22.35% : 0.001247s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.95% : 0.000052s : 4: replace.inline 30.05% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 94.18% : 0.000178s : 4: match.inline 5.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.25% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 1.72% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.21% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.36% : 0.000002s : 10: predicate.minmaximum_grad 2.29% : 0.000003s : 3: predicate.mutable_eliminate 0.77% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.24% : 0.000008s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.45% : 0.000002s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000798 13 50.47% : 0.000403s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.04% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.50% : 0.000355s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015697 72 0.33% : 0.000052s : 1: add_recomputation 0.43% : 0.000067s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.90% : 0.000298s : 1: bootstrap 0.17% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000027s : 1: cse_after_recomputation 0.07% : 0.000010s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.52% : 0.005576s : 1: jit_opt_a 0.96% : 0.000150s : 1: jit_opt_after_cconv 0.33% : 0.000051s : 1: jit_opt_b 2.73% : 0.000429s : 1: loop_unroll 3.65% : 0.000573s : 1: mutable_eliminate 5.73% : 0.000899s : 26: opt.transform.jit_opt_a 0.30% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.05% : 0.000479s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.06% : 0.000010s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000060s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.87% : 0.000450s : 1: renormalize.infer 2.44% : 0.000383s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000041s : 1: rewriter_after_opt_a 0.54% : 0.000085s : 1: rewriter_before_opt_a 0.54% : 0.000085s : 1: symbol_engine_optimizer 36.08% : 0.005663s : 1: type_inference TotalTime = 0.0129502, [30] [bootstrap]: 0.00030835 [type_inference]: 0.00458959 [event_method]: 1.738e-05 [auto_monad]: 6.508e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 3.363e-05 [rewriter_before_opt_a]: 7.093e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00582392, [2] [Cycle 1]: 0.00238281, [27] [switch_simplify]: 5.153e-05 [loop_unroll]: 2.851e-05 [a_1]: 0.00135905 [with_stream_mark]: 1.72e-05 [recompute_prepare]: 7.43e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.377e-05 [j_node_and_user_rematch]: 1.286e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.38002e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00059233 [add_forward_monad_depend]: 5.04e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.466e-05 [cse]: 2.728e-05 [replace_applicator]: 1.156e-05 [Cycle 2]: 0.00031524, [27] [switch_simplify]: 5.62999e-06 [loop_unroll]: 4.78001e-06 [a_1]: 8.8e-05 [with_stream_mark]: 7.87998e-06 [recompute_prepare]: 4.92999e-06 [updatestate_depend_eliminate]: 2.46998e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.80001e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.41002e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.212e-05 [j_node_and_user_rematch]: 7.46001e-06 [meta_fg_expand]: 1.68997e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 5.12e-06 [cse]: 9.92999e-06 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 8.98002e-06 [rewriter_after_opt_a]: 3.328e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00050833 [jit_opt_b]: 4.736e-05, [1] [Cycle 1]: 4.139e-05, [2] [frontend_op_eliminate]: 1.477e-05 [inline_after_opt_a]: 1.49e-05 [cconv]: 2.591e-05 [loop_unroll]: 0.00040242 [jit_opt_after_cconv]: 0.00017087, [1] [Cycle 1]: 0.00016481, [11] [c_1]: 5.051e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.797e-05 [call_graph_tuple_transform]: 1.753e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.05999e-06 [remove_dup_value]: 1.455e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 5.33002e-06 [add_recomputation]: 5.621e-05 [cse_after_recomputation]: 2.202e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.034e-05 [auto_monad_reorder]: 1.567e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 4.30999e-06 [opt_after_jit_grad]: 0.00043474 [symbol_engine_optimizer]: 7.21e-05, [1] [Cycle 1]: 6.594e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.235e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.25999e-06 [renormalize]: 4.80009e-07 [validate]: 3.282e-05 Sums bootstrap : 0.000308s : 3.34% type_inference : 0.004590s : 49.65% event_method : 0.000017s : 0.19% auto_monad : 0.000065s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000034s : 0.36% rewriter_before_opt_a : 0.000071s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.62% jit_opt_a.loop_unroll : 0.000033s : 0.36% jit_opt_a.a_1 : 0.001447s : 15.65% jit_opt_a.with_stream_mark : 0.000025s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000592s : 6.41% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.21% jit_opt_a.cse : 0.000037s : 0.40% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000009s : 0.10% rewriter_after_opt_a : 0.000033s : 0.36% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000508s : 5.50% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000026s : 0.28% loop_unroll : 0.000402s : 4.35% jit_opt_after_cconv.c_1 : 0.000051s : 0.55% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000056s : 0.61% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000435s : 4.70% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000033s : 0.36% Time group info: ------[substitution.] 0.001032 23 0.18% : 0.000002s : 2: substitution.elim_not_effective 0.14% : 0.000001s : 2: substitution.fold_const_symbol 0.47% : 0.000005s : 3: substitution.graph_param_transform 96.80% : 0.000999s : 4: substitution.inline 0.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.44% : 0.000005s : 4: substitution.remove_not_recompute_node 0.45% : 0.000005s : 2: substitution.replace_old_param 1.21% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004532 2 82.25% : 0.003728s : 1: type_inference.infer 17.75% : 0.000804s : 1: type_inference.specialize ------[replace.] 0.000069 6 69.62% : 0.000048s : 4: replace.inline 30.38% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001007 6 98.87% : 0.000996s : 4: match.inline 1.13% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.32% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 2.06% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.55% : 0.000003s : 15: predicate.partial_eliminate 1.44% : 0.000002s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.59% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.94% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000587 13 54.19% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.68% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.12% : 0.000242s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015282 72 0.39% : 0.000059s : 1: add_recomputation 0.45% : 0.000068s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.14% : 0.000326s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.13% : 0.005827s : 1: jit_opt_a 1.14% : 0.000174s : 1: jit_opt_after_cconv 0.33% : 0.000050s : 1: jit_opt_b 2.68% : 0.000410s : 1: loop_unroll 3.38% : 0.000517s : 1: mutable_eliminate 10.82% : 0.001653s : 26: opt.transform.jit_opt_a 0.49% : 0.000075s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.89% : 0.000442s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000036s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 2.01% : 0.000307s : 1: renormalize.infer 1.82% : 0.000278s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000036s : 1: rewriter_after_opt_a 0.48% : 0.000073s : 1: rewriter_before_opt_a 0.49% : 0.000074s : 1: symbol_engine_optimizer 30.11% : 0.004601s : 1: type_inference TotalTime = 0.022025, [30] [bootstrap]: 0.00036136 [type_inference]: 0.00804064 [event_method]: 1.793e-05 [auto_monad]: 6.56e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 4.109e-05 [rewriter_before_opt_a]: 7.441e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00856089, [2] [Cycle 1]: 0.00483345, [27] [switch_simplify]: 5.163e-05 [loop_unroll]: 2.965e-05 [a_1]: 0.00049133 [with_stream_mark]: 1.787e-05 [recompute_prepare]: 6.43e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 5.49998e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.17999e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.409e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 8.48001e-06 [inline_without_move]: 5.22e-06 [renormalize]: 0.00060247 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.457e-05 [cse]: 2.997e-05 [replace_applicator]: 0.00332321 [Cycle 2]: 0.0003778, [27] [switch_simplify]: 1.132e-05 [loop_unroll]: 5.32001e-06 [a_1]: 9.491e-05 [with_stream_mark]: 1.941e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.89003e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 3.49001e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 7.83001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 4.61002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 2.07999e-06 [auto_monad_grad]: 2.14999e-06 [auto_monad_eliminator]: 1.242e-05 [cse]: 2.602e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.34e-05 [rewriter_after_opt_a]: 3.671e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 4.67e-06 [mutable_eliminate]: 0.00066366 [jit_opt_b]: 4.789e-05, [1] [Cycle 1]: 4.066e-05, [2] [frontend_op_eliminate]: 1.525e-05 [inline_after_opt_a]: 1.481e-05 [cconv]: 2.945e-05 [loop_unroll]: 0.00041539 [jit_opt_after_cconv]: 0.00013527, [1] [Cycle 1]: 0.00012848, [11] [c_1]: 2.009e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 1.99999e-06 [cse]: 1.806e-05 [call_graph_tuple_transform]: 1.859e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 4.95001e-06 [remove_dup_value]: 1.471e-05 [partial_unused_args_eliminate]: 2.39999e-06 [environ_conv]: 5.63002e-06 [add_recomputation]: 4.82e-05 [cse_after_recomputation]: 4.215e-05, [1] [Cycle 1]: 1.573e-05, [1] [cse]: 9.96e-06 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00044906 [symbol_engine_optimizer]: 6.908e-05, [1] [Cycle 1]: 6.303e-05, [6] [build]: 3.00998e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.213e-05 [opt_reshape]: 5.42999e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 3.80009e-07 [validate]: 3.654e-05 Sums bootstrap : 0.000361s : 2.34% type_inference : 0.008041s : 52.08% event_method : 0.000018s : 0.12% auto_monad : 0.000066s : 0.42% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000041s : 0.27% rewriter_before_opt_a : 0.000074s : 0.48% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.41% jit_opt_a.loop_unroll : 0.000035s : 0.23% jit_opt_a.a_1 : 0.000586s : 3.80% jit_opt_a.with_stream_mark : 0.000037s : 0.24% jit_opt_a.recompute_prepare : 0.000012s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.000603s : 3.90% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.17% jit_opt_a.cse : 0.000056s : 0.36% jit_opt_a.replace_applicator : 0.003328s : 21.56% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000037s : 0.24% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000664s : 4.30% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.10% jit_opt_b.inline_after_opt_a : 0.000015s : 0.10% cconv : 0.000029s : 0.19% loop_unroll : 0.000415s : 2.69% jit_opt_after_cconv.c_1 : 0.000020s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000018s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000015s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000048s : 0.31% cse_after_recomputation.cse : 0.000010s : 0.06% auto_monad_reorder : 0.000018s : 0.11% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000449s : 2.91% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.24% Time group info: ------[substitution.] 0.000183 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 1.09% : 0.000002s : 2: substitution.fold_const_symbol 2.90% : 0.000005s : 3: substitution.graph_param_transform 80.87% : 0.000148s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000005s : 4: substitution.remove_not_recompute_node 3.26% : 0.000006s : 2: substitution.replace_old_param 6.47% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007971 2 88.28% : 0.007037s : 1: type_inference.infer 11.72% : 0.000934s : 1: type_inference.specialize ------[replace.] 0.000061 6 66.96% : 0.000041s : 4: replace.inline 33.04% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 93.07% : 0.000145s : 4: match.inline 6.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.50% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.40% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 2.28% : 0.000003s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.55% : 0.000010s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000753 13 58.43% : 0.000440s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.70% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.87% : 0.000278s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026785 72 0.19% : 0.000051s : 1: add_recomputation 0.26% : 0.000069s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 11.07% : 0.002964s : 1: bootstrap 0.12% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000044s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 31.97% : 0.008564s : 1: jit_opt_a 0.51% : 0.000138s : 1: jit_opt_after_cconv 0.19% : 0.000050s : 1: jit_opt_b 1.58% : 0.000423s : 1: loop_unroll 2.51% : 0.000673s : 1: mutable_eliminate 15.34% : 0.004109s : 26: opt.transform.jit_opt_a 0.17% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000024s : 4: opt.transform.jit_opt_b 0.05% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.71% : 0.000457s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.16% : 0.000044s : 1: py_interpret_to_execute 0.06% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000017s : 1: remove_dup_value 1.13% : 0.000304s : 1: renormalize.infer 1.09% : 0.000292s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000039s : 1: rewriter_after_opt_a 0.29% : 0.000077s : 1: rewriter_before_opt_a 0.27% : 0.000072s : 1: symbol_engine_optimizer 30.26% : 0.008105s : 1: type_inference TotalTime = 0.019892, [30] [bootstrap]: 0.0004044 [type_inference]: 0.00712009 [event_method]: 2.183e-05 [auto_monad]: 6.983e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 6.036e-05 [rewriter_before_opt_a]: 8.286e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00967229, [2] [Cycle 1]: 0.00221384, [27] [switch_simplify]: 7.171e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00072942 [with_stream_mark]: 2.371e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.32003e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.43998e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.452e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00100037 [add_forward_monad_depend]: 5.83002e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.615e-05 [cse]: 3.813e-05 [replace_applicator]: 1.287e-05 [Cycle 2]: 0.00034429, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.35001e-06 [a_1]: 0.0001003 [with_stream_mark]: 1.029e-05 [recompute_prepare]: 5.76003e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 2.80002e-06 [cell_reuse_recompute_pass]: 1.98002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.383e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 7.85998e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.466e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.888e-05 [rewriter_after_opt_a]: 4.108e-05 [convert_after_rewriter]: 7.34002e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00072819 [jit_opt_b]: 4.968e-05, [1] [Cycle 1]: 4.339e-05, [2] [frontend_op_eliminate]: 1.626e-05 [inline_after_opt_a]: 1.656e-05 [cconv]: 2.614e-05 [loop_unroll]: 0.0004243 [jit_opt_after_cconv]: 0.00017386, [1] [Cycle 1]: 0.00016779, [11] [c_1]: 4.504e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.62001e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 7.11999e-06 [cse]: 2.227e-05 [call_graph_tuple_transform]: 1.844e-05 [tuple_list_get_item_eliminator]: 6.75002e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.599e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.64e-06 [add_recomputation]: 4.957e-05 [cse_after_recomputation]: 2.389e-05, [1] [Cycle 1]: 1.825e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.684e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.28002e-06 [opt_after_jit_grad]: 0.00052747 [symbol_engine_optimizer]: 8.204e-05, [1] [Cycle 1]: 7.589e-05, [6] [build]: 1.041e-05 [elim_shapecalc]: 9.05001e-06 [elim_not_effective]: 1.34e-05 [opt_reshape]: 5.99999e-06 [fold_const_symbol]: 8.91002e-06 [renormalize]: 5.8001e-07 [validate]: 4.255e-05 Sums bootstrap : 0.000404s : 3.33% type_inference : 0.007120s : 58.55% event_method : 0.000022s : 0.18% auto_monad : 0.000070s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000060s : 0.50% rewriter_before_opt_a : 0.000083s : 0.68% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000078s : 0.64% jit_opt_a.loop_unroll : 0.000036s : 0.30% jit_opt_a.a_1 : 0.000830s : 6.82% jit_opt_a.with_stream_mark : 0.000034s : 0.28% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001000s : 8.23% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.19% jit_opt_a.cse : 0.000053s : 0.43% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000019s : 0.16% rewriter_after_opt_a : 0.000041s : 0.34% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000728s : 5.99% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000026s : 0.21% loop_unroll : 0.000424s : 3.49% jit_opt_after_cconv.c_1 : 0.000045s : 0.37% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000009s : 0.07% add_recomputation : 0.000050s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000527s : 4.34% symbol_engine_optimizer.build : 0.000010s : 0.09% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.35% Time group info: ------[substitution.] 0.000356 23 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.54% : 0.000005s : 3: substitution.graph_param_transform 90.38% : 0.000322s : 4: substitution.inline 0.72% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.20% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000006s : 2: substitution.replace_old_param 3.57% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007040 2 80.14% : 0.005642s : 1: type_inference.infer 19.86% : 0.001398s : 1: type_inference.specialize ------[replace.] 0.000084 6 69.20% : 0.000058s : 4: replace.inline 30.80% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000330 6 96.53% : 0.000319s : 4: match.inline 3.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 0.75% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.86% : 0.000001s : 10: predicate.addn_check_dump 1.07% : 0.000002s : 10: predicate.addn_zero_filter 1.62% : 0.000002s : 10: predicate.arithmetic_simplify 0.96% : 0.000001s : 10: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000002s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.00% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_depend_swap 1.06% : 0.000002s : 10: predicate.environ_get_eliminate 0.89% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000008s : 22: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.93% : 0.000001s : 6: predicate.less_batch_normalization 1.29% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 15: predicate.load_eliminater 0.93% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 10: predicate.merge_addn 0.92% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 17.48% : 0.000025s : 15: predicate.partial_eliminate 1.08% : 0.000002s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.75% : 0.000001s : 6: predicate.specialize_transform 1.11% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.06% : 0.000003s : 16: predicate.switch_defer_inline 1.72% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.62% : 0.000010s : 53: predicate.switch_simplify 1.02% : 0.000001s : 10: predicate.tile_eliminate 1.06% : 0.000002s : 10: predicate.transpose_eliminate 1.27% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.30% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.57% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000922 13 48.48% : 0.000447s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.55% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.97% : 0.000415s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022030 72 0.24% : 0.000053s : 1: add_recomputation 0.34% : 0.000074s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.96% : 0.000432s : 1: bootstrap 0.13% : 0.000029s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000026s : 1: cse_after_recomputation 0.07% : 0.000015s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 43.92% : 0.009676s : 1: jit_opt_a 0.80% : 0.000177s : 1: jit_opt_after_cconv 0.24% : 0.000052s : 1: jit_opt_b 1.96% : 0.000432s : 1: loop_unroll 3.34% : 0.000736s : 1: mutable_eliminate 4.83% : 0.001064s : 26: opt.transform.jit_opt_a 0.33% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.09% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000536s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000064s : 1: py_interpret_to_execute 0.10% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000018s : 1: remove_dup_value 2.51% : 0.000554s : 1: renormalize.infer 1.99% : 0.000438s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000044s : 1: rewriter_after_opt_a 0.39% : 0.000086s : 1: rewriter_before_opt_a 0.38% : 0.000085s : 1: symbol_engine_optimizer 32.41% : 0.007139s : 1: type_inference TotalTime = 0.142761, [30] [bootstrap]: 0.00026074 [type_inference]: 0.131409 [event_method]: 2.479e-05 [auto_monad]: 7.734e-05 [graph_reusing]: 7.11999e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00044151 [rewriter_before_opt_a]: 9.809e-05 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.00794503, [2] [Cycle 1]: 0.00395633, [27] [switch_simplify]: 6.443e-05 [loop_unroll]: 3.564e-05 [a_1]: 0.00071074 [with_stream_mark]: 2.289e-05 [recompute_prepare]: 9.02999e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.72002e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 7.59002e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 7.13998e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.722e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 6.76999e-06 [renormalize]: 0.00274439 [add_forward_monad_depend]: 7.83001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.042e-05 [cse]: 3.955e-05 [replace_applicator]: 1.859e-05 [Cycle 2]: 0.00040265, [27] [switch_simplify]: 7.15998e-06 [loop_unroll]: 6.39999e-06 [a_1]: 0.00012154 [with_stream_mark]: 1.362e-05 [recompute_prepare]: 6.42001e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.79998e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 1.123e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.39999e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 8.83001e-06 [cse]: 1.84e-05 [replace_applicator]: 7.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.495e-05 [rewriter_after_opt_a]: 4.114e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 6.79999e-06 [mutable_eliminate]: 0.00062525 [jit_opt_b]: 5.869e-05, [1] [Cycle 1]: 5.139e-05, [2] [frontend_op_eliminate]: 1.955e-05 [inline_after_opt_a]: 2.015e-05 [cconv]: 3.071e-05 [loop_unroll]: 0.00049176 [jit_opt_after_cconv]: 0.00017517, [1] [Cycle 1]: 0.00016779, [11] [c_1]: 2.674e-05 [parameter_eliminate]: 4.11001e-06 [updatestate_depend_eliminate]: 8.3e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.2e-05 [call_graph_tuple_transform]: 2.334e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.9e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 8.84e-06 [add_recomputation]: 5.312e-05 [cse_after_recomputation]: 2.728e-05, [1] [Cycle 1]: 2.095e-05, [1] [cse]: 1.47e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00049637 [symbol_engine_optimizer]: 0.00013972, [1] [Cycle 1]: 0.00013287, [6] [build]: 3.83001e-06 [elim_shapecalc]: 9.61e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 6.47001e-06 [fold_const_symbol]: 7e-05 [renormalize]: 3.59985e-07 [validate]: 4.955e-05 Sums bootstrap : 0.000261s : 0.19% type_inference : 0.131409s : 94.86% event_method : 0.000025s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000442s : 0.32% rewriter_before_opt_a : 0.000098s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000832s : 0.60% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002744s : 1.98% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.000625s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000492s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000496s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000070s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000335 25 0.56% : 0.000002s : 2: substitution.elim_not_effective 18.00% : 0.000060s : 2: substitution.fold_const_symbol 1.93% : 0.000006s : 4: substitution.graph_param_transform 71.53% : 0.000240s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.57% : 0.000005s : 4: substitution.remove_not_recompute_node 1.48% : 0.000005s : 2: substitution.replace_old_param 3.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131315 2 97.73% : 0.128336s : 1: type_inference.infer 2.27% : 0.002979s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.11% : 0.000068s : 5: replace.inline 31.89% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 7 95.57% : 0.000237s : 5: match.inline 4.43% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.75% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.34% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 6.13% : 0.000009s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.61% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.27% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.80% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 1.61% : 0.000002s : 13: predicate.reduce_eliminate 1.81% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002311 25 64.84% : 0.001499s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.55% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.61% : 0.000731s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146715 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.19% : 0.000272s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 5.42% : 0.007948s : 1: jit_opt_a 0.12% : 0.000179s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.34% : 0.000504s : 1: loop_unroll 0.43% : 0.000638s : 1: mutable_eliminate 0.74% : 0.001093s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000097s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000505s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000448s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.37% : 0.002007s : 1: renormalize.infer 0.49% : 0.000725s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000104s : 1: rewriter_before_opt_a 0.10% : 0.000142s : 1: symbol_engine_optimizer 89.58% : 0.131433s : 1: type_inference TotalTime = 0.156344, [30] [bootstrap]: 0.00044198 [type_inference]: 0.139763 [event_method]: 2.98e-05 [auto_monad]: 9.63e-05 [graph_reusing]: 7.23e-06 [pre_auto_parallel]: 2.68003e-06 [py_interpret_to_execute]: 0.00104019 [rewriter_before_opt_a]: 0.00012487 [expand_dump_flag]: 4.52e-06 [jit_opt_a]: 0.0111192, [2] [Cycle 1]: 0.00595818, [27] [switch_simplify]: 8.375e-05 [loop_unroll]: 3.597e-05 [a_1]: 0.00090061 [with_stream_mark]: 2.895e-05 [recompute_prepare]: 1.179e-05 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 2.76999e-06 [specialize_transform]: 8.11002e-06 [updatestate_useless_node_eliminater]: 6.89999e-06 [accelerated_algorithm]: 7.91001e-06 [meta_shard_fg_expand]: 2.78998e-06 [get_grad_eliminate_]: 8.27998e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.71998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.023e-05 [j_node_and_user_rematch]: 1.246e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.349e-05 [inline_without_move]: 6.85998e-06 [renormalize]: 0.00445619 [add_forward_monad_depend]: 1.14e-05 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 2.171e-05 [cse]: 3.8e-05 [replace_applicator]: 2.742e-05 [Cycle 2]: 0.00045265, [27] [switch_simplify]: 8.20999e-06 [loop_unroll]: 7.46001e-06 [a_1]: 0.00015819 [with_stream_mark]: 1.703e-05 [recompute_prepare]: 7.43e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.40002e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.53e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.93998e-06 [merge_forward]: 5.10999e-06 [cell_reuse_recompute_pass]: 3.94002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.124e-05 [inline_without_move]: 6.24999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.74001e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 6.98998e-06 [cse]: 1.703e-05 [replace_applicator]: 7.56999e-06 [py_interpret_to_execute_after_opt_a]: 2.165e-05 [rewriter_after_opt_a]: 4.367e-05 [convert_after_rewriter]: 7.9e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00094858 [jit_opt_b]: 7.844e-05, [1] [Cycle 1]: 6.486e-05, [2] [frontend_op_eliminate]: 2.578e-05 [inline_after_opt_a]: 2.253e-05 [cconv]: 4.108e-05 [loop_unroll]: 0.00065033 [jit_opt_after_cconv]: 0.00023122, [1] [Cycle 1]: 0.00021968, [11] [c_1]: 3.114e-05 [parameter_eliminate]: 5.89e-06 [updatestate_depend_eliminate]: 1.165e-05 [updatestate_assign_eliminate]: 5.68002e-06 [updatestate_loads_eliminate]: 2.98e-06 [cse]: 4.896e-05 [call_graph_tuple_transform]: 3.144e-05 [tuple_list_get_item_eliminator]: 8.28001e-06 [none_parameter_eliminate]: 2.31e-06 [renormalize]: 1.42e-06 [switch_simplify]: 7.79002e-06 [remove_dup_value]: 2.044e-05 [partial_unused_args_eliminate]: 2.80002e-06 [environ_conv]: 1.82e-05 [add_recomputation]: 6.447e-05 [cse_after_recomputation]: 3.552e-05, [1] [Cycle 1]: 2.533e-05, [1] [cse]: 1.629e-05 [auto_monad_reorder]: 2.147e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 9.63002e-06 [opt_after_jit_grad]: 0.00075718 [symbol_engine_optimizer]: 0.00037759, [1] [Cycle 1]: 0.00036812, [6] [build]: 7.48e-06 [elim_shapecalc]: 1.136e-05 [elim_not_effective]: 0.00027633 [opt_reshape]: 1.105e-05 [fold_const_symbol]: 1.184e-05 [renormalize]: 1.92999e-06 [validate]: 7.723e-05 Sums bootstrap : 0.000442s : 0.29% type_inference : 0.139763s : 92.68% event_method : 0.000030s : 0.02% auto_monad : 0.000096s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001040s : 0.69% rewriter_before_opt_a : 0.000125s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000092s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001059s : 0.70% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004456s : 2.96% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000949s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.02% jit_opt_b.inline_after_opt_a : 0.000023s : 0.01% cconv : 0.000041s : 0.03% loop_unroll : 0.000650s : 0.43% jit_opt_after_cconv.c_1 : 0.000031s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000049s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000018s : 0.01% add_recomputation : 0.000064s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000757s : 0.50% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000276s : 0.18% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000002s : 0.00% validate : 0.000077s : 0.05% Time group info: ------[substitution.] 0.000389 28 0.73% : 0.000003s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000007s : 4: substitution.graph_param_transform 84.94% : 0.000330s : 5: substitution.inline 1.35% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.01% : 0.000016s : 3: substitution.reduce_eliminate 1.50% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000007s : 2: substitution.replace_old_param 3.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139619 2 96.58% : 0.134838s : 1: type_inference.infer 3.42% : 0.004781s : 1: type_inference.specialize ------[replace.] 0.000130 7 70.57% : 0.000092s : 5: replace.inline 29.43% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000338 7 96.67% : 0.000326s : 5: match.inline 3.33% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 886 1.12% : 0.000002s : 13: predicate.accumulaten_eliminater 1.98% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.88% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000004s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.92% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 6.74% : 0.000012s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.78% : 0.000003s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000003s : 19: predicate.load_eliminater 2.01% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.49% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.94% : 0.000003s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 1.97% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000004s : 13: predicate.reduce_eliminate 1.48% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.01% : 0.000002s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.51% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 1.84% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.13% : 0.000012s : 64: predicate.switch_simplify 1.44% : 0.000002s : 13: predicate.tile_eliminate 1.11% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.65% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.33% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.39% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000003s : 13: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003234 25 62.17% : 0.002011s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000105s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.57% : 0.001118s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.162496 72 0.04% : 0.000071s : 1: add_recomputation 0.06% : 0.000102s : 1: auto_monad 0.02% : 0.000031s : 1: auto_monad_reorder 0.29% : 0.000467s : 1: bootstrap 0.03% : 0.000045s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000038s : 1: cse_after_recomputation 0.01% : 0.000021s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 6.85% : 0.011123s : 1: jit_opt_a 0.14% : 0.000235s : 1: jit_opt_after_cconv 0.05% : 0.000082s : 1: jit_opt_b 0.41% : 0.000668s : 1: loop_unroll 0.60% : 0.000967s : 1: mutable_eliminate 0.84% : 0.001363s : 26: opt.transform.jit_opt_a 0.04% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000023s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000028s : 1: opt.transform.mutable_eliminate 0.03% : 0.000043s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000305s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000772s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.65% : 0.001058s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 2.01% : 0.003273s : 1: renormalize.infer 0.72% : 0.001168s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000135s : 1: rewriter_before_opt_a 0.23% : 0.000381s : 1: symbol_engine_optimizer 86.03% : 0.139793s : 1: type_inference TotalTime = 0.0171895, [30] [bootstrap]: 0.00049123 [type_inference]: 0.00670878 [event_method]: 2.173e-05 [auto_monad]: 6.901e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 6.432e-05 [rewriter_before_opt_a]: 8.659e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.00711366, [2] [Cycle 1]: 0.00276211, [27] [switch_simplify]: 6.304e-05 [loop_unroll]: 3.18e-05 [a_1]: 0.00059305 [with_stream_mark]: 0.00054367 [recompute_prepare]: 1.427e-05 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.46998e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 7.56001e-06 [meta_shard_fg_expand]: 2.26003e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.679e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.90002e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 5.69e-06 [renormalize]: 0.00108818 [add_forward_monad_depend]: 7.05e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.929e-05 [cse]: 4.248e-05 [replace_applicator]: 1.676e-05 [Cycle 2]: 0.00036271, [27] [switch_simplify]: 6.31998e-06 [loop_unroll]: 5.56002e-06 [a_1]: 9.294e-05 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 2.21998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.59998e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 8.95999e-06 [cse]: 1.727e-05 [replace_applicator]: 7.59002e-06 [py_interpret_to_execute_after_opt_a]: 2.181e-05 [rewriter_after_opt_a]: 4.396e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00070935 [jit_opt_b]: 5.628e-05, [1] [Cycle 1]: 4.734e-05, [2] [frontend_op_eliminate]: 1.677e-05 [inline_after_opt_a]: 1.769e-05 [cconv]: 3.213e-05 [loop_unroll]: 0.00053569 [jit_opt_after_cconv]: 0.00022, [1] [Cycle 1]: 0.00021104, [11] [c_1]: 2.435e-05 [parameter_eliminate]: 4.17e-06 [updatestate_depend_eliminate]: 8.77999e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.475e-05 [call_graph_tuple_transform]: 2.221e-05 [tuple_list_get_item_eliminator]: 6.97002e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.685e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 1.485e-05 [add_recomputation]: 5.64e-05 [cse_after_recomputation]: 2.629e-05, [1] [Cycle 1]: 2.028e-05, [1] [cse]: 1.376e-05 [auto_monad_reorder]: 1.711e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 6.94001e-06 [opt_after_jit_grad]: 0.00050464 [symbol_engine_optimizer]: 8.475e-05, [1] [Cycle 1]: 7.86e-05, [6] [build]: 1.346e-05 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.407e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 4.2998e-07 [validate]: 4.798e-05 Sums bootstrap : 0.000491s : 3.94% type_inference : 0.006709s : 53.87% event_method : 0.000022s : 0.17% auto_monad : 0.000069s : 0.55% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000064s : 0.52% rewriter_before_opt_a : 0.000087s : 0.70% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.56% jit_opt_a.loop_unroll : 0.000037s : 0.30% jit_opt_a.a_1 : 0.000686s : 5.51% jit_opt_a.with_stream_mark : 0.000557s : 4.48% jit_opt_a.recompute_prepare : 0.000020s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000014s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.001088s : 8.74% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.23% jit_opt_a.cse : 0.000060s : 0.48% jit_opt_a.replace_applicator : 0.000024s : 0.20% py_interpret_to_execute_after_opt_a : 0.000022s : 0.18% rewriter_after_opt_a : 0.000044s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000709s : 5.70% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.14% cconv : 0.000032s : 0.26% loop_unroll : 0.000536s : 4.30% jit_opt_after_cconv.c_1 : 0.000024s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000035s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000015s : 0.12% add_recomputation : 0.000056s : 0.45% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000505s : 4.05% symbol_engine_optimizer.build : 0.000013s : 0.11% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.39% Time group info: ------[substitution.] 0.000255 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 84.33% : 0.000215s : 4: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000006s : 4: substitution.remove_not_recompute_node 2.65% : 0.000007s : 2: substitution.replace_old_param 5.32% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006626 2 78.38% : 0.005194s : 1: type_inference.infer 21.62% : 0.001432s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.96% : 0.000054s : 4: replace.inline 31.04% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 6 94.56% : 0.000212s : 4: match.inline 5.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.09% : 0.000001s : 10: predicate.accumulaten_eliminater 1.49% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.52% : 0.000002s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.10% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.34% : 0.000003s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 15: predicate.load_eliminater 2.75% : 0.000004s : 3: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 3.27% : 0.000004s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.00% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.92% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 1.15% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.81% : 0.000010s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.53% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000949 13 48.91% : 0.000464s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.40% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.69% : 0.000434s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019274 72 0.31% : 0.000060s : 1: add_recomputation 0.38% : 0.000073s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 2.65% : 0.000511s : 1: bootstrap 0.18% : 0.000035s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.09% : 0.000017s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 36.93% : 0.007118s : 1: jit_opt_a 1.16% : 0.000224s : 1: jit_opt_after_cconv 0.31% : 0.000060s : 1: jit_opt_b 2.85% : 0.000550s : 1: loop_unroll 3.75% : 0.000723s : 1: mutable_eliminate 4.86% : 0.000937s : 26: opt.transform.jit_opt_a 0.29% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000020s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000513s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000068s : 1: py_interpret_to_execute 0.13% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 3.13% : 0.000604s : 1: renormalize.infer 2.46% : 0.000474s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000048s : 1: rewriter_after_opt_a 0.47% : 0.000091s : 1: rewriter_before_opt_a 0.45% : 0.000088s : 1: symbol_engine_optimizer 34.92% : 0.006730s : 1: type_inference TotalTime = 0.023854, [30] [bootstrap]: 0.00044996 [type_inference]: 0.0121855 [event_method]: 2.477e-05 [auto_monad]: 7.527e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 5.079e-05 [rewriter_before_opt_a]: 8.593e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0081656, [2] [Cycle 1]: 0.00213405, [27] [switch_simplify]: 7.134e-05 [loop_unroll]: 3.392e-05 [a_1]: 0.00074437 [with_stream_mark]: 2.619e-05 [recompute_prepare]: 7.86001e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.66999e-06 [parameter_eliminate]: 2.47001e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.90002e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.644e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 6.29001e-06 [renormalize]: 0.00087071 [add_forward_monad_depend]: 1.177e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.536e-05 [cse]: 3.584e-05 [replace_applicator]: 1.406e-05 [Cycle 2]: 0.00037897, [27] [switch_simplify]: 7.58001e-06 [loop_unroll]: 5.66e-06 [a_1]: 0.0001104 [with_stream_mark]: 1.11e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 7.99002e-06 [inline_without_move]: 5.35001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.64999e-06 [cse]: 1.433e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.534e-05 [rewriter_after_opt_a]: 4.176e-05 [convert_after_rewriter]: 8.15999e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00076336 [jit_opt_b]: 6.089e-05, [1] [Cycle 1]: 5.134e-05, [2] [frontend_op_eliminate]: 1.815e-05 [inline_after_opt_a]: 1.89e-05 [cconv]: 3.333e-05 [loop_unroll]: 0.00053209 [jit_opt_after_cconv]: 0.00018354, [1] [Cycle 1]: 0.00017569, [11] [c_1]: 2.18e-05 [parameter_eliminate]: 5.45001e-06 [updatestate_depend_eliminate]: 9.27001e-06 [updatestate_assign_eliminate]: 3.73001e-06 [updatestate_loads_eliminate]: 3.00002e-06 [cse]: 3.796e-05 [call_graph_tuple_transform]: 2.368e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.886e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.541e-05 [add_recomputation]: 6.423e-05 [cse_after_recomputation]: 2.887e-05, [1] [Cycle 1]: 2.303e-05, [1] [cse]: 1.448e-05 [auto_monad_reorder]: 1.873e-05 [get_jit_bprop_graph]: 2.64001e-06 [rewriter_after_jit_bprop_graph]: 6.62002e-06 [opt_after_jit_grad]: 0.00063724 [symbol_engine_optimizer]: 8.904e-05, [1] [Cycle 1]: 8.037e-05, [6] [build]: 5.42999e-06 [elim_shapecalc]: 9.66e-06 [elim_not_effective]: 1.568e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 1.022e-05 [renormalize]: 5.69999e-07 [validate]: 4.789e-05 Sums bootstrap : 0.000450s : 2.57% type_inference : 0.012186s : 69.66% event_method : 0.000025s : 0.14% auto_monad : 0.000075s : 0.43% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000051s : 0.29% rewriter_before_opt_a : 0.000086s : 0.49% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000079s : 0.45% jit_opt_a.loop_unroll : 0.000040s : 0.23% jit_opt_a.a_1 : 0.000855s : 4.89% jit_opt_a.with_stream_mark : 0.000037s : 0.21% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.10% jit_opt_a.inline_without_move : 0.000012s : 0.07% jit_opt_a.renormalize : 0.000871s : 4.98% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.13% jit_opt_a.cse : 0.000050s : 0.29% jit_opt_a.replace_applicator : 0.000020s : 0.11% py_interpret_to_execute_after_opt_a : 0.000015s : 0.09% rewriter_after_opt_a : 0.000042s : 0.24% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000763s : 4.36% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.10% jit_opt_b.inline_after_opt_a : 0.000019s : 0.11% cconv : 0.000033s : 0.19% loop_unroll : 0.000532s : 3.04% jit_opt_after_cconv.c_1 : 0.000022s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000038s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000019s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000015s : 0.09% add_recomputation : 0.000064s : 0.37% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000019s : 0.11% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000637s : 3.64% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.27% Time group info: ------[substitution.] 0.000322 27 0.78% : 0.000003s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 3: substitution.graph_param_transform 85.85% : 0.000277s : 5: substitution.inline 1.09% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.51% : 0.000011s : 3: substitution.reduce_eliminate 1.44% : 0.000005s : 4: substitution.remove_not_recompute_node 1.34% : 0.000004s : 2: substitution.replace_old_param 3.57% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012096 2 91.35% : 0.011049s : 1: type_inference.infer 8.65% : 0.001047s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.32% : 0.000070s : 5: replace.inline 31.68% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000284 7 96.38% : 0.000273s : 5: match.inline 3.62% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 11: predicate.addn_check_dump 1.27% : 0.000002s : 11: predicate.addn_zero_filter 2.12% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.08% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000002s : 11: predicate.environ_get_eliminate 1.13% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000002s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 6.08% : 0.000008s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.01% : 0.000003s : 16: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000002s : 11: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 2.08% : 0.000003s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.59% : 0.000002s : 19: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.11% : 0.000011s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.90% : 0.000003s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000935 16 54.11% : 0.000506s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.64% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.25% : 0.000339s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025888 72 0.27% : 0.000069s : 1: add_recomputation 0.31% : 0.000079s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.81% : 0.000468s : 1: bootstrap 0.14% : 0.000036s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.12% : 0.000031s : 1: cse_after_recomputation 0.07% : 0.000018s : 1: environ_conv 0.11% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 31.56% : 0.008169s : 1: jit_opt_a 0.72% : 0.000187s : 1: jit_opt_after_cconv 0.25% : 0.000064s : 1: jit_opt_b 2.10% : 0.000545s : 1: loop_unroll 3.02% : 0.000781s : 1: mutable_eliminate 4.25% : 0.001101s : 26: opt.transform.jit_opt_a 0.21% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000022s : 1: opt.transform.mutable_eliminate 0.11% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.52% : 0.000653s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000054s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000022s : 1: remove_dup_value 1.95% : 0.000506s : 1: renormalize.infer 1.38% : 0.000356s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000045s : 1: rewriter_after_opt_a 0.34% : 0.000089s : 1: rewriter_before_opt_a 0.36% : 0.000092s : 1: symbol_engine_optimizer 47.16% : 0.012208s : 1: type_inference TotalTime = 0.0241466, [30] [bootstrap]: 0.0004959 [type_inference]: 0.0118511 [event_method]: 2.931e-05 [auto_monad]: 9.154e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 8.653e-05 [rewriter_before_opt_a]: 0.00010721 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00815473, [2] [Cycle 1]: 0.00280602, [27] [switch_simplify]: 8.488e-05 [loop_unroll]: 3.774e-05 [a_1]: 0.0008593 [with_stream_mark]: 2.734e-05 [recompute_prepare]: 1.262e-05 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 1.026e-05 [updatestate_useless_node_eliminater]: 6.71e-06 [accelerated_algorithm]: 8.23001e-06 [meta_shard_fg_expand]: 2.98e-06 [get_grad_eliminate_]: 7.97e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.89999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.944e-05 [j_node_and_user_rematch]: 1.17e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.247e-05 [inline_without_move]: 6.99001e-06 [renormalize]: 0.00131599 [add_forward_monad_depend]: 1.092e-05 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 2.509e-05 [cse]: 3.734e-05 [replace_applicator]: 2.499e-05 [Cycle 2]: 0.00040765, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.00011872 [with_stream_mark]: 1.648e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.75002e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 4.54998e-06 [cell_reuse_recompute_pass]: 3.65e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.432e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 5.24e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.62999e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 1.155e-05 [cse]: 1.557e-05 [replace_applicator]: 6.69001e-06 [py_interpret_to_execute_after_opt_a]: 1.823e-05 [rewriter_after_opt_a]: 4.825e-05 [convert_after_rewriter]: 8.52e-06 [order_py_execute_after_rewriter]: 6.01e-06 [mutable_eliminate]: 0.00093522 [jit_opt_b]: 6.747e-05, [1] [Cycle 1]: 5.579e-05, [2] [frontend_op_eliminate]: 2.098e-05 [inline_after_opt_a]: 1.959e-05 [cconv]: 4.021e-05 [loop_unroll]: 0.0006097 [jit_opt_after_cconv]: 0.00023952, [1] [Cycle 1]: 0.00023145, [11] [c_1]: 2.371e-05 [parameter_eliminate]: 6.53e-06 [updatestate_depend_eliminate]: 1.096e-05 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 4.697e-05 [call_graph_tuple_transform]: 2.826e-05 [tuple_list_get_item_eliminator]: 3.427e-05 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 1.29e-06 [switch_simplify]: 8.37e-06 [remove_dup_value]: 2.003e-05 [partial_unused_args_eliminate]: 2.89999e-06 [environ_conv]: 8.95999e-06 [add_recomputation]: 6.156e-05 [cse_after_recomputation]: 3.572e-05, [1] [Cycle 1]: 2.78e-05, [1] [cse]: 1.641e-05 [auto_monad_reorder]: 2.039e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 1.205e-05 [opt_after_jit_grad]: 0.00075697 [symbol_engine_optimizer]: 9.642e-05, [1] [Cycle 1]: 8.634e-05, [6] [build]: 5.50001e-06 [elim_shapecalc]: 9.44e-06 [elim_not_effective]: 1.904e-05 [opt_reshape]: 6.98998e-06 [fold_const_symbol]: 1.153e-05 [renormalize]: 7.59988e-07 [validate]: 5.668e-05 Sums bootstrap : 0.000496s : 2.70% type_inference : 0.011851s : 64.44% event_method : 0.000029s : 0.16% auto_monad : 0.000092s : 0.50% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000087s : 0.47% rewriter_before_opt_a : 0.000107s : 0.58% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000091s : 0.50% jit_opt_a.loop_unroll : 0.000043s : 0.24% jit_opt_a.a_1 : 0.000978s : 5.32% jit_opt_a.with_stream_mark : 0.000044s : 0.24% jit_opt_a.recompute_prepare : 0.000021s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000016s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.06% jit_opt_a.accelerated_algorithm : 0.000014s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.07% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000023s : 0.12% jit_opt_a.inline_without_move : 0.000012s : 0.07% jit_opt_a.renormalize : 0.001316s : 7.16% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.20% jit_opt_a.cse : 0.000053s : 0.29% jit_opt_a.replace_applicator : 0.000032s : 0.17% py_interpret_to_execute_after_opt_a : 0.000018s : 0.10% rewriter_after_opt_a : 0.000048s : 0.26% convert_after_rewriter : 0.000009s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000935s : 5.09% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.11% jit_opt_b.inline_after_opt_a : 0.000020s : 0.11% cconv : 0.000040s : 0.22% loop_unroll : 0.000610s : 3.32% jit_opt_after_cconv.c_1 : 0.000024s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000047s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000034s : 0.19% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.05% remove_dup_value : 0.000020s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000009s : 0.05% add_recomputation : 0.000062s : 0.33% cse_after_recomputation.cse : 0.000016s : 0.09% auto_monad_reorder : 0.000020s : 0.11% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000012s : 0.07% opt_after_jit_grad : 0.000757s : 4.12% symbol_engine_optimizer.build : 0.000006s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.31% Time group info: ------[substitution.] 0.000385 27 0.71% : 0.000003s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 1.66% : 0.000006s : 3: substitution.graph_param_transform 85.06% : 0.000328s : 5: substitution.inline 1.33% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.09% : 0.000016s : 3: substitution.reduce_eliminate 1.48% : 0.000006s : 4: substitution.remove_not_recompute_node 1.74% : 0.000007s : 2: substitution.replace_old_param 3.40% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011731 2 86.13% : 0.010104s : 1: type_inference.infer 13.87% : 0.001627s : 1: type_inference.specialize ------[replace.] 0.000137 7 66.85% : 0.000091s : 5: replace.inline 33.15% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000336 7 96.49% : 0.000324s : 5: match.inline 3.51% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 1.91% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 0.86% : 0.000001s : 11: predicate.addn_check_dump 1.07% : 0.000002s : 11: predicate.addn_zero_filter 2.30% : 0.000004s : 11: predicate.arithmetic_simplify 1.19% : 0.000002s : 11: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 11: predicate.compare_switch_simplify 1.53% : 0.000002s : 11: predicate.depend_value_elim 0.89% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.79% : 0.000003s : 11: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000003s : 11: predicate.environ_add_const_eliminate 0.84% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.87% : 0.000001s : 11: predicate.environ_get_depend_swap 1.13% : 0.000002s : 11: predicate.environ_get_eliminate 0.88% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000002s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.84% : 0.000009s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.29% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 16: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.56% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.89% : 0.000001s : 11: predicate.merge_addn 0.94% : 0.000002s : 11: predicate.minmaximum_grad 3.06% : 0.000005s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 16: predicate.partial_eliminate 0.95% : 0.000002s : 11: predicate.print_const_string_wrapper 3.07% : 0.000005s : 11: predicate.reduce_eliminate 1.64% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 19: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 0.99% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.13% : 0.000002s : 3: predicate.row_tensor_eliminate 0.88% : 0.000001s : 11: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 6: predicate.special_op_eliminate 0.72% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000013s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 0.97% : 0.000002s : 11: predicate.transpose_eliminate 1.12% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.65% : 0.000007s : 19: predicate.tuple_list_get_item_eliminator 1.91% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.11% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 16: predicate.updatestate_pure_node_eliminater 2.21% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.98% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001256 16 47.24% : 0.000593s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.47% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.30% : 0.000556s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026843 72 0.26% : 0.000069s : 1: add_recomputation 0.36% : 0.000096s : 1: auto_monad 0.09% : 0.000024s : 1: auto_monad_reorder 1.95% : 0.000524s : 1: bootstrap 0.16% : 0.000043s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.14% : 0.000038s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.13% : 0.000036s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.40% : 0.008161s : 1: jit_opt_a 0.91% : 0.000245s : 1: jit_opt_after_cconv 0.27% : 0.000071s : 1: jit_opt_b 2.32% : 0.000624s : 1: loop_unroll 3.56% : 0.000956s : 1: mutable_eliminate 4.73% : 0.001269s : 26: opt.transform.jit_opt_a 0.34% : 0.000090s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000033s : 4: opt.transform.jit_opt_b 0.08% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000030s : 1: opt.transform.mutable_eliminate 0.15% : 0.000041s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000043s : 4: opt.transform.symbol_engine_opt 2.87% : 0.000771s : 1: opt_after_jit_grad 0.03% : 0.000009s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000091s : 1: py_interpret_to_execute 0.08% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000024s : 1: remove_dup_value 2.82% : 0.000757s : 1: renormalize.infer 2.03% : 0.000544s : 1: renormalize.specialize 0.05% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000054s : 1: rewriter_after_opt_a 0.42% : 0.000113s : 1: rewriter_before_opt_a 0.37% : 0.000100s : 1: symbol_engine_optimizer 44.25% : 0.011877s : 1: type_inference TotalTime = 0.0155059, [30] [bootstrap]: 0.00030193 [type_inference]: 0.00624488 [event_method]: 2.194e-05 [auto_monad]: 7.168e-05 [graph_reusing]: 6.11998e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 6.168e-05 [rewriter_before_opt_a]: 8.59e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.0061785, [2] [Cycle 1]: 0.00220833, [27] [switch_simplify]: 6.731e-05 [loop_unroll]: 3.223e-05 [a_1]: 0.0006027 [with_stream_mark]: 2.484e-05 [recompute_prepare]: 9.74e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.76999e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.656e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 3.14999e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 5.39e-06 [renormalize]: 0.00101933 [add_forward_monad_depend]: 8.39998e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.923e-05 [cse]: 3.929e-05 [replace_applicator]: 1.893e-05 [Cycle 2]: 0.00035352, [27] [switch_simplify]: 6.06e-06 [loop_unroll]: 5.92001e-06 [a_1]: 9.208e-05 [with_stream_mark]: 1.322e-05 [recompute_prepare]: 5.43002e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.87001e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 8.65999e-06 [cse]: 1.508e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 1.971e-05 [rewriter_after_opt_a]: 4.07e-05 [convert_after_rewriter]: 7.68999e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00068488 [jit_opt_b]: 5.289e-05, [1] [Cycle 1]: 4.461e-05, [2] [frontend_op_eliminate]: 1.623e-05 [inline_after_opt_a]: 1.736e-05 [cconv]: 3.309e-05 [loop_unroll]: 0.00047281 [jit_opt_after_cconv]: 0.00017753, [1] [Cycle 1]: 0.00017009, [11] [c_1]: 2.166e-05 [parameter_eliminate]: 5.65001e-06 [updatestate_depend_eliminate]: 9.61998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 3.384e-05 [call_graph_tuple_transform]: 2.48e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 6.29982e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.733e-05 [partial_unused_args_eliminate]: 2.33002e-06 [environ_conv]: 1.12e-05 [add_recomputation]: 6.005e-05 [cse_after_recomputation]: 2.901e-05, [1] [Cycle 1]: 2.208e-05, [1] [cse]: 1.483e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 7.45e-06 [opt_after_jit_grad]: 0.00053341 [symbol_engine_optimizer]: 9.256e-05, [1] [Cycle 1]: 8.556e-05, [6] [build]: 1.331e-05 [elim_shapecalc]: 8.89998e-06 [elim_not_effective]: 1.698e-05 [opt_reshape]: 6.11e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 1.04e-06 [validate]: 5.342e-05 Sums bootstrap : 0.000302s : 2.71% type_inference : 0.006245s : 55.98% event_method : 0.000022s : 0.20% auto_monad : 0.000072s : 0.64% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000062s : 0.55% rewriter_before_opt_a : 0.000086s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.66% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000695s : 6.23% jit_opt_a.with_stream_mark : 0.000038s : 0.34% jit_opt_a.recompute_prepare : 0.000015s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001019s : 9.14% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.25% jit_opt_a.cse : 0.000054s : 0.49% jit_opt_a.replace_applicator : 0.000025s : 0.23% py_interpret_to_execute_after_opt_a : 0.000020s : 0.18% rewriter_after_opt_a : 0.000041s : 0.36% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000685s : 6.14% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000033s : 0.30% loop_unroll : 0.000473s : 4.24% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000034s : 0.30% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000011s : 0.10% add_recomputation : 0.000060s : 0.54% cse_after_recomputation.cse : 0.000015s : 0.13% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.07% opt_after_jit_grad : 0.000533s : 4.78% symbol_engine_optimizer.build : 0.000013s : 0.12% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000053s : 0.48% Time group info: ------[substitution.] 0.000257 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 85.06% : 0.000218s : 4: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 2.49% : 0.000006s : 2: substitution.replace_old_param 5.25% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006168 2 78.31% : 0.004830s : 1: type_inference.infer 21.69% : 0.001338s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.40% : 0.000054s : 4: replace.inline 31.60% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.60% : 0.000216s : 4: match.inline 5.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.60% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.63% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.40% : 0.000002s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 6: predicate.less_batch_normalization 1.27% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.68% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.93% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.21% : 0.000010s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.98% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000848 13 48.18% : 0.000409s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.90% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.92% : 0.000390s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017518 72 0.37% : 0.000064s : 1: add_recomputation 0.43% : 0.000075s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.84% : 0.000322s : 1: bootstrap 0.20% : 0.000036s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000031s : 1: cse_after_recomputation 0.08% : 0.000014s : 1: environ_conv 0.15% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.29% : 0.006182s : 1: jit_opt_a 1.03% : 0.000181s : 1: jit_opt_after_cconv 0.32% : 0.000056s : 1: jit_opt_b 2.76% : 0.000483s : 1: loop_unroll 3.99% : 0.000699s : 1: mutable_eliminate 5.36% : 0.000940s : 26: opt.transform.jit_opt_a 0.31% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000019s : 1: opt.transform.mutable_eliminate 0.15% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000038s : 4: opt.transform.symbol_engine_opt 3.11% : 0.000545s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000065s : 1: py_interpret_to_execute 0.13% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 3.26% : 0.000572s : 1: renormalize.infer 2.48% : 0.000435s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000044s : 1: rewriter_after_opt_a 0.51% : 0.000089s : 1: rewriter_before_opt_a 0.54% : 0.000095s : 1: symbol_engine_optimizer 35.76% : 0.006265s : 1: type_inference TotalTime = 0.139745, [30] [bootstrap]: 0.00029413 [type_inference]: 0.128722 [event_method]: 2.666e-05 [auto_monad]: 7.657e-05 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00044024 [rewriter_before_opt_a]: 0.00010168 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00775737, [2] [Cycle 1]: 0.00393539, [27] [switch_simplify]: 6.168e-05 [loop_unroll]: 3.32e-05 [a_1]: 0.00067985 [with_stream_mark]: 2.045e-05 [recompute_prepare]: 8.59998e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 9.58002e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.18002e-06 [renormalize]: 0.0027728 [add_forward_monad_depend]: 7.16999e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.735e-05 [cse]: 3.864e-05 [replace_applicator]: 1.786e-05 [Cycle 2]: 0.00037686, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 6.10002e-06 [a_1]: 0.00012172 [with_stream_mark]: 1.252e-05 [recompute_prepare]: 6.22001e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.59001e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 2.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.631e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.389e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.59e-05 [rewriter_after_opt_a]: 4.042e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00065301 [jit_opt_b]: 5.514e-05, [1] [Cycle 1]: 4.83e-05, [2] [frontend_op_eliminate]: 1.868e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 2.839e-05 [loop_unroll]: 0.00042419 [jit_opt_after_cconv]: 0.00015866, [1] [Cycle 1]: 0.00015165, [11] [c_1]: 2.511e-05 [parameter_eliminate]: 3.08998e-06 [updatestate_depend_eliminate]: 6.81999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 2.597e-05 [call_graph_tuple_transform]: 2.111e-05 [tuple_list_get_item_eliminator]: 7e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.924e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 7.99002e-06 [add_recomputation]: 4.999e-05 [cse_after_recomputation]: 2.491e-05, [1] [Cycle 1]: 1.955e-05, [1] [cse]: 1.387e-05 [auto_monad_reorder]: 1.786e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.0004634 [symbol_engine_optimizer]: 7.459e-05, [1] [Cycle 1]: 6.848e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 9.05001e-06 [elim_not_effective]: 1.358e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 9.32001e-06 [renormalize]: 3.00002e-07 [validate]: 6.286e-05 Sums bootstrap : 0.000294s : 0.22% type_inference : 0.128722s : 94.86% event_method : 0.000027s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000440s : 0.32% rewriter_before_opt_a : 0.000102s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000802s : 0.59% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002773s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000653s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000424s : 0.31% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000463s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000063s : 0.05% Time group info: ------[substitution.] 0.000265 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 86.32% : 0.000228s : 5: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_old_param 4.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128634 2 97.81% : 0.125819s : 1: type_inference.infer 2.19% : 0.002815s : 1: type_inference.specialize ------[replace.] 0.000095 7 69.57% : 0.000066s : 5: replace.inline 30.43% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 7 95.10% : 0.000225s : 5: match.inline 4.90% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.77% : 0.000002s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.63% : 0.000008s : 28: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 19: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.72% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 1.81% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.50% : 0.000010s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002900 25 63.76% : 0.001849s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.54% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.71% : 0.000978s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143613 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000315s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.40% : 0.007761s : 1: jit_opt_a 0.11% : 0.000162s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.30% : 0.000432s : 1: loop_unroll 0.46% : 0.000662s : 1: mutable_eliminate 0.73% : 0.001050s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000447s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.23% : 0.001769s : 1: renormalize.infer 0.69% : 0.000994s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000107s : 1: rewriter_before_opt_a 0.05% : 0.000077s : 1: symbol_engine_optimizer 89.65% : 0.128746s : 1: type_inference TotalTime = 0.233057, [30] [bootstrap]: 0.00026709 [type_inference]: 0.222613 [event_method]: 2.018e-05 [auto_monad]: 6.856e-05 [graph_reusing]: 6.33002e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00039266 [rewriter_before_opt_a]: 8.227e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00744608, [2] [Cycle 1]: 0.00341084, [27] [switch_simplify]: 5.356e-05 [loop_unroll]: 3.043e-05 [a_1]: 0.00054789 [with_stream_mark]: 1.582e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 6.77002e-06 [updatestate_useless_node_eliminater]: 5.83997e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.565e-05 [j_node_and_user_rematch]: 1.055e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.81e-06 [renormalize]: 0.00242256 [add_forward_monad_depend]: 6.61e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.589e-05 [cse]: 3.001e-05 [replace_applicator]: 1.487e-05 [Cycle 2]: 0.0003615, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.75001e-06 [a_1]: 0.00011721 [with_stream_mark]: 9.81998e-06 [recompute_prepare]: 5.86998e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.88002e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 8.41002e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.14002e-06 [inline_without_move]: 5.92001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.182e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.136e-05 [rewriter_after_opt_a]: 3.586e-05 [convert_after_rewriter]: 6.70998e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00054142 [jit_opt_b]: 5.66e-05, [1] [Cycle 1]: 5.002e-05, [2] [frontend_op_eliminate]: 2.219e-05 [inline_after_opt_a]: 1.654e-05 [cconv]: 2.481e-05 [loop_unroll]: 0.00041575 [jit_opt_after_cconv]: 0.00014504, [1] [Cycle 1]: 0.00013898, [11] [c_1]: 2.46e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 1.982e-05 [call_graph_tuple_transform]: 2.022e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.457e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 7.71999e-06 [add_recomputation]: 4.883e-05 [cse_after_recomputation]: 2.088e-05, [1] [Cycle 1]: 1.594e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.512e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00045155 [symbol_engine_optimizer]: 7.428e-05, [1] [Cycle 1]: 6.841e-05, [6] [build]: 3.40003e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.381e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 4.90021e-07 [validate]: 8.861e-05 Sums bootstrap : 0.000267s : 0.12% type_inference : 0.222613s : 97.30% event_method : 0.000020s : 0.01% auto_monad : 0.000069s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000393s : 0.17% rewriter_before_opt_a : 0.000082s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000665s : 0.29% jit_opt_a.with_stream_mark : 0.000026s : 0.01% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002423s : 1.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000042s : 0.02% jit_opt_a.replace_applicator : 0.000021s : 0.01% py_interpret_to_execute_after_opt_a : 0.000011s : 0.00% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000541s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000025s : 0.01% loop_unroll : 0.000416s : 0.18% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000049s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000452s : 0.20% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.04% Time group info: ------[substitution.] 0.000195 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 3.05% : 0.000006s : 4: substitution.graph_param_transform 82.13% : 0.000160s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.95% : 0.000006s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 6.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.222539 2 98.65% : 0.219526s : 1: type_inference.infer 1.35% : 0.003014s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.54% : 0.000048s : 4: replace.inline 32.46% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 92.92% : 0.000157s : 4: match.inline 7.08% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000001s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.43% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.54% : 0.000003s : 18: predicate.partial_eliminate 1.33% : 0.000002s : 12: predicate.print_const_string_wrapper 1.53% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.98% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.49% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.63% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000010s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.12% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002244 22 63.27% : 0.001419s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.18% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.55% : 0.000798s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.236389 72 0.02% : 0.000051s : 1: add_recomputation 0.03% : 0.000072s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.12% : 0.000287s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000023s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.15% : 0.007449s : 1: jit_opt_a 0.06% : 0.000149s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.18% : 0.000423s : 1: loop_unroll 0.23% : 0.000549s : 1: mutable_eliminate 0.38% : 0.000892s : 26: opt.transform.jit_opt_a 0.02% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000459s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.17% : 0.000398s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.75% : 0.001780s : 1: renormalize.infer 0.27% : 0.000634s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.04% : 0.000088s : 1: rewriter_before_opt_a 0.03% : 0.000077s : 1: symbol_engine_optimizer 94.18% : 0.222630s : 1: type_inference TotalTime = 0.107502, [30] [bootstrap]: 0.00035354 [type_inference]: 0.0913082 [event_method]: 0.00038202 [auto_monad]: 0.00017548 [graph_reusing]: 9.47001e-06 [pre_auto_parallel]: 3.48999e-06 [py_interpret_to_execute]: 4.892e-05 [rewriter_before_opt_a]: 0.00014521 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.0125795, [2] [Cycle 1]: 0.00788693, [27] [switch_simplify]: 0.00019359 [loop_unroll]: 6.706e-05 [a_1]: 0.00157891 [with_stream_mark]: 2.473e-05 [recompute_prepare]: 9.36e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.48e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 5.98998e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.061e-05 [inline_without_move]: 7.01001e-06 [renormalize]: 0.00559403 [add_forward_monad_depend]: 1.138e-05 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 2.013e-05 [cse]: 3.882e-05 [replace_applicator]: 2.361e-05 [Cycle 2]: 0.00038758, [27] [switch_simplify]: 7.88001e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00011066 [with_stream_mark]: 1.328e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.65002e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 2.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.052e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.77001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.14e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.373e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.781e-05 [rewriter_after_opt_a]: 4.066e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.67001e-06 [mutable_eliminate]: 0.00079738 [jit_opt_b]: 5.722e-05, [1] [Cycle 1]: 4.962e-05, [2] [frontend_op_eliminate]: 1.928e-05 [inline_after_opt_a]: 1.926e-05 [cconv]: 2.769e-05 [loop_unroll]: 0.00045266 [jit_opt_after_cconv]: 0.00015708, [1] [Cycle 1]: 0.00014983, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 2.27e-05 [call_graph_tuple_transform]: 2.099e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 1.30007e-07 [switch_simplify]: 6.79999e-06 [remove_dup_value]: 1.711e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 6.63e-06 [add_recomputation]: 5.152e-05 [cse_after_recomputation]: 2.513e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.03002e-06 [opt_after_jit_grad]: 0.00046242 [symbol_engine_optimizer]: 7.673e-05, [1] [Cycle 1]: 7.033e-05, [6] [build]: 3.72998e-06 [elim_shapecalc]: 7.92998e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 6.28e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 3.00002e-07 [validate]: 4.192e-05 Sums bootstrap : 0.000354s : 0.34% type_inference : 0.091308s : 89.08% event_method : 0.000382s : 0.37% auto_monad : 0.000175s : 0.17% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000049s : 0.05% rewriter_before_opt_a : 0.000145s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000201s : 0.20% jit_opt_a.loop_unroll : 0.000073s : 0.07% jit_opt_a.a_1 : 0.001690s : 1.65% jit_opt_a.with_stream_mark : 0.000038s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005594s : 5.46% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000053s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000797s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000453s : 0.44% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000462s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000665 35 0.30% : 0.000002s : 2: substitution.elim_not_effective 0.26% : 0.000002s : 2: substitution.fold_const_symbol 0.86% : 0.000006s : 3: substitution.graph_param_transform 91.12% : 0.000606s : 12: substitution.inline 0.74% : 0.000005s : 4: substitution.j_node_and_user_rematch 0.81% : 0.000005s : 4: substitution.remove_not_recompute_node 0.98% : 0.000007s : 2: substitution.replace_old_param 1.37% : 0.000009s : 1: substitution.reshape_eliminate 1.82% : 0.000012s : 3: substitution.switch_simplify 1.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.091211 2 96.05% : 0.087610s : 1: type_inference.infer 3.95% : 0.003601s : 1: type_inference.specialize ------[replace.] 0.000319 18 52.59% : 0.000168s : 12: replace.inline 1.64% : 0.000005s : 1: replace.reshape_eliminate 20.80% : 0.000066s : 3: replace.switch_simplify 24.97% : 0.000080s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000628 18 95.36% : 0.000599s : 12: match.inline 1.30% : 0.000008s : 1: match.reshape_eliminate 1.67% : 0.000011s : 3: match.switch_simplify 1.67% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000234 1212 1.39% : 0.000003s : 19: predicate.accumulaten_eliminater 0.50% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000003s : 19: predicate.addn_check_dump 1.33% : 0.000003s : 19: predicate.addn_zero_filter 10.72% : 0.000025s : 19: predicate.arithmetic_simplify 1.35% : 0.000003s : 20: predicate.cast_eliminate 0.20% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000003s : 19: predicate.compare_switch_simplify 1.21% : 0.000003s : 19: predicate.depend_value_elim 1.14% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.42% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.22% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.40% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.16% : 0.000000s : 3: predicate.elim_not_effective 0.26% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.25% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.28% : 0.000003s : 20: predicate.environ_get_depend_swap 1.32% : 0.000003s : 20: predicate.environ_get_eliminate 1.20% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.61% : 0.000001s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.11% : 0.000012s : 40: predicate.inline 0.53% : 0.000001s : 6: predicate.inline_without_move 0.20% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.78% : 0.000004s : 25: predicate.load_eliminater 0.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.55% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.11% : 0.000003s : 19: predicate.merge_addn 1.16% : 0.000003s : 19: predicate.minmaximum_grad 1.17% : 0.000003s : 3: predicate.mutable_eliminate 0.26% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000005s : 25: predicate.partial_eliminate 1.26% : 0.000003s : 19: predicate.print_const_string_wrapper 1.82% : 0.000004s : 19: predicate.reduce_eliminate 1.57% : 0.000004s : 22: predicate.redundant_stop_gradient_eliminater 0.33% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000003s : 28: predicate.replace_applicator 0.33% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000001s : 3: predicate.reset_defer_inline 1.76% : 0.000004s : 20: predicate.reshape_eliminate 1.20% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.55% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000003s : 19: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.62% : 0.000001s : 6: predicate.special_op_eliminate 0.51% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.23% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000006s : 34: predicate.switch_defer_inline 2.32% : 0.000005s : 34: predicate.switch_layer_defer_inline 7.57% : 0.000018s : 107: predicate.switch_simplify 1.25% : 0.000003s : 19: predicate.tile_eliminate 1.25% : 0.000003s : 19: predicate.transpose_eliminate 1.74% : 0.000004s : 20: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000004s : 20: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.82% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.42% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.47% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.36% : 0.000006s : 31: predicate.updatestate_useless_node_eliminater 1.61% : 0.000004s : 19: predicate.value_based_eliminate 0.16% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004287 40 63.95% : 0.002742s : 21: func_graph_cloner_run.FuncGraphClonerGraph 7.91% : 0.000339s : 5: func_graph_cloner_run.FuncGraphClonerNode 28.14% : 0.001206s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115255 72 0.05% : 0.000054s : 1: add_recomputation 0.16% : 0.000185s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.32% : 0.000374s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.34% : 0.000393s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 10.92% : 0.012584s : 1: jit_opt_a 0.14% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.40% : 0.000462s : 1: loop_unroll 0.70% : 0.000807s : 1: mutable_eliminate 1.83% : 0.002112s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000052s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 3.98% : 0.004585s : 1: renormalize.infer 0.86% : 0.000994s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.13% : 0.000149s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 79.25% : 0.091335s : 1: type_inference TotalTime = 0.0163785, [30] [bootstrap]: 0.00028905 [type_inference]: 0.00842163 [event_method]: 2.319e-05 [auto_monad]: 6.867e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 4.572e-05 [rewriter_before_opt_a]: 8.595e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00522968, [2] [Cycle 1]: 0.00176722, [27] [switch_simplify]: 5.84e-05 [loop_unroll]: 3.472e-05 [a_1]: 0.00062244 [with_stream_mark]: 1.875e-05 [recompute_prepare]: 7.36001e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00069845 [add_forward_monad_depend]: 5.05999e-06 [auto_monad_grad]: 2.07001e-06 [auto_monad_eliminator]: 1.388e-05 [cse]: 3.894e-05 [replace_applicator]: 1.157e-05 [Cycle 2]: 0.00032017, [27] [switch_simplify]: 5.94999e-06 [loop_unroll]: 5.13002e-06 [a_1]: 8.879e-05 [with_stream_mark]: 9.00001e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.75997e-06 [updatestate_assign_eliminate]: 2.70997e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 4.92999e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.48e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 1.159e-05 [rewriter_after_opt_a]: 3.714e-05 [convert_after_rewriter]: 6.64001e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00048955 [jit_opt_b]: 4.855e-05, [1] [Cycle 1]: 4.183e-05, [2] [frontend_op_eliminate]: 1.519e-05 [inline_after_opt_a]: 1.548e-05 [cconv]: 2.392e-05 [loop_unroll]: 0.00040841 [jit_opt_after_cconv]: 0.00015039, [1] [Cycle 1]: 0.0001443, [11] [c_1]: 2.026e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.28002e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.35e-05 [call_graph_tuple_transform]: 2.555e-05 [tuple_list_get_item_eliminator]: 5.28002e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.58997e-06 [remove_dup_value]: 3.148e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 5.91998e-06 [add_recomputation]: 4.879e-05 [cse_after_recomputation]: 2.464e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.726e-05 [get_jit_bprop_graph]: 1.59e-06 [rewriter_after_jit_bprop_graph]: 4.19002e-06 [opt_after_jit_grad]: 0.00059278 [symbol_engine_optimizer]: 7.672e-05, [1] [Cycle 1]: 7.013e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 6.07001e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 4.39992e-07 [validate]: 3.905e-05 Sums bootstrap : 0.000289s : 2.28% type_inference : 0.008422s : 66.54% event_method : 0.000023s : 0.18% auto_monad : 0.000069s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.36% rewriter_before_opt_a : 0.000086s : 0.68% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000064s : 0.51% jit_opt_a.loop_unroll : 0.000040s : 0.31% jit_opt_a.a_1 : 0.000711s : 5.62% jit_opt_a.with_stream_mark : 0.000028s : 0.22% jit_opt_a.recompute_prepare : 0.000012s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000699s : 5.52% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.15% jit_opt_a.cse : 0.000054s : 0.42% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000037s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000490s : 3.87% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.12% cconv : 0.000024s : 0.19% loop_unroll : 0.000408s : 3.23% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000031s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000049s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000593s : 4.68% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.31% Time group info: ------[substitution.] 0.000236 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000005s : 3: substitution.graph_param_transform 86.20% : 0.000203s : 5: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000004s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 5.39% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008349 2 87.55% : 0.007309s : 1: type_inference.infer 12.45% : 0.001040s : 1: type_inference.specialize ------[replace.] 0.000090 7 68.26% : 0.000061s : 5: replace.inline 31.74% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 7 94.56% : 0.000200s : 5: match.inline 5.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.35% : 0.000002s : 11: predicate.accumulaten_eliminater 1.45% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.36% : 0.000002s : 11: predicate.addn_zero_filter 1.94% : 0.000002s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.30% : 0.000002s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.35% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.86% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 16: predicate.load_eliminater 1.00% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.44% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.22% : 0.000001s : 11: predicate.minmaximum_grad 1.15% : 0.000001s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 1.57% : 0.000002s : 11: predicate.reduce_eliminate 1.52% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.54% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.41% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000785 16 52.62% : 0.000413s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.84% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.53% : 0.000310s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018069 72 0.29% : 0.000052s : 1: add_recomputation 0.40% : 0.000072s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.69% : 0.000306s : 1: bootstrap 0.15% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.16% : 0.000028s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 28.96% : 0.005233s : 1: jit_opt_a 0.85% : 0.000153s : 1: jit_opt_after_cconv 0.28% : 0.000051s : 1: jit_opt_b 2.30% : 0.000416s : 1: loop_unroll 2.76% : 0.000498s : 1: mutable_eliminate 5.15% : 0.000931s : 26: opt.transform.jit_opt_a 0.30% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000012s : 1: opt.transform.mutable_eliminate 0.13% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.33% : 0.000602s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000049s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000034s : 1: remove_dup_value 2.22% : 0.000401s : 1: renormalize.infer 1.61% : 0.000290s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000040s : 1: rewriter_after_opt_a 0.49% : 0.000089s : 1: rewriter_before_opt_a 0.44% : 0.000079s : 1: symbol_engine_optimizer 46.71% : 0.008440s : 1: type_inference TotalTime = 0.142195, [30] [bootstrap]: 0.00036441 [type_inference]: 0.126804 [event_method]: 2.784e-05 [auto_monad]: 8.49e-05 [graph_reusing]: 7.4e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 0.00070281 [rewriter_before_opt_a]: 0.00011343 [expand_dump_flag]: 4.2e-06 [jit_opt_a]: 0.0105182, [2] [Cycle 1]: 0.00564743, [27] [switch_simplify]: 8.492e-05 [loop_unroll]: 3.776e-05 [a_1]: 0.00087111 [with_stream_mark]: 2.601e-05 [recompute_prepare]: 1.156e-05 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 9.67999e-06 [updatestate_useless_node_eliminater]: 7.45998e-06 [accelerated_algorithm]: 8.64e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 7.68001e-06 [merge_forward]: 4.39998e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.759e-05 [j_node_and_user_rematch]: 1.191e-05 [meta_fg_expand]: 3.2e-06 [replace_old_param]: 1.256e-05 [inline_without_move]: 6.95002e-06 [renormalize]: 0.00413319 [add_forward_monad_depend]: 1.29e-05 [auto_monad_grad]: 3.29001e-06 [auto_monad_eliminator]: 2.598e-05 [cse]: 4.377e-05 [replace_applicator]: 3.062e-05 [Cycle 2]: 0.00051914, [27] [switch_simplify]: 8.18001e-06 [loop_unroll]: 8.07e-06 [a_1]: 0.00018455 [with_stream_mark]: 2.013e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 5.29998e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.66e-06 [accelerated_algorithm]: 7.96001e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 4.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 1.13e-05 [meta_fg_expand]: 3.94002e-06 [replace_old_param]: 1.156e-05 [inline_without_move]: 6.58e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.29999e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 1.014e-05 [cse]: 2.2e-05 [replace_applicator]: 8.55001e-06 [py_interpret_to_execute_after_opt_a]: 2.312e-05 [rewriter_after_opt_a]: 4.91e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 6.21998e-06 [mutable_eliminate]: 0.00098374 [jit_opt_b]: 7.431e-05, [1] [Cycle 1]: 6.467e-05, [2] [frontend_op_eliminate]: 2.55e-05 [inline_after_opt_a]: 2.207e-05 [cconv]: 3.848e-05 [loop_unroll]: 0.00061902 [jit_opt_after_cconv]: 0.0002234, [1] [Cycle 1]: 0.00021411, [11] [c_1]: 3.405e-05 [parameter_eliminate]: 5.92001e-06 [updatestate_depend_eliminate]: 1.106e-05 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 5.59998e-06 [cse]: 4.419e-05 [call_graph_tuple_transform]: 3.04e-05 [tuple_list_get_item_eliminator]: 9.37999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 7.43999e-06 [remove_dup_value]: 1.776e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 1.234e-05 [add_recomputation]: 6.245e-05 [cse_after_recomputation]: 3.932e-05, [1] [Cycle 1]: 3.229e-05, [1] [cse]: 2.279e-05 [auto_monad_reorder]: 1.975e-05 [get_jit_bprop_graph]: 2.90998e-06 [rewriter_after_jit_bprop_graph]: 8.38999e-06 [opt_after_jit_grad]: 0.00069459 [symbol_engine_optimizer]: 0.00033704, [1] [Cycle 1]: 0.00032737, [6] [build]: 6.16e-06 [elim_shapecalc]: 1.835e-05 [elim_not_effective]: 2.195e-05 [opt_reshape]: 7.73999e-06 [fold_const_symbol]: 0.0002344 [renormalize]: 1.25001e-06 [validate]: 6.831e-05 Sums bootstrap : 0.000364s : 0.27% type_inference : 0.126804s : 92.55% event_method : 0.000028s : 0.02% auto_monad : 0.000085s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000703s : 0.51% rewriter_before_opt_a : 0.000113s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.07% jit_opt_a.loop_unroll : 0.000046s : 0.03% jit_opt_a.a_1 : 0.001056s : 0.77% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.01% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004133s : 3.02% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.03% jit_opt_a.cse : 0.000066s : 0.05% jit_opt_a.replace_applicator : 0.000039s : 0.03% py_interpret_to_execute_after_opt_a : 0.000023s : 0.02% rewriter_after_opt_a : 0.000049s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000984s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000038s : 0.03% loop_unroll : 0.000619s : 0.45% jit_opt_after_cconv.c_1 : 0.000034s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000062s : 0.05% cse_after_recomputation.cse : 0.000023s : 0.02% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000695s : 0.51% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000018s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000234s : 0.17% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.05% Time group info: ------[substitution.] 0.000372 28 0.53% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000008s : 4: substitution.graph_param_transform 83.55% : 0.000311s : 5: substitution.inline 1.52% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.79% : 0.000018s : 3: substitution.reduce_eliminate 1.45% : 0.000005s : 4: substitution.remove_not_recompute_node 2.01% : 0.000007s : 2: substitution.replace_old_param 3.66% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126681 2 96.92% : 0.122784s : 1: type_inference.infer 3.08% : 0.003897s : 1: type_inference.specialize ------[replace.] 0.000125 7 70.80% : 0.000089s : 5: replace.inline 29.20% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000319 7 96.37% : 0.000307s : 5: match.inline 3.63% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000191 886 1.18% : 0.000002s : 13: predicate.accumulaten_eliminater 1.50% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 13: predicate.addn_check_dump 1.15% : 0.000002s : 13: predicate.addn_zero_filter 2.41% : 0.000005s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 0.92% : 0.000002s : 13: predicate.compare_switch_simplify 0.99% : 0.000002s : 13: predicate.depend_value_elim 0.90% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.91% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.44% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_depend_swap 1.06% : 0.000002s : 13: predicate.environ_get_eliminate 0.90% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.45% : 0.000010s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.22% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 9.69% : 0.000018s : 19: predicate.load_eliminater 1.38% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.41% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 13: predicate.merge_addn 0.87% : 0.000002s : 13: predicate.minmaximum_grad 1.79% : 0.000003s : 4: predicate.mutable_eliminate 0.39% : 0.000001s : 4: predicate.opt_reshape 1.83% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.22% : 0.000004s : 13: predicate.reduce_eliminate 1.84% : 0.000004s : 15: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000004s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000002s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.51% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000002s : 8: predicate.specialize_transform 1.45% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.07% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000004s : 20: predicate.switch_defer_inline 1.89% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.28% : 0.000012s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.07% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.11% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.42% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.38% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000003s : 13: predicate.value_based_eliminate 0.26% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003809 25 69.30% : 0.002640s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.74% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.96% : 0.001065s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148008 72 0.05% : 0.000067s : 1: add_recomputation 0.06% : 0.000090s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.26% : 0.000382s : 1: bootstrap 0.03% : 0.000041s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000041s : 1: cse_after_recomputation 0.01% : 0.000018s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.11% : 0.010524s : 1: jit_opt_a 0.16% : 0.000230s : 1: jit_opt_after_cconv 0.05% : 0.000078s : 1: jit_opt_b 0.43% : 0.000631s : 1: loop_unroll 0.68% : 0.000999s : 1: mutable_eliminate 0.93% : 0.001371s : 26: opt.transform.jit_opt_a 0.05% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000031s : 1: opt.transform.mutable_eliminate 0.03% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000271s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000707s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000713s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.97% : 0.002909s : 1: renormalize.infer 0.82% : 0.001208s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000054s : 1: rewriter_after_opt_a 0.08% : 0.000120s : 1: rewriter_before_opt_a 0.23% : 0.000341s : 1: symbol_engine_optimizer 85.70% : 0.126837s : 1: type_inference TotalTime = 0.206526, [30] [bootstrap]: 0.00028864 [type_inference]: 0.194969 [event_method]: 2.458e-05 [auto_monad]: 7.54e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 0.0004386 [rewriter_before_opt_a]: 9.728e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00803529, [2] [Cycle 1]: 0.00420416, [27] [switch_simplify]: 6.305e-05 [loop_unroll]: 3.485e-05 [a_1]: 0.00072715 [with_stream_mark]: 2.082e-05 [recompute_prepare]: 9.99001e-06 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 3.73001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 8.07998e-06 [updatestate_useless_node_eliminater]: 6.64999e-06 [accelerated_algorithm]: 6.86001e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 7.91001e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.639e-05 [j_node_and_user_rematch]: 1.084e-05 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 1.108e-05 [inline_without_move]: 6.73e-06 [renormalize]: 0.00294834 [add_forward_monad_depend]: 9.40001e-06 [auto_monad_grad]: 2.55002e-06 [auto_monad_eliminator]: 2.198e-05 [cse]: 3.746e-05 [replace_applicator]: 2.254e-05 [Cycle 2]: 0.00041973, [27] [switch_simplify]: 7.58001e-06 [loop_unroll]: 6.60002e-06 [a_1]: 0.00014664 [with_stream_mark]: 1.521e-05 [recompute_prepare]: 6.89001e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.82002e-06 [get_grad_eliminate_]: 5.71003e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 3.28e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.032e-05 [inline_without_move]: 5.94e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.456e-05 [replace_applicator]: 7.26999e-06 [py_interpret_to_execute_after_opt_a]: 1.662e-05 [rewriter_after_opt_a]: 4.219e-05 [convert_after_rewriter]: 7.63999e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00071358 [jit_opt_b]: 6.062e-05, [1] [Cycle 1]: 5.189e-05, [2] [frontend_op_eliminate]: 2.057e-05 [inline_after_opt_a]: 2.002e-05 [cconv]: 3.555e-05 [loop_unroll]: 0.00051894 [jit_opt_after_cconv]: 0.00018955, [1] [Cycle 1]: 0.00018291, [11] [c_1]: 2.863e-05 [parameter_eliminate]: 4.89003e-06 [updatestate_depend_eliminate]: 9.09e-06 [updatestate_assign_eliminate]: 3.10998e-06 [updatestate_loads_eliminate]: 4.08001e-06 [cse]: 3.764e-05 [call_graph_tuple_transform]: 2.761e-05 [tuple_list_get_item_eliminator]: 7.73999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.845e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 1.122e-05 [add_recomputation]: 5.618e-05 [cse_after_recomputation]: 2.503e-05, [1] [Cycle 1]: 1.982e-05, [1] [cse]: 1.36e-05 [auto_monad_reorder]: 1.814e-05 [get_jit_bprop_graph]: 2.68e-06 [rewriter_after_jit_bprop_graph]: 7.4e-06 [opt_after_jit_grad]: 0.00051586 [symbol_engine_optimizer]: 8.049e-05, [1] [Cycle 1]: 7.384e-05, [6] [build]: 5.54998e-06 [elim_shapecalc]: 9.83998e-06 [elim_not_effective]: 1.381e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.97999e-06 [renormalize]: 6.59988e-07 [validate]: 5.628e-05 Sums bootstrap : 0.000289s : 0.14% type_inference : 0.194969s : 96.30% event_method : 0.000025s : 0.01% auto_monad : 0.000075s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000439s : 0.22% rewriter_before_opt_a : 0.000097s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000874s : 0.43% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002948s : 1.46% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000714s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000036s : 0.02% loop_unroll : 0.000519s : 0.26% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000516s : 0.25% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.03% Time group info: ------[substitution.] 0.000286 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000008s : 4: substitution.graph_param_transform 82.53% : 0.000236s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.76% : 0.000014s : 3: substitution.reduce_eliminate 1.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000006s : 2: substitution.replace_old_param 3.85% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.194884 2 98.48% : 0.191931s : 1: type_inference.infer 1.52% : 0.002953s : 1: type_inference.specialize ------[replace.] 0.000099 7 69.28% : 0.000068s : 5: replace.inline 30.72% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 96.00% : 0.000233s : 5: match.inline 4.00% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.54% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.69% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.30% : 0.000002s : 13: predicate.minmaximum_grad 1.75% : 0.000003s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.09% : 0.000003s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.13% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.12% : 0.000011s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002535 25 60.37% : 0.001530s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.03% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.60% : 0.000928s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.210714 72 0.03% : 0.000059s : 1: add_recomputation 0.04% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.14% : 0.000302s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.82% : 0.008040s : 1: jit_opt_a 0.09% : 0.000194s : 1: jit_opt_after_cconv 0.03% : 0.000063s : 1: jit_opt_b 0.25% : 0.000530s : 1: loop_unroll 0.34% : 0.000726s : 1: mutable_eliminate 0.54% : 0.001140s : 26: opt.transform.jit_opt_a 0.03% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000043s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000525s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000446s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.92% : 0.001935s : 1: renormalize.infer 0.48% : 0.001001s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.05% : 0.000103s : 1: rewriter_before_opt_a 0.04% : 0.000083s : 1: symbol_engine_optimizer 92.54% : 0.194992s : 1: type_inference TotalTime = 0.120564, [30] [bootstrap]: 0.00029022 [type_inference]: 0.110146 [event_method]: 1.941e-05 [auto_monad]: 7.088e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00043761 [rewriter_before_opt_a]: 8.674e-05 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.00713619, [2] [Cycle 1]: 0.00354848, [27] [switch_simplify]: 0.00011822 [loop_unroll]: 3.062e-05 [a_1]: 0.00055934 [with_stream_mark]: 1.756e-05 [recompute_prepare]: 8.33001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 7e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.562e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.30001e-06 [inline_without_move]: 6.21e-06 [renormalize]: 0.0024767 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.59e-05 [cse]: 3.167e-05 [replace_applicator]: 1.485e-05 [Cycle 2]: 0.00036004, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 5.59e-06 [a_1]: 0.00011993 [with_stream_mark]: 1.003e-05 [recompute_prepare]: 5.60001e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.82e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.174e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.174e-05 [rewriter_after_opt_a]: 3.591e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00062493 [jit_opt_b]: 5.433e-05, [1] [Cycle 1]: 4.715e-05, [2] [frontend_op_eliminate]: 1.927e-05 [inline_after_opt_a]: 1.716e-05 [cconv]: 2.412e-05 [loop_unroll]: 0.00043229 [jit_opt_after_cconv]: 0.00014823, [1] [Cycle 1]: 0.00014189, [11] [c_1]: 2.514e-05 [parameter_eliminate]: 2.02001e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.085e-05 [call_graph_tuple_transform]: 2.085e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 7.41001e-06 [add_recomputation]: 5.17e-05 [cse_after_recomputation]: 2.276e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.16e-05 [auto_monad_reorder]: 1.659e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 4.41002e-06 [opt_after_jit_grad]: 0.00048869 [symbol_engine_optimizer]: 0.00017451, [1] [Cycle 1]: 0.00016775, [6] [build]: 3.46001e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 0.00010622 [renormalize]: 4.80009e-07 [validate]: 4.785e-05 Sums bootstrap : 0.000290s : 0.25% type_inference : 0.110146s : 94.35% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000438s : 0.37% rewriter_before_opt_a : 0.000087s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000125s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000679s : 0.58% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002477s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000625s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000432s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000489s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000106s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000296 24 0.54% : 0.000002s : 2: substitution.elim_not_effective 32.73% : 0.000097s : 2: substitution.fold_const_symbol 2.30% : 0.000007s : 4: substitution.graph_param_transform 56.28% : 0.000167s : 4: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.29% : 0.000004s : 2: substitution.replace_old_param 3.93% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110053 2 97.32% : 0.107103s : 1: type_inference.infer 2.68% : 0.002950s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.27% : 0.000049s : 4: replace.inline 31.73% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.97% : 0.000164s : 4: match.inline 6.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 1.71% : 0.000002s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.21% : 0.000002s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.16% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.54% : 0.000010s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000001s : 12: predicate.transpose_eliminate 1.57% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002422 22 66.23% : 0.001604s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.15% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.62% : 0.000790s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124170 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000310s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.75% : 0.007139s : 1: jit_opt_a 0.12% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.35% : 0.000441s : 1: loop_unroll 0.51% : 0.000634s : 1: mutable_eliminate 0.78% : 0.000972s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000131s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000497s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000443s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.43% : 0.001774s : 1: renormalize.infer 0.56% : 0.000694s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.14% : 0.000177s : 1: symbol_engine_optimizer 88.72% : 0.110163s : 1: type_inference TotalTime = 0.1136, [30] [bootstrap]: 0.00033666 [type_inference]: 0.088301 [event_method]: 0.00051079 [auto_monad]: 0.0002072 [graph_reusing]: 9.61998e-06 [pre_auto_parallel]: 3.78001e-06 [py_interpret_to_execute]: 5.426e-05 [rewriter_before_opt_a]: 0.00016331 [expand_dump_flag]: 4.77e-06 [jit_opt_a]: 0.0215534, [2] [Cycle 1]: 0.00475706, [27] [switch_simplify]: 0.00020595 [loop_unroll]: 6.637e-05 [a_1]: 0.00153667 [with_stream_mark]: 2.393e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.57002e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 9.90025e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.622e-05 [j_node_and_user_rematch]: 1.133e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.75002e-06 [renormalize]: 0.00253761 [add_forward_monad_depend]: 6.42001e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.79e-05 [cse]: 3.671e-05 [replace_applicator]: 1.61e-05 [Cycle 2]: 0.00034358, [27] [switch_simplify]: 6.20002e-06 [loop_unroll]: 5.47001e-06 [a_1]: 9.752e-05 [with_stream_mark]: 1.099e-05 [recompute_prepare]: 5.31998e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.43002e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 4.93001e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 8.54002e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.375e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.561e-05 [rewriter_after_opt_a]: 5.095e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00068993 [jit_opt_b]: 5.285e-05, [1] [Cycle 1]: 4.486e-05, [2] [frontend_op_eliminate]: 1.682e-05 [inline_after_opt_a]: 1.677e-05 [cconv]: 2.68e-05 [loop_unroll]: 0.00044261 [jit_opt_after_cconv]: 0.00015444, [1] [Cycle 1]: 0.00014656, [11] [c_1]: 2.208e-05 [parameter_eliminate]: 2.81999e-06 [updatestate_depend_eliminate]: 7.15e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.46e-05 [call_graph_tuple_transform]: 2.037e-05 [tuple_list_get_item_eliminator]: 5.99999e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.10002e-06 [remove_dup_value]: 1.641e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 6.43003e-06 [add_recomputation]: 5.005e-05 [cse_after_recomputation]: 2.316e-05, [1] [Cycle 1]: 1.784e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.38002e-06 [opt_after_jit_grad]: 0.00047148 [symbol_engine_optimizer]: 8.33e-05, [1] [Cycle 1]: 7.517e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 8.91002e-06 [elim_not_effective]: 1.495e-05 [opt_reshape]: 8.12e-06 [fold_const_symbol]: 8.83001e-06 [renormalize]: 3.09985e-07 [validate]: 0.00011434 Sums bootstrap : 0.000337s : 0.35% type_inference : 0.088301s : 91.52% event_method : 0.000511s : 0.53% auto_monad : 0.000207s : 0.21% graph_reusing : 0.000010s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000054s : 0.06% rewriter_before_opt_a : 0.000163s : 0.17% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000212s : 0.22% jit_opt_a.loop_unroll : 0.000072s : 0.07% jit_opt_a.a_1 : 0.001634s : 1.69% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002538s : 2.63% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000050s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000051s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000690s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000443s : 0.46% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000471s : 0.49% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000114s : 0.12% Time group info: ------[substitution.] 0.000658 35 0.35% : 0.000002s : 2: substitution.elim_not_effective 0.22% : 0.000001s : 2: substitution.fold_const_symbol 0.83% : 0.000005s : 3: substitution.graph_param_transform 91.17% : 0.000600s : 12: substitution.inline 0.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.79% : 0.000005s : 4: substitution.remove_not_recompute_node 0.81% : 0.000005s : 2: substitution.replace_old_param 1.49% : 0.000010s : 1: substitution.reshape_eliminate 2.12% : 0.000014s : 3: substitution.switch_simplify 1.71% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.088192 2 95.89% : 0.084564s : 1: type_inference.infer 4.11% : 0.003628s : 1: type_inference.specialize ------[replace.] 0.000318 18 51.81% : 0.000165s : 12: replace.inline 1.52% : 0.000005s : 1: replace.reshape_eliminate 21.35% : 0.000068s : 3: replace.switch_simplify 25.32% : 0.000081s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000625 18 94.98% : 0.000594s : 12: match.inline 1.42% : 0.000009s : 1: match.reshape_eliminate 1.98% : 0.000012s : 3: match.switch_simplify 1.62% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000201 1212 1.38% : 0.000003s : 19: predicate.accumulaten_eliminater 0.64% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 19: predicate.addn_check_dump 1.41% : 0.000003s : 19: predicate.addn_zero_filter 2.47% : 0.000005s : 19: predicate.arithmetic_simplify 1.39% : 0.000003s : 20: predicate.cast_eliminate 0.26% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000003s : 19: predicate.compare_switch_simplify 1.45% : 0.000003s : 19: predicate.depend_value_elim 1.37% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.48% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.51% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.40% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.39% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_depend_swap 1.43% : 0.000003s : 20: predicate.environ_get_eliminate 1.30% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.57% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000011s : 40: predicate.inline 0.57% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.87% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.88% : 0.000004s : 25: predicate.load_eliminater 0.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.42% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.78% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 19: predicate.merge_addn 1.27% : 0.000003s : 19: predicate.minmaximum_grad 1.07% : 0.000002s : 3: predicate.mutable_eliminate 0.36% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000004s : 25: predicate.partial_eliminate 1.35% : 0.000003s : 19: predicate.print_const_string_wrapper 1.81% : 0.000004s : 19: predicate.reduce_eliminate 1.63% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.41% : 0.000001s : 6: predicate.remove_not_recompute_node 1.53% : 0.000003s : 28: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.18% : 0.000000s : 3: predicate.reset_defer_inline 2.07% : 0.000004s : 20: predicate.reshape_eliminate 1.39% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.51% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000003s : 19: predicate.same_eliminate 0.30% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.65% : 0.000001s : 6: predicate.special_op_eliminate 0.59% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.24% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.23% : 0.000007s : 34: predicate.switch_defer_inline 2.92% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.89% : 0.000018s : 107: predicate.switch_simplify 1.45% : 0.000003s : 19: predicate.tile_eliminate 1.32% : 0.000003s : 19: predicate.transpose_eliminate 1.61% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.78% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.51% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.64% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.49% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 19: predicate.value_based_eliminate 0.22% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.35% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003575 40 63.41% : 0.002267s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.53% : 0.000341s : 5: func_graph_cloner_run.FuncGraphClonerNode 27.06% : 0.000968s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118163 72 0.04% : 0.000053s : 1: add_recomputation 0.18% : 0.000218s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000353s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.44% : 0.000523s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 18.24% : 0.021558s : 1: jit_opt_a 0.13% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.38% : 0.000451s : 1: loop_unroll 0.59% : 0.000699s : 1: mutable_eliminate 1.74% : 0.002051s : 26: opt.transform.jit_opt_a 0.04% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000058s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.54% : 0.001818s : 1: renormalize.infer 0.60% : 0.000709s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000060s : 1: rewriter_after_opt_a 0.14% : 0.000167s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 74.75% : 0.088325s : 1: type_inference TotalTime = 0.156164, [30] [bootstrap]: 0.00029519 [type_inference]: 0.142911 [event_method]: 2.432e-05 [auto_monad]: 7.562e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00043645 [rewriter_before_opt_a]: 0.00010224 [expand_dump_flag]: 4.27998e-06 [jit_opt_a]: 0.00984256, [2] [Cycle 1]: 0.00484019, [27] [switch_simplify]: 6.992e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.00075885 [with_stream_mark]: 2.736e-05 [recompute_prepare]: 1.107e-05 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 7.35998e-06 [updatestate_useless_node_eliminater]: 6.35002e-06 [accelerated_algorithm]: 7.51999e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 7.28e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.764e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.148e-05 [inline_without_move]: 6.81001e-06 [renormalize]: 0.00351521 [add_forward_monad_depend]: 7.49002e-06 [auto_monad_grad]: 2.76999e-06 [auto_monad_eliminator]: 1.745e-05 [cse]: 3.836e-05 [replace_applicator]: 2.326e-05 [Cycle 2]: 0.00038655, [27] [switch_simplify]: 7.33999e-06 [loop_unroll]: 6.00002e-06 [a_1]: 0.00012343 [with_stream_mark]: 1.419e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.70998e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 2.59001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.765e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 5.83002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.39998e-06 [cse]: 1.388e-05 [replace_applicator]: 6.65998e-06 [py_interpret_to_execute_after_opt_a]: 1.304e-05 [rewriter_after_opt_a]: 4.089e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00071422 [jit_opt_b]: 6.021e-05, [1] [Cycle 1]: 5.173e-05, [2] [frontend_op_eliminate]: 2.086e-05 [inline_after_opt_a]: 1.828e-05 [cconv]: 2.862e-05 [loop_unroll]: 0.0004272 [jit_opt_after_cconv]: 0.00016349, [1] [Cycle 1]: 0.00015558, [11] [c_1]: 2.646e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 7.51001e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.667e-05 [call_graph_tuple_transform]: 2.296e-05 [tuple_list_get_item_eliminator]: 6.71999e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.18998e-06 [remove_dup_value]: 1.907e-05 [partial_unused_args_eliminate]: 2.64999e-06 [environ_conv]: 8.99998e-06 [add_recomputation]: 4.98e-05 [cse_after_recomputation]: 2.433e-05, [1] [Cycle 1]: 1.874e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 2.061e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 5.50001e-06 [opt_after_jit_grad]: 0.00045896 [symbol_engine_optimizer]: 0.00014548, [1] [Cycle 1]: 0.0001383, [6] [build]: 4.36002e-06 [elim_shapecalc]: 9.00001e-06 [elim_not_effective]: 1.459e-05 [opt_reshape]: 7.023e-05 [fold_const_symbol]: 1.092e-05 [renormalize]: 4.40021e-07 [validate]: 5.139e-05 Sums bootstrap : 0.000295s : 0.20% type_inference : 0.142911s : 94.73% event_method : 0.000024s : 0.02% auto_monad : 0.000076s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000436s : 0.29% rewriter_before_opt_a : 0.000102s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000882s : 0.58% jit_opt_a.with_stream_mark : 0.000042s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003515s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000714s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000427s : 0.28% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000021s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000459s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000070s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.03% Time group info: ------[substitution.] 0.000309 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000007s : 4: substitution.graph_param_transform 87.33% : 0.000269s : 5: substitution.inline 1.22% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000006s : 2: substitution.replace_old_param 4.42% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.142817 2 97.94% : 0.139876s : 1: type_inference.infer 2.06% : 0.002941s : 1: type_inference.specialize ------[replace.] 0.000111 7 69.31% : 0.000077s : 5: replace.inline 30.69% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 95.56% : 0.000266s : 5: match.inline 4.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 6.03% : 0.000009s : 28: predicate.inline 1.04% : 0.000002s : 8: predicate.inline_without_move 0.56% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.98% : 0.000003s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.92% : 0.000003s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000004s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.75% : 0.000003s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.37% : 0.000011s : 64: predicate.switch_simplify 1.14% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.95% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002657 25 68.67% : 0.001825s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.46% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.87% : 0.000741s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160961 72 0.03% : 0.000053s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.19% : 0.000313s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.12% : 0.009846s : 1: jit_opt_a 0.10% : 0.000166s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.27% : 0.000435s : 1: loop_unroll 0.45% : 0.000723s : 1: mutable_eliminate 0.72% : 0.001156s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000102s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000468s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000444s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.72% : 0.002769s : 1: renormalize.infer 0.46% : 0.000733s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000068s : 1: rewriter_after_opt_a 0.07% : 0.000108s : 1: rewriter_before_opt_a 0.09% : 0.000148s : 1: symbol_engine_optimizer 88.80% : 0.142929s : 1: type_inference TotalTime = 0.139613, [30] [bootstrap]: 0.00031172 [type_inference]: 0.122887 [event_method]: 0.00044495 [auto_monad]: 0.00013142 [graph_reusing]: 9.04e-06 [pre_auto_parallel]: 3.27002e-06 [py_interpret_to_execute]: 4.371e-05 [rewriter_before_opt_a]: 0.00014288 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.0109852, [2] [Cycle 1]: 0.00459302, [27] [switch_simplify]: 0.00018295 [loop_unroll]: 6.742e-05 [a_1]: 0.00149796 [with_stream_mark]: 1.964e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.611e-05 [j_node_and_user_rematch]: 1.052e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00244761 [add_forward_monad_depend]: 5.95002e-06 [auto_monad_grad]: 2.43002e-06 [auto_monad_eliminator]: 1.718e-05 [cse]: 3.788e-05 [replace_applicator]: 1.369e-05 [Cycle 2]: 0.00033748, [27] [switch_simplify]: 6.82002e-06 [loop_unroll]: 5.36002e-06 [a_1]: 9.761e-05 [with_stream_mark]: 1.087e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.06002e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.414e-05 [j_node_and_user_rematch]: 8.70001e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.90998e-06 [inline_without_move]: 5.19e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.287e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.392e-05 [rewriter_after_opt_a]: 4.243e-05 [convert_after_rewriter]: 7.87003e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00066558 [jit_opt_b]: 5.632e-05, [1] [Cycle 1]: 4.801e-05, [2] [frontend_op_eliminate]: 1.848e-05 [inline_after_opt_a]: 1.756e-05 [cconv]: 2.764e-05 [loop_unroll]: 0.0025723 [jit_opt_after_cconv]: 0.00023589, [1] [Cycle 1]: 0.00022762, [11] [c_1]: 2.607e-05 [parameter_eliminate]: 3.28e-06 [updatestate_depend_eliminate]: 1.08e-05 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.73001e-06 [cse]: 4.816e-05 [call_graph_tuple_transform]: 3.547e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 1.837e-05 [remove_dup_value]: 1.912e-05 [partial_unused_args_eliminate]: 2.18998e-06 [environ_conv]: 1.881e-05 [add_recomputation]: 5.335e-05 [cse_after_recomputation]: 2.903e-05, [1] [Cycle 1]: 2.294e-05, [1] [cse]: 1.671e-05 [auto_monad_reorder]: 1.805e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.84e-06 [opt_after_jit_grad]: 0.00053266 [symbol_engine_optimizer]: 7.84e-05, [1] [Cycle 1]: 7.137e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 9.04998e-06 [elim_not_effective]: 1.454e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 3.60014e-07 [validate]: 4.025e-05 Sums bootstrap : 0.000312s : 0.23% type_inference : 0.122887s : 92.48% event_method : 0.000445s : 0.33% auto_monad : 0.000131s : 0.10% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000044s : 0.03% rewriter_before_opt_a : 0.000143s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000190s : 0.14% jit_opt_a.loop_unroll : 0.000073s : 0.05% jit_opt_a.a_1 : 0.001596s : 1.20% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002448s : 1.84% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000666s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.002572s : 1.94% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000048s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000035s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000018s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000019s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000533s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000632 35 0.34% : 0.000002s : 2: substitution.elim_not_effective 0.19% : 0.000001s : 2: substitution.fold_const_symbol 2.83% : 0.000018s : 3: substitution.graph_param_transform 89.40% : 0.000565s : 12: substitution.inline 0.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.82% : 0.000005s : 4: substitution.remove_not_recompute_node 0.74% : 0.000005s : 2: substitution.replace_old_param 1.49% : 0.000009s : 1: substitution.reshape_eliminate 1.87% : 0.000012s : 3: substitution.switch_simplify 1.77% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122786 2 97.19% : 0.119337s : 1: type_inference.infer 2.81% : 0.003449s : 1: type_inference.specialize ------[replace.] 0.000310 18 54.54% : 0.000169s : 12: replace.inline 1.50% : 0.000005s : 1: replace.reshape_eliminate 17.35% : 0.000054s : 3: replace.switch_simplify 26.62% : 0.000083s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000587 18 95.10% : 0.000558s : 12: match.inline 1.45% : 0.000009s : 1: match.reshape_eliminate 1.73% : 0.000010s : 3: match.switch_simplify 1.72% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000202 1212 1.33% : 0.000003s : 19: predicate.accumulaten_eliminater 0.84% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 19: predicate.addn_check_dump 1.34% : 0.000003s : 19: predicate.addn_zero_filter 1.99% : 0.000004s : 19: predicate.arithmetic_simplify 1.56% : 0.000003s : 20: predicate.cast_eliminate 0.30% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000003s : 19: predicate.compare_switch_simplify 1.50% : 0.000003s : 19: predicate.depend_value_elim 1.39% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.46% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.51% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.56% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.35% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.29% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.27% : 0.000003s : 20: predicate.environ_get_depend_swap 1.60% : 0.000003s : 20: predicate.environ_get_eliminate 1.37% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 3: predicate.fold_const_symbol 0.56% : 0.000001s : 6: predicate.get_grad_eliminate 0.18% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000011s : 40: predicate.inline 0.48% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.71% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.78% : 0.000004s : 25: predicate.load_eliminater 1.58% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.63% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.82% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 19: predicate.merge_addn 1.32% : 0.000003s : 19: predicate.minmaximum_grad 1.07% : 0.000002s : 3: predicate.mutable_eliminate 0.32% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000004s : 25: predicate.partial_eliminate 1.43% : 0.000003s : 19: predicate.print_const_string_wrapper 2.05% : 0.000004s : 19: predicate.reduce_eliminate 1.61% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.29% : 0.000001s : 6: predicate.remove_not_recompute_node 1.52% : 0.000003s : 28: predicate.replace_applicator 0.32% : 0.000001s : 6: predicate.replace_old_param 0.18% : 0.000000s : 3: predicate.reset_defer_inline 1.79% : 0.000004s : 20: predicate.reshape_eliminate 1.49% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.50% : 0.000001s : 3: predicate.row_tensor_eliminate 1.56% : 0.000003s : 19: predicate.same_eliminate 0.30% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.55% : 0.000001s : 6: predicate.special_op_eliminate 0.54% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.39% : 0.000007s : 34: predicate.switch_defer_inline 2.79% : 0.000006s : 34: predicate.switch_layer_defer_inline 8.41% : 0.000017s : 107: predicate.switch_simplify 1.28% : 0.000003s : 19: predicate.tile_eliminate 1.27% : 0.000003s : 19: predicate.transpose_eliminate 1.66% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.68% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.54% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.63% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.55% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.81% : 0.000004s : 19: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003387 40 62.01% : 0.002100s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.25% : 0.000313s : 5: func_graph_cloner_run.FuncGraphClonerNode 28.74% : 0.000973s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144138 72 0.04% : 0.000056s : 1: add_recomputation 0.10% : 0.000138s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000331s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000023s : 1: environ_conv 0.32% : 0.000456s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 7.62% : 0.010990s : 1: jit_opt_a 0.17% : 0.000241s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 1.79% : 0.002586s : 1: loop_unroll 0.47% : 0.000676s : 1: mutable_eliminate 1.38% : 0.001983s : 26: opt.transform.jit_opt_a 0.06% : 0.000082s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000541s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.03% : 0.000047s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.20% : 0.001726s : 1: renormalize.infer 0.49% : 0.000712s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.10% : 0.000146s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 85.28% : 0.122916s : 1: type_inference TotalTime = 0.278752, [30] [bootstrap]: 0.00043483 [type_inference]: 0.24893 [event_method]: 2.501e-05 [auto_monad]: 7.859e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.26998e-06 [py_interpret_to_execute]: 0.00061339 [rewriter_before_opt_a]: 9.921e-05 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.025932, [2] [Cycle 1]: 0.0211812, [27] [switch_simplify]: 7.16e-05 [loop_unroll]: 3.523e-05 [a_1]: 0.00080083 [with_stream_mark]: 2.585e-05 [recompute_prepare]: 9.65002e-06 [updatestate_depend_eliminate]: 4.69998e-06 [updatestate_assign_eliminate]: 3.88001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 6.73998e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 7.45e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.679e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.90998e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 7.02002e-06 [renormalize]: 0.0198082 [add_forward_monad_depend]: 9.32999e-06 [auto_monad_grad]: 2.73003e-06 [auto_monad_eliminator]: 2.159e-05 [cse]: 4.268e-05 [replace_applicator]: 2.73e-05 [Cycle 2]: 0.00042539, [27] [switch_simplify]: 8.38999e-06 [loop_unroll]: 6.98e-06 [a_1]: 0.00015355 [with_stream_mark]: 1.562e-05 [recompute_prepare]: 6.48e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.98998e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 4.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 5.81e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 9.40025e-07 [auto_monad_eliminator]: 6.23998e-06 [cse]: 1.399e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 2.066e-05 [rewriter_after_opt_a]: 3.953e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00083734 [jit_opt_b]: 6.03e-05, [1] [Cycle 1]: 5.195e-05, [2] [frontend_op_eliminate]: 2.121e-05 [inline_after_opt_a]: 1.868e-05 [cconv]: 2.682e-05 [loop_unroll]: 0.00044109 [jit_opt_after_cconv]: 0.00016057, [1] [Cycle 1]: 0.00015417, [11] [c_1]: 2.713e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 2.476e-05 [call_graph_tuple_transform]: 2.181e-05 [tuple_list_get_item_eliminator]: 7.23e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.64999e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 1.98002e-06 [environ_conv]: 9.14998e-06 [add_recomputation]: 5.132e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.27e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00050187 [symbol_engine_optimizer]: 7.88e-05, [1] [Cycle 1]: 7.277e-05, [6] [build]: 4.33001e-06 [elim_shapecalc]: 9.87999e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 6.65002e-06 [fold_const_symbol]: 9.96998e-06 [renormalize]: 3.80009e-07 [validate]: 5.409e-05 Sums bootstrap : 0.000435s : 0.16% type_inference : 0.248930s : 90.95% event_method : 0.000025s : 0.01% auto_monad : 0.000079s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000613s : 0.22% rewriter_before_opt_a : 0.000099s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000954s : 0.35% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.019808s : 7.24% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000057s : 0.02% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000040s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000837s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000441s : 0.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000051s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000502s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.02% Time group info: ------[substitution.] 0.000341 28 0.51% : 0.000002s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 4: substitution.graph_param_transform 84.67% : 0.000289s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.56% : 0.000016s : 3: substitution.reduce_eliminate 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 3.68% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.248832 2 98.53% : 0.245179s : 1: type_inference.infer 1.47% : 0.003653s : 1: type_inference.specialize ------[replace.] 0.000115 7 69.45% : 0.000080s : 5: replace.inline 30.55% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 7 96.21% : 0.000285s : 5: match.inline 3.79% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 2.66% : 0.000004s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.48% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.78% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.98% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.05% : 0.000002s : 13: predicate.print_const_string_wrapper 2.78% : 0.000004s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 23: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 2.02% : 0.000003s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000011s : 64: predicate.switch_simplify 1.64% : 0.000003s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003398 25 54.33% : 0.001846s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.82% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.85% : 0.001456s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.299784 72 0.02% : 0.000054s : 1: add_recomputation 0.03% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.15% : 0.000457s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 8.65% : 0.025936s : 1: jit_opt_a 0.05% : 0.000164s : 1: jit_opt_after_cconv 0.02% : 0.000063s : 1: jit_opt_b 0.15% : 0.000448s : 1: loop_unroll 0.28% : 0.000847s : 1: mutable_eliminate 0.41% : 0.001230s : 26: opt.transform.jit_opt_a 0.02% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000510s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000623s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 6.10% : 0.018280s : 1: renormalize.infer 0.50% : 0.001509s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.03% : 0.000104s : 1: rewriter_before_opt_a 0.03% : 0.000081s : 1: symbol_engine_optimizer 83.04% : 0.248954s : 1: type_inference TotalTime = 0.255981, [30] [bootstrap]: 0.00027151 [type_inference]: 0.224475 [event_method]: 2.355e-05 [auto_monad]: 7.902e-05 [graph_reusing]: 6.82002e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00046206 [rewriter_before_opt_a]: 9.877e-05 [expand_dump_flag]: 3.78999e-06 [jit_opt_a]: 0.0282457, [2] [Cycle 1]: 0.0240924, [27] [switch_simplify]: 6.907e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.0207738 [with_stream_mark]: 2.686e-05 [recompute_prepare]: 1.387e-05 [updatestate_depend_eliminate]: 4.91002e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.78998e-06 [meta_shard_fg_expand]: 3.68999e-06 [get_grad_eliminate_]: 6.88e-06 [merge_forward]: 5.24998e-06 [cell_reuse_recompute_pass]: 3.68999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 5.99999e-06 [renormalize]: 0.00277535 [add_forward_monad_depend]: 8.47e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.713e-05 [cse]: 3.193e-05 [replace_applicator]: 1.901e-05 [Cycle 2]: 0.0003737, [27] [switch_simplify]: 6.95002e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00012477 [with_stream_mark]: 1.168e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.76003e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.57e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 8.67998e-06 [inline_without_move]: 5.26002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.54e-06 [cse]: 1.144e-05 [replace_applicator]: 6.00002e-06 [py_interpret_to_execute_after_opt_a]: 1.264e-05 [rewriter_after_opt_a]: 3.929e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00072609 [jit_opt_b]: 5.443e-05, [1] [Cycle 1]: 4.704e-05, [2] [frontend_op_eliminate]: 1.825e-05 [inline_after_opt_a]: 1.739e-05 [cconv]: 2.735e-05 [loop_unroll]: 0.00041371 [jit_opt_after_cconv]: 0.00014843, [1] [Cycle 1]: 0.00014181, [11] [c_1]: 2.497e-05 [parameter_eliminate]: 2.17999e-06 [updatestate_depend_eliminate]: 5.89e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.01998e-06 [cse]: 2.002e-05 [call_graph_tuple_transform]: 2.093e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 1.89999e-06 [environ_conv]: 7.56001e-06 [add_recomputation]: 4.831e-05 [cse_after_recomputation]: 2.057e-05, [1] [Cycle 1]: 1.541e-05, [1] [cse]: 1.012e-05 [auto_monad_reorder]: 1.539e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.00043629 [symbol_engine_optimizer]: 8.77e-05, [1] [Cycle 1]: 8.12e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 8.40001e-06 [elim_not_effective]: 2.529e-05 [opt_reshape]: 7.01999e-06 [fold_const_symbol]: 9.55001e-06 [renormalize]: 2.20025e-07 [validate]: 4.277e-05 Sums bootstrap : 0.000272s : 0.11% type_inference : 0.224475s : 89.24% event_method : 0.000024s : 0.01% auto_monad : 0.000079s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000462s : 0.18% rewriter_before_opt_a : 0.000099s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.03% jit_opt_a.loop_unroll : 0.000036s : 0.01% jit_opt_a.a_1 : 0.020899s : 8.31% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.00% jit_opt_a.renormalize : 0.002775s : 1.10% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000043s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000726s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.01% loop_unroll : 0.000414s : 0.16% jit_opt_after_cconv.c_1 : 0.000025s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000048s : 0.02% cse_after_recomputation.cse : 0.000010s : 0.00% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000436s : 0.17% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.02% Time group info: ------[substitution.] 0.000261 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 4: substitution.graph_param_transform 82.65% : 0.000216s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 2.09% : 0.000005s : 2: substitution.replace_old_param 7.71% : 0.000020s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.224385 2 98.79% : 0.221675s : 1: type_inference.infer 1.21% : 0.002710s : 1: type_inference.specialize ------[replace.] 0.000120 6 45.02% : 0.000054s : 4: replace.inline 54.98% : 0.000066s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 92.44% : 0.000213s : 4: match.inline 7.56% : 0.000017s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.62% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 12: predicate.compare_switch_simplify 1.48% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.39% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.57% : 0.000009s : 26: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 5.02% : 0.000008s : 18: predicate.load_eliminater 1.01% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.30% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.29% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.80% : 0.000004s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.55% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.91% : 0.000004s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.44% : 0.000010s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.82% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.56% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002231 22 62.54% : 0.001395s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.41% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.05% : 0.000782s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.279971 72 0.02% : 0.000051s : 1: add_recomputation 0.03% : 0.000083s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.10% : 0.000288s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000022s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 10.09% : 0.028249s : 1: jit_opt_a 0.05% : 0.000151s : 1: jit_opt_after_cconv 0.02% : 0.000057s : 1: jit_opt_b 0.15% : 0.000421s : 1: loop_unroll 0.26% : 0.000735s : 1: mutable_eliminate 7.55% : 0.021147s : 26: opt.transform.jit_opt_a 0.02% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000014s : 1: opt.transform.mutable_eliminate 0.01% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000444s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000468s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.68% : 0.001901s : 1: renormalize.infer 0.31% : 0.000864s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.04% : 0.000105s : 1: rewriter_before_opt_a 0.03% : 0.000090s : 1: symbol_engine_optimizer 80.19% : 0.224502s : 1: type_inference TotalTime = 0.215113, [30] [bootstrap]: 0.0003079 [type_inference]: 0.203921 [event_method]: 2.156e-05 [auto_monad]: 7.464e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 0.00046483 [rewriter_before_opt_a]: 9.941e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00769321, [2] [Cycle 1]: 0.00372752, [27] [switch_simplify]: 5.695e-05 [loop_unroll]: 3.387e-05 [a_1]: 0.00063674 [with_stream_mark]: 1.444e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 6.59001e-06 [renormalize]: 0.00262155 [add_forward_monad_depend]: 7.53999e-06 [auto_monad_grad]: 2.95998e-06 [auto_monad_eliminator]: 2.08e-05 [cse]: 3.923e-05 [replace_applicator]: 1.936e-05 [Cycle 2]: 0.00042626, [27] [switch_simplify]: 7.26999e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.00013482 [with_stream_mark]: 1.571e-05 [recompute_prepare]: 6.91001e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 2.25002e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.594e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.16003e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 9.76e-06 [cse]: 2.004e-05 [replace_applicator]: 9.24e-06 [py_interpret_to_execute_after_opt_a]: 1.771e-05 [rewriter_after_opt_a]: 4.125e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.16998e-06 [mutable_eliminate]: 0.00072476 [jit_opt_b]: 5.925e-05, [1] [Cycle 1]: 5.058e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 2.008e-05 [cconv]: 3.083e-05 [loop_unroll]: 0.00044122 [jit_opt_after_cconv]: 0.00016665, [1] [Cycle 1]: 0.0001597, [11] [c_1]: 2.63e-05 [parameter_eliminate]: 3.31001e-06 [updatestate_depend_eliminate]: 7.28e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 3.072e-05 [call_graph_tuple_transform]: 2.369e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 7.79983e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.852e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 8.20999e-06 [add_recomputation]: 5.268e-05 [cse_after_recomputation]: 2.416e-05, [1] [Cycle 1]: 1.892e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.839e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 7.26001e-06 [opt_after_jit_grad]: 0.00045721 [symbol_engine_optimizer]: 7.448e-05, [1] [Cycle 1]: 6.83e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 6.98e-06 [fold_const_symbol]: 9.14e-06 [renormalize]: 4.00003e-07 [validate]: 0.00015639 Sums bootstrap : 0.000308s : 0.15% type_inference : 0.203921s : 96.67% event_method : 0.000022s : 0.01% auto_monad : 0.000075s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000465s : 0.22% rewriter_before_opt_a : 0.000099s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.02% jit_opt_a.a_1 : 0.000772s : 0.37% jit_opt_a.with_stream_mark : 0.000030s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002622s : 1.24% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000059s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000725s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000441s : 0.21% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000457s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000156s : 0.07% Time group info: ------[substitution.] 0.000223 28 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000006s : 4: substitution.graph_param_transform 80.48% : 0.000179s : 5: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.65% : 0.000013s : 3: substitution.reduce_eliminate 2.57% : 0.000006s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 3.35% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.203840 2 98.58% : 0.200939s : 1: type_inference.infer 1.42% : 0.002901s : 1: type_inference.specialize ------[replace.] 0.000095 7 66.90% : 0.000064s : 5: replace.inline 33.10% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 7 96.56% : 0.000176s : 5: match.inline 3.44% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.47% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.25% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.42% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 19: predicate.load_eliminater 1.65% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.04% : 0.000003s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 13: predicate.same_eliminate 1.16% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 20: predicate.switch_defer_inline 2.39% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.45% : 0.000010s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002355 25 65.39% : 0.001540s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.39% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.21% : 0.000759s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.218705 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000078s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.15% : 0.000326s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.52% : 0.007698s : 1: jit_opt_a 0.08% : 0.000170s : 1: jit_opt_after_cconv 0.03% : 0.000062s : 1: jit_opt_b 0.21% : 0.000450s : 1: loop_unroll 0.34% : 0.000738s : 1: mutable_eliminate 0.47% : 0.001022s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000465s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000472s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.80% : 0.001748s : 1: renormalize.infer 0.39% : 0.000864s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.05% : 0.000104s : 1: rewriter_before_opt_a 0.04% : 0.000077s : 1: symbol_engine_optimizer 93.25% : 0.203936s : 1: type_inference TotalTime = 0.186273, [30] [bootstrap]: 0.00029324 [type_inference]: 0.174932 [event_method]: 2.186e-05 [auto_monad]: 7.224e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00043743 [rewriter_before_opt_a]: 0.00010556 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.00779553, [2] [Cycle 1]: 0.00381464, [27] [switch_simplify]: 6.511e-05 [loop_unroll]: 3.438e-05 [a_1]: 0.00067856 [with_stream_mark]: 1.902e-05 [recompute_prepare]: 9.24998e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 4e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 8.2e-06 [updatestate_useless_node_eliminater]: 6.58998e-06 [accelerated_algorithm]: 7.2e-06 [meta_shard_fg_expand]: 3.25998e-06 [get_grad_eliminate_]: 7.41001e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 6.41998e-06 [renormalize]: 0.00263354 [add_forward_monad_depend]: 7.2e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 1.644e-05 [cse]: 3.628e-05 [replace_applicator]: 2.018e-05 [Cycle 2]: 0.00039615, [27] [switch_simplify]: 7.28999e-06 [loop_unroll]: 6.91999e-06 [a_1]: 0.00012969 [with_stream_mark]: 1.168e-05 [recompute_prepare]: 7.13e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 2.71999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.85e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.99998e-06 [inline_without_move]: 6.20002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.42e-05 [replace_applicator]: 6.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.193e-05 [rewriter_after_opt_a]: 3.961e-05 [convert_after_rewriter]: 7.46001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00064319 [jit_opt_b]: 5.803e-05, [1] [Cycle 1]: 5.017e-05, [2] [frontend_op_eliminate]: 1.982e-05 [inline_after_opt_a]: 1.867e-05 [cconv]: 2.767e-05 [loop_unroll]: 0.00056245 [jit_opt_after_cconv]: 0.0002234, [1] [Cycle 1]: 0.00021567, [11] [c_1]: 2.971e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 8.1e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 4.193e-05 [call_graph_tuple_transform]: 3.74e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 1.182e-05 [remove_dup_value]: 1.842e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 8.32998e-06 [add_recomputation]: 5.157e-05 [cse_after_recomputation]: 2.659e-05, [1] [Cycle 1]: 2.064e-05, [1] [cse]: 1.379e-05 [auto_monad_reorder]: 2.046e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.82999e-06 [opt_after_jit_grad]: 0.00047503 [symbol_engine_optimizer]: 0.00015717, [1] [Cycle 1]: 0.00015062, [6] [build]: 3.40998e-06 [elim_shapecalc]: 9.47999e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 8.119e-05 [fold_const_symbol]: 1.233e-05 [renormalize]: 6.39993e-07 [validate]: 5.003e-05 Sums bootstrap : 0.000293s : 0.16% type_inference : 0.174932s : 96.10% event_method : 0.000022s : 0.01% auto_monad : 0.000072s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000437s : 0.24% rewriter_before_opt_a : 0.000106s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000808s : 0.44% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002634s : 1.45% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000643s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000562s : 0.31% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000037s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000012s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000475s : 0.26% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000081s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000252 25 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 4: substitution.graph_param_transform 85.33% : 0.000215s : 5: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000007s : 4: substitution.remove_not_recompute_node 1.75% : 0.000004s : 2: substitution.replace_old_param 5.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.174850 2 98.42% : 0.172085s : 1: type_inference.infer 1.58% : 0.002764s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.18% : 0.000070s : 5: replace.inline 31.82% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 7 94.87% : 0.000213s : 5: match.inline 5.13% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.30% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.73% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.72% : 0.000002s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.37% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002242 25 65.16% : 0.001461s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.67% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.16% : 0.000721s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.190147 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000076s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.16% : 0.000311s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.10% : 0.007799s : 1: jit_opt_a 0.12% : 0.000227s : 1: jit_opt_after_cconv 0.03% : 0.000061s : 1: jit_opt_b 0.30% : 0.000572s : 1: loop_unroll 0.34% : 0.000652s : 1: mutable_eliminate 0.56% : 0.001072s : 26: opt.transform.jit_opt_a 0.04% : 0.000082s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000029s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000114s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000483s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000444s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.98% : 0.001857s : 1: renormalize.infer 0.40% : 0.000766s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000112s : 1: rewriter_before_opt_a 0.08% : 0.000160s : 1: symbol_engine_optimizer 92.01% : 0.174953s : 1: type_inference TotalTime = 0.0153072, [30] [bootstrap]: 0.00027693 [type_inference]: 0.00725124 [event_method]: 2.055e-05 [auto_monad]: 6.7e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 4.57e-05 [rewriter_before_opt_a]: 8.197e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00548142, [2] [Cycle 1]: 0.00184832, [27] [switch_simplify]: 6.183e-05 [loop_unroll]: 3.278e-05 [a_1]: 0.00063984 [with_stream_mark]: 1.851e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.21002e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.59999e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 0.00075451 [add_forward_monad_depend]: 5.06002e-06 [auto_monad_grad]: 2.19999e-06 [auto_monad_eliminator]: 1.373e-05 [cse]: 3.408e-05 [replace_applicator]: 1.181e-05 [Cycle 2]: 0.00048738, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 5.05001e-06 [a_1]: 9.732e-05 [with_stream_mark]: 9.05001e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.71997e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.098e-05 [j_node_and_user_rematch]: 7.63001e-06 [meta_fg_expand]: 1.61002e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.04999e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 8.34002e-06 [cse]: 1.8e-05 [replace_applicator]: 7.67998e-06 [py_interpret_to_execute_after_opt_a]: 1.226e-05 [rewriter_after_opt_a]: 3.788e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00050745 [jit_opt_b]: 5.113e-05, [1] [Cycle 1]: 4.449e-05, [2] [frontend_op_eliminate]: 1.581e-05 [inline_after_opt_a]: 1.665e-05 [cconv]: 2.485e-05 [loop_unroll]: 0.00041316 [jit_opt_after_cconv]: 0.00015867, [1] [Cycle 1]: 0.00015183, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 2.10002e-06 [updatestate_depend_eliminate]: 1.682e-05 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.02e-05 [call_graph_tuple_transform]: 1.999e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 2.29978e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.66e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.19001e-06 [add_recomputation]: 4.844e-05 [cse_after_recomputation]: 2.369e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.201e-05 [auto_monad_reorder]: 1.765e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 5.12999e-06 [opt_after_jit_grad]: 0.00044773 [symbol_engine_optimizer]: 7.383e-05, [1] [Cycle 1]: 6.771e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.45e-06 [elim_not_effective]: 1.254e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 3.4002e-07 [validate]: 3.884e-05 Sums bootstrap : 0.000277s : 2.42% type_inference : 0.007251s : 63.49% event_method : 0.000021s : 0.18% auto_monad : 0.000067s : 0.59% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.40% rewriter_before_opt_a : 0.000082s : 0.72% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.60% jit_opt_a.loop_unroll : 0.000038s : 0.33% jit_opt_a.a_1 : 0.000737s : 6.45% jit_opt_a.with_stream_mark : 0.000028s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000755s : 6.61% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.19% jit_opt_a.cse : 0.000052s : 0.46% jit_opt_a.replace_applicator : 0.000019s : 0.17% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000038s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000507s : 4.44% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000025s : 0.22% loop_unroll : 0.000413s : 3.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000017s : 0.15% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000448s : 3.92% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.34% Time group info: ------[substitution.] 0.000258 27 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.20% : 0.000006s : 3: substitution.graph_param_transform 83.96% : 0.000216s : 5: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.97% : 0.000010s : 3: substitution.reduce_eliminate 1.60% : 0.000004s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 4.11% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007186 2 87.52% : 0.006289s : 1: type_inference.infer 12.48% : 0.000897s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.83% : 0.000063s : 5: replace.inline 31.17% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 7 95.75% : 0.000213s : 5: match.inline 4.25% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.44% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.44% : 0.000002s : 11: predicate.addn_zero_filter 2.03% : 0.000002s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.35% : 0.000002s : 11: predicate.depend_value_elim 1.22% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.71% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000001s : 11: predicate.print_const_string_wrapper 1.92% : 0.000002s : 11: predicate.reduce_eliminate 1.56% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 19: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.23% : 0.000010s : 59: predicate.switch_simplify 1.42% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000728 16 49.38% : 0.000360s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.65% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.97% : 0.000298s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017074 72 0.30% : 0.000051s : 1: add_recomputation 0.41% : 0.000070s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.73% : 0.000295s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 32.13% : 0.005485s : 1: jit_opt_a 0.94% : 0.000161s : 1: jit_opt_after_cconv 0.32% : 0.000054s : 1: jit_opt_b 2.47% : 0.000421s : 1: loop_unroll 3.02% : 0.000515s : 1: mutable_eliminate 5.61% : 0.000957s : 26: opt.transform.jit_opt_a 0.29% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000455s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000049s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.53% : 0.000432s : 1: renormalize.infer 1.84% : 0.000314s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000041s : 1: rewriter_after_opt_a 0.50% : 0.000085s : 1: rewriter_before_opt_a 0.45% : 0.000077s : 1: symbol_engine_optimizer 42.56% : 0.007266s : 1: type_inference TotalTime = 0.0216334, [30] [bootstrap]: 0.00040994 [type_inference]: 0.0104199 [event_method]: 2.444e-05 [auto_monad]: 7.339e-05 [graph_reusing]: 6.83e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 5.361e-05 [rewriter_before_opt_a]: 8.376e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.0066287, [2] [Cycle 1]: 0.00236241, [27] [switch_simplify]: 7.133e-05 [loop_unroll]: 3.672e-05 [a_1]: 0.00073693 [with_stream_mark]: 2.512e-05 [recompute_prepare]: 8.46002e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 5.71998e-06 [meta_shard_fg_expand]: 3.38e-06 [get_grad_eliminate_]: 5.91998e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00111018 [add_forward_monad_depend]: 7.06999e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.817e-05 [cse]: 3.758e-05 [replace_applicator]: 1.479e-05 [Cycle 2]: 0.00034823, [27] [switch_simplify]: 6.46999e-06 [loop_unroll]: 5.20999e-06 [a_1]: 0.00010518 [with_stream_mark]: 1.145e-05 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 2.13002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.17e-05 [j_node_and_user_rematch]: 7.85998e-06 [meta_fg_expand]: 2.13002e-06 [replace_old_param]: 7.20998e-06 [inline_without_move]: 5.08002e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.81001e-06 [cse]: 1.315e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.442e-05 [rewriter_after_opt_a]: 4.187e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00076097 [jit_opt_b]: 5.661e-05, [1] [Cycle 1]: 4.866e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 2.991e-05 [loop_unroll]: 0.00166705 [jit_opt_after_cconv]: 0.00024766, [1] [Cycle 1]: 0.00023739, [11] [c_1]: 2.413e-05 [parameter_eliminate]: 5.10999e-06 [updatestate_depend_eliminate]: 1.089e-05 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 9.121e-05 [call_graph_tuple_transform]: 2.905e-05 [tuple_list_get_item_eliminator]: 5.73997e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 6.41e-06 [remove_dup_value]: 1.909e-05 [partial_unused_args_eliminate]: 3.26001e-06 [environ_conv]: 8.18999e-06 [add_recomputation]: 6.122e-05 [cse_after_recomputation]: 2.931e-05, [1] [Cycle 1]: 2.202e-05, [1] [cse]: 1.488e-05 [auto_monad_reorder]: 1.77e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 1.002e-05 [opt_after_jit_grad]: 0.00059087 [symbol_engine_optimizer]: 8.734e-05, [1] [Cycle 1]: 7.946e-05, [6] [build]: 4.60001e-06 [elim_shapecalc]: 9.22999e-06 [elim_not_effective]: 1.544e-05 [opt_reshape]: 8.08999e-06 [fold_const_symbol]: 1.056e-05 [renormalize]: 7.2e-07 [validate]: 4.948e-05 Sums bootstrap : 0.000410s : 2.41% type_inference : 0.010420s : 61.16% event_method : 0.000024s : 0.14% auto_monad : 0.000073s : 0.43% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000054s : 0.31% rewriter_before_opt_a : 0.000084s : 0.49% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000078s : 0.46% jit_opt_a.loop_unroll : 0.000042s : 0.25% jit_opt_a.a_1 : 0.000842s : 4.94% jit_opt_a.with_stream_mark : 0.000037s : 0.21% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001110s : 6.52% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.15% jit_opt_a.cse : 0.000051s : 0.30% jit_opt_a.replace_applicator : 0.000021s : 0.12% py_interpret_to_execute_after_opt_a : 0.000014s : 0.08% rewriter_after_opt_a : 0.000042s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000761s : 4.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000030s : 0.18% loop_unroll : 0.001667s : 9.78% jit_opt_after_cconv.c_1 : 0.000024s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000091s : 0.54% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000019s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000061s : 0.36% cse_after_recomputation.cse : 0.000015s : 0.09% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.06% opt_after_jit_grad : 0.000591s : 3.47% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.29% Time group info: ------[substitution.] 0.000324 27 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.07% : 0.000007s : 3: substitution.graph_param_transform 85.28% : 0.000276s : 5: substitution.inline 1.06% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.75% : 0.000012s : 3: substitution.reduce_eliminate 1.37% : 0.000004s : 4: substitution.remove_not_recompute_node 1.38% : 0.000004s : 2: substitution.replace_old_param 3.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010335 2 87.96% : 0.009090s : 1: type_inference.infer 12.04% : 0.001245s : 1: type_inference.specialize ------[replace.] 0.000104 7 67.65% : 0.000071s : 5: replace.inline 32.35% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000284 7 96.19% : 0.000273s : 5: match.inline 3.81% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.41% : 0.000002s : 11: predicate.addn_check_dump 1.52% : 0.000002s : 11: predicate.addn_zero_filter 2.13% : 0.000003s : 11: predicate.arithmetic_simplify 1.16% : 0.000002s : 11: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.32% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 11: predicate.environ_get_depend_swap 1.14% : 0.000002s : 11: predicate.environ_get_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000008s : 24: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 2.57% : 0.000004s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 11: predicate.merge_addn 1.01% : 0.000001s : 11: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000002s : 11: predicate.print_const_string_wrapper 2.24% : 0.000003s : 11: predicate.reduce_eliminate 1.91% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 19: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.94% : 0.000011s : 59: predicate.switch_simplify 1.36% : 0.000002s : 11: predicate.tile_eliminate 1.26% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.50% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000998 16 48.46% : 0.000484s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.23% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.31% : 0.000422s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023893 72 0.27% : 0.000065s : 1: add_recomputation 0.32% : 0.000077s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.81% : 0.000432s : 1: bootstrap 0.14% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000032s : 1: cse_after_recomputation 0.05% : 0.000011s : 1: environ_conv 0.12% : 0.000029s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 27.76% : 0.006633s : 1: jit_opt_a 1.05% : 0.000251s : 1: jit_opt_after_cconv 0.25% : 0.000060s : 1: jit_opt_b 7.03% : 0.001680s : 1: loop_unroll 3.23% : 0.000772s : 1: mutable_eliminate 4.54% : 0.001084s : 26: opt.transform.jit_opt_a 0.26% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000029s : 4: opt.transform.jit_opt_b 0.09% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.52% : 0.000603s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000057s : 1: py_interpret_to_execute 0.07% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000022s : 1: remove_dup_value 2.72% : 0.000651s : 1: renormalize.infer 1.88% : 0.000449s : 1: renormalize.specialize 0.05% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000045s : 1: rewriter_after_opt_a 0.36% : 0.000087s : 1: rewriter_before_opt_a 0.38% : 0.000090s : 1: symbol_engine_optimizer 43.69% : 0.010439s : 1: type_inference TotalTime = 0.177137, [30] [bootstrap]: 0.00032824 [type_inference]: 0.162751 [event_method]: 0.00042616 [auto_monad]: 0.0001383 [graph_reusing]: 8.96002e-06 [pre_auto_parallel]: 3.39001e-06 [py_interpret_to_execute]: 0.00011633 [rewriter_before_opt_a]: 0.00014683 [expand_dump_flag]: 3.77002e-06 [jit_opt_a]: 0.0108169, [2] [Cycle 1]: 0.00536481, [27] [switch_simplify]: 0.00020159 [loop_unroll]: 6.692e-05 [a_1]: 0.00153467 [with_stream_mark]: 2.423e-05 [recompute_prepare]: 2.329e-05 [updatestate_depend_eliminate]: 5.07999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.50002e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.633e-05 [j_node_and_user_rematch]: 1.081e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 5.86e-06 [renormalize]: 0.0031213 [add_forward_monad_depend]: 7.84002e-06 [auto_monad_grad]: 3.01001e-06 [auto_monad_eliminator]: 1.658e-05 [cse]: 3.519e-05 [replace_applicator]: 1.983e-05 [Cycle 2]: 0.00035293, [27] [switch_simplify]: 6.31998e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.00010362 [with_stream_mark]: 1.254e-05 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.38002e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.81003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.665e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24003e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.29e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.435e-05 [rewriter_after_opt_a]: 3.623e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00073864 [jit_opt_b]: 5.384e-05, [1] [Cycle 1]: 4.596e-05, [2] [frontend_op_eliminate]: 1.769e-05 [inline_after_opt_a]: 1.738e-05 [cconv]: 2.646e-05 [loop_unroll]: 0.00043875 [jit_opt_after_cconv]: 0.00015129, [1] [Cycle 1]: 0.0001447, [11] [c_1]: 2.274e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.399e-05 [call_graph_tuple_transform]: 2.09e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 1.773e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 6.61999e-06 [add_recomputation]: 4.944e-05 [cse_after_recomputation]: 2.408e-05, [1] [Cycle 1]: 1.846e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.767e-05 [get_jit_bprop_graph]: 2.99999e-06 [rewriter_after_jit_bprop_graph]: 4.82e-06 [opt_after_jit_grad]: 0.00047955 [symbol_engine_optimizer]: 8.051e-05, [1] [Cycle 1]: 7.376e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 8.55001e-06 [elim_not_effective]: 1.394e-05 [opt_reshape]: 5.94999e-06 [fold_const_symbol]: 1.017e-05 [renormalize]: 8.00006e-07 [validate]: 4.349e-05 Sums bootstrap : 0.000328s : 0.19% type_inference : 0.162751s : 94.96% event_method : 0.000426s : 0.25% auto_monad : 0.000138s : 0.08% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000116s : 0.07% rewriter_before_opt_a : 0.000147s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000208s : 0.12% jit_opt_a.loop_unroll : 0.000073s : 0.04% jit_opt_a.a_1 : 0.001638s : 0.96% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000029s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003121s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000048s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000739s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000439s : 0.26% jit_opt_after_cconv.c_1 : 0.000023s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000656 35 0.40% : 0.000003s : 2: substitution.elim_not_effective 0.21% : 0.000001s : 2: substitution.fold_const_symbol 0.91% : 0.000006s : 3: substitution.graph_param_transform 90.95% : 0.000597s : 12: substitution.inline 0.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.82% : 0.000005s : 4: substitution.remove_not_recompute_node 0.82% : 0.000005s : 2: substitution.replace_old_param 1.47% : 0.000010s : 1: substitution.reshape_eliminate 2.03% : 0.000013s : 3: substitution.switch_simplify 1.74% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.162626 2 81.56% : 0.132637s : 1: type_inference.infer 18.44% : 0.029989s : 1: type_inference.specialize ------[replace.] 0.000318 18 52.96% : 0.000169s : 12: replace.inline 1.51% : 0.000005s : 1: replace.reshape_eliminate 20.38% : 0.000065s : 3: replace.switch_simplify 25.14% : 0.000080s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000621 18 95.07% : 0.000590s : 12: match.inline 1.41% : 0.000009s : 1: match.reshape_eliminate 1.87% : 0.000012s : 3: match.switch_simplify 1.65% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000204 1212 1.31% : 0.000003s : 19: predicate.accumulaten_eliminater 0.81% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000003s : 19: predicate.addn_check_dump 1.56% : 0.000003s : 19: predicate.addn_zero_filter 1.98% : 0.000004s : 19: predicate.arithmetic_simplify 1.39% : 0.000003s : 20: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 1.29% : 0.000003s : 19: predicate.compare_switch_simplify 1.37% : 0.000003s : 19: predicate.depend_value_elim 1.30% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.44% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.57% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.42% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.18% : 0.000000s : 3: predicate.elim_not_effective 0.30% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.52% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.30% : 0.000003s : 20: predicate.environ_get_depend_swap 1.54% : 0.000003s : 20: predicate.environ_get_eliminate 1.35% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.16% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000002s : 6: predicate.get_grad_eliminate 0.16% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000011s : 40: predicate.inline 0.52% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.77% : 0.000002s : 6: predicate.less_batch_normalization 1.83% : 0.000004s : 22: predicate.list_to_tuple_eliminator_ 1.68% : 0.000003s : 25: predicate.load_eliminater 0.75% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.61% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.70% : 0.000003s : 23: predicate.make_slice_get_slice_eliminator 1.35% : 0.000003s : 19: predicate.merge_addn 1.32% : 0.000003s : 19: predicate.minmaximum_grad 0.90% : 0.000002s : 3: predicate.mutable_eliminate 0.31% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000004s : 25: predicate.partial_eliminate 1.26% : 0.000003s : 19: predicate.print_const_string_wrapper 1.88% : 0.000004s : 19: predicate.reduce_eliminate 1.64% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 6: predicate.remove_not_recompute_node 1.51% : 0.000003s : 28: predicate.replace_applicator 0.40% : 0.000001s : 6: predicate.replace_old_param 0.17% : 0.000000s : 3: predicate.reset_defer_inline 1.92% : 0.000004s : 20: predicate.reshape_eliminate 1.46% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.38% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000003s : 19: predicate.same_eliminate 0.32% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.57% : 0.000001s : 6: predicate.special_op_eliminate 0.56% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.25% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.33% : 0.000007s : 34: predicate.switch_defer_inline 2.74% : 0.000006s : 34: predicate.switch_layer_defer_inline 9.07% : 0.000018s : 107: predicate.switch_simplify 1.44% : 0.000003s : 19: predicate.tile_eliminate 1.29% : 0.000003s : 19: predicate.transpose_eliminate 1.61% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.64% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.73% : 0.000004s : 22: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.39% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.79% : 0.000004s : 19: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.29% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003695 40 57.02% : 0.002107s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.11% : 0.000337s : 5: func_graph_cloner_run.FuncGraphClonerNode 33.87% : 0.001251s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.182378 72 0.03% : 0.000052s : 1: add_recomputation 0.08% : 0.000145s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.19% : 0.000347s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.24% : 0.000434s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 5.93% : 0.010821s : 1: jit_opt_a 0.08% : 0.000154s : 1: jit_opt_after_cconv 0.03% : 0.000056s : 1: jit_opt_b 0.25% : 0.000447s : 1: loop_unroll 0.41% : 0.000747s : 1: mutable_eliminate 1.13% : 0.002069s : 26: opt.transform.jit_opt_a 0.03% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000490s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.07% : 0.000121s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.25% : 0.002281s : 1: renormalize.infer 0.45% : 0.000828s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000150s : 1: rewriter_before_opt_a 0.05% : 0.000083s : 1: symbol_engine_optimizer 89.25% : 0.162767s : 1: type_inference TotalTime = 0.198726, [30] [bootstrap]: 0.00032939 [type_inference]: 0.183567 [event_method]: 2.353e-05 [auto_monad]: 8.11e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 3.06999e-06 [py_interpret_to_execute]: 0.0006377 [rewriter_before_opt_a]: 0.00010407 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.0113939, [2] [Cycle 1]: 0.00737643, [27] [switch_simplify]: 6.485e-05 [loop_unroll]: 3.058e-05 [a_1]: 0.00064876 [with_stream_mark]: 2.551e-05 [recompute_prepare]: 1.167e-05 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.95998e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4.91002e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.761e-05 [j_node_and_user_rematch]: 1.076e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 6.33998e-06 [renormalize]: 0.00616787 [add_forward_monad_depend]: 1.305e-05 [auto_monad_grad]: 3.08998e-06 [auto_monad_eliminator]: 2.518e-05 [cse]: 3.613e-05 [replace_applicator]: 2.548e-05 [Cycle 2]: 0.00039541, [27] [switch_simplify]: 6.83998e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00012924 [with_stream_mark]: 1.595e-05 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 3.79002e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 4.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.993e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.73997e-06 [cse]: 1.192e-05 [replace_applicator]: 5.52999e-06 [py_interpret_to_execute_after_opt_a]: 1.584e-05 [rewriter_after_opt_a]: 3.978e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.58002e-06 [mutable_eliminate]: 0.00079052 [jit_opt_b]: 5.912e-05, [1] [Cycle 1]: 5.026e-05, [2] [frontend_op_eliminate]: 1.9e-05 [inline_after_opt_a]: 1.975e-05 [cconv]: 3.157e-05 [loop_unroll]: 0.0004349 [jit_opt_after_cconv]: 0.00015251, [1] [Cycle 1]: 0.00014659, [11] [c_1]: 2.569e-05 [parameter_eliminate]: 2.88998e-06 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.288e-05 [call_graph_tuple_transform]: 2.041e-05 [tuple_list_get_item_eliminator]: 5.99e-06 [none_parameter_eliminate]: 1.25999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 8.74998e-06 [add_recomputation]: 5.208e-05 [cse_after_recomputation]: 2.355e-05, [1] [Cycle 1]: 1.738e-05, [1] [cse]: 1.132e-05 [auto_monad_reorder]: 1.545e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.00053708 [symbol_engine_optimizer]: 7.932e-05, [1] [Cycle 1]: 7.279e-05, [6] [build]: 4.37e-06 [elim_shapecalc]: 8.97e-06 [elim_not_effective]: 1.469e-05 [opt_reshape]: 6.93998e-06 [fold_const_symbol]: 9.44998e-06 [renormalize]: 7.00005e-07 [validate]: 4.545e-05 Sums bootstrap : 0.000329s : 0.17% type_inference : 0.183567s : 94.43% event_method : 0.000024s : 0.01% auto_monad : 0.000081s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000638s : 0.33% rewriter_before_opt_a : 0.000104s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.04% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000778s : 0.40% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.006168s : 3.17% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000048s : 0.02% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000791s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000435s : 0.22% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000537s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.02% Time group info: ------[substitution.] 0.000266 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 4: substitution.graph_param_transform 85.30% : 0.000227s : 4: substitution.inline 1.70% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000006s : 4: substitution.remove_not_recompute_node 2.35% : 0.000006s : 2: substitution.replace_old_param 4.88% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.183459 2 96.85% : 0.177688s : 1: type_inference.infer 3.15% : 0.005771s : 1: type_inference.specialize ------[replace.] 0.000087 6 69.68% : 0.000060s : 4: replace.inline 30.32% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000236 6 94.98% : 0.000224s : 4: match.inline 5.02% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 2.26% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.41% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.87% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 18: predicate.load_eliminater 1.08% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 2.14% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.81% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.46% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002400 22 62.47% : 0.001499s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.07% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.46% : 0.000851s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.205988 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000085s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.17% : 0.000344s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 5.53% : 0.011397s : 1: jit_opt_a 0.08% : 0.000155s : 1: jit_opt_after_cconv 0.03% : 0.000062s : 1: jit_opt_b 0.22% : 0.000443s : 1: loop_unroll 0.39% : 0.000800s : 1: mutable_eliminate 0.50% : 0.001039s : 26: opt.transform.jit_opt_a 0.03% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000545s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000649s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 2.52% : 0.005197s : 1: renormalize.infer 0.46% : 0.000955s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000100s : 1: rewriter_after_opt_a 0.05% : 0.000109s : 1: rewriter_before_opt_a 0.04% : 0.000082s : 1: symbol_engine_optimizer 89.12% : 0.183585s : 1: type_inference TotalTime = 0.128552, [30] [bootstrap]: 0.00033939 [type_inference]: 0.116673 [event_method]: 2.561e-05 [auto_monad]: 7.749e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00047018 [rewriter_before_opt_a]: 0.00010326 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.00837441, [2] [Cycle 1]: 0.00427821, [27] [switch_simplify]: 6.903e-05 [loop_unroll]: 3.447e-05 [a_1]: 0.00070489 [with_stream_mark]: 2.01e-05 [recompute_prepare]: 9.79e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 7.84002e-06 [updatestate_useless_node_eliminater]: 6.40002e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.62002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.698e-05 [j_node_and_user_rematch]: 1.129e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 7.16999e-06 [renormalize]: 0.00304554 [add_forward_monad_depend]: 8.32e-06 [auto_monad_grad]: 3.24001e-06 [auto_monad_eliminator]: 1.886e-05 [cse]: 3.849e-05 [replace_applicator]: 2.201e-05 [Cycle 2]: 0.00039556, [27] [switch_simplify]: 7.18998e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00012855 [with_stream_mark]: 1.503e-05 [recompute_prepare]: 6.38998e-06 [updatestate_depend_eliminate]: 3.82998e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.757e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 5.74e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 8.40024e-07 [auto_monad_eliminator]: 5.71003e-06 [cse]: 1.563e-05 [replace_applicator]: 6.39999e-06 [py_interpret_to_execute_after_opt_a]: 1.445e-05 [rewriter_after_opt_a]: 4.013e-05 [convert_after_rewriter]: 7.68001e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00069401 [jit_opt_b]: 5.886e-05, [1] [Cycle 1]: 5.208e-05, [2] [frontend_op_eliminate]: 2.123e-05 [inline_after_opt_a]: 1.923e-05 [cconv]: 2.718e-05 [loop_unroll]: 0.00043585 [jit_opt_after_cconv]: 0.00016212, [1] [Cycle 1]: 0.00015577, [11] [c_1]: 2.757e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 6.23002e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.607e-05 [call_graph_tuple_transform]: 2.302e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.39001e-06 [remove_dup_value]: 1.869e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 7.80998e-06 [add_recomputation]: 5.016e-05 [cse_after_recomputation]: 2.667e-05, [1] [Cycle 1]: 2.156e-05, [1] [cse]: 1.423e-05 [auto_monad_reorder]: 1.867e-05 [get_jit_bprop_graph]: 3.41999e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00048123 [symbol_engine_optimizer]: 0.0001699, [1] [Cycle 1]: 0.00016342, [6] [build]: 3.39001e-06 [elim_shapecalc]: 9.70002e-06 [elim_not_effective]: 0.0001015 [opt_reshape]: 7.58001e-06 [fold_const_symbol]: 1.051e-05 [renormalize]: 3.59985e-07 [validate]: 4.71e-05 Sums bootstrap : 0.000339s : 0.27% type_inference : 0.116673s : 93.93% event_method : 0.000026s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000470s : 0.38% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000833s : 0.67% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003046s : 2.45% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000694s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000436s : 0.35% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000481s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000102s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000346 25 25.07% : 0.000087s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000007s : 4: substitution.graph_param_transform 64.12% : 0.000222s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.53% : 0.000005s : 4: substitution.remove_not_recompute_node 1.50% : 0.000005s : 2: substitution.replace_old_param 4.15% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116571 2 97.45% : 0.113599s : 1: type_inference.infer 2.55% : 0.002972s : 1: type_inference.specialize ------[replace.] 0.000107 7 66.88% : 0.000072s : 5: replace.inline 33.12% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 7 94.37% : 0.000219s : 5: match.inline 5.63% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 1.85% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000001s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.90% : 0.000009s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.58% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 8: predicate.less_batch_normalization 1.93% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.54% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.81% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 1.02% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.79% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.14% : 0.000002s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.77% : 0.000004s : 20: predicate.switch_defer_inline 2.01% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.21% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.14% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002480 25 66.27% : 0.001643s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.54% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.19% : 0.000773s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132855 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000361s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.31% : 0.008378s : 1: jit_opt_a 0.12% : 0.000165s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.33% : 0.000444s : 1: loop_unroll 0.53% : 0.000703s : 1: mutable_eliminate 0.83% : 0.001103s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000126s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000478s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.66% : 0.002200s : 1: renormalize.infer 0.63% : 0.000832s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.13% : 0.000173s : 1: symbol_engine_optimizer 87.84% : 0.116697s : 1: type_inference TotalTime = 0.0778562, [30] [bootstrap]: 0.00032901 [type_inference]: 0.0670663 [event_method]: 1.917e-05 [auto_monad]: 6.931e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00027269 [rewriter_before_opt_a]: 8.026e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00772944, [2] [Cycle 1]: 0.00348799, [27] [switch_simplify]: 5.74e-05 [loop_unroll]: 2.968e-05 [a_1]: 0.00058735 [with_stream_mark]: 2.082e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.10998e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.68002e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 4.07003e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 5.89e-06 [renormalize]: 0.00243771 [add_forward_monad_depend]: 6.30002e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.608e-05 [cse]: 3.199e-05 [replace_applicator]: 1.643e-05 [Cycle 2]: 0.00036234, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00012097 [with_stream_mark]: 1.174e-05 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 3.15998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.45001e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 1.57999e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.179e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 1.172e-05 [rewriter_after_opt_a]: 3.574e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00059982 [jit_opt_b]: 5.208e-05, [1] [Cycle 1]: 4.533e-05, [2] [frontend_op_eliminate]: 1.771e-05 [inline_after_opt_a]: 1.645e-05 [cconv]: 2.51e-05 [loop_unroll]: 0.00046818 [jit_opt_after_cconv]: 0.00014996, [1] [Cycle 1]: 0.00014317, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.939e-05 [call_graph_tuple_transform]: 2.08e-05 [tuple_list_get_item_eliminator]: 6.69001e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 8.97999e-06 [add_recomputation]: 5.038e-05 [cse_after_recomputation]: 2.201e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 1.068e-05 [auto_monad_reorder]: 1.592e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 4.23001e-06 [opt_after_jit_grad]: 0.00047625 [symbol_engine_optimizer]: 9.843e-05, [1] [Cycle 1]: 9.216e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 8.38001e-06 [elim_not_effective]: 1.51e-05 [opt_reshape]: 7.16001e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 3.89991e-07 [validate]: 4.855e-05 Sums bootstrap : 0.000329s : 0.45% type_inference : 0.067066s : 91.41% event_method : 0.000019s : 0.03% auto_monad : 0.000069s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000273s : 0.37% rewriter_before_opt_a : 0.000080s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000708s : 0.97% jit_opt_a.with_stream_mark : 0.000033s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002438s : 3.32% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000044s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000600s : 0.82% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000468s : 0.64% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000476s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000222 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.81% : 0.000006s : 4: substitution.graph_param_transform 84.20% : 0.000187s : 4: substitution.inline 1.58% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 5.67% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066989 2 97.12% : 0.065060s : 1: type_inference.infer 2.88% : 0.001929s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.07% : 0.000051s : 4: replace.inline 30.93% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.16% : 0.000184s : 4: match.inline 5.84% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.70% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.46% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 2.14% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000001s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004298 34 83.81% : 0.003602s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.02% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 15.17% : 0.000652s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.081294 72 0.07% : 0.000053s : 1: add_recomputation 0.09% : 0.000073s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.43% : 0.000346s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.51% : 0.007733s : 1: jit_opt_a 0.19% : 0.000153s : 1: jit_opt_after_cconv 0.07% : 0.000055s : 1: jit_opt_b 0.59% : 0.000476s : 1: loop_unroll 0.75% : 0.000608s : 1: mutable_eliminate 1.16% : 0.000940s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000278s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.10% : 0.001707s : 1: renormalize.infer 0.89% : 0.000721s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.10% : 0.000085s : 1: rewriter_before_opt_a 0.12% : 0.000101s : 1: symbol_engine_optimizer 82.52% : 0.067082s : 1: type_inference TotalTime = 0.119426, [30] [bootstrap]: 0.00035075 [type_inference]: 0.108208 [event_method]: 2.192e-05 [auto_monad]: 0.00013305 [graph_reusing]: 6.77002e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 0.00046293 [rewriter_before_opt_a]: 0.00010048 [expand_dump_flag]: 4.23999e-06 [jit_opt_a]: 0.00775158, [2] [Cycle 1]: 0.0037713, [27] [switch_simplify]: 6.645e-05 [loop_unroll]: 3.454e-05 [a_1]: 0.00072122 [with_stream_mark]: 2.196e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 6.68e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.629e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00255717 [add_forward_monad_depend]: 6.74999e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.686e-05 [cse]: 3.521e-05 [replace_applicator]: 1.721e-05 [Cycle 2]: 0.00045686, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00019034 [with_stream_mark]: 1.231e-05 [recompute_prepare]: 7.52002e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.308e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.838e-05 [replace_applicator]: 6.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.417e-05 [rewriter_after_opt_a]: 4.057e-05 [convert_after_rewriter]: 6.98998e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.0006631 [jit_opt_b]: 5.553e-05, [1] [Cycle 1]: 4.867e-05, [2] [frontend_op_eliminate]: 1.926e-05 [inline_after_opt_a]: 1.84e-05 [cconv]: 2.805e-05 [loop_unroll]: 0.00043243 [jit_opt_after_cconv]: 0.00015169, [1] [Cycle 1]: 0.00014537, [11] [c_1]: 2.609e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.079e-05 [call_graph_tuple_transform]: 2.201e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.15002e-06 [remove_dup_value]: 1.738e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.20999e-06 [add_recomputation]: 5.068e-05 [cse_after_recomputation]: 2.312e-05, [1] [Cycle 1]: 1.828e-05, [1] [cse]: 1.204e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 1.80001e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00047327 [symbol_engine_optimizer]: 7.477e-05, [1] [Cycle 1]: 6.888e-05, [6] [build]: 3.52002e-06 [elim_shapecalc]: 9.21998e-06 [elim_not_effective]: 1.406e-05 [opt_reshape]: 6.30997e-06 [fold_const_symbol]: 9.82001e-06 [renormalize]: 3.50003e-07 [validate]: 0.00011201 Sums bootstrap : 0.000351s : 0.30% type_inference : 0.108208s : 93.86% event_method : 0.000022s : 0.02% auto_monad : 0.000133s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000463s : 0.40% rewriter_before_opt_a : 0.000100s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000912s : 0.79% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002557s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000054s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000663s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000432s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000473s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000112s : 0.10% Time group info: ------[substitution.] 0.000287 28 1.02% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 4: substitution.graph_param_transform 83.62% : 0.000240s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.01% : 0.000012s : 3: substitution.reduce_eliminate 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000005s : 2: substitution.replace_old_param 3.91% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108128 2 97.52% : 0.105443s : 1: type_inference.infer 2.48% : 0.002685s : 1: type_inference.specialize ------[replace.] 0.000100 7 69.57% : 0.000069s : 5: replace.inline 30.43% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 7 96.00% : 0.000236s : 5: match.inline 4.00% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.45% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.94% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.41% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.63% : 0.000011s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.55% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.20% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002343 25 65.28% : 0.001530s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.30% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.42% : 0.000736s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123146 72 0.04% : 0.000053s : 1: add_recomputation 0.11% : 0.000137s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000376s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.30% : 0.007755s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000440s : 1: loop_unroll 0.55% : 0.000672s : 1: mutable_eliminate 0.95% : 0.001165s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000473s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.48% : 0.001817s : 1: renormalize.infer 0.59% : 0.000730s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.09% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 87.88% : 0.108223s : 1: type_inference TotalTime = 0.0605845, [30] [bootstrap]: 0.00033981 [type_inference]: 0.051371 [event_method]: 2.014e-05 [auto_monad]: 6.91e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.0001613 [rewriter_before_opt_a]: 7.77e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.00629074, [2] [Cycle 1]: 0.0025351, [27] [switch_simplify]: 4.887e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00055219 [with_stream_mark]: 1.81e-05 [recompute_prepare]: 7.77e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.91998e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 0.00155121 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.697e-05 [cse]: 3.212e-05 [replace_applicator]: 1.476e-05 [Cycle 2]: 0.00033047, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.13002e-06 [a_1]: 9.422e-05 [with_stream_mark]: 9.89999e-06 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.364e-05 [j_node_and_user_rematch]: 8.54002e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.73001e-06 [inline_without_move]: 4.87e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.328e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.537e-05 [rewriter_after_opt_a]: 3.659e-05 [convert_after_rewriter]: 6.80002e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00063033 [jit_opt_b]: 5.142e-05, [1] [Cycle 1]: 4.362e-05, [2] [frontend_op_eliminate]: 1.607e-05 [inline_after_opt_a]: 1.67e-05 [cconv]: 2.649e-05 [loop_unroll]: 0.00046687 [jit_opt_after_cconv]: 0.0001472, [1] [Cycle 1]: 0.00014029, [11] [c_1]: 2.188e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.12e-05 [call_graph_tuple_transform]: 1.946e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.98002e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.562e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 6.14001e-06 [add_recomputation]: 4.736e-05 [cse_after_recomputation]: 2.334e-05, [1] [Cycle 1]: 1.766e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.709e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 4.19002e-06 [opt_after_jit_grad]: 0.00045216 [symbol_engine_optimizer]: 7.374e-05, [1] [Cycle 1]: 6.775e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 7.66001e-06 [elim_not_effective]: 1.343e-05 [opt_reshape]: 5.40999e-06 [fold_const_symbol]: 9.68997e-06 [renormalize]: 4.30009e-07 [validate]: 3.873e-05 Sums bootstrap : 0.000340s : 0.60% type_inference : 0.051371s : 90.79% event_method : 0.000020s : 0.04% auto_monad : 0.000069s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000161s : 0.29% rewriter_before_opt_a : 0.000078s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000055s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000646s : 1.14% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.001551s : 2.74% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000045s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000630s : 1.11% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000026s : 0.05% loop_unroll : 0.000467s : 0.83% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000047s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000452s : 0.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.07% Time group info: ------[substitution.] 0.000212 23 1.21% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 3: substitution.graph_param_transform 84.69% : 0.000180s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000004s : 4: substitution.remove_not_recompute_node 1.52% : 0.000003s : 2: substitution.replace_old_param 6.00% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051300 2 96.59% : 0.049549s : 1: type_inference.infer 3.41% : 0.001751s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.77% : 0.000049s : 4: replace.inline 32.23% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.84% : 0.000177s : 4: match.inline 6.16% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.40% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.24% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.98% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.31% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 53: predicate.switch_simplify 1.41% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.08% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001233 13 30.03% : 0.000370s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.47% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 66.50% : 0.000820s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063055 72 0.08% : 0.000050s : 1: add_recomputation 0.11% : 0.000072s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.57% : 0.000361s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.98% : 0.006295s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.75% : 0.000476s : 1: loop_unroll 1.01% : 0.000639s : 1: mutable_eliminate 1.36% : 0.000860s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000166s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.12% : 0.000707s : 1: renormalize.infer 1.33% : 0.000836s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000076s : 1: symbol_engine_optimizer 81.49% : 0.051384s : 1: type_inference TotalTime = 0.164088, [30] [bootstrap]: 0.00034712 [type_inference]: 0.151491 [event_method]: 2.524e-05 [auto_monad]: 7.783e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00058341 [rewriter_before_opt_a]: 0.00015357 [expand_dump_flag]: 4.82e-06 [jit_opt_a]: 0.00892192, [2] [Cycle 1]: 0.00469271, [27] [switch_simplify]: 6.371e-05 [loop_unroll]: 6.618e-05 [a_1]: 0.00085142 [with_stream_mark]: 2.519e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.83001e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 7.21999e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 7.43e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 1.052e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.089e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.003298 [add_forward_monad_depend]: 7.55998e-06 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 1.874e-05 [cse]: 3.843e-05 [replace_applicator]: 1.817e-05 [Cycle 2]: 0.00039773, [27] [switch_simplify]: 7.20998e-06 [loop_unroll]: 6.73e-06 [a_1]: 0.00013752 [with_stream_mark]: 1.366e-05 [recompute_prepare]: 6.39001e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.71998e-06 [merge_forward]: 3.38999e-06 [cell_reuse_recompute_pass]: 3.01999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 6.17001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.416e-05 [replace_applicator]: 6.44001e-06 [py_interpret_to_execute_after_opt_a]: 1.454e-05 [rewriter_after_opt_a]: 3.919e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 5.53997e-06 [mutable_eliminate]: 0.00074622 [jit_opt_b]: 5.981e-05, [1] [Cycle 1]: 5.133e-05, [2] [frontend_op_eliminate]: 2.027e-05 [inline_after_opt_a]: 1.88e-05 [cconv]: 2.747e-05 [loop_unroll]: 0.00044424 [jit_opt_after_cconv]: 0.00016531, [1] [Cycle 1]: 0.00015832, [11] [c_1]: 2.738e-05 [parameter_eliminate]: 2.94001e-06 [updatestate_depend_eliminate]: 6.79001e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.703e-05 [call_graph_tuple_transform]: 2.331e-05 [tuple_list_get_item_eliminator]: 6.38003e-06 [none_parameter_eliminate]: 2.36e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 5.376e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.793e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.24999e-06 [opt_after_jit_grad]: 0.00047331 [symbol_engine_optimizer]: 0.00010417, [1] [Cycle 1]: 9.692e-05, [6] [build]: 4.16001e-06 [elim_shapecalc]: 8.76002e-06 [elim_not_effective]: 1.54e-05 [opt_reshape]: 7.75e-06 [fold_const_symbol]: 1.172e-05 [renormalize]: 4.39992e-07 [validate]: 5.193e-05 Sums bootstrap : 0.000347s : 0.22% type_inference : 0.151491s : 94.92% event_method : 0.000025s : 0.02% auto_monad : 0.000078s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000583s : 0.37% rewriter_before_opt_a : 0.000154s : 0.10% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.04% jit_opt_a.loop_unroll : 0.000073s : 0.05% jit_opt_a.a_1 : 0.000989s : 0.62% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003298s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000053s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000746s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000444s : 0.28% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000473s : 0.30% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.03% Time group info: ------[substitution.] 0.000322 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.88% : 0.000006s : 4: substitution.graph_param_transform 84.68% : 0.000272s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.93% : 0.000013s : 3: substitution.reduce_eliminate 1.40% : 0.000004s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 4.00% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151390 2 97.60% : 0.147758s : 1: type_inference.infer 2.40% : 0.003633s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.55% : 0.000074s : 5: replace.inline 31.45% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000281 7 95.86% : 0.000270s : 5: match.inline 4.14% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.28% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.43% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 6.26% : 0.000010s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.48% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.82% : 0.000004s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.79% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.10% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.58% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002758 25 63.91% : 0.001762s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.28% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.81% : 0.000905s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.168723 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000366s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.29% : 0.008927s : 1: jit_opt_a 0.10% : 0.000168s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.27% : 0.000452s : 1: loop_unroll 0.45% : 0.000756s : 1: mutable_eliminate 0.76% : 0.001275s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000482s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000591s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.40% : 0.002365s : 1: renormalize.infer 0.55% : 0.000922s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.10% : 0.000160s : 1: rewriter_before_opt_a 0.06% : 0.000107s : 1: symbol_engine_optimizer 89.80% : 0.151514s : 1: type_inference TotalTime = 0.0175906, [30] [bootstrap]: 0.0003362 [type_inference]: 0.00921366 [event_method]: 2.167e-05 [auto_monad]: 6.983e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 4.366e-05 [rewriter_before_opt_a]: 8.495e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00560102, [2] [Cycle 1]: 0.00193763, [27] [switch_simplify]: 6.239e-05 [loop_unroll]: 3.335e-05 [a_1]: 0.00064491 [with_stream_mark]: 1.946e-05 [recompute_prepare]: 7.96001e-06 [updatestate_depend_eliminate]: 4.81002e-06 [updatestate_assign_eliminate]: 3.47997e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.13998e-06 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00083245 [add_forward_monad_depend]: 5.89e-06 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.531e-05 [cse]: 3.913e-05 [replace_applicator]: 1.252e-05 [Cycle 2]: 0.0003372, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.64e-06 [a_1]: 9.592e-05 [with_stream_mark]: 9.18002e-06 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.66998e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 4.87998e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 8.33001e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.34002e-06 [inline_without_move]: 5.19e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.5e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.167e-05 [rewriter_after_opt_a]: 3.82e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00052841 [jit_opt_b]: 4.946e-05, [1] [Cycle 1]: 4.268e-05, [2] [frontend_op_eliminate]: 1.566e-05 [inline_after_opt_a]: 1.574e-05 [cconv]: 2.561e-05 [loop_unroll]: 0.00043992 [jit_opt_after_cconv]: 0.00015679, [1] [Cycle 1]: 0.00015024, [11] [c_1]: 2.321e-05 [parameter_eliminate]: 2.58998e-06 [updatestate_depend_eliminate]: 6.09999e-06 [updatestate_assign_eliminate]: 2.68003e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.521e-05 [call_graph_tuple_transform]: 2.007e-05 [tuple_list_get_item_eliminator]: 6.44001e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 3.45e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 5.321e-05 [cse_after_recomputation]: 2.614e-05, [1] [Cycle 1]: 2.045e-05, [1] [cse]: 1.404e-05 [auto_monad_reorder]: 1.841e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.08002e-06 [opt_after_jit_grad]: 0.00050539 [symbol_engine_optimizer]: 7.237e-05, [1] [Cycle 1]: 6.614e-05, [6] [build]: 3.28998e-06 [elim_shapecalc]: 7.87998e-06 [elim_not_effective]: 1.246e-05 [opt_reshape]: 6.18998e-06 [fold_const_symbol]: 9.01998e-06 [renormalize]: 3.89991e-07 [validate]: 3.916e-05 Sums bootstrap : 0.000336s : 2.46% type_inference : 0.009214s : 67.40% event_method : 0.000022s : 0.16% auto_monad : 0.000070s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.32% rewriter_before_opt_a : 0.000085s : 0.62% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.50% jit_opt_a.loop_unroll : 0.000039s : 0.29% jit_opt_a.a_1 : 0.000741s : 5.42% jit_opt_a.with_stream_mark : 0.000029s : 0.21% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000833s : 6.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000054s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000038s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000528s : 3.87% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000026s : 0.19% loop_unroll : 0.000440s : 3.22% jit_opt_after_cconv.c_1 : 0.000023s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000035s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000505s : 3.70% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.29% Time group info: ------[substitution.] 0.000258 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 87.17% : 0.000225s : 5: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000004s : 4: substitution.remove_not_recompute_node 1.46% : 0.000004s : 2: substitution.replace_old_param 5.06% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009145 2 89.42% : 0.008178s : 1: type_inference.infer 10.58% : 0.000967s : 1: type_inference.specialize ------[replace.] 0.000092 7 67.60% : 0.000062s : 5: replace.inline 32.40% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000234 7 94.92% : 0.000222s : 5: match.inline 5.08% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.61% : 0.000002s : 11: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.77% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.19% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.43% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000007s : 24: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.95% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 1.78% : 0.000002s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.48% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.74% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.06% : 0.000010s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.43% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000791 16 51.53% : 0.000407s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.78% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.69% : 0.000306s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019448 72 0.29% : 0.000056s : 1: add_recomputation 0.38% : 0.000073s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.83% : 0.000357s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 28.81% : 0.005604s : 1: jit_opt_a 0.82% : 0.000160s : 1: jit_opt_after_cconv 0.27% : 0.000052s : 1: jit_opt_b 2.30% : 0.000448s : 1: loop_unroll 2.76% : 0.000537s : 1: mutable_eliminate 4.97% : 0.000967s : 26: opt.transform.jit_opt_a 0.27% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.64% : 0.000513s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000047s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000038s : 1: remove_dup_value 2.50% : 0.000487s : 1: renormalize.infer 1.74% : 0.000338s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000041s : 1: rewriter_after_opt_a 0.45% : 0.000088s : 1: rewriter_before_opt_a 0.38% : 0.000075s : 1: symbol_engine_optimizer 47.46% : 0.009231s : 1: type_inference TotalTime = 0.072375, [30] [bootstrap]: 0.00033138 [type_inference]: 0.0608185 [event_method]: 2.396e-05 [auto_monad]: 8.134e-05 [graph_reusing]: 7.2e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.0001754 [rewriter_before_opt_a]: 0.00011054 [expand_dump_flag]: 4.63001e-06 [jit_opt_a]: 0.00809534, [2] [Cycle 1]: 0.00338177, [27] [switch_simplify]: 6.927e-05 [loop_unroll]: 4.564e-05 [a_1]: 0.00061346 [with_stream_mark]: 2.431e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.42002e-06 [parameter_eliminate]: 2.45002e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.61998e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00222332 [add_forward_monad_depend]: 7.4e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.96e-05 [cse]: 3.727e-05 [replace_applicator]: 2.146e-05 [Cycle 2]: 0.00036192, [27] [switch_simplify]: 7.61001e-06 [loop_unroll]: 5.50001e-06 [a_1]: 9.908e-05 [with_stream_mark]: 1.564e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.42001e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.72e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.70001e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 7.43e-06 [cse]: 1.429e-05 [replace_applicator]: 5.76003e-06 [py_interpret_to_execute_after_opt_a]: 1.693e-05 [rewriter_after_opt_a]: 4.955e-05 [convert_after_rewriter]: 7.18998e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.00079355 [jit_opt_b]: 5.967e-05, [1] [Cycle 1]: 5.018e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 1.85e-05 [cconv]: 3.03e-05 [loop_unroll]: 0.00049045 [jit_opt_after_cconv]: 0.00017247, [1] [Cycle 1]: 0.00016558, [11] [c_1]: 2.219e-05 [parameter_eliminate]: 4.23999e-06 [updatestate_depend_eliminate]: 8.67e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.128e-05 [call_graph_tuple_transform]: 2.302e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 2.09999e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.91e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 7.26999e-06 [add_recomputation]: 9.689e-05 [cse_after_recomputation]: 2.814e-05, [1] [Cycle 1]: 2.217e-05, [1] [cse]: 1.549e-05 [auto_monad_reorder]: 1.979e-05 [get_jit_bprop_graph]: 2.38002e-06 [rewriter_after_jit_bprop_graph]: 5.78002e-06 [opt_after_jit_grad]: 0.00054326 [symbol_engine_optimizer]: 7.745e-05, [1] [Cycle 1]: 6.929e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.444e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 5.00004e-07 [validate]: 7.434e-05 Sums bootstrap : 0.000331s : 0.49% type_inference : 0.060819s : 90.32% event_method : 0.000024s : 0.04% auto_monad : 0.000081s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000175s : 0.26% rewriter_before_opt_a : 0.000111s : 0.16% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000077s : 0.11% jit_opt_a.loop_unroll : 0.000051s : 0.08% jit_opt_a.a_1 : 0.000713s : 1.06% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002223s : 3.30% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.04% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000050s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000794s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000490s : 0.73% jit_opt_after_cconv.c_1 : 0.000022s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000097s : 0.14% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000543s : 0.81% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000074s : 0.11% Time group info: ------[substitution.] 0.000253 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000007s : 3: substitution.graph_param_transform 84.59% : 0.000214s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000005s : 2: substitution.replace_old_param 5.35% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060715 2 96.82% : 0.058787s : 1: type_inference.infer 3.18% : 0.001928s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.40% : 0.000056s : 4: replace.inline 31.60% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.47% : 0.000211s : 4: match.inline 5.53% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 691 1.96% : 0.000003s : 10: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.13% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 0.97% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.02% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.07% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 6.19% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.72% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000002s : 10: predicate.print_const_string_wrapper 1.46% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000003s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.57% : 0.000001s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000003s : 16: predicate.switch_defer_inline 1.87% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.51% : 0.000011s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.74% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.68% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.47% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000996 13 42.90% : 0.000427s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.14% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.96% : 0.000518s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075606 72 0.13% : 0.000102s : 1: add_recomputation 0.11% : 0.000086s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.46% : 0.000351s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 10.71% : 0.008099s : 1: jit_opt_a 0.23% : 0.000175s : 1: jit_opt_after_cconv 0.08% : 0.000063s : 1: jit_opt_b 0.66% : 0.000500s : 1: loop_unroll 1.07% : 0.000806s : 1: mutable_eliminate 1.29% : 0.000978s : 26: opt.transform.jit_opt_a 0.07% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000182s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 2.17% : 0.001638s : 1: renormalize.infer 0.76% : 0.000571s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000054s : 1: rewriter_after_opt_a 0.16% : 0.000118s : 1: rewriter_before_opt_a 0.11% : 0.000080s : 1: symbol_engine_optimizer 80.47% : 0.060843s : 1: type_inference TotalTime = 0.135979, [30] [bootstrap]: 0.00032065 [type_inference]: 0.124169 [event_method]: 1.94e-05 [auto_monad]: 7.065e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.00028394 [rewriter_before_opt_a]: 8.554e-05 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.00804254, [2] [Cycle 1]: 0.00404213, [27] [switch_simplify]: 5.894e-05 [loop_unroll]: 3.084e-05 [a_1]: 0.00059466 [with_stream_mark]: 2.093e-05 [recompute_prepare]: 8.33001e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 4.32998e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.4e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00296075 [add_forward_monad_depend]: 9.88002e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.801e-05 [cse]: 3.37e-05 [replace_applicator]: 1.967e-05 [Cycle 2]: 0.00037687, [27] [switch_simplify]: 7.5e-06 [loop_unroll]: 5.85002e-06 [a_1]: 0.00012313 [with_stream_mark]: 1.256e-05 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 3.16001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.85e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.164e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.347e-05 [rewriter_after_opt_a]: 3.844e-05 [convert_after_rewriter]: 7.49002e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00069801 [jit_opt_b]: 5.593e-05, [1] [Cycle 1]: 4.853e-05, [2] [frontend_op_eliminate]: 1.98e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 2.906e-05 [loop_unroll]: 0.00043054 [jit_opt_after_cconv]: 0.00015948, [1] [Cycle 1]: 0.00015328, [11] [c_1]: 2.589e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 7.07002e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 2.655e-05 [call_graph_tuple_transform]: 2.122e-05 [tuple_list_get_item_eliminator]: 6.83e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.566e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 8.77e-06 [add_recomputation]: 5.292e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.749e-05, [1] [cse]: 1.174e-05 [auto_monad_reorder]: 1.574e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 5.32001e-06 [opt_after_jit_grad]: 0.00107001 [symbol_engine_optimizer]: 0.00010152, [1] [Cycle 1]: 9.496e-05, [6] [build]: 3.85998e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 2.997e-05 [fold_const_symbol]: 1.017e-05 [renormalize]: 5.3001e-07 [validate]: 4.641e-05 Sums bootstrap : 0.000321s : 0.24% type_inference : 0.124169s : 94.25% event_method : 0.000019s : 0.01% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000284s : 0.22% rewriter_before_opt_a : 0.000086s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000718s : 0.54% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002961s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000698s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000431s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.001070s : 0.81% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000030s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000227 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 4: substitution.graph_param_transform 83.93% : 0.000191s : 4: substitution.inline 1.79% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000005s : 2: substitution.replace_old_param 5.33% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124071 2 97.57% : 0.121058s : 1: type_inference.infer 2.43% : 0.003012s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.78% : 0.000052s : 4: replace.inline 31.22% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.52% : 0.000188s : 4: match.inline 5.48% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.47% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.41% : 0.000002s : 12: predicate.print_const_string_wrapper 1.83% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.08% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.81% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002382 26 73.12% : 0.001742s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.25% : 0.000601s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139992 72 0.04% : 0.000056s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000339s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.75% : 0.008047s : 1: jit_opt_a 0.12% : 0.000162s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.31% : 0.000439s : 1: loop_unroll 0.51% : 0.000709s : 1: mutable_eliminate 0.69% : 0.000962s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000059s : 4: opt.transform.symbol_engine_opt 0.77% : 0.001081s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000290s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.61% : 0.002256s : 1: renormalize.infer 0.50% : 0.000695s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000104s : 1: symbol_engine_optimizer 88.71% : 0.124187s : 1: type_inference TotalTime = 0.133614, [30] [bootstrap]: 0.00033315 [type_inference]: 0.120565 [event_method]: 2.439e-05 [auto_monad]: 7.659e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00060995 [rewriter_before_opt_a]: 0.00010461 [expand_dump_flag]: 4.62e-06 [jit_opt_a]: 0.00878081, [2] [Cycle 1]: 0.00463248, [27] [switch_simplify]: 7.561e-05 [loop_unroll]: 3.777e-05 [a_1]: 0.0007896 [with_stream_mark]: 2.364e-05 [recompute_prepare]: 8.97e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.695e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.072e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00326962 [add_forward_monad_depend]: 8.96002e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.117e-05 [cse]: 4.008e-05 [replace_applicator]: 2.746e-05 [Cycle 2]: 0.00042503, [27] [switch_simplify]: 7.66999e-06 [loop_unroll]: 6.72002e-06 [a_1]: 0.00014628 [with_stream_mark]: 1.856e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.66998e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 4.17998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.91e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.03997e-06 [auto_monad_grad]: 1.40999e-06 [auto_monad_eliminator]: 7.71999e-06 [cse]: 1.694e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.827e-05 [rewriter_after_opt_a]: 4.464e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00074743 [jit_opt_b]: 0.00011119, [1] [Cycle 1]: 0.00010265, [2] [frontend_op_eliminate]: 2.017e-05 [inline_after_opt_a]: 6.952e-05 [cconv]: 3.499e-05 [loop_unroll]: 0.00054507 [jit_opt_after_cconv]: 0.00031724, [1] [Cycle 1]: 0.00030918, [11] [c_1]: 2.68e-05 [parameter_eliminate]: 4.17e-06 [updatestate_depend_eliminate]: 8.17998e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.50002e-06 [cse]: 3.707e-05 [call_graph_tuple_transform]: 2.528e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 2.34999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 9.76e-06 [remove_dup_value]: 2.311e-05 [partial_unused_args_eliminate]: 3.32002e-06 [environ_conv]: 9.57001e-06 [add_recomputation]: 6.063e-05 [cse_after_recomputation]: 3.018e-05, [1] [Cycle 1]: 2.291e-05, [1] [cse]: 1.652e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 6.92002e-06 [opt_after_jit_grad]: 0.00057189 [symbol_engine_optimizer]: 9.222e-05, [1] [Cycle 1]: 8.549e-05, [6] [build]: 4.62e-06 [elim_shapecalc]: 1.146e-05 [elim_not_effective]: 2.169e-05 [opt_reshape]: 6.73998e-06 [fold_const_symbol]: 1.113e-05 [renormalize]: 5.50004e-07 [validate]: 0.0002084 Sums bootstrap : 0.000333s : 0.26% type_inference : 0.120565s : 93.44% event_method : 0.000024s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000610s : 0.47% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.000936s : 0.73% jit_opt_a.with_stream_mark : 0.000042s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003270s : 2.53% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000057s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000747s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000070s : 0.05% cconv : 0.000035s : 0.03% loop_unroll : 0.000545s : 0.42% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.01% remove_dup_value : 0.000023s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000061s : 0.05% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000572s : 0.44% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000208s : 0.16% Time group info: ------[substitution.] 0.000327 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 1.01% : 0.000003s : 2: substitution.fold_const_symbol 2.34% : 0.000008s : 4: substitution.graph_param_transform 83.17% : 0.000272s : 5: substitution.inline 1.05% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.36% : 0.000014s : 3: substitution.reduce_eliminate 1.72% : 0.000006s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 3.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120455 2 97.17% : 0.117042s : 1: type_inference.infer 2.83% : 0.003414s : 1: type_inference.specialize ------[replace.] 0.000115 7 68.93% : 0.000079s : 5: replace.inline 31.07% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 7 96.10% : 0.000268s : 5: match.inline 3.90% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 886 1.71% : 0.000003s : 13: predicate.accumulaten_eliminater 1.50% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.55% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.49% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.73% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.29% : 0.000002s : 13: predicate.minmaximum_grad 1.74% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 2.08% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.49% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 20: predicate.switch_defer_inline 2.25% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.37% : 0.000012s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.13% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003171 25 68.11% : 0.002160s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.25% : 0.000927s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138069 72 0.05% : 0.000063s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000378s : 1: bootstrap 0.03% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.36% : 0.008785s : 1: jit_opt_a 0.23% : 0.000321s : 1: jit_opt_after_cconv 0.08% : 0.000114s : 1: jit_opt_b 0.40% : 0.000555s : 1: loop_unroll 0.55% : 0.000761s : 1: mutable_eliminate 0.88% : 0.001212s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000082s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000024s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000584s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.000617s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000026s : 1: remove_dup_value 1.62% : 0.002235s : 1: renormalize.infer 0.74% : 0.001020s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.07% : 0.000095s : 1: symbol_engine_optimizer 87.34% : 0.120587s : 1: type_inference TotalTime = 0.135818, [30] [bootstrap]: 0.00034509 [type_inference]: 0.117948 [event_method]: 2.855e-05 [auto_monad]: 8.22e-05 [graph_reusing]: 6.72002e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.00046645 [rewriter_before_opt_a]: 0.00011287 [expand_dump_flag]: 4.74e-06 [jit_opt_a]: 0.0086637, [2] [Cycle 1]: 0.00434562, [27] [switch_simplify]: 7.671e-05 [loop_unroll]: 3.629e-05 [a_1]: 0.00081445 [with_stream_mark]: 2.896e-05 [recompute_prepare]: 1.171e-05 [updatestate_depend_eliminate]: 5.01002e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 8.32e-06 [updatestate_useless_node_eliminater]: 6.96999e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 4.86002e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.874e-05 [j_node_and_user_rematch]: 1.166e-05 [meta_fg_expand]: 3.01001e-06 [replace_old_param]: 1.165e-05 [inline_without_move]: 6.40002e-06 [renormalize]: 0.00295335 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 2.392e-05 [cse]: 4.166e-05 [replace_applicator]: 2.285e-05 [Cycle 2]: 0.00040384, [27] [switch_simplify]: 6.80002e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.000124 [with_stream_mark]: 1.599e-05 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 5.98002e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.983e-05 [j_node_and_user_rematch]: 9.52999e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.79e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 7.40998e-06 [cse]: 1.855e-05 [replace_applicator]: 6.65002e-06 [py_interpret_to_execute_after_opt_a]: 1.75e-05 [rewriter_after_opt_a]: 4.118e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.00078706 [jit_opt_b]: 6.253e-05, [1] [Cycle 1]: 5.3e-05, [2] [frontend_op_eliminate]: 2.005e-05 [inline_after_opt_a]: 2.053e-05 [cconv]: 3.268e-05 [loop_unroll]: 0.00588743 [jit_opt_after_cconv]: 0.00022025, [1] [Cycle 1]: 0.0002096, [11] [c_1]: 3.16e-05 [parameter_eliminate]: 5.36002e-06 [updatestate_depend_eliminate]: 1.061e-05 [updatestate_assign_eliminate]: 3.64002e-06 [updatestate_loads_eliminate]: 3.22002e-06 [cse]: 5.091e-05 [call_graph_tuple_transform]: 2.726e-05 [tuple_list_get_item_eliminator]: 7.58001e-06 [none_parameter_eliminate]: 2.32001e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 7.43e-06 [remove_dup_value]: 2.356e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 1.176e-05 [add_recomputation]: 6.146e-05 [cse_after_recomputation]: 2.904e-05, [1] [Cycle 1]: 2.123e-05, [1] [cse]: 1.503e-05 [auto_monad_reorder]: 1.846e-05 [get_jit_bprop_graph]: 2.51e-06 [rewriter_after_jit_bprop_graph]: 7.54002e-06 [opt_after_jit_grad]: 0.00055382 [symbol_engine_optimizer]: 9.005e-05, [1] [Cycle 1]: 8.35e-05, [6] [build]: 4.86997e-06 [elim_shapecalc]: 1.03e-05 [elim_not_effective]: 1.681e-05 [opt_reshape]: 7.12002e-06 [fold_const_symbol]: 1.546e-05 [renormalize]: 3.9002e-07 [validate]: 5.623e-05 Sums bootstrap : 0.000345s : 0.26% type_inference : 0.117948s : 89.91% event_method : 0.000029s : 0.02% auto_monad : 0.000082s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000466s : 0.36% rewriter_before_opt_a : 0.000113s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000938s : 0.72% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002953s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000060s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000787s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000033s : 0.02% loop_unroll : 0.005887s : 4.49% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000051s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000024s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000061s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000554s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.04% Time group info: ------[substitution.] 0.000341 25 0.57% : 0.000002s : 2: substitution.elim_not_effective 2.10% : 0.000007s : 2: substitution.fold_const_symbol 2.02% : 0.000007s : 4: substitution.graph_param_transform 86.14% : 0.000294s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000006s : 4: substitution.remove_not_recompute_node 1.81% : 0.000006s : 2: substitution.replace_old_param 4.28% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117838 2 97.35% : 0.114712s : 1: type_inference.infer 2.65% : 0.003126s : 1: type_inference.specialize ------[replace.] 0.000117 7 67.95% : 0.000079s : 5: replace.inline 32.05% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000304 7 95.61% : 0.000290s : 5: match.inline 4.39% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000162 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.08% : 0.000002s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.16% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.38% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.80% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 6.30% : 0.000010s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 2.56% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.44% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 2.14% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000004s : 19: predicate.partial_eliminate 1.41% : 0.000002s : 13: predicate.print_const_string_wrapper 1.45% : 0.000002s : 13: predicate.reduce_eliminate 1.63% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 23: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000002s : 8: predicate.specialize_transform 1.24% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.70% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000004s : 20: predicate.switch_defer_inline 1.91% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.96% : 0.000013s : 64: predicate.switch_simplify 1.15% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.63% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002566 25 65.37% : 0.001678s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.63% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.99% : 0.000795s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140098 72 0.05% : 0.000065s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000367s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.19% : 0.008667s : 1: jit_opt_a 0.16% : 0.000224s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 4.22% : 0.005907s : 1: loop_unroll 0.57% : 0.000800s : 1: mutable_eliminate 0.87% : 0.001225s : 26: opt.transform.jit_opt_a 0.05% : 0.000070s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000035s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000563s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000475s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000026s : 1: remove_dup_value 1.51% : 0.002111s : 1: renormalize.infer 0.59% : 0.000830s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.09% : 0.000119s : 1: rewriter_before_opt_a 0.07% : 0.000093s : 1: symbol_engine_optimizer 84.21% : 0.117979s : 1: type_inference TotalTime = 0.066244, [30] [bootstrap]: 0.0003787 [type_inference]: 0.0267033 [event_method]: 2.257e-05 [auto_monad]: 0.0291686 [graph_reusing]: 8.74e-06 [pre_auto_parallel]: 3.83001e-06 [py_interpret_to_execute]: 0.0003005 [rewriter_before_opt_a]: 0.00010303 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00662665, [2] [Cycle 1]: 0.00244512, [27] [switch_simplify]: 5.866e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00062965 [with_stream_mark]: 2.357e-05 [recompute_prepare]: 1.258e-05 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 6.47001e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.75002e-06 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00123859 [add_forward_monad_depend]: 7.15e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.638e-05 [cse]: 3.924e-05 [replace_applicator]: 1.671e-05 [Cycle 2]: 0.00039704, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.81998e-06 [a_1]: 9.49e-05 [with_stream_mark]: 1.362e-05 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.114e-05 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.98002e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.62001e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.516e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.746e-05 [rewriter_after_opt_a]: 4.131e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00070537 [jit_opt_b]: 5.47e-05, [1] [Cycle 1]: 4.671e-05, [2] [frontend_op_eliminate]: 1.787e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 2.843e-05 [loop_unroll]: 0.0008595 [jit_opt_after_cconv]: 0.00016802, [1] [Cycle 1]: 0.00016173, [11] [c_1]: 2.291e-05 [parameter_eliminate]: 4.18001e-06 [updatestate_depend_eliminate]: 8.15999e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 3.275e-05 [call_graph_tuple_transform]: 2.238e-05 [tuple_list_get_item_eliminator]: 5.99999e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.701e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 7.31001e-06 [add_recomputation]: 5.657e-05 [cse_after_recomputation]: 2.404e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.802e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.74e-06 [opt_after_jit_grad]: 0.00051605 [symbol_engine_optimizer]: 7.881e-05, [1] [Cycle 1]: 7.229e-05, [6] [build]: 4.23999e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.584e-05 [opt_reshape]: 6.22001e-06 [fold_const_symbol]: 9.12999e-06 [renormalize]: 4.10015e-07 [validate]: 7.475e-05 Sums bootstrap : 0.000379s : 0.61% type_inference : 0.026703s : 43.27% event_method : 0.000023s : 0.04% auto_monad : 0.029169s : 47.27% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.01% py_interpret_to_execute : 0.000300s : 0.49% rewriter_before_opt_a : 0.000103s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000725s : 1.17% jit_opt_a.with_stream_mark : 0.000037s : 0.06% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000058s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001239s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000054s : 0.09% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000705s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000859s : 1.39% jit_opt_after_cconv.c_1 : 0.000023s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000057s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000516s : 0.84% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000075s : 0.12% Time group info: ------[substitution.] 0.000223 23 1.26% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000006s : 3: substitution.graph_param_transform 82.80% : 0.000184s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.48% : 0.000006s : 2: substitution.replace_old_param 6.51% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026618 2 93.29% : 0.024833s : 1: type_inference.infer 6.71% : 0.001786s : 1: type_inference.specialize ------[replace.] 0.000085 6 63.39% : 0.000054s : 4: replace.inline 36.61% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.23% : 0.000181s : 4: match.inline 6.77% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.71% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.00% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 6.14% : 0.000008s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.94% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.26% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.93% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.24% : 0.000002s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.74% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 1.90% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000010s : 53: predicate.switch_simplify 1.12% : 0.000001s : 10: predicate.tile_eliminate 1.44% : 0.000002s : 10: predicate.transpose_eliminate 1.83% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.89% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000930 13 43.79% : 0.000407s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.36% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.85% : 0.000491s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068510 72 0.09% : 0.000060s : 1: add_recomputation 42.61% : 0.029192s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.58% : 0.000398s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000012s : 1: graph_reusing 9.68% : 0.006631s : 1: jit_opt_a 0.25% : 0.000171s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 1.27% : 0.000872s : 1: loop_unroll 1.04% : 0.000715s : 1: mutable_eliminate 1.47% : 0.001007s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.45% : 0.000306s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.05% : 0.000718s : 1: renormalize.infer 0.74% : 0.000510s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000044s : 1: rewriter_after_opt_a 0.16% : 0.000107s : 1: rewriter_before_opt_a 0.12% : 0.000081s : 1: symbol_engine_optimizer 39.01% : 0.026729s : 1: type_inference TotalTime = 0.0187148, [30] [bootstrap]: 0.00036608 [type_inference]: 0.00874024 [event_method]: 2.399e-05 [auto_monad]: 7.251e-05 [graph_reusing]: 7.32002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 5.836e-05 [rewriter_before_opt_a]: 8.895e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0064234, [2] [Cycle 1]: 0.00220946, [27] [switch_simplify]: 6.952e-05 [loop_unroll]: 3.353e-05 [a_1]: 0.00071816 [with_stream_mark]: 2.309e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 4.27003e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00098415 [add_forward_monad_depend]: 8.40001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.672e-05 [cse]: 3.585e-05 [replace_applicator]: 1.438e-05 [Cycle 2]: 0.0003608, [27] [switch_simplify]: 6.79999e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00010751 [with_stream_mark]: 1.059e-05 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 4.90999e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.126e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.17e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.62001e-06 [cse]: 1.402e-05 [replace_applicator]: 4.94003e-06 [py_interpret_to_execute_after_opt_a]: 1.571e-05 [rewriter_after_opt_a]: 3.866e-05 [convert_after_rewriter]: 7.67998e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00094468 [jit_opt_b]: 0.00013157, [1] [Cycle 1]: 0.00012147, [2] [frontend_op_eliminate]: 8.405e-05 [inline_after_opt_a]: 1.835e-05 [cconv]: 3.28e-05 [loop_unroll]: 0.00052955 [jit_opt_after_cconv]: 0.00020683, [1] [Cycle 1]: 0.00019931, [11] [c_1]: 2.298e-05 [parameter_eliminate]: 4.03999e-06 [updatestate_depend_eliminate]: 9.36998e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.529e-05 [cse]: 3.94e-05 [call_graph_tuple_transform]: 2.373e-05 [tuple_list_get_item_eliminator]: 5.75001e-06 [none_parameter_eliminate]: 2.11e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 6.07001e-06 [remove_dup_value]: 1.81e-05 [partial_unused_args_eliminate]: 2.48998e-06 [environ_conv]: 7.53e-06 [add_recomputation]: 5.409e-05 [cse_after_recomputation]: 2.511e-05, [1] [Cycle 1]: 1.89e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.868e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 7.16999e-06 [opt_after_jit_grad]: 0.00051917 [symbol_engine_optimizer]: 9.722e-05, [1] [Cycle 1]: 9.049e-05, [6] [build]: 4.68999e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.412e-05 [opt_reshape]: 6.23002e-06 [fold_const_symbol]: 2.417e-05 [renormalize]: 6.19999e-07 [validate]: 4.64e-05 Sums bootstrap : 0.000366s : 2.58% type_inference : 0.008740s : 61.68% event_method : 0.000024s : 0.17% auto_monad : 0.000073s : 0.51% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000058s : 0.41% rewriter_before_opt_a : 0.000089s : 0.63% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000076s : 0.54% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000826s : 5.83% jit_opt_a.with_stream_mark : 0.000034s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000984s : 6.95% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000050s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000016s : 0.11% rewriter_after_opt_a : 0.000039s : 0.27% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000945s : 6.67% jit_opt_b.frontend_op_eliminate : 0.000084s : 0.59% jit_opt_b.inline_after_opt_a : 0.000018s : 0.13% cconv : 0.000033s : 0.23% loop_unroll : 0.000530s : 3.74% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000025s : 0.18% jit_opt_after_cconv.cse : 0.000039s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000054s : 0.38% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000519s : 3.66% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000024s : 0.17% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.33% Time group info: ------[substitution.] 0.000315 27 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.06% : 0.000006s : 3: substitution.graph_param_transform 84.32% : 0.000266s : 5: substitution.inline 1.19% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.15% : 0.000013s : 3: substitution.reduce_eliminate 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.61% : 0.000005s : 2: substitution.replace_old_param 3.68% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008657 2 87.54% : 0.007578s : 1: type_inference.infer 12.46% : 0.001079s : 1: type_inference.specialize ------[replace.] 0.000101 7 68.40% : 0.000069s : 5: replace.inline 31.60% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 96.15% : 0.000263s : 5: match.inline 3.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.13% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 11: predicate.addn_check_dump 1.24% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000003s : 11: predicate.arithmetic_simplify 1.60% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.18% : 0.000002s : 11: predicate.depend_value_elim 1.05% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.22% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.46% : 0.000002s : 11: predicate.environ_get_depend_swap 1.86% : 0.000003s : 11: predicate.environ_get_eliminate 1.14% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000001s : 3: predicate.graph_param_transform 5.83% : 0.000008s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.54% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 11: predicate.merge_addn 1.00% : 0.000001s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 2.06% : 0.000003s : 16: predicate.partial_eliminate 1.12% : 0.000002s : 11: predicate.print_const_string_wrapper 2.49% : 0.000003s : 11: predicate.reduce_eliminate 1.57% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 19: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.17% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.62% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.67% : 0.000011s : 59: predicate.switch_simplify 1.14% : 0.000002s : 11: predicate.tile_eliminate 1.36% : 0.000002s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.00% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000911 16 50.20% : 0.000457s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.17% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.63% : 0.000370s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020898 72 0.28% : 0.000058s : 1: add_recomputation 0.36% : 0.000076s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.86% : 0.000388s : 1: bootstrap 0.17% : 0.000036s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.14% : 0.000029s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000010s : 1: graph_reusing 30.76% : 0.006428s : 1: jit_opt_a 1.00% : 0.000210s : 1: jit_opt_after_cconv 0.65% : 0.000135s : 1: jit_opt_b 2.58% : 0.000540s : 1: loop_unroll 4.60% : 0.000961s : 1: mutable_eliminate 5.09% : 0.001064s : 26: opt.transform.jit_opt_a 0.26% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.45% : 0.000095s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000020s : 1: opt.transform.mutable_eliminate 0.11% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000050s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000529s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000062s : 1: py_interpret_to_execute 0.09% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000021s : 1: remove_dup_value 2.77% : 0.000580s : 1: renormalize.infer 1.89% : 0.000395s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000042s : 1: rewriter_after_opt_a 0.44% : 0.000092s : 1: rewriter_before_opt_a 0.48% : 0.000100s : 1: symbol_engine_optimizer 41.94% : 0.008765s : 1: type_inference TotalTime = 0.136693, [30] [bootstrap]: 0.00032537 [type_inference]: 0.123995 [event_method]: 2.254e-05 [auto_monad]: 7.218e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00026153 [rewriter_before_opt_a]: 8.481e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00871565, [2] [Cycle 1]: 0.00462112, [27] [switch_simplify]: 6.57e-05 [loop_unroll]: 3.117e-05 [a_1]: 0.00182017 [with_stream_mark]: 2.826e-05 [recompute_prepare]: 1.129e-05 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.54002e-06 [parameter_eliminate]: 3.08998e-06 [specialize_transform]: 7.36001e-06 [updatestate_useless_node_eliminater]: 6.94001e-06 [accelerated_algorithm]: 7.53999e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 6.76e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.931e-05 [j_node_and_user_rematch]: 1.211e-05 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 1.232e-05 [inline_without_move]: 6.31e-06 [renormalize]: 0.00224557 [add_forward_monad_depend]: 1.094e-05 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 2.241e-05 [cse]: 3.273e-05 [replace_applicator]: 2.24e-05 [Cycle 2]: 0.00038765, [27] [switch_simplify]: 7.03998e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00012414 [with_stream_mark]: 1.476e-05 [recompute_prepare]: 5.58002e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 3.01999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.054e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 9.60001e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.68998e-06 [cse]: 1.232e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 1.685e-05 [rewriter_after_opt_a]: 4.04e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00075586 [jit_opt_b]: 6.054e-05, [1] [Cycle 1]: 5.158e-05, [2] [frontend_op_eliminate]: 1.968e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 3.329e-05 [loop_unroll]: 0.0004552 [jit_opt_after_cconv]: 0.00023229, [1] [Cycle 1]: 0.000225, [11] [c_1]: 2.536e-05 [parameter_eliminate]: 3.45998e-06 [updatestate_depend_eliminate]: 8.75999e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 8.959e-05 [call_graph_tuple_transform]: 2.512e-05 [tuple_list_get_item_eliminator]: 6.06998e-06 [none_parameter_eliminate]: 2.16998e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 4.467e-05 [partial_unused_args_eliminate]: 3.87002e-06 [environ_conv]: 1.197e-05 [add_recomputation]: 6.359e-05 [cse_after_recomputation]: 3.888e-05, [1] [Cycle 1]: 3.095e-05, [1] [cse]: 1.794e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 7.56999e-06 [opt_after_jit_grad]: 0.0005761 [symbol_engine_optimizer]: 8.122e-05, [1] [Cycle 1]: 7.326e-05, [6] [build]: 4.15e-06 [elim_shapecalc]: 8.31002e-06 [elim_not_effective]: 1.647e-05 [opt_reshape]: 7.1e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 2.3999e-07 [validate]: 7.506e-05 Sums bootstrap : 0.000325s : 0.25% type_inference : 0.123995s : 94.05% event_method : 0.000023s : 0.02% auto_monad : 0.000072s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000262s : 0.20% rewriter_before_opt_a : 0.000085s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.001944s : 1.47% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002246s : 1.70% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000756s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000033s : 0.03% loop_unroll : 0.000455s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000090s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000045s : 0.03% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000064s : 0.05% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000576s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000075s : 0.06% Time group info: ------[substitution.] 0.000275 24 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000007s : 4: substitution.graph_param_transform 84.52% : 0.000232s : 4: substitution.inline 1.73% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000007s : 2: substitution.replace_old_param 5.16% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123905 2 98.43% : 0.121955s : 1: type_inference.infer 1.57% : 0.001950s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.19% : 0.000054s : 4: replace.inline 31.81% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 94.59% : 0.000229s : 4: match.inline 5.41% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.001293 830 0.12% : 0.000002s : 12: predicate.accumulaten_eliminater 0.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.11% : 0.000001s : 12: predicate.addn_check_dump 0.17% : 0.000002s : 12: predicate.addn_zero_filter 0.21% : 0.000003s : 12: predicate.arithmetic_simplify 0.15% : 0.000002s : 12: predicate.cast_eliminate 0.08% : 0.000001s : 4: predicate.check_bprop_eliminate 0.11% : 0.000001s : 12: predicate.compare_switch_simplify 0.15% : 0.000002s : 12: predicate.depend_value_elim 0.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.11% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.11% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.04% : 0.000001s : 4: predicate.elim_not_effective 0.05% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.11% : 0.000001s : 12: predicate.environ_get_depend_swap 0.13% : 0.000002s : 12: predicate.environ_get_eliminate 0.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 4: predicate.fold_const_symbol 0.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.03% : 0.000000s : 4: predicate.graph_param_transform 0.80% : 0.000010s : 26: predicate.inline 0.10% : 0.000001s : 8: predicate.inline_without_move 0.05% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.17% : 0.000002s : 8: predicate.less_batch_normalization 0.16% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 0.19% : 0.000002s : 18: predicate.load_eliminater 0.20% : 0.000003s : 4: predicate.loop_unroll_after_grad 0.41% : 0.000005s : 36: predicate.loop_unroll_before_grad 0.28% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 0.10% : 0.000001s : 12: predicate.merge_addn 0.11% : 0.000001s : 12: predicate.minmaximum_grad 0.29% : 0.000004s : 4: predicate.mutable_eliminate 0.06% : 0.000001s : 4: predicate.opt_reshape 0.22% : 0.000003s : 18: predicate.partial_eliminate 0.15% : 0.000002s : 12: predicate.print_const_string_wrapper 0.21% : 0.000003s : 12: predicate.reduce_eliminate 0.15% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.08% : 0.000001s : 8: predicate.remove_not_recompute_node 0.20% : 0.000003s : 22: predicate.replace_applicator 0.10% : 0.000001s : 8: predicate.replace_old_param 0.05% : 0.000001s : 4: predicate.reset_defer_inline 0.16% : 0.000002s : 12: predicate.reshape_eliminate 0.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.08% : 0.000001s : 4: predicate.row_tensor_eliminate 0.14% : 0.000002s : 12: predicate.same_eliminate 0.07% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.12% : 0.000002s : 8: predicate.special_op_eliminate 0.10% : 0.000001s : 8: predicate.specialize_transform 0.13% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.05% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.29% : 0.000004s : 18: predicate.switch_defer_inline 0.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 0.80% : 0.000010s : 58: predicate.switch_simplify 0.12% : 0.000002s : 12: predicate.tile_eliminate 0.13% : 0.000002s : 12: predicate.transpose_eliminate 0.19% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.12% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 89.20% : 0.001153s : 22: predicate.tuple_list_get_item_eliminator 0.25% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 0.17% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 0.17% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 0.29% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 0.17% : 0.000002s : 12: predicate.value_based_eliminate 0.04% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.07% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002591 26 74.86% : 0.001940s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.11% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.03% : 0.000597s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141196 72 0.05% : 0.000067s : 1: add_recomputation 0.05% : 0.000076s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.24% : 0.000339s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000041s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.18% : 0.008720s : 1: jit_opt_a 0.49% : 0.000692s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.33% : 0.000465s : 1: loop_unroll 0.55% : 0.000770s : 1: mutable_eliminate 1.57% : 0.002211s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000587s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000269s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000057s : 1: remove_dup_value 1.08% : 0.001522s : 1: renormalize.infer 0.50% : 0.000712s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.06% : 0.000090s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 87.83% : 0.124016s : 1: type_inference TotalTime = 0.227319, [30] [bootstrap]: 0.00041209 [type_inference]: 0.212573 [event_method]: 2.554e-05 [auto_monad]: 8.151e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 3.09999e-06 [py_interpret_to_execute]: 0.00063269 [rewriter_before_opt_a]: 0.0001051 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.0107548, [2] [Cycle 1]: 0.00626584, [27] [switch_simplify]: 7.442e-05 [loop_unroll]: 3.537e-05 [a_1]: 0.00158857 [with_stream_mark]: 2.681e-05 [recompute_prepare]: 1.143e-05 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 3.20998e-06 [specialize_transform]: 7.73001e-06 [updatestate_useless_node_eliminater]: 6.54001e-06 [accelerated_algorithm]: 7.66999e-06 [meta_shard_fg_expand]: 3.30998e-06 [get_grad_eliminate_]: 6.95998e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.596e-05 [j_node_and_user_rematch]: 1.206e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.259e-05 [inline_without_move]: 7.23e-06 [renormalize]: 0.00408977 [add_forward_monad_depend]: 1.03e-05 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 2.079e-05 [cse]: 4.451e-05 [replace_applicator]: 2.54e-05 [Cycle 2]: 0.00042895, [27] [switch_simplify]: 7.75e-06 [loop_unroll]: 6.68998e-06 [a_1]: 0.00015143 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 7.52002e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.89002e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 3.83999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.78998e-06 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 6.31e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.564e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.916e-05 [rewriter_after_opt_a]: 4.104e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00085295 [jit_opt_b]: 6.11e-05, [1] [Cycle 1]: 5.275e-05, [2] [frontend_op_eliminate]: 2.113e-05 [inline_after_opt_a]: 1.909e-05 [cconv]: 2.895e-05 [loop_unroll]: 0.00045108 [jit_opt_after_cconv]: 0.00016973, [1] [Cycle 1]: 0.0001619, [11] [c_1]: 2.802e-05 [parameter_eliminate]: 2.91999e-06 [updatestate_depend_eliminate]: 6.69999e-06 [updatestate_assign_eliminate]: 3.86001e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 2.7e-05 [call_graph_tuple_transform]: 2.409e-05 [tuple_list_get_item_eliminator]: 7.13998e-06 [none_parameter_eliminate]: 2.52001e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.49001e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 8.94e-06 [add_recomputation]: 5.653e-05 [cse_after_recomputation]: 2.802e-05, [1] [Cycle 1]: 2.173e-05, [1] [cse]: 1.428e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 6.71999e-06 [opt_after_jit_grad]: 0.0005147 [symbol_engine_optimizer]: 0.0001653, [1] [Cycle 1]: 7.349e-05, [6] [build]: 4.44002e-06 [elim_shapecalc]: 8.87999e-06 [elim_not_effective]: 1.476e-05 [opt_reshape]: 6.93998e-06 [fold_const_symbol]: 9.92001e-06 [renormalize]: 4.09986e-07 [validate]: 5.498e-05 Sums bootstrap : 0.000412s : 0.19% type_inference : 0.212573s : 95.55% event_method : 0.000026s : 0.01% auto_monad : 0.000082s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000633s : 0.28% rewriter_before_opt_a : 0.000105s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.001740s : 0.78% jit_opt_a.with_stream_mark : 0.000042s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004090s : 1.84% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000060s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000853s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000029s : 0.01% loop_unroll : 0.000451s : 0.20% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000057s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000515s : 0.23% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.02% Time group info: ------[substitution.] 0.001059 28 0.19% : 0.000002s : 2: substitution.elim_not_effective 0.11% : 0.000001s : 2: substitution.fold_const_symbol 0.67% : 0.000007s : 4: substitution.graph_param_transform 94.93% : 0.001005s : 5: substitution.inline 0.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.37% : 0.000015s : 3: substitution.reduce_eliminate 0.52% : 0.000005s : 4: substitution.remove_not_recompute_node 0.55% : 0.000006s : 2: substitution.replace_old_param 1.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.212462 2 98.19% : 0.208618s : 1: type_inference.infer 1.81% : 0.003844s : 1: type_inference.specialize ------[replace.] 0.000158 7 72.42% : 0.000114s : 5: replace.inline 27.58% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001013 7 98.82% : 0.001001s : 5: match.inline 1.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000003s : 13: predicate.arithmetic_simplify 1.44% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.37% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000001s : 4: predicate.graph_param_transform 5.60% : 0.000009s : 28: predicate.inline 1.16% : 0.000002s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.37% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.60% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.46% : 0.000004s : 13: predicate.reduce_eliminate 2.00% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.58% : 0.000003s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.41% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.51% : 0.000010s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.28% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.85% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.34% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003678 25 50.25% : 0.001848s : 16: func_graph_cloner_run.FuncGraphClonerGraph 21.71% : 0.000799s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.04% : 0.001031s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.233489 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000085s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.19% : 0.000433s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.61% : 0.010760s : 1: jit_opt_a 0.07% : 0.000172s : 1: jit_opt_after_cconv 0.03% : 0.000064s : 1: jit_opt_b 0.20% : 0.000459s : 1: loop_unroll 0.37% : 0.000862s : 1: mutable_eliminate 0.87% : 0.002023s : 26: opt.transform.jit_opt_a 0.03% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000524s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000641s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.28% : 0.002985s : 1: renormalize.infer 0.47% : 0.001091s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.05% : 0.000111s : 1: rewriter_before_opt_a 0.07% : 0.000168s : 1: symbol_engine_optimizer 91.05% : 0.212593s : 1: type_inference TotalTime = 0.0343621, [30] [bootstrap]: 0.00036801 [type_inference]: 0.0238911 [event_method]: 2.61e-05 [auto_monad]: 7.55e-05 [graph_reusing]: 6.78998e-06 [pre_auto_parallel]: 2.98998e-06 [py_interpret_to_execute]: 0.00015543 [rewriter_before_opt_a]: 0.00012105 [expand_dump_flag]: 3.47997e-06 [jit_opt_a]: 0.00725106, [2] [Cycle 1]: 0.00261233, [27] [switch_simplify]: 6.671e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00066437 [with_stream_mark]: 2.543e-05 [recompute_prepare]: 1.046e-05 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 6.88998e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.882e-05 [j_node_and_user_rematch]: 1.086e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.228e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00140565 [add_forward_monad_depend]: 1.341e-05 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 1.977e-05 [cse]: 3.815e-05 [replace_applicator]: 1.803e-05 [Cycle 2]: 0.00036894, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00010567 [with_stream_mark]: 1.263e-05 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 2.04999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.02999e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 9.60019e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.492e-05 [replace_applicator]: 6.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.462e-05 [rewriter_after_opt_a]: 4.336e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00067135 [jit_opt_b]: 5.352e-05, [1] [Cycle 1]: 4.488e-05, [2] [frontend_op_eliminate]: 1.628e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 2.805e-05 [loop_unroll]: 0.00049337 [jit_opt_after_cconv]: 0.00016722, [1] [Cycle 1]: 0.00016008, [11] [c_1]: 2.483e-05 [parameter_eliminate]: 3.85998e-06 [updatestate_depend_eliminate]: 6.42001e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 4.10998e-06 [cse]: 3.353e-05 [call_graph_tuple_transform]: 2.058e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 1.50001e-07 [switch_simplify]: 5.46998e-06 [remove_dup_value]: 1.584e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 7.01999e-06 [add_recomputation]: 5.457e-05 [cse_after_recomputation]: 2.328e-05, [1] [Cycle 1]: 1.816e-05, [1] [cse]: 1.259e-05 [auto_monad_reorder]: 1.808e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 6.84999e-06 [opt_after_jit_grad]: 0.00050654 [symbol_engine_optimizer]: 7.75e-05, [1] [Cycle 1]: 7.046e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.471e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 5.59987e-07 [validate]: 4.435e-05 Sums bootstrap : 0.000368s : 1.25% type_inference : 0.023891s : 81.22% event_method : 0.000026s : 0.09% auto_monad : 0.000075s : 0.26% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000155s : 0.53% rewriter_before_opt_a : 0.000121s : 0.41% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.25% jit_opt_a.loop_unroll : 0.000036s : 0.12% jit_opt_a.a_1 : 0.000770s : 2.62% jit_opt_a.with_stream_mark : 0.000038s : 0.13% jit_opt_a.recompute_prepare : 0.000017s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.04% jit_opt_a.accelerated_algorithm : 0.000013s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001406s : 4.78% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000053s : 0.18% jit_opt_a.replace_applicator : 0.000024s : 0.08% py_interpret_to_execute_after_opt_a : 0.000015s : 0.05% rewriter_after_opt_a : 0.000043s : 0.15% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000671s : 2.28% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000028s : 0.10% loop_unroll : 0.000493s : 1.68% jit_opt_after_cconv.c_1 : 0.000025s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000034s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000055s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000507s : 1.72% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.15% Time group info: ------[substitution.] 0.000282 23 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000007s : 3: substitution.graph_param_transform 86.35% : 0.000244s : 4: substitution.inline 1.58% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 4.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.023796 2 91.49% : 0.021771s : 1: type_inference.infer 8.51% : 0.002025s : 1: type_inference.specialize ------[replace.] 0.000088 6 68.67% : 0.000060s : 4: replace.inline 31.33% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 95.17% : 0.000241s : 4: match.inline 4.83% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.47% : 0.000002s : 10: predicate.addn_check_dump 1.20% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000003s : 10: predicate.arithmetic_simplify 1.22% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000002s : 10: predicate.environ_get_eliminate 1.18% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000007s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.04% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000003s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.45% : 0.000001s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 53: predicate.switch_simplify 1.26% : 0.000002s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.96% : 0.000003s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.16% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001077 13 42.23% : 0.000455s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.69% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.08% : 0.000561s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036851 72 0.16% : 0.000058s : 1: add_recomputation 0.22% : 0.000080s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.06% : 0.000391s : 1: bootstrap 0.08% : 0.000031s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000031s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 19.69% : 0.007256s : 1: jit_opt_a 0.46% : 0.000171s : 1: jit_opt_after_cconv 0.15% : 0.000056s : 1: jit_opt_b 1.37% : 0.000505s : 1: loop_unroll 1.85% : 0.000681s : 1: mutable_eliminate 2.79% : 0.001027s : 26: opt.transform.jit_opt_a 0.14% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.40% : 0.000516s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000160s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.23% : 0.000822s : 1: renormalize.infer 1.55% : 0.000572s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000046s : 1: rewriter_after_opt_a 0.35% : 0.000127s : 1: rewriter_before_opt_a 0.22% : 0.000080s : 1: symbol_engine_optimizer 64.90% : 0.023918s : 1: type_inference TotalTime = 0.14323, [30] [bootstrap]: 0.00036299 [type_inference]: 0.131238 [event_method]: 2.577e-05 [auto_monad]: 7.969e-05 [graph_reusing]: 6.59001e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 0.00030225 [rewriter_before_opt_a]: 0.00010626 [expand_dump_flag]: 3.97998e-06 [jit_opt_a]: 0.00861711, [2] [Cycle 1]: 0.00432079, [27] [switch_simplify]: 8.016e-05 [loop_unroll]: 3.735e-05 [a_1]: 0.00075993 [with_stream_mark]: 2.082e-05 [recompute_prepare]: 5.858e-05 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.63e-06 [parameter_eliminate]: 3.01001e-06 [specialize_transform]: 8.97e-06 [updatestate_useless_node_eliminater]: 6.44001e-06 [accelerated_algorithm]: 7.78999e-06 [meta_shard_fg_expand]: 3.06001e-06 [get_grad_eliminate_]: 8.05999e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.76998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.735e-05 [j_node_and_user_rematch]: 1.111e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.164e-05 [inline_without_move]: 6.91999e-06 [renormalize]: 0.00295501 [add_forward_monad_depend]: 7.77998e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.844e-05 [cse]: 3.83e-05 [replace_applicator]: 2.211e-05 [Cycle 2]: 0.00040621, [27] [switch_simplify]: 7.6e-06 [loop_unroll]: 6.48003e-06 [a_1]: 0.00013103 [with_stream_mark]: 1.452e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.62002e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 2.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.922e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.28002e-06 [inline_without_move]: 6.31e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.78001e-06 [cse]: 1.693e-05 [replace_applicator]: 6.57002e-06 [py_interpret_to_execute_after_opt_a]: 1.382e-05 [rewriter_after_opt_a]: 4.3e-05 [convert_after_rewriter]: 7.7e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00076145 [jit_opt_b]: 5.847e-05, [1] [Cycle 1]: 5.082e-05, [2] [frontend_op_eliminate]: 2.091e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00043833 [jit_opt_after_cconv]: 0.00016738, [1] [Cycle 1]: 0.00015989, [11] [c_1]: 2.714e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 5.96998e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 3.124e-05 [call_graph_tuple_transform]: 2.11e-05 [tuple_list_get_item_eliminator]: 6.88e-06 [none_parameter_eliminate]: 2.24001e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 6.27001e-06 [remove_dup_value]: 1.977e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 9.45001e-06 [add_recomputation]: 5.239e-05 [cse_after_recomputation]: 2.608e-05, [1] [Cycle 1]: 2.046e-05, [1] [cse]: 1.499e-05 [auto_monad_reorder]: 1.926e-05 [get_jit_bprop_graph]: 2.06003e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.00047994 [symbol_engine_optimizer]: 7.942e-05, [1] [Cycle 1]: 7.283e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 9.53997e-06 [elim_not_effective]: 1.367e-05 [opt_reshape]: 6.74999e-06 [fold_const_symbol]: 1.008e-05 [renormalize]: 3.10014e-07 [validate]: 7.079e-05 Sums bootstrap : 0.000363s : 0.26% type_inference : 0.131238s : 94.63% event_method : 0.000026s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000302s : 0.22% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.000891s : 0.64% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000065s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002955s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000761s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000438s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000071s : 0.05% Time group info: ------[substitution.] 0.000302 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 4: substitution.graph_param_transform 87.28% : 0.000264s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 4.72% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131138 2 98.24% : 0.128835s : 1: type_inference.infer 1.76% : 0.002303s : 1: type_inference.specialize ------[replace.] 0.000109 7 67.54% : 0.000073s : 5: replace.inline 32.46% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 95.23% : 0.000260s : 5: match.inline 4.77% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000196 888 0.97% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.81% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000003s : 13: predicate.addn_zero_filter 1.39% : 0.000003s : 13: predicate.arithmetic_simplify 0.99% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 0.81% : 0.000002s : 13: predicate.compare_switch_simplify 0.90% : 0.000002s : 13: predicate.depend_value_elim 0.84% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.90% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.90% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.24% : 0.000000s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.89% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.82% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.83% : 0.000002s : 13: predicate.environ_get_depend_swap 0.91% : 0.000002s : 13: predicate.environ_get_eliminate 0.82% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 0.77% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000001s : 4: predicate.graph_param_transform 3.95% : 0.000008s : 28: predicate.inline 0.66% : 0.000001s : 8: predicate.inline_without_move 0.34% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.88% : 0.000002s : 8: predicate.less_batch_normalization 1.09% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.49% : 0.000003s : 19: predicate.load_eliminater 0.91% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.29% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.55% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.79% : 0.000002s : 13: predicate.merge_addn 0.78% : 0.000002s : 13: predicate.minmaximum_grad 0.91% : 0.000002s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 1.85% : 0.000004s : 19: predicate.partial_eliminate 0.92% : 0.000002s : 13: predicate.print_const_string_wrapper 1.24% : 0.000002s : 13: predicate.reduce_eliminate 1.08% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.60% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.25% : 0.000000s : 4: predicate.reset_defer_inline 1.09% : 0.000002s : 13: predicate.reshape_eliminate 0.90% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 0.88% : 0.000002s : 13: predicate.same_eliminate 25.00% : 0.000049s : 8: predicate.set_cell_output_no_recompute 0.69% : 0.000001s : 8: predicate.special_op_eliminate 0.78% : 0.000002s : 8: predicate.specialize_transform 1.03% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.93% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.79% : 0.000003s : 20: predicate.switch_defer_inline 1.88% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.25% : 0.000012s : 65: predicate.switch_simplify 1.01% : 0.000002s : 13: predicate.tile_eliminate 1.02% : 0.000002s : 13: predicate.transpose_eliminate 1.13% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.86% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.13% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.31% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.23% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.06% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.26% : 0.000002s : 13: predicate.value_based_eliminate 0.24% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.37% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.005038 29 83.21% : 0.004192s : 20: func_graph_cloner_run.FuncGraphClonerGraph 1.70% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 15.09% : 0.000760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147458 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000083s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.26% : 0.000384s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.85% : 0.008621s : 1: jit_opt_a 0.12% : 0.000170s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.30% : 0.000447s : 1: loop_unroll 0.52% : 0.000771s : 1: mutable_eliminate 0.83% : 0.001228s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000308s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.45% : 0.002140s : 1: renormalize.infer 0.54% : 0.000802s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000112s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 89.01% : 0.131260s : 1: type_inference TotalTime = 0.129557, [30] [bootstrap]: 0.00034138 [type_inference]: 0.11781 [event_method]: 2.66e-05 [auto_monad]: 7.974e-05 [graph_reusing]: 7.12002e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 0.00051448 [rewriter_before_opt_a]: 0.00010428 [expand_dump_flag]: 4.25999e-06 [jit_opt_a]: 0.00819212, [2] [Cycle 1]: 0.0040699, [27] [switch_simplify]: 7.238e-05 [loop_unroll]: 3.509e-05 [a_1]: 0.00072637 [with_stream_mark]: 2.163e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.73999e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.15998e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.638e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.061e-05 [inline_without_move]: 6.21e-06 [renormalize]: 0.00280544 [add_forward_monad_depend]: 9.61e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.876e-05 [cse]: 3.814e-05 [replace_applicator]: 2.301e-05 [Cycle 2]: 0.00041378, [27] [switch_simplify]: 7.5e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00014548 [with_stream_mark]: 1.456e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 6.08998e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.99001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.27999e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.522e-05 [replace_applicator]: 6.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.571e-05 [rewriter_after_opt_a]: 3.989e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00067899 [jit_opt_b]: 5.838e-05, [1] [Cycle 1]: 5.026e-05, [2] [frontend_op_eliminate]: 1.976e-05 [inline_after_opt_a]: 1.972e-05 [cconv]: 3.113e-05 [loop_unroll]: 0.00045582 [jit_opt_after_cconv]: 0.00016894, [1] [Cycle 1]: 0.00016233, [11] [c_1]: 2.629e-05 [parameter_eliminate]: 4.10998e-06 [updatestate_depend_eliminate]: 6.71e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.86999e-06 [cse]: 3.135e-05 [call_graph_tuple_transform]: 2.229e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 7.18e-06 [remove_dup_value]: 1.787e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 9.99001e-06 [add_recomputation]: 5.256e-05 [cse_after_recomputation]: 2.405e-05, [1] [Cycle 1]: 1.911e-05, [1] [cse]: 1.263e-05 [auto_monad_reorder]: 1.906e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 7.36999e-06 [opt_after_jit_grad]: 0.00047655 [symbol_engine_optimizer]: 0.00014265, [1] [Cycle 1]: 7.043e-05, [6] [build]: 3.95998e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 7.18998e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 3.60014e-07 [validate]: 5.179e-05 Sums bootstrap : 0.000341s : 0.27% type_inference : 0.117810s : 94.15% event_method : 0.000027s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000514s : 0.41% rewriter_before_opt_a : 0.000104s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000872s : 0.70% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002806s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000679s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000031s : 0.02% loop_unroll : 0.000456s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000477s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000289 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 82.77% : 0.000239s : 5: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.21% : 0.000015s : 3: substitution.reduce_eliminate 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 3.70% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117711 2 97.51% : 0.114784s : 1: type_inference.infer 2.49% : 0.002927s : 1: type_inference.specialize ------[replace.] 0.000102 7 67.68% : 0.000069s : 5: replace.inline 32.32% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 7 96.12% : 0.000237s : 5: match.inline 3.88% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.55% : 0.000002s : 13: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 13: predicate.addn_check_dump 1.57% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.53% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 2.02% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 13: predicate.reshape_eliminate 1.43% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000002s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 1.99% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.94% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.00% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002541 25 64.58% : 0.001641s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.32% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.11% : 0.000816s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133566 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000084s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.27% : 0.000357s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.14% : 0.008197s : 1: jit_opt_a 0.13% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.35% : 0.000465s : 1: loop_unroll 0.52% : 0.000691s : 1: mutable_eliminate 0.85% : 0.001138s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000523s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.45% : 0.001938s : 1: renormalize.infer 0.64% : 0.000857s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.11% : 0.000146s : 1: symbol_engine_optimizer 88.23% : 0.117839s : 1: type_inference TotalTime = 0.0579151, [30] [bootstrap]: 0.00031797 [type_inference]: 0.046284 [event_method]: 2.118e-05 [auto_monad]: 7.092e-05 [graph_reusing]: 6.59999e-06 [pre_auto_parallel]: 3.11999e-06 [py_interpret_to_execute]: 0.00013044 [rewriter_before_opt_a]: 8.347e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00855794, [2] [Cycle 1]: 0.00284218, [27] [switch_simplify]: 6.663e-05 [loop_unroll]: 3.187e-05 [a_1]: 0.00072971 [with_stream_mark]: 2.33e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.496e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.087e-05 [inline_without_move]: 6.49001e-06 [renormalize]: 0.00156094 [add_forward_monad_depend]: 6.99001e-06 [auto_monad_grad]: 3.01999e-06 [auto_monad_eliminator]: 1.979e-05 [cse]: 3.859e-05 [replace_applicator]: 1.524e-05 [Cycle 2]: 0.0003848, [27] [switch_simplify]: 6.17001e-06 [loop_unroll]: 5.74e-06 [a_1]: 9.518e-05 [with_stream_mark]: 1.214e-05 [recompute_prepare]: 6.39001e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 7.56999e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.51e-06 [cse]: 1.494e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.546e-05 [rewriter_after_opt_a]: 7.788e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00065453 [jit_opt_b]: 5.105e-05, [1] [Cycle 1]: 4.395e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.708e-05 [cconv]: 2.659e-05 [loop_unroll]: 0.00046638 [jit_opt_after_cconv]: 0.0001474, [1] [Cycle 1]: 0.00014058, [11] [c_1]: 2.246e-05 [parameter_eliminate]: 2.64999e-06 [updatestate_depend_eliminate]: 6.09999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.282e-05 [call_graph_tuple_transform]: 1.939e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.672e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 5.949e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.743e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.808e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.22999e-06 [opt_after_jit_grad]: 0.00047727 [symbol_engine_optimizer]: 7.41e-05, [1] [Cycle 1]: 6.773e-05, [6] [build]: 4.45e-06 [elim_shapecalc]: 7.66001e-06 [elim_not_effective]: 1.337e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 3.59985e-07 [validate]: 6.419e-05 Sums bootstrap : 0.000318s : 0.61% type_inference : 0.046284s : 89.30% event_method : 0.000021s : 0.04% auto_monad : 0.000071s : 0.14% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000130s : 0.25% rewriter_before_opt_a : 0.000083s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.14% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000825s : 1.59% jit_opt_a.with_stream_mark : 0.000035s : 0.07% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001561s : 3.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.05% jit_opt_a.cse : 0.000054s : 0.10% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000078s : 0.15% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000655s : 1.26% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000466s : 0.90% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000059s : 0.11% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000477s : 0.92% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000064s : 0.12% Time group info: ------[substitution.] 0.000258 23 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000005s : 3: substitution.graph_param_transform 85.55% : 0.000220s : 4: substitution.inline 1.58% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 5.55% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046206 2 95.98% : 0.044350s : 1: type_inference.infer 4.02% : 0.001856s : 1: type_inference.specialize ------[replace.] 0.000086 6 66.81% : 0.000057s : 4: replace.inline 33.19% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.32% : 0.000217s : 4: match.inline 5.68% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.55% : 0.000002s : 10: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.98% : 0.000008s : 22: predicate.inline 1.08% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.41% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000001s : 10: predicate.same_eliminate 0.71% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.09% : 0.000001s : 6: predicate.specialize_transform 1.21% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.75% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000002s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.99% : 0.000003s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001033 13 45.28% : 0.000468s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.94% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.78% : 0.000525s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060565 72 0.10% : 0.000063s : 1: add_recomputation 0.12% : 0.000074s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.63% : 0.000383s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 14.14% : 0.008562s : 1: jit_opt_a 0.25% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.78% : 0.000475s : 1: loop_unroll 1.09% : 0.000663s : 1: mutable_eliminate 1.76% : 0.001064s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000135s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.66% : 0.001007s : 1: renormalize.infer 0.90% : 0.000544s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000081s : 1: rewriter_after_opt_a 0.14% : 0.000087s : 1: rewriter_before_opt_a 0.13% : 0.000076s : 1: symbol_engine_optimizer 76.45% : 0.046303s : 1: type_inference TotalTime = 0.124457, [30] [bootstrap]: 0.00032394 [type_inference]: 0.11263 [event_method]: 2.093e-05 [auto_monad]: 7.354e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.80002e-06 [py_interpret_to_execute]: 0.00027572 [rewriter_before_opt_a]: 8.613e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.0085717, [2] [Cycle 1]: 0.00361832, [27] [switch_simplify]: 6.979e-05 [loop_unroll]: 3.215e-05 [a_1]: 0.00067974 [with_stream_mark]: 2.696e-05 [recompute_prepare]: 9.56e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 7.49002e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.83998e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.677e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 1.169e-05 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00240389 [add_forward_monad_depend]: 8.84998e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.908e-05 [cse]: 3.596e-05 [replace_applicator]: 2.095e-05 [Cycle 2]: 0.00039498, [27] [switch_simplify]: 7.36999e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00013473 [with_stream_mark]: 1.37e-05 [recompute_prepare]: 6.36998e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.66998e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.40002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.787e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.019e-05 [replace_applicator]: 6.15002e-06 [py_interpret_to_execute_after_opt_a]: 1.319e-05 [rewriter_after_opt_a]: 3.748e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00076459 [jit_opt_b]: 6.051e-05, [1] [Cycle 1]: 5.27e-05, [2] [frontend_op_eliminate]: 2.064e-05 [inline_after_opt_a]: 1.939e-05 [cconv]: 3.135e-05 [loop_unroll]: 0.00046083 [jit_opt_after_cconv]: 0.00016177, [1] [Cycle 1]: 0.00015529, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 3.57002e-06 [updatestate_depend_eliminate]: 7.31999e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.71e-05 [call_graph_tuple_transform]: 2.181e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.712e-05 [partial_unused_args_eliminate]: 2.61999e-06 [environ_conv]: 9.27001e-06 [add_recomputation]: 5.41e-05 [cse_after_recomputation]: 2.159e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.022e-05 [auto_monad_reorder]: 1.634e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.55001e-06 [opt_after_jit_grad]: 0.00047782 [symbol_engine_optimizer]: 7.57e-05, [1] [Cycle 1]: 6.924e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.17003e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.41003e-06 [renormalize]: 4.19997e-07 [validate]: 5.092e-05 Sums bootstrap : 0.000324s : 0.27% type_inference : 0.112630s : 94.44% event_method : 0.000021s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000276s : 0.23% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000814s : 0.68% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002404s : 2.02% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000765s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000461s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000478s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000285 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.33% : 0.000007s : 4: substitution.graph_param_transform 85.39% : 0.000243s : 4: substitution.inline 1.61% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000007s : 2: substitution.replace_old_param 4.94% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112546 2 98.25% : 0.110577s : 1: type_inference.infer 1.75% : 0.001969s : 1: type_inference.specialize ------[replace.] 0.000084 6 70.03% : 0.000058s : 4: replace.inline 29.97% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 6 94.88% : 0.000240s : 4: match.inline 5.12% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.59% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000002s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.65% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.86% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.30% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.50% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 2.14% : 0.000003s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.56% : 0.000004s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 2.01% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.61% : 0.000011s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.71% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.92% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002393 26 71.71% : 0.001716s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.84% : 0.000618s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127998 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000339s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.70% : 0.008575s : 1: jit_opt_a 0.13% : 0.000164s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.37% : 0.000470s : 1: loop_unroll 0.61% : 0.000776s : 1: mutable_eliminate 0.84% : 0.001077s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000283s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.29% : 0.001654s : 1: renormalize.infer 0.58% : 0.000736s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.01% : 0.112651s : 1: type_inference TotalTime = 0.142188, [30] [bootstrap]: 0.00038451 [type_inference]: 0.127972 [event_method]: 2.574e-05 [auto_monad]: 8.928e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00068706 [rewriter_before_opt_a]: 0.00010713 [expand_dump_flag]: 3.97998e-06 [jit_opt_a]: 0.0101272, [2] [Cycle 1]: 0.00538434, [27] [switch_simplify]: 8.593e-05 [loop_unroll]: 3.707e-05 [a_1]: 0.00089249 [with_stream_mark]: 2.875e-05 [recompute_prepare]: 1.048e-05 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.77002e-06 [specialize_transform]: 8.55001e-06 [updatestate_useless_node_eliminater]: 6.95998e-06 [accelerated_algorithm]: 8.05999e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 7.5e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.95e-05 [j_node_and_user_rematch]: 1.207e-05 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 1.162e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00387653 [add_forward_monad_depend]: 1.198e-05 [auto_monad_grad]: 3.06001e-06 [auto_monad_eliminator]: 2.213e-05 [cse]: 3.884e-05 [replace_applicator]: 2.568e-05 [Cycle 2]: 0.00042716, [27] [switch_simplify]: 7.83001e-06 [loop_unroll]: 6.79001e-06 [a_1]: 0.0001493 [with_stream_mark]: 1.592e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 3.8e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.87001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.81e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 7.5e-06 [cse]: 1.419e-05 [replace_applicator]: 6.18998e-06 [py_interpret_to_execute_after_opt_a]: 1.801e-05 [rewriter_after_opt_a]: 4.282e-05 [convert_after_rewriter]: 8.16002e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00086291 [jit_opt_b]: 6.105e-05, [1] [Cycle 1]: 5.325e-05, [2] [frontend_op_eliminate]: 2.158e-05 [inline_after_opt_a]: 1.999e-05 [cconv]: 3.2e-05 [loop_unroll]: 0.00046432 [jit_opt_after_cconv]: 0.00017716, [1] [Cycle 1]: 0.00017016, [11] [c_1]: 2.839e-05 [parameter_eliminate]: 3.5e-06 [updatestate_depend_eliminate]: 8.27e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 3.68e-06 [cse]: 2.978e-05 [call_graph_tuple_transform]: 2.467e-05 [tuple_list_get_item_eliminator]: 7.56001e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 6.29982e-07 [switch_simplify]: 6.91999e-06 [remove_dup_value]: 1.648e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 9.39e-06 [add_recomputation]: 5.615e-05 [cse_after_recomputation]: 2.639e-05, [1] [Cycle 1]: 2.073e-05, [1] [cse]: 1.455e-05 [auto_monad_reorder]: 1.855e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 7.42002e-06 [opt_after_jit_grad]: 0.00050625 [symbol_engine_optimizer]: 0.00017421, [1] [Cycle 1]: 0.00016744, [6] [build]: 4.45999e-06 [elim_shapecalc]: 9.99001e-06 [elim_not_effective]: 0.00010294 [opt_reshape]: 7.25e-06 [fold_const_symbol]: 1.148e-05 [renormalize]: 3.69997e-07 [validate]: 6.244e-05 Sums bootstrap : 0.000385s : 0.28% type_inference : 0.127972s : 93.31% event_method : 0.000026s : 0.02% auto_monad : 0.000089s : 0.07% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000687s : 0.50% rewriter_before_opt_a : 0.000107s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000094s : 0.07% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.001042s : 0.76% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003877s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000863s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000464s : 0.34% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000506s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000103s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.05% Time group info: ------[substitution.] 0.000374 28 0.71% : 0.000003s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.73% : 0.000006s : 4: substitution.graph_param_transform 84.12% : 0.000314s : 5: substitution.inline 1.27% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.45% : 0.000017s : 3: substitution.reduce_eliminate 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 1.88% : 0.000007s : 2: substitution.replace_old_param 3.83% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127861 2 96.89% : 0.123880s : 1: type_inference.infer 3.11% : 0.003981s : 1: type_inference.specialize ------[replace.] 0.000142 7 70.68% : 0.000101s : 5: replace.inline 29.32% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000323 7 96.02% : 0.000311s : 5: match.inline 3.98% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000163 886 1.48% : 0.000002s : 13: predicate.accumulaten_eliminater 1.65% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 2.28% : 0.000004s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 6.35% : 0.000010s : 28: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000004s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000004s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000002s : 8: predicate.specialize_transform 1.57% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000012s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.30% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.95% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002887 25 62.68% : 0.001809s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.23% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.08% : 0.000984s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147550 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000093s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.28% : 0.000410s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.87% : 0.010131s : 1: jit_opt_a 0.12% : 0.000181s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.32% : 0.000475s : 1: loop_unroll 0.59% : 0.000873s : 1: mutable_eliminate 0.91% : 0.001340s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000127s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000697s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.88% : 0.002777s : 1: renormalize.infer 0.74% : 0.001087s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000114s : 1: rewriter_before_opt_a 0.12% : 0.000177s : 1: symbol_engine_optimizer 86.75% : 0.127998s : 1: type_inference TotalTime = 0.0280552, [30] [bootstrap]: 0.00036156 [type_inference]: 0.0155902 [event_method]: 2.653e-05 [auto_monad]: 8.062e-05 [graph_reusing]: 7.26999e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 6.953e-05 [rewriter_before_opt_a]: 9.851e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00650411, [2] [Cycle 1]: 0.00217461, [27] [switch_simplify]: 6.765e-05 [loop_unroll]: 3.378e-05 [a_1]: 0.00070396 [with_stream_mark]: 2.319e-05 [recompute_prepare]: 8.1e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.683e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.55001e-06 [inline_without_move]: 5.70001e-06 [renormalize]: 0.00097513 [add_forward_monad_depend]: 6.27001e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.599e-05 [cse]: 4.202e-05 [replace_applicator]: 1.456e-05 [Cycle 2]: 0.00033015, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.102e-05 [with_stream_mark]: 1.038e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 4.97999e-06 [meta_shard_fg_expand]: 1.02998e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 3.41999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.367e-05 [j_node_and_user_rematch]: 8.36002e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 7.45998e-06 [inline_without_move]: 5.07e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.49998e-06 [cse]: 1.468e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.433e-05 [rewriter_after_opt_a]: 4.285e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00063562 [jit_opt_b]: 5.029e-05, [1] [Cycle 1]: 4.341e-05, [2] [frontend_op_eliminate]: 1.644e-05 [inline_after_opt_a]: 1.596e-05 [cconv]: 2.828e-05 [loop_unroll]: 0.00306694 [jit_opt_after_cconv]: 0.00021491, [1] [Cycle 1]: 0.00020559, [11] [c_1]: 2.625e-05 [parameter_eliminate]: 7e-06 [updatestate_depend_eliminate]: 1.348e-05 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 5.034e-05 [call_graph_tuple_transform]: 2.853e-05 [tuple_list_get_item_eliminator]: 6.58998e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 6.08998e-06 [remove_dup_value]: 5.466e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 7.45e-06 [add_recomputation]: 6.011e-05 [cse_after_recomputation]: 4.978e-05, [1] [Cycle 1]: 4.301e-05, [1] [cse]: 3.622e-05 [auto_monad_reorder]: 2.085e-05 [get_jit_bprop_graph]: 2.84999e-06 [rewriter_after_jit_bprop_graph]: 1.043e-05 [opt_after_jit_grad]: 0.00068586 [symbol_engine_optimizer]: 8.148e-05, [1] [Cycle 1]: 7.457e-05, [6] [build]: 4.85999e-06 [elim_shapecalc]: 9.59e-06 [elim_not_effective]: 1.616e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.80009e-07 [validate]: 4.712e-05 Sums bootstrap : 0.000362s : 1.55% type_inference : 0.015590s : 66.64% event_method : 0.000027s : 0.11% auto_monad : 0.000081s : 0.34% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000070s : 0.30% rewriter_before_opt_a : 0.000099s : 0.42% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.32% jit_opt_a.loop_unroll : 0.000039s : 0.17% jit_opt_a.a_1 : 0.000795s : 3.40% jit_opt_a.with_stream_mark : 0.000034s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.000975s : 4.17% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.09% jit_opt_a.cse : 0.000057s : 0.24% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000043s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000636s : 2.72% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000028s : 0.12% loop_unroll : 0.003067s : 13.11% jit_opt_after_cconv.c_1 : 0.000026s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000050s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000055s : 0.23% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000060s : 0.26% cse_after_recomputation.cse : 0.000036s : 0.15% auto_monad_reorder : 0.000021s : 0.09% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.04% opt_after_jit_grad : 0.000686s : 2.93% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.20% Time group info: ------[substitution.] 0.000309 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000008s : 3: substitution.graph_param_transform 87.28% : 0.000269s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000006s : 4: substitution.remove_not_recompute_node 1.55% : 0.000005s : 2: substitution.replace_old_param 4.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015501 2 92.19% : 0.014290s : 1: type_inference.infer 7.81% : 0.001211s : 1: type_inference.specialize ------[replace.] 0.000101 7 69.04% : 0.000069s : 5: replace.inline 30.96% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 95.72% : 0.000266s : 5: match.inline 4.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.41% : 0.000002s : 11: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.70% : 0.000002s : 11: predicate.arithmetic_simplify 1.47% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 11: predicate.compare_switch_simplify 1.21% : 0.000002s : 11: predicate.depend_value_elim 1.17% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000002s : 11: predicate.environ_get_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 6.48% : 0.000009s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 3.85% : 0.000005s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.21% : 0.000002s : 11: predicate.minmaximum_grad 2.01% : 0.000003s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 1.65% : 0.000002s : 11: predicate.reduce_eliminate 1.38% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.10% : 0.000001s : 11: predicate.reshape_eliminate 1.21% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 11: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.93% : 0.000011s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000002s : 11: predicate.transpose_eliminate 1.40% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.55% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002826 16 83.18% : 0.002351s : 7: func_graph_cloner_run.FuncGraphClonerGraph 3.17% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 13.65% : 0.000386s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030135 72 0.21% : 0.000063s : 1: add_recomputation 0.28% : 0.000084s : 1: auto_monad 0.08% : 0.000024s : 1: auto_monad_reorder 1.28% : 0.000387s : 1: bootstrap 0.10% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000052s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.10% : 0.000031s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000010s : 1: graph_reusing 21.60% : 0.006508s : 1: jit_opt_a 0.73% : 0.000219s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 10.25% : 0.003089s : 1: loop_unroll 2.14% : 0.000645s : 1: mutable_eliminate 3.42% : 0.001031s : 26: opt.transform.jit_opt_a 0.21% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000029s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.31% : 0.000695s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000073s : 1: py_interpret_to_execute 0.06% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000058s : 1: remove_dup_value 1.95% : 0.000589s : 1: renormalize.infer 1.25% : 0.000376s : 1: renormalize.specialize 0.04% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000046s : 1: rewriter_after_opt_a 0.34% : 0.000103s : 1: rewriter_before_opt_a 0.28% : 0.000084s : 1: symbol_engine_optimizer 51.81% : 0.015614s : 1: type_inference TotalTime = 0.0135074, [30] [bootstrap]: 0.00032745 [type_inference]: 0.00481073 [event_method]: 2.081e-05 [auto_monad]: 6.887e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 3.797e-05 [rewriter_before_opt_a]: 7.313e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00601359, [2] [Cycle 1]: 0.00182793, [27] [switch_simplify]: 5.817e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00056155 [with_stream_mark]: 2.064e-05 [recompute_prepare]: 7.78999e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 5.76998e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 9.38997e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.73002e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 0.00080751 [add_forward_monad_depend]: 6.68e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.617e-05 [cse]: 2.997e-05 [replace_applicator]: 1.46e-05 [Cycle 2]: 0.00055018, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.84e-06 [a_1]: 9.158e-05 [with_stream_mark]: 1.058e-05 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.76002e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 8.22e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 7.26999e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.28998e-06 [cse]: 1.008e-05 [replace_applicator]: 0.00021441 [py_interpret_to_execute_after_opt_a]: 1.43e-05 [rewriter_after_opt_a]: 4.255e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00055033 [jit_opt_b]: 4.953e-05, [1] [Cycle 1]: 4.334e-05, [2] [frontend_op_eliminate]: 1.621e-05 [inline_after_opt_a]: 1.572e-05 [cconv]: 2.548e-05 [loop_unroll]: 0.00042016 [jit_opt_after_cconv]: 0.00014894, [1] [Cycle 1]: 0.00014315, [11] [c_1]: 2.115e-05 [parameter_eliminate]: 2.94999e-06 [updatestate_depend_eliminate]: 5.51002e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 2.425e-05 [call_graph_tuple_transform]: 1.901e-05 [tuple_list_get_item_eliminator]: 5.39998e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 4.98001e-06 [remove_dup_value]: 1.654e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.74999e-06 [add_recomputation]: 5.071e-05 [cse_after_recomputation]: 3.412e-05, [1] [Cycle 1]: 2.865e-05, [1] [cse]: 2.189e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00045562 [symbol_engine_optimizer]: 7.523e-05, [1] [Cycle 1]: 6.89e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 8.03001e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.68001e-06 [renormalize]: 6.00005e-07 [validate]: 3.719e-05 Sums bootstrap : 0.000327s : 3.54% type_inference : 0.004811s : 51.99% event_method : 0.000021s : 0.22% auto_monad : 0.000069s : 0.74% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000038s : 0.41% rewriter_before_opt_a : 0.000073s : 0.79% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000064s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000653s : 7.06% jit_opt_a.with_stream_mark : 0.000031s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000005s : 0.06% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000808s : 8.73% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000040s : 0.43% jit_opt_a.replace_applicator : 0.000229s : 2.47% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000043s : 0.46% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000550s : 5.95% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000025s : 0.28% loop_unroll : 0.000420s : 4.54% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000051s : 0.55% cse_after_recomputation.cse : 0.000022s : 0.24% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000456s : 4.92% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000037s : 0.40% Time group info: ------[substitution.] 0.000228 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.33% : 0.000005s : 3: substitution.graph_param_transform 84.42% : 0.000193s : 4: substitution.inline 1.69% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004738 2 80.92% : 0.003833s : 1: type_inference.infer 19.08% : 0.000904s : 1: type_inference.specialize ------[replace.] 0.000072 6 65.59% : 0.000047s : 4: replace.inline 34.41% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.29% : 0.000190s : 4: match.inline 5.71% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.76% : 0.000002s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.93% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.99% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.17% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.71% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000628 13 48.25% : 0.000303s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.39% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.37% : 0.000278s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015447 72 0.35% : 0.000054s : 1: add_recomputation 0.47% : 0.000072s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.24% : 0.000346s : 1: bootstrap 0.18% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.23% : 0.000036s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.96% : 0.006018s : 1: jit_opt_a 0.98% : 0.000152s : 1: jit_opt_after_cconv 0.34% : 0.000052s : 1: jit_opt_b 2.77% : 0.000428s : 1: loop_unroll 3.62% : 0.000560s : 1: mutable_eliminate 6.98% : 0.001078s : 26: opt.transform.jit_opt_a 0.31% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.00% : 0.000464s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000041s : 1: py_interpret_to_execute 0.11% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.92% : 0.000450s : 1: renormalize.infer 2.26% : 0.000349s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000045s : 1: rewriter_after_opt_a 0.49% : 0.000076s : 1: rewriter_before_opt_a 0.50% : 0.000078s : 1: symbol_engine_optimizer 31.27% : 0.004830s : 1: type_inference TotalTime = 0.0225821, [30] [bootstrap]: 0.0002705 [type_inference]: 0.0107586 [event_method]: 2.547e-05 [auto_monad]: 7.201e-05 [graph_reusing]: 6.69001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 5.84e-05 [rewriter_before_opt_a]: 9.545e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00599435, [2] [Cycle 1]: 0.00200611, [27] [switch_simplify]: 5.881e-05 [loop_unroll]: 3.414e-05 [a_1]: 0.0006384 [with_stream_mark]: 1.653e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 5.53997e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 2.11003e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 8.30012e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.219e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.40001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00093043 [add_forward_monad_depend]: 6.19001e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.423e-05 [cse]: 3.124e-05 [replace_applicator]: 1.262e-05 [Cycle 2]: 0.00032727, [27] [switch_simplify]: 5.92999e-06 [loop_unroll]: 5.45001e-06 [a_1]: 9.054e-05 [with_stream_mark]: 1.019e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.05002e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 4.84998e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.474e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.72998e-06 [inline_without_move]: 4.94998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.46e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.302e-05 [rewriter_after_opt_a]: 3.669e-05 [convert_after_rewriter]: 6.06998e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00058715 [jit_opt_b]: 5.083e-05, [1] [Cycle 1]: 4.396e-05, [2] [frontend_op_eliminate]: 1.687e-05 [inline_after_opt_a]: 1.654e-05 [cconv]: 2.605e-05 [loop_unroll]: 0.00047408 [jit_opt_after_cconv]: 0.00268538, [1] [Cycle 1]: 0.0026752, [11] [c_1]: 2.145e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 6.69999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 3.418e-05 [call_graph_tuple_transform]: 1.92e-05 [tuple_list_get_item_eliminator]: 4.836e-05 [none_parameter_eliminate]: 6.11e-06 [renormalize]: 1.21002e-06 [switch_simplify]: 8.33999e-06 [remove_dup_value]: 6.627e-05 [partial_unused_args_eliminate]: 2.97002e-06 [environ_conv]: 7.68001e-06 [add_recomputation]: 6.47e-05 [cse_after_recomputation]: 5.03e-05, [1] [Cycle 1]: 3.902e-05, [1] [cse]: 2.955e-05 [auto_monad_reorder]: 2.15e-05 [get_jit_bprop_graph]: 4.263e-05 [rewriter_after_jit_bprop_graph]: 9.20999e-06 [opt_after_jit_grad]: 0.00080755 [symbol_engine_optimizer]: 8.806e-05, [1] [Cycle 1]: 7.896e-05, [6] [build]: 5.50001e-06 [elim_shapecalc]: 9.40001e-06 [elim_not_effective]: 1.85e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 9.93998e-06 [renormalize]: 1.09e-06 [validate]: 5.141e-05 Sums bootstrap : 0.000271s : 1.71% type_inference : 0.010759s : 67.96% event_method : 0.000025s : 0.16% auto_monad : 0.000072s : 0.45% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000058s : 0.37% rewriter_before_opt_a : 0.000095s : 0.60% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.41% jit_opt_a.loop_unroll : 0.000040s : 0.25% jit_opt_a.a_1 : 0.000729s : 4.60% jit_opt_a.with_stream_mark : 0.000027s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000931s : 5.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.13% jit_opt_a.cse : 0.000046s : 0.29% jit_opt_a.replace_applicator : 0.000018s : 0.11% py_interpret_to_execute_after_opt_a : 0.000013s : 0.08% rewriter_after_opt_a : 0.000037s : 0.23% convert_after_rewriter : 0.000006s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000587s : 3.71% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000026s : 0.16% loop_unroll : 0.000474s : 2.99% jit_opt_after_cconv.c_1 : 0.000021s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000034s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000048s : 0.31% jit_opt_after_cconv.none_parameter_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.05% remove_dup_value : 0.000066s : 0.42% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000065s : 0.41% cse_after_recomputation.cse : 0.000030s : 0.19% auto_monad_reorder : 0.000022s : 0.14% get_jit_bprop_graph : 0.000043s : 0.27% rewriter_after_jit_bprop_graph : 0.000009s : 0.06% opt_after_jit_grad : 0.000808s : 5.10% symbol_engine_optimizer.build : 0.000006s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000051s : 0.32% Time group info: ------[substitution.] 0.000234 24 1.13% : 0.000003s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.30% : 0.000005s : 3: substitution.graph_param_transform 85.96% : 0.000201s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.50% : 0.000004s : 2: substitution.replace_old_param 5.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010680 2 86.58% : 0.009246s : 1: type_inference.infer 13.42% : 0.001434s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.03% : 0.000065s : 5: replace.inline 32.97% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 7 94.95% : 0.000198s : 5: match.inline 5.05% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 747 1.06% : 0.000001s : 11: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 11: predicate.addn_check_dump 1.17% : 0.000002s : 11: predicate.addn_zero_filter 1.56% : 0.000002s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 1.01% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.92% : 0.000007s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.91% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.62% : 0.000002s : 16: predicate.load_eliminater 1.04% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.66% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 11: predicate.merge_addn 1.01% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 16: predicate.partial_eliminate 1.07% : 0.000001s : 11: predicate.print_const_string_wrapper 1.56% : 0.000002s : 11: predicate.reduce_eliminate 1.31% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.07% : 0.000001s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 10.72% : 0.000015s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.73% : 0.000011s : 59: predicate.switch_simplify 1.14% : 0.000002s : 11: predicate.tile_eliminate 1.34% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000971 16 47.38% : 0.000460s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.29% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.34% : 0.000450s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024557 72 0.28% : 0.000068s : 1: add_recomputation 0.31% : 0.000076s : 1: auto_monad 0.10% : 0.000025s : 1: auto_monad_reorder 1.16% : 0.000285s : 1: bootstrap 0.12% : 0.000029s : 1: cconv 0.03% : 0.000008s : 1: convert_after_rewriter 0.21% : 0.000052s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.12% : 0.000030s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.19% : 0.000046s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 24.42% : 0.005997s : 1: jit_opt_a 10.95% : 0.002690s : 1: jit_opt_after_cconv 0.22% : 0.000054s : 1: jit_opt_b 1.97% : 0.000483s : 1: loop_unroll 2.43% : 0.000596s : 1: mutable_eliminate 3.89% : 0.000954s : 26: opt.transform.jit_opt_a 0.33% : 0.000080s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000041s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000822s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000061s : 1: py_interpret_to_execute 0.06% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.28% : 0.000070s : 1: remove_dup_value 2.04% : 0.000501s : 1: renormalize.infer 1.71% : 0.000421s : 1: renormalize.specialize 0.05% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000039s : 1: rewriter_after_opt_a 0.40% : 0.000099s : 1: rewriter_before_opt_a 0.37% : 0.000091s : 1: symbol_engine_optimizer 43.91% : 0.010783s : 1: type_inference TotalTime = 0.0552343, [30] [bootstrap]: 0.00033365 [type_inference]: 0.045665 [event_method]: 2.452e-05 [auto_monad]: 7.274e-05 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.00014165 [rewriter_before_opt_a]: 8.649e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00653616, [2] [Cycle 1]: 0.00245206, [27] [switch_simplify]: 6.215e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00060936 [with_stream_mark]: 2.46e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 2.55997e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 1.097e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00136077 [add_forward_monad_depend]: 6.68998e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.75e-05 [cse]: 3.827e-05 [replace_applicator]: 1.452e-05 [Cycle 2]: 0.00033066, [27] [switch_simplify]: 5.79999e-06 [loop_unroll]: 5.56e-06 [a_1]: 9.274e-05 [with_stream_mark]: 1.12e-05 [recompute_prepare]: 5.41998e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.37997e-06 [inline_without_move]: 4.89998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.449e-05 [replace_applicator]: 5.40001e-06 [py_interpret_to_execute_after_opt_a]: 1.332e-05 [rewriter_after_opt_a]: 3.836e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00068808 [jit_opt_b]: 5.432e-05, [1] [Cycle 1]: 4.707e-05, [2] [frontend_op_eliminate]: 1.763e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 2.754e-05 [loop_unroll]: 0.00044724 [jit_opt_after_cconv]: 0.00015373, [1] [Cycle 1]: 0.00014731, [11] [c_1]: 2.186e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.596e-05 [call_graph_tuple_transform]: 2.102e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.871e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 5.93002e-06 [add_recomputation]: 5.233e-05 [cse_after_recomputation]: 2.429e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.785e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 5.46e-06 [opt_after_jit_grad]: 0.00046886 [symbol_engine_optimizer]: 9.438e-05, [1] [Cycle 1]: 8.796e-05, [6] [build]: 3.84002e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.305e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 2.874e-05 [renormalize]: 4.00003e-07 [validate]: 4.337e-05 Sums bootstrap : 0.000334s : 0.66% type_inference : 0.045665s : 89.77% event_method : 0.000025s : 0.05% auto_monad : 0.000073s : 0.14% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000142s : 0.28% rewriter_before_opt_a : 0.000086s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.13% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000702s : 1.38% jit_opt_a.with_stream_mark : 0.000036s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001361s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000053s : 0.10% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000688s : 1.35% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000028s : 0.05% loop_unroll : 0.000447s : 0.88% jit_opt_after_cconv.c_1 : 0.000022s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000019s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000469s : 0.92% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000029s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.09% Time group info: ------[substitution.] 0.000255 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 85.36% : 0.000217s : 4: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.70% : 0.000004s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045575 2 42.26% : 0.019259s : 1: type_inference.infer 57.74% : 0.026316s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.82% : 0.000054s : 4: replace.inline 31.18% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.35% : 0.000215s : 4: match.inline 5.65% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.30% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.17% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.09% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.91% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.97% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.15% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.78% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001102 13 35.61% : 0.000393s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.27% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 59.12% : 0.000652s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.057596 72 0.10% : 0.000055s : 1: add_recomputation 0.13% : 0.000077s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.61% : 0.000352s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.36% : 0.006540s : 1: jit_opt_a 0.27% : 0.000156s : 1: jit_opt_after_cconv 0.10% : 0.000057s : 1: jit_opt_b 0.79% : 0.000455s : 1: loop_unroll 1.21% : 0.000697s : 1: mutable_eliminate 1.62% : 0.000932s : 26: opt.transform.jit_opt_a 0.09% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000146s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 1.32% : 0.000762s : 1: renormalize.infer 1.02% : 0.000589s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.16% : 0.000090s : 1: rewriter_before_opt_a 0.17% : 0.000097s : 1: symbol_engine_optimizer 79.33% : 0.045689s : 1: type_inference TotalTime = 0.0280989, [30] [bootstrap]: 0.00032552 [type_inference]: 0.0182155 [event_method]: 2.023e-05 [auto_monad]: 9.464e-05 [graph_reusing]: 5.81998e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 5.744e-05 [rewriter_before_opt_a]: 8.136e-05 [expand_dump_flag]: 2.76999e-06 [jit_opt_a]: 0.00669313, [2] [Cycle 1]: 0.0024184, [27] [switch_simplify]: 7.774e-05 [loop_unroll]: 3.437e-05 [a_1]: 0.00078442 [with_stream_mark]: 2.662e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.76e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.37001e-06 [accelerated_algorithm]: 6.75998e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.852e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 3.08e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00110227 [add_forward_monad_depend]: 6.44999e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.773e-05 [cse]: 4.062e-05 [replace_applicator]: 1.657e-05 [Cycle 2]: 0.00035172, [27] [switch_simplify]: 6.91999e-06 [loop_unroll]: 5.51998e-06 [a_1]: 0.00010619 [with_stream_mark]: 1.243e-05 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.58003e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.39998e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 7.35998e-06 [inline_without_move]: 5.24e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.51998e-06 [cse]: 1.383e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.525e-05 [rewriter_after_opt_a]: 3.997e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00080013 [jit_opt_b]: 7.003e-05, [1] [Cycle 1]: 4.829e-05, [2] [frontend_op_eliminate]: 1.803e-05 [inline_after_opt_a]: 1.649e-05 [cconv]: 3.093e-05 [loop_unroll]: 0.00051999 [jit_opt_after_cconv]: 0.00016608, [1] [Cycle 1]: 0.00015875, [11] [c_1]: 2.365e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 7.53999e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 3.137e-05 [call_graph_tuple_transform]: 2.204e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 7.03e-06 [add_recomputation]: 5.475e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.759e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 6.84001e-06 [opt_after_jit_grad]: 0.00048808 [symbol_engine_optimizer]: 8.033e-05, [1] [Cycle 1]: 7.284e-05, [6] [build]: 4.69002e-06 [elim_shapecalc]: 9.10001e-06 [elim_not_effective]: 1.441e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 9.37001e-06 [renormalize]: 6.90023e-07 [validate]: 4.799e-05 Sums bootstrap : 0.000326s : 1.38% type_inference : 0.018215s : 77.45% event_method : 0.000020s : 0.09% auto_monad : 0.000095s : 0.40% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000057s : 0.24% rewriter_before_opt_a : 0.000081s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000085s : 0.36% jit_opt_a.loop_unroll : 0.000040s : 0.17% jit_opt_a.a_1 : 0.000891s : 3.79% jit_opt_a.with_stream_mark : 0.000039s : 0.17% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.05% jit_opt_a.accelerated_algorithm : 0.000013s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.08% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.001102s : 4.69% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.10% jit_opt_a.cse : 0.000054s : 0.23% jit_opt_a.replace_applicator : 0.000022s : 0.09% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000040s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000800s : 3.40% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000031s : 0.13% loop_unroll : 0.000520s : 2.21% jit_opt_after_cconv.c_1 : 0.000024s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000055s : 0.23% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000488s : 2.08% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.20% Time group info: ------[substitution.] 0.000356 27 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.70% : 0.000006s : 3: substitution.graph_param_transform 86.41% : 0.000307s : 5: substitution.inline 1.23% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.32% : 0.000012s : 3: substitution.reduce_eliminate 1.55% : 0.000006s : 4: substitution.remove_not_recompute_node 1.58% : 0.000006s : 2: substitution.replace_old_param 3.16% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018142 2 93.48% : 0.016960s : 1: type_inference.infer 6.52% : 0.001182s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.86% : 0.000077s : 5: replace.inline 31.14% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000314 7 96.77% : 0.000304s : 5: match.inline 3.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 11: predicate.addn_check_dump 1.13% : 0.000002s : 11: predicate.addn_zero_filter 2.42% : 0.000003s : 11: predicate.arithmetic_simplify 1.52% : 0.000002s : 11: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.05% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.11% : 0.000002s : 11: predicate.environ_get_eliminate 1.13% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000008s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 11: predicate.merge_addn 1.18% : 0.000002s : 11: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 1.98% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 2.62% : 0.000004s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 19: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 11: predicate.reshape_eliminate 1.39% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 18: predicate.switch_defer_inline 2.48% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.28% : 0.000011s : 59: predicate.switch_simplify 1.48% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000002s : 11: predicate.transpose_eliminate 1.26% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001113 16 52.74% : 0.000587s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.33% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.93% : 0.000422s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030401 72 0.19% : 0.000058s : 1: add_recomputation 0.32% : 0.000099s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.13% : 0.000345s : 1: bootstrap 0.11% : 0.000034s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000010s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 22.03% : 0.006698s : 1: jit_opt_a 0.56% : 0.000169s : 1: jit_opt_after_cconv 0.24% : 0.000073s : 1: jit_opt_b 1.74% : 0.000529s : 1: loop_unroll 2.67% : 0.000812s : 1: mutable_eliminate 3.77% : 0.001146s : 26: opt.transform.jit_opt_a 0.18% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.64% : 0.000497s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000060s : 1: py_interpret_to_execute 0.06% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 2.10% : 0.000638s : 1: renormalize.infer 1.50% : 0.000455s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.28% : 0.000084s : 1: rewriter_before_opt_a 0.27% : 0.000083s : 1: symbol_engine_optimizer 59.97% : 0.018232s : 1: type_inference TotalTime = 0.0144641, [30] [bootstrap]: 0.0003089 [type_inference]: 0.00515495 [event_method]: 1.862e-05 [auto_monad]: 6.797e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 3.933e-05 [rewriter_before_opt_a]: 7.541e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00646565, [2] [Cycle 1]: 0.00178673, [27] [switch_simplify]: 5.9e-05 [loop_unroll]: 2.992e-05 [a_1]: 0.00054901 [with_stream_mark]: 2.04e-05 [recompute_prepare]: 7.84002e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.44e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00078517 [add_forward_monad_depend]: 6.43e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 3.111e-05 [replace_applicator]: 1.524e-05 [Cycle 2]: 0.00123858, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 4.78001e-06 [a_1]: 8.834e-05 [with_stream_mark]: 1.013e-05 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 4.61002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.62001e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 0.00089738 [cse]: 2.116e-05 [replace_applicator]: 1.059e-05 [py_interpret_to_execute_after_opt_a]: 1.335e-05 [rewriter_after_opt_a]: 4.072e-05 [convert_after_rewriter]: 7.57998e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00065407 [jit_opt_b]: 5.143e-05, [1] [Cycle 1]: 4.373e-05, [2] [frontend_op_eliminate]: 1.603e-05 [inline_after_opt_a]: 1.641e-05 [cconv]: 3.01e-05 [loop_unroll]: 0.00043122 [jit_opt_after_cconv]: 0.00014654, [1] [Cycle 1]: 0.00014015, [11] [c_1]: 2.078e-05 [parameter_eliminate]: 3.71999e-06 [updatestate_depend_eliminate]: 6.68e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.499e-05 [call_graph_tuple_transform]: 1.857e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 9.30013e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.44001e-06 [add_recomputation]: 5.626e-05 [cse_after_recomputation]: 3.995e-05, [1] [Cycle 1]: 1.742e-05, [1] [cse]: 1.072e-05 [auto_monad_reorder]: 1.645e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 5.77999e-06 [opt_after_jit_grad]: 0.00049803 [symbol_engine_optimizer]: 7.724e-05, [1] [Cycle 1]: 6.949e-05, [6] [build]: 4.48999e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.471e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 6.80011e-07 [validate]: 4.116e-05 Sums bootstrap : 0.000309s : 2.97% type_inference : 0.005155s : 49.55% event_method : 0.000019s : 0.18% auto_monad : 0.000068s : 0.65% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.38% rewriter_before_opt_a : 0.000075s : 0.72% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.33% jit_opt_a.a_1 : 0.000637s : 6.13% jit_opt_a.with_stream_mark : 0.000031s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000785s : 7.55% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000913s : 8.78% jit_opt_a.cse : 0.000052s : 0.50% jit_opt_a.replace_applicator : 0.000026s : 0.25% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000041s : 0.39% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000654s : 6.29% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000030s : 0.29% loop_unroll : 0.000431s : 4.14% jit_opt_after_cconv.c_1 : 0.000021s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000056s : 0.54% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000498s : 4.79% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.40% Time group info: ------[substitution.] 0.000215 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000005s : 3: substitution.graph_param_transform 83.65% : 0.000179s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 6.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005083 2 80.37% : 0.004085s : 1: type_inference.infer 19.63% : 0.000998s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.65% : 0.000051s : 4: replace.inline 32.35% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 6 93.65% : 0.000177s : 4: match.inline 6.35% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.38% : 0.000002s : 10: predicate.accumulaten_eliminater 1.57% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.33% : 0.000002s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.41% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.67% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.88% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000686 13 50.11% : 0.000344s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.13% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.76% : 0.000307s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016165 72 0.36% : 0.000059s : 1: add_recomputation 0.44% : 0.000071s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.02% : 0.000327s : 1: bootstrap 0.20% : 0.000032s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.26% : 0.000042s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 40.02% : 0.006469s : 1: jit_opt_a 0.92% : 0.000149s : 1: jit_opt_after_cconv 0.33% : 0.000054s : 1: jit_opt_b 2.72% : 0.000439s : 1: loop_unroll 4.10% : 0.000663s : 1: mutable_eliminate 5.32% : 0.000860s : 26: opt.transform.jit_opt_a 0.29% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.15% : 0.000509s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000042s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.47% : 0.000398s : 1: renormalize.infer 2.35% : 0.000380s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000044s : 1: rewriter_after_opt_a 0.49% : 0.000078s : 1: rewriter_before_opt_a 0.49% : 0.000080s : 1: symbol_engine_optimizer 32.01% : 0.005174s : 1: type_inference TotalTime = 0.147761, [30] [bootstrap]: 0.00029996 [type_inference]: 0.136682 [event_method]: 2.106e-05 [auto_monad]: 7.869e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.00043448 [rewriter_before_opt_a]: 0.00012214 [expand_dump_flag]: 4.32e-06 [jit_opt_a]: 0.00764088, [2] [Cycle 1]: 0.00376946, [27] [switch_simplify]: 6.294e-05 [loop_unroll]: 3.395e-05 [a_1]: 0.0007464 [with_stream_mark]: 2.066e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 7.28e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 7.12002e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.61999e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.46002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.612e-05 [j_node_and_user_rematch]: 1.054e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.105e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00252602 [add_forward_monad_depend]: 7.38e-06 [auto_monad_grad]: 2.72001e-06 [auto_monad_eliminator]: 1.892e-05 [cse]: 3.693e-05 [replace_applicator]: 1.835e-05 [Cycle 2]: 0.00039385, [27] [switch_simplify]: 7.38e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00013293 [with_stream_mark]: 1.534e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.11998e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.23998e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.73e-06 [cse]: 1.433e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.279e-05 [rewriter_after_opt_a]: 3.766e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.00073168 [jit_opt_b]: 8.348e-05, [1] [Cycle 1]: 7.524e-05, [2] [frontend_op_eliminate]: 1.899e-05 [inline_after_opt_a]: 2.07e-05 [cconv]: 2.918e-05 [loop_unroll]: 0.00045008 [jit_opt_after_cconv]: 0.0001629, [1] [Cycle 1]: 0.00015625, [11] [c_1]: 2.58e-05 [parameter_eliminate]: 3.14001e-06 [updatestate_depend_eliminate]: 6.81001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.935e-05 [call_graph_tuple_transform]: 2.188e-05 [tuple_list_get_item_eliminator]: 6.23002e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.87e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 8.74e-06 [add_recomputation]: 5.116e-05 [cse_after_recomputation]: 2.391e-05, [1] [Cycle 1]: 1.884e-05, [1] [cse]: 1.262e-05 [auto_monad_reorder]: 1.837e-05 [get_jit_bprop_graph]: 3.76999e-06 [rewriter_after_jit_bprop_graph]: 6.07001e-06 [opt_after_jit_grad]: 0.00048732 [symbol_engine_optimizer]: 8.119e-05, [1] [Cycle 1]: 7.511e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 9.52999e-06 [elim_not_effective]: 1.493e-05 [opt_reshape]: 6.57002e-06 [fold_const_symbol]: 1.123e-05 [renormalize]: 5.00004e-07 [validate]: 4.974e-05 Sums bootstrap : 0.000300s : 0.21% type_inference : 0.136682s : 95.16% event_method : 0.000021s : 0.01% auto_monad : 0.000079s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000434s : 0.30% rewriter_before_opt_a : 0.000122s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000879s : 0.61% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002526s : 1.76% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000732s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000450s : 0.31% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000487s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000272 28 1.01% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 81.95% : 0.000223s : 5: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.11% : 0.000014s : 3: substitution.reduce_eliminate 1.85% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 4.15% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.136593 2 97.86% : 0.133672s : 1: type_inference.infer 2.14% : 0.002921s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.03% : 0.000064s : 5: replace.inline 32.97% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 95.63% : 0.000220s : 5: match.inline 4.37% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 13: predicate.addn_check_dump 1.61% : 0.000002s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.49% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.55% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.87% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.61% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.59% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.39% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.49% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002321 25 66.07% : 0.001534s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.09% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.84% : 0.000716s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.151487 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000082s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000320s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.05% : 0.007644s : 1: jit_opt_a 0.11% : 0.000165s : 1: jit_opt_after_cconv 0.06% : 0.000087s : 1: jit_opt_b 0.30% : 0.000458s : 1: loop_unroll 0.49% : 0.000742s : 1: mutable_eliminate 0.75% : 0.001132s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000442s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.19% : 0.001805s : 1: renormalize.infer 0.47% : 0.000710s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.09% : 0.000129s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 90.24% : 0.136703s : 1: type_inference TotalTime = 0.0336237, [30] [bootstrap]: 0.00030154 [type_inference]: 0.0225119 [event_method]: 1.975e-05 [auto_monad]: 7.317e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.28002e-06 [py_interpret_to_execute]: 0.00014015 [rewriter_before_opt_a]: 8.325e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.00800899, [2] [Cycle 1]: 0.0023257, [27] [switch_simplify]: 6.391e-05 [loop_unroll]: 5.697e-05 [a_1]: 0.00057214 [with_stream_mark]: 1.843e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 4.24997e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.43003e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.621e-05 [j_node_and_user_rematch]: 9.40001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.29003e-06 [renormalize]: 0.00122968 [add_forward_monad_depend]: 8.69998e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.944e-05 [cse]: 3.848e-05 [replace_applicator]: 2e-05 [Cycle 2]: 0.00035165, [27] [switch_simplify]: 6.18002e-06 [loop_unroll]: 5.77001e-06 [a_1]: 9.875e-05 [with_stream_mark]: 1.464e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.51998e-06 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.666e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.20999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 6.41998e-06 [cse]: 1.591e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.566e-05 [rewriter_after_opt_a]: 3.972e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00070371 [jit_opt_b]: 5.737e-05, [1] [Cycle 1]: 4.952e-05, [2] [frontend_op_eliminate]: 1.818e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 2.665e-05 [loop_unroll]: 0.00044952 [jit_opt_after_cconv]: 0.00020545, [1] [Cycle 1]: 0.00019845, [11] [c_1]: 2.219e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 6.79001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.89999e-06 [cse]: 7.038e-05 [call_graph_tuple_transform]: 2.141e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.698e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.15002e-06 [add_recomputation]: 5.538e-05 [cse_after_recomputation]: 2.5e-05, [1] [Cycle 1]: 1.881e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.884e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 6.74999e-06 [opt_after_jit_grad]: 0.00049697 [symbol_engine_optimizer]: 7.648e-05, [1] [Cycle 1]: 7.042e-05, [6] [build]: 4.43001e-06 [elim_shapecalc]: 8.23001e-06 [elim_not_effective]: 1.384e-05 [opt_reshape]: 5.45001e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 5.00004e-07 [validate]: 6.787e-05 Sums bootstrap : 0.000302s : 1.09% type_inference : 0.022512s : 81.37% event_method : 0.000020s : 0.07% auto_monad : 0.000073s : 0.26% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000140s : 0.51% rewriter_before_opt_a : 0.000083s : 0.30% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.25% jit_opt_a.loop_unroll : 0.000063s : 0.23% jit_opt_a.a_1 : 0.000671s : 2.43% jit_opt_a.with_stream_mark : 0.000033s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001230s : 4.45% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000054s : 0.20% jit_opt_a.replace_applicator : 0.000025s : 0.09% py_interpret_to_execute_after_opt_a : 0.000016s : 0.06% rewriter_after_opt_a : 0.000040s : 0.14% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000704s : 2.54% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.07% cconv : 0.000027s : 0.10% loop_unroll : 0.000450s : 1.62% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000070s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000055s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000497s : 1.80% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.25% Time group info: ------[substitution.] 0.000222 23 1.18% : 0.000003s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 3: substitution.graph_param_transform 83.08% : 0.000185s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 6.28% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022427 2 91.75% : 0.020578s : 1: type_inference.infer 8.25% : 0.001849s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.41% : 0.000052s : 4: replace.inline 31.59% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.44% : 0.000182s : 4: match.inline 6.56% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 2.15% : 0.000003s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.40% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000002s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.83% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.54% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.77% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.43% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000010s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.47% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.75% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.50% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000892 13 39.22% : 0.000350s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.47% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.31% : 0.000502s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.035822 72 0.16% : 0.000058s : 1: add_recomputation 0.21% : 0.000077s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.90% : 0.000322s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 22.37% : 0.008014s : 1: jit_opt_a 0.58% : 0.000209s : 1: jit_opt_after_cconv 0.17% : 0.000061s : 1: jit_opt_b 1.28% : 0.000458s : 1: loop_unroll 1.99% : 0.000713s : 1: mutable_eliminate 2.61% : 0.000937s : 26: opt.transform.jit_opt_a 0.15% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.41% : 0.000506s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000144s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.94% : 0.000694s : 1: renormalize.infer 1.47% : 0.000526s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.24% : 0.000086s : 1: rewriter_before_opt_a 0.22% : 0.000079s : 1: symbol_engine_optimizer 62.89% : 0.022528s : 1: type_inference TotalTime = 0.036272, [30] [bootstrap]: 0.00033111 [type_inference]: 0.0189291 [event_method]: 2.138e-05 [auto_monad]: 6.912e-05 [graph_reusing]: 6.98e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 5.22e-05 [rewriter_before_opt_a]: 8.857e-05 [expand_dump_flag]: 3.87002e-06 [jit_opt_a]: 0.00945844, [2] [Cycle 1]: 0.00206204, [27] [switch_simplify]: 6.518e-05 [loop_unroll]: 3.334e-05 [a_1]: 0.00070018 [with_stream_mark]: 2.311e-05 [recompute_prepare]: 8.19002e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 6.11998e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.559e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.48002e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00086079 [add_forward_monad_depend]: 6.05002e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.67e-05 [cse]: 3.822e-05 [replace_applicator]: 1.462e-05 [Cycle 2]: 0.00035128, [27] [switch_simplify]: 5.84999e-06 [loop_unroll]: 4.92e-06 [a_1]: 0.00010311 [with_stream_mark]: 1.21e-05 [recompute_prepare]: 5.24998e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 4.82e-06 [updatestate_useless_node_eliminater]: 4.96002e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 3.23998e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.284e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.66002e-06 [replace_old_param]: 7.73999e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.401e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 1.414e-05 [rewriter_after_opt_a]: 3.818e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00062735 [jit_opt_b]: 5.142e-05, [1] [Cycle 1]: 4.342e-05, [2] [frontend_op_eliminate]: 1.569e-05 [inline_after_opt_a]: 1.603e-05 [cconv]: 2.694e-05 [loop_unroll]: 0.00042613 [jit_opt_after_cconv]: 0.0001639, [1] [Cycle 1]: 0.00015714, [11] [c_1]: 2.084e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 5.64998e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.445e-05 [call_graph_tuple_transform]: 2.056e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 2.07999e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.55001e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 7.01001e-06 [add_recomputation]: 5.374e-05 [cse_after_recomputation]: 2.373e-05, [1] [Cycle 1]: 1.832e-05, [1] [cse]: 1.152e-05 [auto_monad_reorder]: 1.843e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.31998e-06 [opt_after_jit_grad]: 0.00045981 [symbol_engine_optimizer]: 7.679e-05, [1] [Cycle 1]: 7.067e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.341e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 8.81002e-06 [renormalize]: 4.80009e-07 [validate]: 4.249e-05 Sums bootstrap : 0.000331s : 1.41% type_inference : 0.018929s : 80.48% event_method : 0.000021s : 0.09% auto_monad : 0.000069s : 0.29% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000052s : 0.22% rewriter_before_opt_a : 0.000089s : 0.38% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.30% jit_opt_a.loop_unroll : 0.000038s : 0.16% jit_opt_a.a_1 : 0.000803s : 3.42% jit_opt_a.with_stream_mark : 0.000035s : 0.15% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000861s : 3.66% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.10% jit_opt_a.cse : 0.000052s : 0.22% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000038s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000627s : 2.67% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000027s : 0.11% loop_unroll : 0.000426s : 1.81% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000054s : 0.23% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000460s : 1.95% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.18% Time group info: ------[substitution.] 0.000307 27 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 3: substitution.graph_param_transform 84.99% : 0.000261s : 5: substitution.inline 1.10% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.13% : 0.000013s : 3: substitution.reduce_eliminate 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000005s : 2: substitution.replace_old_param 3.37% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.018850 2 94.16% : 0.017749s : 1: type_inference.infer 5.84% : 0.001101s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.42% : 0.000066s : 5: replace.inline 32.58% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 7 96.54% : 0.000258s : 5: match.inline 3.46% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.20% : 0.000001s : 11: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.97% : 0.000002s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.24% : 0.000002s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000001s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 16: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.14% : 0.000001s : 11: predicate.print_const_string_wrapper 1.95% : 0.000002s : 11: predicate.reduce_eliminate 1.73% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 19: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.03% : 0.000004s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.32% : 0.000010s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.87% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000980 16 51.93% : 0.000509s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.06% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.01% : 0.000372s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.033157 72 0.17% : 0.000057s : 1: add_recomputation 0.22% : 0.000072s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 1.06% : 0.000350s : 1: bootstrap 0.09% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 28.54% : 0.009462s : 1: jit_opt_a 0.50% : 0.000167s : 1: jit_opt_after_cconv 0.16% : 0.000054s : 1: jit_opt_b 1.31% : 0.000434s : 1: loop_unroll 1.92% : 0.000637s : 1: mutable_eliminate 3.11% : 0.001031s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.41% : 0.000468s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000055s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.49% : 0.000495s : 1: renormalize.infer 1.08% : 0.000357s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000042s : 1: rewriter_after_opt_a 0.28% : 0.000092s : 1: rewriter_before_opt_a 0.24% : 0.000079s : 1: symbol_engine_optimizer 57.15% : 0.018948s : 1: type_inference TotalTime = 0.203179, [30] [bootstrap]: 0.00033794 [type_inference]: 0.189947 [event_method]: 2.787e-05 [auto_monad]: 8.835e-05 [graph_reusing]: 6.79001e-06 [pre_auto_parallel]: 3.23998e-06 [py_interpret_to_execute]: 0.00054611 [rewriter_before_opt_a]: 0.00012608 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.00921308, [2] [Cycle 1]: 0.00467838, [27] [switch_simplify]: 8.961e-05 [loop_unroll]: 3.671e-05 [a_1]: 0.00085136 [with_stream_mark]: 2.625e-05 [recompute_prepare]: 1.071e-05 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 3.95998e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 3.03e-06 [specialize_transform]: 7.82e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 6.76e-06 [meta_shard_fg_expand]: 3.31001e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.824e-05 [j_node_and_user_rematch]: 1.213e-05 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.216e-05 [inline_without_move]: 6.28002e-06 [renormalize]: 0.00323645 [add_forward_monad_depend]: 9.36e-06 [auto_monad_grad]: 3.14999e-06 [auto_monad_eliminator]: 2.146e-05 [cse]: 3.919e-05 [replace_applicator]: 2.593e-05 [Cycle 2]: 0.00049516, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 6.64999e-06 [a_1]: 0.00013058 [with_stream_mark]: 1.746e-05 [recompute_prepare]: 6.76e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.85998e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.08002e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 4.65999e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.9e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.97002e-06 [replace_old_param]: 1.275e-05 [inline_without_move]: 6.96001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.49998e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 8.95001e-06 [cse]: 1.953e-05 [replace_applicator]: 7.26999e-06 [py_interpret_to_execute_after_opt_a]: 1.954e-05 [rewriter_after_opt_a]: 4.57e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 5.63002e-06 [mutable_eliminate]: 0.00079476 [jit_opt_b]: 0.00012654, [1] [Cycle 1]: 0.00011663, [2] [frontend_op_eliminate]: 7.929e-05 [inline_after_opt_a]: 2.141e-05 [cconv]: 3.537e-05 [loop_unroll]: 0.0004756 [jit_opt_after_cconv]: 0.00019868, [1] [Cycle 1]: 0.00019022, [11] [c_1]: 2.795e-05 [parameter_eliminate]: 4.85001e-06 [updatestate_depend_eliminate]: 1.174e-05 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.25e-06 [cse]: 4.077e-05 [call_graph_tuple_transform]: 2.854e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 1.10001e-06 [switch_simplify]: 7.13e-06 [remove_dup_value]: 1.991e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 1.096e-05 [add_recomputation]: 5.581e-05 [cse_after_recomputation]: 2.657e-05, [1] [Cycle 1]: 2.105e-05, [1] [cse]: 1.508e-05 [auto_monad_reorder]: 2.16e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 7.9e-06 [opt_after_jit_grad]: 0.00049757 [symbol_engine_optimizer]: 8.797e-05, [1] [Cycle 1]: 7.811e-05, [6] [build]: 4.63999e-06 [elim_shapecalc]: 9.03002e-06 [elim_not_effective]: 1.763e-05 [opt_reshape]: 8.79e-06 [fold_const_symbol]: 9.70002e-06 [renormalize]: 6.10016e-07 [validate]: 0.00021924 Sums bootstrap : 0.000338s : 0.17% type_inference : 0.189947s : 95.75% event_method : 0.000028s : 0.01% auto_monad : 0.000088s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000546s : 0.28% rewriter_before_opt_a : 0.000126s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000097s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.000982s : 0.49% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003237s : 1.63% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000059s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000046s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000795s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000079s : 0.04% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000476s : 0.24% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000022s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000498s : 0.25% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000219s : 0.11% Time group info: ------[substitution.] 0.000357 25 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000007s : 4: substitution.graph_param_transform 88.02% : 0.000315s : 5: substitution.inline 1.41% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.62% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000006s : 2: substitution.replace_old_param 4.28% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.189837 2 98.17% : 0.186366s : 1: type_inference.infer 1.83% : 0.003471s : 1: type_inference.specialize ------[replace.] 0.000125 7 68.10% : 0.000085s : 5: replace.inline 31.90% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000325 7 95.78% : 0.000312s : 5: match.inline 4.22% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 1.75% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.74% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.50% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.76% : 0.000009s : 28: predicate.inline 1.00% : 0.000002s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 2.05% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.52% : 0.000002s : 13: predicate.print_const_string_wrapper 1.71% : 0.000003s : 13: predicate.reduce_eliminate 1.25% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.65% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.15% : 0.000005s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.89% : 0.000012s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002547 25 60.01% : 0.001528s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.96% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.03% : 0.000918s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.207670 72 0.03% : 0.000059s : 1: add_recomputation 0.04% : 0.000092s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.17% : 0.000359s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 4.44% : 0.009217s : 1: jit_opt_a 0.10% : 0.000202s : 1: jit_opt_after_cconv 0.06% : 0.000130s : 1: jit_opt_b 0.23% : 0.000485s : 1: loop_unroll 0.39% : 0.000807s : 1: mutable_eliminate 0.62% : 0.001287s : 26: opt.transform.jit_opt_a 0.03% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000093s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000506s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000554s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.08% : 0.002237s : 1: renormalize.infer 0.48% : 0.000987s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000049s : 1: rewriter_after_opt_a 0.06% : 0.000134s : 1: rewriter_before_opt_a 0.04% : 0.000091s : 1: symbol_engine_optimizer 91.48% : 0.189969s : 1: type_inference TotalTime = 0.273668, [30] [bootstrap]: 0.00036116 [type_inference]: 0.247137 [event_method]: 2.708e-05 [auto_monad]: 8.506e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 0.00061978 [rewriter_before_opt_a]: 0.00011067 [expand_dump_flag]: 3.77998e-06 [jit_opt_a]: 0.022553, [2] [Cycle 1]: 0.0179631, [27] [switch_simplify]: 6.746e-05 [loop_unroll]: 3.538e-05 [a_1]: 0.00080545 [with_stream_mark]: 2.532e-05 [recompute_prepare]: 1.106e-05 [updatestate_depend_eliminate]: 4.74002e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.61999e-06 [specialize_transform]: 7.98001e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 7.53999e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 7.24001e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.053e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.156e-05 [inline_without_move]: 6.63e-06 [renormalize]: 0.0165896 [add_forward_monad_depend]: 1.193e-05 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.324e-05 [cse]: 4.055e-05 [replace_applicator]: 2.785e-05 [Cycle 2]: 0.0004426, [27] [switch_simplify]: 8.09002e-06 [loop_unroll]: 6.92002e-06 [a_1]: 0.00015828 [with_stream_mark]: 1.596e-05 [recompute_prepare]: 6.84999e-06 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 3.83999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.08998e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 4.68999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 1.13e-05 [inline_without_move]: 6.33998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 7.34002e-06 [cse]: 1.672e-05 [replace_applicator]: 5.95002e-06 [py_interpret_to_execute_after_opt_a]: 1.892e-05 [rewriter_after_opt_a]: 4.377e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00088471 [jit_opt_b]: 6.298e-05, [1] [Cycle 1]: 5.466e-05, [2] [frontend_op_eliminate]: 2.029e-05 [inline_after_opt_a]: 2.123e-05 [cconv]: 3.442e-05 [loop_unroll]: 0.00047037 [jit_opt_after_cconv]: 0.00017643, [1] [Cycle 1]: 0.00016955, [11] [c_1]: 2.866e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 8.32e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 3.076e-05 [call_graph_tuple_transform]: 2.406e-05 [tuple_list_get_item_eliminator]: 7.11999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 6.71e-06 [remove_dup_value]: 1.9e-05 [partial_unused_args_eliminate]: 2.78e-06 [environ_conv]: 1.082e-05 [add_recomputation]: 5.611e-05 [cse_after_recomputation]: 2.736e-05, [1] [Cycle 1]: 2.094e-05, [1] [cse]: 1.445e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 3.09999e-06 [rewriter_after_jit_bprop_graph]: 8.69e-06 [opt_after_jit_grad]: 0.00052064 [symbol_engine_optimizer]: 8.281e-05, [1] [Cycle 1]: 7.638e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 1.038e-05 [elim_not_effective]: 1.489e-05 [opt_reshape]: 7.21999e-06 [fold_const_symbol]: 1.027e-05 [renormalize]: 3.69997e-07 [validate]: 5.813e-05 Sums bootstrap : 0.000361s : 0.13% type_inference : 0.247137s : 91.94% event_method : 0.000027s : 0.01% auto_monad : 0.000085s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000620s : 0.23% rewriter_before_opt_a : 0.000111s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000964s : 0.36% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.016590s : 6.17% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000057s : 0.02% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000885s : 0.33% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.000470s : 0.17% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000521s : 0.19% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000058s : 0.02% Time group info: ------[substitution.] 0.000342 28 0.75% : 0.000003s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.77% : 0.000006s : 4: substitution.graph_param_transform 84.19% : 0.000288s : 5: substitution.inline 1.13% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.32% : 0.000015s : 3: substitution.reduce_eliminate 1.64% : 0.000006s : 4: substitution.remove_not_recompute_node 2.30% : 0.000008s : 2: substitution.replace_old_param 3.57% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.247011 2 98.45% : 0.243188s : 1: type_inference.infer 1.55% : 0.003824s : 1: type_inference.specialize ------[replace.] 0.000112 7 70.59% : 0.000079s : 5: replace.inline 29.41% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 7 96.44% : 0.000285s : 5: match.inline 3.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000159 886 1.52% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.76% : 0.000003s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.31% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.27% : 0.000008s : 28: predicate.inline 0.75% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000003s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.47% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 2.19% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000004s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.48% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.70% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.68% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003298 25 56.84% : 0.001875s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.26% : 0.001328s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.291560 72 0.02% : 0.000059s : 1: add_recomputation 0.03% : 0.000089s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.13% : 0.000386s : 1: bootstrap 0.01% : 0.000038s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.74% : 0.022557s : 1: jit_opt_a 0.06% : 0.000179s : 1: jit_opt_after_cconv 0.02% : 0.000066s : 1: jit_opt_b 0.16% : 0.000480s : 1: loop_unroll 0.31% : 0.000897s : 1: mutable_eliminate 0.43% : 0.001243s : 26: opt.transform.jit_opt_a 0.02% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.18% : 0.000530s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000629s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 5.20% : 0.015172s : 1: renormalize.infer 0.48% : 0.001404s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000046s : 1: rewriter_after_opt_a 0.04% : 0.000115s : 1: rewriter_before_opt_a 0.04% : 0.000112s : 1: symbol_engine_optimizer 84.77% : 0.247164s : 1: type_inference TotalTime = 0.0304902, [30] [bootstrap]: 0.00032631 [type_inference]: 0.020769 [event_method]: 1.706e-05 [auto_monad]: 4.375e-05 [graph_reusing]: 3.43999e-06 [pre_auto_parallel]: 1.54e-06 [py_interpret_to_execute]: 0.0001373 [rewriter_before_opt_a]: 8.62e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00669896, [2] [Cycle 1]: 0.00224306, [27] [switch_simplify]: 6.448e-05 [loop_unroll]: 3.306e-05 [a_1]: 0.00060723 [with_stream_mark]: 2.22e-05 [recompute_prepare]: 8.82e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.34001e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 3.15002e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00113898 [add_forward_monad_depend]: 7.11999e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.695e-05 [cse]: 3.933e-05 [replace_applicator]: 1.447e-05 [Cycle 2]: 0.00033273, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.85002e-06 [a_1]: 9.829e-05 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 3.25998e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.37999e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 8.06001e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 6.93998e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.56998e-06 [cse]: 1.343e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 1.444e-05 [rewriter_after_opt_a]: 3.655e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.53002e-06 [mutable_eliminate]: 0.00071246 [jit_opt_b]: 5.263e-05, [1] [Cycle 1]: 4.506e-05, [2] [frontend_op_eliminate]: 1.611e-05 [inline_after_opt_a]: 1.68e-05 [cconv]: 2.613e-05 [loop_unroll]: 0.00044198 [jit_opt_after_cconv]: 0.00014755, [1] [Cycle 1]: 0.00014086, [11] [c_1]: 2.202e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 2.302e-05 [call_graph_tuple_transform]: 1.973e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.855e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 5.361e-05 [cse_after_recomputation]: 2.314e-05, [1] [Cycle 1]: 1.784e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.93e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 6.19999e-06 [opt_after_jit_grad]: 0.00050226 [symbol_engine_optimizer]: 7.571e-05, [1] [Cycle 1]: 6.899e-05, [6] [build]: 4.79e-06 [elim_shapecalc]: 7.84002e-06 [elim_not_effective]: 1.175e-05 [opt_reshape]: 6.70998e-06 [fold_const_symbol]: 9.77001e-06 [renormalize]: 3.39991e-07 [validate]: 6.689e-05 Sums bootstrap : 0.000326s : 1.27% type_inference : 0.020769s : 80.64% event_method : 0.000017s : 0.07% auto_monad : 0.000044s : 0.17% graph_reusing : 0.000003s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000137s : 0.53% rewriter_before_opt_a : 0.000086s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.28% jit_opt_a.loop_unroll : 0.000039s : 0.15% jit_opt_a.a_1 : 0.000706s : 2.74% jit_opt_a.with_stream_mark : 0.000032s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001139s : 4.42% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000053s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000037s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000712s : 2.77% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000026s : 0.10% loop_unroll : 0.000442s : 1.72% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000054s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000502s : 1.95% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000067s : 0.26% Time group info: ------[substitution.] 0.000242 23 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 85.52% : 0.000207s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000004s : 2: substitution.replace_old_param 5.16% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020704 2 91.42% : 0.018928s : 1: type_inference.infer 8.58% : 0.001776s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.88% : 0.000054s : 4: replace.inline 32.12% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.81% : 0.000205s : 4: match.inline 5.19% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.12% : 0.000001s : 10: predicate.addn_zero_filter 2.03% : 0.000003s : 10: predicate.arithmetic_simplify 1.22% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.53% : 0.000002s : 10: predicate.depend_value_elim 1.23% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000002s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.18% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 6: predicate.less_batch_normalization 1.76% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.90% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.98% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.09% : 0.000010s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.60% : 0.000002s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000984 13 44.53% : 0.000438s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.40% : 0.000496s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032601 72 0.17% : 0.000056s : 1: add_recomputation 0.15% : 0.000047s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.06% : 0.000347s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.06% : 0.000021s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000006s : 1: graph_reusing 20.56% : 0.006703s : 1: jit_opt_a 0.46% : 0.000150s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.38% : 0.000451s : 1: loop_unroll 2.22% : 0.000723s : 1: mutable_eliminate 2.88% : 0.000940s : 26: opt.transform.jit_opt_a 0.15% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.57% : 0.000513s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.44% : 0.000142s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000021s : 1: remove_dup_value 2.00% : 0.000652s : 1: renormalize.infer 1.47% : 0.000478s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000040s : 1: rewriter_after_opt_a 0.28% : 0.000090s : 1: rewriter_before_opt_a 0.24% : 0.000078s : 1: symbol_engine_optimizer 63.75% : 0.020781s : 1: type_inference TotalTime = 0.238702, [30] [bootstrap]: 0.00031398 [type_inference]: 0.227319 [event_method]: 2.139e-05 [auto_monad]: 7.164e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00049288 [rewriter_before_opt_a]: 8.082e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00811519, [2] [Cycle 1]: 0.00378604, [27] [switch_simplify]: 5.552e-05 [loop_unroll]: 3.545e-05 [a_1]: 0.00061729 [with_stream_mark]: 1.402e-05 [recompute_prepare]: 1.02e-05 [updatestate_depend_eliminate]: 3.53999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 7.53e-06 [updatestate_useless_node_eliminater]: 6.94999e-06 [accelerated_algorithm]: 7.16999e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 2.63998e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.27e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 6.64001e-06 [renormalize]: 0.00272278 [add_forward_monad_depend]: 7.56999e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.35e-05 [cse]: 2.452e-05 [replace_applicator]: 1.622e-05 [Cycle 2]: 0.00037057, [27] [switch_simplify]: 6.48998e-06 [loop_unroll]: 5.72999e-06 [a_1]: 0.00012634 [with_stream_mark]: 1.169e-05 [recompute_prepare]: 5.68002e-06 [updatestate_depend_eliminate]: 2.75002e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.02999e-06 [cse]: 1.321e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 1.152e-05 [rewriter_after_opt_a]: 3.009e-05 [convert_after_rewriter]: 7.18998e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00061527 [jit_opt_b]: 6.339e-05, [1] [Cycle 1]: 5.689e-05, [2] [frontend_op_eliminate]: 2.599e-05 [inline_after_opt_a]: 1.83e-05 [cconv]: 2.591e-05 [loop_unroll]: 0.00045143 [jit_opt_after_cconv]: 0.00016387, [1] [Cycle 1]: 0.00015669, [11] [c_1]: 2.64e-05 [parameter_eliminate]: 3.75998e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 3.81999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.714e-05 [call_graph_tuple_transform]: 2.342e-05 [tuple_list_get_item_eliminator]: 6.81999e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.191e-05 [partial_unused_args_eliminate]: 1.71998e-06 [environ_conv]: 8.17998e-06 [add_recomputation]: 4.195e-05 [cse_after_recomputation]: 2.349e-05, [1] [Cycle 1]: 1.857e-05, [1] [cse]: 1.254e-05 [auto_monad_reorder]: 1.31e-05 [get_jit_bprop_graph]: 1.57999e-06 [rewriter_after_jit_bprop_graph]: 5.16998e-06 [opt_after_jit_grad]: 0.00048048 [symbol_engine_optimizer]: 8.189e-05, [1] [Cycle 1]: 7.558e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 1.028e-05 [elim_not_effective]: 1.437e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 1.281e-05 [renormalize]: 4.09986e-07 [validate]: 4.203e-05 Sums bootstrap : 0.000314s : 0.13% type_inference : 0.227319s : 97.09% event_method : 0.000021s : 0.01% auto_monad : 0.000072s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000493s : 0.21% rewriter_before_opt_a : 0.000081s : 0.03% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000744s : 0.32% jit_opt_a.with_stream_mark : 0.000026s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002723s : 1.16% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000038s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000030s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000615s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000451s : 0.19% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000042s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.21% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.02% Time group info: ------[substitution.] 0.000213 24 0.71% : 0.000001s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 4: substitution.graph_param_transform 84.91% : 0.000181s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000004s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 5.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.227233 2 98.78% : 0.224469s : 1: type_inference.infer 1.22% : 0.002764s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.62% : 0.000053s : 4: replace.inline 33.38% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 94.18% : 0.000178s : 4: match.inline 5.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.71% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.67% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.88% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.58% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.60% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.87% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 12: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002419 22 66.63% : 0.001612s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.04% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.33% : 0.000758s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.242494 72 0.02% : 0.000045s : 1: add_recomputation 0.03% : 0.000075s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.14% : 0.000333s : 1: bootstrap 0.01% : 0.000029s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.35% : 0.008119s : 1: jit_opt_a 0.07% : 0.000167s : 1: jit_opt_after_cconv 0.03% : 0.000066s : 1: jit_opt_b 0.19% : 0.000460s : 1: loop_unroll 0.26% : 0.000625s : 1: mutable_eliminate 0.41% : 0.000985s : 26: opt.transform.jit_opt_a 0.02% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.20% : 0.000489s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000502s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 0.80% : 0.001939s : 1: renormalize.infer 0.32% : 0.000775s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000033s : 1: rewriter_after_opt_a 0.04% : 0.000086s : 1: rewriter_before_opt_a 0.03% : 0.000084s : 1: symbol_engine_optimizer 93.75% : 0.227337s : 1: type_inference TotalTime = 0.0191524, [30] [bootstrap]: 0.00040621 [type_inference]: 0.00981932 [event_method]: 2.4e-05 [auto_monad]: 7.546e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 5.705e-05 [rewriter_before_opt_a]: 8.594e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00633835, [2] [Cycle 1]: 0.00218109, [27] [switch_simplify]: 6.726e-05 [loop_unroll]: 3.715e-05 [a_1]: 0.00067084 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.82002e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.451e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00102548 [add_forward_monad_depend]: 5.57001e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.49e-05 [cse]: 3.494e-05 [replace_applicator]: 1.441e-05 [Cycle 2]: 0.00034311, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.27001e-06 [a_1]: 0.000102 [with_stream_mark]: 1.025e-05 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 2.93998e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.19003e-06 [specialize_transform]: 5.44998e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.17e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 6.29999e-06 [cse]: 1.319e-05 [replace_applicator]: 5.38002e-06 [py_interpret_to_execute_after_opt_a]: 1.46e-05 [rewriter_after_opt_a]: 3.907e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00066795 [jit_opt_b]: 5.471e-05, [1] [Cycle 1]: 4.612e-05, [2] [frontend_op_eliminate]: 1.72e-05 [inline_after_opt_a]: 1.66e-05 [cconv]: 2.788e-05 [loop_unroll]: 0.00043607 [jit_opt_after_cconv]: 0.00017007, [1] [Cycle 1]: 0.00016301, [11] [c_1]: 2.204e-05 [parameter_eliminate]: 2.94001e-06 [updatestate_depend_eliminate]: 6.30002e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.60002e-06 [cse]: 2.48e-05 [call_graph_tuple_transform]: 2.015e-05 [tuple_list_get_item_eliminator]: 6.41998e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 7.2e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.574e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 6.53e-06 [add_recomputation]: 5.297e-05 [cse_after_recomputation]: 2.507e-05, [1] [Cycle 1]: 1.901e-05, [1] [cse]: 1.285e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.65002e-06 [rewriter_after_jit_bprop_graph]: 5.72999e-06 [opt_after_jit_grad]: 0.00046787 [symbol_engine_optimizer]: 7.868e-05, [1] [Cycle 1]: 7.24e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 7.79983e-07 [validate]: 4.352e-05 Sums bootstrap : 0.000406s : 2.76% type_inference : 0.009819s : 66.82% event_method : 0.000024s : 0.16% auto_monad : 0.000075s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.39% rewriter_before_opt_a : 0.000086s : 0.58% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.50% jit_opt_a.loop_unroll : 0.000042s : 0.29% jit_opt_a.a_1 : 0.000773s : 5.26% jit_opt_a.with_stream_mark : 0.000029s : 0.20% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001026s : 6.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.14% jit_opt_a.cse : 0.000048s : 0.33% jit_opt_a.replace_applicator : 0.000020s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000039s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000668s : 4.55% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000028s : 0.19% loop_unroll : 0.000436s : 2.97% jit_opt_after_cconv.c_1 : 0.000022s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000053s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000468s : 3.18% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.30% Time group info: ------[substitution.] 0.000263 27 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 3: substitution.graph_param_transform 83.36% : 0.000219s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.95% : 0.000010s : 3: substitution.reduce_eliminate 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 4.45% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009735 2 87.44% : 0.008513s : 1: type_inference.infer 12.56% : 0.001222s : 1: type_inference.specialize ------[replace.] 0.000100 7 65.97% : 0.000066s : 5: replace.inline 34.03% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 7 95.34% : 0.000216s : 5: match.inline 4.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 0.90% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.68% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000003s : 11: predicate.arithmetic_simplify 1.34% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.15% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 16: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.57% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 2.08% : 0.000003s : 11: predicate.reduce_eliminate 1.74% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.41% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.10% : 0.000011s : 59: predicate.switch_simplify 1.43% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.87% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.85% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000951 16 48.33% : 0.000460s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.64% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.03% : 0.000428s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021241 72 0.26% : 0.000056s : 1: add_recomputation 0.37% : 0.000079s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 2.01% : 0.000428s : 1: bootstrap 0.14% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000028s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.86% : 0.006342s : 1: jit_opt_a 0.82% : 0.000173s : 1: jit_opt_after_cconv 0.27% : 0.000057s : 1: jit_opt_b 2.09% : 0.000444s : 1: loop_unroll 3.19% : 0.000677s : 1: mutable_eliminate 4.76% : 0.001011s : 26: opt.transform.jit_opt_a 0.24% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.25% : 0.000477s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000060s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.84% : 0.000604s : 1: renormalize.infer 1.94% : 0.000413s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000043s : 1: rewriter_after_opt_a 0.42% : 0.000089s : 1: rewriter_before_opt_a 0.38% : 0.000081s : 1: symbol_engine_optimizer 46.32% : 0.009839s : 1: type_inference TotalTime = 0.128702, [30] [bootstrap]: 0.00031575 [type_inference]: 0.116497 [event_method]: 2.606e-05 [auto_monad]: 7.869e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00044255 [rewriter_before_opt_a]: 9.994e-05 [expand_dump_flag]: 4.27e-06 [jit_opt_a]: 0.00846652, [2] [Cycle 1]: 0.00438302, [27] [switch_simplify]: 6.845e-05 [loop_unroll]: 3.633e-05 [a_1]: 0.00076229 [with_stream_mark]: 2.567e-05 [recompute_prepare]: 9.05999e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.53998e-06 [specialize_transform]: 7.45998e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.58003e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 5.87999e-06 [renormalize]: 0.00307159 [add_forward_monad_depend]: 1.071e-05 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 2.159e-05 [cse]: 4.174e-05 [replace_applicator]: 2.411e-05 [Cycle 2]: 0.00041827, [27] [switch_simplify]: 8.57e-06 [loop_unroll]: 6.97002e-06 [a_1]: 0.00014003 [with_stream_mark]: 1.572e-05 [recompute_prepare]: 6.29999e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.83997e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.13002e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 3.11001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 7.11001e-06 [cse]: 1.651e-05 [replace_applicator]: 7.40998e-06 [py_interpret_to_execute_after_opt_a]: 6.193e-05 [rewriter_after_opt_a]: 6.114e-05 [convert_after_rewriter]: 8e-06 [order_py_execute_after_rewriter]: 5.53002e-06 [mutable_eliminate]: 0.00079046 [jit_opt_b]: 6.115e-05, [1] [Cycle 1]: 5.21e-05, [2] [frontend_op_eliminate]: 2.068e-05 [inline_after_opt_a]: 1.989e-05 [cconv]: 3.394e-05 [loop_unroll]: 0.0004806 [jit_opt_after_cconv]: 0.0001797, [1] [Cycle 1]: 0.0001729, [11] [c_1]: 2.605e-05 [parameter_eliminate]: 3.8e-06 [updatestate_depend_eliminate]: 8.77e-06 [updatestate_assign_eliminate]: 2.80997e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 3.564e-05 [call_graph_tuple_transform]: 2.677e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 2.26998e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.53003e-06 [remove_dup_value]: 1.688e-05 [partial_unused_args_eliminate]: 3.35998e-06 [environ_conv]: 1.009e-05 [add_recomputation]: 5.719e-05 [cse_after_recomputation]: 2.48e-05, [1] [Cycle 1]: 1.939e-05, [1] [cse]: 1.326e-05 [auto_monad_reorder]: 1.985e-05 [get_jit_bprop_graph]: 2.44999e-06 [rewriter_after_jit_bprop_graph]: 7.31999e-06 [opt_after_jit_grad]: 0.00050712 [symbol_engine_optimizer]: 7.744e-05, [1] [Cycle 1]: 7.101e-05, [6] [build]: 4.12e-06 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 1.403e-05 [opt_reshape]: 7.19001e-06 [fold_const_symbol]: 9.34998e-06 [renormalize]: 5.19998e-07 [validate]: 0.00014171 Sums bootstrap : 0.000316s : 0.25% type_inference : 0.116497s : 93.67% event_method : 0.000026s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000443s : 0.36% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000902s : 0.73% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.003072s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000062s : 0.05% rewriter_after_opt_a : 0.000061s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000790s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000481s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000507s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000142s : 0.11% Time group info: ------[substitution.] 0.000311 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000007s : 4: substitution.graph_param_transform 83.90% : 0.000261s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.48% : 0.000014s : 3: substitution.reduce_eliminate 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000006s : 2: substitution.replace_old_param 3.45% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116401 2 97.39% : 0.113362s : 1: type_inference.infer 2.61% : 0.003039s : 1: type_inference.specialize ------[replace.] 0.000100 7 69.96% : 0.000070s : 5: replace.inline 30.04% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000268 7 96.40% : 0.000258s : 5: match.inline 3.60% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 886 1.64% : 0.000003s : 13: predicate.accumulaten_eliminater 1.04% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000002s : 13: predicate.addn_check_dump 1.17% : 0.000002s : 13: predicate.addn_zero_filter 1.68% : 0.000003s : 13: predicate.arithmetic_simplify 1.14% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 0.93% : 0.000002s : 13: predicate.compare_switch_simplify 1.03% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.88% : 0.000001s : 13: predicate.environ_get_depend_swap 0.96% : 0.000002s : 13: predicate.environ_get_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 0.82% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000001s : 4: predicate.graph_param_transform 5.19% : 0.000009s : 28: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.99% : 0.000002s : 8: predicate.less_batch_normalization 1.18% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.45% : 0.000002s : 19: predicate.load_eliminater 1.59% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 1.68% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000004s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.65% : 0.000003s : 13: predicate.reduce_eliminate 1.25% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.73% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.08% : 0.000002s : 13: predicate.reshape_eliminate 1.11% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000002s : 8: predicate.specialize_transform 1.17% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000004s : 20: predicate.switch_defer_inline 1.80% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.40% : 0.000011s : 64: predicate.switch_simplify 1.13% : 0.000002s : 13: predicate.tile_eliminate 1.09% : 0.000002s : 13: predicate.transpose_eliminate 1.21% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.02% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 13.95% : 0.000024s : 13: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.38% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.41% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.33% : 0.000002s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002586 25 60.83% : 0.001573s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.43% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.74% : 0.000924s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132923 72 0.05% : 0.000061s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.25% : 0.000335s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.37% : 0.008472s : 1: jit_opt_a 0.14% : 0.000183s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.37% : 0.000491s : 1: loop_unroll 0.60% : 0.000803s : 1: mutable_eliminate 0.88% : 0.001167s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000450s : 1: py_interpret_to_execute 0.05% : 0.000066s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.64% : 0.002186s : 1: renormalize.infer 0.66% : 0.000874s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000065s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.66% : 0.116521s : 1: type_inference TotalTime = 0.213303, [30] [bootstrap]: 0.00031962 [type_inference]: 0.200223 [event_method]: 2.888e-05 [auto_monad]: 9.002e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00050096 [rewriter_before_opt_a]: 0.00011679 [expand_dump_flag]: 4.04002e-06 [jit_opt_a]: 0.00932944, [2] [Cycle 1]: 0.00455441, [27] [switch_simplify]: 7.836e-05 [loop_unroll]: 3.803e-05 [a_1]: 0.00075335 [with_stream_mark]: 1.781e-05 [recompute_prepare]: 9.08002e-06 [updatestate_depend_eliminate]: 4.32003e-06 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.51001e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 6.59999e-06 [accelerated_algorithm]: 7.06999e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.729e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 6.70998e-06 [renormalize]: 0.00326167 [add_forward_monad_depend]: 1.009e-05 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.003e-05 [cse]: 4.033e-05 [replace_applicator]: 2.356e-05 [Cycle 2]: 0.00040473, [27] [switch_simplify]: 8.54998e-06 [loop_unroll]: 6.93e-06 [a_1]: 0.00012668 [with_stream_mark]: 1.573e-05 [recompute_prepare]: 6.47001e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 4.21001e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.42001e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 2.83e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.977e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.96e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.584e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.493e-05 [rewriter_after_opt_a]: 4.749e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00071413 [jit_opt_b]: 0.00010544, [1] [Cycle 1]: 9.615e-05, [2] [frontend_op_eliminate]: 6.196e-05 [inline_after_opt_a]: 1.951e-05 [cconv]: 3.116e-05 [loop_unroll]: 0.00049414 [jit_opt_after_cconv]: 0.0001817, [1] [Cycle 1]: 0.00017436, [11] [c_1]: 2.712e-05 [parameter_eliminate]: 4.23001e-06 [updatestate_depend_eliminate]: 7.55e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 3.375e-05 [call_graph_tuple_transform]: 2.563e-05 [tuple_list_get_item_eliminator]: 6.76999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 6.86999e-06 [remove_dup_value]: 2.044e-05 [partial_unused_args_eliminate]: 3.25998e-06 [environ_conv]: 1.032e-05 [add_recomputation]: 5.994e-05 [cse_after_recomputation]: 2.764e-05, [1] [Cycle 1]: 2.199e-05, [1] [cse]: 1.542e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 4.60999e-06 [opt_after_jit_grad]: 0.00048223 [symbol_engine_optimizer]: 0.00017452, [1] [Cycle 1]: 7.877e-05, [6] [build]: 5.27001e-06 [elim_shapecalc]: 9.46e-06 [elim_not_effective]: 1.645e-05 [opt_reshape]: 8.98002e-06 [fold_const_symbol]: 9.52999e-06 [renormalize]: 3.59985e-07 [validate]: 5.368e-05 Sums bootstrap : 0.000320s : 0.15% type_inference : 0.200223s : 96.18% event_method : 0.000029s : 0.01% auto_monad : 0.000090s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000501s : 0.24% rewriter_before_opt_a : 0.000117s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.04% jit_opt_a.loop_unroll : 0.000045s : 0.02% jit_opt_a.a_1 : 0.000880s : 0.42% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003262s : 1.57% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000056s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000047s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000714s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000062s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000031s : 0.01% loop_unroll : 0.000494s : 0.24% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000482s : 0.23% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.03% Time group info: ------[substitution.] 0.000282 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000008s : 4: substitution.graph_param_transform 85.87% : 0.000242s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000006s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 4.91% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.200093 2 97.85% : 0.195791s : 1: type_inference.infer 2.15% : 0.004302s : 1: type_inference.specialize ------[replace.] 0.000124 7 67.12% : 0.000083s : 5: replace.inline 32.88% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.03% : 0.000239s : 5: match.inline 4.97% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.16% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.63% : 0.000009s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.99% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.75% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.85% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 1.97% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.09% : 0.000002s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.65% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 2.03% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.26% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002605 25 62.58% : 0.001630s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.51% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.91% : 0.000910s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.217843 72 0.03% : 0.000064s : 1: add_recomputation 0.04% : 0.000093s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.16% : 0.000340s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.28% : 0.009333s : 1: jit_opt_a 0.08% : 0.000184s : 1: jit_opt_after_cconv 0.05% : 0.000109s : 1: jit_opt_b 0.23% : 0.000504s : 1: loop_unroll 0.33% : 0.000726s : 1: mutable_eliminate 0.54% : 0.001167s : 26: opt.transform.jit_opt_a 0.03% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000075s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000492s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000509s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 1.07% : 0.002321s : 1: renormalize.infer 0.43% : 0.000928s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000051s : 1: rewriter_after_opt_a 0.06% : 0.000122s : 1: rewriter_before_opt_a 0.08% : 0.000178s : 1: symbol_engine_optimizer 91.93% : 0.200253s : 1: type_inference TotalTime = 0.0348241, [30] [bootstrap]: 0.00031577 [type_inference]: 0.0208546 [event_method]: 2.121e-05 [auto_monad]: 7.254e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00012893 [rewriter_before_opt_a]: 8.662e-05 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.0111022, [2] [Cycle 1]: 0.00244429, [27] [switch_simplify]: 6.795e-05 [loop_unroll]: 3.034e-05 [a_1]: 0.00059752 [with_stream_mark]: 2.363e-05 [recompute_prepare]: 8.78001e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.617e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00135592 [add_forward_monad_depend]: 6.63e-06 [auto_monad_grad]: 2.63003e-06 [auto_monad_eliminator]: 1.746e-05 [cse]: 3.712e-05 [replace_applicator]: 1.522e-05 [Cycle 2]: 0.00033056, [27] [switch_simplify]: 7.04001e-06 [loop_unroll]: 5.69999e-06 [a_1]: 9.587e-05 [with_stream_mark]: 9.23002e-06 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.21998e-06 [accelerated_algorithm]: 5.41998e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.31001e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.394e-05 [j_node_and_user_rematch]: 8.12998e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.43999e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.31e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.391e-05 [rewriter_after_opt_a]: 4.024e-05 [convert_after_rewriter]: 6.34999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00061551 [jit_opt_b]: 4.981e-05, [1] [Cycle 1]: 4.242e-05, [2] [frontend_op_eliminate]: 1.581e-05 [inline_after_opt_a]: 1.592e-05 [cconv]: 2.766e-05 [loop_unroll]: 0.0004318 [jit_opt_after_cconv]: 0.00014684, [1] [Cycle 1]: 0.00013939, [11] [c_1]: 2.126e-05 [parameter_eliminate]: 3.02002e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.3e-05 [call_graph_tuple_transform]: 1.932e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.662e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 4.985e-05 [cse_after_recomputation]: 2.192e-05, [1] [Cycle 1]: 1.654e-05, [1] [cse]: 1.108e-05 [auto_monad_reorder]: 1.844e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 5.03002e-06 [opt_after_jit_grad]: 0.00047342 [symbol_engine_optimizer]: 8.844e-05, [1] [Cycle 1]: 8.216e-05, [6] [build]: 3.37997e-06 [elim_shapecalc]: 7.30998e-06 [elim_not_effective]: 2.841e-05 [opt_reshape]: 6.37001e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 3.69997e-07 [validate]: 4.064e-05 Sums bootstrap : 0.000316s : 1.22% type_inference : 0.020855s : 80.50% event_method : 0.000021s : 0.08% auto_monad : 0.000073s : 0.28% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000129s : 0.50% rewriter_before_opt_a : 0.000087s : 0.33% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000075s : 0.29% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.000693s : 2.68% jit_opt_a.with_stream_mark : 0.000033s : 0.13% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.001356s : 5.23% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000050s : 0.19% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000040s : 0.16% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000616s : 2.38% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000028s : 0.11% loop_unroll : 0.000432s : 1.67% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000050s : 0.19% cse_after_recomputation.cse : 0.000011s : 0.04% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000473s : 1.83% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000028s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.16% Time group info: ------[substitution.] 0.000251 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 3: substitution.graph_param_transform 86.17% : 0.000216s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.14% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020780 2 91.47% : 0.019008s : 1: type_inference.infer 8.53% : 0.001772s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.97% : 0.000054s : 4: replace.inline 32.03% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.78% : 0.000214s : 4: match.inline 5.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.32% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.26% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.43% : 0.000001s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.78% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.65% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.23% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.35% : 0.000010s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.75% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000938 13 43.12% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.74% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.13% : 0.000480s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.037176 72 0.14% : 0.000053s : 1: add_recomputation 0.20% : 0.000076s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.89% : 0.000329s : 1: bootstrap 0.08% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000025s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 29.87% : 0.011106s : 1: jit_opt_a 0.40% : 0.000150s : 1: jit_opt_after_cconv 0.14% : 0.000052s : 1: jit_opt_b 1.18% : 0.000440s : 1: loop_unroll 1.68% : 0.000624s : 1: mutable_eliminate 2.49% : 0.000927s : 26: opt.transform.jit_opt_a 0.13% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000048s : 4: opt.transform.symbol_engine_opt 1.30% : 0.000482s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000133s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000019s : 1: remove_dup_value 2.30% : 0.000854s : 1: renormalize.infer 1.32% : 0.000492s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000043s : 1: rewriter_after_opt_a 0.24% : 0.000091s : 1: rewriter_before_opt_a 0.24% : 0.000091s : 1: symbol_engine_optimizer 56.14% : 0.020870s : 1: type_inference TotalTime = 0.127956, [30] [bootstrap]: 0.00029596 [type_inference]: 0.116349 [event_method]: 2.53e-05 [auto_monad]: 7.852e-05 [graph_reusing]: 5.81998e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.00047924 [rewriter_before_opt_a]: 0.00010074 [expand_dump_flag]: 3.97002e-06 [jit_opt_a]: 0.00814623, [2] [Cycle 1]: 0.00404692, [27] [switch_simplify]: 6.938e-05 [loop_unroll]: 3.52e-05 [a_1]: 0.00072117 [with_stream_mark]: 2.277e-05 [recompute_prepare]: 8.33999e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 4.44002e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.086e-05 [inline_without_move]: 6.11998e-06 [renormalize]: 0.00281624 [add_forward_monad_depend]: 7.4e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.782e-05 [cse]: 3.713e-05 [replace_applicator]: 1.906e-05 [Cycle 2]: 0.00040322, [27] [switch_simplify]: 6.76999e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00013824 [with_stream_mark]: 1.368e-05 [recompute_prepare]: 6.59999e-06 [updatestate_depend_eliminate]: 3.63999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 2.86999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.437e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 9.89001e-06 [inline_without_move]: 5.64e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.95002e-06 [cse]: 1.432e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.546e-05 [rewriter_after_opt_a]: 4.055e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00065534 [jit_opt_b]: 9.786e-05, [1] [Cycle 1]: 8.98e-05, [2] [frontend_op_eliminate]: 3.864e-05 [inline_after_opt_a]: 1.945e-05 [cconv]: 2.983e-05 [loop_unroll]: 0.00045375 [jit_opt_after_cconv]: 0.00015672, [1] [Cycle 1]: 0.0001494, [11] [c_1]: 2.61e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.313e-05 [call_graph_tuple_transform]: 2.15e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.972e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 9.71998e-06 [add_recomputation]: 5.238e-05 [cse_after_recomputation]: 2.48e-05, [1] [Cycle 1]: 1.848e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.92e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.66e-06 [opt_after_jit_grad]: 0.00047013 [symbol_engine_optimizer]: 8.065e-05, [1] [Cycle 1]: 7.472e-05, [6] [build]: 3.97998e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 1.561e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 9.90002e-06 [renormalize]: 4.2998e-07 [validate]: 0.00013079 Sums bootstrap : 0.000296s : 0.24% type_inference : 0.116349s : 94.12% event_method : 0.000025s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000479s : 0.39% rewriter_before_opt_a : 0.000101s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000859s : 0.70% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002816s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000655s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000039s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000454s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000470s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000131s : 0.11% Time group info: ------[substitution.] 0.000302 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000006s : 4: substitution.graph_param_transform 84.56% : 0.000255s : 5: substitution.inline 1.22% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.95% : 0.000012s : 3: substitution.reduce_eliminate 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000006s : 2: substitution.replace_old_param 3.61% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116260 2 97.47% : 0.113317s : 1: type_inference.infer 2.53% : 0.002943s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.77% : 0.000066s : 5: replace.inline 32.23% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 96.25% : 0.000252s : 5: match.inline 3.75% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 13: predicate.addn_check_dump 1.90% : 0.000003s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.47% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.45% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.04% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 1.00% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.43% : 0.000011s : 64: predicate.switch_simplify 1.56% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002436 25 62.65% : 0.001526s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.57% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.77% : 0.000823s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131892 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.23% : 0.000308s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.18% : 0.008150s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.08% : 0.000101s : 1: jit_opt_b 0.35% : 0.000462s : 1: loop_unroll 0.50% : 0.000665s : 1: mutable_eliminate 0.85% : 0.001118s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000051s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000487s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.53% : 0.002022s : 1: renormalize.infer 0.59% : 0.000783s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000106s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 88.23% : 0.116370s : 1: type_inference TotalTime = 0.139334, [30] [bootstrap]: 0.00035695 [type_inference]: 0.126368 [event_method]: 2.263e-05 [auto_monad]: 7.435e-05 [graph_reusing]: 6.75002e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00070245 [rewriter_before_opt_a]: 0.00010271 [expand_dump_flag]: 4.47998e-06 [jit_opt_a]: 0.00913875, [2] [Cycle 1]: 0.00493118, [27] [switch_simplify]: 6.877e-05 [loop_unroll]: 3.451e-05 [a_1]: 0.00075169 [with_stream_mark]: 2.246e-05 [recompute_prepare]: 9.15001e-06 [updatestate_depend_eliminate]: 4.47003e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.96999e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 7.16001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.161e-05 [inline_without_move]: 6.63e-06 [renormalize]: 0.0036445 [add_forward_monad_depend]: 9.39e-06 [auto_monad_grad]: 3.09001e-06 [auto_monad_eliminator]: 1.955e-05 [cse]: 4.051e-05 [replace_applicator]: 2.351e-05 [Cycle 2]: 0.00043124, [27] [switch_simplify]: 8.67e-06 [loop_unroll]: 7.21999e-06 [a_1]: 0.00014889 [with_stream_mark]: 1.565e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 3.46999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.677e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.68002e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 7.18e-06 [cse]: 1.837e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.776e-05 [rewriter_after_opt_a]: 4.127e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00080431 [jit_opt_b]: 5.925e-05, [1] [Cycle 1]: 5.158e-05, [2] [frontend_op_eliminate]: 1.998e-05 [inline_after_opt_a]: 1.979e-05 [cconv]: 2.975e-05 [loop_unroll]: 0.0004384 [jit_opt_after_cconv]: 0.0001681, [1] [Cycle 1]: 0.00016157, [11] [c_1]: 2.746e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 7.28999e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.757e-05 [call_graph_tuple_transform]: 2.393e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.31998e-06 [remove_dup_value]: 1.806e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 9.57001e-06 [add_recomputation]: 5.443e-05 [cse_after_recomputation]: 2.606e-05, [1] [Cycle 1]: 1.985e-05, [1] [cse]: 1.378e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 5.47999e-06 [opt_after_jit_grad]: 0.00048656 [symbol_engine_optimizer]: 8.301e-05, [1] [Cycle 1]: 7.664e-05, [6] [build]: 4.28999e-06 [elim_shapecalc]: 9.17001e-06 [elim_not_effective]: 1.494e-05 [opt_reshape]: 7.01999e-06 [fold_const_symbol]: 1.048e-05 [renormalize]: 4.00003e-07 [validate]: 7.365e-05 Sums bootstrap : 0.000357s : 0.26% type_inference : 0.126368s : 93.68% event_method : 0.000023s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000702s : 0.52% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000901s : 0.67% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003645s : 2.70% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000059s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000804s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000438s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000487s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000074s : 0.05% Time group info: ------[substitution.] 0.000307 28 0.83% : 0.000003s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 4: substitution.graph_param_transform 83.58% : 0.000257s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.49% : 0.000014s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000006s : 2: substitution.replace_old_param 3.53% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126273 2 97.08% : 0.122585s : 1: type_inference.infer 2.92% : 0.003687s : 1: type_inference.specialize ------[replace.] 0.000111 7 69.08% : 0.000077s : 5: replace.inline 30.92% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 7 96.36% : 0.000254s : 5: match.inline 3.64% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.48% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 2.10% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.26% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.34% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.05% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 0.97% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.78% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.40% : 0.000002s : 13: predicate.print_const_string_wrapper 2.31% : 0.000004s : 13: predicate.reduce_eliminate 1.72% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.09% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002857 25 59.74% : 0.001707s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.76% : 0.000079s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.50% : 0.001071s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144190 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000376s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.34% : 0.009143s : 1: jit_opt_a 0.12% : 0.000170s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.31% : 0.000447s : 1: loop_unroll 0.56% : 0.000814s : 1: mutable_eliminate 0.81% : 0.001171s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000495s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.49% : 0.000713s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.75% : 0.002523s : 1: renormalize.infer 0.77% : 0.001109s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000107s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 87.66% : 0.126391s : 1: type_inference TotalTime = 0.0642955, [30] [bootstrap]: 0.00028736 [type_inference]: 0.0520248 [event_method]: 2.511e-05 [auto_monad]: 7.857e-05 [graph_reusing]: 7.03e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00035668 [rewriter_before_opt_a]: 0.00010872 [expand_dump_flag]: 4.99998e-06 [jit_opt_a]: 0.00836928, [2] [Cycle 1]: 0.00353069, [27] [switch_simplify]: 8.178e-05 [loop_unroll]: 3.921e-05 [a_1]: 0.00082936 [with_stream_mark]: 2.72e-05 [recompute_prepare]: 1.033e-05 [updatestate_depend_eliminate]: 5.39998e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.88999e-06 [updatestate_useless_node_eliminater]: 6.89999e-06 [accelerated_algorithm]: 7.87e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 7.6e-06 [merge_forward]: 5.58002e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.79e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 3.35e-06 [replace_old_param]: 1.174e-05 [inline_without_move]: 7.41001e-06 [renormalize]: 0.00209737 [add_forward_monad_depend]: 1.093e-05 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 2.177e-05 [cse]: 4.441e-05 [replace_applicator]: 2.611e-05 [Cycle 2]: 0.00042069, [27] [switch_simplify]: 8.50001e-06 [loop_unroll]: 6.66e-06 [a_1]: 0.00013082 [with_stream_mark]: 1.693e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.73999e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 6.30002e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.62e-06 [cell_reuse_recompute_pass]: 3.33e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.15e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 1.117e-05 [inline_without_move]: 5.76e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.14003e-06 [auto_monad_eliminator]: 7.42002e-06 [cse]: 1.92e-05 [replace_applicator]: 6.38e-06 [py_interpret_to_execute_after_opt_a]: 1.854e-05 [rewriter_after_opt_a]: 4.559e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00082895 [jit_opt_b]: 6.701e-05, [1] [Cycle 1]: 5.63e-05, [2] [frontend_op_eliminate]: 2.2e-05 [inline_after_opt_a]: 2.065e-05 [cconv]: 3.609e-05 [loop_unroll]: 0.0005238 [jit_opt_after_cconv]: 0.00019557, [1] [Cycle 1]: 0.00018665, [11] [c_1]: 2.961e-05 [parameter_eliminate]: 4.62998e-06 [updatestate_depend_eliminate]: 1.017e-05 [updatestate_assign_eliminate]: 5.14e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 4.051e-05 [call_graph_tuple_transform]: 2.551e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.81999e-06 [remove_dup_value]: 2.278e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 1.176e-05 [add_recomputation]: 5.951e-05 [cse_after_recomputation]: 2.77e-05, [1] [Cycle 1]: 2.1e-05, [1] [cse]: 1.463e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 2.49001e-06 [rewriter_after_jit_bprop_graph]: 8.12e-06 [opt_after_jit_grad]: 0.00078592 [symbol_engine_optimizer]: 9.123e-05, [1] [Cycle 1]: 8.363e-05, [6] [build]: 5.40999e-06 [elim_shapecalc]: 9.96e-06 [elim_not_effective]: 1.733e-05 [opt_reshape]: 8.28001e-06 [fold_const_symbol]: 1.116e-05 [renormalize]: 6.90023e-07 [validate]: 5.621e-05 Sums bootstrap : 0.000287s : 0.49% type_inference : 0.052025s : 87.92% event_method : 0.000025s : 0.04% auto_monad : 0.000079s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000357s : 0.60% rewriter_before_opt_a : 0.000109s : 0.18% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000090s : 0.15% jit_opt_a.loop_unroll : 0.000046s : 0.08% jit_opt_a.a_1 : 0.000960s : 1.62% jit_opt_a.with_stream_mark : 0.000044s : 0.07% jit_opt_a.recompute_prepare : 0.000017s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000010s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002097s : 3.54% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.05% jit_opt_a.cse : 0.000064s : 0.11% jit_opt_a.replace_applicator : 0.000032s : 0.05% py_interpret_to_execute_after_opt_a : 0.000019s : 0.03% rewriter_after_opt_a : 0.000046s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000829s : 1.40% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.04% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000036s : 0.06% loop_unroll : 0.000524s : 0.89% jit_opt_after_cconv.c_1 : 0.000030s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000023s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.02% add_recomputation : 0.000060s : 0.10% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000786s : 1.33% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.09% Time group info: ------[substitution.] 0.000334 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 4: substitution.graph_param_transform 87.11% : 0.000291s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000006s : 4: substitution.remove_not_recompute_node 2.37% : 0.000008s : 2: substitution.replace_old_param 4.42% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051924 2 95.42% : 0.049547s : 1: type_inference.infer 4.58% : 0.002377s : 1: type_inference.specialize ------[replace.] 0.000129 7 67.67% : 0.000088s : 5: replace.inline 32.33% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000300 7 95.58% : 0.000287s : 5: match.inline 4.42% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.02% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 6.28% : 0.000010s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.15% : 0.000003s : 19: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.39% : 0.000002s : 13: predicate.minmaximum_grad 1.79% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000004s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.86% : 0.000003s : 13: predicate.reduce_eliminate 1.57% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.68% : 0.000012s : 65: predicate.switch_simplify 1.16% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.58% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002130 21 63.37% : 0.001350s : 12: func_graph_cloner_run.FuncGraphClonerGraph 4.46% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.17% : 0.000685s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067735 72 0.09% : 0.000064s : 1: add_recomputation 0.12% : 0.000082s : 1: auto_monad 0.03% : 0.000023s : 1: auto_monad_reorder 0.45% : 0.000305s : 1: bootstrap 0.06% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000030s : 1: cse_after_recomputation 0.02% : 0.000014s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 12.36% : 0.008373s : 1: jit_opt_a 0.29% : 0.000199s : 1: jit_opt_after_cconv 0.10% : 0.000069s : 1: jit_opt_b 0.79% : 0.000534s : 1: loop_unroll 1.24% : 0.000843s : 1: mutable_eliminate 1.86% : 0.001261s : 26: opt.transform.jit_opt_a 0.10% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000035s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.05% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000043s : 4: opt.transform.symbol_engine_opt 1.18% : 0.000797s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.54% : 0.000363s : 1: py_interpret_to_execute 0.03% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000025s : 1: remove_dup_value 1.93% : 0.001305s : 1: renormalize.infer 1.15% : 0.000781s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000049s : 1: rewriter_after_opt_a 0.17% : 0.000115s : 1: rewriter_before_opt_a 0.14% : 0.000094s : 1: symbol_engine_optimizer 76.84% : 0.052047s : 1: type_inference TotalTime = 0.0610153, [30] [bootstrap]: 0.00032305 [type_inference]: 0.050399 [event_method]: 2.174e-05 [auto_monad]: 7.228e-05 [graph_reusing]: 5.57999e-06 [pre_auto_parallel]: 2.04e-06 [py_interpret_to_execute]: 0.00012438 [rewriter_before_opt_a]: 8.706e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00671248, [2] [Cycle 1]: 0.00227215, [27] [switch_simplify]: 6.437e-05 [loop_unroll]: 3.226e-05 [a_1]: 0.00064552 [with_stream_mark]: 2.151e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.21001e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 3.30998e-06 [parameter_eliminate]: 2.50002e-06 [specialize_transform]: 7.34002e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.91999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.90002e-06 [renormalize]: 0.00112299 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.699e-05 [cse]: 3.656e-05 [replace_applicator]: 1.573e-05 [Cycle 2]: 0.0003497, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 5.64998e-06 [a_1]: 9.653e-05 [with_stream_mark]: 1.213e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.41002e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.50003e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.48999e-06 [inline_without_move]: 5.26002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.474e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 1.62e-05 [rewriter_after_opt_a]: 3.771e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00066184 [jit_opt_b]: 5.288e-05, [1] [Cycle 1]: 4.537e-05, [2] [frontend_op_eliminate]: 1.616e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 2.82e-05 [loop_unroll]: 0.00133055 [jit_opt_after_cconv]: 0.00016214, [1] [Cycle 1]: 0.00015442, [11] [c_1]: 2.374e-05 [parameter_eliminate]: 3.30998e-06 [updatestate_depend_eliminate]: 7.01001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.983e-05 [call_graph_tuple_transform]: 1.924e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.59998e-06 [remove_dup_value]: 1.847e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 6.93998e-06 [add_recomputation]: 5.377e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.89e-06 [opt_after_jit_grad]: 0.00050061 [symbol_engine_optimizer]: 9.92e-05, [1] [Cycle 1]: 9.23e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 8.30999e-06 [elim_not_effective]: 3.452e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 4.39992e-07 [validate]: 4.269e-05 Sums bootstrap : 0.000323s : 0.57% type_inference : 0.050399s : 89.54% event_method : 0.000022s : 0.04% auto_monad : 0.000072s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000124s : 0.22% rewriter_before_opt_a : 0.000087s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.13% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000742s : 1.32% jit_opt_a.with_stream_mark : 0.000034s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001123s : 2.00% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000051s : 0.09% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.03% rewriter_after_opt_a : 0.000038s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000662s : 1.18% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.001331s : 2.36% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000054s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000501s : 0.89% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000035s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.08% Time group info: ------[substitution.] 0.000292 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 1.86% : 0.000005s : 3: substitution.graph_param_transform 87.68% : 0.000256s : 4: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.47% : 0.000004s : 2: substitution.replace_old_param 4.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050320 2 96.33% : 0.048476s : 1: type_inference.infer 3.67% : 0.001844s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.11% : 0.000055s : 4: replace.inline 30.89% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 6 95.51% : 0.000253s : 4: match.inline 4.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.12% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.33% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.20% : 0.000008s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.91% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.63% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.78% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000009s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000952 13 41.78% : 0.000398s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.66% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 53.56% : 0.000510s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063205 72 0.09% : 0.000057s : 1: add_recomputation 0.12% : 0.000076s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.55% : 0.000346s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.63% : 0.006716s : 1: jit_opt_a 0.26% : 0.000166s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 2.12% : 0.001343s : 1: loop_unroll 1.06% : 0.000672s : 1: mutable_eliminate 1.56% : 0.000983s : 26: opt.transform.jit_opt_a 0.08% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000055s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000129s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 1.01% : 0.000638s : 1: renormalize.infer 0.75% : 0.000475s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.14% : 0.000091s : 1: rewriter_before_opt_a 0.16% : 0.000102s : 1: symbol_engine_optimizer 79.76% : 0.050413s : 1: type_inference TotalTime = 0.0191493, [30] [bootstrap]: 0.00028134 [type_inference]: 0.00941889 [event_method]: 2.482e-05 [auto_monad]: 7.846e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 6.334e-05 [rewriter_before_opt_a]: 9.772e-05 [expand_dump_flag]: 3.95e-06 [jit_opt_a]: 0.00653758, [2] [Cycle 1]: 0.00208586, [27] [switch_simplify]: 7.039e-05 [loop_unroll]: 3.556e-05 [a_1]: 0.00067996 [with_stream_mark]: 1.939e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 4.06001e-06 [updatestate_loads_eliminate]: 3.43999e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.45002e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 6.03998e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.812e-05 [j_node_and_user_rematch]: 1.137e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 6.18002e-06 [renormalize]: 0.00089391 [add_forward_monad_depend]: 6.90002e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.751e-05 [cse]: 4.286e-05 [replace_applicator]: 1.612e-05 [Cycle 2]: 0.00034265, [27] [switch_simplify]: 6.17999e-06 [loop_unroll]: 5.48002e-06 [a_1]: 9.542e-05 [with_stream_mark]: 1.132e-05 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 2.19999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.08001e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 6.22001e-06 [cse]: 1.58e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.412e-05 [rewriter_after_opt_a]: 4.08e-05 [convert_after_rewriter]: 8.51002e-06 [order_py_execute_after_rewriter]: 5.04003e-06 [mutable_eliminate]: 0.0006961 [jit_opt_b]: 5.263e-05, [1] [Cycle 1]: 4.554e-05, [2] [frontend_op_eliminate]: 1.709e-05 [inline_after_opt_a]: 1.715e-05 [cconv]: 2.863e-05 [loop_unroll]: 0.00053689 [jit_opt_after_cconv]: 0.00017149, [1] [Cycle 1]: 0.00016435, [11] [c_1]: 2.244e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 7.65998e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 3.825e-05 [call_graph_tuple_transform]: 2.113e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 4.703e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 7.41999e-06 [add_recomputation]: 7.879e-05 [cse_after_recomputation]: 2.95e-05, [1] [Cycle 1]: 2.247e-05, [1] [cse]: 1.516e-05 [auto_monad_reorder]: 1.981e-05 [get_jit_bprop_graph]: 2.61e-06 [rewriter_after_jit_bprop_graph]: 7e-06 [opt_after_jit_grad]: 0.00055017 [symbol_engine_optimizer]: 8.187e-05, [1] [Cycle 1]: 7.403e-05, [6] [build]: 4.45e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.535e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 9.49e-06 [renormalize]: 8.2e-07 [validate]: 5.2e-05 Sums bootstrap : 0.000281s : 1.95% type_inference : 0.009419s : 65.40% event_method : 0.000025s : 0.17% auto_monad : 0.000078s : 0.54% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000063s : 0.44% rewriter_before_opt_a : 0.000098s : 0.68% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000077s : 0.53% jit_opt_a.loop_unroll : 0.000041s : 0.28% jit_opt_a.a_1 : 0.000775s : 5.38% jit_opt_a.with_stream_mark : 0.000031s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.14% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000894s : 6.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000059s : 0.41% jit_opt_a.replace_applicator : 0.000021s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000041s : 0.28% convert_after_rewriter : 0.000009s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000696s : 4.83% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000029s : 0.20% loop_unroll : 0.000537s : 3.73% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000038s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000047s : 0.33% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000079s : 0.55% cse_after_recomputation.cse : 0.000015s : 0.11% auto_monad_reorder : 0.000020s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000550s : 3.82% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000052s : 0.36% Time group info: ------[substitution.] 0.000270 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 3: substitution.graph_param_transform 86.30% : 0.000233s : 5: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.72% : 0.000005s : 2: substitution.replace_old_param 5.19% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009279 2 87.06% : 0.008079s : 1: type_inference.infer 12.94% : 0.001200s : 1: type_inference.specialize ------[replace.] 0.000104 7 69.44% : 0.000072s : 5: replace.inline 30.56% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 94.73% : 0.000230s : 5: match.inline 5.27% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 1.45% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.23% : 0.000002s : 11: predicate.addn_zero_filter 2.48% : 0.000003s : 11: predicate.arithmetic_simplify 1.16% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.35% : 0.000002s : 11: predicate.depend_value_elim 1.19% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.63% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_depend_swap 1.40% : 0.000002s : 11: predicate.environ_get_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.94% : 0.000008s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 16: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.14% : 0.000002s : 11: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000001s : 11: predicate.print_const_string_wrapper 1.93% : 0.000003s : 11: predicate.reduce_eliminate 1.61% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000002s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.03% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.78% : 0.000010s : 59: predicate.switch_simplify 1.16% : 0.000002s : 11: predicate.tile_eliminate 1.39% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000872 16 49.13% : 0.000428s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.41% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.46% : 0.000379s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021116 72 0.39% : 0.000083s : 1: add_recomputation 0.39% : 0.000083s : 1: auto_monad 0.11% : 0.000023s : 1: auto_monad_reorder 1.42% : 0.000299s : 1: bootstrap 0.15% : 0.000031s : 1: cconv 0.05% : 0.000011s : 1: convert_after_rewriter 0.15% : 0.000032s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.14% : 0.000030s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.98% : 0.006542s : 1: jit_opt_a 0.82% : 0.000174s : 1: jit_opt_after_cconv 0.26% : 0.000056s : 1: jit_opt_b 2.59% : 0.000546s : 1: loop_unroll 3.35% : 0.000707s : 1: mutable_eliminate 4.84% : 0.001022s : 26: opt.transform.jit_opt_a 0.25% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000562s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000066s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.24% : 0.000050s : 1: remove_dup_value 2.36% : 0.000498s : 1: renormalize.infer 1.83% : 0.000386s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000044s : 1: rewriter_after_opt_a 0.48% : 0.000101s : 1: rewriter_before_opt_a 0.40% : 0.000084s : 1: symbol_engine_optimizer 44.71% : 0.009441s : 1: type_inference TotalTime = 0.250903, [30] [bootstrap]: 0.00125991 [type_inference]: 0.232706 [event_method]: 2.009e-05 [auto_monad]: 7.881e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00063017 [rewriter_before_opt_a]: 9.971e-05 [expand_dump_flag]: 4.30999e-06 [jit_opt_a]: 0.00869862, [2] [Cycle 1]: 0.00423114, [27] [switch_simplify]: 6.637e-05 [loop_unroll]: 3.08e-05 [a_1]: 0.00065439 [with_stream_mark]: 8.935e-05 [recompute_prepare]: 1.095e-05 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 3.11001e-06 [specialize_transform]: 7.68999e-06 [updatestate_useless_node_eliminater]: 6.53e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.665e-05 [j_node_and_user_rematch]: 1.054e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.139e-05 [inline_without_move]: 6.76e-06 [renormalize]: 0.00297646 [add_forward_monad_depend]: 8.65999e-06 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 3.104e-05 [cse]: 3.501e-05 [replace_applicator]: 2.392e-05 [Cycle 2]: 0.00041271, [27] [switch_simplify]: 7.2e-06 [loop_unroll]: 6.14999e-06 [a_1]: 0.00013197 [with_stream_mark]: 1.624e-05 [recompute_prepare]: 6.81999e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.81003e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 3.27002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.032e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 3.33e-06 [replace_old_param]: 1.037e-05 [inline_without_move]: 5.98998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.31e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 8.72998e-06 [cse]: 1.337e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.742e-05 [rewriter_after_opt_a]: 4.66e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00082869 [jit_opt_b]: 6.25e-05, [1] [Cycle 1]: 5.311e-05, [2] [frontend_op_eliminate]: 2.155e-05 [inline_after_opt_a]: 2.018e-05 [cconv]: 3.388e-05 [loop_unroll]: 0.00506918 [jit_opt_after_cconv]: 0.00020205, [1] [Cycle 1]: 0.00019139, [11] [c_1]: 3.141e-05 [parameter_eliminate]: 5.04e-06 [updatestate_depend_eliminate]: 8.69003e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.79999e-06 [cse]: 4.331e-05 [call_graph_tuple_transform]: 2.735e-05 [tuple_list_get_item_eliminator]: 7.63001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.702e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 1.008e-05 [add_recomputation]: 6.249e-05 [cse_after_recomputation]: 2.419e-05, [1] [Cycle 1]: 1.761e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.696e-05 [get_jit_bprop_graph]: 1.67001e-06 [rewriter_after_jit_bprop_graph]: 8.64e-06 [opt_after_jit_grad]: 0.00064192 [symbol_engine_optimizer]: 8.226e-05, [1] [Cycle 1]: 7.535e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 9.50001e-06 [elim_not_effective]: 1.516e-05 [opt_reshape]: 6.69999e-06 [fold_const_symbol]: 1.025e-05 [renormalize]: 5.79981e-07 [validate]: 4.971e-05 Sums bootstrap : 0.001260s : 0.51% type_inference : 0.232706s : 94.52% event_method : 0.000020s : 0.01% auto_monad : 0.000079s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000630s : 0.26% rewriter_before_opt_a : 0.000100s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000786s : 0.32% jit_opt_a.with_stream_mark : 0.000106s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002977s : 1.21% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000040s : 0.02% jit_opt_a.cse : 0.000048s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000047s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000829s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.005069s : 2.06% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000043s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000062s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000642s : 0.26% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.02% Time group info: ------[substitution.] 0.000260 24 1.04% : 0.000003s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000008s : 4: substitution.graph_param_transform 83.71% : 0.000218s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000006s : 4: substitution.remove_not_recompute_node 2.48% : 0.000006s : 2: substitution.replace_old_param 5.36% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.232609 2 98.72% : 0.229626s : 1: type_inference.infer 1.28% : 0.002983s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.30% : 0.000055s : 4: replace.inline 33.70% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.40% : 0.000215s : 4: match.inline 5.60% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.14% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.52% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 6.32% : 0.000009s : 26: predicate.inline 1.22% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 18: predicate.load_eliminater 3.06% : 0.000005s : 4: predicate.loop_unroll_after_grad 3.37% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.97% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.12% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.45% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 8: predicate.special_op_eliminate 1.08% : 0.000002s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.86% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.89% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002350 22 62.02% : 0.001457s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.19% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.80% : 0.000841s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.255040 72 0.03% : 0.000066s : 1: add_recomputation 0.03% : 0.000082s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.50% : 0.001280s : 1: bootstrap 0.01% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.41% : 0.008702s : 1: jit_opt_a 0.08% : 0.000205s : 1: jit_opt_after_cconv 0.03% : 0.000066s : 1: jit_opt_b 1.99% : 0.005084s : 1: loop_unroll 0.33% : 0.000842s : 1: mutable_eliminate 0.41% : 0.001054s : 26: opt.transform.jit_opt_a 0.03% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000032s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000651s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000638s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.79% : 0.002026s : 1: renormalize.infer 0.37% : 0.000939s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000051s : 1: rewriter_after_opt_a 0.04% : 0.000106s : 1: rewriter_before_opt_a 0.03% : 0.000085s : 1: symbol_engine_optimizer 91.25% : 0.232722s : 1: type_inference TotalTime = 0.0600119, [30] [bootstrap]: 0.00036105 [type_inference]: 0.0494428 [event_method]: 2.166e-05 [auto_monad]: 7.329e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00029524 [rewriter_before_opt_a]: 8.829e-05 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00704039, [2] [Cycle 1]: 0.00294597, [27] [switch_simplify]: 6.855e-05 [loop_unroll]: 3.133e-05 [a_1]: 0.00066745 [with_stream_mark]: 2.421e-05 [recompute_prepare]: 1.208e-05 [updatestate_depend_eliminate]: 5.09e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 7.83999e-06 [updatestate_useless_node_eliminater]: 6.78e-06 [accelerated_algorithm]: 6.77002e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.734e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.138e-05 [inline_without_move]: 6.70002e-06 [renormalize]: 0.00174426 [add_forward_monad_depend]: 7.90998e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.112e-05 [cse]: 3.316e-05 [replace_applicator]: 2.14e-05 [Cycle 2]: 0.00039644, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.38e-06 [a_1]: 0.00013059 [with_stream_mark]: 1.403e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 3.41999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.851e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.89999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.132e-05 [replace_applicator]: 6.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.547e-05 [rewriter_after_opt_a]: 3.857e-05 [convert_after_rewriter]: 7.85e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00078363 [jit_opt_b]: 6.248e-05, [1] [Cycle 1]: 5.351e-05, [2] [frontend_op_eliminate]: 2.131e-05 [inline_after_opt_a]: 1.928e-05 [cconv]: 3.448e-05 [loop_unroll]: 0.00049529 [jit_opt_after_cconv]: 0.00017239, [1] [Cycle 1]: 0.00016576, [11] [c_1]: 2.787e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 8.03001e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.28998e-06 [cse]: 3.113e-05 [call_graph_tuple_transform]: 2.307e-05 [tuple_list_get_item_eliminator]: 6.67002e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 2.09984e-07 [switch_simplify]: 6.25002e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 7.43e-06 [add_recomputation]: 5.548e-05 [cse_after_recomputation]: 2.425e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.539e-05 [get_jit_bprop_graph]: 3.30003e-06 [rewriter_after_jit_bprop_graph]: 6.63998e-06 [opt_after_jit_grad]: 0.00059695 [symbol_engine_optimizer]: 8.641e-05, [1] [Cycle 1]: 7.929e-05, [6] [build]: 4.66002e-06 [elim_shapecalc]: 9.12001e-06 [elim_not_effective]: 1.624e-05 [opt_reshape]: 8.35001e-06 [fold_const_symbol]: 1.13e-05 [renormalize]: 6.89994e-07 [validate]: 4.476e-05 Sums bootstrap : 0.000361s : 0.65% type_inference : 0.049443s : 88.83% event_method : 0.000022s : 0.04% auto_monad : 0.000073s : 0.13% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000295s : 0.53% rewriter_before_opt_a : 0.000088s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.14% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000798s : 1.43% jit_opt_a.with_stream_mark : 0.000038s : 0.07% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.001744s : 3.13% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.05% jit_opt_a.cse : 0.000044s : 0.08% jit_opt_a.replace_applicator : 0.000028s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000039s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000784s : 1.41% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000034s : 0.06% loop_unroll : 0.000495s : 0.89% jit_opt_after_cconv.c_1 : 0.000028s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000055s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000597s : 1.07% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.000261 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 4: substitution.graph_param_transform 84.43% : 0.000220s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000006s : 4: substitution.remove_not_recompute_node 2.50% : 0.000007s : 2: substitution.replace_old_param 5.31% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049345 2 94.24% : 0.046500s : 1: type_inference.infer 5.76% : 0.002845s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.93% : 0.000059s : 4: replace.inline 31.07% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.45% : 0.000217s : 4: match.inline 5.55% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 830 1.09% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 0.93% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.01% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 0.95% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 4.97% : 0.000008s : 26: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 18: predicate.load_eliminater 1.61% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.39% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 12: predicate.merge_addn 0.92% : 0.000001s : 12: predicate.minmaximum_grad 2.09% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 10.42% : 0.000017s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000003s : 12: predicate.reduce_eliminate 1.23% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.65% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.05% : 0.000002s : 12: predicate.reshape_eliminate 1.07% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.90% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.50% : 0.000010s : 58: predicate.switch_simplify 1.03% : 0.000002s : 12: predicate.tile_eliminate 1.10% : 0.000002s : 12: predicate.transpose_eliminate 1.23% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.22% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001844 18 67.05% : 0.001237s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.30% : 0.000559s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062903 72 0.09% : 0.000059s : 1: add_recomputation 0.12% : 0.000077s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.61% : 0.000384s : 1: bootstrap 0.06% : 0.000038s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.20% : 0.007045s : 1: jit_opt_a 0.28% : 0.000175s : 1: jit_opt_after_cconv 0.10% : 0.000066s : 1: jit_opt_b 0.80% : 0.000504s : 1: loop_unroll 1.27% : 0.000796s : 1: mutable_eliminate 1.69% : 0.001066s : 26: opt.transform.jit_opt_a 0.10% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000607s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000301s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.71% : 0.001074s : 1: renormalize.infer 1.05% : 0.000658s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000042s : 1: rewriter_after_opt_a 0.15% : 0.000094s : 1: rewriter_before_opt_a 0.14% : 0.000089s : 1: symbol_engine_optimizer 78.63% : 0.049460s : 1: type_inference TotalTime = 0.0431683, [30] [bootstrap]: 0.00033364 [type_inference]: 0.0307908 [event_method]: 2.003e-05 [auto_monad]: 7.435e-05 [graph_reusing]: 7.29001e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00017497 [rewriter_before_opt_a]: 8.599e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00908153, [2] [Cycle 1]: 0.00209378, [27] [switch_simplify]: 8.034e-05 [loop_unroll]: 3.142e-05 [a_1]: 0.00055516 [with_stream_mark]: 1.809e-05 [recompute_prepare]: 9.07001e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.96998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.644e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00104335 [add_forward_monad_depend]: 6.39001e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.614e-05 [cse]: 3.727e-05 [replace_applicator]: 1.639e-05 [Cycle 2]: 0.00033431, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 5.42999e-06 [a_1]: 9.218e-05 [with_stream_mark]: 1.095e-05 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 5.61998e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.54e-05 [j_node_and_user_rematch]: 8.36002e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 6.19999e-06 [cse]: 1.431e-05 [replace_applicator]: 5.46002e-06 [py_interpret_to_execute_after_opt_a]: 1.41e-05 [rewriter_after_opt_a]: 3.678e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00071648 [jit_opt_b]: 5.147e-05, [1] [Cycle 1]: 4.375e-05, [2] [frontend_op_eliminate]: 1.526e-05 [inline_after_opt_a]: 1.723e-05 [cconv]: 2.666e-05 [loop_unroll]: 0.00046857 [jit_opt_after_cconv]: 0.00015678, [1] [Cycle 1]: 0.00014901, [11] [c_1]: 2.138e-05 [parameter_eliminate]: 2.76999e-06 [updatestate_depend_eliminate]: 6.51999e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.93e-05 [call_graph_tuple_transform]: 1.941e-05 [tuple_list_get_item_eliminator]: 5.83002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.65001e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 6.36e-06 [add_recomputation]: 0.00010232 [cse_after_recomputation]: 2.634e-05, [1] [Cycle 1]: 2.013e-05, [1] [cse]: 1.381e-05 [auto_monad_reorder]: 1.833e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 6.86999e-06 [opt_after_jit_grad]: 0.00055401 [symbol_engine_optimizer]: 0.00012593, [1] [Cycle 1]: 0.00011844, [6] [build]: 3.89002e-06 [elim_shapecalc]: 8.02998e-06 [elim_not_effective]: 5.521e-05 [opt_reshape]: 7.14001e-06 [fold_const_symbol]: 1.036e-05 [renormalize]: 1.00001e-06 [validate]: 4.819e-05 Sums bootstrap : 0.000334s : 0.93% type_inference : 0.030791s : 85.81% event_method : 0.000020s : 0.06% auto_monad : 0.000074s : 0.21% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000175s : 0.49% rewriter_before_opt_a : 0.000086s : 0.24% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000086s : 0.24% jit_opt_a.loop_unroll : 0.000037s : 0.10% jit_opt_a.a_1 : 0.000647s : 1.80% jit_opt_a.with_stream_mark : 0.000029s : 0.08% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001043s : 2.91% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000052s : 0.14% jit_opt_a.replace_applicator : 0.000022s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.04% rewriter_after_opt_a : 0.000037s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000716s : 2.00% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000027s : 0.07% loop_unroll : 0.000469s : 1.31% jit_opt_after_cconv.c_1 : 0.000021s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000102s : 0.29% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000018s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000554s : 1.54% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000055s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.13% Time group info: ------[substitution.] 0.000248 23 16.85% : 0.000042s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 3: substitution.graph_param_transform 69.52% : 0.000172s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 5.37% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.027390 2 91.62% : 0.025094s : 1: type_inference.infer 8.38% : 0.002297s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.31% : 0.000053s : 4: replace.inline 31.69% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.30% : 0.000169s : 4: match.inline 6.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 691 1.16% : 0.000002s : 10: predicate.accumulaten_eliminater 1.38% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.86% : 0.000001s : 10: predicate.addn_check_dump 1.03% : 0.000001s : 10: predicate.addn_zero_filter 1.40% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000002s : 10: predicate.cast_eliminate 0.36% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000002s : 10: predicate.depend_value_elim 0.93% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.94% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.95% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.93% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.85% : 0.000001s : 10: predicate.environ_get_depend_swap 1.06% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000002s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 4.92% : 0.000007s : 22: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 6: predicate.less_batch_normalization 1.21% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.50% : 0.000002s : 15: predicate.load_eliminater 1.16% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.55% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.90% : 0.000001s : 10: predicate.merge_addn 0.93% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000003s : 3: predicate.mutable_eliminate 0.81% : 0.000001s : 3: predicate.opt_reshape 1.86% : 0.000003s : 15: predicate.partial_eliminate 0.91% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.24% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.47% : 0.000002s : 18: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.03% : 0.000001s : 10: predicate.reshape_eliminate 1.09% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 10: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.93% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 1.83% : 0.000003s : 16: predicate.switch_defer_inline 1.72% : 0.000002s : 16: predicate.switch_layer_defer_inline 21.51% : 0.000031s : 53: predicate.switch_simplify 1.23% : 0.000002s : 10: predicate.tile_eliminate 1.03% : 0.000001s : 10: predicate.transpose_eliminate 1.16% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.52% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000990 13 40.97% : 0.000406s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.03% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 56.00% : 0.000554s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045203 72 0.23% : 0.000106s : 1: add_recomputation 0.17% : 0.000078s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.79% : 0.000358s : 1: bootstrap 0.06% : 0.000029s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000010s : 1: graph_reusing 20.10% : 0.009086s : 1: jit_opt_a 0.35% : 0.000159s : 1: jit_opt_after_cconv 0.12% : 0.000054s : 1: jit_opt_b 1.06% : 0.000477s : 1: loop_unroll 1.61% : 0.000727s : 1: mutable_eliminate 1.99% : 0.000900s : 26: opt.transform.jit_opt_a 0.11% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000025s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.06% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000077s : 4: opt.transform.symbol_engine_opt 1.25% : 0.000565s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000181s : 1: py_interpret_to_execute 0.04% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 1.31% : 0.000591s : 1: renormalize.infer 0.98% : 0.000443s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000040s : 1: rewriter_after_opt_a 0.20% : 0.000090s : 1: rewriter_before_opt_a 0.28% : 0.000129s : 1: symbol_engine_optimizer 68.16% : 0.030809s : 1: type_inference TotalTime = 0.0192715, [30] [bootstrap]: 0.00029643 [type_inference]: 0.0103352 [event_method]: 2.062e-05 [auto_monad]: 6.889e-05 [graph_reusing]: 6.31998e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 6.102e-05 [rewriter_before_opt_a]: 8.955e-05 [expand_dump_flag]: 2.80997e-06 [jit_opt_a]: 0.00595326, [2] [Cycle 1]: 0.00211265, [27] [switch_simplify]: 6.342e-05 [loop_unroll]: 3.48e-05 [a_1]: 0.00060601 [with_stream_mark]: 1.508e-05 [recompute_prepare]: 9.95002e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 7.47002e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.24e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00105896 [add_forward_monad_depend]: 6.93e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.627e-05 [cse]: 3.167e-05 [replace_applicator]: 1.677e-05 [Cycle 2]: 0.00047234, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 5.53002e-06 [a_1]: 9.29e-05 [with_stream_mark]: 1.175e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.00999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 0.00011093 [merge_forward]: 5.52001e-06 [cell_reuse_recompute_pass]: 2.43998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.693e-05 [j_node_and_user_rematch]: 9.40001e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 8.54e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.43e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 9.17001e-06 [cse]: 2.168e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.507e-05 [rewriter_after_opt_a]: 3.882e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00072346 [jit_opt_b]: 5.202e-05, [1] [Cycle 1]: 4.483e-05, [2] [frontend_op_eliminate]: 1.636e-05 [inline_after_opt_a]: 1.624e-05 [cconv]: 2.867e-05 [loop_unroll]: 0.00042173 [jit_opt_after_cconv]: 0.00018369, [1] [Cycle 1]: 0.00017702, [11] [c_1]: 2.361e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 7.36001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.76999e-06 [cse]: 2.866e-05 [call_graph_tuple_transform]: 2.338e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 2.37001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.60001e-06 [remove_dup_value]: 4.14e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 5.29998e-06 [add_recomputation]: 5.523e-05 [cse_after_recomputation]: 2.71e-05, [1] [Cycle 1]: 2.115e-05, [1] [cse]: 1.361e-05 [auto_monad_reorder]: 1.888e-05 [get_jit_bprop_graph]: 3.3e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00051429 [symbol_engine_optimizer]: 7.588e-05, [1] [Cycle 1]: 6.999e-05, [6] [build]: 3.27002e-06 [elim_shapecalc]: 8.06001e-06 [elim_not_effective]: 1.428e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 5.09986e-07 [validate]: 4.282e-05 Sums bootstrap : 0.000296s : 1.94% type_inference : 0.010335s : 67.55% event_method : 0.000021s : 0.13% auto_monad : 0.000069s : 0.45% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000061s : 0.40% rewriter_before_opt_a : 0.000090s : 0.59% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.46% jit_opt_a.loop_unroll : 0.000040s : 0.26% jit_opt_a.a_1 : 0.000699s : 4.57% jit_opt_a.with_stream_mark : 0.000027s : 0.18% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000117s : 0.76% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001059s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.17% jit_opt_a.cse : 0.000053s : 0.35% jit_opt_a.replace_applicator : 0.000023s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000039s : 0.25% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000723s : 4.73% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000029s : 0.19% loop_unroll : 0.000422s : 2.76% jit_opt_after_cconv.c_1 : 0.000024s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000041s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.03% add_recomputation : 0.000055s : 0.36% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000514s : 3.36% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.28% Time group info: ------[substitution.] 0.000212 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 3: substitution.graph_param_transform 85.68% : 0.000182s : 5: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 4.41% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010263 2 86.21% : 0.008848s : 1: type_inference.infer 13.79% : 0.001416s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.67% : 0.000068s : 5: replace.inline 32.33% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 7 95.68% : 0.000179s : 5: match.inline 4.32% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.42% : 0.000002s : 11: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.23% : 0.000002s : 11: predicate.addn_zero_filter 1.92% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.25% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 11: predicate.environ_get_depend_swap 1.17% : 0.000001s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 16: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.18% : 0.000001s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 2.11% : 0.000003s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 2.10% : 0.000003s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.42% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 11: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.13% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.52% : 0.000009s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000001s : 11: predicate.transpose_eliminate 1.55% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.80% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001025 16 50.35% : 0.000516s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.08% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.57% : 0.000447s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021437 72 0.27% : 0.000058s : 1: add_recomputation 0.34% : 0.000073s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.44% : 0.000309s : 1: bootstrap 0.15% : 0.000031s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000007s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 27.79% : 0.005958s : 1: jit_opt_a 0.87% : 0.000186s : 1: jit_opt_after_cconv 0.25% : 0.000054s : 1: jit_opt_b 2.00% : 0.000429s : 1: loop_unroll 3.41% : 0.000731s : 1: mutable_eliminate 4.89% : 0.001047s : 26: opt.transform.jit_opt_a 0.26% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000521s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000064s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000044s : 1: remove_dup_value 2.72% : 0.000584s : 1: renormalize.infer 2.18% : 0.000468s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000042s : 1: rewriter_after_opt_a 0.43% : 0.000093s : 1: rewriter_before_opt_a 0.37% : 0.000079s : 1: symbol_engine_optimizer 48.28% : 0.010349s : 1: type_inference TotalTime = 0.151346, [30] [bootstrap]: 0.00035269 [type_inference]: 0.139275 [event_method]: 2.117e-05 [auto_monad]: 7.424e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.90002e-06 [py_interpret_to_execute]: 0.00052453 [rewriter_before_opt_a]: 0.00010127 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.00867421, [2] [Cycle 1]: 0.00394633, [27] [switch_simplify]: 7.329e-05 [loop_unroll]: 3.411e-05 [a_1]: 0.00070985 [with_stream_mark]: 2.143e-05 [recompute_prepare]: 9.67999e-06 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.98001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 7.46001e-06 [meta_shard_fg_expand]: 2.87002e-06 [get_grad_eliminate_]: 6.97002e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 6.28e-06 [renormalize]: 0.00276722 [add_forward_monad_depend]: 5.47001e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 1.065e-05 [cse]: 2.067e-05 [replace_applicator]: 1.246e-05 [Cycle 2]: 0.00038392, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00013591 [with_stream_mark]: 1.025e-05 [recompute_prepare]: 6.65002e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.45002e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.377e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 1.177e-05 [rewriter_after_opt_a]: 3.062e-05 [convert_after_rewriter]: 5.76998e-06 [order_py_execute_after_rewriter]: 4.27e-06 [mutable_eliminate]: 0.00058286 [jit_opt_b]: 5.949e-05, [1] [Cycle 1]: 5.322e-05, [2] [frontend_op_eliminate]: 2.186e-05 [inline_after_opt_a]: 2.035e-05 [cconv]: 1.7e-05 [loop_unroll]: 0.00047265 [jit_opt_after_cconv]: 0.00015611, [1] [Cycle 1]: 0.00015003, [11] [c_1]: 2.62e-05 [parameter_eliminate]: 2.09999e-06 [updatestate_depend_eliminate]: 4.99e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.386e-05 [call_graph_tuple_transform]: 2e-05 [tuple_list_get_item_eliminator]: 7e-06 [none_parameter_eliminate]: 1.13001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.18002e-06 [remove_dup_value]: 1.21e-05 [partial_unused_args_eliminate]: 1.77001e-06 [environ_conv]: 7.89002e-06 [add_recomputation]: 3.537e-05 [cse_after_recomputation]: 2.53e-05, [1] [Cycle 1]: 1.906e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.049e-05 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 5.64e-06 [opt_after_jit_grad]: 0.00046407 [symbol_engine_optimizer]: 0.0001933, [1] [Cycle 1]: 0.00018692, [6] [build]: 2.65002e-06 [elim_shapecalc]: 1.129e-05 [elim_not_effective]: 1.493e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 0.0001225 [renormalize]: 5.00004e-07 [validate]: 4.156e-05 Sums bootstrap : 0.000353s : 0.24% type_inference : 0.139275s : 95.13% event_method : 0.000021s : 0.01% auto_monad : 0.000074s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000525s : 0.36% rewriter_before_opt_a : 0.000101s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000846s : 0.58% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002767s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.01% jit_opt_a.cse : 0.000034s : 0.02% jit_opt_a.replace_applicator : 0.000019s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000031s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000583s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000017s : 0.01% loop_unroll : 0.000473s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000035s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000464s : 0.32% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000123s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000380 28 0.39% : 0.000001s : 2: substitution.elim_not_effective 29.64% : 0.000112s : 2: substitution.fold_const_symbol 1.13% : 0.000004s : 4: substitution.graph_param_transform 59.18% : 0.000225s : 5: substitution.inline 1.00% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.30% : 0.000013s : 3: substitution.reduce_eliminate 1.24% : 0.000005s : 4: substitution.remove_not_recompute_node 1.10% : 0.000004s : 2: substitution.replace_old_param 3.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139189 2 97.77% : 0.136086s : 1: type_inference.infer 2.23% : 0.003103s : 1: type_inference.specialize ------[replace.] 0.000104 7 68.42% : 0.000071s : 5: replace.inline 31.58% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 7 95.56% : 0.000222s : 5: match.inline 4.44% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.65% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 13: predicate.addn_check_dump 1.55% : 0.000002s : 13: predicate.addn_zero_filter 1.81% : 0.000003s : 13: predicate.arithmetic_simplify 1.49% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.04% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 4: predicate.elim_not_effective 0.39% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.29% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.77% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.45% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.65% : 0.000013s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.85% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002533 25 64.31% : 0.001629s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.43% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.26% : 0.000843s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155409 72 0.02% : 0.000039s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.24% : 0.000365s : 1: bootstrap 0.01% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.58% : 0.008678s : 1: jit_opt_a 0.10% : 0.000159s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.31% : 0.000479s : 1: loop_unroll 0.38% : 0.000592s : 1: mutable_eliminate 0.71% : 0.001102s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000152s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000471s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000532s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.25% : 0.001943s : 1: renormalize.infer 0.52% : 0.000815s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000034s : 1: rewriter_after_opt_a 0.07% : 0.000106s : 1: rewriter_before_opt_a 0.13% : 0.000196s : 1: symbol_engine_optimizer 89.63% : 0.139289s : 1: type_inference TotalTime = 0.189168, [30] [bootstrap]: 0.00033366 [type_inference]: 0.154147 [event_method]: 2.717e-05 [auto_monad]: 8.301e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 0.00058725 [rewriter_before_opt_a]: 0.00011273 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.0311557, [2] [Cycle 1]: 0.0266512, [27] [switch_simplify]: 6.397e-05 [loop_unroll]: 3.442e-05 [a_1]: 0.00074453 [with_stream_mark]: 2.426e-05 [recompute_prepare]: 9.77001e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 7.26999e-06 [updatestate_useless_node_eliminater]: 6.59001e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 1.24003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.707e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.108e-05 [inline_without_move]: 6.37001e-06 [renormalize]: 0.0253539 [add_forward_monad_depend]: 1.066e-05 [auto_monad_grad]: 3.53e-06 [auto_monad_eliminator]: 2.247e-05 [cse]: 4.134e-05 [replace_applicator]: 2.713e-05 [Cycle 2]: 0.00043693, [27] [switch_simplify]: 8.19002e-06 [loop_unroll]: 6.67002e-06 [a_1]: 0.00015261 [with_stream_mark]: 1.85e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 4.14997e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 2.41998e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 4.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.611e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 6.26e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.79001e-06 [cse]: 1.495e-05 [replace_applicator]: 6.40002e-06 [py_interpret_to_execute_after_opt_a]: 1.816e-05 [rewriter_after_opt_a]: 4.117e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.86e-06 [mutable_eliminate]: 0.00086047 [jit_opt_b]: 6.328e-05, [1] [Cycle 1]: 5.465e-05, [2] [frontend_op_eliminate]: 2.149e-05 [inline_after_opt_a]: 2.049e-05 [cconv]: 3.238e-05 [loop_unroll]: 0.00046224 [jit_opt_after_cconv]: 0.00017998, [1] [Cycle 1]: 0.00017252, [11] [c_1]: 2.805e-05 [parameter_eliminate]: 3.37002e-06 [updatestate_depend_eliminate]: 8.22998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 3.469e-05 [call_graph_tuple_transform]: 2.434e-05 [tuple_list_get_item_eliminator]: 6.81001e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 9.49978e-07 [switch_simplify]: 7.15e-06 [remove_dup_value]: 1.936e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 9.99001e-06 [add_recomputation]: 5.71e-05 [cse_after_recomputation]: 2.551e-05, [1] [Cycle 1]: 1.987e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.717e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 7.49002e-06 [opt_after_jit_grad]: 0.0005026 [symbol_engine_optimizer]: 0.00010903, [1] [Cycle 1]: 0.00010211, [6] [build]: 5.02999e-06 [elim_shapecalc]: 1.051e-05 [elim_not_effective]: 3.749e-05 [opt_reshape]: 7.67998e-06 [fold_const_symbol]: 1.125e-05 [renormalize]: 6.09987e-07 [validate]: 6.219e-05 Sums bootstrap : 0.000334s : 0.18% type_inference : 0.154147s : 83.59% event_method : 0.000027s : 0.01% auto_monad : 0.000083s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000587s : 0.32% rewriter_before_opt_a : 0.000113s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000897s : 0.49% jit_opt_a.with_stream_mark : 0.000043s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.025354s : 13.75% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000056s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000860s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000462s : 0.25% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000503s : 0.27% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000037s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.03% Time group info: ------[substitution.] 0.000339 28 7.17% : 0.000024s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 4: substitution.graph_param_transform 77.85% : 0.000264s : 5: substitution.inline 1.09% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.88% : 0.000017s : 3: substitution.reduce_eliminate 1.70% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000006s : 2: substitution.replace_old_param 3.22% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.154027 2 97.41% : 0.150041s : 1: type_inference.infer 2.59% : 0.003986s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.95% : 0.000071s : 5: replace.inline 31.05% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000271 7 96.39% : 0.000261s : 5: match.inline 3.61% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000156 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 0.99% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.30% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.16% : 0.000008s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 2.02% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000004s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 2.84% : 0.000004s : 13: predicate.reduce_eliminate 1.59% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.97% : 0.000011s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.98% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002882 25 56.51% : 0.001629s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.22% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.27% : 0.001160s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.215768 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000087s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.16% : 0.000354s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 14.44% : 0.031160s : 1: jit_opt_a 0.08% : 0.000183s : 1: jit_opt_after_cconv 0.03% : 0.000066s : 1: jit_opt_b 0.22% : 0.000471s : 1: loop_unroll 0.40% : 0.000871s : 1: mutable_eliminate 0.54% : 0.001166s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000063s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000511s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000596s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 11.20% : 0.024167s : 1: renormalize.infer 0.54% : 0.001173s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.06% : 0.000120s : 1: rewriter_before_opt_a 0.05% : 0.000112s : 1: symbol_engine_optimizer 71.46% : 0.154179s : 1: type_inference TotalTime = 0.0229603, [30] [bootstrap]: 0.00030809 [type_inference]: 0.0106355 [event_method]: 2.505e-05 [auto_monad]: 8.236e-05 [graph_reusing]: 6.85002e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 6.125e-05 [rewriter_before_opt_a]: 8.784e-05 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.00809401, [2] [Cycle 1]: 0.00283594, [27] [switch_simplify]: 7.187e-05 [loop_unroll]: 3.325e-05 [a_1]: 0.00067121 [with_stream_mark]: 2.042e-05 [recompute_prepare]: 8.59998e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 9.33002e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.44998e-06 [inline_without_move]: 6.16998e-06 [renormalize]: 0.001646 [add_forward_monad_depend]: 6.74999e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.672e-05 [cse]: 3.609e-05 [replace_applicator]: 1.938e-05 [Cycle 2]: 0.00138627, [27] [switch_simplify]: 5.96998e-06 [loop_unroll]: 4.94e-06 [a_1]: 0.00010448 [with_stream_mark]: 1.411e-05 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 4.65999e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.62001e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 2.951e-05 [meta_fg_expand]: 3.4e-06 [replace_old_param]: 1.211e-05 [inline_without_move]: 6.31e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 6.17001e-06 [auto_monad_grad]: 2.07999e-06 [auto_monad_eliminator]: 1.917e-05 [cse]: 2.884e-05 [replace_applicator]: 7.33999e-06 [py_interpret_to_execute_after_opt_a]: 1.765e-05 [rewriter_after_opt_a]: 4.382e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00070439 [jit_opt_b]: 5.818e-05, [1] [Cycle 1]: 4.807e-05, [2] [frontend_op_eliminate]: 1.613e-05 [inline_after_opt_a]: 1.888e-05 [cconv]: 3.256e-05 [loop_unroll]: 0.00048357 [jit_opt_after_cconv]: 0.00018171, [1] [Cycle 1]: 0.0001738, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 9.36e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 2.979e-05 [call_graph_tuple_transform]: 3.644e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.911e-05 [partial_unused_args_eliminate]: 2.60002e-06 [environ_conv]: 7.81001e-06 [add_recomputation]: 5.719e-05 [cse_after_recomputation]: 2.679e-05, [1] [Cycle 1]: 2.097e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 1.852e-05 [get_jit_bprop_graph]: 2.79999e-06 [rewriter_after_jit_bprop_graph]: 7.77e-06 [opt_after_jit_grad]: 0.0014636 [symbol_engine_optimizer]: 8.542e-05, [1] [Cycle 1]: 7.702e-05, [6] [build]: 4.61002e-06 [elim_shapecalc]: 7.93001e-06 [elim_not_effective]: 1.584e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 9.20001e-07 [validate]: 4.697e-05 Sums bootstrap : 0.000308s : 1.78% type_inference : 0.010635s : 61.57% event_method : 0.000025s : 0.15% auto_monad : 0.000082s : 0.48% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000061s : 0.35% rewriter_before_opt_a : 0.000088s : 0.51% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000078s : 0.45% jit_opt_a.loop_unroll : 0.000038s : 0.22% jit_opt_a.a_1 : 0.000776s : 4.49% jit_opt_a.with_stream_mark : 0.000035s : 0.20% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000039s : 0.22% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000022s : 0.12% jit_opt_a.inline_without_move : 0.000012s : 0.07% jit_opt_a.renormalize : 0.001646s : 9.53% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.07% jit_opt_a.auto_monad_grad : 0.000005s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.21% jit_opt_a.cse : 0.000065s : 0.38% jit_opt_a.replace_applicator : 0.000027s : 0.15% py_interpret_to_execute_after_opt_a : 0.000018s : 0.10% rewriter_after_opt_a : 0.000044s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000704s : 4.08% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.09% jit_opt_b.inline_after_opt_a : 0.000019s : 0.11% cconv : 0.000033s : 0.19% loop_unroll : 0.000484s : 2.80% jit_opt_after_cconv.c_1 : 0.000022s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000036s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000019s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000057s : 0.33% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000019s : 0.11% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.04% opt_after_jit_grad : 0.001464s : 8.47% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000047s : 0.27% Time group info: ------[substitution.] 0.000301 27 0.89% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 6.71% : 0.000020s : 3: substitution.graph_param_transform 78.36% : 0.000236s : 5: substitution.inline 1.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.45% : 0.000013s : 3: substitution.reduce_eliminate 1.49% : 0.000004s : 4: substitution.remove_not_recompute_node 2.46% : 0.000007s : 2: substitution.replace_old_param 3.46% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010553 2 89.22% : 0.009415s : 1: type_inference.infer 10.78% : 0.001138s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.02% : 0.000063s : 5: replace.inline 32.98% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 96.17% : 0.000233s : 5: match.inline 3.83% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 747 1.17% : 0.000002s : 11: predicate.accumulaten_eliminater 1.53% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.44% : 0.000002s : 11: predicate.addn_zero_filter 2.07% : 0.000003s : 11: predicate.arithmetic_simplify 1.12% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000002s : 11: predicate.environ_get_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000008s : 24: predicate.inline 1.42% : 0.000002s : 6: predicate.inline_without_move 0.76% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 16: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000002s : 11: predicate.minmaximum_grad 2.30% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000002s : 11: predicate.print_const_string_wrapper 1.89% : 0.000003s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 19: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.57% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 11: predicate.reshape_eliminate 1.16% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000002s : 11: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.71% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.68% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.87% : 0.000011s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.11% : 0.000001s : 11: predicate.transpose_eliminate 1.65% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.31% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000852 16 45.04% : 0.000384s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.63% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.33% : 0.000386s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025726 72 0.24% : 0.000060s : 1: add_recomputation 0.87% : 0.000224s : 1: auto_monad 0.08% : 0.000022s : 1: auto_monad_reorder 1.27% : 0.000326s : 1: bootstrap 0.14% : 0.000035s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.12% : 0.000031s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 31.48% : 0.008098s : 1: jit_opt_a 0.72% : 0.000185s : 1: jit_opt_after_cconv 0.24% : 0.000061s : 1: jit_opt_b 1.92% : 0.000493s : 1: loop_unroll 2.78% : 0.000715s : 1: mutable_eliminate 4.05% : 0.001043s : 26: opt.transform.jit_opt_a 0.26% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000036s : 4: opt.transform.symbol_engine_opt 5.75% : 0.001480s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000065s : 1: py_interpret_to_execute 0.08% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000022s : 1: remove_dup_value 4.94% : 0.001271s : 1: renormalize.infer 1.41% : 0.000363s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000047s : 1: rewriter_after_opt_a 0.36% : 0.000092s : 1: rewriter_before_opt_a 0.35% : 0.000089s : 1: symbol_engine_optimizer 41.58% : 0.010696s : 1: type_inference TotalTime = 0.0596498, [30] [bootstrap]: 0.00027419 [type_inference]: 0.0507032 [event_method]: 2.046e-05 [auto_monad]: 7.4e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 0.00012947 [rewriter_before_opt_a]: 8.919e-05 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.00607441, [2] [Cycle 1]: 0.00211959, [27] [switch_simplify]: 6.208e-05 [loop_unroll]: 4.679e-05 [a_1]: 0.00057791 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 0.00103503 [add_forward_monad_depend]: 5.29998e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.789e-05 [cse]: 3.641e-05 [replace_applicator]: 1.532e-05 [Cycle 2]: 0.00033108, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.19e-06 [a_1]: 9.176e-05 [with_stream_mark]: 1.059e-05 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 3.20002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.54998e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.83001e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 5.07e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.60019e-07 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.00002e-06 [cse]: 1.332e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.414e-05 [rewriter_after_opt_a]: 4.124e-05 [convert_after_rewriter]: 6.83998e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00059065 [jit_opt_b]: 5.301e-05, [1] [Cycle 1]: 4.48e-05, [2] [frontend_op_eliminate]: 1.626e-05 [inline_after_opt_a]: 1.698e-05 [cconv]: 2.942e-05 [loop_unroll]: 0.00042837 [jit_opt_after_cconv]: 0.00015177, [1] [Cycle 1]: 0.00014492, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.48002e-06 [cse]: 2.796e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 5.46998e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.69999e-06 [remove_dup_value]: 1.848e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 5.71998e-06 [add_recomputation]: 5.295e-05 [cse_after_recomputation]: 2.389e-05, [1] [Cycle 1]: 1.85e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 1.76e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 5.44e-06 [opt_after_jit_grad]: 0.00047016 [symbol_engine_optimizer]: 0.00010223, [1] [Cycle 1]: 9.563e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 7.91001e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 3.076e-05 [fold_const_symbol]: 1.066e-05 [renormalize]: 3.30008e-07 [validate]: 4.083e-05 Sums bootstrap : 0.000274s : 0.50% type_inference : 0.050703s : 91.56% event_method : 0.000020s : 0.04% auto_monad : 0.000074s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000129s : 0.23% rewriter_before_opt_a : 0.000089s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.12% jit_opt_a.loop_unroll : 0.000052s : 0.09% jit_opt_a.a_1 : 0.000670s : 1.21% jit_opt_a.with_stream_mark : 0.000032s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001035s : 1.87% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000050s : 0.09% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000041s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000591s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000428s : 0.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.10% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000470s : 0.85% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000031s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000234 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000007s : 3: substitution.graph_param_transform 84.14% : 0.000197s : 4: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.32% : 0.000005s : 2: substitution.replace_old_param 5.53% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050618 2 43.34% : 0.021940s : 1: type_inference.infer 56.66% : 0.028678s : 1: type_inference.specialize ------[replace.] 0.000075 6 69.14% : 0.000052s : 4: replace.inline 30.86% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 94.26% : 0.000195s : 4: match.inline 5.74% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 1.29% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000001s : 10: predicate.addn_check_dump 1.39% : 0.000002s : 10: predicate.addn_zero_filter 2.28% : 0.000003s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.29% : 0.000002s : 10: predicate.compare_switch_simplify 1.47% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 6: predicate.less_batch_normalization 1.29% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.66% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.57% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.25% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.84% : 0.000010s : 53: predicate.switch_simplify 1.40% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.46% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.027501 13 1.38% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.16% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 98.46% : 0.027077s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061657 72 0.09% : 0.000056s : 1: add_recomputation 0.13% : 0.000078s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.47% : 0.000292s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.86% : 0.006078s : 1: jit_opt_a 0.25% : 0.000154s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.71% : 0.000437s : 1: loop_unroll 0.97% : 0.000601s : 1: mutable_eliminate 1.48% : 0.000915s : 26: opt.transform.jit_opt_a 0.08% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000058s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.22% : 0.000134s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 0.97% : 0.000597s : 1: renormalize.infer 0.70% : 0.000429s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000093s : 1: rewriter_before_opt_a 0.17% : 0.000105s : 1: symbol_engine_optimizer 82.26% : 0.050721s : 1: type_inference TotalTime = 0.0169487, [30] [bootstrap]: 0.00035266 [type_inference]: 0.00696787 [event_method]: 1.972e-05 [auto_monad]: 6.344e-05 [graph_reusing]: 4.70999e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 3.774e-05 [rewriter_before_opt_a]: 7.556e-05 [expand_dump_flag]: 3.25e-06 [jit_opt_a]: 0.00716801, [2] [Cycle 1]: 0.00185634, [27] [switch_simplify]: 4.87e-05 [loop_unroll]: 3.015e-05 [a_1]: 0.00055509 [with_stream_mark]: 1.538e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.154e-05 [j_node_and_user_rematch]: 8.60999e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.05999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00086202 [add_forward_monad_depend]: 3.36e-05 [auto_monad_grad]: 2.08002e-06 [auto_monad_eliminator]: 1.473e-05 [cse]: 2.231e-05 [replace_applicator]: 1.229e-05 [Cycle 2]: 0.00032964, [27] [switch_simplify]: 5.46002e-06 [loop_unroll]: 4.69998e-06 [a_1]: 9.02e-05 [with_stream_mark]: 9.51e-06 [recompute_prepare]: 5.12e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 4.72998e-06 [accelerated_algorithm]: 4.80001e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 5.06002e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.328e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.71999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 1.24e-06 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.184e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.097e-05 [rewriter_after_opt_a]: 3.587e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00057778 [jit_opt_b]: 5.026e-05, [1] [Cycle 1]: 4.322e-05, [2] [frontend_op_eliminate]: 1.593e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.579e-05 [loop_unroll]: 0.0004526 [jit_opt_after_cconv]: 0.00015237, [1] [Cycle 1]: 0.00014615, [11] [c_1]: 2.131e-05 [parameter_eliminate]: 3.41999e-06 [updatestate_depend_eliminate]: 7.20998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.33998e-06 [cse]: 2.455e-05 [call_graph_tuple_transform]: 1.88e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 1.00001e-06 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.34e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 5.76e-06 [add_recomputation]: 4.796e-05 [cse_after_recomputation]: 2.273e-05, [1] [Cycle 1]: 1.67e-05, [1] [cse]: 1.063e-05 [auto_monad_reorder]: 1.522e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 7.11001e-06 [opt_after_jit_grad]: 0.00051554 [symbol_engine_optimizer]: 8.012e-05, [1] [Cycle 1]: 7.407e-05, [6] [build]: 4.00998e-06 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.478e-05 [opt_reshape]: 6.14001e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 4.10015e-07 [validate]: 3.726e-05 Sums bootstrap : 0.000353s : 3.11% type_inference : 0.006968s : 61.36% event_method : 0.000020s : 0.17% auto_monad : 0.000063s : 0.56% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.33% rewriter_before_opt_a : 0.000076s : 0.67% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.48% jit_opt_a.loop_unroll : 0.000035s : 0.31% jit_opt_a.a_1 : 0.000645s : 5.68% jit_opt_a.with_stream_mark : 0.000025s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000862s : 7.59% jit_opt_a.add_forward_monad_depend : 0.000035s : 0.31% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.19% jit_opt_a.cse : 0.000034s : 0.30% jit_opt_a.replace_applicator : 0.000018s : 0.16% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000036s : 0.32% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000578s : 5.09% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000026s : 0.23% loop_unroll : 0.000453s : 3.99% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000013s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.42% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000015s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000516s : 4.54% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.33% Time group info: ------[substitution.] 0.000190 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000005s : 3: substitution.graph_param_transform 83.04% : 0.000158s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 6.37% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006901 2 87.43% : 0.006033s : 1: type_inference.infer 12.57% : 0.000868s : 1: type_inference.specialize ------[replace.] 0.000072 6 64.88% : 0.000046s : 4: replace.inline 35.12% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.43% : 0.000155s : 4: match.inline 6.57% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.23% : 0.000008s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 2.04% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000622 13 51.51% : 0.000320s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.60% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.89% : 0.000273s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018720 72 0.27% : 0.000051s : 1: add_recomputation 0.36% : 0.000067s : 1: auto_monad 0.10% : 0.000018s : 1: auto_monad_reorder 1.99% : 0.000373s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 38.31% : 0.007171s : 1: jit_opt_a 0.83% : 0.000155s : 1: jit_opt_after_cconv 0.28% : 0.000053s : 1: jit_opt_b 2.47% : 0.000462s : 1: loop_unroll 3.14% : 0.000588s : 1: mutable_eliminate 4.54% : 0.000849s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.80% : 0.000524s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000040s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000016s : 1: remove_dup_value 2.71% : 0.000508s : 1: renormalize.infer 1.85% : 0.000346s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.42% : 0.000078s : 1: rewriter_before_opt_a 0.44% : 0.000083s : 1: symbol_engine_optimizer 37.32% : 0.006986s : 1: type_inference TotalTime = 0.0207915, [30] [bootstrap]: 0.00035359 [type_inference]: 0.0106812 [event_method]: 2.311e-05 [auto_monad]: 7.392e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 5.266e-05 [rewriter_before_opt_a]: 8.545e-05 [expand_dump_flag]: 3.00998e-06 [jit_opt_a]: 0.0068938, [2] [Cycle 1]: 0.00243009, [27] [switch_simplify]: 7.311e-05 [loop_unroll]: 3.344e-05 [a_1]: 0.00074217 [with_stream_mark]: 2.669e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.644e-05 [j_node_and_user_rematch]: 1.057e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00115985 [add_forward_monad_depend]: 9.10999e-06 [auto_monad_grad]: 2.91999e-06 [auto_monad_eliminator]: 1.829e-05 [cse]: 3.54e-05 [replace_applicator]: 1.853e-05 [Cycle 2]: 0.00036657, [27] [switch_simplify]: 6.57002e-06 [loop_unroll]: 5.40999e-06 [a_1]: 0.00011304 [with_stream_mark]: 1.224e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.55002e-06 [parameter_eliminate]: 1.24003e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 2.82002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.307e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.62e-06 [inline_without_move]: 4.94e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.531e-05 [replace_applicator]: 5.68002e-06 [py_interpret_to_execute_after_opt_a]: 1.615e-05 [rewriter_after_opt_a]: 4.096e-05 [convert_after_rewriter]: 7.27997e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00082639 [jit_opt_b]: 5.805e-05, [1] [Cycle 1]: 5.025e-05, [2] [frontend_op_eliminate]: 1.9e-05 [inline_after_opt_a]: 1.852e-05 [cconv]: 3.299e-05 [loop_unroll]: 0.00047574 [jit_opt_after_cconv]: 0.0001912, [1] [Cycle 1]: 0.00018337, [11] [c_1]: 2.245e-05 [parameter_eliminate]: 3.56999e-06 [updatestate_depend_eliminate]: 8.85001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.78998e-06 [cse]: 3.055e-05 [call_graph_tuple_transform]: 2.451e-05 [tuple_list_get_item_eliminator]: 5.88998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 9.80013e-07 [switch_simplify]: 6.13998e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 6.86001e-06 [add_recomputation]: 5.672e-05 [cse_after_recomputation]: 2.445e-05, [1] [Cycle 1]: 1.807e-05, [1] [cse]: 1.244e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 7.12997e-06 [opt_after_jit_grad]: 0.00050106 [symbol_engine_optimizer]: 8.044e-05, [1] [Cycle 1]: 7.338e-05, [6] [build]: 5.22e-06 [elim_shapecalc]: 9.51998e-06 [elim_not_effective]: 1.486e-05 [opt_reshape]: 6.03002e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 2.69996e-07 [validate]: 4.66e-05 Sums bootstrap : 0.000354s : 2.21% type_inference : 0.010681s : 66.68% event_method : 0.000023s : 0.14% auto_monad : 0.000074s : 0.46% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000053s : 0.33% rewriter_before_opt_a : 0.000085s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000080s : 0.50% jit_opt_a.loop_unroll : 0.000039s : 0.24% jit_opt_a.a_1 : 0.000855s : 5.34% jit_opt_a.with_stream_mark : 0.000039s : 0.24% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001160s : 7.24% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.15% jit_opt_a.cse : 0.000051s : 0.32% jit_opt_a.replace_applicator : 0.000024s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.10% rewriter_after_opt_a : 0.000041s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000826s : 5.16% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.12% cconv : 0.000033s : 0.21% loop_unroll : 0.000476s : 2.97% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000057s : 0.35% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000018s : 0.11% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000501s : 3.13% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.29% Time group info: ------[substitution.] 0.000329 27 0.80% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000002s : 2: substitution.fold_const_symbol 1.75% : 0.000006s : 3: substitution.graph_param_transform 84.49% : 0.000278s : 5: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.07% : 0.000013s : 3: substitution.reduce_eliminate 1.53% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 3.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010602 2 88.71% : 0.009405s : 1: type_inference.infer 11.29% : 0.001197s : 1: type_inference.specialize ------[replace.] 0.000107 7 66.67% : 0.000071s : 5: replace.inline 33.33% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000286 7 96.18% : 0.000275s : 5: match.inline 3.82% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 0.88% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 11: predicate.addn_check_dump 1.29% : 0.000002s : 11: predicate.addn_zero_filter 2.36% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 11: predicate.compare_switch_simplify 1.10% : 0.000002s : 11: predicate.depend_value_elim 1.00% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.05% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.96% : 0.000003s : 11: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.98% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.24% : 0.000002s : 6: predicate.get_grad_eliminate 0.50% : 0.000001s : 3: predicate.graph_param_transform 6.39% : 0.000009s : 24: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 16: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.67% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 11: predicate.merge_addn 1.00% : 0.000001s : 11: predicate.minmaximum_grad 1.98% : 0.000003s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 1.94% : 0.000003s : 16: predicate.partial_eliminate 1.30% : 0.000002s : 11: predicate.print_const_string_wrapper 2.67% : 0.000004s : 11: predicate.reduce_eliminate 1.59% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.51% : 0.000002s : 19: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.57% : 0.000001s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 11: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.95% : 0.000011s : 59: predicate.switch_simplify 1.30% : 0.000002s : 11: predicate.tile_eliminate 1.17% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001012 16 47.80% : 0.000484s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.22% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.98% : 0.000435s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023113 72 0.26% : 0.000060s : 1: add_recomputation 0.34% : 0.000078s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.63% : 0.000376s : 1: bootstrap 0.16% : 0.000036s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.85% : 0.006899s : 1: jit_opt_a 0.84% : 0.000194s : 1: jit_opt_after_cconv 0.26% : 0.000060s : 1: jit_opt_b 2.10% : 0.000485s : 1: loop_unroll 3.62% : 0.000838s : 1: mutable_eliminate 4.78% : 0.001104s : 26: opt.transform.jit_opt_a 0.24% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000030s : 4: opt.transform.jit_opt_b 0.06% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000018s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.20% : 0.000509s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000055s : 1: py_interpret_to_execute 0.08% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000019s : 1: remove_dup_value 2.92% : 0.000676s : 1: renormalize.infer 2.04% : 0.000472s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000044s : 1: rewriter_after_opt_a 0.38% : 0.000089s : 1: rewriter_before_opt_a 0.36% : 0.000083s : 1: symbol_engine_optimizer 46.30% : 0.010700s : 1: type_inference TotalTime = 0.0178595, [30] [bootstrap]: 0.00033411 [type_inference]: 0.00965275 [event_method]: 1.739e-05 [auto_monad]: 6.738e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 5.423e-05 [rewriter_before_opt_a]: 7.4e-05 [expand_dump_flag]: 3.28e-06 [jit_opt_a]: 0.00545504, [2] [Cycle 1]: 0.00174668, [27] [switch_simplify]: 5.316e-05 [loop_unroll]: 3.059e-05 [a_1]: 0.00053253 [with_stream_mark]: 1.806e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.73002e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.31998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.514e-05 [j_node_and_user_rematch]: 9.81998e-06 [meta_fg_expand]: 2.71999e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.15002e-06 [renormalize]: 0.00073774 [add_forward_monad_depend]: 5.44998e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.541e-05 [cse]: 2.857e-05 [replace_applicator]: 1.251e-05 [Cycle 2]: 0.00031498, [27] [switch_simplify]: 5.78002e-06 [loop_unroll]: 4.86002e-06 [a_1]: 9.053e-05 [with_stream_mark]: 8.77e-06 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 1.92001e-06 [parameter_eliminate]: 1.31998e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 4.70001e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 2.63003e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.26999e-06 [inline_without_move]: 4.79998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.149e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 9.04998e-06 [rewriter_after_opt_a]: 3.308e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00059786 [jit_opt_b]: 4.957e-05, [1] [Cycle 1]: 4.286e-05, [2] [frontend_op_eliminate]: 1.672e-05 [inline_after_opt_a]: 1.569e-05 [cconv]: 2.616e-05 [loop_unroll]: 0.00043814 [jit_opt_after_cconv]: 0.00014629, [1] [Cycle 1]: 0.00014022, [11] [c_1]: 2.084e-05 [parameter_eliminate]: 4.43999e-06 [updatestate_depend_eliminate]: 5.83002e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 2.31e-05 [call_graph_tuple_transform]: 1.96e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.49003e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.46e-06 [remove_dup_value]: 1.597e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 5.18002e-06 [add_recomputation]: 4.923e-05 [cse_after_recomputation]: 2.122e-05, [1] [Cycle 1]: 1.603e-05, [1] [cse]: 1.021e-05 [auto_monad_reorder]: 3.334e-05 [get_jit_bprop_graph]: 1.49998e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00046479 [symbol_engine_optimizer]: 7.032e-05, [1] [Cycle 1]: 6.422e-05, [6] [build]: 3.29001e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.229e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 2.89991e-07 [validate]: 3.822e-05 Sums bootstrap : 0.000334s : 2.41% type_inference : 0.009653s : 69.67% event_method : 0.000017s : 0.13% auto_monad : 0.000067s : 0.49% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000054s : 0.39% rewriter_before_opt_a : 0.000074s : 0.53% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000059s : 0.43% jit_opt_a.loop_unroll : 0.000035s : 0.26% jit_opt_a.a_1 : 0.000623s : 4.50% jit_opt_a.with_stream_mark : 0.000027s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000738s : 5.33% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000040s : 0.29% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000009s : 0.07% rewriter_after_opt_a : 0.000033s : 0.24% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000598s : 4.32% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000026s : 0.19% loop_unroll : 0.000438s : 3.16% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000049s : 0.36% cse_after_recomputation.cse : 0.000010s : 0.07% auto_monad_reorder : 0.000033s : 0.24% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000465s : 3.35% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.28% TotalTime = 0.0450133, [30] [bootstrap]: 0.00030041 [type_inference]: 0.0344046 [event_method]: 1.962e-05 [auto_monad]: 6.643e-05 [graph_reusing]: 5.70001e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.00013668 [rewriter_before_opt_a]: 9.506e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0073046, [2] [Cycle 1]: 0.00348055, [27] [switch_simplify]: 5.446e-05 [loop_unroll]: 3.084e-05 [a_1]: 0.00057346 [with_stream_mark]: 2.053e-05 [recompute_prepare]: 8.18001e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00243392 [add_forward_monad_depend]: 8.73001e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.797e-05 [cse]: 3.691e-05 [replace_applicator]: 2.118e-05 [Cycle 2]: 0.00043566, [27] [switch_simplify]: 6.80002e-06 [loop_unroll]: 5.76e-06 [a_1]: 0.00010156 [with_stream_mark]: 1.364e-05 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.19003e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 2.93998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.873e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.78998e-06 [cse]: 1.583e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.65e-05 [rewriter_after_opt_a]: 4.12e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00081788 [jit_opt_b]: 5.718e-05, [1] [Cycle 1]: 4.878e-05, [2] [frontend_op_eliminate]: 1.818e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 2.908e-05 [loop_unroll]: 0.00050229 [jit_opt_after_cconv]: 0.0001613, [1] [Cycle 1]: 0.00015409, [11] [c_1]: 2.426e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 5.80002e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 2.705e-05 [call_graph_tuple_transform]: 2.167e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.69001e-06 [remove_dup_value]: 1.841e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 7.06001e-06 [add_recomputation]: 5.703e-05 [cse_after_recomputation]: 2.522e-05, [1] [Cycle 1]: 1.957e-05, [1] [cse]: 1.303e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 7.15998e-06 [opt_after_jit_grad]: 0.00053223 [symbol_engine_optimizer]: 0.00012702, [1] [Cycle 1]: 0.00011979, [6] [build]: 4.56002e-06 [elim_shapecalc]: 9.36e-06 [elim_not_effective]: 1.412e-05 [opt_reshape]: 5.026e-05 [fold_const_symbol]: 1.124e-05 [renormalize]: 5.29981e-07 [validate]: 4.902e-05 Sums bootstrap : 0.000300s : 0.73% type_inference : 0.034405s : 84.05% event_method : 0.000020s : 0.05% auto_monad : 0.000066s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000137s : 0.33% rewriter_before_opt_a : 0.000095s : 0.23% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.15% jit_opt_a.loop_unroll : 0.000037s : 0.09% jit_opt_a.a_1 : 0.000675s : 1.65% jit_opt_a.with_stream_mark : 0.000034s : 0.08% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.002434s : 5.95% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.06% jit_opt_a.cse : 0.000053s : 0.13% jit_opt_a.replace_applicator : 0.000027s : 0.07% py_interpret_to_execute_after_opt_a : 0.000017s : 0.04% rewriter_after_opt_a : 0.000041s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000818s : 2.00% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000029s : 0.07% loop_unroll : 0.000502s : 1.23% jit_opt_after_cconv.c_1 : 0.000024s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.02% remove_dup_value : 0.000018s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000057s : 0.14% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000532s : 1.30% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000050s : 0.12% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.12% Time group info: ------[substitution.] 0.000231 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.59% : 0.000006s : 3: substitution.graph_param_transform 83.31% : 0.000193s : 4: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000006s : 4: substitution.remove_not_recompute_node 2.74% : 0.000006s : 2: substitution.replace_old_param 5.83% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034334 2 94.10% : 0.032310s : 1: type_inference.infer 5.90% : 0.002024s : 1: type_inference.specialize ------[replace.] 0.000075 6 66.89% : 0.000050s : 4: replace.inline 33.11% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 93.89% : 0.000190s : 4: match.inline 6.11% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000002s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000002s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000002s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.51% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.48% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.92% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001045 13 48.06% : 0.000502s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.69% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.25% : 0.000494s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048463 72 0.12% : 0.000060s : 1: add_recomputation 0.14% : 0.000070s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.66% : 0.000321s : 1: bootstrap 0.07% : 0.000032s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 15.08% : 0.007309s : 1: jit_opt_a 0.34% : 0.000164s : 1: jit_opt_after_cconv 0.12% : 0.000060s : 1: jit_opt_b 1.06% : 0.000511s : 1: loop_unroll 1.71% : 0.000828s : 1: mutable_eliminate 1.89% : 0.000914s : 26: opt.transform.jit_opt_a 0.11% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000019s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000081s : 4: opt.transform.symbol_engine_opt 1.12% : 0.000542s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000142s : 1: py_interpret_to_execute 0.04% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000021s : 1: remove_dup_value 3.93% : 0.001902s : 1: renormalize.infer 1.07% : 0.000521s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000044s : 1: rewriter_after_opt_a 0.20% : 0.000099s : 1: rewriter_before_opt_a 0.27% : 0.000130s : 1: symbol_engine_optimizer 71.02% : 0.034417s : 1: type_inference Time group info: ------[substitution.] 0.000202 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.94% : 0.000006s : 3: substitution.graph_param_transform 83.20% : 0.000168s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000004s : 2: substitution.replace_old_param 5.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009581 2 89.39% : 0.008564s : 1: type_inference.infer 10.61% : 0.001017s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.41% : 0.000047s : 4: replace.inline 32.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.88% : 0.000166s : 4: match.inline 6.12% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 1.03% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.47% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.28% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.26% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.87% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.80% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000727 13 51.82% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.41% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.77% : 0.000318s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019490 72 0.27% : 0.000052s : 1: add_recomputation 0.36% : 0.000071s : 1: auto_monad 0.19% : 0.000037s : 1: auto_monad_reorder 1.82% : 0.000355s : 1: bootstrap 0.15% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.11% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 28.01% : 0.005459s : 1: jit_opt_a 0.76% : 0.000149s : 1: jit_opt_after_cconv 0.27% : 0.000052s : 1: jit_opt_b 2.29% : 0.000447s : 1: loop_unroll 3.12% : 0.000608s : 1: mutable_eliminate 4.29% : 0.000837s : 26: opt.transform.jit_opt_a 0.24% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.42% : 0.000472s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000058s : 1: py_interpret_to_execute 0.06% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.04% : 0.000397s : 1: renormalize.infer 1.71% : 0.000333s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000037s : 1: rewriter_after_opt_a 0.40% : 0.000077s : 1: rewriter_before_opt_a 0.37% : 0.000073s : 1: symbol_engine_optimizer 49.60% : 0.009666s : 1: type_inference . TotalTime = 0.137504, [30] [bootstrap]: 0.00028667 [type_inference]: 0.123767 [event_method]: 2.841e-05 [auto_monad]: 8.867e-05 [graph_reusing]: 7.56001e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00059461 [rewriter_before_opt_a]: 0.00011706 [expand_dump_flag]: 4.4e-06 [jit_opt_a]: 0.00969944, [2] [Cycle 1]: 0.00538305, [27] [switch_simplify]: 8.174e-05 [loop_unroll]: 3.825e-05 [a_1]: 0.0008987 [with_stream_mark]: 2.694e-05 [recompute_prepare]: 1.031e-05 [updatestate_depend_eliminate]: 4.98001e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 9.86998e-06 [updatestate_useless_node_eliminater]: 7.66001e-06 [accelerated_algorithm]: 8.67e-06 [meta_shard_fg_expand]: 3.31999e-06 [get_grad_eliminate_]: 8.38999e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.864e-05 [j_node_and_user_rematch]: 1.247e-05 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.199e-05 [inline_without_move]: 7.43e-06 [renormalize]: 0.00388397 [add_forward_monad_depend]: 9.67999e-06 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 1.994e-05 [cse]: 4.267e-05 [replace_applicator]: 2.645e-05 [Cycle 2]: 0.00042212, [27] [switch_simplify]: 8.90001e-06 [loop_unroll]: 7.15e-06 [a_1]: 0.00013872 [with_stream_mark]: 1.345e-05 [recompute_prepare]: 7.14001e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.91998e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.93998e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 4.29997e-06 [cell_reuse_recompute_pass]: 3.12002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.845e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 9.99001e-06 [inline_without_move]: 6.43003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.18998e-06 [cse]: 1.636e-05 [replace_applicator]: 6.64001e-06 [py_interpret_to_execute_after_opt_a]: 1.453e-05 [rewriter_after_opt_a]: 4.146e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00074555 [jit_opt_b]: 8.57e-05, [1] [Cycle 1]: 7.624e-05, [2] [frontend_op_eliminate]: 2.087e-05 [inline_after_opt_a]: 2.098e-05 [cconv]: 2.999e-05 [loop_unroll]: 0.00048012 [jit_opt_after_cconv]: 0.0002907, [1] [Cycle 1]: 0.00028124, [11] [c_1]: 0.00011813 [parameter_eliminate]: 3.45998e-06 [updatestate_depend_eliminate]: 8.82e-06 [updatestate_assign_eliminate]: 5.87001e-06 [updatestate_loads_eliminate]: 3.03e-06 [cse]: 3.188e-05 [call_graph_tuple_transform]: 2.765e-05 [tuple_list_get_item_eliminator]: 7.66999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 7.53e-06 [remove_dup_value]: 2.234e-05 [partial_unused_args_eliminate]: 2.73e-06 [environ_conv]: 1.165e-05 [add_recomputation]: 5.482e-05 [cse_after_recomputation]: 3.031e-05, [1] [Cycle 1]: 2.171e-05, [1] [cse]: 1.461e-05 [auto_monad_reorder]: 1.98e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00051476 [symbol_engine_optimizer]: 9.357e-05, [1] [Cycle 1]: 8.672e-05, [6] [build]: 5.00999e-06 [elim_shapecalc]: 9.62001e-06 [elim_not_effective]: 1.842e-05 [opt_reshape]: 7.75e-06 [fold_const_symbol]: 1.289e-05 [renormalize]: 5.19998e-07 [validate]: 0.00022993 Sums bootstrap : 0.000287s : 0.22% type_inference : 0.123767s : 93.15% event_method : 0.000028s : 0.02% auto_monad : 0.000089s : 0.07% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000595s : 0.45% rewriter_before_opt_a : 0.000117s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000091s : 0.07% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.001037s : 0.78% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003884s : 2.92% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000059s : 0.04% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000746s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000480s : 0.36% jit_opt_after_cconv.c_1 : 0.000118s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000022s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000515s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000230s : 0.17% Time group info: ------[substitution.] 0.000353 25 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000007s : 4: substitution.graph_param_transform 88.56% : 0.000313s : 5: substitution.inline 1.34% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000006s : 4: substitution.remove_not_recompute_node 1.62% : 0.000006s : 2: substitution.replace_old_param 3.90% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123657 2 97.04% : 0.120002s : 1: type_inference.infer 2.96% : 0.003655s : 1: type_inference.specialize ------[replace.] 0.000180 7 75.48% : 0.000136s : 5: replace.inline 24.52% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 7 96.11% : 0.000310s : 5: match.inline 3.89% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.41% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.09% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.81% : 0.000009s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.73% : 0.000003s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.61% : 0.000003s : 19: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000004s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 2.08% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 1.14% : 0.000002s : 8: predicate.specialize_transform 1.67% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.87% : 0.000005s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.19% : 0.000012s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.57% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003040 25 62.10% : 0.001888s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.37% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.53% : 0.001050s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142724 72 0.04% : 0.000058s : 1: add_recomputation 0.07% : 0.000093s : 1: auto_monad 0.02% : 0.000025s : 1: auto_monad_reorder 0.21% : 0.000305s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.80% : 0.009703s : 1: jit_opt_a 0.21% : 0.000294s : 1: jit_opt_after_cconv 0.06% : 0.000089s : 1: jit_opt_b 0.34% : 0.000490s : 1: loop_unroll 0.53% : 0.000756s : 1: mutable_eliminate 0.94% : 0.001345s : 26: opt.transform.jit_opt_a 0.11% : 0.000157s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000525s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000603s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000025s : 1: remove_dup_value 1.94% : 0.002776s : 1: renormalize.infer 0.77% : 0.001094s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000124s : 1: rewriter_before_opt_a 0.07% : 0.000099s : 1: symbol_engine_optimizer 86.73% : 0.123792s : 1: type_inference TotalTime = 0.143243, [30] [bootstrap]: 0.00040651 [type_inference]: 0.12892 [event_method]: 2.516e-05 [auto_monad]: 7.55e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00053556 [rewriter_before_opt_a]: 0.0001019 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0103076, [2] [Cycle 1]: 0.00555259, [27] [switch_simplify]: 7.309e-05 [loop_unroll]: 3.845e-05 [a_1]: 0.0008761 [with_stream_mark]: 2.604e-05 [recompute_prepare]: 1.262e-05 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 2.55002e-06 [specialize_transform]: 8.21002e-06 [updatestate_useless_node_eliminater]: 7.43e-06 [accelerated_algorithm]: 8.18001e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 7.23999e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 2.11e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.756e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.334e-05 [inline_without_move]: 7.28e-06 [renormalize]: 0.0040751 [add_forward_monad_depend]: 1.136e-05 [auto_monad_grad]: 3.11999e-06 [auto_monad_eliminator]: 2.499e-05 [cse]: 4.193e-05 [replace_applicator]: 2.652e-05 [Cycle 2]: 0.00048455, [27] [switch_simplify]: 7.58999e-06 [loop_unroll]: 7.01999e-06 [a_1]: 0.00015664 [with_stream_mark]: 1.873e-05 [recompute_prepare]: 7.85998e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 7.08e-06 [merge_forward]: 5.15999e-06 [cell_reuse_recompute_pass]: 4.47998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.837e-05 [j_node_and_user_rematch]: 1.172e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.287e-05 [inline_without_move]: 6.61e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.16e-06 [auto_monad_grad]: 1.38002e-06 [auto_monad_eliminator]: 1.093e-05 [cse]: 2.122e-05 [replace_applicator]: 9.02999e-06 [py_interpret_to_execute_after_opt_a]: 2.233e-05 [rewriter_after_opt_a]: 4.859e-05 [convert_after_rewriter]: 8.37e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00093027 [jit_opt_b]: 6.357e-05, [1] [Cycle 1]: 5.52e-05, [2] [frontend_op_eliminate]: 2.186e-05 [inline_after_opt_a]: 1.985e-05 [cconv]: 3.566e-05 [loop_unroll]: 0.00048236 [jit_opt_after_cconv]: 0.00017748, [1] [Cycle 1]: 0.00017092, [11] [c_1]: 2.839e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 9.34998e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 3.22e-05 [call_graph_tuple_transform]: 2.437e-05 [tuple_list_get_item_eliminator]: 6.88e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 1.704e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 1.026e-05 [add_recomputation]: 5.563e-05 [cse_after_recomputation]: 2.579e-05, [1] [Cycle 1]: 2.03e-05, [1] [cse]: 1.333e-05 [auto_monad_reorder]: 1.818e-05 [get_jit_bprop_graph]: 2.69001e-06 [rewriter_after_jit_bprop_graph]: 8.79e-06 [opt_after_jit_grad]: 0.00048389 [symbol_engine_optimizer]: 8.459e-05, [1] [Cycle 1]: 7.767e-05, [6] [build]: 5.25999e-06 [elim_shapecalc]: 1.036e-05 [elim_not_effective]: 1.511e-05 [opt_reshape]: 6.93998e-06 [fold_const_symbol]: 1.06e-05 [renormalize]: 9.39996e-07 [validate]: 9.256e-05 Sums bootstrap : 0.000407s : 0.29% type_inference : 0.128920s : 93.30% event_method : 0.000025s : 0.02% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000536s : 0.39% rewriter_before_opt_a : 0.000102s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.06% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.001033s : 0.75% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004075s : 2.95% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.03% jit_opt_a.cse : 0.000063s : 0.05% jit_opt_a.replace_applicator : 0.000036s : 0.03% py_interpret_to_execute_after_opt_a : 0.000022s : 0.02% rewriter_after_opt_a : 0.000049s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000930s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000036s : 0.03% loop_unroll : 0.000482s : 0.35% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000484s : 0.35% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000093s : 0.07% Time group info: ------[substitution.] 0.000372 28 0.69% : 0.000003s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.73% : 0.000006s : 4: substitution.graph_param_transform 85.11% : 0.000316s : 5: substitution.inline 1.06% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000016s : 3: substitution.reduce_eliminate 1.61% : 0.000006s : 4: substitution.remove_not_recompute_node 1.81% : 0.000007s : 2: substitution.replace_old_param 3.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128831 2 97.21% : 0.125236s : 1: type_inference.infer 2.79% : 0.003595s : 1: type_inference.specialize ------[replace.] 0.000128 7 70.26% : 0.000090s : 5: replace.inline 29.74% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000324 7 96.69% : 0.000313s : 5: match.inline 3.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 886 1.14% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.57% : 0.000003s : 13: predicate.addn_zero_filter 2.50% : 0.000004s : 13: predicate.arithmetic_simplify 1.48% : 0.000003s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.34% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 0.99% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.57% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_depend_swap 1.45% : 0.000002s : 13: predicate.environ_get_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000001s : 4: predicate.graph_param_transform 5.49% : 0.000009s : 28: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.53% : 0.000003s : 8: predicate.less_batch_normalization 1.58% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.10% : 0.000004s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 13: predicate.merge_addn 1.25% : 0.000002s : 13: predicate.minmaximum_grad 2.25% : 0.000004s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.00% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 3.24% : 0.000005s : 13: predicate.reduce_eliminate 1.54% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.58% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.74% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.57% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003050 25 62.80% : 0.001915s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.36% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.85% : 0.001032s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148622 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.29% : 0.000431s : 1: bootstrap 0.03% : 0.000039s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.94% : 0.010313s : 1: jit_opt_a 0.12% : 0.000180s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.33% : 0.000492s : 1: loop_unroll 0.63% : 0.000943s : 1: mutable_eliminate 0.90% : 0.001333s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000493s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000543s : 1: py_interpret_to_execute 0.02% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.98% : 0.002937s : 1: renormalize.infer 0.76% : 0.001123s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000052s : 1: rewriter_after_opt_a 0.07% : 0.000108s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 86.76% : 0.128945s : 1: type_inference TotalTime = 0.0373278, [30] [bootstrap]: 0.00032313 [type_inference]: 0.021726 [event_method]: 2.055e-05 [auto_monad]: 7.239e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 0.00063455 [rewriter_before_opt_a]: 9.453e-05 [expand_dump_flag]: 4.70001e-06 [jit_opt_a]: 0.00983927, [2] [Cycle 1]: 0.00432315, [27] [switch_simplify]: 6.603e-05 [loop_unroll]: 3.145e-05 [a_1]: 0.00264932 [with_stream_mark]: 2.496e-05 [recompute_prepare]: 1.325e-05 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 3.75998e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 7.88999e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 4.02e-06 [get_grad_eliminate_]: 7.55998e-06 [merge_forward]: 4.62998e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.757e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.89e-06 [renormalize]: 0.00112581 [add_forward_monad_depend]: 8.12e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.819e-05 [cse]: 3.75e-05 [replace_applicator]: 1.638e-05 [Cycle 2]: 0.00035422, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 6.44001e-06 [a_1]: 0.00010126 [with_stream_mark]: 1.154e-05 [recompute_prepare]: 6.07999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 5.29998e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 8.42998e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 7.41999e-06 [cse]: 1.41e-05 [replace_applicator]: 5.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.438e-05 [rewriter_after_opt_a]: 4.158e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00263452 [jit_opt_b]: 6.164e-05, [1] [Cycle 1]: 5.292e-05, [2] [frontend_op_eliminate]: 1.924e-05 [inline_after_opt_a]: 2.075e-05 [cconv]: 3.095e-05 [loop_unroll]: 0.00058419 [jit_opt_after_cconv]: 0.00018083, [1] [Cycle 1]: 0.00017313, [11] [c_1]: 2.394e-05 [parameter_eliminate]: 4.58999e-06 [updatestate_depend_eliminate]: 8.3e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 3.964e-05 [call_graph_tuple_transform]: 2.396e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.96998e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.779e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.00002e-06 [add_recomputation]: 5.787e-05 [cse_after_recomputation]: 2.379e-05, [1] [Cycle 1]: 1.745e-05, [1] [cse]: 1.155e-05 [auto_monad_reorder]: 1.885e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 6.98e-06 [opt_after_jit_grad]: 0.00052197 [symbol_engine_optimizer]: 0.00012689, [1] [Cycle 1]: 0.00012041, [6] [build]: 4.63001e-06 [elim_shapecalc]: 9.37999e-06 [elim_not_effective]: 1.546e-05 [opt_reshape]: 4.869e-05 [fold_const_symbol]: 1.194e-05 [renormalize]: 3.69997e-07 [validate]: 4.839e-05 Sums bootstrap : 0.000323s : 1.03% type_inference : 0.021726s : 69.01% event_method : 0.000021s : 0.07% auto_monad : 0.000072s : 0.23% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000635s : 2.02% rewriter_before_opt_a : 0.000095s : 0.30% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.23% jit_opt_a.loop_unroll : 0.000038s : 0.12% jit_opt_a.a_1 : 0.002751s : 8.74% jit_opt_a.with_stream_mark : 0.000037s : 0.12% jit_opt_a.recompute_prepare : 0.000019s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001126s : 3.58% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000052s : 0.16% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000042s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.002635s : 8.37% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.06% jit_opt_b.inline_after_opt_a : 0.000021s : 0.07% cconv : 0.000031s : 0.10% loop_unroll : 0.000584s : 1.86% jit_opt_after_cconv.c_1 : 0.000024s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000040s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000058s : 0.18% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000522s : 1.66% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000049s : 0.15% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.15% Time group info: ------[substitution.] 0.000228 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.96% : 0.000007s : 3: substitution.graph_param_transform 80.22% : 0.000183s : 4: substitution.inline 1.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 8.97% : 0.000020s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021641 2 91.76% : 0.019857s : 1: type_inference.infer 8.24% : 0.001784s : 1: type_inference.specialize ------[replace.] 0.000128 6 44.36% : 0.000057s : 4: replace.inline 55.64% : 0.000071s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 91.09% : 0.000180s : 4: match.inline 8.91% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.001172 691 0.16% : 0.000002s : 10: predicate.accumulaten_eliminater 0.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.12% : 0.000001s : 10: predicate.addn_check_dump 0.15% : 0.000002s : 10: predicate.addn_zero_filter 0.27% : 0.000003s : 10: predicate.arithmetic_simplify 0.18% : 0.000002s : 10: predicate.cast_eliminate 0.06% : 0.000001s : 3: predicate.check_bprop_eliminate 0.12% : 0.000001s : 10: predicate.compare_switch_simplify 0.20% : 0.000002s : 10: predicate.depend_value_elim 0.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.17% : 0.000002s : 10: predicate.dict_get_item_eliminator 0.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.08% : 0.000001s : 3: predicate.elim_not_effective 0.07% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.26% : 0.000003s : 10: predicate.environ_add_const_eliminate 0.14% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.12% : 0.000001s : 10: predicate.environ_get_depend_swap 0.15% : 0.000002s : 10: predicate.environ_get_eliminate 0.16% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 3: predicate.fold_const_symbol 0.13% : 0.000002s : 6: predicate.get_grad_eliminate 0.03% : 0.000000s : 3: predicate.graph_param_transform 0.75% : 0.000009s : 22: predicate.inline 0.09% : 0.000001s : 6: predicate.inline_without_move 0.04% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.15% : 0.000002s : 6: predicate.less_batch_normalization 0.37% : 0.000004s : 12: predicate.list_to_tuple_eliminator_ 0.23% : 0.000003s : 15: predicate.load_eliminater 0.18% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.44% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.37% : 0.000004s : 13: predicate.make_slice_get_slice_eliminator 0.13% : 0.000002s : 10: predicate.merge_addn 0.12% : 0.000001s : 10: predicate.minmaximum_grad 0.37% : 0.000004s : 3: predicate.mutable_eliminate 0.06% : 0.000001s : 3: predicate.opt_reshape 0.24% : 0.000003s : 15: predicate.partial_eliminate 0.16% : 0.000002s : 10: predicate.print_const_string_wrapper 0.21% : 0.000002s : 10: predicate.reduce_eliminate 0.17% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.09% : 0.000001s : 6: predicate.remove_not_recompute_node 0.22% : 0.000003s : 18: predicate.replace_applicator 0.07% : 0.000001s : 6: predicate.replace_old_param 0.04% : 0.000001s : 3: predicate.reset_defer_inline 0.15% : 0.000002s : 10: predicate.reshape_eliminate 0.20% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.13% : 0.000001s : 3: predicate.row_tensor_eliminate 0.12% : 0.000001s : 10: predicate.same_eliminate 0.06% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.10% : 0.000001s : 6: predicate.special_op_eliminate 0.10% : 0.000001s : 6: predicate.specialize_transform 0.18% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.14% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.05% : 0.000001s : 3: predicate.switch_call_monad_eliminater 87.36% : 0.001024s : 16: predicate.switch_defer_inline 0.33% : 0.000004s : 16: predicate.switch_layer_defer_inline 0.89% : 0.000010s : 53: predicate.switch_simplify 0.14% : 0.000002s : 10: predicate.tile_eliminate 0.15% : 0.000002s : 10: predicate.transpose_eliminate 0.18% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.17% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 0.57% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 0.28% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 0.19% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.20% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.37% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 0.24% : 0.000003s : 10: predicate.value_based_eliminate 0.04% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.10% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000952 13 47.19% : 0.000449s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.18% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.63% : 0.000473s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.041567 72 0.15% : 0.000061s : 1: add_recomputation 0.18% : 0.000076s : 1: auto_monad 0.05% : 0.000022s : 1: auto_monad_reorder 0.82% : 0.000342s : 1: bootstrap 0.08% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.06% : 0.000025s : 1: event_method 0.02% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 23.68% : 0.009844s : 1: jit_opt_a 0.44% : 0.000184s : 1: jit_opt_after_cconv 0.16% : 0.000065s : 1: jit_opt_b 1.43% : 0.000594s : 1: loop_unroll 6.38% : 0.002650s : 1: mutable_eliminate 7.21% : 0.002998s : 26: opt.transform.jit_opt_a 0.13% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000032s : 4: opt.transform.jit_opt_b 0.04% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000026s : 1: opt.transform.mutable_eliminate 0.06% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000082s : 4: opt.transform.symbol_engine_opt 1.28% : 0.000531s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 1.56% : 0.000647s : 1: py_interpret_to_execute 0.04% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 1.47% : 0.000612s : 1: renormalize.infer 1.21% : 0.000503s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000045s : 1: rewriter_after_opt_a 0.24% : 0.000100s : 1: rewriter_before_opt_a 0.31% : 0.000130s : 1: symbol_engine_optimizer 52.31% : 0.021743s : 1: type_inference TotalTime = 0.139939, [30] [bootstrap]: 0.00032623 [type_inference]: 0.126222 [event_method]: 2.64e-05 [auto_monad]: 0.00011586 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00071294 [rewriter_before_opt_a]: 0.00010358 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.00984757, [2] [Cycle 1]: 0.00510003, [27] [switch_simplify]: 6.185e-05 [loop_unroll]: 3.094e-05 [a_1]: 0.00073528 [with_stream_mark]: 2.034e-05 [recompute_prepare]: 9.93002e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.54002e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.72002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.698e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.08002e-06 [renormalize]: 0.00384788 [add_forward_monad_depend]: 9.49e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 2.023e-05 [cse]: 3.126e-05 [replace_applicator]: 2.223e-05 [Cycle 2]: 0.00042327, [27] [switch_simplify]: 7.53999e-06 [loop_unroll]: 5.99999e-06 [a_1]: 0.0001494 [with_stream_mark]: 1.577e-05 [recompute_prepare]: 6.69001e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 3.04001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.936e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.038e-05 [inline_without_move]: 5.89e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 6.50997e-06 [cse]: 1.306e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.482e-05 [rewriter_after_opt_a]: 6.812e-05 [convert_after_rewriter]: 8.13001e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00069839 [jit_opt_b]: 5.823e-05, [1] [Cycle 1]: 5.003e-05, [2] [frontend_op_eliminate]: 1.968e-05 [inline_after_opt_a]: 1.859e-05 [cconv]: 2.826e-05 [loop_unroll]: 0.00044683 [jit_opt_after_cconv]: 0.00016105, [1] [Cycle 1]: 0.00015421, [11] [c_1]: 2.702e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 5.99999e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.616e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 6.84999e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.657e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 8.68001e-06 [add_recomputation]: 0.00013219 [cse_after_recomputation]: 2.674e-05, [1] [Cycle 1]: 1.955e-05, [1] [cse]: 1.297e-05 [auto_monad_reorder]: 1.65e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 6.01998e-06 [opt_after_jit_grad]: 0.00048464 [symbol_engine_optimizer]: 8.002e-05, [1] [Cycle 1]: 7.426e-05, [6] [build]: 4.81002e-06 [elim_shapecalc]: 9.36002e-06 [elim_not_effective]: 1.51e-05 [opt_reshape]: 6.89001e-06 [fold_const_symbol]: 9.83998e-06 [renormalize]: 4.50003e-07 [validate]: 0.00011521 Sums bootstrap : 0.000326s : 0.24% type_inference : 0.126222s : 93.52% event_method : 0.000026s : 0.02% auto_monad : 0.000116s : 0.09% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000713s : 0.53% rewriter_before_opt_a : 0.000104s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000885s : 0.66% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003848s : 2.85% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000068s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000698s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000447s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000132s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000485s : 0.36% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000115s : 0.09% Time group info: ------[substitution.] 0.000297 24 1.02% : 0.000003s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 4: substitution.graph_param_transform 86.82% : 0.000258s : 4: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000006s : 2: substitution.replace_old_param 4.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124693 2 97.70% : 0.121831s : 1: type_inference.infer 2.30% : 0.002862s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.29% : 0.000056s : 4: replace.inline 31.71% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 6 95.46% : 0.000255s : 4: match.inline 4.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 2.01% : 0.000003s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.03% : 0.000007s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.55% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.72% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.81% : 0.000010s : 58: predicate.switch_simplify 1.10% : 0.000002s : 12: predicate.tile_eliminate 1.39% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002630 22 62.61% : 0.001646s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.90% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.49% : 0.000933s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144927 72 0.09% : 0.000136s : 1: add_recomputation 0.08% : 0.000120s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000337s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.80% : 0.009851s : 1: jit_opt_a 0.11% : 0.000164s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.31% : 0.000455s : 1: loop_unroll 0.49% : 0.000706s : 1: mutable_eliminate 0.79% : 0.001141s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000493s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000722s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.94% : 0.002808s : 1: renormalize.infer 0.71% : 0.001027s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000072s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 87.11% : 0.126248s : 1: type_inference TotalTime = 0.168488, [30] [bootstrap]: 0.00033802 [type_inference]: 0.156525 [event_method]: 2.271e-05 [auto_monad]: 7.688e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00044621 [rewriter_before_opt_a]: 9.832e-05 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00814889, [2] [Cycle 1]: 0.00419883, [27] [switch_simplify]: 6.656e-05 [loop_unroll]: 3.491e-05 [a_1]: 0.00072321 [with_stream_mark]: 2.27e-05 [recompute_prepare]: 9.94001e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 7.28e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 1.095e-05 [inline_without_move]: 6.49999e-06 [renormalize]: 0.00296049 [add_forward_monad_depend]: 7.93001e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.821e-05 [cse]: 3.702e-05 [replace_applicator]: 1.956e-05 [Cycle 2]: 0.00038914, [27] [switch_simplify]: 7.38e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00013194 [with_stream_mark]: 1.318e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.49998e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 4.79998e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.412e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.432e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.575e-05 [rewriter_after_opt_a]: 3.991e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.99999e-06 [mutable_eliminate]: 0.00066217 [jit_opt_b]: 6.402e-05, [1] [Cycle 1]: 5.573e-05, [2] [frontend_op_eliminate]: 2.467e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 3.005e-05 [loop_unroll]: 0.00048397 [jit_opt_after_cconv]: 0.0001656, [1] [Cycle 1]: 0.00015808, [11] [c_1]: 2.565e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 7.53e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.893e-05 [call_graph_tuple_transform]: 2.17e-05 [tuple_list_get_item_eliminator]: 6.16e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.745e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 9.46e-06 [add_recomputation]: 5.436e-05 [cse_after_recomputation]: 2.551e-05, [1] [Cycle 1]: 2.024e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.816e-05 [get_jit_bprop_graph]: 3.24001e-06 [rewriter_after_jit_bprop_graph]: 5.65001e-06 [opt_after_jit_grad]: 0.00080272 [symbol_engine_optimizer]: 8.656e-05, [1] [Cycle 1]: 7.949e-05, [6] [build]: 4.75999e-06 [elim_shapecalc]: 1.259e-05 [elim_not_effective]: 1.581e-05 [opt_reshape]: 6.42001e-06 [fold_const_symbol]: 1.038e-05 [renormalize]: 5.69999e-07 [validate]: 0.00013234 Sums bootstrap : 0.000338s : 0.21% type_inference : 0.156525s : 95.27% event_method : 0.000023s : 0.01% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000446s : 0.27% rewriter_before_opt_a : 0.000098s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000855s : 0.52% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002961s : 1.80% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000051s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000662s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000484s : 0.29% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000803s : 0.49% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000132s : 0.08% Time group info: ------[substitution.] 0.000302 28 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 2.04% : 0.000006s : 4: substitution.graph_param_transform 83.21% : 0.000251s : 5: substitution.inline 1.18% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.82% : 0.000015s : 3: substitution.reduce_eliminate 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000006s : 2: substitution.replace_old_param 3.67% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.156445 2 98.12% : 0.153503s : 1: type_inference.infer 1.88% : 0.002942s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.27% : 0.000070s : 5: replace.inline 31.73% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 7 96.14% : 0.000248s : 5: match.inline 3.86% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 1.40% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 2.00% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 6.27% : 0.000009s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 19: predicate.load_eliminater 1.89% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.86% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.77% : 0.000011s : 64: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002546 25 64.96% : 0.001654s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.43% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.60% : 0.000805s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.172566 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000352s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.72% : 0.008152s : 1: jit_opt_a 0.10% : 0.000169s : 1: jit_opt_after_cconv 0.04% : 0.000067s : 1: jit_opt_b 0.29% : 0.000497s : 1: loop_unroll 0.39% : 0.000674s : 1: mutable_eliminate 0.64% : 0.001112s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000816s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000453s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.26% : 0.002176s : 1: renormalize.infer 0.45% : 0.000773s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000103s : 1: rewriter_before_opt_a 0.05% : 0.000089s : 1: symbol_engine_optimizer 90.71% : 0.156539s : 1: type_inference TotalTime = 0.146673, [30] [bootstrap]: 0.0003225 [type_inference]: 0.133177 [event_method]: 2.863e-05 [auto_monad]: 7.991e-05 [graph_reusing]: 7.35e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.0005355 [rewriter_before_opt_a]: 0.00011113 [expand_dump_flag]: 4.28001e-06 [jit_opt_a]: 0.00985329, [2] [Cycle 1]: 0.00525829, [27] [switch_simplify]: 8.782e-05 [loop_unroll]: 3.592e-05 [a_1]: 0.00084507 [with_stream_mark]: 2.608e-05 [recompute_prepare]: 9.72001e-06 [updatestate_depend_eliminate]: 4.86002e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.76001e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 7.25e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 7.65e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.728e-05 [j_node_and_user_rematch]: 1.184e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.157e-05 [inline_without_move]: 7.25e-06 [renormalize]: 0.00382867 [add_forward_monad_depend]: 1.013e-05 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 2.081e-05 [cse]: 4.123e-05 [replace_applicator]: 2.313e-05 [Cycle 2]: 0.0004537, [27] [switch_simplify]: 7.40998e-06 [loop_unroll]: 7.03e-06 [a_1]: 0.00017462 [with_stream_mark]: 1.718e-05 [recompute_prepare]: 7.47002e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 3.40998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.858e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 1.69998e-06 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.558e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.892e-05 [rewriter_after_opt_a]: 4.186e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.0007645 [jit_opt_b]: 6.021e-05, [1] [Cycle 1]: 5.17e-05, [2] [frontend_op_eliminate]: 1.994e-05 [inline_after_opt_a]: 1.903e-05 [cconv]: 3.394e-05 [loop_unroll]: 0.00045057 [jit_opt_after_cconv]: 0.00017434, [1] [Cycle 1]: 0.00016739, [11] [c_1]: 2.756e-05 [parameter_eliminate]: 3.49001e-06 [updatestate_depend_eliminate]: 8.17998e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 3.147e-05 [call_graph_tuple_transform]: 2.483e-05 [tuple_list_get_item_eliminator]: 6.57002e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.922e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 1.091e-05 [add_recomputation]: 5.324e-05 [cse_after_recomputation]: 2.611e-05, [1] [Cycle 1]: 1.997e-05, [1] [cse]: 1.405e-05 [auto_monad_reorder]: 1.852e-05 [get_jit_bprop_graph]: 2.36998e-06 [rewriter_after_jit_bprop_graph]: 6.84999e-06 [opt_after_jit_grad]: 0.00048343 [symbol_engine_optimizer]: 8.133e-05, [1] [Cycle 1]: 7.457e-05, [6] [build]: 4.54002e-06 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 1.45e-05 [opt_reshape]: 7.68999e-06 [fold_const_symbol]: 9.00001e-06 [renormalize]: 1.05001e-06 [validate]: 8.772e-05 Sums bootstrap : 0.000323s : 0.23% type_inference : 0.133177s : 93.88% event_method : 0.000029s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000536s : 0.38% rewriter_before_opt_a : 0.000111s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000095s : 0.07% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001020s : 0.72% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003829s : 2.70% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000057s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000765s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000451s : 0.32% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000483s : 0.34% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000088s : 0.06% Time group info: ------[substitution.] 0.000367 25 0.56% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.78% : 0.000007s : 4: substitution.graph_param_transform 88.49% : 0.000325s : 5: substitution.inline 1.45% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000006s : 4: substitution.remove_not_recompute_node 1.69% : 0.000006s : 2: substitution.replace_old_param 3.94% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.133075 2 97.26% : 0.129429s : 1: type_inference.infer 2.74% : 0.003647s : 1: type_inference.specialize ------[replace.] 0.000133 7 69.10% : 0.000092s : 5: replace.inline 30.90% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000335 7 96.05% : 0.000321s : 5: match.inline 3.95% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.31% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.73% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.88% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.67% : 0.000003s : 13: predicate.reduce_eliminate 1.60% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.37% : 0.000011s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.63% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003145 25 62.87% : 0.001978s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.29% : 0.000103s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.84% : 0.001064s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.151853 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000083s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000341s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.49% : 0.009858s : 1: jit_opt_a 0.12% : 0.000177s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.30% : 0.000458s : 1: loop_unroll 0.51% : 0.000775s : 1: mutable_eliminate 0.87% : 0.001316s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000543s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.76% : 0.002676s : 1: renormalize.infer 0.75% : 0.001141s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000117s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 87.72% : 0.133202s : 1: type_inference TotalTime = 0.0505024, [30] [bootstrap]: 0.00035764 [type_inference]: 0.0408821 [event_method]: 2.371e-05 [auto_monad]: 7.626e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00012302 [rewriter_before_opt_a]: 8.635e-05 [expand_dump_flag]: 3.72998e-06 [jit_opt_a]: 0.00641463, [2] [Cycle 1]: 0.00230967, [27] [switch_simplify]: 6.431e-05 [loop_unroll]: 3.102e-05 [a_1]: 0.00058331 [with_stream_mark]: 2.497e-05 [recompute_prepare]: 7.96001e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.49998e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.571e-05 [j_node_and_user_rematch]: 9.75002e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.54998e-06 [renormalize]: 0.00123842 [add_forward_monad_depend]: 7.68999e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.668e-05 [cse]: 3.851e-05 [replace_applicator]: 1.598e-05 [Cycle 2]: 0.00033074, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.20001e-06 [a_1]: 9.309e-05 [with_stream_mark]: 1.083e-05 [recompute_prepare]: 5.11002e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.45003e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.426e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 5.46e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.385e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.419e-05 [rewriter_after_opt_a]: 3.996e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00073 [jit_opt_b]: 5.573e-05, [1] [Cycle 1]: 4.686e-05, [2] [frontend_op_eliminate]: 1.72e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 3.043e-05 [loop_unroll]: 0.00047385 [jit_opt_after_cconv]: 0.00016716, [1] [Cycle 1]: 0.00016053, [11] [c_1]: 2.212e-05 [parameter_eliminate]: 5.40999e-06 [updatestate_depend_eliminate]: 8.15e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 3.214e-05 [call_graph_tuple_transform]: 2.219e-05 [tuple_list_get_item_eliminator]: 5.68002e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.748e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 6.25997e-06 [add_recomputation]: 5.465e-05 [cse_after_recomputation]: 2.268e-05, [1] [Cycle 1]: 1.753e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 7.93999e-06 [opt_after_jit_grad]: 0.00053071 [symbol_engine_optimizer]: 8.104e-05, [1] [Cycle 1]: 7.434e-05, [6] [build]: 4.45999e-06 [elim_shapecalc]: 8.20999e-06 [elim_not_effective]: 1.588e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 9.84999e-06 [renormalize]: 8.30012e-07 [validate]: 4.652e-05 Sums bootstrap : 0.000358s : 0.78% type_inference : 0.040882s : 88.70% event_method : 0.000024s : 0.05% auto_monad : 0.000076s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000123s : 0.27% rewriter_before_opt_a : 0.000086s : 0.19% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.15% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000676s : 1.47% jit_opt_a.with_stream_mark : 0.000036s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001239s : 2.69% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000052s : 0.11% jit_opt_a.replace_applicator : 0.000021s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000040s : 0.09% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000730s : 1.58% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000030s : 0.07% loop_unroll : 0.000474s : 1.03% jit_opt_after_cconv.c_1 : 0.000022s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000032s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000055s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.02% opt_after_jit_grad : 0.000531s : 1.15% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.10% Time group info: ------[substitution.] 0.000243 23 1.05% : 0.000003s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 3: substitution.graph_param_transform 84.57% : 0.000205s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000005s : 2: substitution.replace_old_param 5.11% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040785 2 95.38% : 0.038903s : 1: type_inference.infer 4.62% : 0.001882s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.60% : 0.000052s : 4: replace.inline 32.40% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.76% : 0.000203s : 4: match.inline 5.24% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.54% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.62% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.58% : 0.000001s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 22: predicate.inline 1.13% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.77% : 0.000001s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 1.14% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.47% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000986 13 42.14% : 0.000416s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.10% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 52.76% : 0.000520s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.052702 72 0.11% : 0.000057s : 1: add_recomputation 0.15% : 0.000080s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.72% : 0.000381s : 1: bootstrap 0.06% : 0.000033s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.18% : 0.006418s : 1: jit_opt_a 0.32% : 0.000170s : 1: jit_opt_after_cconv 0.11% : 0.000058s : 1: jit_opt_b 0.92% : 0.000484s : 1: loop_unroll 1.41% : 0.000741s : 1: mutable_eliminate 1.72% : 0.000908s : 26: opt.transform.jit_opt_a 0.10% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.03% : 0.000542s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000128s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000020s : 1: remove_dup_value 1.39% : 0.000734s : 1: renormalize.infer 0.94% : 0.000495s : 1: renormalize.specialize 0.02% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000043s : 1: rewriter_after_opt_a 0.17% : 0.000091s : 1: rewriter_before_opt_a 0.16% : 0.000084s : 1: symbol_engine_optimizer 77.62% : 0.040909s : 1: type_inference TotalTime = 0.134612, [30] [bootstrap]: 0.00029184 [type_inference]: 0.12199 [event_method]: 2.523e-05 [auto_monad]: 7.672e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00044774 [rewriter_before_opt_a]: 9.696e-05 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.00746211, [2] [Cycle 1]: 0.00375531, [27] [switch_simplify]: 6.1e-05 [loop_unroll]: 3.443e-05 [a_1]: 0.0006899 [with_stream_mark]: 2.094e-05 [recompute_prepare]: 8.70001e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.12997e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.35998e-06 [updatestate_useless_node_eliminater]: 6.54001e-06 [accelerated_algorithm]: 6.89001e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.603e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.44998e-06 [inline_without_move]: 6.29001e-06 [renormalize]: 0.00256869 [add_forward_monad_depend]: 8.40001e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.915e-05 [cse]: 3.645e-05 [replace_applicator]: 1.936e-05 [Cycle 2]: 0.00039131, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 6.59999e-06 [a_1]: 0.00013317 [with_stream_mark]: 1.363e-05 [recompute_prepare]: 6.38998e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 2.59999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.46998e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.372e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 1.403e-05 [rewriter_after_opt_a]: 3.692e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00240252 [jit_opt_b]: 8.266e-05, [1] [Cycle 1]: 7.299e-05, [2] [frontend_op_eliminate]: 2.105e-05 [inline_after_opt_a]: 3.912e-05 [cconv]: 2.854e-05 [loop_unroll]: 0.00047166 [jit_opt_after_cconv]: 0.00019868, [1] [Cycle 1]: 0.00019176, [11] [c_1]: 2.775e-05 [parameter_eliminate]: 3.74002e-06 [updatestate_depend_eliminate]: 7.66999e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 3.642e-05 [call_graph_tuple_transform]: 2.727e-05 [tuple_list_get_item_eliminator]: 6.64999e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 1.13001e-06 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.939e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 9.12001e-06 [add_recomputation]: 5.398e-05 [cse_after_recomputation]: 2.829e-05, [1] [Cycle 1]: 2.046e-05, [1] [cse]: 1.429e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.69999e-06 [rewriter_after_jit_bprop_graph]: 6.71e-06 [opt_after_jit_grad]: 0.00048654 [symbol_engine_optimizer]: 8.308e-05, [1] [Cycle 1]: 7.667e-05, [6] [build]: 4.02e-06 [elim_shapecalc]: 8.80999e-06 [elim_not_effective]: 1.619e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 1.231e-05 [renormalize]: 5.19998e-07 [validate]: 5.426e-05 Sums bootstrap : 0.000292s : 0.22% type_inference : 0.121990s : 93.37% event_method : 0.000025s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000448s : 0.34% rewriter_before_opt_a : 0.000097s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000823s : 0.63% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002569s : 1.97% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.002403s : 1.84% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000039s : 0.03% cconv : 0.000029s : 0.02% loop_unroll : 0.000472s : 0.36% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000487s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.04% Time group info: ------[substitution.] 0.000271 28 1.66% : 0.000004s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 4: substitution.graph_param_transform 81.99% : 0.000222s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.69% : 0.000013s : 3: substitution.reduce_eliminate 1.68% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000005s : 2: substitution.replace_old_param 4.02% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121904 2 97.61% : 0.118985s : 1: type_inference.infer 2.39% : 0.002919s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.49% : 0.000066s : 5: replace.inline 31.51% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 95.73% : 0.000219s : 5: match.inline 4.27% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 1.85% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.87% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.87% : 0.000008s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.83% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 2.06% : 0.000003s : 13: predicate.reduce_eliminate 1.60% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 4: predicate.row_tensor_eliminate 1.55% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.29% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.45% : 0.000011s : 64: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.02% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002382 25 65.07% : 0.001550s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.77% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.16% : 0.000766s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138358 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000309s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.40% : 0.007466s : 1: jit_opt_a 0.15% : 0.000201s : 1: jit_opt_after_cconv 0.06% : 0.000086s : 1: jit_opt_b 0.35% : 0.000480s : 1: loop_unroll 1.75% : 0.002420s : 1: mutable_eliminate 0.77% : 0.001072s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000052s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000026s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000455s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.30% : 0.001795s : 1: renormalize.infer 0.55% : 0.000763s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000103s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 88.18% : 0.122009s : 1: type_inference TotalTime = 0.0326855, [30] [bootstrap]: 0.00028724 [type_inference]: 0.0226351 [event_method]: 2.125e-05 [auto_monad]: 6.747e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 0.00011242 [rewriter_before_opt_a]: 8.097e-05 [expand_dump_flag]: 3.47002e-06 [jit_opt_a]: 0.0072261, [2] [Cycle 1]: 0.00238702, [27] [switch_simplify]: 0.00011562 [loop_unroll]: 3.012e-05 [a_1]: 0.00068393 [with_stream_mark]: 2.172e-05 [recompute_prepare]: 9.64999e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.55002e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.81e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.80997e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00115385 [add_forward_monad_depend]: 7.3e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 3.529e-05 [replace_applicator]: 1.426e-05 [Cycle 2]: 0.00032855, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.271e-05 [with_stream_mark]: 1.204e-05 [recompute_prepare]: 5.21998e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 7.93999e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.92e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.321e-05 [replace_applicator]: 5.46002e-06 [py_interpret_to_execute_after_opt_a]: 1.34e-05 [rewriter_after_opt_a]: 3.86e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.00058587 [jit_opt_b]: 5.436e-05, [1] [Cycle 1]: 4.697e-05, [2] [frontend_op_eliminate]: 1.829e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 2.647e-05 [loop_unroll]: 0.00044461 [jit_opt_after_cconv]: 0.00016262, [1] [Cycle 1]: 0.00015634, [11] [c_1]: 2.191e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.614e-05 [call_graph_tuple_transform]: 3.271e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.758e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.42001e-06 [add_recomputation]: 5.225e-05 [cse_after_recomputation]: 2.367e-05, [1] [Cycle 1]: 1.808e-05, [1] [cse]: 1.244e-05 [auto_monad_reorder]: 1.838e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 5.42001e-06 [opt_after_jit_grad]: 0.00048452 [symbol_engine_optimizer]: 7.492e-05, [1] [Cycle 1]: 6.833e-05, [6] [build]: 3.97998e-06 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 1.309e-05 [opt_reshape]: 6.01998e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 5.10016e-07 [validate]: 4.071e-05 Sums bootstrap : 0.000287s : 1.04% type_inference : 0.022635s : 82.10% event_method : 0.000021s : 0.08% auto_monad : 0.000067s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000112s : 0.41% rewriter_before_opt_a : 0.000081s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000122s : 0.44% jit_opt_a.loop_unroll : 0.000035s : 0.13% jit_opt_a.a_1 : 0.000777s : 2.82% jit_opt_a.with_stream_mark : 0.000034s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.11% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001154s : 4.19% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.08% jit_opt_a.cse : 0.000048s : 0.18% jit_opt_a.replace_applicator : 0.000020s : 0.07% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000039s : 0.14% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000586s : 2.13% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000445s : 1.61% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000018s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000485s : 1.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.15% Time group info: ------[substitution.] 0.000295 23 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000006s : 3: substitution.graph_param_transform 87.41% : 0.000258s : 4: substitution.inline 1.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.65% : 0.000005s : 2: substitution.replace_old_param 4.75% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022562 2 93.07% : 0.021000s : 1: type_inference.infer 6.93% : 0.001563s : 1: type_inference.specialize ------[replace.] 0.000083 6 69.19% : 0.000058s : 4: replace.inline 30.81% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 6 95.27% : 0.000255s : 4: match.inline 4.73% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000002s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.11% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.46% : 0.000001s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000002s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000001s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.78% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.00% : 0.000004s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000002s : 10: predicate.tile_eliminate 1.41% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 5.12% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000886 13 43.27% : 0.000383s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.13% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.60% : 0.000448s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.034974 72 0.16% : 0.000055s : 1: add_recomputation 0.20% : 0.000071s : 1: auto_monad 0.06% : 0.000021s : 1: auto_monad_reorder 0.87% : 0.000305s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 20.67% : 0.007229s : 1: jit_opt_a 0.47% : 0.000165s : 1: jit_opt_after_cconv 0.16% : 0.000057s : 1: jit_opt_b 1.29% : 0.000453s : 1: loop_unroll 1.70% : 0.000595s : 1: mutable_eliminate 3.04% : 0.001063s : 26: opt.transform.jit_opt_a 0.18% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000015s : 1: opt.transform.mutable_eliminate 0.06% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.41% : 0.000493s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000116s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.89% : 0.000661s : 1: renormalize.infer 1.38% : 0.000482s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.12% : 0.000041s : 1: rewriter_after_opt_a 0.24% : 0.000085s : 1: rewriter_before_opt_a 0.22% : 0.000077s : 1: symbol_engine_optimizer 64.77% : 0.022651s : 1: type_inference TotalTime = 0.0696813, [30] [bootstrap]: 0.00030208 [type_inference]: 0.0590169 [event_method]: 2.3e-05 [auto_monad]: 6.452e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00029513 [rewriter_before_opt_a]: 9.774e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.00749225, [2] [Cycle 1]: 0.00341694, [27] [switch_simplify]: 6.2e-05 [loop_unroll]: 3.56e-05 [a_1]: 0.00069496 [with_stream_mark]: 1.618e-05 [recompute_prepare]: 9.83002e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 8.13999e-06 [updatestate_useless_node_eliminater]: 6.96999e-06 [accelerated_algorithm]: 7.54002e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 3.29001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.92001e-06 [inline_without_move]: 6.43e-06 [renormalize]: 0.0022639 [add_forward_monad_depend]: 5.88002e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.424e-05 [cse]: 2.532e-05 [replace_applicator]: 1.516e-05 [Cycle 2]: 0.00038606, [27] [switch_simplify]: 7.11001e-06 [loop_unroll]: 6.43e-06 [a_1]: 0.00012558 [with_stream_mark]: 1.229e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 6.13998e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 6.05002e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.488e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 8.83001e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.62999e-06 [auto_monad_grad]: 1.04998e-06 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.564e-05 [replace_applicator]: 6.25997e-06 [py_interpret_to_execute_after_opt_a]: 1.183e-05 [rewriter_after_opt_a]: 3.724e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00061502 [jit_opt_b]: 5.652e-05, [1] [Cycle 1]: 4.941e-05, [2] [frontend_op_eliminate]: 1.953e-05 [inline_after_opt_a]: 1.847e-05 [cconv]: 2.396e-05 [loop_unroll]: 0.0004235 [jit_opt_after_cconv]: 0.00016022, [1] [Cycle 1]: 0.00015406, [11] [c_1]: 2.7e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.402e-05 [call_graph_tuple_transform]: 2.176e-05 [tuple_list_get_item_eliminator]: 6.39001e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.78998e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 8.97e-06 [add_recomputation]: 4.375e-05 [cse_after_recomputation]: 2.458e-05, [1] [Cycle 1]: 1.945e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.612e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 4.18001e-06 [opt_after_jit_grad]: 0.00054469 [symbol_engine_optimizer]: 0.00011249, [1] [Cycle 1]: 0.00010515, [6] [build]: 3.81999e-06 [elim_shapecalc]: 9.42999e-06 [elim_not_effective]: 1.415e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 5.69999e-07 [validate]: 8.377e-05 Sums bootstrap : 0.000302s : 0.46% type_inference : 0.059017s : 90.29% event_method : 0.000023s : 0.04% auto_monad : 0.000065s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000295s : 0.45% rewriter_before_opt_a : 0.000098s : 0.15% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.11% jit_opt_a.loop_unroll : 0.000042s : 0.06% jit_opt_a.a_1 : 0.000821s : 1.26% jit_opt_a.with_stream_mark : 0.000028s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002264s : 3.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000041s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000615s : 0.94% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000423s : 0.65% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000044s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000545s : 0.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000084s : 0.13% Time group info: ------[substitution.] 0.000239 25 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000007s : 4: substitution.graph_param_transform 86.61% : 0.000207s : 5: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000004s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 4.56% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058938 2 95.91% : 0.056528s : 1: type_inference.infer 4.09% : 0.002410s : 1: type_inference.specialize ------[replace.] 0.000114 7 65.93% : 0.000075s : 5: replace.inline 34.07% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 95.43% : 0.000204s : 5: match.inline 4.57% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.15% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 2.21% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 19: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.24% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 1.64% : 0.000002s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.02% : 0.000010s : 65: predicate.switch_simplify 1.12% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.58% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002348 25 66.20% : 0.001554s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.78% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.02% : 0.000728s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073057 72 0.06% : 0.000047s : 1: add_recomputation 0.09% : 0.000068s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.43% : 0.000316s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.26% : 0.007495s : 1: jit_opt_a 0.22% : 0.000163s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.59% : 0.000431s : 1: loop_unroll 0.85% : 0.000624s : 1: mutable_eliminate 1.47% : 0.001075s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000553s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000302s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.06% : 0.001504s : 1: renormalize.infer 1.03% : 0.000752s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.14% : 0.000104s : 1: rewriter_before_opt_a 0.16% : 0.000115s : 1: symbol_engine_optimizer 80.80% : 0.059033s : 1: type_inference TotalTime = 0.145001, [30] [bootstrap]: 0.00031212 [type_inference]: 0.127978 [event_method]: 2.398e-05 [auto_monad]: 7.827e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 0.00059527 [rewriter_before_opt_a]: 0.00010209 [expand_dump_flag]: 4.58001e-06 [jit_opt_a]: 0.0130297, [2] [Cycle 1]: 0.00448952, [27] [switch_simplify]: 7.422e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.00069521 [with_stream_mark]: 2.719e-05 [recompute_prepare]: 1.133e-05 [updatestate_depend_eliminate]: 5.32001e-06 [updatestate_assign_eliminate]: 3.96001e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 7.7e-06 [updatestate_useless_node_eliminater]: 6.91001e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.80002e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.763e-05 [j_node_and_user_rematch]: 1.177e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.154e-05 [inline_without_move]: 6.38998e-06 [renormalize]: 0.00321601 [add_forward_monad_depend]: 1.305e-05 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 2.294e-05 [cse]: 3.608e-05 [replace_applicator]: 2.551e-05 [Cycle 2]: 0.00041028, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.00013192 [with_stream_mark]: 1.664e-05 [recompute_prepare]: 7.16001e-06 [updatestate_depend_eliminate]: 3.90998e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 2.38998e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 3.51999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.044e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.108e-05 [inline_without_move]: 5.51998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 8.98002e-06 [cse]: 1.199e-05 [replace_applicator]: 6.26998e-06 [py_interpret_to_execute_after_opt_a]: 1.813e-05 [rewriter_after_opt_a]: 4.355e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00080227 [jit_opt_b]: 6.165e-05, [1] [Cycle 1]: 5.205e-05, [2] [frontend_op_eliminate]: 2.049e-05 [inline_after_opt_a]: 1.912e-05 [cconv]: 3.48e-05 [loop_unroll]: 0.00059033 [jit_opt_after_cconv]: 0.00018058, [1] [Cycle 1]: 0.0001738, [11] [c_1]: 2.787e-05 [parameter_eliminate]: 5.29e-06 [updatestate_depend_eliminate]: 9.99001e-06 [updatestate_assign_eliminate]: 3.61999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 3.351e-05 [call_graph_tuple_transform]: 2.456e-05 [tuple_list_get_item_eliminator]: 7.19001e-06 [none_parameter_eliminate]: 1.80001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.709e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 1.145e-05 [add_recomputation]: 5.427e-05 [cse_after_recomputation]: 2.446e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.284e-05 [auto_monad_reorder]: 1.647e-05 [get_jit_bprop_graph]: 2.13998e-06 [rewriter_after_jit_bprop_graph]: 7.63999e-06 [opt_after_jit_grad]: 0.00049757 [symbol_engine_optimizer]: 8.463e-05, [1] [Cycle 1]: 7.868e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 1.32e-05 [elim_not_effective]: 1.529e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 1.126e-05 [renormalize]: 4.09986e-07 [validate]: 5.785e-05 Sums bootstrap : 0.000312s : 0.23% type_inference : 0.127978s : 94.07% event_method : 0.000024s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000595s : 0.44% rewriter_before_opt_a : 0.000102s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000827s : 0.61% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003216s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000802s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000035s : 0.03% loop_unroll : 0.000590s : 0.43% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000498s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000058s : 0.04% Time group info: ------[substitution.] 0.000298 24 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000007s : 4: substitution.graph_param_transform 85.25% : 0.000254s : 4: substitution.inline 1.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000006s : 4: substitution.remove_not_recompute_node 2.63% : 0.000008s : 2: substitution.replace_old_param 4.82% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127842 2 97.36% : 0.124470s : 1: type_inference.infer 2.64% : 0.003372s : 1: type_inference.specialize ------[replace.] 0.000085 6 69.09% : 0.000059s : 4: replace.inline 30.91% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 6 95.01% : 0.000252s : 4: match.inline 4.99% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 0.86% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.53% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 6.16% : 0.000009s : 26: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 18: predicate.load_eliminater 1.73% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.31% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000002s : 12: predicate.minmaximum_grad 2.87% : 0.000004s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 1.05% : 0.000002s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.23% : 0.000011s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002415 22 61.85% : 0.001494s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.54% : 0.000061s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.61% : 0.000860s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149260 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000082s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000330s : 1: bootstrap 0.03% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.73% : 0.013034s : 1: jit_opt_a 0.12% : 0.000184s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.40% : 0.000601s : 1: loop_unroll 0.55% : 0.000815s : 1: mutable_eliminate 0.74% : 0.001104s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000506s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000606s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.52% : 0.002265s : 1: renormalize.infer 0.63% : 0.000938s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.07% : 0.000108s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 85.76% : 0.128008s : 1: type_inference TotalTime = 0.229455, [30] [bootstrap]: 0.00037148 [type_inference]: 0.199364 [event_method]: 2.558e-05 [auto_monad]: 8.107e-05 [graph_reusing]: 6.71999e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00061271 [rewriter_before_opt_a]: 0.00010646 [expand_dump_flag]: 4.13001e-06 [jit_opt_a]: 0.0263106, [2] [Cycle 1]: 0.00516959, [27] [switch_simplify]: 7.48e-05 [loop_unroll]: 3.434e-05 [a_1]: 0.00083383 [with_stream_mark]: 2.448e-05 [recompute_prepare]: 8.81997e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.10998e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 2.41998e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 5.98998e-06 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 3.59002e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.97002e-06 [replace_old_param]: 1.188e-05 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00379105 [add_forward_monad_depend]: 9.92999e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.021e-05 [cse]: 3.675e-05 [replace_applicator]: 2.407e-05 [Cycle 2]: 0.00041463, [27] [switch_simplify]: 7.65e-06 [loop_unroll]: 6.46e-06 [a_1]: 0.00014826 [with_stream_mark]: 1.476e-05 [recompute_prepare]: 6.00002e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 6.00002e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 3.58999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.83002e-06 [inline_without_move]: 5.81e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.78e-06 [cse]: 1.453e-05 [replace_applicator]: 6.16998e-06 [py_interpret_to_execute_after_opt_a]: 1.844e-05 [rewriter_after_opt_a]: 3.952e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00080461 [jit_opt_b]: 6.623e-05, [1] [Cycle 1]: 5.741e-05, [2] [frontend_op_eliminate]: 2.39e-05 [inline_after_opt_a]: 2.097e-05 [cconv]: 2.958e-05 [loop_unroll]: 0.00046482 [jit_opt_after_cconv]: 0.0001644, [1] [Cycle 1]: 0.00015777, [11] [c_1]: 2.726e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 6.53e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.497e-05 [call_graph_tuple_transform]: 2.399e-05 [tuple_list_get_item_eliminator]: 6.61999e-06 [none_parameter_eliminate]: 1.92999e-06 [renormalize]: 7.60017e-07 [switch_simplify]: 7.64002e-06 [remove_dup_value]: 1.861e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 8.89998e-06 [add_recomputation]: 5.251e-05 [cse_after_recomputation]: 2.572e-05, [1] [Cycle 1]: 2.022e-05, [1] [cse]: 1.424e-05 [auto_monad_reorder]: 1.698e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.50002e-06 [opt_after_jit_grad]: 0.00049179 [symbol_engine_optimizer]: 8.158e-05, [1] [Cycle 1]: 7.512e-05, [6] [build]: 4.36002e-06 [elim_shapecalc]: 9.12001e-06 [elim_not_effective]: 1.389e-05 [opt_reshape]: 7.81001e-06 [fold_const_symbol]: 1.057e-05 [renormalize]: 5.19998e-07 [validate]: 5.389e-05 Sums bootstrap : 0.000371s : 0.18% type_inference : 0.199364s : 95.82% event_method : 0.000026s : 0.01% auto_monad : 0.000081s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000613s : 0.29% rewriter_before_opt_a : 0.000106s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000982s : 0.47% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003791s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000051s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000805s : 0.39% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000465s : 0.22% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000492s : 0.24% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.03% Time group info: ------[substitution.] 0.000376 28 0.53% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.66% : 0.000006s : 4: substitution.graph_param_transform 86.43% : 0.000325s : 5: substitution.inline 1.06% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.65% : 0.000014s : 3: substitution.reduce_eliminate 1.21% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000007s : 2: substitution.replace_old_param 3.03% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.199262 2 98.15% : 0.195575s : 1: type_inference.infer 1.85% : 0.003686s : 1: type_inference.specialize ------[replace.] 0.000118 7 70.20% : 0.000083s : 5: replace.inline 29.80% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000332 7 96.93% : 0.000322s : 5: match.inline 3.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 2.29% : 0.000004s : 13: predicate.arithmetic_simplify 1.16% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.39% : 0.000008s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 0.99% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.36% : 0.000004s : 13: predicate.reduce_eliminate 1.72% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.82% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.14% : 0.000002s : 4: predicate.row_tensor_eliminate 1.42% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.32% : 0.000011s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.92% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.57% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.98% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003062 25 59.71% : 0.001829s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.21% : 0.000129s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.08% : 0.001105s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.234564 72 0.02% : 0.000055s : 1: add_recomputation 0.04% : 0.000084s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.17% : 0.000394s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.22% : 0.026314s : 1: jit_opt_a 0.07% : 0.000167s : 1: jit_opt_after_cconv 0.03% : 0.000069s : 1: jit_opt_b 0.20% : 0.000474s : 1: loop_unroll 0.35% : 0.000816s : 1: mutable_eliminate 0.53% : 0.001252s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.21% : 0.000500s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000621s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.10% : 0.002576s : 1: renormalize.infer 0.51% : 0.001203s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000112s : 1: rewriter_before_opt_a 0.04% : 0.000084s : 1: symbol_engine_optimizer 85.00% : 0.199387s : 1: type_inference TotalTime = 0.0468551, [30] [bootstrap]: 0.00031022 [type_inference]: 0.0210258 [event_method]: 2.176e-05 [auto_monad]: 7.43e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00012867 [rewriter_before_opt_a]: 8.551e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.0228576, [2] [Cycle 1]: 0.0022367, [27] [switch_simplify]: 6.551e-05 [loop_unroll]: 2.995e-05 [a_1]: 0.0006027 [with_stream_mark]: 2.446e-05 [recompute_prepare]: 8.34002e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.60998e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.66998e-06 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 0.00115227 [add_forward_monad_depend]: 7.15998e-06 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 1.731e-05 [cse]: 3.756e-05 [replace_applicator]: 1.346e-05 [Cycle 2]: 0.00035889, [27] [switch_simplify]: 6.26998e-06 [loop_unroll]: 5.36998e-06 [a_1]: 9.443e-05 [with_stream_mark]: 1.126e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 9.19972e-07 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.83002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 1.33002e-06 [auto_monad_eliminator]: 6.77002e-06 [cse]: 1.603e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.514e-05 [rewriter_after_opt_a]: 4.104e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00065598 [jit_opt_b]: 4.958e-05, [1] [Cycle 1]: 4.188e-05, [2] [frontend_op_eliminate]: 1.538e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 2.864e-05 [loop_unroll]: 0.00041913 [jit_opt_after_cconv]: 0.0001804, [1] [Cycle 1]: 0.00017301, [11] [c_1]: 5.035e-05 [parameter_eliminate]: 3.01999e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.376e-05 [call_graph_tuple_transform]: 1.968e-05 [tuple_list_get_item_eliminator]: 5.34998e-06 [none_parameter_eliminate]: 1.27e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.18002e-06 [remove_dup_value]: 1.693e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 6.08998e-06 [add_recomputation]: 5.257e-05 [cse_after_recomputation]: 2.318e-05, [1] [Cycle 1]: 1.741e-05, [1] [cse]: 1.16e-05 [auto_monad_reorder]: 1.93e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.35001e-06 [opt_after_jit_grad]: 0.00050617 [symbol_engine_optimizer]: 7.354e-05, [1] [Cycle 1]: 6.717e-05, [6] [build]: 3.71001e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.10015e-07 [validate]: 4.038e-05 Sums bootstrap : 0.000310s : 1.19% type_inference : 0.021026s : 80.97% event_method : 0.000022s : 0.08% auto_monad : 0.000074s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000129s : 0.50% rewriter_before_opt_a : 0.000086s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.28% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000697s : 2.68% jit_opt_a.with_stream_mark : 0.000036s : 0.14% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001152s : 4.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000054s : 0.21% jit_opt_a.replace_applicator : 0.000019s : 0.07% py_interpret_to_execute_after_opt_a : 0.000015s : 0.06% rewriter_after_opt_a : 0.000041s : 0.16% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000656s : 2.53% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000419s : 1.61% jit_opt_after_cconv.c_1 : 0.000050s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000053s : 0.20% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000506s : 1.95% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.16% Time group info: ------[substitution.] 0.000255 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000005s : 3: substitution.graph_param_transform 85.42% : 0.000218s : 4: substitution.inline 1.83% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000006s : 2: substitution.replace_old_param 5.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020935 2 89.81% : 0.018803s : 1: type_inference.infer 10.19% : 0.002132s : 1: type_inference.specialize ------[replace.] 0.000076 6 70.18% : 0.000053s : 4: replace.inline 29.82% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 6 94.79% : 0.000216s : 4: match.inline 5.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 691 1.11% : 0.000002s : 10: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 0.91% : 0.000001s : 10: predicate.addn_zero_filter 1.75% : 0.000003s : 10: predicate.arithmetic_simplify 1.26% : 0.000002s : 10: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 0.88% : 0.000001s : 10: predicate.compare_switch_simplify 1.03% : 0.000001s : 10: predicate.depend_value_elim 0.92% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.00% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.98% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.02% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.33% : 0.000002s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 0.92% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 4.68% : 0.000007s : 22: predicate.inline 0.71% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.24% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.52% : 0.000002s : 15: predicate.load_eliminater 0.99% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 10: predicate.merge_addn 0.88% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 19.32% : 0.000028s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 1.26% : 0.000002s : 10: predicate.reduce_eliminate 1.20% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.46% : 0.000002s : 18: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 0.97% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.78% : 0.000001s : 6: predicate.specialize_transform 1.15% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.87% : 0.000003s : 16: predicate.switch_defer_inline 1.77% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.27% : 0.000009s : 53: predicate.switch_simplify 1.05% : 0.000002s : 10: predicate.tile_eliminate 1.02% : 0.000001s : 10: predicate.transpose_eliminate 1.30% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.04% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.23% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.20% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.37% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.37% : 0.000002s : 10: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000947 13 44.73% : 0.000424s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.12% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.14% : 0.000465s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049019 72 0.11% : 0.000055s : 1: add_recomputation 0.16% : 0.000078s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.67% : 0.000330s : 1: bootstrap 0.06% : 0.000031s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 46.64% : 0.022861s : 1: jit_opt_a 0.37% : 0.000183s : 1: jit_opt_after_cconv 0.11% : 0.000052s : 1: jit_opt_b 0.87% : 0.000427s : 1: loop_unroll 1.36% : 0.000666s : 1: mutable_eliminate 1.90% : 0.000932s : 26: opt.transform.jit_opt_a 0.16% : 0.000077s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000025s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.05% : 0.000515s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000132s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.38% : 0.000676s : 1: renormalize.infer 0.95% : 0.000467s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000044s : 1: rewriter_after_opt_a 0.18% : 0.000089s : 1: rewriter_before_opt_a 0.16% : 0.000076s : 1: symbol_engine_optimizer 42.94% : 0.021050s : 1: type_inference TotalTime = 0.135598, [30] [bootstrap]: 0.00031738 [type_inference]: 0.123577 [event_method]: 2.33e-05 [auto_monad]: 7.601e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.96001e-06 [py_interpret_to_execute]: 0.00055766 [rewriter_before_opt_a]: 0.00010357 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00844822, [2] [Cycle 1]: 0.00425858, [27] [switch_simplify]: 6.918e-05 [loop_unroll]: 3.458e-05 [a_1]: 0.00072224 [with_stream_mark]: 2.194e-05 [recompute_prepare]: 1.234e-05 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 8.22998e-06 [updatestate_useless_node_eliminater]: 6.57002e-06 [accelerated_algorithm]: 7.38999e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.776e-05 [j_node_and_user_rematch]: 1.052e-05 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.46999e-06 [renormalize]: 0.00292595 [add_forward_monad_depend]: 7.51001e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.838e-05 [cse]: 3.785e-05 [replace_applicator]: 2.277e-05 [Cycle 2]: 0.00040645, [27] [switch_simplify]: 7.2e-06 [loop_unroll]: 6.53e-06 [a_1]: 0.00014242 [with_stream_mark]: 1.379e-05 [recompute_prepare]: 6.09999e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 3.06999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.70002e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.388e-05 [replace_applicator]: 6.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.331e-05 [rewriter_after_opt_a]: 3.773e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00072746 [jit_opt_b]: 5.758e-05, [1] [Cycle 1]: 5.033e-05, [2] [frontend_op_eliminate]: 1.998e-05 [inline_after_opt_a]: 1.876e-05 [cconv]: 2.777e-05 [loop_unroll]: 0.00043822 [jit_opt_after_cconv]: 0.00016021, [1] [Cycle 1]: 0.00015384, [11] [c_1]: 2.611e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 6.34001e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 2.678e-05 [call_graph_tuple_transform]: 2.219e-05 [tuple_list_get_item_eliminator]: 6.25002e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 7.35e-06 [remove_dup_value]: 1.685e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 9.47001e-06 [add_recomputation]: 5.104e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.263e-05 [auto_monad_reorder]: 1.823e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 7.48999e-06 [opt_after_jit_grad]: 0.00046356 [symbol_engine_optimizer]: 7.826e-05, [1] [Cycle 1]: 7.203e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.358e-05 [opt_reshape]: 7.4e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 4.09986e-07 [validate]: 0.0001405 Sums bootstrap : 0.000317s : 0.24% type_inference : 0.123577s : 94.26% event_method : 0.000023s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000558s : 0.43% rewriter_before_opt_a : 0.000104s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000865s : 0.66% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002926s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000438s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000464s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000141s : 0.11% Time group info: ------[substitution.] 0.000280 28 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 81.29% : 0.000228s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.26% : 0.000015s : 3: substitution.reduce_eliminate 1.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.09% : 0.000006s : 2: substitution.replace_old_param 4.38% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123480 2 97.05% : 0.119839s : 1: type_inference.infer 2.95% : 0.003641s : 1: type_inference.specialize ------[replace.] 0.000109 7 67.86% : 0.000074s : 5: replace.inline 32.14% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000236 7 95.30% : 0.000225s : 5: match.inline 4.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.58% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.87% : 0.000003s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.80% : 0.000003s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.79% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000011s : 64: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.58% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.42% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002527 25 62.20% : 0.001572s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.33% : 0.000893s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139631 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000339s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.05% : 0.008451s : 1: jit_opt_a 0.12% : 0.000163s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.32% : 0.000446s : 1: loop_unroll 0.53% : 0.000736s : 1: mutable_eliminate 0.81% : 0.001133s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000567s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.47% : 0.002047s : 1: renormalize.infer 0.62% : 0.000867s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.52% : 0.123596s : 1: type_inference TotalTime = 0.0243454, [30] [bootstrap]: 0.00027805 [type_inference]: 0.0125816 [event_method]: 2.147e-05 [auto_monad]: 7.535e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 5.166e-05 [rewriter_before_opt_a]: 8.789e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00907372, [2] [Cycle 1]: 0.00197737, [27] [switch_simplify]: 5.811e-05 [loop_unroll]: 3.407e-05 [a_1]: 0.00067467 [with_stream_mark]: 1.823e-05 [recompute_prepare]: 8.33001e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 0.00086513 [add_forward_monad_depend]: 5.25999e-06 [auto_monad_grad]: 3.18998e-06 [auto_monad_eliminator]: 1.558e-05 [cse]: 3.297e-05 [replace_applicator]: 1.21e-05 [Cycle 2]: 0.00032929, [27] [switch_simplify]: 6.04999e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.069e-05 [with_stream_mark]: 1.022e-05 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 5.16998e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.41002e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.243e-05 [j_node_and_user_rematch]: 8.60001e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 5.49e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.481e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 1.335e-05 [rewriter_after_opt_a]: 3.87e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00057082 [jit_opt_b]: 5.213e-05, [1] [Cycle 1]: 4.575e-05, [2] [frontend_op_eliminate]: 1.811e-05 [inline_after_opt_a]: 1.583e-05 [cconv]: 2.667e-05 [loop_unroll]: 0.00041764 [jit_opt_after_cconv]: 0.00014585, [1] [Cycle 1]: 0.00013896, [11] [c_1]: 2.149e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.397e-05 [call_graph_tuple_transform]: 1.773e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 3.398e-05 [partial_unused_args_eliminate]: 2.51998e-06 [environ_conv]: 6.00002e-06 [add_recomputation]: 5.034e-05 [cse_after_recomputation]: 2.491e-05, [1] [Cycle 1]: 1.874e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.732e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00045084 [symbol_engine_optimizer]: 7.296e-05, [1] [Cycle 1]: 6.676e-05, [6] [build]: 3.39001e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.264e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 9.56e-06 [renormalize]: 3.30008e-07 [validate]: 3.76e-05 Sums bootstrap : 0.000278s : 1.64% type_inference : 0.012582s : 74.04% event_method : 0.000021s : 0.13% auto_monad : 0.000075s : 0.44% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000052s : 0.30% rewriter_before_opt_a : 0.000088s : 0.52% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000064s : 0.38% jit_opt_a.loop_unroll : 0.000039s : 0.23% jit_opt_a.a_1 : 0.000765s : 4.50% jit_opt_a.with_stream_mark : 0.000028s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000865s : 5.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.13% jit_opt_a.cse : 0.000048s : 0.28% jit_opt_a.replace_applicator : 0.000018s : 0.10% py_interpret_to_execute_after_opt_a : 0.000013s : 0.08% rewriter_after_opt_a : 0.000039s : 0.23% convert_after_rewriter : 0.000006s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000571s : 3.36% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.09% cconv : 0.000027s : 0.16% loop_unroll : 0.000418s : 2.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.14% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000034s : 0.20% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000050s : 0.30% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000017s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000451s : 2.65% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.22% Time group info: ------[substitution.] 0.000271 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 1.90% : 0.000005s : 3: substitution.graph_param_transform 88.21% : 0.000239s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.60% : 0.000004s : 4: substitution.remove_not_recompute_node 1.36% : 0.000004s : 2: substitution.replace_old_param 4.41% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012513 2 90.48% : 0.011321s : 1: type_inference.infer 9.52% : 0.001192s : 1: type_inference.specialize ------[replace.] 0.000107 7 67.87% : 0.000073s : 5: replace.inline 32.13% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 7 95.75% : 0.000236s : 5: match.inline 4.25% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 2.19% : 0.000003s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.20% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.43% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000006s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 16: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.77% : 0.000002s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.27% : 0.000002s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000974 16 53.64% : 0.000522s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.83% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.53% : 0.000365s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026259 72 0.20% : 0.000053s : 1: add_recomputation 0.30% : 0.000079s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.13% : 0.000297s : 1: bootstrap 0.11% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.10% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 34.57% : 0.009078s : 1: jit_opt_a 0.57% : 0.000149s : 1: jit_opt_after_cconv 0.21% : 0.000055s : 1: jit_opt_b 1.62% : 0.000425s : 1: loop_unroll 2.21% : 0.000579s : 1: mutable_eliminate 3.77% : 0.000989s : 26: opt.transform.jit_opt_a 0.18% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.08% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.75% : 0.000460s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000055s : 1: py_interpret_to_execute 0.06% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000048s : 1: remove_dup_value 1.87% : 0.000490s : 1: renormalize.infer 1.40% : 0.000367s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000042s : 1: rewriter_after_opt_a 0.35% : 0.000091s : 1: rewriter_before_opt_a 0.29% : 0.000075s : 1: symbol_engine_optimizer 47.96% : 0.012594s : 1: type_inference TotalTime = 0.0431254, [30] [bootstrap]: 0.00039873 [type_inference]: 0.0347162 [event_method]: 1.883e-05 [auto_monad]: 6.835e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00010387 [rewriter_before_opt_a]: 8.406e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.0055385, [2] [Cycle 1]: 0.00207089, [27] [switch_simplify]: 5.784e-05 [loop_unroll]: 0.00023272 [a_1]: 0.00054292 [with_stream_mark]: 1.976e-05 [recompute_prepare]: 7.58001e-06 [updatestate_depend_eliminate]: 3.63999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.69001e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 8.60999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00088042 [add_forward_monad_depend]: 5.84e-06 [auto_monad_grad]: 3.16001e-06 [auto_monad_eliminator]: 1.546e-05 [cse]: 3.181e-05 [replace_applicator]: 1.25e-05 [Cycle 2]: 0.00032457, [27] [switch_simplify]: 5.86003e-06 [loop_unroll]: 5.19e-06 [a_1]: 8.844e-05 [with_stream_mark]: 9.44998e-06 [recompute_prepare]: 5.29998e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 2.90002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 7.92e-06 [inline_without_move]: 5.35001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.249e-05 [replace_applicator]: 5.70001e-06 [py_interpret_to_execute_after_opt_a]: 1.221e-05 [rewriter_after_opt_a]: 3.581e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.51998e-06 [mutable_eliminate]: 0.00054724 [jit_opt_b]: 4.964e-05, [1] [Cycle 1]: 4.269e-05, [2] [frontend_op_eliminate]: 1.59e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.647e-05 [loop_unroll]: 0.00043437 [jit_opt_after_cconv]: 0.00014777, [1] [Cycle 1]: 0.00014133, [11] [c_1]: 2.113e-05 [parameter_eliminate]: 3.22002e-06 [updatestate_depend_eliminate]: 7.06999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.503e-05 [call_graph_tuple_transform]: 1.875e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.616e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 6.57002e-06 [add_recomputation]: 4.998e-05 [cse_after_recomputation]: 2.682e-05, [1] [Cycle 1]: 2.056e-05, [1] [cse]: 1.405e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 2.36998e-06 [rewriter_after_jit_bprop_graph]: 5.47001e-06 [opt_after_jit_grad]: 0.00048282 [symbol_engine_optimizer]: 7.47e-05, [1] [Cycle 1]: 6.841e-05, [6] [build]: 3.25998e-06 [elim_shapecalc]: 7.77998e-06 [elim_not_effective]: 1.402e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 9.38002e-06 [renormalize]: 5.69999e-07 [validate]: 3.9e-05 Sums bootstrap : 0.000399s : 1.01% type_inference : 0.034716s : 88.15% event_method : 0.000019s : 0.05% auto_monad : 0.000068s : 0.17% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000104s : 0.26% rewriter_before_opt_a : 0.000084s : 0.21% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.16% jit_opt_a.loop_unroll : 0.000238s : 0.60% jit_opt_a.a_1 : 0.000631s : 1.60% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000880s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.06% jit_opt_a.cse : 0.000044s : 0.11% jit_opt_a.replace_applicator : 0.000018s : 0.05% py_interpret_to_execute_after_opt_a : 0.000012s : 0.03% rewriter_after_opt_a : 0.000036s : 0.09% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000547s : 1.39% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000026s : 0.07% loop_unroll : 0.000434s : 1.10% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000050s : 0.13% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000483s : 1.23% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.10% Time group info: ------[substitution.] 0.000206 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000005s : 3: substitution.graph_param_transform 84.87% : 0.000175s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000004s : 4: substitution.remove_not_recompute_node 1.99% : 0.000004s : 2: substitution.replace_old_param 5.70% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.034643 2 95.94% : 0.033237s : 1: type_inference.infer 4.06% : 0.001406s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.16% : 0.000044s : 4: replace.inline 32.84% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 94.15% : 0.000173s : 4: match.inline 5.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.52% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.40% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.67% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.99% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.84% : 0.000006s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.89% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000754 13 45.01% : 0.000339s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.67% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.32% : 0.000372s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045113 72 0.16% : 0.000073s : 1: add_recomputation 0.16% : 0.000072s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.91% : 0.000412s : 1: bootstrap 0.06% : 0.000029s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 12.28% : 0.005541s : 1: jit_opt_a 0.33% : 0.000150s : 1: jit_opt_after_cconv 0.12% : 0.000052s : 1: jit_opt_b 0.98% : 0.000443s : 1: loop_unroll 1.23% : 0.000557s : 1: mutable_eliminate 2.32% : 0.001048s : 26: opt.transform.jit_opt_a 0.11% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.09% : 0.000492s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000108s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000019s : 1: remove_dup_value 1.16% : 0.000524s : 1: renormalize.infer 0.77% : 0.000349s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000039s : 1: rewriter_after_opt_a 0.20% : 0.000088s : 1: rewriter_before_opt_a 0.17% : 0.000077s : 1: symbol_engine_optimizer 76.99% : 0.034732s : 1: type_inference TotalTime = 0.1474, [30] [bootstrap]: 0.00035191 [type_inference]: 0.120552 [event_method]: 2.026e-05 [auto_monad]: 7.251e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 0.00027334 [rewriter_before_opt_a]: 8.602e-05 [expand_dump_flag]: 3.71999e-06 [jit_opt_a]: 0.00707018, [2] [Cycle 1]: 0.00307756, [27] [switch_simplify]: 5.991e-05 [loop_unroll]: 3.208e-05 [a_1]: 0.00069062 [with_stream_mark]: 2.446e-05 [recompute_prepare]: 9.60001e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.75998e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 6.46e-06 [renormalize]: 0.00190532 [add_forward_monad_depend]: 7.02002e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.637e-05 [cse]: 3.212e-05 [replace_applicator]: 1.767e-05 [Cycle 2]: 0.0003696, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012277 [with_stream_mark]: 1.129e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 3.32002e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.38002e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 2.19001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 8.68001e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.63998e-06 [cse]: 1.092e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.372e-05 [rewriter_after_opt_a]: 3.792e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00062036 [jit_opt_b]: 5.688e-05, [1] [Cycle 1]: 4.948e-05, [2] [frontend_op_eliminate]: 1.955e-05 [inline_after_opt_a]: 1.788e-05 [cconv]: 0.0161378 [loop_unroll]: 0.00080725 [jit_opt_after_cconv]: 0.00019819, [1] [Cycle 1]: 0.00018762, [11] [c_1]: 3.098e-05 [parameter_eliminate]: 5.04e-06 [updatestate_depend_eliminate]: 8.74e-06 [updatestate_assign_eliminate]: 4.63999e-06 [updatestate_loads_eliminate]: 2.89001e-06 [cse]: 3.962e-05 [call_graph_tuple_transform]: 2.58e-05 [tuple_list_get_item_eliminator]: 8.87e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 6.96001e-06 [remove_dup_value]: 1.8e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 1.001e-05 [add_recomputation]: 5.501e-05 [cse_after_recomputation]: 2.543e-05, [1] [Cycle 1]: 1.907e-05, [1] [cse]: 1.316e-05 [auto_monad_reorder]: 1.63e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 9.91998e-06 [opt_after_jit_grad]: 0.00054523 [symbol_engine_optimizer]: 0.00011917, [1] [Cycle 1]: 0.00011213, [6] [build]: 4.58999e-06 [elim_shapecalc]: 9.86e-06 [elim_not_effective]: 4.902e-05 [opt_reshape]: 7.56001e-06 [fold_const_symbol]: 1.123e-05 [renormalize]: 5.09986e-07 [validate]: 4.96e-05 Sums bootstrap : 0.000352s : 0.25% type_inference : 0.120552s : 84.23% event_method : 0.000020s : 0.01% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000273s : 0.19% rewriter_before_opt_a : 0.000086s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000813s : 0.57% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001905s : 1.33% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000043s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000620s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.016138s : 11.28% loop_unroll : 0.000807s : 0.56% jit_opt_after_cconv.c_1 : 0.000031s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000545s : 0.38% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000049s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000337 24 10.86% : 0.000037s : 2: substitution.elim_not_effective 0.45% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000007s : 4: substitution.graph_param_transform 78.31% : 0.000264s : 4: substitution.inline 1.45% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.55% : 0.000005s : 4: substitution.remove_not_recompute_node 1.43% : 0.000005s : 2: substitution.replace_old_param 3.84% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120467 2 98.47% : 0.118620s : 1: type_inference.infer 1.53% : 0.001847s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.77% : 0.000054s : 4: replace.inline 32.23% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 6 95.68% : 0.000261s : 4: match.inline 4.32% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.17% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.16% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 6.03% : 0.000008s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 18: predicate.load_eliminater 1.91% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.54% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.018147 22 96.61% : 0.017532s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.29% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 3.10% : 0.000562s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.150480 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000076s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000370s : 1: bootstrap 10.74% : 0.016161s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 4.70% : 0.007073s : 1: jit_opt_a 0.13% : 0.000202s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.54% : 0.000820s : 1: loop_unroll 0.42% : 0.000629s : 1: mutable_eliminate 0.70% : 0.001058s : 26: opt.transform.jit_opt_a 0.05% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000025s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000073s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000555s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000281s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.84% : 0.001259s : 1: renormalize.infer 0.42% : 0.000636s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.06% : 0.000091s : 1: rewriter_before_opt_a 0.08% : 0.000122s : 1: symbol_engine_optimizer 80.12% : 0.120571s : 1: type_inference TotalTime = 0.036896, [30] [bootstrap]: 0.00041238 [type_inference]: 0.00994022 [event_method]: 2.34e-05 [auto_monad]: 7.373e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 5.465e-05 [rewriter_before_opt_a]: 8.311e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00696371, [2] [Cycle 1]: 0.00239041, [27] [switch_simplify]: 7.33e-05 [loop_unroll]: 3.413e-05 [a_1]: 0.00073873 [with_stream_mark]: 2.638e-05 [recompute_prepare]: 8.95001e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 5.40999e-06 [renormalize]: 0.00111292 [add_forward_monad_depend]: 7.26001e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.995e-05 [cse]: 4.086e-05 [replace_applicator]: 1.65e-05 [Cycle 2]: 0.00035587, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00010792 [with_stream_mark]: 1.246e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 6.08002e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 3.15002e-06 [cell_reuse_recompute_pass]: 2.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 8.25999e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 8.12998e-06 [inline_without_move]: 4.96997e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 5.86003e-06 [cse]: 1.413e-05 [replace_applicator]: 5.27999e-06 [py_interpret_to_execute_after_opt_a]: 1.583e-05 [rewriter_after_opt_a]: 4.139e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00082299 [jit_opt_b]: 5.745e-05, [1] [Cycle 1]: 4.876e-05, [2] [frontend_op_eliminate]: 1.83e-05 [inline_after_opt_a]: 1.749e-05 [cconv]: 3.168e-05 [loop_unroll]: 0.0169459 [jit_opt_after_cconv]: 0.00026646, [1] [Cycle 1]: 0.0002554, [11] [c_1]: 2.982e-05 [parameter_eliminate]: 8.24002e-06 [updatestate_depend_eliminate]: 1.426e-05 [updatestate_assign_eliminate]: 3.86999e-06 [updatestate_loads_eliminate]: 3.47997e-06 [cse]: 5.117e-05 [call_graph_tuple_transform]: 2.951e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 1.22e-06 [switch_simplify]: 5.73002e-06 [remove_dup_value]: 2.013e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 8.96002e-06 [add_recomputation]: 6.179e-05 [cse_after_recomputation]: 2.643e-05, [1] [Cycle 1]: 1.992e-05, [1] [cse]: 1.336e-05 [auto_monad_reorder]: 1.933e-05 [get_jit_bprop_graph]: 2.83e-06 [rewriter_after_jit_bprop_graph]: 1.115e-05 [opt_after_jit_grad]: 0.0006165 [symbol_engine_optimizer]: 8.365e-05, [1] [Cycle 1]: 7.667e-05, [6] [build]: 5.39e-06 [elim_shapecalc]: 9.66e-06 [elim_not_effective]: 1.61e-05 [opt_reshape]: 7.01999e-06 [fold_const_symbol]: 9.76998e-06 [renormalize]: 5.3001e-07 [validate]: 5.103e-05 Sums bootstrap : 0.000412s : 1.29% type_inference : 0.009940s : 31.13% event_method : 0.000023s : 0.07% auto_monad : 0.000074s : 0.23% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000055s : 0.17% rewriter_before_opt_a : 0.000083s : 0.26% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000080s : 0.25% jit_opt_a.loop_unroll : 0.000040s : 0.13% jit_opt_a.a_1 : 0.000847s : 2.65% jit_opt_a.with_stream_mark : 0.000039s : 0.12% jit_opt_a.recompute_prepare : 0.000015s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000010s : 0.03% jit_opt_a.renormalize : 0.001113s : 3.49% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.08% jit_opt_a.cse : 0.000055s : 0.17% jit_opt_a.replace_applicator : 0.000022s : 0.07% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000041s : 0.13% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000823s : 2.58% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.05% cconv : 0.000032s : 0.10% loop_unroll : 0.016946s : 53.08% jit_opt_after_cconv.c_1 : 0.000030s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000008s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000051s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000020s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000009s : 0.03% add_recomputation : 0.000062s : 0.19% cse_after_recomputation.cse : 0.000013s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.03% opt_after_jit_grad : 0.000617s : 1.93% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.16% Time group info: ------[substitution.] 0.000329 27 0.80% : 0.000003s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000007s : 3: substitution.graph_param_transform 85.12% : 0.000280s : 5: substitution.inline 1.18% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.64% : 0.000012s : 3: substitution.reduce_eliminate 1.47% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000006s : 2: substitution.replace_old_param 3.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009850 2 87.73% : 0.008642s : 1: type_inference.infer 12.27% : 0.001208s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.23% : 0.000072s : 5: replace.inline 31.77% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000287 7 96.33% : 0.000276s : 5: match.inline 3.67% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.17% : 0.000002s : 11: predicate.addn_zero_filter 2.13% : 0.000003s : 11: predicate.arithmetic_simplify 1.15% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 11: predicate.compare_switch_simplify 1.17% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 11: predicate.environ_get_depend_swap 1.16% : 0.000002s : 11: predicate.environ_get_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000002s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.25% : 0.000009s : 24: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 16: predicate.load_eliminater 4.02% : 0.000006s : 3: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 11: predicate.merge_addn 1.26% : 0.000002s : 11: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 16: predicate.partial_eliminate 0.97% : 0.000001s : 11: predicate.print_const_string_wrapper 2.31% : 0.000003s : 11: predicate.reduce_eliminate 1.66% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 19: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000001s : 3: predicate.reset_defer_inline 1.16% : 0.000002s : 11: predicate.reshape_eliminate 1.43% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 6: predicate.special_op_eliminate 0.79% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001014 16 48.52% : 0.000492s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.43% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.05% : 0.000427s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.039191 72 0.17% : 0.000065s : 1: add_recomputation 0.20% : 0.000077s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.11% : 0.000433s : 1: bootstrap 0.09% : 0.000034s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000011s : 1: environ_conv 0.07% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 17.78% : 0.006969s : 1: jit_opt_a 0.69% : 0.000272s : 1: jit_opt_after_cconv 0.15% : 0.000060s : 1: jit_opt_b 43.30% : 0.016969s : 1: loop_unroll 2.13% : 0.000835s : 1: mutable_eliminate 2.79% : 0.001092s : 26: opt.transform.jit_opt_a 0.17% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000029s : 4: opt.transform.jit_opt_b 0.11% : 0.000041s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000020s : 1: opt.transform.mutable_eliminate 0.07% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000039s : 4: opt.transform.symbol_engine_opt 1.60% : 0.000626s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000057s : 1: py_interpret_to_execute 0.05% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000023s : 1: remove_dup_value 1.66% : 0.000650s : 1: renormalize.infer 1.16% : 0.000453s : 1: renormalize.specialize 0.03% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000045s : 1: rewriter_after_opt_a 0.22% : 0.000086s : 1: rewriter_before_opt_a 0.22% : 0.000086s : 1: symbol_engine_optimizer 25.43% : 0.009966s : 1: type_inference TotalTime = 0.0261745, [30] [bootstrap]: 0.00026155 [type_inference]: 0.0134445 [event_method]: 2.083e-05 [auto_monad]: 7.237e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 5.924e-05 [rewriter_before_opt_a]: 9.284e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00999621, [2] [Cycle 1]: 0.00617199, [27] [switch_simplify]: 6.406e-05 [loop_unroll]: 3.452e-05 [a_1]: 0.00065637 [with_stream_mark]: 1.966e-05 [recompute_prepare]: 8.20999e-06 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 3.76001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 8.97999e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.0050121 [add_forward_monad_depend]: 8.92999e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.039e-05 [cse]: 4.262e-05 [replace_applicator]: 2.137e-05 [Cycle 2]: 0.00036576, [27] [switch_simplify]: 7.28999e-06 [loop_unroll]: 5.46e-06 [a_1]: 0.00010281 [with_stream_mark]: 1.42e-05 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 2.83e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.823e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 3.19001e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.579e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 1.427e-05 [rewriter_after_opt_a]: 4.133e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00057327 [jit_opt_b]: 5.108e-05, [1] [Cycle 1]: 4.411e-05, [2] [frontend_op_eliminate]: 1.669e-05 [inline_after_opt_a]: 1.624e-05 [cconv]: 2.671e-05 [loop_unroll]: 0.00042524 [jit_opt_after_cconv]: 0.00014814, [1] [Cycle 1]: 0.00014072, [11] [c_1]: 2.079e-05 [parameter_eliminate]: 1.60999e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.787e-05 [call_graph_tuple_transform]: 1.811e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.89999e-06 [remove_dup_value]: 3.025e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 5.82999e-06 [add_recomputation]: 5.45e-05 [cse_after_recomputation]: 2.55e-05, [1] [Cycle 1]: 1.954e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 3.696e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 5.80002e-06 [opt_after_jit_grad]: 0.00046824 [symbol_engine_optimizer]: 7.586e-05, [1] [Cycle 1]: 6.92e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.221e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 5.60016e-07 [validate]: 3.979e-05 Sums bootstrap : 0.000262s : 1.18% type_inference : 0.013445s : 60.79% event_method : 0.000021s : 0.09% auto_monad : 0.000072s : 0.33% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000059s : 0.27% rewriter_before_opt_a : 0.000093s : 0.42% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000071s : 0.32% jit_opt_a.loop_unroll : 0.000040s : 0.18% jit_opt_a.a_1 : 0.000759s : 3.43% jit_opt_a.with_stream_mark : 0.000034s : 0.15% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.09% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.005012s : 22.66% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.12% jit_opt_a.cse : 0.000058s : 0.26% jit_opt_a.replace_applicator : 0.000027s : 0.12% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000041s : 0.19% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000573s : 2.59% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000027s : 0.12% loop_unroll : 0.000425s : 1.92% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000028s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000030s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000054s : 0.25% cse_after_recomputation.cse : 0.000013s : 0.06% auto_monad_reorder : 0.000037s : 0.17% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000468s : 2.12% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.18% Time group info: ------[substitution.] 0.000257 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000005s : 3: substitution.graph_param_transform 85.75% : 0.000221s : 5: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000006s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013377 2 89.78% : 0.012009s : 1: type_inference.infer 10.22% : 0.001368s : 1: type_inference.specialize ------[replace.] 0.000103 7 66.85% : 0.000069s : 5: replace.inline 33.15% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 94.81% : 0.000218s : 5: match.inline 5.19% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.22% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 11: predicate.addn_check_dump 1.43% : 0.000002s : 11: predicate.addn_zero_filter 2.01% : 0.000003s : 11: predicate.arithmetic_simplify 1.19% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.78% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.31% : 0.000002s : 11: predicate.environ_get_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.02% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.76% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.35% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 16: predicate.partial_eliminate 1.42% : 0.000002s : 11: predicate.print_const_string_wrapper 1.91% : 0.000002s : 11: predicate.reduce_eliminate 1.37% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 2.07% : 0.000003s : 19: predicate.replace_applicator 0.95% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.17% : 0.000001s : 11: predicate.transpose_eliminate 1.61% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.95% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001063 16 47.43% : 0.000504s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.76% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.81% : 0.000487s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032237 72 0.18% : 0.000058s : 1: add_recomputation 0.24% : 0.000076s : 1: auto_monad 0.12% : 0.000040s : 1: auto_monad_reorder 0.87% : 0.000279s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.09% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 31.02% : 0.010000s : 1: jit_opt_a 0.47% : 0.000151s : 1: jit_opt_after_cconv 0.17% : 0.000054s : 1: jit_opt_b 1.34% : 0.000431s : 1: loop_unroll 1.80% : 0.000581s : 1: mutable_eliminate 3.12% : 0.001005s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.03% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000012s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.48% : 0.000477s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000062s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000033s : 1: remove_dup_value 13.85% : 0.004465s : 1: renormalize.infer 1.66% : 0.000535s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.30% : 0.000096s : 1: rewriter_before_opt_a 0.24% : 0.000079s : 1: symbol_engine_optimizer 41.75% : 0.013460s : 1: type_inference TotalTime = 0.0367394, [30] [bootstrap]: 0.0002922 [type_inference]: 0.0263133 [event_method]: 1.965e-05 [auto_monad]: 6.676e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.11998e-06 [py_interpret_to_execute]: 0.00011251 [rewriter_before_opt_a]: 7.82e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00668613, [2] [Cycle 1]: 0.00181457, [27] [switch_simplify]: 6.455e-05 [loop_unroll]: 3.02e-05 [a_1]: 0.00053089 [with_stream_mark]: 1.439e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.24001e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.262e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00088326 [add_forward_monad_depend]: 4.68999e-06 [auto_monad_grad]: 2.06e-06 [auto_monad_eliminator]: 1.148e-05 [cse]: 1.997e-05 [replace_applicator]: 1.068e-05 [Cycle 2]: 0.00036191, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 5.30001e-06 [a_1]: 8.932e-05 [with_stream_mark]: 1.004e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 2.63998e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 1.16997e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.16e-05 [j_node_and_user_rematch]: 8.03001e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.389e-05 [replace_applicator]: 5.49e-06 [py_interpret_to_execute_after_opt_a]: 1.223e-05 [rewriter_after_opt_a]: 3.255e-05 [convert_after_rewriter]: 6.33e-06 [order_py_execute_after_rewriter]: 6.79001e-06 [mutable_eliminate]: 0.00051843 [jit_opt_b]: 4.823e-05, [1] [Cycle 1]: 4.263e-05, [2] [frontend_op_eliminate]: 1.58e-05 [inline_after_opt_a]: 1.578e-05 [cconv]: 2.132e-05 [loop_unroll]: 0.00148485 [jit_opt_after_cconv]: 0.00015224, [1] [Cycle 1]: 0.0001454, [11] [c_1]: 2.218e-05 [parameter_eliminate]: 3.20998e-06 [updatestate_depend_eliminate]: 6.41e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.668e-05 [call_graph_tuple_transform]: 1.897e-05 [tuple_list_get_item_eliminator]: 5.31998e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.41998e-06 [remove_dup_value]: 1.498e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 6.53e-06 [add_recomputation]: 4.461e-05 [cse_after_recomputation]: 2.529e-05, [1] [Cycle 1]: 1.941e-05, [1] [cse]: 1.352e-05 [auto_monad_reorder]: 1.55e-05 [get_jit_bprop_graph]: 1.66e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.0004608 [symbol_engine_optimizer]: 7.084e-05, [1] [Cycle 1]: 6.492e-05, [6] [build]: 2.74001e-06 [elim_shapecalc]: 7.80998e-06 [elim_not_effective]: 1.243e-05 [opt_reshape]: 6.00002e-06 [fold_const_symbol]: 8.59e-06 [renormalize]: 3.10014e-07 [validate]: 3.763e-05 Sums bootstrap : 0.000292s : 0.92% type_inference : 0.026313s : 83.23% event_method : 0.000020s : 0.06% auto_monad : 0.000067s : 0.21% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000113s : 0.36% rewriter_before_opt_a : 0.000078s : 0.25% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.22% jit_opt_a.loop_unroll : 0.000036s : 0.11% jit_opt_a.a_1 : 0.000620s : 1.96% jit_opt_a.with_stream_mark : 0.000024s : 0.08% jit_opt_a.recompute_prepare : 0.000013s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.05% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.000883s : 2.79% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.06% jit_opt_a.cse : 0.000034s : 0.11% jit_opt_a.replace_applicator : 0.000016s : 0.05% py_interpret_to_execute_after_opt_a : 0.000012s : 0.04% rewriter_after_opt_a : 0.000033s : 0.10% convert_after_rewriter : 0.000006s : 0.02% order_py_execute_after_rewriter : 0.000007s : 0.02% mutable_eliminate : 0.000518s : 1.64% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000021s : 0.07% loop_unroll : 0.001485s : 4.70% jit_opt_after_cconv.c_1 : 0.000022s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000045s : 0.14% cse_after_recomputation.cse : 0.000014s : 0.04% auto_monad_reorder : 0.000016s : 0.05% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000461s : 1.46% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.12% Time group info: ------[substitution.] 0.000199 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.02% : 0.000004s : 3: substitution.graph_param_transform 84.66% : 0.000169s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000004s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 6.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.026246 2 94.24% : 0.024733s : 1: type_inference.infer 5.76% : 0.001513s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.02% : 0.000048s : 4: replace.inline 31.98% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.62% : 0.000166s : 4: match.inline 6.38% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.75% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.30% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.22% : 0.000006s : 22: predicate.inline 1.18% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 2.60% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000002s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.53% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000008s : 53: predicate.switch_simplify 1.40% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000745 13 46.87% : 0.000349s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.79% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.33% : 0.000360s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.038532 72 0.12% : 0.000048s : 1: add_recomputation 0.18% : 0.000070s : 1: auto_monad 0.05% : 0.000018s : 1: auto_monad_reorder 0.79% : 0.000306s : 1: bootstrap 0.06% : 0.000024s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.06% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 17.36% : 0.006690s : 1: jit_opt_a 0.47% : 0.000182s : 1: jit_opt_after_cconv 0.13% : 0.000051s : 1: jit_opt_b 3.88% : 0.001497s : 1: loop_unroll 1.36% : 0.000525s : 1: mutable_eliminate 2.19% : 0.000845s : 26: opt.transform.jit_opt_a 0.13% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000012s : 1: opt.transform.mutable_eliminate 0.05% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.21% : 0.000468s : 1: opt_after_jit_grad 0.02% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000116s : 1: py_interpret_to_execute 0.04% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.36% : 0.000523s : 1: renormalize.infer 0.92% : 0.000353s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000035s : 1: rewriter_after_opt_a 0.21% : 0.000082s : 1: rewriter_before_opt_a 0.19% : 0.000073s : 1: symbol_engine_optimizer 68.33% : 0.026328s : 1: type_inference TotalTime = 0.0136477, [30] [bootstrap]: 0.00028684 [type_inference]: 0.00485506 [event_method]: 1.813e-05 [auto_monad]: 7.053e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 3.767e-05 [rewriter_before_opt_a]: 7.449e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00597744, [2] [Cycle 1]: 0.00191719, [27] [switch_simplify]: 6.22e-05 [loop_unroll]: 3.294e-05 [a_1]: 0.00057779 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 9.17999e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.57002e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 8.32998e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 1.071e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.72999e-06 [renormalize]: 0.000846 [add_forward_monad_depend]: 7.36001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.649e-05 [cse]: 3.26e-05 [replace_applicator]: 1.462e-05 [Cycle 2]: 0.00033905, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.58002e-06 [a_1]: 9.378e-05 [with_stream_mark]: 1.034e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 5.53002e-06 [updatestate_useless_node_eliminater]: 5.14003e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 8.31002e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 7.77998e-06 [inline_without_move]: 5.24998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.39998e-06 [cse]: 1.151e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.308e-05 [rewriter_after_opt_a]: 3.803e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00064061 [jit_opt_b]: 5.354e-05, [1] [Cycle 1]: 4.554e-05, [2] [frontend_op_eliminate]: 1.727e-05 [inline_after_opt_a]: 1.568e-05 [cconv]: 2.656e-05 [loop_unroll]: 0.00044228 [jit_opt_after_cconv]: 0.0001564, [1] [Cycle 1]: 0.00014984, [11] [c_1]: 2.21e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.383e-05 [call_graph_tuple_transform]: 2.122e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 3.665e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 5.539e-05 [cse_after_recomputation]: 2.324e-05, [1] [Cycle 1]: 1.741e-05, [1] [cse]: 1.125e-05 [auto_monad_reorder]: 1.631e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 6.49001e-06 [opt_after_jit_grad]: 0.00048825 [symbol_engine_optimizer]: 7.813e-05, [1] [Cycle 1]: 7.187e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 8.03999e-06 [elim_not_effective]: 1.45e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 9.07999e-06 [renormalize]: 3.69997e-07 [validate]: 4.231e-05 Sums bootstrap : 0.000287s : 3.08% type_inference : 0.004855s : 52.18% event_method : 0.000018s : 0.19% auto_monad : 0.000071s : 0.76% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000038s : 0.40% rewriter_before_opt_a : 0.000074s : 0.80% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000068s : 0.73% jit_opt_a.loop_unroll : 0.000039s : 0.41% jit_opt_a.a_1 : 0.000672s : 7.22% jit_opt_a.with_stream_mark : 0.000032s : 0.34% jit_opt_a.recompute_prepare : 0.000015s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000014s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.12% jit_opt_a.accelerated_algorithm : 0.000012s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000846s : 9.09% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000044s : 0.47% jit_opt_a.replace_applicator : 0.000020s : 0.21% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000038s : 0.41% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000641s : 6.88% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000027s : 0.29% loop_unroll : 0.000442s : 4.75% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000037s : 0.39% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000055s : 0.60% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000488s : 5.25% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.45% Time group info: ------[substitution.] 0.000234 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 83.91% : 0.000197s : 4: substitution.inline 1.81% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 5.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004791 2 82.26% : 0.003942s : 1: type_inference.infer 17.74% : 0.000850s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.47% : 0.000050s : 4: replace.inline 33.53% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.34% : 0.000194s : 4: match.inline 5.66% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 2.07% : 0.000003s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.37% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.52% : 0.000002s : 10: predicate.reduce_eliminate 1.64% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.45% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.52% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000677 13 51.93% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.12% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.95% : 0.000277s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015461 72 0.38% : 0.000058s : 1: add_recomputation 0.48% : 0.000074s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 1.98% : 0.000306s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.69% : 0.005981s : 1: jit_opt_a 1.03% : 0.000159s : 1: jit_opt_after_cconv 0.36% : 0.000056s : 1: jit_opt_b 2.91% : 0.000450s : 1: loop_unroll 4.21% : 0.000651s : 1: mutable_eliminate 5.87% : 0.000908s : 26: opt.transform.jit_opt_a 0.33% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.21% : 0.000497s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000041s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.25% : 0.000039s : 1: remove_dup_value 3.08% : 0.000476s : 1: renormalize.infer 2.33% : 0.000360s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000041s : 1: rewriter_after_opt_a 0.50% : 0.000077s : 1: rewriter_before_opt_a 0.52% : 0.000081s : 1: symbol_engine_optimizer 31.50% : 0.004871s : 1: type_inference TotalTime = 0.125305, [30] [bootstrap]: 0.00031818 [type_inference]: 0.113902 [event_method]: 2.446e-05 [auto_monad]: 7.352e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 0.00045074 [rewriter_before_opt_a]: 9.609e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00789825, [2] [Cycle 1]: 0.00423717, [27] [switch_simplify]: 6.337e-05 [loop_unroll]: 3.43e-05 [a_1]: 0.00073803 [with_stream_mark]: 2.323e-05 [recompute_prepare]: 1.076e-05 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.53003e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.829e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 3.11001e-06 [replace_old_param]: 1.244e-05 [inline_without_move]: 6.99001e-06 [renormalize]: 0.00297827 [add_forward_monad_depend]: 7.36001e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.747e-05 [cse]: 3.6e-05 [replace_applicator]: 2.113e-05 [Cycle 2]: 0.00039154, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.66e-06 [a_1]: 0.00013487 [with_stream_mark]: 1.134e-05 [recompute_prepare]: 6.12001e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 2.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.02999e-06 [cse]: 1.471e-05 [replace_applicator]: 6.10002e-06 [py_interpret_to_execute_after_opt_a]: 1.445e-05 [rewriter_after_opt_a]: 3.866e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00068497 [jit_opt_b]: 5.763e-05, [1] [Cycle 1]: 5e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.752e-05 [cconv]: 2.756e-05 [loop_unroll]: 0.00046602 [jit_opt_after_cconv]: 0.00016403, [1] [Cycle 1]: 0.0001572, [11] [c_1]: 2.806e-05 [parameter_eliminate]: 3.40003e-06 [updatestate_depend_eliminate]: 7.23e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 3.43e-06 [cse]: 2.501e-05 [call_graph_tuple_transform]: 2.137e-05 [tuple_list_get_item_eliminator]: 7.68001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.18998e-06 [remove_dup_value]: 1.709e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 9.39e-06 [add_recomputation]: 5.23e-05 [cse_after_recomputation]: 2.752e-05, [1] [Cycle 1]: 2.214e-05, [1] [cse]: 1.578e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.59998e-06 [opt_after_jit_grad]: 0.00048994 [symbol_engine_optimizer]: 0.00018962, [1] [Cycle 1]: 0.00018262, [6] [build]: 3.53e-06 [elim_shapecalc]: 1.061e-05 [elim_not_effective]: 1.531e-05 [opt_reshape]: 7.13998e-06 [fold_const_symbol]: 0.00011494 [renormalize]: 4.19997e-07 [validate]: 5.171e-05 Sums bootstrap : 0.000318s : 0.26% type_inference : 0.113902s : 93.83% event_method : 0.000024s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000451s : 0.37% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000873s : 0.72% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002978s : 2.45% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000685s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000466s : 0.38% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000490s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000115s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000299 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 4: substitution.graph_param_transform 83.01% : 0.000249s : 5: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.33% : 0.000013s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000006s : 2: substitution.replace_old_param 4.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113818 2 97.43% : 0.110894s : 1: type_inference.infer 2.57% : 0.002923s : 1: type_inference.specialize ------[replace.] 0.000109 7 68.02% : 0.000074s : 5: replace.inline 31.98% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 95.69% : 0.000245s : 5: match.inline 4.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.59% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.65% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000007s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.06% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.86% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002562 25 63.77% : 0.001634s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.13% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.10% : 0.000848s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129586 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000337s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.10% : 0.007902s : 1: jit_opt_a 0.13% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.37% : 0.000476s : 1: loop_unroll 0.54% : 0.000694s : 1: mutable_eliminate 0.87% : 0.001131s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000143s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.62% : 0.002103s : 1: renormalize.infer 0.67% : 0.000865s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.15% : 0.000193s : 1: symbol_engine_optimizer 87.91% : 0.113922s : 1: type_inference TotalTime = 0.137291, [30] [bootstrap]: 0.00046563 [type_inference]: 0.12401 [event_method]: 2.537e-05 [auto_monad]: 7.884e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 0.00057906 [rewriter_before_opt_a]: 0.00011384 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.00931446, [2] [Cycle 1]: 0.00486532, [27] [switch_simplify]: 7.015e-05 [loop_unroll]: 3.391e-05 [a_1]: 0.00080468 [with_stream_mark]: 2.441e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.70998e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 7.03998e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.58998e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 1.116e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.147e-05 [inline_without_move]: 6.66e-06 [renormalize]: 0.00353071 [add_forward_monad_depend]: 8.91002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.879e-05 [cse]: 3.776e-05 [replace_applicator]: 2.306e-05 [Cycle 2]: 0.00042853, [27] [switch_simplify]: 7.98001e-06 [loop_unroll]: 6.55002e-06 [a_1]: 0.00015293 [with_stream_mark]: 1.583e-05 [recompute_prepare]: 6.89999e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 6.79999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 3.30998e-06 [cell_reuse_recompute_pass]: 4.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 9.48002e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.99999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 6.75998e-06 [cse]: 1.558e-05 [replace_applicator]: 6.49001e-06 [py_interpret_to_execute_after_opt_a]: 1.561e-05 [rewriter_after_opt_a]: 4.293e-05 [convert_after_rewriter]: 7.36001e-06 [order_py_execute_after_rewriter]: 5.63002e-06 [mutable_eliminate]: 0.00083742 [jit_opt_b]: 6.393e-05, [1] [Cycle 1]: 5.572e-05, [2] [frontend_op_eliminate]: 2.256e-05 [inline_after_opt_a]: 2.077e-05 [cconv]: 3.423e-05 [loop_unroll]: 0.00050685 [jit_opt_after_cconv]: 0.00017322, [1] [Cycle 1]: 0.00016588, [11] [c_1]: 2.793e-05 [parameter_eliminate]: 3.23998e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 3.02002e-06 [cse]: 3.037e-05 [call_graph_tuple_transform]: 2.321e-05 [tuple_list_get_item_eliminator]: 7.38e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 9.12001e-06 [add_recomputation]: 5.383e-05 [cse_after_recomputation]: 2.61e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.395e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 6.79001e-06 [opt_after_jit_grad]: 0.00049392 [symbol_engine_optimizer]: 8.091e-05, [1] [Cycle 1]: 7.469e-05, [6] [build]: 4.25e-06 [elim_shapecalc]: 9.19998e-06 [elim_not_effective]: 1.526e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 3.7998e-07 [validate]: 7.871e-05 Sums bootstrap : 0.000466s : 0.35% type_inference : 0.124010s : 93.52% event_method : 0.000025s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000579s : 0.44% rewriter_before_opt_a : 0.000114s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000958s : 0.72% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003531s : 2.66% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000837s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000507s : 0.38% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000494s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000079s : 0.06% Time group info: ------[substitution.] 0.000354 28 0.51% : 0.000002s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 1.75% : 0.000006s : 4: substitution.graph_param_transform 85.70% : 0.000303s : 5: substitution.inline 1.12% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000015s : 3: substitution.reduce_eliminate 1.54% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000006s : 2: substitution.replace_old_param 3.22% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123900 2 97.00% : 0.120180s : 1: type_inference.infer 3.00% : 0.003720s : 1: type_inference.specialize ------[replace.] 0.000114 7 69.48% : 0.000079s : 5: replace.inline 30.52% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000310 7 96.76% : 0.000300s : 5: match.inline 3.24% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.32% : 0.000004s : 13: predicate.arithmetic_simplify 1.67% : 0.000003s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.70% : 0.000003s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.97% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000008s : 28: predicate.inline 1.03% : 0.000002s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.65% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.32% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 2.18% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.49% : 0.000004s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002873 25 61.72% : 0.001773s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.28% : 0.000123s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.00% : 0.000977s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142089 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.34% : 0.000486s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.56% : 0.009318s : 1: jit_opt_a 0.12% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000067s : 1: jit_opt_b 0.36% : 0.000517s : 1: loop_unroll 0.60% : 0.000848s : 1: mutable_eliminate 0.86% : 0.001226s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000586s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.77% : 0.002509s : 1: renormalize.infer 0.71% : 0.001009s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000119s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 87.30% : 0.124038s : 1: type_inference TotalTime = 0.0140293, [30] [bootstrap]: 0.00029195 [type_inference]: 0.00546709 [event_method]: 2.034e-05 [auto_monad]: 7.087e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 4.505e-05 [rewriter_before_opt_a]: 7.718e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00575899, [2] [Cycle 1]: 0.00191035, [27] [switch_simplify]: 6.68e-05 [loop_unroll]: 3.19e-05 [a_1]: 0.00058484 [with_stream_mark]: 2.178e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00086215 [add_forward_monad_depend]: 7.35e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.684e-05 [cse]: 3.045e-05 [replace_applicator]: 1.516e-05 [Cycle 2]: 0.00032552, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.60001e-06 [a_1]: 9.079e-05 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 4.89998e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 4.74e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 4.50999e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 8.03001e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.44002e-06 [inline_without_move]: 4.67e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.71998e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.70002e-06 [cse]: 1.21e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.209e-05 [rewriter_after_opt_a]: 3.77e-05 [convert_after_rewriter]: 7.73001e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00062119 [jit_opt_b]: 4.942e-05, [1] [Cycle 1]: 4.24e-05, [2] [frontend_op_eliminate]: 1.511e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 2.779e-05 [loop_unroll]: 0.00043099 [jit_opt_after_cconv]: 0.00014778, [1] [Cycle 1]: 0.00014111, [11] [c_1]: 2.223e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 6.53e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.216e-05 [call_graph_tuple_transform]: 1.967e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.628e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5e-05 [cse_after_recomputation]: 3.902e-05, [1] [Cycle 1]: 1.953e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.847e-05 [get_jit_bprop_graph]: 1.91003e-06 [rewriter_after_jit_bprop_graph]: 5.67999e-06 [opt_after_jit_grad]: 0.00047813 [symbol_engine_optimizer]: 7.556e-05, [1] [Cycle 1]: 6.898e-05, [6] [build]: 4e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 6.30002e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 8.49977e-07 [validate]: 4.256e-05 Sums bootstrap : 0.000292s : 2.96% type_inference : 0.005467s : 55.39% event_method : 0.000020s : 0.21% auto_monad : 0.000071s : 0.72% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.46% rewriter_before_opt_a : 0.000077s : 0.78% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000073s : 0.74% jit_opt_a.loop_unroll : 0.000037s : 0.38% jit_opt_a.a_1 : 0.000676s : 6.85% jit_opt_a.with_stream_mark : 0.000032s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000862s : 8.74% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.24% jit_opt_a.cse : 0.000043s : 0.43% jit_opt_a.replace_applicator : 0.000020s : 0.21% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000038s : 0.38% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000621s : 6.29% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000028s : 0.28% loop_unroll : 0.000431s : 4.37% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000050s : 0.51% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000018s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000478s : 4.84% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000043s : 0.43% Time group info: ------[substitution.] 0.000244 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 3: substitution.graph_param_transform 85.31% : 0.000208s : 4: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005395 2 79.15% : 0.004270s : 1: type_inference.infer 20.85% : 0.001125s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.54% : 0.000053s : 4: replace.inline 32.46% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 94.92% : 0.000205s : 4: match.inline 5.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.10% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.60% : 0.000001s : 3: predicate.graph_param_transform 6.24% : 0.000007s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.28% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.72% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.08% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.44% : 0.000010s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000831 13 45.73% : 0.000380s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.01% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.25% : 0.000401s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015842 72 0.34% : 0.000053s : 1: add_recomputation 0.47% : 0.000074s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 1.94% : 0.000307s : 1: bootstrap 0.19% : 0.000030s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.26% : 0.000041s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.37% : 0.005763s : 1: jit_opt_a 0.95% : 0.000151s : 1: jit_opt_after_cconv 0.33% : 0.000052s : 1: jit_opt_b 3.00% : 0.000475s : 1: loop_unroll 3.97% : 0.000629s : 1: mutable_eliminate 5.71% : 0.000904s : 26: opt.transform.jit_opt_a 0.31% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.07% : 0.000486s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 3.00% : 0.000476s : 1: renormalize.infer 2.39% : 0.000379s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000040s : 1: rewriter_after_opt_a 0.50% : 0.000080s : 1: rewriter_before_opt_a 0.49% : 0.000078s : 1: symbol_engine_optimizer 34.61% : 0.005484s : 1: type_inference TotalTime = 0.0559251, [30] [bootstrap]: 0.0003868 [type_inference]: 0.0387596 [event_method]: 2.219e-05 [auto_monad]: 7.646e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.0001228 [rewriter_before_opt_a]: 8.311e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.0140959, [2] [Cycle 1]: 0.0101088, [27] [switch_simplify]: 6.103e-05 [loop_unroll]: 2.965e-05 [a_1]: 0.00054167 [with_stream_mark]: 1.969e-05 [recompute_prepare]: 8.1e-06 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 5.98002e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 0.00909454 [add_forward_monad_depend]: 7.60998e-06 [auto_monad_grad]: 1.86e-06 [auto_monad_eliminator]: 1.63e-05 [cse]: 2.669e-05 [replace_applicator]: 1.786e-05 [Cycle 2]: 0.00034047, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00010246 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.31998e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.41002e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.259e-05 [j_node_and_user_rematch]: 8.61002e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.287e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.543e-05 [rewriter_after_opt_a]: 3.118e-05 [convert_after_rewriter]: 6.19999e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00070959 [jit_opt_b]: 5.283e-05, [1] [Cycle 1]: 4.558e-05, [2] [frontend_op_eliminate]: 1.714e-05 [inline_after_opt_a]: 1.754e-05 [cconv]: 2.192e-05 [loop_unroll]: 0.00045122 [jit_opt_after_cconv]: 0.0001494, [1] [Cycle 1]: 0.00014285, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 5.87999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.65e-05 [call_graph_tuple_transform]: 1.839e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.14998e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 5.58002e-06 [remove_dup_value]: 1.129e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 5.08002e-06 [add_recomputation]: 3.964e-05 [cse_after_recomputation]: 3.968e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.301e-05 [auto_monad_reorder]: 1.315e-05 [get_jit_bprop_graph]: 1.74998e-06 [rewriter_after_jit_bprop_graph]: 7.5e-06 [opt_after_jit_grad]: 0.00049242 [symbol_engine_optimizer]: 7.33e-05, [1] [Cycle 1]: 6.728e-05, [6] [build]: 2.84999e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 6.06998e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 6.00005e-07 [validate]: 3.611e-05 Sums bootstrap : 0.000387s : 0.75% type_inference : 0.038760s : 75.07% event_method : 0.000022s : 0.04% auto_monad : 0.000076s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000123s : 0.24% rewriter_before_opt_a : 0.000083s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.13% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000644s : 1.25% jit_opt_a.with_stream_mark : 0.000032s : 0.06% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.009095s : 17.61% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000040s : 0.08% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000031s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000710s : 1.37% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000022s : 0.04% loop_unroll : 0.000451s : 0.87% jit_opt_after_cconv.c_1 : 0.000021s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000040s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000492s : 0.95% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.07% Time group info: ------[substitution.] 0.000193 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000004s : 3: substitution.graph_param_transform 83.12% : 0.000160s : 4: substitution.inline 1.81% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000004s : 2: substitution.replace_old_param 6.52% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038670 2 94.91% : 0.036701s : 1: type_inference.infer 5.09% : 0.001969s : 1: type_inference.specialize ------[replace.] 0.000070 6 65.04% : 0.000045s : 4: replace.inline 34.96% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.27% : 0.000158s : 4: match.inline 6.73% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.64% : 0.000002s : 10: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 2.40% : 0.000003s : 10: predicate.arithmetic_simplify 1.89% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.16% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.24% : 0.000003s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.25% : 0.000002s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 2.02% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000001s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.54% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.53% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.008951 13 4.65% : 0.000416s : 6: func_graph_cloner_run.FuncGraphClonerGraph 0.34% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 95.02% : 0.008505s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065949 72 0.06% : 0.000043s : 1: add_recomputation 0.12% : 0.000080s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.62% : 0.000412s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000043s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 21.38% : 0.014100s : 1: jit_opt_a 0.23% : 0.000152s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.70% : 0.000460s : 1: loop_unroll 1.09% : 0.000720s : 1: mutable_eliminate 1.32% : 0.000873s : 26: opt.transform.jit_opt_a 0.07% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000501s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000127s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 0.83% : 0.000550s : 1: renormalize.infer 12.94% : 0.008535s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000034s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000076s : 1: symbol_engine_optimizer 58.81% : 0.038783s : 1: type_inference TotalTime = 0.0199417, [30] [bootstrap]: 0.00036516 [type_inference]: 0.0102391 [event_method]: 2.116e-05 [auto_monad]: 7.533e-05 [graph_reusing]: 6.91999e-06 [pre_auto_parallel]: 2.93003e-06 [py_interpret_to_execute]: 4.667e-05 [rewriter_before_opt_a]: 8.204e-05 [expand_dump_flag]: 3.95e-06 [jit_opt_a]: 0.00678831, [2] [Cycle 1]: 0.00204809, [27] [switch_simplify]: 6.437e-05 [loop_unroll]: 3.302e-05 [a_1]: 0.00072446 [with_stream_mark]: 2.424e-05 [recompute_prepare]: 9.51e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.74001e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.455e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00081332 [add_forward_monad_depend]: 8.42e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.759e-05 [replace_applicator]: 1.618e-05 [Cycle 2]: 0.0003542, [27] [switch_simplify]: 6.57002e-06 [loop_unroll]: 5.20999e-06 [a_1]: 9.781e-05 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 5.67001e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 5.48002e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.86003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.574e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.422e-05 [rewriter_after_opt_a]: 3.992e-05 [convert_after_rewriter]: 7.24001e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00063774 [jit_opt_b]: 6.21e-05, [1] [Cycle 1]: 4.318e-05, [2] [frontend_op_eliminate]: 1.592e-05 [inline_after_opt_a]: 1.636e-05 [cconv]: 3.015e-05 [loop_unroll]: 0.00044016 [jit_opt_after_cconv]: 0.00015696, [1] [Cycle 1]: 0.00014967, [11] [c_1]: 2.032e-05 [parameter_eliminate]: 3.55e-06 [updatestate_depend_eliminate]: 7.01999e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 2.796e-05 [call_graph_tuple_transform]: 1.91e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 5.63002e-06 [remove_dup_value]: 1.73e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 6.99001e-06 [add_recomputation]: 5.148e-05 [cse_after_recomputation]: 2.555e-05, [1] [Cycle 1]: 1.963e-05, [1] [cse]: 1.336e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00049109 [symbol_engine_optimizer]: 7.684e-05, [1] [Cycle 1]: 7.017e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 9.04e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 5.71998e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 5.29981e-07 [validate]: 4.385e-05 Sums bootstrap : 0.000365s : 2.45% type_inference : 0.010239s : 68.68% event_method : 0.000021s : 0.14% auto_monad : 0.000075s : 0.51% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.31% rewriter_before_opt_a : 0.000082s : 0.55% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000071s : 0.48% jit_opt_a.loop_unroll : 0.000038s : 0.26% jit_opt_a.a_1 : 0.000822s : 5.52% jit_opt_a.with_stream_mark : 0.000036s : 0.24% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000813s : 5.46% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000053s : 0.36% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000040s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000638s : 4.28% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000030s : 0.20% loop_unroll : 0.000440s : 2.95% jit_opt_after_cconv.c_1 : 0.000020s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000051s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000491s : 3.29% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.29% Time group info: ------[substitution.] 0.000289 27 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000006s : 3: substitution.graph_param_transform 83.54% : 0.000241s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000012s : 3: substitution.reduce_eliminate 1.48% : 0.000004s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 4.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010158 2 89.00% : 0.009041s : 1: type_inference.infer 11.00% : 0.001117s : 1: type_inference.specialize ------[replace.] 0.000094 7 67.16% : 0.000063s : 5: replace.inline 32.84% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 7 95.68% : 0.000238s : 5: match.inline 4.32% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 747 0.91% : 0.000002s : 11: predicate.accumulaten_eliminater 0.87% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.78% : 0.000001s : 11: predicate.addn_check_dump 0.91% : 0.000002s : 11: predicate.addn_zero_filter 1.67% : 0.000003s : 11: predicate.arithmetic_simplify 1.01% : 0.000002s : 11: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 0.80% : 0.000001s : 11: predicate.compare_switch_simplify 0.95% : 0.000002s : 11: predicate.depend_value_elim 0.84% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 0.88% : 0.000002s : 11: predicate.dict_get_item_eliminator 0.84% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.84% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.81% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.79% : 0.000001s : 11: predicate.environ_get_depend_swap 1.01% : 0.000002s : 11: predicate.environ_get_eliminate 0.84% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.77% : 0.000001s : 6: predicate.get_grad_eliminate 0.17% : 0.000000s : 3: predicate.graph_param_transform 4.36% : 0.000008s : 24: predicate.inline 0.58% : 0.000001s : 6: predicate.inline_without_move 0.27% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 6: predicate.less_batch_normalization 1.07% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.24% : 0.000002s : 16: predicate.load_eliminater 0.89% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.25% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.31% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.79% : 0.000001s : 11: predicate.merge_addn 0.85% : 0.000001s : 11: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.31% : 0.000001s : 3: predicate.opt_reshape 1.67% : 0.000003s : 16: predicate.partial_eliminate 0.87% : 0.000002s : 11: predicate.print_const_string_wrapper 1.46% : 0.000003s : 11: predicate.reduce_eliminate 0.98% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000003s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.23% : 0.000000s : 3: predicate.reset_defer_inline 0.92% : 0.000002s : 11: predicate.reshape_eliminate 1.05% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.51% : 0.000001s : 3: predicate.row_tensor_eliminate 0.84% : 0.000001s : 11: predicate.same_eliminate 0.40% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.67% : 0.000001s : 6: predicate.special_op_eliminate 0.67% : 0.000001s : 6: predicate.specialize_transform 26.76% : 0.000046s : 11: predicate.split_environ_get_set_with_tuple_value 0.98% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.29% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.77% : 0.000003s : 18: predicate.switch_defer_inline 1.63% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.05% : 0.000010s : 59: predicate.switch_simplify 1.05% : 0.000002s : 11: predicate.tile_eliminate 0.88% : 0.000002s : 11: predicate.transpose_eliminate 1.03% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 0.94% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 2.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.05% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.19% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 1.98% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.18% : 0.000002s : 11: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000862 16 47.87% : 0.000413s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.34% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.79% : 0.000369s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021868 72 0.25% : 0.000054s : 1: add_recomputation 0.36% : 0.000079s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.74% : 0.000380s : 1: bootstrap 0.15% : 0.000033s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 31.06% : 0.006793s : 1: jit_opt_a 0.73% : 0.000160s : 1: jit_opt_after_cconv 0.30% : 0.000065s : 1: jit_opt_b 2.05% : 0.000448s : 1: loop_unroll 2.96% : 0.000647s : 1: mutable_eliminate 4.83% : 0.001057s : 26: opt.transform.jit_opt_a 0.22% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.29% : 0.000501s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000049s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000020s : 1: remove_dup_value 2.06% : 0.000450s : 1: renormalize.infer 1.62% : 0.000354s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000044s : 1: rewriter_after_opt_a 0.39% : 0.000085s : 1: rewriter_before_opt_a 0.36% : 0.000079s : 1: symbol_engine_optimizer 46.90% : 0.010256s : 1: type_inference TotalTime = 0.19506, [30] [bootstrap]: 0.00027904 [type_inference]: 0.158475 [event_method]: 2.752e-05 [auto_monad]: 8.169e-05 [graph_reusing]: 6.49001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.0119704 [rewriter_before_opt_a]: 0.00017081 [expand_dump_flag]: 7.81001e-06 [jit_opt_a]: 0.0211513, [2] [Cycle 1]: 0.0151608, [27] [switch_simplify]: 0.00111374 [loop_unroll]: 4.045e-05 [a_1]: 0.00082594 [with_stream_mark]: 2.654e-05 [recompute_prepare]: 9.81998e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.51999e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 6.96999e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.668e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 6.53998e-06 [renormalize]: 0.0126895 [add_forward_monad_depend]: 1.489e-05 [auto_monad_grad]: 3.35e-06 [auto_monad_eliminator]: 2.707e-05 [cse]: 4.628e-05 [replace_applicator]: 3.08e-05 [Cycle 2]: 0.00045276, [27] [switch_simplify]: 8.3e-06 [loop_unroll]: 7.02002e-06 [a_1]: 0.00014598 [with_stream_mark]: 1.749e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 5.26998e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 6.64001e-06 [accelerated_algorithm]: 7.26999e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 7.29001e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.291e-05 [j_node_and_user_rematch]: 1.194e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.182e-05 [inline_without_move]: 7.41001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.96e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 8.77999e-06 [cse]: 1.699e-05 [replace_applicator]: 6.83998e-06 [py_interpret_to_execute_after_opt_a]: 2.207e-05 [rewriter_after_opt_a]: 4.744e-05 [convert_after_rewriter]: 7.21001e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00082675 [jit_opt_b]: 8.409e-05, [1] [Cycle 1]: 7.648e-05, [2] [frontend_op_eliminate]: 4.246e-05 [inline_after_opt_a]: 2.084e-05 [cconv]: 3.166e-05 [loop_unroll]: 0.00051505 [jit_opt_after_cconv]: 0.00017447, [1] [Cycle 1]: 0.00016807, [11] [c_1]: 2.777e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 8.15999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 3.027e-05 [call_graph_tuple_transform]: 2.474e-05 [tuple_list_get_item_eliminator]: 6.91001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 7.01001e-06 [remove_dup_value]: 2.175e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 1.03e-05 [add_recomputation]: 5.873e-05 [cse_after_recomputation]: 2.906e-05, [1] [Cycle 1]: 2.333e-05, [1] [cse]: 1.679e-05 [auto_monad_reorder]: 1.828e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 9.22999e-06 [opt_after_jit_grad]: 0.00051754 [symbol_engine_optimizer]: 9.245e-05, [1] [Cycle 1]: 8.61e-05, [6] [build]: 4.52e-06 [elim_shapecalc]: 9.54999e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 1.07e-05 [fold_const_symbol]: 1.364e-05 [renormalize]: 3.9002e-07 [validate]: 0.00018241 Sums bootstrap : 0.000279s : 0.15% type_inference : 0.158475s : 83.94% event_method : 0.000028s : 0.01% auto_monad : 0.000082s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.011970s : 6.34% rewriter_before_opt_a : 0.000171s : 0.09% expand_dump_flag : 0.000008s : 0.00% jit_opt_a.switch_simplify : 0.001122s : 0.59% jit_opt_a.loop_unroll : 0.000047s : 0.03% jit_opt_a.a_1 : 0.000972s : 0.51% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.012690s : 6.72% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.02% jit_opt_a.cse : 0.000063s : 0.03% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000047s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000827s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000042s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000515s : 0.27% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000059s : 0.03% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000518s : 0.27% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000182s : 0.10% Time group info: ------[substitution.] 0.000355 25 0.55% : 0.000002s : 2: substitution.elim_not_effective 1.34% : 0.000005s : 2: substitution.fold_const_symbol 1.89% : 0.000007s : 4: substitution.graph_param_transform 86.72% : 0.000308s : 5: substitution.inline 1.38% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000007s : 4: substitution.remove_not_recompute_node 2.20% : 0.000008s : 2: substitution.replace_old_param 4.02% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.158380 2 97.48% : 0.154384s : 1: type_inference.infer 2.52% : 0.003996s : 1: type_inference.specialize ------[replace.] 0.000131 7 67.45% : 0.000088s : 5: replace.inline 32.55% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000318 7 95.88% : 0.000305s : 5: match.inline 4.12% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000510 886 0.47% : 0.000002s : 13: predicate.accumulaten_eliminater 0.34% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.32% : 0.000002s : 13: predicate.addn_check_dump 0.53% : 0.000003s : 13: predicate.addn_zero_filter 0.62% : 0.000003s : 13: predicate.arithmetic_simplify 0.43% : 0.000002s : 13: predicate.cast_eliminate 0.13% : 0.000001s : 4: predicate.check_bprop_eliminate 0.33% : 0.000002s : 13: predicate.compare_switch_simplify 0.34% : 0.000002s : 13: predicate.depend_value_elim 0.36% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.36% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.27% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.12% : 0.000001s : 4: predicate.elim_not_effective 0.18% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.32% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.30% : 0.000002s : 13: predicate.environ_get_depend_swap 0.35% : 0.000002s : 13: predicate.environ_get_eliminate 0.38% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.09% : 0.000000s : 4: predicate.fold_const_symbol 0.41% : 0.000002s : 8: predicate.get_grad_eliminate 0.08% : 0.000000s : 4: predicate.graph_param_transform 1.82% : 0.000009s : 28: predicate.inline 0.26% : 0.000001s : 8: predicate.inline_without_move 0.14% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.36% : 0.000002s : 8: predicate.less_batch_normalization 0.50% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 0.58% : 0.000003s : 19: predicate.load_eliminater 0.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 1.23% : 0.000006s : 40: predicate.loop_unroll_before_grad 0.59% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.32% : 0.000002s : 13: predicate.merge_addn 0.34% : 0.000002s : 13: predicate.minmaximum_grad 0.37% : 0.000002s : 4: predicate.mutable_eliminate 0.20% : 0.000001s : 4: predicate.opt_reshape 0.72% : 0.000004s : 19: predicate.partial_eliminate 0.36% : 0.000002s : 13: predicate.print_const_string_wrapper 0.69% : 0.000004s : 13: predicate.reduce_eliminate 0.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.18% : 0.000001s : 8: predicate.remove_not_recompute_node 0.65% : 0.000003s : 23: predicate.replace_applicator 0.16% : 0.000001s : 8: predicate.replace_old_param 0.12% : 0.000001s : 4: predicate.reset_defer_inline 0.45% : 0.000002s : 13: predicate.reshape_eliminate 0.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.21% : 0.000001s : 4: predicate.row_tensor_eliminate 0.35% : 0.000002s : 13: predicate.same_eliminate 0.20% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.31% : 0.000002s : 8: predicate.special_op_eliminate 0.27% : 0.000001s : 8: predicate.specialize_transform 0.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.17% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.75% : 0.000004s : 20: predicate.switch_defer_inline 0.63% : 0.000003s : 20: predicate.switch_layer_defer_inline 71.70% : 0.000366s : 64: predicate.switch_simplify 0.43% : 0.000002s : 13: predicate.tile_eliminate 0.39% : 0.000002s : 13: predicate.transpose_eliminate 0.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 1.25% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 0.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 0.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.49% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 0.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 0.49% : 0.000003s : 13: predicate.value_based_eliminate 0.10% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.16% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003632 25 51.63% : 0.001875s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.61% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.76% : 0.001662s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.209445 72 0.03% : 0.000062s : 1: add_recomputation 0.04% : 0.000086s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.14% : 0.000292s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.01% : 0.000011s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 10.10% : 0.021155s : 1: jit_opt_a 0.08% : 0.000177s : 1: jit_opt_after_cconv 0.04% : 0.000087s : 1: jit_opt_b 0.25% : 0.000525s : 1: loop_unroll 0.40% : 0.000837s : 1: mutable_eliminate 0.83% : 0.001743s : 26: opt.transform.jit_opt_a 0.03% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000057s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000526s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 5.73% : 0.011997s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 5.18% : 0.010847s : 1: renormalize.infer 0.87% : 0.001821s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000050s : 1: rewriter_after_opt_a 0.09% : 0.000178s : 1: rewriter_before_opt_a 0.05% : 0.000095s : 1: symbol_engine_optimizer 75.68% : 0.158500s : 1: type_inference TotalTime = 0.110291, [30] [bootstrap]: 0.00034971 [type_inference]: 0.0980763 [event_method]: 0.00041627 [auto_monad]: 0.0001377 [graph_reusing]: 9.00001e-06 [pre_auto_parallel]: 3.12002e-06 [py_interpret_to_execute]: 4.464e-05 [rewriter_before_opt_a]: 0.00014475 [expand_dump_flag]: 3.87002e-06 [jit_opt_a]: 0.0083588, [2] [Cycle 1]: 0.00429969, [27] [switch_simplify]: 0.00020254 [loop_unroll]: 6.23e-05 [a_1]: 0.00141609 [with_stream_mark]: 2.378e-05 [recompute_prepare]: 8.64998e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 1.61998e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.496e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 5.79999e-06 [renormalize]: 0.00221118 [add_forward_monad_depend]: 6.86999e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.959e-05 [cse]: 3.659e-05 [replace_applicator]: 1.867e-05 [Cycle 2]: 0.00034762, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.72001e-06 [a_1]: 9.741e-05 [with_stream_mark]: 1.412e-05 [recompute_prepare]: 5.31998e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.21002e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.96002e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 3.04999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 7.25e-06 [inline_without_move]: 5.09998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.368e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.491e-05 [rewriter_after_opt_a]: 3.874e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00077591 [jit_opt_b]: 5.353e-05, [1] [Cycle 1]: 4.546e-05, [2] [frontend_op_eliminate]: 1.707e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.743e-05 [loop_unroll]: 0.00073161 [jit_opt_after_cconv]: 0.00015124, [1] [Cycle 1]: 0.00014426, [11] [c_1]: 2.186e-05 [parameter_eliminate]: 2.87002e-06 [updatestate_depend_eliminate]: 6.64999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.454e-05 [call_graph_tuple_transform]: 2.016e-05 [tuple_list_get_item_eliminator]: 5.21998e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.47001e-06 [remove_dup_value]: 1.702e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 5.82999e-06 [add_recomputation]: 5.206e-05 [cse_after_recomputation]: 2.232e-05, [1] [Cycle 1]: 1.73e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.746e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 6.07001e-06 [opt_after_jit_grad]: 0.0004507 [symbol_engine_optimizer]: 7.217e-05, [1] [Cycle 1]: 6.582e-05, [6] [build]: 3.50998e-06 [elim_shapecalc]: 7.48e-06 [elim_not_effective]: 1.23e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 3.60014e-07 [validate]: 8.558e-05 Sums bootstrap : 0.000350s : 0.33% type_inference : 0.098076s : 92.58% event_method : 0.000416s : 0.39% auto_monad : 0.000138s : 0.13% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000045s : 0.04% rewriter_before_opt_a : 0.000145s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000209s : 0.20% jit_opt_a.loop_unroll : 0.000068s : 0.06% jit_opt_a.a_1 : 0.001513s : 1.43% jit_opt_a.with_stream_mark : 0.000038s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000011s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002211s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000050s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000776s : 0.73% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000732s : 0.69% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000451s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000086s : 0.08% Time group info: ------[substitution.] 0.000607 35 0.30% : 0.000002s : 2: substitution.elim_not_effective 0.28% : 0.000002s : 2: substitution.fold_const_symbol 1.03% : 0.000006s : 3: substitution.graph_param_transform 90.14% : 0.000547s : 12: substitution.inline 0.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.78% : 0.000005s : 4: substitution.remove_not_recompute_node 0.85% : 0.000005s : 2: substitution.replace_old_param 1.61% : 0.000010s : 1: substitution.reshape_eliminate 2.41% : 0.000015s : 3: substitution.switch_simplify 1.86% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.096784 2 96.96% : 0.093840s : 1: type_inference.infer 3.04% : 0.002944s : 1: type_inference.specialize ------[replace.] 0.000297 18 51.81% : 0.000154s : 12: replace.inline 1.53% : 0.000005s : 1: replace.reshape_eliminate 21.75% : 0.000065s : 3: replace.switch_simplify 24.92% : 0.000074s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000572 18 94.61% : 0.000541s : 12: match.inline 1.55% : 0.000009s : 1: match.reshape_eliminate 2.08% : 0.000012s : 3: match.switch_simplify 1.76% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000199 1212 1.32% : 0.000003s : 19: predicate.accumulaten_eliminater 0.61% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.28% : 0.000003s : 19: predicate.addn_check_dump 1.73% : 0.000003s : 19: predicate.addn_zero_filter 2.05% : 0.000004s : 19: predicate.arithmetic_simplify 1.55% : 0.000003s : 20: predicate.cast_eliminate 0.26% : 0.000001s : 3: predicate.check_bprop_eliminate 1.27% : 0.000003s : 19: predicate.compare_switch_simplify 1.32% : 0.000003s : 19: predicate.depend_value_elim 1.40% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.33% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.39% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.61% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.21% : 0.000000s : 3: predicate.elim_not_effective 0.29% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.46% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.29% : 0.000003s : 20: predicate.environ_get_depend_swap 1.70% : 0.000003s : 20: predicate.environ_get_eliminate 1.51% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.61% : 0.000001s : 6: predicate.get_grad_eliminate 0.17% : 0.000000s : 3: predicate.graph_param_transform 5.33% : 0.000011s : 40: predicate.inline 0.56% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.81% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.85% : 0.000004s : 25: predicate.load_eliminater 1.12% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.89% : 0.000010s : 64: predicate.loop_unroll_before_grad 1.78% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.28% : 0.000003s : 19: predicate.merge_addn 1.27% : 0.000003s : 19: predicate.minmaximum_grad 0.99% : 0.000002s : 3: predicate.mutable_eliminate 0.26% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000004s : 25: predicate.partial_eliminate 1.31% : 0.000003s : 19: predicate.print_const_string_wrapper 1.76% : 0.000003s : 19: predicate.reduce_eliminate 1.56% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.55% : 0.000003s : 28: predicate.replace_applicator 0.33% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000001s : 3: predicate.reset_defer_inline 1.79% : 0.000004s : 20: predicate.reshape_eliminate 1.39% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000003s : 19: predicate.same_eliminate 0.32% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.58% : 0.000001s : 6: predicate.special_op_eliminate 0.58% : 0.000001s : 6: predicate.specialize_transform 1.67% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.25% : 0.000000s : 3: predicate.switch_call_monad_eliminater 3.06% : 0.000006s : 34: predicate.switch_defer_inline 2.76% : 0.000005s : 34: predicate.switch_layer_defer_inline 9.28% : 0.000018s : 107: predicate.switch_simplify 1.31% : 0.000003s : 19: predicate.tile_eliminate 1.43% : 0.000003s : 19: predicate.transpose_eliminate 1.64% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.66% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.54% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.63% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.30% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.80% : 0.000004s : 19: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003210 40 63.70% : 0.002045s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.62% : 0.000309s : 5: func_graph_cloner_run.FuncGraphClonerNode 26.68% : 0.000857s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114426 72 0.05% : 0.000055s : 1: add_recomputation 0.13% : 0.000145s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.33% : 0.000373s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.37% : 0.000426s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 7.31% : 0.008363s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.65% : 0.000741s : 1: loop_unroll 0.69% : 0.000785s : 1: mutable_eliminate 1.68% : 0.001920s : 26: opt.transform.jit_opt_a 0.04% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000047s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.34% : 0.001533s : 1: renormalize.infer 0.58% : 0.000668s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000148s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 85.73% : 0.098099s : 1: type_inference TotalTime = 0.166879, [30] [bootstrap]: 0.00041448 [type_inference]: 0.15379 [event_method]: 2.662e-05 [auto_monad]: 7.932e-05 [graph_reusing]: 6.93998e-06 [pre_auto_parallel]: 2.60997e-06 [py_interpret_to_execute]: 0.00060189 [rewriter_before_opt_a]: 0.00010329 [expand_dump_flag]: 4.04997e-06 [jit_opt_a]: 0.00937789, [2] [Cycle 1]: 0.00478374, [27] [switch_simplify]: 7.421e-05 [loop_unroll]: 3.431e-05 [a_1]: 0.0007819 [with_stream_mark]: 2.47e-05 [recompute_prepare]: 9.89001e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 6.13998e-06 [accelerated_algorithm]: 7.07002e-06 [meta_shard_fg_expand]: 2.78998e-06 [get_grad_eliminate_]: 6.70002e-06 [merge_forward]: 3.59002e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.683e-05 [j_node_and_user_rematch]: 1.076e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.204e-05 [inline_without_move]: 6.02001e-06 [renormalize]: 0.0034794 [add_forward_monad_depend]: 7.58001e-06 [auto_monad_grad]: 2.18002e-06 [auto_monad_eliminator]: 1.653e-05 [cse]: 3.634e-05 [replace_applicator]: 1.855e-05 [Cycle 2]: 0.00039002, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.0001368 [with_stream_mark]: 1.219e-05 [recompute_prepare]: 6.36e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 5.76e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.304e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 1.472e-05 [rewriter_after_opt_a]: 3.861e-05 [convert_after_rewriter]: 7.22997e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00074588 [jit_opt_b]: 5.421e-05, [1] [Cycle 1]: 4.751e-05, [2] [frontend_op_eliminate]: 1.885e-05 [inline_after_opt_a]: 1.817e-05 [cconv]: 2.859e-05 [loop_unroll]: 0.00043182 [jit_opt_after_cconv]: 0.0001547, [1] [Cycle 1]: 0.00014841, [11] [c_1]: 2.587e-05 [parameter_eliminate]: 2.35002e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.39e-05 [call_graph_tuple_transform]: 2.065e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.10002e-06 [remove_dup_value]: 1.684e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 8.45001e-06 [add_recomputation]: 5.175e-05 [cse_after_recomputation]: 2.474e-05, [1] [Cycle 1]: 1.906e-05, [1] [cse]: 1.323e-05 [auto_monad_reorder]: 1.68e-05 [get_jit_bprop_graph]: 1.98997e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.000455 [symbol_engine_optimizer]: 7.582e-05, [1] [Cycle 1]: 6.995e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 6.50002e-06 [fold_const_symbol]: 9.80002e-06 [renormalize]: 7.89994e-07 [validate]: 4.659e-05 Sums bootstrap : 0.000414s : 0.26% type_inference : 0.153790s : 94.96% event_method : 0.000027s : 0.02% auto_monad : 0.000079s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000602s : 0.37% rewriter_before_opt_a : 0.000103s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000919s : 0.57% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003479s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000049s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000746s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000432s : 0.27% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.28% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.03% Time group info: ------[substitution.] 0.000327 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.78% : 0.000006s : 4: substitution.graph_param_transform 84.84% : 0.000278s : 5: substitution.inline 1.16% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.98% : 0.000013s : 3: substitution.reduce_eliminate 1.72% : 0.000006s : 4: substitution.remove_not_recompute_node 1.98% : 0.000006s : 2: substitution.replace_old_param 3.56% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.153689 2 97.61% : 0.150018s : 1: type_inference.infer 2.39% : 0.003670s : 1: type_inference.specialize ------[replace.] 0.000113 7 69.97% : 0.000079s : 5: replace.inline 30.03% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000285 7 96.37% : 0.000275s : 5: match.inline 3.63% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.58% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.60% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.77% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.41% : 0.000003s : 13: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.29% : 0.000011s : 64: predicate.switch_simplify 1.58% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002851 25 63.98% : 0.001824s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.22% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.80% : 0.000935s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.171516 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000082s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000433s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 5.47% : 0.009382s : 1: jit_opt_a 0.09% : 0.000158s : 1: jit_opt_after_cconv 0.03% : 0.000057s : 1: jit_opt_b 0.26% : 0.000440s : 1: loop_unroll 0.44% : 0.000755s : 1: mutable_eliminate 0.69% : 0.001185s : 26: opt.transform.jit_opt_a 0.03% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000463s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000612s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.46% : 0.002507s : 1: renormalize.infer 0.56% : 0.000961s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000108s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 89.68% : 0.153813s : 1: type_inference TotalTime = 0.0199207, [30] [bootstrap]: 0.00044631 [type_inference]: 0.00998563 [event_method]: 2.38e-05 [auto_monad]: 7.558e-05 [graph_reusing]: 6.97997e-06 [pre_auto_parallel]: 2.90002e-06 [py_interpret_to_execute]: 5.327e-05 [rewriter_before_opt_a]: 8.286e-05 [expand_dump_flag]: 3.22002e-06 [jit_opt_a]: 0.00671186, [2] [Cycle 1]: 0.00232291, [27] [switch_simplify]: 6.931e-05 [loop_unroll]: 3.39e-05 [a_1]: 0.00077689 [with_stream_mark]: 2.451e-05 [recompute_prepare]: 9.38002e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 1.091e-05 [inline_without_move]: 5.71e-06 [renormalize]: 0.00104366 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.613e-05 [cse]: 3.302e-05 [replace_applicator]: 1.598e-05 [Cycle 2]: 0.00034746, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 5.39998e-06 [a_1]: 0.00010503 [with_stream_mark]: 1.202e-05 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.51002e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.88003e-06 [cell_reuse_recompute_pass]: 2.37001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.211e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.97998e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.375e-05 [replace_applicator]: 5.52999e-06 [py_interpret_to_execute_after_opt_a]: 1.416e-05 [rewriter_after_opt_a]: 3.941e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00072816 [jit_opt_b]: 5.305e-05, [1] [Cycle 1]: 4.531e-05, [2] [frontend_op_eliminate]: 1.742e-05 [inline_after_opt_a]: 1.587e-05 [cconv]: 2.764e-05 [loop_unroll]: 0.00044933 [jit_opt_after_cconv]: 0.00017378, [1] [Cycle 1]: 0.0001665, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 3.51999e-06 [updatestate_depend_eliminate]: 7.91001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.747e-05 [call_graph_tuple_transform]: 2.156e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 5.36998e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 5.61998e-06 [add_recomputation]: 5.299e-05 [cse_after_recomputation]: 2.529e-05, [1] [Cycle 1]: 1.92e-05, [1] [cse]: 1.23e-05 [auto_monad_reorder]: 1.768e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 6.60997e-06 [opt_after_jit_grad]: 0.00057033 [symbol_engine_optimizer]: 7.937e-05, [1] [Cycle 1]: 7.306e-05, [6] [build]: 4.65001e-06 [elim_shapecalc]: 8.80999e-06 [elim_not_effective]: 1.429e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 7.60017e-07 [validate]: 4.496e-05 Sums bootstrap : 0.000446s : 2.93% type_inference : 0.009986s : 65.64% event_method : 0.000024s : 0.16% auto_monad : 0.000076s : 0.50% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.35% rewriter_before_opt_a : 0.000083s : 0.54% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.50% jit_opt_a.loop_unroll : 0.000039s : 0.26% jit_opt_a.a_1 : 0.000882s : 5.80% jit_opt_a.with_stream_mark : 0.000037s : 0.24% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.001044s : 6.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.15% jit_opt_a.cse : 0.000047s : 0.31% jit_opt_a.replace_applicator : 0.000022s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.09% rewriter_after_opt_a : 0.000039s : 0.26% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000728s : 4.79% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000028s : 0.18% loop_unroll : 0.000449s : 2.95% jit_opt_after_cconv.c_1 : 0.000022s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000053s : 0.35% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000570s : 3.75% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.30% Time group info: ------[substitution.] 0.000304 27 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 1.80% : 0.000005s : 3: substitution.graph_param_transform 84.92% : 0.000258s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.03% : 0.000012s : 3: substitution.reduce_eliminate 1.43% : 0.000004s : 4: substitution.remove_not_recompute_node 1.61% : 0.000005s : 2: substitution.replace_old_param 3.76% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009903 2 88.35% : 0.008750s : 1: type_inference.infer 11.65% : 0.001153s : 1: type_inference.specialize ------[replace.] 0.000104 7 66.77% : 0.000069s : 5: replace.inline 33.23% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 96.13% : 0.000255s : 5: match.inline 3.87% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 11: predicate.addn_check_dump 1.28% : 0.000002s : 11: predicate.addn_zero_filter 2.06% : 0.000003s : 11: predicate.arithmetic_simplify 1.67% : 0.000002s : 11: predicate.cast_eliminate 0.70% : 0.000001s : 3: predicate.check_bprop_eliminate 1.44% : 0.000002s : 11: predicate.compare_switch_simplify 1.12% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.58% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000002s : 11: predicate.environ_get_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000008s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 16: predicate.load_eliminater 1.62% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 11: predicate.merge_addn 1.02% : 0.000001s : 11: predicate.minmaximum_grad 2.41% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000002s : 11: predicate.print_const_string_wrapper 2.51% : 0.000003s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 19: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 11: predicate.reshape_eliminate 1.16% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 59: predicate.switch_simplify 1.34% : 0.000002s : 11: predicate.tile_eliminate 1.10% : 0.000001s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.45% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000996 16 50.73% : 0.000505s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.82% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.45% : 0.000403s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022136 72 0.25% : 0.000056s : 1: add_recomputation 0.36% : 0.000079s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 2.15% : 0.000476s : 1: bootstrap 0.14% : 0.000031s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.13% : 0.000028s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.34% : 0.006716s : 1: jit_opt_a 0.80% : 0.000177s : 1: jit_opt_after_cconv 0.25% : 0.000056s : 1: jit_opt_b 2.07% : 0.000459s : 1: loop_unroll 3.33% : 0.000738s : 1: mutable_eliminate 5.07% : 0.001121s : 26: opt.transform.jit_opt_a 0.23% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.62% : 0.000580s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000056s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000018s : 1: remove_dup_value 2.69% : 0.000595s : 1: renormalize.infer 1.98% : 0.000439s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000042s : 1: rewriter_after_opt_a 0.39% : 0.000086s : 1: rewriter_before_opt_a 0.37% : 0.000082s : 1: symbol_engine_optimizer 45.21% : 0.010008s : 1: type_inference TotalTime = 0.122285, [30] [bootstrap]: 0.00028662 [type_inference]: 0.110164 [event_method]: 2.154e-05 [auto_monad]: 7.539e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 3.14001e-06 [py_interpret_to_execute]: 0.00060736 [rewriter_before_opt_a]: 0.00010084 [expand_dump_flag]: 3.82998e-06 [jit_opt_a]: 0.00832852, [2] [Cycle 1]: 0.00427863, [27] [switch_simplify]: 6.385e-05 [loop_unroll]: 3.474e-05 [a_1]: 0.0007205 [with_stream_mark]: 2.378e-05 [recompute_prepare]: 1.259e-05 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 3.11001e-06 [specialize_transform]: 7.39002e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 7.45e-06 [meta_shard_fg_expand]: 2.58003e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.675e-05 [j_node_and_user_rematch]: 1.138e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 6.52001e-06 [renormalize]: 0.00302257 [add_forward_monad_depend]: 6.53998e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.035e-05 [cse]: 4.057e-05 [replace_applicator]: 2.243e-05 [Cycle 2]: 0.00040806, [27] [switch_simplify]: 8e-06 [loop_unroll]: 6.30002e-06 [a_1]: 0.00013995 [with_stream_mark]: 1.462e-05 [recompute_prepare]: 6.41998e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.58003e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.97002e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 9.16002e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.48999e-06 [inline_without_move]: 5.63997e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.11e-06 [auto_monad_grad]: 1.55999e-06 [auto_monad_eliminator]: 6.15002e-06 [cse]: 1.736e-05 [replace_applicator]: 6.66999e-06 [py_interpret_to_execute_after_opt_a]: 1.567e-05 [rewriter_after_opt_a]: 3.972e-05 [convert_after_rewriter]: 7.80998e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.00078397 [jit_opt_b]: 6.5e-05, [1] [Cycle 1]: 5.562e-05, [2] [frontend_op_eliminate]: 2.442e-05 [inline_after_opt_a]: 1.94e-05 [cconv]: 2.846e-05 [loop_unroll]: 0.00047542 [jit_opt_after_cconv]: 0.00017, [1] [Cycle 1]: 0.00016323, [11] [c_1]: 2.664e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 6.07999e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 3.22e-05 [call_graph_tuple_transform]: 2.339e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.40002e-06 [remove_dup_value]: 1.683e-05 [partial_unused_args_eliminate]: 3.50998e-06 [environ_conv]: 8.05e-06 [add_recomputation]: 5.358e-05 [cse_after_recomputation]: 2.506e-05, [1] [Cycle 1]: 2.007e-05, [1] [cse]: 1.381e-05 [auto_monad_reorder]: 1.828e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.00049072 [symbol_engine_optimizer]: 8.474e-05, [1] [Cycle 1]: 7.552e-05, [6] [build]: 3.33998e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 1.622e-05 [opt_reshape]: 9.70002e-06 [fold_const_symbol]: 9.86998e-06 [renormalize]: 3.00002e-07 [validate]: 0.00019148 Sums bootstrap : 0.000287s : 0.24% type_inference : 0.110164s : 93.37% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000607s : 0.51% rewriter_before_opt_a : 0.000101s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000860s : 0.73% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003023s : 2.56% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000784s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000475s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000491s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000191s : 0.16% Time group info: ------[substitution.] 0.000293 28 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000008s : 4: substitution.graph_param_transform 83.61% : 0.000245s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.45% : 0.000013s : 3: substitution.reduce_eliminate 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 1.49% : 0.000004s : 2: substitution.replace_old_param 3.53% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110003 2 97.27% : 0.107002s : 1: type_inference.infer 2.73% : 0.003000s : 1: type_inference.specialize ------[replace.] 0.000105 7 69.09% : 0.000072s : 5: replace.inline 30.91% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 96.36% : 0.000242s : 5: match.inline 3.64% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.57% : 0.000002s : 13: predicate.cast_eliminate 0.90% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.13% : 0.000007s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 19: predicate.load_eliminater 0.97% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.96% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.84% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.36% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002412 25 61.50% : 0.001483s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.24% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.26% : 0.000850s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126360 72 0.05% : 0.000058s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000304s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.59% : 0.008332s : 1: jit_opt_a 0.14% : 0.000173s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.38% : 0.000484s : 1: loop_unroll 0.63% : 0.000795s : 1: mutable_eliminate 0.89% : 0.001123s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.49% : 0.000614s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.69% : 0.002131s : 1: renormalize.infer 0.70% : 0.000881s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 87.20% : 0.110182s : 1: type_inference TotalTime = 0.130128, [30] [bootstrap]: 0.00027255 [type_inference]: 0.117366 [event_method]: 2.245e-05 [auto_monad]: 6.859e-05 [graph_reusing]: 6.10002e-06 [pre_auto_parallel]: 2.15002e-06 [py_interpret_to_execute]: 0.00073729 [rewriter_before_opt_a]: 0.00010591 [expand_dump_flag]: 4.08001e-06 [jit_opt_a]: 0.00904364, [2] [Cycle 1]: 0.00524683, [27] [switch_simplify]: 5.88e-05 [loop_unroll]: 3.475e-05 [a_1]: 0.00071652 [with_stream_mark]: 1.842e-05 [recompute_prepare]: 9.58002e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.68998e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 8.13001e-06 [updatestate_useless_node_eliminater]: 6.81001e-06 [accelerated_algorithm]: 8.47998e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 7.04001e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 3.07002e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 6.41e-06 [renormalize]: 0.00405979 [add_forward_monad_depend]: 7.25e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 1.705e-05 [cse]: 2.492e-05 [replace_applicator]: 1.644e-05 [Cycle 2]: 0.00039557, [27] [switch_simplify]: 7.63999e-06 [loop_unroll]: 6.91001e-06 [a_1]: 0.00012528 [with_stream_mark]: 1.502e-05 [recompute_prepare]: 6.74001e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 1.073e-05 [meta_fg_expand]: 2.73003e-06 [replace_old_param]: 8.91997e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 7.06001e-06 [cse]: 1.609e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.466e-05 [rewriter_after_opt_a]: 3.92e-05 [convert_after_rewriter]: 7.12002e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00060153 [jit_opt_b]: 6.035e-05, [1] [Cycle 1]: 5.312e-05, [2] [frontend_op_eliminate]: 2.109e-05 [inline_after_opt_a]: 2.026e-05 [cconv]: 2.768e-05 [loop_unroll]: 0.00045441 [jit_opt_after_cconv]: 0.00017275, [1] [Cycle 1]: 0.00016537, [11] [c_1]: 2.845e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 6.73e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 3.031e-05 [call_graph_tuple_transform]: 2.297e-05 [tuple_list_get_item_eliminator]: 6.83e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 6.94999e-06 [remove_dup_value]: 1.827e-05 [partial_unused_args_eliminate]: 3.19001e-06 [environ_conv]: 8.96998e-06 [add_recomputation]: 4.805e-05 [cse_after_recomputation]: 2.674e-05, [1] [Cycle 1]: 2.134e-05, [1] [cse]: 1.5e-05 [auto_monad_reorder]: 1.6e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.00049627 [symbol_engine_optimizer]: 8.6e-05, [1] [Cycle 1]: 7.91e-05, [6] [build]: 3.40998e-06 [elim_shapecalc]: 9.19e-06 [elim_not_effective]: 1.697e-05 [opt_reshape]: 8.42998e-06 [fold_const_symbol]: 1.039e-05 [renormalize]: 9.09989e-07 [validate]: 0.00021035 Sums bootstrap : 0.000273s : 0.22% type_inference : 0.117366s : 93.07% event_method : 0.000022s : 0.02% auto_monad : 0.000069s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000737s : 0.58% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000842s : 0.67% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004060s : 3.22% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000602s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000454s : 0.36% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000496s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000210s : 0.17% Time group info: ------[substitution.] 0.000273 25 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 87.22% : 0.000238s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000006s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 4.09% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117287 2 96.86% : 0.113602s : 1: type_inference.infer 3.14% : 0.003685s : 1: type_inference.specialize ------[replace.] 0.000109 7 67.83% : 0.000074s : 5: replace.inline 32.17% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 95.96% : 0.000235s : 5: match.inline 4.04% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 13: predicate.addn_check_dump 1.63% : 0.000002s : 13: predicate.addn_zero_filter 2.61% : 0.000004s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.39% : 0.000002s : 13: predicate.environ_get_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.86% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.85% : 0.000003s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.59% : 0.000002s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.30% : 0.000010s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.68% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.20% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.89% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002788 25 60.96% : 0.001700s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.81% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.23% : 0.001010s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135189 72 0.04% : 0.000051s : 1: add_recomputation 0.05% : 0.000072s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000292s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.69% : 0.009047s : 1: jit_opt_a 0.13% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.34% : 0.000463s : 1: loop_unroll 0.45% : 0.000612s : 1: mutable_eliminate 0.81% : 0.001098s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000505s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.55% : 0.000747s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 2.22% : 0.002999s : 1: renormalize.infer 0.77% : 0.001038s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.07% : 0.000089s : 1: symbol_engine_optimizer 86.83% : 0.117382s : 1: type_inference TotalTime = 0.138493, [30] [bootstrap]: 0.00030753 [type_inference]: 0.125541 [event_method]: 2.405e-05 [auto_monad]: 7.681e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00064194 [rewriter_before_opt_a]: 0.00010108 [expand_dump_flag]: 3.88001e-06 [jit_opt_a]: 0.00872351, [2] [Cycle 1]: 0.00432568, [27] [switch_simplify]: 6.696e-05 [loop_unroll]: 3.167e-05 [a_1]: 0.00066892 [with_stream_mark]: 2.655e-05 [recompute_prepare]: 9.37999e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.08002e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 6.50997e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.649e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 6.63998e-06 [renormalize]: 0.00311001 [add_forward_monad_depend]: 1.175e-05 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.352e-05 [cse]: 3.843e-05 [replace_applicator]: 2.599e-05 [Cycle 2]: 0.00041744, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.53e-06 [a_1]: 0.00013185 [with_stream_mark]: 1.837e-05 [recompute_prepare]: 6.92002e-06 [updatestate_depend_eliminate]: 3.94002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 6.55997e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 3.58999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.088e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.09999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 9.04998e-06 [cse]: 1.505e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.856e-05 [rewriter_after_opt_a]: 4.322e-05 [convert_after_rewriter]: 7.56999e-06 [order_py_execute_after_rewriter]: 5.79e-06 [mutable_eliminate]: 0.00082206 [jit_opt_b]: 6.229e-05, [1] [Cycle 1]: 5.252e-05, [2] [frontend_op_eliminate]: 2.023e-05 [inline_after_opt_a]: 1.885e-05 [cconv]: 3.563e-05 [loop_unroll]: 0.00075625 [jit_opt_after_cconv]: 0.00019389, [1] [Cycle 1]: 0.00018561, [11] [c_1]: 2.882e-05 [parameter_eliminate]: 5.62999e-06 [updatestate_depend_eliminate]: 1.088e-05 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.46998e-06 [cse]: 3.976e-05 [call_graph_tuple_transform]: 2.542e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.89999e-06 [renormalize]: 9.5999e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.855e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 1.086e-05 [add_recomputation]: 5.99e-05 [cse_after_recomputation]: 2.72e-05, [1] [Cycle 1]: 1.931e-05, [1] [cse]: 1.351e-05 [auto_monad_reorder]: 1.711e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 8.85999e-06 [opt_after_jit_grad]: 0.00061165 [symbol_engine_optimizer]: 8.221e-05, [1] [Cycle 1]: 7.515e-05, [6] [build]: 5.20999e-06 [elim_shapecalc]: 9.00001e-06 [elim_not_effective]: 1.641e-05 [opt_reshape]: 6.94001e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 7.09988e-07 [validate]: 6.29e-05 Sums bootstrap : 0.000308s : 0.23% type_inference : 0.125541s : 93.80% event_method : 0.000024s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000642s : 0.48% rewriter_before_opt_a : 0.000101s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000801s : 0.60% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003110s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000822s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000036s : 0.03% loop_unroll : 0.000756s : 0.57% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000612s : 0.46% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.05% Time group info: ------[substitution.] 0.000276 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000007s : 4: substitution.graph_param_transform 85.34% : 0.000236s : 4: substitution.inline 1.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000006s : 4: substitution.remove_not_recompute_node 2.24% : 0.000006s : 2: substitution.replace_old_param 4.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125450 2 97.61% : 0.122448s : 1: type_inference.infer 2.39% : 0.003002s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.43% : 0.000058s : 4: replace.inline 31.57% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 6 95.13% : 0.000233s : 4: match.inline 4.87% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.34% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.89% : 0.000009s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 18: predicate.load_eliminater 2.19% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.48% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000002s : 12: predicate.minmaximum_grad 1.84% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.88% : 0.000004s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.54% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.33% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002368 22 60.14% : 0.001424s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.36% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.50% : 0.000888s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142739 72 0.04% : 0.000063s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000325s : 1: bootstrap 0.03% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.11% : 0.008727s : 1: jit_opt_a 0.14% : 0.000197s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.54% : 0.000769s : 1: loop_unroll 0.59% : 0.000836s : 1: mutable_eliminate 0.75% : 0.001068s : 26: opt.transform.jit_opt_a 0.04% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000624s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.46% : 0.000650s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.48% : 0.002115s : 1: renormalize.infer 0.69% : 0.000979s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000107s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 87.96% : 0.125560s : 1: type_inference TotalTime = 0.14291, [30] [bootstrap]: 0.00031633 [type_inference]: 0.131248 [event_method]: 2.369e-05 [auto_monad]: 7.298e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 0.00048291 [rewriter_before_opt_a]: 9.496e-05 [expand_dump_flag]: 4.40999e-06 [jit_opt_a]: 0.00790397, [2] [Cycle 1]: 0.00412027, [27] [switch_simplify]: 6.504e-05 [loop_unroll]: 3.482e-05 [a_1]: 0.0006947 [with_stream_mark]: 2.138e-05 [recompute_prepare]: 9.46e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.47001e-06 [meta_shard_fg_expand]: 2.74999e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.611e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 6.38998e-06 [renormalize]: 0.00289726 [add_forward_monad_depend]: 9.25999e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 2.224e-05 [cse]: 4.047e-05 [replace_applicator]: 2.359e-05 [Cycle 2]: 0.00043274, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.39999e-06 [a_1]: 0.00014064 [with_stream_mark]: 1.737e-05 [recompute_prepare]: 6.47001e-06 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.45002e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 3.28e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.09e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 8.60999e-06 [cse]: 1.797e-05 [replace_applicator]: 8.18001e-06 [py_interpret_to_execute_after_opt_a]: 1.641e-05 [rewriter_after_opt_a]: 4.299e-05 [convert_after_rewriter]: 8.11002e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00078995 [jit_opt_b]: 0.00010712, [1] [Cycle 1]: 9.798e-05, [2] [frontend_op_eliminate]: 2.073e-05 [inline_after_opt_a]: 6.357e-05 [cconv]: 3.638e-05 [loop_unroll]: 0.00050703 [jit_opt_after_cconv]: 0.00019053, [1] [Cycle 1]: 0.0001821, [11] [c_1]: 2.757e-05 [parameter_eliminate]: 4.90999e-06 [updatestate_depend_eliminate]: 9.89999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.561e-05 [call_graph_tuple_transform]: 2.683e-05 [tuple_list_get_item_eliminator]: 7.15e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.70025e-07 [switch_simplify]: 7.56999e-06 [remove_dup_value]: 1.982e-05 [partial_unused_args_eliminate]: 3.04999e-06 [environ_conv]: 1.114e-05 [add_recomputation]: 5.853e-05 [cse_after_recomputation]: 2.698e-05, [1] [Cycle 1]: 2.183e-05, [1] [cse]: 1.492e-05 [auto_monad_reorder]: 1.942e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 7.3e-06 [opt_after_jit_grad]: 0.0005425 [symbol_engine_optimizer]: 9.087e-05, [1] [Cycle 1]: 8.44e-05, [6] [build]: 4.98001e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.556e-05 [opt_reshape]: 9.17999e-06 [fold_const_symbol]: 1.261e-05 [renormalize]: 7.40023e-07 [validate]: 6.004e-05 Sums bootstrap : 0.000316s : 0.23% type_inference : 0.131248s : 94.50% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000483s : 0.35% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000835s : 0.60% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002897s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000790s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000064s : 0.05% cconv : 0.000036s : 0.03% loop_unroll : 0.000507s : 0.37% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000059s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000542s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000060s : 0.04% Time group info: ------[substitution.] 0.000263 28 0.73% : 0.000002s : 2: substitution.elim_not_effective 1.68% : 0.000004s : 2: substitution.fold_const_symbol 2.46% : 0.000006s : 4: substitution.graph_param_transform 80.45% : 0.000212s : 5: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.03% : 0.000013s : 3: substitution.reduce_eliminate 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000006s : 2: substitution.replace_old_param 4.02% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131168 2 97.78% : 0.128252s : 1: type_inference.infer 2.22% : 0.002916s : 1: type_inference.specialize ------[replace.] 0.000100 7 69.52% : 0.000069s : 5: replace.inline 30.48% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 7 95.67% : 0.000209s : 5: match.inline 4.33% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.60% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.49% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.75% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 19: predicate.load_eliminater 1.66% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.81% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 2.07% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.94% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.68% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002498 25 64.89% : 0.001621s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.64% : 0.000815s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147028 72 0.04% : 0.000062s : 1: add_recomputation 0.05% : 0.000077s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.23% : 0.000331s : 1: bootstrap 0.03% : 0.000040s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.38% : 0.007908s : 1: jit_opt_a 0.13% : 0.000193s : 1: jit_opt_after_cconv 0.07% : 0.000110s : 1: jit_opt_b 0.35% : 0.000518s : 1: loop_unroll 0.55% : 0.000804s : 1: mutable_eliminate 0.75% : 0.001098s : 26: opt.transform.jit_opt_a 0.04% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000075s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.37% : 0.002009s : 1: renormalize.infer 0.60% : 0.000876s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000094s : 1: symbol_engine_optimizer 89.28% : 0.131266s : 1: type_inference TotalTime = 0.088138, [30] [bootstrap]: 0.0003226 [type_inference]: 0.0749574 [event_method]: 2.685e-05 [auto_monad]: 8.38e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00037066 [rewriter_before_opt_a]: 0.00011227 [expand_dump_flag]: 4.52e-06 [jit_opt_a]: 0.00967309, [2] [Cycle 1]: 0.00480898, [27] [switch_simplify]: 7.868e-05 [loop_unroll]: 3.611e-05 [a_1]: 0.00078925 [with_stream_mark]: 2.471e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.57002e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 7.75998e-06 [updatestate_useless_node_eliminater]: 7.41999e-06 [accelerated_algorithm]: 7.67002e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 7.46999e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 1.126e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.259e-05 [inline_without_move]: 7.08e-06 [renormalize]: 0.00347452 [add_forward_monad_depend]: 7.41999e-06 [auto_monad_grad]: 2.88998e-06 [auto_monad_eliminator]: 1.9e-05 [cse]: 3.903e-05 [replace_applicator]: 2.078e-05 [Cycle 2]: 0.00041496, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 7.24001e-06 [a_1]: 0.00013127 [with_stream_mark]: 1.325e-05 [recompute_prepare]: 7.8e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 7.03e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 2.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.765e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 6.16998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 7.56001e-06 [cse]: 1.95e-05 [replace_applicator]: 6.99001e-06 [py_interpret_to_execute_after_opt_a]: 1.52e-05 [rewriter_after_opt_a]: 4.071e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00073177 [jit_opt_b]: 6e-05, [1] [Cycle 1]: 5.138e-05, [2] [frontend_op_eliminate]: 2.015e-05 [inline_after_opt_a]: 1.94e-05 [cconv]: 2.695e-05 [loop_unroll]: 0.00045539 [jit_opt_after_cconv]: 0.00017364, [1] [Cycle 1]: 0.00016685, [11] [c_1]: 2.892e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 6.41998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [cse]: 2.983e-05 [call_graph_tuple_transform]: 2.303e-05 [tuple_list_get_item_eliminator]: 8.02003e-06 [none_parameter_eliminate]: 1.89999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.52001e-06 [remove_dup_value]: 1.948e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 9.86e-06 [add_recomputation]: 5.721e-05 [cse_after_recomputation]: 2.818e-05, [1] [Cycle 1]: 2.25e-05, [1] [cse]: 1.595e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 4.67e-06 [opt_after_jit_grad]: 0.00052015 [symbol_engine_optimizer]: 8.494e-05, [1] [Cycle 1]: 7.783e-05, [6] [build]: 4.53999e-06 [elim_shapecalc]: 1.021e-05 [elim_not_effective]: 1.559e-05 [opt_reshape]: 7.62002e-06 [fold_const_symbol]: 1.087e-05 [renormalize]: 6.09987e-07 [validate]: 0.00010711 Sums bootstrap : 0.000323s : 0.39% type_inference : 0.074957s : 90.28% event_method : 0.000027s : 0.03% auto_monad : 0.000084s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000371s : 0.45% rewriter_before_opt_a : 0.000112s : 0.14% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000086s : 0.10% jit_opt_a.loop_unroll : 0.000043s : 0.05% jit_opt_a.a_1 : 0.000921s : 1.11% jit_opt_a.with_stream_mark : 0.000038s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.02% jit_opt_a.accelerated_algorithm : 0.000015s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.003475s : 4.18% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.03% jit_opt_a.cse : 0.000059s : 0.07% jit_opt_a.replace_applicator : 0.000028s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000732s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000455s : 0.55% jit_opt_after_cconv.c_1 : 0.000029s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.07% cse_after_recomputation.cse : 0.000016s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000520s : 0.63% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000107s : 0.13% Time group info: ------[substitution.] 0.000333 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.85% : 0.000006s : 4: substitution.graph_param_transform 87.96% : 0.000293s : 5: substitution.inline 1.13% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000006s : 4: substitution.remove_not_recompute_node 1.98% : 0.000007s : 2: substitution.replace_old_param 4.23% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.074846 2 96.10% : 0.071923s : 1: type_inference.infer 3.90% : 0.002923s : 1: type_inference.specialize ------[replace.] 0.000116 7 69.85% : 0.000081s : 5: replace.inline 30.15% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000303 7 95.79% : 0.000290s : 5: match.inline 4.21% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 888 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.26% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 6.01% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.37% : 0.000002s : 13: predicate.minmaximum_grad 1.83% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 1.51% : 0.000002s : 13: predicate.reduce_eliminate 1.94% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.11% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.44% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.80% : 0.000011s : 65: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004183 29 77.80% : 0.003254s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.39% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 19.80% : 0.000828s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.092840 72 0.06% : 0.000060s : 1: add_recomputation 0.09% : 0.000087s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.37% : 0.000341s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.03% : 0.000032s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.42% : 0.009677s : 1: jit_opt_a 0.19% : 0.000177s : 1: jit_opt_after_cconv 0.07% : 0.000063s : 1: jit_opt_b 0.50% : 0.000464s : 1: loop_unroll 0.80% : 0.000742s : 1: mutable_eliminate 1.30% : 0.001210s : 26: opt.transform.jit_opt_a 0.07% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000377s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 2.81% : 0.002608s : 1: renormalize.infer 0.92% : 0.000853s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.13% : 0.000117s : 1: rewriter_before_opt_a 0.09% : 0.000088s : 1: symbol_engine_optimizer 80.76% : 0.074981s : 1: type_inference TotalTime = 0.192546, [30] [bootstrap]: 0.00031855 [type_inference]: 0.180322 [event_method]: 2.339e-05 [auto_monad]: 7.474e-05 [graph_reusing]: 5.84999e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00052471 [rewriter_before_opt_a]: 9.288e-05 [expand_dump_flag]: 4.1e-06 [jit_opt_a]: 0.00872424, [2] [Cycle 1]: 0.00399157, [27] [switch_simplify]: 6.215e-05 [loop_unroll]: 3.27e-05 [a_1]: 0.00064385 [with_stream_mark]: 2.267e-05 [recompute_prepare]: 9.67001e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 2.444e-05 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 6.49001e-06 [accelerated_algorithm]: 7.06999e-06 [meta_shard_fg_expand]: 2.91999e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.749e-05 [j_node_and_user_rematch]: 1.089e-05 [meta_fg_expand]: 2.99999e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 6.81001e-06 [renormalize]: 0.00281822 [add_forward_monad_depend]: 8.64998e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.915e-05 [cse]: 3.596e-05 [replace_applicator]: 1.988e-05 [Cycle 2]: 0.00038611, [27] [switch_simplify]: 7.53e-06 [loop_unroll]: 6.36998e-06 [a_1]: 0.00012783 [with_stream_mark]: 1.411e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.47002e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.732e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 5.61e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.216e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 1.362e-05 [rewriter_after_opt_a]: 3.926e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 4.70001e-06 [mutable_eliminate]: 0.00076172 [jit_opt_b]: 5.725e-05, [1] [Cycle 1]: 4.985e-05, [2] [frontend_op_eliminate]: 2.028e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 2.835e-05 [loop_unroll]: 0.00044226 [jit_opt_after_cconv]: 0.00015473, [1] [Cycle 1]: 0.00014806, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 7.00002e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.323e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 6.39999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 9.19e-06 [add_recomputation]: 5.235e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.592e-05, [1] [cse]: 1.008e-05 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00047712 [symbol_engine_optimizer]: 7.598e-05, [1] [Cycle 1]: 7.007e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 8.71002e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 9.76e-06 [renormalize]: 5.59987e-07 [validate]: 6.489e-05 Sums bootstrap : 0.000319s : 0.17% type_inference : 0.180322s : 96.14% event_method : 0.000023s : 0.01% auto_monad : 0.000075s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000525s : 0.28% rewriter_before_opt_a : 0.000093s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.04% jit_opt_a.loop_unroll : 0.000039s : 0.02% jit_opt_a.a_1 : 0.000772s : 0.41% jit_opt_a.with_stream_mark : 0.000037s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000027s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002818s : 1.50% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000048s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000762s : 0.41% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000442s : 0.24% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000477s : 0.25% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000065s : 0.03% Time group info: ------[substitution.] 0.000252 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 4: substitution.graph_param_transform 85.42% : 0.000215s : 4: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000006s : 2: substitution.replace_old_param 5.08% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.180225 2 98.34% : 0.177238s : 1: type_inference.infer 1.66% : 0.002986s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.46% : 0.000055s : 4: replace.inline 32.54% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.85% : 0.000213s : 4: match.inline 5.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.48% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.46% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002475 22 64.04% : 0.001585s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.29% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.68% : 0.000833s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.196437 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000078s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.17% : 0.000338s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.44% : 0.008728s : 1: jit_opt_a 0.08% : 0.000158s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.23% : 0.000451s : 1: loop_unroll 0.39% : 0.000771s : 1: mutable_eliminate 0.52% : 0.001028s : 26: opt.transform.jit_opt_a 0.03% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000537s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.98% : 0.001928s : 1: renormalize.infer 0.45% : 0.000879s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000097s : 1: rewriter_before_opt_a 0.04% : 0.000079s : 1: symbol_engine_optimizer 91.81% : 0.180346s : 1: type_inference TotalTime = 0.15437, [30] [bootstrap]: 0.0004152 [type_inference]: 0.141006 [event_method]: 2.795e-05 [auto_monad]: 7.868e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00062061 [rewriter_before_opt_a]: 0.00011006 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00943875, [2] [Cycle 1]: 0.00496774, [27] [switch_simplify]: 7.204e-05 [loop_unroll]: 3.426e-05 [a_1]: 0.00080789 [with_stream_mark]: 2.469e-05 [recompute_prepare]: 1.035e-05 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.37997e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7.41001e-06 [updatestate_useless_node_eliminater]: 6.44001e-06 [accelerated_algorithm]: 7.34002e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.721e-05 [j_node_and_user_rematch]: 1.085e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 6.58998e-06 [renormalize]: 0.00361666 [add_forward_monad_depend]: 8.69e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.158e-05 [cse]: 3.689e-05 [replace_applicator]: 2.287e-05 [Cycle 2]: 0.00042447, [27] [switch_simplify]: 7.75e-06 [loop_unroll]: 6.64001e-06 [a_1]: 0.00014547 [with_stream_mark]: 1.568e-05 [recompute_prepare]: 7.33999e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.63003e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 5.85002e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.156e-05 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 6.59999e-06 [cse]: 1.637e-05 [replace_applicator]: 6.30002e-06 [py_interpret_to_execute_after_opt_a]: 1.799e-05 [rewriter_after_opt_a]: 4.225e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00081715 [jit_opt_b]: 6.206e-05, [1] [Cycle 1]: 5.349e-05, [2] [frontend_op_eliminate]: 2.201e-05 [inline_after_opt_a]: 1.966e-05 [cconv]: 3.284e-05 [loop_unroll]: 0.0004535 [jit_opt_after_cconv]: 0.00016931, [1] [Cycle 1]: 0.00016269, [11] [c_1]: 2.711e-05 [parameter_eliminate]: 3.6e-06 [updatestate_depend_eliminate]: 7.35e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.876e-05 [call_graph_tuple_transform]: 2.344e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.63e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 8.50999e-06 [add_recomputation]: 5.551e-05 [cse_after_recomputation]: 2.591e-05, [1] [Cycle 1]: 2.031e-05, [1] [cse]: 1.36e-05 [auto_monad_reorder]: 1.706e-05 [get_jit_bprop_graph]: 3.06999e-06 [rewriter_after_jit_bprop_graph]: 7.43999e-06 [opt_after_jit_grad]: 0.0004849 [symbol_engine_optimizer]: 7.987e-05, [1] [Cycle 1]: 7.34e-05, [6] [build]: 4.63999e-06 [elim_shapecalc]: 9.36e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 9.97999e-06 [renormalize]: 4.69998e-07 [validate]: 0.00013207 Sums bootstrap : 0.000415s : 0.28% type_inference : 0.141006s : 94.23% event_method : 0.000028s : 0.02% auto_monad : 0.000079s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000621s : 0.41% rewriter_before_opt_a : 0.000110s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000953s : 0.64% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003617s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000817s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000453s : 0.30% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000485s : 0.32% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000132s : 0.09% Time group info: ------[substitution.] 0.000357 28 0.74% : 0.000003s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.82% : 0.000006s : 4: substitution.graph_param_transform 85.05% : 0.000304s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.19% : 0.000015s : 3: substitution.reduce_eliminate 1.63% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000007s : 2: substitution.replace_old_param 3.18% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.140900 2 97.37% : 0.137199s : 1: type_inference.infer 2.63% : 0.003700s : 1: type_inference.specialize ------[replace.] 0.000116 7 70.25% : 0.000082s : 5: replace.inline 29.75% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000310 7 96.73% : 0.000300s : 5: match.inline 3.27% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.19% : 0.000002s : 13: predicate.addn_zero_filter 2.44% : 0.000004s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.28% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.41% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.63% : 0.000009s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.26% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.37% : 0.000004s : 13: predicate.reduce_eliminate 1.52% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.53% : 0.000002s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.47% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.10% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003234 25 63.00% : 0.002037s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.95% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.05% : 0.001101s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.159198 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000083s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000436s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.93% : 0.009443s : 1: jit_opt_a 0.11% : 0.000172s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.29% : 0.000463s : 1: loop_unroll 0.52% : 0.000829s : 1: mutable_eliminate 0.77% : 0.001227s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000629s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.56% : 0.002481s : 1: renormalize.infer 0.71% : 0.001124s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.07% : 0.000116s : 1: rewriter_before_opt_a 0.05% : 0.000082s : 1: symbol_engine_optimizer 88.59% : 0.141033s : 1: type_inference TotalTime = 0.0152674, [30] [bootstrap]: 0.00032871 [type_inference]: 0.0071915 [event_method]: 2.096e-05 [auto_monad]: 6.905e-05 [graph_reusing]: 6.32001e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 4.125e-05 [rewriter_before_opt_a]: 8.123e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00539986, [2] [Cycle 1]: 0.00186477, [27] [switch_simplify]: 5.931e-05 [loop_unroll]: 3.642e-05 [a_1]: 0.00065685 [with_stream_mark]: 1.858e-05 [recompute_prepare]: 8.92999e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.66003e-06 [meta_shard_fg_expand]: 2.72001e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 0.00073822 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 2.13002e-06 [auto_monad_eliminator]: 1.656e-05 [cse]: 3.395e-05 [replace_applicator]: 1.498e-05 [Cycle 2]: 0.00034288, [27] [switch_simplify]: 6.04001e-06 [loop_unroll]: 5.13002e-06 [a_1]: 9.828e-05 [with_stream_mark]: 1.143e-05 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 3.00002e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.195e-05 [j_node_and_user_rematch]: 7.45e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 4.67e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 7.13e-06 [cse]: 1.302e-05 [replace_applicator]: 5.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.185e-05 [rewriter_after_opt_a]: 3.749e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00052943 [jit_opt_b]: 5.107e-05, [1] [Cycle 1]: 4.418e-05, [2] [frontend_op_eliminate]: 1.619e-05 [inline_after_opt_a]: 1.586e-05 [cconv]: 2.545e-05 [loop_unroll]: 0.00042903 [jit_opt_after_cconv]: 0.00016117, [1] [Cycle 1]: 0.00015435, [11] [c_1]: 2.059e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.42999e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.65997e-06 [cse]: 3.317e-05 [call_graph_tuple_transform]: 2.007e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.38002e-06 [remove_dup_value]: 1.535e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.13002e-06 [add_recomputation]: 5.023e-05 [cse_after_recomputation]: 2.256e-05, [1] [Cycle 1]: 1.761e-05, [1] [cse]: 1.183e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 4.37998e-06 [opt_after_jit_grad]: 0.00044662 [symbol_engine_optimizer]: 7.287e-05, [1] [Cycle 1]: 6.681e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 7.51001e-06 [elim_not_effective]: 1.19e-05 [opt_reshape]: 5.59998e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 4.10015e-07 [validate]: 4.013e-05 Sums bootstrap : 0.000329s : 2.87% type_inference : 0.007191s : 62.75% event_method : 0.000021s : 0.18% auto_monad : 0.000069s : 0.60% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000041s : 0.36% rewriter_before_opt_a : 0.000081s : 0.71% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.57% jit_opt_a.loop_unroll : 0.000042s : 0.36% jit_opt_a.a_1 : 0.000755s : 6.59% jit_opt_a.with_stream_mark : 0.000030s : 0.26% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000738s : 6.44% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.21% jit_opt_a.cse : 0.000047s : 0.41% jit_opt_a.replace_applicator : 0.000020s : 0.17% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000037s : 0.33% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000529s : 4.62% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000025s : 0.22% loop_unroll : 0.000429s : 3.74% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.44% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000019s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000447s : 3.90% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.35% Time group info: ------[substitution.] 0.000246 27 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 81.25% : 0.000200s : 5: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.01% : 0.000012s : 3: substitution.reduce_eliminate 1.82% : 0.000004s : 4: substitution.remove_not_recompute_node 2.31% : 0.000006s : 2: substitution.replace_old_param 4.36% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007124 2 87.14% : 0.006208s : 1: type_inference.infer 12.86% : 0.000916s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.71% : 0.000063s : 5: replace.inline 32.29% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 7 95.33% : 0.000197s : 5: match.inline 4.67% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 11: predicate.addn_check_dump 1.24% : 0.000002s : 11: predicate.addn_zero_filter 2.11% : 0.000003s : 11: predicate.arithmetic_simplify 1.43% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.40% : 0.000002s : 11: predicate.depend_value_elim 1.18% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000002s : 11: predicate.environ_get_eliminate 1.26% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.49% : 0.000008s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000003s : 18: predicate.switch_defer_inline 2.35% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.61% : 0.000011s : 59: predicate.switch_simplify 1.37% : 0.000002s : 11: predicate.tile_eliminate 1.26% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000703 16 48.83% : 0.000343s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.27% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.90% : 0.000302s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017040 72 0.31% : 0.000054s : 1: add_recomputation 0.42% : 0.000072s : 1: auto_monad 0.13% : 0.000022s : 1: auto_monad_reorder 2.08% : 0.000354s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.71% : 0.005403s : 1: jit_opt_a 0.96% : 0.000164s : 1: jit_opt_after_cconv 0.32% : 0.000054s : 1: jit_opt_b 2.57% : 0.000437s : 1: loop_unroll 3.17% : 0.000540s : 1: mutable_eliminate 5.76% : 0.000981s : 26: opt.transform.jit_opt_a 0.28% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.67% : 0.000455s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.47% : 0.000420s : 1: renormalize.infer 1.82% : 0.000310s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000040s : 1: rewriter_after_opt_a 0.49% : 0.000084s : 1: rewriter_before_opt_a 0.44% : 0.000076s : 1: symbol_engine_optimizer 42.30% : 0.007208s : 1: type_inference TotalTime = 0.075484, [30] [bootstrap]: 0.0002982 [type_inference]: 0.0633345 [event_method]: 2.651e-05 [auto_monad]: 7.785e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.0004314 [rewriter_before_opt_a]: 0.0001162 [expand_dump_flag]: 4.3e-06 [jit_opt_a]: 0.0085585, [2] [Cycle 1]: 0.00446787, [27] [switch_simplify]: 7.087e-05 [loop_unroll]: 3.582e-05 [a_1]: 0.00076798 [with_stream_mark]: 2.315e-05 [recompute_prepare]: 9.52001e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 8e-06 [updatestate_useless_node_eliminater]: 6.86999e-06 [accelerated_algorithm]: 7.39002e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 7.28999e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.75e-05 [j_node_and_user_rematch]: 1.133e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.089e-05 [inline_without_move]: 6.81999e-06 [renormalize]: 0.00317711 [add_forward_monad_depend]: 7.63001e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.804e-05 [cse]: 4.018e-05 [replace_applicator]: 1.902e-05 [Cycle 2]: 0.00039182, [27] [switch_simplify]: 7.71999e-06 [loop_unroll]: 7e-06 [a_1]: 0.00012836 [with_stream_mark]: 1.242e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 5.72001e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 2.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 9.56003e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.70001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.47001e-06 [cse]: 1.774e-05 [replace_applicator]: 6.54999e-06 [py_interpret_to_execute_after_opt_a]: 1.635e-05 [rewriter_after_opt_a]: 4.194e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00071746 [jit_opt_b]: 5.797e-05, [1] [Cycle 1]: 5.073e-05, [2] [frontend_op_eliminate]: 1.965e-05 [inline_after_opt_a]: 1.948e-05 [cconv]: 2.67e-05 [loop_unroll]: 0.00045608 [jit_opt_after_cconv]: 0.00017401, [1] [Cycle 1]: 0.00016628, [11] [c_1]: 2.728e-05 [parameter_eliminate]: 3.31999e-06 [updatestate_depend_eliminate]: 7.38e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.133e-05 [call_graph_tuple_transform]: 2.434e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 2.01998e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 2.072e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 9.97999e-06 [add_recomputation]: 5.557e-05 [cse_after_recomputation]: 2.949e-05, [1] [Cycle 1]: 2.287e-05, [1] [cse]: 1.616e-05 [auto_monad_reorder]: 1.924e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 6.30002e-06 [opt_after_jit_grad]: 0.00055197 [symbol_engine_optimizer]: 8.519e-05, [1] [Cycle 1]: 7.79e-05, [6] [build]: 5.27999e-06 [elim_shapecalc]: 8.87e-06 [elim_not_effective]: 1.624e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 1.096e-05 [renormalize]: 7.7e-07 [validate]: 0.00014015 Sums bootstrap : 0.000298s : 0.42% type_inference : 0.063335s : 89.02% event_method : 0.000027s : 0.04% auto_monad : 0.000078s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000431s : 0.61% rewriter_before_opt_a : 0.000116s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.11% jit_opt_a.loop_unroll : 0.000043s : 0.06% jit_opt_a.a_1 : 0.000896s : 1.26% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.003177s : 4.47% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000058s : 0.08% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000042s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000717s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000456s : 0.64% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.08% cse_after_recomputation.cse : 0.000016s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000552s : 0.78% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000140s : 0.20% Time group info: ------[substitution.] 0.000317 25 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 4: substitution.graph_param_transform 87.41% : 0.000277s : 5: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000006s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 4.26% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063241 2 95.61% : 0.060468s : 1: type_inference.infer 4.39% : 0.002773s : 1: type_inference.specialize ------[replace.] 0.000110 7 69.26% : 0.000076s : 5: replace.inline 30.74% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000286 7 95.74% : 0.000274s : 5: match.inline 4.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 888 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.51% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.49% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.61% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.74% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.78% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000004s : 20: predicate.switch_defer_inline 2.01% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.66% : 0.000011s : 65: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.60% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002863 29 67.14% : 0.001922s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.60% : 0.000847s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079813 72 0.07% : 0.000059s : 1: add_recomputation 0.10% : 0.000082s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.40% : 0.000317s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000032s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000031s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.73% : 0.008562s : 1: jit_opt_a 0.22% : 0.000177s : 1: jit_opt_after_cconv 0.08% : 0.000061s : 1: jit_opt_b 0.58% : 0.000465s : 1: loop_unroll 0.91% : 0.000728s : 1: mutable_eliminate 1.46% : 0.001167s : 26: opt.transform.jit_opt_a 0.08% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000561s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.55% : 0.000442s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000024s : 1: remove_dup_value 2.84% : 0.002268s : 1: renormalize.infer 1.12% : 0.000898s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000121s : 1: rewriter_before_opt_a 0.11% : 0.000088s : 1: symbol_engine_optimizer 79.38% : 0.063352s : 1: type_inference TotalTime = 0.0996372, [30] [bootstrap]: 0.00031622 [type_inference]: 0.0859987 [event_method]: 2.238e-05 [auto_monad]: 7.471e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.78998e-06 [py_interpret_to_execute]: 0.00030897 [rewriter_before_opt_a]: 9.272e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00855502, [2] [Cycle 1]: 0.00358916, [27] [switch_simplify]: 6.367e-05 [loop_unroll]: 3.2e-05 [a_1]: 0.00062746 [with_stream_mark]: 2.342e-05 [recompute_prepare]: 9.73998e-06 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 7.26001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 7.03998e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 1.075e-05 [meta_fg_expand]: 3.00002e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00241228 [add_forward_monad_depend]: 1.112e-05 [auto_monad_grad]: 2.96001e-06 [auto_monad_eliminator]: 2.379e-05 [cse]: 3.739e-05 [replace_applicator]: 2.448e-05 [Cycle 2]: 0.00045645, [27] [switch_simplify]: 8.03999e-06 [loop_unroll]: 6.49999e-06 [a_1]: 0.00013361 [with_stream_mark]: 1.837e-05 [recompute_prepare]: 7.77e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 3.49001e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.76e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 3.48999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.156e-05 [j_node_and_user_rematch]: 1.14e-05 [meta_fg_expand]: 2.71999e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 6.21e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 2.45002e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 1.031e-05 [cse]: 1.929e-05 [replace_applicator]: 7.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.609e-05 [rewriter_after_opt_a]: 4.521e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00081004 [jit_opt_b]: 6.3e-05, [1] [Cycle 1]: 5.516e-05, [2] [frontend_op_eliminate]: 2.146e-05 [inline_after_opt_a]: 2.127e-05 [cconv]: 3.201e-05 [loop_unroll]: 0.00052947 [jit_opt_after_cconv]: 0.00021333, [1] [Cycle 1]: 0.0002056, [11] [c_1]: 2.769e-05 [parameter_eliminate]: 3.81001e-06 [updatestate_depend_eliminate]: 8.03001e-06 [updatestate_assign_eliminate]: 3.82998e-06 [updatestate_loads_eliminate]: 2.76999e-06 [cse]: 3.388e-05 [call_graph_tuple_transform]: 2.598e-05 [tuple_list_get_item_eliminator]: 6.85998e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 1.04e-06 [switch_simplify]: 7.75e-06 [remove_dup_value]: 1.685e-05 [partial_unused_args_eliminate]: 1.96998e-06 [environ_conv]: 9.68997e-06 [add_recomputation]: 5.566e-05 [cse_after_recomputation]: 2.581e-05, [1] [Cycle 1]: 1.955e-05, [1] [cse]: 1.211e-05 [auto_monad_reorder]: 1.571e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 7.59002e-06 [opt_after_jit_grad]: 0.00198684 [symbol_engine_optimizer]: 0.00012609, [1] [Cycle 1]: 0.00011761, [6] [build]: 4.90999e-06 [elim_shapecalc]: 9.06002e-06 [elim_not_effective]: 1.699e-05 [opt_reshape]: 7.66001e-06 [fold_const_symbol]: 4.599e-05 [renormalize]: 9.89996e-07 [validate]: 6.358e-05 Sums bootstrap : 0.000316s : 0.34% type_inference : 0.085999s : 91.12% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000309s : 0.33% rewriter_before_opt_a : 0.000093s : 0.10% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.08% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000761s : 0.81% jit_opt_a.with_stream_mark : 0.000042s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002412s : 2.56% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.04% jit_opt_a.cse : 0.000057s : 0.06% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000045s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000810s : 0.86% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000529s : 0.56% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.001987s : 2.11% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000046s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000064s : 0.07% Time group info: ------[substitution.] 0.000271 24 0.93% : 0.000003s : 2: substitution.elim_not_effective 13.32% : 0.000036s : 2: substitution.fold_const_symbol 2.58% : 0.000007s : 4: substitution.graph_param_transform 71.80% : 0.000195s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000006s : 4: substitution.remove_not_recompute_node 2.60% : 0.000007s : 2: substitution.replace_old_param 4.92% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.085905 2 97.57% : 0.083816s : 1: type_inference.infer 2.43% : 0.002088s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.54% : 0.000056s : 4: replace.inline 32.46% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.08% : 0.000192s : 4: match.inline 5.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 2.06% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.70% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.54% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.60% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.53% : 0.000008s : 26: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 18: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.49% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000002s : 12: predicate.minmaximum_grad 2.76% : 0.000004s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.67% : 0.000001s : 4: predicate.reset_defer_inline 1.12% : 0.000002s : 12: predicate.reshape_eliminate 1.12% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 18: predicate.switch_defer_inline 1.87% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000011s : 58: predicate.switch_simplify 1.17% : 0.000002s : 12: predicate.tile_eliminate 1.11% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 12: predicate.value_based_eliminate 0.56% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002505 26 72.29% : 0.001811s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.52% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.19% : 0.000656s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.103193 72 0.06% : 0.000059s : 1: add_recomputation 0.08% : 0.000079s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.32% : 0.000335s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.29% : 0.008560s : 1: jit_opt_a 0.21% : 0.000216s : 1: jit_opt_after_cconv 0.06% : 0.000066s : 1: jit_opt_b 0.52% : 0.000540s : 1: loop_unroll 0.80% : 0.000823s : 1: mutable_eliminate 1.00% : 0.001029s : 26: opt.transform.jit_opt_a 0.06% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000024s : 1: opt.transform.mutable_eliminate 0.04% : 0.000042s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000076s : 4: opt.transform.symbol_engine_opt 1.94% : 0.002001s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000316s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.57% : 0.001621s : 1: renormalize.infer 0.75% : 0.000777s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000050s : 1: rewriter_after_opt_a 0.10% : 0.000099s : 1: rewriter_before_opt_a 0.13% : 0.000129s : 1: symbol_engine_optimizer 83.36% : 0.086021s : 1: type_inference TotalTime = 0.0429394, [30] [bootstrap]: 0.00030312 [type_inference]: 0.0103175 [event_method]: 2.471e-05 [auto_monad]: 7.622e-05 [graph_reusing]: 6.02001e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 6.323e-05 [rewriter_before_opt_a]: 8.877e-05 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.0295251, [2] [Cycle 1]: 0.0252318, [27] [switch_simplify]: 7.445e-05 [loop_unroll]: 3.525e-05 [a_1]: 0.00077785 [with_stream_mark]: 5.864e-05 [recompute_prepare]: 4.3e-05 [updatestate_depend_eliminate]: 6.83e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 3.19001e-06 [specialize_transform]: 9.58002e-06 [updatestate_useless_node_eliminater]: 8.55001e-06 [accelerated_algorithm]: 8.67e-06 [meta_shard_fg_expand]: 6.54999e-06 [get_grad_eliminate_]: 6.79999e-06 [merge_forward]: 4.77998e-06 [cell_reuse_recompute_pass]: 3.08e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.935e-05 [j_node_and_user_rematch]: 1.124e-05 [meta_fg_expand]: 3.50998e-06 [replace_old_param]: 1.348e-05 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00122722 [add_forward_monad_depend]: 7.74002e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 2.02e-05 [cse]: 4.211e-05 [replace_applicator]: 1.755e-05 [Cycle 2]: 0.00036877, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.05002e-06 [a_1]: 0.00011182 [with_stream_mark]: 1.159e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.04003e-06 [meta_shard_fg_expand]: 1.83002e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.59002e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.64e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 7.08e-06 [cse]: 1.686e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 1.575e-05 [rewriter_after_opt_a]: 4.241e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00078447 [jit_opt_b]: 5.652e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.879e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 3.266e-05 [loop_unroll]: 0.00048214 [jit_opt_after_cconv]: 0.00016433, [1] [Cycle 1]: 0.00015793, [11] [c_1]: 2.224e-05 [parameter_eliminate]: 3.73999e-06 [updatestate_depend_eliminate]: 7.58001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 3.255e-05 [call_graph_tuple_transform]: 2.161e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.70028e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 4.609e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 6.93e-06 [add_recomputation]: 5.182e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.935e-05, [1] [cse]: 1.304e-05 [auto_monad_reorder]: 1.895e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 5.99999e-06 [opt_after_jit_grad]: 0.00046727 [symbol_engine_optimizer]: 7.586e-05, [1] [Cycle 1]: 6.939e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 6.09987e-07 [validate]: 4.473e-05 Sums bootstrap : 0.000303s : 1.92% type_inference : 0.010318s : 65.35% event_method : 0.000025s : 0.16% auto_monad : 0.000076s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000063s : 0.40% rewriter_before_opt_a : 0.000089s : 0.56% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000081s : 0.52% jit_opt_a.loop_unroll : 0.000041s : 0.26% jit_opt_a.a_1 : 0.000890s : 5.64% jit_opt_a.with_stream_mark : 0.000070s : 0.44% jit_opt_a.recompute_prepare : 0.000049s : 0.31% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000015s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.09% jit_opt_a.accelerated_algorithm : 0.000014s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000044s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.13% jit_opt_a.meta_fg_expand : 0.000006s : 0.04% jit_opt_a.replace_old_param : 0.000022s : 0.14% jit_opt_a.inline_without_move : 0.000012s : 0.07% jit_opt_a.renormalize : 0.001227s : 7.77% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.17% jit_opt_a.cse : 0.000059s : 0.37% jit_opt_a.replace_applicator : 0.000023s : 0.15% py_interpret_to_execute_after_opt_a : 0.000016s : 0.10% rewriter_after_opt_a : 0.000042s : 0.27% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000784s : 4.97% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.11% cconv : 0.000033s : 0.21% loop_unroll : 0.000482s : 3.05% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000046s : 0.29% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000052s : 0.33% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000467s : 2.96% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.28% Time group info: ------[substitution.] 0.000339 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.81% : 0.000006s : 3: substitution.graph_param_transform 86.67% : 0.000294s : 5: substitution.inline 1.67% : 0.000006s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000008s : 2: substitution.replace_old_param 4.26% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010235 2 86.76% : 0.008879s : 1: type_inference.infer 13.24% : 0.001355s : 1: type_inference.specialize ------[replace.] 0.000120 7 66.49% : 0.000080s : 5: replace.inline 33.51% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000304 7 95.61% : 0.000291s : 5: match.inline 4.39% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 747 1.08% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.49% : 0.000002s : 11: predicate.addn_zero_filter 2.10% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.05% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.97% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.92% : 0.000001s : 11: predicate.environ_get_depend_swap 0.97% : 0.000001s : 11: predicate.environ_get_eliminate 0.96% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.84% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000008s : 24: predicate.inline 0.70% : 0.000001s : 6: predicate.inline_without_move 0.31% : 0.000000s : 6: predicate.j_node_and_user_rematch 2.65% : 0.000004s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 16: predicate.load_eliminater 1.07% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 11: predicate.merge_addn 1.21% : 0.000002s : 11: predicate.minmaximum_grad 2.19% : 0.000003s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000004s : 16: predicate.partial_eliminate 1.35% : 0.000002s : 11: predicate.print_const_string_wrapper 2.37% : 0.000004s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.42% : 0.000002s : 19: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000001s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.15% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.63% : 0.000002s : 11: predicate.same_eliminate 1.53% : 0.000002s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 1.57% : 0.000002s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.33% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.71% : 0.000004s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.76% : 0.000012s : 59: predicate.switch_simplify 1.13% : 0.000002s : 11: predicate.tile_eliminate 1.11% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.04% : 0.000005s : 22: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001083 16 46.10% : 0.000499s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.93% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.97% : 0.000487s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.045407 72 0.12% : 0.000054s : 1: add_recomputation 0.18% : 0.000080s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 0.69% : 0.000315s : 1: bootstrap 0.08% : 0.000035s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.07% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 65.03% : 0.029529s : 1: jit_opt_a 0.37% : 0.000167s : 1: jit_opt_after_cconv 0.13% : 0.000059s : 1: jit_opt_b 1.08% : 0.000490s : 1: loop_unroll 1.75% : 0.000795s : 1: mutable_eliminate 2.64% : 0.001197s : 26: opt.transform.jit_opt_a 0.11% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.05% : 0.000475s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000066s : 1: py_interpret_to_execute 0.04% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000049s : 1: remove_dup_value 1.52% : 0.000688s : 1: renormalize.infer 1.16% : 0.000527s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000046s : 1: rewriter_after_opt_a 0.20% : 0.000093s : 1: rewriter_before_opt_a 0.17% : 0.000078s : 1: symbol_engine_optimizer 22.76% : 0.010335s : 1: type_inference . TotalTime = 0.0216938, [30] [bootstrap]: 0.0003345 [type_inference]: 0.0120057 [event_method]: 2.692e-05 [auto_monad]: 7.851e-05 [graph_reusing]: 7e-06 [pre_auto_parallel]: 3.68e-06 [py_interpret_to_execute]: 7.05e-05 [rewriter_before_opt_a]: 9.698e-05 [expand_dump_flag]: 4.04997e-06 [jit_opt_a]: 0.00664385, [2] [Cycle 1]: 0.00231426, [27] [switch_simplify]: 7.104e-05 [loop_unroll]: 3.431e-05 [a_1]: 0.00069289 [with_stream_mark]: 2.13e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 6.08998e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00111646 [add_forward_monad_depend]: 6.34001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.749e-05 [cse]: 5.085e-05 [replace_applicator]: 1.59e-05 [Cycle 2]: 0.0003436, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.67999e-06 [a_1]: 9.333e-05 [with_stream_mark]: 1.075e-05 [recompute_prepare]: 5.29e-06 [updatestate_depend_eliminate]: 3.32002e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.96998e-06 [get_grad_eliminate_]: 4.89003e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.511e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 5.17e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 6.72002e-06 [cse]: 1.562e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 1.415e-05 [rewriter_after_opt_a]: 4.143e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.00063567 [jit_opt_b]: 5.208e-05, [1] [Cycle 1]: 4.481e-05, [2] [frontend_op_eliminate]: 1.626e-05 [inline_after_opt_a]: 1.706e-05 [cconv]: 2.913e-05 [loop_unroll]: 0.00044565 [jit_opt_after_cconv]: 0.00016576, [1] [Cycle 1]: 0.00015791, [11] [c_1]: 2.176e-05 [parameter_eliminate]: 2.79999e-06 [updatestate_depend_eliminate]: 7.77998e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.75002e-06 [cse]: 3.036e-05 [call_graph_tuple_transform]: 2.182e-05 [tuple_list_get_item_eliminator]: 5.86998e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 3.865e-05 [partial_unused_args_eliminate]: 2.53998e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 5.402e-05 [cse_after_recomputation]: 2.463e-05, [1] [Cycle 1]: 1.909e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.934e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 4.89998e-06 [opt_after_jit_grad]: 0.00055123 [symbol_engine_optimizer]: 7.965e-05, [1] [Cycle 1]: 7.293e-05, [6] [build]: 4.3e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.47e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 4.30009e-07 [validate]: 4.498e-05 Sums bootstrap : 0.000334s : 1.96% type_inference : 0.012006s : 70.30% event_method : 0.000027s : 0.16% auto_monad : 0.000079s : 0.46% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000004s : 0.02% py_interpret_to_execute : 0.000070s : 0.41% rewriter_before_opt_a : 0.000097s : 0.57% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000077s : 0.45% jit_opt_a.loop_unroll : 0.000040s : 0.23% jit_opt_a.a_1 : 0.000786s : 4.60% jit_opt_a.with_stream_mark : 0.000032s : 0.19% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.001117s : 6.54% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.14% jit_opt_a.cse : 0.000066s : 0.39% jit_opt_a.replace_applicator : 0.000022s : 0.13% py_interpret_to_execute_after_opt_a : 0.000014s : 0.08% rewriter_after_opt_a : 0.000041s : 0.24% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000636s : 3.72% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000029s : 0.17% loop_unroll : 0.000446s : 2.61% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000039s : 0.23% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000054s : 0.32% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000019s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000551s : 3.23% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.26% Time group info: ------[substitution.] 0.000290 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000007s : 3: substitution.graph_param_transform 86.93% : 0.000252s : 5: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000005s : 2: substitution.replace_old_param 4.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011923 2 86.84% : 0.010354s : 1: type_inference.infer 13.16% : 0.001569s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.02% : 0.000071s : 5: replace.inline 31.98% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 7 95.49% : 0.000249s : 5: match.inline 4.51% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.22% : 0.000002s : 11: predicate.addn_zero_filter 1.75% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.40% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 5.46% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.41% : 0.000002s : 11: predicate.print_const_string_wrapper 1.74% : 0.000002s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 11: predicate.reshape_eliminate 1.67% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.80% : 0.000004s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.03% : 0.000010s : 59: predicate.switch_simplify 1.23% : 0.000002s : 11: predicate.tile_eliminate 1.26% : 0.000002s : 11: predicate.transpose_eliminate 1.83% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001175 16 47.50% : 0.000558s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.02% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.48% : 0.000523s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023896 72 0.24% : 0.000057s : 1: add_recomputation 0.35% : 0.000083s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.49% : 0.000355s : 1: bootstrap 0.13% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.14% : 0.000032s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 27.82% : 0.006648s : 1: jit_opt_a 0.71% : 0.000169s : 1: jit_opt_after_cconv 0.23% : 0.000055s : 1: jit_opt_b 1.90% : 0.000455s : 1: loop_unroll 2.70% : 0.000645s : 1: mutable_eliminate 4.32% : 0.001031s : 26: opt.transform.jit_opt_a 0.22% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.35% : 0.000561s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000006s : 1: pre_auto_parallel 0.31% : 0.000074s : 1: py_interpret_to_execute 0.07% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000041s : 1: remove_dup_value 2.52% : 0.000601s : 1: renormalize.infer 2.12% : 0.000506s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000044s : 1: rewriter_after_opt_a 0.42% : 0.000101s : 1: rewriter_before_opt_a 0.34% : 0.000082s : 1: symbol_engine_optimizer 50.34% : 0.012029s : 1: type_inference TotalTime = 0.0822981, [30] [bootstrap]: 0.00476158 [type_inference]: 0.0675234 [event_method]: 2.237e-05 [auto_monad]: 7.039e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.93003e-06 [py_interpret_to_execute]: 0.00028055 [rewriter_before_opt_a]: 9.506e-05 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.00721286, [2] [Cycle 1]: 0.00309124, [27] [switch_simplify]: 6.365e-05 [loop_unroll]: 3.105e-05 [a_1]: 0.00058236 [with_stream_mark]: 2.019e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 6.93998e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.95002e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.721e-05 [j_node_and_user_rematch]: 1.089e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00203612 [add_forward_monad_depend]: 6.56999e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 1.673e-05 [cse]: 3.072e-05 [replace_applicator]: 1.667e-05 [Cycle 2]: 0.00037304, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00012672 [with_stream_mark]: 1.049e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 2.29999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 8.42998e-06 [inline_without_move]: 5.64e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.46999e-06 [cse]: 1.251e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.165e-05 [rewriter_after_opt_a]: 3.87e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00062431 [jit_opt_b]: 5.553e-05, [1] [Cycle 1]: 4.898e-05, [2] [frontend_op_eliminate]: 2.025e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 2.59e-05 [loop_unroll]: 0.00043577 [jit_opt_after_cconv]: 0.00015089, [1] [Cycle 1]: 0.00014501, [11] [c_1]: 2.72e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.25999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.60997e-06 [cse]: 2.035e-05 [call_graph_tuple_transform]: 2.108e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.38998e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 8.00999e-06 [add_recomputation]: 4.936e-05 [cse_after_recomputation]: 2.232e-05, [1] [Cycle 1]: 1.738e-05, [1] [cse]: 1.157e-05 [auto_monad_reorder]: 1.568e-05 [get_jit_bprop_graph]: 2.44999e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00049538 [symbol_engine_optimizer]: 9.432e-05, [1] [Cycle 1]: 8.748e-05, [6] [build]: 3.98001e-06 [elim_shapecalc]: 9.31998e-06 [elim_not_effective]: 1.382e-05 [opt_reshape]: 2.037e-05 [fold_const_symbol]: 1.039e-05 [renormalize]: 3.89991e-07 [validate]: 4.231e-05 Sums bootstrap : 0.004762s : 6.11% type_inference : 0.067523s : 86.65% event_method : 0.000022s : 0.03% auto_monad : 0.000070s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000281s : 0.36% rewriter_before_opt_a : 0.000095s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000709s : 0.91% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002036s : 2.61% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000043s : 0.06% jit_opt_a.replace_applicator : 0.000023s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000039s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000624s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000436s : 0.56% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000495s : 0.64% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000020s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.05% Time group info: ------[substitution.] 0.000205 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000006s : 4: substitution.graph_param_transform 81.81% : 0.000167s : 4: substitution.inline 1.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.54% : 0.000005s : 4: substitution.remove_not_recompute_node 2.32% : 0.000005s : 2: substitution.replace_old_param 6.70% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067436 2 97.24% : 0.065572s : 1: type_inference.infer 2.76% : 0.001864s : 1: type_inference.specialize ------[replace.] 0.000075 6 65.92% : 0.000049s : 4: replace.inline 34.08% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.00% : 0.000165s : 4: match.inline 7.00% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.40% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.94% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.62% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.12% : 0.000001s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002508 26 75.11% : 0.001884s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.18% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.71% : 0.000595s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.085370 72 0.06% : 0.000052s : 1: add_recomputation 0.09% : 0.000074s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 5.61% : 0.004794s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.45% : 0.007216s : 1: jit_opt_a 0.18% : 0.000153s : 1: jit_opt_after_cconv 0.07% : 0.000058s : 1: jit_opt_b 0.52% : 0.000444s : 1: loop_unroll 0.74% : 0.000634s : 1: mutable_eliminate 1.12% : 0.000953s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000051s : 4: opt.transform.symbol_engine_opt 0.59% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000288s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.61% : 0.001374s : 1: renormalize.infer 0.77% : 0.000653s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000101s : 1: rewriter_before_opt_a 0.11% : 0.000097s : 1: symbol_engine_optimizer 79.12% : 0.067544s : 1: type_inference TotalTime = 0.128765, [30] [bootstrap]: 0.00037622 [type_inference]: 0.116681 [event_method]: 2.233e-05 [auto_monad]: 9.235e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00051624 [rewriter_before_opt_a]: 9.9e-05 [expand_dump_flag]: 3.95998e-06 [jit_opt_a]: 0.00819839, [2] [Cycle 1]: 0.00433336, [27] [switch_simplify]: 6.325e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.00071345 [with_stream_mark]: 2.401e-05 [recompute_prepare]: 9.09998e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.97e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 7.87e-06 [updatestate_useless_node_eliminater]: 6.16998e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.70002e-06 [get_grad_eliminate_]: 6.45002e-06 [merge_forward]: 4.14002e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 6.06e-06 [renormalize]: 0.00310882 [add_forward_monad_depend]: 8.99e-06 [auto_monad_grad]: 2.48002e-06 [auto_monad_eliminator]: 1.982e-05 [cse]: 3.758e-05 [replace_applicator]: 1.968e-05 [Cycle 2]: 0.00040042, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00013645 [with_stream_mark]: 1.516e-05 [recompute_prepare]: 6.36e-06 [updatestate_depend_eliminate]: 4.04002e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.45001e-06 [specialize_transform]: 5.98998e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 2.76999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.57999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.47998e-06 [cse]: 1.517e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 1.485e-05 [rewriter_after_opt_a]: 4.182e-05 [convert_after_rewriter]: 7.00002e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00068509 [jit_opt_b]: 8.56e-05, [1] [Cycle 1]: 7.77e-05, [2] [frontend_op_eliminate]: 4.579e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 3.021e-05 [loop_unroll]: 0.00044592 [jit_opt_after_cconv]: 0.00017012, [1] [Cycle 1]: 0.00016323, [11] [c_1]: 2.535e-05 [parameter_eliminate]: 4.07998e-06 [updatestate_depend_eliminate]: 8.10999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 3.204e-05 [call_graph_tuple_transform]: 2.38e-05 [tuple_list_get_item_eliminator]: 6.49001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.767e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 9.89999e-06 [add_recomputation]: 5.229e-05 [cse_after_recomputation]: 2.698e-05, [1] [Cycle 1]: 2.183e-05, [1] [cse]: 1.272e-05 [auto_monad_reorder]: 1.831e-05 [get_jit_bprop_graph]: 3.3e-06 [rewriter_after_jit_bprop_graph]: 5.86998e-06 [opt_after_jit_grad]: 0.00070726 [symbol_engine_optimizer]: 0.0001665, [1] [Cycle 1]: 0.00015804, [6] [build]: 5.30001e-06 [elim_shapecalc]: 1.092e-05 [elim_not_effective]: 1.806e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 8.696e-05 [renormalize]: 4.69998e-07 [validate]: 5.97e-05 Sums bootstrap : 0.000376s : 0.30% type_inference : 0.116681s : 93.61% event_method : 0.000022s : 0.02% auto_monad : 0.000092s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000516s : 0.41% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000850s : 0.68% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003109s : 2.49% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000685s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000046s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000446s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000707s : 0.57% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000087s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.05% Time group info: ------[substitution.] 0.000283 28 1.62% : 0.000005s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 82.14% : 0.000233s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.02% : 0.000014s : 3: substitution.reduce_eliminate 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 1.59% : 0.000005s : 2: substitution.replace_old_param 3.83% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116600 2 97.67% : 0.113878s : 1: type_inference.infer 2.33% : 0.002722s : 1: type_inference.specialize ------[replace.] 0.000103 7 67.96% : 0.000070s : 5: replace.inline 32.04% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 7 95.93% : 0.000230s : 5: match.inline 4.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.73% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.49% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.37% : 0.000008s : 28: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.58% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.76% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000004s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 1.94% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.82% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002383 25 65.29% : 0.001556s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.94% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.77% : 0.000757s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133136 72 0.04% : 0.000055s : 1: add_recomputation 0.07% : 0.000096s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000399s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.16% : 0.008202s : 1: jit_opt_a 0.13% : 0.000172s : 1: jit_opt_after_cconv 0.07% : 0.000089s : 1: jit_opt_b 0.34% : 0.000455s : 1: loop_unroll 0.52% : 0.000696s : 1: mutable_eliminate 0.83% : 0.001101s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000057s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000119s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000722s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000529s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.72% : 0.002287s : 1: renormalize.infer 0.61% : 0.000807s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.13% : 0.000170s : 1: symbol_engine_optimizer 87.65% : 0.116698s : 1: type_inference TotalTime = 0.212992, [30] [bootstrap]: 0.00042368 [type_inference]: 0.198983 [event_method]: 2.839e-05 [auto_monad]: 8.36e-05 [graph_reusing]: 5.88998e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00071732 [rewriter_before_opt_a]: 0.00012078 [expand_dump_flag]: 4.63001e-06 [jit_opt_a]: 0.00989572, [2] [Cycle 1]: 0.00517068, [27] [switch_simplify]: 7.558e-05 [loop_unroll]: 3.549e-05 [a_1]: 0.00086966 [with_stream_mark]: 2.43e-05 [recompute_prepare]: 9.25001e-06 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 8.36002e-06 [updatestate_useless_node_eliminater]: 6.78998e-06 [accelerated_algorithm]: 7.73999e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 7.15e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.682e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 6.83e-06 [renormalize]: 0.00373822 [add_forward_monad_depend]: 9.40001e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.211e-05 [cse]: 3.854e-05 [replace_applicator]: 2.273e-05 [Cycle 2]: 0.00042587, [27] [switch_simplify]: 7.85998e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00014446 [with_stream_mark]: 1.626e-05 [recompute_prepare]: 7.16999e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.32001e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 3.81001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.618e-05 [j_node_and_user_rematch]: 1.168e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 6.33e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.543e-05 [replace_applicator]: 6.45002e-06 [py_interpret_to_execute_after_opt_a]: 1.794e-05 [rewriter_after_opt_a]: 4.177e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00082505 [jit_opt_b]: 5.947e-05, [1] [Cycle 1]: 5.118e-05, [2] [frontend_op_eliminate]: 2.025e-05 [inline_after_opt_a]: 1.862e-05 [cconv]: 3.029e-05 [loop_unroll]: 0.0004622 [jit_opt_after_cconv]: 0.00016998, [1] [Cycle 1]: 0.00016178, [11] [c_1]: 2.737e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 7.71001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.746e-05 [call_graph_tuple_transform]: 2.506e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.35997e-06 [remove_dup_value]: 1.862e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 8.88002e-06 [add_recomputation]: 5.347e-05 [cse_after_recomputation]: 2.582e-05, [1] [Cycle 1]: 2.011e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 6.63e-06 [opt_after_jit_grad]: 0.00049626 [symbol_engine_optimizer]: 8.245e-05, [1] [Cycle 1]: 7.499e-05, [6] [build]: 5.14998e-06 [elim_shapecalc]: 8.90001e-06 [elim_not_effective]: 1.484e-05 [opt_reshape]: 7.68999e-06 [fold_const_symbol]: 9.77001e-06 [renormalize]: 3.19997e-07 [validate]: 0.00017869 Sums bootstrap : 0.000424s : 0.20% type_inference : 0.198983s : 95.66% event_method : 0.000028s : 0.01% auto_monad : 0.000084s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000717s : 0.34% rewriter_before_opt_a : 0.000121s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.001014s : 0.49% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003738s : 1.80% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000054s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000825s : 0.40% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000462s : 0.22% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000496s : 0.24% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000179s : 0.09% Time group info: ------[substitution.] 0.000332 28 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.75% : 0.000006s : 4: substitution.graph_param_transform 84.34% : 0.000280s : 5: substitution.inline 1.39% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.56% : 0.000015s : 3: substitution.reduce_eliminate 1.58% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_old_param 3.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.198875 2 98.08% : 0.195048s : 1: type_inference.infer 1.92% : 0.003828s : 1: type_inference.specialize ------[replace.] 0.000202 7 81.58% : 0.000165s : 5: replace.inline 18.42% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000288 7 96.35% : 0.000277s : 5: match.inline 3.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.64% : 0.000003s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000008s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.27% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 2.58% : 0.000004s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.04% : 0.000002s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.43% : 0.000011s : 64: predicate.switch_simplify 1.55% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 2.25% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002938 25 58.54% : 0.001720s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.22% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.24% : 0.001123s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.217957 72 0.03% : 0.000057s : 1: add_recomputation 0.04% : 0.000087s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000445s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.54% : 0.009900s : 1: jit_opt_a 0.08% : 0.000172s : 1: jit_opt_after_cconv 0.03% : 0.000062s : 1: jit_opt_b 0.22% : 0.000471s : 1: loop_unroll 0.38% : 0.000835s : 1: mutable_eliminate 0.59% : 0.001295s : 26: opt.transform.jit_opt_a 0.03% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000506s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000728s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.15% : 0.002500s : 1: renormalize.infer 0.56% : 0.001224s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.06% : 0.000126s : 1: rewriter_before_opt_a 0.04% : 0.000085s : 1: symbol_engine_optimizer 91.31% : 0.199009s : 1: type_inference TotalTime = 0.136038, [30] [bootstrap]: 0.0003029 [type_inference]: 0.12392 [event_method]: 2.674e-05 [auto_monad]: 8.588e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.00058349 [rewriter_before_opt_a]: 0.00010935 [expand_dump_flag]: 3.90998e-06 [jit_opt_a]: 0.00855559, [2] [Cycle 1]: 0.00453895, [27] [switch_simplify]: 6.791e-05 [loop_unroll]: 3.409e-05 [a_1]: 0.00074222 [with_stream_mark]: 2.262e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.01999e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.76e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 1.088e-05 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00328955 [add_forward_monad_depend]: 9.31002e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.926e-05 [cse]: 3.904e-05 [replace_applicator]: 1.904e-05 [Cycle 2]: 0.0003951, [27] [switch_simplify]: 7.28e-06 [loop_unroll]: 6.56e-06 [a_1]: 0.00013019 [with_stream_mark]: 1.306e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 6.41998e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 5.93998e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.753e-05 [j_node_and_user_rematch]: 9.75002e-06 [meta_fg_expand]: 2.81999e-06 [replace_old_param]: 8.89998e-06 [inline_without_move]: 5.76e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.55e-05 [replace_applicator]: 6.26998e-06 [py_interpret_to_execute_after_opt_a]: 1.586e-05 [rewriter_after_opt_a]: 4.123e-05 [convert_after_rewriter]: 6.78998e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00065513 [jit_opt_b]: 5.734e-05, [1] [Cycle 1]: 5.026e-05, [2] [frontend_op_eliminate]: 1.976e-05 [inline_after_opt_a]: 1.895e-05 [cconv]: 2.828e-05 [loop_unroll]: 0.00042556 [jit_opt_after_cconv]: 0.00018039, [1] [Cycle 1]: 0.0001733, [11] [c_1]: 2.7e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 6.36998e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.571e-05 [call_graph_tuple_transform]: 2.141e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 2.513e-05 [remove_dup_value]: 2.047e-05 [partial_unused_args_eliminate]: 2.63e-06 [environ_conv]: 8.80999e-06 [add_recomputation]: 5.352e-05 [cse_after_recomputation]: 2.756e-05, [1] [Cycle 1]: 2.212e-05, [1] [cse]: 1.521e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 5.58002e-06 [opt_after_jit_grad]: 0.00047546 [symbol_engine_optimizer]: 7.855e-05, [1] [Cycle 1]: 7.233e-05, [6] [build]: 3.45998e-06 [elim_shapecalc]: 8.99998e-06 [elim_not_effective]: 1.448e-05 [opt_reshape]: 7.06001e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 3.00002e-07 [validate]: 0.00014195 Sums bootstrap : 0.000303s : 0.23% type_inference : 0.123920s : 94.02% event_method : 0.000027s : 0.02% auto_monad : 0.000086s : 0.07% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000583s : 0.44% rewriter_before_opt_a : 0.000109s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000872s : 0.66% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003290s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000655s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000426s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000025s : 0.02% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000475s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000142s : 0.11% Time group info: ------[substitution.] 0.000301 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.02% : 0.000006s : 4: substitution.graph_param_transform 88.03% : 0.000265s : 5: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000005s : 2: substitution.replace_old_param 4.14% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123812 2 96.88% : 0.119944s : 1: type_inference.infer 3.12% : 0.003869s : 1: type_inference.specialize ------[replace.] 0.000110 7 70.72% : 0.000078s : 5: replace.inline 29.28% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 95.92% : 0.000262s : 5: match.inline 4.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.34% : 0.000002s : 13: predicate.addn_check_dump 1.94% : 0.000003s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.37% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.73% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.52% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.53% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 20: predicate.switch_defer_inline 2.26% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.34% : 0.000011s : 64: predicate.switch_simplify 1.56% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002618 25 60.10% : 0.001574s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.48% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.42% : 0.000954s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140447 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000090s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000316s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.09% : 0.008559s : 1: jit_opt_a 0.13% : 0.000183s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.31% : 0.000433s : 1: loop_unroll 0.47% : 0.000664s : 1: mutable_eliminate 0.81% : 0.001132s : 26: opt.transform.jit_opt_a 0.06% : 0.000077s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000591s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.64% : 0.002307s : 1: renormalize.infer 0.69% : 0.000972s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000115s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.25% : 0.123942s : 1: type_inference TotalTime = 0.0165437, [30] [bootstrap]: 0.0002984 [type_inference]: 0.00807009 [event_method]: 2e-05 [auto_monad]: 7.488e-05 [graph_reusing]: 6.69001e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 4.636e-05 [rewriter_before_opt_a]: 7.82e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.00579315, [2] [Cycle 1]: 0.0017574, [27] [switch_simplify]: 5.8e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00056193 [with_stream_mark]: 2.171e-05 [recompute_prepare]: 8.06001e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.36998e-06 [meta_shard_fg_expand]: 2.89999e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 5.71998e-06 [renormalize]: 0.00074006 [add_forward_monad_depend]: 5.62001e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 3.058e-05 [replace_applicator]: 1.285e-05 [Cycle 2]: 0.00033732, [27] [switch_simplify]: 5.51998e-06 [loop_unroll]: 4.97e-06 [a_1]: 9.354e-05 [with_stream_mark]: 8.91002e-06 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 8.49977e-07 [specialize_transform]: 5.47999e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 4.88001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 8.16002e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 5.09998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.54998e-06 [cse]: 1.226e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.189e-05 [rewriter_after_opt_a]: 3.717e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00051976 [jit_opt_b]: 5.071e-05, [1] [Cycle 1]: 4.337e-05, [2] [frontend_op_eliminate]: 1.567e-05 [inline_after_opt_a]: 1.553e-05 [cconv]: 2.554e-05 [loop_unroll]: 0.00045532 [jit_opt_after_cconv]: 0.00015071, [1] [Cycle 1]: 0.00014364, [11] [c_1]: 2.056e-05 [parameter_eliminate]: 2.31998e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.16003e-06 [cse]: 1.978e-05 [call_graph_tuple_transform]: 2.116e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 5.62001e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 5.067e-05 [cse_after_recomputation]: 2.497e-05, [1] [Cycle 1]: 1.901e-05, [1] [cse]: 1.192e-05 [auto_monad_reorder]: 1.685e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00046645 [symbol_engine_optimizer]: 7.57e-05, [1] [Cycle 1]: 6.976e-05, [6] [build]: 3.58e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.83001e-06 [renormalize]: 4.00003e-07 [validate]: 4.026e-05 Sums bootstrap : 0.000298s : 2.44% type_inference : 0.008070s : 66.00% event_method : 0.000020s : 0.16% auto_monad : 0.000075s : 0.61% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.38% rewriter_before_opt_a : 0.000078s : 0.64% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.52% jit_opt_a.loop_unroll : 0.000036s : 0.29% jit_opt_a.a_1 : 0.000655s : 5.36% jit_opt_a.with_stream_mark : 0.000031s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000740s : 6.05% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000043s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000037s : 0.30% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000520s : 4.25% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000455s : 3.72% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000051s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000466s : 3.82% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.33% Time group info: ------[substitution.] 0.000226 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000006s : 3: substitution.graph_param_transform 84.27% : 0.000191s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007990 2 49.15% : 0.003928s : 1: type_inference.infer 50.85% : 0.004063s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.81% : 0.000044s : 4: replace.inline 33.19% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.06% : 0.000188s : 4: match.inline 5.94% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.56% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.15% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 6.38% : 0.000008s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.78% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000670 13 48.34% : 0.000324s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.57% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.10% : 0.000296s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018213 72 0.30% : 0.000054s : 1: add_recomputation 0.43% : 0.000078s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.70% : 0.000310s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.11% : 0.000020s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.83% : 0.005796s : 1: jit_opt_a 0.84% : 0.000153s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.55% : 0.000464s : 1: loop_unroll 2.90% : 0.000529s : 1: mutable_eliminate 4.81% : 0.000875s : 26: opt.transform.jit_opt_a 0.27% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.61% : 0.000475s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000049s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.24% : 0.000409s : 1: renormalize.infer 1.77% : 0.000323s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000040s : 1: rewriter_after_opt_a 0.45% : 0.000081s : 1: rewriter_before_opt_a 0.43% : 0.000078s : 1: symbol_engine_optimizer 44.41% : 0.008087s : 1: type_inference TotalTime = 0.0141643, [30] [bootstrap]: 0.00032928 [type_inference]: 0.00480242 [event_method]: 1.805e-05 [auto_monad]: 6.801e-05 [graph_reusing]: 6.68998e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 4.581e-05 [rewriter_before_opt_a]: 7.493e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.00653932, [2] [Cycle 1]: 0.00162501, [27] [switch_simplify]: 4.71e-05 [loop_unroll]: 3.07e-05 [a_1]: 0.00050142 [with_stream_mark]: 1.443e-05 [recompute_prepare]: 7.89002e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.242e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 7.59002e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 0.00071717 [add_forward_monad_depend]: 6.58e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 1.539e-05 [cse]: 3.03e-05 [replace_applicator]: 1.29e-05 [Cycle 2]: 0.00032072, [27] [switch_simplify]: 5.53002e-06 [loop_unroll]: 5.01002e-06 [a_1]: 9.138e-05 [with_stream_mark]: 9.53002e-06 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 4.86997e-06 [accelerated_algorithm]: 4.64002e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.85998e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 7.83999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 7.36999e-06 [inline_without_move]: 4.82998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.18998e-06 [cse]: 1.235e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.38e-05 [rewriter_after_opt_a]: 3.601e-05 [convert_after_rewriter]: 7.61999e-06 [order_py_execute_after_rewriter]: 4.96997e-06 [mutable_eliminate]: 0.00062885 [jit_opt_b]: 5.578e-05, [1] [Cycle 1]: 4.859e-05, [2] [frontend_op_eliminate]: 1.709e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 2.811e-05 [loop_unroll]: 0.00047141 [jit_opt_after_cconv]: 0.00013907, [1] [Cycle 1]: 0.00013296, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 2.70997e-06 [updatestate_depend_eliminate]: 5.17999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 1.992e-05 [call_graph_tuple_transform]: 1.875e-05 [tuple_list_get_item_eliminator]: 5.29998e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 1.684e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 6.15002e-06 [add_recomputation]: 6.65e-05 [cse_after_recomputation]: 2.713e-05, [1] [Cycle 1]: 2.064e-05, [1] [cse]: 1.364e-05 [auto_monad_reorder]: 1.656e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 6.14001e-06 [opt_after_jit_grad]: 0.00046138 [symbol_engine_optimizer]: 7.271e-05, [1] [Cycle 1]: 6.64e-05, [6] [build]: 3.52002e-06 [elim_shapecalc]: 7.65998e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 5.88002e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 4.39992e-07 [validate]: 3.628e-05 Sums bootstrap : 0.000329s : 3.66% type_inference : 0.004802s : 53.35% event_method : 0.000018s : 0.20% auto_monad : 0.000068s : 0.76% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000046s : 0.51% rewriter_before_opt_a : 0.000075s : 0.83% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000053s : 0.58% jit_opt_a.loop_unroll : 0.000036s : 0.40% jit_opt_a.a_1 : 0.000593s : 6.58% jit_opt_a.with_stream_mark : 0.000024s : 0.27% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000717s : 7.97% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000043s : 0.47% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000014s : 0.15% rewriter_after_opt_a : 0.000036s : 0.40% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000629s : 6.99% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000018s : 0.20% cconv : 0.000028s : 0.31% loop_unroll : 0.000471s : 5.24% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000067s : 0.74% cse_after_recomputation.cse : 0.000014s : 0.15% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000461s : 5.13% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.40% Time group info: ------[substitution.] 0.000165 23 1.37% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000001s : 2: substitution.fold_const_symbol 3.35% : 0.000006s : 3: substitution.graph_param_transform 83.14% : 0.000137s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000004s : 4: substitution.remove_not_recompute_node 1.93% : 0.000003s : 2: substitution.replace_old_param 5.23% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004740 2 80.34% : 0.003808s : 1: type_inference.infer 19.66% : 0.000932s : 1: type_inference.specialize ------[replace.] 0.000067 6 64.53% : 0.000043s : 4: replace.inline 35.47% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 94.81% : 0.000135s : 4: match.inline 5.19% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.53% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.62% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.11% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.12% : 0.000003s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.45% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000002s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000666 13 50.74% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.33% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.93% : 0.000299s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015742 72 0.45% : 0.000070s : 1: add_recomputation 0.45% : 0.000072s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.19% : 0.000346s : 1: bootstrap 0.20% : 0.000031s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000029s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 41.56% : 0.006542s : 1: jit_opt_a 0.90% : 0.000142s : 1: jit_opt_after_cconv 0.37% : 0.000058s : 1: jit_opt_b 3.05% : 0.000480s : 1: loop_unroll 4.06% : 0.000638s : 1: mutable_eliminate 5.05% : 0.000795s : 26: opt.transform.jit_opt_a 0.30% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.98% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000049s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.35% : 0.000370s : 1: renormalize.infer 2.17% : 0.000341s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.49% : 0.000078s : 1: rewriter_before_opt_a 0.48% : 0.000075s : 1: symbol_engine_optimizer 30.61% : 0.004818s : 1: type_inference TotalTime = 0.136773, [30] [bootstrap]: 0.00031529 [type_inference]: 0.126493 [event_method]: 1.878e-05 [auto_monad]: 4.709e-05 [graph_reusing]: 3.75e-06 [pre_auto_parallel]: 1.87001e-06 [py_interpret_to_execute]: 0.00046752 [rewriter_before_opt_a]: 8.446e-05 [expand_dump_flag]: 3.05998e-06 [jit_opt_a]: 0.00715346, [2] [Cycle 1]: 0.00363637, [27] [switch_simplify]: 6.125e-05 [loop_unroll]: 3.444e-05 [a_1]: 0.00066844 [with_stream_mark]: 2.085e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 7.9e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 2.50997e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 6.14001e-06 [renormalize]: 0.00249525 [add_forward_monad_depend]: 6.13002e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.45e-05 [cse]: 2.858e-05 [replace_applicator]: 1.497e-05 [Cycle 2]: 0.00039173, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00014145 [with_stream_mark]: 1.152e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.234e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.79e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.497e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.17e-05 [rewriter_after_opt_a]: 3.007e-05 [convert_after_rewriter]: 6.06e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00055325 [jit_opt_b]: 5.367e-05, [1] [Cycle 1]: 4.709e-05, [2] [frontend_op_eliminate]: 1.809e-05 [inline_after_opt_a]: 1.796e-05 [cconv]: 2.068e-05 [loop_unroll]: 0.00042334 [jit_opt_after_cconv]: 0.00015024, [1] [Cycle 1]: 0.00014357, [11] [c_1]: 2.469e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.39999e-06 [cse]: 2.367e-05 [call_graph_tuple_transform]: 1.949e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.21002e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.58998e-06 [remove_dup_value]: 1.397e-05 [partial_unused_args_eliminate]: 1.69e-06 [environ_conv]: 7.21999e-06 [add_recomputation]: 3.719e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.282e-05 [auto_monad_reorder]: 1.348e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.00046835 [symbol_engine_optimizer]: 8.151e-05, [1] [Cycle 1]: 7.467e-05, [6] [build]: 3.21999e-06 [elim_shapecalc]: 8.38001e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 9.44e-06 [fold_const_symbol]: 1.067e-05 [renormalize]: 3.4002e-07 [validate]: 0.00010322 Sums bootstrap : 0.000315s : 0.24% type_inference : 0.126493s : 95.07% event_method : 0.000019s : 0.01% auto_monad : 0.000047s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000468s : 0.35% rewriter_before_opt_a : 0.000084s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000810s : 0.61% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002495s : 1.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000030s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000553s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000021s : 0.02% loop_unroll : 0.000423s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000468s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000103s : 0.08% Time group info: ------[substitution.] 0.000251 28 0.55% : 0.000001s : 2: substitution.elim_not_effective 0.87% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000005s : 4: substitution.graph_param_transform 81.80% : 0.000205s : 5: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.08% : 0.000013s : 3: substitution.reduce_eliminate 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.51% : 0.000004s : 2: substitution.replace_old_param 4.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126425 2 97.84% : 0.123694s : 1: type_inference.infer 2.16% : 0.002732s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.43% : 0.000064s : 5: replace.inline 31.57% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 7 94.96% : 0.000202s : 5: match.inline 5.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.48% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.52% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.93% : 0.000008s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.99% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.47% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002312 25 65.44% : 0.001513s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.55% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.02% : 0.000740s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140334 72 0.03% : 0.000040s : 1: add_recomputation 0.04% : 0.000050s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000334s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.10% : 0.007157s : 1: jit_opt_a 0.11% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.31% : 0.000431s : 1: loop_unroll 0.40% : 0.000562s : 1: mutable_eliminate 0.75% : 0.001052s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000476s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.24% : 0.001736s : 1: renormalize.infer 0.53% : 0.000751s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000033s : 1: rewriter_after_opt_a 0.06% : 0.000090s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 90.15% : 0.126505s : 1: type_inference TotalTime = 0.094401, [30] [bootstrap]: 0.0002981 [type_inference]: 0.0828559 [event_method]: 0.00033437 [auto_monad]: 0.0001307 [graph_reusing]: 8.67998e-06 [pre_auto_parallel]: 3.27997e-06 [py_interpret_to_execute]: 4.305e-05 [rewriter_before_opt_a]: 0.00013812 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00803111, [2] [Cycle 1]: 0.00426559, [27] [switch_simplify]: 0.00017958 [loop_unroll]: 6.037e-05 [a_1]: 0.00137836 [with_stream_mark]: 2.487e-05 [recompute_prepare]: 1.06e-05 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.47002e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 4.34002e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.585e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.92001e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00221203 [add_forward_monad_depend]: 9.07001e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.753e-05 [cse]: 3.654e-05 [replace_applicator]: 2.056e-05 [Cycle 2]: 0.00034709, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 6.01e-06 [a_1]: 9.682e-05 [with_stream_mark]: 1.382e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.29998e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 2.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 7.46001e-06 [inline_without_move]: 5.09e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.70028e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.239e-05 [replace_applicator]: 5.51002e-06 [py_interpret_to_execute_after_opt_a]: 1.465e-05 [rewriter_after_opt_a]: 3.81e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00072703 [jit_opt_b]: 5.432e-05, [1] [Cycle 1]: 4.634e-05, [2] [frontend_op_eliminate]: 1.714e-05 [inline_after_opt_a]: 1.73e-05 [cconv]: 2.859e-05 [loop_unroll]: 0.00046119 [jit_opt_after_cconv]: 0.00016017, [1] [Cycle 1]: 0.00015323, [11] [c_1]: 2.341e-05 [parameter_eliminate]: 2.95002e-06 [updatestate_depend_eliminate]: 6.19001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 3.057e-05 [call_graph_tuple_transform]: 1.999e-05 [tuple_list_get_item_eliminator]: 5.19e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 6.24001e-06 [add_recomputation]: 5.215e-05 [cse_after_recomputation]: 2.397e-05, [1] [Cycle 1]: 1.856e-05, [1] [cse]: 1.296e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 7.33e-06 [opt_after_jit_grad]: 0.00048531 [symbol_engine_optimizer]: 0.00020044, [1] [Cycle 1]: 0.00019355, [6] [build]: 4.03999e-06 [elim_shapecalc]: 7.56999e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 8.77999e-06 [fold_const_symbol]: 0.00012805 [renormalize]: 5.3001e-07 [validate]: 4.462e-05 Sums bootstrap : 0.000298s : 0.33% type_inference : 0.082856s : 91.73% event_method : 0.000334s : 0.37% auto_monad : 0.000131s : 0.14% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000043s : 0.05% rewriter_before_opt_a : 0.000138s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000187s : 0.21% jit_opt_a.loop_unroll : 0.000066s : 0.07% jit_opt_a.a_1 : 0.001475s : 1.63% jit_opt_a.with_stream_mark : 0.000039s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002212s : 2.45% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000049s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000727s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000461s : 0.51% jit_opt_after_cconv.c_1 : 0.000023s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000485s : 0.54% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000128s : 0.14% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.05% Time group info: ------[substitution.] 0.000681 35 0.29% : 0.000002s : 2: substitution.elim_not_effective 17.62% : 0.000120s : 2: substitution.fold_const_symbol 0.76% : 0.000005s : 3: substitution.graph_param_transform 74.55% : 0.000508s : 12: substitution.inline 0.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.81% : 0.000005s : 4: substitution.remove_not_recompute_node 0.67% : 0.000005s : 2: substitution.replace_old_param 1.32% : 0.000009s : 1: substitution.reshape_eliminate 1.80% : 0.000012s : 3: substitution.switch_simplify 1.53% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.082769 2 96.40% : 0.079793s : 1: type_inference.infer 3.60% : 0.002976s : 1: type_inference.specialize ------[replace.] 0.000288 18 52.73% : 0.000152s : 12: replace.inline 1.59% : 0.000005s : 1: replace.reshape_eliminate 19.78% : 0.000057s : 3: replace.switch_simplify 25.90% : 0.000075s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000530 18 94.71% : 0.000502s : 12: match.inline 1.52% : 0.000008s : 1: match.reshape_eliminate 2.01% : 0.000011s : 3: match.switch_simplify 1.76% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000197 1212 1.51% : 0.000003s : 19: predicate.accumulaten_eliminater 0.68% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 19: predicate.addn_check_dump 1.45% : 0.000003s : 19: predicate.addn_zero_filter 1.93% : 0.000004s : 19: predicate.arithmetic_simplify 1.62% : 0.000003s : 20: predicate.cast_eliminate 0.27% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 19: predicate.compare_switch_simplify 1.46% : 0.000003s : 19: predicate.depend_value_elim 1.31% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.43% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.38% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.17% : 0.000000s : 3: predicate.elim_not_effective 0.36% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.28% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.30% : 0.000003s : 20: predicate.environ_get_depend_swap 1.44% : 0.000003s : 20: predicate.environ_get_eliminate 1.30% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.13% : 0.000000s : 3: predicate.fold_const_symbol 0.57% : 0.000001s : 6: predicate.get_grad_eliminate 0.14% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000011s : 40: predicate.inline 0.52% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.63% : 0.000001s : 6: predicate.less_batch_normalization 1.70% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.83% : 0.000004s : 25: predicate.load_eliminater 0.78% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.49% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.84% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 19: predicate.merge_addn 1.23% : 0.000002s : 19: predicate.minmaximum_grad 1.24% : 0.000002s : 3: predicate.mutable_eliminate 0.35% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000004s : 25: predicate.partial_eliminate 1.31% : 0.000003s : 19: predicate.print_const_string_wrapper 1.70% : 0.000003s : 19: predicate.reduce_eliminate 1.51% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.42% : 0.000001s : 6: predicate.remove_not_recompute_node 1.51% : 0.000003s : 28: predicate.replace_applicator 0.30% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 2.00% : 0.000004s : 20: predicate.reshape_eliminate 1.47% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000003s : 19: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.51% : 0.000001s : 6: predicate.special_op_eliminate 0.54% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.36% : 0.000007s : 34: predicate.switch_defer_inline 2.67% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.99% : 0.000018s : 107: predicate.switch_simplify 1.68% : 0.000003s : 19: predicate.tile_eliminate 1.49% : 0.000003s : 19: predicate.transpose_eliminate 1.64% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.65% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.58% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.59% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.71% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.38% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.64% : 0.000003s : 19: predicate.value_based_eliminate 0.21% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.31% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003135 40 61.75% : 0.001936s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.81% : 0.000276s : 5: func_graph_cloner_run.FuncGraphClonerNode 29.44% : 0.000923s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.098650 72 0.06% : 0.000055s : 1: add_recomputation 0.14% : 0.000138s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.32% : 0.000315s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.35% : 0.000343s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 8.14% : 0.008035s : 1: jit_opt_a 0.16% : 0.000163s : 1: jit_opt_after_cconv 0.06% : 0.000057s : 1: jit_opt_b 0.48% : 0.000470s : 1: loop_unroll 0.75% : 0.000737s : 1: mutable_eliminate 1.89% : 0.001864s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000155s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.05% : 0.000046s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.48% : 0.001461s : 1: renormalize.infer 0.75% : 0.000741s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.14% : 0.000142s : 1: rewriter_before_opt_a 0.21% : 0.000203s : 1: symbol_engine_optimizer 84.01% : 0.082875s : 1: type_inference TotalTime = 0.246335, [30] [bootstrap]: 0.00040709 [type_inference]: 0.231246 [event_method]: 2.818e-05 [auto_monad]: 8.611e-05 [graph_reusing]: 7.23e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 0.00066145 [rewriter_before_opt_a]: 0.00011878 [expand_dump_flag]: 4.90999e-06 [jit_opt_a]: 0.0104606, [2] [Cycle 1]: 0.00509536, [27] [switch_simplify]: 7.622e-05 [loop_unroll]: 3.658e-05 [a_1]: 0.00086199 [with_stream_mark]: 3.239e-05 [recompute_prepare]: 1.588e-05 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 8.84e-06 [updatestate_useless_node_eliminater]: 6.94001e-06 [accelerated_algorithm]: 8.07e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 8.33001e-06 [merge_forward]: 5.36002e-06 [cell_reuse_recompute_pass]: 2.78e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.755e-05 [j_node_and_user_rematch]: 1.254e-05 [meta_fg_expand]: 2.60002e-06 [replace_old_param]: 1.227e-05 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00359427 [add_forward_monad_depend]: 1.054e-05 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 2.392e-05 [cse]: 4.348e-05 [replace_applicator]: 2.644e-05 [Cycle 2]: 0.00050455, [27] [switch_simplify]: 7.93999e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00015142 [with_stream_mark]: 1.751e-05 [recompute_prepare]: 7.21999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 3.77002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.688e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 6.56e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.27999e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 8.74998e-06 [cse]: 2.047e-05 [replace_applicator]: 7.14001e-06 [py_interpret_to_execute_after_opt_a]: 2.108e-05 [rewriter_after_opt_a]: 4.435e-05 [convert_after_rewriter]: 7.40998e-06 [order_py_execute_after_rewriter]: 1.154e-05 [mutable_eliminate]: 0.00108937 [jit_opt_b]: 7.307e-05, [1] [Cycle 1]: 6.232e-05, [2] [frontend_op_eliminate]: 2.293e-05 [inline_after_opt_a]: 2.545e-05 [cconv]: 4.025e-05 [loop_unroll]: 0.00052962 [jit_opt_after_cconv]: 0.00020786, [1] [Cycle 1]: 0.00020055, [11] [c_1]: 2.771e-05 [parameter_eliminate]: 5.39e-06 [updatestate_depend_eliminate]: 1.13e-05 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.18998e-06 [cse]: 4.459e-05 [call_graph_tuple_transform]: 3.081e-05 [tuple_list_get_item_eliminator]: 6.73998e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 7.7e-07 [switch_simplify]: 6.69999e-06 [remove_dup_value]: 1.939e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 1.075e-05 [add_recomputation]: 6.007e-05 [cse_after_recomputation]: 3.22e-05, [1] [Cycle 1]: 2.255e-05, [1] [cse]: 1.537e-05 [auto_monad_reorder]: 1.853e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 1.027e-05 [opt_after_jit_grad]: 0.00057685 [symbol_engine_optimizer]: 0.00022826, [1] [Cycle 1]: 0.00022008, [6] [build]: 6.01e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.986e-05 [opt_reshape]: 8.43999e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 9.80013e-07 [validate]: 6.281e-05 Sums bootstrap : 0.000407s : 0.17% type_inference : 0.231246s : 96.16% event_method : 0.000028s : 0.01% auto_monad : 0.000086s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000661s : 0.28% rewriter_before_opt_a : 0.000119s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.001013s : 0.42% jit_opt_a.with_stream_mark : 0.000050s : 0.02% jit_opt_a.recompute_prepare : 0.000023s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003594s : 1.49% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000064s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000012s : 0.00% mutable_eliminate : 0.001089s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000040s : 0.02% loop_unroll : 0.000530s : 0.22% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000060s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000577s : 0.24% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000063s : 0.03% Time group info: ------[substitution.] 0.000369 28 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 1.86% : 0.000007s : 4: substitution.graph_param_transform 84.28% : 0.000311s : 5: substitution.inline 1.58% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000016s : 3: substitution.reduce_eliminate 1.33% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000007s : 2: substitution.replace_old_param 3.94% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.231119 2 98.23% : 0.227021s : 1: type_inference.infer 1.77% : 0.004097s : 1: type_inference.specialize ------[replace.] 0.000129 7 68.50% : 0.000089s : 5: replace.inline 31.50% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000320 7 95.88% : 0.000307s : 5: match.inline 4.12% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000171 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.49% : 0.000003s : 13: predicate.addn_zero_filter 2.99% : 0.000005s : 13: predicate.arithmetic_simplify 1.49% : 0.000003s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 0.95% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.32% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.89% : 0.000002s : 13: predicate.environ_get_depend_swap 1.01% : 0.000002s : 13: predicate.environ_get_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.52% : 0.000003s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.51% : 0.000009s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.00% : 0.000003s : 8: predicate.less_batch_normalization 1.57% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 19: predicate.load_eliminater 1.69% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.23% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 13: predicate.merge_addn 0.94% : 0.000002s : 13: predicate.minmaximum_grad 2.86% : 0.000005s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.05% : 0.000002s : 13: predicate.print_const_string_wrapper 2.81% : 0.000005s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000003s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.93% : 0.000002s : 4: predicate.row_tensor_eliminate 1.03% : 0.000002s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000002s : 8: predicate.specialize_transform 1.10% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.06% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.86% : 0.000005s : 20: predicate.switch_defer_inline 2.06% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.49% : 0.000013s : 64: predicate.switch_simplify 1.55% : 0.000003s : 13: predicate.tile_eliminate 1.01% : 0.000002s : 13: predicate.transpose_eliminate 1.17% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.28% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003072 25 64.01% : 0.001966s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.29% : 0.000101s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.71% : 0.001005s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.251315 72 0.03% : 0.000063s : 1: add_recomputation 0.04% : 0.000091s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.17% : 0.000430s : 1: bootstrap 0.02% : 0.000044s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 4.16% : 0.010466s : 1: jit_opt_a 0.08% : 0.000211s : 1: jit_opt_after_cconv 0.03% : 0.000076s : 1: jit_opt_b 0.21% : 0.000540s : 1: loop_unroll 0.44% : 0.001103s : 1: mutable_eliminate 0.52% : 0.001313s : 26: opt.transform.jit_opt_a 0.03% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000027s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000589s : 1: opt_after_jit_grad 0.01% : 0.000014s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000673s : 1: py_interpret_to_execute 0.01% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 1.02% : 0.002572s : 1: renormalize.infer 0.40% : 0.001005s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.05% : 0.000127s : 1: rewriter_before_opt_a 0.09% : 0.000231s : 1: symbol_engine_optimizer 92.03% : 0.231286s : 1: type_inference TotalTime = 0.0163732, [30] [bootstrap]: 0.00029812 [type_inference]: 0.00788984 [event_method]: 2.063e-05 [auto_monad]: 6.886e-05 [graph_reusing]: 6.44999e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.361e-05 [rewriter_before_opt_a]: 8.162e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00565333, [2] [Cycle 1]: 0.00191547, [27] [switch_simplify]: 6.233e-05 [loop_unroll]: 3.287e-05 [a_1]: 0.00066399 [with_stream_mark]: 2.02e-05 [recompute_prepare]: 9.14998e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.51e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 0.00075728 [add_forward_monad_depend]: 6.47001e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.722e-05 [cse]: 3.596e-05 [replace_applicator]: 1.742e-05 [Cycle 2]: 0.00035765, [27] [switch_simplify]: 6.31e-06 [loop_unroll]: 5.25999e-06 [a_1]: 0.00010118 [with_stream_mark]: 1.233e-05 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 2.84001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.162e-05 [j_node_and_user_rematch]: 7.98001e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 7.98001e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 6.46e-06 [cse]: 1.466e-05 [replace_applicator]: 5.68997e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 3.906e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.0006569 [jit_opt_b]: 5.25e-05, [1] [Cycle 1]: 4.408e-05, [2] [frontend_op_eliminate]: 1.615e-05 [inline_after_opt_a]: 1.602e-05 [cconv]: 2.777e-05 [loop_unroll]: 0.00043729 [jit_opt_after_cconv]: 0.00017109, [1] [Cycle 1]: 0.00016438, [11] [c_1]: 2.049e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 7.26999e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.89e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 1.691e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 6.74001e-06 [add_recomputation]: 5.177e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.93e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 6.15002e-06 [opt_after_jit_grad]: 0.0004601 [symbol_engine_optimizer]: 7.358e-05, [1] [Cycle 1]: 6.746e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 7.72998e-06 [elim_not_effective]: 1.226e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 5.39992e-07 [validate]: 4.488e-05 Sums bootstrap : 0.000298s : 2.42% type_inference : 0.007890s : 63.93% event_method : 0.000021s : 0.17% auto_monad : 0.000069s : 0.56% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.35% rewriter_before_opt_a : 0.000082s : 0.66% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.56% jit_opt_a.loop_unroll : 0.000038s : 0.31% jit_opt_a.a_1 : 0.000765s : 6.20% jit_opt_a.with_stream_mark : 0.000033s : 0.26% jit_opt_a.recompute_prepare : 0.000015s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000757s : 6.14% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.19% jit_opt_a.cse : 0.000051s : 0.41% jit_opt_a.replace_applicator : 0.000023s : 0.19% py_interpret_to_execute_after_opt_a : 0.000015s : 0.12% rewriter_after_opt_a : 0.000039s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000657s : 5.32% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000028s : 0.23% loop_unroll : 0.000437s : 3.54% jit_opt_after_cconv.c_1 : 0.000020s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000052s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000460s : 3.73% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.36% Time group info: ------[substitution.] 0.000272 27 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 3: substitution.graph_param_transform 82.62% : 0.000225s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.71% : 0.000013s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 4.03% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007816 2 87.36% : 0.006828s : 1: type_inference.infer 12.64% : 0.000988s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.39% : 0.000065s : 5: replace.inline 32.61% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 7 95.73% : 0.000221s : 5: match.inline 4.27% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.22% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.15% : 0.000001s : 11: predicate.addn_zero_filter 2.12% : 0.000003s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.19% : 0.000001s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 24: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 16: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 2.11% : 0.000003s : 11: predicate.reduce_eliminate 1.60% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 18: predicate.switch_defer_inline 2.37% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.10% : 0.000010s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.26% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000784 16 49.13% : 0.000385s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.17% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.70% : 0.000327s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018171 72 0.30% : 0.000055s : 1: add_recomputation 0.40% : 0.000072s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.74% : 0.000317s : 1: bootstrap 0.17% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.13% : 0.005657s : 1: jit_opt_a 0.96% : 0.000174s : 1: jit_opt_after_cconv 0.30% : 0.000055s : 1: jit_opt_b 2.45% : 0.000446s : 1: loop_unroll 3.68% : 0.000669s : 1: mutable_eliminate 5.48% : 0.000996s : 26: opt.transform.jit_opt_a 0.27% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.58% : 0.000469s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000046s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.24% : 0.000407s : 1: renormalize.infer 1.88% : 0.000341s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.47% : 0.000085s : 1: rewriter_before_opt_a 0.42% : 0.000076s : 1: symbol_engine_optimizer 43.51% : 0.007906s : 1: type_inference TotalTime = 0.136066, [30] [bootstrap]: 0.00030958 [type_inference]: 0.122672 [event_method]: 2.047e-05 [auto_monad]: 4.919e-05 [graph_reusing]: 3.58e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 0.00056301 [rewriter_before_opt_a]: 9.093e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00963712, [2] [Cycle 1]: 0.0055272, [27] [switch_simplify]: 7.39e-05 [loop_unroll]: 3.461e-05 [a_1]: 0.00085479 [with_stream_mark]: 2.317e-05 [recompute_prepare]: 1.115e-05 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 2.62001e-06 [specialize_transform]: 8.59e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 7.89002e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 7.28e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.94e-05 [j_node_and_user_rematch]: 1.419e-05 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.306e-05 [inline_without_move]: 8.23999e-06 [renormalize]: 0.00409577 [add_forward_monad_depend]: 9.79e-06 [auto_monad_grad]: 3.45e-06 [auto_monad_eliminator]: 2.07e-05 [cse]: 3.991e-05 [replace_applicator]: 2.448e-05 [Cycle 2]: 0.00041769, [27] [switch_simplify]: 7.58001e-06 [loop_unroll]: 6.79999e-06 [a_1]: 0.00013503 [with_stream_mark]: 1.669e-05 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 2.39999e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 3.01999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 1.128e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.18002e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.83997e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 7.63999e-06 [cse]: 1.74e-05 [replace_applicator]: 7.78999e-06 [py_interpret_to_execute_after_opt_a]: 1.686e-05 [rewriter_after_opt_a]: 4.522e-05 [convert_after_rewriter]: 7.08998e-06 [order_py_execute_after_rewriter]: 5.06997e-06 [mutable_eliminate]: 0.00081358 [jit_opt_b]: 6.533e-05, [1] [Cycle 1]: 5.602e-05, [2] [frontend_op_eliminate]: 2.075e-05 [inline_after_opt_a]: 2.205e-05 [cconv]: 2.942e-05 [loop_unroll]: 0.00046794 [jit_opt_after_cconv]: 0.00016649, [1] [Cycle 1]: 0.00015856, [11] [c_1]: 2.685e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 7.31999e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 2.586e-05 [call_graph_tuple_transform]: 2.173e-05 [tuple_list_get_item_eliminator]: 6.84001e-06 [none_parameter_eliminate]: 1.88997e-06 [renormalize]: 8.2e-07 [switch_simplify]: 7.28e-06 [remove_dup_value]: 1.872e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.006e-05 [add_recomputation]: 5.168e-05 [cse_after_recomputation]: 2.737e-05, [1] [Cycle 1]: 2.15e-05, [1] [cse]: 1.5e-05 [auto_monad_reorder]: 1.995e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 5.96e-06 [opt_after_jit_grad]: 0.00050263 [symbol_engine_optimizer]: 8.31e-05, [1] [Cycle 1]: 7.634e-05, [6] [build]: 3.35003e-06 [elim_shapecalc]: 9.91e-06 [elim_not_effective]: 1.529e-05 [opt_reshape]: 7.51999e-06 [fold_const_symbol]: 1.015e-05 [renormalize]: 3.50003e-07 [validate]: 0.0001845 Sums bootstrap : 0.000310s : 0.24% type_inference : 0.122672s : 93.14% event_method : 0.000020s : 0.02% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000563s : 0.43% rewriter_before_opt_a : 0.000091s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000990s : 0.75% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.004096s : 3.11% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000057s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000814s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000468s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000503s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000185s : 0.14% Time group info: ------[substitution.] 0.000338 25 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000007s : 4: substitution.graph_param_transform 87.02% : 0.000295s : 5: substitution.inline 1.95% : 0.000007s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 1.75% : 0.000006s : 2: substitution.replace_old_param 4.43% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122596 2 96.98% : 0.118898s : 1: type_inference.infer 3.02% : 0.003697s : 1: type_inference.specialize ------[replace.] 0.000124 7 66.15% : 0.000082s : 5: replace.inline 33.85% : 0.000042s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000305 7 95.48% : 0.000291s : 5: match.inline 4.52% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.72% : 0.000003s : 13: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.67% : 0.000002s : 13: predicate.addn_zero_filter 1.85% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.34% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.18% : 0.000009s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.71% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.79% : 0.000003s : 13: predicate.reduce_eliminate 1.81% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.47% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.79% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.87% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000011s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.57% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002946 25 56.11% : 0.001653s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.18% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.70% : 0.001199s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141380 72 0.04% : 0.000054s : 1: add_recomputation 0.04% : 0.000052s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.23% : 0.000325s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.82% : 0.009641s : 1: jit_opt_a 0.12% : 0.000169s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.34% : 0.000476s : 1: loop_unroll 0.58% : 0.000825s : 1: mutable_eliminate 0.91% : 0.001280s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000512s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000570s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.98% : 0.002806s : 1: renormalize.infer 0.90% : 0.001276s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000049s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 86.78% : 0.122686s : 1: type_inference TotalTime = 0.141148, [30] [bootstrap]: 0.00034228 [type_inference]: 0.126411 [event_method]: 1.876e-05 [auto_monad]: 7.116e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.00046518 [rewriter_before_opt_a]: 8.634e-05 [expand_dump_flag]: 3.90998e-06 [jit_opt_a]: 0.0112118, [2] [Cycle 1]: 0.00474661, [27] [switch_simplify]: 6.565e-05 [loop_unroll]: 3.183e-05 [a_1]: 0.00064577 [with_stream_mark]: 2.21e-05 [recompute_prepare]: 1.185e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 2.41998e-06 [specialize_transform]: 8e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 1.159e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.055e-05 [inline_without_move]: 6.50002e-06 [renormalize]: 0.00360781 [add_forward_monad_depend]: 8.67998e-06 [auto_monad_grad]: 1.92001e-06 [auto_monad_eliminator]: 1.645e-05 [cse]: 2.321e-05 [replace_applicator]: 1.718e-05 [Cycle 2]: 0.0003869, [27] [switch_simplify]: 6.96999e-06 [loop_unroll]: 6.39001e-06 [a_1]: 0.00013068 [with_stream_mark]: 1.389e-05 [recompute_prepare]: 7.16001e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.11e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.243e-05 [replace_applicator]: 6.73e-06 [py_interpret_to_execute_after_opt_a]: 1.313e-05 [rewriter_after_opt_a]: 3.383e-05 [convert_after_rewriter]: 8.02998e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00060792 [jit_opt_b]: 6.146e-05, [1] [Cycle 1]: 5.398e-05, [2] [frontend_op_eliminate]: 2.163e-05 [inline_after_opt_a]: 1.898e-05 [cconv]: 1.997e-05 [loop_unroll]: 0.00047411 [jit_opt_after_cconv]: 0.00020982, [1] [Cycle 1]: 0.00020115, [11] [c_1]: 6.694e-05 [parameter_eliminate]: 3.91999e-06 [updatestate_depend_eliminate]: 6.83003e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.632e-05 [call_graph_tuple_transform]: 2.387e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.27001e-06 [remove_dup_value]: 1.215e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 9.71e-06 [add_recomputation]: 4.344e-05 [cse_after_recomputation]: 2.669e-05, [1] [Cycle 1]: 1.915e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.628e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 7.16001e-06 [opt_after_jit_grad]: 0.00053246 [symbol_engine_optimizer]: 0.00016874, [1] [Cycle 1]: 0.00016215, [6] [build]: 3.35e-06 [elim_shapecalc]: 9.82999e-06 [elim_not_effective]: 1.649e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 9.31e-05 [renormalize]: 1.01002e-06 [validate]: 4.779e-05 Sums bootstrap : 0.000342s : 0.25% type_inference : 0.126411s : 94.06% event_method : 0.000019s : 0.01% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000465s : 0.35% rewriter_before_opt_a : 0.000086s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000776s : 0.58% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003608s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000608s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000020s : 0.01% loop_unroll : 0.000474s : 0.35% jit_opt_after_cconv.c_1 : 0.000067s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000043s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000532s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000093s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000248 24 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.59% : 0.000006s : 4: substitution.graph_param_transform 84.84% : 0.000210s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.50% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126334 2 97.87% : 0.123647s : 1: type_inference.infer 2.13% : 0.002687s : 1: type_inference.specialize ------[replace.] 0.000083 6 64.42% : 0.000054s : 4: replace.inline 35.58% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.46% : 0.000207s : 4: match.inline 5.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.77% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.56% : 0.000001s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000008s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.70% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 18: predicate.load_eliminater 1.93% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.29% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.02% : 0.000003s : 18: predicate.partial_eliminate 1.45% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000003s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 1.08% : 0.000002s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.73% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.86% : 0.000003s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003575 22 78.12% : 0.002793s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 20.42% : 0.000730s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.145951 72 0.03% : 0.000047s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000361s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.68% : 0.011215s : 1: jit_opt_a 0.15% : 0.000213s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.33% : 0.000484s : 1: loop_unroll 0.42% : 0.000617s : 1: mutable_eliminate 0.71% : 0.001031s : 26: opt.transform.jit_opt_a 0.07% : 0.000100s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000122s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000542s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000473s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.93% : 0.002815s : 1: renormalize.infer 0.54% : 0.000782s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.06% : 0.000091s : 1: rewriter_before_opt_a 0.12% : 0.000172s : 1: symbol_engine_optimizer 86.62% : 0.126425s : 1: type_inference TotalTime = 0.0170255, [30] [bootstrap]: 0.00037502 [type_inference]: 0.00841405 [event_method]: 2.143e-05 [auto_monad]: 6.875e-05 [graph_reusing]: 6.42001e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 4.321e-05 [rewriter_before_opt_a]: 8.278e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00580741, [2] [Cycle 1]: 0.00194234, [27] [switch_simplify]: 6.174e-05 [loop_unroll]: 3.369e-05 [a_1]: 0.00065225 [with_stream_mark]: 2.126e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.29003e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 9.66998e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00082815 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.393e-05 [cse]: 3.486e-05 [replace_applicator]: 1.383e-05 [Cycle 2]: 0.00032921, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.634e-05 [with_stream_mark]: 9.57001e-06 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.29998e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.61998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.099e-05 [j_node_and_user_rematch]: 8.15999e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.31e-05 [replace_applicator]: 4.94998e-06 [py_interpret_to_execute_after_opt_a]: 1.212e-05 [rewriter_after_opt_a]: 3.769e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00059234 [jit_opt_b]: 5.153e-05, [1] [Cycle 1]: 4.378e-05, [2] [frontend_op_eliminate]: 1.645e-05 [inline_after_opt_a]: 1.625e-05 [cconv]: 2.562e-05 [loop_unroll]: 0.0004255 [jit_opt_after_cconv]: 0.00016215, [1] [Cycle 1]: 0.00015533, [11] [c_1]: 2.262e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 2.58003e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 2.325e-05 [call_graph_tuple_transform]: 2.939e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.71002e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.06e-06 [add_recomputation]: 5.233e-05 [cse_after_recomputation]: 2.372e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.259e-05 [auto_monad_reorder]: 1.752e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00046726 [symbol_engine_optimizer]: 7.404e-05, [1] [Cycle 1]: 6.737e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 7.82002e-06 [elim_not_effective]: 1.386e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 3.69997e-07 [validate]: 3.751e-05 Sums bootstrap : 0.000375s : 2.91% type_inference : 0.008414s : 65.25% event_method : 0.000021s : 0.17% auto_monad : 0.000069s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000043s : 0.34% rewriter_before_opt_a : 0.000083s : 0.64% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000068s : 0.53% jit_opt_a.loop_unroll : 0.000039s : 0.30% jit_opt_a.a_1 : 0.000749s : 5.80% jit_opt_a.with_stream_mark : 0.000031s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000828s : 6.42% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000048s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000038s : 0.29% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000592s : 4.59% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.20% loop_unroll : 0.000425s : 3.30% jit_opt_after_cconv.c_1 : 0.000023s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000052s : 0.41% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000467s : 3.62% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.29% Time group info: ------[substitution.] 0.000262 27 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 3: substitution.graph_param_transform 84.09% : 0.000221s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.81% : 0.000010s : 3: substitution.reduce_eliminate 1.71% : 0.000004s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 3.98% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008337 2 87.64% : 0.007306s : 1: type_inference.infer 12.36% : 0.001031s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.45% : 0.000062s : 5: replace.inline 31.55% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 95.90% : 0.000218s : 5: match.inline 4.10% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.18% : 0.000001s : 11: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.22% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000001s : 11: predicate.depend_value_elim 1.20% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.57% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.32% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 16: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.95% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.52% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000002s : 11: predicate.print_const_string_wrapper 2.15% : 0.000003s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000003s : 18: predicate.switch_defer_inline 2.39% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.93% : 0.000010s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.52% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000806 16 48.53% : 0.000391s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.70% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.77% : 0.000345s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018898 72 0.29% : 0.000055s : 1: add_recomputation 0.38% : 0.000072s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 2.09% : 0.000394s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.75% : 0.005811s : 1: jit_opt_a 0.87% : 0.000165s : 1: jit_opt_after_cconv 0.29% : 0.000055s : 1: jit_opt_b 2.30% : 0.000434s : 1: loop_unroll 3.18% : 0.000600s : 1: mutable_eliminate 5.16% : 0.000976s : 26: opt.transform.jit_opt_a 0.32% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.51% : 0.000475s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.59% : 0.000490s : 1: renormalize.infer 1.75% : 0.000331s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000041s : 1: rewriter_after_opt_a 0.46% : 0.000086s : 1: rewriter_before_opt_a 0.40% : 0.000076s : 1: symbol_engine_optimizer 44.61% : 0.008431s : 1: type_inference TotalTime = 0.0950787, [30] [bootstrap]: 0.0003151 [type_inference]: 0.0835789 [event_method]: 0.00036007 [auto_monad]: 0.00012852 [graph_reusing]: 8.59e-06 [pre_auto_parallel]: 3.78001e-06 [py_interpret_to_execute]: 4.273e-05 [rewriter_before_opt_a]: 0.00014614 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00809002, [2] [Cycle 1]: 0.00424785, [27] [switch_simplify]: 0.00018821 [loop_unroll]: 6.071e-05 [a_1]: 0.00137073 [with_stream_mark]: 2.152e-05 [recompute_prepare]: 1.027e-05 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.64999e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.47e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00220004 [add_forward_monad_depend]: 8.96002e-06 [auto_monad_grad]: 2.28002e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 3.811e-05 [replace_applicator]: 2.087e-05 [Cycle 2]: 0.00035554, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.49e-06 [a_1]: 9.748e-05 [with_stream_mark]: 1.434e-05 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 2.63998e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 5.06002e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 2.13002e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 4.94e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.372e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 1.519e-05 [rewriter_after_opt_a]: 4.025e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00070881 [jit_opt_b]: 5.208e-05, [1] [Cycle 1]: 4.369e-05, [2] [frontend_op_eliminate]: 1.633e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 3.091e-05 [loop_unroll]: 0.00043942 [jit_opt_after_cconv]: 0.00017037, [1] [Cycle 1]: 0.00016216, [11] [c_1]: 2.161e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 6.84999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 4.104e-05 [call_graph_tuple_transform]: 2.127e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.772e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 6.86001e-06 [add_recomputation]: 5.35e-05 [cse_after_recomputation]: 2.327e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 1.814e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 5.42001e-06 [opt_after_jit_grad]: 0.00047744 [symbol_engine_optimizer]: 7.427e-05, [1] [Cycle 1]: 6.729e-05, [6] [build]: 3.79002e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 6.32001e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 4.60015e-07 [validate]: 4.206e-05 Sums bootstrap : 0.000315s : 0.35% type_inference : 0.083579s : 91.92% event_method : 0.000360s : 0.40% auto_monad : 0.000129s : 0.14% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000043s : 0.05% rewriter_before_opt_a : 0.000146s : 0.16% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000195s : 0.21% jit_opt_a.loop_unroll : 0.000066s : 0.07% jit_opt_a.a_1 : 0.001468s : 1.61% jit_opt_a.with_stream_mark : 0.000036s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002200s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000052s : 0.06% jit_opt_a.replace_applicator : 0.000027s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000709s : 0.78% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000439s : 0.48% jit_opt_after_cconv.c_1 : 0.000022s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000477s : 0.53% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.05% Time group info: ------[substitution.] 0.000552 35 0.38% : 0.000002s : 2: substitution.elim_not_effective 0.24% : 0.000001s : 2: substitution.fold_const_symbol 1.15% : 0.000006s : 3: substitution.graph_param_transform 89.08% : 0.000492s : 12: substitution.inline 0.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.04% : 0.000006s : 4: substitution.remove_not_recompute_node 1.00% : 0.000006s : 2: substitution.replace_old_param 1.84% : 0.000010s : 1: substitution.reshape_eliminate 2.65% : 0.000015s : 3: substitution.switch_simplify 1.95% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.083478 2 95.81% : 0.079985s : 1: type_inference.infer 4.19% : 0.003494s : 1: type_inference.specialize ------[replace.] 0.000298 18 52.89% : 0.000157s : 12: replace.inline 1.70% : 0.000005s : 1: replace.reshape_eliminate 20.62% : 0.000061s : 3: replace.switch_simplify 24.80% : 0.000074s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000517 18 94.00% : 0.000486s : 12: match.inline 1.75% : 0.000009s : 1: match.reshape_eliminate 2.37% : 0.000012s : 3: match.switch_simplify 1.88% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000202 1212 1.50% : 0.000003s : 19: predicate.accumulaten_eliminater 0.73% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000003s : 19: predicate.addn_check_dump 1.96% : 0.000004s : 19: predicate.addn_zero_filter 2.00% : 0.000004s : 19: predicate.arithmetic_simplify 1.32% : 0.000003s : 20: predicate.cast_eliminate 0.35% : 0.000001s : 3: predicate.check_bprop_eliminate 1.31% : 0.000003s : 19: predicate.compare_switch_simplify 1.29% : 0.000003s : 19: predicate.depend_value_elim 1.28% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.43% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.48% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.52% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.18% : 0.000000s : 3: predicate.elim_not_effective 0.26% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.42% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.36% : 0.000003s : 20: predicate.environ_get_depend_swap 1.57% : 0.000003s : 20: predicate.environ_get_eliminate 1.24% : 0.000002s : 20: predicate.environ_get_set_eliminate 0.14% : 0.000000s : 3: predicate.fold_const_symbol 0.61% : 0.000001s : 6: predicate.get_grad_eliminate 0.15% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000011s : 40: predicate.inline 0.52% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.78% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.77% : 0.000004s : 25: predicate.load_eliminater 0.88% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.42% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.80% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 19: predicate.merge_addn 1.29% : 0.000003s : 19: predicate.minmaximum_grad 0.96% : 0.000002s : 3: predicate.mutable_eliminate 0.26% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000005s : 25: predicate.partial_eliminate 1.33% : 0.000003s : 19: predicate.print_const_string_wrapper 1.97% : 0.000004s : 19: predicate.reduce_eliminate 1.64% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.49% : 0.000003s : 28: predicate.replace_applicator 0.34% : 0.000001s : 6: predicate.replace_old_param 0.18% : 0.000000s : 3: predicate.reset_defer_inline 2.08% : 0.000004s : 20: predicate.reshape_eliminate 1.30% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000003s : 19: predicate.same_eliminate 0.31% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.58% : 0.000001s : 6: predicate.special_op_eliminate 0.59% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.13% : 0.000006s : 34: predicate.switch_defer_inline 2.64% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.78% : 0.000018s : 107: predicate.switch_simplify 1.43% : 0.000003s : 19: predicate.tile_eliminate 1.35% : 0.000003s : 19: predicate.transpose_eliminate 1.57% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000008s : 28: predicate.tuple_list_get_item_eliminator 1.60% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.54% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.63% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.28% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.81% : 0.000004s : 19: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.38% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003221 40 64.82% : 0.002088s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.08% : 0.000260s : 5: func_graph_cloner_run.FuncGraphClonerNode 27.10% : 0.000873s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.099194 72 0.06% : 0.000056s : 1: add_recomputation 0.14% : 0.000135s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.34% : 0.000334s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.37% : 0.000369s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 8.16% : 0.008094s : 1: jit_opt_a 0.17% : 0.000173s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.45% : 0.000449s : 1: loop_unroll 0.73% : 0.000720s : 1: mutable_eliminate 1.88% : 0.001865s : 26: opt.transform.jit_opt_a 0.05% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.05% : 0.000045s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.52% : 0.001510s : 1: renormalize.infer 0.69% : 0.000680s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.15% : 0.000150s : 1: rewriter_before_opt_a 0.08% : 0.000076s : 1: symbol_engine_optimizer 84.29% : 0.083608s : 1: type_inference TotalTime = 0.129302, [30] [bootstrap]: 0.00032141 [type_inference]: 0.1166 [event_method]: 2.139e-05 [auto_monad]: 0.00014268 [graph_reusing]: 7.56001e-06 [pre_auto_parallel]: 3.21999e-06 [py_interpret_to_execute]: 0.00063972 [rewriter_before_opt_a]: 0.00011071 [expand_dump_flag]: 4.81002e-06 [jit_opt_a]: 0.00868598, [2] [Cycle 1]: 0.00480824, [27] [switch_simplify]: 6.772e-05 [loop_unroll]: 3.52e-05 [a_1]: 0.00074015 [with_stream_mark]: 2.06e-05 [recompute_prepare]: 9.56e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.75e-06 [updatestate_useless_node_eliminater]: 6.58998e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 6.94001e-06 [merge_forward]: 4.52e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.622e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.59001e-06 [renormalize]: 0.00354234 [add_forward_monad_depend]: 7.8e-06 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 1.989e-05 [cse]: 3.934e-05 [replace_applicator]: 2.406e-05 [Cycle 2]: 0.00039833, [27] [switch_simplify]: 7.54002e-06 [loop_unroll]: 6.35002e-06 [a_1]: 0.00012658 [with_stream_mark]: 1.583e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 3.06001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.844e-05 [j_node_and_user_rematch]: 1.038e-05 [meta_fg_expand]: 2.70997e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.49e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.97999e-06 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 6.55997e-06 [cse]: 1.652e-05 [replace_applicator]: 6.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.4e-05 [rewriter_after_opt_a]: 4.19e-05 [convert_after_rewriter]: 6.84001e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00072182 [jit_opt_b]: 7.807e-05, [1] [Cycle 1]: 7.02e-05, [2] [frontend_op_eliminate]: 2.067e-05 [inline_after_opt_a]: 2.145e-05 [cconv]: 2.811e-05 [loop_unroll]: 0.00047989 [jit_opt_after_cconv]: 0.00017142, [1] [Cycle 1]: 0.00016354, [11] [c_1]: 2.721e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 6.36998e-06 [updatestate_assign_eliminate]: 4.13001e-06 [updatestate_loads_eliminate]: 2.81e-06 [cse]: 2.897e-05 [call_graph_tuple_transform]: 2.238e-05 [tuple_list_get_item_eliminator]: 6.81999e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 7.7e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.898e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 1.191e-05 [add_recomputation]: 5.133e-05 [cse_after_recomputation]: 2.634e-05, [1] [Cycle 1]: 1.966e-05, [1] [cse]: 1.397e-05 [auto_monad_reorder]: 1.771e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 5.13002e-06 [opt_after_jit_grad]: 0.00048475 [symbol_engine_optimizer]: 8.742e-05, [1] [Cycle 1]: 8.136e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 8.80001e-06 [elim_not_effective]: 1.829e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 1.19e-05 [renormalize]: 3.00002e-07 [validate]: 0.00030224 Sums bootstrap : 0.000321s : 0.26% type_inference : 0.116600s : 93.16% event_method : 0.000021s : 0.02% auto_monad : 0.000143s : 0.11% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000640s : 0.51% rewriter_before_opt_a : 0.000111s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000867s : 0.69% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003542s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000722s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000480s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000485s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000302s : 0.24% Time group info: ------[substitution.] 0.000291 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.20% : 0.000006s : 4: substitution.graph_param_transform 86.64% : 0.000252s : 5: substitution.inline 1.85% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000006s : 4: substitution.remove_not_recompute_node 1.58% : 0.000005s : 2: substitution.replace_old_param 4.47% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116514 2 96.94% : 0.112944s : 1: type_inference.infer 3.06% : 0.003570s : 1: type_inference.specialize ------[replace.] 0.000110 7 68.24% : 0.000075s : 5: replace.inline 31.76% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000260 7 95.47% : 0.000248s : 5: match.inline 4.53% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.24% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.27% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.39% : 0.000002s : 13: predicate.print_const_string_wrapper 1.82% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000011s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002740 25 60.07% : 0.001646s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.06% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.87% : 0.001010s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133790 72 0.04% : 0.000054s : 1: add_recomputation 0.11% : 0.000147s : 1: auto_monad 0.02% : 0.000025s : 1: auto_monad_reorder 0.25% : 0.000341s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.50% : 0.008690s : 1: jit_opt_a 0.13% : 0.000174s : 1: jit_opt_after_cconv 0.06% : 0.000081s : 1: jit_opt_b 0.37% : 0.000488s : 1: loop_unroll 0.55% : 0.000732s : 1: mutable_eliminate 0.85% : 0.001136s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000648s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.84% : 0.002460s : 1: renormalize.infer 0.80% : 0.001069s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000116s : 1: rewriter_before_opt_a 0.07% : 0.000092s : 1: symbol_engine_optimizer 87.16% : 0.116616s : 1: type_inference TotalTime = 0.121422, [30] [bootstrap]: 0.00031425 [type_inference]: 0.109774 [event_method]: 2.32e-05 [auto_monad]: 7.981e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00051065 [rewriter_before_opt_a]: 0.00010271 [expand_dump_flag]: 4.3e-06 [jit_opt_a]: 0.0081194, [2] [Cycle 1]: 0.00399463, [27] [switch_simplify]: 6.833e-05 [loop_unroll]: 3.551e-05 [a_1]: 0.00075212 [with_stream_mark]: 2.457e-05 [recompute_prepare]: 9.76e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.56999e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 7.31999e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00271137 [add_forward_monad_depend]: 8.52e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.204e-05 [cse]: 3.781e-05 [replace_applicator]: 2.174e-05 [Cycle 2]: 0.00040467, [27] [switch_simplify]: 7.98001e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00014142 [with_stream_mark]: 1.529e-05 [recompute_prepare]: 6.58998e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.78998e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 2.22001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.36998e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 1.025e-05 [inline_without_move]: 5.59998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.366e-05 [replace_applicator]: 6.44999e-06 [py_interpret_to_execute_after_opt_a]: 1.591e-05 [rewriter_after_opt_a]: 3.921e-05 [convert_after_rewriter]: 3.472e-05 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.00070963 [jit_opt_b]: 5.783e-05, [1] [Cycle 1]: 5.06e-05, [2] [frontend_op_eliminate]: 1.945e-05 [inline_after_opt_a]: 1.945e-05 [cconv]: 2.883e-05 [loop_unroll]: 0.00043301 [jit_opt_after_cconv]: 0.00016022, [1] [Cycle 1]: 0.0001536, [11] [c_1]: 2.549e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 7.13998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 2.714e-05 [call_graph_tuple_transform]: 2.301e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.61999e-06 [remove_dup_value]: 1.635e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 9.53002e-06 [add_recomputation]: 5.273e-05 [cse_after_recomputation]: 2.386e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.282e-05 [auto_monad_reorder]: 1.823e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 6.48e-06 [opt_after_jit_grad]: 0.00047394 [symbol_engine_optimizer]: 7.905e-05, [1] [Cycle 1]: 7.255e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 9.11998e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 7.55998e-06 [fold_const_symbol]: 9.66e-06 [renormalize]: 2.99973e-07 [validate]: 0.00011248 Sums bootstrap : 0.000314s : 0.27% type_inference : 0.109774s : 93.78% event_method : 0.000023s : 0.02% auto_monad : 0.000080s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000511s : 0.44% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000894s : 0.76% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002711s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000035s : 0.03% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000710s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000433s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000474s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000112s : 0.10% Time group info: ------[substitution.] 0.000322 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.95% : 0.000006s : 4: substitution.graph_param_transform 84.32% : 0.000272s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.41% : 0.000014s : 3: substitution.reduce_eliminate 1.65% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000006s : 2: substitution.replace_old_param 3.52% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109679 2 97.28% : 0.106698s : 1: type_inference.infer 2.72% : 0.002981s : 1: type_inference.specialize ------[replace.] 0.000101 7 69.15% : 0.000070s : 5: replace.inline 30.85% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000279 7 96.34% : 0.000269s : 5: match.inline 3.66% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.89% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.73% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.32% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.17% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.97% : 0.000012s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002391 25 63.42% : 0.001516s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.58% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.00% : 0.000789s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125301 72 0.04% : 0.000056s : 1: add_recomputation 0.07% : 0.000084s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000331s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.03% : 0.000038s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.48% : 0.008123s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.35% : 0.000442s : 1: loop_unroll 0.57% : 0.000719s : 1: mutable_eliminate 0.92% : 0.001153s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000037s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000518s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.53% : 0.001919s : 1: renormalize.infer 0.62% : 0.000780s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000108s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 87.62% : 0.109795s : 1: type_inference TotalTime = 0.121858, [30] [bootstrap]: 0.00030792 [type_inference]: 0.110169 [event_method]: 2.103e-05 [auto_monad]: 7.238e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00046848 [rewriter_before_opt_a]: 8.695e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00825408, [2] [Cycle 1]: 0.00435535, [27] [switch_simplify]: 5.638e-05 [loop_unroll]: 3.079e-05 [a_1]: 0.00057532 [with_stream_mark]: 1.909e-05 [recompute_prepare]: 8.97999e-06 [updatestate_depend_eliminate]: 4.32998e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.95002e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.532e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 6.25002e-06 [renormalize]: 0.0033077 [add_forward_monad_depend]: 8.43999e-06 [auto_monad_grad]: 2.90998e-06 [auto_monad_eliminator]: 1.759e-05 [cse]: 3.285e-05 [replace_applicator]: 1.879e-05 [Cycle 2]: 0.00039226, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 6.17001e-06 [a_1]: 0.00012871 [with_stream_mark]: 1.349e-05 [recompute_prepare]: 6.30002e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 4.77e-06 [cell_reuse_recompute_pass]: 2.73998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.702e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.76e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 7.08e-06 [cse]: 1.382e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.254e-05 [rewriter_after_opt_a]: 5.346e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 5.77999e-06 [mutable_eliminate]: 0.00065972 [jit_opt_b]: 5.972e-05, [1] [Cycle 1]: 5.171e-05, [2] [frontend_op_eliminate]: 2.182e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 2.828e-05 [loop_unroll]: 0.00044233 [jit_opt_after_cconv]: 0.00015969, [1] [Cycle 1]: 0.00015325, [11] [c_1]: 2.686e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.326e-05 [call_graph_tuple_transform]: 2.378e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.63997e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.506e-05 [partial_unused_args_eliminate]: 4.63001e-06 [environ_conv]: 9.69e-06 [add_recomputation]: 5.461e-05 [cse_after_recomputation]: 2.198e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.091e-05 [auto_monad_reorder]: 1.601e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00058125 [symbol_engine_optimizer]: 8.106e-05, [1] [Cycle 1]: 7.449e-05, [6] [build]: 3.76001e-06 [elim_shapecalc]: 1.011e-05 [elim_not_effective]: 1.471e-05 [opt_reshape]: 6.94999e-06 [fold_const_symbol]: 9.81998e-06 [renormalize]: 4.09986e-07 [validate]: 4.345e-05 Sums bootstrap : 0.000308s : 0.26% type_inference : 0.110169s : 93.58% event_method : 0.000021s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000468s : 0.40% rewriter_before_opt_a : 0.000087s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000704s : 0.60% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003308s : 2.81% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000053s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000660s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000442s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000581s : 0.49% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000205 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 4.27% : 0.000009s : 4: substitution.graph_param_transform 81.58% : 0.000167s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000005s : 2: substitution.replace_old_param 6.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110081 2 97.56% : 0.107396s : 1: type_inference.infer 2.44% : 0.002685s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.98% : 0.000051s : 4: replace.inline 32.02% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.51% : 0.000165s : 4: match.inline 6.49% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.78% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.74% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.99% : 0.000003s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.41% : 0.000002s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.57% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 58: predicate.switch_simplify 1.54% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.27% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002179 22 66.61% : 0.001452s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.98% : 0.000697s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126268 72 0.05% : 0.000058s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000326s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.54% : 0.008258s : 1: jit_opt_a 0.13% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.36% : 0.000451s : 1: loop_unroll 0.53% : 0.000670s : 1: mutable_eliminate 0.75% : 0.000945s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.09% : 0.000113s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000591s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 2.03% : 0.002560s : 1: renormalize.infer 0.58% : 0.000738s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000057s : 1: rewriter_after_opt_a 0.07% : 0.000092s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 87.27% : 0.110189s : 1: type_inference TotalTime = 0.0984806, [30] [bootstrap]: 0.00031142 [type_inference]: 0.0860807 [event_method]: 0.00034664 [auto_monad]: 0.00013312 [graph_reusing]: 8.59998e-06 [pre_auto_parallel]: 3.2e-06 [py_interpret_to_execute]: 4.241e-05 [rewriter_before_opt_a]: 0.00014058 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00873412, [2] [Cycle 1]: 0.00442504, [27] [switch_simplify]: 0.00018514 [loop_unroll]: 5.996e-05 [a_1]: 0.00143144 [with_stream_mark]: 2.078e-05 [recompute_prepare]: 1.084e-05 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.53e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 5.074e-05 [get_grad_eliminate_]: 7.77e-06 [merge_forward]: 4.67e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.869e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.123e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00224453 [add_forward_monad_depend]: 8.17998e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.934e-05 [cse]: 4.027e-05 [replace_applicator]: 1.974e-05 [Cycle 2]: 0.00035443, [27] [switch_simplify]: 6.42001e-06 [loop_unroll]: 5.23002e-06 [a_1]: 9.745e-05 [with_stream_mark]: 1.449e-05 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.71002e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 2.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.715e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.395e-05 [replace_applicator]: 5.71003e-06 [py_interpret_to_execute_after_opt_a]: 1.608e-05 [rewriter_after_opt_a]: 3.867e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00075217 [jit_opt_b]: 5.751e-05, [1] [Cycle 1]: 4.861e-05, [2] [frontend_op_eliminate]: 1.801e-05 [inline_after_opt_a]: 1.809e-05 [cconv]: 2.951e-05 [loop_unroll]: 0.00051174 [jit_opt_after_cconv]: 0.00017147, [1] [Cycle 1]: 0.00016382, [11] [c_1]: 2.257e-05 [parameter_eliminate]: 4.64998e-06 [updatestate_depend_eliminate]: 8.1e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 3.147e-05 [call_graph_tuple_transform]: 2.149e-05 [tuple_list_get_item_eliminator]: 5.74e-06 [none_parameter_eliminate]: 2.14999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 6.73e-06 [remove_dup_value]: 1.718e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 7.88999e-06 [add_recomputation]: 5.842e-05 [cse_after_recomputation]: 2.64e-05, [1] [Cycle 1]: 2.094e-05, [1] [cse]: 1.349e-05 [auto_monad_reorder]: 1.894e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 6.66e-06 [opt_after_jit_grad]: 0.00057619 [symbol_engine_optimizer]: 8.787e-05, [1] [Cycle 1]: 8.052e-05, [6] [build]: 5.62999e-06 [elim_shapecalc]: 9.04998e-06 [elim_not_effective]: 1.547e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 6.69999e-07 [validate]: 5.324e-05 Sums bootstrap : 0.000311s : 0.33% type_inference : 0.086081s : 91.76% event_method : 0.000347s : 0.37% auto_monad : 0.000133s : 0.14% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000042s : 0.05% rewriter_before_opt_a : 0.000141s : 0.15% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000192s : 0.20% jit_opt_a.loop_unroll : 0.000065s : 0.07% jit_opt_a.a_1 : 0.001529s : 1.63% jit_opt_a.with_stream_mark : 0.000035s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000052s : 0.06% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002245s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000054s : 0.06% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000752s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000512s : 0.55% jit_opt_after_cconv.c_1 : 0.000023s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000058s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000576s : 0.61% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.06% Time group info: ------[substitution.] 0.000601 35 0.41% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000003s : 2: substitution.fold_const_symbol 1.10% : 0.000007s : 3: substitution.graph_param_transform 89.53% : 0.000538s : 12: substitution.inline 0.74% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.97% : 0.000006s : 4: substitution.remove_not_recompute_node 0.98% : 0.000006s : 2: substitution.replace_old_param 1.65% : 0.000010s : 1: substitution.reshape_eliminate 2.25% : 0.000013s : 3: substitution.switch_simplify 1.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.085982 2 96.50% : 0.082976s : 1: type_inference.infer 3.50% : 0.003006s : 1: type_inference.specialize ------[replace.] 0.000295 18 53.64% : 0.000158s : 12: replace.inline 1.69% : 0.000005s : 1: replace.reshape_eliminate 18.67% : 0.000055s : 3: replace.switch_simplify 26.00% : 0.000077s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000562 18 94.63% : 0.000531s : 12: match.inline 1.57% : 0.000009s : 1: match.reshape_eliminate 1.97% : 0.000011s : 3: match.switch_simplify 1.83% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000202 1212 1.53% : 0.000003s : 19: predicate.accumulaten_eliminater 0.70% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.34% : 0.000003s : 19: predicate.addn_check_dump 1.86% : 0.000004s : 19: predicate.addn_zero_filter 1.90% : 0.000004s : 19: predicate.arithmetic_simplify 1.42% : 0.000003s : 20: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.25% : 0.000003s : 19: predicate.compare_switch_simplify 1.25% : 0.000003s : 19: predicate.depend_value_elim 1.32% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.37% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.32% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.20% : 0.000000s : 3: predicate.elim_not_effective 0.32% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.27% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.31% : 0.000003s : 20: predicate.environ_get_depend_swap 1.44% : 0.000003s : 20: predicate.environ_get_eliminate 1.27% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.65% : 0.000001s : 6: predicate.get_grad_eliminate 0.15% : 0.000000s : 3: predicate.graph_param_transform 5.94% : 0.000012s : 40: predicate.inline 0.68% : 0.000001s : 6: predicate.inline_without_move 0.23% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.85% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.87% : 0.000004s : 25: predicate.load_eliminater 0.88% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000009s : 64: predicate.loop_unroll_before_grad 2.10% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 19: predicate.merge_addn 1.18% : 0.000002s : 19: predicate.minmaximum_grad 1.13% : 0.000002s : 3: predicate.mutable_eliminate 0.25% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000004s : 25: predicate.partial_eliminate 1.41% : 0.000003s : 19: predicate.print_const_string_wrapper 1.73% : 0.000003s : 19: predicate.reduce_eliminate 1.67% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.38% : 0.000001s : 6: predicate.remove_not_recompute_node 1.54% : 0.000003s : 28: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000001s : 3: predicate.reset_defer_inline 1.56% : 0.000003s : 20: predicate.reshape_eliminate 1.37% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.53% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000003s : 19: predicate.same_eliminate 0.32% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.60% : 0.000001s : 6: predicate.special_op_eliminate 0.65% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.25% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.38% : 0.000007s : 34: predicate.switch_defer_inline 2.64% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.89% : 0.000018s : 107: predicate.switch_simplify 1.75% : 0.000004s : 19: predicate.tile_eliminate 1.39% : 0.000003s : 19: predicate.transpose_eliminate 1.61% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.54% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.86% : 0.000004s : 20: predicate.tuple_list_set_item_eliminator 1.48% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.61% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.38% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.62% : 0.000003s : 19: predicate.value_based_eliminate 0.23% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.38% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003177 40 63.09% : 0.002005s : 21: func_graph_cloner_run.FuncGraphClonerGraph 9.31% : 0.000296s : 5: func_graph_cloner_run.FuncGraphClonerNode 27.60% : 0.000877s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.102701 72 0.06% : 0.000062s : 1: add_recomputation 0.14% : 0.000140s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.32% : 0.000329s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.35% : 0.000356s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 8.51% : 0.008738s : 1: jit_opt_a 0.17% : 0.000174s : 1: jit_opt_after_cconv 0.06% : 0.000060s : 1: jit_opt_b 0.51% : 0.000524s : 1: loop_unroll 0.74% : 0.000765s : 1: mutable_eliminate 1.88% : 0.001929s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000588s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.04% : 0.000045s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.51% : 0.001552s : 1: renormalize.infer 0.66% : 0.000681s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.14% : 0.000145s : 1: rewriter_before_opt_a 0.09% : 0.000091s : 1: symbol_engine_optimizer 83.85% : 0.086110s : 1: type_inference TotalTime = 0.091168, [30] [bootstrap]: 0.00030275 [type_inference]: 0.077644 [event_method]: 2.201e-05 [auto_monad]: 7.148e-05 [graph_reusing]: 6.86001e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00032012 [rewriter_before_opt_a]: 9.668e-05 [expand_dump_flag]: 3.97e-06 [jit_opt_a]: 0.010347, [2] [Cycle 1]: 0.00642032, [27] [switch_simplify]: 7.045e-05 [loop_unroll]: 3.586e-05 [a_1]: 0.00071061 [with_stream_mark]: 2.112e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.83001e-06 [updatestate_assign_eliminate]: 4.17e-06 [updatestate_loads_eliminate]: 3.20002e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.73999e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 6.52001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.019e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.0051827 [add_forward_monad_depend]: 8.37e-06 [auto_monad_grad]: 2.84999e-06 [auto_monad_eliminator]: 1.6e-05 [cse]: 3.888e-05 [replace_applicator]: 2.356e-05 [Cycle 2]: 0.00042087, [27] [switch_simplify]: 9.59999e-06 [loop_unroll]: 7.58001e-06 [a_1]: 0.00013349 [with_stream_mark]: 1.459e-05 [recompute_prepare]: 6.74999e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 6.41998e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 3.03e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.014e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.21e-06 [renormalize]: 3.10014e-07 [add_forward_monad_depend]: 1.54998e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 6.22001e-06 [cse]: 1.533e-05 [replace_applicator]: 7.17002e-06 [py_interpret_to_execute_after_opt_a]: 1.354e-05 [rewriter_after_opt_a]: 4.074e-05 [convert_after_rewriter]: 7.68999e-06 [order_py_execute_after_rewriter]: 5.51002e-06 [mutable_eliminate]: 0.00071024 [jit_opt_b]: 6.123e-05, [1] [Cycle 1]: 5.406e-05, [2] [frontend_op_eliminate]: 2.091e-05 [inline_after_opt_a]: 2.031e-05 [cconv]: 2.475e-05 [loop_unroll]: 0.00042756 [jit_opt_after_cconv]: 0.00016471, [1] [Cycle 1]: 0.0001576, [11] [c_1]: 2.644e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 6.30997e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.46998e-06 [cse]: 2.43e-05 [call_graph_tuple_transform]: 2.466e-05 [tuple_list_get_item_eliminator]: 7.31999e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.80002e-06 [remove_dup_value]: 1.756e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 9.64e-06 [add_recomputation]: 5.024e-05 [cse_after_recomputation]: 2.608e-05, [1] [Cycle 1]: 2.016e-05, [1] [cse]: 1.374e-05 [auto_monad_reorder]: 1.874e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 4.53001e-06 [opt_after_jit_grad]: 0.00045009 [symbol_engine_optimizer]: 7.89e-05, [1] [Cycle 1]: 7.133e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 9.31e-06 [elim_not_effective]: 1.327e-05 [opt_reshape]: 7.41001e-06 [fold_const_symbol]: 9.81998e-06 [renormalize]: 3.9002e-07 [validate]: 4.628e-05 Sums bootstrap : 0.000303s : 0.35% type_inference : 0.077644s : 89.22% event_method : 0.000022s : 0.03% auto_monad : 0.000071s : 0.08% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000320s : 0.37% rewriter_before_opt_a : 0.000097s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.09% jit_opt_a.loop_unroll : 0.000043s : 0.05% jit_opt_a.a_1 : 0.000844s : 0.97% jit_opt_a.with_stream_mark : 0.000036s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005183s : 5.96% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000054s : 0.06% jit_opt_a.replace_applicator : 0.000031s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000710s : 0.82% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000428s : 0.49% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000050s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000450s : 0.52% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.05% Time group info: ------[substitution.] 0.000279 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000007s : 4: substitution.graph_param_transform 86.32% : 0.000240s : 5: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.08% : 0.000006s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.61% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.077558 2 96.55% : 0.074884s : 1: type_inference.infer 3.45% : 0.002675s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.21% : 0.000071s : 5: replace.inline 31.79% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 7 95.28% : 0.000237s : 5: match.inline 4.72% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 888 1.50% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 2.12% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.69% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.48% : 0.000008s : 28: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.28% : 0.000002s : 13: predicate.minmaximum_grad 1.21% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 2.04% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.44% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.64% : 0.000011s : 65: predicate.switch_simplify 1.15% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.52% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004174 33 76.06% : 0.003175s : 24: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 22.00% : 0.000918s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.097544 72 0.05% : 0.000053s : 1: add_recomputation 0.08% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.33% : 0.000320s : 1: bootstrap 0.03% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.61% : 0.010352s : 1: jit_opt_a 0.17% : 0.000167s : 1: jit_opt_after_cconv 0.07% : 0.000064s : 1: jit_opt_b 0.45% : 0.000435s : 1: loop_unroll 0.74% : 0.000720s : 1: mutable_eliminate 1.15% : 0.001124s : 26: opt.transform.jit_opt_a 0.06% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000326s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 4.33% : 0.004228s : 1: renormalize.infer 0.97% : 0.000943s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000045s : 1: rewriter_after_opt_a 0.10% : 0.000102s : 1: rewriter_before_opt_a 0.08% : 0.000081s : 1: symbol_engine_optimizer 79.62% : 0.077661s : 1: type_inference TotalTime = 0.124289, [30] [bootstrap]: 0.00029259 [type_inference]: 0.112399 [event_method]: 2.157e-05 [auto_monad]: 7.485e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 0.00047749 [rewriter_before_opt_a]: 0.00010004 [expand_dump_flag]: 4.32998e-06 [jit_opt_a]: 0.00831298, [2] [Cycle 1]: 0.0043325, [27] [switch_simplify]: 6.784e-05 [loop_unroll]: 3.519e-05 [a_1]: 0.00107424 [with_stream_mark]: 2.491e-05 [recompute_prepare]: 9.66e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.64002e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.90002e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.95002e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 6.76e-06 [merge_forward]: 4.09997e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.628e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.115e-05 [inline_without_move]: 6.37001e-06 [renormalize]: 0.00272585 [add_forward_monad_depend]: 8.75999e-06 [auto_monad_grad]: 3.38e-06 [auto_monad_eliminator]: 1.932e-05 [cse]: 4.694e-05 [replace_applicator]: 2.159e-05 [Cycle 2]: 0.00039187, [27] [switch_simplify]: 6.81001e-06 [loop_unroll]: 6.43998e-06 [a_1]: 0.00013231 [with_stream_mark]: 1.485e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.75997e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 9.21998e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 9.47999e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.43e-06 [cse]: 1.488e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.594e-05 [rewriter_after_opt_a]: 3.976e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.000699 [jit_opt_b]: 8.037e-05, [1] [Cycle 1]: 7.129e-05, [2] [frontend_op_eliminate]: 1.854e-05 [inline_after_opt_a]: 1.862e-05 [cconv]: 2.86e-05 [loop_unroll]: 0.0004576 [jit_opt_after_cconv]: 0.00017633, [1] [Cycle 1]: 0.00016949, [11] [c_1]: 2.59e-05 [parameter_eliminate]: 4.60001e-06 [updatestate_depend_eliminate]: 9.46e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 3.58e-06 [cse]: 3.274e-05 [call_graph_tuple_transform]: 2.449e-05 [tuple_list_get_item_eliminator]: 6.77002e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.988e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 1.078e-05 [add_recomputation]: 5.171e-05 [cse_after_recomputation]: 2.604e-05, [1] [Cycle 1]: 2.003e-05, [1] [cse]: 1.391e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 7.15998e-06 [opt_after_jit_grad]: 0.00053357 [symbol_engine_optimizer]: 8.552e-05, [1] [Cycle 1]: 7.824e-05, [6] [build]: 4.69998e-06 [elim_shapecalc]: 1.065e-05 [elim_not_effective]: 1.813e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 7.50006e-07 [validate]: 5.707e-05 Sums bootstrap : 0.000293s : 0.24% type_inference : 0.112399s : 93.69% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000477s : 0.40% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.001207s : 1.01% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002726s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000062s : 0.05% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000699s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000458s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000534s : 0.44% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.05% Time group info: ------[substitution.] 0.000629 28 0.30% : 0.000002s : 2: substitution.elim_not_effective 0.18% : 0.000001s : 2: substitution.fold_const_symbol 1.09% : 0.000007s : 4: substitution.graph_param_transform 91.77% : 0.000577s : 5: substitution.inline 0.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000015s : 3: substitution.reduce_eliminate 0.78% : 0.000005s : 4: substitution.remove_not_recompute_node 0.96% : 0.000006s : 2: substitution.replace_old_param 1.88% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112319 2 97.42% : 0.109419s : 1: type_inference.infer 2.58% : 0.002900s : 1: type_inference.specialize ------[replace.] 0.000107 7 69.12% : 0.000074s : 5: replace.inline 30.88% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000584 7 98.17% : 0.000573s : 5: match.inline 1.83% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.65% : 0.000002s : 13: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.28% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.66% : 0.000001s : 4: predicate.graph_param_transform 6.19% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.35% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.35% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.59% : 0.000011s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.63% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002310 25 62.89% : 0.001453s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.71% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.40% : 0.000772s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128474 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000313s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.47% : 0.008317s : 1: jit_opt_a 0.14% : 0.000179s : 1: jit_opt_after_cconv 0.06% : 0.000083s : 1: jit_opt_b 0.36% : 0.000468s : 1: loop_unroll 0.55% : 0.000710s : 1: mutable_eliminate 1.14% : 0.001466s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000545s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.51% : 0.001937s : 1: renormalize.infer 0.61% : 0.000778s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.07% : 0.000088s : 1: symbol_engine_optimizer 87.50% : 0.112415s : 1: type_inference TotalTime = 0.171559, [30] [bootstrap]: 0.0003773 [type_inference]: 0.160191 [event_method]: 1.949e-05 [auto_monad]: 7.118e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.67001e-06 [py_interpret_to_execute]: 0.00050642 [rewriter_before_opt_a]: 8.846e-05 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00763309, [2] [Cycle 1]: 0.00378274, [27] [switch_simplify]: 5.808e-05 [loop_unroll]: 3.111e-05 [a_1]: 0.00060077 [with_stream_mark]: 2.23e-05 [recompute_prepare]: 9.51998e-06 [updatestate_depend_eliminate]: 4.86002e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 8.31002e-06 [updatestate_useless_node_eliminater]: 6.35002e-06 [accelerated_algorithm]: 7.08998e-06 [meta_shard_fg_expand]: 2.73998e-06 [get_grad_eliminate_]: 6.53003e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.562e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.87001e-06 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00266905 [add_forward_monad_depend]: 9.24e-06 [auto_monad_grad]: 3.25e-06 [auto_monad_eliminator]: 2.042e-05 [cse]: 3.404e-05 [replace_applicator]: 2.344e-05 [Cycle 2]: 0.00040971, [27] [switch_simplify]: 7.06001e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00013095 [with_stream_mark]: 1.714e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 4.98001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.824e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 6.10002e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 2.24001e-06 [auto_monad_grad]: 2.07001e-06 [auto_monad_eliminator]: 7.19001e-06 [cse]: 1.507e-05 [replace_applicator]: 6.16998e-06 [py_interpret_to_execute_after_opt_a]: 1.545e-05 [rewriter_after_opt_a]: 3.928e-05 [convert_after_rewriter]: 2.364e-05 [order_py_execute_after_rewriter]: 5.54998e-06 [mutable_eliminate]: 0.00073064 [jit_opt_b]: 6.012e-05, [1] [Cycle 1]: 5.322e-05, [2] [frontend_op_eliminate]: 2.141e-05 [inline_after_opt_a]: 1.943e-05 [cconv]: 3.376e-05 [loop_unroll]: 0.00050319 [jit_opt_after_cconv]: 0.00017785, [1] [Cycle 1]: 0.0001706, [11] [c_1]: 2.876e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 9.49999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 3.75e-06 [cse]: 3.021e-05 [call_graph_tuple_transform]: 2.379e-05 [tuple_list_get_item_eliminator]: 6.44001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 8.2e-07 [switch_simplify]: 6.51999e-06 [remove_dup_value]: 1.485e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 9.79999e-06 [add_recomputation]: 5.222e-05 [cse_after_recomputation]: 2.574e-05, [1] [Cycle 1]: 1.972e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.59e-05 [get_jit_bprop_graph]: 3.80998e-06 [rewriter_after_jit_bprop_graph]: 6.23e-06 [opt_after_jit_grad]: 0.00060368 [symbol_engine_optimizer]: 8.342e-05, [1] [Cycle 1]: 7.703e-05, [6] [build]: 4.85001e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.48e-05 [opt_reshape]: 7.1e-06 [fold_const_symbol]: 1.075e-05 [renormalize]: 3.69997e-07 [validate]: 4.586e-05 Sums bootstrap : 0.000377s : 0.23% type_inference : 0.160191s : 95.66% event_method : 0.000019s : 0.01% auto_monad : 0.000071s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000506s : 0.30% rewriter_before_opt_a : 0.000088s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.04% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000732s : 0.44% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002669s : 1.59% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000049s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000024s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000731s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000503s : 0.30% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000604s : 0.36% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.03% Time group info: ------[substitution.] 0.000222 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000006s : 4: substitution.graph_param_transform 82.85% : 0.000184s : 4: substitution.inline 2.14% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000006s : 4: substitution.remove_not_recompute_node 2.45% : 0.000005s : 2: substitution.replace_old_param 5.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.160109 2 98.36% : 0.157479s : 1: type_inference.infer 1.64% : 0.002631s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.98% : 0.000053s : 4: replace.inline 31.02% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 93.87% : 0.000181s : 4: match.inline 6.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 6.13% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 18: predicate.load_eliminater 1.74% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.94% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000003s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 18: predicate.switch_defer_inline 1.89% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.04% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002191 22 66.12% : 0.001448s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.25% : 0.000706s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.175291 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000397s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.02% : 0.000027s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.36% : 0.007637s : 1: jit_opt_a 0.10% : 0.000181s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.29% : 0.000514s : 1: loop_unroll 0.42% : 0.000743s : 1: mutable_eliminate 0.56% : 0.000985s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000614s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000516s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.06% : 0.001853s : 1: renormalize.infer 0.46% : 0.000805s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.05% : 0.000094s : 1: rewriter_before_opt_a 0.05% : 0.000086s : 1: symbol_engine_optimizer 91.40% : 0.160208s : 1: type_inference TotalTime = 0.101678, [30] [bootstrap]: 0.00035048 [type_inference]: 0.0904312 [event_method]: 0.00033506 [auto_monad]: 0.00012456 [graph_reusing]: 9.15999e-06 [pre_auto_parallel]: 3.65e-06 [py_interpret_to_execute]: 4.033e-05 [rewriter_before_opt_a]: 0.00013831 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.00791169, [2] [Cycle 1]: 0.00424297, [27] [switch_simplify]: 0.00018149 [loop_unroll]: 6.142e-05 [a_1]: 0.0013641 [with_stream_mark]: 1.814e-05 [recompute_prepare]: 9.46e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00222836 [add_forward_monad_depend]: 8.55999e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.803e-05 [cse]: 3.578e-05 [replace_applicator]: 2.014e-05 [Cycle 2]: 0.00035237, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.44e-06 [a_1]: 9.517e-05 [with_stream_mark]: 1.526e-05 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.795e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 4.88001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.50002e-06 [cse]: 1.286e-05 [replace_applicator]: 6.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.557e-05 [rewriter_after_opt_a]: 3.784e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.0005938 [jit_opt_b]: 4.97e-05, [1] [Cycle 1]: 4.311e-05, [2] [frontend_op_eliminate]: 1.536e-05 [inline_after_opt_a]: 1.636e-05 [cconv]: 2.804e-05 [loop_unroll]: 0.00042457 [jit_opt_after_cconv]: 0.00015432, [1] [Cycle 1]: 0.00014773, [11] [c_1]: 2.148e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 7.7e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.95002e-06 [cse]: 2.831e-05 [call_graph_tuple_transform]: 1.911e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 8.79983e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.736e-05 [partial_unused_args_eliminate]: 1.89999e-06 [environ_conv]: 6.54001e-06 [add_recomputation]: 5.183e-05 [cse_after_recomputation]: 2.483e-05, [1] [Cycle 1]: 1.991e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.59001e-06 [rewriter_after_jit_bprop_graph]: 6.80998e-06 [opt_after_jit_grad]: 0.00056119 [symbol_engine_optimizer]: 7.779e-05, [1] [Cycle 1]: 7.024e-05, [6] [build]: 4.08999e-06 [elim_shapecalc]: 8.52998e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 8.55999e-06 [renormalize]: 4.00003e-07 [validate]: 4.206e-05 Sums bootstrap : 0.000350s : 0.36% type_inference : 0.090431s : 92.55% event_method : 0.000335s : 0.34% auto_monad : 0.000125s : 0.13% graph_reusing : 0.000009s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000040s : 0.04% rewriter_before_opt_a : 0.000138s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000188s : 0.19% jit_opt_a.loop_unroll : 0.000067s : 0.07% jit_opt_a.a_1 : 0.001459s : 1.49% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002228s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000049s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000038s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000594s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000425s : 0.43% jit_opt_after_cconv.c_1 : 0.000021s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000561s : 0.57% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000554 35 0.33% : 0.000002s : 2: substitution.elim_not_effective 0.24% : 0.000001s : 2: substitution.fold_const_symbol 1.00% : 0.000006s : 3: substitution.graph_param_transform 89.81% : 0.000498s : 12: substitution.inline 0.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.01% : 0.000006s : 2: substitution.replace_old_param 1.71% : 0.000009s : 1: substitution.reshape_eliminate 2.23% : 0.000012s : 3: substitution.switch_simplify 2.04% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.090351 2 96.74% : 0.087401s : 1: type_inference.infer 3.26% : 0.002949s : 1: type_inference.specialize ------[replace.] 0.000290 18 52.62% : 0.000152s : 12: replace.inline 1.77% : 0.000005s : 1: replace.reshape_eliminate 19.99% : 0.000058s : 3: replace.switch_simplify 25.62% : 0.000074s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000520 18 94.41% : 0.000491s : 12: match.inline 1.63% : 0.000008s : 1: match.reshape_eliminate 1.99% : 0.000010s : 3: match.switch_simplify 1.97% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000197 1212 1.55% : 0.000003s : 19: predicate.accumulaten_eliminater 0.65% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 19: predicate.addn_check_dump 1.68% : 0.000003s : 19: predicate.addn_zero_filter 2.22% : 0.000004s : 19: predicate.arithmetic_simplify 1.42% : 0.000003s : 20: predicate.cast_eliminate 0.30% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000002s : 19: predicate.compare_switch_simplify 1.28% : 0.000003s : 19: predicate.depend_value_elim 1.34% : 0.000003s : 20: predicate.dict_get_item_const_eliminator 1.49% : 0.000003s : 20: predicate.dict_get_item_eliminator 1.36% : 0.000003s : 20: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.19% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000003s : 20: predicate.environ_add_const_eliminate 1.28% : 0.000003s : 20: predicate.environ_get_add_eliminate 1.30% : 0.000003s : 20: predicate.environ_get_depend_swap 1.41% : 0.000003s : 20: predicate.environ_get_eliminate 1.32% : 0.000003s : 20: predicate.environ_get_set_eliminate 0.15% : 0.000000s : 3: predicate.fold_const_symbol 0.73% : 0.000001s : 6: predicate.get_grad_eliminate 0.16% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000011s : 40: predicate.inline 0.60% : 0.000001s : 6: predicate.inline_without_move 0.22% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.65% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000003s : 22: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 25: predicate.load_eliminater 0.83% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.83% : 0.000009s : 64: predicate.loop_unroll_before_grad 1.80% : 0.000004s : 23: predicate.make_slice_get_slice_eliminator 1.36% : 0.000003s : 19: predicate.merge_addn 1.25% : 0.000002s : 19: predicate.minmaximum_grad 1.06% : 0.000002s : 3: predicate.mutable_eliminate 0.32% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000004s : 25: predicate.partial_eliminate 1.47% : 0.000003s : 19: predicate.print_const_string_wrapper 1.73% : 0.000003s : 19: predicate.reduce_eliminate 1.73% : 0.000003s : 22: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.59% : 0.000003s : 28: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.19% : 0.000000s : 3: predicate.reset_defer_inline 1.65% : 0.000003s : 20: predicate.reshape_eliminate 1.31% : 0.000003s : 19: predicate.row_tensor_add_zeros_like 0.43% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000003s : 19: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.54% : 0.000001s : 6: predicate.special_op_eliminate 0.57% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000003s : 19: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000003s : 19: predicate.stack_unstack_eliminate 0.26% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.42% : 0.000007s : 34: predicate.switch_defer_inline 2.65% : 0.000005s : 34: predicate.switch_layer_defer_inline 8.99% : 0.000018s : 107: predicate.switch_simplify 1.43% : 0.000003s : 19: predicate.tile_eliminate 1.30% : 0.000003s : 19: predicate.transpose_eliminate 1.62% : 0.000003s : 20: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000003s : 20: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000007s : 28: predicate.tuple_list_get_item_eliminator 1.59% : 0.000003s : 20: predicate.tuple_list_set_item_eliminator 1.69% : 0.000003s : 22: predicate.tuple_to_list_eliminator_ 1.71% : 0.000003s : 25: predicate.updatestate_pure_node_eliminater 2.30% : 0.000005s : 31: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 19: predicate.value_based_eliminate 0.19% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.37% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003138 40 64.88% : 0.002036s : 21: func_graph_cloner_run.FuncGraphClonerGraph 8.50% : 0.000267s : 5: func_graph_cloner_run.FuncGraphClonerNode 26.62% : 0.000835s : 14: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.105802 72 0.05% : 0.000055s : 1: add_recomputation 0.12% : 0.000132s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.35% : 0.000370s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.32% : 0.000343s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000012s : 1: graph_reusing 7.48% : 0.007916s : 1: jit_opt_a 0.15% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000052s : 1: jit_opt_b 0.41% : 0.000433s : 1: loop_unroll 0.57% : 0.000604s : 1: mutable_eliminate 1.75% : 0.001850s : 26: opt.transform.jit_opt_a 0.05% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000026s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000573s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000006s : 1: pre_auto_parallel 0.04% : 0.000043s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.51% : 0.001594s : 1: renormalize.infer 0.59% : 0.000625s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000142s : 1: rewriter_before_opt_a 0.08% : 0.000080s : 1: symbol_engine_optimizer 85.49% : 0.090448s : 1: type_inference TotalTime = 0.0185915, [30] [bootstrap]: 0.00027443 [type_inference]: 0.00919356 [event_method]: 2.015e-05 [auto_monad]: 5.043e-05 [graph_reusing]: 3.95e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 4.255e-05 [rewriter_before_opt_a]: 7.127e-05 [expand_dump_flag]: 1.72001e-06 [jit_opt_a]: 0.00675522, [2] [Cycle 1]: 0.00296485, [27] [switch_simplify]: 5.249e-05 [loop_unroll]: 3.191e-05 [a_1]: 0.00170692 [with_stream_mark]: 1.576e-05 [recompute_prepare]: 7.97003e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.211e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 8.65999e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00083031 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.392e-05 [cse]: 2.722e-05 [replace_applicator]: 1.257e-05 [Cycle 2]: 0.00033498, [27] [switch_simplify]: 5.81998e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.812e-05 [with_stream_mark]: 9.44e-06 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.037e-05 [j_node_and_user_rematch]: 7.79002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.199e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.353e-05 [rewriter_after_opt_a]: 4.147e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00061126 [jit_opt_b]: 4.812e-05, [1] [Cycle 1]: 4.198e-05, [2] [frontend_op_eliminate]: 1.593e-05 [inline_after_opt_a]: 1.543e-05 [cconv]: 2.188e-05 [loop_unroll]: 0.00042543 [jit_opt_after_cconv]: 0.00013676, [1] [Cycle 1]: 0.00013043, [11] [c_1]: 1.993e-05 [parameter_eliminate]: 1.50999e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 1.827e-05 [call_graph_tuple_transform]: 1.645e-05 [tuple_list_get_item_eliminator]: 5.53002e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 1.379e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 5.52001e-06 [add_recomputation]: 4.997e-05 [cse_after_recomputation]: 2.381e-05, [1] [Cycle 1]: 1.845e-05, [1] [cse]: 1.174e-05 [auto_monad_reorder]: 1.61e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 4.27e-06 [opt_after_jit_grad]: 0.00043058 [symbol_engine_optimizer]: 0.00012872, [1] [Cycle 1]: 0.0001229, [6] [build]: 2.93e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 3.80009e-07 [validate]: 3.374e-05 Sums bootstrap : 0.000274s : 1.89% type_inference : 0.009194s : 63.40% event_method : 0.000020s : 0.14% auto_monad : 0.000050s : 0.35% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000043s : 0.29% rewriter_before_opt_a : 0.000071s : 0.49% expand_dump_flag : 0.000002s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.40% jit_opt_a.loop_unroll : 0.000037s : 0.25% jit_opt_a.a_1 : 0.001805s : 12.45% jit_opt_a.with_stream_mark : 0.000025s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000006s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000830s : 5.73% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.13% jit_opt_a.cse : 0.000039s : 0.27% jit_opt_a.replace_applicator : 0.000018s : 0.12% py_interpret_to_execute_after_opt_a : 0.000014s : 0.09% rewriter_after_opt_a : 0.000041s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000611s : 4.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000022s : 0.15% loop_unroll : 0.000425s : 2.93% jit_opt_after_cconv.c_1 : 0.000020s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000014s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000050s : 0.34% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000016s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000431s : 2.97% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.23% Time group info: ------[substitution.] 0.000264 27 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 3: substitution.graph_param_transform 84.99% : 0.000225s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.96% : 0.000010s : 3: substitution.reduce_eliminate 1.53% : 0.000004s : 4: substitution.remove_not_recompute_node 1.39% : 0.000004s : 2: substitution.replace_old_param 3.66% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009132 2 89.02% : 0.008130s : 1: type_inference.infer 10.98% : 0.001003s : 1: type_inference.specialize ------[replace.] 0.000095 7 67.40% : 0.000064s : 5: replace.inline 32.60% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 96.26% : 0.000222s : 5: match.inline 3.74% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 2.00% : 0.000002s : 11: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 2.15% : 0.000003s : 11: predicate.arithmetic_simplify 1.63% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.67% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.76% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_depend_swap 1.32% : 0.000002s : 11: predicate.environ_get_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 2.19% : 0.000003s : 11: predicate.reduce_eliminate 1.79% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.75% : 0.000003s : 18: predicate.switch_defer_inline 2.35% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.79% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000761 16 42.97% : 0.000327s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.65% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 48.39% : 0.000368s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021491 72 0.25% : 0.000053s : 1: add_recomputation 0.25% : 0.000054s : 1: auto_monad 0.09% : 0.000019s : 1: auto_monad_reorder 1.34% : 0.000288s : 1: bootstrap 0.11% : 0.000024s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.11% : 0.000024s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000006s : 1: graph_reusing 31.45% : 0.006759s : 1: jit_opt_a 0.65% : 0.000139s : 1: jit_opt_after_cconv 0.23% : 0.000050s : 1: jit_opt_b 2.01% : 0.000431s : 1: loop_unroll 2.87% : 0.000618s : 1: mutable_eliminate 9.38% : 0.002015s : 26: opt.transform.jit_opt_a 0.21% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.05% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000013s : 1: opt.transform.mutable_eliminate 0.09% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.03% : 0.000437s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000045s : 1: py_interpret_to_execute 0.07% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000016s : 1: remove_dup_value 2.20% : 0.000473s : 1: renormalize.infer 1.63% : 0.000350s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000045s : 1: rewriter_after_opt_a 0.34% : 0.000074s : 1: rewriter_before_opt_a 0.61% : 0.000131s : 1: symbol_engine_optimizer 42.84% : 0.009206s : 1: type_inference TotalTime = 0.0821799, [30] [bootstrap]: 0.00030605 [type_inference]: 0.0712182 [event_method]: 2.495e-05 [auto_monad]: 7.152e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 0.00034085 [rewriter_before_opt_a]: 0.0001001 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00795446, [2] [Cycle 1]: 0.00402239, [27] [switch_simplify]: 5.429e-05 [loop_unroll]: 3.423e-05 [a_1]: 0.00073439 [with_stream_mark]: 2.019e-05 [recompute_prepare]: 8.80001e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 7.90998e-06 [updatestate_useless_node_eliminater]: 7.66001e-06 [accelerated_algorithm]: 7.43e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.81999e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.154e-05 [inline_without_move]: 7.25e-06 [renormalize]: 0.00284792 [add_forward_monad_depend]: 6.64001e-06 [auto_monad_grad]: 1.82999e-06 [auto_monad_eliminator]: 1.207e-05 [cse]: 2.302e-05 [replace_applicator]: 1.273e-05 [Cycle 2]: 0.00037212, [27] [switch_simplify]: 7.25998e-06 [loop_unroll]: 6.92002e-06 [a_1]: 0.00012284 [with_stream_mark]: 1.06e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 7.18998e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.405e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.542e-05 [replace_applicator]: 5.95002e-06 [py_interpret_to_execute_after_opt_a]: 9.71e-06 [rewriter_after_opt_a]: 3.101e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 4.4e-06 [mutable_eliminate]: 0.00053143 [jit_opt_b]: 5.219e-05, [1] [Cycle 1]: 4.634e-05, [2] [frontend_op_eliminate]: 1.784e-05 [inline_after_opt_a]: 1.788e-05 [cconv]: 1.668e-05 [loop_unroll]: 0.00047252 [jit_opt_after_cconv]: 0.00015378, [1] [Cycle 1]: 0.00014707, [11] [c_1]: 2.721e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 5.24998e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.288e-05 [call_graph_tuple_transform]: 1.938e-05 [tuple_list_get_item_eliminator]: 6.98998e-06 [none_parameter_eliminate]: 9.50007e-07 [renormalize]: 3.30008e-07 [switch_simplify]: 6.58e-06 [remove_dup_value]: 1.248e-05 [partial_unused_args_eliminate]: 1.76998e-06 [environ_conv]: 7.61001e-06 [add_recomputation]: 3.215e-05 [cse_after_recomputation]: 2.525e-05, [1] [Cycle 1]: 1.999e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.14e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 4.24002e-06 [opt_after_jit_grad]: 0.00048205 [symbol_engine_optimizer]: 7.481e-05, [1] [Cycle 1]: 6.821e-05, [6] [build]: 2.48e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 1.384e-05 [opt_reshape]: 6.88998e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 3.4002e-07 [validate]: 5.329e-05 Sums bootstrap : 0.000306s : 0.39% type_inference : 0.071218s : 91.24% event_method : 0.000025s : 0.03% auto_monad : 0.000072s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000341s : 0.44% rewriter_before_opt_a : 0.000100s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.08% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000857s : 1.10% jit_opt_a.with_stream_mark : 0.000031s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002848s : 3.65% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000038s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000531s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000473s : 0.61% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000032s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000482s : 0.62% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.07% Time group info: ------[substitution.] 0.000281 25 0.41% : 0.000001s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 1.60% : 0.000004s : 4: substitution.graph_param_transform 88.54% : 0.000249s : 5: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.35% : 0.000004s : 2: substitution.replace_old_param 4.52% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.071132 2 96.18% : 0.068417s : 1: type_inference.infer 3.82% : 0.002715s : 1: type_inference.specialize ------[replace.] 0.000114 7 67.98% : 0.000077s : 5: replace.inline 32.02% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 95.51% : 0.000246s : 5: match.inline 4.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 888 1.59% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.40% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.72% : 0.000006s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 1.81% : 0.000002s : 13: predicate.reduce_eliminate 1.62% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.96% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.82% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.65% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 65: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.87% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002795 29 68.34% : 0.001910s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.71% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.95% : 0.000809s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.086196 72 0.04% : 0.000035s : 1: add_recomputation 0.09% : 0.000075s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.38% : 0.000324s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.23% : 0.007958s : 1: jit_opt_a 0.18% : 0.000156s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.56% : 0.000479s : 1: loop_unroll 0.63% : 0.000539s : 1: mutable_eliminate 1.28% : 0.001105s : 26: opt.transform.jit_opt_a 0.07% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000345s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000015s : 1: remove_dup_value 2.37% : 0.002046s : 1: renormalize.infer 0.92% : 0.000792s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000104s : 1: rewriter_before_opt_a 0.09% : 0.000077s : 1: symbol_engine_optimizer 82.64% : 0.071233s : 1: type_inference TotalTime = 0.270642, [30] [bootstrap]: 0.00042951 [type_inference]: 0.243745 [event_method]: 2.802e-05 [auto_monad]: 8.599e-05 [graph_reusing]: 6.89001e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00065267 [rewriter_before_opt_a]: 0.0001111 [expand_dump_flag]: 4.53999e-06 [jit_opt_a]: 0.0226824, [2] [Cycle 1]: 0.0179949, [27] [switch_simplify]: 6.987e-05 [loop_unroll]: 3.551e-05 [a_1]: 0.00077796 [with_stream_mark]: 2.553e-05 [recompute_prepare]: 1.004e-05 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.9e-06 [updatestate_loads_eliminate]: 3.63999e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 7.56999e-06 [updatestate_useless_node_eliminater]: 6.71e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 7.37997e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 7.40998e-06 [renormalize]: 0.0166482 [add_forward_monad_depend]: 1.09e-05 [auto_monad_grad]: 3.02002e-06 [auto_monad_eliminator]: 2.146e-05 [cse]: 4.151e-05 [replace_applicator]: 2.625e-05 [Cycle 2]: 0.00044094, [27] [switch_simplify]: 8.02998e-06 [loop_unroll]: 6.09999e-06 [a_1]: 0.00015257 [with_stream_mark]: 1.649e-05 [recompute_prepare]: 7.32002e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 6.53998e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 4.85999e-06 [cell_reuse_recompute_pass]: 4.62e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.736e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.43002e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 6.53e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 7.13e-06 [cse]: 1.707e-05 [replace_applicator]: 6.81001e-06 [py_interpret_to_execute_after_opt_a]: 1.789e-05 [rewriter_after_opt_a]: 4.297e-05 [convert_after_rewriter]: 8.38999e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00087724 [jit_opt_b]: 9.574e-05, [1] [Cycle 1]: 8.622e-05, [2] [frontend_op_eliminate]: 5.011e-05 [inline_after_opt_a]: 2.148e-05 [cconv]: 3.173e-05 [loop_unroll]: 0.00049817 [jit_opt_after_cconv]: 0.00018214, [1] [Cycle 1]: 0.00017335, [11] [c_1]: 2.825e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 7.92e-06 [updatestate_assign_eliminate]: 2.90002e-06 [updatestate_loads_eliminate]: 2.84999e-06 [cse]: 3.249e-05 [call_graph_tuple_transform]: 2.524e-05 [tuple_list_get_item_eliminator]: 7.63001e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 4.99975e-07 [switch_simplify]: 7.03e-06 [remove_dup_value]: 1.779e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 9.79e-06 [add_recomputation]: 5.615e-05 [cse_after_recomputation]: 2.614e-05, [1] [Cycle 1]: 2.047e-05, [1] [cse]: 1.373e-05 [auto_monad_reorder]: 1.931e-05 [get_jit_bprop_graph]: 2.35002e-06 [rewriter_after_jit_bprop_graph]: 6.98998e-06 [opt_after_jit_grad]: 0.000542 [symbol_engine_optimizer]: 9.022e-05, [1] [Cycle 1]: 8.059e-05, [6] [build]: 4.32e-06 [elim_shapecalc]: 9.38002e-06 [elim_not_effective]: 1.713e-05 [opt_reshape]: 7.98999e-06 [fold_const_symbol]: 9.59e-06 [renormalize]: 8.29983e-07 [validate]: 0.00013687 Sums bootstrap : 0.000430s : 0.16% type_inference : 0.243745s : 91.74% event_method : 0.000028s : 0.01% auto_monad : 0.000086s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000653s : 0.25% rewriter_before_opt_a : 0.000111s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.03% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.000931s : 0.35% jit_opt_a.with_stream_mark : 0.000042s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.016648s : 6.27% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000059s : 0.02% jit_opt_a.replace_applicator : 0.000033s : 0.01% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000043s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000877s : 0.33% jit_opt_b.frontend_op_eliminate : 0.000050s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.000498s : 0.19% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000542s : 0.20% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000137s : 0.05% Time group info: ------[substitution.] 0.000336 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000007s : 4: substitution.graph_param_transform 84.13% : 0.000282s : 5: substitution.inline 1.14% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.80% : 0.000016s : 3: substitution.reduce_eliminate 1.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000006s : 2: substitution.replace_old_param 3.41% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.243620 2 93.67% : 0.228197s : 1: type_inference.infer 6.33% : 0.015423s : 1: type_inference.specialize ------[replace.] 0.000112 7 69.31% : 0.000078s : 5: replace.inline 30.69% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000290 7 96.44% : 0.000280s : 5: match.inline 3.56% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.41% : 0.000004s : 13: predicate.arithmetic_simplify 1.15% : 0.000002s : 13: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 0.99% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000009s : 28: predicate.inline 1.11% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 0.98% : 0.000002s : 13: predicate.minmaximum_grad 2.07% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 2.42% : 0.000004s : 13: predicate.reduce_eliminate 1.69% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 2.03% : 0.000003s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.51% : 0.000012s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.43% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.52% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002876 25 63.49% : 0.001826s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.15% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.36% : 0.000959s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.288512 72 0.02% : 0.000059s : 1: add_recomputation 0.03% : 0.000090s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.16% : 0.000451s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 7.86% : 0.022686s : 1: jit_opt_a 0.06% : 0.000185s : 1: jit_opt_after_cconv 0.03% : 0.000099s : 1: jit_opt_b 0.18% : 0.000508s : 1: loop_unroll 0.31% : 0.000889s : 1: mutable_eliminate 0.42% : 0.001209s : 26: opt.transform.jit_opt_a 0.02% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000063s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000551s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000661s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 5.40% : 0.015583s : 1: renormalize.infer 0.36% : 0.001051s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.04% : 0.000117s : 1: rewriter_before_opt_a 0.03% : 0.000093s : 1: symbol_engine_optimizer 84.49% : 0.243774s : 1: type_inference TotalTime = 0.020385, [30] [bootstrap]: 0.0002566 [type_inference]: 0.0106076 [event_method]: 2.19e-05 [auto_monad]: 7.252e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 4.953e-05 [rewriter_before_opt_a]: 8.583e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00681591, [2] [Cycle 1]: 0.00231128, [27] [switch_simplify]: 7.389e-05 [loop_unroll]: 3.787e-05 [a_1]: 0.00074832 [with_stream_mark]: 2.51e-05 [recompute_prepare]: 1.097e-05 [updatestate_depend_eliminate]: 5.47001e-06 [updatestate_assign_eliminate]: 4.30999e-06 [updatestate_loads_eliminate]: 3.46999e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 8.18999e-06 [updatestate_useless_node_eliminater]: 7.2e-06 [accelerated_algorithm]: 8.56002e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 7.69002e-06 [merge_forward]: 4.89e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.772e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 1.135e-05 [inline_without_move]: 6.74999e-06 [renormalize]: 0.0010328 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.718e-05 [cse]: 4.122e-05 [replace_applicator]: 1.695e-05 [Cycle 2]: 0.00035011, [27] [switch_simplify]: 6.53998e-06 [loop_unroll]: 5.77001e-06 [a_1]: 9.959e-05 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 6.16998e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.54998e-06 [updatestate_useless_node_eliminater]: 5.49998e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.67001e-06 [get_grad_eliminate_]: 4.89003e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.76001e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.616e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.437e-05 [rewriter_after_opt_a]: 4.168e-05 [convert_after_rewriter]: 7.47002e-06 [order_py_execute_after_rewriter]: 5.49998e-06 [mutable_eliminate]: 0.00065799 [jit_opt_b]: 5.204e-05, [1] [Cycle 1]: 4.474e-05, [2] [frontend_op_eliminate]: 1.63e-05 [inline_after_opt_a]: 1.713e-05 [cconv]: 2.872e-05 [loop_unroll]: 0.00044639 [jit_opt_after_cconv]: 0.00018259, [1] [Cycle 1]: 0.0001754, [11] [c_1]: 2.263e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 6.56999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 3.249e-05 [call_graph_tuple_transform]: 2.324e-05 [tuple_list_get_item_eliminator]: 6.65998e-06 [none_parameter_eliminate]: 1.93002e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.21998e-06 [remove_dup_value]: 4.078e-05 [partial_unused_args_eliminate]: 2.89999e-06 [environ_conv]: 6.94999e-06 [add_recomputation]: 5.481e-05 [cse_after_recomputation]: 2.682e-05, [1] [Cycle 1]: 2.108e-05, [1] [cse]: 1.503e-05 [auto_monad_reorder]: 1.826e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.00051001 [symbol_engine_optimizer]: 8.082e-05, [1] [Cycle 1]: 7.376e-05, [6] [build]: 4.70001e-06 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.53e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 9.90002e-06 [renormalize]: 5.00004e-07 [validate]: 4.585e-05 Sums bootstrap : 0.000257s : 1.65% type_inference : 0.010608s : 68.20% event_method : 0.000022s : 0.14% auto_monad : 0.000073s : 0.47% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.32% rewriter_before_opt_a : 0.000086s : 0.55% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000080s : 0.52% jit_opt_a.loop_unroll : 0.000044s : 0.28% jit_opt_a.a_1 : 0.000848s : 5.45% jit_opt_a.with_stream_mark : 0.000035s : 0.23% jit_opt_a.recompute_prepare : 0.000017s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000014s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.08% jit_opt_a.accelerated_algorithm : 0.000014s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.08% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.12% jit_opt_a.inline_without_move : 0.000012s : 0.08% jit_opt_a.renormalize : 0.001033s : 6.64% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.15% jit_opt_a.cse : 0.000057s : 0.37% jit_opt_a.replace_applicator : 0.000023s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.09% rewriter_after_opt_a : 0.000042s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000658s : 4.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000029s : 0.18% loop_unroll : 0.000446s : 2.87% jit_opt_after_cconv.c_1 : 0.000023s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000041s : 0.26% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000055s : 0.35% cse_after_recomputation.cse : 0.000015s : 0.10% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000510s : 3.28% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.29% Time group info: ------[substitution.] 0.000313 24 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 3: substitution.graph_param_transform 87.61% : 0.000274s : 5: substitution.inline 1.00% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.85% : 0.000006s : 4: substitution.remove_not_recompute_node 1.72% : 0.000005s : 2: substitution.replace_old_param 4.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010536 2 89.16% : 0.009394s : 1: type_inference.infer 10.84% : 0.001142s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.22% : 0.000074s : 5: replace.inline 31.78% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 7 95.74% : 0.000270s : 5: match.inline 4.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.23% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 11: predicate.addn_check_dump 1.24% : 0.000002s : 11: predicate.addn_zero_filter 2.34% : 0.000003s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.25% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.91% : 0.000008s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.31% : 0.000003s : 16: predicate.load_eliminater 1.27% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 11: predicate.merge_addn 1.07% : 0.000001s : 11: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 2.11% : 0.000003s : 16: predicate.partial_eliminate 1.12% : 0.000002s : 11: predicate.print_const_string_wrapper 1.81% : 0.000002s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 19: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.43% : 0.000002s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.00% : 0.000011s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000915 16 46.90% : 0.000429s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.91% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.19% : 0.000395s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022546 72 0.26% : 0.000058s : 1: add_recomputation 0.34% : 0.000076s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.20% : 0.000271s : 1: bootstrap 0.14% : 0.000031s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.25% : 0.006820s : 1: jit_opt_a 0.82% : 0.000185s : 1: jit_opt_after_cconv 0.24% : 0.000055s : 1: jit_opt_b 2.02% : 0.000455s : 1: loop_unroll 2.96% : 0.000667s : 1: mutable_eliminate 4.95% : 0.001116s : 26: opt.transform.jit_opt_a 0.24% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000037s : 4: opt.transform.symbol_engine_opt 2.31% : 0.000522s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000052s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000044s : 1: remove_dup_value 2.69% : 0.000607s : 1: renormalize.infer 1.85% : 0.000416s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000045s : 1: rewriter_after_opt_a 0.39% : 0.000089s : 1: rewriter_before_opt_a 0.37% : 0.000084s : 1: symbol_engine_optimizer 47.13% : 0.010625s : 1: type_inference TotalTime = 0.079326, [30] [bootstrap]: 0.00031458 [type_inference]: 0.0684204 [event_method]: 2.229e-05 [auto_monad]: 7.498e-05 [graph_reusing]: 7.18e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 0.00030991 [rewriter_before_opt_a]: 9.331e-05 [expand_dump_flag]: 4.22998e-06 [jit_opt_a]: 0.00783225, [2] [Cycle 1]: 0.00349864, [27] [switch_simplify]: 6.116e-05 [loop_unroll]: 3.113e-05 [a_1]: 0.00064936 [with_stream_mark]: 2.321e-05 [recompute_prepare]: 1.047e-05 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 6.65002e-06 [accelerated_algorithm]: 7.54002e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 7.16001e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 1.109e-05 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.109e-05 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00235363 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.80002e-06 [auto_monad_eliminator]: 1.703e-05 [cse]: 3.116e-05 [replace_applicator]: 1.781e-05 [Cycle 2]: 0.00037686, [27] [switch_simplify]: 6.99001e-06 [loop_unroll]: 5.76e-06 [a_1]: 0.00012487 [with_stream_mark]: 1.206e-05 [recompute_prepare]: 6.04999e-06 [updatestate_depend_eliminate]: 3.03998e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 1.83997e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.78002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.78002e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.236e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.281e-05 [rewriter_after_opt_a]: 3.692e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.0006007 [jit_opt_b]: 5.633e-05, [1] [Cycle 1]: 4.923e-05, [2] [frontend_op_eliminate]: 1.936e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 2.787e-05 [loop_unroll]: 0.00042723 [jit_opt_after_cconv]: 0.00015818, [1] [Cycle 1]: 0.00015115, [11] [c_1]: 3.024e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 2.24e-05 [call_graph_tuple_transform]: 2.043e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.52e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 8.31002e-06 [add_recomputation]: 4.935e-05 [cse_after_recomputation]: 2.31e-05, [1] [Cycle 1]: 1.744e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.612e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 5.08002e-06 [opt_after_jit_grad]: 0.00045975 [symbol_engine_optimizer]: 7.832e-05, [1] [Cycle 1]: 7.22e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 9.74e-06 [elim_not_effective]: 1.421e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 3.19997e-07 [validate]: 5.716e-05 Sums bootstrap : 0.000315s : 0.42% type_inference : 0.068420s : 91.53% event_method : 0.000022s : 0.03% auto_monad : 0.000075s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000310s : 0.41% rewriter_before_opt_a : 0.000093s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000774s : 1.04% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002354s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000044s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000601s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.04% loop_unroll : 0.000427s : 0.57% jit_opt_after_cconv.c_1 : 0.000030s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000460s : 0.62% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.08% Time group info: ------[substitution.] 0.000248 24 1.05% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 4: substitution.graph_param_transform 84.98% : 0.000211s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.24% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068318 2 97.07% : 0.066318s : 1: type_inference.infer 2.93% : 0.002000s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.92% : 0.000054s : 4: replace.inline 31.08% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.68% : 0.000208s : 4: match.inline 5.32% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.48% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.34% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.32% : 0.000002s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 6.10% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.16% : 0.000002s : 12: predicate.minmaximum_grad 1.11% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.41% : 0.000002s : 12: predicate.print_const_string_wrapper 2.05% : 0.000003s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 8: predicate.special_op_eliminate 1.20% : 0.000002s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.47% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002673 30 73.78% : 0.001972s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.97% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.26% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.082761 72 0.06% : 0.000052s : 1: add_recomputation 0.09% : 0.000078s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.41% : 0.000337s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.47% : 0.007835s : 1: jit_opt_a 0.19% : 0.000161s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.53% : 0.000436s : 1: loop_unroll 0.74% : 0.000609s : 1: mutable_eliminate 1.24% : 0.001025s : 26: opt.transform.jit_opt_a 0.07% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000317s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.97% : 0.001630s : 1: renormalize.infer 0.86% : 0.000713s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.12% : 0.000099s : 1: rewriter_before_opt_a 0.10% : 0.000081s : 1: symbol_engine_optimizer 82.70% : 0.068442s : 1: type_inference TotalTime = 0.0223096, [30] [bootstrap]: 0.00027953 [type_inference]: 0.0112232 [event_method]: 2.524e-05 [auto_monad]: 8.218e-05 [graph_reusing]: 6.89999e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 7.207e-05 [rewriter_before_opt_a]: 0.00010062 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.00780841, [2] [Cycle 1]: 0.00269332, [27] [switch_simplify]: 8.073e-05 [loop_unroll]: 3.628e-05 [a_1]: 0.00075585 [with_stream_mark]: 2.309e-05 [recompute_prepare]: 9.56e-06 [updatestate_depend_eliminate]: 5.29998e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 6.93998e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 3.03e-06 [get_grad_eliminate_]: 5.58997e-06 [merge_forward]: 4.29997e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.643e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.59e-06 [renormalize]: 0.00136387 [add_forward_monad_depend]: 7.58001e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 2.11e-05 [cse]: 4.73e-05 [replace_applicator]: 2.122e-05 [Cycle 2]: 0.00036781, [27] [switch_simplify]: 6.97002e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.00010626 [with_stream_mark]: 1.477e-05 [recompute_prepare]: 5.63997e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 4.95001e-06 [merge_forward]: 3.55003e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.739e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 7.01001e-06 [cse]: 1.543e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.896e-05 [rewriter_after_opt_a]: 4.263e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00077454 [jit_opt_b]: 5.69e-05, [1] [Cycle 1]: 4.804e-05, [2] [frontend_op_eliminate]: 1.89e-05 [inline_after_opt_a]: 1.737e-05 [cconv]: 3.481e-05 [loop_unroll]: 0.00048411 [jit_opt_after_cconv]: 0.000181, [1] [Cycle 1]: 0.00017339, [11] [c_1]: 2.318e-05 [parameter_eliminate]: 3.80998e-06 [updatestate_depend_eliminate]: 8.68001e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 2.89001e-06 [cse]: 3.708e-05 [call_graph_tuple_transform]: 2.566e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 4.543e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 6.40997e-06 [add_recomputation]: 5.595e-05 [cse_after_recomputation]: 3.029e-05, [1] [Cycle 1]: 2.269e-05, [1] [cse]: 1.482e-05 [auto_monad_reorder]: 2.003e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 7.38e-06 [opt_after_jit_grad]: 0.00055133 [symbol_engine_optimizer]: 0.00012255, [1] [Cycle 1]: 0.00011409, [6] [build]: 4.67e-06 [elim_shapecalc]: 8.33001e-06 [elim_not_effective]: 5.492e-05 [opt_reshape]: 6.60997e-06 [fold_const_symbol]: 1.015e-05 [renormalize]: 4.50003e-07 [validate]: 5.04e-05 Sums bootstrap : 0.000280s : 1.66% type_inference : 0.011223s : 66.51% event_method : 0.000025s : 0.15% auto_monad : 0.000082s : 0.49% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000072s : 0.43% rewriter_before_opt_a : 0.000101s : 0.60% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000088s : 0.52% jit_opt_a.loop_unroll : 0.000042s : 0.25% jit_opt_a.a_1 : 0.000862s : 5.11% jit_opt_a.with_stream_mark : 0.000038s : 0.22% jit_opt_a.recompute_prepare : 0.000015s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001364s : 8.08% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.17% jit_opt_a.cse : 0.000063s : 0.37% jit_opt_a.replace_applicator : 0.000027s : 0.16% py_interpret_to_execute_after_opt_a : 0.000019s : 0.11% rewriter_after_opt_a : 0.000043s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000775s : 4.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000035s : 0.21% loop_unroll : 0.000484s : 2.87% jit_opt_after_cconv.c_1 : 0.000023s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000037s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000045s : 0.27% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000056s : 0.33% cse_after_recomputation.cse : 0.000015s : 0.09% auto_monad_reorder : 0.000020s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000551s : 3.27% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000055s : 0.33% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.30% Time group info: ------[substitution.] 0.000327 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 2.20% : 0.000007s : 3: substitution.graph_param_transform 87.38% : 0.000286s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.82% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000006s : 2: substitution.replace_old_param 4.22% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011134 2 84.59% : 0.009418s : 1: type_inference.infer 15.41% : 0.001716s : 1: type_inference.specialize ------[replace.] 0.000114 7 67.84% : 0.000078s : 5: replace.inline 32.16% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000295 7 95.77% : 0.000283s : 5: match.inline 4.23% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 747 1.48% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 11: predicate.addn_check_dump 1.54% : 0.000002s : 11: predicate.addn_zero_filter 2.35% : 0.000003s : 11: predicate.arithmetic_simplify 1.50% : 0.000002s : 11: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.30% : 0.000002s : 11: predicate.compare_switch_simplify 1.06% : 0.000001s : 11: predicate.depend_value_elim 1.05% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.71% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000008s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 16: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000002s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000002s : 11: predicate.print_const_string_wrapper 1.74% : 0.000002s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000003s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.52% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.68% : 0.000011s : 59: predicate.switch_simplify 1.13% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.89% : 0.000003s : 13: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.55% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001225 16 43.40% : 0.000532s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.66% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 48.94% : 0.000599s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024867 72 0.24% : 0.000059s : 1: add_recomputation 0.34% : 0.000086s : 1: auto_monad 0.09% : 0.000023s : 1: auto_monad_reorder 1.17% : 0.000291s : 1: bootstrap 0.15% : 0.000037s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000032s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.13% : 0.000031s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000006s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 31.42% : 0.007812s : 1: jit_opt_a 0.74% : 0.000184s : 1: jit_opt_after_cconv 0.24% : 0.000060s : 1: jit_opt_b 1.99% : 0.000494s : 1: loop_unroll 3.17% : 0.000787s : 1: mutable_eliminate 4.54% : 0.001129s : 26: opt.transform.jit_opt_a 0.23% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000018s : 1: opt.transform.mutable_eliminate 0.11% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000039s : 4: opt.transform.symbol_engine_opt 2.27% : 0.000565s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000076s : 1: py_interpret_to_execute 0.09% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000048s : 1: remove_dup_value 2.98% : 0.000741s : 1: renormalize.infer 2.46% : 0.000612s : 1: renormalize.specialize 0.04% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000046s : 1: rewriter_after_opt_a 0.42% : 0.000105s : 1: rewriter_before_opt_a 0.50% : 0.000126s : 1: symbol_engine_optimizer 45.24% : 0.011249s : 1: type_inference TotalTime = 0.0678212, [30] [bootstrap]: 0.00034655 [type_inference]: 0.0574222 [event_method]: 1.981e-05 [auto_monad]: 6.995e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00029364 [rewriter_before_opt_a]: 8.99e-05 [expand_dump_flag]: 3.96001e-06 [jit_opt_a]: 0.0073025, [2] [Cycle 1]: 0.00333333, [27] [switch_simplify]: 6.342e-05 [loop_unroll]: 3.349e-05 [a_1]: 0.00063314 [with_stream_mark]: 1.97e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.94001e-06 [updatestate_useless_node_eliminater]: 6.58e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.745e-05 [j_node_and_user_rematch]: 1.187e-05 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 1.104e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00220287 [add_forward_monad_depend]: 8.15999e-06 [auto_monad_grad]: 2.63003e-06 [auto_monad_eliminator]: 1.871e-05 [cse]: 3.411e-05 [replace_applicator]: 2.103e-05 [Cycle 2]: 0.00038663, [27] [switch_simplify]: 6.83998e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00012697 [with_stream_mark]: 1.356e-05 [recompute_prepare]: 6.56e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.66002e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.12998e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.65e-05 [j_node_and_user_rematch]: 9.99999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.89e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 6.88998e-06 [cse]: 1.264e-05 [replace_applicator]: 6.51999e-06 [py_interpret_to_execute_after_opt_a]: 1.388e-05 [rewriter_after_opt_a]: 3.73e-05 [convert_after_rewriter]: 7.88999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00056044 [jit_opt_b]: 5.741e-05, [1] [Cycle 1]: 5.045e-05, [2] [frontend_op_eliminate]: 2.021e-05 [inline_after_opt_a]: 1.96e-05 [cconv]: 2.83e-05 [loop_unroll]: 0.00042381 [jit_opt_after_cconv]: 0.00015573, [1] [Cycle 1]: 0.00014944, [11] [c_1]: 2.656e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.86003e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.294e-05 [call_graph_tuple_transform]: 2.186e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 6.54001e-06 [remove_dup_value]: 1.639e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 9.43997e-06 [add_recomputation]: 5.098e-05 [cse_after_recomputation]: 2.321e-05, [1] [Cycle 1]: 1.798e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.655e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 6.40002e-06 [opt_after_jit_grad]: 0.00047656 [symbol_engine_optimizer]: 7.669e-05, [1] [Cycle 1]: 7.052e-05, [6] [build]: 3.97002e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 9.55001e-06 [renormalize]: 3.80009e-07 [validate]: 9.424e-05 Sums bootstrap : 0.000347s : 0.54% type_inference : 0.057422s : 90.26% event_method : 0.000020s : 0.03% auto_monad : 0.000070s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000294s : 0.46% rewriter_before_opt_a : 0.000090s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.11% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000760s : 1.19% jit_opt_a.with_stream_mark : 0.000033s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002203s : 3.46% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000047s : 0.07% jit_opt_a.replace_applicator : 0.000028s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000560s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000424s : 0.67% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000477s : 0.75% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000094s : 0.15% Time group info: ------[substitution.] 0.000238 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 4: substitution.graph_param_transform 83.64% : 0.000199s : 4: substitution.inline 1.98% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000006s : 2: substitution.replace_old_param 6.05% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057339 2 96.60% : 0.055387s : 1: type_inference.infer 3.40% : 0.001952s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.86% : 0.000052s : 4: replace.inline 32.14% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 93.72% : 0.000196s : 4: match.inline 6.28% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.36% : 0.000002s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.01% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 6.07% : 0.000009s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.15% : 0.000002s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000011s : 58: predicate.switch_simplify 1.39% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002353 26 72.71% : 0.001711s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.95% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.34% : 0.000596s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071054 72 0.08% : 0.000054s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.52% : 0.000369s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.28% : 0.007306s : 1: jit_opt_a 0.22% : 0.000158s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.61% : 0.000433s : 1: loop_unroll 0.80% : 0.000569s : 1: mutable_eliminate 1.43% : 0.001017s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000301s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.11% : 0.001502s : 1: renormalize.infer 0.97% : 0.000690s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000095s : 1: rewriter_before_opt_a 0.11% : 0.000079s : 1: symbol_engine_optimizer 80.84% : 0.057442s : 1: type_inference TotalTime = 0.160804, [30] [bootstrap]: 0.00032998 [type_inference]: 0.148302 [event_method]: 2.598e-05 [auto_monad]: 7.576e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00056749 [rewriter_before_opt_a]: 0.00010045 [expand_dump_flag]: 4.56002e-06 [jit_opt_a]: 0.00802147, [2] [Cycle 1]: 0.00403717, [27] [switch_simplify]: 5.501e-05 [loop_unroll]: 3.489e-05 [a_1]: 0.00069419 [with_stream_mark]: 1.634e-05 [recompute_prepare]: 1.013e-05 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 7.45998e-06 [updatestate_useless_node_eliminater]: 6.69001e-06 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 6.84999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.383e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.55997e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 6.78e-06 [renormalize]: 0.00287394 [add_forward_monad_depend]: 1.21e-05 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.688e-05 [cse]: 3.046e-05 [replace_applicator]: 1.991e-05 [Cycle 2]: 0.00039567, [27] [switch_simplify]: 7.24001e-06 [loop_unroll]: 6.18998e-06 [a_1]: 0.00013487 [with_stream_mark]: 1.297e-05 [recompute_prepare]: 6.03002e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.93003e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 5.56998e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.379e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 6.46e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.61999e-06 [cse]: 1.335e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.434e-05 [rewriter_after_opt_a]: 3.689e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00066402 [jit_opt_b]: 5.9e-05, [1] [Cycle 1]: 5.06e-05, [2] [frontend_op_eliminate]: 1.962e-05 [inline_after_opt_a]: 1.896e-05 [cconv]: 2.671e-05 [loop_unroll]: 0.00046711 [jit_opt_after_cconv]: 0.00016898, [1] [Cycle 1]: 0.00016135, [11] [c_1]: 2.711e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 7.25998e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.79e-05 [call_graph_tuple_transform]: 2.337e-05 [tuple_list_get_item_eliminator]: 7.18e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.931e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 1.003e-05 [add_recomputation]: 5.085e-05 [cse_after_recomputation]: 2.602e-05, [1] [Cycle 1]: 2.07e-05, [1] [cse]: 1.369e-05 [auto_monad_reorder]: 2.043e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 8.13999e-06 [opt_after_jit_grad]: 0.00141385 [symbol_engine_optimizer]: 0.00012208, [1] [Cycle 1]: 0.00011369, [6] [build]: 4e-06 [elim_shapecalc]: 9.44e-06 [elim_not_effective]: 1.786e-05 [opt_reshape]: 7.98999e-06 [fold_const_symbol]: 4.198e-05 [renormalize]: 8.39995e-07 [validate]: 5.045e-05 Sums bootstrap : 0.000330s : 0.21% type_inference : 0.148302s : 94.70% event_method : 0.000026s : 0.02% auto_monad : 0.000076s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000567s : 0.36% rewriter_before_opt_a : 0.000100s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000829s : 0.53% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002874s : 1.84% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000664s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000467s : 0.30% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.001414s : 0.90% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000042s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.03% Time group info: ------[substitution.] 0.000297 28 0.77% : 0.000002s : 2: substitution.elim_not_effective 10.77% : 0.000032s : 2: substitution.fold_const_symbol 2.06% : 0.000006s : 4: substitution.graph_param_transform 74.04% : 0.000220s : 5: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.27% : 0.000013s : 3: substitution.reduce_eliminate 1.62% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 3.62% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.148217 2 97.45% : 0.144437s : 1: type_inference.infer 2.55% : 0.003780s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.52% : 0.000072s : 5: replace.inline 31.48% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 7 95.77% : 0.000217s : 5: match.inline 4.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 1.79% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.58% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.70% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 19: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 2.08% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 1.95% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.70% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002554 25 62.44% : 0.001595s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.76% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.81% : 0.000889s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.164873 72 0.03% : 0.000055s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.21% : 0.000346s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.87% : 0.008025s : 1: jit_opt_a 0.10% : 0.000172s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.29% : 0.000477s : 1: loop_unroll 0.41% : 0.000674s : 1: mutable_eliminate 0.65% : 0.001078s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000074s : 4: opt.transform.symbol_engine_opt 0.86% : 0.001425s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000575s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.21% : 0.001989s : 1: renormalize.infer 0.53% : 0.000873s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.06% : 0.000105s : 1: rewriter_before_opt_a 0.08% : 0.000125s : 1: symbol_engine_optimizer 89.96% : 0.148319s : 1: type_inference TotalTime = 0.0294834, [30] [bootstrap]: 0.00030144 [type_inference]: 0.0194847 [event_method]: 1.878e-05 [auto_monad]: 7.015e-05 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00012146 [rewriter_before_opt_a]: 8.16e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.00691834, [2] [Cycle 1]: 0.00330865, [27] [switch_simplify]: 5.957e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.0016346 [with_stream_mark]: 2.428e-05 [recompute_prepare]: 1.052e-05 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.71e-06 [specialize_transform]: 6.23998e-06 [updatestate_useless_node_eliminater]: 5.56998e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.615e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.80002e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00116421 [add_forward_monad_depend]: 7.4e-06 [auto_monad_grad]: 2.43998e-06 [auto_monad_eliminator]: 1.878e-05 [cse]: 3.734e-05 [replace_applicator]: 1.679e-05 [Cycle 2]: 0.00034299, [27] [switch_simplify]: 6.17001e-06 [loop_unroll]: 5.58997e-06 [a_1]: 8.814e-05 [with_stream_mark]: 1.301e-05 [recompute_prepare]: 5.52001e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.81998e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.618e-05 [j_node_and_user_rematch]: 8.23001e-06 [meta_fg_expand]: 2.06003e-06 [replace_old_param]: 8.82e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.51002e-06 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 7.07002e-06 [cse]: 1.583e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.724e-05 [rewriter_after_opt_a]: 4.246e-05 [convert_after_rewriter]: 7.6e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.0007693 [jit_opt_b]: 5.347e-05, [1] [Cycle 1]: 4.526e-05, [2] [frontend_op_eliminate]: 1.642e-05 [inline_after_opt_a]: 1.729e-05 [cconv]: 2.975e-05 [loop_unroll]: 0.00045827 [jit_opt_after_cconv]: 0.00015905, [1] [Cycle 1]: 0.00015267, [11] [c_1]: 2.119e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 7.2e-06 [updatestate_assign_eliminate]: 2.68003e-06 [updatestate_loads_eliminate]: 3.09999e-06 [cse]: 3.031e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.788e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 7.18e-06 [add_recomputation]: 5.267e-05 [cse_after_recomputation]: 2.379e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 1.949e-05 [get_jit_bprop_graph]: 1.64e-06 [rewriter_after_jit_bprop_graph]: 5.73002e-06 [opt_after_jit_grad]: 0.00048549 [symbol_engine_optimizer]: 7.334e-05, [1] [Cycle 1]: 6.699e-05, [6] [build]: 3.66999e-06 [elim_shapecalc]: 7.40003e-06 [elim_not_effective]: 1.322e-05 [opt_reshape]: 5.40999e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 5.69999e-07 [validate]: 5.373e-05 Sums bootstrap : 0.000301s : 1.18% type_inference : 0.019485s : 76.19% event_method : 0.000019s : 0.07% auto_monad : 0.000070s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000121s : 0.47% rewriter_before_opt_a : 0.000082s : 0.32% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.26% jit_opt_a.loop_unroll : 0.000036s : 0.14% jit_opt_a.a_1 : 0.001723s : 6.74% jit_opt_a.with_stream_mark : 0.000037s : 0.15% jit_opt_a.recompute_prepare : 0.000016s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001164s : 4.55% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.10% jit_opt_a.cse : 0.000053s : 0.21% jit_opt_a.replace_applicator : 0.000023s : 0.09% py_interpret_to_execute_after_opt_a : 0.000017s : 0.07% rewriter_after_opt_a : 0.000042s : 0.17% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000769s : 3.01% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000030s : 0.12% loop_unroll : 0.000458s : 1.79% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000030s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000053s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000485s : 1.90% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.21% Time group info: ------[substitution.] 0.000276 23 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000006s : 3: substitution.graph_param_transform 85.88% : 0.000237s : 4: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000006s : 2: substitution.replace_old_param 5.54% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019401 2 92.80% : 0.018005s : 1: type_inference.infer 7.20% : 0.001396s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.89% : 0.000057s : 4: replace.inline 31.11% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 6 94.39% : 0.000234s : 4: match.inline 5.61% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 10: predicate.addn_check_dump 1.62% : 0.000002s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.05% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.08% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.76% : 0.000007s : 22: predicate.inline 1.23% : 0.000002s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.83% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.37% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.50% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 2.48% : 0.000003s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.93% : 0.000010s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.25% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.45% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000830 13 44.00% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.71% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.29% : 0.000409s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032644 72 0.17% : 0.000056s : 1: add_recomputation 0.22% : 0.000073s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 0.98% : 0.000321s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.07% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 21.20% : 0.006922s : 1: jit_opt_a 0.50% : 0.000162s : 1: jit_opt_after_cconv 0.17% : 0.000057s : 1: jit_opt_b 1.43% : 0.000466s : 1: loop_unroll 2.39% : 0.000781s : 1: mutable_eliminate 5.98% : 0.001954s : 26: opt.transform.jit_opt_a 0.15% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000027s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.52% : 0.000495s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000126s : 1: py_interpret_to_execute 0.06% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.11% : 0.000689s : 1: renormalize.infer 1.42% : 0.000464s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000047s : 1: rewriter_after_opt_a 0.26% : 0.000086s : 1: rewriter_before_opt_a 0.23% : 0.000076s : 1: symbol_engine_optimizer 59.74% : 0.019501s : 1: type_inference TotalTime = 0.139773, [30] [bootstrap]: 0.0003265 [type_inference]: 0.126559 [event_method]: 2.597e-05 [auto_monad]: 7.8e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00050751 [rewriter_before_opt_a]: 0.00010042 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.00933136, [2] [Cycle 1]: 0.00472067, [27] [switch_simplify]: 9.091e-05 [loop_unroll]: 3.793e-05 [a_1]: 0.00078482 [with_stream_mark]: 2.402e-05 [recompute_prepare]: 1.068e-05 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 6.53e-06 [accelerated_algorithm]: 7.36999e-06 [meta_shard_fg_expand]: 2.28002e-06 [get_grad_eliminate_]: 7.95998e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 2.51e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.134e-05 [inline_without_move]: 6.93998e-06 [renormalize]: 0.00335378 [add_forward_monad_depend]: 9.87999e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.903e-05 [cse]: 3.759e-05 [replace_applicator]: 2.257e-05 [Cycle 2]: 0.00041758, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.61999e-06 [a_1]: 0.00014281 [with_stream_mark]: 1.473e-05 [recompute_prepare]: 6.43e-06 [updatestate_depend_eliminate]: 4.07998e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.87001e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 4.46002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 6.00002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.15999e-06 [auto_monad_eliminator]: 6.81999e-06 [cse]: 1.64e-05 [replace_applicator]: 7.16001e-06 [py_interpret_to_execute_after_opt_a]: 1.658e-05 [rewriter_after_opt_a]: 4.107e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00084092 [jit_opt_b]: 8.353e-05, [1] [Cycle 1]: 7.488e-05, [2] [frontend_op_eliminate]: 3.853e-05 [inline_after_opt_a]: 2.085e-05 [cconv]: 3.38e-05 [loop_unroll]: 0.00052188 [jit_opt_after_cconv]: 0.00017579, [1] [Cycle 1]: 0.00016891, [11] [c_1]: 2.778e-05 [parameter_eliminate]: 3.53e-06 [updatestate_depend_eliminate]: 7.45e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 3.153e-05 [call_graph_tuple_transform]: 2.299e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.83002e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 6.76999e-06 [remove_dup_value]: 1.872e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 9.31002e-06 [add_recomputation]: 5.336e-05 [cse_after_recomputation]: 2.718e-05, [1] [Cycle 1]: 2.186e-05, [1] [cse]: 1.381e-05 [auto_monad_reorder]: 1.808e-05 [get_jit_bprop_graph]: 4.85001e-06 [rewriter_after_jit_bprop_graph]: 6.91001e-06 [opt_after_jit_grad]: 0.00051685 [symbol_engine_optimizer]: 0.00017977, [1] [Cycle 1]: 0.0001724, [6] [build]: 4.55001e-06 [elim_shapecalc]: 1.205e-05 [elim_not_effective]: 1.525e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 0.00010217 [renormalize]: 5.60016e-07 [validate]: 5.716e-05 Sums bootstrap : 0.000327s : 0.24% type_inference : 0.126559s : 93.83% event_method : 0.000026s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000508s : 0.38% rewriter_before_opt_a : 0.000100s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000098s : 0.07% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.000928s : 0.69% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003354s : 2.49% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000841s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000039s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000522s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000517s : 0.38% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000102s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000328 28 0.99% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 1.94% : 0.000006s : 4: substitution.graph_param_transform 84.25% : 0.000276s : 5: substitution.inline 1.13% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000014s : 3: substitution.reduce_eliminate 1.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000006s : 2: substitution.replace_old_param 3.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126442 2 97.31% : 0.123037s : 1: type_inference.infer 2.69% : 0.003406s : 1: type_inference.specialize ------[replace.] 0.000107 7 69.58% : 0.000074s : 5: replace.inline 30.42% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 7 96.63% : 0.000273s : 5: match.inline 3.37% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.16% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.07% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.69% : 0.000009s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.77% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.65% : 0.000003s : 19: predicate.load_eliminater 1.73% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.36% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 2.36% : 0.000004s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 2.37% : 0.000004s : 13: predicate.reduce_eliminate 1.65% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.70% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.34% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.12% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.83% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002705 25 61.90% : 0.001674s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.51% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.59% : 0.000936s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144521 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000347s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.46% : 0.009335s : 1: jit_opt_a 0.12% : 0.000178s : 1: jit_opt_after_cconv 0.06% : 0.000087s : 1: jit_opt_b 0.37% : 0.000531s : 1: loop_unroll 0.59% : 0.000852s : 1: mutable_eliminate 0.85% : 0.001224s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000052s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000133s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000525s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000515s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.66% : 0.002401s : 1: renormalize.infer 0.65% : 0.000939s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000106s : 1: rewriter_before_opt_a 0.13% : 0.000183s : 1: symbol_engine_optimizer 87.59% : 0.126584s : 1: type_inference TotalTime = 0.0212476, [30] [bootstrap]: 0.00028441 [type_inference]: 0.0128608 [event_method]: 2.122e-05 [auto_monad]: 7.472e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 4.466e-05 [rewriter_before_opt_a]: 7.648e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00567755, [2] [Cycle 1]: 0.00175176, [27] [switch_simplify]: 5.552e-05 [loop_unroll]: 2.989e-05 [a_1]: 0.00054653 [with_stream_mark]: 2.021e-05 [recompute_prepare]: 8.45999e-06 [updatestate_depend_eliminate]: 4.13999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.617e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00075089 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.421e-05 [cse]: 2.593e-05 [replace_applicator]: 1.463e-05 [Cycle 2]: 0.00033135, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 4.74e-06 [a_1]: 9.142e-05 [with_stream_mark]: 9.70002e-06 [recompute_prepare]: 5.16998e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 4.96002e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.57e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 8.06001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.50001e-06 [cse]: 1.151e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.177e-05 [rewriter_after_opt_a]: 3.465e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00055426 [jit_opt_b]: 5.549e-05, [1] [Cycle 1]: 4.847e-05, [2] [frontend_op_eliminate]: 1.737e-05 [inline_after_opt_a]: 1.763e-05 [cconv]: 2.684e-05 [loop_unroll]: 0.0004368 [jit_opt_after_cconv]: 0.00014461, [1] [Cycle 1]: 0.00013846, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 5.92999e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.114e-05 [call_graph_tuple_transform]: 1.85e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.22999e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.07999e-06 [remove_dup_value]: 1.419e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 4.776e-05 [cse_after_recomputation]: 3.3e-05, [1] [Cycle 1]: 1.732e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.449e-05 [get_jit_bprop_graph]: 2.38002e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00050832 [symbol_engine_optimizer]: 7.498e-05, [1] [Cycle 1]: 6.908e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.67998e-06 [renormalize]: 4.7998e-07 [validate]: 3.5e-05 Sums bootstrap : 0.000284s : 1.67% type_inference : 0.012861s : 75.53% event_method : 0.000021s : 0.12% auto_monad : 0.000075s : 0.44% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000045s : 0.26% rewriter_before_opt_a : 0.000076s : 0.45% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000061s : 0.36% jit_opt_a.loop_unroll : 0.000035s : 0.20% jit_opt_a.a_1 : 0.000638s : 3.75% jit_opt_a.with_stream_mark : 0.000030s : 0.18% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000010s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000006s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.000751s : 4.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.12% jit_opt_a.cse : 0.000037s : 0.22% jit_opt_a.replace_applicator : 0.000020s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.07% rewriter_after_opt_a : 0.000035s : 0.20% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000554s : 3.25% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000027s : 0.16% loop_unroll : 0.000437s : 2.57% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000014s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.03% add_recomputation : 0.000048s : 0.28% cse_after_recomputation.cse : 0.000011s : 0.07% auto_monad_reorder : 0.000014s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000508s : 2.99% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.21% Time group info: ------[substitution.] 0.000214 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000005s : 3: substitution.graph_param_transform 83.34% : 0.000179s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000006s : 4: substitution.remove_not_recompute_node 2.46% : 0.000005s : 2: substitution.replace_old_param 6.00% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012785 2 91.28% : 0.011670s : 1: type_inference.infer 8.72% : 0.001115s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.01% : 0.000044s : 4: replace.inline 33.99% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 93.95% : 0.000176s : 4: match.inline 6.05% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.28% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 6.05% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 2.18% : 0.000003s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.26% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000778 13 43.27% : 0.000337s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.63% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.10% : 0.000398s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022916 72 0.22% : 0.000051s : 1: add_recomputation 0.34% : 0.000078s : 1: auto_monad 0.07% : 0.000017s : 1: auto_monad_reorder 1.34% : 0.000307s : 1: bootstrap 0.13% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000035s : 1: cse_after_recomputation 0.03% : 0.000007s : 1: environ_conv 0.11% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 24.79% : 0.005681s : 1: jit_opt_a 0.64% : 0.000147s : 1: jit_opt_after_cconv 0.26% : 0.000059s : 1: jit_opt_b 1.94% : 0.000446s : 1: loop_unroll 2.46% : 0.000564s : 1: mutable_eliminate 3.73% : 0.000854s : 26: opt.transform.jit_opt_a 0.21% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.10% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.26% : 0.000517s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000047s : 1: py_interpret_to_execute 0.06% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000016s : 1: remove_dup_value 1.84% : 0.000421s : 1: renormalize.infer 1.41% : 0.000322s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000038s : 1: rewriter_after_opt_a 0.35% : 0.000080s : 1: rewriter_before_opt_a 0.34% : 0.000078s : 1: symbol_engine_optimizer 56.18% : 0.012874s : 1: type_inference TotalTime = 0.0131275, [30] [bootstrap]: 0.00028778 [type_inference]: 0.00490862 [event_method]: 1.879e-05 [auto_monad]: 7.388e-05 [graph_reusing]: 6.13998e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 4.287e-05 [rewriter_before_opt_a]: 7.581e-05 [expand_dump_flag]: 2.93e-06 [jit_opt_a]: 0.00556637, [2] [Cycle 1]: 0.00170983, [27] [switch_simplify]: 5.867e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00054419 [with_stream_mark]: 2.14e-05 [recompute_prepare]: 7.58999e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.452e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.79001e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 0.00072242 [add_forward_monad_depend]: 5.84e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.5e-05 [cse]: 2.986e-05 [replace_applicator]: 1.27e-05 [Cycle 2]: 0.00033545, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 4.92999e-06 [a_1]: 0.00010309 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 5.24998e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.09e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.315e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.91001e-06 [cse]: 1.097e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 1.202e-05 [rewriter_after_opt_a]: 3.554e-05 [convert_after_rewriter]: 7.95e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00056602 [jit_opt_b]: 5.103e-05, [1] [Cycle 1]: 4.405e-05, [2] [frontend_op_eliminate]: 1.667e-05 [inline_after_opt_a]: 1.534e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00042282 [jit_opt_after_cconv]: 0.00015112, [1] [Cycle 1]: 0.00014446, [11] [c_1]: 2.052e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.44998e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 1.964e-05 [call_graph_tuple_transform]: 1.804e-05 [tuple_list_get_item_eliminator]: 5.23002e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.591e-05 [partial_unused_args_eliminate]: 2.16003e-06 [environ_conv]: 5.31998e-06 [add_recomputation]: 5.183e-05 [cse_after_recomputation]: 2.192e-05, [1] [Cycle 1]: 1.652e-05, [1] [cse]: 1.071e-05 [auto_monad_reorder]: 1.628e-05 [get_jit_bprop_graph]: 2.43998e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.00046108 [symbol_engine_optimizer]: 7.225e-05, [1] [Cycle 1]: 6.64e-05, [6] [build]: 3.85998e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.283e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 3.89991e-07 [validate]: 3.901e-05 Sums bootstrap : 0.000288s : 3.19% type_inference : 0.004909s : 54.43% event_method : 0.000019s : 0.21% auto_monad : 0.000074s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000043s : 0.48% rewriter_before_opt_a : 0.000076s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.72% jit_opt_a.loop_unroll : 0.000036s : 0.39% jit_opt_a.a_1 : 0.000647s : 7.18% jit_opt_a.with_stream_mark : 0.000032s : 0.35% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000722s : 8.01% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000041s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000036s : 0.39% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000566s : 6.28% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.29% loop_unroll : 0.000423s : 4.69% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000052s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000461s : 5.11% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.43% Time group info: ------[substitution.] 0.000217 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000005s : 3: substitution.graph_param_transform 83.38% : 0.000181s : 4: substitution.inline 1.67% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000006s : 4: substitution.remove_not_recompute_node 2.45% : 0.000005s : 2: substitution.replace_old_param 5.97% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004840 2 79.47% : 0.003847s : 1: type_inference.infer 20.53% : 0.000994s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.17% : 0.000047s : 4: replace.inline 32.83% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 93.79% : 0.000178s : 4: match.inline 6.21% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.05% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.45% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.99% : 0.000009s : 53: predicate.switch_simplify 1.54% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000683 13 49.58% : 0.000339s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.24% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.18% : 0.000302s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014765 72 0.37% : 0.000055s : 1: add_recomputation 0.52% : 0.000077s : 1: auto_monad 0.13% : 0.000019s : 1: auto_monad_reorder 2.06% : 0.000305s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.73% : 0.005570s : 1: jit_opt_a 1.04% : 0.000154s : 1: jit_opt_after_cconv 0.37% : 0.000054s : 1: jit_opt_b 2.92% : 0.000431s : 1: loop_unroll 3.89% : 0.000574s : 1: mutable_eliminate 5.85% : 0.000864s : 26: opt.transform.jit_opt_a 0.31% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.18% : 0.000469s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000046s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.55% : 0.000377s : 1: renormalize.infer 2.29% : 0.000338s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000038s : 1: rewriter_after_opt_a 0.53% : 0.000079s : 1: rewriter_before_opt_a 0.51% : 0.000075s : 1: symbol_engine_optimizer 33.36% : 0.004925s : 1: type_inference TotalTime = 0.126441, [30] [bootstrap]: 0.00033953 [type_inference]: 0.114453 [event_method]: 2.185e-05 [auto_monad]: 7.484e-05 [graph_reusing]: 6.01998e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00048621 [rewriter_before_opt_a]: 0.00010228 [expand_dump_flag]: 3.67998e-06 [jit_opt_a]: 0.00834413, [2] [Cycle 1]: 0.00442325, [27] [switch_simplify]: 6.965e-05 [loop_unroll]: 3.429e-05 [a_1]: 0.00084241 [with_stream_mark]: 2.409e-05 [recompute_prepare]: 1.005e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 7.18998e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 6.65002e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 1.156e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 1.075e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 0.00305759 [add_forward_monad_depend]: 8.20999e-06 [auto_monad_grad]: 2.69999e-06 [auto_monad_eliminator]: 2.041e-05 [cse]: 3.989e-05 [replace_applicator]: 2.116e-05 [Cycle 2]: 0.00040625, [27] [switch_simplify]: 6.70998e-06 [loop_unroll]: 6.43e-06 [a_1]: 0.00012522 [with_stream_mark]: 1.398e-05 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 2.031e-05 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 2.06998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.639e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 5.89e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 7.49002e-06 [cse]: 1.729e-05 [replace_applicator]: 5.94999e-06 [py_interpret_to_execute_after_opt_a]: 1.606e-05 [rewriter_after_opt_a]: 4.282e-05 [convert_after_rewriter]: 7.53999e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00069697 [jit_opt_b]: 7.68e-05, [1] [Cycle 1]: 6.918e-05, [2] [frontend_op_eliminate]: 3.685e-05 [inline_after_opt_a]: 1.894e-05 [cconv]: 3.226e-05 [loop_unroll]: 0.00048095 [jit_opt_after_cconv]: 0.00017985, [1] [Cycle 1]: 0.00017245, [11] [c_1]: 2.781e-05 [parameter_eliminate]: 3.66001e-06 [updatestate_depend_eliminate]: 7.98999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 3.3e-05 [call_graph_tuple_transform]: 2.431e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 9.79984e-07 [switch_simplify]: 6.27001e-06 [remove_dup_value]: 1.857e-05 [partial_unused_args_eliminate]: 2.73998e-06 [environ_conv]: 9.53997e-06 [add_recomputation]: 5.211e-05 [cse_after_recomputation]: 2.759e-05, [1] [Cycle 1]: 2.212e-05, [1] [cse]: 1.402e-05 [auto_monad_reorder]: 1.815e-05 [get_jit_bprop_graph]: 4.58001e-06 [rewriter_after_jit_bprop_graph]: 6.38e-06 [opt_after_jit_grad]: 0.00049026 [symbol_engine_optimizer]: 0.00018725, [1] [Cycle 1]: 0.00017999, [6] [build]: 4e-06 [elim_shapecalc]: 1.074e-05 [elim_not_effective]: 1.533e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 0.00011327 [renormalize]: 8.49977e-07 [validate]: 5.761e-05 Sums bootstrap : 0.000340s : 0.28% type_inference : 0.114453s : 93.59% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000486s : 0.40% rewriter_before_opt_a : 0.000102s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000968s : 0.79% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000027s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003058s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000057s : 0.05% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000697s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000037s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000481s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000490s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000113s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.05% Time group info: ------[substitution.] 0.000358 25 1.03% : 0.000004s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.91% : 0.000007s : 4: substitution.graph_param_transform 88.95% : 0.000318s : 5: substitution.inline 1.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.52% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000006s : 2: substitution.replace_old_param 3.52% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114371 2 97.08% : 0.111037s : 1: type_inference.infer 2.92% : 0.003334s : 1: type_inference.specialize ------[replace.] 0.000111 7 69.01% : 0.000077s : 5: replace.inline 30.99% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000327 7 96.57% : 0.000315s : 5: match.inline 3.43% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.40% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 6.13% : 0.000009s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.22% : 0.000002s : 13: predicate.minmaximum_grad 1.96% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.67% : 0.000002s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.56% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.56% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002623 25 62.68% : 0.001644s : 16: func_graph_cloner_run.FuncGraphClonerGraph 5.42% : 0.000142s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.90% : 0.000837s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130931 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000358s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.38% : 0.008348s : 1: jit_opt_a 0.14% : 0.000183s : 1: jit_opt_after_cconv 0.06% : 0.000080s : 1: jit_opt_b 0.37% : 0.000490s : 1: loop_unroll 0.54% : 0.000708s : 1: mutable_eliminate 0.95% : 0.001249s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000050s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000143s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000493s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.68% : 0.002199s : 1: renormalize.infer 0.65% : 0.000847s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000108s : 1: rewriter_before_opt_a 0.15% : 0.000190s : 1: symbol_engine_optimizer 87.43% : 0.114468s : 1: type_inference TotalTime = 0.157982, [30] [bootstrap]: 0.00028917 [type_inference]: 0.136048 [event_method]: 3.305e-05 [auto_monad]: 9.811e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 3.09001e-06 [py_interpret_to_execute]: 0.00118912 [rewriter_before_opt_a]: 0.00011837 [expand_dump_flag]: 4.65001e-06 [jit_opt_a]: 0.0174757, [2] [Cycle 1]: 0.00710318, [27] [switch_simplify]: 7.231e-05 [loop_unroll]: 3.523e-05 [a_1]: 0.00270473 [with_stream_mark]: 7.432e-05 [recompute_prepare]: 1.361e-05 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 3.01001e-06 [specialize_transform]: 8.25999e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 7.3e-06 [meta_shard_fg_expand]: 4.77998e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 5.09e-06 [cell_reuse_recompute_pass]: 2.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.804e-05 [j_node_and_user_rematch]: 1.166e-05 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 1.198e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.0037624 [add_forward_monad_depend]: 1.138e-05 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 2.24e-05 [cse]: 3.943e-05 [replace_applicator]: 2.387e-05 [Cycle 2]: 0.000421, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00014912 [with_stream_mark]: 1.509e-05 [recompute_prepare]: 6.73e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 7.03e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.47001e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 2.60002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 5.97999e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.56e-06 [cse]: 1.491e-05 [replace_applicator]: 6.78e-06 [py_interpret_to_execute_after_opt_a]: 1.725e-05 [rewriter_after_opt_a]: 4.668e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00076543 [jit_opt_b]: 0.00010845, [1] [Cycle 1]: 0.0001002, [2] [frontend_op_eliminate]: 1.992e-05 [inline_after_opt_a]: 1.976e-05 [cconv]: 2.945e-05 [loop_unroll]: 0.00046212 [jit_opt_after_cconv]: 0.00016704, [1] [Cycle 1]: 0.00015905, [11] [c_1]: 2.735e-05 [parameter_eliminate]: 3.25e-06 [updatestate_depend_eliminate]: 6.91999e-06 [updatestate_assign_eliminate]: 4.95999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.564e-05 [call_graph_tuple_transform]: 2.195e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.99e-05 [partial_unused_args_eliminate]: 2.30002e-06 [environ_conv]: 9.78998e-06 [add_recomputation]: 5.857e-05 [cse_after_recomputation]: 2.718e-05, [1] [Cycle 1]: 2.011e-05, [1] [cse]: 1.423e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 6.02001e-06 [opt_after_jit_grad]: 0.00048111 [symbol_engine_optimizer]: 8.389e-05, [1] [Cycle 1]: 7.786e-05, [6] [build]: 4.28999e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 1.582e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 1.143e-05 [renormalize]: 4.50003e-07 [validate]: 0.00017668 Sums bootstrap : 0.000289s : 0.20% type_inference : 0.136048s : 92.37% event_method : 0.000033s : 0.02% auto_monad : 0.000098s : 0.07% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001189s : 0.81% rewriter_before_opt_a : 0.000118s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000080s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.002854s : 1.94% jit_opt_a.with_stream_mark : 0.000089s : 0.06% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003763s : 2.55% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000047s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000765s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000462s : 0.31% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000059s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000481s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000177s : 0.12% Time group info: ------[substitution.] 0.000313 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 1.88% : 0.000006s : 4: substitution.graph_param_transform 81.44% : 0.000255s : 5: substitution.inline 1.46% : 0.000005s : 4: substitution.j_node_and_user_rematch 5.77% : 0.000018s : 3: substitution.reduce_eliminate 1.82% : 0.000006s : 4: substitution.remove_not_recompute_node 2.46% : 0.000008s : 2: substitution.replace_old_param 4.18% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132846 2 95.03% : 0.126248s : 1: type_inference.infer 4.97% : 0.006598s : 1: type_inference.specialize ------[replace.] 0.000142 7 52.46% : 0.000074s : 5: replace.inline 47.54% : 0.000067s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000263 7 95.51% : 0.000252s : 5: match.inline 4.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.002016 886 0.12% : 0.000002s : 13: predicate.accumulaten_eliminater 0.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 92.22% : 0.001859s : 13: predicate.addn_check_dump 0.12% : 0.000002s : 13: predicate.addn_zero_filter 0.17% : 0.000004s : 13: predicate.arithmetic_simplify 0.14% : 0.000003s : 13: predicate.cast_eliminate 0.03% : 0.000001s : 4: predicate.check_bprop_eliminate 0.09% : 0.000002s : 13: predicate.compare_switch_simplify 0.14% : 0.000003s : 13: predicate.depend_value_elim 0.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.09% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.10% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.03% : 0.000001s : 4: predicate.elim_not_effective 0.04% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.10% : 0.000002s : 13: predicate.environ_get_depend_swap 0.09% : 0.000002s : 13: predicate.environ_get_eliminate 0.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 4: predicate.fold_const_symbol 0.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.02% : 0.000000s : 4: predicate.graph_param_transform 0.49% : 0.000010s : 28: predicate.inline 0.06% : 0.000001s : 8: predicate.inline_without_move 0.03% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.09% : 0.000002s : 8: predicate.less_batch_normalization 0.11% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 0.13% : 0.000003s : 19: predicate.load_eliminater 0.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 0.28% : 0.000006s : 40: predicate.loop_unroll_before_grad 0.14% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.09% : 0.000002s : 13: predicate.merge_addn 0.08% : 0.000002s : 13: predicate.minmaximum_grad 0.10% : 0.000002s : 4: predicate.mutable_eliminate 0.03% : 0.000001s : 4: predicate.opt_reshape 0.19% : 0.000004s : 19: predicate.partial_eliminate 0.11% : 0.000002s : 13: predicate.print_const_string_wrapper 0.18% : 0.000004s : 13: predicate.reduce_eliminate 0.11% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.05% : 0.000001s : 8: predicate.remove_not_recompute_node 0.14% : 0.000003s : 23: predicate.replace_applicator 0.05% : 0.000001s : 8: predicate.replace_old_param 0.03% : 0.000001s : 4: predicate.reset_defer_inline 0.14% : 0.000003s : 13: predicate.reshape_eliminate 0.10% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.05% : 0.000001s : 4: predicate.row_tensor_eliminate 0.09% : 0.000002s : 13: predicate.same_eliminate 0.06% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.08% : 0.000002s : 8: predicate.special_op_eliminate 0.08% : 0.000002s : 8: predicate.specialize_transform 0.14% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 0.10% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.03% : 0.000001s : 4: predicate.switch_call_monad_eliminater 0.23% : 0.000005s : 20: predicate.switch_defer_inline 0.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 0.54% : 0.000011s : 64: predicate.switch_simplify 0.10% : 0.000002s : 13: predicate.tile_eliminate 0.10% : 0.000002s : 13: predicate.transpose_eliminate 0.12% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.10% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 0.31% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 0.13% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 0.12% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.13% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 0.23% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 0.15% : 0.000003s : 13: predicate.value_based_eliminate 0.03% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.05% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002697 25 63.79% : 0.001720s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.16% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.05% : 0.000891s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.164808 72 0.04% : 0.000062s : 1: add_recomputation 0.06% : 0.000101s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.19% : 0.000307s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000039s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.61% : 0.017480s : 1: jit_opt_a 0.10% : 0.000170s : 1: jit_opt_after_cconv 0.07% : 0.000111s : 1: jit_opt_b 0.29% : 0.000471s : 1: loop_unroll 0.47% : 0.000775s : 1: mutable_eliminate 1.90% : 0.003136s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000489s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.73% : 0.001205s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.31% : 0.002159s : 1: renormalize.infer 0.96% : 0.001589s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.08% : 0.000124s : 1: rewriter_before_opt_a 0.05% : 0.000087s : 1: symbol_engine_optimizer 82.56% : 0.136073s : 1: type_inference TotalTime = 0.0277845, [30] [bootstrap]: 0.00030196 [type_inference]: 0.0192778 [event_method]: 1.797e-05 [auto_monad]: 5.028e-05 [graph_reusing]: 4.21001e-06 [pre_auto_parallel]: 1.53002e-06 [py_interpret_to_execute]: 0.00011369 [rewriter_before_opt_a]: 8.335e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00578693, [2] [Cycle 1]: 0.00200529, [27] [switch_simplify]: 5.424e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00055043 [with_stream_mark]: 2.263e-05 [recompute_prepare]: 7.85998e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.46002e-06 [renormalize]: 0.00100014 [add_forward_monad_depend]: 5.71e-06 [auto_monad_grad]: 2.23998e-06 [auto_monad_eliminator]: 1.69e-05 [cse]: 3.821e-05 [replace_applicator]: 1.481e-05 [Cycle 2]: 0.0003435, [27] [switch_simplify]: 6.34001e-06 [loop_unroll]: 5.46e-06 [a_1]: 9.805e-05 [with_stream_mark]: 1.054e-05 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.97999e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 8.21002e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.71999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.363e-05 [replace_applicator]: 5.55001e-06 [py_interpret_to_execute_after_opt_a]: 1.087e-05 [rewriter_after_opt_a]: 4.009e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00053394 [jit_opt_b]: 5.354e-05, [1] [Cycle 1]: 4.599e-05, [2] [frontend_op_eliminate]: 1.698e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 2.679e-05 [loop_unroll]: 0.00043047 [jit_opt_after_cconv]: 0.00015111, [1] [Cycle 1]: 0.00014428, [11] [c_1]: 2.218e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 5.99e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.374e-05 [call_graph_tuple_transform]: 1.898e-05 [tuple_list_get_item_eliminator]: 5.91e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.706e-05 [partial_unused_args_eliminate]: 2.70002e-06 [environ_conv]: 5.84999e-06 [add_recomputation]: 5.46e-05 [cse_after_recomputation]: 2.383e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.234e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 5.12e-06 [opt_after_jit_grad]: 0.00046198 [symbol_engine_optimizer]: 7.184e-05, [1] [Cycle 1]: 6.54e-05, [6] [build]: 3.86001e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 4.30009e-07 [validate]: 4.833e-05 Sums bootstrap : 0.000302s : 1.27% type_inference : 0.019278s : 81.15% event_method : 0.000018s : 0.08% auto_monad : 0.000050s : 0.21% graph_reusing : 0.000004s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000114s : 0.48% rewriter_before_opt_a : 0.000083s : 0.35% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.26% jit_opt_a.loop_unroll : 0.000035s : 0.15% jit_opt_a.a_1 : 0.000648s : 2.73% jit_opt_a.with_stream_mark : 0.000033s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001000s : 4.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.10% jit_opt_a.cse : 0.000052s : 0.22% jit_opt_a.replace_applicator : 0.000020s : 0.09% py_interpret_to_execute_after_opt_a : 0.000011s : 0.05% rewriter_after_opt_a : 0.000040s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000534s : 2.25% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.07% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000027s : 0.11% loop_unroll : 0.000430s : 1.81% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000055s : 0.23% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000018s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000462s : 1.94% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.20% Time group info: ------[substitution.] 0.000226 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 3: substitution.graph_param_transform 85.11% : 0.000193s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 5.24% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019213 2 92.39% : 0.017752s : 1: type_inference.infer 7.61% : 0.001462s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.59% : 0.000048s : 4: replace.inline 31.41% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.60% : 0.000190s : 4: match.inline 5.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.05% : 0.000007s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.37% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.18% : 0.000010s : 53: predicate.switch_simplify 1.10% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.58% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000809 13 43.91% : 0.000355s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.00% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.09% : 0.000405s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029697 72 0.19% : 0.000058s : 1: add_recomputation 0.18% : 0.000054s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 1.07% : 0.000319s : 1: bootstrap 0.10% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.07% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000006s : 1: graph_reusing 19.50% : 0.005790s : 1: jit_opt_a 0.52% : 0.000154s : 1: jit_opt_after_cconv 0.19% : 0.000056s : 1: jit_opt_b 1.48% : 0.000438s : 1: loop_unroll 1.83% : 0.000543s : 1: mutable_eliminate 2.92% : 0.000867s : 26: opt.transform.jit_opt_a 0.17% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000471s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.40% : 0.000118s : 1: py_interpret_to_execute 0.05% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 1.97% : 0.000586s : 1: renormalize.infer 1.36% : 0.000405s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000043s : 1: rewriter_after_opt_a 0.29% : 0.000087s : 1: rewriter_before_opt_a 0.25% : 0.000074s : 1: symbol_engine_optimizer 64.96% : 0.019292s : 1: type_inference TotalTime = 0.149425, [30] [bootstrap]: 0.00031118 [type_inference]: 0.132023 [event_method]: 2.119e-05 [auto_monad]: 7.152e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.0038985 [rewriter_before_opt_a]: 9.899e-05 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.0102834, [2] [Cycle 1]: 0.00644682, [27] [switch_simplify]: 5.314e-05 [loop_unroll]: 3.454e-05 [a_1]: 0.00059731 [with_stream_mark]: 1.568e-05 [recompute_prepare]: 9.83998e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 8.10999e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 7.61001e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 7.30998e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.367e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.04998e-06 [inline_without_move]: 6.49999e-06 [renormalize]: 0.00536241 [add_forward_monad_depend]: 9.46e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.99e-05 [cse]: 3.535e-05 [replace_applicator]: 2.514e-05 [Cycle 2]: 0.0004069, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 7.09001e-06 [a_1]: 0.00013467 [with_stream_mark]: 1.584e-05 [recompute_prepare]: 7.06001e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.33998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.955e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 5.69e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.57999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.227e-05 [replace_applicator]: 6.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.547e-05 [rewriter_after_opt_a]: 6.149e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 2.926e-05 [mutable_eliminate]: 0.00076423 [jit_opt_b]: 6.115e-05, [1] [Cycle 1]: 5.399e-05, [2] [frontend_op_eliminate]: 2.126e-05 [inline_after_opt_a]: 2.072e-05 [cconv]: 2.894e-05 [loop_unroll]: 0.00047269 [jit_opt_after_cconv]: 0.00016482, [1] [Cycle 1]: 0.00015809, [11] [c_1]: 2.741e-05 [parameter_eliminate]: 2.87002e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.418e-05 [call_graph_tuple_transform]: 2.369e-05 [tuple_list_get_item_eliminator]: 6.80002e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 7.48999e-06 [remove_dup_value]: 1.569e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 9.52999e-06 [add_recomputation]: 4.893e-05 [cse_after_recomputation]: 2.319e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.126e-05 [auto_monad_reorder]: 1.501e-05 [get_jit_bprop_graph]: 2.55002e-06 [rewriter_after_jit_bprop_graph]: 8.94998e-06 [opt_after_jit_grad]: 0.00053192 [symbol_engine_optimizer]: 0.00016905, [1] [Cycle 1]: 0.00016255, [6] [build]: 3.97002e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.528e-05 [opt_reshape]: 8.94e-06 [fold_const_symbol]: 9.351e-05 [renormalize]: 4.50003e-07 [validate]: 4.898e-05 Sums bootstrap : 0.000311s : 0.21% type_inference : 0.132023s : 90.84% event_method : 0.000021s : 0.01% auto_monad : 0.000072s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.003898s : 2.68% rewriter_before_opt_a : 0.000099s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000732s : 0.50% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.005362s : 3.69% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000048s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000061s : 0.04% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000029s : 0.02% mutable_eliminate : 0.000764s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000473s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000532s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000094s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.03% TotalTime = 0.143736, [30] [bootstrap]: 0.00033835 [type_inference]: 0.129069 [event_method]: 2.908e-05 [auto_monad]: 8.907e-05 [graph_reusing]: 7.6e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00086181 [rewriter_before_opt_a]: 0.00013005 [expand_dump_flag]: 4.44998e-06 [jit_opt_a]: 0.0101823, [2] [Cycle 1]: 0.00502598, [27] [switch_simplify]: 8.092e-05 [loop_unroll]: 3.592e-05 [a_1]: 0.0008684 [with_stream_mark]: 2.854e-05 [recompute_prepare]: 1.028e-05 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 3.00998e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 6.41998e-06 [accelerated_algorithm]: 7.58001e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 7.33e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.808e-05 [j_node_and_user_rematch]: 1.218e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.312e-05 [inline_without_move]: 7.17002e-06 [renormalize]: 0.00356662 [add_forward_monad_depend]: 1.001e-05 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.991e-05 [cse]: 3.911e-05 [replace_applicator]: 2.221e-05 [Cycle 2]: 0.00042625, [27] [switch_simplify]: 7.68999e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00014695 [with_stream_mark]: 1.506e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.73998e-06 [parameter_eliminate]: 1.26997e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 3.56999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.173e-05 [inline_without_move]: 6.46e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 1.09998e-06 [auto_monad_eliminator]: 8.32e-06 [cse]: 1.687e-05 [replace_applicator]: 7.77002e-06 [py_interpret_to_execute_after_opt_a]: 1.675e-05 [rewriter_after_opt_a]: 4.251e-05 [convert_after_rewriter]: 7.77002e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00104941 [jit_opt_b]: 6.219e-05, [1] [Cycle 1]: 5.191e-05, [2] [frontend_op_eliminate]: 2.046e-05 [inline_after_opt_a]: 1.941e-05 [cconv]: 3.299e-05 [loop_unroll]: 0.00047613 [jit_opt_after_cconv]: 0.00017372, [1] [Cycle 1]: 0.0001659, [11] [c_1]: 2.694e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 7.2e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 3.241e-05 [call_graph_tuple_transform]: 2.458e-05 [tuple_list_get_item_eliminator]: 6.71999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.675e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 1.065e-05 [add_recomputation]: 5.673e-05 [cse_after_recomputation]: 2.606e-05, [1] [Cycle 1]: 2.014e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 1.982e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 7.04001e-06 [opt_after_jit_grad]: 0.00053992 [symbol_engine_optimizer]: 0.00017072, [1] [Cycle 1]: 7.659e-05, [6] [build]: 5.87999e-06 [elim_shapecalc]: 9.29e-06 [elim_not_effective]: 1.445e-05 [opt_reshape]: 7.46999e-06 [fold_const_symbol]: 9.72999e-06 [renormalize]: 4.60015e-07 [validate]: 6.139e-05 Sums bootstrap : 0.000338s : 0.24% type_inference : 0.129069s : 93.40% event_method : 0.000029s : 0.02% auto_monad : 0.000089s : 0.06% graph_reusing : 0.000008s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000862s : 0.62% rewriter_before_opt_a : 0.000130s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000089s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001015s : 0.73% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003567s : 2.58% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001049s : 0.76% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000033s : 0.02% loop_unroll : 0.000476s : 0.34% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000057s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000540s : 0.39% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.04% Time group info: ------[substitution.] 0.000279 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 29.94% : 0.000083s : 2: substitution.fold_const_symbol 2.37% : 0.000007s : 4: substitution.graph_param_transform 58.00% : 0.000162s : 4: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000006s : 4: substitution.remove_not_recompute_node 1.88% : 0.000005s : 2: substitution.replace_old_param 3.47% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131936 2 97.78% : 0.129007s : 1: type_inference.infer 2.22% : 0.002929s : 1: type_inference.specialize ------[replace.] 0.000077 6 66.34% : 0.000051s : 4: replace.inline 33.66% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 94.99% : 0.000159s : 4: match.inline 5.01% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.47% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.54% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 18: predicate.load_eliminater 1.69% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 12: predicate.merge_addn 1.22% : 0.000002s : 12: predicate.minmaximum_grad 1.99% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.98% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000010s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.49% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002317 22 65.35% : 0.001515s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.17% : 0.000769s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155933 72 0.03% : 0.000052s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.21% : 0.000331s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.60% : 0.010287s : 1: jit_opt_a 0.11% : 0.000168s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.31% : 0.000482s : 1: loop_unroll 0.50% : 0.000774s : 1: mutable_eliminate 0.64% : 0.000990s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000123s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000541s : 1: opt_after_jit_grad 0.02% : 0.000032s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 2.51% : 0.003920s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 2.88% : 0.004483s : 1: renormalize.infer 0.56% : 0.000867s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000065s : 1: rewriter_after_opt_a 0.07% : 0.000105s : 1: rewriter_before_opt_a 0.11% : 0.000172s : 1: symbol_engine_optimizer 84.68% : 0.132044s : 1: type_inference Time group info: ------[substitution.] 0.000372 28 0.46% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000002s : 2: substitution.fold_const_symbol 1.73% : 0.000006s : 4: substitution.graph_param_transform 84.40% : 0.000314s : 5: substitution.inline 1.32% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.53% : 0.000017s : 3: substitution.reduce_eliminate 1.56% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000008s : 2: substitution.replace_old_param 3.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128930 2 96.88% : 0.124908s : 1: type_inference.infer 3.12% : 0.004022s : 1: type_inference.specialize ------[replace.] 0.000121 7 68.24% : 0.000082s : 5: replace.inline 31.76% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000322 7 96.44% : 0.000310s : 5: match.inline 3.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000165 886 1.50% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 2.08% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.41% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_depend_swap 1.11% : 0.000002s : 13: predicate.environ_get_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 6.30% : 0.000010s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.75% : 0.000003s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.18% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 2.03% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000004s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 2.65% : 0.000004s : 13: predicate.reduce_eliminate 1.63% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.61% : 0.000003s : 23: predicate.replace_applicator 0.93% : 0.000002s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.59% : 0.000003s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 20: predicate.switch_defer_inline 2.21% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.72% : 0.000011s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.81% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002990 25 63.94% : 0.001912s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.31% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.75% : 0.000979s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148662 72 0.04% : 0.000060s : 1: add_recomputation 0.06% : 0.000093s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.24% : 0.000359s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000035s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000011s : 1: graph_reusing 6.85% : 0.010187s : 1: jit_opt_a 0.12% : 0.000177s : 1: jit_opt_after_cconv 0.04% : 0.000065s : 1: jit_opt_b 0.33% : 0.000486s : 1: loop_unroll 0.72% : 0.001063s : 1: mutable_eliminate 0.88% : 0.001306s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.59% : 0.000875s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.73% : 0.002565s : 1: renormalize.infer 0.67% : 0.000989s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.09% : 0.000139s : 1: rewriter_before_opt_a 0.12% : 0.000174s : 1: symbol_engine_optimizer 86.84% : 0.129102s : 1: type_inference TotalTime = 0.166313, [30] [bootstrap]: 0.00030057 [type_inference]: 0.15117 [event_method]: 0.00012592 [auto_monad]: 7.732e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 0.00057831 [rewriter_before_opt_a]: 0.0001034 [expand_dump_flag]: 4.40999e-06 [jit_opt_a]: 0.0110291, [2] [Cycle 1]: 0.00690114, [27] [switch_simplify]: 0.0001176 [loop_unroll]: 3.572e-05 [a_1]: 0.00077349 [with_stream_mark]: 2.59e-05 [recompute_prepare]: 1.149e-05 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 2.28002e-06 [specialize_transform]: 9.04e-06 [updatestate_useless_node_eliminater]: 6.88998e-06 [accelerated_algorithm]: 7.42002e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.84999e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.881e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.177e-05 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00550428 [add_forward_monad_depend]: 1.116e-05 [auto_monad_grad]: 3.00998e-06 [auto_monad_eliminator]: 2.389e-05 [cse]: 4.113e-05 [replace_applicator]: 2.722e-05 [Cycle 2]: 0.00045163, [27] [switch_simplify]: 8.55999e-06 [loop_unroll]: 8.28001e-06 [a_1]: 0.00014096 [with_stream_mark]: 1.837e-05 [recompute_prepare]: 7.31001e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.10002e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 6.59001e-06 [accelerated_algorithm]: 6.55002e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 4.53001e-06 [cell_reuse_recompute_pass]: 3.86001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.075e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 6.34001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.81003e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 8.73001e-06 [cse]: 2.164e-05 [replace_applicator]: 7e-06 [py_interpret_to_execute_after_opt_a]: 1.955e-05 [rewriter_after_opt_a]: 4.815e-05 [convert_after_rewriter]: 8.05e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00087531 [jit_opt_b]: 7.397e-05, [1] [Cycle 1]: 6.516e-05, [2] [frontend_op_eliminate]: 1.984e-05 [inline_after_opt_a]: 2.117e-05 [cconv]: 3.528e-05 [loop_unroll]: 0.00048964 [jit_opt_after_cconv]: 0.00019067, [1] [Cycle 1]: 0.0001815, [11] [c_1]: 2.811e-05 [parameter_eliminate]: 4.73001e-06 [updatestate_depend_eliminate]: 1.059e-05 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.75997e-06 [cse]: 3.743e-05 [call_graph_tuple_transform]: 2.797e-05 [tuple_list_get_item_eliminator]: 6.62002e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.45002e-06 [remove_dup_value]: 2.001e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 1.039e-05 [add_recomputation]: 5.289e-05 [cse_after_recomputation]: 2.563e-05, [1] [Cycle 1]: 1.982e-05, [1] [cse]: 1.376e-05 [auto_monad_reorder]: 2.191e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 6.44001e-06 [opt_after_jit_grad]: 0.00051639 [symbol_engine_optimizer]: 0.00023303, [1] [Cycle 1]: 7.938e-05, [6] [build]: 5.11002e-06 [elim_shapecalc]: 9.89001e-06 [elim_not_effective]: 1.747e-05 [opt_reshape]: 9.17999e-06 [fold_const_symbol]: 9.35001e-06 [renormalize]: 5.39992e-07 [validate]: 6.419e-05 Sums bootstrap : 0.000301s : 0.19% type_inference : 0.151170s : 93.44% event_method : 0.000126s : 0.08% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000578s : 0.36% rewriter_before_opt_a : 0.000103s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.08% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.000914s : 0.57% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005504s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000063s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000875s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000490s : 0.30% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000022s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000516s : 0.32% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000064s : 0.04% Time group info: ------[substitution.] 0.000314 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 4: substitution.graph_param_transform 86.97% : 0.000273s : 5: substitution.inline 1.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000006s : 4: substitution.remove_not_recompute_node 2.31% : 0.000007s : 2: substitution.replace_old_param 4.39% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151078 2 97.70% : 0.147609s : 1: type_inference.infer 2.30% : 0.003469s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.25% : 0.000077s : 5: replace.inline 31.75% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000283 7 95.54% : 0.000270s : 5: match.inline 4.46% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000194 886 0.97% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.80% : 0.000002s : 13: predicate.addn_check_dump 1.10% : 0.000002s : 13: predicate.addn_zero_filter 1.66% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000003s : 13: predicate.cast_eliminate 0.31% : 0.000001s : 4: predicate.check_bprop_eliminate 0.80% : 0.000002s : 13: predicate.compare_switch_simplify 1.00% : 0.000002s : 13: predicate.depend_value_elim 0.86% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.90% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.98% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.56% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.94% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.87% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.85% : 0.000002s : 13: predicate.environ_get_depend_swap 0.93% : 0.000002s : 13: predicate.environ_get_eliminate 0.89% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 0.81% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000001s : 4: predicate.graph_param_transform 4.27% : 0.000008s : 28: predicate.inline 0.79% : 0.000002s : 8: predicate.inline_without_move 0.32% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000002s : 8: predicate.less_batch_normalization 1.19% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.28% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.72% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.81% : 0.000002s : 13: predicate.merge_addn 0.84% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 1.85% : 0.000004s : 19: predicate.partial_eliminate 0.90% : 0.000002s : 13: predicate.print_const_string_wrapper 1.73% : 0.000003s : 13: predicate.reduce_eliminate 1.31% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.61% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.27% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 0.96% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.48% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.63% : 0.000001s : 8: predicate.special_op_eliminate 0.75% : 0.000001s : 8: predicate.specialize_transform 1.03% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.90% : 0.000004s : 20: predicate.switch_defer_inline 1.66% : 0.000003s : 20: predicate.switch_layer_defer_inline 26.71% : 0.000052s : 64: predicate.switch_simplify 0.91% : 0.000002s : 13: predicate.tile_eliminate 1.03% : 0.000002s : 13: predicate.transpose_eliminate 1.23% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.91% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.10% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.09% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.28% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.15% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.42% : 0.000003s : 13: predicate.value_based_eliminate 0.24% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002764 25 60.20% : 0.001664s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.28% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.52% : 0.001009s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173135 72 0.03% : 0.000056s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000024s : 1: auto_monad_reorder 0.18% : 0.000317s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.08% : 0.000135s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 6.37% : 0.011033s : 1: jit_opt_a 0.11% : 0.000193s : 1: jit_opt_after_cconv 0.04% : 0.000077s : 1: jit_opt_b 0.29% : 0.000499s : 1: loop_unroll 0.52% : 0.000892s : 1: mutable_eliminate 0.72% : 0.001253s : 26: opt.transform.jit_opt_a 0.04% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000526s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000586s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.55% : 0.004407s : 1: renormalize.infer 0.63% : 0.001083s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.06% : 0.000108s : 1: rewriter_before_opt_a 0.14% : 0.000236s : 1: symbol_engine_optimizer 87.32% : 0.151188s : 1: type_inference TotalTime = 0.0283336, [30] [bootstrap]: 0.00031415 [type_inference]: 0.0199032 [event_method]: 1.972e-05 [auto_monad]: 6.977e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.53998e-06 [py_interpret_to_execute]: 0.0001087 [rewriter_before_opt_a]: 7.984e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00559925, [2] [Cycle 1]: 0.00194678, [27] [switch_simplify]: 5.596e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00053717 [with_stream_mark]: 1.907e-05 [recompute_prepare]: 8.79003e-06 [updatestate_depend_eliminate]: 4.68001e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00095191 [add_forward_monad_depend]: 6.53e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.638e-05 [cse]: 3.608e-05 [replace_applicator]: 1.462e-05 [Cycle 2]: 0.00032348, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 5.21002e-06 [a_1]: 9.066e-05 [with_stream_mark]: 1.117e-05 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.62998e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.42e-05 [j_node_and_user_rematch]: 8.08999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.53999e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.56998e-06 [cse]: 1.252e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.315e-05 [rewriter_after_opt_a]: 3.904e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00058787 [jit_opt_b]: 5.059e-05, [1] [Cycle 1]: 4.347e-05, [2] [frontend_op_eliminate]: 1.562e-05 [inline_after_opt_a]: 1.654e-05 [cconv]: 2.77e-05 [loop_unroll]: 0.00047143 [jit_opt_after_cconv]: 0.00014539, [1] [Cycle 1]: 0.00013854, [11] [c_1]: 2.11e-05 [parameter_eliminate]: 3.21001e-06 [updatestate_depend_eliminate]: 6.54001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.457e-05 [call_graph_tuple_transform]: 1.842e-05 [tuple_list_get_item_eliminator]: 5.37999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 5.92001e-06 [add_recomputation]: 5.108e-05 [cse_after_recomputation]: 2.29e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.69999e-06 [opt_after_jit_grad]: 0.00046931 [symbol_engine_optimizer]: 7.175e-05, [1] [Cycle 1]: 6.521e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 7.36001e-06 [elim_not_effective]: 1.238e-05 [opt_reshape]: 6.19999e-06 [fold_const_symbol]: 8.15999e-06 [renormalize]: 3.7998e-07 [validate]: 3.911e-05 Sums bootstrap : 0.000314s : 1.29% type_inference : 0.019903s : 81.50% event_method : 0.000020s : 0.08% auto_monad : 0.000070s : 0.29% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000109s : 0.45% rewriter_before_opt_a : 0.000080s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000628s : 2.57% jit_opt_a.with_stream_mark : 0.000030s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000952s : 3.90% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000049s : 0.20% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000013s : 0.05% rewriter_after_opt_a : 0.000039s : 0.16% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000588s : 2.41% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000017s : 0.07% cconv : 0.000028s : 0.11% loop_unroll : 0.000471s : 1.93% jit_opt_after_cconv.c_1 : 0.000021s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000051s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000469s : 1.92% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.16% Time group info: ------[substitution.] 0.000210 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000005s : 3: substitution.graph_param_transform 84.13% : 0.000177s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000004s : 4: substitution.remove_not_recompute_node 2.31% : 0.000005s : 2: substitution.replace_old_param 6.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.019832 2 92.49% : 0.018342s : 1: type_inference.infer 7.51% : 0.001490s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.74% : 0.000046s : 4: replace.inline 32.26% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 93.65% : 0.000174s : 4: match.inline 6.35% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.39% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.48% : 0.000002s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.88% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000809 13 45.15% : 0.000365s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.77% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.08% : 0.000405s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030188 72 0.18% : 0.000054s : 1: add_recomputation 0.24% : 0.000073s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.10% : 0.000331s : 1: bootstrap 0.10% : 0.000030s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 18.56% : 0.005603s : 1: jit_opt_a 0.49% : 0.000148s : 1: jit_opt_after_cconv 0.18% : 0.000053s : 1: jit_opt_b 1.59% : 0.000480s : 1: loop_unroll 1.98% : 0.000597s : 1: mutable_eliminate 2.80% : 0.000845s : 26: opt.transform.jit_opt_a 0.16% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.10% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000031s : 4: opt.transform.symbol_engine_opt 1.58% : 0.000477s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000112s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.81% : 0.000545s : 1: renormalize.infer 1.32% : 0.000398s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000042s : 1: rewriter_after_opt_a 0.28% : 0.000083s : 1: rewriter_before_opt_a 0.25% : 0.000074s : 1: symbol_engine_optimizer 65.99% : 0.019921s : 1: type_inference TotalTime = 0.129168, [30] [bootstrap]: 0.00034849 [type_inference]: 0.117409 [event_method]: 2.512e-05 [auto_monad]: 7.578e-05 [graph_reusing]: 6.48e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00054062 [rewriter_before_opt_a]: 9.741e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.0080731, [2] [Cycle 1]: 0.0040857, [27] [switch_simplify]: 6.269e-05 [loop_unroll]: 7.618e-05 [a_1]: 0.00070505 [with_stream_mark]: 1.876e-05 [recompute_prepare]: 9.38997e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.55998e-06 [parameter_eliminate]: 2.66999e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 6.52001e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.75997e-06 [get_grad_eliminate_]: 6.66999e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.87002e-06 [replace_old_param]: 1.089e-05 [inline_without_move]: 6.46e-06 [renormalize]: 0.00281401 [add_forward_monad_depend]: 1.012e-05 [auto_monad_grad]: 2.51998e-06 [auto_monad_eliminator]: 2.188e-05 [cse]: 3.983e-05 [replace_applicator]: 2.251e-05 [Cycle 2]: 0.00048747, [27] [switch_simplify]: 6.333e-05 [loop_unroll]: 8.52e-06 [a_1]: 0.00015088 [with_stream_mark]: 1.515e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 6.45002e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 3.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.52999e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 8.50999e-06 [cse]: 1.624e-05 [replace_applicator]: 6.35002e-06 [py_interpret_to_execute_after_opt_a]: 1.527e-05 [rewriter_after_opt_a]: 4.073e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 6.34001e-06 [mutable_eliminate]: 0.00072871 [jit_opt_b]: 6.102e-05, [1] [Cycle 1]: 5.263e-05, [2] [frontend_op_eliminate]: 2.044e-05 [inline_after_opt_a]: 1.903e-05 [cconv]: 2.802e-05 [loop_unroll]: 0.00045298 [jit_opt_after_cconv]: 0.00016235, [1] [Cycle 1]: 0.00015516, [11] [c_1]: 2.688e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 2.631e-05 [call_graph_tuple_transform]: 2.339e-05 [tuple_list_get_item_eliminator]: 6.43998e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.08002e-06 [remove_dup_value]: 1.711e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 8.77e-06 [add_recomputation]: 5.546e-05 [cse_after_recomputation]: 2.637e-05, [1] [Cycle 1]: 2.045e-05, [1] [cse]: 1.375e-05 [auto_monad_reorder]: 2.087e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 6.78e-06 [opt_after_jit_grad]: 0.0005113 [symbol_engine_optimizer]: 8.375e-05, [1] [Cycle 1]: 7.635e-05, [6] [build]: 4.18999e-06 [elim_shapecalc]: 8.97e-06 [elim_not_effective]: 1.661e-05 [opt_reshape]: 8.97999e-06 [fold_const_symbol]: 9.18002e-06 [renormalize]: 4.39992e-07 [validate]: 0.00014727 Sums bootstrap : 0.000348s : 0.28% type_inference : 0.117409s : 93.91% event_method : 0.000025s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000541s : 0.43% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000126s : 0.10% jit_opt_a.loop_unroll : 0.000085s : 0.07% jit_opt_a.a_1 : 0.000856s : 0.68% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002814s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000729s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000453s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000021s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000511s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000147s : 0.12% Time group info: ------[substitution.] 0.000268 28 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000007s : 4: substitution.graph_param_transform 80.56% : 0.000216s : 5: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.78% : 0.000016s : 3: substitution.reduce_eliminate 2.10% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000006s : 2: substitution.replace_old_param 3.98% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117324 2 97.48% : 0.114371s : 1: type_inference.infer 2.52% : 0.002953s : 1: type_inference.specialize ------[replace.] 0.000106 7 69.50% : 0.000073s : 5: replace.inline 30.50% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 7 95.78% : 0.000213s : 5: match.inline 4.22% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.45% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.43% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.69% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.68% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 2.22% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.78% : 0.000003s : 23: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000004s : 20: predicate.switch_defer_inline 2.32% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.96% : 0.000010s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.89% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002636 25 64.13% : 0.001691s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.22% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.65% : 0.000887s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133110 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.28% : 0.000369s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.07% : 0.008077s : 1: jit_opt_a 0.12% : 0.000165s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.35% : 0.000461s : 1: loop_unroll 0.55% : 0.000739s : 1: mutable_eliminate 0.87% : 0.001158s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000521s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000549s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.45% : 0.001926s : 1: renormalize.infer 0.66% : 0.000876s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 88.22% : 0.117429s : 1: type_inference TotalTime = 0.142655, [30] [bootstrap]: 0.00036105 [type_inference]: 0.129743 [event_method]: 2.361e-05 [auto_monad]: 7.724e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 0.00060833 [rewriter_before_opt_a]: 0.00010033 [expand_dump_flag]: 3.35003e-06 [jit_opt_a]: 0.00902692, [2] [Cycle 1]: 0.00474848, [27] [switch_simplify]: 6.672e-05 [loop_unroll]: 3.522e-05 [a_1]: 0.00077483 [with_stream_mark]: 2.224e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.74002e-06 [updatestate_useless_node_eliminater]: 6.13998e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.71999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.672e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.111e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 0.00344198 [add_forward_monad_depend]: 8.00999e-06 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 1.975e-05 [cse]: 3.83e-05 [replace_applicator]: 2.058e-05 [Cycle 2]: 0.00039993, [27] [switch_simplify]: 7.7e-06 [loop_unroll]: 6.24999e-06 [a_1]: 0.00014168 [with_stream_mark]: 1.333e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 3.03e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.74999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.43e-06 [cse]: 1.361e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.553e-05 [rewriter_after_opt_a]: 3.971e-05 [convert_after_rewriter]: 7.28999e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00080794 [jit_opt_b]: 6.031e-05, [1] [Cycle 1]: 5.207e-05, [2] [frontend_op_eliminate]: 2.121e-05 [inline_after_opt_a]: 1.848e-05 [cconv]: 2.864e-05 [loop_unroll]: 0.0004533 [jit_opt_after_cconv]: 0.0001693, [1] [Cycle 1]: 0.00016247, [11] [c_1]: 2.661e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 7.68999e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 2.78e-05 [call_graph_tuple_transform]: 2.442e-05 [tuple_list_get_item_eliminator]: 6.65002e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.587e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.019e-05 [add_recomputation]: 5.1e-05 [cse_after_recomputation]: 2.616e-05, [1] [Cycle 1]: 2.096e-05, [1] [cse]: 1.343e-05 [auto_monad_reorder]: 1.715e-05 [get_jit_bprop_graph]: 3.06001e-06 [rewriter_after_jit_bprop_graph]: 5.40001e-06 [opt_after_jit_grad]: 0.00048715 [symbol_engine_optimizer]: 0.00024348, [1] [Cycle 1]: 0.00023665, [6] [build]: 3.69002e-06 [elim_shapecalc]: 0.00016623 [elim_not_effective]: 1.625e-05 [opt_reshape]: 6.61e-06 [fold_const_symbol]: 1.026e-05 [renormalize]: 3.4002e-07 [validate]: 4.993e-05 Sums bootstrap : 0.000361s : 0.26% type_inference : 0.129743s : 93.94% event_method : 0.000024s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000608s : 0.44% rewriter_before_opt_a : 0.000100s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000917s : 0.66% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003442s : 2.49% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000808s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000453s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000487s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000166s : 0.12% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000327 28 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000007s : 4: substitution.graph_param_transform 83.90% : 0.000274s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.10% : 0.000013s : 3: substitution.reduce_eliminate 1.54% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000006s : 2: substitution.replace_old_param 3.81% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129653 2 97.42% : 0.126311s : 1: type_inference.infer 2.58% : 0.003343s : 1: type_inference.specialize ------[replace.] 0.000110 7 67.96% : 0.000075s : 5: replace.inline 32.04% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000282 7 96.07% : 0.000271s : 5: match.inline 3.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000302 886 0.60% : 0.000002s : 13: predicate.accumulaten_eliminater 0.37% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.53% : 0.000002s : 13: predicate.addn_check_dump 0.60% : 0.000002s : 13: predicate.addn_zero_filter 1.05% : 0.000003s : 13: predicate.arithmetic_simplify 0.67% : 0.000002s : 13: predicate.cast_eliminate 0.24% : 0.000001s : 4: predicate.check_bprop_eliminate 0.52% : 0.000002s : 13: predicate.compare_switch_simplify 0.52% : 0.000002s : 13: predicate.depend_value_elim 0.53% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.56% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.65% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.40% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.24% : 0.000001s : 4: predicate.elim_not_effective 50.80% : 0.000153s : 4: predicate.elim_shapecalc_of_broadcastargs 0.65% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.51% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.53% : 0.000002s : 13: predicate.environ_get_depend_swap 0.58% : 0.000002s : 13: predicate.environ_get_eliminate 0.53% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.12% : 0.000000s : 4: predicate.fold_const_symbol 0.54% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000001s : 4: predicate.graph_param_transform 2.54% : 0.000008s : 28: predicate.inline 0.52% : 0.000002s : 8: predicate.inline_without_move 0.21% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.64% : 0.000002s : 8: predicate.less_batch_normalization 0.72% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 0.92% : 0.000003s : 19: predicate.load_eliminater 0.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 1.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 0.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.54% : 0.000002s : 13: predicate.merge_addn 0.53% : 0.000002s : 13: predicate.minmaximum_grad 0.85% : 0.000003s : 4: predicate.mutable_eliminate 0.31% : 0.000001s : 4: predicate.opt_reshape 1.07% : 0.000003s : 19: predicate.partial_eliminate 0.58% : 0.000002s : 13: predicate.print_const_string_wrapper 1.17% : 0.000004s : 13: predicate.reduce_eliminate 0.84% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.34% : 0.000001s : 8: predicate.remove_not_recompute_node 0.97% : 0.000003s : 23: predicate.replace_applicator 0.43% : 0.000001s : 8: predicate.replace_old_param 0.17% : 0.000001s : 4: predicate.reset_defer_inline 0.82% : 0.000002s : 13: predicate.reshape_eliminate 0.82% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.38% : 0.000001s : 4: predicate.row_tensor_eliminate 0.58% : 0.000002s : 13: predicate.same_eliminate 0.29% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.59% : 0.000002s : 8: predicate.special_op_eliminate 0.42% : 0.000001s : 8: predicate.specialize_transform 0.79% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.57% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.21% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.20% : 0.000004s : 20: predicate.switch_defer_inline 0.99% : 0.000003s : 20: predicate.switch_layer_defer_inline 3.85% : 0.000012s : 64: predicate.switch_simplify 0.72% : 0.000002s : 13: predicate.tile_eliminate 0.57% : 0.000002s : 13: predicate.transpose_eliminate 0.71% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.73% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 1.98% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 0.74% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 0.70% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 0.77% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 1.48% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 0.78% : 0.000002s : 13: predicate.value_based_eliminate 0.17% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.39% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002726 25 62.58% : 0.001706s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.51% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.91% : 0.000924s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147498 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000383s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.12% : 0.009032s : 1: jit_opt_a 0.12% : 0.000172s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.31% : 0.000462s : 1: loop_unroll 0.55% : 0.000817s : 1: mutable_eliminate 0.80% : 0.001177s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000196s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000618s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.67% : 0.002468s : 1: renormalize.infer 0.65% : 0.000963s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000105s : 1: rewriter_before_opt_a 0.17% : 0.000246s : 1: symbol_engine_optimizer 87.98% : 0.129766s : 1: type_inference TotalTime = 0.174726, [30] [bootstrap]: 0.00032012 [type_inference]: 0.156806 [event_method]: 2.321e-05 [auto_monad]: 7.779e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.0005169 [rewriter_before_opt_a]: 9.055e-05 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.0141095, [2] [Cycle 1]: 0.00853478, [27] [switch_simplify]: 6.855e-05 [loop_unroll]: 3.274e-05 [a_1]: 0.00074603 [with_stream_mark]: 2.452e-05 [recompute_prepare]: 1.009e-05 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.38999e-06 [parameter_eliminate]: 2.20002e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.68998e-06 [accelerated_algorithm]: 6.65998e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 7.08998e-06 [renormalize]: 0.00717416 [add_forward_monad_depend]: 1.301e-05 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 2.473e-05 [cse]: 8.947e-05 [replace_applicator]: 2.984e-05 [Cycle 2]: 0.00042341, [27] [switch_simplify]: 8.69998e-06 [loop_unroll]: 6.81001e-06 [a_1]: 0.00014423 [with_stream_mark]: 1.623e-05 [recompute_prepare]: 6.27001e-06 [updatestate_depend_eliminate]: 4.07003e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 3.21999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.999e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 6.34001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 7.35e-06 [cse]: 1.458e-05 [replace_applicator]: 6.19001e-06 [py_interpret_to_execute_after_opt_a]: 1.719e-05 [rewriter_after_opt_a]: 4.293e-05 [convert_after_rewriter]: 7.15998e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00083363 [jit_opt_b]: 6.279e-05, [1] [Cycle 1]: 5.465e-05, [2] [frontend_op_eliminate]: 2.241e-05 [inline_after_opt_a]: 1.925e-05 [cconv]: 3.425e-05 [loop_unroll]: 0.00051355 [jit_opt_after_cconv]: 0.00017161, [1] [Cycle 1]: 0.00016424, [11] [c_1]: 2.682e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 8.50001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 3.011e-05 [call_graph_tuple_transform]: 2.364e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.706e-05 [partial_unused_args_eliminate]: 2.69999e-06 [environ_conv]: 1.052e-05 [add_recomputation]: 5.317e-05 [cse_after_recomputation]: 2.325e-05, [1] [Cycle 1]: 1.684e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.703e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 7.25e-06 [opt_after_jit_grad]: 0.00051525 [symbol_engine_optimizer]: 0.00016218, [1] [Cycle 1]: 7.337e-05, [6] [build]: 4.68999e-06 [elim_shapecalc]: 9.07999e-06 [elim_not_effective]: 1.491e-05 [opt_reshape]: 6.89999e-06 [fold_const_symbol]: 9.87999e-06 [renormalize]: 3.39991e-07 [validate]: 5.412e-05 Sums bootstrap : 0.000320s : 0.19% type_inference : 0.156806s : 92.89% event_method : 0.000023s : 0.01% auto_monad : 0.000078s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000517s : 0.31% rewriter_before_opt_a : 0.000091s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.02% jit_opt_a.a_1 : 0.000890s : 0.53% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.007174s : 4.25% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000104s : 0.06% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000834s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000514s : 0.30% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000515s : 0.31% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.03% Time group info: ------[substitution.] 0.000275 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000007s : 4: substitution.graph_param_transform 84.74% : 0.000233s : 4: substitution.inline 1.72% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000006s : 4: substitution.remove_not_recompute_node 2.39% : 0.000007s : 2: substitution.replace_old_param 5.20% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.156713 2 98.13% : 0.153786s : 1: type_inference.infer 1.87% : 0.002927s : 1: type_inference.specialize ------[replace.] 0.000084 6 66.77% : 0.000056s : 4: replace.inline 33.23% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 94.64% : 0.000230s : 4: match.inline 5.36% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 12: predicate.compare_switch_simplify 1.37% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.98% : 0.000009s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 18: predicate.load_eliminater 2.32% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 2.18% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.28% : 0.000002s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.95% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002679 22 59.12% : 0.001584s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.15% : 0.000058s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.73% : 0.001037s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.183129 72 0.03% : 0.000056s : 1: add_recomputation 0.04% : 0.000082s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.19% : 0.000340s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 7.71% : 0.014113s : 1: jit_opt_a 0.10% : 0.000175s : 1: jit_opt_after_cconv 0.04% : 0.000066s : 1: jit_opt_b 0.29% : 0.000525s : 1: loop_unroll 0.46% : 0.000848s : 1: mutable_eliminate 0.64% : 0.001166s : 26: opt.transform.jit_opt_a 0.03% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000525s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000525s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 3.30% : 0.006048s : 1: renormalize.infer 0.61% : 0.001110s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.05% : 0.000096s : 1: rewriter_before_opt_a 0.09% : 0.000165s : 1: symbol_engine_optimizer 85.64% : 0.156832s : 1: type_inference TotalTime = 0.0166068, [30] [bootstrap]: 0.00029379 [type_inference]: 0.00827823 [event_method]: 2.263e-05 [auto_monad]: 8.551e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 4.761e-05 [rewriter_before_opt_a]: 8.605e-05 [expand_dump_flag]: 3.16999e-06 [jit_opt_a]: 0.00566003, [2] [Cycle 1]: 0.00188286, [27] [switch_simplify]: 6.277e-05 [loop_unroll]: 3.324e-05 [a_1]: 0.00067931 [with_stream_mark]: 2.023e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00073104 [add_forward_monad_depend]: 6.04999e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.465e-05 [cse]: 3.245e-05 [replace_applicator]: 1.26e-05 [Cycle 2]: 0.00033503, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.698e-05 [with_stream_mark]: 9.17001e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.11997e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.148e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.202e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.243e-05 [rewriter_after_opt_a]: 3.586e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00053763 [jit_opt_b]: 4.974e-05, [1] [Cycle 1]: 4.263e-05, [2] [frontend_op_eliminate]: 1.565e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.566e-05 [loop_unroll]: 0.00041382 [jit_opt_after_cconv]: 0.00015752, [1] [Cycle 1]: 0.00015096, [11] [c_1]: 2.009e-05 [parameter_eliminate]: 2.13998e-06 [updatestate_depend_eliminate]: 6.09999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 3.158e-05 [call_graph_tuple_transform]: 1.874e-05 [tuple_list_get_item_eliminator]: 5.55001e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.757e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 5.078e-05 [cse_after_recomputation]: 2.515e-05, [1] [Cycle 1]: 1.951e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.000455 [symbol_engine_optimizer]: 7.665e-05, [1] [Cycle 1]: 7.003e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 8.19998e-06 [elim_not_effective]: 1.341e-05 [opt_reshape]: 5.95002e-06 [fold_const_symbol]: 8.94998e-06 [renormalize]: 3.70026e-07 [validate]: 3.933e-05 Sums bootstrap : 0.000294s : 2.34% type_inference : 0.008278s : 65.99% event_method : 0.000023s : 0.18% auto_monad : 0.000086s : 0.68% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000048s : 0.38% rewriter_before_opt_a : 0.000086s : 0.69% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.55% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000776s : 6.19% jit_opt_a.with_stream_mark : 0.000029s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000731s : 5.83% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000044s : 0.35% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000036s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000538s : 4.29% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.20% loop_unroll : 0.000414s : 3.30% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000018s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000051s : 0.40% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000455s : 3.63% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.31% Time group info: ------[substitution.] 0.000252 27 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000005s : 3: substitution.graph_param_transform 82.85% : 0.000208s : 5: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.59% : 0.000012s : 3: substitution.reduce_eliminate 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 4.25% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008207 2 87.87% : 0.007212s : 1: type_inference.infer 12.13% : 0.000996s : 1: type_inference.specialize ------[replace.] 0.000133 7 78.92% : 0.000105s : 5: replace.inline 21.08% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 95.57% : 0.000205s : 5: match.inline 4.43% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.59% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.19% : 0.000001s : 11: predicate.addn_zero_filter 1.94% : 0.000002s : 11: predicate.arithmetic_simplify 1.30% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.99% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 16: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 16: predicate.partial_eliminate 1.23% : 0.000002s : 11: predicate.print_const_string_wrapper 1.87% : 0.000002s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.11% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000003s : 18: predicate.switch_defer_inline 2.35% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.14% : 0.000010s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.30% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 16 53.36% : 0.000429s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.15% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.49% : 0.000317s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018386 72 0.29% : 0.000054s : 1: add_recomputation 0.49% : 0.000089s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.71% : 0.000315s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.15% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.80% : 0.005663s : 1: jit_opt_a 0.87% : 0.000160s : 1: jit_opt_after_cconv 0.28% : 0.000052s : 1: jit_opt_b 2.29% : 0.000422s : 1: loop_unroll 2.97% : 0.000546s : 1: mutable_eliminate 5.43% : 0.000998s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.52% : 0.000463s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000050s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.21% : 0.000406s : 1: renormalize.infer 1.72% : 0.000316s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.49% : 0.000090s : 1: rewriter_before_opt_a 0.43% : 0.000079s : 1: symbol_engine_optimizer 45.11% : 0.008294s : 1: type_inference TotalTime = 0.168741, [30] [bootstrap]: 0.00028909 [type_inference]: 0.139619 [event_method]: 2.577e-05 [auto_monad]: 8.263e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.75997e-06 [py_interpret_to_execute]: 0.0169818 [rewriter_before_opt_a]: 0.00013102 [expand_dump_flag]: 5.57001e-06 [jit_opt_a]: 0.00887424, [2] [Cycle 1]: 0.00461868, [27] [switch_simplify]: 7.121e-05 [loop_unroll]: 3.46e-05 [a_1]: 0.00074002 [with_stream_mark]: 1.928e-05 [recompute_prepare]: 1.048e-05 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 8.38001e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 7.8e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 7e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.742e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.071e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00333861 [add_forward_monad_depend]: 9.03002e-06 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 1.947e-05 [cse]: 3.838e-05 [replace_applicator]: 2.578e-05 [Cycle 2]: 0.0004176, [27] [switch_simplify]: 7.82e-06 [loop_unroll]: 6.98e-06 [a_1]: 0.00013362 [with_stream_mark]: 1.453e-05 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 6.03998e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 3.52002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.894e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 5.94999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 7.85e-06 [cse]: 1.898e-05 [replace_applicator]: 7.65e-06 [py_interpret_to_execute_after_opt_a]: 1.534e-05 [rewriter_after_opt_a]: 4.356e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00072681 [jit_opt_b]: 9.732e-05, [1] [Cycle 1]: 8.873e-05, [2] [frontend_op_eliminate]: 5.304e-05 [inline_after_opt_a]: 1.976e-05 [cconv]: 2.99e-05 [loop_unroll]: 0.00045456 [jit_opt_after_cconv]: 0.00017411, [1] [Cycle 1]: 0.00016749, [11] [c_1]: 2.681e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 8.50999e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 3.42002e-06 [cse]: 3.459e-05 [call_graph_tuple_transform]: 2.129e-05 [tuple_list_get_item_eliminator]: 9.30001e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 7.59988e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.898e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.65001e-06 [add_recomputation]: 5.323e-05 [cse_after_recomputation]: 2.832e-05, [1] [Cycle 1]: 2.319e-05, [1] [cse]: 1.689e-05 [auto_monad_reorder]: 1.926e-05 [get_jit_bprop_graph]: 2.62001e-06 [rewriter_after_jit_bprop_graph]: 5.29e-06 [opt_after_jit_grad]: 0.00054137 [symbol_engine_optimizer]: 0.00021322, [1] [Cycle 1]: 0.00020675, [6] [build]: 3.8e-06 [elim_shapecalc]: 1.169e-05 [elim_not_effective]: 1.517e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 0.0001387 [renormalize]: 5.8001e-07 [validate]: 5.104e-05 Sums bootstrap : 0.000289s : 0.18% type_inference : 0.139619s : 85.02% event_method : 0.000026s : 0.02% auto_monad : 0.000083s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.016982s : 10.34% rewriter_before_opt_a : 0.000131s : 0.08% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000874s : 0.53% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003339s : 2.03% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000057s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000053s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000455s : 0.28% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.03% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000541s : 0.33% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000139s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.03% Time group info: ------[substitution.] 0.000287 25 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.11% : 0.000006s : 4: substitution.graph_param_transform 86.27% : 0.000248s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000006s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 5.20% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139522 2 97.58% : 0.136148s : 1: type_inference.infer 2.42% : 0.003374s : 1: type_inference.specialize ------[replace.] 0.000114 7 69.36% : 0.000079s : 5: replace.inline 30.64% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 7 94.69% : 0.000245s : 5: match.inline 5.31% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.51% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.81% : 0.000003s : 13: predicate.arithmetic_simplify 1.53% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.45% : 0.000002s : 13: predicate.depend_value_elim 1.28% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 19: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 2.44% : 0.000004s : 13: predicate.reduce_eliminate 1.30% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.61% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000004s : 20: predicate.switch_defer_inline 1.98% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.13% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002706 25 62.97% : 0.001704s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.70% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.33% : 0.000929s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.173458 72 0.03% : 0.000057s : 1: add_recomputation 0.05% : 0.000086s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.17% : 0.000302s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.12% : 0.008879s : 1: jit_opt_a 0.10% : 0.000179s : 1: jit_opt_after_cconv 0.06% : 0.000100s : 1: jit_opt_b 0.27% : 0.000464s : 1: loop_unroll 0.43% : 0.000739s : 1: mutable_eliminate 0.66% : 0.001152s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000066s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000166s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000551s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 9.80% : 0.017003s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.37% : 0.002376s : 1: renormalize.infer 0.55% : 0.000950s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000138s : 1: rewriter_before_opt_a 0.12% : 0.000216s : 1: symbol_engine_optimizer 80.51% : 0.139643s : 1: type_inference TotalTime = 0.0291701, [30] [bootstrap]: 0.00033944 [type_inference]: 0.0203544 [event_method]: 2.131e-05 [auto_monad]: 8.553e-05 [graph_reusing]: 6.51999e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.00012176 [rewriter_before_opt_a]: 8.276e-05 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.00587885, [2] [Cycle 1]: 0.00211319, [27] [switch_simplify]: 5.831e-05 [loop_unroll]: 2.971e-05 [a_1]: 0.00056687 [with_stream_mark]: 2.222e-05 [recompute_prepare]: 8.25999e-06 [updatestate_depend_eliminate]: 4.27998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 2.28998e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 8.79e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 0.00109043 [add_forward_monad_depend]: 6.32001e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.602e-05 [cse]: 3.407e-05 [replace_applicator]: 1.434e-05 [Cycle 2]: 0.00032073, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 5.12999e-06 [a_1]: 8.953e-05 [with_stream_mark]: 1.008e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 4.90999e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 7.46999e-06 [inline_without_move]: 5.17e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.66998e-06 [cse]: 1.283e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.447e-05 [rewriter_after_opt_a]: 4.413e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 4.82998e-06 [mutable_eliminate]: 0.0006515 [jit_opt_b]: 4.982e-05, [1] [Cycle 1]: 4.315e-05, [2] [frontend_op_eliminate]: 1.549e-05 [inline_after_opt_a]: 1.608e-05 [cconv]: 2.611e-05 [loop_unroll]: 0.00042822 [jit_opt_after_cconv]: 0.00014441, [1] [Cycle 1]: 0.00013805, [11] [c_1]: 2.108e-05 [parameter_eliminate]: 3.10998e-06 [updatestate_depend_eliminate]: 5.68997e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.236e-05 [call_graph_tuple_transform]: 1.826e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.37999e-06 [remove_dup_value]: 1.704e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.91998e-06 [add_recomputation]: 5.221e-05 [cse_after_recomputation]: 2.432e-05, [1] [Cycle 1]: 1.776e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.875e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 5.91e-06 [opt_after_jit_grad]: 0.00049254 [symbol_engine_optimizer]: 7.062e-05, [1] [Cycle 1]: 6.456e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.288e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.77999e-06 [renormalize]: 2.69996e-07 [validate]: 3.626e-05 Sums bootstrap : 0.000339s : 1.35% type_inference : 0.020354s : 80.96% event_method : 0.000021s : 0.08% auto_monad : 0.000086s : 0.34% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000122s : 0.48% rewriter_before_opt_a : 0.000083s : 0.33% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.25% jit_opt_a.loop_unroll : 0.000035s : 0.14% jit_opt_a.a_1 : 0.000656s : 2.61% jit_opt_a.with_stream_mark : 0.000032s : 0.13% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001091s : 4.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.09% jit_opt_a.cse : 0.000047s : 0.19% jit_opt_a.replace_applicator : 0.000020s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000044s : 0.18% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000651s : 2.59% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000026s : 0.10% loop_unroll : 0.000428s : 1.70% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000022s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000017s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000052s : 0.21% cse_after_recomputation.cse : 0.000012s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.02% opt_after_jit_grad : 0.000493s : 1.96% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.14% Time group info: ------[substitution.] 0.000230 23 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 85.14% : 0.000196s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.17% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000004s : 2: substitution.replace_old_param 5.52% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.020267 2 91.57% : 0.018560s : 1: type_inference.infer 8.43% : 0.001708s : 1: type_inference.specialize ------[replace.] 0.000077 6 70.19% : 0.000054s : 4: replace.inline 29.81% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.34% : 0.000193s : 4: match.inline 5.66% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.72% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.65% : 0.000001s : 3: predicate.opt_reshape 2.47% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.92% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000856 13 44.27% : 0.000379s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.01% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.72% : 0.000443s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031189 72 0.18% : 0.000055s : 1: add_recomputation 0.29% : 0.000090s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.14% : 0.000357s : 1: bootstrap 0.09% : 0.000029s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 18.86% : 0.005883s : 1: jit_opt_a 0.47% : 0.000147s : 1: jit_opt_after_cconv 0.17% : 0.000052s : 1: jit_opt_b 1.40% : 0.000436s : 1: loop_unroll 2.12% : 0.000660s : 1: mutable_eliminate 2.80% : 0.000873s : 26: opt.transform.jit_opt_a 0.15% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000032s : 4: opt.transform.symbol_engine_opt 1.61% : 0.000501s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000125s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 1.99% : 0.000621s : 1: renormalize.infer 1.48% : 0.000461s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000047s : 1: rewriter_after_opt_a 0.28% : 0.000087s : 1: rewriter_before_opt_a 0.23% : 0.000073s : 1: symbol_engine_optimizer 65.32% : 0.020372s : 1: type_inference TotalTime = 0.132215, [30] [bootstrap]: 0.00032331 [type_inference]: 0.119062 [event_method]: 2.337e-05 [auto_monad]: 7.309e-05 [graph_reusing]: 5.88002e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00052509 [rewriter_before_opt_a]: 9.612e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00930369, [2] [Cycle 1]: 0.00496525, [27] [switch_simplify]: 7.012e-05 [loop_unroll]: 3.4e-05 [a_1]: 0.00077573 [with_stream_mark]: 2.29e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 7.76001e-06 [updatestate_useless_node_eliminater]: 6.24999e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.539e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.135e-05 [inline_without_move]: 6.61999e-06 [renormalize]: 0.00366403 [add_forward_monad_depend]: 1.022e-05 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 1.997e-05 [cse]: 3.571e-05 [replace_applicator]: 2.315e-05 [Cycle 2]: 0.00042048, [27] [switch_simplify]: 8.17e-06 [loop_unroll]: 7.1e-06 [a_1]: 0.00014752 [with_stream_mark]: 1.635e-05 [recompute_prepare]: 6.28e-06 [updatestate_depend_eliminate]: 4.10998e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.43e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 3.16999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.99e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 7e-06 [cse]: 1.356e-05 [replace_applicator]: 6.83998e-06 [py_interpret_to_execute_after_opt_a]: 1.628e-05 [rewriter_after_opt_a]: 4.228e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 4.75001e-06 [mutable_eliminate]: 0.00087435 [jit_opt_b]: 6.114e-05, [1] [Cycle 1]: 5.255e-05, [2] [frontend_op_eliminate]: 2.123e-05 [inline_after_opt_a]: 1.994e-05 [cconv]: 3.03e-05 [loop_unroll]: 0.00046317 [jit_opt_after_cconv]: 0.00016439, [1] [Cycle 1]: 0.00015765, [11] [c_1]: 2.718e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.45002e-06 [cse]: 2.779e-05 [call_graph_tuple_transform]: 2.357e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 7.35e-06 [remove_dup_value]: 1.785e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 8.60999e-06 [add_recomputation]: 5.214e-05 [cse_after_recomputation]: 2.401e-05, [1] [Cycle 1]: 1.858e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 3.181e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 6.83e-06 [opt_after_jit_grad]: 0.00051599 [symbol_engine_optimizer]: 0.00021785, [1] [Cycle 1]: 0.00021093, [6] [build]: 4.58001e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 1.428e-05 [opt_reshape]: 7.23999e-06 [fold_const_symbol]: 0.00014438 [renormalize]: 4.59986e-07 [validate]: 5.561e-05 Sums bootstrap : 0.000323s : 0.25% type_inference : 0.119062s : 93.27% event_method : 0.000023s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000525s : 0.41% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000923s : 0.72% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003664s : 2.87% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000874s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000463s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000032s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000516s : 0.40% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000144s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.04% Time group info: ------[substitution.] 0.000324 28 0.54% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.85% : 0.000006s : 4: substitution.graph_param_transform 84.77% : 0.000275s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.63% : 0.000015s : 3: substitution.reduce_eliminate 1.43% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000006s : 2: substitution.replace_old_param 3.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118947 2 97.34% : 0.115783s : 1: type_inference.infer 2.66% : 0.003164s : 1: type_inference.specialize ------[replace.] 0.000112 7 67.31% : 0.000076s : 5: replace.inline 32.69% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000281 7 96.64% : 0.000272s : 5: match.inline 3.36% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000153 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 2.49% : 0.000004s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.78% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.33% : 0.000001s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.79% : 0.000009s : 28: predicate.inline 0.78% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.22% : 0.000002s : 13: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000004s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.62% : 0.000004s : 13: predicate.reduce_eliminate 1.69% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.48% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 20: predicate.switch_defer_inline 2.23% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000011s : 64: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.14% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.67% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002790 25 61.55% : 0.001717s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.20% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.24% : 0.000983s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137265 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.03% : 0.000035s : 1: auto_monad_reorder 0.25% : 0.000342s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.78% : 0.009308s : 1: jit_opt_a 0.12% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.34% : 0.000472s : 1: loop_unroll 0.64% : 0.000884s : 1: mutable_eliminate 0.87% : 0.001193s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000171s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000524s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000532s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.88% : 0.002577s : 1: renormalize.infer 0.78% : 0.001074s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.16% : 0.000221s : 1: symbol_engine_optimizer 86.75% : 0.119082s : 1: type_inference TotalTime = 0.130969, [30] [bootstrap]: 0.0002922 [type_inference]: 0.117455 [event_method]: 2.738e-05 [auto_monad]: 8.419e-05 [graph_reusing]: 0.00039036 [pre_auto_parallel]: 4.14002e-06 [py_interpret_to_execute]: 0.00065847 [rewriter_before_opt_a]: 0.00011692 [expand_dump_flag]: 4.13001e-06 [jit_opt_a]: 0.00911708, [2] [Cycle 1]: 0.0047238, [27] [switch_simplify]: 7.468e-05 [loop_unroll]: 3.503e-05 [a_1]: 0.0007888 [with_stream_mark]: 2.617e-05 [recompute_prepare]: 9.70002e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.62998e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 7.51999e-06 [updatestate_useless_node_eliminater]: 6.48998e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 7.08998e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.694e-05 [j_node_and_user_rematch]: 1.138e-05 [meta_fg_expand]: 3.13998e-06 [replace_old_param]: 1.261e-05 [inline_without_move]: 7.03998e-06 [renormalize]: 0.00336173 [add_forward_monad_depend]: 1.145e-05 [auto_monad_grad]: 3.76999e-06 [auto_monad_eliminator]: 2.367e-05 [cse]: 4.107e-05 [replace_applicator]: 2.527e-05 [Cycle 2]: 0.00043158, [27] [switch_simplify]: 8.05e-06 [loop_unroll]: 6.76e-06 [a_1]: 0.00014641 [with_stream_mark]: 1.722e-05 [recompute_prepare]: 7.67998e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 2.48002e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 3.89002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.677e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.106e-05 [inline_without_move]: 6.00002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 7.09001e-06 [cse]: 1.597e-05 [replace_applicator]: 6.57002e-06 [py_interpret_to_execute_after_opt_a]: 1.818e-05 [rewriter_after_opt_a]: 4.223e-05 [convert_after_rewriter]: 8.62998e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00078004 [jit_opt_b]: 6.059e-05, [1] [Cycle 1]: 5.19e-05, [2] [frontend_op_eliminate]: 1.946e-05 [inline_after_opt_a]: 1.958e-05 [cconv]: 3.23e-05 [loop_unroll]: 0.00047544 [jit_opt_after_cconv]: 0.00018339, [1] [Cycle 1]: 0.00017626, [11] [c_1]: 2.867e-05 [parameter_eliminate]: 4.70001e-06 [updatestate_depend_eliminate]: 9.07999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 3.83999e-06 [cse]: 3.483e-05 [call_graph_tuple_transform]: 2.409e-05 [tuple_list_get_item_eliminator]: 7.41999e-06 [none_parameter_eliminate]: 1.96998e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 7.12002e-06 [remove_dup_value]: 8.013e-05 [partial_unused_args_eliminate]: 2.79001e-06 [environ_conv]: 1.119e-05 [add_recomputation]: 6.011e-05 [cse_after_recomputation]: 2.806e-05, [1] [Cycle 1]: 2.163e-05, [1] [cse]: 1.519e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 2.44999e-06 [rewriter_after_jit_bprop_graph]: 8.12998e-06 [opt_after_jit_grad]: 0.00053195 [symbol_engine_optimizer]: 0.0001918, [1] [Cycle 1]: 0.00018438, [6] [build]: 4.32e-06 [elim_shapecalc]: 9.82001e-06 [elim_not_effective]: 0.00011851 [opt_reshape]: 7.98001e-06 [fold_const_symbol]: 1.119e-05 [renormalize]: 3.4002e-07 [validate]: 6.127e-05 Sums bootstrap : 0.000292s : 0.23% type_inference : 0.117455s : 92.98% event_method : 0.000027s : 0.02% auto_monad : 0.000084s : 0.07% graph_reusing : 0.000390s : 0.31% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000658s : 0.52% rewriter_before_opt_a : 0.000117s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.07% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000935s : 0.74% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003362s : 2.66% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000057s : 0.05% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000780s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000475s : 0.38% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000080s : 0.06% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000060s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000532s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000119s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.05% Time group info: ------[substitution.] 0.000449 28 23.37% : 0.000105s : 2: substitution.elim_not_effective 0.37% : 0.000002s : 2: substitution.fold_const_symbol 1.48% : 0.000007s : 4: substitution.graph_param_transform 63.95% : 0.000287s : 5: substitution.inline 1.08% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.86% : 0.000017s : 3: substitution.reduce_eliminate 1.22% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000009s : 2: substitution.replace_old_param 2.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117343 2 97.18% : 0.114032s : 1: type_inference.infer 2.82% : 0.003311s : 1: type_inference.specialize ------[replace.] 0.000112 7 70.43% : 0.000079s : 5: replace.inline 29.57% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000296 7 96.24% : 0.000284s : 5: match.inline 3.76% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000147 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.31% : 0.000003s : 13: predicate.arithmetic_simplify 1.61% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.73% : 0.000008s : 28: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.32% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.35% : 0.000003s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.44% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002790 25 59.13% : 0.001650s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.47% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.39% : 0.001043s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135710 72 0.05% : 0.000064s : 1: add_recomputation 0.06% : 0.000088s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000305s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.29% : 0.000398s : 1: graph_reusing 6.72% : 0.009121s : 1: jit_opt_a 0.14% : 0.000187s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.36% : 0.000485s : 1: loop_unroll 0.58% : 0.000793s : 1: mutable_eliminate 0.90% : 0.001216s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000143s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000540s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000007s : 1: pre_auto_parallel 0.49% : 0.000669s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000083s : 1: remove_dup_value 1.68% : 0.002274s : 1: renormalize.infer 0.79% : 0.001072s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000123s : 1: rewriter_before_opt_a 0.14% : 0.000195s : 1: symbol_engine_optimizer 86.57% : 0.117482s : 1: type_inference TotalTime = 0.234049, [30] [bootstrap]: 0.0003599 [type_inference]: 0.221317 [event_method]: 2.039e-05 [auto_monad]: 7.418e-05 [graph_reusing]: 5.79999e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00056218 [rewriter_before_opt_a]: 9.18e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.00884179, [2] [Cycle 1]: 0.00421116, [27] [switch_simplify]: 6.694e-05 [loop_unroll]: 3.159e-05 [a_1]: 0.00065451 [with_stream_mark]: 2.186e-05 [recompute_prepare]: 1.052e-05 [updatestate_depend_eliminate]: 5.09998e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 7.31001e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 6.74999e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.704e-05 [j_node_and_user_rematch]: 1.083e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00303154 [add_forward_monad_depend]: 8.94e-06 [auto_monad_grad]: 2.86e-06 [auto_monad_eliminator]: 2.117e-05 [cse]: 3.355e-05 [replace_applicator]: 2.284e-05 [Cycle 2]: 0.00039915, [27] [switch_simplify]: 7.66999e-06 [loop_unroll]: 6.43e-06 [a_1]: 0.00013227 [with_stream_mark]: 1.448e-05 [recompute_prepare]: 6.57002e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 6.54999e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.864e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 5.63002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.10999e-06 [auto_monad_eliminator]: 6.11998e-06 [cse]: 1.327e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.548e-05 [rewriter_after_opt_a]: 4.092e-05 [convert_after_rewriter]: 2.888e-05 [order_py_execute_after_rewriter]: 6.43e-06 [mutable_eliminate]: 0.00077645 [jit_opt_b]: 6.803e-05, [1] [Cycle 1]: 5.939e-05, [2] [frontend_op_eliminate]: 2.28e-05 [inline_after_opt_a]: 2.142e-05 [cconv]: 2.961e-05 [loop_unroll]: 0.00047297 [jit_opt_after_cconv]: 0.00016928, [1] [Cycle 1]: 0.00016146, [11] [c_1]: 2.746e-05 [parameter_eliminate]: 3.35e-06 [updatestate_depend_eliminate]: 6.66e-06 [updatestate_assign_eliminate]: 5.12999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.711e-05 [call_graph_tuple_transform]: 2.251e-05 [tuple_list_get_item_eliminator]: 9.00999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.717e-05 [partial_unused_args_eliminate]: 2.55002e-06 [environ_conv]: 1.051e-05 [add_recomputation]: 5.515e-05 [cse_after_recomputation]: 2.756e-05, [1] [Cycle 1]: 2.191e-05, [1] [cse]: 1.514e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 8.25999e-06 [opt_after_jit_grad]: 0.00052839 [symbol_engine_optimizer]: 0.00022117, [1] [Cycle 1]: 0.00021392, [6] [build]: 4.2e-06 [elim_shapecalc]: 0.00014365 [elim_not_effective]: 1.644e-05 [opt_reshape]: 7.26001e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 6.59988e-07 [validate]: 5.358e-05 Sums bootstrap : 0.000360s : 0.16% type_inference : 0.221317s : 96.58% event_method : 0.000020s : 0.01% auto_monad : 0.000074s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000562s : 0.25% rewriter_before_opt_a : 0.000092s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.03% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000787s : 0.34% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003032s : 1.32% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.01% jit_opt_a.cse : 0.000047s : 0.02% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000029s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000776s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000473s : 0.21% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000009s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000528s : 0.23% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000144s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.02% Time group info: ------[substitution.] 0.000263 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000007s : 4: substitution.graph_param_transform 84.62% : 0.000223s : 4: substitution.inline 1.53% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000006s : 4: substitution.remove_not_recompute_node 2.46% : 0.000006s : 2: substitution.replace_old_param 5.20% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.221225 2 98.72% : 0.218390s : 1: type_inference.infer 1.28% : 0.002835s : 1: type_inference.specialize ------[replace.] 0.000083 6 68.71% : 0.000057s : 4: replace.inline 31.29% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.65% : 0.000220s : 4: match.inline 5.35% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.53% : 0.000002s : 12: predicate.addn_zero_filter 2.05% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 1.12% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.51% : 0.000008s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.94% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000003s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.95% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.60% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002803 22 66.74% : 0.001870s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.96% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.30% : 0.000877s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.238196 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000077s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.16% : 0.000383s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.01% : 0.000032s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.01% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.71% : 0.008845s : 1: jit_opt_a 0.07% : 0.000173s : 1: jit_opt_after_cconv 0.03% : 0.000071s : 1: jit_opt_b 0.20% : 0.000482s : 1: loop_unroll 0.33% : 0.000787s : 1: mutable_eliminate 0.44% : 0.001051s : 26: opt.transform.jit_opt_a 0.03% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000537s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000569s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.85% : 0.002020s : 1: renormalize.infer 0.42% : 0.000999s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000097s : 1: rewriter_before_opt_a 0.09% : 0.000224s : 1: symbol_engine_optimizer 92.92% : 0.221336s : 1: type_inference TotalTime = 0.140069, [30] [bootstrap]: 0.00032994 [type_inference]: 0.127633 [event_method]: 2.579e-05 [auto_monad]: 8.606e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.00065861 [rewriter_before_opt_a]: 0.00010497 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00879363, [2] [Cycle 1]: 0.00441819, [27] [switch_simplify]: 6.901e-05 [loop_unroll]: 4.166e-05 [a_1]: 0.00076085 [with_stream_mark]: 2.658e-05 [recompute_prepare]: 8.90999e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.81001e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 8.05e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.91001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.081e-05 [inline_without_move]: 6.74999e-06 [renormalize]: 0.00311582 [add_forward_monad_depend]: 7.49002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.673e-05 [cse]: 3.491e-05 [replace_applicator]: 1.728e-05 [Cycle 2]: 0.00038497, [27] [switch_simplify]: 6.98998e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00013236 [with_stream_mark]: 1.183e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.61998e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.04e-06 [inline_without_move]: 5.71e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 5.81998e-06 [cse]: 1.381e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.358e-05 [rewriter_after_opt_a]: 4.463e-05 [convert_after_rewriter]: 7.46001e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00070463 [jit_opt_b]: 5.766e-05, [1] [Cycle 1]: 5.033e-05, [2] [frontend_op_eliminate]: 1.98e-05 [inline_after_opt_a]: 1.857e-05 [cconv]: 2.603e-05 [loop_unroll]: 0.00043453 [jit_opt_after_cconv]: 0.00015301, [1] [Cycle 1]: 0.0001468, [11] [c_1]: 2.612e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.238e-05 [call_graph_tuple_transform]: 2.06e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.86999e-06 [remove_dup_value]: 1.54e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 7.68999e-06 [add_recomputation]: 5.596e-05 [cse_after_recomputation]: 2.549e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00046187 [symbol_engine_optimizer]: 0.00014107, [1] [Cycle 1]: 0.00013392, [6] [build]: 4.06001e-06 [elim_shapecalc]: 9.24e-06 [elim_not_effective]: 1.565e-05 [opt_reshape]: 7.58999e-06 [fold_const_symbol]: 1.044e-05 [renormalize]: 3.60014e-07 [validate]: 4.842e-05 Sums bootstrap : 0.000330s : 0.24% type_inference : 0.127633s : 94.29% event_method : 0.000026s : 0.02% auto_monad : 0.000086s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000659s : 0.49% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000048s : 0.04% jit_opt_a.a_1 : 0.000893s : 0.66% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003116s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000705s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000435s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000462s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000307 28 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 4: substitution.graph_param_transform 84.63% : 0.000260s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.62% : 0.000011s : 3: substitution.reduce_eliminate 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.63% : 0.000005s : 2: substitution.replace_old_param 3.94% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.127526 2 97.34% : 0.124136s : 1: type_inference.infer 2.66% : 0.003389s : 1: type_inference.specialize ------[replace.] 0.000108 7 67.96% : 0.000073s : 5: replace.inline 32.04% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 7 95.96% : 0.000257s : 5: match.inline 4.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.51% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.55% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.56% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.69% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.41% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.72% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.51% : 0.000004s : 13: predicate.reduce_eliminate 1.60% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000004s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000011s : 64: predicate.switch_simplify 1.55% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002554 25 65.07% : 0.001662s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.30% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.63% : 0.000808s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144404 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000090s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000349s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.09% : 0.008797s : 1: jit_opt_a 0.11% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.31% : 0.000442s : 1: loop_unroll 0.49% : 0.000713s : 1: mutable_eliminate 0.80% : 0.001157s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000469s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000667s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.55% : 0.002234s : 1: renormalize.infer 0.60% : 0.000871s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.10% : 0.000144s : 1: symbol_engine_optimizer 88.40% : 0.127656s : 1: type_inference TotalTime = 0.174911, [30] [bootstrap]: 0.00029261 [type_inference]: 0.163555 [event_method]: 2.547e-05 [auto_monad]: 7.652e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 0.00049214 [rewriter_before_opt_a]: 0.00010431 [expand_dump_flag]: 3.72002e-06 [jit_opt_a]: 0.00801436, [2] [Cycle 1]: 0.00416177, [27] [switch_simplify]: 6.516e-05 [loop_unroll]: 3.695e-05 [a_1]: 0.00070046 [with_stream_mark]: 1.988e-05 [recompute_prepare]: 9.62001e-06 [updatestate_depend_eliminate]: 4.62998e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.58003e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 6.01998e-06 [renormalize]: 0.00297083 [add_forward_monad_depend]: 8.33999e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.669e-05 [cse]: 3.651e-05 [replace_applicator]: 1.926e-05 [Cycle 2]: 0.0003792, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 6.38e-06 [a_1]: 0.00012265 [with_stream_mark]: 1.064e-05 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.18002e-06 [inline_without_move]: 5.69e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.636e-05 [replace_applicator]: 6.39999e-06 [py_interpret_to_execute_after_opt_a]: 1.285e-05 [rewriter_after_opt_a]: 3.966e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00062741 [jit_opt_b]: 5.679e-05, [1] [Cycle 1]: 4.934e-05, [2] [frontend_op_eliminate]: 1.956e-05 [inline_after_opt_a]: 1.877e-05 [cconv]: 2.659e-05 [loop_unroll]: 0.00042723 [jit_opt_after_cconv]: 0.00016362, [1] [Cycle 1]: 0.00015751, [11] [c_1]: 2.664e-05 [parameter_eliminate]: 3.2e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.789e-05 [call_graph_tuple_transform]: 2.193e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 6.56e-06 [remove_dup_value]: 1.856e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 7.98999e-06 [add_recomputation]: 5.021e-05 [cse_after_recomputation]: 2.375e-05, [1] [Cycle 1]: 1.895e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 1.806e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 1.681e-05 [opt_after_jit_grad]: 0.00048224 [symbol_engine_optimizer]: 7.711e-05, [1] [Cycle 1]: 6.997e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 7.06001e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 4.40021e-07 [validate]: 7.129e-05 Sums bootstrap : 0.000293s : 0.17% type_inference : 0.163555s : 95.75% event_method : 0.000025s : 0.01% auto_monad : 0.000077s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000492s : 0.29% rewriter_before_opt_a : 0.000104s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.04% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000823s : 0.48% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002971s : 1.74% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000053s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000627s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000427s : 0.25% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000017s : 0.01% opt_after_jit_grad : 0.000482s : 0.28% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000071s : 0.04% Time group info: ------[substitution.] 0.000251 25 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000007s : 4: substitution.graph_param_transform 85.11% : 0.000214s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 5.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.163459 2 97.94% : 0.160085s : 1: type_inference.infer 2.06% : 0.003375s : 1: type_inference.specialize ------[replace.] 0.000109 7 69.71% : 0.000076s : 5: replace.inline 30.29% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 94.69% : 0.000211s : 5: match.inline 5.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.45% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.48% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.35% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 8: predicate.less_batch_normalization 1.94% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.41% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.35% : 0.000002s : 13: predicate.print_const_string_wrapper 1.88% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.49% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.48% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.75% : 0.000004s : 20: predicate.switch_defer_inline 2.33% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 64: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002629 25 65.33% : 0.001718s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.21% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.46% : 0.000854s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.179007 72 0.03% : 0.000053s : 1: add_recomputation 0.04% : 0.000080s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.17% : 0.000310s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 4.48% : 0.008018s : 1: jit_opt_a 0.09% : 0.000167s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.24% : 0.000435s : 1: loop_unroll 0.36% : 0.000636s : 1: mutable_eliminate 0.60% : 0.001081s : 26: opt.transform.jit_opt_a 0.03% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000492s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000500s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.19% : 0.002127s : 1: renormalize.infer 0.47% : 0.000834s : 1: renormalize.specialize 0.01% : 0.000019s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000110s : 1: rewriter_before_opt_a 0.04% : 0.000080s : 1: symbol_engine_optimizer 91.38% : 0.163581s : 1: type_inference TotalTime = 0.02248, [30] [bootstrap]: 0.00037982 [type_inference]: 0.0129837 [event_method]: 2.232e-05 [auto_monad]: 7.135e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 4.764e-05 [rewriter_before_opt_a]: 8.129e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00646197, [2] [Cycle 1]: 0.00214135, [27] [switch_simplify]: 6.555e-05 [loop_unroll]: 3.32e-05 [a_1]: 0.00070163 [with_stream_mark]: 2.353e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.47001e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.508e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 1.11e-05 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00094961 [add_forward_monad_depend]: 1.118e-05 [auto_monad_grad]: 2.40002e-06 [auto_monad_eliminator]: 1.655e-05 [cse]: 3.527e-05 [replace_applicator]: 1.45e-05 [Cycle 2]: 0.00039046, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 5.10001e-06 [a_1]: 0.00014233 [with_stream_mark]: 1.211e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.63998e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 4.90001e-06 [merge_forward]: 3.32002e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.79999e-06 [cse]: 1.542e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.604e-05 [rewriter_after_opt_a]: 3.963e-05 [convert_after_rewriter]: 6.64001e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00069329 [jit_opt_b]: 5.31e-05, [1] [Cycle 1]: 4.509e-05, [2] [frontend_op_eliminate]: 1.767e-05 [inline_after_opt_a]: 1.608e-05 [cconv]: 2.991e-05 [loop_unroll]: 0.00046142 [jit_opt_after_cconv]: 0.00017656, [1] [Cycle 1]: 0.0001692, [11] [c_1]: 2.233e-05 [parameter_eliminate]: 4.05998e-06 [updatestate_depend_eliminate]: 7.66001e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 2.9e-05 [call_graph_tuple_transform]: 2.162e-05 [tuple_list_get_item_eliminator]: 5.66998e-06 [none_parameter_eliminate]: 1.95001e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.651e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 5.29e-05 [cse_after_recomputation]: 2.489e-05, [1] [Cycle 1]: 1.86e-05, [1] [cse]: 1.221e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 6.47001e-06 [opt_after_jit_grad]: 0.00050071 [symbol_engine_optimizer]: 7.605e-05, [1] [Cycle 1]: 6.896e-05, [6] [build]: 3.52002e-06 [elim_shapecalc]: 7.95998e-06 [elim_not_effective]: 1.494e-05 [opt_reshape]: 5.70001e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 5.79981e-07 [validate]: 4.324e-05 Sums bootstrap : 0.000380s : 2.12% type_inference : 0.012984s : 72.48% event_method : 0.000022s : 0.12% auto_monad : 0.000071s : 0.40% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000048s : 0.27% rewriter_before_opt_a : 0.000081s : 0.45% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.40% jit_opt_a.loop_unroll : 0.000038s : 0.21% jit_opt_a.a_1 : 0.000844s : 4.71% jit_opt_a.with_stream_mark : 0.000036s : 0.20% jit_opt_a.recompute_prepare : 0.000016s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.10% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000019s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.06% jit_opt_a.renormalize : 0.000950s : 5.30% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.13% jit_opt_a.cse : 0.000051s : 0.28% jit_opt_a.replace_applicator : 0.000020s : 0.11% py_interpret_to_execute_after_opt_a : 0.000016s : 0.09% rewriter_after_opt_a : 0.000040s : 0.22% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000693s : 3.87% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.09% cconv : 0.000030s : 0.17% loop_unroll : 0.000461s : 2.58% jit_opt_after_cconv.c_1 : 0.000022s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000053s : 0.30% cse_after_recomputation.cse : 0.000012s : 0.07% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000501s : 2.80% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.24% Time group info: ------[substitution.] 0.000305 27 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000006s : 3: substitution.graph_param_transform 84.46% : 0.000258s : 5: substitution.inline 1.11% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.12% : 0.000013s : 3: substitution.reduce_eliminate 1.46% : 0.000004s : 4: substitution.remove_not_recompute_node 1.99% : 0.000006s : 2: substitution.replace_old_param 3.87% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012911 2 91.49% : 0.011813s : 1: type_inference.infer 8.51% : 0.001098s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.88% : 0.000066s : 5: replace.inline 32.12% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 96.01% : 0.000255s : 5: match.inline 3.99% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 0.83% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 11: predicate.addn_check_dump 1.23% : 0.000002s : 11: predicate.addn_zero_filter 2.26% : 0.000003s : 11: predicate.arithmetic_simplify 1.19% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000002s : 11: predicate.environ_get_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.50% : 0.000001s : 3: predicate.graph_param_transform 5.89% : 0.000008s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 2.68% : 0.000003s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.65% : 0.000003s : 18: predicate.switch_defer_inline 2.27% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000010s : 59: predicate.switch_simplify 1.93% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.19% : 0.000002s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000976 16 52.53% : 0.000513s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.26% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.20% : 0.000373s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024559 72 0.23% : 0.000056s : 1: add_recomputation 0.30% : 0.000075s : 1: auto_monad 0.08% : 0.000020s : 1: auto_monad_reorder 1.63% : 0.000399s : 1: bootstrap 0.13% : 0.000033s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.11% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.11% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 26.33% : 0.006466s : 1: jit_opt_a 0.73% : 0.000179s : 1: jit_opt_after_cconv 0.23% : 0.000056s : 1: jit_opt_b 1.91% : 0.000470s : 1: loop_unroll 2.87% : 0.000704s : 1: mutable_eliminate 4.38% : 0.001077s : 26: opt.transform.jit_opt_a 0.21% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.09% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.07% : 0.000509s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000050s : 1: py_interpret_to_execute 0.08% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000019s : 1: remove_dup_value 2.30% : 0.000566s : 1: renormalize.infer 1.53% : 0.000375s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000043s : 1: rewriter_after_opt_a 0.34% : 0.000084s : 1: rewriter_before_opt_a 0.32% : 0.000078s : 1: symbol_engine_optimizer 52.93% : 0.013000s : 1: type_inference TotalTime = 0.1259, [30] [bootstrap]: 0.00028901 [type_inference]: 0.114798 [event_method]: 2.182e-05 [auto_monad]: 7.268e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.71e-06 [py_interpret_to_execute]: 0.00051315 [rewriter_before_opt_a]: 9.745e-05 [expand_dump_flag]: 4.2e-06 [jit_opt_a]: 0.00759681, [2] [Cycle 1]: 0.00376342, [27] [switch_simplify]: 6.301e-05 [loop_unroll]: 3.46e-05 [a_1]: 0.00069271 [with_stream_mark]: 1.764e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 7.02002e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.98998e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00258046 [add_forward_monad_depend]: 7.76001e-06 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 1.924e-05 [cse]: 3.612e-05 [replace_applicator]: 1.996e-05 [Cycle 2]: 0.00039978, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00013625 [with_stream_mark]: 1.277e-05 [recompute_prepare]: 6.65002e-06 [updatestate_depend_eliminate]: 4.27998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.63003e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.424e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 6.21998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 6.99001e-06 [cse]: 1.574e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.856e-05 [rewriter_after_opt_a]: 4.168e-05 [convert_after_rewriter]: 7.93999e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00072038 [jit_opt_b]: 5.969e-05, [1] [Cycle 1]: 5.078e-05, [2] [frontend_op_eliminate]: 2.004e-05 [inline_after_opt_a]: 1.84e-05 [cconv]: 2.901e-05 [loop_unroll]: 0.00045899 [jit_opt_after_cconv]: 0.00017688, [1] [Cycle 1]: 0.00016865, [11] [c_1]: 2.701e-05 [parameter_eliminate]: 3.35998e-06 [updatestate_depend_eliminate]: 8.50999e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [cse]: 3.402e-05 [call_graph_tuple_transform]: 2.301e-05 [tuple_list_get_item_eliminator]: 6.26998e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.901e-05 [partial_unused_args_eliminate]: 2.63e-06 [environ_conv]: 1.169e-05 [add_recomputation]: 5.938e-05 [cse_after_recomputation]: 2.776e-05, [1] [Cycle 1]: 2.086e-05, [1] [cse]: 1.454e-05 [auto_monad_reorder]: 1.819e-05 [get_jit_bprop_graph]: 1.88002e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00050682 [symbol_engine_optimizer]: 8.25e-05, [1] [Cycle 1]: 7.59e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.426e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 1.159e-05 [renormalize]: 5.69999e-07 [validate]: 5.102e-05 Sums bootstrap : 0.000289s : 0.24% type_inference : 0.114798s : 94.22% event_method : 0.000022s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000513s : 0.42% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000829s : 0.68% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002581s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000720s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000459s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000059s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000507s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000263 28 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000007s : 4: substitution.graph_param_transform 81.68% : 0.000215s : 5: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.91% : 0.000013s : 3: substitution.reduce_eliminate 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000005s : 2: substitution.replace_old_param 4.10% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114715 2 97.48% : 0.111819s : 1: type_inference.infer 2.52% : 0.002895s : 1: type_inference.specialize ------[replace.] 0.000101 7 69.22% : 0.000070s : 5: replace.inline 30.78% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 95.64% : 0.000212s : 5: match.inline 4.36% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.55% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.59% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.83% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.83% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 1.97% : 0.000003s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.42% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002404 25 65.07% : 0.001564s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.65% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.28% : 0.000776s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129626 72 0.05% : 0.000063s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000304s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.86% : 0.007600s : 1: jit_opt_a 0.14% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.36% : 0.000468s : 1: loop_unroll 0.56% : 0.000730s : 1: mutable_eliminate 0.83% : 0.001081s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000520s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.37% : 0.001774s : 1: renormalize.infer 0.61% : 0.000797s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 88.57% : 0.114814s : 1: type_inference TotalTime = 0.124603, [30] [bootstrap]: 0.00031838 [type_inference]: 0.112288 [event_method]: 1.943e-05 [auto_monad]: 7.524e-05 [graph_reusing]: 5.43002e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00059999 [rewriter_before_opt_a]: 9.244e-05 [expand_dump_flag]: 4.60001e-06 [jit_opt_a]: 0.00842666, [2] [Cycle 1]: 0.0043544, [27] [switch_simplify]: 5.66e-05 [loop_unroll]: 3.19e-05 [a_1]: 0.0006375 [with_stream_mark]: 1.831e-05 [recompute_prepare]: 1.035e-05 [updatestate_depend_eliminate]: 4.59002e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 6.75002e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.87002e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.715e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 9.99001e-06 [inline_without_move]: 6.89999e-06 [renormalize]: 0.00324444 [add_forward_monad_depend]: 7.59002e-06 [auto_monad_grad]: 3.16001e-06 [auto_monad_eliminator]: 2.033e-05 [cse]: 2.37e-05 [replace_applicator]: 1.685e-05 [Cycle 2]: 0.00038467, [27] [switch_simplify]: 7.43e-06 [loop_unroll]: 6.06998e-06 [a_1]: 0.00013425 [with_stream_mark]: 9.77001e-06 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.83002e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.63001e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.273e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.656e-05 [rewriter_after_opt_a]: 4.834e-05 [convert_after_rewriter]: 7.58999e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00072901 [jit_opt_b]: 6.59e-05, [1] [Cycle 1]: 5.653e-05, [2] [frontend_op_eliminate]: 2.535e-05 [inline_after_opt_a]: 1.938e-05 [cconv]: 3.025e-05 [loop_unroll]: 0.00049749 [jit_opt_after_cconv]: 0.00017653, [1] [Cycle 1]: 0.00016944, [11] [c_1]: 2.743e-05 [parameter_eliminate]: 4.33001e-06 [updatestate_depend_eliminate]: 6.67002e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.99999e-06 [cse]: 2.789e-05 [call_graph_tuple_transform]: 2.637e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 6.41e-06 [remove_dup_value]: 1.657e-05 [partial_unused_args_eliminate]: 5.40001e-06 [environ_conv]: 8.65001e-06 [add_recomputation]: 5.449e-05 [cse_after_recomputation]: 2.414e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.676e-05 [get_jit_bprop_graph]: 2.50997e-06 [rewriter_after_jit_bprop_graph]: 7.31999e-06 [opt_after_jit_grad]: 0.00072499 [symbol_engine_optimizer]: 8.684e-05, [1] [Cycle 1]: 7.901e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 1.09e-05 [elim_not_effective]: 1.616e-05 [opt_reshape]: 7.42998e-06 [fold_const_symbol]: 1.031e-05 [renormalize]: 1.27999e-06 [validate]: 4.646e-05 Sums bootstrap : 0.000318s : 0.26% type_inference : 0.112288s : 93.36% event_method : 0.000019s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000600s : 0.50% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000772s : 0.64% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003245s : 2.70% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000048s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000729s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000497s : 0.41% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000725s : 0.60% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000242 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 3.24% : 0.000008s : 4: substitution.graph_param_transform 84.85% : 0.000205s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 5.36% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112209 2 97.45% : 0.109353s : 1: type_inference.infer 2.55% : 0.002856s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.67% : 0.000054s : 4: replace.inline 33.33% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.51% : 0.000202s : 4: match.inline 5.49% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.55% : 0.000002s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.63% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.35% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.42% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.38% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 2.07% : 0.000003s : 12: predicate.reduce_eliminate 1.73% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.30% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.83% : 0.000010s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002374 22 59.90% : 0.001422s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.98% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.12% : 0.000905s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129087 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000335s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.53% : 0.008431s : 1: jit_opt_a 0.14% : 0.000179s : 1: jit_opt_after_cconv 0.05% : 0.000069s : 1: jit_opt_b 0.39% : 0.000506s : 1: loop_unroll 0.57% : 0.000740s : 1: mutable_eliminate 0.79% : 0.001016s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.14% : 0.000176s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000737s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000611s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.72% : 0.002220s : 1: renormalize.infer 0.78% : 0.001010s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000052s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.07% : 0.000090s : 1: symbol_engine_optimizer 87.00% : 0.112302s : 1: type_inference TotalTime = 0.0890988, [30] [bootstrap]: 0.00030689 [type_inference]: 0.0746121 [event_method]: 2.037e-05 [auto_monad]: 7.008e-05 [graph_reusing]: 5.74999e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00034409 [rewriter_before_opt_a]: 9.831e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00856252, [2] [Cycle 1]: 0.00431296, [27] [switch_simplify]: 6.604e-05 [loop_unroll]: 3.503e-05 [a_1]: 0.00072309 [with_stream_mark]: 1.926e-05 [recompute_prepare]: 9.02e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 8.21002e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.66999e-06 [get_grad_eliminate_]: 7.03e-06 [merge_forward]: 3.97002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.655e-05 [j_node_and_user_rematch]: 1.14e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 1.1e-05 [inline_without_move]: 6.71e-06 [renormalize]: 0.00310203 [add_forward_monad_depend]: 8.33999e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.862e-05 [cse]: 3.05e-05 [replace_applicator]: 1.9e-05 [Cycle 2]: 0.00039591, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.0001283 [with_stream_mark]: 1.482e-05 [recompute_prepare]: 7.01001e-06 [updatestate_depend_eliminate]: 3.32002e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.76003e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 2.97002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.699e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.77001e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.45001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.796e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 1.758e-05 [rewriter_after_opt_a]: 4.08e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00069361 [jit_opt_b]: 5.92e-05, [1] [Cycle 1]: 5.224e-05, [2] [frontend_op_eliminate]: 2.035e-05 [inline_after_opt_a]: 2.05e-05 [cconv]: 2.854e-05 [loop_unroll]: 0.00045287 [jit_opt_after_cconv]: 0.00016885, [1] [Cycle 1]: 0.00016229, [11] [c_1]: 2.678e-05 [parameter_eliminate]: 3.97e-06 [updatestate_depend_eliminate]: 7.18e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 3.45e-06 [cse]: 2.901e-05 [call_graph_tuple_transform]: 2.295e-05 [tuple_list_get_item_eliminator]: 6.93e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.979e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 9.96e-06 [add_recomputation]: 4.749e-05 [cse_after_recomputation]: 2.527e-05, [1] [Cycle 1]: 1.99e-05, [1] [cse]: 1.416e-05 [auto_monad_reorder]: 1.637e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 5.74999e-06 [opt_after_jit_grad]: 0.00052682 [symbol_engine_optimizer]: 0.00268612, [1] [Cycle 1]: 0.00267715, [6] [build]: 3.2e-06 [elim_shapecalc]: 1.054e-05 [elim_not_effective]: 0.00258259 [opt_reshape]: 1.608e-05 [fold_const_symbol]: 1.353e-05 [renormalize]: 1.31998e-06 [validate]: 7.231e-05 Sums bootstrap : 0.000307s : 0.36% type_inference : 0.074612s : 88.17% event_method : 0.000020s : 0.02% auto_monad : 0.000070s : 0.08% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000344s : 0.41% rewriter_before_opt_a : 0.000098s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000851s : 1.01% jit_opt_a.with_stream_mark : 0.000034s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003102s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000048s : 0.06% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000694s : 0.82% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000453s : 0.54% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000047s : 0.06% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000527s : 0.62% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.002583s : 3.05% symbol_engine_optimizer.opt_reshape : 0.000016s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000072s : 0.09% Time group info: ------[substitution.] 0.000277 25 1.18% : 0.000003s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000007s : 4: substitution.graph_param_transform 85.55% : 0.000237s : 5: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000006s : 4: substitution.remove_not_recompute_node 2.01% : 0.000006s : 2: substitution.replace_old_param 4.37% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.074524 2 92.73% : 0.069103s : 1: type_inference.infer 7.27% : 0.005421s : 1: type_inference.specialize ------[replace.] 0.000111 7 68.69% : 0.000076s : 5: replace.inline 31.31% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 95.55% : 0.000234s : 5: match.inline 4.45% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 888 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 1.83% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 1.33% : 0.000002s : 4: predicate.elim_not_effective 0.78% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.51% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.58% : 0.000002s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 1.32% : 0.000002s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.79% : 0.000003s : 13: predicate.print_const_string_wrapper 2.10% : 0.000003s : 13: predicate.reduce_eliminate 1.62% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.43% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 20: predicate.switch_defer_inline 2.26% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 65: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003378 37 69.54% : 0.002349s : 28: func_graph_cloner_run.FuncGraphClonerGraph 1.99% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.46% : 0.000961s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.095940 72 0.05% : 0.000050s : 1: add_recomputation 0.08% : 0.000073s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.34% : 0.000327s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.93% : 0.008566s : 1: jit_opt_a 0.18% : 0.000172s : 1: jit_opt_after_cconv 0.06% : 0.000062s : 1: jit_opt_b 0.48% : 0.000461s : 1: loop_unroll 0.73% : 0.000703s : 1: mutable_eliminate 1.16% : 0.001116s : 26: opt.transform.jit_opt_a 0.06% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000028s : 1: opt.transform.opt_after_jit_grad 2.72% : 0.002614s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000536s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000350s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 2.22% : 0.002130s : 1: renormalize.infer 1.00% : 0.000962s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.11% : 0.000102s : 1: rewriter_before_opt_a 2.80% : 0.002690s : 1: symbol_engine_optimizer 77.78% : 0.074624s : 1: type_inference TotalTime = 0.0681319, [30] [bootstrap]: 0.00032443 [type_inference]: 0.0574001 [event_method]: 2.317e-05 [auto_monad]: 7.113e-05 [graph_reusing]: 5.43002e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00030058 [rewriter_before_opt_a]: 9.897e-05 [expand_dump_flag]: 3.55998e-06 [jit_opt_a]: 0.00758202, [2] [Cycle 1]: 0.003475, [27] [switch_simplify]: 6.49e-05 [loop_unroll]: 3.437e-05 [a_1]: 0.00068849 [with_stream_mark]: 1.741e-05 [recompute_prepare]: 9.40001e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.73999e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.22003e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00230328 [add_forward_monad_depend]: 6.38998e-06 [auto_monad_grad]: 2.55997e-06 [auto_monad_eliminator]: 1.702e-05 [cse]: 3.855e-05 [replace_applicator]: 1.681e-05 [Cycle 2]: 0.00061471, [27] [switch_simplify]: 7.66001e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012222 [with_stream_mark]: 1.177e-05 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 3.57002e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 9.06998e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.43e-06 [cse]: 0.00023374 [replace_applicator]: 1.267e-05 [py_interpret_to_execute_after_opt_a]: 1.738e-05 [rewriter_after_opt_a]: 4.802e-05 [convert_after_rewriter]: 7.44002e-06 [order_py_execute_after_rewriter]: 5.66e-06 [mutable_eliminate]: 0.00063254 [jit_opt_b]: 5.823e-05, [1] [Cycle 1]: 5e-05, [2] [frontend_op_eliminate]: 1.998e-05 [inline_after_opt_a]: 1.881e-05 [cconv]: 2.621e-05 [loop_unroll]: 0.00042983 [jit_opt_after_cconv]: 0.00015768, [1] [Cycle 1]: 0.00015161, [11] [c_1]: 2.533e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.95002e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 2.634e-05 [call_graph_tuple_transform]: 2.06e-05 [tuple_list_get_item_eliminator]: 6.58998e-06 [none_parameter_eliminate]: 2.19999e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 8.17e-06 [add_recomputation]: 5.182e-05 [cse_after_recomputation]: 2.448e-05, [1] [Cycle 1]: 1.941e-05, [1] [cse]: 1.358e-05 [auto_monad_reorder]: 1.917e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00047067 [symbol_engine_optimizer]: 7.686e-05, [1] [Cycle 1]: 7.031e-05, [6] [build]: 3.85e-06 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 1.319e-05 [opt_reshape]: 7.21001e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 3.60014e-07 [validate]: 6.805e-05 Sums bootstrap : 0.000324s : 0.51% type_inference : 0.057400s : 89.66% event_method : 0.000023s : 0.04% auto_monad : 0.000071s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000301s : 0.47% rewriter_before_opt_a : 0.000099s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.11% jit_opt_a.loop_unroll : 0.000040s : 0.06% jit_opt_a.a_1 : 0.000811s : 1.27% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002303s : 3.60% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000272s : 0.43% jit_opt_a.replace_applicator : 0.000029s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000048s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000633s : 0.99% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000430s : 0.67% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000052s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000471s : 0.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000068s : 0.11% Time group info: ------[substitution.] 0.000257 25 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 2.50% : 0.000006s : 4: substitution.graph_param_transform 85.73% : 0.000220s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057249 2 95.92% : 0.054913s : 1: type_inference.infer 4.08% : 0.002336s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.91% : 0.000071s : 5: replace.inline 31.09% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 7 94.61% : 0.000217s : 5: match.inline 5.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 888 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.35% : 0.000007s : 28: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 19: predicate.load_eliminater 0.98% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.36% : 0.000002s : 13: predicate.merge_addn 1.31% : 0.000002s : 13: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000002s : 13: predicate.reduce_eliminate 1.52% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.77% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 65: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002543 29 69.83% : 0.001776s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.41% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.76% : 0.000706s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071543 72 0.08% : 0.000055s : 1: add_recomputation 0.10% : 0.000075s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.48% : 0.000346s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.60% : 0.007586s : 1: jit_opt_a 0.22% : 0.000160s : 1: jit_opt_after_cconv 0.09% : 0.000061s : 1: jit_opt_b 0.61% : 0.000438s : 1: loop_unroll 0.90% : 0.000642s : 1: mutable_eliminate 1.49% : 0.001068s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000306s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 2.19% : 0.001567s : 1: renormalize.infer 1.01% : 0.000726s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000051s : 1: rewriter_after_opt_a 0.15% : 0.000104s : 1: rewriter_before_opt_a 0.11% : 0.000079s : 1: symbol_engine_optimizer 80.26% : 0.057417s : 1: type_inference TotalTime = 0.0746815, [30] [bootstrap]: 0.00029822 [type_inference]: 0.063047 [event_method]: 1.94e-05 [auto_monad]: 7.631e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 3.00002e-06 [py_interpret_to_execute]: 0.00037022 [rewriter_before_opt_a]: 9.06e-05 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.00820632, [2] [Cycle 1]: 0.00399008, [27] [switch_simplify]: 6.613e-05 [loop_unroll]: 3.345e-05 [a_1]: 0.00065409 [with_stream_mark]: 1.982e-05 [recompute_prepare]: 9.54999e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.95002e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.71e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.60997e-06 [replace_old_param]: 1.074e-05 [inline_without_move]: 6.76e-06 [renormalize]: 0.00281143 [add_forward_monad_depend]: 1.118e-05 [auto_monad_grad]: 2.70002e-06 [auto_monad_eliminator]: 2.306e-05 [cse]: 3.515e-05 [replace_applicator]: 2.407e-05 [Cycle 2]: 0.00040603, [27] [switch_simplify]: 7.41001e-06 [loop_unroll]: 6.89001e-06 [a_1]: 0.00013228 [with_stream_mark]: 1.575e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.53998e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.86998e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 2.78998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.992e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 5.65001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 7.25e-06 [cse]: 1.316e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.354e-05 [rewriter_after_opt_a]: 3.877e-05 [convert_after_rewriter]: 8.23001e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.0007412 [jit_opt_b]: 5.966e-05, [1] [Cycle 1]: 5.143e-05, [2] [frontend_op_eliminate]: 2.158e-05 [inline_after_opt_a]: 1.841e-05 [cconv]: 3.222e-05 [loop_unroll]: 0.00046501 [jit_opt_after_cconv]: 0.00016374, [1] [Cycle 1]: 0.00015709, [11] [c_1]: 2.816e-05 [parameter_eliminate]: 4.05998e-06 [updatestate_depend_eliminate]: 7.82002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.472e-05 [call_graph_tuple_transform]: 2.322e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.641e-05 [partial_unused_args_eliminate]: 3.01001e-06 [environ_conv]: 9.98998e-06 [add_recomputation]: 5.207e-05 [cse_after_recomputation]: 2.351e-05, [1] [Cycle 1]: 1.801e-05, [1] [cse]: 1.231e-05 [auto_monad_reorder]: 1.579e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00049849 [symbol_engine_optimizer]: 0.00012618, [1] [Cycle 1]: 0.00011961, [6] [build]: 3.51001e-06 [elim_shapecalc]: 9.17999e-06 [elim_not_effective]: 5.69e-05 [opt_reshape]: 7.83001e-06 [fold_const_symbol]: 1.122e-05 [renormalize]: 3.50003e-07 [validate]: 8.28e-05 Sums bootstrap : 0.000298s : 0.42% type_inference : 0.063047s : 89.77% event_method : 0.000019s : 0.03% auto_monad : 0.000076s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000370s : 0.53% rewriter_before_opt_a : 0.000091s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.10% jit_opt_a.loop_unroll : 0.000040s : 0.06% jit_opt_a.a_1 : 0.000786s : 1.12% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002812s : 4.00% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.04% jit_opt_a.cse : 0.000048s : 0.07% jit_opt_a.replace_applicator : 0.000030s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000741s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000032s : 0.05% loop_unroll : 0.000465s : 0.66% jit_opt_after_cconv.c_1 : 0.000028s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000498s : 0.71% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000057s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000083s : 0.12% Time group info: ------[substitution.] 0.000256 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000007s : 4: substitution.graph_param_transform 84.07% : 0.000215s : 4: substitution.inline 1.71% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000007s : 4: substitution.remove_not_recompute_node 2.28% : 0.000006s : 2: substitution.replace_old_param 5.16% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062955 2 96.61% : 0.060819s : 1: type_inference.infer 3.39% : 0.002137s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.09% : 0.000054s : 4: replace.inline 32.91% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.66% : 0.000212s : 4: match.inline 5.34% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.28% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 26: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.83% : 0.000003s : 12: predicate.reduce_eliminate 1.72% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.41% : 0.000002s : 12: predicate.transpose_eliminate 1.73% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003018 34 71.91% : 0.002170s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.69% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.40% : 0.000797s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.078614 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000079s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.40% : 0.000316s : 1: bootstrap 0.04% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.44% : 0.008210s : 1: jit_opt_a 0.21% : 0.000167s : 1: jit_opt_after_cconv 0.08% : 0.000062s : 1: jit_opt_b 0.60% : 0.000474s : 1: loop_unroll 0.96% : 0.000752s : 1: mutable_eliminate 1.34% : 0.001051s : 26: opt.transform.jit_opt_a 0.08% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000507s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000377s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 2.40% : 0.001886s : 1: renormalize.infer 1.16% : 0.000913s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000042s : 1: rewriter_after_opt_a 0.12% : 0.000097s : 1: rewriter_before_opt_a 0.16% : 0.000129s : 1: symbol_engine_optimizer 80.22% : 0.063062s : 1: type_inference TotalTime = 0.137165, [30] [bootstrap]: 0.00034534 [type_inference]: 0.122979 [event_method]: 2.619e-05 [auto_monad]: 8.94e-05 [graph_reusing]: 6.89001e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 0.0005462 [rewriter_before_opt_a]: 9.877e-05 [expand_dump_flag]: 3.45998e-06 [jit_opt_a]: 0.0100623, [2] [Cycle 1]: 0.00491456, [27] [switch_simplify]: 6.905e-05 [loop_unroll]: 3.534e-05 [a_1]: 0.00092731 [with_stream_mark]: 2.463e-05 [recompute_prepare]: 1.096e-05 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 2.21998e-06 [specialize_transform]: 8.43999e-06 [updatestate_useless_node_eliminater]: 6.86001e-06 [accelerated_algorithm]: 7.42002e-06 [meta_shard_fg_expand]: 2.87002e-06 [get_grad_eliminate_]: 7.04001e-06 [merge_forward]: 4.17998e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.803e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 1.105e-05 [inline_without_move]: 6.56999e-06 [renormalize]: 0.00340496 [add_forward_monad_depend]: 1.074e-05 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 1.997e-05 [cse]: 3.742e-05 [replace_applicator]: 2.255e-05 [Cycle 2]: 0.00040823, [27] [switch_simplify]: 7.19001e-06 [loop_unroll]: 6.48998e-06 [a_1]: 0.00014219 [with_stream_mark]: 1.664e-05 [recompute_prepare]: 6.48998e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 3.07002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 9.50001e-06 [inline_without_move]: 5.99999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.453e-05 [replace_applicator]: 6.72002e-06 [py_interpret_to_execute_after_opt_a]: 1.735e-05 [rewriter_after_opt_a]: 7.415e-05 [convert_after_rewriter]: 7.93001e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00093639 [jit_opt_b]: 6.187e-05, [1] [Cycle 1]: 5.328e-05, [2] [frontend_op_eliminate]: 2.239e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 3.168e-05 [loop_unroll]: 0.00047602 [jit_opt_after_cconv]: 0.00016807, [1] [Cycle 1]: 0.00016069, [11] [c_1]: 2.747e-05 [parameter_eliminate]: 3.13e-06 [updatestate_depend_eliminate]: 7.48999e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.625e-05 [call_graph_tuple_transform]: 2.432e-05 [tuple_list_get_item_eliminator]: 6.96999e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.57002e-06 [remove_dup_value]: 1.698e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 1.055e-05 [add_recomputation]: 0.00011551 [cse_after_recomputation]: 2.778e-05, [1] [Cycle 1]: 2.152e-05, [1] [cse]: 1.504e-05 [auto_monad_reorder]: 1.865e-05 [get_jit_bprop_graph]: 1.98002e-06 [rewriter_after_jit_bprop_graph]: 7.11001e-06 [opt_after_jit_grad]: 0.00054452 [symbol_engine_optimizer]: 0.00013989, [1] [Cycle 1]: 0.00013229, [6] [build]: 4.03999e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 6.805e-05 [opt_reshape]: 8.08001e-06 [fold_const_symbol]: 1.19e-05 [renormalize]: 4.39992e-07 [validate]: 8.568e-05 Sums bootstrap : 0.000345s : 0.26% type_inference : 0.122979s : 93.39% event_method : 0.000026s : 0.02% auto_monad : 0.000089s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000546s : 0.41% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.001069s : 0.81% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003405s : 2.59% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000074s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000936s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000476s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000116s : 0.09% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000545s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000068s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000086s : 0.07% Time group info: ------[substitution.] 0.000450 28 11.97% : 0.000054s : 2: substitution.elim_not_effective 0.37% : 0.000002s : 2: substitution.fold_const_symbol 1.40% : 0.000006s : 4: substitution.graph_param_transform 76.32% : 0.000344s : 5: substitution.inline 1.08% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.11% : 0.000014s : 3: substitution.reduce_eliminate 1.37% : 0.000006s : 4: substitution.remove_not_recompute_node 1.40% : 0.000006s : 2: substitution.replace_old_param 2.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122828 2 97.12% : 0.119288s : 1: type_inference.infer 2.88% : 0.003540s : 1: type_inference.specialize ------[replace.] 0.000114 7 69.15% : 0.000079s : 5: replace.inline 30.85% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000352 7 96.60% : 0.000340s : 5: match.inline 3.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000160 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.30% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.78% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 19: predicate.load_eliminater 1.46% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.76% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.76% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000004s : 19: predicate.partial_eliminate 1.36% : 0.000002s : 13: predicate.print_const_string_wrapper 2.43% : 0.000004s : 13: predicate.reduce_eliminate 1.57% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.09% : 0.000002s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000002s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.99% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002568 25 61.31% : 0.001574s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.60% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.09% : 0.000901s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141993 72 0.08% : 0.000119s : 1: add_recomputation 0.07% : 0.000093s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000363s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.09% : 0.010067s : 1: jit_opt_a 0.12% : 0.000171s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.34% : 0.000484s : 1: loop_unroll 0.67% : 0.000948s : 1: mutable_eliminate 0.94% : 0.001340s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000094s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000553s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000554s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.72% : 0.002442s : 1: renormalize.infer 0.67% : 0.000951s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000078s : 1: rewriter_after_opt_a 0.07% : 0.000104s : 1: rewriter_before_opt_a 0.10% : 0.000143s : 1: symbol_engine_optimizer 86.65% : 0.123043s : 1: type_inference TotalTime = 0.122655, [30] [bootstrap]: 0.00027556 [type_inference]: 0.111827 [event_method]: 2.495e-05 [auto_monad]: 7.645e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 2.87002e-06 [py_interpret_to_execute]: 0.00053117 [rewriter_before_opt_a]: 0.00010176 [expand_dump_flag]: 4.12003e-06 [jit_opt_a]: 0.00754224, [2] [Cycle 1]: 0.00384822, [27] [switch_simplify]: 6.316e-05 [loop_unroll]: 3.413e-05 [a_1]: 0.00069728 [with_stream_mark]: 2.157e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.86999e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.50997e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.60997e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.50997e-06 [renormalize]: 0.00262092 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.677e-05 [cse]: 7.99e-05 [replace_applicator]: 1.507e-05 [Cycle 2]: 0.00038275, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012919 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 6.32001e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.43998e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.76e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.98002e-06 [cse]: 1.681e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.359e-05 [rewriter_after_opt_a]: 3.761e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00059434 [jit_opt_b]: 5.447e-05, [1] [Cycle 1]: 4.701e-05, [2] [frontend_op_eliminate]: 1.89e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 2.627e-05 [loop_unroll]: 0.00042347 [jit_opt_after_cconv]: 0.00015051, [1] [Cycle 1]: 0.00014447, [11] [c_1]: 2.541e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.228e-05 [call_graph_tuple_transform]: 2.089e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.564e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 8.47e-06 [add_recomputation]: 5.253e-05 [cse_after_recomputation]: 2.32e-05, [1] [Cycle 1]: 1.822e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.798e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.89998e-06 [opt_after_jit_grad]: 0.00045457 [symbol_engine_optimizer]: 7.467e-05, [1] [Cycle 1]: 6.851e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.234e-05 [opt_reshape]: 6.51999e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 4.00003e-07 [validate]: 0.0001148 Sums bootstrap : 0.000276s : 0.23% type_inference : 0.111827s : 94.17% event_method : 0.000025s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000531s : 0.45% rewriter_before_opt_a : 0.000102s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000826s : 0.70% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002621s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000097s : 0.08% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000594s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000423s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000115s : 0.10% Time group info: ------[substitution.] 0.000277 28 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 4: substitution.graph_param_transform 83.98% : 0.000232s : 5: substitution.inline 1.15% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.40% : 0.000012s : 3: substitution.reduce_eliminate 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 3.84% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111652 2 97.40% : 0.108754s : 1: type_inference.infer 2.60% : 0.002898s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.35% : 0.000065s : 5: replace.inline 31.65% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 7 96.04% : 0.000230s : 5: match.inline 3.96% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.39% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.14% : 0.000007s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 19: predicate.load_eliminater 1.05% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.22% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.49% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.52% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.69% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.77% : 0.000011s : 64: predicate.switch_simplify 1.44% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002320 25 64.31% : 0.001492s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.21% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.49% : 0.000754s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126346 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000290s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.97% : 0.007545s : 1: jit_opt_a 0.12% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.34% : 0.000431s : 1: loop_unroll 0.48% : 0.000603s : 1: mutable_eliminate 0.85% : 0.001072s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000539s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.47% : 0.001863s : 1: renormalize.infer 0.59% : 0.000749s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000107s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 88.53% : 0.111848s : 1: type_inference TotalTime = 0.0680869, [30] [bootstrap]: 0.00030115 [type_inference]: 0.0576157 [event_method]: 2.26e-05 [auto_monad]: 7.259e-05 [graph_reusing]: 6.06998e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 0.00029221 [rewriter_before_opt_a]: 9.919e-05 [expand_dump_flag]: 4.15999e-06 [jit_opt_a]: 0.00726093, [2] [Cycle 1]: 0.00355594, [27] [switch_simplify]: 5.918e-05 [loop_unroll]: 3.395e-05 [a_1]: 0.00067634 [with_stream_mark]: 1.889e-05 [recompute_prepare]: 1.061e-05 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 8.02e-06 [updatestate_useless_node_eliminater]: 6.61e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.94001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.037e-05 [inline_without_move]: 7.23999e-06 [renormalize]: 0.00237895 [add_forward_monad_depend]: 7.13e-06 [auto_monad_grad]: 3.25e-06 [auto_monad_eliminator]: 1.929e-05 [cse]: 4.213e-05 [replace_applicator]: 1.894e-05 [Cycle 2]: 0.0003845, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 7.31001e-06 [a_1]: 0.00012571 [with_stream_mark]: 1.148e-05 [recompute_prepare]: 6.15002e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 2.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.71002e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.548e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.307e-05 [rewriter_after_opt_a]: 3.984e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00064101 [jit_opt_b]: 5.724e-05, [1] [Cycle 1]: 4.927e-05, [2] [frontend_op_eliminate]: 1.889e-05 [inline_after_opt_a]: 1.888e-05 [cconv]: 2.751e-05 [loop_unroll]: 0.00042808 [jit_opt_after_cconv]: 0.00016265, [1] [Cycle 1]: 0.00015546, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 2.972e-05 [call_graph_tuple_transform]: 2.151e-05 [tuple_list_get_item_eliminator]: 6.84999e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.29999e-06 [remove_dup_value]: 1.896e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 9.71998e-06 [add_recomputation]: 4.967e-05 [cse_after_recomputation]: 2.495e-05, [1] [Cycle 1]: 1.941e-05, [1] [cse]: 1.374e-05 [auto_monad_reorder]: 1.784e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 4.48001e-06 [opt_after_jit_grad]: 0.00056124 [symbol_engine_optimizer]: 7.889e-05, [1] [Cycle 1]: 7.195e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 9.19998e-06 [elim_not_effective]: 1.415e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 3.69997e-07 [validate]: 7.565e-05 Sums bootstrap : 0.000301s : 0.47% type_inference : 0.057616s : 89.80% event_method : 0.000023s : 0.04% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000292s : 0.46% rewriter_before_opt_a : 0.000099s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.10% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000802s : 1.25% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002379s : 3.71% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000058s : 0.09% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000641s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000428s : 0.67% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000561s : 0.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000076s : 0.12% Time group info: ------[substitution.] 0.000243 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 4: substitution.graph_param_transform 85.32% : 0.000208s : 5: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 5.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057532 2 95.36% : 0.054861s : 1: type_inference.infer 4.64% : 0.002672s : 1: type_inference.specialize ------[replace.] 0.000096 7 69.79% : 0.000067s : 5: replace.inline 30.21% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 94.62% : 0.000204s : 5: match.inline 5.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 888 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.46% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.35% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.73% : 0.000011s : 65: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.98% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002649 29 70.97% : 0.001880s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.23% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.80% : 0.000710s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071634 72 0.07% : 0.000052s : 1: add_recomputation 0.11% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.44% : 0.000318s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.14% : 0.007263s : 1: jit_opt_a 0.23% : 0.000165s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.61% : 0.000436s : 1: loop_unroll 0.91% : 0.000650s : 1: mutable_eliminate 1.47% : 0.001055s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000099s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000571s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000297s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 2.27% : 0.001628s : 1: renormalize.infer 1.03% : 0.000740s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.15% : 0.000104s : 1: rewriter_before_opt_a 0.11% : 0.000081s : 1: symbol_engine_optimizer 80.46% : 0.057634s : 1: type_inference TotalTime = 0.0254875, [30] [bootstrap]: 0.00070114 [type_inference]: 0.0133257 [event_method]: 2.119e-05 [auto_monad]: 7.017e-05 [graph_reusing]: 6.74999e-06 [pre_auto_parallel]: 3.14999e-06 [py_interpret_to_execute]: 4.992e-05 [rewriter_before_opt_a]: 8.312e-05 [expand_dump_flag]: 2.84001e-06 [jit_opt_a]: 0.00899711, [2] [Cycle 1]: 0.00288504, [27] [switch_simplify]: 6.177e-05 [loop_unroll]: 3.372e-05 [a_1]: 0.00156964 [with_stream_mark]: 2.106e-05 [recompute_prepare]: 8.70001e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.48002e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 4.07998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00084967 [add_forward_monad_depend]: 5.38002e-06 [auto_monad_grad]: 2.12999e-06 [auto_monad_eliminator]: 1.433e-05 [cse]: 3.527e-05 [replace_applicator]: 1.18e-05 [Cycle 2]: 0.0003246, [27] [switch_simplify]: 6.09999e-06 [loop_unroll]: 4.95999e-06 [a_1]: 9.666e-05 [with_stream_mark]: 8.87999e-06 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.56998e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.056e-05 [j_node_and_user_rematch]: 7.8e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 7.55998e-06 [inline_without_move]: 5.11997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.266e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.193e-05 [rewriter_after_opt_a]: 3.62e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00053679 [jit_opt_b]: 4.976e-05, [1] [Cycle 1]: 4.276e-05, [2] [frontend_op_eliminate]: 1.659e-05 [inline_after_opt_a]: 1.55e-05 [cconv]: 2.478e-05 [loop_unroll]: 0.00043036 [jit_opt_after_cconv]: 0.00018861, [1] [Cycle 1]: 0.00018217, [11] [c_1]: 2.217e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.111e-05 [call_graph_tuple_transform]: 2.025e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.33002e-06 [remove_dup_value]: 1.528e-05 [partial_unused_args_eliminate]: 2.48002e-06 [environ_conv]: 7.11999e-06 [add_recomputation]: 5.171e-05 [cse_after_recomputation]: 2.527e-05, [1] [Cycle 1]: 1.936e-05, [1] [cse]: 1.305e-05 [auto_monad_reorder]: 1.726e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00045921 [symbol_engine_optimizer]: 7.409e-05, [1] [Cycle 1]: 6.806e-05, [6] [build]: 3.98999e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.89992e-07 [validate]: 3.755e-05 Sums bootstrap : 0.000701s : 3.69% type_inference : 0.013326s : 70.12% event_method : 0.000021s : 0.11% auto_monad : 0.000070s : 0.37% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.26% rewriter_before_opt_a : 0.000083s : 0.44% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.36% jit_opt_a.loop_unroll : 0.000039s : 0.20% jit_opt_a.a_1 : 0.001666s : 8.77% jit_opt_a.with_stream_mark : 0.000030s : 0.16% jit_opt_a.recompute_prepare : 0.000014s : 0.07% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.09% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.09% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.000850s : 4.47% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.11% jit_opt_a.cse : 0.000048s : 0.25% jit_opt_a.replace_applicator : 0.000017s : 0.09% py_interpret_to_execute_after_opt_a : 0.000012s : 0.06% rewriter_after_opt_a : 0.000036s : 0.19% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000537s : 2.82% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.09% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000025s : 0.13% loop_unroll : 0.000430s : 2.26% jit_opt_after_cconv.c_1 : 0.000022s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000015s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000052s : 0.27% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000017s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000459s : 2.42% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.20% Time group info: ------[substitution.] 0.000277 27 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 3: substitution.graph_param_transform 84.09% : 0.000233s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.08% : 0.000011s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.23% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.013250 2 88.62% : 0.011742s : 1: type_inference.infer 11.38% : 0.001508s : 1: type_inference.specialize ------[replace.] 0.000965 7 96.61% : 0.000932s : 5: replace.inline 3.39% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 95.60% : 0.000230s : 5: match.inline 4.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 2.23% : 0.000003s : 11: predicate.arithmetic_simplify 1.21% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000002s : 11: predicate.compare_switch_simplify 1.37% : 0.000002s : 11: predicate.depend_value_elim 1.33% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000001s : 3: predicate.graph_param_transform 5.98% : 0.000008s : 24: predicate.inline 1.15% : 0.000002s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 16: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.33% : 0.000002s : 11: predicate.minmaximum_grad 1.15% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000002s : 11: predicate.print_const_string_wrapper 2.21% : 0.000003s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 11: predicate.reshape_eliminate 1.72% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.79% : 0.000004s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 59: predicate.switch_simplify 1.47% : 0.000002s : 11: predicate.tile_eliminate 1.36% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001291 16 46.26% : 0.000597s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.89% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 47.84% : 0.000618s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028270 72 0.19% : 0.000055s : 1: add_recomputation 0.26% : 0.000074s : 1: auto_monad 0.07% : 0.000020s : 1: auto_monad_reorder 2.71% : 0.000765s : 1: bootstrap 0.10% : 0.000027s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 31.84% : 0.009001s : 1: jit_opt_a 0.68% : 0.000191s : 1: jit_opt_after_cconv 0.19% : 0.000052s : 1: jit_opt_b 1.55% : 0.000438s : 1: loop_unroll 1.93% : 0.000545s : 1: mutable_eliminate 6.70% : 0.001893s : 26: opt.transform.jit_opt_a 0.18% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000013s : 1: opt.transform.mutable_eliminate 0.07% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.65% : 0.000467s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000053s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000018s : 1: remove_dup_value 1.68% : 0.000476s : 1: renormalize.infer 1.29% : 0.000365s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000039s : 1: rewriter_after_opt_a 0.30% : 0.000086s : 1: rewriter_before_opt_a 0.27% : 0.000077s : 1: symbol_engine_optimizer 47.21% : 0.013345s : 1: type_inference TotalTime = 0.0722629, [30] [bootstrap]: 0.00030424 [type_inference]: 0.0614693 [event_method]: 2.135e-05 [auto_monad]: 7.59e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 2.60997e-06 [py_interpret_to_execute]: 0.0003742 [rewriter_before_opt_a]: 9.503e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00752397, [2] [Cycle 1]: 0.00337477, [27] [switch_simplify]: 6.293e-05 [loop_unroll]: 3.183e-05 [a_1]: 0.00062683 [with_stream_mark]: 2.155e-05 [recompute_prepare]: 9.33997e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 7.05002e-06 [updatestate_useless_node_eliminater]: 6.42001e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 7e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.61999e-06 [renormalize]: 0.00227242 [add_forward_monad_depend]: 6.76e-06 [auto_monad_grad]: 3.15002e-06 [auto_monad_eliminator]: 1.785e-05 [cse]: 3.016e-05 [replace_applicator]: 1.844e-05 [Cycle 2]: 0.00038226, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 6.21998e-06 [a_1]: 0.00012923 [with_stream_mark]: 1.174e-05 [recompute_prepare]: 6.53998e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.12002e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.205e-05 [replace_applicator]: 5.88002e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 3.895e-05 [convert_after_rewriter]: 7.11999e-06 [order_py_execute_after_rewriter]: 6.06998e-06 [mutable_eliminate]: 0.00068272 [jit_opt_b]: 5.786e-05, [1] [Cycle 1]: 5.02e-05, [2] [frontend_op_eliminate]: 2.038e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.979e-05 [loop_unroll]: 0.00044647 [jit_opt_after_cconv]: 0.00015514, [1] [Cycle 1]: 0.00014869, [11] [c_1]: 2.731e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.36998e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 2.155e-05 [call_graph_tuple_transform]: 2.229e-05 [tuple_list_get_item_eliminator]: 6.25002e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.528e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 8.95001e-06 [add_recomputation]: 5.316e-05 [cse_after_recomputation]: 2.289e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 1.115e-05 [auto_monad_reorder]: 1.561e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00048379 [symbol_engine_optimizer]: 0.00010285, [1] [Cycle 1]: 9.628e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 3.521e-05 [opt_reshape]: 7.41999e-06 [fold_const_symbol]: 1.058e-05 [renormalize]: 3.19997e-07 [validate]: 4.741e-05 Sums bootstrap : 0.000304s : 0.45% type_inference : 0.061469s : 90.54% event_method : 0.000021s : 0.03% auto_monad : 0.000076s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000374s : 0.55% rewriter_before_opt_a : 0.000095s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000756s : 1.11% jit_opt_a.with_stream_mark : 0.000033s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002273s : 3.35% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000042s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000683s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000446s : 0.66% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000484s : 0.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000035s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.07% Time group info: ------[substitution.] 0.000239 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.74% : 0.000007s : 4: substitution.graph_param_transform 84.89% : 0.000203s : 4: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000005s : 2: substitution.replace_old_param 5.11% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061379 2 95.04% : 0.058334s : 1: type_inference.infer 4.96% : 0.003045s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.06% : 0.000052s : 4: replace.inline 31.94% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.81% : 0.000200s : 4: match.inline 5.19% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.23% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.39% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.04% : 0.000007s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.74% : 0.000010s : 58: predicate.switch_simplify 1.44% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.61% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003428 26 79.04% : 0.002709s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.45% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 19.51% : 0.000669s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.075633 72 0.07% : 0.000056s : 1: add_recomputation 0.11% : 0.000080s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.43% : 0.000322s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.95% : 0.007527s : 1: jit_opt_a 0.21% : 0.000158s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.60% : 0.000454s : 1: loop_unroll 0.91% : 0.000691s : 1: mutable_eliminate 1.33% : 0.001007s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000058s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000380s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.90% : 0.001439s : 1: renormalize.infer 1.09% : 0.000824s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000101s : 1: rewriter_before_opt_a 0.14% : 0.000105s : 1: symbol_engine_optimizer 81.30% : 0.061488s : 1: type_inference TotalTime = 0.0731891, [30] [bootstrap]: 0.00031121 [type_inference]: 0.0626486 [event_method]: 2.158e-05 [auto_monad]: 7.589e-05 [graph_reusing]: 6.36998e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 0.00032793 [rewriter_before_opt_a]: 9.684e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00732947, [2] [Cycle 1]: 0.00360388, [27] [switch_simplify]: 6.177e-05 [loop_unroll]: 3.441e-05 [a_1]: 0.00068018 [with_stream_mark]: 1.878e-05 [recompute_prepare]: 9.28002e-06 [updatestate_depend_eliminate]: 4.75999e-06 [updatestate_assign_eliminate]: 3.50003e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 7.88001e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 8.07e-06 [meta_shard_fg_expand]: 2.87002e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.63999e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 0.00010588 [j_node_and_user_rematch]: 1.17e-05 [meta_fg_expand]: 3.17002e-06 [replace_old_param]: 1e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00227536 [add_forward_monad_depend]: 7.11001e-06 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 1.532e-05 [cse]: 3.743e-05 [replace_applicator]: 1.881e-05 [Cycle 2]: 0.00037323, [27] [switch_simplify]: 7.14001e-06 [loop_unroll]: 5.79e-06 [a_1]: 0.00012248 [with_stream_mark]: 1.135e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 2.48998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.48999e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.474e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.308e-05 [rewriter_after_opt_a]: 3.835e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00061506 [jit_opt_b]: 5.61e-05, [1] [Cycle 1]: 4.821e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.828e-05 [cconv]: 2.432e-05 [loop_unroll]: 0.00051153 [jit_opt_after_cconv]: 0.00015835, [1] [Cycle 1]: 0.0001511, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 7.15e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.524e-05 [call_graph_tuple_transform]: 2.216e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.74e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 8.49998e-06 [add_recomputation]: 4.996e-05 [cse_after_recomputation]: 2.439e-05, [1] [Cycle 1]: 1.907e-05, [1] [cse]: 1.368e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00045773 [symbol_engine_optimizer]: 7.449e-05, [1] [Cycle 1]: 6.736e-05, [6] [build]: 3.11001e-06 [elim_shapecalc]: 8.20999e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 6.47001e-06 [fold_const_symbol]: 9.37999e-06 [renormalize]: 3.19997e-07 [validate]: 9.19e-05 Sums bootstrap : 0.000311s : 0.45% type_inference : 0.062649s : 90.57% event_method : 0.000022s : 0.03% auto_monad : 0.000076s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000328s : 0.47% rewriter_before_opt_a : 0.000097s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.10% jit_opt_a.loop_unroll : 0.000040s : 0.06% jit_opt_a.a_1 : 0.000803s : 1.16% jit_opt_a.with_stream_mark : 0.000030s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000121s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002275s : 3.29% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000615s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000512s : 0.74% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000458s : 0.66% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000092s : 0.13% Time group info: ------[substitution.] 0.000245 25 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.66% : 0.000007s : 4: substitution.graph_param_transform 84.93% : 0.000208s : 5: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000006s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.52% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062565 2 96.23% : 0.060209s : 1: type_inference.infer 3.77% : 0.002356s : 1: type_inference.specialize ------[replace.] 0.000104 7 69.03% : 0.000072s : 5: replace.inline 30.97% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 94.32% : 0.000205s : 5: match.inline 5.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 888 1.52% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 1.85% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.20% : 0.000007s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 1.57% : 0.000002s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 65: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.99% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002649 29 71.41% : 0.001892s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.26% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.33% : 0.000697s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076539 72 0.07% : 0.000053s : 1: add_recomputation 0.10% : 0.000079s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.43% : 0.000329s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.58% : 0.007333s : 1: jit_opt_a 0.21% : 0.000161s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.68% : 0.000519s : 1: loop_unroll 0.81% : 0.000624s : 1: mutable_eliminate 1.38% : 0.001060s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.44% : 0.000333s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.02% : 0.001545s : 1: renormalize.infer 0.94% : 0.000721s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000102s : 1: rewriter_before_opt_a 0.10% : 0.000077s : 1: symbol_engine_optimizer 81.88% : 0.062667s : 1: type_inference TotalTime = 0.0678268, [30] [bootstrap]: 0.00041232 [type_inference]: 0.0573646 [event_method]: 2.188e-05 [auto_monad]: 7.21e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.68003e-06 [py_interpret_to_execute]: 0.00032114 [rewriter_before_opt_a]: 8.749e-05 [expand_dump_flag]: 4.00998e-06 [jit_opt_a]: 0.00720284, [2] [Cycle 1]: 0.00324962, [27] [switch_simplify]: 5.938e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.0006134 [with_stream_mark]: 1.856e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.78001e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 7.17002e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.21003e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.613e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00217011 [add_forward_monad_depend]: 6.21e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.689e-05 [cse]: 3.235e-05 [replace_applicator]: 1.628e-05 [Cycle 2]: 0.00037638, [27] [switch_simplify]: 6.98998e-06 [loop_unroll]: 6.10002e-06 [a_1]: 0.00012811 [with_stream_mark]: 1.035e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 8.83001e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.66998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.46002e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.167e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 3.809e-05 [convert_after_rewriter]: 7.68001e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00062426 [jit_opt_b]: 5.643e-05, [1] [Cycle 1]: 4.938e-05, [2] [frontend_op_eliminate]: 1.979e-05 [inline_after_opt_a]: 1.811e-05 [cconv]: 2.572e-05 [loop_unroll]: 0.00045725 [jit_opt_after_cconv]: 0.00015644, [1] [Cycle 1]: 0.00014971, [11] [c_1]: 2.726e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.343e-05 [call_graph_tuple_transform]: 2.132e-05 [tuple_list_get_item_eliminator]: 7.36001e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.13998e-06 [remove_dup_value]: 1.793e-05 [partial_unused_args_eliminate]: 2.56998e-06 [environ_conv]: 8.51002e-06 [add_recomputation]: 5.001e-05 [cse_after_recomputation]: 2.268e-05, [1] [Cycle 1]: 1.756e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.678e-05 [get_jit_bprop_graph]: 2.06998e-06 [rewriter_after_jit_bprop_graph]: 5.12e-06 [opt_after_jit_grad]: 0.00048433 [symbol_engine_optimizer]: 0.00010051, [1] [Cycle 1]: 9.401e-05, [6] [build]: 3.90998e-06 [elim_shapecalc]: 9.29e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 6.58e-06 [fold_const_symbol]: 2.998e-05 [renormalize]: 6.60017e-07 [validate]: 4.755e-05 Sums bootstrap : 0.000412s : 0.65% type_inference : 0.057365s : 90.13% event_method : 0.000022s : 0.03% auto_monad : 0.000072s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000321s : 0.50% rewriter_before_opt_a : 0.000087s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000742s : 1.17% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002170s : 3.41% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000044s : 0.07% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000624s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000457s : 0.72% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000484s : 0.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000030s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.07% Time group info: ------[substitution.] 0.000243 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 8.21% : 0.000020s : 2: substitution.fold_const_symbol 2.69% : 0.000007s : 4: substitution.graph_param_transform 77.75% : 0.000189s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 5.28% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057281 2 96.37% : 0.055204s : 1: type_inference.infer 3.63% : 0.002078s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.82% : 0.000053s : 4: replace.inline 32.18% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.16% : 0.000186s : 4: match.inline 5.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.75% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.64% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002459 26 71.78% : 0.001765s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.69% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.54% : 0.000653s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071065 72 0.07% : 0.000053s : 1: add_recomputation 0.11% : 0.000076s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.61% : 0.000431s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.14% : 0.007207s : 1: jit_opt_a 0.22% : 0.000160s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.65% : 0.000465s : 1: loop_unroll 0.89% : 0.000633s : 1: mutable_eliminate 1.38% : 0.000982s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000056s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000493s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.46% : 0.000327s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.03% : 0.001444s : 1: renormalize.infer 1.01% : 0.000716s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000093s : 1: rewriter_before_opt_a 0.15% : 0.000104s : 1: symbol_engine_optimizer 80.75% : 0.057382s : 1: type_inference TotalTime = 0.126599, [30] [bootstrap]: 0.00031695 [type_inference]: 0.115544 [event_method]: 2.16e-05 [auto_monad]: 7.577e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 0.00051666 [rewriter_before_opt_a]: 0.00010062 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.00774471, [2] [Cycle 1]: 0.00402349, [27] [switch_simplify]: 6.244e-05 [loop_unroll]: 3.453e-05 [a_1]: 0.00069313 [with_stream_mark]: 1.914e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.75e-06 [updatestate_loads_eliminate]: 3.59002e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 8.1e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 6.87002e-06 [meta_shard_fg_expand]: 3.14999e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.545e-05 [j_node_and_user_rematch]: 1.052e-05 [meta_fg_expand]: 3.25e-06 [replace_old_param]: 1.048e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.00284791 [add_forward_monad_depend]: 7.41999e-06 [auto_monad_grad]: 3.18e-06 [auto_monad_eliminator]: 1.787e-05 [cse]: 3.68e-05 [replace_applicator]: 1.298e-05 [Cycle 2]: 0.00039208, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.23e-06 [a_1]: 0.00013438 [with_stream_mark]: 1.429e-05 [recompute_prepare]: 6.51e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.81999e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.11e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.421e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 8.82999e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.478e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.42e-05 [rewriter_after_opt_a]: 3.827e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00058374 [jit_opt_b]: 5.497e-05, [1] [Cycle 1]: 4.809e-05, [2] [frontend_op_eliminate]: 1.959e-05 [inline_after_opt_a]: 1.806e-05 [cconv]: 2.657e-05 [loop_unroll]: 0.00043196 [jit_opt_after_cconv]: 0.00015611, [1] [Cycle 1]: 0.00014931, [11] [c_1]: 2.621e-05 [parameter_eliminate]: 2.48998e-06 [updatestate_depend_eliminate]: 5.86003e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.367e-05 [call_graph_tuple_transform]: 2.22e-05 [tuple_list_get_item_eliminator]: 6.33e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 6.76e-06 [remove_dup_value]: 1.765e-05 [partial_unused_args_eliminate]: 2.88e-06 [environ_conv]: 8.94998e-06 [add_recomputation]: 5.066e-05 [cse_after_recomputation]: 2.402e-05, [1] [Cycle 1]: 1.865e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.759e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00047307 [symbol_engine_optimizer]: 7.539e-05, [1] [Cycle 1]: 6.925e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 9.49e-06 [renormalize]: 5.50004e-07 [validate]: 8.567e-05 Sums bootstrap : 0.000317s : 0.26% type_inference : 0.115544s : 94.19% event_method : 0.000022s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000517s : 0.42% rewriter_before_opt_a : 0.000101s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000828s : 0.67% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002848s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000584s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000432s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000473s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000086s : 0.07% Time group info: ------[substitution.] 0.000257 28 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 4: substitution.graph_param_transform 82.04% : 0.000211s : 5: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.03% : 0.000013s : 3: substitution.reduce_eliminate 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 4.29% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115466 2 97.53% : 0.112615s : 1: type_inference.infer 2.47% : 0.002852s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.76% : 0.000068s : 5: replace.inline 32.24% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.48% : 0.000208s : 5: match.inline 4.52% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.72% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.57% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.40% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.02% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.24% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.20% : 0.000002s : 13: predicate.minmaximum_grad 1.32% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000002s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.02% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002553 25 64.58% : 0.001649s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.40% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.02% : 0.000843s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130540 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000339s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.94% : 0.007748s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.34% : 0.000440s : 1: loop_unroll 0.45% : 0.000591s : 1: mutable_eliminate 0.82% : 0.001073s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000524s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.49% : 0.001950s : 1: renormalize.infer 0.68% : 0.000887s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000106s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.52% : 0.115559s : 1: type_inference TotalTime = 0.0166387, [30] [bootstrap]: 0.00028632 [type_inference]: 0.00844478 [event_method]: 2.049e-05 [auto_monad]: 6.721e-05 [graph_reusing]: 6.06998e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 4.982e-05 [rewriter_before_opt_a]: 7.94e-05 [expand_dump_flag]: 2.95998e-06 [jit_opt_a]: 0.00559249, [2] [Cycle 1]: 0.00186965, [27] [switch_simplify]: 5.886e-05 [loop_unroll]: 3.219e-05 [a_1]: 0.0006302 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 7.86001e-06 [inline_without_move]: 5.63997e-06 [renormalize]: 0.00084077 [add_forward_monad_depend]: 4.39002e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 1.121e-05 [cse]: 2.212e-05 [replace_applicator]: 1.057e-05 [Cycle 2]: 0.0003272, [27] [switch_simplify]: 6.13002e-06 [loop_unroll]: 4.99e-06 [a_1]: 9.067e-05 [with_stream_mark]: 1.052e-05 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.283e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.392e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.1e-05 [rewriter_after_opt_a]: 3.351e-05 [convert_after_rewriter]: 5.89999e-06 [order_py_execute_after_rewriter]: 4.63001e-06 [mutable_eliminate]: 0.0004955 [jit_opt_b]: 5.057e-05, [1] [Cycle 1]: 4.461e-05, [2] [frontend_op_eliminate]: 1.704e-05 [inline_after_opt_a]: 1.616e-05 [cconv]: 1.908e-05 [loop_unroll]: 0.00041422 [jit_opt_after_cconv]: 0.0001459, [1] [Cycle 1]: 0.00014047, [11] [c_1]: 2.122e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.7e-05 [call_graph_tuple_transform]: 1.731e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.26002e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 3.488e-05 [partial_unused_args_eliminate]: 1.87999e-06 [environ_conv]: 3.85e-06 [add_recomputation]: 3.431e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.862e-05, [1] [cse]: 1.273e-05 [auto_monad_reorder]: 1.117e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 1.51e-05 [opt_after_jit_grad]: 0.00052232 [symbol_engine_optimizer]: 7.707e-05, [1] [Cycle 1]: 7.051e-05, [6] [build]: 2.22999e-06 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.46e-05 [opt_reshape]: 6.64001e-06 [fold_const_symbol]: 8.65001e-06 [renormalize]: 6.00005e-07 [validate]: 3.385e-05 Sums bootstrap : 0.000286s : 2.25% type_inference : 0.008445s : 66.48% event_method : 0.000020s : 0.16% auto_monad : 0.000067s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.39% rewriter_before_opt_a : 0.000079s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.51% jit_opt_a.loop_unroll : 0.000037s : 0.29% jit_opt_a.a_1 : 0.000721s : 5.68% jit_opt_a.with_stream_mark : 0.000023s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000841s : 6.62% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.04% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.14% jit_opt_a.cse : 0.000036s : 0.28% jit_opt_a.replace_applicator : 0.000016s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000034s : 0.26% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000496s : 3.90% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000019s : 0.15% loop_unroll : 0.000414s : 3.26% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000035s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000004s : 0.03% add_recomputation : 0.000034s : 0.27% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000011s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000015s : 0.12% opt_after_jit_grad : 0.000522s : 4.11% symbol_engine_optimizer.build : 0.000002s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000034s : 0.27% Time group info: ------[substitution.] 0.000235 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000005s : 3: substitution.graph_param_transform 87.70% : 0.000206s : 5: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 1.06% : 0.000003s : 2: substitution.replace_old_param 4.30% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008378 2 86.70% : 0.007264s : 1: type_inference.infer 13.30% : 0.001115s : 1: type_inference.specialize ------[replace.] 0.000098 7 68.01% : 0.000067s : 5: replace.inline 31.99% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 7 95.77% : 0.000204s : 5: match.inline 4.23% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.44% : 0.000002s : 11: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000002s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.21% : 0.000001s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 11: predicate.environ_get_depend_swap 1.23% : 0.000001s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 16: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.24% : 0.000001s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000001s : 11: predicate.print_const_string_wrapper 1.58% : 0.000002s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 11: predicate.reshape_eliminate 1.35% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 11: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.86% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.84% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.71% : 0.000009s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.30% : 0.000002s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.46% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000814 16 47.58% : 0.000387s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.65% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.78% : 0.000365s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018486 72 0.20% : 0.000037s : 1: add_recomputation 0.38% : 0.000070s : 1: auto_monad 0.07% : 0.000014s : 1: auto_monad_reorder 1.61% : 0.000297s : 1: bootstrap 0.12% : 0.000022s : 1: cconv 0.04% : 0.000008s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000006s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.27% : 0.005595s : 1: jit_opt_a 0.80% : 0.000148s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.27% : 0.000420s : 1: loop_unroll 2.71% : 0.000502s : 1: mutable_eliminate 5.07% : 0.000938s : 26: opt.transform.jit_opt_a 0.25% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000012s : 1: opt.transform.mutable_eliminate 0.13% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.88% : 0.000532s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000053s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000038s : 1: remove_dup_value 2.54% : 0.000469s : 1: renormalize.infer 1.97% : 0.000365s : 1: renormalize.specialize 0.10% : 0.000018s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000036s : 1: rewriter_after_opt_a 0.44% : 0.000082s : 1: rewriter_before_opt_a 0.43% : 0.000080s : 1: symbol_engine_optimizer 45.73% : 0.008453s : 1: type_inference TotalTime = 0.13918, [30] [bootstrap]: 0.00045413 [type_inference]: 0.126847 [event_method]: 2.32e-05 [auto_monad]: 7.697e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.42001e-06 [py_interpret_to_execute]: 0.00057054 [rewriter_before_opt_a]: 9.381e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00859975, [2] [Cycle 1]: 0.00421654, [27] [switch_simplify]: 6.656e-05 [loop_unroll]: 3.434e-05 [a_1]: 0.00075204 [with_stream_mark]: 2.287e-05 [recompute_prepare]: 1.065e-05 [updatestate_depend_eliminate]: 4.94998e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 1.077e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.064e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00294373 [add_forward_monad_depend]: 9.19e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 2.04e-05 [cse]: 3.544e-05 [replace_applicator]: 2.324e-05 [Cycle 2]: 0.00046122, [27] [switch_simplify]: 7.02002e-06 [loop_unroll]: 6.06998e-06 [a_1]: 0.00019697 [with_stream_mark]: 1.225e-05 [recompute_prepare]: 6.54001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 3.32002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.378e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 9.74999e-06 [inline_without_move]: 5.76003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.76e-06 [cse]: 1.521e-05 [replace_applicator]: 6.58e-06 [py_interpret_to_execute_after_opt_a]: 1.651e-05 [rewriter_after_opt_a]: 3.85e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 5.41998e-06 [mutable_eliminate]: 0.00082319 [jit_opt_b]: 5.761e-05, [1] [Cycle 1]: 4.893e-05, [2] [frontend_op_eliminate]: 1.945e-05 [inline_after_opt_a]: 1.793e-05 [cconv]: 3.047e-05 [loop_unroll]: 0.00043903 [jit_opt_after_cconv]: 0.00015306, [1] [Cycle 1]: 0.00014681, [11] [c_1]: 2.725e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.137e-05 [call_graph_tuple_transform]: 2.033e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.525e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 8.53001e-06 [add_recomputation]: 5.045e-05 [cse_after_recomputation]: 2.493e-05, [1] [Cycle 1]: 1.903e-05, [1] [cse]: 1.262e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.00046579 [symbol_engine_optimizer]: 7.675e-05, [1] [Cycle 1]: 7.062e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 9.49e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.79999e-06 [renormalize]: 4.7998e-07 [validate]: 4.678e-05 Sums bootstrap : 0.000454s : 0.34% type_inference : 0.126847s : 94.24% event_method : 0.000023s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000571s : 0.42% rewriter_before_opt_a : 0.000094s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000949s : 0.71% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002944s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000823s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000439s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000466s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.03% Time group info: ------[substitution.] 0.000311 28 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 4: substitution.graph_param_transform 83.51% : 0.000260s : 5: substitution.inline 1.46% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.65% : 0.000014s : 3: substitution.reduce_eliminate 1.49% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_old_param 3.83% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126767 2 97.82% : 0.123999s : 1: type_inference.infer 2.18% : 0.002768s : 1: type_inference.specialize ------[replace.] 0.000101 7 68.87% : 0.000069s : 5: replace.inline 31.13% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 7 96.00% : 0.000256s : 5: match.inline 4.00% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.30% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.56% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.00% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 1.44% : 0.000002s : 13: predicate.print_const_string_wrapper 2.49% : 0.000004s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.65% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.34% : 0.000011s : 64: predicate.switch_simplify 1.17% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002475 25 64.51% : 0.001596s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.41% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.09% : 0.000794s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.143380 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.33% : 0.000476s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.00% : 0.008604s : 1: jit_opt_a 0.11% : 0.000156s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.31% : 0.000447s : 1: loop_unroll 0.58% : 0.000832s : 1: mutable_eliminate 0.84% : 0.001210s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000581s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.45% : 0.002072s : 1: renormalize.infer 0.60% : 0.000860s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000099s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.48% : 0.126869s : 1: type_inference TotalTime = 0.020729, [30] [bootstrap]: 0.00031188 [type_inference]: 0.00762976 [event_method]: 2.152e-05 [auto_monad]: 7.028e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 4.806e-05 [rewriter_before_opt_a]: 8.332e-05 [expand_dump_flag]: 3.37002e-06 [jit_opt_a]: 0.0103925, [2] [Cycle 1]: 0.00197719, [27] [switch_simplify]: 6.542e-05 [loop_unroll]: 3.335e-05 [a_1]: 0.00067146 [with_stream_mark]: 2.065e-05 [recompute_prepare]: 7.53999e-06 [updatestate_depend_eliminate]: 4.58999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.55e-06 [parameter_eliminate]: 2.13998e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.79e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.49e-06 [renormalize]: 0.00078657 [add_forward_monad_depend]: 5.20001e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.533e-05 [cse]: 3.444e-05 [replace_applicator]: 1.366e-05 [Cycle 2]: 0.00034175, [27] [switch_simplify]: 6.03002e-06 [loop_unroll]: 4.92999e-06 [a_1]: 9.894e-05 [with_stream_mark]: 9.18002e-06 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.38002e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 2.78998e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.144e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.51001e-06 [inline_without_move]: 4.72998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.71998e-06 [cse]: 1.284e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.207e-05 [rewriter_after_opt_a]: 3.849e-05 [convert_after_rewriter]: 7.44002e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00054619 [jit_opt_b]: 5.116e-05, [1] [Cycle 1]: 4.342e-05, [2] [frontend_op_eliminate]: 1.61e-05 [inline_after_opt_a]: 1.592e-05 [cconv]: 2.579e-05 [loop_unroll]: 0.00042819 [jit_opt_after_cconv]: 0.00014952, [1] [Cycle 1]: 0.00014311, [11] [c_1]: 2.259e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 2.216e-05 [call_graph_tuple_transform]: 1.923e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.48002e-06 [remove_dup_value]: 1.588e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 7.06999e-06 [add_recomputation]: 4.993e-05 [cse_after_recomputation]: 2.41e-05, [1] [Cycle 1]: 1.874e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.8e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 4.57e-06 [opt_after_jit_grad]: 0.00047122 [symbol_engine_optimizer]: 7.581e-05, [1] [Cycle 1]: 6.947e-05, [6] [build]: 3.72998e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 5.80002e-06 [fold_const_symbol]: 8.78001e-06 [renormalize]: 4.69998e-07 [validate]: 3.936e-05 Sums bootstrap : 0.000312s : 2.60% type_inference : 0.007630s : 63.65% event_method : 0.000022s : 0.18% auto_monad : 0.000070s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000048s : 0.40% rewriter_before_opt_a : 0.000083s : 0.70% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000071s : 0.60% jit_opt_a.loop_unroll : 0.000038s : 0.32% jit_opt_a.a_1 : 0.000770s : 6.43% jit_opt_a.with_stream_mark : 0.000030s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000787s : 6.56% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.18% jit_opt_a.cse : 0.000047s : 0.39% jit_opt_a.replace_applicator : 0.000019s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000038s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000546s : 4.56% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.22% loop_unroll : 0.000428s : 3.57% jit_opt_after_cconv.c_1 : 0.000023s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000050s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000471s : 3.93% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.33% Time group info: ------[substitution.] 0.000277 27 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 84.92% : 0.000235s : 5: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.56% : 0.000010s : 3: substitution.reduce_eliminate 1.68% : 0.000005s : 4: substitution.remove_not_recompute_node 1.42% : 0.000004s : 2: substitution.replace_old_param 3.85% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007558 2 87.01% : 0.006576s : 1: type_inference.infer 12.99% : 0.000982s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.51% : 0.000067s : 5: replace.inline 31.49% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 96.03% : 0.000232s : 5: match.inline 3.97% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.73% : 0.000002s : 11: predicate.addn_zero_filter 1.93% : 0.000002s : 11: predicate.arithmetic_simplify 1.32% : 0.000002s : 11: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.18% : 0.000001s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.33% : 0.000002s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 16: predicate.load_eliminater 1.21% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.32% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000001s : 11: predicate.print_const_string_wrapper 2.05% : 0.000003s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 11: predicate.reshape_eliminate 1.20% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.41% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.94% : 0.000010s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.60% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000794 16 48.95% : 0.000389s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.87% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.18% : 0.000327s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022555 72 0.23% : 0.000053s : 1: add_recomputation 0.33% : 0.000074s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.46% : 0.000330s : 1: bootstrap 0.13% : 0.000029s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.11% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 46.09% : 0.010396s : 1: jit_opt_a 0.67% : 0.000152s : 1: jit_opt_after_cconv 0.24% : 0.000054s : 1: jit_opt_b 1.93% : 0.000436s : 1: loop_unroll 2.46% : 0.000555s : 1: mutable_eliminate 4.42% : 0.000996s : 26: opt.transform.jit_opt_a 0.22% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000013s : 1: opt.transform.mutable_eliminate 0.10% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.12% : 0.000479s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000051s : 1: py_interpret_to_execute 0.06% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000018s : 1: remove_dup_value 1.90% : 0.000430s : 1: renormalize.infer 1.55% : 0.000350s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000042s : 1: rewriter_after_opt_a 0.38% : 0.000086s : 1: rewriter_before_opt_a 0.35% : 0.000078s : 1: symbol_engine_optimizer 33.89% : 0.007645s : 1: type_inference TotalTime = 0.0672484, [30] [bootstrap]: 0.00033565 [type_inference]: 0.057111 [event_method]: 1.855e-05 [auto_monad]: 7.217e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00032687 [rewriter_before_opt_a]: 8.753e-05 [expand_dump_flag]: 4.28999e-06 [jit_opt_a]: 0.00697032, [2] [Cycle 1]: 0.00312864, [27] [switch_simplify]: 5.686e-05 [loop_unroll]: 3.104e-05 [a_1]: 0.00061054 [with_stream_mark]: 1.707e-05 [recompute_prepare]: 9.00001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.51999e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.39998e-06 [inline_without_move]: 6.26e-06 [renormalize]: 0.0020641 [add_forward_monad_depend]: 5.61e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.565e-05 [cse]: 3.258e-05 [replace_applicator]: 1.534e-05 [Cycle 2]: 0.00037223, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.0001274 [with_stream_mark]: 1.01e-05 [recompute_prepare]: 6.27001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 8.87999e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 9.18002e-06 [inline_without_move]: 5.54e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.278e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.138e-05 [rewriter_after_opt_a]: 3.635e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00059947 [jit_opt_b]: 5.86e-05, [1] [Cycle 1]: 5.09e-05, [2] [frontend_op_eliminate]: 1.956e-05 [inline_after_opt_a]: 1.913e-05 [cconv]: 2.662e-05 [loop_unroll]: 0.00048164 [jit_opt_after_cconv]: 0.00015862, [1] [Cycle 1]: 0.00015231, [11] [c_1]: 2.724e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.44998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 2.506e-05 [call_graph_tuple_transform]: 2.223e-05 [tuple_list_get_item_eliminator]: 6.76e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.585e-05 [partial_unused_args_eliminate]: 2.73003e-06 [environ_conv]: 8.68001e-06 [add_recomputation]: 4.986e-05 [cse_after_recomputation]: 2.297e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.166e-05 [auto_monad_reorder]: 1.665e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 5.10001e-06 [opt_after_jit_grad]: 0.00049697 [symbol_engine_optimizer]: 8.19e-05, [1] [Cycle 1]: 7.489e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 8.64003e-06 [elim_not_effective]: 1.493e-05 [opt_reshape]: 7.78001e-06 [fold_const_symbol]: 1.022e-05 [renormalize]: 2.20025e-07 [validate]: 4.486e-05 Sums bootstrap : 0.000336s : 0.53% type_inference : 0.057111s : 90.39% event_method : 0.000019s : 0.03% auto_monad : 0.000072s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000327s : 0.52% rewriter_before_opt_a : 0.000088s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000738s : 1.17% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002064s : 3.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000045s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000599s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000482s : 0.76% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000497s : 0.79% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.07% Time group info: ------[substitution.] 0.000219 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 3.04% : 0.000007s : 4: substitution.graph_param_transform 82.56% : 0.000181s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 6.88% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057033 2 96.42% : 0.054990s : 1: type_inference.infer 3.58% : 0.002043s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.38% : 0.000054s : 4: replace.inline 31.62% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 92.78% : 0.000178s : 4: match.inline 7.22% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 2.21% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.38% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.14% : 0.000010s : 58: predicate.switch_simplify 1.44% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.55% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.95% : 0.000003s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002364 26 71.17% : 0.001682s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.35% : 0.000647s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070362 72 0.07% : 0.000053s : 1: add_recomputation 0.11% : 0.000075s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.50% : 0.000355s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.91% : 0.006974s : 1: jit_opt_a 0.23% : 0.000161s : 1: jit_opt_after_cconv 0.09% : 0.000061s : 1: jit_opt_b 0.70% : 0.000490s : 1: loop_unroll 0.87% : 0.000610s : 1: mutable_eliminate 1.39% : 0.000975s : 26: opt.transform.jit_opt_a 0.08% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000505s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000335s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.92% : 0.001352s : 1: renormalize.infer 1.00% : 0.000702s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000092s : 1: rewriter_before_opt_a 0.12% : 0.000085s : 1: symbol_engine_optimizer 81.19% : 0.057124s : 1: type_inference TotalTime = 0.0139872, [30] [bootstrap]: 0.00035774 [type_inference]: 0.00513374 [event_method]: 2.104e-05 [auto_monad]: 7.221e-05 [graph_reusing]: 7.43e-06 [pre_auto_parallel]: 3.07002e-06 [py_interpret_to_execute]: 4.796e-05 [rewriter_before_opt_a]: 7.847e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00589572, [2] [Cycle 1]: 0.00186849, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 3.04e-05 [a_1]: 0.00057751 [with_stream_mark]: 2.269e-05 [recompute_prepare]: 8.46002e-06 [updatestate_depend_eliminate]: 4.48999e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.51999e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 4.37998e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00082086 [add_forward_monad_depend]: 6.38e-06 [auto_monad_grad]: 2.17001e-06 [auto_monad_eliminator]: 1.665e-05 [cse]: 2.966e-05 [replace_applicator]: 1.384e-05 [Cycle 2]: 0.00034053, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.29e-06 [a_1]: 9.674e-05 [with_stream_mark]: 9.35001e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 8.40999e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.191e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 1.181e-05 [rewriter_after_opt_a]: 3.692e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.26002e-06 [mutable_eliminate]: 0.00061031 [jit_opt_b]: 5.193e-05, [1] [Cycle 1]: 4.494e-05, [2] [frontend_op_eliminate]: 1.718e-05 [inline_after_opt_a]: 1.544e-05 [cconv]: 2.525e-05 [loop_unroll]: 0.00049377 [jit_opt_after_cconv]: 0.00015331, [1] [Cycle 1]: 0.00014621, [11] [c_1]: 2.44e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.073e-05 [call_graph_tuple_transform]: 1.963e-05 [tuple_list_get_item_eliminator]: 6.40002e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.39998e-06 [remove_dup_value]: 1.576e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 5.74e-06 [add_recomputation]: 6.609e-05 [cse_after_recomputation]: 2.415e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.15e-05 [auto_monad_reorder]: 1.665e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 6.02999e-06 [opt_after_jit_grad]: 0.00051093 [symbol_engine_optimizer]: 8.848e-05, [1] [Cycle 1]: 8.098e-05, [6] [build]: 4.48999e-06 [elim_shapecalc]: 9.91998e-06 [elim_not_effective]: 1.559e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 1.071e-05 [renormalize]: 4.40021e-07 [validate]: 4.133e-05 Sums bootstrap : 0.000358s : 3.70% type_inference : 0.005134s : 53.14% event_method : 0.000021s : 0.22% auto_monad : 0.000072s : 0.75% graph_reusing : 0.000007s : 0.08% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000048s : 0.50% rewriter_before_opt_a : 0.000078s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.68% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000674s : 6.98% jit_opt_a.with_stream_mark : 0.000032s : 0.33% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000821s : 8.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.23% jit_opt_a.cse : 0.000042s : 0.43% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000037s : 0.38% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000610s : 6.32% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000025s : 0.26% loop_unroll : 0.000494s : 5.11% jit_opt_after_cconv.c_1 : 0.000024s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000066s : 0.68% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000017s : 0.17% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000511s : 5.29% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.43% Time group info: ------[substitution.] 0.000233 23 1.18% : 0.000003s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.46% : 0.000006s : 3: substitution.graph_param_transform 83.83% : 0.000195s : 4: substitution.inline 1.79% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.63% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005059 2 81.05% : 0.004101s : 1: type_inference.infer 18.95% : 0.000959s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.05% : 0.000049s : 4: replace.inline 33.95% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.14% : 0.000193s : 4: match.inline 5.86% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.63% : 0.000002s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.23% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.21% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.13% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.76% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.99% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.43% : 0.000002s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.61% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.93% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000697 13 49.91% : 0.000348s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.85% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.24% : 0.000301s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015767 72 0.44% : 0.000070s : 1: add_recomputation 0.48% : 0.000076s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.41% : 0.000380s : 1: bootstrap 0.18% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.17% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000010s : 1: graph_reusing 37.42% : 0.005900s : 1: jit_opt_a 0.99% : 0.000157s : 1: jit_opt_after_cconv 0.34% : 0.000054s : 1: jit_opt_b 3.19% : 0.000503s : 1: loop_unroll 3.93% : 0.000619s : 1: mutable_eliminate 5.69% : 0.000898s : 26: opt.transform.jit_opt_a 0.33% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000039s : 4: opt.transform.symbol_engine_opt 3.30% : 0.000521s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000051s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.80% : 0.000441s : 1: renormalize.infer 2.35% : 0.000371s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000040s : 1: rewriter_after_opt_a 0.52% : 0.000081s : 1: rewriter_before_opt_a 0.58% : 0.000092s : 1: symbol_engine_optimizer 32.66% : 0.005149s : 1: type_inference TotalTime = 0.125534, [30] [bootstrap]: 0.00031425 [type_inference]: 0.114619 [event_method]: 2.175e-05 [auto_monad]: 7.244e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00046126 [rewriter_before_opt_a]: 9.439e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00763931, [2] [Cycle 1]: 0.00387955, [27] [switch_simplify]: 6.027e-05 [loop_unroll]: 3.399e-05 [a_1]: 0.00068178 [with_stream_mark]: 1.78e-05 [recompute_prepare]: 8.74e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.86003e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 9.99999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.80002e-06 [inline_without_move]: 6.33e-06 [renormalize]: 0.00273714 [add_forward_monad_depend]: 6.21e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 3.378e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.00038792, [27] [switch_simplify]: 7.02002e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.0001309 [with_stream_mark]: 1.186e-05 [recompute_prepare]: 6.64999e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 6.49999e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 2.11e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.267e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 6.08998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.392e-05 [replace_applicator]: 6.68e-06 [py_interpret_to_execute_after_opt_a]: 1.351e-05 [rewriter_after_opt_a]: 3.744e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.56e-06 [mutable_eliminate]: 0.00060635 [jit_opt_b]: 5.601e-05, [1] [Cycle 1]: 4.837e-05, [2] [frontend_op_eliminate]: 2.002e-05 [inline_after_opt_a]: 1.737e-05 [cconv]: 3.386e-05 [loop_unroll]: 0.00042875 [jit_opt_after_cconv]: 0.00015667, [1] [Cycle 1]: 0.00015007, [11] [c_1]: 2.595e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.265e-05 [call_graph_tuple_transform]: 2.243e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.18998e-06 [remove_dup_value]: 1.522e-05 [partial_unused_args_eliminate]: 2.60002e-06 [environ_conv]: 7.58001e-06 [add_recomputation]: 4.879e-05 [cse_after_recomputation]: 2.297e-05, [1] [Cycle 1]: 1.785e-05, [1] [cse]: 1.23e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 4.51002e-06 [opt_after_jit_grad]: 0.00046328 [symbol_engine_optimizer]: 0.00014636, [1] [Cycle 1]: 0.00013995, [6] [build]: 2.98e-06 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 8.039e-05 [opt_reshape]: 6.78998e-06 [fold_const_symbol]: 1.035e-05 [renormalize]: 4.40021e-07 [validate]: 4.211e-05 Sums bootstrap : 0.000314s : 0.26% type_inference : 0.114619s : 94.29% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000461s : 0.38% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000813s : 0.67% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002737s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000606s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000034s : 0.03% loop_unroll : 0.000429s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000463s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000080s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000326 28 20.83% : 0.000068s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.94% : 0.000006s : 4: substitution.graph_param_transform 66.81% : 0.000218s : 5: substitution.inline 1.04% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.15% : 0.000010s : 3: substitution.reduce_eliminate 1.36% : 0.000004s : 4: substitution.remove_not_recompute_node 1.23% : 0.000004s : 2: substitution.replace_old_param 3.23% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114544 2 97.47% : 0.111646s : 1: type_inference.infer 2.53% : 0.002898s : 1: type_inference.specialize ------[replace.] 0.000094 7 69.41% : 0.000065s : 5: replace.inline 30.59% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 7 95.89% : 0.000215s : 5: match.inline 4.11% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 2.12% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.32% : 0.000008s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.21% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.17% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.39% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.28% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.67% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002291 25 64.34% : 0.001474s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.00% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.65% : 0.000748s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129469 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000332s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.90% : 0.007643s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.34% : 0.000437s : 1: loop_unroll 0.48% : 0.000615s : 1: mutable_eliminate 0.82% : 0.001059s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000103s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000468s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.51% : 0.001951s : 1: renormalize.infer 0.60% : 0.000776s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000099s : 1: rewriter_before_opt_a 0.12% : 0.000149s : 1: symbol_engine_optimizer 88.54% : 0.114636s : 1: type_inference TotalTime = 0.122607, [30] [bootstrap]: 0.00028093 [type_inference]: 0.109964 [event_method]: 2.485e-05 [auto_monad]: 7.974e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00049299 [rewriter_before_opt_a]: 0.00010218 [expand_dump_flag]: 4.00998e-06 [jit_opt_a]: 0.00900716, [2] [Cycle 1]: 0.00491918, [27] [switch_simplify]: 7.005e-05 [loop_unroll]: 3.468e-05 [a_1]: 0.00074196 [with_stream_mark]: 2.399e-05 [recompute_prepare]: 8.45999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.71999e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.68998e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.583e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.052e-05 [inline_without_move]: 6.01e-06 [renormalize]: 0.00364779 [add_forward_monad_depend]: 9.35001e-06 [auto_monad_grad]: 3.26999e-06 [auto_monad_eliminator]: 1.987e-05 [cse]: 4.049e-05 [replace_applicator]: 2.365e-05 [Cycle 2]: 0.00045069, [27] [switch_simplify]: 7.37997e-06 [loop_unroll]: 6.58003e-06 [a_1]: 0.00012724 [with_stream_mark]: 1.502e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.18998e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.956e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 5.71e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.622e-05 [replace_applicator]: 7.31999e-06 [py_interpret_to_execute_after_opt_a]: 1.892e-05 [rewriter_after_opt_a]: 4.441e-05 [convert_after_rewriter]: 7.83999e-06 [order_py_execute_after_rewriter]: 5.77001e-06 [mutable_eliminate]: 0.00075775 [jit_opt_b]: 5.982e-05, [1] [Cycle 1]: 5.174e-05, [2] [frontend_op_eliminate]: 2.007e-05 [inline_after_opt_a]: 1.944e-05 [cconv]: 3.155e-05 [loop_unroll]: 0.00046338 [jit_opt_after_cconv]: 0.00017522, [1] [Cycle 1]: 0.00016773, [11] [c_1]: 2.591e-05 [parameter_eliminate]: 3.97002e-06 [updatestate_depend_eliminate]: 8.00999e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 3.351e-05 [call_graph_tuple_transform]: 2.395e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 6.31998e-06 [remove_dup_value]: 2.136e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 1.151e-05 [add_recomputation]: 5.255e-05 [cse_after_recomputation]: 2.755e-05, [1] [Cycle 1]: 2.136e-05, [1] [cse]: 1.429e-05 [auto_monad_reorder]: 1.838e-05 [get_jit_bprop_graph]: 2.51998e-06 [rewriter_after_jit_bprop_graph]: 6.33002e-06 [opt_after_jit_grad]: 0.00050765 [symbol_engine_optimizer]: 8.369e-05, [1] [Cycle 1]: 7.684e-05, [6] [build]: 4.11001e-06 [elim_shapecalc]: 8.81997e-06 [elim_not_effective]: 1.579e-05 [opt_reshape]: 8.13001e-06 [fold_const_symbol]: 1.005e-05 [renormalize]: 4.89992e-07 [validate]: 0.00013788 Sums bootstrap : 0.000281s : 0.24% type_inference : 0.109964s : 92.98% event_method : 0.000025s : 0.02% auto_monad : 0.000080s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000493s : 0.42% rewriter_before_opt_a : 0.000102s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000869s : 0.73% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003648s : 3.08% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000057s : 0.05% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000758s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000463s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000508s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000138s : 0.12% Time group info: ------[substitution.] 0.000308 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000007s : 4: substitution.graph_param_transform 87.17% : 0.000269s : 5: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000006s : 4: substitution.remove_not_recompute_node 2.11% : 0.000007s : 2: substitution.replace_old_param 4.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109869 2 97.01% : 0.106584s : 1: type_inference.infer 2.99% : 0.003285s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.19% : 0.000072s : 5: replace.inline 31.81% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000276 7 95.97% : 0.000265s : 5: match.inline 4.03% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.57% : 0.000002s : 13: predicate.addn_zero_filter 1.77% : 0.000003s : 13: predicate.arithmetic_simplify 1.15% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.67% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.04% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.67% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.97% : 0.000003s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.57% : 0.000002s : 13: predicate.reduce_eliminate 1.52% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000011s : 64: predicate.switch_simplify 1.17% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002361 25 61.83% : 0.001460s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.86% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.30% : 0.000810s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127376 72 0.04% : 0.000056s : 1: add_recomputation 0.07% : 0.000083s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000298s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.07% : 0.009011s : 1: jit_opt_a 0.14% : 0.000178s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.37% : 0.000474s : 1: loop_unroll 0.60% : 0.000768s : 1: mutable_eliminate 0.89% : 0.001138s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000501s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 2.18% : 0.002776s : 1: renormalize.infer 0.67% : 0.000858s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000108s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 86.35% : 0.109992s : 1: type_inference TotalTime = 0.0145499, [30] [bootstrap]: 0.00035929 [type_inference]: 0.00560336 [event_method]: 1.882e-05 [auto_monad]: 6.842e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 4.928e-05 [rewriter_before_opt_a]: 7.863e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00572537, [2] [Cycle 1]: 0.00200862, [27] [switch_simplify]: 5.623e-05 [loop_unroll]: 3.176e-05 [a_1]: 0.00071353 [with_stream_mark]: 1.848e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.56002e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.52999e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 8.71002e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 0.00083261 [add_forward_monad_depend]: 7.25e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.914e-05 [cse]: 3.122e-05 [replace_applicator]: 1.643e-05 [Cycle 2]: 0.00038544, [27] [switch_simplify]: 7.30998e-06 [loop_unroll]: 5.64998e-06 [a_1]: 0.00010475 [with_stream_mark]: 1.254e-05 [recompute_prepare]: 6.30002e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.62998e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.754e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 1.69995e-07 [add_forward_monad_depend]: 2.57001e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 8.77e-06 [cse]: 1.592e-05 [replace_applicator]: 7.6e-06 [py_interpret_to_execute_after_opt_a]: 1.688e-05 [rewriter_after_opt_a]: 4.323e-05 [convert_after_rewriter]: 8.97e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00068128 [jit_opt_b]: 5.875e-05, [1] [Cycle 1]: 4.894e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 1.806e-05 [cconv]: 3.127e-05 [loop_unroll]: 0.00054955 [jit_opt_after_cconv]: 0.00015988, [1] [Cycle 1]: 0.00015131, [11] [c_1]: 2.247e-05 [parameter_eliminate]: 4e-06 [updatestate_depend_eliminate]: 8.77e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.28998e-06 [cse]: 2.498e-05 [call_graph_tuple_transform]: 2.16e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.92999e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.39e-06 [remove_dup_value]: 1.815e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 7.73999e-06 [add_recomputation]: 5.609e-05 [cse_after_recomputation]: 2.55e-05, [1] [Cycle 1]: 1.841e-05, [1] [cse]: 1.188e-05 [auto_monad_reorder]: 1.761e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 6.05002e-06 [opt_after_jit_grad]: 0.00061407 [symbol_engine_optimizer]: 8.263e-05, [1] [Cycle 1]: 7.463e-05, [6] [build]: 5.40999e-06 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.444e-05 [opt_reshape]: 7.24001e-06 [fold_const_symbol]: 9.57001e-06 [renormalize]: 5.40022e-07 [validate]: 4.457e-05 Sums bootstrap : 0.000359s : 3.40% type_inference : 0.005603s : 53.01% event_method : 0.000019s : 0.18% auto_monad : 0.000068s : 0.65% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000049s : 0.47% rewriter_before_opt_a : 0.000079s : 0.74% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.60% jit_opt_a.loop_unroll : 0.000037s : 0.35% jit_opt_a.a_1 : 0.000818s : 7.74% jit_opt_a.with_stream_mark : 0.000031s : 0.29% jit_opt_a.recompute_prepare : 0.000015s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.18% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.17% jit_opt_a.inline_without_move : 0.000012s : 0.11% jit_opt_a.renormalize : 0.000833s : 7.88% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.26% jit_opt_a.cse : 0.000047s : 0.45% jit_opt_a.replace_applicator : 0.000024s : 0.23% py_interpret_to_execute_after_opt_a : 0.000017s : 0.16% rewriter_after_opt_a : 0.000043s : 0.41% convert_after_rewriter : 0.000009s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000681s : 6.44% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.17% jit_opt_b.inline_after_opt_a : 0.000018s : 0.17% cconv : 0.000031s : 0.30% loop_unroll : 0.000550s : 5.20% jit_opt_after_cconv.c_1 : 0.000022s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000018s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.07% add_recomputation : 0.000056s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000018s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000614s : 5.81% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000045s : 0.42% Time group info: ------[substitution.] 0.000341 23 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000002s : 2: substitution.fold_const_symbol 1.61% : 0.000005s : 3: substitution.graph_param_transform 89.24% : 0.000304s : 4: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.67% : 0.000006s : 4: substitution.remove_not_recompute_node 1.40% : 0.000005s : 2: substitution.replace_old_param 3.96% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005536 2 81.00% : 0.004485s : 1: type_inference.infer 19.00% : 0.001052s : 1: type_inference.specialize ------[replace.] 0.000082 6 68.80% : 0.000056s : 4: replace.inline 31.20% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000313 6 96.12% : 0.000301s : 4: match.inline 3.88% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.36% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 2.01% : 0.000003s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000002s : 10: predicate.compare_switch_simplify 1.55% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 4.95% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 15: predicate.load_eliminater 2.09% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000002s : 10: predicate.minmaximum_grad 2.37% : 0.000003s : 3: predicate.mutable_eliminate 0.71% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000002s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.33% : 0.000010s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000762 13 51.93% : 0.000395s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.37% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.70% : 0.000325s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016503 72 0.37% : 0.000060s : 1: add_recomputation 0.43% : 0.000072s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 2.31% : 0.000381s : 1: bootstrap 0.21% : 0.000035s : 1: cconv 0.07% : 0.000012s : 1: convert_after_rewriter 0.17% : 0.000028s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 34.71% : 0.005728s : 1: jit_opt_a 0.99% : 0.000163s : 1: jit_opt_after_cconv 0.38% : 0.000062s : 1: jit_opt_b 3.40% : 0.000561s : 1: loop_unroll 4.21% : 0.000695s : 1: mutable_eliminate 6.38% : 0.001052s : 26: opt.transform.jit_opt_a 0.31% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000029s : 4: opt.transform.jit_opt_b 0.12% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000020s : 1: opt.transform.mutable_eliminate 0.16% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.80% : 0.000628s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000052s : 1: py_interpret_to_execute 0.13% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000021s : 1: remove_dup_value 2.52% : 0.000416s : 1: renormalize.infer 2.46% : 0.000406s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000048s : 1: rewriter_after_opt_a 0.49% : 0.000082s : 1: rewriter_before_opt_a 0.52% : 0.000085s : 1: symbol_engine_optimizer 34.05% : 0.005619s : 1: type_inference TotalTime = 0.0173003, [30] [bootstrap]: 0.00032764 [type_inference]: 0.00952697 [event_method]: 2.084e-05 [auto_monad]: 6.718e-05 [graph_reusing]: 5.22e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 4.468e-05 [rewriter_before_opt_a]: 8.148e-05 [expand_dump_flag]: 2.78e-06 [jit_opt_a]: 0.00517549, [2] [Cycle 1]: 0.00172976, [27] [switch_simplify]: 5.675e-05 [loop_unroll]: 3.324e-05 [a_1]: 0.00061664 [with_stream_mark]: 1.588e-05 [recompute_prepare]: 7.87998e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 6.84001e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.98002e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00067747 [add_forward_monad_depend]: 5.64e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.59e-05 [cse]: 3.405e-05 [replace_applicator]: 1.283e-05 [Cycle 2]: 0.00032605, [27] [switch_simplify]: 5.76998e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.883e-05 [with_stream_mark]: 8.72998e-06 [recompute_prepare]: 5.32999e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.33998e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.072e-05 [j_node_and_user_rematch]: 7.88001e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.84e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.204e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.016e-05 [rewriter_after_opt_a]: 3.5e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00047909 [jit_opt_b]: 5.047e-05, [1] [Cycle 1]: 4.372e-05, [2] [frontend_op_eliminate]: 1.68e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.441e-05 [loop_unroll]: 0.00043222 [jit_opt_after_cconv]: 0.00014452, [1] [Cycle 1]: 0.00013818, [11] [c_1]: 2.224e-05 [parameter_eliminate]: 2.25002e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.72001e-06 [cse]: 2.053e-05 [call_graph_tuple_transform]: 1.85e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.51998e-06 [remove_dup_value]: 1.534e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.39001e-06 [add_recomputation]: 4.818e-05 [cse_after_recomputation]: 2.281e-05, [1] [Cycle 1]: 1.759e-05, [1] [cse]: 1.148e-05 [auto_monad_reorder]: 1.788e-05 [get_jit_bprop_graph]: 1.63002e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.00045845 [symbol_engine_optimizer]: 7.282e-05, [1] [Cycle 1]: 6.652e-05, [6] [build]: 3.18e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.319e-05 [opt_reshape]: 5.67001e-06 [fold_const_symbol]: 9.04e-06 [renormalize]: 4.69998e-07 [validate]: 3.666e-05 Sums bootstrap : 0.000328s : 2.41% type_inference : 0.009527s : 70.00% event_method : 0.000021s : 0.15% auto_monad : 0.000067s : 0.49% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.33% rewriter_before_opt_a : 0.000081s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.46% jit_opt_a.loop_unroll : 0.000038s : 0.28% jit_opt_a.a_1 : 0.000715s : 5.26% jit_opt_a.with_stream_mark : 0.000025s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000678s : 4.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000046s : 0.34% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000010s : 0.07% rewriter_after_opt_a : 0.000035s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000479s : 3.52% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000024s : 0.18% loop_unroll : 0.000432s : 3.18% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000015s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.35% cse_after_recomputation.cse : 0.000011s : 0.08% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000458s : 3.37% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.27% Time group info: ------[substitution.] 0.000233 27 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 83.10% : 0.000194s : 5: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.07% : 0.000009s : 3: substitution.reduce_eliminate 1.75% : 0.000004s : 4: substitution.remove_not_recompute_node 1.51% : 0.000004s : 2: substitution.replace_old_param 4.47% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009465 2 89.67% : 0.008487s : 1: type_inference.infer 10.33% : 0.000977s : 1: type_inference.specialize ------[replace.] 0.000087 7 68.10% : 0.000059s : 5: replace.inline 31.90% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 7 95.35% : 0.000191s : 5: match.inline 4.65% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.55% : 0.000002s : 11: predicate.addn_zero_filter 2.15% : 0.000003s : 11: predicate.arithmetic_simplify 1.26% : 0.000002s : 11: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.12% : 0.000001s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_depend_swap 1.29% : 0.000002s : 11: predicate.environ_get_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.90% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 16: predicate.load_eliminater 1.12% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.99% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.44% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.43% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.78% : 0.000010s : 59: predicate.switch_simplify 1.41% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000768 16 51.67% : 0.000397s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.34% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.99% : 0.000315s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018966 72 0.27% : 0.000051s : 1: add_recomputation 0.37% : 0.000070s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.83% : 0.000347s : 1: bootstrap 0.14% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 27.30% : 0.005178s : 1: jit_opt_a 0.78% : 0.000147s : 1: jit_opt_after_cconv 0.28% : 0.000053s : 1: jit_opt_b 2.32% : 0.000440s : 1: loop_unroll 2.57% : 0.000487s : 1: mutable_eliminate 4.91% : 0.000930s : 26: opt.transform.jit_opt_a 0.26% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.46% : 0.000466s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000047s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 1.82% : 0.000345s : 1: renormalize.infer 1.71% : 0.000325s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000038s : 1: rewriter_after_opt_a 0.44% : 0.000084s : 1: rewriter_before_opt_a 0.40% : 0.000075s : 1: symbol_engine_optimizer 50.31% : 0.009542s : 1: type_inference TotalTime = 0.142943, [30] [bootstrap]: 0.00030999 [type_inference]: 0.130794 [event_method]: 2.437e-05 [auto_monad]: 7.933e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 3.20998e-06 [py_interpret_to_execute]: 0.00059466 [rewriter_before_opt_a]: 0.00010523 [expand_dump_flag]: 4.77998e-06 [jit_opt_a]: 0.00820464, [2] [Cycle 1]: 0.00404792, [27] [switch_simplify]: 6.686e-05 [loop_unroll]: 3.546e-05 [a_1]: 0.00073461 [with_stream_mark]: 2.177e-05 [recompute_prepare]: 8.84003e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.55998e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.49001e-06 [renormalize]: 0.00281945 [add_forward_monad_depend]: 7.51001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.63e-05 [cse]: 3.669e-05 [replace_applicator]: 1.693e-05 [Cycle 2]: 0.00038634, [27] [switch_simplify]: 7.1e-06 [loop_unroll]: 6.02001e-06 [a_1]: 0.00013339 [with_stream_mark]: 1.159e-05 [recompute_prepare]: 6.19999e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 2.55002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.307e-05 [j_node_and_user_rematch]: 9.21998e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 1.14998e-06 [auto_monad_eliminator]: 7.33e-06 [cse]: 1.455e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.351e-05 [rewriter_after_opt_a]: 3.866e-05 [convert_after_rewriter]: 7.59002e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.000637 [jit_opt_b]: 5.623e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.926e-05 [inline_after_opt_a]: 1.814e-05 [cconv]: 2.556e-05 [loop_unroll]: 0.00043601 [jit_opt_after_cconv]: 0.00015484, [1] [Cycle 1]: 0.00014816, [11] [c_1]: 2.63e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.75001e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.78998e-06 [cse]: 2.402e-05 [call_graph_tuple_transform]: 2.024e-05 [tuple_list_get_item_eliminator]: 7.01001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 6.23002e-06 [remove_dup_value]: 1.767e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 8.07998e-06 [add_recomputation]: 5.012e-05 [cse_after_recomputation]: 2.509e-05, [1] [Cycle 1]: 1.972e-05, [1] [cse]: 1.378e-05 [auto_monad_reorder]: 1.923e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 4.85999e-06 [opt_after_jit_grad]: 0.00089404 [symbol_engine_optimizer]: 7.78e-05, [1] [Cycle 1]: 7.166e-05, [6] [build]: 3.50998e-06 [elim_shapecalc]: 9.33002e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 6.53003e-06 [fold_const_symbol]: 1.031e-05 [renormalize]: 4.89992e-07 [validate]: 0.00011585 Sums bootstrap : 0.000310s : 0.22% type_inference : 0.130794s : 94.42% event_method : 0.000024s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000595s : 0.43% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000868s : 0.63% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002820s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000637s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000436s : 0.31% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000894s : 0.65% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000116s : 0.08% Time group info: ------[substitution.] 0.000301 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000006s : 4: substitution.graph_param_transform 84.26% : 0.000253s : 5: substitution.inline 1.56% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.13% : 0.000012s : 3: substitution.reduce_eliminate 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.45% : 0.000004s : 2: substitution.replace_old_param 3.84% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.130701 2 97.70% : 0.127692s : 1: type_inference.infer 2.30% : 0.003009s : 1: type_inference.specialize ------[replace.] 0.000102 7 70.20% : 0.000072s : 5: replace.inline 29.80% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000261 7 95.99% : 0.000250s : 5: match.inline 4.01% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.12% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.13% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 2.03% : 0.000003s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.11% : 0.000012s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002459 25 63.00% : 0.001550s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.40% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.60% : 0.000826s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146839 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000083s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.22% : 0.000322s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.59% : 0.008208s : 1: jit_opt_a 0.11% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.30% : 0.000443s : 1: loop_unroll 0.44% : 0.000645s : 1: mutable_eliminate 0.76% : 0.001119s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000904s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000603s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.35% : 0.001976s : 1: renormalize.infer 0.57% : 0.000833s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.05% : 0.000080s : 1: symbol_engine_optimizer 89.09% : 0.130815s : 1: type_inference TotalTime = 0.0793484, [30] [bootstrap]: 0.00031536 [type_inference]: 0.0686853 [event_method]: 2.436e-05 [auto_monad]: 7.189e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00029151 [rewriter_before_opt_a]: 9.847e-05 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00742757, [2] [Cycle 1]: 0.00358666, [27] [switch_simplify]: 6.355e-05 [loop_unroll]: 3.493e-05 [a_1]: 0.00076234 [with_stream_mark]: 2.146e-05 [recompute_prepare]: 9.31002e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 7.2e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 6.29999e-06 [renormalize]: 0.00233257 [add_forward_monad_depend]: 7.46001e-06 [auto_monad_grad]: 2.89999e-06 [auto_monad_eliminator]: 1.777e-05 [cse]: 3.749e-05 [replace_applicator]: 1.843e-05 [Cycle 2]: 0.00037699, [27] [switch_simplify]: 7.10002e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00012244 [with_stream_mark]: 1.213e-05 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.37999e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.26998e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 8.61002e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.46999e-06 [cse]: 1.51e-05 [replace_applicator]: 6.25002e-06 [py_interpret_to_execute_after_opt_a]: 1.491e-05 [rewriter_after_opt_a]: 4.091e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00067916 [jit_opt_b]: 6.966e-05, [1] [Cycle 1]: 6.249e-05, [2] [frontend_op_eliminate]: 1.912e-05 [inline_after_opt_a]: 3.134e-05 [cconv]: 2.783e-05 [loop_unroll]: 0.00043639 [jit_opt_after_cconv]: 0.00015734, [1] [Cycle 1]: 0.00015115, [11] [c_1]: 2.582e-05 [parameter_eliminate]: 2.45002e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.532e-05 [call_graph_tuple_transform]: 2.152e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.91003e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.9e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 5.362e-05 [cse_after_recomputation]: 2.531e-05, [1] [Cycle 1]: 1.977e-05, [1] [cse]: 1.389e-05 [auto_monad_reorder]: 1.855e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 4.77998e-06 [opt_after_jit_grad]: 0.00047601 [symbol_engine_optimizer]: 7.654e-05, [1] [Cycle 1]: 6.988e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 9.03002e-06 [elim_not_effective]: 1.386e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.60001e-06 [renormalize]: 3.50003e-07 [validate]: 0.00011301 Sums bootstrap : 0.000315s : 0.42% type_inference : 0.068685s : 91.23% event_method : 0.000024s : 0.03% auto_monad : 0.000072s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000292s : 0.39% rewriter_before_opt_a : 0.000098s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.05% jit_opt_a.a_1 : 0.000885s : 1.18% jit_opt_a.with_stream_mark : 0.000034s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002333s : 3.10% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000053s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000041s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000679s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000031s : 0.04% cconv : 0.000028s : 0.04% loop_unroll : 0.000436s : 0.58% jit_opt_after_cconv.c_1 : 0.000026s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000054s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000476s : 0.63% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000113s : 0.15% Time group info: ------[substitution.] 0.000277 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 4: substitution.graph_param_transform 87.23% : 0.000242s : 5: substitution.inline 1.36% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.21% : 0.000003s : 2: substitution.replace_old_param 4.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068598 2 96.75% : 0.066370s : 1: type_inference.infer 3.25% : 0.002228s : 1: type_inference.specialize ------[replace.] 0.000101 7 69.02% : 0.000070s : 5: replace.inline 30.98% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.11% : 0.000239s : 5: match.inline 4.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.66% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.31% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.96% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.75% : 0.000002s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.17% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.47% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 20: predicate.switch_defer_inline 2.38% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.64% : 0.000011s : 65: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.14% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002527 29 69.19% : 0.001749s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.31% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.50% : 0.000695s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.082829 72 0.07% : 0.000057s : 1: add_recomputation 0.09% : 0.000075s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.41% : 0.000336s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000029s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.97% : 0.007431s : 1: jit_opt_a 0.19% : 0.000160s : 1: jit_opt_after_cconv 0.09% : 0.000072s : 1: jit_opt_b 0.54% : 0.000443s : 1: loop_unroll 0.83% : 0.000686s : 1: mutable_eliminate 1.38% : 0.001140s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000044s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000297s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 1.92% : 0.001591s : 1: renormalize.infer 0.88% : 0.000732s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000103s : 1: rewriter_before_opt_a 0.10% : 0.000079s : 1: symbol_engine_optimizer 82.94% : 0.068702s : 1: type_inference TotalTime = 0.015895, [30] [bootstrap]: 0.00025081 [type_inference]: 0.00799932 [event_method]: 1.856e-05 [auto_monad]: 4.592e-05 [graph_reusing]: 4e-06 [pre_auto_parallel]: 1.55999e-06 [py_interpret_to_execute]: 4.567e-05 [rewriter_before_opt_a]: 7.456e-05 [expand_dump_flag]: 2.04e-06 [jit_opt_a]: 0.00522132, [2] [Cycle 1]: 0.00187132, [27] [switch_simplify]: 5.84e-05 [loop_unroll]: 3.271e-05 [a_1]: 0.00062408 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 7.3e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 7.00005e-07 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.40997e-06 [cell_reuse_recompute_pass]: 8.39995e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.162e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 7.73001e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00082376 [add_forward_monad_depend]: 5.99e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.692e-05 [cse]: 3.912e-05 [replace_applicator]: 1.304e-05 [Cycle 2]: 0.00032449, [27] [switch_simplify]: 6.32001e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.178e-05 [with_stream_mark]: 9.75002e-06 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 4.87e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 7.85e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.456e-05 [replace_applicator]: 5.43997e-06 [py_interpret_to_execute_after_opt_a]: 1.274e-05 [rewriter_after_opt_a]: 3.888e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00055954 [jit_opt_b]: 5.034e-05, [1] [Cycle 1]: 4.386e-05, [2] [frontend_op_eliminate]: 1.661e-05 [inline_after_opt_a]: 1.597e-05 [cconv]: 2.589e-05 [loop_unroll]: 0.00042506 [jit_opt_after_cconv]: 0.00014606, [1] [Cycle 1]: 0.00013956, [11] [c_1]: 2.056e-05 [parameter_eliminate]: 2.45002e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.78998e-06 [cse]: 2.363e-05 [call_graph_tuple_transform]: 1.788e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 3.405e-05 [partial_unused_args_eliminate]: 2.41998e-06 [environ_conv]: 6.33e-06 [add_recomputation]: 9.075e-05 [cse_after_recomputation]: 3.613e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.228e-05 [auto_monad_reorder]: 1.864e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 4.72998e-06 [opt_after_jit_grad]: 0.00048009 [symbol_engine_optimizer]: 7.405e-05, [1] [Cycle 1]: 6.807e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 7.74002e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 6.09999e-06 [fold_const_symbol]: 9.37999e-06 [renormalize]: 3.50003e-07 [validate]: 4.433e-05 Sums bootstrap : 0.000251s : 2.04% type_inference : 0.007999s : 65.07% event_method : 0.000019s : 0.15% auto_monad : 0.000046s : 0.37% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000046s : 0.37% rewriter_before_opt_a : 0.000075s : 0.61% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.53% jit_opt_a.loop_unroll : 0.000038s : 0.31% jit_opt_a.a_1 : 0.000716s : 5.82% jit_opt_a.with_stream_mark : 0.000019s : 0.16% jit_opt_a.recompute_prepare : 0.000012s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000005s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000824s : 6.70% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.19% jit_opt_a.cse : 0.000054s : 0.44% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000039s : 0.32% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000560s : 4.55% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000425s : 3.46% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000034s : 0.28% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000091s : 0.74% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000019s : 0.15% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000480s : 3.91% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.36% Time group info: ------[substitution.] 0.000236 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.21% : 0.000005s : 3: substitution.graph_param_transform 89.47% : 0.000211s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.07% : 0.000003s : 2: substitution.replace_old_param 2.73% : 0.000006s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007946 2 87.47% : 0.006950s : 1: type_inference.infer 12.53% : 0.000996s : 1: type_inference.specialize ------[replace.] 0.000093 7 66.52% : 0.000062s : 5: replace.inline 33.48% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 97.52% : 0.000208s : 5: match.inline 2.48% : 0.000005s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.40% : 0.000002s : 11: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 2.19% : 0.000003s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.23% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.25% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.22% : 0.000006s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 16: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.66% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 1.88% : 0.000002s : 11: predicate.reduce_eliminate 1.56% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.38% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000003s : 18: predicate.switch_defer_inline 2.36% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.91% : 0.000010s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.30% : 0.000002s : 11: predicate.transpose_eliminate 1.54% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000791 16 47.54% : 0.000376s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.56% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.90% : 0.000347s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017699 72 0.53% : 0.000094s : 1: add_recomputation 0.28% : 0.000049s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.51% : 0.000267s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.22% : 0.000038s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 29.52% : 0.005225s : 1: jit_opt_a 0.84% : 0.000149s : 1: jit_opt_after_cconv 0.30% : 0.000053s : 1: jit_opt_b 2.44% : 0.000433s : 1: loop_unroll 3.21% : 0.000568s : 1: mutable_eliminate 5.27% : 0.000933s : 26: opt.transform.jit_opt_a 0.27% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.75% : 0.000487s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.27% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000037s : 1: remove_dup_value 2.66% : 0.000472s : 1: renormalize.infer 1.95% : 0.000346s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.44% : 0.000077s : 1: rewriter_before_opt_a 0.44% : 0.000077s : 1: symbol_engine_optimizer 45.25% : 0.008009s : 1: type_inference TotalTime = 0.1203, [30] [bootstrap]: 0.00029886 [type_inference]: 0.109548 [event_method]: 1.939e-05 [auto_monad]: 6.948e-05 [graph_reusing]: 5.68002e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00051463 [rewriter_before_opt_a]: 8.981e-05 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.00740919, [2] [Cycle 1]: 0.00350015, [27] [switch_simplify]: 5.668e-05 [loop_unroll]: 3.125e-05 [a_1]: 0.0005763 [with_stream_mark]: 1.952e-05 [recompute_prepare]: 9.43002e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 7.37002e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 7.01001e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.41998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 1.134e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.0024978 [add_forward_monad_depend]: 4.25999e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 1.091e-05 [cse]: 1.535e-05 [replace_applicator]: 1.297e-05 [Cycle 2]: 0.00041791, [27] [switch_simplify]: 7.11999e-06 [loop_unroll]: 6.94001e-06 [a_1]: 0.00016981 [with_stream_mark]: 9.24e-06 [recompute_prepare]: 6.52001e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 7.49977e-07 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.373e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.198e-05 [replace_applicator]: 6.41e-06 [py_interpret_to_execute_after_opt_a]: 9.91e-06 [rewriter_after_opt_a]: 2.847e-05 [convert_after_rewriter]: 6.23e-06 [order_py_execute_after_rewriter]: 4.60999e-06 [mutable_eliminate]: 0.0005433 [jit_opt_b]: 6.188e-05, [1] [Cycle 1]: 5.502e-05, [2] [frontend_op_eliminate]: 2.196e-05 [inline_after_opt_a]: 2.107e-05 [cconv]: 2.135e-05 [loop_unroll]: 0.00052424 [jit_opt_after_cconv]: 0.00017124, [1] [Cycle 1]: 0.00016384, [11] [c_1]: 3.157e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.46998e-06 [cse]: 2.703e-05 [call_graph_tuple_transform]: 2.352e-05 [tuple_list_get_item_eliminator]: 6.89999e-06 [none_parameter_eliminate]: 1.10999e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.105e-05 [partial_unused_args_eliminate]: 2.94999e-06 [environ_conv]: 8.40001e-06 [add_recomputation]: 4.109e-05 [cse_after_recomputation]: 2.287e-05, [1] [Cycle 1]: 1.752e-05, [1] [cse]: 1.121e-05 [auto_monad_reorder]: 1.274e-05 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00050023 [symbol_engine_optimizer]: 7.965e-05, [1] [Cycle 1]: 7.301e-05, [6] [build]: 3.66001e-06 [elim_shapecalc]: 9.82999e-06 [elim_not_effective]: 1.443e-05 [opt_reshape]: 7.45e-06 [fold_const_symbol]: 9.32001e-06 [renormalize]: 3.39991e-07 [validate]: 0.00010574 Sums bootstrap : 0.000299s : 0.26% type_inference : 0.109548s : 94.26% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000515s : 0.44% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000746s : 0.64% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002498s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.01% jit_opt_a.cse : 0.000027s : 0.02% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000028s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000543s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000021s : 0.02% loop_unroll : 0.000524s : 0.45% jit_opt_after_cconv.c_1 : 0.000032s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000500s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000106s : 0.09% Time group info: ------[substitution.] 0.000199 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 3.41% : 0.000007s : 4: substitution.graph_param_transform 82.40% : 0.000164s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000005s : 2: substitution.replace_old_param 6.22% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109470 2 97.44% : 0.106673s : 1: type_inference.infer 2.56% : 0.002797s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.66% : 0.000051s : 4: replace.inline 33.34% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.53% : 0.000161s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 2.23% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000002s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.62% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.83% : 0.000009s : 58: predicate.switch_simplify 1.39% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002242 22 64.97% : 0.001457s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.55% : 0.000752s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123808 72 0.04% : 0.000044s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000309s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.99% : 0.007412s : 1: jit_opt_a 0.14% : 0.000174s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.43% : 0.000533s : 1: loop_unroll 0.45% : 0.000552s : 1: mutable_eliminate 0.80% : 0.000984s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000522s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.40% : 0.001732s : 1: renormalize.infer 0.61% : 0.000757s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 88.49% : 0.109564s : 1: type_inference TotalTime = 0.15669, [30] [bootstrap]: 0.00033856 [type_inference]: 0.143232 [event_method]: 2.347e-05 [auto_monad]: 7.512e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00046791 [rewriter_before_opt_a]: 9.636e-05 [expand_dump_flag]: 4.03001e-06 [jit_opt_a]: 0.0102548, [2] [Cycle 1]: 0.00371283, [27] [switch_simplify]: 6.516e-05 [loop_unroll]: 3.479e-05 [a_1]: 0.00068754 [with_stream_mark]: 2.015e-05 [recompute_prepare]: 9.08002e-06 [updatestate_depend_eliminate]: 4.68001e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.95998e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 6.63998e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00254422 [add_forward_monad_depend]: 6.51e-06 [auto_monad_grad]: 3.14001e-06 [auto_monad_eliminator]: 1.643e-05 [cse]: 3.373e-05 [replace_applicator]: 1.707e-05 [Cycle 2]: 0.0003788, [27] [switch_simplify]: 6.83998e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00013031 [with_stream_mark]: 1.127e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.11998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.232e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.67998e-06 [inline_without_move]: 5.76e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.419e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.408e-05 [rewriter_after_opt_a]: 3.855e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00055881 [jit_opt_b]: 5.472e-05, [1] [Cycle 1]: 4.722e-05, [2] [frontend_op_eliminate]: 1.835e-05 [inline_after_opt_a]: 1.771e-05 [cconv]: 2.791e-05 [loop_unroll]: 0.00043149 [jit_opt_after_cconv]: 0.00015561, [1] [Cycle 1]: 0.00014886, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.425e-05 [call_graph_tuple_transform]: 2.168e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.26998e-06 [remove_dup_value]: 1.766e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 8.25999e-06 [add_recomputation]: 4.887e-05 [cse_after_recomputation]: 2.291e-05, [1] [Cycle 1]: 1.795e-05, [1] [cse]: 1.187e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 5.15001e-06 [opt_after_jit_grad]: 0.00046358 [symbol_engine_optimizer]: 7.402e-05, [1] [Cycle 1]: 6.795e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.344e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 9.76e-06 [renormalize]: 3.59985e-07 [validate]: 4.315e-05 Sums bootstrap : 0.000339s : 0.23% type_inference : 0.143232s : 95.53% event_method : 0.000023s : 0.02% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000468s : 0.31% rewriter_before_opt_a : 0.000096s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000818s : 0.55% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002544s : 1.70% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000048s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000559s : 0.37% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000431s : 0.29% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000464s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000255 28 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 4: substitution.graph_param_transform 82.45% : 0.000210s : 5: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.14% : 0.000011s : 3: substitution.reduce_eliminate 1.74% : 0.000004s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 4.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.143143 2 98.00% : 0.140285s : 1: type_inference.infer 2.00% : 0.002858s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.55% : 0.000068s : 5: replace.inline 31.45% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.28% : 0.000207s : 5: match.inline 4.72% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.42% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.23% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.77% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.32% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.75% : 0.000002s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.88% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.71% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002395 25 65.06% : 0.001558s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.44% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.50% : 0.000778s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.160372 72 0.03% : 0.000052s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000360s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.40% : 0.010258s : 1: jit_opt_a 0.10% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.27% : 0.000439s : 1: loop_unroll 0.35% : 0.000568s : 1: mutable_eliminate 0.67% : 0.001067s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.29% : 0.000471s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.10% : 0.001763s : 1: renormalize.infer 0.48% : 0.000771s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000101s : 1: rewriter_before_opt_a 0.05% : 0.000076s : 1: symbol_engine_optimizer 89.33% : 0.143254s : 1: type_inference TotalTime = 0.124374, [30] [bootstrap]: 0.00029617 [type_inference]: 0.112798 [event_method]: 2.334e-05 [auto_monad]: 7.34e-05 [graph_reusing]: 7.11001e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 0.00044772 [rewriter_before_opt_a]: 0.00025642 [expand_dump_flag]: 5.02999e-06 [jit_opt_a]: 0.00723913, [2] [Cycle 1]: 0.00364956, [27] [switch_simplify]: 5.852e-05 [loop_unroll]: 3.33e-05 [a_1]: 0.00067147 [with_stream_mark]: 1.839e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 3.87998e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.16998e-06 [renormalize]: 0.00253148 [add_forward_monad_depend]: 5.94999e-06 [auto_monad_grad]: 2.85002e-06 [auto_monad_eliminator]: 1.617e-05 [cse]: 2.48e-05 [replace_applicator]: 1.403e-05 [Cycle 2]: 0.00035252, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00011591 [with_stream_mark]: 9.81e-06 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 7.85e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.81003e-06 [cse]: 1.321e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 3.59e-05 [convert_after_rewriter]: 6.80002e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00052804 [jit_opt_b]: 5.415e-05, [1] [Cycle 1]: 4.751e-05, [2] [frontend_op_eliminate]: 1.881e-05 [inline_after_opt_a]: 1.848e-05 [cconv]: 2.557e-05 [loop_unroll]: 0.00042249 [jit_opt_after_cconv]: 0.00015251, [1] [Cycle 1]: 0.00014595, [11] [c_1]: 2.48e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.409e-05 [call_graph_tuple_transform]: 2.036e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 7.03e-06 [remove_dup_value]: 1.902e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 8.87e-06 [add_recomputation]: 5.058e-05 [cse_after_recomputation]: 2.437e-05, [1] [Cycle 1]: 1.903e-05, [1] [cse]: 1.335e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.20002e-06 [rewriter_after_jit_bprop_graph]: 5.11002e-06 [opt_after_jit_grad]: 0.00046395 [symbol_engine_optimizer]: 0.00015383, [1] [Cycle 1]: 0.00013444, [6] [build]: 3.14999e-06 [elim_shapecalc]: 9.04998e-06 [elim_not_effective]: 1.269e-05 [opt_reshape]: 8.12e-06 [fold_const_symbol]: 7.088e-05 [renormalize]: 9.90025e-07 [validate]: 4.842e-05 Sums bootstrap : 0.000296s : 0.25% type_inference : 0.112798s : 94.36% event_method : 0.000023s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000448s : 0.37% rewriter_before_opt_a : 0.000256s : 0.21% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000787s : 0.66% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002532s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000528s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000422s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000464s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000071s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000306 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 20.38% : 0.000062s : 2: substitution.fold_const_symbol 1.77% : 0.000005s : 4: substitution.graph_param_transform 69.47% : 0.000212s : 5: substitution.inline 0.93% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.45% : 0.000004s : 4: substitution.remove_not_recompute_node 1.23% : 0.000004s : 2: substitution.replace_old_param 4.18% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112720 2 97.55% : 0.109960s : 1: type_inference.infer 2.45% : 0.002760s : 1: type_inference.specialize ------[replace.] 0.000090 7 67.64% : 0.000061s : 5: replace.inline 32.36% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 94.73% : 0.000209s : 5: match.inline 5.27% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.18% : 0.000002s : 13: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.64% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.08% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.29% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.18% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 1.57% : 0.000002s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.72% : 0.000004s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002252 25 66.81% : 0.001505s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.31% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.88% : 0.000673s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128038 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000315s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 5.66% : 0.007242s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.34% : 0.000430s : 1: loop_unroll 0.42% : 0.000536s : 1: mutable_eliminate 0.80% : 0.001025s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000098s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000454s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.44% : 0.001849s : 1: renormalize.infer 0.53% : 0.000673s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.21% : 0.000269s : 1: rewriter_before_opt_a 0.12% : 0.000156s : 1: symbol_engine_optimizer 88.88% : 0.113796s : 1: type_inference TotalTime = 0.150032, [30] [bootstrap]: 0.00040624 [type_inference]: 0.136972 [event_method]: 2.506e-05 [auto_monad]: 7.748e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00051284 [rewriter_before_opt_a]: 0.00010473 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00926763, [2] [Cycle 1]: 0.00419975, [27] [switch_simplify]: 7.126e-05 [loop_unroll]: 3.608e-05 [a_1]: 0.00077679 [with_stream_mark]: 2.376e-05 [recompute_prepare]: 9.99999e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 6.47001e-06 [accelerated_algorithm]: 7.66001e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 7.47002e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.088e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.179e-05 [inline_without_move]: 6.43e-06 [renormalize]: 0.00284227 [add_forward_monad_depend]: 7.56001e-06 [auto_monad_grad]: 2.33002e-06 [auto_monad_eliminator]: 1.829e-05 [cse]: 3.797e-05 [replace_applicator]: 2.038e-05 [Cycle 2]: 0.00039879, [27] [switch_simplify]: 7.15998e-06 [loop_unroll]: 6.57002e-06 [a_1]: 0.00013842 [with_stream_mark]: 1.385e-05 [recompute_prepare]: 7.11999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.11997e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 2.54999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.426e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 9.60001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.56e-06 [cse]: 1.375e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.536e-05 [rewriter_after_opt_a]: 3.93e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00077302 [jit_opt_b]: 5.927e-05, [1] [Cycle 1]: 5.146e-05, [2] [frontend_op_eliminate]: 2.03e-05 [inline_after_opt_a]: 1.93e-05 [cconv]: 2.724e-05 [loop_unroll]: 0.00045911 [jit_opt_after_cconv]: 0.00016534, [1] [Cycle 1]: 0.00015901, [11] [c_1]: 2.705e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 6.94001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.731e-05 [call_graph_tuple_transform]: 2.347e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 7.44002e-06 [remove_dup_value]: 1.694e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 9.05001e-06 [add_recomputation]: 5.089e-05 [cse_after_recomputation]: 2.401e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.857e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 7.48999e-06 [opt_after_jit_grad]: 0.00051303 [symbol_engine_optimizer]: 0.00017624, [1] [Cycle 1]: 0.00016952, [6] [build]: 3.75998e-06 [elim_shapecalc]: 9.64e-06 [elim_not_effective]: 1.402e-05 [opt_reshape]: 7.13e-06 [fold_const_symbol]: 0.000103 [renormalize]: 8.60018e-07 [validate]: 5.247e-05 Sums bootstrap : 0.000406s : 0.28% type_inference : 0.136972s : 94.70% event_method : 0.000025s : 0.02% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000513s : 0.35% rewriter_before_opt_a : 0.000105s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000915s : 0.63% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002842s : 1.97% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000773s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000459s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000513s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000103s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000412 28 0.52% : 0.000002s : 2: substitution.elim_not_effective 22.77% : 0.000094s : 2: substitution.fold_const_symbol 1.44% : 0.000006s : 4: substitution.graph_param_transform 65.41% : 0.000270s : 5: substitution.inline 1.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.37% : 0.000014s : 3: substitution.reduce_eliminate 1.25% : 0.000005s : 4: substitution.remove_not_recompute_node 1.52% : 0.000006s : 2: substitution.replace_old_param 2.68% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.136880 2 97.70% : 0.133732s : 1: type_inference.infer 2.30% : 0.003148s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.62% : 0.000072s : 5: replace.inline 31.38% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000276 7 96.41% : 0.000266s : 5: match.inline 3.59% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.27% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.43% : 0.000004s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.65% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.69% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.27% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000004s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.48% : 0.000004s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.52% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000011s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002707 25 68.64% : 0.001859s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.36% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.00% : 0.000758s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154193 72 0.03% : 0.000054s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.28% : 0.000428s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.01% : 0.009271s : 1: jit_opt_a 0.11% : 0.000168s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.30% : 0.000467s : 1: loop_unroll 0.51% : 0.000783s : 1: mutable_eliminate 0.77% : 0.001184s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000131s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000523s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000520s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.31% : 0.002025s : 1: renormalize.infer 0.52% : 0.000806s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000110s : 1: rewriter_before_opt_a 0.12% : 0.000179s : 1: symbol_engine_optimizer 88.85% : 0.136996s : 1: type_inference TotalTime = 0.0299898, [30] [bootstrap]: 0.00028875 [type_inference]: 0.0214998 [event_method]: 2.124e-05 [auto_monad]: 7.057e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 3.07002e-06 [py_interpret_to_execute]: 4.66e-05 [rewriter_before_opt_a]: 8.235e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.00564686, [2] [Cycle 1]: 0.00201476, [27] [switch_simplify]: 5.919e-05 [loop_unroll]: 3.394e-05 [a_1]: 0.00064901 [with_stream_mark]: 1.88e-05 [recompute_prepare]: 8.02e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00075683 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.556e-05 [cse]: 3.18e-05 [replace_applicator]: 0.00016661 [Cycle 2]: 0.00036042, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 5.72999e-06 [a_1]: 9.915e-05 [with_stream_mark]: 1.224e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.16998e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.108e-05 [j_node_and_user_rematch]: 7.98001e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 7.55e-06 [inline_without_move]: 5.12e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.63997e-06 [auto_monad_grad]: 1.30001e-06 [auto_monad_eliminator]: 7.96001e-06 [cse]: 1.921e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.375e-05 [rewriter_after_opt_a]: 3.821e-05 [convert_after_rewriter]: 7.85e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.0005664 [jit_opt_b]: 5.236e-05, [1] [Cycle 1]: 4.425e-05, [2] [frontend_op_eliminate]: 1.546e-05 [inline_after_opt_a]: 1.634e-05 [cconv]: 2.948e-05 [loop_unroll]: 0.00046871 [jit_opt_after_cconv]: 0.00018238, [1] [Cycle 1]: 0.00017467, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 3.71999e-06 [updatestate_depend_eliminate]: 9.32001e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 3.11999e-06 [cse]: 3.14e-05 [call_graph_tuple_transform]: 2.346e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.75001e-06 [remove_dup_value]: 1.764e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 7.33999e-06 [add_recomputation]: 5.441e-05 [cse_after_recomputation]: 2.612e-05, [1] [Cycle 1]: 2.001e-05, [1] [cse]: 1.276e-05 [auto_monad_reorder]: 1.75e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 6.55002e-06 [opt_after_jit_grad]: 0.00052097 [symbol_engine_optimizer]: 7.744e-05, [1] [Cycle 1]: 7.058e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 7.59002e-06 [elim_not_effective]: 1.421e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 4.80009e-07 [validate]: 3.976e-05 Sums bootstrap : 0.000289s : 1.11% type_inference : 0.021500s : 82.44% event_method : 0.000021s : 0.08% auto_monad : 0.000071s : 0.27% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000047s : 0.18% rewriter_before_opt_a : 0.000082s : 0.32% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.25% jit_opt_a.loop_unroll : 0.000040s : 0.15% jit_opt_a.a_1 : 0.000748s : 2.87% jit_opt_a.with_stream_mark : 0.000031s : 0.12% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000757s : 2.90% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.09% jit_opt_a.cse : 0.000051s : 0.20% jit_opt_a.replace_applicator : 0.000172s : 0.66% py_interpret_to_execute_after_opt_a : 0.000014s : 0.05% rewriter_after_opt_a : 0.000038s : 0.15% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000566s : 2.17% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000029s : 0.11% loop_unroll : 0.000469s : 1.80% jit_opt_after_cconv.c_1 : 0.000021s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000031s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.09% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000018s : 0.07% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.03% add_recomputation : 0.000054s : 0.21% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000017s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.03% opt_after_jit_grad : 0.000521s : 2.00% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.15% Time group info: ------[substitution.] 0.000263 27 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 84.00% : 0.000221s : 5: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.03% : 0.000011s : 3: substitution.reduce_eliminate 1.55% : 0.000004s : 4: substitution.remove_not_recompute_node 1.58% : 0.000004s : 2: substitution.replace_old_param 3.96% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.021432 2 95.59% : 0.020487s : 1: type_inference.infer 4.41% : 0.000945s : 1: type_inference.specialize ------[replace.] 0.000090 7 68.09% : 0.000061s : 5: replace.inline 31.91% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 95.90% : 0.000218s : 5: match.inline 4.10% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.33% : 0.000002s : 11: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.21% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.42% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.18% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.74% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 1.88% : 0.000002s : 11: predicate.reduce_eliminate 1.51% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.75% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000770 16 47.84% : 0.000368s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.82% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.34% : 0.000326s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.031783 72 0.18% : 0.000058s : 1: add_recomputation 0.23% : 0.000074s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.96% : 0.000305s : 1: bootstrap 0.10% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 17.78% : 0.005650s : 1: jit_opt_a 0.58% : 0.000185s : 1: jit_opt_after_cconv 0.17% : 0.000055s : 1: jit_opt_b 1.51% : 0.000480s : 1: loop_unroll 1.81% : 0.000576s : 1: mutable_eliminate 3.05% : 0.000971s : 26: opt.transform.jit_opt_a 0.16% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.67% : 0.000531s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.15% : 0.000049s : 1: py_interpret_to_execute 0.05% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 1.36% : 0.000431s : 1: renormalize.infer 1.00% : 0.000318s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000041s : 1: rewriter_after_opt_a 0.27% : 0.000086s : 1: rewriter_before_opt_a 0.25% : 0.000080s : 1: symbol_engine_optimizer 67.70% : 0.021518s : 1: type_inference TotalTime = 0.131454, [30] [bootstrap]: 0.0003024 [type_inference]: 0.120509 [event_method]: 1.917e-05 [auto_monad]: 5.186e-05 [graph_reusing]: 4.18001e-06 [pre_auto_parallel]: 1.88002e-06 [py_interpret_to_execute]: 0.00052726 [rewriter_before_opt_a]: 8.156e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.00746286, [2] [Cycle 1]: 0.00385461, [27] [switch_simplify]: 4.895e-05 [loop_unroll]: 3.129e-05 [a_1]: 0.00060135 [with_stream_mark]: 1.808e-05 [recompute_prepare]: 9.57999e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 6.75998e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 8.00006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.13002e-06 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00280937 [add_forward_monad_depend]: 9.15999e-06 [auto_monad_grad]: 2.19999e-06 [auto_monad_eliminator]: 1.774e-05 [cse]: 2.5e-05 [replace_applicator]: 1.716e-05 [Cycle 2]: 0.00039385, [27] [switch_simplify]: 6.51999e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00013068 [with_stream_mark]: 1.384e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.688e-05 [j_node_and_user_rematch]: 9.01998e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.81998e-06 [inline_without_move]: 6.29999e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 6.75002e-06 [cse]: 1.258e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.332e-05 [rewriter_after_opt_a]: 4.117e-05 [convert_after_rewriter]: 7.71001e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00069816 [jit_opt_b]: 5.982e-05, [1] [Cycle 1]: 5.346e-05, [2] [frontend_op_eliminate]: 2.114e-05 [inline_after_opt_a]: 1.946e-05 [cconv]: 2.523e-05 [loop_unroll]: 0.00046985 [jit_opt_after_cconv]: 0.00015565, [1] [Cycle 1]: 0.00014897, [11] [c_1]: 2.729e-05 [parameter_eliminate]: 1.93002e-06 [updatestate_depend_eliminate]: 5.05999e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.146e-05 [call_graph_tuple_transform]: 2.212e-05 [tuple_list_get_item_eliminator]: 7.00998e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.356e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 7.09001e-06 [add_recomputation]: 4.958e-05 [cse_after_recomputation]: 2.43e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.313e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 5.12999e-06 [opt_after_jit_grad]: 0.00048234 [symbol_engine_optimizer]: 7.678e-05, [1] [Cycle 1]: 7.069e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 9.08002e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 1.002e-05 [renormalize]: 3.50003e-07 [validate]: 0.00015157 Sums bootstrap : 0.000302s : 0.24% type_inference : 0.120509s : 94.42% event_method : 0.000019s : 0.02% auto_monad : 0.000052s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000527s : 0.41% rewriter_before_opt_a : 0.000082s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.04% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000732s : 0.57% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002809s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000698s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000470s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000482s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000152s : 0.12% Time group info: ------[substitution.] 0.000176 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.79% : 0.000007s : 4: substitution.graph_param_transform 82.36% : 0.000145s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.82% : 0.000005s : 4: substitution.remove_not_recompute_node 2.79% : 0.000005s : 2: substitution.replace_old_param 4.98% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120428 2 96.85% : 0.116633s : 1: type_inference.infer 3.15% : 0.003795s : 1: type_inference.specialize ------[replace.] 0.000071 6 65.32% : 0.000046s : 4: replace.inline 34.68% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000149 6 95.00% : 0.000142s : 4: match.inline 5.00% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.84% : 0.000002s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.64% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.56% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.08% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002325 22 64.28% : 0.001495s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.21% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.51% : 0.000803s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135196 72 0.04% : 0.000053s : 1: add_recomputation 0.04% : 0.000056s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.24% : 0.000322s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.52% : 0.007466s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.35% : 0.000477s : 1: loop_unroll 0.52% : 0.000707s : 1: mutable_eliminate 0.72% : 0.000968s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000536s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.44% : 0.001944s : 1: renormalize.infer 0.63% : 0.000856s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.06% : 0.000086s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 89.15% : 0.120522s : 1: type_inference TotalTime = 0.0506984, [30] [bootstrap]: 0.00033303 [type_inference]: 0.0403693 [event_method]: 2.176e-05 [auto_monad]: 7.488e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 3.5e-06 [py_interpret_to_execute]: 0.00029966 [rewriter_before_opt_a]: 8.779e-05 [expand_dump_flag]: 4.03999e-06 [jit_opt_a]: 0.0070077, [2] [Cycle 1]: 0.00280896, [27] [switch_simplify]: 6.672e-05 [loop_unroll]: 3.35e-05 [a_1]: 0.00064457 [with_stream_mark]: 2.411e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.86001e-06 [meta_shard_fg_expand]: 2.45002e-06 [get_grad_eliminate_]: 6.64001e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 1.54998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.635e-05 [j_node_and_user_rematch]: 1.073e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.113e-05 [inline_without_move]: 6.79999e-06 [renormalize]: 0.00165958 [add_forward_monad_depend]: 8.07e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.78e-05 [cse]: 3.373e-05 [replace_applicator]: 1.74e-05 [Cycle 2]: 0.00043388, [27] [switch_simplify]: 7.41999e-06 [loop_unroll]: 5.84999e-06 [a_1]: 0.00012854 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 6.08002e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 8.33001e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.79998e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 7.72998e-06 [cse]: 1.655e-05 [replace_applicator]: 7.43999e-06 [py_interpret_to_execute_after_opt_a]: 1.397e-05 [rewriter_after_opt_a]: 4.058e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00070983 [jit_opt_b]: 6.45e-05, [1] [Cycle 1]: 5.59e-05, [2] [frontend_op_eliminate]: 2.331e-05 [inline_after_opt_a]: 2.021e-05 [cconv]: 2.759e-05 [loop_unroll]: 0.00047219 [jit_opt_after_cconv]: 0.00015455, [1] [Cycle 1]: 0.00014839, [11] [c_1]: 2.665e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.232e-05 [call_graph_tuple_transform]: 2.235e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.516e-05 [partial_unused_args_eliminate]: 2.71999e-06 [environ_conv]: 6.53e-06 [add_recomputation]: 5.342e-05 [cse_after_recomputation]: 7.476e-05, [1] [Cycle 1]: 1.896e-05, [1] [cse]: 1.203e-05 [auto_monad_reorder]: 1.659e-05 [get_jit_bprop_graph]: 2.48998e-06 [rewriter_after_jit_bprop_graph]: 6.11e-06 [opt_after_jit_grad]: 0.00049217 [symbol_engine_optimizer]: 8.201e-05, [1] [Cycle 1]: 7.466e-05, [6] [build]: 4.03999e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.491e-05 [opt_reshape]: 7.4e-06 [fold_const_symbol]: 1.083e-05 [renormalize]: 3.39991e-07 [validate]: 4.22e-05 Sums bootstrap : 0.000333s : 0.72% type_inference : 0.040369s : 87.36% event_method : 0.000022s : 0.05% auto_monad : 0.000075s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000300s : 0.65% rewriter_before_opt_a : 0.000088s : 0.19% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.16% jit_opt_a.loop_unroll : 0.000039s : 0.09% jit_opt_a.a_1 : 0.000773s : 1.67% jit_opt_a.with_stream_mark : 0.000035s : 0.07% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.03% jit_opt_a.accelerated_algorithm : 0.000015s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.03% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001660s : 3.59% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.06% jit_opt_a.cse : 0.000050s : 0.11% jit_opt_a.replace_applicator : 0.000025s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000041s : 0.09% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000710s : 1.54% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.05% jit_opt_b.inline_after_opt_a : 0.000020s : 0.04% cconv : 0.000028s : 0.06% loop_unroll : 0.000472s : 1.02% jit_opt_after_cconv.c_1 : 0.000027s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000053s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000492s : 1.07% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.09% Time group info: ------[substitution.] 0.000255 24 1.00% : 0.000003s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.71% : 0.000007s : 4: substitution.graph_param_transform 84.62% : 0.000215s : 4: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.33% : 0.000006s : 2: substitution.replace_old_param 5.13% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.040291 2 95.26% : 0.038380s : 1: type_inference.infer 4.74% : 0.001911s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.45% : 0.000054s : 4: replace.inline 32.55% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.76% : 0.000213s : 4: match.inline 5.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.61% : 0.000002s : 12: predicate.addn_zero_filter 2.21% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.74% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 2.10% : 0.000003s : 12: predicate.reduce_eliminate 1.32% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.90% : 0.000003s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001729 18 67.09% : 0.001160s : 11: func_graph_cloner_run.FuncGraphClonerGraph 3.12% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.79% : 0.000515s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.053463 72 0.11% : 0.000056s : 1: add_recomputation 0.15% : 0.000078s : 1: auto_monad 0.04% : 0.000019s : 1: auto_monad_reorder 0.66% : 0.000351s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000077s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 13.11% : 0.007012s : 1: jit_opt_a 0.29% : 0.000157s : 1: jit_opt_after_cconv 0.13% : 0.000067s : 1: jit_opt_b 0.90% : 0.000481s : 1: loop_unroll 1.35% : 0.000721s : 1: mutable_eliminate 1.93% : 0.001034s : 26: opt.transform.jit_opt_a 0.11% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000036s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.05% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.93% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.57% : 0.000307s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.97% : 0.001055s : 1: renormalize.infer 1.11% : 0.000595s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000044s : 1: rewriter_after_opt_a 0.17% : 0.000093s : 1: rewriter_before_opt_a 0.16% : 0.000085s : 1: symbol_engine_optimizer 75.55% : 0.040388s : 1: type_inference TotalTime = 0.128959, [30] [bootstrap]: 0.00030351 [type_inference]: 0.117027 [event_method]: 2.247e-05 [auto_monad]: 6.025e-05 [graph_reusing]: 5.02e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 0.00053266 [rewriter_before_opt_a]: 9.303e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00750443, [2] [Cycle 1]: 0.00391284, [27] [switch_simplify]: 5.442e-05 [loop_unroll]: 3.614e-05 [a_1]: 0.00066976 [with_stream_mark]: 1.604e-05 [recompute_prepare]: 1.083e-05 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 8.44002e-06 [updatestate_useless_node_eliminater]: 7.15e-06 [accelerated_algorithm]: 7.45e-06 [meta_shard_fg_expand]: 1.83002e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.456e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 6.59001e-06 [renormalize]: 0.00281197 [add_forward_monad_depend]: 5.39998e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 1.208e-05 [cse]: 2.064e-05 [replace_applicator]: 1.386e-05 [Cycle 2]: 0.00037113, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.0001218 [with_stream_mark]: 1.039e-05 [recompute_prepare]: 6.85002e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.23002e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.351e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.357e-05 [replace_applicator]: 6.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.217e-05 [rewriter_after_opt_a]: 3.454e-05 [convert_after_rewriter]: 5.77001e-06 [order_py_execute_after_rewriter]: 4.68999e-06 [mutable_eliminate]: 0.00057121 [jit_opt_b]: 5.583e-05, [1] [Cycle 1]: 4.937e-05, [2] [frontend_op_eliminate]: 1.979e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 1.941e-05 [loop_unroll]: 0.00047155 [jit_opt_after_cconv]: 0.00016964, [1] [Cycle 1]: 0.0001627, [11] [c_1]: 2.879e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 4.85999e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 3.143e-05 [call_graph_tuple_transform]: 2.252e-05 [tuple_list_get_item_eliminator]: 6.55002e-06 [none_parameter_eliminate]: 9.10019e-07 [renormalize]: 4.49974e-07 [switch_simplify]: 7.02002e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 6.36998e-06 [add_recomputation]: 4.162e-05 [cse_after_recomputation]: 2.476e-05, [1] [Cycle 1]: 1.89e-05, [1] [cse]: 1.343e-05 [auto_monad_reorder]: 1.415e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 5.21002e-06 [opt_after_jit_grad]: 0.00156507 [symbol_engine_optimizer]: 0.00015582, [1] [Cycle 1]: 0.00014758, [6] [build]: 3.75003e-06 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 7.88001e-06 [fold_const_symbol]: 8.304e-05 [renormalize]: 3.89991e-07 [validate]: 4.975e-05 Sums bootstrap : 0.000304s : 0.24% type_inference : 0.117027s : 93.51% event_method : 0.000022s : 0.02% auto_monad : 0.000060s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000533s : 0.43% rewriter_before_opt_a : 0.000093s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000792s : 0.63% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002812s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.01% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000571s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000019s : 0.02% loop_unroll : 0.000472s : 0.38% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000042s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.001565s : 1.25% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000083s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000222 25 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.95% : 0.000007s : 4: substitution.graph_param_transform 85.88% : 0.000191s : 5: substitution.inline 1.49% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000003s : 2: substitution.replace_old_param 4.45% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116953 2 97.60% : 0.114147s : 1: type_inference.infer 2.40% : 0.002805s : 1: type_inference.specialize ------[replace.] 0.000098 7 66.04% : 0.000065s : 5: replace.inline 33.96% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 7 95.74% : 0.000187s : 5: match.inline 4.26% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.49% : 0.000002s : 13: predicate.accumulaten_eliminater 1.85% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.61% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.77% : 0.000007s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.28% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.25% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.12% : 0.000002s : 4: predicate.mutable_eliminate 0.77% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 19: predicate.partial_eliminate 1.38% : 0.000002s : 13: predicate.print_const_string_wrapper 1.94% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.45% : 0.000004s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.56% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.04% : 0.000010s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002348 25 64.83% : 0.001522s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.81% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.36% : 0.000760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132966 72 0.03% : 0.000045s : 1: add_recomputation 0.05% : 0.000064s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000313s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.65% : 0.007509s : 1: jit_opt_a 0.13% : 0.000172s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.36% : 0.000481s : 1: loop_unroll 0.44% : 0.000579s : 1: mutable_eliminate 0.78% : 0.001038s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000037s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000110s : 4: opt.transform.symbol_engine_opt 1.19% : 0.001577s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000539s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.51% : 0.002009s : 1: renormalize.infer 0.60% : 0.000796s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000099s : 1: rewriter_before_opt_a 0.12% : 0.000159s : 1: symbol_engine_optimizer 88.02% : 0.117042s : 1: type_inference TotalTime = 0.132657, [30] [bootstrap]: 0.00029713 [type_inference]: 0.120357 [event_method]: 2.555e-05 [auto_monad]: 7.69e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.69999e-06 [py_interpret_to_execute]: 0.00049074 [rewriter_before_opt_a]: 0.00010504 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00865126, [2] [Cycle 1]: 0.00433756, [27] [switch_simplify]: 7.574e-05 [loop_unroll]: 3.472e-05 [a_1]: 0.00081122 [with_stream_mark]: 2.6e-05 [recompute_prepare]: 1.03e-05 [updatestate_depend_eliminate]: 5.52001e-06 [updatestate_assign_eliminate]: 3.85e-06 [updatestate_loads_eliminate]: 3.62002e-06 [parameter_eliminate]: 2.31998e-06 [specialize_transform]: 8.64e-06 [updatestate_useless_node_eliminater]: 6.66999e-06 [accelerated_algorithm]: 7.5e-06 [meta_shard_fg_expand]: 2.50997e-06 [get_grad_eliminate_]: 7.51001e-06 [merge_forward]: 4.58001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.825e-05 [j_node_and_user_rematch]: 1.232e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.278e-05 [inline_without_move]: 7.17002e-06 [renormalize]: 0.00295893 [add_forward_monad_depend]: 8.45001e-06 [auto_monad_grad]: 2.88003e-06 [auto_monad_eliminator]: 2.037e-05 [cse]: 3.994e-05 [replace_applicator]: 2.004e-05 [Cycle 2]: 0.00042127, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00013518 [with_stream_mark]: 1.488e-05 [recompute_prepare]: 7.01999e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 6.20002e-06 [updatestate_useless_node_eliminater]: 6.27001e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.18998e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 2.95998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.49999e-06 [inline_without_move]: 5.66e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.93002e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 7.26999e-06 [cse]: 1.672e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.671e-05 [rewriter_after_opt_a]: 4.189e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00075959 [jit_opt_b]: 6.127e-05, [1] [Cycle 1]: 5.123e-05, [2] [frontend_op_eliminate]: 1.954e-05 [inline_after_opt_a]: 1.987e-05 [cconv]: 3.102e-05 [loop_unroll]: 0.00046722 [jit_opt_after_cconv]: 0.0001727, [1] [Cycle 1]: 0.00016547, [11] [c_1]: 2.735e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 7.01999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.998e-05 [call_graph_tuple_transform]: 2.655e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 1.70025e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.774e-05 [partial_unused_args_eliminate]: 3.36001e-06 [environ_conv]: 9.96e-06 [add_recomputation]: 5.394e-05 [cse_after_recomputation]: 2.475e-05, [1] [Cycle 1]: 1.922e-05, [1] [cse]: 1.311e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 6.06998e-06 [opt_after_jit_grad]: 0.00051179 [symbol_engine_optimizer]: 7.633e-05, [1] [Cycle 1]: 6.996e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 7.12002e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 3.89991e-07 [validate]: 5.661e-05 Sums bootstrap : 0.000297s : 0.23% type_inference : 0.120357s : 94.04% event_method : 0.000026s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000491s : 0.38% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000946s : 0.74% jit_opt_a.with_stream_mark : 0.000041s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002959s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000057s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000760s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000031s : 0.02% loop_unroll : 0.000467s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000512s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000356 28 0.54% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 4: substitution.graph_param_transform 84.71% : 0.000302s : 5: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.25% : 0.000015s : 3: substitution.reduce_eliminate 1.66% : 0.000006s : 4: substitution.remove_not_recompute_node 1.79% : 0.000006s : 2: substitution.replace_old_param 3.11% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120261 2 97.54% : 0.117302s : 1: type_inference.infer 2.46% : 0.002958s : 1: type_inference.specialize ------[replace.] 0.000113 7 70.05% : 0.000079s : 5: replace.inline 29.95% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000308 7 96.73% : 0.000298s : 5: match.inline 3.27% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.96% : 0.000003s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.10% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 6.18% : 0.000009s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 19: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.86% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000004s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.46% : 0.000004s : 13: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.42% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002604 25 64.76% : 0.001686s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.20% : 0.000109s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.04% : 0.000808s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136904 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000316s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.32% : 0.008655s : 1: jit_opt_a 0.13% : 0.000175s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.35% : 0.000477s : 1: loop_unroll 0.56% : 0.000771s : 1: mutable_eliminate 0.89% : 0.001225s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000498s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.53% : 0.002095s : 1: renormalize.infer 0.62% : 0.000853s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.12% : 0.000166s : 1: symbol_engine_optimizer 87.93% : 0.120381s : 1: type_inference TotalTime = 0.0148489, [30] [bootstrap]: 0.00040303 [type_inference]: 0.00584383 [event_method]: 2.122e-05 [auto_monad]: 0.00013899 [graph_reusing]: 6.93998e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 4.987e-05 [rewriter_before_opt_a]: 7.822e-05 [expand_dump_flag]: 3.32002e-06 [jit_opt_a]: 0.00591403, [2] [Cycle 1]: 0.00198726, [27] [switch_simplify]: 5.906e-05 [loop_unroll]: 3.125e-05 [a_1]: 0.00065033 [with_stream_mark]: 2.11e-05 [recompute_prepare]: 9.26998e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.83001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.85002e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 1.042e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.01998e-06 [renormalize]: 0.00085897 [add_forward_monad_depend]: 6.38998e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.537e-05 [cse]: 3.323e-05 [replace_applicator]: 1.347e-05 [Cycle 2]: 0.00036262, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00010435 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 5.64998e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.33998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 2.49999e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.48998e-06 [cse]: 1.159e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 1.328e-05 [rewriter_after_opt_a]: 3.914e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00060171 [jit_opt_b]: 5.375e-05, [1] [Cycle 1]: 4.686e-05, [2] [frontend_op_eliminate]: 1.73e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 2.559e-05 [loop_unroll]: 0.00045235 [jit_opt_after_cconv]: 0.00014926, [1] [Cycle 1]: 0.00014272, [11] [c_1]: 2.221e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 6.11e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.148e-05 [call_graph_tuple_transform]: 1.942e-05 [tuple_list_get_item_eliminator]: 6.11998e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 1.606e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 5.90002e-06 [add_recomputation]: 5.323e-05 [cse_after_recomputation]: 2.445e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.08998e-06 [rewriter_after_jit_bprop_graph]: 5.10001e-06 [opt_after_jit_grad]: 0.00057401 [symbol_engine_optimizer]: 8.254e-05, [1] [Cycle 1]: 7.553e-05, [6] [build]: 4.53999e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.429e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 1.023e-05 [renormalize]: 4.00003e-07 [validate]: 4.221e-05 Sums bootstrap : 0.000403s : 3.80% type_inference : 0.005844s : 55.04% event_method : 0.000021s : 0.20% auto_monad : 0.000139s : 1.31% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.47% rewriter_before_opt_a : 0.000078s : 0.74% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.62% jit_opt_a.loop_unroll : 0.000037s : 0.35% jit_opt_a.a_1 : 0.000755s : 7.11% jit_opt_a.with_stream_mark : 0.000032s : 0.30% jit_opt_a.recompute_prepare : 0.000015s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.19% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000859s : 8.09% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.21% jit_opt_a.cse : 0.000045s : 0.42% jit_opt_a.replace_applicator : 0.000019s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000039s : 0.37% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000602s : 5.67% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000026s : 0.24% loop_unroll : 0.000452s : 4.26% jit_opt_after_cconv.c_1 : 0.000022s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.50% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000574s : 5.41% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.40% Time group info: ------[substitution.] 0.000283 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 3: substitution.graph_param_transform 86.90% : 0.000246s : 4: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000005s : 2: substitution.replace_old_param 4.99% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005765 2 83.92% : 0.004837s : 1: type_inference.infer 16.08% : 0.000927s : 1: type_inference.specialize ------[replace.] 0.000080 6 65.07% : 0.000052s : 4: replace.inline 34.93% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 94.96% : 0.000243s : 4: match.inline 5.04% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 2.08% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.23% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.37% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.32% : 0.000008s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.95% : 0.000003s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.98% : 0.000003s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.72% : 0.000010s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000749 13 54.74% : 0.000410s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.79% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.47% : 0.000288s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016747 72 0.34% : 0.000057s : 1: add_recomputation 0.86% : 0.000144s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.56% : 0.000428s : 1: bootstrap 0.17% : 0.000028s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.14% : 0.000024s : 1: environ_conv 0.15% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 35.34% : 0.005918s : 1: jit_opt_a 0.91% : 0.000152s : 1: jit_opt_after_cconv 0.34% : 0.000056s : 1: jit_opt_b 2.75% : 0.000460s : 1: loop_unroll 3.65% : 0.000610s : 1: mutable_eliminate 5.89% : 0.000986s : 26: opt.transform.jit_opt_a 0.30% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.48% : 0.000583s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000053s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.87% : 0.000481s : 1: renormalize.infer 2.20% : 0.000369s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000042s : 1: rewriter_after_opt_a 0.48% : 0.000081s : 1: rewriter_before_opt_a 0.51% : 0.000085s : 1: symbol_engine_optimizer 35.02% : 0.005865s : 1: type_inference TotalTime = 0.021386, [30] [bootstrap]: 0.00028076 [type_inference]: 0.0126588 [event_method]: 2.524e-05 [auto_monad]: 7.853e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.50002e-06 [py_interpret_to_execute]: 5.33e-05 [rewriter_before_opt_a]: 9.001e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00583863, [2] [Cycle 1]: 0.00206552, [27] [switch_simplify]: 6.046e-05 [loop_unroll]: 3.426e-05 [a_1]: 0.00067738 [with_stream_mark]: 2.18e-05 [recompute_prepare]: 8.97999e-06 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 5.74999e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.519e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00090992 [add_forward_monad_depend]: 5.54998e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.586e-05 [cse]: 4.312e-05 [replace_applicator]: 1.38e-05 [Cycle 2]: 0.00033741, [27] [switch_simplify]: 6.23998e-06 [loop_unroll]: 5.63002e-06 [a_1]: 9.381e-05 [with_stream_mark]: 1.086e-05 [recompute_prepare]: 5.34998e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.23002e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.87998e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.71001e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.492e-05 [replace_applicator]: 5.53002e-06 [py_interpret_to_execute_after_opt_a]: 1.243e-05 [rewriter_after_opt_a]: 3.908e-05 [convert_after_rewriter]: 7.24001e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.0005905 [jit_opt_b]: 5.238e-05, [1] [Cycle 1]: 4.425e-05, [2] [frontend_op_eliminate]: 1.702e-05 [inline_after_opt_a]: 1.568e-05 [cconv]: 2.576e-05 [loop_unroll]: 0.00048058 [jit_opt_after_cconv]: 0.00016233, [1] [Cycle 1]: 0.00015573, [11] [c_1]: 2.129e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 1.556e-05 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.636e-05 [call_graph_tuple_transform]: 1.925e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 3.553e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 5.153e-05 [cse_after_recomputation]: 2.626e-05, [1] [Cycle 1]: 1.984e-05, [1] [cse]: 1.306e-05 [auto_monad_reorder]: 1.778e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 6.01e-06 [opt_after_jit_grad]: 0.00050969 [symbol_engine_optimizer]: 7.905e-05, [1] [Cycle 1]: 7.126e-05, [6] [build]: 4.13999e-06 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 6.26998e-06 [fold_const_symbol]: 9.16998e-06 [renormalize]: 6.30011e-07 [validate]: 4.558e-05 Sums bootstrap : 0.000281s : 1.62% type_inference : 0.012659s : 73.02% event_method : 0.000025s : 0.15% auto_monad : 0.000079s : 0.45% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000053s : 0.31% rewriter_before_opt_a : 0.000090s : 0.52% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000067s : 0.38% jit_opt_a.loop_unroll : 0.000040s : 0.23% jit_opt_a.a_1 : 0.000771s : 4.45% jit_opt_a.with_stream_mark : 0.000033s : 0.19% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.000910s : 5.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.13% jit_opt_a.cse : 0.000058s : 0.33% jit_opt_a.replace_applicator : 0.000019s : 0.11% py_interpret_to_execute_after_opt_a : 0.000012s : 0.07% rewriter_after_opt_a : 0.000039s : 0.23% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000591s : 3.41% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000016s : 0.09% cconv : 0.000026s : 0.15% loop_unroll : 0.000481s : 2.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000036s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000052s : 0.30% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000510s : 2.94% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.26% Time group info: ------[substitution.] 0.000273 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 3: substitution.graph_param_transform 87.80% : 0.000239s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.68% : 0.000005s : 4: substitution.remove_not_recompute_node 1.48% : 0.000004s : 2: substitution.replace_old_param 4.61% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012576 2 59.40% : 0.007470s : 1: type_inference.infer 40.60% : 0.005106s : 1: type_inference.specialize ------[replace.] 0.000101 7 68.20% : 0.000069s : 5: replace.inline 31.80% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 7 95.38% : 0.000236s : 5: match.inline 4.62% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.07% : 0.000003s : 11: predicate.arithmetic_simplify 1.26% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.34% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_depend_swap 1.30% : 0.000002s : 11: predicate.environ_get_eliminate 1.26% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.78% : 0.000007s : 24: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 16: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 1.57% : 0.000002s : 11: predicate.reduce_eliminate 1.55% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.97% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.05% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.62% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.61% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000913 16 46.54% : 0.000425s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.81% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.65% : 0.000407s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.023346 72 0.23% : 0.000055s : 1: add_recomputation 0.35% : 0.000082s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.28% : 0.000299s : 1: bootstrap 0.12% : 0.000028s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000029s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.13% : 0.000030s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 25.02% : 0.005842s : 1: jit_opt_a 0.71% : 0.000165s : 1: jit_opt_after_cconv 0.23% : 0.000055s : 1: jit_opt_b 2.09% : 0.000489s : 1: loop_unroll 2.57% : 0.000599s : 1: mutable_eliminate 4.28% : 0.001000s : 26: opt.transform.jit_opt_a 0.21% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.23% : 0.000521s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000056s : 1: py_interpret_to_execute 0.06% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000039s : 1: remove_dup_value 2.31% : 0.000539s : 1: renormalize.infer 1.55% : 0.000362s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000043s : 1: rewriter_after_opt_a 0.40% : 0.000093s : 1: rewriter_before_opt_a 0.35% : 0.000082s : 1: symbol_engine_optimizer 54.31% : 0.012679s : 1: type_inference TotalTime = 0.16695, [30] [bootstrap]: 0.00048311 [type_inference]: 0.152825 [event_method]: 2.861e-05 [auto_monad]: 8.547e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 0.00075148 [rewriter_before_opt_a]: 0.00011347 [expand_dump_flag]: 4.38001e-06 [jit_opt_a]: 0.00964544, [2] [Cycle 1]: 0.00490699, [27] [switch_simplify]: 7.852e-05 [loop_unroll]: 3.458e-05 [a_1]: 0.00088348 [with_stream_mark]: 2.7e-05 [recompute_prepare]: 1.146e-05 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.93001e-06 [updatestate_loads_eliminate]: 4.13001e-06 [parameter_eliminate]: 2.49999e-06 [specialize_transform]: 8.08001e-06 [updatestate_useless_node_eliminater]: 6.89001e-06 [accelerated_algorithm]: 7.23e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 7.73001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 1.184e-05 [meta_fg_expand]: 3.19001e-06 [replace_old_param]: 1.206e-05 [inline_without_move]: 6.88998e-06 [renormalize]: 0.00342805 [add_forward_monad_depend]: 1.1e-05 [auto_monad_grad]: 2.43002e-06 [auto_monad_eliminator]: 2.291e-05 [cse]: 4.312e-05 [replace_applicator]: 2.642e-05 [Cycle 2]: 0.00042779, [27] [switch_simplify]: 7.22997e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00014657 [with_stream_mark]: 1.791e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.26003e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 3.95e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.622e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 5.77001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 7.14001e-06 [cse]: 1.508e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 2.058e-05 [rewriter_after_opt_a]: 4.531e-05 [convert_after_rewriter]: 7.89002e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00093674 [jit_opt_b]: 6.608e-05, [1] [Cycle 1]: 5.478e-05, [2] [frontend_op_eliminate]: 2.237e-05 [inline_after_opt_a]: 2.026e-05 [cconv]: 3.564e-05 [loop_unroll]: 0.00052175 [jit_opt_after_cconv]: 0.00019855, [1] [Cycle 1]: 0.00019157, [11] [c_1]: 2.726e-05 [parameter_eliminate]: 4.83001e-06 [updatestate_depend_eliminate]: 9.67001e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 4.219e-05 [call_graph_tuple_transform]: 2.923e-05 [tuple_list_get_item_eliminator]: 7.77998e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 7.14001e-06 [remove_dup_value]: 1.897e-05 [partial_unused_args_eliminate]: 3.33e-06 [environ_conv]: 1.219e-05 [add_recomputation]: 5.931e-05 [cse_after_recomputation]: 2.517e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.878e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 9.91998e-06 [opt_after_jit_grad]: 0.00053891 [symbol_engine_optimizer]: 8.253e-05, [1] [Cycle 1]: 7.539e-05, [6] [build]: 4.97999e-06 [elim_shapecalc]: 9.22999e-06 [elim_not_effective]: 1.639e-05 [opt_reshape]: 7.22002e-06 [fold_const_symbol]: 9.77001e-06 [renormalize]: 4.19997e-07 [validate]: 0.00015717 Sums bootstrap : 0.000483s : 0.30% type_inference : 0.152825s : 94.38% event_method : 0.000029s : 0.02% auto_monad : 0.000085s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000751s : 0.46% rewriter_before_opt_a : 0.000113s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.001030s : 0.64% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003428s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000045s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000937s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000036s : 0.02% loop_unroll : 0.000522s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000042s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000059s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000539s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000157s : 0.10% Time group info: ------[substitution.] 0.000408 28 0.46% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000008s : 4: substitution.graph_param_transform 86.02% : 0.000351s : 5: substitution.inline 1.20% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.93% : 0.000016s : 3: substitution.reduce_eliminate 1.27% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000007s : 2: substitution.replace_old_param 2.90% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.152700 2 97.55% : 0.148959s : 1: type_inference.infer 2.45% : 0.003741s : 1: type_inference.specialize ------[replace.] 0.000112 7 67.07% : 0.000075s : 5: replace.inline 32.93% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000358 7 97.06% : 0.000348s : 5: match.inline 2.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000003s : 13: predicate.addn_zero_filter 1.98% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.00% : 0.000002s : 13: predicate.depend_value_elim 1.26% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.49% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.95% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.91% : 0.000010s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 19: predicate.load_eliminater 1.64% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.27% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 2.12% : 0.000004s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000004s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.48% : 0.000001s : 8: predicate.replace_old_param 0.58% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.77% : 0.000005s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.63% : 0.000013s : 64: predicate.switch_simplify 1.60% : 0.000003s : 13: predicate.tile_eliminate 1.11% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.86% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.06% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003029 25 64.79% : 0.001962s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.81% : 0.000146s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.40% : 0.000921s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.171666 72 0.04% : 0.000063s : 1: add_recomputation 0.05% : 0.000089s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.30% : 0.000511s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.62% : 0.009649s : 1: jit_opt_a 0.12% : 0.000201s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.31% : 0.000532s : 1: loop_unroll 0.55% : 0.000951s : 1: mutable_eliminate 0.77% : 0.001316s : 26: opt.transform.jit_opt_a 0.04% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000551s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000760s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.41% : 0.002414s : 1: renormalize.infer 0.58% : 0.001000s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.07% : 0.000119s : 1: rewriter_before_opt_a 0.05% : 0.000085s : 1: symbol_engine_optimizer 89.04% : 0.152850s : 1: type_inference TotalTime = 0.0149317, [30] [bootstrap]: 0.00035788 [type_inference]: 0.00578364 [event_method]: 2.217e-05 [auto_monad]: 7.257e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 3.25e-06 [py_interpret_to_execute]: 5.751e-05 [rewriter_before_opt_a]: 9.085e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00617629, [2] [Cycle 1]: 0.00193165, [27] [switch_simplify]: 6.588e-05 [loop_unroll]: 3.143e-05 [a_1]: 0.00058544 [with_stream_mark]: 2.276e-05 [recompute_prepare]: 8.20999e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 5.64e-06 [renormalize]: 0.00087368 [add_forward_monad_depend]: 1.145e-05 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.668e-05 [cse]: 3.1e-05 [replace_applicator]: 1.346e-05 [Cycle 2]: 0.00032932, [27] [switch_simplify]: 5.99999e-06 [loop_unroll]: 5.29998e-06 [a_1]: 9.369e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 2.03002e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.84998e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 8.32998e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.76002e-06 [inline_without_move]: 4.83001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.49998e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 7.33999e-06 [cse]: 1.097e-05 [replace_applicator]: 4.99998e-06 [py_interpret_to_execute_after_opt_a]: 1.324e-05 [rewriter_after_opt_a]: 3.841e-05 [convert_after_rewriter]: 7.74002e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00060479 [jit_opt_b]: 5.073e-05, [1] [Cycle 1]: 4.384e-05, [2] [frontend_op_eliminate]: 1.682e-05 [inline_after_opt_a]: 1.574e-05 [cconv]: 2.785e-05 [loop_unroll]: 0.0004346 [jit_opt_after_cconv]: 0.00015025, [1] [Cycle 1]: 0.00014332, [11] [c_1]: 2.198e-05 [parameter_eliminate]: 3.47997e-06 [updatestate_depend_eliminate]: 6.63e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 2.287e-05 [call_graph_tuple_transform]: 1.959e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.70025e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.728e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 5.155e-05 [cse_after_recomputation]: 2.261e-05, [1] [Cycle 1]: 1.751e-05, [1] [cse]: 1.079e-05 [auto_monad_reorder]: 1.631e-05 [get_jit_bprop_graph]: 2.57001e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00051621 [symbol_engine_optimizer]: 7.847e-05, [1] [Cycle 1]: 7.15e-05, [6] [build]: 5.10999e-06 [elim_shapecalc]: 7.92998e-06 [elim_not_effective]: 1.441e-05 [opt_reshape]: 6.46999e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 5.19998e-07 [validate]: 4.804e-05 Sums bootstrap : 0.000358s : 3.46% type_inference : 0.005784s : 55.94% event_method : 0.000022s : 0.21% auto_monad : 0.000073s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000058s : 0.56% rewriter_before_opt_a : 0.000091s : 0.88% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000072s : 0.70% jit_opt_a.loop_unroll : 0.000037s : 0.36% jit_opt_a.a_1 : 0.000679s : 6.57% jit_opt_a.with_stream_mark : 0.000032s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000874s : 8.45% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.13% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.23% jit_opt_a.cse : 0.000042s : 0.41% jit_opt_a.replace_applicator : 0.000018s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000038s : 0.37% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000605s : 5.85% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000028s : 0.27% loop_unroll : 0.000435s : 4.20% jit_opt_after_cconv.c_1 : 0.000022s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.50% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000516s : 4.99% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000048s : 0.46% Time group info: ------[substitution.] 0.000241 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 84.56% : 0.000204s : 4: substitution.inline 1.69% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000005s : 4: substitution.remove_not_recompute_node 2.62% : 0.000006s : 2: substitution.replace_old_param 5.12% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005698 2 78.95% : 0.004499s : 1: type_inference.infer 21.05% : 0.001200s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.73% : 0.000049s : 4: replace.inline 33.27% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.73% : 0.000201s : 4: match.inline 5.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.24% : 0.000003s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.28% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.22% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.45% : 0.000001s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.30% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.94% : 0.000002s : 3: predicate.mutable_eliminate 0.82% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.56% : 0.000002s : 10: predicate.reduce_eliminate 1.70% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.56% : 0.000002s : 18: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000804 13 50.37% : 0.000405s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.16% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.47% : 0.000349s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016758 72 0.33% : 0.000055s : 1: add_recomputation 0.46% : 0.000077s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.26% : 0.000379s : 1: bootstrap 0.18% : 0.000031s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.16% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.87% : 0.006179s : 1: jit_opt_a 0.92% : 0.000154s : 1: jit_opt_after_cconv 0.32% : 0.000053s : 1: jit_opt_b 2.99% : 0.000501s : 1: loop_unroll 3.67% : 0.000615s : 1: mutable_eliminate 5.43% : 0.000909s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.17% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.15% : 0.000528s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000061s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000020s : 1: remove_dup_value 2.85% : 0.000478s : 1: renormalize.infer 2.31% : 0.000387s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000041s : 1: rewriter_after_opt_a 0.57% : 0.000096s : 1: rewriter_before_opt_a 0.48% : 0.000081s : 1: symbol_engine_optimizer 34.64% : 0.005804s : 1: type_inference TotalTime = 0.129211, [30] [bootstrap]: 0.00032857 [type_inference]: 0.116224 [event_method]: 2.556e-05 [auto_monad]: 7.736e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.0005194 [rewriter_before_opt_a]: 0.00010989 [expand_dump_flag]: 4.75999e-06 [jit_opt_a]: 0.00894149, [2] [Cycle 1]: 0.00469072, [27] [switch_simplify]: 6.439e-05 [loop_unroll]: 3.474e-05 [a_1]: 0.00078559 [with_stream_mark]: 2.645e-05 [recompute_prepare]: 1.134e-05 [updatestate_depend_eliminate]: 5.11002e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 7.44002e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.70002e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.732e-05 [j_node_and_user_rematch]: 1.087e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.204e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.00334021 [add_forward_monad_depend]: 1.111e-05 [auto_monad_grad]: 2.82002e-06 [auto_monad_eliminator]: 2.538e-05 [cse]: 4.183e-05 [replace_applicator]: 2.559e-05 [Cycle 2]: 0.00042442, [27] [switch_simplify]: 7.2e-06 [loop_unroll]: 6.17999e-06 [a_1]: 0.00014318 [with_stream_mark]: 1.661e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 3.32997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.133e-05 [inline_without_move]: 5.79e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.84e-06 [auto_monad_grad]: 1.22e-06 [auto_monad_eliminator]: 8.22e-06 [cse]: 1.564e-05 [replace_applicator]: 8.02998e-06 [py_interpret_to_execute_after_opt_a]: 1.968e-05 [rewriter_after_opt_a]: 4.401e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00084183 [jit_opt_b]: 6.34e-05, [1] [Cycle 1]: 5.282e-05, [2] [frontend_op_eliminate]: 2.057e-05 [inline_after_opt_a]: 1.99e-05 [cconv]: 3.592e-05 [loop_unroll]: 0.00055031 [jit_opt_after_cconv]: 0.00019528, [1] [Cycle 1]: 0.00018636, [11] [c_1]: 2.681e-05 [parameter_eliminate]: 5.66998e-06 [updatestate_depend_eliminate]: 1.058e-05 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 2.69999e-06 [cse]: 4.147e-05 [call_graph_tuple_transform]: 2.663e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 2.204e-05 [partial_unused_args_eliminate]: 2.83e-06 [environ_conv]: 1.074e-05 [add_recomputation]: 5.789e-05 [cse_after_recomputation]: 2.694e-05, [1] [Cycle 1]: 2.141e-05, [1] [cse]: 1.39e-05 [auto_monad_reorder]: 1.945e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 8.12e-06 [opt_after_jit_grad]: 0.00057728 [symbol_engine_optimizer]: 8.548e-05, [1] [Cycle 1]: 7.794e-05, [6] [build]: 5.35999e-06 [elim_shapecalc]: 9.24e-06 [elim_not_effective]: 1.617e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 1.041e-05 [renormalize]: 4.00003e-07 [validate]: 0.00017798 Sums bootstrap : 0.000329s : 0.26% type_inference : 0.116224s : 93.21% event_method : 0.000026s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000519s : 0.42% rewriter_before_opt_a : 0.000110s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000929s : 0.74% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003340s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.03% jit_opt_a.cse : 0.000057s : 0.05% jit_opt_a.replace_applicator : 0.000034s : 0.03% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000842s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000550s : 0.44% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000022s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000058s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000577s : 0.46% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000178s : 0.14% Time group info: ------[substitution.] 0.000330 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000007s : 4: substitution.graph_param_transform 83.15% : 0.000275s : 5: substitution.inline 1.51% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.60% : 0.000015s : 3: substitution.reduce_eliminate 1.47% : 0.000005s : 4: substitution.remove_not_recompute_node 2.42% : 0.000008s : 2: substitution.replace_old_param 3.71% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116135 2 97.46% : 0.113185s : 1: type_inference.infer 2.54% : 0.002951s : 1: type_inference.specialize ------[replace.] 0.000115 7 67.59% : 0.000078s : 5: replace.inline 32.41% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000282 7 96.15% : 0.000272s : 5: match.inline 3.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.75% : 0.000003s : 13: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.53% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.93% : 0.000009s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.90% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.75% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000004s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.40% : 0.000004s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.13% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000004s : 20: predicate.switch_defer_inline 1.94% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.30% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.11% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.84% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.74% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.02% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002703 25 62.81% : 0.001698s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.40% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.79% : 0.000913s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133701 72 0.05% : 0.000061s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.26% : 0.000346s : 1: bootstrap 0.03% : 0.000039s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.69% : 0.008946s : 1: jit_opt_a 0.15% : 0.000198s : 1: jit_opt_after_cconv 0.05% : 0.000067s : 1: jit_opt_b 0.42% : 0.000564s : 1: loop_unroll 0.64% : 0.000856s : 1: mutable_eliminate 0.89% : 0.001196s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000590s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000528s : 1: py_interpret_to_execute 0.02% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 1.72% : 0.002306s : 1: renormalize.infer 0.76% : 0.001019s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000048s : 1: rewriter_after_opt_a 0.09% : 0.000116s : 1: rewriter_before_opt_a 0.07% : 0.000089s : 1: symbol_engine_optimizer 86.94% : 0.116243s : 1: type_inference TotalTime = 0.0155848, [30] [bootstrap]: 0.00035075 [type_inference]: 0.00530033 [event_method]: 2.09e-05 [auto_monad]: 7.493e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 4.513e-05 [rewriter_before_opt_a]: 7.626e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.007617, [2] [Cycle 1]: 0.00179312, [27] [switch_simplify]: 6.448e-05 [loop_unroll]: 3.034e-05 [a_1]: 0.00057115 [with_stream_mark]: 2.125e-05 [recompute_prepare]: 7.58001e-06 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 3.04999e-06 [specialize_transform]: 6.45002e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 9.28002e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00075206 [add_forward_monad_depend]: 1.732e-05 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.671e-05 [cse]: 3.033e-05 [replace_applicator]: 1.272e-05 [Cycle 2]: 0.00031794, [27] [switch_simplify]: 5.74999e-06 [loop_unroll]: 4.82e-06 [a_1]: 8.901e-05 [with_stream_mark]: 8.87e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.65999e-06 [accelerated_algorithm]: 4.75001e-06 [meta_shard_fg_expand]: 1.14998e-06 [get_grad_eliminate_]: 4.50001e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.366e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 6.93e-06 [inline_without_move]: 4.58999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.097e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.183e-05 [rewriter_after_opt_a]: 3.655e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00052806 [jit_opt_b]: 5.099e-05, [1] [Cycle 1]: 4.392e-05, [2] [frontend_op_eliminate]: 1.668e-05 [inline_after_opt_a]: 1.623e-05 [cconv]: 2.65e-05 [loop_unroll]: 0.00040482 [jit_opt_after_cconv]: 0.00016862, [1] [Cycle 1]: 0.00016224, [11] [c_1]: 2.016e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2e-05 [call_graph_tuple_transform]: 4.513e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.645e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 5.50001e-06 [add_recomputation]: 5.41e-05 [cse_after_recomputation]: 2.21e-05, [1] [Cycle 1]: 1.665e-05, [1] [cse]: 1.084e-05 [auto_monad_reorder]: 1.615e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 4.35e-06 [opt_after_jit_grad]: 0.00044119 [symbol_engine_optimizer]: 7.052e-05, [1] [Cycle 1]: 6.479e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.216e-05 [opt_reshape]: 5.46e-06 [fold_const_symbol]: 8.49002e-06 [renormalize]: 4.40021e-07 [validate]: 3.482e-05 Sums bootstrap : 0.000351s : 3.70% type_inference : 0.005300s : 55.87% event_method : 0.000021s : 0.22% auto_monad : 0.000075s : 0.79% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.48% rewriter_before_opt_a : 0.000076s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.74% jit_opt_a.loop_unroll : 0.000035s : 0.37% jit_opt_a.a_1 : 0.000660s : 6.96% jit_opt_a.with_stream_mark : 0.000030s : 0.32% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000752s : 7.93% jit_opt_a.add_forward_monad_depend : 0.000018s : 0.19% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.24% jit_opt_a.cse : 0.000041s : 0.44% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000037s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000528s : 5.57% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000026s : 0.28% loop_unroll : 0.000405s : 4.27% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000045s : 0.48% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000054s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000441s : 4.65% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.37% Time group info: ------[substitution.] 0.000239 23 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.39% : 0.000006s : 3: substitution.graph_param_transform 85.56% : 0.000204s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.28% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005212 2 82.65% : 0.004308s : 1: type_inference.infer 17.35% : 0.000904s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.86% : 0.000050s : 4: replace.inline 30.14% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.58% : 0.000202s : 4: match.inline 5.42% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.07% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.43% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.71% : 0.000001s : 3: predicate.graph_param_transform 6.02% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.60% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.98% : 0.000011s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000681 13 50.13% : 0.000341s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.38% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.49% : 0.000289s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017298 72 0.33% : 0.000057s : 1: add_recomputation 0.46% : 0.000079s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.15% : 0.000372s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 44.05% : 0.007620s : 1: jit_opt_a 0.99% : 0.000172s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.39% : 0.000413s : 1: loop_unroll 3.11% : 0.000538s : 1: mutable_eliminate 5.10% : 0.000882s : 26: opt.transform.jit_opt_a 0.42% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.60% : 0.000449s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.49% : 0.000431s : 1: renormalize.infer 1.81% : 0.000313s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000039s : 1: rewriter_after_opt_a 0.46% : 0.000079s : 1: rewriter_before_opt_a 0.42% : 0.000073s : 1: symbol_engine_optimizer 30.74% : 0.005318s : 1: type_inference TotalTime = 0.017664, [30] [bootstrap]: 0.00028729 [type_inference]: 0.00959876 [event_method]: 2.306e-05 [auto_monad]: 7.242e-05 [graph_reusing]: 6.32001e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 4.999e-05 [rewriter_before_opt_a]: 8.448e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.0054153, [2] [Cycle 1]: 0.00180497, [27] [switch_simplify]: 5.857e-05 [loop_unroll]: 3.239e-05 [a_1]: 0.00063168 [with_stream_mark]: 2.004e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.76999e-06 [parameter_eliminate]: 2.44001e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.80998e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 8.70001e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 6.00002e-06 [renormalize]: 0.00070827 [add_forward_monad_depend]: 5.57001e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.516e-05 [cse]: 3.42e-05 [replace_applicator]: 1.408e-05 [Cycle 2]: 0.00033921, [27] [switch_simplify]: 6.08998e-06 [loop_unroll]: 4.98001e-06 [a_1]: 9.728e-05 [with_stream_mark]: 1.127e-05 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.99998e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.102e-05 [j_node_and_user_rematch]: 8.20999e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 6.81999e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.90002e-06 [cse]: 1.27e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 6.144e-05 [rewriter_after_opt_a]: 3.63e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.62001e-06 [mutable_eliminate]: 0.00051286 [jit_opt_b]: 5.016e-05, [1] [Cycle 1]: 4.274e-05, [2] [frontend_op_eliminate]: 1.527e-05 [inline_after_opt_a]: 1.53e-05 [cconv]: 2.455e-05 [loop_unroll]: 0.0004226 [jit_opt_after_cconv]: 0.00014824, [1] [Cycle 1]: 0.0001421, [11] [c_1]: 2.047e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.54001e-06 [cse]: 2.313e-05 [call_graph_tuple_transform]: 1.84e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.52999e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.53002e-06 [add_recomputation]: 4.991e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.755e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00044191 [symbol_engine_optimizer]: 7.447e-05, [1] [Cycle 1]: 6.822e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 7.8e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 8.49998e-06 [renormalize]: 3.39991e-07 [validate]: 3.713e-05 Sums bootstrap : 0.000287s : 2.08% type_inference : 0.009599s : 69.66% event_method : 0.000023s : 0.17% auto_monad : 0.000072s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.36% rewriter_before_opt_a : 0.000084s : 0.61% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.47% jit_opt_a.loop_unroll : 0.000037s : 0.27% jit_opt_a.a_1 : 0.000729s : 5.29% jit_opt_a.with_stream_mark : 0.000031s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000708s : 5.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.15% jit_opt_a.cse : 0.000047s : 0.34% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000061s : 0.45% rewriter_after_opt_a : 0.000036s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000513s : 3.72% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.11% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000025s : 0.18% loop_unroll : 0.000423s : 3.07% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000050s : 0.36% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000442s : 3.21% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.27% Time group info: ------[substitution.] 0.000245 27 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 3: substitution.graph_param_transform 83.14% : 0.000204s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.96% : 0.000010s : 3: substitution.reduce_eliminate 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 4.44% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009522 2 88.28% : 0.008406s : 1: type_inference.infer 11.72% : 0.001116s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.61% : 0.000063s : 5: replace.inline 31.39% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 95.35% : 0.000201s : 5: match.inline 4.65% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.94% : 0.000002s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.21% : 0.000001s : 11: predicate.depend_value_elim 1.25% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.34% : 0.000008s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.69% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.42% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.48% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000001s : 11: predicate.print_const_string_wrapper 1.81% : 0.000002s : 11: predicate.reduce_eliminate 1.55% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 19: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.11% : 0.000010s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.60% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 11: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000830 16 50.80% : 0.000422s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.16% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.04% : 0.000349s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019378 72 0.27% : 0.000053s : 1: add_recomputation 0.40% : 0.000077s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.58% : 0.000305s : 1: bootstrap 0.14% : 0.000027s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000028s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 27.96% : 0.005418s : 1: jit_opt_a 0.78% : 0.000151s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.22% : 0.000431s : 1: loop_unroll 2.69% : 0.000521s : 1: mutable_eliminate 4.90% : 0.000950s : 26: opt.transform.jit_opt_a 0.24% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.32% : 0.000450s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000053s : 1: py_interpret_to_execute 0.34% : 0.000066s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 1.97% : 0.000381s : 1: renormalize.infer 1.65% : 0.000320s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000039s : 1: rewriter_after_opt_a 0.45% : 0.000088s : 1: rewriter_before_opt_a 0.40% : 0.000077s : 1: symbol_engine_optimizer 49.63% : 0.009617s : 1: type_inference TotalTime = 0.0141325, [30] [bootstrap]: 0.00030459 [type_inference]: 0.00617454 [event_method]: 2.219e-05 [auto_monad]: 6.44e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 4.295e-05 [rewriter_before_opt_a]: 7.454e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00538376, [2] [Cycle 1]: 0.00174766, [27] [switch_simplify]: 5.565e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00053889 [with_stream_mark]: 1.971e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 0.00079175 [add_forward_monad_depend]: 5.45001e-06 [auto_monad_grad]: 2.48002e-06 [auto_monad_eliminator]: 1.426e-05 [cse]: 2.721e-05 [replace_applicator]: 1.155e-05 [Cycle 2]: 0.00031259, [27] [switch_simplify]: 5.46e-06 [loop_unroll]: 4.87998e-06 [a_1]: 8.973e-05 [with_stream_mark]: 9.02999e-06 [recompute_prepare]: 5.08002e-06 [updatestate_depend_eliminate]: 2.52001e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.04998e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.60999e-06 [meta_shard_fg_expand]: 1.16997e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.284e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 6.89999e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.121e-05 [replace_applicator]: 5.11997e-06 [py_interpret_to_execute_after_opt_a]: 1.756e-05 [rewriter_after_opt_a]: 3.588e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00055695 [jit_opt_b]: 4.932e-05, [1] [Cycle 1]: 4.219e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.444e-05 [loop_unroll]: 0.0004031 [jit_opt_after_cconv]: 0.0001387, [1] [Cycle 1]: 0.00013229, [11] [c_1]: 2.029e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 5.53002e-06 [updatestate_assign_eliminate]: 2.83003e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 1.935e-05 [call_graph_tuple_transform]: 1.776e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.34998e-06 [remove_dup_value]: 1.452e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 6.27001e-06 [add_recomputation]: 4.744e-05 [cse_after_recomputation]: 2.099e-05, [1] [Cycle 1]: 1.583e-05, [1] [cse]: 1.029e-05 [auto_monad_reorder]: 1.497e-05 [get_jit_bprop_graph]: 2.33002e-06 [rewriter_after_jit_bprop_graph]: 4.51002e-06 [opt_after_jit_grad]: 0.00042809 [symbol_engine_optimizer]: 7.051e-05, [1] [Cycle 1]: 6.482e-05, [6] [build]: 3.43999e-06 [elim_shapecalc]: 7.47998e-06 [elim_not_effective]: 1.267e-05 [opt_reshape]: 6.05002e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 2.50002e-07 [validate]: 3.662e-05 Sums bootstrap : 0.000305s : 2.97% type_inference : 0.006175s : 60.22% event_method : 0.000022s : 0.22% auto_monad : 0.000064s : 0.63% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.42% rewriter_before_opt_a : 0.000075s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.60% jit_opt_a.loop_unroll : 0.000035s : 0.34% jit_opt_a.a_1 : 0.000629s : 6.13% jit_opt_a.with_stream_mark : 0.000029s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000792s : 7.72% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.20% jit_opt_a.cse : 0.000038s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000018s : 0.17% rewriter_after_opt_a : 0.000036s : 0.35% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000557s : 5.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.15% cconv : 0.000024s : 0.24% loop_unroll : 0.000403s : 3.93% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000047s : 0.46% cse_after_recomputation.cse : 0.000010s : 0.10% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000428s : 4.18% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.36% Time group info: ------[substitution.] 0.000209 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000005s : 3: substitution.graph_param_transform 84.10% : 0.000176s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.93% : 0.000004s : 2: substitution.replace_old_param 5.91% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006105 2 81.17% : 0.004955s : 1: type_inference.infer 18.83% : 0.001150s : 1: type_inference.specialize ------[replace.] 0.000071 6 68.60% : 0.000049s : 4: replace.inline 31.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 93.94% : 0.000174s : 4: match.inline 6.06% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.46% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.32% : 0.000008s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.58% : 0.000002s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.02% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000705 13 43.48% : 0.000306s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.58% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.94% : 0.000359s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015813 72 0.32% : 0.000050s : 1: add_recomputation 0.43% : 0.000068s : 1: auto_monad 0.11% : 0.000017s : 1: auto_monad_reorder 2.00% : 0.000317s : 1: bootstrap 0.17% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.17% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 34.06% : 0.005386s : 1: jit_opt_a 0.89% : 0.000141s : 1: jit_opt_after_cconv 0.33% : 0.000052s : 1: jit_opt_b 2.60% : 0.000410s : 1: loop_unroll 3.58% : 0.000566s : 1: mutable_eliminate 5.29% : 0.000837s : 26: opt.transform.jit_opt_a 0.29% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.76% : 0.000436s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000046s : 1: py_interpret_to_execute 0.13% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 2.78% : 0.000439s : 1: renormalize.infer 2.18% : 0.000345s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000039s : 1: rewriter_after_opt_a 0.49% : 0.000077s : 1: rewriter_before_opt_a 0.46% : 0.000073s : 1: symbol_engine_optimizer 39.17% : 0.006194s : 1: type_inference TotalTime = 0.176296, [30] [bootstrap]: 0.00044843 [type_inference]: 0.158532 [event_method]: 3.376e-05 [auto_monad]: 0.00010973 [graph_reusing]: 7.29001e-06 [pre_auto_parallel]: 3.21999e-06 [py_interpret_to_execute]: 0.00099921 [rewriter_before_opt_a]: 0.00013313 [expand_dump_flag]: 3.73999e-06 [jit_opt_a]: 0.0120397, [2] [Cycle 1]: 0.00644687, [27] [switch_simplify]: 0.00010407 [loop_unroll]: 3.61e-05 [a_1]: 0.00097199 [with_stream_mark]: 2.683e-05 [recompute_prepare]: 9.46e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 7.97e-06 [updatestate_useless_node_eliminater]: 6.39999e-06 [accelerated_algorithm]: 7.47002e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.84001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.721e-05 [j_node_and_user_rematch]: 1.196e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.184e-05 [inline_without_move]: 6.90002e-06 [renormalize]: 0.00482778 [add_forward_monad_depend]: 1.188e-05 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 2.796e-05 [cse]: 4.523e-05 [replace_applicator]: 2.846e-05 [Cycle 2]: 0.00049502, [27] [switch_simplify]: 8.62998e-06 [loop_unroll]: 6.73998e-06 [a_1]: 0.00016279 [with_stream_mark]: 2.05e-05 [recompute_prepare]: 9.47001e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.98998e-06 [updatestate_useless_node_eliminater]: 7.21001e-06 [accelerated_algorithm]: 7.94997e-06 [meta_shard_fg_expand]: 3.51999e-06 [get_grad_eliminate_]: 6.74999e-06 [merge_forward]: 5.09e-06 [cell_reuse_recompute_pass]: 4.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.858e-05 [j_node_and_user_rematch]: 1.192e-05 [meta_fg_expand]: 3.81999e-06 [replace_old_param]: 1.197e-05 [inline_without_move]: 5.56e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.92999e-06 [auto_monad_grad]: 1.46998e-06 [auto_monad_eliminator]: 1.027e-05 [cse]: 2.105e-05 [replace_applicator]: 7.87998e-06 [py_interpret_to_execute_after_opt_a]: 2.438e-05 [rewriter_after_opt_a]: 5.046e-05 [convert_after_rewriter]: 8.71002e-06 [order_py_execute_after_rewriter]: 6.81001e-06 [mutable_eliminate]: 0.0011235 [jit_opt_b]: 8.463e-05, [1] [Cycle 1]: 7.292e-05, [2] [frontend_op_eliminate]: 2.991e-05 [inline_after_opt_a]: 2.777e-05 [cconv]: 4.107e-05 [loop_unroll]: 0.0007036 [jit_opt_after_cconv]: 0.00022262, [1] [Cycle 1]: 0.00021452, [11] [c_1]: 3.557e-05 [parameter_eliminate]: 5.44998e-06 [updatestate_depend_eliminate]: 1.145e-05 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 4.421e-05 [call_graph_tuple_transform]: 3.397e-05 [tuple_list_get_item_eliminator]: 7.54002e-06 [none_parameter_eliminate]: 2.30002e-06 [renormalize]: 1.05999e-06 [switch_simplify]: 7.65e-06 [remove_dup_value]: 2.327e-05 [partial_unused_args_eliminate]: 3.04001e-06 [environ_conv]: 1.336e-05 [add_recomputation]: 0.00012644 [cse_after_recomputation]: 4.079e-05, [1] [Cycle 1]: 3.076e-05, [1] [cse]: 2.057e-05 [auto_monad_reorder]: 2.184e-05 [get_jit_bprop_graph]: 2.73998e-06 [rewriter_after_jit_bprop_graph]: 1.04e-05 [opt_after_jit_grad]: 0.00074121 [symbol_engine_optimizer]: 0.00034448, [1] [Cycle 1]: 0.0003341, [6] [build]: 7.31001e-06 [elim_shapecalc]: 1.122e-05 [elim_not_effective]: 1.819e-05 [opt_reshape]: 0.00023956 [fold_const_symbol]: 1.508e-05 [renormalize]: 7.89994e-07 [validate]: 8.329e-05 Sums bootstrap : 0.000448s : 0.26% type_inference : 0.158532s : 93.07% event_method : 0.000034s : 0.02% auto_monad : 0.000110s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000999s : 0.59% rewriter_before_opt_a : 0.000133s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000113s : 0.07% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.001135s : 0.67% jit_opt_a.with_stream_mark : 0.000047s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004828s : 2.83% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.02% jit_opt_a.cse : 0.000066s : 0.04% jit_opt_a.replace_applicator : 0.000036s : 0.02% py_interpret_to_execute_after_opt_a : 0.000024s : 0.01% rewriter_after_opt_a : 0.000050s : 0.03% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.001123s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000030s : 0.02% jit_opt_b.inline_after_opt_a : 0.000028s : 0.02% cconv : 0.000041s : 0.02% loop_unroll : 0.000704s : 0.41% jit_opt_after_cconv.c_1 : 0.000036s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000034s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000126s : 0.07% cse_after_recomputation.cse : 0.000021s : 0.01% auto_monad_reorder : 0.000022s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000741s : 0.44% symbol_engine_optimizer.build : 0.000007s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000240s : 0.14% symbol_engine_optimizer.fold_const_symbol : 0.000015s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000083s : 0.05% Time group info: ------[substitution.] 0.000449 28 0.48% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000002s : 2: substitution.fold_const_symbol 1.86% : 0.000008s : 4: substitution.graph_param_transform 86.21% : 0.000387s : 5: substitution.inline 1.43% : 0.000006s : 4: substitution.j_node_and_user_rematch 3.71% : 0.000017s : 3: substitution.reduce_eliminate 1.40% : 0.000006s : 4: substitution.remove_not_recompute_node 1.77% : 0.000008s : 2: substitution.replace_old_param 2.66% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.158373 2 96.36% : 0.152606s : 1: type_inference.infer 3.64% : 0.005766s : 1: type_inference.specialize ------[replace.] 0.000151 7 71.78% : 0.000109s : 5: replace.inline 28.22% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000395 7 97.26% : 0.000384s : 5: match.inline 2.74% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 886 1.54% : 0.000003s : 13: predicate.accumulaten_eliminater 2.30% : 0.000004s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000002s : 13: predicate.addn_check_dump 1.51% : 0.000003s : 13: predicate.addn_zero_filter 2.13% : 0.000004s : 13: predicate.arithmetic_simplify 1.72% : 0.000003s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 0.97% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_depend_swap 1.36% : 0.000002s : 13: predicate.environ_get_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 4.96% : 0.000009s : 28: predicate.inline 0.73% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 2.45% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.55% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.29% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 0.99% : 0.000002s : 13: predicate.minmaximum_grad 3.26% : 0.000006s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 1.89% : 0.000003s : 19: predicate.partial_eliminate 1.07% : 0.000002s : 13: predicate.print_const_string_wrapper 2.10% : 0.000004s : 13: predicate.reduce_eliminate 1.65% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.03% : 0.000002s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 8: predicate.special_op_eliminate 0.78% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 0.96% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.34% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000004s : 20: predicate.switch_defer_inline 1.85% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.32% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.49% : 0.000003s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000003s : 13: predicate.value_based_eliminate 0.27% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.07% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003936 25 61.62% : 0.002425s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000114s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.48% : 0.001397s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.182903 72 0.07% : 0.000131s : 1: add_recomputation 0.06% : 0.000115s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.26% : 0.000471s : 1: bootstrap 0.02% : 0.000044s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000044s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000042s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.59% : 0.012046s : 1: jit_opt_a 0.12% : 0.000226s : 1: jit_opt_after_cconv 0.05% : 0.000089s : 1: jit_opt_b 0.39% : 0.000721s : 1: loop_unroll 0.62% : 0.001141s : 1: mutable_eliminate 0.80% : 0.001455s : 26: opt.transform.jit_opt_a 0.04% : 0.000080s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000047s : 4: opt.transform.jit_opt_b 0.01% : 0.000027s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000032s : 1: opt.transform.mutable_eliminate 0.03% : 0.000048s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000278s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000756s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.55% : 0.001008s : 1: py_interpret_to_execute 0.02% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000028s : 1: remove_dup_value 1.84% : 0.003365s : 1: renormalize.infer 0.79% : 0.001448s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000056s : 1: rewriter_after_opt_a 0.08% : 0.000141s : 1: rewriter_before_opt_a 0.19% : 0.000348s : 1: symbol_engine_optimizer 86.70% : 0.158584s : 1: type_inference TotalTime = 0.12833, [30] [bootstrap]: 0.0003766 [type_inference]: 0.117013 [event_method]: 2.209e-05 [auto_monad]: 7.53e-05 [graph_reusing]: 6.41998e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 0.00051556 [rewriter_before_opt_a]: 9.602e-05 [expand_dump_flag]: 4.2e-06 [jit_opt_a]: 0.00771299, [2] [Cycle 1]: 0.00364855, [27] [switch_simplify]: 6.057e-05 [loop_unroll]: 3.355e-05 [a_1]: 0.00065717 [with_stream_mark]: 2.203e-05 [recompute_prepare]: 1.086e-05 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00250665 [add_forward_monad_depend]: 6.79001e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 1.813e-05 [cse]: 3.177e-05 [replace_applicator]: 1.809e-05 [Cycle 2]: 0.00039385, [27] [switch_simplify]: 7.68999e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00013678 [with_stream_mark]: 1.174e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.50003e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.24003e-06 [specialize_transform]: 6.03002e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 1.66998e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.46999e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.96e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 6.59999e-06 [cse]: 1.269e-05 [replace_applicator]: 6.19001e-06 [py_interpret_to_execute_after_opt_a]: 1.364e-05 [rewriter_after_opt_a]: 3.911e-05 [convert_after_rewriter]: 7.55998e-06 [order_py_execute_after_rewriter]: 5.89e-06 [mutable_eliminate]: 0.00078286 [jit_opt_b]: 6.455e-05, [1] [Cycle 1]: 5.65e-05, [2] [frontend_op_eliminate]: 2.287e-05 [inline_after_opt_a]: 2.094e-05 [cconv]: 2.794e-05 [loop_unroll]: 0.00045251 [jit_opt_after_cconv]: 0.00016151, [1] [Cycle 1]: 0.00015512, [11] [c_1]: 2.792e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.528e-05 [call_graph_tuple_transform]: 2.265e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 6.18002e-06 [remove_dup_value]: 1.607e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 8.48999e-06 [add_recomputation]: 5.293e-05 [cse_after_recomputation]: 2.345e-05, [1] [Cycle 1]: 1.703e-05, [1] [cse]: 1.123e-05 [auto_monad_reorder]: 1.511e-05 [get_jit_bprop_graph]: 2.03997e-06 [rewriter_after_jit_bprop_graph]: 4.79998e-06 [opt_after_jit_grad]: 0.00048026 [symbol_engine_optimizer]: 8.209e-05, [1] [Cycle 1]: 7.643e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 1.013e-05 [elim_not_effective]: 1.557e-05 [opt_reshape]: 7.06001e-06 [fold_const_symbol]: 1.137e-05 [renormalize]: 3.89991e-07 [validate]: 4.706e-05 Sums bootstrap : 0.000377s : 0.30% type_inference : 0.117013s : 94.35% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000516s : 0.42% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000794s : 0.64% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002507s : 2.02% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000783s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000453s : 0.36% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000253 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 1.12% : 0.000003s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 4: substitution.graph_param_transform 84.97% : 0.000215s : 4: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116926 2 97.74% : 0.114278s : 1: type_inference.infer 2.26% : 0.002648s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.94% : 0.000054s : 4: replace.inline 32.06% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.57% : 0.000212s : 4: match.inline 5.43% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.39% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.89% : 0.000008s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.98% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.57% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002287 22 67.17% : 0.001536s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.35% : 0.000694s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131951 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.30% : 0.000399s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.85% : 0.007716s : 1: jit_opt_a 0.12% : 0.000164s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.35% : 0.000461s : 1: loop_unroll 0.60% : 0.000793s : 1: mutable_eliminate 0.79% : 0.001043s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000525s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.33% : 0.001749s : 1: renormalize.infer 0.57% : 0.000747s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 88.70% : 0.117040s : 1: type_inference TotalTime = 0.0225839, [30] [bootstrap]: 0.00038595 [type_inference]: 0.0107902 [event_method]: 3.387e-05 [auto_monad]: 9.49e-05 [graph_reusing]: 7.78999e-06 [pre_auto_parallel]: 3.7e-06 [py_interpret_to_execute]: 0.0001248 [rewriter_before_opt_a]: 0.00011487 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.0084815, [2] [Cycle 1]: 0.00261322, [27] [switch_simplify]: 8.837e-05 [loop_unroll]: 3.42e-05 [a_1]: 0.00079809 [with_stream_mark]: 2.742e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.038e-05 [inline_without_move]: 6.15002e-06 [renormalize]: 0.00122281 [add_forward_monad_depend]: 6.33e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 4.058e-05 [replace_applicator]: 1.459e-05 [Cycle 2]: 0.000335, [27] [switch_simplify]: 5.81e-06 [loop_unroll]: 5.09e-06 [a_1]: 0.00010116 [with_stream_mark]: 1.024e-05 [recompute_prepare]: 5.42999e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.073e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 5.03002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 1.268e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.486e-05 [rewriter_after_opt_a]: 4.171e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00073917 [jit_opt_b]: 6.459e-05, [1] [Cycle 1]: 4.546e-05, [2] [frontend_op_eliminate]: 1.736e-05 [inline_after_opt_a]: 1.72e-05 [cconv]: 2.917e-05 [loop_unroll]: 0.00050422 [jit_opt_after_cconv]: 0.00015322, [1] [Cycle 1]: 0.00014627, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.27001e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.45002e-06 [cse]: 2.414e-05 [call_graph_tuple_transform]: 2.081e-05 [tuple_list_get_item_eliminator]: 5.59998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.646e-05 [partial_unused_args_eliminate]: 2.54001e-06 [environ_conv]: 6.48e-06 [add_recomputation]: 5.707e-05 [cse_after_recomputation]: 2.618e-05, [1] [Cycle 1]: 1.936e-05, [1] [cse]: 1.323e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.91e-06 [rewriter_after_jit_bprop_graph]: 6.21998e-06 [opt_after_jit_grad]: 0.00048194 [symbol_engine_optimizer]: 7.894e-05, [1] [Cycle 1]: 7.223e-05, [6] [build]: 3.76001e-06 [elim_shapecalc]: 8.50999e-06 [elim_not_effective]: 1.485e-05 [opt_reshape]: 6.40997e-06 [fold_const_symbol]: 9.46998e-06 [renormalize]: 4.19997e-07 [validate]: 4.89e-05 Sums bootstrap : 0.000386s : 2.37% type_inference : 0.010790s : 66.19% event_method : 0.000034s : 0.21% auto_monad : 0.000095s : 0.58% graph_reusing : 0.000008s : 0.05% pre_auto_parallel : 0.000004s : 0.02% py_interpret_to_execute : 0.000125s : 0.77% rewriter_before_opt_a : 0.000115s : 0.70% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000094s : 0.58% jit_opt_a.loop_unroll : 0.000039s : 0.24% jit_opt_a.a_1 : 0.000899s : 5.52% jit_opt_a.with_stream_mark : 0.000038s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.001223s : 7.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.14% jit_opt_a.cse : 0.000053s : 0.33% jit_opt_a.replace_applicator : 0.000020s : 0.12% py_interpret_to_execute_after_opt_a : 0.000015s : 0.09% rewriter_after_opt_a : 0.000042s : 0.26% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000739s : 4.53% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000029s : 0.18% loop_unroll : 0.000504s : 3.09% jit_opt_after_cconv.c_1 : 0.000022s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000016s : 0.10% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000057s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000482s : 2.96% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.30% Time group info: ------[substitution.] 0.000361 27 0.74% : 0.000003s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.81% : 0.000007s : 3: substitution.graph_param_transform 86.72% : 0.000313s : 5: substitution.inline 1.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.04% : 0.000011s : 3: substitution.reduce_eliminate 1.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.41% : 0.000005s : 2: substitution.replace_old_param 3.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010653 2 81.64% : 0.008697s : 1: type_inference.infer 18.36% : 0.001956s : 1: type_inference.specialize ------[replace.] 0.000120 7 66.59% : 0.000080s : 5: replace.inline 33.41% : 0.000040s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000321 7 96.48% : 0.000309s : 5: match.inline 3.52% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 2.58% : 0.000003s : 11: predicate.arithmetic_simplify 1.42% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000002s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.08% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.33% : 0.000007s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 16: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 2.08% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000002s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.71% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 19: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000002s : 11: predicate.reshape_eliminate 1.57% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.74% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.36% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.67% : 0.000012s : 59: predicate.switch_simplify 1.54% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.56% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001346 16 38.47% : 0.000518s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.55% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 53.98% : 0.000727s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024991 72 0.24% : 0.000060s : 1: add_recomputation 0.40% : 0.000101s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.64% : 0.000409s : 1: bootstrap 0.13% : 0.000032s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.16% : 0.000041s : 1: event_method 0.03% : 0.000008s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 33.96% : 0.008487s : 1: jit_opt_a 0.62% : 0.000156s : 1: jit_opt_after_cconv 0.27% : 0.000067s : 1: jit_opt_b 2.05% : 0.000513s : 1: loop_unroll 2.99% : 0.000748s : 1: mutable_eliminate 4.62% : 0.001155s : 26: opt.transform.jit_opt_a 0.20% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.09% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.96% : 0.000490s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000006s : 1: pre_auto_parallel 0.52% : 0.000130s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000019s : 1: remove_dup_value 2.93% : 0.000732s : 1: renormalize.infer 1.92% : 0.000480s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000045s : 1: rewriter_after_opt_a 0.49% : 0.000122s : 1: rewriter_before_opt_a 0.33% : 0.000083s : 1: symbol_engine_optimizer 43.31% : 0.010825s : 1: type_inference TotalTime = 0.14918, [30] [bootstrap]: 0.00024562 [type_inference]: 0.137012 [event_method]: 2.838e-05 [auto_monad]: 8.536e-05 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 3.2e-06 [py_interpret_to_execute]: 0.0006161 [rewriter_before_opt_a]: 0.00012285 [expand_dump_flag]: 4.72e-06 [jit_opt_a]: 0.00837148, [2] [Cycle 1]: 0.00429554, [27] [switch_simplify]: 7.048e-05 [loop_unroll]: 3.633e-05 [a_1]: 0.00070471 [with_stream_mark]: 2.095e-05 [recompute_prepare]: 9.74999e-06 [updatestate_depend_eliminate]: 4.39002e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 7.43999e-06 [updatestate_useless_node_eliminater]: 6.71999e-06 [accelerated_algorithm]: 6.86001e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.711e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.075e-05 [inline_without_move]: 6.45002e-06 [renormalize]: 0.0030629 [add_forward_monad_depend]: 7.71999e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 2.126e-05 [cse]: 3.964e-05 [replace_applicator]: 2.066e-05 [Cycle 2]: 0.00039398, [27] [switch_simplify]: 8.14997e-06 [loop_unroll]: 6.42001e-06 [a_1]: 0.00012988 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 6.51e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.96998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.828e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 6.04001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.44001e-06 [cse]: 1.434e-05 [replace_applicator]: 6.34001e-06 [py_interpret_to_execute_after_opt_a]: 1.407e-05 [rewriter_after_opt_a]: 4.323e-05 [convert_after_rewriter]: 7.55e-06 [order_py_execute_after_rewriter]: 5.61998e-06 [mutable_eliminate]: 0.00073459 [jit_opt_b]: 6.56e-05, [1] [Cycle 1]: 5.733e-05, [2] [frontend_op_eliminate]: 2.316e-05 [inline_after_opt_a]: 2.177e-05 [cconv]: 2.798e-05 [loop_unroll]: 0.00049464 [jit_opt_after_cconv]: 0.00017349, [1] [Cycle 1]: 0.00016629, [11] [c_1]: 2.831e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 6.45002e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 2.916e-05 [call_graph_tuple_transform]: 2.341e-05 [tuple_list_get_item_eliminator]: 7.82002e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 7.31999e-06 [remove_dup_value]: 2.09e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 9.20999e-06 [add_recomputation]: 5.6e-05 [cse_after_recomputation]: 2.824e-05, [1] [Cycle 1]: 2.178e-05, [1] [cse]: 1.52e-05 [auto_monad_reorder]: 1.882e-05 [get_jit_bprop_graph]: 3.26001e-06 [rewriter_after_jit_bprop_graph]: 5.42999e-06 [opt_after_jit_grad]: 0.00052967 [symbol_engine_optimizer]: 0.00016631, [1] [Cycle 1]: 0.00015932, [6] [build]: 3.97002e-06 [elim_shapecalc]: 1.083e-05 [elim_not_effective]: 1.515e-05 [opt_reshape]: 8.31e-05 [fold_const_symbol]: 1.3e-05 [renormalize]: 9.50007e-07 [validate]: 5.321e-05 Sums bootstrap : 0.000246s : 0.17% type_inference : 0.137012s : 94.60% event_method : 0.000028s : 0.02% auto_monad : 0.000085s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000616s : 0.43% rewriter_before_opt_a : 0.000123s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000835s : 0.58% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003063s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000735s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000495s : 0.34% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000530s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000083s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.04% Time group info: ------[substitution.] 0.000256 25 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.68% : 0.000007s : 4: substitution.graph_param_transform 84.59% : 0.000216s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000006s : 4: substitution.remove_not_recompute_node 2.42% : 0.000006s : 2: substitution.replace_old_param 5.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.136897 2 97.70% : 0.133743s : 1: type_inference.infer 2.30% : 0.003154s : 1: type_inference.specialize ------[replace.] 0.000109 7 66.38% : 0.000072s : 5: replace.inline 33.62% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 94.74% : 0.000214s : 5: match.inline 5.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.15% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.35% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.87% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.71% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.97% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000011s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002493 25 61.28% : 0.001527s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.62% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.10% : 0.000900s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153510 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000090s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.17% : 0.000256s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.46% : 0.008375s : 1: jit_opt_a 0.11% : 0.000176s : 1: jit_opt_after_cconv 0.04% : 0.000068s : 1: jit_opt_b 0.33% : 0.000503s : 1: loop_unroll 0.48% : 0.000744s : 1: mutable_eliminate 0.72% : 0.001108s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000118s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000539s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000645s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.38% : 0.002115s : 1: renormalize.infer 0.61% : 0.000936s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000130s : 1: rewriter_before_opt_a 0.11% : 0.000169s : 1: symbol_engine_optimizer 89.27% : 0.137042s : 1: type_inference TotalTime = 0.125521, [30] [bootstrap]: 0.00033181 [type_inference]: 0.112739 [event_method]: 1.973e-05 [auto_monad]: 7.288e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00045437 [rewriter_before_opt_a]: 9.041e-05 [expand_dump_flag]: 4.01001e-06 [jit_opt_a]: 0.00817143, [2] [Cycle 1]: 0.00413263, [27] [switch_simplify]: 6.107e-05 [loop_unroll]: 3.109e-05 [a_1]: 0.00060162 [with_stream_mark]: 1.904e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.49002e-06 [updatestate_assign_eliminate]: 3.85998e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.08002e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.38003e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 6.36998e-06 [merge_forward]: 4.44998e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00299261 [add_forward_monad_depend]: 1.288e-05 [auto_monad_grad]: 3.01999e-06 [auto_monad_eliminator]: 2.465e-05 [cse]: 3.785e-05 [replace_applicator]: 2.907e-05 [Cycle 2]: 0.0004607, [27] [switch_simplify]: 7.73001e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00013565 [with_stream_mark]: 1.89e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 2.11998e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.88002e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.88001e-06 [cell_reuse_recompute_pass]: 3.14001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.194e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 3.49001e-06 [replace_old_param]: 1.282e-05 [inline_without_move]: 6.15002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.44999e-06 [auto_monad_grad]: 2.00002e-06 [auto_monad_eliminator]: 1.252e-05 [cse]: 1.985e-05 [replace_applicator]: 7.64002e-06 [py_interpret_to_execute_after_opt_a]: 2.308e-05 [rewriter_after_opt_a]: 4.816e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 6.07001e-06 [mutable_eliminate]: 0.00105345 [jit_opt_b]: 8.139e-05, [1] [Cycle 1]: 7.006e-05, [2] [frontend_op_eliminate]: 2.362e-05 [inline_after_opt_a]: 3.094e-05 [cconv]: 4.341e-05 [loop_unroll]: 0.00071341 [jit_opt_after_cconv]: 0.00022732, [1] [Cycle 1]: 0.0002188, [11] [c_1]: 2.945e-05 [parameter_eliminate]: 6.93e-06 [updatestate_depend_eliminate]: 1.353e-05 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 2.90002e-06 [cse]: 5.274e-05 [call_graph_tuple_transform]: 3.07e-05 [tuple_list_get_item_eliminator]: 7.08998e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 1.91e-06 [switch_simplify]: 6.59999e-06 [remove_dup_value]: 1.909e-05 [partial_unused_args_eliminate]: 2.79999e-06 [environ_conv]: 1.357e-05 [add_recomputation]: 6.611e-05 [cse_after_recomputation]: 2.892e-05, [1] [Cycle 1]: 2.157e-05, [1] [cse]: 1.419e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 1.215e-05 [opt_after_jit_grad]: 0.00074194 [symbol_engine_optimizer]: 0.00020501, [1] [Cycle 1]: 0.00019681, [6] [build]: 4.92e-06 [elim_shapecalc]: 9.92001e-06 [elim_not_effective]: 0.00012297 [opt_reshape]: 8e-06 [fold_const_symbol]: 1.177e-05 [renormalize]: 9.10019e-07 [validate]: 6.448e-05 Sums bootstrap : 0.000332s : 0.27% type_inference : 0.112739s : 93.04% event_method : 0.000020s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000454s : 0.37% rewriter_before_opt_a : 0.000090s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000737s : 0.61% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002993s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.03% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000037s : 0.03% py_interpret_to_execute_after_opt_a : 0.000023s : 0.02% rewriter_after_opt_a : 0.000048s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.001053s : 0.87% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000031s : 0.03% cconv : 0.000043s : 0.04% loop_unroll : 0.000713s : 0.59% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000014s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000053s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000031s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000002s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.01% add_recomputation : 0.000066s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000742s : 0.61% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000123s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000064s : 0.05% Time group info: ------[substitution.] 0.000333 24 31.85% : 0.000106s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 2.18% : 0.000007s : 4: substitution.graph_param_transform 56.03% : 0.000186s : 4: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000007s : 4: substitution.remove_not_recompute_node 2.14% : 0.000007s : 2: substitution.replace_old_param 3.99% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112651 2 97.68% : 0.110034s : 1: type_inference.infer 2.32% : 0.002617s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.34% : 0.000055s : 4: replace.inline 31.66% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 93.75% : 0.000184s : 4: match.inline 6.25% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 830 1.67% : 0.000003s : 12: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 0.93% : 0.000001s : 12: predicate.compare_switch_simplify 1.01% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.31% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.31% : 0.000008s : 26: predicate.inline 0.96% : 0.000002s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 18: predicate.load_eliminater 2.53% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.40% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 0.88% : 0.000001s : 12: predicate.minmaximum_grad 3.11% : 0.000005s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.50% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.85% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.57% : 0.000002s : 12: predicate.reshape_eliminate 1.09% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.28% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 1.90% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.46% : 0.000010s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.42% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002158 22 70.52% : 0.001522s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.02% : 0.000605s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129798 72 0.05% : 0.000070s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000354s : 1: bootstrap 0.04% : 0.000047s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.30% : 0.008176s : 1: jit_opt_a 0.18% : 0.000232s : 1: jit_opt_after_cconv 0.07% : 0.000085s : 1: jit_opt_b 0.56% : 0.000728s : 1: loop_unroll 0.83% : 0.001078s : 1: mutable_eliminate 0.78% : 0.001007s : 26: opt.transform.jit_opt_a 0.05% : 0.000070s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000045s : 4: opt.transform.jit_opt_b 0.02% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000099s : 1: opt.transform.mutable_eliminate 0.03% : 0.000039s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000149s : 4: opt.transform.symbol_engine_opt 0.58% : 0.000758s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000461s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.73% : 0.002242s : 1: renormalize.infer 0.57% : 0.000737s : 1: renormalize.specialize 0.01% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000054s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.16% : 0.000209s : 1: symbol_engine_optimizer 86.87% : 0.112757s : 1: type_inference TotalTime = 0.137455, [30] [bootstrap]: 0.00027771 [type_inference]: 0.126821 [event_method]: 2.221e-05 [auto_monad]: 7.56e-05 [graph_reusing]: 5.65001e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00047484 [rewriter_before_opt_a]: 9.485e-05 [expand_dump_flag]: 4.18999e-06 [jit_opt_a]: 0.00747617, [2] [Cycle 1]: 0.00371082, [27] [switch_simplify]: 6.002e-05 [loop_unroll]: 3.499e-05 [a_1]: 0.00066734 [with_stream_mark]: 1.712e-05 [recompute_prepare]: 8.87e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.76999e-06 [updatestate_loads_eliminate]: 3.93999e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 6.37001e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.80002e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00257093 [add_forward_monad_depend]: 6.43e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 3.414e-05 [replace_applicator]: 1.683e-05 [Cycle 2]: 0.00037938, [27] [switch_simplify]: 6.79999e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00013037 [with_stream_mark]: 1.181e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.24001e-06 [cell_reuse_recompute_pass]: 2.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.267e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.61e-06 [cse]: 1.351e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.346e-05 [rewriter_after_opt_a]: 3.708e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00058023 [jit_opt_b]: 5.664e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.864e-05 [inline_after_opt_a]: 1.891e-05 [cconv]: 2.556e-05 [loop_unroll]: 0.00042591 [jit_opt_after_cconv]: 0.00015136, [1] [Cycle 1]: 0.00014471, [11] [c_1]: 2.569e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 5.84e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.174e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.50997e-06 [environ_conv]: 8.80999e-06 [add_recomputation]: 4.856e-05 [cse_after_recomputation]: 2.295e-05, [1] [Cycle 1]: 1.758e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00045833 [symbol_engine_optimizer]: 9.082e-05, [1] [Cycle 1]: 8.48e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 8.37e-06 [elim_not_effective]: 1.345e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 2.533e-05 [renormalize]: 3.00002e-07 [validate]: 4.355e-05 Sums bootstrap : 0.000278s : 0.21% type_inference : 0.126821s : 95.02% event_method : 0.000022s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000475s : 0.36% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000798s : 0.60% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002571s : 1.93% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000580s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000426s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000458s : 0.34% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000025s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.03% Time group info: ------[substitution.] 0.000250 28 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 82.07% : 0.000205s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.65% : 0.000012s : 3: substitution.reduce_eliminate 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 4.19% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126736 2 97.75% : 0.123884s : 1: type_inference.infer 2.25% : 0.002852s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.55% : 0.000064s : 5: replace.inline 31.45% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 95.55% : 0.000202s : 5: match.inline 4.45% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.53% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.68% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 20: predicate.switch_defer_inline 2.35% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.51% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002442 25 63.37% : 0.001547s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.36% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.27% : 0.000837s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141153 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000297s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.30% : 0.007480s : 1: jit_opt_a 0.11% : 0.000154s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.31% : 0.000434s : 1: loop_unroll 0.42% : 0.000589s : 1: mutable_eliminate 0.74% : 0.001041s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000467s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000481s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.21% : 0.001715s : 1: renormalize.infer 0.60% : 0.000847s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000100s : 1: rewriter_before_opt_a 0.07% : 0.000093s : 1: symbol_engine_optimizer 89.86% : 0.126838s : 1: type_inference TotalTime = 0.183786, [30] [bootstrap]: 0.00032142 [type_inference]: 0.173025 [event_method]: 2.148e-05 [auto_monad]: 7.699e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.00050317 [rewriter_before_opt_a]: 8.987e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00749614, [2] [Cycle 1]: 0.00367933, [27] [switch_simplify]: 5.973e-05 [loop_unroll]: 3.248e-05 [a_1]: 0.00061272 [with_stream_mark]: 2.024e-05 [recompute_prepare]: 8.77999e-06 [updatestate_depend_eliminate]: 4.46002e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.44998e-06 [inline_without_move]: 6.43e-06 [renormalize]: 0.00260272 [add_forward_monad_depend]: 6.14001e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.863e-05 [cse]: 3.024e-05 [replace_applicator]: 1.575e-05 [Cycle 2]: 0.00037365, [27] [switch_simplify]: 6.78998e-06 [loop_unroll]: 6.03002e-06 [a_1]: 0.00012451 [with_stream_mark]: 1.126e-05 [recompute_prepare]: 6.40002e-06 [updatestate_depend_eliminate]: 3.57997e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 9.88002e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.213e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.218e-05 [rewriter_after_opt_a]: 3.766e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00056083 [jit_opt_b]: 5.726e-05, [1] [Cycle 1]: 4.911e-05, [2] [frontend_op_eliminate]: 2.022e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 2.633e-05 [loop_unroll]: 0.00042951 [jit_opt_after_cconv]: 0.0001539, [1] [Cycle 1]: 0.00014705, [11] [c_1]: 2.642e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.028e-05 [call_graph_tuple_transform]: 2.179e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 1.455e-05 [partial_unused_args_eliminate]: 2.52001e-06 [environ_conv]: 8.32e-06 [add_recomputation]: 5.155e-05 [cse_after_recomputation]: 2.254e-05, [1] [Cycle 1]: 1.733e-05, [1] [cse]: 1.083e-05 [auto_monad_reorder]: 1.566e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.33001e-06 [opt_after_jit_grad]: 0.00051219 [symbol_engine_optimizer]: 7.596e-05, [1] [Cycle 1]: 6.898e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 8.60001e-06 [elim_not_effective]: 1.384e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 9.29e-06 [renormalize]: 4.00003e-07 [validate]: 4.279e-05 Sums bootstrap : 0.000321s : 0.18% type_inference : 0.173025s : 96.27% event_method : 0.000021s : 0.01% auto_monad : 0.000077s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000503s : 0.28% rewriter_before_opt_a : 0.000090s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.04% jit_opt_a.loop_unroll : 0.000039s : 0.02% jit_opt_a.a_1 : 0.000737s : 0.41% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002603s : 1.45% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000042s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000561s : 0.31% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.01% loop_unroll : 0.000430s : 0.24% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000512s : 0.28% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.02% Time group info: ------[substitution.] 0.000233 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 2.84% : 0.000007s : 4: substitution.graph_param_transform 84.41% : 0.000196s : 4: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.35% : 0.000005s : 2: substitution.replace_old_param 5.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.172934 2 98.36% : 0.170090s : 1: type_inference.infer 1.64% : 0.002844s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.75% : 0.000050s : 4: replace.inline 32.25% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 94.61% : 0.000193s : 4: match.inline 5.39% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.59% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.49% : 0.000002s : 12: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.74% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.46% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.27% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002252 22 64.39% : 0.001450s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.48% : 0.000754s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.187436 72 0.03% : 0.000055s : 1: add_recomputation 0.04% : 0.000081s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.18% : 0.000342s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.00% : 0.007499s : 1: jit_opt_a 0.08% : 0.000156s : 1: jit_opt_after_cconv 0.03% : 0.000060s : 1: jit_opt_b 0.23% : 0.000438s : 1: loop_unroll 0.30% : 0.000569s : 1: mutable_eliminate 0.52% : 0.000980s : 26: opt.transform.jit_opt_a 0.03% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000522s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000510s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.96% : 0.001798s : 1: renormalize.infer 0.42% : 0.000795s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000041s : 1: rewriter_after_opt_a 0.05% : 0.000095s : 1: rewriter_before_opt_a 0.04% : 0.000078s : 1: symbol_engine_optimizer 92.32% : 0.173047s : 1: type_inference TotalTime = 0.184974, [30] [bootstrap]: 0.00043278 [type_inference]: 0.166603 [event_method]: 3.142e-05 [auto_monad]: 9.786e-05 [graph_reusing]: 7.41001e-06 [pre_auto_parallel]: 3.05002e-06 [py_interpret_to_execute]: 0.0010191 [rewriter_before_opt_a]: 0.0001293 [expand_dump_flag]: 5.32001e-06 [jit_opt_a]: 0.0134785, [2] [Cycle 1]: 0.00798945, [27] [switch_simplify]: 9.088e-05 [loop_unroll]: 3.826e-05 [a_1]: 0.00101931 [with_stream_mark]: 4.104e-05 [recompute_prepare]: 1.369e-05 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 2.59001e-06 [specialize_transform]: 8.85999e-06 [updatestate_useless_node_eliminater]: 7.46001e-06 [accelerated_algorithm]: 8.35001e-06 [meta_shard_fg_expand]: 3.91001e-06 [get_grad_eliminate_]: 8.09002e-06 [merge_forward]: 4.71997e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.956e-05 [j_node_and_user_rematch]: 1.084e-05 [meta_fg_expand]: 2.88998e-06 [replace_old_param]: 1.241e-05 [inline_without_move]: 6.81999e-06 [renormalize]: 0.00630235 [add_forward_monad_depend]: 1.125e-05 [auto_monad_grad]: 3.03998e-06 [auto_monad_eliminator]: 2.385e-05 [cse]: 4.493e-05 [replace_applicator]: 3.339e-05 [Cycle 2]: 0.00049698, [27] [switch_simplify]: 9.04e-06 [loop_unroll]: 8.57998e-06 [a_1]: 0.00017543 [with_stream_mark]: 2.12e-05 [recompute_prepare]: 8.02e-06 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 7.71999e-06 [meta_shard_fg_expand]: 3.35e-06 [get_grad_eliminate_]: 6.93e-06 [merge_forward]: 5.21002e-06 [cell_reuse_recompute_pass]: 5.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 1.238e-05 [meta_fg_expand]: 3.38e-06 [replace_old_param]: 1.227e-05 [inline_without_move]: 7.36999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 7.93999e-06 [cse]: 1.897e-05 [replace_applicator]: 8.04002e-06 [py_interpret_to_execute_after_opt_a]: 2.222e-05 [rewriter_after_opt_a]: 5.039e-05 [convert_after_rewriter]: 8.70001e-06 [order_py_execute_after_rewriter]: 5.76003e-06 [mutable_eliminate]: 0.00111703 [jit_opt_b]: 7.724e-05, [1] [Cycle 1]: 6.333e-05, [2] [frontend_op_eliminate]: 2.914e-05 [inline_after_opt_a]: 2.027e-05 [cconv]: 3.613e-05 [loop_unroll]: 0.00046293 [jit_opt_after_cconv]: 0.00017795, [1] [Cycle 1]: 0.00017004, [11] [c_1]: 2.854e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 7.1e-06 [updatestate_assign_eliminate]: 4.00998e-06 [updatestate_loads_eliminate]: 2.28998e-06 [cse]: 3.024e-05 [call_graph_tuple_transform]: 2.472e-05 [tuple_list_get_item_eliminator]: 7.67998e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 1.887e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 1.127e-05 [add_recomputation]: 5.563e-05 [cse_after_recomputation]: 2.853e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.338e-05 [auto_monad_reorder]: 1.897e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.31998e-06 [opt_after_jit_grad]: 0.00049753 [symbol_engine_optimizer]: 9.078e-05, [1] [Cycle 1]: 8.416e-05, [6] [build]: 4.94e-06 [elim_shapecalc]: 9.39e-06 [elim_not_effective]: 1.517e-05 [opt_reshape]: 7.03998e-06 [fold_const_symbol]: 1.346e-05 [renormalize]: 7.2e-07 [validate]: 0.00022749 Sums bootstrap : 0.000433s : 0.24% type_inference : 0.166603s : 92.97% event_method : 0.000031s : 0.02% auto_monad : 0.000098s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001019s : 0.57% rewriter_before_opt_a : 0.000129s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000100s : 0.06% jit_opt_a.loop_unroll : 0.000047s : 0.03% jit_opt_a.a_1 : 0.001195s : 0.67% jit_opt_a.with_stream_mark : 0.000062s : 0.03% jit_opt_a.recompute_prepare : 0.000022s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.006302s : 3.52% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000064s : 0.04% jit_opt_a.replace_applicator : 0.000041s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000050s : 0.03% convert_after_rewriter : 0.000009s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001117s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000029s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000036s : 0.02% loop_unroll : 0.000463s : 0.26% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000498s : 0.28% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000227s : 0.13% Time group info: ------[substitution.] 0.000448 28 0.40% : 0.000002s : 2: substitution.elim_not_effective 0.30% : 0.000001s : 2: substitution.fold_const_symbol 1.56% : 0.000007s : 4: substitution.graph_param_transform 85.97% : 0.000385s : 5: substitution.inline 1.28% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.10% : 0.000018s : 3: substitution.reduce_eliminate 1.41% : 0.000006s : 4: substitution.remove_not_recompute_node 1.60% : 0.000007s : 2: substitution.replace_old_param 3.39% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.166456 2 96.53% : 0.160684s : 1: type_inference.infer 3.47% : 0.005772s : 1: type_inference.specialize ------[replace.] 0.000163 7 64.55% : 0.000105s : 5: replace.inline 35.45% : 0.000058s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000395 7 96.49% : 0.000382s : 5: match.inline 3.51% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000176 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.90% : 0.000002s : 13: predicate.addn_check_dump 1.77% : 0.000003s : 13: predicate.addn_zero_filter 2.61% : 0.000005s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 0.91% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.89% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.43% : 0.000003s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 4.74% : 0.000008s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.37% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.22% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.51% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.86% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.88% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000004s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.28% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.59% : 0.000005s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000001s : 4: predicate.reset_defer_inline 1.57% : 0.000003s : 13: predicate.reshape_eliminate 1.10% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.50% : 0.000001s : 4: predicate.row_tensor_eliminate 2.12% : 0.000004s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 8: predicate.special_op_eliminate 0.74% : 0.000001s : 8: predicate.specialize_transform 2.29% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000005s : 20: predicate.switch_defer_inline 2.34% : 0.000004s : 20: predicate.switch_layer_defer_inline 6.65% : 0.000012s : 64: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.69% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 1.94% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.28% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.87% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.57% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004146 25 62.91% : 0.002609s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.01% : 0.000125s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.08% : 0.001413s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.192691 72 0.03% : 0.000059s : 1: add_recomputation 0.05% : 0.000102s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.24% : 0.000458s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000038s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.00% : 0.013485s : 1: jit_opt_a 0.09% : 0.000181s : 1: jit_opt_after_cconv 0.04% : 0.000080s : 1: jit_opt_b 0.24% : 0.000471s : 1: loop_unroll 0.59% : 0.001128s : 1: mutable_eliminate 0.79% : 0.001523s : 26: opt.transform.jit_opt_a 0.03% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000042s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.26% : 0.000506s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.54% : 0.001032s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 2.43% : 0.004681s : 1: renormalize.infer 0.83% : 0.001604s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000054s : 1: rewriter_after_opt_a 0.07% : 0.000136s : 1: rewriter_before_opt_a 0.05% : 0.000096s : 1: symbol_engine_optimizer 86.48% : 0.166635s : 1: type_inference TotalTime = 0.118065, [30] [bootstrap]: 0.00031024 [type_inference]: 0.106978 [event_method]: 2.053e-05 [auto_monad]: 7.329e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 0.00044818 [rewriter_before_opt_a]: 8.775e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.00766641, [2] [Cycle 1]: 0.00371138, [27] [switch_simplify]: 5.927e-05 [loop_unroll]: 3.041e-05 [a_1]: 0.00058297 [with_stream_mark]: 2.101e-05 [recompute_prepare]: 9.61998e-06 [updatestate_depend_eliminate]: 4.49002e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 7.68001e-06 [updatestate_useless_node_eliminater]: 6.58998e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 6.56999e-06 [merge_forward]: 3.97002e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 6.27001e-06 [renormalize]: 0.00262967 [add_forward_monad_depend]: 8.73001e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 2.047e-05 [cse]: 3.367e-05 [replace_applicator]: 2.089e-05 [Cycle 2]: 0.0003935, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00012674 [with_stream_mark]: 1.378e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.93002e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.38999e-06 [cell_reuse_recompute_pass]: 2.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.786e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7e-06 [cse]: 1.269e-05 [replace_applicator]: 6.38e-06 [py_interpret_to_execute_after_opt_a]: 1.413e-05 [rewriter_after_opt_a]: 4.616e-05 [convert_after_rewriter]: 7.00002e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00069975 [jit_opt_b]: 5.859e-05, [1] [Cycle 1]: 5.113e-05, [2] [frontend_op_eliminate]: 2.009e-05 [inline_after_opt_a]: 1.965e-05 [cconv]: 2.752e-05 [loop_unroll]: 0.00043706 [jit_opt_after_cconv]: 0.00015681, [1] [Cycle 1]: 0.0001503, [11] [c_1]: 2.677e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.18e-05 [call_graph_tuple_transform]: 2.097e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.83e-06 [remove_dup_value]: 1.627e-05 [partial_unused_args_eliminate]: 2.36998e-06 [environ_conv]: 8.1e-06 [add_recomputation]: 5.457e-05 [cse_after_recomputation]: 3.627e-05, [1] [Cycle 1]: 2.957e-05, [1] [cse]: 2.305e-05 [auto_monad_reorder]: 1.67e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.45001e-06 [opt_after_jit_grad]: 0.00047582 [symbol_engine_optimizer]: 0.00017175, [1] [Cycle 1]: 0.00016499, [6] [build]: 4e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.688e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 9.595e-05 [renormalize]: 4.89992e-07 [validate]: 4.68e-05 Sums bootstrap : 0.000310s : 0.27% type_inference : 0.106978s : 93.94% event_method : 0.000021s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000448s : 0.39% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000710s : 0.62% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002630s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000700s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000437s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000023s : 0.02% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000476s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000096s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000215 24 1.98% : 0.000004s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.98% : 0.000006s : 4: substitution.graph_param_transform 80.96% : 0.000174s : 4: substitution.inline 2.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.79% : 0.000006s : 4: substitution.remove_not_recompute_node 2.75% : 0.000006s : 2: substitution.replace_old_param 5.90% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106894 2 97.57% : 0.104297s : 1: type_inference.infer 2.43% : 0.002596s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.49% : 0.000051s : 4: replace.inline 31.51% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.69% : 0.000172s : 4: match.inline 6.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.68% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.43% : 0.000002s : 12: predicate.depend_value_elim 1.31% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.59% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.81% : 0.000011s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002114 22 66.26% : 0.001401s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.59% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.15% : 0.000680s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121812 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.27% : 0.000324s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000038s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.30% : 0.007670s : 1: jit_opt_a 0.13% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.37% : 0.000445s : 1: loop_unroll 0.58% : 0.000709s : 1: mutable_eliminate 0.79% : 0.000959s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000125s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000455s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.54% : 0.001872s : 1: renormalize.infer 0.61% : 0.000748s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000049s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.14% : 0.000175s : 1: symbol_engine_optimizer 87.84% : 0.106996s : 1: type_inference TotalTime = 0.068529, [30] [bootstrap]: 0.00036546 [type_inference]: 0.0568663 [event_method]: 1.976e-05 [auto_monad]: 7.644e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00027514 [rewriter_before_opt_a]: 8.673e-05 [expand_dump_flag]: 3.52997e-06 [jit_opt_a]: 0.00799701, [2] [Cycle 1]: 0.00371009, [27] [switch_simplify]: 5.983e-05 [loop_unroll]: 3.149e-05 [a_1]: 0.0006211 [with_stream_mark]: 2.184e-05 [recompute_prepare]: 9.80002e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 7.13998e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 6.96001e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 2.92002e-06 [replace_old_param]: 1.164e-05 [inline_without_move]: 7.00998e-06 [renormalize]: 0.00256516 [add_forward_monad_depend]: 9.52001e-06 [auto_monad_grad]: 3.13e-06 [auto_monad_eliminator]: 2.218e-05 [cse]: 3.782e-05 [replace_applicator]: 2.564e-05 [Cycle 2]: 0.00044892, [27] [switch_simplify]: 8.04002e-06 [loop_unroll]: 7.11999e-06 [a_1]: 0.00015092 [with_stream_mark]: 1.632e-05 [recompute_prepare]: 6.53998e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 7.28999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.43998e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 3.65e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.207e-05 [j_node_and_user_rematch]: 1.092e-05 [meta_fg_expand]: 3.25e-06 [replace_old_param]: 1.13e-05 [inline_without_move]: 6.52001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.05002e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 7.59002e-06 [cse]: 1.767e-05 [replace_applicator]: 6.36e-06 [py_interpret_to_execute_after_opt_a]: 1.271e-05 [rewriter_after_opt_a]: 4.851e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00079496 [jit_opt_b]: 6.489e-05, [1] [Cycle 1]: 5.585e-05, [2] [frontend_op_eliminate]: 2.244e-05 [inline_after_opt_a]: 2.017e-05 [cconv]: 3.359e-05 [loop_unroll]: 0.00053561 [jit_opt_after_cconv]: 0.00018062, [1] [Cycle 1]: 0.00017288, [11] [c_1]: 2.935e-05 [parameter_eliminate]: 4.18999e-06 [updatestate_depend_eliminate]: 7.54002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.91999e-06 [cse]: 3.231e-05 [call_graph_tuple_transform]: 2.6e-05 [tuple_list_get_item_eliminator]: 6.81001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.61999e-06 [remove_dup_value]: 1.858e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 9.89999e-06 [add_recomputation]: 6.586e-05 [cse_after_recomputation]: 2.55e-05, [1] [Cycle 1]: 1.932e-05, [1] [cse]: 1.288e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 7.05002e-06 [opt_after_jit_grad]: 0.00054772 [symbol_engine_optimizer]: 0.00018418, [1] [Cycle 1]: 0.00017723, [6] [build]: 4.61002e-06 [elim_shapecalc]: 5.027e-05 [elim_not_effective]: 1.733e-05 [opt_reshape]: 8.13999e-06 [fold_const_symbol]: 1.163e-05 [renormalize]: 6.69999e-07 [validate]: 6.178e-05 Sums bootstrap : 0.000365s : 0.57% type_inference : 0.056866s : 88.89% event_method : 0.000020s : 0.03% auto_monad : 0.000076s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000275s : 0.43% rewriter_before_opt_a : 0.000087s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.11% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000772s : 1.21% jit_opt_a.with_stream_mark : 0.000038s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.04% jit_opt_a.inline_without_move : 0.000014s : 0.02% jit_opt_a.renormalize : 0.002565s : 4.01% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.05% jit_opt_a.cse : 0.000055s : 0.09% jit_opt_a.replace_applicator : 0.000032s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000049s : 0.08% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000795s : 1.24% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000034s : 0.05% loop_unroll : 0.000536s : 0.84% jit_opt_after_cconv.c_1 : 0.000029s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000066s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000548s : 0.86% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000050s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.10% TotalTime = 0.151438, [30] [bootstrap]: 0.0003496 [type_inference]: 0.139569 [event_method]: 2.075e-05 [auto_monad]: 5.04e-05 [graph_reusing]: 3.8e-06 [pre_auto_parallel]: 2.45997e-06 [py_interpret_to_execute]: 0.00052158 [rewriter_before_opt_a]: 9.154e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00823067, [2] [Cycle 1]: 0.00425107, [27] [switch_simplify]: 6.693e-05 [loop_unroll]: 3.546e-05 [a_1]: 0.00071181 [with_stream_mark]: 1.462e-05 [recompute_prepare]: 9.00001e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 7.63001e-06 [updatestate_useless_node_eliminater]: 6.67002e-06 [accelerated_algorithm]: 7.40998e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 7.06999e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.99999e-06 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00306116 [add_forward_monad_depend]: 1.204e-05 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 1.407e-05 [cse]: 2.85e-05 [replace_applicator]: 1.844e-05 [Cycle 2]: 0.00041292, [27] [switch_simplify]: 7.91001e-06 [loop_unroll]: 7.25e-06 [a_1]: 0.00013589 [with_stream_mark]: 1.164e-05 [recompute_prepare]: 6.93998e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 6.23002e-06 [accelerated_algorithm]: 7.3e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 3.06001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.656e-05 [j_node_and_user_rematch]: 9.80002e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 8.87999e-06 [inline_without_move]: 5.74e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.92001e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 7.43999e-06 [cse]: 1.669e-05 [replace_applicator]: 6.76e-06 [py_interpret_to_execute_after_opt_a]: 1.298e-05 [rewriter_after_opt_a]: 3.641e-05 [convert_after_rewriter]: 6.36e-06 [order_py_execute_after_rewriter]: 4.16e-05 [mutable_eliminate]: 0.00065356 [jit_opt_b]: 6.124e-05, [1] [Cycle 1]: 5.396e-05, [2] [frontend_op_eliminate]: 2.133e-05 [inline_after_opt_a]: 2.042e-05 [cconv]: 2.02e-05 [loop_unroll]: 0.00047218 [jit_opt_after_cconv]: 0.00016938, [1] [Cycle 1]: 0.0001622, [11] [c_1]: 2.759e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.43998e-06 [cse]: 2.907e-05 [call_graph_tuple_transform]: 2.348e-05 [tuple_list_get_item_eliminator]: 7.43e-06 [none_parameter_eliminate]: 9.70002e-07 [renormalize]: 4.00003e-07 [switch_simplify]: 6.66999e-06 [remove_dup_value]: 1.383e-05 [partial_unused_args_eliminate]: 1.40001e-06 [environ_conv]: 6.54001e-06 [add_recomputation]: 3.785e-05 [cse_after_recomputation]: 2.783e-05, [1] [Cycle 1]: 2.071e-05, [1] [cse]: 1.485e-05 [auto_monad_reorder]: 1.223e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 4.48999e-06 [opt_after_jit_grad]: 0.00056613 [symbol_engine_optimizer]: 0.00021804, [1] [Cycle 1]: 0.00021108, [6] [build]: 3.66999e-06 [elim_shapecalc]: 9.55001e-06 [elim_not_effective]: 1.708e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 0.00014025 [renormalize]: 4.69998e-07 [validate]: 4.49e-05 Sums bootstrap : 0.000350s : 0.24% type_inference : 0.139569s : 94.79% event_method : 0.000021s : 0.01% auto_monad : 0.000050s : 0.03% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000522s : 0.35% rewriter_before_opt_a : 0.000092s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000848s : 0.58% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003061s : 2.08% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.01% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000042s : 0.03% mutable_eliminate : 0.000654s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000020s : 0.01% loop_unroll : 0.000472s : 0.32% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000566s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000140s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000225 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.99% : 0.000007s : 4: substitution.graph_param_transform 82.07% : 0.000184s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.85% : 0.000006s : 4: substitution.remove_not_recompute_node 2.82% : 0.000006s : 2: substitution.replace_old_param 5.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056788 2 95.90% : 0.054461s : 1: type_inference.infer 4.10% : 0.002327s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.75% : 0.000056s : 4: replace.inline 31.25% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 93.90% : 0.000182s : 4: match.inline 6.10% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.73% : 0.000003s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.39% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.14% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.57% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.43% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.87% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 12: predicate.reshape_eliminate 1.58% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.77% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002207 22 62.11% : 0.001370s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.56% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.33% : 0.000802s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072238 72 0.10% : 0.000069s : 1: add_recomputation 0.11% : 0.000080s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.53% : 0.000383s : 1: bootstrap 0.05% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.08% : 0.008002s : 1: jit_opt_a 0.25% : 0.000183s : 1: jit_opt_after_cconv 0.09% : 0.000068s : 1: jit_opt_b 0.75% : 0.000545s : 1: loop_unroll 1.12% : 0.000805s : 1: mutable_eliminate 1.44% : 0.001043s : 26: opt.transform.jit_opt_a 0.09% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000036s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000082s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000558s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000281s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 2.25% : 0.001622s : 1: renormalize.infer 1.29% : 0.000929s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000052s : 1: rewriter_after_opt_a 0.13% : 0.000092s : 1: rewriter_before_opt_a 0.26% : 0.000187s : 1: symbol_engine_optimizer 78.74% : 0.056884s : 1: type_inference Time group info: ------[substitution.] 0.000259 25 1.62% : 0.000004s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.02% : 0.000005s : 4: substitution.graph_param_transform 88.05% : 0.000228s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.04% : 0.000005s : 4: substitution.remove_not_recompute_node 1.39% : 0.000004s : 2: substitution.replace_old_param 3.05% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139494 2 97.85% : 0.136498s : 1: type_inference.infer 2.15% : 0.002997s : 1: type_inference.specialize ------[replace.] 0.000111 7 69.52% : 0.000077s : 5: replace.inline 30.48% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 7 97.12% : 0.000225s : 5: match.inline 2.88% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 13: predicate.addn_check_dump 1.95% : 0.000003s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.42% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 19: predicate.load_eliminater 1.61% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.09% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.13% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.82% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002357 25 64.27% : 0.001515s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.67% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.06% : 0.000779s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.155832 72 0.03% : 0.000041s : 1: add_recomputation 0.03% : 0.000054s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.24% : 0.000369s : 1: bootstrap 0.01% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.28% : 0.008235s : 1: jit_opt_a 0.11% : 0.000172s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.31% : 0.000481s : 1: loop_unroll 0.43% : 0.000664s : 1: mutable_eliminate 0.72% : 0.001114s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000170s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000577s : 1: opt_after_jit_grad 0.03% : 0.000044s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000528s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.42% : 0.002207s : 1: renormalize.infer 0.54% : 0.000843s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.06% : 0.000097s : 1: rewriter_before_opt_a 0.14% : 0.000221s : 1: symbol_engine_optimizer 89.57% : 0.139582s : 1: type_inference TotalTime = 0.13137, [30] [bootstrap]: 0.00026697 [type_inference]: 0.119708 [event_method]: 2.239e-05 [auto_monad]: 8.218e-05 [graph_reusing]: 6.66e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00053815 [rewriter_before_opt_a]: 0.00010347 [expand_dump_flag]: 4.33999e-06 [jit_opt_a]: 0.00825126, [2] [Cycle 1]: 0.00421292, [27] [switch_simplify]: 5.893e-05 [loop_unroll]: 3.475e-05 [a_1]: 0.00074329 [with_stream_mark]: 2.092e-05 [recompute_prepare]: 9.23002e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.66999e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 7.53e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 6.60002e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.657e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 7e-06 [renormalize]: 0.00297358 [add_forward_monad_depend]: 9.19998e-06 [auto_monad_grad]: 3.62002e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 3.412e-05 [replace_applicator]: 2.399e-05 [Cycle 2]: 0.00039983, [27] [switch_simplify]: 7.31001e-06 [loop_unroll]: 6.38e-06 [a_1]: 0.00014 [with_stream_mark]: 1.483e-05 [recompute_prepare]: 6.25002e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 2.87002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.78002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.419e-05 [replace_applicator]: 6.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.66e-05 [rewriter_after_opt_a]: 3.888e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.0007337 [jit_opt_b]: 5.651e-05, [1] [Cycle 1]: 4.912e-05, [2] [frontend_op_eliminate]: 1.925e-05 [inline_after_opt_a]: 1.843e-05 [cconv]: 2.663e-05 [loop_unroll]: 0.00043313 [jit_opt_after_cconv]: 0.00015263, [1] [Cycle 1]: 0.00014598, [11] [c_1]: 2.649e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.129e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 6.33002e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.04999e-06 [remove_dup_value]: 1.873e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 8.87e-06 [add_recomputation]: 4.711e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.831e-05, [1] [cse]: 1.261e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 5.85002e-06 [opt_after_jit_grad]: 0.0004633 [symbol_engine_optimizer]: 0.00010601, [1] [Cycle 1]: 9.919e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 6.71e-06 [fold_const_symbol]: 3.938e-05 [renormalize]: 4.80009e-07 [validate]: 4.499e-05 Sums bootstrap : 0.000267s : 0.21% type_inference : 0.119708s : 94.16% event_method : 0.000022s : 0.02% auto_monad : 0.000082s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000538s : 0.42% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000883s : 0.69% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002974s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000734s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000433s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000463s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000039s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000306 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 4: substitution.graph_param_transform 84.49% : 0.000259s : 5: substitution.inline 1.35% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.58% : 0.000014s : 3: substitution.reduce_eliminate 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.62% : 0.000005s : 2: substitution.replace_old_param 3.49% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119609 2 97.36% : 0.116449s : 1: type_inference.infer 2.64% : 0.003160s : 1: type_inference.specialize ------[replace.] 0.000107 7 69.80% : 0.000075s : 5: replace.inline 30.20% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 96.45% : 0.000255s : 5: match.inline 3.55% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.58% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.62% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.61% : 0.000001s : 4: predicate.graph_param_transform 5.61% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.19% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.38% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.78% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 1.95% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.37% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.91% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002428 25 61.61% : 0.001496s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.57% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.81% : 0.000845s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135581 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.20% : 0.000277s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.09% : 0.008255s : 1: jit_opt_a 0.11% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.33% : 0.000441s : 1: loop_unroll 0.55% : 0.000743s : 1: mutable_eliminate 0.84% : 0.001139s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000065s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000546s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.54% : 0.002089s : 1: renormalize.infer 0.64% : 0.000872s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.08% : 0.000109s : 1: symbol_engine_optimizer 88.30% : 0.119725s : 1: type_inference TotalTime = 0.0245, [30] [bootstrap]: 0.00041726 [type_inference]: 0.0125453 [event_method]: 2.697e-05 [auto_monad]: 8.325e-05 [graph_reusing]: 6.09999e-06 [pre_auto_parallel]: 3.63e-06 [py_interpret_to_execute]: 8.425e-05 [rewriter_before_opt_a]: 9.627e-05 [expand_dump_flag]: 4.31002e-06 [jit_opt_a]: 0.00828252, [2] [Cycle 1]: 0.00287345, [27] [switch_simplify]: 9.926e-05 [loop_unroll]: 3.448e-05 [a_1]: 0.00082009 [with_stream_mark]: 2.784e-05 [recompute_prepare]: 8.83001e-06 [updatestate_depend_eliminate]: 4.69998e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.25002e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 1.063e-05 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00146733 [add_forward_monad_depend]: 8.42e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 2.037e-05 [cse]: 4.205e-05 [replace_applicator]: 2.073e-05 [Cycle 2]: 0.00043263, [27] [switch_simplify]: 7.65e-06 [loop_unroll]: 5.44e-06 [a_1]: 0.00012915 [with_stream_mark]: 1.487e-05 [recompute_prepare]: 6.84001e-06 [updatestate_depend_eliminate]: 2.184e-05 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 3.31999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.11998e-06 [inline_without_move]: 5.00999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 1.21002e-06 [auto_monad_eliminator]: 6.83998e-06 [cse]: 1.52e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.961e-05 [rewriter_after_opt_a]: 4.651e-05 [convert_after_rewriter]: 7.46001e-06 [order_py_execute_after_rewriter]: 5.15999e-06 [mutable_eliminate]: 0.00099909 [jit_opt_b]: 6.682e-05, [1] [Cycle 1]: 5.646e-05, [2] [frontend_op_eliminate]: 2.309e-05 [inline_after_opt_a]: 1.883e-05 [cconv]: 3.46e-05 [loop_unroll]: 0.00049966 [jit_opt_after_cconv]: 0.0002051, [1] [Cycle 1]: 0.00019745, [11] [c_1]: 2.438e-05 [parameter_eliminate]: 4.11001e-06 [updatestate_depend_eliminate]: 7.48999e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.01001e-06 [cse]: 3.651e-05 [call_graph_tuple_transform]: 4.692e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 2.07001e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 6.87002e-06 [remove_dup_value]: 1.82e-05 [partial_unused_args_eliminate]: 2.88e-06 [environ_conv]: 7.90998e-06 [add_recomputation]: 5.917e-05 [cse_after_recomputation]: 2.653e-05, [1] [Cycle 1]: 2.007e-05, [1] [cse]: 1.282e-05 [auto_monad_reorder]: 1.875e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 9.24e-06 [opt_after_jit_grad]: 0.00055025 [symbol_engine_optimizer]: 8.876e-05, [1] [Cycle 1]: 8.117e-05, [6] [build]: 5.69e-06 [elim_shapecalc]: 9.61998e-06 [elim_not_effective]: 1.647e-05 [opt_reshape]: 7.73001e-06 [fold_const_symbol]: 1.073e-05 [renormalize]: 7.50006e-07 [validate]: 5.16e-05 Sums bootstrap : 0.000417s : 2.22% type_inference : 0.012545s : 66.77% event_method : 0.000027s : 0.14% auto_monad : 0.000083s : 0.44% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000004s : 0.02% py_interpret_to_execute : 0.000084s : 0.45% rewriter_before_opt_a : 0.000096s : 0.51% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000107s : 0.57% jit_opt_a.loop_unroll : 0.000040s : 0.21% jit_opt_a.a_1 : 0.000949s : 5.05% jit_opt_a.with_stream_mark : 0.000043s : 0.23% jit_opt_a.recompute_prepare : 0.000016s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000027s : 0.14% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000014s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001467s : 7.81% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.14% jit_opt_a.cse : 0.000057s : 0.30% jit_opt_a.replace_applicator : 0.000026s : 0.14% py_interpret_to_execute_after_opt_a : 0.000020s : 0.10% rewriter_after_opt_a : 0.000047s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000999s : 5.32% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.10% cconv : 0.000035s : 0.18% loop_unroll : 0.000500s : 2.66% jit_opt_after_cconv.c_1 : 0.000024s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000037s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000047s : 0.25% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.04% remove_dup_value : 0.000018s : 0.10% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.04% add_recomputation : 0.000059s : 0.31% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000019s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.05% opt_after_jit_grad : 0.000550s : 2.93% symbol_engine_optimizer.build : 0.000006s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.27% Time group info: ------[substitution.] 0.000386 27 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 1.86% : 0.000007s : 3: substitution.graph_param_transform 85.79% : 0.000331s : 5: substitution.inline 1.14% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.54% : 0.000014s : 3: substitution.reduce_eliminate 1.56% : 0.000006s : 4: substitution.remove_not_recompute_node 1.55% : 0.000006s : 2: substitution.replace_old_param 3.45% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.012429 2 86.72% : 0.010779s : 1: type_inference.infer 13.28% : 0.001650s : 1: type_inference.specialize ------[replace.] 0.000120 7 66.04% : 0.000079s : 5: replace.inline 33.96% : 0.000041s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000340 7 96.43% : 0.000328s : 5: match.inline 3.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000165 747 0.94% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.86% : 0.000001s : 11: predicate.addn_check_dump 1.54% : 0.000003s : 11: predicate.addn_zero_filter 2.22% : 0.000004s : 11: predicate.arithmetic_simplify 1.13% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000002s : 11: predicate.compare_switch_simplify 0.92% : 0.000002s : 11: predicate.depend_value_elim 0.89% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.01% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.91% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.87% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 11: predicate.environ_get_depend_swap 1.05% : 0.000002s : 11: predicate.environ_get_eliminate 0.88% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000001s : 3: predicate.graph_param_transform 4.41% : 0.000007s : 24: predicate.inline 0.63% : 0.000001s : 6: predicate.inline_without_move 0.28% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.61% : 0.000003s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.38% : 0.000002s : 16: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.61% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 11: predicate.merge_addn 0.96% : 0.000002s : 11: predicate.minmaximum_grad 2.19% : 0.000004s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 1.76% : 0.000003s : 16: predicate.partial_eliminate 1.10% : 0.000002s : 11: predicate.print_const_string_wrapper 1.64% : 0.000003s : 11: predicate.reduce_eliminate 1.52% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.50% : 0.000002s : 19: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 8.19% : 0.000014s : 11: predicate.reshape_eliminate 1.02% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.19% : 0.000002s : 3: predicate.row_tensor_eliminate 3.54% : 0.000006s : 11: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 6: predicate.special_op_eliminate 0.74% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.30% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000004s : 18: predicate.switch_defer_inline 1.87% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000012s : 59: predicate.switch_simplify 1.03% : 0.000002s : 11: predicate.tile_eliminate 1.53% : 0.000003s : 11: predicate.transpose_eliminate 1.66% : 0.000003s : 11: predicate.tuple_list_convert_item_index_to_positive 1.08% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.25% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.42% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.36% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000003s : 11: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001294 16 45.52% : 0.000589s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.08% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.40% : 0.000600s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027281 72 0.23% : 0.000062s : 1: add_recomputation 0.32% : 0.000087s : 1: auto_monad 0.08% : 0.000021s : 1: auto_monad_reorder 1.62% : 0.000441s : 1: bootstrap 0.14% : 0.000037s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.12% : 0.000032s : 1: event_method 0.03% : 0.000007s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 30.39% : 0.008290s : 1: jit_opt_a 0.76% : 0.000208s : 1: jit_opt_after_cconv 0.26% : 0.000070s : 1: jit_opt_b 1.86% : 0.000509s : 1: loop_unroll 3.71% : 0.001013s : 1: mutable_eliminate 4.52% : 0.001234s : 26: opt.transform.jit_opt_a 0.30% : 0.000081s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000034s : 4: opt.transform.jit_opt_b 0.06% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000022s : 1: opt.transform.mutable_eliminate 0.10% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000041s : 4: opt.transform.symbol_engine_opt 2.05% : 0.000560s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000087s : 1: py_interpret_to_execute 0.08% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000021s : 1: remove_dup_value 2.86% : 0.000781s : 1: renormalize.infer 2.47% : 0.000674s : 1: renormalize.specialize 0.04% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000050s : 1: rewriter_after_opt_a 0.36% : 0.000100s : 1: rewriter_before_opt_a 0.34% : 0.000092s : 1: symbol_engine_optimizer 46.08% : 0.012571s : 1: type_inference TotalTime = 0.0148962, [30] [bootstrap]: 0.00032002 [type_inference]: 0.00537095 [event_method]: 2.204e-05 [auto_monad]: 7.536e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 4.871e-05 [rewriter_before_opt_a]: 7.912e-05 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.00649894, [2] [Cycle 1]: 0.00180143, [27] [switch_simplify]: 5.927e-05 [loop_unroll]: 3.046e-05 [a_1]: 0.000569 [with_stream_mark]: 2.08e-05 [recompute_prepare]: 8.50999e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.63003e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 5.59998e-06 [renormalize]: 0.00077208 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.467e-05 [cse]: 3.031e-05 [replace_applicator]: 1.58e-05 [Cycle 2]: 0.00034742, [27] [switch_simplify]: 6.75002e-06 [loop_unroll]: 5.38002e-06 [a_1]: 9.487e-05 [with_stream_mark]: 1.023e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 3.47002e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 4.77998e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 7.84002e-06 [inline_without_move]: 5.14e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.231e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 3.645e-05 [convert_after_rewriter]: 7.77e-06 [order_py_execute_after_rewriter]: 6.16e-06 [mutable_eliminate]: 0.00066782 [jit_opt_b]: 5.306e-05, [1] [Cycle 1]: 4.536e-05, [2] [frontend_op_eliminate]: 1.681e-05 [inline_after_opt_a]: 1.676e-05 [cconv]: 2.489e-05 [loop_unroll]: 0.00049898 [jit_opt_after_cconv]: 0.00017592, [1] [Cycle 1]: 0.0001686, [11] [c_1]: 2.227e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 6.40002e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.419e-05 [call_graph_tuple_transform]: 2.024e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.601e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 5.72999e-06 [add_recomputation]: 5.505e-05 [cse_after_recomputation]: 2.36e-05, [1] [Cycle 1]: 1.782e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.69e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 5.14e-06 [opt_after_jit_grad]: 0.00054133 [symbol_engine_optimizer]: 8.014e-05, [1] [Cycle 1]: 7.334e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.465e-05 [opt_reshape]: 6.59001e-06 [fold_const_symbol]: 9.14998e-06 [renormalize]: 6.30011e-07 [validate]: 3.889e-05 Sums bootstrap : 0.000320s : 3.24% type_inference : 0.005371s : 54.30% event_method : 0.000022s : 0.22% auto_monad : 0.000075s : 0.76% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000049s : 0.49% rewriter_before_opt_a : 0.000079s : 0.80% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000066s : 0.67% jit_opt_a.loop_unroll : 0.000036s : 0.36% jit_opt_a.a_1 : 0.000664s : 6.71% jit_opt_a.with_stream_mark : 0.000031s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000013s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000772s : 7.81% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000043s : 0.43% jit_opt_a.replace_applicator : 0.000022s : 0.22% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000036s : 0.37% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000668s : 6.75% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.17% cconv : 0.000025s : 0.25% loop_unroll : 0.000499s : 5.04% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000055s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000017s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000541s : 5.47% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000039s : 0.39% Time group info: ------[substitution.] 0.000223 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000006s : 3: substitution.graph_param_transform 83.02% : 0.000185s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000005s : 2: substitution.replace_old_param 6.11% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005288 2 81.19% : 0.004294s : 1: type_inference.infer 18.81% : 0.000995s : 1: type_inference.specialize ------[replace.] 0.000078 6 66.19% : 0.000052s : 4: replace.inline 33.81% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 93.62% : 0.000183s : 4: match.inline 6.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.22% : 0.000002s : 10: predicate.accumulaten_eliminater 1.37% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 2.17% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000007s : 22: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.73% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.36% : 0.000009s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000717 13 53.72% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.06% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.21% : 0.000296s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016622 72 0.35% : 0.000058s : 1: add_recomputation 0.48% : 0.000079s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.07% : 0.000344s : 1: bootstrap 0.17% : 0.000028s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 39.12% : 0.006502s : 1: jit_opt_a 1.08% : 0.000180s : 1: jit_opt_after_cconv 0.33% : 0.000056s : 1: jit_opt_b 3.06% : 0.000509s : 1: loop_unroll 4.08% : 0.000678s : 1: mutable_eliminate 5.37% : 0.000893s : 26: opt.transform.jit_opt_a 0.31% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.31% : 0.000551s : 1: opt_after_jit_grad 0.05% : 0.000009s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000052s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.38% : 0.000396s : 1: renormalize.infer 2.21% : 0.000368s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000040s : 1: rewriter_after_opt_a 0.49% : 0.000082s : 1: rewriter_before_opt_a 0.50% : 0.000083s : 1: symbol_engine_optimizer 32.43% : 0.005390s : 1: type_inference TotalTime = 0.0255083, [30] [bootstrap]: 0.00032645 [type_inference]: 0.0117427 [event_method]: 1.982e-05 [auto_monad]: 7.364e-05 [graph_reusing]: 6.08002e-06 [pre_auto_parallel]: 3.03e-06 [py_interpret_to_execute]: 5.052e-05 [rewriter_before_opt_a]: 8.213e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.0106138, [2] [Cycle 1]: 0.00398721, [27] [switch_simplify]: 6.753e-05 [loop_unroll]: 3.265e-05 [a_1]: 0.00069153 [with_stream_mark]: 2.41e-05 [recompute_prepare]: 8.71002e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.62001e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.55002e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00278363 [add_forward_monad_depend]: 8.15999e-06 [auto_monad_grad]: 3.09999e-06 [auto_monad_eliminator]: 1.762e-05 [cse]: 3.679e-05 [replace_applicator]: 1.815e-05 [Cycle 2]: 0.00036875, [27] [switch_simplify]: 6.39999e-06 [loop_unroll]: 5.59e-06 [a_1]: 0.00010921 [with_stream_mark]: 1.229e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 4.82e-06 [merge_forward]: 4.74e-06 [cell_reuse_recompute_pass]: 2.76999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.433e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.57998e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.423e-05 [replace_applicator]: 4.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.52e-05 [rewriter_after_opt_a]: 3.876e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 6.17999e-06 [mutable_eliminate]: 0.00074169 [jit_opt_b]: 5.523e-05, [1] [Cycle 1]: 4.702e-05, [2] [frontend_op_eliminate]: 1.778e-05 [inline_after_opt_a]: 1.717e-05 [cconv]: 3.156e-05 [loop_unroll]: 0.0005353 [jit_opt_after_cconv]: 0.00017174, [1] [Cycle 1]: 0.00016422, [11] [c_1]: 2.273e-05 [parameter_eliminate]: 3.56001e-06 [updatestate_depend_eliminate]: 8.59e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 3.13e-06 [cse]: 3.293e-05 [call_graph_tuple_transform]: 2.087e-05 [tuple_list_get_item_eliminator]: 5.83002e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 6.29982e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.643e-05 [partial_unused_args_eliminate]: 2.88e-06 [environ_conv]: 7.03e-06 [add_recomputation]: 5.517e-05 [cse_after_recomputation]: 2.405e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.41998e-06 [rewriter_after_jit_bprop_graph]: 6.18002e-06 [opt_after_jit_grad]: 0.00049983 [symbol_engine_optimizer]: 7.901e-05, [1] [Cycle 1]: 7.305e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.393e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 6.80011e-07 [validate]: 4.401e-05 Sums bootstrap : 0.000326s : 1.76% type_inference : 0.011743s : 63.26% event_method : 0.000020s : 0.11% auto_monad : 0.000074s : 0.40% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000051s : 0.27% rewriter_before_opt_a : 0.000082s : 0.44% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000074s : 0.40% jit_opt_a.loop_unroll : 0.000038s : 0.21% jit_opt_a.a_1 : 0.000801s : 4.31% jit_opt_a.with_stream_mark : 0.000036s : 0.20% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.10% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.002784s : 15.00% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.13% jit_opt_a.cse : 0.000051s : 0.27% jit_opt_a.replace_applicator : 0.000023s : 0.12% py_interpret_to_execute_after_opt_a : 0.000015s : 0.08% rewriter_after_opt_a : 0.000039s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000742s : 4.00% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.09% cconv : 0.000032s : 0.17% loop_unroll : 0.000535s : 2.88% jit_opt_after_cconv.c_1 : 0.000023s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.11% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000016s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000055s : 0.30% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000019s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000500s : 2.69% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.24% Time group info: ------[substitution.] 0.000299 27 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 3: substitution.graph_param_transform 83.44% : 0.000249s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.59% : 0.000014s : 3: substitution.reduce_eliminate 1.88% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000006s : 2: substitution.replace_old_param 3.78% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011672 2 90.90% : 0.010610s : 1: type_inference.infer 9.10% : 0.001063s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.22% : 0.000066s : 5: replace.inline 31.78% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 96.02% : 0.000246s : 5: match.inline 3.98% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 2.00% : 0.000003s : 11: predicate.arithmetic_simplify 1.40% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.01% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000008s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.07% : 0.000001s : 11: predicate.print_const_string_wrapper 2.19% : 0.000003s : 11: predicate.reduce_eliminate 1.59% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 19: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 11: predicate.reshape_eliminate 1.25% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.48% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.82% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000895 16 47.49% : 0.000425s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.17% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.34% : 0.000388s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.029389 72 0.20% : 0.000058s : 1: add_recomputation 0.26% : 0.000077s : 1: auto_monad 0.07% : 0.000022s : 1: auto_monad_reorder 1.17% : 0.000345s : 1: bootstrap 0.12% : 0.000034s : 1: cconv 0.04% : 0.000011s : 1: convert_after_rewriter 0.09% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.17% : 0.000051s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 36.13% : 0.010618s : 1: jit_opt_a 0.59% : 0.000175s : 1: jit_opt_after_cconv 0.20% : 0.000058s : 1: jit_opt_b 1.85% : 0.000544s : 1: loop_unroll 2.56% : 0.000751s : 1: mutable_eliminate 3.53% : 0.001038s : 26: opt.transform.jit_opt_a 0.18% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000017s : 1: opt.transform.mutable_eliminate 0.08% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.73% : 0.000509s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.18% : 0.000053s : 1: py_interpret_to_execute 0.06% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 7.99% : 0.002348s : 1: renormalize.infer 1.44% : 0.000424s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000042s : 1: rewriter_after_opt_a 0.29% : 0.000086s : 1: rewriter_before_opt_a 0.28% : 0.000081s : 1: symbol_engine_optimizer 40.01% : 0.011758s : 1: type_inference TotalTime = 0.0161173, [30] [bootstrap]: 0.00035561 [type_inference]: 0.00619775 [event_method]: 2.195e-05 [auto_monad]: 7.501e-05 [graph_reusing]: 6.11e-06 [pre_auto_parallel]: 3.2e-06 [py_interpret_to_execute]: 5.848e-05 [rewriter_before_opt_a]: 8.218e-05 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.00667428, [2] [Cycle 1]: 0.00215792, [27] [switch_simplify]: 7.102e-05 [loop_unroll]: 3.179e-05 [a_1]: 0.00065021 [with_stream_mark]: 2.593e-05 [recompute_prepare]: 8.52e-06 [updatestate_depend_eliminate]: 5.44998e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 6.01998e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 2.50002e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 1.07e-05 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00100643 [add_forward_monad_depend]: 7.37002e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.767e-05 [cse]: 3.431e-05 [replace_applicator]: 1.41e-05 [Cycle 2]: 0.00034428, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.25001e-06 [a_1]: 9.817e-05 [with_stream_mark]: 1.123e-05 [recompute_prepare]: 5.74999e-06 [updatestate_depend_eliminate]: 2.90002e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 4.91002e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 4.92999e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 4.79998e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 2.44001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 8.12998e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 4.94e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.12999e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.74001e-06 [cse]: 1.488e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.355e-05 [rewriter_after_opt_a]: 3.938e-05 [convert_after_rewriter]: 8.33001e-06 [order_py_execute_after_rewriter]: 5.55001e-06 [mutable_eliminate]: 0.00086923 [jit_opt_b]: 5.485e-05, [1] [Cycle 1]: 4.676e-05, [2] [frontend_op_eliminate]: 1.883e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 3.089e-05 [loop_unroll]: 0.00050718 [jit_opt_after_cconv]: 0.0001506, [1] [Cycle 1]: 0.00014406, [11] [c_1]: 2.185e-05 [parameter_eliminate]: 3.09999e-06 [updatestate_depend_eliminate]: 6.39001e-06 [updatestate_assign_eliminate]: 3.48999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.207e-05 [call_graph_tuple_transform]: 2.017e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.71998e-06 [remove_dup_value]: 1.711e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 5.86e-06 [add_recomputation]: 8.396e-05 [cse_after_recomputation]: 2.607e-05, [1] [Cycle 1]: 1.927e-05, [1] [cse]: 1.291e-05 [auto_monad_reorder]: 1.702e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.45001e-06 [opt_after_jit_grad]: 0.00048694 [symbol_engine_optimizer]: 7.648e-05, [1] [Cycle 1]: 6.962e-05, [6] [build]: 3.99002e-06 [elim_shapecalc]: 7.85998e-06 [elim_not_effective]: 1.513e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 1.50001e-07 [validate]: 4.418e-05 Sums bootstrap : 0.000356s : 3.14% type_inference : 0.006198s : 54.77% event_method : 0.000022s : 0.19% auto_monad : 0.000075s : 0.66% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000058s : 0.52% rewriter_before_opt_a : 0.000082s : 0.73% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000077s : 0.68% jit_opt_a.loop_unroll : 0.000037s : 0.33% jit_opt_a.a_1 : 0.000748s : 6.61% jit_opt_a.with_stream_mark : 0.000037s : 0.33% jit_opt_a.recompute_prepare : 0.000014s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000020s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.001007s : 8.89% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.22% jit_opt_a.cse : 0.000049s : 0.43% jit_opt_a.replace_applicator : 0.000019s : 0.17% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000039s : 0.35% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000869s : 7.68% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000031s : 0.27% loop_unroll : 0.000507s : 4.48% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000084s : 0.74% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000487s : 4.30% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.39% Time group info: ------[substitution.] 0.000285 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 3: substitution.graph_param_transform 86.07% : 0.000245s : 4: substitution.inline 0.96% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.60% : 0.000007s : 2: substitution.replace_old_param 4.88% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006124 2 80.89% : 0.004953s : 1: type_inference.infer 19.11% : 0.001170s : 1: type_inference.specialize ------[replace.] 0.000087 6 68.13% : 0.000059s : 4: replace.inline 31.87% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 95.07% : 0.000242s : 4: match.inline 4.93% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000003s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.68% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.43% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.30% : 0.000002s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.66% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.26% : 0.000002s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.45% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 53: predicate.switch_simplify 1.20% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.70% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000827 13 48.46% : 0.000401s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.31% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.23% : 0.000366s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018163 72 0.48% : 0.000087s : 1: add_recomputation 0.44% : 0.000080s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 2.06% : 0.000374s : 1: bootstrap 0.18% : 0.000034s : 1: cconv 0.06% : 0.000011s : 1: convert_after_rewriter 0.16% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.77% : 0.006678s : 1: jit_opt_a 0.85% : 0.000154s : 1: jit_opt_after_cconv 0.32% : 0.000058s : 1: jit_opt_b 2.84% : 0.000516s : 1: loop_unroll 4.84% : 0.000879s : 1: mutable_eliminate 5.42% : 0.000985s : 26: opt.transform.jit_opt_a 0.28% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000496s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000063s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 3.04% : 0.000553s : 1: renormalize.infer 2.44% : 0.000443s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.47% : 0.000086s : 1: rewriter_before_opt_a 0.44% : 0.000079s : 1: symbol_engine_optimizer 34.23% : 0.006217s : 1: type_inference TotalTime = 0.0536627, [30] [bootstrap]: 0.00029287 [type_inference]: 0.0439666 [event_method]: 1.947e-05 [auto_monad]: 5.439e-05 [graph_reusing]: 4.37e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 0.00030947 [rewriter_before_opt_a]: 8.23e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00666586, [2] [Cycle 1]: 0.00261397, [27] [switch_simplify]: 5.594e-05 [loop_unroll]: 3.144e-05 [a_1]: 0.00056138 [with_stream_mark]: 1.672e-05 [recompute_prepare]: 9.76e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 7.01001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 9.29984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.331e-05 [j_node_and_user_rematch]: 1.012e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 6.31e-06 [renormalize]: 0.00152476 [add_forward_monad_depend]: 1.274e-05 [auto_monad_grad]: 1.77001e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 9.307e-05 [replace_applicator]: 1.794e-05 [Cycle 2]: 0.00038626, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 6.18998e-06 [a_1]: 0.00012795 [with_stream_mark]: 1.143e-05 [recompute_prepare]: 6.68998e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 2.32001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 6.70002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 7.31001e-06 [cse]: 1.134e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.396e-05 [rewriter_after_opt_a]: 3.333e-05 [convert_after_rewriter]: 2.888e-05 [order_py_execute_after_rewriter]: 4.40999e-06 [mutable_eliminate]: 0.00059909 [jit_opt_b]: 5.667e-05, [1] [Cycle 1]: 4.982e-05, [2] [frontend_op_eliminate]: 2.034e-05 [inline_after_opt_a]: 1.71e-05 [cconv]: 1.882e-05 [loop_unroll]: 0.00043587 [jit_opt_after_cconv]: 0.00015251, [1] [Cycle 1]: 0.00014595, [11] [c_1]: 2.644e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.19e-05 [call_graph_tuple_transform]: 1.927e-05 [tuple_list_get_item_eliminator]: 7.44002e-06 [none_parameter_eliminate]: 9.5999e-07 [renormalize]: 3.09985e-07 [switch_simplify]: 6.47001e-06 [remove_dup_value]: 1.009e-05 [partial_unused_args_eliminate]: 2.36998e-06 [environ_conv]: 5.67999e-06 [add_recomputation]: 3.476e-05 [cse_after_recomputation]: 2.507e-05, [1] [Cycle 1]: 1.918e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.113e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 6.50002e-06 [opt_after_jit_grad]: 0.00047612 [symbol_engine_optimizer]: 7.431e-05, [1] [Cycle 1]: 6.831e-05, [6] [build]: 2.89999e-06 [elim_shapecalc]: 8.55999e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 4.00003e-07 [validate]: 2.958e-05 Sums bootstrap : 0.000293s : 0.59% type_inference : 0.043967s : 89.13% event_method : 0.000019s : 0.04% auto_monad : 0.000054s : 0.11% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000309s : 0.63% rewriter_before_opt_a : 0.000082s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.13% jit_opt_a.loop_unroll : 0.000038s : 0.08% jit_opt_a.a_1 : 0.000689s : 1.40% jit_opt_a.with_stream_mark : 0.000028s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.03% jit_opt_a.renormalize : 0.001525s : 3.09% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000104s : 0.21% jit_opt_a.replace_applicator : 0.000024s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000033s : 0.07% convert_after_rewriter : 0.000029s : 0.06% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000599s : 1.21% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000019s : 0.04% loop_unroll : 0.000436s : 0.88% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000035s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000476s : 0.97% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.06% Time group info: ------[substitution.] 0.000188 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.38% : 0.000004s : 4: substitution.graph_param_transform 84.19% : 0.000158s : 4: substitution.inline 1.76% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000004s : 2: substitution.replace_old_param 5.27% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.043834 2 95.65% : 0.041925s : 1: type_inference.infer 4.35% : 0.001909s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.31% : 0.000048s : 4: replace.inline 34.69% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 94.67% : 0.000156s : 4: match.inline 5.33% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.87% : 0.000003s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.57% : 0.000006s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.06% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.59% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.77% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 2.02% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.34% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001738 18 69.02% : 0.001199s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.97% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.01% : 0.000504s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056205 72 0.07% : 0.000038s : 1: add_recomputation 0.10% : 0.000058s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.55% : 0.000307s : 1: bootstrap 0.04% : 0.000022s : 1: cconv 0.06% : 0.000031s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 11.86% : 0.006669s : 1: jit_opt_a 0.39% : 0.000221s : 1: jit_opt_after_cconv 0.11% : 0.000060s : 1: jit_opt_b 0.79% : 0.000443s : 1: loop_unroll 1.08% : 0.000609s : 1: mutable_eliminate 1.66% : 0.000932s : 26: opt.transform.jit_opt_a 0.10% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.86% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.56% : 0.000316s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.68% : 0.000944s : 1: renormalize.infer 1.02% : 0.000572s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000036s : 1: rewriter_after_opt_a 0.16% : 0.000088s : 1: rewriter_before_opt_a 0.14% : 0.000077s : 1: symbol_engine_optimizer 78.25% : 0.043983s : 1: type_inference TotalTime = 0.155617, [30] [bootstrap]: 0.00042408 [type_inference]: 0.138031 [event_method]: 2.701e-05 [auto_monad]: 8.505e-05 [graph_reusing]: 6.98e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00072594 [rewriter_before_opt_a]: 0.00010956 [expand_dump_flag]: 4.62e-06 [jit_opt_a]: 0.0130271, [2] [Cycle 1]: 0.00793198, [27] [switch_simplify]: 8.139e-05 [loop_unroll]: 3.497e-05 [a_1]: 0.00086999 [with_stream_mark]: 2.709e-05 [recompute_prepare]: 1.009e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.44001e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 8.18001e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 8.84003e-06 [meta_shard_fg_expand]: 3.08e-06 [get_grad_eliminate_]: 8.37e-06 [merge_forward]: 5.00001e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 1.269e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.155e-05 [inline_without_move]: 7.29001e-06 [renormalize]: 0.0064545 [add_forward_monad_depend]: 1.225e-05 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 2.521e-05 [cse]: 4.596e-05 [replace_applicator]: 2.833e-05 [Cycle 2]: 0.00045906, [27] [switch_simplify]: 8.99e-06 [loop_unroll]: 6.53e-06 [a_1]: 0.00016425 [with_stream_mark]: 1.988e-05 [recompute_prepare]: 6.99001e-06 [updatestate_depend_eliminate]: 4.66002e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 7.45e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.55002e-06 [merge_forward]: 4.95999e-06 [cell_reuse_recompute_pass]: 4.65999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 3.18e-06 [replace_old_param]: 1.168e-05 [inline_without_move]: 6.49001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.62001e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 7.71999e-06 [cse]: 1.709e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.961e-05 [rewriter_after_opt_a]: 4.732e-05 [convert_after_rewriter]: 7.55e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00097047 [jit_opt_b]: 6.554e-05, [1] [Cycle 1]: 5.695e-05, [2] [frontend_op_eliminate]: 2.355e-05 [inline_after_opt_a]: 2.015e-05 [cconv]: 3.82e-05 [loop_unroll]: 0.00054106 [jit_opt_after_cconv]: 0.00018938, [1] [Cycle 1]: 0.00018132, [11] [c_1]: 2.932e-05 [parameter_eliminate]: 4.07e-06 [updatestate_depend_eliminate]: 9.19e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.50002e-06 [cse]: 3.566e-05 [call_graph_tuple_transform]: 2.602e-05 [tuple_list_get_item_eliminator]: 7.04001e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 7.11001e-06 [remove_dup_value]: 1.972e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 1.13e-05 [add_recomputation]: 5.733e-05 [cse_after_recomputation]: 2.82e-05, [1] [Cycle 1]: 2.229e-05, [1] [cse]: 1.435e-05 [auto_monad_reorder]: 1.886e-05 [get_jit_bprop_graph]: 3.16999e-06 [rewriter_after_jit_bprop_graph]: 9.14e-06 [opt_after_jit_grad]: 0.00056967 [symbol_engine_optimizer]: 8.813e-05, [1] [Cycle 1]: 8.173e-05, [6] [build]: 5.62001e-06 [elim_shapecalc]: 1.004e-05 [elim_not_effective]: 1.701e-05 [opt_reshape]: 6.86999e-06 [fold_const_symbol]: 1.092e-05 [renormalize]: 3.19997e-07 [validate]: 0.00024968 Sums bootstrap : 0.000424s : 0.28% type_inference : 0.138031s : 91.86% event_method : 0.000027s : 0.02% auto_monad : 0.000085s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000726s : 0.48% rewriter_before_opt_a : 0.000110s : 0.07% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000090s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.001034s : 0.69% jit_opt_a.with_stream_mark : 0.000047s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.006455s : 4.30% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000063s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000047s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000970s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000038s : 0.03% loop_unroll : 0.000541s : 0.36% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000057s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000570s : 0.38% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000250s : 0.17% Time group info: ------[substitution.] 0.000389 28 1.05% : 0.000004s : 2: substitution.elim_not_effective 0.31% : 0.000001s : 2: substitution.fold_const_symbol 1.76% : 0.000007s : 4: substitution.graph_param_transform 84.65% : 0.000330s : 5: substitution.inline 1.33% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.37% : 0.000017s : 3: substitution.reduce_eliminate 1.61% : 0.000006s : 4: substitution.remove_not_recompute_node 1.66% : 0.000006s : 2: substitution.replace_old_param 3.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.137912 2 96.16% : 0.132614s : 1: type_inference.infer 3.84% : 0.005299s : 1: type_inference.specialize ------[replace.] 0.000133 7 67.61% : 0.000090s : 5: replace.inline 32.39% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000338 7 96.60% : 0.000327s : 5: match.inline 3.40% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000168 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.60% : 0.000003s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.59% : 0.000003s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 4.66% : 0.000008s : 28: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000003s : 19: predicate.load_eliminater 1.90% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.13% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 0.96% : 0.000002s : 13: predicate.minmaximum_grad 2.68% : 0.000004s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 1.78% : 0.000003s : 13: predicate.reduce_eliminate 1.54% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.05% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.00% : 0.000002s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 8: predicate.special_op_eliminate 0.79% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000012s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.53% : 0.000003s : 13: predicate.transpose_eliminate 1.62% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.19% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.98% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.53% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003877 25 51.86% : 0.002011s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.75% : 0.000106s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.39% : 0.001760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.163287 72 0.04% : 0.000060s : 1: add_recomputation 0.05% : 0.000089s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000442s : 1: bootstrap 0.03% : 0.000042s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.98% : 0.013032s : 1: jit_opt_a 0.12% : 0.000192s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.34% : 0.000552s : 1: loop_unroll 0.60% : 0.000984s : 1: mutable_eliminate 0.82% : 0.001333s : 26: opt.transform.jit_opt_a 0.04% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000580s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.000734s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.88% : 0.004695s : 1: renormalize.infer 1.07% : 0.001744s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.07% : 0.000116s : 1: rewriter_before_opt_a 0.06% : 0.000091s : 1: symbol_engine_optimizer 84.55% : 0.138061s : 1: type_inference TotalTime = 0.126453, [30] [bootstrap]: 0.00032566 [type_inference]: 0.114907 [event_method]: 1.925e-05 [auto_monad]: 7.244e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.00050441 [rewriter_before_opt_a]: 9.111e-05 [expand_dump_flag]: 4.38001e-06 [jit_opt_a]: 0.00789101, [2] [Cycle 1]: 0.00391077, [27] [switch_simplify]: 5.989e-05 [loop_unroll]: 3.141e-05 [a_1]: 0.00061384 [with_stream_mark]: 1.947e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 7.77e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 7.77e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 6.65998e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 6.58e-06 [renormalize]: 0.00278205 [add_forward_monad_depend]: 8.75999e-06 [auto_monad_grad]: 3.04999e-06 [auto_monad_eliminator]: 2.129e-05 [cse]: 3.604e-05 [replace_applicator]: 2.381e-05 [Cycle 2]: 0.00043581, [27] [switch_simplify]: 8.28001e-06 [loop_unroll]: 7.45003e-06 [a_1]: 0.00013536 [with_stream_mark]: 1.804e-05 [recompute_prepare]: 7.35e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 6.72002e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 3.13e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.898e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 7.11999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.01003e-06 [auto_monad_grad]: 1.27999e-06 [auto_monad_eliminator]: 7.92e-06 [cse]: 1.569e-05 [replace_applicator]: 6.82002e-06 [py_interpret_to_execute_after_opt_a]: 1.295e-05 [rewriter_after_opt_a]: 3.949e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00073209 [jit_opt_b]: 6.303e-05, [1] [Cycle 1]: 5.346e-05, [2] [frontend_op_eliminate]: 2.219e-05 [inline_after_opt_a]: 1.97e-05 [cconv]: 2.666e-05 [loop_unroll]: 0.00045925 [jit_opt_after_cconv]: 0.00016283, [1] [Cycle 1]: 0.00015524, [11] [c_1]: 2.675e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 2.508e-05 [call_graph_tuple_transform]: 2.344e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.28998e-06 [remove_dup_value]: 1.643e-05 [partial_unused_args_eliminate]: 3.02002e-06 [environ_conv]: 9.24e-06 [add_recomputation]: 5.413e-05 [cse_after_recomputation]: 2.29e-05, [1] [Cycle 1]: 1.738e-05, [1] [cse]: 1.143e-05 [auto_monad_reorder]: 1.527e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 5.76e-06 [opt_after_jit_grad]: 0.00057833 [symbol_engine_optimizer]: 8.362e-05, [1] [Cycle 1]: 7.39e-05, [6] [build]: 4.53001e-06 [elim_shapecalc]: 8.96002e-06 [elim_not_effective]: 1.431e-05 [opt_reshape]: 8.24998e-06 [fold_const_symbol]: 9.07001e-06 [renormalize]: 5.69999e-07 [validate]: 0.00013337 Sums bootstrap : 0.000326s : 0.27% type_inference : 0.114907s : 94.00% event_method : 0.000019s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000504s : 0.41% rewriter_before_opt_a : 0.000091s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000749s : 0.61% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.002782s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000732s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000459s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000578s : 0.47% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000133s : 0.11% Time group info: ------[substitution.] 0.000230 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 3.27% : 0.000008s : 4: substitution.graph_param_transform 83.55% : 0.000193s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000006s : 4: substitution.remove_not_recompute_node 2.10% : 0.000005s : 2: substitution.replace_old_param 5.72% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114827 2 97.63% : 0.112105s : 1: type_inference.infer 2.37% : 0.002722s : 1: type_inference.specialize ------[replace.] 0.000078 6 66.50% : 0.000052s : 4: replace.inline 33.50% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 94.07% : 0.000189s : 4: match.inline 5.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.84% : 0.000003s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.53% : 0.000008s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.81% : 0.000003s : 8: predicate.less_batch_normalization 1.30% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 18: predicate.load_eliminater 1.81% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000003s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.28% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002444 22 67.93% : 0.001660s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.67% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.40% : 0.000743s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130229 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000345s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.06% : 0.007894s : 1: jit_opt_a 0.13% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.36% : 0.000469s : 1: loop_unroll 0.57% : 0.000742s : 1: mutable_eliminate 0.78% : 0.001011s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000588s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000511s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.50% : 0.001955s : 1: renormalize.infer 0.63% : 0.000816s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 88.25% : 0.114923s : 1: type_inference TotalTime = 0.12849, [30] [bootstrap]: 0.00031205 [type_inference]: 0.116452 [event_method]: 2.322e-05 [auto_monad]: 7.785e-05 [graph_reusing]: 5.70001e-06 [pre_auto_parallel]: 2.31998e-06 [py_interpret_to_execute]: 0.00051495 [rewriter_before_opt_a]: 0.00010068 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.00845928, [2] [Cycle 1]: 0.00439175, [27] [switch_simplify]: 6.496e-05 [loop_unroll]: 3.373e-05 [a_1]: 0.0007377 [with_stream_mark]: 2.356e-05 [recompute_prepare]: 9.84001e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.83003e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00315884 [add_forward_monad_depend]: 7.03e-06 [auto_monad_grad]: 2.97002e-06 [auto_monad_eliminator]: 1.795e-05 [cse]: 3.718e-05 [replace_applicator]: 1.69e-05 [Cycle 2]: 0.00038773, [27] [switch_simplify]: 6.80998e-06 [loop_unroll]: 6.57002e-06 [a_1]: 0.00013498 [with_stream_mark]: 1.262e-05 [recompute_prepare]: 6.36998e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 1.88997e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.262e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.28002e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.363e-05 [replace_applicator]: 5.99999e-06 [py_interpret_to_execute_after_opt_a]: 1.685e-05 [rewriter_after_opt_a]: 4.09e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00071136 [jit_opt_b]: 8.755e-05, [1] [Cycle 1]: 7.938e-05, [2] [frontend_op_eliminate]: 4.804e-05 [inline_after_opt_a]: 1.907e-05 [cconv]: 3.969e-05 [loop_unroll]: 0.00046035 [jit_opt_after_cconv]: 0.00015771, [1] [Cycle 1]: 0.00015078, [11] [c_1]: 2.672e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.64e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.161e-05 [call_graph_tuple_transform]: 2.324e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 6.32001e-06 [remove_dup_value]: 1.793e-05 [partial_unused_args_eliminate]: 4.13001e-06 [environ_conv]: 8.23999e-06 [add_recomputation]: 5.006e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.288e-05 [auto_monad_reorder]: 1.798e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.97001e-06 [opt_after_jit_grad]: 0.00046887 [symbol_engine_optimizer]: 0.00017398, [1] [Cycle 1]: 0.00016695, [6] [build]: 3.36999e-06 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 1.603e-05 [opt_reshape]: 9.907e-05 [fold_const_symbol]: 9.69999e-06 [renormalize]: 4.80009e-07 [validate]: 5.062e-05 Sums bootstrap : 0.000312s : 0.25% type_inference : 0.116452s : 93.76% event_method : 0.000023s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000515s : 0.41% rewriter_before_opt_a : 0.000101s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000873s : 0.70% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003159s : 2.54% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000711s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000048s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000040s : 0.03% loop_unroll : 0.000460s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000469s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000099s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000306 28 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.33% : 0.000007s : 4: substitution.graph_param_transform 84.25% : 0.000258s : 5: substitution.inline 1.36% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.99% : 0.000012s : 3: substitution.reduce_eliminate 1.57% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_old_param 3.64% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116370 2 97.44% : 0.113389s : 1: type_inference.infer 2.56% : 0.002981s : 1: type_inference.specialize ------[replace.] 0.000103 7 69.22% : 0.000071s : 5: replace.inline 30.78% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 96.27% : 0.000255s : 5: match.inline 3.73% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.51% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.56% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.91% : 0.000003s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.94% : 0.000009s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.29% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.85% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000010s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002412 25 63.07% : 0.001521s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.61% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.32% : 0.000804s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132957 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000328s : 1: bootstrap 0.03% : 0.000043s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.37% : 0.008463s : 1: jit_opt_a 0.12% : 0.000160s : 1: jit_opt_after_cconv 0.07% : 0.000091s : 1: jit_opt_b 0.35% : 0.000468s : 1: loop_unroll 0.54% : 0.000720s : 1: mutable_eliminate 0.85% : 0.001124s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000060s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000128s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000523s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.75% : 0.002321s : 1: renormalize.infer 0.62% : 0.000826s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000107s : 1: rewriter_before_opt_a 0.13% : 0.000177s : 1: symbol_engine_optimizer 87.60% : 0.116469s : 1: type_inference TotalTime = 0.136256, [30] [bootstrap]: 0.00035421 [type_inference]: 0.124228 [event_method]: 2.405e-05 [auto_monad]: 7.081e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.08998e-06 [py_interpret_to_execute]: 0.00067297 [rewriter_before_opt_a]: 0.00010606 [expand_dump_flag]: 4.03001e-06 [jit_opt_a]: 0.00832503, [2] [Cycle 1]: 0.00418477, [27] [switch_simplify]: 6.603e-05 [loop_unroll]: 3.699e-05 [a_1]: 0.00073399 [with_stream_mark]: 1.942e-05 [recompute_prepare]: 9.84999e-06 [updatestate_depend_eliminate]: 4.19997e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 9.12999e-06 [updatestate_useless_node_eliminater]: 6.38003e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 7.06999e-06 [merge_forward]: 3.55003e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 1.121e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 1.144e-05 [inline_without_move]: 7.11999e-06 [renormalize]: 0.00296629 [add_forward_monad_depend]: 6.93998e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.492e-05 [cse]: 2.775e-05 [replace_applicator]: 1.585e-05 [Cycle 2]: 0.00038393, [27] [switch_simplify]: 7.8e-06 [loop_unroll]: 6.46999e-06 [a_1]: 0.00012743 [with_stream_mark]: 1.061e-05 [recompute_prepare]: 5.98002e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.41998e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.394e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.205e-05 [rewriter_after_opt_a]: 4.141e-05 [convert_after_rewriter]: 6.27001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00060429 [jit_opt_b]: 5.958e-05, [1] [Cycle 1]: 5.345e-05, [2] [frontend_op_eliminate]: 1.978e-05 [inline_after_opt_a]: 2.116e-05 [cconv]: 2e-05 [loop_unroll]: 0.00044964 [jit_opt_after_cconv]: 0.00016839, [1] [Cycle 1]: 0.00016147, [11] [c_1]: 2.793e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 7.03e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.54999e-06 [cse]: 2.944e-05 [call_graph_tuple_transform]: 2.16e-05 [tuple_list_get_item_eliminator]: 6.84999e-06 [none_parameter_eliminate]: 1.24998e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.52001e-06 [remove_dup_value]: 1.53e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.65998e-06 [add_recomputation]: 5.045e-05 [cse_after_recomputation]: 2.768e-05, [1] [Cycle 1]: 2.151e-05, [1] [cse]: 1.508e-05 [auto_monad_reorder]: 1.4e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 6.17999e-06 [opt_after_jit_grad]: 0.00059139 [symbol_engine_optimizer]: 7.986e-05, [1] [Cycle 1]: 7.374e-05, [6] [build]: 3.08998e-06 [elim_shapecalc]: 9.64e-06 [elim_not_effective]: 1.47e-05 [opt_reshape]: 7.48e-06 [fold_const_symbol]: 1.075e-05 [renormalize]: 5.00004e-07 [validate]: 5.363e-05 Sums bootstrap : 0.000354s : 0.27% type_inference : 0.124228s : 94.24% event_method : 0.000024s : 0.02% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000673s : 0.51% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000861s : 0.65% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002966s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000604s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000450s : 0.34% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000591s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.04% Time group info: ------[substitution.] 0.000260 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.03% : 0.000005s : 4: substitution.graph_param_transform 86.83% : 0.000226s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 4.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124143 2 97.02% : 0.120447s : 1: type_inference.infer 2.98% : 0.003696s : 1: type_inference.specialize ------[replace.] 0.000111 7 66.53% : 0.000074s : 5: replace.inline 33.47% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000234 7 95.42% : 0.000223s : 5: match.inline 4.58% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.60% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.62% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.74% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.79% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 1.13% : 0.000002s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002682 25 62.66% : 0.001680s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.76% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.58% : 0.000927s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140370 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000378s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.93% : 0.008329s : 1: jit_opt_a 0.12% : 0.000171s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.33% : 0.000457s : 1: loop_unroll 0.44% : 0.000613s : 1: mutable_eliminate 0.80% : 0.001125s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000600s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.49% : 0.000684s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.46% : 0.002052s : 1: renormalize.infer 0.64% : 0.000904s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 88.51% : 0.124244s : 1: type_inference TotalTime = 0.0174624, [30] [bootstrap]: 0.00032588 [type_inference]: 0.00899523 [event_method]: 2.155e-05 [auto_monad]: 7.268e-05 [graph_reusing]: 6.56999e-06 [pre_auto_parallel]: 3.13e-06 [py_interpret_to_execute]: 4.679e-05 [rewriter_before_opt_a]: 8.452e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00566254, [2] [Cycle 1]: 0.00195055, [27] [switch_simplify]: 6.224e-05 [loop_unroll]: 3.528e-05 [a_1]: 0.0007014 [with_stream_mark]: 1.886e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.004e-05 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00079055 [add_forward_monad_depend]: 5.52001e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.507e-05 [cse]: 4.012e-05 [replace_applicator]: 1.256e-05 [Cycle 2]: 0.00033096, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.79999e-06 [a_1]: 9.311e-05 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 4.85001e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 7.67002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.14001e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 6.12001e-06 [cse]: 1.5e-05 [replace_applicator]: 5.44998e-06 [py_interpret_to_execute_after_opt_a]: 1.165e-05 [rewriter_after_opt_a]: 3.909e-05 [convert_after_rewriter]: 7.42998e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00055678 [jit_opt_b]: 5.165e-05, [1] [Cycle 1]: 4.468e-05, [2] [frontend_op_eliminate]: 1.652e-05 [inline_after_opt_a]: 1.639e-05 [cconv]: 2.562e-05 [loop_unroll]: 0.00045539 [jit_opt_after_cconv]: 0.00016871, [1] [Cycle 1]: 0.00016197, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 6.14001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.401e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 6.41998e-06 [remove_dup_value]: 3.476e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 6.34999e-06 [add_recomputation]: 4.96e-05 [cse_after_recomputation]: 2.54e-05, [1] [Cycle 1]: 1.97e-05, [1] [cse]: 1.346e-05 [auto_monad_reorder]: 1.876e-05 [get_jit_bprop_graph]: 2.62001e-06 [rewriter_after_jit_bprop_graph]: 5.47001e-06 [opt_after_jit_grad]: 0.00047999 [symbol_engine_optimizer]: 7.414e-05, [1] [Cycle 1]: 6.752e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 4.00003e-07 [validate]: 4.036e-05 Sums bootstrap : 0.000326s : 2.42% type_inference : 0.008995s : 66.74% event_method : 0.000022s : 0.16% auto_monad : 0.000073s : 0.54% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.35% rewriter_before_opt_a : 0.000085s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000068s : 0.51% jit_opt_a.loop_unroll : 0.000041s : 0.30% jit_opt_a.a_1 : 0.000795s : 5.89% jit_opt_a.with_stream_mark : 0.000030s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000791s : 5.87% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000055s : 0.41% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000039s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000557s : 4.13% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000026s : 0.19% loop_unroll : 0.000455s : 3.38% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000035s : 0.26% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.37% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000480s : 3.56% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.30% Time group info: ------[substitution.] 0.000255 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000005s : 3: substitution.graph_param_transform 87.33% : 0.000223s : 5: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000005s : 2: substitution.replace_old_param 4.52% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008929 2 88.63% : 0.007914s : 1: type_inference.infer 11.37% : 0.001015s : 1: type_inference.specialize ------[replace.] 0.000099 7 67.92% : 0.000067s : 5: replace.inline 32.08% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 95.48% : 0.000219s : 5: match.inline 4.52% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.52% : 0.000002s : 11: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.63% : 0.000002s : 11: predicate.addn_zero_filter 1.86% : 0.000002s : 11: predicate.arithmetic_simplify 1.30% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.17% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.31% : 0.000002s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.95% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 16: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.45% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000001s : 11: predicate.print_const_string_wrapper 1.66% : 0.000002s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.47% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000004s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.90% : 0.000010s : 59: predicate.switch_simplify 1.34% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 2.27% : 0.000003s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000829 16 51.86% : 0.000430s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.55% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.59% : 0.000328s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019333 72 0.27% : 0.000053s : 1: add_recomputation 0.39% : 0.000076s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.77% : 0.000343s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 29.31% : 0.005666s : 1: jit_opt_a 0.89% : 0.000171s : 1: jit_opt_after_cconv 0.28% : 0.000054s : 1: jit_opt_b 2.40% : 0.000464s : 1: loop_unroll 2.92% : 0.000565s : 1: mutable_eliminate 5.29% : 0.001022s : 26: opt.transform.jit_opt_a 0.27% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000488s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000050s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000038s : 1: remove_dup_value 2.30% : 0.000445s : 1: renormalize.infer 1.74% : 0.000337s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000042s : 1: rewriter_after_opt_a 0.45% : 0.000088s : 1: rewriter_before_opt_a 0.40% : 0.000077s : 1: symbol_engine_optimizer 46.62% : 0.009013s : 1: type_inference TotalTime = 0.120993, [30] [bootstrap]: 0.00032665 [type_inference]: 0.110407 [event_method]: 2.206e-05 [auto_monad]: 7.3e-05 [graph_reusing]: 6.59001e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00049595 [rewriter_before_opt_a]: 9.564e-05 [expand_dump_flag]: 3.64002e-06 [jit_opt_a]: 0.00731124, [2] [Cycle 1]: 0.00372501, [27] [switch_simplify]: 5.941e-05 [loop_unroll]: 3.403e-05 [a_1]: 0.00066189 [with_stream_mark]: 1.648e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 2.40002e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.70998e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.28002e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.72999e-06 [meta_fg_expand]: 3.08e-06 [replace_old_param]: 9.41003e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 0.00260872 [add_forward_monad_depend]: 5.46e-06 [auto_monad_grad]: 2.09e-06 [auto_monad_eliminator]: 1.667e-05 [cse]: 3.502e-05 [replace_applicator]: 1.487e-05 [Cycle 2]: 0.00037914, [27] [switch_simplify]: 6.89001e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.00012974 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.23998e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.53998e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.10002e-06 [cell_reuse_recompute_pass]: 2.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.297e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.83002e-06 [cse]: 1.453e-05 [replace_applicator]: 6.36e-06 [py_interpret_to_execute_after_opt_a]: 1.224e-05 [rewriter_after_opt_a]: 3.819e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00051131 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.763e-05, [2] [frontend_op_eliminate]: 1.836e-05 [inline_after_opt_a]: 1.868e-05 [cconv]: 2.718e-05 [loop_unroll]: 0.00044202 [jit_opt_after_cconv]: 0.00015382, [1] [Cycle 1]: 0.00014739, [11] [c_1]: 2.547e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.73998e-06 [cse]: 2.437e-05 [call_graph_tuple_transform]: 2.1e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.859e-05 [partial_unused_args_eliminate]: 2.05002e-06 [environ_conv]: 8.03001e-06 [add_recomputation]: 4.804e-05 [cse_after_recomputation]: 2.284e-05, [1] [Cycle 1]: 1.799e-05, [1] [cse]: 1.219e-05 [auto_monad_reorder]: 1.795e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 6.46e-06 [opt_after_jit_grad]: 0.00047871 [symbol_engine_optimizer]: 7.671e-05, [1] [Cycle 1]: 7.084e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.28e-05 [opt_reshape]: 7.66999e-06 [fold_const_symbol]: 1.009e-05 [renormalize]: 4.50003e-07 [validate]: 0.00012527 Sums bootstrap : 0.000327s : 0.28% type_inference : 0.110407s : 94.21% event_method : 0.000022s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000496s : 0.42% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000792s : 0.68% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002609s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000511s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000442s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000479s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000125s : 0.11% Time group info: ------[substitution.] 0.000251 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 1.06% : 0.000003s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 4: substitution.graph_param_transform 82.29% : 0.000206s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.58% : 0.000011s : 3: substitution.reduce_eliminate 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 4.16% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110330 2 97.41% : 0.107470s : 1: type_inference.infer 2.59% : 0.002860s : 1: type_inference.specialize ------[replace.] 0.000091 7 69.11% : 0.000063s : 5: replace.inline 30.89% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 7 95.70% : 0.000204s : 5: match.inline 4.30% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.87% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.67% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.43% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002354 25 66.51% : 0.001566s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.66% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.83% : 0.000726s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124617 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.28% : 0.000349s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.87% : 0.007314s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.36% : 0.000451s : 1: loop_unroll 0.42% : 0.000520s : 1: mutable_eliminate 0.83% : 0.001031s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000502s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.51% : 0.001876s : 1: renormalize.infer 0.58% : 0.000722s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.61% : 0.110425s : 1: type_inference TotalTime = 0.184279, [30] [bootstrap]: 0.00044178 [type_inference]: 0.165933 [event_method]: 3.068e-05 [auto_monad]: 0.00010195 [graph_reusing]: 4.963e-05 [pre_auto_parallel]: 3.26001e-06 [py_interpret_to_execute]: 0.00131287 [rewriter_before_opt_a]: 0.00013843 [expand_dump_flag]: 4.72e-06 [jit_opt_a]: 0.0131097, [2] [Cycle 1]: 0.00721045, [27] [switch_simplify]: 8.667e-05 [loop_unroll]: 3.556e-05 [a_1]: 0.00095045 [with_stream_mark]: 3.001e-05 [recompute_prepare]: 1.124e-05 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.48e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 6.88998e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 2.99001e-06 [get_grad_eliminate_]: 8.12e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.039e-05 [j_node_and_user_rematch]: 1.364e-05 [meta_fg_expand]: 3.78999e-06 [replace_old_param]: 1.422e-05 [inline_without_move]: 6.95002e-06 [renormalize]: 0.00562254 [add_forward_monad_depend]: 1.126e-05 [auto_monad_grad]: 3.17997e-06 [auto_monad_eliminator]: 2.597e-05 [cse]: 4.776e-05 [replace_applicator]: 2.755e-05 [Cycle 2]: 0.00045087, [27] [switch_simplify]: 7.87e-06 [loop_unroll]: 7.07002e-06 [a_1]: 0.00015322 [with_stream_mark]: 1.722e-05 [recompute_prepare]: 6.91999e-06 [updatestate_depend_eliminate]: 4.77e-06 [updatestate_assign_eliminate]: 2.97002e-06 [updatestate_loads_eliminate]: 2.70002e-06 [parameter_eliminate]: 2.43e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 3.37002e-06 [get_grad_eliminate_]: 7.33e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 5.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.727e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 3.29001e-06 [replace_old_param]: 1.126e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 7.43999e-06 [cse]: 1.749e-05 [replace_applicator]: 6.64999e-06 [py_interpret_to_execute_after_opt_a]: 2.203e-05 [rewriter_after_opt_a]: 4.82e-05 [convert_after_rewriter]: 7.7e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00105013 [jit_opt_b]: 0.00012304, [1] [Cycle 1]: 0.00011477, [2] [frontend_op_eliminate]: 2.196e-05 [inline_after_opt_a]: 2.164e-05 [cconv]: 3.684e-05 [loop_unroll]: 0.00054988 [jit_opt_after_cconv]: 0.00019067, [1] [Cycle 1]: 0.000183, [11] [c_1]: 2.833e-05 [parameter_eliminate]: 4.62e-06 [updatestate_depend_eliminate]: 1.021e-05 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 3.733e-05 [call_graph_tuple_transform]: 2.497e-05 [tuple_list_get_item_eliminator]: 6.71e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.74001e-06 [remove_dup_value]: 2.261e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 9.76e-06 [add_recomputation]: 5.975e-05 [cse_after_recomputation]: 3.004e-05, [1] [Cycle 1]: 2.418e-05, [1] [cse]: 1.555e-05 [auto_monad_reorder]: 1.882e-05 [get_jit_bprop_graph]: 4.55001e-06 [rewriter_after_jit_bprop_graph]: 8.12e-06 [opt_after_jit_grad]: 0.00052086 [symbol_engine_optimizer]: 0.0001028, [1] [Cycle 1]: 9.55e-05, [6] [build]: 5.30999e-06 [elim_shapecalc]: 1.367e-05 [elim_not_effective]: 2.136e-05 [opt_reshape]: 8.08001e-06 [fold_const_symbol]: 1.234e-05 [renormalize]: 4.20026e-07 [validate]: 8.324e-05 Sums bootstrap : 0.000442s : 0.25% type_inference : 0.165933s : 93.22% event_method : 0.000031s : 0.02% auto_monad : 0.000102s : 0.06% graph_reusing : 0.000050s : 0.03% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001313s : 0.74% rewriter_before_opt_a : 0.000138s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000095s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.02% jit_opt_a.a_1 : 0.001104s : 0.62% jit_opt_a.with_stream_mark : 0.000047s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005623s : 3.16% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.02% jit_opt_a.cse : 0.000065s : 0.04% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000048s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001050s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000037s : 0.02% loop_unroll : 0.000550s : 0.31% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000023s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000060s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000521s : 0.29% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000021s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000083s : 0.05% Time group info: ------[substitution.] 0.000461 28 1.74% : 0.000008s : 2: substitution.elim_not_effective 0.28% : 0.000001s : 2: substitution.fold_const_symbol 1.50% : 0.000007s : 4: substitution.graph_param_transform 73.51% : 0.000339s : 5: substitution.inline 1.16% : 0.000005s : 4: substitution.j_node_and_user_rematch 15.33% : 0.000071s : 3: substitution.reduce_eliminate 1.52% : 0.000007s : 4: substitution.remove_not_recompute_node 1.68% : 0.000008s : 2: substitution.replace_old_param 3.27% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.165773 2 96.07% : 0.159253s : 1: type_inference.infer 3.93% : 0.006520s : 1: type_inference.specialize ------[replace.] 0.000147 7 64.17% : 0.000095s : 5: replace.inline 35.83% : 0.000053s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000349 7 96.02% : 0.000335s : 5: match.inline 3.98% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000165 886 1.06% : 0.000002s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 2.38% : 0.000004s : 13: predicate.arithmetic_simplify 1.87% : 0.000003s : 13: predicate.cast_eliminate 0.75% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.53% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.95% : 0.000008s : 28: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000003s : 19: predicate.load_eliminater 1.81% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 0.98% : 0.000002s : 13: predicate.minmaximum_grad 2.16% : 0.000004s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.26% : 0.000004s : 13: predicate.reduce_eliminate 1.67% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.63% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.10% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000002s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000004s : 20: predicate.switch_defer_inline 2.31% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.39% : 0.000012s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.69% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003842 25 59.58% : 0.002289s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.85% : 0.000110s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.57% : 0.001444s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.191352 72 0.03% : 0.000063s : 1: add_recomputation 0.06% : 0.000106s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000464s : 1: bootstrap 0.02% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000037s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.03% : 0.000053s : 1: graph_reusing 6.85% : 0.013117s : 1: jit_opt_a 0.10% : 0.000193s : 1: jit_opt_after_cconv 0.07% : 0.000127s : 1: jit_opt_b 0.29% : 0.000559s : 1: loop_unroll 0.56% : 0.001064s : 1: mutable_eliminate 0.74% : 0.001413s : 26: opt.transform.jit_opt_a 0.03% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.28% : 0.000529s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.69% : 0.001326s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 2.15% : 0.004123s : 1: renormalize.infer 0.77% : 0.001482s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000051s : 1: rewriter_after_opt_a 0.08% : 0.000148s : 1: rewriter_before_opt_a 0.05% : 0.000105s : 1: symbol_engine_optimizer 86.73% : 0.165963s : 1: type_inference TotalTime = 0.143277, [30] [bootstrap]: 0.0003644 [type_inference]: 0.132414 [event_method]: 2.157e-05 [auto_monad]: 5.842e-05 [graph_reusing]: 4.97999e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00050922 [rewriter_before_opt_a]: 8.042e-05 [expand_dump_flag]: 3.55003e-06 [jit_opt_a]: 0.00732375, [2] [Cycle 1]: 0.0034902, [27] [switch_simplify]: 5.078e-05 [loop_unroll]: 3.358e-05 [a_1]: 0.00058921 [with_stream_mark]: 1.258e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 6.57002e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.243e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.83001e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00248898 [add_forward_monad_depend]: 7.06999e-06 [auto_monad_grad]: 1.65001e-06 [auto_monad_eliminator]: 1.462e-05 [cse]: 2.065e-05 [replace_applicator]: 1.517e-05 [Cycle 2]: 0.00037294, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.00012758 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 6.16998e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.41002e-06 [get_grad_eliminate_]: 5.61003e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.88002e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 6.41998e-06 [cse]: 1.185e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.117e-05 [rewriter_after_opt_a]: 3.105e-05 [convert_after_rewriter]: 7.21001e-06 [order_py_execute_after_rewriter]: 4.46002e-06 [mutable_eliminate]: 0.00062563 [jit_opt_b]: 5.962e-05, [1] [Cycle 1]: 5.169e-05, [2] [frontend_op_eliminate]: 2.124e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 2.295e-05 [loop_unroll]: 0.00046024 [jit_opt_after_cconv]: 0.00015564, [1] [Cycle 1]: 0.00014761, [11] [c_1]: 2.649e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 7.13998e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.137e-05 [call_graph_tuple_transform]: 2.188e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.24e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.96998e-06 [remove_dup_value]: 1.299e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 7.44002e-06 [add_recomputation]: 4.07e-05 [cse_after_recomputation]: 2.263e-05, [1] [Cycle 1]: 1.742e-05, [1] [cse]: 1.131e-05 [auto_monad_reorder]: 1.391e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.00048381 [symbol_engine_optimizer]: 0.00017504, [1] [Cycle 1]: 7.425e-05, [6] [build]: 3.37002e-06 [elim_shapecalc]: 9.25999e-06 [elim_not_effective]: 1.658e-05 [opt_reshape]: 7.93001e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 5.19998e-07 [validate]: 4.518e-05 Sums bootstrap : 0.000364s : 0.26% type_inference : 0.132414s : 95.25% event_method : 0.000022s : 0.02% auto_monad : 0.000058s : 0.04% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000509s : 0.37% rewriter_before_opt_a : 0.000080s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.04% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000717s : 0.52% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002489s : 1.79% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000033s : 0.02% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000031s : 0.02% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000626s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000460s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000041s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000484s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000194 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000002s : 2: substitution.fold_const_symbol 3.01% : 0.000006s : 4: substitution.graph_param_transform 85.13% : 0.000165s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000004s : 4: substitution.remove_not_recompute_node 1.83% : 0.000004s : 2: substitution.replace_old_param 4.81% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132344 2 97.90% : 0.129559s : 1: type_inference.infer 2.10% : 0.002786s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.22% : 0.000050s : 4: replace.inline 32.78% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 95.25% : 0.000162s : 4: match.inline 4.75% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.59% : 0.000002s : 12: predicate.addn_zero_filter 2.14% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 12: predicate.compare_switch_simplify 1.40% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.22% : 0.000002s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 2.33% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.50% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.07% : 0.000010s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002490 22 70.20% : 0.001748s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.22% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.57% : 0.000711s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146671 72 0.03% : 0.000043s : 1: add_recomputation 0.04% : 0.000062s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.26% : 0.000387s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 5.00% : 0.007327s : 1: jit_opt_a 0.11% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.32% : 0.000469s : 1: loop_unroll 0.43% : 0.000635s : 1: mutable_eliminate 0.65% : 0.000947s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000492s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000518s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.21% : 0.001771s : 1: renormalize.infer 0.48% : 0.000710s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000034s : 1: rewriter_after_opt_a 0.06% : 0.000085s : 1: rewriter_before_opt_a 0.12% : 0.000179s : 1: symbol_engine_optimizer 90.29% : 0.132428s : 1: type_inference TotalTime = 0.019023, [30] [bootstrap]: 0.0003305 [type_inference]: 0.0093792 [event_method]: 2.289e-05 [auto_monad]: 7.488e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 5.701e-05 [rewriter_before_opt_a]: 8.723e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00648394, [2] [Cycle 1]: 0.00222929, [27] [switch_simplify]: 6.685e-05 [loop_unroll]: 3.377e-05 [a_1]: 0.0007093 [with_stream_mark]: 2.019e-05 [recompute_prepare]: 7.94002e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.80001e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 2.77002e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00104344 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.538e-05 [cse]: 3.737e-05 [replace_applicator]: 1.198e-05 [Cycle 2]: 0.0003373, [27] [switch_simplify]: 6.11998e-06 [loop_unroll]: 5.31002e-06 [a_1]: 0.00010129 [with_stream_mark]: 9.76998e-06 [recompute_prepare]: 5.74999e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.73998e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.37001e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.26002e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.063e-05 [j_node_and_user_rematch]: 7.93001e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.07998e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.73002e-06 [cse]: 1.275e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.185e-05 [rewriter_after_opt_a]: 4.198e-05 [convert_after_rewriter]: 7.36999e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00089374 [jit_opt_b]: 5.439e-05, [1] [Cycle 1]: 4.678e-05, [2] [frontend_op_eliminate]: 1.824e-05 [inline_after_opt_a]: 1.615e-05 [cconv]: 2.699e-05 [loop_unroll]: 0.00043917 [jit_opt_after_cconv]: 0.00016237, [1] [Cycle 1]: 0.00015572, [11] [c_1]: 2.131e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 6.29999e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.295e-05 [call_graph_tuple_transform]: 3.238e-05 [tuple_list_get_item_eliminator]: 5.80002e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.927e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 6.33002e-06 [add_recomputation]: 5.449e-05 [cse_after_recomputation]: 2.547e-05, [1] [Cycle 1]: 1.964e-05, [1] [cse]: 1.351e-05 [auto_monad_reorder]: 1.85e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.07e-06 [opt_after_jit_grad]: 0.0004799 [symbol_engine_optimizer]: 7.735e-05, [1] [Cycle 1]: 6.937e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 7.8e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 3.50003e-07 [validate]: 4.441e-05 Sums bootstrap : 0.000331s : 2.28% type_inference : 0.009379s : 64.76% event_method : 0.000023s : 0.16% auto_monad : 0.000075s : 0.52% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000057s : 0.39% rewriter_before_opt_a : 0.000087s : 0.60% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.50% jit_opt_a.loop_unroll : 0.000039s : 0.27% jit_opt_a.a_1 : 0.000811s : 5.60% jit_opt_a.with_stream_mark : 0.000030s : 0.21% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.001044s : 7.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.15% jit_opt_a.cse : 0.000050s : 0.35% jit_opt_a.replace_applicator : 0.000017s : 0.12% py_interpret_to_execute_after_opt_a : 0.000012s : 0.08% rewriter_after_opt_a : 0.000042s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000894s : 6.17% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000027s : 0.19% loop_unroll : 0.000439s : 3.03% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000032s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000019s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000054s : 0.38% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000480s : 3.31% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.31% Time group info: ------[substitution.] 0.000313 27 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 5.63% : 0.000018s : 3: substitution.graph_param_transform 81.88% : 0.000257s : 5: substitution.inline 1.27% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.35% : 0.000010s : 3: substitution.reduce_eliminate 1.46% : 0.000005s : 4: substitution.remove_not_recompute_node 1.35% : 0.000004s : 2: substitution.replace_old_param 4.02% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009295 2 86.93% : 0.008081s : 1: type_inference.infer 13.07% : 0.001214s : 1: type_inference.specialize ------[replace.] 0.000100 7 66.17% : 0.000066s : 5: replace.inline 33.83% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 7 95.73% : 0.000253s : 5: match.inline 4.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.35% : 0.000002s : 11: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.37% : 0.000002s : 11: predicate.addn_check_dump 1.39% : 0.000002s : 11: predicate.addn_zero_filter 2.14% : 0.000003s : 11: predicate.arithmetic_simplify 1.47% : 0.000002s : 11: predicate.cast_eliminate 0.69% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.14% : 0.000001s : 11: predicate.depend_value_elim 1.33% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.13% : 0.000001s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000007s : 24: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 16: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.75% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000001s : 11: predicate.print_const_string_wrapper 2.59% : 0.000003s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 19: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.82% : 0.000004s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.92% : 0.000010s : 59: predicate.switch_simplify 1.19% : 0.000002s : 11: predicate.tile_eliminate 1.40% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.60% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001014 16 48.95% : 0.000497s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.29% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.76% : 0.000444s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021167 72 0.27% : 0.000058s : 1: add_recomputation 0.37% : 0.000078s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.66% : 0.000352s : 1: bootstrap 0.14% : 0.000030s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000028s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.66% : 0.006490s : 1: jit_opt_a 0.78% : 0.000165s : 1: jit_opt_after_cconv 0.27% : 0.000057s : 1: jit_opt_b 2.11% : 0.000447s : 1: loop_unroll 4.27% : 0.000904s : 1: mutable_eliminate 4.92% : 0.001042s : 26: opt.transform.jit_opt_a 0.29% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.31% : 0.000489s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000060s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000022s : 1: remove_dup_value 2.74% : 0.000581s : 1: renormalize.infer 2.15% : 0.000455s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000045s : 1: rewriter_after_opt_a 0.43% : 0.000090s : 1: rewriter_before_opt_a 0.38% : 0.000080s : 1: symbol_engine_optimizer 44.40% : 0.009398s : 1: type_inference TotalTime = 0.0163566, [30] [bootstrap]: 0.00029408 [type_inference]: 0.00475437 [event_method]: 1.721e-05 [auto_monad]: 7.269e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 3.542e-05 [rewriter_before_opt_a]: 7.214e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.0068156, [2] [Cycle 1]: 0.00233529, [27] [switch_simplify]: 7.035e-05 [loop_unroll]: 3.324e-05 [a_1]: 0.00059908 [with_stream_mark]: 1.715e-05 [recompute_prepare]: 7.46001e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.402e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00123752 [add_forward_monad_depend]: 7.05e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.991e-05 [cse]: 3.396e-05 [replace_applicator]: 1.49e-05 [Cycle 2]: 0.00035536, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00010413 [with_stream_mark]: 1.193e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.58001e-06 [inline_without_move]: 5.07e-06 [renormalize]: 2.19996e-07 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 7.65e-06 [cse]: 1.315e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.337e-05 [rewriter_after_opt_a]: 4.504e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 4.82998e-06 [mutable_eliminate]: 0.00069614 [jit_opt_b]: 5.249e-05, [1] [Cycle 1]: 4.515e-05, [2] [frontend_op_eliminate]: 1.74e-05 [inline_after_opt_a]: 1.6e-05 [cconv]: 2.947e-05 [loop_unroll]: 0.00043418 [jit_opt_after_cconv]: 0.0001511, [1] [Cycle 1]: 0.00014397, [11] [c_1]: 2.164e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.424e-05 [call_graph_tuple_transform]: 2.012e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.31002e-06 [remove_dup_value]: 1.471e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5.286e-05 [cse_after_recomputation]: 2.179e-05, [1] [Cycle 1]: 1.627e-05, [1] [cse]: 1.031e-05 [auto_monad_reorder]: 1.616e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 5.80002e-06 [opt_after_jit_grad]: 0.00046521 [symbol_engine_optimizer]: 7.488e-05, [1] [Cycle 1]: 6.895e-05, [6] [build]: 4.03999e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.334e-05 [opt_reshape]: 6.27001e-06 [fold_const_symbol]: 8.86002e-06 [renormalize]: 5.60016e-07 [validate]: 3.991e-05 Sums bootstrap : 0.000294s : 3.05% type_inference : 0.004754s : 49.34% event_method : 0.000017s : 0.18% auto_monad : 0.000073s : 0.75% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.37% rewriter_before_opt_a : 0.000072s : 0.75% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000077s : 0.80% jit_opt_a.loop_unroll : 0.000039s : 0.40% jit_opt_a.a_1 : 0.000703s : 7.30% jit_opt_a.with_stream_mark : 0.000029s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.001238s : 12.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.29% jit_opt_a.cse : 0.000047s : 0.49% jit_opt_a.replace_applicator : 0.000021s : 0.21% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000045s : 0.47% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000696s : 7.22% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000029s : 0.31% loop_unroll : 0.000434s : 4.51% jit_opt_after_cconv.c_1 : 0.000022s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.55% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000465s : 4.83% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000040s : 0.41% Time group info: ------[substitution.] 0.000234 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 3: substitution.graph_param_transform 84.62% : 0.000198s : 4: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000004s : 4: substitution.remove_not_recompute_node 2.48% : 0.000006s : 2: substitution.replace_old_param 5.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004689 2 81.04% : 0.003800s : 1: type_inference.infer 18.96% : 0.000889s : 1: type_inference.specialize ------[replace.] 0.000090 6 67.35% : 0.000060s : 4: replace.inline 32.65% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 6 94.57% : 0.000195s : 4: match.inline 5.43% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.46% : 0.000002s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000002s : 10: predicate.addn_zero_filter 2.55% : 0.000003s : 10: predicate.arithmetic_simplify 1.22% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000002s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.11% : 0.000006s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.29% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.68% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.09% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.91% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.42% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.10% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.82% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000690 13 51.48% : 0.000355s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.44% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.07% : 0.000297s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016619 72 0.34% : 0.000056s : 1: add_recomputation 0.46% : 0.000076s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 1.87% : 0.000310s : 1: bootstrap 0.20% : 0.000033s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.12% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 41.04% : 0.006820s : 1: jit_opt_a 0.93% : 0.000154s : 1: jit_opt_after_cconv 0.33% : 0.000055s : 1: jit_opt_b 2.67% : 0.000443s : 1: loop_unroll 4.25% : 0.000707s : 1: mutable_eliminate 5.68% : 0.000944s : 26: opt.transform.jit_opt_a 0.30% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.85% : 0.000474s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 4.73% : 0.000786s : 1: renormalize.infer 2.66% : 0.000442s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000049s : 1: rewriter_after_opt_a 0.45% : 0.000075s : 1: rewriter_before_opt_a 0.47% : 0.000077s : 1: symbol_engine_optimizer 28.67% : 0.004764s : 1: type_inference TotalTime = 0.0634501, [30] [bootstrap]: 0.00030504 [type_inference]: 0.0533318 [event_method]: 2.016e-05 [auto_monad]: 7.06e-05 [graph_reusing]: 6.33e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00029227 [rewriter_before_opt_a]: 8.535e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00701094, [2] [Cycle 1]: 0.00319838, [27] [switch_simplify]: 5.885e-05 [loop_unroll]: 3.096e-05 [a_1]: 0.0005952 [with_stream_mark]: 2.027e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 6.43998e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.18002e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 1.096e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 6.51e-06 [renormalize]: 0.00214106 [add_forward_monad_depend]: 6.24999e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.789e-05 [cse]: 3.1e-05 [replace_applicator]: 1.549e-05 [Cycle 2]: 0.00037055, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00012629 [with_stream_mark]: 1.011e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.81003e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 2.84999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.98002e-06 [cse]: 1.224e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.254e-05 [rewriter_after_opt_a]: 3.554e-05 [convert_after_rewriter]: 7.93001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00056569 [jit_opt_b]: 5.74e-05, [1] [Cycle 1]: 5.037e-05, [2] [frontend_op_eliminate]: 2.045e-05 [inline_after_opt_a]: 1.888e-05 [cconv]: 2.589e-05 [loop_unroll]: 0.00044086 [jit_opt_after_cconv]: 0.00014987, [1] [Cycle 1]: 0.00014373, [11] [c_1]: 2.739e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.96e-05 [call_graph_tuple_transform]: 2.064e-05 [tuple_list_get_item_eliminator]: 6.16998e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 6.47001e-06 [remove_dup_value]: 1.734e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 5.04e-05 [cse_after_recomputation]: 2.254e-05, [1] [Cycle 1]: 1.692e-05, [1] [cse]: 1.092e-05 [auto_monad_reorder]: 1.543e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 4.46002e-06 [opt_after_jit_grad]: 0.00058848 [symbol_engine_optimizer]: 7.993e-05, [1] [Cycle 1]: 7.363e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 9.79999e-06 [elim_not_effective]: 1.469e-05 [opt_reshape]: 7.34002e-06 [fold_const_symbol]: 9.76998e-06 [renormalize]: 4.00003e-07 [validate]: 4.295e-05 Sums bootstrap : 0.000305s : 0.51% type_inference : 0.053332s : 89.77% event_method : 0.000020s : 0.03% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000292s : 0.49% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000721s : 1.21% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002141s : 3.60% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000566s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000441s : 0.74% jit_opt_after_cconv.c_1 : 0.000027s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000588s : 0.99% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000218 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000006s : 4: substitution.graph_param_transform 83.68% : 0.000182s : 4: substitution.inline 1.81% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000006s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 5.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053254 2 96.51% : 0.051395s : 1: type_inference.infer 3.49% : 0.001859s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.76% : 0.000049s : 4: replace.inline 33.24% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 94.35% : 0.000180s : 4: match.inline 5.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.51% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.69% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000003s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002328 26 71.46% : 0.001664s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.89% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.64% : 0.000620s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066663 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000074s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.48% : 0.000322s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.52% : 0.007015s : 1: jit_opt_a 0.23% : 0.000152s : 1: jit_opt_after_cconv 0.09% : 0.000060s : 1: jit_opt_b 0.67% : 0.000449s : 1: loop_unroll 0.86% : 0.000575s : 1: mutable_eliminate 1.44% : 0.000961s : 26: opt.transform.jit_opt_a 0.09% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000067s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.90% : 0.000598s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000299s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.17% : 0.001445s : 1: renormalize.infer 1.03% : 0.000686s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.12% : 0.000083s : 1: symbol_engine_optimizer 80.03% : 0.053348s : 1: type_inference TotalTime = 0.0134164, [30] [bootstrap]: 0.00027039 [type_inference]: 0.00462673 [event_method]: 1.792e-05 [auto_monad]: 6.564e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.973e-05 [rewriter_before_opt_a]: 7.49e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00611055, [2] [Cycle 1]: 0.00163349, [27] [switch_simplify]: 5.725e-05 [loop_unroll]: 3.029e-05 [a_1]: 0.00051253 [with_stream_mark]: 1.611e-05 [recompute_prepare]: 7.88999e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.13002e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 5.14998e-06 [renormalize]: 0.00070194 [add_forward_monad_depend]: 4.75999e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 2.876e-05 [replace_applicator]: 1.074e-05 [Cycle 2]: 0.00031097, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 5.04e-06 [a_1]: 9.043e-05 [with_stream_mark]: 8.84e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.13998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.149e-05 [j_node_and_user_rematch]: 7.63001e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.09001e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.011e-05 [replace_applicator]: 5.47001e-06 [py_interpret_to_execute_after_opt_a]: 9.70002e-06 [rewriter_after_opt_a]: 3.359e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00057068 [jit_opt_b]: 4.853e-05, [1] [Cycle 1]: 4.176e-05, [2] [frontend_op_eliminate]: 1.533e-05 [inline_after_opt_a]: 1.563e-05 [cconv]: 2.55e-05 [loop_unroll]: 0.00049456 [jit_opt_after_cconv]: 0.00014883, [1] [Cycle 1]: 0.00014171, [11] [c_1]: 2.225e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 2.252e-05 [call_graph_tuple_transform]: 1.825e-05 [tuple_list_get_item_eliminator]: 5.17999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.574e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 5.94999e-06 [add_recomputation]: 4.94e-05 [cse_after_recomputation]: 2.24e-05, [1] [Cycle 1]: 1.709e-05, [1] [cse]: 1.128e-05 [auto_monad_reorder]: 1.61e-05 [get_jit_bprop_graph]: 1.84998e-06 [rewriter_after_jit_bprop_graph]: 4.08001e-06 [opt_after_jit_grad]: 0.0004669 [symbol_engine_optimizer]: 7.2e-05, [1] [Cycle 1]: 6.578e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 7.33e-06 [elim_not_effective]: 1.243e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 3.70026e-07 [validate]: 3.414e-05 Sums bootstrap : 0.000270s : 3.11% type_inference : 0.004627s : 53.23% event_method : 0.000018s : 0.21% auto_monad : 0.000066s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000040s : 0.46% rewriter_before_opt_a : 0.000075s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000063s : 0.73% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000603s : 6.94% jit_opt_a.with_stream_mark : 0.000025s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000702s : 8.08% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000039s : 0.45% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000034s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000571s : 6.57% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000025s : 0.29% loop_unroll : 0.000495s : 5.69% jit_opt_after_cconv.c_1 : 0.000022s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000049s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000467s : 5.37% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.39% Time group info: ------[substitution.] 0.000188 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 2.87% : 0.000005s : 3: substitution.graph_param_transform 82.29% : 0.000154s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 6.96% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004568 2 80.00% : 0.003654s : 1: type_inference.infer 20.00% : 0.000913s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.94% : 0.000046s : 4: replace.inline 33.06% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 6 92.71% : 0.000152s : 4: match.inline 7.29% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.47% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.75% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.65% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.09% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.97% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.67% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.86% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000617 13 49.98% : 0.000308s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.47% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.55% : 0.000281s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014992 72 0.35% : 0.000052s : 1: add_recomputation 0.46% : 0.000069s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 1.90% : 0.000285s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 40.78% : 0.006114s : 1: jit_opt_a 1.01% : 0.000152s : 1: jit_opt_after_cconv 0.34% : 0.000052s : 1: jit_opt_b 3.36% : 0.000504s : 1: loop_unroll 3.87% : 0.000580s : 1: mutable_eliminate 5.41% : 0.000812s : 26: opt.transform.jit_opt_a 0.32% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.17% : 0.000475s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.11% : 0.000317s : 1: renormalize.infer 2.53% : 0.000379s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000036s : 1: rewriter_after_opt_a 0.52% : 0.000078s : 1: rewriter_before_opt_a 0.50% : 0.000074s : 1: symbol_engine_optimizer 30.94% : 0.004639s : 1: type_inference TotalTime = 0.12242, [30] [bootstrap]: 0.00030572 [type_inference]: 0.111274 [event_method]: 2.314e-05 [auto_monad]: 7.101e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 3.4e-06 [py_interpret_to_execute]: 0.00059147 [rewriter_before_opt_a]: 0.00012237 [expand_dump_flag]: 4.69998e-06 [jit_opt_a]: 0.0076063, [2] [Cycle 1]: 0.00391681, [27] [switch_simplify]: 6.457e-05 [loop_unroll]: 3.596e-05 [a_1]: 0.0007555 [with_stream_mark]: 1.805e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 4.62998e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 7.43e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.62002e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.68998e-06 [replace_old_param]: 9.71998e-06 [inline_without_move]: 6.34999e-06 [renormalize]: 0.0026757 [add_forward_monad_depend]: 7.18e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.579e-05 [cse]: 3.622e-05 [replace_applicator]: 1.782e-05 [Cycle 2]: 0.00038355, [27] [switch_simplify]: 7.39002e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00012914 [with_stream_mark]: 1.102e-05 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.93002e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.601e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.524e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.264e-05 [rewriter_after_opt_a]: 3.791e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 5.04003e-06 [mutable_eliminate]: 0.00065365 [jit_opt_b]: 5.859e-05, [1] [Cycle 1]: 5.175e-05, [2] [frontend_op_eliminate]: 2.079e-05 [inline_after_opt_a]: 1.992e-05 [cconv]: 2.432e-05 [loop_unroll]: 0.00044922 [jit_opt_after_cconv]: 0.00015723, [1] [Cycle 1]: 0.00015123, [11] [c_1]: 2.713e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.266e-05 [call_graph_tuple_transform]: 2.203e-05 [tuple_list_get_item_eliminator]: 6.78e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 7.44002e-06 [remove_dup_value]: 1.93e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 8.28999e-06 [add_recomputation]: 4.896e-05 [cse_after_recomputation]: 2.432e-05, [1] [Cycle 1]: 1.915e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.836e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.76e-06 [opt_after_jit_grad]: 0.00047303 [symbol_engine_optimizer]: 0.00017365, [1] [Cycle 1]: 0.00016739, [6] [build]: 3.60998e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.378e-05 [opt_reshape]: 7.75998e-06 [fold_const_symbol]: 9.978e-05 [renormalize]: 4.00003e-07 [validate]: 4.533e-05 Sums bootstrap : 0.000306s : 0.26% type_inference : 0.111274s : 93.90% event_method : 0.000023s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000591s : 0.50% rewriter_before_opt_a : 0.000122s : 0.10% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.04% jit_opt_a.a_1 : 0.000885s : 0.75% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002676s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000654s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000449s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000473s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000100s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000340 25 0.53% : 0.000002s : 2: substitution.elim_not_effective 26.58% : 0.000090s : 2: substitution.fold_const_symbol 1.74% : 0.000006s : 4: substitution.graph_param_transform 63.69% : 0.000216s : 5: substitution.inline 0.90% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.41% : 0.000005s : 4: substitution.remove_not_recompute_node 1.20% : 0.000004s : 2: substitution.replace_old_param 3.95% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111173 2 97.19% : 0.108044s : 1: type_inference.infer 2.81% : 0.003129s : 1: type_inference.specialize ------[replace.] 0.000160 7 77.80% : 0.000124s : 5: replace.inline 22.20% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 94.69% : 0.000213s : 5: match.inline 5.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.35% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.26% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 1.94% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.23% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.43% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 13: predicate.value_based_eliminate 0.48% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002363 25 63.18% : 0.001493s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.57% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.25% : 0.000809s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126436 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000325s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.02% : 0.007609s : 1: jit_opt_a 0.13% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.36% : 0.000457s : 1: loop_unroll 0.52% : 0.000662s : 1: mutable_eliminate 0.90% : 0.001139s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000049s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000127s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000599s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.46% : 0.001843s : 1: renormalize.infer 0.65% : 0.000822s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000129s : 1: rewriter_before_opt_a 0.14% : 0.000176s : 1: symbol_engine_optimizer 88.02% : 0.111288s : 1: type_inference TotalTime = 0.118384, [30] [bootstrap]: 0.00026127 [type_inference]: 0.10773 [event_method]: 2.094e-05 [auto_monad]: 7.248e-05 [graph_reusing]: 5.65001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00052787 [rewriter_before_opt_a]: 9.52e-05 [expand_dump_flag]: 3.63999e-06 [jit_opt_a]: 0.00733631, [2] [Cycle 1]: 0.00377269, [27] [switch_simplify]: 5.771e-05 [loop_unroll]: 3.394e-05 [a_1]: 0.00077659 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 8.96998e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 6.43998e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.24999e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.63997e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00252833 [add_forward_monad_depend]: 6.78e-06 [auto_monad_grad]: 2.86999e-06 [auto_monad_eliminator]: 1.725e-05 [cse]: 3.297e-05 [replace_applicator]: 1.848e-05 [Cycle 2]: 0.00038139, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00013131 [with_stream_mark]: 1.298e-05 [recompute_prepare]: 6.24001e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 2.61e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.268e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.59e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.338e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.383e-05 [rewriter_after_opt_a]: 3.725e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00067705 [jit_opt_b]: 5.564e-05, [1] [Cycle 1]: 4.832e-05, [2] [frontend_op_eliminate]: 1.85e-05 [inline_after_opt_a]: 1.857e-05 [cconv]: 2.786e-05 [loop_unroll]: 0.00042894 [jit_opt_after_cconv]: 0.00015314, [1] [Cycle 1]: 0.00014677, [11] [c_1]: 2.564e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 6.44999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.289e-05 [call_graph_tuple_transform]: 2.072e-05 [tuple_list_get_item_eliminator]: 6.35002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 4.49974e-07 [switch_simplify]: 6.81001e-06 [remove_dup_value]: 1.577e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 8.32e-06 [add_recomputation]: 4.803e-05 [cse_after_recomputation]: 2.349e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.214e-05 [auto_monad_reorder]: 1.75e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.84e-06 [opt_after_jit_grad]: 0.00045906 [symbol_engine_optimizer]: 7.334e-05, [1] [Cycle 1]: 6.762e-05, [6] [build]: 3.43999e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.286e-05 [opt_reshape]: 6.57002e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 3.20026e-07 [validate]: 8.86e-05 Sums bootstrap : 0.000261s : 0.23% type_inference : 0.107730s : 93.99% event_method : 0.000021s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000528s : 0.46% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000908s : 0.79% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002528s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000677s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000429s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000459s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.08% Time group info: ------[substitution.] 0.000351 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.67% : 0.000006s : 4: substitution.graph_param_transform 87.13% : 0.000306s : 5: substitution.inline 1.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.70% : 0.000013s : 3: substitution.reduce_eliminate 1.23% : 0.000004s : 4: substitution.remove_not_recompute_node 1.11% : 0.000004s : 2: substitution.replace_old_param 3.11% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107655 2 97.44% : 0.104903s : 1: type_inference.infer 2.56% : 0.002752s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.90% : 0.000062s : 5: replace.inline 32.10% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000312 7 96.89% : 0.000302s : 5: match.inline 3.11% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.43% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.49% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.40% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.16% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.68% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.32% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 2.10% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000010s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002314 25 64.03% : 0.001482s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.00% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.97% : 0.000763s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122085 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000275s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.01% : 0.007340s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000437s : 1: loop_unroll 0.56% : 0.000687s : 1: mutable_eliminate 0.94% : 0.001148s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000536s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.42% : 0.001730s : 1: renormalize.infer 0.65% : 0.000788s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 88.26% : 0.107748s : 1: type_inference TotalTime = 0.0651594, [30] [bootstrap]: 0.00030319 [type_inference]: 0.0549627 [event_method]: 1.965e-05 [auto_monad]: 7.187e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 0.00029992 [rewriter_before_opt_a]: 8.766e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00698169, [2] [Cycle 1]: 0.00307601, [27] [switch_simplify]: 5.858e-05 [loop_unroll]: 3.115e-05 [a_1]: 0.00058343 [with_stream_mark]: 8.268e-05 [recompute_prepare]: 9.67001e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.77002e-06 [merge_forward]: 5.12e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.647e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00195335 [add_forward_monad_depend]: 6.83e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.8e-05 [cse]: 3.137e-05 [replace_applicator]: 1.906e-05 [Cycle 2]: 0.00037812, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 6.27001e-06 [a_1]: 0.00012675 [with_stream_mark]: 1.134e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 9.49999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 6.00002e-06 [cse]: 1.212e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.025e-05 [rewriter_after_opt_a]: 3.497e-05 [convert_after_rewriter]: 6.98e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00064693 [jit_opt_b]: 5.485e-05, [1] [Cycle 1]: 4.811e-05, [2] [frontend_op_eliminate]: 1.964e-05 [inline_after_opt_a]: 1.729e-05 [cconv]: 2.551e-05 [loop_unroll]: 0.00043852 [jit_opt_after_cconv]: 0.00015915, [1] [Cycle 1]: 0.00015204, [11] [c_1]: 2.822e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.262e-05 [call_graph_tuple_transform]: 2.142e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.596e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 9.11998e-06 [add_recomputation]: 5.021e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.6e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.561e-05 [get_jit_bprop_graph]: 1.59998e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00048106 [symbol_engine_optimizer]: 0.00014809, [1] [Cycle 1]: 0.00014124, [6] [build]: 3.38999e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.567e-05 [opt_reshape]: 7.228e-05 [fold_const_symbol]: 1.132e-05 [renormalize]: 3.80009e-07 [validate]: 4.74e-05 Sums bootstrap : 0.000303s : 0.50% type_inference : 0.054963s : 90.15% event_method : 0.000020s : 0.03% auto_monad : 0.000072s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000300s : 0.49% rewriter_before_opt_a : 0.000088s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000710s : 1.16% jit_opt_a.with_stream_mark : 0.000094s : 0.15% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001953s : 3.20% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000647s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000439s : 0.72% jit_opt_after_cconv.c_1 : 0.000028s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000481s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000072s : 0.12% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.08% Time group info: ------[substitution.] 0.000207 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.26% : 0.000007s : 4: substitution.graph_param_transform 82.28% : 0.000170s : 4: substitution.inline 1.74% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.50% : 0.000005s : 2: substitution.replace_old_param 6.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054882 2 96.52% : 0.052969s : 1: type_inference.infer 3.48% : 0.001913s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.46% : 0.000051s : 4: replace.inline 33.54% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.72% : 0.000168s : 4: match.inline 6.28% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.59% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.38% : 0.000002s : 12: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.72% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.51% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.50% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.17% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002267 26 72.47% : 0.001643s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.22% : 0.000594s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068199 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000076s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.47% : 0.000320s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.24% : 0.006985s : 1: jit_opt_a 0.24% : 0.000162s : 1: jit_opt_after_cconv 0.08% : 0.000058s : 1: jit_opt_b 0.74% : 0.000507s : 1: loop_unroll 0.96% : 0.000655s : 1: mutable_eliminate 1.40% : 0.000952s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000102s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.000307s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.92% : 0.001310s : 1: renormalize.infer 0.93% : 0.000634s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.14% : 0.000092s : 1: rewriter_before_opt_a 0.22% : 0.000151s : 1: symbol_engine_optimizer 80.61% : 0.054978s : 1: type_inference TotalTime = 0.0157743, [30] [bootstrap]: 0.00028105 [type_inference]: 0.00765203 [event_method]: 2.078e-05 [auto_monad]: 7.162e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 4.588e-05 [rewriter_before_opt_a]: 8.075e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00545881, [2] [Cycle 1]: 0.00192033, [27] [switch_simplify]: 5.037e-05 [loop_unroll]: 3.226e-05 [a_1]: 0.00063148 [with_stream_mark]: 1.424e-05 [recompute_prepare]: 6.91001e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 9.49e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 4.78001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 0.00076127 [add_forward_monad_depend]: 4.75001e-06 [auto_monad_grad]: 2.14999e-06 [auto_monad_eliminator]: 1.266e-05 [cse]: 2.366e-05 [replace_applicator]: 1.285e-05 [Cycle 2]: 0.00033735, [27] [switch_simplify]: 5.93998e-06 [loop_unroll]: 5.03002e-06 [a_1]: 9.761e-05 [with_stream_mark]: 9.04998e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.90998e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.28002e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.16002e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 2.78998e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.088e-05 [j_node_and_user_rematch]: 7.65998e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.11999e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.316e-05 [replace_applicator]: 5.22999e-06 [py_interpret_to_execute_after_opt_a]: 1.296e-05 [rewriter_after_opt_a]: 3.131e-05 [convert_after_rewriter]: 7.13998e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00056302 [jit_opt_b]: 5.077e-05, [1] [Cycle 1]: 4.336e-05, [2] [frontend_op_eliminate]: 1.565e-05 [inline_after_opt_a]: 1.582e-05 [cconv]: 2.551e-05 [loop_unroll]: 0.00045713 [jit_opt_after_cconv]: 0.00015019, [1] [Cycle 1]: 0.00014368, [11] [c_1]: 2.09e-05 [parameter_eliminate]: 2.55002e-06 [updatestate_depend_eliminate]: 6.03002e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 2.348e-05 [call_graph_tuple_transform]: 1.813e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.25001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.485e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 6.04001e-06 [add_recomputation]: 4.269e-05 [cse_after_recomputation]: 2.416e-05, [1] [Cycle 1]: 1.891e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.564e-05 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 5.89e-06 [opt_after_jit_grad]: 0.00045764 [symbol_engine_optimizer]: 7.323e-05, [1] [Cycle 1]: 6.738e-05, [6] [build]: 2.99999e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.252e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 4.69998e-07 [validate]: 3.706e-05 Sums bootstrap : 0.000281s : 2.37% type_inference : 0.007652s : 64.45% event_method : 0.000021s : 0.18% auto_monad : 0.000072s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.39% rewriter_before_opt_a : 0.000081s : 0.68% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000056s : 0.47% jit_opt_a.loop_unroll : 0.000037s : 0.31% jit_opt_a.a_1 : 0.000729s : 6.14% jit_opt_a.with_stream_mark : 0.000023s : 0.20% jit_opt_a.recompute_prepare : 0.000012s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000015s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000761s : 6.41% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.16% jit_opt_a.cse : 0.000037s : 0.31% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000031s : 0.26% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000563s : 4.74% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000457s : 3.85% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000043s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000016s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000458s : 3.85% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.31% Time group info: ------[substitution.] 0.000248 27 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000005s : 3: substitution.graph_param_transform 83.87% : 0.000208s : 5: substitution.inline 1.06% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.27% : 0.000011s : 3: substitution.reduce_eliminate 1.76% : 0.000004s : 4: substitution.remove_not_recompute_node 1.32% : 0.000003s : 2: substitution.replace_old_param 4.37% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007591 2 87.55% : 0.006646s : 1: type_inference.infer 12.45% : 0.000945s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.59% : 0.000062s : 5: replace.inline 31.41% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 7 95.46% : 0.000205s : 5: match.inline 4.54% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.35% : 0.000002s : 11: predicate.accumulaten_eliminater 0.84% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.63% : 0.000002s : 11: predicate.addn_zero_filter 1.87% : 0.000002s : 11: predicate.arithmetic_simplify 1.25% : 0.000001s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000007s : 24: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 16: predicate.load_eliminater 1.34% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.21% : 0.000001s : 11: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 16: predicate.partial_eliminate 1.34% : 0.000002s : 11: predicate.print_const_string_wrapper 1.94% : 0.000002s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.61% : 0.000002s : 11: predicate.reshape_eliminate 1.26% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 1.18% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.36% : 0.000002s : 11: predicate.transpose_eliminate 1.49% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000752 16 49.06% : 0.000369s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.26% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.68% : 0.000313s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017534 72 0.26% : 0.000046s : 1: add_recomputation 0.43% : 0.000075s : 1: auto_monad 0.10% : 0.000018s : 1: auto_monad_reorder 1.70% : 0.000298s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.15% : 0.005462s : 1: jit_opt_a 0.87% : 0.000153s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.65% : 0.000465s : 1: loop_unroll 3.27% : 0.000573s : 1: mutable_eliminate 5.36% : 0.000940s : 26: opt.transform.jit_opt_a 0.27% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000466s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.53% : 0.000443s : 1: renormalize.infer 1.77% : 0.000310s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000034s : 1: rewriter_after_opt_a 0.48% : 0.000084s : 1: rewriter_before_opt_a 0.43% : 0.000076s : 1: symbol_engine_optimizer 43.72% : 0.007666s : 1: type_inference TotalTime = 0.145063, [30] [bootstrap]: 0.00037325 [type_inference]: 0.13234 [event_method]: 2.619e-05 [auto_monad]: 7.684e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 0.00053372 [rewriter_before_opt_a]: 0.00010244 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00880644, [2] [Cycle 1]: 0.00450605, [27] [switch_simplify]: 6.944e-05 [loop_unroll]: 3.515e-05 [a_1]: 0.00076146 [with_stream_mark]: 2.364e-05 [recompute_prepare]: 9.19998e-06 [updatestate_depend_eliminate]: 4.73001e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 2.14e-06 [specialize_transform]: 7.37997e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 7.43e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 7.44002e-06 [merge_forward]: 4.47998e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 1.121e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 2.173e-05 [inline_without_move]: 6.86001e-06 [renormalize]: 0.00314749 [add_forward_monad_depend]: 9.68997e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.948e-05 [cse]: 4.371e-05 [replace_applicator]: 2.216e-05 [Cycle 2]: 0.00040646, [27] [switch_simplify]: 7.41001e-06 [loop_unroll]: 6.79999e-06 [a_1]: 0.00013929 [with_stream_mark]: 1.436e-05 [recompute_prepare]: 6.58998e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.31998e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.639e-05 [replace_applicator]: 6.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.643e-05 [rewriter_after_opt_a]: 4.045e-05 [convert_after_rewriter]: 7.36999e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.00094426 [jit_opt_b]: 6.112e-05, [1] [Cycle 1]: 5.188e-05, [2] [frontend_op_eliminate]: 2.112e-05 [inline_after_opt_a]: 1.979e-05 [cconv]: 3.025e-05 [loop_unroll]: 0.00047212 [jit_opt_after_cconv]: 0.00016741, [1] [Cycle 1]: 0.00016072, [11] [c_1]: 2.664e-05 [parameter_eliminate]: 3.45e-06 [updatestate_depend_eliminate]: 6.91001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.85e-05 [call_graph_tuple_transform]: 2.276e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 7.15e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 8.99e-06 [add_recomputation]: 5.405e-05 [cse_after_recomputation]: 2.603e-05, [1] [Cycle 1]: 1.987e-05, [1] [cse]: 1.378e-05 [auto_monad_reorder]: 1.746e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 7.76001e-06 [opt_after_jit_grad]: 0.00048413 [symbol_engine_optimizer]: 0.00017817, [1] [Cycle 1]: 0.0001719, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.40999e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 7.61001e-06 [fold_const_symbol]: 0.00010594 [renormalize]: 6.19999e-07 [validate]: 5.022e-05 Sums bootstrap : 0.000373s : 0.27% type_inference : 0.132340s : 94.21% event_method : 0.000026s : 0.02% auto_monad : 0.000077s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000534s : 0.38% rewriter_before_opt_a : 0.000102s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000901s : 0.64% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000031s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003148s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000060s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000944s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000472s : 0.34% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000484s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000106s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000424 28 0.41% : 0.000002s : 2: substitution.elim_not_effective 23.05% : 0.000098s : 2: substitution.fold_const_symbol 1.37% : 0.000006s : 4: substitution.graph_param_transform 62.97% : 0.000267s : 5: substitution.inline 1.06% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.33% : 0.000014s : 3: substitution.reduce_eliminate 1.37% : 0.000006s : 4: substitution.remove_not_recompute_node 3.71% : 0.000016s : 2: substitution.replace_old_param 2.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132253 2 97.57% : 0.129040s : 1: type_inference.infer 2.43% : 0.003213s : 1: type_inference.specialize ------[replace.] 0.000109 7 69.42% : 0.000075s : 5: replace.inline 30.58% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 7 96.18% : 0.000264s : 5: match.inline 3.82% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.38% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.57% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.92% : 0.000009s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.71% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.41% : 0.000007s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.82% : 0.000003s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000004s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 13: predicate.reshape_eliminate 1.46% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.54% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.53% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002725 25 65.82% : 0.001794s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.93% : 0.000843s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149556 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000081s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000394s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.89% : 0.008810s : 1: jit_opt_a 0.11% : 0.000170s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.32% : 0.000480s : 1: loop_unroll 0.64% : 0.000955s : 1: mutable_eliminate 0.79% : 0.001179s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000132s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000542s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.51% : 0.002255s : 1: renormalize.infer 0.59% : 0.000880s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000108s : 1: rewriter_before_opt_a 0.12% : 0.000181s : 1: symbol_engine_optimizer 88.50% : 0.132362s : 1: type_inference TotalTime = 0.0131621, [30] [bootstrap]: 0.00030042 [type_inference]: 0.00443253 [event_method]: 1.711e-05 [auto_monad]: 5.251e-05 [graph_reusing]: 4.86997e-06 [pre_auto_parallel]: 2.00002e-06 [py_interpret_to_execute]: 4.037e-05 [rewriter_before_opt_a]: 6.733e-05 [expand_dump_flag]: 2.32999e-06 [jit_opt_a]: 0.00483538, [2] [Cycle 1]: 0.00147449, [27] [switch_simplify]: 4.578e-05 [loop_unroll]: 3.038e-05 [a_1]: 0.00048604 [with_stream_mark]: 1.267e-05 [recompute_prepare]: 7.76001e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.13002e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.142e-05 [j_node_and_user_rematch]: 8.60001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.07e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00058534 [add_forward_monad_depend]: 5.30001e-06 [auto_monad_grad]: 2.33002e-06 [auto_monad_eliminator]: 1.4e-05 [cse]: 2.871e-05 [replace_applicator]: 1.197e-05 [Cycle 2]: 0.00033985, [27] [switch_simplify]: 5.91998e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.511e-05 [with_stream_mark]: 9.17001e-06 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 3.15002e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.09e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.311e-05 [j_node_and_user_rematch]: 8.03001e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 7.74002e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.48998e-06 [cse]: 1.262e-05 [replace_applicator]: 5.25001e-06 [py_interpret_to_execute_after_opt_a]: 1.129e-05 [rewriter_after_opt_a]: 3.582e-05 [convert_after_rewriter]: 8.18001e-06 [order_py_execute_after_rewriter]: 0.00121092 [mutable_eliminate]: 0.00057864 [jit_opt_b]: 5.68e-05, [1] [Cycle 1]: 4.83e-05, [2] [frontend_op_eliminate]: 1.792e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 2.8e-05 [loop_unroll]: 0.00043369 [jit_opt_after_cconv]: 0.00015384, [1] [Cycle 1]: 0.00014669, [11] [c_1]: 2.145e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.428e-05 [call_graph_tuple_transform]: 1.97e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.598e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 6.36e-06 [add_recomputation]: 4.95e-05 [cse_after_recomputation]: 3.709e-05, [1] [Cycle 1]: 1.656e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.47e-05 [get_jit_bprop_graph]: 2.11998e-06 [rewriter_after_jit_bprop_graph]: 6.41e-06 [opt_after_jit_grad]: 0.00046267 [symbol_engine_optimizer]: 7.452e-05, [1] [Cycle 1]: 6.852e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.276e-05 [opt_reshape]: 6.03002e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 4.00003e-07 [validate]: 3.813e-05 Sums bootstrap : 0.000300s : 3.16% type_inference : 0.004433s : 46.57% event_method : 0.000017s : 0.18% auto_monad : 0.000053s : 0.55% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.42% rewriter_before_opt_a : 0.000067s : 0.71% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000052s : 0.54% jit_opt_a.loop_unroll : 0.000035s : 0.37% jit_opt_a.a_1 : 0.000581s : 6.11% jit_opt_a.with_stream_mark : 0.000022s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000585s : 6.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000041s : 0.43% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000036s : 0.38% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.001211s : 12.72% mutable_eliminate : 0.000579s : 6.08% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.19% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000028s : 0.29% loop_unroll : 0.000434s : 4.56% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000049s : 0.52% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000463s : 4.86% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.40% TotalTime = 0.125369, [30] [bootstrap]: 0.00026056 [type_inference]: 0.114938 [event_method]: 1.839e-05 [auto_monad]: 6.93e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.73998e-06 [py_interpret_to_execute]: 0.00048055 [rewriter_before_opt_a]: 9.199e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00726863, [2] [Cycle 1]: 0.00353994, [27] [switch_simplify]: 5.847e-05 [loop_unroll]: 3.107e-05 [a_1]: 0.00057607 [with_stream_mark]: 1.684e-05 [recompute_prepare]: 9.05999e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.45003e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.05002e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.98002e-06 [meta_fg_expand]: 2.98998e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 6.46e-06 [renormalize]: 0.00251774 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 1.87001e-06 [auto_monad_eliminator]: 1.413e-05 [cse]: 2.062e-05 [replace_applicator]: 1.63e-05 [Cycle 2]: 0.00036425, [27] [switch_simplify]: 7.14001e-06 [loop_unroll]: 5.99e-06 [a_1]: 0.00012616 [with_stream_mark]: 8.77e-06 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 5.83997e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.379e-05 [j_node_and_user_rematch]: 8.44002e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.74999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.06997e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.078e-05 [replace_applicator]: 6.40002e-06 [py_interpret_to_execute_after_opt_a]: 8.91997e-06 [rewriter_after_opt_a]: 2.925e-05 [convert_after_rewriter]: 7.76001e-06 [order_py_execute_after_rewriter]: 3.97e-06 [mutable_eliminate]: 0.00054814 [jit_opt_b]: 5.61e-05, [1] [Cycle 1]: 4.994e-05, [2] [frontend_op_eliminate]: 2.021e-05 [inline_after_opt_a]: 1.748e-05 [cconv]: 1.562e-05 [loop_unroll]: 0.00045756 [jit_opt_after_cconv]: 0.00014985, [1] [Cycle 1]: 0.00014409, [11] [c_1]: 2.603e-05 [parameter_eliminate]: 2.25002e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 4.57e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.056e-05 [call_graph_tuple_transform]: 1.865e-05 [tuple_list_get_item_eliminator]: 7.83001e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 6.18002e-06 [remove_dup_value]: 8.24998e-06 [partial_unused_args_eliminate]: 1.30999e-06 [environ_conv]: 6.25002e-06 [add_recomputation]: 3.03e-05 [cse_after_recomputation]: 2.217e-05, [1] [Cycle 1]: 1.69e-05, [1] [cse]: 1.147e-05 [auto_monad_reorder]: 1.502e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00048525 [symbol_engine_optimizer]: 7.724e-05, [1] [Cycle 1]: 7.105e-05, [6] [build]: 2.70002e-06 [elim_shapecalc]: 9.30001e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 7.11001e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 3.69997e-07 [validate]: 3.271e-05 Sums bootstrap : 0.000261s : 0.21% type_inference : 0.114938s : 94.73% event_method : 0.000018s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000481s : 0.40% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000702s : 0.58% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002518s : 2.08% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000029s : 0.02% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000548s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000016s : 0.01% loop_unroll : 0.000458s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000030s : 0.02% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000485s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000157 23 1.27% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 3.96% : 0.000006s : 3: substitution.graph_param_transform 82.19% : 0.000129s : 4: substitution.inline 1.76% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000004s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 5.02% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004378 2 81.72% : 0.003578s : 1: type_inference.infer 18.28% : 0.000800s : 1: type_inference.specialize ------[replace.] 0.000063 6 64.67% : 0.000041s : 4: replace.inline 35.33% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000133 6 94.96% : 0.000126s : 4: match.inline 5.04% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.09% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.65% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.24% : 0.000003s : 3: predicate.mutable_eliminate 0.84% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000002s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.39% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.15% : 0.000008s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.68% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000589 13 50.49% : 0.000298s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.72% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.79% : 0.000264s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014591 72 0.36% : 0.000053s : 1: add_recomputation 0.38% : 0.000056s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.19% : 0.000320s : 1: bootstrap 0.21% : 0.000031s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.27% : 0.000039s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 33.16% : 0.004838s : 1: jit_opt_a 1.07% : 0.000157s : 1: jit_opt_after_cconv 0.41% : 0.000059s : 1: jit_opt_b 3.03% : 0.000442s : 1: loop_unroll 4.03% : 0.000588s : 1: mutable_eliminate 5.36% : 0.000783s : 26: opt.transform.jit_opt_a 0.33% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.23% : 0.000471s : 1: opt_after_jit_grad 8.37% : 0.001221s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000044s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 1.97% : 0.000287s : 1: renormalize.infer 2.01% : 0.000293s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.48% : 0.000070s : 1: rewriter_before_opt_a 0.53% : 0.000077s : 1: symbol_engine_optimizer 30.47% : 0.004445s : 1: type_inference Time group info: ------[substitution.] 0.000197 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000004s : 4: substitution.graph_param_transform 83.64% : 0.000165s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 6.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114866 2 97.71% : 0.112242s : 1: type_inference.infer 2.29% : 0.002625s : 1: type_inference.specialize ------[replace.] 0.000075 6 66.69% : 0.000050s : 4: replace.inline 33.31% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.36% : 0.000162s : 4: match.inline 6.64% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.27% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.33% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 4.99% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000001s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.28% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.02% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002057 22 67.79% : 0.001394s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.90% : 0.000635s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128793 72 0.03% : 0.000033s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.21% : 0.000274s : 1: bootstrap 0.01% : 0.000018s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.65% : 0.007273s : 1: jit_opt_a 0.12% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000465s : 1: loop_unroll 0.43% : 0.000556s : 1: mutable_eliminate 0.73% : 0.000942s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000494s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000487s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.41% : 0.001810s : 1: renormalize.infer 0.52% : 0.000665s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 89.25% : 0.114951s : 1: type_inference TotalTime = 0.0698299, [30] [bootstrap]: 0.00034171 [type_inference]: 0.0583076 [event_method]: 2.223e-05 [auto_monad]: 7.327e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.78998e-06 [py_interpret_to_execute]: 0.00030835 [rewriter_before_opt_a]: 0.00010516 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.00817995, [2] [Cycle 1]: 0.00416778, [27] [switch_simplify]: 6.879e-05 [loop_unroll]: 3.519e-05 [a_1]: 0.0007254 [with_stream_mark]: 2.257e-05 [recompute_prepare]: 9.23002e-06 [updatestate_depend_eliminate]: 4.78001e-06 [updatestate_assign_eliminate]: 3.84002e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 7.9e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 6.80002e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 6.51999e-06 [renormalize]: 0.00293739 [add_forward_monad_depend]: 6.51999e-06 [auto_monad_grad]: 3.06001e-06 [auto_monad_eliminator]: 2.084e-05 [cse]: 3.824e-05 [replace_applicator]: 2.004e-05 [Cycle 2]: 0.00038764, [27] [switch_simplify]: 7.20998e-06 [loop_unroll]: 6.79001e-06 [a_1]: 0.00012818 [with_stream_mark]: 1.242e-05 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 6.23002e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 3.74002e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.08002e-06 [inline_without_move]: 5.78002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.575e-05 [replace_applicator]: 6.38998e-06 [py_interpret_to_execute_after_opt_a]: 1.565e-05 [rewriter_after_opt_a]: 4.181e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00069957 [jit_opt_b]: 6.152e-05, [1] [Cycle 1]: 5.327e-05, [2] [frontend_op_eliminate]: 2.054e-05 [inline_after_opt_a]: 1.97e-05 [cconv]: 2.815e-05 [loop_unroll]: 0.00045717 [jit_opt_after_cconv]: 0.00016693, [1] [Cycle 1]: 0.00015979, [11] [c_1]: 2.966e-05 [parameter_eliminate]: 2.72001e-06 [updatestate_depend_eliminate]: 7.95e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 2.536e-05 [call_graph_tuple_transform]: 2.267e-05 [tuple_list_get_item_eliminator]: 7.21001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 2.096e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 8.80001e-06 [add_recomputation]: 5.201e-05 [cse_after_recomputation]: 2.608e-05, [1] [Cycle 1]: 2.057e-05, [1] [cse]: 1.486e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00049507 [symbol_engine_optimizer]: 7.817e-05, [1] [Cycle 1]: 7.187e-05, [6] [build]: 3.58e-06 [elim_shapecalc]: 9.25001e-06 [elim_not_effective]: 1.46e-05 [opt_reshape]: 7.18998e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 4.90021e-07 [validate]: 5.495e-05 Sums bootstrap : 0.000342s : 0.52% type_inference : 0.058308s : 88.95% event_method : 0.000022s : 0.03% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000308s : 0.47% rewriter_before_opt_a : 0.000105s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000076s : 0.12% jit_opt_a.loop_unroll : 0.000042s : 0.06% jit_opt_a.a_1 : 0.000854s : 1.30% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002937s : 4.48% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.04% jit_opt_a.cse : 0.000054s : 0.08% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000042s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000700s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000457s : 0.70% jit_opt_after_cconv.c_1 : 0.000030s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.08% cse_after_recomputation.cse : 0.000015s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000495s : 0.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.08% Time group info: ------[substitution.] 0.000282 25 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 4: substitution.graph_param_transform 87.49% : 0.000247s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000004s : 2: substitution.replace_old_param 4.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058229 2 96.21% : 0.056025s : 1: type_inference.infer 3.79% : 0.002204s : 1: type_inference.specialize ------[replace.] 0.000108 7 67.86% : 0.000073s : 5: replace.inline 32.14% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.61% : 0.000244s : 5: match.inline 4.39% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 888 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 1.89% : 0.000003s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 6.14% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.02% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.43% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 2.37% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000011s : 65: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.95% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002647 29 67.48% : 0.001786s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.10% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.43% : 0.000779s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073954 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.49% : 0.000359s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.07% : 0.008183s : 1: jit_opt_a 0.23% : 0.000170s : 1: jit_opt_after_cconv 0.09% : 0.000064s : 1: jit_opt_b 0.63% : 0.000465s : 1: loop_unroll 0.96% : 0.000708s : 1: mutable_eliminate 1.51% : 0.001118s : 26: opt.transform.jit_opt_a 0.08% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000315s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 2.82% : 0.002087s : 1: renormalize.infer 1.14% : 0.000840s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000110s : 1: rewriter_before_opt_a 0.19% : 0.000139s : 1: symbol_engine_optimizer 78.86% : 0.058316s : 1: type_inference TotalTime = 0.0168164, [30] [bootstrap]: 0.00029035 [type_inference]: 0.00517071 [event_method]: 1.947e-05 [auto_monad]: 6.734e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 4.678e-05 [rewriter_before_opt_a]: 7.778e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.00739563, [2] [Cycle 1]: 0.00184224, [27] [switch_simplify]: 6.181e-05 [loop_unroll]: 3.199e-05 [a_1]: 0.00056082 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 7.37997e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.26998e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.25001e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00082432 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.78e-05 [cse]: 2.971e-05 [replace_applicator]: 1.377e-05 [Cycle 2]: 0.00032148, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.262e-05 [with_stream_mark]: 8.99e-06 [recompute_prepare]: 5.55001e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.18001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 4.79002e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.296e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.53e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.091e-05 [replace_applicator]: 4.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.101e-05 [rewriter_after_opt_a]: 3.575e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00052939 [jit_opt_b]: 5.001e-05, [1] [Cycle 1]: 4.307e-05, [2] [frontend_op_eliminate]: 1.678e-05 [inline_after_opt_a]: 1.538e-05 [cconv]: 2.553e-05 [loop_unroll]: 0.00042082 [jit_opt_after_cconv]: 0.00014006, [1] [Cycle 1]: 0.00013428, [11] [c_1]: 2.113e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.18002e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.946e-05 [call_graph_tuple_transform]: 1.876e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.547e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 5.97001e-06 [add_recomputation]: 5.297e-05 [cse_after_recomputation]: 2.412e-05, [1] [Cycle 1]: 1.863e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.647e-05 [get_jit_bprop_graph]: 2.11998e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.00207948 [symbol_engine_optimizer]: 7.585e-05, [1] [Cycle 1]: 6.856e-05, [6] [build]: 4.46002e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.263e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 3.89991e-07 [validate]: 3.783e-05 Sums bootstrap : 0.000290s : 2.64% type_inference : 0.005171s : 47.10% event_method : 0.000019s : 0.18% auto_monad : 0.000067s : 0.61% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000047s : 0.43% rewriter_before_opt_a : 0.000078s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.62% jit_opt_a.loop_unroll : 0.000037s : 0.34% jit_opt_a.a_1 : 0.000653s : 5.95% jit_opt_a.with_stream_mark : 0.000028s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.15% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000824s : 7.51% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.22% jit_opt_a.cse : 0.000041s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.17% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000036s : 0.33% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000529s : 4.82% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000026s : 0.23% loop_unroll : 0.000421s : 3.83% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.48% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.002079s : 18.94% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.34% Time group info: ------[substitution.] 0.000219 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 3: substitution.graph_param_transform 84.32% : 0.000185s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 5.76% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005105 2 80.33% : 0.004101s : 1: type_inference.infer 19.67% : 0.001004s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.31% : 0.000048s : 4: replace.inline 34.69% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 94.07% : 0.000182s : 4: match.inline 5.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.47% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.53% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.68% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.98% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.17% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.25% : 0.000010s : 53: predicate.switch_simplify 1.25% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.53% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000724 13 48.66% : 0.000352s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.85% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.49% : 0.000329s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018572 72 0.30% : 0.000056s : 1: add_recomputation 0.38% : 0.000071s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.66% : 0.000309s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.12% : 0.000023s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 39.84% : 0.007399s : 1: jit_opt_a 0.77% : 0.000143s : 1: jit_opt_after_cconv 0.28% : 0.000053s : 1: jit_opt_b 2.31% : 0.000429s : 1: loop_unroll 2.90% : 0.000538s : 1: mutable_eliminate 4.71% : 0.000875s : 26: opt.transform.jit_opt_a 0.26% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000012s : 1: opt.transform.mutable_eliminate 0.14% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 11.26% : 0.002092s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000050s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.26% : 0.000420s : 1: renormalize.infer 2.13% : 0.000396s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.43% : 0.000081s : 1: rewriter_before_opt_a 0.43% : 0.000079s : 1: symbol_engine_optimizer 27.93% : 0.005187s : 1: type_inference TotalTime = 0.0187508, [30] [bootstrap]: 0.00029463 [type_inference]: 0.00995757 [event_method]: 2.105e-05 [auto_monad]: 7.293e-05 [graph_reusing]: 7.21001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 4.912e-05 [rewriter_before_opt_a]: 8.764e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00588313, [2] [Cycle 1]: 0.00194597, [27] [switch_simplify]: 6.303e-05 [loop_unroll]: 3.399e-05 [a_1]: 0.00065505 [with_stream_mark]: 1.926e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.23999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 0.00081432 [add_forward_monad_depend]: 6.02001e-06 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 1.592e-05 [cse]: 4.099e-05 [replace_applicator]: 1.365e-05 [Cycle 2]: 0.00033113, [27] [switch_simplify]: 6.44001e-06 [loop_unroll]: 5.21002e-06 [a_1]: 9.301e-05 [with_stream_mark]: 1.133e-05 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 4.80999e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.279e-05 [j_node_and_user_rematch]: 8e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 7.93001e-06 [inline_without_move]: 4.95999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.46e-05 [replace_applicator]: 5.39998e-06 [py_interpret_to_execute_after_opt_a]: 1.323e-05 [rewriter_after_opt_a]: 3.869e-05 [convert_after_rewriter]: 7.17002e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.0006376 [jit_opt_b]: 5.354e-05, [1] [Cycle 1]: 4.703e-05, [2] [frontend_op_eliminate]: 1.707e-05 [inline_after_opt_a]: 1.769e-05 [cconv]: 2.601e-05 [loop_unroll]: 0.00046872 [jit_opt_after_cconv]: 0.00015925, [1] [Cycle 1]: 0.00015282, [11] [c_1]: 2.261e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 7.11999e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 3.49001e-06 [cse]: 2.922e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 5.54e-06 [remove_dup_value]: 3.731e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 7.33999e-06 [add_recomputation]: 4.949e-05 [cse_after_recomputation]: 2.486e-05, [1] [Cycle 1]: 1.885e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 4.05e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 6.21e-06 [opt_after_jit_grad]: 0.00049273 [symbol_engine_optimizer]: 7.759e-05, [1] [Cycle 1]: 7.123e-05, [6] [build]: 3.82998e-06 [elim_shapecalc]: 8.61002e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 9.62999e-06 [renormalize]: 4.50003e-07 [validate]: 4.147e-05 Sums bootstrap : 0.000295s : 2.03% type_inference : 0.009958s : 68.45% event_method : 0.000021s : 0.14% auto_monad : 0.000073s : 0.50% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.34% rewriter_before_opt_a : 0.000088s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.48% jit_opt_a.loop_unroll : 0.000039s : 0.27% jit_opt_a.a_1 : 0.000748s : 5.14% jit_opt_a.with_stream_mark : 0.000031s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000814s : 5.60% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.15% jit_opt_a.cse : 0.000056s : 0.38% jit_opt_a.replace_applicator : 0.000019s : 0.13% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000039s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000638s : 4.38% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000026s : 0.18% loop_unroll : 0.000469s : 3.22% jit_opt_after_cconv.c_1 : 0.000023s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000037s : 0.26% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000049s : 0.34% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000040s : 0.28% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000493s : 3.39% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.29% Time group info: ------[substitution.] 0.000258 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 3: substitution.graph_param_transform 86.31% : 0.000222s : 5: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009887 2 89.50% : 0.008849s : 1: type_inference.infer 10.50% : 0.001038s : 1: type_inference.specialize ------[replace.] 0.000097 7 66.76% : 0.000065s : 5: replace.inline 33.24% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 7 95.10% : 0.000220s : 5: match.inline 4.90% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.52% : 0.000002s : 11: predicate.addn_zero_filter 1.90% : 0.000002s : 11: predicate.arithmetic_simplify 1.18% : 0.000001s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.27% : 0.000002s : 11: predicate.compare_switch_simplify 1.32% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.61% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.51% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000007s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.10% : 0.000001s : 11: predicate.print_const_string_wrapper 1.93% : 0.000002s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.32% : 0.000011s : 59: predicate.switch_simplify 1.27% : 0.000002s : 11: predicate.tile_eliminate 1.61% : 0.000002s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000826 16 51.78% : 0.000428s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.73% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.49% : 0.000335s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020606 72 0.25% : 0.000052s : 1: add_recomputation 0.37% : 0.000077s : 1: auto_monad 0.21% : 0.000044s : 1: auto_monad_reorder 1.53% : 0.000314s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000010s : 1: graph_reusing 28.57% : 0.005886s : 1: jit_opt_a 0.79% : 0.000163s : 1: jit_opt_after_cconv 0.27% : 0.000056s : 1: jit_opt_b 2.31% : 0.000477s : 1: loop_unroll 3.14% : 0.000647s : 1: mutable_eliminate 4.74% : 0.000977s : 26: opt.transform.jit_opt_a 0.25% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000502s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000052s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000040s : 1: remove_dup_value 2.17% : 0.000447s : 1: renormalize.infer 1.74% : 0.000359s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000042s : 1: rewriter_after_opt_a 0.44% : 0.000091s : 1: rewriter_before_opt_a 0.39% : 0.000080s : 1: symbol_engine_optimizer 48.41% : 0.009975s : 1: type_inference TotalTime = 0.126846, [30] [bootstrap]: 0.00036773 [type_inference]: 0.115251 [event_method]: 2.485e-05 [auto_monad]: 7.286e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 0.00052933 [rewriter_before_opt_a]: 0.00010583 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.00816865, [2] [Cycle 1]: 0.00424441, [27] [switch_simplify]: 6.429e-05 [loop_unroll]: 3.468e-05 [a_1]: 0.00070216 [with_stream_mark]: 2.005e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 4.44998e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.31999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 7.2e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.68998e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00306621 [add_forward_monad_depend]: 6.46999e-06 [auto_monad_grad]: 3.21001e-06 [auto_monad_eliminator]: 1.54e-05 [cse]: 3.485e-05 [replace_applicator]: 1.806e-05 [Cycle 2]: 0.00038518, [27] [switch_simplify]: 6.66999e-06 [loop_unroll]: 6.38e-06 [a_1]: 0.00013535 [with_stream_mark]: 1.155e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 2.58998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.358e-05 [replace_applicator]: 5.95002e-06 [py_interpret_to_execute_after_opt_a]: 1.485e-05 [rewriter_after_opt_a]: 3.864e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00061668 [jit_opt_b]: 5.698e-05, [1] [Cycle 1]: 4.94e-05, [2] [frontend_op_eliminate]: 1.96e-05 [inline_after_opt_a]: 1.807e-05 [cconv]: 2.663e-05 [loop_unroll]: 0.00044913 [jit_opt_after_cconv]: 0.00015482, [1] [Cycle 1]: 0.00014756, [11] [c_1]: 2.674e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.309e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.38002e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.03998e-06 [remove_dup_value]: 1.763e-05 [partial_unused_args_eliminate]: 2.03002e-06 [environ_conv]: 8.55001e-06 [add_recomputation]: 4.941e-05 [cse_after_recomputation]: 2.366e-05, [1] [Cycle 1]: 1.794e-05, [1] [cse]: 1.225e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.92999e-06 [opt_after_jit_grad]: 0.00046704 [symbol_engine_optimizer]: 7.745e-05, [1] [Cycle 1]: 7.108e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.83001e-06 [elim_not_effective]: 1.423e-05 [opt_reshape]: 6.96001e-06 [fold_const_symbol]: 9.23002e-06 [renormalize]: 3.89991e-07 [validate]: 8.57e-05 Sums bootstrap : 0.000368s : 0.30% type_inference : 0.115251s : 93.92% event_method : 0.000025s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000529s : 0.43% rewriter_before_opt_a : 0.000106s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000838s : 0.68% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003066s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000617s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000449s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000467s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000086s : 0.07% Time group info: ------[substitution.] 0.000275 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 84.03% : 0.000231s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.04% : 0.000011s : 3: substitution.reduce_eliminate 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000005s : 2: substitution.replace_old_param 3.96% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115166 2 97.38% : 0.112148s : 1: type_inference.infer 2.62% : 0.003018s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.38% : 0.000068s : 5: replace.inline 32.62% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 7 95.93% : 0.000228s : 5: match.inline 4.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.18% : 0.000002s : 13: predicate.addn_zero_filter 2.10% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.79% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.11% : 0.000002s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.71% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.26% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.79% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002458 25 60.91% : 0.001497s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.09% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.00% : 0.000885s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131022 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.29% : 0.000385s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.24% : 0.008172s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.35% : 0.000457s : 1: loop_unroll 0.48% : 0.000625s : 1: mutable_eliminate 0.83% : 0.001087s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000536s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.63% : 0.002142s : 1: renormalize.infer 0.70% : 0.000914s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000112s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.98% : 0.115270s : 1: type_inference TotalTime = 0.0161017, [30] [bootstrap]: 0.00029552 [type_inference]: 0.0079753 [event_method]: 2.039e-05 [auto_monad]: 6.886e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 4.481e-05 [rewriter_before_opt_a]: 8.136e-05 [expand_dump_flag]: 2.95002e-06 [jit_opt_a]: 0.00539011, [2] [Cycle 1]: 0.00183018, [27] [switch_simplify]: 5.757e-05 [loop_unroll]: 3.264e-05 [a_1]: 0.00063534 [with_stream_mark]: 1.576e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.72002e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.73002e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00071572 [add_forward_monad_depend]: 4.476e-05 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.513e-05 [cse]: 3.087e-05 [replace_applicator]: 1.213e-05 [Cycle 2]: 0.00033046, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 5.62999e-06 [a_1]: 9.799e-05 [with_stream_mark]: 9.02e-06 [recompute_prepare]: 5.34998e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 5.25999e-06 [updatestate_useless_node_eliminater]: 5.06002e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.078e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.26999e-06 [inline_without_move]: 4.92999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.247e-05 [replace_applicator]: 5.41998e-06 [py_interpret_to_execute_after_opt_a]: 1.115e-05 [rewriter_after_opt_a]: 3.729e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00049444 [jit_opt_b]: 5.174e-05, [1] [Cycle 1]: 4.429e-05, [2] [frontend_op_eliminate]: 1.627e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.526e-05 [loop_unroll]: 0.00041274 [jit_opt_after_cconv]: 0.00015626, [1] [Cycle 1]: 0.00014898, [11] [c_1]: 2.142e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 5.75001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 1.184e-05 [cse]: 2.083e-05 [call_graph_tuple_transform]: 1.955e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 0.00013471 [partial_unused_args_eliminate]: 3.3e-06 [environ_conv]: 6.56e-06 [add_recomputation]: 5.304e-05 [cse_after_recomputation]: 2.979e-05, [1] [Cycle 1]: 2.33e-05, [1] [cse]: 1.541e-05 [auto_monad_reorder]: 1.747e-05 [get_jit_bprop_graph]: 1.78002e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00047224 [symbol_engine_optimizer]: 7.406e-05, [1] [Cycle 1]: 6.715e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.375e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.74e-06 [renormalize]: 5.39992e-07 [validate]: 3.634e-05 Sums bootstrap : 0.000296s : 2.41% type_inference : 0.007975s : 64.95% event_method : 0.000020s : 0.17% auto_monad : 0.000069s : 0.56% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000045s : 0.36% rewriter_before_opt_a : 0.000081s : 0.66% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000064s : 0.52% jit_opt_a.loop_unroll : 0.000038s : 0.31% jit_opt_a.a_1 : 0.000733s : 5.97% jit_opt_a.with_stream_mark : 0.000025s : 0.20% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000716s : 5.83% jit_opt_a.add_forward_monad_depend : 0.000046s : 0.37% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000043s : 0.35% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000037s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000494s : 4.03% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000025s : 0.21% loop_unroll : 0.000413s : 3.36% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000012s : 0.10% jit_opt_after_cconv.cse : 0.000021s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000135s : 1.10% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000053s : 0.43% cse_after_recomputation.cse : 0.000015s : 0.13% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000472s : 3.85% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.30% Time group info: ------[substitution.] 0.000247 27 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 3: substitution.graph_param_transform 83.13% : 0.000205s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000011s : 3: substitution.reduce_eliminate 1.82% : 0.000004s : 4: substitution.remove_not_recompute_node 1.45% : 0.000004s : 2: substitution.replace_old_param 4.43% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007905 2 87.62% : 0.006927s : 1: type_inference.infer 12.38% : 0.000979s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.21% : 0.000063s : 5: replace.inline 31.79% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 95.41% : 0.000202s : 5: match.inline 4.59% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.40% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 11: predicate.addn_check_dump 1.23% : 0.000002s : 11: predicate.addn_zero_filter 1.98% : 0.000002s : 11: predicate.arithmetic_simplify 1.39% : 0.000002s : 11: predicate.cast_eliminate 0.69% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.27% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 16: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.15% : 0.000001s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.34% : 0.000002s : 11: predicate.print_const_string_wrapper 2.65% : 0.000003s : 11: predicate.reduce_eliminate 1.52% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.37% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.70% : 0.000010s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.35% : 0.000002s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000781 16 51.30% : 0.000400s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.00% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.70% : 0.000318s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017826 72 0.31% : 0.000056s : 1: add_recomputation 0.41% : 0.000072s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.76% : 0.000314s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000032s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.26% : 0.005393s : 1: jit_opt_a 0.89% : 0.000159s : 1: jit_opt_after_cconv 0.30% : 0.000054s : 1: jit_opt_b 2.36% : 0.000421s : 1: loop_unroll 2.82% : 0.000503s : 1: mutable_eliminate 5.33% : 0.000950s : 26: opt.transform.jit_opt_a 0.27% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000012s : 1: opt.transform.mutable_eliminate 0.13% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.70% : 0.000481s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000047s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.79% : 0.000141s : 1: remove_dup_value 2.25% : 0.000402s : 1: renormalize.infer 1.72% : 0.000306s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000041s : 1: rewriter_after_opt_a 0.47% : 0.000084s : 1: rewriter_before_opt_a 0.43% : 0.000077s : 1: symbol_engine_optimizer 44.82% : 0.007990s : 1: type_inference TotalTime = 0.120034, [30] [bootstrap]: 0.00027596 [type_inference]: 0.108771 [event_method]: 2.196e-05 [auto_monad]: 7.184e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00047148 [rewriter_before_opt_a]: 9.494e-05 [expand_dump_flag]: 3.69002e-06 [jit_opt_a]: 0.00766691, [2] [Cycle 1]: 0.00383021, [27] [switch_simplify]: 6.207e-05 [loop_unroll]: 3.487e-05 [a_1]: 0.00071219 [with_stream_mark]: 2.133e-05 [recompute_prepare]: 1.106e-05 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.79002e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 4.77e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 6.33e-06 [renormalize]: 0.00260911 [add_forward_monad_depend]: 7.36999e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.782e-05 [cse]: 3.692e-05 [replace_applicator]: 1.894e-05 [Cycle 2]: 0.0003955, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00013303 [with_stream_mark]: 1.38e-05 [recompute_prepare]: 6.39999e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.50002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 8.94003e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 9.24998e-06 [inline_without_move]: 5.66e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.554e-05 [replace_applicator]: 6.39999e-06 [py_interpret_to_execute_after_opt_a]: 1.61e-05 [rewriter_after_opt_a]: 4.095e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00073932 [jit_opt_b]: 8.279e-05, [1] [Cycle 1]: 7.315e-05, [2] [frontend_op_eliminate]: 3.635e-05 [inline_after_opt_a]: 1.966e-05 [cconv]: 3.284e-05 [loop_unroll]: 0.00049204 [jit_opt_after_cconv]: 0.00017072, [1] [Cycle 1]: 0.00016358, [11] [c_1]: 2.598e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 3.33998e-06 [cse]: 3.238e-05 [call_graph_tuple_transform]: 2.54e-05 [tuple_list_get_item_eliminator]: 7.11001e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.739e-05 [partial_unused_args_eliminate]: 2.39001e-06 [environ_conv]: 9.52001e-06 [add_recomputation]: 5.376e-05 [cse_after_recomputation]: 4.113e-05, [1] [Cycle 1]: 3.527e-05, [1] [cse]: 1.443e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 6.06998e-06 [opt_after_jit_grad]: 0.00049783 [symbol_engine_optimizer]: 8.112e-05, [1] [Cycle 1]: 7.535e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 1.022e-05 [elim_not_effective]: 1.557e-05 [opt_reshape]: 6.03002e-06 [fold_const_symbol]: 1.124e-05 [renormalize]: 5.60016e-07 [validate]: 5.651e-05 Sums bootstrap : 0.000276s : 0.24% type_inference : 0.108771s : 93.88% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000471s : 0.41% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000845s : 0.73% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002609s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000052s : 0.05% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000739s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000036s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000492s : 0.42% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000498s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.05% Time group info: ------[substitution.] 0.000272 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000007s : 4: substitution.graph_param_transform 82.48% : 0.000224s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.92% : 0.000013s : 3: substitution.reduce_eliminate 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.27% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108689 2 97.38% : 0.105837s : 1: type_inference.infer 2.62% : 0.002852s : 1: type_inference.specialize ------[replace.] 0.000103 7 67.22% : 0.000069s : 5: replace.inline 32.78% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 7 95.52% : 0.000220s : 5: match.inline 4.48% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.51% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.40% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 6.05% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 19: predicate.load_eliminater 0.98% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 2.20% : 0.000003s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 19: predicate.partial_eliminate 1.56% : 0.000002s : 13: predicate.print_const_string_wrapper 2.17% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.81% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000002s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000011s : 64: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002237 25 65.26% : 0.001460s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.93% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.80% : 0.000711s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123746 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000292s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000044s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.20% : 0.007671s : 1: jit_opt_a 0.14% : 0.000174s : 1: jit_opt_after_cconv 0.07% : 0.000086s : 1: jit_opt_b 0.40% : 0.000500s : 1: loop_unroll 0.61% : 0.000753s : 1: mutable_eliminate 0.89% : 0.001098s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000048s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000506s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000478s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.51% : 0.001872s : 1: renormalize.infer 0.59% : 0.000727s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 87.91% : 0.108788s : 1: type_inference TotalTime = 0.129905, [30] [bootstrap]: 0.00027848 [type_inference]: 0.118333 [event_method]: 2.374e-05 [auto_monad]: 7.617e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00059357 [rewriter_before_opt_a]: 9.12e-05 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.0081058, [2] [Cycle 1]: 0.00395565, [27] [switch_simplify]: 0.00011217 [loop_unroll]: 3.339e-05 [a_1]: 0.00061852 [with_stream_mark]: 1.884e-05 [recompute_prepare]: 9.00999e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.73998e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 7.39002e-06 [updatestate_useless_node_eliminater]: 6.93e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.32998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 9.93002e-06 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 1.005e-05 [inline_without_move]: 6.58e-06 [renormalize]: 0.00282101 [add_forward_monad_depend]: 7.21999e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.693e-05 [cse]: 2.381e-05 [replace_applicator]: 1.844e-05 [Cycle 2]: 0.00045828, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00019164 [with_stream_mark]: 1.333e-05 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.30998e-06 [cell_reuse_recompute_pass]: 2.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.787e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 9.39998e-06 [inline_without_move]: 6.26e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 7.41001e-06 [cse]: 1.22e-05 [replace_applicator]: 5.75001e-06 [py_interpret_to_execute_after_opt_a]: 1.428e-05 [rewriter_after_opt_a]: 3.622e-05 [convert_after_rewriter]: 7.00998e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00069481 [jit_opt_b]: 5.661e-05, [1] [Cycle 1]: 4.931e-05, [2] [frontend_op_eliminate]: 1.983e-05 [inline_after_opt_a]: 1.845e-05 [cconv]: 2.733e-05 [loop_unroll]: 0.00045059 [jit_opt_after_cconv]: 0.00015408, [1] [Cycle 1]: 0.00014741, [11] [c_1]: 2.695e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 1.922e-05 [call_graph_tuple_transform]: 2.214e-05 [tuple_list_get_item_eliminator]: 6.70002e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.35002e-06 [remove_dup_value]: 1.634e-05 [partial_unused_args_eliminate]: 2.70002e-06 [environ_conv]: 9.05001e-06 [add_recomputation]: 8.574e-05 [cse_after_recomputation]: 2.473e-05, [1] [Cycle 1]: 1.851e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.552e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.58002e-06 [opt_after_jit_grad]: 0.00048639 [symbol_engine_optimizer]: 7.795e-05, [1] [Cycle 1]: 7.134e-05, [6] [build]: 4.33001e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.407e-05 [opt_reshape]: 7.08998e-06 [fold_const_symbol]: 9.66e-06 [renormalize]: 4.60015e-07 [validate]: 4.267e-05 Sums bootstrap : 0.000278s : 0.22% type_inference : 0.118333s : 94.20% event_method : 0.000024s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000594s : 0.47% rewriter_before_opt_a : 0.000091s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000119s : 0.09% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000810s : 0.64% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002821s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000695s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000451s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000086s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000486s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000239 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000007s : 4: substitution.graph_param_transform 84.35% : 0.000201s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000006s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 5.21% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118243 2 97.55% : 0.115342s : 1: type_inference.infer 2.45% : 0.002901s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.12% : 0.000053s : 4: replace.inline 32.88% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.62% : 0.000199s : 4: match.inline 5.38% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000196 830 1.00% : 0.000002s : 12: predicate.accumulaten_eliminater 0.67% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.71% : 0.000001s : 12: predicate.addn_check_dump 0.87% : 0.000002s : 12: predicate.addn_zero_filter 1.61% : 0.000003s : 12: predicate.arithmetic_simplify 0.97% : 0.000002s : 12: predicate.cast_eliminate 0.33% : 0.000001s : 4: predicate.check_bprop_eliminate 0.76% : 0.000001s : 12: predicate.compare_switch_simplify 0.87% : 0.000002s : 12: predicate.depend_value_elim 0.76% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.87% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.89% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.56% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 4: predicate.elim_not_effective 0.38% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.83% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.82% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.76% : 0.000001s : 12: predicate.environ_get_depend_swap 0.87% : 0.000002s : 12: predicate.environ_get_eliminate 0.73% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 0.76% : 0.000001s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 3.83% : 0.000008s : 26: predicate.inline 0.65% : 0.000001s : 8: predicate.inline_without_move 0.33% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000002s : 8: predicate.less_batch_normalization 31.65% : 0.000062s : 14: predicate.list_to_tuple_eliminator_ 1.30% : 0.000003s : 18: predicate.load_eliminater 0.98% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.70% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.64% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.75% : 0.000001s : 12: predicate.merge_addn 0.88% : 0.000002s : 12: predicate.minmaximum_grad 1.05% : 0.000002s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 1.48% : 0.000003s : 18: predicate.partial_eliminate 0.83% : 0.000002s : 12: predicate.print_const_string_wrapper 1.29% : 0.000003s : 12: predicate.reduce_eliminate 1.13% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.40% : 0.000001s : 8: predicate.remove_not_recompute_node 1.47% : 0.000003s : 22: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.24% : 0.000000s : 4: predicate.reset_defer_inline 0.94% : 0.000002s : 12: predicate.reshape_eliminate 0.92% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 4: predicate.row_tensor_eliminate 0.93% : 0.000002s : 12: predicate.same_eliminate 0.45% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.68% : 0.000001s : 8: predicate.special_op_eliminate 0.65% : 0.000001s : 8: predicate.specialize_transform 0.93% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.85% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.64% : 0.000003s : 18: predicate.switch_defer_inline 1.43% : 0.000003s : 18: predicate.switch_layer_defer_inline 4.65% : 0.000009s : 58: predicate.switch_simplify 0.98% : 0.000002s : 12: predicate.tile_eliminate 0.85% : 0.000002s : 12: predicate.transpose_eliminate 1.17% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.81% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 2.66% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.23% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.00% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.23% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.19% : 0.000002s : 12: predicate.value_based_eliminate 0.25% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.43% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002390 22 63.73% : 0.001523s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.98% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.29% : 0.000819s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133911 72 0.07% : 0.000089s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000292s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.06% : 0.008110s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.34% : 0.000458s : 1: loop_unroll 0.53% : 0.000703s : 1: mutable_eliminate 0.83% : 0.001111s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000603s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.44% : 0.001935s : 1: renormalize.infer 0.65% : 0.000876s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.38% : 0.118346s : 1: type_inference TotalTime = 0.126843, [30] [bootstrap]: 0.00028326 [type_inference]: 0.115162 [event_method]: 2.301e-05 [auto_monad]: 7.763e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00055628 [rewriter_before_opt_a]: 9.951e-05 [expand_dump_flag]: 4.22998e-06 [jit_opt_a]: 0.00812452, [2] [Cycle 1]: 0.00387207, [27] [switch_simplify]: 6.431e-05 [loop_unroll]: 3.554e-05 [a_1]: 0.00064299 [with_stream_mark]: 2.338e-05 [recompute_prepare]: 9.69e-06 [updatestate_depend_eliminate]: 4.95999e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.01999e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.67002e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.67002e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 1.098e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00272661 [add_forward_monad_depend]: 8.67e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.744e-05 [cse]: 3.141e-05 [replace_applicator]: 1.943e-05 [Cycle 2]: 0.00039524, [27] [switch_simplify]: 7.15998e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012791 [with_stream_mark]: 1.334e-05 [recompute_prepare]: 6.44001e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.16e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.736e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.09999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 8.05999e-06 [cse]: 1.383e-05 [replace_applicator]: 6.62002e-06 [py_interpret_to_execute_after_opt_a]: 1.527e-05 [rewriter_after_opt_a]: 4.118e-05 [convert_after_rewriter]: 8.02e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00068466 [jit_opt_b]: 6.01e-05, [1] [Cycle 1]: 5.206e-05, [2] [frontend_op_eliminate]: 2.13e-05 [inline_after_opt_a]: 1.923e-05 [cconv]: 2.849e-05 [loop_unroll]: 0.00045386 [jit_opt_after_cconv]: 0.00015851, [1] [Cycle 1]: 0.0001522, [11] [c_1]: 2.686e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.87001e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.461e-05 [call_graph_tuple_transform]: 2.272e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.25002e-06 [remove_dup_value]: 1.697e-05 [partial_unused_args_eliminate]: 2.63003e-06 [environ_conv]: 8.84e-06 [add_recomputation]: 4.936e-05 [cse_after_recomputation]: 2.447e-05, [1] [Cycle 1]: 1.889e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.704e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00052414 [symbol_engine_optimizer]: 0.00014027, [1] [Cycle 1]: 0.00013307, [6] [build]: 4.08999e-06 [elim_shapecalc]: 8.39998e-06 [elim_not_effective]: 7.049e-05 [opt_reshape]: 7.73001e-06 [fold_const_symbol]: 1.103e-05 [renormalize]: 4.19997e-07 [validate]: 4.898e-05 Sums bootstrap : 0.000283s : 0.23% type_inference : 0.115162s : 94.13% event_method : 0.000023s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000556s : 0.45% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000771s : 0.63% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002727s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000685s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000454s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000524s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000070s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000250 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000007s : 4: substitution.graph_param_transform 84.95% : 0.000213s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000006s : 2: substitution.replace_old_param 5.19% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115061 2 97.53% : 0.112216s : 1: type_inference.infer 2.47% : 0.002845s : 1: type_inference.specialize ------[replace.] 0.000079 6 66.15% : 0.000052s : 4: replace.inline 33.85% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.72% : 0.000210s : 4: match.inline 5.28% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 1.41% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.19% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.22% : 0.000002s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.36% : 0.000009s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 0.97% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 2.10% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.78% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 1.87% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.88% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002225 22 63.72% : 0.001418s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.39% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.89% : 0.000754s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130726 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000296s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.22% : 0.008128s : 1: jit_opt_a 0.12% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.35% : 0.000463s : 1: loop_unroll 0.53% : 0.000696s : 1: mutable_eliminate 0.79% : 0.001029s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000094s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000537s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000566s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.46% : 0.001904s : 1: renormalize.infer 0.62% : 0.000812s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000106s : 1: rewriter_before_opt_a 0.11% : 0.000144s : 1: symbol_engine_optimizer 88.11% : 0.115188s : 1: type_inference TotalTime = 0.0192311, [30] [bootstrap]: 0.00027938 [type_inference]: 0.0103089 [event_method]: 2.189e-05 [auto_monad]: 7.116e-05 [graph_reusing]: 6.79001e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 5.87e-05 [rewriter_before_opt_a]: 9.33e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.00589939, [2] [Cycle 1]: 0.00209323, [27] [switch_simplify]: 0.00011705 [loop_unroll]: 3.599e-05 [a_1]: 0.0006494 [with_stream_mark]: 1.899e-05 [recompute_prepare]: 7.87e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 4.28001e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 1.93997e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.08998e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 3.06001e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.00092079 [add_forward_monad_depend]: 6.44999e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.587e-05 [cse]: 3.907e-05 [replace_applicator]: 1.292e-05 [Cycle 2]: 0.00033023, [27] [switch_simplify]: 6.18998e-06 [loop_unroll]: 5.25999e-06 [a_1]: 9.37e-05 [with_stream_mark]: 8.94e-06 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 3.15998e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 7.07002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.16997e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.653e-05 [replace_applicator]: 5.64998e-06 [py_interpret_to_execute_after_opt_a]: 1.347e-05 [rewriter_after_opt_a]: 4.156e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.0005821 [jit_opt_b]: 5.1e-05, [1] [Cycle 1]: 4.445e-05, [2] [frontend_op_eliminate]: 1.724e-05 [inline_after_opt_a]: 1.641e-05 [cconv]: 2.737e-05 [loop_unroll]: 0.00043623 [jit_opt_after_cconv]: 0.00015031, [1] [Cycle 1]: 0.0001433, [11] [c_1]: 2.184e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.589e-05 [call_graph_tuple_transform]: 1.915e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.50001e-06 [remove_dup_value]: 3.43e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 5.79e-06 [add_recomputation]: 5.189e-05 [cse_after_recomputation]: 2.497e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.319e-05 [auto_monad_reorder]: 4.203e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 5.24998e-06 [opt_after_jit_grad]: 0.00071124 [symbol_engine_optimizer]: 7.65e-05, [1] [Cycle 1]: 7.033e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.439e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 9.77001e-06 [renormalize]: 5.19998e-07 [validate]: 4.269e-05 Sums bootstrap : 0.000279s : 1.84% type_inference : 0.010309s : 67.93% event_method : 0.000022s : 0.14% auto_monad : 0.000071s : 0.47% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000059s : 0.39% rewriter_before_opt_a : 0.000093s : 0.61% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000123s : 0.81% jit_opt_a.loop_unroll : 0.000041s : 0.27% jit_opt_a.a_1 : 0.000743s : 4.90% jit_opt_a.with_stream_mark : 0.000028s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000921s : 6.07% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.15% jit_opt_a.cse : 0.000056s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.12% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000042s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000582s : 3.84% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000027s : 0.18% loop_unroll : 0.000436s : 2.87% jit_opt_after_cconv.c_1 : 0.000022s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000034s : 0.23% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000052s : 0.34% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000042s : 0.28% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000711s : 4.69% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.28% Time group info: ------[substitution.] 0.000248 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 86.48% : 0.000215s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 1.23% : 0.000003s : 2: substitution.replace_old_param 5.19% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010234 2 87.03% : 0.008906s : 1: type_inference.infer 12.97% : 0.001328s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.84% : 0.000068s : 5: replace.inline 32.16% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 94.80% : 0.000212s : 5: match.inline 5.20% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.20% : 0.000002s : 11: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.95% : 0.000002s : 11: predicate.arithmetic_simplify 1.67% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000001s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 16: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.59% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.27% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 16: predicate.partial_eliminate 1.23% : 0.000002s : 11: predicate.print_const_string_wrapper 2.00% : 0.000003s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.19% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.85% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.08% : 0.000010s : 59: predicate.switch_simplify 1.37% : 0.000002s : 11: predicate.tile_eliminate 1.30% : 0.000002s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000952 16 49.39% : 0.000470s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.43% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.18% : 0.000421s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021240 72 0.26% : 0.000055s : 1: add_recomputation 0.35% : 0.000074s : 1: auto_monad 0.21% : 0.000045s : 1: auto_monad_reorder 1.40% : 0.000297s : 1: bootstrap 0.14% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 27.79% : 0.005903s : 1: jit_opt_a 0.72% : 0.000153s : 1: jit_opt_after_cconv 0.25% : 0.000054s : 1: jit_opt_b 2.09% : 0.000444s : 1: loop_unroll 2.78% : 0.000590s : 1: mutable_eliminate 4.85% : 0.001029s : 26: opt.transform.jit_opt_a 0.23% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.39% : 0.000719s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000061s : 1: py_interpret_to_execute 0.07% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000037s : 1: remove_dup_value 2.30% : 0.000489s : 1: renormalize.infer 1.99% : 0.000423s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000045s : 1: rewriter_after_opt_a 0.45% : 0.000096s : 1: rewriter_before_opt_a 0.37% : 0.000079s : 1: symbol_engine_optimizer 48.61% : 0.010325s : 1: type_inference TotalTime = 0.0626611, [30] [bootstrap]: 0.00027614 [type_inference]: 0.0535339 [event_method]: 1.725e-05 [auto_monad]: 4.702e-05 [graph_reusing]: 3.88001e-06 [pre_auto_parallel]: 1.62999e-06 [py_interpret_to_execute]: 0.00025663 [rewriter_before_opt_a]: 7.614e-05 [expand_dump_flag]: 2.48e-06 [jit_opt_a]: 0.00627826, [2] [Cycle 1]: 0.00262074, [27] [switch_simplify]: 4.878e-05 [loop_unroll]: 3.133e-05 [a_1]: 0.00053433 [with_stream_mark]: 1.225e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.04003e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 7.18e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 1.01997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00168212 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 1.45999e-06 [auto_monad_eliminator]: 1.328e-05 [cse]: 1.907e-05 [replace_applicator]: 1.383e-05 [Cycle 2]: 0.00036181, [27] [switch_simplify]: 6.98998e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00012386 [with_stream_mark]: 9.56003e-06 [recompute_prepare]: 6.10002e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.71998e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.348e-05 [j_node_and_user_rematch]: 8.70999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.04002e-06 [inline_without_move]: 5.54e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.1e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 9.25999e-06 [rewriter_after_opt_a]: 2.76e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.52e-06 [mutable_eliminate]: 0.00057862 [jit_opt_b]: 5.382e-05, [1] [Cycle 1]: 4.797e-05, [2] [frontend_op_eliminate]: 1.915e-05 [inline_after_opt_a]: 1.771e-05 [cconv]: 1.677e-05 [loop_unroll]: 0.00043989 [jit_opt_after_cconv]: 0.00014823, [1] [Cycle 1]: 0.00014202, [11] [c_1]: 2.65e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 5.86e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 2.031e-05 [call_graph_tuple_transform]: 1.881e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 9.39996e-07 [renormalize]: 3.89991e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.059e-05 [partial_unused_args_eliminate]: 1.65001e-06 [environ_conv]: 7.23999e-06 [add_recomputation]: 3.542e-05 [cse_after_recomputation]: 2.29e-05, [1] [Cycle 1]: 1.77e-05, [1] [cse]: 1.17e-05 [auto_monad_reorder]: 1.073e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00048816 [symbol_engine_optimizer]: 7.763e-05, [1] [Cycle 1]: 7.098e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 8.67e-06 [elim_not_effective]: 1.428e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 6.19999e-07 [validate]: 3.591e-05 Sums bootstrap : 0.000276s : 0.47% type_inference : 0.053534s : 91.07% event_method : 0.000017s : 0.03% auto_monad : 0.000047s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000257s : 0.44% rewriter_before_opt_a : 0.000076s : 0.13% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000658s : 1.12% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001682s : 2.86% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000030s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000028s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000579s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000017s : 0.03% loop_unroll : 0.000440s : 0.75% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000488s : 0.83% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.06% Time group info: ------[substitution.] 0.000163 24 1.40% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000004s : 4: substitution.graph_param_transform 83.90% : 0.000136s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000004s : 4: substitution.remove_not_recompute_node 2.05% : 0.000003s : 2: substitution.replace_old_param 5.05% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053464 2 96.58% : 0.051634s : 1: type_inference.infer 3.42% : 0.001830s : 1: type_inference.specialize ------[replace.] 0.000070 6 65.68% : 0.000046s : 4: replace.inline 34.32% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 94.99% : 0.000134s : 4: match.inline 5.01% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000002s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.74% : 0.000002s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.49% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.95% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.87% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001995 22 71.83% : 0.001433s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.37% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.80% : 0.000535s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065294 72 0.06% : 0.000038s : 1: add_recomputation 0.08% : 0.000050s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.45% : 0.000293s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.62% : 0.006281s : 1: jit_opt_a 0.23% : 0.000151s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.69% : 0.000449s : 1: loop_unroll 0.90% : 0.000588s : 1: mutable_eliminate 1.35% : 0.000882s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.40% : 0.000262s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.69% : 0.001102s : 1: renormalize.infer 0.88% : 0.000572s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000031s : 1: rewriter_after_opt_a 0.12% : 0.000081s : 1: rewriter_before_opt_a 0.12% : 0.000081s : 1: symbol_engine_optimizer 82.01% : 0.053547s : 1: type_inference TotalTime = 0.121282, [30] [bootstrap]: 0.00029014 [type_inference]: 0.110526 [event_method]: 2.391e-05 [auto_monad]: 7.252e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00045667 [rewriter_before_opt_a]: 9.564e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.00730989, [2] [Cycle 1]: 0.00373999, [27] [switch_simplify]: 6.222e-05 [loop_unroll]: 3.595e-05 [a_1]: 0.00067819 [with_stream_mark]: 1.834e-05 [recompute_prepare]: 9.37001e-06 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00258849 [add_forward_monad_depend]: 5.60001e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.6e-05 [cse]: 3.418e-05 [replace_applicator]: 1.823e-05 [Cycle 2]: 0.0003742, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00012949 [with_stream_mark]: 1.055e-05 [recompute_prepare]: 5.83002e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 3.34001e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.313e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 2.03002e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.43002e-06 [cse]: 1.356e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.453e-05 [rewriter_after_opt_a]: 3.695e-05 [convert_after_rewriter]: 7.20998e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00065959 [jit_opt_b]: 6.391e-05, [1] [Cycle 1]: 5.598e-05, [2] [frontend_op_eliminate]: 2.618e-05 [inline_after_opt_a]: 1.879e-05 [cconv]: 2.865e-05 [loop_unroll]: 0.00048368 [jit_opt_after_cconv]: 0.00016014, [1] [Cycle 1]: 0.0001529, [11] [c_1]: 2.598e-05 [parameter_eliminate]: 2.88998e-06 [updatestate_depend_eliminate]: 6.02999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 2.282e-05 [call_graph_tuple_transform]: 2.442e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 7.23e-06 [remove_dup_value]: 1.887e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.89e-06 [add_recomputation]: 5.025e-05 [cse_after_recomputation]: 2.33e-05, [1] [Cycle 1]: 1.799e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.852e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.00048559 [symbol_engine_optimizer]: 8.153e-05, [1] [Cycle 1]: 7.555e-05, [6] [build]: 3.62002e-06 [elim_shapecalc]: 8.57998e-06 [elim_not_effective]: 1.225e-05 [opt_reshape]: 9.52001e-06 [fold_const_symbol]: 1.082e-05 [renormalize]: 8.00006e-07 [validate]: 0.0001481 Sums bootstrap : 0.000290s : 0.25% type_inference : 0.110526s : 94.08% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000457s : 0.39% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.04% jit_opt_a.a_1 : 0.000808s : 0.69% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002589s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000660s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000484s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000486s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000148s : 0.13% Time group info: ------[substitution.] 0.000249 28 0.75% : 0.000002s : 2: substitution.elim_not_effective 1.18% : 0.000003s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 4: substitution.graph_param_transform 81.17% : 0.000202s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.81% : 0.000012s : 3: substitution.reduce_eliminate 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.75% : 0.000004s : 2: substitution.replace_old_param 4.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110448 2 97.50% : 0.107683s : 1: type_inference.infer 2.50% : 0.002765s : 1: type_inference.specialize ------[replace.] 0.000096 7 69.05% : 0.000066s : 5: replace.inline 30.95% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 7 95.38% : 0.000199s : 5: match.inline 4.62% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 1.78% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.62% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.46% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.06% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.55% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.51% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002275 25 65.61% : 0.001492s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.68% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.71% : 0.000721s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124903 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000307s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.86% : 0.007313s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.39% : 0.000491s : 1: loop_unroll 0.54% : 0.000669s : 1: mutable_eliminate 0.85% : 0.001056s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000464s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.48% : 0.001850s : 1: renormalize.infer 0.58% : 0.000728s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 88.50% : 0.110544s : 1: type_inference TotalTime = 0.122692, [30] [bootstrap]: 0.00029797 [type_inference]: 0.111684 [event_method]: 2.201e-05 [auto_monad]: 7.157e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.00048474 [rewriter_before_opt_a]: 9.553e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00768079, [2] [Cycle 1]: 0.00397619, [27] [switch_simplify]: 5.839e-05 [loop_unroll]: 3.39e-05 [a_1]: 0.00069537 [with_stream_mark]: 1.708e-05 [recompute_prepare]: 8.75001e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.93002e-06 [accelerated_algorithm]: 6.56999e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.56999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.535e-05 [j_node_and_user_rematch]: 9.89999e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 5.98998e-06 [renormalize]: 0.00281506 [add_forward_monad_depend]: 6.61e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.564e-05 [cse]: 3.518e-05 [replace_applicator]: 1.528e-05 [Cycle 2]: 0.00037992, [27] [switch_simplify]: 6.64001e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00013243 [with_stream_mark]: 1.12e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.189e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.51e-06 [cse]: 1.337e-05 [replace_applicator]: 6.31998e-06 [py_interpret_to_execute_after_opt_a]: 1.151e-05 [rewriter_after_opt_a]: 3.818e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00063882 [jit_opt_b]: 5.623e-05, [1] [Cycle 1]: 4.904e-05, [2] [frontend_op_eliminate]: 2.049e-05 [inline_after_opt_a]: 1.799e-05 [cconv]: 2.58e-05 [loop_unroll]: 0.00045143 [jit_opt_after_cconv]: 0.00016246, [1] [Cycle 1]: 0.00015604, [11] [c_1]: 2.731e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 6.31e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.50997e-06 [cse]: 2.346e-05 [call_graph_tuple_transform]: 2.275e-05 [tuple_list_get_item_eliminator]: 6.83e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 6.59001e-06 [remove_dup_value]: 1.497e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 8.26002e-06 [add_recomputation]: 4.938e-05 [cse_after_recomputation]: 2.406e-05, [1] [Cycle 1]: 1.849e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.743e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 5.27999e-06 [opt_after_jit_grad]: 0.00047286 [symbol_engine_optimizer]: 7.668e-05, [1] [Cycle 1]: 7.009e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 6.74999e-06 [fold_const_symbol]: 9.58002e-06 [renormalize]: 3.7998e-07 [validate]: 8.703e-05 Sums bootstrap : 0.000298s : 0.25% type_inference : 0.111684s : 94.04% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000485s : 0.41% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000828s : 0.70% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002815s : 2.37% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000639s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000451s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000473s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000087s : 0.07% Time group info: ------[substitution.] 0.000263 28 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000007s : 4: substitution.graph_param_transform 83.06% : 0.000219s : 5: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.42% : 0.000012s : 3: substitution.reduce_eliminate 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 3.93% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111601 2 97.34% : 0.108628s : 1: type_inference.infer 2.66% : 0.002972s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.77% : 0.000068s : 5: replace.inline 31.23% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 95.96% : 0.000216s : 5: match.inline 4.04% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.53% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.38% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.77% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000003s : 13: predicate.reduce_eliminate 1.58% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 64: predicate.switch_simplify 1.46% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002410 25 62.98% : 0.001518s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.12% : 0.000822s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126601 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000316s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.07% : 0.007684s : 1: jit_opt_a 0.13% : 0.000165s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000460s : 1: loop_unroll 0.51% : 0.000647s : 1: mutable_eliminate 0.84% : 0.001066s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000491s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.57% : 0.001988s : 1: renormalize.infer 0.65% : 0.000817s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.23% : 0.111701s : 1: type_inference TotalTime = 0.132199, [30] [bootstrap]: 0.00027925 [type_inference]: 0.119995 [event_method]: 1.991e-05 [auto_monad]: 7.145e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 0.00055008 [rewriter_before_opt_a]: 8.821e-05 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00840215, [2] [Cycle 1]: 0.00454632, [27] [switch_simplify]: 6.073e-05 [loop_unroll]: 3.166e-05 [a_1]: 0.00081926 [with_stream_mark]: 2.135e-05 [recompute_prepare]: 1.208e-05 [updatestate_depend_eliminate]: 4.92999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.24999e-06 [specialize_transform]: 8.16002e-06 [updatestate_useless_node_eliminater]: 6.71999e-06 [accelerated_algorithm]: 7.10998e-06 [meta_shard_fg_expand]: 2.65997e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.658e-05 [j_node_and_user_rematch]: 1.192e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 1.134e-05 [inline_without_move]: 6.63e-06 [renormalize]: 0.00315343 [add_forward_monad_depend]: 8.23999e-06 [auto_monad_grad]: 2.78998e-06 [auto_monad_eliminator]: 2.034e-05 [cse]: 3.516e-05 [replace_applicator]: 2.318e-05 [Cycle 2]: 0.00040286, [27] [switch_simplify]: 7.84997e-06 [loop_unroll]: 5.93002e-06 [a_1]: 0.00013583 [with_stream_mark]: 1.469e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.82998e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.78997e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 2.85002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.809e-05 [j_node_and_user_rematch]: 1.097e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.80002e-06 [inline_without_move]: 6.12001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.352e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.504e-05 [rewriter_after_opt_a]: 4.087e-05 [convert_after_rewriter]: 7.8e-06 [order_py_execute_after_rewriter]: 6.17001e-06 [mutable_eliminate]: 0.00074457 [jit_opt_b]: 6.423e-05, [1] [Cycle 1]: 5.542e-05, [2] [frontend_op_eliminate]: 2.226e-05 [inline_after_opt_a]: 1.905e-05 [cconv]: 2.826e-05 [loop_unroll]: 0.00050443 [jit_opt_after_cconv]: 0.00017774, [1] [Cycle 1]: 0.00016798, [11] [c_1]: 2.803e-05 [parameter_eliminate]: 2.96999e-06 [updatestate_depend_eliminate]: 9.08002e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.43002e-06 [cse]: 2.674e-05 [call_graph_tuple_transform]: 2.719e-05 [tuple_list_get_item_eliminator]: 7.15998e-06 [none_parameter_eliminate]: 1.68997e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.863e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 9.25999e-06 [add_recomputation]: 5.56e-05 [cse_after_recomputation]: 2.461e-05, [1] [Cycle 1]: 1.921e-05, [1] [cse]: 1.254e-05 [auto_monad_reorder]: 1.933e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 6.66e-06 [opt_after_jit_grad]: 0.00054547 [symbol_engine_optimizer]: 8.986e-05, [1] [Cycle 1]: 8.181e-05, [6] [build]: 5.22e-06 [elim_shapecalc]: 9.62001e-06 [elim_not_effective]: 1.819e-05 [opt_reshape]: 1.108e-05 [fold_const_symbol]: 9.92999e-06 [renormalize]: 2.60014e-07 [validate]: 0.00021721 Sums bootstrap : 0.000279s : 0.22% type_inference : 0.119995s : 93.72% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000550s : 0.43% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000955s : 0.75% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003154s : 2.46% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000745s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000504s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000545s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000011s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000217s : 0.17% Time group info: ------[substitution.] 0.000244 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.96% : 0.000007s : 4: substitution.graph_param_transform 82.87% : 0.000202s : 4: substitution.inline 1.93% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000006s : 4: substitution.remove_not_recompute_node 2.53% : 0.000006s : 2: substitution.replace_old_param 5.90% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119916 2 97.71% : 0.117171s : 1: type_inference.infer 2.29% : 0.002745s : 1: type_inference.specialize ------[replace.] 0.000244 6 88.11% : 0.000215s : 4: replace.inline 11.89% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 6 93.79% : 0.000199s : 4: match.inline 6.21% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 2.29% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.28% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.57% : 0.000001s : 4: predicate.graph_param_transform 5.94% : 0.000009s : 26: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.51% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000002s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000003s : 12: predicate.reduce_eliminate 1.29% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.94% : 0.000004s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.65% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 12: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.14% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002681 22 63.04% : 0.001690s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.21% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.75% : 0.000958s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136479 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.22% : 0.000295s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.16% : 0.008406s : 1: jit_opt_a 0.13% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000067s : 1: jit_opt_b 0.38% : 0.000513s : 1: loop_unroll 0.55% : 0.000755s : 1: mutable_eliminate 0.89% : 0.001216s : 26: opt.transform.jit_opt_a 0.05% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000556s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000560s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.54% : 0.002102s : 1: renormalize.infer 0.76% : 0.001040s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000092s : 1: symbol_engine_optimizer 87.93% : 0.120013s : 1: type_inference TotalTime = 0.131114, [30] [bootstrap]: 0.00028885 [type_inference]: 0.118269 [event_method]: 2.27e-05 [auto_monad]: 7.831e-05 [graph_reusing]: 6.02999e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 0.00052516 [rewriter_before_opt_a]: 0.00010713 [expand_dump_flag]: 4.18001e-06 [jit_opt_a]: 0.00905784, [2] [Cycle 1]: 0.00480346, [27] [switch_simplify]: 7.087e-05 [loop_unroll]: 3.531e-05 [a_1]: 0.00081797 [with_stream_mark]: 2.621e-05 [recompute_prepare]: 1.164e-05 [updatestate_depend_eliminate]: 4.64998e-06 [updatestate_assign_eliminate]: 3.98001e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 7.45998e-06 [updatestate_useless_node_eliminater]: 6.57002e-06 [accelerated_algorithm]: 7.75e-06 [meta_shard_fg_expand]: 3.34001e-06 [get_grad_eliminate_]: 7.40998e-06 [merge_forward]: 5.39e-06 [cell_reuse_recompute_pass]: 1.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.889e-05 [j_node_and_user_rematch]: 1.24e-05 [meta_fg_expand]: 3.03e-06 [replace_old_param]: 1.11e-05 [inline_without_move]: 7.81001e-06 [renormalize]: 0.00340016 [add_forward_monad_depend]: 1.351e-05 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 2.492e-05 [cse]: 4.095e-05 [replace_applicator]: 2.911e-05 [Cycle 2]: 0.00042944, [27] [switch_simplify]: 8.3e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00013521 [with_stream_mark]: 1.712e-05 [recompute_prepare]: 6.26998e-06 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 7.07002e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 3.17002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.126e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.81001e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 7.36001e-06 [cse]: 1.76e-05 [replace_applicator]: 7.36001e-06 [py_interpret_to_execute_after_opt_a]: 1.834e-05 [rewriter_after_opt_a]: 4.361e-05 [convert_after_rewriter]: 7.13998e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00080959 [jit_opt_b]: 8.246e-05, [1] [Cycle 1]: 7.453e-05, [2] [frontend_op_eliminate]: 4.11e-05 [inline_after_opt_a]: 2.002e-05 [cconv]: 3.227e-05 [loop_unroll]: 0.00046685 [jit_opt_after_cconv]: 0.00017643, [1] [Cycle 1]: 0.00016976, [11] [c_1]: 2.701e-05 [parameter_eliminate]: 4.32998e-06 [updatestate_depend_eliminate]: 8.03001e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 3.28998e-06 [cse]: 3.21e-05 [call_graph_tuple_transform]: 2.405e-05 [tuple_list_get_item_eliminator]: 8.15e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.68998e-06 [remove_dup_value]: 2.038e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 1.152e-05 [add_recomputation]: 5.319e-05 [cse_after_recomputation]: 2.668e-05, [1] [Cycle 1]: 2.131e-05, [1] [cse]: 1.505e-05 [auto_monad_reorder]: 1.881e-05 [get_jit_bprop_graph]: 2.45002e-06 [rewriter_after_jit_bprop_graph]: 6.78998e-06 [opt_after_jit_grad]: 0.00048482 [symbol_engine_optimizer]: 8.82e-05, [1] [Cycle 1]: 8.217e-05, [6] [build]: 4.75999e-06 [elim_shapecalc]: 1.316e-05 [elim_not_effective]: 1.777e-05 [opt_reshape]: 6.96999e-06 [fold_const_symbol]: 1.04e-05 [renormalize]: 5.19998e-07 [validate]: 6.246e-05 Sums bootstrap : 0.000289s : 0.23% type_inference : 0.118269s : 93.50% event_method : 0.000023s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000525s : 0.42% rewriter_before_opt_a : 0.000107s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000953s : 0.75% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000015s : 0.01% jit_opt_a.renormalize : 0.003400s : 2.69% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.03% jit_opt_a.cse : 0.000059s : 0.05% jit_opt_a.replace_applicator : 0.000036s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000810s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000041s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000467s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000485s : 0.38% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.05% Time group info: ------[substitution.] 0.000310 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000007s : 4: substitution.graph_param_transform 86.32% : 0.000268s : 5: substitution.inline 1.69% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 2.05% : 0.000006s : 2: substitution.replace_old_param 4.73% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118179 2 97.44% : 0.115158s : 1: type_inference.infer 2.56% : 0.003021s : 1: type_inference.specialize ------[replace.] 0.000116 7 68.29% : 0.000079s : 5: replace.inline 31.71% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 95.15% : 0.000264s : 5: match.inline 4.85% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 0.86% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.80% : 0.000009s : 28: predicate.inline 1.29% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.65% : 0.000003s : 8: predicate.less_batch_normalization 1.69% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 2.02% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 1.61% : 0.000002s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.05% : 0.000002s : 8: predicate.remove_not_recompute_node 2.43% : 0.000004s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.31% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002756 25 62.16% : 0.001713s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.35% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.49% : 0.000951s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135704 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.22% : 0.000304s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.68% : 0.009061s : 1: jit_opt_a 0.13% : 0.000180s : 1: jit_opt_after_cconv 0.06% : 0.000085s : 1: jit_opt_b 0.35% : 0.000475s : 1: loop_unroll 0.60% : 0.000820s : 1: mutable_eliminate 0.92% : 0.001246s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000054s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000532s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.67% : 0.002266s : 1: renormalize.infer 0.82% : 0.001117s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000113s : 1: rewriter_before_opt_a 0.07% : 0.000091s : 1: symbol_engine_optimizer 87.17% : 0.118290s : 1: type_inference TotalTime = 0.120478, [30] [bootstrap]: 0.00028795 [type_inference]: 0.110158 [event_method]: 1.968e-05 [auto_monad]: 4.903e-05 [graph_reusing]: 3.91001e-06 [pre_auto_parallel]: 2.08002e-06 [py_interpret_to_execute]: 0.00047407 [rewriter_before_opt_a]: 8.519e-05 [expand_dump_flag]: 2.42001e-06 [jit_opt_a]: 0.00721388, [2] [Cycle 1]: 0.00360273, [27] [switch_simplify]: 5.195e-05 [loop_unroll]: 3.46e-05 [a_1]: 0.0006232 [with_stream_mark]: 1.351e-05 [recompute_prepare]: 8.89998e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 6.35002e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 8.40024e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.251e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 6.21e-06 [renormalize]: 0.00256196 [add_forward_monad_depend]: 6.43998e-06 [auto_monad_grad]: 1.76e-06 [auto_monad_eliminator]: 1.322e-05 [cse]: 2.297e-05 [replace_applicator]: 1.346e-05 [Cycle 2]: 0.00038099, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.74999e-06 [a_1]: 0.0001339 [with_stream_mark]: 1.016e-05 [recompute_prepare]: 6.46e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 5.81003e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 2.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.194e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.91998e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 5.98998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.42001e-06 [cse]: 1.235e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.027e-05 [rewriter_after_opt_a]: 3.094e-05 [convert_after_rewriter]: 6.20002e-06 [order_py_execute_after_rewriter]: 4.57e-06 [mutable_eliminate]: 0.0005537 [jit_opt_b]: 6.091e-05, [1] [Cycle 1]: 5.467e-05, [2] [frontend_op_eliminate]: 1.944e-05 [inline_after_opt_a]: 1.759e-05 [cconv]: 1.764e-05 [loop_unroll]: 0.00044836 [jit_opt_after_cconv]: 0.00015137, [1] [Cycle 1]: 0.00014482, [11] [c_1]: 2.721e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 3.51001e-06 [cse]: 2.087e-05 [call_graph_tuple_transform]: 1.89e-05 [tuple_list_get_item_eliminator]: 7.05e-06 [none_parameter_eliminate]: 1.00001e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.012e-05 [partial_unused_args_eliminate]: 1.60999e-06 [environ_conv]: 6.08002e-06 [add_recomputation]: 3.122e-05 [cse_after_recomputation]: 2.358e-05, [1] [Cycle 1]: 1.838e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.105e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.0004632 [symbol_engine_optimizer]: 7.651e-05, [1] [Cycle 1]: 7.065e-05, [6] [build]: 2.32001e-06 [elim_shapecalc]: 1.04e-05 [elim_not_effective]: 1.44e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 9.69999e-06 [renormalize]: 3.00002e-07 [validate]: 9.328e-05 Sums bootstrap : 0.000288s : 0.25% type_inference : 0.110158s : 94.42% event_method : 0.000020s : 0.02% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000474s : 0.41% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000757s : 0.65% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002562s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000554s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000448s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000031s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000463s : 0.40% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000093s : 0.08% Time group info: ------[substitution.] 0.000210 28 0.63% : 0.000001s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000004s : 4: substitution.graph_param_transform 83.16% : 0.000175s : 5: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.01% : 0.000011s : 3: substitution.reduce_eliminate 2.16% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000004s : 2: substitution.replace_old_param 3.38% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110089 2 97.31% : 0.107127s : 1: type_inference.infer 2.69% : 0.002961s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.22% : 0.000061s : 5: replace.inline 32.78% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 7 96.70% : 0.000172s : 5: match.inline 3.30% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.86% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.06% : 0.000007s : 28: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.61% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.33% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.07% : 0.000010s : 64: predicate.switch_simplify 1.54% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.22% : 0.000004s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002339 25 65.94% : 0.001542s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.43% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.62% : 0.000740s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124052 72 0.03% : 0.000034s : 1: add_recomputation 0.04% : 0.000052s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.25% : 0.000305s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.82% : 0.007217s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.37% : 0.000456s : 1: loop_unroll 0.45% : 0.000562s : 1: mutable_eliminate 0.80% : 0.000990s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000480s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.49% : 0.001842s : 1: renormalize.infer 0.57% : 0.000710s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.81% : 0.110171s : 1: type_inference TotalTime = 0.0147867, [30] [bootstrap]: 0.00027623 [type_inference]: 0.00711591 [event_method]: 1.773e-05 [auto_monad]: 4.766e-05 [graph_reusing]: 3.68e-06 [pre_auto_parallel]: 1.72999e-06 [py_interpret_to_execute]: 4.001e-05 [rewriter_before_opt_a]: 7.298e-05 [expand_dump_flag]: 1.84e-06 [jit_opt_a]: 0.00521628, [2] [Cycle 1]: 0.00171524, [27] [switch_simplify]: 5.692e-05 [loop_unroll]: 3.265e-05 [a_1]: 0.00063187 [with_stream_mark]: 1.635e-05 [recompute_prepare]: 8.05e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00065359 [add_forward_monad_depend]: 5.06002e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.318e-05 [cse]: 3.07e-05 [replace_applicator]: 1.175e-05 [Cycle 2]: 0.00032413, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.394e-05 [with_stream_mark]: 9.64e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.05001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.045e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.247e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 9.49999e-06 [rewriter_after_opt_a]: 3.357e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.00048237 [jit_opt_b]: 4.917e-05, [1] [Cycle 1]: 4.231e-05, [2] [frontend_op_eliminate]: 1.576e-05 [inline_after_opt_a]: 1.571e-05 [cconv]: 2.176e-05 [loop_unroll]: 0.00040721 [jit_opt_after_cconv]: 0.00014902, [1] [Cycle 1]: 0.00014283, [11] [c_1]: 2.038e-05 [parameter_eliminate]: 2.17999e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.882e-05 [call_graph_tuple_transform]: 1.803e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.664e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 4.548e-05 [cse_after_recomputation]: 2.342e-05, [1] [Cycle 1]: 1.8e-05, [1] [cse]: 1.194e-05 [auto_monad_reorder]: 1.715e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 4.70001e-06 [opt_after_jit_grad]: 0.00044735 [symbol_engine_optimizer]: 7.147e-05, [1] [Cycle 1]: 6.556e-05, [6] [build]: 3.32002e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.294e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 8.24998e-06 [renormalize]: 4.60015e-07 [validate]: 3.377e-05 Sums bootstrap : 0.000276s : 2.50% type_inference : 0.007116s : 64.38% event_method : 0.000018s : 0.16% auto_monad : 0.000048s : 0.43% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.36% rewriter_before_opt_a : 0.000073s : 0.66% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.57% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000726s : 6.57% jit_opt_a.with_stream_mark : 0.000026s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000654s : 5.91% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.17% jit_opt_a.cse : 0.000043s : 0.39% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.09% rewriter_after_opt_a : 0.000034s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000482s : 4.36% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000022s : 0.20% loop_unroll : 0.000407s : 3.68% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000045s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000447s : 4.05% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.31% Time group info: ------[substitution.] 0.000225 27 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000005s : 3: substitution.graph_param_transform 82.56% : 0.000186s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.25% : 0.000010s : 3: substitution.reduce_eliminate 1.93% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000004s : 2: substitution.replace_old_param 4.59% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007066 2 87.51% : 0.006183s : 1: type_inference.infer 12.49% : 0.000883s : 1: type_inference.specialize ------[replace.] 0.000089 7 68.44% : 0.000061s : 5: replace.inline 31.56% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 7 95.18% : 0.000183s : 5: match.inline 4.82% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.28% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.36% : 0.000002s : 11: predicate.addn_zero_filter 2.04% : 0.000002s : 11: predicate.arithmetic_simplify 1.48% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.31% : 0.000002s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 1.99% : 0.000002s : 11: predicate.reduce_eliminate 1.59% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 11: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.94% : 0.000010s : 59: predicate.switch_simplify 1.38% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000724 16 50.32% : 0.000364s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.96% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.72% : 0.000302s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016443 72 0.29% : 0.000048s : 1: add_recomputation 0.31% : 0.000051s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.78% : 0.000293s : 1: bootstrap 0.15% : 0.000024s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000021s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 31.74% : 0.005219s : 1: jit_opt_a 0.92% : 0.000152s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.52% : 0.000415s : 1: loop_unroll 2.98% : 0.000491s : 1: mutable_eliminate 5.72% : 0.000941s : 26: opt.transform.jit_opt_a 0.28% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000456s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000043s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.22% : 0.000365s : 1: renormalize.infer 1.71% : 0.000281s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000037s : 1: rewriter_after_opt_a 0.46% : 0.000076s : 1: rewriter_before_opt_a 0.45% : 0.000074s : 1: symbol_engine_optimizer 43.34% : 0.007126s : 1: type_inference TotalTime = 0.133179, [30] [bootstrap]: 0.00029983 [type_inference]: 0.121217 [event_method]: 2.392e-05 [auto_monad]: 7.946e-05 [graph_reusing]: 7.16001e-06 [pre_auto_parallel]: 3.04999e-06 [py_interpret_to_execute]: 0.00054309 [rewriter_before_opt_a]: 0.00010216 [expand_dump_flag]: 4.27998e-06 [jit_opt_a]: 0.00848536, [2] [Cycle 1]: 0.00441281, [27] [switch_simplify]: 7.425e-05 [loop_unroll]: 3.59e-05 [a_1]: 0.00081861 [with_stream_mark]: 2.888e-05 [recompute_prepare]: 1.18e-05 [updatestate_depend_eliminate]: 4.84998e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 7.95e-06 [updatestate_useless_node_eliminater]: 6.91999e-06 [accelerated_algorithm]: 7.36001e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 6.85998e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 2.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.875e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.203e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00301042 [add_forward_monad_depend]: 1.067e-05 [auto_monad_grad]: 3.01999e-06 [auto_monad_eliminator]: 2.1e-05 [cse]: 3.919e-05 [replace_applicator]: 2.359e-05 [Cycle 2]: 0.0003959, [27] [switch_simplify]: 6.96999e-06 [loop_unroll]: 6.01998e-06 [a_1]: 0.0001345 [with_stream_mark]: 1.658e-05 [recompute_prepare]: 6.43e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 3.16001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.535e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 9.47999e-06 [inline_without_move]: 5.68002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.79e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.353e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.713e-05 [rewriter_after_opt_a]: 3.803e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.56998e-06 [mutable_eliminate]: 0.00076654 [jit_opt_b]: 5.671e-05, [1] [Cycle 1]: 4.88e-05, [2] [frontend_op_eliminate]: 1.943e-05 [inline_after_opt_a]: 1.873e-05 [cconv]: 3.027e-05 [loop_unroll]: 0.00042591 [jit_opt_after_cconv]: 0.00015273, [1] [Cycle 1]: 0.0001463, [11] [c_1]: 2.559e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 6.32001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.193e-05 [call_graph_tuple_transform]: 2.153e-05 [tuple_list_get_item_eliminator]: 6.08998e-06 [none_parameter_eliminate]: 1.39003e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.735e-05 [partial_unused_args_eliminate]: 2.81e-06 [environ_conv]: 9.78998e-06 [add_recomputation]: 4.984e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.776e-05, [1] [cse]: 1.209e-05 [auto_monad_reorder]: 1.764e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 5.62001e-06 [opt_after_jit_grad]: 0.00045659 [symbol_engine_optimizer]: 9.03e-05, [1] [Cycle 1]: 6.856e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 8.02998e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 6.03002e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 4.40021e-07 [validate]: 4.645e-05 Sums bootstrap : 0.000300s : 0.23% type_inference : 0.121217s : 94.09% event_method : 0.000024s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000543s : 0.42% rewriter_before_opt_a : 0.000102s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000953s : 0.74% jit_opt_a.with_stream_mark : 0.000045s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003010s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000767s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000426s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000457s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000354 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 1.96% : 0.000007s : 4: substitution.graph_param_transform 84.14% : 0.000298s : 5: substitution.inline 1.29% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.64% : 0.000016s : 3: substitution.reduce_eliminate 1.66% : 0.000006s : 4: substitution.remove_not_recompute_node 1.83% : 0.000006s : 2: substitution.replace_old_param 3.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121114 2 97.45% : 0.118023s : 1: type_inference.infer 2.55% : 0.003091s : 1: type_inference.specialize ------[replace.] 0.000119 7 68.92% : 0.000082s : 5: replace.inline 31.08% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000306 7 96.36% : 0.000295s : 5: match.inline 3.64% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.58% : 0.000002s : 13: predicate.addn_zero_filter 2.24% : 0.000003s : 13: predicate.arithmetic_simplify 1.53% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.33% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.84% : 0.000009s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.75% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 2.00% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 23: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.53% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.74% : 0.000012s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002694 25 63.28% : 0.001705s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.56% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.16% : 0.000893s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137476 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000083s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000318s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.17% : 0.008489s : 1: jit_opt_a 0.11% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.32% : 0.000434s : 1: loop_unroll 0.57% : 0.000777s : 1: mutable_eliminate 0.89% : 0.001228s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000551s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.51% : 0.002076s : 1: renormalize.infer 0.67% : 0.000921s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.07% : 0.000093s : 1: symbol_engine_optimizer 88.19% : 0.121239s : 1: type_inference TotalTime = 0.125657, [30] [bootstrap]: 0.00036915 [type_inference]: 0.113888 [event_method]: 2.17e-05 [auto_monad]: 7.389e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.97002e-06 [py_interpret_to_execute]: 0.00051321 [rewriter_before_opt_a]: 8.797e-05 [expand_dump_flag]: 4.28001e-06 [jit_opt_a]: 0.00832662, [2] [Cycle 1]: 0.00409873, [27] [switch_simplify]: 6.048e-05 [loop_unroll]: 3.2e-05 [a_1]: 0.00097389 [with_stream_mark]: 1.755e-05 [recompute_prepare]: 1.057e-05 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 7.60998e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 6.41998e-06 [renormalize]: 0.00263251 [add_forward_monad_depend]: 7.71999e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.94e-05 [cse]: 3.126e-05 [replace_applicator]: 1.951e-05 [Cycle 2]: 0.00046527, [27] [switch_simplify]: 7.07002e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00012791 [with_stream_mark]: 1.334e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 7.381e-05 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.74999e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.78002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 1.04998e-06 [auto_monad_eliminator]: 7.64002e-06 [cse]: 1.309e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.179e-05 [rewriter_after_opt_a]: 3.607e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00060384 [jit_opt_b]: 6.027e-05, [1] [Cycle 1]: 5.312e-05, [2] [frontend_op_eliminate]: 2.315e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 2.923e-05 [loop_unroll]: 0.00042843 [jit_opt_after_cconv]: 0.00016004, [1] [Cycle 1]: 0.00015292, [11] [c_1]: 2.701e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.80002e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.128e-05 [call_graph_tuple_transform]: 2.19e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 6.48998e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 3.93999e-06 [environ_conv]: 8.3e-06 [add_recomputation]: 5.24e-05 [cse_after_recomputation]: 2.363e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.159e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 5.86998e-06 [opt_after_jit_grad]: 0.00047231 [symbol_engine_optimizer]: 0.00016901, [1] [Cycle 1]: 0.00016237, [6] [build]: 3.8e-06 [elim_shapecalc]: 8.71002e-06 [elim_not_effective]: 0.0001013 [opt_reshape]: 7.63999e-06 [fold_const_symbol]: 1.078e-05 [renormalize]: 4.69998e-07 [validate]: 4.717e-05 Sums bootstrap : 0.000369s : 0.30% type_inference : 0.113888s : 93.93% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000513s : 0.42% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.001102s : 0.91% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000076s : 0.06% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002633s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000604s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000428s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000472s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000101s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000272 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000007s : 4: substitution.graph_param_transform 85.99% : 0.000234s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 4.80% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113796 2 97.53% : 0.110991s : 1: type_inference.infer 2.47% : 0.002806s : 1: type_inference.specialize ------[replace.] 0.000378 6 93.14% : 0.000352s : 4: replace.inline 6.86% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 95.15% : 0.000231s : 4: match.inline 4.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 2.25% : 0.000003s : 12: predicate.arithmetic_simplify 1.42% : 0.000002s : 12: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.64% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000002s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.44% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 1.82% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.78% : 0.000004s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002211 22 66.01% : 0.001460s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.21% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.78% : 0.000703s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129707 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.30% : 0.000389s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.42% : 0.008330s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.34% : 0.000437s : 1: loop_unroll 0.47% : 0.000613s : 1: mutable_eliminate 1.04% : 0.001351s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000521s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.45% : 0.001886s : 1: renormalize.infer 0.57% : 0.000737s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000094s : 1: rewriter_before_opt_a 0.13% : 0.000172s : 1: symbol_engine_optimizer 87.82% : 0.113907s : 1: type_inference TotalTime = 0.128774, [30] [bootstrap]: 0.00030059 [type_inference]: 0.117799 [event_method]: 2.579e-05 [auto_monad]: 7.646e-05 [graph_reusing]: 6.84999e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00053616 [rewriter_before_opt_a]: 0.00010462 [expand_dump_flag]: 3.87002e-06 [jit_opt_a]: 0.00774059, [2] [Cycle 1]: 0.00382536, [27] [switch_simplify]: 6.214e-05 [loop_unroll]: 3.45e-05 [a_1]: 0.00066515 [with_stream_mark]: 1.446e-05 [recompute_prepare]: 8.71997e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.60002e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 7.91001e-06 [updatestate_useless_node_eliminater]: 7.61999e-06 [accelerated_algorithm]: 7.73001e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 6.85998e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.416e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 6.26998e-06 [renormalize]: 0.00271416 [add_forward_monad_depend]: 6.20002e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.511e-05 [cse]: 2.567e-05 [replace_applicator]: 1.561e-05 [Cycle 2]: 0.00036711, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012215 [with_stream_mark]: 1.094e-05 [recompute_prepare]: 6.26998e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.76998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.12998e-06 [inline_without_move]: 5.84e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.377e-05 [replace_applicator]: 6.33998e-06 [py_interpret_to_execute_after_opt_a]: 1.25e-05 [rewriter_after_opt_a]: 3.473e-05 [convert_after_rewriter]: 6.70002e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00056155 [jit_opt_b]: 5.526e-05, [1] [Cycle 1]: 4.887e-05, [2] [frontend_op_eliminate]: 1.906e-05 [inline_after_opt_a]: 1.822e-05 [cconv]: 2.078e-05 [loop_unroll]: 0.00041929 [jit_opt_after_cconv]: 0.00015113, [1] [Cycle 1]: 0.00014486, [11] [c_1]: 2.644e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.281e-05 [call_graph_tuple_transform]: 1.96e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.17999e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.33998e-06 [remove_dup_value]: 1.497e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 7.80998e-06 [add_recomputation]: 4.258e-05 [cse_after_recomputation]: 2.384e-05, [1] [Cycle 1]: 1.886e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.423e-05 [get_jit_bprop_graph]: 2.51998e-06 [rewriter_after_jit_bprop_graph]: 4.61002e-06 [opt_after_jit_grad]: 0.00045461 [symbol_engine_optimizer]: 0.00012433, [1] [Cycle 1]: 0.00011803, [6] [build]: 3.38999e-06 [elim_shapecalc]: 8.74e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 5.189e-05 [fold_const_symbol]: 1.144e-05 [renormalize]: 4.39992e-07 [validate]: 4.07e-05 Sums bootstrap : 0.000301s : 0.24% type_inference : 0.117799s : 94.51% event_method : 0.000026s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000536s : 0.43% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000787s : 0.63% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002714s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000562s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000021s : 0.02% loop_unroll : 0.000419s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000043s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000052s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000241 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000005s : 4: substitution.graph_param_transform 86.33% : 0.000208s : 5: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.25% : 0.000003s : 2: substitution.replace_old_param 5.65% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117717 2 97.31% : 0.114546s : 1: type_inference.infer 2.69% : 0.003170s : 1: type_inference.specialize ------[replace.] 0.000098 7 66.50% : 0.000065s : 5: replace.inline 33.50% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 94.45% : 0.000205s : 5: match.inline 5.55% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.50% : 0.000002s : 13: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.59% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.27% : 0.000002s : 13: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.75% : 0.000002s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.40% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.13% : 0.000002s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.85% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002424 25 62.93% : 0.001525s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.74% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.33% : 0.000832s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132637 72 0.03% : 0.000046s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000318s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.84% : 0.007744s : 1: jit_opt_a 0.12% : 0.000154s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.32% : 0.000427s : 1: loop_unroll 0.43% : 0.000570s : 1: mutable_eliminate 0.78% : 0.001034s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000082s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000543s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.43% : 0.001891s : 1: renormalize.infer 0.61% : 0.000814s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.10% : 0.000127s : 1: symbol_engine_optimizer 88.82% : 0.117811s : 1: type_inference TotalTime = 0.126392, [30] [bootstrap]: 0.00030595 [type_inference]: 0.114432 [event_method]: 2.211e-05 [auto_monad]: 7.805e-05 [graph_reusing]: 6.66999e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00054765 [rewriter_before_opt_a]: 0.00010508 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00835944, [2] [Cycle 1]: 0.00426574, [27] [switch_simplify]: 6.928e-05 [loop_unroll]: 3.376e-05 [a_1]: 0.0007236 [with_stream_mark]: 2.106e-05 [recompute_prepare]: 1.079e-05 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.13002e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 6.13002e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.77002e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00302961 [add_forward_monad_depend]: 8.01001e-06 [auto_monad_grad]: 3.07002e-06 [auto_monad_eliminator]: 1.706e-05 [cse]: 3.397e-05 [replace_applicator]: 2.212e-05 [Cycle 2]: 0.00039948, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00013911 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 3.51999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.29998e-06 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.298e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.597e-05 [rewriter_after_opt_a]: 3.735e-05 [convert_after_rewriter]: 7.10998e-06 [order_py_execute_after_rewriter]: 5.72999e-06 [mutable_eliminate]: 0.00077179 [jit_opt_b]: 5.838e-05, [1] [Cycle 1]: 4.934e-05, [2] [frontend_op_eliminate]: 1.953e-05 [inline_after_opt_a]: 1.898e-05 [cconv]: 2.725e-05 [loop_unroll]: 0.0004479 [jit_opt_after_cconv]: 0.00016129, [1] [Cycle 1]: 0.0001545, [11] [c_1]: 2.622e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 2.90002e-06 [cse]: 2.695e-05 [call_graph_tuple_transform]: 2.155e-05 [tuple_list_get_item_eliminator]: 6.49001e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 1.733e-05 [partial_unused_args_eliminate]: 1.94999e-06 [environ_conv]: 9.50001e-06 [add_recomputation]: 4.846e-05 [cse_after_recomputation]: 2.369e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.685e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 6.22001e-06 [opt_after_jit_grad]: 0.00046504 [symbol_engine_optimizer]: 7.779e-05, [1] [Cycle 1]: 7.162e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 8.80999e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 6.06998e-06 [fold_const_symbol]: 9.59e-06 [renormalize]: 5.40022e-07 [validate]: 0.00014302 Sums bootstrap : 0.000306s : 0.25% type_inference : 0.114432s : 93.74% event_method : 0.000022s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000548s : 0.45% rewriter_before_opt_a : 0.000105s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000863s : 0.71% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003030s : 2.48% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000772s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000448s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000465s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000143s : 0.12% Time group info: ------[substitution.] 0.000296 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 4: substitution.graph_param_transform 83.32% : 0.000247s : 5: substitution.inline 1.30% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.99% : 0.000015s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 4.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114349 2 97.35% : 0.111323s : 1: type_inference.infer 2.65% : 0.003025s : 1: type_inference.specialize ------[replace.] 0.000102 7 70.05% : 0.000071s : 5: replace.inline 29.95% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 7 95.69% : 0.000243s : 5: match.inline 4.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000001s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.64% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.96% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 2.26% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 23: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.63% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.12% : 0.000010s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.76% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002490 25 62.66% : 0.001560s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.95% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.39% : 0.000856s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130515 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000319s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.41% : 0.008363s : 1: jit_opt_a 0.13% : 0.000164s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.35% : 0.000456s : 1: loop_unroll 0.60% : 0.000781s : 1: mutable_eliminate 0.86% : 0.001123s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000559s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.62% : 0.002116s : 1: renormalize.infer 0.69% : 0.000903s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 87.69% : 0.114452s : 1: type_inference TotalTime = 0.120757, [30] [bootstrap]: 0.00028612 [type_inference]: 0.109233 [event_method]: 2.495e-05 [auto_monad]: 7.403e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 0.00047554 [rewriter_before_opt_a]: 9.909e-05 [expand_dump_flag]: 4.52e-06 [jit_opt_a]: 0.00819481, [2] [Cycle 1]: 0.00416697, [27] [switch_simplify]: 6.339e-05 [loop_unroll]: 3.369e-05 [a_1]: 0.00069529 [with_stream_mark]: 2.014e-05 [recompute_prepare]: 9.05999e-06 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 3.70998e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 1.046e-05 [inline_without_move]: 6.08998e-06 [renormalize]: 0.00297799 [add_forward_monad_depend]: 7.76001e-06 [auto_monad_grad]: 3.11999e-06 [auto_monad_eliminator]: 1.95e-05 [cse]: 3.652e-05 [replace_applicator]: 1.873e-05 [Cycle 2]: 0.00037944, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00013199 [with_stream_mark]: 1.149e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.77002e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 8.35999e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.351e-05 [replace_applicator]: 5.71998e-06 [py_interpret_to_execute_after_opt_a]: 1.342e-05 [rewriter_after_opt_a]: 3.748e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00062204 [jit_opt_b]: 5.499e-05, [1] [Cycle 1]: 4.722e-05, [2] [frontend_op_eliminate]: 1.787e-05 [inline_after_opt_a]: 1.784e-05 [cconv]: 2.553e-05 [loop_unroll]: 0.00049521 [jit_opt_after_cconv]: 0.00015329, [1] [Cycle 1]: 0.00014679, [11] [c_1]: 2.611e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.087e-05 [call_graph_tuple_transform]: 2.113e-05 [tuple_list_get_item_eliminator]: 6.72002e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.71999e-06 [remove_dup_value]: 1.783e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 8.52998e-06 [add_recomputation]: 5.02e-05 [cse_after_recomputation]: 2.434e-05, [1] [Cycle 1]: 1.903e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.789e-05 [get_jit_bprop_graph]: 2.85002e-06 [rewriter_after_jit_bprop_graph]: 4.70999e-06 [opt_after_jit_grad]: 0.00047014 [symbol_engine_optimizer]: 7.699e-05, [1] [Cycle 1]: 7.122e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 9.12001e-06 [elim_not_effective]: 1.387e-05 [opt_reshape]: 6.38998e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 3.69997e-07 [validate]: 7.67e-05 Sums bootstrap : 0.000286s : 0.25% type_inference : 0.109233s : 93.76% event_method : 0.000025s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000476s : 0.41% rewriter_before_opt_a : 0.000099s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000827s : 0.71% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002978s : 2.56% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000622s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000495s : 0.43% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000470s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000077s : 0.07% Time group info: ------[substitution.] 0.000273 28 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 4: substitution.graph_param_transform 82.67% : 0.000226s : 5: substitution.inline 1.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.63% : 0.000013s : 3: substitution.reduce_eliminate 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 4.02% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109149 2 97.34% : 0.106242s : 1: type_inference.infer 2.66% : 0.002907s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.28% : 0.000067s : 5: replace.inline 31.72% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 7 95.82% : 0.000223s : 5: match.inline 4.18% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.41% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 19: predicate.partial_eliminate 1.43% : 0.000002s : 13: predicate.print_const_string_wrapper 2.22% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 4: predicate.row_tensor_eliminate 1.48% : 0.000002s : 13: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.31% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.45% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002480 25 63.49% : 0.001575s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.06% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.45% : 0.000830s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124842 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000304s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.57% : 0.008199s : 1: jit_opt_a 0.12% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.40% : 0.000504s : 1: loop_unroll 0.50% : 0.000630s : 1: mutable_eliminate 0.86% : 0.001073s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000483s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.70% : 0.002123s : 1: renormalize.infer 0.68% : 0.000845s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 87.51% : 0.109253s : 1: type_inference TotalTime = 0.0172004, [30] [bootstrap]: 0.00033072 [type_inference]: 0.00919596 [event_method]: 1.744e-05 [auto_monad]: 6.771e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 3.569e-05 [rewriter_before_opt_a]: 7.293e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00542775, [2] [Cycle 1]: 0.00157264, [27] [switch_simplify]: 5.13e-05 [loop_unroll]: 3.036e-05 [a_1]: 0.00060385 [with_stream_mark]: 1.594e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.36001e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.89001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 6.73998e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 1.41998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00054432 [add_forward_monad_depend]: 4.40999e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.459e-05 [cse]: 3.047e-05 [replace_applicator]: 1.083e-05 [Cycle 2]: 0.00031395, [27] [switch_simplify]: 5.49e-06 [loop_unroll]: 4.85001e-06 [a_1]: 9.066e-05 [with_stream_mark]: 8.79e-06 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 4.77e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.41998e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 7.63999e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 6.72002e-06 [inline_without_move]: 4.61002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.88002e-06 [cse]: 1.042e-05 [replace_applicator]: 4.98001e-06 [py_interpret_to_execute_after_opt_a]: 8.68001e-06 [rewriter_after_opt_a]: 3.556e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00051251 [jit_opt_b]: 5.102e-05, [1] [Cycle 1]: 4.446e-05, [2] [frontend_op_eliminate]: 1.706e-05 [inline_after_opt_a]: 1.598e-05 [cconv]: 2.695e-05 [loop_unroll]: 0.0004096 [jit_opt_after_cconv]: 0.00014215, [1] [Cycle 1]: 0.00013572, [11] [c_1]: 2.076e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.036e-05 [call_graph_tuple_transform]: 1.85e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 5.63002e-06 [remove_dup_value]: 1.589e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.04999e-06 [add_recomputation]: 4.866e-05 [cse_after_recomputation]: 2.082e-05, [1] [Cycle 1]: 1.575e-05, [1] [cse]: 1.031e-05 [auto_monad_reorder]: 1.599e-05 [get_jit_bprop_graph]: 1.44e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00044011 [symbol_engine_optimizer]: 7.089e-05, [1] [Cycle 1]: 6.508e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 7.75e-06 [elim_not_effective]: 1.269e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.84998e-06 [renormalize]: 4.09986e-07 [validate]: 3.422e-05 Sums bootstrap : 0.000331s : 2.53% type_inference : 0.009196s : 70.28% event_method : 0.000017s : 0.13% auto_monad : 0.000068s : 0.52% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.27% rewriter_before_opt_a : 0.000073s : 0.56% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.43% jit_opt_a.loop_unroll : 0.000035s : 0.27% jit_opt_a.a_1 : 0.000695s : 5.31% jit_opt_a.with_stream_mark : 0.000025s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000008s : 0.06% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000544s : 4.16% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000041s : 0.31% jit_opt_a.replace_applicator : 0.000016s : 0.12% py_interpret_to_execute_after_opt_a : 0.000009s : 0.07% rewriter_after_opt_a : 0.000036s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000513s : 3.92% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000027s : 0.21% loop_unroll : 0.000410s : 3.13% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000049s : 0.37% cse_after_recomputation.cse : 0.000010s : 0.08% auto_monad_reorder : 0.000016s : 0.12% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000440s : 3.36% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.26% Time group info: ------[substitution.] 0.000212 23 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000002s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 3: substitution.graph_param_transform 84.02% : 0.000178s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 1.77% : 0.000004s : 2: substitution.replace_old_param 6.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009134 2 90.66% : 0.008281s : 1: type_inference.infer 9.34% : 0.000853s : 1: type_inference.specialize ------[replace.] 0.000103 6 46.64% : 0.000048s : 4: replace.inline 53.36% : 0.000055s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 93.53% : 0.000175s : 4: match.inline 6.47% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 691 1.05% : 0.000001s : 10: predicate.accumulaten_eliminater 0.85% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.88% : 0.000001s : 10: predicate.addn_check_dump 1.08% : 0.000002s : 10: predicate.addn_zero_filter 1.85% : 0.000003s : 10: predicate.arithmetic_simplify 1.03% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.90% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 0.89% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.97% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.98% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 8.19% : 0.000012s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.87% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000002s : 10: predicate.environ_get_eliminate 0.87% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.00% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.24% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.55% : 0.000002s : 15: predicate.load_eliminater 1.14% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 10: predicate.merge_addn 0.94% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.37% : 0.000001s : 3: predicate.opt_reshape 1.90% : 0.000003s : 15: predicate.partial_eliminate 0.99% : 0.000001s : 10: predicate.print_const_string_wrapper 1.32% : 0.000002s : 10: predicate.reduce_eliminate 1.20% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.42% : 0.000002s : 18: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.06% : 0.000002s : 10: predicate.reshape_eliminate 1.01% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 0.99% : 0.000001s : 10: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.10% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.36% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.90% : 0.000003s : 16: predicate.switch_defer_inline 1.66% : 0.000002s : 16: predicate.switch_layer_defer_inline 15.72% : 0.000022s : 53: predicate.switch_simplify 1.08% : 0.000002s : 10: predicate.tile_eliminate 0.94% : 0.000001s : 10: predicate.transpose_eliminate 1.18% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.14% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.36% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.34% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.25% : 0.000002s : 10: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003963 13 92.25% : 0.003656s : 6: func_graph_cloner_run.FuncGraphClonerGraph 1.23% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 6.52% : 0.000258s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018697 72 0.28% : 0.000052s : 1: add_recomputation 0.38% : 0.000071s : 1: auto_monad 0.10% : 0.000018s : 1: auto_monad_reorder 1.89% : 0.000353s : 1: bootstrap 0.16% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.11% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.04% : 0.005430s : 1: jit_opt_a 0.77% : 0.000145s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.23% : 0.000418s : 1: loop_unroll 2.79% : 0.000521s : 1: mutable_eliminate 4.81% : 0.000899s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.40% : 0.000449s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000038s : 1: py_interpret_to_execute 0.06% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 1.57% : 0.000294s : 1: renormalize.infer 1.30% : 0.000243s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.41% : 0.000076s : 1: rewriter_before_opt_a 0.39% : 0.000073s : 1: symbol_engine_optimizer 49.27% : 0.009211s : 1: type_inference TotalTime = 0.0151293, [30] [bootstrap]: 0.00033974 [type_inference]: 0.00749015 [event_method]: 1.981e-05 [auto_monad]: 5.623e-05 [graph_reusing]: 3.98001e-06 [pre_auto_parallel]: 1.96e-06 [py_interpret_to_execute]: 4.28e-05 [rewriter_before_opt_a]: 7.491e-05 [expand_dump_flag]: 2.84001e-06 [jit_opt_a]: 0.00510634, [2] [Cycle 1]: 0.00165739, [27] [switch_simplify]: 5.1e-05 [loop_unroll]: 3.301e-05 [a_1]: 0.00058711 [with_stream_mark]: 1.377e-05 [recompute_prepare]: 8.35001e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 6.23998e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 2.46998e-06 [cell_reuse_recompute_pass]: 8.89995e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.193e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 7.93001e-06 [inline_without_move]: 5.46998e-06 [renormalize]: 0.00066823 [add_forward_monad_depend]: 5.24998e-06 [auto_monad_grad]: 1.53002e-06 [auto_monad_eliminator]: 1.231e-05 [cse]: 2.172e-05 [replace_applicator]: 1.154e-05 [Cycle 2]: 0.00033265, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.746e-05 [with_stream_mark]: 8.80999e-06 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.11002e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.033e-05 [j_node_and_user_rematch]: 7.31999e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 6.83e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 5.61998e-06 [cse]: 1.213e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.123e-05 [rewriter_after_opt_a]: 2.974e-05 [convert_after_rewriter]: 5.69e-06 [order_py_execute_after_rewriter]: 4.70999e-06 [mutable_eliminate]: 0.00048494 [jit_opt_b]: 4.843e-05, [1] [Cycle 1]: 4.235e-05, [2] [frontend_op_eliminate]: 1.576e-05 [inline_after_opt_a]: 1.497e-05 [cconv]: 1.987e-05 [loop_unroll]: 0.0004072 [jit_opt_after_cconv]: 0.00015252, [1] [Cycle 1]: 0.00014638, [11] [c_1]: 2.063e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 5.20001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 1.974e-05 [call_graph_tuple_transform]: 1.79e-05 [tuple_list_get_item_eliminator]: 5.52999e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.327e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 3.954e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.902e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.469e-05 [get_jit_bprop_graph]: 1.62001e-06 [rewriter_after_jit_bprop_graph]: 4.19997e-06 [opt_after_jit_grad]: 0.00044213 [symbol_engine_optimizer]: 7.268e-05, [1] [Cycle 1]: 6.654e-05, [6] [build]: 2.66e-06 [elim_shapecalc]: 7.47998e-06 [elim_not_effective]: 1.304e-05 [opt_reshape]: 5.79999e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 3.19997e-07 [validate]: 3.092e-05 Sums bootstrap : 0.000340s : 2.98% type_inference : 0.007490s : 65.63% event_method : 0.000020s : 0.17% auto_monad : 0.000056s : 0.49% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.37% rewriter_before_opt_a : 0.000075s : 0.66% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000057s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.33% jit_opt_a.a_1 : 0.000685s : 6.00% jit_opt_a.with_stream_mark : 0.000023s : 0.20% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000668s : 5.86% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.16% jit_opt_a.cse : 0.000034s : 0.30% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000030s : 0.26% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000485s : 4.25% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000020s : 0.17% loop_unroll : 0.000407s : 3.57% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000013s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000040s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000015s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000442s : 3.87% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.27% Time group info: ------[substitution.] 0.000214 27 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 83.28% : 0.000178s : 5: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.37% : 0.000009s : 3: substitution.reduce_eliminate 1.88% : 0.000004s : 4: substitution.remove_not_recompute_node 1.47% : 0.000003s : 2: substitution.replace_old_param 3.85% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007437 2 88.20% : 0.006559s : 1: type_inference.infer 11.80% : 0.000878s : 1: type_inference.specialize ------[replace.] 0.000081 7 66.64% : 0.000054s : 5: replace.inline 33.36% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 7 96.09% : 0.000175s : 5: match.inline 3.91% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.97% : 0.000002s : 11: predicate.arithmetic_simplify 1.49% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 11: predicate.compare_switch_simplify 1.37% : 0.000002s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.64% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000001s : 11: predicate.environ_get_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000006s : 24: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 16: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.32% : 0.000002s : 11: predicate.minmaximum_grad 1.50% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000001s : 11: predicate.print_const_string_wrapper 2.07% : 0.000002s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 11: predicate.reshape_eliminate 1.26% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.11% : 0.000010s : 59: predicate.switch_simplify 1.41% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.55% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000713 16 48.95% : 0.000349s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.24% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.81% : 0.000305s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016751 72 0.25% : 0.000042s : 1: add_recomputation 0.36% : 0.000060s : 1: auto_monad 0.10% : 0.000017s : 1: auto_monad_reorder 2.14% : 0.000359s : 1: bootstrap 0.13% : 0.000022s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 30.50% : 0.005109s : 1: jit_opt_a 0.93% : 0.000155s : 1: jit_opt_after_cconv 0.30% : 0.000051s : 1: jit_opt_b 2.47% : 0.000414s : 1: loop_unroll 2.94% : 0.000493s : 1: mutable_eliminate 5.32% : 0.000892s : 26: opt.transform.jit_opt_a 0.28% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000012s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.69% : 0.000450s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000016s : 1: remove_dup_value 2.24% : 0.000376s : 1: renormalize.infer 1.70% : 0.000285s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000033s : 1: rewriter_after_opt_a 0.46% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000075s : 1: symbol_engine_optimizer 44.87% : 0.007516s : 1: type_inference TotalTime = 0.0739096, [30] [bootstrap]: 0.00029402 [type_inference]: 0.0645642 [event_method]: 1.665e-05 [auto_monad]: 5.385e-05 [graph_reusing]: 4.3e-06 [pre_auto_parallel]: 1.74e-06 [py_interpret_to_execute]: 0.00030684 [rewriter_before_opt_a]: 0.00011802 [expand_dump_flag]: 2.71e-06 [jit_opt_a]: 0.00646706, [2] [Cycle 1]: 0.00297631, [27] [switch_simplify]: 4.555e-05 [loop_unroll]: 3.146e-05 [a_1]: 0.0005284 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 8.48999e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 1.51998e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 1.012e-05 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.57998e-06 [inline_without_move]: 1.889e-05 [renormalize]: 0.00203394 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 1.90001e-06 [auto_monad_eliminator]: 1.293e-05 [cse]: 1.939e-05 [replace_applicator]: 1.448e-05 [Cycle 2]: 0.00036317, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 6.13002e-06 [a_1]: 0.00012441 [with_stream_mark]: 9.51003e-06 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 2.41e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.384e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.34998e-06 [inline_without_move]: 5.71e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.55002e-06 [cse]: 1.166e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 9.37999e-06 [rewriter_after_opt_a]: 2.676e-05 [convert_after_rewriter]: 5.76e-06 [order_py_execute_after_rewriter]: 4.19002e-06 [mutable_eliminate]: 0.00050713 [jit_opt_b]: 5.423e-05, [1] [Cycle 1]: 4.815e-05, [2] [frontend_op_eliminate]: 1.923e-05 [inline_after_opt_a]: 1.769e-05 [cconv]: 1.634e-05 [loop_unroll]: 0.00043131 [jit_opt_after_cconv]: 0.00014613, [1] [Cycle 1]: 0.00014021, [11] [c_1]: 2.648e-05 [parameter_eliminate]: 2.48002e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 1.872e-05 [call_graph_tuple_transform]: 1.957e-05 [tuple_list_get_item_eliminator]: 6.46999e-06 [none_parameter_eliminate]: 1.03001e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.58e-06 [remove_dup_value]: 9.54e-06 [partial_unused_args_eliminate]: 1.66e-06 [environ_conv]: 6.88e-06 [add_recomputation]: 3.417e-05 [cse_after_recomputation]: 2.224e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.108e-05 [auto_monad_reorder]: 1.05e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 5.17999e-06 [opt_after_jit_grad]: 0.00048652 [symbol_engine_optimizer]: 7.487e-05, [1] [Cycle 1]: 6.902e-05, [6] [build]: 2.70002e-06 [elim_shapecalc]: 8.38001e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 9.54999e-06 [renormalize]: 4.50003e-07 [validate]: 5.03e-05 Sums bootstrap : 0.000294s : 0.42% type_inference : 0.064564s : 91.96% event_method : 0.000017s : 0.02% auto_monad : 0.000054s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000307s : 0.44% rewriter_before_opt_a : 0.000118s : 0.17% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.07% jit_opt_a.loop_unroll : 0.000038s : 0.05% jit_opt_a.a_1 : 0.000653s : 0.93% jit_opt_a.with_stream_mark : 0.000023s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000025s : 0.04% jit_opt_a.renormalize : 0.002034s : 2.90% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000031s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000027s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000507s : 0.72% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000016s : 0.02% loop_unroll : 0.000431s : 0.61% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000034s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000487s : 0.69% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.07% Time group info: ------[substitution.] 0.000159 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000004s : 4: substitution.graph_param_transform 83.89% : 0.000134s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.91% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000003s : 2: substitution.replace_old_param 5.01% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.064488 2 97.14% : 0.062644s : 1: type_inference.infer 2.86% : 0.001844s : 1: type_inference.specialize ------[replace.] 0.000066 6 64.87% : 0.000043s : 4: replace.inline 35.13% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 6 95.17% : 0.000131s : 4: match.inline 4.83% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000001s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000009s : 58: predicate.switch_simplify 1.55% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.66% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002665 30 74.90% : 0.001996s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.03% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.07% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076896 72 0.05% : 0.000037s : 1: add_recomputation 0.07% : 0.000057s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.41% : 0.000312s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 8.41% : 0.006470s : 1: jit_opt_a 0.19% : 0.000149s : 1: jit_opt_after_cconv 0.07% : 0.000057s : 1: jit_opt_b 0.57% : 0.000440s : 1: loop_unroll 0.67% : 0.000515s : 1: mutable_eliminate 1.16% : 0.000888s : 26: opt.transform.jit_opt_a 0.07% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.64% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000313s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 1.76% : 0.001350s : 1: renormalize.infer 0.88% : 0.000676s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000030s : 1: rewriter_after_opt_a 0.16% : 0.000125s : 1: rewriter_before_opt_a 0.10% : 0.000077s : 1: symbol_engine_optimizer 83.98% : 0.064576s : 1: type_inference TotalTime = 0.0120099, [30] [bootstrap]: 0.00024893 [type_inference]: 0.00455376 [event_method]: 1.706e-05 [auto_monad]: 6.353e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 3.851e-05 [rewriter_before_opt_a]: 7.563e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.0049672, [2] [Cycle 1]: 0.00154327, [27] [switch_simplify]: 5.301e-05 [loop_unroll]: 3.117e-05 [a_1]: 0.00051633 [with_stream_mark]: 1.615e-05 [recompute_prepare]: 7.81001e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 8.28999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 0.00061345 [add_forward_monad_depend]: 4.92e-06 [auto_monad_grad]: 2.16998e-06 [auto_monad_eliminator]: 1.375e-05 [cse]: 2.856e-05 [replace_applicator]: 1.171e-05 [Cycle 2]: 0.00030922, [27] [switch_simplify]: 5.55001e-06 [loop_unroll]: 4.85999e-06 [a_1]: 8.971e-05 [with_stream_mark]: 8.03999e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.58e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 4.69998e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.45e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.159e-05 [j_node_and_user_rematch]: 7.45998e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.28e-06 [inline_without_move]: 4.72e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.54e-06 [cse]: 1.102e-05 [replace_applicator]: 5.26002e-06 [py_interpret_to_execute_after_opt_a]: 1.03e-05 [rewriter_after_opt_a]: 3.251e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.00048282 [jit_opt_b]: 5.706e-05, [1] [Cycle 1]: 5.062e-05, [2] [frontend_op_eliminate]: 1.545e-05 [inline_after_opt_a]: 2.432e-05 [cconv]: 2.497e-05 [loop_unroll]: 0.00043409 [jit_opt_after_cconv]: 0.00013682, [1] [Cycle 1]: 0.00013038, [11] [c_1]: 1.981e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 1.796e-05 [call_graph_tuple_transform]: 1.803e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 7.7e-07 [switch_simplify]: 5.05999e-06 [remove_dup_value]: 1.556e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.76998e-06 [add_recomputation]: 4.707e-05 [cse_after_recomputation]: 2.158e-05, [1] [Cycle 1]: 1.6e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.603e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00045916 [symbol_engine_optimizer]: 7.058e-05, [1] [Cycle 1]: 6.428e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 7.56001e-06 [elim_not_effective]: 1.223e-05 [opt_reshape]: 5.56e-06 [fold_const_symbol]: 8.26002e-06 [renormalize]: 3.19997e-07 [validate]: 3.569e-05 Sums bootstrap : 0.000249s : 2.98% type_inference : 0.004554s : 54.57% event_method : 0.000017s : 0.20% auto_monad : 0.000064s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000039s : 0.46% rewriter_before_opt_a : 0.000076s : 0.91% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.70% jit_opt_a.loop_unroll : 0.000036s : 0.43% jit_opt_a.a_1 : 0.000606s : 7.26% jit_opt_a.with_stream_mark : 0.000024s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000614s : 7.35% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000040s : 0.47% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000033s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000483s : 5.79% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000024s : 0.29% cconv : 0.000025s : 0.30% loop_unroll : 0.000434s : 5.20% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000047s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000459s : 5.50% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.43% Time group info: ------[substitution.] 0.000189 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000005s : 3: substitution.graph_param_transform 83.10% : 0.000157s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004496 2 79.72% : 0.003584s : 1: type_inference.infer 20.28% : 0.000912s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.17% : 0.000046s : 4: replace.inline 32.83% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.27% : 0.000155s : 4: match.inline 6.73% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000006s : 22: predicate.inline 1.04% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.66% : 0.000003s : 16: predicate.switch_defer_inline 2.33% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.61% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000614 13 50.10% : 0.000308s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.83% : 0.000275s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013498 72 0.37% : 0.000050s : 1: add_recomputation 0.49% : 0.000067s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 1.96% : 0.000264s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.82% : 0.004970s : 1: jit_opt_a 1.03% : 0.000139s : 1: jit_opt_after_cconv 0.44% : 0.000060s : 1: jit_opt_b 3.28% : 0.000442s : 1: loop_unroll 3.64% : 0.000491s : 1: mutable_eliminate 6.02% : 0.000812s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.25% : 0.000034s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.47% : 0.000468s : 1: opt_after_jit_grad 0.06% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000042s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.40% : 0.000323s : 1: renormalize.infer 2.09% : 0.000282s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000035s : 1: rewriter_after_opt_a 0.58% : 0.000078s : 1: rewriter_before_opt_a 0.54% : 0.000073s : 1: symbol_engine_optimizer 33.83% : 0.004567s : 1: type_inference TotalTime = 0.0524039, [30] [bootstrap]: 0.00029277 [type_inference]: 0.0430229 [event_method]: 2.195e-05 [auto_monad]: 7.255e-05 [graph_reusing]: 6.86999e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00027131 [rewriter_before_opt_a]: 0.00011393 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00623909, [2] [Cycle 1]: 0.00265487, [27] [switch_simplify]: 6.252e-05 [loop_unroll]: 3.689e-05 [a_1]: 0.00068873 [with_stream_mark]: 1.843e-05 [recompute_prepare]: 9.11998e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.50997e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 2.81e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 1.031e-05 [meta_fg_expand]: 2.78e-06 [replace_old_param]: 1.038e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00148761 [add_forward_monad_depend]: 7.08e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.756e-05 [cse]: 3.724e-05 [replace_applicator]: 1.436e-05 [Cycle 2]: 0.00037396, [27] [switch_simplify]: 7.2e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00012555 [with_stream_mark]: 9.49e-06 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 6.53003e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.25e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 7.07002e-06 [cse]: 1.508e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.517e-05 [rewriter_after_opt_a]: 3.815e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00060466 [jit_opt_b]: 5.555e-05, [1] [Cycle 1]: 4.836e-05, [2] [frontend_op_eliminate]: 1.89e-05 [inline_after_opt_a]: 1.848e-05 [cconv]: 2.547e-05 [loop_unroll]: 0.00043465 [jit_opt_after_cconv]: 0.00015943, [1] [Cycle 1]: 0.00015269, [11] [c_1]: 2.599e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 6.70998e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.552e-05 [call_graph_tuple_transform]: 2.268e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 2.001e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 7.05e-06 [add_recomputation]: 5.089e-05 [cse_after_recomputation]: 2.468e-05, [1] [Cycle 1]: 1.921e-05, [1] [cse]: 1.346e-05 [auto_monad_reorder]: 1.885e-05 [get_jit_bprop_graph]: 2.28998e-06 [rewriter_after_jit_bprop_graph]: 6.84001e-06 [opt_after_jit_grad]: 0.00050806 [symbol_engine_optimizer]: 0.00014194, [1] [Cycle 1]: 0.00013477, [6] [build]: 4.08999e-06 [elim_shapecalc]: 9.34e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 8.03001e-06 [fold_const_symbol]: 7.007e-05 [renormalize]: 3.30008e-07 [validate]: 4.299e-05 Sums bootstrap : 0.000293s : 0.60% type_inference : 0.043023s : 88.53% event_method : 0.000022s : 0.05% auto_monad : 0.000073s : 0.15% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000271s : 0.56% rewriter_before_opt_a : 0.000114s : 0.23% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.14% jit_opt_a.loop_unroll : 0.000043s : 0.09% jit_opt_a.a_1 : 0.000814s : 1.68% jit_opt_a.with_stream_mark : 0.000028s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001488s : 3.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.05% jit_opt_a.cse : 0.000052s : 0.11% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.03% rewriter_after_opt_a : 0.000038s : 0.08% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000605s : 1.24% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000025s : 0.05% loop_unroll : 0.000435s : 0.89% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.04% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000051s : 0.10% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000019s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000508s : 1.05% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000070s : 0.14% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.09% Time group info: ------[substitution.] 0.000301 25 0.69% : 0.000002s : 2: substitution.elim_not_effective 20.36% : 0.000061s : 2: substitution.fold_const_symbol 2.23% : 0.000007s : 4: substitution.graph_param_transform 68.14% : 0.000205s : 5: substitution.inline 1.06% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.58% : 0.000005s : 4: substitution.remove_not_recompute_node 1.50% : 0.000005s : 2: substitution.replace_old_param 4.45% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042943 2 95.31% : 0.040931s : 1: type_inference.infer 4.69% : 0.002013s : 1: type_inference.specialize ------[replace.] 0.000100 7 66.28% : 0.000066s : 5: replace.inline 33.72% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 94.38% : 0.000202s : 5: match.inline 5.62% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 888 1.49% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.25% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.46% : 0.000002s : 13: predicate.print_const_string_wrapper 1.85% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.42% : 0.000010s : 65: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.57% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001714 21 65.31% : 0.001119s : 12: func_graph_cloner_run.FuncGraphClonerGraph 3.45% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.24% : 0.000535s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.055092 72 0.10% : 0.000054s : 1: add_recomputation 0.14% : 0.000076s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.56% : 0.000310s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000026s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 11.33% : 0.006243s : 1: jit_opt_a 0.29% : 0.000162s : 1: jit_opt_after_cconv 0.11% : 0.000058s : 1: jit_opt_b 0.80% : 0.000443s : 1: loop_unroll 1.11% : 0.000614s : 1: mutable_eliminate 1.93% : 0.001066s : 26: opt.transform.jit_opt_a 0.11% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000098s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000277s : 1: py_interpret_to_execute 0.03% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000022s : 1: remove_dup_value 1.68% : 0.000923s : 1: renormalize.infer 1.01% : 0.000556s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000041s : 1: rewriter_after_opt_a 0.22% : 0.000120s : 1: rewriter_before_opt_a 0.26% : 0.000145s : 1: symbol_engine_optimizer 78.12% : 0.043040s : 1: type_inference TotalTime = 0.0626133, [30] [bootstrap]: 0.00031109 [type_inference]: 0.0531201 [event_method]: 1.772e-05 [auto_monad]: 4.907e-05 [graph_reusing]: 3.68999e-06 [pre_auto_parallel]: 1.87001e-06 [py_interpret_to_execute]: 0.00032287 [rewriter_before_opt_a]: 8.045e-05 [expand_dump_flag]: 2.84001e-06 [jit_opt_a]: 0.00658826, [2] [Cycle 1]: 0.00312371, [27] [switch_simplify]: 4.756e-05 [loop_unroll]: 3.121e-05 [a_1]: 0.00078146 [with_stream_mark]: 1.223e-05 [recompute_prepare]: 1.002e-05 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 6.66999e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.204e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.13002e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 6.83998e-06 [renormalize]: 0.00193604 [add_forward_monad_depend]: 4.75001e-06 [auto_monad_grad]: 1.55001e-06 [auto_monad_eliminator]: 1.202e-05 [cse]: 1.898e-05 [replace_applicator]: 1.308e-05 [Cycle 2]: 0.00036548, [27] [switch_simplify]: 7.11999e-06 [loop_unroll]: 6.58e-06 [a_1]: 0.00012585 [with_stream_mark]: 8.75001e-06 [recompute_prepare]: 6.13998e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.78997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.322e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.148e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 8.73001e-06 [rewriter_after_opt_a]: 2.749e-05 [convert_after_rewriter]: 5.91998e-06 [order_py_execute_after_rewriter]: 4.2e-06 [mutable_eliminate]: 0.00053099 [jit_opt_b]: 5.632e-05, [1] [Cycle 1]: 4.947e-05, [2] [frontend_op_eliminate]: 2.01e-05 [inline_after_opt_a]: 1.733e-05 [cconv]: 1.649e-05 [loop_unroll]: 0.00044877 [jit_opt_after_cconv]: 0.00014729, [1] [Cycle 1]: 0.00014077, [11] [c_1]: 2.633e-05 [parameter_eliminate]: 2.51998e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 1.908e-05 [call_graph_tuple_transform]: 1.831e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 7.89994e-07 [renormalize]: 4.09986e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 7.83001e-06 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.60002e-06 [add_recomputation]: 3.134e-05 [cse_after_recomputation]: 2.248e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.104e-05 [auto_monad_reorder]: 1.012e-05 [get_jit_bprop_graph]: 1.43002e-06 [rewriter_after_jit_bprop_graph]: 3.93999e-06 [opt_after_jit_grad]: 0.00047348 [symbol_engine_optimizer]: 9.791e-05, [1] [Cycle 1]: 7.228e-05, [6] [build]: 3.11001e-06 [elim_shapecalc]: 9.16998e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 7.18998e-06 [fold_const_symbol]: 9.95002e-06 [renormalize]: 2.50002e-07 [validate]: 3.324e-05 Sums bootstrap : 0.000311s : 0.53% type_inference : 0.053120s : 90.17% event_method : 0.000018s : 0.03% auto_monad : 0.000049s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000323s : 0.55% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.09% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000907s : 1.54% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001936s : 3.29% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000030s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000027s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000531s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000449s : 0.76% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000031s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000473s : 0.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.06% Time group info: ------[substitution.] 0.000172 24 0.72% : 0.000001s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000004s : 4: substitution.graph_param_transform 84.70% : 0.000146s : 4: substitution.inline 1.73% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000004s : 4: substitution.remove_not_recompute_node 2.16% : 0.000004s : 2: substitution.replace_old_param 5.33% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053046 2 96.47% : 0.051172s : 1: type_inference.infer 3.53% : 0.001874s : 1: type_inference.specialize ------[replace.] 0.000287 6 91.56% : 0.000263s : 4: replace.inline 8.44% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 94.76% : 0.000143s : 4: match.inline 5.24% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.83% : 0.000002s : 12: predicate.addn_zero_filter 2.19% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.14% : 0.000007s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.85% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002219 26 70.85% : 0.001572s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.19% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.97% : 0.000621s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065763 72 0.05% : 0.000034s : 1: add_recomputation 0.08% : 0.000053s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.51% : 0.000332s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.02% : 0.006591s : 1: jit_opt_a 0.23% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.69% : 0.000457s : 1: loop_unroll 0.82% : 0.000540s : 1: mutable_eliminate 1.72% : 0.001133s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000330s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000010s : 1: remove_dup_value 1.94% : 0.001278s : 1: renormalize.infer 0.99% : 0.000650s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000030s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.15% : 0.000101s : 1: symbol_engine_optimizer 80.79% : 0.053132s : 1: type_inference TotalTime = 0.122853, [30] [bootstrap]: 0.00036709 [type_inference]: 0.112579 [event_method]: 2.033e-05 [auto_monad]: 7.215e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.00045449 [rewriter_before_opt_a]: 8.888e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00714065, [2] [Cycle 1]: 0.00358934, [27] [switch_simplify]: 5.279e-05 [loop_unroll]: 3.415e-05 [a_1]: 0.00063355 [with_stream_mark]: 1.395e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 3.02002e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.332e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 6.26e-06 [renormalize]: 0.00253722 [add_forward_monad_depend]: 5.36998e-06 [auto_monad_grad]: 1.55999e-06 [auto_monad_eliminator]: 1.367e-05 [cse]: 2.352e-05 [replace_applicator]: 1.418e-05 [Cycle 2]: 0.0003689, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012742 [with_stream_mark]: 9.72001e-06 [recompute_prepare]: 6.52001e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.08002e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.193e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.54e-06 [inline_without_move]: 5.66003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.302e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 1.003e-05 [rewriter_after_opt_a]: 3.284e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 4.82998e-06 [mutable_eliminate]: 0.000548 [jit_opt_b]: 5.271e-05, [1] [Cycle 1]: 4.655e-05, [2] [frontend_op_eliminate]: 1.813e-05 [inline_after_opt_a]: 1.751e-05 [cconv]: 2.32e-05 [loop_unroll]: 0.00042712 [jit_opt_after_cconv]: 0.00015087, [1] [Cycle 1]: 0.00014492, [11] [c_1]: 2.49e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 5.54998e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.43998e-06 [cse]: 2.244e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.24998e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 5.98998e-06 [remove_dup_value]: 1.507e-05 [partial_unused_args_eliminate]: 1.87001e-06 [environ_conv]: 7.29001e-06 [add_recomputation]: 3.944e-05 [cse_after_recomputation]: 2.353e-05, [1] [Cycle 1]: 1.876e-05, [1] [cse]: 1.256e-05 [auto_monad_reorder]: 1.488e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 5.39998e-06 [opt_after_jit_grad]: 0.00046083 [symbol_engine_optimizer]: 7.386e-05, [1] [Cycle 1]: 6.772e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 8.43999e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 6.01998e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 4.60015e-07 [validate]: 5.16e-05 Sums bootstrap : 0.000367s : 0.31% type_inference : 0.112579s : 94.52% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000454s : 0.38% rewriter_before_opt_a : 0.000089s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000761s : 0.64% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002537s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000548s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000427s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000461s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000218 28 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000005s : 4: substitution.graph_param_transform 82.18% : 0.000179s : 5: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.77% : 0.000010s : 3: substitution.reduce_eliminate 1.85% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000004s : 2: substitution.replace_old_param 4.29% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112509 2 97.44% : 0.109634s : 1: type_inference.infer 2.56% : 0.002875s : 1: type_inference.specialize ------[replace.] 0.000091 7 69.32% : 0.000063s : 5: replace.inline 30.68% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 7 95.61% : 0.000177s : 5: match.inline 4.39% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.55% : 0.000002s : 13: predicate.addn_zero_filter 2.15% : 0.000003s : 13: predicate.arithmetic_simplify 1.59% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.40% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000007s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 19: predicate.load_eliminater 1.05% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.34% : 0.000002s : 13: predicate.print_const_string_wrapper 2.59% : 0.000004s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.52% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.72% : 0.000004s : 20: predicate.switch_defer_inline 2.27% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.78% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002246 25 63.70% : 0.001430s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.84% : 0.000760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126443 72 0.03% : 0.000042s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.30% : 0.000385s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.65% : 0.007144s : 1: jit_opt_a 0.12% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.34% : 0.000434s : 1: loop_unroll 0.44% : 0.000556s : 1: mutable_eliminate 0.78% : 0.000992s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000461s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.42% : 0.001790s : 1: renormalize.infer 0.59% : 0.000740s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 89.05% : 0.112592s : 1: type_inference TotalTime = 0.0141654, [30] [bootstrap]: 0.00027012 [type_inference]: 0.00479567 [event_method]: 1.766e-05 [auto_monad]: 6.712e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.075e-05 [rewriter_before_opt_a]: 7.458e-05 [expand_dump_flag]: 3.35998e-06 [jit_opt_a]: 0.00666599, [2] [Cycle 1]: 0.00166603, [27] [switch_simplify]: 5.578e-05 [loop_unroll]: 3.134e-05 [a_1]: 0.00054495 [with_stream_mark]: 1.567e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 3.99997e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 9.15001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 8.70999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00068107 [add_forward_monad_depend]: 5.50001e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.571e-05 [cse]: 2.92e-05 [replace_applicator]: 1.255e-05 [Cycle 2]: 0.00033262, [27] [switch_simplify]: 5.64998e-06 [loop_unroll]: 5.00999e-06 [a_1]: 9.494e-05 [with_stream_mark]: 9.18002e-06 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.06003e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 4.93001e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.45002e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 8.1e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.31999e-06 [inline_without_move]: 4.92999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.62001e-06 [cse]: 1.192e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.163e-05 [rewriter_after_opt_a]: 3.621e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00055541 [jit_opt_b]: 5.377e-05, [1] [Cycle 1]: 4.665e-05, [2] [frontend_op_eliminate]: 1.822e-05 [inline_after_opt_a]: 1.575e-05 [cconv]: 2.573e-05 [loop_unroll]: 0.00045499 [jit_opt_after_cconv]: 0.00014615, [1] [Cycle 1]: 0.00013949, [11] [c_1]: 2.169e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.96998e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 2.017e-05 [call_graph_tuple_transform]: 1.896e-05 [tuple_list_get_item_eliminator]: 5.55001e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 1.443e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 5.82001e-06 [add_recomputation]: 4.759e-05 [cse_after_recomputation]: 4.045e-05, [1] [Cycle 1]: 1.721e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 4.83001e-06 [opt_after_jit_grad]: 0.0005097 [symbol_engine_optimizer]: 7.537e-05, [1] [Cycle 1]: 6.945e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.342e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 3.49974e-07 [validate]: 3.537e-05 Sums bootstrap : 0.000270s : 3.04% type_inference : 0.004796s : 53.97% event_method : 0.000018s : 0.20% auto_monad : 0.000067s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000041s : 0.46% rewriter_before_opt_a : 0.000075s : 0.84% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000061s : 0.69% jit_opt_a.loop_unroll : 0.000036s : 0.41% jit_opt_a.a_1 : 0.000640s : 7.20% jit_opt_a.with_stream_mark : 0.000025s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000681s : 7.67% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000041s : 0.46% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000036s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000555s : 6.25% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.21% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000026s : 0.29% loop_unroll : 0.000455s : 5.12% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.54% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000018s : 0.21% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000510s : 5.74% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.40% Time group info: ------[substitution.] 0.000196 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000005s : 3: substitution.graph_param_transform 82.97% : 0.000162s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004733 2 77.48% : 0.003667s : 1: type_inference.infer 22.52% : 0.001066s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.87% : 0.000048s : 4: replace.inline 34.13% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.31% : 0.000159s : 4: match.inline 6.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.49% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.08% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.19% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 2.01% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.77% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.78% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000643 13 50.92% : 0.000328s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.63% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.45% : 0.000286s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015762 72 0.32% : 0.000050s : 1: add_recomputation 0.45% : 0.000070s : 1: auto_monad 0.13% : 0.000021s : 1: auto_monad_reorder 1.84% : 0.000289s : 1: bootstrap 0.18% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.27% : 0.000043s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 42.31% : 0.006670s : 1: jit_opt_a 0.95% : 0.000149s : 1: jit_opt_after_cconv 0.36% : 0.000056s : 1: jit_opt_b 2.93% : 0.000462s : 1: loop_unroll 3.58% : 0.000564s : 1: mutable_eliminate 5.42% : 0.000854s : 26: opt.transform.jit_opt_a 0.31% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.29% : 0.000518s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000044s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 2.18% : 0.000344s : 1: renormalize.infer 2.09% : 0.000330s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.49% : 0.000077s : 1: rewriter_before_opt_a 0.49% : 0.000078s : 1: symbol_engine_optimizer 30.51% : 0.004809s : 1: type_inference TotalTime = 0.0169954, [30] [bootstrap]: 0.00112154 [type_inference]: 0.00792528 [event_method]: 1.967e-05 [auto_monad]: 6.669e-05 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 3.21001e-06 [py_interpret_to_execute]: 4.369e-05 [rewriter_before_opt_a]: 7.956e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00487642, [2] [Cycle 1]: 0.00163677, [27] [switch_simplify]: 5.153e-05 [loop_unroll]: 3.41e-05 [a_1]: 0.0005948 [with_stream_mark]: 1.47e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.98998e-06 [meta_shard_fg_expand]: 1.68002e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 8.70001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.302e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 7.81001e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00063567 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 1.83997e-06 [auto_monad_eliminator]: 1.37e-05 [cse]: 2.574e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00032005, [27] [switch_simplify]: 5.99999e-06 [loop_unroll]: 5.04998e-06 [a_1]: 8.974e-05 [with_stream_mark]: 8.28001e-06 [recompute_prepare]: 5.19e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 8.99978e-07 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.199e-05 [j_node_and_user_rematch]: 7.93001e-06 [meta_fg_expand]: 1.81998e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.459e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 1.122e-05 [rewriter_after_opt_a]: 3.056e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00045849 [jit_opt_b]: 4.902e-05, [1] [Cycle 1]: 4.229e-05, [2] [frontend_op_eliminate]: 1.531e-05 [inline_after_opt_a]: 1.556e-05 [cconv]: 2.224e-05 [loop_unroll]: 0.00125538 [jit_opt_after_cconv]: 0.00014698, [1] [Cycle 1]: 0.00014048, [11] [c_1]: 2.082e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 6.04999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.556e-05 [call_graph_tuple_transform]: 1.823e-05 [tuple_list_get_item_eliminator]: 5.76e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 3.109e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 4.97999e-06 [add_recomputation]: 4.326e-05 [cse_after_recomputation]: 2.461e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.659e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 1.584e-05 [opt_after_jit_grad]: 0.00045705 [symbol_engine_optimizer]: 7.316e-05, [1] [Cycle 1]: 6.711e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 8.02998e-06 [elim_not_effective]: 1.278e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 9.05001e-06 [renormalize]: 6.89994e-07 [validate]: 3.504e-05 Sums bootstrap : 0.001122s : 8.29% type_inference : 0.007925s : 58.58% event_method : 0.000020s : 0.15% auto_monad : 0.000067s : 0.49% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.32% rewriter_before_opt_a : 0.000080s : 0.59% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.43% jit_opt_a.loop_unroll : 0.000039s : 0.29% jit_opt_a.a_1 : 0.000685s : 5.06% jit_opt_a.with_stream_mark : 0.000023s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000636s : 4.70% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.14% jit_opt_a.cse : 0.000040s : 0.30% jit_opt_a.replace_applicator : 0.000017s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.08% rewriter_after_opt_a : 0.000031s : 0.23% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000458s : 3.39% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000022s : 0.16% loop_unroll : 0.001255s : 9.28% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000031s : 0.23% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000043s : 0.32% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000017s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000016s : 0.12% opt_after_jit_grad : 0.000457s : 3.38% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000035s : 0.26% Time group info: ------[substitution.] 0.000208 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000005s : 3: substitution.graph_param_transform 85.52% : 0.000178s : 5: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.79% : 0.000004s : 4: substitution.remove_not_recompute_node 1.52% : 0.000003s : 2: substitution.replace_old_param 5.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007865 2 88.53% : 0.006964s : 1: type_inference.infer 11.47% : 0.000902s : 1: type_inference.specialize ------[replace.] 0.000087 7 66.90% : 0.000058s : 5: replace.inline 33.10% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 7 94.04% : 0.000175s : 5: match.inline 5.96% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.22% : 0.000001s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.19% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.31% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.99% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 16: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.49% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.22% : 0.000001s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 16: predicate.partial_eliminate 1.29% : 0.000002s : 11: predicate.print_const_string_wrapper 1.72% : 0.000002s : 11: predicate.reduce_eliminate 1.51% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.56% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.91% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000735 16 52.85% : 0.000388s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.57% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.58% : 0.000291s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018591 72 0.25% : 0.000046s : 1: add_recomputation 0.38% : 0.000070s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 6.11% : 0.001135s : 1: bootstrap 0.13% : 0.000025s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 26.24% : 0.004879s : 1: jit_opt_a 0.81% : 0.000150s : 1: jit_opt_after_cconv 0.28% : 0.000052s : 1: jit_opt_b 6.81% : 0.001265s : 1: loop_unroll 2.51% : 0.000466s : 1: mutable_eliminate 4.83% : 0.000897s : 26: opt.transform.jit_opt_a 0.25% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.50% : 0.000465s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000047s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000034s : 1: remove_dup_value 1.89% : 0.000352s : 1: renormalize.infer 1.49% : 0.000276s : 1: renormalize.specialize 0.10% : 0.000018s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000034s : 1: rewriter_after_opt_a 0.44% : 0.000083s : 1: rewriter_before_opt_a 0.41% : 0.000076s : 1: symbol_engine_optimizer 42.69% : 0.007937s : 1: type_inference TotalTime = 0.0163063, [30] [bootstrap]: 0.00027928 [type_inference]: 0.00498624 [event_method]: 4.441e-05 [auto_monad]: 8.591e-05 [graph_reusing]: 6.25997e-06 [pre_auto_parallel]: 3.68999e-06 [py_interpret_to_execute]: 7.613e-05 [rewriter_before_opt_a]: 0.00010977 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.0076403, [2] [Cycle 1]: 0.00391754, [27] [switch_simplify]: 5.657e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00262135 [with_stream_mark]: 2.085e-05 [recompute_prepare]: 1.058e-05 [updatestate_depend_eliminate]: 4.78001e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 4.26001e-06 [cell_reuse_recompute_pass]: 2.06998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.711e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.201e-05 [replace_old_param]: 9.79e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00079324 [add_forward_monad_depend]: 6.26e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.52e-05 [cse]: 2.945e-05 [replace_applicator]: 1.335e-05 [Cycle 2]: 0.00033505, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 5.20999e-06 [a_1]: 9.769e-05 [with_stream_mark]: 1.01e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.50001e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.78003e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.264e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 8.28001e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.26e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 1.001e-05 [rewriter_after_opt_a]: 3.537e-05 [convert_after_rewriter]: 7.82998e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00061715 [jit_opt_b]: 5.515e-05, [1] [Cycle 1]: 4.685e-05, [2] [frontend_op_eliminate]: 1.691e-05 [inline_after_opt_a]: 1.798e-05 [cconv]: 2.792e-05 [loop_unroll]: 0.00045031 [jit_opt_after_cconv]: 0.00016238, [1] [Cycle 1]: 0.00013354, [11] [c_1]: 2.152e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 6.04001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.95e-05 [call_graph_tuple_transform]: 1.856e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.559e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 5.86998e-06 [add_recomputation]: 5.295e-05 [cse_after_recomputation]: 2.631e-05, [1] [Cycle 1]: 1.935e-05, [1] [cse]: 1.28e-05 [auto_monad_reorder]: 1.672e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 5.94999e-06 [opt_after_jit_grad]: 0.00049698 [symbol_engine_optimizer]: 7.867e-05, [1] [Cycle 1]: 7.196e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 9.08002e-06 [elim_not_effective]: 1.441e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 3.19997e-07 [validate]: 3.592e-05 Sums bootstrap : 0.000279s : 2.43% type_inference : 0.004986s : 43.38% event_method : 0.000044s : 0.39% auto_monad : 0.000086s : 0.75% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000004s : 0.03% py_interpret_to_execute : 0.000076s : 0.66% rewriter_before_opt_a : 0.000110s : 0.96% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.54% jit_opt_a.loop_unroll : 0.000036s : 0.31% jit_opt_a.a_1 : 0.002719s : 23.66% jit_opt_a.with_stream_mark : 0.000031s : 0.27% jit_opt_a.recompute_prepare : 0.000016s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.26% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000024s : 0.21% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000793s : 6.90% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.19% jit_opt_a.cse : 0.000042s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.16% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000035s : 0.31% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000617s : 5.37% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.16% cconv : 0.000028s : 0.24% loop_unroll : 0.000450s : 3.92% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000053s : 0.46% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000497s : 4.32% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.31% Time group info: ------[substitution.] 0.000199 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 3: substitution.graph_param_transform 81.32% : 0.000162s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000004s : 2: substitution.replace_old_param 7.83% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004922 2 79.42% : 0.003909s : 1: type_inference.infer 20.58% : 0.001013s : 1: type_inference.specialize ------[replace.] 0.002141 6 2.17% : 0.000047s : 4: replace.inline 97.83% : 0.002094s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 91.80% : 0.000159s : 4: match.inline 8.20% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 691 1.26% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.42% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.07% : 0.000006s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.14% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.98% : 0.000002s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.36% : 0.000002s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.88% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.75% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000010s : 53: predicate.switch_simplify 1.50% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000732 13 51.39% : 0.000376s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.92% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.69% : 0.000327s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020101 72 0.28% : 0.000056s : 1: add_recomputation 0.45% : 0.000090s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.48% : 0.000298s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.26% : 0.000052s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 38.03% : 0.007643s : 1: jit_opt_a 0.82% : 0.000165s : 1: jit_opt_after_cconv 0.29% : 0.000059s : 1: jit_opt_b 2.28% : 0.000459s : 1: loop_unroll 3.11% : 0.000626s : 1: mutable_eliminate 14.63% : 0.002940s : 26: opt.transform.jit_opt_a 0.24% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000028s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.52% : 0.000506s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000006s : 1: pre_auto_parallel 0.39% : 0.000079s : 1: py_interpret_to_execute 0.06% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 1.93% : 0.000388s : 1: renormalize.infer 1.97% : 0.000397s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000039s : 1: rewriter_after_opt_a 0.56% : 0.000113s : 1: rewriter_before_opt_a 0.40% : 0.000081s : 1: symbol_engine_optimizer 28.75% : 0.005780s : 1: type_inference TotalTime = 0.131203, [30] [bootstrap]: 0.00030039 [type_inference]: 0.120153 [event_method]: 2.252e-05 [auto_monad]: 7.219e-05 [graph_reusing]: 6.53998e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00053575 [rewriter_before_opt_a]: 9.848e-05 [expand_dump_flag]: 3.75998e-06 [jit_opt_a]: 0.00761956, [2] [Cycle 1]: 0.00380075, [27] [switch_simplify]: 6.044e-05 [loop_unroll]: 3.266e-05 [a_1]: 0.00068747 [with_stream_mark]: 1.853e-05 [recompute_prepare]: 9.34998e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 9.72999e-06 [meta_fg_expand]: 3.32002e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 6.69999e-06 [renormalize]: 0.00263036 [add_forward_monad_depend]: 7.13e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.658e-05 [cse]: 4.426e-05 [replace_applicator]: 1.734e-05 [Cycle 2]: 0.00038238, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 6.44999e-06 [a_1]: 0.00013326 [with_stream_mark]: 1.143e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.13002e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 2.51e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.285e-05 [j_node_and_user_rematch]: 9.28002e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.36998e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.82002e-06 [cse]: 1.396e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.356e-05 [rewriter_after_opt_a]: 3.824e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00062188 [jit_opt_b]: 6.05e-05, [1] [Cycle 1]: 5.178e-05, [2] [frontend_op_eliminate]: 2.137e-05 [inline_after_opt_a]: 1.869e-05 [cconv]: 2.78e-05 [loop_unroll]: 0.00044528 [jit_opt_after_cconv]: 0.00015552, [1] [Cycle 1]: 0.00014703, [11] [c_1]: 2.623e-05 [parameter_eliminate]: 2.22001e-06 [updatestate_depend_eliminate]: 6.93e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.151e-05 [call_graph_tuple_transform]: 2.21e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.791e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 7.93001e-06 [add_recomputation]: 4.877e-05 [cse_after_recomputation]: 2.356e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.855e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.0004799 [symbol_engine_optimizer]: 8.824e-05, [1] [Cycle 1]: 7.97e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 8.85001e-06 [elim_not_effective]: 2.151e-05 [opt_reshape]: 8.1e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 3.89991e-07 [validate]: 0.00014407 Sums bootstrap : 0.000300s : 0.24% type_inference : 0.120153s : 94.48% event_method : 0.000023s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000536s : 0.42% rewriter_before_opt_a : 0.000098s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000821s : 0.65% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002630s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000622s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000445s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000144s : 0.11% Time group info: ------[substitution.] 0.000262 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 4: substitution.graph_param_transform 82.12% : 0.000216s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.83% : 0.000013s : 3: substitution.reduce_eliminate 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.31% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120068 2 97.57% : 0.117146s : 1: type_inference.infer 2.43% : 0.002922s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.71% : 0.000070s : 5: replace.inline 31.29% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 95.47% : 0.000212s : 5: match.inline 4.53% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 2.28% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.47% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.56% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.71% : 0.000008s : 28: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.66% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 1.89% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.62% : 0.000011s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002310 25 62.90% : 0.001453s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.66% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.43% : 0.000795s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134877 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000313s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.65% : 0.007623s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.34% : 0.000453s : 1: loop_unroll 0.47% : 0.000631s : 1: mutable_eliminate 0.79% : 0.001062s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000542s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.34% : 0.001814s : 1: renormalize.infer 0.60% : 0.000807s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.07% : 0.000091s : 1: symbol_engine_optimizer 89.10% : 0.120170s : 1: type_inference TotalTime = 0.122709, [30] [bootstrap]: 0.00026334 [type_inference]: 0.111723 [event_method]: 1.863e-05 [auto_monad]: 6.841e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00040512 [rewriter_before_opt_a]: 8.082e-05 [expand_dump_flag]: 3.28998e-06 [jit_opt_a]: 0.00748481, [2] [Cycle 1]: 0.00352772, [27] [switch_simplify]: 5.538e-05 [loop_unroll]: 3.184e-05 [a_1]: 0.00059607 [with_stream_mark]: 1.793e-05 [recompute_prepare]: 9.15001e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 7.01999e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 6.52001e-06 [merge_forward]: 4.19002e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.056e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.00248532 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.702e-05 [cse]: 2.195e-05 [replace_applicator]: 1.637e-05 [Cycle 2]: 0.00037308, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00012481 [with_stream_mark]: 1.199e-05 [recompute_prepare]: 6.02999e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.50998e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.09998e-06 [inline_without_move]: 5.81e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.63998e-06 [cse]: 1.138e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.53e-05 [convert_after_rewriter]: 6.90002e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00062511 [jit_opt_b]: 5.641e-05, [1] [Cycle 1]: 4.922e-05, [2] [frontend_op_eliminate]: 1.936e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.889e-05 [loop_unroll]: 0.0004366 [jit_opt_after_cconv]: 0.00015456, [1] [Cycle 1]: 0.00014648, [11] [c_1]: 2.658e-05 [parameter_eliminate]: 3.12002e-06 [updatestate_depend_eliminate]: 5.34998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.18e-05 [call_graph_tuple_transform]: 2.114e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.674e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 8.92999e-06 [add_recomputation]: 4.618e-05 [cse_after_recomputation]: 2.174e-05, [1] [Cycle 1]: 1.652e-05, [1] [cse]: 1.079e-05 [auto_monad_reorder]: 7.698e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00080915 [symbol_engine_optimizer]: 8.209e-05, [1] [Cycle 1]: 7.536e-05, [6] [build]: 3.99002e-06 [elim_shapecalc]: 9.92001e-06 [elim_not_effective]: 1.507e-05 [opt_reshape]: 7.34002e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 6.09987e-07 [validate]: 4.392e-05 Sums bootstrap : 0.000263s : 0.22% type_inference : 0.111723s : 94.25% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000405s : 0.34% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000721s : 0.61% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002485s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000625s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000437s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000077s : 0.06% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000809s : 0.68% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000225 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 4: substitution.graph_param_transform 83.65% : 0.000188s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000005s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111658 2 97.75% : 0.109144s : 1: type_inference.infer 2.25% : 0.002514s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.74% : 0.000051s : 4: replace.inline 32.26% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.11% : 0.000186s : 4: match.inline 5.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.49% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 2.05% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.11% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 5.78% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.79% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.23% : 0.000002s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001986 22 65.04% : 0.001291s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.17% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.79% : 0.000651s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126233 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.06% : 0.000080s : 1: auto_monad_reorder 0.22% : 0.000275s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.93% : 0.007488s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.35% : 0.000445s : 1: loop_unroll 0.50% : 0.000635s : 1: mutable_eliminate 0.76% : 0.000962s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000820s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000411s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.40% : 0.001762s : 1: renormalize.infer 0.57% : 0.000714s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 88.52% : 0.111736s : 1: type_inference TotalTime = 0.0194599, [30] [bootstrap]: 0.00029161 [type_inference]: 0.0110896 [event_method]: 2.142e-05 [auto_monad]: 6.947e-05 [graph_reusing]: 6.94001e-06 [pre_auto_parallel]: 2.99001e-06 [py_interpret_to_execute]: 8.012e-05 [rewriter_before_opt_a]: 0.000125 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00565161, [2] [Cycle 1]: 0.00196507, [27] [switch_simplify]: 5.983e-05 [loop_unroll]: 3.394e-05 [a_1]: 0.00064282 [with_stream_mark]: 1.831e-05 [recompute_prepare]: 7.96001e-06 [updatestate_depend_eliminate]: 4.49998e-06 [updatestate_assign_eliminate]: 3.9e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.76003e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.24002e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00086489 [add_forward_monad_depend]: 5.52001e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.72e-05 [cse]: 4.005e-05 [replace_applicator]: 1.369e-05 [Cycle 2]: 0.00032564, [27] [switch_simplify]: 6.40997e-06 [loop_unroll]: 5.05999e-06 [a_1]: 8.983e-05 [with_stream_mark]: 1.023e-05 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 4.85999e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.97002e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 7.21999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 7.09001e-06 [cse]: 1.423e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.298e-05 [rewriter_after_opt_a]: 3.813e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 6.01e-06 [mutable_eliminate]: 0.0005419 [jit_opt_b]: 4.967e-05, [1] [Cycle 1]: 4.334e-05, [2] [frontend_op_eliminate]: 1.641e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.692e-05 [loop_unroll]: 0.00040851 [jit_opt_after_cconv]: 0.00014585, [1] [Cycle 1]: 0.00013992, [11] [c_1]: 2.129e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 2.366e-05 [call_graph_tuple_transform]: 1.799e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 3.32e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 5.63997e-06 [add_recomputation]: 5.118e-05 [cse_after_recomputation]: 2.375e-05, [1] [Cycle 1]: 1.813e-05, [1] [cse]: 1.22e-05 [auto_monad_reorder]: 1.846e-05 [get_jit_bprop_graph]: 2.03997e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00045015 [symbol_engine_optimizer]: 7.239e-05, [1] [Cycle 1]: 6.632e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.259e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.85999e-06 [renormalize]: 6.19999e-07 [validate]: 5.208e-05 Sums bootstrap : 0.000292s : 1.88% type_inference : 0.011090s : 71.39% event_method : 0.000021s : 0.14% auto_monad : 0.000069s : 0.45% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000080s : 0.52% rewriter_before_opt_a : 0.000125s : 0.80% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.43% jit_opt_a.loop_unroll : 0.000039s : 0.25% jit_opt_a.a_1 : 0.000733s : 4.72% jit_opt_a.with_stream_mark : 0.000029s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000865s : 5.57% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000054s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.12% py_interpret_to_execute_after_opt_a : 0.000013s : 0.08% rewriter_after_opt_a : 0.000038s : 0.25% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000542s : 3.49% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.10% cconv : 0.000027s : 0.17% loop_unroll : 0.000409s : 2.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000033s : 0.21% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000051s : 0.33% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000450s : 2.90% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.34% Time group info: ------[substitution.] 0.000238 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 3: substitution.graph_param_transform 86.47% : 0.000206s : 5: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 1.36% : 0.000003s : 2: substitution.replace_old_param 5.28% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011018 2 88.50% : 0.009751s : 1: type_inference.infer 11.50% : 0.001268s : 1: type_inference.specialize ------[replace.] 0.000100 7 68.54% : 0.000069s : 5: replace.inline 31.46% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 94.68% : 0.000203s : 5: match.inline 5.32% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.23% : 0.000002s : 11: predicate.addn_zero_filter 1.96% : 0.000002s : 11: predicate.arithmetic_simplify 1.41% : 0.000002s : 11: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 11: predicate.compare_switch_simplify 1.35% : 0.000002s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.35% : 0.000002s : 11: predicate.environ_get_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.88% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 16: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 11: predicate.merge_addn 1.19% : 0.000001s : 11: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000001s : 11: predicate.print_const_string_wrapper 1.81% : 0.000002s : 11: predicate.reduce_eliminate 1.59% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 11: predicate.reshape_eliminate 1.25% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.74% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.85% : 0.000010s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000001s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001789 16 74.38% : 0.001331s : 7: func_graph_cloner_run.FuncGraphClonerGraph 3.41% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 22.21% : 0.000397s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021325 72 0.25% : 0.000054s : 1: add_recomputation 0.34% : 0.000073s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.42% : 0.000304s : 1: bootstrap 0.14% : 0.000030s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.12% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 26.52% : 0.005655s : 1: jit_opt_a 0.70% : 0.000148s : 1: jit_opt_after_cconv 0.25% : 0.000052s : 1: jit_opt_b 1.95% : 0.000417s : 1: loop_unroll 2.58% : 0.000551s : 1: mutable_eliminate 4.49% : 0.000956s : 26: opt.transform.jit_opt_a 0.22% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.15% : 0.000458s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000084s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000036s : 1: remove_dup_value 2.18% : 0.000466s : 1: renormalize.infer 1.83% : 0.000391s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000041s : 1: rewriter_after_opt_a 0.60% : 0.000128s : 1: rewriter_before_opt_a 0.35% : 0.000075s : 1: symbol_engine_optimizer 52.07% : 0.011105s : 1: type_inference TotalTime = 0.122117, [30] [bootstrap]: 0.00030702 [type_inference]: 0.111136 [event_method]: 2.156e-05 [auto_monad]: 7.227e-05 [graph_reusing]: 6.33998e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00050861 [rewriter_before_opt_a]: 0.00014915 [expand_dump_flag]: 4.05e-06 [jit_opt_a]: 0.00756448, [2] [Cycle 1]: 0.00379079, [27] [switch_simplify]: 5.338e-05 [loop_unroll]: 3.424e-05 [a_1]: 0.00065496 [with_stream_mark]: 1.607e-05 [recompute_prepare]: 8.82999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.95002e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.81003e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.404e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 9.72001e-06 [inline_without_move]: 6.52001e-06 [renormalize]: 0.00268508 [add_forward_monad_depend]: 6.58e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.56e-05 [cse]: 3.571e-05 [replace_applicator]: 1.536e-05 [Cycle 2]: 0.00037496, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012876 [with_stream_mark]: 1.075e-05 [recompute_prepare]: 6.24001e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.256e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.47998e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.38998e-06 [cse]: 1.346e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.529e-05 [rewriter_after_opt_a]: 3.716e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00067237 [jit_opt_b]: 5.58e-05, [1] [Cycle 1]: 4.779e-05, [2] [frontend_op_eliminate]: 1.858e-05 [inline_after_opt_a]: 1.774e-05 [cconv]: 2.415e-05 [loop_unroll]: 0.00042612 [jit_opt_after_cconv]: 0.00015367, [1] [Cycle 1]: 0.00014728, [11] [c_1]: 2.547e-05 [parameter_eliminate]: 2.53998e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.94001e-06 [cse]: 2.437e-05 [call_graph_tuple_transform]: 2.015e-05 [tuple_list_get_item_eliminator]: 6.23e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.583e-05 [partial_unused_args_eliminate]: 1.98002e-06 [environ_conv]: 7.56001e-06 [add_recomputation]: 4.817e-05 [cse_after_recomputation]: 2.421e-05, [1] [Cycle 1]: 1.832e-05, [1] [cse]: 1.258e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 5.66e-06 [opt_after_jit_grad]: 0.00047755 [symbol_engine_optimizer]: 7.415e-05, [1] [Cycle 1]: 6.814e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 7.98001e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 6.16998e-06 [fold_const_symbol]: 9.30001e-06 [renormalize]: 4.09986e-07 [validate]: 4.78e-05 Sums bootstrap : 0.000307s : 0.26% type_inference : 0.111136s : 94.11% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000509s : 0.43% rewriter_before_opt_a : 0.000149s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000784s : 0.66% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002685s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000672s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000426s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000478s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000233 28 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.38% : 0.000006s : 4: substitution.graph_param_transform 81.34% : 0.000189s : 5: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.95% : 0.000012s : 3: substitution.reduce_eliminate 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 1.58% : 0.000004s : 2: substitution.replace_old_param 4.68% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111057 2 97.29% : 0.108043s : 1: type_inference.infer 2.71% : 0.003015s : 1: type_inference.specialize ------[replace.] 0.000090 7 68.38% : 0.000061s : 5: replace.inline 31.62% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 7 95.23% : 0.000186s : 5: match.inline 4.77% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.39% : 0.000008s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 19: predicate.load_eliminater 1.47% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000003s : 13: predicate.reduce_eliminate 1.61% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002250 25 63.74% : 0.001434s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.63% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.63% : 0.000757s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125838 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000322s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.01% : 0.007568s : 1: jit_opt_a 0.12% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000434s : 1: loop_unroll 0.54% : 0.000683s : 1: mutable_eliminate 0.81% : 0.001019s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000515s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.52% : 0.001909s : 1: renormalize.infer 0.61% : 0.000766s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.12% : 0.000156s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 88.33% : 0.111153s : 1: type_inference TotalTime = 0.0152117, [30] [bootstrap]: 0.00025911 [type_inference]: 0.00726857 [event_method]: 2.106e-05 [auto_monad]: 6.918e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 4.312e-05 [rewriter_before_opt_a]: 8.196e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00543383, [2] [Cycle 1]: 0.00174315, [27] [switch_simplify]: 5.791e-05 [loop_unroll]: 3.289e-05 [a_1]: 0.00060175 [with_stream_mark]: 1.638e-05 [recompute_prepare]: 7.68999e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.44001e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 2.11003e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.493e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 0.00070973 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 2.05002e-06 [auto_monad_eliminator]: 1.282e-05 [cse]: 3.3e-05 [replace_applicator]: 1.134e-05 [Cycle 2]: 0.00032224, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 4.72e-06 [a_1]: 9.654e-05 [with_stream_mark]: 8.79e-06 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 8.2e-07 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 5.00999e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.005e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 6.86999e-06 [inline_without_move]: 4.65999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.06997e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.226e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 9.44998e-06 [rewriter_after_opt_a]: 3.367e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00051431 [jit_opt_b]: 4.955e-05, [1] [Cycle 1]: 4.261e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.309e-05 [loop_unroll]: 0.00041036 [jit_opt_after_cconv]: 0.00014992, [1] [Cycle 1]: 0.00014375, [11] [c_1]: 2.122e-05 [parameter_eliminate]: 1.72999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.123e-05 [call_graph_tuple_transform]: 1.875e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.27999e-06 [remove_dup_value]: 1.57e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 5.60001e-06 [add_recomputation]: 4.69e-05 [cse_after_recomputation]: 2.37e-05, [1] [Cycle 1]: 1.784e-05, [1] [cse]: 1.238e-05 [auto_monad_reorder]: 1.709e-05 [get_jit_bprop_graph]: 1.44e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00044517 [symbol_engine_optimizer]: 7.196e-05, [1] [Cycle 1]: 6.563e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.288e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.33001e-06 [renormalize]: 4.39992e-07 [validate]: 3.427e-05 Sums bootstrap : 0.000259s : 2.30% type_inference : 0.007269s : 64.42% event_method : 0.000021s : 0.19% auto_monad : 0.000069s : 0.61% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000043s : 0.38% rewriter_before_opt_a : 0.000082s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.56% jit_opt_a.loop_unroll : 0.000038s : 0.33% jit_opt_a.a_1 : 0.000698s : 6.19% jit_opt_a.with_stream_mark : 0.000025s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000710s : 6.29% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.16% jit_opt_a.cse : 0.000045s : 0.40% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000034s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000514s : 4.56% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000023s : 0.20% loop_unroll : 0.000410s : 3.64% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000047s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000445s : 3.95% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.30% Time group info: ------[substitution.] 0.000219 27 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000006s : 3: substitution.graph_param_transform 81.60% : 0.000179s : 5: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.40% : 0.000010s : 3: substitution.reduce_eliminate 2.16% : 0.000005s : 4: substitution.remove_not_recompute_node 1.75% : 0.000004s : 2: substitution.replace_old_param 4.62% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007205 2 86.82% : 0.006255s : 1: type_inference.infer 13.18% : 0.000950s : 1: type_inference.specialize ------[replace.] 0.000088 7 66.65% : 0.000059s : 5: replace.inline 33.35% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 7 95.15% : 0.000176s : 5: match.inline 4.85% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.21% : 0.000002s : 11: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 11: predicate.addn_check_dump 1.57% : 0.000002s : 11: predicate.addn_zero_filter 1.80% : 0.000002s : 11: predicate.arithmetic_simplify 1.66% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000001s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.74% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 16: predicate.load_eliminater 1.08% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.21% : 0.000002s : 11: predicate.minmaximum_grad 1.23% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.33% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000002s : 11: predicate.print_const_string_wrapper 2.13% : 0.000003s : 11: predicate.reduce_eliminate 2.08% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 11: predicate.reshape_eliminate 1.59% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.45% : 0.000002s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 59: predicate.switch_simplify 1.41% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000710 16 48.42% : 0.000344s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.55% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.04% : 0.000313s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016897 72 0.29% : 0.000050s : 1: add_recomputation 0.43% : 0.000072s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.59% : 0.000269s : 1: bootstrap 0.15% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 32.18% : 0.005437s : 1: jit_opt_a 0.90% : 0.000153s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.46% : 0.000416s : 1: loop_unroll 3.09% : 0.000522s : 1: mutable_eliminate 5.41% : 0.000913s : 26: opt.transform.jit_opt_a 0.28% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000012s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.68% : 0.000452s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000046s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.40% : 0.000406s : 1: renormalize.infer 1.76% : 0.000297s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000037s : 1: rewriter_after_opt_a 0.50% : 0.000085s : 1: rewriter_before_opt_a 0.44% : 0.000074s : 1: symbol_engine_optimizer 43.10% : 0.007283s : 1: type_inference TotalTime = 0.127388, [30] [bootstrap]: 0.00029266 [type_inference]: 0.115423 [event_method]: 2.044e-05 [auto_monad]: 7.268e-05 [graph_reusing]: 5.84999e-06 [pre_auto_parallel]: 2.91e-06 [py_interpret_to_execute]: 0.00050084 [rewriter_before_opt_a]: 8.785e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00829637, [2] [Cycle 1]: 0.00434478, [27] [switch_simplify]: 6.036e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.00061103 [with_stream_mark]: 1.86e-05 [recompute_prepare]: 9.34e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.40998e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 6.80002e-06 [meta_shard_fg_expand]: 2.82002e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.99999e-06 [replace_old_param]: 9.65002e-06 [inline_without_move]: 6.29001e-06 [renormalize]: 0.00323077 [add_forward_monad_depend]: 8.84998e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.918e-05 [cse]: 3.521e-05 [replace_applicator]: 2.433e-05 [Cycle 2]: 0.00043914, [27] [switch_simplify]: 8.43001e-06 [loop_unroll]: 7.51001e-06 [a_1]: 0.0001473 [with_stream_mark]: 1.485e-05 [recompute_prepare]: 7.46999e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 6.54999e-06 [updatestate_useless_node_eliminater]: 6.39001e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.81999e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 3.65e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.999e-05 [j_node_and_user_rematch]: 1.054e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.193e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 1.31002e-06 [auto_monad_eliminator]: 7.11999e-06 [cse]: 1.295e-05 [replace_applicator]: 6.70998e-06 [py_interpret_to_execute_after_opt_a]: 1.556e-05 [rewriter_after_opt_a]: 4.435e-05 [convert_after_rewriter]: 7.99002e-06 [order_py_execute_after_rewriter]: 6.06e-06 [mutable_eliminate]: 0.00072334 [jit_opt_b]: 6.185e-05, [1] [Cycle 1]: 5.412e-05, [2] [frontend_op_eliminate]: 2.142e-05 [inline_after_opt_a]: 2.087e-05 [cconv]: 2.496e-05 [loop_unroll]: 0.00049044 [jit_opt_after_cconv]: 0.00017313, [1] [Cycle 1]: 0.00016624, [11] [c_1]: 2.983e-05 [parameter_eliminate]: 3.14999e-06 [updatestate_depend_eliminate]: 6.16998e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.25e-05 [call_graph_tuple_transform]: 2.509e-05 [tuple_list_get_item_eliminator]: 7.3e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 9.81e-06 [remove_dup_value]: 1.74e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 5.505e-05 [cse_after_recomputation]: 2.488e-05, [1] [Cycle 1]: 1.939e-05, [1] [cse]: 1.285e-05 [auto_monad_reorder]: 1.707e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 6.06e-06 [opt_after_jit_grad]: 0.00053107 [symbol_engine_optimizer]: 0.00018956, [1] [Cycle 1]: 0.00018246, [6] [build]: 4.57e-06 [elim_shapecalc]: 9.26998e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 8.72e-06 [fold_const_symbol]: 0.00011262 [renormalize]: 5.3001e-07 [validate]: 4.457e-05 Sums bootstrap : 0.000293s : 0.24% type_inference : 0.115423s : 93.70% event_method : 0.000020s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000501s : 0.41% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000758s : 0.62% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003231s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000723s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000490s : 0.40% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000531s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000113s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000327 24 0.58% : 0.000002s : 2: substitution.elim_not_effective 31.34% : 0.000102s : 2: substitution.fold_const_symbol 2.06% : 0.000007s : 4: substitution.graph_param_transform 57.12% : 0.000187s : 4: substitution.inline 1.10% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000006s : 4: substitution.remove_not_recompute_node 1.91% : 0.000006s : 2: substitution.replace_old_param 4.04% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115340 2 97.54% : 0.112502s : 1: type_inference.infer 2.46% : 0.002838s : 1: type_inference.specialize ------[replace.] 0.000079 6 66.92% : 0.000053s : 4: replace.inline 33.08% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 93.88% : 0.000184s : 4: match.inline 6.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 2.19% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 4.98% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.95% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000002s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.04% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.97% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.50% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002208 22 62.68% : 0.001384s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.90% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.42% : 0.000782s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131784 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000308s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.30% : 0.008300s : 1: jit_opt_a 0.13% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.38% : 0.000499s : 1: loop_unroll 0.56% : 0.000733s : 1: mutable_eliminate 0.78% : 0.001022s : 26: opt.transform.jit_opt_a 0.05% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000140s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000540s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000508s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.78% : 0.002349s : 1: renormalize.infer 0.66% : 0.000868s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000049s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.15% : 0.000192s : 1: symbol_engine_optimizer 87.60% : 0.115440s : 1: type_inference TotalTime = 0.122348, [30] [bootstrap]: 0.00028096 [type_inference]: 0.111957 [event_method]: 1.999e-05 [auto_monad]: 6.569e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00044361 [rewriter_before_opt_a]: 8.556e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.0072369, [2] [Cycle 1]: 0.00352094, [27] [switch_simplify]: 5.486e-05 [loop_unroll]: 3.194e-05 [a_1]: 0.0005713 [with_stream_mark]: 1.717e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.43999e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 6.85998e-06 [renormalize]: 0.0025054 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 2.994e-05 [replace_applicator]: 1.337e-05 [Cycle 2]: 0.00039136, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00012521 [with_stream_mark]: 1.035e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 2.89001e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.47998e-06 [inline_without_move]: 5.58002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.255e-05 [replace_applicator]: 6.53e-06 [py_interpret_to_execute_after_opt_a]: 9.69999e-06 [rewriter_after_opt_a]: 3.447e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00055559 [jit_opt_b]: 5.576e-05, [1] [Cycle 1]: 4.864e-05, [2] [frontend_op_eliminate]: 1.971e-05 [inline_after_opt_a]: 1.809e-05 [cconv]: 2.422e-05 [loop_unroll]: 0.00046106 [jit_opt_after_cconv]: 0.00015204, [1] [Cycle 1]: 0.00014601, [11] [c_1]: 2.582e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 2.162e-05 [call_graph_tuple_transform]: 2.06e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 6.41e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 2.08998e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 4.564e-05 [cse_after_recomputation]: 8.283e-05, [1] [Cycle 1]: 1.588e-05, [1] [cse]: 1.063e-05 [auto_monad_reorder]: 1.679e-05 [get_jit_bprop_graph]: 1.80001e-06 [rewriter_after_jit_bprop_graph]: 4.88001e-06 [opt_after_jit_grad]: 0.00047371 [symbol_engine_optimizer]: 7.768e-05, [1] [Cycle 1]: 7.151e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 8.84e-06 [elim_not_effective]: 1.395e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 9.77001e-06 [renormalize]: 2.40019e-07 [validate]: 3.718e-05 Sums bootstrap : 0.000281s : 0.24% type_inference : 0.111957s : 94.59% event_method : 0.000020s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000444s : 0.37% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000697s : 0.59% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002505s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000556s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000461s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000474s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000199 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 4: substitution.graph_param_transform 82.80% : 0.000165s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.66% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111883 2 97.61% : 0.109209s : 1: type_inference.infer 2.39% : 0.002674s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.33% : 0.000048s : 4: replace.inline 33.67% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.05% : 0.000162s : 4: match.inline 6.95% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.11% : 0.000001s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.49% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001994 22 67.56% : 0.001347s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.49% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.95% : 0.000617s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125860 72 0.04% : 0.000049s : 1: add_recomputation 0.05% : 0.000069s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000292s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000086s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.75% : 0.007240s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000470s : 1: loop_unroll 0.45% : 0.000565s : 1: mutable_eliminate 0.74% : 0.000928s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000450s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.46% : 0.001835s : 1: renormalize.infer 0.53% : 0.000661s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 88.97% : 0.111973s : 1: type_inference TotalTime = 0.1299, [30] [bootstrap]: 0.00026702 [type_inference]: 0.118139 [event_method]: 2.487e-05 [auto_monad]: 7.998e-05 [graph_reusing]: 6.86001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00065644 [rewriter_before_opt_a]: 0.00010804 [expand_dump_flag]: 4.50001e-06 [jit_opt_a]: 0.00812241, [2] [Cycle 1]: 0.00410643, [27] [switch_simplify]: 6.63e-05 [loop_unroll]: 3.397e-05 [a_1]: 0.0007345 [with_stream_mark]: 2.211e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 1.023e-05 [inline_without_move]: 6.25002e-06 [renormalize]: 0.00287492 [add_forward_monad_depend]: 8.37e-06 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 1.745e-05 [cse]: 3.627e-05 [replace_applicator]: 1.843e-05 [Cycle 2]: 0.00039543, [27] [switch_simplify]: 7.00998e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00013556 [with_stream_mark]: 1.466e-05 [recompute_prepare]: 6.44999e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 7.90023e-07 [auto_monad_eliminator]: 6.57002e-06 [cse]: 1.491e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 1.454e-05 [rewriter_after_opt_a]: 3.984e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.00067277 [jit_opt_b]: 8.965e-05, [1] [Cycle 1]: 8.119e-05, [2] [frontend_op_eliminate]: 5.006e-05 [inline_after_opt_a]: 1.821e-05 [cconv]: 2.599e-05 [loop_unroll]: 0.00044883 [jit_opt_after_cconv]: 0.00015707, [1] [Cycle 1]: 0.0001505, [11] [c_1]: 2.529e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 6.38003e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.96001e-06 [cse]: 2.551e-05 [call_graph_tuple_transform]: 2.07e-05 [tuple_list_get_item_eliminator]: 7.7e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.949e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 9.54e-06 [add_recomputation]: 4.941e-05 [cse_after_recomputation]: 2.488e-05, [1] [Cycle 1]: 1.972e-05, [1] [cse]: 1.406e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00047019 [symbol_engine_optimizer]: 8.22e-05, [1] [Cycle 1]: 7.639e-05, [6] [build]: 3.71001e-06 [elim_shapecalc]: 1.177e-05 [elim_not_effective]: 1.562e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 1.113e-05 [renormalize]: 4.60015e-07 [validate]: 4.798e-05 Sums bootstrap : 0.000267s : 0.21% type_inference : 0.118139s : 94.09% event_method : 0.000025s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000656s : 0.52% rewriter_before_opt_a : 0.000108s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000870s : 0.69% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002875s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000673s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000050s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000449s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000470s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000304 28 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 4: substitution.graph_param_transform 84.31% : 0.000256s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.39% : 0.000013s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000005s : 2: substitution.replace_old_param 3.56% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118051 2 97.40% : 0.114981s : 1: type_inference.infer 2.60% : 0.003070s : 1: type_inference.specialize ------[replace.] 0.000101 7 68.68% : 0.000069s : 5: replace.inline 31.32% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000263 7 96.31% : 0.000253s : 5: match.inline 3.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.12% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.79% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.34% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.40% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.23% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000011s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.99% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003362 25 74.11% : 0.002491s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.53% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 23.37% : 0.000786s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133888 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000083s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000282s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.07% : 0.008126s : 1: jit_opt_a 0.12% : 0.000161s : 1: jit_opt_after_cconv 0.07% : 0.000092s : 1: jit_opt_b 0.34% : 0.000457s : 1: loop_unroll 0.51% : 0.000682s : 1: mutable_eliminate 0.84% : 0.001122s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000062s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000668s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.49% : 0.001995s : 1: renormalize.infer 0.65% : 0.000869s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000113s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 88.25% : 0.118160s : 1: type_inference TotalTime = 0.133689, [30] [bootstrap]: 0.00027693 [type_inference]: 0.121909 [event_method]: 2.445e-05 [auto_monad]: 7.546e-05 [graph_reusing]: 6.49001e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 0.00042562 [rewriter_before_opt_a]: 0.00010089 [expand_dump_flag]: 3.82998e-06 [jit_opt_a]: 0.00808065, [2] [Cycle 1]: 0.00413167, [27] [switch_simplify]: 6.72e-05 [loop_unroll]: 3.502e-05 [a_1]: 0.00068233 [with_stream_mark]: 1.89e-05 [recompute_prepare]: 9.20999e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.74002e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.58999e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 7.19001e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.611e-05 [j_node_and_user_rematch]: 1.137e-05 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 9.67001e-06 [inline_without_move]: 6.50002e-06 [renormalize]: 0.00291388 [add_forward_monad_depend]: 1.079e-05 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 2.261e-05 [cse]: 4.425e-05 [replace_applicator]: 2.439e-05 [Cycle 2]: 0.00042334, [27] [switch_simplify]: 7.58999e-06 [loop_unroll]: 7.16999e-06 [a_1]: 0.00013291 [with_stream_mark]: 1.795e-05 [recompute_prepare]: 6.54999e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 3.6e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.72e-06 [cell_reuse_recompute_pass]: 2.49999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.887e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 2.63003e-06 [replace_old_param]: 1.09e-05 [inline_without_move]: 6.29001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 9.39998e-06 [cse]: 1.694e-05 [replace_applicator]: 7.83999e-06 [py_interpret_to_execute_after_opt_a]: 1.879e-05 [rewriter_after_opt_a]: 4.564e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00078276 [jit_opt_b]: 8.465e-05, [1] [Cycle 1]: 7.437e-05, [2] [frontend_op_eliminate]: 2.214e-05 [inline_after_opt_a]: 2.115e-05 [cconv]: 2.997e-05 [loop_unroll]: 0.00049563 [jit_opt_after_cconv]: 0.00020249, [1] [Cycle 1]: 0.00019384, [11] [c_1]: 3.027e-05 [parameter_eliminate]: 4.48001e-06 [updatestate_depend_eliminate]: 7.93001e-06 [updatestate_assign_eliminate]: 4.72e-06 [updatestate_loads_eliminate]: 3.23e-06 [cse]: 4.078e-05 [call_graph_tuple_transform]: 2.664e-05 [tuple_list_get_item_eliminator]: 8.48999e-06 [none_parameter_eliminate]: 2.03002e-06 [renormalize]: 9.09989e-07 [switch_simplify]: 7.23e-06 [remove_dup_value]: 2.047e-05 [partial_unused_args_eliminate]: 3.39001e-06 [environ_conv]: 1.025e-05 [add_recomputation]: 5.542e-05 [cse_after_recomputation]: 2.876e-05, [1] [Cycle 1]: 2.182e-05, [1] [cse]: 1.5e-05 [auto_monad_reorder]: 1.91e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 7.88001e-06 [opt_after_jit_grad]: 0.00061004 [symbol_engine_optimizer]: 9.209e-05, [1] [Cycle 1]: 8.521e-05, [6] [build]: 4.17e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 1.662e-05 [opt_reshape]: 7.55e-06 [fold_const_symbol]: 1.317e-05 [renormalize]: 7.90023e-07 [validate]: 5.542e-05 Sums bootstrap : 0.000277s : 0.21% type_inference : 0.121909s : 94.16% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000426s : 0.33% rewriter_before_opt_a : 0.000101s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000815s : 0.63% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002914s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.02% jit_opt_a.cse : 0.000061s : 0.05% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000783s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000496s : 0.38% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000610s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.04% Time group info: ------[substitution.] 0.000253 25 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 3.04% : 0.000008s : 4: substitution.graph_param_transform 84.52% : 0.000214s : 5: substitution.inline 1.78% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 2.45% : 0.000006s : 2: substitution.replace_old_param 4.85% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121818 2 97.67% : 0.118983s : 1: type_inference.infer 2.33% : 0.002835s : 1: type_inference.specialize ------[replace.] 0.000103 7 69.68% : 0.000072s : 5: replace.inline 30.32% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 7 95.01% : 0.000211s : 5: match.inline 4.99% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.17% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.69% : 0.000003s : 13: predicate.addn_zero_filter 1.72% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.06% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.38% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.26% : 0.000002s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.93% : 0.000009s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 19: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.71% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 1.78% : 0.000003s : 13: predicate.reduce_eliminate 1.61% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.41% : 0.000011s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.29% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.51% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002373 25 63.69% : 0.001511s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.49% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.82% : 0.000803s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137787 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.22% : 0.000299s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.87% : 0.008084s : 1: jit_opt_a 0.15% : 0.000206s : 1: jit_opt_after_cconv 0.06% : 0.000087s : 1: jit_opt_b 0.37% : 0.000505s : 1: loop_unroll 0.58% : 0.000794s : 1: mutable_eliminate 0.79% : 0.001090s : 26: opt.transform.jit_opt_a 0.05% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000620s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000432s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.47% : 0.002032s : 1: renormalize.infer 0.63% : 0.000870s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000049s : 1: rewriter_after_opt_a 0.08% : 0.000106s : 1: rewriter_before_opt_a 0.07% : 0.000098s : 1: symbol_engine_optimizer 88.49% : 0.121929s : 1: type_inference TotalTime = 0.0226867, [30] [bootstrap]: 0.00028747 [type_inference]: 0.010614 [event_method]: 2.079e-05 [auto_monad]: 7.375e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 5.107e-05 [rewriter_before_opt_a]: 8.487e-05 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.00921314, [2] [Cycle 1]: 0.00374043, [27] [switch_simplify]: 6.398e-05 [loop_unroll]: 3.326e-05 [a_1]: 0.00069742 [with_stream_mark]: 2.054e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.29997e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.33002e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.68001e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 0.00257224 [add_forward_monad_depend]: 7.18e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.654e-05 [cse]: 2.745e-05 [replace_applicator]: 1.625e-05 [Cycle 2]: 0.0003529, [27] [switch_simplify]: 6.24999e-06 [loop_unroll]: 5.24e-06 [a_1]: 0.00010585 [with_stream_mark]: 1.155e-05 [recompute_prepare]: 6.02999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.40998e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.167e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 5.56e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.73002e-06 [cse]: 1.209e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.585e-05 [rewriter_after_opt_a]: 3.632e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00064295 [jit_opt_b]: 5.378e-05, [1] [Cycle 1]: 4.621e-05, [2] [frontend_op_eliminate]: 1.732e-05 [inline_after_opt_a]: 1.712e-05 [cconv]: 2.798e-05 [loop_unroll]: 0.00043272 [jit_opt_after_cconv]: 0.0001735, [1] [Cycle 1]: 0.00016616, [11] [c_1]: 2.135e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 6.60002e-06 [updatestate_assign_eliminate]: 2.40997e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.462e-05 [call_graph_tuple_transform]: 3.832e-05 [tuple_list_get_item_eliminator]: 5.58002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.82999e-06 [remove_dup_value]: 1.909e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 5.021e-05 [cse_after_recomputation]: 2.488e-05, [1] [Cycle 1]: 1.933e-05, [1] [cse]: 1.304e-05 [auto_monad_reorder]: 1.863e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 6.32001e-06 [opt_after_jit_grad]: 0.00051788 [symbol_engine_optimizer]: 7.977e-05, [1] [Cycle 1]: 7.231e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.532e-05 [opt_reshape]: 6.05002e-06 [fold_const_symbol]: 9.14e-06 [renormalize]: 3.50003e-07 [validate]: 3.995e-05 Sums bootstrap : 0.000287s : 1.69% type_inference : 0.010614s : 62.58% event_method : 0.000021s : 0.12% auto_monad : 0.000074s : 0.43% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000051s : 0.30% rewriter_before_opt_a : 0.000085s : 0.50% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.41% jit_opt_a.loop_unroll : 0.000039s : 0.23% jit_opt_a.a_1 : 0.000803s : 4.74% jit_opt_a.with_stream_mark : 0.000032s : 0.19% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.002572s : 15.17% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.13% jit_opt_a.cse : 0.000040s : 0.23% jit_opt_a.replace_applicator : 0.000021s : 0.13% py_interpret_to_execute_after_opt_a : 0.000016s : 0.09% rewriter_after_opt_a : 0.000036s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000643s : 3.79% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000028s : 0.16% loop_unroll : 0.000433s : 2.55% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000019s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000050s : 0.30% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000019s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000518s : 3.05% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.24% Time group info: ------[substitution.] 0.000316 27 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 7.36% : 0.000023s : 3: substitution.graph_param_transform 79.46% : 0.000251s : 5: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000013s : 3: substitution.reduce_eliminate 1.49% : 0.000005s : 4: substitution.remove_not_recompute_node 1.36% : 0.000004s : 2: substitution.replace_old_param 3.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010537 2 88.82% : 0.009359s : 1: type_inference.infer 11.18% : 0.001178s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.06% : 0.000066s : 5: replace.inline 31.94% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 7 95.79% : 0.000248s : 5: match.inline 4.21% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.22% : 0.000002s : 11: predicate.addn_zero_filter 2.68% : 0.000004s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.04% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.33% : 0.000002s : 11: predicate.environ_get_eliminate 1.27% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.61% : 0.000007s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 6: predicate.less_batch_normalization 1.81% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 16: predicate.partial_eliminate 1.23% : 0.000002s : 11: predicate.print_const_string_wrapper 1.95% : 0.000003s : 11: predicate.reduce_eliminate 1.84% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.49% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 11: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.65% : 0.000004s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000010s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.62% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000931 16 47.78% : 0.000445s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.64% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.58% : 0.000405s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026369 72 0.20% : 0.000053s : 1: add_recomputation 0.29% : 0.000077s : 1: auto_monad 0.08% : 0.000021s : 1: auto_monad_reorder 1.14% : 0.000300s : 1: bootstrap 0.12% : 0.000030s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.09% : 0.000024s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 34.95% : 0.009216s : 1: jit_opt_a 0.67% : 0.000176s : 1: jit_opt_after_cconv 0.22% : 0.000057s : 1: jit_opt_b 1.67% : 0.000441s : 1: loop_unroll 2.47% : 0.000652s : 1: mutable_eliminate 3.92% : 0.001034s : 26: opt.transform.jit_opt_a 0.26% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000013s : 1: opt.transform.mutable_eliminate 0.09% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.99% : 0.000526s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.20% : 0.000054s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000022s : 1: remove_dup_value 8.14% : 0.002147s : 1: renormalize.infer 1.57% : 0.000414s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000039s : 1: rewriter_after_opt_a 0.33% : 0.000088s : 1: rewriter_before_opt_a 0.31% : 0.000082s : 1: symbol_engine_optimizer 40.30% : 0.010627s : 1: type_inference TotalTime = 0.116772, [30] [bootstrap]: 0.00028781 [type_inference]: 0.106712 [event_method]: 1.749e-05 [auto_monad]: 5.906e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 0.0004799 [rewriter_before_opt_a]: 8.333e-05 [expand_dump_flag]: 1.87001e-06 [jit_opt_a]: 0.00711144, [2] [Cycle 1]: 0.00371916, [27] [switch_simplify]: 5.554e-05 [loop_unroll]: 3.333e-05 [a_1]: 0.00064696 [with_stream_mark]: 1.512e-05 [recompute_prepare]: 8.13001e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.93002e-06 [get_grad_eliminate_]: 6.81999e-06 [merge_forward]: 3.29001e-06 [cell_reuse_recompute_pass]: 8.00006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 9.66003e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.51e-06 [inline_without_move]: 5.98998e-06 [renormalize]: 0.00263755 [add_forward_monad_depend]: 4.92e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 1.148e-05 [cse]: 2.17e-05 [replace_applicator]: 1.242e-05 [Cycle 2]: 0.00036496, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.95002e-06 [a_1]: 0.0001281 [with_stream_mark]: 9.43997e-06 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.66998e-06 [merge_forward]: 2.70002e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.101e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.296e-05 [replace_applicator]: 5.84999e-06 [py_interpret_to_execute_after_opt_a]: 1.001e-05 [rewriter_after_opt_a]: 2.899e-05 [convert_after_rewriter]: 5.26002e-06 [order_py_execute_after_rewriter]: 4.25e-06 [mutable_eliminate]: 0.00054359 [jit_opt_b]: 5.313e-05, [1] [Cycle 1]: 4.711e-05, [2] [frontend_op_eliminate]: 1.857e-05 [inline_after_opt_a]: 1.767e-05 [cconv]: 1.65e-05 [loop_unroll]: 0.00040974 [jit_opt_after_cconv]: 0.00014282, [1] [Cycle 1]: 0.00013746, [11] [c_1]: 2.452e-05 [parameter_eliminate]: 1.76e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.109e-05 [call_graph_tuple_transform]: 1.861e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 9.29984e-07 [renormalize]: 4.69998e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 9.02e-06 [partial_unused_args_eliminate]: 1.30001e-06 [environ_conv]: 5.42001e-06 [add_recomputation]: 3.305e-05 [cse_after_recomputation]: 2.333e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.122e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 3.76001e-06 [opt_after_jit_grad]: 0.00045523 [symbol_engine_optimizer]: 7.197e-05, [1] [Cycle 1]: 6.646e-05, [6] [build]: 2.34001e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.228e-05 [opt_reshape]: 6.32001e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 3.19997e-07 [validate]: 3.278e-05 Sums bootstrap : 0.000288s : 0.25% type_inference : 0.106712s : 94.28% event_method : 0.000017s : 0.02% auto_monad : 0.000059s : 0.05% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000480s : 0.42% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000775s : 0.68% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002638s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000005s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000544s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000016s : 0.01% loop_unroll : 0.000410s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000033s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000455s : 0.40% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000229 28 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000004s : 4: substitution.graph_param_transform 83.31% : 0.000191s : 5: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.71% : 0.000011s : 3: substitution.reduce_eliminate 1.87% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.07% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106649 2 97.28% : 0.103749s : 1: type_inference.infer 2.72% : 0.002900s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.15% : 0.000064s : 5: replace.inline 31.85% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 7 95.82% : 0.000188s : 5: match.inline 4.18% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.13% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 19: predicate.load_eliminater 0.94% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 2.39% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.99% : 0.000003s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 20: predicate.switch_defer_inline 2.36% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000010s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.58% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002181 25 62.31% : 0.001359s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.50% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.19% : 0.000768s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120494 72 0.03% : 0.000036s : 1: add_recomputation 0.05% : 0.000062s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.25% : 0.000298s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000007s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.90% : 0.007115s : 1: jit_opt_a 0.12% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.35% : 0.000416s : 1: loop_unroll 0.46% : 0.000551s : 1: mutable_eliminate 0.83% : 0.001005s : 26: opt.transform.jit_opt_a 0.04% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000485s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.55% : 0.001868s : 1: renormalize.infer 0.63% : 0.000762s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 88.57% : 0.106722s : 1: type_inference TotalTime = 0.0642113, [30] [bootstrap]: 0.00029548 [type_inference]: 0.0539622 [event_method]: 1.883e-05 [auto_monad]: 6.836e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 0.00030459 [rewriter_before_opt_a]: 8.461e-05 [expand_dump_flag]: 3.35998e-06 [jit_opt_a]: 0.00698588, [2] [Cycle 1]: 0.00316983, [27] [switch_simplify]: 5.623e-05 [loop_unroll]: 3.146e-05 [a_1]: 0.00057643 [with_stream_mark]: 1.577e-05 [recompute_prepare]: 9.15999e-06 [updatestate_depend_eliminate]: 4.19002e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 6.49001e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.33002e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 2.74999e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 6.76e-06 [renormalize]: 0.00216319 [add_forward_monad_depend]: 4.75001e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 1.234e-05 [cse]: 1.823e-05 [replace_applicator]: 1.756e-05 [Cycle 2]: 0.00038617, [27] [switch_simplify]: 7.78999e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.00013342 [with_stream_mark]: 1.13e-05 [recompute_prepare]: 6.07999e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 1.68002e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 2.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 9.19998e-06 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.24003e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.168e-05 [replace_applicator]: 6.16998e-06 [py_interpret_to_execute_after_opt_a]: 1.123e-05 [rewriter_after_opt_a]: 3.664e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 5.82999e-06 [mutable_eliminate]: 0.00069975 [jit_opt_b]: 5.969e-05, [1] [Cycle 1]: 5.182e-05, [2] [frontend_op_eliminate]: 2.014e-05 [inline_after_opt_a]: 2.018e-05 [cconv]: 2.331e-05 [loop_unroll]: 0.00043003 [jit_opt_after_cconv]: 0.00015702, [1] [Cycle 1]: 0.00015059, [11] [c_1]: 2.621e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 2.144e-05 [call_graph_tuple_transform]: 2.246e-05 [tuple_list_get_item_eliminator]: 6.45002e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 1.025e-05 [remove_dup_value]: 1.463e-05 [partial_unused_args_eliminate]: 2.99001e-06 [environ_conv]: 8.95999e-06 [add_recomputation]: 5.141e-05 [cse_after_recomputation]: 2.679e-05, [1] [Cycle 1]: 2.008e-05, [1] [cse]: 1.352e-05 [auto_monad_reorder]: 1.574e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.46e-06 [opt_after_jit_grad]: 0.00052428 [symbol_engine_optimizer]: 7.915e-05, [1] [Cycle 1]: 7.251e-05, [6] [build]: 3.25998e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.468e-05 [opt_reshape]: 6.83998e-06 [fold_const_symbol]: 1.038e-05 [renormalize]: 4.10015e-07 [validate]: 4.42e-05 Sums bootstrap : 0.000295s : 0.49% type_inference : 0.053962s : 89.79% event_method : 0.000019s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000305s : 0.51% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.11% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000710s : 1.18% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002163s : 3.60% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000030s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000700s : 1.16% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000430s : 0.72% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.02% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000524s : 0.87% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000199 24 1.31% : 0.000003s : 2: substitution.elim_not_effective 0.92% : 0.000002s : 2: substitution.fold_const_symbol 2.92% : 0.000006s : 4: substitution.graph_param_transform 82.24% : 0.000163s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.83% : 0.000006s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 6.04% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053888 2 96.37% : 0.051933s : 1: type_inference.infer 3.63% : 0.001955s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.02% : 0.000050s : 4: replace.inline 33.98% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.65% : 0.000161s : 4: match.inline 6.35% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.60% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.92% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.25% : 0.000003s : 18: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.19% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.42% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.82% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003055 26 80.39% : 0.002456s : 19: func_graph_cloner_run.FuncGraphClonerGraph 0.80% : 0.000024s : 1: func_graph_cloner_run.FuncGraphClonerNode 18.81% : 0.000575s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067307 72 0.08% : 0.000055s : 1: add_recomputation 0.11% : 0.000072s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.46% : 0.000310s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.39% : 0.006990s : 1: jit_opt_a 0.24% : 0.000160s : 1: jit_opt_after_cconv 0.09% : 0.000062s : 1: jit_opt_b 0.65% : 0.000437s : 1: loop_unroll 1.05% : 0.000708s : 1: mutable_eliminate 1.41% : 0.000952s : 26: opt.transform.jit_opt_a 0.09% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000533s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000310s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.24% : 0.001506s : 1: renormalize.infer 0.96% : 0.000649s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.12% : 0.000082s : 1: symbol_engine_optimizer 80.19% : 0.053975s : 1: type_inference TotalTime = 0.137117, [30] [bootstrap]: 0.00029343 [type_inference]: 0.125548 [event_method]: 1.987e-05 [auto_monad]: 6.836e-05 [graph_reusing]: 5.61e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00055008 [rewriter_before_opt_a]: 9.356e-05 [expand_dump_flag]: 4.11001e-06 [jit_opt_a]: 0.00778423, [2] [Cycle 1]: 0.0039187, [27] [switch_simplify]: 6.428e-05 [loop_unroll]: 3.14e-05 [a_1]: 0.00063755 [with_stream_mark]: 2.01e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 8.07e-06 [updatestate_useless_node_eliminater]: 7.05002e-06 [accelerated_algorithm]: 7.34002e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 7.01999e-06 [merge_forward]: 4.39002e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.725e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 7.18e-06 [renormalize]: 0.00277651 [add_forward_monad_depend]: 8.46002e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.821e-05 [cse]: 3.274e-05 [replace_applicator]: 1.993e-05 [Cycle 2]: 0.00038527, [27] [switch_simplify]: 7.76001e-06 [loop_unroll]: 6.35997e-06 [a_1]: 0.00012892 [with_stream_mark]: 1.217e-05 [recompute_prepare]: 6.17999e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.18998e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.42001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 5.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.192e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.246e-05 [rewriter_after_opt_a]: 3.822e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00072054 [jit_opt_b]: 6.276e-05, [1] [Cycle 1]: 5.383e-05, [2] [frontend_op_eliminate]: 2.258e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 3.122e-05 [loop_unroll]: 0.00053748 [jit_opt_after_cconv]: 0.00022161, [1] [Cycle 1]: 0.00021338, [11] [c_1]: 3.008e-05 [parameter_eliminate]: 4.34997e-06 [updatestate_depend_eliminate]: 3.816e-05 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 3.518e-05 [call_graph_tuple_transform]: 2.735e-05 [tuple_list_get_item_eliminator]: 7.01001e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.681e-05 [partial_unused_args_eliminate]: 2.81e-06 [environ_conv]: 9.68002e-06 [add_recomputation]: 5.499e-05 [cse_after_recomputation]: 2.394e-05, [1] [Cycle 1]: 1.801e-05, [1] [cse]: 1.155e-05 [auto_monad_reorder]: 1.649e-05 [get_jit_bprop_graph]: 1.93002e-06 [rewriter_after_jit_bprop_graph]: 6.24999e-06 [opt_after_jit_grad]: 0.00054813 [symbol_engine_optimizer]: 0.00014865, [1] [Cycle 1]: 0.00014232, [6] [build]: 3.93999e-06 [elim_shapecalc]: 8.97e-06 [elim_not_effective]: 1.476e-05 [opt_reshape]: 7.63999e-06 [fold_const_symbol]: 7.672e-05 [renormalize]: 8.39995e-07 [validate]: 4.879e-05 Sums bootstrap : 0.000293s : 0.22% type_inference : 0.125548s : 94.43% event_method : 0.000020s : 0.01% auto_monad : 0.000068s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000550s : 0.41% rewriter_before_opt_a : 0.000094s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000766s : 0.58% jit_opt_a.with_stream_mark : 0.000032s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002777s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000045s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000721s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000537s : 0.40% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000038s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000548s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000077s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000244 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 3.12% : 0.000008s : 4: substitution.graph_param_transform 83.72% : 0.000204s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 2.56% : 0.000006s : 2: substitution.replace_old_param 5.29% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125459 2 97.76% : 0.122652s : 1: type_inference.infer 2.24% : 0.002806s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.10% : 0.000052s : 4: replace.inline 32.90% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.59% : 0.000201s : 4: match.inline 5.41% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.46% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 2.20% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.88% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 2.03% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.44% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 1.91% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000003s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000011s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.09% : 0.000005s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002345 22 63.70% : 0.001494s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.05% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.25% : 0.000803s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141043 72 0.04% : 0.000058s : 1: add_recomputation 0.05% : 0.000072s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000306s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.52% : 0.007787s : 1: jit_opt_a 0.16% : 0.000225s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.39% : 0.000551s : 1: loop_unroll 0.52% : 0.000733s : 1: mutable_eliminate 0.73% : 0.001025s : 26: opt.transform.jit_opt_a 0.05% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000104s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000560s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000558s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.35% : 0.001905s : 1: renormalize.infer 0.61% : 0.000860s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000099s : 1: rewriter_before_opt_a 0.11% : 0.000152s : 1: symbol_engine_optimizer 89.03% : 0.125564s : 1: type_inference TotalTime = 0.0651887, [30] [bootstrap]: 0.00028018 [type_inference]: 0.0544772 [event_method]: 1.866e-05 [auto_monad]: 0.0001112 [graph_reusing]: 6.88e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00028701 [rewriter_before_opt_a]: 8.615e-05 [expand_dump_flag]: 4.12998e-06 [jit_opt_a]: 0.00757867, [2] [Cycle 1]: 0.00351804, [27] [switch_simplify]: 6.131e-05 [loop_unroll]: 3.249e-05 [a_1]: 0.0007162 [with_stream_mark]: 1.774e-05 [recompute_prepare]: 9.84999e-06 [updatestate_depend_eliminate]: 4.59998e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 7.83999e-06 [updatestate_useless_node_eliminater]: 7.15e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.678e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 9.59999e-06 [inline_without_move]: 6.58998e-06 [renormalize]: 0.00231311 [add_forward_monad_depend]: 7.97998e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.917e-05 [cse]: 3.01e-05 [replace_applicator]: 1.908e-05 [Cycle 2]: 0.0004194, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 6.29999e-06 [a_1]: 0.00012906 [with_stream_mark]: 1.423e-05 [recompute_prepare]: 6.64001e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.762e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 6.70998e-06 [cse]: 1.269e-05 [replace_applicator]: 7.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.241e-05 [rewriter_after_opt_a]: 3.812e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00067264 [jit_opt_b]: 5.742e-05, [1] [Cycle 1]: 4.904e-05, [2] [frontend_op_eliminate]: 1.953e-05 [inline_after_opt_a]: 1.822e-05 [cconv]: 2.757e-05 [loop_unroll]: 0.00044039 [jit_opt_after_cconv]: 0.00016246, [1] [Cycle 1]: 0.00015477, [11] [c_1]: 2.639e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 8.23999e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.713e-05 [call_graph_tuple_transform]: 2.107e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.08002e-06 [remove_dup_value]: 1.51e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 8.65999e-06 [add_recomputation]: 4.942e-05 [cse_after_recomputation]: 2.377e-05, [1] [Cycle 1]: 1.857e-05, [1] [cse]: 1.261e-05 [auto_monad_reorder]: 1.6e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.82001e-06 [opt_after_jit_grad]: 0.00046675 [symbol_engine_optimizer]: 0.0001, [1] [Cycle 1]: 9.354e-05, [6] [build]: 4.08999e-06 [elim_shapecalc]: 2.645e-05 [elim_not_effective]: 1.491e-05 [opt_reshape]: 7.7e-06 [fold_const_symbol]: 1.059e-05 [renormalize]: 2.70025e-07 [validate]: 4.696e-05 Sums bootstrap : 0.000280s : 0.46% type_inference : 0.054477s : 89.43% event_method : 0.000019s : 0.03% auto_monad : 0.000111s : 0.18% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000287s : 0.47% rewriter_before_opt_a : 0.000086s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.11% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000845s : 1.39% jit_opt_a.with_stream_mark : 0.000032s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002313s : 3.80% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000673s : 1.10% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000440s : 0.72% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000467s : 0.77% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000026s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.08% Time group info: ------[substitution.] 0.000251 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 4: substitution.graph_param_transform 84.60% : 0.000213s : 4: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.68% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054398 2 96.18% : 0.052318s : 1: type_inference.infer 3.82% : 0.002080s : 1: type_inference.specialize ------[replace.] 0.000090 6 69.00% : 0.000062s : 4: replace.inline 31.00% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.32% : 0.000210s : 4: match.inline 5.68% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 12: predicate.addn_check_dump 1.58% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.01% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.37% : 0.000002s : 12: predicate.print_const_string_wrapper 2.01% : 0.000003s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.52% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.24% : 0.000011s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.55% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002262 26 69.88% : 0.001580s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.49% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.63% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068690 72 0.08% : 0.000052s : 1: add_recomputation 0.17% : 0.000117s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.43% : 0.000294s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.04% : 0.007582s : 1: jit_opt_a 0.24% : 0.000165s : 1: jit_opt_after_cconv 0.09% : 0.000060s : 1: jit_opt_b 0.65% : 0.000448s : 1: loop_unroll 0.99% : 0.000682s : 1: mutable_eliminate 1.60% : 0.001102s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000056s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000293s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.30% : 0.001579s : 1: renormalize.infer 1.05% : 0.000724s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.13% : 0.000091s : 1: rewriter_before_opt_a 0.15% : 0.000103s : 1: symbol_engine_optimizer 79.33% : 0.054491s : 1: type_inference TotalTime = 0.121217, [30] [bootstrap]: 0.00030979 [type_inference]: 0.109722 [event_method]: 2.007e-05 [auto_monad]: 5.811e-05 [graph_reusing]: 4.92e-06 [pre_auto_parallel]: 2.20002e-06 [py_interpret_to_execute]: 0.00049487 [rewriter_before_opt_a]: 9.747e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.00798565, [2] [Cycle 1]: 0.00408095, [27] [switch_simplify]: 6.09e-05 [loop_unroll]: 3.388e-05 [a_1]: 0.0006641 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 9.15001e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.33e-06 [accelerated_algorithm]: 7.26999e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 6.98e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.356e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 6.61999e-06 [renormalize]: 0.00295028 [add_forward_monad_depend]: 7.61999e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.745e-05 [cse]: 2.936e-05 [replace_applicator]: 2.216e-05 [Cycle 2]: 0.00039839, [27] [switch_simplify]: 7.06001e-06 [loop_unroll]: 6.49001e-06 [a_1]: 0.00013534 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 6.81001e-06 [updatestate_depend_eliminate]: 3.75998e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 3.44001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.46002e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.368e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.388e-05 [rewriter_after_opt_a]: 3.852e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00075988 [jit_opt_b]: 5.749e-05, [1] [Cycle 1]: 4.992e-05, [2] [frontend_op_eliminate]: 1.962e-05 [inline_after_opt_a]: 1.85e-05 [cconv]: 2.718e-05 [loop_unroll]: 0.00043539 [jit_opt_after_cconv]: 0.0001644, [1] [Cycle 1]: 0.00015814, [11] [c_1]: 2.622e-05 [parameter_eliminate]: 3.47002e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 2.847e-05 [call_graph_tuple_transform]: 2.291e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.745e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 9.22001e-06 [add_recomputation]: 5.218e-05 [cse_after_recomputation]: 2.505e-05, [1] [Cycle 1]: 1.976e-05, [1] [cse]: 1.307e-05 [auto_monad_reorder]: 1.746e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 6.38e-06 [opt_after_jit_grad]: 0.00049381 [symbol_engine_optimizer]: 7.967e-05, [1] [Cycle 1]: 7.32e-05, [6] [build]: 4.12998e-06 [elim_shapecalc]: 9.71e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 9.92999e-06 [renormalize]: 5.69999e-07 [validate]: 0.00012528 Sums bootstrap : 0.000310s : 0.26% type_inference : 0.109722s : 93.69% event_method : 0.000020s : 0.02% auto_monad : 0.000058s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000495s : 0.42% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000799s : 0.68% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002950s : 2.52% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000760s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000435s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000494s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000125s : 0.11% Time group info: ------[substitution.] 0.000242 28 1.10% : 0.000003s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 4: substitution.graph_param_transform 81.46% : 0.000197s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.62% : 0.000011s : 3: substitution.reduce_eliminate 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 4.13% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109650 2 97.29% : 0.106681s : 1: type_inference.infer 2.71% : 0.002969s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.45% : 0.000068s : 5: replace.inline 32.55% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 7 95.67% : 0.000194s : 5: match.inline 4.33% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.25% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.12% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 2.54% : 0.000004s : 13: predicate.reduce_eliminate 1.74% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.07% : 0.000010s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.52% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002258 25 62.42% : 0.001409s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.65% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.94% : 0.000789s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125213 72 0.04% : 0.000055s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000321s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.38% : 0.007989s : 1: jit_opt_a 0.13% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.35% : 0.000444s : 1: loop_unroll 0.61% : 0.000769s : 1: mutable_eliminate 0.84% : 0.001054s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000503s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000502s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.67% : 0.002094s : 1: renormalize.infer 0.68% : 0.000846s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 87.64% : 0.109737s : 1: type_inference TotalTime = 0.121569, [30] [bootstrap]: 0.00030084 [type_inference]: 0.110194 [event_method]: 2.27e-05 [auto_monad]: 7.375e-05 [graph_reusing]: 6.56999e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00048518 [rewriter_before_opt_a]: 0.00010004 [expand_dump_flag]: 4e-06 [jit_opt_a]: 0.0077875, [2] [Cycle 1]: 0.0040165, [27] [switch_simplify]: 6.776e-05 [loop_unroll]: 3.413e-05 [a_1]: 0.00069598 [with_stream_mark]: 2.122e-05 [recompute_prepare]: 9.61e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 4.60999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.48999e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 6.58998e-06 [meta_shard_fg_expand]: 2.86999e-06 [get_grad_eliminate_]: 6.64001e-06 [merge_forward]: 5.34998e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00279399 [add_forward_monad_depend]: 9.41e-06 [auto_monad_grad]: 3.04001e-06 [auto_monad_eliminator]: 1.94e-05 [cse]: 4.044e-05 [replace_applicator]: 2.272e-05 [Cycle 2]: 0.00039898, [27] [switch_simplify]: 8.30999e-06 [loop_unroll]: 6.44001e-06 [a_1]: 0.0001249 [with_stream_mark]: 1.533e-05 [recompute_prepare]: 6.70002e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.98002e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 5.10001e-06 [cell_reuse_recompute_pass]: 3.21001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.764e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 9.67001e-06 [inline_without_move]: 6.21e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.528e-05 [replace_applicator]: 6.39999e-06 [py_interpret_to_execute_after_opt_a]: 1.542e-05 [rewriter_after_opt_a]: 4.015e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.000765 [jit_opt_b]: 9.093e-05, [1] [Cycle 1]: 5.004e-05, [2] [frontend_op_eliminate]: 1.92e-05 [inline_after_opt_a]: 1.921e-05 [cconv]: 2.884e-05 [loop_unroll]: 0.00046323 [jit_opt_after_cconv]: 0.0001737, [1] [Cycle 1]: 0.00016636, [11] [c_1]: 2.585e-05 [parameter_eliminate]: 3.25e-06 [updatestate_depend_eliminate]: 8.65999e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.434e-05 [call_graph_tuple_transform]: 2.434e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 1.927e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 1.031e-05 [add_recomputation]: 5.451e-05 [cse_after_recomputation]: 2.597e-05, [1] [Cycle 1]: 2.057e-05, [1] [cse]: 1.481e-05 [auto_monad_reorder]: 1.89e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.0005155 [symbol_engine_optimizer]: 8.415e-05, [1] [Cycle 1]: 7.594e-05, [6] [build]: 3.98001e-06 [elim_shapecalc]: 9.58002e-06 [elim_not_effective]: 1.557e-05 [opt_reshape]: 8.62e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 3.69997e-07 [validate]: 6.281e-05 Sums bootstrap : 0.000301s : 0.26% type_inference : 0.110194s : 93.76% event_method : 0.000023s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000485s : 0.41% rewriter_before_opt_a : 0.000100s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000821s : 0.70% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002794s : 2.38% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000056s : 0.05% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000765s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000463s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000515s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000063s : 0.05% Time group info: ------[substitution.] 0.000269 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000007s : 4: substitution.graph_param_transform 86.05% : 0.000232s : 5: substitution.inline 1.46% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.03% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 4.71% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110116 2 97.49% : 0.107354s : 1: type_inference.infer 2.51% : 0.002762s : 1: type_inference.specialize ------[replace.] 0.000104 7 68.60% : 0.000071s : 5: replace.inline 31.40% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 95.19% : 0.000229s : 5: match.inline 4.81% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.48% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 1.72% : 0.000002s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.36% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.07% : 0.000007s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.35% : 0.000002s : 13: predicate.print_const_string_wrapper 1.55% : 0.000002s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.82% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002270 25 65.37% : 0.001484s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.10% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.53% : 0.000716s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125502 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000323s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.21% : 0.007791s : 1: jit_opt_a 0.14% : 0.000176s : 1: jit_opt_after_cconv 0.07% : 0.000094s : 1: jit_opt_b 0.38% : 0.000472s : 1: loop_unroll 0.62% : 0.000774s : 1: mutable_eliminate 0.87% : 0.001088s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000525s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000492s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.62% : 0.002034s : 1: renormalize.infer 0.60% : 0.000749s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 87.82% : 0.110211s : 1: type_inference TotalTime = 0.131418, [30] [bootstrap]: 0.00030914 [type_inference]: 0.119151 [event_method]: 2.16e-05 [auto_monad]: 7.574e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 3.55e-06 [py_interpret_to_execute]: 0.0005449 [rewriter_before_opt_a]: 9.588e-05 [expand_dump_flag]: 4.02998e-06 [jit_opt_a]: 0.00835676, [2] [Cycle 1]: 0.00426037, [27] [switch_simplify]: 6.417e-05 [loop_unroll]: 3.441e-05 [a_1]: 0.00074324 [with_stream_mark]: 2.296e-05 [recompute_prepare]: 8.72e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.43999e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 9.20999e-06 [updatestate_useless_node_eliminater]: 6.69001e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.99999e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.702e-05 [j_node_and_user_rematch]: 1.138e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.185e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 0.00296628 [add_forward_monad_depend]: 8.62e-06 [auto_monad_grad]: 3.46999e-06 [auto_monad_eliminator]: 1.743e-05 [cse]: 2.515e-05 [replace_applicator]: 2.463e-05 [Cycle 2]: 0.00040733, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00013994 [with_stream_mark]: 1.695e-05 [recompute_prepare]: 7.01999e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.67002e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 4.22e-06 [cell_reuse_recompute_pass]: 3.45e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.418e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.71e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 7.33999e-06 [cse]: 1.441e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 1.686e-05 [rewriter_after_opt_a]: 3.93e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 5.54e-06 [mutable_eliminate]: 0.00087489 [jit_opt_b]: 6.62e-05, [1] [Cycle 1]: 5.572e-05, [2] [frontend_op_eliminate]: 2.196e-05 [inline_after_opt_a]: 1.94e-05 [cconv]: 3.619e-05 [loop_unroll]: 0.00049306 [jit_opt_after_cconv]: 0.00018338, [1] [Cycle 1]: 0.0001747, [11] [c_1]: 2.807e-05 [parameter_eliminate]: 4.01001e-06 [updatestate_depend_eliminate]: 7.03998e-06 [updatestate_assign_eliminate]: 5.14998e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.595e-05 [call_graph_tuple_transform]: 2.508e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 6.82002e-06 [remove_dup_value]: 2.15e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 1.213e-05 [add_recomputation]: 5.232e-05 [cse_after_recomputation]: 2.68e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.38e-05 [auto_monad_reorder]: 1.825e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 6.98e-06 [opt_after_jit_grad]: 0.0005033 [symbol_engine_optimizer]: 0.00024002, [1] [Cycle 1]: 0.00023341, [6] [build]: 4.15e-06 [elim_shapecalc]: 8.96002e-06 [elim_not_effective]: 1.83e-05 [opt_reshape]: 7.12002e-06 [fold_const_symbol]: 0.00016294 [renormalize]: 3.09985e-07 [validate]: 5.18e-05 Sums bootstrap : 0.000309s : 0.24% type_inference : 0.119151s : 93.78% event_method : 0.000022s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000545s : 0.43% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000883s : 0.70% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002966s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000875s : 0.69% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000493s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000503s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000163s : 0.13% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000313 28 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000007s : 4: substitution.graph_param_transform 82.96% : 0.000259s : 5: substitution.inline 1.61% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.82% : 0.000015s : 3: substitution.reduce_eliminate 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 3.83% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119066 2 97.42% : 0.115991s : 1: type_inference.infer 2.58% : 0.003075s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.89% : 0.000073s : 5: replace.inline 31.11% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 7 95.91% : 0.000256s : 5: match.inline 4.09% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.18% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.68% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000001s : 13: predicate.minmaximum_grad 2.00% : 0.000003s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.85% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 23: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.30% : 0.000011s : 64: predicate.switch_simplify 1.50% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002434 25 61.92% : 0.001507s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.59% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.49% : 0.000839s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135762 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000024s : 1: auto_monad_reorder 0.24% : 0.000323s : 1: bootstrap 0.03% : 0.000039s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.16% : 0.008360s : 1: jit_opt_a 0.14% : 0.000186s : 1: jit_opt_after_cconv 0.05% : 0.000069s : 1: jit_opt_b 0.37% : 0.000502s : 1: loop_unroll 0.65% : 0.000887s : 1: mutable_eliminate 0.85% : 0.001148s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000194s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.41% : 0.000552s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 1.53% : 0.002083s : 1: renormalize.infer 0.64% : 0.000870s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.18% : 0.000243s : 1: symbol_engine_optimizer 87.78% : 0.119167s : 1: type_inference TotalTime = 0.124965, [30] [bootstrap]: 0.00029472 [type_inference]: 0.113492 [event_method]: 2.052e-05 [auto_monad]: 7.287e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00059038 [rewriter_before_opt_a]: 9.443e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00787676, [2] [Cycle 1]: 0.00386252, [27] [switch_simplify]: 6.864e-05 [loop_unroll]: 3.144e-05 [a_1]: 0.0006544 [with_stream_mark]: 2.426e-05 [recompute_prepare]: 9.53002e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 2.68998e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 6.38003e-06 [renormalize]: 0.00271035 [add_forward_monad_depend]: 7.13998e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.738e-05 [cse]: 3.217e-05 [replace_applicator]: 1.759e-05 [Cycle 2]: 0.00038305, [27] [switch_simplify]: 7.12002e-06 [loop_unroll]: 6.34001e-06 [a_1]: 0.00012678 [with_stream_mark]: 1.276e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.96998e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 2.21998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.68e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.33002e-06 [cse]: 1.251e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.254e-05 [rewriter_after_opt_a]: 3.702e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00068526 [jit_opt_b]: 5.928e-05, [1] [Cycle 1]: 5.114e-05, [2] [frontend_op_eliminate]: 2.085e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 2.75e-05 [loop_unroll]: 0.0004374 [jit_opt_after_cconv]: 0.00016006, [1] [Cycle 1]: 0.00015217, [11] [c_1]: 2.662e-05 [parameter_eliminate]: 3.28998e-06 [updatestate_depend_eliminate]: 7.25998e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.31e-05 [call_graph_tuple_transform]: 2.207e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.19999e-06 [remove_dup_value]: 1.722e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 8.92999e-06 [add_recomputation]: 5.077e-05 [cse_after_recomputation]: 2.49e-05, [1] [Cycle 1]: 1.754e-05, [1] [cse]: 1.116e-05 [auto_monad_reorder]: 1.925e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.49998e-06 [opt_after_jit_grad]: 0.00051714 [symbol_engine_optimizer]: 0.00017879, [1] [Cycle 1]: 0.00017093, [6] [build]: 5.02e-06 [elim_shapecalc]: 9.06998e-06 [elim_not_effective]: 1.635e-05 [opt_reshape]: 6.85998e-06 [fold_const_symbol]: 0.00010265 [renormalize]: 5.50004e-07 [validate]: 5.011e-05 Sums bootstrap : 0.000295s : 0.24% type_inference : 0.113492s : 94.03% event_method : 0.000021s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000590s : 0.49% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000781s : 0.65% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002710s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000685s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000437s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000517s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000103s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000268 24 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000007s : 4: substitution.graph_param_transform 85.52% : 0.000229s : 4: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000006s : 2: substitution.replace_old_param 4.75% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113411 2 97.50% : 0.110582s : 1: type_inference.infer 2.50% : 0.002830s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.74% : 0.000054s : 4: replace.inline 33.26% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.20% : 0.000227s : 4: match.inline 4.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.15% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.36% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.01% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.42% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.77% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002262 22 64.52% : 0.001459s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000056s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.99% : 0.000746s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128867 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.24% : 0.000315s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.12% : 0.007880s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.35% : 0.000446s : 1: loop_unroll 0.54% : 0.000694s : 1: mutable_eliminate 0.80% : 0.001036s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000131s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000528s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000602s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.47% : 0.001899s : 1: renormalize.infer 0.62% : 0.000801s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.14% : 0.000183s : 1: symbol_engine_optimizer 88.08% : 0.113509s : 1: type_inference TotalTime = 0.0670126, [30] [bootstrap]: 0.00034192 [type_inference]: 0.0556106 [event_method]: 2.504e-05 [auto_monad]: 7.646e-05 [graph_reusing]: 7.23999e-06 [pre_auto_parallel]: 2.99999e-06 [py_interpret_to_execute]: 0.0002542 [rewriter_before_opt_a]: 0.00010097 [expand_dump_flag]: 4.19002e-06 [jit_opt_a]: 0.00802541, [2] [Cycle 1]: 0.0039369, [27] [switch_simplify]: 6.474e-05 [loop_unroll]: 3.524e-05 [a_1]: 0.00072175 [with_stream_mark]: 1.886e-05 [recompute_prepare]: 9.63002e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.70998e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00268864 [add_forward_monad_depend]: 8.46002e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 2.118e-05 [cse]: 3.959e-05 [replace_applicator]: 2.699e-05 [Cycle 2]: 0.00040567, [27] [switch_simplify]: 8.23999e-06 [loop_unroll]: 6.59001e-06 [a_1]: 0.00013077 [with_stream_mark]: 1.28e-05 [recompute_prepare]: 6.17999e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 6.27001e-06 [accelerated_algorithm]: 6.26998e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 3.13998e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.086e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 3.31001e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 6.11e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.32001e-06 [cse]: 1.557e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.486e-05 [rewriter_after_opt_a]: 4.203e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00076713 [jit_opt_b]: 6.167e-05, [1] [Cycle 1]: 5.32e-05, [2] [frontend_op_eliminate]: 2.001e-05 [inline_after_opt_a]: 2.086e-05 [cconv]: 2.853e-05 [loop_unroll]: 0.00047362 [jit_opt_after_cconv]: 0.00017202, [1] [Cycle 1]: 0.00016521, [11] [c_1]: 2.699e-05 [parameter_eliminate]: 3.83001e-06 [updatestate_depend_eliminate]: 7.89002e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [cse]: 3.262e-05 [call_graph_tuple_transform]: 2.3e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.27001e-06 [remove_dup_value]: 1.898e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 9.56e-06 [add_recomputation]: 5.456e-05 [cse_after_recomputation]: 2.573e-05, [1] [Cycle 1]: 1.973e-05, [1] [cse]: 1.406e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.06002e-06 [opt_after_jit_grad]: 0.00046598 [symbol_engine_optimizer]: 0.00014138, [1] [Cycle 1]: 0.00013504, [6] [build]: 3.89002e-06 [elim_shapecalc]: 9.10999e-06 [elim_not_effective]: 1.478e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 7.139e-05 [renormalize]: 4.30009e-07 [validate]: 4.838e-05 Sums bootstrap : 0.000342s : 0.55% type_inference : 0.055611s : 88.71% event_method : 0.000025s : 0.04% auto_monad : 0.000076s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000254s : 0.41% rewriter_before_opt_a : 0.000101s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000073s : 0.12% jit_opt_a.loop_unroll : 0.000042s : 0.07% jit_opt_a.a_1 : 0.000853s : 1.36% jit_opt_a.with_stream_mark : 0.000032s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002689s : 4.29% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.04% jit_opt_a.cse : 0.000055s : 0.09% jit_opt_a.replace_applicator : 0.000033s : 0.05% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000042s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000767s : 1.22% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000474s : 0.76% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000055s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000466s : 0.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000071s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.08% Time group info: ------[substitution.] 0.000263 25 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000007s : 4: substitution.graph_param_transform 85.18% : 0.000224s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000006s : 4: substitution.remove_not_recompute_node 2.22% : 0.000006s : 2: substitution.replace_old_param 5.18% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055519 2 96.17% : 0.053392s : 1: type_inference.infer 3.83% : 0.002127s : 1: type_inference.specialize ------[replace.] 0.000103 7 67.99% : 0.000070s : 5: replace.inline 32.01% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 7 94.76% : 0.000220s : 5: match.inline 5.24% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 888 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.25% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.94% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.99% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.37% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.21% : 0.000011s : 65: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002187 25 66.80% : 0.001461s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.87% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.33% : 0.000663s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070958 72 0.08% : 0.000057s : 1: add_recomputation 0.11% : 0.000080s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.51% : 0.000359s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.32% : 0.008029s : 1: jit_opt_a 0.25% : 0.000174s : 1: jit_opt_after_cconv 0.09% : 0.000064s : 1: jit_opt_b 0.68% : 0.000484s : 1: loop_unroll 1.10% : 0.000780s : 1: mutable_eliminate 1.58% : 0.001124s : 26: opt.transform.jit_opt_a 0.08% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000099s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000260s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 2.75% : 0.001952s : 1: renormalize.infer 1.02% : 0.000723s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.15% : 0.000107s : 1: rewriter_before_opt_a 0.20% : 0.000144s : 1: symbol_engine_optimizer 78.40% : 0.055631s : 1: type_inference TotalTime = 0.135036, [30] [bootstrap]: 0.00036957 [type_inference]: 0.121764 [event_method]: 2.618e-05 [auto_monad]: 8.228e-05 [graph_reusing]: 5.74999e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00076685 [rewriter_before_opt_a]: 0.0001124 [expand_dump_flag]: 4.45999e-06 [jit_opt_a]: 0.00930875, [2] [Cycle 1]: 0.00488022, [27] [switch_simplify]: 7.516e-05 [loop_unroll]: 3.534e-05 [a_1]: 0.00073976 [with_stream_mark]: 1.963e-05 [recompute_prepare]: 9.24e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 7.26999e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 7.28999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.594e-05 [j_node_and_user_rematch]: 1.113e-05 [meta_fg_expand]: 3.35e-06 [replace_old_param]: 1.175e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 0.00359212 [add_forward_monad_depend]: 8.65999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 2.061e-05 [cse]: 3.869e-05 [replace_applicator]: 2.516e-05 [Cycle 2]: 0.00043546, [27] [switch_simplify]: 7.48e-06 [loop_unroll]: 6.73e-06 [a_1]: 0.00014508 [with_stream_mark]: 1.565e-05 [recompute_prepare]: 6.54999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.83998e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 5.02999e-06 [cell_reuse_recompute_pass]: 3.88999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.60002e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 1.698e-05 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 7.38999e-06 [cse]: 1.683e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.735e-05 [rewriter_after_opt_a]: 3.865e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00074146 [jit_opt_b]: 5.997e-05, [1] [Cycle 1]: 5.253e-05, [2] [frontend_op_eliminate]: 2.056e-05 [inline_after_opt_a]: 2.012e-05 [cconv]: 3.103e-05 [loop_unroll]: 0.0004641 [jit_opt_after_cconv]: 0.00016631, [1] [Cycle 1]: 0.00015985, [11] [c_1]: 2.639e-05 [parameter_eliminate]: 3.25e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 3.024e-05 [call_graph_tuple_transform]: 2.489e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.793e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.87999e-06 [add_recomputation]: 5.487e-05 [cse_after_recomputation]: 2.673e-05, [1] [Cycle 1]: 2.029e-05, [1] [cse]: 1.382e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 7.19001e-06 [opt_after_jit_grad]: 0.00052187 [symbol_engine_optimizer]: 8.086e-05, [1] [Cycle 1]: 7.465e-05, [6] [build]: 4.51002e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.507e-05 [opt_reshape]: 6.92002e-06 [fold_const_symbol]: 1.084e-05 [renormalize]: 3.39991e-07 [validate]: 0.00011477 Sums bootstrap : 0.000370s : 0.28% type_inference : 0.121764s : 93.39% event_method : 0.000026s : 0.02% auto_monad : 0.000082s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000767s : 0.59% rewriter_before_opt_a : 0.000112s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000885s : 0.68% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000024s : 0.02% jit_opt_a.renormalize : 0.003592s : 2.76% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000741s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000031s : 0.02% loop_unroll : 0.000464s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000522s : 0.40% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000115s : 0.09% Time group info: ------[substitution.] 0.000294 28 1.09% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.22% : 0.000007s : 4: substitution.graph_param_transform 81.19% : 0.000239s : 5: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.41% : 0.000016s : 3: substitution.reduce_eliminate 1.98% : 0.000006s : 4: substitution.remove_not_recompute_node 1.94% : 0.000006s : 2: substitution.replace_old_param 4.15% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121663 2 96.95% : 0.117949s : 1: type_inference.infer 3.05% : 0.003714s : 1: type_inference.specialize ------[replace.] 0.000110 7 68.06% : 0.000075s : 5: replace.inline 31.94% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 7 95.53% : 0.000236s : 5: match.inline 4.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.46% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.28% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.20% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.02% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.72% : 0.000004s : 13: predicate.reduce_eliminate 1.67% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.58% : 0.000002s : 13: predicate.reshape_eliminate 1.50% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000011s : 64: predicate.switch_simplify 1.53% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.68% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002715 25 58.66% : 0.001592s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.41% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.94% : 0.001057s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139802 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.28% : 0.000390s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.66% : 0.009313s : 1: jit_opt_a 0.12% : 0.000169s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.34% : 0.000473s : 1: loop_unroll 0.54% : 0.000750s : 1: mutable_eliminate 0.84% : 0.001174s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.55% : 0.000776s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.78% : 0.002486s : 1: renormalize.infer 0.78% : 0.001092s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000119s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 87.11% : 0.121787s : 1: type_inference TotalTime = 0.125547, [30] [bootstrap]: 0.00029308 [type_inference]: 0.113804 [event_method]: 2.043e-05 [auto_monad]: 7.294e-05 [graph_reusing]: 6.47001e-06 [pre_auto_parallel]: 3.35e-06 [py_interpret_to_execute]: 0.00068093 [rewriter_before_opt_a]: 9.469e-05 [expand_dump_flag]: 4.01001e-06 [jit_opt_a]: 0.00804336, [2] [Cycle 1]: 0.00401128, [27] [switch_simplify]: 6.569e-05 [loop_unroll]: 3.161e-05 [a_1]: 0.00063585 [with_stream_mark]: 1.733e-05 [recompute_prepare]: 9.00001e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.88e-06 [accelerated_algorithm]: 6.76e-06 [meta_shard_fg_expand]: 2.48002e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.639e-05 [j_node_and_user_rematch]: 1.102e-05 [meta_fg_expand]: 2.60002e-06 [replace_old_param]: 9.74999e-06 [inline_without_move]: 6.68998e-06 [renormalize]: 0.00288294 [add_forward_monad_depend]: 7.83999e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.872e-05 [cse]: 3.27e-05 [replace_applicator]: 2.09e-05 [Cycle 2]: 0.00041523, [27] [switch_simplify]: 8.54998e-06 [loop_unroll]: 7.45e-06 [a_1]: 0.00014509 [with_stream_mark]: 1.192e-05 [recompute_prepare]: 6.01998e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 3.16999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.22999e-06 [inline_without_move]: 5.87999e-06 [renormalize]: 1.30007e-07 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.345e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 9.09998e-06 [rewriter_after_opt_a]: 3.455e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00061184 [jit_opt_b]: 6.236e-05, [1] [Cycle 1]: 5.462e-05, [2] [frontend_op_eliminate]: 2.306e-05 [inline_after_opt_a]: 1.854e-05 [cconv]: 2.67e-05 [loop_unroll]: 0.00046237 [jit_opt_after_cconv]: 0.00016371, [1] [Cycle 1]: 0.00015511, [11] [c_1]: 2.787e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 6.29001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.435e-05 [call_graph_tuple_transform]: 2.21e-05 [tuple_list_get_item_eliminator]: 7.11001e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.693e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.127e-05 [add_recomputation]: 5.006e-05 [cse_after_recomputation]: 2.597e-05, [1] [Cycle 1]: 1.795e-05, [1] [cse]: 1.222e-05 [auto_monad_reorder]: 1.99e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 5.22e-06 [opt_after_jit_grad]: 0.00053032 [symbol_engine_optimizer]: 0.00022546, [1] [Cycle 1]: 0.00021834, [6] [build]: 4.75001e-06 [elim_shapecalc]: 9.61e-06 [elim_not_effective]: 0.00015314 [opt_reshape]: 8.03999e-06 [fold_const_symbol]: 1.047e-05 [renormalize]: 3.69997e-07 [validate]: 5.294e-05 Sums bootstrap : 0.000293s : 0.24% type_inference : 0.113804s : 93.83% event_method : 0.000020s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000681s : 0.56% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000781s : 0.64% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002883s : 2.38% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000612s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000462s : 0.38% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000530s : 0.44% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000153s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.04% Time group info: ------[substitution.] 0.000238 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 4: substitution.graph_param_transform 84.15% : 0.000200s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000005s : 2: substitution.replace_old_param 5.66% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113726 2 97.45% : 0.110826s : 1: type_inference.infer 2.55% : 0.002900s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.99% : 0.000054s : 4: replace.inline 33.01% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.20% : 0.000197s : 4: match.inline 5.80% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 2.21% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.80% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.37% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.98% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.59% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.77% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 18: predicate.load_eliminater 1.64% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.99% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.47% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.42% : 0.000011s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.40% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.82% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002331 22 63.22% : 0.001473s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.04% : 0.000817s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129664 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.24% : 0.000306s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.21% : 0.008047s : 1: jit_opt_a 0.13% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.36% : 0.000470s : 1: loop_unroll 0.48% : 0.000621s : 1: mutable_eliminate 0.80% : 0.001040s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000177s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000541s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.53% : 0.000690s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.56% : 0.002019s : 1: renormalize.infer 0.66% : 0.000852s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.18% : 0.000229s : 1: symbol_engine_optimizer 87.78% : 0.113818s : 1: type_inference TotalTime = 0.122334, [30] [bootstrap]: 0.00027953 [type_inference]: 0.111179 [event_method]: 2.444e-05 [auto_monad]: 7.237e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.43002e-06 [py_interpret_to_execute]: 0.00049196 [rewriter_before_opt_a]: 9.25e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00784949, [2] [Cycle 1]: 0.00403337, [27] [switch_simplify]: 5.666e-05 [loop_unroll]: 3.514e-05 [a_1]: 0.00067089 [with_stream_mark]: 1.378e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 6.65998e-06 [accelerated_algorithm]: 7.58001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 6.77002e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.315e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 6.38e-06 [renormalize]: 0.00291995 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.628e-05 [cse]: 2.881e-05 [replace_applicator]: 1.476e-05 [Cycle 2]: 0.00038356, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00013315 [with_stream_mark]: 1.297e-05 [recompute_prepare]: 6.28e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.81003e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.93998e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 2.35002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 8.94998e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.352e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.462e-05 [rewriter_after_opt_a]: 3.584e-05 [convert_after_rewriter]: 6.53998e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00065254 [jit_opt_b]: 5.655e-05, [1] [Cycle 1]: 4.822e-05, [2] [frontend_op_eliminate]: 1.938e-05 [inline_after_opt_a]: 1.755e-05 [cconv]: 2.609e-05 [loop_unroll]: 0.00043912 [jit_opt_after_cconv]: 0.00019522, [1] [Cycle 1]: 0.00018879, [11] [c_1]: 2.565e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.374e-05 [call_graph_tuple_transform]: 2.331e-05 [tuple_list_get_item_eliminator]: 4.311e-05 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.51999e-06 [remove_dup_value]: 1.871e-05 [partial_unused_args_eliminate]: 2.74999e-06 [environ_conv]: 7.62002e-06 [add_recomputation]: 4.946e-05 [cse_after_recomputation]: 2.534e-05, [1] [Cycle 1]: 1.981e-05, [1] [cse]: 1.356e-05 [auto_monad_reorder]: 1.792e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00048069 [symbol_engine_optimizer]: 7.742e-05, [1] [Cycle 1]: 7.086e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 8.21002e-06 [elim_not_effective]: 1.365e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 8.95999e-06 [renormalize]: 3.19997e-07 [validate]: 4.107e-05 Sums bootstrap : 0.000280s : 0.24% type_inference : 0.111179s : 93.96% event_method : 0.000024s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000492s : 0.42% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000804s : 0.68% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002920s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000653s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000439s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000043s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000481s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000243 28 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.95% : 0.000007s : 4: substitution.graph_param_transform 80.70% : 0.000196s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.72% : 0.000014s : 3: substitution.reduce_eliminate 1.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.61% : 0.000004s : 2: substitution.replace_old_param 4.49% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111101 2 97.41% : 0.108229s : 1: type_inference.infer 2.59% : 0.002873s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.63% : 0.000066s : 5: replace.inline 32.37% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 7 95.30% : 0.000193s : 5: match.inline 4.70% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.62% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.04% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.76% : 0.000003s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.04% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.34% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000010s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.54% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002389 25 61.36% : 0.001466s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.05% : 0.000861s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126413 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000291s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.21% : 0.007853s : 1: jit_opt_a 0.16% : 0.000198s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.35% : 0.000448s : 1: loop_unroll 0.52% : 0.000661s : 1: mutable_eliminate 0.83% : 0.001045s : 26: opt.transform.jit_opt_a 0.08% : 0.000095s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000498s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.59% : 0.002005s : 1: renormalize.infer 0.72% : 0.000906s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.96% : 0.111198s : 1: type_inference TotalTime = 0.0185295, [30] [bootstrap]: 0.0003362 [type_inference]: 0.00834865 [event_method]: 1.895e-05 [auto_monad]: 6.164e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 1.70001e-06 [py_interpret_to_execute]: 4.549e-05 [rewriter_before_opt_a]: 8.223e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00749374, [2] [Cycle 1]: 0.0040085, [27] [switch_simplify]: 5.158e-05 [loop_unroll]: 5.509e-05 [a_1]: 0.00064576 [with_stream_mark]: 1.373e-05 [recompute_prepare]: 7.48999e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.91998e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.41998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.266e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00078475 [add_forward_monad_depend]: 5.07999e-06 [auto_monad_grad]: 1.51998e-06 [auto_monad_eliminator]: 1.279e-05 [cse]: 2.995e-05 [replace_applicator]: 1.365e-05 [Cycle 2]: 0.00038804, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.46e-06 [a_1]: 0.00013758 [with_stream_mark]: 9.94999e-06 [recompute_prepare]: 5.85002e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 5.33002e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 5.11002e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.63002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.406e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.706e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.156e-05 [rewriter_after_opt_a]: 3.347e-05 [convert_after_rewriter]: 6.53998e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00058889 [jit_opt_b]: 5.014e-05, [1] [Cycle 1]: 4.403e-05, [2] [frontend_op_eliminate]: 1.619e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 1.724e-05 [loop_unroll]: 0.00041993 [jit_opt_after_cconv]: 0.00014958, [1] [Cycle 1]: 0.00014282, [11] [c_1]: 2.175e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.39e-05 [call_graph_tuple_transform]: 1.886e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 1.15999e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.62001e-06 [remove_dup_value]: 3.167e-05 [partial_unused_args_eliminate]: 1.84998e-06 [environ_conv]: 4.37e-06 [add_recomputation]: 3.434e-05 [cse_after_recomputation]: 2.531e-05, [1] [Cycle 1]: 1.98e-05, [1] [cse]: 1.357e-05 [auto_monad_reorder]: 1.182e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 4.72e-06 [opt_after_jit_grad]: 0.00045196 [symbol_engine_optimizer]: 7.146e-05, [1] [Cycle 1]: 6.545e-05, [6] [build]: 2.63e-06 [elim_shapecalc]: 8.12998e-06 [elim_not_effective]: 1.238e-05 [opt_reshape]: 5.82001e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 4.80009e-07 [validate]: 3.249e-05 Sums bootstrap : 0.000336s : 2.65% type_inference : 0.008349s : 65.71% event_method : 0.000019s : 0.15% auto_monad : 0.000062s : 0.49% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000045s : 0.36% rewriter_before_opt_a : 0.000082s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.46% jit_opt_a.loop_unroll : 0.000061s : 0.48% jit_opt_a.a_1 : 0.000783s : 6.17% jit_opt_a.with_stream_mark : 0.000024s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000785s : 6.18% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.15% jit_opt_a.cse : 0.000047s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000033s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000589s : 4.63% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.13% cconv : 0.000017s : 0.14% loop_unroll : 0.000420s : 3.30% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000032s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000004s : 0.03% add_recomputation : 0.000034s : 0.27% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000012s : 0.09% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000452s : 3.56% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.26% Time group info: ------[substitution.] 0.000240 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 1.83% : 0.000004s : 3: substitution.graph_param_transform 87.22% : 0.000209s : 5: substitution.inline 1.22% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008288 2 87.09% : 0.007218s : 1: type_inference.infer 12.91% : 0.001070s : 1: type_inference.specialize ------[replace.] 0.000097 7 66.57% : 0.000064s : 5: replace.inline 33.43% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.25% : 0.000206s : 5: match.inline 4.75% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.29% : 0.000002s : 11: predicate.addn_zero_filter 2.36% : 0.000003s : 11: predicate.arithmetic_simplify 1.26% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.80% : 0.000002s : 11: predicate.depend_value_elim 1.06% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.70% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 16: predicate.load_eliminater 1.09% : 0.000001s : 3: predicate.loop_unroll_after_grad 6.86% : 0.000009s : 38: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000001s : 3: predicate.opt_reshape 1.94% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 1.76% : 0.000002s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.42% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.36% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.54% : 0.000010s : 59: predicate.switch_simplify 1.34% : 0.000002s : 11: predicate.tile_eliminate 1.41% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000762 16 48.98% : 0.000373s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.87% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.14% : 0.000329s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020395 72 0.18% : 0.000037s : 1: add_recomputation 0.32% : 0.000065s : 1: auto_monad 0.07% : 0.000014s : 1: auto_monad_reorder 1.74% : 0.000354s : 1: bootstrap 0.10% : 0.000020s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000006s : 1: environ_conv 0.11% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 36.76% : 0.007497s : 1: jit_opt_a 0.75% : 0.000152s : 1: jit_opt_after_cconv 0.26% : 0.000053s : 1: jit_opt_b 2.10% : 0.000428s : 1: loop_unroll 2.93% : 0.000598s : 1: mutable_eliminate 5.02% : 0.001024s : 26: opt.transform.jit_opt_a 0.24% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.25% : 0.000460s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000049s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.17% : 0.000035s : 1: remove_dup_value 2.21% : 0.000450s : 1: renormalize.infer 1.60% : 0.000326s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000037s : 1: rewriter_after_opt_a 0.42% : 0.000085s : 1: rewriter_before_opt_a 0.36% : 0.000074s : 1: symbol_engine_optimizer 41.00% : 0.008362s : 1: type_inference TotalTime = 0.0128512, [30] [bootstrap]: 0.00027885 [type_inference]: 0.00465765 [event_method]: 1.776e-05 [auto_monad]: 6.39e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 3.713e-05 [rewriter_before_opt_a]: 7.385e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00545951, [2] [Cycle 1]: 0.00165, [27] [switch_simplify]: 6.598e-05 [loop_unroll]: 3.049e-05 [a_1]: 0.00053363 [with_stream_mark]: 1.689e-05 [recompute_prepare]: 7.49002e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.706e-05 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 8.71002e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00064611 [add_forward_monad_depend]: 5.17999e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.531e-05 [cse]: 2.8e-05 [replace_applicator]: 1.192e-05 [Cycle 2]: 0.00031888, [27] [switch_simplify]: 5.99999e-06 [loop_unroll]: 4.87e-06 [a_1]: 9.295e-05 [with_stream_mark]: 9.06002e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 4.89e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.45002e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 7.66001e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 7.05998e-06 [inline_without_move]: 4.62e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.73997e-06 [cse]: 1.143e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.027e-05 [rewriter_after_opt_a]: 3.425e-05 [convert_after_rewriter]: 7.37002e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00064447 [jit_opt_b]: 5.3e-05, [1] [Cycle 1]: 4.617e-05, [2] [frontend_op_eliminate]: 1.779e-05 [inline_after_opt_a]: 1.639e-05 [cconv]: 2.514e-05 [loop_unroll]: 0.00043905 [jit_opt_after_cconv]: 0.00015461, [1] [Cycle 1]: 0.00014809, [11] [c_1]: 2.31e-05 [parameter_eliminate]: 2.85002e-06 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.29e-05 [call_graph_tuple_transform]: 2.024e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.75001e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.497e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 5.62001e-06 [add_recomputation]: 5.422e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.683e-05, [1] [cse]: 1.089e-05 [auto_monad_reorder]: 1.936e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.34e-06 [opt_after_jit_grad]: 0.0004639 [symbol_engine_optimizer]: 7.598e-05, [1] [Cycle 1]: 7.001e-05, [6] [build]: 3.38999e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 1.4e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.44e-06 [renormalize]: 5.3001e-07 [validate]: 3.555e-05 Sums bootstrap : 0.000279s : 3.18% type_inference : 0.004658s : 53.10% event_method : 0.000018s : 0.20% auto_monad : 0.000064s : 0.73% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.42% rewriter_before_opt_a : 0.000074s : 0.84% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000072s : 0.82% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000627s : 7.14% jit_opt_a.with_stream_mark : 0.000026s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000028s : 0.32% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000646s : 7.37% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000039s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000034s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000644s : 7.35% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000025s : 0.29% loop_unroll : 0.000439s : 5.01% jit_opt_after_cconv.c_1 : 0.000023s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000054s : 0.62% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000019s : 0.22% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000464s : 5.29% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000036s : 0.41% Time group info: ------[substitution.] 0.000201 23 1.21% : 0.000002s : 2: substitution.elim_not_effective 0.97% : 0.000002s : 2: substitution.fold_const_symbol 3.01% : 0.000006s : 3: substitution.graph_param_transform 83.13% : 0.000167s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000004s : 2: substitution.replace_old_param 6.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004597 2 81.28% : 0.003737s : 1: type_inference.infer 18.72% : 0.000861s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.94% : 0.000047s : 4: replace.inline 33.06% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.73% : 0.000164s : 4: match.inline 6.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.53% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.35% : 0.000002s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.60% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.84% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.03% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.73% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.01% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.55% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000618 13 51.51% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.03% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.46% : 0.000269s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014416 72 0.40% : 0.000057s : 1: add_recomputation 0.47% : 0.000067s : 1: auto_monad 0.15% : 0.000022s : 1: auto_monad_reorder 2.04% : 0.000295s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.90% : 0.005463s : 1: jit_opt_a 1.09% : 0.000158s : 1: jit_opt_after_cconv 0.38% : 0.000055s : 1: jit_opt_b 3.16% : 0.000455s : 1: loop_unroll 4.54% : 0.000654s : 1: mutable_eliminate 5.88% : 0.000848s : 26: opt.transform.jit_opt_a 0.36% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000028s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.28% : 0.000473s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.30% : 0.000332s : 1: renormalize.infer 2.12% : 0.000306s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000037s : 1: rewriter_after_opt_a 0.53% : 0.000077s : 1: rewriter_before_opt_a 0.55% : 0.000079s : 1: symbol_engine_optimizer 32.39% : 0.004670s : 1: type_inference TotalTime = 0.019519, [30] [bootstrap]: 0.00028012 [type_inference]: 0.00992903 [event_method]: 2.318e-05 [auto_monad]: 7.167e-05 [graph_reusing]: 7.11999e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 5.508e-05 [rewriter_before_opt_a]: 9.137e-05 [expand_dump_flag]: 3.29001e-06 [jit_opt_a]: 0.00557727, [2] [Cycle 1]: 0.00189368, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 3.38e-05 [a_1]: 0.0006308 [with_stream_mark]: 1.74e-05 [recompute_prepare]: 8.13999e-06 [updatestate_depend_eliminate]: 4.90999e-06 [updatestate_assign_eliminate]: 4.40999e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.30997e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.61998e-06 [inline_without_move]: 6.23002e-06 [renormalize]: 0.00080649 [add_forward_monad_depend]: 5.47001e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.557e-05 [cse]: 3.914e-05 [replace_applicator]: 1.261e-05 [Cycle 2]: 0.00036741, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.35001e-06 [a_1]: 0.00012876 [with_stream_mark]: 9.96998e-06 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 3.05998e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.82998e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.67999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.317e-05 [j_node_and_user_rematch]: 8.26002e-06 [meta_fg_expand]: 1.83997e-06 [replace_old_param]: 8.11002e-06 [inline_without_move]: 5.12e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.28998e-06 [cse]: 1.593e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.214e-05 [rewriter_after_opt_a]: 4.071e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 4.96002e-06 [mutable_eliminate]: 0.00184301 [jit_opt_b]: 5.18e-05, [1] [Cycle 1]: 4.49e-05, [2] [frontend_op_eliminate]: 1.624e-05 [inline_after_opt_a]: 1.721e-05 [cconv]: 2.651e-05 [loop_unroll]: 0.00041643 [jit_opt_after_cconv]: 0.00015267, [1] [Cycle 1]: 0.00014649, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 6.07999e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.71999e-06 [cse]: 3.068e-05 [call_graph_tuple_transform]: 1.935e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.53002e-06 [remove_dup_value]: 3.751e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.21998e-06 [add_recomputation]: 6.077e-05 [cse_after_recomputation]: 2.525e-05, [1] [Cycle 1]: 1.949e-05, [1] [cse]: 1.317e-05 [auto_monad_reorder]: 1.854e-05 [get_jit_bprop_graph]: 2.54999e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00048185 [symbol_engine_optimizer]: 7.21e-05, [1] [Cycle 1]: 6.605e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 7.83999e-06 [elim_not_effective]: 1.281e-05 [opt_reshape]: 5.74999e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 5.3001e-07 [validate]: 3.835e-05 Sums bootstrap : 0.000280s : 1.79% type_inference : 0.009929s : 63.54% event_method : 0.000023s : 0.15% auto_monad : 0.000072s : 0.46% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000055s : 0.35% rewriter_before_opt_a : 0.000091s : 0.58% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000066s : 0.43% jit_opt_a.loop_unroll : 0.000039s : 0.25% jit_opt_a.a_1 : 0.000760s : 4.86% jit_opt_a.with_stream_mark : 0.000027s : 0.18% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000807s : 5.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.14% jit_opt_a.cse : 0.000055s : 0.35% jit_opt_a.replace_applicator : 0.000018s : 0.11% py_interpret_to_execute_after_opt_a : 0.000012s : 0.08% rewriter_after_opt_a : 0.000041s : 0.26% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.001843s : 11.79% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000027s : 0.17% loop_unroll : 0.000416s : 2.67% jit_opt_after_cconv.c_1 : 0.000021s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000038s : 0.24% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.03% add_recomputation : 0.000061s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.08% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000482s : 3.08% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.25% Time group info: ------[substitution.] 0.000240 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 85.73% : 0.000206s : 5: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.75% : 0.000004s : 4: substitution.remove_not_recompute_node 2.22% : 0.000005s : 2: substitution.replace_old_param 5.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009855 2 87.07% : 0.008581s : 1: type_inference.infer 12.93% : 0.001274s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.97% : 0.000064s : 5: replace.inline 31.03% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 7 94.59% : 0.000203s : 5: match.inline 5.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.56% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.17% : 0.000001s : 11: predicate.addn_zero_filter 1.68% : 0.000002s : 11: predicate.arithmetic_simplify 1.21% : 0.000002s : 11: predicate.cast_eliminate 0.64% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 1.08% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.12% : 0.000001s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000000s : 3: predicate.graph_param_transform 5.67% : 0.000007s : 24: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 16: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 2.08% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000001s : 11: predicate.print_const_string_wrapper 2.76% : 0.000003s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.33% : 0.000010s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.18% : 0.000001s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000921 16 48.91% : 0.000451s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.28% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.82% : 0.000404s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021373 72 0.30% : 0.000064s : 1: add_recomputation 0.35% : 0.000076s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.40% : 0.000299s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000007s : 1: environ_conv 0.13% : 0.000028s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 26.11% : 0.005580s : 1: jit_opt_a 0.73% : 0.000155s : 1: jit_opt_after_cconv 0.26% : 0.000055s : 1: jit_opt_b 1.98% : 0.000424s : 1: loop_unroll 8.68% : 0.001854s : 1: mutable_eliminate 4.61% : 0.000985s : 26: opt.transform.jit_opt_a 0.22% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000018s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.29% : 0.000490s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000058s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000040s : 1: remove_dup_value 1.90% : 0.000407s : 1: renormalize.infer 1.83% : 0.000390s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000044s : 1: rewriter_after_opt_a 0.44% : 0.000094s : 1: rewriter_before_opt_a 0.35% : 0.000075s : 1: symbol_engine_optimizer 46.54% : 0.009946s : 1: type_inference TotalTime = 0.0158119, [30] [bootstrap]: 0.00025517 [type_inference]: 0.0076265 [event_method]: 1.858e-05 [auto_monad]: 7.089e-05 [graph_reusing]: 5.76998e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 4.368e-05 [rewriter_before_opt_a]: 8.075e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00565816, [2] [Cycle 1]: 0.00187198, [27] [switch_simplify]: 6.193e-05 [loop_unroll]: 3.364e-05 [a_1]: 0.00065433 [with_stream_mark]: 1.753e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 6.69001e-06 [meta_shard_fg_expand]: 2.99001e-06 [get_grad_eliminate_]: 5.78002e-06 [merge_forward]: 4.44002e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.629e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.51999e-06 [renormalize]: 0.00071306 [add_forward_monad_depend]: 5.25001e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 3.282e-05 [cse]: 3.357e-05 [replace_applicator]: 1.395e-05 [Cycle 2]: 0.00035385, [27] [switch_simplify]: 6.77002e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.0001002 [with_stream_mark]: 1.06e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.25999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.29999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.083e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.12998e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 1.60001e-06 [auto_monad_eliminator]: 5.81003e-06 [cse]: 1.493e-05 [replace_applicator]: 5.31998e-06 [py_interpret_to_execute_after_opt_a]: 1.237e-05 [rewriter_after_opt_a]: 3.58e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00052996 [jit_opt_b]: 5.779e-05, [1] [Cycle 1]: 5.062e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 2.42e-05 [cconv]: 2.492e-05 [loop_unroll]: 0.00040906 [jit_opt_after_cconv]: 0.00014552, [1] [Cycle 1]: 0.00013922, [11] [c_1]: 2.072e-05 [parameter_eliminate]: 1.88002e-06 [updatestate_depend_eliminate]: 4.89003e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 2.141e-05 [call_graph_tuple_transform]: 1.847e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.30001e-06 [remove_dup_value]: 1.595e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 6.37001e-06 [add_recomputation]: 4.962e-05 [cse_after_recomputation]: 2.314e-05, [1] [Cycle 1]: 1.806e-05, [1] [cse]: 1.164e-05 [auto_monad_reorder]: 1.806e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 3.78001e-06 [opt_after_jit_grad]: 0.00043594 [symbol_engine_optimizer]: 7.222e-05, [1] [Cycle 1]: 6.634e-05, [6] [build]: 3.07002e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.209e-05 [opt_reshape]: 5.47001e-06 [fold_const_symbol]: 8.38999e-06 [renormalize]: 3.80009e-07 [validate]: 3.503e-05 Sums bootstrap : 0.000255s : 2.17% type_inference : 0.007626s : 64.79% event_method : 0.000019s : 0.16% auto_monad : 0.000071s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.37% rewriter_before_opt_a : 0.000081s : 0.69% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.58% jit_opt_a.loop_unroll : 0.000039s : 0.33% jit_opt_a.a_1 : 0.000755s : 6.41% jit_opt_a.with_stream_mark : 0.000028s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000012s : 0.10% jit_opt_a.renormalize : 0.000713s : 6.06% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000039s : 0.33% jit_opt_a.cse : 0.000048s : 0.41% jit_opt_a.replace_applicator : 0.000019s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000036s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000530s : 4.50% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000024s : 0.21% cconv : 0.000025s : 0.21% loop_unroll : 0.000409s : 3.48% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000436s : 3.70% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.30% Time group info: ------[substitution.] 0.000247 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000006s : 3: substitution.graph_param_transform 82.38% : 0.000203s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000010s : 3: substitution.reduce_eliminate 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000004s : 2: substitution.replace_old_param 4.85% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007563 2 87.44% : 0.006614s : 1: type_inference.infer 12.56% : 0.000950s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.38% : 0.000061s : 5: replace.inline 32.62% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 94.88% : 0.000200s : 5: match.inline 5.12% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.22% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.59% : 0.000002s : 11: predicate.addn_zero_filter 2.12% : 0.000003s : 11: predicate.arithmetic_simplify 1.32% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.16% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.33% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 11: predicate.environ_get_depend_swap 1.18% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 5.75% : 0.000007s : 24: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.02% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 1.19% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000002s : 11: predicate.print_const_string_wrapper 1.99% : 0.000003s : 11: predicate.reduce_eliminate 1.45% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 11: predicate.reshape_eliminate 1.31% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.75% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.98% : 0.000004s : 18: predicate.switch_defer_inline 2.46% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.84% : 0.000010s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.53% : 0.000002s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000726 16 49.44% : 0.000359s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.26% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.30% : 0.000307s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017578 72 0.30% : 0.000053s : 1: add_recomputation 0.42% : 0.000074s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.52% : 0.000268s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 32.21% : 0.005661s : 1: jit_opt_a 0.84% : 0.000148s : 1: jit_opt_after_cconv 0.34% : 0.000060s : 1: jit_opt_b 2.37% : 0.000417s : 1: loop_unroll 3.06% : 0.000539s : 1: mutable_eliminate 5.60% : 0.000985s : 26: opt.transform.jit_opt_a 0.27% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000034s : 4: opt.transform.jit_opt_b 0.06% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000444s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.21% : 0.000389s : 1: renormalize.infer 1.80% : 0.000316s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000039s : 1: rewriter_after_opt_a 0.48% : 0.000083s : 1: rewriter_before_opt_a 0.42% : 0.000075s : 1: symbol_engine_optimizer 43.46% : 0.007639s : 1: type_inference TotalTime = 0.0129733, [30] [bootstrap]: 0.00028815 [type_inference]: 0.00504604 [event_method]: 1.844e-05 [auto_monad]: 7.555e-05 [graph_reusing]: 6.30002e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 4.402e-05 [rewriter_before_opt_a]: 7.593e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00532646, [2] [Cycle 1]: 0.00176264, [27] [switch_simplify]: 5.577e-05 [loop_unroll]: 3.026e-05 [a_1]: 0.00058652 [with_stream_mark]: 1.763e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 2.95998e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.18002e-06 [renormalize]: 0.00072462 [add_forward_monad_depend]: 4.75999e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 1.506e-05 [cse]: 2.874e-05 [replace_applicator]: 1.24e-05 [Cycle 2]: 0.00032052, [27] [switch_simplify]: 5.81e-06 [loop_unroll]: 4.67e-06 [a_1]: 8.849e-05 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 4.74e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.331e-05 [j_node_and_user_rematch]: 7.88001e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 4.67e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 1.21002e-06 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.314e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 9.61003e-06 [rewriter_after_opt_a]: 3.361e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.51998e-06 [mutable_eliminate]: 0.00052481 [jit_opt_b]: 5.953e-05, [1] [Cycle 1]: 5.294e-05, [2] [frontend_op_eliminate]: 1.616e-05 [inline_after_opt_a]: 2.536e-05 [cconv]: 2.598e-05 [loop_unroll]: 0.00041635 [jit_opt_after_cconv]: 0.00015209, [1] [Cycle 1]: 0.00014563, [11] [c_1]: 2.064e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.53998e-06 [cse]: 1.912e-05 [call_graph_tuple_transform]: 1.903e-05 [tuple_list_get_item_eliminator]: 5.67001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.62001e-06 [remove_dup_value]: 1.404e-05 [partial_unused_args_eliminate]: 2.69001e-06 [environ_conv]: 5.27999e-06 [add_recomputation]: 4.96e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.601e-05, [1] [cse]: 1.049e-05 [auto_monad_reorder]: 1.524e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.0004635 [symbol_engine_optimizer]: 7.24e-05, [1] [Cycle 1]: 6.663e-05, [6] [build]: 3.36999e-06 [elim_shapecalc]: 8.03001e-06 [elim_not_effective]: 1.253e-05 [opt_reshape]: 5.88002e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 4.09986e-07 [validate]: 3.549e-05 Sums bootstrap : 0.000288s : 3.16% type_inference : 0.005046s : 55.27% event_method : 0.000018s : 0.20% auto_monad : 0.000076s : 0.83% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000044s : 0.48% rewriter_before_opt_a : 0.000076s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.38% jit_opt_a.a_1 : 0.000675s : 7.39% jit_opt_a.with_stream_mark : 0.000027s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000725s : 7.94% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000042s : 0.46% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000034s : 0.37% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000525s : 5.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000025s : 0.28% cconv : 0.000026s : 0.28% loop_unroll : 0.000416s : 4.56% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000014s : 0.15% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000050s : 0.54% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000464s : 5.08% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.39% Time group info: ------[substitution.] 0.000188 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.84% : 0.000005s : 3: substitution.graph_param_transform 81.96% : 0.000154s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000005s : 4: substitution.remove_not_recompute_node 2.42% : 0.000005s : 2: substitution.replace_old_param 6.61% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004983 2 79.92% : 0.003983s : 1: type_inference.infer 20.08% : 0.001000s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.73% : 0.000048s : 4: replace.inline 34.27% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.14% : 0.000152s : 4: match.inline 6.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.61% : 0.000007s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000002s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000676 13 50.35% : 0.000341s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.47% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.18% : 0.000306s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014653 72 0.36% : 0.000052s : 1: add_recomputation 0.54% : 0.000080s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.08% : 0.000305s : 1: bootstrap 0.20% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 36.38% : 0.005330s : 1: jit_opt_a 1.06% : 0.000155s : 1: jit_opt_after_cconv 0.42% : 0.000062s : 1: jit_opt_b 2.90% : 0.000425s : 1: loop_unroll 3.64% : 0.000533s : 1: mutable_eliminate 6.05% : 0.000887s : 26: opt.transform.jit_opt_a 0.32% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.24% : 0.000035s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.22% : 0.000472s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000047s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000016s : 1: remove_dup_value 2.62% : 0.000383s : 1: renormalize.infer 2.27% : 0.000333s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000036s : 1: rewriter_after_opt_a 0.54% : 0.000079s : 1: rewriter_before_opt_a 0.51% : 0.000075s : 1: symbol_engine_optimizer 34.52% : 0.005058s : 1: type_inference TotalTime = 0.130814, [30] [bootstrap]: 0.0002931 [type_inference]: 0.119265 [event_method]: 1.9e-05 [auto_monad]: 8.521e-05 [graph_reusing]: 4.63999e-06 [pre_auto_parallel]: 1.72001e-06 [py_interpret_to_execute]: 0.00055161 [rewriter_before_opt_a]: 9.117e-05 [expand_dump_flag]: 2.59999e-06 [jit_opt_a]: 0.0082373, [2] [Cycle 1]: 0.00404969, [27] [switch_simplify]: 5.764e-05 [loop_unroll]: 3.543e-05 [a_1]: 0.00069184 [with_stream_mark]: 4.091e-05 [recompute_prepare]: 9.46998e-06 [updatestate_depend_eliminate]: 3.80998e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 7.62998e-06 [updatestate_useless_node_eliminater]: 6.72002e-06 [accelerated_algorithm]: 7.95e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 7.16001e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.352e-05 [j_node_and_user_rematch]: 1.123e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 6.86001e-06 [renormalize]: 0.00289578 [add_forward_monad_depend]: 5.82999e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.201e-05 [cse]: 2.138e-05 [replace_applicator]: 1.444e-05 [Cycle 2]: 0.00037639, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 6.29001e-06 [a_1]: 0.00013254 [with_stream_mark]: 9.69999e-06 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 2.96999e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.282e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 8.28001e-06 [inline_without_move]: 6.14001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.42999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.415e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.206e-05 [rewriter_after_opt_a]: 6.224e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.70999e-06 [mutable_eliminate]: 0.00059632 [jit_opt_b]: 5.471e-05, [1] [Cycle 1]: 4.863e-05, [2] [frontend_op_eliminate]: 1.945e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 2.213e-05 [loop_unroll]: 0.00042997 [jit_opt_after_cconv]: 0.00014978, [1] [Cycle 1]: 0.00014279, [11] [c_1]: 2.59e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.173e-05 [call_graph_tuple_transform]: 2.019e-05 [tuple_list_get_item_eliminator]: 6.11998e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 6.54999e-06 [remove_dup_value]: 1.172e-05 [partial_unused_args_eliminate]: 1.42999e-06 [environ_conv]: 7.49002e-06 [add_recomputation]: 6.723e-05 [cse_after_recomputation]: 2.454e-05, [1] [Cycle 1]: 1.919e-05, [1] [cse]: 1.329e-05 [auto_monad_reorder]: 1.385e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 5.15001e-06 [opt_after_jit_grad]: 0.00046588 [symbol_engine_optimizer]: 9.104e-05, [1] [Cycle 1]: 8.528e-05, [6] [build]: 2.48e-06 [elim_shapecalc]: 8.67e-06 [elim_not_effective]: 1.293e-05 [opt_reshape]: 7.16001e-06 [fold_const_symbol]: 2.606e-05 [renormalize]: 3.49974e-07 [validate]: 7.011e-05 Sums bootstrap : 0.000293s : 0.23% type_inference : 0.119265s : 94.33% event_method : 0.000019s : 0.02% auto_monad : 0.000085s : 0.07% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000552s : 0.44% rewriter_before_opt_a : 0.000091s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000824s : 0.65% jit_opt_a.with_stream_mark : 0.000051s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002896s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.01% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000062s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000596s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000022s : 0.02% loop_unroll : 0.000430s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000067s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000466s : 0.37% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000026s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000070s : 0.06% Time group info: ------[substitution.] 0.000257 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 6.64% : 0.000017s : 2: substitution.fold_const_symbol 1.74% : 0.000004s : 4: substitution.graph_param_transform 78.63% : 0.000202s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.08% : 0.000011s : 3: substitution.reduce_eliminate 1.74% : 0.000004s : 4: substitution.remove_not_recompute_node 1.50% : 0.000004s : 2: substitution.replace_old_param 3.88% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119191 2 97.33% : 0.116012s : 1: type_inference.infer 2.67% : 0.003179s : 1: type_inference.specialize ------[replace.] 0.000102 7 67.18% : 0.000068s : 5: replace.inline 32.82% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 7 95.82% : 0.000199s : 5: match.inline 4.18% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.44% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.24% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.01% : 0.000007s : 28: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.22% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.36% : 0.000002s : 13: predicate.print_const_string_wrapper 2.12% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.96% : 0.000010s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002346 25 61.40% : 0.001441s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.75% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.85% : 0.000841s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134843 72 0.05% : 0.000071s : 1: add_recomputation 0.07% : 0.000089s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.23% : 0.000307s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.11% : 0.008240s : 1: jit_opt_a 0.11% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.33% : 0.000438s : 1: loop_unroll 0.45% : 0.000604s : 1: mutable_eliminate 0.79% : 0.001071s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000559s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.51% : 0.002041s : 1: renormalize.infer 0.63% : 0.000847s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000066s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000094s : 1: symbol_engine_optimizer 88.45% : 0.119275s : 1: type_inference TotalTime = 0.0809928, [30] [bootstrap]: 0.000312 [type_inference]: 0.0699556 [event_method]: 2.053e-05 [auto_monad]: 6.986e-05 [graph_reusing]: 6.57002e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00040089 [rewriter_before_opt_a]: 9.041e-05 [expand_dump_flag]: 4.18999e-06 [jit_opt_a]: 0.00781249, [2] [Cycle 1]: 0.00368713, [27] [switch_simplify]: 7.737e-05 [loop_unroll]: 3.137e-05 [a_1]: 0.00063552 [with_stream_mark]: 2.431e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.33e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.61002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 9.96998e-06 [meta_fg_expand]: 3.06999e-06 [replace_old_param]: 1.069e-05 [inline_without_move]: 6.69999e-06 [renormalize]: 0.00254443 [add_forward_monad_depend]: 6.85998e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.79e-05 [cse]: 3.182e-05 [replace_applicator]: 2.046e-05 [Cycle 2]: 0.00043029, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00012748 [with_stream_mark]: 1.16e-05 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 1.98002e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 3.02002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.599e-05 [j_node_and_user_rematch]: 9.43002e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 5.62001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.225e-05 [replace_applicator]: 7.43e-06 [py_interpret_to_execute_after_opt_a]: 1.163e-05 [rewriter_after_opt_a]: 3.845e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.00066314 [jit_opt_b]: 5.665e-05, [1] [Cycle 1]: 4.97e-05, [2] [frontend_op_eliminate]: 1.971e-05 [inline_after_opt_a]: 1.821e-05 [cconv]: 2.612e-05 [loop_unroll]: 0.00043263 [jit_opt_after_cconv]: 0.00015107, [1] [Cycle 1]: 0.00014495, [11] [c_1]: 2.691e-05 [parameter_eliminate]: 2.02001e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.66999e-06 [cse]: 2.02e-05 [call_graph_tuple_transform]: 2.035e-05 [tuple_list_get_item_eliminator]: 7.17002e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.30002e-06 [remove_dup_value]: 1.605e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.54e-06 [add_recomputation]: 4.933e-05 [cse_after_recomputation]: 2.365e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.652e-05 [get_jit_bprop_graph]: 2.23002e-06 [rewriter_after_jit_bprop_graph]: 4.50999e-06 [opt_after_jit_grad]: 0.000465 [symbol_engine_optimizer]: 0.00010007, [1] [Cycle 1]: 9.353e-05, [6] [build]: 3.65998e-06 [elim_shapecalc]: 9.12001e-06 [elim_not_effective]: 3.272e-05 [opt_reshape]: 7.03998e-06 [fold_const_symbol]: 1.086e-05 [renormalize]: 4.00003e-07 [validate]: 4.281e-05 Sums bootstrap : 0.000312s : 0.41% type_inference : 0.069956s : 91.28% event_method : 0.000021s : 0.03% auto_monad : 0.000070s : 0.09% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000401s : 0.52% rewriter_before_opt_a : 0.000090s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000084s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000763s : 1.00% jit_opt_a.with_stream_mark : 0.000036s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002545s : 3.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000044s : 0.06% jit_opt_a.replace_applicator : 0.000028s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000663s : 0.87% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.03% loop_unroll : 0.000433s : 0.56% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000465s : 0.61% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000033s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.06% Time group info: ------[substitution.] 0.000244 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 4: substitution.graph_param_transform 84.23% : 0.000205s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000006s : 4: substitution.remove_not_recompute_node 2.29% : 0.000006s : 2: substitution.replace_old_param 5.60% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.069876 2 97.19% : 0.067913s : 1: type_inference.infer 2.81% : 0.001963s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.86% : 0.000055s : 4: replace.inline 32.14% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.20% : 0.000203s : 4: match.inline 5.80% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.72% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.56% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 8: predicate.less_batch_normalization 1.69% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.24% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.76% : 0.000004s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.08% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003028 34 73.74% : 0.002232s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.65% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.62% : 0.000745s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084624 72 0.06% : 0.000052s : 1: add_recomputation 0.09% : 0.000073s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.39% : 0.000331s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.24% : 0.007816s : 1: jit_opt_a 0.18% : 0.000154s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.52% : 0.000439s : 1: loop_unroll 0.79% : 0.000672s : 1: mutable_eliminate 1.21% : 0.001025s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.56% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000410s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.01% : 0.001702s : 1: renormalize.infer 0.98% : 0.000831s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.11% : 0.000095s : 1: rewriter_before_opt_a 0.12% : 0.000103s : 1: symbol_engine_optimizer 82.69% : 0.069973s : 1: type_inference TotalTime = 0.11725, [30] [bootstrap]: 0.00029395 [type_inference]: 0.106613 [event_method]: 2.225e-05 [auto_monad]: 7.388e-05 [graph_reusing]: 6.79999e-06 [pre_auto_parallel]: 2.66999e-06 [py_interpret_to_execute]: 0.00049398 [rewriter_before_opt_a]: 9.751e-05 [expand_dump_flag]: 4.02998e-06 [jit_opt_a]: 0.00736907, [2] [Cycle 1]: 0.00367769, [27] [switch_simplify]: 5.958e-05 [loop_unroll]: 3.4e-05 [a_1]: 0.00066547 [with_stream_mark]: 1.81e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.59001e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.772e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 2.60997e-06 [replace_old_param]: 1e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00248204 [add_forward_monad_depend]: 7e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.651e-05 [cse]: 3.407e-05 [replace_applicator]: 1.676e-05 [Cycle 2]: 0.00038304, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00013297 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 6.24001e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.37002e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 5.86998e-06 [cse]: 1.285e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.247e-05 [rewriter_after_opt_a]: 3.595e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00063604 [jit_opt_b]: 5.66e-05, [1] [Cycle 1]: 4.925e-05, [2] [frontend_op_eliminate]: 1.885e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 2.753e-05 [loop_unroll]: 0.00044072 [jit_opt_after_cconv]: 0.00015616, [1] [Cycle 1]: 0.00014918, [11] [c_1]: 2.607e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 2.377e-05 [call_graph_tuple_transform]: 2.178e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.13002e-06 [remove_dup_value]: 1.58e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.56002e-06 [add_recomputation]: 4.9e-05 [cse_after_recomputation]: 2.291e-05, [1] [Cycle 1]: 1.759e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.79e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 5.56998e-06 [opt_after_jit_grad]: 0.00047116 [symbol_engine_optimizer]: 7.713e-05, [1] [Cycle 1]: 7.134e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 8.82e-06 [elim_not_effective]: 1.41e-05 [opt_reshape]: 6.30002e-06 [fold_const_symbol]: 9.89001e-06 [renormalize]: 3.69997e-07 [validate]: 4.546e-05 Sums bootstrap : 0.000294s : 0.26% type_inference : 0.106613s : 94.10% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000494s : 0.44% rewriter_before_opt_a : 0.000098s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000798s : 0.70% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002482s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000636s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000441s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000471s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000250 28 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.33% : 0.000006s : 4: substitution.graph_param_transform 80.85% : 0.000202s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.97% : 0.000012s : 3: substitution.reduce_eliminate 2.43% : 0.000006s : 4: substitution.remove_not_recompute_node 2.08% : 0.000005s : 2: substitution.replace_old_param 4.50% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106537 2 97.40% : 0.103772s : 1: type_inference.infer 2.60% : 0.002765s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.36% : 0.000064s : 5: replace.inline 31.64% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 7 95.17% : 0.000200s : 5: match.inline 4.83% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 0.76% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.30% : 0.000003s : 13: predicate.arithmetic_simplify 1.18% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000008s : 28: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.88% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.06% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.77% : 0.000011s : 64: predicate.switch_simplify 1.74% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002249 25 64.77% : 0.001457s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.50% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.72% : 0.000736s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120845 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.25% : 0.000307s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.10% : 0.007372s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.37% : 0.000448s : 1: loop_unroll 0.53% : 0.000645s : 1: mutable_eliminate 0.86% : 0.001044s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000501s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.44% : 0.001739s : 1: renormalize.infer 0.61% : 0.000733s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.09% : 0.000103s : 1: rewriter_before_opt_a 0.07% : 0.000080s : 1: symbol_engine_optimizer 88.24% : 0.106631s : 1: type_inference TotalTime = 0.116796, [30] [bootstrap]: 0.00025886 [type_inference]: 0.105946 [event_method]: 1.926e-05 [auto_monad]: 6.609e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 0.00045342 [rewriter_before_opt_a]: 8.747e-05 [expand_dump_flag]: 3.98001e-06 [jit_opt_a]: 0.0076668, [2] [Cycle 1]: 0.003881, [27] [switch_simplify]: 5.968e-05 [loop_unroll]: 3.339e-05 [a_1]: 0.00061818 [with_stream_mark]: 1.626e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 4.08999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 7.28999e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 3.08998e-06 [replace_old_param]: 1.076e-05 [inline_without_move]: 7.95e-06 [renormalize]: 0.00279979 [add_forward_monad_depend]: 5.90002e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.727e-05 [cse]: 2.87e-05 [replace_applicator]: 1.693e-05 [Cycle 2]: 0.00038226, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00013174 [with_stream_mark]: 1.014e-05 [recompute_prepare]: 6.35997e-06 [updatestate_depend_eliminate]: 2.93998e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 2.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 9.22999e-06 [inline_without_move]: 5.69e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.65002e-06 [cse]: 1.145e-05 [replace_applicator]: 6.73e-06 [py_interpret_to_execute_after_opt_a]: 9.77001e-06 [rewriter_after_opt_a]: 3.295e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 4.68001e-06 [mutable_eliminate]: 0.00061326 [jit_opt_b]: 5.685e-05, [1] [Cycle 1]: 4.936e-05, [2] [frontend_op_eliminate]: 2.018e-05 [inline_after_opt_a]: 1.76e-05 [cconv]: 2.553e-05 [loop_unroll]: 0.00042556 [jit_opt_after_cconv]: 0.00015229, [1] [Cycle 1]: 0.0001452, [11] [c_1]: 2.702e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.046e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 6.46999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.592e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 8.17e-06 [add_recomputation]: 0.00012419 [cse_after_recomputation]: 2.581e-05, [1] [Cycle 1]: 1.982e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.658e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 5.32001e-06 [opt_after_jit_grad]: 0.00046562 [symbol_engine_optimizer]: 7.978e-05, [1] [Cycle 1]: 7.283e-05, [6] [build]: 2.91e-06 [elim_shapecalc]: 9.46e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 7.62002e-06 [fold_const_symbol]: 1.016e-05 [renormalize]: 3.39991e-07 [validate]: 3.871e-05 Sums bootstrap : 0.000259s : 0.23% type_inference : 0.105946s : 93.92% event_method : 0.000019s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000453s : 0.40% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000750s : 0.66% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.002800s : 2.48% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000613s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000426s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000124s : 0.11% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000466s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000214 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 2.81% : 0.000006s : 4: substitution.graph_param_transform 83.85% : 0.000179s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 5.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105875 2 97.32% : 0.103035s : 1: type_inference.infer 2.68% : 0.002840s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.04% : 0.000053s : 4: replace.inline 32.96% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 94.22% : 0.000176s : 4: match.inline 5.78% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.54% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002097 22 63.74% : 0.001336s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.63% : 0.000726s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120670 72 0.11% : 0.000128s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000272s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.36% : 0.007670s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000433s : 1: loop_unroll 0.52% : 0.000623s : 1: mutable_eliminate 0.83% : 0.000998s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000459s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.68% : 0.002028s : 1: renormalize.infer 0.63% : 0.000762s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 87.81% : 0.105960s : 1: type_inference TotalTime = 0.0654772, [30] [bootstrap]: 0.00032988 [type_inference]: 0.0549828 [event_method]: 1.933e-05 [auto_monad]: 6.836e-05 [graph_reusing]: 6.23002e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.0003352 [rewriter_before_opt_a]: 8.324e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00705364, [2] [Cycle 1]: 0.00317429, [27] [switch_simplify]: 5.683e-05 [loop_unroll]: 3.093e-05 [a_1]: 0.00058864 [with_stream_mark]: 1.837e-05 [recompute_prepare]: 9.17999e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 1.71998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 6.40002e-06 [renormalize]: 0.00213445 [add_forward_monad_depend]: 8.07e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.719e-05 [cse]: 1.972e-05 [replace_applicator]: 2.007e-05 [Cycle 2]: 0.00039866, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 5.91003e-06 [a_1]: 0.00013287 [with_stream_mark]: 1.225e-05 [recompute_prepare]: 6.59001e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.56002e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.48998e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 3.36001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 9.76998e-06 [inline_without_move]: 5.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.36e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 7.25e-06 [cse]: 1.221e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.396e-05 [rewriter_after_opt_a]: 3.548e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00070881 [jit_opt_b]: 6.21e-05, [1] [Cycle 1]: 5.403e-05, [2] [frontend_op_eliminate]: 2.095e-05 [inline_after_opt_a]: 2.056e-05 [cconv]: 3.07e-05 [loop_unroll]: 0.00050585 [jit_opt_after_cconv]: 0.00017197, [1] [Cycle 1]: 0.00016371, [11] [c_1]: 2.983e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 6.46e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.453e-05 [call_graph_tuple_transform]: 2.581e-05 [tuple_list_get_item_eliminator]: 7.60998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 7.01001e-06 [remove_dup_value]: 1.682e-05 [partial_unused_args_eliminate]: 2.48002e-06 [environ_conv]: 9.38002e-06 [add_recomputation]: 5.179e-05 [cse_after_recomputation]: 2.527e-05, [1] [Cycle 1]: 1.939e-05, [1] [cse]: 1.244e-05 [auto_monad_reorder]: 1.914e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 7.17002e-06 [opt_after_jit_grad]: 0.00053631 [symbol_engine_optimizer]: 8.331e-05, [1] [Cycle 1]: 7.625e-05, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.72998e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 8.17e-06 [fold_const_symbol]: 1.042e-05 [renormalize]: 3.69997e-07 [validate]: 0.00010371 Sums bootstrap : 0.000330s : 0.54% type_inference : 0.054983s : 89.58% event_method : 0.000019s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000335s : 0.55% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000722s : 1.18% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002135s : 3.48% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000032s : 0.05% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000709s : 1.15% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000031s : 0.05% loop_unroll : 0.000506s : 0.82% jit_opt_after_cconv.c_1 : 0.000030s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000052s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000536s : 0.87% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000104s : 0.17% Time group info: ------[substitution.] 0.000209 24 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 3.57% : 0.000007s : 4: substitution.graph_param_transform 81.09% : 0.000170s : 4: substitution.inline 1.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.58% : 0.000005s : 2: substitution.replace_old_param 6.61% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054904 2 96.32% : 0.052883s : 1: type_inference.infer 3.68% : 0.002021s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.63% : 0.000052s : 4: replace.inline 32.37% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.01% : 0.000167s : 4: match.inline 6.99% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 1.44% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 12: predicate.addn_check_dump 1.85% : 0.000003s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.40% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.11% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 18: predicate.load_eliminater 2.08% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.67% : 0.000002s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 1.33% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.78% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002625 26 71.85% : 0.001886s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.02% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.13% : 0.000712s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068606 72 0.08% : 0.000055s : 1: add_recomputation 0.10% : 0.000072s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.51% : 0.000350s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.29% : 0.007058s : 1: jit_opt_a 0.25% : 0.000175s : 1: jit_opt_after_cconv 0.09% : 0.000065s : 1: jit_opt_b 0.75% : 0.000516s : 1: loop_unroll 1.05% : 0.000719s : 1: mutable_eliminate 1.41% : 0.000969s : 26: opt.transform.jit_opt_a 0.10% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000546s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000342s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 1.96% : 0.001342s : 1: renormalize.infer 1.14% : 0.000783s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000088s : 1: rewriter_before_opt_a 0.13% : 0.000086s : 1: symbol_engine_optimizer 80.16% : 0.054993s : 1: type_inference TotalTime = 0.136651, [30] [bootstrap]: 0.00026657 [type_inference]: 0.125267 [event_method]: 2.074e-05 [auto_monad]: 7.911e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 0.00059036 [rewriter_before_opt_a]: 0.00010453 [expand_dump_flag]: 3.75998e-06 [jit_opt_a]: 0.00805894, [2] [Cycle 1]: 0.00395766, [27] [switch_simplify]: 6.306e-05 [loop_unroll]: 3.403e-05 [a_1]: 0.00070534 [with_stream_mark]: 2.229e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 4.09997e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.78999e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 6.19001e-06 [renormalize]: 0.00278317 [add_forward_monad_depend]: 7.2e-06 [auto_monad_grad]: 3.06001e-06 [auto_monad_eliminator]: 1.69e-05 [cse]: 3.019e-05 [replace_applicator]: 1.659e-05 [Cycle 2]: 0.00038439, [27] [switch_simplify]: 7.92e-06 [loop_unroll]: 6.59001e-06 [a_1]: 0.00012664 [with_stream_mark]: 1.168e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.68997e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.681e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.59002e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.28e-06 [cse]: 1.568e-05 [replace_applicator]: 6.10002e-06 [py_interpret_to_execute_after_opt_a]: 1.494e-05 [rewriter_after_opt_a]: 4.333e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00062863 [jit_opt_b]: 5.744e-05, [1] [Cycle 1]: 5.034e-05, [2] [frontend_op_eliminate]: 2.02e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 2.572e-05 [loop_unroll]: 0.00042581 [jit_opt_after_cconv]: 0.00016096, [1] [Cycle 1]: 0.00015438, [11] [c_1]: 2.695e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 5.94999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.28998e-06 [cse]: 2.262e-05 [call_graph_tuple_transform]: 2.388e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.83998e-06 [remove_dup_value]: 1.861e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 8.57e-06 [add_recomputation]: 5.09e-05 [cse_after_recomputation]: 2.574e-05, [1] [Cycle 1]: 2.033e-05, [1] [cse]: 1.457e-05 [auto_monad_reorder]: 1.936e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 5.66998e-06 [opt_after_jit_grad]: 0.00046442 [symbol_engine_optimizer]: 7.598e-05, [1] [Cycle 1]: 6.948e-05, [6] [build]: 2.83e-06 [elim_shapecalc]: 8.90001e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 9.69e-06 [renormalize]: 4.30009e-07 [validate]: 4.449e-05 Sums bootstrap : 0.000267s : 0.20% type_inference : 0.125267s : 94.64% event_method : 0.000021s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000590s : 0.45% rewriter_before_opt_a : 0.000105s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000832s : 0.63% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002783s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000046s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000629s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000426s : 0.32% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000464s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.03% Time group info: ------[substitution.] 0.000277 25 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.69% : 0.000007s : 4: substitution.graph_param_transform 86.65% : 0.000240s : 5: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.53% : 0.000004s : 2: substitution.replace_old_param 4.67% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125179 2 94.50% : 0.118299s : 1: type_inference.infer 5.50% : 0.006880s : 1: type_inference.specialize ------[replace.] 0.000102 7 69.45% : 0.000071s : 5: replace.inline 30.55% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 7 95.34% : 0.000236s : 5: match.inline 4.66% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.98% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.70% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 19: predicate.load_eliminater 1.01% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 2.01% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.74% : 0.000002s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.80% : 0.000003s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.62% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002242 25 61.40% : 0.001377s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.71% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.89% : 0.000782s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140596 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000083s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.20% : 0.000278s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.73% : 0.008063s : 1: jit_opt_a 0.12% : 0.000164s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.31% : 0.000434s : 1: loop_unroll 0.45% : 0.000638s : 1: mutable_eliminate 0.77% : 0.001085s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000596s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.39% : 0.001952s : 1: renormalize.infer 0.58% : 0.000821s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 89.10% : 0.125278s : 1: type_inference TotalTime = 0.120408, [30] [bootstrap]: 0.00036542 [type_inference]: 0.109185 [event_method]: 1.953e-05 [auto_monad]: 5.751e-05 [graph_reusing]: 4.50999e-06 [pre_auto_parallel]: 1.84e-06 [py_interpret_to_execute]: 0.00046225 [rewriter_before_opt_a]: 0.00012104 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.00790611, [2] [Cycle 1]: 0.00402453, [27] [switch_simplify]: 5.459e-05 [loop_unroll]: 3.644e-05 [a_1]: 0.00070385 [with_stream_mark]: 1.343e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 6.03002e-06 [renormalize]: 0.00284268 [add_forward_monad_depend]: 4.504e-05 [auto_monad_grad]: 2.63998e-06 [auto_monad_eliminator]: 1.584e-05 [cse]: 2.505e-05 [replace_applicator]: 1.611e-05 [Cycle 2]: 0.00037521, [27] [switch_simplify]: 7.07002e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00013085 [with_stream_mark]: 9.95002e-06 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.93002e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 3.10002e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.257e-05 [j_node_and_user_rematch]: 8.96998e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.83997e-06 [cse]: 1.296e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 2.285e-05 [rewriter_after_opt_a]: 3.79e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00059738 [jit_opt_b]: 5.619e-05, [1] [Cycle 1]: 4.907e-05, [2] [frontend_op_eliminate]: 1.907e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 2.511e-05 [loop_unroll]: 0.0004366 [jit_opt_after_cconv]: 0.00015612, [1] [Cycle 1]: 0.0001493, [11] [c_1]: 2.603e-05 [parameter_eliminate]: 2.60002e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.386e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 6.63998e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 1.387e-05 [partial_unused_args_eliminate]: 1.97999e-06 [environ_conv]: 7.90998e-06 [add_recomputation]: 4.493e-05 [cse_after_recomputation]: 2.326e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.679e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 6.11e-06 [opt_after_jit_grad]: 0.00048202 [symbol_engine_optimizer]: 0.00012509, [1] [Cycle 1]: 0.00011844, [6] [build]: 3.75e-06 [elim_shapecalc]: 8.65999e-06 [elim_not_effective]: 5.733e-05 [opt_reshape]: 7.6e-06 [fold_const_symbol]: 1.076e-05 [renormalize]: 4.19997e-07 [validate]: 4.45e-05 Sums bootstrap : 0.000365s : 0.31% type_inference : 0.109185s : 93.87% event_method : 0.000020s : 0.02% auto_monad : 0.000058s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000462s : 0.40% rewriter_before_opt_a : 0.000121s : 0.10% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.04% jit_opt_a.a_1 : 0.000835s : 0.72% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002843s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000046s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000023s : 0.02% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000597s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000437s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000482s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000057s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000294 28 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.96% : 0.000006s : 4: substitution.graph_param_transform 86.03% : 0.000253s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.63% : 0.000011s : 3: substitution.reduce_eliminate 1.49% : 0.000004s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 3.05% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109122 2 97.49% : 0.106382s : 1: type_inference.infer 2.51% : 0.002740s : 1: type_inference.specialize ------[replace.] 0.000092 7 67.22% : 0.000062s : 5: replace.inline 32.78% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 7 96.94% : 0.000250s : 5: match.inline 3.06% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.48% : 0.000002s : 13: predicate.addn_zero_filter 1.83% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.90% : 0.000007s : 28: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 2.26% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000011s : 64: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.68% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.88% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002332 25 59.71% : 0.001392s : 16: func_graph_cloner_run.FuncGraphClonerGraph 5.30% : 0.000123s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.00% : 0.000816s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124445 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.30% : 0.000379s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.36% : 0.007909s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000445s : 1: loop_unroll 0.49% : 0.000605s : 1: mutable_eliminate 0.86% : 0.001075s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000468s : 1: py_interpret_to_execute 0.02% : 0.000026s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.57% : 0.001954s : 1: renormalize.infer 0.71% : 0.000879s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000126s : 1: rewriter_before_opt_a 0.10% : 0.000128s : 1: symbol_engine_optimizer 87.75% : 0.109197s : 1: type_inference TotalTime = 0.066891, [30] [bootstrap]: 0.00029998 [type_inference]: 0.0555469 [event_method]: 2.292e-05 [auto_monad]: 7.573e-05 [graph_reusing]: 6.23998e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00033046 [rewriter_before_opt_a]: 9.19e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00781775, [2] [Cycle 1]: 0.00358993, [27] [switch_simplify]: 6.614e-05 [loop_unroll]: 3.122e-05 [a_1]: 0.00066194 [with_stream_mark]: 2.784e-05 [recompute_prepare]: 1.232e-05 [updatestate_depend_eliminate]: 4.68999e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 2.87002e-06 [specialize_transform]: 7.42998e-06 [updatestate_useless_node_eliminater]: 6.23002e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.849e-05 [j_node_and_user_rematch]: 1.221e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.232e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00238466 [add_forward_monad_depend]: 9.72999e-06 [auto_monad_grad]: 2.80997e-06 [auto_monad_eliminator]: 2.334e-05 [cse]: 3.451e-05 [replace_applicator]: 2.406e-05 [Cycle 2]: 0.00041162, [27] [switch_simplify]: 7.62002e-06 [loop_unroll]: 6.66e-06 [a_1]: 0.0001336 [with_stream_mark]: 1.753e-05 [recompute_prepare]: 6.51999e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.50997e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 5.09e-06 [cell_reuse_recompute_pass]: 3.22002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.023e-05 [j_node_and_user_rematch]: 1.038e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.389e-05 [replace_applicator]: 6.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.658e-05 [rewriter_after_opt_a]: 3.921e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00069147 [jit_opt_b]: 5.655e-05, [1] [Cycle 1]: 4.811e-05, [2] [frontend_op_eliminate]: 1.912e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 3.094e-05 [loop_unroll]: 0.00044191 [jit_opt_after_cconv]: 0.00015721, [1] [Cycle 1]: 0.00015085, [11] [c_1]: 2.618e-05 [parameter_eliminate]: 3.19001e-06 [updatestate_depend_eliminate]: 5.68002e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 2.22e-05 [call_graph_tuple_transform]: 2.248e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.73e-06 [remove_dup_value]: 1.652e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 9.34e-06 [add_recomputation]: 5.112e-05 [cse_after_recomputation]: 2.327e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.589e-05 [get_jit_bprop_graph]: 2.61999e-06 [rewriter_after_jit_bprop_graph]: 5.33002e-06 [opt_after_jit_grad]: 0.00073631 [symbol_engine_optimizer]: 0.00013911, [1] [Cycle 1]: 0.0001325, [6] [build]: 3.96001e-06 [elim_shapecalc]: 9.63002e-06 [elim_not_effective]: 1.437e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 6.805e-05 [renormalize]: 4.19997e-07 [validate]: 4.578e-05 Sums bootstrap : 0.000300s : 0.48% type_inference : 0.055547s : 88.98% event_method : 0.000023s : 0.04% auto_monad : 0.000076s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000330s : 0.53% rewriter_before_opt_a : 0.000092s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.12% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000796s : 1.27% jit_opt_a.with_stream_mark : 0.000045s : 0.07% jit_opt_a.recompute_prepare : 0.000019s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000010s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002385s : 3.82% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.05% jit_opt_a.cse : 0.000048s : 0.08% jit_opt_a.replace_applicator : 0.000031s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000691s : 1.11% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000031s : 0.05% loop_unroll : 0.000442s : 0.71% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000736s : 1.18% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000068s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.07% Time group info: ------[substitution.] 0.000262 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.49% : 0.000007s : 4: substitution.graph_param_transform 84.57% : 0.000222s : 4: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000006s : 4: substitution.remove_not_recompute_node 2.37% : 0.000006s : 2: substitution.replace_old_param 5.33% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055452 2 96.30% : 0.053401s : 1: type_inference.infer 3.70% : 0.002051s : 1: type_inference.specialize ------[replace.] 0.000086 6 62.74% : 0.000054s : 4: replace.inline 37.26% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 6 94.48% : 0.000219s : 4: match.inline 5.52% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.62% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.93% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002502 26 68.47% : 0.001713s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.16% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.37% : 0.000735s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070463 72 0.08% : 0.000054s : 1: add_recomputation 0.11% : 0.000079s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.45% : 0.000317s : 1: bootstrap 0.05% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.10% : 0.007822s : 1: jit_opt_a 0.23% : 0.000160s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.64% : 0.000451s : 1: loop_unroll 1.00% : 0.000701s : 1: mutable_eliminate 1.52% : 0.001068s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000095s : 4: opt.transform.symbol_engine_opt 1.06% : 0.000748s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000338s : 1: py_interpret_to_execute 0.03% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.19% : 0.001541s : 1: renormalize.infer 1.18% : 0.000829s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.14% : 0.000097s : 1: rewriter_before_opt_a 0.20% : 0.000143s : 1: symbol_engine_optimizer 78.86% : 0.055566s : 1: type_inference TotalTime = 0.122544, [30] [bootstrap]: 0.00036497 [type_inference]: 0.111034 [event_method]: 1.985e-05 [auto_monad]: 7.178e-05 [graph_reusing]: 5.90002e-06 [pre_auto_parallel]: 3.06999e-06 [py_interpret_to_execute]: 0.00057339 [rewriter_before_opt_a]: 9.089e-05 [expand_dump_flag]: 3.63e-06 [jit_opt_a]: 0.00812176, [2] [Cycle 1]: 0.00413367, [27] [switch_simplify]: 6.077e-05 [loop_unroll]: 3.236e-05 [a_1]: 0.00065113 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 8.74998e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.45998e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 7.20998e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 7.02002e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 6.68e-06 [renormalize]: 0.00299963 [add_forward_monad_depend]: 6.93998e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.744e-05 [cse]: 3.163e-05 [replace_applicator]: 1.806e-05 [Cycle 2]: 0.00043469, [27] [switch_simplify]: 7.36001e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00013365 [with_stream_mark]: 1.189e-05 [recompute_prepare]: 6.71e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.61003e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.14998e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 7.46001e-06 [cse]: 1.517e-05 [replace_applicator]: 7.68999e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 3.967e-05 [convert_after_rewriter]: 7.82998e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00059976 [jit_opt_b]: 5.694e-05, [1] [Cycle 1]: 4.995e-05, [2] [frontend_op_eliminate]: 2.03e-05 [inline_after_opt_a]: 1.814e-05 [cconv]: 2.491e-05 [loop_unroll]: 0.00042427 [jit_opt_after_cconv]: 0.00015221, [1] [Cycle 1]: 0.00014563, [11] [c_1]: 2.744e-05 [parameter_eliminate]: 1.80001e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 3.10998e-06 [cse]: 2.088e-05 [call_graph_tuple_transform]: 2.093e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 6.33998e-06 [remove_dup_value]: 1.465e-05 [partial_unused_args_eliminate]: 3.924e-05 [environ_conv]: 8.77e-06 [add_recomputation]: 5.231e-05 [cse_after_recomputation]: 2.504e-05, [1] [Cycle 1]: 1.914e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.636e-05 [get_jit_bprop_graph]: 2.37001e-06 [rewriter_after_jit_bprop_graph]: 5.42001e-06 [opt_after_jit_grad]: 0.00047356 [symbol_engine_optimizer]: 7.91e-05, [1] [Cycle 1]: 7.329e-05, [6] [build]: 4.03999e-06 [elim_shapecalc]: 9.20001e-06 [elim_not_effective]: 1.442e-05 [opt_reshape]: 7.58999e-06 [fold_const_symbol]: 9.57001e-06 [renormalize]: 6.59988e-07 [validate]: 3.981e-05 Sums bootstrap : 0.000365s : 0.31% type_inference : 0.111034s : 93.82% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000573s : 0.48% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000785s : 0.66% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003000s : 2.53% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000600s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000424s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000039s : 0.03% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000474s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000255 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.67% : 0.000007s : 4: substitution.graph_param_transform 85.57% : 0.000218s : 4: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110950 2 97.27% : 0.107923s : 1: type_inference.infer 2.73% : 0.003027s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.50% : 0.000055s : 4: replace.inline 33.50% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 95.14% : 0.000215s : 4: match.inline 4.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.72% : 0.000002s : 12: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.50% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 4.98% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 18: predicate.load_eliminater 1.02% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.38% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.14% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.79% : 0.000004s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 2.12% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.45% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000002s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.73% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.66% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.84% : 0.000010s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002299 22 62.98% : 0.001448s : 15: func_graph_cloner_run.FuncGraphClonerGraph 3.18% : 0.000073s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.84% : 0.000778s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126648 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.30% : 0.000379s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.42% : 0.008126s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.34% : 0.000431s : 1: loop_unroll 0.48% : 0.000608s : 1: mutable_eliminate 0.82% : 0.001036s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000042s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.46% : 0.000581s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.71% : 0.002161s : 1: renormalize.infer 0.65% : 0.000828s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 87.68% : 0.111051s : 1: type_inference TotalTime = 0.121825, [30] [bootstrap]: 0.0002726 [type_inference]: 0.110925 [event_method]: 2.404e-05 [auto_monad]: 7.117e-05 [graph_reusing]: 6.57002e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 0.00045398 [rewriter_before_opt_a]: 9.752e-05 [expand_dump_flag]: 4.2e-06 [jit_opt_a]: 0.0076186, [2] [Cycle 1]: 0.00392411, [27] [switch_simplify]: 6.384e-05 [loop_unroll]: 3.604e-05 [a_1]: 0.00071383 [with_stream_mark]: 2.005e-05 [recompute_prepare]: 8.35001e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.18002e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.40002e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.006e-05 [inline_without_move]: 6.38e-06 [renormalize]: 0.00271814 [add_forward_monad_depend]: 7.96001e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.73e-05 [cse]: 3.62e-05 [replace_applicator]: 1.992e-05 [Cycle 2]: 0.0003802, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.00013232 [with_stream_mark]: 1.232e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 5.67999e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.78002e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.335e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 8.95001e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.323e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 1.517e-05 [rewriter_after_opt_a]: 3.954e-05 [convert_after_rewriter]: 6.58003e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00066307 [jit_opt_b]: 5.899e-05, [1] [Cycle 1]: 5.125e-05, [2] [frontend_op_eliminate]: 2.133e-05 [inline_after_opt_a]: 1.763e-05 [cconv]: 2.827e-05 [loop_unroll]: 0.00042109 [jit_opt_after_cconv]: 0.00015358, [1] [Cycle 1]: 0.00014654, [11] [c_1]: 2.548e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 6.24999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.219e-05 [call_graph_tuple_transform]: 2.141e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.614e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.986e-05 [cse_after_recomputation]: 2.427e-05, [1] [Cycle 1]: 1.914e-05, [1] [cse]: 1.37e-05 [auto_monad_reorder]: 1.975e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.55999e-06 [opt_after_jit_grad]: 0.00045577 [symbol_engine_optimizer]: 7.687e-05, [1] [Cycle 1]: 6.898e-05, [6] [build]: 3.32002e-06 [elim_shapecalc]: 8.69e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 7.62002e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 3.69997e-07 [validate]: 0.00011542 Sums bootstrap : 0.000273s : 0.23% type_inference : 0.110925s : 94.08% event_method : 0.000024s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000454s : 0.39% rewriter_before_opt_a : 0.000098s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.04% jit_opt_a.a_1 : 0.000846s : 0.72% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002718s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000663s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000421s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000456s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000115s : 0.10% Time group info: ------[substitution.] 0.000285 28 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000007s : 4: substitution.graph_param_transform 83.32% : 0.000237s : 5: substitution.inline 1.41% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.59% : 0.000013s : 3: substitution.reduce_eliminate 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000005s : 2: substitution.replace_old_param 3.90% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110841 2 97.32% : 0.107873s : 1: type_inference.infer 2.68% : 0.002968s : 1: type_inference.specialize ------[replace.] 0.000097 7 70.07% : 0.000068s : 5: replace.inline 29.93% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 7 95.92% : 0.000234s : 5: match.inline 4.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.89% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.48% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.88% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002437 25 64.89% : 0.001581s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.19% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.92% : 0.000778s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125635 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.23% : 0.000288s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.07% : 0.007622s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.34% : 0.000429s : 1: loop_unroll 0.53% : 0.000672s : 1: mutable_eliminate 0.87% : 0.001096s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000461s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.54% : 0.001939s : 1: renormalize.infer 0.61% : 0.000769s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.31% : 0.110945s : 1: type_inference TotalTime = 0.126639, [30] [bootstrap]: 0.00036923 [type_inference]: 0.115109 [event_method]: 2.346e-05 [auto_monad]: 8.494e-05 [graph_reusing]: 5.62001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00049371 [rewriter_before_opt_a]: 9.697e-05 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.00814624, [2] [Cycle 1]: 0.00420418, [27] [switch_simplify]: 6.351e-05 [loop_unroll]: 3.351e-05 [a_1]: 0.00070772 [with_stream_mark]: 2.084e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 7.03e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.88002e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 6.88e-06 [renormalize]: 0.00301853 [add_forward_monad_depend]: 6.69001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.647e-05 [cse]: 3.383e-05 [replace_applicator]: 1.771e-05 [Cycle 2]: 0.00038436, [27] [switch_simplify]: 7.03998e-06 [loop_unroll]: 6.24999e-06 [a_1]: 0.00013397 [with_stream_mark]: 1.168e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.15998e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 2.91999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.99003e-06 [meta_fg_expand]: 2.03997e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.12001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.296e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.234e-05 [rewriter_after_opt_a]: 3.765e-05 [convert_after_rewriter]: 6.83998e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.0006382 [jit_opt_b]: 5.616e-05, [1] [Cycle 1]: 4.886e-05, [2] [frontend_op_eliminate]: 1.98e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 2.484e-05 [loop_unroll]: 0.00043297 [jit_opt_after_cconv]: 0.00015446, [1] [Cycle 1]: 0.00014758, [11] [c_1]: 2.605e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 6.20997e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 2.304e-05 [call_graph_tuple_transform]: 2.107e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.571e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 7.39002e-06 [add_recomputation]: 4.646e-05 [cse_after_recomputation]: 2.232e-05, [1] [Cycle 1]: 1.694e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.0004659 [symbol_engine_optimizer]: 7.397e-05, [1] [Cycle 1]: 6.815e-05, [6] [build]: 3.28998e-06 [elim_shapecalc]: 8.67e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.88e-06 [fold_const_symbol]: 9.09998e-06 [renormalize]: 3.9002e-07 [validate]: 4.226e-05 Sums bootstrap : 0.000369s : 0.30% type_inference : 0.115109s : 94.01% event_method : 0.000023s : 0.02% auto_monad : 0.000085s : 0.07% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000494s : 0.40% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000842s : 0.69% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003019s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000638s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000433s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000466s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000285 28 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.16% : 0.000006s : 4: substitution.graph_param_transform 83.34% : 0.000237s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.38% : 0.000012s : 3: substitution.reduce_eliminate 1.83% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 3.85% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115028 2 97.48% : 0.112130s : 1: type_inference.infer 2.52% : 0.002898s : 1: type_inference.specialize ------[replace.] 0.000099 7 69.38% : 0.000069s : 5: replace.inline 30.62% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 7 96.00% : 0.000234s : 5: match.inline 4.00% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.35% : 0.000002s : 13: predicate.addn_zero_filter 1.96% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.27% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.13% : 0.000002s : 13: predicate.environ_get_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.78% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.27% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.06% : 0.000003s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.95% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002422 25 65.34% : 0.001582s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.24% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.43% : 0.000761s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130822 72 0.04% : 0.000049s : 1: add_recomputation 0.07% : 0.000089s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000388s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.23% : 0.008149s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.34% : 0.000441s : 1: loop_unroll 0.49% : 0.000647s : 1: mutable_eliminate 0.84% : 0.001093s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000501s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.54% : 0.002011s : 1: renormalize.infer 0.76% : 0.000997s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.10% : 0.000127s : 1: symbol_engine_optimizer 88.00% : 0.115128s : 1: type_inference TotalTime = 0.067409, [30] [bootstrap]: 0.00033818 [type_inference]: 0.0573994 [event_method]: 1.967e-05 [auto_monad]: 6.942e-05 [graph_reusing]: 6.63e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 0.00034821 [rewriter_before_opt_a]: 8.68e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00688532, [2] [Cycle 1]: 0.00316783, [27] [switch_simplify]: 5.641e-05 [loop_unroll]: 3.112e-05 [a_1]: 0.00059062 [with_stream_mark]: 1.895e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.95001e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.97002e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 4.29002e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.83002e-06 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.96e-06 [renormalize]: 0.00211668 [add_forward_monad_depend]: 6.69999e-06 [auto_monad_grad]: 2.46998e-06 [auto_monad_eliminator]: 1.755e-05 [cse]: 3.172e-05 [replace_applicator]: 1.56e-05 [Cycle 2]: 0.00037494, [27] [switch_simplify]: 7.53e-06 [loop_unroll]: 5.92001e-06 [a_1]: 0.00012533 [with_stream_mark]: 1.189e-05 [recompute_prepare]: 6.72002e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.525e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.42e-06 [inline_without_move]: 5.66e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.204e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 1.24e-05 [rewriter_after_opt_a]: 3.612e-05 [convert_after_rewriter]: 7.68999e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00058539 [jit_opt_b]: 5.607e-05, [1] [Cycle 1]: 4.926e-05, [2] [frontend_op_eliminate]: 1.953e-05 [inline_after_opt_a]: 1.81e-05 [cconv]: 2.534e-05 [loop_unroll]: 0.0004367 [jit_opt_after_cconv]: 0.00015298, [1] [Cycle 1]: 0.00014657, [11] [c_1]: 2.732e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 5.87001e-06 [updatestate_assign_eliminate]: 2.98003e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 1.973e-05 [call_graph_tuple_transform]: 2.164e-05 [tuple_list_get_item_eliminator]: 7.08998e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.39001e-06 [remove_dup_value]: 1.588e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 8.15999e-06 [add_recomputation]: 4.935e-05 [cse_after_recomputation]: 2.295e-05, [1] [Cycle 1]: 1.78e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.521e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 4.86002e-06 [opt_after_jit_grad]: 0.00046927 [symbol_engine_optimizer]: 7.445e-05, [1] [Cycle 1]: 6.866e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 9.27001e-06 [elim_not_effective]: 1.305e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 9.93998e-06 [renormalize]: 4.2998e-07 [validate]: 7.618e-05 Sums bootstrap : 0.000338s : 0.53% type_inference : 0.057399s : 90.44% event_method : 0.000020s : 0.03% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000348s : 0.55% rewriter_before_opt_a : 0.000087s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000716s : 1.13% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002117s : 3.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000044s : 0.07% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000585s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000437s : 0.69% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000469s : 0.74% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000076s : 0.12% Time group info: ------[substitution.] 0.000217 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 3.25% : 0.000007s : 4: substitution.graph_param_transform 84.04% : 0.000182s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000004s : 2: substitution.replace_old_param 5.66% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057313 2 96.61% : 0.055371s : 1: type_inference.infer 3.39% : 0.001942s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.39% : 0.000048s : 4: replace.inline 33.61% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 94.20% : 0.000179s : 4: match.inline 5.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.57% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.78% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000001s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.70% : 0.000010s : 58: predicate.switch_simplify 1.14% : 0.000001s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002479 26 72.46% : 0.001797s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.66% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.88% : 0.000642s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070510 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.50% : 0.000356s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.77% : 0.006888s : 1: jit_opt_a 0.22% : 0.000156s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.63% : 0.000445s : 1: loop_unroll 0.84% : 0.000594s : 1: mutable_eliminate 1.35% : 0.000951s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.51% : 0.000356s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.99% : 0.001400s : 1: renormalize.infer 1.00% : 0.000706s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000092s : 1: rewriter_before_opt_a 0.11% : 0.000077s : 1: symbol_engine_optimizer 81.43% : 0.057417s : 1: type_inference TotalTime = 0.0159466, [30] [bootstrap]: 0.00027957 [type_inference]: 0.00767812 [event_method]: 2.012e-05 [auto_monad]: 6.811e-05 [graph_reusing]: 6.19999e-06 [pre_auto_parallel]: 3.08e-06 [py_interpret_to_execute]: 4.551e-05 [rewriter_before_opt_a]: 8.165e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00566105, [2] [Cycle 1]: 0.00198419, [27] [switch_simplify]: 5.877e-05 [loop_unroll]: 3.298e-05 [a_1]: 0.00065631 [with_stream_mark]: 1.953e-05 [recompute_prepare]: 8.83001e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.58e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.368e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.77001e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00087375 [add_forward_monad_depend]: 5.74e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.401e-05 [cse]: 3.322e-05 [replace_applicator]: 1.224e-05 [Cycle 2]: 0.00032558, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.23002e-06 [a_1]: 9.554e-05 [with_stream_mark]: 9.21998e-06 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 5.24003e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.103e-05 [j_node_and_user_rematch]: 8.08001e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.28e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.204e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.163e-05 [rewriter_after_opt_a]: 3.72e-05 [convert_after_rewriter]: 6.68998e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00054161 [jit_opt_b]: 4.871e-05, [1] [Cycle 1]: 4.187e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.509e-05 [cconv]: 2.372e-05 [loop_unroll]: 0.00041382 [jit_opt_after_cconv]: 0.00015341, [1] [Cycle 1]: 0.00014729, [11] [c_1]: 2.068e-05 [parameter_eliminate]: 2.21e-06 [updatestate_depend_eliminate]: 5.66998e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 2.189e-05 [call_graph_tuple_transform]: 1.94e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 1.499e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 5.54e-06 [add_recomputation]: 4.727e-05 [cse_after_recomputation]: 2.369e-05, [1] [Cycle 1]: 1.813e-05, [1] [cse]: 1.219e-05 [auto_monad_reorder]: 1.685e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 4.22998e-06 [opt_after_jit_grad]: 0.00046161 [symbol_engine_optimizer]: 7.324e-05, [1] [Cycle 1]: 6.686e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 7.93999e-06 [elim_not_effective]: 1.244e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 3.80009e-07 [validate]: 3.933e-05 Sums bootstrap : 0.000280s : 2.33% type_inference : 0.007678s : 63.96% event_method : 0.000020s : 0.17% auto_monad : 0.000068s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000046s : 0.38% rewriter_before_opt_a : 0.000082s : 0.68% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.54% jit_opt_a.loop_unroll : 0.000038s : 0.32% jit_opt_a.a_1 : 0.000752s : 6.26% jit_opt_a.with_stream_mark : 0.000029s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000874s : 7.28% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000045s : 0.38% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000037s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000542s : 4.51% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000024s : 0.20% loop_unroll : 0.000414s : 3.45% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000015s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000047s : 0.39% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000462s : 3.85% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.33% Time group info: ------[substitution.] 0.000259 27 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000005s : 3: substitution.graph_param_transform 83.84% : 0.000217s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.85% : 0.000010s : 3: substitution.reduce_eliminate 1.59% : 0.000004s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 4.42% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007613 2 86.87% : 0.006613s : 1: type_inference.infer 13.13% : 0.001000s : 1: type_inference.specialize ------[replace.] 0.000093 7 66.68% : 0.000062s : 5: replace.inline 33.32% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 95.41% : 0.000214s : 5: match.inline 4.59% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.31% : 0.000002s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.87% : 0.000002s : 11: predicate.arithmetic_simplify 1.32% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 11: predicate.compare_switch_simplify 1.17% : 0.000001s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.61% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.35% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000007s : 24: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.95% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 1.26% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.28% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 16: predicate.partial_eliminate 1.34% : 0.000002s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.75% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.22% : 0.000010s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000001s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.63% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000787 16 49.57% : 0.000390s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.05% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.38% : 0.000326s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017842 72 0.28% : 0.000050s : 1: add_recomputation 0.40% : 0.000072s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 1.64% : 0.000292s : 1: bootstrap 0.15% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.75% : 0.005664s : 1: jit_opt_a 0.87% : 0.000156s : 1: jit_opt_after_cconv 0.29% : 0.000051s : 1: jit_opt_b 2.36% : 0.000421s : 1: loop_unroll 3.08% : 0.000550s : 1: mutable_eliminate 5.45% : 0.000972s : 26: opt.transform.jit_opt_a 0.27% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.63% : 0.000469s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.73% : 0.000487s : 1: renormalize.infer 2.12% : 0.000378s : 1: renormalize.specialize 0.03% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000040s : 1: rewriter_after_opt_a 0.47% : 0.000084s : 1: rewriter_before_opt_a 0.42% : 0.000076s : 1: symbol_engine_optimizer 43.13% : 0.007695s : 1: type_inference TotalTime = 0.124923, [30] [bootstrap]: 0.00030815 [type_inference]: 0.112706 [event_method]: 2.844e-05 [auto_monad]: 8.194e-05 [graph_reusing]: 6.83998e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.0006282 [rewriter_before_opt_a]: 0.00011547 [expand_dump_flag]: 5.17999e-06 [jit_opt_a]: 0.00819242, [2] [Cycle 1]: 0.00417875, [27] [switch_simplify]: 6.956e-05 [loop_unroll]: 3.372e-05 [a_1]: 0.00075345 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 1.008e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.90998e-06 [updatestate_loads_eliminate]: 3.29001e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 7.77998e-06 [updatestate_useless_node_eliminater]: 6.88e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 1.05e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.097e-05 [inline_without_move]: 6.83e-06 [renormalize]: 0.00289999 [add_forward_monad_depend]: 9.59999e-06 [auto_monad_grad]: 3.14999e-06 [auto_monad_eliminator]: 1.891e-05 [cse]: 3.904e-05 [replace_applicator]: 2.28e-05 [Cycle 2]: 0.00040467, [27] [switch_simplify]: 7.9e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00012853 [with_stream_mark]: 1.569e-05 [recompute_prepare]: 6.27001e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.862e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.21998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 7.27997e-06 [cse]: 1.705e-05 [replace_applicator]: 7.19001e-06 [py_interpret_to_execute_after_opt_a]: 1.682e-05 [rewriter_after_opt_a]: 4.504e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00079955 [jit_opt_b]: 5.919e-05, [1] [Cycle 1]: 5.038e-05, [2] [frontend_op_eliminate]: 1.967e-05 [inline_after_opt_a]: 1.987e-05 [cconv]: 2.603e-05 [loop_unroll]: 0.00051204 [jit_opt_after_cconv]: 0.00018012, [1] [Cycle 1]: 0.00017197, [11] [c_1]: 2.713e-05 [parameter_eliminate]: 3.51999e-06 [updatestate_depend_eliminate]: 7.78001e-06 [updatestate_assign_eliminate]: 5.34e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 3.309e-05 [call_graph_tuple_transform]: 2.314e-05 [tuple_list_get_item_eliminator]: 6.94001e-06 [none_parameter_eliminate]: 2.04999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.91e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 1.159e-05 [add_recomputation]: 5.35e-05 [cse_after_recomputation]: 2.828e-05, [1] [Cycle 1]: 2.1e-05, [1] [cse]: 1.511e-05 [auto_monad_reorder]: 1.995e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00055271 [symbol_engine_optimizer]: 8.807e-05, [1] [Cycle 1]: 8.093e-05, [6] [build]: 4.13999e-06 [elim_shapecalc]: 9.19998e-06 [elim_not_effective]: 1.752e-05 [opt_reshape]: 6.97002e-06 [fold_const_symbol]: 1.292e-05 [renormalize]: 4.10015e-07 [validate]: 0.00019627 Sums bootstrap : 0.000308s : 0.26% type_inference : 0.112706s : 93.41% event_method : 0.000028s : 0.02% auto_monad : 0.000082s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000628s : 0.52% rewriter_before_opt_a : 0.000115s : 0.10% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000882s : 0.73% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002900s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000056s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000045s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000800s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000512s : 0.42% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000553s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000196s : 0.16% Time group info: ------[substitution.] 0.000288 25 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000007s : 4: substitution.graph_param_transform 86.19% : 0.000248s : 5: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000006s : 2: substitution.replace_old_param 5.19% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112611 2 97.19% : 0.109445s : 1: type_inference.infer 2.81% : 0.003166s : 1: type_inference.specialize ------[replace.] 0.000110 7 67.14% : 0.000074s : 5: replace.inline 32.86% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 7 94.80% : 0.000245s : 5: match.inline 5.20% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.54% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.30% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.80% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 1.85% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.79% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.31% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.37% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000004s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.96% : 0.000003s : 13: predicate.reduce_eliminate 1.56% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.04% : 0.000002s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.13% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002433 25 63.70% : 0.001550s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.05% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.25% : 0.000809s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128909 72 0.04% : 0.000057s : 1: add_recomputation 0.07% : 0.000086s : 1: auto_monad 0.02% : 0.000025s : 1: auto_monad_reorder 0.25% : 0.000321s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.03% : 0.000034s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.36% : 0.008197s : 1: jit_opt_a 0.14% : 0.000183s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.41% : 0.000523s : 1: loop_unroll 0.63% : 0.000813s : 1: mutable_eliminate 0.90% : 0.001155s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000563s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.49% : 0.000638s : 1: py_interpret_to_execute 0.02% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.58% : 0.002037s : 1: renormalize.infer 0.66% : 0.000853s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000048s : 1: rewriter_after_opt_a 0.10% : 0.000123s : 1: rewriter_before_opt_a 0.07% : 0.000096s : 1: symbol_engine_optimizer 87.45% : 0.112726s : 1: type_inference TotalTime = 0.0168516, [30] [bootstrap]: 0.0002988 [type_inference]: 0.00819722 [event_method]: 2.055e-05 [auto_monad]: 7.185e-05 [graph_reusing]: 6.81001e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 4.619e-05 [rewriter_before_opt_a]: 8.16e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00573325, [2] [Cycle 1]: 0.00205833, [27] [switch_simplify]: 6.316e-05 [loop_unroll]: 3.237e-05 [a_1]: 0.00068011 [with_stream_mark]: 2.229e-05 [recompute_prepare]: 8.50001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 1.139e-05 [inline_without_move]: 5.84e-06 [renormalize]: 0.00089098 [add_forward_monad_depend]: 7.8e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.588e-05 [cse]: 3.273e-05 [replace_applicator]: 1.626e-05 [Cycle 2]: 0.00034373, [27] [switch_simplify]: 5.99999e-06 [loop_unroll]: 5.34998e-06 [a_1]: 0.00010008 [with_stream_mark]: 1.048e-05 [recompute_prepare]: 5.44e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.107e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 8.19002e-06 [inline_without_move]: 4.95999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 5.34e-06 [cse]: 1.195e-05 [replace_applicator]: 5.47999e-06 [py_interpret_to_execute_after_opt_a]: 1.427e-05 [rewriter_after_opt_a]: 3.677e-05 [convert_after_rewriter]: 6.70002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00073064 [jit_opt_b]: 5.381e-05, [1] [Cycle 1]: 4.502e-05, [2] [frontend_op_eliminate]: 1.577e-05 [inline_after_opt_a]: 1.622e-05 [cconv]: 3.309e-05 [loop_unroll]: 0.00044034 [jit_opt_after_cconv]: 0.00017043, [1] [Cycle 1]: 0.00016345, [11] [c_1]: 2.124e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 1.281e-05 [cse]: 2.607e-05 [call_graph_tuple_transform]: 2.303e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 1.22e-06 [switch_simplify]: 5.32999e-06 [remove_dup_value]: 1.688e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 5.83002e-06 [add_recomputation]: 5.12e-05 [cse_after_recomputation]: 2.587e-05, [1] [Cycle 1]: 1.974e-05, [1] [cse]: 1.274e-05 [auto_monad_reorder]: 1.76e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 7.2e-06 [opt_after_jit_grad]: 0.00047888 [symbol_engine_optimizer]: 7.549e-05, [1] [Cycle 1]: 6.941e-05, [6] [build]: 3.59002e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.296e-05 [opt_reshape]: 5.85002e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 6.19999e-07 [validate]: 3.859e-05 Sums bootstrap : 0.000299s : 2.32% type_inference : 0.008197s : 63.59% event_method : 0.000021s : 0.16% auto_monad : 0.000072s : 0.56% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.36% rewriter_before_opt_a : 0.000082s : 0.63% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.54% jit_opt_a.loop_unroll : 0.000038s : 0.29% jit_opt_a.a_1 : 0.000780s : 6.05% jit_opt_a.with_stream_mark : 0.000033s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000891s : 6.91% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000045s : 0.35% jit_opt_a.replace_applicator : 0.000022s : 0.17% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000037s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000731s : 5.67% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000033s : 0.26% loop_unroll : 0.000440s : 3.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000013s : 0.10% jit_opt_after_cconv.cse : 0.000026s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000017s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000051s : 0.40% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000479s : 3.71% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.30% Time group info: ------[substitution.] 0.000290 27 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000007s : 3: substitution.graph_param_transform 82.86% : 0.000240s : 5: substitution.inline 1.30% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.70% : 0.000014s : 3: substitution.reduce_eliminate 1.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000006s : 2: substitution.replace_old_param 3.92% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008126 2 87.64% : 0.007121s : 1: type_inference.infer 12.36% : 0.001004s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.56% : 0.000065s : 5: replace.inline 32.44% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000247 7 95.88% : 0.000237s : 5: match.inline 4.12% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.49% : 0.000002s : 11: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 11: predicate.addn_check_dump 1.40% : 0.000002s : 11: predicate.addn_zero_filter 1.80% : 0.000002s : 11: predicate.arithmetic_simplify 1.18% : 0.000001s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.04% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_depend_swap 1.40% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.19% : 0.000008s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.35% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 16: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.52% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000001s : 11: predicate.print_const_string_wrapper 2.20% : 0.000003s : 11: predicate.reduce_eliminate 1.61% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 19: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.96% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.01% : 0.000004s : 18: predicate.switch_defer_inline 2.35% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.24% : 0.000010s : 59: predicate.switch_simplify 1.22% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000001s : 11: predicate.transpose_eliminate 1.49% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000842 16 50.91% : 0.000428s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.50% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.59% : 0.000333s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018815 72 0.29% : 0.000054s : 1: add_recomputation 0.40% : 0.000075s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.68% : 0.000317s : 1: bootstrap 0.19% : 0.000036s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.49% : 0.005737s : 1: jit_opt_a 0.92% : 0.000174s : 1: jit_opt_after_cconv 0.30% : 0.000057s : 1: jit_opt_b 2.39% : 0.000450s : 1: loop_unroll 3.94% : 0.000741s : 1: mutable_eliminate 5.37% : 0.001010s : 26: opt.transform.jit_opt_a 0.28% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.60% : 0.000489s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000049s : 1: py_interpret_to_execute 0.09% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.76% : 0.000519s : 1: renormalize.infer 1.93% : 0.000363s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000040s : 1: rewriter_after_opt_a 0.45% : 0.000084s : 1: rewriter_before_opt_a 0.42% : 0.000078s : 1: symbol_engine_optimizer 43.64% : 0.008210s : 1: type_inference TotalTime = 0.118478, [30] [bootstrap]: 0.00026299 [type_inference]: 0.107649 [event_method]: 1.772e-05 [auto_monad]: 5.631e-05 [graph_reusing]: 4.70001e-06 [pre_auto_parallel]: 1.69998e-06 [py_interpret_to_execute]: 0.00052257 [rewriter_before_opt_a]: 8.183e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00747077, [2] [Cycle 1]: 0.00376814, [27] [switch_simplify]: 5.006e-05 [loop_unroll]: 3.367e-05 [a_1]: 0.00057403 [with_stream_mark]: 1.271e-05 [recompute_prepare]: 8.74003e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 6.63e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 6.51999e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.365e-05 [j_node_and_user_rematch]: 1.05e-05 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.0027776 [add_forward_monad_depend]: 5.71e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.306e-05 [cse]: 2.207e-05 [replace_applicator]: 1.493e-05 [Cycle 2]: 0.00039559, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00012842 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 6.28998e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 2.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.554e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 8.67998e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.10002e-06 [cse]: 1.274e-05 [replace_applicator]: 6.36e-06 [py_interpret_to_execute_after_opt_a]: 1.177e-05 [rewriter_after_opt_a]: 3.402e-05 [convert_after_rewriter]: 6.40002e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00061901 [jit_opt_b]: 5.977e-05, [1] [Cycle 1]: 5.19e-05, [2] [frontend_op_eliminate]: 2.183e-05 [inline_after_opt_a]: 1.884e-05 [cconv]: 2.165e-05 [loop_unroll]: 0.00041588 [jit_opt_after_cconv]: 0.00015533, [1] [Cycle 1]: 0.0001492, [11] [c_1]: 2.737e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.844e-05 [call_graph_tuple_transform]: 2.238e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.317e-05 [partial_unused_args_eliminate]: 5.69999e-06 [environ_conv]: 7.37002e-06 [add_recomputation]: 0.00012953 [cse_after_recomputation]: 2.674e-05, [1] [Cycle 1]: 2.098e-05, [1] [cse]: 1.365e-05 [auto_monad_reorder]: 1.518e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00057586 [symbol_engine_optimizer]: 8.934e-05, [1] [Cycle 1]: 8.252e-05, [6] [build]: 3.85e-06 [elim_shapecalc]: 1.014e-05 [elim_not_effective]: 1.577e-05 [opt_reshape]: 9.19e-06 [fold_const_symbol]: 1.221e-05 [renormalize]: 4.10015e-07 [validate]: 4.177e-05 Sums bootstrap : 0.000263s : 0.23% type_inference : 0.107649s : 93.95% event_method : 0.000018s : 0.02% auto_monad : 0.000056s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000523s : 0.46% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000702s : 0.61% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002778s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000619s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000416s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000006s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000130s : 0.11% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000576s : 0.50% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000191 24 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 4.19% : 0.000008s : 4: substitution.graph_param_transform 81.75% : 0.000156s : 4: substitution.inline 1.74% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 5.67% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107581 2 97.31% : 0.104688s : 1: type_inference.infer 2.69% : 0.002893s : 1: type_inference.specialize ------[replace.] 0.000074 6 65.96% : 0.000049s : 4: replace.inline 34.04% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 94.13% : 0.000153s : 4: match.inline 5.87% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 2.37% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.34% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 4.87% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.04% : 0.000003s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.83% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.57% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002073 22 65.41% : 0.001356s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.51% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.08% : 0.000686s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122280 72 0.11% : 0.000134s : 1: add_recomputation 0.05% : 0.000059s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000275s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.11% : 0.007474s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.35% : 0.000423s : 1: loop_unroll 0.51% : 0.000626s : 1: mutable_eliminate 0.77% : 0.000937s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.48% : 0.000585s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000008s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000528s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.66% : 0.002026s : 1: renormalize.infer 0.61% : 0.000743s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.08% : 0.000092s : 1: symbol_engine_optimizer 88.04% : 0.107660s : 1: type_inference TotalTime = 0.0771969, [30] [bootstrap]: 0.0003235 [type_inference]: 0.0663835 [event_method]: 2.541e-05 [auto_monad]: 7.52e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00025813 [rewriter_before_opt_a]: 0.0001005 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00765539, [2] [Cycle 1]: 0.00348782, [27] [switch_simplify]: 6.701e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.0007152 [with_stream_mark]: 2.442e-05 [recompute_prepare]: 9.79e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.75998e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 1.036e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 0.00226561 [add_forward_monad_depend]: 9.87999e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.802e-05 [cse]: 3.871e-05 [replace_applicator]: 1.857e-05 [Cycle 2]: 0.00037463, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.87999e-06 [a_1]: 0.00012235 [with_stream_mark]: 1.104e-05 [recompute_prepare]: 6.47001e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 6.40002e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.696e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.15002e-06 [cse]: 1.503e-05 [replace_applicator]: 6.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.345e-05 [rewriter_after_opt_a]: 4.193e-05 [convert_after_rewriter]: 7.91001e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00067263 [jit_opt_b]: 5.648e-05, [1] [Cycle 1]: 4.97e-05, [2] [frontend_op_eliminate]: 1.92e-05 [inline_after_opt_a]: 1.924e-05 [cconv]: 2.788e-05 [loop_unroll]: 0.0004267 [jit_opt_after_cconv]: 0.00016062, [1] [Cycle 1]: 0.00015422, [11] [c_1]: 2.664e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 6.12999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.677e-05 [call_graph_tuple_transform]: 2.229e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.31998e-06 [remove_dup_value]: 1.911e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 9.19e-06 [add_recomputation]: 5.025e-05 [cse_after_recomputation]: 2.568e-05, [1] [Cycle 1]: 1.938e-05, [1] [cse]: 1.383e-05 [auto_monad_reorder]: 1.858e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 5.24998e-06 [opt_after_jit_grad]: 0.00048722 [symbol_engine_optimizer]: 8.608e-05, [1] [Cycle 1]: 8.005e-05, [6] [build]: 3.75998e-06 [elim_shapecalc]: 8.54e-06 [elim_not_effective]: 1.447e-05 [opt_reshape]: 6.30002e-06 [fold_const_symbol]: 1.89e-05 [renormalize]: 4.69998e-07 [validate]: 4.836e-05 Sums bootstrap : 0.000323s : 0.44% type_inference : 0.066383s : 91.20% event_method : 0.000025s : 0.03% auto_monad : 0.000075s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000258s : 0.35% rewriter_before_opt_a : 0.000101s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.10% jit_opt_a.loop_unroll : 0.000040s : 0.06% jit_opt_a.a_1 : 0.000838s : 1.15% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002266s : 3.11% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000054s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000042s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000673s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000028s : 0.04% loop_unroll : 0.000427s : 0.59% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000487s : 0.67% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000019s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.07% Time group info: ------[substitution.] 0.000285 25 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000007s : 4: substitution.graph_param_transform 86.99% : 0.000248s : 5: substitution.inline 1.04% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_old_param 4.45% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.066290 2 96.57% : 0.064018s : 1: type_inference.infer 3.43% : 0.002273s : 1: type_inference.specialize ------[replace.] 0.000098 7 69.21% : 0.000068s : 5: replace.inline 30.79% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 95.53% : 0.000245s : 5: match.inline 4.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 6.67% : 0.000009s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 19: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.58% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.66% : 0.000002s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 20: predicate.switch_defer_inline 2.45% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.23% : 0.000010s : 65: predicate.switch_simplify 1.17% : 0.000002s : 13: predicate.tile_eliminate 1.51% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002616 29 71.35% : 0.001867s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.30% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 25.35% : 0.000663s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.080635 72 0.07% : 0.000053s : 1: add_recomputation 0.10% : 0.000079s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.43% : 0.000344s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.04% : 0.000030s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.50% : 0.007659s : 1: jit_opt_a 0.20% : 0.000164s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.54% : 0.000435s : 1: loop_unroll 0.85% : 0.000683s : 1: mutable_eliminate 1.36% : 0.001094s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000265s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 1.94% : 0.001565s : 1: renormalize.infer 0.86% : 0.000690s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000045s : 1: rewriter_after_opt_a 0.13% : 0.000106s : 1: rewriter_before_opt_a 0.11% : 0.000089s : 1: symbol_engine_optimizer 82.35% : 0.066406s : 1: type_inference TotalTime = 0.126953, [30] [bootstrap]: 0.00036968 [type_inference]: 0.115024 [event_method]: 2.342e-05 [auto_monad]: 7.384e-05 [graph_reusing]: 5.86998e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.0005565 [rewriter_before_opt_a]: 9.591e-05 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.00831319, [2] [Cycle 1]: 0.00417179, [27] [switch_simplify]: 6.602e-05 [loop_unroll]: 7.81e-05 [a_1]: 0.00070894 [with_stream_mark]: 1.874e-05 [recompute_prepare]: 1.094e-05 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.81003e-06 [specialize_transform]: 7.93001e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 3.67998e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 1.049e-05 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00287938 [add_forward_monad_depend]: 6.59001e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.615e-05 [cse]: 3.382e-05 [replace_applicator]: 1.832e-05 [Cycle 2]: 0.00038622, [27] [switch_simplify]: 7.41999e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00013484 [with_stream_mark]: 1.132e-05 [recompute_prepare]: 6.36998e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.18998e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 2.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.38e-06 [cse]: 1.36e-05 [replace_applicator]: 5.86998e-06 [py_interpret_to_execute_after_opt_a]: 1.309e-05 [rewriter_after_opt_a]: 4.458e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00067639 [jit_opt_b]: 5.641e-05, [1] [Cycle 1]: 4.85e-05, [2] [frontend_op_eliminate]: 1.951e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 2.57e-05 [loop_unroll]: 0.00045413 [jit_opt_after_cconv]: 0.00015491, [1] [Cycle 1]: 0.00014821, [11] [c_1]: 2.554e-05 [parameter_eliminate]: 2.53998e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.429e-05 [call_graph_tuple_transform]: 2.132e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.576e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 7.49002e-06 [add_recomputation]: 0.00010445 [cse_after_recomputation]: 2.538e-05, [1] [Cycle 1]: 1.963e-05, [1] [cse]: 1.351e-05 [auto_monad_reorder]: 1.829e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00049239 [symbol_engine_optimizer]: 0.00013039, [1] [Cycle 1]: 0.00012324, [6] [build]: 3.81001e-06 [elim_shapecalc]: 1.021e-05 [elim_not_effective]: 1.543e-05 [opt_reshape]: 6.98998e-06 [fold_const_symbol]: 1.038e-05 [renormalize]: 7.2e-07 [validate]: 4.977e-05 Sums bootstrap : 0.000370s : 0.30% type_inference : 0.115024s : 93.91% event_method : 0.000023s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000556s : 0.45% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000084s : 0.07% jit_opt_a.a_1 : 0.000844s : 0.69% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002879s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000045s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000676s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000454s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000104s : 0.09% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000492s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000271 28 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 4: substitution.graph_param_transform 81.99% : 0.000222s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.90% : 0.000013s : 3: substitution.reduce_eliminate 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 4.24% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114902 2 96.77% : 0.111192s : 1: type_inference.infer 3.23% : 0.003710s : 1: type_inference.specialize ------[replace.] 0.000099 7 67.03% : 0.000066s : 5: replace.inline 32.97% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 7 95.45% : 0.000219s : 5: match.inline 4.55% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.15% : 0.000002s : 13: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.63% : 0.000002s : 13: predicate.addn_zero_filter 2.17% : 0.000003s : 13: predicate.arithmetic_simplify 1.15% : 0.000002s : 13: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.83% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.30% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 2.07% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000011s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002702 25 56.71% : 0.001532s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.22% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.07% : 0.001110s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131045 72 0.08% : 0.000108s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000388s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.35% : 0.008316s : 1: jit_opt_a 0.12% : 0.000158s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.35% : 0.000462s : 1: loop_unroll 0.52% : 0.000684s : 1: mutable_eliminate 0.87% : 0.001144s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000565s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.59% : 0.002087s : 1: renormalize.infer 0.60% : 0.000783s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000048s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.10% : 0.000133s : 1: symbol_engine_optimizer 87.79% : 0.115044s : 1: type_inference TotalTime = 0.0699951, [30] [bootstrap]: 0.0002793 [type_inference]: 0.0589822 [event_method]: 1.922e-05 [auto_monad]: 6.745e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00030194 [rewriter_before_opt_a]: 0.00012311 [expand_dump_flag]: 3.97002e-06 [jit_opt_a]: 0.0076421, [2] [Cycle 1]: 0.00361614, [27] [switch_simplify]: 6.121e-05 [loop_unroll]: 3.175e-05 [a_1]: 0.00068662 [with_stream_mark]: 2.151e-05 [recompute_prepare]: 9.49999e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 4e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 6.84001e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.636e-05 [j_node_and_user_rematch]: 1.063e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 1.023e-05 [inline_without_move]: 6.90998e-06 [renormalize]: 0.00243922 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.032e-05 [cse]: 2.927e-05 [replace_applicator]: 2.053e-05 [Cycle 2]: 0.00039349, [27] [switch_simplify]: 7.30998e-06 [loop_unroll]: 6.63998e-06 [a_1]: 0.00013291 [with_stream_mark]: 1.232e-05 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 2.53003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.66e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 8.21002e-06 [cse]: 1.348e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.515e-05 [rewriter_after_opt_a]: 3.951e-05 [convert_after_rewriter]: 8.26002e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00073542 [jit_opt_b]: 6.425e-05, [1] [Cycle 1]: 5.394e-05, [2] [frontend_op_eliminate]: 2.195e-05 [inline_after_opt_a]: 1.963e-05 [cconv]: 3.189e-05 [loop_unroll]: 0.0004924 [jit_opt_after_cconv]: 0.00017154, [1] [Cycle 1]: 0.00016356, [11] [c_1]: 2.795e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 5.00001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.788e-05 [call_graph_tuple_transform]: 2.521e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.93e-06 [remove_dup_value]: 1.618e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 8.78001e-06 [add_recomputation]: 5.211e-05 [cse_after_recomputation]: 2.566e-05, [1] [Cycle 1]: 1.975e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.547e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 6.84999e-06 [opt_after_jit_grad]: 0.00055068 [symbol_engine_optimizer]: 8.647e-05, [1] [Cycle 1]: 7.965e-05, [6] [build]: 3.78001e-06 [elim_shapecalc]: 1.077e-05 [elim_not_effective]: 1.453e-05 [opt_reshape]: 7.26001e-06 [fold_const_symbol]: 1.108e-05 [renormalize]: 8.39995e-07 [validate]: 4.697e-05 Sums bootstrap : 0.000279s : 0.42% type_inference : 0.058982s : 89.73% event_method : 0.000019s : 0.03% auto_monad : 0.000067s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000302s : 0.46% rewriter_before_opt_a : 0.000123s : 0.19% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000820s : 1.25% jit_opt_a.with_stream_mark : 0.000034s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002439s : 3.71% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000735s : 1.12% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.03% cconv : 0.000032s : 0.05% loop_unroll : 0.000492s : 0.75% jit_opt_after_cconv.c_1 : 0.000028s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000551s : 0.84% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.07% Time group info: ------[substitution.] 0.000298 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000007s : 4: substitution.graph_param_transform 87.32% : 0.000261s : 4: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000005s : 2: substitution.replace_old_param 4.46% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058903 2 96.60% : 0.056903s : 1: type_inference.infer 3.40% : 0.002000s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.27% : 0.000052s : 4: replace.inline 32.73% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000270 6 95.53% : 0.000258s : 4: match.inline 4.47% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.59% : 0.000008s : 26: predicate.inline 1.09% : 0.000002s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 8: predicate.less_batch_normalization 2.01% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.64% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 2.13% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000003s : 12: predicate.reduce_eliminate 1.78% : 0.000003s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.60% : 0.000009s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.55% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.77% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 12: predicate.value_based_eliminate 0.51% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.10% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002797 30 74.26% : 0.002077s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.01% : 0.000672s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073589 72 0.08% : 0.000055s : 1: add_recomputation 0.10% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.39% : 0.000289s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.39% : 0.007647s : 1: jit_opt_a 0.24% : 0.000175s : 1: jit_opt_after_cconv 0.09% : 0.000067s : 1: jit_opt_b 0.68% : 0.000503s : 1: loop_unroll 1.02% : 0.000747s : 1: mutable_eliminate 1.46% : 0.001072s : 26: opt.transform.jit_opt_a 0.08% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000560s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000309s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.25% : 0.001657s : 1: renormalize.infer 1.05% : 0.000772s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000043s : 1: rewriter_after_opt_a 0.18% : 0.000131s : 1: rewriter_before_opt_a 0.12% : 0.000089s : 1: symbol_engine_optimizer 80.17% : 0.058997s : 1: type_inference TotalTime = 0.017815, [30] [bootstrap]: 0.00035556 [type_inference]: 0.00861884 [event_method]: 2.123e-05 [auto_monad]: 7.159e-05 [graph_reusing]: 6.13998e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 5.306e-05 [rewriter_before_opt_a]: 8.825e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00631795, [2] [Cycle 1]: 0.00206599, [27] [switch_simplify]: 6.648e-05 [loop_unroll]: 3.362e-05 [a_1]: 0.00068583 [with_stream_mark]: 2.158e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.55002e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.603e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 1.052e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00089867 [add_forward_monad_depend]: 6.81001e-06 [auto_monad_grad]: 2.86999e-06 [auto_monad_eliminator]: 1.593e-05 [cse]: 3.312e-05 [replace_applicator]: 1.394e-05 [Cycle 2]: 0.00033312, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.78e-05 [with_stream_mark]: 1.1e-05 [recompute_prepare]: 5.35001e-06 [updatestate_depend_eliminate]: 2.90998e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 5.35001e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.01002e-06 [meta_shard_fg_expand]: 1.56002e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.094e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 8.10999e-06 [inline_without_move]: 4.84998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 6.02999e-06 [cse]: 1.258e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.357e-05 [rewriter_after_opt_a]: 3.748e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.00056852 [jit_opt_b]: 5.225e-05, [1] [Cycle 1]: 4.526e-05, [2] [frontend_op_eliminate]: 1.685e-05 [inline_after_opt_a]: 1.657e-05 [cconv]: 2.714e-05 [loop_unroll]: 0.00045447 [jit_opt_after_cconv]: 0.00016218, [1] [Cycle 1]: 0.00015549, [11] [c_1]: 2.172e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.761e-05 [call_graph_tuple_transform]: 1.993e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.694e-05 [partial_unused_args_eliminate]: 2.81999e-06 [environ_conv]: 5.42001e-06 [add_recomputation]: 5.076e-05 [cse_after_recomputation]: 2.537e-05, [1] [Cycle 1]: 1.958e-05, [1] [cse]: 1.331e-05 [auto_monad_reorder]: 1.891e-05 [get_jit_bprop_graph]: 2.70002e-06 [rewriter_after_jit_bprop_graph]: 6.53e-06 [opt_after_jit_grad]: 0.00049995 [symbol_engine_optimizer]: 7.568e-05, [1] [Cycle 1]: 6.897e-05, [6] [build]: 3.98001e-06 [elim_shapecalc]: 8.41002e-06 [elim_not_effective]: 1.386e-05 [opt_reshape]: 5.85002e-06 [fold_const_symbol]: 8.83001e-06 [renormalize]: 4.89992e-07 [validate]: 3.945e-05 Sums bootstrap : 0.000356s : 2.68% type_inference : 0.008619s : 65.01% event_method : 0.000021s : 0.16% auto_monad : 0.000072s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.40% rewriter_before_opt_a : 0.000088s : 0.67% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.55% jit_opt_a.loop_unroll : 0.000039s : 0.29% jit_opt_a.a_1 : 0.000784s : 5.91% jit_opt_a.with_stream_mark : 0.000033s : 0.25% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000899s : 6.78% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000046s : 0.34% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000037s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000569s : 4.29% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000027s : 0.20% loop_unroll : 0.000454s : 3.43% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000051s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000500s : 3.77% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.30% Time group info: ------[substitution.] 0.000283 27 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.77% : 0.000005s : 3: substitution.graph_param_transform 83.61% : 0.000237s : 5: substitution.inline 1.25% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000012s : 3: substitution.reduce_eliminate 1.57% : 0.000004s : 4: substitution.remove_not_recompute_node 2.14% : 0.000006s : 2: substitution.replace_old_param 4.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008545 2 86.43% : 0.007385s : 1: type_inference.infer 13.57% : 0.001160s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.83% : 0.000066s : 5: replace.inline 32.17% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 7 95.59% : 0.000233s : 5: match.inline 4.41% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.19% : 0.000002s : 11: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.24% : 0.000002s : 11: predicate.addn_zero_filter 2.41% : 0.000003s : 11: predicate.arithmetic_simplify 1.59% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000002s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 1.21% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 11: predicate.environ_get_depend_swap 1.24% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.33% : 0.000008s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.49% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.96% : 0.000002s : 11: predicate.reduce_eliminate 1.60% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 19: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.98% : 0.000010s : 59: predicate.switch_simplify 1.27% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000824 16 46.03% : 0.000379s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.39% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.58% : 0.000367s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019790 72 0.28% : 0.000055s : 1: add_recomputation 0.38% : 0.000075s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 1.87% : 0.000369s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 31.94% : 0.006322s : 1: jit_opt_a 0.83% : 0.000165s : 1: jit_opt_after_cconv 0.28% : 0.000055s : 1: jit_opt_b 2.33% : 0.000462s : 1: loop_unroll 3.07% : 0.000607s : 1: mutable_eliminate 5.14% : 0.001018s : 26: opt.transform.jit_opt_a 0.25% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.57% : 0.000508s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000056s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.71% : 0.000536s : 1: renormalize.infer 1.78% : 0.000353s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000040s : 1: rewriter_after_opt_a 0.47% : 0.000092s : 1: rewriter_before_opt_a 0.40% : 0.000078s : 1: symbol_engine_optimizer 43.64% : 0.008636s : 1: type_inference TotalTime = 0.123489, [30] [bootstrap]: 0.00029804 [type_inference]: 0.111383 [event_method]: 2.346e-05 [auto_monad]: 7.803e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 3.4e-06 [py_interpret_to_execute]: 0.00053141 [rewriter_before_opt_a]: 0.00010287 [expand_dump_flag]: 3.97e-06 [jit_opt_a]: 0.00846043, [2] [Cycle 1]: 0.00428409, [27] [switch_simplify]: 6.718e-05 [loop_unroll]: 3.476e-05 [a_1]: 0.00075721 [with_stream_mark]: 2.122e-05 [recompute_prepare]: 1.073e-05 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 7.68999e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.757e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.96001e-06 [replace_old_param]: 1.187e-05 [inline_without_move]: 6.57002e-06 [renormalize]: 0.00302157 [add_forward_monad_depend]: 7.13998e-06 [auto_monad_grad]: 3.11001e-06 [auto_monad_eliminator]: 1.929e-05 [cse]: 4.014e-05 [replace_applicator]: 1.6e-05 [Cycle 2]: 0.00038778, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00013452 [with_stream_mark]: 1.146e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 2.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.49e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 7.51999e-06 [cse]: 1.52e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.747e-05 [rewriter_after_opt_a]: 4.322e-05 [convert_after_rewriter]: 6.73998e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00072428 [jit_opt_b]: 5.766e-05, [1] [Cycle 1]: 4.918e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.876e-05 [cconv]: 3.173e-05 [loop_unroll]: 0.0004732 [jit_opt_after_cconv]: 0.00017077, [1] [Cycle 1]: 0.0001632, [11] [c_1]: 2.654e-05 [parameter_eliminate]: 3.57997e-06 [updatestate_depend_eliminate]: 7.19001e-06 [updatestate_assign_eliminate]: 2.60997e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 3.189e-05 [call_graph_tuple_transform]: 2.271e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 6.20002e-06 [remove_dup_value]: 1.76e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 8.69e-06 [add_recomputation]: 0.00010932 [cse_after_recomputation]: 3.079e-05, [1] [Cycle 1]: 2.391e-05, [1] [cse]: 1.593e-05 [auto_monad_reorder]: 2.031e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 6.66999e-06 [opt_after_jit_grad]: 0.00053082 [symbol_engine_optimizer]: 0.00010107, [1] [Cycle 1]: 6.925e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 6.41998e-06 [fold_const_symbol]: 9.10001e-06 [renormalize]: 5.00004e-07 [validate]: 4.618e-05 Sums bootstrap : 0.000298s : 0.25% type_inference : 0.111383s : 93.56% event_method : 0.000023s : 0.02% auto_monad : 0.000078s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000531s : 0.45% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000892s : 0.75% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003022s : 2.54% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000055s : 0.05% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000724s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000473s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000109s : 0.09% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000020s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000531s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000321 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.96% : 0.000006s : 4: substitution.graph_param_transform 84.80% : 0.000272s : 5: substitution.inline 1.22% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.23% : 0.000014s : 3: substitution.reduce_eliminate 1.73% : 0.000006s : 4: substitution.remove_not_recompute_node 1.57% : 0.000005s : 2: substitution.replace_old_param 3.39% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111291 2 97.24% : 0.108215s : 1: type_inference.infer 2.76% : 0.003076s : 1: type_inference.specialize ------[replace.] 0.000112 7 68.21% : 0.000076s : 5: replace.inline 31.79% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 96.47% : 0.000268s : 5: match.inline 3.53% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.46% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 6.09% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.57% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.74% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.95% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.60% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 13: predicate.value_based_eliminate 0.49% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002419 25 61.47% : 0.001487s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.69% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.84% : 0.000843s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127725 72 0.09% : 0.000114s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.25% : 0.000316s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.63% : 0.008464s : 1: jit_opt_a 0.14% : 0.000173s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.38% : 0.000482s : 1: loop_unroll 0.58% : 0.000735s : 1: mutable_eliminate 0.90% : 0.001147s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000538s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000539s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.69% : 0.002153s : 1: renormalize.infer 0.67% : 0.000858s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000108s : 1: rewriter_before_opt_a 0.08% : 0.000103s : 1: symbol_engine_optimizer 87.22% : 0.111401s : 1: type_inference TotalTime = 0.0690691, [30] [bootstrap]: 0.00030345 [type_inference]: 0.0584865 [event_method]: 2.242e-05 [auto_monad]: 7.439e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 3.06001e-06 [py_interpret_to_execute]: 0.00027473 [rewriter_before_opt_a]: 9.948e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00761529, [2] [Cycle 1]: 0.00350401, [27] [switch_simplify]: 6.578e-05 [loop_unroll]: 3.517e-05 [a_1]: 0.00072713 [with_stream_mark]: 1.954e-05 [recompute_prepare]: 9.46998e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 3.6e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 7.28999e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.92002e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.672e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 6.61e-06 [renormalize]: 0.0022946 [add_forward_monad_depend]: 6.89999e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.682e-05 [cse]: 2.499e-05 [replace_applicator]: 1.634e-05 [Cycle 2]: 0.00038422, [27] [switch_simplify]: 8.05e-06 [loop_unroll]: 6.26e-06 [a_1]: 0.00012641 [with_stream_mark]: 1.337e-05 [recompute_prepare]: 6.38e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.641e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 8.42998e-06 [inline_without_move]: 5.73997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.59002e-06 [cse]: 1.514e-05 [replace_applicator]: 6.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.393e-05 [rewriter_after_opt_a]: 3.783e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00058354 [jit_opt_b]: 5.564e-05, [1] [Cycle 1]: 4.939e-05, [2] [frontend_op_eliminate]: 1.96e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 2.517e-05 [loop_unroll]: 0.00042074 [jit_opt_after_cconv]: 0.00015574, [1] [Cycle 1]: 0.00014933, [11] [c_1]: 2.662e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 6.64999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.53003e-06 [cse]: 2.444e-05 [call_graph_tuple_transform]: 2.08e-05 [tuple_list_get_item_eliminator]: 6.33998e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 2.99973e-07 [switch_simplify]: 6.64999e-06 [remove_dup_value]: 1.413e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.91001e-06 [add_recomputation]: 3.963e-05 [cse_after_recomputation]: 2.435e-05, [1] [Cycle 1]: 1.855e-05, [1] [cse]: 1.286e-05 [auto_monad_reorder]: 1.258e-05 [get_jit_bprop_graph]: 1.59e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00045221 [symbol_engine_optimizer]: 7.428e-05, [1] [Cycle 1]: 6.798e-05, [6] [build]: 2.56998e-06 [elim_shapecalc]: 8.54e-06 [elim_not_effective]: 1.343e-05 [opt_reshape]: 6.25002e-06 [fold_const_symbol]: 9.83002e-06 [renormalize]: 9.29984e-07 [validate]: 5.711e-05 Sums bootstrap : 0.000303s : 0.47% type_inference : 0.058487s : 90.34% event_method : 0.000022s : 0.03% auto_monad : 0.000074s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000275s : 0.42% rewriter_before_opt_a : 0.000099s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.11% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000854s : 1.32% jit_opt_a.with_stream_mark : 0.000033s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002295s : 3.54% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000040s : 0.06% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000038s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000584s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000421s : 0.65% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.06% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000452s : 0.70% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.09% Time group info: ------[substitution.] 0.000284 25 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.00% : 0.000006s : 4: substitution.graph_param_transform 87.15% : 0.000248s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000006s : 4: substitution.remove_not_recompute_node 1.71% : 0.000005s : 2: substitution.replace_old_param 4.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058391 2 96.08% : 0.056102s : 1: type_inference.infer 3.92% : 0.002289s : 1: type_inference.specialize ------[replace.] 0.000110 7 70.48% : 0.000077s : 5: replace.inline 29.52% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 95.39% : 0.000244s : 5: match.inline 4.61% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 888 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.23% : 0.000002s : 13: predicate.addn_zero_filter 2.40% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.39% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.59% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.58% : 0.000011s : 65: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.83% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002557 29 69.14% : 0.001768s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.25% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.61% : 0.000706s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072535 72 0.06% : 0.000042s : 1: add_recomputation 0.11% : 0.000078s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.45% : 0.000323s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.50% : 0.007618s : 1: jit_opt_a 0.22% : 0.000158s : 1: jit_opt_after_cconv 0.08% : 0.000058s : 1: jit_opt_b 0.59% : 0.000428s : 1: loop_unroll 0.82% : 0.000593s : 1: mutable_eliminate 1.53% : 0.001112s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000282s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 2.06% : 0.001491s : 1: renormalize.infer 1.09% : 0.000794s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000041s : 1: rewriter_after_opt_a 0.15% : 0.000105s : 1: rewriter_before_opt_a 0.11% : 0.000077s : 1: symbol_engine_optimizer 80.66% : 0.058506s : 1: type_inference TotalTime = 0.062234, [30] [bootstrap]: 0.0002413 [type_inference]: 0.0527811 [event_method]: 1.866e-05 [auto_monad]: 5.842e-05 [graph_reusing]: 5.01997e-06 [pre_auto_parallel]: 2.07001e-06 [py_interpret_to_execute]: 0.00028913 [rewriter_before_opt_a]: 7.658e-05 [expand_dump_flag]: 2.69999e-06 [jit_opt_a]: 0.0065382, [2] [Cycle 1]: 0.0030114, [27] [switch_simplify]: 4.844e-05 [loop_unroll]: 3.167e-05 [a_1]: 0.00054931 [with_stream_mark]: 1.247e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 6.64001e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.78998e-06 [inline_without_move]: 6.57002e-06 [renormalize]: 0.00205515 [add_forward_monad_depend]: 5.39e-06 [auto_monad_grad]: 1.89999e-06 [auto_monad_eliminator]: 1.41e-05 [cse]: 2.093e-05 [replace_applicator]: 1.353e-05 [Cycle 2]: 0.00036458, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00012573 [with_stream_mark]: 9.20999e-06 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 1.14998e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.316e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.35999e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.99999e-06 [cse]: 1.151e-05 [replace_applicator]: 5.91998e-06 [py_interpret_to_execute_after_opt_a]: 1.033e-05 [rewriter_after_opt_a]: 3.207e-05 [convert_after_rewriter]: 6.39999e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00063493 [jit_opt_b]: 5.62e-05, [1] [Cycle 1]: 4.937e-05, [2] [frontend_op_eliminate]: 2.123e-05 [inline_after_opt_a]: 1.727e-05 [cconv]: 1.842e-05 [loop_unroll]: 0.00042146 [jit_opt_after_cconv]: 0.00014666, [1] [Cycle 1]: 0.0001408, [11] [c_1]: 2.574e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.06002e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 1.93997e-06 [cse]: 1.896e-05 [call_graph_tuple_transform]: 1.979e-05 [tuple_list_get_item_eliminator]: 6.32001e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.272e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 3.738e-05 [cse_after_recomputation]: 2.233e-05, [1] [Cycle 1]: 1.731e-05, [1] [cse]: 1.132e-05 [auto_monad_reorder]: 1.169e-05 [get_jit_bprop_graph]: 5.31e-05 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.00046128 [symbol_engine_optimizer]: 7.984e-05, [1] [Cycle 1]: 7.337e-05, [6] [build]: 2.69999e-06 [elim_shapecalc]: 9.20999e-06 [elim_not_effective]: 1.465e-05 [opt_reshape]: 7.68001e-06 [fold_const_symbol]: 1.026e-05 [renormalize]: 3.10014e-07 [validate]: 3.608e-05 Sums bootstrap : 0.000241s : 0.41% type_inference : 0.052781s : 90.20% event_method : 0.000019s : 0.03% auto_monad : 0.000058s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000289s : 0.49% rewriter_before_opt_a : 0.000077s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.09% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000675s : 1.15% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002055s : 3.51% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000032s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000032s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000635s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000018s : 0.03% loop_unroll : 0.000421s : 0.72% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000037s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000053s : 0.09% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.06% Time group info: ------[substitution.] 0.000179 24 1.12% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 3.08% : 0.000006s : 4: substitution.graph_param_transform 83.70% : 0.000150s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 5.19% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052707 2 95.47% : 0.050318s : 1: type_inference.infer 4.53% : 0.002388s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.22% : 0.000047s : 4: replace.inline 33.78% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 94.86% : 0.000147s : 4: match.inline 5.14% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.16% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.26% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 4.97% : 0.000006s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.34% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.50% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.65% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002158 26 71.30% : 0.001539s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.51% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.19% : 0.000587s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065275 72 0.06% : 0.000040s : 1: add_recomputation 0.09% : 0.000062s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.38% : 0.000251s : 1: bootstrap 0.03% : 0.000021s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.09% : 0.000056s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.02% : 0.006542s : 1: jit_opt_a 0.23% : 0.000149s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.66% : 0.000429s : 1: loop_unroll 0.99% : 0.000644s : 1: mutable_eliminate 1.38% : 0.000901s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000295s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000015s : 1: remove_dup_value 2.16% : 0.001411s : 1: renormalize.infer 0.97% : 0.000636s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000081s : 1: rewriter_before_opt_a 0.13% : 0.000082s : 1: symbol_engine_optimizer 80.88% : 0.052793s : 1: type_inference TotalTime = 0.017344, [30] [bootstrap]: 0.00028761 [type_inference]: 0.00861286 [event_method]: 2.208e-05 [auto_monad]: 7.192e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.97002e-06 [py_interpret_to_execute]: 4.594e-05 [rewriter_before_opt_a]: 8.593e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00582337, [2] [Cycle 1]: 0.00200009, [27] [switch_simplify]: 6.247e-05 [loop_unroll]: 3.259e-05 [a_1]: 0.00066544 [with_stream_mark]: 2.335e-05 [recompute_prepare]: 8.00999e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.43003e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.68002e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00084419 [add_forward_monad_depend]: 7.55e-06 [auto_monad_grad]: 2.53003e-06 [auto_monad_eliminator]: 1.849e-05 [cse]: 4.397e-05 [replace_applicator]: 1.563e-05 [Cycle 2]: 0.00036643, [27] [switch_simplify]: 6.40002e-06 [loop_unroll]: 5.12999e-06 [a_1]: 8.953e-05 [with_stream_mark]: 1.286e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 2.39999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 9.03002e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 4.81002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 6.72002e-06 [cse]: 3.077e-05 [replace_applicator]: 6.49999e-06 [py_interpret_to_execute_after_opt_a]: 1.515e-05 [rewriter_after_opt_a]: 4.58e-05 [convert_after_rewriter]: 7.45003e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.0006485 [jit_opt_b]: 5.162e-05, [1] [Cycle 1]: 4.446e-05, [2] [frontend_op_eliminate]: 1.697e-05 [inline_after_opt_a]: 1.613e-05 [cconv]: 3.005e-05 [loop_unroll]: 0.00042329 [jit_opt_after_cconv]: 0.00015864, [1] [Cycle 1]: 0.00015218, [11] [c_1]: 2.129e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 6.91999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 3.035e-05 [call_graph_tuple_transform]: 2.071e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 5.107e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 5.597e-05 [cse_after_recomputation]: 2.751e-05, [1] [Cycle 1]: 2.19e-05, [1] [cse]: 1.487e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 5.39e-06 [opt_after_jit_grad]: 0.0005095 [symbol_engine_optimizer]: 7.816e-05, [1] [Cycle 1]: 7.171e-05, [6] [build]: 5.29998e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.429e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 8.50006e-07 [validate]: 4.359e-05 Sums bootstrap : 0.000288s : 2.17% type_inference : 0.008613s : 64.97% event_method : 0.000022s : 0.17% auto_monad : 0.000072s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.35% rewriter_before_opt_a : 0.000086s : 0.65% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.52% jit_opt_a.loop_unroll : 0.000038s : 0.28% jit_opt_a.a_1 : 0.000755s : 5.69% jit_opt_a.with_stream_mark : 0.000036s : 0.27% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000844s : 6.37% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.19% jit_opt_a.cse : 0.000075s : 0.56% jit_opt_a.replace_applicator : 0.000022s : 0.17% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000046s : 0.35% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000648s : 4.89% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000030s : 0.23% loop_unroll : 0.000423s : 3.19% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000051s : 0.39% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000056s : 0.42% cse_after_recomputation.cse : 0.000015s : 0.11% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000509s : 3.84% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.33% Time group info: ------[substitution.] 0.000282 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 3: substitution.graph_param_transform 86.63% : 0.000244s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000005s : 2: substitution.replace_old_param 4.86% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008541 2 88.24% : 0.007537s : 1: type_inference.infer 11.76% : 0.001004s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.43% : 0.000062s : 5: replace.inline 32.57% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 7 95.09% : 0.000241s : 5: match.inline 4.91% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.16% : 0.000001s : 11: predicate.addn_zero_filter 1.79% : 0.000002s : 11: predicate.arithmetic_simplify 1.30% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.16% : 0.000001s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.32% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 6.34% : 0.000008s : 24: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.01% : 0.000002s : 16: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.22% : 0.000002s : 11: predicate.minmaximum_grad 1.71% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 16: predicate.partial_eliminate 1.37% : 0.000002s : 11: predicate.print_const_string_wrapper 1.51% : 0.000002s : 11: predicate.reduce_eliminate 1.65% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 2.10% : 0.000003s : 19: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 11: predicate.reshape_eliminate 1.78% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.97% : 0.000010s : 59: predicate.switch_simplify 1.17% : 0.000001s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.40% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000858 16 51.92% : 0.000446s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.66% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.43% : 0.000330s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019235 72 0.31% : 0.000059s : 1: add_recomputation 0.39% : 0.000075s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 1.60% : 0.000307s : 1: bootstrap 0.17% : 0.000033s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000030s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.30% : 0.005827s : 1: jit_opt_a 0.84% : 0.000162s : 1: jit_opt_after_cconv 0.28% : 0.000054s : 1: jit_opt_b 2.24% : 0.000432s : 1: loop_unroll 3.43% : 0.000659s : 1: mutable_eliminate 5.15% : 0.000991s : 26: opt.transform.jit_opt_a 0.26% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.13% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.71% : 0.000521s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000049s : 1: py_interpret_to_execute 0.10% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.29% : 0.000055s : 1: remove_dup_value 2.45% : 0.000472s : 1: renormalize.infer 1.89% : 0.000363s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000050s : 1: rewriter_after_opt_a 0.46% : 0.000089s : 1: rewriter_before_opt_a 0.42% : 0.000081s : 1: symbol_engine_optimizer 44.88% : 0.008633s : 1: type_inference TotalTime = 0.12579, [30] [bootstrap]: 0.0002751 [type_inference]: 0.111233 [event_method]: 2.71e-05 [auto_monad]: 9.048e-05 [graph_reusing]: 7.26001e-06 [pre_auto_parallel]: 2.61999e-06 [py_interpret_to_execute]: 0.00110934 [rewriter_before_opt_a]: 0.00012301 [expand_dump_flag]: 4.61002e-06 [jit_opt_a]: 0.00964011, [2] [Cycle 1]: 0.0047988, [27] [switch_simplify]: 7.753e-05 [loop_unroll]: 3.392e-05 [a_1]: 0.00078697 [with_stream_mark]: 2.859e-05 [recompute_prepare]: 1.165e-05 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.58001e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 7.36999e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.719e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.166e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00342288 [add_forward_monad_depend]: 9.61998e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 2.168e-05 [cse]: 4.272e-05 [replace_applicator]: 2.833e-05 [Cycle 2]: 0.00042592, [27] [switch_simplify]: 7.25998e-06 [loop_unroll]: 6.21998e-06 [a_1]: 0.00014402 [with_stream_mark]: 1.837e-05 [recompute_prepare]: 6.83998e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 1.20024e-07 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 9.07001e-06 [cse]: 1.722e-05 [replace_applicator]: 6.26e-06 [py_interpret_to_execute_after_opt_a]: 2.065e-05 [rewriter_after_opt_a]: 4.438e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00091954 [jit_opt_b]: 6.633e-05, [1] [Cycle 1]: 5.536e-05, [2] [frontend_op_eliminate]: 2.256e-05 [inline_after_opt_a]: 2.013e-05 [cconv]: 3.418e-05 [loop_unroll]: 0.00064062 [jit_opt_after_cconv]: 0.00021078, [1] [Cycle 1]: 0.0002002, [11] [c_1]: 2.971e-05 [parameter_eliminate]: 5.37999e-06 [updatestate_depend_eliminate]: 1.079e-05 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 3.849e-05 [call_graph_tuple_transform]: 4.167e-05 [tuple_list_get_item_eliminator]: 6.95998e-06 [none_parameter_eliminate]: 2.13002e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.896e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 1.116e-05 [add_recomputation]: 6.172e-05 [cse_after_recomputation]: 2.586e-05, [1] [Cycle 1]: 1.993e-05, [1] [cse]: 1.356e-05 [auto_monad_reorder]: 1.809e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 9.44e-06 [opt_after_jit_grad]: 0.00062654 [symbol_engine_optimizer]: 0.00025288, [1] [Cycle 1]: 0.0002453, [6] [build]: 5.04e-06 [elim_shapecalc]: 8.87999e-06 [elim_not_effective]: 0.00018075 [opt_reshape]: 7.97e-06 [fold_const_symbol]: 1.146e-05 [renormalize]: 6.69999e-07 [validate]: 6.523e-05 Sums bootstrap : 0.000275s : 0.23% type_inference : 0.111233s : 92.20% event_method : 0.000027s : 0.02% auto_monad : 0.000090s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001109s : 0.92% rewriter_before_opt_a : 0.000123s : 0.10% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000085s : 0.07% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000931s : 0.77% jit_opt_a.with_stream_mark : 0.000047s : 0.04% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003423s : 2.84% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.03% jit_opt_a.cse : 0.000060s : 0.05% jit_opt_a.replace_applicator : 0.000035s : 0.03% py_interpret_to_execute_after_opt_a : 0.000021s : 0.02% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000920s : 0.76% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000641s : 0.53% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000038s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000042s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000062s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000627s : 0.52% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000181s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000065s : 0.05% Time group info: ------[substitution.] 0.000504 28 32.46% : 0.000164s : 2: substitution.elim_not_effective 0.34% : 0.000002s : 2: substitution.fold_const_symbol 1.40% : 0.000007s : 4: substitution.graph_param_transform 56.96% : 0.000287s : 5: substitution.inline 0.93% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.14% : 0.000016s : 3: substitution.reduce_eliminate 1.05% : 0.000005s : 4: substitution.remove_not_recompute_node 1.35% : 0.000007s : 2: substitution.replace_old_param 2.38% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111113 2 96.70% : 0.107446s : 1: type_inference.infer 3.30% : 0.003667s : 1: type_inference.specialize ------[replace.] 0.000113 7 69.34% : 0.000078s : 5: replace.inline 30.66% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000295 7 96.34% : 0.000284s : 5: match.inline 3.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000158 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.52% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.91% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.12% : 0.000003s : 19: predicate.load_eliminater 2.00% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 2.15% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 1.89% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.24% : 0.000004s : 13: predicate.reduce_eliminate 1.69% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.98% : 0.000011s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.14% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002525 25 58.23% : 0.001470s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.75% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.02% : 0.000960s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130676 72 0.05% : 0.000065s : 1: add_recomputation 0.07% : 0.000095s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000288s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.38% : 0.009644s : 1: jit_opt_a 0.16% : 0.000214s : 1: jit_opt_after_cconv 0.05% : 0.000069s : 1: jit_opt_b 0.50% : 0.000652s : 1: loop_unroll 0.72% : 0.000936s : 1: mutable_eliminate 0.93% : 0.001212s : 26: opt.transform.jit_opt_a 0.06% : 0.000080s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.02% : 0.000021s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000023s : 1: opt.transform.mutable_eliminate 0.03% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000206s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000638s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.86% : 0.001124s : 1: py_interpret_to_execute 0.02% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.82% : 0.002381s : 1: renormalize.infer 0.79% : 0.001028s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.10% : 0.000128s : 1: rewriter_before_opt_a 0.20% : 0.000256s : 1: symbol_engine_optimizer 85.14% : 0.111262s : 1: type_inference TotalTime = 0.0204004, [30] [bootstrap]: 0.00034424 [type_inference]: 0.0109811 [event_method]: 2.27e-05 [auto_monad]: 7.343e-05 [graph_reusing]: 7.15e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 5.566e-05 [rewriter_before_opt_a]: 9.564e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00611869, [2] [Cycle 1]: 0.00212488, [27] [switch_simplify]: 6.664e-05 [loop_unroll]: 3.328e-05 [a_1]: 0.0006584 [with_stream_mark]: 2.034e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 4.25999e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 2.63e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.46998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.565e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 8.86002e-06 [inline_without_move]: 6.05002e-06 [renormalize]: 0.00098793 [add_forward_monad_depend]: 6.46e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.651e-05 [cse]: 4.172e-05 [replace_applicator]: 1.534e-05 [Cycle 2]: 0.00032963, [27] [switch_simplify]: 6.51999e-06 [loop_unroll]: 5.37001e-06 [a_1]: 9.096e-05 [with_stream_mark]: 9.74999e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 8.54002e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 7.81001e-06 [inline_without_move]: 4.99e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.602e-05 [replace_applicator]: 5.38002e-06 [py_interpret_to_execute_after_opt_a]: 1.315e-05 [rewriter_after_opt_a]: 4.116e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.92001e-06 [mutable_eliminate]: 0.00071544 [jit_opt_b]: 5.929e-05, [1] [Cycle 1]: 5.041e-05, [2] [frontend_op_eliminate]: 1.771e-05 [inline_after_opt_a]: 1.866e-05 [cconv]: 2.935e-05 [loop_unroll]: 0.00056101 [jit_opt_after_cconv]: 0.00017527, [1] [Cycle 1]: 0.00016851, [11] [c_1]: 2.269e-05 [parameter_eliminate]: 3.41001e-06 [updatestate_depend_eliminate]: 8.25999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 4.079e-05 [call_graph_tuple_transform]: 2.229e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.80002e-06 [remove_dup_value]: 4.562e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 6.72002e-06 [add_recomputation]: 5.487e-05 [cse_after_recomputation]: 2.403e-05, [1] [Cycle 1]: 1.836e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.881e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 6.66999e-06 [opt_after_jit_grad]: 0.00056725 [symbol_engine_optimizer]: 7.815e-05, [1] [Cycle 1]: 7.135e-05, [6] [build]: 4.34002e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 1.441e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 4.30009e-07 [validate]: 4.473e-05 Sums bootstrap : 0.000344s : 2.14% type_inference : 0.010981s : 68.28% event_method : 0.000023s : 0.14% auto_monad : 0.000073s : 0.46% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000056s : 0.35% rewriter_before_opt_a : 0.000096s : 0.59% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.45% jit_opt_a.loop_unroll : 0.000039s : 0.24% jit_opt_a.a_1 : 0.000749s : 4.66% jit_opt_a.with_stream_mark : 0.000030s : 0.19% jit_opt_a.recompute_prepare : 0.000014s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.10% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000988s : 6.14% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.14% jit_opt_a.cse : 0.000058s : 0.36% jit_opt_a.replace_applicator : 0.000021s : 0.13% py_interpret_to_execute_after_opt_a : 0.000013s : 0.08% rewriter_after_opt_a : 0.000041s : 0.26% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000715s : 4.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.11% jit_opt_b.inline_after_opt_a : 0.000019s : 0.12% cconv : 0.000029s : 0.18% loop_unroll : 0.000561s : 3.49% jit_opt_after_cconv.c_1 : 0.000023s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000041s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000046s : 0.28% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000055s : 0.34% cse_after_recomputation.cse : 0.000012s : 0.07% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000567s : 3.53% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.28% Time group info: ------[substitution.] 0.000264 24 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000007s : 3: substitution.graph_param_transform 86.08% : 0.000227s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000006s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 5.04% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010900 2 87.08% : 0.009492s : 1: type_inference.infer 12.92% : 0.001408s : 1: type_inference.specialize ------[replace.] 0.000101 7 69.33% : 0.000070s : 5: replace.inline 30.67% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 7 94.87% : 0.000225s : 5: match.inline 5.13% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.59% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.12% : 0.000001s : 11: predicate.addn_zero_filter 1.92% : 0.000002s : 11: predicate.arithmetic_simplify 1.20% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.14% : 0.000001s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.59% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 16: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 2.24% : 0.000003s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.13% : 0.000001s : 11: predicate.print_const_string_wrapper 1.78% : 0.000002s : 11: predicate.reduce_eliminate 1.39% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.97% : 0.000003s : 19: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.05% : 0.000010s : 59: predicate.switch_simplify 1.20% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000001s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.75% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001052 16 49.58% : 0.000522s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.72% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.70% : 0.000460s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022443 72 0.26% : 0.000057s : 1: add_recomputation 0.34% : 0.000077s : 1: auto_monad 0.09% : 0.000021s : 1: auto_monad_reorder 1.64% : 0.000368s : 1: bootstrap 0.14% : 0.000033s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.21% : 0.000047s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 27.28% : 0.006122s : 1: jit_opt_a 0.79% : 0.000178s : 1: jit_opt_after_cconv 0.28% : 0.000062s : 1: jit_opt_b 2.54% : 0.000571s : 1: loop_unroll 3.24% : 0.000727s : 1: mutable_eliminate 4.39% : 0.000986s : 26: opt.transform.jit_opt_a 0.24% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000028s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000020s : 1: opt.transform.mutable_eliminate 0.12% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.57% : 0.000577s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000059s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000049s : 1: remove_dup_value 2.30% : 0.000516s : 1: renormalize.infer 2.07% : 0.000464s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000044s : 1: rewriter_after_opt_a 0.44% : 0.000099s : 1: rewriter_before_opt_a 0.36% : 0.000081s : 1: symbol_engine_optimizer 49.01% : 0.010998s : 1: type_inference TotalTime = 0.124155, [30] [bootstrap]: 0.0003052 [type_inference]: 0.113599 [event_method]: 2.487e-05 [auto_monad]: 7.517e-05 [graph_reusing]: 6.99001e-06 [pre_auto_parallel]: 2.72001e-06 [py_interpret_to_execute]: 0.00045052 [rewriter_before_opt_a]: 0.00012764 [expand_dump_flag]: 3.84002e-06 [jit_opt_a]: 0.00722903, [2] [Cycle 1]: 0.00360743, [27] [switch_simplify]: 6.018e-05 [loop_unroll]: 3.431e-05 [a_1]: 0.00072478 [with_stream_mark]: 1.764e-05 [recompute_prepare]: 9.07999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.90002e-06 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 6.40002e-06 [renormalize]: 0.00241962 [add_forward_monad_depend]: 5.89999e-06 [auto_monad_grad]: 2.02999e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 3.645e-05 [replace_applicator]: 1.586e-05 [Cycle 2]: 0.00037038, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.82001e-06 [a_1]: 0.00012564 [with_stream_mark]: 1.068e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.23e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.22998e-06 [inline_without_move]: 5.54e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.78002e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.376e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 1.363e-05 [rewriter_after_opt_a]: 3.787e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.0006339 [jit_opt_b]: 5.685e-05, [1] [Cycle 1]: 4.878e-05, [2] [frontend_op_eliminate]: 1.867e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.968e-05 [loop_unroll]: 0.00044694 [jit_opt_after_cconv]: 0.00016378, [1] [Cycle 1]: 0.00015703, [11] [c_1]: 2.59e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 8.00999e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.838e-05 [call_graph_tuple_transform]: 2.263e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 1.90019e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.712e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 8.82999e-06 [add_recomputation]: 5.232e-05 [cse_after_recomputation]: 2.347e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.219e-05 [auto_monad_reorder]: 1.939e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 5.75001e-06 [opt_after_jit_grad]: 0.00048475 [symbol_engine_optimizer]: 7.854e-05, [1] [Cycle 1]: 7.163e-05, [6] [build]: 4.49002e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.418e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 8.69998e-06 [renormalize]: 4.60015e-07 [validate]: 4.755e-05 Sums bootstrap : 0.000305s : 0.25% type_inference : 0.113599s : 94.43% event_method : 0.000025s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000451s : 0.37% rewriter_before_opt_a : 0.000128s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000850s : 0.71% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002420s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000634s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000447s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000485s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000247 28 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000007s : 4: substitution.graph_param_transform 81.09% : 0.000200s : 5: substitution.inline 1.43% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.84% : 0.000012s : 3: substitution.reduce_eliminate 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000005s : 2: substitution.replace_old_param 4.70% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113516 2 97.51% : 0.110688s : 1: type_inference.infer 2.49% : 0.002828s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.85% : 0.000066s : 5: replace.inline 32.15% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 7 95.07% : 0.000197s : 5: match.inline 4.93% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000200 886 1.01% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.80% : 0.000002s : 13: predicate.addn_check_dump 0.85% : 0.000002s : 13: predicate.addn_zero_filter 1.27% : 0.000003s : 13: predicate.arithmetic_simplify 0.83% : 0.000002s : 13: predicate.cast_eliminate 0.29% : 0.000001s : 4: predicate.check_bprop_eliminate 0.76% : 0.000002s : 13: predicate.compare_switch_simplify 0.93% : 0.000002s : 13: predicate.depend_value_elim 0.78% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.82% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.80% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.58% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.84% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.75% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.76% : 0.000002s : 13: predicate.environ_get_depend_swap 0.84% : 0.000002s : 13: predicate.environ_get_eliminate 0.80% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 0.71% : 0.000001s : 8: predicate.get_grad_eliminate 0.20% : 0.000000s : 4: predicate.graph_param_transform 4.05% : 0.000008s : 28: predicate.inline 0.61% : 0.000001s : 8: predicate.inline_without_move 0.29% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.79% : 0.000002s : 8: predicate.less_batch_normalization 0.97% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.24% : 0.000002s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.70% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.27% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.77% : 0.000002s : 13: predicate.merge_addn 0.80% : 0.000002s : 13: predicate.minmaximum_grad 7.85% : 0.000016s : 4: predicate.mutable_eliminate 0.32% : 0.000001s : 4: predicate.opt_reshape 1.64% : 0.000003s : 19: predicate.partial_eliminate 0.83% : 0.000002s : 13: predicate.print_const_string_wrapper 1.33% : 0.000003s : 13: predicate.reduce_eliminate 1.01% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.39% : 0.000001s : 8: predicate.remove_not_recompute_node 1.51% : 0.000003s : 23: predicate.replace_applicator 0.53% : 0.000001s : 8: predicate.replace_old_param 0.26% : 0.000001s : 4: predicate.reset_defer_inline 1.07% : 0.000002s : 13: predicate.reshape_eliminate 0.93% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.45% : 0.000001s : 4: predicate.row_tensor_eliminate 0.83% : 0.000002s : 13: predicate.same_eliminate 0.45% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.60% : 0.000001s : 8: predicate.special_op_eliminate 0.68% : 0.000001s : 8: predicate.specialize_transform 0.98% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.03% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.77% : 0.000004s : 20: predicate.switch_defer_inline 1.48% : 0.000003s : 20: predicate.switch_layer_defer_inline 29.24% : 0.000058s : 64: predicate.switch_simplify 0.92% : 0.000002s : 13: predicate.tile_eliminate 0.81% : 0.000002s : 13: predicate.transpose_eliminate 0.98% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.90% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.61% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.14% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.02% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.15% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 1.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.10% : 0.000002s : 13: predicate.value_based_eliminate 0.26% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002382 25 65.01% : 0.001549s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.36% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.63% : 0.000777s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127753 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.25% : 0.000323s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 5.66% : 0.007233s : 1: jit_opt_a 0.13% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000455s : 1: loop_unroll 0.50% : 0.000644s : 1: mutable_eliminate 0.85% : 0.001092s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000033s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.32% : 0.001687s : 1: renormalize.infer 0.57% : 0.000723s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.11% : 0.000135s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.94% : 0.113620s : 1: type_inference TotalTime = 0.127164, [30] [bootstrap]: 0.00049763 [type_inference]: 0.116052 [event_method]: 2.197e-05 [auto_monad]: 7.427e-05 [graph_reusing]: 6.70002e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 0.00053482 [rewriter_before_opt_a]: 9.433e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.0075966, [2] [Cycle 1]: 0.00380067, [27] [switch_simplify]: 5.731e-05 [loop_unroll]: 3.343e-05 [a_1]: 0.00065548 [with_stream_mark]: 1.612e-05 [recompute_prepare]: 9.04998e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.79999e-06 [inline_without_move]: 6.26e-06 [renormalize]: 0.00269827 [add_forward_monad_depend]: 6.09001e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.623e-05 [cse]: 3.29e-05 [replace_applicator]: 1.475e-05 [Cycle 2]: 0.00038092, [27] [switch_simplify]: 7.38e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.00013335 [with_stream_mark]: 1.074e-05 [recompute_prepare]: 6.76e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.96998e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.98998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.249e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.69e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.318e-05 [replace_applicator]: 5.90002e-06 [py_interpret_to_execute_after_opt_a]: 1.295e-05 [rewriter_after_opt_a]: 3.727e-05 [convert_after_rewriter]: 7.37997e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00056358 [jit_opt_b]: 5.384e-05, [1] [Cycle 1]: 4.711e-05, [2] [frontend_op_eliminate]: 1.833e-05 [inline_after_opt_a]: 1.792e-05 [cconv]: 2.362e-05 [loop_unroll]: 0.00042187 [jit_opt_after_cconv]: 0.00018324, [1] [Cycle 1]: 0.00017657, [11] [c_1]: 2.531e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 3.292e-05 [cse]: 2.145e-05 [call_graph_tuple_transform]: 2.144e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.581e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 7.65998e-06 [add_recomputation]: 4.746e-05 [cse_after_recomputation]: 2.506e-05, [1] [Cycle 1]: 1.975e-05, [1] [cse]: 1.257e-05 [auto_monad_reorder]: 1.652e-05 [get_jit_bprop_graph]: 3.14999e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.00047303 [symbol_engine_optimizer]: 7.823e-05, [1] [Cycle 1]: 7.248e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 9.52999e-06 [elim_not_effective]: 1.427e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 1.135e-05 [renormalize]: 4.09986e-07 [validate]: 0.00011285 Sums bootstrap : 0.000498s : 0.40% type_inference : 0.116052s : 94.23% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000535s : 0.43% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000789s : 0.64% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002698s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000564s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000422s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000033s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000473s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000113s : 0.09% Time group info: ------[substitution.] 0.000246 28 1.27% : 0.000003s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 4: substitution.graph_param_transform 81.48% : 0.000201s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.49% : 0.000011s : 3: substitution.reduce_eliminate 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000004s : 2: substitution.replace_old_param 4.45% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115973 2 97.36% : 0.112909s : 1: type_inference.infer 2.64% : 0.003064s : 1: type_inference.specialize ------[replace.] 0.000094 7 67.35% : 0.000063s : 5: replace.inline 32.65% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 7 95.29% : 0.000198s : 5: match.inline 4.71% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 2.00% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.26% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000007s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.22% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.72% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.10% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.52% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003238 25 76.14% : 0.002465s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.81% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 22.05% : 0.000714s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130890 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.40% : 0.000521s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.81% : 0.007600s : 1: jit_opt_a 0.14% : 0.000186s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.33% : 0.000430s : 1: loop_unroll 0.44% : 0.000572s : 1: mutable_eliminate 0.78% : 0.001027s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000541s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.49% : 0.001956s : 1: renormalize.infer 0.56% : 0.000733s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000099s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.68% : 0.116068s : 1: type_inference TotalTime = 0.0285679, [30] [bootstrap]: 0.0003677 [type_inference]: 0.0165622 [event_method]: 2.38e-05 [auto_monad]: 7.804e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 3.01999e-06 [py_interpret_to_execute]: 7.479e-05 [rewriter_before_opt_a]: 8.529e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.0090452, [2] [Cycle 1]: 0.00251292, [27] [switch_simplify]: 8.623e-05 [loop_unroll]: 3.34e-05 [a_1]: 0.00080165 [with_stream_mark]: 2.623e-05 [recompute_prepare]: 8.1e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 2.01003e-06 [specialize_transform]: 6.75998e-06 [updatestate_useless_node_eliminater]: 5.78997e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.58003e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 9.13002e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 5.79e-06 [renormalize]: 0.00119941 [add_forward_monad_depend]: 6.10002e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.684e-05 [cse]: 3.714e-05 [replace_applicator]: 1.311e-05 [Cycle 2]: 0.00033471, [27] [switch_simplify]: 5.87001e-06 [loop_unroll]: 5.02999e-06 [a_1]: 0.00010236 [with_stream_mark]: 1.01e-05 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.19998e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.085e-05 [j_node_and_user_rematch]: 7.83001e-06 [meta_fg_expand]: 1.61002e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.69972e-07 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.273e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.402e-05 [rewriter_after_opt_a]: 4.498e-05 [convert_after_rewriter]: 7.93999e-06 [order_py_execute_after_rewriter]: 6.00002e-06 [mutable_eliminate]: 0.00065052 [jit_opt_b]: 5.357e-05, [1] [Cycle 1]: 4.575e-05, [2] [frontend_op_eliminate]: 1.791e-05 [inline_after_opt_a]: 1.578e-05 [cconv]: 2.541e-05 [loop_unroll]: 0.0004303 [jit_opt_after_cconv]: 0.0001627, [1] [Cycle 1]: 0.00015608, [11] [c_1]: 2.279e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.258e-05 [call_graph_tuple_transform]: 3.272e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.744e-05 [partial_unused_args_eliminate]: 2.08002e-06 [environ_conv]: 5.81e-06 [add_recomputation]: 5.5e-05 [cse_after_recomputation]: 2.377e-05, [1] [Cycle 1]: 1.827e-05, [1] [cse]: 1.209e-05 [auto_monad_reorder]: 1.732e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 5.71998e-06 [opt_after_jit_grad]: 0.00047039 [symbol_engine_optimizer]: 7.54e-05, [1] [Cycle 1]: 6.916e-05, [6] [build]: 3.93001e-06 [elim_shapecalc]: 8.04997e-06 [elim_not_effective]: 1.349e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.89999e-06 [renormalize]: 3.59985e-07 [validate]: 4.238e-05 Sums bootstrap : 0.000368s : 1.69% type_inference : 0.016562s : 76.20% event_method : 0.000024s : 0.11% auto_monad : 0.000078s : 0.36% graph_reusing : 0.000007s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000075s : 0.34% rewriter_before_opt_a : 0.000085s : 0.39% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000092s : 0.42% jit_opt_a.loop_unroll : 0.000038s : 0.18% jit_opt_a.a_1 : 0.000904s : 4.16% jit_opt_a.with_stream_mark : 0.000036s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.05% jit_opt_a.accelerated_algorithm : 0.000011s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.08% jit_opt_a.inline_without_move : 0.000011s : 0.05% jit_opt_a.renormalize : 0.001199s : 5.52% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.11% jit_opt_a.cse : 0.000050s : 0.23% jit_opt_a.replace_applicator : 0.000018s : 0.08% py_interpret_to_execute_after_opt_a : 0.000014s : 0.06% rewriter_after_opt_a : 0.000045s : 0.21% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000651s : 2.99% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.07% cconv : 0.000025s : 0.12% loop_unroll : 0.000430s : 1.98% jit_opt_after_cconv.c_1 : 0.000023s : 0.10% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000033s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000055s : 0.25% cse_after_recomputation.cse : 0.000012s : 0.06% auto_monad_reorder : 0.000017s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000470s : 2.16% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.19% Time group info: ------[substitution.] 0.000369 27 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000002s : 2: substitution.fold_const_symbol 1.70% : 0.000006s : 3: substitution.graph_param_transform 87.67% : 0.000323s : 5: substitution.inline 0.92% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.76% : 0.000010s : 3: substitution.reduce_eliminate 1.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.33% : 0.000005s : 2: substitution.replace_old_param 3.31% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.016453 2 91.01% : 0.014975s : 1: type_inference.infer 8.99% : 0.001478s : 1: type_inference.specialize ------[replace.] 0.000112 7 69.23% : 0.000078s : 5: replace.inline 30.77% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000331 7 96.64% : 0.000320s : 5: match.inline 3.36% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 747 2.12% : 0.000003s : 11: predicate.accumulaten_eliminater 1.18% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.24% : 0.000002s : 11: predicate.addn_zero_filter 2.42% : 0.000003s : 11: predicate.arithmetic_simplify 1.76% : 0.000002s : 11: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 11: predicate.compare_switch_simplify 1.16% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.33% : 0.000002s : 11: predicate.environ_get_depend_swap 1.38% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 24: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 11: predicate.merge_addn 1.39% : 0.000002s : 11: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 2.41% : 0.000003s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 19: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 11: predicate.reshape_eliminate 1.57% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.47% : 0.000002s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.35% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.29% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 59: predicate.switch_simplify 1.42% : 0.000002s : 11: predicate.tile_eliminate 1.97% : 0.000003s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.50% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001273 16 54.65% : 0.000695s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.01% : 0.000102s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.34% : 0.000475s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030979 72 0.19% : 0.000058s : 1: add_recomputation 0.26% : 0.000081s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 1.26% : 0.000389s : 1: bootstrap 0.09% : 0.000028s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000026s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000029s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 29.22% : 0.009053s : 1: jit_opt_a 0.53% : 0.000166s : 1: jit_opt_after_cconv 0.18% : 0.000057s : 1: jit_opt_b 1.41% : 0.000438s : 1: loop_unroll 2.13% : 0.000660s : 1: mutable_eliminate 3.72% : 0.001152s : 26: opt.transform.jit_opt_a 0.21% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000015s : 1: opt.transform.mutable_eliminate 0.07% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.55% : 0.000479s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000077s : 1: py_interpret_to_execute 0.05% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000020s : 1: remove_dup_value 2.13% : 0.000659s : 1: renormalize.infer 1.71% : 0.000530s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000048s : 1: rewriter_after_opt_a 0.29% : 0.000088s : 1: rewriter_before_opt_a 0.25% : 0.000078s : 1: symbol_engine_optimizer 53.54% : 0.016585s : 1: type_inference TotalTime = 0.138506, [30] [bootstrap]: 0.00029405 [type_inference]: 0.126207 [event_method]: 2.308e-05 [auto_monad]: 8.207e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 3.00998e-06 [py_interpret_to_execute]: 0.00044295 [rewriter_before_opt_a]: 0.00010238 [expand_dump_flag]: 4.11001e-06 [jit_opt_a]: 0.00872266, [2] [Cycle 1]: 0.00414818, [27] [switch_simplify]: 7.013e-05 [loop_unroll]: 3.394e-05 [a_1]: 0.00075777 [with_stream_mark]: 2.116e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 4.55001e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 6.38998e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.57001e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.707e-05 [j_node_and_user_rematch]: 1.048e-05 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 1.028e-05 [inline_without_move]: 6.45997e-06 [renormalize]: 0.00287693 [add_forward_monad_depend]: 7.9e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.906e-05 [cse]: 4.06e-05 [replace_applicator]: 2.149e-05 [Cycle 2]: 0.00041962, [27] [switch_simplify]: 8.87e-06 [loop_unroll]: 6.47001e-06 [a_1]: 0.00014291 [with_stream_mark]: 1.675e-05 [recompute_prepare]: 6.93998e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.28999e-06 [cell_reuse_recompute_pass]: 3.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.941e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.77001e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.727e-05 [replace_applicator]: 6.34001e-06 [py_interpret_to_execute_after_opt_a]: 1.437e-05 [rewriter_after_opt_a]: 5.154e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.21998e-06 [mutable_eliminate]: 0.00072449 [jit_opt_b]: 8.799e-05, [1] [Cycle 1]: 7.99e-05, [2] [frontend_op_eliminate]: 1.973e-05 [inline_after_opt_a]: 1.884e-05 [cconv]: 2.683e-05 [loop_unroll]: 0.00044312 [jit_opt_after_cconv]: 0.00016461, [1] [Cycle 1]: 0.00015819, [11] [c_1]: 2.674e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.62001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 4.62e-06 [cse]: 2.687e-05 [call_graph_tuple_transform]: 2.255e-05 [tuple_list_get_item_eliminator]: 8.09002e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 1.853e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 5.026e-05 [cse_after_recomputation]: 2.841e-05, [1] [Cycle 1]: 2.274e-05, [1] [cse]: 1.665e-05 [auto_monad_reorder]: 1.875e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.19e-06 [opt_after_jit_grad]: 0.00049408 [symbol_engine_optimizer]: 8.858e-05, [1] [Cycle 1]: 8.186e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 1.242e-05 [elim_not_effective]: 1.765e-05 [opt_reshape]: 6.55997e-06 [fold_const_symbol]: 1.347e-05 [renormalize]: 5.39992e-07 [validate]: 5.688e-05 Sums bootstrap : 0.000294s : 0.22% type_inference : 0.126207s : 94.48% event_method : 0.000023s : 0.02% auto_monad : 0.000082s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000443s : 0.33% rewriter_before_opt_a : 0.000102s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000901s : 0.67% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002877s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000052s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000724s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000443s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000494s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000267 25 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000007s : 4: substitution.graph_param_transform 84.95% : 0.000227s : 5: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000005s : 2: substitution.replace_old_param 5.29% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126116 2 97.64% : 0.123145s : 1: type_inference.infer 2.36% : 0.002972s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.97% : 0.000073s : 5: replace.inline 31.03% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000237 7 94.56% : 0.000224s : 5: match.inline 5.44% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000198 886 0.95% : 0.000002s : 13: predicate.accumulaten_eliminater 0.74% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.89% : 0.000002s : 13: predicate.addn_check_dump 1.13% : 0.000002s : 13: predicate.addn_zero_filter 1.36% : 0.000003s : 13: predicate.arithmetic_simplify 0.94% : 0.000002s : 13: predicate.cast_eliminate 0.28% : 0.000001s : 4: predicate.check_bprop_eliminate 0.80% : 0.000002s : 13: predicate.compare_switch_simplify 0.84% : 0.000002s : 13: predicate.depend_value_elim 0.81% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.94% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.00% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.57% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.90% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.79% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.82% : 0.000002s : 13: predicate.environ_get_depend_swap 0.89% : 0.000002s : 13: predicate.environ_get_eliminate 0.83% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 0.82% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000001s : 4: predicate.graph_param_transform 3.94% : 0.000008s : 28: predicate.inline 0.62% : 0.000001s : 8: predicate.inline_without_move 0.32% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.97% : 0.000002s : 8: predicate.less_batch_normalization 1.16% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.39% : 0.000003s : 19: predicate.load_eliminater 0.76% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.96% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.53% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.85% : 0.000002s : 13: predicate.merge_addn 0.81% : 0.000002s : 13: predicate.minmaximum_grad 1.23% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 1.75% : 0.000003s : 19: predicate.partial_eliminate 0.86% : 0.000002s : 13: predicate.print_const_string_wrapper 1.43% : 0.000003s : 13: predicate.reduce_eliminate 1.14% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 8: predicate.remove_not_recompute_node 1.49% : 0.000003s : 23: predicate.replace_applicator 0.43% : 0.000001s : 8: predicate.replace_old_param 0.25% : 0.000001s : 4: predicate.reset_defer_inline 1.00% : 0.000002s : 13: predicate.reshape_eliminate 1.04% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.55% : 0.000001s : 4: predicate.row_tensor_eliminate 0.94% : 0.000002s : 13: predicate.same_eliminate 0.48% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.74% : 0.000001s : 8: predicate.special_op_eliminate 0.68% : 0.000001s : 8: predicate.specialize_transform 1.09% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.82% : 0.000004s : 20: predicate.switch_defer_inline 1.50% : 0.000003s : 20: predicate.switch_layer_defer_inline 5.33% : 0.000011s : 64: predicate.switch_simplify 1.02% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 0.98% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.95% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.15% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.08% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.19% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 28.25% : 0.000056s : 27: predicate.updatestate_useless_node_eliminater 1.13% : 0.000002s : 13: predicate.value_based_eliminate 0.23% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002470 25 64.75% : 0.001599s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.53% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.72% : 0.000808s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142494 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000313s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.12% : 0.008726s : 1: jit_opt_a 0.12% : 0.000168s : 1: jit_opt_after_cconv 0.06% : 0.000091s : 1: jit_opt_b 0.32% : 0.000451s : 1: loop_unroll 0.52% : 0.000734s : 1: mutable_eliminate 0.82% : 0.001168s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000450s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.43% : 0.002044s : 1: renormalize.infer 0.58% : 0.000822s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000055s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000091s : 1: symbol_engine_optimizer 88.58% : 0.126224s : 1: type_inference TotalTime = 0.130937, [30] [bootstrap]: 0.00027788 [type_inference]: 0.119322 [event_method]: 2.235e-05 [auto_monad]: 7.449e-05 [graph_reusing]: 5.83002e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00047759 [rewriter_before_opt_a]: 9.451e-05 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.00817057, [2] [Cycle 1]: 0.00453435, [27] [switch_simplify]: 5.638e-05 [loop_unroll]: 3.422e-05 [a_1]: 0.00069783 [with_stream_mark]: 1.63e-05 [recompute_prepare]: 1.005e-05 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 7.15998e-06 [updatestate_useless_node_eliminater]: 6.49999e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.50002e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 2.464e-05 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 1.061e-05 [inline_without_move]: 6.63998e-06 [renormalize]: 0.00334765 [add_forward_monad_depend]: 7.17002e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.711e-05 [cse]: 3.725e-05 [replace_applicator]: 2.185e-05 [Cycle 2]: 0.00040545, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.79999e-06 [a_1]: 0.00013993 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 5.96003e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 3.9e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.534e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.51999e-06 [cse]: 1.475e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.37e-05 [rewriter_after_opt_a]: 8.599e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 5.74999e-06 [mutable_eliminate]: 0.00061258 [jit_opt_b]: 5.629e-05, [1] [Cycle 1]: 4.97e-05, [2] [frontend_op_eliminate]: 1.991e-05 [inline_after_opt_a]: 1.889e-05 [cconv]: 3.015e-05 [loop_unroll]: 0.0004456 [jit_opt_after_cconv]: 0.00016082, [1] [Cycle 1]: 0.0001544, [11] [c_1]: 2.765e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.23e-05 [call_graph_tuple_transform]: 2.202e-05 [tuple_list_get_item_eliminator]: 6.91001e-06 [none_parameter_eliminate]: 1.76003e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 7.41999e-06 [remove_dup_value]: 1.825e-05 [partial_unused_args_eliminate]: 2.81e-06 [environ_conv]: 8.55999e-06 [add_recomputation]: 5.313e-05 [cse_after_recomputation]: 2.415e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.323e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 5.82999e-06 [opt_after_jit_grad]: 0.00048008 [symbol_engine_optimizer]: 8.016e-05, [1] [Cycle 1]: 7.344e-05, [6] [build]: 4.03001e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 8.63001e-06 [fold_const_symbol]: 1.045e-05 [renormalize]: 4.19997e-07 [validate]: 0.00019177 Sums bootstrap : 0.000278s : 0.22% type_inference : 0.119322s : 93.87% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000478s : 0.38% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000838s : 0.66% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000034s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003348s : 2.63% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000086s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000613s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000446s : 0.35% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000480s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000192s : 0.15% Time group info: ------[substitution.] 0.000278 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 4: substitution.graph_param_transform 77.53% : 0.000216s : 5: substitution.inline 6.17% : 0.000017s : 4: substitution.j_node_and_user_rematch 4.78% : 0.000013s : 3: substitution.reduce_eliminate 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 4.13% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119242 2 97.44% : 0.116192s : 1: type_inference.infer 2.56% : 0.003050s : 1: type_inference.specialize ------[replace.] 0.000108 7 69.26% : 0.000075s : 5: replace.inline 30.74% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 95.34% : 0.000213s : 5: match.inline 4.66% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.47% : 0.000002s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.26% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.31% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.41% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.25% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 1.00% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.46% : 0.000002s : 13: predicate.print_const_string_wrapper 2.23% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 1.01% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000004s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002652 25 59.33% : 0.001574s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.33% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.33% : 0.001017s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135318 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000297s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.04% : 0.008174s : 1: jit_opt_a 0.12% : 0.000163s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.34% : 0.000454s : 1: loop_unroll 0.46% : 0.000621s : 1: mutable_eliminate 0.82% : 0.001103s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000485s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.79% : 0.002419s : 1: renormalize.infer 0.68% : 0.000918s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000089s : 1: rewriter_after_opt_a 0.07% : 0.000099s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 88.19% : 0.119338s : 1: type_inference TotalTime = 0.0135495, [30] [bootstrap]: 0.00028893 [type_inference]: 0.00452798 [event_method]: 1.703e-05 [auto_monad]: 6.482e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 3.511e-05 [rewriter_before_opt_a]: 0.00108875 [expand_dump_flag]: 4.13999e-06 [jit_opt_a]: 0.00550615, [2] [Cycle 1]: 0.00163591, [27] [switch_simplify]: 4.942e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00055381 [with_stream_mark]: 1.401e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.204e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 8.23001e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.0006902 [add_forward_monad_depend]: 4.98001e-06 [auto_monad_grad]: 1.55999e-06 [auto_monad_eliminator]: 1.274e-05 [cse]: 1.676e-05 [replace_applicator]: 1.106e-05 [Cycle 2]: 0.00032366, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.07999e-06 [a_1]: 9.46e-05 [with_stream_mark]: 8.97999e-06 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 4.82e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 4.59998e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.172e-05 [j_node_and_user_rematch]: 8.61002e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.15e-06 [inline_without_move]: 4.82e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.46999e-06 [cse]: 1.053e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 1.662e-05 [rewriter_after_opt_a]: 3.142e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00049181 [jit_opt_b]: 5.305e-05, [1] [Cycle 1]: 4.651e-05, [2] [frontend_op_eliminate]: 1.865e-05 [inline_after_opt_a]: 1.596e-05 [cconv]: 1.786e-05 [loop_unroll]: 0.00041708 [jit_opt_after_cconv]: 0.00013854, [1] [Cycle 1]: 0.00013226, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.64e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.007e-05 [call_graph_tuple_transform]: 1.702e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 1.34998e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.24998e-06 [remove_dup_value]: 1.113e-05 [partial_unused_args_eliminate]: 1.53002e-06 [environ_conv]: 5.32001e-06 [add_recomputation]: 3.717e-05 [cse_after_recomputation]: 2.148e-05, [1] [Cycle 1]: 1.652e-05, [1] [cse]: 1.03e-05 [auto_monad_reorder]: 1.205e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00046803 [symbol_engine_optimizer]: 7.189e-05, [1] [Cycle 1]: 6.484e-05, [6] [build]: 2.88998e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.255e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.41002e-06 [renormalize]: 4.09986e-07 [validate]: 2.936e-05 Sums bootstrap : 0.000289s : 3.06% type_inference : 0.004528s : 47.98% event_method : 0.000017s : 0.18% auto_monad : 0.000065s : 0.69% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.37% rewriter_before_opt_a : 0.001089s : 11.54% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.58% jit_opt_a.loop_unroll : 0.000036s : 0.38% jit_opt_a.a_1 : 0.000648s : 6.87% jit_opt_a.with_stream_mark : 0.000023s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000690s : 7.31% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.20% jit_opt_a.cse : 0.000027s : 0.29% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000017s : 0.18% rewriter_after_opt_a : 0.000031s : 0.33% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000492s : 5.21% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000018s : 0.19% loop_unroll : 0.000417s : 4.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000011s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000037s : 0.39% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000012s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000468s : 4.96% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.31% Time group info: ------[substitution.] 0.000209 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000005s : 3: substitution.graph_param_transform 85.66% : 0.000179s : 4: substitution.inline 1.15% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000004s : 2: substitution.replace_old_param 5.46% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004471 2 81.92% : 0.003663s : 1: type_inference.infer 18.08% : 0.000808s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.63% : 0.000046s : 4: replace.inline 33.37% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 94.48% : 0.000177s : 4: match.inline 5.52% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.17% : 0.000001s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.33% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.33% : 0.000002s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 5.32% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000593 13 52.14% : 0.000309s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.09% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.77% : 0.000248s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015156 72 0.26% : 0.000040s : 1: add_recomputation 0.45% : 0.000068s : 1: auto_monad 0.09% : 0.000014s : 1: auto_monad_reorder 2.00% : 0.000303s : 1: bootstrap 0.13% : 0.000020s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.05% : 0.000007s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.35% : 0.005510s : 1: jit_opt_a 0.93% : 0.000141s : 1: jit_opt_after_cconv 0.37% : 0.000056s : 1: jit_opt_b 2.81% : 0.000426s : 1: loop_unroll 3.30% : 0.000501s : 1: mutable_eliminate 5.62% : 0.000852s : 26: opt.transform.jit_opt_a 0.30% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.14% : 0.000475s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000038s : 1: py_interpret_to_execute 0.13% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000013s : 1: remove_dup_value 2.52% : 0.000381s : 1: renormalize.infer 1.98% : 0.000300s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000035s : 1: rewriter_after_opt_a 7.23% : 0.001096s : 1: rewriter_before_opt_a 0.49% : 0.000075s : 1: symbol_engine_optimizer 29.95% : 0.004539s : 1: type_inference TotalTime = 0.0137207, [30] [bootstrap]: 0.00031253 [type_inference]: 0.0054849 [event_method]: 1.855e-05 [auto_monad]: 6.664e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 4.639e-05 [rewriter_before_opt_a]: 7.742e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00539304, [2] [Cycle 1]: 0.00177362, [27] [switch_simplify]: 5.76e-05 [loop_unroll]: 3.067e-05 [a_1]: 0.00059138 [with_stream_mark]: 1.789e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 8.87999e-06 [inline_without_move]: 5.01002e-06 [renormalize]: 0.00073885 [add_forward_monad_depend]: 7.01999e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.835e-05 [cse]: 2.89e-05 [replace_applicator]: 1.44e-05 [Cycle 2]: 0.00033762, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.27999e-06 [a_1]: 9.164e-05 [with_stream_mark]: 1.151e-05 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.36998e-06 [updatestate_useless_node_eliminater]: 4.79998e-06 [accelerated_algorithm]: 4.65001e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.46999e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 4.82e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.58002e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 7.93001e-06 [cse]: 1.348e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.295e-05 [rewriter_after_opt_a]: 3.936e-05 [convert_after_rewriter]: 7.86001e-06 [order_py_execute_after_rewriter]: 5.31002e-06 [mutable_eliminate]: 0.00060957 [jit_opt_b]: 6.89e-05, [1] [Cycle 1]: 6.031e-05, [2] [frontend_op_eliminate]: 1.673e-05 [inline_after_opt_a]: 1.836e-05 [cconv]: 2.655e-05 [loop_unroll]: 0.00046542 [jit_opt_after_cconv]: 0.00015598, [1] [Cycle 1]: 0.00014838, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 3.28998e-06 [updatestate_depend_eliminate]: 7.47002e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.91999e-06 [cse]: 2.775e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 8.39995e-07 [switch_simplify]: 5.80002e-06 [remove_dup_value]: 1.713e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 5.92999e-06 [add_recomputation]: 5.161e-05 [cse_after_recomputation]: 2.171e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.085e-05 [auto_monad_reorder]: 1.495e-05 [get_jit_bprop_graph]: 2.08998e-06 [rewriter_after_jit_bprop_graph]: 5.00001e-06 [opt_after_jit_grad]: 0.00050089 [symbol_engine_optimizer]: 7.438e-05, [1] [Cycle 1]: 6.73e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 7.77002e-06 [elim_not_effective]: 1.28e-05 [opt_reshape]: 6.71999e-06 [fold_const_symbol]: 8.76002e-06 [renormalize]: 4.19997e-07 [validate]: 3.748e-05 Sums bootstrap : 0.000313s : 3.18% type_inference : 0.005485s : 55.80% event_method : 0.000019s : 0.19% auto_monad : 0.000067s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000046s : 0.47% rewriter_before_opt_a : 0.000077s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000683s : 6.95% jit_opt_a.with_stream_mark : 0.000029s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000739s : 7.52% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.27% jit_opt_a.cse : 0.000042s : 0.43% jit_opt_a.replace_applicator : 0.000020s : 0.20% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000039s : 0.40% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000610s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000018s : 0.19% cconv : 0.000027s : 0.27% loop_unroll : 0.000465s : 4.73% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000028s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.53% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000501s : 5.10% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.38% Time group info: ------[substitution.] 0.000206 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 3.15% : 0.000006s : 3: substitution.graph_param_transform 81.94% : 0.000169s : 4: substitution.inline 1.82% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000006s : 4: substitution.remove_not_recompute_node 2.84% : 0.000006s : 2: substitution.replace_old_param 5.97% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005376 2 81.39% : 0.004376s : 1: type_inference.infer 18.61% : 0.001000s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.62% : 0.000049s : 4: replace.inline 33.38% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.69% : 0.000166s : 4: match.inline 6.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 691 0.96% : 0.000002s : 10: predicate.accumulaten_eliminater 0.70% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 32.27% : 0.000056s : 10: predicate.addn_check_dump 0.86% : 0.000001s : 10: predicate.addn_zero_filter 1.37% : 0.000002s : 10: predicate.arithmetic_simplify 0.86% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 0.74% : 0.000001s : 10: predicate.compare_switch_simplify 0.86% : 0.000001s : 10: predicate.depend_value_elim 0.72% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.78% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.83% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.47% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000001s : 3: predicate.elim_not_effective 0.38% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000002s : 10: predicate.environ_add_const_eliminate 0.73% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.76% : 0.000001s : 10: predicate.environ_get_depend_swap 0.94% : 0.000002s : 10: predicate.environ_get_eliminate 0.80% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.17% : 0.000000s : 3: predicate.fold_const_symbol 0.68% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000001s : 3: predicate.graph_param_transform 3.78% : 0.000007s : 22: predicate.inline 0.73% : 0.000001s : 6: predicate.inline_without_move 0.25% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.71% : 0.000001s : 6: predicate.less_batch_normalization 1.22% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.28% : 0.000002s : 15: predicate.load_eliminater 0.88% : 0.000002s : 3: predicate.loop_unroll_after_grad 2.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.42% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.72% : 0.000001s : 10: predicate.merge_addn 0.72% : 0.000001s : 10: predicate.minmaximum_grad 1.09% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000001s : 3: predicate.opt_reshape 1.62% : 0.000003s : 15: predicate.partial_eliminate 0.74% : 0.000001s : 10: predicate.print_const_string_wrapper 1.15% : 0.000002s : 10: predicate.reduce_eliminate 0.98% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.36% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000001s : 3: predicate.reset_defer_inline 0.79% : 0.000001s : 10: predicate.reshape_eliminate 0.88% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 3: predicate.row_tensor_eliminate 0.79% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.69% : 0.000001s : 6: predicate.special_op_eliminate 0.69% : 0.000001s : 6: predicate.specialize_transform 1.06% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.84% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.90% : 0.000003s : 16: predicate.switch_defer_inline 1.33% : 0.000002s : 16: predicate.switch_layer_defer_inline 5.13% : 0.000009s : 53: predicate.switch_simplify 0.83% : 0.000001s : 10: predicate.tile_eliminate 0.83% : 0.000001s : 10: predicate.transpose_eliminate 0.97% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.86% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.09% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.95% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.10% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.00% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.09% : 0.000002s : 10: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000726 13 54.25% : 0.000394s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.29% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.46% : 0.000301s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015420 72 0.35% : 0.000054s : 1: add_recomputation 0.45% : 0.000070s : 1: auto_monad 0.11% : 0.000017s : 1: auto_monad_reorder 2.16% : 0.000333s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 35.00% : 0.005397s : 1: jit_opt_a 1.03% : 0.000159s : 1: jit_opt_after_cconv 0.47% : 0.000072s : 1: jit_opt_b 3.07% : 0.000473s : 1: loop_unroll 4.03% : 0.000622s : 1: mutable_eliminate 5.86% : 0.000903s : 26: opt.transform.jit_opt_a 0.31% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.31% : 0.000510s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000049s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000020s : 1: remove_dup_value 2.42% : 0.000374s : 1: renormalize.infer 2.32% : 0.000358s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000043s : 1: rewriter_after_opt_a 0.52% : 0.000080s : 1: rewriter_before_opt_a 0.50% : 0.000077s : 1: symbol_engine_optimizer 35.67% : 0.005501s : 1: type_inference TotalTime = 0.0190504, [30] [bootstrap]: 0.00032686 [type_inference]: 0.00800582 [event_method]: 2.155e-05 [auto_monad]: 7.788e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 5.392e-05 [rewriter_before_opt_a]: 8.164e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00549577, [2] [Cycle 1]: 0.00187483, [27] [switch_simplify]: 5.24e-05 [loop_unroll]: 3.258e-05 [a_1]: 0.00065724 [with_stream_mark]: 1.652e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.51002e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 8.34002e-06 [inline_without_move]: 5.44e-06 [renormalize]: 0.00079861 [add_forward_monad_depend]: 5.64998e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.293e-05 [cse]: 2.83e-05 [replace_applicator]: 1.336e-05 [Cycle 2]: 0.00034143, [27] [switch_simplify]: 5.97999e-06 [loop_unroll]: 5.07e-06 [a_1]: 9.858e-05 [with_stream_mark]: 1.095e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.31002e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.12e-06 [meta_shard_fg_expand]: 1.05001e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.248e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 4.74e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 8.50006e-07 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.262e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.417e-05 [rewriter_after_opt_a]: 3.461e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00063901 [jit_opt_b]: 5.293e-05, [1] [Cycle 1]: 4.523e-05, [2] [frontend_op_eliminate]: 1.565e-05 [inline_after_opt_a]: 1.744e-05 [cconv]: 2.781e-05 [loop_unroll]: 0.00282244 [jit_opt_after_cconv]: 0.00022029, [1] [Cycle 1]: 0.00021013, [11] [c_1]: 2.646e-05 [parameter_eliminate]: 5.42001e-06 [updatestate_depend_eliminate]: 9.07999e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 3.52997e-06 [cse]: 3.569e-05 [call_graph_tuple_transform]: 2.708e-05 [tuple_list_get_item_eliminator]: 7.11999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 1.05001e-06 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 2.017e-05 [partial_unused_args_eliminate]: 3.41001e-06 [environ_conv]: 7.75e-06 [add_recomputation]: 5.525e-05 [cse_after_recomputation]: 2.754e-05, [1] [Cycle 1]: 2.127e-05, [1] [cse]: 1.389e-05 [auto_monad_reorder]: 1.88e-05 [get_jit_bprop_graph]: 2.43998e-06 [rewriter_after_jit_bprop_graph]: 8.10999e-06 [opt_after_jit_grad]: 0.00070182 [symbol_engine_optimizer]: 8.762e-05, [1] [Cycle 1]: 7.948e-05, [6] [build]: 4.17003e-06 [elim_shapecalc]: 9.31998e-06 [elim_not_effective]: 1.655e-05 [opt_reshape]: 6.74999e-06 [fold_const_symbol]: 1.031e-05 [renormalize]: 6.59988e-07 [validate]: 4.642e-05 Sums bootstrap : 0.000327s : 2.16% type_inference : 0.008006s : 52.87% event_method : 0.000022s : 0.14% auto_monad : 0.000078s : 0.51% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000054s : 0.36% rewriter_before_opt_a : 0.000082s : 0.54% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.39% jit_opt_a.loop_unroll : 0.000038s : 0.25% jit_opt_a.a_1 : 0.000756s : 4.99% jit_opt_a.with_stream_mark : 0.000027s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000799s : 5.27% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.12% jit_opt_a.cse : 0.000041s : 0.27% jit_opt_a.replace_applicator : 0.000018s : 0.12% py_interpret_to_execute_after_opt_a : 0.000014s : 0.09% rewriter_after_opt_a : 0.000035s : 0.23% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000639s : 4.22% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.12% cconv : 0.000028s : 0.18% loop_unroll : 0.002822s : 18.64% jit_opt_after_cconv.c_1 : 0.000026s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000020s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000055s : 0.36% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.05% opt_after_jit_grad : 0.000702s : 4.63% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.31% Time group info: ------[substitution.] 0.000246 27 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000008s : 3: substitution.graph_param_transform 81.50% : 0.000200s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.50% : 0.000011s : 3: substitution.reduce_eliminate 1.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.61% : 0.000004s : 2: substitution.replace_old_param 4.63% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007823 2 86.84% : 0.006794s : 1: type_inference.infer 13.16% : 0.001029s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.21% : 0.000062s : 5: replace.inline 31.79% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 7 95.06% : 0.000197s : 5: match.inline 4.94% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.28% : 0.000002s : 11: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.20% : 0.000002s : 11: predicate.addn_zero_filter 1.95% : 0.000002s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.13% : 0.000001s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 6.09% : 0.000008s : 24: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.92% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 16: predicate.load_eliminater 2.49% : 0.000003s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.05% : 0.000001s : 11: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.83% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000001s : 11: predicate.print_const_string_wrapper 1.95% : 0.000002s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 11: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000009s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.17% : 0.000001s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.92% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.87% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000774 16 49.23% : 0.000381s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.29% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.48% : 0.000336s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020909 72 0.28% : 0.000059s : 1: add_recomputation 0.39% : 0.000081s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.61% : 0.000336s : 1: bootstrap 0.15% : 0.000031s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000030s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 26.30% : 0.005499s : 1: jit_opt_a 1.07% : 0.000223s : 1: jit_opt_after_cconv 0.27% : 0.000056s : 1: jit_opt_b 13.56% : 0.002835s : 1: loop_unroll 3.10% : 0.000648s : 1: mutable_eliminate 4.63% : 0.000969s : 26: opt.transform.jit_opt_a 0.30% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.13% : 0.000028s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000017s : 1: opt.transform.mutable_eliminate 0.13% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000039s : 4: opt.transform.symbol_engine_opt 3.41% : 0.000712s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000006s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000057s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000023s : 1: remove_dup_value 1.97% : 0.000411s : 1: renormalize.infer 1.82% : 0.000380s : 1: renormalize.specialize 0.05% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000037s : 1: rewriter_after_opt_a 0.41% : 0.000085s : 1: rewriter_before_opt_a 0.43% : 0.000090s : 1: symbol_engine_optimizer 38.34% : 0.008016s : 1: type_inference TotalTime = 0.137688, [30] [bootstrap]: 0.00030683 [type_inference]: 0.126102 [event_method]: 2.563e-05 [auto_monad]: 7.62e-05 [graph_reusing]: 6.60997e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00044797 [rewriter_before_opt_a]: 9.947e-05 [expand_dump_flag]: 3.67002e-06 [jit_opt_a]: 0.00823714, [2] [Cycle 1]: 0.00386821, [27] [switch_simplify]: 5.877e-05 [loop_unroll]: 3.4e-05 [a_1]: 0.00066865 [with_stream_mark]: 1.539e-05 [recompute_prepare]: 8.52998e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.42001e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 9.25001e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00273771 [add_forward_monad_depend]: 6.40002e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 3.298e-05 [replace_applicator]: 1.846e-05 [Cycle 2]: 0.00037551, [27] [switch_simplify]: 6.68998e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00011957 [with_stream_mark]: 1.145e-05 [recompute_prepare]: 6.22001e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.34001e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.725e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.46e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.17001e-06 [cse]: 1.552e-05 [replace_applicator]: 6.56e-06 [py_interpret_to_execute_after_opt_a]: 1.254e-05 [rewriter_after_opt_a]: 3.752e-05 [convert_after_rewriter]: 7.48999e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00065736 [jit_opt_b]: 6.499e-05, [1] [Cycle 1]: 5.825e-05, [2] [frontend_op_eliminate]: 1.865e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 2.664e-05 [loop_unroll]: 0.00047813 [jit_opt_after_cconv]: 0.00015872, [1] [Cycle 1]: 0.00015255, [11] [c_1]: 2.555e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.83002e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.95002e-06 [cse]: 2.73e-05 [call_graph_tuple_transform]: 2.135e-05 [tuple_list_get_item_eliminator]: 7.6e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.792e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.64998e-06 [add_recomputation]: 5.852e-05 [cse_after_recomputation]: 2.725e-05, [1] [Cycle 1]: 2.161e-05, [1] [cse]: 1.559e-05 [auto_monad_reorder]: 1.708e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.0004791 [symbol_engine_optimizer]: 7.834e-05, [1] [Cycle 1]: 7.258e-05, [6] [build]: 3.46001e-06 [elim_shapecalc]: 1.037e-05 [elim_not_effective]: 1.496e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 1.053e-05 [renormalize]: 5.39992e-07 [validate]: 4.774e-05 Sums bootstrap : 0.000307s : 0.23% type_inference : 0.126102s : 94.75% event_method : 0.000026s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000448s : 0.34% rewriter_before_opt_a : 0.000099s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000788s : 0.59% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002738s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000657s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000478s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000059s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000479s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000242 25 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000006s : 4: substitution.graph_param_transform 86.65% : 0.000210s : 5: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.126014 2 97.62% : 0.123019s : 1: type_inference.infer 2.38% : 0.002995s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.16% : 0.000070s : 5: replace.inline 31.84% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.26% : 0.000207s : 5: match.inline 4.74% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 19: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.38% : 0.000002s : 13: predicate.print_const_string_wrapper 1.93% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.72% : 0.000004s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.03% : 0.000009s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002436 25 66.01% : 0.001608s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.86% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.13% : 0.000758s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141534 72 0.04% : 0.000061s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000319s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.82% : 0.008240s : 1: jit_opt_a 0.11% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.34% : 0.000486s : 1: loop_unroll 0.47% : 0.000667s : 1: mutable_eliminate 0.73% : 0.001037s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000488s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000456s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.41% : 0.001994s : 1: renormalize.infer 0.52% : 0.000735s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 89.11% : 0.126126s : 1: type_inference TotalTime = 0.114121, [30] [bootstrap]: 0.0002994 [type_inference]: 0.103234 [event_method]: 2.003e-05 [auto_monad]: 7.082e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00045206 [rewriter_before_opt_a]: 9.07e-05 [expand_dump_flag]: 4.27e-06 [jit_opt_a]: 0.0076374, [2] [Cycle 1]: 0.00378023, [27] [switch_simplify]: 6.029e-05 [loop_unroll]: 3.12e-05 [a_1]: 0.000599 [with_stream_mark]: 1.932e-05 [recompute_prepare]: 9.67001e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.96003e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 4.07998e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.83998e-06 [renormalize]: 0.00271422 [add_forward_monad_depend]: 6.68e-06 [auto_monad_grad]: 3.03e-06 [auto_monad_eliminator]: 1.729e-05 [cse]: 3.134e-05 [replace_applicator]: 1.806e-05 [Cycle 2]: 0.00038604, [27] [switch_simplify]: 7.51001e-06 [loop_unroll]: 6.14999e-06 [a_1]: 0.00012624 [with_stream_mark]: 1.106e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.77998e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.626e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.311e-05 [replace_applicator]: 6.61999e-06 [py_interpret_to_execute_after_opt_a]: 1.129e-05 [rewriter_after_opt_a]: 3.618e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00061326 [jit_opt_b]: 5.837e-05, [1] [Cycle 1]: 5.004e-05, [2] [frontend_op_eliminate]: 2.068e-05 [inline_after_opt_a]: 1.749e-05 [cconv]: 2.511e-05 [loop_unroll]: 0.00043515 [jit_opt_after_cconv]: 0.00021563, [1] [Cycle 1]: 0.00014943, [11] [c_1]: 2.665e-05 [parameter_eliminate]: 3.46001e-06 [updatestate_depend_eliminate]: 7.88001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.053e-05 [call_graph_tuple_transform]: 2.136e-05 [tuple_list_get_item_eliminator]: 6.39001e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.641e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 8.45001e-06 [add_recomputation]: 5.036e-05 [cse_after_recomputation]: 2.622e-05, [1] [Cycle 1]: 2.031e-05, [1] [cse]: 1.348e-05 [auto_monad_reorder]: 1.595e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.00047553 [symbol_engine_optimizer]: 7.453e-05, [1] [Cycle 1]: 6.869e-05, [6] [build]: 3.25002e-06 [elim_shapecalc]: 8.72998e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 6.68998e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 4.00003e-07 [validate]: 4.239e-05 Sums bootstrap : 0.000299s : 0.27% type_inference : 0.103234s : 93.86% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000452s : 0.41% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000725s : 0.66% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002714s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000613s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000435s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000476s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000228 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.81% : 0.000006s : 4: substitution.graph_param_transform 83.79% : 0.000191s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 5.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103156 2 97.29% : 0.100357s : 1: type_inference.infer 2.71% : 0.002799s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.41% : 0.000050s : 4: replace.inline 33.59% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.29% : 0.000189s : 4: match.inline 5.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.71% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.51% : 0.000002s : 12: predicate.print_const_string_wrapper 1.96% : 0.000003s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.98% : 0.000009s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.57% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001983 22 65.70% : 0.001303s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.21% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.08% : 0.000636s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117876 72 0.05% : 0.000054s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.27% : 0.000314s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.48% : 0.007641s : 1: jit_opt_a 0.19% : 0.000219s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.38% : 0.000443s : 1: loop_unroll 0.53% : 0.000622s : 1: mutable_eliminate 0.82% : 0.000969s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000460s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.69% : 0.001989s : 1: renormalize.infer 0.61% : 0.000715s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 87.59% : 0.103251s : 1: type_inference TotalTime = 0.122571, [30] [bootstrap]: 0.000266 [type_inference]: 0.111067 [event_method]: 2.25e-05 [auto_monad]: 7.539e-05 [graph_reusing]: 6.72002e-06 [pre_auto_parallel]: 2.48002e-06 [py_interpret_to_execute]: 0.00052038 [rewriter_before_opt_a]: 9.889e-05 [expand_dump_flag]: 4.53999e-06 [jit_opt_a]: 0.0081375, [2] [Cycle 1]: 0.00418491, [27] [switch_simplify]: 6.581e-05 [loop_unroll]: 3.499e-05 [a_1]: 0.00072788 [with_stream_mark]: 2.324e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 4.64998e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.65998e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.39002e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.45997e-06 [get_grad_eliminate_]: 6.84001e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.682e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.69999e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 0.0029454 [add_forward_monad_depend]: 8.37e-06 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.895e-05 [cse]: 3.713e-05 [replace_applicator]: 2.193e-05 [Cycle 2]: 0.00040182, [27] [switch_simplify]: 7.10998e-06 [loop_unroll]: 6.23998e-06 [a_1]: 0.00013831 [with_stream_mark]: 1.502e-05 [recompute_prepare]: 6.20002e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 3.32002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.376e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.69e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 7.59002e-06 [cse]: 1.38e-05 [replace_applicator]: 6.30002e-06 [py_interpret_to_execute_after_opt_a]: 1.749e-05 [rewriter_after_opt_a]: 3.808e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 5.04003e-06 [mutable_eliminate]: 0.00068782 [jit_opt_b]: 5.88e-05, [1] [Cycle 1]: 5.084e-05, [2] [frontend_op_eliminate]: 1.974e-05 [inline_after_opt_a]: 2.007e-05 [cconv]: 2.971e-05 [loop_unroll]: 0.0004281 [jit_opt_after_cconv]: 0.00022037, [1] [Cycle 1]: 0.00021343, [11] [c_1]: 2.629e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 6.78e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.304e-05 [call_graph_tuple_transform]: 6.891e-05 [tuple_list_get_item_eliminator]: 1.718e-05 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 7.21001e-06 [remove_dup_value]: 1.815e-05 [partial_unused_args_eliminate]: 2.96001e-06 [environ_conv]: 8.70999e-06 [add_recomputation]: 5.221e-05 [cse_after_recomputation]: 2.523e-05, [1] [Cycle 1]: 1.997e-05, [1] [cse]: 1.412e-05 [auto_monad_reorder]: 1.799e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.000456 [symbol_engine_optimizer]: 7.547e-05, [1] [Cycle 1]: 6.921e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 7.16999e-06 [fold_const_symbol]: 9.24998e-06 [renormalize]: 3.99974e-07 [validate]: 4.465e-05 Sums bootstrap : 0.000266s : 0.22% type_inference : 0.111067s : 93.79% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000520s : 0.44% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000866s : 0.73% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002945s : 2.49% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000688s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000428s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000069s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000017s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000456s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000296 28 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000008s : 4: substitution.graph_param_transform 83.31% : 0.000247s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.73% : 0.000014s : 3: substitution.reduce_eliminate 1.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.47% : 0.000004s : 2: substitution.replace_old_param 4.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110991 2 97.31% : 0.108000s : 1: type_inference.infer 2.69% : 0.002991s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.42% : 0.000073s : 5: replace.inline 31.58% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 7 95.75% : 0.000244s : 5: match.inline 4.25% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.28% : 0.000003s : 13: predicate.arithmetic_simplify 1.56% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 19: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 2.14% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.68% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002427 25 61.13% : 0.001483s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.40% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.47% : 0.000861s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126769 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000276s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.42% : 0.008141s : 1: jit_opt_a 0.18% : 0.000223s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.34% : 0.000437s : 1: loop_unroll 0.55% : 0.000696s : 1: mutable_eliminate 0.89% : 0.001123s : 26: opt.transform.jit_opt_a 0.09% : 0.000115s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000527s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.61% : 0.002047s : 1: renormalize.infer 0.70% : 0.000888s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 87.62% : 0.111081s : 1: type_inference TotalTime = 0.14121, [30] [bootstrap]: 0.00037689 [type_inference]: 0.125881 [event_method]: 1.96e-05 [auto_monad]: 5.502e-05 [graph_reusing]: 4.46002e-06 [pre_auto_parallel]: 2.06e-06 [py_interpret_to_execute]: 0.00044378 [rewriter_before_opt_a]: 8.325e-05 [expand_dump_flag]: 2.73998e-06 [jit_opt_a]: 0.0121218, [2] [Cycle 1]: 0.00876053, [27] [switch_simplify]: 4.946e-05 [loop_unroll]: 3.349e-05 [a_1]: 0.00061791 [with_stream_mark]: 1.307e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 6.80002e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.245e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 6.21e-06 [renormalize]: 0.00771983 [add_forward_monad_depend]: 6.06e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.448e-05 [cse]: 2.762e-05 [replace_applicator]: 1.684e-05 [Cycle 2]: 0.00038406, [27] [switch_simplify]: 6.94001e-06 [loop_unroll]: 6.17001e-06 [a_1]: 0.00013461 [with_stream_mark]: 1.133e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 3.4e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 9.06002e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.52998e-06 [inline_without_move]: 5.46e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24998e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.285e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 1.151e-05 [rewriter_after_opt_a]: 3.289e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00062332 [jit_opt_b]: 5.432e-05, [1] [Cycle 1]: 4.775e-05, [2] [frontend_op_eliminate]: 1.903e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 2.153e-05 [loop_unroll]: 0.00044628 [jit_opt_after_cconv]: 0.0001493, [1] [Cycle 1]: 0.00014345, [11] [c_1]: 2.542e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.63998e-06 [cse]: 2.151e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 6.85002e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.381e-05 [partial_unused_args_eliminate]: 1.92001e-06 [environ_conv]: 6.78e-06 [add_recomputation]: 4.271e-05 [cse_after_recomputation]: 2.207e-05, [1] [Cycle 1]: 1.728e-05, [1] [cse]: 1.174e-05 [auto_monad_reorder]: 1.637e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 4.12e-06 [opt_after_jit_grad]: 0.0004621 [symbol_engine_optimizer]: 7.394e-05, [1] [Cycle 1]: 6.797e-05, [6] [build]: 2.92002e-06 [elim_shapecalc]: 9.04e-06 [elim_not_effective]: 1.344e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 2.80008e-07 [validate]: 5.062e-05 Sums bootstrap : 0.000377s : 0.27% type_inference : 0.125881s : 91.44% event_method : 0.000020s : 0.01% auto_monad : 0.000055s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000444s : 0.32% rewriter_before_opt_a : 0.000083s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.04% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000753s : 0.55% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.007720s : 5.61% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000033s : 0.02% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000623s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000022s : 0.02% loop_unroll : 0.000446s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000043s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000462s : 0.34% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000212 28 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 4: substitution.graph_param_transform 81.43% : 0.000173s : 5: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.02% : 0.000011s : 3: substitution.reduce_eliminate 2.16% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 4.04% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.125818 2 97.96% : 0.123256s : 1: type_inference.infer 2.04% : 0.002562s : 1: type_inference.specialize ------[replace.] 0.000085 7 68.26% : 0.000058s : 5: replace.inline 31.74% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 7 95.78% : 0.000170s : 5: match.inline 4.22% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.60% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.21% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.82% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.02% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.07% : 0.000010s : 64: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.38% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002539 25 63.66% : 0.001616s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.21% : 0.000868s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149975 72 0.03% : 0.000046s : 1: add_recomputation 0.04% : 0.000058s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000397s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 8.08% : 0.012125s : 1: jit_opt_a 0.10% : 0.000152s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.30% : 0.000454s : 1: loop_unroll 0.42% : 0.000632s : 1: mutable_eliminate 0.65% : 0.000982s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000470s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000451s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 4.54% : 0.006809s : 1: renormalize.infer 0.60% : 0.000902s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.06% : 0.000087s : 1: rewriter_before_opt_a 0.05% : 0.000076s : 1: symbol_engine_optimizer 83.94% : 0.125893s : 1: type_inference TotalTime = 0.132141, [30] [bootstrap]: 0.00027507 [type_inference]: 0.12043 [event_method]: 1.946e-05 [auto_monad]: 6.993e-05 [graph_reusing]: 6.08002e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00059214 [rewriter_before_opt_a]: 9.636e-05 [expand_dump_flag]: 4.22e-06 [jit_opt_a]: 0.00779568, [2] [Cycle 1]: 0.00405557, [27] [switch_simplify]: 5.476e-05 [loop_unroll]: 3.139e-05 [a_1]: 0.00059748 [with_stream_mark]: 1.625e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 4.32003e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 9.71e-06 [updatestate_useless_node_eliminater]: 6.81001e-06 [accelerated_algorithm]: 7.02002e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.57998e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 1.04e-05 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 9.45001e-06 [inline_without_move]: 6.34001e-06 [renormalize]: 0.00288795 [add_forward_monad_depend]: 6.51999e-06 [auto_monad_grad]: 2.98003e-06 [auto_monad_eliminator]: 1.489e-05 [cse]: 2.685e-05 [replace_applicator]: 1.916e-05 [Cycle 2]: 0.00037561, [27] [switch_simplify]: 6.80002e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00012745 [with_stream_mark]: 1.2e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.13998e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 2.51e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.73002e-06 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.99001e-06 [cse]: 1.19e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 1.178e-05 [rewriter_after_opt_a]: 3.309e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00071871 [jit_opt_b]: 5.914e-05, [1] [Cycle 1]: 5.164e-05, [2] [frontend_op_eliminate]: 2.077e-05 [inline_after_opt_a]: 1.952e-05 [cconv]: 2.415e-05 [loop_unroll]: 0.00077358 [jit_opt_after_cconv]: 0.00017338, [1] [Cycle 1]: 0.00016571, [11] [c_1]: 2.94e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 6.92002e-06 [updatestate_assign_eliminate]: 2.18998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 3.078e-05 [call_graph_tuple_transform]: 2.408e-05 [tuple_list_get_item_eliminator]: 6.75998e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 7.24001e-06 [remove_dup_value]: 1.604e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 9.02e-06 [add_recomputation]: 5.041e-05 [cse_after_recomputation]: 2.41e-05, [1] [Cycle 1]: 1.83e-05, [1] [cse]: 1.19e-05 [auto_monad_reorder]: 1.644e-05 [get_jit_bprop_graph]: 4.045e-05 [rewriter_after_jit_bprop_graph]: 6.88e-06 [opt_after_jit_grad]: 0.00055124 [symbol_engine_optimizer]: 8.67e-05, [1] [Cycle 1]: 8.011e-05, [6] [build]: 4.67998e-06 [elim_shapecalc]: 9.39998e-06 [elim_not_effective]: 1.578e-05 [opt_reshape]: 7.95e-06 [fold_const_symbol]: 1.199e-05 [renormalize]: 3.39991e-07 [validate]: 4.457e-05 Sums bootstrap : 0.000275s : 0.21% type_inference : 0.120430s : 94.05% event_method : 0.000019s : 0.02% auto_monad : 0.000070s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000592s : 0.46% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000725s : 0.57% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002888s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000719s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000774s : 0.60% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000040s : 0.03% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000551s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000222 24 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000006s : 4: substitution.graph_param_transform 83.79% : 0.000186s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000005s : 4: substitution.remove_not_recompute_node 2.39% : 0.000005s : 2: substitution.replace_old_param 5.48% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120278 2 97.61% : 0.117403s : 1: type_inference.infer 2.39% : 0.002875s : 1: type_inference.specialize ------[replace.] 0.000080 6 67.09% : 0.000054s : 4: replace.inline 32.91% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.35% : 0.000183s : 4: match.inline 5.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.73% : 0.000002s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.48% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.84% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.45% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.47% : 0.000002s : 8: predicate.special_op_eliminate 1.18% : 0.000002s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.45% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.88% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002209 22 65.52% : 0.001448s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.76% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.71% : 0.000723s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136085 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.21% : 0.000287s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000043s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.73% : 0.007799s : 1: jit_opt_a 0.13% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.58% : 0.000785s : 1: loop_unroll 0.54% : 0.000729s : 1: mutable_eliminate 0.71% : 0.000969s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000560s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000600s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000029s : 1: remove_dup_value 1.52% : 0.002073s : 1: renormalize.infer 0.59% : 0.000806s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.07% : 0.000089s : 1: symbol_engine_optimizer 88.51% : 0.120444s : 1: type_inference TotalTime = 0.123368, [30] [bootstrap]: 0.00028033 [type_inference]: 0.112098 [event_method]: 2.274e-05 [auto_monad]: 7.45e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 3.01001e-06 [py_interpret_to_execute]: 0.00045844 [rewriter_before_opt_a]: 0.00010318 [expand_dump_flag]: 4.05998e-06 [jit_opt_a]: 0.00802223, [2] [Cycle 1]: 0.00399963, [27] [switch_simplify]: 6.852e-05 [loop_unroll]: 3.464e-05 [a_1]: 0.00069273 [with_stream_mark]: 2.124e-05 [recompute_prepare]: 1.023e-05 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 7.59002e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 1.009e-05 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 6.94999e-06 [renormalize]: 0.00278749 [add_forward_monad_depend]: 8.40999e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.805e-05 [cse]: 3.756e-05 [replace_applicator]: 2.282e-05 [Cycle 2]: 0.00038353, [27] [switch_simplify]: 7.33999e-06 [loop_unroll]: 6.27001e-06 [a_1]: 0.00012207 [with_stream_mark]: 1.378e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 6.03002e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.801e-05 [j_node_and_user_rematch]: 9.98998e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.567e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.397e-05 [rewriter_after_opt_a]: 3.888e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00068221 [jit_opt_b]: 5.561e-05, [1] [Cycle 1]: 4.889e-05, [2] [frontend_op_eliminate]: 1.863e-05 [inline_after_opt_a]: 1.945e-05 [cconv]: 2.594e-05 [loop_unroll]: 0.00041688 [jit_opt_after_cconv]: 0.00015488, [1] [Cycle 1]: 0.00014877, [11] [c_1]: 2.586e-05 [parameter_eliminate]: 2.74999e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.459e-05 [call_graph_tuple_transform]: 2.105e-05 [tuple_list_get_item_eliminator]: 6.44001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.912e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 8.3e-06 [add_recomputation]: 4.997e-05 [cse_after_recomputation]: 2.418e-05, [1] [Cycle 1]: 1.869e-05, [1] [cse]: 1.321e-05 [auto_monad_reorder]: 1.775e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 4.84998e-06 [opt_after_jit_grad]: 0.00044715 [symbol_engine_optimizer]: 7.566e-05, [1] [Cycle 1]: 6.968e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 8.34002e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 6.37001e-06 [fold_const_symbol]: 9.49e-06 [renormalize]: 9.20001e-07 [validate]: 6.156e-05 Sums bootstrap : 0.000280s : 0.24% type_inference : 0.112098s : 94.10% event_method : 0.000023s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000458s : 0.38% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000815s : 0.68% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002788s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000682s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000417s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000447s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000062s : 0.05% Time group info: ------[substitution.] 0.000252 25 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000006s : 4: substitution.graph_param_transform 85.14% : 0.000215s : 5: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 2.35% : 0.000006s : 2: substitution.replace_old_param 5.18% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112017 2 97.28% : 0.108974s : 1: type_inference.infer 2.72% : 0.003043s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.35% : 0.000074s : 5: replace.inline 31.65% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 7 94.68% : 0.000212s : 5: match.inline 5.32% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.17% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.11% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000001s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.39% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.81% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 2.12% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 20: predicate.switch_defer_inline 2.37% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.69% : 0.000011s : 64: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002347 25 63.47% : 0.001490s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.51% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.01% : 0.000798s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127288 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000300s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.31% : 0.008026s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.33% : 0.000425s : 1: loop_unroll 0.54% : 0.000692s : 1: mutable_eliminate 0.85% : 0.001081s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000465s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.53% : 0.001951s : 1: renormalize.infer 0.65% : 0.000825s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.09% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.08% : 0.112115s : 1: type_inference TotalTime = 0.12946, [30] [bootstrap]: 0.00027439 [type_inference]: 0.117562 [event_method]: 2.363e-05 [auto_monad]: 7.329e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00051118 [rewriter_before_opt_a]: 0.00018014 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00823978, [2] [Cycle 1]: 0.0042735, [27] [switch_simplify]: 5.93e-05 [loop_unroll]: 3.498e-05 [a_1]: 0.0008152 [with_stream_mark]: 1.955e-05 [recompute_prepare]: 1.024e-05 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.79999e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 7.19001e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.587e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 6.59001e-06 [renormalize]: 0.00295242 [add_forward_monad_depend]: 9.66e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 2.026e-05 [cse]: 3.711e-05 [replace_applicator]: 2.353e-05 [Cycle 2]: 0.00053072, [27] [switch_simplify]: 7.3e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00023678 [with_stream_mark]: 2.043e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.73003e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 6.48003e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 3.40998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.758e-05 [j_node_and_user_rematch]: 1.109e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 1.11002e-06 [auto_monad_eliminator]: 7.88001e-06 [cse]: 1.86e-05 [replace_applicator]: 7.05998e-06 [py_interpret_to_execute_after_opt_a]: 1.824e-05 [rewriter_after_opt_a]: 4.153e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00077239 [jit_opt_b]: 6.092e-05, [1] [Cycle 1]: 5.119e-05, [2] [frontend_op_eliminate]: 1.973e-05 [inline_after_opt_a]: 1.971e-05 [cconv]: 3.349e-05 [loop_unroll]: 0.0004648 [jit_opt_after_cconv]: 0.00016334, [1] [Cycle 1]: 0.00015666, [11] [c_1]: 2.599e-05 [parameter_eliminate]: 4.07e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.88e-06 [cse]: 2.547e-05 [call_graph_tuple_transform]: 2.313e-05 [tuple_list_get_item_eliminator]: 6.53998e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.61e-06 [remove_dup_value]: 1.825e-05 [partial_unused_args_eliminate]: 2.61999e-06 [environ_conv]: 9.41e-06 [add_recomputation]: 5.293e-05 [cse_after_recomputation]: 2.451e-05, [1] [Cycle 1]: 1.861e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00047935 [symbol_engine_optimizer]: 0.00016749, [1] [Cycle 1]: 0.00016088, [6] [build]: 3.5e-06 [elim_shapecalc]: 8.89998e-06 [elim_not_effective]: 1.447e-05 [opt_reshape]: 6.82002e-06 [fold_const_symbol]: 9.613e-05 [renormalize]: 3.50003e-07 [validate]: 5.044e-05 Sums bootstrap : 0.000274s : 0.22% type_inference : 0.117562s : 93.75% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000511s : 0.41% rewriter_before_opt_a : 0.000180s : 0.14% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.001052s : 0.84% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002952s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000056s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000772s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000465s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000479s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000096s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000385 28 0.55% : 0.000002s : 2: substitution.elim_not_effective 22.39% : 0.000086s : 2: substitution.fold_const_symbol 1.76% : 0.000007s : 4: substitution.graph_param_transform 64.00% : 0.000246s : 5: substitution.inline 1.20% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.95% : 0.000015s : 3: substitution.reduce_eliminate 1.50% : 0.000006s : 4: substitution.remove_not_recompute_node 1.65% : 0.000006s : 2: substitution.replace_old_param 2.99% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117483 2 97.51% : 0.114560s : 1: type_inference.infer 2.49% : 0.002924s : 1: type_inference.specialize ------[replace.] 0.000122 7 70.47% : 0.000086s : 5: replace.inline 29.53% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 7 95.91% : 0.000243s : 5: match.inline 4.09% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000197 886 0.94% : 0.000002s : 13: predicate.accumulaten_eliminater 0.67% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.81% : 0.000002s : 13: predicate.addn_check_dump 1.07% : 0.000002s : 13: predicate.addn_zero_filter 1.47% : 0.000003s : 13: predicate.arithmetic_simplify 1.03% : 0.000002s : 13: predicate.cast_eliminate 0.29% : 0.000001s : 4: predicate.check_bprop_eliminate 0.82% : 0.000002s : 13: predicate.compare_switch_simplify 0.93% : 0.000002s : 13: predicate.depend_value_elim 0.85% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.90% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.93% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.42% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.82% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.83% : 0.000002s : 13: predicate.environ_get_depend_swap 0.91% : 0.000002s : 13: predicate.environ_get_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.20% : 0.000000s : 4: predicate.graph_param_transform 3.79% : 0.000007s : 28: predicate.inline 0.64% : 0.000001s : 8: predicate.inline_without_move 0.29% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000002s : 8: predicate.less_batch_normalization 1.05% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.38% : 0.000003s : 19: predicate.load_eliminater 0.82% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.53% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.89% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 0.90% : 0.000002s : 4: predicate.mutable_eliminate 0.30% : 0.000001s : 4: predicate.opt_reshape 1.68% : 0.000003s : 19: predicate.partial_eliminate 0.93% : 0.000002s : 13: predicate.print_const_string_wrapper 1.45% : 0.000003s : 13: predicate.reduce_eliminate 1.17% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 1.42% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.24% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.05% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.57% : 0.000001s : 4: predicate.row_tensor_eliminate 0.93% : 0.000002s : 13: predicate.same_eliminate 0.46% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.67% : 0.000001s : 8: predicate.special_op_eliminate 0.63% : 0.000001s : 8: predicate.specialize_transform 1.13% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.90% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.04% : 0.000004s : 20: predicate.switch_defer_inline 1.59% : 0.000003s : 20: predicate.switch_layer_defer_inline 31.01% : 0.000061s : 64: predicate.switch_simplify 1.01% : 0.000002s : 13: predicate.tile_eliminate 0.95% : 0.000002s : 13: predicate.transpose_eliminate 1.16% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.93% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.89% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.06% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.11% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.24% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.06% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000003s : 13: predicate.value_based_eliminate 0.28% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003215 25 71.17% : 0.002288s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.65% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.18% : 0.000842s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133882 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000289s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.16% : 0.008243s : 1: jit_opt_a 0.12% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.35% : 0.000475s : 1: loop_unroll 0.59% : 0.000784s : 1: mutable_eliminate 0.98% : 0.001316s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000123s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000518s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.53% : 0.002053s : 1: renormalize.infer 0.66% : 0.000885s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.14% : 0.000187s : 1: rewriter_before_opt_a 0.13% : 0.000170s : 1: symbol_engine_optimizer 87.82% : 0.117577s : 1: type_inference TotalTime = 0.118445, [30] [bootstrap]: 0.00028575 [type_inference]: 0.107718 [event_method]: 2.461e-05 [auto_monad]: 7.15e-05 [graph_reusing]: 5.36002e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 0.00045584 [rewriter_before_opt_a]: 9.159e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00746117, [2] [Cycle 1]: 0.00374145, [27] [switch_simplify]: 5.647e-05 [loop_unroll]: 3.362e-05 [a_1]: 0.00066542 [with_stream_mark]: 1.66e-05 [recompute_prepare]: 8.89998e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.554e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00262229 [add_forward_monad_depend]: 5.81e-06 [auto_monad_grad]: 2.70002e-06 [auto_monad_eliminator]: 1.626e-05 [cse]: 3.388e-05 [replace_applicator]: 1.467e-05 [Cycle 2]: 0.0003679, [27] [switch_simplify]: 6.85002e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00012727 [with_stream_mark]: 1.075e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.314e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.13001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.53002e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.78997e-06 [cse]: 1.354e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.131e-05 [rewriter_after_opt_a]: 3.708e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00060553 [jit_opt_b]: 5.518e-05, [1] [Cycle 1]: 4.735e-05, [2] [frontend_op_eliminate]: 1.872e-05 [inline_after_opt_a]: 1.757e-05 [cconv]: 2.468e-05 [loop_unroll]: 0.00041926 [jit_opt_after_cconv]: 0.00015104, [1] [Cycle 1]: 0.00014413, [11] [c_1]: 2.554e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.89999e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.191e-05 [call_graph_tuple_transform]: 2.087e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.59e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 7.63001e-06 [add_recomputation]: 4.627e-05 [cse_after_recomputation]: 2.363e-05, [1] [Cycle 1]: 1.86e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.815e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00056036 [symbol_engine_optimizer]: 0.00011247, [1] [Cycle 1]: 0.00010593, [6] [build]: 3.25998e-06 [elim_shapecalc]: 8.91002e-06 [elim_not_effective]: 1.279e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 4.613e-05 [renormalize]: 4.90021e-07 [validate]: 4.244e-05 Sums bootstrap : 0.000286s : 0.25% type_inference : 0.107718s : 94.07% event_method : 0.000025s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000456s : 0.40% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000793s : 0.69% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002622s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000606s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000419s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000560s : 0.49% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000046s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000244 28 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.21% : 0.000005s : 4: substitution.graph_param_transform 82.59% : 0.000201s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.69% : 0.000011s : 3: substitution.reduce_eliminate 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000005s : 2: substitution.replace_old_param 4.21% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107637 2 97.34% : 0.104774s : 1: type_inference.infer 2.66% : 0.002863s : 1: type_inference.specialize ------[replace.] 0.000098 7 69.92% : 0.000068s : 5: replace.inline 30.08% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 7 95.65% : 0.000198s : 5: match.inline 4.35% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.33% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 19: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.42% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.55% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.57% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.53% : 0.000010s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002189 25 62.63% : 0.001371s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.73% : 0.000760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122203 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000298s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.11% : 0.007464s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000427s : 1: loop_unroll 0.50% : 0.000614s : 1: mutable_eliminate 0.84% : 0.001027s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000071s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000569s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000462s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.52% : 0.001860s : 1: renormalize.infer 0.62% : 0.000753s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.09% : 0.000115s : 1: symbol_engine_optimizer 88.16% : 0.107738s : 1: type_inference TotalTime = 0.0809751, [30] [bootstrap]: 0.0002698 [type_inference]: 0.0644616 [event_method]: 2.169e-05 [auto_monad]: 6.826e-05 [graph_reusing]: 6.54001e-06 [pre_auto_parallel]: 2.74001e-06 [py_interpret_to_execute]: 0.00025575 [rewriter_before_opt_a]: 9.516e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.0134345, [2] [Cycle 1]: 0.00452687, [27] [switch_simplify]: 7.026e-05 [loop_unroll]: 3.47e-05 [a_1]: 0.00067882 [with_stream_mark]: 1.961e-05 [recompute_prepare]: 8.70001e-06 [updatestate_depend_eliminate]: 4.35999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.12002e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.64999e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00333178 [add_forward_monad_depend]: 9.97999e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.873e-05 [cse]: 3.886e-05 [replace_applicator]: 2.336e-05 [Cycle 2]: 0.00038573, [27] [switch_simplify]: 7.32997e-06 [loop_unroll]: 6.44999e-06 [a_1]: 0.00012271 [with_stream_mark]: 1.408e-05 [recompute_prepare]: 6.31998e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 2.29999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.817e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.26998e-06 [inline_without_move]: 5.61e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.632e-05 [replace_applicator]: 6.98e-06 [py_interpret_to_execute_after_opt_a]: 1.539e-05 [rewriter_after_opt_a]: 4.095e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00069173 [jit_opt_b]: 5.674e-05, [1] [Cycle 1]: 4.922e-05, [2] [frontend_op_eliminate]: 1.844e-05 [inline_after_opt_a]: 1.924e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00043327 [jit_opt_after_cconv]: 0.00016047, [1] [Cycle 1]: 0.00015353, [11] [c_1]: 2.605e-05 [parameter_eliminate]: 2.48998e-06 [updatestate_depend_eliminate]: 7.83001e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.785e-05 [call_graph_tuple_transform]: 2.192e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.848e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 9.12999e-06 [add_recomputation]: 5.048e-05 [cse_after_recomputation]: 2.496e-05, [1] [Cycle 1]: 1.979e-05, [1] [cse]: 1.404e-05 [auto_monad_reorder]: 1.901e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.00048077 [symbol_engine_optimizer]: 7.85e-05, [1] [Cycle 1]: 7.177e-05, [6] [build]: 4.44002e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 1.438e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 4.09986e-07 [validate]: 4.689e-05 Sums bootstrap : 0.000270s : 0.38% type_inference : 0.064462s : 89.72% event_method : 0.000022s : 0.03% auto_monad : 0.000068s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000256s : 0.36% rewriter_before_opt_a : 0.000095s : 0.13% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.11% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000802s : 1.12% jit_opt_a.with_stream_mark : 0.000034s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.003332s : 4.64% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000055s : 0.08% jit_opt_a.replace_applicator : 0.000030s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000041s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000692s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000029s : 0.04% loop_unroll : 0.000433s : 0.60% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000481s : 0.67% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.07% Time group info: ------[substitution.] 0.000251 25 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.61% : 0.000007s : 4: substitution.graph_param_transform 85.21% : 0.000214s : 5: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 4.93% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.064383 2 96.84% : 0.062350s : 1: type_inference.infer 3.16% : 0.002034s : 1: type_inference.specialize ------[replace.] 0.000102 7 67.92% : 0.000069s : 5: replace.inline 32.08% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 7 94.95% : 0.000211s : 5: match.inline 5.05% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 888 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000002s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.49% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.78% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 19: predicate.load_eliminater 1.08% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 1.56% : 0.000002s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.47% : 0.000010s : 65: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.47% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002843 33 70.10% : 0.001993s : 24: func_graph_cloner_run.FuncGraphClonerGraph 2.19% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.72% : 0.000788s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.085445 72 0.06% : 0.000054s : 1: add_recomputation 0.08% : 0.000072s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.33% : 0.000285s : 1: bootstrap 0.04% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 15.73% : 0.013438s : 1: jit_opt_a 0.19% : 0.000163s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.52% : 0.000441s : 1: loop_unroll 0.82% : 0.000702s : 1: mutable_eliminate 1.25% : 0.001069s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.57% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000262s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 2.87% : 0.002451s : 1: renormalize.infer 1.02% : 0.000868s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000100s : 1: rewriter_before_opt_a 0.09% : 0.000081s : 1: symbol_engine_optimizer 75.46% : 0.064479s : 1: type_inference TotalTime = 0.119339, [30] [bootstrap]: 0.00028328 [type_inference]: 0.108643 [event_method]: 1.887e-05 [auto_monad]: 7.065e-05 [graph_reusing]: 6.32001e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00046691 [rewriter_before_opt_a]: 8.772e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.00742778, [2] [Cycle 1]: 0.00362675, [27] [switch_simplify]: 5.678e-05 [loop_unroll]: 3.011e-05 [a_1]: 0.00058608 [with_stream_mark]: 1.672e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.26998e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.485e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.76e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00262025 [add_forward_monad_depend]: 5.49998e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 1.203e-05 [cse]: 1.92e-05 [replace_applicator]: 1.395e-05 [Cycle 2]: 0.00035858, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.00012362 [with_stream_mark]: 9.10001e-06 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.56002e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.41002e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.338e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 8.25e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.09003e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.16998e-06 [cse]: 1.203e-05 [replace_applicator]: 5.84999e-06 [py_interpret_to_execute_after_opt_a]: 8.55999e-06 [rewriter_after_opt_a]: 2.692e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 4.05998e-06 [mutable_eliminate]: 0.00056449 [jit_opt_b]: 5.552e-05, [1] [Cycle 1]: 4.943e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.794e-05 [cconv]: 1.684e-05 [loop_unroll]: 0.00043446 [jit_opt_after_cconv]: 0.00017761, [1] [Cycle 1]: 0.00017101, [11] [c_1]: 2.59e-05 [parameter_eliminate]: 2.31e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 3.25998e-06 [cse]: 1.932e-05 [call_graph_tuple_transform]: 4.42e-05 [tuple_list_get_item_eliminator]: 7.22997e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 6.66999e-06 [remove_dup_value]: 1.122e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 6.42001e-06 [add_recomputation]: 3.557e-05 [cse_after_recomputation]: 2.753e-05, [1] [Cycle 1]: 2.175e-05, [1] [cse]: 1.566e-05 [auto_monad_reorder]: 9.92001e-06 [get_jit_bprop_graph]: 4.88001e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.00063616 [symbol_engine_optimizer]: 7.975e-05, [1] [Cycle 1]: 7.368e-05, [6] [build]: 3.10998e-06 [elim_shapecalc]: 8.67998e-06 [elim_not_effective]: 1.563e-05 [opt_reshape]: 7.55e-06 [fold_const_symbol]: 1.005e-05 [renormalize]: 3.4002e-07 [validate]: 3.371e-05 Sums bootstrap : 0.000283s : 0.25% type_inference : 0.108643s : 94.21% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000467s : 0.40% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000710s : 0.62% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002620s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000027s : 0.02% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000564s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.01% loop_unroll : 0.000434s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000044s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000005s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000636s : 0.55% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000214 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000004s : 4: substitution.graph_param_transform 85.02% : 0.000182s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 6.01% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108572 2 97.30% : 0.105637s : 1: type_inference.infer 2.70% : 0.002935s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.77% : 0.000051s : 4: replace.inline 33.23% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.85% : 0.000179s : 4: match.inline 6.15% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 12: predicate.environ_get_depend_swap 1.11% : 0.000001s : 12: predicate.environ_get_eliminate 1.28% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.46% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 1.01% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000001s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 58: predicate.switch_simplify 1.49% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002200 22 68.80% : 0.001514s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.67% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.53% : 0.000650s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123003 72 0.03% : 0.000038s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.24% : 0.000300s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.04% : 0.007432s : 1: jit_opt_a 0.15% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000442s : 1: loop_unroll 0.47% : 0.000572s : 1: mutable_eliminate 0.76% : 0.000939s : 26: opt.transform.jit_opt_a 0.07% : 0.000080s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.52% : 0.000645s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.58% : 0.001943s : 1: renormalize.infer 0.54% : 0.000669s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000030s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.34% : 0.108658s : 1: type_inference TotalTime = 0.121248, [30] [bootstrap]: 0.00028149 [type_inference]: 0.109674 [event_method]: 2.797e-05 [auto_monad]: 7.958e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.62001e-06 [py_interpret_to_execute]: 0.00049231 [rewriter_before_opt_a]: 0.00010083 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00807993, [2] [Cycle 1]: 0.00417488, [27] [switch_simplify]: 6.718e-05 [loop_unroll]: 3.48e-05 [a_1]: 0.00077849 [with_stream_mark]: 2.469e-05 [recompute_prepare]: 1.103e-05 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.20998e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 8.2e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 1.082e-05 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00288319 [add_forward_monad_depend]: 8.45001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.95e-05 [cse]: 3.532e-05 [replace_applicator]: 2.071e-05 [Cycle 2]: 0.00043514, [27] [switch_simplify]: 7.85e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00014041 [with_stream_mark]: 1.353e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.47997e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 3.04001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 1.10999e-06 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.696e-05 [replace_applicator]: 7.71001e-06 [py_interpret_to_execute_after_opt_a]: 1.464e-05 [rewriter_after_opt_a]: 3.846e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00070395 [jit_opt_b]: 6.017e-05, [1] [Cycle 1]: 5.231e-05, [2] [frontend_op_eliminate]: 2.059e-05 [inline_after_opt_a]: 2.05e-05 [cconv]: 3.013e-05 [loop_unroll]: 0.0004749 [jit_opt_after_cconv]: 0.00017692, [1] [Cycle 1]: 0.00016986, [11] [c_1]: 2.819e-05 [parameter_eliminate]: 3.53e-06 [updatestate_depend_eliminate]: 7.17002e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 3.554e-05 [call_graph_tuple_transform]: 2.405e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.84e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 1.004e-05 [add_recomputation]: 5.233e-05 [cse_after_recomputation]: 2.732e-05, [1] [Cycle 1]: 2.099e-05, [1] [cse]: 1.477e-05 [auto_monad_reorder]: 1.848e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.84999e-06 [opt_after_jit_grad]: 0.00050488 [symbol_engine_optimizer]: 0.00011154, [1] [Cycle 1]: 0.00010474, [6] [build]: 5.05001e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.509e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 4.043e-05 [renormalize]: 5.8001e-07 [validate]: 4.7e-05 Sums bootstrap : 0.000281s : 0.24% type_inference : 0.109674s : 93.63% event_method : 0.000028s : 0.02% auto_monad : 0.000080s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000492s : 0.42% rewriter_before_opt_a : 0.000101s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000919s : 0.78% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002883s : 2.46% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000704s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000475s : 0.41% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000505s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000040s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000359 28 0.57% : 0.000002s : 2: substitution.elim_not_effective 8.88% : 0.000032s : 2: substitution.fold_const_symbol 1.85% : 0.000007s : 4: substitution.graph_param_transform 77.08% : 0.000276s : 5: substitution.inline 1.01% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.52% : 0.000016s : 3: substitution.reduce_eliminate 1.39% : 0.000005s : 4: substitution.remove_not_recompute_node 1.43% : 0.000005s : 2: substitution.replace_old_param 3.27% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109587 2 97.03% : 0.106331s : 1: type_inference.infer 2.97% : 0.003256s : 1: type_inference.specialize ------[replace.] 0.000110 7 66.95% : 0.000073s : 5: replace.inline 33.05% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000284 7 96.24% : 0.000273s : 5: match.inline 3.76% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.67% : 0.000002s : 13: predicate.accumulaten_eliminater 1.55% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.99% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.75% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 1.91% : 0.000003s : 13: predicate.reduce_eliminate 1.59% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.79% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.21% : 0.000011s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002569 25 59.84% : 0.001538s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.91% : 0.000100s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.25% : 0.000931s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125423 72 0.04% : 0.000055s : 1: add_recomputation 0.07% : 0.000083s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000297s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.03% : 0.000033s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.44% : 0.008083s : 1: jit_opt_a 0.14% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.39% : 0.000484s : 1: loop_unroll 0.57% : 0.000715s : 1: mutable_eliminate 0.94% : 0.001181s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000068s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000499s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.61% : 0.002022s : 1: renormalize.infer 0.68% : 0.000848s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.09% : 0.000114s : 1: symbol_engine_optimizer 87.46% : 0.109694s : 1: type_inference TotalTime = 0.1203, [30] [bootstrap]: 0.00029566 [type_inference]: 0.110015 [event_method]: 1.906e-05 [auto_monad]: 5.784e-05 [graph_reusing]: 4.35999e-06 [pre_auto_parallel]: 1.97001e-06 [py_interpret_to_execute]: 0.000483 [rewriter_before_opt_a]: 8.462e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00705316, [2] [Cycle 1]: 0.00357361, [27] [switch_simplify]: 5.086e-05 [loop_unroll]: 3.325e-05 [a_1]: 0.00064014 [with_stream_mark]: 1.341e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 6.58998e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 9.29984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 5.84e-06 [renormalize]: 0.00251555 [add_forward_monad_depend]: 5.47001e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.412e-05 [cse]: 2.61e-05 [replace_applicator]: 1.48e-05 [Cycle 2]: 0.00036115, [27] [switch_simplify]: 6.81999e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.00012479 [with_stream_mark]: 9.74999e-06 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.36998e-06 [specialize_transform]: 5.61998e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.59001e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.228e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.89002e-06 [inline_without_move]: 5.51002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.29e-06 [cse]: 1.255e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 1.224e-05 [rewriter_after_opt_a]: 3.429e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 4.84998e-06 [mutable_eliminate]: 0.00061031 [jit_opt_b]: 5.882e-05, [1] [Cycle 1]: 5.093e-05, [2] [frontend_op_eliminate]: 2.057e-05 [inline_after_opt_a]: 1.875e-05 [cconv]: 2.697e-05 [loop_unroll]: 0.00044069 [jit_opt_after_cconv]: 0.00015447, [1] [Cycle 1]: 0.00014791, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 6.41e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.396e-05 [call_graph_tuple_transform]: 2.151e-05 [tuple_list_get_item_eliminator]: 6.39999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.567e-05 [partial_unused_args_eliminate]: 2.66999e-06 [environ_conv]: 8.13001e-06 [add_recomputation]: 4.688e-05 [cse_after_recomputation]: 2.409e-05, [1] [Cycle 1]: 1.866e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.674e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.0004789 [symbol_engine_optimizer]: 0.0001098, [1] [Cycle 1]: 0.00010356, [6] [build]: 3.25002e-06 [elim_shapecalc]: 3.845e-05 [elim_not_effective]: 1.502e-05 [opt_reshape]: 6.96001e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 4.80009e-07 [validate]: 4.392e-05 Sums bootstrap : 0.000296s : 0.25% type_inference : 0.110015s : 94.35% event_method : 0.000019s : 0.02% auto_monad : 0.000058s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000483s : 0.41% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000765s : 0.66% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002516s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000610s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000441s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000479s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000038s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000237 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 83.49% : 0.000198s : 5: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.88% : 0.000009s : 3: substitution.reduce_eliminate 1.74% : 0.000004s : 4: substitution.remove_not_recompute_node 1.83% : 0.000004s : 2: substitution.replace_old_param 4.00% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109952 2 97.72% : 0.107449s : 1: type_inference.infer 2.28% : 0.002503s : 1: type_inference.specialize ------[replace.] 0.000089 7 68.33% : 0.000061s : 5: replace.inline 31.67% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 7 95.89% : 0.000195s : 5: match.inline 4.11% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.51% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000002s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.29% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 5.27% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.26% : 0.000002s : 13: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000002s : 13: predicate.print_const_string_wrapper 2.10% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.89% : 0.000003s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000010s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.46% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002191 25 64.92% : 0.001422s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.44% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.63% : 0.000693s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123912 72 0.04% : 0.000050s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000314s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.69% : 0.007056s : 1: jit_opt_a 0.13% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.36% : 0.000449s : 1: loop_unroll 0.50% : 0.000620s : 1: mutable_eliminate 0.80% : 0.000992s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000067s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.44% : 0.001790s : 1: renormalize.infer 0.58% : 0.000718s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000089s : 1: rewriter_before_opt_a 0.09% : 0.000112s : 1: symbol_engine_optimizer 88.79% : 0.110027s : 1: type_inference TotalTime = 0.068565, [30] [bootstrap]: 0.00032313 [type_inference]: 0.0585716 [event_method]: 2.123e-05 [auto_monad]: 6.934e-05 [graph_reusing]: 6.98e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.0002592 [rewriter_before_opt_a]: 9.753e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00701587, [2] [Cycle 1]: 0.00322934, [27] [switch_simplify]: 6.312e-05 [loop_unroll]: 3.449e-05 [a_1]: 0.00066649 [with_stream_mark]: 1.935e-05 [recompute_prepare]: 9.65002e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.55998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 6.28002e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 4.67998e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.704e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.032e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.00207559 [add_forward_monad_depend]: 6.73e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.638e-05 [cse]: 3.69e-05 [replace_applicator]: 1.681e-05 [Cycle 2]: 0.00036845, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 6.19001e-06 [a_1]: 0.00011842 [with_stream_mark]: 1.188e-05 [recompute_prepare]: 6.12001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 2.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.571e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.58001e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.43e-05 [replace_applicator]: 5.99e-06 [py_interpret_to_execute_after_opt_a]: 1.014e-05 [rewriter_after_opt_a]: 3.686e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00061781 [jit_opt_b]: 5.408e-05, [1] [Cycle 1]: 4.744e-05, [2] [frontend_op_eliminate]: 1.835e-05 [inline_after_opt_a]: 1.811e-05 [cconv]: 2.672e-05 [loop_unroll]: 0.00041596 [jit_opt_after_cconv]: 0.00015445, [1] [Cycle 1]: 0.0001479, [11] [c_1]: 2.539e-05 [parameter_eliminate]: 3.16999e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.545e-05 [call_graph_tuple_transform]: 2.139e-05 [tuple_list_get_item_eliminator]: 6.30002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 6.08002e-06 [remove_dup_value]: 1.851e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 8.25999e-06 [add_recomputation]: 4.913e-05 [cse_after_recomputation]: 2.429e-05, [1] [Cycle 1]: 1.902e-05, [1] [cse]: 1.352e-05 [auto_monad_reorder]: 1.834e-05 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 4.47998e-06 [opt_after_jit_grad]: 0.00044947 [symbol_engine_optimizer]: 7.595e-05, [1] [Cycle 1]: 6.998e-05, [6] [build]: 3.93999e-06 [elim_shapecalc]: 9.04e-06 [elim_not_effective]: 1.434e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 9.51998e-06 [renormalize]: 5.10016e-07 [validate]: 4.429e-05 Sums bootstrap : 0.000323s : 0.50% type_inference : 0.058572s : 90.71% event_method : 0.000021s : 0.03% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000259s : 0.40% rewriter_before_opt_a : 0.000098s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.11% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000785s : 1.22% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002076s : 3.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000051s : 0.08% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000618s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000416s : 0.64% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000449s : 0.70% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000249 25 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.57% : 0.000006s : 4: substitution.graph_param_transform 85.24% : 0.000212s : 5: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 5.24% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058494 2 96.44% : 0.056409s : 1: type_inference.infer 3.56% : 0.002085s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.68% : 0.000066s : 5: replace.inline 31.32% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 94.69% : 0.000209s : 5: match.inline 5.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 888 1.14% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.49% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 6.20% : 0.000008s : 28: predicate.inline 1.08% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 19: predicate.load_eliminater 1.04% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 41: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.45% : 0.000002s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.69% : 0.000010s : 65: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002443 29 70.44% : 0.001721s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.10% : 0.000662s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071748 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000073s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.47% : 0.000338s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.78% : 0.007019s : 1: jit_opt_a 0.22% : 0.000157s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.59% : 0.000424s : 1: loop_unroll 0.87% : 0.000627s : 1: mutable_eliminate 1.44% : 0.001037s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.64% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000265s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 1.95% : 0.001396s : 1: renormalize.infer 0.93% : 0.000670s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.14% : 0.000103s : 1: rewriter_before_opt_a 0.11% : 0.000078s : 1: symbol_engine_optimizer 81.65% : 0.058585s : 1: type_inference TotalTime = 0.0145155, [30] [bootstrap]: 0.00027229 [type_inference]: 0.00723269 [event_method]: 1.819e-05 [auto_monad]: 4.954e-05 [graph_reusing]: 3.65998e-06 [pre_auto_parallel]: 1.80001e-06 [py_interpret_to_execute]: 3.815e-05 [rewriter_before_opt_a]: 7.251e-05 [expand_dump_flag]: 1.91998e-06 [jit_opt_a]: 0.00484492, [2] [Cycle 1]: 0.00154523, [27] [switch_simplify]: 4.781e-05 [loop_unroll]: 3.283e-05 [a_1]: 0.00056337 [with_stream_mark]: 1.228e-05 [recompute_prepare]: 7.68001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 5.93002e-06 [merge_forward]: 2.58998e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.128e-05 [j_node_and_user_rematch]: 8.43001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.49002e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00058502 [add_forward_monad_depend]: 4.65001e-06 [auto_monad_grad]: 1.60001e-06 [auto_monad_eliminator]: 1.046e-05 [cse]: 2.193e-05 [replace_applicator]: 1.157e-05 [Cycle 2]: 0.00032145, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 5.06997e-06 [a_1]: 9.661e-05 [with_stream_mark]: 8.79e-06 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 4.95999e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.023e-05 [j_node_and_user_rematch]: 7.38e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 6.66e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.19e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 8.87e-06 [rewriter_after_opt_a]: 2.819e-05 [convert_after_rewriter]: 5.45001e-06 [order_py_execute_after_rewriter]: 4.13999e-06 [mutable_eliminate]: 0.00047351 [jit_opt_b]: 5.877e-05, [1] [Cycle 1]: 5.257e-05, [2] [frontend_op_eliminate]: 1.612e-05 [inline_after_opt_a]: 2.484e-05 [cconv]: 1.79e-05 [loop_unroll]: 0.00042886 [jit_opt_after_cconv]: 0.00016394, [1] [Cycle 1]: 0.00015783, [11] [c_1]: 2.115e-05 [parameter_eliminate]: 2.38002e-06 [updatestate_depend_eliminate]: 2.601e-05 [updatestate_assign_eliminate]: 2.85998e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 2.067e-05 [call_graph_tuple_transform]: 1.75e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.04998e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.03998e-06 [remove_dup_value]: 9.12001e-06 [partial_unused_args_eliminate]: 1.76e-06 [environ_conv]: 4.13001e-06 [add_recomputation]: 3.298e-05 [cse_after_recomputation]: 2.217e-05, [1] [Cycle 1]: 1.687e-05, [1] [cse]: 1.122e-05 [auto_monad_reorder]: 1.077e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 4.3e-06 [opt_after_jit_grad]: 0.00044675 [symbol_engine_optimizer]: 7.068e-05, [1] [Cycle 1]: 6.466e-05, [6] [build]: 2.43002e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.64998e-06 [fold_const_symbol]: 8.02e-06 [renormalize]: 3.30008e-07 [validate]: 2.872e-05 Sums bootstrap : 0.000272s : 2.48% type_inference : 0.007233s : 65.91% event_method : 0.000018s : 0.17% auto_monad : 0.000050s : 0.45% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.35% rewriter_before_opt_a : 0.000073s : 0.66% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000053s : 0.49% jit_opt_a.loop_unroll : 0.000038s : 0.35% jit_opt_a.a_1 : 0.000660s : 6.01% jit_opt_a.with_stream_mark : 0.000021s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000003s : 0.03% jit_opt_a.replace_old_param : 0.000014s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000585s : 5.33% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.15% jit_opt_a.cse : 0.000034s : 0.31% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000028s : 0.26% convert_after_rewriter : 0.000005s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000474s : 4.31% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000025s : 0.23% cconv : 0.000018s : 0.16% loop_unroll : 0.000429s : 3.91% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000026s : 0.24% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000009s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.04% add_recomputation : 0.000033s : 0.30% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000011s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000447s : 4.07% symbol_engine_optimizer.build : 0.000002s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.26% Time group info: ------[substitution.] 0.000189 27 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000004s : 3: substitution.graph_param_transform 83.64% : 0.000158s : 5: substitution.inline 1.24% : 0.000002s : 4: substitution.j_node_and_user_rematch 4.80% : 0.000009s : 3: substitution.reduce_eliminate 1.97% : 0.000004s : 4: substitution.remove_not_recompute_node 1.42% : 0.000003s : 2: substitution.replace_old_param 3.72% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007179 2 88.17% : 0.006330s : 1: type_inference.infer 11.83% : 0.000849s : 1: type_inference.specialize ------[replace.] 0.000083 7 67.27% : 0.000056s : 5: replace.inline 32.73% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 7 96.27% : 0.000155s : 5: match.inline 3.73% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 747 1.23% : 0.000001s : 11: predicate.accumulaten_eliminater 1.28% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.26% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.70% : 0.000002s : 11: predicate.arithmetic_simplify 1.27% : 0.000001s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.34% : 0.000002s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.24% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000001s : 11: predicate.environ_get_eliminate 1.24% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.19% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000007s : 24: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.07% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.46% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.34% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 16: predicate.partial_eliminate 1.28% : 0.000002s : 11: predicate.print_const_string_wrapper 2.02% : 0.000002s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 19: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.42% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 11: predicate.reshape_eliminate 1.22% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.94% : 0.000009s : 59: predicate.switch_simplify 1.31% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000001s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000706 16 51.61% : 0.000364s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.38% : 0.000052s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.01% : 0.000290s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016041 72 0.22% : 0.000036s : 1: add_recomputation 0.33% : 0.000053s : 1: auto_monad 0.08% : 0.000013s : 1: auto_monad_reorder 1.80% : 0.000289s : 1: bootstrap 0.13% : 0.000021s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 30.22% : 0.004848s : 1: jit_opt_a 1.04% : 0.000167s : 1: jit_opt_after_cconv 0.38% : 0.000061s : 1: jit_opt_b 2.72% : 0.000436s : 1: loop_unroll 3.00% : 0.000481s : 1: mutable_eliminate 5.37% : 0.000862s : 26: opt.transform.jit_opt_a 0.29% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.22% : 0.000035s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.83% : 0.000454s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000041s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000012s : 1: remove_dup_value 1.94% : 0.000311s : 1: renormalize.infer 1.67% : 0.000267s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000031s : 1: rewriter_after_opt_a 0.47% : 0.000075s : 1: rewriter_before_opt_a 0.46% : 0.000073s : 1: symbol_engine_optimizer 45.16% : 0.007244s : 1: type_inference TotalTime = 0.119763, [30] [bootstrap]: 0.00030258 [type_inference]: 0.108451 [event_method]: 2.144e-05 [auto_monad]: 7.021e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00048016 [rewriter_before_opt_a]: 9.683e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.0079452, [2] [Cycle 1]: 0.0039927, [27] [switch_simplify]: 6.193e-05 [loop_unroll]: 3.102e-05 [a_1]: 0.00060828 [with_stream_mark]: 2.053e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.83999e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.26998e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.78998e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00290695 [add_forward_monad_depend]: 7.41001e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.677e-05 [cse]: 3.433e-05 [replace_applicator]: 1.799e-05 [Cycle 2]: 0.00037746, [27] [switch_simplify]: 6.66999e-06 [loop_unroll]: 5.95002e-06 [a_1]: 0.00012789 [with_stream_mark]: 1.338e-05 [recompute_prepare]: 6.13998e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 5.88002e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 2.33998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.46e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 7.00002e-06 [cse]: 1.246e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.257e-05 [rewriter_after_opt_a]: 3.866e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 6.33002e-06 [mutable_eliminate]: 0.00066039 [jit_opt_b]: 5.849e-05, [1] [Cycle 1]: 5.199e-05, [2] [frontend_op_eliminate]: 2.086e-05 [inline_after_opt_a]: 1.963e-05 [cconv]: 2.316e-05 [loop_unroll]: 0.00043202 [jit_opt_after_cconv]: 0.00015736, [1] [Cycle 1]: 0.0001507, [11] [c_1]: 2.514e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 4.94003e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.157e-05 [call_graph_tuple_transform]: 2.299e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 1.00001e-06 [switch_simplify]: 8.59e-06 [remove_dup_value]: 1.488e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 7.40003e-06 [add_recomputation]: 4.892e-05 [cse_after_recomputation]: 2.223e-05, [1] [Cycle 1]: 1.716e-05, [1] [cse]: 1.143e-05 [auto_monad_reorder]: 1.626e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 8.304e-05 [opt_after_jit_grad]: 0.00047193 [symbol_engine_optimizer]: 7.57e-05, [1] [Cycle 1]: 6.96e-05, [6] [build]: 2.48e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 9.87999e-06 [renormalize]: 3.7998e-07 [validate]: 3.963e-05 Sums bootstrap : 0.000303s : 0.26% type_inference : 0.108451s : 93.84% event_method : 0.000021s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000480s : 0.42% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000736s : 0.64% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002907s : 2.52% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000660s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000432s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000083s : 0.07% opt_after_jit_grad : 0.000472s : 0.41% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000240 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 4: substitution.graph_param_transform 84.60% : 0.000203s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000006s : 4: substitution.remove_not_recompute_node 2.21% : 0.000005s : 2: substitution.replace_old_param 5.41% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108371 2 97.38% : 0.105532s : 1: type_inference.infer 2.62% : 0.002838s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.00% : 0.000052s : 4: replace.inline 32.00% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.43% : 0.000201s : 4: match.inline 5.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000001s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.78% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.29% : 0.000002s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.65% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.42% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002345 22 63.91% : 0.001498s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.15% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.94% : 0.000796s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123705 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000314s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.43% : 0.007948s : 1: jit_opt_a 0.13% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.36% : 0.000441s : 1: loop_unroll 0.54% : 0.000668s : 1: mutable_eliminate 0.79% : 0.000979s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.64% : 0.002023s : 1: renormalize.infer 0.71% : 0.000874s : 1: renormalize.specialize 0.07% : 0.000086s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 87.69% : 0.108472s : 1: type_inference . TotalTime = 0.134576, [30] [bootstrap]: 0.00038072 [type_inference]: 0.122776 [event_method]: 2.46e-05 [auto_monad]: 8.139e-05 [graph_reusing]: 6.43998e-06 [pre_auto_parallel]: 2.92002e-06 [py_interpret_to_execute]: 0.00064449 [rewriter_before_opt_a]: 0.00010592 [expand_dump_flag]: 4e-06 [jit_opt_a]: 0.00809157, [2] [Cycle 1]: 0.00397437, [27] [switch_simplify]: 6.823e-05 [loop_unroll]: 3.512e-05 [a_1]: 0.00073151 [with_stream_mark]: 2.01e-05 [recompute_prepare]: 8.87e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.70997e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 6.60002e-06 [renormalize]: 0.00275162 [add_forward_monad_depend]: 6.16e-06 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 3.55e-05 [replace_applicator]: 1.556e-05 [Cycle 2]: 0.00038182, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 6.62002e-06 [a_1]: 0.00013136 [with_stream_mark]: 1.091e-05 [recompute_prepare]: 6.61999e-06 [updatestate_depend_eliminate]: 3.42997e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.73003e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.70001e-06 [inline_without_move]: 5.76998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.418e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.359e-05 [rewriter_after_opt_a]: 3.966e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.00063198 [jit_opt_b]: 5.944e-05, [1] [Cycle 1]: 5.126e-05, [2] [frontend_op_eliminate]: 2.017e-05 [inline_after_opt_a]: 1.841e-05 [cconv]: 2.984e-05 [loop_unroll]: 0.00048698 [jit_opt_after_cconv]: 0.00016987, [1] [Cycle 1]: 0.00016117, [11] [c_1]: 2.755e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 7.03e-06 [updatestate_assign_eliminate]: 3.46001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.872e-05 [call_graph_tuple_transform]: 2.297e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.759e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 9.41e-06 [add_recomputation]: 5.366e-05 [cse_after_recomputation]: 2.762e-05, [1] [Cycle 1]: 2.065e-05, [1] [cse]: 1.405e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 6.31e-06 [opt_after_jit_grad]: 0.00054106 [symbol_engine_optimizer]: 8.359e-05, [1] [Cycle 1]: 7.643e-05, [6] [build]: 5.02e-06 [elim_shapecalc]: 9.36e-06 [elim_not_effective]: 1.536e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.017e-05 [renormalize]: 7.89994e-07 [validate]: 4.994e-05 Sums bootstrap : 0.000381s : 0.29% type_inference : 0.122776s : 94.29% event_method : 0.000025s : 0.02% auto_monad : 0.000081s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000644s : 0.49% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000863s : 0.66% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002752s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000632s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000487s : 0.37% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000541s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000280 28 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 4: substitution.graph_param_transform 83.90% : 0.000235s : 5: substitution.inline 1.16% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.17% : 0.000012s : 3: substitution.reduce_eliminate 1.65% : 0.000005s : 4: substitution.remove_not_recompute_node 1.44% : 0.000004s : 2: substitution.replace_old_param 4.23% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122685 2 97.45% : 0.119557s : 1: type_inference.infer 2.55% : 0.003128s : 1: type_inference.specialize ------[replace.] 0.000108 7 69.86% : 0.000075s : 5: replace.inline 30.14% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 95.60% : 0.000232s : 5: match.inline 4.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 2.06% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.16% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 19: predicate.load_eliminater 1.77% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.45% : 0.000004s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.05% : 0.000002s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.63% : 0.000011s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002535 25 64.71% : 0.001640s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.83% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.46% : 0.000823s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138522 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000085s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.29% : 0.000400s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.84% : 0.008095s : 1: jit_opt_a 0.12% : 0.000173s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.36% : 0.000498s : 1: loop_unroll 0.46% : 0.000643s : 1: mutable_eliminate 0.81% : 0.001117s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000553s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000656s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.34% : 0.001860s : 1: renormalize.infer 0.64% : 0.000882s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 88.65% : 0.122794s : 1: type_inference TotalTime = 0.0189488, [30] [bootstrap]: 0.00026877 [type_inference]: 0.0102144 [event_method]: 2.201e-05 [auto_monad]: 7.471e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 4.692e-05 [rewriter_before_opt_a]: 8.755e-05 [expand_dump_flag]: 3.14001e-06 [jit_opt_a]: 0.00596175, [2] [Cycle 1]: 0.00197948, [27] [switch_simplify]: 6.409e-05 [loop_unroll]: 3.401e-05 [a_1]: 0.00065547 [with_stream_mark]: 2.074e-05 [recompute_prepare]: 1.101e-05 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.57002e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 7.11001e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.65999e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.826e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00080545 [add_forward_monad_depend]: 7.95e-06 [auto_monad_grad]: 2.96999e-06 [auto_monad_eliminator]: 1.653e-05 [cse]: 3.862e-05 [replace_applicator]: 1.729e-05 [Cycle 2]: 0.00034048, [27] [switch_simplify]: 6.11998e-06 [loop_unroll]: 5.05001e-06 [a_1]: 8.922e-05 [with_stream_mark]: 1.258e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.48002e-06 [parameter_eliminate]: 1.56998e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 4.95001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.64998e-06 [merge_forward]: 3.25e-06 [cell_reuse_recompute_pass]: 2.40002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.892e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8e-06 [inline_without_move]: 4.88001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 1.06002e-06 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.534e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.7e-05 [rewriter_after_opt_a]: 4.273e-05 [convert_after_rewriter]: 7.78999e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.00061442 [jit_opt_b]: 5.192e-05, [1] [Cycle 1]: 4.364e-05, [2] [frontend_op_eliminate]: 1.545e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.912e-05 [loop_unroll]: 0.00042184 [jit_opt_after_cconv]: 0.00016789, [1] [Cycle 1]: 0.00016026, [11] [c_1]: 2.081e-05 [parameter_eliminate]: 3.23e-06 [updatestate_depend_eliminate]: 6.93e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.61999e-06 [cse]: 3.086e-05 [call_graph_tuple_transform]: 2.962e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 1.07e-06 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 4.181e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 5.178e-05 [cse_after_recomputation]: 2.514e-05, [1] [Cycle 1]: 1.89e-05, [1] [cse]: 1.301e-05 [auto_monad_reorder]: 1.867e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00046212 [symbol_engine_optimizer]: 7.491e-05, [1] [Cycle 1]: 6.881e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.409e-05 [opt_reshape]: 5.67001e-06 [fold_const_symbol]: 8.79998e-06 [renormalize]: 4.19997e-07 [validate]: 4.097e-05 Sums bootstrap : 0.000269s : 1.83% type_inference : 0.010214s : 69.56% event_method : 0.000022s : 0.15% auto_monad : 0.000075s : 0.51% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.32% rewriter_before_opt_a : 0.000088s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.48% jit_opt_a.loop_unroll : 0.000039s : 0.27% jit_opt_a.a_1 : 0.000745s : 5.07% jit_opt_a.with_stream_mark : 0.000033s : 0.23% jit_opt_a.recompute_prepare : 0.000016s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000806s : 5.49% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.16% jit_opt_a.cse : 0.000054s : 0.37% jit_opt_a.replace_applicator : 0.000023s : 0.15% py_interpret_to_execute_after_opt_a : 0.000017s : 0.12% rewriter_after_opt_a : 0.000043s : 0.29% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000614s : 4.18% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.11% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000029s : 0.20% loop_unroll : 0.000422s : 2.87% jit_opt_after_cconv.c_1 : 0.000021s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000042s : 0.28% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000052s : 0.35% cse_after_recomputation.cse : 0.000013s : 0.09% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000462s : 3.15% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.28% Time group info: ------[substitution.] 0.000267 24 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000005s : 3: substitution.graph_param_transform 86.87% : 0.000232s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 4.80% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010135 2 88.89% : 0.009009s : 1: type_inference.infer 11.11% : 0.001126s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.05% : 0.000061s : 5: replace.inline 32.95% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 95.16% : 0.000229s : 5: match.inline 4.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.40% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.21% : 0.000002s : 11: predicate.addn_zero_filter 2.17% : 0.000003s : 11: predicate.arithmetic_simplify 1.21% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000001s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000001s : 3: predicate.graph_param_transform 6.27% : 0.000008s : 24: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.48% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.05% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 1.55% : 0.000002s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 2.03% : 0.000003s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 11: predicate.same_eliminate 0.89% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.73% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.01% : 0.000010s : 59: predicate.switch_simplify 1.50% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.67% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.86% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000827 16 46.76% : 0.000386s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.79% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.45% : 0.000359s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020813 72 0.26% : 0.000055s : 1: add_recomputation 0.38% : 0.000079s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.35% : 0.000281s : 1: bootstrap 0.15% : 0.000032s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 28.66% : 0.005965s : 1: jit_opt_a 0.82% : 0.000171s : 1: jit_opt_after_cconv 0.26% : 0.000054s : 1: jit_opt_b 2.06% : 0.000430s : 1: loop_unroll 3.00% : 0.000625s : 1: mutable_eliminate 4.74% : 0.000987s : 26: opt.transform.jit_opt_a 0.28% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000017s : 1: opt.transform.mutable_eliminate 0.10% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.26% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000050s : 1: py_interpret_to_execute 0.09% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000045s : 1: remove_dup_value 2.12% : 0.000442s : 1: renormalize.infer 1.71% : 0.000355s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000046s : 1: rewriter_after_opt_a 0.43% : 0.000091s : 1: rewriter_before_opt_a 0.37% : 0.000077s : 1: symbol_engine_optimizer 49.18% : 0.010235s : 1: type_inference TotalTime = 0.126545, [30] [bootstrap]: 0.00027338 [type_inference]: 0.115256 [event_method]: 2.357e-05 [auto_monad]: 7.196e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00052605 [rewriter_before_opt_a]: 0.00010016 [expand_dump_flag]: 3.85e-06 [jit_opt_a]: 0.00794465, [2] [Cycle 1]: 0.00396699, [27] [switch_simplify]: 0.00010493 [loop_unroll]: 3.464e-05 [a_1]: 0.00072563 [with_stream_mark]: 2.033e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 4.24997e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 7.12002e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 6.19001e-06 [renormalize]: 0.00273524 [add_forward_monad_depend]: 6.58e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.556e-05 [cse]: 3.279e-05 [replace_applicator]: 1.599e-05 [Cycle 2]: 0.00048421, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00022015 [with_stream_mark]: 1.213e-05 [recompute_prepare]: 6.94999e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.38003e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 7.17002e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 5.73002e-06 [merge_forward]: 3.27002e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32999e-06 [auto_monad_grad]: 9.49978e-07 [auto_monad_eliminator]: 7.29001e-06 [cse]: 1.658e-05 [replace_applicator]: 5.96998e-06 [py_interpret_to_execute_after_opt_a]: 1.359e-05 [rewriter_after_opt_a]: 3.723e-05 [convert_after_rewriter]: 6.49001e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00064999 [jit_opt_b]: 5.426e-05, [1] [Cycle 1]: 4.748e-05, [2] [frontend_op_eliminate]: 1.862e-05 [inline_after_opt_a]: 1.732e-05 [cconv]: 2.659e-05 [loop_unroll]: 0.00042653 [jit_opt_after_cconv]: 0.00014934, [1] [Cycle 1]: 0.00014307, [11] [c_1]: 2.533e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.064e-05 [call_graph_tuple_transform]: 2.104e-05 [tuple_list_get_item_eliminator]: 6.28002e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.497e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 7.98001e-06 [add_recomputation]: 5.007e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.946e-05, [1] [cse]: 1.268e-05 [auto_monad_reorder]: 1.721e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 4.91002e-06 [opt_after_jit_grad]: 0.0004865 [symbol_engine_optimizer]: 0.00012127, [1] [Cycle 1]: 0.0001146, [6] [build]: 3.76999e-06 [elim_shapecalc]: 8.54002e-06 [elim_not_effective]: 1.375e-05 [opt_reshape]: 6.34001e-06 [fold_const_symbol]: 5.45e-05 [renormalize]: 4.99975e-07 [validate]: 4.693e-05 Sums bootstrap : 0.000273s : 0.22% type_inference : 0.115256s : 94.13% event_method : 0.000024s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000526s : 0.43% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000112s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000946s : 0.77% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002735s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000650s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000427s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000487s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000055s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000278 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000006s : 4: substitution.graph_param_transform 84.77% : 0.000236s : 5: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.18% : 0.000012s : 3: substitution.reduce_eliminate 1.61% : 0.000004s : 4: substitution.remove_not_recompute_node 1.62% : 0.000005s : 2: substitution.replace_old_param 3.64% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115178 2 97.41% : 0.112189s : 1: type_inference.infer 2.59% : 0.002989s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.38% : 0.000068s : 5: replace.inline 31.62% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 7 96.28% : 0.000233s : 5: match.inline 3.72% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.84% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 13: predicate.addn_check_dump 1.69% : 0.000002s : 13: predicate.addn_zero_filter 1.85% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.99% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.40% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 2.13% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.27% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002272 25 62.55% : 0.001421s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.52% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.93% : 0.000771s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130614 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000296s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.09% : 0.007948s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.33% : 0.000434s : 1: loop_unroll 0.50% : 0.000658s : 1: mutable_eliminate 0.94% : 0.001230s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000080s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000534s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.46% : 0.001913s : 1: renormalize.infer 0.62% : 0.000813s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.09% : 0.000124s : 1: symbol_engine_optimizer 88.26% : 0.115275s : 1: type_inference TotalTime = 0.0775528, [30] [bootstrap]: 0.0003022 [type_inference]: 0.0672596 [event_method]: 1.973e-05 [auto_monad]: 6.973e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00028346 [rewriter_before_opt_a]: 8.245e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.00721145, [2] [Cycle 1]: 0.003526, [27] [switch_simplify]: 5.588e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00057764 [with_stream_mark]: 1.724e-05 [recompute_prepare]: 8.87e-06 [updatestate_depend_eliminate]: 3.67002e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 7.35003e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.57002e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.19003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.41998e-06 [inline_without_move]: 6.41e-06 [renormalize]: 0.00249816 [add_forward_monad_depend]: 6.71e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.714e-05 [cse]: 3.152e-05 [replace_applicator]: 1.45e-05 [Cycle 2]: 0.00035922, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.74999e-06 [a_1]: 0.00012047 [with_stream_mark]: 9.89001e-06 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.70002e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 2.07001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.376e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.03002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.17e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.138e-05 [rewriter_after_opt_a]: 3.842e-05 [convert_after_rewriter]: 7.63999e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00066508 [jit_opt_b]: 5.471e-05, [1] [Cycle 1]: 4.717e-05, [2] [frontend_op_eliminate]: 1.84e-05 [inline_after_opt_a]: 1.731e-05 [cconv]: 2.681e-05 [loop_unroll]: 0.00042693 [jit_opt_after_cconv]: 0.00015198, [1] [Cycle 1]: 0.00014554, [11] [c_1]: 2.483e-05 [parameter_eliminate]: 2.89001e-06 [updatestate_depend_eliminate]: 6.04999e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.295e-05 [call_graph_tuple_transform]: 2.046e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 6.37001e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 9.05001e-06 [add_recomputation]: 5.223e-05 [cse_after_recomputation]: 2.135e-05, [1] [Cycle 1]: 1.627e-05, [1] [cse]: 1.066e-05 [auto_monad_reorder]: 1.591e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 5.73997e-06 [opt_after_jit_grad]: 0.00049366 [symbol_engine_optimizer]: 7.624e-05, [1] [Cycle 1]: 7.006e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 8.67e-06 TotalTime = 0.017169, [30] [bootstrap]: 0.00025743 [type_inference]: 0.00936955 [event_method]: 1.918e-05 [auto_monad]: 4.709e-05 [graph_reusing]: 3.67002e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 4.762e-05 [rewriter_before_opt_a]: 7.947e-05 [expand_dump_flag]: 2.06e-06 [jit_opt_a]: 0.00524304, [2] [Cycle 1]: 0.00193072, [27] [switch_simplify]: 4.891e-05 [loop_unroll]: 3.43e-05 [a_1]: 0.00059903 [with_stream_mark]: 1.495e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 5.38002e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.213e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 8.22e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 0.00091481 [add_forward_monad_depend]: 5.20999e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 1.193e-05 [cse]: 2.784e-05 [replace_applicator]: 1.284e-05 [Cycle 2]: 0.00032524, [27] [switch_simplify]: 6.04001e-06 [loop_unroll]: 5.47999e-06 [a_1]: 8.965e-05 [with_stream_mark]: 1.005e-05 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 4.99e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.43e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.40997e-06 [cse]: 1.618e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.022e-05 [rewriter_after_opt_a]: 5.309e-05 [convert_after_rewriter]: 5.74999e-06 [order_py_execute_after_rewriter]: 4.53999e-06 [mutable_eliminate]: 0.00054447 [jit_opt_b]: 4.739e-05, [1] [Cycle 1]: 4.145e-05, [2] [frontend_op_eliminate]: 1.584e-05 [inline_after_opt_a]: 1.516e-05 [cconv]: 1.593e-05 [loop_unroll]: 0.00041888 [jit_opt_after_cconv]: 0.00014102, [1] [Cycle 1]: 0.00013488, [11] [c_1]: 2.045e-05 [parameter_eliminate]: 1.99e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.476e-05 [call_graph_tuple_transform]: 1.753e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 1.32e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 3.346e-05 [partial_unused_args_eliminate]: 1.47001e-06 [environ_conv]: 3.95e-06 [add_recomputation]: 3.054e-05 [cse_after_recomputation]: 2.259e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.305e-05 [get_jit_bprop_graph]: 1.49e-06 [rewriter_after_jit_bprop_graph]: 4.56002e-06 [opt_after_jit_grad]: 0.00045592 [symbol_engine_optimizer]: 7.055e-05, [1] [Cycle 1]: 6.504e-05, [6] [build]: 2.83e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 7.11001e-06 [fold_const_symbol]: 9.56e-06 [renormalize]: 4.69998e-07 [validate]: 4.799e-05 Sums bootstrap : 0.000302s : 0.41% type_inference : 0.067260s : 91.33% event_method : 0.000020s : 0.03% auto_monad : 0.000070s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000283s : 0.38% rewriter_before_opt_a : 0.000082s : 0.11% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000698s : 0.95% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002498s : 3.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000043s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000665s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000027s : 0.04% loop_unroll : 0.000427s : 0.58% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% [elim_not_effective]: 1.246e-05 [opt_reshape]: 6.07999e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 4.49974e-07 [validate]: 3.028e-05 Sums bootstrap : 0.000257s : 1.89% type_inference : 0.009370s : 68.91% event_method : 0.000019s : 0.14% auto_monad : 0.000047s : 0.35% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000048s : 0.35% rewriter_before_opt_a : 0.000079s : 0.58% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000055s : 0.40% jit_opt_a.loop_unroll : 0.000040s : 0.29% jit_opt_a.a_1 : 0.000689s : 5.07% jit_opt_a.with_stream_mark : 0.000025s : 0.18% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000006s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000915s : 6.73% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.13% jit_opt_a.cse : 0.000044s : 0.32% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000010s : 0.08% rewriter_after_opt_a : 0.000053s : 0.39% convert_after_rewriter : 0.000006s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000544s : 4.00% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000016s : 0.12% loop_unroll : 0.000419s : 3.08% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000033s : 0.25% partial_unused_args_eliminate : 0.000001s : 0.01 environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000494s : 0.67% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.07% % environ_conv : 0.000004s : 0.03% add_recomputation : 0.000031s : 0.22% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000013s : 0.10% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.03% opt_after_jit_grad : 0.000456s : 3.35% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.22% Time group info: ------[substitution.] 0.000195 24 0.73% : 0.000001s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.39% : 0.000005s : 3: substitution.graph_param_transform 86.65% : 0.000169s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 1.81% : 0.000004s : 2: substitution.replace_old_param 4.24% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009313 2 86.29% : 0.008036s : 1: type_inference.infer 13.71% : 0.001277s : 1: type_inference.specialize ------[replace.] 0.000094 7 66.20% : 0.000062s : 5: replace.inline 33.80% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 7 95.91% : 0.000166s : 5: match.inline 4.09% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.50% : 0.000002s : 11: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.31% : 0.000002s : 11: predicate.addn_zero_filter 2.15% : 0.000003s : 11: predicate.arithmetic_simplify 1.31% : 0.000002s : 11: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.22% : 0.000001s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000001s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 16: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.60% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.24% : 0.000001s : 11: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000001s : 11: predicate.print_const_string_wrapper 2.17% : 0.000003s : 11: predicate.reduce_eliminate 1.56% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.35% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: Time group info: ------[substitution.] 0.000216 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 4: substitution.graph_param_transform 83.55% : 0.000181s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000005s : 4: substitution.remove_not_recompute_node 2.32% : 0.000005s : 2: substitution.replace_old_param 6.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067183 2 96.95% : 0.065137s : 1: type_inference.infer 3.05% : 0.002046s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.40% : 0.000049s : 4: replace.inline 31.60% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 93.59% : 0.000178s : 4: match.inline 6.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.09% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.88% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 2.00% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000001s : 12: predicate.print_const_string_wrapper 1.86% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 11: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.77% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.60% : 0.000009s : 59: predicate.switch_simplify 1.43% : 0.000002s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000906 16 48.40% : 0.000439s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.31% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.29% : 0.000410s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019034 72 0.18% : 0.000033s : 1: add_recomputation 0.27% : 0.000050s : 1: auto_monad 0.08% : 0.000016s : 1: auto_monad_reorder 1.43% : 0.000273s : 1: bootstrap 0.10% : 0.000018s : 1: cconv 0.04% : 0.000008s : 1: convert_after_rewriter 0.13% : 0.000025s : 1: cse_after_recomputation 0.03% : 0.000006s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000006s : 1: graph_reusing 27.56% : 0.005246s : 1: jit_opt_a 0.75% : 0.000143s : 1: jit_opt_after_cconv 0.26% : 0.000050s : 1: jit_opt_b 2.24% : 0.000426s : 1: loop_unroll 2.90% : 0.000553s : 1: mutable_eliminate 4.74% : 0.000903s : 26: opt.transform.jit_opt_a 0.24% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.44% : 0.000464s : 1: opt_after_jit_grad 0.12% : 0.000022s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000050s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000036s : 1: remove_dup_value 2.78% : 0.000528s : 1: renormalize.infer 1.99% : 0.000378s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000056s : 1: rewriter_after_opt_a 0.43% : 0.000082s : 1: rewriter_before_opt_a 0.38% : 0.000073s : 1: symbol_engine_optimizer 49.30% : 0.009383s : 1: type_inference predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.33% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002850 34 76.12% : 0.002170s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 22.59% : 0.000644s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.081042 72 0.07% : 0.000055s : 1: add_recomputation 0.09% : 0.000073s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.40% : 0.000321s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.90% : 0.007215s : 1: jit_opt_a 0.19% : 0.000155s : 1: jit_opt_after_cconv 0.07% : 0.000057s : 1: jit_opt_b 0.54% : 0.000435s : 1: loop_unroll 0.83% : 0.000674s : 1: mutable_eliminate 1.15% : 0.000929s : 26: opt.transform.jit_opt_a 0.07% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000502s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000289s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.20% : 0.001780s : 1: renormalize.infer 0.88% : 0.000709s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.11% : 0.000087s : 1: rewriter_before_opt_a 0.10% : 0.000079s : 1: symbol_engine_optimizer 83.01% : 0.067277s : 1: type_inference TotalTime = 0.0179334, [30] [bootstrap]: 0.00031914 [type_inference]: 0.0090391 [event_method]: 1.883e-05 [auto_monad]: 6.578e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 1.92999e-06 [py_interpret_to_execute]: 4.199e-05 [rewriter_before_opt_a]: 7.855e-05 [expand_dump_flag]: 2.71999e-06 [jit_opt_a]: 0.00605907, [2] [Cycle 1]: 0.00192986, [27] [switch_simplify]: 5.707e-05 [loop_unroll]: 3.375e-05 [a_1]: 0.00063539 [with_stream_mark]: 1.708e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 4.13001e-06 [cell_reuse_recompute_pass]: 1.61e-05 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00084743 [add_forward_monad_depend]: 5.37999e-06 [auto_monad_grad]: 2.11998e-06 [auto_monad_eliminator]: 1.537e-05 [cse]: 2.598e-05 [replace_applicator]: 1.239e-05 [Cycle 2]: 0.0003798, [27] [switch_simplify]: 6.11e-06 [loop_unroll]: 4.92e-06 [a_1]: 9.781e-05 [with_stream_mark]: 9.25001e-06 [recompute_prepare]: 5.105e-05 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.21997e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.145e-05 [j_node_and_user_rematch]: 7.88001e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.44002e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.428e-05 [replace_applicator]: 5.42999e-06 [py_interpret_to_execute_after_opt_a]: 1.261e-05 [rewriter_after_opt_a]: 3.578e-05 [convert_after_rewriter]: 7.59002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00059092 [jit_opt_b]: 5.167e-05, [1] [Cycle 1]: 4.49e-05, [2] [frontend_op_eliminate]: 1.684e-05 [inline_after_opt_a]: 1.615e-05 [cconv]: 2.492e-05 [loop_unroll]: 0.00047998 [jit_opt_after_cconv]: 0.00016387, [1] [Cycle 1]: 0.00015633, [11] [c_1]: 2.193e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 1.594e-05 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.504e-05 [call_graph_tuple_transform]: 2.028e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.69999e-06 [remove_dup_value]: 1.558e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 5.34998e-06 [add_recomputation]: 4.997e-05 [cse_after_recomputation]: 2.335e-05, [1] [Cycle 1]: 1.757e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.731e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 6.14999e-06 [opt_after_jit_grad]: 0.00051892 [symbol_engine_optimizer]: 7.505e-05, [1] [Cycle 1]: 6.88e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.317e-05 [opt_reshape]: 6.62002e-06 [fold_const_symbol]: 8.85999e-06 [renormalize]: 3.50003e-07 [validate]: 3.914e-05 Sums bootstrap : 0.000319s : 2.35% type_inference : 0.009039s : 66.47% event_method : 0.000019s : 0.14% auto_monad : 0.000066s : 0.48% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000042s : 0.31% rewriter_before_opt_a : 0.000079s : 0.58% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.46% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000733s : 5.39% jit_opt_a.with_stream_mark : 0.000026s : 0.19% jit_opt_a.recompute_prepare : 0.000059s : 0.43% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000018s : 0.13% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000847s : 6.23% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.16% jit_opt_a.cse : 0.000040s : 0.30% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000013s : 0.09% rewriter_after_opt_a : 0.000036s : 0.26% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000591s : 4.35% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.18% loop_unroll : 0.000480s : 3.53% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.12% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000050s : 0.37% cse_after_recomputation.cse : 0.000011s : 0.08% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000519s : 3.82% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.29% Time group info: ------[substitution.] 0.000257 27 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000005s : 3: substitution.graph_param_transform 83.92% : 0.000216s : 5: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.18% : 0.000011s : 3: substitution.reduce_eliminate 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 3.94% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008974 2 88.79% : 0.007968s : 1: type_inference.infer 11.21% : 0.001006s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.71% : 0.000062s : 5: replace.inline 32.29% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 95.95% : 0.000212s : 5: match.inline 4.05% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.43% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.28% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000001s : 11: predicate.environ_get_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.05% : 0.000006s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.54% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.94% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000001s : 11: predicate.print_const_string_wrapper 2.01% : 0.000002s : 11: predicate.reduce_eliminate 1.67% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 11: predicate.reshape_eliminate 1.35% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.68% : 0.000009s : 59: predicate.switch_simplify 1.38% : 0.000002s : 11: predicate.tile_eliminate 1.40% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.81% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000819 16 49.27% : 0.000403s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.64% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.09% : 0.000345s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019846 72 0.27% : 0.000053s : 1: add_recomputation 0.35% : 0.000069s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.70% : 0.000337s : 1: bootstrap 0.14% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.11% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.55% : 0.006063s : 1: jit_opt_a 0.84% : 0.000167s : 1: jit_opt_after_cconv 0.27% : 0.000054s : 1: jit_opt_b 2.46% : 0.000489s : 1: loop_unroll 3.03% : 0.000601s : 1: mutable_eliminate 5.03% : 0.000999s : 26: opt.transform.jit_opt_a 0.25% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.67% : 0.000529s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.47% : 0.000489s : 1: renormalize.infer 1.77% : 0.000350s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000039s : 1: rewriter_after_opt_a 0.41% : 0.000082s : 1: rewriter_before_opt_a 0.39% : 0.000078s : 1: symbol_engine_optimizer 45.61% : 0.009052s : 1: type_inference TotalTime = 0.0688644, [30] [bootstrap]: 0.0003004 [type_inference]: 0.0556087 [event_method]: 2.149e-05 [auto_monad]: 7.068e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00027328 [rewriter_before_opt_a]: 8.382e-05 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.0102323, [2] [Cycle 1]: 0.00326928, [27] [switch_simplify]: 5.954e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00058943 [with_stream_mark]: 1.563e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.88998e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 1.029e-05 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 6.58e-06 [renormalize]: 0.00222336 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.791e-05 [cse]: 3.503e-05 [replace_applicator]: 1.686e-05 [Cycle 2]: 0.00038706, [27] [switch_simplify]: 6.51999e-06 [loop_unroll]: 5.74e-06 [a_1]: 0.00013907 [with_stream_mark]: 1.266e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 3.31001e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 2.03997e-06 [replace_old_param]: 9.27999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.295e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.232e-05 [rewriter_after_opt_a]: 3.628e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00060389 [jit_opt_b]: 5.637e-05, [1] [Cycle 1]: 4.879e-05, [2] [frontend_op_eliminate]: 1.968e-05 [inline_after_opt_a]: 1.837e-05 [cconv]: 2.483e-05 [loop_unroll]: 0.00043126 [jit_opt_after_cconv]: 0.00015079, [1] [Cycle 1]: 0.00014432, [11] [c_1]: 2.652e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.137e-05 [call_graph_tuple_transform]: 2.068e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.91998e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.534e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.81998e-06 [add_recomputation]: 5.12e-05 [cse_after_recomputation]: 2.313e-05, [1] [Cycle 1]: 1.687e-05, [1] [cse]: 1.126e-05 [auto_monad_reorder]: 1.575e-05 [get_jit_bprop_graph]: 2.29001e-06 [rewriter_after_jit_bprop_graph]: 5.76e-06 [opt_after_jit_grad]: 0.0005094 [symbol_engine_optimizer]: 7.696e-05, [1] [Cycle 1]: 7.095e-05, [6] [build]: 3.61999e-06 [elim_shapecalc]: 8.49998e-06 [elim_not_effective]: 1.406e-05 [opt_reshape]: 7.12002e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 3.60014e-07 [validate]: 4.388e-05 Sums bootstrap : 0.000300s : 0.49% type_inference : 0.055609s : 90.12% event_method : 0.000021s : 0.03% auto_monad : 0.000071s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000273s : 0.44% rewriter_before_opt_a : 0.000084s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000728s : 1.18% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002223s : 3.60% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000048s : 0.08% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000604s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000431s : 0.70% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000509s : 0.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000219 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000006s : 4: substitution.graph_param_transform 83.21% : 0.000182s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000005s : 2: substitution.replace_old_param 6.22% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055523 2 96.30% : 0.053467s : 1: type_inference.infer 3.70% : 0.002056s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.03% : 0.000052s : 4: replace.inline 31.97% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 93.56% : 0.000180s : 4: match.inline 6.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 2.16% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000001s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.60% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.21% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002260 26 72.35% : 0.001635s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.56% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.09% : 0.000589s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072122 72 0.07% : 0.000054s : 1: add_recomputation 0.10% : 0.000074s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000316s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 14.19% : 0.010236s : 1: jit_opt_a 0.21% : 0.000153s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.61% : 0.000439s : 1: loop_unroll 0.85% : 0.000612s : 1: mutable_eliminate 1.34% : 0.000967s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000279s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 2.18% : 0.001569s : 1: renormalize.infer 0.89% : 0.000645s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.12% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000079s : 1: symbol_engine_optimizer 77.13% : 0.055629s : 1: type_inference TotalTime = 0.122474, [30] [bootstrap]: 0.00026068 [type_inference]: 0.110157 [event_method]: 2.597e-05 [auto_monad]: 7.933e-05 [graph_reusing]: 6.23998e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 0.000459 [rewriter_before_opt_a]: 0.00010747 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00872296, [2] [Cycle 1]: 0.00445139, [27] [switch_simplify]: 7.604e-05 [loop_unroll]: 3.501e-05 [a_1]: 0.00080068 [with_stream_mark]: 2.768e-05 [recompute_prepare]: 1.293e-05 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.79001e-06 [specialize_transform]: 7.64002e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 6.68e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.728e-05 [j_node_and_user_rematch]: 1.186e-05 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 1.145e-05 [inline_without_move]: 6.74001e-06 [renormalize]: 0.00308467 [add_forward_monad_depend]: 1.049e-05 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 2.163e-05 [cse]: 3.886e-05 [replace_applicator]: 2.452e-05 [Cycle 2]: 0.00039765, [27] [switch_simplify]: 7.28999e-06 [loop_unroll]: 6.32001e-06 [a_1]: 0.00012417 [with_stream_mark]: 1.558e-05 [recompute_prepare]: 6.36e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 3.57002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.998e-05 [j_node_and_user_rematch]: 9.66e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 8.39995e-07 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 7.05e-06 [cse]: 1.637e-05 [replace_applicator]: 7.28999e-06 [py_interpret_to_execute_after_opt_a]: 1.454e-05 [rewriter_after_opt_a]: 4.416e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00072473 [jit_opt_b]: 5.783e-05, [1] [Cycle 1]: 4.972e-05, [2] [frontend_op_eliminate]: 1.902e-05 [inline_after_opt_a]: 1.879e-05 [cconv]: 2.635e-05 [loop_unroll]: 0.00042972 [jit_opt_after_cconv]: 0.00016585, [1] [Cycle 1]: 0.00015882, [11] [c_1]: 2.739e-05 [parameter_eliminate]: 3.08e-06 [updatestate_depend_eliminate]: 5.87001e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 2.998e-05 [call_graph_tuple_transform]: 2.233e-05 [tuple_list_get_item_eliminator]: 6.61999e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 6.55997e-06 [remove_dup_value]: 1.813e-05 [partial_unused_args_eliminate]: 2.55002e-06 [environ_conv]: 8.54e-06 [add_recomputation]: 5.168e-05 [cse_after_recomputation]: 2.435e-05, [1] [Cycle 1]: 1.92e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.906e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 6.56e-06 [opt_after_jit_grad]: 0.00069022 [symbol_engine_optimizer]: 7.575e-05, [1] [Cycle 1]: 6.89e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 9.04998e-06 [elim_not_effective]: 1.345e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 3.69997e-07 [validate]: 4.572e-05 Sums bootstrap : 0.000261s : 0.22% type_inference : 0.110157s : 93.41% event_method : 0.000026s : 0.02% auto_monad : 0.000079s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000459s : 0.39% rewriter_before_opt_a : 0.000107s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000925s : 0.78% jit_opt_a.with_stream_mark : 0.000043s : 0.04% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003085s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000055s : 0.05% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000725s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000430s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000690s : 0.59% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000342 25 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000007s : 4: substitution.graph_param_transform 87.58% : 0.000300s : 5: substitution.inline 1.40% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000007s : 2: substitution.replace_old_param 4.30% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110060 2 97.26% : 0.107041s : 1: type_inference.infer 2.74% : 0.003019s : 1: type_inference.specialize ------[replace.] 0.000121 7 69.03% : 0.000083s : 5: replace.inline 30.97% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000310 7 95.71% : 0.000296s : 5: match.inline 4.29% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.63% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 6.14% : 0.000009s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.77% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 1.77% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.51% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.42% : 0.000002s : 13: predicate.same_eliminate 0.95% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 1.97% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.98% : 0.000012s : 64: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002379 25 60.71% : 0.001444s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.06% : 0.000097s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.23% : 0.000838s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126840 72 0.04% : 0.000055s : 1: add_recomputation 0.07% : 0.000083s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.22% : 0.000277s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.04% : 0.000047s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.88% : 0.008727s : 1: jit_opt_a 0.13% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.34% : 0.000437s : 1: loop_unroll 0.58% : 0.000734s : 1: mutable_eliminate 0.95% : 0.001206s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.55% : 0.000700s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000466s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.75% : 0.002222s : 1: renormalize.infer 0.67% : 0.000849s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.09% : 0.000113s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 86.86% : 0.110178s : 1: type_inference TotalTime = 0.123625, [30] [bootstrap]: 0.00028618 [type_inference]: 0.112481 [event_method]: 2.074e-05 [auto_monad]: 5.037e-05 [graph_reusing]: 3.86999e-06 [pre_auto_parallel]: 1.85001e-06 [py_interpret_to_execute]: 0.00051779 [rewriter_before_opt_a]: 8.883e-05 [expand_dump_flag]: 2.58003e-06 [jit_opt_a]: 0.00757323, [2] [Cycle 1]: 0.00397924, [27] [switch_simplify]: 5.448e-05 [loop_unroll]: 3.422e-05 [a_1]: 0.00068287 [with_stream_mark]: 1.405e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.72002e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 6.66999e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.208e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.99e-06 [renormalize]: 0.00286219 [add_forward_monad_depend]: 6.91999e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.52e-05 [cse]: 2.786e-05 [replace_applicator]: 1.6e-05 [Cycle 2]: 0.0004229, [27] [switch_simplify]: 7.23999e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00013382 [with_stream_mark]: 1.232e-05 [recompute_prepare]: 6.23998e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.16999e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 8.49002e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 3.635e-05 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.66001e-06 [cse]: 1.747e-05 [replace_applicator]: 6.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.44e-05 [rewriter_after_opt_a]: 3.814e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 4.69998e-06 [mutable_eliminate]: 0.00069494 [jit_opt_b]: 6.209e-05, [1] [Cycle 1]: 5.372e-05, [2] [frontend_op_eliminate]: 2.203e-05 [inline_after_opt_a]: 2.003e-05 [cconv]: 3e-05 [loop_unroll]: 0.00050988 [jit_opt_after_cconv]: 0.00017803, [1] [Cycle 1]: 0.00017126, [11] [c_1]: 2.839e-05 [parameter_eliminate]: 3.67998e-06 [updatestate_depend_eliminate]: 7.58001e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.98e-06 [cse]: 3.068e-05 [call_graph_tuple_transform]: 2.461e-05 [tuple_list_get_item_eliminator]: 7.13998e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 6.62002e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.87002e-06 [environ_conv]: 9.09e-06 [add_recomputation]: 4.787e-05 [cse_after_recomputation]: 2.586e-05, [1] [Cycle 1]: 2.039e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.831e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 7.31999e-06 [opt_after_jit_grad]: 0.00058259 [symbol_engine_optimizer]: 8.372e-05, [1] [Cycle 1]: 7.597e-05, [6] [build]: 4.13001e-06 [elim_shapecalc]: 9.67001e-06 [elim_not_effective]: 1.561e-05 [opt_reshape]: 7.16001e-06 [fold_const_symbol]: 9.63997e-06 [renormalize]: 3.30008e-07 [validate]: 8.5e-05 Sums bootstrap : 0.000286s : 0.24% type_inference : 0.112481s : 93.85% event_method : 0.000021s : 0.02% auto_monad : 0.000050s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000518s : 0.43% rewriter_before_opt_a : 0.000089s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000817s : 0.68% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000042s : 0.04% jit_opt_a.renormalize : 0.002862s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000695s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000510s : 0.43% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000583s : 0.49% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000085s : 0.07% Time group info: ------[substitution.] 0.000231 28 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000006s : 4: substitution.graph_param_transform 82.53% : 0.000191s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.90% : 0.000011s : 3: substitution.reduce_eliminate 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 3.47% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112419 2 97.45% : 0.109556s : 1: type_inference.infer 2.55% : 0.002863s : 1: type_inference.specialize ------[replace.] 0.000095 7 67.45% : 0.000064s : 5: replace.inline 32.55% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 7 96.48% : 0.000188s : 5: match.inline 3.52% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.23% : 0.000002s : 13: predicate.addn_zero_filter 1.79% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.79% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.36% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000008s : 28: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.74% : 0.000003s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.92% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.20% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.36% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002459 25 62.27% : 0.001531s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.28% : 0.000867s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127623 72 0.04% : 0.000051s : 1: add_recomputation 0.04% : 0.000054s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000298s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.94% : 0.007577s : 1: jit_opt_a 0.14% : 0.000181s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.41% : 0.000519s : 1: loop_unroll 0.55% : 0.000705s : 1: mutable_eliminate 0.85% : 0.001084s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000593s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000525s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.52% : 0.001946s : 1: renormalize.infer 0.71% : 0.000906s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 88.14% : 0.112493s : 1: type_inference TotalTime = 0.0672987, [30] [bootstrap]: 0.00028691 [type_inference]: 0.0560353 [event_method]: 2.078e-05 [auto_monad]: 7.312e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.00027143 [rewriter_before_opt_a]: 8.493e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.00805119, [2] [Cycle 1]: 0.0033196, [27] [switch_simplify]: 6.144e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.00059193 [with_stream_mark]: 1.984e-05 [recompute_prepare]: 9.47001e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.63999e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 6.74001e-06 [accelerated_algorithm]: 6.74999e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 6.65998e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.573e-05 [j_node_and_user_rematch]: 1.123e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.086e-05 [inline_without_move]: 6.69999e-06 [renormalize]: 0.00221434 [add_forward_monad_depend]: 6.51999e-06 [auto_monad_grad]: 2.91e-06 [auto_monad_eliminator]: 1.711e-05 [cse]: 3.094e-05 [replace_applicator]: 1.724e-05 [Cycle 2]: 0.00040168, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00013406 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.83997e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 3.11999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.782e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 6.21e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.287e-05 [replace_applicator]: 6.83e-06 [py_interpret_to_execute_after_opt_a]: 1.234e-05 [rewriter_after_opt_a]: 3.905e-05 [convert_after_rewriter]: 6.88e-06 [order_py_execute_after_rewriter]: 6.31998e-06 [mutable_eliminate]: 0.00070563 [jit_opt_b]: 5.616e-05, [1] [Cycle 1]: 4.836e-05, [2] [frontend_op_eliminate]: 1.891e-05 [inline_after_opt_a]: 1.834e-05 [cconv]: 2.604e-05 [loop_unroll]: 0.00049218 [jit_opt_after_cconv]: 0.00015139, [1] [Cycle 1]: 0.00014521, [11] [c_1]: 2.516e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 2.159e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 6.11998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.766e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 7.65e-06 [add_recomputation]: 5.028e-05 [cse_after_recomputation]: 2.497e-05, [1] [Cycle 1]: 1.813e-05, [1] [cse]: 1.201e-05 [auto_monad_reorder]: 1.561e-05 [get_jit_bprop_graph]: 1.51998e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.00052902 [symbol_engine_optimizer]: 7.903e-05, [1] [Cycle 1]: 7.272e-05, [6] [build]: 4.34997e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.393e-05 [opt_reshape]: 7.25003e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 3.30008e-07 [validate]: 4.232e-05 Sums bootstrap : 0.000287s : 0.46% type_inference : 0.056035s : 89.93% event_method : 0.000021s : 0.03% auto_monad : 0.000073s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000271s : 0.44% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000726s : 1.17% jit_opt_a.with_stream_mark : 0.000032s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002214s : 3.55% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000044s : 0.07% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000706s : 1.13% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000492s : 0.79% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000529s : 0.85% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000221 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.04% : 0.000007s : 4: substitution.graph_param_transform 82.10% : 0.000181s : 4: substitution.inline 1.84% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.95% : 0.000007s : 4: substitution.remove_not_recompute_node 2.88% : 0.000006s : 2: substitution.replace_old_param 5.60% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055952 2 96.44% : 0.053959s : 1: type_inference.infer 3.56% : 0.001992s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.00% : 0.000052s : 4: replace.inline 33.00% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 94.09% : 0.000179s : 4: match.inline 5.91% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.58% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.40% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.44% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.07% : 0.000003s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 1.00% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.96% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002314 26 74.53% : 0.001725s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.15% : 0.000559s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070545 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000077s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.42% : 0.000299s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.42% : 0.008055s : 1: jit_opt_a 0.22% : 0.000154s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.71% : 0.000500s : 1: loop_unroll 1.01% : 0.000714s : 1: mutable_eliminate 1.39% : 0.000980s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000537s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000277s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.22% : 0.001565s : 1: renormalize.infer 0.91% : 0.000639s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.12% : 0.000082s : 1: symbol_engine_optimizer 79.46% : 0.056053s : 1: type_inference TotalTime = 0.0754988, [30] [bootstrap]: 0.00033562 [type_inference]: 0.0639654 [event_method]: 2.067e-05 [auto_monad]: 7.161e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 0.00028466 [rewriter_before_opt_a]: 8.589e-05 [expand_dump_flag]: 4.02998e-06 [jit_opt_a]: 0.00811514, [2] [Cycle 1]: 0.00404994, [27] [switch_simplify]: 6.571e-05 [loop_unroll]: 3.215e-05 [a_1]: 0.0008606 [with_stream_mark]: 2.717e-05 [recompute_prepare]: 1.007e-05 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 1.72e-05 [updatestate_loads_eliminate]: 3.63e-06 [parameter_eliminate]: 2.69999e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.85002e-06 [get_grad_eliminate_]: 6.08002e-06 [merge_forward]: 4.95999e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.874e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.163e-05 [inline_without_move]: 6.54001e-06 [renormalize]: 0.002617 [add_forward_monad_depend]: 1.145e-05 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 2.237e-05 [cse]: 3.722e-05 [replace_applicator]: 2.582e-05 [Cycle 2]: 0.00040706, [27] [switch_simplify]: 7.88999e-06 [loop_unroll]: 6.09999e-06 [a_1]: 0.00012968 [with_stream_mark]: 1.711e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 4.33999e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.93998e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 2.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.944e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 3.01001e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.49998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.31e-05 [replace_applicator]: 6.40002e-06 [py_interpret_to_execute_after_opt_a]: 1.604e-05 [rewriter_after_opt_a]: 8.269e-05 [convert_after_rewriter]: 9.46e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.0007426 [jit_opt_b]: 5.923e-05, [1] [Cycle 1]: 5.059e-05, [2] [frontend_op_eliminate]: 2.061e-05 [inline_after_opt_a]: 1.792e-05 [cconv]: 3.487e-05 [loop_unroll]: 0.00046449 [jit_opt_after_cconv]: 0.00017867, [1] [Cycle 1]: 0.00017136, [11] [c_1]: 2.611e-05 [parameter_eliminate]: 5.49998e-06 [updatestate_depend_eliminate]: 8.81002e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 3.516e-05 [call_graph_tuple_transform]: 2.509e-05 [tuple_list_get_item_eliminator]: 6.89001e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.01998e-06 [remove_dup_value]: 1.795e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 9.75002e-06 [add_recomputation]: 5.642e-05 [cse_after_recomputation]: 2.433e-05, [1] [Cycle 1]: 1.899e-05, [1] [cse]: 1.319e-05 [auto_monad_reorder]: 1.638e-05 [get_jit_bprop_graph]: 2.57001e-06 [rewriter_after_jit_bprop_graph]: 8.09002e-06 [opt_after_jit_grad]: 0.00053273 [symbol_engine_optimizer]: 8.419e-05, [1] [Cycle 1]: 7.727e-05, [6] [build]: 4.32998e-06 [elim_shapecalc]: 9.42999e-06 [elim_not_effective]: 1.512e-05 [opt_reshape]: 7e-06 [fold_const_symbol]: 1.136e-05 [renormalize]: 6.90023e-07 [validate]: 5.659e-05 Sums bootstrap : 0.000336s : 0.47% type_inference : 0.063965s : 89.87% event_method : 0.000021s : 0.03% auto_monad : 0.000072s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000285s : 0.40% rewriter_before_opt_a : 0.000086s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000074s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.05% jit_opt_a.a_1 : 0.000990s : 1.39% jit_opt_a.with_stream_mark : 0.000044s : 0.06% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000020s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000022s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002617s : 3.68% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.04% jit_opt_a.cse : 0.000050s : 0.07% jit_opt_a.replace_applicator : 0.000032s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000083s : 0.12% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000743s : 1.04% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000035s : 0.05% loop_unroll : 0.000464s : 0.65% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000533s : 0.75% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.08% Time group info: ------[substitution.] 0.000279 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.65% : 0.000007s : 4: substitution.graph_param_transform 82.49% : 0.000230s : 4: substitution.inline 2.08% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.78% : 0.000008s : 4: substitution.remove_not_recompute_node 2.71% : 0.000008s : 2: substitution.replace_old_param 5.85% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063880 2 96.56% : 0.061684s : 1: type_inference.infer 3.44% : 0.002195s : 1: type_inference.specialize ------[replace.] 0.000090 6 60.11% : 0.000054s : 4: replace.inline 39.89% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 93.85% : 0.000227s : 4: match.inline 6.15% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.87% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.09% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.23% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.38% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 2.60% : 0.000004s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.80% : 0.000004s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.08% : 0.000002s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.57% : 0.000009s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.40% : 0.000002s : 12: predicate.transpose_eliminate 1.25% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.69% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.66% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002518 26 70.35% : 0.001772s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.33% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.32% : 0.000713s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.079439 72 0.07% : 0.000059s : 1: add_recomputation 0.09% : 0.000075s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.45% : 0.000359s : 1: bootstrap 0.05% : 0.000038s : 1: cconv 0.02% : 0.000012s : 1: convert_after_rewriter 0.03% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.22% : 0.008119s : 1: jit_opt_a 0.23% : 0.000182s : 1: jit_opt_after_cconv 0.08% : 0.000062s : 1: jit_opt_b 0.60% : 0.000473s : 1: loop_unroll 0.95% : 0.000756s : 1: mutable_eliminate 1.59% : 0.001261s : 26: opt.transform.jit_opt_a 0.08% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000020s : 1: opt.transform.mutable_eliminate 0.03% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000541s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000290s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.24% : 0.001779s : 1: renormalize.infer 1.04% : 0.000825s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.11% : 0.000086s : 1: rewriter_after_opt_a 0.11% : 0.000091s : 1: rewriter_before_opt_a 0.11% : 0.000087s : 1: symbol_engine_optimizer 80.55% : 0.063985s : 1: type_inference TotalTime = 0.13081, [30] [bootstrap]: 0.0003529 [type_inference]: 0.117403 [event_method]: 2.377e-05 [auto_monad]: 8.096e-05 [graph_reusing]: 6.88e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.00063138 [rewriter_before_opt_a]: 0.00010936 [expand_dump_flag]: 3.83999e-06 [jit_opt_a]: 0.00937712, [2] [Cycle 1]: 0.00479043, [27] [switch_simplify]: 7.593e-05 [loop_unroll]: 3.431e-05 [a_1]: 0.00078788 [with_stream_mark]: 2.284e-05 [recompute_prepare]: 1.121e-05 [updatestate_depend_eliminate]: 5.04e-06 [updatestate_assign_eliminate]: 3.50998e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 7.92e-06 [updatestate_useless_node_eliminater]: 6.94999e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.731e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 3.51001e-06 [replace_old_param]: 1.267e-05 [inline_without_move]: 6.89001e-06 [renormalize]: 0.00344331 [add_forward_monad_depend]: 1.028e-05 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 2.332e-05 [cse]: 3.97e-05 [replace_applicator]: 2.478e-05 [Cycle 2]: 0.0004089, [27] [switch_simplify]: 7.60998e-06 [loop_unroll]: 6.33002e-06 [a_1]: 0.00013785 [with_stream_mark]: 1.761e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 2.87002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.74e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 7.21999e-06 [cse]: 1.557e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 2.048e-05 [rewriter_after_opt_a]: 4.257e-05 [convert_after_rewriter]: 7.87e-06 [order_py_execute_after_rewriter]: 5.11997e-06 [mutable_eliminate]: 0.00081525 [jit_opt_b]: 6.869e-05, [1] [Cycle 1]: 6e-05, [2] [frontend_op_eliminate]: 2.695e-05 [inline_after_opt_a]: 1.927e-05 [cconv]: 3.366e-05 [loop_unroll]: 0.00049911 [jit_opt_after_cconv]: 0.00017712, [1] [Cycle 1]: 0.00016937, [11] [c_1]: 2.711e-05 [parameter_eliminate]: 4.45e-06 [updatestate_depend_eliminate]: 7.8e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.38998e-06 [cse]: 3.035e-05 [call_graph_tuple_transform]: 2.49e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 6.64001e-06 [remove_dup_value]: 1.982e-05 [partial_unused_args_eliminate]: 2.18998e-06 [environ_conv]: 9.67001e-06 [add_recomputation]: 5.387e-05 [cse_after_recomputation]: 2.541e-05, [1] [Cycle 1]: 2.006e-05, [1] [cse]: 1.285e-05 [auto_monad_reorder]: 1.823e-05 [get_jit_bprop_graph]: 3.08998e-06 [rewriter_after_jit_bprop_graph]: 7.05e-06 [opt_after_jit_grad]: 0.00053733 [symbol_engine_optimizer]: 8.853e-05, [1] [Cycle 1]: 8.167e-05, [6] [build]: 4.75001e-06 [elim_shapecalc]: 1.177e-05 [elim_not_effective]: 1.652e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 1.342e-05 [renormalize]: 4.59986e-07 [validate]: 0.00016807 Sums bootstrap : 0.000353s : 0.28% type_inference : 0.117403s : 93.21% event_method : 0.000024s : 0.02% auto_monad : 0.000081s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000631s : 0.50% rewriter_before_opt_a : 0.000109s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000926s : 0.73% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003443s : 2.73% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000815s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000499s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000537s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000168s : 0.13% Time group info: ------[substitution.] 0.000340 28 1.19% : 0.000004s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000007s : 4: substitution.graph_param_transform 83.30% : 0.000283s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.61% : 0.000016s : 3: substitution.reduce_eliminate 1.55% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000008s : 2: substitution.replace_old_param 3.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117299 2 97.26% : 0.114090s : 1: type_inference.infer 2.74% : 0.003208s : 1: type_inference.specialize ------[replace.] 0.000117 7 69.55% : 0.000081s : 5: replace.inline 30.45% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000290 7 96.30% : 0.000280s : 5: match.inline 3.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.35% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.25% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.09% : 0.000002s : 13: predicate.environ_get_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.49% : 0.000001s : 4: predicate.graph_param_transform 5.90% : 0.000009s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.82% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 2.51% : 0.000004s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 1.84% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 1.18% : 0.000002s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 20: predicate.switch_defer_inline 1.86% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.26% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.77% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.30% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000003s : 13: predicate.value_based_eliminate 0.82% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002548 25 63.50% : 0.001618s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.52% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.98% : 0.000840s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135427 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000085s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.28% : 0.000374s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.93% : 0.009381s : 1: jit_opt_a 0.13% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000071s : 1: jit_opt_b 0.38% : 0.000508s : 1: loop_unroll 0.61% : 0.000827s : 1: mutable_eliminate 0.89% : 0.001204s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000548s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000639s : 1: py_interpret_to_execute 0.02% : 0.000024s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.65% : 0.002238s : 1: renormalize.infer 0.88% : 0.001194s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000115s : 1: rewriter_before_opt_a 0.07% : 0.000092s : 1: symbol_engine_optimizer 86.71% : 0.117426s : 1: type_inference TotalTime = 0.0166381, [30] [bootstrap]: 0.00031638 [type_inference]: 0.00815852 [event_method]: 2.166e-05 [auto_monad]: 7.017e-05 [graph_reusing]: 6.16998e-06 [pre_auto_parallel]: 2.81e-06 [py_interpret_to_execute]: 4.669e-05 [rewriter_before_opt_a]: 8.136e-05 [expand_dump_flag]: 2.77002e-06 [jit_opt_a]: 0.00578791, [2] [Cycle 1]: 0.00192933, [27] [switch_simplify]: 5.879e-05 [loop_unroll]: 3.346e-05 [a_1]: 0.00072566 [with_stream_mark]: 1.888e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.54999e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 0.00075347 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 2.53003e-06 [auto_monad_eliminator]: 1.405e-05 [cse]: 3.374e-05 [replace_applicator]: 1.171e-05 [Cycle 2]: 0.00032522, [27] [switch_simplify]: 5.93002e-06 [loop_unroll]: 4.85999e-06 [a_1]: 9.737e-05 [with_stream_mark]: 9.37999e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.09003e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.084e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 7.05002e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.237e-05 [replace_applicator]: 5.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.216e-05 [rewriter_after_opt_a]: 3.767e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 4.70999e-06 [mutable_eliminate]: 0.00057389 [jit_opt_b]: 4.99e-05, [1] [Cycle 1]: 4.258e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.573e-05 [cconv]: 2.627e-05 [loop_unroll]: 0.00042199 [jit_opt_after_cconv]: 0.00015841, [1] [Cycle 1]: 0.0001517, [11] [c_1]: 2.178e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 1.656e-05 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.73e-06 [cse]: 2.261e-05 [call_graph_tuple_transform]: 1.906e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.709e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 5.70001e-06 [add_recomputation]: 4.812e-05 [cse_after_recomputation]: 2.253e-05, [1] [Cycle 1]: 1.733e-05, [1] [cse]: 1.147e-05 [auto_monad_reorder]: 1.675e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.0004615 [symbol_engine_optimizer]: 7.288e-05, [1] [Cycle 1]: 6.633e-05, [6] [build]: 3.58999e-06 [elim_shapecalc]: 8.12003e-06 [elim_not_effective]: 1.256e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 2.89991e-07 [validate]: 3.483e-05 Sums bootstrap : 0.000316s : 2.53% type_inference : 0.008159s : 65.11% event_method : 0.000022s : 0.17% auto_monad : 0.000070s : 0.56% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000047s : 0.37% rewriter_before_opt_a : 0.000081s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.52% jit_opt_a.loop_unroll : 0.000038s : 0.31% jit_opt_a.a_1 : 0.000823s : 6.57% jit_opt_a.with_stream_mark : 0.000028s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000754s : 6.01% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000046s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.13% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000038s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000574s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000422s : 3.37% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000017s : 0.13% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.38% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000461s : 3.68% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.28% Time group info: ------[substitution.] 0.000306 27 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 1.70% : 0.000005s : 3: substitution.graph_param_transform 86.33% : 0.000264s : 5: substitution.inline 0.92% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.63% : 0.000011s : 3: substitution.reduce_eliminate 1.42% : 0.000004s : 4: substitution.remove_not_recompute_node 1.48% : 0.000005s : 2: substitution.replace_old_param 3.40% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008091 2 84.70% : 0.006853s : 1: type_inference.infer 15.30% : 0.001238s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.89% : 0.000063s : 5: replace.inline 32.11% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000271 7 96.54% : 0.000261s : 5: match.inline 3.46% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 11: predicate.addn_check_dump 1.53% : 0.000002s : 11: predicate.addn_zero_filter 2.04% : 0.000003s : 11: predicate.arithmetic_simplify 1.32% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.13% : 0.000001s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.55% : 0.000001s : 3: predicate.graph_param_transform 5.71% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.62% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000001s : 11: predicate.print_const_string_wrapper 2.24% : 0.000003s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.56% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.70% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.45% : 0.000009s : 59: predicate.switch_simplify 1.30% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000994 16 38.32% : 0.000381s : 7: func_graph_cloner_run.FuncGraphClonerGraph 12.14% : 0.000121s : 2: func_graph_cloner_run.FuncGraphClonerNode 49.53% : 0.000492s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018499 72 0.28% : 0.000051s : 1: add_recomputation 0.40% : 0.000074s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.79% : 0.000331s : 1: bootstrap 0.16% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 31.30% : 0.005791s : 1: jit_opt_a 0.87% : 0.000161s : 1: jit_opt_after_cconv 0.28% : 0.000052s : 1: jit_opt_b 2.32% : 0.000429s : 1: loop_unroll 3.15% : 0.000582s : 1: mutable_eliminate 5.63% : 0.001042s : 26: opt.transform.jit_opt_a 0.26% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.54% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.27% : 0.000049s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.31% : 0.000427s : 1: renormalize.infer 1.73% : 0.000319s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000041s : 1: rewriter_after_opt_a 0.46% : 0.000085s : 1: rewriter_before_opt_a 0.41% : 0.000075s : 1: symbol_engine_optimizer 44.18% : 0.008174s : 1: type_inference TotalTime = 0.16236, [30] [bootstrap]: 0.00031626 [type_inference]: 0.15135 [event_method]: 2.129e-05 [auto_monad]: 7.396e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 2.94999e-06 [py_interpret_to_execute]: 0.00043196 [rewriter_before_opt_a]: 9.831e-05 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00766947, [2] [Cycle 1]: 0.00398689, [27] [switch_simplify]: 6.727e-05 [loop_unroll]: 3.454e-05 [a_1]: 0.00070434 [with_stream_mark]: 2.288e-05 [recompute_prepare]: 9.72999e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.94001e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 4.83001e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.684e-05 [j_node_and_user_rematch]: 1.106e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.146e-05 [inline_without_move]: 6.61e-06 [renormalize]: 0.00272468 [add_forward_monad_depend]: 7.46999e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 2.038e-05 [cse]: 4.036e-05 [replace_applicator]: 1.858e-05 [Cycle 2]: 0.00040441, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 1.995e-05 [a_1]: 0.00012127 [with_stream_mark]: 1.203e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.28998e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.45997e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.719e-05 [j_node_and_user_rematch]: 9.51998e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 6.06e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 8e-06 [cse]: 1.765e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.599e-05 [rewriter_after_opt_a]: 4.149e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00069144 [jit_opt_b]: 5.975e-05, [1] [Cycle 1]: 5.349e-05, [2] [frontend_op_eliminate]: 2.304e-05 [inline_after_opt_a]: 1.884e-05 [cconv]: 2.477e-05 [loop_unroll]: 0.00042746 [jit_opt_after_cconv]: 0.00015669, [1] [Cycle 1]: 0.00015016, [11] [c_1]: 2.547e-05 [parameter_eliminate]: 1.79e-06 [updatestate_depend_eliminate]: 5.07999e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.617e-05 [call_graph_tuple_transform]: 2.207e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.685e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 9.84999e-06 [add_recomputation]: 5.241e-05 [cse_after_recomputation]: 2.594e-05, [1] [Cycle 1]: 1.964e-05, [1] [cse]: 1.352e-05 [auto_monad_reorder]: 1.898e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.97e-06 [opt_after_jit_grad]: 0.00043896 [symbol_engine_optimizer]: 8.247e-05, [1] [Cycle 1]: 7.611e-05, [6] [build]: 4.42e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.788e-05 [opt_reshape]: 6.63e-06 [fold_const_symbol]: 9.90002e-06 [renormalize]: 7.39994e-07 [validate]: 0.00011895 Sums bootstrap : 0.000316s : 0.20% type_inference : 0.151350s : 95.53% event_method : 0.000021s : 0.01% auto_monad : 0.000074s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000432s : 0.27% rewriter_before_opt_a : 0.000098s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.05% jit_opt_a.loop_unroll : 0.000054s : 0.03% jit_opt_a.a_1 : 0.000826s : 0.52% jit_opt_a.with_stream_mark : 0.000035s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002725s : 1.72% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000691s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000427s : 0.27% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.03% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000439s : 0.28% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000119s : 0.08% Time group info: ------[substitution.] 0.000287 25 1.68% : 0.000005s : 2: substitution.elim_not_effective 0.53% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 85.86% : 0.000247s : 5: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000006s : 2: substitution.replace_old_param 4.41% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.151252 2 98.14% : 0.148438s : 1: type_inference.infer 1.86% : 0.002814s : 1: type_inference.specialize ------[replace.] 0.000100 7 70.14% : 0.000070s : 5: replace.inline 29.86% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.51% : 0.000244s : 5: match.inline 4.49% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 0.79% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.71% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.91% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000001s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 1.87% : 0.000003s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.61% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000010s : 64: predicate.switch_simplify 1.48% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002447 25 66.92% : 0.001638s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.16% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.92% : 0.000732s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.166184 72 0.03% : 0.000056s : 1: add_recomputation 0.05% : 0.000078s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.20% : 0.000332s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 4.62% : 0.007673s : 1: jit_opt_a 0.10% : 0.000159s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.26% : 0.000434s : 1: loop_unroll 0.42% : 0.000699s : 1: mutable_eliminate 0.66% : 0.001101s : 26: opt.transform.jit_opt_a 0.03% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000446s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000437s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.16% : 0.001931s : 1: renormalize.infer 0.47% : 0.000784s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.06% : 0.000103s : 1: rewriter_before_opt_a 0.05% : 0.000085s : 1: symbol_engine_optimizer 91.08% : 0.151366s : 1: type_inference TotalTime = 0.135379, [30] [bootstrap]: 0.00033182 [type_inference]: 0.124168 [event_method]: 2.254e-05 [auto_monad]: 7.322e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.00046807 [rewriter_before_opt_a]: 9.535e-05 [expand_dump_flag]: 4.06001e-06 [jit_opt_a]: 0.00774503, [2] [Cycle 1]: 0.00387477, [27] [switch_simplify]: 6.243e-05 [loop_unroll]: 3.138e-05 [a_1]: 0.00067052 [with_stream_mark]: 2.221e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 4.72998e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 2.08998e-06 [specialize_transform]: 7.55998e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 6.34999e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00270945 [add_forward_monad_depend]: 7.45e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.877e-05 [cse]: 3.211e-05 [replace_applicator]: 2.201e-05 [Cycle 2]: 0.00038153, [27] [switch_simplify]: 6.41998e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00012353 [with_stream_mark]: 1.47e-05 [recompute_prepare]: 6.29999e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 5.46002e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 2.60002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 5.64998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.51999e-06 [cse]: 1.21e-05 [replace_applicator]: 5.84999e-06 [py_interpret_to_execute_after_opt_a]: 1.243e-05 [rewriter_after_opt_a]: 3.722e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.65001e-06 [mutable_eliminate]: 0.00074891 [jit_opt_b]: 5.548e-05, [1] [Cycle 1]: 4.731e-05, [2] [frontend_op_eliminate]: 1.898e-05 [inline_after_opt_a]: 1.778e-05 [cconv]: 2.604e-05 [loop_unroll]: 0.00043179 [jit_opt_after_cconv]: 0.00015581, [1] [Cycle 1]: 0.00014929, [11] [c_1]: 2.481e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 5.54998e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.549e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 6.03002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.693e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 8.40001e-06 [add_recomputation]: 5.097e-05 [cse_after_recomputation]: 2.329e-05, [1] [Cycle 1]: 1.766e-05, [1] [cse]: 1.203e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00047517 [symbol_engine_optimizer]: 7.906e-05, [1] [Cycle 1]: 7.287e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.489e-05 [opt_reshape]: 6.71e-06 [fold_const_symbol]: 9.56998e-06 [renormalize]: 5.39992e-07 [validate]: 0.00011576 Sums bootstrap : 0.000332s : 0.25% type_inference : 0.124168s : 94.59% event_method : 0.000023s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000468s : 0.36% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000794s : 0.60% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002710s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000749s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000432s : 0.33% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000475s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000116s : 0.09% Time group info: ------[substitution.] 0.000296 24 1.25% : 0.000004s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 4: substitution.graph_param_transform 85.97% : 0.000254s : 4: substitution.inline 1.41% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000006s : 2: substitution.replace_old_param 4.93% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124079 2 97.66% : 0.121180s : 1: type_inference.infer 2.34% : 0.002899s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.57% : 0.000055s : 4: replace.inline 32.43% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000266 6 94.96% : 0.000252s : 4: match.inline 5.04% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.54% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.08% : 0.000001s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.56% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.95% : 0.000003s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 1.00% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.58% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.57% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000009s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.57% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002374 22 67.52% : 0.001603s : 15: func_graph_cloner_run.FuncGraphClonerGraph 3.58% : 0.000085s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.90% : 0.000686s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139127 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000349s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.57% : 0.007749s : 1: jit_opt_a 0.11% : 0.000159s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.32% : 0.000440s : 1: loop_unroll 0.55% : 0.000759s : 1: mutable_eliminate 0.75% : 0.001044s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.39% : 0.001941s : 1: renormalize.infer 0.55% : 0.000759s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 89.26% : 0.124186s : 1: type_inference TotalTime = 0.14893, [30] [bootstrap]: 0.00035851 [type_inference]: 0.135761 [event_method]: 2.387e-05 [auto_monad]: 7.314e-05 [graph_reusing]: 6.56999e-06 [pre_auto_parallel]: 2.25002e-06 [py_interpret_to_execute]: 0.00051866 [rewriter_before_opt_a]: 9.64e-05 [expand_dump_flag]: 3.17002e-06 [jit_opt_a]: 0.00869398, [2] [Cycle 1]: 0.00403775, [27] [switch_simplify]: 5.582e-05 [loop_unroll]: 3.361e-05 [a_1]: 0.00065192 [with_stream_mark]: 1.369e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 7.13e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 7.90023e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.232e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 9.79999e-06 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00296535 [add_forward_monad_depend]: 6.42001e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 1.278e-05 [cse]: 2.375e-05 [replace_applicator]: 1.283e-05 [Cycle 2]: 0.00039409, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 6.37001e-06 [a_1]: 0.00013081 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 3.15002e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 1.46998e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 2.23998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.205e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.334e-05 [replace_applicator]: 2.158e-05 [py_interpret_to_execute_after_opt_a]: 1.255e-05 [rewriter_after_opt_a]: 3.825e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.04998e-06 [mutable_eliminate]: 0.00156537 [jit_opt_b]: 6.124e-05, [1] [Cycle 1]: 5.405e-05, [2] [frontend_op_eliminate]: 2.083e-05 [inline_after_opt_a]: 2.039e-05 [cconv]: 2.974e-05 [loop_unroll]: 0.00047771 [jit_opt_after_cconv]: 0.00018232, [1] [Cycle 1]: 0.00017564, [11] [c_1]: 2.793e-05 [parameter_eliminate]: 3.8e-06 [updatestate_depend_eliminate]: 7.18e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 3.54e-05 [call_graph_tuple_transform]: 2.558e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.71e-06 [remove_dup_value]: 1.688e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 9.69e-06 [add_recomputation]: 4.922e-05 [cse_after_recomputation]: 2.719e-05, [1] [Cycle 1]: 2.178e-05, [1] [cse]: 1.47e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 7.26001e-06 [opt_after_jit_grad]: 0.00053102 [symbol_engine_optimizer]: 8.339e-05, [1] [Cycle 1]: 7.698e-05, [6] [build]: 4.42e-06 [elim_shapecalc]: 9.61998e-06 [elim_not_effective]: 1.484e-05 [opt_reshape]: 6.91001e-06 [fold_const_symbol]: 1.113e-05 [renormalize]: 4.00003e-07 [validate]: 7.745e-05 Sums bootstrap : 0.000359s : 0.25% type_inference : 0.135761s : 94.23% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000519s : 0.36% rewriter_before_opt_a : 0.000096s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.04% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000783s : 0.54% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002965s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.01% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001565s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000478s : 0.33% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000531s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000077s : 0.05% Time group info: ------[substitution.] 0.000234 28 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 4: substitution.graph_param_transform 82.97% : 0.000194s : 5: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.51% : 0.000011s : 3: substitution.reduce_eliminate 1.79% : 0.000004s : 4: substitution.remove_not_recompute_node 1.94% : 0.000005s : 2: substitution.replace_old_param 3.23% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.135681 2 97.79% : 0.132681s : 1: type_inference.infer 2.21% : 0.003000s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.01% : 0.000066s : 5: replace.inline 31.99% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 7 96.72% : 0.000191s : 5: match.inline 3.28% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 2.37% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.51% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.37% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 4.91% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 2.84% : 0.000004s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 19: predicate.partial_eliminate 1.35% : 0.000002s : 13: predicate.print_const_string_wrapper 1.86% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.66% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.69% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.86% : 0.000010s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.44% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.10% : 0.000004s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002562 25 63.03% : 0.001615s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.89% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.08% : 0.000873s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.152994 72 0.03% : 0.000053s : 1: add_recomputation 0.05% : 0.000077s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000373s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.68% : 0.008697s : 1: jit_opt_a 0.12% : 0.000186s : 1: jit_opt_after_cconv 0.04% : 0.000064s : 1: jit_opt_b 0.32% : 0.000487s : 1: loop_unroll 1.03% : 0.001576s : 1: mutable_eliminate 0.68% : 0.001035s : 26: opt.transform.jit_opt_a 0.04% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000539s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000525s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.36% : 0.002080s : 1: renormalize.infer 0.57% : 0.000878s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 88.75% : 0.135782s : 1: type_inference TotalTime = 0.123594, [30] [bootstrap]: 0.0002981 [type_inference]: 0.111925 [event_method]: 2.064e-05 [auto_monad]: 7.68e-05 [graph_reusing]: 6.44001e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00044025 [rewriter_before_opt_a]: 9.34e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00810627, [2] [Cycle 1]: 0.00399767, [27] [switch_simplify]: 6.936e-05 [loop_unroll]: 3.375e-05 [a_1]: 0.00071674 [with_stream_mark]: 1.976e-05 [recompute_prepare]: 1.012e-05 [updatestate_depend_eliminate]: 4.39998e-06 [updatestate_assign_eliminate]: 4.15999e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 6.03002e-06 [accelerated_algorithm]: 6.38998e-06 [meta_shard_fg_expand]: 2.76e-06 [get_grad_eliminate_]: 6.52001e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.675e-05 [j_node_and_user_rematch]: 1.086e-05 [meta_fg_expand]: 2.73998e-06 [replace_old_param]: 9.60001e-06 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00276825 [add_forward_monad_depend]: 9.09e-06 [auto_monad_grad]: 2.52001e-06 [auto_monad_eliminator]: 1.912e-05 [cse]: 3.57e-05 [replace_applicator]: 2.404e-05 [Cycle 2]: 0.00039569, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 6.71999e-06 [a_1]: 0.00012403 [with_stream_mark]: 1.567e-05 [recompute_prepare]: 6.44999e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 2.22999e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 2.88998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.818e-05 [j_node_and_user_rematch]: 9.83002e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.61e-06 [cse]: 1.604e-05 [replace_applicator]: 6.10002e-06 [py_interpret_to_execute_after_opt_a]: 1.528e-05 [rewriter_after_opt_a]: 4.105e-05 [convert_after_rewriter]: 7.56999e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00067679 [jit_opt_b]: 6.084e-05, [1] [Cycle 1]: 5.122e-05, [2] [frontend_op_eliminate]: 1.862e-05 [inline_after_opt_a]: 1.884e-05 [cconv]: 2.695e-05 [loop_unroll]: 0.00044606 [jit_opt_after_cconv]: 0.00017234, [1] [Cycle 1]: 0.00016468, [11] [c_1]: 2.546e-05 [parameter_eliminate]: 3.26999e-06 [updatestate_depend_eliminate]: 6.42001e-06 [updatestate_assign_eliminate]: 4.44002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 3.402e-05 [call_graph_tuple_transform]: 2.271e-05 [tuple_list_get_item_eliminator]: 6.38e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 4.82e-05 [partial_unused_args_eliminate]: 2.89001e-06 [environ_conv]: 1.103e-05 [add_recomputation]: 5.926e-05 [cse_after_recomputation]: 3.119e-05, [1] [Cycle 1]: 2.38e-05, [1] [cse]: 1.667e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.34998e-06 [opt_after_jit_grad]: 0.00054076 [symbol_engine_optimizer]: 8.863e-05, [1] [Cycle 1]: 8.151e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 9.39e-06 [elim_not_effective]: 1.741e-05 [opt_reshape]: 6.64001e-06 [fold_const_symbol]: 1.261e-05 [renormalize]: 1.15001e-06 [validate]: 0.00017151 Sums bootstrap : 0.000298s : 0.25% type_inference : 0.111925s : 93.86% event_method : 0.000021s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000440s : 0.37% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000841s : 0.71% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002768s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000052s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000677s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000446s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000048s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000059s : 0.05% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000541s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000172s : 0.14% Time group info: ------[substitution.] 0.000287 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 4: substitution.graph_param_transform 85.79% : 0.000246s : 5: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 1.79% : 0.000005s : 2: substitution.replace_old_param 5.37% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111847 2 97.48% : 0.109026s : 1: type_inference.infer 2.52% : 0.002821s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.21% : 0.000072s : 5: replace.inline 31.79% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000258 7 94.51% : 0.000243s : 5: match.inline 5.49% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.57% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.61% : 0.000002s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.11% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.40% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 28: predicate.inline 1.05% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.80% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 1.53% : 0.000002s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.67% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002472 25 66.82% : 0.001652s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.07% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.11% : 0.000744s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127427 72 0.05% : 0.000062s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.25% : 0.000315s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.36% : 0.008109s : 1: jit_opt_a 0.14% : 0.000175s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.36% : 0.000455s : 1: loop_unroll 0.54% : 0.000687s : 1: mutable_eliminate 0.87% : 0.001109s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000445s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000052s : 1: remove_dup_value 1.54% : 0.001961s : 1: renormalize.infer 0.62% : 0.000796s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.07% : 0.000092s : 1: symbol_engine_optimizer 87.85% : 0.111939s : 1: type_inference TotalTime = 0.123218, [30] [bootstrap]: 0.00028147 [type_inference]: 0.111193 [event_method]: 2.043e-05 [auto_monad]: 7.567e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.18002e-06 [py_interpret_to_execute]: 0.0005032 [rewriter_before_opt_a]: 9.502e-05 [expand_dump_flag]: 3.76001e-06 [jit_opt_a]: 0.0084852, [2] [Cycle 1]: 0.00426146, [27] [switch_simplify]: 6.074e-05 [loop_unroll]: 3.192e-05 [a_1]: 0.00062164 [with_stream_mark]: 2.204e-05 [recompute_prepare]: 9.36e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 7.17997e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 4.43999e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.66e-05 [j_node_and_user_rematch]: 1.213e-05 [meta_fg_expand]: 3.25e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 6.24999e-06 [renormalize]: 0.00314364 [add_forward_monad_depend]: 8.23999e-06 [auto_monad_grad]: 2.94001e-06 [auto_monad_eliminator]: 1.956e-05 [cse]: 3.408e-05 [replace_applicator]: 2.246e-05 [Cycle 2]: 0.00038528, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 6.82002e-06 [a_1]: 0.00012656 [with_stream_mark]: 1.408e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 2.55002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.823e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.48002e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.174e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.361e-05 [rewriter_after_opt_a]: 3.721e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 5.89999e-06 [mutable_eliminate]: 0.00080271 [jit_opt_b]: 5.753e-05, [1] [Cycle 1]: 4.947e-05, [2] [frontend_op_eliminate]: 1.917e-05 [inline_after_opt_a]: 1.92e-05 [cconv]: 2.943e-05 [loop_unroll]: 0.00044436 [jit_opt_after_cconv]: 0.00015841, [1] [Cycle 1]: 0.00015198, [11] [c_1]: 2.729e-05 [parameter_eliminate]: 3.16999e-06 [updatestate_depend_eliminate]: 6.61999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 2.388e-05 [call_graph_tuple_transform]: 2.128e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.619e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 9.41e-06 [add_recomputation]: 5.158e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.777e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.575e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 6.28e-06 [opt_after_jit_grad]: 0.00046729 [symbol_engine_optimizer]: 8.036e-05, [1] [Cycle 1]: 7.419e-05, [6] [build]: 4.41002e-06 [elim_shapecalc]: 9.49e-06 [elim_not_effective]: 1.445e-05 [opt_reshape]: 6.74001e-06 [fold_const_symbol]: 1.024e-05 [renormalize]: 3.69997e-07 [validate]: 0.00014096 Sums bootstrap : 0.000281s : 0.24% type_inference : 0.111193s : 93.62% event_method : 0.000020s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000503s : 0.42% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000748s : 0.63% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003144s : 2.65% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000803s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000444s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000467s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000141s : 0.12% Time group info: ------[substitution.] 0.000247 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 1.01% : 0.000003s : 2: substitution.fold_const_symbol 2.50% : 0.000006s : 4: substitution.graph_param_transform 84.09% : 0.000208s : 4: substitution.inline 2.29% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 5.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111112 2 97.41% : 0.108235s : 1: type_inference.infer 2.59% : 0.002877s : 1: type_inference.specialize ------[replace.] 0.000080 6 66.56% : 0.000053s : 4: replace.inline 33.44% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.62% : 0.000205s : 4: match.inline 5.38% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.60% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000002s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000001s : 12: predicate.depend_value_elim 1.27% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.84% : 0.000008s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.67% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.34% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002340 22 65.42% : 0.001531s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.25% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.33% : 0.000756s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127337 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000298s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.67% : 0.008488s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000453s : 1: loop_unroll 0.64% : 0.000813s : 1: mutable_eliminate 0.79% : 0.001003s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000510s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.76% : 0.002245s : 1: renormalize.infer 0.70% : 0.000886s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 87.33% : 0.111208s : 1: type_inference TotalTime = 0.142583, [30] [bootstrap]: 0.00031326 [type_inference]: 0.131081 [event_method]: 2.125e-05 [auto_monad]: 7.07e-05 [graph_reusing]: 5.07999e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 0.00057718 [rewriter_before_opt_a]: 9.692e-05 [expand_dump_flag]: 4.1e-06 [jit_opt_a]: 0.00806181, [2] [Cycle 1]: 0.00404611, [27] [switch_simplify]: 5.763e-05 [loop_unroll]: 3.373e-05 [a_1]: 0.00071261 [with_stream_mark]: 1.498e-05 [recompute_prepare]: 8.95999e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 2.55997e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00287929 [add_forward_monad_depend]: 7.73001e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.626e-05 [cse]: 2.925e-05 [replace_applicator]: 1.758e-05 [Cycle 2]: 0.00038286, [27] [switch_simplify]: 6.91999e-06 [loop_unroll]: 6.36998e-06 [a_1]: 0.00013264 [with_stream_mark]: 1.2e-05 [recompute_prepare]: 6.28e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.88997e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 3.33998e-06 [cell_reuse_recompute_pass]: 2.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 1.93997e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.441e-05 [replace_applicator]: 6.07001e-06 [py_interpret_to_execute_after_opt_a]: 1.501e-05 [rewriter_after_opt_a]: 3.937e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00070523 [jit_opt_b]: 5.711e-05, [1] [Cycle 1]: 4.987e-05, [2] [frontend_op_eliminate]: 1.989e-05 [inline_after_opt_a]: 1.868e-05 [cconv]: 2.49e-05 [loop_unroll]: 0.0004388 [jit_opt_after_cconv]: 0.00015472, [1] [Cycle 1]: 0.0001478, [11] [c_1]: 2.586e-05 [parameter_eliminate]: 2.63003e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 2.41e-05 [call_graph_tuple_transform]: 2.217e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.64001e-06 [remove_dup_value]: 1.726e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 7.85998e-06 [add_recomputation]: 4.634e-05 [cse_after_recomputation]: 2.396e-05, [1] [Cycle 1]: 1.864e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.594e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 6.02999e-06 [opt_after_jit_grad]: 0.00047981 [symbol_engine_optimizer]: 8.297e-05, [1] [Cycle 1]: 7.591e-05, [6] [build]: 3.69002e-06 [elim_shapecalc]: 8.95001e-06 [elim_not_effective]: 1.426e-05 [opt_reshape]: 7.78999e-06 [fold_const_symbol]: 1.065e-05 [renormalize]: 4.30009e-07 [validate]: 4.537e-05 Sums bootstrap : 0.000313s : 0.23% type_inference : 0.131081s : 94.74% event_method : 0.000021s : 0.02% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000577s : 0.42% rewriter_before_opt_a : 0.000097s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000845s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002879s : 2.08% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000705s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000439s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000480s : 0.35% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.03% Time group info: ------[substitution.] 0.000281 28 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000002s : 2: substitution.fold_const_symbol 2.35% : 0.000007s : 4: substitution.graph_param_transform 83.63% : 0.000235s : 5: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.99% : 0.000011s : 3: substitution.reduce_eliminate 1.56% : 0.000004s : 4: substitution.remove_not_recompute_node 2.05% : 0.000006s : 2: substitution.replace_old_param 3.63% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131007 2 97.60% : 0.127859s : 1: type_inference.infer 2.40% : 0.003148s : 1: type_inference.specialize ------[replace.] 0.000104 7 68.27% : 0.000071s : 5: replace.inline 31.73% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 7 96.21% : 0.000232s : 5: match.inline 3.79% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.71% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.33% : 0.000003s : 13: predicate.reduce_eliminate 1.52% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.64% : 0.000004s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.19% : 0.000010s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.54% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002469 25 62.27% : 0.001537s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.12% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.61% : 0.000854s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.146626 72 0.03% : 0.000050s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.22% : 0.000326s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.50% : 0.008065s : 1: jit_opt_a 0.11% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000060s : 1: jit_opt_b 0.30% : 0.000447s : 1: loop_unroll 0.49% : 0.000714s : 1: mutable_eliminate 0.74% : 0.001088s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000488s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000585s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.34% : 0.001966s : 1: renormalize.infer 0.62% : 0.000903s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 89.41% : 0.131096s : 1: type_inference TotalTime = 0.0156562, [30] [bootstrap]: 0.00028947 [type_inference]: 0.00673861 [event_method]: 1.841e-05 [auto_monad]: 6.611e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 3.86e-05 [rewriter_before_opt_a]: 7.357e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00599159, [2] [Cycle 1]: 0.00179982, [27] [switch_simplify]: 6.231e-05 [loop_unroll]: 2.907e-05 [a_1]: 0.00056695 [with_stream_mark]: 2.109e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.99999e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 0.0007915 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.492e-05 [cse]: 3.093e-05 [replace_applicator]: 1.103e-05 [Cycle 2]: 0.00031865, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 4.97999e-06 [a_1]: 9.182e-05 [with_stream_mark]: 1.016e-05 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 4.87998e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 4.70999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 8.18001e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 4.92e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.088e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.171e-05 [rewriter_after_opt_a]: 3.717e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00056029 [jit_opt_b]: 6.061e-05, [1] [Cycle 1]: 5.392e-05, [2] [frontend_op_eliminate]: 2.575e-05 [inline_after_opt_a]: 1.601e-05 [cconv]: 6.874e-05 [loop_unroll]: 0.00043528 [jit_opt_after_cconv]: 0.00014123, [1] [Cycle 1]: 0.00013468, [11] [c_1]: 2.087e-05 [parameter_eliminate]: 2.99001e-06 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 1.878e-05 [call_graph_tuple_transform]: 1.971e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.73997e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.46998e-06 [environ_conv]: 6.06998e-06 [add_recomputation]: 4.959e-05 [cse_after_recomputation]: 2.024e-05, [1] [Cycle 1]: 1.514e-05, [1] [cse]: 9.74e-06 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 6.11e-06 [opt_after_jit_grad]: 0.00046144 [symbol_engine_optimizer]: 0.00010376, [1] [Cycle 1]: 9.35e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 1.336e-05 [elim_not_effective]: 1.495e-05 [opt_reshape]: 5.74999e-06 [fold_const_symbol]: 8.38999e-06 [renormalize]: 3.39991e-07 [validate]: 4.106e-05 Sums bootstrap : 0.000289s : 2.64% type_inference : 0.006739s : 61.36% event_method : 0.000018s : 0.17% auto_monad : 0.000066s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.35% rewriter_before_opt_a : 0.000074s : 0.67% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.62% jit_opt_a.loop_unroll : 0.000034s : 0.31% jit_opt_a.a_1 : 0.000659s : 6.00% jit_opt_a.with_stream_mark : 0.000031s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000792s : 7.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.19% jit_opt_a.cse : 0.000042s : 0.38% jit_opt_a.replace_applicator : 0.000016s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000037s : 0.34% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000560s : 5.10% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.23% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000069s : 0.63% loop_unroll : 0.000435s : 3.96% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.18% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000050s : 0.45% cse_after_recomputation.cse : 0.000010s : 0.09% auto_monad_reorder : 0.000015s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000461s : 4.20% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.12% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.37% Time group info: ------[substitution.] 0.000234 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 3: substitution.graph_param_transform 84.43% : 0.000198s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000006s : 4: substitution.remove_not_recompute_node 2.21% : 0.000005s : 2: substitution.replace_old_param 5.41% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006667 2 86.85% : 0.005790s : 1: type_inference.infer 13.15% : 0.000877s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.82% : 0.000049s : 4: replace.inline 32.18% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 94.40% : 0.000195s : 4: match.inline 5.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.75% : 0.000002s : 10: predicate.accumulaten_eliminater 1.50% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.98% : 0.000001s : 3: predicate.elim_not_effective 1.22% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.76% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.88% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.94% : 0.000002s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000713 13 54.07% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.68% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 39.25% : 0.000280s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017199 72 0.31% : 0.000053s : 1: add_recomputation 0.40% : 0.000070s : 1: auto_monad 0.10% : 0.000018s : 1: auto_monad_reorder 1.80% : 0.000310s : 1: bootstrap 0.42% : 0.000072s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 34.86% : 0.005996s : 1: jit_opt_a 0.84% : 0.000144s : 1: jit_opt_after_cconv 0.37% : 0.000063s : 1: jit_opt_b 2.58% : 0.000444s : 1: loop_unroll 3.31% : 0.000569s : 1: mutable_eliminate 5.10% : 0.000877s : 26: opt.transform.jit_opt_a 0.28% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.21% : 0.000035s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000470s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000041s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.56% : 0.000441s : 1: renormalize.infer 2.00% : 0.000343s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000040s : 1: rewriter_after_opt_a 0.44% : 0.000077s : 1: rewriter_before_opt_a 0.63% : 0.000108s : 1: symbol_engine_optimizer 39.28% : 0.006755s : 1: type_inference TotalTime = 0.0345057, [30] [bootstrap]: 0.00031265 [type_inference]: 0.0258802 [event_method]: 2.156e-05 [auto_monad]: 7.312e-05 [graph_reusing]: 5.62999e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 5.184e-05 [rewriter_before_opt_a]: 8.762e-05 [expand_dump_flag]: 2.79001e-06 [jit_opt_a]: 0.005881, [2] [Cycle 1]: 0.0018857, [27] [switch_simplify]: 5.994e-05 [loop_unroll]: 3.316e-05 [a_1]: 0.00065848 [with_stream_mark]: 1.764e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 5.21998e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.414e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 5.71e-06 [renormalize]: 0.00077783 [add_forward_monad_depend]: 5.24e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.449e-05 [cse]: 3.489e-05 [replace_applicator]: 1.234e-05 [Cycle 2]: 0.00032431, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 4.81002e-06 [a_1]: 9.676e-05 [with_stream_mark]: 9.22001e-06 [recompute_prepare]: 5.50001e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 4.88001e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.07999e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.085e-05 [j_node_and_user_rematch]: 7.96001e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 7.30998e-06 [inline_without_move]: 4.97e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.319e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 1.057e-05 [rewriter_after_opt_a]: 4.95e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00056772 [jit_opt_b]: 4.925e-05, [1] [Cycle 1]: 4.254e-05, [2] [frontend_op_eliminate]: 1.579e-05 [inline_after_opt_a]: 1.598e-05 [cconv]: 2.605e-05 [loop_unroll]: 0.00042726 [jit_opt_after_cconv]: 0.00015849, [1] [Cycle 1]: 0.00015196, [11] [c_1]: 2.12e-05 [parameter_eliminate]: 2.63998e-06 [updatestate_depend_eliminate]: 5.72999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 2.283e-05 [call_graph_tuple_transform]: 1.911e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.30999e-06 [remove_dup_value]: 1.563e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 5.39e-06 [add_recomputation]: 5.031e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.756e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.772e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.38002e-06 [opt_after_jit_grad]: 0.00047586 [symbol_engine_optimizer]: 7.529e-05, [1] [Cycle 1]: 6.919e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 8.28001e-06 [elim_not_effective]: 1.368e-05 [opt_reshape]: 5.96998e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.59985e-07 [validate]: 4.056e-05 Sums bootstrap : 0.000313s : 1.03% type_inference : 0.025880s : 85.58% event_method : 0.000022s : 0.07% auto_monad : 0.000073s : 0.24% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000052s : 0.17% rewriter_before_opt_a : 0.000088s : 0.29% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.22% jit_opt_a.loop_unroll : 0.000038s : 0.13% jit_opt_a.a_1 : 0.000755s : 2.50% jit_opt_a.with_stream_mark : 0.000027s : 0.09% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000010s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.08% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.06% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.000778s : 2.57% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.07% jit_opt_a.cse : 0.000048s : 0.16% jit_opt_a.replace_applicator : 0.000017s : 0.06% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000049s : 0.16% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000006s : 0.02% mutable_eliminate : 0.000568s : 1.88% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.05% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000026s : 0.09% loop_unroll : 0.000427s : 1.41% jit_opt_after_cconv.c_1 : 0.000021s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.08% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000016s : 0.05% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.02% add_recomputation : 0.000050s : 0.17% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000018s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.000476s : 1.57% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.13% Time group info: ------[substitution.] 0.000246 27 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000005s : 3: substitution.graph_param_transform 82.69% : 0.000203s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000011s : 3: substitution.reduce_eliminate 1.78% : 0.000004s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 4.54% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.025796 2 33.00% : 0.008512s : 1: type_inference.infer 67.00% : 0.017284s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.15% : 0.000063s : 5: replace.inline 31.85% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 7 95.19% : 0.000200s : 5: match.inline 4.81% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.54% : 0.000002s : 11: predicate.addn_zero_filter 2.04% : 0.000003s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.26% : 0.000002s : 11: predicate.compare_switch_simplify 1.20% : 0.000001s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.01% : 0.000006s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.71% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.24% : 0.000003s : 16: predicate.load_eliminater 1.22% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.40% : 0.000002s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.23% : 0.000002s : 11: predicate.print_const_string_wrapper 2.12% : 0.000003s : 11: predicate.reduce_eliminate 1.67% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.89% : 0.000010s : 59: predicate.switch_simplify 1.42% : 0.000002s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.016881 16 2.49% : 0.000421s : 7: func_graph_cloner_run.FuncGraphClonerGraph 0.35% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 97.15% : 0.016401s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036316 72 0.15% : 0.000054s : 1: add_recomputation 0.21% : 0.000076s : 1: auto_monad 0.06% : 0.000020s : 1: auto_monad_reorder 0.90% : 0.000327s : 1: bootstrap 0.08% : 0.000029s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.07% : 0.000026s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 16.20% : 0.005884s : 1: jit_opt_a 0.44% : 0.000161s : 1: jit_opt_after_cconv 0.14% : 0.000052s : 1: jit_opt_b 1.20% : 0.000435s : 1: loop_unroll 1.59% : 0.000576s : 1: mutable_eliminate 2.68% : 0.000973s : 26: opt.transform.jit_opt_a 0.13% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.07% : 0.000026s : 4: opt.transform.jit_opt_b 0.04% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.33% : 0.000484s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000055s : 1: py_interpret_to_execute 0.04% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000018s : 1: remove_dup_value 1.23% : 0.000448s : 1: renormalize.infer 0.88% : 0.000321s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000053s : 1: rewriter_after_opt_a 0.25% : 0.000090s : 1: rewriter_before_opt_a 0.21% : 0.000078s : 1: symbol_engine_optimizer 71.32% : 0.025900s : 1: type_inference TotalTime = 0.124799, [30] [bootstrap]: 0.00030221 [type_inference]: 0.113372 [event_method]: 2.053e-05 [auto_monad]: 6.948e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.00047873 [rewriter_before_opt_a]: 9.055e-05 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.00790613, [2] [Cycle 1]: 0.00384331, [27] [switch_simplify]: 6.102e-05 [loop_unroll]: 3.116e-05 [a_1]: 0.00060084 [with_stream_mark]: 1.955e-05 [recompute_prepare]: 9.22999e-06 [updatestate_depend_eliminate]: 3.97002e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.46001e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.96e-06 [renormalize]: 0.00276368 [add_forward_monad_depend]: 6.95002e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 1.769e-05 [cse]: 3.387e-05 [replace_applicator]: 2.133e-05 [Cycle 2]: 0.00039382, [27] [switch_simplify]: 7.36999e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00013204 [with_stream_mark]: 1.259e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 3.27997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.736e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 9.40025e-07 [auto_monad_eliminator]: 7.1e-06 [cse]: 1.363e-05 [replace_applicator]: 6.18002e-06 [py_interpret_to_execute_after_opt_a]: 1.151e-05 [rewriter_after_opt_a]: 3.624e-05 [convert_after_rewriter]: 8.68001e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00069333 [jit_opt_b]: 5.814e-05, [1] [Cycle 1]: 5.049e-05, [2] [frontend_op_eliminate]: 2.032e-05 [inline_after_opt_a]: 1.844e-05 [cconv]: 2.622e-05 [loop_unroll]: 0.00051194 [jit_opt_after_cconv]: 0.00016784, [1] [Cycle 1]: 0.00016083, [11] [c_1]: 2.709e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 7.97e-06 [updatestate_assign_eliminate]: 4.22998e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.683e-05 [call_graph_tuple_transform]: 2.241e-05 [tuple_list_get_item_eliminator]: 8.47e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 1.604e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 8.33999e-06 [add_recomputation]: 5.096e-05 [cse_after_recomputation]: 0.00011425, [1] [Cycle 1]: 0.00010837, [1] [cse]: 0.00010026 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.31e-06 [opt_after_jit_grad]: 0.00048026 [symbol_engine_optimizer]: 8.097e-05, [1] [Cycle 1]: 7.471e-05, [6] [build]: 5.37001e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 9.58002e-06 [renormalize]: 6.09987e-07 [validate]: 4.675e-05 Sums bootstrap : 0.000302s : 0.25% type_inference : 0.113372s : 94.08% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000479s : 0.40% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000733s : 0.61% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002764s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000693s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000512s : 0.42% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000100s : 0.08% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000480s : 0.40% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000224 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000006s : 4: substitution.graph_param_transform 83.29% : 0.000187s : 4: substitution.inline 1.68% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000006s : 4: substitution.remove_not_recompute_node 2.39% : 0.000005s : 2: substitution.replace_old_param 6.02% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113290 2 97.50% : 0.110460s : 1: type_inference.infer 2.50% : 0.002830s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.77% : 0.000054s : 4: replace.inline 31.23% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.67% : 0.000184s : 4: match.inline 6.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.32% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.63% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.06% : 0.000001s : 12: predicate.depend_value_elim 1.27% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.45% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.42% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.98% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 8: predicate.remove_not_recompute_node 2.64% : 0.000004s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.65% : 0.000002s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002205 22 68.09% : 0.001502s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.53% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.38% : 0.000670s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128614 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000320s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.09% : 0.000117s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.15% : 0.007910s : 1: jit_opt_a 0.14% : 0.000174s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.41% : 0.000521s : 1: loop_unroll 0.55% : 0.000704s : 1: mutable_eliminate 0.76% : 0.000983s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000486s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.57% : 0.002018s : 1: renormalize.infer 0.57% : 0.000737s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 88.16% : 0.113389s : 1: type_inference TotalTime = 0.130202, [30] [bootstrap]: 0.00027698 [type_inference]: 0.1188 [event_method]: 2.226e-05 [auto_monad]: 7.48e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 3.08998e-06 [py_interpret_to_execute]: 0.00047005 [rewriter_before_opt_a]: 0.00010412 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.00813823, [2] [Cycle 1]: 0.00397956, [27] [switch_simplify]: 6.537e-05 [loop_unroll]: 3.369e-05 [a_1]: 0.0007168 [with_stream_mark]: 2.08e-05 [recompute_prepare]: 8.89998e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.40002e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00279264 [add_forward_monad_depend]: 7.5e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.62e-05 [cse]: 3.509e-05 [replace_applicator]: 1.368e-05 [Cycle 2]: 0.00037685, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 6.36998e-06 [a_1]: 0.00012034 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.59002e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 5.93002e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.01998e-06 [inline_without_move]: 5.76e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.467e-05 [replace_applicator]: 6.31998e-06 [py_interpret_to_execute_after_opt_a]: 1.516e-05 [rewriter_after_opt_a]: 3.864e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00063465 [jit_opt_b]: 5.453e-05, [1] [Cycle 1]: 4.744e-05, [2] [frontend_op_eliminate]: 1.844e-05 [inline_after_opt_a]: 1.801e-05 [cconv]: 2.573e-05 [loop_unroll]: 0.00042687 [jit_opt_after_cconv]: 0.0001447, [1] [Cycle 1]: 0.00013818, [11] [c_1]: 2.455e-05 [parameter_eliminate]: 1.59e-06 [updatestate_depend_eliminate]: 5.06997e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.107e-05 [call_graph_tuple_transform]: 1.956e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.834e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 7.85e-06 [add_recomputation]: 4.869e-05 [cse_after_recomputation]: 2.331e-05, [1] [Cycle 1]: 1.833e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.853e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.0004552 [symbol_engine_optimizer]: 0.00014504, [1] [Cycle 1]: 0.00013926, [6] [build]: 3.41001e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 6.57002e-06 [fold_const_symbol]: 8.007e-05 [renormalize]: 5.39992e-07 [validate]: 4.606e-05 Sums bootstrap : 0.000277s : 0.22% type_inference : 0.118800s : 94.40% event_method : 0.000022s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000470s : 0.37% rewriter_before_opt_a : 0.000104s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000837s : 0.67% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002793s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000635s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000427s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.36% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000080s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000351 25 0.60% : 0.000002s : 2: substitution.elim_not_effective 20.47% : 0.000072s : 2: substitution.fold_const_symbol 1.70% : 0.000006s : 4: substitution.graph_param_transform 69.45% : 0.000244s : 5: substitution.inline 1.09% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.56% : 0.000005s : 4: substitution.remove_not_recompute_node 1.35% : 0.000005s : 2: substitution.replace_old_param 3.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118721 2 97.58% : 0.115846s : 1: type_inference.infer 2.42% : 0.002875s : 1: type_inference.specialize ------[replace.] 0.000106 7 68.66% : 0.000073s : 5: replace.inline 31.34% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000253 7 95.26% : 0.000241s : 5: match.inline 4.74% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.13% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.49% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000007s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.71% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 0.99% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.24% : 0.000002s : 13: predicate.minmaximum_grad 1.14% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 1.79% : 0.000002s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.95% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 13: predicate.value_based_eliminate 0.59% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002502 25 65.48% : 0.001638s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.26% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.26% : 0.000782s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134202 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000292s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.07% : 0.008141s : 1: jit_opt_a 0.11% : 0.000147s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.32% : 0.000433s : 1: loop_unroll 0.48% : 0.000644s : 1: mutable_eliminate 0.81% : 0.001082s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000105s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.47% : 0.001975s : 1: renormalize.infer 0.60% : 0.000807s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.11% : 0.000148s : 1: symbol_engine_optimizer 88.53% : 0.118816s : 1: type_inference TotalTime = 0.126454, [30] [bootstrap]: 0.00033312 [type_inference]: 0.115105 [event_method]: 2.007e-05 [auto_monad]: 6.105e-05 [graph_reusing]: 4.67e-06 [pre_auto_parallel]: 1.95001e-06 [py_interpret_to_execute]: 0.00045376 [rewriter_before_opt_a]: 9.151e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.00745687, [2] [Cycle 1]: 0.00373316, [27] [switch_simplify]: 5.631e-05 [loop_unroll]: 3.401e-05 [a_1]: 0.00068343 [with_stream_mark]: 1.584e-05 [recompute_prepare]: 8.87e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.366e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 6.69001e-06 [renormalize]: 0.00262088 [add_forward_monad_depend]: 5.74e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.516e-05 [cse]: 2.387e-05 [replace_applicator]: 1.382e-05 [Cycle 2]: 0.00037049, [27] [switch_simplify]: 6.59999e-06 [loop_unroll]: 6.00002e-06 [a_1]: 0.00012713 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 5.98002e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.66003e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.65002e-06 [cell_reuse_recompute_pass]: 2.49999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.205e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.00002e-06 [cse]: 1.281e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.252e-05 [rewriter_after_opt_a]: 3.589e-05 [convert_after_rewriter]: 6.29001e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.0010864 [jit_opt_b]: 9.166e-05, [1] [Cycle 1]: 8.419e-05, [2] [frontend_op_eliminate]: 5.02e-05 [inline_after_opt_a]: 1.886e-05 [cconv]: 2.749e-05 [loop_unroll]: 0.00048323 [jit_opt_after_cconv]: 0.0001564, [1] [Cycle 1]: 0.00015011, [11] [c_1]: 2.503e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.93002e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.441e-05 [call_graph_tuple_transform]: 2.15e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.72e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 7.82e-06 [add_recomputation]: 4.642e-05 [cse_after_recomputation]: 2.422e-05, [1] [Cycle 1]: 1.772e-05, [1] [cse]: 1.176e-05 [auto_monad_reorder]: 1.631e-05 [get_jit_bprop_graph]: 2.26998e-06 [rewriter_after_jit_bprop_graph]: 4.91997e-06 [opt_after_jit_grad]: 0.00050707 [symbol_engine_optimizer]: 0.00016686, [1] [Cycle 1]: 0.00016068, [6] [build]: 3.51001e-06 [elim_shapecalc]: 1.034e-05 [elim_not_effective]: 0.00010131 [opt_reshape]: 6.66999e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 4.19997e-07 [validate]: 4.438e-05 Sums bootstrap : 0.000333s : 0.27% type_inference : 0.115105s : 93.95% event_method : 0.000020s : 0.02% auto_monad : 0.000061s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000454s : 0.37% rewriter_before_opt_a : 0.000092s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000811s : 0.66% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002621s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001086s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000050s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000483s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000507s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000101s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000251 28 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 4: substitution.graph_param_transform 83.19% : 0.000209s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.90% : 0.000010s : 3: substitution.reduce_eliminate 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 4.07% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114832 2 97.44% : 0.111896s : 1: type_inference.infer 2.56% : 0.002936s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.64% : 0.000065s : 5: replace.inline 31.36% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 7 95.82% : 0.000206s : 5: match.inline 4.18% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000002s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.20% : 0.000007s : 28: predicate.inline 1.11% : 0.000002s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 19: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 1.84% : 0.000002s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.50% : 0.000010s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.29% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002508 25 68.75% : 0.001725s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.74% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.51% : 0.000715s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130791 72 0.04% : 0.000049s : 1: add_recomputation 0.05% : 0.000064s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.27% : 0.000350s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.70% : 0.007460s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.07% : 0.000095s : 1: jit_opt_b 0.38% : 0.000491s : 1: loop_unroll 0.84% : 0.001097s : 1: mutable_eliminate 0.80% : 0.001044s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000061s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.38% : 0.000496s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000125s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000516s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000460s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.44% : 0.001884s : 1: renormalize.infer 0.56% : 0.000729s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.13% : 0.000170s : 1: symbol_engine_optimizer 88.02% : 0.115118s : 1: type_inference TotalTime = 0.126981, [30] [bootstrap]: 0.0002919 [type_inference]: 0.115547 [event_method]: 2.289e-05 [auto_monad]: 7.228e-05 [graph_reusing]: 6.60997e-06 [pre_auto_parallel]: 2.55002e-06 [py_interpret_to_execute]: 0.00047354 [rewriter_before_opt_a]: 9.891e-05 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00805051, [2] [Cycle 1]: 0.00424014, [27] [switch_simplify]: 6.656e-05 [loop_unroll]: 3.538e-05 [a_1]: 0.00070958 [with_stream_mark]: 1.661e-05 [recompute_prepare]: 8.80001e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 6.57002e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.76e-06 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00304759 [add_forward_monad_depend]: 7e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.676e-05 [cse]: 3.514e-05 [replace_applicator]: 1.818e-05 [Cycle 2]: 0.00038882, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 6.42001e-06 [a_1]: 0.00013551 [with_stream_mark]: 1.252e-05 [recompute_prepare]: 6.54001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.60002e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.81003e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 2.79001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.352e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.72001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.11997e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.403e-05 [replace_applicator]: 5.98002e-06 [py_interpret_to_execute_after_opt_a]: 1.459e-05 [rewriter_after_opt_a]: 3.871e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 4.86002e-06 [mutable_eliminate]: 0.00070036 [jit_opt_b]: 5.833e-05, [1] [Cycle 1]: 5.016e-05, [2] [frontend_op_eliminate]: 2.025e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 2.801e-05 [loop_unroll]: 0.0004389 [jit_opt_after_cconv]: 0.0001584, [1] [Cycle 1]: 0.00015165, [11] [c_1]: 2.577e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.48e-05 [call_graph_tuple_transform]: 2.268e-05 [tuple_list_get_item_eliminator]: 6.28998e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 7.08e-06 [remove_dup_value]: 1.787e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 8.02e-06 [add_recomputation]: 5.076e-05 [cse_after_recomputation]: 2.364e-05, [1] [Cycle 1]: 1.837e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.705e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.62001e-06 [opt_after_jit_grad]: 0.00049061 [symbol_engine_optimizer]: 7.667e-05, [1] [Cycle 1]: 7.044e-05, [6] [build]: 3.36999e-06 [elim_shapecalc]: 8.69e-06 [elim_not_effective]: 1.397e-05 [opt_reshape]: 6.80998e-06 [fold_const_symbol]: 9.67001e-06 [renormalize]: 3.69997e-07 [validate]: 8.912e-05 Sums bootstrap : 0.000292s : 0.24% type_inference : 0.115547s : 93.97% event_method : 0.000023s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000474s : 0.39% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000845s : 0.69% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003048s : 2.48% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000700s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000439s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000491s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.07% Time group info: ------[substitution.] 0.000266 28 0.68% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 83.03% : 0.000221s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.24% : 0.000011s : 3: substitution.reduce_eliminate 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000005s : 2: substitution.replace_old_param 4.12% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115471 2 97.29% : 0.112346s : 1: type_inference.infer 2.71% : 0.003125s : 1: type_inference.specialize ------[replace.] 0.000116 7 69.31% : 0.000080s : 5: replace.inline 30.69% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 95.71% : 0.000218s : 5: match.inline 4.29% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.51% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_depend_swap 1.51% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.26% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.14% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.60% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002493 25 58.87% : 0.001468s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.46% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.67% : 0.000964s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131159 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000305s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.14% : 0.008054s : 1: jit_opt_a 0.12% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.34% : 0.000447s : 1: loop_unroll 0.54% : 0.000710s : 1: mutable_eliminate 0.84% : 0.001099s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000499s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000481s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.57% : 0.002064s : 1: renormalize.infer 0.74% : 0.000973s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.11% : 0.115568s : 1: type_inference TotalTime = 0.0967049, [30] [bootstrap]: 0.00032365 [type_inference]: 0.0854069 [event_method]: 2.647e-05 [auto_monad]: 7.955e-05 [graph_reusing]: 6.47001e-06 [pre_auto_parallel]: 2.79001e-06 [py_interpret_to_execute]: 0.00029704 [rewriter_before_opt_a]: 9.873e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00784104, [2] [Cycle 1]: 0.00371544, [27] [switch_simplify]: 6.966e-05 [loop_unroll]: 3.487e-05 [a_1]: 0.00067823 [with_stream_mark]: 1.828e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.31998e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 2.924e-05 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.674e-05 [j_node_and_user_rematch]: 1.123e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.109e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.00249437 [add_forward_monad_depend]: 7.24001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.726e-05 [cse]: 3.714e-05 [replace_applicator]: 1.808e-05 [Cycle 2]: 0.00037512, [27] [switch_simplify]: 6.94999e-06 [loop_unroll]: 6.32001e-06 [a_1]: 0.0001237 [with_stream_mark]: 1.148e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 5.83002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.39998e-06 [auto_monad_eliminator]: 7.48e-06 [cse]: 1.488e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 1.477e-05 [rewriter_after_opt_a]: 3.955e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00065529 [jit_opt_b]: 5.505e-05, [1] [Cycle 1]: 4.836e-05, [2] [frontend_op_eliminate]: 1.943e-05 [inline_after_opt_a]: 1.851e-05 [cconv]: 2.773e-05 [loop_unroll]: 0.00043139 [jit_opt_after_cconv]: 0.00043331, [1] [Cycle 1]: 0.00042638, [11] [c_1]: 2.508e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.265e-05 [call_graph_tuple_transform]: 2.076e-05 [tuple_list_get_item_eliminator]: 1.269e-05 [none_parameter_eliminate]: 2.52001e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 7.73001e-06 [remove_dup_value]: 2.149e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 9.39e-06 [add_recomputation]: 5.163e-05 [cse_after_recomputation]: 2.983e-05, [1] [Cycle 1]: 2.354e-05, [1] [cse]: 1.725e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 5.26998e-06 [opt_after_jit_grad]: 0.00048562 [symbol_engine_optimizer]: 7.551e-05, [1] [Cycle 1]: 6.956e-05, [6] [build]: 3.88999e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.357e-05 [opt_reshape]: 6.83998e-06 [fold_const_symbol]: 9.89001e-06 [renormalize]: 2.9002e-07 [validate]: 6.289e-05 Sums bootstrap : 0.000324s : 0.35% type_inference : 0.085407s : 92.77% event_method : 0.000026s : 0.03% auto_monad : 0.000080s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000297s : 0.32% rewriter_before_opt_a : 0.000099s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.08% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000802s : 0.87% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000035s : 0.04% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002494s : 2.71% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.03% jit_opt_a.cse : 0.000052s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000655s : 0.71% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000431s : 0.47% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000013s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.06% cse_after_recomputation.cse : 0.000017s : 0.02% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000486s : 0.53% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000063s : 0.07% Time group info: ------[substitution.] 0.000251 25 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.50% : 0.000006s : 4: substitution.graph_param_transform 85.32% : 0.000214s : 5: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 5.19% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.085299 2 97.20% : 0.082913s : 1: type_inference.infer 2.80% : 0.002386s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.44% : 0.000070s : 5: replace.inline 31.56% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 94.75% : 0.000212s : 5: match.inline 5.25% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 888 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 6.03% : 0.000008s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.44% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 1.59% : 0.000002s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.02% : 0.000011s : 65: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003463 37 76.17% : 0.002638s : 28: func_graph_cloner_run.FuncGraphClonerGraph 1.71% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 22.12% : 0.000766s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.100318 72 0.05% : 0.000054s : 1: add_recomputation 0.08% : 0.000083s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.34% : 0.000338s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000032s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.82% : 0.007845s : 1: jit_opt_a 0.43% : 0.000436s : 1: jit_opt_after_cconv 0.06% : 0.000058s : 1: jit_opt_b 0.44% : 0.000439s : 1: loop_unroll 0.66% : 0.000665s : 1: mutable_eliminate 1.06% : 0.001062s : 26: opt.transform.jit_opt_a 0.06% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000493s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000304s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000024s : 1: remove_dup_value 1.71% : 0.001714s : 1: renormalize.infer 0.77% : 0.000771s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.10% : 0.000104s : 1: rewriter_before_opt_a 0.08% : 0.000078s : 1: symbol_engine_optimizer 85.16% : 0.085429s : 1: type_inference TotalTime = 0.0168673, [30] [bootstrap]: 0.00030265 [type_inference]: 0.00849728 [event_method]: 1.941e-05 [auto_monad]: 6.934e-05 [graph_reusing]: 5.44e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 4.444e-05 [rewriter_before_opt_a]: 8.074e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00565146, [2] [Cycle 1]: 0.0019221, [27] [switch_simplify]: 6.152e-05 [loop_unroll]: 3.371e-05 [a_1]: 0.00064705 [with_stream_mark]: 1.915e-05 [recompute_prepare]: 7.45998e-06 [updatestate_depend_eliminate]: 4.07003e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.55002e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 2.28002e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.00083222 [add_forward_monad_depend]: 5.92001e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.506e-05 [cse]: 3.118e-05 [replace_applicator]: 1.281e-05 [Cycle 2]: 0.00032562, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 4.93001e-06 [a_1]: 9.742e-05 [with_stream_mark]: 9.73002e-06 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 4.95001e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.09e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.2e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.276e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 1.174e-05 [rewriter_after_opt_a]: 3.715e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00056296 [jit_opt_b]: 4.866e-05, [1] [Cycle 1]: 4.161e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.503e-05 [cconv]: 2.491e-05 [loop_unroll]: 0.00042158 [jit_opt_after_cconv]: 0.00015548, [1] [Cycle 1]: 0.00014812, [11] [c_1]: 2.091e-05 [parameter_eliminate]: 2.22001e-06 [updatestate_depend_eliminate]: 5.96998e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.3e-05 [call_graph_tuple_transform]: 2.875e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.67001e-06 [remove_dup_value]: 1.597e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.89999e-06 [add_recomputation]: 4.716e-05 [cse_after_recomputation]: 2.483e-05, [1] [Cycle 1]: 1.917e-05, [1] [cse]: 1.351e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00052371 [symbol_engine_optimizer]: 7.449e-05, [1] [Cycle 1]: 6.814e-05, [6] [build]: 3.61001e-06 [elim_shapecalc]: 8.90001e-06 [elim_not_effective]: 1.364e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 5.00004e-07 [validate]: 3.896e-05 Sums bootstrap : 0.000303s : 2.35% type_inference : 0.008497s : 65.84% event_method : 0.000019s : 0.15% auto_monad : 0.000069s : 0.54% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000044s : 0.34% rewriter_before_opt_a : 0.000081s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000068s : 0.53% jit_opt_a.loop_unroll : 0.000039s : 0.30% jit_opt_a.a_1 : 0.000744s : 5.77% jit_opt_a.with_stream_mark : 0.000029s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000832s : 6.45% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000044s : 0.34% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000037s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000563s : 4.36% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.12% cconv : 0.000025s : 0.19% loop_unroll : 0.000422s : 3.27% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000047s : 0.37% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000524s : 4.06% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.30% Time group info: ------[substitution.] 0.000272 27 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 5.29% : 0.000014s : 3: substitution.graph_param_transform 81.16% : 0.000221s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.99% : 0.000011s : 3: substitution.reduce_eliminate 1.98% : 0.000005s : 4: substitution.remove_not_recompute_node 1.31% : 0.000004s : 2: substitution.replace_old_param 3.86% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008432 2 87.34% : 0.007365s : 1: type_inference.infer 12.66% : 0.001067s : 1: type_inference.specialize ------[replace.] 0.000090 7 66.41% : 0.000060s : 5: replace.inline 33.59% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 95.90% : 0.000218s : 5: match.inline 4.10% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.47% : 0.000002s : 11: predicate.addn_zero_filter 1.89% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 11: predicate.compare_switch_simplify 1.43% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.70% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 16: predicate.load_eliminater 1.20% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 2.04% : 0.000003s : 11: predicate.reduce_eliminate 1.56% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.37% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.29% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.12% : 0.000010s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 16 48.70% : 0.000391s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.69% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.60% : 0.000334s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018734 72 0.27% : 0.000050s : 1: add_recomputation 0.39% : 0.000073s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.68% : 0.000315s : 1: bootstrap 0.15% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.19% : 0.005655s : 1: jit_opt_a 0.84% : 0.000158s : 1: jit_opt_after_cconv 0.27% : 0.000051s : 1: jit_opt_b 2.29% : 0.000429s : 1: loop_unroll 3.05% : 0.000572s : 1: mutable_eliminate 5.16% : 0.000967s : 26: opt.transform.jit_opt_a 0.31% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.84% : 0.000532s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000047s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.54% : 0.000475s : 1: renormalize.infer 1.86% : 0.000348s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000040s : 1: rewriter_after_opt_a 0.45% : 0.000084s : 1: rewriter_before_opt_a 0.41% : 0.000077s : 1: symbol_engine_optimizer 45.42% : 0.008509s : 1: type_inference TotalTime = 0.0733805, [30] [bootstrap]: 0.00031599 [type_inference]: 0.0614059 [event_method]: 2.231e-05 [auto_monad]: 7.32e-05 [graph_reusing]: 6.12001e-06 [pre_auto_parallel]: 3.03998e-06 [py_interpret_to_execute]: 0.00027877 [rewriter_before_opt_a]: 9.757e-05 [expand_dump_flag]: 4.15999e-06 [jit_opt_a]: 0.00877169, [2] [Cycle 1]: 0.00444627, [27] [switch_simplify]: 7.426e-05 [loop_unroll]: 3.474e-05 [a_1]: 0.00173318 [with_stream_mark]: 2.652e-05 [recompute_prepare]: 1.14e-05 [updatestate_depend_eliminate]: 4.67998e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.93998e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.645e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 7.2e-06 [renormalize]: 0.0021888 [add_forward_monad_depend]: 7.53999e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 1.587e-05 [cse]: 3.591e-05 [replace_applicator]: 1.896e-05 [Cycle 2]: 0.00044041, [27] [switch_simplify]: 6.93998e-06 [loop_unroll]: 6.00002e-06 [a_1]: 0.00017988 [with_stream_mark]: 1.344e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.65002e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.76998e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.83002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.46998e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.96001e-06 [cse]: 1.724e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.481e-05 [rewriter_after_opt_a]: 3.957e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00071728 [jit_opt_b]: 5.669e-05, [1] [Cycle 1]: 4.824e-05, [2] [frontend_op_eliminate]: 1.863e-05 [inline_after_opt_a]: 1.799e-05 [cconv]: 2.716e-05 [loop_unroll]: 0.0004294 [jit_opt_after_cconv]: 0.00015781, [1] [Cycle 1]: 0.00015127, [11] [c_1]: 2.634e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.80002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.554e-05 [call_graph_tuple_transform]: 2.205e-05 [tuple_list_get_item_eliminator]: 6.86001e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.858e-05 [partial_unused_args_eliminate]: 3.15002e-06 [environ_conv]: 8.29998e-06 [add_recomputation]: 5.092e-05 [cse_after_recomputation]: 2.515e-05, [1] [Cycle 1]: 1.953e-05, [1] [cse]: 1.378e-05 [auto_monad_reorder]: 1.887e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 5.24e-06 [opt_after_jit_grad]: 0.00045741 [symbol_engine_optimizer]: 7.405e-05, [1] [Cycle 1]: 6.784e-05, [6] [build]: 3.17997e-06 [elim_shapecalc]: 8.36002e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 5.59987e-07 [validate]: 9.532e-05 Sums bootstrap : 0.000316s : 0.46% type_inference : 0.061406s : 89.15% event_method : 0.000022s : 0.03% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000279s : 0.40% rewriter_before_opt_a : 0.000098s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.12% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.001913s : 2.78% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000019s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002189s : 3.18% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.03% jit_opt_a.cse : 0.000053s : 0.08% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000015s : 0.02% rewriter_after_opt_a : 0.000040s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000717s : 1.04% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000429s : 0.62% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000457s : 0.66% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000095s : 0.14% Time group info: ------[substitution.] 0.001254 25 0.14% : 0.000002s : 2: substitution.elim_not_effective 0.10% : 0.000001s : 2: substitution.fold_const_symbol 0.58% : 0.000007s : 4: substitution.graph_param_transform 96.94% : 0.001215s : 5: substitution.inline 0.30% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.45% : 0.000006s : 4: substitution.remove_not_recompute_node 0.37% : 0.000005s : 2: substitution.replace_old_param 1.12% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061314 2 96.51% : 0.059176s : 1: type_inference.infer 3.49% : 0.002138s : 1: type_inference.specialize ------[replace.] 0.000129 7 71.97% : 0.000093s : 5: replace.inline 28.03% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.001224 7 98.98% : 0.001211s : 5: match.inline 1.02% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 888 1.18% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000001s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 6.04% : 0.000009s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.70% : 0.000002s : 13: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.80% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.70% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 20: predicate.switch_defer_inline 2.47% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000011s : 65: predicate.switch_simplify 1.41% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.99% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002574 29 70.28% : 0.001809s : 20: func_graph_cloner_run.FuncGraphClonerGraph 4.22% : 0.000109s : 2: func_graph_cloner_run.FuncGraphClonerNode 25.50% : 0.000656s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077769 72 0.07% : 0.000054s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.43% : 0.000337s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.28% : 0.008775s : 1: jit_opt_a 0.21% : 0.000160s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.56% : 0.000437s : 1: loop_unroll 0.93% : 0.000726s : 1: mutable_eliminate 2.81% : 0.002182s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000284s : 1: py_interpret_to_execute 0.02% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000021s : 1: remove_dup_value 1.90% : 0.001478s : 1: renormalize.infer 0.90% : 0.000701s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.13% : 0.000103s : 1: rewriter_before_opt_a 0.10% : 0.000077s : 1: symbol_engine_optimizer 78.99% : 0.061427s : 1: type_inference TotalTime = 0.129494, [30] [bootstrap]: 0.00031238 [type_inference]: 0.116688 [event_method]: 2.49e-05 [auto_monad]: 7.949e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.86e-06 [py_interpret_to_execute]: 0.00057387 [rewriter_before_opt_a]: 0.00010604 [expand_dump_flag]: 4.26001e-06 [jit_opt_a]: 0.0090255, [2] [Cycle 1]: 0.00469111, [27] [switch_simplify]: 7.306e-05 [loop_unroll]: 3.519e-05 [a_1]: 0.00075177 [with_stream_mark]: 5.71e-05 [recompute_prepare]: 1.047e-05 [updatestate_depend_eliminate]: 4.95999e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 7.45e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 6.72002e-06 [meta_shard_fg_expand]: 2.43002e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.75e-05 [j_node_and_user_rematch]: 1.048e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.133e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00333961 [add_forward_monad_depend]: 9.18002e-06 [auto_monad_grad]: 2.61999e-06 [auto_monad_eliminator]: 2.102e-05 [cse]: 4.333e-05 [replace_applicator]: 2.423e-05 [Cycle 2]: 0.00045159, [27] [switch_simplify]: 7.86001e-06 [loop_unroll]: 7.04001e-06 [a_1]: 0.00014677 [with_stream_mark]: 1.933e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 1.628e-05 [specialize_transform]: 7.88001e-06 [updatestate_useless_node_eliminater]: 6.64001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 4.42998e-06 [cell_reuse_recompute_pass]: 2.96001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.069e-05 [inline_without_move]: 6.15997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 8.45999e-06 [cse]: 1.733e-05 [replace_applicator]: 6.64001e-06 [py_interpret_to_execute_after_opt_a]: 1.688e-05 [rewriter_after_opt_a]: 4.393e-05 [convert_after_rewriter]: 7.35003e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00082802 [jit_opt_b]: 6.108e-05, [1] [Cycle 1]: 5.297e-05, [2] [frontend_op_eliminate]: 1.963e-05 [inline_after_opt_a]: 2.145e-05 [cconv]: 3.412e-05 [loop_unroll]: 0.00046124 [jit_opt_after_cconv]: 0.00017337, [1] [Cycle 1]: 0.00016653, [11] [c_1]: 2.664e-05 [parameter_eliminate]: 3.56001e-06 [updatestate_depend_eliminate]: 8.02998e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 3.295e-05 [call_graph_tuple_transform]: 2.466e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 6.91999e-06 [remove_dup_value]: 1.696e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 1.048e-05 [add_recomputation]: 5.639e-05 [cse_after_recomputation]: 2.467e-05, [1] [Cycle 1]: 1.893e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.734e-05 [get_jit_bprop_graph]: 2.71999e-06 [rewriter_after_jit_bprop_graph]: 7.07002e-06 [opt_after_jit_grad]: 0.00051134 [symbol_engine_optimizer]: 8.048e-05, [1] [Cycle 1]: 7.452e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 9.64999e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 7.23999e-06 [fold_const_symbol]: 1.075e-05 [renormalize]: 5.50004e-07 [validate]: 0.00010046 Sums bootstrap : 0.000312s : 0.25% type_inference : 0.116688s : 93.40% event_method : 0.000025s : 0.02% auto_monad : 0.000079s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000574s : 0.46% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000899s : 0.72% jit_opt_a.with_stream_mark : 0.000076s : 0.06% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000018s : 0.01% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003340s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000061s : 0.05% jit_opt_a.replace_applicator : 0.000031s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000828s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000461s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000511s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000100s : 0.08% Time group info: ------[substitution.] 0.000314 28 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.91% : 0.000003s : 2: substitution.fold_const_symbol 2.07% : 0.000007s : 4: substitution.graph_param_transform 82.24% : 0.000258s : 5: substitution.inline 1.52% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.84% : 0.000015s : 3: substitution.reduce_eliminate 1.80% : 0.000006s : 4: substitution.remove_not_recompute_node 2.27% : 0.000007s : 2: substitution.replace_old_param 3.74% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116592 2 97.26% : 0.113392s : 1: type_inference.infer 2.74% : 0.003200s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.67% : 0.000074s : 5: replace.inline 31.33% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000266 7 96.07% : 0.000255s : 5: match.inline 3.93% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.11% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000002s : 13: predicate.addn_check_dump 1.36% : 0.000002s : 13: predicate.addn_zero_filter 2.25% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.38% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.56% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 1.01% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.70% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.01% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 2.21% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000004s : 19: predicate.partial_eliminate 1.07% : 0.000002s : 13: predicate.print_const_string_wrapper 2.11% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.51% : 0.000001s : 8: predicate.replace_old_param 0.83% : 0.000001s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 13: predicate.reshape_eliminate 1.15% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 20: predicate.switch_defer_inline 1.93% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.34% : 0.000011s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.37% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002722 25 59.58% : 0.001622s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.95% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.47% : 0.001020s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134036 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000083s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000330s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.74% : 0.009030s : 1: jit_opt_a 0.13% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.35% : 0.000470s : 1: loop_unroll 0.63% : 0.000843s : 1: mutable_eliminate 0.88% : 0.001178s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000580s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.69% : 0.002263s : 1: renormalize.infer 0.79% : 0.001064s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000112s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 87.08% : 0.116715s : 1: type_inference TotalTime = 0.0807945, [30] [bootstrap]: 0.00034379 [type_inference]: 0.0674718 [event_method]: 2.034e-05 [auto_monad]: 6.882e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.83998e-06 [py_interpret_to_execute]: 0.00025067 [rewriter_before_opt_a]: 8.313e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00901595, [2] [Cycle 1]: 0.00332098, [27] [switch_simplify]: 6.216e-05 [loop_unroll]: 3.474e-05 [a_1]: 0.00058991 [with_stream_mark]: 1.865e-05 [recompute_prepare]: 8.26002e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 6.28002e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.53998e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.603e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 2.755e-05 [replace_old_param]: 1.056e-05 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00222692 [add_forward_monad_depend]: 7.20998e-06 [auto_monad_grad]: 2.98998e-06 [auto_monad_eliminator]: 1.638e-05 [cse]: 3.233e-05 [replace_applicator]: 1.725e-05 [Cycle 2]: 0.00038082, [27] [switch_simplify]: 7.00998e-06 [loop_unroll]: 6.59001e-06 [a_1]: 0.00013138 [with_stream_mark]: 1.122e-05 [recompute_prepare]: 6.94001e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 3.30998e-06 [cell_reuse_recompute_pass]: 2.83e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 5.10016e-07 [auto_monad_eliminator]: 5.92001e-06 [cse]: 1.2e-05 [replace_applicator]: 6.33e-06 [py_interpret_to_execute_after_opt_a]: 1.191e-05 [rewriter_after_opt_a]: 3.77e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.38002e-06 [mutable_eliminate]: 0.00071285 [jit_opt_b]: 5.939e-05, [1] [Cycle 1]: 5.228e-05, [2] [frontend_op_eliminate]: 2.135e-05 [inline_after_opt_a]: 1.845e-05 [cconv]: 2.65e-05 [loop_unroll]: 0.00146376 [jit_opt_after_cconv]: 0.00027692, [1] [Cycle 1]: 0.00026953, [11] [c_1]: 2.737e-05 [parameter_eliminate]: 3.5e-06 [updatestate_depend_eliminate]: 6.28998e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 4.27e-06 [cse]: 2.644e-05 [call_graph_tuple_transform]: 2.16e-05 [tuple_list_get_item_eliminator]: 6.64999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 7.82e-06 [remove_dup_value]: 1.722e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 9.28002e-06 [add_recomputation]: 5.279e-05 [cse_after_recomputation]: 2.593e-05, [1] [Cycle 1]: 2.042e-05, [1] [cse]: 1.436e-05 [auto_monad_reorder]: 1.623e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 6.58e-06 [opt_after_jit_grad]: 0.00049804 [symbol_engine_optimizer]: 7.886e-05, [1] [Cycle 1]: 7.274e-05, [6] [build]: 4.15e-06 [elim_shapecalc]: 9.32001e-06 [elim_not_effective]: 1.454e-05 [opt_reshape]: 6.94001e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 2.99973e-07 [validate]: 4.306e-05 Sums bootstrap : 0.000344s : 0.46% type_inference : 0.067472s : 90.24% event_method : 0.000020s : 0.03% auto_monad : 0.000069s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000251s : 0.34% rewriter_before_opt_a : 0.000083s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.09% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000721s : 0.96% jit_opt_a.with_stream_mark : 0.000030s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000030s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002227s : 2.98% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000044s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000038s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000713s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.04% loop_unroll : 0.001464s : 1.96% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000498s : 0.67% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.06% Time group info: ------[substitution.] 0.000219 24 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 3.14% : 0.000007s : 4: substitution.graph_param_transform 83.56% : 0.000183s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.69% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.31% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.067393 2 97.14% : 0.065463s : 1: type_inference.infer 2.86% : 0.001931s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.75% : 0.000052s : 4: replace.inline 32.25% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 94.46% : 0.000180s : 4: match.inline 5.54% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.50% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.62% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 18: predicate.load_eliminater 1.65% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.38% : 0.000002s : 12: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.15% : 0.000002s : 8: predicate.specialize_transform 1.27% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.63% : 0.000011s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.55% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002484 26 74.18% : 0.001843s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.38% : 0.000606s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.084071 72 0.07% : 0.000056s : 1: add_recomputation 0.09% : 0.000072s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.42% : 0.000357s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.73% : 0.009019s : 1: jit_opt_a 0.33% : 0.000280s : 1: jit_opt_after_cconv 0.07% : 0.000062s : 1: jit_opt_b 1.75% : 0.001473s : 1: loop_unroll 0.86% : 0.000722s : 1: mutable_eliminate 1.15% : 0.000968s : 26: opt.transform.jit_opt_a 0.07% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.60% : 0.000506s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000256s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.81% : 0.001523s : 1: renormalize.infer 0.83% : 0.000694s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000041s : 1: rewriter_after_opt_a 0.10% : 0.000088s : 1: rewriter_before_opt_a 0.10% : 0.000081s : 1: symbol_engine_optimizer 80.27% : 0.067487s : 1: type_inference TotalTime = 0.0798067, [30] [bootstrap]: 0.00034853 [type_inference]: 0.0682232 [event_method]: 2.37e-05 [auto_monad]: 7.965e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.75002e-06 [py_interpret_to_execute]: 0.00030205 [rewriter_before_opt_a]: 0.00010394 [expand_dump_flag]: 4.21001e-06 [jit_opt_a]: 0.00825556, [2] [Cycle 1]: 0.00382419, [27] [switch_simplify]: 7.429e-05 [loop_unroll]: 3.618e-05 [a_1]: 0.00077921 [with_stream_mark]: 2.754e-05 [recompute_prepare]: 9.81e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 3.73999e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.13002e-06 [accelerated_algorithm]: 6.56999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.697e-05 [j_node_and_user_rematch]: 1.012e-05 [meta_fg_expand]: 3.01999e-06 [replace_old_param]: 1.182e-05 [inline_without_move]: 6.94999e-06 [renormalize]: 0.00249316 [add_forward_monad_depend]: 8.87999e-06 [auto_monad_grad]: 2.66999e-06 [auto_monad_eliminator]: 1.925e-05 [cse]: 3.861e-05 [replace_applicator]: 2.284e-05 [Cycle 2]: 0.00038223, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 6.01998e-06 [a_1]: 0.000122 [with_stream_mark]: 1.349e-05 [recompute_prepare]: 6.57002e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.43001e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.872e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.74e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.494e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 1.604e-05 [rewriter_after_opt_a]: 4.048e-05 [convert_after_rewriter]: 7.29001e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.00071819 [jit_opt_b]: 5.67e-05, [1] [Cycle 1]: 4.874e-05, [2] [frontend_op_eliminate]: 1.903e-05 [inline_after_opt_a]: 1.857e-05 [cconv]: 2.757e-05 [loop_unroll]: 0.00043397 [jit_opt_after_cconv]: 0.00016394, [1] [Cycle 1]: 0.00015685, [11] [c_1]: 2.535e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 7.25e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 3.08e-06 [cse]: 2.877e-05 [call_graph_tuple_transform]: 2.278e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.58998e-06 [remove_dup_value]: 2.051e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 8.66002e-06 [add_recomputation]: 5.209e-05 [cse_after_recomputation]: 2.547e-05, [1] [Cycle 1]: 2.012e-05, [1] [cse]: 1.442e-05 [auto_monad_reorder]: 1.862e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 5.39e-06 [opt_after_jit_grad]: 0.00050093 [symbol_engine_optimizer]: 0.00010143, [1] [Cycle 1]: 9.499e-05, [6] [build]: 3.34001e-06 [elim_shapecalc]: 8.65999e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 3.432e-05 [renormalize]: 3.80009e-07 [validate]: 5.391e-05 Sums bootstrap : 0.000349s : 0.46% type_inference : 0.068223s : 90.82% event_method : 0.000024s : 0.03% auto_monad : 0.000080s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000302s : 0.40% rewriter_before_opt_a : 0.000104s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000081s : 0.11% jit_opt_a.loop_unroll : 0.000042s : 0.06% jit_opt_a.a_1 : 0.000901s : 1.20% jit_opt_a.with_stream_mark : 0.000041s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002493s : 3.32% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.03% jit_opt_a.cse : 0.000054s : 0.07% jit_opt_a.replace_applicator : 0.000029s : 0.04% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000040s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000718s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.04% loop_unroll : 0.000434s : 0.58% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000052s : 0.07% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000501s : 0.67% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000034s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.07% Time group info: ------[substitution.] 0.000320 25 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000007s : 4: substitution.graph_param_transform 87.66% : 0.000280s : 5: substitution.inline 1.11% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000006s : 4: substitution.remove_not_recompute_node 2.06% : 0.000007s : 2: substitution.replace_old_param 4.11% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.068113 2 96.51% : 0.065739s : 1: type_inference.infer 3.49% : 0.002374s : 1: type_inference.specialize ------[replace.] 0.000111 7 69.64% : 0.000078s : 5: replace.inline 30.36% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 7 95.88% : 0.000277s : 5: match.inline 4.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 888 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.31% : 0.000002s : 13: predicate.addn_check_dump 1.69% : 0.000002s : 13: predicate.addn_zero_filter 2.05% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.35% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.22% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.39% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.87% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.44% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.82% : 0.000011s : 65: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002601 29 68.39% : 0.001779s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.68% : 0.000096s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.93% : 0.000726s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.083555 72 0.07% : 0.000055s : 1: add_recomputation 0.10% : 0.000083s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.44% : 0.000369s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.04% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.89% : 0.008259s : 1: jit_opt_a 0.20% : 0.000167s : 1: jit_opt_after_cconv 0.07% : 0.000059s : 1: jit_opt_b 0.53% : 0.000442s : 1: loop_unroll 0.87% : 0.000727s : 1: mutable_eliminate 1.41% : 0.001174s : 26: opt.transform.jit_opt_a 0.07% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000061s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000310s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000023s : 1: remove_dup_value 2.03% : 0.001699s : 1: renormalize.infer 0.94% : 0.000784s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000043s : 1: rewriter_after_opt_a 0.13% : 0.000109s : 1: rewriter_before_opt_a 0.12% : 0.000104s : 1: symbol_engine_optimizer 81.67% : 0.068243s : 1: type_inference TotalTime = 0.0146844, [30] [bootstrap]: 0.00035133 [type_inference]: 0.00557777 [event_method]: 1.872e-05 [auto_monad]: 6.349e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 4.047e-05 [rewriter_before_opt_a]: 8.25e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00594301, [2] [Cycle 1]: 0.00206932, [27] [switch_simplify]: 5.891e-05 [loop_unroll]: 3.062e-05 [a_1]: 0.00073877 [with_stream_mark]: 2.408e-05 [recompute_prepare]: 9.43002e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.74001e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.18998e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 2.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 1.103e-05 [inline_without_move]: 5.42001e-06 [renormalize]: 0.00083169 [add_forward_monad_depend]: 6.11e-06 [auto_monad_grad]: 2.11998e-06 [auto_monad_eliminator]: 1.753e-05 [cse]: 3.36e-05 [replace_applicator]: 1.457e-05 [Cycle 2]: 0.0003414, [27] [switch_simplify]: 5.81e-06 [loop_unroll]: 4.89e-06 [a_1]: 9.169e-05 [with_stream_mark]: 1.166e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 2.66999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 5.35999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 4.89e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 8.38001e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.51998e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 7.5e-06 [cse]: 1.296e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.161e-05 [rewriter_after_opt_a]: 4.545e-05 [convert_after_rewriter]: 8.00999e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00074886 [jit_opt_b]: 6.152e-05, [1] [Cycle 1]: 5.24e-05, [2] [frontend_op_eliminate]: 2.039e-05 [inline_after_opt_a]: 1.868e-05 [cconv]: 3.079e-05 [loop_unroll]: 0.00054089 [jit_opt_after_cconv]: 0.00015956, [1] [Cycle 1]: 0.0001517, [11] [c_1]: 2.32e-05 [parameter_eliminate]: 3.58999e-06 [updatestate_depend_eliminate]: 8.2e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.557e-05 [call_graph_tuple_transform]: 2.137e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.57001e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 5.64e-06 [add_recomputation]: 6.45e-05 [cse_after_recomputation]: 2.414e-05, [1] [Cycle 1]: 1.804e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.584e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 5.91e-06 [opt_after_jit_grad]: 0.0005214 [symbol_engine_optimizer]: 7.94e-05, [1] [Cycle 1]: 7.205e-05, [6] [build]: 4.68001e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.404e-05 [opt_reshape]: 5.92001e-06 [fold_const_symbol]: 8.62e-06 [renormalize]: 9.09989e-07 [validate]: 4.044e-05 Sums bootstrap : 0.000351s : 3.35% type_inference : 0.005578s : 53.20% event_method : 0.000019s : 0.18% auto_monad : 0.000063s : 0.61% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.39% rewriter_before_opt_a : 0.000082s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000065s : 0.62% jit_opt_a.loop_unroll : 0.000036s : 0.34% jit_opt_a.a_1 : 0.000830s : 7.92% jit_opt_a.with_stream_mark : 0.000036s : 0.34% jit_opt_a.recompute_prepare : 0.000015s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000832s : 7.93% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.24% jit_opt_a.cse : 0.000047s : 0.44% jit_opt_a.replace_applicator : 0.000020s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000045s : 0.43% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000749s : 7.14% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.19% jit_opt_b.inline_after_opt_a : 0.000019s : 0.18% cconv : 0.000031s : 0.29% loop_unroll : 0.000541s : 5.16% jit_opt_after_cconv.c_1 : 0.000023s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000064s : 0.62% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000521s : 4.97% symbol_engine_optimizer.build : 0.000005s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000040s : 0.39% Time group info: ------[substitution.] 0.000374 23 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.62% : 0.000006s : 3: substitution.graph_param_transform 89.62% : 0.000335s : 4: substitution.inline 0.88% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.57% : 0.000006s : 4: substitution.remove_not_recompute_node 1.70% : 0.000006s : 2: substitution.replace_old_param 3.69% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005503 2 82.96% : 0.004565s : 1: type_inference.infer 17.04% : 0.000938s : 1: type_inference.specialize ------[replace.] 0.000084 6 65.53% : 0.000055s : 4: replace.inline 34.47% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000344 6 96.38% : 0.000332s : 4: match.inline 3.62% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 1.26% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000002s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.06% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 3: predicate.elim_not_effective 0.83% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.98% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.53% : 0.000008s : 22: predicate.inline 1.10% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.64% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 2.38% : 0.000003s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.88% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.08% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.36% : 0.000002s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 6: predicate.special_op_eliminate 0.86% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 1.89% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 5.26% : 0.000007s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000708 13 51.07% : 0.000362s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.79% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.14% : 0.000291s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016642 72 0.41% : 0.000068s : 1: add_recomputation 0.40% : 0.000067s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.24% : 0.000373s : 1: bootstrap 0.20% : 0.000033s : 1: cconv 0.06% : 0.000011s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000010s : 1: graph_reusing 35.74% : 0.005947s : 1: jit_opt_a 0.98% : 0.000163s : 1: jit_opt_after_cconv 0.39% : 0.000065s : 1: jit_opt_b 3.32% : 0.000553s : 1: loop_unroll 4.58% : 0.000761s : 1: mutable_eliminate 6.36% : 0.001059s : 26: opt.transform.jit_opt_a 0.31% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000032s : 4: opt.transform.jit_opt_b 0.10% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000017s : 1: opt.transform.mutable_eliminate 0.15% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.21% : 0.000534s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000043s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.77% : 0.000460s : 1: renormalize.infer 2.17% : 0.000361s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000050s : 1: rewriter_after_opt_a 0.52% : 0.000087s : 1: rewriter_before_opt_a 0.49% : 0.000082s : 1: symbol_engine_optimizer 33.62% : 0.005595s : 1: type_inference TotalTime = 0.139206, [30] [bootstrap]: 0.0003769 [type_inference]: 0.122957 [event_method]: 2.319e-05 [auto_monad]: 6.539e-05 [graph_reusing]: 5.27001e-06 [pre_auto_parallel]: 2.17001e-06 [py_interpret_to_execute]: 0.0005978 [rewriter_before_opt_a]: 9.645e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.012413, [2] [Cycle 1]: 0.0084117, [27] [switch_simplify]: 5.296e-05 [loop_unroll]: 3.396e-05 [a_1]: 0.00065864 [with_stream_mark]: 1.347e-05 [recompute_prepare]: 7.87998e-06 [updatestate_depend_eliminate]: 2.85002e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 7.57998e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.85002e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 2.53998e-06 [cell_reuse_recompute_pass]: 8.60018e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.256e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00727483 [add_forward_monad_depend]: 1.007e-05 [auto_monad_grad]: 3.26999e-06 [auto_monad_eliminator]: 2.268e-05 [cse]: 3.81e-05 [replace_applicator]: 2.619e-05 [Cycle 2]: 0.00052128, [27] [switch_simplify]: 8.12998e-06 [loop_unroll]: 8.62e-06 [a_1]: 0.00017558 [with_stream_mark]: 1.907e-05 [recompute_prepare]: 6.79001e-06 [updatestate_depend_eliminate]: 4.15999e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.19999e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 8.99998e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 7.64002e-06 [merge_forward]: 4.45999e-06 [cell_reuse_recompute_pass]: 4.48001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.878e-05 [j_node_and_user_rematch]: 1.119e-05 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 6.74999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 1.67001e-06 [auto_monad_eliminator]: 8.74e-06 [cse]: 1.963e-05 [replace_applicator]: 6.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.701e-05 [rewriter_after_opt_a]: 4.448e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.48002e-06 [mutable_eliminate]: 0.00079087 [jit_opt_b]: 5.808e-05, [1] [Cycle 1]: 4.977e-05, [2] [frontend_op_eliminate]: 1.971e-05 [inline_after_opt_a]: 1.882e-05 [cconv]: 3.163e-05 [loop_unroll]: 0.00045177 [jit_opt_after_cconv]: 0.0002371, [1] [Cycle 1]: 0.00022973, [11] [c_1]: 2.619e-05 [parameter_eliminate]: 3.26999e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [cse]: 2.894e-05 [call_graph_tuple_transform]: 2.263e-05 [tuple_list_get_item_eliminator]: 7.479e-05 [none_parameter_eliminate]: 2.19999e-06 [renormalize]: 9.39996e-07 [switch_simplify]: 7.4e-06 [remove_dup_value]: 2.02e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 1.001e-05 [add_recomputation]: 5.581e-05 [cse_after_recomputation]: 2.823e-05, [1] [Cycle 1]: 2.218e-05, [1] [cse]: 1.554e-05 [auto_monad_reorder]: 1.789e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 7.15e-06 [opt_after_jit_grad]: 0.00054269 [symbol_engine_optimizer]: 8.055e-05, [1] [Cycle 1]: 7.454e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 9.24998e-06 [elim_not_effective]: 1.505e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.037e-05 [renormalize]: 5.00004e-07 [validate]: 5.032e-05 Sums bootstrap : 0.000377s : 0.28% type_inference : 0.122957s : 91.05% event_method : 0.000023s : 0.02% auto_monad : 0.000065s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000598s : 0.44% rewriter_before_opt_a : 0.000096s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000834s : 0.62% jit_opt_a.with_stream_mark : 0.000033s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.007275s : 5.39% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000058s : 0.04% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000044s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000791s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000452s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000075s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000543s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000243 28 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 4: substitution.graph_param_transform 80.15% : 0.000194s : 5: substitution.inline 1.83% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.58% : 0.000014s : 3: substitution.reduce_eliminate 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 2.42% : 0.000006s : 2: substitution.replace_old_param 3.81% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122870 2 97.47% : 0.119760s : 1: type_inference.infer 2.53% : 0.003110s : 1: type_inference.specialize ------[replace.] 0.000099 7 67.26% : 0.000067s : 5: replace.inline 32.74% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 7 95.95% : 0.000191s : 5: match.inline 4.05% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.53% : 0.000003s : 13: predicate.accumulaten_eliminater 0.79% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.84% : 0.000003s : 13: predicate.addn_zero_filter 4.07% : 0.000007s : 13: predicate.arithmetic_simplify 1.75% : 0.000003s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.44% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.52% : 0.000003s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 4.18% : 0.000007s : 28: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.26% : 0.000004s : 8: predicate.less_batch_normalization 2.19% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 1.62% : 0.000003s : 19: predicate.load_eliminater 0.85% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.62% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.00% : 0.000002s : 13: predicate.minmaximum_grad 1.62% : 0.000003s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 1.95% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 3.57% : 0.000006s : 13: predicate.reduce_eliminate 1.24% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.65% : 0.000003s : 13: predicate.reshape_eliminate 1.56% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.71% : 0.000003s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000002s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.15% : 0.000004s : 20: predicate.switch_defer_inline 1.81% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.02% : 0.000010s : 64: predicate.switch_simplify 1.13% : 0.000002s : 13: predicate.tile_eliminate 1.61% : 0.000003s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 2.02% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.86% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.42% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.41% : 0.000004s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002935 25 60.28% : 0.001769s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.13% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.58% : 0.001103s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147714 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000069s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000401s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 8.41% : 0.012416s : 1: jit_opt_a 0.16% : 0.000241s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.31% : 0.000460s : 1: loop_unroll 0.54% : 0.000802s : 1: mutable_eliminate 0.74% : 0.001098s : 26: opt.transform.jit_opt_a 0.09% : 0.000127s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000605s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 4.11% : 0.006068s : 1: renormalize.infer 0.81% : 0.001196s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000048s : 1: rewriter_after_opt_a 0.07% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 83.25% : 0.122977s : 1: type_inference TotalTime = 0.126921, [30] [bootstrap]: 0.00027656 [type_inference]: 0.115215 [event_method]: 2.052e-05 [auto_monad]: 6.99e-05 [graph_reusing]: 6.69001e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 0.0004933 [rewriter_before_opt_a]: 8.961e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00804534, [2] [Cycle 1]: 0.00411038, [27] [switch_simplify]: 6.107e-05 [loop_unroll]: 3.029e-05 [a_1]: 0.0006205 [with_stream_mark]: 2.263e-05 [recompute_prepare]: 1.023e-05 [updatestate_depend_eliminate]: 3.92002e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.88999e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 7.28999e-06 [merge_forward]: 4.87998e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 1.009e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 7.09001e-06 [renormalize]: 0.00297638 [add_forward_monad_depend]: 9.47001e-06 [auto_monad_grad]: 2.71999e-06 [auto_monad_eliminator]: 2.126e-05 [cse]: 3.601e-05 [replace_applicator]: 2.5e-05 [Cycle 2]: 0.00042405, [27] [switch_simplify]: 8.34998e-06 [loop_unroll]: 6.83e-06 [a_1]: 0.00013618 [with_stream_mark]: 1.552e-05 [recompute_prepare]: 6.51999e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.32001e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 3.31999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.138e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 5.75001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 7.74002e-06 [cse]: 1.258e-05 [replace_applicator]: 6.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.46e-05 [rewriter_after_opt_a]: 3.885e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 6.16e-06 [mutable_eliminate]: 0.0007699 [jit_opt_b]: 6.095e-05, [1] [Cycle 1]: 5.293e-05, [2] [frontend_op_eliminate]: 2.057e-05 [inline_after_opt_a]: 2.05e-05 [cconv]: 3.204e-05 [loop_unroll]: 0.0004466 [jit_opt_after_cconv]: 0.00017066, [1] [Cycle 1]: 0.00016423, [11] [c_1]: 2.68e-05 [parameter_eliminate]: 4.07e-06 [updatestate_depend_eliminate]: 7.33999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.85998e-06 [cse]: 2.958e-05 [call_graph_tuple_transform]: 2.347e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.601e-05 [partial_unused_args_eliminate]: 3.00998e-06 [environ_conv]: 9.77001e-06 [add_recomputation]: 0.00020153 [cse_after_recomputation]: 3.491e-05, [1] [Cycle 1]: 2.684e-05, [1] [cse]: 1.72e-05 [auto_monad_reorder]: 1.742e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 6.09001e-06 [opt_after_jit_grad]: 0.00052187 [symbol_engine_optimizer]: 8.11e-05, [1] [Cycle 1]: 7.462e-05, [6] [build]: 4.75999e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.513e-05 [opt_reshape]: 8.15e-06 [fold_const_symbol]: 1.045e-05 [renormalize]: 5.00004e-07 [validate]: 4.836e-05 Sums bootstrap : 0.000277s : 0.23% type_inference : 0.115215s : 93.87% event_method : 0.000021s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000493s : 0.40% rewriter_before_opt_a : 0.000090s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000757s : 0.62% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002976s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000770s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000447s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000202s : 0.16% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000522s : 0.43% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000240 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 4: substitution.graph_param_transform 83.10% : 0.000200s : 4: substitution.inline 1.69% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000007s : 4: substitution.remove_not_recompute_node 2.60% : 0.000006s : 2: substitution.replace_old_param 5.54% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115123 2 97.54% : 0.112286s : 1: type_inference.infer 2.46% : 0.002836s : 1: type_inference.specialize ------[replace.] 0.000078 6 66.77% : 0.000052s : 4: replace.inline 33.23% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 6 94.19% : 0.000197s : 4: match.inline 5.81% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 2.35% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.52% : 0.000001s : 4: predicate.graph_param_transform 5.79% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.53% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 0.96% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.25% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.54% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.06% : 0.000010s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.48% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002289 22 65.58% : 0.001501s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.98% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.44% : 0.000742s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130986 72 0.16% : 0.000208s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000296s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000038s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.14% : 0.008049s : 1: jit_opt_a 0.13% : 0.000173s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.35% : 0.000456s : 1: loop_unroll 0.60% : 0.000783s : 1: mutable_eliminate 0.78% : 0.001020s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000532s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000500s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.63% : 0.002130s : 1: renormalize.infer 0.64% : 0.000834s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000084s : 1: symbol_engine_optimizer 87.97% : 0.115234s : 1: type_inference TotalTime = 0.0727737, [30] [bootstrap]: 0.00030661 [type_inference]: 0.0623841 [event_method]: 2.085e-05 [auto_monad]: 7.275e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.45002e-06 [py_interpret_to_execute]: 0.0002756 [rewriter_before_opt_a]: 9.556e-05 [expand_dump_flag]: 3.50998e-06 [jit_opt_a]: 0.00720723, [2] [Cycle 1]: 0.00348496, [27] [switch_simplify]: 6.056e-05 [loop_unroll]: 3.472e-05 [a_1]: 0.00069434 [with_stream_mark]: 2.071e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.36e-06 [specialize_transform]: 7.18998e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.71999e-06 [merge_forward]: 3.79002e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.48002e-06 [replace_old_param]: 1.105e-05 [inline_without_move]: 6.20002e-06 [renormalize]: 0.00231134 [add_forward_monad_depend]: 7.93001e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 3.394e-05 [replace_applicator]: 2.018e-05 [Cycle 2]: 0.0003929, [27] [switch_simplify]: 6.89001e-06 [loop_unroll]: 6.24999e-06 [a_1]: 0.00012749 [with_stream_mark]: 1.457e-05 [recompute_prepare]: 6.69001e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.43999e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.72e-06 [cell_reuse_recompute_pass]: 3.23e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.75e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.561e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 1.424e-05 [rewriter_after_opt_a]: 3.935e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00068254 [jit_opt_b]: 5.749e-05, [1] [Cycle 1]: 5.005e-05, [2] [frontend_op_eliminate]: 1.969e-05 [inline_after_opt_a]: 1.908e-05 [cconv]: 3.21e-05 [loop_unroll]: 0.00046193 [jit_opt_after_cconv]: 0.00016701, [1] [Cycle 1]: 0.00016033, [11] [c_1]: 2.625e-05 [parameter_eliminate]: 3.25e-06 [updatestate_depend_eliminate]: 7.44002e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [cse]: 2.973e-05 [call_graph_tuple_transform]: 2.221e-05 [tuple_list_get_item_eliminator]: 7.16999e-06 [none_parameter_eliminate]: 1.95001e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.98002e-06 [remove_dup_value]: 1.986e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 9.69e-06 [add_recomputation]: 5.171e-05 [cse_after_recomputation]: 2.6e-05, [1] [Cycle 1]: 2.069e-05, [1] [cse]: 1.435e-05 [auto_monad_reorder]: 1.972e-05 [get_jit_bprop_graph]: 2.31998e-06 [rewriter_after_jit_bprop_graph]: 6.39001e-06 [opt_after_jit_grad]: 0.00048457 [symbol_engine_optimizer]: 7.754e-05, [1] [Cycle 1]: 7.125e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 9.09998e-06 [elim_not_effective]: 1.488e-05 [opt_reshape]: 6.62002e-06 [fold_const_symbol]: 1e-05 [renormalize]: 3.50003e-07 [validate]: 5.489e-05 Sums bootstrap : 0.000307s : 0.45% type_inference : 0.062384s : 90.60% event_method : 0.000021s : 0.03% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000276s : 0.40% rewriter_before_opt_a : 0.000096s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.10% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000822s : 1.19% jit_opt_a.with_stream_mark : 0.000035s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002311s : 3.36% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.03% jit_opt_a.cse : 0.000050s : 0.07% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000683s : 0.99% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000032s : 0.05% loop_unroll : 0.000462s : 0.67% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000020s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000020s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000485s : 0.70% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.08% Time group info: ------[substitution.] 0.000274 25 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 4: substitution.graph_param_transform 86.78% : 0.000237s : 5: substitution.inline 1.30% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.07% : 0.000006s : 4: substitution.remove_not_recompute_node 2.08% : 0.000006s : 2: substitution.replace_old_param 4.37% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062300 2 96.54% : 0.060145s : 1: type_inference.infer 3.46% : 0.002155s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.85% : 0.000070s : 5: replace.inline 31.15% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 95.58% : 0.000234s : 5: match.inline 4.42% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 888 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.19% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.90% : 0.000003s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_depend_swap 1.15% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.98% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 41: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.96% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 1.65% : 0.000002s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.74% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.88% : 0.000010s : 65: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004033 29 81.52% : 0.003288s : 20: func_graph_cloner_run.FuncGraphClonerGraph 2.06% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 16.42% : 0.000662s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076227 72 0.07% : 0.000054s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.42% : 0.000322s : 1: bootstrap 0.05% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000013s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.46% : 0.007211s : 1: jit_opt_a 0.22% : 0.000171s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.62% : 0.000470s : 1: loop_unroll 0.91% : 0.000693s : 1: mutable_eliminate 1.41% : 0.001075s : 26: opt.transform.jit_opt_a 0.08% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000282s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 2.03% : 0.001550s : 1: renormalize.infer 0.98% : 0.000750s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000101s : 1: rewriter_before_opt_a 0.11% : 0.000080s : 1: symbol_engine_optimizer 81.86% : 0.062398s : 1: type_inference TotalTime = 0.0185201, [30] [bootstrap]: 0.00026082 [type_inference]: 0.00840741 [event_method]: 2.122e-05 [auto_monad]: 7.079e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 4.504e-05 [rewriter_before_opt_a]: 7.972e-05 [expand_dump_flag]: 3.78999e-06 [jit_opt_a]: 0.00710519, [2] [Cycle 1]: 0.00212975, [27] [switch_simplify]: 6.327e-05 [loop_unroll]: 3.326e-05 [a_1]: 0.00074448 [with_stream_mark]: 2.1e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 4.03999e-06 [parameter_eliminate]: 2.19001e-06 [specialize_transform]: 7.14001e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.646e-05 [j_node_and_user_rematch]: 9.20001e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 5.92001e-06 [renormalize]: 0.0009195 [add_forward_monad_depend]: 5.76e-06 [auto_monad_grad]: 2.81999e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 2.945e-05 [replace_applicator]: 1.441e-05 [Cycle 2]: 0.000347, [27] [switch_simplify]: 6.33998e-06 [loop_unroll]: 5.65001e-06 [a_1]: 9.616e-05 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.35997e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 5.26002e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.92e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.455e-05 [j_node_and_user_rematch]: 9.26998e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.68999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 1.04998e-06 [auto_monad_eliminator]: 6.38e-06 [cse]: 1.565e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.454e-05 [rewriter_after_opt_a]: 4.096e-05 [convert_after_rewriter]: 7.42998e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00069267 [jit_opt_b]: 5.72e-05, [1] [Cycle 1]: 4.889e-05, [2] [frontend_op_eliminate]: 1.857e-05 [inline_after_opt_a]: 1.741e-05 [cconv]: 2.657e-05 [loop_unroll]: 0.00048856 [jit_opt_after_cconv]: 0.0001702, [1] [Cycle 1]: 0.00016287, [11] [c_1]: 2.388e-05 [parameter_eliminate]: 3.09999e-06 [updatestate_depend_eliminate]: 7.03e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 3.06001e-06 [cse]: 3.285e-05 [call_graph_tuple_transform]: 2.279e-05 [tuple_list_get_item_eliminator]: 5.97999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 3.902e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 6.58003e-06 [add_recomputation]: 5.194e-05 [cse_after_recomputation]: 2.523e-05, [1] [Cycle 1]: 1.965e-05, [1] [cse]: 1.305e-05 [auto_monad_reorder]: 1.754e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 7.23e-06 [opt_after_jit_grad]: 0.00056889 [symbol_engine_optimizer]: 7.967e-05, [1] [Cycle 1]: 7.343e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 6.86999e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 4.19997e-07 [validate]: 4.226e-05 Sums bootstrap : 0.000261s : 1.96% type_inference : 0.008407s : 63.25% event_method : 0.000021s : 0.16% auto_monad : 0.000071s : 0.53% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000045s : 0.34% rewriter_before_opt_a : 0.000080s : 0.60% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.52% jit_opt_a.loop_unroll : 0.000039s : 0.29% jit_opt_a.a_1 : 0.000841s : 6.32% jit_opt_a.with_stream_mark : 0.000031s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000920s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000045s : 0.34% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000041s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000693s : 5.21% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.13% cconv : 0.000027s : 0.20% loop_unroll : 0.000489s : 3.68% jit_opt_after_cconv.c_1 : 0.000024s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000039s : 0.29% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000052s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000569s : 4.28% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.32% Time group info: ------[substitution.] 0.000284 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000007s : 3: substitution.graph_param_transform 86.34% : 0.000245s : 5: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000006s : 4: substitution.remove_not_recompute_node 1.63% : 0.000005s : 2: substitution.replace_old_param 4.92% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008342 2 87.75% : 0.007320s : 1: type_inference.infer 12.25% : 0.001022s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.53% : 0.000068s : 5: replace.inline 32.47% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.10% : 0.000242s : 5: match.inline 4.90% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.42% : 0.000002s : 11: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.27% : 0.000002s : 11: predicate.addn_zero_filter 2.06% : 0.000003s : 11: predicate.arithmetic_simplify 1.42% : 0.000002s : 11: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000002s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.19% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 6.04% : 0.000008s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 16: predicate.load_eliminater 1.23% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.23% : 0.000002s : 11: predicate.minmaximum_grad 1.27% : 0.000002s : 3: predicate.mutable_eliminate 0.75% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.29% : 0.000002s : 11: predicate.print_const_string_wrapper 1.97% : 0.000003s : 11: predicate.reduce_eliminate 1.72% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.50% : 0.000010s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.56% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.54% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000779 16 46.52% : 0.000362s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.42% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.06% : 0.000335s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020587 72 0.26% : 0.000055s : 1: add_recomputation 0.36% : 0.000074s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.35% : 0.000279s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 34.53% : 0.007109s : 1: jit_opt_a 0.84% : 0.000173s : 1: jit_opt_after_cconv 0.29% : 0.000060s : 1: jit_opt_b 2.42% : 0.000497s : 1: loop_unroll 3.41% : 0.000702s : 1: mutable_eliminate 5.24% : 0.001078s : 26: opt.transform.jit_opt_a 0.27% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.80% : 0.000577s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000042s : 1: remove_dup_value 2.60% : 0.000535s : 1: renormalize.infer 1.82% : 0.000375s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000044s : 1: rewriter_after_opt_a 0.40% : 0.000083s : 1: rewriter_before_opt_a 0.40% : 0.000082s : 1: symbol_engine_optimizer 40.90% : 0.008420s : 1: type_inference TotalTime = 0.134118, [30] [bootstrap]: 0.00040566 [type_inference]: 0.121781 [event_method]: 2.393e-05 [auto_monad]: 7.286e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00048512 [rewriter_before_opt_a]: 9.536e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00851496, [2] [Cycle 1]: 0.00448524, [27] [switch_simplify]: 6.441e-05 [loop_unroll]: 3.478e-05 [a_1]: 0.00071876 [with_stream_mark]: 2.021e-05 [recompute_prepare]: 9.01998e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.48999e-06 [updatestate_useless_node_eliminater]: 6.18002e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 6.66e-06 [merge_forward]: 3.62002e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.548e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00325944 [add_forward_monad_depend]: 8.22998e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.997e-05 [cse]: 3.678e-05 [replace_applicator]: 1.943e-05 [Cycle 2]: 0.00047777, [27] [switch_simplify]: 6.98998e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00013703 [with_stream_mark]: 4.359e-05 [recompute_prepare]: 7.35e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 6.71999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.85002e-06 [merge_forward]: 4.14002e-06 [cell_reuse_recompute_pass]: 2.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 9.85002e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.71998e-06 [auto_monad_grad]: 1.49e-06 [auto_monad_eliminator]: 9.13002e-06 [cse]: 1.722e-05 [replace_applicator]: 6.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.572e-05 [rewriter_after_opt_a]: 4.112e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00085506 [jit_opt_b]: 6.237e-05, [1] [Cycle 1]: 5.3e-05, [2] [frontend_op_eliminate]: 2.09e-05 [inline_after_opt_a]: 1.953e-05 [cconv]: 3.391e-05 [loop_unroll]: 0.0004823 [jit_opt_after_cconv]: 0.00017638, [1] [Cycle 1]: 0.00016923, [11] [c_1]: 2.627e-05 [parameter_eliminate]: 4.11001e-06 [updatestate_depend_eliminate]: 8.89e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 3.44001e-06 [cse]: 3.184e-05 [call_graph_tuple_transform]: 2.504e-05 [tuple_list_get_item_eliminator]: 7.12002e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.21998e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 9.71e-06 [add_recomputation]: 5.603e-05 [cse_after_recomputation]: 2.592e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.391e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 6.82002e-06 [opt_after_jit_grad]: 0.00050381 [symbol_engine_optimizer]: 0.000143, [1] [Cycle 1]: 0.00013642, [6] [build]: 5.06002e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 1.553e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 6.92e-05 [renormalize]: 3.80009e-07 [validate]: 5.603e-05 Sums bootstrap : 0.000406s : 0.31% type_inference : 0.121781s : 93.76% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000485s : 0.37% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000856s : 0.66% jit_opt_a.with_stream_mark : 0.000064s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003260s : 2.51% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000855s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000482s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000504s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000069s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.04% Time group info: ------[substitution.] 0.000293 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000006s : 4: substitution.graph_param_transform 83.21% : 0.000244s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.70% : 0.000014s : 3: substitution.reduce_eliminate 1.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000006s : 2: substitution.replace_old_param 3.84% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121700 2 97.40% : 0.118539s : 1: type_inference.infer 2.60% : 0.003161s : 1: type_inference.specialize ------[replace.] 0.000103 7 67.83% : 0.000070s : 5: replace.inline 32.17% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.94% : 0.000241s : 5: match.inline 4.06% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.62% : 0.000002s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.50% : 0.000002s : 13: predicate.cast_eliminate 0.75% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.05% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.88% : 0.000009s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.84% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 2.06% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.76% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002787 25 66.11% : 0.001842s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.99% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.90% : 0.000861s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138616 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.31% : 0.000430s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.15% : 0.008519s : 1: jit_opt_a 0.13% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.35% : 0.000491s : 1: loop_unroll 0.63% : 0.000867s : 1: mutable_eliminate 0.80% : 0.001114s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000097s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000492s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.68% : 0.002330s : 1: renormalize.infer 0.66% : 0.000917s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.11% : 0.000146s : 1: symbol_engine_optimizer 87.87% : 0.121802s : 1: type_inference TotalTime = 0.0164569, [30] [bootstrap]: 0.00030472 [type_inference]: 0.00771055 [event_method]: 1.94e-05 [auto_monad]: 6.679e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 4.22e-05 [rewriter_before_opt_a]: 7.972e-05 [expand_dump_flag]: 3.20998e-06 [jit_opt_a]: 0.00578712, [2] [Cycle 1]: 0.00192232, [27] [switch_simplify]: 6.203e-05 [loop_unroll]: 3.389e-05 [a_1]: 0.00065876 [with_stream_mark]: 2.11e-05 [recompute_prepare]: 1.031e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 2.34999e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 8.89998e-06 [inline_without_move]: 5.76e-06 [renormalize]: 0.00079617 [add_forward_monad_depend]: 6.16998e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.403e-05 [cse]: 2.502e-05 [replace_applicator]: 1.555e-05 [Cycle 2]: 0.00034348, [27] [switch_simplify]: 5.71998e-06 [loop_unroll]: 5.30001e-06 [a_1]: 0.00010264 [with_stream_mark]: 1.175e-05 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 4.64998e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.143e-05 [j_node_and_user_rematch]: 7.69002e-06 [meta_fg_expand]: 1.83997e-06 [replace_old_param]: 8.00999e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.79998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.355e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.328e-05 [rewriter_after_opt_a]: 3.694e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00067008 [jit_opt_b]: 5.352e-05, [1] [Cycle 1]: 4.566e-05, [2] [frontend_op_eliminate]: 1.729e-05 [inline_after_opt_a]: 1.607e-05 [cconv]: 2.561e-05 [loop_unroll]: 0.00048348 [jit_opt_after_cconv]: 0.00016367, [1] [Cycle 1]: 0.00015679, [11] [c_1]: 2.108e-05 [parameter_eliminate]: 1.90001e-06 [updatestate_depend_eliminate]: 7.65e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 2.846e-05 [call_graph_tuple_transform]: 1.786e-05 [tuple_list_get_item_eliminator]: 1.725e-05 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 1.592e-05 [partial_unused_args_eliminate]: 2.13002e-06 [environ_conv]: 5.69e-06 [add_recomputation]: 4.808e-05 [cse_after_recomputation]: 2.577e-05, [1] [Cycle 1]: 2.025e-05, [1] [cse]: 1.368e-05 [auto_monad_reorder]: 7.309e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 6.17999e-06 [opt_after_jit_grad]: 0.00051386 [symbol_engine_optimizer]: 7.621e-05, [1] [Cycle 1]: 6.996e-05, [6] [build]: 3.47002e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.76e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 4.00003e-07 [validate]: 3.946e-05 Sums bootstrap : 0.000305s : 2.47% type_inference : 0.007711s : 62.48% event_method : 0.000019s : 0.16% auto_monad : 0.000067s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000042s : 0.34% rewriter_before_opt_a : 0.000080s : 0.65% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.55% jit_opt_a.loop_unroll : 0.000039s : 0.32% jit_opt_a.a_1 : 0.000761s : 6.17% jit_opt_a.with_stream_mark : 0.000033s : 0.27% jit_opt_a.recompute_prepare : 0.000016s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000796s : 6.45% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000039s : 0.31% jit_opt_a.replace_applicator : 0.000022s : 0.18% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000037s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000670s : 5.43% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000483s : 3.92% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000017s : 0.14% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.11% auto_monad_reorder : 0.000073s : 0.59% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000514s : 4.16% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.32% Time group info: ------[substitution.] 0.000267 27 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 3: substitution.graph_param_transform 83.70% : 0.000223s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.41% : 0.000012s : 3: substitution.reduce_eliminate 1.66% : 0.000004s : 4: substitution.remove_not_recompute_node 1.53% : 0.000004s : 2: substitution.replace_old_param 4.27% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007642 2 86.41% : 0.006603s : 1: type_inference.infer 13.59% : 0.001039s : 1: type_inference.specialize ------[replace.] 0.000092 7 67.41% : 0.000062s : 5: replace.inline 32.59% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 95.52% : 0.000220s : 5: match.inline 4.48% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.46% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000002s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.77% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000001s : 11: predicate.environ_get_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.01% : 0.000003s : 16: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.24% : 0.000002s : 11: predicate.minmaximum_grad 1.15% : 0.000001s : 3: predicate.mutable_eliminate 0.88% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 16: predicate.partial_eliminate 1.23% : 0.000002s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.34% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 11: predicate.reshape_eliminate 1.25% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.02% : 0.000010s : 59: predicate.switch_simplify 1.23% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.31% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.91% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000769 16 45.45% : 0.000349s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.66% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.89% : 0.000345s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018314 72 0.28% : 0.000051s : 1: add_recomputation 0.38% : 0.000070s : 1: auto_monad 0.43% : 0.000078s : 1: auto_monad_reorder 1.75% : 0.000320s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.62% : 0.005791s : 1: jit_opt_a 0.91% : 0.000166s : 1: jit_opt_after_cconv 0.31% : 0.000056s : 1: jit_opt_b 2.69% : 0.000492s : 1: loop_unroll 3.71% : 0.000679s : 1: mutable_eliminate 5.41% : 0.000990s : 26: opt.transform.jit_opt_a 0.32% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.85% : 0.000521s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000045s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.33% : 0.000428s : 1: renormalize.infer 1.97% : 0.000360s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000041s : 1: rewriter_after_opt_a 0.45% : 0.000083s : 1: rewriter_before_opt_a 0.43% : 0.000078s : 1: symbol_engine_optimizer 42.17% : 0.007724s : 1: type_inference TotalTime = 0.134914, [30] [bootstrap]: 0.00032367 [type_inference]: 0.122275 [event_method]: 1.99e-05 [auto_monad]: 7.804e-05 [graph_reusing]: 6.46999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00057877 [rewriter_before_opt_a]: 9.398e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.00878593, [2] [Cycle 1]: 0.00417508, [27] [switch_simplify]: 6.521e-05 [loop_unroll]: 3.03e-05 [a_1]: 0.00061955 [with_stream_mark]: 2.292e-05 [recompute_prepare]: 8.35001e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 6.45002e-06 [accelerated_algorithm]: 7.12997e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.048e-05 [inline_without_move]: 6.69001e-06 [renormalize]: 0.00306022 [add_forward_monad_depend]: 8.74e-06 [auto_monad_grad]: 2.08002e-06 [auto_monad_eliminator]: 1.949e-05 [cse]: 3.163e-05 [replace_applicator]: 2.284e-05 [Cycle 2]: 0.00040239, [27] [switch_simplify]: 8.28999e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00014039 [with_stream_mark]: 1.642e-05 [recompute_prepare]: 6.36e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.56998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.992e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.76998e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 6.42001e-06 [cse]: 1.191e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 4.701e-05 [convert_after_rewriter]: 8.54e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00080031 [jit_opt_b]: 5.971e-05, [1] [Cycle 1]: 5.09e-05, [2] [frontend_op_eliminate]: 2.044e-05 [inline_after_opt_a]: 1.946e-05 [cconv]: 3.342e-05 [loop_unroll]: 0.00052777 [jit_opt_after_cconv]: 0.00017637, [1] [Cycle 1]: 0.00016973, [11] [c_1]: 2.948e-05 [parameter_eliminate]: 4.42e-06 [updatestate_depend_eliminate]: 8.32e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 2.953e-05 [call_graph_tuple_transform]: 2.436e-05 [tuple_list_get_item_eliminator]: 7.10998e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 6.71e-06 [remove_dup_value]: 1.54e-05 [partial_unused_args_eliminate]: 3.8e-06 [environ_conv]: 9.95002e-06 [add_recomputation]: 5.609e-05 [cse_after_recomputation]: 2.461e-05, [1] [Cycle 1]: 1.842e-05, [1] [cse]: 1.22e-05 [auto_monad_reorder]: 1.554e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 6.39999e-06 [opt_after_jit_grad]: 0.00059292 [symbol_engine_optimizer]: 8.95e-05, [1] [Cycle 1]: 8.221e-05, [6] [build]: 4.17998e-06 [elim_shapecalc]: 1.061e-05 [elim_not_effective]: 1.683e-05 [opt_reshape]: 8.25999e-06 [fold_const_symbol]: 1.183e-05 [renormalize]: 3.80009e-07 [validate]: 5.379e-05 Sums bootstrap : 0.000324s : 0.25% type_inference : 0.122275s : 94.01% event_method : 0.000020s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000579s : 0.44% rewriter_before_opt_a : 0.000094s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000760s : 0.58% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003060s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000047s : 0.04% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000800s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000033s : 0.03% loop_unroll : 0.000528s : 0.41% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000593s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.04% Time group info: ------[substitution.] 0.000243 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 3.00% : 0.000007s : 4: substitution.graph_param_transform 83.81% : 0.000204s : 4: substitution.inline 1.59% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000006s : 4: substitution.remove_not_recompute_node 2.37% : 0.000006s : 2: substitution.replace_old_param 5.14% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.122168 2 97.52% : 0.119142s : 1: type_inference.infer 2.48% : 0.003026s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.10% : 0.000053s : 4: replace.inline 31.90% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.65% : 0.000201s : 4: match.inline 5.35% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 0.99% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.97% : 0.000009s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.49% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000002s : 12: predicate.minmaximum_grad 2.06% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.66% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.15% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 1.83% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.65% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002266 22 62.50% : 0.001416s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.30% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.20% : 0.000798s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.139064 72 0.04% : 0.000059s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000344s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.32% : 0.008789s : 1: jit_opt_a 0.13% : 0.000179s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.39% : 0.000537s : 1: loop_unroll 0.58% : 0.000811s : 1: mutable_eliminate 0.73% : 0.001016s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000604s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000586s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.56% : 0.002165s : 1: renormalize.infer 0.64% : 0.000883s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.07% : 0.000099s : 1: rewriter_before_opt_a 0.07% : 0.000092s : 1: symbol_engine_optimizer 87.94% : 0.122296s : 1: type_inference TotalTime = 0.0138885, [30] [bootstrap]: 0.00039885 [type_inference]: 0.00511802 [event_method]: 2.017e-05 [auto_monad]: 6.719e-05 [graph_reusing]: 6.72002e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 3.805e-05 [rewriter_before_opt_a]: 7.324e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.00523077, [2] [Cycle 1]: 0.00163286, [27] [switch_simplify]: 5.636e-05 [loop_unroll]: 3.057e-05 [a_1]: 0.00053616 [with_stream_mark]: 1.906e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.27001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.10999e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 8.49998e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 8.82e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 0.00067451 [add_forward_monad_depend]: 4.77e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.47e-05 [cse]: 2.912e-05 [replace_applicator]: 1.145e-05 [Cycle 2]: 0.00031028, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.79e-06 [a_1]: 8.899e-05 [with_stream_mark]: 8.82e-06 [recompute_prepare]: 4.79e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 4.96002e-06 [updatestate_useless_node_eliminater]: 4.70999e-06 [accelerated_algorithm]: 4.58001e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 7.65e-06 [meta_fg_expand]: 1.58997e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.74998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 5.56002e-06 [cse]: 1.082e-05 [replace_applicator]: 5.47001e-06 [py_interpret_to_execute_after_opt_a]: 1.105e-05 [rewriter_after_opt_a]: 3.522e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 6.01e-06 [mutable_eliminate]: 0.00050176 [jit_opt_b]: 4.975e-05, [1] [Cycle 1]: 4.308e-05, [2] [frontend_op_eliminate]: 1.628e-05 [inline_after_opt_a]: 1.567e-05 [cconv]: 2.377e-05 [loop_unroll]: 0.0012492 [jit_opt_after_cconv]: 0.00015204, [1] [Cycle 1]: 0.0001447, [11] [c_1]: 2.105e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 8.02e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.74001e-06 [cse]: 2.353e-05 [call_graph_tuple_transform]: 1.98e-05 [tuple_list_get_item_eliminator]: 5.68002e-06 [none_parameter_eliminate]: 1.93002e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.578e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 5.99999e-06 [add_recomputation]: 5.118e-05 [cse_after_recomputation]: 2.212e-05, [1] [Cycle 1]: 1.694e-05, [1] [cse]: 1.096e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.71e-06 [opt_after_jit_grad]: 0.00046941 [symbol_engine_optimizer]: 7.462e-05, [1] [Cycle 1]: 6.825e-05, [6] [build]: 4.35e-06 [elim_shapecalc]: 7.81001e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 4.7998e-07 [validate]: 4.003e-05 Sums bootstrap : 0.000399s : 3.98% type_inference : 0.005118s : 51.09% event_method : 0.000020s : 0.20% auto_monad : 0.000067s : 0.67% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.38% rewriter_before_opt_a : 0.000073s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.35% jit_opt_a.a_1 : 0.000625s : 6.24% jit_opt_a.with_stream_mark : 0.000028s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.16% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000675s : 6.73% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.20% jit_opt_a.cse : 0.000040s : 0.40% jit_opt_a.replace_applicator : 0.000017s : 0.17% py_interpret_to_execute_after_opt_a : 0.000011s : 0.11% rewriter_after_opt_a : 0.000035s : 0.35% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000502s : 5.01% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000024s : 0.24% loop_unroll : 0.001249s : 12.47% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000024s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000051s : 0.51% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000469s : 4.69% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.40% Time group info: ------[substitution.] 0.000212 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000006s : 3: substitution.graph_param_transform 84.17% : 0.000178s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 5.95% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005051 2 81.43% : 0.004113s : 1: type_inference.infer 18.57% : 0.000938s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.56% : 0.000044s : 4: replace.inline 33.44% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 6 93.83% : 0.000176s : 4: match.inline 6.17% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.50% : 0.000002s : 10: predicate.cast_eliminate 0.66% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.92% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.80% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.49% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000665 13 50.41% : 0.000335s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.18% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.41% : 0.000289s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015448 72 0.35% : 0.000054s : 1: add_recomputation 0.46% : 0.000070s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.74% : 0.000423s : 1: bootstrap 0.17% : 0.000026s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 33.88% : 0.005234s : 1: jit_opt_a 1.00% : 0.000155s : 1: jit_opt_after_cconv 0.34% : 0.000052s : 1: jit_opt_b 8.16% : 0.001260s : 1: loop_unroll 3.30% : 0.000510s : 1: mutable_eliminate 5.40% : 0.000834s : 26: opt.transform.jit_opt_a 0.31% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.10% : 0.000478s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.40% : 0.000371s : 1: renormalize.infer 1.92% : 0.000296s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000038s : 1: rewriter_after_opt_a 0.50% : 0.000077s : 1: rewriter_before_opt_a 0.50% : 0.000077s : 1: symbol_engine_optimizer 33.24% : 0.005135s : 1: type_inference TotalTime = 0.124453, [30] [bootstrap]: 0.00030522 [type_inference]: 0.113584 [event_method]: 2.004e-05 [auto_monad]: 4.772e-05 [graph_reusing]: 3.5e-06 [pre_auto_parallel]: 1.50999e-06 [py_interpret_to_execute]: 0.00042931 [rewriter_before_opt_a]: 9.096e-05 [expand_dump_flag]: 2.56998e-06 [jit_opt_a]: 0.0077927, [2] [Cycle 1]: 0.00422682, [27] [switch_simplify]: 6.794e-05 [loop_unroll]: 3.391e-05 [a_1]: 0.00075379 [with_stream_mark]: 2.229e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.66001e-06 [updatestate_loads_eliminate]: 3.30003e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.60003e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 1.186e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.067e-05 [inline_without_move]: 6.86999e-06 [renormalize]: 0.00298017 [add_forward_monad_depend]: 6.68e-06 [auto_monad_grad]: 1.72999e-06 [auto_monad_eliminator]: 1.633e-05 [cse]: 3.177e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.0003654, [27] [switch_simplify]: 6.78998e-06 [loop_unroll]: 6.49999e-06 [a_1]: 0.00012119 [with_stream_mark]: 1.208e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.51002e-06 [accelerated_algorithm]: 5.51998e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.32997e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 8.19998e-06 [inline_without_move]: 5.46998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.358e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.24e-05 [rewriter_after_opt_a]: 3.393e-05 [convert_after_rewriter]: 5.86e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00058603 [jit_opt_b]: 5.346e-05, [1] [Cycle 1]: 4.744e-05, [2] [frontend_op_eliminate]: 1.841e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 1.839e-05 [loop_unroll]: 0.0004143 [jit_opt_after_cconv]: 0.00015245, [1] [Cycle 1]: 0.00014632, [11] [c_1]: 2.501e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.49998e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.373e-05 [call_graph_tuple_transform]: 1.996e-05 [tuple_list_get_item_eliminator]: 6.43998e-06 [none_parameter_eliminate]: 1.26002e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 7.03e-06 [remove_dup_value]: 1.386e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 7.28999e-06 [add_recomputation]: 3.702e-05 [cse_after_recomputation]: 2.321e-05, [1] [Cycle 1]: 1.81e-05, [1] [cse]: 1.269e-05 [auto_monad_reorder]: 1.266e-05 [get_jit_bprop_graph]: 1.71002e-06 [rewriter_after_jit_bprop_graph]: 4.2e-06 [opt_after_jit_grad]: 0.00045688 [symbol_engine_optimizer]: 0.0001149, [1] [Cycle 1]: 6.695e-05, [6] [build]: 2.92002e-06 [elim_shapecalc]: 8.99998e-06 [elim_not_effective]: 1.349e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 4.30009e-07 [validate]: 4.289e-05 Sums bootstrap : 0.000305s : 0.25% type_inference : 0.113584s : 94.17% event_method : 0.000020s : 0.02% auto_monad : 0.000048s : 0.04% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000429s : 0.36% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000875s : 0.73% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002980s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000586s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000018s : 0.02% loop_unroll : 0.000414s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000457s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000302 25 0.42% : 0.000001s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.78% : 0.000005s : 4: substitution.graph_param_transform 88.18% : 0.000266s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.42% : 0.000004s : 2: substitution.replace_old_param 4.65% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113513 2 97.67% : 0.110863s : 1: type_inference.infer 2.33% : 0.002650s : 1: type_inference.specialize ------[replace.] 0.000102 7 69.51% : 0.000071s : 5: replace.inline 30.49% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000276 7 95.33% : 0.000263s : 5: match.inline 4.67% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.49% : 0.000008s : 28: predicate.inline 1.08% : 0.000002s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.09% : 0.000002s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.40% : 0.000002s : 13: predicate.print_const_string_wrapper 1.59% : 0.000002s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 23: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.45% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000004s : 20: predicate.switch_defer_inline 2.57% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.75% : 0.000011s : 64: predicate.switch_simplify 1.59% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.79% : 0.000003s : 13: predicate.value_based_eliminate 0.46% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002344 25 66.26% : 0.001553s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.79% : 0.000089s : 2: func_graph_cloner_run.FuncGraphClonerNode 29.95% : 0.000702s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128631 72 0.03% : 0.000040s : 1: add_recomputation 0.04% : 0.000051s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000324s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.06% : 0.007796s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.33% : 0.000422s : 1: loop_unroll 0.46% : 0.000595s : 1: mutable_eliminate 0.88% : 0.001131s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.34% : 0.000436s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.41% : 0.001811s : 1: renormalize.infer 0.90% : 0.001160s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.09% : 0.000117s : 1: symbol_engine_optimizer 88.31% : 0.113600s : 1: type_inference TotalTime = 0.130301, [30] [bootstrap]: 0.00036158 [type_inference]: 0.118879 [event_method]: 2.101e-05 [auto_monad]: 6.742e-05 [graph_reusing]: 5.52999e-06 [pre_auto_parallel]: 2.09999e-06 [py_interpret_to_execute]: 0.00052222 [rewriter_before_opt_a]: 9.584e-05 [expand_dump_flag]: 3.95998e-06 [jit_opt_a]: 0.00786024, [2] [Cycle 1]: 0.00396634, [27] [switch_simplify]: 5.999e-05 [loop_unroll]: 3.449e-05 [a_1]: 0.00069977 [with_stream_mark]: 1.884e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.84001e-06 [merge_forward]: 4.06001e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 6.48003e-06 [renormalize]: 0.00280717 [add_forward_monad_depend]: 7.26001e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.568e-05 [cse]: 2.735e-05 [replace_applicator]: 1.67e-05 [Cycle 2]: 0.00037929, [27] [switch_simplify]: 6.87002e-06 [loop_unroll]: 6.44999e-06 [a_1]: 0.00013208 [with_stream_mark]: 1.243e-05 [recompute_prepare]: 5.90002e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 8.71002e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.98998e-06 [cse]: 1.391e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.38e-05 [rewriter_after_opt_a]: 3.858e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.00001e-06 [mutable_eliminate]: 0.00062181 [jit_opt_b]: 7.194e-05, [1] [Cycle 1]: 6.47e-05, [2] [frontend_op_eliminate]: 3.433e-05 [inline_after_opt_a]: 1.84e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.00042468 [jit_opt_after_cconv]: 0.00014994, [1] [Cycle 1]: 0.0001438, [11] [c_1]: 2.572e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.237e-05 [call_graph_tuple_transform]: 1.993e-05 [tuple_list_get_item_eliminator]: 6.22001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.88998e-06 [remove_dup_value]: 1.528e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 8.17e-06 [add_recomputation]: 4.637e-05 [cse_after_recomputation]: 2.305e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.197e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.00062428 [symbol_engine_optimizer]: 8.004e-05, [1] [Cycle 1]: 7.39e-05, [6] [build]: 3.91999e-06 [elim_shapecalc]: 8.74e-06 [elim_not_effective]: 1.292e-05 [opt_reshape]: 8.74e-06 [fold_const_symbol]: 1.018e-05 [renormalize]: 4.39992e-07 [validate]: 0.00011142 Sums bootstrap : 0.000362s : 0.29% type_inference : 0.118879s : 94.21% event_method : 0.000021s : 0.02% auto_monad : 0.000067s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000522s : 0.41% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000832s : 0.66% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002807s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000622s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000034s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000425s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000624s : 0.49% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000111s : 0.09% Time group info: ------[substitution.] 0.000277 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.93% : 0.000003s : 2: substitution.fold_const_symbol 1.98% : 0.000005s : 4: substitution.graph_param_transform 83.59% : 0.000232s : 5: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.37% : 0.000012s : 3: substitution.reduce_eliminate 1.67% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000005s : 2: substitution.replace_old_param 3.98% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118805 2 97.56% : 0.115907s : 1: type_inference.infer 2.44% : 0.002898s : 1: type_inference.specialize ------[replace.] 0.000098 7 68.83% : 0.000067s : 5: replace.inline 31.17% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 7 95.88% : 0.000229s : 5: match.inline 4.12% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000008s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 19: predicate.load_eliminater 1.07% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.16% : 0.000010s : 64: predicate.switch_simplify 1.19% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002640 25 69.30% : 0.001830s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.92% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.78% : 0.000733s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134200 72 0.04% : 0.000049s : 1: add_recomputation 0.05% : 0.000071s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.29% : 0.000383s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.86% : 0.007863s : 1: jit_opt_a 0.11% : 0.000153s : 1: jit_opt_after_cconv 0.06% : 0.000074s : 1: jit_opt_b 0.32% : 0.000432s : 1: loop_unroll 0.47% : 0.000630s : 1: mutable_eliminate 0.80% : 0.001075s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000046s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000633s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000530s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.52% : 0.002039s : 1: renormalize.infer 0.56% : 0.000758s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 88.59% : 0.118895s : 1: type_inference TotalTime = 0.123527, [30] [bootstrap]: 0.00028098 [type_inference]: 0.111602 [event_method]: 2.383e-05 [auto_monad]: 7.508e-05 [graph_reusing]: 6.25002e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00060529 [rewriter_before_opt_a]: 9.99e-05 [expand_dump_flag]: 4.11001e-06 [jit_opt_a]: 0.00830084, [2] [Cycle 1]: 0.00437945, [27] [switch_simplify]: 7.768e-05 [loop_unroll]: 6.315e-05 [a_1]: 0.00080944 [with_stream_mark]: 1.991e-05 [recompute_prepare]: 8.82999e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.59002e-06 [updatestate_loads_eliminate]: 3.73999e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.40002e-06 [accelerated_algorithm]: 6.77002e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.613e-05 [j_node_and_user_rematch]: 9.80002e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.057e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00303396 [add_forward_monad_depend]: 8.25999e-06 [auto_monad_grad]: 2.83998e-06 [auto_monad_eliminator]: 1.777e-05 [cse]: 3.657e-05 [replace_applicator]: 1.815e-05 [Cycle 2]: 0.00039678, [27] [switch_simplify]: 7.8e-06 [loop_unroll]: 6.17999e-06 [a_1]: 0.00014141 [with_stream_mark]: 1.261e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.67002e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.349e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.339e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.477e-05 [rewriter_after_opt_a]: 6.561e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00069692 [jit_opt_b]: 8.343e-05, [1] [Cycle 1]: 7.593e-05, [2] [frontend_op_eliminate]: 1.888e-05 [inline_after_opt_a]: 4.449e-05 [cconv]: 2.815e-05 [loop_unroll]: 0.00044782 [jit_opt_after_cconv]: 0.00015849, [1] [Cycle 1]: 0.0001521, [11] [c_1]: 2.591e-05 [parameter_eliminate]: 3.37002e-06 [updatestate_depend_eliminate]: 6.24999e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.401e-05 [call_graph_tuple_transform]: 2.228e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.94999e-06 [remove_dup_value]: 1.731e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 9.09998e-06 [add_recomputation]: 4.967e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.923e-05, [1] [cse]: 1.349e-05 [auto_monad_reorder]: 1.681e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 5.74999e-06 [opt_after_jit_grad]: 0.00046718 [symbol_engine_optimizer]: 7.668e-05, [1] [Cycle 1]: 7.069e-05, [6] [build]: 4.00998e-06 [elim_shapecalc]: 9.17999e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 7.08e-06 [fold_const_symbol]: 9.72999e-06 [renormalize]: 3.39991e-07 [validate]: 0.00014888 Sums bootstrap : 0.000281s : 0.24% type_inference : 0.111602s : 93.48% event_method : 0.000024s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000605s : 0.51% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000085s : 0.07% jit_opt_a.loop_unroll : 0.000069s : 0.06% jit_opt_a.a_1 : 0.000951s : 0.80% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003034s : 2.54% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000066s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000697s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000044s : 0.04% cconv : 0.000028s : 0.02% loop_unroll : 0.000448s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000467s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000149s : 0.12% Time group info: ------[substitution.] 0.000332 28 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.90% : 0.000006s : 4: substitution.graph_param_transform 85.95% : 0.000285s : 5: substitution.inline 1.03% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.59% : 0.000012s : 3: substitution.reduce_eliminate 1.48% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_old_param 3.15% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111518 2 97.35% : 0.108563s : 1: type_inference.infer 2.65% : 0.002955s : 1: type_inference.specialize ------[replace.] 0.000106 7 69.24% : 0.000073s : 5: replace.inline 30.76% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000291 7 96.81% : 0.000282s : 5: match.inline 3.19% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 886 0.99% : 0.000002s : 13: predicate.accumulaten_eliminater 0.61% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.86% : 0.000002s : 13: predicate.addn_check_dump 1.11% : 0.000002s : 13: predicate.addn_zero_filter 1.60% : 0.000003s : 13: predicate.arithmetic_simplify 1.01% : 0.000002s : 13: predicate.cast_eliminate 0.32% : 0.000001s : 4: predicate.check_bprop_eliminate 0.87% : 0.000002s : 13: predicate.compare_switch_simplify 0.96% : 0.000002s : 13: predicate.depend_value_elim 0.92% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.27% : 0.000001s : 4: predicate.elim_not_effective 0.37% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.89% : 0.000002s : 13: predicate.environ_get_depend_swap 0.92% : 0.000002s : 13: predicate.environ_get_eliminate 0.86% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 0.70% : 0.000001s : 8: predicate.get_grad_eliminate 0.17% : 0.000000s : 4: predicate.graph_param_transform 18.11% : 0.000034s : 28: predicate.inline 0.70% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.91% : 0.000002s : 8: predicate.less_batch_normalization 1.18% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.45% : 0.000003s : 19: predicate.load_eliminater 0.98% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.96% : 0.000006s : 40: predicate.loop_unroll_before_grad 9.85% : 0.000018s : 17: predicate.make_slice_get_slice_eliminator 0.88% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 1.15% : 0.000002s : 4: predicate.mutable_eliminate 0.39% : 0.000001s : 4: predicate.opt_reshape 1.61% : 0.000003s : 19: predicate.partial_eliminate 1.02% : 0.000002s : 13: predicate.print_const_string_wrapper 1.72% : 0.000003s : 13: predicate.reduce_eliminate 1.11% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.55% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.23% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.53% : 0.000001s : 4: predicate.row_tensor_eliminate 0.96% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.67% : 0.000001s : 8: predicate.special_op_eliminate 0.75% : 0.000001s : 8: predicate.specialize_transform 1.12% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000004s : 20: predicate.switch_defer_inline 1.67% : 0.000003s : 20: predicate.switch_layer_defer_inline 5.67% : 0.000011s : 64: predicate.switch_simplify 1.17% : 0.000002s : 13: predicate.tile_eliminate 1.11% : 0.000002s : 13: predicate.transpose_eliminate 1.18% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.88% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.29% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.21% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.24% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.29% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.21% : 0.000002s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.39% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002423 25 61.49% : 0.001490s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.50% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.01% : 0.000848s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127792 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000295s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.50% : 0.008305s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.07% : 0.000086s : 1: jit_opt_b 0.36% : 0.000458s : 1: loop_unroll 0.55% : 0.000707s : 1: mutable_eliminate 0.97% : 0.001245s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000057s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000617s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.63% : 0.002082s : 1: renormalize.infer 0.74% : 0.000940s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000069s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 87.35% : 0.111622s : 1: type_inference TotalTime = 0.0728309, [30] [bootstrap]: 0.00037206 [type_inference]: 0.0620582 [event_method]: 2.364e-05 [auto_monad]: 7.869e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 3.00002e-06 [py_interpret_to_execute]: 0.00028933 [rewriter_before_opt_a]: 0.00011002 [expand_dump_flag]: 3.65e-06 [jit_opt_a]: 0.00762881, [2] [Cycle 1]: 0.00350303, [27] [switch_simplify]: 6.844e-05 [loop_unroll]: 3.531e-05 [a_1]: 0.00071286 [with_stream_mark]: 2.513e-05 [recompute_prepare]: 9.39e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.71001e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 7.98999e-06 [updatestate_useless_node_eliminater]: 6.31998e-06 [accelerated_algorithm]: 7e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 4.17003e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 6.48e-06 [renormalize]: 0.00228359 [add_forward_monad_depend]: 6.70002e-06 [auto_monad_grad]: 2.84999e-06 [auto_monad_eliminator]: 1.648e-05 [cse]: 3.649e-05 [replace_applicator]: 2.074e-05 [Cycle 2]: 0.00037892, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.19001e-06 [a_1]: 0.00012344 [with_stream_mark]: 1.231e-05 [recompute_prepare]: 6.03002e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.68998e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.65998e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.698e-05 [j_node_and_user_rematch]: 9.06002e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.526e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.387e-05 [rewriter_after_opt_a]: 4.459e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00057598 [jit_opt_b]: 5.374e-05, [1] [Cycle 1]: 4.687e-05, [2] [frontend_op_eliminate]: 1.865e-05 [inline_after_opt_a]: 1.813e-05 [cconv]: 2.559e-05 [loop_unroll]: 0.000428 [jit_opt_after_cconv]: 0.00015896, [1] [Cycle 1]: 0.00015247, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.727e-05 [call_graph_tuple_transform]: 2.17e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.916e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.61e-06 [add_recomputation]: 5.45e-05 [cse_after_recomputation]: 2.579e-05, [1] [Cycle 1]: 1.968e-05, [1] [cse]: 1.397e-05 [auto_monad_reorder]: 1.819e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00046755 [symbol_engine_optimizer]: 7.587e-05, [1] [Cycle 1]: 6.941e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.98002e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 6.14001e-06 [fold_const_symbol]: 9.66e-06 [renormalize]: 3.69997e-07 [validate]: 7.708e-05 Sums bootstrap : 0.000372s : 0.54% type_inference : 0.062058s : 90.62% event_method : 0.000024s : 0.03% auto_monad : 0.000079s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000289s : 0.42% rewriter_before_opt_a : 0.000110s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.11% jit_opt_a.loop_unroll : 0.000041s : 0.06% jit_opt_a.a_1 : 0.000836s : 1.22% jit_opt_a.with_stream_mark : 0.000037s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002284s : 3.33% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000052s : 0.08% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000045s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000576s : 0.84% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000428s : 0.62% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.08% cse_after_recomputation.cse : 0.000014s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000468s : 0.68% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000077s : 0.11% Time group info: ------[substitution.] 0.000278 25 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 4: substitution.graph_param_transform 87.11% : 0.000242s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.87% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 4.36% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.061959 2 96.42% : 0.059741s : 1: type_inference.infer 3.58% : 0.002218s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.82% : 0.000073s : 5: replace.inline 31.18% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 7 95.66% : 0.000239s : 5: match.inline 4.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 888 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 1.72% : 0.000002s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.78% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 41: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 1.80% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.35% : 0.000011s : 65: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.36% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002624 29 71.21% : 0.001869s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.07% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 25.73% : 0.000675s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.076249 72 0.08% : 0.000058s : 1: add_recomputation 0.11% : 0.000082s : 1: auto_monad 0.03% : 0.000021s : 1: auto_monad_reorder 0.51% : 0.000392s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.01% : 0.007632s : 1: jit_opt_a 0.21% : 0.000162s : 1: jit_opt_after_cconv 0.07% : 0.000056s : 1: jit_opt_b 0.57% : 0.000436s : 1: loop_unroll 0.77% : 0.000585s : 1: mutable_eliminate 1.44% : 0.001100s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000295s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000022s : 1: remove_dup_value 2.03% : 0.001545s : 1: renormalize.infer 0.96% : 0.000728s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000048s : 1: rewriter_after_opt_a 0.15% : 0.000115s : 1: rewriter_before_opt_a 0.10% : 0.000078s : 1: symbol_engine_optimizer 81.41% : 0.062076s : 1: type_inference TotalTime = 0.132499, [30] [bootstrap]: 0.00027711 [type_inference]: 0.121657 [event_method]: 2.409e-05 [auto_monad]: 7.139e-05 [graph_reusing]: 6.27001e-06 [pre_auto_parallel]: 2.00002e-06 [py_interpret_to_execute]: 0.000461 [rewriter_before_opt_a]: 8.781e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.00754298, [2] [Cycle 1]: 0.00358188, [27] [switch_simplify]: 5.281e-05 [loop_unroll]: 3.126e-05 [a_1]: 0.00057335 [with_stream_mark]: 1.398e-05 [recompute_prepare]: 9.92999e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 7.98001e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 6.69999e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 9.82999e-06 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00257924 [add_forward_monad_depend]: 1.084e-05 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.528e-05 [cse]: 2.222e-05 [replace_applicator]: 1.64e-05 [Cycle 2]: 0.00037391, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 6.33e-06 [a_1]: 0.00012556 [with_stream_mark]: 1.089e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.28002e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.27997e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.29e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.139e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.159e-05 [rewriter_after_opt_a]: 3.506e-05 [convert_after_rewriter]: 6.34999e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00062409 [jit_opt_b]: 5.875e-05, [1] [Cycle 1]: 5.099e-05, [2] [frontend_op_eliminate]: 2.273e-05 [inline_after_opt_a]: 1.728e-05 [cconv]: 2.483e-05 [loop_unroll]: 0.00043709 [jit_opt_after_cconv]: 0.00021962, [1] [Cycle 1]: 0.00021283, [11] [c_1]: 2.589e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.005e-05 [call_graph_tuple_transform]: 2.313e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 6.13002e-06 [remove_dup_value]: 1.509e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 8.15e-06 [add_recomputation]: 4.612e-05 [cse_after_recomputation]: 2.507e-05, [1] [Cycle 1]: 1.935e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.513e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 5.08002e-06 [opt_after_jit_grad]: 0.0004782 [symbol_engine_optimizer]: 7.642e-05, [1] [Cycle 1]: 7.03e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 1.408e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 9.72001e-06 [renormalize]: 4.89992e-07 [validate]: 8.007e-05 Sums bootstrap : 0.000277s : 0.22% type_inference : 0.121657s : 94.86% event_method : 0.000024s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000461s : 0.36% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000699s : 0.54% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002579s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000624s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000437s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000478s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000080s : 0.06% Time group info: ------[substitution.] 0.000207 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 3.90% : 0.000008s : 4: substitution.graph_param_transform 81.98% : 0.000170s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 6.09% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121571 2 97.72% : 0.118794s : 1: type_inference.infer 2.28% : 0.002776s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.28% : 0.000051s : 4: replace.inline 32.72% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.60% : 0.000167s : 4: match.inline 6.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.87% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 2.27% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000009s : 58: predicate.switch_simplify 1.48% : 0.000002s : 12: predicate.tile_eliminate 1.55% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.18% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.011322 22 93.78% : 0.010617s : 15: func_graph_cloner_run.FuncGraphClonerGraph 0.27% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 5.95% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136049 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000296s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.55% : 0.007546s : 1: jit_opt_a 0.16% : 0.000222s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.33% : 0.000445s : 1: loop_unroll 0.47% : 0.000633s : 1: mutable_eliminate 0.69% : 0.000934s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000467s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.36% : 0.001852s : 1: renormalize.infer 0.53% : 0.000719s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000094s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 89.44% : 0.121677s : 1: type_inference TotalTime = 0.019627, [30] [bootstrap]: 0.00034754 [type_inference]: 0.00958194 [event_method]: 2.305e-05 [auto_monad]: 7.031e-05 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 4.269e-05 [rewriter_before_opt_a]: 8.519e-05 [expand_dump_flag]: 3.62998e-06 [jit_opt_a]: 0.00705903, [2] [Cycle 1]: 0.00217903, [27] [switch_simplify]: 6.938e-05 [loop_unroll]: 3.32e-05 [a_1]: 0.00071153 [with_stream_mark]: 2.61e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 1.01e-05 [inline_without_move]: 5.59e-06 [renormalize]: 0.00095653 [add_forward_monad_depend]: 7.41999e-06 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 1.995e-05 [cse]: 4.388e-05 [replace_applicator]: 1.56e-05 [Cycle 2]: 0.00034687, [27] [switch_simplify]: 6.30002e-06 [loop_unroll]: 5.25999e-06 [a_1]: 9.207e-05 [with_stream_mark]: 1.226e-05 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.21002e-06 [meta_shard_fg_expand]: 1.76003e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.71002e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 7.50003e-06 [cse]: 1.702e-05 [replace_applicator]: 6.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.542e-05 [rewriter_after_opt_a]: 4.16e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00071531 [jit_opt_b]: 5.435e-05, [1] [Cycle 1]: 4.602e-05, [2] [frontend_op_eliminate]: 1.716e-05 [inline_after_opt_a]: 1.655e-05 [cconv]: 2.794e-05 [loop_unroll]: 0.00042704 [jit_opt_after_cconv]: 0.00015957, [1] [Cycle 1]: 0.00015189, [11] [c_1]: 2.132e-05 [parameter_eliminate]: 3.56999e-06 [updatestate_depend_eliminate]: 7e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 3.158e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 4.312e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 6.46999e-06 [add_recomputation]: 5.807e-05 [cse_after_recomputation]: 2.681e-05, [1] [Cycle 1]: 2.069e-05, [1] [cse]: 1.435e-05 [auto_monad_reorder]: 1.848e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 5.51e-06 [opt_after_jit_grad]: 0.00047087 [symbol_engine_optimizer]: 7.575e-05, [1] [Cycle 1]: 6.896e-05, [6] [build]: 4.05e-06 [elim_shapecalc]: 8.14997e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 3.39991e-07 [validate]: 4.435e-05 Sums bootstrap : 0.000348s : 2.40% type_inference : 0.009582s : 66.25% event_method : 0.000023s : 0.16% auto_monad : 0.000070s : 0.49% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.30% rewriter_before_opt_a : 0.000085s : 0.59% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000076s : 0.52% jit_opt_a.loop_unroll : 0.000038s : 0.27% jit_opt_a.a_1 : 0.000804s : 5.56% jit_opt_a.with_stream_mark : 0.000038s : 0.27% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000957s : 6.61% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.19% jit_opt_a.cse : 0.000061s : 0.42% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000042s : 0.29% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000715s : 4.95% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.11% cconv : 0.000028s : 0.19% loop_unroll : 0.000427s : 2.95% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000032s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000043s : 0.30% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000058s : 0.40% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000471s : 3.26% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.31% Time group info: ------[substitution.] 0.000307 24 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000002s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 3: substitution.graph_param_transform 87.24% : 0.000268s : 5: substitution.inline 1.54% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.75% : 0.000005s : 2: substitution.replace_old_param 4.55% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009507 2 89.01% : 0.008463s : 1: type_inference.infer 10.99% : 0.001044s : 1: type_inference.specialize ------[replace.] 0.000101 7 68.84% : 0.000070s : 5: replace.inline 31.16% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000278 7 95.40% : 0.000265s : 5: match.inline 4.60% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.13% : 0.000001s : 11: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 11: predicate.addn_check_dump 1.19% : 0.000002s : 11: predicate.addn_zero_filter 1.88% : 0.000002s : 11: predicate.arithmetic_simplify 1.31% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.29% : 0.000002s : 11: predicate.environ_get_eliminate 1.25% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.14% : 0.000008s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 6: predicate.less_batch_normalization 1.67% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 16: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000002s : 11: predicate.minmaximum_grad 1.99% : 0.000003s : 3: predicate.mutable_eliminate 0.72% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000002s : 11: predicate.print_const_string_wrapper 1.78% : 0.000002s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 19: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.07% : 0.000011s : 59: predicate.switch_simplify 1.19% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000002s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000898 16 50.94% : 0.000457s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.22% : 0.000092s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.84% : 0.000349s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021671 72 0.28% : 0.000061s : 1: add_recomputation 0.34% : 0.000074s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.69% : 0.000366s : 1: bootstrap 0.14% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000029s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.59% : 0.007063s : 1: jit_opt_a 0.75% : 0.000162s : 1: jit_opt_after_cconv 0.26% : 0.000057s : 1: jit_opt_b 2.01% : 0.000436s : 1: loop_unroll 3.35% : 0.000726s : 1: mutable_eliminate 4.83% : 0.001047s : 26: opt.transform.jit_opt_a 0.23% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.21% : 0.000479s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.21% : 0.000046s : 1: remove_dup_value 2.51% : 0.000544s : 1: renormalize.infer 1.86% : 0.000403s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000045s : 1: rewriter_after_opt_a 0.41% : 0.000088s : 1: rewriter_before_opt_a 0.36% : 0.000078s : 1: symbol_engine_optimizer 44.30% : 0.009601s : 1: type_inference TotalTime = 0.126901, [30] [bootstrap]: 0.00038446 [type_inference]: 0.115191 [event_method]: 2.507e-05 [auto_monad]: 7.546e-05 [graph_reusing]: 6.57002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00056009 [rewriter_before_opt_a]: 9.936e-05 [expand_dump_flag]: 3.438e-05 [jit_opt_a]: 0.00813956, [2] [Cycle 1]: 0.00421939, [27] [switch_simplify]: 6.155e-05 [loop_unroll]: 3.447e-05 [a_1]: 0.00073831 [with_stream_mark]: 2.364e-05 [recompute_prepare]: 9.05001e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 7.55998e-06 [updatestate_useless_node_eliminater]: 6.52001e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 7.08e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 1.066e-05 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00298542 [add_forward_monad_depend]: 6.46e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.784e-05 [cse]: 3.595e-05 [replace_applicator]: 1.86e-05 [Cycle 2]: 0.00042952, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00016963 [with_stream_mark]: 1.367e-05 [recompute_prepare]: 6.41e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.01998e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.83002e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 2.73e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.322e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 1.031e-05 [inline_without_move]: 5.52999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 1.21002e-06 [auto_monad_eliminator]: 6.51999e-06 [cse]: 1.542e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.415e-05 [rewriter_after_opt_a]: 3.839e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00070391 [jit_opt_b]: 5.648e-05, [1] [Cycle 1]: 4.805e-05, [2] [frontend_op_eliminate]: 1.909e-05 [inline_after_opt_a]: 1.811e-05 [cconv]: 2.741e-05 [loop_unroll]: 0.00043387 [jit_opt_after_cconv]: 0.00015689, [1] [Cycle 1]: 0.00015044, [11] [c_1]: 2.527e-05 [parameter_eliminate]: 3.23998e-06 [updatestate_depend_eliminate]: 6.36998e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.432e-05 [call_graph_tuple_transform]: 2.224e-05 [tuple_list_get_item_eliminator]: 6.23e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 8.55999e-06 [add_recomputation]: 5.391e-05 [cse_after_recomputation]: 2.36e-05, [1] [Cycle 1]: 1.816e-05, [1] [cse]: 1.248e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 6.06e-06 [opt_after_jit_grad]: 0.00047336 [symbol_engine_optimizer]: 7.521e-05, [1] [Cycle 1]: 6.887e-05, [6] [build]: 4.03999e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 4.80009e-07 [validate]: 4.803e-05 Sums bootstrap : 0.000384s : 0.31% type_inference : 0.115191s : 93.83% event_method : 0.000025s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000560s : 0.46% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000034s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000908s : 0.74% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002985s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000704s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000434s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000473s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000315 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 2.11% : 0.000007s : 4: substitution.graph_param_transform 84.33% : 0.000266s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.17% : 0.000013s : 3: substitution.reduce_eliminate 1.54% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000006s : 2: substitution.replace_old_param 3.70% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115106 2 97.41% : 0.112126s : 1: type_inference.infer 2.59% : 0.002980s : 1: type_inference.specialize ------[replace.] 0.000102 7 69.03% : 0.000071s : 5: replace.inline 30.97% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 96.14% : 0.000263s : 5: match.inline 3.86% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.58% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.61% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.38% : 0.000002s : 8: predicate.get_grad_eliminate 0.56% : 0.000001s : 4: predicate.graph_param_transform 5.89% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000003s : 19: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.08% : 0.000002s : 13: predicate.print_const_string_wrapper 2.49% : 0.000004s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.67% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002434 25 62.58% : 0.001523s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.39% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.03% : 0.000828s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131108 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.30% : 0.000399s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.03% : 0.000038s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.21% : 0.008144s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.34% : 0.000442s : 1: loop_unroll 0.54% : 0.000713s : 1: mutable_eliminate 0.88% : 0.001158s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000568s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.62% : 0.002122s : 1: renormalize.infer 0.65% : 0.000854s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.07% : 0.000096s : 1: symbol_engine_optimizer 87.88% : 0.115216s : 1: type_inference TotalTime = 0.126228, [30] [bootstrap]: 0.00029692 [type_inference]: 0.114258 [event_method]: 2.396e-05 [auto_monad]: 7.559e-05 [graph_reusing]: 6.46999e-06 [pre_auto_parallel]: 3.21999e-06 [py_interpret_to_execute]: 0.00053213 [rewriter_before_opt_a]: 0.00010399 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00830796, [2] [Cycle 1]: 0.00414432, [27] [switch_simplify]: 6.341e-05 [loop_unroll]: 3.506e-05 [a_1]: 0.00069483 [with_stream_mark]: 2.058e-05 [recompute_prepare]: 9.63002e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 6.86999e-06 [accelerated_algorithm]: 7.2e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 6.98e-06 [merge_forward]: 0.00019411 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.355e-05 [j_node_and_user_rematch]: 1.211e-05 [meta_fg_expand]: 2.86999e-06 [replace_old_param]: 1.088e-05 [inline_without_move]: 7.29001e-06 [renormalize]: 0.00272532 [add_forward_monad_depend]: 8.64e-06 [auto_monad_grad]: 3.46001e-06 [auto_monad_eliminator]: 2.006e-05 [cse]: 4.033e-05 [replace_applicator]: 1.854e-05 [Cycle 2]: 0.0003965, [27] [switch_simplify]: 7.21999e-06 [loop_unroll]: 6.14999e-06 [a_1]: 0.00013407 [with_stream_mark]: 1.411e-05 [recompute_prepare]: 6.48998e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 2.10002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.785e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 5.92001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.72999e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.443e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 1.616e-05 [rewriter_after_opt_a]: 4.277e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00081135 [jit_opt_b]: 6.148e-05, [1] [Cycle 1]: 5.3e-05, [2] [frontend_op_eliminate]: 2.138e-05 [inline_after_opt_a]: 1.988e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00047623 [jit_opt_after_cconv]: 0.00017536, [1] [Cycle 1]: 0.00016871, [11] [c_1]: 2.843e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 6.46e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 3.251e-05 [call_graph_tuple_transform]: 2.447e-05 [tuple_list_get_item_eliminator]: 7.13998e-06 [none_parameter_eliminate]: 2.09999e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 6.92002e-06 [remove_dup_value]: 1.858e-05 [partial_unused_args_eliminate]: 3.19001e-06 [environ_conv]: 9.62999e-06 [add_recomputation]: 5.329e-05 [cse_after_recomputation]: 2.618e-05, [1] [Cycle 1]: 2.03e-05, [1] [cse]: 1.407e-05 [auto_monad_reorder]: 1.853e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 6.34001e-06 [opt_after_jit_grad]: 0.00050252 [symbol_engine_optimizer]: 8.286e-05, [1] [Cycle 1]: 7.508e-05, [6] [build]: 3.71001e-06 [elim_shapecalc]: 9.58002e-06 [elim_not_effective]: 1.55e-05 [opt_reshape]: 7.38e-06 [fold_const_symbol]: 9.57999e-06 [renormalize]: 3.60014e-07 [validate]: 7.506e-05 Sums bootstrap : 0.000297s : 0.24% type_inference : 0.114258s : 93.79% event_method : 0.000024s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000532s : 0.44% rewriter_before_opt_a : 0.000104s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000829s : 0.68% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000198s : 0.16% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002725s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000811s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000476s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000503s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000075s : 0.06% Time group info: ------[substitution.] 0.000249 25 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 3.01% : 0.000007s : 4: substitution.graph_param_transform 84.80% : 0.000211s : 5: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000006s : 4: substitution.remove_not_recompute_node 1.97% : 0.000005s : 2: substitution.replace_old_param 4.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114167 2 97.46% : 0.111271s : 1: type_inference.infer 2.54% : 0.002896s : 1: type_inference.specialize ------[replace.] 0.000103 7 69.67% : 0.000072s : 5: replace.inline 30.33% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 7 95.08% : 0.000208s : 5: match.inline 4.92% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.13% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 1.75% : 0.000003s : 13: predicate.arithmetic_simplify 1.18% : 0.000002s : 13: predicate.cast_eliminate 0.37% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.06% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.06% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.09% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.73% : 0.000008s : 28: predicate.inline 0.97% : 0.000002s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.00% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.38% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000004s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 1.65% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.52% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.25% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000004s : 20: predicate.switch_defer_inline 1.82% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.78% : 0.000011s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.14% : 0.000002s : 13: predicate.transpose_eliminate 11.07% : 0.000018s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.32% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002289 25 62.23% : 0.001424s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.53% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.24% : 0.000807s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130105 72 0.04% : 0.000057s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000316s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.39% : 0.008312s : 1: jit_opt_a 0.14% : 0.000178s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.37% : 0.000485s : 1: loop_unroll 0.63% : 0.000822s : 1: mutable_eliminate 0.84% : 0.001097s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000539s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.42% : 0.001850s : 1: renormalize.infer 0.66% : 0.000864s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000110s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 87.83% : 0.114277s : 1: type_inference TotalTime = 0.155195, [30] [bootstrap]: 0.0003332 [type_inference]: 0.143253 [event_method]: 2.6e-05 [auto_monad]: 7.541e-05 [graph_reusing]: 6.58e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00058437 [rewriter_before_opt_a]: 0.00010123 [expand_dump_flag]: 3.52997e-06 [jit_opt_a]: 0.00836492, [2] [Cycle 1]: 0.0042904, [27] [switch_simplify]: 6.722e-05 [loop_unroll]: 3.521e-05 [a_1]: 0.00078571 [with_stream_mark]: 2.544e-05 [recompute_prepare]: 9.12999e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.98998e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.56999e-06 [meta_shard_fg_expand]: 2.91e-06 [get_grad_eliminate_]: 6.58998e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.635e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.013e-05 [inline_without_move]: 6.66e-06 [renormalize]: 0.00298624 [add_forward_monad_depend]: 8.37998e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.876e-05 [cse]: 3.572e-05 [replace_applicator]: 1.947e-05 [Cycle 2]: 0.00038856, [27] [switch_simplify]: 7.13998e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.0001349 [with_stream_mark]: 1.393e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.46001e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.385e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.03e-06 [cse]: 1.354e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.641e-05 [rewriter_after_opt_a]: 4.064e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00073776 [jit_opt_b]: 5.829e-05, [1] [Cycle 1]: 4.958e-05, [2] [frontend_op_eliminate]: 1.983e-05 [inline_after_opt_a]: 1.822e-05 [cconv]: 3.035e-05 [loop_unroll]: 0.00042941 [jit_opt_after_cconv]: 0.00015457, [1] [Cycle 1]: 0.00014713, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 6.95002e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.344e-05 [call_graph_tuple_transform]: 2.224e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.621e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 8.47998e-06 [add_recomputation]: 5.442e-05 [cse_after_recomputation]: 2.36e-05, [1] [Cycle 1]: 1.835e-05, [1] [cse]: 1.271e-05 [auto_monad_reorder]: 1.826e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.00046439 [symbol_engine_optimizer]: 7.787e-05, [1] [Cycle 1]: 7.148e-05, [6] [build]: 4.28999e-06 [elim_shapecalc]: 8.59998e-06 [elim_not_effective]: 1.394e-05 [opt_reshape]: 7.4e-06 [fold_const_symbol]: 9.06998e-06 [renormalize]: 3.69997e-07 [validate]: 0.00010105 Sums bootstrap : 0.000333s : 0.22% type_inference : 0.143253s : 94.94% event_method : 0.000026s : 0.02% auto_monad : 0.000075s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000584s : 0.39% rewriter_before_opt_a : 0.000101s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000921s : 0.61% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002986s : 1.98% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000049s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000738s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000429s : 0.28% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000464s : 0.31% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000101s : 0.07% Time group info: ------[substitution.] 0.000307 28 0.61% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.96% : 0.000006s : 4: substitution.graph_param_transform 84.74% : 0.000260s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.11% : 0.000013s : 3: substitution.reduce_eliminate 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.68% : 0.000005s : 2: substitution.replace_old_param 3.68% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.143157 2 97.85% : 0.140085s : 1: type_inference.infer 2.15% : 0.003072s : 1: type_inference.specialize ------[replace.] 0.000152 7 49.95% : 0.000076s : 5: replace.inline 50.05% : 0.000076s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 7 96.21% : 0.000257s : 5: match.inline 3.79% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.60% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.16% : 0.000002s : 13: predicate.environ_get_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.18% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.71% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002601 25 61.78% : 0.001607s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.38% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.84% : 0.000906s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.159368 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000349s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.25% : 0.008368s : 1: jit_opt_a 0.10% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000061s : 1: jit_opt_b 0.27% : 0.000437s : 1: loop_unroll 0.47% : 0.000747s : 1: mutable_eliminate 0.74% : 0.001175s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000473s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000592s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.29% : 0.002057s : 1: renormalize.infer 0.58% : 0.000918s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000107s : 1: rewriter_before_opt_a 0.05% : 0.000080s : 1: symbol_engine_optimizer 89.90% : 0.143278s : 1: type_inference TotalTime = 0.130799, [30] [bootstrap]: 0.00028919 [type_inference]: 0.120341 [event_method]: 2.034e-05 [auto_monad]: 7.411e-05 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00044585 [rewriter_before_opt_a]: 8.606e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00730287, [2] [Cycle 1]: 0.00356132, [27] [switch_simplify]: 5.211e-05 [loop_unroll]: 4.337e-05 [a_1]: 0.00061582 [with_stream_mark]: 1.302e-05 [recompute_prepare]: 9.20001e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 8.10018e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.232e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.36998e-06 [inline_without_move]: 6.40002e-06 [renormalize]: 0.00251241 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.40001e-06 [auto_monad_eliminator]: 1.204e-05 [cse]: 2.209e-05 [replace_applicator]: 1.464e-05 [Cycle 2]: 0.00035492, [27] [switch_simplify]: 6.56999e-06 [loop_unroll]: 5.66e-06 [a_1]: 0.0001212 [with_stream_mark]: 9.19998e-06 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 2.68998e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.91e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.373e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 5.74e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 6.12001e-06 [cse]: 1.124e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 8.21002e-06 [rewriter_after_opt_a]: 2.945e-05 [convert_after_rewriter]: 6.48003e-06 [order_py_execute_after_rewriter]: 4.31002e-06 [mutable_eliminate]: 0.00059497 [jit_opt_b]: 5.512e-05, [1] [Cycle 1]: 4.868e-05, [2] [frontend_op_eliminate]: 1.925e-05 [inline_after_opt_a]: 1.795e-05 [cconv]: 1.597e-05 [loop_unroll]: 0.00043365 [jit_opt_after_cconv]: 0.00014612, [1] [Cycle 1]: 0.00013984, [11] [c_1]: 2.513e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.78002e-06 [updatestate_assign_eliminate]: 2.80002e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.955e-05 [call_graph_tuple_transform]: 1.939e-05 [tuple_list_get_item_eliminator]: 6.64001e-06 [none_parameter_eliminate]: 1.04e-06 [renormalize]: 1.39989e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.042e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 6.83998e-06 [add_recomputation]: 3.515e-05 [cse_after_recomputation]: 2.13e-05, [1] [Cycle 1]: 1.611e-05, [1] [cse]: 1.043e-05 [auto_monad_reorder]: 6.989e-05 [get_jit_bprop_graph]: 1.64e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00048872 [symbol_engine_optimizer]: 7.754e-05, [1] [Cycle 1]: 7.114e-05, [6] [build]: 3.41001e-06 [elim_shapecalc]: 9.10001e-06 [elim_not_effective]: 1.42e-05 [opt_reshape]: 6.75002e-06 [fold_const_symbol]: 9.82001e-06 [renormalize]: 2.40019e-07 [validate]: 3.674e-05 Sums bootstrap : 0.000289s : 0.23% type_inference : 0.120341s : 94.88% event_method : 0.000020s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000446s : 0.35% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000049s : 0.04% jit_opt_a.a_1 : 0.000737s : 0.58% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002512s : 1.98% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.01% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000029s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000595s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000016s : 0.01% loop_unroll : 0.000434s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000070s : 0.06% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000489s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000239 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.05% : 0.000005s : 4: substitution.graph_param_transform 87.13% : 0.000209s : 4: substitution.inline 1.13% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.59% : 0.000004s : 2: substitution.replace_old_param 4.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120259 2 97.66% : 0.117439s : 1: type_inference.infer 2.34% : 0.002820s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.39% : 0.000048s : 4: replace.inline 34.61% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 6 95.09% : 0.000206s : 4: match.inline 4.91% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.52% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002159 22 67.25% : 0.001452s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.44% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.31% : 0.000654s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134369 72 0.03% : 0.000038s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.05% : 0.000073s : 1: auto_monad_reorder 0.23% : 0.000305s : 1: bootstrap 0.01% : 0.000019s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.44% : 0.007306s : 1: jit_opt_a 0.11% : 0.000149s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.33% : 0.000442s : 1: loop_unroll 0.45% : 0.000604s : 1: mutable_eliminate 0.73% : 0.000978s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000496s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000453s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.34% : 0.001807s : 1: renormalize.infer 0.52% : 0.000698s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000032s : 1: rewriter_after_opt_a 0.07% : 0.000092s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 89.58% : 0.120361s : 1: type_inference TotalTime = 0.122352, [30] [bootstrap]: 0.00030093 [type_inference]: 0.110915 [event_method]: 2.422e-05 [auto_monad]: 7.394e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00055698 [rewriter_before_opt_a]: 9.715e-05 [expand_dump_flag]: 4.41002e-06 [jit_opt_a]: 0.00795324, [2] [Cycle 1]: 0.00405462, [27] [switch_simplify]: 6.239e-05 [loop_unroll]: 3.443e-05 [a_1]: 0.00071332 [with_stream_mark]: 2.181e-05 [recompute_prepare]: 9.10999e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 7.05002e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 7.18e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.051e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00285038 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.98998e-06 [auto_monad_eliminator]: 1.78e-05 [cse]: 3.542e-05 [replace_applicator]: 1.903e-05 [Cycle 2]: 0.00038848, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.00013153 [with_stream_mark]: 1.274e-05 [recompute_prepare]: 6.96001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 3.21001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.23998e-06 [cse]: 1.485e-05 [replace_applicator]: 5.99e-06 [py_interpret_to_execute_after_opt_a]: 1.601e-05 [rewriter_after_opt_a]: 4.03e-05 [convert_after_rewriter]: 7.66999e-06 [order_py_execute_after_rewriter]: 4.79998e-06 [mutable_eliminate]: 0.00070665 [jit_opt_b]: 5.931e-05, [1] [Cycle 1]: 5.228e-05, [2] [frontend_op_eliminate]: 2.083e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 2.88e-05 [loop_unroll]: 0.00043761 [jit_opt_after_cconv]: 0.00015952, [1] [Cycle 1]: 0.00015287, [11] [c_1]: 2.551e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 6.86999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.596e-05 [call_graph_tuple_transform]: 2.202e-05 [tuple_list_get_item_eliminator]: 6.40002e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 9.89996e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.35002e-06 [environ_conv]: 9.58002e-06 [add_recomputation]: 5.408e-05 [cse_after_recomputation]: 2.389e-05, [1] [Cycle 1]: 1.81e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.81e-06 [opt_after_jit_grad]: 0.00051095 [symbol_engine_optimizer]: 7.441e-05, [1] [Cycle 1]: 6.846e-05, [6] [build]: 3.66001e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.249e-05 [opt_reshape]: 6.58998e-06 [fold_const_symbol]: 9.71003e-06 [renormalize]: 4.10015e-07 [validate]: 4.641e-05 Sums bootstrap : 0.000301s : 0.25% type_inference : 0.110915s : 93.81% event_method : 0.000024s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000557s : 0.47% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000845s : 0.71% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002850s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000707s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000438s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000511s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000291 28 0.58% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 4: substitution.graph_param_transform 83.59% : 0.000243s : 5: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.25% : 0.000012s : 3: substitution.reduce_eliminate 1.75% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000006s : 2: substitution.replace_old_param 3.64% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110835 2 97.27% : 0.107805s : 1: type_inference.infer 2.73% : 0.003030s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.90% : 0.000069s : 5: replace.inline 32.10% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000250 7 96.19% : 0.000241s : 5: match.inline 3.81% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.59% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 19: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.57% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.88% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002401 25 64.70% : 0.001553s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.44% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.86% : 0.000765s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126365 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000321s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.30% : 0.007956s : 1: jit_opt_a 0.13% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.35% : 0.000446s : 1: loop_unroll 0.57% : 0.000717s : 1: mutable_eliminate 0.87% : 0.001096s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000520s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000563s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.62% : 0.002041s : 1: renormalize.infer 0.63% : 0.000799s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 87.79% : 0.110935s : 1: type_inference TotalTime = 0.132149, [30] [bootstrap]: 0.00032028 [type_inference]: 0.12074 [event_method]: 2.271e-05 [auto_monad]: 7.079e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 0.00056567 [rewriter_before_opt_a]: 9.738e-05 [expand_dump_flag]: 4.37e-06 [jit_opt_a]: 0.00780175, [2] [Cycle 1]: 0.00401861, [27] [switch_simplify]: 6.743e-05 [loop_unroll]: 3.387e-05 [a_1]: 0.00076803 [with_stream_mark]: 2.316e-05 [recompute_prepare]: 1.005e-05 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 3.42002e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 7.78999e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 7.4e-06 [meta_shard_fg_expand]: 2.87002e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.32e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.802e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00273041 [add_forward_monad_depend]: 9.11002e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.834e-05 [cse]: 3.699e-05 [replace_applicator]: 2.121e-05 [Cycle 2]: 0.00043747, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 6.23e-06 [a_1]: 0.00016522 [with_stream_mark]: 1.336e-05 [recompute_prepare]: 6.94999e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 1.84998e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.757e-05 [j_node_and_user_rematch]: 9.85002e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.79e-06 [inline_without_move]: 6.02999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.44001e-06 [cse]: 1.652e-05 [replace_applicator]: 6.39001e-06 [py_interpret_to_execute_after_opt_a]: 1.509e-05 [rewriter_after_opt_a]: 4.2e-05 [convert_after_rewriter]: 7.72002e-06 [order_py_execute_after_rewriter]: 5.62999e-06 [mutable_eliminate]: 0.00072234 [jit_opt_b]: 5.956e-05, [1] [Cycle 1]: 5.148e-05, [2] [frontend_op_eliminate]: 1.938e-05 [inline_after_opt_a]: 2.051e-05 [cconv]: 2.7e-05 [loop_unroll]: 0.00045011 [jit_opt_after_cconv]: 0.00016433, [1] [Cycle 1]: 0.00015787, [11] [c_1]: 2.579e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.56998e-06 [cse]: 2.781e-05 [call_graph_tuple_transform]: 2.356e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.869e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 9.91e-06 [add_recomputation]: 5.796e-05 [cse_after_recomputation]: 2.607e-05, [1] [Cycle 1]: 2.041e-05, [1] [cse]: 1.39e-05 [auto_monad_reorder]: 1.904e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 5.35999e-06 [opt_after_jit_grad]: 0.00047836 [symbol_engine_optimizer]: 0.00015743, [1] [Cycle 1]: 0.00015095, [6] [build]: 4.22e-06 [elim_shapecalc]: 8.67e-06 [elim_not_effective]: 9.102e-05 [opt_reshape]: 7.53e-06 [fold_const_symbol]: 1.009e-05 [renormalize]: 4.10015e-07 [validate]: 5.318e-05 Sums bootstrap : 0.000320s : 0.25% type_inference : 0.120740s : 94.20% event_method : 0.000023s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000566s : 0.44% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000933s : 0.73% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002730s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000054s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000722s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000450s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000058s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000478s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000091s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.04% Time group info: ------[substitution.] 0.000280 25 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000007s : 4: substitution.graph_param_transform 86.47% : 0.000242s : 5: substitution.inline 1.34% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000007s : 4: substitution.remove_not_recompute_node 1.78% : 0.000005s : 2: substitution.replace_old_param 4.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120666 2 97.82% : 0.118036s : 1: type_inference.infer 2.18% : 0.002630s : 1: type_inference.specialize ------[replace.] 0.000104 7 67.34% : 0.000070s : 5: replace.inline 32.66% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.41% : 0.000240s : 5: match.inline 4.59% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000184 886 1.09% : 0.000002s : 13: predicate.accumulaten_eliminater 0.83% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.89% : 0.000002s : 13: predicate.addn_check_dump 1.01% : 0.000002s : 13: predicate.addn_zero_filter 1.33% : 0.000002s : 13: predicate.arithmetic_simplify 1.15% : 0.000002s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 0.88% : 0.000002s : 13: predicate.compare_switch_simplify 0.96% : 0.000002s : 13: predicate.depend_value_elim 0.95% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.89% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.98% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.64% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 4: predicate.elim_not_effective 0.42% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.95% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.83% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.85% : 0.000002s : 13: predicate.environ_get_depend_swap 0.94% : 0.000002s : 13: predicate.environ_get_eliminate 0.83% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.79% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 4.08% : 0.000007s : 28: predicate.inline 0.69% : 0.000001s : 8: predicate.inline_without_move 0.34% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.25% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.41% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.96% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.60% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.83% : 0.000002s : 13: predicate.merge_addn 0.85% : 0.000002s : 13: predicate.minmaximum_grad 1.38% : 0.000003s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 24.94% : 0.000046s : 19: predicate.partial_eliminate 0.92% : 0.000002s : 13: predicate.print_const_string_wrapper 1.36% : 0.000003s : 13: predicate.reduce_eliminate 1.04% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.65% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000001s : 4: predicate.reset_defer_inline 0.97% : 0.000002s : 13: predicate.reshape_eliminate 1.03% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 0.92% : 0.000002s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.63% : 0.000001s : 8: predicate.special_op_eliminate 0.70% : 0.000001s : 8: predicate.specialize_transform 1.03% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.05% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.05% : 0.000004s : 20: predicate.switch_defer_inline 1.81% : 0.000003s : 20: predicate.switch_layer_defer_inline 5.74% : 0.000011s : 64: predicate.switch_simplify 0.98% : 0.000002s : 13: predicate.tile_eliminate 0.98% : 0.000002s : 13: predicate.transpose_eliminate 1.09% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.00% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.14% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.11% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.12% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.25% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.25% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.11% : 0.000002s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.45% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002334 25 65.38% : 0.001526s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.44% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.18% : 0.000728s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.136223 72 0.04% : 0.000061s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.25% : 0.000340s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.73% : 0.007805s : 1: jit_opt_a 0.12% : 0.000167s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.34% : 0.000459s : 1: loop_unroll 0.54% : 0.000733s : 1: mutable_eliminate 0.88% : 0.001200s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000114s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.42% : 0.000575s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.44% : 0.001959s : 1: renormalize.infer 0.56% : 0.000762s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.07% : 0.000102s : 1: rewriter_before_opt_a 0.12% : 0.000160s : 1: symbol_engine_optimizer 88.65% : 0.120758s : 1: type_inference TotalTime = 0.118538, [30] [bootstrap]: 0.00027673 [type_inference]: 0.10636 [event_method]: 2.157e-05 [auto_monad]: 7.57e-05 [graph_reusing]: 6.43e-06 [pre_auto_parallel]: 3.25e-06 [py_interpret_to_execute]: 0.00047102 [rewriter_before_opt_a]: 9.555e-05 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00861808, [2] [Cycle 1]: 0.00409769, [27] [switch_simplify]: 6.713e-05 [loop_unroll]: 3.129e-05 [a_1]: 0.00065027 [with_stream_mark]: 2.479e-05 [recompute_prepare]: 9.62999e-06 [updatestate_depend_eliminate]: 4.97e-06 [updatestate_assign_eliminate]: 3.56001e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 2.18998e-06 [specialize_transform]: 7.67998e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 7.38e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 1.104e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.099e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 0.0029285 [add_forward_monad_depend]: 9.66998e-06 [auto_monad_grad]: 2.43998e-06 [auto_monad_eliminator]: 1.914e-05 [cse]: 3.465e-05 [replace_applicator]: 2.039e-05 [Cycle 2]: 0.00043032, [27] [switch_simplify]: 7.82e-06 [loop_unroll]: 6.48998e-06 [a_1]: 0.00012994 [with_stream_mark]: 1.505e-05 [recompute_prepare]: 6.66e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.51002e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 1.98997e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 3.44001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.82e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.87002e-06 [replace_old_param]: 9.77999e-06 [inline_without_move]: 5.56002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.62999e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 6.86001e-06 [cse]: 3.865e-05 [replace_applicator]: 7.41001e-06 [py_interpret_to_execute_after_opt_a]: 1.52e-05 [rewriter_after_opt_a]: 4.174e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 5.26002e-06 [mutable_eliminate]: 0.00073374 [jit_opt_b]: 5.979e-05, [1] [Cycle 1]: 5.151e-05, [2] [frontend_op_eliminate]: 2.041e-05 [inline_after_opt_a]: 1.827e-05 [cconv]: 3.244e-05 [loop_unroll]: 0.00045901 [jit_opt_after_cconv]: 0.00016644, [1] [Cycle 1]: 0.0001579, [11] [c_1]: 2.678e-05 [parameter_eliminate]: 3.65e-06 [updatestate_depend_eliminate]: 8.46997e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 2.613e-05 [call_graph_tuple_transform]: 2.39e-05 [tuple_list_get_item_eliminator]: 6.28998e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 7.49977e-07 [switch_simplify]: 5.93002e-06 [remove_dup_value]: 1.707e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 9.59e-06 [add_recomputation]: 5.131e-05 [cse_after_recomputation]: 2.267e-05, [1] [Cycle 1]: 1.771e-05, [1] [cse]: 1.141e-05 [auto_monad_reorder]: 9.567e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 7.29001e-06 [opt_after_jit_grad]: 0.00053642 [symbol_engine_optimizer]: 8.182e-05, [1] [Cycle 1]: 7.484e-05, [6] [build]: 4.98001e-06 [elim_shapecalc]: 8.90999e-06 [elim_not_effective]: 1.575e-05 [opt_reshape]: 7.39002e-06 [fold_const_symbol]: 9.74999e-06 [renormalize]: 3.30008e-07 [validate]: 5.513e-05 Sums bootstrap : 0.000277s : 0.24% type_inference : 0.106360s : 93.46% event_method : 0.000022s : 0.02% auto_monad : 0.000076s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000471s : 0.41% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.07% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000780s : 0.69% jit_opt_a.with_stream_mark : 0.000040s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002929s : 2.57% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000073s : 0.06% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000734s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000459s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000096s : 0.08% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000536s : 0.47% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.05% Time group info: ------[substitution.] 0.000273 24 0.92% : 0.000003s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.34% : 0.000006s : 4: substitution.graph_param_transform 85.03% : 0.000232s : 4: substitution.inline 1.88% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000007s : 2: substitution.replace_old_param 4.97% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106278 2 97.38% : 0.103490s : 1: type_inference.infer 2.62% : 0.002787s : 1: type_inference.specialize ------[replace.] 0.000081 6 69.36% : 0.000056s : 4: replace.inline 30.64% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000242 6 94.96% : 0.000229s : 4: match.inline 5.04% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.35% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000002s : 12: predicate.arithmetic_simplify 1.10% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.06% : 0.000001s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 6.32% : 0.000009s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.71% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.28% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.12% : 0.000002s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 1.92% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.75% : 0.000011s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 2.10% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002161 22 66.08% : 0.001428s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.72% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.20% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122569 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.08% : 0.000099s : 1: auto_monad_reorder 0.24% : 0.000293s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.03% : 0.008622s : 1: jit_opt_a 0.14% : 0.000169s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.38% : 0.000467s : 1: loop_unroll 0.61% : 0.000745s : 1: mutable_eliminate 0.85% : 0.001043s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000548s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000478s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.75% : 0.002145s : 1: renormalize.infer 0.63% : 0.000772s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 86.79% : 0.106380s : 1: type_inference TotalTime = 0.0182418, [30] [bootstrap]: 0.00031959 [type_inference]: 0.00946922 [event_method]: 2.096e-05 [auto_monad]: 6.97e-05 [graph_reusing]: 5.99e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 4.927e-05 [rewriter_before_opt_a]: 8.576e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00587871, [2] [Cycle 1]: 0.00203989, [27] [switch_simplify]: 6.098e-05 [loop_unroll]: 3.391e-05 [a_1]: 0.0006373 [with_stream_mark]: 1.894e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 4.14002e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.48999e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.646e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 2.43002e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 1.958e-05 [renormalize]: 0.00091224 [add_forward_monad_depend]: 6.58998e-06 [auto_monad_grad]: 2.18002e-06 [auto_monad_eliminator]: 1.805e-05 [cse]: 3.996e-05 [replace_applicator]: 1.615e-05 [Cycle 2]: 0.00033819, [27] [switch_simplify]: 6.29001e-06 [loop_unroll]: 5.17999e-06 [a_1]: 9.628e-05 [with_stream_mark]: 1.122e-05 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 4.97999e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 2.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.429e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 7.4e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 6.38998e-06 [cse]: 1.602e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.444e-05 [rewriter_after_opt_a]: 4.121e-05 [convert_after_rewriter]: 6.86999e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00067266 [jit_opt_b]: 5.155e-05, [1] [Cycle 1]: 4.408e-05, [2] [frontend_op_eliminate]: 1.693e-05 [inline_after_opt_a]: 1.59e-05 [cconv]: 2.792e-05 [loop_unroll]: 0.00043207 [jit_opt_after_cconv]: 0.00015297, [1] [Cycle 1]: 0.00014639, [11] [c_1]: 2.139e-05 [parameter_eliminate]: 2.95998e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.881e-05 [call_graph_tuple_transform]: 1.987e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 4.107e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 5.536e-05 [cse_after_recomputation]: 2.609e-05, [1] [Cycle 1]: 2.026e-05, [1] [cse]: 1.409e-05 [auto_monad_reorder]: 1.869e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.32999e-06 [opt_after_jit_grad]: 0.00046378 [symbol_engine_optimizer]: 7.431e-05, [1] [Cycle 1]: 6.789e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 5.94e-06 [fold_const_symbol]: 8.93002e-06 [renormalize]: 4.09986e-07 [validate]: 4.116e-05 Sums bootstrap : 0.000320s : 2.26% type_inference : 0.009469s : 67.02% event_method : 0.000021s : 0.15% auto_monad : 0.000070s : 0.49% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.35% rewriter_before_opt_a : 0.000086s : 0.61% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000067s : 0.48% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000734s : 5.19% jit_opt_a.with_stream_mark : 0.000030s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.12% jit_opt_a.inline_without_move : 0.000024s : 0.17% jit_opt_a.renormalize : 0.000912s : 6.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.17% jit_opt_a.cse : 0.000056s : 0.40% jit_opt_a.replace_applicator : 0.000022s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000041s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000673s : 4.76% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000028s : 0.20% loop_unroll : 0.000432s : 3.06% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000041s : 0.29% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000055s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000019s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000464s : 3.28% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.29% Time group info: ------[substitution.] 0.000247 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 3: substitution.graph_param_transform 85.54% : 0.000211s : 5: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 5.26% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009401 2 88.71% : 0.008340s : 1: type_inference.infer 11.29% : 0.001061s : 1: type_inference.specialize ------[replace.] 0.000093 7 66.53% : 0.000062s : 5: replace.inline 33.47% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 7 94.63% : 0.000208s : 5: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 747 1.15% : 0.000002s : 11: predicate.accumulaten_eliminater 0.82% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 11: predicate.addn_check_dump 1.35% : 0.000002s : 11: predicate.addn_zero_filter 1.72% : 0.000002s : 11: predicate.arithmetic_simplify 1.05% : 0.000001s : 11: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000002s : 11: predicate.compare_switch_simplify 1.20% : 0.000002s : 11: predicate.depend_value_elim 0.96% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 11: predicate.environ_get_depend_swap 1.16% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.79% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000007s : 24: predicate.inline 9.98% : 0.000014s : 6: predicate.inline_without_move 0.32% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 16: predicate.load_eliminater 1.03% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 11: predicate.merge_addn 0.96% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 16: predicate.partial_eliminate 1.39% : 0.000002s : 11: predicate.print_const_string_wrapper 1.57% : 0.000002s : 11: predicate.reduce_eliminate 1.56% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000003s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000002s : 11: predicate.same_eliminate 0.41% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.70% : 0.000010s : 59: predicate.switch_simplify 1.17% : 0.000002s : 11: predicate.tile_eliminate 1.15% : 0.000002s : 11: predicate.transpose_eliminate 1.24% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.40% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.36% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000865 16 50.41% : 0.000436s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.72% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.87% : 0.000362s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020183 72 0.29% : 0.000059s : 1: add_recomputation 0.36% : 0.000073s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.68% : 0.000340s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.14% : 0.005882s : 1: jit_opt_a 0.86% : 0.000173s : 1: jit_opt_after_cconv 0.27% : 0.000054s : 1: jit_opt_b 2.18% : 0.000440s : 1: loop_unroll 3.38% : 0.000682s : 1: mutable_eliminate 4.84% : 0.000976s : 26: opt.transform.jit_opt_a 0.24% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.10% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.34% : 0.000472s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000052s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000044s : 1: remove_dup_value 2.59% : 0.000522s : 1: renormalize.infer 1.89% : 0.000381s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000044s : 1: rewriter_after_opt_a 0.44% : 0.000089s : 1: rewriter_before_opt_a 0.38% : 0.000077s : 1: symbol_engine_optimizer 46.99% : 0.009485s : 1: type_inference TotalTime = 0.0131292, [30] [bootstrap]: 0.00030679 [type_inference]: 0.00485407 [event_method]: 1.828e-05 [auto_monad]: 6.55e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 4.012e-05 [rewriter_before_opt_a]: 7.53e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00568558, [2] [Cycle 1]: 0.00170316, [27] [switch_simplify]: 6.148e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.0005444 [with_stream_mark]: 2.02e-05 [recompute_prepare]: 7.93999e-06 [updatestate_depend_eliminate]: 3.60998e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 2.25002e-06 [specialize_transform]: 5.78002e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.02999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.431e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 0.00072751 [add_forward_monad_depend]: 5.77001e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 1.535e-05 [cse]: 2.751e-05 [replace_applicator]: 1.23e-05 [Cycle 2]: 0.00038589, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 6.89001e-06 [a_1]: 9.107e-05 [with_stream_mark]: 9.45001e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.60002e-06 [updatestate_assign_eliminate]: 2.10002e-06 [updatestate_loads_eliminate]: 1.89e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 4.79e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 7.98999e-06 [inline_without_move]: 4.99e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.54999e-06 [cse]: 1.215e-05 [replace_applicator]: 5.26002e-06 [py_interpret_to_execute_after_opt_a]: 1.11e-05 [rewriter_after_opt_a]: 3.468e-05 [convert_after_rewriter]: 6.38998e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00054344 [jit_opt_b]: 4.986e-05, [1] [Cycle 1]: 4.332e-05, [2] [frontend_op_eliminate]: 1.615e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.451e-05 [loop_unroll]: 0.00041009 [jit_opt_after_cconv]: 0.00014946, [1] [Cycle 1]: 0.00014297, [11] [c_1]: 2.024e-05 [parameter_eliminate]: 2.48002e-06 [updatestate_depend_eliminate]: 5.80002e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 1.755e-05 [call_graph_tuple_transform]: 1.877e-05 [tuple_list_get_item_eliminator]: 1.598e-05 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.49998e-06 [remove_dup_value]: 1.6e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 5.26998e-06 [add_recomputation]: 4.997e-05 [cse_after_recomputation]: 2.205e-05, [1] [Cycle 1]: 1.644e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.547e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.18002e-06 [opt_after_jit_grad]: 0.00044598 [symbol_engine_optimizer]: 7.148e-05, [1] [Cycle 1]: 6.544e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.204e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 9.03002e-06 [renormalize]: 2.69996e-07 [validate]: 3.491e-05 Sums bootstrap : 0.000307s : 3.44% type_inference : 0.004854s : 54.50% event_method : 0.000018s : 0.21% auto_monad : 0.000066s : 0.74% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000040s : 0.45% rewriter_before_opt_a : 0.000075s : 0.85% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000067s : 0.75% jit_opt_a.loop_unroll : 0.000038s : 0.42% jit_opt_a.a_1 : 0.000635s : 7.14% jit_opt_a.with_stream_mark : 0.000030s : 0.33% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000728s : 8.17% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.25% jit_opt_a.cse : 0.000040s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000035s : 0.39% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000543s : 6.10% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000025s : 0.28% loop_unroll : 0.000410s : 4.60% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000016s : 0.18% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000050s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000446s : 5.01% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.39% Time group info: ------[substitution.] 0.000219 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 3: substitution.graph_param_transform 84.40% : 0.000185s : 4: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004784 2 82.51% : 0.003947s : 1: type_inference.infer 17.49% : 0.000837s : 1: type_inference.specialize ------[replace.] 0.000066 6 65.93% : 0.000043s : 4: replace.inline 34.07% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.20% : 0.000183s : 4: match.inline 5.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.54% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.81% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.26% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.65% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.32% : 0.000002s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 2.18% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.38% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000638 13 51.66% : 0.000330s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.29% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.05% : 0.000262s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014787 72 0.36% : 0.000053s : 1: add_recomputation 0.47% : 0.000069s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.17% : 0.000321s : 1: bootstrap 0.18% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.48% : 0.005689s : 1: jit_opt_a 1.03% : 0.000152s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.83% : 0.000418s : 1: loop_unroll 3.73% : 0.000552s : 1: mutable_eliminate 5.78% : 0.000854s : 26: opt.transform.jit_opt_a 0.39% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.16% : 0.000023s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.07% : 0.000453s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000043s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.76% : 0.000408s : 1: renormalize.infer 2.11% : 0.000312s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000037s : 1: rewriter_after_opt_a 0.53% : 0.000079s : 1: rewriter_before_opt_a 0.50% : 0.000074s : 1: symbol_engine_optimizer 32.95% : 0.004871s : 1: type_inference TotalTime = 0.125798, [30] [bootstrap]: 0.00028836 [type_inference]: 0.114142 [event_method]: 2.262e-05 [auto_monad]: 7.225e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.00051895 [rewriter_before_opt_a]: 9.332e-05 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.00829538, [2] [Cycle 1]: 0.00439278, [27] [switch_simplify]: 6.306e-05 [loop_unroll]: 3.5e-05 [a_1]: 0.00072329 [with_stream_mark]: 2.274e-05 [recompute_prepare]: 9.22001e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.10002e-06 [parameter_eliminate]: 2.23002e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.38998e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 3.52002e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.535e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.037e-05 [inline_without_move]: 6.25997e-06 [renormalize]: 0.00318886 [add_forward_monad_depend]: 7.03e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.572e-05 [cse]: 3.315e-05 [replace_applicator]: 1.615e-05 [Cycle 2]: 0.00037807, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.39999e-06 [a_1]: 0.00013169 [with_stream_mark]: 1.242e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 8.99978e-07 [specialize_transform]: 5.82001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.35002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.212e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.30002e-06 [cse]: 1.314e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.378e-05 [rewriter_after_opt_a]: 3.752e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00064295 [jit_opt_b]: 5.508e-05, [1] [Cycle 1]: 4.748e-05, [2] [frontend_op_eliminate]: 1.803e-05 [inline_after_opt_a]: 1.769e-05 [cconv]: 2.675e-05 [loop_unroll]: 0.0004314 [jit_opt_after_cconv]: 0.00015211, [1] [Cycle 1]: 0.0001456, [11] [c_1]: 2.561e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.257e-05 [call_graph_tuple_transform]: 2.107e-05 [tuple_list_get_item_eliminator]: 6.62002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.45e-05 [partial_unused_args_eliminate]: 2.03002e-06 [environ_conv]: 8.35001e-06 [add_recomputation]: 4.708e-05 [cse_after_recomputation]: 7.734e-05, [1] [Cycle 1]: 2.121e-05, [1] [cse]: 1.437e-05 [auto_monad_reorder]: 1.831e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.29998e-06 [opt_after_jit_grad]: 0.00047892 [symbol_engine_optimizer]: 9.585e-05, [1] [Cycle 1]: 8.973e-05, [6] [build]: 3.71001e-06 [elim_shapecalc]: 9.43997e-06 [elim_not_effective]: 3.151e-05 [opt_reshape]: 7.05e-06 [fold_const_symbol]: 1.03e-05 [renormalize]: 3.39991e-07 [validate]: 4.551e-05 Sums bootstrap : 0.000288s : 0.24% type_inference : 0.114142s : 93.85% event_method : 0.000023s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000519s : 0.43% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000855s : 0.70% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003189s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000643s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000027s : 0.02% loop_unroll : 0.000431s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000479s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000032s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000285 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.19% : 0.000006s : 4: substitution.graph_param_transform 84.09% : 0.000239s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.24% : 0.000012s : 3: substitution.reduce_eliminate 1.52% : 0.000004s : 4: substitution.remove_not_recompute_node 1.57% : 0.000004s : 2: substitution.replace_old_param 3.90% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114062 2 97.29% : 0.110967s : 1: type_inference.infer 2.71% : 0.003095s : 1: type_inference.specialize ------[replace.] 0.000101 7 67.69% : 0.000068s : 5: replace.inline 32.31% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 7 95.95% : 0.000236s : 5: match.inline 4.05% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.31% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.62% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000003s : 13: predicate.reduce_eliminate 1.57% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.44% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002423 25 63.72% : 0.001544s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.34% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.94% : 0.000798s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130154 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000307s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.06% : 0.000079s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.38% : 0.008299s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.34% : 0.000439s : 1: loop_unroll 0.50% : 0.000652s : 1: mutable_eliminate 0.85% : 0.001101s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000525s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.80% : 0.002348s : 1: renormalize.infer 0.64% : 0.000831s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.08% : 0.000098s : 1: symbol_engine_optimizer 87.71% : 0.114161s : 1: type_inference TotalTime = 0.018949, [30] [bootstrap]: 0.00030703 [type_inference]: 0.00816472 [event_method]: 2.034e-05 [auto_monad]: 7.27e-05 [graph_reusing]: 5.98998e-06 [pre_auto_parallel]: 3.16999e-06 [py_interpret_to_execute]: 4.64e-05 [rewriter_before_opt_a]: 8.267e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.00747189, [2] [Cycle 1]: 0.00194534, [27] [switch_simplify]: 6.51e-05 [loop_unroll]: 3.345e-05 [a_1]: 0.00067632 [with_stream_mark]: 2.28e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 4.29002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 5.92999e-06 [renormalize]: 0.00078201 [add_forward_monad_depend]: 6.33998e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.546e-05 [cse]: 3.44e-05 [replace_applicator]: 1.337e-05 [Cycle 2]: 0.00034795, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.65001e-06 [a_1]: 0.00011039 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.85001e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.123e-05 [j_node_and_user_rematch]: 7.84002e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.81002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.46998e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.70998e-06 [cse]: 1.401e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.311e-05 [rewriter_after_opt_a]: 4e-05 [convert_after_rewriter]: 7.04001e-06 [order_py_execute_after_rewriter]: 5.84e-06 [mutable_eliminate]: 0.00064457 [jit_opt_b]: 5.137e-05, [1] [Cycle 1]: 4.366e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 2.575e-05 [loop_unroll]: 0.00044084 [jit_opt_after_cconv]: 0.00060984, [1] [Cycle 1]: 0.00060245, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 1.066e-05 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 2.899e-05 [call_graph_tuple_transform]: 2.416e-05 [tuple_list_get_item_eliminator]: 6.26998e-06 [none_parameter_eliminate]: 2.48998e-06 [renormalize]: 6.90023e-07 [switch_simplify]: 5.68002e-06 [remove_dup_value]: 1.787e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 6.49001e-06 [add_recomputation]: 5.178e-05 [cse_after_recomputation]: 2.399e-05, [1] [Cycle 1]: 1.738e-05, [1] [cse]: 1.181e-05 [auto_monad_reorder]: 1.744e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 5.19e-06 [opt_after_jit_grad]: 0.00050346 [symbol_engine_optimizer]: 7.674e-05, [1] [Cycle 1]: 7.014e-05, [6] [build]: 3.76999e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.503e-05 [opt_reshape]: 5.90002e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 3.39991e-07 [validate]: 4.155e-05 Sums bootstrap : 0.000307s : 2.42% type_inference : 0.008165s : 64.25% event_method : 0.000020s : 0.16% auto_monad : 0.000073s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.37% rewriter_before_opt_a : 0.000083s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000072s : 0.56% jit_opt_a.loop_unroll : 0.000039s : 0.31% jit_opt_a.a_1 : 0.000787s : 6.19% jit_opt_a.with_stream_mark : 0.000034s : 0.26% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000782s : 6.15% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000048s : 0.38% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000040s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000645s : 5.07% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000026s : 0.20% loop_unroll : 0.000441s : 3.47% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000052s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000503s : 3.96% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.33% Time group info: ------[substitution.] 0.000273 27 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000002s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 3: substitution.graph_param_transform 83.36% : 0.000228s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.04% : 0.000011s : 3: substitution.reduce_eliminate 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000005s : 2: substitution.replace_old_param 4.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008095 2 87.60% : 0.007091s : 1: type_inference.infer 12.40% : 0.001003s : 1: type_inference.specialize ------[replace.] 0.000097 7 66.94% : 0.000065s : 5: replace.inline 33.06% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 7 95.56% : 0.000225s : 5: match.inline 4.44% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 747 1.43% : 0.000002s : 11: predicate.accumulaten_eliminater 1.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.98% : 0.000003s : 11: predicate.arithmetic_simplify 1.21% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000002s : 11: predicate.compare_switch_simplify 1.17% : 0.000002s : 11: predicate.depend_value_elim 1.08% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 11: predicate.environ_get_depend_swap 1.20% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.56% : 0.000001s : 3: predicate.graph_param_transform 5.46% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 16: predicate.load_eliminater 1.17% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000002s : 11: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000002s : 11: predicate.print_const_string_wrapper 2.20% : 0.000003s : 11: predicate.reduce_eliminate 1.64% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.93% : 0.000003s : 19: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.42% : 0.000002s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.80% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.58% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.90% : 0.000010s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000812 16 49.51% : 0.000402s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.09% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.39% : 0.000336s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020804 72 0.26% : 0.000055s : 1: add_recomputation 0.37% : 0.000077s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.56% : 0.000324s : 1: bootstrap 0.14% : 0.000029s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 35.93% : 0.007476s : 1: jit_opt_a 2.95% : 0.000613s : 1: jit_opt_after_cconv 0.26% : 0.000054s : 1: jit_opt_b 2.16% : 0.000449s : 1: loop_unroll 3.14% : 0.000654s : 1: mutable_eliminate 4.89% : 0.001018s : 26: opt.transform.jit_opt_a 0.26% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.46% : 0.000512s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000049s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000021s : 1: remove_dup_value 2.08% : 0.000434s : 1: renormalize.infer 1.64% : 0.000340s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000043s : 1: rewriter_after_opt_a 0.41% : 0.000086s : 1: rewriter_before_opt_a 0.38% : 0.000079s : 1: symbol_engine_optimizer 39.33% : 0.008183s : 1: type_inference TotalTime = 0.0237846, [30] [bootstrap]: 0.00029555 [type_inference]: 0.0151777 [event_method]: 1.977e-05 [auto_monad]: 7.315e-05 [graph_reusing]: 6.18998e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 4.683e-05 [rewriter_before_opt_a]: 8.153e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.00579514, [2] [Cycle 1]: 0.001978, [27] [switch_simplify]: 5.978e-05 [loop_unroll]: 3.631e-05 [a_1]: 0.00066844 [with_stream_mark]: 1.81e-05 [recompute_prepare]: 7.36001e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.25002e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.58998e-06 [get_grad_eliminate_]: 6.03002e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.629e-05 [j_node_and_user_rematch]: 9.99001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00086257 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 2.18998e-06 [auto_monad_eliminator]: 1.41e-05 [cse]: 2.91e-05 [replace_applicator]: 1.132e-05 [Cycle 2]: 0.00032747, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 5.04e-06 [a_1]: 9.092e-05 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.329e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 7.09001e-06 [inline_without_move]: 4.79e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.437e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 1.271e-05 [rewriter_after_opt_a]: 3.937e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.30999e-06 [mutable_eliminate]: 0.00066846 [jit_opt_b]: 5.004e-05, [1] [Cycle 1]: 4.265e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.817e-05 [loop_unroll]: 0.00042128 [jit_opt_after_cconv]: 0.00014975, [1] [Cycle 1]: 0.00014323, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 2.79999e-06 [updatestate_depend_eliminate]: 6.31e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.66e-06 [cse]: 2.506e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 5.46998e-06 [remove_dup_value]: 3.428e-05 [partial_unused_args_eliminate]: 1.184e-05 [environ_conv]: 5.76998e-06 [add_recomputation]: 4.937e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.919e-05, [1] [cse]: 1.301e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00046152 [symbol_engine_optimizer]: 7.473e-05, [1] [Cycle 1]: 6.808e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.394e-05 [opt_reshape]: 6.10002e-06 [fold_const_symbol]: 8.73001e-06 [renormalize]: 2.50002e-07 [validate]: 4.059e-05 Sums bootstrap : 0.000296s : 1.50% type_inference : 0.015178s : 76.99% event_method : 0.000020s : 0.10% auto_monad : 0.000073s : 0.37% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000047s : 0.24% rewriter_before_opt_a : 0.000082s : 0.41% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.33% jit_opt_a.loop_unroll : 0.000041s : 0.21% jit_opt_a.a_1 : 0.000759s : 3.85% jit_opt_a.with_stream_mark : 0.000029s : 0.15% jit_opt_a.recompute_prepare : 0.000012s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000012s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.15% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.09% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000863s : 4.38% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.04% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.10% jit_opt_a.cse : 0.000043s : 0.22% jit_opt_a.replace_applicator : 0.000017s : 0.09% py_interpret_to_execute_after_opt_a : 0.000013s : 0.06% rewriter_after_opt_a : 0.000039s : 0.20% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000668s : 3.39% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.08% jit_opt_b.inline_after_opt_a : 0.000016s : 0.08% cconv : 0.000028s : 0.14% loop_unroll : 0.000421s : 2.14% jit_opt_after_cconv.c_1 : 0.000021s : 0.11% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000025s : 0.13% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.10% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.03% remove_dup_value : 0.000034s : 0.17% partial_unused_args_eliminate : 0.000012s : 0.06% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000049s : 0.25% cse_after_recomputation.cse : 0.000013s : 0.07% auto_monad_reorder : 0.000019s : 0.10% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.02% opt_after_jit_grad : 0.000462s : 2.34% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.21% Time group info: ------[substitution.] 0.000267 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000006s : 3: substitution.graph_param_transform 86.81% : 0.000231s : 5: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000005s : 4: substitution.remove_not_recompute_node 1.45% : 0.000004s : 2: substitution.replace_old_param 4.99% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.015107 2 93.02% : 0.014053s : 1: type_inference.infer 6.98% : 0.001054s : 1: type_inference.specialize ------[replace.] 0.000096 7 68.37% : 0.000065s : 5: replace.inline 31.63% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 7 94.99% : 0.000228s : 5: match.inline 5.01% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.37% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.53% : 0.000002s : 11: predicate.addn_zero_filter 1.76% : 0.000002s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.28% : 0.000002s : 11: predicate.depend_value_elim 1.23% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000002s : 11: predicate.environ_get_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.81% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 6.02% : 0.000008s : 24: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.86% : 0.000002s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 16: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.95% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.47% : 0.000002s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.04% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 1.69% : 0.000002s : 11: predicate.reduce_eliminate 1.92% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.92% : 0.000010s : 59: predicate.switch_simplify 1.36% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.15% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000845 16 49.44% : 0.000418s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.25% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.30% : 0.000349s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.025690 72 0.20% : 0.000052s : 1: add_recomputation 0.30% : 0.000077s : 1: auto_monad 0.08% : 0.000022s : 1: auto_monad_reorder 1.23% : 0.000316s : 1: bootstrap 0.12% : 0.000031s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.10% : 0.000027s : 1: cse_after_recomputation 0.03% : 0.000008s : 1: environ_conv 0.09% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 22.57% : 0.005798s : 1: jit_opt_a 0.59% : 0.000153s : 1: jit_opt_after_cconv 0.20% : 0.000053s : 1: jit_opt_b 1.67% : 0.000429s : 1: loop_unroll 2.64% : 0.000677s : 1: mutable_eliminate 3.84% : 0.000987s : 26: opt.transform.jit_opt_a 0.19% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000025s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000014s : 1: opt.transform.mutable_eliminate 0.08% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000033s : 4: opt.transform.symbol_engine_opt 1.83% : 0.000469s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.05% : 0.000014s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000049s : 1: py_interpret_to_execute 0.06% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000037s : 1: remove_dup_value 1.95% : 0.000502s : 1: renormalize.infer 1.37% : 0.000352s : 1: renormalize.specialize 0.02% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000042s : 1: rewriter_after_opt_a 0.33% : 0.000084s : 1: rewriter_before_opt_a 0.30% : 0.000077s : 1: symbol_engine_optimizer 59.14% : 0.015194s : 1: type_inference TotalTime = 0.0185044, [30] [bootstrap]: 0.00030153 [type_inference]: 0.00903838 [event_method]: 2.03e-05 [auto_monad]: 7.007e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.78003e-06 [py_interpret_to_execute]: 4.826e-05 [rewriter_before_opt_a]: 8.43e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00660317, [2] [Cycle 1]: 0.0018674, [27] [switch_simplify]: 5.391e-05 [loop_unroll]: 3.27e-05 [a_1]: 0.00065806 [with_stream_mark]: 1.471e-05 [recompute_prepare]: 7.55998e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.203e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00077554 [add_forward_monad_depend]: 6.43e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.448e-05 [cse]: 3.975e-05 [replace_applicator]: 1.284e-05 [Cycle 2]: 0.00031729, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 5.05999e-06 [a_1]: 8.928e-05 [with_stream_mark]: 8.65001e-06 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.234e-05 [j_node_and_user_rematch]: 7.95e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.48e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.56002e-06 [cse]: 1.437e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 1.357e-05 [rewriter_after_opt_a]: 3.825e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00062815 [jit_opt_b]: 5.073e-05, [1] [Cycle 1]: 4.336e-05, [2] [frontend_op_eliminate]: 1.619e-05 [inline_after_opt_a]: 1.532e-05 [cconv]: 2.752e-05 [loop_unroll]: 0.00042439 [jit_opt_after_cconv]: 0.00015883, [1] [Cycle 1]: 0.00015259, [11] [c_1]: 2.237e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 7.78999e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.095e-05 [call_graph_tuple_transform]: 1.972e-05 [tuple_list_get_item_eliminator]: 5.39998e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 3.829e-05 [partial_unused_args_eliminate]: 2.47001e-06 [environ_conv]: 5.67999e-06 [add_recomputation]: 5.442e-05 [cse_after_recomputation]: 2.55e-05, [1] [Cycle 1]: 1.967e-05, [1] [cse]: 1.287e-05 [auto_monad_reorder]: 1.762e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.94e-06 [opt_after_jit_grad]: 0.00050351 [symbol_engine_optimizer]: 7.742e-05, [1] [Cycle 1]: 7.101e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 9.39996e-07 [validate]: 4.615e-05 Sums bootstrap : 0.000302s : 2.24% type_inference : 0.009038s : 67.02% event_method : 0.000020s : 0.15% auto_monad : 0.000070s : 0.52% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000048s : 0.36% rewriter_before_opt_a : 0.000084s : 0.63% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000060s : 0.44% jit_opt_a.loop_unroll : 0.000038s : 0.28% jit_opt_a.a_1 : 0.000747s : 5.54% jit_opt_a.with_stream_mark : 0.000023s : 0.17% jit_opt_a.recompute_prepare : 0.000013s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000005s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000776s : 5.75% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.15% jit_opt_a.cse : 0.000054s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.13% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000038s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000628s : 4.66% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000015s : 0.11% cconv : 0.000028s : 0.20% loop_unroll : 0.000424s : 3.15% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000038s : 0.28% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000054s : 0.40% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000504s : 3.73% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000046s : 0.34% Time group info: ------[substitution.] 0.000226 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 3: substitution.graph_param_transform 87.37% : 0.000198s : 5: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000004s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 3.73% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008964 2 88.52% : 0.007935s : 1: type_inference.infer 11.48% : 0.001029s : 1: type_inference.specialize ------[replace.] 0.000089 7 66.10% : 0.000059s : 5: replace.inline 33.90% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 96.41% : 0.000195s : 5: match.inline 3.59% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.31% : 0.000002s : 11: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000001s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000001s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.02% : 0.000006s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 16: predicate.load_eliminater 1.20% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 2.05% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000001s : 11: predicate.print_const_string_wrapper 1.89% : 0.000002s : 11: predicate.reduce_eliminate 1.75% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 2.05% : 0.000002s : 19: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.39% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.79% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.89% : 0.000009s : 59: predicate.switch_simplify 1.23% : 0.000001s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.87% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000810 16 51.22% : 0.000415s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.66% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.12% : 0.000317s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020288 72 0.28% : 0.000057s : 1: add_recomputation 0.36% : 0.000074s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.59% : 0.000323s : 1: bootstrap 0.15% : 0.000030s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 32.56% : 0.006606s : 1: jit_opt_a 0.80% : 0.000161s : 1: jit_opt_after_cconv 0.26% : 0.000053s : 1: jit_opt_b 2.13% : 0.000433s : 1: loop_unroll 3.15% : 0.000639s : 1: mutable_eliminate 4.74% : 0.000962s : 26: opt.transform.jit_opt_a 0.24% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000513s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000051s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000041s : 1: remove_dup_value 2.33% : 0.000473s : 1: renormalize.infer 1.46% : 0.000297s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000041s : 1: rewriter_after_opt_a 0.43% : 0.000087s : 1: rewriter_before_opt_a 0.39% : 0.000080s : 1: symbol_engine_optimizer 44.65% : 0.009059s : 1: type_inference TotalTime = 0.216898, [30] [bootstrap]: 0.00037009 [type_inference]: 0.205996 [event_method]: 2.191e-05 [auto_monad]: 9.273e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00052835 [rewriter_before_opt_a]: 9.135e-05 [expand_dump_flag]: 4.17998e-06 [jit_opt_a]: 0.00749553, [2] [Cycle 1]: 0.00354278, [27] [switch_simplify]: 5.138e-05 [loop_unroll]: 3.085e-05 [a_1]: 0.00057447 [with_stream_mark]: 1.478e-05 [recompute_prepare]: 9.14998e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.0025435 [add_forward_monad_depend]: 5.82001e-06 [auto_monad_grad]: 3.06999e-06 [auto_monad_eliminator]: 1.596e-05 [cse]: 2.426e-05 [replace_applicator]: 1.663e-05 [Cycle 2]: 0.00055287, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.99e-06 [a_1]: 0.00012153 [with_stream_mark]: 1.016e-05 [recompute_prepare]: 5.88002e-06 [updatestate_depend_eliminate]: 2.95002e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 2.45002e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 7.73999e-06 [inline_without_move]: 5.31998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 0.00016373 [cse]: 2.017e-05 [replace_applicator]: 8.64e-06 [py_interpret_to_execute_after_opt_a]: 1.194e-05 [rewriter_after_opt_a]: 3.757e-05 [convert_after_rewriter]: 7.85998e-06 [order_py_execute_after_rewriter]: 4.55999e-06 [mutable_eliminate]: 0.00061893 [jit_opt_b]: 5.56e-05, [1] [Cycle 1]: 4.878e-05, [2] [frontend_op_eliminate]: 1.978e-05 [inline_after_opt_a]: 1.716e-05 [cconv]: 2.423e-05 [loop_unroll]: 0.00042523 [jit_opt_after_cconv]: 0.00014766, [1] [Cycle 1]: 0.00014153, [11] [c_1]: 2.557e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 5.23002e-06 [updatestate_assign_eliminate]: 5.54998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 1.799e-05 [call_graph_tuple_transform]: 2.005e-05 [tuple_list_get_item_eliminator]: 7.22002e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.78002e-06 [remove_dup_value]: 1.411e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 7.85998e-06 [add_recomputation]: 4.388e-05 [cse_after_recomputation]: 2.6e-05, [1] [Cycle 1]: 1.986e-05, [1] [cse]: 1.312e-05 [auto_monad_reorder]: 1.54e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 4.92e-06 [opt_after_jit_grad]: 0.00047484 [symbol_engine_optimizer]: 7.433e-05, [1] [Cycle 1]: 6.804e-05, [6] [build]: 2.89001e-06 [elim_shapecalc]: 8.82999e-06 [elim_not_effective]: 1.349e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 9.44998e-06 [renormalize]: 3.20026e-07 [validate]: 4.034e-05 Sums bootstrap : 0.000370s : 0.17% type_inference : 0.205996s : 96.79% event_method : 0.000022s : 0.01% auto_monad : 0.000093s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000528s : 0.25% rewriter_before_opt_a : 0.000091s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.03% jit_opt_a.loop_unroll : 0.000037s : 0.02% jit_opt_a.a_1 : 0.000696s : 0.33% jit_opt_a.with_stream_mark : 0.000025s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002544s : 1.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000180s : 0.08% jit_opt_a.cse : 0.000044s : 0.02% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000619s : 0.29% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000024s : 0.01% loop_unroll : 0.000425s : 0.20% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000044s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000475s : 0.22% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.02% Time group info: ------[substitution.] 0.000205 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 4: substitution.graph_param_transform 84.75% : 0.000173s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000003s : 2: substitution.replace_old_param 5.33% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.205915 2 98.72% : 0.203274s : 1: type_inference.infer 1.28% : 0.002641s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.30% : 0.000050s : 4: replace.inline 33.70% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 94.55% : 0.000171s : 4: match.inline 5.45% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000007s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.26% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.93% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.72% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.70% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.10% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.55% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002442 22 70.42% : 0.001720s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.56% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.02% : 0.000684s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.220442 72 0.02% : 0.000047s : 1: add_recomputation 0.04% : 0.000096s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.18% : 0.000389s : 1: bootstrap 0.01% : 0.000027s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000076s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 3.40% : 0.007499s : 1: jit_opt_a 0.07% : 0.000151s : 1: jit_opt_after_cconv 0.03% : 0.000058s : 1: jit_opt_b 0.20% : 0.000433s : 1: loop_unroll 0.28% : 0.000627s : 1: mutable_eliminate 0.42% : 0.000924s : 26: opt.transform.jit_opt_a 0.03% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000483s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000537s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 0.83% : 0.001840s : 1: renormalize.infer 0.32% : 0.000696s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000040s : 1: rewriter_after_opt_a 0.04% : 0.000096s : 1: rewriter_before_opt_a 0.03% : 0.000077s : 1: symbol_engine_optimizer 93.46% : 0.206014s : 1: type_inference TotalTime = 0.200778, [30] [bootstrap]: 0.00033065 [type_inference]: 0.188968 [event_method]: 2.355e-05 [auto_monad]: 7.363e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.38998e-06 [py_interpret_to_execute]: 0.00058376 [rewriter_before_opt_a]: 0.00010033 [expand_dump_flag]: 3.60998e-06 [jit_opt_a]: 0.0081733, [2] [Cycle 1]: 0.0040877, [27] [switch_simplify]: 6.669e-05 [loop_unroll]: 3.407e-05 [a_1]: 0.00072591 [with_stream_mark]: 2.386e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 7.41001e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00285983 [add_forward_monad_depend]: 7e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.881e-05 [cse]: 3.745e-05 [replace_applicator]: 1.888e-05 [Cycle 2]: 0.00039081, [27] [switch_simplify]: 7.78001e-06 [loop_unroll]: 6.78e-06 [a_1]: 0.0001344 [with_stream_mark]: 1.462e-05 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.40002e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.452e-05 [replace_applicator]: 5.99999e-06 [py_interpret_to_execute_after_opt_a]: 1.467e-05 [rewriter_after_opt_a]: 3.927e-05 [convert_after_rewriter]: 6.72002e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00067488 [jit_opt_b]: 5.662e-05, [1] [Cycle 1]: 4.904e-05, [2] [frontend_op_eliminate]: 1.994e-05 [inline_after_opt_a]: 1.837e-05 [cconv]: 2.806e-05 [loop_unroll]: 0.00059231 [jit_opt_after_cconv]: 0.00015886, [1] [Cycle 1]: 0.00015236, [11] [c_1]: 2.643e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.56999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.457e-05 [call_graph_tuple_transform]: 2.197e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 8.2e-07 [switch_simplify]: 6.19999e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 2.82002e-06 [environ_conv]: 8.33999e-06 [add_recomputation]: 5.111e-05 [cse_after_recomputation]: 2.265e-05, [1] [Cycle 1]: 1.729e-05, [1] [cse]: 1.165e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.71998e-06 [opt_after_jit_grad]: 0.00046825 [symbol_engine_optimizer]: 9.91e-05, [1] [Cycle 1]: 9.277e-05, [6] [build]: 4.99e-06 [elim_shapecalc]: 8.22998e-06 [elim_not_effective]: 3.333e-05 [opt_reshape]: 7.1e-06 [fold_const_symbol]: 1.048e-05 [renormalize]: 3.69997e-07 [validate]: 4.787e-05 Sums bootstrap : 0.000331s : 0.17% type_inference : 0.188968s : 96.19% event_method : 0.000024s : 0.01% auto_monad : 0.000074s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000584s : 0.30% rewriter_before_opt_a : 0.000100s : 0.05% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.04% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000860s : 0.44% jit_opt_a.with_stream_mark : 0.000038s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002860s : 1.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000675s : 0.34% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000592s : 0.30% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000051s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000468s : 0.24% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000033s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.02% Time group info: ------[substitution.] 0.000297 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000007s : 4: substitution.graph_param_transform 84.11% : 0.000250s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.06% : 0.000012s : 3: substitution.reduce_eliminate 1.46% : 0.000004s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 3.68% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.188880 2 98.50% : 0.186053s : 1: type_inference.infer 1.50% : 0.002827s : 1: type_inference.specialize ------[replace.] 0.000100 7 69.12% : 0.000069s : 5: replace.inline 30.88% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 96.15% : 0.000247s : 5: match.inline 3.85% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.70% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 19: predicate.partial_eliminate 1.55% : 0.000002s : 13: predicate.print_const_string_wrapper 1.88% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.65% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.011872 25 92.74% : 0.011010s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.70% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 6.56% : 0.000779s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.204838 72 0.03% : 0.000054s : 1: add_recomputation 0.04% : 0.000077s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.17% : 0.000351s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.01% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.99% : 0.008177s : 1: jit_opt_a 0.08% : 0.000162s : 1: jit_opt_after_cconv 0.03% : 0.000059s : 1: jit_opt_b 0.29% : 0.000602s : 1: loop_unroll 0.33% : 0.000684s : 1: mutable_eliminate 0.54% : 0.001114s : 26: opt.transform.jit_opt_a 0.03% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000056s : 4: opt.transform.symbol_engine_opt 0.23% : 0.000477s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000592s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 0.99% : 0.002034s : 1: renormalize.infer 0.40% : 0.000815s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000042s : 1: rewriter_after_opt_a 0.05% : 0.000106s : 1: rewriter_before_opt_a 0.05% : 0.000101s : 1: symbol_engine_optimizer 92.26% : 0.188990s : 1: type_inference TotalTime = 0.0456143, [30] [bootstrap]: 0.00034951 [type_inference]: 0.0368549 [event_method]: 2.333e-05 [auto_monad]: 7.017e-05 [graph_reusing]: 6.21e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 4.267e-05 [rewriter_before_opt_a]: 8.492e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00598486, [2] [Cycle 1]: 0.0020239, [27] [switch_simplify]: 6.584e-05 [loop_unroll]: 3.312e-05 [a_1]: 0.00067435 [with_stream_mark]: 2.559e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 2.72001e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.558e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 1.056e-05 [inline_without_move]: 5.29e-06 [renormalize]: 0.00084985 [add_forward_monad_depend]: 6.68e-06 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 1.629e-05 [cse]: 4.334e-05 [replace_applicator]: 1.41e-05 [Cycle 2]: 0.00037657, [27] [switch_simplify]: 6.44001e-06 [loop_unroll]: 5.15999e-06 [a_1]: 8.984e-05 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 4.685e-05 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.48997e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 4.85999e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.20002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.392e-05 [j_node_and_user_rematch]: 8.40999e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 7.14001e-06 [cse]: 1.735e-05 [replace_applicator]: 5.11002e-06 [py_interpret_to_execute_after_opt_a]: 1.366e-05 [rewriter_after_opt_a]: 4.225e-05 [convert_after_rewriter]: 7.21999e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00061036 [jit_opt_b]: 5.13e-05, [1] [Cycle 1]: 4.283e-05, [2] [frontend_op_eliminate]: 1.529e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.73e-05 [loop_unroll]: 0.00040703 [jit_opt_after_cconv]: 0.00014824, [1] [Cycle 1]: 0.00014201, [11] [c_1]: 2.062e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.04001e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 2.627e-05 [call_graph_tuple_transform]: 1.971e-05 [tuple_list_get_item_eliminator]: 5.20999e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.24998e-06 [remove_dup_value]: 3.937e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 5.56e-06 [add_recomputation]: 5.32e-05 [cse_after_recomputation]: 3.057e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.32e-05 [auto_monad_reorder]: 1.849e-05 [get_jit_bprop_graph]: 2.11e-06 [rewriter_after_jit_bprop_graph]: 4.70999e-06 [opt_after_jit_grad]: 0.00044071 [symbol_engine_optimizer]: 7.071e-05, [1] [Cycle 1]: 6.505e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.284e-05 [opt_reshape]: 5.49998e-06 [fold_const_symbol]: 8.72e-06 [renormalize]: 4.69998e-07 [validate]: 3.896e-05 Sums bootstrap : 0.000350s : 0.84% type_inference : 0.036855s : 88.97% event_method : 0.000023s : 0.06% auto_monad : 0.000070s : 0.17% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000043s : 0.10% rewriter_before_opt_a : 0.000085s : 0.20% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.17% jit_opt_a.loop_unroll : 0.000038s : 0.09% jit_opt_a.a_1 : 0.000764s : 1.84% jit_opt_a.with_stream_mark : 0.000036s : 0.09% jit_opt_a.recompute_prepare : 0.000056s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000010s : 0.02% jit_opt_a.renormalize : 0.000850s : 2.05% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.06% jit_opt_a.cse : 0.000061s : 0.15% jit_opt_a.replace_applicator : 0.000019s : 0.05% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000042s : 0.10% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000610s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.04% jit_opt_b.inline_after_opt_a : 0.000016s : 0.04% cconv : 0.000027s : 0.07% loop_unroll : 0.000407s : 0.98% jit_opt_after_cconv.c_1 : 0.000021s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000026s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000039s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000053s : 0.13% cse_after_recomputation.cse : 0.000013s : 0.03% auto_monad_reorder : 0.000018s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000441s : 1.06% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.09% Time group info: ------[substitution.] 0.000285 24 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 3: substitution.graph_param_transform 87.50% : 0.000250s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000005s : 2: substitution.replace_old_param 4.14% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.036783 2 97.19% : 0.035749s : 1: type_inference.infer 2.81% : 0.001034s : 1: type_inference.specialize ------[replace.] 0.000097 7 69.11% : 0.000067s : 5: replace.inline 30.89% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 95.83% : 0.000247s : 5: match.inline 4.17% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 1.72% : 0.000002s : 11: predicate.arithmetic_simplify 1.21% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.19% : 0.000001s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 6.44% : 0.000008s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 16: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.92% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000001s : 11: predicate.print_const_string_wrapper 1.69% : 0.000002s : 11: predicate.reduce_eliminate 1.64% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 19: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000002s : 11: predicate.same_eliminate 0.74% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.63% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.38% : 0.000010s : 59: predicate.switch_simplify 1.31% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.56% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004273 16 90.41% : 0.003863s : 7: func_graph_cloner_run.FuncGraphClonerGraph 1.97% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 7.62% : 0.000326s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.047558 72 0.12% : 0.000056s : 1: add_recomputation 0.15% : 0.000074s : 1: auto_monad 0.04% : 0.000021s : 1: auto_monad_reorder 0.77% : 0.000366s : 1: bootstrap 0.06% : 0.000030s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000033s : 1: cse_after_recomputation 0.02% : 0.000007s : 1: environ_conv 0.06% : 0.000028s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.59% : 0.005988s : 1: jit_opt_a 0.32% : 0.000151s : 1: jit_opt_after_cconv 0.11% : 0.000054s : 1: jit_opt_b 0.87% : 0.000415s : 1: loop_unroll 1.31% : 0.000621s : 1: mutable_eliminate 2.18% : 0.001039s : 26: opt.transform.jit_opt_a 0.10% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000448s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.10% : 0.000045s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000042s : 1: remove_dup_value 1.07% : 0.000507s : 1: renormalize.infer 0.70% : 0.000334s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.09% : 0.000045s : 1: rewriter_after_opt_a 0.18% : 0.000088s : 1: rewriter_before_opt_a 0.15% : 0.000073s : 1: symbol_engine_optimizer 77.53% : 0.036874s : 1: type_inference TotalTime = 0.0167109, [30] [bootstrap]: 0.00036407 [type_inference]: 0.00845221 [event_method]: 2.162e-05 [auto_monad]: 6.767e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 4.596e-05 [rewriter_before_opt_a]: 8.308e-05 [expand_dump_flag]: 2.82002e-06 [jit_opt_a]: 0.0055523, [2] [Cycle 1]: 0.0018909, [27] [switch_simplify]: 5.935e-05 [loop_unroll]: 3.334e-05 [a_1]: 0.00064516 [with_stream_mark]: 2.155e-05 [recompute_prepare]: 7.73999e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.69999e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.33999e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00079497 [add_forward_monad_depend]: 5.27001e-06 [auto_monad_grad]: 2.16e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 3.62e-05 [replace_applicator]: 1.234e-05 [Cycle 2]: 0.00032121, [27] [switch_simplify]: 5.96e-06 [loop_unroll]: 4.92999e-06 [a_1]: 9.584e-05 [with_stream_mark]: 9.51998e-06 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 4.99998e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.75997e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.023e-05 [j_node_and_user_rematch]: 7.97998e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.82e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.80013e-07 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.171e-05 [replace_applicator]: 5.39e-06 [py_interpret_to_execute_after_opt_a]: 1.129e-05 [rewriter_after_opt_a]: 3.611e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00052182 [jit_opt_b]: 5.017e-05, [1] [Cycle 1]: 4.282e-05, [2] [frontend_op_eliminate]: 1.579e-05 [inline_after_opt_a]: 1.572e-05 [cconv]: 2.539e-05 [loop_unroll]: 0.00040994 [jit_opt_after_cconv]: 0.00017261, [1] [Cycle 1]: 0.00016587, [11] [c_1]: 1.963e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 6.41e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.234e-05 [call_graph_tuple_transform]: 1.994e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.36e-06 [add_recomputation]: 4.974e-05 [cse_after_recomputation]: 2.183e-05, [1] [Cycle 1]: 1.643e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.759e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 4.94998e-06 [opt_after_jit_grad]: 0.00046032 [symbol_engine_optimizer]: 7.206e-05, [1] [Cycle 1]: 6.611e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 5.19998e-07 [validate]: 3.791e-05 Sums bootstrap : 0.000364s : 2.85% type_inference : 0.008452s : 66.26% event_method : 0.000022s : 0.17% auto_monad : 0.000068s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.36% rewriter_before_opt_a : 0.000083s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.51% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000741s : 5.81% jit_opt_a.with_stream_mark : 0.000031s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000795s : 6.23% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000048s : 0.38% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000036s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000522s : 4.09% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.20% loop_unroll : 0.000410s : 3.21% jit_opt_after_cconv.c_1 : 0.000020s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.39% cse_after_recomputation.cse : 0.000011s : 0.08% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000460s : 3.61% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.30% Time group info: ------[substitution.] 0.000261 27 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000005s : 3: substitution.graph_param_transform 84.46% : 0.000221s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.82% : 0.000010s : 3: substitution.reduce_eliminate 1.62% : 0.000004s : 4: substitution.remove_not_recompute_node 1.61% : 0.000004s : 2: substitution.replace_old_param 4.07% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008375 2 86.72% : 0.007263s : 1: type_inference.infer 13.28% : 0.001112s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.39% : 0.000061s : 5: replace.inline 32.61% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 95.77% : 0.000218s : 5: match.inline 4.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.24% : 0.000001s : 11: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 11: predicate.addn_check_dump 1.31% : 0.000002s : 11: predicate.addn_zero_filter 2.01% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000001s : 11: predicate.depend_value_elim 1.21% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000002s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.57% : 0.000007s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 1.19% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.49% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.05% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 1.88% : 0.000002s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.83% : 0.000003s : 18: predicate.switch_defer_inline 2.34% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.14% : 0.000010s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.49% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000818 16 49.88% : 0.000408s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.64% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.48% : 0.000339s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018515 72 0.28% : 0.000053s : 1: add_recomputation 0.38% : 0.000071s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 2.08% : 0.000386s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.01% : 0.005555s : 1: jit_opt_a 0.95% : 0.000175s : 1: jit_opt_after_cconv 0.28% : 0.000053s : 1: jit_opt_b 2.26% : 0.000418s : 1: loop_unroll 2.86% : 0.000530s : 1: mutable_eliminate 5.18% : 0.000959s : 26: opt.transform.jit_opt_a 0.26% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000468s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000049s : 1: py_interpret_to_execute 0.07% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.48% : 0.000459s : 1: renormalize.infer 1.78% : 0.000329s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.46% : 0.000086s : 1: rewriter_before_opt_a 0.40% : 0.000074s : 1: symbol_engine_optimizer 45.75% : 0.008471s : 1: type_inference TotalTime = 0.0656941, [30] [bootstrap]: 0.00038324 [type_inference]: 0.0558309 [event_method]: 1.898e-05 [auto_monad]: 7.341e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00028109 [rewriter_before_opt_a]: 8.545e-05 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.00680303, [2] [Cycle 1]: 0.00295621, [27] [switch_simplify]: 6.136e-05 [loop_unroll]: 3.109e-05 [a_1]: 0.00061193 [with_stream_mark]: 2.235e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 1.076e-05 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 9.96998e-06 [inline_without_move]: 5.81e-06 [renormalize]: 0.00189928 [add_forward_monad_depend]: 4.55999e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 1.208e-05 [cse]: 2.236e-05 [replace_applicator]: 1.256e-05 [Cycle 2]: 0.00036465, [27] [switch_simplify]: 6.38e-06 [loop_unroll]: 5.69999e-06 [a_1]: 0.00012244 [with_stream_mark]: 8.84e-06 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 5.63002e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.87001e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.68e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.443e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.91e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.20002e-06 [cse]: 1.249e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.027e-05 [rewriter_after_opt_a]: 3.106e-05 [convert_after_rewriter]: 5.37001e-06 [order_py_execute_after_rewriter]: 4.62998e-06 [mutable_eliminate]: 0.00065192 [jit_opt_b]: 5.38e-05, [1] [Cycle 1]: 4.771e-05, [2] [frontend_op_eliminate]: 1.827e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 1.646e-05 [loop_unroll]: 0.00043011 [jit_opt_after_cconv]: 0.00014833, [1] [Cycle 1]: 0.00014203, [11] [c_1]: 2.614e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.08e-05 [call_graph_tuple_transform]: 2.027e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.11002e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 8.78001e-06 [partial_unused_args_eliminate]: 1.50001e-06 [environ_conv]: 7.5e-06 [add_recomputation]: 3.458e-05 [cse_after_recomputation]: 3.752e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.038e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 5.14998e-06 [opt_after_jit_grad]: 0.00045984 [symbol_engine_optimizer]: 7.6e-05, [1] [Cycle 1]: 6.943e-05, [6] [build]: 2.98e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 6.96999e-06 [fold_const_symbol]: 9.34998e-06 [renormalize]: 5.19998e-07 [validate]: 3.354e-05 Sums bootstrap : 0.000383s : 0.62% type_inference : 0.055831s : 90.61% event_method : 0.000019s : 0.03% auto_monad : 0.000073s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000281s : 0.46% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000734s : 1.19% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001899s : 3.08% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000035s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000031s : 0.05% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000652s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000430s : 0.70% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000460s : 0.75% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000034s : 0.05% Time group info: ------[substitution.] 0.000237 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000005s : 4: substitution.graph_param_transform 84.98% : 0.000202s : 4: substitution.inline 2.13% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 5.27% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055745 2 96.52% : 0.053803s : 1: type_inference.infer 3.48% : 0.001942s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.75% : 0.000052s : 4: replace.inline 31.25% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.63% : 0.000199s : 4: match.inline 5.37% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.51% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.12% : 0.000001s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.46% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.88% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002326 26 74.16% : 0.001725s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.10% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.74% : 0.000552s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068643 72 0.05% : 0.000037s : 1: add_recomputation 0.11% : 0.000077s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.58% : 0.000401s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.06% : 0.000040s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.92% : 0.006807s : 1: jit_opt_a 0.22% : 0.000151s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.64% : 0.000438s : 1: loop_unroll 0.96% : 0.000660s : 1: mutable_eliminate 1.42% : 0.000972s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000287s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000011s : 1: remove_dup_value 1.90% : 0.001305s : 1: renormalize.infer 0.85% : 0.000587s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000034s : 1: rewriter_after_opt_a 0.13% : 0.000091s : 1: rewriter_before_opt_a 0.11% : 0.000079s : 1: symbol_engine_optimizer 81.36% : 0.055850s : 1: type_inference TotalTime = 0.0189274, [30] [bootstrap]: 0.00037033 [type_inference]: 0.00955864 [event_method]: 2.173e-05 [auto_monad]: 7.061e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 4.552e-05 [rewriter_before_opt_a]: 8.873e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.00626119, [2] [Cycle 1]: 0.00241492, [27] [switch_simplify]: 6.265e-05 [loop_unroll]: 3.253e-05 [a_1]: 0.00068561 [with_stream_mark]: 2.469e-05 [recompute_prepare]: 9.38002e-06 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.96003e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.74999e-06 [merge_forward]: 4.14002e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00121887 [add_forward_monad_depend]: 7.53999e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.699e-05 [cse]: 4.496e-05 [replace_applicator]: 1.771e-05 [Cycle 2]: 0.0003558, [27] [switch_simplify]: 6.49999e-06 [loop_unroll]: 5.62001e-06 [a_1]: 9.931e-05 [with_stream_mark]: 1.166e-05 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 4.04002e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.79002e-06 [inline_without_move]: 5.24e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.83998e-06 [cse]: 1.551e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 1.484e-05 [rewriter_after_opt_a]: 4.398e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00070027 [jit_opt_b]: 5.726e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.779e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 3.043e-05 [loop_unroll]: 0.00046228 [jit_opt_after_cconv]: 0.00017224, [1] [Cycle 1]: 0.00016503, [11] [c_1]: 2.362e-05 [parameter_eliminate]: 3.63999e-06 [updatestate_depend_eliminate]: 8.67998e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 3.505e-05 [call_graph_tuple_transform]: 2.261e-05 [tuple_list_get_item_eliminator]: 5.41998e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 4.617e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 6.91001e-06 [add_recomputation]: 5.785e-05 [cse_after_recomputation]: 3.23e-05, [1] [Cycle 1]: 2.033e-05, [1] [cse]: 1.409e-05 [auto_monad_reorder]: 2.003e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 5.74e-06 [opt_after_jit_grad]: 0.00050819 [symbol_engine_optimizer]: 7.996e-05, [1] [Cycle 1]: 7.232e-05, [6] [build]: 4.25e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.427e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 9.67999e-06 [renormalize]: 4.50003e-07 [validate]: 4.738e-05 Sums bootstrap : 0.000370s : 2.50% type_inference : 0.009559s : 64.65% event_method : 0.000022s : 0.15% auto_monad : 0.000071s : 0.48% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.31% rewriter_before_opt_a : 0.000089s : 0.60% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.47% jit_opt_a.loop_unroll : 0.000038s : 0.26% jit_opt_a.a_1 : 0.000785s : 5.31% jit_opt_a.with_stream_mark : 0.000036s : 0.25% jit_opt_a.recompute_prepare : 0.000015s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000012s : 0.08% jit_opt_a.renormalize : 0.001219s : 8.24% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.16% jit_opt_a.cse : 0.000060s : 0.41% jit_opt_a.replace_applicator : 0.000024s : 0.16% py_interpret_to_execute_after_opt_a : 0.000015s : 0.10% rewriter_after_opt_a : 0.000044s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000700s : 4.74% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000030s : 0.21% loop_unroll : 0.000462s : 3.13% jit_opt_after_cconv.c_1 : 0.000024s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000035s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000046s : 0.31% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000058s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000020s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000508s : 3.44% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.32% Time group info: ------[substitution.] 0.000287 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 87.19% : 0.000251s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000005s : 2: substitution.replace_old_param 4.37% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009482 2 89.21% : 0.008459s : 1: type_inference.infer 10.79% : 0.001023s : 1: type_inference.specialize ------[replace.] 0.000099 7 69.42% : 0.000069s : 5: replace.inline 30.58% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 7 95.60% : 0.000248s : 5: match.inline 4.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.42% : 0.000002s : 11: predicate.addn_zero_filter 1.80% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 11: predicate.environ_get_depend_swap 1.23% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.77% : 0.000008s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.01% : 0.000003s : 16: predicate.load_eliminater 1.22% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000002s : 11: predicate.minmaximum_grad 2.43% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 1.78% : 0.000002s : 11: predicate.reduce_eliminate 1.64% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 11: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.71% : 0.000010s : 59: predicate.switch_simplify 1.12% : 0.000001s : 11: predicate.tile_eliminate 1.18% : 0.000002s : 11: predicate.transpose_eliminate 1.36% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000953 16 56.10% : 0.000535s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.24% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.67% : 0.000330s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021230 72 0.29% : 0.000061s : 1: add_recomputation 0.35% : 0.000074s : 1: auto_monad 0.11% : 0.000023s : 1: auto_monad_reorder 1.85% : 0.000393s : 1: bootstrap 0.16% : 0.000033s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000034s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000027s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 29.51% : 0.006265s : 1: jit_opt_a 0.83% : 0.000175s : 1: jit_opt_after_cconv 0.28% : 0.000060s : 1: jit_opt_b 2.22% : 0.000471s : 1: loop_unroll 3.35% : 0.000710s : 1: mutable_eliminate 4.83% : 0.001026s : 26: opt.transform.jit_opt_a 0.25% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000019s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000517s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.23% : 0.000049s : 1: remove_dup_value 3.98% : 0.000846s : 1: renormalize.infer 1.71% : 0.000362s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000047s : 1: rewriter_after_opt_a 0.43% : 0.000092s : 1: rewriter_before_opt_a 0.39% : 0.000083s : 1: symbol_engine_optimizer 45.12% : 0.009579s : 1: type_inference TotalTime = 0.148534, [30] [bootstrap]: 0.00031058 [type_inference]: 0.132583 [event_method]: 2.799e-05 [auto_monad]: 7.057e-05 [graph_reusing]: 3.74002e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00092973 [rewriter_before_opt_a]: 0.00010731 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.0111464, [2] [Cycle 1]: 0.00598639, [27] [switch_simplify]: 8.026e-05 [loop_unroll]: 3.566e-05 [a_1]: 0.00078175 [with_stream_mark]: 1.682e-05 [recompute_prepare]: 8.82e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 7.89997e-06 [updatestate_useless_node_eliminater]: 6.81001e-06 [accelerated_algorithm]: 7.23e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.96001e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.33002e-06 [renormalize]: 0.00467506 [add_forward_monad_depend]: 8.67998e-06 [auto_monad_grad]: 3.55e-06 [auto_monad_eliminator]: 2.1e-05 [cse]: 3.595e-05 [replace_applicator]: 2.37e-05 [Cycle 2]: 0.00042711, [27] [switch_simplify]: 7.81001e-06 [loop_unroll]: 7.05e-06 [a_1]: 0.00014999 [with_stream_mark]: 1.751e-05 [recompute_prepare]: 6.91001e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 6.18998e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 2.28002e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.58001e-06 [cell_reuse_recompute_pass]: 3.94002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 6.06998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 7.65998e-06 [cse]: 1.413e-05 [replace_applicator]: 6.31998e-06 [py_interpret_to_execute_after_opt_a]: 1.956e-05 [rewriter_after_opt_a]: 4.004e-05 [convert_after_rewriter]: 7.46999e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.00088161 [jit_opt_b]: 7.047e-05, [1] [Cycle 1]: 6.094e-05, [2] [frontend_op_eliminate]: 2.507e-05 [inline_after_opt_a]: 2.111e-05 [cconv]: 3.099e-05 [loop_unroll]: 0.00071139 [jit_opt_after_cconv]: 0.00019232, [1] [Cycle 1]: 0.00018326, [11] [c_1]: 3.234e-05 [parameter_eliminate]: 3.35998e-06 [updatestate_depend_eliminate]: 7.28e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 4.93001e-06 [cse]: 3.137e-05 [call_graph_tuple_transform]: 2.694e-05 [tuple_list_get_item_eliminator]: 1.039e-05 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.65998e-06 [remove_dup_value]: 1.896e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 9.10999e-06 [add_recomputation]: 5.77e-05 [cse_after_recomputation]: 2.933e-05, [1] [Cycle 1]: 2.324e-05, [1] [cse]: 1.673e-05 [auto_monad_reorder]: 1.939e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 8.46002e-06 [opt_after_jit_grad]: 0.00061286 [symbol_engine_optimizer]: 0.00033371, [1] [Cycle 1]: 0.0003254, [6] [build]: 4.33999e-06 [elim_shapecalc]: 1.927e-05 [elim_not_effective]: 1.781e-05 [opt_reshape]: 7.21999e-06 [fold_const_symbol]: 0.00024404 [renormalize]: 6.10016e-07 [validate]: 5.994e-05 Sums bootstrap : 0.000311s : 0.22% type_inference : 0.132583s : 92.65% event_method : 0.000028s : 0.02% auto_monad : 0.000071s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000930s : 0.65% rewriter_before_opt_a : 0.000107s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000088s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000932s : 0.65% jit_opt_a.with_stream_mark : 0.000034s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.004675s : 3.27% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000882s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000711s : 0.50% jit_opt_after_cconv.c_1 : 0.000032s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000058s : 0.04% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000613s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000019s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000244s : 0.17% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000060s : 0.04% Time group info: ------[substitution.] 0.000310 28 0.85% : 0.000003s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.28% : 0.000007s : 4: substitution.graph_param_transform 83.43% : 0.000259s : 5: substitution.inline 1.56% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000013s : 3: substitution.reduce_eliminate 1.93% : 0.000006s : 4: substitution.remove_not_recompute_node 1.84% : 0.000006s : 2: substitution.replace_old_param 3.24% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.132459 2 96.14% : 0.127352s : 1: type_inference.infer 3.86% : 0.005107s : 1: type_inference.specialize ------[replace.] 0.000127 7 65.84% : 0.000084s : 5: replace.inline 34.16% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 7 96.63% : 0.000255s : 5: match.inline 3.37% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000161 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 2.06% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 0.98% : 0.000002s : 13: predicate.depend_value_elim 1.26% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.56% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 4.81% : 0.000008s : 28: predicate.inline 0.77% : 0.000001s : 8: predicate.inline_without_move 0.39% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.32% : 0.000002s : 13: predicate.minmaximum_grad 1.62% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.52% : 0.000004s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000004s : 20: predicate.switch_defer_inline 2.45% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.57% : 0.000012s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.84% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002994 25 61.83% : 0.001851s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.44% : 0.000073s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.73% : 0.001070s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.154730 72 0.04% : 0.000061s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.21% : 0.000331s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000032s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 7.21% : 0.011151s : 1: jit_opt_a 0.13% : 0.000197s : 1: jit_opt_after_cconv 0.05% : 0.000073s : 1: jit_opt_b 0.47% : 0.000723s : 1: loop_unroll 0.58% : 0.000892s : 1: mutable_eliminate 0.78% : 0.001213s : 26: opt.transform.jit_opt_a 0.05% : 0.000072s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000276s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000625s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.61% : 0.000938s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 2.28% : 0.003531s : 1: renormalize.infer 0.73% : 0.001132s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000113s : 1: rewriter_before_opt_a 0.22% : 0.000337s : 1: symbol_engine_optimizer 85.70% : 0.132607s : 1: type_inference TotalTime = 0.0448166, [30] [bootstrap]: 0.00035299 [type_inference]: 0.00989314 [event_method]: 2.336e-05 [auto_monad]: 7.473e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 4.715e-05 [rewriter_before_opt_a]: 8.67e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.0314845, [2] [Cycle 1]: 0.0273084, [27] [switch_simplify]: 7.152e-05 [loop_unroll]: 3.389e-05 [a_1]: 0.00078099 [with_stream_mark]: 2.685e-05 [recompute_prepare]: 9.29e-06 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.48998e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 4.97999e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.805e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.61003e-06 [inline_without_move]: 5.66e-06 [renormalize]: 0.0259398 [add_forward_monad_depend]: 1.314e-05 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 2.481e-05 [cse]: 4.704e-05 [replace_applicator]: 2.759e-05 [Cycle 2]: 0.00037971, [27] [switch_simplify]: 7.28e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00010381 [with_stream_mark]: 1.686e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.66001e-06 [parameter_eliminate]: 2.01003e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 5.25999e-06 [cell_reuse_recompute_pass]: 3.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.807e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 5.14e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 9.30013e-07 [auto_monad_eliminator]: 7.53e-06 [cse]: 1.647e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 2.224e-05 [rewriter_after_opt_a]: 4.683e-05 [convert_after_rewriter]: 8.17e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00083154 [jit_opt_b]: 0.00011677, [1] [Cycle 1]: 0.00010619, [2] [frontend_op_eliminate]: 1.632e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 3.739e-05 [loop_unroll]: 0.00049392 [jit_opt_after_cconv]: 0.0001909, [1] [Cycle 1]: 0.0001826, [11] [c_1]: 2.298e-05 [parameter_eliminate]: 6.12999e-06 [updatestate_depend_eliminate]: 1.012e-05 [updatestate_assign_eliminate]: 4.06001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [cse]: 4.738e-05 [call_graph_tuple_transform]: 2.309e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 2.17001e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 5.021e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 6.14999e-06 [add_recomputation]: 5.895e-05 [cse_after_recomputation]: 2.913e-05, [1] [Cycle 1]: 2.206e-05, [1] [cse]: 1.484e-05 [auto_monad_reorder]: 1.937e-05 [get_jit_bprop_graph]: 2.84999e-06 [rewriter_after_jit_bprop_graph]: 9.04998e-06 [opt_after_jit_grad]: 0.00056315 [symbol_engine_optimizer]: 7.979e-05, [1] [Cycle 1]: 7.208e-05, [6] [build]: 5.77001e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.403e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 9.00001e-06 [renormalize]: 5.09986e-07 [validate]: 5.036e-05 Sums bootstrap : 0.000353s : 0.88% type_inference : 0.009893s : 24.58% event_method : 0.000023s : 0.06% auto_monad : 0.000075s : 0.19% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000047s : 0.12% rewriter_before_opt_a : 0.000087s : 0.22% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000079s : 0.20% jit_opt_a.loop_unroll : 0.000040s : 0.10% jit_opt_a.a_1 : 0.000885s : 2.20% jit_opt_a.with_stream_mark : 0.000044s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.04% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.02% jit_opt_a.parameter_eliminate : 0.000005s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000010s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.05% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.025940s : 64.44% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.04% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.08% jit_opt_a.cse : 0.000064s : 0.16% jit_opt_a.replace_applicator : 0.000033s : 0.08% py_interpret_to_execute_after_opt_a : 0.000022s : 0.06% rewriter_after_opt_a : 0.000047s : 0.12% convert_after_rewriter : 0.000008s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000832s : 2.07% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000037s : 0.09% loop_unroll : 0.000494s : 1.23% jit_opt_after_cconv.c_1 : 0.000023s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000047s : 0.12% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.06% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.01% remove_dup_value : 0.000050s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000059s : 0.15% cse_after_recomputation.cse : 0.000015s : 0.04% auto_monad_reorder : 0.000019s : 0.05% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.02% opt_after_jit_grad : 0.000563s : 1.40% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.13% Time group info: ------[substitution.] 0.000320 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 3: substitution.graph_param_transform 86.98% : 0.000279s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.89% : 0.000006s : 4: substitution.remove_not_recompute_node 2.13% : 0.000007s : 2: substitution.replace_old_param 4.46% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009802 2 89.10% : 0.008734s : 1: type_inference.infer 10.90% : 0.001069s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.21% : 0.000073s : 5: replace.inline 31.79% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 7 95.53% : 0.000276s : 5: match.inline 4.47% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.34% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 11: predicate.addn_check_dump 1.42% : 0.000002s : 11: predicate.addn_zero_filter 1.69% : 0.000002s : 11: predicate.arithmetic_simplify 1.47% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000002s : 11: predicate.depend_value_elim 1.42% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.42% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 11: predicate.environ_get_depend_swap 1.47% : 0.000002s : 11: predicate.environ_get_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 6.15% : 0.000009s : 24: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000003s : 16: predicate.load_eliminater 1.01% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 11: predicate.merge_addn 1.03% : 0.000001s : 11: predicate.minmaximum_grad 1.97% : 0.000003s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000002s : 11: predicate.print_const_string_wrapper 1.65% : 0.000002s : 11: predicate.reduce_eliminate 1.54% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 2.19% : 0.000003s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 11: predicate.reshape_eliminate 1.18% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.76% : 0.000001s : 6: predicate.specialize_transform 1.61% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.62% : 0.000011s : 59: predicate.switch_simplify 1.16% : 0.000002s : 11: predicate.tile_eliminate 1.19% : 0.000002s : 11: predicate.transpose_eliminate 1.52% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 11: predicate.value_based_eliminate 0.25% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000984 16 50.17% : 0.000494s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.52% : 0.000094s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.32% : 0.000397s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071947 72 0.09% : 0.000062s : 1: add_recomputation 0.11% : 0.000079s : 1: auto_monad 0.03% : 0.000022s : 1: auto_monad_reorder 0.53% : 0.000379s : 1: bootstrap 0.06% : 0.000040s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000028s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 43.77% : 0.031488s : 1: jit_opt_a 0.27% : 0.000194s : 1: jit_opt_after_cconv 0.17% : 0.000120s : 1: jit_opt_b 0.70% : 0.000504s : 1: loop_unroll 1.17% : 0.000844s : 1: mutable_eliminate 1.59% : 0.001147s : 26: opt.transform.jit_opt_a 0.07% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000027s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000021s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000576s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.07% : 0.000050s : 1: py_interpret_to_execute 0.03% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000054s : 1: remove_dup_value 35.34% : 0.025428s : 1: renormalize.infer 0.69% : 0.000493s : 1: renormalize.specialize 0.02% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000050s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000082s : 1: symbol_engine_optimizer 13.78% : 0.009917s : 1: type_inference TotalTime = 0.208349, [30] [bootstrap]: 0.00038263 [type_inference]: 0.190522 [event_method]: 2.985e-05 [auto_monad]: 9.267e-05 [graph_reusing]: 6.27001e-06 [pre_auto_parallel]: 2.07999e-06 [py_interpret_to_execute]: 0.00112606 [rewriter_before_opt_a]: 0.00012839 [expand_dump_flag]: 4.45e-06 [jit_opt_a]: 0.0130679, [2] [Cycle 1]: 0.00686137, [27] [switch_simplify]: 0.00011088 [loop_unroll]: 3.615e-05 [a_1]: 0.00103183 [with_stream_mark]: 2.246e-05 [recompute_prepare]: 1.119e-05 [updatestate_depend_eliminate]: 4.54002e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 8.03001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.7e-06 [meta_shard_fg_expand]: 2.85002e-06 [get_grad_eliminate_]: 7.97e-06 [merge_forward]: 4.85001e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.808e-05 [j_node_and_user_rematch]: 1.144e-05 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 1.142e-05 [inline_without_move]: 6.59001e-06 [renormalize]: 0.00521532 [add_forward_monad_depend]: 9.60001e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.272e-05 [cse]: 4.401e-05 [replace_applicator]: 1.994e-05 [Cycle 2]: 0.0004307, [27] [switch_simplify]: 7.78001e-06 [loop_unroll]: 8.02e-06 [a_1]: 0.00015689 [with_stream_mark]: 1.366e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 7.33e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 6.44001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 4.57e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.279e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.92002e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 5.77999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.34999e-06 [cse]: 1.635e-05 [replace_applicator]: 6.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.947e-05 [rewriter_after_opt_a]: 4.504e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00089485 [jit_opt_b]: 6.309e-05, [1] [Cycle 1]: 5.473e-05, [2] [frontend_op_eliminate]: 2.218e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 2.794e-05 [loop_unroll]: 0.00048808 [jit_opt_after_cconv]: 0.00017564, [1] [Cycle 1]: 0.00016862, [11] [c_1]: 2.91e-05 [parameter_eliminate]: 3.11001e-06 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 3.193e-05 [call_graph_tuple_transform]: 2.417e-05 [tuple_list_get_item_eliminator]: 6.83e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.71999e-06 [remove_dup_value]: 1.878e-05 [partial_unused_args_eliminate]: 2.61e-06 [environ_conv]: 9.52999e-06 [add_recomputation]: 5.907e-05 [cse_after_recomputation]: 2.78e-05, [1] [Cycle 1]: 2.079e-05, [1] [cse]: 1.463e-05 [auto_monad_reorder]: 1.921e-05 [get_jit_bprop_graph]: 2.42001e-06 [rewriter_after_jit_bprop_graph]: 9.22001e-06 [opt_after_jit_grad]: 0.0005637 [symbol_engine_optimizer]: 8.685e-05, [1] [Cycle 1]: 7.987e-05, [6] [build]: 5.12e-06 [elim_shapecalc]: 1.043e-05 [elim_not_effective]: 1.618e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 1.058e-05 [renormalize]: 5.39992e-07 [validate]: 0.00023201 Sums bootstrap : 0.000383s : 0.19% type_inference : 0.190522s : 94.38% event_method : 0.000030s : 0.01% auto_monad : 0.000093s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.001126s : 0.56% rewriter_before_opt_a : 0.000128s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000119s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.001189s : 0.59% jit_opt_a.with_stream_mark : 0.000036s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.005215s : 2.58% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.01% jit_opt_a.cse : 0.000060s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000045s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000895s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000488s : 0.24% jit_opt_after_cconv.c_1 : 0.000029s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000059s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000564s : 0.28% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000232s : 0.11% Time group info: ------[substitution.] 0.000431 28 0.49% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.55% : 0.000007s : 4: substitution.graph_param_transform 86.16% : 0.000372s : 5: substitution.inline 1.09% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.76% : 0.000016s : 3: substitution.reduce_eliminate 1.44% : 0.000006s : 4: substitution.remove_not_recompute_node 1.38% : 0.000006s : 2: substitution.replace_old_param 3.62% : 0.000016s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.190388 2 97.21% : 0.185071s : 1: type_inference.infer 2.79% : 0.005316s : 1: type_inference.specialize ------[replace.] 0.000173 7 63.80% : 0.000110s : 5: replace.inline 36.20% : 0.000062s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000382 7 96.18% : 0.000367s : 5: match.inline 3.82% : 0.000015s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000180 886 1.17% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000002s : 13: predicate.addn_check_dump 1.78% : 0.000003s : 13: predicate.addn_zero_filter 3.26% : 0.000006s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000002s : 13: predicate.compare_switch_simplify 1.40% : 0.000003s : 13: predicate.depend_value_elim 1.43% : 0.000003s : 13: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.65% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.86% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_depend_swap 1.05% : 0.000002s : 13: predicate.environ_get_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 4.10% : 0.000007s : 28: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000007s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.52% : 0.000003s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 1.91% : 0.000003s : 19: predicate.partial_eliminate 1.61% : 0.000003s : 13: predicate.print_const_string_wrapper 2.40% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000003s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.50% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 2.16% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.42% : 0.000013s : 64: predicate.switch_simplify 1.53% : 0.000003s : 13: predicate.tile_eliminate 1.43% : 0.000003s : 13: predicate.transpose_eliminate 1.40% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 2.66% : 0.000005s : 13: predicate.tuple_list_set_item_eliminator 1.74% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.25% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.20% : 0.000004s : 13: predicate.value_based_eliminate 0.28% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003523 25 60.01% : 0.002114s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000093s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.35% : 0.001316s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.214952 72 0.03% : 0.000062s : 1: add_recomputation 0.04% : 0.000097s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.19% : 0.000401s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000036s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 6.08% : 0.013073s : 1: jit_opt_a 0.08% : 0.000178s : 1: jit_opt_after_cconv 0.03% : 0.000066s : 1: jit_opt_b 0.23% : 0.000497s : 1: loop_unroll 0.42% : 0.000905s : 1: mutable_eliminate 0.70% : 0.001503s : 26: opt.transform.jit_opt_a 0.03% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000574s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.53% : 0.001141s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.77% : 0.003794s : 1: renormalize.infer 0.65% : 0.001408s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000048s : 1: rewriter_after_opt_a 0.06% : 0.000133s : 1: rewriter_before_opt_a 0.04% : 0.000090s : 1: symbol_engine_optimizer 88.65% : 0.190549s : 1: type_inference TotalTime = 0.0335391, [30] [bootstrap]: 0.00041736 [type_inference]: 0.0223144 [event_method]: 2.734e-05 [auto_monad]: 8.108e-05 [graph_reusing]: 6.07001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 7.571e-05 [rewriter_before_opt_a]: 9.412e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00783157, [2] [Cycle 1]: 0.00272549, [27] [switch_simplify]: 8.884e-05 [loop_unroll]: 3.541e-05 [a_1]: 0.00078689 [with_stream_mark]: 2.639e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 3.60998e-06 [get_grad_eliminate_]: 6.35002e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.46002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 1.04e-05 [inline_without_move]: 6.19001e-06 [renormalize]: 0.00139016 [add_forward_monad_depend]: 8.42e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.96e-05 [cse]: 3.79e-05 [replace_applicator]: 1.566e-05 [Cycle 2]: 0.00036012, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.98002e-06 [a_1]: 0.00010865 [with_stream_mark]: 1.244e-05 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 5.01002e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 3.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 7.78001e-06 [inline_without_move]: 4.74e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.79999e-06 [cse]: 1.293e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.782e-05 [rewriter_after_opt_a]: 4.689e-05 [convert_after_rewriter]: 7.70998e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.0009085 [jit_opt_b]: 5.301e-05, [1] [Cycle 1]: 4.554e-05, [2] [frontend_op_eliminate]: 1.82e-05 [inline_after_opt_a]: 1.569e-05 [cconv]: 2.98e-05 [loop_unroll]: 0.00047625 [jit_opt_after_cconv]: 0.00017188, [1] [Cycle 1]: 0.00016416, [11] [c_1]: 2.206e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 1.965e-05 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 2.723e-05 [call_graph_tuple_transform]: 2.21e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.721e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 6.44001e-06 [add_recomputation]: 5.569e-05 [cse_after_recomputation]: 2.561e-05, [1] [Cycle 1]: 1.955e-05, [1] [cse]: 1.316e-05 [auto_monad_reorder]: 1.93e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 7.73999e-06 [opt_after_jit_grad]: 0.00049019 [symbol_engine_optimizer]: 7.914e-05, [1] [Cycle 1]: 7.24e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 9.17999e-06 [elim_not_effective]: 1.416e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.86998e-06 [renormalize]: 3.89991e-07 [validate]: 4.449e-05 Sums bootstrap : 0.000417s : 1.48% type_inference : 0.022314s : 79.37% event_method : 0.000027s : 0.10% auto_monad : 0.000081s : 0.29% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000076s : 0.27% rewriter_before_opt_a : 0.000094s : 0.33% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000095s : 0.34% jit_opt_a.loop_unroll : 0.000041s : 0.15% jit_opt_a.a_1 : 0.000896s : 3.19% jit_opt_a.with_stream_mark : 0.000039s : 0.14% jit_opt_a.recompute_prepare : 0.000014s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000012s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.04% jit_opt_a.merge_forward : 0.000007s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.10% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.07% jit_opt_a.meta_fg_expand : 0.000005s : 0.02% jit_opt_a.replace_old_param : 0.000018s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001390s : 4.94% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.09% jit_opt_a.cse : 0.000051s : 0.18% jit_opt_a.replace_applicator : 0.000021s : 0.08% py_interpret_to_execute_after_opt_a : 0.000018s : 0.06% rewriter_after_opt_a : 0.000047s : 0.17% convert_after_rewriter : 0.000008s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000909s : 3.23% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000030s : 0.11% loop_unroll : 0.000476s : 1.69% jit_opt_after_cconv.c_1 : 0.000022s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000020s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.10% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000017s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.02% add_recomputation : 0.000056s : 0.20% cse_after_recomputation.cse : 0.000013s : 0.05% auto_monad_reorder : 0.000019s : 0.07% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000008s : 0.03% opt_after_jit_grad : 0.000490s : 1.74% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.16% Time group info: ------[substitution.] 0.000355 27 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 1.83% : 0.000006s : 3: substitution.graph_param_transform 86.23% : 0.000306s : 5: substitution.inline 1.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.49% : 0.000012s : 3: substitution.reduce_eliminate 1.43% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000006s : 2: substitution.replace_old_param 3.29% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.022205 2 40.70% : 0.009037s : 1: type_inference.infer 59.30% : 0.013168s : 1: type_inference.specialize ------[replace.] 0.000115 7 65.92% : 0.000076s : 5: replace.inline 34.08% : 0.000039s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000313 7 96.64% : 0.000302s : 5: match.inline 3.36% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 747 1.09% : 0.000001s : 11: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 11: predicate.addn_check_dump 1.53% : 0.000002s : 11: predicate.addn_zero_filter 2.20% : 0.000003s : 11: predicate.arithmetic_simplify 1.51% : 0.000002s : 11: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 0.99% : 0.000001s : 11: predicate.compare_switch_simplify 1.10% : 0.000002s : 11: predicate.depend_value_elim 1.01% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.77% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 11: predicate.environ_get_depend_swap 1.67% : 0.000002s : 11: predicate.environ_get_eliminate 1.24% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000002s : 6: predicate.get_grad_eliminate 0.36% : 0.000001s : 3: predicate.graph_param_transform 5.31% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 6: predicate.less_batch_normalization 1.90% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.12% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 11: predicate.merge_addn 1.03% : 0.000001s : 11: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.01% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000002s : 11: predicate.print_const_string_wrapper 2.70% : 0.000004s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.44% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.58% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 11: predicate.same_eliminate 0.46% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.36% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.90% : 0.000004s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.85% : 0.000011s : 59: predicate.switch_simplify 1.66% : 0.000002s : 11: predicate.tile_eliminate 1.39% : 0.000002s : 11: predicate.transpose_eliminate 1.26% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.93% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.23% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.44% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.012504 16 4.33% : 0.000541s : 7: func_graph_cloner_run.FuncGraphClonerGraph 0.79% : 0.000099s : 2: func_graph_cloner_run.FuncGraphClonerNode 94.88% : 0.011864s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.036134 72 0.16% : 0.000059s : 1: add_recomputation 0.23% : 0.000085s : 1: auto_monad 0.06% : 0.000022s : 1: auto_monad_reorder 1.22% : 0.000441s : 1: bootstrap 0.09% : 0.000032s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000028s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.09% : 0.000033s : 1: event_method 0.02% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 21.69% : 0.007838s : 1: jit_opt_a 0.48% : 0.000175s : 1: jit_opt_after_cconv 0.15% : 0.000056s : 1: jit_opt_b 1.34% : 0.000485s : 1: loop_unroll 2.55% : 0.000920s : 1: mutable_eliminate 3.21% : 0.001159s : 26: opt.transform.jit_opt_a 0.14% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000028s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000016s : 1: opt.transform.mutable_eliminate 0.07% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000036s : 4: opt.transform.symbol_engine_opt 1.38% : 0.000499s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000079s : 1: py_interpret_to_execute 0.06% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000020s : 1: remove_dup_value 2.25% : 0.000813s : 1: renormalize.infer 1.57% : 0.000566s : 1: renormalize.specialize 0.03% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000051s : 1: rewriter_after_opt_a 0.27% : 0.000097s : 1: rewriter_before_opt_a 0.23% : 0.000082s : 1: symbol_engine_optimizer 61.83% : 0.022341s : 1: type_inference TotalTime = 0.0161509, [30] [bootstrap]: 0.00030867 [type_inference]: 0.00497358 [event_method]: 1.725e-05 [auto_monad]: 6.87e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.82002e-06 [py_interpret_to_execute]: 0.000108 [rewriter_before_opt_a]: 7.448e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00835046, [2] [Cycle 1]: 0.00457269, [27] [switch_simplify]: 5.687e-05 [loop_unroll]: 3.072e-05 [a_1]: 0.00336438 [with_stream_mark]: 2.214e-05 [recompute_prepare]: 1.102e-05 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 8.49998e-06 [meta_fg_expand]: 2.34999e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00074445 [add_forward_monad_depend]: 6.26e-06 [auto_monad_grad]: 3.43999e-06 [auto_monad_eliminator]: 1.728e-05 [cse]: 3.313e-05 [replace_applicator]: 1.207e-05 [Cycle 2]: 0.00031977, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.114e-05 [with_stream_mark]: 9.44e-06 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 4.80999e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.00999e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.63001e-06 [merge_forward]: 2.52001e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.364e-05 [j_node_and_user_rematch]: 8.54002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 5.09e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.28998e-06 [cse]: 1.006e-05 [replace_applicator]: 4.97e-06 [py_interpret_to_execute_after_opt_a]: 1.312e-05 [rewriter_after_opt_a]: 4.352e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00066405 [jit_opt_b]: 4.998e-05, [1] [Cycle 1]: 4.283e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.595e-05 [cconv]: 2.805e-05 [loop_unroll]: 0.00042257 [jit_opt_after_cconv]: 0.00014734, [1] [Cycle 1]: 0.00014081, [11] [c_1]: 2.149e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 6.26998e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.18998e-06 [cse]: 2.33e-05 [call_graph_tuple_transform]: 1.945e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.22999e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 6.60997e-06 [add_recomputation]: 5.191e-05 [cse_after_recomputation]: 2.164e-05, [1] [Cycle 1]: 1.63e-05, [1] [cse]: 1.04e-05 [auto_monad_reorder]: 1.551e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 5.91e-06 [opt_after_jit_grad]: 0.00044773 [symbol_engine_optimizer]: 7.206e-05, [1] [Cycle 1]: 6.539e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.222e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 4.89992e-07 [validate]: 3.677e-05 Sums bootstrap : 0.000309s : 2.55% type_inference : 0.004974s : 41.11% event_method : 0.000017s : 0.14% auto_monad : 0.000069s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000108s : 0.89% rewriter_before_opt_a : 0.000074s : 0.62% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.52% jit_opt_a.loop_unroll : 0.000036s : 0.30% jit_opt_a.a_1 : 0.003456s : 28.56% jit_opt_a.with_stream_mark : 0.000032s : 0.26% jit_opt_a.recompute_prepare : 0.000016s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000745s : 6.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.19% jit_opt_a.cse : 0.000043s : 0.36% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000044s : 0.36% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000664s : 5.49% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000028s : 0.23% loop_unroll : 0.000423s : 3.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000052s : 0.43% cse_after_recomputation.cse : 0.000010s : 0.09% auto_monad_reorder : 0.000016s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000448s : 3.70% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.30% Time group info: ------[substitution.] 0.002970 23 0.06% : 0.000002s : 2: substitution.elim_not_effective 0.06% : 0.000002s : 2: substitution.fold_const_symbol 0.21% : 0.000006s : 3: substitution.graph_param_transform 98.73% : 0.002932s : 4: substitution.inline 0.11% : 0.000003s : 4: substitution.j_node_and_user_rematch 0.20% : 0.000006s : 4: substitution.remove_not_recompute_node 0.16% : 0.000005s : 2: substitution.replace_old_param 0.47% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004906 2 81.76% : 0.004011s : 1: type_inference.infer 18.24% : 0.000895s : 1: type_inference.specialize ------[replace.] 0.000104 6 73.51% : 0.000076s : 4: replace.inline 26.49% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.002939 6 99.56% : 0.002927s : 4: match.inline 0.44% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 2.15% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 0.98% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.42% : 0.000001s : 3: predicate.graph_param_transform 6.24% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.74% : 0.000003s : 15: predicate.partial_eliminate 1.05% : 0.000001s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.74% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.69% : 0.000005s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.04% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000002s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.46% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.52% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000643 13 52.66% : 0.000339s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.51% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.83% : 0.000269s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020624 72 0.26% : 0.000055s : 1: add_recomputation 0.35% : 0.000072s : 1: auto_monad 0.09% : 0.000018s : 1: auto_monad_reorder 1.60% : 0.000329s : 1: bootstrap 0.15% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.11% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 40.50% : 0.008353s : 1: jit_opt_a 0.73% : 0.000150s : 1: jit_opt_after_cconv 0.25% : 0.000052s : 1: jit_opt_b 2.09% : 0.000430s : 1: loop_unroll 3.26% : 0.000673s : 1: mutable_eliminate 17.81% : 0.003672s : 26: opt.transform.jit_opt_a 0.23% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.21% : 0.000455s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.54% : 0.000112s : 1: py_interpret_to_execute 0.07% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000019s : 1: remove_dup_value 1.70% : 0.000350s : 1: renormalize.infer 1.87% : 0.000386s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000047s : 1: rewriter_after_opt_a 0.37% : 0.000077s : 1: rewriter_before_opt_a 0.36% : 0.000074s : 1: symbol_engine_optimizer 24.21% : 0.004993s : 1: type_inference TotalTime = 0.300248, [30] [bootstrap]: 0.00029905 [type_inference]: 0.257982 [event_method]: 2.389e-05 [auto_monad]: 7.748e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 0.00044282 [rewriter_before_opt_a]: 0.00010342 [expand_dump_flag]: 3.9e-06 [jit_opt_a]: 0.0126932, [2] [Cycle 1]: 0.00874304, [27] [switch_simplify]: 6.709e-05 [loop_unroll]: 3.435e-05 [a_1]: 0.00072299 [with_stream_mark]: 2.373e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.67e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 6.33e-06 [renormalize]: 0.00745509 [add_forward_monad_depend]: 1.401e-05 [auto_monad_grad]: 2.53003e-06 [auto_monad_eliminator]: 2.637e-05 [cse]: 4.898e-05 [replace_applicator]: 2.845e-05 [Cycle 2]: 0.00041304, [27] [switch_simplify]: 8.48999e-06 [loop_unroll]: 6.71999e-06 [a_1]: 0.00013114 [with_stream_mark]: 1.799e-05 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.67001e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 3.38999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.953e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 5.91e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.71e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.709e-05 [replace_applicator]: 6.33e-06 [py_interpret_to_execute_after_opt_a]: 2.039e-05 [rewriter_after_opt_a]: 4.647e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00082465 [jit_opt_b]: 5.812e-05, [1] [Cycle 1]: 5.039e-05, [2] [frontend_op_eliminate]: 2.003e-05 [inline_after_opt_a]: 1.912e-05 [cconv]: 3.214e-05 [loop_unroll]: 0.026107 [jit_opt_after_cconv]: 0.00022274, [1] [Cycle 1]: 0.00021235, [11] [c_1]: 3.14e-05 [parameter_eliminate]: 7.38e-06 [updatestate_depend_eliminate]: 1.169e-05 [updatestate_assign_eliminate]: 3.83999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 5.518e-05 [call_graph_tuple_transform]: 2.936e-05 [tuple_list_get_item_eliminator]: 7.71001e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 6.65002e-06 [remove_dup_value]: 2.231e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 1.394e-05 [add_recomputation]: 5.815e-05 [cse_after_recomputation]: 2.947e-05, [1] [Cycle 1]: 2.408e-05, [1] [cse]: 1.635e-05 [auto_monad_reorder]: 1.976e-05 [get_jit_bprop_graph]: 2.83e-06 [rewriter_after_jit_bprop_graph]: 9.81e-06 [opt_after_jit_grad]: 0.00065931 [symbol_engine_optimizer]: 8.205e-05, [1] [Cycle 1]: 7.54e-05, [6] [build]: 4.25e-06 [elim_shapecalc]: 1.014e-05 [elim_not_effective]: 1.541e-05 [opt_reshape]: 6.84001e-06 [fold_const_symbol]: 9.80002e-06 [renormalize]: 7.09988e-07 [validate]: 0.00016349 Sums bootstrap : 0.000299s : 0.10% type_inference : 0.257982s : 87.15% event_method : 0.000024s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000443s : 0.15% rewriter_before_opt_a : 0.000103s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000854s : 0.29% jit_opt_a.with_stream_mark : 0.000042s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.007455s : 2.52% jit_opt_a.add_forward_monad_depend : 0.000016s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.01% jit_opt_a.cse : 0.000066s : 0.02% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000046s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000825s : 0.28% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.01% loop_unroll : 0.026107s : 8.82% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000055s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000014s : 0.00% add_recomputation : 0.000058s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000659s : 0.22% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000163s : 0.06% Time group info: ------[substitution.] 0.000298 25 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000007s : 4: substitution.graph_param_transform 85.40% : 0.000255s : 5: substitution.inline 1.60% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000006s : 4: substitution.remove_not_recompute_node 2.33% : 0.000007s : 2: substitution.replace_old_param 4.88% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.257848 2 98.92% : 0.255071s : 1: type_inference.infer 1.08% : 0.002777s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.52% : 0.000071s : 5: replace.inline 31.48% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 94.95% : 0.000252s : 5: match.inline 5.05% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.45% : 0.000002s : 13: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.22% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.73% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000002s : 13: predicate.compare_switch_simplify 1.11% : 0.000002s : 13: predicate.depend_value_elim 1.01% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.16% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 6.13% : 0.000009s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 3.63% : 0.000006s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.57% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 1.97% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 1.96% : 0.000003s : 13: predicate.reduce_eliminate 1.31% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.82% : 0.000001s : 8: predicate.specialize_transform 1.23% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 1.89% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000011s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.14% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.53% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.54% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002886 25 59.87% : 0.001728s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.00% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.13% : 0.001071s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.308809 72 0.02% : 0.000061s : 1: add_recomputation 0.03% : 0.000081s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.10% : 0.000317s : 1: bootstrap 0.01% : 0.000035s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000016s : 1: environ_conv 0.01% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.11% : 0.012697s : 1: jit_opt_a 0.07% : 0.000226s : 1: jit_opt_after_cconv 0.02% : 0.000061s : 1: jit_opt_b 8.46% : 0.026129s : 1: loop_unroll 0.27% : 0.000836s : 1: mutable_eliminate 0.37% : 0.001129s : 26: opt.transform.jit_opt_a 0.02% : 0.000071s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000038s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000670s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.15% : 0.000450s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000025s : 1: remove_dup_value 2.01% : 0.006200s : 1: renormalize.infer 0.40% : 0.001233s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000050s : 1: rewriter_after_opt_a 0.04% : 0.000109s : 1: rewriter_before_opt_a 0.03% : 0.000085s : 1: symbol_engine_optimizer 83.55% : 0.258007s : 1: type_inference TotalTime = 0.0183806, [30] [bootstrap]: 0.00032735 [type_inference]: 0.00553682 [event_method]: 1.959e-05 [auto_monad]: 7.061e-05 [graph_reusing]: 6.43998e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 4.497e-05 [rewriter_before_opt_a]: 7.925e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.00806904, [2] [Cycle 1]: 0.00202467, [27] [switch_simplify]: 6.335e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00058113 [with_stream_mark]: 2.34e-05 [recompute_prepare]: 8.32998e-06 [updatestate_depend_eliminate]: 4.62998e-06 [updatestate_assign_eliminate]: 3.10002e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.42e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.0009693 [add_forward_monad_depend]: 7.22997e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.81e-05 [cse]: 3.449e-05 [replace_applicator]: 1.668e-05 [Cycle 2]: 0.00033754, [27] [switch_simplify]: 7.04001e-06 [loop_unroll]: 5.72001e-06 [a_1]: 9.791e-05 [with_stream_mark]: 1.269e-05 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 4.75999e-06 [merge_forward]: 3.47997e-06 [cell_reuse_recompute_pass]: 2.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 8.22998e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 7.6e-06 [inline_without_move]: 4.92e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.33002e-06 [cse]: 1.246e-05 [replace_applicator]: 5.45001e-06 [py_interpret_to_execute_after_opt_a]: 1.428e-05 [rewriter_after_opt_a]: 3.846e-05 [convert_after_rewriter]: 7.61001e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00244443 [jit_opt_b]: 5.557e-05, [1] [Cycle 1]: 4.742e-05, [2] [frontend_op_eliminate]: 1.793e-05 [inline_after_opt_a]: 1.831e-05 [cconv]: 3.606e-05 [loop_unroll]: 0.00048578 [jit_opt_after_cconv]: 0.00018692, [1] [Cycle 1]: 0.00018005, [11] [c_1]: 2.216e-05 [parameter_eliminate]: 5.52001e-06 [updatestate_depend_eliminate]: 8.44998e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 3.265e-05 [call_graph_tuple_transform]: 1.966e-05 [tuple_list_get_item_eliminator]: 5.65001e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.582e-05 [partial_unused_args_eliminate]: 2.71999e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 7.102e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.836e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.776e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 6.73e-06 [opt_after_jit_grad]: 0.00048451 [symbol_engine_optimizer]: 8.119e-05, [1] [Cycle 1]: 7.382e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 9.27999e-06 [elim_not_effective]: 1.394e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.98998e-06 [renormalize]: 6.49976e-07 [validate]: 4.317e-05 Sums bootstrap : 0.000327s : 2.72% type_inference : 0.005537s : 45.99% event_method : 0.000020s : 0.16% auto_monad : 0.000071s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.37% rewriter_before_opt_a : 0.000079s : 0.66% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.58% jit_opt_a.loop_unroll : 0.000037s : 0.30% jit_opt_a.a_1 : 0.000679s : 5.64% jit_opt_a.with_stream_mark : 0.000036s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.24% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000969s : 8.05% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.19% jit_opt_a.cse : 0.000047s : 0.39% jit_opt_a.replace_applicator : 0.000022s : 0.18% py_interpret_to_execute_after_opt_a : 0.000014s : 0.12% rewriter_after_opt_a : 0.000038s : 0.32% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.002444s : 20.30% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.15% cconv : 0.000036s : 0.30% loop_unroll : 0.000486s : 4.04% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000033s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000071s : 0.59% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.06% opt_after_jit_grad : 0.000485s : 4.02% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000043s : 0.36% Time group info: ------[substitution.] 0.000249 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 3: substitution.graph_param_transform 85.36% : 0.000213s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000005s : 2: substitution.replace_old_param 5.28% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005463 2 80.59% : 0.004402s : 1: type_inference.infer 19.41% : 0.001060s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.06% : 0.000051s : 4: replace.inline 31.94% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.56% : 0.000210s : 4: match.inline 5.44% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.66% : 0.000002s : 10: predicate.accumulaten_eliminater 1.84% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.07% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.00% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.01% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.99% : 0.000008s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.75% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.75% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000002s : 10: predicate.print_const_string_wrapper 2.45% : 0.000003s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 1.07% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.23% : 0.000002s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000794 13 48.81% : 0.000388s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.71% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.48% : 0.000353s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020324 72 0.37% : 0.000074s : 1: add_recomputation 0.36% : 0.000074s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.70% : 0.000346s : 1: bootstrap 0.19% : 0.000039s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 39.72% : 0.008073s : 1: jit_opt_a 0.93% : 0.000189s : 1: jit_opt_after_cconv 0.29% : 0.000059s : 1: jit_opt_b 2.43% : 0.000494s : 1: loop_unroll 12.11% : 0.002461s : 1: mutable_eliminate 4.46% : 0.000907s : 26: opt.transform.jit_opt_a 0.25% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000029s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000022s : 1: opt.transform.mutable_eliminate 0.12% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.43% : 0.000494s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.52% : 0.000513s : 1: renormalize.infer 2.21% : 0.000448s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000041s : 1: rewriter_after_opt_a 0.40% : 0.000082s : 1: rewriter_before_opt_a 0.41% : 0.000084s : 1: symbol_engine_optimizer 27.33% : 0.005554s : 1: type_inference TotalTime = 0.234473, [30] [bootstrap]: 0.00045884 [type_inference]: 0.217954 [event_method]: 2.977e-05 [auto_monad]: 9.079e-05 [graph_reusing]: 7.68001e-06 [pre_auto_parallel]: 2.91999e-06 [py_interpret_to_execute]: 0.00079641 [rewriter_before_opt_a]: 0.00011732 [expand_dump_flag]: 4.66002e-06 [jit_opt_a]: 0.0118368, [2] [Cycle 1]: 0.00669317, [27] [switch_simplify]: 8.685e-05 [loop_unroll]: 3.478e-05 [a_1]: 0.00095531 [with_stream_mark]: 2.568e-05 [recompute_prepare]: 9.66e-06 [updatestate_depend_eliminate]: 4.95999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 8.64e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 8.38001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 7.71001e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.863e-05 [j_node_and_user_rematch]: 1.177e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.32e-05 [inline_without_move]: 7.06999e-06 [renormalize]: 0.00514956 [add_forward_monad_depend]: 1.062e-05 [auto_monad_grad]: 3.08e-06 [auto_monad_eliminator]: 2.311e-05 [cse]: 4.172e-05 [replace_applicator]: 2.61e-05 [Cycle 2]: 0.00046274, [27] [switch_simplify]: 8.25999e-06 [loop_unroll]: 7.13e-06 [a_1]: 0.0001728 [with_stream_mark]: 1.958e-05 [recompute_prepare]: 7.08e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.78e-06 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.88998e-06 [meta_shard_fg_expand]: 3.01999e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 5.06002e-06 [cell_reuse_recompute_pass]: 5.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.053e-05 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 6.28e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.57001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.26001e-06 [cse]: 1.44e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 2.017e-05 [rewriter_after_opt_a]: 4.432e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00108646 [jit_opt_b]: 6.59e-05, [1] [Cycle 1]: 5.69e-05, [2] [frontend_op_eliminate]: 2.421e-05 [inline_after_opt_a]: 1.989e-05 [cconv]: 3.03e-05 [loop_unroll]: 0.00045789 [jit_opt_after_cconv]: 0.000168, [1] [Cycle 1]: 0.00016124, [11] [c_1]: 2.703e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 6.42001e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 2.824e-05 [call_graph_tuple_transform]: 2.392e-05 [tuple_list_get_item_eliminator]: 6.94001e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.39001e-06 [remove_dup_value]: 1.68e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 8.99998e-06 [add_recomputation]: 5.815e-05 [cse_after_recomputation]: 2.733e-05, [1] [Cycle 1]: 2.15e-05, [1] [cse]: 1.455e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 7.08e-06 [opt_after_jit_grad]: 0.00077418 [symbol_engine_optimizer]: 8.834e-05, [1] [Cycle 1]: 8.105e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 1.052e-05 [elim_not_effective]: 1.611e-05 [opt_reshape]: 7.75e-06 [fold_const_symbol]: 1.134e-05 [renormalize]: 6.39993e-07 [validate]: 5.61e-05 Sums bootstrap : 0.000459s : 0.20% type_inference : 0.217954s : 95.14% event_method : 0.000030s : 0.01% auto_monad : 0.000091s : 0.04% graph_reusing : 0.000008s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000796s : 0.35% rewriter_before_opt_a : 0.000117s : 0.05% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000095s : 0.04% jit_opt_a.loop_unroll : 0.000042s : 0.02% jit_opt_a.a_1 : 0.001128s : 0.49% jit_opt_a.with_stream_mark : 0.000045s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.005150s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000044s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001086s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000458s : 0.20% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000058s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000774s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.02% Time group info: ------[substitution.] 0.000463 28 0.43% : 0.000002s : 2: substitution.elim_not_effective 0.35% : 0.000002s : 2: substitution.fold_const_symbol 1.50% : 0.000007s : 4: substitution.graph_param_transform 87.23% : 0.000404s : 5: substitution.inline 1.10% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.46% : 0.000016s : 3: substitution.reduce_eliminate 1.38% : 0.000006s : 4: substitution.remove_not_recompute_node 1.73% : 0.000008s : 2: substitution.replace_old_param 2.83% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.217826 2 97.73% : 0.212878s : 1: type_inference.infer 2.27% : 0.004948s : 1: type_inference.specialize ------[replace.] 0.000136 7 68.36% : 0.000093s : 5: replace.inline 31.64% : 0.000043s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000412 7 97.12% : 0.000400s : 5: match.inline 2.88% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.54% : 0.000003s : 13: predicate.accumulaten_eliminater 1.51% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 0.96% : 0.000002s : 13: predicate.addn_check_dump 1.52% : 0.000003s : 13: predicate.addn_zero_filter 2.47% : 0.000004s : 13: predicate.arithmetic_simplify 2.34% : 0.000004s : 13: predicate.cast_eliminate 0.73% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 0.96% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.01% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.56% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.96% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.08% : 0.000008s : 28: predicate.inline 0.74% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.47% : 0.000002s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.97% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 1.95% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.59% : 0.000004s : 13: predicate.reduce_eliminate 1.88% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.16% : 0.000002s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.75% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 1.74% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.72% : 0.000011s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.96% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.84% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.78% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003425 25 60.22% : 0.002063s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.04% : 0.000104s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.74% : 0.001258s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.241167 72 0.03% : 0.000061s : 1: add_recomputation 0.04% : 0.000094s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000480s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000036s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000011s : 1: graph_reusing 4.91% : 0.011843s : 1: jit_opt_a 0.07% : 0.000171s : 1: jit_opt_after_cconv 0.03% : 0.000068s : 1: jit_opt_b 0.19% : 0.000466s : 1: loop_unroll 0.45% : 0.001096s : 1: mutable_eliminate 0.59% : 0.001427s : 26: opt.transform.jit_opt_a 0.03% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000080s : 1: opt.transform.mutable_eliminate 0.01% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000785s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.33% : 0.000805s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.57% : 0.003786s : 1: renormalize.infer 0.56% : 0.001346s : 1: renormalize.specialize 0.00% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000047s : 1: rewriter_after_opt_a 0.05% : 0.000123s : 1: rewriter_before_opt_a 0.04% : 0.000091s : 1: symbol_engine_optimizer 90.39% : 0.217983s : 1: type_inference TotalTime = 0.127124, [30] [bootstrap]: 0.00034608 [type_inference]: 0.115251 [event_method]: 2.229e-05 [auto_monad]: 7.181e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 1.055e-05 [py_interpret_to_execute]: 0.00045391 [rewriter_before_opt_a]: 8.996e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00847524, [2] [Cycle 1]: 0.00374054, [27] [switch_simplify]: 6.544e-05 [loop_unroll]: 3.134e-05 [a_1]: 0.00064174 [with_stream_mark]: 2.17e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.52001e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.03002e-06 [accelerated_algorithm]: 6.84001e-06 [meta_shard_fg_expand]: 2.82002e-06 [get_grad_eliminate_]: 5.88002e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 1.103e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.96e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00260536 [add_forward_monad_depend]: 7.55e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.822e-05 [cse]: 3.216e-05 [replace_applicator]: 1.813e-05 [Cycle 2]: 0.00044304, [27] [switch_simplify]: 6.81001e-06 [loop_unroll]: 5.84999e-06 [a_1]: 0.00018638 [with_stream_mark]: 1.348e-05 [recompute_prepare]: 6.68998e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.88002e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 1.91003e-06 [get_grad_eliminate_]: 6.08002e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 2.58003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 9.68997e-06 [inline_without_move]: 5.70001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.64999e-06 [cse]: 1.274e-05 [replace_applicator]: 5.81998e-06 [py_interpret_to_execute_after_opt_a]: 1.428e-05 [rewriter_after_opt_a]: 4.05e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00071612 [jit_opt_b]: 5.754e-05, [1] [Cycle 1]: 4.977e-05, [2] [frontend_op_eliminate]: 1.943e-05 [inline_after_opt_a]: 1.818e-05 [cconv]: 3.085e-05 [loop_unroll]: 0.00042861 [jit_opt_after_cconv]: 0.00015928, [1] [Cycle 1]: 0.00015301, [11] [c_1]: 2.568e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 6.94001e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 2.627e-05 [call_graph_tuple_transform]: 2.129e-05 [tuple_list_get_item_eliminator]: 6.23002e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.51e-06 [remove_dup_value]: 1.6e-05 [partial_unused_args_eliminate]: 2.13002e-06 [environ_conv]: 9.45001e-06 [add_recomputation]: 5.062e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.808e-05, [1] [cse]: 1.197e-05 [auto_monad_reorder]: 1.613e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 5.37001e-06 [opt_after_jit_grad]: 0.00045461 [symbol_engine_optimizer]: 7.503e-05, [1] [Cycle 1]: 6.898e-05, [6] [build]: 4.43999e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.10002e-06 [fold_const_symbol]: 9.29e-06 [renormalize]: 4.89992e-07 [validate]: 6.875e-05 Sums bootstrap : 0.000346s : 0.28% type_inference : 0.115251s : 94.32% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000011s : 0.01% py_interpret_to_execute : 0.000454s : 0.37% rewriter_before_opt_a : 0.000090s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000828s : 0.68% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002605s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000716s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.03% loop_unroll : 0.000429s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000069s : 0.06% Time group info: ------[substitution.] 0.000266 24 0.97% : 0.000003s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 4: substitution.graph_param_transform 86.48% : 0.000230s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 2.05% : 0.000005s : 2: substitution.replace_old_param 4.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115159 2 97.72% : 0.112530s : 1: type_inference.infer 2.28% : 0.002629s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.49% : 0.000055s : 4: replace.inline 30.51% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.39% : 0.000227s : 4: match.inline 4.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.47% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.41% : 0.000002s : 12: predicate.addn_zero_filter 2.23% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000001s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.74% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 2.22% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.83% : 0.000002s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.12% : 0.000001s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.59% : 0.000010s : 58: predicate.switch_simplify 1.14% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.50% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.32% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002354 22 67.68% : 0.001593s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.34% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.99% : 0.000706s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130848 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.28% : 0.000370s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.48% : 0.008479s : 1: jit_opt_a 0.12% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.33% : 0.000437s : 1: loop_unroll 0.56% : 0.000728s : 1: mutable_eliminate 0.82% : 0.001078s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000013s : 1: pre_auto_parallel 0.35% : 0.000461s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.39% : 0.001823s : 1: renormalize.infer 0.59% : 0.000773s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.10% : 0.115279s : 1: type_inference TotalTime = 0.143883, [30] [bootstrap]: 0.0003269 [type_inference]: 0.13005 [event_method]: 2.039e-05 [auto_monad]: 5.258e-05 [graph_reusing]: 4.25999e-06 [pre_auto_parallel]: 2.16e-06 [py_interpret_to_execute]: 0.00209546 [rewriter_before_opt_a]: 0.00011418 [expand_dump_flag]: 4.85001e-06 [jit_opt_a]: 0.00865793, [2] [Cycle 1]: 0.00480699, [27] [switch_simplify]: 5.911e-05 [loop_unroll]: 3.466e-05 [a_1]: 0.00069176 [with_stream_mark]: 1.524e-05 [recompute_prepare]: 9.36002e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 7.58999e-06 [updatestate_useless_node_eliminater]: 6.64999e-06 [accelerated_algorithm]: 6.99001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.79001e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 1.124e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 9.76e-06 [inline_without_move]: 6.61e-06 [renormalize]: 0.0036244 [add_forward_monad_depend]: 1.004e-05 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.87e-05 [cse]: 3.767e-05 [replace_applicator]: 2.256e-05 [Cycle 2]: 0.00040355, [27] [switch_simplify]: 7.69002e-06 [loop_unroll]: 6.51e-06 [a_1]: 0.00012893 [with_stream_mark]: 1.483e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 4.55999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 4.60999e-06 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.952e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.64998e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.81999e-06 [cse]: 1.561e-05 [replace_applicator]: 6.78998e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 4.093e-05 [convert_after_rewriter]: 7.9e-06 [order_py_execute_after_rewriter]: 5.61998e-06 [mutable_eliminate]: 0.00072568 [jit_opt_b]: 5.905e-05, [1] [Cycle 1]: 5.097e-05, [2] [frontend_op_eliminate]: 2.037e-05 [inline_after_opt_a]: 1.896e-05 [cconv]: 2.779e-05 [loop_unroll]: 0.00044159 [jit_opt_after_cconv]: 0.00016936, [1] [Cycle 1]: 0.00016187, [11] [c_1]: 2.618e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 7.03998e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.927e-05 [call_graph_tuple_transform]: 2.389e-05 [tuple_list_get_item_eliminator]: 6.81001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 1.99972e-07 [switch_simplify]: 6.25002e-06 [remove_dup_value]: 2.012e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 8.71997e-06 [add_recomputation]: 5.342e-05 [cse_after_recomputation]: 2.682e-05, [1] [Cycle 1]: 2.131e-05, [1] [cse]: 1.454e-05 [auto_monad_reorder]: 1.9e-05 [get_jit_bprop_graph]: 4.49998e-06 [rewriter_after_jit_bprop_graph]: 5.87999e-06 [opt_after_jit_grad]: 0.00047863 [symbol_engine_optimizer]: 8.682e-05, [1] [Cycle 1]: 7.967e-05, [6] [build]: 4.04002e-06 [elim_shapecalc]: 1.139e-05 [elim_not_effective]: 1.721e-05 [opt_reshape]: 7.13e-06 [fold_const_symbol]: 1.157e-05 [renormalize]: 5.69999e-07 [validate]: 0.00015674 Sums bootstrap : 0.000327s : 0.23% type_inference : 0.130050s : 93.02% event_method : 0.000020s : 0.01% auto_monad : 0.000053s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.002095s : 1.50% rewriter_before_opt_a : 0.000114s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000821s : 0.59% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003624s : 2.59% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000053s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000726s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000442s : 0.32% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000479s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000157s : 0.11% Time group info: ------[substitution.] 0.000241 25 1.74% : 0.000004s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.92% : 0.000007s : 4: substitution.graph_param_transform 84.73% : 0.000204s : 5: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000006s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.17% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129978 2 97.91% : 0.127263s : 1: type_inference.infer 2.09% : 0.002716s : 1: type_inference.specialize ------[replace.] 0.000109 7 66.55% : 0.000072s : 5: replace.inline 33.45% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 7 95.83% : 0.000201s : 5: match.inline 4.17% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.27% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.48% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.23% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.38% : 0.000002s : 13: predicate.depend_value_elim 1.28% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.42% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.31% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.15% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 2.13% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 20: predicate.switch_defer_inline 2.27% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000011s : 64: predicate.switch_simplify 1.42% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.74% : 0.000003s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002455 25 65.08% : 0.001598s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.56% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.36% : 0.000794s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.148557 72 0.04% : 0.000056s : 1: add_recomputation 0.04% : 0.000056s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.23% : 0.000342s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000007s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 5.83% : 0.008661s : 1: jit_opt_a 0.12% : 0.000173s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.30% : 0.000449s : 1: loop_unroll 0.50% : 0.000736s : 1: mutable_eliminate 0.73% : 0.001085s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 1.42% : 0.002114s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.84% : 0.002734s : 1: renormalize.infer 0.59% : 0.000880s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000121s : 1: rewriter_before_opt_a 0.06% : 0.000089s : 1: symbol_engine_optimizer 87.55% : 0.130063s : 1: type_inference TotalTime = 0.119019, [30] [bootstrap]: 0.00037118 [type_inference]: 0.107795 [event_method]: 1.967e-05 [auto_monad]: 7.112e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.11998e-06 [py_interpret_to_execute]: 0.00043069 [rewriter_before_opt_a]: 8.44e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00775504, [2] [Cycle 1]: 0.00373879, [27] [switch_simplify]: 5.615e-05 [loop_unroll]: 2.978e-05 [a_1]: 0.00059969 [with_stream_mark]: 1.851e-05 [recompute_prepare]: 8.90001e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 7.4e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 9.40025e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00269806 [add_forward_monad_depend]: 6.19001e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.696e-05 [cse]: 2.166e-05 [replace_applicator]: 1.552e-05 [Cycle 2]: 0.00042903, [27] [switch_simplify]: 1.361e-05 [loop_unroll]: 6.51999e-06 [a_1]: 0.00015055 [with_stream_mark]: 2.503e-05 [recompute_prepare]: 6.16998e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 2.69999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.723e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 6.74001e-06 [cse]: 1.443e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 1.334e-05 [rewriter_after_opt_a]: 3.332e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 6.31e-06 [mutable_eliminate]: 0.00065688 [jit_opt_b]: 5.735e-05, [1] [Cycle 1]: 5.058e-05, [2] [frontend_op_eliminate]: 2.082e-05 [inline_after_opt_a]: 1.854e-05 [cconv]: 2.256e-05 [loop_unroll]: 0.0004361 [jit_opt_after_cconv]: 0.00016227, [1] [Cycle 1]: 0.0001554, [11] [c_1]: 2.554e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 6.68e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.721e-05 [call_graph_tuple_transform]: 2.153e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 7.16001e-06 [add_recomputation]: 4.713e-05 [cse_after_recomputation]: 2.42e-05, [1] [Cycle 1]: 1.712e-05, [1] [cse]: 1.13e-05 [auto_monad_reorder]: 1.448e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.15001e-06 [opt_after_jit_grad]: 0.00049908 [symbol_engine_optimizer]: 8.779e-05, [1] [Cycle 1]: 8.159e-05, [6] [build]: 3.76001e-06 [elim_shapecalc]: 1.29e-05 [elim_not_effective]: 1.69e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.159e-05 [renormalize]: 2.80008e-07 [validate]: 0.00016754 Sums bootstrap : 0.000371s : 0.32% type_inference : 0.107795s : 93.90% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000431s : 0.38% rewriter_before_opt_a : 0.000084s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000750s : 0.65% jit_opt_a.with_stream_mark : 0.000044s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002698s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000657s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000436s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000499s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000168s : 0.15% Time group info: ------[substitution.] 0.000236 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 1.04% : 0.000002s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 4: substitution.graph_param_transform 84.45% : 0.000199s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000006s : 4: substitution.remove_not_recompute_node 1.62% : 0.000004s : 2: substitution.replace_old_param 5.49% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107715 2 97.56% : 0.105082s : 1: type_inference.infer 2.44% : 0.002632s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.04% : 0.000051s : 4: replace.inline 31.96% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.33% : 0.000197s : 4: match.inline 5.67% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.20% : 0.000002s : 12: predicate.addn_zero_filter 2.27% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 6.00% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.16% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.83% : 0.000002s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002457 22 70.81% : 0.001740s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.24% : 0.000669s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122635 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.32% : 0.000389s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.33% : 0.007759s : 1: jit_opt_a 0.13% : 0.000165s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000444s : 1: loop_unroll 0.54% : 0.000665s : 1: mutable_eliminate 0.81% : 0.000994s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000508s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000437s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.56% : 0.001919s : 1: renormalize.infer 0.63% : 0.000770s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000090s : 1: symbol_engine_optimizer 87.91% : 0.107807s : 1: type_inference TotalTime = 0.0520145, [30] [bootstrap]: 0.00031604 [type_inference]: 0.0421891 [event_method]: 1.975e-05 [auto_monad]: 7.041e-05 [graph_reusing]: 5.79999e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00023147 [rewriter_before_opt_a]: 8.058e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00668023, [2] [Cycle 1]: 0.0027894, [27] [switch_simplify]: 6.258e-05 [loop_unroll]: 3.121e-05 [a_1]: 0.00079263 [with_stream_mark]: 2.191e-05 [recompute_prepare]: 1.016e-05 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.47001e-06 [specialize_transform]: 7.43e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.46999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 1.009e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.167e-05 [inline_without_move]: 6.68e-06 [renormalize]: 0.00149642 [add_forward_monad_depend]: 6.93e-06 [auto_monad_grad]: 2.90998e-06 [auto_monad_eliminator]: 1.82e-05 [cse]: 3.559e-05 [replace_applicator]: 2.04e-05 [Cycle 2]: 0.00039525, [27] [switch_simplify]: 7.65e-06 [loop_unroll]: 5.89e-06 [a_1]: 0.00013245 [with_stream_mark]: 1.243e-05 [recompute_prepare]: 6.39001e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.56002e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.836e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.42998e-06 [inline_without_move]: 5.91e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 7.63001e-06 [cse]: 1.243e-05 [replace_applicator]: 6.36998e-06 [py_interpret_to_execute_after_opt_a]: 1.365e-05 [rewriter_after_opt_a]: 3.957e-05 [convert_after_rewriter]: 7.41001e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00070333 [jit_opt_b]: 5.75e-05, [1] [Cycle 1]: 5.006e-05, [2] [frontend_op_eliminate]: 1.899e-05 [inline_after_opt_a]: 1.901e-05 [cconv]: 2.923e-05 [loop_unroll]: 0.00044814 [jit_opt_after_cconv]: 0.00017423, [1] [Cycle 1]: 0.00016759, [11] [c_1]: 2.609e-05 [parameter_eliminate]: 3.50998e-06 [updatestate_depend_eliminate]: 6.38e-06 [updatestate_assign_eliminate]: 1.338e-05 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.513e-05 [call_graph_tuple_transform]: 2.28e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.88997e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 6.84999e-06 [remove_dup_value]: 1.655e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 7.40998e-06 [add_recomputation]: 5.184e-05 [cse_after_recomputation]: 2.132e-05, [1] [Cycle 1]: 1.588e-05, [1] [cse]: 9.62001e-06 [auto_monad_reorder]: 1.537e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 6.06998e-06 [opt_after_jit_grad]: 0.00050824 [symbol_engine_optimizer]: 7.968e-05, [1] [Cycle 1]: 7.276e-05, [6] [build]: 4.48001e-06 [elim_shapecalc]: 9.09998e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.88998e-06 [fold_const_symbol]: 9.72999e-06 [renormalize]: 6.50005e-07 [validate]: 4.006e-05 Sums bootstrap : 0.000316s : 0.66% type_inference : 0.042189s : 88.09% event_method : 0.000020s : 0.04% auto_monad : 0.000070s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000231s : 0.48% rewriter_before_opt_a : 0.000081s : 0.17% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.15% jit_opt_a.loop_unroll : 0.000037s : 0.08% jit_opt_a.a_1 : 0.000925s : 1.93% jit_opt_a.with_stream_mark : 0.000034s : 0.07% jit_opt_a.recompute_prepare : 0.000017s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000013s : 0.03% jit_opt_a.renormalize : 0.001497s : 3.12% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.05% jit_opt_a.cse : 0.000048s : 0.10% jit_opt_a.replace_applicator : 0.000027s : 0.06% py_interpret_to_execute_after_opt_a : 0.000014s : 0.03% rewriter_after_opt_a : 0.000040s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000703s : 1.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000029s : 0.06% loop_unroll : 0.000448s : 0.94% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000013s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000052s : 0.11% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000508s : 1.06% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.08% Time group info: ------[substitution.] 0.000249 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000007s : 4: substitution.graph_param_transform 84.35% : 0.000210s : 4: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000006s : 4: substitution.remove_not_recompute_node 1.93% : 0.000005s : 2: substitution.replace_old_param 5.63% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.042106 2 95.74% : 0.040314s : 1: type_inference.infer 4.26% : 0.001792s : 1: type_inference.specialize ------[replace.] 0.000085 6 60.54% : 0.000051s : 4: replace.inline 39.46% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.38% : 0.000207s : 4: match.inline 5.62% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.19% : 0.000002s : 12: predicate.addn_zero_filter 1.64% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.31% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 2.01% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 2.59% : 0.000004s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.05% : 0.000001s : 8: predicate.remove_not_recompute_node 2.38% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.07% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.81% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001687 18 68.67% : 0.001159s : 11: func_graph_cloner_run.FuncGraphClonerGraph 3.00% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.33% : 0.000478s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054771 72 0.10% : 0.000055s : 1: add_recomputation 0.14% : 0.000074s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.61% : 0.000335s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.05% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 12.20% : 0.006684s : 1: jit_opt_a 0.32% : 0.000177s : 1: jit_opt_after_cconv 0.11% : 0.000060s : 1: jit_opt_b 0.83% : 0.000457s : 1: loop_unroll 1.30% : 0.000713s : 1: mutable_eliminate 2.16% : 0.001181s : 26: opt.transform.jit_opt_a 0.11% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000237s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.72% : 0.000943s : 1: renormalize.infer 0.99% : 0.000544s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000042s : 1: rewriter_after_opt_a 0.16% : 0.000086s : 1: rewriter_before_opt_a 0.15% : 0.000082s : 1: symbol_engine_optimizer 77.06% : 0.042207s : 1: type_inference TotalTime = 0.139487, [30] [bootstrap]: 0.00032164 [type_inference]: 0.124887 [event_method]: 2.453e-05 [auto_monad]: 0.00011283 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 0.00216173 [rewriter_before_opt_a]: 0.00012499 [expand_dump_flag]: 5.08002e-06 [jit_opt_a]: 0.00907112, [2] [Cycle 1]: 0.00511825, [27] [switch_simplify]: 6.136e-05 [loop_unroll]: 3.47e-05 [a_1]: 0.00066235 [with_stream_mark]: 1.547e-05 [recompute_prepare]: 8.97999e-06 [updatestate_depend_eliminate]: 3.66001e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 7.47998e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 7.13998e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 7.18998e-06 [merge_forward]: 3.05998e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.379e-05 [j_node_and_user_rematch]: 9.96998e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.54001e-06 [renormalize]: 0.00397431 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.831e-05 [cse]: 3.257e-05 [replace_applicator]: 2.054e-05 [Cycle 2]: 0.00039802, [27] [switch_simplify]: 7.38e-06 [loop_unroll]: 6.33998e-06 [a_1]: 0.00013025 [with_stream_mark]: 1.522e-05 [recompute_prepare]: 6.64001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 6.22001e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 4.86002e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.736e-05 [j_node_and_user_rematch]: 9.71998e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 5.64e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.49999e-06 [cse]: 1.652e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.611e-05 [rewriter_after_opt_a]: 3.967e-05 [convert_after_rewriter]: 7.95e-06 [order_py_execute_after_rewriter]: 6.28e-06 [mutable_eliminate]: 0.00075913 [jit_opt_b]: 6.435e-05, [1] [Cycle 1]: 5.624e-05, [2] [frontend_op_eliminate]: 2.237e-05 [inline_after_opt_a]: 2.097e-05 [cconv]: 2.873e-05 [loop_unroll]: 0.0004501 [jit_opt_after_cconv]: 0.00017643, [1] [Cycle 1]: 0.00016975, [11] [c_1]: 2.654e-05 [parameter_eliminate]: 4.81002e-06 [updatestate_depend_eliminate]: 6.62002e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.524e-05 [call_graph_tuple_transform]: 2.33e-05 [tuple_list_get_item_eliminator]: 7.03e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.63998e-06 [remove_dup_value]: 1.994e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 1.029e-05 [add_recomputation]: 4.908e-05 [cse_after_recomputation]: 2.796e-05, [1] [Cycle 1]: 2.178e-05, [1] [cse]: 1.406e-05 [auto_monad_reorder]: 1.721e-05 [get_jit_bprop_graph]: 5.59998e-06 [rewriter_after_jit_bprop_graph]: 6.49001e-06 [opt_after_jit_grad]: 0.00057717 [symbol_engine_optimizer]: 0.00019384, [1] [Cycle 1]: 0.00018647, [6] [build]: 4.35999e-06 [elim_shapecalc]: 0.00011799 [elim_not_effective]: 1.609e-05 [opt_reshape]: 7.57998e-06 [fold_const_symbol]: 1.033e-05 [renormalize]: 4.50003e-07 [validate]: 5.702e-05 Sums bootstrap : 0.000322s : 0.24% type_inference : 0.124887s : 92.34% event_method : 0.000025s : 0.02% auto_monad : 0.000113s : 0.08% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.002162s : 1.60% rewriter_before_opt_a : 0.000125s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000793s : 0.59% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003974s : 2.94% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000759s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000450s : 0.33% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000035s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000006s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000577s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000118s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000057s : 0.04% Time group info: ------[substitution.] 0.000230 25 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000006s : 4: substitution.graph_param_transform 85.67% : 0.000197s : 5: substitution.inline 1.54% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 2.41% : 0.000006s : 2: substitution.replace_old_param 3.80% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.124800 2 97.64% : 0.121857s : 1: type_inference.infer 2.36% : 0.002943s : 1: type_inference.specialize ------[replace.] 0.000102 7 65.92% : 0.000067s : 5: replace.inline 34.08% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 7 96.27% : 0.000194s : 5: match.inline 3.73% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.05% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 2.17% : 0.000003s : 13: predicate.arithmetic_simplify 1.44% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.38% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.77% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.39% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.54% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 19: predicate.partial_eliminate 1.43% : 0.000002s : 13: predicate.print_const_string_wrapper 1.86% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000010s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.16% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.73% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002458 25 64.28% : 0.001580s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.69% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.02% : 0.000812s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.144686 72 0.04% : 0.000052s : 1: add_recomputation 0.08% : 0.000117s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000339s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.03% : 0.000047s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000008s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.27% : 0.009074s : 1: jit_opt_a 0.12% : 0.000179s : 1: jit_opt_after_cconv 0.05% : 0.000067s : 1: jit_opt_b 0.32% : 0.000458s : 1: loop_unroll 0.53% : 0.000770s : 1: mutable_eliminate 0.73% : 0.001053s : 26: opt.transform.jit_opt_a 0.04% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000149s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000587s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 1.51% : 0.002182s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 2.11% : 0.003046s : 1: renormalize.infer 0.63% : 0.000916s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000131s : 1: rewriter_before_opt_a 0.14% : 0.000196s : 1: symbol_engine_optimizer 86.33% : 0.124908s : 1: type_inference TotalTime = 0.314546, [30] [bootstrap]: 0.00046303 [type_inference]: 0.285554 [event_method]: 2.802e-05 [auto_monad]: 8.501e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00078036 [rewriter_before_opt_a]: 0.00011204 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.0245356, [2] [Cycle 1]: 0.0194984, [27] [switch_simplify]: 8.496e-05 [loop_unroll]: 3.623e-05 [a_1]: 0.0133083 [with_stream_mark]: 4.861e-05 [recompute_prepare]: 2.045e-05 [updatestate_depend_eliminate]: 5.90002e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 3.38999e-06 [specialize_transform]: 1.152e-05 [updatestate_useless_node_eliminater]: 9.91e-06 [accelerated_algorithm]: 1.154e-05 [meta_shard_fg_expand]: 9.20001e-06 [get_grad_eliminate_]: 1.075e-05 [merge_forward]: 4.56002e-06 [cell_reuse_recompute_pass]: 7.95e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.304e-05 [j_node_and_user_rematch]: 1.69e-05 [meta_fg_expand]: 4.80001e-06 [replace_old_param]: 1.765e-05 [inline_without_move]: 8.22e-06 [renormalize]: 0.00541838 [add_forward_monad_depend]: 1.307e-05 [auto_monad_grad]: 2.77002e-06 [auto_monad_eliminator]: 2.285e-05 [cse]: 4.056e-05 [replace_applicator]: 2.846e-05 [Cycle 2]: 0.00044436, [27] [switch_simplify]: 8.45999e-06 [loop_unroll]: 7.03e-06 [a_1]: 0.00015628 [with_stream_mark]: 1.766e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 6.58998e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 7.26001e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 3.65e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.84999e-06 [replace_old_param]: 1.107e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.88002e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 7.89002e-06 [cse]: 1.427e-05 [replace_applicator]: 6.44001e-06 [py_interpret_to_execute_after_opt_a]: 2.098e-05 [rewriter_after_opt_a]: 4.405e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.66e-06 [mutable_eliminate]: 0.00101403 [jit_opt_b]: 6.695e-05, [1] [Cycle 1]: 5.641e-05, [2] [frontend_op_eliminate]: 2.423e-05 [inline_after_opt_a]: 1.995e-05 [cconv]: 3.386e-05 [loop_unroll]: 0.00049692 [jit_opt_after_cconv]: 0.00018761, [1] [Cycle 1]: 0.00018059, [11] [c_1]: 2.799e-05 [parameter_eliminate]: 3.91999e-06 [updatestate_depend_eliminate]: 7.87998e-06 [updatestate_assign_eliminate]: 3.41999e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 3.69e-05 [call_graph_tuple_transform]: 2.602e-05 [tuple_list_get_item_eliminator]: 7.21001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 7.15e-06 [remove_dup_value]: 1.831e-05 [partial_unused_args_eliminate]: 3.31999e-06 [environ_conv]: 1.049e-05 [add_recomputation]: 5.898e-05 [cse_after_recomputation]: 2.546e-05, [1] [Cycle 1]: 1.982e-05, [1] [cse]: 1.301e-05 [auto_monad_reorder]: 2.036e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 9.79999e-06 [opt_after_jit_grad]: 0.00051273 [symbol_engine_optimizer]: 0.00012797, [1] [Cycle 1]: 0.00011907, [6] [build]: 4.79e-06 [elim_shapecalc]: 1.041e-05 [elim_not_effective]: 1.645e-05 [opt_reshape]: 7.65e-06 [fold_const_symbol]: 4.946e-05 [renormalize]: 4.19997e-07 [validate]: 6.764e-05 Sums bootstrap : 0.000463s : 0.15% type_inference : 0.285554s : 92.37% event_method : 0.000028s : 0.01% auto_monad : 0.000085s : 0.03% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000780s : 0.25% rewriter_before_opt_a : 0.000112s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000093s : 0.03% jit_opt_a.loop_unroll : 0.000043s : 0.01% jit_opt_a.a_1 : 0.013465s : 4.36% jit_opt_a.with_stream_mark : 0.000066s : 0.02% jit_opt_a.recompute_prepare : 0.000028s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000006s : 0.00% jit_opt_a.specialize_transform : 0.000018s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000016s : 0.01% jit_opt_a.accelerated_algorithm : 0.000019s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000012s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000012s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000039s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.01% jit_opt_a.meta_fg_expand : 0.000008s : 0.00% jit_opt_a.replace_old_param : 0.000029s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.00% jit_opt_a.renormalize : 0.005418s : 1.75% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.01% jit_opt_a.cse : 0.000055s : 0.02% jit_opt_a.replace_applicator : 0.000035s : 0.01% py_interpret_to_execute_after_opt_a : 0.000021s : 0.01% rewriter_after_opt_a : 0.000044s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001014s : 0.33% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000034s : 0.01% loop_unroll : 0.000497s : 0.16% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000059s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000513s : 0.17% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000049s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000068s : 0.02% Time group info: ------[substitution.] 0.000458 28 0.43% : 0.000002s : 2: substitution.elim_not_effective 9.08% : 0.000042s : 2: substitution.fold_const_symbol 1.72% : 0.000008s : 4: substitution.graph_param_transform 74.50% : 0.000341s : 5: substitution.inline 1.73% : 0.000008s : 4: substitution.j_node_and_user_rematch 5.75% : 0.000026s : 3: substitution.reduce_eliminate 1.67% : 0.000008s : 4: substitution.remove_not_recompute_node 2.37% : 0.000011s : 2: substitution.replace_old_param 2.75% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.285434 2 98.33% : 0.280676s : 1: type_inference.infer 1.67% : 0.004758s : 1: type_inference.specialize ------[replace.] 0.012352 7 0.72% : 0.000089s : 5: replace.inline 99.28% : 0.012263s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000349 7 96.71% : 0.000337s : 5: match.inline 3.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000211 886 1.67% : 0.000004s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.93% : 0.000002s : 13: predicate.addn_check_dump 1.71% : 0.000004s : 13: predicate.addn_zero_filter 3.29% : 0.000007s : 13: predicate.arithmetic_simplify 2.08% : 0.000004s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000003s : 13: predicate.depend_value_elim 0.91% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.30% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.52% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.26% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000003s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.60% : 0.000003s : 13: predicate.environ_get_eliminate 1.03% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 5.35% : 0.000011s : 28: predicate.inline 0.62% : 0.000001s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.78% : 0.000004s : 8: predicate.less_batch_normalization 1.93% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000004s : 19: predicate.load_eliminater 0.84% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.09% : 0.000007s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.99% : 0.000002s : 13: predicate.merge_addn 1.22% : 0.000003s : 13: predicate.minmaximum_grad 1.16% : 0.000002s : 4: predicate.mutable_eliminate 0.41% : 0.000001s : 4: predicate.opt_reshape 1.54% : 0.000003s : 19: predicate.partial_eliminate 1.23% : 0.000003s : 13: predicate.print_const_string_wrapper 2.81% : 0.000006s : 13: predicate.reduce_eliminate 1.78% : 0.000004s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.53% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.20% : 0.000000s : 4: predicate.reset_defer_inline 1.69% : 0.000004s : 13: predicate.reshape_eliminate 1.62% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000002s : 4: predicate.row_tensor_eliminate 1.36% : 0.000003s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000002s : 8: predicate.special_op_eliminate 0.67% : 0.000001s : 8: predicate.specialize_transform 1.78% : 0.000004s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.29% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.26% : 0.000007s : 20: predicate.switch_defer_inline 1.94% : 0.000004s : 20: predicate.switch_layer_defer_inline 5.28% : 0.000011s : 64: predicate.switch_simplify 1.42% : 0.000003s : 13: predicate.tile_eliminate 1.40% : 0.000003s : 13: predicate.transpose_eliminate 1.55% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000008s : 23: predicate.tuple_list_get_item_eliminator 2.10% : 0.000004s : 13: predicate.tuple_list_set_item_eliminator 1.72% : 0.000004s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000004s : 19: predicate.updatestate_pure_node_eliminater 2.41% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 2.13% : 0.000004s : 13: predicate.value_based_eliminate 0.25% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.027722 25 95.04% : 0.026347s : 16: func_graph_cloner_run.FuncGraphClonerGraph 0.39% : 0.000107s : 2: func_graph_cloner_run.FuncGraphClonerNode 4.57% : 0.001268s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.333843 72 0.02% : 0.000063s : 1: add_recomputation 0.03% : 0.000089s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.15% : 0.000487s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 7.35% : 0.024540s : 1: jit_opt_a 0.06% : 0.000190s : 1: jit_opt_after_cconv 0.02% : 0.000070s : 1: jit_opt_b 0.15% : 0.000505s : 1: loop_unroll 0.31% : 0.001028s : 1: mutable_eliminate 4.13% : 0.013794s : 26: opt.transform.jit_opt_a 0.02% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000037s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000079s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000523s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000790s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 1.22% : 0.004057s : 1: renormalize.infer 0.40% : 0.001341s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.04% : 0.000119s : 1: rewriter_before_opt_a 0.04% : 0.000131s : 1: symbol_engine_optimizer 85.54% : 0.285584s : 1: type_inference TotalTime = 0.0207906, [30] [bootstrap]: 0.00039266 [type_inference]: 0.0103998 [event_method]: 1.946e-05 [auto_monad]: 4.836e-05 [graph_reusing]: 3.94002e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 4.467e-05 [rewriter_before_opt_a]: 7.553e-05 [expand_dump_flag]: 1.92001e-06 [jit_opt_a]: 0.00750555, [2] [Cycle 1]: 0.00381718, [27] [switch_simplify]: 6.559e-05 [loop_unroll]: 3.328e-05 [a_1]: 0.00065928 [with_stream_mark]: 2.207e-05 [recompute_prepare]: 8.00999e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.69002e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.42001e-06 [specialize_transform]: 6.30002e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.81e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.092e-05 [inline_without_move]: 5.45001e-06 [renormalize]: 0.0026285 [add_forward_monad_depend]: 1.247e-05 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 2.236e-05 [cse]: 4.461e-05 [replace_applicator]: 1.972e-05 [Cycle 2]: 0.00034292, [27] [switch_simplify]: 6.35002e-06 [loop_unroll]: 5.75001e-06 [a_1]: 9.025e-05 [with_stream_mark]: 1.295e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.06002e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 4.68999e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 2.45002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.713e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 2.18002e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.452e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.659e-05 [rewriter_after_opt_a]: 4.084e-05 [convert_after_rewriter]: 7.53999e-06 [order_py_execute_after_rewriter]: 5.64e-06 [mutable_eliminate]: 0.00062692 [jit_opt_b]: 5.156e-05, [1] [Cycle 1]: 4.528e-05, [2] [frontend_op_eliminate]: 1.675e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.726e-05 [loop_unroll]: 0.0004304 [jit_opt_after_cconv]: 0.00016375, [1] [Cycle 1]: 0.00015722, [11] [c_1]: 2.044e-05 [parameter_eliminate]: 3.23998e-06 [updatestate_depend_eliminate]: 5.86e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.914e-05 [call_graph_tuple_transform]: 2.012e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 4.214e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 5.717e-05 [cse_after_recomputation]: 2.54e-05, [1] [Cycle 1]: 1.98e-05, [1] [cse]: 1.357e-05 [auto_monad_reorder]: 1.941e-05 [get_jit_bprop_graph]: 1.77001e-06 [rewriter_after_jit_bprop_graph]: 5.67999e-06 [opt_after_jit_grad]: 0.00046115 [symbol_engine_optimizer]: 7.616e-05, [1] [Cycle 1]: 6.946e-05, [6] [build]: 4.94e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.389e-05 [opt_reshape]: 5.95002e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 4.60015e-07 [validate]: 4.557e-05 Sums bootstrap : 0.000393s : 2.34% type_inference : 0.010400s : 61.86% event_method : 0.000019s : 0.12% auto_monad : 0.000048s : 0.29% graph_reusing : 0.000004s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000045s : 0.27% rewriter_before_opt_a : 0.000076s : 0.45% expand_dump_flag : 0.000002s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.43% jit_opt_a.loop_unroll : 0.000039s : 0.23% jit_opt_a.a_1 : 0.000750s : 4.46% jit_opt_a.with_stream_mark : 0.000035s : 0.21% jit_opt_a.recompute_prepare : 0.000014s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.002629s : 15.64% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.17% jit_opt_a.cse : 0.000059s : 0.35% jit_opt_a.replace_applicator : 0.000025s : 0.15% py_interpret_to_execute_after_opt_a : 0.000017s : 0.10% rewriter_after_opt_a : 0.000041s : 0.24% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000627s : 3.73% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000017s : 0.10% cconv : 0.000027s : 0.16% loop_unroll : 0.000430s : 2.56% jit_opt_after_cconv.c_1 : 0.000020s : 0.12% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000029s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000042s : 0.25% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000057s : 0.34% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.03% opt_after_jit_grad : 0.000461s : 2.74% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.27% Time group info: ------[substitution.] 0.000272 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 85.63% : 0.000233s : 5: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000006s : 4: substitution.remove_not_recompute_node 2.20% : 0.000006s : 2: substitution.replace_old_param 4.96% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.010336 2 90.37% : 0.009341s : 1: type_inference.infer 9.63% : 0.000996s : 1: type_inference.specialize ------[replace.] 0.000095 7 67.73% : 0.000065s : 5: replace.inline 32.27% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 94.93% : 0.000230s : 5: match.inline 5.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.23% : 0.000003s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.29% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 16: predicate.load_eliminater 1.18% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 11: predicate.merge_addn 1.22% : 0.000002s : 11: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.61% : 0.000002s : 11: predicate.reduce_eliminate 1.71% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 2.15% : 0.000003s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.66% : 0.000002s : 11: predicate.reshape_eliminate 1.21% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.46% : 0.000011s : 59: predicate.switch_simplify 1.16% : 0.000001s : 11: predicate.tile_eliminate 1.16% : 0.000001s : 11: predicate.transpose_eliminate 1.61% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 1.11% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000907 16 54.21% : 0.000492s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.77% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.01% : 0.000345s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.024458 72 0.25% : 0.000060s : 1: add_recomputation 0.21% : 0.000052s : 1: auto_monad 0.09% : 0.000022s : 1: auto_monad_reorder 1.71% : 0.000418s : 1: bootstrap 0.12% : 0.000030s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.10% : 0.000023s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000006s : 1: graph_reusing 30.70% : 0.007509s : 1: jit_opt_a 0.68% : 0.000166s : 1: jit_opt_after_cconv 0.22% : 0.000054s : 1: jit_opt_b 1.79% : 0.000439s : 1: loop_unroll 2.60% : 0.000636s : 1: mutable_eliminate 4.06% : 0.000993s : 26: opt.transform.jit_opt_a 0.20% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.11% : 0.000027s : 4: opt.transform.jit_opt_b 0.05% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000014s : 1: opt.transform.mutable_eliminate 0.09% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000034s : 4: opt.transform.symbol_engine_opt 1.92% : 0.000469s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000047s : 1: py_interpret_to_execute 0.08% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000046s : 1: remove_dup_value 9.20% : 0.002250s : 1: renormalize.infer 1.50% : 0.000367s : 1: renormalize.specialize 0.03% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000044s : 1: rewriter_after_opt_a 0.32% : 0.000078s : 1: rewriter_before_opt_a 0.32% : 0.000079s : 1: symbol_engine_optimizer 42.59% : 0.010416s : 1: type_inference TotalTime = 0.165446, [30] [bootstrap]: 0.00050835 [type_inference]: 0.149017 [event_method]: 3.248e-05 [auto_monad]: 9.794e-05 [graph_reusing]: 7.31001e-06 [pre_auto_parallel]: 2.63998e-06 [py_interpret_to_execute]: 0.00080208 [rewriter_before_opt_a]: 0.00012047 [expand_dump_flag]: 4.87998e-06 [jit_opt_a]: 0.0119814, [2] [Cycle 1]: 0.00657076, [27] [switch_simplify]: 8.101e-05 [loop_unroll]: 3.422e-05 [a_1]: 0.00095694 [with_stream_mark]: 2.94e-05 [recompute_prepare]: 1.035e-05 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 2.64001e-06 [specialize_transform]: 7.84002e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 7.55998e-06 [meta_shard_fg_expand]: 2.96999e-06 [get_grad_eliminate_]: 7.96001e-06 [merge_forward]: 4.62e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.91e-05 [j_node_and_user_rematch]: 1.336e-05 [meta_fg_expand]: 3.14001e-06 [replace_old_param]: 1.507e-05 [inline_without_move]: 8.32003e-06 [renormalize]: 0.00499943 [add_forward_monad_depend]: 1.131e-05 [auto_monad_grad]: 3.02002e-06 [auto_monad_eliminator]: 2.307e-05 [cse]: 4.366e-05 [replace_applicator]: 2.707e-05 [Cycle 2]: 0.00045267, [27] [switch_simplify]: 8.43999e-06 [loop_unroll]: 7.20998e-06 [a_1]: 0.00016394 [with_stream_mark]: 1.709e-05 [recompute_prepare]: 6.40997e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 7.46999e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 6.50002e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 7.07002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.741e-05 [j_node_and_user_rematch]: 1.125e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 5.61e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.68e-06 [cse]: 1.531e-05 [replace_applicator]: 6.22001e-06 [py_interpret_to_execute_after_opt_a]: 2.19e-05 [rewriter_after_opt_a]: 4.614e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00091256 [jit_opt_b]: 6.04e-05, [1] [Cycle 1]: 5.223e-05, [2] [frontend_op_eliminate]: 2.048e-05 [inline_after_opt_a]: 1.894e-05 [cconv]: 3.367e-05 [loop_unroll]: 0.00050125 [jit_opt_after_cconv]: 0.00017931, [1] [Cycle 1]: 0.0001726, [11] [c_1]: 2.799e-05 [parameter_eliminate]: 3.93999e-06 [updatestate_depend_eliminate]: 7.87e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 3.319e-05 [call_graph_tuple_transform]: 2.515e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.84e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.35002e-06 [remove_dup_value]: 1.891e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 9.45001e-06 [add_recomputation]: 5.912e-05 [cse_after_recomputation]: 2.643e-05, [1] [Cycle 1]: 2.042e-05, [1] [cse]: 1.363e-05 [auto_monad_reorder]: 1.832e-05 [get_jit_bprop_graph]: 2.99001e-06 [rewriter_after_jit_bprop_graph]: 7.87998e-06 [opt_after_jit_grad]: 0.00052457 [symbol_engine_optimizer]: 0.00012982, [1] [Cycle 1]: 0.00012216, [6] [build]: 4.53001e-06 [elim_shapecalc]: 9.25999e-06 [elim_not_effective]: 1.712e-05 [opt_reshape]: 8.23999e-06 [fold_const_symbol]: 1.277e-05 [renormalize]: 2.10013e-07 [validate]: 6.25e-05 Sums bootstrap : 0.000508s : 0.32% type_inference : 0.149017s : 93.30% event_method : 0.000032s : 0.02% auto_monad : 0.000098s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000802s : 0.50% rewriter_before_opt_a : 0.000120s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000089s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.001121s : 0.70% jit_opt_a.with_stream_mark : 0.000046s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.005000s : 3.13% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000059s : 0.04% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000022s : 0.01% rewriter_after_opt_a : 0.000046s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000913s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000501s : 0.31% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000059s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000525s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.04% Time group info: ------[substitution.] 0.000425 28 0.60% : 0.000003s : 2: substitution.elim_not_effective 0.47% : 0.000002s : 2: substitution.fold_const_symbol 1.70% : 0.000007s : 4: substitution.graph_param_transform 84.89% : 0.000361s : 5: substitution.inline 1.41% : 0.000006s : 4: substitution.j_node_and_user_rematch 3.92% : 0.000017s : 3: substitution.reduce_eliminate 1.61% : 0.000007s : 4: substitution.remove_not_recompute_node 1.96% : 0.000008s : 2: substitution.replace_old_param 3.44% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.148863 2 96.33% : 0.143403s : 1: type_inference.infer 3.67% : 0.005460s : 1: type_inference.specialize ------[replace.] 0.000182 7 75.68% : 0.000138s : 5: replace.inline 24.32% : 0.000044s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000372 7 96.33% : 0.000358s : 5: match.inline 3.67% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000169 886 1.46% : 0.000002s : 13: predicate.accumulaten_eliminater 0.86% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 1.73% : 0.000003s : 13: predicate.addn_zero_filter 2.54% : 0.000004s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.93% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_depend_swap 1.43% : 0.000002s : 13: predicate.environ_get_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.34% : 0.000001s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000009s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.59% : 0.000003s : 8: predicate.less_batch_normalization 1.62% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.48% : 0.000002s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.23% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 13: predicate.merge_addn 0.95% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000004s : 19: predicate.partial_eliminate 1.51% : 0.000003s : 13: predicate.print_const_string_wrapper 2.58% : 0.000004s : 13: predicate.reduce_eliminate 1.51% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.54% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.84% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000004s : 20: predicate.switch_defer_inline 1.87% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.81% : 0.000012s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.77% : 0.000003s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.95% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.34% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.90% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003760 25 62.50% : 0.002350s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.13% : 0.000117s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.38% : 0.001293s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.171910 72 0.04% : 0.000062s : 1: add_recomputation 0.06% : 0.000101s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.31% : 0.000532s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000038s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.97% : 0.011988s : 1: jit_opt_a 0.11% : 0.000182s : 1: jit_opt_after_cconv 0.04% : 0.000063s : 1: jit_opt_b 0.30% : 0.000511s : 1: loop_unroll 0.54% : 0.000923s : 1: mutable_eliminate 0.83% : 0.001421s : 26: opt.transform.jit_opt_a 0.04% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000534s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000812s : 1: py_interpret_to_execute 0.01% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 2.05% : 0.003528s : 1: renormalize.infer 0.85% : 0.001456s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000050s : 1: rewriter_after_opt_a 0.07% : 0.000127s : 1: rewriter_before_opt_a 0.08% : 0.000133s : 1: symbol_engine_optimizer 86.70% : 0.149047s : 1: type_inference TotalTime = 0.145148, [30] [bootstrap]: 0.00039013 [type_inference]: 0.133702 [event_method]: 2.381e-05 [auto_monad]: 7.595e-05 [graph_reusing]: 6.63998e-06 [pre_auto_parallel]: 2.98e-06 [py_interpret_to_execute]: 0.00046087 [rewriter_before_opt_a]: 0.00010831 [expand_dump_flag]: 3.72998e-06 [jit_opt_a]: 0.00771962, [2] [Cycle 1]: 0.00392098, [27] [switch_simplify]: 6.737e-05 [loop_unroll]: 3.433e-05 [a_1]: 0.00075778 [with_stream_mark]: 2.307e-05 [recompute_prepare]: 9.46e-06 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 3.8e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 8.05e-06 [updatestate_useless_node_eliminater]: 6.66999e-06 [accelerated_algorithm]: 7.95998e-06 [meta_shard_fg_expand]: 2.92002e-06 [get_grad_eliminate_]: 6.92002e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.674e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 6.58e-06 [renormalize]: 0.00264096 [add_forward_monad_depend]: 6.88e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.842e-05 [cse]: 3.999e-05 [replace_applicator]: 2.096e-05 [Cycle 2]: 0.00040363, [27] [switch_simplify]: 7.27002e-06 [loop_unroll]: 7.23e-06 [a_1]: 0.0001299 [with_stream_mark]: 1.385e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.5e-06 [parameter_eliminate]: 1.46002e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 2.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.826e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 5.91e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 7.25998e-06 [cse]: 1.705e-05 [replace_applicator]: 6.99001e-06 [py_interpret_to_execute_after_opt_a]: 1.091e-05 [rewriter_after_opt_a]: 3.794e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.16002e-06 [mutable_eliminate]: 0.00081736 [jit_opt_b]: 6.66e-05, [1] [Cycle 1]: 5.803e-05, [2] [frontend_op_eliminate]: 2.297e-05 [inline_after_opt_a]: 2.048e-05 [cconv]: 2.827e-05 [loop_unroll]: 0.00042885 [jit_opt_after_cconv]: 0.00016665, [1] [Cycle 1]: 0.00015957, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 4.45e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 3.016e-05 [call_graph_tuple_transform]: 2.105e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.955e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 1.063e-05 [add_recomputation]: 5.145e-05 [cse_after_recomputation]: 2.636e-05, [1] [Cycle 1]: 1.975e-05, [1] [cse]: 1.386e-05 [auto_monad_reorder]: 1.811e-05 [get_jit_bprop_graph]: 1.67999e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00047853 [symbol_engine_optimizer]: 0.00015572, [1] [Cycle 1]: 0.00014932, [6] [build]: 3.88001e-06 [elim_shapecalc]: 9.24998e-06 [elim_not_effective]: 8.723e-05 [opt_reshape]: 7.46001e-06 [fold_const_symbol]: 1.016e-05 [renormalize]: 3.59985e-07 [validate]: 5.131e-05 Sums bootstrap : 0.000390s : 0.28% type_inference : 0.133702s : 94.79% event_method : 0.000024s : 0.02% auto_monad : 0.000076s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000461s : 0.33% rewriter_before_opt_a : 0.000108s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000888s : 0.63% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002641s : 1.87% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000057s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000817s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000028s : 0.02% loop_unroll : 0.000429s : 0.30% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000479s : 0.34% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000087s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000318 25 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.89% : 0.000006s : 4: substitution.graph_param_transform 87.93% : 0.000280s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.86% : 0.000006s : 4: substitution.remove_not_recompute_node 1.83% : 0.000006s : 2: substitution.replace_old_param 4.29% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.133614 2 97.86% : 0.130757s : 1: type_inference.infer 2.14% : 0.002857s : 1: type_inference.specialize ------[replace.] 0.000111 7 70.44% : 0.000078s : 5: replace.inline 29.56% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000289 7 95.70% : 0.000277s : 5: match.inline 4.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.16% : 0.000002s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.81% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 6.01% : 0.000009s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 2.01% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 1.98% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000002s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.28% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.71% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002597 25 68.84% : 0.001788s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.30% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.86% : 0.000724s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.149094 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000080s : 1: auto_monad 0.02% : 0.000023s : 1: auto_monad_reorder 0.27% : 0.000409s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.18% : 0.007723s : 1: jit_opt_a 0.11% : 0.000169s : 1: jit_opt_after_cconv 0.05% : 0.000069s : 1: jit_opt_b 0.29% : 0.000437s : 1: loop_unroll 0.55% : 0.000827s : 1: mutable_eliminate 0.78% : 0.001158s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000111s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000542s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 1.27% : 0.001901s : 1: renormalize.infer 0.49% : 0.000729s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000115s : 1: rewriter_before_opt_a 0.11% : 0.000159s : 1: symbol_engine_optimizer 89.69% : 0.133720s : 1: type_inference TotalTime = 0.0375183, [30] [bootstrap]: 0.0005438 [type_inference]: 0.0249667 [event_method]: 2.775e-05 [auto_monad]: 9.173e-05 [graph_reusing]: 7.36001e-06 [pre_auto_parallel]: 2.93e-06 [py_interpret_to_execute]: 8.278e-05 [rewriter_before_opt_a]: 9.288e-05 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.00825443, [2] [Cycle 1]: 0.00277076, [27] [switch_simplify]: 8.131e-05 [loop_unroll]: 3.317e-05 [a_1]: 0.00082634 [with_stream_mark]: 2.892e-05 [recompute_prepare]: 1.007e-05 [updatestate_depend_eliminate]: 5.17999e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 6.70998e-06 [updatestate_useless_node_eliminater]: 5.38002e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.743e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00138997 [add_forward_monad_depend]: 8.3e-06 [auto_monad_grad]: 2.58998e-06 [auto_monad_eliminator]: 2.083e-05 [cse]: 4.143e-05 [replace_applicator]: 1.95e-05 [Cycle 2]: 0.0003697, [27] [switch_simplify]: 7.63999e-06 [loop_unroll]: 5.71998e-06 [a_1]: 0.0001171 [with_stream_mark]: 1.375e-05 [recompute_prepare]: 5.66998e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.66998e-06 [get_grad_eliminate_]: 5.00001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.246e-05 [j_node_and_user_rematch]: 8.25e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 5.40022e-07 [auto_monad_eliminator]: 6.81001e-06 [cse]: 1.384e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.631e-05 [rewriter_after_opt_a]: 4.675e-05 [convert_after_rewriter]: 7.21999e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00100285 [jit_opt_b]: 7.614e-05, [1] [Cycle 1]: 5.175e-05, [2] [frontend_op_eliminate]: 2.255e-05 [inline_after_opt_a]: 1.634e-05 [cconv]: 3.497e-05 [loop_unroll]: 0.00051224 [jit_opt_after_cconv]: 0.000179, [1] [Cycle 1]: 0.00017183, [11] [c_1]: 2.434e-05 [parameter_eliminate]: 4.41002e-06 [updatestate_depend_eliminate]: 8.85999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 3.593e-05 [call_graph_tuple_transform]: 2.418e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 1.18001e-06 [switch_simplify]: 6.37001e-06 [remove_dup_value]: 1.856e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 6.91999e-06 [add_recomputation]: 5.925e-05 [cse_after_recomputation]: 2.464e-05, [1] [Cycle 1]: 1.825e-05, [1] [cse]: 1.192e-05 [auto_monad_reorder]: 1.893e-05 [get_jit_bprop_graph]: 3.26999e-06 [rewriter_after_jit_bprop_graph]: 8.56002e-06 [opt_after_jit_grad]: 0.00103386 [symbol_engine_optimizer]: 8.516e-05, [1] [Cycle 1]: 7.777e-05, [6] [build]: 5.03002e-06 [elim_shapecalc]: 9.73002e-06 [elim_not_effective]: 1.588e-05 [opt_reshape]: 6.81999e-06 [fold_const_symbol]: 9.65002e-06 [renormalize]: 8.00006e-07 [validate]: 5.649e-05 Sums bootstrap : 0.000544s : 1.72% type_inference : 0.024967s : 78.81% event_method : 0.000028s : 0.09% auto_monad : 0.000092s : 0.29% graph_reusing : 0.000007s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000083s : 0.26% rewriter_before_opt_a : 0.000093s : 0.29% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000089s : 0.28% jit_opt_a.loop_unroll : 0.000039s : 0.12% jit_opt_a.a_1 : 0.000943s : 2.98% jit_opt_a.with_stream_mark : 0.000043s : 0.13% jit_opt_a.recompute_prepare : 0.000016s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.04% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000009s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.09% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.06% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.06% jit_opt_a.inline_without_move : 0.000011s : 0.04% jit_opt_a.renormalize : 0.001390s : 4.39% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.09% jit_opt_a.cse : 0.000055s : 0.17% jit_opt_a.replace_applicator : 0.000025s : 0.08% py_interpret_to_execute_after_opt_a : 0.000016s : 0.05% rewriter_after_opt_a : 0.000047s : 0.15% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.001003s : 3.17% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.07% jit_opt_b.inline_after_opt_a : 0.000016s : 0.05% cconv : 0.000035s : 0.11% loop_unroll : 0.000512s : 1.62% jit_opt_after_cconv.c_1 : 0.000024s : 0.08% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.03% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000036s : 0.11% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.08% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.02% remove_dup_value : 0.000019s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.02% add_recomputation : 0.000059s : 0.19% cse_after_recomputation.cse : 0.000012s : 0.04% auto_monad_reorder : 0.000019s : 0.06% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.03% opt_after_jit_grad : 0.001034s : 3.26% symbol_engine_optimizer.build : 0.000005s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.18% Time group info: ------[substitution.] 0.000360 27 0.71% : 0.000003s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 1.83% : 0.000007s : 3: substitution.graph_param_transform 85.39% : 0.000308s : 5: substitution.inline 1.11% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.43% : 0.000012s : 3: substitution.reduce_eliminate 1.57% : 0.000006s : 4: substitution.remove_not_recompute_node 1.80% : 0.000006s : 2: substitution.replace_old_param 3.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.024841 2 93.78% : 0.023295s : 1: type_inference.infer 6.22% : 0.001546s : 1: type_inference.specialize ------[replace.] 0.000112 7 69.10% : 0.000077s : 5: replace.inline 30.90% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000316 7 96.17% : 0.000304s : 5: match.inline 3.83% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 747 1.71% : 0.000003s : 11: predicate.accumulaten_eliminater 1.80% : 0.000003s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 11: predicate.addn_check_dump 1.48% : 0.000002s : 11: predicate.addn_zero_filter 2.27% : 0.000003s : 11: predicate.arithmetic_simplify 1.62% : 0.000002s : 11: predicate.cast_eliminate 0.92% : 0.000001s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 11: predicate.compare_switch_simplify 1.06% : 0.000002s : 11: predicate.depend_value_elim 0.98% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.30% : 0.000002s : 11: predicate.environ_get_depend_swap 1.14% : 0.000002s : 11: predicate.environ_get_eliminate 0.95% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.02% : 0.000007s : 24: predicate.inline 0.74% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 6: predicate.less_batch_normalization 1.78% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 16: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 11: predicate.merge_addn 0.97% : 0.000001s : 11: predicate.minmaximum_grad 2.06% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000003s : 16: predicate.partial_eliminate 1.50% : 0.000002s : 11: predicate.print_const_string_wrapper 2.13% : 0.000003s : 11: predicate.reduce_eliminate 1.73% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000003s : 19: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.24% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.17% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.64% : 0.000002s : 3: predicate.row_tensor_eliminate 1.47% : 0.000002s : 11: predicate.same_eliminate 0.43% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.53% : 0.000002s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.32% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.44% : 0.000011s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.53% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.06% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.80% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.56% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001360 16 48.65% : 0.000662s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.22% : 0.000098s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.13% : 0.000600s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.040158 72 0.16% : 0.000063s : 1: add_recomputation 0.24% : 0.000096s : 1: auto_monad 0.05% : 0.000021s : 1: auto_monad_reorder 1.42% : 0.000572s : 1: bootstrap 0.09% : 0.000038s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.08% : 0.000032s : 1: event_method 0.02% : 0.000010s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 20.57% : 0.008260s : 1: jit_opt_a 0.45% : 0.000182s : 1: jit_opt_after_cconv 0.20% : 0.000081s : 1: jit_opt_b 1.30% : 0.000521s : 1: loop_unroll 2.53% : 0.001017s : 1: mutable_eliminate 2.99% : 0.001202s : 26: opt.transform.jit_opt_a 0.14% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000032s : 4: opt.transform.jit_opt_b 0.04% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000022s : 1: opt.transform.mutable_eliminate 0.07% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.61% : 0.001046s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.21% : 0.000086s : 1: py_interpret_to_execute 0.05% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.05% : 0.000021s : 1: remove_dup_value 1.92% : 0.000770s : 1: renormalize.infer 1.51% : 0.000608s : 1: renormalize.specialize 0.03% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.13% : 0.000051s : 1: rewriter_after_opt_a 0.24% : 0.000096s : 1: rewriter_before_opt_a 0.22% : 0.000088s : 1: symbol_engine_optimizer 62.25% : 0.024998s : 1: type_inference TotalTime = 0.0286689, [30] [bootstrap]: 0.00025422 [type_inference]: 0.00450852 [event_method]: 1.957e-05 [auto_monad]: 6.67e-05 [graph_reusing]: 6.17999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 3.542e-05 [rewriter_before_opt_a]: 7.328e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00534403, [2] [Cycle 1]: 0.00170269, [27] [switch_simplify]: 5.787e-05 [loop_unroll]: 3.896e-05 [a_1]: 0.00055779 [with_stream_mark]: 2.159e-05 [recompute_prepare]: 7.71999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.67002e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 2.28002e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.07e-06 [renormalize]: 0.00068393 [add_forward_monad_depend]: 6.28998e-06 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 1.619e-05 [cse]: 3.461e-05 [replace_applicator]: 1.305e-05 [Cycle 2]: 0.00032106, [27] [switch_simplify]: 6.02999e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.137e-05 [with_stream_mark]: 8.84e-06 [recompute_prepare]: 5.38002e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.349e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 7.08e-06 [cse]: 1.174e-05 [replace_applicator]: 5.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 4.244e-05 [convert_after_rewriter]: 7.15998e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00058123 [jit_opt_b]: 5.109e-05, [1] [Cycle 1]: 4.38e-05, [2] [frontend_op_eliminate]: 1.599e-05 [inline_after_opt_a]: 1.579e-05 [cconv]: 2.542e-05 [loop_unroll]: 0.00043595 [jit_opt_after_cconv]: 0.00014416, [1] [Cycle 1]: 0.0001378, [11] [c_1]: 2.211e-05 [parameter_eliminate]: 2.90998e-06 [updatestate_depend_eliminate]: 6.11e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.117e-05 [call_graph_tuple_transform]: 1.852e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 2.29978e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 5.325e-05 [cse_after_recomputation]: 2.251e-05, [1] [Cycle 1]: 1.676e-05, [1] [cse]: 1.037e-05 [auto_monad_reorder]: 1.607e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 4.95001e-06 [opt_after_jit_grad]: 0.0166182 [symbol_engine_optimizer]: 9.033e-05, [1] [Cycle 1]: 8.21e-05, [6] [build]: 6.19999e-06 [elim_shapecalc]: 1.208e-05 [elim_not_effective]: 1.623e-05 [opt_reshape]: 6.92002e-06 [fold_const_symbol]: 9.54999e-06 [renormalize]: 3.19997e-07 [validate]: 3.799e-05 Sums bootstrap : 0.000254s : 1.03% type_inference : 0.004509s : 18.22% event_method : 0.000020s : 0.08% auto_monad : 0.000067s : 0.27% graph_reusing : 0.000006s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000035s : 0.14% rewriter_before_opt_a : 0.000073s : 0.30% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.26% jit_opt_a.loop_unroll : 0.000044s : 0.18% jit_opt_a.a_1 : 0.000649s : 2.62% jit_opt_a.with_stream_mark : 0.000030s : 0.12% jit_opt_a.recompute_prepare : 0.000013s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.02% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.02% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.04% jit_opt_a.accelerated_algorithm : 0.000010s : 0.04% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.04% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.07% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000016s : 0.07% jit_opt_a.inline_without_move : 0.000010s : 0.04% jit_opt_a.renormalize : 0.000684s : 2.76% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.09% jit_opt_a.cse : 0.000046s : 0.19% jit_opt_a.replace_applicator : 0.000018s : 0.07% py_interpret_to_execute_after_opt_a : 0.000010s : 0.04% rewriter_after_opt_a : 0.000042s : 0.17% convert_after_rewriter : 0.000007s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000581s : 2.35% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.06% jit_opt_b.inline_after_opt_a : 0.000016s : 0.06% cconv : 0.000025s : 0.10% loop_unroll : 0.000436s : 1.76% jit_opt_after_cconv.c_1 : 0.000022s : 0.09% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.09% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.07% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.02% remove_dup_value : 0.000015s : 0.06% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.03% add_recomputation : 0.000053s : 0.22% cse_after_recomputation.cse : 0.000010s : 0.04% auto_monad_reorder : 0.000016s : 0.06% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.02% opt_after_jit_grad : 0.016618s : 67.15% symbol_engine_optimizer.build : 0.000006s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.15% Time group info: ------[substitution.] 0.000221 23 1.13% : 0.000003s : 2: substitution.elim_not_effective 0.89% : 0.000002s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 3: substitution.graph_param_transform 84.08% : 0.000186s : 4: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000005s : 2: substitution.replace_old_param 5.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004437 2 80.12% : 0.003555s : 1: type_inference.infer 19.88% : 0.000882s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.72% : 0.000048s : 4: replace.inline 31.28% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.31% : 0.000184s : 4: match.inline 5.69% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.09% : 0.000001s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 10: predicate.addn_check_dump 1.09% : 0.000001s : 10: predicate.addn_zero_filter 2.11% : 0.000003s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 10: predicate.dict_set_item_eliminator 4.66% : 0.000006s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.84% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 6.00% : 0.000007s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 0.99% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.70% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.25% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 53: predicate.switch_simplify 1.15% : 0.000001s : 10: predicate.tile_eliminate 1.10% : 0.000001s : 10: predicate.transpose_eliminate 1.29% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.95% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.71% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000605 13 48.75% : 0.000295s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.56% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.68% : 0.000270s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046412 72 0.12% : 0.000056s : 1: add_recomputation 0.15% : 0.000071s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.58% : 0.000269s : 1: bootstrap 0.06% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.52% : 0.005347s : 1: jit_opt_a 0.32% : 0.000147s : 1: jit_opt_after_cconv 0.12% : 0.000054s : 1: jit_opt_b 0.96% : 0.000443s : 1: loop_unroll 1.27% : 0.000591s : 1: mutable_eliminate 1.88% : 0.000872s : 26: opt.transform.jit_opt_a 0.10% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000026s : 4: opt.transform.jit_opt_b 0.03% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 34.79% : 0.016147s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000040s : 4: opt.transform.symbol_engine_opt 35.84% : 0.016633s : 1: opt_after_jit_grad 0.02% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000038s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000018s : 1: remove_dup_value 0.82% : 0.000379s : 1: renormalize.infer 0.64% : 0.000298s : 1: renormalize.specialize 0.02% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.10% : 0.000046s : 1: rewriter_after_opt_a 0.16% : 0.000076s : 1: rewriter_before_opt_a 0.20% : 0.000094s : 1: symbol_engine_optimizer 9.76% : 0.004528s : 1: type_inference TotalTime = 0.0733955, [30] [bootstrap]: 0.00035426 [type_inference]: 0.0622375 [event_method]: 2.102e-05 [auto_monad]: 7.396e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00029131 [rewriter_before_opt_a]: 0.00010212 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.00797974, [2] [Cycle 1]: 0.00373531, [27] [switch_simplify]: 7.495e-05 [loop_unroll]: 3.526e-05 [a_1]: 0.00074539 [with_stream_mark]: 2.61e-05 [recompute_prepare]: 9.19e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 7.54002e-06 [updatestate_useless_node_eliminater]: 6.83e-06 [accelerated_algorithm]: 7.08998e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 7.63001e-06 [merge_forward]: 4.48001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.871e-05 [j_node_and_user_rematch]: 1.125e-05 [meta_fg_expand]: 2.89999e-06 [replace_old_param]: 1.229e-05 [inline_without_move]: 7.63999e-06 [renormalize]: 0.00246874 [add_forward_monad_depend]: 1.05e-05 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 1.21e-05 [cse]: 2.824e-05 [replace_applicator]: 1.387e-05 [Cycle 2]: 0.00038597, [27] [switch_simplify]: 7.21001e-06 [loop_unroll]: 6.71e-06 [a_1]: 0.00012533 [with_stream_mark]: 1.101e-05 [recompute_prepare]: 6.45997e-06 [updatestate_depend_eliminate]: 3.92998e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 6.65002e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 3.25e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.96e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.56002e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.23e-06 [cse]: 1.619e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.209e-05 [rewriter_after_opt_a]: 3.315e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 4.42e-06 [mutable_eliminate]: 0.00062005 [jit_opt_b]: 5.794e-05, [1] [Cycle 1]: 4.92e-05, [2] [frontend_op_eliminate]: 1.961e-05 [inline_after_opt_a]: 1.81e-05 [cconv]: 2.981e-05 [loop_unroll]: 0.00046113 [jit_opt_after_cconv]: 0.0001646, [1] [Cycle 1]: 0.00015784, [11] [c_1]: 2.666e-05 [parameter_eliminate]: 4.41002e-06 [updatestate_depend_eliminate]: 8.3e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 3.11e-05 [call_graph_tuple_transform]: 1.969e-05 [tuple_list_get_item_eliminator]: 6.93e-06 [none_parameter_eliminate]: 7.60017e-07 [renormalize]: 3.19997e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 1.52001e-06 [environ_conv]: 8.99e-06 [add_recomputation]: 4.837e-05 [cse_after_recomputation]: 2.496e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.301e-05 [auto_monad_reorder]: 1.305e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 7.58999e-06 [opt_after_jit_grad]: 0.00049102 [symbol_engine_optimizer]: 7.739e-05, [1] [Cycle 1]: 7.008e-05, [6] [build]: 4.15e-06 [elim_shapecalc]: 8.38001e-06 [elim_not_effective]: 1.414e-05 [opt_reshape]: 7.65e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 3.50003e-07 [validate]: 5.33e-05 Sums bootstrap : 0.000354s : 0.51% type_inference : 0.062238s : 90.32% event_method : 0.000021s : 0.03% auto_monad : 0.000074s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000291s : 0.42% rewriter_before_opt_a : 0.000102s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000082s : 0.12% jit_opt_a.loop_unroll : 0.000042s : 0.06% jit_opt_a.a_1 : 0.000871s : 1.26% jit_opt_a.with_stream_mark : 0.000037s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000014s : 0.02% jit_opt_a.renormalize : 0.002469s : 3.58% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000044s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000620s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000030s : 0.04% loop_unroll : 0.000461s : 0.67% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.07% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000491s : 0.71% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.08% Time group info: ------[substitution.] 0.000294 25 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.54% : 0.000005s : 4: substitution.graph_param_transform 87.44% : 0.000257s : 5: substitution.inline 1.24% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000006s : 2: substitution.replace_old_param 4.76% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062142 2 96.46% : 0.059941s : 1: type_inference.infer 3.54% : 0.002201s : 1: type_inference.specialize ------[replace.] 0.000107 7 69.05% : 0.000074s : 5: replace.inline 30.95% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000267 7 95.23% : 0.000254s : 5: match.inline 4.77% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 888 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 13: predicate.addn_check_dump 1.62% : 0.000002s : 13: predicate.addn_zero_filter 2.06% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.33% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.06% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.62% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000008s : 28: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.62% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 41: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 1.79% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.04% : 0.000002s : 8: predicate.remove_not_recompute_node 1.88% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.35% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.30% : 0.000011s : 65: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002756 29 69.15% : 0.001906s : 20: func_graph_cloner_run.FuncGraphClonerGraph 3.06% : 0.000084s : 2: func_graph_cloner_run.FuncGraphClonerNode 27.79% : 0.000766s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077073 72 0.07% : 0.000052s : 1: add_recomputation 0.10% : 0.000077s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.49% : 0.000376s : 1: bootstrap 0.04% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.36% : 0.007983s : 1: jit_opt_a 0.22% : 0.000168s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.61% : 0.000469s : 1: loop_unroll 0.82% : 0.000631s : 1: mutable_eliminate 1.48% : 0.001141s : 26: opt.transform.jit_opt_a 0.07% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000500s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000297s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 2.19% : 0.001690s : 1: renormalize.infer 1.00% : 0.000768s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.14% : 0.000107s : 1: rewriter_before_opt_a 0.10% : 0.000080s : 1: symbol_engine_optimizer 80.78% : 0.062256s : 1: type_inference TotalTime = 0.181515, [30] [bootstrap]: 0.00058035 [type_inference]: 0.163053 [event_method]: 3.139e-05 [auto_monad]: 9.075e-05 [graph_reusing]: 7.26999e-06 [pre_auto_parallel]: 3.05002e-06 [py_interpret_to_execute]: 0.00125962 [rewriter_before_opt_a]: 0.00011893 [expand_dump_flag]: 4.11001e-06 [jit_opt_a]: 0.0132912, [2] [Cycle 1]: 0.00790517, [27] [switch_simplify]: 8.655e-05 [loop_unroll]: 3.692e-05 [a_1]: 0.00100397 [with_stream_mark]: 2.386e-05 [recompute_prepare]: 1.011e-05 [updatestate_depend_eliminate]: 4.66002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.32002e-06 [parameter_eliminate]: 2.10002e-06 [specialize_transform]: 9.59999e-06 [updatestate_useless_node_eliminater]: 7.28999e-06 [accelerated_algorithm]: 9.17001e-06 [meta_shard_fg_expand]: 3.15998e-06 [get_grad_eliminate_]: 8.31002e-06 [merge_forward]: 4.14002e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.879e-05 [j_node_and_user_rematch]: 1.334e-05 [meta_fg_expand]: 3.09001e-06 [replace_old_param]: 1.239e-05 [inline_without_move]: 6.74001e-06 [renormalize]: 0.00629433 [add_forward_monad_depend]: 1.079e-05 [auto_monad_grad]: 3.55e-06 [auto_monad_eliminator]: 2.209e-05 [cse]: 3.971e-05 [replace_applicator]: 3.071e-05 [Cycle 2]: 0.00058455, [27] [switch_simplify]: 1.059e-05 [loop_unroll]: 8.08001e-06 [a_1]: 0.00018231 [with_stream_mark]: 1.83e-05 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 5.09998e-06 [updatestate_assign_eliminate]: 3.71001e-06 [updatestate_loads_eliminate]: 2.126e-05 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 6.43998e-06 [accelerated_algorithm]: 8.15e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 7.73001e-06 [merge_forward]: 4.82998e-06 [cell_reuse_recompute_pass]: 6.40002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.878e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 4.09002e-06 [replace_old_param]: 1.174e-05 [inline_without_move]: 6.14001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.92999e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 8.46002e-06 [cse]: 1.558e-05 [replace_applicator]: 7.13e-06 [py_interpret_to_execute_after_opt_a]: 2.359e-05 [rewriter_after_opt_a]: 4.937e-05 [convert_after_rewriter]: 7.74002e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.00093576 [jit_opt_b]: 6.651e-05, [1] [Cycle 1]: 5.778e-05, [2] [frontend_op_eliminate]: 2.45e-05 [inline_after_opt_a]: 1.953e-05 [cconv]: 3.372e-05 [loop_unroll]: 0.00051373 [jit_opt_after_cconv]: 0.00019936, [1] [Cycle 1]: 0.00018816, [11] [c_1]: 3.482e-05 [parameter_eliminate]: 3.88999e-06 [updatestate_depend_eliminate]: 6.64001e-06 [updatestate_assign_eliminate]: 5.05999e-06 [updatestate_loads_eliminate]: 2.41998e-06 [cse]: 3.243e-05 [call_graph_tuple_transform]: 2.872e-05 [tuple_list_get_item_eliminator]: 7.61001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 7.98999e-06 [remove_dup_value]: 2.185e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 1.14e-05 [add_recomputation]: 5.833e-05 [cse_after_recomputation]: 3.002e-05, [1] [Cycle 1]: 2.23e-05, [1] [cse]: 1.625e-05 [auto_monad_reorder]: 2.045e-05 [get_jit_bprop_graph]: 2.60002e-06 [rewriter_after_jit_bprop_graph]: 9.52999e-06 [opt_after_jit_grad]: 0.00058054 [symbol_engine_optimizer]: 9.761e-05, [1] [Cycle 1]: 9.01e-05, [6] [build]: 4.68999e-06 [elim_shapecalc]: 1.092e-05 [elim_not_effective]: 1.957e-05 [opt_reshape]: 8.22e-06 [fold_const_symbol]: 1.225e-05 [renormalize]: 4.30009e-07 [validate]: 0.00015703 Sums bootstrap : 0.000580s : 0.33% type_inference : 0.163053s : 92.70% event_method : 0.000031s : 0.02% auto_monad : 0.000091s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001260s : 0.72% rewriter_before_opt_a : 0.000119s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000097s : 0.06% jit_opt_a.loop_unroll : 0.000045s : 0.03% jit_opt_a.a_1 : 0.001186s : 0.67% jit_opt_a.with_stream_mark : 0.000042s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000025s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000017s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000017s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000008s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.006294s : 3.58% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000055s : 0.03% jit_opt_a.replace_applicator : 0.000038s : 0.02% py_interpret_to_execute_after_opt_a : 0.000024s : 0.01% rewriter_after_opt_a : 0.000049s : 0.03% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000936s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000514s : 0.29% jit_opt_after_cconv.c_1 : 0.000035s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000058s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000581s : 0.33% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000157s : 0.09% Time group info: ------[substitution.] 0.000486 28 0.49% : 0.000002s : 2: substitution.elim_not_effective 0.24% : 0.000001s : 2: substitution.fold_const_symbol 1.59% : 0.000008s : 4: substitution.graph_param_transform 86.84% : 0.000422s : 5: substitution.inline 1.16% : 0.000006s : 4: substitution.j_node_and_user_rematch 3.42% : 0.000017s : 3: substitution.reduce_eliminate 1.66% : 0.000008s : 4: substitution.remove_not_recompute_node 1.57% : 0.000008s : 2: substitution.replace_old_param 3.05% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.162912 2 96.25% : 0.156804s : 1: type_inference.infer 3.75% : 0.006108s : 1: type_inference.specialize ------[replace.] 0.000160 7 63.12% : 0.000101s : 5: replace.inline 36.88% : 0.000059s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000432 7 96.87% : 0.000418s : 5: match.inline 3.13% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000174 886 1.41% : 0.000002s : 13: predicate.accumulaten_eliminater 0.88% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.85% : 0.000003s : 13: predicate.addn_zero_filter 2.38% : 0.000004s : 13: predicate.arithmetic_simplify 1.75% : 0.000003s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.24% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 0.92% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.67% : 0.000003s : 13: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.29% : 0.000001s : 4: predicate.elim_not_effective 0.83% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.35% : 0.000002s : 13: predicate.environ_get_eliminate 0.87% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.69% : 0.000003s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000009s : 28: predicate.inline 0.74% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.60% : 0.000005s : 8: predicate.less_batch_normalization 1.65% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.05% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.36% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 13: predicate.merge_addn 0.93% : 0.000002s : 13: predicate.minmaximum_grad 1.84% : 0.000003s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 1.91% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 2.61% : 0.000005s : 13: predicate.reduce_eliminate 1.27% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.60% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000002s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.53% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000002s : 8: predicate.specialize_transform 1.65% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.03% : 0.000004s : 20: predicate.switch_defer_inline 1.72% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.09% : 0.000012s : 64: predicate.switch_simplify 1.55% : 0.000003s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.12% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.11% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.80% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004003 25 56.04% : 0.002243s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.74% : 0.000110s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.22% : 0.001650s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.189289 72 0.03% : 0.000062s : 1: add_recomputation 0.05% : 0.000094s : 1: auto_monad 0.01% : 0.000025s : 1: auto_monad_reorder 0.32% : 0.000609s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000037s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.03% : 0.013298s : 1: jit_opt_a 0.11% : 0.000203s : 1: jit_opt_after_cconv 0.04% : 0.000069s : 1: jit_opt_b 0.28% : 0.000522s : 1: loop_unroll 0.50% : 0.000948s : 1: mutable_eliminate 0.80% : 0.001505s : 26: opt.transform.jit_opt_a 0.04% : 0.000074s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000047s : 4: opt.transform.symbol_engine_opt 0.31% : 0.000590s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.67% : 0.001269s : 1: py_interpret_to_execute 0.01% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 2.36% : 0.004466s : 1: renormalize.infer 0.96% : 0.001812s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000052s : 1: rewriter_after_opt_a 0.07% : 0.000125s : 1: rewriter_before_opt_a 0.05% : 0.000101s : 1: symbol_engine_optimizer 86.15% : 0.163079s : 1: type_inference TotalTime = 0.0136947, [30] [bootstrap]: 0.00029061 [type_inference]: 0.00524948 [event_method]: 1.906e-05 [auto_monad]: 6.83e-05 [graph_reusing]: 6.73e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 4.128e-05 [rewriter_before_opt_a]: 7.923e-05 [expand_dump_flag]: 3.23998e-06 [jit_opt_a]: 0.00577054, [2] [Cycle 1]: 0.00191001, [27] [switch_simplify]: 6.49e-05 [loop_unroll]: 3.338e-05 [a_1]: 0.00063603 [with_stream_mark]: 2.341e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.57002e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 5.31002e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.0008086 [add_forward_monad_depend]: 6.19999e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 2.997e-05 [replace_applicator]: 1.398e-05 [Cycle 2]: 0.0003145, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 4.78001e-06 [a_1]: 9.019e-05 [with_stream_mark]: 9.96e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.66999e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 4.89998e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 4.80001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.385e-05 [j_node_and_user_rematch]: 8.31002e-06 [meta_fg_expand]: 1.48002e-06 [replace_old_param]: 7.16001e-06 [inline_without_move]: 4.52e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.01e-05 [replace_applicator]: 4.95001e-06 [py_interpret_to_execute_after_opt_a]: 1.146e-05 [rewriter_after_opt_a]: 3.594e-05 [convert_after_rewriter]: 7.63999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00059142 [jit_opt_b]: 5.841e-05, [1] [Cycle 1]: 4.155e-05, [2] [frontend_op_eliminate]: 1.547e-05 [inline_after_opt_a]: 1.506e-05 [cconv]: 2.746e-05 [loop_unroll]: 0.00042512 [jit_opt_after_cconv]: 0.00014529, [1] [Cycle 1]: 0.00013903, [11] [c_1]: 2.024e-05 [parameter_eliminate]: 2.91e-06 [updatestate_depend_eliminate]: 6.78e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.284e-05 [call_graph_tuple_transform]: 1.977e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.17999e-06 [remove_dup_value]: 1.575e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 5.98002e-06 [add_recomputation]: 5.254e-05 [cse_after_recomputation]: 2.054e-05, [1] [Cycle 1]: 1.535e-05, [1] [cse]: 9.91998e-06 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.00045707 [symbol_engine_optimizer]: 7.08e-05, [1] [Cycle 1]: 6.49e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 7.51001e-06 [elim_not_effective]: 1.263e-05 [opt_reshape]: 5.60001e-06 [fold_const_symbol]: 8.35001e-06 [renormalize]: 3.30008e-07 [validate]: 3.837e-05 Sums bootstrap : 0.000291s : 3.04% type_inference : 0.005249s : 54.89% event_method : 0.000019s : 0.20% auto_monad : 0.000068s : 0.71% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.43% rewriter_before_opt_a : 0.000079s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000071s : 0.74% jit_opt_a.loop_unroll : 0.000038s : 0.40% jit_opt_a.a_1 : 0.000726s : 7.59% jit_opt_a.with_stream_mark : 0.000033s : 0.35% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000809s : 8.46% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.23% jit_opt_a.cse : 0.000040s : 0.42% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000036s : 0.38% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000591s : 6.18% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.16% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000027s : 0.29% loop_unroll : 0.000425s : 4.45% jit_opt_after_cconv.c_1 : 0.000020s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.55% cse_after_recomputation.cse : 0.000010s : 0.10% auto_monad_reorder : 0.000015s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000457s : 4.78% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.40% Time group info: ------[substitution.] 0.000290 23 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 1.95% : 0.000006s : 3: substitution.graph_param_transform 87.25% : 0.000253s : 4: substitution.inline 1.28% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000006s : 4: substitution.remove_not_recompute_node 1.50% : 0.000004s : 2: substitution.replace_old_param 4.85% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005186 2 81.57% : 0.004230s : 1: type_inference.infer 18.43% : 0.000956s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.52% : 0.000051s : 4: replace.inline 31.48% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 6 95.13% : 0.000251s : 4: match.inline 4.87% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.16% : 0.000001s : 10: predicate.addn_zero_filter 2.04% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.01% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 6.28% : 0.000008s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.69% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 2.57% : 0.000003s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 2.12% : 0.000003s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000759 13 47.52% : 0.000361s : 6: func_graph_cloner_run.FuncGraphClonerGraph 13.75% : 0.000104s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.73% : 0.000294s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015510 72 0.36% : 0.000056s : 1: add_recomputation 0.46% : 0.000072s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 1.99% : 0.000308s : 1: bootstrap 0.20% : 0.000030s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 37.23% : 0.005774s : 1: jit_opt_a 0.96% : 0.000148s : 1: jit_opt_after_cconv 0.39% : 0.000061s : 1: jit_opt_b 2.79% : 0.000433s : 1: loop_unroll 3.88% : 0.000601s : 1: mutable_eliminate 6.14% : 0.000953s : 26: opt.transform.jit_opt_a 0.31% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.00% : 0.000465s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000044s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.92% : 0.000453s : 1: renormalize.infer 2.24% : 0.000348s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000039s : 1: rewriter_after_opt_a 0.53% : 0.000082s : 1: rewriter_before_opt_a 0.47% : 0.000073s : 1: symbol_engine_optimizer 33.92% : 0.005261s : 1: type_inference TotalTime = 0.02371, [30] [bootstrap]: 0.00050945 [type_inference]: 0.0119843 [event_method]: 2.301e-05 [auto_monad]: 7.797e-05 [graph_reusing]: 6.69001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 6.399e-05 [rewriter_before_opt_a]: 8.371e-05 [expand_dump_flag]: 2.79999e-06 [jit_opt_a]: 0.00792008, [2] [Cycle 1]: 0.00303438, [27] [switch_simplify]: 6.865e-05 [loop_unroll]: 3.365e-05 [a_1]: 0.00084138 [with_stream_mark]: 2.635e-05 [recompute_prepare]: 8.86002e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.63998e-06 [specialize_transform]: 6.92002e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 3.6e-06 [get_grad_eliminate_]: 9.71e-06 [merge_forward]: 4.82e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.717e-05 [j_node_and_user_rematch]: 1.346e-05 [meta_fg_expand]: 2.73003e-06 [replace_old_param]: 1.265e-05 [inline_without_move]: 6.01e-06 [renormalize]: 0.00162919 [add_forward_monad_depend]: 8.13001e-06 [auto_monad_grad]: 2.93e-06 [auto_monad_eliminator]: 1.75e-05 [cse]: 3.88e-05 [replace_applicator]: 2.245e-05 [Cycle 2]: 0.00038469, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 5.91998e-06 [a_1]: 0.00012793 [with_stream_mark]: 1.556e-05 [recompute_prepare]: 5.89999e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.48002e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 3.20998e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.274e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.36002e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.81999e-06 [cse]: 1.494e-05 [replace_applicator]: 5.48002e-06 [py_interpret_to_execute_after_opt_a]: 1.517e-05 [rewriter_after_opt_a]: 3.935e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00086511 [jit_opt_b]: 6.055e-05, [1] [Cycle 1]: 5.171e-05, [2] [frontend_op_eliminate]: 2.047e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 3.369e-05 [loop_unroll]: 0.00057987 [jit_opt_after_cconv]: 0.00019482, [1] [Cycle 1]: 0.00018635, [11] [c_1]: 2.482e-05 [parameter_eliminate]: 5.55001e-06 [updatestate_depend_eliminate]: 7.13e-06 [updatestate_assign_eliminate]: 4.05e-06 [updatestate_loads_eliminate]: 3.78999e-06 [cse]: 4.165e-05 [call_graph_tuple_transform]: 2.678e-05 [tuple_list_get_item_eliminator]: 6.93e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 7.18e-06 [remove_dup_value]: 1.873e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.23999e-06 [add_recomputation]: 6.736e-05 [cse_after_recomputation]: 2.999e-05, [1] [Cycle 1]: 2.133e-05, [1] [cse]: 1.391e-05 [auto_monad_reorder]: 2.023e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 1.107e-05 [opt_after_jit_grad]: 0.00067233 [symbol_engine_optimizer]: 0.00012037, [1] [Cycle 1]: 0.00011254, [6] [build]: 5.19e-06 [elim_shapecalc]: 1.018e-05 [elim_not_effective]: 3.918e-05 [opt_reshape]: 1.024e-05 [fold_const_symbol]: 1.354e-05 [renormalize]: 1.14e-06 [validate]: 5.783e-05 Sums bootstrap : 0.000509s : 2.75% type_inference : 0.011984s : 64.80% event_method : 0.000023s : 0.12% auto_monad : 0.000078s : 0.42% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000064s : 0.35% rewriter_before_opt_a : 0.000084s : 0.45% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000076s : 0.41% jit_opt_a.loop_unroll : 0.000040s : 0.21% jit_opt_a.a_1 : 0.000969s : 5.24% jit_opt_a.with_stream_mark : 0.000042s : 0.23% jit_opt_a.recompute_prepare : 0.000015s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000013s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000015s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.16% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000021s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.001629s : 8.81% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.13% jit_opt_a.cse : 0.000054s : 0.29% jit_opt_a.replace_applicator : 0.000028s : 0.15% py_interpret_to_execute_after_opt_a : 0.000015s : 0.08% rewriter_after_opt_a : 0.000039s : 0.21% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000865s : 4.68% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.11% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000034s : 0.18% loop_unroll : 0.000580s : 3.14% jit_opt_after_cconv.c_1 : 0.000025s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.cse : 0.000042s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.04% remove_dup_value : 0.000019s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000008s : 0.04% add_recomputation : 0.000067s : 0.36% cse_after_recomputation.cse : 0.000014s : 0.08% auto_monad_reorder : 0.000020s : 0.11% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000011s : 0.06% opt_after_jit_grad : 0.000672s : 3.64% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000039s : 0.21% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000058s : 0.31% Time group info: ------[substitution.] 0.000337 27 1.15% : 0.000004s : 2: substitution.elim_not_effective 0.51% : 0.000002s : 2: substitution.fold_const_symbol 2.19% : 0.000007s : 3: substitution.graph_param_transform 82.86% : 0.000279s : 5: substitution.inline 1.34% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.16% : 0.000014s : 3: substitution.reduce_eliminate 1.63% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000006s : 2: substitution.replace_old_param 4.31% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011895 2 87.25% : 0.010379s : 1: type_inference.infer 12.75% : 0.001516s : 1: type_inference.specialize ------[replace.] 0.000189 7 41.40% : 0.000078s : 5: replace.inline 58.60% : 0.000111s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000290 7 95.39% : 0.000276s : 5: match.inline 4.61% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 747 1.04% : 0.000002s : 11: predicate.accumulaten_eliminater 1.20% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 11: predicate.addn_check_dump 1.84% : 0.000003s : 11: predicate.addn_zero_filter 2.37% : 0.000004s : 11: predicate.arithmetic_simplify 1.60% : 0.000002s : 11: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 0.92% : 0.000001s : 11: predicate.compare_switch_simplify 1.36% : 0.000002s : 11: predicate.depend_value_elim 0.96% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 11: predicate.environ_get_depend_swap 1.41% : 0.000002s : 11: predicate.environ_get_eliminate 0.94% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000002s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000008s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.82% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.50% : 0.000002s : 16: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 11: predicate.merge_addn 0.95% : 0.000001s : 11: predicate.minmaximum_grad 2.03% : 0.000003s : 3: predicate.mutable_eliminate 0.69% : 0.000001s : 3: predicate.opt_reshape 1.94% : 0.000003s : 16: predicate.partial_eliminate 1.29% : 0.000002s : 11: predicate.print_const_string_wrapper 2.81% : 0.000004s : 11: predicate.reduce_eliminate 1.20% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.46% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 19: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.85% : 0.000003s : 11: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.06% : 0.000002s : 11: predicate.same_eliminate 0.42% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.77% : 0.000003s : 11: predicate.stack_unstack_eliminate 0.30% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.79% : 0.000004s : 18: predicate.switch_defer_inline 1.91% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.85% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.20% : 0.000002s : 11: predicate.transpose_eliminate 1.60% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 2.09% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.22% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.39% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001303 16 45.19% : 0.000589s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.01% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 47.80% : 0.000623s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026655 72 0.27% : 0.000071s : 1: add_recomputation 0.30% : 0.000081s : 1: auto_monad 0.09% : 0.000023s : 1: auto_monad_reorder 2.02% : 0.000538s : 1: bootstrap 0.14% : 0.000036s : 1: cconv 0.03% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000033s : 1: cse_after_recomputation 0.04% : 0.000011s : 1: environ_conv 0.10% : 0.000027s : 1: event_method 0.02% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000009s : 1: graph_reusing 29.73% : 0.007925s : 1: jit_opt_a 0.74% : 0.000198s : 1: jit_opt_after_cconv 0.24% : 0.000063s : 1: jit_opt_b 2.22% : 0.000591s : 1: loop_unroll 3.29% : 0.000878s : 1: mutable_eliminate 4.61% : 0.001229s : 26: opt.transform.jit_opt_a 0.23% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000031s : 4: opt.transform.jit_opt_b 0.06% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000020s : 1: opt.transform.mutable_eliminate 0.12% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.26% : 0.000068s : 4: opt.transform.symbol_engine_opt 2.56% : 0.000683s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000067s : 1: py_interpret_to_execute 0.07% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000022s : 1: remove_dup_value 3.56% : 0.000948s : 1: renormalize.infer 2.51% : 0.000670s : 1: renormalize.specialize 0.05% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000042s : 1: rewriter_after_opt_a 0.33% : 0.000087s : 1: rewriter_before_opt_a 0.46% : 0.000124s : 1: symbol_engine_optimizer 45.04% : 0.012004s : 1: type_inference TotalTime = 0.122086, [30] [bootstrap]: 0.00028002 [type_inference]: 0.111137 [event_method]: 1.809e-05 [auto_monad]: 7.28e-05 [graph_reusing]: 6.35002e-06 [pre_auto_parallel]: 2.89999e-06 [py_interpret_to_execute]: 0.00047335 [rewriter_before_opt_a]: 8.969e-05 [expand_dump_flag]: 4.36002e-06 [jit_opt_a]: 0.00743491, [2] [Cycle 1]: 0.00348496, [27] [switch_simplify]: 5.891e-05 [loop_unroll]: 3.172e-05 [a_1]: 0.00063856 [with_stream_mark]: 1.75e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 4.06001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.40998e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 8.43999e-06 [updatestate_useless_node_eliminater]: 6.50002e-06 [accelerated_algorithm]: 7.18998e-06 [meta_shard_fg_expand]: 2.88e-06 [get_grad_eliminate_]: 7.25e-06 [merge_forward]: 4.53999e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.635e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 1.048e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00236742 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 1.83002e-06 [auto_monad_eliminator]: 1.813e-05 [cse]: 3.391e-05 [replace_applicator]: 1.805e-05 [Cycle 2]: 0.00038915, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.01998e-06 [a_1]: 0.00013173 [with_stream_mark]: 1.283e-05 [recompute_prepare]: 6.39001e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.40998e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.692e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 7.2e-06 [cse]: 1.296e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 2.296e-05 [rewriter_after_opt_a]: 3.47e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 7.28999e-06 [mutable_eliminate]: 0.00067901 [jit_opt_b]: 0.00012339, [1] [Cycle 1]: 0.0001159, [2] [frontend_op_eliminate]: 8.335e-05 [inline_after_opt_a]: 1.927e-05 [cconv]: 3.162e-05 [loop_unroll]: 0.00048942 [jit_opt_after_cconv]: 0.00016742, [1] [Cycle 1]: 0.00016032, [11] [c_1]: 2.606e-05 [parameter_eliminate]: 2.87002e-06 [updatestate_depend_eliminate]: 6.62002e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 3.068e-05 [call_graph_tuple_transform]: 2.157e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 7.7e-07 [switch_simplify]: 6.50002e-06 [remove_dup_value]: 1.657e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 8.88002e-06 [add_recomputation]: 0.00012279 [cse_after_recomputation]: 2.65e-05, [1] [Cycle 1]: 2.032e-05, [1] [cse]: 1.353e-05 [auto_monad_reorder]: 1.718e-05 [get_jit_bprop_graph]: 1.71e-06 [rewriter_after_jit_bprop_graph]: 5.96998e-06 [opt_after_jit_grad]: 0.00048326 [symbol_engine_optimizer]: 7.795e-05, [1] [Cycle 1]: 7.135e-05, [6] [build]: 4.60001e-06 [elim_shapecalc]: 8.83001e-06 [elim_not_effective]: 1.411e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 4.30009e-07 [validate]: 4.648e-05 Sums bootstrap : 0.000280s : 0.24% type_inference : 0.111137s : 94.26% event_method : 0.000018s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000473s : 0.40% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000770s : 0.65% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002368s : 2.01% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000023s : 0.02% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000679s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000083s : 0.07% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000489s : 0.42% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000123s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000483s : 0.41% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000207 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 4: substitution.graph_param_transform 81.67% : 0.000169s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.94% : 0.000006s : 4: substitution.remove_not_recompute_node 2.64% : 0.000005s : 2: substitution.replace_old_param 6.44% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111048 2 97.64% : 0.108423s : 1: type_inference.infer 2.36% : 0.002625s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.19% : 0.000050s : 4: replace.inline 31.81% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 93.18% : 0.000166s : 4: match.inline 6.82% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.56% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.77% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.55% : 0.000004s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.64% : 0.000004s : 22: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.54% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.70% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002438 22 72.22% : 0.001761s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.23% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.55% : 0.000647s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125605 72 0.10% : 0.000127s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000300s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.92% : 0.007438s : 1: jit_opt_a 0.14% : 0.000170s : 1: jit_opt_after_cconv 0.10% : 0.000126s : 1: jit_opt_b 0.40% : 0.000498s : 1: loop_unroll 0.55% : 0.000688s : 1: mutable_eliminate 0.81% : 0.001019s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000096s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000480s : 1: py_interpret_to_execute 0.02% : 0.000025s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.36% : 0.001704s : 1: renormalize.infer 0.52% : 0.000654s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 88.50% : 0.111156s : 1: type_inference TotalTime = 0.24595, [30] [bootstrap]: 0.00053998 [type_inference]: 0.223426 [event_method]: 3.111e-05 [auto_monad]: 9.507e-05 [graph_reusing]: 6.52001e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00115446 [rewriter_before_opt_a]: 0.0001339 [expand_dump_flag]: 5.87001e-06 [jit_opt_a]: 0.0166644, [2] [Cycle 1]: 0.0111815, [27] [switch_simplify]: 9.22e-05 [loop_unroll]: 3.651e-05 [a_1]: 0.00084434 [with_stream_mark]: 2.466e-05 [recompute_prepare]: 1.015e-05 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 8.43999e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 8.52e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 4.55999e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.951e-05 [j_node_and_user_rematch]: 1.157e-05 [meta_fg_expand]: 3.56999e-06 [replace_old_param]: 1.255e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.00969661 [add_forward_monad_depend]: 1.4e-05 [auto_monad_grad]: 3.28998e-06 [auto_monad_eliminator]: 2.752e-05 [cse]: 4.305e-05 [replace_applicator]: 2.928e-05 [Cycle 2]: 0.00053186, [27] [switch_simplify]: 1.009e-05 [loop_unroll]: 9.82999e-06 [a_1]: 0.00020087 [with_stream_mark]: 2.042e-05 [recompute_prepare]: 6.43998e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 7.58001e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 1.139e-05 [meta_shard_fg_expand]: 3.45e-06 [get_grad_eliminate_]: 7.2e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 7.16001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 1.163e-05 [meta_fg_expand]: 5.28002e-06 [replace_old_param]: 1.437e-05 [inline_without_move]: 5.49e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 2.88e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 8.75999e-06 [cse]: 2.068e-05 [replace_applicator]: 7.83001e-06 [py_interpret_to_execute_after_opt_a]: 2.853e-05 [rewriter_after_opt_a]: 5.167e-05 [convert_after_rewriter]: 7.92e-06 [order_py_execute_after_rewriter]: 5.58002e-06 [mutable_eliminate]: 0.00104752 [jit_opt_b]: 0.00019045, [1] [Cycle 1]: 0.00017737, [2] [frontend_op_eliminate]: 0.00013368 [inline_after_opt_a]: 2.481e-05 [cconv]: 3.47e-05 [loop_unroll]: 0.00061831 [jit_opt_after_cconv]: 0.00021469, [1] [Cycle 1]: 0.0002024, [11] [c_1]: 3.154e-05 [parameter_eliminate]: 4.52e-06 [updatestate_depend_eliminate]: 1.018e-05 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.84999e-06 [cse]: 4.509e-05 [call_graph_tuple_transform]: 3.458e-05 [tuple_list_get_item_eliminator]: 7.14001e-06 [none_parameter_eliminate]: 1.78997e-06 [renormalize]: 9.20001e-07 [switch_simplify]: 7.05998e-06 [remove_dup_value]: 1.956e-05 [partial_unused_args_eliminate]: 2.48998e-06 [environ_conv]: 1.213e-05 [add_recomputation]: 5.541e-05 [cse_after_recomputation]: 2.882e-05, [1] [Cycle 1]: 2.283e-05, [1] [cse]: 1.584e-05 [auto_monad_reorder]: 2.502e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 9.66003e-06 [opt_after_jit_grad]: 0.0007531 [symbol_engine_optimizer]: 0.00043368, [1] [Cycle 1]: 0.00042467, [6] [build]: 5.64e-06 [elim_shapecalc]: 1.017e-05 [elim_not_effective]: 1.967e-05 [opt_reshape]: 0.00033764 [fold_const_symbol]: 1.326e-05 [renormalize]: 9.09989e-07 [validate]: 7.039e-05 Sums bootstrap : 0.000540s : 0.22% type_inference : 0.223426s : 93.03% event_method : 0.000031s : 0.01% auto_monad : 0.000095s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001154s : 0.48% rewriter_before_opt_a : 0.000134s : 0.06% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000102s : 0.04% jit_opt_a.loop_unroll : 0.000046s : 0.02% jit_opt_a.a_1 : 0.001045s : 0.44% jit_opt_a.with_stream_mark : 0.000045s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000020s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000009s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.01% jit_opt_a.meta_fg_expand : 0.000009s : 0.00% jit_opt_a.replace_old_param : 0.000027s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.009697s : 4.04% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000036s : 0.02% jit_opt_a.cse : 0.000064s : 0.03% jit_opt_a.replace_applicator : 0.000037s : 0.02% py_interpret_to_execute_after_opt_a : 0.000029s : 0.01% rewriter_after_opt_a : 0.000052s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001048s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000134s : 0.06% jit_opt_b.inline_after_opt_a : 0.000025s : 0.01% cconv : 0.000035s : 0.01% loop_unroll : 0.000618s : 0.26% jit_opt_after_cconv.c_1 : 0.000032s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000045s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000035s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000025s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000753s : 0.31% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000338s : 0.14% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000070s : 0.03% Time group info: ------[substitution.] 0.000358 28 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 1.91% : 0.000007s : 4: substitution.graph_param_transform 82.03% : 0.000293s : 5: substitution.inline 1.69% : 0.000006s : 4: substitution.j_node_and_user_rematch 4.79% : 0.000017s : 3: substitution.reduce_eliminate 1.92% : 0.000007s : 4: substitution.remove_not_recompute_node 2.52% : 0.000009s : 2: substitution.replace_old_param 3.99% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.223270 2 95.38% : 0.212943s : 1: type_inference.infer 4.62% : 0.010326s : 1: type_inference.specialize ------[replace.] 0.000139 7 66.60% : 0.000093s : 5: replace.inline 33.40% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000303 7 95.68% : 0.000290s : 5: match.inline 4.32% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000182 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000002s : 13: predicate.addn_check_dump 1.70% : 0.000003s : 13: predicate.addn_zero_filter 2.11% : 0.000004s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 13: predicate.compare_switch_simplify 1.52% : 0.000003s : 13: predicate.depend_value_elim 1.26% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.33% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 4.67% : 0.000008s : 28: predicate.inline 0.72% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.57% : 0.000005s : 8: predicate.less_batch_normalization 1.82% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 1.53% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.34% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.85% : 0.000002s : 13: predicate.merge_addn 0.84% : 0.000002s : 13: predicate.minmaximum_grad 1.84% : 0.000003s : 4: predicate.mutable_eliminate 0.98% : 0.000002s : 4: predicate.opt_reshape 1.75% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 2.44% : 0.000004s : 13: predicate.reduce_eliminate 1.63% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.63% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000001s : 4: predicate.reset_defer_inline 1.66% : 0.000003s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.91% : 0.000002s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000002s : 8: predicate.special_op_eliminate 0.73% : 0.000001s : 8: predicate.specialize_transform 1.77% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.32% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000004s : 20: predicate.switch_defer_inline 1.87% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.84% : 0.000012s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.50% : 0.000003s : 13: predicate.transpose_eliminate 2.03% : 0.000004s : 13: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.82% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.26% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.49% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.92% : 0.000004s : 13: predicate.value_based_eliminate 0.26% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.004426 25 52.54% : 0.002325s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.85% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.61% : 0.002018s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.257515 72 0.02% : 0.000058s : 1: add_recomputation 0.04% : 0.000100s : 1: auto_monad 0.01% : 0.000028s : 1: auto_monad_reorder 0.22% : 0.000567s : 1: bootstrap 0.01% : 0.000037s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.01% : 0.000037s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 6.47% : 0.016671s : 1: jit_opt_a 0.08% : 0.000217s : 1: jit_opt_after_cconv 0.08% : 0.000193s : 1: jit_opt_b 0.24% : 0.000629s : 1: loop_unroll 0.41% : 0.001063s : 1: mutable_eliminate 0.53% : 0.001367s : 26: opt.transform.jit_opt_a 0.03% : 0.000076s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000148s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000377s : 4: opt.transform.symbol_engine_opt 0.30% : 0.000766s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.001169s : 1: py_interpret_to_execute 0.01% : 0.000032s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 2.88% : 0.007405s : 1: renormalize.infer 0.88% : 0.002275s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000055s : 1: rewriter_after_opt_a 0.05% : 0.000141s : 1: rewriter_before_opt_a 0.17% : 0.000438s : 1: symbol_engine_optimizer 86.77% : 0.223458s : 1: type_inference TotalTime = 0.124185, [30] [bootstrap]: 0.00032139 [type_inference]: 0.112219 [event_method]: 2.324e-05 [auto_monad]: 7.56e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00044403 [rewriter_before_opt_a]: 9.063e-05 [expand_dump_flag]: 3.79002e-06 [jit_opt_a]: 0.00839722, [2] [Cycle 1]: 0.00434571, [27] [switch_simplify]: 6.666e-05 [loop_unroll]: 3.161e-05 [a_1]: 0.00060619 [with_stream_mark]: 2.149e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.23001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.81001e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.625e-05 [j_node_and_user_rematch]: 1.069e-05 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00322243 [add_forward_monad_depend]: 9.27001e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 2.155e-05 [cse]: 3.601e-05 [replace_applicator]: 2.277e-05 [Cycle 2]: 0.00041032, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00012846 [with_stream_mark]: 1.499e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.53998e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 2.37001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.924e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 1.027e-05 [inline_without_move]: 5.51e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.77999e-06 [cse]: 1.39e-05 [replace_applicator]: 6.45997e-06 [py_interpret_to_execute_after_opt_a]: 1.421e-05 [rewriter_after_opt_a]: 3.983e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.00075422 [jit_opt_b]: 5.861e-05, [1] [Cycle 1]: 5.014e-05, [2] [frontend_op_eliminate]: 2.136e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 2.929e-05 [loop_unroll]: 0.0004838 [jit_opt_after_cconv]: 0.00017195, [1] [Cycle 1]: 0.00016494, [11] [c_1]: 2.718e-05 [parameter_eliminate]: 2.93998e-06 [updatestate_depend_eliminate]: 7.63001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 2.955e-05 [call_graph_tuple_transform]: 2.415e-05 [tuple_list_get_item_eliminator]: 6.69001e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 1.674e-05 [partial_unused_args_eliminate]: 5.27999e-06 [environ_conv]: 9.19e-06 [add_recomputation]: 0.00012528 [cse_after_recomputation]: 2.819e-05, [1] [Cycle 1]: 2.133e-05, [1] [cse]: 1.447e-05 [auto_monad_reorder]: 1.904e-05 [get_jit_bprop_graph]: 2.53003e-06 [rewriter_after_jit_bprop_graph]: 7.15998e-06 [opt_after_jit_grad]: 0.00048442 [symbol_engine_optimizer]: 7.8e-05, [1] [Cycle 1]: 7.163e-05, [6] [build]: 4.12003e-06 [elim_shapecalc]: 8.85999e-06 [elim_not_effective]: 1.43e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 9.87999e-06 [renormalize]: 5.19998e-07 [validate]: 5.126e-05 Sums bootstrap : 0.000321s : 0.27% type_inference : 0.112219s : 93.62% event_method : 0.000023s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000444s : 0.37% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000735s : 0.61% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003223s : 2.69% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000754s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000484s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000005s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000125s : 0.10% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000484s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000236 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 3.68% : 0.000009s : 4: substitution.graph_param_transform 81.77% : 0.000193s : 4: substitution.inline 1.88% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000006s : 4: substitution.remove_not_recompute_node 3.06% : 0.000007s : 2: substitution.replace_old_param 5.43% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112124 2 97.63% : 0.109464s : 1: type_inference.infer 2.37% : 0.002660s : 1: type_inference.specialize ------[replace.] 0.000076 6 68.68% : 0.000052s : 4: replace.inline 31.32% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 6 94.22% : 0.000191s : 4: match.inline 5.78% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.38% : 0.000002s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.11% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.59% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.94% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.75% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.32% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.02% : 0.000010s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002288 22 66.68% : 0.001526s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.69% : 0.000725s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128464 72 0.10% : 0.000129s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.27% : 0.000345s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.54% : 0.008400s : 1: jit_opt_a 0.14% : 0.000175s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.38% : 0.000493s : 1: loop_unroll 0.59% : 0.000763s : 1: mutable_eliminate 0.77% : 0.000995s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000453s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.86% : 0.002390s : 1: renormalize.infer 0.64% : 0.000820s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 87.38% : 0.112247s : 1: type_inference TotalTime = 0.224877, [30] [bootstrap]: 0.00046005 [type_inference]: 0.205608 [event_method]: 2.82e-05 [auto_monad]: 9.12e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00115522 [rewriter_before_opt_a]: 0.00013881 [expand_dump_flag]: 5.44e-06 [jit_opt_a]: 0.0140918, [2] [Cycle 1]: 0.00836458, [27] [switch_simplify]: 0.00010932 [loop_unroll]: 3.709e-05 [a_1]: 0.00092453 [with_stream_mark]: 2.633e-05 [recompute_prepare]: 1.169e-05 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 3.88999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.72001e-06 [specialize_transform]: 8.67e-06 [updatestate_useless_node_eliminater]: 6.28998e-06 [accelerated_algorithm]: 8.05e-06 [meta_shard_fg_expand]: 3.2e-06 [get_grad_eliminate_]: 7.36999e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.925e-05 [j_node_and_user_rematch]: 1.261e-05 [meta_fg_expand]: 3.52002e-06 [replace_old_param]: 1.194e-05 [inline_without_move]: 6.97002e-06 [renormalize]: 0.0068083 [add_forward_monad_depend]: 8.75999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 2.008e-05 [cse]: 3.909e-05 [replace_applicator]: 2.494e-05 [Cycle 2]: 0.00046162, [27] [switch_simplify]: 7.50998e-06 [loop_unroll]: 7.01999e-06 [a_1]: 0.00016038 [with_stream_mark]: 1.759e-05 [recompute_prepare]: 7.08e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 6.74999e-06 [merge_forward]: 4.25999e-06 [cell_reuse_recompute_pass]: 4.87998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.695e-05 [j_node_and_user_rematch]: 1.156e-05 [meta_fg_expand]: 3.65e-06 [replace_old_param]: 1.156e-05 [inline_without_move]: 7.08e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.87999e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 8.18001e-06 [cse]: 1.895e-05 [replace_applicator]: 6.86001e-06 [py_interpret_to_execute_after_opt_a]: 1.998e-05 [rewriter_after_opt_a]: 4.237e-05 [convert_after_rewriter]: 7.55003e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.000935 [jit_opt_b]: 0.00010433, [1] [Cycle 1]: 9.326e-05, [2] [frontend_op_eliminate]: 2.412e-05 [inline_after_opt_a]: 2.148e-05 [cconv]: 3.616e-05 [loop_unroll]: 0.00060101 [jit_opt_after_cconv]: 0.00019623, [1] [Cycle 1]: 0.00018838, [11] [c_1]: 2.976e-05 [parameter_eliminate]: 3.63999e-06 [updatestate_depend_eliminate]: 7.98999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 4.055e-05 [call_graph_tuple_transform]: 2.784e-05 [tuple_list_get_item_eliminator]: 7.83999e-06 [none_parameter_eliminate]: 2.17001e-06 [renormalize]: 8.10018e-07 [switch_simplify]: 7.80998e-06 [remove_dup_value]: 2.213e-05 [partial_unused_args_eliminate]: 3.83001e-06 [environ_conv]: 9.97999e-06 [add_recomputation]: 5.92e-05 [cse_after_recomputation]: 2.791e-05, [1] [Cycle 1]: 2.19e-05, [1] [cse]: 1.502e-05 [auto_monad_reorder]: 1.965e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 9.18002e-06 [opt_after_jit_grad]: 0.0005733 [symbol_engine_optimizer]: 9.479e-05, [1] [Cycle 1]: 8.484e-05, [6] [build]: 5.55001e-06 [elim_shapecalc]: 1.041e-05 [elim_not_effective]: 1.825e-05 [opt_reshape]: 8.67e-06 [fold_const_symbol]: 9.69e-06 [renormalize]: 4.70027e-07 [validate]: 0.00026879 Sums bootstrap : 0.000460s : 0.21% type_inference : 0.205608s : 93.96% event_method : 0.000028s : 0.01% auto_monad : 0.000091s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001155s : 0.53% rewriter_before_opt_a : 0.000139s : 0.06% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000117s : 0.05% jit_opt_a.loop_unroll : 0.000044s : 0.02% jit_opt_a.a_1 : 0.001085s : 0.50% jit_opt_a.with_stream_mark : 0.000044s : 0.02% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000024s : 0.01% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.006808s : 3.11% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.01% jit_opt_a.cse : 0.000058s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000042s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000935s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000021s : 0.01% cconv : 0.000036s : 0.02% loop_unroll : 0.000601s : 0.27% jit_opt_after_cconv.c_1 : 0.000030s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000041s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000022s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000059s : 0.03% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000020s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.00% opt_after_jit_grad : 0.000573s : 0.26% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000269s : 0.12% Time group info: ------[substitution.] 0.000383 28 0.73% : 0.000003s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000009s : 4: substitution.graph_param_transform 83.04% : 0.000318s : 5: substitution.inline 1.25% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.40% : 0.000017s : 3: substitution.reduce_eliminate 1.82% : 0.000007s : 4: substitution.remove_not_recompute_node 1.89% : 0.000007s : 2: substitution.replace_old_param 4.01% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.205451 2 97.32% : 0.199939s : 1: type_inference.infer 2.68% : 0.005512s : 1: type_inference.specialize ------[replace.] 0.000150 7 65.72% : 0.000098s : 5: replace.inline 34.28% : 0.000051s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000329 7 95.81% : 0.000315s : 5: match.inline 4.19% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 886 1.62% : 0.000003s : 13: predicate.accumulaten_eliminater 0.96% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000002s : 13: predicate.addn_check_dump 1.76% : 0.000003s : 13: predicate.addn_zero_filter 2.27% : 0.000004s : 13: predicate.arithmetic_simplify 1.64% : 0.000003s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.25% : 0.000002s : 13: predicate.compare_switch_simplify 1.40% : 0.000003s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.38% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.87% : 0.000002s : 13: predicate.environ_get_depend_swap 1.81% : 0.000003s : 13: predicate.environ_get_eliminate 1.36% : 0.000003s : 13: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.22% : 0.000000s : 4: predicate.graph_param_transform 4.67% : 0.000009s : 28: predicate.inline 0.67% : 0.000001s : 8: predicate.inline_without_move 0.32% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000003s : 8: predicate.less_batch_normalization 1.91% : 0.000004s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000008s : 40: predicate.loop_unroll_before_grad 2.42% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 0.86% : 0.000002s : 13: predicate.merge_addn 1.20% : 0.000002s : 13: predicate.minmaximum_grad 1.88% : 0.000003s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 1.69% : 0.000003s : 19: predicate.partial_eliminate 1.63% : 0.000003s : 13: predicate.print_const_string_wrapper 2.19% : 0.000004s : 13: predicate.reduce_eliminate 1.47% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000002s : 8: predicate.remove_not_recompute_node 1.66% : 0.000003s : 23: predicate.replace_applicator 0.55% : 0.000001s : 8: predicate.replace_old_param 0.27% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 8: predicate.special_op_eliminate 0.70% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000005s : 20: predicate.switch_defer_inline 2.00% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.53% : 0.000014s : 64: predicate.switch_simplify 1.79% : 0.000003s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.10% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.70% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 3.54% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.79% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.93% : 0.000004s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.39% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 13: predicate.value_based_eliminate 0.27% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003781 25 58.37% : 0.002207s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.32% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.31% : 0.001486s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.232957 72 0.03% : 0.000063s : 1: add_recomputation 0.04% : 0.000095s : 1: auto_monad 0.01% : 0.000022s : 1: auto_monad_reorder 0.21% : 0.000485s : 1: bootstrap 0.02% : 0.000039s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 6.05% : 0.014097s : 1: jit_opt_a 0.09% : 0.000199s : 1: jit_opt_after_cconv 0.05% : 0.000107s : 1: jit_opt_b 0.26% : 0.000612s : 1: loop_unroll 0.41% : 0.000947s : 1: mutable_eliminate 0.61% : 0.001411s : 26: opt.transform.jit_opt_a 0.03% : 0.000070s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.01% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000584s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.001173s : 1: py_interpret_to_execute 0.01% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000024s : 1: remove_dup_value 2.24% : 0.005225s : 1: renormalize.infer 0.67% : 0.001569s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.06% : 0.000145s : 1: rewriter_before_opt_a 0.04% : 0.000097s : 1: symbol_engine_optimizer 88.27% : 0.205636s : 1: type_inference TotalTime = 0.0634053, [30] [bootstrap]: 0.00030561 [type_inference]: 0.0530443 [event_method]: 2.127e-05 [auto_monad]: 7.11e-05 [graph_reusing]: 6.92002e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00026189 [rewriter_before_opt_a]: 8.767e-05 [expand_dump_flag]: 3.32002e-06 [jit_opt_a]: 0.00717102, [2] [Cycle 1]: 0.00307314, [27] [switch_simplify]: 6.3e-05 [loop_unroll]: 3.271e-05 [a_1]: 0.00064331 [with_stream_mark]: 2.412e-05 [recompute_prepare]: 8.75999e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.88e-06 [merge_forward]: 4.39002e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 1.1e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00193698 [add_forward_monad_depend]: 6.89001e-06 [auto_monad_grad]: 2.84001e-06 [auto_monad_eliminator]: 2.004e-05 [cse]: 3.241e-05 [replace_applicator]: 1.685e-05 [Cycle 2]: 0.00039597, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 7.74002e-06 [a_1]: 0.00014111 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 6.33002e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 2.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.606e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 8.41002e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.165e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.285e-05 [rewriter_after_opt_a]: 3.705e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 5.71e-06 [mutable_eliminate]: 0.00076184 [jit_opt_b]: 5.737e-05, [1] [Cycle 1]: 4.98e-05, [2] [frontend_op_eliminate]: 1.941e-05 [inline_after_opt_a]: 1.904e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.0004399 [jit_opt_after_cconv]: 0.00015751, [1] [Cycle 1]: 0.00015083, [11] [c_1]: 2.913e-05 [parameter_eliminate]: 3.01001e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 2.167e-05 [call_graph_tuple_transform]: 2.168e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.84999e-06 [remove_dup_value]: 1.585e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 8.69e-06 [add_recomputation]: 5.333e-05 [cse_after_recomputation]: 2.352e-05, [1] [Cycle 1]: 1.789e-05, [1] [cse]: 1.157e-05 [auto_monad_reorder]: 1.739e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.07e-06 [opt_after_jit_grad]: 0.00046352 [symbol_engine_optimizer]: 7.698e-05, [1] [Cycle 1]: 7.095e-05, [6] [build]: 4.31002e-06 [elim_shapecalc]: 8.93002e-06 [elim_not_effective]: 1.37e-05 [opt_reshape]: 6.68003e-06 [fold_const_symbol]: 9.65002e-06 [renormalize]: 3.89991e-07 [validate]: 4.25e-05 Sums bootstrap : 0.000306s : 0.52% type_inference : 0.053044s : 89.81% event_method : 0.000021s : 0.04% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000262s : 0.44% rewriter_before_opt_a : 0.000088s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.12% jit_opt_a.loop_unroll : 0.000040s : 0.07% jit_opt_a.a_1 : 0.000784s : 1.33% jit_opt_a.with_stream_mark : 0.000035s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001937s : 3.28% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000044s : 0.07% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000762s : 1.29% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000440s : 0.74% jit_opt_after_cconv.c_1 : 0.000029s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000464s : 0.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000260 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000006s : 4: substitution.graph_param_transform 85.42% : 0.000222s : 4: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 5.22% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052951 2 96.43% : 0.051063s : 1: type_inference.infer 3.57% : 0.001888s : 1: type_inference.specialize ------[replace.] 0.000078 6 66.57% : 0.000052s : 4: replace.inline 33.43% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000232 6 94.63% : 0.000220s : 4: match.inline 5.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.50% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.61% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.38% : 0.000002s : 12: predicate.depend_value_elim 1.02% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.56% : 0.000008s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.69% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.10% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.85% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.65% : 0.000004s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002045 22 70.43% : 0.001440s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.98% : 0.000552s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066438 72 0.09% : 0.000057s : 1: add_recomputation 0.11% : 0.000075s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.49% : 0.000327s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.80% : 0.007174s : 1: jit_opt_a 0.24% : 0.000160s : 1: jit_opt_after_cconv 0.09% : 0.000060s : 1: jit_opt_b 0.67% : 0.000448s : 1: loop_unroll 1.16% : 0.000773s : 1: mutable_eliminate 1.56% : 0.001036s : 26: opt.transform.jit_opt_a 0.09% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000268s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.93% : 0.001285s : 1: renormalize.infer 0.97% : 0.000642s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.14% : 0.000093s : 1: rewriter_before_opt_a 0.12% : 0.000079s : 1: symbol_engine_optimizer 79.88% : 0.053069s : 1: type_inference TotalTime = 0.0244467, [30] [bootstrap]: 0.00041461 [type_inference]: 0.0113557 [event_method]: 2.848e-05 [auto_monad]: 8.14e-05 [graph_reusing]: 6.94999e-06 [pre_auto_parallel]: 3.28e-06 [py_interpret_to_execute]: 9.861e-05 [rewriter_before_opt_a]: 0.00010133 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.00901007, [2] [Cycle 1]: 0.00350693, [27] [switch_simplify]: 7.43e-05 [loop_unroll]: 3.546e-05 [a_1]: 0.0008556 [with_stream_mark]: 2.578e-05 [recompute_prepare]: 1.344e-05 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.73e-06 [specialize_transform]: 9.61e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 9.02e-06 [meta_shard_fg_expand]: 2.83e-06 [get_grad_eliminate_]: 7.63999e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.88e-05 [j_node_and_user_rematch]: 1.365e-05 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.269e-05 [inline_without_move]: 7.7e-06 [renormalize]: 0.00203094 [add_forward_monad_depend]: 1.13e-05 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 2.262e-05 [cse]: 4.186e-05 [replace_applicator]: 2.81e-05 [Cycle 2]: 0.00042419, [27] [switch_simplify]: 7.21001e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.0001319 [with_stream_mark]: 1.742e-05 [recompute_prepare]: 6.78998e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 7.56001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 4.72998e-06 [cell_reuse_recompute_pass]: 3.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.749e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 3.36001e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 5.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.06e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 7.64002e-06 [cse]: 1.669e-05 [replace_applicator]: 5.58002e-06 [py_interpret_to_execute_after_opt_a]: 2.082e-05 [rewriter_after_opt_a]: 4.703e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.61003e-06 [mutable_eliminate]: 0.001031 [jit_opt_b]: 6.75e-05, [1] [Cycle 1]: 5.595e-05, [2] [frontend_op_eliminate]: 2.215e-05 [inline_after_opt_a]: 1.916e-05 [cconv]: 4.116e-05 [loop_unroll]: 0.00061113 [jit_opt_after_cconv]: 0.00025769, [1] [Cycle 1]: 0.00024716, [11] [c_1]: 2.801e-05 [parameter_eliminate]: 5.77001e-06 [updatestate_depend_eliminate]: 9.12999e-06 [updatestate_assign_eliminate]: 4.67e-06 [updatestate_loads_eliminate]: 4.12e-06 [cse]: 4.933e-05 [call_graph_tuple_transform]: 2.853e-05 [tuple_list_get_item_eliminator]: 6.16998e-06 [none_parameter_eliminate]: 2.10002e-06 [renormalize]: 1.03001e-06 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 2.098e-05 [partial_unused_args_eliminate]: 2.92002e-06 [environ_conv]: 9.58002e-06 [add_recomputation]: 6.688e-05 [cse_after_recomputation]: 2.88e-05, [1] [Cycle 1]: 2.122e-05, [1] [cse]: 1.381e-05 [auto_monad_reorder]: 2.054e-05 [get_jit_bprop_graph]: 2.68e-06 [rewriter_after_jit_bprop_graph]: 9.39998e-06 [opt_after_jit_grad]: 0.00069973 [symbol_engine_optimizer]: 9.154e-05, [1] [Cycle 1]: 8.412e-05, [6] [build]: 5.46002e-06 [elim_shapecalc]: 9.82001e-06 [elim_not_effective]: 1.807e-05 [opt_reshape]: 7.31001e-06 [fold_const_symbol]: 1.078e-05 [renormalize]: 9.29984e-07 [validate]: 5.178e-05 Sums bootstrap : 0.000415s : 2.24% type_inference : 0.011356s : 61.24% event_method : 0.000028s : 0.15% auto_monad : 0.000081s : 0.44% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000099s : 0.53% rewriter_before_opt_a : 0.000101s : 0.55% expand_dump_flag : 0.000004s : 0.02% jit_opt_a.switch_simplify : 0.000082s : 0.44% jit_opt_a.loop_unroll : 0.000042s : 0.23% jit_opt_a.a_1 : 0.000988s : 5.33% jit_opt_a.with_stream_mark : 0.000043s : 0.23% jit_opt_a.recompute_prepare : 0.000020s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000005s : 0.03% jit_opt_a.specialize_transform : 0.000016s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000017s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.07% jit_opt_a.merge_forward : 0.000009s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.12% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000022s : 0.12% jit_opt_a.inline_without_move : 0.000014s : 0.07% jit_opt_a.renormalize : 0.002031s : 10.95% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.16% jit_opt_a.cse : 0.000059s : 0.32% jit_opt_a.replace_applicator : 0.000034s : 0.18% py_interpret_to_execute_after_opt_a : 0.000021s : 0.11% rewriter_after_opt_a : 0.000047s : 0.25% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.001031s : 5.56% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.10% cconv : 0.000041s : 0.22% loop_unroll : 0.000611s : 3.30% jit_opt_after_cconv.c_1 : 0.000028s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.cse : 0.000049s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000021s : 0.11% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000010s : 0.05% add_recomputation : 0.000067s : 0.36% cse_after_recomputation.cse : 0.000014s : 0.07% auto_monad_reorder : 0.000021s : 0.11% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000009s : 0.05% opt_after_jit_grad : 0.000700s : 3.77% symbol_engine_optimizer.build : 0.000005s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000052s : 0.28% Time group info: ------[substitution.] 0.000345 27 0.77% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 2.18% : 0.000008s : 3: substitution.graph_param_transform 82.72% : 0.000285s : 5: substitution.inline 1.53% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.66% : 0.000016s : 3: substitution.reduce_eliminate 2.06% : 0.000007s : 4: substitution.remove_not_recompute_node 1.89% : 0.000007s : 2: substitution.replace_old_param 3.63% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.011233 2 86.63% : 0.009731s : 1: type_inference.infer 13.37% : 0.001501s : 1: type_inference.specialize ------[replace.] 0.000129 7 65.18% : 0.000084s : 5: replace.inline 34.82% : 0.000045s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 7 96.08% : 0.000282s : 5: match.inline 3.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 747 1.39% : 0.000002s : 11: predicate.accumulaten_eliminater 1.19% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.88% : 0.000001s : 11: predicate.addn_check_dump 1.95% : 0.000003s : 11: predicate.addn_zero_filter 2.58% : 0.000004s : 11: predicate.arithmetic_simplify 1.31% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 0.92% : 0.000002s : 11: predicate.compare_switch_simplify 1.21% : 0.000002s : 11: predicate.depend_value_elim 1.20% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.01% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.81% : 0.000003s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.07% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 11: predicate.environ_get_depend_swap 1.17% : 0.000002s : 11: predicate.environ_get_eliminate 0.88% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 1.27% : 0.000002s : 6: predicate.get_grad_eliminate 0.17% : 0.000000s : 3: predicate.graph_param_transform 5.29% : 0.000009s : 24: predicate.inline 0.59% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 2.12% : 0.000004s : 6: predicate.less_batch_normalization 1.81% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 1.36% : 0.000002s : 16: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.32% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.61% : 0.000004s : 14: predicate.make_slice_get_slice_eliminator 0.96% : 0.000002s : 11: predicate.merge_addn 1.57% : 0.000003s : 11: predicate.minmaximum_grad 2.49% : 0.000004s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 1.72% : 0.000003s : 16: predicate.partial_eliminate 1.75% : 0.000003s : 11: predicate.print_const_string_wrapper 2.50% : 0.000004s : 11: predicate.reduce_eliminate 1.64% : 0.000003s : 13: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000003s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000001s : 3: predicate.reset_defer_inline 1.47% : 0.000002s : 11: predicate.reshape_eliminate 1.45% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.09% : 0.000002s : 3: predicate.row_tensor_eliminate 1.09% : 0.000002s : 11: predicate.same_eliminate 0.70% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.15% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.31% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000005s : 18: predicate.switch_defer_inline 1.76% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.65% : 0.000011s : 59: predicate.switch_simplify 1.12% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000006s : 19: predicate.tuple_list_get_item_eliminator 1.93% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.10% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.38% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.34% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 11: predicate.value_based_eliminate 0.24% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001192 16 44.85% : 0.000534s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.62% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 47.54% : 0.000566s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.027826 72 0.25% : 0.000071s : 1: add_recomputation 0.31% : 0.000086s : 1: auto_monad 0.08% : 0.000023s : 1: auto_monad_reorder 1.57% : 0.000438s : 1: bootstrap 0.16% : 0.000045s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.11% : 0.000031s : 1: cse_after_recomputation 0.04% : 0.000012s : 1: environ_conv 0.12% : 0.000034s : 1: event_method 0.03% : 0.000009s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 32.40% : 0.009015s : 1: jit_opt_a 0.94% : 0.000262s : 1: jit_opt_after_cconv 0.26% : 0.000072s : 1: jit_opt_b 2.24% : 0.000624s : 1: loop_unroll 3.77% : 0.001048s : 1: mutable_eliminate 4.59% : 0.001277s : 26: opt.transform.jit_opt_a 0.23% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000034s : 4: opt.transform.jit_opt_b 0.07% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000027s : 1: opt.transform.mutable_eliminate 0.12% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000042s : 4: opt.transform.symbol_engine_opt 2.56% : 0.000713s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000102s : 1: py_interpret_to_execute 0.08% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000024s : 1: remove_dup_value 4.93% : 0.001373s : 1: renormalize.infer 2.30% : 0.000640s : 1: renormalize.specialize 0.04% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000051s : 1: rewriter_after_opt_a 0.38% : 0.000106s : 1: rewriter_before_opt_a 0.34% : 0.000095s : 1: symbol_engine_optimizer 40.90% : 0.011381s : 1: type_inference . TotalTime = 0.307204, [30] [bootstrap]: 0.00039921 [type_inference]: 0.265672 [event_method]: 2.348e-05 [auto_monad]: 7.421e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 3.67998e-06 [py_interpret_to_execute]: 0.00060216 [rewriter_before_opt_a]: 9.846e-05 [expand_dump_flag]: 4.18001e-06 [jit_opt_a]: 0.0377778, [2] [Cycle 1]: 0.0339091, [27] [switch_simplify]: 6.027e-05 [loop_unroll]: 3.538e-05 [a_1]: 0.0285767 [with_stream_mark]: 3.095e-05 [recompute_prepare]: 1.49e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 2.79001e-06 [specialize_transform]: 8.37e-06 [updatestate_useless_node_eliminater]: 6.64999e-06 [accelerated_algorithm]: 8.42998e-06 [meta_shard_fg_expand]: 4.82998e-06 [get_grad_eliminate_]: 8.40001e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.81003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 1.268e-05 [meta_fg_expand]: 3.97e-06 [replace_old_param]: 1.371e-05 [inline_without_move]: 7.08e-06 [renormalize]: 0.00476748 [add_forward_monad_depend]: 7.18998e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.858e-05 [cse]: 3.707e-05 [replace_applicator]: 1.8e-05 [Cycle 2]: 0.00037775, [27] [switch_simplify]: 7.53999e-06 [loop_unroll]: 6.87002e-06 [a_1]: 0.00013125 [with_stream_mark]: 1.23e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.38999e-06 [cell_reuse_recompute_pass]: 2.71e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.45999e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.54998e-06 [cse]: 1.293e-05 [replace_applicator]: 5.99999e-06 [py_interpret_to_execute_after_opt_a]: 1.411e-05 [rewriter_after_opt_a]: 4.069e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.06002e-06 [mutable_eliminate]: 0.00083391 [jit_opt_b]: 5.891e-05, [1] [Cycle 1]: 5.072e-05, [2] [frontend_op_eliminate]: 2.054e-05 [inline_after_opt_a]: 1.894e-05 [cconv]: 2.776e-05 [loop_unroll]: 0.0004088 [jit_opt_after_cconv]: 0.00018365, [1] [Cycle 1]: 0.00017681, [11] [c_1]: 5.331e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.104e-05 [call_graph_tuple_transform]: 2.116e-05 [tuple_list_get_item_eliminator]: 6.40002e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.73e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 8.03001e-06 [add_recomputation]: 5.444e-05 [cse_after_recomputation]: 2.341e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.712e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.3e-06 [opt_after_jit_grad]: 0.00045292 [symbol_engine_optimizer]: 7.947e-05, [1] [Cycle 1]: 7.226e-05, [6] [build]: 4.06001e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.376e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 6.39993e-07 [validate]: 9.353e-05 Sums bootstrap : 0.000399s : 0.13% type_inference : 0.265672s : 87.67% event_method : 0.000023s : 0.01% auto_monad : 0.000074s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000004s : 0.00% py_interpret_to_execute : 0.000602s : 0.20% rewriter_before_opt_a : 0.000098s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.028708s : 9.47% jit_opt_a.with_stream_mark : 0.000043s : 0.01% jit_opt_a.recompute_prepare : 0.000021s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000006s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004768s : 1.57% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000024s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000834s : 0.28% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000409s : 0.13% jit_opt_after_cconv.c_1 : 0.000053s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000453s : 0.15% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000094s : 0.03% Time group info: ------[substitution.] 0.000436 28 0.44% : 0.000002s : 2: substitution.elim_not_effective 0.28% : 0.000001s : 2: substitution.fold_const_symbol 1.51% : 0.000007s : 4: substitution.graph_param_transform 85.88% : 0.000374s : 5: substitution.inline 1.08% : 0.000005s : 4: substitution.j_node_and_user_rematch 3.49% : 0.000015s : 3: substitution.reduce_eliminate 1.41% : 0.000006s : 4: substitution.remove_not_recompute_node 1.48% : 0.000006s : 2: substitution.replace_old_param 4.43% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.265581 2 98.30% : 0.261070s : 1: type_inference.infer 1.70% : 0.004511s : 1: type_inference.specialize ------[replace.] 0.000209 7 61.59% : 0.000128s : 5: replace.inline 38.41% : 0.000080s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000388 7 95.47% : 0.000370s : 5: match.inline 4.53% : 0.000018s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000212 886 1.49% : 0.000003s : 13: predicate.accumulaten_eliminater 0.59% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.87% : 0.000002s : 13: predicate.addn_check_dump 1.16% : 0.000002s : 13: predicate.addn_zero_filter 2.46% : 0.000005s : 13: predicate.arithmetic_simplify 1.21% : 0.000003s : 13: predicate.cast_eliminate 0.33% : 0.000001s : 4: predicate.check_bprop_eliminate 0.82% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 0.88% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000003s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.57% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000001s : 4: predicate.elim_not_effective 0.35% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.82% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000003s : 13: predicate.environ_get_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.20% : 0.000000s : 4: predicate.graph_param_transform 5.20% : 0.000011s : 28: predicate.inline 0.64% : 0.000001s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000002s : 8: predicate.less_batch_normalization 1.17% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 13.00% : 0.000028s : 19: predicate.load_eliminater 0.74% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.82% : 0.000006s : 40: predicate.loop_unroll_before_grad 5.31% : 0.000011s : 17: predicate.make_slice_get_slice_eliminator 0.85% : 0.000002s : 13: predicate.merge_addn 0.84% : 0.000002s : 13: predicate.minmaximum_grad 0.87% : 0.000002s : 4: predicate.mutable_eliminate 0.30% : 0.000001s : 4: predicate.opt_reshape 1.69% : 0.000004s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.28% : 0.000005s : 13: predicate.reduce_eliminate 1.18% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 8: predicate.remove_not_recompute_node 1.42% : 0.000003s : 23: predicate.replace_applicator 0.49% : 0.000001s : 8: predicate.replace_old_param 0.27% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000003s : 13: predicate.reshape_eliminate 1.29% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000003s : 13: predicate.same_eliminate 0.48% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.80% : 0.000002s : 8: predicate.special_op_eliminate 0.60% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000003s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.44% : 0.000007s : 20: predicate.switch_defer_inline 1.88% : 0.000004s : 20: predicate.switch_layer_defer_inline 5.09% : 0.000011s : 64: predicate.switch_simplify 1.47% : 0.000003s : 13: predicate.tile_eliminate 1.08% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.90% : 0.000004s : 13: predicate.tuple_list_get_item_depend_reorder 2.88% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.32% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.17% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.19% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.41% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.41% : 0.000003s : 13: predicate.value_based_eliminate 0.25% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.49% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003226 25 59.76% : 0.001928s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.93% : 0.000159s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.31% : 0.001139s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.340976 72 0.02% : 0.000057s : 1: add_recomputation 0.02% : 0.000077s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.12% : 0.000420s : 1: bootstrap 0.01% : 0.000030s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 11.08% : 0.037782s : 1: jit_opt_a 0.05% : 0.000187s : 1: jit_opt_after_cconv 0.02% : 0.000061s : 1: jit_opt_b 0.12% : 0.000415s : 1: loop_unroll 0.25% : 0.000842s : 1: mutable_eliminate 8.50% : 0.028969s : 26: opt.transform.jit_opt_a 0.02% : 0.000083s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000475s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000006s : 1: pre_auto_parallel 0.18% : 0.000607s : 1: py_interpret_to_execute 0.00% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.05% : 0.003584s : 1: renormalize.infer 0.34% : 0.001172s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000044s : 1: rewriter_after_opt_a 0.03% : 0.000104s : 1: rewriter_before_opt_a 0.02% : 0.000082s : 1: symbol_engine_optimizer 77.92% : 0.265694s : 1: type_inference TotalTime = 0.0249393, [30] [bootstrap]: 0.00029308 [type_inference]: 0.00434495 [event_method]: 1.673e-05 [auto_monad]: 4.278e-05 [graph_reusing]: 3.38e-06 [pre_auto_parallel]: 1.67999e-06 [py_interpret_to_execute]: 3.33e-05 [rewriter_before_opt_a]: 6.296e-05 [expand_dump_flag]: 1.99999e-06 [jit_opt_a]: 0.00544203, [2] [Cycle 1]: 0.00170954, [27] [switch_simplify]: 5.865e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00057133 [with_stream_mark]: 2.122e-05 [recompute_prepare]: 7.31999e-06 [updatestate_depend_eliminate]: 3.80998e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.31001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.13998e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00070039 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.475e-05 [cse]: 3.044e-05 [replace_applicator]: 1.167e-05 [Cycle 2]: 0.00031303, [27] [switch_simplify]: 5.56998e-06 [loop_unroll]: 5.42001e-06 [a_1]: 9.196e-05 [with_stream_mark]: 8.97e-06 [recompute_prepare]: 4.74e-06 [updatestate_depend_eliminate]: 2.54999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.77998e-06 [accelerated_algorithm]: 4.85001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.44999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.202e-05 [j_node_and_user_rematch]: 7.68001e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.02002e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 9.90002e-06 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.186e-05 [rewriter_after_opt_a]: 3.847e-05 [convert_after_rewriter]: 7.46001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00057332 [jit_opt_b]: 4.857e-05, [1] [Cycle 1]: 4.224e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.517e-05 [cconv]: 2.549e-05 [loop_unroll]: 0.0127988 [jit_opt_after_cconv]: 0.00020086, [1] [Cycle 1]: 0.00019007, [11] [c_1]: 2.747e-05 [parameter_eliminate]: 7.43999e-06 [updatestate_depend_eliminate]: 1.292e-05 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.13e-06 [cse]: 4.17e-05 [call_graph_tuple_transform]: 2.578e-05 [tuple_list_get_item_eliminator]: 5.97999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 8.80013e-07 [switch_simplify]: 5.82999e-06 [remove_dup_value]: 1.705e-05 [partial_unused_args_eliminate]: 3.00998e-06 [environ_conv]: 7.45e-06 [add_recomputation]: 5.782e-05 [cse_after_recomputation]: 2.377e-05, [1] [Cycle 1]: 1.784e-05, [1] [cse]: 1.129e-05 [auto_monad_reorder]: 1.67e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 9.86e-06 [opt_after_jit_grad]: 0.00053452 [symbol_engine_optimizer]: 7.797e-05, [1] [Cycle 1]: 7.075e-05, [6] [build]: 4.17998e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.502e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.98002e-06 [renormalize]: 2.69996e-07 [validate]: 4.09e-05 Sums bootstrap : 0.000293s : 1.40% type_inference : 0.004345s : 20.78% event_method : 0.000017s : 0.08% auto_monad : 0.000043s : 0.20% graph_reusing : 0.000003s : 0.02% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000033s : 0.16% rewriter_before_opt_a : 0.000063s : 0.30% expand_dump_flag : 0.000002s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.31% jit_opt_a.loop_unroll : 0.000035s : 0.17% jit_opt_a.a_1 : 0.000663s : 3.17% jit_opt_a.with_stream_mark : 0.000030s : 0.14% jit_opt_a.recompute_prepare : 0.000012s : 0.06% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.05% jit_opt_a.accelerated_algorithm : 0.000010s : 0.05% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000006s : 0.03% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.13% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.08% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000017s : 0.08% jit_opt_a.inline_without_move : 0.000010s : 0.05% jit_opt_a.renormalize : 0.000700s : 3.35% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.10% jit_opt_a.cse : 0.000040s : 0.19% jit_opt_a.replace_applicator : 0.000017s : 0.08% py_interpret_to_execute_after_opt_a : 0.000012s : 0.06% rewriter_after_opt_a : 0.000038s : 0.18% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.02% mutable_eliminate : 0.000573s : 2.74% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.08% jit_opt_b.inline_after_opt_a : 0.000015s : 0.07% cconv : 0.000025s : 0.12% loop_unroll : 0.012799s : 61.20% jit_opt_after_cconv.c_1 : 0.000027s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000042s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000017s : 0.08% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000058s : 0.28% cse_after_recomputation.cse : 0.000011s : 0.05% auto_monad_reorder : 0.000017s : 0.08% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.05% opt_after_jit_grad : 0.000535s : 2.56% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.20% Time group info: ------[substitution.] 0.000240 23 1.06% : 0.000003s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000007s : 3: substitution.graph_param_transform 85.87% : 0.000206s : 4: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 4.84% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004290 2 82.00% : 0.003518s : 1: type_inference.infer 18.00% : 0.000772s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.99% : 0.000048s : 4: replace.inline 32.01% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 95.09% : 0.000204s : 4: match.inline 4.91% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.40% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.05% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 6.65% : 0.000008s : 22: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 3.96% : 0.000005s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.19% : 0.000001s : 10: predicate.minmaximum_grad 1.50% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.33% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.45% : 0.000001s : 6: predicate.remove_not_recompute_node 1.57% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 1.91% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.45% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.09% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000613 13 51.11% : 0.000313s : 6: func_graph_cloner_run.FuncGraphClonerGraph 8.64% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.25% : 0.000247s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.026600 72 0.23% : 0.000062s : 1: add_recomputation 0.17% : 0.000046s : 1: auto_monad 0.07% : 0.000019s : 1: auto_monad_reorder 1.16% : 0.000309s : 1: bootstrap 0.11% : 0.000028s : 1: cconv 0.04% : 0.000010s : 1: convert_after_rewriter 0.10% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.08% : 0.000020s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000005s : 1: graph_reusing 20.47% : 0.005446s : 1: jit_opt_a 0.77% : 0.000205s : 1: jit_opt_after_cconv 0.19% : 0.000051s : 1: jit_opt_b 48.22% : 0.012827s : 1: loop_unroll 2.19% : 0.000581s : 1: mutable_eliminate 3.29% : 0.000875s : 26: opt.transform.jit_opt_a 0.23% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000025s : 4: opt.transform.jit_opt_b 0.14% : 0.000036s : 1: opt.transform.loop_unroll_optimizer 0.05% : 0.000013s : 1: opt.transform.mutable_eliminate 0.08% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.04% : 0.000543s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000036s : 1: py_interpret_to_execute 0.05% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000020s : 1: remove_dup_value 1.49% : 0.000396s : 1: renormalize.infer 1.12% : 0.000297s : 1: renormalize.specialize 0.04% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.16% : 0.000042s : 1: rewriter_after_opt_a 0.25% : 0.000066s : 1: rewriter_before_opt_a 0.30% : 0.000080s : 1: symbol_engine_optimizer 16.38% : 0.004358s : 1: type_inference TotalTime = 0.0136627, [30] [bootstrap]: 0.00028563 [type_inference]: 0.00522969 [event_method]: 2.023e-05 [auto_monad]: 6.921e-05 [graph_reusing]: 7.1e-06 [pre_auto_parallel]: 2.53998e-06 [py_interpret_to_execute]: 4.511e-05 [rewriter_before_opt_a]: 7.838e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00572613, [2] [Cycle 1]: 0.00191203, [27] [switch_simplify]: 6.472e-05 [loop_unroll]: 3.106e-05 [a_1]: 0.00057679 [with_stream_mark]: 2.186e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.0008748 [add_forward_monad_depend]: 6.18002e-06 [auto_monad_grad]: 2.88e-06 [auto_monad_eliminator]: 1.806e-05 [cse]: 3.305e-05 [replace_applicator]: 1.273e-05 [Cycle 2]: 0.00031391, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 4.72998e-06 [a_1]: 8.875e-05 [with_stream_mark]: 1.063e-05 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 2.49001e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 4.86002e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.46002e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.49998e-06 [merge_forward]: 3.15002e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.383e-05 [j_node_and_user_rematch]: 7.58999e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 4.48999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 5.29e-06 [cse]: 1.038e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.194e-05 [rewriter_after_opt_a]: 3.709e-05 [convert_after_rewriter]: 6.52001e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00060149 [jit_opt_b]: 6.159e-05, [1] [Cycle 1]: 5.366e-05, [2] [frontend_op_eliminate]: 1.664e-05 [inline_after_opt_a]: 2.597e-05 [cconv]: 2.884e-05 [loop_unroll]: 0.00042901 [jit_opt_after_cconv]: 0.00014532, [1] [Cycle 1]: 0.00013865, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 6.84999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.081e-05 [call_graph_tuple_transform]: 1.989e-05 [tuple_list_get_item_eliminator]: 5.77999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 5.50001e-06 [remove_dup_value]: 1.487e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 5.82999e-06 [add_recomputation]: 5.188e-05 [cse_after_recomputation]: 2.092e-05, [1] [Cycle 1]: 1.558e-05, [1] [cse]: 9.89999e-06 [auto_monad_reorder]: 1.643e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 5.12999e-06 [opt_after_jit_grad]: 0.00045839 [symbol_engine_optimizer]: 7.082e-05, [1] [Cycle 1]: 6.481e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 7.63001e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.73002e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 3.39991e-07 [validate]: 3.992e-05 Sums bootstrap : 0.000286s : 2.98% type_inference : 0.005230s : 54.60% event_method : 0.000020s : 0.21% auto_monad : 0.000069s : 0.72% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.47% rewriter_before_opt_a : 0.000078s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000071s : 0.74% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000666s : 6.95% jit_opt_a.with_stream_mark : 0.000032s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000875s : 9.13% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.24% jit_opt_a.cse : 0.000043s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000037s : 0.39% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000601s : 6.28% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000026s : 0.27% cconv : 0.000029s : 0.30% loop_unroll : 0.000429s : 4.48% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000015s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000052s : 0.54% cse_after_recomputation.cse : 0.000010s : 0.10% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000458s : 4.79% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.42% Time group info: ------[substitution.] 0.000245 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 85.65% : 0.000210s : 4: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.09% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005154 2 80.83% : 0.004166s : 1: type_inference.infer 19.17% : 0.000988s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.35% : 0.000050s : 4: replace.inline 31.65% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.76% : 0.000208s : 4: match.inline 5.24% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.83% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.32% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 6.95% : 0.000008s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.48% : 0.000002s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 1.92% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.26% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000726 13 51.43% : 0.000373s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.07% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.50% : 0.000301s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015481 72 0.35% : 0.000054s : 1: add_recomputation 0.47% : 0.000072s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 1.97% : 0.000305s : 1: bootstrap 0.20% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 37.01% : 0.005729s : 1: jit_opt_a 0.96% : 0.000148s : 1: jit_opt_after_cconv 0.41% : 0.000064s : 1: jit_opt_b 2.83% : 0.000438s : 1: loop_unroll 3.94% : 0.000610s : 1: mutable_eliminate 5.71% : 0.000884s : 26: opt.transform.jit_opt_a 0.31% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.23% : 0.000036s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.01% : 0.000467s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 3.03% : 0.000469s : 1: renormalize.infer 2.56% : 0.000397s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000040s : 1: rewriter_after_opt_a 0.53% : 0.000082s : 1: rewriter_before_opt_a 0.47% : 0.000073s : 1: symbol_engine_optimizer 33.90% : 0.005249s : 1: type_inference TotalTime = 0.328298, [30] [bootstrap]: 0.00031981 [type_inference]: 0.315075 [event_method]: 2.866e-05 [auto_monad]: 7.683e-05 [graph_reusing]: 6.59001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.0006316 [rewriter_before_opt_a]: 0.00010574 [expand_dump_flag]: 3.93999e-06 [jit_opt_a]: 0.00971219, [2] [Cycle 1]: 0.00511276, [27] [switch_simplify]: 6.907e-05 [loop_unroll]: 3.457e-05 [a_1]: 0.00072632 [with_stream_mark]: 1.984e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 4.4e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 3.24001e-06 [parameter_eliminate]: 2.54999e-06 [specialize_transform]: 7.43999e-06 [updatestate_useless_node_eliminater]: 6.23998e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 6.75002e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.666e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 7.63001e-06 [replace_old_param]: 1.153e-05 [inline_without_move]: 7.73999e-06 [renormalize]: 0.00389439 [add_forward_monad_depend]: 6.44999e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.838e-05 [cse]: 3.605e-05 [replace_applicator]: 1.644e-05 [Cycle 2]: 0.0003797, [27] [switch_simplify]: 7.5e-06 [loop_unroll]: 6.40997e-06 [a_1]: 0.00012987 [with_stream_mark]: 1.203e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.27997e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 3.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.32e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.311e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.187e-05 [rewriter_after_opt_a]: 4.071e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00060143 [jit_opt_b]: 5.566e-05, [1] [Cycle 1]: 4.842e-05, [2] [frontend_op_eliminate]: 1.898e-05 [inline_after_opt_a]: 1.8e-05 [cconv]: 2.85e-05 [loop_unroll]: 0.00042434 [jit_opt_after_cconv]: 0.000155, [1] [Cycle 1]: 0.00014897, [11] [c_1]: 2.576e-05 [parameter_eliminate]: 2.87002e-06 [updatestate_depend_eliminate]: 6.68998e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 2.215e-05 [call_graph_tuple_transform]: 2.215e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.894e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 8.60999e-06 [add_recomputation]: 5.349e-05 [cse_after_recomputation]: 2.39e-05, [1] [Cycle 1]: 1.819e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.773e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 5.04998e-06 [opt_after_jit_grad]: 0.00045948 [symbol_engine_optimizer]: 7.824e-05, [1] [Cycle 1]: 7.201e-05, [6] [build]: 3.73001e-06 [elim_shapecalc]: 9.16998e-06 [elim_not_effective]: 1.363e-05 [opt_reshape]: 6.53998e-06 [fold_const_symbol]: 1.045e-05 [renormalize]: 2.9002e-07 [validate]: 0.00014335 Sums bootstrap : 0.000320s : 0.10% type_inference : 0.315075s : 97.40% event_method : 0.000029s : 0.01% auto_monad : 0.000077s : 0.02% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000632s : 0.20% rewriter_before_opt_a : 0.000106s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.02% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000856s : 0.26% jit_opt_a.with_stream_mark : 0.000032s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000010s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003894s : 1.20% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.01% jit_opt_a.cse : 0.000049s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000041s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000601s : 0.19% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000424s : 0.13% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000459s : 0.14% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000143s : 0.04% Time group info: ------[substitution.] 0.000286 28 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.02% : 0.000006s : 4: substitution.graph_param_transform 84.41% : 0.000241s : 5: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.69% : 0.000011s : 3: substitution.reduce_eliminate 1.94% : 0.000006s : 4: substitution.remove_not_recompute_node 1.69% : 0.000005s : 2: substitution.replace_old_param 3.89% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.314975 2 87.83% : 0.276627s : 1: type_inference.infer 12.17% : 0.038347s : 1: type_inference.specialize ------[replace.] 0.000102 7 68.09% : 0.000069s : 5: replace.inline 31.91% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 7 95.95% : 0.000238s : 5: match.inline 4.05% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.20% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.36% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.17% : 0.000008s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.91% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.34% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 8.66% : 0.000013s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002997 25 58.57% : 0.001755s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.71% : 0.000081s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.72% : 0.001160s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.333268 72 0.02% : 0.000056s : 1: add_recomputation 0.02% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.10% : 0.000337s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000035s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.92% : 0.009716s : 1: jit_opt_a 0.05% : 0.000158s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.13% : 0.000431s : 1: loop_unroll 0.18% : 0.000609s : 1: mutable_eliminate 0.33% : 0.001111s : 26: opt.transform.jit_opt_a 0.02% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000031s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000016s : 1: opt.transform.mutable_eliminate 0.01% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.14% : 0.000467s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000637s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 0.87% : 0.002894s : 1: renormalize.infer 0.30% : 0.000989s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000043s : 1: rewriter_after_opt_a 0.03% : 0.000111s : 1: rewriter_before_opt_a 0.02% : 0.000081s : 1: symbol_engine_optimizer 94.55% : 0.315100s : 1: type_inference TotalTime = 0.016303, [30] [bootstrap]: 0.00028143 [type_inference]: 0.00781294 [event_method]: 2.124e-05 [auto_monad]: 6.813e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 4.852e-05 [rewriter_before_opt_a]: 8.248e-05 [expand_dump_flag]: 3.18998e-06 [jit_opt_a]: 0.00559383, [2] [Cycle 1]: 0.00185013, [27] [switch_simplify]: 5.791e-05 [loop_unroll]: 3.356e-05 [a_1]: 0.00064639 [with_stream_mark]: 1.886e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.94999e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 4.50001e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.61003e-06 [inline_without_move]: 5.74999e-06 [renormalize]: 0.00075091 [add_forward_monad_depend]: 6.60997e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.583e-05 [cse]: 3.522e-05 [replace_applicator]: 1.307e-05 [Cycle 2]: 0.00033712, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.85002e-06 [a_1]: 0.00010077 [with_stream_mark]: 9.96e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.04003e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.46998e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 2.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.174e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 6.91001e-06 [inline_without_move]: 4.97e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 1.14003e-06 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.39e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.174e-05 [rewriter_after_opt_a]: 3.728e-05 [convert_after_rewriter]: 7.92e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.0005412 [jit_opt_b]: 5.191e-05, [1] [Cycle 1]: 4.497e-05, [2] [frontend_op_eliminate]: 1.657e-05 [inline_after_opt_a]: 1.775e-05 [cconv]: 2.715e-05 [loop_unroll]: 0.0004261 [jit_opt_after_cconv]: 0.00015245, [1] [Cycle 1]: 0.00014653, [11] [c_1]: 2.223e-05 [parameter_eliminate]: 2.98e-06 [updatestate_depend_eliminate]: 6.76999e-06 [updatestate_assign_eliminate]: 2.85998e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 2.329e-05 [call_graph_tuple_transform]: 2.004e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.704e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 6.63998e-06 [add_recomputation]: 5.282e-05 [cse_after_recomputation]: 2.179e-05, [1] [Cycle 1]: 1.685e-05, [1] [cse]: 1.143e-05 [auto_monad_reorder]: 1.738e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.87001e-06 [opt_after_jit_grad]: 0.00070606 [symbol_engine_optimizer]: 8.02e-05, [1] [Cycle 1]: 7.366e-05, [6] [build]: 4.28999e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.48e-05 [opt_reshape]: 6.73998e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 3.60014e-07 [validate]: 3.948e-05 Sums bootstrap : 0.000281s : 2.28% type_inference : 0.007813s : 63.42% event_method : 0.000021s : 0.17% auto_monad : 0.000068s : 0.55% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000049s : 0.39% rewriter_before_opt_a : 0.000082s : 0.67% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.52% jit_opt_a.loop_unroll : 0.000039s : 0.32% jit_opt_a.a_1 : 0.000747s : 6.06% jit_opt_a.with_stream_mark : 0.000029s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000751s : 6.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.18% jit_opt_a.cse : 0.000049s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000037s : 0.30% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000541s : 4.39% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000018s : 0.14% cconv : 0.000027s : 0.22% loop_unroll : 0.000426s : 3.46% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000053s : 0.43% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000706s : 5.73% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.32% Time group info: ------[substitution.] 0.000255 27 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000006s : 3: substitution.graph_param_transform 83.51% : 0.000213s : 5: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.96% : 0.000010s : 3: substitution.reduce_eliminate 1.84% : 0.000005s : 4: substitution.remove_not_recompute_node 1.43% : 0.000004s : 2: substitution.replace_old_param 4.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007745 2 85.50% : 0.006623s : 1: type_inference.infer 14.50% : 0.001123s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.20% : 0.000063s : 5: replace.inline 31.80% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 7 95.47% : 0.000210s : 5: match.inline 4.53% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.67% : 0.000002s : 11: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.41% : 0.000002s : 11: predicate.addn_zero_filter 2.12% : 0.000003s : 11: predicate.arithmetic_simplify 1.32% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.08% : 0.000001s : 11: predicate.depend_value_elim 1.06% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.32% : 0.000002s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 16: predicate.load_eliminater 1.15% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.74% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 16: predicate.partial_eliminate 1.16% : 0.000002s : 11: predicate.print_const_string_wrapper 2.06% : 0.000003s : 11: predicate.reduce_eliminate 1.37% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 19: predicate.replace_applicator 0.63% : 0.000001s : 6: predicate.replace_old_param 0.48% : 0.000001s : 3: predicate.reset_defer_inline 1.18% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.09% : 0.000001s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.83% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.78% : 0.000004s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 59: predicate.switch_simplify 1.36% : 0.000002s : 11: predicate.tile_eliminate 1.36% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000886 16 49.12% : 0.000435s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.17% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.71% : 0.000387s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018089 72 0.31% : 0.000056s : 1: add_recomputation 0.39% : 0.000071s : 1: auto_monad 0.16% : 0.000029s : 1: auto_monad_reorder 1.65% : 0.000299s : 1: bootstrap 0.16% : 0.000030s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.94% : 0.005596s : 1: jit_opt_a 0.86% : 0.000155s : 1: jit_opt_after_cconv 0.30% : 0.000055s : 1: jit_opt_b 2.39% : 0.000432s : 1: loop_unroll 3.03% : 0.000548s : 1: mutable_eliminate 5.36% : 0.000970s : 26: opt.transform.jit_opt_a 0.28% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000028s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.95% : 0.000714s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000051s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.19% : 0.000397s : 1: renormalize.infer 1.91% : 0.000345s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000040s : 1: rewriter_after_opt_a 0.47% : 0.000085s : 1: rewriter_before_opt_a 0.46% : 0.000083s : 1: symbol_engine_optimizer 43.25% : 0.007824s : 1: type_inference TotalTime = 0.213844, [30] [bootstrap]: 0.00032864 [type_inference]: 0.201871 [event_method]: 1.979e-05 [auto_monad]: 7.591e-05 [graph_reusing]: 6.86999e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00042425 [rewriter_before_opt_a]: 8.873e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00838617, [2] [Cycle 1]: 0.00400938, [27] [switch_simplify]: 6.756e-05 [loop_unroll]: 3.165e-05 [a_1]: 0.00069982 [with_stream_mark]: 2.356e-05 [recompute_prepare]: 1.05e-05 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 3.26001e-06 [parameter_eliminate]: 2.18002e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.709e-05 [j_node_and_user_rematch]: 9.89001e-06 [meta_fg_expand]: 2.66e-06 [replace_old_param]: 1.136e-05 [inline_without_move]: 7.05e-06 [renormalize]: 0.00277972 [add_forward_monad_depend]: 1.034e-05 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 2.372e-05 [cse]: 3.575e-05 [replace_applicator]: 2.156e-05 [Cycle 2]: 0.00047339, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00012821 [with_stream_mark]: 1.569e-05 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.55998e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.63002e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 6.03002e-06 [merge_forward]: 4.34997e-06 [cell_reuse_recompute_pass]: 2.71999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.806e-05 [j_node_and_user_rematch]: 7.284e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.069e-05 [inline_without_move]: 6.12999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 1.03e-05 [cse]: 1.617e-05 [replace_applicator]: 7.22997e-06 [py_interpret_to_execute_after_opt_a]: 1.673e-05 [rewriter_after_opt_a]: 3.978e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00075515 [jit_opt_b]: 6.003e-05, [1] [Cycle 1]: 5.118e-05, [2] [frontend_op_eliminate]: 2.073e-05 [inline_after_opt_a]: 1.95e-05 [cconv]: 3.368e-05 [loop_unroll]: 0.00046494 [jit_opt_after_cconv]: 0.00017805, [1] [Cycle 1]: 0.00017079, [11] [c_1]: 2.629e-05 [parameter_eliminate]: 4.19002e-06 [updatestate_depend_eliminate]: 9.87001e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 3.326e-05 [call_graph_tuple_transform]: 2.5e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 7.29982e-07 [switch_simplify]: 6.13998e-06 [remove_dup_value]: 1.727e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 1.156e-05 [add_recomputation]: 6.067e-05 [cse_after_recomputation]: 3.24e-05, [1] [Cycle 1]: 2.441e-05, [1] [cse]: 1.569e-05 [auto_monad_reorder]: 1.823e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 7.92003e-06 [opt_after_jit_grad]: 0.00052117 [symbol_engine_optimizer]: 8.356e-05, [1] [Cycle 1]: 7.617e-05, [6] [build]: 5.79999e-06 [elim_shapecalc]: 8.85001e-06 [elim_not_effective]: 1.597e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 5.89993e-07 [validate]: 5.288e-05 Sums bootstrap : 0.000329s : 0.16% type_inference : 0.201871s : 96.49% event_method : 0.000020s : 0.01% auto_monad : 0.000076s : 0.04% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000424s : 0.20% rewriter_before_opt_a : 0.000089s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.04% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000828s : 0.40% jit_opt_a.with_stream_mark : 0.000039s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000083s : 0.04% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002780s : 1.33% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.02% jit_opt_a.cse : 0.000052s : 0.02% jit_opt_a.replace_applicator : 0.000029s : 0.01% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000755s : 0.36% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000034s : 0.02% loop_unroll : 0.000465s : 0.22% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000061s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000521s : 0.25% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.03% Time group info: ------[substitution.] 0.000274 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.39% : 0.000007s : 4: substitution.graph_param_transform 85.00% : 0.000233s : 4: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.14% : 0.000006s : 4: substitution.remove_not_recompute_node 2.40% : 0.000007s : 2: substitution.replace_old_param 5.35% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.201785 2 98.66% : 0.199079s : 1: type_inference.infer 1.34% : 0.002706s : 1: type_inference.specialize ------[replace.] 0.000129 6 80.94% : 0.000105s : 4: replace.inline 19.06% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000244 6 94.43% : 0.000230s : 4: match.inline 5.57% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.99% : 0.000008s : 26: predicate.inline 1.06% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 18: predicate.load_eliminater 1.64% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 2.32% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.56% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 1.11% : 0.000002s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.07% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.45% : 0.000011s : 58: predicate.switch_simplify 1.14% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.28% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.80% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002242 22 63.17% : 0.001416s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.61% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.22% : 0.000767s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.217782 72 0.03% : 0.000065s : 1: add_recomputation 0.04% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.16% : 0.000347s : 1: bootstrap 0.02% : 0.000036s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000035s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.01% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.85% : 0.008390s : 1: jit_opt_a 0.08% : 0.000181s : 1: jit_opt_after_cconv 0.03% : 0.000063s : 1: jit_opt_b 0.22% : 0.000476s : 1: loop_unroll 0.35% : 0.000768s : 1: mutable_eliminate 0.53% : 0.001153s : 26: opt.transform.jit_opt_a 0.03% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.24% : 0.000532s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.20% : 0.000430s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 0.88% : 0.001920s : 1: renormalize.infer 0.39% : 0.000848s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000094s : 1: rewriter_before_opt_a 0.04% : 0.000087s : 1: symbol_engine_optimizer 92.70% : 0.201888s : 1: type_inference TotalTime = 0.127895, [30] [bootstrap]: 0.0003321 [type_inference]: 0.116061 [event_method]: 1.919e-05 [auto_monad]: 7.26e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.27001e-06 [py_interpret_to_execute]: 0.00045918 [rewriter_before_opt_a]: 8.483e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.00848505, [2] [Cycle 1]: 0.0038057, [27] [switch_simplify]: 5.838e-05 [loop_unroll]: 3.114e-05 [a_1]: 0.00062285 [with_stream_mark]: 2.149e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 8.17998e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 4.05998e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 1.105e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 1.015e-05 [inline_without_move]: 7.16001e-06 [renormalize]: 0.00270152 [add_forward_monad_depend]: 8.75001e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.886e-05 [cse]: 3.366e-05 [replace_applicator]: 2.002e-05 [Cycle 2]: 0.00037934, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012688 [with_stream_mark]: 1.279e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 1.92999e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.6e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.79e-06 [inline_without_move]: 6.10002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.90002e-06 [cse]: 1.195e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 1.349e-05 [rewriter_after_opt_a]: 3.753e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.0006626 [jit_opt_b]: 5.688e-05, [1] [Cycle 1]: 4.875e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 2.861e-05 [loop_unroll]: 0.00042581 [jit_opt_after_cconv]: 0.00016923, [1] [Cycle 1]: 0.000163, [11] [c_1]: 2.585e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 6.98e-06 [updatestate_assign_eliminate]: 2.45997e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 3.416e-05 [call_graph_tuple_transform]: 2.217e-05 [tuple_list_get_item_eliminator]: 6.68998e-06 [none_parameter_eliminate]: 2.26e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.572e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 8.42998e-06 [add_recomputation]: 5.31e-05 [cse_after_recomputation]: 2.267e-05, [1] [Cycle 1]: 1.728e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.729e-05 [get_jit_bprop_graph]: 2.61e-06 [rewriter_after_jit_bprop_graph]: 5.84e-06 [opt_after_jit_grad]: 0.00047671 [symbol_engine_optimizer]: 7.855e-05, [1] [Cycle 1]: 7.238e-05, [6] [build]: 4.82e-06 [elim_shapecalc]: 8.84e-06 [elim_not_effective]: 1.482e-05 [opt_reshape]: 6.66999e-06 [fold_const_symbol]: 9.53002e-06 [renormalize]: 3.7998e-07 [validate]: 4.774e-05 Sums bootstrap : 0.000332s : 0.27% type_inference : 0.116061s : 94.40% event_method : 0.000019s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000459s : 0.37% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000750s : 0.61% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002702s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000663s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000426s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000477s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000247 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000006s : 4: substitution.graph_param_transform 85.13% : 0.000210s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 1.88% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115978 2 97.79% : 0.113410s : 1: type_inference.infer 2.21% : 0.002568s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.96% : 0.000052s : 4: replace.inline 32.04% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.81% : 0.000208s : 4: match.inline 5.19% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.57% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.97% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.34% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.67% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.07% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002412 22 66.56% : 0.001606s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.15% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.29% : 0.000755s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131620 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000356s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.45% : 0.008489s : 1: jit_opt_a 0.13% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.33% : 0.000433s : 1: loop_unroll 0.51% : 0.000671s : 1: mutable_eliminate 0.76% : 0.001000s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000468s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.40% : 0.001845s : 1: renormalize.infer 0.64% : 0.000847s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000089s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.19% : 0.116077s : 1: type_inference TotalTime = 0.264507, [30] [bootstrap]: 0.00035898 [type_inference]: 0.230505 [event_method]: 2.354e-05 [auto_monad]: 7.56e-05 [graph_reusing]: 5.94999e-06 [pre_auto_parallel]: 2.77002e-06 [py_interpret_to_execute]: 0.00063095 [rewriter_before_opt_a]: 9.864e-05 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.0301564, [2] [Cycle 1]: 0.0261933, [27] [switch_simplify]: 6.015e-05 [loop_unroll]: 3.397e-05 [a_1]: 0.00069711 [with_stream_mark]: 1.994e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.88002e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 6.30997e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.31998e-06 [merge_forward]: 4.17003e-06 [cell_reuse_recompute_pass]: 1.61998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.03002e-06 [renormalize]: 0.0249622 [add_forward_monad_depend]: 1.254e-05 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 2.585e-05 [cse]: 4.172e-05 [replace_applicator]: 3.19e-05 [Cycle 2]: 0.00043519, [27] [switch_simplify]: 9.01002e-06 [loop_unroll]: 6.90998e-06 [a_1]: 0.000159 [with_stream_mark]: 1.74e-05 [recompute_prepare]: 6.29999e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.96999e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 4.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.76999e-06 [replace_old_param]: 9.73002e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.93002e-06 [cse]: 1.393e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.504e-05 [rewriter_after_opt_a]: 4.102e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00085319 [jit_opt_b]: 9.372e-05, [1] [Cycle 1]: 8.477e-05, [2] [frontend_op_eliminate]: 5.294e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 2.97e-05 [loop_unroll]: 0.0004288 [jit_opt_after_cconv]: 0.00015864, [1] [Cycle 1]: 0.00015212, [11] [c_1]: 2.738e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.335e-05 [call_graph_tuple_transform]: 2.138e-05 [tuple_list_get_item_eliminator]: 6.86999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.909e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 9.99001e-06 [add_recomputation]: 5.601e-05 [cse_after_recomputation]: 2.715e-05, [1] [Cycle 1]: 2.032e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.882e-05 [get_jit_bprop_graph]: 2.15002e-06 [rewriter_after_jit_bprop_graph]: 4.37998e-06 [opt_after_jit_grad]: 0.00045555 [symbol_engine_optimizer]: 8.364e-05, [1] [Cycle 1]: 7.744e-05, [6] [build]: 4.52e-06 [elim_shapecalc]: 1.048e-05 [elim_not_effective]: 1.615e-05 [opt_reshape]: 6.46999e-06 [fold_const_symbol]: 1.049e-05 [renormalize]: 2.30008e-07 [validate]: 0.00013938 Sums bootstrap : 0.000359s : 0.14% type_inference : 0.230505s : 88.54% event_method : 0.000024s : 0.01% auto_monad : 0.000076s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000631s : 0.24% rewriter_before_opt_a : 0.000099s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000856s : 0.33% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.024962s : 9.59% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000032s : 0.01% jit_opt_a.cse : 0.000056s : 0.02% jit_opt_a.replace_applicator : 0.000038s : 0.01% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000853s : 0.33% jit_opt_b.frontend_op_eliminate : 0.000053s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000429s : 0.16% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000456s : 0.17% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000139s : 0.05% Time group info: ------[substitution.] 0.000279 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.16% : 0.000006s : 4: substitution.graph_param_transform 81.69% : 0.000228s : 5: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.51% : 0.000015s : 3: substitution.reduce_eliminate 1.94% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000005s : 2: substitution.replace_old_param 3.91% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.230402 2 97.94% : 0.225666s : 1: type_inference.infer 2.06% : 0.004736s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.24% : 0.000067s : 5: replace.inline 31.76% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 7 95.85% : 0.000225s : 5: match.inline 4.15% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.39% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.44% : 0.000002s : 13: predicate.cast_eliminate 0.71% : 0.000001s : 4: predicate.check_bprop_eliminate 1.48% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.80% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.14% : 0.000008s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.34% : 0.000004s : 13: predicate.reduce_eliminate 1.32% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000004s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.53% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.69% : 0.000010s : 64: predicate.switch_simplify 1.45% : 0.000002s : 13: predicate.tile_eliminate 1.43% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.89% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.71% : 0.000003s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003703 25 47.11% : 0.001744s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.93% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.96% : 0.001887s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.290588 72 0.02% : 0.000059s : 1: add_recomputation 0.03% : 0.000079s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.13% : 0.000377s : 1: bootstrap 0.01% : 0.000032s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 10.38% : 0.030161s : 1: jit_opt_a 0.06% : 0.000161s : 1: jit_opt_after_cconv 0.03% : 0.000096s : 1: jit_opt_b 0.15% : 0.000436s : 1: loop_unroll 0.30% : 0.000861s : 1: mutable_eliminate 0.38% : 0.001118s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000066s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.16% : 0.000462s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000638s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000022s : 1: remove_dup_value 7.91% : 0.022998s : 1: renormalize.infer 0.67% : 0.001949s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000103s : 1: rewriter_before_opt_a 0.03% : 0.000086s : 1: symbol_engine_optimizer 79.33% : 0.230528s : 1: type_inference TotalTime = 0.156961, [30] [bootstrap]: 0.00032486 [type_inference]: 0.121737 [event_method]: 2.025e-05 [auto_monad]: 7.286e-05 [graph_reusing]: 6.47001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00025467 [rewriter_before_opt_a]: 8.468e-05 [expand_dump_flag]: 3.7e-06 [jit_opt_a]: 0.0312064, [2] [Cycle 1]: 0.0273319, [27] [switch_simplify]: 6.082e-05 [loop_unroll]: 3.152e-05 [a_1]: 0.00058225 [with_stream_mark]: 2.051e-05 [recompute_prepare]: 1.069e-05 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 4.33001e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 7.97e-06 [updatestate_useless_node_eliminater]: 6.03002e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 7.57002e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.638e-05 [j_node_and_user_rematch]: 1.038e-05 [meta_fg_expand]: 2.67001e-06 [replace_old_param]: 1.116e-05 [inline_without_move]: 6.46999e-06 [renormalize]: 0.0261714 [add_forward_monad_depend]: 1.245e-05 [auto_monad_grad]: 3.16001e-06 [auto_monad_eliminator]: 2.3e-05 [cse]: 3.697e-05 [replace_applicator]: 2.825e-05 [Cycle 2]: 0.00045199, [27] [switch_simplify]: 8.72e-06 [loop_unroll]: 7.45e-06 [a_1]: 0.00014982 [with_stream_mark]: 1.776e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.45999e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.81999e-06 [parameter_eliminate]: 2.51998e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 7.13e-06 [meta_shard_fg_expand]: 2.66e-06 [get_grad_eliminate_]: 6.70998e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 4.83001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.046e-05 [j_node_and_user_rematch]: 1.258e-05 [meta_fg_expand]: 3.56001e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 6.02001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.633e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.731e-05 [rewriter_after_opt_a]: 4.163e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 6.61999e-06 [mutable_eliminate]: 0.00097249 [jit_opt_b]: 7.061e-05, [1] [Cycle 1]: 6.15e-05, [2] [frontend_op_eliminate]: 2.517e-05 [inline_after_opt_a]: 2.257e-05 [cconv]: 3.492e-05 [loop_unroll]: 0.00063545 [jit_opt_after_cconv]: 0.00019033, [1] [Cycle 1]: 0.00018343, [11] [c_1]: 3.023e-05 [parameter_eliminate]: 4.94003e-06 [updatestate_depend_eliminate]: 8.95001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 3.179e-05 [call_graph_tuple_transform]: 2.737e-05 [tuple_list_get_item_eliminator]: 7.34002e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 7.46999e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 3.75e-06 [environ_conv]: 1.191e-05 [add_recomputation]: 5.835e-05 [cse_after_recomputation]: 3.076e-05, [1] [Cycle 1]: 2.409e-05, [1] [cse]: 1.605e-05 [auto_monad_reorder]: 1.757e-05 [get_jit_bprop_graph]: 2.37999e-06 [rewriter_after_jit_bprop_graph]: 8.23001e-06 [opt_after_jit_grad]: 0.00061401 [symbol_engine_optimizer]: 8.862e-05, [1] [Cycle 1]: 8.178e-05, [6] [build]: 4.77e-06 [elim_shapecalc]: 9.02e-06 [elim_not_effective]: 1.783e-05 [opt_reshape]: 8.55999e-06 [fold_const_symbol]: 1.143e-05 [renormalize]: 6.19999e-07 [validate]: 5.777e-05 Sums bootstrap : 0.000325s : 0.21% type_inference : 0.121737s : 79.74% event_method : 0.000020s : 0.01% auto_monad : 0.000073s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000255s : 0.17% rewriter_before_opt_a : 0.000085s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000732s : 0.48% jit_opt_a.with_stream_mark : 0.000038s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.026171s : 17.14% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000053s : 0.03% jit_opt_a.replace_applicator : 0.000035s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000007s : 0.00% mutable_eliminate : 0.000972s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000023s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000635s : 0.42% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000058s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000614s : 0.40% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.04% Time group info: ------[substitution.] 0.000214 24 1.20% : 0.000003s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 3.23% : 0.000007s : 4: substitution.graph_param_transform 80.72% : 0.000173s : 4: substitution.inline 2.48% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.90% : 0.000006s : 4: substitution.remove_not_recompute_node 2.78% : 0.000006s : 2: substitution.replace_old_param 5.96% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.121656 2 98.47% : 0.119792s : 1: type_inference.infer 1.53% : 0.001865s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.59% : 0.000050s : 4: replace.inline 32.41% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.63% : 0.000170s : 4: match.inline 6.37% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 830 1.86% : 0.000003s : 12: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.42% : 0.000002s : 12: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.04% : 0.000002s : 12: predicate.depend_value_elim 0.96% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.61% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.56% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.44% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.38% : 0.000008s : 26: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.41% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000002s : 12: predicate.merge_addn 1.32% : 0.000002s : 12: predicate.minmaximum_grad 1.93% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.02% : 0.000003s : 18: predicate.partial_eliminate 1.08% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.46% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.02% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.54% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.93% : 0.000003s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003021 26 57.67% : 0.001742s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.02% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.31% : 0.001248s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.184075 72 0.03% : 0.000062s : 1: add_recomputation 0.04% : 0.000077s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.19% : 0.000347s : 1: bootstrap 0.02% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 16.96% : 0.031211s : 1: jit_opt_a 0.11% : 0.000194s : 1: jit_opt_after_cconv 0.04% : 0.000074s : 1: jit_opt_b 0.35% : 0.000646s : 1: loop_unroll 0.54% : 0.000986s : 1: mutable_eliminate 0.55% : 0.001006s : 26: opt.transform.jit_opt_a 0.04% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000024s : 1: opt.transform.mutable_eliminate 0.02% : 0.000033s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000624s : 1: opt_after_jit_grad 0.00% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000007s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.14% : 0.000261s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 13.36% : 0.024597s : 1: renormalize.infer 0.85% : 0.001557s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000045s : 1: rewriter_after_opt_a 0.05% : 0.000090s : 1: rewriter_before_opt_a 0.05% : 0.000091s : 1: symbol_engine_optimizer 66.14% : 0.121754s : 1: type_inference TotalTime = 0.272812, [30] [bootstrap]: 0.00030936 [type_inference]: 0.259991 [event_method]: 2.45e-05 [auto_monad]: 7.474e-05 [graph_reusing]: 6.27001e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00095399 [rewriter_before_opt_a]: 0.00010291 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00900997, [2] [Cycle 1]: 0.00500256, [27] [switch_simplify]: 6.264e-05 [loop_unroll]: 3.381e-05 [a_1]: 0.00083416 [with_stream_mark]: 2.071e-05 [recompute_prepare]: 8.99998e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.63998e-06 [accelerated_algorithm]: 7.08e-06 [meta_shard_fg_expand]: 2.43998e-06 [get_grad_eliminate_]: 6.84001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.618e-05 [j_node_and_user_rematch]: 9.96998e-06 [meta_fg_expand]: 2.87002e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00368538 [add_forward_monad_depend]: 1.221e-05 [auto_monad_grad]: 2.78998e-06 [auto_monad_eliminator]: 1.731e-05 [cse]: 3.618e-05 [replace_applicator]: 1.572e-05 [Cycle 2]: 0.00038394, [27] [switch_simplify]: 8.02998e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00012944 [with_stream_mark]: 1.104e-05 [recompute_prepare]: 5.89999e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.52001e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.23998e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 2.73998e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.308e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 1.205e-05 [inline_without_move]: 5.64e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.21997e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.385e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.153e-05 [rewriter_after_opt_a]: 4.101e-05 [convert_after_rewriter]: 6.84001e-06 [order_py_execute_after_rewriter]: 5.55001e-06 [mutable_eliminate]: 0.00064464 [jit_opt_b]: 5.51e-05, [1] [Cycle 1]: 4.868e-05, [2] [frontend_op_eliminate]: 1.983e-05 [inline_after_opt_a]: 1.802e-05 [cconv]: 2.84e-05 [loop_unroll]: 0.00042075 [jit_opt_after_cconv]: 0.00015405, [1] [Cycle 1]: 0.00014789, [11] [c_1]: 2.559e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.49001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.378e-05 [call_graph_tuple_transform]: 2.144e-05 [tuple_list_get_item_eliminator]: 6.13002e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.904e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 7.74002e-06 [add_recomputation]: 5.614e-05 [cse_after_recomputation]: 2.442e-05, [1] [Cycle 1]: 1.821e-05, [1] [cse]: 1.232e-05 [auto_monad_reorder]: 1.784e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.67e-06 [opt_after_jit_grad]: 0.00045995 [symbol_engine_optimizer]: 7.721e-05, [1] [Cycle 1]: 7.129e-05, [6] [build]: 3.60998e-06 [elim_shapecalc]: 9.39998e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 1.001e-05 [renormalize]: 3.69997e-07 [validate]: 0.00010285 Sums bootstrap : 0.000309s : 0.12% type_inference : 0.259991s : 96.80% event_method : 0.000025s : 0.01% auto_monad : 0.000075s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000954s : 0.36% rewriter_before_opt_a : 0.000103s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.03% jit_opt_a.loop_unroll : 0.000040s : 0.02% jit_opt_a.a_1 : 0.000964s : 0.36% jit_opt_a.with_stream_mark : 0.000032s : 0.01% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.003685s : 1.37% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.01% jit_opt_a.cse : 0.000050s : 0.02% jit_opt_a.replace_applicator : 0.000022s : 0.01% py_interpret_to_execute_after_opt_a : 0.000012s : 0.00% rewriter_after_opt_a : 0.000041s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000645s : 0.24% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000421s : 0.16% jit_opt_after_cconv.c_1 : 0.000026s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000460s : 0.17% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000103s : 0.04% Time group info: ------[substitution.] 0.000362 28 0.52% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000002s : 2: substitution.fold_const_symbol 1.70% : 0.000006s : 4: substitution.graph_param_transform 87.06% : 0.000315s : 5: substitution.inline 0.94% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.09% : 0.000011s : 3: substitution.reduce_eliminate 1.48% : 0.000005s : 4: substitution.remove_not_recompute_node 1.16% : 0.000004s : 2: substitution.replace_old_param 3.50% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.259899 2 98.23% : 0.255301s : 1: type_inference.infer 1.77% : 0.004599s : 1: type_inference.specialize ------[replace.] 0.000127 7 73.30% : 0.000093s : 5: replace.inline 26.70% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000323 7 96.43% : 0.000311s : 5: match.inline 3.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 886 1.17% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.09% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000008s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.67% : 0.000002s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000004s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.22% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 13: predicate.reshape_eliminate 1.42% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.56% : 0.000004s : 20: predicate.switch_defer_inline 2.27% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.32% : 0.000011s : 64: predicate.switch_simplify 1.54% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.23% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 5.47% : 0.000008s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002824 25 60.44% : 0.001707s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.52% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.03% : 0.001046s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.277717 72 0.02% : 0.000059s : 1: add_recomputation 0.03% : 0.000078s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.12% : 0.000326s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000026s : 1: cse_after_recomputation 0.00% : 0.000010s : 1: environ_conv 0.01% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.25% : 0.009014s : 1: jit_opt_a 0.06% : 0.000157s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.15% : 0.000428s : 1: loop_unroll 0.23% : 0.000652s : 1: mutable_eliminate 0.44% : 0.001215s : 26: opt.transform.jit_opt_a 0.02% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000467s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.35% : 0.000964s : 1: py_interpret_to_execute 0.00% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000021s : 1: remove_dup_value 0.99% : 0.002736s : 1: renormalize.infer 0.34% : 0.000940s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000044s : 1: rewriter_after_opt_a 0.04% : 0.000107s : 1: rewriter_before_opt_a 0.03% : 0.000080s : 1: symbol_engine_optimizer 93.63% : 0.260013s : 1: type_inference TotalTime = 0.0665393, [30] [bootstrap]: 0.00030898 [type_inference]: 0.0556904 [event_method]: 1.928e-05 [auto_monad]: 7.349e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.60002e-06 [py_interpret_to_execute]: 0.0004061 [rewriter_before_opt_a]: 0.00010803 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.00753058, [2] [Cycle 1]: 0.00348095, [27] [switch_simplify]: 6.265e-05 [loop_unroll]: 3.254e-05 [a_1]: 0.00063438 [with_stream_mark]: 1.984e-05 [recompute_prepare]: 9.26998e-06 [updatestate_depend_eliminate]: 3.62002e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.72001e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 7.84002e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.94999e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.70001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.64e-05 [j_node_and_user_rematch]: 9.58002e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00231808 [add_forward_monad_depend]: 7.93999e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.852e-05 [cse]: 2.965e-05 [replace_applicator]: 1.919e-05 [Cycle 2]: 0.00037731, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00012572 [with_stream_mark]: 1.374e-05 [recompute_prepare]: 5.92001e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.03002e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 2.54001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.686e-05 [j_node_and_user_rematch]: 9.36002e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.44998e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 6.15002e-06 [cse]: 1.171e-05 [replace_applicator]: 5.86998e-06 [py_interpret_to_execute_after_opt_a]: 1.331e-05 [rewriter_after_opt_a]: 3.591e-05 [convert_after_rewriter]: 6.33998e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00070672 [jit_opt_b]: 5.734e-05, [1] [Cycle 1]: 4.975e-05, [2] [frontend_op_eliminate]: 1.944e-05 [inline_after_opt_a]: 1.869e-05 [cconv]: 2.947e-05 [loop_unroll]: 0.00043378 [jit_opt_after_cconv]: 0.00015906, [1] [Cycle 1]: 0.00015185, [11] [c_1]: 2.584e-05 [parameter_eliminate]: 3.21001e-06 [updatestate_depend_eliminate]: 7.30998e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.537e-05 [call_graph_tuple_transform]: 2.177e-05 [tuple_list_get_item_eliminator]: 6.79999e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 5.98002e-06 [remove_dup_value]: 1.669e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 9.20999e-06 [add_recomputation]: 5.339e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.792e-05, [1] [cse]: 1.175e-05 [auto_monad_reorder]: 1.703e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 6.61999e-06 [opt_after_jit_grad]: 0.00047438 [symbol_engine_optimizer]: 7.956e-05, [1] [Cycle 1]: 7.344e-05, [6] [build]: 4.15999e-06 [elim_shapecalc]: 8.72e-06 [elim_not_effective]: 1.481e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 1.024e-05 [renormalize]: 4.00003e-07 [validate]: 5.148e-05 Sums bootstrap : 0.000309s : 0.50% type_inference : 0.055690s : 89.54% event_method : 0.000019s : 0.03% auto_monad : 0.000073s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000406s : 0.65% rewriter_before_opt_a : 0.000108s : 0.17% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.11% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000760s : 1.22% jit_opt_a.with_stream_mark : 0.000034s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002318s : 3.73% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000041s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000707s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000029s : 0.05% loop_unroll : 0.000434s : 0.70% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000474s : 0.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.08% Time group info: ------[substitution.] 0.000251 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000006s : 4: substitution.graph_param_transform 84.84% : 0.000213s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000006s : 2: substitution.replace_old_param 5.15% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055604 2 96.68% : 0.053760s : 1: type_inference.infer 3.32% : 0.001844s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.83% : 0.000056s : 4: replace.inline 32.17% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.70% : 0.000210s : 4: match.inline 5.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.85% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.47% : 0.000002s : 12: predicate.environ_get_eliminate 1.34% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.43% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 6.06% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.05% : 0.000010s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002331 26 71.68% : 0.001671s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.27% : 0.000053s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.05% : 0.000607s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.069928 72 0.08% : 0.000057s : 1: add_recomputation 0.11% : 0.000076s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.47% : 0.000328s : 1: bootstrap 0.05% : 0.000032s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000020s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.77% : 0.007534s : 1: jit_opt_a 0.23% : 0.000162s : 1: jit_opt_after_cconv 0.09% : 0.000060s : 1: jit_opt_b 0.63% : 0.000442s : 1: loop_unroll 1.03% : 0.000717s : 1: mutable_eliminate 1.45% : 0.001011s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.60% : 0.000416s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.30% : 0.001606s : 1: renormalize.infer 1.00% : 0.000699s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.16% : 0.000113s : 1: rewriter_before_opt_a 0.12% : 0.000082s : 1: symbol_engine_optimizer 79.66% : 0.055707s : 1: type_inference TotalTime = 0.0171863, [30] [bootstrap]: 0.00038304 [type_inference]: 0.00885937 [event_method]: 2.099e-05 [auto_monad]: 7.557e-05 [graph_reusing]: 5.72999e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 4.975e-05 [rewriter_before_opt_a]: 8.079e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.00551614, [2] [Cycle 1]: 0.00174214, [27] [switch_simplify]: 5.688e-05 [loop_unroll]: 3.345e-05 [a_1]: 0.00066768 [with_stream_mark]: 1.615e-05 [recompute_prepare]: 7.55e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 5.29998e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.84001e-06 [get_grad_eliminate_]: 5.73002e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.535e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00063852 [add_forward_monad_depend]: 5.62999e-06 [auto_monad_grad]: 2.00002e-06 [auto_monad_eliminator]: 1.375e-05 [cse]: 3.383e-05 [replace_applicator]: 1.11e-05 [Cycle 2]: 0.00032601, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.721e-05 [with_stream_mark]: 8.40001e-06 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 5.06997e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.10001e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.048e-05 [j_node_and_user_rematch]: 7.65e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 7.06001e-06 [inline_without_move]: 4.86002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 8.89995e-07 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.34998e-06 [cse]: 1.245e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 8.47e-06 [rewriter_after_opt_a]: 3.721e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 4.91002e-06 [mutable_eliminate]: 0.00062282 [jit_opt_b]: 5.135e-05, [1] [Cycle 1]: 4.537e-05, [2] [frontend_op_eliminate]: 1.73e-05 [inline_after_opt_a]: 1.6e-05 [cconv]: 2.545e-05 [loop_unroll]: 0.00043144 [jit_opt_after_cconv]: 0.00015967, [1] [Cycle 1]: 0.00015346, [11] [c_1]: 2.061e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.78002e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.023e-05 [call_graph_tuple_transform]: 2.872e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.554e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 5.71e-06 [add_recomputation]: 5.689e-05 [cse_after_recomputation]: 2.403e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.288e-05 [auto_monad_reorder]: 1.774e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.42e-06 [opt_after_jit_grad]: 0.00043818 [symbol_engine_optimizer]: 7.15e-05, [1] [Cycle 1]: 6.565e-05, [6] [build]: 3.64002e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.241e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.72e-06 [renormalize]: 3.59985e-07 [validate]: 3.836e-05 Sums bootstrap : 0.000383s : 2.91% type_inference : 0.008859s : 67.29% event_method : 0.000021s : 0.16% auto_monad : 0.000076s : 0.57% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000050s : 0.38% rewriter_before_opt_a : 0.000081s : 0.61% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.48% jit_opt_a.loop_unroll : 0.000039s : 0.29% jit_opt_a.a_1 : 0.000765s : 5.81% jit_opt_a.with_stream_mark : 0.000025s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000639s : 4.85% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.15% jit_opt_a.cse : 0.000046s : 0.35% jit_opt_a.replace_applicator : 0.000016s : 0.12% py_interpret_to_execute_after_opt_a : 0.000008s : 0.06% rewriter_after_opt_a : 0.000037s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000623s : 4.73% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.19% loop_unroll : 0.000431s : 3.28% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.15% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000057s : 0.43% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000438s : 3.33% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.29% Time group info: ------[substitution.] 0.000260 27 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 1.96% : 0.000005s : 3: substitution.graph_param_transform 84.41% : 0.000220s : 5: substitution.inline 1.08% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.75% : 0.000010s : 3: substitution.reduce_eliminate 1.76% : 0.000005s : 4: substitution.remove_not_recompute_node 1.38% : 0.000004s : 2: substitution.replace_old_param 4.29% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008788 2 87.16% : 0.007659s : 1: type_inference.infer 12.84% : 0.001128s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.24% : 0.000063s : 5: replace.inline 31.76% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 95.52% : 0.000217s : 5: match.inline 4.48% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.43% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000003s : 11: predicate.arithmetic_simplify 1.46% : 0.000002s : 11: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.18% : 0.000001s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.63% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.34% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.37% : 0.000007s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.16% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000001s : 11: predicate.print_const_string_wrapper 2.24% : 0.000003s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.41% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.41% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 18: predicate.switch_defer_inline 2.35% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.62% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000906 16 51.67% : 0.000468s : 7: func_graph_cloner_run.FuncGraphClonerGraph 5.97% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.36% : 0.000384s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018875 72 0.32% : 0.000060s : 1: add_recomputation 0.42% : 0.000079s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 2.14% : 0.000404s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.24% : 0.005519s : 1: jit_opt_a 0.86% : 0.000163s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.32% : 0.000438s : 1: loop_unroll 3.34% : 0.000631s : 1: mutable_eliminate 5.21% : 0.000983s : 26: opt.transform.jit_opt_a 0.31% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.36% : 0.000445s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000052s : 1: py_interpret_to_execute 0.06% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 1.82% : 0.000343s : 1: renormalize.infer 1.52% : 0.000288s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000040s : 1: rewriter_after_opt_a 0.44% : 0.000083s : 1: rewriter_before_opt_a 0.39% : 0.000074s : 1: symbol_engine_optimizer 47.00% : 0.008872s : 1: type_inference TotalTime = 0.287817, [30] [bootstrap]: 0.00034446 [type_inference]: 0.272528 [event_method]: 2.685e-05 [auto_monad]: 7.904e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00130255 [rewriter_before_opt_a]: 0.00011084 [expand_dump_flag]: 4.77e-06 [jit_opt_a]: 0.0106183, [2] [Cycle 1]: 0.00591831, [27] [switch_simplify]: 6.761e-05 [loop_unroll]: 3.478e-05 [a_1]: 0.00074898 [with_stream_mark]: 2.254e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 6.42001e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 2.86e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.83998e-06 [replace_old_param]: 1.014e-05 [inline_without_move]: 6.12001e-06 [renormalize]: 0.00448646 [add_forward_monad_depend]: 7.46999e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.872e-05 [cse]: 0.00020762 [replace_applicator]: 1.862e-05 [Cycle 2]: 0.00043902, [27] [switch_simplify]: 7.27002e-06 [loop_unroll]: 3.581e-05 [a_1]: 0.00013859 [with_stream_mark]: 1.431e-05 [recompute_prepare]: 6.13998e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.98e-06 [meta_shard_fg_expand]: 1.81998e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 2.82002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.335e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 9.40025e-07 [auto_monad_eliminator]: 7.16001e-06 [cse]: 1.59e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.335e-05 [rewriter_after_opt_a]: 6.431e-05 [convert_after_rewriter]: 8.04997e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00060971 [jit_opt_b]: 5.573e-05, [1] [Cycle 1]: 4.847e-05, [2] [frontend_op_eliminate]: 1.952e-05 [inline_after_opt_a]: 1.755e-05 [cconv]: 3.757e-05 [loop_unroll]: 0.00064791 [jit_opt_after_cconv]: 0.00015886, [1] [Cycle 1]: 0.0001519, [11] [c_1]: 2.699e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 6.73998e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.353e-05 [call_graph_tuple_transform]: 2.205e-05 [tuple_list_get_item_eliminator]: 6.52001e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.16998e-06 [remove_dup_value]: 1.671e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 8.75999e-06 [add_recomputation]: 5.279e-05 [cse_after_recomputation]: 2.278e-05, [1] [Cycle 1]: 1.794e-05, [1] [cse]: 1.221e-05 [auto_monad_reorder]: 1.853e-05 [get_jit_bprop_graph]: 2.08002e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00073588 [symbol_engine_optimizer]: 7.919e-05, [1] [Cycle 1]: 7.225e-05, [6] [build]: 4.97e-06 [elim_shapecalc]: 8.86997e-06 [elim_not_effective]: 1.453e-05 [opt_reshape]: 7.21999e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 3.19997e-07 [validate]: 4.623e-05 Sums bootstrap : 0.000344s : 0.12% type_inference : 0.272528s : 96.33% event_method : 0.000027s : 0.01% auto_monad : 0.000079s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001303s : 0.46% rewriter_before_opt_a : 0.000111s : 0.04% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.03% jit_opt_a.loop_unroll : 0.000071s : 0.02% jit_opt_a.a_1 : 0.000888s : 0.31% jit_opt_a.with_stream_mark : 0.000037s : 0.01% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.004487s : 1.59% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.01% jit_opt_a.cse : 0.000224s : 0.08% jit_opt_a.replace_applicator : 0.000025s : 0.01% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000064s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000610s : 0.22% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000038s : 0.01% loop_unroll : 0.000648s : 0.23% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000053s : 0.02% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000736s : 0.26% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.02% Time group info: ------[substitution.] 0.000304 28 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 4: substitution.graph_param_transform 85.19% : 0.000259s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.90% : 0.000012s : 3: substitution.reduce_eliminate 1.68% : 0.000005s : 4: substitution.remove_not_recompute_node 1.41% : 0.000004s : 2: substitution.replace_old_param 3.65% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.272423 2 98.12% : 0.267289s : 1: type_inference.infer 1.88% : 0.005134s : 1: type_inference.specialize ------[replace.] 0.000111 7 68.96% : 0.000077s : 5: replace.inline 31.04% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000265 7 96.23% : 0.000255s : 5: match.inline 3.77% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 886 0.92% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.91% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.69% : 0.000003s : 13: predicate.arithmetic_simplify 1.17% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 0.89% : 0.000002s : 13: predicate.compare_switch_simplify 0.99% : 0.000002s : 13: predicate.depend_value_elim 0.92% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.00% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.00% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.41% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.04% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.90% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 0.91% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 4.94% : 0.000009s : 28: predicate.inline 0.71% : 0.000001s : 8: predicate.inline_without_move 0.36% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000002s : 8: predicate.less_batch_normalization 1.17% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.43% : 0.000002s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 18.72% : 0.000032s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.92% : 0.000002s : 13: predicate.merge_addn 0.92% : 0.000002s : 13: predicate.minmaximum_grad 1.09% : 0.000002s : 4: predicate.mutable_eliminate 0.38% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000004s : 19: predicate.partial_eliminate 0.96% : 0.000002s : 13: predicate.print_const_string_wrapper 2.26% : 0.000004s : 13: predicate.reduce_eliminate 1.46% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.64% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 1.09% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.58% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.75% : 0.000001s : 8: predicate.specialize_transform 1.14% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.98% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.03% : 0.000003s : 20: predicate.switch_defer_inline 1.88% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.30% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.11% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.99% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.27% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.40% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.32% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.29% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003420 25 56.20% : 0.001922s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.33% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.47% : 0.001418s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.293514 72 0.02% : 0.000055s : 1: add_recomputation 0.03% : 0.000082s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.12% : 0.000362s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.01% : 0.000032s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 3.62% : 0.010621s : 1: jit_opt_a 0.06% : 0.000162s : 1: jit_opt_after_cconv 0.02% : 0.000058s : 1: jit_opt_b 0.22% : 0.000656s : 1: loop_unroll 0.21% : 0.000618s : 1: mutable_eliminate 0.40% : 0.001170s : 26: opt.transform.jit_opt_a 0.02% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.25% : 0.000744s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.45% : 0.001315s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.08% : 0.003181s : 1: renormalize.infer 0.43% : 0.001273s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000068s : 1: rewriter_after_opt_a 0.04% : 0.000115s : 1: rewriter_before_opt_a 0.03% : 0.000082s : 1: symbol_engine_optimizer 92.86% : 0.272552s : 1: type_inference TotalTime = 0.0228109, [30] [bootstrap]: 0.00055496 [type_inference]: 0.00543133 [event_method]: 1.983e-05 [auto_monad]: 7.028e-05 [graph_reusing]: 5.90002e-06 [pre_auto_parallel]: 3.23e-06 [py_interpret_to_execute]: 3.963e-05 [rewriter_before_opt_a]: 7.556e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.0138745, [2] [Cycle 1]: 0.00964736, [27] [switch_simplify]: 6.854e-05 [loop_unroll]: 3.084e-05 [a_1]: 0.00065506 [with_stream_mark]: 2.85e-05 [recompute_prepare]: 1.078e-05 [updatestate_depend_eliminate]: 4.80999e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.22002e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.84e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.703e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 3.12002e-06 [replace_old_param]: 1.441e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00833771 [add_forward_monad_depend]: 1.216e-05 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 2.547e-05 [cse]: 3.856e-05 [replace_applicator]: 2.578e-05 [Cycle 2]: 0.00039963, [27] [switch_simplify]: 6.87002e-06 [loop_unroll]: 5.71998e-06 [a_1]: 0.00011046 [with_stream_mark]: 2.023e-05 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 4.69998e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 2.24001e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 4.75001e-06 [merge_forward]: 3.99002e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.02e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.04e-05 [inline_without_move]: 5.33002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.66e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 9.78998e-06 [cse]: 1.446e-05 [replace_applicator]: 1.118e-05 [py_interpret_to_execute_after_opt_a]: 2.029e-05 [rewriter_after_opt_a]: 4e-05 [convert_after_rewriter]: 0.00022057 [order_py_execute_after_rewriter]: 1.088e-05 [mutable_eliminate]: 0.00078893 [jit_opt_b]: 5.739e-05, [1] [Cycle 1]: 4.836e-05, [2] [frontend_op_eliminate]: 1.858e-05 [inline_after_opt_a]: 1.751e-05 [cconv]: 3.576e-05 [loop_unroll]: 0.00045741 [jit_opt_after_cconv]: 0.00016854, [1] [Cycle 1]: 0.00016225, [11] [c_1]: 2.299e-05 [parameter_eliminate]: 4.44998e-06 [updatestate_depend_eliminate]: 7.33e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.86e-06 [cse]: 3.467e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 6.69999e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 5.93002e-06 [remove_dup_value]: 1.619e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 6.48003e-06 [add_recomputation]: 5.571e-05 [cse_after_recomputation]: 2.237e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.088e-05 [auto_monad_reorder]: 1.48e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 7.26001e-06 [opt_after_jit_grad]: 0.00047822 [symbol_engine_optimizer]: 7.712e-05, [1] [Cycle 1]: 7.061e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.44e-05 [opt_reshape]: 6.36998e-06 [fold_const_symbol]: 9.27999e-06 [renormalize]: 5.09986e-07 [validate]: 4.325e-05 Sums bootstrap : 0.000555s : 3.05% type_inference : 0.005431s : 29.81% event_method : 0.000020s : 0.11% auto_monad : 0.000070s : 0.39% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000040s : 0.22% rewriter_before_opt_a : 0.000076s : 0.41% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000075s : 0.41% jit_opt_a.loop_unroll : 0.000037s : 0.20% jit_opt_a.a_1 : 0.000766s : 4.20% jit_opt_a.with_stream_mark : 0.000049s : 0.27% jit_opt_a.recompute_prepare : 0.000017s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000013s : 0.07% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000012s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.05% jit_opt_a.merge_forward : 0.000008s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.11% jit_opt_a.meta_fg_expand : 0.000006s : 0.03% jit_opt_a.replace_old_param : 0.000025s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.008338s : 45.77% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.19% jit_opt_a.cse : 0.000053s : 0.29% jit_opt_a.replace_applicator : 0.000037s : 0.20% py_interpret_to_execute_after_opt_a : 0.000020s : 0.11% rewriter_after_opt_a : 0.000040s : 0.22% convert_after_rewriter : 0.000221s : 1.21% order_py_execute_after_rewriter : 0.000011s : 0.06% mutable_eliminate : 0.000789s : 4.33% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.10% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000036s : 0.20% loop_unroll : 0.000457s : 2.51% jit_opt_after_cconv.c_1 : 0.000023s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000035s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.03% remove_dup_value : 0.000016s : 0.09% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000056s : 0.31% cse_after_recomputation.cse : 0.000011s : 0.06% auto_monad_reorder : 0.000015s : 0.08% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.04% opt_after_jit_grad : 0.000478s : 2.62% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.24% Time group info: ------[substitution.] 0.000287 23 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 3: substitution.graph_param_transform 84.83% : 0.000243s : 4: substitution.inline 1.65% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000007s : 4: substitution.remove_not_recompute_node 2.90% : 0.000008s : 2: substitution.replace_old_param 4.92% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005350 2 83.09% : 0.004446s : 1: type_inference.infer 16.91% : 0.000905s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.95% : 0.000055s : 4: replace.inline 32.05% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000254 6 94.89% : 0.000241s : 4: match.inline 5.11% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.93% : 0.000001s : 10: predicate.addn_check_dump 1.41% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000003s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.12% : 0.000002s : 10: predicate.depend_value_elim 0.98% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.37% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 10: predicate.environ_get_depend_swap 1.15% : 0.000002s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 6.10% : 0.000008s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.98% : 0.000003s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.42% : 0.000002s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.95% : 0.000003s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000003s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 16: predicate.switch_defer_inline 1.97% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.04% : 0.000010s : 53: predicate.switch_simplify 1.44% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 2.13% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.86% : 0.000003s : 12: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000891 13 43.22% : 0.000385s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.63% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.15% : 0.000447s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.032223 72 0.18% : 0.000059s : 1: add_recomputation 0.23% : 0.000074s : 1: auto_monad 0.05% : 0.000017s : 1: auto_monad_reorder 1.79% : 0.000578s : 1: bootstrap 0.12% : 0.000039s : 1: cconv 0.71% : 0.000228s : 1: convert_after_rewriter 0.08% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000024s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 43.07% : 0.013878s : 1: jit_opt_a 0.53% : 0.000171s : 1: jit_opt_after_cconv 0.19% : 0.000060s : 1: jit_opt_b 1.45% : 0.000466s : 1: loop_unroll 2.48% : 0.000799s : 1: mutable_eliminate 3.21% : 0.001033s : 26: opt.transform.jit_opt_a 0.16% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.09% : 0.000029s : 4: opt.transform.jit_opt_b 0.04% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000019s : 1: opt.transform.mutable_eliminate 0.07% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.51% : 0.000487s : 1: opt_after_jit_grad 0.04% : 0.000014s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.13% : 0.000043s : 1: py_interpret_to_execute 0.07% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.06% : 0.000019s : 1: remove_dup_value 23.85% : 0.007685s : 1: renormalize.infer 1.95% : 0.000629s : 1: renormalize.specialize 0.03% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.24% : 0.000078s : 1: rewriter_before_opt_a 0.25% : 0.000079s : 1: symbol_engine_optimizer 16.93% : 0.005454s : 1: type_inference TotalTime = 0.014498, [30] [bootstrap]: 0.00033527 [type_inference]: 0.00560065 [event_method]: 2.002e-05 [auto_monad]: 7.053e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.93998e-06 [py_interpret_to_execute]: 4.496e-05 [rewriter_before_opt_a]: 7.716e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.00603962, [2] [Cycle 1]: 0.00197338, [27] [switch_simplify]: 6.805e-05 [loop_unroll]: 3.032e-05 [a_1]: 0.00060586 [with_stream_mark]: 2.023e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 4.63001e-06 [updatestate_assign_eliminate]: 3.12997e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 2.49001e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.88002e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.532e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00090855 [add_forward_monad_depend]: 6.33e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 2.623e-05 [replace_applicator]: 1.452e-05 [Cycle 2]: 0.0003421, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.848e-05 [with_stream_mark]: 1.107e-05 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.36002e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 9.60019e-07 [auto_monad_eliminator]: 6.33998e-06 [cse]: 1.145e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.245e-05 [rewriter_after_opt_a]: 3.696e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 5.04998e-06 [mutable_eliminate]: 0.00066972 [jit_opt_b]: 5.112e-05, [1] [Cycle 1]: 4.435e-05, [2] [frontend_op_eliminate]: 1.689e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 2.984e-05 [loop_unroll]: 0.00045209 [jit_opt_after_cconv]: 0.00015041, [1] [Cycle 1]: 0.00014407, [11] [c_1]: 2.035e-05 [parameter_eliminate]: 4.04002e-06 [updatestate_depend_eliminate]: 6.21998e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.268e-05 [call_graph_tuple_transform]: 2.148e-05 [tuple_list_get_item_eliminator]: 5.67999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.618e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 6.12999e-06 [add_recomputation]: 4.901e-05 [cse_after_recomputation]: 2.277e-05, [1] [Cycle 1]: 1.705e-05, [1] [cse]: 1.079e-05 [auto_monad_reorder]: 1.668e-05 [get_jit_bprop_graph]: 2.23998e-06 [rewriter_after_jit_bprop_graph]: 6.41e-06 [opt_after_jit_grad]: 0.00047098 [symbol_engine_optimizer]: 7.011e-05, [1] [Cycle 1]: 6.389e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 7.36001e-06 [elim_not_effective]: 1.187e-05 [opt_reshape]: 5.27999e-06 [fold_const_symbol]: 8.41002e-06 [renormalize]: 1.19e-06 [validate]: 3.678e-05 Sums bootstrap : 0.000335s : 3.29% type_inference : 0.005601s : 55.04% event_method : 0.000020s : 0.20% auto_monad : 0.000071s : 0.69% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.44% rewriter_before_opt_a : 0.000077s : 0.76% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000074s : 0.73% jit_opt_a.loop_unroll : 0.000035s : 0.35% jit_opt_a.a_1 : 0.000704s : 6.92% jit_opt_a.with_stream_mark : 0.000031s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000019s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000909s : 8.93% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.22% jit_opt_a.cse : 0.000038s : 0.37% jit_opt_a.replace_applicator : 0.000020s : 0.19% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000037s : 0.36% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000670s : 6.58% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000030s : 0.29% loop_unroll : 0.000452s : 4.44% jit_opt_after_cconv.c_1 : 0.000020s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000049s : 0.48% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000017s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000471s : 4.63% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000037s : 0.36% Time group info: ------[substitution.] 0.000258 23 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 3: substitution.graph_param_transform 85.42% : 0.000221s : 4: substitution.inline 1.44% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000006s : 2: substitution.replace_old_param 5.13% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005526 2 81.85% : 0.004523s : 1: type_inference.infer 18.15% : 0.001003s : 1: type_inference.specialize ------[replace.] 0.000076 6 69.51% : 0.000053s : 4: replace.inline 30.49% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 6 94.74% : 0.000218s : 4: match.inline 5.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 691 1.24% : 0.000002s : 10: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.31% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.68% : 0.000001s : 3: predicate.graph_param_transform 5.89% : 0.000007s : 22: predicate.inline 1.08% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 6: predicate.less_batch_normalization 1.67% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.63% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000000s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.53% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.94% : 0.000010s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.88% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000752 13 52.14% : 0.000392s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.19% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.67% : 0.000306s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016397 72 0.32% : 0.000052s : 1: add_recomputation 0.45% : 0.000074s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.17% : 0.000356s : 1: bootstrap 0.20% : 0.000033s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.86% : 0.006044s : 1: jit_opt_a 0.93% : 0.000153s : 1: jit_opt_after_cconv 0.33% : 0.000054s : 1: jit_opt_b 2.80% : 0.000459s : 1: loop_unroll 4.15% : 0.000680s : 1: mutable_eliminate 5.71% : 0.000936s : 26: opt.transform.jit_opt_a 0.30% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.92% : 0.000479s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 3.16% : 0.000518s : 1: renormalize.infer 2.33% : 0.000381s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000040s : 1: rewriter_after_opt_a 0.49% : 0.000080s : 1: rewriter_before_opt_a 0.44% : 0.000073s : 1: symbol_engine_optimizer 34.28% : 0.005620s : 1: type_inference TotalTime = 0.308067, [30] [bootstrap]: 0.00030684 [type_inference]: 0.295072 [event_method]: 2.27e-05 [auto_monad]: 7.656e-05 [graph_reusing]: 6.40002e-06 [pre_auto_parallel]: 2.76999e-06 [py_interpret_to_execute]: 0.00066453 [rewriter_before_opt_a]: 0.00010673 [expand_dump_flag]: 4.20999e-06 [jit_opt_a]: 0.0089053, [2] [Cycle 1]: 0.00473485, [27] [switch_simplify]: 6.669e-05 [loop_unroll]: 3.558e-05 [a_1]: 0.00073825 [with_stream_mark]: 1.854e-05 [recompute_prepare]: 1.004e-05 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 2.17001e-06 [specialize_transform]: 7.7e-06 [updatestate_useless_node_eliminater]: 6.52001e-06 [accelerated_algorithm]: 8.03001e-06 [meta_shard_fg_expand]: 2.89001e-06 [get_grad_eliminate_]: 7.68999e-06 [merge_forward]: 4.48999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.815e-05 [j_node_and_user_rematch]: 1.164e-05 [meta_fg_expand]: 3.00002e-06 [replace_old_param]: 1.058e-05 [inline_without_move]: 7.11999e-06 [renormalize]: 0.00344532 [add_forward_monad_depend]: 1.135e-05 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 2.267e-05 [cse]: 3.978e-05 [replace_applicator]: 2.64e-05 [Cycle 2]: 0.0004419, [27] [switch_simplify]: 7.51999e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00015557 [with_stream_mark]: 1.716e-05 [recompute_prepare]: 6.76e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 6.59001e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.58998e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 3.86001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.69e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 1.115e-05 [inline_without_move]: 6.36e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.31998e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 7.02002e-06 [cse]: 1.711e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.863e-05 [rewriter_after_opt_a]: 4.349e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00079375 [jit_opt_b]: 6.466e-05, [1] [Cycle 1]: 5.518e-05, [2] [frontend_op_eliminate]: 2.167e-05 [inline_after_opt_a]: 2.003e-05 [cconv]: 3.786e-05 [loop_unroll]: 0.00057224 [jit_opt_after_cconv]: 0.00019742, [1] [Cycle 1]: 0.0001892, [11] [c_1]: 3.13e-05 [parameter_eliminate]: 4.43999e-06 [updatestate_depend_eliminate]: 8.60001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.58998e-06 [cse]: 3.967e-05 [call_graph_tuple_transform]: 2.783e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 8.2e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 2.002e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 1.045e-05 [add_recomputation]: 5.564e-05 [cse_after_recomputation]: 2.687e-05, [1] [Cycle 1]: 1.993e-05, [1] [cse]: 1.339e-05 [auto_monad_reorder]: 1.735e-05 [get_jit_bprop_graph]: 2.04999e-06 [rewriter_after_jit_bprop_graph]: 8.47e-06 [opt_after_jit_grad]: 0.00057012 [symbol_engine_optimizer]: 8.64e-05, [1] [Cycle 1]: 7.883e-05, [6] [build]: 5.19e-06 [elim_shapecalc]: 9.09e-06 [elim_not_effective]: 1.567e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 1.067e-05 [renormalize]: 9.20001e-07 [validate]: 0.00014681 Sums bootstrap : 0.000307s : 0.10% type_inference : 0.295072s : 97.18% event_method : 0.000023s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000665s : 0.22% rewriter_before_opt_a : 0.000107s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.02% jit_opt_a.loop_unroll : 0.000042s : 0.01% jit_opt_a.a_1 : 0.000894s : 0.29% jit_opt_a.with_stream_mark : 0.000036s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000015s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.003445s : 1.13% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000057s : 0.02% jit_opt_a.replace_applicator : 0.000032s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.01% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000794s : 0.26% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000038s : 0.01% loop_unroll : 0.000572s : 0.19% jit_opt_after_cconv.c_1 : 0.000031s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000020s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000056s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000570s : 0.19% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000147s : 0.05% Time group info: ------[substitution.] 0.000281 28 1.03% : 0.000003s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000007s : 4: substitution.graph_param_transform 80.77% : 0.000227s : 5: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.46% : 0.000015s : 3: substitution.reduce_eliminate 2.20% : 0.000006s : 4: substitution.remove_not_recompute_node 1.97% : 0.000006s : 2: substitution.replace_old_param 4.15% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.294977 2 98.72% : 0.291194s : 1: type_inference.infer 1.28% : 0.003783s : 1: type_inference.specialize ------[replace.] 0.000111 7 66.80% : 0.000074s : 5: replace.inline 33.20% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000234 7 95.56% : 0.000224s : 5: match.inline 4.44% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.38% : 0.000004s : 13: predicate.arithmetic_simplify 1.42% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.74% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.56% : 0.000009s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.67% : 0.000003s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.01% : 0.000002s : 13: predicate.minmaximum_grad 1.66% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.20% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.70% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.59% : 0.000001s : 4: predicate.reset_defer_inline 2.03% : 0.000003s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000004s : 20: predicate.switch_defer_inline 1.94% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.60% : 0.000010s : 64: predicate.switch_simplify 1.53% : 0.000002s : 13: predicate.tile_eliminate 1.39% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002756 25 61.83% : 0.001704s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.37% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.79% : 0.000986s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.312676 72 0.02% : 0.000059s : 1: add_recomputation 0.03% : 0.000080s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.10% : 0.000324s : 1: bootstrap 0.01% : 0.000041s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.01% : 0.000029s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 2.85% : 0.008909s : 1: jit_opt_a 0.06% : 0.000200s : 1: jit_opt_after_cconv 0.02% : 0.000067s : 1: jit_opt_b 0.19% : 0.000583s : 1: loop_unroll 0.26% : 0.000805s : 1: mutable_eliminate 0.37% : 0.001172s : 26: opt.transform.jit_opt_a 0.02% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000024s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.19% : 0.000584s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.22% : 0.000673s : 1: py_interpret_to_execute 0.01% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000023s : 1: remove_dup_value 0.75% : 0.002359s : 1: renormalize.infer 0.34% : 0.001075s : 1: renormalize.specialize 0.00% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000047s : 1: rewriter_after_opt_a 0.04% : 0.000112s : 1: rewriter_before_opt_a 0.03% : 0.000089s : 1: symbol_engine_optimizer 94.38% : 0.295093s : 1: type_inference TotalTime = 0.181148, [30] [bootstrap]: 0.00032028 [type_inference]: 0.168328 [event_method]: 1.966e-05 [auto_monad]: 7.723e-05 [graph_reusing]: 6.39001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.000465 [rewriter_before_opt_a]: 9.702e-05 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.00912251, [2] [Cycle 1]: 0.00441377, [27] [switch_simplify]: 7.073e-05 [loop_unroll]: 3.183e-05 [a_1]: 0.00068444 [with_stream_mark]: 2.57e-05 [recompute_prepare]: 1.034e-05 [updatestate_depend_eliminate]: 4.04002e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 3.3e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.54001e-06 [accelerated_algorithm]: 6.93998e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.96999e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.636e-05 [j_node_and_user_rematch]: 1.055e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.111e-05 [inline_without_move]: 7.15e-06 [renormalize]: 0.00317991 [add_forward_monad_depend]: 9.77001e-06 [auto_monad_grad]: 2.99999e-06 [auto_monad_eliminator]: 2.098e-05 [cse]: 3.59e-05 [replace_applicator]: 2.531e-05 [Cycle 2]: 0.00043805, [27] [switch_simplify]: 7.48999e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00014267 [with_stream_mark]: 1.904e-05 [recompute_prepare]: 7.63001e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 6.90998e-06 [updatestate_useless_node_eliminater]: 6.44999e-06 [accelerated_algorithm]: 6.75002e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 5.10001e-06 [cell_reuse_recompute_pass]: 3.23e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.069e-05 [j_node_and_user_rematch]: 1.092e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 1.06e-05 [inline_without_move]: 5.71e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.86e-06 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 7.77e-06 [cse]: 1.625e-05 [replace_applicator]: 7.23e-06 [py_interpret_to_execute_after_opt_a]: 1.751e-05 [rewriter_after_opt_a]: 4.003e-05 [convert_after_rewriter]: 7.93999e-06 [order_py_execute_after_rewriter]: 5.16998e-06 [mutable_eliminate]: 0.00083938 [jit_opt_b]: 6.118e-05, [1] [Cycle 1]: 5.232e-05, [2] [frontend_op_eliminate]: 2.09e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 3.513e-05 [loop_unroll]: 0.0004746 [jit_opt_after_cconv]: 0.00018321, [1] [Cycle 1]: 0.00017655, [11] [c_1]: 2.708e-05 [parameter_eliminate]: 4.85999e-06 [updatestate_depend_eliminate]: 8.74e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 3.358e-05 [call_graph_tuple_transform]: 2.859e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 8.2e-06 [remove_dup_value]: 1.678e-05 [partial_unused_args_eliminate]: 3.04999e-06 [environ_conv]: 9.41998e-06 [add_recomputation]: 5.637e-05 [cse_after_recomputation]: 3.149e-05, [1] [Cycle 1]: 2.423e-05, [1] [cse]: 1.623e-05 [auto_monad_reorder]: 1.606e-05 [get_jit_bprop_graph]: 2.59999e-06 [rewriter_after_jit_bprop_graph]: 7.71999e-06 [opt_after_jit_grad]: 0.00049761 [symbol_engine_optimizer]: 8.049e-05, [1] [Cycle 1]: 7.401e-05, [6] [build]: 6.18002e-06 [elim_shapecalc]: 9.07999e-06 [elim_not_effective]: 1.449e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 9.55001e-06 [renormalize]: 5.60016e-07 [validate]: 5.198e-05 Sums bootstrap : 0.000320s : 0.18% type_inference : 0.168328s : 95.56% event_method : 0.000020s : 0.01% auto_monad : 0.000077s : 0.04% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000465s : 0.26% rewriter_before_opt_a : 0.000097s : 0.06% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.04% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000827s : 0.47% jit_opt_a.with_stream_mark : 0.000045s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003180s : 1.81% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000052s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000839s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000020s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000475s : 0.27% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000056s : 0.03% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000498s : 0.28% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.03% Time group info: ------[substitution.] 0.000279 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000006s : 4: substitution.graph_param_transform 85.29% : 0.000238s : 4: substitution.inline 1.67% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.23% : 0.000006s : 4: substitution.remove_not_recompute_node 2.45% : 0.000007s : 2: substitution.replace_old_param 5.06% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.168239 2 98.36% : 0.165473s : 1: type_inference.infer 1.64% : 0.002766s : 1: type_inference.specialize ------[replace.] 0.000089 6 66.32% : 0.000059s : 4: replace.inline 33.68% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 6 94.80% : 0.000236s : 4: match.inline 5.20% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.08% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.74% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 0.92% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.87% : 0.000009s : 26: predicate.inline 1.03% : 0.000002s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.89% : 0.000003s : 8: predicate.less_batch_normalization 1.28% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 18: predicate.load_eliminater 1.98% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.47% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 0.92% : 0.000001s : 12: predicate.minmaximum_grad 3.01% : 0.000005s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 0.97% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.62% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000002s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000004s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.68% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002270 22 65.69% : 0.001491s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.50% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.81% : 0.000722s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.185449 72 0.03% : 0.000060s : 1: add_recomputation 0.04% : 0.000081s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.18% : 0.000339s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 4.92% : 0.009126s : 1: jit_opt_a 0.10% : 0.000187s : 1: jit_opt_after_cconv 0.03% : 0.000064s : 1: jit_opt_b 0.26% : 0.000484s : 1: loop_unroll 0.46% : 0.000852s : 1: mutable_eliminate 0.60% : 0.001106s : 26: opt.transform.jit_opt_a 0.04% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000023s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000507s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000473s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.25% : 0.002321s : 1: renormalize.infer 0.46% : 0.000845s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.06% : 0.000103s : 1: rewriter_before_opt_a 0.05% : 0.000084s : 1: symbol_engine_optimizer 90.78% : 0.168345s : 1: type_inference TotalTime = 0.277041, [30] [bootstrap]: 0.00038226 [type_inference]: 0.234437 [event_method]: 2.693e-05 [auto_monad]: 8.081e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.34999e-06 [py_interpret_to_execute]: 0.00058227 [rewriter_before_opt_a]: 0.00010516 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.0377277, [2] [Cycle 1]: 0.0329446, [27] [switch_simplify]: 6.955e-05 [loop_unroll]: 3.49e-05 [a_1]: 0.00075359 [with_stream_mark]: 2.48e-05 [recompute_prepare]: 9.14e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 7.18e-06 [meta_shard_fg_expand]: 2.73998e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.535e-05 [j_node_and_user_rematch]: 1.041e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.132e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.031645 [add_forward_monad_depend]: 1e-05 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 2.101e-05 [cse]: 3.815e-05 [replace_applicator]: 2.584e-05 [Cycle 2]: 0.00091261, [27] [switch_simplify]: 8.21002e-06 [loop_unroll]: 6.48e-06 [a_1]: 0.00014737 [with_stream_mark]: 1.56e-05 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 2.36998e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 3.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 0.00033425 [inline_without_move]: 1.688e-05 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 3.85e-06 [auto_monad_grad]: 1.79998e-06 [auto_monad_eliminator]: 1.627e-05 [cse]: 2.666e-05 [replace_applicator]: 1.1e-05 [py_interpret_to_execute_after_opt_a]: 1.962e-05 [rewriter_after_opt_a]: 4.652e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 5.16002e-06 [mutable_eliminate]: 0.00173793 [jit_opt_b]: 6.414e-05, [1] [Cycle 1]: 5.487e-05, [2] [frontend_op_eliminate]: 2.08e-05 [inline_after_opt_a]: 2.211e-05 [cconv]: 3.022e-05 [loop_unroll]: 0.0005623 [jit_opt_after_cconv]: 0.00018391, [1] [Cycle 1]: 0.00017719, [11] [c_1]: 2.716e-05 [parameter_eliminate]: 4.07998e-06 [updatestate_depend_eliminate]: 7.41001e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.04001e-06 [cse]: 4.015e-05 [call_graph_tuple_transform]: 2.36e-05 [tuple_list_get_item_eliminator]: 6.61999e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 6.66e-06 [remove_dup_value]: 1.749e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.061e-05 [add_recomputation]: 5.488e-05 [cse_after_recomputation]: 2.515e-05, [1] [Cycle 1]: 1.936e-05, [1] [cse]: 1.315e-05 [auto_monad_reorder]: 1.793e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 9.59e-06 [opt_after_jit_grad]: 0.00050385 [symbol_engine_optimizer]: 0.00012021, [1] [Cycle 1]: 0.00011282, [6] [build]: 4.38999e-06 [elim_shapecalc]: 9.40001e-06 [elim_not_effective]: 1.345e-05 [opt_reshape]: 7.15003e-06 [fold_const_symbol]: 4.845e-05 [renormalize]: 5.89993e-07 [validate]: 5.099e-05 Sums bootstrap : 0.000382s : 0.14% type_inference : 0.234437s : 86.07% event_method : 0.000027s : 0.01% auto_monad : 0.000081s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000582s : 0.21% rewriter_before_opt_a : 0.000105s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.03% jit_opt_a.loop_unroll : 0.000041s : 0.02% jit_opt_a.a_1 : 0.000901s : 0.33% jit_opt_a.with_stream_mark : 0.000040s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000346s : 0.13% jit_opt_a.inline_without_move : 0.000023s : 0.01% jit_opt_a.renormalize : 0.031645s : 11.62% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.01% jit_opt_a.cse : 0.000065s : 0.02% jit_opt_a.replace_applicator : 0.000037s : 0.01% py_interpret_to_execute_after_opt_a : 0.000020s : 0.01% rewriter_after_opt_a : 0.000047s : 0.02% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001738s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000022s : 0.01% cconv : 0.000030s : 0.01% loop_unroll : 0.000562s : 0.21% jit_opt_after_cconv.c_1 : 0.000027s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000040s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.00% add_recomputation : 0.000055s : 0.02% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.00% opt_after_jit_grad : 0.000504s : 0.18% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000048s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.02% Time group info: ------[substitution.] 0.000318 28 0.55% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 4: substitution.graph_param_transform 83.55% : 0.000266s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.83% : 0.000015s : 3: substitution.reduce_eliminate 1.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000006s : 2: substitution.replace_old_param 3.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.234334 2 98.55% : 0.230947s : 1: type_inference.infer 1.45% : 0.003387s : 1: type_inference.specialize ------[replace.] 0.000108 7 69.79% : 0.000076s : 5: replace.inline 30.21% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000273 7 96.17% : 0.000262s : 5: match.inline 3.83% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.21% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.57% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.63% : 0.000008s : 28: predicate.inline 2.05% : 0.000003s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.67% : 0.000003s : 19: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.65% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 2.37% : 0.000004s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.35% : 0.000004s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.11% : 0.000002s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.56% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.02% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.27% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003130 25 67.00% : 0.002097s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.80% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.20% : 0.000945s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.310307 72 0.02% : 0.000058s : 1: add_recomputation 0.03% : 0.000084s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.13% : 0.000403s : 1: bootstrap 0.01% : 0.000033s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000028s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000033s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000009s : 1: graph_reusing 12.16% : 0.037731s : 1: jit_opt_a 0.06% : 0.000186s : 1: jit_opt_after_cconv 0.02% : 0.000067s : 1: jit_opt_b 0.18% : 0.000572s : 1: loop_unroll 0.56% : 0.001751s : 1: mutable_eliminate 0.49% : 0.001509s : 26: opt.transform.jit_opt_a 0.02% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000025s : 1: opt.transform.mutable_eliminate 0.01% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000075s : 4: opt.transform.symbol_engine_opt 0.17% : 0.000514s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000592s : 1: py_interpret_to_execute 0.01% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 9.88% : 0.030650s : 1: renormalize.infer 0.32% : 0.000981s : 1: renormalize.specialize 0.00% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000050s : 1: rewriter_after_opt_a 0.04% : 0.000110s : 1: rewriter_before_opt_a 0.04% : 0.000123s : 1: symbol_engine_optimizer 75.56% : 0.234461s : 1: type_inference TotalTime = 0.319661, [30] [bootstrap]: 0.00050285 [type_inference]: 0.290903 [event_method]: 2.044e-05 [auto_monad]: 7.223e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.0006904 [rewriter_before_opt_a]: 9.168e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.008243, [2] [Cycle 1]: 0.0041041, [27] [switch_simplify]: 6.468e-05 [loop_unroll]: 3.27e-05 [a_1]: 0.00065432 [with_stream_mark]: 2.137e-05 [recompute_prepare]: 1.047e-05 [updatestate_depend_eliminate]: 4.36002e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 7.56001e-06 [updatestate_useless_node_eliminater]: 6.71999e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 9.66998e-06 [meta_fg_expand]: 2.76e-06 [replace_old_param]: 1.069e-05 [inline_without_move]: 6.64001e-06 [renormalize]: 0.00295163 [add_forward_monad_depend]: 7.86001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.889e-05 [cse]: 2.962e-05 [replace_applicator]: 2.182e-05 [Cycle 2]: 0.0004106, [27] [switch_simplify]: 7.25003e-06 [loop_unroll]: 6.23998e-06 [a_1]: 0.0001339 [with_stream_mark]: 1.376e-05 [recompute_prepare]: 6.23998e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.63003e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 3.58e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.771e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.08002e-06 [replace_old_param]: 9.31998e-06 [inline_without_move]: 5.64e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 1.11997e-06 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.365e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.449e-05 [rewriter_after_opt_a]: 3.941e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.45001e-06 [mutable_eliminate]: 0.00073994 [jit_opt_b]: 6.407e-05, [1] [Cycle 1]: 5.441e-05, [2] [frontend_op_eliminate]: 2.421e-05 [inline_after_opt_a]: 1.829e-05 [cconv]: 2.837e-05 [loop_unroll]: 0.0004534 [jit_opt_after_cconv]: 0.0001708, [1] [Cycle 1]: 0.00016398, [11] [c_1]: 2.752e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 7.42002e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.566e-05 [call_graph_tuple_transform]: 2.518e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.20002e-06 [remove_dup_value]: 1.486e-05 [partial_unused_args_eliminate]: 5.64e-06 [environ_conv]: 9.54999e-06 [add_recomputation]: 0.00019669 [cse_after_recomputation]: 3.01e-05, [1] [Cycle 1]: 2.338e-05, [1] [cse]: 1.489e-05 [auto_monad_reorder]: 0.0160959 [get_jit_bprop_graph]: 3.68e-06 [rewriter_after_jit_bprop_graph]: 1.457e-05 [opt_after_jit_grad]: 0.0008485 [symbol_engine_optimizer]: 9.582e-05, [1] [Cycle 1]: 8.744e-05, [6] [build]: 5.55001e-06 [elim_shapecalc]: 9.64e-06 [elim_not_effective]: 1.969e-05 [opt_reshape]: 8.89e-06 [fold_const_symbol]: 1.236e-05 [renormalize]: 1.13001e-06 [validate]: 5.432e-05 Sums bootstrap : 0.000503s : 0.16% type_inference : 0.290903s : 92.28% event_method : 0.000020s : 0.01% auto_monad : 0.000072s : 0.02% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000690s : 0.22% rewriter_before_opt_a : 0.000092s : 0.03% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.02% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000788s : 0.25% jit_opt_a.with_stream_mark : 0.000035s : 0.01% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000007s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002952s : 0.94% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.01% jit_opt_a.cse : 0.000043s : 0.01% jit_opt_a.replace_applicator : 0.000028s : 0.01% py_interpret_to_execute_after_opt_a : 0.000014s : 0.00% rewriter_after_opt_a : 0.000039s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000740s : 0.23% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000028s : 0.01% loop_unroll : 0.000453s : 0.14% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.00% partial_unused_args_eliminate : 0.000006s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000197s : 0.06% cse_after_recomputation.cse : 0.000015s : 0.00% auto_monad_reorder : 0.016096s : 5.11% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000015s : 0.00% opt_after_jit_grad : 0.000848s : 0.27% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000020s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.00% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000054s : 0.02% Time group info: ------[substitution.] 0.000259 24 1.34% : 0.000003s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 3.73% : 0.000010s : 4: substitution.graph_param_transform 82.87% : 0.000215s : 4: substitution.inline 1.64% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000006s : 4: substitution.remove_not_recompute_node 2.21% : 0.000006s : 2: substitution.replace_old_param 5.05% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.290808 2 90.60% : 0.263478s : 1: type_inference.infer 9.40% : 0.027330s : 1: type_inference.specialize ------[replace.] 0.000083 6 67.24% : 0.000056s : 4: replace.inline 32.76% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 6 94.70% : 0.000211s : 4: match.inline 5.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 1.89% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 12: predicate.addn_check_dump 1.51% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000001s : 12: predicate.compare_switch_simplify 1.38% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.68% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.55% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.80% : 0.000003s : 4: predicate.mutable_eliminate 0.81% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.11% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.37% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.78% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002554 22 69.15% : 0.001766s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.92% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.93% : 0.000739s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.323733 72 0.06% : 0.000201s : 1: add_recomputation 0.02% : 0.000076s : 1: auto_monad 4.98% : 0.016117s : 1: auto_monad_reorder 0.16% : 0.000528s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.01% : 0.000032s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.01% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000008s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 2.55% : 0.008247s : 1: jit_opt_a 0.05% : 0.000174s : 1: jit_opt_after_cconv 0.02% : 0.000067s : 1: jit_opt_b 0.14% : 0.000462s : 1: loop_unroll 0.23% : 0.000749s : 1: mutable_eliminate 0.32% : 0.001047s : 26: opt.transform.jit_opt_a 0.02% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000036s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.01% : 0.000038s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.27% : 0.000861s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000008s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000698s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 0.66% : 0.002127s : 1: renormalize.infer 0.25% : 0.000814s : 1: renormalize.specialize 0.01% : 0.000017s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000042s : 1: rewriter_after_opt_a 0.03% : 0.000097s : 1: rewriter_before_opt_a 0.03% : 0.000098s : 1: symbol_engine_optimizer 89.86% : 0.290918s : 1: type_inference TotalTime = 0.0242017, [30] [bootstrap]: 0.00033422 [type_inference]: 0.00793758 [event_method]: 1.989e-05 [auto_monad]: 0.00216686 [graph_reusing]: 6.91999e-06 [pre_auto_parallel]: 2.65002e-06 [py_interpret_to_execute]: 6.601e-05 [rewriter_before_opt_a]: 9.247e-05 [expand_dump_flag]: 2.80997e-06 [jit_opt_a]: 0.00954286, [2] [Cycle 1]: 0.00389557, [27] [switch_simplify]: 7.198e-05 [loop_unroll]: 3.358e-05 [a_1]: 0.00076614 [with_stream_mark]: 2.595e-05 [recompute_prepare]: 1.112e-05 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.44999e-06 [specialize_transform]: 7.43e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 6.48e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.084e-05 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00256664 [add_forward_monad_depend]: 1.249e-05 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 2.302e-05 [cse]: 3.705e-05 [replace_applicator]: 2.437e-05 [Cycle 2]: 0.00038234, [27] [switch_simplify]: 7.73999e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00011309 [with_stream_mark]: 1.752e-05 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 3.02002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.38e-05 [j_node_and_user_rematch]: 8.82e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.54e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 6.94001e-06 [cse]: 1.469e-05 [replace_applicator]: 6.33998e-06 [py_interpret_to_execute_after_opt_a]: 1.704e-05 [rewriter_after_opt_a]: 3.968e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00082734 [jit_opt_b]: 5.466e-05, [1] [Cycle 1]: 4.678e-05, [2] [frontend_op_eliminate]: 1.728e-05 [inline_after_opt_a]: 1.759e-05 [cconv]: 3.314e-05 [loop_unroll]: 0.00047976 [jit_opt_after_cconv]: 0.00144723, [1] [Cycle 1]: 0.00143794, [11] [c_1]: 2.296e-05 [parameter_eliminate]: 4.48999e-06 [updatestate_depend_eliminate]: 8.97999e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.78e-06 [cse]: 2.978e-05 [call_graph_tuple_transform]: 2.158e-05 [tuple_list_get_item_eliminator]: 0.00072206 [none_parameter_eliminate]: 4.28001e-06 [renormalize]: 1.37999e-06 [switch_simplify]: 1.847e-05 [remove_dup_value]: 2.213e-05 [partial_unused_args_eliminate]: 2.91999e-06 [environ_conv]: 8.05e-06 [add_recomputation]: 6.061e-05 [cse_after_recomputation]: 3.646e-05, [1] [Cycle 1]: 2.906e-05, [1] [cse]: 2.254e-05 [auto_monad_reorder]: 1.824e-05 [get_jit_bprop_graph]: 2.81e-06 [rewriter_after_jit_bprop_graph]: 8.70001e-06 [opt_after_jit_grad]: 0.00062581 [symbol_engine_optimizer]: 8.183e-05, [1] [Cycle 1]: 7.51e-05, [6] [build]: 4.16001e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.692e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 9.01998e-06 [renormalize]: 5.19998e-07 [validate]: 4.589e-05 Sums bootstrap : 0.000334s : 1.89% type_inference : 0.007938s : 44.82% event_method : 0.000020s : 0.11% auto_monad : 0.002167s : 12.24% graph_reusing : 0.000007s : 0.04% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000066s : 0.37% rewriter_before_opt_a : 0.000092s : 0.52% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000080s : 0.45% jit_opt_a.loop_unroll : 0.000040s : 0.23% jit_opt_a.a_1 : 0.000879s : 4.97% jit_opt_a.with_stream_mark : 0.000043s : 0.25% jit_opt_a.recompute_prepare : 0.000017s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.03% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000014s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000013s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.11% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000020s : 0.11% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.002567s : 14.49% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.17% jit_opt_a.cse : 0.000052s : 0.29% jit_opt_a.replace_applicator : 0.000031s : 0.17% py_interpret_to_execute_after_opt_a : 0.000017s : 0.10% rewriter_after_opt_a : 0.000040s : 0.22% convert_after_rewriter : 0.000007s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000827s : 4.67% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.10% jit_opt_b.inline_after_opt_a : 0.000018s : 0.10% cconv : 0.000033s : 0.19% loop_unroll : 0.000480s : 2.71% jit_opt_after_cconv.c_1 : 0.000023s : 0.13% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.17% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.12% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000722s : 4.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000018s : 0.10% remove_dup_value : 0.000022s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000061s : 0.34% cse_after_recomputation.cse : 0.000023s : 0.13% auto_monad_reorder : 0.000018s : 0.10% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000009s : 0.05% opt_after_jit_grad : 0.000626s : 3.53% symbol_engine_optimizer.build : 0.000004s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.26% Time group info: ------[substitution.] 0.000324 27 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.02% : 0.000007s : 3: substitution.graph_param_transform 84.02% : 0.000273s : 5: substitution.inline 1.48% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.23% : 0.000014s : 3: substitution.reduce_eliminate 1.40% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000007s : 2: substitution.replace_old_param 3.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007877 2 87.14% : 0.006864s : 1: type_inference.infer 12.86% : 0.001013s : 1: type_inference.specialize ------[replace.] 0.000133 7 75.48% : 0.000100s : 5: replace.inline 24.52% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000280 7 96.32% : 0.000270s : 5: match.inline 3.68% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000846 747 0.19% : 0.000002s : 11: predicate.accumulaten_eliminater 0.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.18% : 0.000002s : 11: predicate.addn_check_dump 0.21% : 0.000002s : 11: predicate.addn_zero_filter 0.35% : 0.000003s : 11: predicate.arithmetic_simplify 0.28% : 0.000002s : 11: predicate.cast_eliminate 0.07% : 0.000001s : 3: predicate.check_bprop_eliminate 0.18% : 0.000001s : 11: predicate.compare_switch_simplify 0.19% : 0.000002s : 11: predicate.depend_value_elim 0.18% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 0.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 0.18% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.09% : 0.000001s : 3: predicate.elim_not_effective 0.07% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.19% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.17% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.17% : 0.000001s : 11: predicate.environ_get_depend_swap 0.18% : 0.000001s : 11: predicate.environ_get_eliminate 0.18% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.03% : 0.000000s : 3: predicate.fold_const_symbol 0.18% : 0.000001s : 6: predicate.get_grad_eliminate 0.06% : 0.000000s : 3: predicate.graph_param_transform 0.94% : 0.000008s : 24: predicate.inline 0.13% : 0.000001s : 6: predicate.inline_without_move 0.06% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.28% : 0.000002s : 6: predicate.less_batch_normalization 0.30% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 0.32% : 0.000003s : 16: predicate.load_eliminater 0.19% : 0.000002s : 3: predicate.loop_unroll_after_grad 0.67% : 0.000006s : 38: predicate.loop_unroll_before_grad 0.36% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.17% : 0.000001s : 11: predicate.merge_addn 0.17% : 0.000001s : 11: predicate.minmaximum_grad 0.29% : 0.000002s : 3: predicate.mutable_eliminate 0.11% : 0.000001s : 3: predicate.opt_reshape 0.34% : 0.000003s : 16: predicate.partial_eliminate 0.20% : 0.000002s : 11: predicate.print_const_string_wrapper 0.32% : 0.000003s : 11: predicate.reduce_eliminate 0.25% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.14% : 0.000001s : 6: predicate.remove_not_recompute_node 0.32% : 0.000003s : 19: predicate.replace_applicator 0.10% : 0.000001s : 6: predicate.replace_old_param 0.08% : 0.000001s : 3: predicate.reset_defer_inline 0.24% : 0.000002s : 11: predicate.reshape_eliminate 0.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.12% : 0.000001s : 3: predicate.row_tensor_eliminate 0.23% : 0.000002s : 11: predicate.same_eliminate 0.10% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.15% : 0.000001s : 6: predicate.special_op_eliminate 0.17% : 0.000001s : 6: predicate.specialize_transform 0.22% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 0.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.06% : 0.000000s : 3: predicate.switch_call_monad_eliminater 0.40% : 0.000003s : 18: predicate.switch_defer_inline 0.39% : 0.000003s : 18: predicate.switch_layer_defer_inline 1.43% : 0.000012s : 59: predicate.switch_simplify 0.19% : 0.000002s : 11: predicate.tile_eliminate 0.19% : 0.000002s : 11: predicate.transpose_eliminate 0.27% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 0.20% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 83.89% : 0.000709s : 19: predicate.tuple_list_get_item_eliminator 0.26% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 0.27% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 0.27% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 0.41% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 0.32% : 0.000003s : 11: predicate.value_based_eliminate 0.05% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.10% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000913 16 42.04% : 0.000384s : 7: func_graph_cloner_run.FuncGraphClonerGraph 10.39% : 0.000095s : 2: func_graph_cloner_run.FuncGraphClonerNode 47.58% : 0.000434s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.028692 72 0.22% : 0.000063s : 1: add_recomputation 7.61% : 0.002182s : 1: auto_monad 0.07% : 0.000021s : 1: auto_monad_reorder 1.22% : 0.000351s : 1: bootstrap 0.12% : 0.000036s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000039s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.08% : 0.000023s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000011s : 1: graph_reusing 33.28% : 0.009548s : 1: jit_opt_a 5.06% : 0.001451s : 1: jit_opt_after_cconv 0.20% : 0.000058s : 1: jit_opt_b 1.71% : 0.000490s : 1: loop_unroll 2.93% : 0.000840s : 1: mutable_eliminate 3.98% : 0.001141s : 26: opt.transform.jit_opt_a 2.71% : 0.000779s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000028s : 4: opt.transform.jit_opt_b 0.05% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000018s : 1: opt.transform.mutable_eliminate 0.08% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000038s : 4: opt.transform.symbol_engine_opt 2.22% : 0.000636s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.24% : 0.000070s : 1: py_interpret_to_execute 0.07% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000025s : 1: remove_dup_value 7.28% : 0.002088s : 1: renormalize.infer 1.63% : 0.000468s : 1: renormalize.specialize 0.04% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.15% : 0.000043s : 1: rewriter_after_opt_a 0.33% : 0.000096s : 1: rewriter_before_opt_a 0.29% : 0.000084s : 1: symbol_engine_optimizer 27.71% : 0.007949s : 1: type_inference TotalTime = 0.233927, [30] [bootstrap]: 0.00035646 [type_inference]: 0.208789 [event_method]: 2.084e-05 [auto_monad]: 7.748e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 0.00055468 [rewriter_before_opt_a]: 9.544e-05 [expand_dump_flag]: 4.17e-06 [jit_opt_a]: 0.021196, [2] [Cycle 1]: 0.0165953, [27] [switch_simplify]: 6.891e-05 [loop_unroll]: 3.172e-05 [a_1]: 0.00066708 [with_stream_mark]: 2.385e-05 [recompute_prepare]: 1.041e-05 [updatestate_depend_eliminate]: 4.45999e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.46001e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 7.75e-06 [meta_shard_fg_expand]: 2.30002e-06 [get_grad_eliminate_]: 7.40003e-06 [merge_forward]: 4.81997e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.644e-05 [j_node_and_user_rematch]: 1.164e-05 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 0.0120816 [inline_without_move]: 1.938e-05 [renormalize]: 0.00326835 [add_forward_monad_depend]: 9.87999e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 2.041e-05 [cse]: 3.765e-05 [replace_applicator]: 2.265e-05 [Cycle 2]: 0.00054427, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.39001e-06 [a_1]: 0.00013556 [with_stream_mark]: 1.67e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 3.28e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.018e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.45002e-06 [replace_old_param]: 1.17e-05 [inline_without_move]: 5.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.79998e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 9.57999e-06 [cse]: 1.605e-05 [replace_applicator]: 6.91999e-06 [py_interpret_to_execute_after_opt_a]: 1.567e-05 [rewriter_after_opt_a]: 4.027e-05 [convert_after_rewriter]: 7.99002e-06 [order_py_execute_after_rewriter]: 5.67999e-06 [mutable_eliminate]: 0.00080127 [jit_opt_b]: 6.215e-05, [1] [Cycle 1]: 5.419e-05, [2] [frontend_op_eliminate]: 2.17e-05 [inline_after_opt_a]: 1.903e-05 [cconv]: 3.529e-05 [loop_unroll]: 0.00046757 [jit_opt_after_cconv]: 0.0001816, [1] [Cycle 1]: 0.00017454, [11] [c_1]: 2.826e-05 [parameter_eliminate]: 4.28999e-06 [updatestate_depend_eliminate]: 8.2e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 5.17999e-06 [cse]: 3.065e-05 [call_graph_tuple_transform]: 2.483e-05 [tuple_list_get_item_eliminator]: 6.60997e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 6.42001e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.038e-05 [add_recomputation]: 5.411e-05 [cse_after_recomputation]: 0.00017935, [1] [Cycle 1]: 0.00017294, [1] [cse]: 0.00016335 [auto_monad_reorder]: 1.914e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 8.05e-06 [opt_after_jit_grad]: 0.00054569 [symbol_engine_optimizer]: 9.178e-05, [1] [Cycle 1]: 8.464e-05, [6] [build]: 4.83001e-06 [elim_shapecalc]: 1.028e-05 [elim_not_effective]: 1.894e-05 [opt_reshape]: 8.23999e-06 [fold_const_symbol]: 1.147e-05 [renormalize]: 4.80009e-07 [validate]: 5.314e-05 Sums bootstrap : 0.000356s : 0.16% type_inference : 0.208789s : 91.17% event_method : 0.000021s : 0.01% auto_monad : 0.000077s : 0.03% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000555s : 0.24% rewriter_before_opt_a : 0.000095s : 0.04% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.03% jit_opt_a.loop_unroll : 0.000038s : 0.02% jit_opt_a.a_1 : 0.000803s : 0.35% jit_opt_a.with_stream_mark : 0.000041s : 0.02% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.012093s : 5.28% jit_opt_a.inline_without_move : 0.000025s : 0.01% jit_opt_a.renormalize : 0.003268s : 1.43% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.01% jit_opt_a.cse : 0.000054s : 0.02% jit_opt_a.replace_applicator : 0.000030s : 0.01% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.02% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000801s : 0.35% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000035s : 0.02% loop_unroll : 0.000468s : 0.20% jit_opt_after_cconv.c_1 : 0.000028s : 0.01% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.00% add_recomputation : 0.000054s : 0.02% cse_after_recomputation.cse : 0.000163s : 0.07% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.00% opt_after_jit_grad : 0.000546s : 0.24% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000019s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000053s : 0.02% Time group info: ------[substitution.] 0.012316 24 0.02% : 0.000003s : 2: substitution.elim_not_effective 0.01% : 0.000002s : 2: substitution.fold_const_symbol 0.05% : 0.000007s : 4: substitution.graph_param_transform 1.87% : 0.000230s : 4: substitution.inline 0.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 0.05% : 0.000006s : 4: substitution.remove_not_recompute_node 97.84% : 0.012051s : 2: substitution.replace_old_param 0.11% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.208694 2 98.53% : 0.205625s : 1: type_inference.infer 1.47% : 0.003069s : 1: type_inference.specialize ------[replace.] 0.000083 6 65.78% : 0.000055s : 4: replace.inline 34.22% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 94.63% : 0.000227s : 4: match.inline 5.37% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.98% : 0.000002s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 2.16% : 0.000003s : 12: predicate.arithmetic_simplify 1.54% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.64% : 0.000003s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.74% : 0.000009s : 26: predicate.inline 2.41% : 0.000004s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.79% : 0.000003s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.42% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 1.96% : 0.000003s : 18: predicate.partial_eliminate 1.05% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000003s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 1.94% : 0.000003s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000004s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000011s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.62% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002595 22 66.29% : 0.001720s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.11% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.60% : 0.000820s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.250413 72 0.02% : 0.000057s : 1: add_recomputation 0.03% : 0.000081s : 1: auto_monad 0.01% : 0.000023s : 1: auto_monad_reorder 0.15% : 0.000376s : 1: bootstrap 0.02% : 0.000038s : 1: cconv 0.00% : 0.000010s : 1: convert_after_rewriter 0.07% : 0.000182s : 1: cse_after_recomputation 0.00% : 0.000013s : 1: environ_conv 0.01% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 8.47% : 0.021200s : 1: jit_opt_a 0.07% : 0.000184s : 1: jit_opt_after_cconv 0.03% : 0.000065s : 1: jit_opt_b 0.19% : 0.000477s : 1: loop_unroll 0.33% : 0.000815s : 1: mutable_eliminate 5.25% : 0.013155s : 26: opt.transform.jit_opt_a 0.02% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.01% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000044s : 4: opt.transform.symbol_engine_opt 0.22% : 0.000557s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000564s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 0.93% : 0.002326s : 1: renormalize.infer 0.37% : 0.000927s : 1: renormalize.specialize 0.00% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000043s : 1: rewriter_after_opt_a 0.04% : 0.000102s : 1: rewriter_before_opt_a 0.04% : 0.000095s : 1: symbol_engine_optimizer 83.39% : 0.208811s : 1: type_inference TotalTime = 0.152735, [30] [bootstrap]: 0.00039222 [type_inference]: 0.138557 [event_method]: 2.775e-05 [auto_monad]: 8.063e-05 [graph_reusing]: 7.23999e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00191791 [rewriter_before_opt_a]: 0.0001163 [expand_dump_flag]: 4.77e-06 [jit_opt_a]: 0.00854892, [2] [Cycle 1]: 0.00434051, [27] [switch_simplify]: 6.768e-05 [loop_unroll]: 3.61e-05 [a_1]: 0.00074737 [with_stream_mark]: 2.54e-05 [recompute_prepare]: 9.47999e-06 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 6.93998e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.56999e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 6.51999e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 1.115e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.143e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00306638 [add_forward_monad_depend]: 8.84e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 2.021e-05 [cse]: 3.604e-05 [replace_applicator]: 2.118e-05 [Cycle 2]: 0.00040561, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.42001e-06 [a_1]: 0.00013534 [with_stream_mark]: 1.439e-05 [recompute_prepare]: 7.46001e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 5.72001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.97999e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.444e-05 [replace_applicator]: 6.35002e-06 [py_interpret_to_execute_after_opt_a]: 1.475e-05 [rewriter_after_opt_a]: 4.129e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.0007274 [jit_opt_b]: 8.718e-05, [1] [Cycle 1]: 7.911e-05, [2] [frontend_op_eliminate]: 4.668e-05 [inline_after_opt_a]: 1.906e-05 [cconv]: 3.245e-05 [loop_unroll]: 0.00045031 [jit_opt_after_cconv]: 0.00057565, [1] [Cycle 1]: 0.00056772, [11] [c_1]: 0.00040188 [parameter_eliminate]: 4.72998e-06 [updatestate_depend_eliminate]: 1.07e-05 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.98001e-06 [cse]: 3.355e-05 [call_graph_tuple_transform]: 2.768e-05 [tuple_list_get_item_eliminator]: 8.13001e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.728e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 1.045e-05 [add_recomputation]: 5.525e-05 [cse_after_recomputation]: 2.855e-05, [1] [Cycle 1]: 2.118e-05, [1] [cse]: 1.441e-05 [auto_monad_reorder]: 1.879e-05 [get_jit_bprop_graph]: 2.21998e-06 [rewriter_after_jit_bprop_graph]: 7.54002e-06 [opt_after_jit_grad]: 0.00053755 [symbol_engine_optimizer]: 8.484e-05, [1] [Cycle 1]: 7.832e-05, [6] [build]: 4.68999e-06 [elim_shapecalc]: 1.207e-05 [elim_not_effective]: 1.588e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 1.002e-05 [renormalize]: 8.2e-07 [validate]: 5.816e-05 Sums bootstrap : 0.000392s : 0.26% type_inference : 0.138557s : 93.52% event_method : 0.000028s : 0.02% auto_monad : 0.000081s : 0.05% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001918s : 1.29% rewriter_before_opt_a : 0.000116s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.03% jit_opt_a.a_1 : 0.000883s : 0.60% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003066s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000050s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000727s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000047s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000032s : 0.02% loop_unroll : 0.000450s : 0.30% jit_opt_after_cconv.c_1 : 0.000402s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000538s : 0.36% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000058s : 0.04% Time group info: ------[substitution.] 0.000311 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000007s : 4: substitution.graph_param_transform 83.93% : 0.000261s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.26% : 0.000013s : 3: substitution.reduce_eliminate 1.48% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000007s : 2: substitution.replace_old_param 3.70% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.138450 2 97.70% : 0.135272s : 1: type_inference.infer 2.30% : 0.003178s : 1: type_inference.specialize ------[replace.] 0.000105 7 69.05% : 0.000072s : 5: replace.inline 30.95% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000269 7 96.18% : 0.000258s : 5: match.inline 3.82% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.08% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 2.10% : 0.000003s : 13: predicate.arithmetic_simplify 1.19% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.87% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.53% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 6.27% : 0.000009s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.39% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.48% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002711 25 66.62% : 0.001806s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.24% : 0.000088s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.13% : 0.000817s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.157323 72 0.04% : 0.000059s : 1: add_recomputation 0.05% : 0.000084s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000406s : 1: bootstrap 0.02% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000033s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 5.44% : 0.008552s : 1: jit_opt_a 0.37% : 0.000580s : 1: jit_opt_after_cconv 0.06% : 0.000090s : 1: jit_opt_b 0.29% : 0.000459s : 1: loop_unroll 0.47% : 0.000737s : 1: mutable_eliminate 0.73% : 0.001148s : 26: opt.transform.jit_opt_a 0.28% : 0.000440s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000058s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000546s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 1.23% : 0.001940s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.41% : 0.002215s : 1: renormalize.infer 0.53% : 0.000839s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000122s : 1: rewriter_before_opt_a 0.06% : 0.000087s : 1: symbol_engine_optimizer 88.09% : 0.138587s : 1: type_inference TotalTime = 0.149061, [30] [bootstrap]: 0.00031906 [type_inference]: 0.116765 [event_method]: 1.961e-05 [auto_monad]: 7.961e-05 [graph_reusing]: 6.08002e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.00031984 [rewriter_before_opt_a]: 9.687e-05 [expand_dump_flag]: 4.47998e-06 [jit_opt_a]: 0.0286007, [2] [Cycle 1]: 0.00401968, [27] [switch_simplify]: 6.99e-05 [loop_unroll]: 3.471e-05 [a_1]: 0.00072891 [with_stream_mark]: 2.46e-05 [recompute_prepare]: 9.45001e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 4.00998e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 7.8e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.84999e-06 [merge_forward]: 4.04002e-06 [cell_reuse_recompute_pass]: 1.87001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.767e-05 [j_node_and_user_rematch]: 1.073e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.136e-05 [inline_without_move]: 7.18998e-06 [renormalize]: 0.0027459 [add_forward_monad_depend]: 9.47001e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 2.091e-05 [cse]: 3.304e-05 [replace_applicator]: 2.348e-05 [Cycle 2]: 0.00040868, [27] [switch_simplify]: 7.8e-06 [loop_unroll]: 6.46999e-06 [a_1]: 0.00014092 [with_stream_mark]: 1.47e-05 [recompute_prepare]: 6.13002e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.63002e-06 [specialize_transform]: 6.56999e-06 [updatestate_useless_node_eliminater]: 6.38e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 2.89001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.027e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.81998e-06 [inline_without_move]: 5.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.96001e-06 [cse]: 1.198e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.593e-05 [rewriter_after_opt_a]: 3.853e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00087432 [jit_opt_b]: 6.797e-05, [1] [Cycle 1]: 5.734e-05, [2] [frontend_op_eliminate]: 2.332e-05 [inline_after_opt_a]: 2.045e-05 [cconv]: 3.573e-05 [loop_unroll]: 0.00050723 [jit_opt_after_cconv]: 0.0001887, [1] [Cycle 1]: 0.00018151, [11] [c_1]: 2.991e-05 [parameter_eliminate]: 5.32999e-06 [updatestate_depend_eliminate]: 1.077e-05 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 3.352e-05 [call_graph_tuple_transform]: 2.759e-05 [tuple_list_get_item_eliminator]: 6.47001e-06 [none_parameter_eliminate]: 2.00002e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 6.96001e-06 [remove_dup_value]: 1.714e-05 [partial_unused_args_eliminate]: 3.08e-06 [environ_conv]: 1.048e-05 [add_recomputation]: 5.425e-05 [cse_after_recomputation]: 2.464e-05, [1] [Cycle 1]: 1.847e-05, [1] [cse]: 1.239e-05 [auto_monad_reorder]: 1.565e-05 [get_jit_bprop_graph]: 2.38998e-06 [rewriter_after_jit_bprop_graph]: 8.55999e-06 [opt_after_jit_grad]: 0.00052415 [symbol_engine_optimizer]: 0.0001857, [1] [Cycle 1]: 0.00017927, [6] [build]: 5.05001e-06 [elim_shapecalc]: 9.47001e-06 [elim_not_effective]: 1.695e-05 [opt_reshape]: 0.00010293 [fold_const_symbol]: 1.377e-05 [renormalize]: 4.10015e-07 [validate]: 5.801e-05 Sums bootstrap : 0.000319s : 0.26% type_inference : 0.116765s : 94.00% event_method : 0.000020s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000320s : 0.26% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000870s : 0.70% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002746s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000874s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000507s : 0.41% jit_opt_after_cconv.c_1 : 0.000030s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000524s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000103s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000058s : 0.05% Time group info: ------[substitution.] 0.000329 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.55% : 0.000008s : 4: substitution.graph_param_transform 86.42% : 0.000285s : 4: substitution.inline 1.37% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000007s : 4: substitution.remove_not_recompute_node 1.86% : 0.000006s : 2: substitution.replace_old_param 4.34% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116665 2 98.09% : 0.114436s : 1: type_inference.infer 1.91% : 0.002229s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.23% : 0.000058s : 4: replace.inline 31.77% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000295 6 95.56% : 0.000282s : 4: match.inline 4.44% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.58% : 0.000002s : 12: predicate.addn_zero_filter 2.29% : 0.000003s : 12: predicate.arithmetic_simplify 1.49% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.49% : 0.000002s : 12: predicate.depend_value_elim 0.97% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.91% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.59% : 0.000008s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000003s : 18: predicate.load_eliminater 1.66% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.79% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000002s : 12: predicate.minmaximum_grad 2.35% : 0.000003s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.05% : 0.000002s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 1.02% : 0.000002s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.10% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.93% : 0.000010s : 58: predicate.switch_simplify 1.11% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.69% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.69% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003220 30 74.36% : 0.002394s : 23: func_graph_cloner_run.FuncGraphClonerGraph 3.16% : 0.000102s : 1: func_graph_cloner_run.FuncGraphClonerNode 22.49% : 0.000724s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.153122 72 0.04% : 0.000057s : 1: add_recomputation 0.05% : 0.000084s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000333s : 1: bootstrap 0.03% : 0.000038s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 18.68% : 0.028605s : 1: jit_opt_a 0.13% : 0.000191s : 1: jit_opt_after_cconv 0.05% : 0.000071s : 1: jit_opt_b 0.34% : 0.000517s : 1: loop_unroll 0.58% : 0.000885s : 1: mutable_eliminate 0.75% : 0.001143s : 26: opt.transform.jit_opt_a 0.04% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000138s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000534s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.21% : 0.000328s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.23% : 0.001881s : 1: renormalize.infer 0.56% : 0.000852s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000103s : 1: rewriter_before_opt_a 0.12% : 0.000189s : 1: symbol_engine_optimizer 76.27% : 0.116785s : 1: type_inference TotalTime = 0.070273, [30] [bootstrap]: 0.00030678 [type_inference]: 0.0584515 [event_method]: 1.971e-05 [auto_monad]: 7.089e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.28998e-06 [py_interpret_to_execute]: 0.0003283 [rewriter_before_opt_a]: 8.77e-05 [expand_dump_flag]: 3.64002e-06 [jit_opt_a]: 0.00835948, [2] [Cycle 1]: 0.00380142, [27] [switch_simplify]: 6.735e-05 [loop_unroll]: 3.204e-05 [a_1]: 0.00067597 [with_stream_mark]: 2.467e-05 [recompute_prepare]: 1.162e-05 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 2.29999e-06 [specialize_transform]: 8.15e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 6.77002e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 7.06001e-06 [merge_forward]: 4.97e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.803e-05 [j_node_and_user_rematch]: 1.148e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.198e-05 [inline_without_move]: 7.19001e-06 [renormalize]: 0.00258392 [add_forward_monad_depend]: 9.76e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.954e-05 [cse]: 2.811e-05 [replace_applicator]: 2.476e-05 [Cycle 2]: 0.00040617, [27] [switch_simplify]: 7.33999e-06 [loop_unroll]: 6.81001e-06 [a_1]: 0.0001354 [with_stream_mark]: 1.489e-05 [recompute_prepare]: 6.89001e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 2.06003e-06 [specialize_transform]: 6.18002e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.10002e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.923e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 1.071e-05 [inline_without_move]: 5.72999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 6.30002e-06 [cse]: 1.208e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.576e-05 [rewriter_after_opt_a]: 3.693e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 5.52001e-06 [mutable_eliminate]: 0.00078478 [jit_opt_b]: 5.886e-05, [1] [Cycle 1]: 5.102e-05, [2] [frontend_op_eliminate]: 2.027e-05 [inline_after_opt_a]: 1.888e-05 [cconv]: 2.91e-05 [loop_unroll]: 0.00043686 [jit_opt_after_cconv]: 0.00016631, [1] [Cycle 1]: 0.00015981, [11] [c_1]: 2.725e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 5.84e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.525e-05 [call_graph_tuple_transform]: 2.405e-05 [tuple_list_get_item_eliminator]: 7.5e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.89999e-06 [remove_dup_value]: 1.623e-05 [partial_unused_args_eliminate]: 2.05002e-06 [environ_conv]: 8.56002e-06 [add_recomputation]: 5.033e-05 [cse_after_recomputation]: 2.315e-05, [1] [Cycle 1]: 1.706e-05, [1] [cse]: 1.099e-05 [auto_monad_reorder]: 1.553e-05 [get_jit_bprop_graph]: 0.00010779 [rewriter_after_jit_bprop_graph]: 7.05e-06 [opt_after_jit_grad]: 0.00054146 [symbol_engine_optimizer]: 8.717e-05, [1] [Cycle 1]: 8.051e-05, [6] [build]: 4.98001e-06 [elim_shapecalc]: 9.46e-06 [elim_not_effective]: 1.642e-05 [opt_reshape]: 7.48999e-06 [fold_const_symbol]: 1.186e-05 [renormalize]: 8.50006e-07 [validate]: 4.882e-05 Sums bootstrap : 0.000307s : 0.47% type_inference : 0.058451s : 89.28% event_method : 0.000020s : 0.03% auto_monad : 0.000071s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000328s : 0.50% rewriter_before_opt_a : 0.000088s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000075s : 0.11% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000811s : 1.24% jit_opt_a.with_stream_mark : 0.000040s : 0.06% jit_opt_a.recompute_prepare : 0.000019s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000014s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000023s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.002584s : 3.95% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000040s : 0.06% jit_opt_a.replace_applicator : 0.000031s : 0.05% py_interpret_to_execute_after_opt_a : 0.000016s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000785s : 1.20% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000029s : 0.04% loop_unroll : 0.000437s : 0.67% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000108s : 0.16% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000541s : 0.83% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.07% Time group info: ------[substitution.] 0.000275 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000002s : 2: substitution.fold_const_symbol 2.40% : 0.000007s : 4: substitution.graph_param_transform 84.61% : 0.000233s : 4: substitution.inline 1.71% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000006s : 2: substitution.replace_old_param 5.12% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058363 2 96.37% : 0.056242s : 1: type_inference.infer 3.63% : 0.002120s : 1: type_inference.specialize ------[replace.] 0.000086 6 65.48% : 0.000056s : 4: replace.inline 34.52% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 6 94.72% : 0.000230s : 4: match.inline 5.28% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.60% : 0.000004s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.32% : 0.000002s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.37% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.54% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.41% : 0.000004s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.36% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.83% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.53% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.97% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.11% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.38% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 1.85% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.94% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002495 26 70.84% : 0.001768s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.16% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.00% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.074018 72 0.07% : 0.000053s : 1: add_recomputation 0.10% : 0.000074s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000326s : 1: bootstrap 0.04% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.15% : 0.000111s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.30% : 0.008363s : 1: jit_opt_a 0.23% : 0.000169s : 1: jit_opt_after_cconv 0.08% : 0.000061s : 1: jit_opt_b 0.60% : 0.000445s : 1: loop_unroll 1.07% : 0.000794s : 1: mutable_eliminate 1.47% : 0.001086s : 26: opt.transform.jit_opt_a 0.08% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000550s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000335s : 1: py_interpret_to_execute 0.02% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.39% : 0.001769s : 1: renormalize.infer 1.08% : 0.000801s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000040s : 1: rewriter_after_opt_a 0.13% : 0.000093s : 1: rewriter_before_opt_a 0.12% : 0.000090s : 1: symbol_engine_optimizer 78.99% : 0.058468s : 1: type_inference TotalTime = 0.0166897, [30] [bootstrap]: 0.00043458 [type_inference]: 0.00577967 [event_method]: 2.044e-05 [auto_monad]: 9.883e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 4.087e-05 [rewriter_before_opt_a]: 9.495e-05 [expand_dump_flag]: 3.04001e-06 [jit_opt_a]: 0.00759902, [2] [Cycle 1]: 0.00262399, [27] [switch_simplify]: 6.694e-05 [loop_unroll]: 3.153e-05 [a_1]: 0.00111268 [with_stream_mark]: 2.819e-05 [recompute_prepare]: 1.025e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 2.43002e-06 [specialize_transform]: 6.66999e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 2.43e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.677e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 5.46e-06 [renormalize]: 0.00099062 [add_forward_monad_depend]: 7.21001e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.688e-05 [cse]: 3.206e-05 [replace_applicator]: 1.641e-05 [Cycle 2]: 0.00033647, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.263e-05 [with_stream_mark]: 1.224e-05 [recompute_prepare]: 5.42001e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 5.30999e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.99e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 2.16998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.54e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 5.10999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.72001e-06 [auto_monad_grad]: 8.99978e-07 [auto_monad_eliminator]: 7.12002e-06 [cse]: 1.1e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 1.27e-05 [rewriter_after_opt_a]: 0.00011595 [convert_after_rewriter]: 8.77999e-06 [order_py_execute_after_rewriter]: 6.03002e-06 [mutable_eliminate]: 0.00075123 [jit_opt_b]: 5.72e-05, [1] [Cycle 1]: 4.778e-05, [2] [frontend_op_eliminate]: 1.869e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 3.513e-05 [loop_unroll]: 0.00044301 [jit_opt_after_cconv]: 0.0001849, [1] [Cycle 1]: 0.00017764, [11] [c_1]: 2.157e-05 [parameter_eliminate]: 3.76001e-06 [updatestate_depend_eliminate]: 9.69999e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.952e-05 [call_graph_tuple_transform]: 4e-05 [tuple_list_get_item_eliminator]: 5.90002e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 1.02e-06 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.65e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 5.65001e-06 [add_recomputation]: 5.646e-05 [cse_after_recomputation]: 2.433e-05, [1] [Cycle 1]: 1.83e-05, [1] [cse]: 1.154e-05 [auto_monad_reorder]: 1.61e-05 [get_jit_bprop_graph]: 2.73e-06 [rewriter_after_jit_bprop_graph]: 6.21e-06 [opt_after_jit_grad]: 0.00052173 [symbol_engine_optimizer]: 8.013e-05, [1] [Cycle 1]: 7.323e-05, [6] [build]: 5.18002e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.459e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 9.56e-06 [renormalize]: 5.59987e-07 [validate]: 4.461e-05 Sums bootstrap : 0.000435s : 3.82% type_inference : 0.005780s : 50.82% event_method : 0.000020s : 0.18% auto_monad : 0.000099s : 0.87% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000041s : 0.36% rewriter_before_opt_a : 0.000095s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000073s : 0.64% jit_opt_a.loop_unroll : 0.000037s : 0.32% jit_opt_a.a_1 : 0.001205s : 10.60% jit_opt_a.with_stream_mark : 0.000040s : 0.36% jit_opt_a.recompute_prepare : 0.000016s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.16% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000991s : 8.71% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.21% jit_opt_a.cse : 0.000043s : 0.38% jit_opt_a.replace_applicator : 0.000022s : 0.19% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000116s : 1.02% convert_after_rewriter : 0.000009s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000751s : 6.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.16% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000035s : 0.31% loop_unroll : 0.000443s : 3.90% jit_opt_after_cconv.c_1 : 0.000022s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000030s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000040s : 0.35% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000056s : 0.50% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000016s : 0.14% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000522s : 4.59% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.39% Time group info: ------[substitution.] 0.000273 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.63% : 0.000007s : 3: substitution.graph_param_transform 84.68% : 0.000231s : 4: substitution.inline 1.71% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.12% : 0.000006s : 4: substitution.remove_not_recompute_node 2.16% : 0.000006s : 2: substitution.replace_old_param 5.25% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005642 2 83.36% : 0.004704s : 1: type_inference.infer 16.64% : 0.000939s : 1: type_inference.specialize ------[replace.] 0.000106 6 66.98% : 0.000071s : 4: replace.inline 33.02% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 6 94.78% : 0.000228s : 4: match.inline 5.22% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 691 1.19% : 0.000002s : 10: predicate.accumulaten_eliminater 0.88% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.96% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000002s : 10: predicate.addn_zero_filter 2.38% : 0.000003s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 0.97% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.96% : 0.000001s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.97% : 0.000008s : 22: predicate.inline 0.77% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.56% : 0.000002s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.00% : 0.000001s : 10: predicate.minmaximum_grad 1.62% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.33% : 0.000002s : 10: predicate.print_const_string_wrapper 2.05% : 0.000003s : 10: predicate.reduce_eliminate 1.36% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.62% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.09% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 53: predicate.switch_simplify 1.22% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 2.50% : 0.000003s : 10: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.52% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000741 13 50.88% : 0.000377s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.71% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.41% : 0.000307s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019189 72 0.32% : 0.000061s : 1: add_recomputation 0.54% : 0.000105s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 2.39% : 0.000458s : 1: bootstrap 0.20% : 0.000038s : 1: cconv 0.06% : 0.000012s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 39.62% : 0.007603s : 1: jit_opt_a 0.98% : 0.000188s : 1: jit_opt_after_cconv 0.31% : 0.000060s : 1: jit_opt_b 2.36% : 0.000453s : 1: loop_unroll 3.98% : 0.000764s : 1: mutable_eliminate 7.54% : 0.001446s : 26: opt.transform.jit_opt_a 0.36% : 0.000069s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000028s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000018s : 1: opt.transform.mutable_eliminate 0.13% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000532s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.23% : 0.000043s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 3.01% : 0.000577s : 1: renormalize.infer 2.10% : 0.000402s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.62% : 0.000120s : 1: rewriter_after_opt_a 0.52% : 0.000099s : 1: rewriter_before_opt_a 0.43% : 0.000083s : 1: symbol_engine_optimizer 30.24% : 0.005802s : 1: type_inference TotalTime = 1.13527, [30] [bootstrap]: 0.00033388 [type_inference]: 1.11911 [event_method]: 2.874e-05 [auto_monad]: 8.275e-05 [graph_reusing]: 6.96999e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00066417 [rewriter_before_opt_a]: 0.00011439 [expand_dump_flag]: 4.09002e-06 [jit_opt_a]: 0.0123243, [2] [Cycle 1]: 0.00584485, [27] [switch_simplify]: 9.242e-05 [loop_unroll]: 3.7e-05 [a_1]: 0.00076381 [with_stream_mark]: 2.367e-05 [recompute_prepare]: 2.804e-05 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 3.35998e-06 [updatestate_loads_eliminate]: 3.73999e-06 [parameter_eliminate]: 2.68e-06 [specialize_transform]: 8.32998e-06 [updatestate_useless_node_eliminater]: 6.98e-06 [accelerated_algorithm]: 6.70002e-06 [meta_shard_fg_expand]: 3.29001e-06 [get_grad_eliminate_]: 7.51001e-06 [merge_forward]: 4.63001e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.663e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.96001e-06 [replace_old_param]: 1.418e-05 [inline_without_move]: 6.98998e-06 [renormalize]: 0.00450194 [add_forward_monad_depend]: 7.65e-06 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 1.865e-05 [cse]: 3.762e-05 [replace_applicator]: 1.768e-05 [Cycle 2]: 0.00051896, [27] [switch_simplify]: 7.31001e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00013539 [with_stream_mark]: 1.243e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.57997e-06 [cell_reuse_recompute_pass]: 2.93e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 0.00010602 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.99e-06 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 8.28001e-06 [cse]: 1.761e-05 [replace_applicator]: 7.20998e-06 [py_interpret_to_execute_after_opt_a]: 1.544e-05 [rewriter_after_opt_a]: 4.12e-05 [convert_after_rewriter]: 2.447e-05 [order_py_execute_after_rewriter]: 5.76e-06 [mutable_eliminate]: 0.00069633 [jit_opt_b]: 5.578e-05, [1] [Cycle 1]: 4.905e-05, [2] [frontend_op_eliminate]: 1.986e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 2.741e-05 [loop_unroll]: 0.00049402 [jit_opt_after_cconv]: 0.00015786, [1] [Cycle 1]: 0.00015181, [11] [c_1]: 2.889e-05 [parameter_eliminate]: 2.91999e-06 [updatestate_depend_eliminate]: 5.60001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [cse]: 2.207e-05 [call_graph_tuple_transform]: 2.129e-05 [tuple_list_get_item_eliminator]: 6.74999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.876e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 8.37e-06 [add_recomputation]: 5.375e-05 [cse_after_recomputation]: 2.323e-05, [1] [Cycle 1]: 1.799e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 7.051e-05 [get_jit_bprop_graph]: 2.47001e-06 [rewriter_after_jit_bprop_graph]: 4.82998e-06 [opt_after_jit_grad]: 0.00053402 [symbol_engine_optimizer]: 0.00010669, [1] [Cycle 1]: 0.00010002, [6] [build]: 4.03999e-06 [elim_shapecalc]: 9.84999e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 3.686e-05 [renormalize]: 3.60014e-07 [validate]: 4.76e-05 Sums bootstrap : 0.000334s : 0.03% type_inference : 1.119111s : 99.16% event_method : 0.000029s : 0.00% auto_monad : 0.000083s : 0.01% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000664s : 0.06% rewriter_before_opt_a : 0.000114s : 0.01% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000100s : 0.01% jit_opt_a.loop_unroll : 0.000043s : 0.00% jit_opt_a.a_1 : 0.000899s : 0.08% jit_opt_a.with_stream_mark : 0.000036s : 0.00% jit_opt_a.recompute_prepare : 0.000034s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.00% jit_opt_a.accelerated_algorithm : 0.000013s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000116s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000025s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004502s : 0.40% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.00% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.00% jit_opt_a.cse : 0.000055s : 0.00% jit_opt_a.replace_applicator : 0.000025s : 0.00% py_interpret_to_execute_after_opt_a : 0.000015s : 0.00% rewriter_after_opt_a : 0.000041s : 0.00% convert_after_rewriter : 0.000024s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000696s : 0.06% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000027s : 0.00% loop_unroll : 0.000494s : 0.04% jit_opt_after_cconv.c_1 : 0.000029s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.00% add_recomputation : 0.000054s : 0.00% cse_after_recomputation.cse : 0.000012s : 0.00% auto_monad_reorder : 0.000071s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000534s : 0.05% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000037s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.00% Time group info: ------[substitution.] 0.000341 28 0.56% : 0.000002s : 2: substitution.elim_not_effective 8.04% : 0.000027s : 2: substitution.fold_const_symbol 1.81% : 0.000006s : 4: substitution.graph_param_transform 78.32% : 0.000267s : 5: substitution.inline 1.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.87% : 0.000013s : 3: substitution.reduce_eliminate 1.32% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000005s : 2: substitution.replace_old_param 3.26% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 1.119001 2 99.56% : 1.114120s : 1: type_inference.infer 0.44% : 0.004881s : 1: type_inference.specialize ------[replace.] 0.000112 7 69.11% : 0.000077s : 5: replace.inline 30.89% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 96.34% : 0.000264s : 5: match.inline 3.66% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.13% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.59% : 0.000002s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.73% : 0.000003s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000004s : 19: predicate.partial_eliminate 1.40% : 0.000002s : 13: predicate.print_const_string_wrapper 2.43% : 0.000004s : 13: predicate.reduce_eliminate 1.62% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 13: predicate.reshape_eliminate 1.46% : 0.000002s : 13: predi TotalTime = 0.02229, [30] [bootstrap]: 0.00034118 [type_inference]: 0.00601018 [event_method]: 2.138e-05 [auto_monad]: 6.871e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 5.404e-05 [rewriter_before_opt_a]: 7.919e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.012603, [2] [Cycle 1]: 0.0083857, [27] [switch_simplify]: 6.323e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.00061031 [with_stream_mark]: 2.389e-05 [recompute_prepare]: 9.05001e-06 [updatestate_depend_eliminate]: 4.70001e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 5.63002e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 7.661e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 1.099e-05 [inline_without_move]: 5.59e-06 [renormalize]: 0.00712969 [add_forward_monad_depend]: 1.997e-05 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 2.943e-05 [cse]: 3.787e-05 [replace_applicator]: 2.786e-05 [Cycle 2]: 0.00039848, [27] [switch_simplify]: 6.56e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00011128 [with_stream_mark]: 2.133e-05 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 4.12998e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 5.57001e-06 [updatestate_useless_node_eliminater]: 5.21998e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 4.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.218e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 1.046e-05 [inline_without_move]: 5.27001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.44998e-06 [auto_monad_grad]: 1.81e-06 [auto_monad_eliminator]: 8.67e-06 [cse]: 1.265e-05 [replace_applicator]: 6.60002e-06 [py_interpret_to_execute_after_opt_a]: 2.041e-05 [rewriter_after_opt_a]: 4.037e-05 [convert_after_rewriter]: 7.86001e-06 [order_py_execute_after_rewriter]: 5.62999e-06 [mutable_eliminate]: 0.00095537 [jit_opt_b]: 6.536e-05, [1] [Cycle 1]: 5.227e-05, [2] [frontend_op_eliminate]: 2.15e-05 [inline_after_opt_a]: 1.871e-05 [cconv]: 4.01e-05 [loop_unroll]: 0.00059148 [jit_opt_after_cconv]: 0.00019223, [1] [Cycle 1]: 0.00018311, [11] [c_1]: 2.466e-05 [parameter_eliminate]: 6.11998e-06 [updatestate_depend_eliminate]: 1.234e-05 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [cse]: 3.994e-05 [call_graph_tuple_transform]: 2.722e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.48003e-06 [remove_dup_value]: 1.816e-05 [partial_unused_args_eliminate]: 2.61999e-06 [environ_conv]: 7.08e-06 [add_recomputation]: 6.184e-05 [cse_after_recomputation]: 2.565e-05, [1] [Cycle 1]: 1.936e-05, [1] [cse]: 1.236e-05 [auto_monad_reorder]: 1.656e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 1.002e-05 [opt_after_jit_grad]: 0.00066879 [symbol_engine_optimizer]: 8.741e-05, [1] [Cycle 1]: 7.922e-05, [6] [build]: 6.71e-06 [elim_shapecalc]: 1.012e-05 cate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.34% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.58% : 0.000011s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.52% : 0.000002s : 13: predicate.transpose_eliminate 1.74% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.87% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.79% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003185 25 58.40% : 0.001860s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000083s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.01% : 0.001243s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 1.141151 72 0.00% : 0.000056s : 1: add_recomputation 0.01% : 0.000086s : 1: auto_monad 0.01% : 0.000075s : 1: auto_monad_reorder 0.03% : 0.000344s : 1: bootstrap 0.00% : 0.000030s : 1: cconv 0.00% : 0.000028s : 1: convert_after_rewriter 0.00% : 0.000025s : 1: cse_after_recomputation 0.00% : 0.000011s : 1: environ_conv 0.00% : 0.000034s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.00% : 0.000010s : 1: graph_reusing 1.08% : 0.012328s : 1: jit_opt_a 0.01% : 0.000161s : 1: jit_opt_after_cconv 0.01% : 0.000058s : 1: jit_opt_b 0.04% : 0.000502s : 1: loop_unroll 0.06% : 0.000704s : 1: mutable_eliminate 0.11% : 0.001301s : 26: opt.transform.jit_opt_a 0.01% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.00% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.00% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.01% : 0.000063s : 4: opt.transform.symbol_engine_opt 0.05% : 0.000541s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.06% : 0.000670s : 1: py_interpret_to_execute 0.00% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000021s : 1: remove_dup_value 0.29% : 0.003255s : 1: renormalize.infer 0.11% : 0.001235s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.00% : 0.000044s : 1: rewriter_after_opt_a 0.01% : 0.000120s : 1: rewriter_before_opt_a 0.01% : 0.000109s : 1: symbol_engine_optimizer 98.07% : 1.119137s : 1: type_inference [elim_not_effective]: 1.796e-05 [opt_reshape]: 6.83998e-06 [fold_const_symbol]: 9.39e-06 [renormalize]: 5.00004e-07 [validate]: 5.035e-05 Sums bootstrap : 0.000341s : 1.92% type_inference : 0.006010s : 33.88% event_method : 0.000021s : 0.12% auto_monad : 0.000069s : 0.39% graph_reusing : 0.000006s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000054s : 0.30% rewriter_before_opt_a : 0.000079s : 0.45% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000070s : 0.39% jit_opt_a.loop_unroll : 0.000037s : 0.21% jit_opt_a.a_1 : 0.000722s : 4.07% jit_opt_a.with_stream_mark : 0.000045s : 0.25% jit_opt_a.recompute_prepare : 0.000015s : 0.09% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.06% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.06% jit_opt_a.accelerated_algorithm : 0.000011s : 0.06% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.06% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000086s : 0.48% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000021s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.06% jit_opt_a.renormalize : 0.007130s : 40.19% jit_opt_a.add_forward_monad_depend : 0.000021s : 0.12% jit_opt_a.auto_monad_grad : 0.000005s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.21% jit_opt_a.cse : 0.000051s : 0.28% jit_opt_a.replace_applicator : 0.000034s : 0.19% py_interpret_to_execute_after_opt_a : 0.000020s : 0.12% rewriter_after_opt_a : 0.000040s : 0.23% convert_after_rewriter : 0.000008s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.03% mutable_eliminate : 0.000955s : 5.39% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.12% jit_opt_b.inline_after_opt_a : 0.000019s : 0.11% cconv : 0.000040s : 0.23% loop_unroll : 0.000591s : 3.33% jit_opt_after_cconv.c_1 : 0.000025s : 0.14% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000012s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000040s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.03% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.10% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.04% add_recomputation : 0.000062s : 0.35% cse_after_recomputation.cse : 0.000012s : 0.07% auto_monad_reorder : 0.000017s : 0.09% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000010s : 0.06% opt_after_jit_grad : 0.000669s : 3.77% symbol_engine_optimizer.build : 0.000007s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.05% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.28% Time group info: ------[substitution.] 0.000275 23 0.95% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 3: substitution.graph_param_transform 84.56% : 0.000232s : 4: substitution.inline 1.84% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000007s : 4: substitution.remove_not_recompute_node 2.80% : 0.000008s : 2: substitution.replace_old_param 4.49% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005925 2 81.75% : 0.004844s : 1: type_inference.infer 18.25% : 0.001081s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.20% : 0.000053s : 4: replace.inline 31.80% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 95.43% : 0.000229s : 4: match.inline 4.57% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.76% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.90% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.43% : 0.000003s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000002s : 10: predicate.compare_switch_simplify 1.02% : 0.000001s : 10: predicate.depend_value_elim 1.41% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.05% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.90% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000002s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000008s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.63% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 15: predicate.load_eliminater 1.88% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.50% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.91% : 0.000001s : 10: predicate.merge_addn 0.96% : 0.000001s : 10: predicate.minmaximum_grad 2.79% : 0.000004s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.03% : 0.000003s : 15: predicate.partial_eliminate 0.98% : 0.000001s : 10: predicate.print_const_string_wrapper 2.14% : 0.000003s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000003s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.66% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 10: predicate.reshape_eliminate 1.16% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.15% : 0.000002s : 3: predicate.row_tensor_eliminate 1.12% : 0.000002s : 10: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 6: predicate.special_op_eliminate 0.82% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.34% : 0.000000s : 3: predicate.switch_call_monad_eliminater 1.92% : 0.000003s : 16: predicate.switch_defer_inline 1.79% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.36% : 0.000010s : 53: predicate.switch_simplify 1.19% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.47% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.37% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000940 13 45.63% : 0.000429s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.70% : 0.000054s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.67% : 0.000458s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.030524 72 0.21% : 0.000065s : 1: add_recomputation 0.24% : 0.000072s : 1: auto_monad 0.06% : 0.000019s : 1: auto_monad_reorder 1.20% : 0.000365s : 1: bootstrap 0.14% : 0.000043s : 1: cconv 0.03% : 0.000010s : 1: convert_after_rewriter 0.09% : 0.000028s : 1: cse_after_recomputation 0.03% : 0.000009s : 1: environ_conv 0.08% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.03% : 0.000008s : 1: graph_reusing 41.30% : 0.012608s : 1: jit_opt_a 0.64% : 0.000196s : 1: jit_opt_after_cconv 0.23% : 0.000069s : 1: jit_opt_b 1.98% : 0.000603s : 1: loop_unroll 3.18% : 0.000972s : 1: mutable_eliminate 3.42% : 0.001045s : 26: opt.transform.jit_opt_a 0.20% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.10% : 0.000032s : 4: opt.transform.jit_opt_b 0.05% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000025s : 1: opt.transform.mutable_eliminate 0.10% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000040s : 4: opt.transform.symbol_engine_opt 2.23% : 0.000682s : 1: opt_after_jit_grad 0.03% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000057s : 1: py_interpret_to_execute 0.08% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000021s : 1: remove_dup_value 21.12% : 0.006447s : 1: renormalize.infer 2.16% : 0.000661s : 1: renormalize.specialize 0.04% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.14% : 0.000044s : 1: rewriter_after_opt_a 0.27% : 0.000083s : 1: rewriter_before_opt_a 0.30% : 0.000091s : 1: symbol_engine_optimizer 19.77% : 0.006034s : 1: type_inference . TotalTime = 0.143092, [30] [bootstrap]: 0.0003815 [type_inference]: 0.129483 [event_method]: 2.472e-05 [auto_monad]: 8.32e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00057847 [rewriter_before_opt_a]: 0.00010001 [expand_dump_flag]: 3.86001e-06 [jit_opt_a]: 0.00953016, [2] [Cycle 1]: 0.00457761, [27] [switch_simplify]: 7.216e-05 [loop_unroll]: 3.156e-05 [a_1]: 0.00069104 [with_stream_mark]: 2.752e-05 [recompute_prepare]: 1.089e-05 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.14001e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.22997e-06 [updatestate_useless_node_eliminater]: 6.18998e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 6.75002e-06 [merge_forward]: 3.72002e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 1.058e-05 [meta_fg_expand]: 2.88003e-06 [replace_old_param]: 1.226e-05 [inline_without_move]: 6.71e-06 [renormalize]: 0.00333145 [add_forward_monad_depend]: 1.06e-05 [auto_monad_grad]: 3.11001e-06 [auto_monad_eliminator]: 2.235e-05 [cse]: 3.519e-05 [replace_applicator]: 2.654e-05 [Cycle 2]: 0.00040405, [27] [switch_simplify]: 7.19001e-06 [loop_unroll]: 6.63e-06 [a_1]: 0.00013635 [with_stream_mark]: 1.582e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.96998e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.947e-05 [j_node_and_user_rematch]: 1.011e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.04e-05 [inline_without_move]: 6.14001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.83998e-06 [cse]: 1.181e-05 [replace_applicator]: 6.44999e-06 [py_interpret_to_execute_after_opt_a]: 1.578e-05 [rewriter_after_opt_a]: 3.896e-05 [convert_after_rewriter]: 7.22997e-06 [order_py_execute_after_rewriter]: 5.49e-06 [mutable_eliminate]: 0.00080074 [jit_opt_b]: 6.015e-05, [1] [Cycle 1]: 5.163e-05, [2] [frontend_op_eliminate]: 2.171e-05 [inline_after_opt_a]: 1.887e-05 [cconv]: 2.991e-05 [loop_unroll]: 0.00046996 [jit_opt_after_cconv]: 0.00016867, [1] [Cycle 1]: 0.00016184, [11] [c_1]: 2.717e-05 [parameter_eliminate]: 4.23999e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.915e-05 [call_graph_tuple_transform]: 2.449e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 7.14001e-06 [remove_dup_value]: 1.6e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 1.011e-05 [add_recomputation]: 5.369e-05 [cse_after_recomputation]: 0.000121, [1] [Cycle 1]: 2.186e-05, [1] [cse]: 1.477e-05 [auto_monad_reorder]: 1.649e-05 [get_jit_bprop_graph]: 2.56998e-06 [rewriter_after_jit_bprop_graph]: 8.48999e-06 [opt_after_jit_grad]: 0.00054233 [symbol_engine_optimizer]: 8.866e-05, [1] [Cycle 1]: 8.169e-05, [6] [build]: 4.78001e-06 [elim_shapecalc]: 1.036e-05 [elim_not_effective]: 1.717e-05 [opt_reshape]: 8.15e-06 [fold_const_symbol]: 1.122e-05 [renormalize]: 5.50004e-07 [validate]: 0.00020174 Sums bootstrap : 0.000381s : 0.28% type_inference : 0.129483s : 93.99% event_method : 0.000025s : 0.02% auto_monad : 0.000083s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000578s : 0.42% rewriter_before_opt_a : 0.000100s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000079s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000827s : 0.60% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003332s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000047s : 0.03% jit_opt_a.replace_applicator : 0.000033s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000801s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000470s : 0.34% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000542s : 0.39% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000202s : 0.15% Time group info: ------[substitution.] 0.000294 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000002s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 85.99% : 0.000253s : 4: substitution.inline 1.61% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.02% : 0.000006s : 4: substitution.remove_not_recompute_node 2.53% : 0.000007s : 2: substitution.replace_old_param 4.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.129373 2 97.38% : 0.125980s : 1: type_inference.infer 2.62% : 0.003393s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.67% : 0.000058s : 4: replace.inline 31.33% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 6 95.46% : 0.000250s : 4: match.inline 4.54% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 2.11% : 0.000003s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.29% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.81% : 0.000009s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.83% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.45% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.81% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 2.21% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.83% : 0.000001s : 8: predicate.specialize_transform 1.70% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000010s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.96% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000003s : 12: predicate.value_based_eliminate 0.48% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002873 22 64.27% : 0.001846s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.04% : 0.000059s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.69% : 0.000968s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147420 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000087s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.27% : 0.000401s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000123s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000030s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.47% : 0.009534s : 1: jit_opt_a 0.12% : 0.000172s : 1: jit_opt_after_cconv 0.04% : 0.000062s : 1: jit_opt_b 0.33% : 0.000479s : 1: loop_unroll 0.55% : 0.000811s : 1: mutable_eliminate 0.75% : 0.001101s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000588s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.55% : 0.002286s : 1: renormalize.infer 0.70% : 0.001031s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000106s : 1: rewriter_before_opt_a 0.06% : 0.000091s : 1: symbol_engine_optimizer 87.85% : 0.129509s : 1: type_inference TotalTime = 0.127468, [30] [bootstrap]: 0.00034749 [type_inference]: 0.114229 [event_method]: 2.019e-05 [auto_monad]: 7.125e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.13002e-06 [py_interpret_to_execute]: 0.00060917 [rewriter_before_opt_a]: 9.545e-05 [expand_dump_flag]: 4.67e-06 [jit_opt_a]: 0.00907037, [2] [Cycle 1]: 0.00467545, [27] [switch_simplify]: 6.757e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00061162 [with_stream_mark]: 1.915e-05 [recompute_prepare]: 9.22001e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 7.00998e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 6.33998e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 1.105e-05 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00353932 [add_forward_monad_depend]: 1.084e-05 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.073e-05 [cse]: 3.592e-05 [replace_applicator]: 2.529e-05 [Cycle 2]: 0.0004079, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.28998e-06 [a_1]: 0.00013301 [with_stream_mark]: 1.497e-05 [recompute_prepare]: 6.01003e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.94001e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 3.75e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.009e-05 [j_node_and_user_rematch]: 1.047e-05 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.30999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.62998e-06 [cse]: 1.504e-05 [replace_applicator]: 6.43998e-06 [py_interpret_to_execute_after_opt_a]: 1.852e-05 [rewriter_after_opt_a]: 4.054e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 5.79e-06 [mutable_eliminate]: 0.00079677 [jit_opt_b]: 6.49e-05, [1] [Cycle 1]: 5.523e-05, [2] [frontend_op_eliminate]: 2.064e-05 [inline_after_opt_a]: 2.108e-05 [cconv]: 3.202e-05 [loop_unroll]: 0.00050099 [jit_opt_after_cconv]: 0.00018268, [1] [Cycle 1]: 0.00017393, [11] [c_1]: 2.548e-05 [parameter_eliminate]: 4.90001e-06 [updatestate_depend_eliminate]: 8.20999e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.572e-05 [call_graph_tuple_transform]: 2.623e-05 [tuple_list_get_item_eliminator]: 6.47001e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 9.29984e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.599e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 1.264e-05 [add_recomputation]: 5.672e-05 [cse_after_recomputation]: 2.743e-05, [1] [Cycle 1]: 2.036e-05, [1] [cse]: 1.263e-05 [auto_monad_reorder]: 1.895e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 9.60001e-06 [opt_after_jit_grad]: 0.00081259 [symbol_engine_optimizer]: 9.033e-05, [1] [Cycle 1]: 8.207e-05, [6] [build]: 5.59e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.698e-05 [opt_reshape]: 8.38999e-06 [fold_const_symbol]: 1.158e-05 [renormalize]: 1.10999e-06 [validate]: 5.6e-05 Sums bootstrap : 0.000347s : 0.28% type_inference : 0.114229s : 93.05% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000609s : 0.50% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000075s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000745s : 0.61% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003539s : 2.88% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000797s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000501s : 0.41% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000057s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000010s : 0.01% opt_after_jit_grad : 0.000813s : 0.66% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000056s : 0.05% Time group info: ------[substitution.] 0.000230 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.96% : 0.000007s : 4: substitution.graph_param_transform 82.94% : 0.000190s : 4: substitution.inline 1.96% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000006s : 2: substitution.replace_old_param 5.40% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114148 2 97.46% : 0.111244s : 1: type_inference.infer 2.54% : 0.002904s : 1: type_inference.specialize ------[replace.] 0.000083 6 66.96% : 0.000055s : 4: replace.inline 33.04% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 94.33% : 0.000188s : 4: match.inline 5.67% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.47% : 0.000002s : 12: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.65% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 0.95% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.31% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.66% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.08% : 0.000007s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 2.13% : 0.000003s : 8: predicate.less_batch_normalization 1.80% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.10% : 0.000003s : 18: predicate.load_eliminater 1.79% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.43% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.98% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.35% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003001 22 60.20% : 0.001807s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.08% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 38.71% : 0.001162s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132093 72 0.05% : 0.000060s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.28% : 0.000369s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000081s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.87% : 0.009075s : 1: jit_opt_a 0.14% : 0.000185s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.39% : 0.000510s : 1: loop_unroll 0.61% : 0.000807s : 1: mutable_eliminate 0.76% : 0.001009s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.03% : 0.000034s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.62% : 0.000824s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000620s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.69% : 0.002230s : 1: renormalize.infer 0.98% : 0.001297s : 1: renormalize.specialize 0.01% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.07% : 0.000093s : 1: symbol_engine_optimizer 86.49% : 0.114245s : 1: type_inference TotalTime = 0.13037, [30] [bootstrap]: 0.00030256 [type_inference]: 0.118159 [event_method]: 2.34e-05 [auto_monad]: 7.781e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 0.00072108 [rewriter_before_opt_a]: 9.811e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00856313, [2] [Cycle 1]: 0.00445069, [27] [switch_simplify]: 7.045e-05 [loop_unroll]: 3.34e-05 [a_1]: 0.00065889 [with_stream_mark]: 2.42e-05 [recompute_prepare]: 1.02e-05 [updatestate_depend_eliminate]: 4.51002e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 7.29001e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 6.47001e-06 [merge_forward]: 4.11001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.767e-05 [j_node_and_user_rematch]: 1.109e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00325453 [add_forward_monad_depend]: 9.04e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.973e-05 [cse]: 3.163e-05 [replace_applicator]: 2.771e-05 [Cycle 2]: 0.0004237, [27] [switch_simplify]: 7.9e-06 [loop_unroll]: 7.73001e-06 [a_1]: 0.00015144 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 7.13e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 3.04999e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 3.66001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.954e-05 [j_node_and_user_rematch]: 1.043e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 9.68002e-06 [inline_without_move]: 6.56e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.246e-05 [replace_applicator]: 6.43e-06 [py_interpret_to_execute_after_opt_a]: 1.414e-05 [rewriter_after_opt_a]: 3.719e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00075472 [jit_opt_b]: 5.839e-05, [1] [Cycle 1]: 5.051e-05, [2] [frontend_op_eliminate]: 1.925e-05 [inline_after_opt_a]: 1.891e-05 [cconv]: 2.508e-05 [loop_unroll]: 0.0004266 [jit_opt_after_cconv]: 0.00015516, [1] [Cycle 1]: 0.00014823, [11] [c_1]: 2.638e-05 [parameter_eliminate]: 3.97e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.282e-05 [call_graph_tuple_transform]: 2.103e-05 [tuple_list_get_item_eliminator]: 6.46999e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 7.2e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.536e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 7.98999e-06 [add_recomputation]: 4.592e-05 [cse_after_recomputation]: 2.286e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.548e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 5.94e-06 [opt_after_jit_grad]: 0.00046253 [symbol_engine_optimizer]: 8.115e-05, [1] [Cycle 1]: 7.503e-05, [6] [build]: 4.32e-06 [elim_shapecalc]: 9.01002e-06 [elim_not_effective]: 1.52e-05 [opt_reshape]: 7.51999e-06 [fold_const_symbol]: 1.02e-05 [renormalize]: 3.19997e-07 [validate]: 4.538e-05 Sums bootstrap : 0.000303s : 0.24% type_inference : 0.118159s : 93.77% event_method : 0.000023s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000721s : 0.57% rewriter_before_opt_a : 0.000098s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000078s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000810s : 0.64% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003255s : 2.58% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000044s : 0.03% jit_opt_a.replace_applicator : 0.000034s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000755s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000427s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000463s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000272 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000007s : 4: substitution.graph_param_transform 85.16% : 0.000231s : 4: substitution.inline 1.83% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000007s : 4: substitution.remove_not_recompute_node 2.19% : 0.000006s : 2: substitution.replace_old_param 4.63% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118051 2 97.33% : 0.114899s : 1: type_inference.infer 2.67% : 0.003151s : 1: type_inference.specialize ------[replace.] 0.000082 6 70.21% : 0.000058s : 4: replace.inline 29.79% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000240 6 95.25% : 0.000229s : 4: match.inline 4.75% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.45% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.26% : 0.000002s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 2.32% : 0.000003s : 12: predicate.arithmetic_simplify 1.42% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000001s : 12: predicate.compare_switch_simplify 1.36% : 0.000002s : 12: predicate.depend_value_elim 1.27% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.30% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.59% : 0.000002s : 12: predicate.environ_get_eliminate 1.51% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000008s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000002s : 12: predicate.minmaximum_grad 1.92% : 0.000003s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.10% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.13% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.50% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002543 22 62.90% : 0.001600s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.23% : 0.000057s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.87% : 0.000887s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134760 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000321s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.36% : 0.008567s : 1: jit_opt_a 0.12% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.32% : 0.000435s : 1: loop_unroll 0.57% : 0.000765s : 1: mutable_eliminate 0.81% : 0.001086s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.55% : 0.000737s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.70% : 0.002288s : 1: renormalize.infer 0.71% : 0.000955s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.06% : 0.000083s : 1: symbol_engine_optimizer 87.70% : 0.118184s : 1: type_inference TotalTime = 0.126988, [30] [bootstrap]: 0.00030445 [type_inference]: 0.114154 [event_method]: 2.329e-05 [auto_monad]: 7.501e-05 [graph_reusing]: 6.12999e-06 [pre_auto_parallel]: 2.46e-06 [py_interpret_to_execute]: 0.00052423 [rewriter_before_opt_a]: 9.554e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00902141, [2] [Cycle 1]: 0.00456473, [27] [switch_simplify]: 7.33e-05 [loop_unroll]: 3.163e-05 [a_1]: 0.00068308 [with_stream_mark]: 2.445e-05 [recompute_prepare]: 1.177e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 6.94999e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 3.54002e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 1.204e-05 [meta_fg_expand]: 2.59999e-06 [replace_old_param]: 1.064e-05 [inline_without_move]: 6.61e-06 [renormalize]: 0.00333145 [add_forward_monad_depend]: 9.43002e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 2.134e-05 [cse]: 3.445e-05 [replace_applicator]: 2.414e-05 [Cycle 2]: 0.00042951, [27] [switch_simplify]: 8.03999e-06 [loop_unroll]: 6.59999e-06 [a_1]: 0.00013353 [with_stream_mark]: 1.535e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 3.63999e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 2.17999e-06 [specialize_transform]: 6.38003e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 3.44001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.149e-05 [j_node_and_user_rematch]: 1.089e-05 [meta_fg_expand]: 3.08e-06 [replace_old_param]: 9.90002e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 2.507e-05 [cse]: 1.512e-05 [replace_applicator]: 6.59001e-06 [py_interpret_to_execute_after_opt_a]: 1.544e-05 [rewriter_after_opt_a]: 3.93e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 6.51e-06 [mutable_eliminate]: 0.0007617 [jit_opt_b]: 6.151e-05, [1] [Cycle 1]: 5.346e-05, [2] [frontend_op_eliminate]: 2.141e-05 [inline_after_opt_a]: 2.044e-05 [cconv]: 2.666e-05 [loop_unroll]: 0.00054483 [jit_opt_after_cconv]: 0.00017677, [1] [Cycle 1]: 0.0001696, [11] [c_1]: 2.678e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.753e-05 [call_graph_tuple_transform]: 2.874e-05 [tuple_list_get_item_eliminator]: 6.57002e-06 [none_parameter_eliminate]: 2.01003e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 1.04e-05 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 9.15999e-06 [add_recomputation]: 0.00021874 [cse_after_recomputation]: 2.969e-05, [1] [Cycle 1]: 2.261e-05, [1] [cse]: 1.452e-05 [auto_monad_reorder]: 1.638e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 8.45999e-06 [opt_after_jit_grad]: 0.00050316 [symbol_engine_optimizer]: 8.271e-05, [1] [Cycle 1]: 7.597e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 9.79999e-06 [elim_not_effective]: 1.535e-05 [opt_reshape]: 6.93e-06 [fold_const_symbol]: 1.089e-05 [renormalize]: 6.19999e-07 [validate]: 4.812e-05 Sums bootstrap : 0.000304s : 0.25% type_inference : 0.114154s : 93.35% event_method : 0.000023s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000524s : 0.43% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.07% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000817s : 0.67% jit_opt_a.with_stream_mark : 0.000040s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003332s : 2.72% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000046s : 0.04% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000762s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000545s : 0.45% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000029s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000219s : 0.18% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000503s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000288 24 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 4: substitution.graph_param_transform 85.53% : 0.000246s : 4: substitution.inline 1.90% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000006s : 2: substitution.replace_old_param 4.73% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114054 2 97.19% : 0.110844s : 1: type_inference.infer 2.81% : 0.003210s : 1: type_inference.specialize ------[replace.] 0.000091 6 68.32% : 0.000062s : 4: replace.inline 31.68% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 6 95.28% : 0.000243s : 4: match.inline 4.72% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.73% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.03% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 1.01% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.08% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.91% : 0.000009s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.81% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.40% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.42% : 0.000001s : 4: predicate.opt_reshape 1.98% : 0.000003s : 18: predicate.partial_eliminate 1.04% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.66% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000002s : 8: predicate.special_op_eliminate 1.15% : 0.000002s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.16% : 0.000011s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002503 22 63.80% : 0.001597s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.38% : 0.000060s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.82% : 0.000846s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131493 72 0.17% : 0.000223s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000319s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.86% : 0.009025s : 1: jit_opt_a 0.14% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.42% : 0.000554s : 1: loop_unroll 0.59% : 0.000771s : 1: mutable_eliminate 0.83% : 0.001094s : 26: opt.transform.jit_opt_a 0.05% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000533s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.84% : 0.002418s : 1: renormalize.infer 0.69% : 0.000902s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.06% : 0.000085s : 1: symbol_engine_optimizer 86.83% : 0.114178s : 1: type_inference TotalTime = 0.0947995, [30] [bootstrap]: 0.00120977 [type_inference]: 0.0833199 [event_method]: 1.935e-05 [auto_monad]: 6.39e-05 [graph_reusing]: 5.37001e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 0.00027717 [rewriter_before_opt_a]: 8.213e-05 [expand_dump_flag]: 3.27002e-06 [jit_opt_a]: 0.00756695, [2] [Cycle 1]: 0.00357756, [27] [switch_simplify]: 5.955e-05 [loop_unroll]: 3.283e-05 [a_1]: 0.00057927 [with_stream_mark]: 1.728e-05 [recompute_prepare]: 8.15999e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 9.77001e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00254576 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 2.15002e-06 [auto_monad_eliminator]: 1.589e-05 [cse]: 2.936e-05 [replace_applicator]: 1.534e-05 [Cycle 2]: 0.00036379, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00012592 [with_stream_mark]: 9.17999e-06 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 2.95998e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.93002e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 8.85999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 5.70001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.50002e-06 [cse]: 1.193e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 9.56e-06 [rewriter_after_opt_a]: 3.369e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00063278 [jit_opt_b]: 5.291e-05, [1] [Cycle 1]: 4.696e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.746e-05 [cconv]: 2.543e-05 [loop_unroll]: 0.00041494 [jit_opt_after_cconv]: 0.00014461, [1] [Cycle 1]: 0.00013857, [11] [c_1]: 2.498e-05 [parameter_eliminate]: 2.15002e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 2.057e-05 [call_graph_tuple_transform]: 2.013e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.442e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.764e-05 [cse_after_recomputation]: 2.251e-05, [1] [Cycle 1]: 1.642e-05, [1] [cse]: 1.067e-05 [auto_monad_reorder]: 1.476e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00043688 [symbol_engine_optimizer]: 0.00012178, [1] [Cycle 1]: 0.00011514, [6] [build]: 3.45e-06 [elim_shapecalc]: 9.07999e-06 [elim_not_effective]: 5.482e-05 [opt_reshape]: 7.05998e-06 [fold_const_symbol]: 1.028e-05 [renormalize]: 4.00003e-07 [validate]: 4.407e-05 Sums bootstrap : 0.001210s : 1.34% type_inference : 0.083320s : 92.00% event_method : 0.000019s : 0.02% auto_monad : 0.000064s : 0.07% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000277s : 0.31% rewriter_before_opt_a : 0.000082s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.07% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000705s : 0.78% jit_opt_a.with_stream_mark : 0.000026s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002546s : 2.81% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000041s : 0.05% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000633s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.03% loop_unroll : 0.000415s : 0.46% jit_opt_after_cconv.c_1 : 0.000025s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000437s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000055s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.05% Time group info: ------[substitution.] 0.000206 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 4: substitution.graph_param_transform 83.34% : 0.000172s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000004s : 2: substitution.replace_old_param 6.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.083232 2 97.51% : 0.081163s : 1: type_inference.infer 2.49% : 0.002069s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.01% : 0.000050s : 4: replace.inline 32.99% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.77% : 0.000169s : 4: match.inline 6.23% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.28% : 0.000002s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.09% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.79% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.24% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.67% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.17% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.08% : 0.000003s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003236 34 78.21% : 0.002531s : 27: func_graph_cloner_run.FuncGraphClonerGraph 0.98% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 20.82% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.098387 72 0.05% : 0.000050s : 1: add_recomputation 0.07% : 0.000068s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 1.27% : 0.001248s : 1: bootstrap 0.03% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.69% : 0.007571s : 1: jit_opt_a 0.15% : 0.000147s : 1: jit_opt_after_cconv 0.06% : 0.000055s : 1: jit_opt_b 0.43% : 0.000423s : 1: loop_unroll 0.65% : 0.000640s : 1: mutable_eliminate 0.96% : 0.000944s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000078s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000283s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.85% : 0.001822s : 1: renormalize.infer 0.73% : 0.000715s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000036s : 1: rewriter_after_opt_a 0.09% : 0.000087s : 1: rewriter_before_opt_a 0.13% : 0.000124s : 1: symbol_engine_optimizer 84.71% : 0.083339s : 1: type_inference TotalTime = 0.552804, [30] [bootstrap]: 0.00031051 [type_inference]: 0.533793 [event_method]: 2.138e-05 [auto_monad]: 7.544e-05 [graph_reusing]: 5.52999e-06 [pre_auto_parallel]: 2.24001e-06 [py_interpret_to_execute]: 0.00058087 [rewriter_before_opt_a]: 0.00010054 [expand_dump_flag]: 3.33998e-06 [jit_opt_a]: 0.0152888, [2] [Cycle 1]: 0.00546158, [27] [switch_simplify]: 6.694e-05 [loop_unroll]: 3.502e-05 [a_1]: 0.00075817 [with_stream_mark]: 3.227e-05 [recompute_prepare]: 9.85002e-06 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.56999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 7.56001e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 7.45003e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.792e-05 [j_node_and_user_rematch]: 1e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 6.54999e-06 [renormalize]: 0.00416603 [add_forward_monad_depend]: 1.152e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.012e-05 [cse]: 3.515e-05 [replace_applicator]: 2.434e-05 [Cycle 2]: 0.00041398, [27] [switch_simplify]: 7.42002e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.00014289 [with_stream_mark]: 1.531e-05 [recompute_prepare]: 6.22001e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.68998e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.96998e-06 [merge_forward]: 4.36002e-06 [cell_reuse_recompute_pass]: 2.74999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.451e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 9.72001e-06 [inline_without_move]: 6.47001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 6.78998e-06 [cse]: 1.615e-05 [replace_applicator]: 6.68e-06 [py_interpret_to_execute_after_opt_a]: 1.858e-05 [rewriter_after_opt_a]: 4.274e-05 [convert_after_rewriter]: 7.93001e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00073933 [jit_opt_b]: 5.854e-05, [1] [Cycle 1]: 5.1e-05, [2] [frontend_op_eliminate]: 2.017e-05 [inline_after_opt_a]: 1.886e-05 [cconv]: 2.888e-05 [loop_unroll]: 0.00050721 [jit_opt_after_cconv]: 0.0001686, [1] [Cycle 1]: 0.00016227, [11] [c_1]: 2.706e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 7.74002e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [cse]: 3.026e-05 [call_graph_tuple_transform]: 2.231e-05 [tuple_list_get_item_eliminator]: 6.96999e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 6.64999e-06 [remove_dup_value]: 1.711e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 9.17001e-06 [add_recomputation]: 5.456e-05 [cse_after_recomputation]: 2.523e-05, [1] [Cycle 1]: 1.94e-05, [1] [cse]: 1.356e-05 [auto_monad_reorder]: 1.734e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 6.33998e-06 [opt_after_jit_grad]: 0.00047812 [symbol_engine_optimizer]: 0.0001885, [1] [Cycle 1]: 0.00018215, [6] [build]: 4.26001e-06 [elim_shapecalc]: 9.79e-06 [elim_not_effective]: 1.377e-05 [opt_reshape]: 6.52001e-06 [fold_const_symbol]: 0.00011753 [renormalize]: 5.3001e-07 [validate]: 5.318e-05 Sums bootstrap : 0.000311s : 0.06% type_inference : 0.533793s : 98.35% event_method : 0.000021s : 0.00% auto_monad : 0.000075s : 0.01% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000581s : 0.11% rewriter_before_opt_a : 0.000101s : 0.02% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.01% jit_opt_a.loop_unroll : 0.000041s : 0.01% jit_opt_a.a_1 : 0.000901s : 0.17% jit_opt_a.with_stream_mark : 0.000048s : 0.01% jit_opt_a.recompute_prepare : 0.000016s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000014s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.00% jit_opt_a.merge_forward : 0.000008s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.01% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.00% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.00% jit_opt_a.inline_without_move : 0.000013s : 0.00% jit_opt_a.renormalize : 0.004166s : 0.77% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.00% jit_opt_a.cse : 0.000051s : 0.01% jit_opt_a.replace_applicator : 0.000031s : 0.01% py_interpret_to_execute_after_opt_a : 0.000019s : 0.00% rewriter_after_opt_a : 0.000043s : 0.01% convert_after_rewriter : 0.000008s : 0.00% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000739s : 0.14% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000019s : 0.00% cconv : 0.000029s : 0.01% loop_unroll : 0.000507s : 0.09% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000017s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.00% add_recomputation : 0.000055s : 0.01% cse_after_recomputation.cse : 0.000014s : 0.00% auto_monad_reorder : 0.000017s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000478s : 0.09% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000118s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.01% Time group info: ------[substitution.] 0.000420 28 0.44% : 0.000002s : 2: substitution.elim_not_effective 25.60% : 0.000108s : 2: substitution.fold_const_symbol 1.37% : 0.000006s : 4: substitution.graph_param_transform 62.40% : 0.000262s : 5: substitution.inline 0.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.38% : 0.000014s : 3: substitution.reduce_eliminate 1.40% : 0.000006s : 4: substitution.remove_not_recompute_node 1.20% : 0.000005s : 2: substitution.replace_old_param 3.32% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.533703 2 99.42% : 0.530605s : 1: type_inference.infer 0.58% : 0.003098s : 1: type_inference.specialize ------[replace.] 0.000108 7 68.47% : 0.000074s : 5: replace.inline 31.53% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000272 7 95.31% : 0.000259s : 5: match.inline 4.69% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.67% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.76% : 0.000003s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.70% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 19: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.72% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.44% : 0.000004s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.58% : 0.000002s : 13: predicate.reshape_eliminate 1.54% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000004s : 20: predicate.switch_defer_inline 2.07% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000011s : 64: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002599 25 60.02% : 0.001560s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.25% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.73% : 0.000954s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.558305 72 0.01% : 0.000058s : 1: add_recomputation 0.01% : 0.000079s : 1: auto_monad 0.00% : 0.000020s : 1: auto_monad_reorder 0.06% : 0.000329s : 1: bootstrap 0.01% : 0.000031s : 1: cconv 0.00% : 0.000011s : 1: convert_after_rewriter 0.00% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000012s : 1: environ_conv 0.00% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000008s : 1: graph_reusing 2.74% : 0.015292s : 1: jit_opt_a 0.03% : 0.000172s : 1: jit_opt_after_cconv 0.01% : 0.000061s : 1: jit_opt_b 0.09% : 0.000518s : 1: loop_unroll 0.13% : 0.000749s : 1: mutable_eliminate 0.21% : 0.001167s : 26: opt.transform.jit_opt_a 0.01% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000017s : 1: opt.transform.mutable_eliminate 0.00% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000144s : 4: opt.transform.symbol_engine_opt 0.09% : 0.000487s : 1: opt_after_jit_grad 0.00% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.11% : 0.000587s : 1: py_interpret_to_execute 0.00% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000019s : 1: remove_dup_value 0.56% : 0.003121s : 1: renormalize.infer 0.18% : 0.001033s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000046s : 1: rewriter_after_opt_a 0.02% : 0.000106s : 1: rewriter_before_opt_a 0.03% : 0.000192s : 1: symbol_engine_optimizer 95.61% : 0.533806s : 1: type_inference TotalTime = 0.0713479, [30] [bootstrap]: 0.00027877 [type_inference]: 0.0603572 [event_method]: 2.13e-05 [auto_monad]: 7.275e-05 [graph_reusing]: 6.37001e-06 [pre_auto_parallel]: 2.15002e-06 [py_interpret_to_execute]: 0.000431 [rewriter_before_opt_a]: 9.683e-05 [expand_dump_flag]: 4.75001e-06 [jit_opt_a]: 0.00760122, [2] [Cycle 1]: 0.00349154, [27] [switch_simplify]: 6.247e-05 [loop_unroll]: 3.04e-05 [a_1]: 0.00058728 [with_stream_mark]: 2.002e-05 [recompute_prepare]: 8.33001e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 7.36999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 6.89999e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 9.74999e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 1.14e-05 [inline_without_move]: 6.58e-06 [renormalize]: 0.0024352 [add_forward_monad_depend]: 6.60997e-06 [auto_monad_grad]: 1.67999e-06 [auto_monad_eliminator]: 1.403e-05 [cse]: 2.316e-05 [replace_applicator]: 1.833e-05 [Cycle 2]: 0.00037581, [27] [switch_simplify]: 6.87002e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00012558 [with_stream_mark]: 1.101e-05 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 6.27001e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 2.64999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.632e-05 [j_node_and_user_rematch]: 8.84003e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.60001e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 6.19999e-06 [cse]: 1.256e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.107e-05 [rewriter_after_opt_a]: 2.873e-05 [convert_after_rewriter]: 5.96998e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00063288 [jit_opt_b]: 5.451e-05, [1] [Cycle 1]: 4.835e-05, [2] [frontend_op_eliminate]: 1.958e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 1.692e-05 [loop_unroll]: 0.00042078 [jit_opt_after_cconv]: 0.0001539, [1] [Cycle 1]: 0.0001478, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 2.67001e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.28e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 9.44e-06 [partial_unused_args_eliminate]: 1.49998e-06 [environ_conv]: 5.46e-06 [add_recomputation]: 3.431e-05 [cse_after_recomputation]: 2.25e-05, [1] [Cycle 1]: 1.662e-05, [1] [cse]: 1.101e-05 [auto_monad_reorder]: 1.035e-05 [get_jit_bprop_graph]: 1.40001e-06 [rewriter_after_jit_bprop_graph]: 5.64e-06 [opt_after_jit_grad]: 0.00051164 [symbol_engine_optimizer]: 0.00022694, [1] [Cycle 1]: 0.00022001, [6] [build]: 3.11001e-06 [elim_shapecalc]: 9.89e-05 [elim_not_effective]: 6.47e-05 [opt_reshape]: 7.46001e-06 [fold_const_symbol]: 1.055e-05 [renormalize]: 3.50003e-07 [validate]: 4.187e-05 Sums bootstrap : 0.000279s : 0.42% type_inference : 0.060357s : 90.21% event_method : 0.000021s : 0.03% auto_monad : 0.000073s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000431s : 0.64% rewriter_before_opt_a : 0.000097s : 0.14% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000069s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000713s : 1.07% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002435s : 3.64% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000036s : 0.05% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000029s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000633s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000017s : 0.03% loop_unroll : 0.000421s : 0.63% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000034s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000512s : 0.76% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000099s : 0.15% symbol_engine_optimizer.elim_not_effective : 0.000065s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.06% Time group info: ------[substitution.] 0.000214 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000005s : 4: substitution.graph_param_transform 83.78% : 0.000179s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000006s : 4: substitution.remove_not_recompute_node 2.61% : 0.000006s : 2: substitution.replace_old_param 5.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060263 2 95.93% : 0.057812s : 1: type_inference.infer 4.07% : 0.002451s : 1: type_inference.specialize ------[replace.] 0.000075 6 66.48% : 0.000050s : 4: replace.inline 33.52% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 94.06% : 0.000176s : 4: match.inline 5.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.68% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.91% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 26: predicate.inline 1.07% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.29% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.06% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002438 26 71.45% : 0.001742s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.23% : 0.000664s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.074968 72 0.05% : 0.000037s : 1: add_recomputation 0.10% : 0.000076s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.52% : 0.000386s : 1: bootstrap 0.03% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000025s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.14% : 0.007605s : 1: jit_opt_a 0.21% : 0.000157s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.57% : 0.000429s : 1: loop_unroll 0.86% : 0.000642s : 1: mutable_eliminate 1.28% : 0.000961s : 26: opt.transform.jit_opt_a 0.07% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000084s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000130s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000520s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.58% : 0.000438s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 2.28% : 0.001713s : 1: renormalize.infer 0.95% : 0.000713s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000032s : 1: rewriter_after_opt_a 0.14% : 0.000103s : 1: rewriter_before_opt_a 0.31% : 0.000230s : 1: symbol_engine_optimizer 80.54% : 0.060375s : 1: type_inference TotalTime = 0.068243, [30] [bootstrap]: 0.00032941 [type_inference]: 0.0568016 [event_method]: 2.082e-05 [auto_monad]: 7.178e-05 [graph_reusing]: 6.69001e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00032548 [rewriter_before_opt_a]: 9.147e-05 [expand_dump_flag]: 3.96001e-06 [jit_opt_a]: 0.00786065, [2] [Cycle 1]: 0.00355843, [27] [switch_simplify]: 6.476e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.00059284 [with_stream_mark]: 8.12e-05 [recompute_prepare]: 1.09e-05 [updatestate_depend_eliminate]: 5.65001e-06 [updatestate_assign_eliminate]: 3.27997e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.27001e-06 [specialize_transform]: 8.99e-06 [updatestate_useless_node_eliminater]: 6.50997e-06 [accelerated_algorithm]: 6.86001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.80998e-06 [merge_forward]: 4.70999e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 1.042e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00231636 [add_forward_monad_depend]: 1.125e-05 [auto_monad_grad]: 2.74999e-06 [auto_monad_eliminator]: 2.363e-05 [cse]: 3.485e-05 [replace_applicator]: 2.288e-05 [Cycle 2]: 0.00042914, [27] [switch_simplify]: 7.74002e-06 [loop_unroll]: 6.22001e-06 [a_1]: 0.00013312 [with_stream_mark]: 1.609e-05 [recompute_prepare]: 6.91001e-06 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 3.68999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 3.26001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.134e-05 [j_node_and_user_rematch]: 1.117e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.035e-05 [inline_without_move]: 5.86e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.98998e-06 [auto_monad_grad]: 1.49e-06 [auto_monad_eliminator]: 1.091e-05 [cse]: 1.582e-05 [replace_applicator]: 6.78e-06 [py_interpret_to_execute_after_opt_a]: 1.739e-05 [rewriter_after_opt_a]: 4.371e-05 [convert_after_rewriter]: 8.47998e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00084547 [jit_opt_b]: 6.479e-05, [1] [Cycle 1]: 5.451e-05, [2] [frontend_op_eliminate]: 2.123e-05 [inline_after_opt_a]: 2.071e-05 [cconv]: 3.423e-05 [loop_unroll]: 0.00049595 [jit_opt_after_cconv]: 0.00017814, [1] [Cycle 1]: 0.00017066, [11] [c_1]: 2.626e-05 [parameter_eliminate]: 4.82e-06 [updatestate_depend_eliminate]: 8.45001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.51998e-06 [cse]: 3.579e-05 [call_graph_tuple_transform]: 2.241e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 2.27999e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.715e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 1.002e-05 [add_recomputation]: 5.742e-05 [cse_after_recomputation]: 2.683e-05, [1] [Cycle 1]: 1.961e-05, [1] [cse]: 1.26e-05 [auto_monad_reorder]: 1.555e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 7.01999e-06 [opt_after_jit_grad]: 0.00050185 [symbol_engine_optimizer]: 8.166e-05, [1] [Cycle 1]: 7.452e-05, [6] [build]: 4.92999e-06 [elim_shapecalc]: 8.32998e-06 [elim_not_effective]: 1.521e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 6.09987e-07 [validate]: 0.00010109 Sums bootstrap : 0.000329s : 0.52% type_inference : 0.056802s : 89.26% event_method : 0.000021s : 0.03% auto_monad : 0.000072s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000325s : 0.51% rewriter_before_opt_a : 0.000091s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000726s : 1.14% jit_opt_a.with_stream_mark : 0.000097s : 0.15% jit_opt_a.recompute_prepare : 0.000018s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000011s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000015s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002316s : 3.64% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.05% jit_opt_a.cse : 0.000051s : 0.08% jit_opt_a.replace_applicator : 0.000030s : 0.05% py_interpret_to_execute_after_opt_a : 0.000017s : 0.03% rewriter_after_opt_a : 0.000044s : 0.07% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000845s : 1.33% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.03% jit_opt_b.inline_after_opt_a : 0.000021s : 0.03% cconv : 0.000034s : 0.05% loop_unroll : 0.000496s : 0.78% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.06% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000057s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000502s : 0.79% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000101s : 0.16% Time group info: ------[substitution.] 0.000217 24 1.30% : 0.000003s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 3.24% : 0.000007s : 4: substitution.graph_param_transform 81.50% : 0.000177s : 4: substitution.inline 2.13% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.74% : 0.000006s : 4: substitution.remove_not_recompute_node 2.69% : 0.000006s : 2: substitution.replace_old_param 5.70% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056694 2 95.99% : 0.054418s : 1: type_inference.infer 4.01% : 0.002276s : 1: type_inference.specialize ------[replace.] 0.000080 6 65.88% : 0.000053s : 4: replace.inline 34.12% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 6 93.95% : 0.000175s : 4: match.inline 6.05% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.20% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.44% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.96% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.31% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.09% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.37% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.82% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.95% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.96% : 0.000003s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.29% : 0.000002s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.56% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.60% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.47% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002462 26 71.40% : 0.001758s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.17% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.43% : 0.000675s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071568 72 0.08% : 0.000060s : 1: add_recomputation 0.11% : 0.000075s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.49% : 0.000351s : 1: bootstrap 0.05% : 0.000037s : 1: cconv 0.02% : 0.000011s : 1: convert_after_rewriter 0.04% : 0.000029s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.99% : 0.007865s : 1: jit_opt_a 0.25% : 0.000181s : 1: jit_opt_after_cconv 0.09% : 0.000068s : 1: jit_opt_b 0.71% : 0.000505s : 1: loop_unroll 1.20% : 0.000857s : 1: mutable_eliminate 1.39% : 0.000995s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000034s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000019s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000512s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000332s : 1: py_interpret_to_execute 0.03% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.20% : 0.001572s : 1: renormalize.infer 1.02% : 0.000733s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000049s : 1: rewriter_after_opt_a 0.14% : 0.000098s : 1: rewriter_before_opt_a 0.12% : 0.000084s : 1: symbol_engine_optimizer 79.40% : 0.056822s : 1: type_inference TotalTime = 0.135258, [30] [bootstrap]: 0.00034692 [type_inference]: 0.120754 [event_method]: 2.431e-05 [auto_monad]: 7.254e-05 [graph_reusing]: 4.94e-06 [pre_auto_parallel]: 2.80997e-06 [py_interpret_to_execute]: 0.0010159 [rewriter_before_opt_a]: 0.00012049 [expand_dump_flag]: 4.60001e-06 [jit_opt_a]: 0.0102733, [2] [Cycle 1]: 0.00466659, [27] [switch_simplify]: 7.023e-05 [loop_unroll]: 3.493e-05 [a_1]: 0.00076704 [with_stream_mark]: 2.239e-05 [recompute_prepare]: 1.045e-05 [updatestate_depend_eliminate]: 4.91997e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 6.55002e-06 [accelerated_algorithm]: 6.73998e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 7.67002e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.756e-05 [j_node_and_user_rematch]: 1.079e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 7.92e-06 [renormalize]: 0.00338648 [add_forward_monad_depend]: 6.52001e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.698e-05 [cse]: 3.411e-05 [replace_applicator]: 1.658e-05 [Cycle 2]: 0.00040273, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 6.33002e-06 [a_1]: 0.00013872 [with_stream_mark]: 1.392e-05 [recompute_prepare]: 6.08998e-06 [updatestate_depend_eliminate]: 3.45998e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.82998e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 7.03e-06 [cse]: 1.667e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 1.407e-05 [rewriter_after_opt_a]: 3.737e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.0006898 [jit_opt_b]: 6.061e-05, [1] [Cycle 1]: 5.28e-05, [2] [frontend_op_eliminate]: 2.093e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 3e-05 [loop_unroll]: 0.00052332 [jit_opt_after_cconv]: 0.0001683, [1] [Cycle 1]: 0.0001613, [11] [c_1]: 2.673e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.56998e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.934e-05 [call_graph_tuple_transform]: 2.228e-05 [tuple_list_get_item_eliminator]: 6.55997e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.629e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 8.63001e-06 [add_recomputation]: 5.041e-05 [cse_after_recomputation]: 3.139e-05, [1] [Cycle 1]: 2.591e-05, [1] [cse]: 1.341e-05 [auto_monad_reorder]: 1.784e-05 [get_jit_bprop_graph]: 5.51e-06 [rewriter_after_jit_bprop_graph]: 5.88002e-06 [opt_after_jit_grad]: 0.00048043 [symbol_engine_optimizer]: 0.00024843, [1] [Cycle 1]: 0.00024197, [6] [build]: 3.56999e-06 [elim_shapecalc]: 1.095e-05 [elim_not_effective]: 0.00017661 [opt_reshape]: 7.69002e-06 [fold_const_symbol]: 1.176e-05 [renormalize]: 4.00003e-07 [validate]: 4.715e-05 Sums bootstrap : 0.000347s : 0.27% type_inference : 0.120754s : 93.31% event_method : 0.000024s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001016s : 0.78% rewriter_before_opt_a : 0.000120s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000906s : 0.70% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003387s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000690s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000030s : 0.02% loop_unroll : 0.000523s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000006s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000480s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000177s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000464 28 35.32% : 0.000164s : 2: substitution.elim_not_effective 0.32% : 0.000001s : 2: substitution.fold_const_symbol 1.24% : 0.000006s : 4: substitution.graph_param_transform 54.38% : 0.000252s : 5: substitution.inline 0.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.23% : 0.000015s : 3: substitution.reduce_eliminate 1.05% : 0.000005s : 4: substitution.remove_not_recompute_node 0.95% : 0.000004s : 2: substitution.replace_old_param 2.66% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120659 2 96.92% : 0.116940s : 1: type_inference.infer 3.08% : 0.003719s : 1: type_inference.specialize ------[replace.] 0.000113 7 68.15% : 0.000077s : 5: replace.inline 31.85% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000259 7 95.69% : 0.000248s : 5: match.inline 4.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.44% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 0.98% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 28: predicate.inline 1.00% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.20% : 0.000002s : 13: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 2.45% : 0.000004s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000004s : 20: predicate.switch_defer_inline 2.00% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.79% : 0.000010s : 64: predicate.switch_simplify 1.48% : 0.000002s : 13: predicate.tile_eliminate 1.44% : 0.000002s : 13: predicate.transpose_eliminate 1.62% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.84% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.68% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002603 25 61.12% : 0.001591s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.87% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.02% : 0.000937s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.140053 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000076s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000359s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000008s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.34% : 0.010277s : 1: jit_opt_a 0.12% : 0.000171s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.38% : 0.000533s : 1: loop_unroll 0.50% : 0.000699s : 1: mutable_eliminate 0.84% : 0.001172s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.15% : 0.000204s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.73% : 0.001028s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.74% : 0.002434s : 1: renormalize.infer 0.67% : 0.000940s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000126s : 1: rewriter_before_opt_a 0.18% : 0.000251s : 1: symbol_engine_optimizer 86.23% : 0.120770s : 1: type_inference TotalTime = 0.0684545, [30] [bootstrap]: 0.00032462 [type_inference]: 0.0584412 [event_method]: 1.941e-05 [auto_monad]: 6.424e-05 [graph_reusing]: 5.09e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00030289 [rewriter_before_opt_a]: 8.348e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00708737, [2] [Cycle 1]: 0.00316986, [27] [switch_simplify]: 4.995e-05 [loop_unroll]: 3.123e-05 [a_1]: 0.00054041 [with_stream_mark]: 1.218e-05 [recompute_prepare]: 8.88002e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.222e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 9.02999e-06 [inline_without_move]: 6.06e-06 [renormalize]: 0.00222851 [add_forward_monad_depend]: 6.36e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 1.299e-05 [cse]: 2.361e-05 [replace_applicator]: 1.366e-05 [Cycle 2]: 0.00035654, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00012135 [with_stream_mark]: 8.85001e-06 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 2.75002e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.34003e-06 [get_grad_eliminate_]: 5.26998e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 8.34998e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.147e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.14e-05 [rewriter_after_opt_a]: 3.293e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00060826 [jit_opt_b]: 5.321e-05, [1] [Cycle 1]: 4.692e-05, [2] [frontend_op_eliminate]: 1.901e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.006e-05 [loop_unroll]: 0.00040783 [jit_opt_after_cconv]: 0.00014195, [1] [Cycle 1]: 0.00013625, [11] [c_1]: 2.543e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.801e-05 [call_graph_tuple_transform]: 1.928e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.28e-05 [partial_unused_args_eliminate]: 1.52001e-06 [environ_conv]: 6.73998e-06 [add_recomputation]: 3.774e-05 [cse_after_recomputation]: 2.121e-05, [1] [Cycle 1]: 1.648e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.264e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.08001e-06 [opt_after_jit_grad]: 0.0004423 [symbol_engine_optimizer]: 8.487e-05, [1] [Cycle 1]: 7.883e-05, [6] [build]: 2.74001e-06 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 2.001e-05 [renormalize]: 4.39992e-07 [validate]: 3.69e-05 Sums bootstrap : 0.000325s : 0.50% type_inference : 0.058441s : 90.83% event_method : 0.000019s : 0.03% auto_monad : 0.000064s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000303s : 0.47% rewriter_before_opt_a : 0.000083s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000662s : 1.03% jit_opt_a.with_stream_mark : 0.000021s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002229s : 3.46% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000035s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000608s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000020s : 0.03% loop_unroll : 0.000408s : 0.63% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000038s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000442s : 0.69% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000020s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.06% Time group info: ------[substitution.] 0.000176 24 1.32% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000001s : 2: substitution.fold_const_symbol 2.96% : 0.000005s : 4: substitution.graph_param_transform 83.74% : 0.000147s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000004s : 2: substitution.replace_old_param 4.80% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058361 2 96.42% : 0.056271s : 1: type_inference.infer 3.58% : 0.002089s : 1: type_inference.specialize ------[replace.] 0.000071 6 67.75% : 0.000048s : 4: replace.inline 32.25% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 95.22% : 0.000145s : 4: match.inline 4.78% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.63% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.23% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.89% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.00% : 0.000006s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 2.20% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002424 26 72.07% : 0.001747s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.22% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.71% : 0.000647s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071654 72 0.06% : 0.000040s : 1: add_recomputation 0.09% : 0.000068s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.47% : 0.000340s : 1: bootstrap 0.03% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.90% : 0.007091s : 1: jit_opt_a 0.20% : 0.000145s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.58% : 0.000415s : 1: loop_unroll 0.86% : 0.000615s : 1: mutable_eliminate 1.24% : 0.000886s : 26: opt.transform.jit_opt_a 0.07% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.63% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000310s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000015s : 1: remove_dup_value 2.14% : 0.001532s : 1: renormalize.infer 0.96% : 0.000689s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000088s : 1: rewriter_before_opt_a 0.12% : 0.000087s : 1: symbol_engine_optimizer 81.59% : 0.058460s : 1: type_inference TotalTime = 0.137366, [30] [bootstrap]: 0.00031029 [type_inference]: 0.123978 [event_method]: 2.385e-05 [auto_monad]: 8.037e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00076016 [rewriter_before_opt_a]: 0.00010576 [expand_dump_flag]: 4.28999e-06 [jit_opt_a]: 0.00912487, [2] [Cycle 1]: 0.0046352, [27] [switch_simplify]: 6.842e-05 [loop_unroll]: 3.469e-05 [a_1]: 0.0009005 [with_stream_mark]: 2.244e-05 [recompute_prepare]: 1.049e-05 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 6.30002e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.78e-06 [merge_forward]: 3.72002e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.801e-05 [j_node_and_user_rematch]: 1.128e-05 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 1.16e-05 [inline_without_move]: 6.78e-06 [renormalize]: 0.0031885 [add_forward_monad_depend]: 1.02e-05 [auto_monad_grad]: 2.63998e-06 [auto_monad_eliminator]: 2.082e-05 [cse]: 3.627e-05 [replace_applicator]: 2.134e-05 [Cycle 2]: 0.00047118, [27] [switch_simplify]: 8e-06 [loop_unroll]: 6.79999e-06 [a_1]: 0.00014316 [with_stream_mark]: 1.668e-05 [recompute_prepare]: 6.96999e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 2.45002e-06 [specialize_transform]: 8.38999e-06 [updatestate_useless_node_eliminater]: 6.64001e-06 [accelerated_algorithm]: 7.38999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 4.69002e-06 [cell_reuse_recompute_pass]: 3.01999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.786e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 5.81e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 2.83e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 1.014e-05 [cse]: 1.862e-05 [replace_applicator]: 7.71999e-06 [py_interpret_to_execute_after_opt_a]: 1.795e-05 [rewriter_after_opt_a]: 5.452e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00081844 [jit_opt_b]: 6.55e-05, [1] [Cycle 1]: 5.606e-05, [2] [frontend_op_eliminate]: 2.219e-05 [inline_after_opt_a]: 2.106e-05 [cconv]: 3.358e-05 [loop_unroll]: 0.00051942 [jit_opt_after_cconv]: 0.00019155, [1] [Cycle 1]: 0.00018406, [11] [c_1]: 2.702e-05 [parameter_eliminate]: 4.78001e-06 [updatestate_depend_eliminate]: 9.86e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.732e-05 [call_graph_tuple_transform]: 2.808e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 8.31002e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 9.58002e-06 [add_recomputation]: 6.235e-05 [cse_after_recomputation]: 2.724e-05, [1] [Cycle 1]: 2.182e-05, [1] [cse]: 1.46e-05 [auto_monad_reorder]: 1.783e-05 [get_jit_bprop_graph]: 2.39999e-06 [rewriter_after_jit_bprop_graph]: 1.167e-05 [opt_after_jit_grad]: 0.00069526 [symbol_engine_optimizer]: 8.749e-05, [1] [Cycle 1]: 7.846e-05, [6] [build]: 4.80999e-06 [elim_shapecalc]: 9.66e-06 [elim_not_effective]: 1.655e-05 [opt_reshape]: 7.41001e-06 [fold_const_symbol]: 1.025e-05 [renormalize]: 7.2e-07 [validate]: 5.916e-05 Sums bootstrap : 0.000310s : 0.23% type_inference : 0.123978s : 93.51% event_method : 0.000024s : 0.02% auto_monad : 0.000080s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000760s : 0.57% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.001044s : 0.79% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003189s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000055s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000818s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000519s : 0.39% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000037s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000062s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000695s : 0.52% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000059s : 0.04% Time group info: ------[substitution.] 0.000330 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.00% : 0.000007s : 4: substitution.graph_param_transform 83.38% : 0.000275s : 5: substitution.inline 1.29% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.51% : 0.000015s : 3: substitution.reduce_eliminate 1.96% : 0.000006s : 4: substitution.remove_not_recompute_node 1.98% : 0.000007s : 2: substitution.replace_old_param 3.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123872 2 97.32% : 0.120552s : 1: type_inference.infer 2.68% : 0.003320s : 1: type_inference.specialize ------[replace.] 0.000213 7 36.56% : 0.000078s : 5: replace.inline 63.44% : 0.000135s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000282 7 96.13% : 0.000271s : 5: match.inline 3.87% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 886 1.22% : 0.000002s : 13: predicate.accumulaten_eliminater 1.44% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 1.83% : 0.000003s : 13: predicate.arithmetic_simplify 1.69% : 0.000003s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.97% : 0.000002s : 13: predicate.compare_switch_simplify 1.09% : 0.000002s : 13: predicate.depend_value_elim 1.02% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.02% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.80% : 0.000009s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.75% : 0.000003s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 2.50% : 0.000004s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.09% : 0.000003s : 13: predicate.reduce_eliminate 1.31% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.50% : 0.000001s : 4: predicate.reset_defer_inline 1.08% : 0.000002s : 13: predicate.reshape_eliminate 1.75% : 0.000003s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000002s : 8: predicate.specialize_transform 1.53% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.81% : 0.000004s : 20: predicate.switch_defer_inline 1.89% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.05% : 0.000011s : 64: predicate.switch_simplify 1.40% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.15% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.59% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.70% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.60% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000003s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002591 25 64.62% : 0.001674s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.33% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.05% : 0.000830s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.141928 72 0.05% : 0.000066s : 1: add_recomputation 0.06% : 0.000085s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000328s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.43% : 0.009129s : 1: jit_opt_a 0.14% : 0.000194s : 1: jit_opt_after_cconv 0.05% : 0.000069s : 1: jit_opt_b 0.37% : 0.000531s : 1: loop_unroll 0.59% : 0.000836s : 1: mutable_eliminate 0.93% : 0.001322s : 26: opt.transform.jit_opt_a 0.05% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000027s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000709s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.54% : 0.000771s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.62% : 0.002304s : 1: renormalize.infer 0.61% : 0.000872s : 1: renormalize.specialize 0.01% : 0.000014s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000060s : 1: rewriter_after_opt_a 0.08% : 0.000112s : 1: rewriter_before_opt_a 0.06% : 0.000090s : 1: symbol_engine_optimizer 87.37% : 0.124001s : 1: type_inference TotalTime = 0.122549, [30] [bootstrap]: 0.00029103 [type_inference]: 0.110344 [event_method]: 2.202e-05 [auto_monad]: 7.087e-05 [graph_reusing]: 5.67001e-06 [pre_auto_parallel]: 2.74999e-06 [py_interpret_to_execute]: 0.00053405 [rewriter_before_opt_a]: 9.598e-05 [expand_dump_flag]: 3.80998e-06 [jit_opt_a]: 0.00819198, [2] [Cycle 1]: 0.00407541, [27] [switch_simplify]: 6.255e-05 [loop_unroll]: 3.238e-05 [a_1]: 0.00060705 [with_stream_mark]: 1.929e-05 [recompute_prepare]: 8.81002e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.56999e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 7.3e-06 [updatestate_useless_node_eliminater]: 6.32001e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.82002e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.683e-05 [j_node_and_user_rematch]: 1.097e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 1.034e-05 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00297755 [add_forward_monad_depend]: 8.48001e-06 [auto_monad_grad]: 2.66e-06 [auto_monad_eliminator]: 1.823e-05 [cse]: 3.065e-05 [replace_applicator]: 2.314e-05 [Cycle 2]: 0.00040953, [27] [switch_simplify]: 7.77e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00014156 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 6.38998e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 3.41001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.79e-05 [j_node_and_user_rematch]: 1.051e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 1.064e-05 [inline_without_move]: 5.93002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.453e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.451e-05 [rewriter_after_opt_a]: 3.826e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.50001e-06 [mutable_eliminate]: 0.00077669 [jit_opt_b]: 6.822e-05, [1] [Cycle 1]: 5.76e-05, [2] [frontend_op_eliminate]: 2.342e-05 [inline_after_opt_a]: 2.072e-05 [cconv]: 2.937e-05 [loop_unroll]: 0.00054041 [jit_opt_after_cconv]: 0.000179, [1] [Cycle 1]: 0.00017075, [11] [c_1]: 2.96e-05 [parameter_eliminate]: 3.20998e-06 [updatestate_depend_eliminate]: 8.75001e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 3.084e-05 [call_graph_tuple_transform]: 2.645e-05 [tuple_list_get_item_eliminator]: 6.83e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.72002e-06 [remove_dup_value]: 1.601e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 9.67999e-06 [add_recomputation]: 4.925e-05 [cse_after_recomputation]: 2.273e-05, [1] [Cycle 1]: 1.724e-05, [1] [cse]: 1.118e-05 [auto_monad_reorder]: 1.715e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 6.39999e-06 [opt_after_jit_grad]: 0.00063105 [symbol_engine_optimizer]: 9.767e-05, [1] [Cycle 1]: 8.725e-05, [6] [build]: 4.57998e-06 [elim_shapecalc]: 8.95001e-06 [elim_not_effective]: 2.172e-05 [opt_reshape]: 1.292e-05 [fold_const_symbol]: 9.97999e-06 [renormalize]: 3.99974e-07 [validate]: 0.00027439 Sums bootstrap : 0.000291s : 0.25% type_inference : 0.110344s : 93.35% event_method : 0.000022s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000534s : 0.45% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000749s : 0.63% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002978s : 2.52% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000777s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000540s : 0.46% jit_opt_after_cconv.c_1 : 0.000030s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000631s : 0.53% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000022s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000013s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000274s : 0.23% Time group info: ------[substitution.] 0.000209 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.94% : 0.000006s : 4: substitution.graph_param_transform 81.52% : 0.000171s : 4: substitution.inline 2.13% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.91% : 0.000006s : 2: substitution.replace_old_param 5.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110268 2 97.31% : 0.107301s : 1: type_inference.infer 2.69% : 0.002967s : 1: type_inference.specialize ------[replace.] 0.000078 6 66.30% : 0.000051s : 4: replace.inline 33.70% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.78% : 0.000167s : 4: match.inline 6.22% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000148 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000003s : 12: predicate.arithmetic_simplify 1.09% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.56% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.04% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.42% : 0.000002s : 12: predicate.environ_get_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.04% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 12: predicate.merge_addn 1.16% : 0.000002s : 12: predicate.minmaximum_grad 1.70% : 0.000003s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.40% : 0.000004s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 12: predicate.reshape_eliminate 1.44% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.31% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.66% : 0.000004s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.90% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000002s : 12: predicate.transpose_eliminate 1.65% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002192 22 62.85% : 0.001377s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.42% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.74% : 0.000783s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126403 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000308s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.48% : 0.008196s : 1: jit_opt_a 0.14% : 0.000182s : 1: jit_opt_after_cconv 0.06% : 0.000071s : 1: jit_opt_b 0.43% : 0.000550s : 1: loop_unroll 0.62% : 0.000788s : 1: mutable_eliminate 0.80% : 0.001011s : 26: opt.transform.jit_opt_a 0.05% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000050s : 4: opt.transform.symbol_engine_opt 0.51% : 0.000640s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000541s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.62% : 0.002047s : 1: renormalize.infer 0.73% : 0.000920s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.08% : 0.000100s : 1: symbol_engine_optimizer 87.31% : 0.110363s : 1: type_inference TotalTime = 0.133139, [30] [bootstrap]: 0.00028307 [type_inference]: 0.120979 [event_method]: 2.126e-05 [auto_monad]: 7.289e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 0.00076895 [rewriter_before_opt_a]: 0.00010708 [expand_dump_flag]: 3.82998e-06 [jit_opt_a]: 0.00849148, [2] [Cycle 1]: 0.00413729, [27] [switch_simplify]: 6.722e-05 [loop_unroll]: 3.407e-05 [a_1]: 0.00066499 [with_stream_mark]: 1.163e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 3.10002e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 8.29983e-07 [specialize_transform]: 7.63001e-06 [updatestate_useless_node_eliminater]: 6.79001e-06 [accelerated_algorithm]: 8.02e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 7.08e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00302483 [add_forward_monad_depend]: 6.07001e-06 [auto_monad_grad]: 1.94999e-06 [auto_monad_eliminator]: 1.571e-05 [cse]: 2.601e-05 [replace_applicator]: 1.682e-05 [Cycle 2]: 0.00039089, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 6.35002e-06 [a_1]: 0.0001389 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 6.33e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.93998e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.166e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.33002e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 6.34999e-06 [cse]: 1.36e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.321e-05 [rewriter_after_opt_a]: 3.792e-05 [convert_after_rewriter]: 6.23e-06 [order_py_execute_after_rewriter]: 4.96997e-06 [mutable_eliminate]: 0.00065788 [jit_opt_b]: 5.625e-05, [1] [Cycle 1]: 4.956e-05, [2] [frontend_op_eliminate]: 1.956e-05 [inline_after_opt_a]: 1.863e-05 [cconv]: 2.072e-05 [loop_unroll]: 0.00045343 [jit_opt_after_cconv]: 0.00017099, [1] [Cycle 1]: 0.00016388, [11] [c_1]: 2.687e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 4.40999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.45002e-06 [cse]: 3.028e-05 [call_graph_tuple_transform]: 2.395e-05 [tuple_list_get_item_eliminator]: 7.44002e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.59001e-06 [remove_dup_value]: 1.444e-05 [partial_unused_args_eliminate]: 2.76e-06 [environ_conv]: 8.02e-06 [add_recomputation]: 4.319e-05 [cse_after_recomputation]: 2.459e-05, [1] [Cycle 1]: 1.932e-05, [1] [cse]: 1.334e-05 [auto_monad_reorder]: 1.677e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 6.38998e-06 [opt_after_jit_grad]: 0.00048567 [symbol_engine_optimizer]: 0.0001352, [1] [Cycle 1]: 0.00012906, [6] [build]: 3.7e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.375e-05 [opt_reshape]: 6.412e-05 [fold_const_symbol]: 1.062e-05 [renormalize]: 5.89993e-07 [validate]: 4.431e-05 Sums bootstrap : 0.000283s : 0.22% type_inference : 0.120979s : 94.10% event_method : 0.000021s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000769s : 0.60% rewriter_before_opt_a : 0.000107s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000804s : 0.63% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003025s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000658s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000021s : 0.02% loop_unroll : 0.000453s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000043s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000486s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000064s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.03% Time group info: ------[substitution.] 0.000255 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000002s : 2: substitution.fold_const_symbol 2.76% : 0.000007s : 4: substitution.graph_param_transform 82.70% : 0.000211s : 5: substitution.inline 1.38% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.25% : 0.000013s : 3: substitution.reduce_eliminate 1.79% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 3.25% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120889 2 97.30% : 0.117629s : 1: type_inference.infer 2.70% : 0.003260s : 1: type_inference.specialize ------[replace.] 0.000097 7 65.04% : 0.000063s : 5: replace.inline 34.96% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 96.75% : 0.000208s : 5: match.inline 3.25% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.76% : 0.000002s : 13: predicate.accumulaten_eliminater 0.84% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.55% : 0.000002s : 13: predicate.addn_zero_filter 2.59% : 0.000004s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 4.80% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.19% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.30% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.23% : 0.000002s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.17% : 0.000003s : 13: predicate.reduce_eliminate 1.50% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.30% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.21% : 0.000002s : 13: predicate.transpose_eliminate 1.61% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.01% : 0.000004s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002533 25 60.61% : 0.001535s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.72% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.67% : 0.000929s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137350 72 0.03% : 0.000047s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000298s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.19% : 0.008495s : 1: jit_opt_a 0.13% : 0.000174s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.34% : 0.000462s : 1: loop_unroll 0.49% : 0.000666s : 1: mutable_eliminate 0.77% : 0.001058s : 26: opt.transform.jit_opt_a 0.04% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000093s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.57% : 0.000781s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.50% : 0.002059s : 1: renormalize.infer 0.70% : 0.000959s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.10% : 0.000138s : 1: symbol_engine_optimizer 88.10% : 0.121000s : 1: type_inference TotalTime = 0.0169648, [30] [bootstrap]: 0.0003056 [type_inference]: 0.00821911 [event_method]: 2.169e-05 [auto_monad]: 7.051e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 5.589e-05 [rewriter_before_opt_a]: 8.451e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00593326, [2] [Cycle 1]: 0.00200426, [27] [switch_simplify]: 6.198e-05 [loop_unroll]: 3.349e-05 [a_1]: 0.00064897 [with_stream_mark]: 1.935e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.21998e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 6.68e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.931e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 9.22999e-06 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00082413 [add_forward_monad_depend]: 6.27001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.525e-05 [cse]: 2.457e-05 [replace_applicator]: 1.349e-05 [Cycle 2]: 0.00035021, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.35999e-06 [a_1]: 0.00010261 [with_stream_mark]: 1.16e-05 [recompute_prepare]: 5.56998e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.28998e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.09998e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.211e-05 [j_node_and_user_rematch]: 8.20999e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.38999e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.52001e-06 [cse]: 1.431e-05 [replace_applicator]: 5.30001e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 3.819e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00065121 [jit_opt_b]: 5.3e-05, [1] [Cycle 1]: 4.523e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.568e-05 [cconv]: 2.84e-05 [loop_unroll]: 0.0004533 [jit_opt_after_cconv]: 0.00015202, [1] [Cycle 1]: 0.00014473, [11] [c_1]: 2.19e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 5.86003e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.467e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 5.53002e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 6.04001e-06 [add_recomputation]: 4.688e-05 [cse_after_recomputation]: 2.512e-05, [1] [Cycle 1]: 1.931e-05, [1] [cse]: 1.34e-05 [auto_monad_reorder]: 1.732e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00046098 [symbol_engine_optimizer]: 7.596e-05, [1] [Cycle 1]: 6.915e-05, [6] [build]: 2.89999e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 1.327e-05 [opt_reshape]: 6.69999e-06 [fold_const_symbol]: 9.36998e-06 [renormalize]: 6.29982e-07 [validate]: 4.118e-05 Sums bootstrap : 0.000306s : 2.40% type_inference : 0.008219s : 64.57% event_method : 0.000022s : 0.17% auto_monad : 0.000071s : 0.55% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000056s : 0.44% rewriter_before_opt_a : 0.000085s : 0.66% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.53% jit_opt_a.loop_unroll : 0.000039s : 0.31% jit_opt_a.a_1 : 0.000752s : 5.90% jit_opt_a.with_stream_mark : 0.000031s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000010s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.25% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000824s : 6.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000039s : 0.31% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000038s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000651s : 5.12% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000028s : 0.22% loop_unroll : 0.000453s : 3.56% jit_opt_after_cconv.c_1 : 0.000022s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000047s : 0.37% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000461s : 3.62% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.32% Time group info: ------[substitution.] 0.000257 27 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 3: substitution.graph_param_transform 83.77% : 0.000216s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.33% : 0.000011s : 3: substitution.reduce_eliminate 1.71% : 0.000004s : 4: substitution.remove_not_recompute_node 1.37% : 0.000004s : 2: substitution.replace_old_param 4.07% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008147 2 86.33% : 0.007033s : 1: type_inference.infer 13.67% : 0.001114s : 1: type_inference.specialize ------[replace.] 0.000095 7 67.74% : 0.000064s : 5: replace.inline 32.26% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 95.75% : 0.000212s : 5: match.inline 4.25% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.93% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.14% : 0.000001s : 11: predicate.addn_zero_filter 1.97% : 0.000002s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.67% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.75% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_depend_swap 1.17% : 0.000001s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.52% : 0.000007s : 24: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 16: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.40% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 1.25% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 16: predicate.partial_eliminate 1.25% : 0.000002s : 11: predicate.print_const_string_wrapper 2.21% : 0.000003s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 19: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.49% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.57% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000009s : 59: predicate.switch_simplify 1.30% : 0.000002s : 11: predicate.tile_eliminate 1.59% : 0.000002s : 11: predicate.transpose_eliminate 1.39% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.24% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000824 16 46.58% : 0.000384s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.51% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.92% : 0.000378s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018832 72 0.26% : 0.000050s : 1: add_recomputation 0.39% : 0.000074s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.68% : 0.000316s : 1: bootstrap 0.16% : 0.000031s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.52% : 0.005936s : 1: jit_opt_a 0.82% : 0.000155s : 1: jit_opt_after_cconv 0.30% : 0.000056s : 1: jit_opt_b 2.45% : 0.000462s : 1: loop_unroll 3.51% : 0.000661s : 1: mutable_eliminate 5.22% : 0.000984s : 26: opt.transform.jit_opt_a 0.26% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.49% : 0.000468s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000059s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.38% : 0.000448s : 1: renormalize.infer 1.95% : 0.000368s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000041s : 1: rewriter_after_opt_a 0.46% : 0.000087s : 1: rewriter_before_opt_a 0.42% : 0.000078s : 1: symbol_engine_optimizer 43.73% : 0.008235s : 1: type_inference TotalTime = 0.126455, [30] [bootstrap]: 0.00029103 [type_inference]: 0.112744 [event_method]: 2.102e-05 [auto_monad]: 6.699e-05 [graph_reusing]: 5.20001e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.00093727 [rewriter_before_opt_a]: 0.00010299 [expand_dump_flag]: 4.25999e-06 [jit_opt_a]: 0.00930001, [2] [Cycle 1]: 0.0049938, [27] [switch_simplify]: 5.847e-05 [loop_unroll]: 3.228e-05 [a_1]: 0.0006545 [with_stream_mark]: 1.94e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 3.72998e-06 [updatestate_assign_eliminate]: 2.91999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 7.35003e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.83e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.435e-05 [j_node_and_user_rematch]: 1.078e-05 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.046e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00383674 [add_forward_monad_depend]: 1.044e-05 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.964e-05 [cse]: 3.035e-05 [replace_applicator]: 2.565e-05 [Cycle 2]: 0.00041921, [27] [switch_simplify]: 8.1e-06 [loop_unroll]: 6.96001e-06 [a_1]: 0.00014081 [with_stream_mark]: 1.496e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 2.59999e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.79999e-06 [meta_shard_fg_expand]: 2.47001e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 4.59998e-06 [cell_reuse_recompute_pass]: 4.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.109e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 3.24001e-06 [replace_old_param]: 1.113e-05 [inline_without_move]: 5.84e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 7.04001e-06 [cse]: 1.195e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.797e-05 [rewriter_after_opt_a]: 4.019e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.00084752 [jit_opt_b]: 6.262e-05, [1] [Cycle 1]: 5.406e-05, [2] [frontend_op_eliminate]: 2.263e-05 [inline_after_opt_a]: 1.936e-05 [cconv]: 3.372e-05 [loop_unroll]: 0.00052536 [jit_opt_after_cconv]: 0.00017654, [1] [Cycle 1]: 0.00016798, [11] [c_1]: 2.84e-05 [parameter_eliminate]: 3.67998e-06 [updatestate_depend_eliminate]: 8.22998e-06 [updatestate_assign_eliminate]: 3.00002e-06 [updatestate_loads_eliminate]: 2.47001e-06 [cse]: 3.006e-05 [call_graph_tuple_transform]: 2.654e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 7.08998e-06 [remove_dup_value]: 1.775e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 1.059e-05 [add_recomputation]: 5.142e-05 [cse_after_recomputation]: 2.385e-05, [1] [Cycle 1]: 1.812e-05, [1] [cse]: 1.231e-05 [auto_monad_reorder]: 7.002e-05 [get_jit_bprop_graph]: 3.48e-06 [rewriter_after_jit_bprop_graph]: 8.86002e-06 [opt_after_jit_grad]: 0.00058921 [symbol_engine_optimizer]: 8.501e-05, [1] [Cycle 1]: 7.734e-05, [6] [build]: 4.55001e-06 [elim_shapecalc]: 1.016e-05 [elim_not_effective]: 1.624e-05 [opt_reshape]: 8.22998e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 3.19997e-07 [validate]: 0.00019289 Sums bootstrap : 0.000291s : 0.24% type_inference : 0.112744s : 92.48% event_method : 0.000021s : 0.02% auto_monad : 0.000067s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000937s : 0.77% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000795s : 0.65% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003837s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000848s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000034s : 0.03% loop_unroll : 0.000525s : 0.43% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000070s : 0.06% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000589s : 0.48% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000193s : 0.16% Time group info: ------[substitution.] 0.000265 24 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.46% : 0.000007s : 4: substitution.graph_param_transform 84.70% : 0.000224s : 4: substitution.inline 1.80% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000006s : 4: substitution.remove_not_recompute_node 2.38% : 0.000006s : 2: substitution.replace_old_param 4.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112658 2 96.79% : 0.109037s : 1: type_inference.infer 3.21% : 0.003622s : 1: type_inference.specialize ------[replace.] 0.000085 6 68.61% : 0.000058s : 4: replace.inline 31.39% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 6 94.97% : 0.000222s : 4: match.inline 5.03% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.18% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.51% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.33% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 4.92% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.89% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.60% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.36% : 0.000002s : 12: predicate.minmaximum_grad 2.03% : 0.000003s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 1.93% : 0.000003s : 12: predicate.reduce_eliminate 1.29% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.32% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.07% : 0.000002s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.20% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.13% : 0.000003s : 18: predicate.switch_defer_inline 1.85% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.51% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.78% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002650 22 56.02% : 0.001485s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.08% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.90% : 0.001111s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131283 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000071s : 1: auto_monad 0.06% : 0.000073s : 1: auto_monad_reorder 0.23% : 0.000304s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.09% : 0.009304s : 1: jit_opt_a 0.14% : 0.000179s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.41% : 0.000535s : 1: loop_unroll 0.65% : 0.000860s : 1: mutable_eliminate 0.81% : 0.001059s : 26: opt.transform.jit_opt_a 0.05% : 0.000064s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000599s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.72% : 0.000951s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.96% : 0.002567s : 1: renormalize.infer 0.96% : 0.001256s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.08% : 0.000108s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 85.89% : 0.112764s : 1: type_inference TotalTime = 0.0170707, [30] [bootstrap]: 0.00031851 [type_inference]: 0.00649242 [event_method]: 1.783e-05 [auto_monad]: 6.211e-05 [graph_reusing]: 5.84e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 4.733e-05 [rewriter_before_opt_a]: 7.302e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.006036, [2] [Cycle 1]: 0.00190614, [27] [switch_simplify]: 5.631e-05 [loop_unroll]: 3.061e-05 [a_1]: 0.00059315 [with_stream_mark]: 1.939e-05 [recompute_prepare]: 7.43e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.54002e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 8.70999e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 0.00087111 [add_forward_monad_depend]: 6.02001e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.555e-05 [cse]: 2.597e-05 [replace_applicator]: 1.395e-05 [Cycle 2]: 0.00033368, [27] [switch_simplify]: 5.85002e-06 [loop_unroll]: 5.56002e-06 [a_1]: 9.595e-05 [with_stream_mark]: 1.02e-05 [recompute_prepare]: 5.28002e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.84e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 8.56002e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 4.89003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 5.96998e-06 [cse]: 1.17e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.385e-05 [rewriter_after_opt_a]: 3.839e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00203126 [jit_opt_b]: 0.00011158, [1] [Cycle 1]: 0.00010101, [2] [frontend_op_eliminate]: 6.437e-05 [inline_after_opt_a]: 2.249e-05 [cconv]: 3.629e-05 [loop_unroll]: 0.00062506 [jit_opt_after_cconv]: 0.00017437, [1] [Cycle 1]: 0.00016671, [11] [c_1]: 2.389e-05 [parameter_eliminate]: 5.91e-06 [updatestate_depend_eliminate]: 8.57e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [cse]: 3.095e-05 [call_graph_tuple_transform]: 2.475e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 9.70002e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.757e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 8.12e-06 [add_recomputation]: 5.029e-05 [cse_after_recomputation]: 2.351e-05, [1] [Cycle 1]: 1.776e-05, [1] [cse]: 1.184e-05 [auto_monad_reorder]: 1.678e-05 [get_jit_bprop_graph]: 2.25002e-06 [rewriter_after_jit_bprop_graph]: 8.33001e-06 [opt_after_jit_grad]: 0.00052835 [symbol_engine_optimizer]: 7.908e-05, [1] [Cycle 1]: 7.226e-05, [6] [build]: 4.18001e-06 [elim_shapecalc]: 8.42998e-06 [elim_not_effective]: 1.524e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 9.76e-06 [renormalize]: 4.30009e-07 [validate]: 4.421e-05 Sums bootstrap : 0.000319s : 2.52% type_inference : 0.006492s : 51.28% event_method : 0.000018s : 0.14% auto_monad : 0.000062s : 0.49% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000047s : 0.37% rewriter_before_opt_a : 0.000073s : 0.58% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.49% jit_opt_a.loop_unroll : 0.000036s : 0.29% jit_opt_a.a_1 : 0.000689s : 5.44% jit_opt_a.with_stream_mark : 0.000030s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000871s : 6.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000038s : 0.30% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000014s : 0.11% rewriter_after_opt_a : 0.000038s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.002031s : 16.04% jit_opt_b.frontend_op_eliminate : 0.000064s : 0.51% jit_opt_b.inline_after_opt_a : 0.000022s : 0.18% cconv : 0.000036s : 0.29% loop_unroll : 0.000625s : 4.94% jit_opt_after_cconv.c_1 : 0.000024s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000031s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000018s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.06% add_recomputation : 0.000050s : 0.40% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000008s : 0.07% opt_after_jit_grad : 0.000528s : 4.17% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.35% Time group info: ------[substitution.] 0.000243 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.83% : 0.000007s : 3: substitution.graph_param_transform 84.30% : 0.000205s : 4: substitution.inline 1.71% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000006s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 5.35% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006425 2 83.35% : 0.005355s : 1: type_inference.infer 16.65% : 0.001070s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.74% : 0.000051s : 4: replace.inline 33.26% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 6 94.48% : 0.000202s : 4: match.inline 5.52% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.25% : 0.000002s : 10: predicate.accumulaten_eliminater 1.21% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.28% : 0.000002s : 10: predicate.addn_check_dump 1.42% : 0.000002s : 10: predicate.addn_zero_filter 2.03% : 0.000003s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000002s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 4.81% : 0.000006s : 22: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.69% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 3.06% : 0.000004s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.10% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.62% : 0.000001s : 3: predicate.reset_defer_inline 1.88% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.10% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.58% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.04% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000755 13 47.66% : 0.000360s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.44% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.90% : 0.000347s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018981 72 0.28% : 0.000053s : 1: add_recomputation 0.34% : 0.000065s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.76% : 0.000334s : 1: bootstrap 0.21% : 0.000040s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000010s : 1: environ_conv 0.11% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.82% : 0.006040s : 1: jit_opt_a 0.93% : 0.000177s : 1: jit_opt_after_cconv 0.61% : 0.000115s : 1: jit_opt_b 3.34% : 0.000635s : 1: loop_unroll 10.80% : 0.002050s : 1: mutable_eliminate 4.80% : 0.000911s : 26: opt.transform.jit_opt_a 0.30% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.40% : 0.000076s : 4: opt.transform.jit_opt_b 0.08% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.15% : 0.000028s : 1: opt.transform.mutable_eliminate 0.13% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.84% : 0.000539s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000050s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000021s : 1: remove_dup_value 2.44% : 0.000463s : 1: renormalize.infer 2.10% : 0.000399s : 1: renormalize.specialize 0.06% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000042s : 1: rewriter_after_opt_a 0.40% : 0.000076s : 1: rewriter_before_opt_a 0.43% : 0.000081s : 1: symbol_engine_optimizer 34.28% : 0.006507s : 1: type_inference TotalTime = 0.138813, [30] [bootstrap]: 0.00035929 [type_inference]: 0.128357 [event_method]: 1.962e-05 [auto_monad]: 6.094e-05 [graph_reusing]: 5.12e-06 [pre_auto_parallel]: 1.66002e-06 [py_interpret_to_execute]: 0.0005026 [rewriter_before_opt_a]: 8.572e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00714693, [2] [Cycle 1]: 0.00361413, [27] [switch_simplify]: 5.454e-05 [loop_unroll]: 3.41e-05 [a_1]: 0.00064798 [with_stream_mark]: 1.408e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 6.28e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 1.90001e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00254372 [add_forward_monad_depend]: 6.08998e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.402e-05 [cse]: 2.223e-05 [replace_applicator]: 1.438e-05 [Cycle 2]: 0.00036912, [27] [switch_simplify]: 7.11001e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00012844 [with_stream_mark]: 1.104e-05 [recompute_prepare]: 6.23998e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.98998e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.178e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 7.98001e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.40025e-07 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.286e-05 [replace_applicator]: 6.38e-06 [py_interpret_to_execute_after_opt_a]: 1.337e-05 [rewriter_after_opt_a]: 3.669e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 5.36002e-06 [mutable_eliminate]: 0.00058335 [jit_opt_b]: 5.418e-05, [1] [Cycle 1]: 4.716e-05, [2] [frontend_op_eliminate]: 1.874e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 2.261e-05 [loop_unroll]: 0.00042792 [jit_opt_after_cconv]: 0.0001529, [1] [Cycle 1]: 0.00014538, [11] [c_1]: 2.545e-05 [parameter_eliminate]: 2.35002e-06 [updatestate_depend_eliminate]: 7.08e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.219e-05 [call_graph_tuple_transform]: 2.121e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.518e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 7.95e-06 [add_recomputation]: 4.492e-05 [cse_after_recomputation]: 2.274e-05, [1] [Cycle 1]: 1.737e-05, [1] [cse]: 1.173e-05 [auto_monad_reorder]: 1.814e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 4.44998e-06 [opt_after_jit_grad]: 0.00046835 [symbol_engine_optimizer]: 0.00015609, [1] [Cycle 1]: 0.00014959, [6] [build]: 3.31001e-06 [elim_shapecalc]: 8.64e-06 [elim_not_effective]: 9.159e-05 [opt_reshape]: 7.51999e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 3.89991e-07 [validate]: 4.23e-05 Sums bootstrap : 0.000359s : 0.27% type_inference : 0.128357s : 95.03% event_method : 0.000020s : 0.01% auto_monad : 0.000061s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000503s : 0.37% rewriter_before_opt_a : 0.000086s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000776s : 0.57% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002544s : 1.88% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.01% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000583s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000428s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000468s : 0.35% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000092s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.03% Time group info: ------[substitution.] 0.000230 28 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000006s : 4: substitution.graph_param_transform 82.64% : 0.000190s : 5: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000010s : 3: substitution.reduce_eliminate 1.82% : 0.000004s : 4: substitution.remove_not_recompute_node 1.58% : 0.000004s : 2: substitution.replace_old_param 4.12% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.128254 2 97.87% : 0.125524s : 1: type_inference.infer 2.13% : 0.002730s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.00% : 0.000062s : 5: replace.inline 32.00% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 7 95.73% : 0.000187s : 5: match.inline 4.27% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 2.19% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.89% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.34% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 1.98% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.56% : 0.000010s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002530 25 71.38% : 0.001806s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.14% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 26.48% : 0.000670s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.142511 72 0.03% : 0.000048s : 1: add_recomputation 0.04% : 0.000064s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.27% : 0.000379s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.02% : 0.007151s : 1: jit_opt_a 0.11% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.31% : 0.000436s : 1: loop_unroll 0.42% : 0.000592s : 1: mutable_eliminate 0.71% : 0.001010s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000114s : 4: opt.transform.symbol_engine_opt 0.33% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000508s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.29% : 0.001840s : 1: renormalize.infer 0.49% : 0.000695s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.06% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000159s : 1: symbol_engine_optimizer 90.08% : 0.128369s : 1: type_inference TotalTime = 0.116241, [30] [bootstrap]: 0.00030084 [type_inference]: 0.105745 [event_method]: 1.856e-05 [auto_monad]: 6.675e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.0004454 [rewriter_before_opt_a]: 8.248e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.0074646, [2] [Cycle 1]: 0.00386168, [27] [switch_simplify]: 5.457e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00055269 [with_stream_mark]: 1.515e-05 [recompute_prepare]: 8.23001e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.10998e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.93998e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.99999e-06 [renormalize]: 0.00286982 [add_forward_monad_depend]: 6.02001e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 2.967e-05 [replace_applicator]: 1.456e-05 [Cycle 2]: 0.00036072, [27] [switch_simplify]: 7.13998e-06 [loop_unroll]: 5.80002e-06 [a_1]: 0.0001205 [with_stream_mark]: 9.92001e-06 [recompute_prepare]: 6.02999e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 5.33002e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 1.91003e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.82999e-06 [cse]: 1.109e-05 [replace_applicator]: 5.85002e-06 [py_interpret_to_execute_after_opt_a]: 9.68997e-06 [rewriter_after_opt_a]: 3.307e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.58002e-06 [mutable_eliminate]: 0.00053732 [jit_opt_b]: 5.564e-05, [1] [Cycle 1]: 4.882e-05, [2] [frontend_op_eliminate]: 1.977e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.332e-05 [loop_unroll]: 0.00041545 [jit_opt_after_cconv]: 0.00015875, [1] [Cycle 1]: 0.00015218, [11] [c_1]: 2.531e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.05999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 1.219e-05 [cse]: 2.097e-05 [call_graph_tuple_transform]: 1.971e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.547e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 7.43e-06 [add_recomputation]: 4.691e-05 [cse_after_recomputation]: 2.105e-05, [1] [Cycle 1]: 1.526e-05, [1] [cse]: 9.90002e-06 [auto_monad_reorder]: 1.425e-05 [get_jit_bprop_graph]: 1.445e-05 [rewriter_after_jit_bprop_graph]: 4.84998e-06 [opt_after_jit_grad]: 0.00045507 [symbol_engine_optimizer]: 7.541e-05, [1] [Cycle 1]: 6.915e-05, [6] [build]: 3.35998e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 6.78e-06 [fold_const_symbol]: 9.45001e-06 [renormalize]: 3.10014e-07 [validate]: 3.805e-05 Sums bootstrap : 0.000301s : 0.27% type_inference : 0.105745s : 94.05% event_method : 0.000019s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000445s : 0.40% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000673s : 0.60% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002870s : 2.55% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000537s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000415s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000012s : 0.01% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000014s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000455s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.03% Time group info: ------[substitution.] 0.000196 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000005s : 4: substitution.graph_param_transform 82.94% : 0.000163s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000005s : 4: substitution.remove_not_recompute_node 2.45% : 0.000005s : 2: substitution.replace_old_param 5.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105675 2 97.36% : 0.102885s : 1: type_inference.infer 2.64% : 0.002790s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.72% : 0.000049s : 4: replace.inline 32.28% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.84% : 0.000160s : 4: match.inline 6.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.20% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.09% : 0.000001s : 12: predicate.environ_get_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.30% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.79% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.74% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.69% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.45% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002049 22 65.71% : 0.001346s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.89% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120087 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.26% : 0.000313s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000017s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.22% : 0.007468s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000423s : 1: loop_unroll 0.45% : 0.000546s : 1: mutable_eliminate 0.75% : 0.000902s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000452s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.80% : 0.002164s : 1: renormalize.infer 0.58% : 0.000698s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000087s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.07% : 0.105760s : 1: type_inference TotalTime = 0.0150725, [30] [bootstrap]: 0.0003528 [type_inference]: 0.00752237 [event_method]: 1.973e-05 [auto_monad]: 5.563e-05 [graph_reusing]: 4.75999e-06 [pre_auto_parallel]: 1.70001e-06 [py_interpret_to_execute]: 4.064e-05 [rewriter_before_opt_a]: 7.384e-05 [expand_dump_flag]: 2.36e-06 [jit_opt_a]: 0.00505012, [2] [Cycle 1]: 0.00153595, [27] [switch_simplify]: 5.031e-05 [loop_unroll]: 3.304e-05 [a_1]: 0.00056555 [with_stream_mark]: 1.033e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 5.84999e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 8.29983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.125e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 1.96003e-06 [replace_old_param]: 8.36002e-06 [inline_without_move]: 5.84e-06 [renormalize]: 0.00058148 [add_forward_monad_depend]: 4.27003e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 9.96e-06 [cse]: 2.227e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00058979, [27] [switch_simplify]: 6.02001e-06 [loop_unroll]: 5.00999e-06 [a_1]: 9.558e-05 [with_stream_mark]: 8.28999e-06 [recompute_prepare]: 5.11997e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.97999e-06 [updatestate_useless_node_eliminater]: 4.96002e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.033e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.57999e-06 [cse]: 1.248e-05 [replace_applicator]: 1.188e-05 [py_interpret_to_execute_after_opt_a]: 1.108e-05 [rewriter_after_opt_a]: 3.673e-05 [convert_after_rewriter]: 6.01e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00047638 [jit_opt_b]: 4.936e-05, [1] [Cycle 1]: 4.352e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 1.459e-05 [loop_unroll]: 0.00040614 [jit_opt_after_cconv]: 0.00015002, [1] [Cycle 1]: 0.00014404, [11] [c_1]: 2.14e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.154e-05 [call_graph_tuple_transform]: 2.661e-05 [tuple_list_get_item_eliminator]: 5.41002e-06 [none_parameter_eliminate]: 1.08001e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 9.43002e-06 [partial_unused_args_eliminate]: 2.05002e-06 [environ_conv]: 4.65001e-06 [add_recomputation]: 3.309e-05 [cse_after_recomputation]: 2.297e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.216e-05 [auto_monad_reorder]: 1.163e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.07003e-06 [opt_after_jit_grad]: 0.00044517 [symbol_engine_optimizer]: 6.939e-05, [1] [Cycle 1]: 6.334e-05, [6] [build]: 2.39999e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.209e-05 [opt_reshape]: 5.59e-06 [fold_const_symbol]: 8.20999e-06 [renormalize]: 3.19997e-07 [validate]: 3.058e-05 Sums bootstrap : 0.000353s : 3.11% type_inference : 0.007522s : 66.36% event_method : 0.000020s : 0.17% auto_monad : 0.000056s : 0.49% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000041s : 0.36% rewriter_before_opt_a : 0.000074s : 0.65% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000056s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000661s : 5.83% jit_opt_a.with_stream_mark : 0.000019s : 0.16% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000582s : 5.13% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.14% jit_opt_a.cse : 0.000035s : 0.31% jit_opt_a.replace_applicator : 0.000024s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000037s : 0.32% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000476s : 4.20% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000015s : 0.13% loop_unroll : 0.000406s : 3.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000009s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000033s : 0.29% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000012s : 0.10% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000445s : 3.93% symbol_engine_optimizer.build : 0.000002s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.27% Time group info: ------[substitution.] 0.000203 27 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 6.87% : 0.000014s : 3: substitution.graph_param_transform 78.32% : 0.000159s : 5: substitution.inline 1.21% : 0.000002s : 4: substitution.j_node_and_user_rematch 4.48% : 0.000009s : 3: substitution.reduce_eliminate 1.92% : 0.000004s : 4: substitution.remove_not_recompute_node 1.33% : 0.000003s : 2: substitution.replace_old_param 4.52% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007465 2 87.78% : 0.006553s : 1: type_inference.infer 12.22% : 0.000912s : 1: type_inference.specialize ------[replace.] 0.000081 7 65.24% : 0.000053s : 5: replace.inline 34.76% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 7 95.06% : 0.000156s : 5: match.inline 4.94% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.27% : 0.000002s : 11: predicate.addn_zero_filter 1.94% : 0.000002s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.22% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000001s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.33% : 0.000002s : 6: predicate.get_grad_eliminate 0.21% : 0.000000s : 3: predicate.graph_param_transform 5.28% : 0.000006s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 16: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.25% : 0.000002s : 11: predicate.minmaximum_grad 1.10% : 0.000001s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000001s : 11: predicate.print_const_string_wrapper 1.99% : 0.000002s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.91% : 0.000002s : 11: predicate.reshape_eliminate 1.39% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 11: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.77% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.33% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000009s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000710 16 51.17% : 0.000363s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.98% : 0.000050s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.84% : 0.000297s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016601 72 0.22% : 0.000036s : 1: add_recomputation 0.36% : 0.000059s : 1: auto_monad 0.09% : 0.000014s : 1: auto_monad_reorder 2.24% : 0.000371s : 1: bootstrap 0.10% : 0.000017s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000003s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.44% : 0.005053s : 1: jit_opt_a 0.92% : 0.000153s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.49% : 0.000414s : 1: loop_unroll 2.91% : 0.000483s : 1: mutable_eliminate 5.26% : 0.000874s : 26: opt.transform.jit_opt_a 0.34% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000012s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000453s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.26% : 0.000043s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000012s : 1: remove_dup_value 1.87% : 0.000311s : 1: renormalize.infer 1.59% : 0.000264s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000040s : 1: rewriter_after_opt_a 0.46% : 0.000077s : 1: rewriter_before_opt_a 0.43% : 0.000072s : 1: symbol_engine_optimizer 45.38% : 0.007534s : 1: type_inference TotalTime = 0.0652405, [30] [bootstrap]: 0.00033815 [type_inference]: 0.0548007 [event_method]: 3.26e-05 [auto_monad]: 7.08e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00024705 [rewriter_before_opt_a]: 9.497e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00729853, [2] [Cycle 1]: 0.00303899, [27] [switch_simplify]: 6.475e-05 [loop_unroll]: 3.343e-05 [a_1]: 0.00060215 [with_stream_mark]: 1.93e-05 [recompute_prepare]: 8.41002e-06 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00197718 [add_forward_monad_depend]: 5.45001e-06 [auto_monad_grad]: 2.95002e-06 [auto_monad_eliminator]: 1.539e-05 [cse]: 2.988e-05 [replace_applicator]: 1.542e-05 [Cycle 2]: 0.00035858, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 5.52999e-06 [a_1]: 0.00012142 [with_stream_mark]: 1.019e-05 [recompute_prepare]: 5.98998e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 2.13998e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 5.74999e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.60999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.45002e-06 [cse]: 1.167e-05 [replace_applicator]: 5.98002e-06 [py_interpret_to_execute_after_opt_a]: 1.283e-05 [rewriter_after_opt_a]: 3.678e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00073994 [jit_opt_b]: 5.316e-05, [1] [Cycle 1]: 4.646e-05, [2] [frontend_op_eliminate]: 1.852e-05 [inline_after_opt_a]: 1.727e-05 [cconv]: 2.408e-05 [loop_unroll]: 0.0004134 [jit_opt_after_cconv]: 0.00017774, [1] [Cycle 1]: 0.00017158, [11] [c_1]: 2.519e-05 [parameter_eliminate]: 2.55002e-06 [updatestate_depend_eliminate]: 5.13002e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 1.961e-05 [call_graph_tuple_transform]: 2.015e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.67002e-06 [remove_dup_value]: 1.521e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 8.30999e-06 [add_recomputation]: 4.97e-05 [cse_after_recomputation]: 2.371e-05, [1] [Cycle 1]: 1.796e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.48e-05 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.000456 [symbol_engine_optimizer]: 7.506e-05, [1] [Cycle 1]: 6.894e-05, [6] [build]: 3.38999e-06 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 6.19001e-06 [fold_const_symbol]: 9.17001e-06 [renormalize]: 3.59985e-07 [validate]: 4.215e-05 Sums bootstrap : 0.000338s : 0.56% type_inference : 0.054801s : 90.24% event_method : 0.000033s : 0.05% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000247s : 0.41% rewriter_before_opt_a : 0.000095s : 0.16% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000072s : 0.12% jit_opt_a.loop_unroll : 0.000039s : 0.06% jit_opt_a.a_1 : 0.000724s : 1.19% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001977s : 3.26% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000740s : 1.22% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000413s : 0.68% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000456s : 0.75% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000240 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 4: substitution.graph_param_transform 85.15% : 0.000204s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000005s : 2: substitution.replace_old_param 5.33% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054712 2 96.34% : 0.052711s : 1: type_inference.infer 3.66% : 0.002001s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.23% : 0.000052s : 4: replace.inline 30.77% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 6 94.50% : 0.000202s : 4: match.inline 5.50% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.70% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.54% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.22% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.71% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.54% : 0.000010s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002332 26 74.35% : 0.001734s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.19% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.46% : 0.000547s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068248 72 0.08% : 0.000053s : 1: add_recomputation 0.11% : 0.000075s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.52% : 0.000352s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.06% : 0.000038s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.70% : 0.007302s : 1: jit_opt_a 0.26% : 0.000181s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.62% : 0.000420s : 1: loop_unroll 1.10% : 0.000749s : 1: mutable_eliminate 1.41% : 0.000965s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000254s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.03% : 0.001387s : 1: renormalize.infer 0.85% : 0.000582s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.15% : 0.000102s : 1: rewriter_before_opt_a 0.11% : 0.000078s : 1: symbol_engine_optimizer 80.32% : 0.054820s : 1: type_inference TotalTime = 0.0112385, [30] [bootstrap]: 0.00028744 [type_inference]: 0.00416367 [event_method]: 1.544e-05 [auto_monad]: 4.285e-05 [graph_reusing]: 3.93999e-06 [pre_auto_parallel]: 1.55999e-06 [py_interpret_to_execute]: 3.106e-05 [rewriter_before_opt_a]: 6.22e-05 [expand_dump_flag]: 2.73e-06 [jit_opt_a]: 0.00476311, [2] [Cycle 1]: 0.00137769, [27] [switch_simplify]: 4.65e-05 [loop_unroll]: 3.013e-05 [a_1]: 0.00047582 [with_stream_mark]: 1.164e-05 [recompute_prepare]: 7.16999e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.19003e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 8.70001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.113e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.85998e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00053781 [add_forward_monad_depend]: 4.70999e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 1.041e-05 [cse]: 1.676e-05 [replace_applicator]: 1.14e-05 [Cycle 2]: 0.00030746, [27] [switch_simplify]: 5.74999e-06 [loop_unroll]: 4.93001e-06 [a_1]: 8.991e-05 [with_stream_mark]: 7.74002e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.07001e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 4.85999e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.76002e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 4.49998e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.01999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.60018e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.24998e-06 [cse]: 9.49999e-06 [replace_applicator]: 4.87e-06 [py_interpret_to_execute_after_opt_a]: 7.98999e-06 [rewriter_after_opt_a]: 2.728e-05 [convert_after_rewriter]: 5.54998e-06 [order_py_execute_after_rewriter]: 4.38999e-06 [mutable_eliminate]: 0.00046765 [jit_opt_b]: 4.884e-05, [1] [Cycle 1]: 4.246e-05, [2] [frontend_op_eliminate]: 1.59e-05 [inline_after_opt_a]: 1.508e-05 [cconv]: 1.791e-05 [loop_unroll]: 0.00039465 [jit_opt_after_cconv]: 0.00013682, [1] [Cycle 1]: 0.0001305, [11] [c_1]: 2.043e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.778e-05 [call_graph_tuple_transform]: 1.777e-05 [tuple_list_get_item_eliminator]: 5.63002e-06 [none_parameter_eliminate]: 1.01002e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.09998e-06 [remove_dup_value]: 8.57e-06 [partial_unused_args_eliminate]: 1.87999e-06 [environ_conv]: 4.27e-06 [add_recomputation]: 3.366e-05 [cse_after_recomputation]: 2.097e-05, [1] [Cycle 1]: 1.576e-05, [1] [cse]: 1.034e-05 [auto_monad_reorder]: 9.35001e-06 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 3.74002e-06 [opt_after_jit_grad]: 0.00042593 [symbol_engine_optimizer]: 6.871e-05, [1] [Cycle 1]: 6.281e-05, [6] [build]: 2.25002e-06 [elim_shapecalc]: 7.31001e-06 [elim_not_effective]: 1.196e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.32998e-06 [renormalize]: 3.89991e-07 [validate]: 2.655e-05 Sums bootstrap : 0.000287s : 3.77% type_inference : 0.004164s : 54.54% event_method : 0.000015s : 0.20% auto_monad : 0.000043s : 0.56% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000031s : 0.41% rewriter_before_opt_a : 0.000062s : 0.81% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000052s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.46% jit_opt_a.a_1 : 0.000566s : 7.41% jit_opt_a.with_stream_mark : 0.000019s : 0.25% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.14% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000538s : 7.05% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.21% jit_opt_a.cse : 0.000026s : 0.34% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000027s : 0.36% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000468s : 6.13% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000018s : 0.23% loop_unroll : 0.000395s : 5.17% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000009s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.06% add_recomputation : 0.000034s : 0.44% cse_after_recomputation.cse : 0.000010s : 0.14% auto_monad_reorder : 0.000009s : 0.12% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000426s : 5.58% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000027s : 0.35% Time group info: ------[substitution.] 0.000153 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 3.00% : 0.000005s : 3: substitution.graph_param_transform 83.93% : 0.000128s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.92% : 0.000004s : 4: substitution.remove_not_recompute_node 1.76% : 0.000003s : 2: substitution.replace_old_param 5.06% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004117 2 79.62% : 0.003278s : 1: type_inference.infer 20.38% : 0.000839s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.12% : 0.000041s : 4: replace.inline 33.88% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000132 6 95.02% : 0.000126s : 4: match.inline 4.98% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.30% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 2.31% : 0.000003s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.30% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.37% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.44% : 0.000008s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000561 13 50.35% : 0.000283s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.98% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.67% : 0.000251s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012610 72 0.29% : 0.000036s : 1: add_recomputation 0.36% : 0.000046s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 2.39% : 0.000301s : 1: bootstrap 0.16% : 0.000020s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.80% : 0.004767s : 1: jit_opt_a 1.11% : 0.000139s : 1: jit_opt_after_cconv 0.41% : 0.000051s : 1: jit_opt_b 3.19% : 0.000403s : 1: loop_unroll 3.77% : 0.000476s : 1: mutable_eliminate 6.06% : 0.000764s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.43% : 0.000433s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000034s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000011s : 1: remove_dup_value 2.17% : 0.000274s : 1: renormalize.infer 2.05% : 0.000258s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000030s : 1: rewriter_after_opt_a 0.51% : 0.000065s : 1: rewriter_before_opt_a 0.56% : 0.000071s : 1: symbol_engine_optimizer 33.09% : 0.004173s : 1: type_inference TotalTime = 0.573997, [30] [bootstrap]: 0.00028857 [type_inference]: 0.563195 [event_method]: 2.353e-05 [auto_monad]: 6.73e-05 [graph_reusing]: 4.74998e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 0.00047413 [rewriter_before_opt_a]: 9.076e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0075707, [2] [Cycle 1]: 0.00369994, [27] [switch_simplify]: 5.225e-05 [loop_unroll]: 3.315e-05 [a_1]: 0.0006556 [with_stream_mark]: 1.316e-05 [recompute_prepare]: 8.82999e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 7.12002e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 6.42001e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 7.30011e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.235e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 9.55001e-06 [inline_without_move]: 6.29001e-06 [renormalize]: 0.00261437 [add_forward_monad_depend]: 5.61003e-06 [auto_monad_grad]: 2.39999e-06 [auto_monad_eliminator]: 1.46e-05 [cse]: 2.838e-05 [replace_applicator]: 1.521e-05 [Cycle 2]: 0.00037286, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.83997e-06 [a_1]: 0.00012859 [with_stream_mark]: 1.022e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.307e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 9.09998e-06 [inline_without_move]: 5.49e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.447e-05 [replace_applicator]: 6.36e-06 [py_interpret_to_execute_after_opt_a]: 1.256e-05 [rewriter_after_opt_a]: 3.674e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.0005977 [jit_opt_b]: 5.574e-05, [1] [Cycle 1]: 4.899e-05, [2] [frontend_op_eliminate]: 1.965e-05 [inline_after_opt_a]: 1.837e-05 [cconv]: 2.174e-05 [loop_unroll]: 0.00043351 [jit_opt_after_cconv]: 0.00015205, [1] [Cycle 1]: 0.00014553, [11] [c_1]: 2.703e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.184e-05 [call_graph_tuple_transform]: 2.073e-05 [tuple_list_get_item_eliminator]: 6.23e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 7.2e-06 [remove_dup_value]: 1.326e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 7.10002e-06 [add_recomputation]: 4.325e-05 [cse_after_recomputation]: 2.335e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.58e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.74999e-06 [opt_after_jit_grad]: 0.00046686 [symbol_engine_optimizer]: 0.00014903, [1] [Cycle 1]: 0.00014287, [6] [build]: 3.33998e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 7.79e-05 [fold_const_symbol]: 1.06e-05 [renormalize]: 3.60014e-07 [validate]: 4.133e-05 Sums bootstrap : 0.000289s : 0.05% type_inference : 0.563195s : 98.82% event_method : 0.000024s : 0.00% auto_monad : 0.000067s : 0.01% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000474s : 0.08% rewriter_before_opt_a : 0.000091s : 0.02% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.01% jit_opt_a.loop_unroll : 0.000039s : 0.01% jit_opt_a.a_1 : 0.000784s : 0.14% jit_opt_a.with_stream_mark : 0.000023s : 0.00% jit_opt_a.recompute_prepare : 0.000015s : 0.00% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.00% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.00% jit_opt_a.accelerated_algorithm : 0.000012s : 0.00% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.00% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.00% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.00% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.00% jit_opt_a.inline_without_move : 0.000012s : 0.00% jit_opt_a.renormalize : 0.002614s : 0.46% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.00% jit_opt_a.cse : 0.000043s : 0.01% jit_opt_a.replace_applicator : 0.000022s : 0.00% py_interpret_to_execute_after_opt_a : 0.000013s : 0.00% rewriter_after_opt_a : 0.000037s : 0.01% convert_after_rewriter : 0.000007s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000598s : 0.10% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.00% jit_opt_b.inline_after_opt_a : 0.000018s : 0.00% cconv : 0.000022s : 0.00% loop_unroll : 0.000434s : 0.08% jit_opt_after_cconv.c_1 : 0.000027s : 0.00% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.00% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.00% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000013s : 0.00% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.00% add_recomputation : 0.000043s : 0.01% cse_after_recomputation.cse : 0.000013s : 0.00% auto_monad_reorder : 0.000016s : 0.00% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000467s : 0.08% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.00% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.00% symbol_engine_optimizer.opt_reshape : 0.000078s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.00% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.01% Time group info: ------[substitution.] 0.000244 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000005s : 4: substitution.graph_param_transform 83.19% : 0.000203s : 5: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.85% : 0.000009s : 3: substitution.reduce_eliminate 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 4.31% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.563118 2 99.51% : 0.560340s : 1: type_inference.infer 0.49% : 0.002778s : 1: type_inference.specialize ------[replace.] 0.000094 7 69.02% : 0.000065s : 5: replace.inline 30.98% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 7 95.52% : 0.000201s : 5: match.inline 4.48% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.52% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.37% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.06% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.39% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.80% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 1.94% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.57% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.43% : 0.000010s : 64: predicate.switch_simplify 1.49% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.62% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002315 25 65.97% : 0.001527s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.90% : 0.000067s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.13% : 0.000720s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.577770 72 0.01% : 0.000046s : 1: add_recomputation 0.01% : 0.000071s : 1: auto_monad 0.00% : 0.000018s : 1: auto_monad_reorder 0.05% : 0.000305s : 1: bootstrap 0.00% : 0.000024s : 1: cconv 0.00% : 0.000009s : 1: convert_after_rewriter 0.00% : 0.000027s : 1: cse_after_recomputation 0.00% : 0.000009s : 1: environ_conv 0.00% : 0.000028s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 1.31% : 0.007575s : 1: jit_opt_a 0.03% : 0.000155s : 1: jit_opt_after_cconv 0.01% : 0.000058s : 1: jit_opt_b 0.08% : 0.000441s : 1: loop_unroll 0.10% : 0.000606s : 1: mutable_eliminate 0.18% : 0.001018s : 26: opt.transform.jit_opt_a 0.01% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.01% : 0.000032s : 4: opt.transform.jit_opt_b 0.00% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.00% : 0.000015s : 1: opt.transform.mutable_eliminate 0.00% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000106s : 4: opt.transform.symbol_engine_opt 0.08% : 0.000474s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.08% : 0.000480s : 1: py_interpret_to_execute 0.00% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.00% : 0.000016s : 1: remove_dup_value 0.32% : 0.001857s : 1: renormalize.infer 0.13% : 0.000749s : 1: renormalize.specialize 0.00% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.01% : 0.000039s : 1: rewriter_after_opt_a 0.02% : 0.000095s : 1: rewriter_before_opt_a 0.03% : 0.000152s : 1: symbol_engine_optimizer 97.48% : 0.563214s : 1: type_inference TotalTime = 0.142994, [30] [bootstrap]: 0.00029578 [type_inference]: 0.131501 [event_method]: 2.05e-05 [auto_monad]: 4.939e-05 [graph_reusing]: 4.28999e-06 [pre_auto_parallel]: 1.76e-06 [py_interpret_to_execute]: 0.00047724 [rewriter_before_opt_a]: 8.876e-05 [expand_dump_flag]: 2.53e-06 [jit_opt_a]: 0.00805185, [2] [Cycle 1]: 0.00419727, [27] [switch_simplify]: 6.011e-05 [loop_unroll]: 3.43e-05 [a_1]: 0.00070154 [with_stream_mark]: 1.399e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.347e-05 [j_node_and_user_rematch]: 9.80002e-06 [meta_fg_expand]: 1.89999e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 6.76999e-06 [renormalize]: 0.00303549 [add_forward_monad_depend]: 7.91001e-06 [auto_monad_grad]: 3.01001e-06 [auto_monad_eliminator]: 1.779e-05 [cse]: 2.993e-05 [replace_applicator]: 1.824e-05 [Cycle 2]: 0.00038578, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.54001e-06 [a_1]: 0.00013795 [with_stream_mark]: 9.87001e-06 [recompute_prepare]: 7e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.33998e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.304e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 4.60015e-07 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.321e-05 [replace_applicator]: 6.10002e-06 [py_interpret_to_execute_after_opt_a]: 1.493e-05 [rewriter_after_opt_a]: 3.62e-05 [convert_after_rewriter]: 6.09001e-06 [order_py_execute_after_rewriter]: 4.65001e-06 [mutable_eliminate]: 0.000717 [jit_opt_b]: 5.661e-05, [1] [Cycle 1]: 4.95e-05, [2] [frontend_op_eliminate]: 2.076e-05 [inline_after_opt_a]: 1.797e-05 [cconv]: 2.916e-05 [loop_unroll]: 0.00043654 [jit_opt_after_cconv]: 0.00015076, [1] [Cycle 1]: 0.00014458, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.305e-05 [call_graph_tuple_transform]: 1.981e-05 [tuple_list_get_item_eliminator]: 6.46999e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.73e-06 [remove_dup_value]: 1.493e-05 [partial_unused_args_eliminate]: 2.24999e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.985e-05 [cse_after_recomputation]: 5.597e-05, [1] [Cycle 1]: 5.087e-05, [1] [cse]: 4.409e-05 [auto_monad_reorder]: 1.845e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 6.84001e-06 [opt_after_jit_grad]: 0.00051087 [symbol_engine_optimizer]: 0.00014965, [1] [Cycle 1]: 0.00014245, [6] [build]: 3.85e-06 [elim_shapecalc]: 8.72e-06 [elim_not_eff TotalTime = 0.130263, [30] [bootstrap]: 0.00029703 [type_inference]: 0.118683 [event_method]: 1.887e-05 [auto_monad]: 5.517e-05 [graph_reusing]: 4.87e-06 [pre_auto_parallel]: 1.92001e-06 [py_interpret_to_execute]: 0.00047199 [rewriter_before_opt_a]: 8.69e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.0081267, [2] [Cycle 1]: 0.0041976, [27] [switch_simplify]: 5.368e-05 [loop_unroll]: 3.093e-05 [a_1]: 0.00059502 [with_stream_mark]: 1.524e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 3.56001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 7.12002e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.60997e-06 [renormalize]: 0.00315243 [add_forward_monad_depend]: 7.64002e-06 [auto_monad_grad]: 2.97002e-06 [auto_monad_eliminator]: 1.776e-05 [cse]: 2.882e-05 [replace_applicator]: 2.073e-05 [Cycle 2]: 0.00038364, [27] [switch_simplify]: 6.96999e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00013007 [with_stream_mark]: 1.333e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 5.90002e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 3.5e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.16998e-06 [meta_fg_expand]: 2.53003e-06 [replace_old_param]: 9.29998e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.09e-05 [replace_applicator]: 5.86998e-06 [py_interpret_to_execute_after_opt_a]: 1.45e-05 [rewriter_after_opt_a]: 3.553e-05 [convert_after_rewriter]: 7.04001e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.00071467 [jit_opt_b]: 5.868e-05, [1] [Cycle 1]: 5.142e-05, [2] [frontend_op_eliminate]: 2.021e-05 [inline_after_opt_a]: 1.957e-05 [cconv]: 2.951e-05 [loop_unroll]: 0.00042937 [jit_opt_after_cconv]: 0.00015738, [1] [Cycle 1]: 0.00015092, [11] [c_1]: 2.553e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 2.47e-05 [call_graph_tuple_transform]: 2.058e-05 [tuple_list_get_item_eliminator]: 5.98002e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.509e-05 [partial_unused_args_eliminate]: 1.42e-06 [environ_conv]: 5.62001e-06 [add_recomputation]: 4.997e-05 [cse_after_recomputation]: 0.00015341, [1] [Cycle 1]: 3.04e-05, [1] [cse]: 2.387e-05 [auto_monad_reorder]: 1.292e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 7.36001e-06 [opt_after_jit_grad]: 0.00051046 [symbol_engine_optimizer]: 7.832e-05, [1] [Cycle 1]: 7.026e-05, [6] [build]: 2.89999e-06 [elim_shapecalc]: 8.429ective]: 8.302e-05 [opt_reshape]: 7.51999e-06 [fold_const_symbol]: 9.99999e-06 [renormalize]: 4.80009e-07 [validate]: 4.937e-05 Sums bootstrap : 0.000296s : 0.21% type_inference : 0.131501s : 94.65% event_method : 0.000021s : 0.01% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000477s : 0.34% rewriter_before_opt_a : 0.000089s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000839s : 0.60% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003036s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000043s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000717s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000437s : 0.31% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_98e-06 [elim_not_effective]: 1.407e-05 [opt_reshape]: 7.18998e-06 [fold_const_symbol]: 9.86998e-06 [renormalize]: 3.59985e-07 [validate]: 3.588e-05 Sums bootstrap : 0.000297s : 0.24% type_inference : 0.118683s : 94.20% event_method : 0.000019s : 0.01% auto_monad : 0.000055s : 0.04% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000472s : 0.37% rewriter_before_opt_a : 0.000087s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000725s : 0.58% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003152s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000715s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000429s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.0conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000044s : 0.03% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.00% opt_after_jit_grad : 0.000511s : 0.37% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000083s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.04% 00001s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000024s : 0.02% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000510s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000222 24 0.67% : 0.000001s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 84.30% : 0.000187s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.25% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 5.68% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118607 2 97.63% : 0.115799s : 1: type_inference.infer 2.37% : 0.002808s : 1: type_inference.specialize ------[replace.] 0.000075 6 67.85% : 0.000051s : 4: replace.inline 32.15% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.16% : 0.000185s : 4: match.inline 5.84% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.42% : 0.000002s : 12: predicate.addn_check_dump 1.19% : 0.000002s : 12: predicate.addn_zero_filter 2.57% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.49% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 2.09% : 0.000003s : 12: predicate.reduce_eliminate 1.72% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: Time group info: ------[substitution.] 0.000264 28 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 4: substitution.graph_param_transform 84.56% : 0.000223s : 5: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000012s : 3: substitution.reduce_eliminate 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000005s : 2: substitution.replace_old_param 3.00% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.131439 2 97.83% : 0.128590s : 1: type_inference.infer 2.17% : 0.002850s : 1: type_inference.specialize ------[replace.] 0.000102 7 67.78% : 0.000069s : 5: replace.inline 32.22% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 97.00% : 0.000220s : 5: match.inline 3.00% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.56% : 0.000002s : 13: predicate.accumulaten_eliminater 1.43% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 2.30% : 0.000003s : 13: predicate.arithmetic_simplify 1.41% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.42% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 4.79% : 0.000007s : 28: predicate.inline 1.02% : 0.000002s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.82% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.03% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.38% : 0.000004s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predi predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.74% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.92% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002258 22 65.36% : 0.001476s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.82% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.82% : 0.000741s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134455 72 0.04% : 0.000053s : 1: add_recomputation 0.04% : 0.000059s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.23% : 0.000315s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000157s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.05% : 0.008131s : 1: jit_opt_a 0.12% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.33% : 0.000437s : 1: loop_unroll 0.54% : 0.000723s : 1: mutable_eliminate 0.72% : 0.000964s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000519s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000479s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.71% : 0.002293s : 1: renormalize.infer 0.63% : 0.000849s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000092s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.28% : 0.118701s : 1: type_inference cate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.73% : 0.000010s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.70% : 0.000003s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.92% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000003s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002413 25 63.63% : 0.001536s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.94% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.43% : 0.000807s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.147248 72 0.04% : 0.000053s : 1: add_recomputation 0.04% : 0.000053s : 1: auto_monad 0.01% : 0.000021s : 1: auto_monad_reorder 0.21% : 0.000309s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000058s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 5.47% : 0.008055s : 1: jit_opt_a 0.10% : 0.000154s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.30% : 0.000445s : 1: loop_unroll 0.49% : 0.000727s : 1: mutable_eliminate 0.74% : 0.001085s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000106s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000520s : 1: opt_after_jit_grad 0.00% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000484s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.50% : 0.002212s : 1: renormalize.infer 0.55% : 0.000815s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.06% : 0.000095s : 1: rewriter_before_opt_a 0.10% : 0.000152s : 1: symbol_engine_optimizer 89.31% : 0.131513s : 1: type_inference TotalTime = 0.0180375, [30] [bootstrap]: 0.00035883 [type_inference]: 0.00877989 [event_method]: 2.014e-05 [auto_monad]: 7.256e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 5.159e-05 [rewriter_before_opt_a]: 8.331e-05 [expand_dump_flag]: 3.55998e-06 [jit_opt_a]: 0.0060871, [2] [Cycle 1]: 0.0020632, [27] [switch_simplify]: 5.718e-05 [loop_unroll]: 3.358e-05 [a_1]: 0.00071866 [with_stream_mark]: 1.831e-05 [recompute_prepare]: 8.43001e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 2.43998e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.374e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.82999e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00089824 [add_forward_monad_depend]: 5.94999e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.492e-05 [cse]: 2.999e-05 [replace_applicator]: 1.48e-05 [Cycle 2]: 0.0003391, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.14e-06 [a_1]: 0.00010114 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 5.39e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.95002e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 5.12e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.137e-05 [j_node_and_user_rematch]: 7.92003e-06 [meta_fg_expand]: 1.71998e-06 [replace_old_param]: 7.56001e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.3e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.375e-05 [rewriter_after_opt_a]: 3.707e-05 [convert_after_rewriter]: 7.72998e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00070973 [jit_opt_b]: 5.313e-05, [1] [Cycle 1]: 4.534e-05, [2] [frontend_op_eliminate]: 1.757e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 3.016e-05 [loop_unroll]: 0.00048247 [jit_opt_after_cconv]: 0.00016151, [1] [Cycle 1]: 0.00015405, [11] [c_1]: 2.112e-05 [parameter_eliminate]: 4.34997e-06 [updatestate_depend_eliminate]: 5.75001e-06 [updatestate_assign_eliminate]: 3.00002e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 2.924e-05 [call_graph_tuple_transform]: 2.219e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 5.118e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.813e-05, [1] [cse]: 1.182e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 7.25998e-06 [opt_after_jit_grad]: 0.00063723 [symbol_engine_optimizer]: 7.682e-05, [1] [Cycle 1]: 7.007e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.455e-05 [opt_reshape]: 5.61998e-06 [fold_const_symbol]: 9.05001e-06 [renormalize]: 6.20028e-07 [validate]: 4.431e-05 Sums bootstrap : 0.000359s : 2.61% type_inference : 0.008780s : 63.87% event_method : 0.000020s : 0.15% auto_monad : 0.000073s : 0.53% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000052s : 0.38% rewriter_before_opt_a : 0.000083s : 0.61% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.46% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000820s : 5.96% jit_opt_a.with_stream_mark : 0.000030s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000898s : 6.53% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.15% jit_opt_a.cse : 0.000043s : 0.31% jit_opt_a.replace_applicator : 0.000020s : 0.14% py_interpret_to_execute_after_opt_a : 0.000014s : 0.10% rewriter_after_opt_a : 0.000037s : 0.27% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000710s : 5.16% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000030s : 0.22% loop_unroll : 0.000482s : 3.51% jit_opt_after_cconv.c_1 : 0.000021s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000051s : 0.37% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000637s : 4.64% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.32% Time group info: ------[substitution.] 0.000330 27 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000002s : 2: substitution.fold_const_symbol 1.78% : 0.000006s : 3: substitution.graph_param_transform 86.88% : 0.000287s : 5: substitution.inline 1.05% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.29% : 0.000011s : 3: substitution.reduce_eliminate 1.27% : 0.000004s : 4: substitution.remove_not_recompute_node 1.31% : 0.000004s : 2: substitution.replace_old_param 3.35% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008701 2 87.16% : 0.007584s : 1: type_inference.infer 12.84% : 0.001117s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.61% : 0.000064s : 5: replace.inline 31.39% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000294 7 96.63% : 0.000284s : 5: match.inline 3.37% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 1.38% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.60% : 0.000002s : 11: predicate.addn_zero_filter 1.84% : 0.000002s : 11: predicate.arithmetic_simplify 1.17% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 11: predicate.compare_switch_simplify 1.42% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.17% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.25% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.28% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.92% : 0.000002s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 16: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 2.06% : 0.000003s : 11: predicate.reduce_eliminate 1.36% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 11: predicate.reshape_eliminate 1.48% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.24% : 0.000002s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.03% : 0.000010s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000001s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.64% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000891 16 48.42% : 0.000431s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.55% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.03% : 0.000374s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020037 72 0.27% : 0.000054s : 1: add_recomputation 0.38% : 0.000076s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.88% : 0.000378s : 1: bootstrap 0.16% : 0.000033s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.40% : 0.006091s : 1: jit_opt_a 0.82% : 0.000164s : 1: jit_opt_after_cconv 0.28% : 0.000056s : 1: jit_opt_b 2.46% : 0.000492s : 1: loop_unroll 3.60% : 0.000721s : 1: mutable_eliminate 5.20% : 0.001042s : 26: opt.transform.jit_opt_a 0.25% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000028s : 4: opt.transform.jit_opt_b 0.07% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.24% : 0.000649s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000055s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000019s : 1: remove_dup_value 2.57% : 0.000516s : 1: renormalize.infer 1.87% : 0.000374s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000040s : 1: rewriter_after_opt_a 0.43% : 0.000086s : 1: rewriter_before_opt_a 0.40% : 0.000079s : 1: symbol_engine_optimizer 43.90% : 0.008796s : 1: type_inference TotalTime = 0.0164037, [30] [bootstrap]: 0.00032939 [type_inference]: 0.00836728 [event_method]: 2.024e-05 [auto_monad]: 6.042e-05 [graph_reusing]: 5.21002e-06 [pre_auto_parallel]: 1.95001e-06 [py_interpret_to_execute]: 4.26e-05 [rewriter_before_opt_a]: 7.909e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00534726, [2] [Cycle 1]: 0.00182178, [27] [switch_simplify]: 5.29e-05 [loop_unroll]: 3.279e-05 [a_1]: 0.00060811 [with_stream_mark]: 1.458e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 3.11999e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.192e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00079845 [add_forward_monad_depend]: 5.25999e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.319e-05 [cse]: 2.594e-05 [replace_applicator]: 1.237e-05 [Cycle 2]: 0.00032825, [27] [switch_simplify]: 5.72001e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.745e-05 [with_stream_mark]: 9.72999e-06 [recompute_prepare]: 5.20999e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.53003e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 4.64998e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 2.00002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.072e-05 [j_node_and_user_rematch]: 7.83001e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.04001e-06 [inline_without_move]: 4.87998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.338e-05 [replace_applicator]: 5.56e-06 [py_interpret_to_execute_after_opt_a]: 1.163e-05 [rewriter_after_opt_a]: 3.434e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00057383 [jit_opt_b]: 4.805e-05, [1] [Cycle 1]: 4.179e-05, [2] [frontend_op_eliminate]: 1.592e-05 [inline_after_opt_a]: 1.529e-05 [cconv]: 2.422e-05 [loop_unroll]: 0.00041971 [jit_opt_after_cconv]: 0.00015759, [1] [Cycle 1]: 0.000151, [11] [c_1]: 2.098e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.525e-05 [call_graph_tuple_transform]: 2.745e-05 [tuple_list_get_item_eliminator]: 5.41998e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.03002e-06 [remove_dup_value]: 1.52e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 5.69999e-06 [add_recomputation]: 4.579e-05 [cse_after_recomputation]: 2.449e-05, [1] [Cycle 1]: 1.88e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.16998e-06 [rewriter_after_jit_bprop_graph]: 4.39998e-06 [opt_after_jit_grad]: 0.00047231 [symbol_engine_optimizer]: 7.411e-05, [1] [Cycle 1]: 6.79e-05, [6] [build]: 3.12002e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.357e-05 [opt_reshape]: 6.23002e-06 [fold_const_symbol]: 8.67e-06 [renormalize]: 4.19997e-07 [validate]: 3.635e-05 Sums bootstrap : 0.000329s : 2.61% type_inference : 0.008367s : 66.22% event_method : 0.000020s : 0.16% auto_monad : 0.000060s : 0.48% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.34% rewriter_before_opt_a : 0.000079s : 0.63% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.46% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000706s : 5.58% jit_opt_a.with_stream_mark : 0.000024s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000799s : 6.32% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.15% jit_opt_a.cse : 0.000039s : 0.31% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000034s : 0.27% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000574s : 4.54% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.12% cconv : 0.000024s : 0.19% loop_unroll : 0.000420s : 3.32% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000046s : 0.36% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000016s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000472s : 3.74% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.29% Time group info: ------[substitution.] 0.000225 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000005s : 3: substitution.graph_param_transform 83.50% : 0.000188s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.50% : 0.000010s : 3: substitution.reduce_eliminate 1.74% : 0.000004s : 4: substitution.remove_not_recompute_node 1.25% : 0.000003s : 2: substitution.replace_old_param 4.16% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008301 2 88.13% : 0.007316s : 1: type_inference.infer 11.87% : 0.000985s : 1: type_inference.specialize ------[replace.] 0.000089 7 67.48% : 0.000060s : 5: replace.inline 32.52% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 7 95.73% : 0.000185s : 5: match.inline 4.27% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.23% : 0.000002s : 11: predicate.accumulaten_eliminater 1.22% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.88% : 0.000002s : 11: predicate.arithmetic_simplify 1.60% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.26% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 24: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.42% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000000s : 3: predicate.opt_reshape 2.17% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.25% : 0.000003s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 11: predicate.reshape_eliminate 1.21% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.09% : 0.000001s : 3: predicate.row_tensor_eliminate 1.40% : 0.000002s : 11: predicate.same_eliminate 0.47% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.60% : 0.000009s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.47% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.78% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.96% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000804 16 50.42% : 0.000405s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.70% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.88% : 0.000337s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018187 72 0.27% : 0.000049s : 1: add_recomputation 0.35% : 0.000064s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.90% : 0.000345s : 1: bootstrap 0.15% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 29.42% : 0.005351s : 1: jit_opt_a 0.88% : 0.000161s : 1: jit_opt_after_cconv 0.28% : 0.000050s : 1: jit_opt_b 2.35% : 0.000427s : 1: loop_unroll 3.21% : 0.000583s : 1: mutable_eliminate 5.04% : 0.000916s : 26: opt.transform.jit_opt_a 0.31% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.64% : 0.000481s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000045s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.49% : 0.000452s : 1: renormalize.infer 1.86% : 0.000339s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000038s : 1: rewriter_after_opt_a 0.45% : 0.000082s : 1: rewriter_before_opt_a 0.42% : 0.000077s : 1: symbol_engine_optimizer 46.08% : 0.008380s : 1: type_inference TotalTime = 0.118573, [30] [bootstrap]: 0.00029285 [type_inference]: 0.107775 [event_method]: 1.897e-05 [auto_monad]: 7.156e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 0.00048973 [rewriter_before_opt_a]: 8.811e-05 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.00747876, [2] [Cycle 1]: 0.00368206, [27] [switch_simplify]: 5.147e-05 [loop_unroll]: 2.996e-05 [a_1]: 0.0005718 [with_stream_mark]: 1.465e-05 [recompute_prepare]: 9.01002e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 2.27999e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.376e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 6.95998e-06 [renormalize]: 0.00266663 [add_forward_monad_depend]: 7.71001e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.787e-05 [cse]: 2.866e-05 [replace_applicator]: 2.034e-05 [Cycle 2]: 0.00039859, [27] [switch_simplify]: 7.24001e-06 [loop_unroll]: 5.49998e-06 [a_1]: 0.00012755 [with_stream_mark]: 1.274e-05 [recompute_prepare]: 6.05002e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.66999e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.73002e-06 [meta_shard_fg_expand]: 1.73002e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 2.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.722e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 1.9e-05 [cse]: 1.249e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.232e-05 [rewriter_after_opt_a]: 3.548e-05 [convert_after_rewriter]: 6.06e-06 [order_py_execute_after_rewriter]: 5.61998e-06 [mutable_eliminate]: 0.00068555 [jit_opt_b]: 5.661e-05, [1] [Cycle 1]: 4.941e-05, [2] [frontend_op_eliminate]: 1.961e-05 [inline_after_opt_a]: 1.879e-05 [cconv]: 2.596e-05 [loop_unroll]: 0.0004208 [jit_opt_after_cconv]: 0.00015124, [1] [Cycle 1]: 0.00014456, [11] [c_1]: 2.484e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.06998e-06 [cse]: 2.042e-05 [call_graph_tuple_transform]: 2.25e-05 [tuple_list_get_item_eliminator]: 5.72001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.30011e-07 [switch_simplify]: 7.1e-06 [remove_dup_value]: 1.4e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 7.95998e-06 [add_recomputation]: 4.618e-05 [cse_after_recomputation]: 2.249e-05, [1] [Cycle 1]: 1.698e-05, [1] [cse]: 1.086e-05 [auto_monad_reorder]: 1.513e-05 [get_jit_bprop_graph]: 1.79998e-06 [rewriter_after_jit_bprop_graph]: 6.39999e-06 [opt_after_jit_grad]: 0.00053882 [symbol_engine_optimizer]: 7.67e-05, [1] [Cycle 1]: 7.05e-05, [6] [build]: 3.66001e-06 [elim_shapecalc]: 8.51002e-06 [elim_not_effective]: 1.382e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 1.015e-05 [renormalize]: 6.10016e-07 [validate]: 3.896e-05 Sums bootstrap : 0.000293s : 0.26% type_inference : 0.107775s : 94.05% event_method : 0.000019s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000490s : 0.43% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000699s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002667s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000037s : 0.03% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000686s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000421s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000539s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000212 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 4: substitution.graph_param_transform 83.31% : 0.000177s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 5.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107692 2 97.23% : 0.104713s : 1: type_inference.infer 2.77% : 0.002979s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.42% : 0.000051s : 4: replace.inline 31.58% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 94.03% : 0.000174s : 4: match.inline 5.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.29% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.85% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000010s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002176 22 67.51% : 0.001469s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.81% : 0.000670s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122255 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000306s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.12% : 0.007482s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.35% : 0.000429s : 1: loop_unroll 0.57% : 0.000695s : 1: mutable_eliminate 0.77% : 0.000937s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000548s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000496s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.58% : 0.001932s : 1: renormalize.infer 0.59% : 0.000725s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.17% : 0.107791s : 1: type_inference TotalTime = 0.0174067, [30] [bootstrap]: 0.00033678 [type_inference]: 0.00857138 [event_method]: 2.218e-05 [auto_monad]: 7.316e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.89001e-06 [py_interpret_to_execute]: 5.335e-05 [rewriter_before_opt_a]: 8.244e-05 [expand_dump_flag]: 3.77998e-06 [jit_opt_a]: 0.00593705, [2] [Cycle 1]: 0.00202458, [27] [switch_simplify]: 0.00010954 [loop_unroll]: 3.424e-05 [a_1]: 0.00066401 [with_stream_mark]: 1.966e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.21001e-06 [updatestate_assign_eliminate]: 3.30998e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.61003e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.67002e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.29998e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00084951 [add_forward_monad_depend]: 6.22001e-06 [auto_monad_grad]: 2.19999e-06 [auto_monad_eliminator]: 1.58e-05 [cse]: 2.738e-05 [replace_applicator]: 1.46e-05 [Cycle 2]: 0.00033807, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.82998e-06 [a_1]: 0.0001 [with_stream_mark]: 1.109e-05 [recompute_prepare]: 5.74999e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.77002e-06 [parameter_eliminate]: 1.23002e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.26002e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.101e-05 [j_node_and_user_rematch]: 8.04002e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.93999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 1.41002e-06 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.364e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 1.287e-05 [rewriter_after_opt_a]: 3.635e-05 [convert_after_rewriter]: 6.65998e-06 [order_py_execute_after_rewriter]: 4.67998e-06 [mutable_eliminate]: 0.00058394 [jit_opt_b]: 5.113e-05, [1] [Cycle 1]: 4.365e-05, [2] [frontend_op_eliminate]: 1.583e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 2.398e-05 [loop_unroll]: 0.00043592 [jit_opt_after_cconv]: 0.00016246, [1] [Cycle 1]: 0.00015524, [11] [c_1]: 2.059e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.56e-05 [call_graph_tuple_transform]: 2.019e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.51999e-06 [add_recomputation]: 5.04e-05 [cse_after_recomputation]: 2.471e-05, [1] [Cycle 1]: 1.934e-05, [1] [cse]: 1.367e-05 [auto_monad_reorder]: 1.909e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 7.05e-06 [opt_after_jit_grad]: 0.00057227 [symbol_engine_optimizer]: 7.88e-05, [1] [Cycle 1]: 7.153e-05, [6] [build]: 3.73999e-06 [elim_shapecalc]: 8.92999e-06 [elim_not_effective]: 1.379e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.62999e-06 [renormalize]: 5.3001e-07 [validate]: 3.95e-05 Sums bootstrap : 0.000337s : 2.55% type_inference : 0.008571s : 64.87% event_method : 0.000022s : 0.17% auto_monad : 0.000073s : 0.55% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.40% rewriter_before_opt_a : 0.000082s : 0.62% expand_dump_flag : 0.000004s : 0.03% jit_opt_a.switch_simplify : 0.000116s : 0.87% jit_opt_a.loop_unroll : 0.000039s : 0.30% jit_opt_a.a_1 : 0.000764s : 5.78% jit_opt_a.with_stream_mark : 0.000031s : 0.23% jit_opt_a.recompute_prepare : 0.000015s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000850s : 6.43% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000041s : 0.31% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000036s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000584s : 4.42% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000024s : 0.18% loop_unroll : 0.000436s : 3.30% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000050s : 0.38% cse_after_recomputation.cse : 0.000014s : 0.10% auto_monad_reorder : 0.000019s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000572s : 4.33% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.30% Time group info: ------[substitution.] 0.000262 27 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.26% : 0.000006s : 3: substitution.graph_param_transform 82.53% : 0.000216s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.86% : 0.000013s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 4.08% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008498 2 86.86% : 0.007381s : 1: type_inference.infer 13.14% : 0.001117s : 1: type_inference.specialize ------[replace.] 0.000097 7 66.16% : 0.000064s : 5: replace.inline 33.84% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000223 7 95.68% : 0.000213s : 5: match.inline 4.32% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 747 1.25% : 0.000002s : 11: predicate.accumulaten_eliminater 1.24% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 2.07% : 0.000003s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.35% : 0.000000s : 3: predicate.check_bprop_eliminate 1.20% : 0.000002s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.49% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 6: predicate.less_batch_normalization 1.85% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.36% : 0.000002s : 11: predicate.print_const_string_wrapper 1.93% : 0.000002s : 11: predicate.reduce_eliminate 1.67% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.64% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.49% : 0.000002s : 11: predicate.reshape_eliminate 1.19% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.99% : 0.000010s : 59: predicate.switch_simplify 1.49% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000806 16 48.64% : 0.000392s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.81% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.55% : 0.000351s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019356 72 0.28% : 0.000054s : 1: add_recomputation 0.40% : 0.000077s : 1: auto_monad 0.11% : 0.000022s : 1: auto_monad_reorder 1.81% : 0.000350s : 1: bootstrap 0.14% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.69% : 0.005940s : 1: jit_opt_a 0.85% : 0.000165s : 1: jit_opt_after_cconv 0.28% : 0.000054s : 1: jit_opt_b 2.30% : 0.000444s : 1: loop_unroll 3.07% : 0.000593s : 1: mutable_eliminate 5.37% : 0.001039s : 26: opt.transform.jit_opt_a 0.25% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.07% : 0.000593s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000056s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000018s : 1: remove_dup_value 2.55% : 0.000494s : 1: renormalize.infer 1.79% : 0.000346s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000039s : 1: rewriter_after_opt_a 0.44% : 0.000085s : 1: rewriter_before_opt_a 0.42% : 0.000082s : 1: symbol_engine_optimizer 44.36% : 0.008586s : 1: type_inference TotalTime = 0.0175303, [30] [bootstrap]: 0.00029374 [type_inference]: 0.0088038 [event_method]: 2.192e-05 [auto_monad]: 6.903e-05 [graph_reusing]: 6.68e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 4.63e-05 [rewriter_before_opt_a]: 8.3e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00583939, [2] [Cycle 1]: 0.00199121, [27] [switch_simplify]: 5.888e-05 [loop_unroll]: 3.563e-05 [a_1]: 0.0006644 [with_stream_mark]: 1.873e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00082642 [add_forward_monad_depend]: 6.19999e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 3.329e-05 [replace_applicator]: 1.5e-05 [Cycle 2]: 0.00034472, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 5.17e-06 [a_1]: 0.00010217 [with_stream_mark]: 1.163e-05 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 5.32001e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.76003e-06 [get_grad_eliminate_]: 4.77e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.222e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 4.79002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.90023e-07 [auto_monad_eliminator]: 6.84001e-06 [cse]: 1.498e-05 [replace_applicator]: 5.24998e-06 [py_interpret_to_execute_after_opt_a]: 9.74999e-06 [rewriter_after_opt_a]: 3.533e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.00070512 [jit_opt_b]: 4.967e-05, [1] [Cycle 1]: 4.321e-05, [2] [frontend_op_eliminate]: 1.591e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.856e-05 [loop_unroll]: 0.00044296 [jit_opt_after_cconv]: 0.00016745, [1] [Cycle 1]: 0.00016071, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 3.58e-06 [updatestate_depend_eliminate]: 6.76999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.38002e-06 [cse]: 2.873e-05 [call_graph_tuple_transform]: 1.962e-05 [tuple_list_get_item_eliminator]: 5.62999e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.81003e-06 [remove_dup_value]: 1.746e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 5.96e-06 [add_recomputation]: 5.144e-05 [cse_after_recomputation]: 2.544e-05, [1] [Cycle 1]: 1.954e-05, [1] [cse]: 1.292e-05 [auto_monad_reorder]: 1.797e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 6.02001e-06 [opt_after_jit_grad]: 0.00049748 [symbol_engine_optimizer]: 7.49e-05, [1] [Cycle 1]: 6.844e-05, [6] [build]: 3.59002e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 5.3001e-07 [validate]: 4.376e-05 Sums bootstrap : 0.000294s : 2.19% type_inference : 0.008804s : 65.74% event_method : 0.000022s : 0.16% auto_monad : 0.000069s : 0.52% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.35% rewriter_before_opt_a : 0.000083s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.48% jit_opt_a.loop_unroll : 0.000041s : 0.30% jit_opt_a.a_1 : 0.000767s : 5.72% jit_opt_a.with_stream_mark : 0.000030s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000827s : 6.17% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000048s : 0.36% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000010s : 0.07% rewriter_after_opt_a : 0.000035s : 0.26% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000705s : 5.27% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000029s : 0.21% loop_unroll : 0.000443s : 3.31% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000029s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.04% add_recomputation : 0.000051s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000497s : 3.72% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.33% Time group info: ------[substitution.] 0.000267 27 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000002s : 2: substitution.fold_const_symbol 2.18% : 0.000006s : 3: substitution.graph_param_transform 82.50% : 0.000220s : 5: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.76% : 0.000013s : 3: substitution.reduce_eliminate 1.78% : 0.000005s : 4: substitution.remove_not_recompute_node 1.75% : 0.000005s : 2: substitution.replace_old_param 4.13% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008733 2 87.09% : 0.007606s : 1: type_inference.infer 12.91% : 0.001127s : 1: type_inference.specialize ------[replace.] 0.000100 7 67.76% : 0.000068s : 5: replace.inline 32.24% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 95.60% : 0.000217s : 5: match.inline 4.40% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 747 1.42% : 0.000002s : 11: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.38% : 0.000003s : 11: predicate.arithmetic_simplify 1.61% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000001s : 11: predicate.depend_value_elim 1.09% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_depend_swap 1.10% : 0.000001s : 11: predicate.environ_get_eliminate 1.04% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000007s : 24: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.59% : 0.000002s : 6: predicate.less_batch_normalization 1.84% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 16: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.27% : 0.000002s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 1.51% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 16: predicate.partial_eliminate 1.68% : 0.000002s : 11: predicate.print_const_string_wrapper 2.08% : 0.000003s : 11: predicate.reduce_eliminate 1.54% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000003s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.72% : 0.000002s : 11: predicate.reshape_eliminate 1.58% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000002s : 11: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.33% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.00% : 0.000009s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.31% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 2.22% : 0.000003s : 11: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000838 16 49.33% : 0.000414s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.72% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.95% : 0.000360s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019403 72 0.28% : 0.000054s : 1: add_recomputation 0.37% : 0.000072s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.58% : 0.000307s : 1: bootstrap 0.16% : 0.000031s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.12% : 0.005844s : 1: jit_opt_a 0.88% : 0.000170s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.32% : 0.000451s : 1: loop_unroll 3.68% : 0.000714s : 1: mutable_eliminate 5.12% : 0.000992s : 26: opt.transform.jit_opt_a 0.25% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000013s : 1: opt.transform.mutable_eliminate 0.11% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.61% : 0.000506s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000049s : 1: py_interpret_to_execute 0.06% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 2.55% : 0.000494s : 1: renormalize.infer 1.67% : 0.000324s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000038s : 1: rewriter_after_opt_a 0.44% : 0.000086s : 1: rewriter_before_opt_a 0.40% : 0.000078s : 1: symbol_engine_optimizer 45.45% : 0.008819s : 1: type_inference TotalTime = 0.019393, [30] [bootstrap]: 0.00035485 [type_inference]: 0.00962087 [event_method]: 2.071e-05 [auto_monad]: 6.927e-05 [graph_reusing]: 7.12002e-06 [pre_auto_parallel]: 2.76e-06 [py_interpret_to_execute]: 5.294e-05 [rewriter_before_opt_a]: 8.432e-05 [expand_dump_flag]: 2.63998e-06 [jit_opt_a]: 0.00664276, [2] [Cycle 1]: 0.00217305, [27] [switch_simplify]: 6.848e-05 [loop_unroll]: 3.367e-05 [a_1]: 0.00073118 [with_stream_mark]: 2.248e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 4.32e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.26e-06 [specialize_transform]: 6.68998e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 1.029e-05 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00095688 [add_forward_monad_depend]: 7.22002e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.54e-05 [cse]: 3.67e-05 [replace_applicator]: 1.35e-05 [Cycle 2]: 0.00034782, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.27001e-06 [a_1]: 0.00010151 [with_stream_mark]: 1.116e-05 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 5.26998e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.69998e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 2.59999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 7.83999e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 7.53999e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.65001e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 7.68999e-06 [cse]: 1.468e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.538e-05 [rewriter_after_opt_a]: 4.351e-05 [convert_after_rewriter]: 7.15003e-06 [order_py_execute_after_rewriter]: 5.91e-06 [mutable_eliminate]: 0.00078483 [jit_opt_b]: 5.274e-05, [1] [Cycle 1]: 4.426e-05, [2] [frontend_op_eliminate]: 1.685e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 3.205e-05 [loop_unroll]: 0.00046004 [jit_opt_after_cconv]: 0.0001856, [1] [Cycle 1]: 0.00016336, [11] [c_1]: 2.218e-05 [parameter_eliminate]: 4.22e-06 [updatestate_depend_eliminate]: 7.63001e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 3.58e-05 [call_graph_tuple_transform]: 2.338e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.538e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.71e-06 [add_recomputation]: 5.335e-05 [cse_after_recomputation]: 2.463e-05, [1] [Cycle 1]: 1.885e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.766e-05 [get_jit_bprop_graph]: 2.18002e-06 [rewriter_after_jit_bprop_graph]: 7.36999e-06 [opt_after_jit_grad]: 0.00052207 [symbol_engine_optimizer]: 7.519e-05, [1] [Cycle 1]: 6.879e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 7.68001e-06 [elim_not_effective]: 1.439e-05 [opt_reshape]: 6.01998e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 6.00005e-07 [validate]: 3.351e-05 Sums bootstrap : 0.000355s : 2.42% type_inference : 0.009621s : 65.73% event_method : 0.000021s : 0.14% auto_monad : 0.000069s : 0.47% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000053s : 0.36% rewriter_before_opt_a : 0.000084s : 0.58% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000075s : 0.51% jit_opt_a.loop_unroll : 0.000039s : 0.27% jit_opt_a.a_1 : 0.000833s : 5.69% jit_opt_a.with_stream_mark : 0.000034s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000011s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.18% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.12% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000957s : 6.54% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.16% jit_opt_a.cse : 0.000051s : 0.35% jit_opt_a.replace_applicator : 0.000019s : 0.13% py_interpret_to_execute_after_opt_a : 0.000015s : 0.11% rewriter_after_opt_a : 0.000044s : 0.30% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000785s : 5.36% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000032s : 0.22% loop_unroll : 0.000460s : 3.14% jit_opt_after_cconv.c_1 : 0.000022s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000036s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000015s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000053s : 0.36% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000007s : 0.05% opt_after_jit_grad : 0.000522s : 3.57% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000034s : 0.23% Time group info: ------[substitution.] 0.000292 27 0.53% : 0.000002s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000006s : 3: substitution.graph_param_transform 84.41% : 0.000247s : 5: substitution.inline 1.10% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.23% : 0.000012s : 3: substitution.reduce_eliminate 1.44% : 0.000004s : 4: substitution.remove_not_recompute_node 1.61% : 0.000005s : 2: substitution.replace_old_param 4.12% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009546 2 88.87% : 0.008484s : 1: type_inference.infer 11.13% : 0.001062s : 1: type_inference.specialize ------[replace.] 0.000135 7 47.54% : 0.000064s : 5: replace.inline 52.46% : 0.000071s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000255 7 95.73% : 0.000244s : 5: match.inline 4.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 747 1.18% : 0.000002s : 11: predicate.accumulaten_eliminater 0.83% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 11: predicate.addn_check_dump 1.41% : 0.000002s : 11: predicate.addn_zero_filter 2.35% : 0.000003s : 11: predicate.arithmetic_simplify 1.33% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.27% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_depend_swap 1.15% : 0.000002s : 11: predicate.environ_get_eliminate 1.05% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000007s : 24: predicate.inline 0.80% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.99% : 0.000001s : 6: predicate.less_batch_normalization 1.92% : 0.000003s : 13: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 16: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 2.09% : 0.000003s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 16: predicate.partial_eliminate 1.48% : 0.000002s : 11: predicate.print_const_string_wrapper 1.89% : 0.000002s : 11: predicate.reduce_eliminate 1.53% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 11: predicate.reshape_eliminate 1.43% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.09% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.26% : 0.000004s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 59: predicate.switch_simplify 1.21% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000002s : 11: predicate.transpose_eliminate 1.34% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.56% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 11: predicate.value_based_eliminate 0.27% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000972 16 54.67% : 0.000531s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.79% : 0.000085s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.54% : 0.000355s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.021489 72 0.26% : 0.000057s : 1: add_recomputation 0.34% : 0.000073s : 1: auto_monad 0.09% : 0.000020s : 1: auto_monad_reorder 1.74% : 0.000373s : 1: bootstrap 0.16% : 0.000035s : 1: cconv 0.04% : 0.000009s : 1: convert_after_rewriter 0.12% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000009s : 1: environ_conv 0.12% : 0.000025s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000010s : 1: graph_reusing 30.93% : 0.006646s : 1: jit_opt_a 0.88% : 0.000189s : 1: jit_opt_after_cconv 0.26% : 0.000056s : 1: jit_opt_b 2.18% : 0.000469s : 1: loop_unroll 3.71% : 0.000798s : 1: mutable_eliminate 4.95% : 0.001065s : 26: opt.transform.jit_opt_a 0.25% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.12% : 0.000027s : 4: opt.transform.jit_opt_b 0.06% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000019s : 1: opt.transform.mutable_eliminate 0.11% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.47% : 0.000531s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000056s : 1: py_interpret_to_execute 0.08% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000018s : 1: remove_dup_value 2.70% : 0.000580s : 1: renormalize.infer 1.71% : 0.000367s : 1: renormalize.specialize 0.04% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000047s : 1: rewriter_after_opt_a 0.41% : 0.000088s : 1: rewriter_before_opt_a 0.36% : 0.000078s : 1: symbol_engine_optimizer 44.87% : 0.009641s : 1: type_inference TotalTime = 0.014194, [30] [bootstrap]: 0.00045191 [type_inference]: 0.0052678 [event_method]: 1.982e-05 [auto_monad]: 6.502e-05 [graph_reusing]: 5.67001e-06 [pre_auto_parallel]: 2.85002e-06 [py_interpret_to_execute]: 3.953e-05 [rewriter_before_opt_a]: 7.431e-05 [expand_dump_flag]: 2.93e-06 [jit_opt_a]: 0.00597839, [2] [Cycle 1]: 0.00190973, [27] [switch_simplify]: 5.738e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.0005812 [with_stream_mark]: 1.738e-05 [recompute_prepare]: 6.82002e-06 [updatestate_depend_eliminate]: 3.40003e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 1.004e-05 [meta_fg_expand]: 2.06003e-06 [replace_old_param]: 8.87999e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00089831 [add_forward_monad_depend]: 6.00002e-06 [auto_monad_grad]: 2.67001e-06 [auto_monad_eliminator]: 1.676e-05 [cse]: 2.646e-05 [replace_applicator]: 1.459e-05 [Cycle 2]: 0.00033885, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.225e-05 [with_stream_mark]: 1.301e-05 [recompute_prepare]: 5.69999e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 4.91002e-06 [updatestate_useless_node_eliminater]: 4.77e-06 [accelerated_algorithm]: 4.70999e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 2.00002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 8.45001e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.19e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.82001e-06 [auto_monad_grad]: 1.34e-06 [auto_monad_eliminator]: 7.37997e-06 [cse]: 1.277e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.323e-05 [rewriter_after_opt_a]: 3.94e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00068484 [jit_opt_b]: 6.251e-05, [1] [Cycle 1]: 5.558e-05, [2] [frontend_op_eliminate]: 2.692e-05 [inline_after_opt_a]: 1.58e-05 [cconv]: 2.975e-05 [loop_unroll]: 0.00042757 [jit_opt_after_cconv]: 0.00015039, [1] [Cycle 1]: 0.00014356, [11] [c_1]: 2.129e-05 [parameter_eliminate]: 3.95e-06 [updatestate_depend_eliminate]: 6.91001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.376e-05 [call_graph_tuple_transform]: 1.922e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.66003e-06 [remove_dup_value]: 1.417e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 6.29001e-06 [add_recomputation]: 4.757e-05 [cse_after_recomputation]: 2.18e-05, [1] [Cycle 1]: 1.638e-05, [1] [cse]: 1.077e-05 [auto_monad_reorder]: 1.499e-05 [get_jit_bprop_graph]: 2.34999e-06 [rewriter_after_jit_bprop_graph]: 6.31e-06 [opt_after_jit_grad]: 0.00046255 [symbol_engine_optimizer]: 7.673e-05, [1] [Cycle 1]: 7.04e-05, [6] [build]: 4.70001e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 5.86998e-06 [fold_const_symbol]: 9.01998e-06 [renormalize]: 2.79979e-07 [validate]: 4.129e-05 Sums bootstrap : 0.000452s : 4.57% type_inference : 0.005268s : 53.29% event_method : 0.000020s : 0.20% auto_monad : 0.000065s : 0.66% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000040s : 0.40% rewriter_before_opt_a : 0.000074s : 0.75% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.64% jit_opt_a.loop_unroll : 0.000036s : 0.36% jit_opt_a.a_1 : 0.000673s : 6.81% jit_opt_a.with_stream_mark : 0.000030s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000898s : 9.09% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.24% jit_opt_a.cse : 0.000039s : 0.40% jit_opt_a.replace_applicator : 0.000020s : 0.20% py_interpret_to_execute_after_opt_a : 0.000013s : 0.13% rewriter_after_opt_a : 0.000039s : 0.40% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000685s : 6.93% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.27% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000030s : 0.30% loop_unroll : 0.000428s : 4.33% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000014s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000048s : 0.48% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000015s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000463s : 4.68% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.42% Time group info: ------[substitution.] 0.000247 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.21% : 0.000005s : 3: substitution.graph_param_transform 85.56% : 0.000212s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005194 2 82.35% : 0.004277s : 1: type_inference.infer 17.65% : 0.000917s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.05% : 0.000051s : 4: replace.inline 31.95% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.83% : 0.000209s : 4: match.inline 5.17% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.30% : 0.000003s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.58% : 0.000001s : 3: predicate.check_bprop_eliminate 1.22% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.30% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.33% : 0.000002s : 10: predicate.minmaximum_grad 2.08% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.67% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.95% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.49% : 0.000001s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.16% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000736 13 50.72% : 0.000374s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.92% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.36% : 0.000312s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016053 72 0.32% : 0.000051s : 1: add_recomputation 0.43% : 0.000069s : 1: auto_monad 0.11% : 0.000017s : 1: auto_monad_reorder 2.91% : 0.000468s : 1: bootstrap 0.20% : 0.000032s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.26% : 0.005982s : 1: jit_opt_a 0.96% : 0.000154s : 1: jit_opt_after_cconv 0.41% : 0.000065s : 1: jit_opt_b 2.71% : 0.000436s : 1: loop_unroll 4.32% : 0.000694s : 1: mutable_eliminate 5.57% : 0.000895s : 26: opt.transform.jit_opt_a 0.30% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.22% : 0.000036s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.94% : 0.000472s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000042s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000016s : 1: remove_dup_value 3.23% : 0.000519s : 1: renormalize.infer 2.31% : 0.000370s : 1: renormalize.specialize 0.05% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000043s : 1: rewriter_after_opt_a 0.48% : 0.000077s : 1: rewriter_before_opt_a 0.49% : 0.000079s : 1: symbol_engine_optimizer 32.91% : 0.005283s : 1: type_inference TotalTime = 0.0202939, [30] [bootstrap]: 0.00035295 [type_inference]: 0.00991725 [event_method]: 2.233e-05 [auto_monad]: 7.51e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 5.966e-05 [rewriter_before_opt_a]: 8.824e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.0068428, [2] [Cycle 1]: 0.00219362, [27] [switch_simplify]: 6.605e-05 [loop_unroll]: 3.256e-05 [a_1]: 0.00069512 [with_stream_mark]: 2.467e-05 [recompute_prepare]: 9.77001e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 2.46e-06 [specialize_transform]: 7.11001e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 7e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.45001e-06 [merge_forward]: 4.05e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.591e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 5.66998e-06 [renormalize]: 0.0009752 [add_forward_monad_depend]: 1.1e-05 [auto_monad_grad]: 3.07002e-06 [auto_monad_eliminator]: 2.055e-05 [cse]: 4.182e-05 [replace_applicator]: 2.367e-05 [Cycle 2]: 0.00038503, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.22999e-06 [a_1]: 0.00010783 [with_stream_mark]: 1.803e-05 [recompute_prepare]: 7.03e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.94999e-06 [specialize_transform]: 5.22999e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.33999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 9.99717e-08 [add_forward_monad_depend]: 2.15002e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 8.71002e-06 [cse]: 1.795e-05 [replace_applicator]: 7.61999e-06 [py_interpret_to_execute_after_opt_a]: 1.696e-05 [rewriter_after_opt_a]: 4.532e-05 [convert_after_rewriter]: 8.40999e-06 [order_py_execute_after_rewriter]: 5.82999e-06 [mutable_eliminate]: 0.00088271 [jit_opt_b]: 5.895e-05, [1] [Cycle 1]: 4.891e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.795e-05 [cconv]: 3.811e-05 [loop_unroll]: 0.00057161 [jit_opt_after_cconv]: 0.00019246, [1] [Cycle 1]: 0.00018352, [11] [c_1]: 2.36e-05 [parameter_eliminate]: 6.77002e-06 [updatestate_depend_eliminate]: 7.95e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 4.009e-05 [call_graph_tuple_transform]: 2.543e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 9.60019e-07 [switch_simplify]: 7.18e-06 [remove_dup_value]: 1.724e-05 [partial_unused_args_eliminate]: 2.067e-05 [environ_conv]: 7.48e-06 [add_recomputation]: 5.916e-05 [cse_after_recomputation]: 2.817e-05, [1] [Cycle 1]: 2.113e-05, [1] [cse]: 1.359e-05 [auto_monad_reorder]: 1.89e-05 [get_jit_bprop_graph]: 2.43998e-06 [rewriter_after_jit_bprop_graph]: 1.087e-05 [opt_after_jit_grad]: 0.00059837 [symbol_engine_optimizer]: 8.154e-05, [1] [Cycle 1]: 7.381e-05, [6] [build]: 3.87998e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.583e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 9.06002e-06 [renormalize]: 7.2e-07 [validate]: 4.915e-05 Sums bootstrap : 0.000353s : 2.30% type_inference : 0.009917s : 64.58% event_method : 0.000022s : 0.15% auto_monad : 0.000075s : 0.49% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000060s : 0.39% rewriter_before_opt_a : 0.000088s : 0.57% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.47% jit_opt_a.loop_unroll : 0.000038s : 0.25% jit_opt_a.a_1 : 0.000803s : 5.23% jit_opt_a.with_stream_mark : 0.000043s : 0.28% jit_opt_a.recompute_prepare : 0.000017s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.07% jit_opt_a.accelerated_algorithm : 0.000013s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.07% jit_opt_a.merge_forward : 0.000008s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.12% jit_opt_a.meta_fg_expand : 0.000005s : 0.03% jit_opt_a.replace_old_param : 0.000019s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.07% jit_opt_a.renormalize : 0.000975s : 6.35% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.09% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.19% jit_opt_a.cse : 0.000060s : 0.39% jit_opt_a.replace_applicator : 0.000031s : 0.20% py_interpret_to_execute_after_opt_a : 0.000017s : 0.11% rewriter_after_opt_a : 0.000045s : 0.30% convert_after_rewriter : 0.000008s : 0.05% order_py_execute_after_rewriter : 0.000006s : 0.04% mutable_eliminate : 0.000883s : 5.75% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.12% jit_opt_b.inline_after_opt_a : 0.000018s : 0.12% cconv : 0.000038s : 0.25% loop_unroll : 0.000572s : 3.72% jit_opt_after_cconv.c_1 : 0.000024s : 0.15% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000040s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.05% remove_dup_value : 0.000017s : 0.11% partial_unused_args_eliminate : 0.000021s : 0.13% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000059s : 0.39% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000019s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000011s : 0.07% opt_after_jit_grad : 0.000598s : 3.90% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.32% Time group info: ------[substitution.] 0.000300 27 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 3: substitution.graph_param_transform 82.95% : 0.000249s : 5: substitution.inline 1.39% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.90% : 0.000015s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 3.67% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.009842 2 87.23% : 0.008585s : 1: type_inference.infer 12.77% : 0.001257s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.34% : 0.000066s : 5: replace.inline 32.66% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 96.14% : 0.000246s : 5: match.inline 3.86% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 747 1.20% : 0.000002s : 11: predicate.accumulaten_eliminater 1.64% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 11: predicate.addn_check_dump 1.23% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000003s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.68% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 11: predicate.compare_switch_simplify 1.08% : 0.000001s : 11: predicate.depend_value_elim 1.01% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.61% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 11: predicate.environ_get_depend_swap 1.11% : 0.000002s : 11: predicate.environ_get_eliminate 1.00% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.82% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 6.76% : 0.000009s : 24: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.77% : 0.000002s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.61% : 0.000002s : 16: predicate.load_eliminater 1.78% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 11: predicate.merge_addn 1.00% : 0.000001s : 11: predicate.minmaximum_grad 2.14% : 0.000003s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 16: predicate.partial_eliminate 1.09% : 0.000001s : 11: predicate.print_const_string_wrapper 1.93% : 0.000003s : 11: predicate.reduce_eliminate 1.28% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 2.07% : 0.000003s : 19: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 3: predicate.row_tensor_eliminate 1.02% : 0.000001s : 11: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.29% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.68% : 0.000010s : 59: predicate.switch_simplify 1.15% : 0.000002s : 11: predicate.tile_eliminate 1.14% : 0.000002s : 11: predicate.transpose_eliminate 1.23% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.41% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.42% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000945 16 48.90% : 0.000462s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.71% : 0.000082s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.40% : 0.000401s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.022392 72 0.29% : 0.000064s : 1: add_recomputation 0.35% : 0.000078s : 1: auto_monad 0.10% : 0.000022s : 1: auto_monad_reorder 1.65% : 0.000368s : 1: bootstrap 0.18% : 0.000041s : 1: cconv 0.05% : 0.000011s : 1: convert_after_rewriter 0.14% : 0.000031s : 1: cse_after_recomputation 0.04% : 0.000010s : 1: environ_conv 0.12% : 0.000026s : 1: event_method 0.03% : 0.000007s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.58% : 0.006847s : 1: jit_opt_a 0.87% : 0.000196s : 1: jit_opt_after_cconv 0.28% : 0.000063s : 1: jit_opt_b 2.61% : 0.000584s : 1: loop_unroll 4.01% : 0.000898s : 1: mutable_eliminate 4.70% : 0.001051s : 26: opt.transform.jit_opt_a 0.26% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000029s : 4: opt.transform.jit_opt_b 0.08% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000025s : 1: opt.transform.mutable_eliminate 0.14% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000036s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000612s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.10% : 0.000023s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000062s : 1: py_interpret_to_execute 0.09% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000020s : 1: remove_dup_value 2.48% : 0.000554s : 1: renormalize.infer 1.83% : 0.000410s : 1: renormalize.specialize 0.06% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000049s : 1: rewriter_after_opt_a 0.41% : 0.000092s : 1: rewriter_before_opt_a 0.38% : 0.000084s : 1: symbol_engine_optimizer 44.36% : 0.009934s : 1: type_inference TotalTime = 0.124741, [30] [bootstrap]: 0.00039078 [type_inference]: 0.112904 [event_method]: 2.065e-05 [auto_monad]: 7.023e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.21998e-06 [py_interpret_to_execute]: 0.00042989 [rewriter_before_opt_a]: 8.788e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00841653, [2] [Cycle 1]: 0.00406925, [27] [switch_simplify]: 6.154e-05 [loop_unroll]: 3.138e-05 [a_1]: 0.00061092 [with_stream_mark]: 2.204e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.97999e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 6.29999e-06 [accelerated_algorithm]: 5.93002e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.068e-05 [inline_without_move]: 6.11998e-06 [renormalize]: 0.00294651 [add_forward_monad_depend]: 3.821e-05 [auto_monad_grad]: 2.83e-06 [auto_monad_eliminator]: 1.712e-05 [cse]: 3.137e-05 [replace_applicator]: 2.105e-05 [Cycle 2]: 0.00038505, [27] [switch_simplify]: 7.53e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.00012625 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 2.17001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.871e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 5.56e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 6.90998e-06 [cse]: 1.238e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.182e-05 [rewriter_after_opt_a]: 3.564e-05 [convert_after_rewriter]: 7.35003e-06 [order_py_execute_after_rewriter]: 4.79998e-06 [mutable_eliminate]: 0.00068914 [jit_opt_b]: 5.663e-05, [1] [Cycle 1]: 4.913e-05, [2] [frontend_op_eliminate]: 2.05e-05 [inline_after_opt_a]: 1.704e-05 [cconv]: 2.474e-05 [loop_unroll]: 0.00044271 [jit_opt_after_cconv]: 0.0001571, [1] [Cycle 1]: 0.00014984, [11] [c_1]: 2.556e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.53002e-06 [updatestate_assign_eliminate]: 5.00999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.353e-05 [call_graph_tuple_transform]: 2.089e-05 [tuple_list_get_item_eliminator]: 7.75e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.496e-05 [partial_unused_args_eliminate]: 2.23002e-06 [environ_conv]: 8.18001e-06 [add_recomputation]: 4.902e-05 [cse_after_recomputation]: 0.00010152, [1] [Cycle 1]: 9.603e-05, [1] [cse]: 8.853e-05 [auto_monad_reorder]: 1.575e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 6.38998e-06 [opt_after_jit_grad]: 0.00047227 [symbol_engine_optimizer]: 7.77e-05, [1] [Cycle 1]: 7.079e-05, [6] [build]: 3.98001e-06 [elim_shapecalc]: 8.30999e-06 [elim_not_effective]: 1.397e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 1.015e-05 [renormalize]: 2.9002e-07 [validate]: 4.079e-05 Sums bootstrap : 0.000391s : 0.33% type_inference : 0.112904s : 93.96% event_method : 0.000021s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000430s : 0.36% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000737s : 0.61% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002947s : 2.45% jit_opt_a.add_forward_monad_depend : 0.000040s : 0.03% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000689s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000443s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000089s : 0.07% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000472s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000242 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.56% : 0.000006s : 4: substitution.graph_param_transform 85.07% : 0.000206s : 4: substitution.inline 1.23% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 2.54% : 0.000006s : 2: substitution.replace_old_param 5.17% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112826 2 97.31% : 0.109795s : 1: type_inference.infer 2.69% : 0.003031s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.85% : 0.000053s : 4: replace.inline 32.15% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000215 6 94.69% : 0.000203s : 4: match.inline 5.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.57% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.05% : 0.000001s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.06% : 0.000001s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.44% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.64% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.65% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.04% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 1.05% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.12% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.36% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002181 22 66.83% : 0.001458s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.37% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.80% : 0.000672s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128747 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.32% : 0.000408s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.08% : 0.000104s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.54% : 0.008421s : 1: jit_opt_a 0.13% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.35% : 0.000451s : 1: loop_unroll 0.54% : 0.000698s : 1: mutable_eliminate 0.77% : 0.000987s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000437s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.71% : 0.002198s : 1: renormalize.infer 0.57% : 0.000738s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.71% : 0.112923s : 1: type_inference TotalTime = 0.126657, [30] [bootstrap]: 0.00032457 [type_inference]: 0.11545 [event_method]: 2.132e-05 [auto_monad]: 7.592e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00061172 [rewriter_before_opt_a]: 9.019e-05 [expand_dump_flag]: 2.27999e-06 [jit_opt_a]: 0.00785519, [2] [Cycle 1]: 0.00394363, [27] [switch_simplify]: 5.702e-05 [loop_unroll]: 3.528e-05 [a_1]: 0.00068543 [with_stream_mark]: 1.548e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.75998e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 6.13002e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.252e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.31002e-06 [inline_without_move]: 6.23e-06 [renormalize]: 0.0028145 [add_forward_monad_depend]: 7.35e-06 [auto_monad_grad]: 2.55002e-06 [auto_monad_eliminator]: 1.427e-05 [cse]: 2.428e-05 [replace_applicator]: 1.649e-05 [Cycle 2]: 0.00038432, [27] [switch_simplify]: 6.91999e-06 [loop_unroll]: 6.76e-06 [a_1]: 0.00013992 [with_stream_mark]: 1.109e-05 [recompute_prepare]: 6.20997e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.98998e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.76e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.166e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 2.11003e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 6.76999e-06 [cse]: 1.322e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.258e-05 [rewriter_after_opt_a]: 3.377e-05 [convert_after_rewriter]: 6.43998e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00066817 [jit_opt_b]: 5.834e-05, [1] [Cycle 1]: 5.186e-05, [2] [frontend_op_eliminate]: 2.134e-05 [inline_after_opt_a]: 1.867e-05 [cconv]: 1.926e-05 [loop_unroll]: 0.00042569 [jit_opt_after_cconv]: 0.00015105, [1] [Cycle 1]: 0.00014473, [11] [c_1]: 2.577e-05 [parameter_eliminate]: 2.76999e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.215e-05 [call_graph_tuple_transform]: 1.97e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.48998e-06 [remove_dup_value]: 1.001e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.88998e-06 [add_recomputation]: 3.498e-05 [cse_after_recomputation]: 2.238e-05, [1] [Cycle 1]: 1.757e-05, [1] [cse]: 1.202e-05 [auto_monad_reorder]: 1.303e-05 [get_jit_bprop_graph]: 1.76998e-06 [rewriter_after_jit_bprop_graph]: 5.92001e-06 [opt_after_jit_grad]: 0.00045397 [symbol_engine_optimizer]: 7.229e-05, [1] [Cycle 1]: 6.611e-05, [6] [build]: 2.39999e-06 [elim_shapecalc]: 8.26002e-06 [elim_not_effective]: 1.366e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 8.88002e-06 [renormalize]: 4.30009e-07 [validate]: 3.621e-05 Sums bootstrap : 0.000325s : 0.26% type_inference : 0.115450s : 94.21% event_method : 0.000021s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000612s : 0.50% rewriter_before_opt_a : 0.000090s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000825s : 0.67% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002815s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000668s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000019s : 0.02% loop_unroll : 0.000426s : 0.35% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000454s : 0.37% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000238 28 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.16% : 0.000005s : 4: substitution.graph_param_transform 83.40% : 0.000199s : 5: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.12% : 0.000012s : 3: substitution.reduce_eliminate 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 3.25% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115368 2 97.41% : 0.112385s : 1: type_inference.infer 2.59% : 0.002983s : 1: type_inference.specialize ------[replace.] 0.000101 7 65.86% : 0.000066s : 5: replace.inline 34.14% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 96.72% : 0.000196s : 5: match.inline 3.28% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.47% : 0.000002s : 13: predicate.accumulaten_eliminater 0.78% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.40% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.31% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.85% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 2.30% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.43% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.23% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.42% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.46% : 0.000003s : 13: predicate.reduce_eliminate 1.83% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.74% : 0.000010s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.58% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002337 25 63.88% : 0.001493s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.61% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.51% : 0.000783s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130617 72 0.03% : 0.000038s : 1: add_recomputation 0.06% : 0.000080s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.26% : 0.000342s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.02% : 0.007858s : 1: jit_opt_a 0.12% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.33% : 0.000433s : 1: loop_unroll 0.52% : 0.000677s : 1: mutable_eliminate 0.82% : 0.001066s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000618s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.52% : 0.001987s : 1: renormalize.infer 0.63% : 0.000819s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.40% : 0.115467s : 1: type_inference TotalTime = 0.127945, [30] [bootstrap]: 0.00029085 [type_inference]: 0.116649 [event_method]: 1.997e-05 [auto_monad]: 0.00010655 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 0.00048298 [rewriter_before_opt_a]: 8.563e-05 [expand_dump_flag]: 4.33999e-06 [jit_opt_a]: 0.00786406, [2] [Cycle 1]: 0.00389402, [27] [switch_simplify]: 6.009e-05 [loop_unroll]: 3.119e-05 [a_1]: 0.00063449 [with_stream_mark]: 1.833e-05 [recompute_prepare]: 8.99e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 3.95e-06 [updatestate_loads_eliminate]: 2.95002e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.58003e-06 [meta_shard_fg_expand]: 2.16003e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 1.007e-05 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.56998e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00279772 [add_forward_monad_depend]: 6.71e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.751e-05 [cse]: 3.053e-05 [replace_applicator]: 1.663e-05 [Cycle 2]: 0.0003741, [27] [switch_simplify]: 7.77e-06 [loop_unroll]: 6.88e-06 [a_1]: 0.00012356 [with_stream_mark]: 1.241e-05 [recompute_prepare]: 5.54e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 2.85998e-06 [cell_reuse_recompute_pass]: 2.61e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 8.90001e-06 [inline_without_move]: 5.24e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 1.114e-05 [cse]: 1.146e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 3.688e-05 [convert_after_rewriter]: 6.94001e-06 [order_py_execute_after_rewriter]: 5.54998e-06 [mutable_eliminate]: 0.00067261 [jit_opt_b]: 5.798e-05, [1] [Cycle 1]: 5.046e-05, [2] [frontend_op_eliminate]: 1.98e-05 [inline_after_opt_a]: 1.899e-05 [cconv]: 2.586e-05 [loop_unroll]: 0.00042635 [jit_opt_after_cconv]: 0.0001583, [1] [Cycle 1]: 0.00015193, [11] [c_1]: 2.462e-05 [parameter_eliminate]: 3.01999e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.517e-05 [call_graph_tuple_transform]: 2.247e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 8.61002e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 7.66999e-06 [add_recomputation]: 5.327e-05 [cse_after_recomputation]: 2.12e-05, [1] [Cycle 1]: 1.593e-05, [1] [cse]: 1.044e-05 [auto_monad_reorder]: 1.533e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 8.689e-05 [opt_after_jit_grad]: 0.00051094 [symbol_engine_optimizer]: 7.731e-05, [1] [Cycle 1]: 7.076e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.459e-05 [opt_reshape]: 7.33999e-06 [fold_const_symbol]: 8.82999e-06 [renormalize]: 2.80008e-07 [validate]: 3.559e-05 Sums bootstrap : 0.000291s : 0.24% type_inference : 0.116649s : 94.27% event_method : 0.000020s : 0.02% auto_monad : 0.000107s : 0.09% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000483s : 0.39% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000758s : 0.61% jit_opt_a.with_stream_mark : 0.000031s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002798s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000673s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000426s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000087s : 0.07% opt_after_jit_grad : 0.000511s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000269 24 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000007s : 4: substitution.graph_param_transform 86.12% : 0.000232s : 4: substitution.inline 1.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.27% : 0.000006s : 4: substitution.remove_not_recompute_node 1.74% : 0.000005s : 2: substitution.replace_old_param 4.93% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116529 2 97.45% : 0.113561s : 1: type_inference.infer 2.55% : 0.002969s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.79% : 0.000054s : 4: replace.inline 31.21% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000241 6 94.94% : 0.000229s : 4: match.inline 5.06% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.79% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.46% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.41% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.44% : 0.000002s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.29% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.16% : 0.000002s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.80% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.22% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.84% : 0.000009s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002108 22 66.01% : 0.001392s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.53% : 0.000686s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131805 72 0.04% : 0.000056s : 1: add_recomputation 0.08% : 0.000111s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000305s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.97% : 0.007868s : 1: jit_opt_a 0.12% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.33% : 0.000434s : 1: loop_unroll 0.52% : 0.000683s : 1: mutable_eliminate 0.76% : 0.000999s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000519s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.56% : 0.002052s : 1: renormalize.infer 0.56% : 0.000736s : 1: renormalize.specialize 0.07% : 0.000089s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 88.52% : 0.116667s : 1: type_inference TotalTime = 0.131553, [30] [bootstrap]: 0.0003095 [type_inference]: 0.119128 [event_method]: 2.295e-05 [auto_monad]: 6.986e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 0.00063003 [rewriter_before_opt_a]: 0.00010556 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00859471, [2] [Cycle 1]: 0.00439101, [27] [switch_simplify]: 5.862e-05 [loop_unroll]: 3.358e-05 [a_1]: 0.00076119 [with_stream_mark]: 1.658e-05 [recompute_prepare]: 9.29e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.80002e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 6.83998e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 1.026e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00314622 [add_forward_monad_depend]: 9.10999e-06 [auto_monad_grad]: 2.53003e-06 [auto_monad_eliminator]: 1.802e-05 [cse]: 3.41e-05 [replace_applicator]: 2.208e-05 [Cycle 2]: 0.00046631, [27] [switch_simplify]: 7.43e-06 [loop_unroll]: 6.60002e-06 [a_1]: 0.00014113 [with_stream_mark]: 1.718e-05 [recompute_prepare]: 6.40002e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.66999e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 5.745e-05 [updatestate_useless_node_eliminater]: 6.08002e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.79999e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.76999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.59e-05 [j_node_and_user_rematch]: 1.096e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.98002e-06 [inline_without_move]: 6.11e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.46e-06 [cse]: 1.471e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.729e-05 [rewriter_after_opt_a]: 3.916e-05 [convert_after_rewriter]: 7.01999e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00078406 [jit_opt_b]: 5.883e-05, [1] [Cycle 1]: 5.051e-05, [2] [frontend_op_eliminate]: 1.98e-05 [inline_after_opt_a]: 1.817e-05 [cconv]: 3.064e-05 [loop_unroll]: 0.00048648 [jit_opt_after_cconv]: 0.00017635, [1] [Cycle 1]: 0.00016956, [11] [c_1]: 2.72e-05 [parameter_eliminate]: 4.28001e-06 [updatestate_depend_eliminate]: 6.49999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 3.56999e-06 [cse]: 3.628e-05 [call_graph_tuple_transform]: 2.36e-05 [tuple_list_get_item_eliminator]: 7.8e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.49976e-07 [switch_simplify]: 6.43998e-06 [remove_dup_value]: 1.863e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 9.69e-06 [add_recomputation]: 5.1e-05 [cse_after_recomputation]: 2.673e-05, [1] [Cycle 1]: 2.071e-05, [1] [cse]: 1.506e-05 [auto_monad_reorder]: 1.84e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 7.87003e-06 [opt_after_jit_grad]: 0.00051227 [symbol_engine_optimizer]: 7.775e-05, [1] [Cycle 1]: 7.134e-05, [6] [build]: 3.58e-06 [elim_shapecalc]: 9.17001e-06 [elim_not_effective]: 1.425e-05 [opt_reshape]: 6.57002e-06 [fold_const_symbol]: 9.91e-06 [renormalize]: 5.89993e-07 [validate]: 0.00015301 Sums bootstrap : 0.000309s : 0.24% type_inference : 0.119128s : 93.67% event_method : 0.000023s : 0.02% auto_monad : 0.000070s : 0.05% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000630s : 0.50% rewriter_before_opt_a : 0.000106s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000902s : 0.71% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000065s : 0.05% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003146s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000784s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000031s : 0.02% loop_unroll : 0.000486s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000512s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000153s : 0.12% Time group info: ------[substitution.] 0.000257 28 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 4: substitution.graph_param_transform 81.51% : 0.000209s : 5: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.58% : 0.000014s : 3: substitution.reduce_eliminate 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000006s : 2: substitution.replace_old_param 3.46% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119035 2 97.40% : 0.115936s : 1: type_inference.infer 2.60% : 0.003100s : 1: type_inference.specialize ------[replace.] 0.000104 7 64.57% : 0.000067s : 5: replace.inline 35.43% : 0.000037s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 96.33% : 0.000206s : 5: match.inline 3.67% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000197 886 1.10% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.84% : 0.000002s : 13: predicate.addn_check_dump 1.03% : 0.000002s : 13: predicate.addn_zero_filter 2.03% : 0.000004s : 13: predicate.arithmetic_simplify 0.91% : 0.000002s : 13: predicate.cast_eliminate 0.35% : 0.000001s : 4: predicate.check_bprop_eliminate 0.80% : 0.000002s : 13: predicate.compare_switch_simplify 0.86% : 0.000002s : 13: predicate.depend_value_elim 0.79% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 0.89% : 0.000002s : 13: predicate.dict_get_item_eliminator 0.99% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.55% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.23% : 0.000000s : 4: predicate.elim_not_effective 0.37% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.05% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.85% : 0.000002s : 13: predicate.environ_get_depend_swap 1.02% : 0.000002s : 13: predicate.environ_get_eliminate 0.82% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000001s : 4: predicate.graph_param_transform 4.04% : 0.000008s : 28: predicate.inline 0.64% : 0.000001s : 8: predicate.inline_without_move 0.31% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.96% : 0.000002s : 8: predicate.less_batch_normalization 1.24% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.71% : 0.000003s : 19: predicate.load_eliminater 0.82% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.11% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.41% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.82% : 0.000002s : 13: predicate.merge_addn 0.84% : 0.000002s : 13: predicate.minmaximum_grad 1.01% : 0.000002s : 4: predicate.mutable_eliminate 0.35% : 0.000001s : 4: predicate.opt_reshape 1.61% : 0.000003s : 19: predicate.partial_eliminate 0.92% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000004s : 13: predicate.reduce_eliminate 1.05% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.44% : 0.000001s : 8: predicate.remove_not_recompute_node 1.40% : 0.000003s : 23: predicate.replace_applicator 0.40% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000001s : 4: predicate.reset_defer_inline 0.97% : 0.000002s : 13: predicate.reshape_eliminate 0.94% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.48% : 0.000001s : 4: predicate.row_tensor_eliminate 0.94% : 0.000002s : 13: predicate.same_eliminate 0.45% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.69% : 0.000001s : 8: predicate.special_op_eliminate 26.25% : 0.000052s : 8: predicate.specialize_transform 1.08% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 0.91% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.87% : 0.000004s : 20: predicate.switch_defer_inline 1.45% : 0.000003s : 20: predicate.switch_layer_defer_inline 5.05% : 0.000010s : 64: predicate.switch_simplify 0.97% : 0.000002s : 13: predicate.tile_eliminate 0.95% : 0.000002s : 13: predicate.transpose_eliminate 1.05% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 0.95% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 2.65% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.29% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.13% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.19% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.32% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.14% : 0.000002s : 13: predicate.value_based_eliminate 0.26% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002612 25 62.27% : 0.001626s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.26% : 0.000921s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135874 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000074s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000325s : 1: bootstrap 0.02% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.33% : 0.008599s : 1: jit_opt_a 0.13% : 0.000180s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.36% : 0.000496s : 1: loop_unroll 0.59% : 0.000796s : 1: mutable_eliminate 0.89% : 0.001207s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000638s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.57% : 0.002137s : 1: renormalize.infer 0.74% : 0.000999s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000111s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.69% : 0.119148s : 1: type_inference TotalTime = 0.123782, [30] [bootstrap]: 0.00036326 [type_inference]: 0.112924 [event_method]: 2.085e-05 [auto_monad]: 6.688e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00046182 [rewriter_before_opt_a]: 9.147e-05 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.00758205, [2] [Cycle 1]: 0.00381663, [27] [switch_simplify]: 5.973e-05 [loop_unroll]: 3.445e-05 [a_1]: 0.00065309 [with_stream_mark]: 1.288e-05 [recompute_prepare]: 8.82e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.14003e-06 [specialize_transform]: 7.10998e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 9.56003e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.65999e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00273568 [add_forward_monad_depend]: 6.23998e-06 [auto_monad_grad]: 2.00002e-06 [auto_monad_eliminator]: 1.423e-05 [cse]: 2.313e-05 [replace_applicator]: 1.351e-05 [Cycle 2]: 0.00037873, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00012679 [with_stream_mark]: 1.172e-05 [recompute_prepare]: 6.58e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 2.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 9.05999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.352e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.256e-05 [rewriter_after_opt_a]: 3.572e-05 [convert_after_rewriter]: 6.36998e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.0005998 [jit_opt_b]: 5.522e-05, [1] [Cycle 1]: 4.887e-05, [2] [frontend_op_eliminate]: 1.897e-05 [inline_after_opt_a]: 1.777e-05 [cconv]: 2.217e-05 [loop_unroll]: 0.00042504 [jit_opt_after_cconv]: 0.00015636, [1] [Cycle 1]: 0.00014943, [11] [c_1]: 2.742e-05 [parameter_eliminate]: 2.63998e-06 [updatestate_depend_eliminate]: 5.52001e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.452e-05 [call_graph_tuple_transform]: 1.946e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 1.078e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 8.02e-06 [add_recomputation]: 3.969e-05 [cse_after_recomputation]: 2.421e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.191e-05 [auto_monad_reorder]: 1.536e-05 [get_jit_bprop_graph]: 3.13e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00045771 [symbol_engine_optimizer]: 0.00015367, [1] [Cycle 1]: 0.0001469, [6] [build]: 3.12002e-06 [elim_shapecalc]: 1.106e-05 [elim_not_effective]: 1.429e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 8.344e-05 [renormalize]: 5.8001e-07 [validate]: 4.446e-05 Sums bootstrap : 0.000363s : 0.30% type_inference : 0.112924s : 94.25% event_method : 0.000021s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000462s : 0.39% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000780s : 0.65% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002736s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000600s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000022s : 0.02% loop_unroll : 0.000425s : 0.35% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000458s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000083s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000232 28 1.23% : 0.000003s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000005s : 4: substitution.graph_param_transform 83.65% : 0.000194s : 5: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.21% : 0.000010s : 3: substitution.reduce_eliminate 1.93% : 0.000004s : 4: substitution.remove_not_recompute_node 1.59% : 0.000004s : 2: substitution.replace_old_param 3.36% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112853 2 97.52% : 0.110058s : 1: type_inference.infer 2.48% : 0.002796s : 1: type_inference.specialize ------[replace.] 0.000094 7 67.45% : 0.000063s : 5: replace.inline 32.55% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 7 96.61% : 0.000191s : 5: match.inline 3.39% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.23% : 0.000002s : 13: predicate.addn_zero_filter 2.27% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.33% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.43% : 0.000001s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.03% : 0.000007s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.80% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.19% : 0.000004s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002236 25 64.52% : 0.001443s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.66% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.82% : 0.000734s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127685 72 0.03% : 0.000042s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.30% : 0.000379s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.94% : 0.007585s : 1: jit_opt_a 0.12% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.34% : 0.000433s : 1: loop_unroll 0.48% : 0.000609s : 1: mutable_eliminate 0.80% : 0.001019s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000112s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000471s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.55% : 0.001979s : 1: renormalize.infer 0.59% : 0.000748s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.12% : 0.000157s : 1: symbol_engine_optimizer 88.45% : 0.112939s : 1: type_inference TotalTime = 0.0175452, [30] [bootstrap]: 0.00033302 [type_inference]: 0.0087017 [event_method]: 2.075e-05 [auto_monad]: 7.123e-05 [graph_reusing]: 6.84001e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 5.192e-05 [rewriter_before_opt_a]: 8.399e-05 [expand_dump_flag]: 2.99999e-06 [jit_opt_a]: 0.00595352, [2] [Cycle 1]: 0.00202103, [27] [switch_simplify]: 6.63e-05 [loop_unroll]: 3.408e-05 [a_1]: 0.00066758 [with_stream_mark]: 2.111e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 4.31002e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 2.41998e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.36998e-06 [merge_forward]: 4.95999e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00086822 [add_forward_monad_depend]: 6.58e-06 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.72e-05 [cse]: 3.549e-05 [replace_applicator]: 1.527e-05 [Cycle 2]: 0.00033812, [27] [switch_simplify]: 6.36998e-06 [loop_unroll]: 5.22e-06 [a_1]: 0.00010147 [with_stream_mark]: 8.67e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 4.80001e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.197e-05 [j_node_and_user_rematch]: 7.82998e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.47999e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.404e-05 [replace_applicator]: 5.37001e-06 [py_interpret_to_execute_after_opt_a]: 1.273e-05 [rewriter_after_opt_a]: 3.747e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00064952 [jit_opt_b]: 5.052e-05, [1] [Cycle 1]: 4.302e-05, [2] [frontend_op_eliminate]: 1.613e-05 [inline_after_opt_a]: 1.622e-05 [cconv]: 2.588e-05 [loop_unroll]: 0.00045305 [jit_opt_after_cconv]: 0.00017052, [1] [Cycle 1]: 0.00016359, [11] [c_1]: 2.257e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.11e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.798e-05 [call_graph_tuple_transform]: 1.982e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.54998e-06 [remove_dup_value]: 1.76e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.51999e-06 [add_recomputation]: 5.045e-05 [cse_after_recomputation]: 2.515e-05, [1] [Cycle 1]: 1.915e-05, [1] [cse]: 1.286e-05 [auto_monad_reorder]: 1.74e-05 [get_jit_bprop_graph]: 1.64998e-06 [rewriter_after_jit_bprop_graph]: 5.69e-06 [opt_after_jit_grad]: 0.00048266 [symbol_engine_optimizer]: 7.759e-05, [1] [Cycle 1]: 7.099e-05, [6] [build]: 4.19002e-06 [elim_shapecalc]: 9.09e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 6.81999e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.69997e-07 [validate]: 4.261e-05 Sums bootstrap : 0.000333s : 2.50% type_inference : 0.008702s : 65.27% event_method : 0.000021s : 0.16% auto_monad : 0.000071s : 0.53% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000052s : 0.39% rewriter_before_opt_a : 0.000084s : 0.63% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.55% jit_opt_a.loop_unroll : 0.000039s : 0.29% jit_opt_a.a_1 : 0.000769s : 5.77% jit_opt_a.with_stream_mark : 0.000030s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.13% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.12% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000868s : 6.51% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.17% jit_opt_a.cse : 0.000050s : 0.37% jit_opt_a.replace_applicator : 0.000021s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000037s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000650s : 4.87% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000026s : 0.19% loop_unroll : 0.000453s : 3.40% jit_opt_after_cconv.c_1 : 0.000023s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000018s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000050s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000483s : 3.62% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.32% Time group info: ------[substitution.] 0.000269 27 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 1.91% : 0.000005s : 3: substitution.graph_param_transform 83.32% : 0.000224s : 5: substitution.inline 1.12% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.19% : 0.000011s : 3: substitution.reduce_eliminate 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 1.57% : 0.000004s : 2: substitution.replace_old_param 4.77% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008622 2 87.73% : 0.007565s : 1: type_inference.infer 12.27% : 0.001058s : 1: type_inference.specialize ------[replace.] 0.000097 7 67.08% : 0.000065s : 5: replace.inline 32.92% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000233 7 95.00% : 0.000221s : 5: match.inline 5.00% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.33% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.53% : 0.000002s : 11: predicate.addn_zero_filter 1.78% : 0.000002s : 11: predicate.arithmetic_simplify 1.30% : 0.000002s : 11: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000002s : 11: predicate.compare_switch_simplify 1.37% : 0.000002s : 11: predicate.depend_value_elim 1.07% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_depend_swap 1.48% : 0.000002s : 11: predicate.environ_get_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.38% : 0.000000s : 3: predicate.graph_param_transform 5.36% : 0.000007s : 24: predicate.inline 0.78% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 16: predicate.load_eliminater 1.20% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 2.36% : 0.000003s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.48% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000002s : 11: predicate.transpose_eliminate 1.82% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 11: predicate.value_based_eliminate 0.29% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000839 16 50.28% : 0.000422s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.42% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.30% : 0.000355s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019471 72 0.28% : 0.000054s : 1: add_recomputation 0.38% : 0.000075s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.79% : 0.000348s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000027s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.60% : 0.005957s : 1: jit_opt_a 0.89% : 0.000173s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.37% : 0.000461s : 1: loop_unroll 3.38% : 0.000658s : 1: mutable_eliminate 5.14% : 0.001000s : 26: opt.transform.jit_opt_a 0.26% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.53% : 0.000492s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000055s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 2.50% : 0.000487s : 1: renormalize.infer 1.91% : 0.000373s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000040s : 1: rewriter_after_opt_a 0.45% : 0.000087s : 1: rewriter_before_opt_a 0.41% : 0.000080s : 1: symbol_engine_optimizer 44.78% : 0.008719s : 1: type_inference TotalTime = 0.116254, [30] [bootstrap]: 0.00028499 [type_inference]: 0.104687 [event_method]: 1.641e-05 [auto_monad]: 4.747e-05 [graph_reusing]: 3.91001e-06 [pre_auto_parallel]: 2.17001e-06 [py_interpret_to_execute]: 0.00049215 [rewriter_before_opt_a]: 8.247e-05 [expand_dump_flag]: 2.76999e-06 [jit_opt_a]: 0.00785458, [2] [Cycle 1]: 0.00396303, [27] [switch_simplify]: 5.017e-05 [loop_unroll]: 3.171e-05 [a_1]: 0.00055325 [with_stream_mark]: 1.519e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 7.05998e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.375e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 8.43999e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00298667 [add_forward_monad_depend]: 7.3e-06 [auto_monad_grad]: 3.01999e-06 [auto_monad_eliminator]: 1.63e-05 [cse]: 1.994e-05 [replace_applicator]: 1.636e-05 [Cycle 2]: 0.0003809, [27] [switch_simplify]: 6.93998e-06 [loop_unroll]: 5.98998e-06 [a_1]: 0.00012627 [with_stream_mark]: 1.47e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 2.27001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.63e-05 [j_node_and_user_rematch]: 1.115e-05 [meta_fg_expand]: 2.56998e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.124e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.247e-05 [rewriter_after_opt_a]: 3.504e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.00067448 [jit_opt_b]: 6.058e-05, [1] [Cycle 1]: 5.271e-05, [2] [frontend_op_eliminate]: 2.105e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 3.016e-05 [loop_unroll]: 0.00060523 [jit_opt_after_cconv]: 0.00017882, [1] [Cycle 1]: 0.00017148, [11] [c_1]: 2.67e-05 [parameter_eliminate]: 4.80001e-06 [updatestate_depend_eliminate]: 6.81001e-06 [updatestate_assign_eliminate]: 6.48e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 3.183e-05 [call_graph_tuple_transform]: 2.358e-05 [tuple_list_get_item_eliminator]: 6.86999e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 1.14e-06 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.446e-05 [partial_unused_args_eliminate]: 2.63003e-06 [environ_conv]: 9.96998e-06 [add_recomputation]: 4.735e-05 [cse_after_recomputation]: 2.869e-05, [1] [Cycle 1]: 2.278e-05, [1] [cse]: 1.647e-05 [auto_monad_reorder]: 1.461e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 7.18e-06 [opt_after_jit_grad]: 0.00052983 [symbol_engine_optimizer]: 0.00024549, [1] [Cycle 1]: 0.00023879, [6] [build]: 3.68e-06 [elim_shapecalc]: 0.00016956 [elim_not_effective]: 1.661e-05 [opt_reshape]: 7.57998e-06 [fold_const_symbol]: 1.079e-05 [renormalize]: 5.39992e-07 [validate]: 4.909e-05 Sums bootstrap : 0.000285s : 0.25% type_inference : 0.104687s : 93.38% event_method : 0.000016s : 0.01% auto_monad : 0.000047s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000492s : 0.44% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000680s : 0.61% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002987s : 2.66% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000674s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000605s : 0.54% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000016s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000530s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000170s : 0.15% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000188 24 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 3.31% : 0.000006s : 4: substitution.graph_param_transform 81.81% : 0.000153s : 4: substitution.inline 2.43% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.85% : 0.000005s : 4: substitution.remove_not_recompute_node 2.46% : 0.000005s : 2: substitution.replace_old_param 5.17% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104622 2 97.27% : 0.101766s : 1: type_inference.infer 2.73% : 0.002856s : 1: type_inference.specialize ------[replace.] 0.000077 6 63.62% : 0.000049s : 4: replace.inline 36.38% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 94.77% : 0.000151s : 4: match.inline 5.23% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.54% : 0.000002s : 12: predicate.accumulaten_eliminater 1.42% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.45% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 4: predicate.elim_not_effective 1.17% : 0.000002s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.89% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.74% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.57% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.16% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.12% : 0.000002s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.11% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.63% : 0.000009s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002162 22 63.98% : 0.001383s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.55% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.47% : 0.000745s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120225 72 0.04% : 0.000050s : 1: add_recomputation 0.04% : 0.000051s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000299s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.54% : 0.007858s : 1: jit_opt_a 0.15% : 0.000184s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.51% : 0.000615s : 1: loop_unroll 0.57% : 0.000683s : 1: mutable_eliminate 0.76% : 0.000911s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.03% : 0.000035s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000554s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000497s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.78% : 0.002137s : 1: renormalize.infer 0.70% : 0.000841s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000087s : 1: rewriter_before_opt_a 0.21% : 0.000248s : 1: symbol_engine_optimizer 87.09% : 0.104699s : 1: type_inference TotalTime = 0.0141693, [30] [bootstrap]: 0.00032799 [type_inference]: 0.005243 [event_method]: 1.861e-05 [auto_monad]: 6.626e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.519e-05 [rewriter_before_opt_a]: 7.217e-05 [expand_dump_flag]: 3.05002e-06 [jit_opt_a]: 0.00590457, [2] [Cycle 1]: 0.00175907, [27] [switch_simplify]: 6.081e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.0005457 [with_stream_mark]: 2.142e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 3.72002e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.14998e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 1.103e-05 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00074662 [add_forward_monad_depend]: 6.36e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.779e-05 [cse]: 3.076e-05 [replace_applicator]: 1.767e-05 [Cycle 2]: 0.00034102, [27] [switch_simplify]: 5.67001e-06 [loop_unroll]: 5.22e-06 [a_1]: 8.859e-05 [with_stream_mark]: 1.049e-05 [recompute_prepare]: 5.55001e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.557e-05 [j_node_and_user_rematch]: 8.05999e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.3e-06 [inline_without_move]: 2.065e-05 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 6.17001e-06 [cse]: 1.217e-05 [replace_applicator]: 5.47999e-06 [py_interpret_to_execute_after_opt_a]: 1.327e-05 [rewriter_after_opt_a]: 3.806e-05 [convert_after_rewriter]: 7.78999e-06 [order_py_execute_after_rewriter]: 5.57999e-06 [mutable_eliminate]: 0.00067405 [jit_opt_b]: 6.413e-05, [1] [Cycle 1]: 5.545e-05, [2] [frontend_op_eliminate]: 2.565e-05 [inline_after_opt_a]: 1.684e-05 [cconv]: 2.657e-05 [loop_unroll]: 0.0005372 [jit_opt_after_cconv]: 0.00016556, [1] [Cycle 1]: 0.00015778, [11] [c_1]: 2.246e-05 [parameter_eliminate]: 4.68999e-06 [updatestate_depend_eliminate]: 8.17e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 3.016e-05 [call_graph_tuple_transform]: 2.068e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.578e-05 [partial_unused_args_eliminate]: 2.16003e-06 [environ_conv]: 5.97999e-06 [add_recomputation]: 5.087e-05 [cse_after_recomputation]: 2.327e-05, [1] [Cycle 1]: 1.792e-05, [1] [cse]: 1.083e-05 [auto_monad_reorder]: 1.536e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 6.44001e-06 [opt_after_jit_grad]: 0.00053258 [symbol_engine_optimizer]: 7.432e-05, [1] [Cycle 1]: 6.78e-05, [6] [build]: 4.58001e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 5.67001e-06 [fold_const_symbol]: 8.54002e-06 [renormalize]: 5.8001e-07 [validate]: 3.957e-05 Sums bootstrap : 0.000328s : 3.36% type_inference : 0.005243s : 53.77% event_method : 0.000019s : 0.19% auto_monad : 0.000066s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.36% rewriter_before_opt_a : 0.000072s : 0.74% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000634s : 6.51% jit_opt_a.with_stream_mark : 0.000032s : 0.33% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.19% jit_opt_a.inline_without_move : 0.000026s : 0.27% jit_opt_a.renormalize : 0.000747s : 7.66% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.25% jit_opt_a.cse : 0.000043s : 0.44% jit_opt_a.replace_applicator : 0.000023s : 0.24% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000038s : 0.39% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000674s : 6.91% jit_opt_b.frontend_op_eliminate : 0.000026s : 0.26% jit_opt_b.inline_after_opt_a : 0.000017s : 0.17% cconv : 0.000027s : 0.27% loop_unroll : 0.000537s : 5.51% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000030s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000051s : 0.52% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000015s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000533s : 5.46% symbol_engine_optimizer.build : 0.000005s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000040s : 0.41% Time group info: ------[substitution.] 0.000216 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.80% : 0.000006s : 3: substitution.graph_param_transform 82.99% : 0.000179s : 4: substitution.inline 2.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.54% : 0.000005s : 2: substitution.replace_old_param 5.66% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005173 2 83.41% : 0.004315s : 1: type_inference.infer 16.59% : 0.000858s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.88% : 0.000046s : 4: replace.inline 32.12% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 94.12% : 0.000177s : 4: match.inline 5.88% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.47% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000002s : 10: predicate.addn_zero_filter 2.23% : 0.000003s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.27% : 0.000002s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.00% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 6.00% : 0.000007s : 22: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 2.04% : 0.000003s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 1.36% : 0.000002s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.13% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.07% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 1.94% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.82% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.65% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000666 13 53.06% : 0.000353s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.74% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.20% : 0.000274s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015864 72 0.34% : 0.000054s : 1: add_recomputation 0.44% : 0.000070s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 2.20% : 0.000349s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.24% : 0.005908s : 1: jit_opt_a 1.06% : 0.000169s : 1: jit_opt_after_cconv 0.42% : 0.000067s : 1: jit_opt_b 3.46% : 0.000549s : 1: loop_unroll 4.32% : 0.000685s : 1: mutable_eliminate 5.53% : 0.000878s : 26: opt.transform.jit_opt_a 0.32% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.22% : 0.000036s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000542s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.51% : 0.000398s : 1: renormalize.infer 2.15% : 0.000341s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000042s : 1: rewriter_after_opt_a 0.47% : 0.000075s : 1: rewriter_before_opt_a 0.49% : 0.000077s : 1: symbol_engine_optimizer 33.16% : 0.005261s : 1: type_inference TotalTime = 0.133124, [30] [bootstrap]: 0.00033859 [type_inference]: 0.12034 [event_method]: 2.191e-05 [auto_monad]: 7.634e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 2.84001e-06 [py_interpret_to_execute]: 0.00075862 [rewriter_before_opt_a]: 0.00011517 [expand_dump_flag]: 3.98999e-06 [jit_opt_a]: 0.00902972, [2] [Cycle 1]: 0.00474955, [27] [switch_simplify]: 6.828e-05 [loop_unroll]: 3.401e-05 [a_1]: 0.00073895 [with_stream_mark]: 1.95e-05 [recompute_prepare]: 9.05999e-06 [updatestate_depend_eliminate]: 4.17998e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 8.90999e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 2.63e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.686e-05 [j_node_and_user_rematch]: 1.107e-05 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.46999e-06 [renormalize]: 0.00350916 [add_forward_monad_depend]: 6.17999e-06 [auto_monad_grad]: 3.41999e-06 [auto_monad_eliminator]: 1.658e-05 [cse]: 3.503e-05 [replace_applicator]: 1.441e-05 [Cycle 2]: 0.00039667, [27] [switch_simplify]: 7.46001e-06 [loop_unroll]: 6.83998e-06 [a_1]: 0.00014096 [with_stream_mark]: 1.065e-05 [recompute_prepare]: 6.46e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 6.76e-06 [meta_shard_fg_expand]: 1.74998e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.222e-05 [j_node_and_user_rematch]: 8.84998e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.11998e-06 [inline_without_move]: 5.66998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.50999e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.554e-05 [replace_applicator]: 6.33998e-06 [py_interpret_to_execute_after_opt_a]: 1.402e-05 [rewriter_after_opt_a]: 3.238e-05 [convert_after_rewriter]: 5.66e-06 [order_py_execute_after_rewriter]: 3.98999e-06 [mutable_eliminate]: 0.00068924 [jit_opt_b]: 5.7e-05, [1] [Cycle 1]: 4.981e-05, [2] [frontend_op_eliminate]: 2.075e-05 [inline_after_opt_a]: 1.753e-05 [cconv]: 1.732e-05 [loop_unroll]: 0.00052184 [jit_opt_after_cconv]: 0.00015753, [1] [Cycle 1]: 0.000151, [11] [c_1]: 2.666e-05 [parameter_eliminate]: 2.68998e-06 [updatestate_depend_eliminate]: 6.64999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.555e-05 [call_graph_tuple_transform]: 2.132e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.04998e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.116e-05 [partial_unused_args_eliminate]: 1.47999e-06 [environ_conv]: 7.15e-06 [add_recomputation]: 3.385e-05 [cse_after_recomputation]: 2.326e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.276e-05 [get_jit_bprop_graph]: 1.60001e-06 [rewriter_after_jit_bprop_graph]: 6.04999e-06 [opt_after_jit_grad]: 0.00043858 [symbol_engine_optimizer]: 7.559e-05, [1] [Cycle 1]: 6.972e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 8.84e-06 [elim_not_effective]: 1.253e-05 [opt_reshape]: 7.79002e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 3.50003e-07 [validate]: 0.00013939 Sums bootstrap : 0.000339s : 0.26% type_inference : 0.120340s : 93.56% event_method : 0.000022s : 0.02% auto_monad : 0.000076s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000759s : 0.59% rewriter_before_opt_a : 0.000115s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000880s : 0.68% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003509s : 2.73% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000689s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000017s : 0.01% loop_unroll : 0.000522s : 0.41% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000439s : 0.34% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000139s : 0.11% Time group info: ------[substitution.] 0.000283 28 0.50% : 0.000001s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 1.53% : 0.000004s : 4: substitution.graph_param_transform 83.36% : 0.000236s : 5: substitution.inline 1.56% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.86% : 0.000014s : 3: substitution.reduce_eliminate 1.92% : 0.000005s : 4: substitution.remove_not_recompute_node 1.66% : 0.000005s : 2: substitution.replace_old_param 4.26% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120251 2 97.11% : 0.116771s : 1: type_inference.infer 2.89% : 0.003480s : 1: type_inference.specialize ------[replace.] 0.000109 7 68.96% : 0.000075s : 5: replace.inline 31.04% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000243 7 95.50% : 0.000232s : 5: match.inline 4.50% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.49% : 0.000002s : 13: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.08% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.39% : 0.000002s : 13: predicate.depend_value_elim 1.35% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.61% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.82% : 0.000009s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.84% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.28% : 0.000003s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.75% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.78% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.80% : 0.000010s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.57% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002852 25 59.41% : 0.001694s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.32% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.27% : 0.001092s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137743 72 0.03% : 0.000037s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.26% : 0.000353s : 1: bootstrap 0.01% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.56% : 0.009035s : 1: jit_opt_a 0.12% : 0.000160s : 1: jit_opt_after_cconv 0.04% : 0.000059s : 1: jit_opt_b 0.38% : 0.000530s : 1: loop_unroll 0.51% : 0.000699s : 1: mutable_eliminate 0.82% : 0.001135s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.32% : 0.000446s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.56% : 0.000767s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.72% : 0.002371s : 1: renormalize.infer 0.82% : 0.001127s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.09% : 0.000121s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 87.38% : 0.120357s : 1: type_inference TotalTime = 0.0160701, [30] [bootstrap]: 0.0003046 [type_inference]: 0.00792291 [event_method]: 2.012e-05 [auto_monad]: 7.012e-05 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.47001e-06 [py_interpret_to_execute]: 4.372e-05 [rewriter_before_opt_a]: 7.945e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.00543548, [2] [Cycle 1]: 0.00189383, [27] [switch_simplify]: 5.421e-05 [loop_unroll]: 3.453e-05 [a_1]: 0.00064794 [with_stream_mark]: 1.752e-05 [recompute_prepare]: 7.8e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.64001e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.80998e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.398e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00081659 [add_forward_monad_depend]: 5.32999e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.428e-05 [cse]: 2.286e-05 [replace_applicator]: 1.336e-05 [Cycle 2]: 0.00033067, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.933e-05 [with_stream_mark]: 9.94999e-06 [recompute_prepare]: 6.70002e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 7.99977e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 5.03002e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.134e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 7.25e-06 [inline_without_move]: 4.77e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.274e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.129e-05 [rewriter_after_opt_a]: 3.422e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.73001e-06 [mutable_eliminate]: 0.00060148 [jit_opt_b]: 5.129e-05, [1] [Cycle 1]: 4.395e-05, [2] [frontend_op_eliminate]: 1.622e-05 [inline_after_opt_a]: 1.552e-05 [cconv]: 2.311e-05 [loop_unroll]: 0.00042862 [jit_opt_after_cconv]: 0.00015067, [1] [Cycle 1]: 0.00014371, [11] [c_1]: 2.148e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 6.28e-06 [updatestate_assign_eliminate]: 4.04997e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.715e-05 [call_graph_tuple_transform]: 1.837e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.29998e-06 [remove_dup_value]: 1.579e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 6.04001e-06 [add_recomputation]: 4.867e-05 [cse_after_recomputation]: 2.424e-05, [1] [Cycle 1]: 1.897e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.711e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.0004676 [symbol_engine_optimizer]: 7.305e-05, [1] [Cycle 1]: 6.66e-05, [6] [build]: 3.00002e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 6.02999e-06 [fold_const_symbol]: 8.63001e-06 [renormalize]: 4.59986e-07 [validate]: 3.795e-05 Sums bootstrap : 0.000305s : 2.48% type_inference : 0.007923s : 64.51% event_method : 0.000020s : 0.16% auto_monad : 0.000070s : 0.57% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000044s : 0.36% rewriter_before_opt_a : 0.000079s : 0.65% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000060s : 0.49% jit_opt_a.loop_unroll : 0.000040s : 0.32% jit_opt_a.a_1 : 0.000747s : 6.08% jit_opt_a.with_stream_mark : 0.000027s : 0.22% jit_opt_a.recompute_prepare : 0.000015s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000817s : 6.65% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000036s : 0.29% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000034s : 0.28% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000601s : 4.90% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000023s : 0.19% loop_unroll : 0.000429s : 3.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000049s : 0.40% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000468s : 3.81% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.31% Time group info: ------[substitution.] 0.000242 27 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000005s : 3: substitution.graph_param_transform 83.50% : 0.000202s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.18% : 0.000010s : 3: substitution.reduce_eliminate 1.82% : 0.000004s : 4: substitution.remove_not_recompute_node 1.50% : 0.000004s : 2: substitution.replace_old_param 4.36% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007863 2 87.62% : 0.006889s : 1: type_inference.infer 12.38% : 0.000974s : 1: type_inference.specialize ------[replace.] 0.000096 7 66.47% : 0.000064s : 5: replace.inline 33.53% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 7 95.46% : 0.000200s : 5: match.inline 4.54% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.35% : 0.000002s : 11: predicate.addn_zero_filter 2.11% : 0.000003s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.23% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 16: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.62% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 2.25% : 0.000003s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 19: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.52% : 0.000002s : 11: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.91% : 0.000010s : 59: predicate.switch_simplify 1.43% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000002s : 11: predicate.transpose_eliminate 1.41% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000777 16 49.86% : 0.000387s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.40% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.74% : 0.000332s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017915 72 0.29% : 0.000052s : 1: add_recomputation 0.41% : 0.000073s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.78% : 0.000320s : 1: bootstrap 0.14% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.36% : 0.005440s : 1: jit_opt_a 0.91% : 0.000163s : 1: jit_opt_after_cconv 0.30% : 0.000054s : 1: jit_opt_b 2.44% : 0.000437s : 1: loop_unroll 3.41% : 0.000611s : 1: mutable_eliminate 5.39% : 0.000965s : 26: opt.transform.jit_opt_a 0.26% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000476s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.71% : 0.000486s : 1: renormalize.infer 1.79% : 0.000322s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000037s : 1: rewriter_after_opt_a 0.46% : 0.000082s : 1: rewriter_before_opt_a 0.42% : 0.000076s : 1: symbol_engine_optimizer 44.30% : 0.007935s : 1: type_inference TotalTime = 0.11756, [30] [bootstrap]: 0.00028869 [type_inference]: 0.107073 [event_method]: 1.92e-05 [auto_monad]: 9.733e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00055561 [rewriter_before_opt_a]: 8.851e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.0071778, [2] [Cycle 1]: 0.00348994, [27] [switch_simplify]: 5.672e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00055925 [with_stream_mark]: 1.831e-05 [recompute_prepare]: 8.09002e-06 [updatestate_depend_eliminate]: 4.20999e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 6.26e-06 [renormalize]: 0.00249418 [add_forward_monad_depend]: 5.82999e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.732e-05 [cse]: 2.795e-05 [replace_applicator]: 1.439e-05 [Cycle 2]: 0.00037965, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00011985 [with_stream_mark]: 1.095e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.20998e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.60001e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.433e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.1e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.221e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.167e-05 [rewriter_after_opt_a]: 3.477e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00060404 [jit_opt_b]: 5.522e-05, [1] [Cycle 1]: 4.812e-05, [2] [frontend_op_eliminate]: 2.083e-05 [inline_after_opt_a]: 1.661e-05 [cconv]: 2.412e-05 [loop_unroll]: 0.00041057 [jit_opt_after_cconv]: 0.00014535, [1] [Cycle 1]: 0.00013936, [11] [c_1]: 2.468e-05 [parameter_eliminate]: 2.13998e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.864e-05 [call_graph_tuple_transform]: 2.007e-05 [tuple_list_get_item_eliminator]: 5.90002e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.432e-05 [partial_unused_args_eliminate]: 3.18e-06 [environ_conv]: 7.61001e-06 [add_recomputation]: 4.679e-05 [cse_after_recomputation]: 2.185e-05, [1] [Cycle 1]: 1.691e-05, [1] [cse]: 1.115e-05 [auto_monad_reorder]: 1.539e-05 [get_jit_bprop_graph]: 1.76998e-06 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.00046002 [symbol_engine_optimizer]: 7.335e-05, [1] [Cycle 1]: 6.691e-05, [6] [build]: 2.79999e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 6.74999e-06 [fold_const_symbol]: 9.22001e-06 [renormalize]: 3.49974e-07 [validate]: 3.947e-05 Sums bootstrap : 0.000289s : 0.25% type_inference : 0.107073s : 94.28% event_method : 0.000019s : 0.02% auto_monad : 0.000097s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000556s : 0.49% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000679s : 0.60% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002494s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000604s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000411s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000460s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000204 24 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.25% : 0.000007s : 4: substitution.graph_param_transform 82.77% : 0.000169s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 6.06% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106992 2 97.35% : 0.104155s : 1: type_inference.infer 2.65% : 0.002836s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.08% : 0.000049s : 4: replace.inline 31.92% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.68% : 0.000166s : 4: match.inline 6.32% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.73% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.10% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.65% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.52% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.69% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.44% : 0.000010s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.85% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002103 22 67.80% : 0.001426s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.50% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.70% : 0.000645s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120969 72 0.04% : 0.000049s : 1: add_recomputation 0.08% : 0.000102s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000306s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.03% : 0.000033s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.94% : 0.007181s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000418s : 1: loop_unroll 0.51% : 0.000612s : 1: mutable_eliminate 0.75% : 0.000907s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000564s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.48% : 0.001793s : 1: renormalize.infer 0.57% : 0.000692s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 88.53% : 0.107089s : 1: type_inference TotalTime = 0.120004, [30] [bootstrap]: 0.00031364 [type_inference]: 0.10905 [event_method]: 2.018e-05 [auto_monad]: 6.859e-05 [graph_reusing]: 5.44e-06 [pre_auto_parallel]: 2.04e-06 [py_interpret_to_execute]: 0.00048488 [rewriter_before_opt_a]: 9.334e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00757822, [2] [Cycle 1]: 0.00385913, [27] [switch_simplify]: 6.012e-05 [loop_unroll]: 3.414e-05 [a_1]: 0.00067036 [with_stream_mark]: 1.842e-05 [recompute_prepare]: 8.46002e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 6.68e-06 [merge_forward]: 6.726e-05 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 9.88998e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.56e-06 [inline_without_move]: 6.10002e-06 [renormalize]: 0.00267389 [add_forward_monad_depend]: 6.17001e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 2.967e-05 [replace_applicator]: 1.511e-05 [Cycle 2]: 0.00036691, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 6.27001e-06 [a_1]: 0.0001289 [with_stream_mark]: 9.36002e-06 [recompute_prepare]: 6.25002e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.60997e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.103e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.03001e-06 [inline_without_move]: 5.53002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.43002e-06 [auto_monad_grad]: 9.80013e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.363e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 1.199e-05 [rewriter_after_opt_a]: 3.565e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.0005912 [jit_opt_b]: 0.00012285, [1] [Cycle 1]: 0.00011569, [2] [frontend_op_eliminate]: 8.38e-05 [inline_after_opt_a]: 1.893e-05 [cconv]: 2.449e-05 [loop_unroll]: 0.00043661 [jit_opt_after_cconv]: 0.00015353, [1] [Cycle 1]: 0.0001472, [11] [c_1]: 2.632e-05 [parameter_eliminate]: 2.26003e-06 [updatestate_depend_eliminate]: 5.52001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.263e-05 [call_graph_tuple_transform]: 2.08e-05 [tuple_list_get_item_eliminator]: 6.38998e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.14999e-06 [remove_dup_value]: 1.673e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.85e-06 [add_recomputation]: 4.618e-05 [cse_after_recomputation]: 2.474e-05, [1] [Cycle 1]: 1.838e-05, [1] [cse]: 1.285e-05 [auto_monad_reorder]: 1.76e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 4.58999e-06 [opt_after_jit_grad]: 0.0004855 [symbol_engine_optimizer]: 8.345e-05, [1] [Cycle 1]: 7.692e-05, [6] [build]: 3.81999e-06 [elim_shapecalc]: 1.324e-05 [elim_not_effective]: 1.55e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 1.018e-05 [renormalize]: 3.80009e-07 [validate]: 0.00013467 Sums bootstrap : 0.000314s : 0.27% type_inference : 0.109050s : 93.95% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000485s : 0.42% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000799s : 0.69% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000070s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002674s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000591s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000084s : 0.07% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000437s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000486s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000135s : 0.12% Time group info: ------[substitution.] 0.000257 28 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.85% : 0.000002s : 2: substitution.fold_const_symbol 2.24% : 0.000006s : 4: substitution.graph_param_transform 82.83% : 0.000213s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.34% : 0.000011s : 3: substitution.reduce_eliminate 1.67% : 0.000004s : 4: substitution.remove_not_recompute_node 1.49% : 0.000004s : 2: substitution.replace_old_param 4.67% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108981 2 97.46% : 0.106218s : 1: type_inference.infer 2.54% : 0.002763s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.78% : 0.000065s : 5: replace.inline 31.22% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 95.05% : 0.000210s : 5: match.inline 4.95% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.73% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.39% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 19: predicate.partial_eliminate 1.29% : 0.000002s : 13: predicate.print_const_string_wrapper 2.27% : 0.000003s : 13: predicate.reduce_eliminate 1.46% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002233 25 64.86% : 0.001448s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.15% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.99% : 0.000714s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123768 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000326s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.13% : 0.007582s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.10% : 0.000126s : 1: jit_opt_b 0.36% : 0.000445s : 1: loop_unroll 0.48% : 0.000600s : 1: mutable_eliminate 0.84% : 0.001037s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000097s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.57% : 0.001945s : 1: renormalize.infer 0.58% : 0.000720s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000099s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 88.12% : 0.109063s : 1: type_inference TotalTime = 0.0649159, [30] [bootstrap]: 0.00031144 [type_inference]: 0.0557248 [event_method]: 1.692e-05 [auto_monad]: 5.415e-05 [graph_reusing]: 5.05999e-06 [pre_auto_parallel]: 1.69e-06 [py_interpret_to_execute]: 0.00024108 [rewriter_before_opt_a]: 7.622e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.0063178, [2] [Cycle 1]: 0.00275663, [27] [switch_simplify]: 4.686e-05 [loop_unroll]: 3.015e-05 [a_1]: 0.00050961 [with_stream_mark]: 1.225e-05 [recompute_prepare]: 8.10999e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.77999e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 9.56998e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00185997 [add_forward_monad_depend]: 5.04e-06 [auto_monad_grad]: 1.49e-06 [auto_monad_eliminator]: 1.191e-05 [cse]: 1.965e-05 [replace_applicator]: 1.309e-05 [Cycle 2]: 0.00034373, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.57001e-06 [a_1]: 0.00011763 [with_stream_mark]: 8.55999e-06 [recompute_prepare]: 5.95002e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.29998e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 2.41e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 8.24998e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 5.79981e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.055e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 9.07999e-06 [rewriter_after_opt_a]: 2.636e-05 [convert_after_rewriter]: 5.37999e-06 [order_py_execute_after_rewriter]: 4.67e-06 [mutable_eliminate]: 0.00051722 [jit_opt_b]: 5.303e-05, [1] [Cycle 1]: 4.583e-05, [2] [frontend_op_eliminate]: 1.735e-05 [inline_after_opt_a]: 1.817e-05 [cconv]: 2.01e-05 [loop_unroll]: 0.0004673 [jit_opt_after_cconv]: 0.00015616, [1] [Cycle 1]: 0.00014891, [11] [c_1]: 2.494e-05 [parameter_eliminate]: 3.48e-06 [updatestate_depend_eliminate]: 6.29999e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.392e-05 [call_graph_tuple_transform]: 2.131e-05 [tuple_list_get_item_eliminator]: 6.33002e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.083e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 4.029e-05 [cse_after_recomputation]: 2.22e-05, [1] [Cycle 1]: 1.665e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.166e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.08002e-06 [opt_after_jit_grad]: 0.00051556 [symbol_engine_optimizer]: 7.857e-05, [1] [Cycle 1]: 7.112e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 8.37e-06 [elim_not_effective]: 1.409e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 4.89992e-07 [validate]: 3.825e-05 Sums bootstrap : 0.000311s : 0.51% type_inference : 0.055725s : 91.15% event_method : 0.000017s : 0.03% auto_monad : 0.000054s : 0.09% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000241s : 0.39% rewriter_before_opt_a : 0.000076s : 0.12% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000627s : 1.03% jit_opt_a.with_stream_mark : 0.000021s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001860s : 3.04% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000030s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000026s : 0.04% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000517s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000020s : 0.03% loop_unroll : 0.000467s : 0.76% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000516s : 0.84% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.06% Time group info: ------[substitution.] 0.000164 24 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.23% : 0.000005s : 4: substitution.graph_param_transform 83.05% : 0.000136s : 4: substitution.inline 1.83% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000004s : 4: substitution.remove_not_recompute_node 1.94% : 0.000003s : 2: substitution.replace_old_param 5.52% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055658 2 96.76% : 0.053856s : 1: type_inference.infer 3.24% : 0.001802s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.97% : 0.000043s : 4: replace.inline 33.03% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 94.39% : 0.000134s : 4: match.inline 5.61% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.18% : 0.000001s : 12: predicate.addn_zero_filter 1.98% : 0.000002s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000001s : 12: predicate.environ_get_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 2.05% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.55% : 0.000001s : 4: predicate.reset_defer_inline 1.66% : 0.000002s : 12: predicate.reshape_eliminate 1.60% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.36% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002240 26 71.90% : 0.001611s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.25% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.85% : 0.000602s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067696 72 0.06% : 0.000044s : 1: add_recomputation 0.08% : 0.000057s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.48% : 0.000327s : 1: bootstrap 0.03% : 0.000023s : 1: cconv 0.01% : 0.000007s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.34% : 0.006321s : 1: jit_opt_a 0.23% : 0.000159s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.70% : 0.000476s : 1: loop_unroll 0.78% : 0.000528s : 1: mutable_eliminate 1.24% : 0.000840s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000524s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.36% : 0.000246s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.83% : 0.001237s : 1: renormalize.infer 0.91% : 0.000616s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000029s : 1: rewriter_after_opt_a 0.12% : 0.000081s : 1: rewriter_before_opt_a 0.12% : 0.000081s : 1: symbol_engine_optimizer 82.34% : 0.055739s : 1: type_inference TotalTime = 0.0114566, [30] [bootstrap]: 0.0002513 [type_inference]: 0.00413258 [event_method]: 1.656e-05 [auto_monad]: 6.28e-05 [graph_reusing]: 5.26002e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 3.451e-05 [rewriter_before_opt_a]: 6.97e-05 [expand_dump_flag]: 2.93e-06 [jit_opt_a]: 0.00489139, [2] [Cycle 1]: 0.00145147, [27] [switch_simplify]: 5.234e-05 [loop_unroll]: 3.109e-05 [a_1]: 0.00050919 [with_stream_mark]: 1.455e-05 [recompute_prepare]: 7e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.91e-06 [parameter_eliminate]: 1.66998e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 4.95999e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 0.00053146 [add_forward_monad_depend]: 4.99e-06 [auto_monad_grad]: 1.92999e-06 [auto_monad_eliminator]: 1.325e-05 [cse]: 2.623e-05 [replace_applicator]: 1.091e-05 [Cycle 2]: 0.00030888, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.77e-06 [a_1]: 8.721e-05 [with_stream_mark]: 9.00001e-06 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.68001e-06 [accelerated_algorithm]: 4.75999e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.47e-06 [merge_forward]: 2.65002e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 7.46999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.08998e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 1.051e-05 [replace_applicator]: 4.95999e-06 [py_interpret_to_execute_after_opt_a]: 8.52998e-06 [rewriter_after_opt_a]: 3.182e-05 [convert_after_rewriter]: 6.38e-06 [order_py_execute_after_rewriter]: 5.25001e-06 [mutable_eliminate]: 0.00051295 [jit_opt_b]: 4.728e-05, [1] [Cycle 1]: 4.105e-05, [2] [frontend_op_eliminate]: 1.495e-05 [inline_after_opt_a]: 1.563e-05 [cconv]: 2.533e-05 [loop_unroll]: 0.00039679 [jit_opt_after_cconv]: 0.00014715, [1] [Cycle 1]: 0.00014085, [11] [c_1]: 2.007e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 6.78998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.002e-05 [call_graph_tuple_transform]: 1.773e-05 [tuple_list_get_item_eliminator]: 5.20001e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.17999e-06 [remove_dup_value]: 1.426e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 5.22e-06 [add_recomputation]: 4.573e-05 [cse_after_recomputation]: 2.058e-05, [1] [Cycle 1]: 1.503e-05, [1] [cse]: 9.67999e-06 [auto_monad_reorder]: 1.531e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 3.81999e-06 [opt_after_jit_grad]: 0.00044561 [symbol_engine_optimizer]: 6.982e-05, [1] [Cycle 1]: 6.361e-05, [6] [build]: 3.36999e-06 [elim_shapecalc]: 8.03999e-06 [elim_not_effective]: 1.204e-05 [opt_reshape]: 5.20999e-06 [fold_const_symbol]: 8.38001e-06 [renormalize]: 3.30008e-07 [validate]: 3.318e-05 Sums bootstrap : 0.000251s : 3.23% type_inference : 0.004133s : 53.13% event_method : 0.000017s : 0.21% auto_monad : 0.000063s : 0.81% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.44% rewriter_before_opt_a : 0.000070s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000058s : 0.74% jit_opt_a.loop_unroll : 0.000036s : 0.46% jit_opt_a.a_1 : 0.000596s : 7.67% jit_opt_a.with_stream_mark : 0.000024s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000532s : 6.83% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.24% jit_opt_a.cse : 0.000037s : 0.47% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000032s : 0.41% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000513s : 6.60% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000025s : 0.33% loop_unroll : 0.000397s : 5.10% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000046s : 0.59% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.20% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000446s : 5.73% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.43% Time group info: ------[substitution.] 0.000183 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000005s : 3: substitution.graph_param_transform 83.10% : 0.000152s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000004s : 2: substitution.replace_old_param 5.97% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004078 2 80.61% : 0.003287s : 1: type_inference.infer 19.39% : 0.000791s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.99% : 0.000043s : 4: replace.inline 33.01% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.79% : 0.000150s : 4: match.inline 6.21% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.29% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 6.11% : 0.000007s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.16% : 0.000001s : 10: predicate.print_const_string_wrapper 1.55% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.54% : 0.000001s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000550 13 51.69% : 0.000285s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.16% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.15% : 0.000237s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012849 72 0.38% : 0.000049s : 1: add_recomputation 0.52% : 0.000066s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.05% : 0.000263s : 1: bootstrap 0.22% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.09% : 0.004895s : 1: jit_opt_a 1.17% : 0.000150s : 1: jit_opt_after_cconv 0.39% : 0.000050s : 1: jit_opt_b 3.15% : 0.000404s : 1: loop_unroll 4.06% : 0.000521s : 1: mutable_eliminate 6.22% : 0.000800s : 26: opt.transform.jit_opt_a 0.35% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.53% : 0.000453s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.15% : 0.000276s : 1: renormalize.infer 1.93% : 0.000249s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000034s : 1: rewriter_after_opt_a 0.56% : 0.000072s : 1: rewriter_before_opt_a 0.56% : 0.000072s : 1: symbol_engine_optimizer 32.25% : 0.004143s : 1: type_inference TotalTime = 0.0126036, [30] [bootstrap]: 0.00028842 [type_inference]: 0.00498015 [event_method]: 1.646e-05 [auto_monad]: 5.516e-05 [graph_reusing]: 3.83999e-06 [pre_auto_parallel]: 1.92999e-06 [py_interpret_to_execute]: 3.493e-05 [rewriter_before_opt_a]: 6.855e-05 [expand_dump_flag]: 2.44999e-06 [jit_opt_a]: 0.00516324, [2] [Cycle 1]: 0.00168172, [27] [switch_simplify]: 4.919e-05 [loop_unroll]: 2.991e-05 [a_1]: 0.00049645 [with_stream_mark]: 1.299e-05 [recompute_prepare]: 6.81001e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 6.11998e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 1.86998e-06 [get_grad_eliminate_]: 5.10999e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 7.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.085e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00080845 [add_forward_monad_depend]: 4.45999e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.262e-05 [cse]: 2.014e-05 [replace_applicator]: 1.171e-05 [Cycle 2]: 0.00031227, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 4.83001e-06 [a_1]: 8.88e-05 [with_stream_mark]: 8.70001e-06 [recompute_prepare]: 4.67e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.08002e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 4.60999e-06 [updatestate_useless_node_eliminater]: 4.80001e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 4.69002e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.298e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.93001e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.052e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 9.27999e-06 [rewriter_after_opt_a]: 2.991e-05 [convert_after_rewriter]: 6.24999e-06 [order_py_execute_after_rewriter]: 4.16001e-06 [mutable_eliminate]: 0.00050539 [jit_opt_b]: 4.659e-05, [1] [Cycle 1]: 4.081e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.509e-05 [cconv]: 1.908e-05 [loop_unroll]: 0.00042794 [jit_opt_after_cconv]: 0.00013315, [1] [Cycle 1]: 0.00012729, [11] [c_1]: 2.034e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 1.797e-05 [call_graph_tuple_transform]: 1.67e-05 [tuple_list_get_item_eliminator]: 5.07e-06 [none_parameter_eliminate]: 1.25999e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.065e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 5.63997e-06 [add_recomputation]: 3.763e-05 [cse_after_recomputation]: 2.224e-05, [1] [Cycle 1]: 1.686e-05, [1] [cse]: 1.061e-05 [auto_monad_reorder]: 1.311e-05 [get_jit_bprop_graph]: 1.60001e-06 [rewriter_after_jit_bprop_graph]: 4.28999e-06 [opt_after_jit_grad]: 0.00045077 [symbol_engine_optimizer]: 6.882e-05, [1] [Cycle 1]: 6.292e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 7.84002e-06 [elim_not_effective]: 1.189e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 8.33999e-06 [renormalize]: 3.00002e-07 [validate]: 2.89e-05 Sums bootstrap : 0.000288s : 3.24% type_inference : 0.004980s : 55.99% event_method : 0.000016s : 0.19% auto_monad : 0.000055s : 0.62% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.39% rewriter_before_opt_a : 0.000069s : 0.77% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.39% jit_opt_a.a_1 : 0.000585s : 6.58% jit_opt_a.with_stream_mark : 0.000022s : 0.24% jit_opt_a.recompute_prepare : 0.000011s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000809s : 9.09% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.21% jit_opt_a.cse : 0.000031s : 0.34% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000009s : 0.10% rewriter_after_opt_a : 0.000030s : 0.34% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000505s : 5.68% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000019s : 0.21% loop_unroll : 0.000428s : 4.81% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000011s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000038s : 0.42% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000013s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000451s : 5.07% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.32% Time group info: ------[substitution.] 0.000172 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000004s : 3: substitution.graph_param_transform 83.56% : 0.000144s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000004s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 5.99% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004927 2 81.73% : 0.004027s : 1: type_inference.infer 18.27% : 0.000900s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.99% : 0.000045s : 4: replace.inline 34.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 93.83% : 0.000141s : 4: match.inline 6.17% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.45% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.73% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.24% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.20% : 0.000006s : 22: predicate.inline 1.01% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 2.00% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 2.00% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.56% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.06% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000008s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.62% : 0.000002s : 10: predicate.transpose_eliminate 1.53% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000675 13 52.22% : 0.000353s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.32% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.47% : 0.000293s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014252 72 0.28% : 0.000040s : 1: add_recomputation 0.41% : 0.000058s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 2.11% : 0.000301s : 1: bootstrap 0.15% : 0.000022s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 36.25% : 0.005166s : 1: jit_opt_a 0.95% : 0.000136s : 1: jit_opt_after_cconv 0.34% : 0.000049s : 1: jit_opt_b 3.06% : 0.000437s : 1: loop_unroll 3.61% : 0.000514s : 1: mutable_eliminate 5.52% : 0.000786s : 26: opt.transform.jit_opt_a 0.31% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.22% : 0.000459s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000013s : 1: remove_dup_value 3.33% : 0.000474s : 1: renormalize.infer 2.30% : 0.000328s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000033s : 1: rewriter_after_opt_a 0.50% : 0.000071s : 1: rewriter_before_opt_a 0.50% : 0.000071s : 1: symbol_engine_optimizer 35.01% : 0.004989s : 1: type_inference TotalTime = 0.122079, [30] [bootstrap]: 0.00030775 [type_inference]: 0.111022 [event_method]: 2.112e-05 [auto_monad]: 6.946e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00055503 [rewriter_before_opt_a]: 9.379e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00762001, [2] [Cycle 1]: 0.00384834, [27] [switch_simplify]: 6.122e-05 [loop_unroll]: 3.413e-05 [a_1]: 0.00070915 [with_stream_mark]: 2.303e-05 [recompute_prepare]: 1.085e-05 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 3.91001e-06 [parameter_eliminate]: 2.06998e-06 [specialize_transform]: 7.78001e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 7.66999e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.57e-05 [j_node_and_user_rematch]: 1.028e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00265288 [add_forward_monad_depend]: 6.33998e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.668e-05 [cse]: 3.209e-05 [replace_applicator]: 1.541e-05 [Cycle 2]: 0.00040379, [27] [switch_simplify]: 2.196e-05 [loop_unroll]: 6.56e-06 [a_1]: 0.00013301 [with_stream_mark]: 1.227e-05 [recompute_prepare]: 6.74999e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.02002e-06 [cell_reuse_recompute_pass]: 2.28998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.89e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 7.05998e-06 [cse]: 1.568e-05 [replace_applicator]: 6.46e-06 [py_interpret_to_execute_after_opt_a]: 1.392e-05 [rewriter_after_opt_a]: 3.975e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.00066611 [jit_opt_b]: 6.99e-05, [1] [Cycle 1]: 5.017e-05, [2] [frontend_op_eliminate]: 1.951e-05 [inline_after_opt_a]: 1.873e-05 [cconv]: 2.699e-05 [loop_unroll]: 0.00043664 [jit_opt_after_cconv]: 0.00016379, [1] [Cycle 1]: 0.00015714, [11] [c_1]: 2.617e-05 [parameter_eliminate]: 4.06001e-06 [updatestate_depend_eliminate]: 6.51e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.672e-05 [call_graph_tuple_transform]: 2.294e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.816e-05 [partial_unused_args_eliminate]: 2.87002e-06 [environ_conv]: 8.30999e-06 [add_recomputation]: 4.8e-05 [cse_after_recomputation]: 2.458e-05, [1] [Cycle 1]: 1.909e-05, [1] [cse]: 1.309e-05 [auto_monad_reorder]: 1.779e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.28002e-06 [opt_after_jit_grad]: 0.00049804 [symbol_engine_optimizer]: 8.465e-05, [1] [Cycle 1]: 7.694e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 9.71e-06 [elim_not_effective]: 1.591e-05 [opt_reshape]: 8.78001e-06 [fold_const_symbol]: 9.37001e-06 [renormalize]: 2.19996e-07 [validate]: 5.626e-05 Sums bootstrap : 0.000308s : 0.26% type_inference : 0.111022s : 94.02% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000555s : 0.47% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000083s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000842s : 0.71% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002653s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000666s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000437s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000498s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.05% Time group info: ------[substitution.] 0.000265 28 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000002s : 2: substitution.fold_const_symbol 2.58% : 0.000007s : 4: substitution.graph_param_transform 81.84% : 0.000217s : 5: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.46% : 0.000012s : 3: substitution.reduce_eliminate 1.86% : 0.000005s : 4: substitution.remove_not_recompute_node 1.52% : 0.000004s : 2: substitution.replace_old_param 4.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110944 2 97.35% : 0.108003s : 1: type_inference.infer 2.65% : 0.002942s : 1: type_inference.specialize ------[replace.] 0.000106 7 65.99% : 0.000070s : 5: replace.inline 34.01% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000225 7 94.74% : 0.000213s : 5: match.inline 5.26% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.56% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 1.74% : 0.000003s : 13: predicate.arithmetic_simplify 1.20% : 0.000002s : 13: predicate.cast_eliminate 0.39% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.14% : 0.000002s : 13: predicate.environ_get_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.06% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.52% : 0.000004s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.02% : 0.000003s : 13: predicate.reduce_eliminate 1.28% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.09% : 0.000010s : 64: predicate.switch_simplify 1.49% : 0.000002s : 13: predicate.tile_eliminate 1.18% : 0.000002s : 13: predicate.transpose_eliminate 1.30% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.55% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 3.20% : 0.000005s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002208 25 63.07% : 0.001392s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.93% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.99% : 0.000750s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125899 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000325s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.05% : 0.007623s : 1: jit_opt_a 0.13% : 0.000166s : 1: jit_opt_after_cconv 0.06% : 0.000073s : 1: jit_opt_b 0.35% : 0.000445s : 1: loop_unroll 0.54% : 0.000676s : 1: mutable_eliminate 0.88% : 0.001104s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000507s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000562s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.51% : 0.001896s : 1: renormalize.infer 0.59% : 0.000746s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 88.19% : 0.111036s : 1: type_inference TotalTime = 0.0159321, [30] [bootstrap]: 0.00031417 [type_inference]: 0.00780296 [event_method]: 1.99e-05 [auto_monad]: 6.792e-05 [graph_reusing]: 5.42999e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 4.204e-05 [rewriter_before_opt_a]: 8.102e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00551063, [2] [Cycle 1]: 0.00183795, [27] [switch_simplify]: 5.713e-05 [loop_unroll]: 3.32e-05 [a_1]: 0.00061784 [with_stream_mark]: 1.692e-05 [recompute_prepare]: 7.8e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 4.731e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.11e-05 [inline_without_move]: 6.31998e-06 [renormalize]: 0.00073886 [add_forward_monad_depend]: 5.60001e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.394e-05 [cse]: 3.209e-05 [replace_applicator]: 1.28e-05 [Cycle 2]: 0.00033004, [27] [switch_simplify]: 5.78002e-06 [loop_unroll]: 4.99998e-06 [a_1]: 9.701e-05 [with_stream_mark]: 1.025e-05 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.67e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.071e-05 [j_node_and_user_rematch]: 8.02998e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.69999e-06 [cse]: 1.419e-05 [replace_applicator]: 5.23002e-06 [py_interpret_to_execute_after_opt_a]: 1.132e-05 [rewriter_after_opt_a]: 3.721e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00053142 [jit_opt_b]: 4.895e-05, [1] [Cycle 1]: 4.211e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 2.371e-05 [loop_unroll]: 0.00041129 [jit_opt_after_cconv]: 0.00015285, [1] [Cycle 1]: 0.00014614, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 2.17001e-06 [updatestate_depend_eliminate]: 5.64e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.108e-05 [call_graph_tuple_transform]: 2.763e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 5.55001e-06 [remove_dup_value]: 1.589e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.66e-06 [add_recomputation]: 4.667e-05 [cse_after_recomputation]: 2.391e-05, [1] [Cycle 1]: 1.808e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.724e-05 [get_jit_bprop_graph]: 2.16e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.00045665 [symbol_engine_optimizer]: 7.371e-05, [1] [Cycle 1]: 6.735e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 7.71999e-06 [elim_not_effective]: 1.296e-05 [opt_reshape]: 5.75001e-06 [fold_const_symbol]: 8.48001e-06 [renormalize]: 3.19997e-07 [validate]: 3.849e-05 Sums bootstrap : 0.000314s : 2.61% type_inference : 0.007803s : 64.95% event_method : 0.000020s : 0.17% auto_monad : 0.000068s : 0.57% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000042s : 0.35% rewriter_before_opt_a : 0.000081s : 0.67% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000063s : 0.52% jit_opt_a.loop_unroll : 0.000038s : 0.32% jit_opt_a.a_1 : 0.000715s : 5.95% jit_opt_a.with_stream_mark : 0.000027s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000055s : 0.46% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000739s : 6.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000046s : 0.39% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000037s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000531s : 4.42% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000024s : 0.20% loop_unroll : 0.000411s : 3.42% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000047s : 0.39% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000457s : 3.80% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.32% Time group info: ------[substitution.] 0.000240 27 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 3: substitution.graph_param_transform 82.50% : 0.000198s : 5: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.01% : 0.000010s : 3: substitution.reduce_eliminate 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 4.43% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007739 2 87.42% : 0.006765s : 1: type_inference.infer 12.58% : 0.000974s : 1: type_inference.specialize ------[replace.] 0.000088 7 68.48% : 0.000060s : 5: replace.inline 31.52% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 7 95.31% : 0.000194s : 5: match.inline 4.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.23% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.36% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_depend_swap 1.34% : 0.000002s : 11: predicate.environ_get_eliminate 1.24% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 24: predicate.inline 1.06% : 0.000001s : 6: predicate.inline_without_move 0.57% : 0.000001s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.36% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 16: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.57% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.00% : 0.000002s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 11: predicate.reshape_eliminate 1.56% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.78% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000746 16 50.01% : 0.000373s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.43% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.56% : 0.000318s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017708 72 0.28% : 0.000050s : 1: add_recomputation 0.40% : 0.000071s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.88% : 0.000334s : 1: bootstrap 0.15% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.14% : 0.005514s : 1: jit_opt_a 0.88% : 0.000156s : 1: jit_opt_after_cconv 0.29% : 0.000051s : 1: jit_opt_b 2.37% : 0.000419s : 1: loop_unroll 3.04% : 0.000539s : 1: mutable_eliminate 5.49% : 0.000972s : 26: opt.transform.jit_opt_a 0.32% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.62% : 0.000464s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.25% : 0.000045s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.35% : 0.000415s : 1: renormalize.infer 1.78% : 0.000316s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000040s : 1: rewriter_after_opt_a 0.47% : 0.000084s : 1: rewriter_before_opt_a 0.43% : 0.000077s : 1: symbol_engine_optimizer 44.14% : 0.007817s : 1: type_inference TotalTime = 0.12508, [30] [bootstrap]: 0.00025084 [type_inference]: 0.114746 [event_method]: 2.057e-05 [auto_monad]: 7.164e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00045116 [rewriter_before_opt_a]: 8.474e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00732862, [2] [Cycle 1]: 0.00352802, [27] [switch_simplify]: 5.795e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00060512 [with_stream_mark]: 1.575e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 3.62998e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.83e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 6.44999e-06 [renormalize]: 0.00247209 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 2.766e-05 [cse]: 2.887e-05 [replace_applicator]: 1.473e-05 [Cycle 2]: 0.00037447, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 6.69001e-06 [a_1]: 0.000124 [with_stream_mark]: 1.079e-05 [recompute_prepare]: 6.28998e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.43e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.21998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.172e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 9.54e-06 [rewriter_after_opt_a]: 3.359e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 4.63001e-06 [mutable_eliminate]: 0.00052217 [jit_opt_b]: 5.233e-05, [1] [Cycle 1]: 4.622e-05, [2] [frontend_op_eliminate]: 1.844e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 2.38e-05 [loop_unroll]: 0.00040814 [jit_opt_after_cconv]: 0.00014406, [1] [Cycle 1]: 0.00013779, [11] [c_1]: 2.506e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.04998e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.01998e-06 [cse]: 1.838e-05 [call_graph_tuple_transform]: 2.073e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.49974e-07 [switch_simplify]: 5.68002e-06 [remove_dup_value]: 1.519e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 7.16999e-06 [add_recomputation]: 4.555e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.653e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.504e-05 [get_jit_bprop_graph]: 1.73002e-06 [rewriter_after_jit_bprop_graph]: 4.13001e-06 [opt_after_jit_grad]: 0.00044824 [symbol_engine_optimizer]: 0.00013687, [1] [Cycle 1]: 6.487e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.97999e-06 [renormalize]: 3.80009e-07 [validate]: 4.02e-05 Sums bootstrap : 0.000251s : 0.21% type_inference : 0.114746s : 94.82% event_method : 0.000021s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000451s : 0.37% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000729s : 0.60% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002472s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000034s : 0.03% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000522s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000408s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000448s : 0.37% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000203 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 3.18% : 0.000006s : 4: substitution.graph_param_transform 83.18% : 0.000169s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000004s : 2: substitution.replace_old_param 5.62% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114670 2 97.58% : 0.111894s : 1: type_inference.infer 2.42% : 0.002775s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.89% : 0.000053s : 4: replace.inline 32.11% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 94.18% : 0.000166s : 4: match.inline 5.82% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.66% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000001s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.38% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.03% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.47% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.50% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002148 22 68.29% : 0.001467s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.35% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.36% : 0.000652s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128580 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.20% : 0.000263s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.70% : 0.007332s : 1: jit_opt_a 0.11% : 0.000147s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.32% : 0.000416s : 1: loop_unroll 0.41% : 0.000530s : 1: mutable_eliminate 0.75% : 0.000963s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.41% : 0.001810s : 1: renormalize.infer 0.51% : 0.000654s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000140s : 1: symbol_engine_optimizer 89.26% : 0.114765s : 1: type_inference TotalTime = 0.122595, [30] [bootstrap]: 0.0003108 [type_inference]: 0.111281 [event_method]: 2.094e-05 [auto_monad]: 5.196e-05 [graph_reusing]: 3.60998e-06 [pre_auto_parallel]: 1.77001e-06 [py_interpret_to_execute]: 0.00054673 [rewriter_before_opt_a]: 8.761e-05 [expand_dump_flag]: 2.78e-06 [jit_opt_a]: 0.00788741, [2] [Cycle 1]: 0.00405636, [27] [switch_simplify]: 6.238e-05 [loop_unroll]: 3.732e-05 [a_1]: 0.00071759 [with_stream_mark]: 1.607e-05 [recompute_prepare]: 9.67999e-06 [updatestate_depend_eliminate]: 4.28999e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.66e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 7.43999e-06 [updatestate_useless_node_eliminater]: 6.64001e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 6.76e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 1.11e-05 [inline_without_move]: 7.03998e-06 [renormalize]: 0.00285672 [add_forward_monad_depend]: 5.80002e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.483e-05 [cse]: 3.051e-05 [replace_applicator]: 1.729e-05 [Cycle 2]: 0.00039232, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.24001e-06 [a_1]: 0.00013544 [with_stream_mark]: 1.211e-05 [recompute_prepare]: 6.91999e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.66999e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 7.14001e-06 [meta_shard_fg_expand]: 1.91998e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 3.08e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.327e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.323e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.29e-05 [rewriter_after_opt_a]: 3.704e-05 [convert_after_rewriter]: 6.41998e-06 [order_py_execute_after_rewriter]: 4.74002e-06 [mutable_eliminate]: 0.00067182 [jit_opt_b]: 5.596e-05, [1] [Cycle 1]: 4.868e-05, [2] [frontend_op_eliminate]: 1.921e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 2.162e-05 [loop_unroll]: 0.00041522 [jit_opt_after_cconv]: 0.00015421, [1] [Cycle 1]: 0.0001474, [11] [c_1]: 2.532e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.32001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.77002e-06 [cse]: 2.385e-05 [call_graph_tuple_transform]: 2.14e-05 [tuple_list_get_item_eliminator]: 6.81999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.391e-05 [partial_unused_args_eliminate]: 2.11998e-06 [environ_conv]: 8.12998e-06 [add_recomputation]: 4.349e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.862e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.58e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.0004654 [symbol_engine_optimizer]: 7.499e-05, [1] [Cycle 1]: 6.875e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 9.52999e-06 [renormalize]: 4.00003e-07 [validate]: 0.00018308 Sums bootstrap : 0.000311s : 0.26% type_inference : 0.111281s : 93.87% event_method : 0.000021s : 0.02% auto_monad : 0.000052s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000547s : 0.46% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.04% jit_opt_a.a_1 : 0.000853s : 0.72% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002857s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000672s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000415s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000043s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000465s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000183s : 0.15% Time group info: ------[substitution.] 0.000256 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.39% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 4: substitution.graph_param_transform 82.33% : 0.000211s : 5: substitution.inline 1.57% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.15% : 0.000013s : 3: substitution.reduce_eliminate 1.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000005s : 2: substitution.replace_old_param 3.70% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111204 2 97.34% : 0.108241s : 1: type_inference.infer 2.66% : 0.002963s : 1: type_inference.specialize ------[replace.] 0.000102 7 67.79% : 0.000069s : 5: replace.inline 32.21% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 96.12% : 0.000208s : 5: match.inline 3.88% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 0.84% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 4.76% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.96% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 0.98% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.29% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.70% : 0.000004s : 13: predicate.reduce_eliminate 1.67% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 13: predicate.reshape_eliminate 1.43% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 2.11% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.07% : 0.000011s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.46% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.76% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002366 25 61.42% : 0.001453s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.96% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.62% : 0.000843s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126493 72 0.04% : 0.000046s : 1: add_recomputation 0.04% : 0.000056s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000329s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.24% : 0.007891s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.33% : 0.000423s : 1: loop_unroll 0.54% : 0.000681s : 1: mutable_eliminate 0.88% : 0.001112s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000553s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.57% : 0.001988s : 1: renormalize.infer 0.68% : 0.000860s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 87.99% : 0.111298s : 1: type_inference TotalTime = 0.130256, [30] [bootstrap]: 0.00027872 [type_inference]: 0.119472 [event_method]: 1.773e-05 [auto_monad]: 4.537e-05 [graph_reusing]: 3.86999e-06 [pre_auto_parallel]: 1.62001e-06 [py_interpret_to_execute]: 0.00050474 [rewriter_before_opt_a]: 7.798e-05 [expand_dump_flag]: 2.50002e-06 [jit_opt_a]: 0.00774569, [2] [Cycle 1]: 0.0035265, [27] [switch_simplify]: 4.931e-05 [loop_unroll]: 3.059e-05 [a_1]: 0.00053289 [with_stream_mark]: 1.318e-05 [recompute_prepare]: 8.59e-06 [updatestate_depend_eliminate]: 3.14001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 6.59001e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.257e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00259725 [add_forward_monad_depend]: 5.08002e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 1.299e-05 [cse]: 2.097e-05 [replace_applicator]: 1.479e-05 [Cycle 2]: 0.00035769, [27] [switch_simplify]: 6.30002e-06 [loop_unroll]: 6.16e-06 [a_1]: 0.00012164 [with_stream_mark]: 9.32001e-06 [recompute_prepare]: 5.86998e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.21998e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 5.71003e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.376e-05 [j_node_and_user_rematch]: 8.87999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.14997e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.065e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.019e-05 [rewriter_after_opt_a]: 2.896e-05 [convert_after_rewriter]: 5.95002e-06 [order_py_execute_after_rewriter]: 4.4e-06 [mutable_eliminate]: 0.00054147 [jit_opt_b]: 5.399e-05, [1] [Cycle 1]: 4.802e-05, [2] [frontend_op_eliminate]: 1.96e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 1.841e-05 [loop_unroll]: 0.00041944 [jit_opt_after_cconv]: 0.00014794, [1] [Cycle 1]: 0.00014185, [11] [c_1]: 2.632e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.992e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 1.186e-05 [partial_unused_args_eliminate]: 1.81998e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 3.833e-05 [cse_after_recomputation]: 2.189e-05, [1] [Cycle 1]: 1.689e-05, [1] [cse]: 1.125e-05 [auto_monad_reorder]: 1.203e-05 [get_jit_bprop_graph]: 1.67999e-06 [rewriter_after_jit_bprop_graph]: 4.02e-06 [opt_after_jit_grad]: 0.00045989 [symbol_engine_optimizer]: 0.00011061, [1] [Cycle 1]: 0.00010434, [6] [build]: 3.03e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 4.614e-05 [opt_reshape]: 7.5e-06 [fold_const_symbol]: 1.019e-05 [renormalize]: 4.39992e-07 [validate]: 3.639e-05 Sums bootstrap : 0.000279s : 0.22% type_inference : 0.119472s : 94.94% event_method : 0.000018s : 0.01% auto_monad : 0.000045s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000505s : 0.40% rewriter_before_opt_a : 0.000078s : 0.06% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.04% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000655s : 0.52% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002597s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000029s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000541s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000018s : 0.01% loop_unroll : 0.000419s : 0.33% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000460s : 0.37% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000046s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000168 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 3.20% : 0.000005s : 4: substitution.graph_param_transform 83.57% : 0.000140s : 4: substitution.inline 1.98% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.01% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000003s : 2: substitution.replace_old_param 4.79% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.119410 2 97.66% : 0.116613s : 1: type_inference.infer 2.34% : 0.002797s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.51% : 0.000048s : 4: replace.inline 34.49% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 95.19% : 0.000138s : 4: match.inline 4.81% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.68% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.56% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.26% : 0.000002s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.87% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.12% : 0.000009s : 58: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002275 22 67.74% : 0.001541s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.28% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.99% : 0.000705s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133843 72 0.03% : 0.000041s : 1: add_recomputation 0.04% : 0.000049s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.22% : 0.000293s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.79% : 0.007749s : 1: jit_opt_a 0.11% : 0.000151s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.32% : 0.000427s : 1: loop_unroll 0.41% : 0.000550s : 1: mutable_eliminate 0.66% : 0.000878s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000069s : 4: opt.transform.symbol_engine_opt 0.35% : 0.000468s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.38% : 0.000512s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.35% : 0.001812s : 1: renormalize.infer 0.58% : 0.000777s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000032s : 1: rewriter_after_opt_a 0.06% : 0.000083s : 1: rewriter_before_opt_a 0.08% : 0.000113s : 1: symbol_engine_optimizer 89.27% : 0.119486s : 1: type_inference TotalTime = 0.11874, [30] [bootstrap]: 0.00032085 [type_inference]: 0.107789 [event_method]: 2.127e-05 [auto_monad]: 6.856e-05 [graph_reusing]: 6.51e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00047388 [rewriter_before_opt_a]: 9.738e-05 [expand_dump_flag]: 4.12e-06 [jit_opt_a]: 0.00765388, [2] [Cycle 1]: 0.00392894, [27] [switch_simplify]: 5.96e-05 [loop_unroll]: 3.46e-05 [a_1]: 0.00066578 [with_stream_mark]: 1.782e-05 [recompute_prepare]: 8.97e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.86001e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.515e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.48998e-06 [renormalize]: 0.00280875 [add_forward_monad_depend]: 5.71e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 2.869e-05 [replace_applicator]: 1.499e-05 [Cycle 2]: 0.00038357, [27] [switch_simplify]: 7.1e-06 [loop_unroll]: 5.90002e-06 [a_1]: 0.00013207 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 6.07999e-06 [updatestate_depend_eliminate]: 4.05e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.91998e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.36e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.404e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 1.205e-05 [rewriter_after_opt_a]: 3.765e-05 [convert_after_rewriter]: 6.81999e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00057779 [jit_opt_b]: 6.647e-05, [1] [Cycle 1]: 5.961e-05, [2] [frontend_op_eliminate]: 2.915e-05 [inline_after_opt_a]: 1.887e-05 [cconv]: 2.306e-05 [loop_unroll]: 0.00042923 [jit_opt_after_cconv]: 0.00015581, [1] [Cycle 1]: 0.00014946, [11] [c_1]: 2.637e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.251e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.55002e-06 [remove_dup_value]: 1.709e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.08001e-06 [add_recomputation]: 4.835e-05 [cse_after_recomputation]: 2.355e-05, [1] [Cycle 1]: 1.733e-05, [1] [cse]: 1.18e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00048732 [symbol_engine_optimizer]: 0.00015453, [1] [Cycle 1]: 0.000148, [6] [build]: 3.53999e-06 [elim_shapecalc]: 8.54998e-06 [elim_not_effective]: 1.587e-05 [opt_reshape]: 6.46999e-06 [fold_const_symbol]: 8.388e-05 [renormalize]: 4.59986e-07 [validate]: 4.417e-05 Sums bootstrap : 0.000321s : 0.28% type_inference : 0.107789s : 93.88% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000474s : 0.41% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000798s : 0.69% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002809s : 2.45% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000578s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000029s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000429s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000487s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000084s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000244 28 1.80% : 0.000004s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000006s : 4: substitution.graph_param_transform 81.06% : 0.000197s : 5: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.73% : 0.000012s : 3: substitution.reduce_eliminate 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.62% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107714 2 97.34% : 0.104852s : 1: type_inference.infer 2.66% : 0.002862s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.37% : 0.000063s : 5: replace.inline 31.63% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 7 95.07% : 0.000194s : 5: match.inline 4.93% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.14% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.47% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.81% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.84% : 0.000004s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.90% : 0.000011s : 64: predicate.switch_simplify 1.23% : 0.000002s : 13: predicate.tile_eliminate 1.34% : 0.000002s : 13: predicate.transpose_eliminate 1.31% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.87% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002204 25 62.70% : 0.001382s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.52% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.78% : 0.000767s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122746 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000337s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.24% : 0.007658s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.06% : 0.000069s : 1: jit_opt_b 0.36% : 0.000437s : 1: loop_unroll 0.48% : 0.000586s : 1: mutable_eliminate 0.85% : 0.001040s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000111s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000480s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.66% : 0.002037s : 1: renormalize.infer 0.62% : 0.000763s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.13% : 0.000157s : 1: symbol_engine_optimizer 87.83% : 0.107806s : 1: type_inference TotalTime = 0.0480607, [30] [bootstrap]: 0.00026854 [type_inference]: 0.0392833 [event_method]: 1.775e-05 [auto_monad]: 5.351e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 1.95001e-06 [py_interpret_to_execute]: 0.00026143 [rewriter_before_opt_a]: 7.783e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00595669, [2] [Cycle 1]: 0.0023778, [27] [switch_simplify]: 4.691e-05 [loop_unroll]: 3.039e-05 [a_1]: 0.00060593 [with_stream_mark]: 1.312e-05 [recompute_prepare]: 7.78999e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.175e-05 [j_node_and_user_rematch]: 8.76002e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00138224 [add_forward_monad_depend]: 4.80001e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.237e-05 [cse]: 1.877e-05 [replace_applicator]: 1.463e-05 [Cycle 2]: 0.0003539, [27] [switch_simplify]: 6.44001e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.00011926 [with_stream_mark]: 9.27999e-06 [recompute_prepare]: 6.07001e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.49998e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 5.39e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.085e-05 [replace_applicator]: 5.66998e-06 [py_interpret_to_execute_after_opt_a]: 1.022e-05 [rewriter_after_opt_a]: 3.04e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.0005788 [jit_opt_b]: 5.371e-05, [1] [Cycle 1]: 4.756e-05, [2] [frontend_op_eliminate]: 1.895e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 1.971e-05 [loop_unroll]: 0.00041954 [jit_opt_after_cconv]: 0.00013977, [1] [Cycle 1]: 0.00013389, [11] [c_1]: 2.434e-05 [parameter_eliminate]: 2.16e-06 [updatestate_depend_eliminate]: 4.38999e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.06998e-06 [cse]: 1.749e-05 [call_graph_tuple_transform]: 1.882e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.233e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 4.90999e-06 [add_recomputation]: 3.914e-05 [cse_after_recomputation]: 2.109e-05, [1] [Cycle 1]: 1.596e-05, [1] [cse]: 1.02e-05 [auto_monad_reorder]: 3.892e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 5.61998e-06 [opt_after_jit_grad]: 0.00047564 [symbol_engine_optimizer]: 7.6e-05, [1] [Cycle 1]: 6.963e-05, [6] [build]: 2.76999e-06 [elim_shapecalc]: 7.79002e-06 [elim_not_effective]: 1.332e-05 [opt_reshape]: 6.99001e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 4.7998e-07 [validate]: 3.055e-05 Sums bootstrap : 0.000269s : 0.61% type_inference : 0.039283s : 88.70% event_method : 0.000018s : 0.04% auto_monad : 0.000054s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000261s : 0.59% rewriter_before_opt_a : 0.000078s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.12% jit_opt_a.loop_unroll : 0.000037s : 0.08% jit_opt_a.a_1 : 0.000725s : 1.64% jit_opt_a.with_stream_mark : 0.000022s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001382s : 3.12% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.04% jit_opt_a.cse : 0.000030s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.05% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000030s : 0.07% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000579s : 1.31% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000020s : 0.04% loop_unroll : 0.000420s : 0.95% jit_opt_after_cconv.c_1 : 0.000024s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000039s : 0.09% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000039s : 0.09% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000476s : 1.07% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.07% Time group info: ------[substitution.] 0.000165 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.88% : 0.000001s : 2: substitution.fold_const_symbol 3.24% : 0.000005s : 4: substitution.graph_param_transform 82.17% : 0.000136s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000003s : 2: substitution.replace_old_param 6.48% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.039218 2 95.38% : 0.037406s : 1: type_inference.infer 4.62% : 0.001812s : 1: type_inference.specialize ------[replace.] 0.000072 6 62.44% : 0.000045s : 4: replace.inline 37.56% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 93.41% : 0.000133s : 4: match.inline 6.59% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.55% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 2.39% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000001s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 2.22% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 18: predicate.load_eliminater 1.14% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000001s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000001s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.71% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001504 18 67.68% : 0.001018s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.58% : 0.000460s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.050463 72 0.08% : 0.000042s : 1: add_recomputation 0.11% : 0.000057s : 1: auto_monad 0.08% : 0.000042s : 1: auto_monad_reorder 0.55% : 0.000279s : 1: bootstrap 0.04% : 0.000022s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 11.81% : 0.005960s : 1: jit_opt_a 0.28% : 0.000142s : 1: jit_opt_after_cconv 0.11% : 0.000056s : 1: jit_opt_b 0.84% : 0.000426s : 1: loop_unroll 1.16% : 0.000587s : 1: mutable_eliminate 1.87% : 0.000943s : 26: opt.transform.jit_opt_a 0.10% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.96% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.53% : 0.000268s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000015s : 1: remove_dup_value 1.76% : 0.000887s : 1: renormalize.infer 0.97% : 0.000488s : 1: renormalize.specialize 0.02% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000033s : 1: rewriter_after_opt_a 0.16% : 0.000082s : 1: rewriter_before_opt_a 0.16% : 0.000078s : 1: symbol_engine_optimizer 77.87% : 0.039296s : 1: type_inference TotalTime = 0.0173045, [30] [bootstrap]: 0.0003374 [type_inference]: 0.00869309 [event_method]: 2.062e-05 [auto_monad]: 7.119e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 4.775e-05 [rewriter_before_opt_a]: 8.919e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00580541, [2] [Cycle 1]: 0.00195097, [27] [switch_simplify]: 6.71e-05 [loop_unroll]: 3.345e-05 [a_1]: 0.00064636 [with_stream_mark]: 1.863e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.42002e-06 [updatestate_loads_eliminate]: 3.7e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.17e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.68002e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.80002e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00084047 [add_forward_monad_depend]: 6.11e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.53e-05 [cse]: 3.499e-05 [replace_applicator]: 1.359e-05 [Cycle 2]: 0.00033928, [27] [switch_simplify]: 6.22001e-06 [loop_unroll]: 5.02e-06 [a_1]: 9.944e-05 [with_stream_mark]: 1.07e-05 [recompute_prepare]: 6.13998e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.83002e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 3.34001e-06 [cell_reuse_recompute_pass]: 2.15002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.106e-05 [j_node_and_user_rematch]: 7.93001e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.99978e-07 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.351e-05 [replace_applicator]: 5.43002e-06 [py_interpret_to_execute_after_opt_a]: 1.221e-05 [rewriter_after_opt_a]: 3.828e-05 [convert_after_rewriter]: 7.49002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00058375 [jit_opt_b]: 5.025e-05, [1] [Cycle 1]: 4.348e-05, [2] [frontend_op_eliminate]: 1.565e-05 [inline_after_opt_a]: 1.652e-05 [cconv]: 2.281e-05 [loop_unroll]: 0.00042817 [jit_opt_after_cconv]: 0.00016373, [1] [Cycle 1]: 0.00015669, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 1.81003e-06 [updatestate_depend_eliminate]: 4.67e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.661e-05 [call_graph_tuple_transform]: 2.005e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.605e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.44001e-06 [add_recomputation]: 5.085e-05 [cse_after_recomputation]: 2.443e-05, [1] [Cycle 1]: 1.882e-05, [1] [cse]: 1.254e-05 [auto_monad_reorder]: 1.73e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.97999e-06 [opt_after_jit_grad]: 0.00051572 [symbol_engine_optimizer]: 7.256e-05, [1] [Cycle 1]: 6.668e-05, [6] [build]: 3.07002e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.211e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 4.89992e-07 [validate]: 3.994e-05 Sums bootstrap : 0.000337s : 2.56% type_inference : 0.008693s : 65.86% event_method : 0.000021s : 0.16% auto_monad : 0.000071s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000048s : 0.36% rewriter_before_opt_a : 0.000089s : 0.68% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.56% jit_opt_a.loop_unroll : 0.000038s : 0.29% jit_opt_a.a_1 : 0.000746s : 5.65% jit_opt_a.with_stream_mark : 0.000029s : 0.22% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000841s : 6.37% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.16% jit_opt_a.cse : 0.000048s : 0.37% jit_opt_a.replace_applicator : 0.000019s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.09% rewriter_after_opt_a : 0.000038s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000584s : 4.42% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000017s : 0.13% cconv : 0.000023s : 0.17% loop_unroll : 0.000428s : 3.24% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000051s : 0.39% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000516s : 3.91% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.30% Time group info: ------[substitution.] 0.000259 27 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 3: substitution.graph_param_transform 82.32% : 0.000213s : 5: substitution.inline 1.36% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.11% : 0.000011s : 3: substitution.reduce_eliminate 2.00% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000005s : 2: substitution.replace_old_param 4.44% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008620 2 87.51% : 0.007544s : 1: type_inference.infer 12.49% : 0.001076s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.51% : 0.000063s : 5: replace.inline 32.49% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000221 7 95.27% : 0.000210s : 5: match.inline 4.73% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.64% : 0.000002s : 11: predicate.addn_zero_filter 2.21% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.32% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.71% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 11: predicate.environ_get_depend_swap 1.46% : 0.000002s : 11: predicate.environ_get_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 16: predicate.load_eliminater 1.02% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.08% : 0.000001s : 11: predicate.minmaximum_grad 1.23% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000001s : 11: predicate.print_const_string_wrapper 2.36% : 0.000003s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.25% : 0.000000s : 3: predicate.reset_defer_inline 1.53% : 0.000002s : 11: predicate.reshape_eliminate 1.21% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.84% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.23% : 0.000010s : 59: predicate.switch_simplify 1.40% : 0.000002s : 11: predicate.tile_eliminate 1.21% : 0.000002s : 11: predicate.transpose_eliminate 1.54% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 11: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000810 16 51.02% : 0.000413s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.87% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.11% : 0.000333s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019172 72 0.28% : 0.000054s : 1: add_recomputation 0.39% : 0.000075s : 1: auto_monad 0.10% : 0.000020s : 1: auto_monad_reorder 1.84% : 0.000352s : 1: bootstrap 0.13% : 0.000026s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000025s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000009s : 1: graph_reusing 30.30% : 0.005809s : 1: jit_opt_a 0.87% : 0.000167s : 1: jit_opt_after_cconv 0.27% : 0.000053s : 1: jit_opt_b 2.27% : 0.000435s : 1: loop_unroll 3.08% : 0.000590s : 1: mutable_eliminate 5.10% : 0.000978s : 26: opt.transform.jit_opt_a 0.26% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.06% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000012s : 1: opt.transform.mutable_eliminate 0.10% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.72% : 0.000522s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000051s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.55% : 0.000488s : 1: renormalize.infer 1.79% : 0.000343s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000041s : 1: rewriter_after_opt_a 0.48% : 0.000092s : 1: rewriter_before_opt_a 0.39% : 0.000075s : 1: symbol_engine_optimizer 45.43% : 0.008709s : 1: type_inference TotalTime = 0.0141992, [30] [bootstrap]: 0.0003191 [type_inference]: 0.00474662 [event_method]: 1.692e-05 [auto_monad]: 4.505e-05 [graph_reusing]: 3.85998e-06 [pre_auto_parallel]: 1.87001e-06 [py_interpret_to_execute]: 3.659e-05 [rewriter_before_opt_a]: 6.432e-05 [expand_dump_flag]: 2.32999e-06 [jit_opt_a]: 0.00686896, [2] [Cycle 1]: 0.00166477, [27] [switch_simplify]: 4.675e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.0005229 [with_stream_mark]: 1.422e-05 [recompute_prepare]: 6.65002e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.64998e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.09e-05 [j_node_and_user_rematch]: 9.21002e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00072419 [add_forward_monad_depend]: 3.84002e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 1.176e-05 [cse]: 1.554e-05 [replace_applicator]: 1.089e-05 [Cycle 2]: 0.00031489, [27] [switch_simplify]: 5.39998e-06 [loop_unroll]: 4.85001e-06 [a_1]: 9.026e-05 [with_stream_mark]: 8.92999e-06 [recompute_prepare]: 4.74998e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 1.98997e-06 [parameter_eliminate]: 8.2e-07 [specialize_transform]: 4.95999e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 4.97999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 7.73999e-06 [meta_fg_expand]: 1.56002e-06 [replace_old_param]: 7.10998e-06 [inline_without_move]: 4.53999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.092e-05 [replace_applicator]: 5.15001e-06 [py_interpret_to_execute_after_opt_a]: 9.89999e-06 [rewriter_after_opt_a]: 3.053e-05 [convert_after_rewriter]: 6.18002e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.0005345 [jit_opt_b]: 4.953e-05, [1] [Cycle 1]: 4.373e-05, [2] [frontend_op_eliminate]: 1.642e-05 [inline_after_opt_a]: 1.579e-05 [cconv]: 1.924e-05 [loop_unroll]: 0.00042416 [jit_opt_after_cconv]: 0.0001403, [1] [Cycle 1]: 0.0001345, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 1.96e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.43998e-06 [cse]: 1.934e-05 [call_graph_tuple_transform]: 1.875e-05 [tuple_list_get_item_eliminator]: 5.68002e-06 [none_parameter_eliminate]: 1.11002e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.195e-05 [partial_unused_args_eliminate]: 1.92999e-06 [environ_conv]: 4.43001e-06 [add_recomputation]: 3.914e-05 [cse_after_recomputation]: 2.155e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.046e-05 [auto_monad_reorder]: 1.342e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 4.76002e-06 [opt_after_jit_grad]: 0.00049259 [symbol_engine_optimizer]: 7.264e-05, [1] [Cycle 1]: 6.683e-05, [6] [build]: 2.59999e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.369e-05 [opt_reshape]: 5.89999e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 4.19997e-07 [validate]: 3.565e-05 Sums bootstrap : 0.000319s : 3.67% type_inference : 0.004747s : 54.54% event_method : 0.000017s : 0.19% auto_monad : 0.000045s : 0.52% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.42% rewriter_before_opt_a : 0.000064s : 0.74% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000052s : 0.60% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000613s : 7.05% jit_opt_a.with_stream_mark : 0.000023s : 0.27% jit_opt_a.recompute_prepare : 0.000011s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000724s : 8.32% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.20% jit_opt_a.cse : 0.000026s : 0.30% jit_opt_a.replace_applicator : 0.000016s : 0.18% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000031s : 0.35% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000534s : 6.14% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000019s : 0.22% loop_unroll : 0.000424s : 4.87% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000012s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000039s : 0.45% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000013s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000493s : 5.66% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.41% Time group info: ------[substitution.] 0.000190 23 1.17% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000005s : 3: substitution.graph_param_transform 84.35% : 0.000160s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000003s : 2: substitution.replace_old_param 5.20% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004688 2 81.64% : 0.003827s : 1: type_inference.infer 18.36% : 0.000861s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.98% : 0.000049s : 4: replace.inline 32.02% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 94.75% : 0.000158s : 4: match.inline 5.25% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.39% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 2.26% : 0.000003s : 10: predicate.arithmetic_simplify 1.57% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.72% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.20% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 4.96% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.15% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.34% : 0.000002s : 10: predicate.merge_addn 1.28% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000002s : 15: predicate.partial_eliminate 1.42% : 0.000002s : 10: predicate.print_const_string_wrapper 2.47% : 0.000003s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.83% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.95% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.27% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.42% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000608 13 48.64% : 0.000296s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.49% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.87% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015782 72 0.27% : 0.000042s : 1: add_recomputation 0.31% : 0.000048s : 1: auto_monad 0.10% : 0.000016s : 1: auto_monad_reorder 2.14% : 0.000337s : 1: bootstrap 0.14% : 0.000022s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.13% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 43.55% : 0.006872s : 1: jit_opt_a 0.91% : 0.000144s : 1: jit_opt_after_cconv 0.33% : 0.000052s : 1: jit_opt_b 2.72% : 0.000430s : 1: loop_unroll 3.43% : 0.000541s : 1: mutable_eliminate 5.16% : 0.000814s : 26: opt.transform.jit_opt_a 0.30% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000012s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.17% : 0.000500s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000039s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000014s : 1: remove_dup_value 2.46% : 0.000387s : 1: renormalize.infer 2.09% : 0.000330s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000033s : 1: rewriter_after_opt_a 0.43% : 0.000067s : 1: rewriter_before_opt_a 0.48% : 0.000076s : 1: symbol_engine_optimizer 30.16% : 0.004759s : 1: type_inference TotalTime = 0.0136753, [30] [bootstrap]: 0.00030197 [type_inference]: 0.00537773 [event_method]: 1.66e-05 [auto_monad]: 6.392e-05 [graph_reusing]: 6.36998e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 4.47e-05 [rewriter_before_opt_a]: 7.626e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00556466, [2] [Cycle 1]: 0.00180512, [27] [switch_simplify]: 5.834e-05 [loop_unroll]: 2.911e-05 [a_1]: 0.00054038 [with_stream_mark]: 1.867e-05 [recompute_prepare]: 8.67998e-06 [updatestate_depend_eliminate]: 3.86001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 2.61e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.83997e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 4.03001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.409e-05 [j_node_and_user_rematch]: 9.14998e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 0.00077322 [add_forward_monad_depend]: 6.48e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 3.17e-05 [replace_applicator]: 1.656e-05 [Cycle 2]: 0.00033112, [27] [switch_simplify]: 5.74999e-06 [loop_unroll]: 5.39998e-06 [a_1]: 9.726e-05 [with_stream_mark]: 9.71e-06 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.61003e-06 [meta_shard_fg_expand]: 1.49998e-06 [get_grad_eliminate_]: 4.67998e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.34003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 8.13001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 7.11001e-06 [inline_without_move]: 4.57998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.69998e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.093e-05 [replace_applicator]: 5.21002e-06 [py_interpret_to_execute_after_opt_a]: 1.023e-05 [rewriter_after_opt_a]: 3.543e-05 [convert_after_rewriter]: 7.33999e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00058235 [jit_opt_b]: 5.025e-05, [1] [Cycle 1]: 4.372e-05, [2] [frontend_op_eliminate]: 1.647e-05 [inline_after_opt_a]: 1.556e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00047123 [jit_opt_after_cconv]: 0.00015214, [1] [Cycle 1]: 0.00014571, [11] [c_1]: 2.17e-05 [parameter_eliminate]: 3.59002e-06 [updatestate_depend_eliminate]: 6.58003e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.673e-05 [call_graph_tuple_transform]: 1.925e-05 [tuple_list_get_item_eliminator]: 5.71998e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.664e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 6.16e-06 [add_recomputation]: 6.489e-05 [cse_after_recomputation]: 2.408e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 2.615e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.37001e-06 [opt_after_jit_grad]: 0.00044454 [symbol_engine_optimizer]: 7.206e-05, [1] [Cycle 1]: 6.634e-05, [6] [build]: 3.99997e-06 [elim_shapecalc]: 7.28e-06 [elim_not_effective]: 1.262e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 5.00004e-07 [validate]: 3.831e-05 Sums bootstrap : 0.000302s : 3.14% type_inference : 0.005378s : 55.88% event_method : 0.000017s : 0.17% auto_monad : 0.000064s : 0.66% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.46% rewriter_before_opt_a : 0.000076s : 0.79% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000064s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.36% jit_opt_a.a_1 : 0.000638s : 6.63% jit_opt_a.with_stream_mark : 0.000028s : 0.29% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.16% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000773s : 8.03% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.23% jit_opt_a.cse : 0.000043s : 0.44% jit_opt_a.replace_applicator : 0.000022s : 0.23% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000035s : 0.37% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000582s : 6.05% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.16% cconv : 0.000029s : 0.30% loop_unroll : 0.000471s : 4.90% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000065s : 0.67% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000026s : 0.27% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000445s : 4.62% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000038s : 0.40% Time group info: ------[substitution.] 0.000200 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.87% : 0.000002s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 3: substitution.graph_param_transform 81.91% : 0.000164s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 6.84% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005313 2 80.58% : 0.004281s : 1: type_inference.infer 19.42% : 0.001032s : 1: type_inference.specialize ------[replace.] 0.000079 6 65.72% : 0.000052s : 4: replace.inline 34.28% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 92.75% : 0.000161s : 4: match.inline 7.25% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.22% : 0.000003s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.22% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 6.28% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.90% : 0.000002s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 15: predicate.load_eliminater 1.59% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 2.54% : 0.000003s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000737 13 53.12% : 0.000391s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.69% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.18% : 0.000318s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015367 72 0.44% : 0.000068s : 1: add_recomputation 0.44% : 0.000067s : 1: auto_monad 0.19% : 0.000029s : 1: auto_monad_reorder 2.09% : 0.000321s : 1: bootstrap 0.20% : 0.000031s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000020s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.23% : 0.005568s : 1: jit_opt_a 1.01% : 0.000155s : 1: jit_opt_after_cconv 0.35% : 0.000053s : 1: jit_opt_b 3.13% : 0.000481s : 1: loop_unroll 3.85% : 0.000592s : 1: mutable_eliminate 5.57% : 0.000857s : 26: opt.transform.jit_opt_a 0.32% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.96% : 0.000454s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.70% : 0.000415s : 1: renormalize.infer 2.27% : 0.000349s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000038s : 1: rewriter_after_opt_a 0.52% : 0.000079s : 1: rewriter_before_opt_a 0.49% : 0.000075s : 1: symbol_engine_optimizer 35.08% : 0.005391s : 1: type_inference TotalTime = 0.127225, [30] [bootstrap]: 0.00030384 [type_inference]: 0.11444 [event_method]: 2.511e-05 [auto_monad]: 7.653e-05 [graph_reusing]: 6.05002e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 0.00057524 [rewriter_before_opt_a]: 0.00011567 [expand_dump_flag]: 4.08999e-06 [jit_opt_a]: 0.00897341, [2] [Cycle 1]: 0.00433109, [27] [switch_simplify]: 6.267e-05 [loop_unroll]: 3.459e-05 [a_1]: 0.00073406 [with_stream_mark]: 2.06e-05 [recompute_prepare]: 2.974e-05 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.58998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.37002e-06 [updatestate_useless_node_eliminater]: 6.46999e-06 [accelerated_algorithm]: 7.23e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.242e-05 [j_node_and_user_rematch]: 1.045e-05 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 9.81e-06 [inline_without_move]: 6.05002e-06 [renormalize]: 0.00307508 [add_forward_monad_depend]: 8.40001e-06 [auto_monad_grad]: 2.25002e-06 [auto_monad_eliminator]: 1.789e-05 [cse]: 3.561e-05 [replace_applicator]: 2.209e-05 [Cycle 2]: 0.00041369, [27] [switch_simplify]: 6.91001e-06 [loop_unroll]: 6.38e-06 [a_1]: 0.00014232 [with_stream_mark]: 1.533e-05 [recompute_prepare]: 6.48e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.16998e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 4e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.26998e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 7.20998e-06 [cse]: 1.485e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 1.611e-05 [rewriter_after_opt_a]: 4.01e-05 [convert_after_rewriter]: 7.82e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.0007634 [jit_opt_b]: 6.849e-05, [1] [Cycle 1]: 6.019e-05, [2] [frontend_op_eliminate]: 1.918e-05 [inline_after_opt_a]: 2.123e-05 [cconv]: 2.764e-05 [loop_unroll]: 0.00048522 [jit_opt_after_cconv]: 0.0001745, [1] [Cycle 1]: 0.00016739, [11] [c_1]: 2.668e-05 [parameter_eliminate]: 3.71001e-06 [updatestate_depend_eliminate]: 6.24999e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 3.75e-06 [cse]: 3.58e-05 [call_graph_tuple_transform]: 2.203e-05 [tuple_list_get_item_eliminator]: 7.41001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.58e-06 [remove_dup_value]: 1.747e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 9.24e-06 [add_recomputation]: 4.775e-05 [cse_after_recomputation]: 3.087e-05, [1] [Cycle 1]: 2.513e-05, [1] [cse]: 1.806e-05 [auto_monad_reorder]: 1.768e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 6.56999e-06 [opt_after_jit_grad]: 0.00051067 [symbol_engine_optimizer]: 8.568e-05, [1] [Cycle 1]: 7.94e-05, [6] [build]: 4.59998e-06 [elim_shapecalc]: 1.02e-05 [elim_not_effective]: 1.775e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 1.135e-05 [renormalize]: 8.00006e-07 [validate]: 5.313e-05 Sums bootstrap : 0.000304s : 0.25% type_inference : 0.114440s : 93.64% event_method : 0.000025s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000575s : 0.47% rewriter_before_opt_a : 0.000116s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000876s : 0.72% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000036s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003075s : 2.52% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000763s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000485s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000018s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000511s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000053s : 0.04% Time group info: ------[substitution.] 0.000299 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 1.99% : 0.000006s : 4: substitution.graph_param_transform 83.41% : 0.000249s : 5: substitution.inline 1.62% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.74% : 0.000014s : 3: substitution.reduce_eliminate 1.59% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 3.77% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114352 2 97.39% : 0.111366s : 1: type_inference.infer 2.61% : 0.002985s : 1: type_inference.specialize ------[replace.] 0.000107 7 68.72% : 0.000073s : 5: replace.inline 31.28% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000257 7 96.05% : 0.000246s : 5: match.inline 3.95% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.59% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.64% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.63% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000003s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 2.09% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.41% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.32% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.88% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002486 25 63.66% : 0.001583s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.20% : 0.000080s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.13% : 0.000824s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131392 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000319s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.83% : 0.008977s : 1: jit_opt_a 0.14% : 0.000178s : 1: jit_opt_after_cconv 0.05% : 0.000071s : 1: jit_opt_b 0.38% : 0.000494s : 1: loop_unroll 0.59% : 0.000773s : 1: mutable_eliminate 0.88% : 0.001151s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000520s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000584s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.65% : 0.002174s : 1: renormalize.infer 0.68% : 0.000890s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.09% : 0.000122s : 1: rewriter_before_opt_a 0.07% : 0.000088s : 1: symbol_engine_optimizer 87.12% : 0.114464s : 1: type_inference TotalTime = 0.129609, [30] [bootstrap]: 0.00026823 [type_inference]: 0.118414 [event_method]: 2.242e-05 [auto_monad]: 7.088e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.94001e-06 [py_interpret_to_execute]: 0.00046744 [rewriter_before_opt_a]: 9.127e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.00781361, [2] [Cycle 1]: 0.00381972, [27] [switch_simplify]: 6.108e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.00059392 [with_stream_mark]: 1.804e-05 [recompute_prepare]: 9.45001e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 7.06001e-06 [updatestate_useless_node_eliminater]: 6.20002e-06 [accelerated_algorithm]: 6.61999e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 4.33001e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.618e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 1.103e-05 [inline_without_move]: 7.05e-06 [renormalize]: 0.00274212 [add_forward_monad_depend]: 9.07999e-06 [auto_monad_grad]: 2.33002e-06 [auto_monad_eliminator]: 1.981e-05 [cse]: 3.255e-05 [replace_applicator]: 2.055e-05 [Cycle 2]: 0.00039564, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.81999e-06 [a_1]: 0.00012752 [with_stream_mark]: 1.355e-05 [recompute_prepare]: 6.65998e-06 [updatestate_depend_eliminate]: 3.45998e-06 [updatestate_assign_eliminate]: 2.75002e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 6.01998e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 3.41001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.825e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 1.047e-05 [inline_without_move]: 6.36998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 1.35001e-06 [auto_monad_eliminator]: 6.53003e-06 [cse]: 1.252e-05 [replace_applicator]: 6.26998e-06 [py_interpret_to_execute_after_opt_a]: 1.3e-05 [rewriter_after_opt_a]: 3.815e-05 [convert_after_rewriter]: 7.21999e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00072885 [jit_opt_b]: 5.926e-05, [1] [Cycle 1]: 5.17e-05, [2] [frontend_op_eliminate]: 2.156e-05 [inline_after_opt_a]: 1.81e-05 [cconv]: 2.881e-05 [loop_unroll]: 0.0004511 [jit_opt_after_cconv]: 0.00016283, [1] [Cycle 1]: 0.00015629, [11] [c_1]: 2.639e-05 [parameter_eliminate]: 3.52002e-06 [updatestate_depend_eliminate]: 6.89001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 4.01001e-06 [cse]: 2.637e-05 [call_graph_tuple_transform]: 2.228e-05 [tuple_list_get_item_eliminator]: 6.04001e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 5.40022e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.475e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 9.12001e-06 [add_recomputation]: 4.923e-05 [cse_after_recomputation]: 2.401e-05, [1] [Cycle 1]: 1.865e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.602e-05 [get_jit_bprop_graph]: 2.84001e-06 [rewriter_after_jit_bprop_graph]: 5.61998e-06 [opt_after_jit_grad]: 0.00051555 [symbol_engine_optimizer]: 8.349e-05, [1] [Cycle 1]: 7.673e-05, [6] [build]: 4.08001e-06 [elim_shapecalc]: 9.52999e-06 [elim_not_effective]: 1.477e-05 [opt_reshape]: 6.45002e-06 [fold_const_symbol]: 1.327e-05 [renormalize]: 3.09985e-07 [validate]: 4.623e-05 Sums bootstrap : 0.000268s : 0.21% type_inference : 0.118414s : 94.43% event_method : 0.000022s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000467s : 0.37% rewriter_before_opt_a : 0.000091s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000721s : 0.58% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002742s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000729s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000029s : 0.02% loop_unroll : 0.000451s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000516s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000219 24 1.66% : 0.000004s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 3.05% : 0.000007s : 4: substitution.graph_param_transform 81.71% : 0.000179s : 4: substitution.inline 1.70% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.76% : 0.000006s : 4: substitution.remove_not_recompute_node 2.60% : 0.000006s : 2: substitution.replace_old_param 6.00% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.118331 2 97.44% : 0.115298s : 1: type_inference.infer 2.56% : 0.003033s : 1: type_inference.specialize ------[replace.] 0.000081 6 66.67% : 0.000054s : 4: replace.inline 33.33% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 93.64% : 0.000176s : 4: match.inline 6.36% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 12: predicate.addn_check_dump 1.64% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.83% : 0.000003s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.07% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 26: predicate.inline 1.15% : 0.000002s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.32% : 0.000002s : 12: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.79% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.04% : 0.000001s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.22% : 0.000003s : 22: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.24% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.46% : 0.000010s : 58: predicate.switch_simplify 1.14% : 0.000002s : 12: predicate.tile_eliminate 1.42% : 0.000002s : 12: predicate.transpose_eliminate 1.67% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002376 22 67.42% : 0.001602s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.27% : 0.000743s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.133405 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.21% : 0.000280s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.86% : 0.007817s : 1: jit_opt_a 0.12% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.35% : 0.000461s : 1: loop_unroll 0.55% : 0.000739s : 1: mutable_eliminate 0.73% : 0.000977s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.41% : 0.001886s : 1: renormalize.infer 0.63% : 0.000845s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000097s : 1: rewriter_before_opt_a 0.06% : 0.000086s : 1: symbol_engine_optimizer 88.78% : 0.118434s : 1: type_inference TotalTime = 0.123531, [30] [bootstrap]: 0.00031818 [type_inference]: 0.112663 [event_method]: 2.149e-05 [auto_monad]: 7.179e-05 [graph_reusing]: 6.33998e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00049778 [rewriter_before_opt_a]: 9.747e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.00757221, [2] [Cycle 1]: 0.00373036, [27] [switch_simplify]: 6.085e-05 [loop_unroll]: 3.486e-05 [a_1]: 0.00067483 [with_stream_mark]: 1.829e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.56999e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 7.78999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.18002e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.39001e-06 [renormalize]: 0.00260967 [add_forward_monad_depend]: 5.37999e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 1.285e-05 [cse]: 2.5e-05 [replace_applicator]: 1.486e-05 [Cycle 2]: 0.00037516, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.23002e-06 [a_1]: 0.00013218 [with_stream_mark]: 1.036e-05 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.49999e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.142e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.408e-05 [replace_applicator]: 5.99e-06 [py_interpret_to_execute_after_opt_a]: 1.08e-05 [rewriter_after_opt_a]: 3.06e-05 [convert_after_rewriter]: 5.71e-06 [order_py_execute_after_rewriter]: 4.31002e-06 [mutable_eliminate]: 0.00057399 [jit_opt_b]: 6.257e-05, [1] [Cycle 1]: 5.541e-05, [2] [frontend_op_eliminate]: 2.657e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 1.814e-05 [loop_unroll]: 0.00043048 [jit_opt_after_cconv]: 0.00015399, [1] [Cycle 1]: 0.00014761, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 2.28998e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.343e-05 [call_graph_tuple_transform]: 2.029e-05 [tuple_list_get_item_eliminator]: 6.10002e-06 [none_parameter_eliminate]: 1.14998e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.236e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 7.23e-06 [add_recomputation]: 3.605e-05 [cse_after_recomputation]: 3.461e-05, [1] [Cycle 1]: 2.933e-05, [1] [cse]: 2.325e-05 [auto_monad_reorder]: 1.24e-05 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4.33999e-06 [opt_after_jit_grad]: 0.0004773 [symbol_engine_optimizer]: 0.00017663, [1] [Cycle 1]: 0.00017001, [6] [build]: 2.76e-06 [elim_shapecalc]: 8.69998e-06 [elim_not_effective]: 1.505e-05 [opt_reshape]: 0.00010368 [fold_const_symbol]: 1.094e-05 [renormalize]: 3.89991e-07 [validate]: 4.211e-05 Sums bootstrap : 0.000318s : 0.27% type_inference : 0.112663s : 94.30% event_method : 0.000021s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000498s : 0.42% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000807s : 0.68% jit_opt_a.with_stream_mark : 0.000029s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002610s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000574s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000018s : 0.02% loop_unroll : 0.000430s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000023s : 0.02% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000477s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000104s : 0.09% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000246 28 0.64% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.16% : 0.000005s : 4: substitution.graph_param_transform 83.41% : 0.000205s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.44% : 0.000011s : 3: substitution.reduce_eliminate 1.71% : 0.000004s : 4: substitution.remove_not_recompute_node 1.50% : 0.000004s : 2: substitution.replace_old_param 4.38% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112585 2 97.41% : 0.109664s : 1: type_inference.infer 2.59% : 0.002921s : 1: type_inference.specialize ------[replace.] 0.000099 7 67.55% : 0.000067s : 5: replace.inline 32.45% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000212 7 95.53% : 0.000202s : 5: match.inline 4.47% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 1.74% : 0.000002s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.36% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 19: predicate.load_eliminater 1.08% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.95% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.47% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 64: predicate.switch_simplify 1.53% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.56% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002321 25 63.98% : 0.001485s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.61% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.41% : 0.000775s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127370 72 0.03% : 0.000040s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.26% : 0.000332s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000037s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.95% : 0.007576s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.34% : 0.000438s : 1: loop_unroll 0.46% : 0.000583s : 1: mutable_eliminate 0.82% : 0.001048s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000038s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000133s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000504s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.44% : 0.001837s : 1: renormalize.infer 0.60% : 0.000764s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000103s : 1: rewriter_before_opt_a 0.14% : 0.000179s : 1: symbol_engine_optimizer 88.47% : 0.112680s : 1: type_inference TotalTime = 0.0156427, [30] [bootstrap]: 0.00027931 [type_inference]: 0.00766171 [event_method]: 2.151e-05 [auto_monad]: 6.878e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.86999e-06 [py_interpret_to_execute]: 4.757e-05 [rewriter_before_opt_a]: 8.623e-05 [expand_dump_flag]: 3.13998e-06 [jit_opt_a]: 0.00527332, [2] [Cycle 1]: 0.0017152, [27] [switch_simplify]: 5.863e-05 [loop_unroll]: 3.279e-05 [a_1]: 0.0005989 [with_stream_mark]: 1.652e-05 [recompute_prepare]: 7.92998e-06 [updatestate_depend_eliminate]: 3.77998e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 2.12001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00068291 [add_forward_monad_depend]: 5.17999e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.431e-05 [cse]: 2.777e-05 [replace_applicator]: 1.245e-05 [Cycle 2]: 0.00032222, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.56e-05 [with_stream_mark]: 9.62999e-06 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 2.88998e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 7.80012e-07 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.07e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.061e-05 [j_node_and_user_rematch]: 7.8e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 6.98e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 5.90022e-07 [auto_monad_eliminator]: 5.93002e-06 [cse]: 1.256e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 1.133e-05 [rewriter_after_opt_a]: 3.555e-05 [convert_after_rewriter]: 6.43e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00053787 [jit_opt_b]: 5.169e-05, [1] [Cycle 1]: 4.499e-05, [2] [frontend_op_eliminate]: 1.648e-05 [inline_after_opt_a]: 1.702e-05 [cconv]: 2.444e-05 [loop_unroll]: 0.00048652 [jit_opt_after_cconv]: 0.00014572, [1] [Cycle 1]: 0.00013947, [11] [c_1]: 2.162e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.265e-05 [call_graph_tuple_transform]: 1.956e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.48002e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.634e-05 [partial_unused_args_eliminate]: 1.193e-05 [environ_conv]: 6.02001e-06 [add_recomputation]: 4.732e-05 [cse_after_recomputation]: 2.354e-05, [1] [Cycle 1]: 1.793e-05, [1] [cse]: 1.201e-05 [auto_monad_reorder]: 1.67e-05 [get_jit_bprop_graph]: 1.56998e-06 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.00047321 [symbol_engine_optimizer]: 7.702e-05, [1] [Cycle 1]: 6.985e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 8.44002e-06 [elim_not_effective]: 1.377e-05 [opt_reshape]: 6.07999e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 3.50003e-07 [validate]: 3.903e-05 Sums bootstrap : 0.000279s : 2.36% type_inference : 0.007662s : 64.77% event_method : 0.000022s : 0.18% auto_monad : 0.000069s : 0.58% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000048s : 0.40% rewriter_before_opt_a : 0.000086s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.54% jit_opt_a.loop_unroll : 0.000038s : 0.32% jit_opt_a.a_1 : 0.000694s : 5.87% jit_opt_a.with_stream_mark : 0.000026s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000683s : 5.77% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.17% jit_opt_a.cse : 0.000040s : 0.34% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000036s : 0.30% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000538s : 4.55% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000017s : 0.14% cconv : 0.000024s : 0.21% loop_unroll : 0.000487s : 4.11% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000012s : 0.10% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000047s : 0.40% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000473s : 4.00% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.33% Time group info: ------[substitution.] 0.000223 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 3: substitution.graph_param_transform 82.52% : 0.000184s : 5: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.38% : 0.000010s : 3: substitution.reduce_eliminate 1.87% : 0.000004s : 4: substitution.remove_not_recompute_node 1.60% : 0.000004s : 2: substitution.replace_old_param 4.54% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007591 2 86.93% : 0.006599s : 1: type_inference.infer 13.07% : 0.000992s : 1: type_inference.specialize ------[replace.] 0.000084 7 67.52% : 0.000057s : 5: replace.inline 32.48% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 7 95.25% : 0.000181s : 5: match.inline 4.75% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.33% : 0.000002s : 11: predicate.accumulaten_eliminater 1.27% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.28% : 0.000002s : 11: predicate.addn_zero_filter 1.82% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 11: predicate.compare_switch_simplify 1.21% : 0.000001s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 3: predicate.elim_not_effective 0.81% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.27% : 0.000002s : 11: predicate.environ_get_depend_swap 1.48% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000007s : 24: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.34% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.68% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.10% : 0.000001s : 11: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.65% : 0.000003s : 16: predicate.partial_eliminate 1.28% : 0.000002s : 11: predicate.print_const_string_wrapper 2.00% : 0.000002s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.57% : 0.000002s : 11: predicate.reshape_eliminate 1.22% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.75% : 0.000010s : 59: predicate.switch_simplify 1.42% : 0.000002s : 11: predicate.tile_eliminate 1.38% : 0.000002s : 11: predicate.transpose_eliminate 1.57% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000786 16 51.67% : 0.000406s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.83% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.50% : 0.000326s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017298 72 0.29% : 0.000051s : 1: add_recomputation 0.42% : 0.000072s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 1.69% : 0.000293s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.50% : 0.005276s : 1: jit_opt_a 0.86% : 0.000148s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.86% : 0.000495s : 1: loop_unroll 3.16% : 0.000546s : 1: mutable_eliminate 5.26% : 0.000910s : 26: opt.transform.jit_opt_a 0.28% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.80% : 0.000484s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.08% : 0.000014s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000050s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.21% : 0.000382s : 1: renormalize.infer 1.69% : 0.000293s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000039s : 1: rewriter_after_opt_a 0.52% : 0.000090s : 1: rewriter_before_opt_a 0.46% : 0.000080s : 1: symbol_engine_optimizer 44.39% : 0.007678s : 1: type_inference TotalTime = 0.118173, [30] [bootstrap]: 0.00030342 [type_inference]: 0.107528 [event_method]: 1.846e-05 [auto_monad]: 6.292e-05 [graph_reusing]: 5.46e-06 [pre_auto_parallel]: 2.08002e-06 [py_interpret_to_execute]: 0.00055485 [rewriter_before_opt_a]: 8.617e-05 [expand_dump_flag]: 4.31002e-06 [jit_opt_a]: 0.00738655, [2] [Cycle 1]: 0.00372259, [27] [switch_simplify]: 5.011e-05 [loop_unroll]: 3.094e-05 [a_1]: 0.0005566 [with_stream_mark]: 1.389e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 3.47002e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 7.07002e-06 [updatestate_useless_node_eliminater]: 5.91003e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 6.53003e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.326e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.93998e-06 [renormalize]: 0.00275022 [add_forward_monad_depend]: 5.36998e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 1.548e-05 [cse]: 2.442e-05 [replace_applicator]: 1.334e-05 [Cycle 2]: 0.00038091, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00013521 [with_stream_mark]: 1.035e-05 [recompute_prepare]: 7.01001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.2e-05 [replace_applicator]: 5.77999e-06 [py_interpret_to_execute_after_opt_a]: 1.105e-05 [rewriter_after_opt_a]: 3.536e-05 [convert_after_rewriter]: 7.31001e-06 [order_py_execute_after_rewriter]: 4.74998e-06 [mutable_eliminate]: 0.00064518 [jit_opt_b]: 5.304e-05, [1] [Cycle 1]: 4.606e-05, [2] [frontend_op_eliminate]: 1.791e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 2.249e-05 [loop_unroll]: 0.00042466 [jit_opt_after_cconv]: 0.00015211, [1] [Cycle 1]: 0.00014527, [11] [c_1]: 2.694e-05 [parameter_eliminate]: 2.09999e-06 [updatestate_depend_eliminate]: 5.18002e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 1.94e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 7.32002e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.88e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 7.90998e-06 [add_recomputation]: 4.964e-05 [cse_after_recomputation]: 2.379e-05, [1] [Cycle 1]: 1.764e-05, [1] [cse]: 1.137e-05 [auto_monad_reorder]: 1.57e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00046372 [symbol_engine_optimizer]: 7.559e-05, [1] [Cycle 1]: 6.953e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 8.24998e-06 [elim_not_effective]: 1.362e-05 [opt_reshape]: 6.74001e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 3.4002e-07 [validate]: 4.237e-05 Sums bootstrap : 0.000303s : 0.27% type_inference : 0.107528s : 94.05% event_method : 0.000018s : 0.02% auto_monad : 0.000063s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000555s : 0.49% rewriter_before_opt_a : 0.000086s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000692s : 0.61% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002750s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000645s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000425s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000464s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000191 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.24% : 0.000006s : 4: substitution.graph_param_transform 82.25% : 0.000157s : 4: substitution.inline 1.89% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000004s : 2: substitution.replace_old_param 6.02% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107456 2 97.26% : 0.104515s : 1: type_inference.infer 2.74% : 0.002940s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.97% : 0.000049s : 4: replace.inline 33.03% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.77% : 0.000154s : 4: match.inline 6.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.35% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 4.80% : 0.000006s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.57% : 0.000003s : 18: predicate.load_eliminater 1.10% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.06% : 0.000001s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.55% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.52% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.33% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002155 22 63.60% : 0.001371s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.00% : 0.000754s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121914 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000066s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000316s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.06% : 0.007390s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.35% : 0.000432s : 1: loop_unroll 0.53% : 0.000652s : 1: mutable_eliminate 0.75% : 0.000919s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000562s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.61% : 0.001963s : 1: renormalize.infer 0.64% : 0.000780s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 88.21% : 0.107539s : 1: type_inference TotalTime = 0.0604028, [30] [bootstrap]: 0.00028203 [type_inference]: 0.0507933 [event_method]: 1.657e-05 [auto_monad]: 4.734e-05 [graph_reusing]: 4e-06 [pre_auto_parallel]: 1.97001e-06 [py_interpret_to_execute]: 0.00028189 [rewriter_before_opt_a]: 7.647e-05 [expand_dump_flag]: 2.41998e-06 [jit_opt_a]: 0.00656516, [2] [Cycle 1]: 0.00283487, [27] [switch_simplify]: 5.171e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00055237 [with_stream_mark]: 1.36e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 7.32002e-06 [updatestate_useless_node_eliminater]: 6.26e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.165e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.83001e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00187132 [add_forward_monad_depend]: 5.39998e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.426e-05 [cse]: 2.142e-05 [replace_applicator]: 1.507e-05 [Cycle 2]: 0.0003591, [27] [switch_simplify]: 7.19001e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00012044 [with_stream_mark]: 1.079e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.81998e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.302e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.26e-06 [cse]: 1.193e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 9.05999e-06 [rewriter_after_opt_a]: 3.108e-05 [convert_after_rewriter]: 6.73998e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00057138 [jit_opt_b]: 5.38e-05, [1] [Cycle 1]: 4.73e-05, [2] [frontend_op_eliminate]: 1.946e-05 [inline_after_opt_a]: 1.704e-05 [cconv]: 6.008e-05 [loop_unroll]: 0.00046481 [jit_opt_after_cconv]: 0.00015907, [1] [Cycle 1]: 0.0001518, [11] [c_1]: 2.981e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.162e-05 [call_graph_tuple_transform]: 2.198e-05 [tuple_list_get_item_eliminator]: 5.87999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.343e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 7.40998e-06 [add_recomputation]: 4.367e-05 [cse_after_recomputation]: 2.339e-05, [1] [Cycle 1]: 1.812e-05, [1] [cse]: 1.136e-05 [auto_monad_reorder]: 1.546e-05 [get_jit_bprop_graph]: 1.66e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.0005507 [symbol_engine_optimizer]: 8.882e-05, [1] [Cycle 1]: 8.123e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 9.89999e-06 [elim_not_effective]: 1.689e-05 [opt_reshape]: 7.66999e-06 [fold_const_symbol]: 1.055e-05 [renormalize]: 5.3001e-07 [validate]: 4.37e-05 Sums bootstrap : 0.000282s : 0.50% type_inference : 0.050793s : 89.97% event_method : 0.000017s : 0.03% auto_monad : 0.000047s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000282s : 0.50% rewriter_before_opt_a : 0.000076s : 0.14% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000673s : 1.19% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001871s : 3.31% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000031s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000571s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000060s : 0.11% loop_unroll : 0.000465s : 0.82% jit_opt_after_cconv.c_1 : 0.000030s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000044s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000551s : 0.98% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.08% Time group info: ------[substitution.] 0.000185 24 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.62% : 0.000007s : 4: substitution.graph_param_transform 82.99% : 0.000154s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000004s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 5.46% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050728 2 96.24% : 0.048823s : 1: type_inference.infer 3.76% : 0.001905s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.38% : 0.000048s : 4: replace.inline 34.62% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 94.36% : 0.000151s : 4: match.inline 5.64% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.43% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 18: predicate.load_eliminater 1.78% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.33% : 0.000002s : 4: predicate.mutable_eliminate 0.72% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.33% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000001s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.38% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.96% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001896 22 68.81% : 0.001304s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.61% : 0.000561s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063290 72 0.07% : 0.000047s : 1: add_recomputation 0.08% : 0.000051s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.47% : 0.000295s : 1: bootstrap 0.10% : 0.000063s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.38% : 0.006568s : 1: jit_opt_a 0.26% : 0.000162s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.75% : 0.000474s : 1: loop_unroll 0.92% : 0.000580s : 1: mutable_eliminate 1.42% : 0.000899s : 26: opt.transform.jit_opt_a 0.09% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.10% : 0.000062s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.89% : 0.000562s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000288s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.96% : 0.001242s : 1: renormalize.infer 0.98% : 0.000622s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000034s : 1: rewriter_after_opt_a 0.13% : 0.000081s : 1: rewriter_before_opt_a 0.15% : 0.000092s : 1: symbol_engine_optimizer 80.28% : 0.050806s : 1: type_inference TotalTime = 0.122649, [30] [bootstrap]: 0.00029197 [type_inference]: 0.1102 [event_method]: 2.302e-05 [auto_monad]: 6.603e-05 [graph_reusing]: 5.03002e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00064273 [rewriter_before_opt_a]: 0.00010892 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00821309, [2] [Cycle 1]: 0.00427913, [27] [switch_simplify]: 5.699e-05 [loop_unroll]: 3.457e-05 [a_1]: 0.0007209 [with_stream_mark]: 1.536e-05 [recompute_prepare]: 9.03002e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.61e-06 [accelerated_algorithm]: 6.99001e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 7.03e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.438e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.25002e-06 [renormalize]: 0.00306783 [add_forward_monad_depend]: 1.021e-05 [auto_monad_grad]: 2.51e-06 [auto_monad_eliminator]: 1.919e-05 [cse]: 3.845e-05 [replace_applicator]: 2.198e-05 [Cycle 2]: 0.00047767, [27] [switch_simplify]: 7.41999e-06 [loop_unroll]: 6.43e-06 [a_1]: 0.00016663 [with_stream_mark]: 1.747e-05 [recompute_prepare]: 8.63001e-06 [updatestate_depend_eliminate]: 4.16001e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 2.41e-06 [specialize_transform]: 7.37002e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 7.66001e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 4.60999e-06 [cell_reuse_recompute_pass]: 3.15998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.826e-05 [j_node_and_user_rematch]: 1.159e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.45001e-06 [inline_without_move]: 5.96e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 3.8e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 8.82e-06 [cse]: 2.312e-05 [replace_applicator]: 8.67998e-06 [py_interpret_to_execute_after_opt_a]: 1.938e-05 [rewriter_after_opt_a]: 4.58e-05 [convert_after_rewriter]: 7.78001e-06 [order_py_execute_after_rewriter]: 5.37999e-06 [mutable_eliminate]: 0.00079056 [jit_opt_b]: 6.692e-05, [1] [Cycle 1]: 5.82e-05, [2] [frontend_op_eliminate]: 2.223e-05 [inline_after_opt_a]: 2.358e-05 [cconv]: 3.095e-05 [loop_unroll]: 0.00059644 [jit_opt_after_cconv]: 0.00019206, [1] [Cycle 1]: 0.00018353, [11] [c_1]: 2.673e-05 [parameter_eliminate]: 3.85e-06 [updatestate_depend_eliminate]: 7.17997e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 3.551e-05 [call_graph_tuple_transform]: 2.745e-05 [tuple_list_get_item_eliminator]: 6.44001e-06 [none_parameter_eliminate]: 2.22001e-06 [renormalize]: 1.32e-06 [switch_simplify]: 1.035e-05 [remove_dup_value]: 1.774e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 9.72001e-06 [add_recomputation]: 5.516e-05 [cse_after_recomputation]: 2.888e-05, [1] [Cycle 1]: 2.204e-05, [1] [cse]: 1.479e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 1.107e-05 [opt_after_jit_grad]: 0.00068297 [symbol_engine_optimizer]: 0.00025249, [1] [Cycle 1]: 0.00024343, [6] [build]: 4.55001e-06 [elim_shapecalc]: 1.077e-05 [elim_not_effective]: 1.626e-05 [opt_reshape]: 0.00016235 [fold_const_symbol]: 1.377e-05 [renormalize]: 7.00005e-07 [validate]: 5.713e-05 Sums bootstrap : 0.000292s : 0.25% type_inference : 0.110200s : 92.98% event_method : 0.000023s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000643s : 0.54% rewriter_before_opt_a : 0.000109s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000888s : 0.75% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003068s : 2.59% jit_opt_a.add_forward_monad_depend : 0.000014s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000062s : 0.05% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000019s : 0.02% rewriter_after_opt_a : 0.000046s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000791s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000024s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000596s : 0.50% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000027s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000010s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000011s : 0.01% opt_after_jit_grad : 0.000683s : 0.58% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000162s : 0.14% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000057s : 0.05% Time group info: ------[substitution.] 0.000266 28 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 2.39% : 0.000006s : 4: substitution.graph_param_transform 80.84% : 0.000215s : 5: substitution.inline 1.72% : 0.000005s : 4: substitution.j_node_and_user_rematch 5.52% : 0.000015s : 3: substitution.reduce_eliminate 2.01% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000005s : 2: substitution.replace_old_param 4.20% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110126 2 97.34% : 0.107194s : 1: type_inference.infer 2.66% : 0.002932s : 1: type_inference.specialize ------[replace.] 0.000105 7 68.31% : 0.000072s : 5: replace.inline 31.69% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 7 95.45% : 0.000212s : 5: match.inline 4.55% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 1.39% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.68% : 0.000003s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000002s : 13: predicate.compare_switch_simplify 1.26% : 0.000002s : 13: predicate.depend_value_elim 1.06% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.92% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 4.90% : 0.000007s : 28: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.70% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.53% : 0.000004s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.10% : 0.000002s : 13: predicate.print_const_string_wrapper 2.06% : 0.000003s : 13: predicate.reduce_eliminate 1.30% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 23: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.18% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000002s : 8: predicate.special_op_eliminate 1.03% : 0.000002s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 20: predicate.switch_defer_inline 2.04% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.91% : 0.000011s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.55% : 0.000002s : 13: predicate.transpose_eliminate 1.37% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.95% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.65% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002368 25 60.35% : 0.001429s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.67% : 0.000063s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.99% : 0.000876s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127137 72 0.05% : 0.000059s : 1: add_recomputation 0.05% : 0.000069s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000307s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000034s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.46% : 0.008218s : 1: jit_opt_a 0.15% : 0.000195s : 1: jit_opt_after_cconv 0.05% : 0.000069s : 1: jit_opt_b 0.48% : 0.000607s : 1: loop_unroll 0.63% : 0.000801s : 1: mutable_eliminate 0.90% : 0.001150s : 26: opt.transform.jit_opt_a 0.05% : 0.000067s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000037s : 4: opt.transform.jit_opt_b 0.02% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000042s : 1: opt.transform.mutable_eliminate 0.03% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.16% : 0.000199s : 4: opt.transform.symbol_engine_opt 0.54% : 0.000693s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.51% : 0.000651s : 1: py_interpret_to_execute 0.02% : 0.000022s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.63% : 0.002077s : 1: renormalize.infer 0.77% : 0.000977s : 1: renormalize.specialize 0.01% : 0.000013s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000050s : 1: rewriter_after_opt_a 0.09% : 0.000115s : 1: rewriter_before_opt_a 0.20% : 0.000256s : 1: symbol_engine_optimizer 86.69% : 0.110215s : 1: type_inference TotalTime = 0.0137972, [30] [bootstrap]: 0.00028645 [type_inference]: 0.00471335 [event_method]: 1.746e-05 [auto_monad]: 6.488e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.01e-06 [py_interpret_to_execute]: 4.047e-05 [rewriter_before_opt_a]: 6.981e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.0059624, [2] [Cycle 1]: 0.0019318, [27] [switch_simplify]: 5.449e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00059731 [with_stream_mark]: 2.183e-05 [recompute_prepare]: 8.84003e-06 [updatestate_depend_eliminate]: 4.70999e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.63002e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.29e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 9.53002e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00089479 [add_forward_monad_depend]: 5.13002e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.605e-05 [cse]: 1.999e-05 [replace_applicator]: 1.461e-05 [Cycle 2]: 0.00034909, [27] [switch_simplify]: 6.15002e-06 [loop_unroll]: 5.47001e-06 [a_1]: 9.211e-05 [with_stream_mark]: 1.326e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 4.64998e-06 [merge_forward]: 4.72e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.703e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.21002e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.51998e-06 [auto_monad_grad]: 1.63002e-06 [auto_monad_eliminator]: 9.52999e-06 [cse]: 1.262e-05 [replace_applicator]: 6.43998e-06 [py_interpret_to_execute_after_opt_a]: 1.292e-05 [rewriter_after_opt_a]: 3.91e-05 [convert_after_rewriter]: 8.33999e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00065524 [jit_opt_b]: 5.448e-05, [1] [Cycle 1]: 4.724e-05, [2] [frontend_op_eliminate]: 1.658e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 3.17e-05 [loop_unroll]: 0.00063852 [jit_opt_after_cconv]: 0.00018409, [1] [Cycle 1]: 0.00017577, [11] [c_1]: 2.426e-05 [parameter_eliminate]: 4.77998e-06 [updatestate_depend_eliminate]: 6.96999e-06 [updatestate_assign_eliminate]: 3.77998e-06 [updatestate_loads_eliminate]: 2.87002e-06 [cse]: 3.696e-05 [call_graph_tuple_transform]: 2.57e-05 [tuple_list_get_item_eliminator]: 7.01999e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.79e-06 [remove_dup_value]: 1.39e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 6.43e-06 [add_recomputation]: 5.473e-05 [cse_after_recomputation]: 2.388e-05, [1] [Cycle 1]: 1.811e-05, [1] [cse]: 1.157e-05 [auto_monad_reorder]: 1.398e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 7.36999e-06 [opt_after_jit_grad]: 0.00057145 [symbol_engine_optimizer]: 8.197e-05, [1] [Cycle 1]: 7.428e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 9.44e-06 [elim_not_effective]: 1.568e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 9.97001e-06 [renormalize]: 6.80011e-07 [validate]: 3.923e-05 Sums bootstrap : 0.000286s : 3.02% type_inference : 0.004713s : 49.62% event_method : 0.000017s : 0.18% auto_monad : 0.000065s : 0.68% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.43% rewriter_before_opt_a : 0.000070s : 0.73% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000061s : 0.64% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000689s : 7.26% jit_opt_a.with_stream_mark : 0.000035s : 0.37% jit_opt_a.recompute_prepare : 0.000015s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000009s : 0.10% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000895s : 9.42% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.27% jit_opt_a.cse : 0.000033s : 0.34% jit_opt_a.replace_applicator : 0.000021s : 0.22% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000039s : 0.41% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000655s : 6.90% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000018s : 0.19% cconv : 0.000032s : 0.33% loop_unroll : 0.000639s : 6.72% jit_opt_after_cconv.c_1 : 0.000024s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000037s : 0.39% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.27% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000014s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000055s : 0.58% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000014s : 0.15% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000007s : 0.08% opt_after_jit_grad : 0.000571s : 6.02% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000039s : 0.41% Time group info: ------[substitution.] 0.000249 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.47% : 0.000006s : 3: substitution.graph_param_transform 84.79% : 0.000211s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 2.65% : 0.000007s : 2: substitution.replace_old_param 5.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004654 2 81.10% : 0.003774s : 1: type_inference.infer 18.90% : 0.000880s : 1: type_inference.specialize ------[replace.] 0.000082 6 65.90% : 0.000054s : 4: replace.inline 34.10% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 6 94.77% : 0.000208s : 4: match.inline 5.23% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 2.00% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.48% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.41% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 0.97% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000001s : 3: predicate.graph_param_transform 5.59% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.77% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 15: predicate.load_eliminater 2.00% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.63% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.08% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.63% : 0.000001s : 3: predicate.reset_defer_inline 1.10% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000712 13 51.48% : 0.000367s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.02% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.50% : 0.000296s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015691 72 0.37% : 0.000058s : 1: add_recomputation 0.43% : 0.000068s : 1: auto_monad 0.11% : 0.000017s : 1: auto_monad_reorder 1.88% : 0.000296s : 1: bootstrap 0.22% : 0.000035s : 1: cconv 0.07% : 0.000011s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.17% : 0.000026s : 1: environ_conv 0.13% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.02% : 0.005966s : 1: jit_opt_a 1.20% : 0.000188s : 1: jit_opt_after_cconv 0.36% : 0.000057s : 1: jit_opt_b 4.14% : 0.000650s : 1: loop_unroll 4.24% : 0.000665s : 1: mutable_eliminate 5.82% : 0.000913s : 26: opt.transform.jit_opt_a 0.38% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000028s : 4: opt.transform.jit_opt_b 0.11% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000018s : 1: opt.transform.mutable_eliminate 0.17% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000038s : 4: opt.transform.symbol_engine_opt 3.71% : 0.000582s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000043s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000016s : 1: remove_dup_value 3.13% : 0.000491s : 1: renormalize.infer 2.51% : 0.000394s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000043s : 1: rewriter_after_opt_a 0.46% : 0.000073s : 1: rewriter_before_opt_a 0.54% : 0.000085s : 1: symbol_engine_optimizer 30.10% : 0.004723s : 1: type_inference TotalTime = 0.0122974, [30] [bootstrap]: 0.00030869 [type_inference]: 0.00477143 [event_method]: 1.68e-05 [auto_monad]: 6.932e-05 [graph_reusing]: 4.65001e-06 [pre_auto_parallel]: 2.06e-06 [py_interpret_to_execute]: 3.952e-05 [rewriter_before_opt_a]: 6.976e-05 [expand_dump_flag]: 2.94001e-06 [jit_opt_a]: 0.00503507, [2] [Cycle 1]: 0.00165958, [27] [switch_simplify]: 5.604e-05 [loop_unroll]: 3.145e-05 [a_1]: 0.0005755 [with_stream_mark]: 1.38e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.151e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00069032 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.383e-05 [cse]: 1.947e-05 [replace_applicator]: 1.128e-05 [Cycle 2]: 0.00030765, [27] [switch_simplify]: 5.92001e-06 [loop_unroll]: 5.10999e-06 [a_1]: 8.842e-05 [with_stream_mark]: 8.05e-06 [recompute_prepare]: 4.99003e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 4.94998e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.70999e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.85999e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.22e-05 [j_node_and_user_rematch]: 7.33e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 4.57998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.60019e-07 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 5.34998e-06 [cse]: 1.052e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 8.52e-06 [rewriter_after_opt_a]: 2.941e-05 [convert_after_rewriter]: 5.98998e-06 [order_py_execute_after_rewriter]: 4.45999e-06 [mutable_eliminate]: 0.00048694 [jit_opt_b]: 4.737e-05, [1] [Cycle 1]: 4.146e-05, [2] [frontend_op_eliminate]: 1.566e-05 [inline_after_opt_a]: 1.534e-05 [cconv]: 1.775e-05 [loop_unroll]: 0.00040428 [jit_opt_after_cconv]: 0.0001353, [1] [Cycle 1]: 0.00012953, [11] [c_1]: 2.215e-05 [parameter_eliminate]: 2.43002e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 1.782e-05 [call_graph_tuple_transform]: 1.664e-05 [tuple_list_get_item_eliminator]: 5.15001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.14998e-06 [remove_dup_value]: 1.035e-05 [partial_unused_args_eliminate]: 1.79e-06 [environ_conv]: 4.45e-06 [add_recomputation]: 3.792e-05 [cse_after_recomputation]: 2.387e-05, [1] [Cycle 1]: 1.822e-05, [1] [cse]: 1.174e-05 [auto_monad_reorder]: 1.319e-05 [get_jit_bprop_graph]: 1.62999e-06 [rewriter_after_jit_bprop_graph]: 4.24997e-06 [opt_after_jit_grad]: 0.00047586 [symbol_engine_optimizer]: 7.031e-05, [1] [Cycle 1]: 6.438e-05, [6] [build]: 2.78998e-06 [elim_shapecalc]: 8.05999e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.19998e-06 [renormalize]: 3.89991e-07 [validate]: 2.945e-05 Sums bootstrap : 0.000309s : 3.56% type_inference : 0.004771s : 54.95% event_method : 0.000017s : 0.19% auto_monad : 0.000069s : 0.80% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.46% rewriter_before_opt_a : 0.000070s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.71% jit_opt_a.loop_unroll : 0.000037s : 0.42% jit_opt_a.a_1 : 0.000664s : 7.65% jit_opt_a.with_stream_mark : 0.000022s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000690s : 7.95% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.22% jit_opt_a.cse : 0.000030s : 0.35% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000009s : 0.10% rewriter_after_opt_a : 0.000029s : 0.34% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000487s : 5.61% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000018s : 0.20% loop_unroll : 0.000404s : 4.66% jit_opt_after_cconv.c_1 : 0.000022s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000010s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000038s : 0.44% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000013s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000476s : 5.48% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.34% Time group info: ------[substitution.] 0.000176 23 1.12% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000004s : 3: substitution.graph_param_transform 81.79% : 0.000144s : 4: substitution.inline 1.39% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.54% : 0.000004s : 4: substitution.remove_not_recompute_node 2.13% : 0.000004s : 2: substitution.replace_old_param 8.04% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004715 2 78.97% : 0.003723s : 1: type_inference.infer 21.03% : 0.000992s : 1: type_inference.specialize ------[replace.] 0.000071 6 59.69% : 0.000042s : 4: replace.inline 40.31% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 91.69% : 0.000141s : 4: match.inline 8.31% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.30% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.50% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000008s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.96% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000718 13 45.11% : 0.000324s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.30% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.60% : 0.000363s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013916 72 0.29% : 0.000041s : 1: add_recomputation 0.53% : 0.000073s : 1: auto_monad 0.11% : 0.000016s : 1: auto_monad_reorder 2.30% : 0.000321s : 1: bootstrap 0.14% : 0.000020s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.20% : 0.005038s : 1: jit_opt_a 0.99% : 0.000138s : 1: jit_opt_after_cconv 0.36% : 0.000050s : 1: jit_opt_b 2.96% : 0.000412s : 1: loop_unroll 3.56% : 0.000495s : 1: mutable_eliminate 6.28% : 0.000873s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.48% : 0.000485s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000013s : 1: remove_dup_value 2.53% : 0.000351s : 1: renormalize.infer 2.38% : 0.000332s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000032s : 1: rewriter_after_opt_a 0.52% : 0.000072s : 1: rewriter_before_opt_a 0.52% : 0.000073s : 1: symbol_engine_optimizer 34.37% : 0.004783s : 1: type_inference TotalTime = 0.120708, [30] [bootstrap]: 0.00030134 [type_inference]: 0.109242 [event_method]: 2.159e-05 [auto_monad]: 0.00010988 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00053419 [rewriter_before_opt_a]: 9.866e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00799836, [2] [Cycle 1]: 0.00403805, [27] [switch_simplify]: 6.842e-05 [loop_unroll]: 3.785e-05 [a_1]: 0.00072933 [with_stream_mark]: 1.967e-05 [recompute_prepare]: 9.62001e-06 [updatestate_depend_eliminate]: 4.91002e-06 [updatestate_assign_eliminate]: 3.23998e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 8.23001e-06 [updatestate_useless_node_eliminater]: 6.68998e-06 [accelerated_algorithm]: 7.47998e-06 [meta_shard_fg_expand]: 2.38998e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 3.87002e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.554e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00279523 [add_forward_monad_depend]: 7.34002e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.755e-05 [cse]: 3.724e-05 [replace_applicator]: 2.009e-05 [Cycle 2]: 0.00041535, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.01e-06 [a_1]: 0.0001474 [with_stream_mark]: 1.3e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 3.17997e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.46998e-06 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 6.33002e-06 [accelerated_algorithm]: 6.61e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 2.95998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 1.026e-05 [inline_without_move]: 6.27001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 6.19999e-06 [cse]: 1.342e-05 [replace_applicator]: 6.95002e-06 [py_interpret_to_execute_after_opt_a]: 1.086e-05 [rewriter_after_opt_a]: 3.92e-05 [convert_after_rewriter]: 7.73999e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.0006808 [jit_opt_b]: 6.591e-05, [1] [Cycle 1]: 5.939e-05, [2] [frontend_op_eliminate]: 2.908e-05 [inline_after_opt_a]: 1.776e-05 [cconv]: 2.567e-05 [loop_unroll]: 0.00043411 [jit_opt_after_cconv]: 0.00015477, [1] [Cycle 1]: 0.0001483, [11] [c_1]: 2.584e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 3.31001e-06 [cse]: 2.383e-05 [call_graph_tuple_transform]: 2.105e-05 [tuple_list_get_item_eliminator]: 6.87002e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.06003e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.03997e-06 [environ_conv]: 7.95998e-06 [add_recomputation]: 4.659e-05 [cse_after_recomputation]: 2.565e-05, [1] [Cycle 1]: 2.037e-05, [1] [cse]: 1.439e-05 [auto_monad_reorder]: 1.662e-05 [get_jit_bprop_graph]: 1.62001e-06 [rewriter_after_jit_bprop_graph]: 5.13002e-06 [opt_after_jit_grad]: 0.00045177 [symbol_engine_optimizer]: 7.759e-05, [1] [Cycle 1]: 7.16e-05, [6] [build]: 2.98e-06 [elim_shapecalc]: 1.034e-05 [elim_not_effective]: 1.484e-05 [opt_reshape]: 6.22001e-06 [fold_const_symbol]: 9.90002e-06 [renormalize]: 3.69997e-07 [validate]: 0.00013746 Sums bootstrap : 0.000301s : 0.26% type_inference : 0.109242s : 93.73% event_method : 0.000022s : 0.02% auto_monad : 0.000110s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000534s : 0.46% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.04% jit_opt_a.a_1 : 0.000877s : 0.75% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002795s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000681s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000029s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000434s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000452s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000137s : 0.12% Time group info: ------[substitution.] 0.000268 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.20% : 0.000006s : 4: substitution.graph_param_transform 82.17% : 0.000220s : 5: substitution.inline 1.32% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.84% : 0.000013s : 3: substitution.reduce_eliminate 1.81% : 0.000005s : 4: substitution.remove_not_recompute_node 2.01% : 0.000005s : 2: substitution.replace_old_param 4.58% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109162 2 97.37% : 0.106286s : 1: type_inference.infer 2.63% : 0.002876s : 1: type_inference.specialize ------[replace.] 0.000109 7 68.45% : 0.000075s : 5: replace.inline 31.55% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 95.20% : 0.000217s : 5: match.inline 4.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 0.97% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000002s : 8: predicate.get_grad_eliminate 0.56% : 0.000001s : 4: predicate.graph_param_transform 5.05% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.74% : 0.000003s : 19: predicate.load_eliminater 0.91% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.22% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000004s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.12% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.49% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.36% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.87% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.73% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002226 25 62.10% : 0.001382s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.79% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.11% : 0.000782s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124633 72 0.04% : 0.000049s : 1: add_recomputation 0.09% : 0.000114s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000312s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.42% : 0.008002s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.35% : 0.000442s : 1: loop_unroll 0.55% : 0.000690s : 1: mutable_eliminate 0.92% : 0.001146s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000041s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000541s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.54% : 0.001918s : 1: renormalize.infer 0.70% : 0.000868s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.66% : 0.109257s : 1: type_inference TotalTime = 0.118878, [30] [bootstrap]: 0.00030199 [type_inference]: 0.108239 [event_method]: 1.841e-05 [auto_monad]: 5.234e-05 [graph_reusing]: 3.8e-06 [pre_auto_parallel]: 1.71e-06 [py_interpret_to_execute]: 0.0005549 [rewriter_before_opt_a]: 7.879e-05 [expand_dump_flag]: 2.83e-06 [jit_opt_a]: 0.00747473, [2] [Cycle 1]: 0.00374863, [27] [switch_simplify]: 5.731e-05 [loop_unroll]: 3.084e-05 [a_1]: 0.00056895 [with_stream_mark]: 1.507e-05 [recompute_prepare]: 8.77e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 3.44001e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.612e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.51e-06 [inline_without_move]: 6.14001e-06 [renormalize]: 0.00273109 [add_forward_monad_depend]: 6.24001e-06 [auto_monad_grad]: 1.92001e-06 [auto_monad_eliminator]: 1.678e-05 [cse]: 2.696e-05 [replace_applicator]: 1.526e-05 [Cycle 2]: 0.00037777, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00012518 [with_stream_mark]: 1.013e-05 [recompute_prepare]: 6.05002e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.728e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.87999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.51e-06 [cse]: 1.141e-05 [replace_applicator]: 6.15002e-06 [py_interpret_to_execute_after_opt_a]: 9.42999e-06 [rewriter_after_opt_a]: 3.305e-05 [convert_after_rewriter]: 6.98998e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00060491 [jit_opt_b]: 5.535e-05, [1] [Cycle 1]: 4.82e-05, [2] [frontend_op_eliminate]: 1.925e-05 [inline_after_opt_a]: 1.769e-05 [cconv]: 2.668e-05 [loop_unroll]: 0.00041714 [jit_opt_after_cconv]: 0.00015057, [1] [Cycle 1]: 0.00014389, [11] [c_1]: 2.677e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.971e-05 [call_graph_tuple_transform]: 2.163e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 6.49976e-07 [switch_simplify]: 5.83002e-06 [remove_dup_value]: 1.478e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 8.32e-06 [add_recomputation]: 4.652e-05 [cse_after_recomputation]: 2.262e-05, [1] [Cycle 1]: 1.705e-05, [1] [cse]: 1.12e-05 [auto_monad_reorder]: 1.629e-05 [get_jit_bprop_graph]: 1.67001e-06 [rewriter_after_jit_bprop_graph]: 4.57e-06 [opt_after_jit_grad]: 0.00044744 [symbol_engine_optimizer]: 7.422e-05, [1] [Cycle 1]: 6.871e-05, [6] [build]: 4.27e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.4e-05 [opt_reshape]: 6.41e-06 [fold_const_symbol]: 9.64999e-06 [renormalize]: 1.50001e-07 [validate]: 4.157e-05 Sums bootstrap : 0.000302s : 0.26% type_inference : 0.108239s : 94.15% event_method : 0.000018s : 0.02% auto_monad : 0.000052s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000555s : 0.48% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000694s : 0.60% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002731s : 2.38% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000605s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000417s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000447s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000200 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 4: substitution.graph_param_transform 82.24% : 0.000164s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000006s : 4: substitution.remove_not_recompute_node 2.81% : 0.000006s : 2: substitution.replace_old_param 5.97% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108169 2 97.38% : 0.105335s : 1: type_inference.infer 2.62% : 0.002833s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.87% : 0.000049s : 4: replace.inline 33.13% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.76% : 0.000162s : 4: match.inline 6.24% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.63% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.09% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.27% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 12: predicate.reshape_eliminate 1.41% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.60% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.04% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002182 22 65.29% : 0.001425s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.42% : 0.000729s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122617 72 0.04% : 0.000049s : 1: add_recomputation 0.05% : 0.000056s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000313s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.10% : 0.007478s : 1: jit_opt_a 0.12% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000424s : 1: loop_unroll 0.50% : 0.000613s : 1: mutable_eliminate 0.76% : 0.000933s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000562s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.58% : 0.001934s : 1: renormalize.infer 0.64% : 0.000788s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000084s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 88.28% : 0.108252s : 1: type_inference TotalTime = 0.122747, [30] [bootstrap]: 0.00030529 [type_inference]: 0.111811 [event_method]: 2.114e-05 [auto_monad]: 6.542e-05 [graph_reusing]: 5.12999e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00056329 [rewriter_before_opt_a]: 9.656e-05 [expand_dump_flag]: 3.68e-06 [jit_opt_a]: 0.00750436, [2] [Cycle 1]: 0.00383178, [27] [switch_simplify]: 5.557e-05 [loop_unroll]: 3.552e-05 [a_1]: 0.00065862 [with_stream_mark]: 1.453e-05 [recompute_prepare]: 9.13002e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 7.82e-06 [updatestate_useless_node_eliminater]: 6.49001e-06 [accelerated_algorithm]: 7.19001e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.51999e-06 [merge_forward]: 3.55998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 2.60002e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 6.45002e-06 [renormalize]: 0.00272883 [add_forward_monad_depend]: 5.71003e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.418e-05 [cse]: 2.12e-05 [replace_applicator]: 1.66e-05 [Cycle 2]: 0.0003843, [27] [switch_simplify]: 7.74997e-06 [loop_unroll]: 6.64999e-06 [a_1]: 0.00013622 [with_stream_mark]: 1.098e-05 [recompute_prepare]: 6.41998e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.58002e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.182e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.40002e-06 [replace_old_param]: 8.65999e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.341e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.241e-05 [rewriter_after_opt_a]: 3.28e-05 [convert_after_rewriter]: 5.64e-06 [order_py_execute_after_rewriter]: 4.44998e-06 [mutable_eliminate]: 0.00062704 [jit_opt_b]: 5.725e-05, [1] [Cycle 1]: 5.057e-05, [2] [frontend_op_eliminate]: 2.045e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 2.023e-05 [loop_unroll]: 0.00044067 [jit_opt_after_cconv]: 0.00015306, [1] [Cycle 1]: 0.00014675, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.355e-05 [call_graph_tuple_transform]: 1.981e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.13001e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.198e-05 [partial_unused_args_eliminate]: 1.68002e-06 [environ_conv]: 6.75002e-06 [add_recomputation]: 3.918e-05 [cse_after_recomputation]: 2.448e-05, [1] [Cycle 1]: 1.899e-05, [1] [cse]: 1.22e-05 [auto_monad_reorder]: 1.177e-05 [get_jit_bprop_graph]: 4.15e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.0004624 [symbol_engine_optimizer]: 8.191e-05, [1] [Cycle 1]: 7.584e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 1.209e-05 [elim_not_effective]: 1.568e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 1.024e-05 [renormalize]: 3.69997e-07 [validate]: 0.00019478 Sums bootstrap : 0.000305s : 0.26% type_inference : 0.111811s : 94.06% event_method : 0.000021s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000563s : 0.47% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.04% jit_opt_a.a_1 : 0.000795s : 0.67% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002729s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000627s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000441s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000462s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000195s : 0.16% Time group info: ------[substitution.] 0.000231 28 1.71% : 0.000004s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.01% : 0.000005s : 4: substitution.graph_param_transform 82.68% : 0.000191s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.37% : 0.000010s : 3: substitution.reduce_eliminate 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 1.99% : 0.000005s : 2: substitution.replace_old_param 3.54% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111739 2 97.28% : 0.108699s : 1: type_inference.infer 2.72% : 0.003040s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.10% : 0.000066s : 5: replace.inline 32.90% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 7 96.36% : 0.000188s : 5: match.inline 3.64% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.53% : 0.000002s : 13: predicate.addn_zero_filter 2.31% : 0.000003s : 13: predicate.arithmetic_simplify 1.60% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.25% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.45% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_depend_swap 1.13% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.13% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.25% : 0.000002s : 13: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.46% : 0.000004s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.12% : 0.000010s : 64: predicate.switch_simplify 1.66% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000003s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002306 25 63.77% : 0.001471s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.60% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.63% : 0.000775s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126441 72 0.03% : 0.000042s : 1: add_recomputation 0.05% : 0.000069s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.25% : 0.000318s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.94% : 0.007508s : 1: jit_opt_a 0.12% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.35% : 0.000448s : 1: loop_unroll 0.50% : 0.000635s : 1: mutable_eliminate 0.82% : 0.001040s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000570s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.52% : 0.001924s : 1: renormalize.infer 0.63% : 0.000796s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 88.44% : 0.111825s : 1: type_inference TotalTime = 0.119231, [30] [bootstrap]: 0.00033569 [type_inference]: 0.108694 [event_method]: 1.793e-05 [auto_monad]: 5.654e-05 [graph_reusing]: 4.28001e-06 [pre_auto_parallel]: 1.99999e-06 [py_interpret_to_execute]: 0.00050357 [rewriter_before_opt_a]: 8.505e-05 [expand_dump_flag]: 3.15002e-06 [jit_opt_a]: 0.00732938, [2] [Cycle 1]: 0.00367797, [27] [switch_simplify]: 5.254e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.00054087 [with_stream_mark]: 1.288e-05 [recompute_prepare]: 8.22998e-06 [updatestate_depend_eliminate]: 3.40003e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 7.44002e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 6.30002e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.355e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.0027238 [add_forward_monad_depend]: 5.15999e-06 [auto_monad_grad]: 1.54998e-06 [auto_monad_eliminator]: 1.322e-05 [cse]: 2.144e-05 [replace_applicator]: 1.483e-05 [Cycle 2]: 0.00036713, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.14001e-06 [a_1]: 0.00012671 [with_stream_mark]: 1.055e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 6.67002e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.03002e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.175e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 9.94999e-06 [rewriter_after_opt_a]: 3.018e-05 [convert_after_rewriter]: 6.08002e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00058526 [jit_opt_b]: 5.456e-05, [1] [Cycle 1]: 4.806e-05, [2] [frontend_op_eliminate]: 1.968e-05 [inline_after_opt_a]: 1.764e-05 [cconv]: 1.763e-05 [loop_unroll]: 0.00042211 [jit_opt_after_cconv]: 0.0001493, [1] [Cycle 1]: 0.00014286, [11] [c_1]: 2.73e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.052e-05 [call_graph_tuple_transform]: 1.935e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 9.79984e-07 [renormalize]: 3.29979e-07 [switch_simplify]: 6.60002e-06 [remove_dup_value]: 8.47998e-06 [partial_unused_args_eliminate]: 1.74e-06 [environ_conv]: 6.39999e-06 [add_recomputation]: 3.644e-05 [cse_after_recomputation]: 2.113e-05, [1] [Cycle 1]: 1.63e-05, [1] [cse]: 1.083e-05 [auto_monad_reorder]: 9.99001e-06 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00045785 [symbol_engine_optimizer]: 8.025e-05, [1] [Cycle 1]: 7.254e-05, [6] [build]: 2.79999e-06 [elim_shapecalc]: 8.65999e-06 [elim_not_effective]: 1.569e-05 [opt_reshape]: 8.67e-06 [fold_const_symbol]: 8.91002e-06 [renormalize]: 4.00003e-07 [validate]: 0.00012227 Sums bootstrap : 0.000336s : 0.29% type_inference : 0.108694s : 94.20% event_method : 0.000018s : 0.02% auto_monad : 0.000057s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000504s : 0.44% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000668s : 0.58% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002724s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000585s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000422s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000458s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000122s : 0.11% Time group info: ------[substitution.] 0.000178 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000004s : 4: substitution.graph_param_transform 83.40% : 0.000149s : 4: substitution.inline 1.76% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.06% : 0.000005s : 4: substitution.remove_not_recompute_node 2.41% : 0.000004s : 2: substitution.replace_old_param 5.43% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108626 2 97.42% : 0.105828s : 1: type_inference.infer 2.58% : 0.002799s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.42% : 0.000047s : 4: replace.inline 33.58% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 94.45% : 0.000146s : 4: match.inline 5.55% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.51% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000009s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002179 22 63.34% : 0.001380s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.32% : 0.000770s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122849 72 0.03% : 0.000039s : 1: add_recomputation 0.05% : 0.000060s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.29% : 0.000350s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.97% : 0.007333s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.35% : 0.000430s : 1: loop_unroll 0.48% : 0.000593s : 1: mutable_eliminate 0.73% : 0.000898s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000511s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.54% : 0.001898s : 1: renormalize.infer 0.67% : 0.000819s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000033s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 88.49% : 0.108709s : 1: type_inference TotalTime = 0.0150617, [30] [bootstrap]: 0.00027576 [type_inference]: 0.00730889 [event_method]: 1.791e-05 [auto_monad]: 6.67e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.24001e-06 [py_interpret_to_execute]: 4.291e-05 [rewriter_before_opt_a]: 7.431e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00515633, [2] [Cycle 1]: 0.00169897, [27] [switch_simplify]: 5.294e-05 [loop_unroll]: 3.273e-05 [a_1]: 0.00060721 [with_stream_mark]: 1.413e-05 [recompute_prepare]: 7.75998e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.26002e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.53002e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.11997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.299e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.71002e-06 [inline_without_move]: 5.24e-06 [renormalize]: 0.00068064 [add_forward_monad_depend]: 5.04e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 1.33e-05 [cse]: 2.837e-05 [replace_applicator]: 1.204e-05 [Cycle 2]: 0.00032377, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.618e-05 [with_stream_mark]: 9.30001e-06 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 5.15999e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.023e-05 [j_node_and_user_rematch]: 7.94002e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 6.75998e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.256e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 9.24998e-06 [rewriter_after_opt_a]: 3.227e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.0005205 [jit_opt_b]: 7.867e-05, [1] [Cycle 1]: 7.23e-05, [2] [frontend_op_eliminate]: 4.204e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.517e-05 [loop_unroll]: 0.00042326 [jit_opt_after_cconv]: 0.00015843, [1] [Cycle 1]: 0.00015169, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 6.01998e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.69999e-06 [cse]: 2.115e-05 [call_graph_tuple_transform]: 1.888e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.45001e-06 [remove_dup_value]: 1.528e-05 [partial_unused_args_eliminate]: 2.29999e-06 [environ_conv]: 6.17999e-06 [add_recomputation]: 4.895e-05 [cse_after_recomputation]: 2.401e-05, [1] [Cycle 1]: 1.819e-05, [1] [cse]: 1.248e-05 [auto_monad_reorder]: 1.823e-05 [get_jit_bprop_graph]: 1.66998e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.0004701 [symbol_engine_optimizer]: 7.371e-05, [1] [Cycle 1]: 6.623e-05, [6] [build]: 3.13998e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 5.63002e-06 [fold_const_symbol]: 8.72e-06 [renormalize]: 4.10015e-07 [validate]: 3.761e-05 Sums bootstrap : 0.000276s : 2.43% type_inference : 0.007309s : 64.28% event_method : 0.000018s : 0.16% auto_monad : 0.000067s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.38% rewriter_before_opt_a : 0.000074s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000059s : 0.52% jit_opt_a.loop_unroll : 0.000038s : 0.33% jit_opt_a.a_1 : 0.000703s : 6.19% jit_opt_a.with_stream_mark : 0.000023s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000681s : 5.99% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.17% jit_opt_a.cse : 0.000041s : 0.36% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000032s : 0.28% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000521s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000042s : 0.37% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000025s : 0.22% loop_unroll : 0.000423s : 3.72% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000049s : 0.43% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000018s : 0.16% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000470s : 4.13% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.33% Time group info: ------[substitution.] 0.000229 27 1.11% : 0.000003s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.42% : 0.000006s : 3: substitution.graph_param_transform 82.21% : 0.000189s : 5: substitution.inline 1.30% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000010s : 3: substitution.reduce_eliminate 1.78% : 0.000004s : 4: substitution.remove_not_recompute_node 1.50% : 0.000003s : 2: substitution.replace_old_param 4.80% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007255 2 87.52% : 0.006350s : 1: type_inference.infer 12.48% : 0.000905s : 1: type_inference.specialize ------[replace.] 0.000087 7 67.85% : 0.000059s : 5: replace.inline 32.15% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 7 94.95% : 0.000186s : 5: match.inline 5.05% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 747 1.04% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 11: predicate.addn_check_dump 1.09% : 0.000002s : 11: predicate.addn_zero_filter 1.79% : 0.000003s : 11: predicate.arithmetic_simplify 1.10% : 0.000002s : 11: predicate.cast_eliminate 0.33% : 0.000000s : 3: predicate.check_bprop_eliminate 0.93% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 0.97% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.02% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.03% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 11: predicate.environ_add_const_eliminate 0.92% : 0.000001s : 11: predicate.environ_get_add_eliminate 0.95% : 0.000001s : 11: predicate.environ_get_depend_swap 1.13% : 0.000002s : 11: predicate.environ_get_eliminate 0.93% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.74% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 4.56% : 0.000007s : 24: predicate.inline 0.72% : 0.000001s : 6: predicate.inline_without_move 0.30% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.90% : 0.000001s : 6: predicate.less_batch_normalization 1.19% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.53% : 0.000002s : 16: predicate.load_eliminater 0.95% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.55% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 11: predicate.merge_addn 1.04% : 0.000001s : 11: predicate.minmaximum_grad 1.30% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000001s : 3: predicate.opt_reshape 1.89% : 0.000003s : 16: predicate.partial_eliminate 1.04% : 0.000002s : 11: predicate.print_const_string_wrapper 1.64% : 0.000002s : 11: predicate.reduce_eliminate 1.16% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.43% : 0.000001s : 6: predicate.remove_not_recompute_node 1.45% : 0.000002s : 19: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000001s : 3: predicate.reset_defer_inline 1.16% : 0.000002s : 11: predicate.reshape_eliminate 1.08% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 16.67% : 0.000024s : 3: predicate.row_tensor_eliminate 1.11% : 0.000002s : 11: predicate.same_eliminate 0.45% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.77% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.04% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.08% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.21% : 0.000009s : 59: predicate.switch_simplify 1.06% : 0.000002s : 11: predicate.tile_eliminate 1.00% : 0.000001s : 11: predicate.transpose_eliminate 1.30% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.10% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 2.92% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.18% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.41% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.41% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.35% : 0.000002s : 11: predicate.value_based_eliminate 0.26% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000691 16 47.64% : 0.000329s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.95% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.41% : 0.000307s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016754 72 0.31% : 0.000052s : 1: add_recomputation 0.42% : 0.000070s : 1: auto_monad 0.12% : 0.000021s : 1: auto_monad_reorder 1.71% : 0.000286s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.80% : 0.005159s : 1: jit_opt_a 0.96% : 0.000161s : 1: jit_opt_after_cconv 0.49% : 0.000081s : 1: jit_opt_b 2.57% : 0.000430s : 1: loop_unroll 3.16% : 0.000529s : 1: mutable_eliminate 5.45% : 0.000914s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.31% : 0.000052s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.16% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.86% : 0.000479s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000045s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.28% : 0.000383s : 1: renormalize.infer 1.73% : 0.000290s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000035s : 1: rewriter_after_opt_a 0.46% : 0.000077s : 1: rewriter_before_opt_a 0.45% : 0.000076s : 1: symbol_engine_optimizer 43.68% : 0.007318s : 1: type_inference TotalTime = 0.0625569, [30] [bootstrap]: 0.00027348 [type_inference]: 0.052459 [event_method]: 1.86e-05 [auto_monad]: 6.419e-05 [graph_reusing]: 5.22e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.00030527 [rewriter_before_opt_a]: 7.981e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00706215, [2] [Cycle 1]: 0.0032728, [27] [switch_simplify]: 5.424e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.00057041 [with_stream_mark]: 1.625e-05 [recompute_prepare]: 9.49e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 2.93e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 4.35999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 6.43e-06 [renormalize]: 0.00225337 [add_forward_monad_depend]: 6.22001e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.636e-05 [cse]: 3.061e-05 [replace_applicator]: 1.707e-05 [Cycle 2]: 0.0003734, [27] [switch_simplify]: 7e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.000125 [with_stream_mark]: 1.111e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 2.79999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 9.37999e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.70001e-06 [inline_without_move]: 5.66003e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.265e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 9.77999e-06 [rewriter_after_opt_a]: 3.413e-05 [convert_after_rewriter]: 7.51999e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00066015 [jit_opt_b]: 5.638e-05, [1] [Cycle 1]: 4.977e-05, [2] [frontend_op_eliminate]: 2.055e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 2.452e-05 [loop_unroll]: 0.00043047 [jit_opt_after_cconv]: 0.00015337, [1] [Cycle 1]: 0.00014711, [11] [c_1]: 2.707e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 2.116e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 6.88e-06 [none_parameter_eliminate]: 1.76003e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.637e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 8.13999e-06 [add_recomputation]: 4.632e-05 [cse_after_recomputation]: 2.325e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.475e-05 [get_jit_bprop_graph]: 1.34998e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00045826 [symbol_engine_optimizer]: 0.00012104, [1] [Cycle 1]: 0.00011477, [6] [build]: 3.85e-06 [elim_shapecalc]: 4.953e-05 [elim_not_effective]: 1.418e-05 [opt_reshape]: 7.18998e-06 [fold_const_symbol]: 1.052e-05 [renormalize]: 5.19998e-07 [validate]: 4.188e-05 Sums bootstrap : 0.000273s : 0.47% type_inference : 0.052459s : 89.56% event_method : 0.000019s : 0.03% auto_monad : 0.000064s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000305s : 0.52% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000695s : 1.19% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002253s : 3.85% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000660s : 1.13% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000430s : 0.73% jit_opt_after_cconv.c_1 : 0.000027s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000458s : 0.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000050s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000200 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000006s : 4: substitution.graph_param_transform 82.35% : 0.000165s : 4: substitution.inline 2.21% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 6.02% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052385 2 96.26% : 0.050425s : 1: type_inference.infer 3.74% : 0.001960s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.23% : 0.000048s : 4: replace.inline 32.77% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.70% : 0.000162s : 4: match.inline 6.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.75% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.78% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 1.18% : 0.000002s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.69% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000009s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002244 26 71.01% : 0.001593s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.57% : 0.000619s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065860 72 0.07% : 0.000049s : 1: add_recomputation 0.10% : 0.000067s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.43% : 0.000283s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.73% : 0.007066s : 1: jit_opt_a 0.24% : 0.000156s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.66% : 0.000438s : 1: loop_unroll 1.02% : 0.000669s : 1: mutable_eliminate 1.42% : 0.000933s : 26: opt.transform.jit_opt_a 0.09% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000078s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000311s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.39% : 0.001572s : 1: renormalize.infer 1.02% : 0.000673s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000037s : 1: rewriter_after_opt_a 0.13% : 0.000084s : 1: rewriter_before_opt_a 0.19% : 0.000124s : 1: symbol_engine_optimizer 79.67% : 0.052473s : 1: type_inference TotalTime = 0.0644875, [30] [bootstrap]: 0.00028524 [type_inference]: 0.0540568 [event_method]: 1.902e-05 [auto_monad]: 6.926e-05 [graph_reusing]: 5.96998e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00028651 [rewriter_before_opt_a]: 8.243e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.0072722, [2] [Cycle 1]: 0.00328007, [27] [switch_simplify]: 6.051e-05 [loop_unroll]: 3.126e-05 [a_1]: 0.00058821 [with_stream_mark]: 1.873e-05 [recompute_prepare]: 9.51e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 4.68999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 6.38e-06 [renormalize]: 0.00221122 [add_forward_monad_depend]: 7.8e-06 [auto_monad_grad]: 3.38e-06 [auto_monad_eliminator]: 1.729e-05 [cse]: 2.595e-05 [replace_applicator]: 1.854e-05 [Cycle 2]: 0.00038918, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00012634 [with_stream_mark]: 1.31e-05 [recompute_prepare]: 6.24001e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 2.42001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 2.91999e-06 [replace_old_param]: 9.82001e-06 [inline_without_move]: 5.64e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 1.20999e-06 [auto_monad_eliminator]: 7.75e-06 [cse]: 1.316e-05 [replace_applicator]: 6.82002e-06 [py_interpret_to_execute_after_opt_a]: 1.408e-05 [rewriter_after_opt_a]: 3.56e-05 [convert_after_rewriter]: 6.84999e-06 [order_py_execute_after_rewriter]: 4.65999e-06 [mutable_eliminate]: 0.00071637 [jit_opt_b]: 8.383e-05, [1] [Cycle 1]: 7.52e-05, [2] [frontend_op_eliminate]: 4.386e-05 [inline_after_opt_a]: 1.849e-05 [cconv]: 2.773e-05 [loop_unroll]: 0.00044964 [jit_opt_after_cconv]: 0.00016451, [1] [Cycle 1]: 0.00015689, [11] [c_1]: 2.637e-05 [parameter_eliminate]: 3.01999e-06 [updatestate_depend_eliminate]: 7.46999e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 2.613e-05 [call_graph_tuple_transform]: 2.156e-05 [tuple_list_get_item_eliminator]: 7.06999e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 8.65001e-06 [add_recomputation]: 4.65e-05 [cse_after_recomputation]: 2.13e-05, [1] [Cycle 1]: 1.586e-05, [1] [cse]: 1.034e-05 [auto_monad_reorder]: 1.532e-05 [get_jit_bprop_graph]: 1.57001e-06 [rewriter_after_jit_bprop_graph]: 2.541e-05 [opt_after_jit_grad]: 0.00046487 [symbol_engine_optimizer]: 7.737e-05, [1] [Cycle 1]: 7.139e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.404e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 1.069e-05 [renormalize]: 4.19997e-07 [validate]: 4.432e-05 Sums bootstrap : 0.000285s : 0.47% type_inference : 0.054057s : 89.69% event_method : 0.000019s : 0.03% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000287s : 0.48% rewriter_before_opt_a : 0.000082s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000068s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000715s : 1.19% jit_opt_a.with_stream_mark : 0.000032s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002211s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000005s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.04% jit_opt_a.cse : 0.000039s : 0.06% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000716s : 1.19% jit_opt_b.frontend_op_eliminate : 0.000044s : 0.07% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000450s : 0.75% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000025s : 0.04% opt_after_jit_grad : 0.000465s : 0.77% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000210 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 4: substitution.graph_param_transform 82.48% : 0.000173s : 4: substitution.inline 1.72% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.71% : 0.000006s : 4: substitution.remove_not_recompute_node 2.73% : 0.000006s : 2: substitution.replace_old_param 6.14% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053972 2 96.24% : 0.051941s : 1: type_inference.infer 3.76% : 0.002031s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.86% : 0.000052s : 4: replace.inline 32.14% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 93.58% : 0.000171s : 4: match.inline 6.42% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.48% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.46% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.66% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.77% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.58% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000010s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002224 26 71.74% : 0.001596s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.82% : 0.000597s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067760 72 0.07% : 0.000049s : 1: add_recomputation 0.11% : 0.000073s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000298s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.74% : 0.007275s : 1: jit_opt_a 0.25% : 0.000167s : 1: jit_opt_after_cconv 0.13% : 0.000087s : 1: jit_opt_b 0.68% : 0.000458s : 1: loop_unroll 1.07% : 0.000727s : 1: mutable_eliminate 1.42% : 0.000961s : 26: opt.transform.jit_opt_a 0.09% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000055s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000294s : 1: py_interpret_to_execute 0.03% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.27% : 0.001539s : 1: renormalize.infer 0.98% : 0.000663s : 1: renormalize.specialize 0.04% : 0.000028s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000082s : 1: symbol_engine_optimizer 79.80% : 0.054072s : 1: type_inference TotalTime = 0.159865, [30] [bootstrap]: 0.00026833 [type_inference]: 0.13928 [event_method]: 2.896e-05 [auto_monad]: 8.56e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.70002e-06 [py_interpret_to_execute]: 0.00109672 [rewriter_before_opt_a]: 0.00014304 [expand_dump_flag]: 5.52001e-06 [jit_opt_a]: 0.0146988, [2] [Cycle 1]: 0.00855788, [27] [switch_simplify]: 7.827e-05 [loop_unroll]: 3.585e-05 [a_1]: 0.00082457 [with_stream_mark]: 2.172e-05 [recompute_prepare]: 1.096e-05 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.65998e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 7.76001e-06 [updatestate_useless_node_eliminater]: 6.74999e-06 [accelerated_algorithm]: 7.46999e-06 [meta_shard_fg_expand]: 3.39001e-06 [get_grad_eliminate_]: 8.08999e-06 [merge_forward]: 4.75001e-06 [cell_reuse_recompute_pass]: 1.61002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.887e-05 [j_node_and_user_rematch]: 1.266e-05 [meta_fg_expand]: 3.33e-06 [replace_old_param]: 1.311e-05 [inline_without_move]: 6.64999e-06 [renormalize]: 0.00712886 [add_forward_monad_depend]: 1.05e-05 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.276e-05 [cse]: 4.747e-05 [replace_applicator]: 3.094e-05 [Cycle 2]: 0.00055405, [27] [switch_simplify]: 9.03002e-06 [loop_unroll]: 7.68001e-06 [a_1]: 0.00018229 [with_stream_mark]: 2.167e-05 [recompute_prepare]: 9.50001e-06 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 7.75e-06 [accelerated_algorithm]: 8.38999e-06 [meta_shard_fg_expand]: 3.46999e-06 [get_grad_eliminate_]: 7.59002e-06 [merge_forward]: 7.01999e-06 [cell_reuse_recompute_pass]: 5.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.909e-05 [j_node_and_user_rematch]: 1.238e-05 [meta_fg_expand]: 4.12e-06 [replace_old_param]: 1.337e-05 [inline_without_move]: 6.88998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.56e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.227e-05 [cse]: 2.699e-05 [replace_applicator]: 8.21002e-06 [py_interpret_to_execute_after_opt_a]: 2.373e-05 [rewriter_after_opt_a]: 5.597e-05 [convert_after_rewriter]: 9.14998e-06 [order_py_execute_after_rewriter]: 6.45002e-06 [mutable_eliminate]: 0.00107851 [jit_opt_b]: 0.00017902, [1] [Cycle 1]: 0.00016264, [2] [frontend_op_eliminate]: 0.00011146 [inline_after_opt_a]: 2.695e-05 [cconv]: 3.709e-05 [loop_unroll]: 0.00083502 [jit_opt_after_cconv]: 0.00026196, [1] [Cycle 1]: 0.00024467, [11] [c_1]: 3.456e-05 [parameter_eliminate]: 1.638e-05 [updatestate_depend_eliminate]: 1.348e-05 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 4.448e-05 [call_graph_tuple_transform]: 4.037e-05 [tuple_list_get_item_eliminator]: 9.93998e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 8.59e-06 [remove_dup_value]: 2.48e-05 [partial_unused_args_eliminate]: 2.58003e-06 [environ_conv]: 1.277e-05 [add_recomputation]: 6.963e-05 [cse_after_recomputation]: 4.921e-05, [1] [Cycle 1]: 3.933e-05, [1] [cse]: 2.288e-05 [auto_monad_reorder]: 3.038e-05 [get_jit_bprop_graph]: 3.27997e-06 [rewriter_after_jit_bprop_graph]: 1.231e-05 [opt_after_jit_grad]: 0.00078611 [symbol_engine_optimizer]: 0.00010768, [1] [Cycle 1]: 9.85e-05, [6] [build]: 5.98002e-06 [elim_shapecalc]: 9.76e-06 [elim_not_effective]: 2.339e-05 [opt_reshape]: 1.405e-05 [fold_const_symbol]: 1.107e-05 [renormalize]: 2.10013e-07 [validate]: 0.00040308 Sums bootstrap : 0.000268s : 0.17% type_inference : 0.139280s : 90.78% event_method : 0.000029s : 0.02% auto_monad : 0.000086s : 0.06% graph_reusing : 0.000007s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.001097s : 0.71% rewriter_before_opt_a : 0.000143s : 0.09% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000087s : 0.06% jit_opt_a.loop_unroll : 0.000044s : 0.03% jit_opt_a.a_1 : 0.001007s : 0.66% jit_opt_a.with_stream_mark : 0.000043s : 0.03% jit_opt_a.recompute_prepare : 0.000020s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000014s : 0.01% jit_opt_a.accelerated_algorithm : 0.000016s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000007s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000016s : 0.01% jit_opt_a.merge_forward : 0.000012s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000007s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000038s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000025s : 0.02% jit_opt_a.meta_fg_expand : 0.000007s : 0.00% jit_opt_a.replace_old_param : 0.000026s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.007129s : 4.65% jit_opt_a.add_forward_monad_depend : 0.000013s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.02% jit_opt_a.cse : 0.000074s : 0.05% jit_opt_a.replace_applicator : 0.000039s : 0.03% py_interpret_to_execute_after_opt_a : 0.000024s : 0.02% rewriter_after_opt_a : 0.000056s : 0.04% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.001079s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000111s : 0.07% jit_opt_b.inline_after_opt_a : 0.000027s : 0.02% cconv : 0.000037s : 0.02% loop_unroll : 0.000835s : 0.54% jit_opt_after_cconv.c_1 : 0.000035s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000016s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000040s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000010s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000025s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000013s : 0.01% add_recomputation : 0.000070s : 0.05% cse_after_recomputation.cse : 0.000023s : 0.01% auto_monad_reorder : 0.000030s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000012s : 0.01% opt_after_jit_grad : 0.000786s : 0.51% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000023s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000014s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000403s : 0.26% Time group info: ------[substitution.] 0.000352 28 0.56% : 0.000002s : 2: substitution.elim_not_effective 0.40% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000010s : 4: substitution.graph_param_transform 81.72% : 0.000288s : 5: substitution.inline 1.43% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.88% : 0.000017s : 3: substitution.reduce_eliminate 2.04% : 0.000007s : 4: substitution.remove_not_recompute_node 2.04% : 0.000007s : 2: substitution.replace_old_param 4.14% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.139161 2 94.84% : 0.131981s : 1: type_inference.infer 5.16% : 0.007180s : 1: type_inference.specialize ------[replace.] 0.000138 7 65.86% : 0.000091s : 5: replace.inline 34.14% : 0.000047s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000297 7 95.54% : 0.000284s : 5: match.inline 4.46% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000177 886 1.19% : 0.000002s : 13: predicate.accumulaten_eliminater 1.36% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.10% : 0.000004s : 13: predicate.arithmetic_simplify 1.59% : 0.000003s : 13: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.46% : 0.000003s : 13: predicate.compare_switch_simplify 1.08% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.59% : 0.000003s : 13: predicate.dict_set_item_eliminator 0.59% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_depend_swap 1.07% : 0.000002s : 13: predicate.environ_get_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.21% : 0.000000s : 4: predicate.graph_param_transform 4.85% : 0.000009s : 28: predicate.inline 0.94% : 0.000002s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000003s : 8: predicate.less_batch_normalization 1.64% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 19: predicate.load_eliminater 2.37% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.58% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.78% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 13: predicate.merge_addn 0.87% : 0.000002s : 13: predicate.minmaximum_grad 2.45% : 0.000004s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000004s : 19: predicate.partial_eliminate 1.35% : 0.000002s : 13: predicate.print_const_string_wrapper 2.11% : 0.000004s : 13: predicate.reduce_eliminate 1.45% : 0.000003s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000004s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.01% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.26% : 0.000002s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.80% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.81% : 0.000003s : 8: predicate.special_op_eliminate 0.85% : 0.000002s : 8: predicate.specialize_transform 1.27% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.11% : 0.000004s : 20: predicate.switch_defer_inline 1.76% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.14% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.30% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000003s : 13: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000007s : 23: predicate.tuple_list_get_item_eliminator 1.57% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.60% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.33% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.99% : 0.000004s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.08% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003963 25 47.36% : 0.001877s : 16: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 50.70% : 0.002009s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.168165 72 0.05% : 0.000076s : 1: add_recomputation 0.05% : 0.000089s : 1: auto_monad 0.02% : 0.000034s : 1: auto_monad_reorder 0.17% : 0.000279s : 1: bootstrap 0.02% : 0.000041s : 1: cconv 0.01% : 0.000012s : 1: convert_after_rewriter 0.03% : 0.000053s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.00% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 8.74% : 0.014706s : 1: jit_opt_a 0.16% : 0.000266s : 1: jit_opt_after_cconv 0.11% : 0.000183s : 1: jit_opt_b 0.50% : 0.000847s : 1: loop_unroll 0.65% : 0.001093s : 1: mutable_eliminate 0.79% : 0.001322s : 26: opt.transform.jit_opt_a 0.05% : 0.000088s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000128s : 4: opt.transform.jit_opt_b 0.01% : 0.000022s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000031s : 1: opt.transform.mutable_eliminate 0.02% : 0.000036s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000054s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000798s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.66% : 0.001108s : 1: py_interpret_to_execute 0.02% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000028s : 1: remove_dup_value 2.99% : 0.005036s : 1: renormalize.infer 1.23% : 0.002074s : 1: renormalize.specialize 0.01% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000062s : 1: rewriter_after_opt_a 0.09% : 0.000150s : 1: rewriter_before_opt_a 0.07% : 0.000110s : 1: symbol_engine_optimizer 82.84% : 0.139307s : 1: type_inference TotalTime = 0.0120022, [30] [bootstrap]: 0.00026626 [type_inference]: 0.00444187 [event_method]: 1.774e-05 [auto_monad]: 6.526e-05 [graph_reusing]: 5.65001e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 4.126e-05 [rewriter_before_opt_a]: 7.153e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.0050715, [2] [Cycle 1]: 0.0015681, [27] [switch_simplify]: 5.361e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00051749 [with_stream_mark]: 1.572e-05 [recompute_prepare]: 7.15e-06 [updatestate_depend_eliminate]: 3.72998e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.83998e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 8.52998e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00063179 [add_forward_monad_depend]: 5.97001e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.463e-05 [cse]: 2.948e-05 [replace_applicator]: 1.166e-05 [Cycle 2]: 0.00031114, [27] [switch_simplify]: 5.57001e-06 [loop_unroll]: 4.75999e-06 [a_1]: 8.876e-05 [with_stream_mark]: 8.2e-06 [recompute_prepare]: 4.70001e-06 [updatestate_depend_eliminate]: 2.51998e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 4.80001e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.38001e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.40999e-06 [merge_forward]: 2.70002e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.305e-05 [j_node_and_user_rematch]: 7.49002e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.23999e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.43002e-06 [cse]: 1.125e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 8.47e-06 [rewriter_after_opt_a]: 3.347e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00050523 [jit_opt_b]: 4.859e-05, [1] [Cycle 1]: 4.169e-05, [2] [frontend_op_eliminate]: 1.534e-05 [inline_after_opt_a]: 1.499e-05 [cconv]: 2.482e-05 [loop_unroll]: 0.00040955 [jit_opt_after_cconv]: 0.00013964, [1] [Cycle 1]: 0.00013341, [11] [c_1]: 2.13e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 6.14999e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.983e-05 [call_graph_tuple_transform]: 1.808e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.462e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 6.62002e-06 [add_recomputation]: 4.671e-05 [cse_after_recomputation]: 2.278e-05, [1] [Cycle 1]: 1.709e-05, [1] [cse]: 1.108e-05 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 1.77999e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00044121 [symbol_engine_optimizer]: 7.082e-05, [1] [Cycle 1]: 6.488e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.72001e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 3.89991e-07 [validate]: 3.743e-05 Sums bootstrap : 0.000266s : 3.23% type_inference : 0.004442s : 53.86% event_method : 0.000018s : 0.22% auto_monad : 0.000065s : 0.79% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000041s : 0.50% rewriter_before_opt_a : 0.000072s : 0.87% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000059s : 0.72% jit_opt_a.loop_unroll : 0.000035s : 0.43% jit_opt_a.a_1 : 0.000606s : 7.35% jit_opt_a.with_stream_mark : 0.000024s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.13% jit_opt_a.renormalize : 0.000632s : 7.66% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000041s : 0.49% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000033s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000505s : 6.13% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.30% loop_unroll : 0.000410s : 4.97% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000007s : 0.08% add_recomputation : 0.000047s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.07% opt_after_jit_grad : 0.000441s : 5.35% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.45% Time group info: ------[substitution.] 0.000186 23 1.17% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000005s : 3: substitution.graph_param_transform 82.08% : 0.000153s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 6.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004380 2 80.54% : 0.003527s : 1: type_inference.infer 19.46% : 0.000852s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.59% : 0.000046s : 4: replace.inline 33.41% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 92.88% : 0.000150s : 4: match.inline 7.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.47% : 0.000002s : 10: predicate.addn_zero_filter 2.32% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000009s : 53: predicate.switch_simplify 1.14% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000591 13 49.81% : 0.000294s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.86% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.34% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013493 72 0.37% : 0.000050s : 1: add_recomputation 0.51% : 0.000068s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.08% : 0.000281s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.61% : 0.005074s : 1: jit_opt_a 1.05% : 0.000142s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.10% : 0.000418s : 1: loop_unroll 3.81% : 0.000514s : 1: mutable_eliminate 6.03% : 0.000814s : 26: opt.transform.jit_opt_a 0.34% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.33% : 0.000450s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.42% : 0.000326s : 1: renormalize.infer 2.22% : 0.000299s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000036s : 1: rewriter_after_opt_a 0.55% : 0.000074s : 1: rewriter_before_opt_a 0.54% : 0.000073s : 1: symbol_engine_optimizer 33.01% : 0.004454s : 1: type_inference TotalTime = 0.0121982, [30] [bootstrap]: 0.00026264 [type_inference]: 0.0047325 [event_method]: 1.738e-05 [auto_monad]: 6.201e-05 [graph_reusing]: 6.20002e-06 [pre_auto_parallel]: 2.03002e-06 [py_interpret_to_execute]: 4.205e-05 [rewriter_before_opt_a]: 7.233e-05 [expand_dump_flag]: 2.78e-06 [jit_opt_a]: 0.00494581, [2] [Cycle 1]: 0.00151553, [27] [switch_simplify]: 4.827e-05 [loop_unroll]: 3.076e-05 [a_1]: 0.0005108 [with_stream_mark]: 1.31e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 5.21002e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.144e-05 [j_node_and_user_rematch]: 8.70001e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 7.64002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00062568 [add_forward_monad_depend]: 4.1e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 1.16e-05 [cse]: 1.8e-05 [replace_applicator]: 1.129e-05 [Cycle 2]: 0.0003121, [27] [switch_simplify]: 5.74999e-06 [loop_unroll]: 4.98001e-06 [a_1]: 9.067e-05 [with_stream_mark]: 8.88002e-06 [recompute_prepare]: 4.99e-06 [updatestate_depend_eliminate]: 2.83998e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 4.85999e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 4.77998e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 2.34999e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 8.05e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 7.63001e-06 [inline_without_move]: 5.03002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 1.055e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 8.33999e-06 [rewriter_after_opt_a]: 2.766e-05 [convert_after_rewriter]: 5.72001e-06 [order_py_execute_after_rewriter]: 4.15999e-06 [mutable_eliminate]: 0.00052162 [jit_opt_b]: 4.969e-05, [1] [Cycle 1]: 4.323e-05, [2] [frontend_op_eliminate]: 1.675e-05 [inline_after_opt_a]: 1.504e-05 [cconv]: 2.119e-05 [loop_unroll]: 0.00044854 [jit_opt_after_cconv]: 0.00014052, [1] [Cycle 1]: 0.00013384, [11] [c_1]: 2.165e-05 [parameter_eliminate]: 2.44001e-06 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.56e-06 [cse]: 2.225e-05 [call_graph_tuple_transform]: 1.653e-05 [tuple_list_get_item_eliminator]: 5.29998e-06 [none_parameter_eliminate]: 1.22e-06 [renormalize]: 5.10016e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.064e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 5.09e-06 [add_recomputation]: 5.368e-05 [cse_after_recomputation]: 2.324e-05, [1] [Cycle 1]: 1.775e-05, [1] [cse]: 1.194e-05 [auto_monad_reorder]: 1.214e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 4.57e-06 [opt_after_jit_grad]: 0.00045356 [symbol_engine_optimizer]: 7.037e-05, [1] [Cycle 1]: 6.451e-05, [6] [build]: 2.96001e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.233e-05 [opt_reshape]: 5.76003e-06 [fold_const_symbol]: 8.39998e-06 [renormalize]: 3.69997e-07 [validate]: 3.251e-05 Sums bootstrap : 0.000263s : 3.08% type_inference : 0.004733s : 55.41% event_method : 0.000017s : 0.20% auto_monad : 0.000062s : 0.73% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000042s : 0.49% rewriter_before_opt_a : 0.000072s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.63% jit_opt_a.loop_unroll : 0.000036s : 0.42% jit_opt_a.a_1 : 0.000601s : 7.04% jit_opt_a.with_stream_mark : 0.000022s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000626s : 7.33% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.20% jit_opt_a.cse : 0.000029s : 0.33% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000028s : 0.32% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000522s : 6.11% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000021s : 0.25% loop_unroll : 0.000449s : 5.25% jit_opt_after_cconv.c_1 : 0.000022s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000011s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000054s : 0.63% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000012s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000454s : 5.31% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.38% Time group info: ------[substitution.] 0.000168 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000004s : 3: substitution.graph_param_transform 84.26% : 0.000142s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000004s : 4: substitution.remove_not_recompute_node 2.01% : 0.000003s : 2: substitution.replace_old_param 5.33% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004675 2 80.12% : 0.003746s : 1: type_inference.infer 19.88% : 0.000929s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.79% : 0.000045s : 4: replace.inline 34.21% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 94.68% : 0.000139s : 4: match.inline 5.32% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.35% : 0.000003s : 3: predicate.mutable_eliminate 0.78% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.39% : 0.000002s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.42% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.56% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000666 13 49.79% : 0.000331s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.30% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.91% : 0.000306s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013705 72 0.42% : 0.000057s : 1: add_recomputation 0.48% : 0.000065s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 2.01% : 0.000275s : 1: bootstrap 0.18% : 0.000024s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 36.11% : 0.004948s : 1: jit_opt_a 1.04% : 0.000143s : 1: jit_opt_after_cconv 0.38% : 0.000052s : 1: jit_opt_b 3.33% : 0.000457s : 1: loop_unroll 3.88% : 0.000532s : 1: mutable_eliminate 5.87% : 0.000804s : 26: opt.transform.jit_opt_a 0.33% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.18% : 0.000025s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.37% : 0.000461s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000045s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000013s : 1: remove_dup_value 2.30% : 0.000315s : 1: renormalize.infer 2.22% : 0.000305s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000031s : 1: rewriter_after_opt_a 0.55% : 0.000075s : 1: rewriter_before_opt_a 0.53% : 0.000073s : 1: symbol_engine_optimizer 34.62% : 0.004745s : 1: type_inference TotalTime = 0.120778, [30] [bootstrap]: 0.00031126 [type_inference]: 0.109765 [event_method]: 2.02e-05 [auto_monad]: 6.89e-05 [graph_reusing]: 7.18998e-06 [pre_auto_parallel]: 3.18e-06 [py_interpret_to_execute]: 0.00057153 [rewriter_before_opt_a]: 9.529e-05 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.00765599, [2] [Cycle 1]: 0.00395219, [27] [switch_simplify]: 6.258e-05 [loop_unroll]: 3.434e-05 [a_1]: 0.00077245 [with_stream_mark]: 1.711e-05 [recompute_prepare]: 9.31e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 7.98001e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 7.21001e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.705e-05 [j_node_and_user_rematch]: 1.096e-05 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 1.181e-05 [inline_without_move]: 6.71e-06 [renormalize]: 0.00270211 [add_forward_monad_depend]: 6.83998e-06 [auto_monad_grad]: 2.16003e-06 [auto_monad_eliminator]: 1.627e-05 [cse]: 3.388e-05 [replace_applicator]: 1.507e-05 [Cycle 2]: 0.00041141, [27] [switch_simplify]: 7.53999e-06 [loop_unroll]: 6.46999e-06 [a_1]: 0.00014223 [with_stream_mark]: 1.043e-05 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 6.36998e-06 [updatestate_useless_node_eliminater]: 6.44001e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 6.78998e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 2.34999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 8.43999e-06 [inline_without_move]: 6.13998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.16998e-06 [cse]: 1.496e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.226e-05 [rewriter_after_opt_a]: 3.834e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.0005764 [jit_opt_b]: 5.493e-05, [1] [Cycle 1]: 4.825e-05, [2] [frontend_op_eliminate]: 1.914e-05 [inline_after_opt_a]: 1.743e-05 [cconv]: 2.292e-05 [loop_unroll]: 0.00043337 [jit_opt_after_cconv]: 0.0001582, [1] [Cycle 1]: 0.00015122, [11] [c_1]: 2.612e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.23998e-06 [cse]: 2.419e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 6.86001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.51e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.93999e-06 [add_recomputation]: 4.607e-05 [cse_after_recomputation]: 2.318e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.877e-05 [get_jit_bprop_graph]: 1.80001e-06 [rewriter_after_jit_bprop_graph]: 5.90002e-06 [opt_after_jit_grad]: 0.00047617 [symbol_engine_optimizer]: 8.006e-05, [1] [Cycle 1]: 7.282e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 9.62999e-06 [elim_not_effective]: 1.398e-05 [opt_reshape]: 8.03001e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 4.60015e-07 [validate]: 0.00011669 Sums bootstrap : 0.000311s : 0.27% type_inference : 0.109765s : 93.91% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000572s : 0.49% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000915s : 0.78% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002702s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000576s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000433s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000476s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000117s : 0.10% Time group info: ------[substitution.] 0.000313 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.87% : 0.000006s : 4: substitution.graph_param_transform 85.71% : 0.000269s : 5: substitution.inline 1.15% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.63% : 0.000011s : 3: substitution.reduce_eliminate 1.54% : 0.000005s : 4: substitution.remove_not_recompute_node 1.46% : 0.000005s : 2: substitution.replace_old_param 3.53% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109691 2 97.30% : 0.106731s : 1: type_inference.infer 2.70% : 0.002960s : 1: type_inference.specialize ------[replace.] 0.000103 7 68.75% : 0.000071s : 5: replace.inline 31.25% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000275 7 96.40% : 0.000265s : 5: match.inline 3.60% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000149 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 13: predicate.addn_check_dump 1.45% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000008s : 28: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.01% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.34% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.26% : 0.000002s : 13: predicate.minmaximum_grad 1.07% : 0.000002s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.57% : 0.000004s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000002s : 8: predicate.specialize_transform 1.62% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000011s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.69% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002329 25 63.09% : 0.001470s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.51% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.40% : 0.000801s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124652 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000325s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.14% : 0.007659s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.35% : 0.000441s : 1: loop_unroll 0.47% : 0.000585s : 1: mutable_eliminate 0.94% : 0.001170s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.47% : 0.000580s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.50% : 0.001867s : 1: renormalize.infer 0.66% : 0.000825s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000099s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.07% : 0.109779s : 1: type_inference TotalTime = 0.114276, [30] [bootstrap]: 0.00032676 [type_inference]: 0.103415 [event_method]: 1.847e-05 [auto_monad]: 6.622e-05 [graph_reusing]: 5.14e-06 [pre_auto_parallel]: 2.07999e-06 [py_interpret_to_execute]: 0.00055218 [rewriter_before_opt_a]: 8.54e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00745212, [2] [Cycle 1]: 0.00369109, [27] [switch_simplify]: 5.75e-05 [loop_unroll]: 3.087e-05 [a_1]: 0.0005951 [with_stream_mark]: 1.645e-05 [recompute_prepare]: 9.07001e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 2.12999e-06 [get_grad_eliminate_]: 6.33998e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.426e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.67999e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.00265248 [add_forward_monad_depend]: 6.22001e-06 [auto_monad_grad]: 1.99e-06 [auto_monad_eliminator]: 1.652e-05 [cse]: 2.485e-05 [replace_applicator]: 1.597e-05 [Cycle 2]: 0.00038001, [27] [switch_simplify]: 6.68998e-06 [loop_unroll]: 5.95002e-06 [a_1]: 0.00012458 [with_stream_mark]: 1.07e-05 [recompute_prepare]: 6.40002e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 1.98002e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.77002e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 2.79999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.775e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 6.14001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.06998e-06 [cse]: 1.129e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.081e-05 [rewriter_after_opt_a]: 3.298e-05 [convert_after_rewriter]: 7.21001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00065497 [jit_opt_b]: 7.008e-05, [1] [Cycle 1]: 6.276e-05, [2] [frontend_op_eliminate]: 3.216e-05 [inline_after_opt_a]: 1.785e-05 [cconv]: 2.399e-05 [loop_unroll]: 0.00043765 [jit_opt_after_cconv]: 0.00015564, [1] [Cycle 1]: 0.00014866, [11] [c_1]: 2.546e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 6.86999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.253e-05 [call_graph_tuple_transform]: 2.273e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 8.59989e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.557e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 6.96001e-06 [add_recomputation]: 4.566e-05 [cse_after_recomputation]: 2.274e-05, [1] [Cycle 1]: 1.733e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.661e-05 [get_jit_bprop_graph]: 1.97999e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00046081 [symbol_engine_optimizer]: 7.869e-05, [1] [Cycle 1]: 7.109e-05, [6] [build]: 3.59002e-06 [elim_shapecalc]: 8.33001e-06 [elim_not_effective]: 1.505e-05 [opt_reshape]: 8.55001e-06 [fold_const_symbol]: 8.70999e-06 [renormalize]: 3.50003e-07 [validate]: 0.00012141 Sums bootstrap : 0.000327s : 0.30% type_inference : 0.103415s : 93.75% event_method : 0.000018s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000552s : 0.50% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000720s : 0.65% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002653s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000655s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000032s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000438s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000461s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000121s : 0.11% Time group info: ------[substitution.] 0.000222 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.94% : 0.000007s : 4: substitution.graph_param_transform 84.09% : 0.000187s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000006s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103347 2 97.36% : 0.100621s : 1: type_inference.infer 2.64% : 0.002726s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.06% : 0.000051s : 4: replace.inline 31.94% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.26% : 0.000184s : 4: match.inline 5.74% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.14% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.09% : 0.000007s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.64% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.78% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.57% : 0.000002s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.22% : 0.000003s : 22: predicate.replace_applicator 0.97% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.62% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000010s : 58: predicate.switch_simplify 1.63% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.96% : 0.000003s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002031 22 65.58% : 0.001332s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.99% : 0.000670s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117898 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.29% : 0.000340s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.32% : 0.007456s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.06% : 0.000073s : 1: jit_opt_b 0.38% : 0.000446s : 1: loop_unroll 0.56% : 0.000663s : 1: mutable_eliminate 0.82% : 0.000961s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000468s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000561s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.64% : 0.001936s : 1: renormalize.infer 0.60% : 0.000707s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000089s : 1: rewriter_before_opt_a 0.07% : 0.000081s : 1: symbol_engine_optimizer 87.73% : 0.103430s : 1: type_inference TotalTime = 0.12281, [30] [bootstrap]: 0.00030987 [type_inference]: 0.111928 [event_method]: 2.228e-05 [auto_monad]: 6.782e-05 [graph_reusing]: 5.35999e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00052822 [rewriter_before_opt_a]: 9.646e-05 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.00757288, [2] [Cycle 1]: 0.00377972, [27] [switch_simplify]: 5.644e-05 [loop_unroll]: 3.394e-05 [a_1]: 0.00064259 [with_stream_mark]: 1.382e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 6.43003e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.225e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 6.51e-06 [renormalize]: 0.00270382 [add_forward_monad_depend]: 6.01e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.393e-05 [cse]: 2.374e-05 [replace_applicator]: 1.569e-05 [Cycle 2]: 0.00041528, [27] [switch_simplify]: 7.56001e-06 [loop_unroll]: 6.82002e-06 [a_1]: 0.00014684 [with_stream_mark]: 1.244e-05 [recompute_prepare]: 6.63e-06 [updatestate_depend_eliminate]: 3.57002e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 6.38003e-06 [accelerated_algorithm]: 6.31998e-06 [meta_shard_fg_expand]: 1.71998e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 2.00002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.3e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.06e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.92001e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.86999e-06 [cse]: 1.593e-05 [replace_applicator]: 6.77002e-06 [py_interpret_to_execute_after_opt_a]: 1.18e-05 [rewriter_after_opt_a]: 3.777e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 4.56002e-06 [mutable_eliminate]: 0.00059495 [jit_opt_b]: 5.736e-05, [1] [Cycle 1]: 5.062e-05, [2] [frontend_op_eliminate]: 2.043e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 1.906e-05 [loop_unroll]: 0.00043959 [jit_opt_after_cconv]: 0.00016143, [1] [Cycle 1]: 0.00015463, [11] [c_1]: 2.921e-05 [parameter_eliminate]: 3.08e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.69999e-06 [cse]: 2.568e-05 [call_graph_tuple_transform]: 1.958e-05 [tuple_list_get_item_eliminator]: 7.41999e-06 [none_parameter_eliminate]: 9.50007e-07 [renormalize]: 3.80009e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 1.293e-05 [partial_unused_args_eliminate]: 1.74e-06 [environ_conv]: 6.47001e-06 [add_recomputation]: 3.96e-05 [cse_after_recomputation]: 2.347e-05, [1] [Cycle 1]: 1.839e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.258e-05 [get_jit_bprop_graph]: 1.67001e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00046381 [symbol_engine_optimizer]: 0.00016326, [1] [Cycle 1]: 0.00015702, [6] [build]: 3.10998e-06 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 8.941e-05 [fold_const_symbol]: 1.104e-05 [renormalize]: 4.50003e-07 [validate]: 3.955e-05 Sums bootstrap : 0.000310s : 0.26% type_inference : 0.111928s : 94.18% event_method : 0.000022s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000528s : 0.44% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000789s : 0.66% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002704s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000040s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000595s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000019s : 0.02% loop_unroll : 0.000440s : 0.37% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000040s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000464s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000089s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000221 28 0.66% : 0.000001s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.02% : 0.000004s : 4: substitution.graph_param_transform 83.29% : 0.000184s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.63% : 0.000010s : 3: substitution.reduce_eliminate 2.01% : 0.000004s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 3.70% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111848 2 97.26% : 0.108780s : 1: type_inference.infer 2.74% : 0.003068s : 1: type_inference.specialize ------[replace.] 0.000096 7 66.71% : 0.000064s : 5: replace.inline 33.29% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 7 96.27% : 0.000181s : 5: match.inline 3.73% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.54% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.28% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.11% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 19: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.36% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.33% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.64% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000004s : 20: predicate.switch_defer_inline 2.23% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.10% : 0.000010s : 64: predicate.switch_simplify 1.54% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.86% : 0.000003s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002315 25 62.42% : 0.001445s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.13% : 0.000814s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126715 72 0.03% : 0.000042s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000321s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.98% : 0.007576s : 1: jit_opt_a 0.13% : 0.000164s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.35% : 0.000448s : 1: loop_unroll 0.48% : 0.000604s : 1: mutable_eliminate 0.82% : 0.001034s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000119s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000535s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.49% : 0.001890s : 1: renormalize.infer 0.64% : 0.000806s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.13% : 0.000166s : 1: symbol_engine_optimizer 88.34% : 0.111942s : 1: type_inference TotalTime = 0.115277, [30] [bootstrap]: 0.00030475 [type_inference]: 0.104904 [event_method]: 1.749e-05 [auto_monad]: 5.999e-05 [graph_reusing]: 5.42999e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00050072 [rewriter_before_opt_a]: 8.512e-05 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.00733764, [2] [Cycle 1]: 0.00364365, [27] [switch_simplify]: 5.169e-05 [loop_unroll]: 3.07e-05 [a_1]: 0.00055055 [with_stream_mark]: 1.323e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 3.42997e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 7.54002e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 6.76e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.96998e-06 [renormalize]: 0.00269096 [add_forward_monad_depend]: 5.04e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 1.257e-05 [cse]: 1.929e-05 [replace_applicator]: 1.24e-05 [Cycle 2]: 0.00036447, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 6.11998e-06 [a_1]: 0.0001252 [with_stream_mark]: 1.048e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.58002e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.80002e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.364e-05 [j_node_and_user_rematch]: 8.70999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 9.44e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.98998e-06 [cse]: 1.029e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 9.50001e-06 [rewriter_after_opt_a]: 2.945e-05 [convert_after_rewriter]: 6.16e-06 [order_py_execute_after_rewriter]: 4.48001e-06 [mutable_eliminate]: 0.00054731 [jit_opt_b]: 5.498e-05, [1] [Cycle 1]: 4.913e-05, [2] [frontend_op_eliminate]: 2.046e-05 [inline_after_opt_a]: 1.699e-05 [cconv]: 1.815e-05 [loop_unroll]: 0.00042292 [jit_opt_after_cconv]: 0.00014512, [1] [Cycle 1]: 0.00013913, [11] [c_1]: 2.576e-05 [parameter_eliminate]: 2.94001e-06 [updatestate_depend_eliminate]: 4.19997e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 2.036e-05 [call_graph_tuple_transform]: 1.879e-05 [tuple_list_get_item_eliminator]: 6.35002e-06 [none_parameter_eliminate]: 1.19998e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.03002e-06 [remove_dup_value]: 8.47e-06 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.41e-06 [add_recomputation]: 3.812e-05 [cse_after_recomputation]: 2.131e-05, [1] [Cycle 1]: 1.607e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.137e-05 [get_jit_bprop_graph]: 1.27999e-06 [rewriter_after_jit_bprop_graph]: 4.80999e-06 [opt_after_jit_grad]: 0.00045411 [symbol_engine_optimizer]: 7.275e-05, [1] [Cycle 1]: 6.664e-05, [6] [build]: 2.49999e-06 [elim_shapecalc]: 8.43999e-06 [elim_not_effective]: 1.291e-05 [opt_reshape]: 6.63998e-06 [fold_const_symbol]: 8.79003e-06 [renormalize]: 4.50003e-07 [validate]: 3.493e-05 Sums bootstrap : 0.000305s : 0.27% type_inference : 0.104904s : 94.17% event_method : 0.000017s : 0.02% auto_monad : 0.000060s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000501s : 0.45% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000676s : 0.61% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002691s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000547s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000423s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000454s : 0.41% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.03% Time group info: ------[substitution.] 0.000178 24 0.78% : 0.000001s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000005s : 4: substitution.graph_param_transform 83.89% : 0.000149s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000004s : 2: substitution.replace_old_param 5.50% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104834 2 97.20% : 0.101902s : 1: type_inference.infer 2.80% : 0.002932s : 1: type_inference.specialize ------[replace.] 0.000070 6 65.74% : 0.000046s : 4: replace.inline 34.26% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 94.41% : 0.000147s : 4: match.inline 5.59% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.23% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.21% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000001s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000002s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.94% : 0.000009s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.47% : 0.000002s : 12: predicate.transpose_eliminate 1.60% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.12% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002139 22 61.81% : 0.001322s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.25% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.94% : 0.000790s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118947 72 0.03% : 0.000041s : 1: add_recomputation 0.05% : 0.000063s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.27% : 0.000318s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.17% : 0.007341s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.36% : 0.000429s : 1: loop_unroll 0.47% : 0.000554s : 1: mutable_eliminate 0.76% : 0.000902s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000507s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.57% : 0.001870s : 1: renormalize.infer 0.68% : 0.000814s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.21% : 0.104918s : 1: type_inference TotalTime = 0.118738, [30] [bootstrap]: 0.00028998 [type_inference]: 0.107957 [event_method]: 2.014e-05 [auto_monad]: 4.897e-05 [graph_reusing]: 4.22e-06 [pre_auto_parallel]: 1.77001e-06 [py_interpret_to_execute]: 0.00055972 [rewriter_before_opt_a]: 8.905e-05 [expand_dump_flag]: 2.31998e-06 [jit_opt_a]: 0.00725487, [2] [Cycle 1]: 0.00379472, [27] [switch_simplify]: 6.187e-05 [loop_unroll]: 3.726e-05 [a_1]: 0.0006346 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 3.27997e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 8.29983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 9.51998e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 6.17001e-06 [renormalize]: 0.00269768 [add_forward_monad_depend]: 4.4e-06 [auto_monad_grad]: 1.07e-06 [auto_monad_eliminator]: 1.032e-05 [cse]: 2.287e-05 [replace_applicator]: 1.309e-05 [Cycle 2]: 0.00037926, [27] [switch_simplify]: 7.1e-06 [loop_unroll]: 6.17001e-06 [a_1]: 0.00013136 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 6.50002e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 2.39001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.192e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 5.64e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.06997e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.33e-06 [cse]: 1.541e-05 [replace_applicator]: 6.29999e-06 [py_interpret_to_execute_after_opt_a]: 1.112e-05 [rewriter_after_opt_a]: 2.97e-05 [convert_after_rewriter]: 6.28002e-06 [order_py_execute_after_rewriter]: 4.552e-05 [mutable_eliminate]: 0.00058555 [jit_opt_b]: 6.136e-05, [1] [Cycle 1]: 5.481e-05, [2] [frontend_op_eliminate]: 2.192e-05 [inline_after_opt_a]: 2.172e-05 [cconv]: 2.038e-05 [loop_unroll]: 0.0004918 [jit_opt_after_cconv]: 0.00016936, [1] [Cycle 1]: 0.00016343, [11] [c_1]: 2.69e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 4.63999e-06 [updatestate_assign_eliminate]: 2.65997e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.806e-05 [call_graph_tuple_transform]: 2.536e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 6.44001e-06 [remove_dup_value]: 1.458e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 9.81998e-06 [add_recomputation]: 4.261e-05 [cse_after_recomputation]: 2.768e-05, [1] [Cycle 1]: 1.895e-05, [1] [cse]: 1.281e-05 [auto_monad_reorder]: 1.37e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.00048803 [symbol_engine_optimizer]: 0.00026798, [1] [Cycle 1]: 0.00026184, [6] [build]: 2.73e-06 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 1.542e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 0.0001942 [renormalize]: 5.69999e-07 [validate]: 4.512e-05 Sums bootstrap : 0.000290s : 0.25% type_inference : 0.107957s : 93.85% event_method : 0.000020s : 0.02% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000560s : 0.49% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000043s : 0.04% jit_opt_a.a_1 : 0.000766s : 0.67% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002698s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.01% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000046s : 0.04% mutable_eliminate : 0.000586s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000022s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000492s : 0.43% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000043s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000488s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000194s : 0.17% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000217 28 1.70% : 0.000004s : 2: substitution.elim_not_effective 0.92% : 0.000002s : 2: substitution.fold_const_symbol 2.42% : 0.000005s : 4: substitution.graph_param_transform 81.91% : 0.000178s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.39% : 0.000010s : 3: substitution.reduce_eliminate 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 3.44% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107890 2 97.30% : 0.104973s : 1: type_inference.infer 2.70% : 0.002917s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.34% : 0.000066s : 5: replace.inline 31.66% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 7 96.52% : 0.000175s : 5: match.inline 3.48% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 2.25% : 0.000003s : 13: predicate.arithmetic_simplify 1.38% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.15% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.59% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.06% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.45% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.23% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 19: predicate.partial_eliminate 1.30% : 0.000002s : 13: predicate.print_const_string_wrapper 2.22% : 0.000003s : 13: predicate.reduce_eliminate 1.33% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.85% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 64: predicate.switch_simplify 1.42% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.26% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002197 25 62.50% : 0.001373s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.62% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.89% : 0.000766s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122711 72 0.04% : 0.000045s : 1: add_recomputation 0.04% : 0.000052s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000302s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.91% : 0.007258s : 1: jit_opt_a 0.14% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.41% : 0.000499s : 1: loop_unroll 0.48% : 0.000594s : 1: mutable_eliminate 0.82% : 0.001009s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000036s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000221s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000496s : 1: opt_after_jit_grad 0.04% : 0.000048s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000566s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.58% : 0.001934s : 1: renormalize.infer 0.62% : 0.000757s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000094s : 1: rewriter_before_opt_a 0.22% : 0.000271s : 1: symbol_engine_optimizer 87.99% : 0.107969s : 1: type_inference TotalTime = 0.115013, [30] [bootstrap]: 0.00025963 [type_inference]: 0.104142 [event_method]: 1.836e-05 [auto_monad]: 6.648e-05 [graph_reusing]: 5.09e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00047325 [rewriter_before_opt_a]: 8.304e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00762501, [2] [Cycle 1]: 0.00380975, [27] [switch_simplify]: 6.173e-05 [loop_unroll]: 3.013e-05 [a_1]: 0.00057483 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 9.71998e-06 [updatestate_depend_eliminate]: 3.84002e-06 [updatestate_assign_eliminate]: 3.68e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.72002e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 1.094e-05 [meta_fg_expand]: 2.73e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.82002e-06 [renormalize]: 0.00275989 [add_forward_monad_depend]: 6.53e-06 [auto_monad_grad]: 1.83002e-06 [auto_monad_eliminator]: 1.715e-05 [cse]: 3.015e-05 [replace_applicator]: 1.974e-05 [Cycle 2]: 0.00039162, [27] [switch_simplify]: 7.26999e-06 [loop_unroll]: 6.14999e-06 [a_1]: 0.00013248 [with_stream_mark]: 1.125e-05 [recompute_prepare]: 6.07999e-06 [updatestate_depend_eliminate]: 3.43999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.55001e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.53002e-06 [accelerated_algorithm]: 6.81999e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 3.3e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.732e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 6.22001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.231e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.02e-05 [rewriter_after_opt_a]: 3.326e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00068777 [jit_opt_b]: 5.732e-05, [1] [Cycle 1]: 4.993e-05, [2] [frontend_op_eliminate]: 1.878e-05 [inline_after_opt_a]: 1.894e-05 [cconv]: 2.595e-05 [loop_unroll]: 0.00043505 [jit_opt_after_cconv]: 0.00016128, [1] [Cycle 1]: 0.00015497, [11] [c_1]: 2.757e-05 [parameter_eliminate]: 3.06001e-06 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 2.361e-05 [call_graph_tuple_transform]: 2.178e-05 [tuple_list_get_item_eliminator]: 7.05998e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.30002e-06 [remove_dup_value]: 1.529e-05 [partial_unused_args_eliminate]: 2.18002e-06 [environ_conv]: 8.2e-06 [add_recomputation]: 4.737e-05 [cse_after_recomputation]: 2.21e-05, [1] [Cycle 1]: 1.722e-05, [1] [cse]: 1.114e-05 [auto_monad_reorder]: 1.503e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 5.71e-06 [opt_after_jit_grad]: 0.00046498 [symbol_engine_optimizer]: 7.65e-05, [1] [Cycle 1]: 7.024e-05, [6] [build]: 3.48999e-06 [elim_shapecalc]: 9.15999e-06 [elim_not_effective]: 1.412e-05 [opt_reshape]: 6.04999e-06 [fold_const_symbol]: 9.91998e-06 [renormalize]: 3.00002e-07 [validate]: 6.066e-05 Sums bootstrap : 0.000260s : 0.23% type_inference : 0.104142s : 93.84% event_method : 0.000018s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000473s : 0.43% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000707s : 0.64% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002760s : 2.49% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000688s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000435s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000465s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000061s : 0.05% Time group info: ------[substitution.] 0.000204 24 1.13% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.24% : 0.000007s : 4: substitution.graph_param_transform 82.18% : 0.000167s : 4: substitution.inline 1.83% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.71% : 0.000006s : 4: substitution.remove_not_recompute_node 2.44% : 0.000005s : 2: substitution.replace_old_param 5.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104072 2 97.29% : 0.101255s : 1: type_inference.infer 2.71% : 0.002818s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.26% : 0.000051s : 4: replace.inline 31.74% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.96% : 0.000165s : 4: match.inline 6.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.16% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.64% : 0.000008s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.60% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.60% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.51% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.44% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.72% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.58% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002051 22 63.56% : 0.001304s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.04% : 0.000719s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118790 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000272s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.42% : 0.007629s : 1: jit_opt_a 0.14% : 0.000164s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.37% : 0.000443s : 1: loop_unroll 0.59% : 0.000697s : 1: mutable_eliminate 0.81% : 0.000959s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000480s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.69% : 0.002003s : 1: renormalize.infer 0.63% : 0.000747s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 87.68% : 0.104157s : 1: type_inference TotalTime = 0.0656728, [30] [bootstrap]: 0.000262 [type_inference]: 0.0562555 [event_method]: 1.906e-05 [auto_monad]: 6.261e-05 [graph_reusing]: 5.64e-06 [pre_auto_parallel]: 2.27001e-06 [py_interpret_to_execute]: 0.00027325 [rewriter_before_opt_a]: 8.191e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00661181, [2] [Cycle 1]: 0.00307951, [27] [switch_simplify]: 4.899e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00053586 [with_stream_mark]: 1.481e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.72002e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.54999e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.444e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 6.26998e-06 [renormalize]: 0.00212622 [add_forward_monad_depend]: 5.02e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.482e-05 [cse]: 2.959e-05 [replace_applicator]: 1.256e-05 [Cycle 2]: 0.00035475, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.00012224 [with_stream_mark]: 8.75001e-06 [recompute_prepare]: 5.73002e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.285e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.159e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 9.39998e-06 [rewriter_after_opt_a]: 3.274e-05 [convert_after_rewriter]: 6.75002e-06 [order_py_execute_after_rewriter]: 4.55999e-06 [mutable_eliminate]: 0.00051522 [jit_opt_b]: 5.325e-05, [1] [Cycle 1]: 4.665e-05, [2] [frontend_op_eliminate]: 1.795e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 2.134e-05 [loop_unroll]: 0.00041157 [jit_opt_after_cconv]: 0.00014328, [1] [Cycle 1]: 0.00013698, [11] [c_1]: 2.518e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.791e-05 [call_graph_tuple_transform]: 1.951e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.03002e-06 [remove_dup_value]: 1.492e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 7.46999e-06 [add_recomputation]: 4.506e-05 [cse_after_recomputation]: 2.119e-05, [1] [Cycle 1]: 1.603e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.463e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00046782 [symbol_engine_optimizer]: 7.254e-05, [1] [Cycle 1]: 6.631e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.243e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 9.05999e-06 [renormalize]: 4.09986e-07 [validate]: 8.481e-05 Sums bootstrap : 0.000262s : 0.42% type_inference : 0.056256s : 90.81% event_method : 0.000019s : 0.03% auto_monad : 0.000063s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000273s : 0.44% rewriter_before_opt_a : 0.000082s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000658s : 1.06% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002126s : 3.43% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000041s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000515s : 0.83% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000021s : 0.03% loop_unroll : 0.000412s : 0.66% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000468s : 0.76% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000085s : 0.14% Time group info: ------[substitution.] 0.000179 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.15% : 0.000006s : 4: substitution.graph_param_transform 84.35% : 0.000151s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000004s : 2: substitution.replace_old_param 4.45% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056185 2 96.56% : 0.054254s : 1: type_inference.infer 3.44% : 0.001930s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.64% : 0.000043s : 4: replace.inline 33.36% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 95.58% : 0.000149s : 4: match.inline 4.42% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.53% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.85% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000001s : 12: predicate.print_const_string_wrapper 2.09% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000001s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 1.13% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002412 30 74.24% : 0.001791s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.15% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.60% : 0.000593s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068702 72 0.07% : 0.000048s : 1: add_recomputation 0.10% : 0.000066s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.40% : 0.000274s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.63% : 0.006615s : 1: jit_opt_a 0.21% : 0.000146s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.61% : 0.000419s : 1: loop_unroll 0.76% : 0.000523s : 1: mutable_eliminate 1.28% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000279s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 2.17% : 0.001488s : 1: renormalize.infer 0.92% : 0.000630s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.11% : 0.000075s : 1: symbol_engine_optimizer 81.90% : 0.056268s : 1: type_inference TotalTime = 0.120661, [30] [bootstrap]: 0.00033461 [type_inference]: 0.110209 [event_method]: 2.039e-05 [auto_monad]: 6.882e-05 [graph_reusing]: 4.85001e-06 [pre_auto_parallel]: 2.63e-06 [py_interpret_to_execute]: 0.00050484 [rewriter_before_opt_a]: 8.656e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.007138, [2] [Cycle 1]: 0.00362789, [27] [switch_simplify]: 5.586e-05 [loop_unroll]: 3.407e-05 [a_1]: 0.00066452 [with_stream_mark]: 1.567e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 3.88999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.468e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.01002e-06 [inline_without_move]: 6.21e-06 [renormalize]: 0.00252503 [add_forward_monad_depend]: 6.04001e-06 [auto_monad_grad]: 2.16e-06 [auto_monad_eliminator]: 1.428e-05 [cse]: 3.181e-05 [replace_applicator]: 1.518e-05 [Cycle 2]: 0.0003714, [27] [switch_simplify]: 7.11999e-06 [loop_unroll]: 5.95002e-06 [a_1]: 0.00012742 [with_stream_mark]: 1.007e-05 [recompute_prepare]: 6.09999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.30003e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.248e-05 [j_node_and_user_rematch]: 9.26998e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 8.76002e-06 [inline_without_move]: 5.56e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 8.60018e-07 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.363e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 3.768e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 4.89998e-06 [mutable_eliminate]: 0.0005879 [jit_opt_b]: 5.429e-05, [1] [Cycle 1]: 4.704e-05, [2] [frontend_op_eliminate]: 1.851e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 2.385e-05 [loop_unroll]: 0.00042709 [jit_opt_after_cconv]: 0.0001535, [1] [Cycle 1]: 0.0001466, [11] [c_1]: 2.67e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.247e-05 [call_graph_tuple_transform]: 2.076e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 1.431e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 8.17003e-06 [add_recomputation]: 4.569e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.825e-05, [1] [cse]: 1.265e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.45e-06 [opt_after_jit_grad]: 0.00055747 [symbol_engine_optimizer]: 8.606e-05, [1] [Cycle 1]: 7.899e-05, [6] [build]: 4.28001e-06 [elim_shapecalc]: 1.068e-05 [elim_not_effective]: 1.654e-05 [opt_reshape]: 7.39002e-06 [fold_const_symbol]: 1.038e-05 [renormalize]: 2.89991e-07 [validate]: 4.787e-05 Sums bootstrap : 0.000335s : 0.29% type_inference : 0.110209s : 94.24% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000505s : 0.43% rewriter_before_opt_a : 0.000087s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000792s : 0.68% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002525s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000588s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000024s : 0.02% loop_unroll : 0.000427s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000557s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000237 28 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 4: substitution.graph_param_transform 82.12% : 0.000195s : 5: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000010s : 3: substitution.reduce_eliminate 1.85% : 0.000004s : 4: substitution.remove_not_recompute_node 1.63% : 0.000004s : 2: substitution.replace_old_param 4.64% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110138 2 97.48% : 0.107360s : 1: type_inference.infer 2.52% : 0.002777s : 1: type_inference.specialize ------[replace.] 0.000093 7 69.48% : 0.000065s : 5: replace.inline 30.52% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 95.06% : 0.000192s : 5: match.inline 4.94% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 13: predicate.compare_switch_simplify 1.43% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.74% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.29% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.35% : 0.000007s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 64: predicate.switch_simplify 1.31% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002221 25 64.07% : 0.001423s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.58% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.35% : 0.000741s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124288 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.28% : 0.000350s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.75% : 0.007141s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.35% : 0.000435s : 1: loop_unroll 0.48% : 0.000596s : 1: mutable_eliminate 0.83% : 0.001026s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000568s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000512s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.43% : 0.001774s : 1: renormalize.infer 0.60% : 0.000743s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000089s : 1: symbol_engine_optimizer 88.68% : 0.110222s : 1: type_inference TotalTime = 0.0622363, [30] [bootstrap]: 0.00027299 [type_inference]: 0.052791 [event_method]: 1.908e-05 [auto_monad]: 5.11e-05 [graph_reusing]: 3.95e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 0.00026598 [rewriter_before_opt_a]: 7.387e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00657929, [2] [Cycle 1]: 0.00300991, [27] [switch_simplify]: 4.736e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00052382 [with_stream_mark]: 1.235e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 8.10018e-07 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.31998e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 7.99977e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.288e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00208711 [add_forward_monad_depend]: 5.10999e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.308e-05 [cse]: 2.417e-05 [replace_applicator]: 1.263e-05 [Cycle 2]: 0.0003583, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.57999e-06 [a_1]: 0.00011963 [with_stream_mark]: 1.096e-05 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 1.89e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 2.17001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.509e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.99997e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.64998e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.74999e-06 [cse]: 1.14e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.008e-05 [rewriter_after_opt_a]: 2.896e-05 [convert_after_rewriter]: 5.92999e-06 [order_py_execute_after_rewriter]: 4.3e-06 [mutable_eliminate]: 0.0005473 [jit_opt_b]: 5.42e-05, [1] [Cycle 1]: 4.743e-05, [2] [frontend_op_eliminate]: 1.836e-05 [inline_after_opt_a]: 1.769e-05 [cconv]: 1.856e-05 [loop_unroll]: 0.00046488 [jit_opt_after_cconv]: 0.00015549, [1] [Cycle 1]: 0.00014828, [11] [c_1]: 2.754e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 7.07002e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 2.226e-05 [call_graph_tuple_transform]: 1.904e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 8.39995e-07 [renormalize]: 3.39991e-07 [switch_simplify]: 6.12999e-06 [remove_dup_value]: 9.99001e-06 [partial_unused_args_eliminate]: 1.35001e-06 [environ_conv]: 7.41999e-06 [add_recomputation]: 3.849e-05 [cse_after_recomputation]: 2.181e-05, [1] [Cycle 1]: 1.595e-05, [1] [cse]: 1e-05 [auto_monad_reorder]: 1.106e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.51002e-06 [opt_after_jit_grad]: 0.0004785 [symbol_engine_optimizer]: 7.418e-05, [1] [Cycle 1]: 6.787e-05, [6] [build]: 2.60997e-06 [elim_shapecalc]: 8.44002e-06 [elim_not_effective]: 1.281e-05 [opt_reshape]: 6.92002e-06 [fold_const_symbol]: 9.15001e-06 [renormalize]: 4.00003e-07 [validate]: 6.639e-05 Sums bootstrap : 0.000273s : 0.47% type_inference : 0.052791s : 90.30% event_method : 0.000019s : 0.03% auto_monad : 0.000051s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000266s : 0.45% rewriter_before_opt_a : 0.000074s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000643s : 1.10% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002087s : 3.57% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000036s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000029s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000547s : 0.94% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000019s : 0.03% loop_unroll : 0.000465s : 0.80% jit_opt_after_cconv.c_1 : 0.000028s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000038s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000479s : 0.82% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000066s : 0.11% Time group info: ------[substitution.] 0.000165 24 0.79% : 0.000001s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000004s : 4: substitution.graph_param_transform 84.05% : 0.000139s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.92% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 4.94% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052722 2 96.34% : 0.050793s : 1: type_inference.infer 3.66% : 0.001929s : 1: type_inference.specialize ------[replace.] 0.000067 6 65.27% : 0.000043s : 4: replace.inline 34.73% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 95.13% : 0.000136s : 4: match.inline 4.87% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.76% : 0.000002s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000001s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.39% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.52% : 0.000001s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.95% : 0.000003s : 4: predicate.mutable_eliminate 0.76% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000002s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.68% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.64% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.01% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.44% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002178 26 71.71% : 0.001562s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.28% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.01% : 0.000588s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065238 72 0.06% : 0.000041s : 1: add_recomputation 0.08% : 0.000054s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.44% : 0.000287s : 1: bootstrap 0.03% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.09% : 0.006582s : 1: jit_opt_a 0.24% : 0.000158s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.73% : 0.000474s : 1: loop_unroll 0.85% : 0.000555s : 1: mutable_eliminate 1.32% : 0.000863s : 26: opt.transform.jit_opt_a 0.09% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000272s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 2.22% : 0.001451s : 1: renormalize.infer 0.96% : 0.000629s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.12% : 0.000079s : 1: rewriter_before_opt_a 0.12% : 0.000077s : 1: symbol_engine_optimizer 80.94% : 0.052804s : 1: type_inference TotalTime = 0.012688, [30] [bootstrap]: 0.00027265 [type_inference]: 0.00463137 [event_method]: 1.754e-05 [auto_monad]: 6.296e-05 [graph_reusing]: 5.34e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 3.509e-05 [rewriter_before_opt_a]: 7.024e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00531947, [2] [Cycle 1]: 0.00168045, [27] [switch_simplify]: 5.103e-05 [loop_unroll]: 3.088e-05 [a_1]: 0.00052669 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 7.73001e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.92001e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 5.71e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.91002e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.00073029 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 2.23002e-06 [auto_monad_eliminator]: 1.322e-05 [cse]: 2.622e-05 [replace_applicator]: 1.337e-05 [Cycle 2]: 0.00032531, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 4.72e-06 [a_1]: 9.2e-05 [with_stream_mark]: 1.114e-05 [recompute_prepare]: 5.01997e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.372e-05 [j_node_and_user_rematch]: 7.46999e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 7.59002e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 9.39996e-07 [auto_monad_eliminator]: 7.11001e-06 [cse]: 1.126e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.103e-05 [rewriter_after_opt_a]: 3.356e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00066677 [jit_opt_b]: 5.137e-05, [1] [Cycle 1]: 4.36e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.558e-05 [cconv]: 2.614e-05 [loop_unroll]: 0.00044034 [jit_opt_after_cconv]: 0.00015067, [1] [Cycle 1]: 0.0001438, [11] [c_1]: 2.207e-05 [parameter_eliminate]: 4.17e-06 [updatestate_depend_eliminate]: 7.3e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.379e-05 [call_graph_tuple_transform]: 1.917e-05 [tuple_list_get_item_eliminator]: 5.37999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.02999e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 4.754e-05 [cse_after_recomputation]: 2.303e-05, [1] [Cycle 1]: 1.748e-05, [1] [cse]: 1.091e-05 [auto_monad_reorder]: 1.565e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00047869 [symbol_engine_optimizer]: 7.214e-05, [1] [Cycle 1]: 6.587e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 5.77999e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 5.09986e-07 [validate]: 3.903e-05 Sums bootstrap : 0.000273s : 3.10% type_inference : 0.004631s : 52.64% event_method : 0.000018s : 0.20% auto_monad : 0.000063s : 0.72% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000035s : 0.40% rewriter_before_opt_a : 0.000070s : 0.80% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.40% jit_opt_a.a_1 : 0.000619s : 7.03% jit_opt_a.with_stream_mark : 0.000030s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000730s : 8.30% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000037s : 0.43% jit_opt_a.replace_applicator : 0.000019s : 0.22% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000034s : 0.38% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000667s : 7.58% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000026s : 0.30% loop_unroll : 0.000440s : 5.00% jit_opt_after_cconv.c_1 : 0.000022s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.54% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000479s : 5.44% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000039s : 0.44% Time group info: ------[substitution.] 0.000206 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 83.59% : 0.000172s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000006s : 4: substitution.remove_not_recompute_node 2.08% : 0.000004s : 2: substitution.replace_old_param 6.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004572 2 82.01% : 0.003749s : 1: type_inference.infer 17.99% : 0.000823s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.92% : 0.000044s : 4: replace.inline 33.08% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.77% : 0.000170s : 4: match.inline 6.23% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 2.01% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.79% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.47% : 0.000001s : 3: predicate.graph_param_transform 5.65% : 0.000007s : 22: predicate.inline 1.05% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.79% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.19% : 0.000001s : 10: predicate.minmaximum_grad 2.05% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.80% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.90% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.26% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000626 13 48.99% : 0.000307s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.86% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.15% : 0.000276s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014299 72 0.35% : 0.000051s : 1: add_recomputation 0.46% : 0.000066s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.00% : 0.000286s : 1: bootstrap 0.20% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.22% : 0.005322s : 1: jit_opt_a 1.07% : 0.000153s : 1: jit_opt_after_cconv 0.38% : 0.000054s : 1: jit_opt_b 3.14% : 0.000449s : 1: loop_unroll 4.73% : 0.000677s : 1: mutable_eliminate 5.80% : 0.000829s : 26: opt.transform.jit_opt_a 0.34% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.41% : 0.000487s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.26% : 0.000038s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.72% : 0.000389s : 1: renormalize.infer 2.34% : 0.000334s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000036s : 1: rewriter_after_opt_a 0.51% : 0.000073s : 1: rewriter_before_opt_a 0.52% : 0.000075s : 1: symbol_engine_optimizer 32.47% : 0.004644s : 1: type_inference TotalTime = 0.0120946, [30] [bootstrap]: 0.00027441 [type_inference]: 0.00468465 [event_method]: 1.713e-05 [auto_monad]: 6.07e-05 [graph_reusing]: 5.77999e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 3.608e-05 [rewriter_before_opt_a]: 6.973e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00492828, [2] [Cycle 1]: 0.00158538, [27] [switch_simplify]: 4.678e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00050661 [with_stream_mark]: 1.37e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.12001e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.08002e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.04003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.166e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00069394 [add_forward_monad_depend]: 4.69002e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 1.278e-05 [cse]: 2.264e-05 [replace_applicator]: 1.286e-05 [Cycle 2]: 0.00031633, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.924e-05 [with_stream_mark]: 9.14e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.23002e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 4.94e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.88001e-06 [merge_forward]: 2.36e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.219e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 4.57e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.30012e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.115e-05 [replace_applicator]: 5.22999e-06 [py_interpret_to_execute_after_opt_a]: 9.43002e-06 [rewriter_after_opt_a]: 3.049e-05 [convert_after_rewriter]: 6.04999e-06 [order_py_execute_after_rewriter]: 4.39002e-06 [mutable_eliminate]: 0.00049525 [jit_opt_b]: 4.927e-05, [1] [Cycle 1]: 4.26e-05, [2] [frontend_op_eliminate]: 1.604e-05 [inline_after_opt_a]: 1.556e-05 [cconv]: 2.146e-05 [loop_unroll]: 0.00041563 [jit_opt_after_cconv]: 0.00013574, [1] [Cycle 1]: 0.00012975, [11] [c_1]: 2.078e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.854e-05 [call_graph_tuple_transform]: 1.677e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.20999e-06 [renormalize]: 6.29982e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.311e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 4.28001e-06 [add_recomputation]: 4.422e-05 [cse_after_recomputation]: 2.317e-05, [1] [Cycle 1]: 1.755e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.392e-05 [get_jit_bprop_graph]: 1.41002e-06 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00045921 [symbol_engine_optimizer]: 7.557e-05, [1] [Cycle 1]: 6.865e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 8.38001e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 5.81998e-06 [fold_const_symbol]: 8.43999e-06 [renormalize]: 5.90022e-07 [validate]: 3.457e-05 Sums bootstrap : 0.000274s : 3.22% type_inference : 0.004685s : 55.05% event_method : 0.000017s : 0.20% auto_monad : 0.000061s : 0.71% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.42% rewriter_before_opt_a : 0.000070s : 0.82% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000053s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000596s : 7.00% jit_opt_a.with_stream_mark : 0.000023s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000694s : 8.16% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.21% jit_opt_a.cse : 0.000034s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000030s : 0.36% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000495s : 5.82% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000021s : 0.25% loop_unroll : 0.000416s : 4.88% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000044s : 0.52% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000014s : 0.16% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000459s : 5.40% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000035s : 0.41% Time group info: ------[substitution.] 0.000186 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000002s : 2: substitution.fold_const_symbol 2.57% : 0.000005s : 3: substitution.graph_param_transform 83.49% : 0.000156s : 4: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 6.08% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004631 2 80.12% : 0.003711s : 1: type_inference.infer 19.88% : 0.000921s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.41% : 0.000044s : 4: replace.inline 33.59% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.74% : 0.000153s : 4: match.inline 6.26% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.22% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.46% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.15% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.31% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.47% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.15% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.04% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000654 13 49.24% : 0.000322s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.69% : 0.000299s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013634 72 0.34% : 0.000047s : 1: add_recomputation 0.47% : 0.000064s : 1: auto_monad 0.12% : 0.000016s : 1: auto_monad_reorder 2.11% : 0.000288s : 1: bootstrap 0.18% : 0.000024s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.17% : 0.004932s : 1: jit_opt_a 1.01% : 0.000138s : 1: jit_opt_after_cconv 0.38% : 0.000052s : 1: jit_opt_b 3.11% : 0.000423s : 1: loop_unroll 3.69% : 0.000504s : 1: mutable_eliminate 5.85% : 0.000798s : 26: opt.transform.jit_opt_a 0.33% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.44% : 0.000469s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000015s : 1: remove_dup_value 2.44% : 0.000333s : 1: renormalize.infer 2.60% : 0.000354s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000033s : 1: rewriter_after_opt_a 0.53% : 0.000072s : 1: rewriter_before_opt_a 0.57% : 0.000078s : 1: symbol_engine_optimizer 34.44% : 0.004695s : 1: type_inference TotalTime = 0.120426, [30] [bootstrap]: 0.00029156 [type_inference]: 0.110264 [event_method]: 1.97e-05 [auto_monad]: 5.111e-05 [graph_reusing]: 4.02e-06 [pre_auto_parallel]: 1.75001e-06 [py_interpret_to_execute]: 0.00048893 [rewriter_before_opt_a]: 8.885e-05 [expand_dump_flag]: 2.86999e-06 [jit_opt_a]: 0.00708342, [2] [Cycle 1]: 0.00362302, [27] [switch_simplify]: 5.529e-05 [loop_unroll]: 3.687e-05 [a_1]: 0.00062639 [with_stream_mark]: 1.309e-05 [recompute_prepare]: 8.48001e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 7.17002e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.232e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 6.19001e-06 [renormalize]: 0.0025716 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 1.345e-05 [cse]: 2.473e-05 [replace_applicator]: 1.329e-05 [Cycle 2]: 0.00036666, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 6.20002e-06 [a_1]: 0.00012651 [with_stream_mark]: 9.65002e-06 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.55997e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.81003e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.196e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.12998e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.309e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 8.85001e-06 [rewriter_after_opt_a]: 3.13e-05 [convert_after_rewriter]: 5.86e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00054386 [jit_opt_b]: 5.308e-05, [1] [Cycle 1]: 4.678e-05, [2] [frontend_op_eliminate]: 1.864e-05 [inline_after_opt_a]: 1.778e-05 [cconv]: 1.825e-05 [loop_unroll]: 0.00042282 [jit_opt_after_cconv]: 0.0001484, [1] [Cycle 1]: 0.00014234, [11] [c_1]: 2.579e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 5.19003e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.135e-05 [call_graph_tuple_transform]: 2.055e-05 [tuple_list_get_item_eliminator]: 6.27001e-06 [none_parameter_eliminate]: 1.03001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.16998e-06 [remove_dup_value]: 1.282e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.64999e-06 [add_recomputation]: 3.774e-05 [cse_after_recomputation]: 2.257e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.206e-05 [auto_monad_reorder]: 1.447e-05 [get_jit_bprop_graph]: 1.43002e-06 [rewriter_after_jit_bprop_graph]: 3.86001e-06 [opt_after_jit_grad]: 0.00046913 [symbol_engine_optimizer]: 0.00012219, [1] [Cycle 1]: 0.00011612, [6] [build]: 2.97002e-06 [elim_shapecalc]: 9.15001e-06 [elim_not_effective]: 5.874e-05 [opt_reshape]: 7.28e-06 [fold_const_symbol]: 9.46998e-06 [renormalize]: 4.60015e-07 [validate]: 3.77e-05 Sums bootstrap : 0.000292s : 0.25% type_inference : 0.110264s : 94.43% event_method : 0.000020s : 0.02% auto_monad : 0.000051s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000489s : 0.42% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000043s : 0.04% jit_opt_a.a_1 : 0.000753s : 0.64% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002572s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000544s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000423s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000469s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000059s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.03% Time group info: ------[substitution.] 0.000212 28 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000006s : 4: substitution.graph_param_transform 82.71% : 0.000175s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.38% : 0.000009s : 3: substitution.reduce_eliminate 2.00% : 0.000004s : 4: substitution.remove_not_recompute_node 1.66% : 0.000004s : 2: substitution.replace_old_param 3.68% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110200 2 97.52% : 0.107462s : 1: type_inference.infer 2.48% : 0.002738s : 1: type_inference.specialize ------[replace.] 0.000087 7 66.29% : 0.000058s : 5: replace.inline 33.71% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 7 96.24% : 0.000172s : 5: match.inline 3.76% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.27% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.04% : 0.000007s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.42% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.23% : 0.000002s : 13: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.54% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 13: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.37% : 0.000010s : 64: predicate.switch_simplify 1.56% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002224 25 64.25% : 0.001429s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.47% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.28% : 0.000740s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124112 72 0.03% : 0.000041s : 1: add_recomputation 0.04% : 0.000054s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000304s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.71% : 0.007086s : 1: jit_opt_a 0.12% : 0.000151s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.35% : 0.000430s : 1: loop_unroll 0.44% : 0.000552s : 1: mutable_eliminate 0.80% : 0.000987s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000495s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.48% : 0.001838s : 1: renormalize.infer 0.58% : 0.000726s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000094s : 1: rewriter_before_opt_a 0.10% : 0.000125s : 1: symbol_engine_optimizer 88.85% : 0.110280s : 1: type_inference TotalTime = 0.0144624, [30] [bootstrap]: 0.00025965 [type_inference]: 0.00709083 [event_method]: 1.837e-05 [auto_monad]: 5.158e-05 [graph_reusing]: 4.29002e-06 [pre_auto_parallel]: 1.82999e-06 [py_interpret_to_execute]: 4.107e-05 [rewriter_before_opt_a]: 7.487e-05 [expand_dump_flag]: 2.11998e-06 [jit_opt_a]: 0.00495493, [2] [Cycle 1]: 0.001577, [27] [switch_simplify]: 5.153e-05 [loop_unroll]: 3.279e-05 [a_1]: 0.00057277 [with_stream_mark]: 1.399e-05 [recompute_prepare]: 7.95998e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.46998e-06 [parameter_eliminate]: 1.23002e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.185e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.60999e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 0.00061022 [add_forward_monad_depend]: 4.32e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 1.03e-05 [cse]: 2.098e-05 [replace_applicator]: 1.199e-05 [Cycle 2]: 0.00032326, [27] [switch_simplify]: 6.17001e-06 [loop_unroll]: 5.20999e-06 [a_1]: 9.583e-05 [with_stream_mark]: 8.54e-06 [recompute_prepare]: 5.13002e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 5.32999e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.31002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.026e-05 [j_node_and_user_rematch]: 7.48999e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 6.71999e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.285e-05 [replace_applicator]: 5.37999e-06 [py_interpret_to_execute_after_opt_a]: 8.40999e-06 [rewriter_after_opt_a]: 2.788e-05 [convert_after_rewriter]: 5.53002e-06 [order_py_execute_after_rewriter]: 4.15999e-06 [mutable_eliminate]: 0.00048591 [jit_opt_b]: 6.144e-05, [1] [Cycle 1]: 5.486e-05, [2] [frontend_op_eliminate]: 1.641e-05 [inline_after_opt_a]: 2.685e-05 [cconv]: 1.698e-05 [loop_unroll]: 0.00042122 [jit_opt_after_cconv]: 0.00013918, [1] [Cycle 1]: 0.00013302, [11] [c_1]: 2.117e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 6.06998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.135e-05 [call_graph_tuple_transform]: 1.587e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.00001e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 8.80001e-06 [partial_unused_args_eliminate]: 1.40999e-06 [environ_conv]: 4.72e-06 [add_recomputation]: 3.143e-05 [cse_after_recomputation]: 2.227e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.141e-05 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 4.05e-06 [opt_after_jit_grad]: 0.00045683 [symbol_engine_optimizer]: 7.012e-05, [1] [Cycle 1]: 6.411e-05, [6] [build]: 2.64001e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.176e-05 [opt_reshape]: 5.69e-06 [fold_const_symbol]: 8.45999e-06 [renormalize]: 3.89991e-07 [validate]: 2.806e-05 Sums bootstrap : 0.000260s : 2.39% type_inference : 0.007091s : 65.28% event_method : 0.000018s : 0.17% auto_monad : 0.000052s : 0.47% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.38% rewriter_before_opt_a : 0.000075s : 0.69% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.53% jit_opt_a.loop_unroll : 0.000038s : 0.35% jit_opt_a.a_1 : 0.000669s : 6.16% jit_opt_a.with_stream_mark : 0.000023s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000610s : 5.62% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.15% jit_opt_a.cse : 0.000034s : 0.31% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000008s : 0.08% rewriter_after_opt_a : 0.000028s : 0.26% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000486s : 4.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000027s : 0.25% cconv : 0.000017s : 0.16% loop_unroll : 0.000421s : 3.88% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000009s : 0.08% partial_unused_args_eliminate : 0.000001s : 0.01% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000031s : 0.29% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000011s : 0.11% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000457s : 4.21% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.26% Time group info: ------[substitution.] 0.000194 27 0.70% : 0.000001s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 1.68% : 0.000003s : 3: substitution.graph_param_transform 82.92% : 0.000161s : 5: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.75% : 0.000009s : 3: substitution.reduce_eliminate 2.09% : 0.000004s : 4: substitution.remove_not_recompute_node 1.82% : 0.000004s : 2: substitution.replace_old_param 3.99% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007042 2 87.70% : 0.006175s : 1: type_inference.infer 12.30% : 0.000866s : 1: type_inference.specialize ------[replace.] 0.000082 7 67.08% : 0.000055s : 5: replace.inline 32.92% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 7 95.98% : 0.000158s : 5: match.inline 4.02% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.98% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000002s : 11: predicate.arithmetic_simplify 1.25% : 0.000002s : 11: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 11: predicate.compare_switch_simplify 1.18% : 0.000001s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.23% : 0.000001s : 11: predicate.environ_get_eliminate 1.31% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.25% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.37% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.23% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.20% : 0.000003s : 16: predicate.partial_eliminate 1.28% : 0.000002s : 11: predicate.print_const_string_wrapper 2.22% : 0.000003s : 11: predicate.reduce_eliminate 1.60% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.88% : 0.000010s : 59: predicate.switch_simplify 1.34% : 0.000002s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000689 16 48.63% : 0.000335s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.54% : 0.000052s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.83% : 0.000302s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016030 72 0.21% : 0.000034s : 1: add_recomputation 0.34% : 0.000055s : 1: auto_monad 0.09% : 0.000014s : 1: auto_monad_reorder 1.69% : 0.000271s : 1: bootstrap 0.12% : 0.000020s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.93% : 0.004958s : 1: jit_opt_a 0.89% : 0.000142s : 1: jit_opt_after_cconv 0.40% : 0.000064s : 1: jit_opt_b 2.67% : 0.000429s : 1: loop_unroll 3.09% : 0.000495s : 1: mutable_eliminate 5.47% : 0.000877s : 26: opt.transform.jit_opt_a 0.28% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.23% : 0.000037s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.90% : 0.000465s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000044s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000011s : 1: remove_dup_value 2.08% : 0.000333s : 1: renormalize.infer 1.69% : 0.000271s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000031s : 1: rewriter_after_opt_a 0.48% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000073s : 1: symbol_engine_optimizer 44.30% : 0.007102s : 1: type_inference TotalTime = 0.113903, [30] [bootstrap]: 0.00026233 [type_inference]: 0.1023 [event_method]: 1.924e-05 [auto_monad]: 6.845e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.45997e-06 [py_interpret_to_execute]: 0.0007085 [rewriter_before_opt_a]: 0.00010275 [expand_dump_flag]: 4.35e-06 [jit_opt_a]: 0.00825645, [2] [Cycle 1]: 0.00390764, [27] [switch_simplify]: 6.441e-05 [loop_unroll]: 3.151e-05 [a_1]: 0.00062364 [with_stream_mark]: 2.065e-05 [recompute_prepare]: 8.03999e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.07002e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.03002e-06 [accelerated_algorithm]: 7.51001e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.605e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 9.45001e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00281934 [add_forward_monad_depend]: 7.71999e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.677e-05 [cse]: 2.806e-05 [replace_applicator]: 1.477e-05 [Cycle 2]: 0.00036386, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.76998e-06 [a_1]: 0.00012387 [with_stream_mark]: 9.97001e-06 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.46998e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 9.38002e-06 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 7.94002e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.076e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 1.104e-05 [rewriter_after_opt_a]: 3.337e-05 [convert_after_rewriter]: 7.55998e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00063037 [jit_opt_b]: 5.512e-05, [1] [Cycle 1]: 4.816e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 1.773e-05 [cconv]: 2.646e-05 [loop_unroll]: 0.00041878 [jit_opt_after_cconv]: 0.00014556, [1] [Cycle 1]: 0.00013893, [11] [c_1]: 2.575e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.862e-05 [call_graph_tuple_transform]: 2.073e-05 [tuple_list_get_item_eliminator]: 6.13998e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.369e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 8.53001e-06 [add_recomputation]: 4.712e-05 [cse_after_recomputation]: 2.132e-05, [1] [Cycle 1]: 1.58e-05, [1] [cse]: 1.027e-05 [auto_monad_reorder]: 1.564e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 4.33999e-06 [opt_after_jit_grad]: 0.0004462 [symbol_engine_optimizer]: 7.146e-05, [1] [Cycle 1]: 6.523e-05, [6] [build]: 2.88e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 8.98002e-06 [renormalize]: 3.80009e-07 [validate]: 3.634e-05 Sums bootstrap : 0.000262s : 0.24% type_inference : 0.102300s : 93.56% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000709s : 0.65% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000748s : 0.68% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002819s : 2.58% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000630s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000419s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000237 24 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000005s : 4: substitution.graph_param_transform 85.76% : 0.000203s : 4: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000006s : 4: substitution.remove_not_recompute_node 1.66% : 0.000004s : 2: substitution.replace_old_param 4.97% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102216 2 96.86% : 0.099007s : 1: type_inference.infer 3.14% : 0.003208s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.99% : 0.000055s : 4: replace.inline 32.01% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 6 94.94% : 0.000201s : 4: match.inline 5.06% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.29% : 0.000002s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.35% : 0.000002s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.45% : 0.000007s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.31% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.85% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.41% : 0.000002s : 12: predicate.transpose_eliminate 1.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.97% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002112 22 61.84% : 0.001306s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.28% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.87% : 0.000758s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117786 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000275s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.01% : 0.008260s : 1: jit_opt_a 0.13% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.36% : 0.000426s : 1: loop_unroll 0.54% : 0.000639s : 1: mutable_eliminate 0.84% : 0.000991s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.61% : 0.000717s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.72% : 0.002029s : 1: renormalize.infer 0.66% : 0.000781s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.09% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 86.87% : 0.102317s : 1: type_inference TotalTime = 0.120756, [30] [bootstrap]: 0.00026075 [type_inference]: 0.108972 [event_method]: 2.181e-05 [auto_monad]: 7.57e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.07001e-06 [py_interpret_to_execute]: 0.00047264 [rewriter_before_opt_a]: 9.275e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00815469, [2] [Cycle 1]: 0.00401963, [27] [switch_simplify]: 6.094e-05 [loop_unroll]: 3.496e-05 [a_1]: 0.00070624 [with_stream_mark]: 1.963e-05 [recompute_prepare]: 1.126e-05 [updatestate_depend_eliminate]: 3.53999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 6.46e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.46e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 1.08e-05 [meta_fg_expand]: 2.26003e-06 [replace_old_param]: 1.12e-05 [inline_without_move]: 6.21e-06 [renormalize]: 0.00281519 [add_forward_monad_depend]: 9.70002e-06 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 1.672e-05 [cse]: 3.269e-05 [replace_applicator]: 1.84e-05 [Cycle 2]: 0.00041057, [27] [switch_simplify]: 7.16999e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.0001318 [with_stream_mark]: 1.497e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.57997e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 6.06998e-06 [merge_forward]: 3.30998e-06 [cell_reuse_recompute_pass]: 2.46e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 1.56002e-06 [replace_old_param]: 9.42999e-06 [inline_without_move]: 6.54999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.58e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 8.25999e-06 [cse]: 1.547e-05 [replace_applicator]: 7.25998e-06 [py_interpret_to_execute_after_opt_a]: 1.455e-05 [rewriter_after_opt_a]: 4.346e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00073465 [jit_opt_b]: 7.269e-05, [1] [Cycle 1]: 6.43e-05, [2] [frontend_op_eliminate]: 3.125e-05 [inline_after_opt_a]: 2.049e-05 [cconv]: 2.721e-05 [loop_unroll]: 0.0005103 [jit_opt_after_cconv]: 0.00017293, [1] [Cycle 1]: 0.00016524, [11] [c_1]: 2.677e-05 [parameter_eliminate]: 3.96001e-06 [updatestate_depend_eliminate]: 6.81001e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 3.163e-05 [call_graph_tuple_transform]: 2.419e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.31002e-06 [renormalize]: 7.7e-07 [switch_simplify]: 6.53998e-06 [remove_dup_value]: 1.746e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 9.82001e-06 [add_recomputation]: 5.242e-05 [cse_after_recomputation]: 2.858e-05, [1] [Cycle 1]: 2.176e-05, [1] [cse]: 1.437e-05 [auto_monad_reorder]: 1.867e-05 [get_jit_bprop_graph]: 2.88e-06 [rewriter_after_jit_bprop_graph]: 6.83e-06 [opt_after_jit_grad]: 0.00055233 [symbol_engine_optimizer]: 0.0001614, [1] [Cycle 1]: 0.00015322, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.35999e-06 [elim_not_effective]: 1.715e-05 [opt_reshape]: 7.07997e-06 [fold_const_symbol]: 1.083e-05 [renormalize]: 7.40023e-07 [validate]: 5.522e-05 Sums bootstrap : 0.000261s : 0.22% type_inference : 0.108972s : 93.70% event_method : 0.000022s : 0.02% auto_monad : 0.000076s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000473s : 0.41% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000838s : 0.72% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002815s : 2.42% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000735s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000031s : 0.03% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000510s : 0.44% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000552s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.05% Time group info: ------[substitution.] 0.000279 28 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 4: substitution.graph_param_transform 82.75% : 0.000231s : 5: substitution.inline 1.66% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.36% : 0.000012s : 3: substitution.reduce_eliminate 1.75% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000006s : 2: substitution.replace_old_param 4.02% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108885 2 97.23% : 0.105873s : 1: type_inference.infer 2.77% : 0.003013s : 1: type_inference.specialize ------[replace.] 0.000098 7 65.94% : 0.000065s : 5: replace.inline 34.06% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 7 95.75% : 0.000228s : 5: match.inline 4.25% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.24% : 0.000002s : 13: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 2.14% : 0.000003s : 13: predicate.arithmetic_simplify 1.16% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000002s : 13: predicate.compare_switch_simplify 1.14% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.75% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.33% : 0.000009s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000003s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.30% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.05% : 0.000002s : 13: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 1.63% : 0.000002s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.49% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.64% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.88% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 3.06% : 0.000004s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.52% : 0.000011s : 64: predicate.switch_simplify 1.22% : 0.000002s : 13: predicate.tile_eliminate 1.55% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002245 25 62.60% : 0.001405s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.45% : 0.000077s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.95% : 0.000762s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124753 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.22% : 0.000272s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000031s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.54% : 0.008158s : 1: jit_opt_a 0.14% : 0.000177s : 1: jit_opt_after_cconv 0.06% : 0.000076s : 1: jit_opt_b 0.42% : 0.000523s : 1: loop_unroll 0.60% : 0.000747s : 1: mutable_eliminate 0.88% : 0.001096s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000044s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000563s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000480s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.63% : 0.002035s : 1: renormalize.infer 0.62% : 0.000770s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000047s : 1: rewriter_after_opt_a 0.08% : 0.000099s : 1: rewriter_before_opt_a 0.13% : 0.000164s : 1: symbol_engine_optimizer 87.37% : 0.108991s : 1: type_inference TotalTime = 0.0173929, [30] [bootstrap]: 0.00035366 [type_inference]: 0.00849061 [event_method]: 2.019e-05 [auto_monad]: 6.767e-05 [graph_reusing]: 6.57002e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.638e-05 [rewriter_before_opt_a]: 8.25e-05 [expand_dump_flag]: 3.03998e-06 [jit_opt_a]: 0.00600055, [2] [Cycle 1]: 0.00208822, [27] [switch_simplify]: 6.757e-05 [loop_unroll]: 3.293e-05 [a_1]: 0.00066935 [with_stream_mark]: 2.277e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.43998e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.586e-05 [j_node_and_user_rematch]: 1.018e-05 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 5.64e-06 [renormalize]: 0.00092732 [add_forward_monad_depend]: 6.59999e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.809e-05 [cse]: 3.812e-05 [replace_applicator]: 1.401e-05 [Cycle 2]: 0.00034622, [27] [switch_simplify]: 5.79999e-06 [loop_unroll]: 4.94e-06 [a_1]: 9.768e-05 [with_stream_mark]: 1.416e-05 [recompute_prepare]: 5.19003e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 4.51002e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.42998e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 4.93001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 7.73999e-06 [cse]: 1.368e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.332e-05 [rewriter_after_opt_a]: 3.969e-05 [convert_after_rewriter]: 7.30998e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00062685 [jit_opt_b]: 5.286e-05, [1] [Cycle 1]: 4.504e-05, [2] [frontend_op_eliminate]: 1.738e-05 [inline_after_opt_a]: 1.623e-05 [cconv]: 2.879e-05 [loop_unroll]: 0.00047492 [jit_opt_after_cconv]: 0.00016149, [1] [Cycle 1]: 0.00015462, [11] [c_1]: 2.132e-05 [parameter_eliminate]: 2.88998e-06 [updatestate_depend_eliminate]: 5.80002e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.469e-05 [call_graph_tuple_transform]: 1.951e-05 [tuple_list_get_item_eliminator]: 5.28002e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.69e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.96e-06 [add_recomputation]: 4.874e-05 [cse_after_recomputation]: 2.394e-05, [1] [Cycle 1]: 1.852e-05, [1] [cse]: 1.272e-05 [auto_monad_reorder]: 1.838e-05 [get_jit_bprop_graph]: 1.92001e-06 [rewriter_after_jit_bprop_graph]: 4.69002e-06 [opt_after_jit_grad]: 0.00050388 [symbol_engine_optimizer]: 7.266e-05, [1] [Cycle 1]: 6.641e-05, [6] [build]: 3.43e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 8.66002e-06 [renormalize]: 4.2998e-07 [validate]: 3.959e-05 Sums bootstrap : 0.000354s : 2.68% type_inference : 0.008491s : 64.23% event_method : 0.000020s : 0.15% auto_monad : 0.000068s : 0.51% graph_reusing : 0.000007s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000046s : 0.35% rewriter_before_opt_a : 0.000083s : 0.62% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.56% jit_opt_a.loop_unroll : 0.000038s : 0.29% jit_opt_a.a_1 : 0.000767s : 5.80% jit_opt_a.with_stream_mark : 0.000037s : 0.28% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000018s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.08% jit_opt_a.renormalize : 0.000927s : 7.02% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.20% jit_opt_a.cse : 0.000052s : 0.39% jit_opt_a.replace_applicator : 0.000020s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000040s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000627s : 4.74% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000029s : 0.22% loop_unroll : 0.000475s : 3.59% jit_opt_after_cconv.c_1 : 0.000021s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000049s : 0.37% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000504s : 3.81% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.30% Time group info: ------[substitution.] 0.000285 27 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000005s : 3: substitution.graph_param_transform 83.92% : 0.000239s : 5: substitution.inline 1.50% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.98% : 0.000011s : 3: substitution.reduce_eliminate 1.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000006s : 2: substitution.replace_old_param 3.95% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008423 2 87.12% : 0.007338s : 1: type_inference.infer 12.88% : 0.001085s : 1: type_inference.specialize ------[replace.] 0.000098 7 67.83% : 0.000066s : 5: replace.inline 32.17% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000246 7 95.88% : 0.000236s : 5: match.inline 4.12% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.22% : 0.000002s : 11: predicate.accumulaten_eliminater 0.92% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 1.94% : 0.000002s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 11: predicate.compare_switch_simplify 1.18% : 0.000001s : 11: predicate.depend_value_elim 1.10% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.43% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.96% : 0.000002s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.41% : 0.000002s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000002s : 11: predicate.print_const_string_wrapper 2.07% : 0.000003s : 11: predicate.reduce_eliminate 1.64% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 19: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.46% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000002s : 11: predicate.reshape_eliminate 1.18% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.78% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.49% : 0.000011s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000846 16 48.31% : 0.000409s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.18% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.51% : 0.000359s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019378 72 0.27% : 0.000052s : 1: add_recomputation 0.37% : 0.000071s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.90% : 0.000368s : 1: bootstrap 0.16% : 0.000031s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.13% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.98% : 0.006004s : 1: jit_opt_a 0.85% : 0.000164s : 1: jit_opt_after_cconv 0.29% : 0.000055s : 1: jit_opt_b 2.49% : 0.000483s : 1: loop_unroll 3.28% : 0.000637s : 1: mutable_eliminate 5.17% : 0.001002s : 26: opt.transform.jit_opt_a 0.25% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000027s : 4: opt.transform.jit_opt_b 0.07% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.64% : 0.000512s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000049s : 1: py_interpret_to_execute 0.08% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000019s : 1: remove_dup_value 2.85% : 0.000551s : 1: renormalize.infer 1.89% : 0.000366s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000043s : 1: rewriter_after_opt_a 0.44% : 0.000086s : 1: rewriter_before_opt_a 0.39% : 0.000075s : 1: symbol_engine_optimizer 43.89% : 0.008505s : 1: type_inference TotalTime = 0.125009, [30] [bootstrap]: 0.00030719 [type_inference]: 0.111023 [event_method]: 2.163e-05 [auto_monad]: 7.256e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00086782 [rewriter_before_opt_a]: 0.00010091 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00936304, [2] [Cycle 1]: 0.00502413, [27] [switch_simplify]: 6.291e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00065683 [with_stream_mark]: 1.976e-05 [recompute_prepare]: 8.80001e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 7.82e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 7.75998e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 7.10002e-06 [merge_forward]: 4.37998e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 1.174e-05 [meta_fg_expand]: 2.85002e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 6.61e-06 [renormalize]: 0.00385275 [add_forward_monad_depend]: 8.05e-06 [auto_monad_grad]: 2.06e-06 [auto_monad_eliminator]: 2.15e-05 [cse]: 3.177e-05 [replace_applicator]: 2.353e-05 [Cycle 2]: 0.00043668, [27] [switch_simplify]: 7.46999e-06 [loop_unroll]: 6.85002e-06 [a_1]: 0.00014455 [with_stream_mark]: 1.536e-05 [recompute_prepare]: 7.08e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 6.03998e-06 [accelerated_algorithm]: 6.82002e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 4.2e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.025e-05 [j_node_and_user_rematch]: 1.047e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.195e-05 [inline_without_move]: 7.17002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.37999e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 9.07001e-06 [cse]: 1.423e-05 [replace_applicator]: 7.21001e-06 [py_interpret_to_execute_after_opt_a]: 1.746e-05 [rewriter_after_opt_a]: 3.937e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 6.59001e-06 [mutable_eliminate]: 0.00081732 [jit_opt_b]: 7.03e-05, [1] [Cycle 1]: 6.157e-05, [2] [frontend_op_eliminate]: 2.52e-05 [inline_after_opt_a]: 2.313e-05 [cconv]: 3.009e-05 [loop_unroll]: 0.00057759 [jit_opt_after_cconv]: 0.00018313, [1] [Cycle 1]: 0.00017578, [11] [c_1]: 3.032e-05 [parameter_eliminate]: 4.04002e-06 [updatestate_depend_eliminate]: 7.21001e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 3.233e-05 [call_graph_tuple_transform]: 2.341e-05 [tuple_list_get_item_eliminator]: 7.33999e-06 [none_parameter_eliminate]: 1.41998e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 7.03e-06 [remove_dup_value]: 2.077e-05 [partial_unused_args_eliminate]: 2.11003e-06 [environ_conv]: 9.66e-06 [add_recomputation]: 5.153e-05 [cse_after_recomputation]: 2.783e-05, [1] [Cycle 1]: 1.82e-05, [1] [cse]: 1.216e-05 [auto_monad_reorder]: 1.385e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 7.35e-06 [opt_after_jit_grad]: 0.00063594 [symbol_engine_optimizer]: 0.00010364, [1] [Cycle 1]: 9.589e-05, [6] [build]: 6.16e-06 [elim_shapecalc]: 1.35e-05 [elim_not_effective]: 2.398e-05 [opt_reshape]: 7.01001e-06 [fold_const_symbol]: 1.349e-05 [renormalize]: 5.59987e-07 [validate]: 0.00027192 Sums bootstrap : 0.000307s : 0.26% type_inference : 0.111023s : 92.30% event_method : 0.000022s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000868s : 0.72% rewriter_before_opt_a : 0.000101s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000801s : 0.67% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.003853s : 3.20% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.03% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000817s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000025s : 0.02% jit_opt_b.inline_after_opt_a : 0.000023s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000578s : 0.48% jit_opt_after_cconv.c_1 : 0.000030s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000021s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000636s : 0.53% symbol_engine_optimizer.build : 0.000006s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000272s : 0.23% Time group info: ------[substitution.] 0.000263 24 0.98% : 0.000003s : 2: substitution.elim_not_effective 1.86% : 0.000005s : 2: substitution.fold_const_symbol 2.41% : 0.000006s : 4: substitution.graph_param_transform 82.80% : 0.000218s : 4: substitution.inline 1.80% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000007s : 4: substitution.remove_not_recompute_node 2.81% : 0.000007s : 2: substitution.replace_old_param 4.85% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110930 2 96.76% : 0.107337s : 1: type_inference.infer 3.24% : 0.003593s : 1: type_inference.specialize ------[replace.] 0.000088 6 66.07% : 0.000058s : 4: replace.inline 33.93% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 94.91% : 0.000215s : 4: match.inline 5.09% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 2.05% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.39% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.61% : 0.000001s : 4: predicate.elim_not_effective 0.80% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_depend_swap 1.38% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.07% : 0.000008s : 26: predicate.inline 1.00% : 0.000002s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.74% : 0.000003s : 8: predicate.less_batch_normalization 1.74% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 18: predicate.load_eliminater 1.57% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.36% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 12: predicate.merge_addn 0.97% : 0.000001s : 12: predicate.minmaximum_grad 2.06% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.05% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.38% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.84% : 0.000001s : 8: predicate.specialize_transform 1.66% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 1.86% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.79% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.43% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002645 22 58.04% : 0.001535s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.85% : 0.000049s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.11% : 0.001061s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129728 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000324s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000008s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 7.22% : 0.009367s : 1: jit_opt_a 0.14% : 0.000186s : 1: jit_opt_after_cconv 0.06% : 0.000073s : 1: jit_opt_b 0.45% : 0.000586s : 1: loop_unroll 0.68% : 0.000883s : 1: mutable_eliminate 0.83% : 0.001071s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000040s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000023s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000054s : 4: opt.transform.symbol_engine_opt 0.50% : 0.000647s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.68% : 0.000878s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 2.06% : 0.002670s : 1: renormalize.infer 0.90% : 0.001169s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.08% : 0.000106s : 1: symbol_engine_optimizer 85.60% : 0.111041s : 1: type_inference TotalTime = 0.128028, [30] [bootstrap]: 0.00032638 [type_inference]: 0.116332 [event_method]: 2.072e-05 [auto_monad]: 7.13e-05 [graph_reusing]: 6.35002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00055497 [rewriter_before_opt_a]: 9.517e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00825775, [2] [Cycle 1]: 0.00427602, [27] [switch_simplify]: 6.88e-05 [loop_unroll]: 3.461e-05 [a_1]: 0.00072229 [with_stream_mark]: 2.186e-05 [recompute_prepare]: 1.168e-05 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 3.81001e-06 [updatestate_loads_eliminate]: 3.95e-06 [parameter_eliminate]: 2.56e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.9e-06 [meta_shard_fg_expand]: 2.27001e-06 [get_grad_eliminate_]: 7.15e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.66998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.786e-05 [j_node_and_user_rematch]: 1.122e-05 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 1.139e-05 [inline_without_move]: 6.61999e-06 [renormalize]: 0.00303395 [add_forward_monad_depend]: 7.61999e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.727e-05 [cse]: 3.486e-05 [replace_applicator]: 1.514e-05 [Cycle 2]: 0.00037712, [27] [switch_simplify]: 7.24001e-06 [loop_unroll]: 6.05002e-06 [a_1]: 0.00013622 [with_stream_mark]: 9.79999e-06 [recompute_prepare]: 6.89999e-06 [updatestate_depend_eliminate]: 2.90002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 6.09001e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 7.16999e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.129e-05 [j_node_and_user_rematch]: 8.49002e-06 [meta_fg_expand]: 2.23998e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 5.96998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09003e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.323e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.187e-05 [rewriter_after_opt_a]: 3.726e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00063683 [jit_opt_b]: 5.824e-05, [1] [Cycle 1]: 5.046e-05, [2] [frontend_op_eliminate]: 2.097e-05 [inline_after_opt_a]: 1.836e-05 [cconv]: 2.554e-05 [loop_unroll]: 0.00044987 [jit_opt_after_cconv]: 0.0001548, [1] [Cycle 1]: 0.00014797, [11] [c_1]: 2.568e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.208e-05 [call_graph_tuple_transform]: 2.192e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.93002e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 7.38e-06 [remove_dup_value]: 1.668e-05 [partial_unused_args_eliminate]: 2.68003e-06 [environ_conv]: 8.25e-06 [add_recomputation]: 5.271e-05 [cse_after_recomputation]: 2.343e-05, [1] [Cycle 1]: 1.812e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.744e-05 [get_jit_bprop_graph]: 2.56e-06 [rewriter_after_jit_bprop_graph]: 6.04999e-06 [opt_after_jit_grad]: 0.00047085 [symbol_engine_optimizer]: 0.00014132, [1] [Cycle 1]: 0.00013493, [6] [build]: 3.61001e-06 [elim_shapecalc]: 8.62998e-06 [elim_not_effective]: 1.309e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 7.396e-05 [renormalize]: 6.09987e-07 [validate]: 4.809e-05 Sums bootstrap : 0.000326s : 0.26% type_inference : 0.116332s : 93.96% event_method : 0.000021s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000555s : 0.45% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000859s : 0.69% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000015s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003034s : 2.45% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000637s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000450s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000053s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000471s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000074s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000343 28 0.51% : 0.000002s : 2: substitution.elim_not_effective 18.89% : 0.000065s : 2: substitution.fold_const_symbol 1.79% : 0.000006s : 4: substitution.graph_param_transform 67.73% : 0.000232s : 5: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.86% : 0.000013s : 3: substitution.reduce_eliminate 1.41% : 0.000005s : 4: substitution.remove_not_recompute_node 1.37% : 0.000005s : 2: substitution.replace_old_param 3.42% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116258 2 97.46% : 0.113308s : 1: type_inference.infer 2.54% : 0.002950s : 1: type_inference.specialize ------[replace.] 0.000103 7 66.86% : 0.000069s : 5: replace.inline 33.14% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000239 7 95.64% : 0.000229s : 5: match.inline 4.36% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.49% : 0.000002s : 13: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.47% : 0.000002s : 13: predicate.addn_zero_filter 1.97% : 0.000003s : 13: predicate.arithmetic_simplify 1.44% : 0.000002s : 13: predicate.cast_eliminate 0.66% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.46% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.53% : 0.000008s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.54% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 1.09% : 0.000002s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.63% : 0.000004s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.48% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.86% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002742 25 68.73% : 0.001884s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000071s : 2: func_graph_cloner_run.FuncGraphClonerNode 28.68% : 0.000786s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132311 72 0.04% : 0.000056s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000340s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.24% : 0.008261s : 1: jit_opt_a 0.12% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.35% : 0.000458s : 1: loop_unroll 0.49% : 0.000647s : 1: mutable_eliminate 0.84% : 0.001117s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000099s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000564s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.61% : 0.002125s : 1: renormalize.infer 0.68% : 0.000897s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.11% : 0.000144s : 1: symbol_engine_optimizer 87.93% : 0.116347s : 1: type_inference TotalTime = 0.118837, [30] [bootstrap]: 0.00034433 [type_inference]: 0.107066 [event_method]: 1.895e-05 [auto_monad]: 7.025e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 0.00051336 [rewriter_before_opt_a]: 8.651e-05 [expand_dump_flag]: 3.95e-06 [jit_opt_a]: 0.00827315, [2] [Cycle 1]: 0.00408732, [27] [switch_simplify]: 6.592e-05 [loop_unroll]: 3.47e-05 [a_1]: 0.00062635 [with_stream_mark]: 2.151e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.56999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.76e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 6.00002e-06 [renormalize]: 0.00296576 [add_forward_monad_depend]: 8.68001e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.935e-05 [cse]: 3.094e-05 [replace_applicator]: 2.021e-05 [Cycle 2]: 0.0004084, [27] [switch_simplify]: 7.19001e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00012814 [with_stream_mark]: 1.333e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 5.37999e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 5.77001e-06 [merge_forward]: 4.57e-06 [cell_reuse_recompute_pass]: 2.16998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.889e-05 [j_node_and_user_rematch]: 1.115e-05 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.99999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 9.76e-06 [cse]: 1.608e-05 [replace_applicator]: 7.18e-06 [py_interpret_to_execute_after_opt_a]: 1.4e-05 [rewriter_after_opt_a]: 3.682e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00071976 [jit_opt_b]: 5.864e-05, [1] [Cycle 1]: 4.94e-05, [2] [frontend_op_eliminate]: 1.966e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 2.954e-05 [loop_unroll]: 0.00047138 [jit_opt_after_cconv]: 0.00016309, [1] [Cycle 1]: 0.00015569, [11] [c_1]: 2.59e-05 [parameter_eliminate]: 3.20998e-06 [updatestate_depend_eliminate]: 7.87e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.13002e-06 [cse]: 2.653e-05 [call_graph_tuple_transform]: 2.167e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 2.01998e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.543e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 9.75002e-06 [add_recomputation]: 4.86e-05 [cse_after_recomputation]: 2.356e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.104e-05 [auto_monad_reorder]: 1.588e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 5.07e-06 [opt_after_jit_grad]: 0.00049875 [symbol_engine_optimizer]: 9.159e-05, [1] [Cycle 1]: 8.499e-05, [6] [build]: 4.06001e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 2.353e-05 [renormalize]: 6.30011e-07 [validate]: 4.224e-05 Sums bootstrap : 0.000344s : 0.30% type_inference : 0.107066s : 93.56% event_method : 0.000019s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000513s : 0.45% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000754s : 0.66% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002966s : 2.59% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.03% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000720s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000471s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000499s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000024s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000248 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000002s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 4: substitution.graph_param_transform 85.11% : 0.000211s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000005s : 2: substitution.replace_old_param 5.03% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106992 2 97.21% : 0.104007s : 1: type_inference.infer 2.79% : 0.002986s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.59% : 0.000053s : 4: replace.inline 32.41% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 6 94.85% : 0.000209s : 4: match.inline 5.15% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.13% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000002s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.02% : 0.000001s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.30% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.77% : 0.000008s : 26: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.95% : 0.000003s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.65% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 2.06% : 0.000003s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.12% : 0.000002s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.51% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.82% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.95% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002270 22 63.82% : 0.001449s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.28% : 0.000052s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.90% : 0.000770s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122908 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.29% : 0.000361s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.74% : 0.008278s : 1: jit_opt_a 0.14% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.39% : 0.000482s : 1: loop_unroll 0.59% : 0.000729s : 1: mutable_eliminate 0.83% : 0.001016s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000510s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000520s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.72% : 0.002116s : 1: renormalize.infer 0.68% : 0.000838s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.08% : 0.000094s : 1: symbol_engine_optimizer 87.12% : 0.107083s : 1: type_inference TotalTime = 0.128444, [30] [bootstrap]: 0.00033638 [type_inference]: 0.116957 [event_method]: 2.042e-05 [auto_monad]: 6.599e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.25002e-06 [py_interpret_to_execute]: 0.00048339 [rewriter_before_opt_a]: 0.00015464 [expand_dump_flag]: 3.74002e-06 [jit_opt_a]: 0.007885, [2] [Cycle 1]: 0.00394741, [27] [switch_simplify]: 6.368e-05 [loop_unroll]: 3.54e-05 [a_1]: 0.00076134 [with_stream_mark]: 2.106e-05 [recompute_prepare]: 1.148e-05 [updatestate_depend_eliminate]: 4.72e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.07999e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.33e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 6.64001e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.584e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 1.041e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00268577 [add_forward_monad_depend]: 7.03e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.736e-05 [cse]: 3.22e-05 [replace_applicator]: 1.909e-05 [Cycle 2]: 0.0004224, [27] [switch_simplify]: 7.13e-06 [loop_unroll]: 6.48e-06 [a_1]: 0.0001334 [with_stream_mark]: 1.208e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.31002e-06 [cell_reuse_recompute_pass]: 1.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 9.51e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 6.32001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 2.64999e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 9.22001e-06 [cse]: 1.875e-05 [replace_applicator]: 8.2e-06 [py_interpret_to_execute_after_opt_a]: 1.481e-05 [rewriter_after_opt_a]: 4.088e-05 [convert_after_rewriter]: 7.21001e-06 [order_py_execute_after_rewriter]: 5.33002e-06 [mutable_eliminate]: 0.0006801 [jit_opt_b]: 5.8e-05, [1] [Cycle 1]: 5.037e-05, [2] [frontend_op_eliminate]: 1.933e-05 [inline_after_opt_a]: 1.909e-05 [cconv]: 2.961e-05 [loop_unroll]: 0.00049313 [jit_opt_after_cconv]: 0.00017357, [1] [Cycle 1]: 0.00016586, [11] [c_1]: 2.685e-05 [parameter_eliminate]: 3.73999e-06 [updatestate_depend_eliminate]: 7.43e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.60002e-06 [cse]: 3.227e-05 [call_graph_tuple_transform]: 2.344e-05 [tuple_list_get_item_eliminator]: 6.22001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.537e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 1.026e-05 [add_recomputation]: 4.955e-05 [cse_after_recomputation]: 2.514e-05, [1] [Cycle 1]: 1.973e-05, [1] [cse]: 1.293e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 6.98998e-06 [opt_after_jit_grad]: 0.00052812 [symbol_engine_optimizer]: 7.898e-05, [1] [Cycle 1]: 7.093e-05, [6] [build]: 4.62e-06 [elim_shapecalc]: 8.39002e-06 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.95002e-06 [fold_const_symbol]: 8.99e-06 [renormalize]: 5.50004e-07 [validate]: 9.574e-05 Sums bootstrap : 0.000336s : 0.27% type_inference : 0.116957s : 94.11% event_method : 0.000020s : 0.02% auto_monad : 0.000066s : 0.05% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000483s : 0.39% rewriter_before_opt_a : 0.000155s : 0.12% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000895s : 0.72% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002686s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000680s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.02% loop_unroll : 0.000493s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000528s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000096s : 0.08% Time group info: ------[substitution.] 0.000286 28 0.66% : 0.000002s : 2: substitution.elim_not_effective 0.41% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 4: substitution.graph_param_transform 83.49% : 0.000238s : 5: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.48% : 0.000013s : 3: substitution.reduce_eliminate 1.82% : 0.000005s : 4: substitution.remove_not_recompute_node 1.55% : 0.000004s : 2: substitution.replace_old_param 3.84% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.116880 2 97.52% : 0.113978s : 1: type_inference.infer 2.48% : 0.002902s : 1: type_inference.specialize ------[replace.] 0.000103 7 66.62% : 0.000069s : 5: replace.inline 33.38% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000245 7 96.03% : 0.000235s : 5: match.inline 3.97% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.19% : 0.000002s : 13: predicate.addn_zero_filter 1.76% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.12% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.61% : 0.000001s : 4: predicate.graph_param_transform 6.02% : 0.000009s : 28: predicate.inline 0.81% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.23% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.62% : 0.000003s : 19: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.57% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.65% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 2.03% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000003s : 13: predicate.reduce_eliminate 1.27% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.72% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000004s : 20: predicate.switch_defer_inline 2.02% : 0.000003s : 20: predicate.switch_layer_defer_inline 12.65% : 0.000020s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.07% : 0.000002s : 13: predicate.transpose_eliminate 1.29% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.59% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002430 25 66.39% : 0.001613s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.89% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.72% : 0.000746s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132314 72 0.04% : 0.000054s : 1: add_recomputation 0.05% : 0.000070s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000351s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.96% : 0.007889s : 1: jit_opt_a 0.13% : 0.000177s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.38% : 0.000504s : 1: loop_unroll 0.52% : 0.000691s : 1: mutable_eliminate 0.87% : 0.001152s : 26: opt.transform.jit_opt_a 0.04% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000538s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000491s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.46% : 0.001937s : 1: renormalize.infer 0.56% : 0.000740s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.12% : 0.000164s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.41% : 0.116973s : 1: type_inference TotalTime = 0.120733, [30] [bootstrap]: 0.00029249 [type_inference]: 0.109919 [event_method]: 1.856e-05 [auto_monad]: 6.453e-05 [graph_reusing]: 5.34998e-06 [pre_auto_parallel]: 2.04e-06 [py_interpret_to_execute]: 0.00048157 [rewriter_before_opt_a]: 8.554e-05 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.00750246, [2] [Cycle 1]: 0.00370284, [27] [switch_simplify]: 5.561e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00057011 [with_stream_mark]: 1.618e-05 [recompute_prepare]: 8.74e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 7.44002e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 4.02002e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.618e-05 [j_node_and_user_rematch]: 9.36002e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 6.25002e-06 [renormalize]: 0.0027001 [add_forward_monad_depend]: 6.17001e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.599e-05 [cse]: 2.081e-05 [replace_applicator]: 1.517e-05 [Cycle 2]: 0.00036884, [27] [switch_simplify]: 6.92002e-06 [loop_unroll]: 6.05002e-06 [a_1]: 0.00012243 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.46002e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 2.66999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 8.09989e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.257e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 9.89001e-06 [rewriter_after_opt_a]: 3.249e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 7.67998e-06 [mutable_eliminate]: 0.00060553 [jit_opt_b]: 5.526e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.929e-05 [inline_after_opt_a]: 1.813e-05 [cconv]: 2.422e-05 [loop_unroll]: 0.0004358 [jit_opt_after_cconv]: 0.00015534, [1] [Cycle 1]: 0.00014858, [11] [c_1]: 2.548e-05 [parameter_eliminate]: 2.80002e-06 [updatestate_depend_eliminate]: 5.69999e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.16003e-06 [cse]: 2.264e-05 [call_graph_tuple_transform]: 2.158e-05 [tuple_list_get_item_eliminator]: 6.76e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 6.69001e-06 [remove_dup_value]: 1.571e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 4.899e-05 [cse_after_recomputation]: 2.429e-05, [1] [Cycle 1]: 1.68e-05, [1] [cse]: 1.12e-05 [auto_monad_reorder]: 1.516e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00048805 [symbol_engine_optimizer]: 0.00019364, [1] [Cycle 1]: 0.00018672, [6] [build]: 3.76999e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 0.00012321 [opt_reshape]: 7.43999e-06 [fold_const_symbol]: 1.118e-05 [renormalize]: 3.60014e-07 [validate]: 4.322e-05 Sums bootstrap : 0.000292s : 0.25% type_inference : 0.109919s : 94.18% event_method : 0.000019s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000482s : 0.41% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000693s : 0.59% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002700s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000008s : 0.01% mutable_eliminate : 0.000606s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000436s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000488s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000123s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000280 24 27.37% : 0.000077s : 2: substitution.elim_not_effective 0.54% : 0.000002s : 2: substitution.fold_const_symbol 2.16% : 0.000006s : 4: substitution.graph_param_transform 60.85% : 0.000170s : 4: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 4.48% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109847 2 97.39% : 0.106978s : 1: type_inference.infer 2.61% : 0.002869s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.20% : 0.000052s : 4: replace.inline 32.80% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.60% : 0.000168s : 4: match.inline 6.40% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.74% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.87% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000001s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.41% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.89% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.99% : 0.000003s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002217 22 67.77% : 0.001503s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.35% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.88% : 0.000685s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124538 72 0.04% : 0.000052s : 1: add_recomputation 0.05% : 0.000068s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000311s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.03% : 0.007506s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000443s : 1: loop_unroll 0.49% : 0.000615s : 1: mutable_eliminate 0.74% : 0.000926s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000147s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.61% : 0.001999s : 1: renormalize.infer 0.55% : 0.000690s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.16% : 0.000196s : 1: symbol_engine_optimizer 88.27% : 0.109932s : 1: type_inference TotalTime = 0.0166925, [30] [bootstrap]: 0.00029397 [type_inference]: 0.00815684 [event_method]: 2.217e-05 [auto_monad]: 7.971e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.88e-06 [py_interpret_to_execute]: 5.49e-05 [rewriter_before_opt_a]: 8.568e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.00570791, [2] [Cycle 1]: 0.00189309, [27] [switch_simplify]: 5.895e-05 [loop_unroll]: 4.29e-05 [a_1]: 0.00065348 [with_stream_mark]: 1.84e-05 [recompute_prepare]: 8.69003e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 6.98998e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.60003e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.403e-05 [j_node_and_user_rematch]: 9.35001e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00077046 [add_forward_monad_depend]: 6.16e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.52e-05 [cse]: 4.284e-05 [replace_applicator]: 1.374e-05 [Cycle 2]: 0.00033509, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.19e-06 [a_1]: 9.802e-05 [with_stream_mark]: 1.037e-05 [recompute_prepare]: 5.39998e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.234e-05 [j_node_and_user_rematch]: 7.71001e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 5.50004e-07 [auto_monad_eliminator]: 6.49999e-06 [cse]: 1.319e-05 [replace_applicator]: 5.53002e-06 [py_interpret_to_execute_after_opt_a]: 1.301e-05 [rewriter_after_opt_a]: 3.575e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.0005965 [jit_opt_b]: 5.091e-05, [1] [Cycle 1]: 4.289e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.593e-05 [cconv]: 2.572e-05 [loop_unroll]: 0.00044856 [jit_opt_after_cconv]: 0.00016556, [1] [Cycle 1]: 0.00015844, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 3.28e-06 [updatestate_depend_eliminate]: 7.16999e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.58e-06 [cse]: 2.724e-05 [call_graph_tuple_transform]: 2.151e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.51002e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 6.30002e-06 [add_recomputation]: 4.84e-05 [cse_after_recomputation]: 3.66e-05, [1] [Cycle 1]: 3.107e-05, [1] [cse]: 2.448e-05 [auto_monad_reorder]: 1.813e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00050715 [symbol_engine_optimizer]: 7.617e-05, [1] [Cycle 1]: 6.95e-05, [6] [build]: 3.34001e-06 [elim_shapecalc]: 8.74e-06 [elim_not_effective]: 1.41e-05 [opt_reshape]: 5.99999e-06 [fold_const_symbol]: 8.85999e-06 [renormalize]: 5.09986e-07 [validate]: 3.935e-05 Sums bootstrap : 0.000294s : 2.33% type_inference : 0.008157s : 64.66% event_method : 0.000022s : 0.18% auto_monad : 0.000080s : 0.63% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000055s : 0.44% rewriter_before_opt_a : 0.000086s : 0.68% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000065s : 0.51% jit_opt_a.loop_unroll : 0.000048s : 0.38% jit_opt_a.a_1 : 0.000752s : 5.96% jit_opt_a.with_stream_mark : 0.000029s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000771s : 6.11% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.17% jit_opt_a.cse : 0.000056s : 0.44% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000036s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000597s : 4.73% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.20% loop_unroll : 0.000449s : 3.56% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000027s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.38% cse_after_recomputation.cse : 0.000024s : 0.19% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000507s : 4.02% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.31% Time group info: ------[substitution.] 0.000252 27 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000006s : 3: substitution.graph_param_transform 82.93% : 0.000209s : 5: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.26% : 0.000011s : 3: substitution.reduce_eliminate 1.69% : 0.000004s : 4: substitution.remove_not_recompute_node 1.38% : 0.000003s : 2: substitution.replace_old_param 4.58% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008087 2 86.77% : 0.007017s : 1: type_inference.infer 13.23% : 0.001070s : 1: type_inference.specialize ------[replace.] 0.000091 7 67.43% : 0.000061s : 5: replace.inline 32.57% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 95.16% : 0.000205s : 5: match.inline 4.84% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 747 1.15% : 0.000002s : 11: predicate.accumulaten_eliminater 1.31% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 1.82% : 0.000002s : 11: predicate.arithmetic_simplify 1.22% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 11: predicate.compare_switch_simplify 1.11% : 0.000001s : 11: predicate.depend_value_elim 1.03% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.10% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.75% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 11: predicate.environ_get_depend_swap 1.11% : 0.000001s : 11: predicate.environ_get_eliminate 1.03% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.37% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000007s : 24: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.33% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 16: predicate.load_eliminater 1.70% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.62% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 11: predicate.merge_addn 6.56% : 0.000009s : 11: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 16: predicate.partial_eliminate 1.37% : 0.000002s : 11: predicate.print_const_string_wrapper 1.92% : 0.000003s : 11: predicate.reduce_eliminate 1.27% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 19: predicate.replace_applicator 0.45% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000002s : 11: predicate.reshape_eliminate 1.17% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 11: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.11% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000004s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.47% : 0.000010s : 59: predicate.switch_simplify 1.55% : 0.000002s : 11: predicate.tile_eliminate 1.16% : 0.000002s : 11: predicate.transpose_eliminate 1.31% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000832 16 48.38% : 0.000403s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.93% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.69% : 0.000372s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018512 72 0.28% : 0.000051s : 1: add_recomputation 0.45% : 0.000083s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.65% : 0.000305s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.21% : 0.000039s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.85% : 0.005712s : 1: jit_opt_a 0.91% : 0.000168s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.47% : 0.000457s : 1: loop_unroll 3.27% : 0.000605s : 1: mutable_eliminate 5.31% : 0.000983s : 26: opt.transform.jit_opt_a 0.27% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.14% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.79% : 0.000516s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000064s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000020s : 1: remove_dup_value 2.23% : 0.000413s : 1: renormalize.infer 1.88% : 0.000349s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.48% : 0.000089s : 1: rewriter_before_opt_a 0.43% : 0.000079s : 1: symbol_engine_optimizer 44.16% : 0.008175s : 1: type_inference TotalTime = 0.0153032, [30] [bootstrap]: 0.00027965 [type_inference]: 0.0075446 [event_method]: 2.115e-05 [auto_monad]: 6.894e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 4.886e-05 [rewriter_before_opt_a]: 8.196e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00526496, [2] [Cycle 1]: 0.00164502, [27] [switch_simplify]: 5.716e-05 [loop_unroll]: 3.284e-05 [a_1]: 0.00059854 [with_stream_mark]: 1.608e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 6.42001e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.54998e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 7.80012e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.45999e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.0006351 [add_forward_monad_depend]: 4.67e-06 [auto_monad_grad]: 1.33002e-06 [auto_monad_eliminator]: 1.072e-05 [cse]: 2.414e-05 [replace_applicator]: 1.163e-05 [Cycle 2]: 0.00033861, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00010843 [with_stream_mark]: 9.28002e-06 [recompute_prepare]: 5.78002e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.25001e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 4.65999e-06 [merge_forward]: 2.52001e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.081e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 6.88e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.314e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 9.41998e-06 [rewriter_after_opt_a]: 2.736e-05 [convert_after_rewriter]: 5.60001e-06 [order_py_execute_after_rewriter]: 4.3e-06 [mutable_eliminate]: 0.00049489 [jit_opt_b]: 4.879e-05, [1] [Cycle 1]: 4.253e-05, [2] [frontend_op_eliminate]: 1.565e-05 [inline_after_opt_a]: 1.574e-05 [cconv]: 1.478e-05 [loop_unroll]: 0.00043019 [jit_opt_after_cconv]: 0.00014792, [1] [Cycle 1]: 0.00014195, [11] [c_1]: 2.004e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.17e-05 [call_graph_tuple_transform]: 1.625e-05 [tuple_list_get_item_eliminator]: 5.69999e-06 [none_parameter_eliminate]: 1.00999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 8.77999e-06 [partial_unused_args_eliminate]: 1.69e-06 [environ_conv]: 4.45999e-06 [add_recomputation]: 3.287e-05 [cse_after_recomputation]: 2.267e-05, [1] [Cycle 1]: 1.771e-05, [1] [cse]: 1.156e-05 [auto_monad_reorder]: 1.179e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 4.06001e-06 [opt_after_jit_grad]: 0.00045253 [symbol_engine_optimizer]: 6.935e-05, [1] [Cycle 1]: 6.357e-05, [6] [build]: 2.41e-06 [elim_shapecalc]: 7.79002e-06 [elim_not_effective]: 1.264e-05 [opt_reshape]: 5.49e-06 [fold_const_symbol]: 8.01001e-06 [renormalize]: 3.89991e-07 [validate]: 2.818e-05 Sums bootstrap : 0.000280s : 2.44% type_inference : 0.007545s : 65.86% event_method : 0.000021s : 0.18% auto_monad : 0.000069s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000049s : 0.43% rewriter_before_opt_a : 0.000082s : 0.72% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000063s : 0.55% jit_opt_a.loop_unroll : 0.000039s : 0.34% jit_opt_a.a_1 : 0.000707s : 6.17% jit_opt_a.with_stream_mark : 0.000025s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000635s : 5.54% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.15% jit_opt_a.cse : 0.000037s : 0.33% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000027s : 0.24% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000495s : 4.32% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000015s : 0.13% loop_unroll : 0.000430s : 3.76% jit_opt_after_cconv.c_1 : 0.000020s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000009s : 0.08% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000004s : 0.04% add_recomputation : 0.000033s : 0.29% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000012s : 0.10% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000453s : 3.95% symbol_engine_optimizer.build : 0.000002s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.25% Time group info: ------[substitution.] 0.000213 27 0.65% : 0.000001s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 1.60% : 0.000003s : 3: substitution.graph_param_transform 83.01% : 0.000177s : 5: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.77% : 0.000010s : 3: substitution.reduce_eliminate 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.49% : 0.000003s : 2: substitution.replace_old_param 4.82% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007476 2 86.62% : 0.006476s : 1: type_inference.infer 13.38% : 0.001000s : 1: type_inference.specialize ------[replace.] 0.000086 7 67.50% : 0.000058s : 5: replace.inline 32.50% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 7 95.02% : 0.000174s : 5: match.inline 4.98% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 747 1.36% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.18% : 0.000002s : 11: predicate.addn_zero_filter 1.97% : 0.000003s : 11: predicate.arithmetic_simplify 1.17% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.19% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000002s : 11: predicate.environ_get_eliminate 1.09% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.70% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.09% : 0.000001s : 11: predicate.minmaximum_grad 6.73% : 0.000009s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.15% : 0.000001s : 11: predicate.print_const_string_wrapper 1.88% : 0.000002s : 11: predicate.reduce_eliminate 1.41% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 19: predicate.replace_applicator 0.46% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.26% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 11: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.24% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.61% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000742 16 49.62% : 0.000368s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.03% : 0.000052s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.35% : 0.000322s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016935 72 0.21% : 0.000036s : 1: add_recomputation 0.43% : 0.000072s : 1: auto_monad 0.08% : 0.000014s : 1: auto_monad_reorder 1.73% : 0.000293s : 1: bootstrap 0.10% : 0.000017s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.11% : 0.005268s : 1: jit_opt_a 0.89% : 0.000151s : 1: jit_opt_after_cconv 0.30% : 0.000051s : 1: jit_opt_b 2.59% : 0.000438s : 1: loop_unroll 2.98% : 0.000504s : 1: mutable_eliminate 5.44% : 0.000921s : 26: opt.transform.jit_opt_a 0.26% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.13% : 0.000021s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.72% : 0.000460s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000052s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000011s : 1: remove_dup_value 2.12% : 0.000358s : 1: renormalize.infer 1.59% : 0.000270s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000030s : 1: rewriter_after_opt_a 0.50% : 0.000085s : 1: rewriter_before_opt_a 0.42% : 0.000072s : 1: symbol_engine_optimizer 44.64% : 0.007561s : 1: type_inference TotalTime = 0.0168604, [30] [bootstrap]: 0.00027983 [type_inference]: 0.00820605 [event_method]: 2.194e-05 [auto_monad]: 6.582e-05 [graph_reusing]: 5.56e-06 [pre_auto_parallel]: 2.12999e-06 [py_interpret_to_execute]: 5.107e-05 [rewriter_before_opt_a]: 8.165e-05 [expand_dump_flag]: 2.40002e-06 [jit_opt_a]: 0.0059052, [2] [Cycle 1]: 0.00198707, [27] [switch_simplify]: 5.585e-05 [loop_unroll]: 3.297e-05 [a_1]: 0.00065819 [with_stream_mark]: 1.707e-05 [recompute_prepare]: 8.24002e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.56002e-06 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.42002e-06 [cell_reuse_recompute_pass]: 7.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.302e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 1.926e-05 [renormalize]: 0.0008829 [add_forward_monad_depend]: 4.77e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.36e-05 [cse]: 2.734e-05 [replace_applicator]: 1.182e-05 [Cycle 2]: 0.00040795, [27] [switch_simplify]: 5.73002e-06 [loop_unroll]: 5.00999e-06 [a_1]: 9.939e-05 [with_stream_mark]: 9.07001e-06 [recompute_prepare]: 5.29998e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.34998e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.28998e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.245e-05 [j_node_and_user_rematch]: 8.15999e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 7.41001e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.48e-06 [cse]: 1.516e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.286e-05 [rewriter_after_opt_a]: 3.595e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00060118 [jit_opt_b]: 5.121e-05, [1] [Cycle 1]: 4.428e-05, [2] [frontend_op_eliminate]: 1.658e-05 [inline_after_opt_a]: 1.567e-05 [cconv]: 2.562e-05 [loop_unroll]: 0.00044649 [jit_opt_after_cconv]: 0.00016123, [1] [Cycle 1]: 0.00015442, [11] [c_1]: 2.115e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.00002e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.542e-05 [call_graph_tuple_transform]: 2.01e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 1.42e-06 [renormalize]: 7.50006e-07 [switch_simplify]: 5.42999e-06 [remove_dup_value]: 1.602e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 4.755e-05 [cse_after_recomputation]: 2.395e-05, [1] [Cycle 1]: 1.776e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.7e-05 [get_jit_bprop_graph]: 2.31e-06 [rewriter_after_jit_bprop_graph]: 5.73002e-06 [opt_after_jit_grad]: 0.00049169 [symbol_engine_optimizer]: 7.465e-05, [1] [Cycle 1]: 6.845e-05, [6] [build]: 2.93998e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 9.42999e-06 [renormalize]: 6.80011e-07 [validate]: 3.864e-05 Sums bootstrap : 0.000280s : 2.21% type_inference : 0.008206s : 64.68% event_method : 0.000022s : 0.17% auto_monad : 0.000066s : 0.52% graph_reusing : 0.000006s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000051s : 0.40% rewriter_before_opt_a : 0.000082s : 0.64% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.49% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000758s : 5.97% jit_opt_a.with_stream_mark : 0.000026s : 0.21% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000024s : 0.19% jit_opt_a.renormalize : 0.000883s : 6.96% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.16% jit_opt_a.cse : 0.000042s : 0.33% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000036s : 0.28% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000601s : 4.74% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000026s : 0.20% loop_unroll : 0.000446s : 3.52% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.37% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000492s : 3.88% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000039s : 0.30% Time group info: ------[substitution.] 0.000266 27 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000006s : 3: substitution.graph_param_transform 84.06% : 0.000224s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.97% : 0.000011s : 3: substitution.reduce_eliminate 1.61% : 0.000004s : 4: substitution.remove_not_recompute_node 1.62% : 0.000004s : 2: substitution.replace_old_param 3.92% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008135 2 87.70% : 0.007134s : 1: type_inference.infer 12.30% : 0.001001s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.21% : 0.000064s : 5: replace.inline 32.79% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000230 7 95.93% : 0.000221s : 5: match.inline 4.07% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.48% : 0.000002s : 11: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 11: predicate.addn_check_dump 1.43% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.33% : 0.000002s : 11: predicate.depend_value_elim 1.15% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.18% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.86% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 24: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.57% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.24% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000001s : 11: predicate.print_const_string_wrapper 2.16% : 0.000003s : 11: predicate.reduce_eliminate 1.40% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 19: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.19% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.43% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.29% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000839 16 51.14% : 0.000429s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.91% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.94% : 0.000335s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018797 72 0.27% : 0.000050s : 1: add_recomputation 0.37% : 0.000069s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.54% : 0.000290s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.14% : 0.000026s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 31.43% : 0.005908s : 1: jit_opt_a 0.87% : 0.000164s : 1: jit_opt_after_cconv 0.29% : 0.000054s : 1: jit_opt_b 2.42% : 0.000455s : 1: loop_unroll 3.25% : 0.000611s : 1: mutable_eliminate 5.27% : 0.000990s : 26: opt.transform.jit_opt_a 0.26% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.66% : 0.000501s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000054s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.78% : 0.000523s : 1: renormalize.infer 1.87% : 0.000351s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000039s : 1: rewriter_after_opt_a 0.45% : 0.000085s : 1: rewriter_before_opt_a 0.41% : 0.000077s : 1: symbol_engine_optimizer 43.75% : 0.008223s : 1: type_inference TotalTime = 0.0740587, [30] [bootstrap]: 0.00029722 [type_inference]: 0.0634259 [event_method]: 2.05e-05 [auto_monad]: 5.94e-05 [graph_reusing]: 4.48001e-06 [pre_auto_parallel]: 1.84998e-06 [py_interpret_to_execute]: 0.00030907 [rewriter_before_opt_a]: 7.714e-05 [expand_dump_flag]: 2.63998e-06 [jit_opt_a]: 0.00757984, [2] [Cycle 1]: 0.0037312, [27] [switch_simplify]: 5.42e-05 [loop_unroll]: 3.124e-05 [a_1]: 0.00057435 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.33998e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 6.05002e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 3.903e-05 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.338e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.82e-06 [inline_without_move]: 6.20002e-06 [renormalize]: 0.00270524 [add_forward_monad_depend]: 6.37001e-06 [auto_monad_grad]: 2.14999e-06 [auto_monad_eliminator]: 1.476e-05 [cse]: 2.131e-05 [replace_applicator]: 1.522e-05 [Cycle 2]: 0.00037899, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 6.87002e-06 [a_1]: 0.00012816 [with_stream_mark]: 1.29e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.04003e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.623e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.90023e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.146e-05 [replace_applicator]: 5.77999e-06 [py_interpret_to_execute_after_opt_a]: 1.224e-05 [rewriter_after_opt_a]: 3.194e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00059958 [jit_opt_b]: 6.853e-05, [1] [Cycle 1]: 5.086e-05, [2] [frontend_op_eliminate]: 2.031e-05 [inline_after_opt_a]: 1.83e-05 [cconv]: 2.26e-05 [loop_unroll]: 0.00043741 [jit_opt_after_cconv]: 0.00015303, [1] [Cycle 1]: 0.00014586, [11] [c_1]: 2.618e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 6.39001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.062e-05 [call_graph_tuple_transform]: 2.099e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 6.94999e-06 [remove_dup_value]: 1.412e-05 [partial_unused_args_eliminate]: 1.76e-06 [environ_conv]: 7.58999e-06 [add_recomputation]: 4.114e-05 [cse_after_recomputation]: 2.288e-05, [1] [Cycle 1]: 1.717e-05, [1] [cse]: 1.092e-05 [auto_monad_reorder]: 1.275e-05 [get_jit_bprop_graph]: 1.75001e-06 [rewriter_after_jit_bprop_graph]: 6.07999e-06 [opt_after_jit_grad]: 0.00051795 [symbol_engine_optimizer]: 7.75e-05, [1] [Cycle 1]: 7.071e-05, [6] [build]: 3.48999e-06 [elim_shapecalc]: 8.29002e-06 [elim_not_effective]: 1.418e-05 [opt_reshape]: 6.76e-06 [fold_const_symbol]: 9.30001e-06 [renormalize]: 6.19999e-07 [validate]: 6.631e-05 Sums bootstrap : 0.000297s : 0.42% type_inference : 0.063426s : 90.61% event_method : 0.000020s : 0.03% auto_monad : 0.000059s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000309s : 0.44% rewriter_before_opt_a : 0.000077s : 0.11% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.09% jit_opt_a.loop_unroll : 0.000038s : 0.05% jit_opt_a.a_1 : 0.000703s : 1.00% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000045s : 0.06% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002705s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000033s : 0.05% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000032s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000600s : 0.86% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000023s : 0.03% loop_unroll : 0.000437s : 0.62% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000518s : 0.74% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000066s : 0.09% Time group info: ------[substitution.] 0.000199 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.62% : 0.000005s : 4: substitution.graph_param_transform 83.84% : 0.000167s : 4: substitution.inline 1.81% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.063344 2 96.81% : 0.061321s : 1: type_inference.infer 3.19% : 0.002023s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.50% : 0.000049s : 4: replace.inline 32.50% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 94.84% : 0.000165s : 4: match.inline 5.16% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 2.32% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.32% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.65% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.56% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.71% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.44% : 0.000002s : 12: predicate.minmaximum_grad 1.83% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.73% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.92% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003069 34 75.53% : 0.002318s : 27: func_graph_cloner_run.FuncGraphClonerGraph 0.97% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.50% : 0.000721s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.077788 72 0.06% : 0.000045s : 1: add_recomputation 0.08% : 0.000063s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.40% : 0.000311s : 1: bootstrap 0.03% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.75% : 0.007583s : 1: jit_opt_a 0.20% : 0.000156s : 1: jit_opt_after_cconv 0.09% : 0.000071s : 1: jit_opt_b 0.57% : 0.000446s : 1: loop_unroll 0.78% : 0.000608s : 1: mutable_eliminate 1.25% : 0.000971s : 26: opt.transform.jit_opt_a 0.07% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000527s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000316s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 2.43% : 0.001891s : 1: renormalize.infer 1.04% : 0.000805s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000035s : 1: rewriter_after_opt_a 0.10% : 0.000082s : 1: rewriter_before_opt_a 0.10% : 0.000080s : 1: symbol_engine_optimizer 81.56% : 0.063442s : 1: type_inference TotalTime = 0.0186701, [30] [bootstrap]: 0.00025207 [type_inference]: 0.00716449 [event_method]: 1.868e-05 [auto_monad]: 5.131e-05 [graph_reusing]: 5.24e-06 [pre_auto_parallel]: 2.00002e-06 [py_interpret_to_execute]: 4.102e-05 [rewriter_before_opt_a]: 7.534e-05 [expand_dump_flag]: 2.34001e-06 [jit_opt_a]: 0.00476976, [2] [Cycle 1]: 0.00150785, [27] [switch_simplify]: 4.86e-05 [loop_unroll]: 3.262e-05 [a_1]: 0.00056694 [with_stream_mark]: 1.301e-05 [recompute_prepare]: 7.35e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.125e-05 [j_node_and_user_rematch]: 8.62e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00056204 [add_forward_monad_depend]: 4.37003e-06 [auto_monad_grad]: 1.46998e-06 [auto_monad_eliminator]: 1.138e-05 [cse]: 2.299e-05 [replace_applicator]: 1.138e-05 [Cycle 2]: 0.00031742, [27] [switch_simplify]: 5.78997e-06 [loop_unroll]: 5.10001e-06 [a_1]: 9.449e-05 [with_stream_mark]: 8.38999e-06 [recompute_prepare]: 5.20001e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.18002e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 4.97e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.038e-05 [j_node_and_user_rematch]: 7.55e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 6.84001e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.37001e-06 [cse]: 1.217e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 9.40001e-06 [rewriter_after_opt_a]: 3.077e-05 [convert_after_rewriter]: 5.88002e-06 [order_py_execute_after_rewriter]: 4.53999e-06 [mutable_eliminate]: 0.00048563 [jit_opt_b]: 4.97e-05, [1] [Cycle 1]: 4.294e-05, [2] [frontend_op_eliminate]: 1.648e-05 [inline_after_opt_a]: 1.539e-05 [cconv]: 1.875e-05 [loop_unroll]: 0.00452437 [jit_opt_after_cconv]: 0.00019943, [1] [Cycle 1]: 0.00019114, [11] [c_1]: 2.438e-05 [parameter_eliminate]: 4.49002e-06 [updatestate_depend_eliminate]: 9.24e-06 [updatestate_assign_eliminate]: 3.30003e-06 [updatestate_loads_eliminate]: 2.94999e-06 [cse]: 3.531e-05 [call_graph_tuple_transform]: 2.27e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.723e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.6e-06 [add_recomputation]: 5.292e-05 [cse_after_recomputation]: 2.587e-05, [1] [Cycle 1]: 2.03e-05, [1] [cse]: 1.391e-05 [auto_monad_reorder]: 1.835e-05 [get_jit_bprop_graph]: 2.57001e-06 [rewriter_after_jit_bprop_graph]: 1.298e-05 [opt_after_jit_grad]: 0.00052474 [symbol_engine_optimizer]: 7.689e-05, [1] [Cycle 1]: 7.032e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.449e-05 [opt_reshape]: 6.01003e-06 [fold_const_symbol]: 9.38002e-06 [renormalize]: 4.60015e-07 [validate]: 4.846e-05 Sums bootstrap : 0.000252s : 1.66% type_inference : 0.007164s : 47.30% event_method : 0.000019s : 0.12% auto_monad : 0.000051s : 0.34% graph_reusing : 0.000005s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000041s : 0.27% rewriter_before_opt_a : 0.000075s : 0.50% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000054s : 0.36% jit_opt_a.loop_unroll : 0.000038s : 0.25% jit_opt_a.a_1 : 0.000661s : 4.37% jit_opt_a.with_stream_mark : 0.000021s : 0.14% jit_opt_a.recompute_prepare : 0.000013s : 0.08% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.03% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.07% jit_opt_a.accelerated_algorithm : 0.000010s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.06% jit_opt_a.merge_forward : 0.000005s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.14% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.11% jit_opt_a.meta_fg_expand : 0.000004s : 0.02% jit_opt_a.replace_old_param : 0.000015s : 0.10% jit_opt_a.inline_without_move : 0.000010s : 0.07% jit_opt_a.renormalize : 0.000562s : 3.71% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.04% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.11% jit_opt_a.cse : 0.000035s : 0.23% jit_opt_a.replace_applicator : 0.000016s : 0.11% py_interpret_to_execute_after_opt_a : 0.000009s : 0.06% rewriter_after_opt_a : 0.000031s : 0.20% convert_after_rewriter : 0.000006s : 0.04% order_py_execute_after_rewriter : 0.000005s : 0.03% mutable_eliminate : 0.000486s : 3.21% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.11% jit_opt_b.inline_after_opt_a : 0.000015s : 0.10% cconv : 0.000019s : 0.12% loop_unroll : 0.004524s : 29.87% jit_opt_after_cconv.c_1 : 0.000024s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000035s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.04% remove_dup_value : 0.000017s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000008s : 0.05% add_recomputation : 0.000053s : 0.35% cse_after_recomputation.cse : 0.000014s : 0.09% auto_monad_reorder : 0.000018s : 0.12% get_jit_bprop_graph : 0.000003s : 0.02% rewriter_after_jit_bprop_graph : 0.000013s : 0.09% opt_after_jit_grad : 0.000525s : 3.46% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.32% Time group info: ------[substitution.] 0.000195 27 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000002s : 2: substitution.fold_const_symbol 2.98% : 0.000006s : 3: substitution.graph_param_transform 82.43% : 0.000161s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.16% : 0.000008s : 3: substitution.reduce_eliminate 1.85% : 0.000004s : 4: substitution.remove_not_recompute_node 1.57% : 0.000003s : 2: substitution.replace_old_param 3.85% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007114 2 87.90% : 0.006253s : 1: type_inference.infer 12.10% : 0.000861s : 1: type_inference.specialize ------[replace.] 0.000081 7 66.79% : 0.000054s : 5: replace.inline 33.21% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 7 96.07% : 0.000158s : 5: match.inline 3.93% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.31% : 0.000002s : 11: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000002s : 11: predicate.arithmetic_simplify 1.50% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.34% : 0.000002s : 11: predicate.depend_value_elim 1.22% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000001s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.40% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 16: predicate.load_eliminater 2.06% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.42% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 11: predicate.merge_addn 1.24% : 0.000002s : 11: predicate.minmaximum_grad 1.27% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 16: predicate.partial_eliminate 1.40% : 0.000002s : 11: predicate.print_const_string_wrapper 1.88% : 0.000002s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.24% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.19% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 59: predicate.switch_simplify 1.43% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000694 16 51.12% : 0.000355s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.41% : 0.000051s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.46% : 0.000288s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.020170 72 0.28% : 0.000056s : 1: add_recomputation 0.27% : 0.000055s : 1: auto_monad 0.10% : 0.000021s : 1: auto_monad_reorder 1.32% : 0.000265s : 1: bootstrap 0.11% : 0.000021s : 1: cconv 0.04% : 0.000008s : 1: convert_after_rewriter 0.14% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.11% : 0.000022s : 1: event_method 0.02% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 23.66% : 0.004772s : 1: jit_opt_a 1.00% : 0.000202s : 1: jit_opt_after_cconv 0.26% : 0.000052s : 1: jit_opt_b 22.51% : 0.004541s : 1: loop_unroll 2.45% : 0.000495s : 1: mutable_eliminate 4.28% : 0.000863s : 26: opt.transform.jit_opt_a 0.28% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000026s : 4: opt.transform.jit_opt_b 0.12% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.06% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000035s : 4: opt.transform.symbol_engine_opt 2.65% : 0.000534s : 1: opt_after_jit_grad 0.03% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000044s : 1: py_interpret_to_execute 0.06% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000020s : 1: remove_dup_value 1.51% : 0.000304s : 1: renormalize.infer 1.25% : 0.000253s : 1: renormalize.specialize 0.08% : 0.000015s : 1: rewriter_after_jit_bprop_graph 0.17% : 0.000034s : 1: rewriter_after_opt_a 0.39% : 0.000078s : 1: rewriter_before_opt_a 0.39% : 0.000080s : 1: symbol_engine_optimizer 35.57% : 0.007175s : 1: type_inference TotalTime = 0.0163255, [30] [bootstrap]: 0.00031098 [type_inference]: 0.00788622 [event_method]: 1.998e-05 [auto_monad]: 7.238e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 4.594e-05 [rewriter_before_opt_a]: 0.00011882 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00560154, [2] [Cycle 1]: 0.00188252, [27] [switch_simplify]: 6.15e-05 [loop_unroll]: 3.284e-05 [a_1]: 0.00065439 [with_stream_mark]: 1.842e-05 [recompute_prepare]: 9.12001e-06 [updatestate_depend_eliminate]: 4.49002e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.40997e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.48002e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.574e-05 [j_node_and_user_rematch]: 9.36002e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.72999e-06 [renormalize]: 0.00076707 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 2.92002e-06 [auto_monad_eliminator]: 1.67e-05 [cse]: 3.292e-05 [replace_applicator]: 1.435e-05 [Cycle 2]: 0.00033476, [27] [switch_simplify]: 6.12001e-06 [loop_unroll]: 4.79998e-06 [a_1]: 9.642e-05 [with_stream_mark]: 1.078e-05 [recompute_prepare]: 5.29998e-06 [updatestate_depend_eliminate]: 3.56001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.60001e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.55001e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.168e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 4.92e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.298e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 1.47e-05 [rewriter_after_opt_a]: 5.091e-05 [convert_after_rewriter]: 7.83001e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00058184 [jit_opt_b]: 5.133e-05, [1] [Cycle 1]: 4.378e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.643e-05 [cconv]: 2.758e-05 [loop_unroll]: 0.00045791 [jit_opt_after_cconv]: 0.00016084, [1] [Cycle 1]: 0.00015302, [11] [c_1]: 2.109e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 6.76e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.49e-05 [call_graph_tuple_transform]: 1.853e-05 [tuple_list_get_item_eliminator]: 5.15001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 8.30012e-07 [switch_simplify]: 1.441e-05 [remove_dup_value]: 1.58e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 5.65001e-06 [add_recomputation]: 4.998e-05 [cse_after_recomputation]: 2.542e-05, [1] [Cycle 1]: 1.918e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.751e-05 [get_jit_bprop_graph]: 2.30002e-06 [rewriter_after_jit_bprop_graph]: 4.91997e-06 [opt_after_jit_grad]: 0.00048895 [symbol_engine_optimizer]: 7.526e-05, [1] [Cycle 1]: 6.877e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 7.99997e-06 [elim_not_effective]: 1.397e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.77999e-06 [renormalize]: 5.39992e-07 [validate]: 3.845e-05 Sums bootstrap : 0.000311s : 2.52% type_inference : 0.007886s : 63.88% event_method : 0.000020s : 0.16% auto_monad : 0.000072s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.37% rewriter_before_opt_a : 0.000119s : 0.96% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000068s : 0.55% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000751s : 6.08% jit_opt_a.with_stream_mark : 0.000029s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000008s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000767s : 6.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.19% jit_opt_a.cse : 0.000046s : 0.37% jit_opt_a.replace_applicator : 0.000021s : 0.17% py_interpret_to_execute_after_opt_a : 0.000015s : 0.12% rewriter_after_opt_a : 0.000051s : 0.41% convert_after_rewriter : 0.000008s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000582s : 4.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000028s : 0.22% loop_unroll : 0.000458s : 3.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000025s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000014s : 0.12% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.40% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000489s : 3.96% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.31% Time group info: ------[substitution.] 0.000253 27 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000002s : 2: substitution.fold_const_symbol 2.15% : 0.000005s : 3: substitution.graph_param_transform 81.71% : 0.000207s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.51% : 0.000011s : 3: substitution.reduce_eliminate 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 4.46% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007825 2 87.72% : 0.006864s : 1: type_inference.infer 12.28% : 0.000961s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.21% : 0.000063s : 5: replace.inline 31.79% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 95.22% : 0.000203s : 5: match.inline 4.78% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.16% : 0.000001s : 11: predicate.addn_zero_filter 2.12% : 0.000003s : 11: predicate.arithmetic_simplify 1.47% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 16: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000006s : 38: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.26% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 16: predicate.partial_eliminate 1.55% : 0.000002s : 11: predicate.print_const_string_wrapper 2.09% : 0.000003s : 11: predicate.reduce_eliminate 1.53% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.43% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.70% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.43% : 0.000011s : 59: predicate.switch_simplify 1.39% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 11: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000831 16 54.14% : 0.000450s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.47% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.39% : 0.000319s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018141 72 0.29% : 0.000053s : 1: add_recomputation 0.42% : 0.000076s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.78% : 0.000324s : 1: bootstrap 0.17% : 0.000031s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.90% : 0.005605s : 1: jit_opt_a 0.90% : 0.000163s : 1: jit_opt_after_cconv 0.30% : 0.000054s : 1: jit_opt_b 2.58% : 0.000468s : 1: loop_unroll 3.27% : 0.000593s : 1: mutable_eliminate 5.38% : 0.000976s : 26: opt.transform.jit_opt_a 0.31% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000016s : 1: opt.transform.mutable_eliminate 0.12% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.75% : 0.000498s : 1: opt_after_jit_grad 0.04% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000049s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.35% : 0.000426s : 1: renormalize.infer 1.84% : 0.000334s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000055s : 1: rewriter_after_opt_a 0.67% : 0.000122s : 1: rewriter_before_opt_a 0.43% : 0.000078s : 1: symbol_engine_optimizer 43.56% : 0.007902s : 1: type_inference TotalTime = 0.0680823, [30] [bootstrap]: 0.0003057 [type_inference]: 0.0573638 [event_method]: 2.029e-05 [auto_monad]: 5.873e-05 [graph_reusing]: 5.17e-06 [pre_auto_parallel]: 1.99e-06 [py_interpret_to_execute]: 0.00033822 [rewriter_before_opt_a]: 8.832e-05 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.007615, [2] [Cycle 1]: 0.00349722, [27] [switch_simplify]: 5.689e-05 [loop_unroll]: 3.127e-05 [a_1]: 0.00058304 [with_stream_mark]: 1.493e-05 [recompute_prepare]: 8.58001e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.48998e-06 [meta_shard_fg_expand]: 1.81998e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.262e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 0.00247106 [add_forward_monad_depend]: 7.03e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.74e-05 [cse]: 2.466e-05 [replace_applicator]: 1.773e-05 [Cycle 2]: 0.00038003, [27] [switch_simplify]: 7.63999e-06 [loop_unroll]: 7.06001e-06 [a_1]: 0.00012784 [with_stream_mark]: 1.195e-05 [recompute_prepare]: 6.16998e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 2.18998e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 2.30002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 9.59999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.116e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.356e-05 [rewriter_after_opt_a]: 3.528e-05 [convert_after_rewriter]: 7.43999e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00067354 [jit_opt_b]: 5.754e-05, [1] [Cycle 1]: 5.067e-05, [2] [frontend_op_eliminate]: 2.027e-05 [inline_after_opt_a]: 1.821e-05 [cconv]: 2.471e-05 [loop_unroll]: 0.00043689 [jit_opt_after_cconv]: 0.00015422, [1] [Cycle 1]: 0.00014778, [11] [c_1]: 2.583e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.63002e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.245e-05 [call_graph_tuple_transform]: 2.127e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.07998e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.257e-05 [partial_unused_args_eliminate]: 2.55002e-06 [environ_conv]: 8.99e-06 [add_recomputation]: 4.298e-05 [cse_after_recomputation]: 2.406e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.181e-05 [auto_monad_reorder]: 1.252e-05 [get_jit_bprop_graph]: 1.86003e-06 [rewriter_after_jit_bprop_graph]: 4.70001e-06 [opt_after_jit_grad]: 0.00046135 [symbol_engine_optimizer]: 7.838e-05, [1] [Cycle 1]: 7.228e-05, [6] [build]: 3.60998e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.44001e-06 [fold_const_symbol]: 1.004e-05 [renormalize]: 3.80009e-07 [validate]: 4.351e-05 Sums bootstrap : 0.000306s : 0.48% type_inference : 0.057364s : 89.98% event_method : 0.000020s : 0.03% auto_monad : 0.000059s : 0.09% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000338s : 0.53% rewriter_before_opt_a : 0.000088s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000711s : 1.12% jit_opt_a.with_stream_mark : 0.000027s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002471s : 3.88% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000036s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000674s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000437s : 0.69% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000043s : 0.07% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000461s : 0.72% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000203 24 1.51% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000006s : 4: substitution.graph_param_transform 83.84% : 0.000170s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.16% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057279 2 96.20% : 0.055105s : 1: type_inference.infer 3.80% : 0.002175s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.03% : 0.000053s : 4: replace.inline 31.97% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 94.69% : 0.000167s : 4: match.inline 5.31% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 12: predicate.addn_check_dump 1.50% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.46% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.94% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.71% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.84% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.80% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.18% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002596 26 71.79% : 0.001864s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.89% : 0.000698s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071577 72 0.06% : 0.000046s : 1: add_recomputation 0.09% : 0.000062s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.45% : 0.000321s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.64% : 0.007619s : 1: jit_opt_a 0.22% : 0.000157s : 1: jit_opt_after_cconv 0.08% : 0.000060s : 1: jit_opt_b 0.62% : 0.000445s : 1: loop_unroll 0.95% : 0.000683s : 1: mutable_eliminate 1.33% : 0.000950s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000345s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 2.26% : 0.001615s : 1: renormalize.infer 1.18% : 0.000847s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000094s : 1: rewriter_before_opt_a 0.11% : 0.000081s : 1: symbol_engine_optimizer 80.16% : 0.057379s : 1: type_inference TotalTime = 0.0164364, [30] [bootstrap]: 0.00033708 [type_inference]: 0.0077367 [event_method]: 2.024e-05 [auto_monad]: 7.691e-05 [graph_reusing]: 6.44999e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 4.465e-05 [rewriter_before_opt_a]: 7.881e-05 [expand_dump_flag]: 2.71e-06 [jit_opt_a]: 0.00575601, [2] [Cycle 1]: 0.00196863, [27] [switch_simplify]: 6.713e-05 [loop_unroll]: 3.366e-05 [a_1]: 0.00067897 [with_stream_mark]: 2.037e-05 [recompute_prepare]: 9.36e-06 [updatestate_depend_eliminate]: 4.34997e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.51999e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.39998e-06 [accelerated_algorithm]: 6.86999e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.81e-06 [replace_old_param]: 1.037e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00080743 [add_forward_monad_depend]: 6.02999e-06 [auto_monad_grad]: 2.12999e-06 [auto_monad_eliminator]: 1.71e-05 [cse]: 2.868e-05 [replace_applicator]: 1.427e-05 [Cycle 2]: 0.00034959, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.747e-05 [with_stream_mark]: 1.143e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.25002e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 4.86002e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 4.78001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.15e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 4.94003e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.74998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 7.65e-06 [cse]: 1.506e-05 [replace_applicator]: 6.76e-06 [py_interpret_to_execute_after_opt_a]: 1.288e-05 [rewriter_after_opt_a]: 3.894e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00058781 [jit_opt_b]: 5.062e-05, [1] [Cycle 1]: 4.332e-05, [2] [frontend_op_eliminate]: 1.597e-05 [inline_after_opt_a]: 1.605e-05 [cconv]: 2.611e-05 [loop_unroll]: 0.00047775 [jit_opt_after_cconv]: 0.0001538, [1] [Cycle 1]: 0.00014722, [11] [c_1]: 2.078e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 7.6e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.43002e-06 [cse]: 2.782e-05 [call_graph_tuple_transform]: 2.047e-05 [tuple_list_get_item_eliminator]: 5.71e-06 [none_parameter_eliminate]: 1.93002e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 1.535e-05 [partial_unused_args_eliminate]: 2.71999e-06 [environ_conv]: 7.7e-06 [add_recomputation]: 5.131e-05 [cse_after_recomputation]: 2.708e-05, [1] [Cycle 1]: 2.156e-05, [1] [cse]: 1.481e-05 [auto_monad_reorder]: 1.782e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 5.42999e-06 [opt_after_jit_grad]: 0.00057451 [symbol_engine_optimizer]: 7.734e-05, [1] [Cycle 1]: 7.021e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.392e-05 [opt_reshape]: 6.64999e-06 [fold_const_symbol]: 9.19e-06 [renormalize]: 6.10016e-07 [validate]: 4.281e-05 Sums bootstrap : 0.000337s : 2.72% type_inference : 0.007737s : 62.53% event_method : 0.000020s : 0.16% auto_monad : 0.000077s : 0.62% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.36% rewriter_before_opt_a : 0.000079s : 0.64% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000073s : 0.59% jit_opt_a.loop_unroll : 0.000039s : 0.31% jit_opt_a.a_1 : 0.000776s : 6.28% jit_opt_a.with_stream_mark : 0.000032s : 0.26% jit_opt_a.recompute_prepare : 0.000015s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000012s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.15% jit_opt_a.meta_fg_expand : 0.000005s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.15% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000808s : 6.53% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.20% jit_opt_a.cse : 0.000044s : 0.35% jit_opt_a.replace_applicator : 0.000021s : 0.17% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000039s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000588s : 4.75% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000478s : 3.86% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000015s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000008s : 0.06% add_recomputation : 0.000051s : 0.41% cse_after_recomputation.cse : 0.000015s : 0.12% auto_monad_reorder : 0.000018s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000575s : 4.64% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.35% Time group info: ------[substitution.] 0.000286 27 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.81% : 0.000005s : 3: substitution.graph_param_transform 84.49% : 0.000242s : 5: substitution.inline 1.41% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.62% : 0.000010s : 3: substitution.reduce_eliminate 1.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000006s : 2: substitution.replace_old_param 3.80% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007676 2 87.49% : 0.006716s : 1: type_inference.infer 12.51% : 0.000960s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.34% : 0.000063s : 5: replace.inline 32.66% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000249 7 96.06% : 0.000239s : 5: match.inline 3.94% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000179 747 1.02% : 0.000002s : 11: predicate.accumulaten_eliminater 0.97% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 0.78% : 0.000001s : 11: predicate.addn_check_dump 0.96% : 0.000002s : 11: predicate.addn_zero_filter 1.30% : 0.000002s : 11: predicate.arithmetic_simplify 0.93% : 0.000002s : 11: predicate.cast_eliminate 0.28% : 0.000001s : 3: predicate.check_bprop_eliminate 0.75% : 0.000001s : 11: predicate.compare_switch_simplify 0.91% : 0.000002s : 11: predicate.depend_value_elim 0.77% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 0.88% : 0.000002s : 11: predicate.dict_get_item_eliminator 0.84% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 3: predicate.elim_not_effective 0.34% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.94% : 0.000002s : 11: predicate.environ_add_const_eliminate 0.84% : 0.000002s : 11: predicate.environ_get_add_eliminate 0.84% : 0.000002s : 11: predicate.environ_get_depend_swap 0.82% : 0.000001s : 11: predicate.environ_get_eliminate 0.79% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.18% : 0.000000s : 3: predicate.fold_const_symbol 0.75% : 0.000001s : 6: predicate.get_grad_eliminate 0.16% : 0.000000s : 3: predicate.graph_param_transform 3.77% : 0.000007s : 24: predicate.inline 0.58% : 0.000001s : 6: predicate.inline_without_move 0.24% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.90% : 0.000002s : 6: predicate.less_batch_normalization 0.98% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.27% : 0.000002s : 16: predicate.load_eliminater 0.72% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.06% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.62% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 0.77% : 0.000001s : 11: predicate.merge_addn 0.77% : 0.000001s : 11: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 1.59% : 0.000003s : 16: predicate.partial_eliminate 0.89% : 0.000002s : 11: predicate.print_const_string_wrapper 1.81% : 0.000003s : 11: predicate.reduce_eliminate 1.12% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.16% : 0.000002s : 19: predicate.replace_applicator 0.30% : 0.000001s : 6: predicate.replace_old_param 0.22% : 0.000000s : 3: predicate.reset_defer_inline 1.05% : 0.000002s : 11: predicate.reshape_eliminate 0.91% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 0.79% : 0.000001s : 11: predicate.same_eliminate 0.39% : 0.000001s : 6: predicate.set_cell_output_no_recompute 29.56% : 0.000053s : 6: predicate.special_op_eliminate 0.68% : 0.000001s : 6: predicate.specialize_transform 0.96% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 0.84% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.29% : 0.000001s : 3: predicate.switch_call_monad_eliminater 1.69% : 0.000003s : 18: predicate.switch_defer_inline 1.66% : 0.000003s : 18: predicate.switch_layer_defer_inline 5.80% : 0.000010s : 59: predicate.switch_simplify 0.87% : 0.000002s : 11: predicate.tile_eliminate 0.88% : 0.000002s : 11: predicate.transpose_eliminate 0.99% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.01% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 2.79% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.03% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.05% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.13% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 1.98% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.03% : 0.000002s : 11: predicate.value_based_eliminate 0.20% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.40% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000771 16 48.66% : 0.000375s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.69% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.65% : 0.000321s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018369 72 0.30% : 0.000055s : 1: add_recomputation 0.44% : 0.000081s : 1: auto_monad 0.11% : 0.000021s : 1: auto_monad_reorder 1.91% : 0.000352s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000029s : 1: cse_after_recomputation 0.05% : 0.000010s : 1: environ_conv 0.13% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.35% : 0.005759s : 1: jit_opt_a 0.89% : 0.000164s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.66% : 0.000489s : 1: loop_unroll 3.26% : 0.000600s : 1: mutable_eliminate 5.51% : 0.001012s : 26: opt.transform.jit_opt_a 0.26% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000017s : 1: opt.transform.mutable_eliminate 0.42% : 0.000078s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.19% : 0.000585s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.58% : 0.000475s : 1: renormalize.infer 1.76% : 0.000324s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000043s : 1: rewriter_after_opt_a 0.45% : 0.000082s : 1: rewriter_before_opt_a 0.44% : 0.000080s : 1: symbol_engine_optimizer 42.20% : 0.007751s : 1: type_inference TotalTime = 0.0644558, [30] [bootstrap]: 0.00030932 [type_inference]: 0.0543655 [event_method]: 1.89e-05 [auto_monad]: 6.773e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00027815 [rewriter_before_opt_a]: 8.112e-05 [expand_dump_flag]: 4.26001e-06 [jit_opt_a]: 0.0069146, [2] [Cycle 1]: 0.00329355, [27] [switch_simplify]: 5.515e-05 [loop_unroll]: 3.056e-05 [a_1]: 0.000585 [with_stream_mark]: 1.924e-05 [recompute_prepare]: 8.76997e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.12997e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.81998e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.48998e-06 [meta_shard_fg_expand]: 2.63998e-06 [get_grad_eliminate_]: 6.48e-06 [merge_forward]: 4.55999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.656e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.93002e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00224135 [add_forward_monad_depend]: 8.80001e-06 [auto_monad_grad]: 2.19001e-06 [auto_monad_eliminator]: 1.945e-05 [cse]: 2.682e-05 [replace_applicator]: 1.922e-05 [Cycle 2]: 0.00039943, [27] [switch_simplify]: 6.85002e-06 [loop_unroll]: 5.97001e-06 [a_1]: 0.0001295 [with_stream_mark]: 1.704e-05 [recompute_prepare]: 7.23e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.41998e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 3.03998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.836e-05 [j_node_and_user_rematch]: 9.61003e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 7.82002e-06 [cse]: 1.375e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.368e-05 [rewriter_after_opt_a]: 3.271e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 4.17e-06 [mutable_eliminate]: 0.00068255 [jit_opt_b]: 5.573e-05, [1] [Cycle 1]: 4.854e-05, [2] [frontend_op_eliminate]: 1.928e-05 [inline_after_opt_a]: 1.82e-05 [cconv]: 1.827e-05 [loop_unroll]: 0.00042231 [jit_opt_after_cconv]: 0.00015463, [1] [Cycle 1]: 0.00014778, [11] [c_1]: 2.527e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 6.53e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.174e-05 [call_graph_tuple_transform]: 2.055e-05 [tuple_list_get_item_eliminator]: 6.96999e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 7.7e-07 [switch_simplify]: 6.74999e-06 [remove_dup_value]: 1.012e-05 [partial_unused_args_eliminate]: 1.55001e-06 [environ_conv]: 9.84999e-06 [add_recomputation]: 3.627e-05 [cse_after_recomputation]: 2.462e-05, [1] [Cycle 1]: 1.814e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.155e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.00051668 [symbol_engine_optimizer]: 8.673e-05, [1] [Cycle 1]: 7.949e-05, [6] [build]: 3.86001e-06 [elim_shapecalc]: 8.75001e-06 [elim_not_effective]: 1.712e-05 [opt_reshape]: 6.48e-06 [fold_const_symbol]: 1.117e-05 [renormalize]: 1.22e-06 [validate]: 7.848e-05 Sums bootstrap : 0.000309s : 0.51% type_inference : 0.054365s : 89.75% event_method : 0.000019s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000278s : 0.46% rewriter_before_opt_a : 0.000081s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000714s : 1.18% jit_opt_a.with_stream_mark : 0.000036s : 0.06% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002241s : 3.70% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.05% jit_opt_a.cse : 0.000041s : 0.07% jit_opt_a.replace_applicator : 0.000025s : 0.04% py_interpret_to_execute_after_opt_a : 0.000014s : 0.02% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000683s : 1.13% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000018s : 0.03% loop_unroll : 0.000422s : 0.70% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000036s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000517s : 0.85% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000078s : 0.13% Time group info: ------[substitution.] 0.000224 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000005s : 4: substitution.graph_param_transform 84.33% : 0.000189s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000005s : 4: substitution.remove_not_recompute_node 2.66% : 0.000006s : 2: substitution.replace_old_param 5.60% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054293 2 96.36% : 0.052314s : 1: type_inference.infer 3.64% : 0.001979s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.37% : 0.000049s : 4: replace.inline 31.63% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 94.24% : 0.000186s : 4: match.inline 5.76% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.72% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.67% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.47% : 0.000002s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.19% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.73% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.72% : 0.000002s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.62% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000010s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002334 26 67.80% : 0.001582s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.46% : 0.000711s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067690 72 0.06% : 0.000039s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.48% : 0.000323s : 1: bootstrap 0.03% : 0.000021s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000027s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.22% : 0.006918s : 1: jit_opt_a 0.23% : 0.000157s : 1: jit_opt_after_cconv 0.09% : 0.000058s : 1: jit_opt_b 0.64% : 0.000430s : 1: loop_unroll 1.02% : 0.000692s : 1: mutable_eliminate 1.41% : 0.000956s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000528s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000284s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 2.03% : 0.001376s : 1: renormalize.infer 1.26% : 0.000854s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000091s : 1: symbol_engine_optimizer 80.41% : 0.054431s : 1: type_inference TotalTime = 0.0644456, [30] [bootstrap]: 0.00027613 [type_inference]: 0.0536318 [event_method]: 2.09e-05 [auto_monad]: 6.925e-05 [graph_reusing]: 5.69999e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00033249 [rewriter_before_opt_a]: 8.439e-05 [expand_dump_flag]: 3.17002e-06 [jit_opt_a]: 0.00758365, [2] [Cycle 1]: 0.00342511, [27] [switch_simplify]: 6.348e-05 [loop_unroll]: 3.139e-05 [a_1]: 0.00062211 [with_stream_mark]: 2.224e-05 [recompute_prepare]: 8.84998e-06 [updatestate_depend_eliminate]: 4.90001e-06 [updatestate_assign_eliminate]: 3.78999e-06 [updatestate_loads_eliminate]: 3.54002e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.0023163 [add_forward_monad_depend]: 8.58001e-06 [auto_monad_grad]: 2.63003e-06 [auto_monad_eliminator]: 1.926e-05 [cse]: 3.089e-05 [replace_applicator]: 1.741e-05 [Cycle 2]: 0.00037647, [27] [switch_simplify]: 7.31001e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00012055 [with_stream_mark]: 1.288e-05 [recompute_prepare]: 6.21e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.651e-05 [j_node_and_user_rematch]: 9.71998e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 6.72002e-06 [cse]: 1.324e-05 [replace_applicator]: 6.51e-06 [py_interpret_to_execute_after_opt_a]: 1.277e-05 [rewriter_after_opt_a]: 3.856e-05 [convert_after_rewriter]: 7.80998e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00070486 [jit_opt_b]: 5.802e-05, [1] [Cycle 1]: 5.025e-05, [2] [frontend_op_eliminate]: 1.933e-05 [inline_after_opt_a]: 1.914e-05 [cconv]: 3.084e-05 [loop_unroll]: 0.00047321 [jit_opt_after_cconv]: 0.00016289, [1] [Cycle 1]: 0.0001556, [11] [c_1]: 2.575e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 6.71999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.33998e-06 [cse]: 2.624e-05 [call_graph_tuple_transform]: 2.348e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.662e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 9.41e-06 [add_recomputation]: 4.922e-05 [cse_after_recomputation]: 2.301e-05, [1] [Cycle 1]: 1.706e-05, [1] [cse]: 1.129e-05 [auto_monad_reorder]: 1.567e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 5.81003e-06 [opt_after_jit_grad]: 0.00050257 [symbol_engine_optimizer]: 8.034e-05, [1] [Cycle 1]: 7.337e-05, [6] [build]: 4.12998e-06 [elim_shapecalc]: 8.33001e-06 [elim_not_effective]: 1.533e-05 [opt_reshape]: 6.86999e-06 [fold_const_symbol]: 9.94001e-06 [renormalize]: 7.89994e-07 [validate]: 4.731e-05 Sums bootstrap : 0.000276s : 0.46% type_inference : 0.053632s : 89.31% event_method : 0.000021s : 0.03% auto_monad : 0.000069s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000332s : 0.55% rewriter_before_opt_a : 0.000084s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.12% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000743s : 1.24% jit_opt_a.with_stream_mark : 0.000035s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002316s : 3.86% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000044s : 0.07% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000039s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000705s : 1.17% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000031s : 0.05% loop_unroll : 0.000473s : 0.79% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000049s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000503s : 0.84% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.08% Time group info: ------[substitution.] 0.000247 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.51% : 0.000006s : 4: substitution.graph_param_transform 84.45% : 0.000208s : 4: substitution.inline 1.85% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000006s : 4: substitution.remove_not_recompute_node 2.20% : 0.000005s : 2: substitution.replace_old_param 5.07% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053546 2 95.87% : 0.051334s : 1: type_inference.infer 4.13% : 0.002212s : 1: type_inference.specialize ------[replace.] 0.000078 6 67.71% : 0.000053s : 4: replace.inline 32.29% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 6 94.77% : 0.000206s : 4: match.inline 5.23% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 2.45% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.11% : 0.000001s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.57% : 0.000001s : 4: predicate.graph_param_transform 5.90% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.76% : 0.000001s : 4: predicate.opt_reshape 2.01% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000001s : 12: predicate.print_const_string_wrapper 1.86% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.13% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 1.02% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.90% : 0.000011s : 58: predicate.switch_simplify 1.15% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.87% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002350 26 70.01% : 0.001645s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.19% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.80% : 0.000653s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067826 72 0.08% : 0.000052s : 1: add_recomputation 0.11% : 0.000073s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.43% : 0.000289s : 1: bootstrap 0.05% : 0.000033s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 11.19% : 0.007587s : 1: jit_opt_a 0.24% : 0.000166s : 1: jit_opt_after_cconv 0.09% : 0.000061s : 1: jit_opt_b 0.71% : 0.000482s : 1: loop_unroll 1.06% : 0.000716s : 1: mutable_eliminate 1.46% : 0.000990s : 26: opt.transform.jit_opt_a 0.09% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000513s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000339s : 1: py_interpret_to_execute 0.02% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.35% : 0.001592s : 1: renormalize.infer 1.05% : 0.000715s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000042s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.12% : 0.000083s : 1: symbol_engine_optimizer 79.10% : 0.053651s : 1: type_inference TotalTime = 0.122268, [30] [bootstrap]: 0.00031216 [type_inference]: 0.11062 [event_method]: 2.142e-05 [auto_monad]: 6.899e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.43002e-06 [py_interpret_to_execute]: 0.0004841 [rewriter_before_opt_a]: 9.288e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00819912, [2] [Cycle 1]: 0.00435502, [27] [switch_simplify]: 7.365e-05 [loop_unroll]: 3.771e-05 [a_1]: 0.00076396 [with_stream_mark]: 2.047e-05 [recompute_prepare]: 8.65999e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.91001e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 1.142e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 1.161e-05 [inline_without_move]: 6.23e-06 [renormalize]: 0.00308537 [add_forward_monad_depend]: 6.69999e-06 [auto_monad_grad]: 2.56e-06 [auto_monad_eliminator]: 1.691e-05 [cse]: 3.56e-05 [replace_applicator]: 1.846e-05 [Cycle 2]: 0.00040504, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 6.27001e-06 [a_1]: 0.00013935 [with_stream_mark]: 1.321e-05 [recompute_prepare]: 6.88e-06 [updatestate_depend_eliminate]: 3.20998e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.83002e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.11e-06 [merge_forward]: 3.82002e-06 [cell_reuse_recompute_pass]: 2.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.451e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 5.76e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.536e-05 [replace_applicator]: 6.83e-06 [py_interpret_to_execute_after_opt_a]: 1.536e-05 [rewriter_after_opt_a]: 3.991e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00070972 [jit_opt_b]: 5.743e-05, [1] [Cycle 1]: 4.936e-05, [2] [frontend_op_eliminate]: 1.883e-05 [inline_after_opt_a]: 1.937e-05 [cconv]: 2.715e-05 [loop_unroll]: 0.00047291 [jit_opt_after_cconv]: 0.00016503, [1] [Cycle 1]: 0.00015839, [11] [c_1]: 2.609e-05 [parameter_eliminate]: 3.02002e-06 [updatestate_depend_eliminate]: 7.38e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 3.099e-05 [call_graph_tuple_transform]: 2.14e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.40022e-07 [switch_simplify]: 6.15002e-06 [remove_dup_value]: 1.636e-05 [partial_unused_args_eliminate]: 2.57001e-06 [environ_conv]: 8.33999e-06 [add_recomputation]: 4.788e-05 [cse_after_recomputation]: 2.522e-05, [1] [Cycle 1]: 1.996e-05, [1] [cse]: 1.36e-05 [auto_monad_reorder]: 1.847e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.91e-06 [opt_after_jit_grad]: 0.00051062 [symbol_engine_optimizer]: 7.708e-05, [1] [Cycle 1]: 6.997e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.378e-05 [opt_reshape]: 7.09001e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 4.50003e-07 [validate]: 5.987e-05 Sums bootstrap : 0.000312s : 0.26% type_inference : 0.110620s : 93.57% event_method : 0.000021s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000484s : 0.41% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000081s : 0.07% jit_opt_a.loop_unroll : 0.000044s : 0.04% jit_opt_a.a_1 : 0.000903s : 0.76% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003085s : 2.61% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000710s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000473s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000511s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000060s : 0.05% Time group info: ------[substitution.] 0.000298 28 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000006s : 4: substitution.graph_param_transform 83.88% : 0.000250s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.39% : 0.000013s : 3: substitution.reduce_eliminate 1.47% : 0.000004s : 4: substitution.remove_not_recompute_node 2.24% : 0.000007s : 2: substitution.replace_old_param 3.48% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110546 2 97.33% : 0.107596s : 1: type_inference.infer 2.67% : 0.002950s : 1: type_inference.specialize ------[replace.] 0.000103 7 66.61% : 0.000069s : 5: replace.inline 33.39% : 0.000034s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 7 96.40% : 0.000247s : 5: match.inline 3.60% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.39% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.41% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.25% : 0.000008s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.21% : 0.000002s : 13: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.39% : 0.000002s : 13: predicate.print_const_string_wrapper 2.15% : 0.000003s : 13: predicate.reduce_eliminate 1.62% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.51% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.55% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.81% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.65% : 0.000004s : 20: predicate.switch_defer_inline 2.38% : 0.000004s : 20: predicate.switch_layer_defer_inline 7.84% : 0.000012s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002465 25 59.08% : 0.001456s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.50% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 37.41% : 0.000922s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126585 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000330s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.48% : 0.008202s : 1: jit_opt_a 0.13% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.38% : 0.000483s : 1: loop_unroll 0.57% : 0.000721s : 1: mutable_eliminate 0.93% : 0.001172s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000520s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.69% : 0.002136s : 1: renormalize.infer 0.74% : 0.000939s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 87.40% : 0.110635s : 1: type_inference TotalTime = 0.119528, [30] [bootstrap]: 0.0002708 [type_inference]: 0.108936 [event_method]: 1.851e-05 [auto_monad]: 5.354e-05 [graph_reusing]: 3.91999e-06 [pre_auto_parallel]: 1.70001e-06 [py_interpret_to_execute]: 0.00048724 [rewriter_before_opt_a]: 8.247e-05 [expand_dump_flag]: 2.61e-06 [jit_opt_a]: 0.00750483, [2] [Cycle 1]: 0.00366759, [27] [switch_simplify]: 5.337e-05 [loop_unroll]: 3.197e-05 [a_1]: 0.00059449 [with_stream_mark]: 1.587e-05 [recompute_prepare]: 1.018e-05 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 7.83001e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 6.75998e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 1.034e-05 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 9.39998e-06 [inline_without_move]: 6.11998e-06 [renormalize]: 0.00264207 [add_forward_monad_depend]: 5.12e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 1.453e-05 [cse]: 2.096e-05 [replace_applicator]: 1.464e-05 [Cycle 2]: 0.00036111, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00012447 [with_stream_mark]: 9.37001e-06 [recompute_prepare]: 5.69999e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.40001e-06 [inline_without_move]: 5.70001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.09003e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.137e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 9.14e-06 [rewriter_after_opt_a]: 2.847e-05 [convert_after_rewriter]: 5.54e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00055976 [jit_opt_b]: 5.545e-05, [1] [Cycle 1]: 4.905e-05, [2] [frontend_op_eliminate]: 2.006e-05 [inline_after_opt_a]: 1.777e-05 [cconv]: 1.694e-05 [loop_unroll]: 0.00041975 [jit_opt_after_cconv]: 0.0001449, [1] [Cycle 1]: 0.00013885, [11] [c_1]: 2.488e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.864e-05 [call_graph_tuple_transform]: 1.983e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.22e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.96e-06 [remove_dup_value]: 8.60001e-06 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 6.26e-06 [add_recomputation]: 3.164e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.694e-05, [1] [cse]: 1.121e-05 [auto_monad_reorder]: 9.34e-06 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 4.52998e-06 [opt_after_jit_grad]: 0.00050623 [symbol_engine_optimizer]: 7.352e-05, [1] [Cycle 1]: 6.744e-05, [6] [build]: 2.51e-06 [elim_shapecalc]: 9.00999e-06 [elim_not_effective]: 1.313e-05 [opt_reshape]: 6.92002e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 3.69997e-07 [validate]: 8.286e-05 Sums bootstrap : 0.000271s : 0.23% type_inference : 0.108936s : 94.34% event_method : 0.000019s : 0.02% auto_monad : 0.000054s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000487s : 0.42% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000719s : 0.62% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002642s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000028s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000560s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.01% loop_unroll : 0.000420s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000009s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000506s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000083s : 0.07% Time group info: ------[substitution.] 0.000199 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000005s : 4: substitution.graph_param_transform 84.83% : 0.000169s : 4: substitution.inline 1.90% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.41% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 5.15% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108863 2 97.37% : 0.105995s : 1: type_inference.infer 2.63% : 0.002867s : 1: type_inference.specialize ------[replace.] 0.000081 6 65.30% : 0.000053s : 4: replace.inline 34.70% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 95.03% : 0.000167s : 4: match.inline 4.97% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.46% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.81% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.51% : 0.000002s : 12: predicate.cast_eliminate 0.76% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.33% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.49% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.23% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.82% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.46% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.86% : 0.000009s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002258 22 65.74% : 0.001485s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.52% : 0.000735s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123151 72 0.03% : 0.000034s : 1: add_recomputation 0.05% : 0.000057s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.23% : 0.000282s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.10% : 0.007508s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000427s : 1: loop_unroll 0.46% : 0.000568s : 1: mutable_eliminate 0.77% : 0.000952s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000496s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.52% : 0.001876s : 1: renormalize.infer 0.62% : 0.000759s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 88.47% : 0.108953s : 1: type_inference TotalTime = 0.122353, [30] [bootstrap]: 0.00029874 [type_inference]: 0.111539 [event_method]: 2.082e-05 [auto_monad]: 7.227e-05 [graph_reusing]: 5.54e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00044607 [rewriter_before_opt_a]: 8.992e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.00761743, [2] [Cycle 1]: 0.00395614, [27] [switch_simplify]: 5.947e-05 [loop_unroll]: 3.39e-05 [a_1]: 0.0006696 [with_stream_mark]: 1.776e-05 [recompute_prepare]: 8.93002e-06 [updatestate_depend_eliminate]: 4.61002e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.21999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 7.2e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 9.78002e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.036e-05 [inline_without_move]: 6.40002e-06 [renormalize]: 0.00284122 [add_forward_monad_depend]: 5.61998e-06 [auto_monad_grad]: 1.33002e-06 [auto_monad_eliminator]: 1.312e-05 [cse]: 2.597e-05 [replace_applicator]: 1.505e-05 [Cycle 2]: 0.00038489, [27] [switch_simplify]: 7.46001e-06 [loop_unroll]: 6.13002e-06 [a_1]: 0.0001331 [with_stream_mark]: 1.044e-05 [recompute_prepare]: 6.88e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.60002e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 2.69001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.253e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 7.69002e-06 [inline_without_move]: 5.71e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.55002e-06 [cse]: 1.466e-05 [replace_applicator]: 6.31e-06 [py_interpret_to_execute_after_opt_a]: 1.289e-05 [rewriter_after_opt_a]: 3.203e-05 [convert_after_rewriter]: 6.46e-06 [order_py_execute_after_rewriter]: 4.48001e-06 [mutable_eliminate]: 0.00061629 [jit_opt_b]: 6.033e-05, [1] [Cycle 1]: 5.245e-05, [2] [frontend_op_eliminate]: 2.157e-05 [inline_after_opt_a]: 1.792e-05 [cconv]: 1.824e-05 [loop_unroll]: 0.00044831 [jit_opt_after_cconv]: 0.00015886, [1] [Cycle 1]: 0.00015199, [11] [c_1]: 2.685e-05 [parameter_eliminate]: 2.91999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.703e-05 [call_graph_tuple_transform]: 2.057e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 9.69e-06 [partial_unused_args_eliminate]: 1.62001e-06 [environ_conv]: 8.06001e-06 [add_recomputation]: 3.387e-05 [cse_after_recomputation]: 2.426e-05, [1] [Cycle 1]: 1.857e-05, [1] [cse]: 1.313e-05 [auto_monad_reorder]: 1.211e-05 [get_jit_bprop_graph]: 1.54998e-06 [rewriter_after_jit_bprop_graph]: 6.89999e-06 [opt_after_jit_grad]: 0.00048135 [symbol_engine_optimizer]: 7.731e-05, [1] [Cycle 1]: 7.084e-05, [6] [build]: 3.05002e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 1.375e-05 [opt_reshape]: 6.70002e-06 [fold_const_symbol]: 9.22001e-06 [renormalize]: 3.30008e-07 [validate]: 6.452e-05 Sums bootstrap : 0.000299s : 0.25% type_inference : 0.111539s : 94.13% event_method : 0.000021s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000446s : 0.38% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000803s : 0.68% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002841s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000616s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000448s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000481s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000065s : 0.05% Time group info: ------[substitution.] 0.000249 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000005s : 4: substitution.graph_param_transform 82.96% : 0.000206s : 5: substitution.inline 1.19% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.92% : 0.000012s : 3: substitution.reduce_eliminate 2.06% : 0.000005s : 4: substitution.remove_not_recompute_node 1.59% : 0.000004s : 2: substitution.replace_old_param 4.47% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111471 2 97.46% : 0.108638s : 1: type_inference.infer 2.54% : 0.002833s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.66% : 0.000065s : 5: replace.inline 32.34% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 7 95.31% : 0.000203s : 5: match.inline 4.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.58% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.26% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.12% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002398 25 62.61% : 0.001501s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.80% : 0.000835s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126297 72 0.03% : 0.000037s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000315s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.03% : 0.007621s : 1: jit_opt_a 0.13% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.36% : 0.000457s : 1: loop_unroll 0.50% : 0.000626s : 1: mutable_eliminate 0.83% : 0.001045s : 26: opt.transform.jit_opt_a 0.04% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000452s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.58% : 0.001992s : 1: renormalize.infer 0.66% : 0.000839s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 88.33% : 0.111553s : 1: type_inference TotalTime = 0.121671, [30] [bootstrap]: 0.00025368 [type_inference]: 0.110941 [event_method]: 1.94e-05 [auto_monad]: 6.873e-05 [graph_reusing]: 5.62999e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 0.00054213 [rewriter_before_opt_a]: 8.781e-05 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.00758944, [2] [Cycle 1]: 0.00384564, [27] [switch_simplify]: 5.638e-05 [loop_unroll]: 3.09e-05 [a_1]: 0.00059509 [with_stream_mark]: 1.833e-05 [recompute_prepare]: 8.92e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 2.09e-06 [specialize_transform]: 7.43999e-06 [updatestate_useless_node_eliminater]: 6.25997e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.29001e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.534e-05 [j_node_and_user_rematch]: 1.081e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.81e-06 [inline_without_move]: 6.73e-06 [renormalize]: 0.00281509 [add_forward_monad_depend]: 5.54e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 1.305e-05 [cse]: 2.11e-05 [replace_applicator]: 1.464e-05 [Cycle 2]: 0.00037164, [27] [switch_simplify]: 7e-06 [loop_unroll]: 6.67002e-06 [a_1]: 0.000127 [with_stream_mark]: 9.84001e-06 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 2.85002e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.72999e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 2.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 1.83002e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.11997e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.269e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 9.34e-06 [rewriter_after_opt_a]: 2.633e-05 [convert_after_rewriter]: 5.44e-06 [order_py_execute_after_rewriter]: 4.1e-06 [mutable_eliminate]: 0.00058136 [jit_opt_b]: 5.969e-05, [1] [Cycle 1]: 5.317e-05, [2] [frontend_op_eliminate]: 2.176e-05 [inline_after_opt_a]: 1.954e-05 [cconv]: 1.666e-05 [loop_unroll]: 0.00043841 [jit_opt_after_cconv]: 0.00016901, [1] [Cycle 1]: 0.00016232, [11] [c_1]: 2.804e-05 [parameter_eliminate]: 2.61999e-06 [updatestate_depend_eliminate]: 5.89999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.18998e-06 [cse]: 2.215e-05 [call_graph_tuple_transform]: 2.128e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 1.22e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.93e-06 [remove_dup_value]: 1.036e-05 [partial_unused_args_eliminate]: 1.92001e-06 [environ_conv]: 7.12002e-06 [add_recomputation]: 3.366e-05 [cse_after_recomputation]: 2.347e-05, [1] [Cycle 1]: 1.761e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 9.64e-06 [get_jit_bprop_graph]: 1.49998e-06 [rewriter_after_jit_bprop_graph]: 4.28999e-06 [opt_after_jit_grad]: 0.00047219 [symbol_engine_optimizer]: 7.382e-05, [1] [Cycle 1]: 6.82e-05, [6] [build]: 2.78e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.359e-05 [opt_reshape]: 6.48e-06 [fold_const_symbol]: 9.94001e-06 [renormalize]: 4.09986e-07 [validate]: 3.378e-05 Sums bootstrap : 0.000254s : 0.22% type_inference : 0.110941s : 94.25% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000542s : 0.46% rewriter_before_opt_a : 0.000088s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000722s : 0.61% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002815s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000026s : 0.02% convert_after_rewriter : 0.000005s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000581s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000017s : 0.01% loop_unroll : 0.000438s : 0.37% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000472s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000214 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000002s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 4: substitution.graph_param_transform 83.96% : 0.000180s : 4: substitution.inline 1.81% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000005s : 2: substitution.replace_old_param 5.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110865 2 97.26% : 0.107823s : 1: type_inference.infer 2.74% : 0.003042s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.96% : 0.000052s : 4: replace.inline 32.04% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 94.19% : 0.000177s : 4: match.inline 5.81% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.40% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.71% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 2.12% : 0.000003s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.44% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 12: predicate.value_based_eliminate 0.46% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002404 22 62.94% : 0.001513s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.62% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.43% : 0.000852s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125536 72 0.03% : 0.000036s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.21% : 0.000266s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.05% : 0.007593s : 1: jit_opt_a 0.14% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.36% : 0.000448s : 1: loop_unroll 0.47% : 0.000592s : 1: mutable_eliminate 0.76% : 0.000959s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000481s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.44% : 0.000550s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.60% : 0.002007s : 1: renormalize.infer 0.64% : 0.000798s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000076s : 1: symbol_engine_optimizer 88.39% : 0.110956s : 1: type_inference TotalTime = 0.0128921, [30] [bootstrap]: 0.00030277 [type_inference]: 0.00482639 [event_method]: 1.868e-05 [auto_monad]: 5.067e-05 [graph_reusing]: 3.46001e-06 [pre_auto_parallel]: 1.44e-06 [py_interpret_to_execute]: 2.129e-05 [rewriter_before_opt_a]: 6.63e-05 [expand_dump_flag]: 2.09999e-06 [jit_opt_a]: 0.00545608, [2] [Cycle 1]: 0.00169482, [27] [switch_simplify]: 5.84e-05 [loop_unroll]: 3.243e-05 [a_1]: 0.00055511 [with_stream_mark]: 1.695e-05 [recompute_prepare]: 7.82e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.21997e-06 [specialize_transform]: 6.24001e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.26002e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 0.00071262 [add_forward_monad_depend]: 5.32999e-06 [auto_monad_grad]: 2.21998e-06 [auto_monad_eliminator]: 1.485e-05 [cse]: 2.862e-05 [replace_applicator]: 1.227e-05 [Cycle 2]: 0.00031947, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.20999e-06 [a_1]: 9.225e-05 [with_stream_mark]: 8.56002e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.74002e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 2.41e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.33999e-06 [inline_without_move]: 4.84003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.129e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.088e-05 [rewriter_after_opt_a]: 3.39e-05 [convert_after_rewriter]: 6.87002e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00058296 [jit_opt_b]: 4.969e-05, [1] [Cycle 1]: 4.291e-05, [2] [frontend_op_eliminate]: 1.675e-05 [inline_after_opt_a]: 1.533e-05 [cconv]: 2.569e-05 [loop_unroll]: 0.000411 [jit_opt_after_cconv]: 0.00016275, [1] [Cycle 1]: 0.00015648, [11] [c_1]: 2.171e-05 [parameter_eliminate]: 3.11001e-06 [updatestate_depend_eliminate]: 6.29999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.969e-05 [call_graph_tuple_transform]: 3.79e-05 [tuple_list_get_item_eliminator]: 5.56e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 1.742e-05 [partial_unused_args_eliminate]: 2.98998e-06 [environ_conv]: 5.62999e-06 [add_recomputation]: 5.109e-05 [cse_after_recomputation]: 2.212e-05, [1] [Cycle 1]: 1.662e-05, [1] [cse]: 1.081e-05 [auto_monad_reorder]: 1.511e-05 [get_jit_bprop_graph]: 1.89e-06 [rewriter_after_jit_bprop_graph]: 4.64002e-06 [opt_after_jit_grad]: 0.00045125 [symbol_engine_optimizer]: 7.525e-05, [1] [Cycle 1]: 6.813e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 8.06001e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 5.93998e-06 [fold_const_symbol]: 9.14e-06 [renormalize]: 4.19997e-07 [validate]: 3.778e-05 Sums bootstrap : 0.000303s : 3.41% type_inference : 0.004826s : 54.35% event_method : 0.000019s : 0.21% auto_monad : 0.000051s : 0.57% graph_reusing : 0.000003s : 0.04% pre_auto_parallel : 0.000001s : 0.02% py_interpret_to_execute : 0.000021s : 0.24% rewriter_before_opt_a : 0.000066s : 0.75% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000064s : 0.72% jit_opt_a.loop_unroll : 0.000038s : 0.42% jit_opt_a.a_1 : 0.000647s : 7.29% jit_opt_a.with_stream_mark : 0.000026s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000713s : 8.03% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000040s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000034s : 0.38% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000583s : 6.57% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.29% loop_unroll : 0.000411s : 4.63% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.43% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.20% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000051s : 0.58% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000451s : 5.08% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.43% Time group info: ------[substitution.] 0.000220 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 3: substitution.graph_param_transform 86.37% : 0.000190s : 4: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.15% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 3.97% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004768 2 82.49% : 0.003933s : 1: type_inference.infer 17.51% : 0.000835s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.50% : 0.000047s : 4: replace.inline 32.50% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 96.15% : 0.000187s : 4: match.inline 3.85% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.44% : 0.000002s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.09% : 0.000006s : 22: predicate.inline 0.83% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.43% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 2.05% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.61% : 0.000002s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.99% : 0.000009s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000673 13 52.01% : 0.000350s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.51% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.47% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014545 72 0.37% : 0.000054s : 1: add_recomputation 0.37% : 0.000054s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.21% : 0.000322s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 37.53% : 0.005459s : 1: jit_opt_a 1.14% : 0.000165s : 1: jit_opt_after_cconv 0.36% : 0.000052s : 1: jit_opt_b 2.88% : 0.000419s : 1: loop_unroll 4.07% : 0.000592s : 1: mutable_eliminate 5.94% : 0.000863s : 26: opt.transform.jit_opt_a 0.46% : 0.000068s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.16% : 0.000460s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.16% : 0.000024s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000020s : 1: remove_dup_value 2.70% : 0.000393s : 1: renormalize.infer 2.15% : 0.000313s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000038s : 1: rewriter_after_opt_a 0.48% : 0.000069s : 1: rewriter_before_opt_a 0.54% : 0.000078s : 1: symbol_engine_optimizer 33.27% : 0.004839s : 1: type_inference TotalTime = 0.125775, [30] [bootstrap]: 0.00032147 [type_inference]: 0.113758 [event_method]: 2.396e-05 [auto_monad]: 7.682e-05 [graph_reusing]: 6.69999e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00047546 [rewriter_before_opt_a]: 9.707e-05 [expand_dump_flag]: 4.05998e-06 [jit_opt_a]: 0.00835816, [2] [Cycle 1]: 0.00419242, [27] [switch_simplify]: 6.719e-05 [loop_unroll]: 3.422e-05 [a_1]: 0.00083541 [with_stream_mark]: 2.174e-05 [recompute_prepare]: 1.066e-05 [updatestate_depend_eliminate]: 4.44998e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.36999e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.93998e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.37001e-06 [merge_forward]: 4.24997e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.632e-05 [j_node_and_user_rematch]: 1.093e-05 [meta_fg_expand]: 2.61999e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 7.68001e-06 [renormalize]: 0.00283278 [add_forward_monad_depend]: 8.23999e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.994e-05 [cse]: 3.795e-05 [replace_applicator]: 2.006e-05 [Cycle 2]: 0.00046353, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00013612 [with_stream_mark]: 1.444e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.15e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 4.62e-06 [cell_reuse_recompute_pass]: 2.49001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 5.68002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.24001e-06 [auto_monad_grad]: 9.5999e-07 [auto_monad_eliminator]: 9.89999e-06 [cse]: 1.8e-05 [replace_applicator]: 7.2e-06 [py_interpret_to_execute_after_opt_a]: 1.633e-05 [rewriter_after_opt_a]: 4.162e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.98002e-06 [mutable_eliminate]: 0.00071691 [jit_opt_b]: 6.108e-05, [1] [Cycle 1]: 5.227e-05, [2] [frontend_op_eliminate]: 2.022e-05 [inline_after_opt_a]: 2.034e-05 [cconv]: 2.809e-05 [loop_unroll]: 0.00048779 [jit_opt_after_cconv]: 0.00017269, [1] [Cycle 1]: 0.00016415, [11] [c_1]: 2.672e-05 [parameter_eliminate]: 3.56999e-06 [updatestate_depend_eliminate]: 7.71999e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 3.183e-05 [call_graph_tuple_transform]: 2.269e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.03998e-06 [remove_dup_value]: 1.864e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 9.71998e-06 [add_recomputation]: 5.146e-05 [cse_after_recomputation]: 2.712e-05, [1] [Cycle 1]: 2.025e-05, [1] [cse]: 1.42e-05 [auto_monad_reorder]: 1.748e-05 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 6.63e-06 [opt_after_jit_grad]: 0.0005369 [symbol_engine_optimizer]: 0.00016661, [1] [Cycle 1]: 0.0001597, [6] [build]: 4.99e-06 [elim_shapecalc]: 8.981e-05 [elim_not_effective]: 1.596e-05 [opt_reshape]: 7.21999e-06 [fold_const_symbol]: 1.03e-05 [renormalize]: 4.00003e-07 [validate]: 5.38e-05 Sums bootstrap : 0.000321s : 0.26% type_inference : 0.113758s : 93.75% event_method : 0.000024s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000475s : 0.39% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000972s : 0.80% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002833s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000030s : 0.02% jit_opt_a.cse : 0.000056s : 0.05% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000042s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000717s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000488s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000537s : 0.44% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000090s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.04% Time group info: ------[substitution.] 0.000315 28 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 4: substitution.graph_param_transform 83.58% : 0.000263s : 5: substitution.inline 1.49% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.79% : 0.000015s : 3: substitution.reduce_eliminate 1.60% : 0.000005s : 4: substitution.remove_not_recompute_node 1.63% : 0.000005s : 2: substitution.replace_old_param 3.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113670 2 97.37% : 0.110678s : 1: type_inference.infer 2.63% : 0.002991s : 1: type_inference.specialize ------[replace.] 0.000177 7 79.48% : 0.000141s : 5: replace.inline 20.52% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000271 7 96.07% : 0.000260s : 5: match.inline 3.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 1.76% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 13: predicate.compare_switch_simplify 1.41% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.47% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.05% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 6.03% : 0.000009s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.65% : 0.000002s : 19: predicate.load_eliminater 1.89% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.71% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.36% : 0.000002s : 13: predicate.print_const_string_wrapper 2.14% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 23: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.17% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000002s : 8: predicate.specialize_transform 1.39% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.61% : 0.000004s : 20: predicate.switch_defer_inline 2.17% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.84% : 0.000011s : 64: predicate.switch_simplify 1.20% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.42% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.44% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002403 25 65.72% : 0.001579s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.62% : 0.000087s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.66% : 0.000737s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129989 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000341s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.43% : 0.008363s : 1: jit_opt_a 0.14% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.38% : 0.000500s : 1: loop_unroll 0.56% : 0.000729s : 1: mutable_eliminate 0.95% : 0.001232s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000120s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000550s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000485s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.58% : 0.002055s : 1: renormalize.infer 0.59% : 0.000767s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.13% : 0.000170s : 1: symbol_engine_optimizer 87.53% : 0.113778s : 1: type_inference TotalTime = 0.0152044, [30] [bootstrap]: 0.00030705 [type_inference]: 0.00747355 [event_method]: 1.907e-05 [auto_monad]: 5.695e-05 [graph_reusing]: 4.63999e-06 [pre_auto_parallel]: 1.86e-06 [py_interpret_to_execute]: 4.063e-05 [rewriter_before_opt_a]: 7.854e-05 [expand_dump_flag]: 2.51e-06 [jit_opt_a]: 0.00518103, [2] [Cycle 1]: 0.00168549, [27] [switch_simplify]: 5.271e-05 [loop_unroll]: 3.364e-05 [a_1]: 0.00059451 [with_stream_mark]: 1.249e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 2.55002e-06 [cell_reuse_recompute_pass]: 7.80012e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.175e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00069146 [add_forward_monad_depend]: 4.51002e-06 [auto_monad_grad]: 1.60001e-06 [auto_monad_eliminator]: 1.065e-05 [cse]: 2.236e-05 [replace_applicator]: 1.136e-05 [Cycle 2]: 0.0003574, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.843e-05 [with_stream_mark]: 9.17999e-06 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 2.91999e-06 [cell_reuse_recompute_pass]: 1.61002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.05e-05 [j_node_and_user_rematch]: 7.71001e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.21001e-06 [inline_without_move]: 4.84998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 5.98002e-06 [cse]: 1.429e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 9.76e-06 [rewriter_after_opt_a]: 2.98e-05 [convert_after_rewriter]: 5.89e-06 [order_py_execute_after_rewriter]: 4.12998e-06 [mutable_eliminate]: 0.00050963 [jit_opt_b]: 5.059e-05, [1] [Cycle 1]: 4.387e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.573e-05 [cconv]: 1.854e-05 [loop_unroll]: 0.00043043 [jit_opt_after_cconv]: 0.00015148, [1] [Cycle 1]: 0.00014521, [11] [c_1]: 2.111e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 5.70001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.183e-05 [call_graph_tuple_transform]: 1.707e-05 [tuple_list_get_item_eliminator]: 1.469e-05 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.89999e-06 [remove_dup_value]: 1.22e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 5.17999e-06 [add_recomputation]: 3.788e-05 [cse_after_recomputation]: 2.357e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.242e-05 [auto_monad_reorder]: 1.434e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 5.25999e-06 [opt_after_jit_grad]: 0.00045723 [symbol_engine_optimizer]: 7.121e-05, [1] [Cycle 1]: 6.544e-05, [6] [build]: 3.07002e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.216e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.47e-06 [renormalize]: 3.80009e-07 [validate]: 3.534e-05 Sums bootstrap : 0.000307s : 2.68% type_inference : 0.007474s : 65.12% event_method : 0.000019s : 0.17% auto_monad : 0.000057s : 0.50% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.35% rewriter_before_opt_a : 0.000079s : 0.68% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000059s : 0.51% jit_opt_a.loop_unroll : 0.000039s : 0.34% jit_opt_a.a_1 : 0.000693s : 6.04% jit_opt_a.with_stream_mark : 0.000022s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000692s : 6.03% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.14% jit_opt_a.cse : 0.000037s : 0.32% jit_opt_a.replace_applicator : 0.000016s : 0.14% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000030s : 0.26% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000510s : 4.44% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000019s : 0.16% loop_unroll : 0.000430s : 3.75% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000015s : 0.13% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000012s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000038s : 0.33% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000014s : 0.12% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000457s : 3.98% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.31% Time group info: ------[substitution.] 0.000212 27 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 1.83% : 0.000004s : 3: substitution.graph_param_transform 84.18% : 0.000178s : 5: substitution.inline 1.17% : 0.000002s : 4: substitution.j_node_and_user_rematch 4.36% : 0.000009s : 3: substitution.reduce_eliminate 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000003s : 2: substitution.replace_old_param 3.82% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007412 2 87.66% : 0.006498s : 1: type_inference.infer 12.34% : 0.000915s : 1: type_inference.specialize ------[replace.] 0.000088 7 67.11% : 0.000059s : 5: replace.inline 32.89% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 7 96.14% : 0.000175s : 5: match.inline 3.86% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.32% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.22% : 0.000001s : 11: predicate.addn_check_dump 1.48% : 0.000002s : 11: predicate.addn_zero_filter 2.07% : 0.000002s : 11: predicate.arithmetic_simplify 1.22% : 0.000001s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.34% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.21% : 0.000001s : 11: predicate.environ_get_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 16: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.34% : 0.000002s : 11: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000001s : 11: predicate.print_const_string_wrapper 2.21% : 0.000003s : 11: predicate.reduce_eliminate 1.53% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.47% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 11: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.65% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 59: predicate.switch_simplify 1.44% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.81% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000736 16 48.74% : 0.000359s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.66% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.61% : 0.000321s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016870 72 0.24% : 0.000041s : 1: add_recomputation 0.36% : 0.000060s : 1: auto_monad 0.10% : 0.000017s : 1: auto_monad_reorder 1.91% : 0.000322s : 1: bootstrap 0.12% : 0.000021s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.73% : 0.005184s : 1: jit_opt_a 0.91% : 0.000154s : 1: jit_opt_after_cconv 0.31% : 0.000053s : 1: jit_opt_b 2.60% : 0.000439s : 1: loop_unroll 3.08% : 0.000519s : 1: mutable_eliminate 5.35% : 0.000903s : 26: opt.transform.jit_opt_a 0.33% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.76% : 0.000466s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000043s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000014s : 1: remove_dup_value 2.26% : 0.000382s : 1: renormalize.infer 1.80% : 0.000303s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000033s : 1: rewriter_after_opt_a 0.48% : 0.000082s : 1: rewriter_before_opt_a 0.44% : 0.000074s : 1: symbol_engine_optimizer 44.38% : 0.007487s : 1: type_inference TotalTime = 0.119763, [30] [bootstrap]: 0.00029106 [type_inference]: 0.109485 [event_method]: 1.833e-05 [auto_monad]: 4.927e-05 [graph_reusing]: 3.34001e-06 [pre_auto_parallel]: 1.70001e-06 [py_interpret_to_execute]: 0.00058689 [rewriter_before_opt_a]: 7.777e-05 [expand_dump_flag]: 2.61999e-06 [jit_opt_a]: 0.00700351, [2] [Cycle 1]: 0.00345678, [27] [switch_simplify]: 4.788e-05 [loop_unroll]: 3.094e-05 [a_1]: 0.0005245 [with_stream_mark]: 1.292e-05 [recompute_prepare]: 5.629e-05 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 2.45997e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.348e-05 [j_node_and_user_rematch]: 9.43002e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 6.49999e-06 [renormalize]: 0.00247913 [add_forward_monad_depend]: 4.45e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 1.282e-05 [cse]: 1.945e-05 [replace_applicator]: 1.412e-05 [Cycle 2]: 0.00036214, [27] [switch_simplify]: 6.89001e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00012392 [with_stream_mark]: 9.24e-06 [recompute_prepare]: 5.88998e-06 [updatestate_depend_eliminate]: 2.73003e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.68997e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.51002e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.359e-05 [j_node_and_user_rematch]: 8.79003e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.49e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.49978e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.26998e-06 [cse]: 1.231e-05 [replace_applicator]: 6.24001e-06 [py_interpret_to_execute_after_opt_a]: 9.13002e-06 [rewriter_after_opt_a]: 5.465e-05 [convert_after_rewriter]: 5.87999e-06 [order_py_execute_after_rewriter]: 4.38001e-06 [mutable_eliminate]: 0.00055691 [jit_opt_b]: 5.605e-05, [1] [Cycle 1]: 4.921e-05, [2] [frontend_op_eliminate]: 2.023e-05 [inline_after_opt_a]: 1.713e-05 [cconv]: 1.765e-05 [loop_unroll]: 0.00045027 [jit_opt_after_cconv]: 0.00015022, [1] [Cycle 1]: 0.00014325, [11] [c_1]: 2.627e-05 [parameter_eliminate]: 2.84001e-06 [updatestate_depend_eliminate]: 6.76e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 1.863e-05 [call_graph_tuple_transform]: 2.042e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.02e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.44999e-06 [remove_dup_value]: 8.70999e-06 [partial_unused_args_eliminate]: 1.54e-06 [environ_conv]: 6.17001e-06 [add_recomputation]: 3.396e-05 [cse_after_recomputation]: 2.152e-05, [1] [Cycle 1]: 1.67e-05, [1] [cse]: 1.087e-05 [auto_monad_reorder]: 1.153e-05 [get_jit_bprop_graph]: 1.40001e-06 [rewriter_after_jit_bprop_graph]: 4.1e-06 [opt_after_jit_grad]: 0.00047256 [symbol_engine_optimizer]: 0.00016231, [1] [Cycle 1]: 0.00015636, [6] [build]: 2.65997e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 9.82e-05 [opt_reshape]: 7.25e-06 [fold_const_symbol]: 1.008e-05 [renormalize]: 4.19997e-07 [validate]: 3.713e-05 Sums bootstrap : 0.000291s : 0.25% type_inference : 0.109485s : 94.38% event_method : 0.000018s : 0.02% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000587s : 0.51% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000648s : 0.56% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000062s : 0.05% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002479s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000055s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000557s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000018s : 0.02% loop_unroll : 0.000450s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000473s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000098s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000165 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000005s : 4: substitution.graph_param_transform 84.14% : 0.000139s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000003s : 2: substitution.replace_old_param 4.78% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109410 2 97.43% : 0.106596s : 1: type_inference.infer 2.57% : 0.002815s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.56% : 0.000044s : 4: replace.inline 34.44% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 95.32% : 0.000136s : 4: match.inline 4.68% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.54% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 2.16% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.35% : 0.000002s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.99% : 0.000009s : 58: predicate.switch_simplify 1.17% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002115 22 67.21% : 0.001422s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.43% : 0.000665s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123326 72 0.03% : 0.000037s : 1: add_recomputation 0.04% : 0.000053s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.25% : 0.000308s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.68% : 0.007007s : 1: jit_opt_a 0.12% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.37% : 0.000459s : 1: loop_unroll 0.46% : 0.000565s : 1: mutable_eliminate 0.75% : 0.000920s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000121s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000481s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000596s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.45% : 0.001784s : 1: renormalize.infer 0.56% : 0.000688s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000058s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.13% : 0.000165s : 1: symbol_engine_optimizer 88.79% : 0.109500s : 1: type_inference TotalTime = 0.0646264, [30] [bootstrap]: 0.0002693 [type_inference]: 0.0547722 [event_method]: 2.072e-05 [auto_monad]: 6.462e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00028826 [rewriter_before_opt_a]: 8.348e-05 [expand_dump_flag]: 4.23001e-06 [jit_opt_a]: 0.00697307, [2] [Cycle 1]: 0.00312499, [27] [switch_simplify]: 5.457e-05 [loop_unroll]: 3.21e-05 [a_1]: 0.00060183 [with_stream_mark]: 1.713e-05 [recompute_prepare]: 1.004e-05 [updatestate_depend_eliminate]: 4.35e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 7.31999e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 6.68e-06 [meta_shard_fg_expand]: 2.67001e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.737e-05 [j_node_and_user_rematch]: 1.108e-05 [meta_fg_expand]: 2.99999e-06 [replace_old_param]: 1.059e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00204996 [add_forward_monad_depend]: 6.56e-06 [auto_monad_grad]: 2.63e-06 [auto_monad_eliminator]: 1.87e-05 [cse]: 2.911e-05 [replace_applicator]: 1.599e-05 [Cycle 2]: 0.00038144, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 5.87999e-06 [a_1]: 0.00012361 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.09999e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 5.31002e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.76998e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 2.35002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.648e-05 [j_node_and_user_rematch]: 9.62001e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.48002e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 7.72998e-06 [cse]: 1.268e-05 [replace_applicator]: 7.66999e-06 [py_interpret_to_execute_after_opt_a]: 1.15e-05 [rewriter_after_opt_a]: 3.399e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 4.94003e-06 [mutable_eliminate]: 0.00056758 [jit_opt_b]: 5.495e-05, [1] [Cycle 1]: 4.814e-05, [2] [frontend_op_eliminate]: 1.921e-05 [inline_after_opt_a]: 1.81e-05 [cconv]: 2.509e-05 [loop_unroll]: 0.0004268 [jit_opt_after_cconv]: 0.00014956, [1] [Cycle 1]: 0.00014365, [11] [c_1]: 2.529e-05 [parameter_eliminate]: 2.43002e-06 [updatestate_depend_eliminate]: 5.26998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.267e-05 [call_graph_tuple_transform]: 2.05e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.446e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 7.37997e-06 [add_recomputation]: 4.681e-05 [cse_after_recomputation]: 2.191e-05, [1] [Cycle 1]: 1.658e-05, [1] [cse]: 1.105e-05 [auto_monad_reorder]: 1.443e-05 [get_jit_bprop_graph]: 1.83002e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00044895 [symbol_engine_optimizer]: 8.943e-05, [1] [Cycle 1]: 8.308e-05, [6] [build]: 3.41999e-06 [elim_shapecalc]: 8.72e-06 [elim_not_effective]: 2.662e-05 [opt_reshape]: 6.69001e-06 [fold_const_symbol]: 9.89001e-06 [renormalize]: 3.39991e-07 [validate]: 4.061e-05 Sums bootstrap : 0.000269s : 0.44% type_inference : 0.054772s : 90.43% event_method : 0.000021s : 0.03% auto_monad : 0.000065s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000288s : 0.48% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.06% jit_opt_a.a_1 : 0.000725s : 1.20% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000017s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002050s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000568s : 0.94% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000427s : 0.70% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000449s : 0.74% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000221 24 6.63% : 0.000015s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 4: substitution.graph_param_transform 78.49% : 0.000173s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054691 2 96.17% : 0.052597s : 1: type_inference.infer 3.83% : 0.002095s : 1: type_inference.specialize ------[replace.] 0.000079 6 64.04% : 0.000050s : 4: replace.inline 35.96% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.86% : 0.000170s : 4: match.inline 6.14% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 1.08% : 0.000001s : 8: predicate.inline_without_move 0.54% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.44% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.60% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 58: predicate.switch_simplify 1.39% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002320 26 71.56% : 0.001661s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.51% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.93% : 0.000625s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067728 72 0.07% : 0.000050s : 1: add_recomputation 0.10% : 0.000068s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.42% : 0.000282s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.30% : 0.006976s : 1: jit_opt_a 0.22% : 0.000152s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.64% : 0.000435s : 1: loop_unroll 0.85% : 0.000577s : 1: mutable_eliminate 1.43% : 0.000968s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000294s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 2.04% : 0.001380s : 1: renormalize.infer 0.97% : 0.000658s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000037s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.14% : 0.000092s : 1: symbol_engine_optimizer 80.89% : 0.054787s : 1: type_inference TotalTime = 0.122293, [30] [bootstrap]: 0.00031148 [type_inference]: 0.111601 [event_method]: 2.065e-05 [auto_monad]: 7.055e-05 [graph_reusing]: 5.46e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00044138 [rewriter_before_opt_a]: 9.693e-05 [expand_dump_flag]: 4.13001e-06 [jit_opt_a]: 0.00745465, [2] [Cycle 1]: 0.0038038, [27] [switch_simplify]: 5.688e-05 [loop_unroll]: 3.398e-05 [a_1]: 0.00066334 [with_stream_mark]: 2.848e-05 [recompute_prepare]: 8.70999e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.96001e-06 [updatestate_useless_node_eliminater]: 6.23e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.35002e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.68002e-06 [inline_without_move]: 6.49001e-06 [renormalize]: 0.00269058 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.54e-05 [cse]: 2.836e-05 [replace_applicator]: 1.431e-05 [Cycle 2]: 0.00036867, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.0001275 [with_stream_mark]: 1.056e-05 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 3.05998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 2.56e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.78997e-06 [cse]: 1.442e-05 [replace_applicator]: 5.93002e-06 [py_interpret_to_execute_after_opt_a]: 1.214e-05 [rewriter_after_opt_a]: 3.595e-05 [convert_after_rewriter]: 6.43998e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00059053 [jit_opt_b]: 5.621e-05, [1] [Cycle 1]: 4.97e-05, [2] [frontend_op_eliminate]: 1.842e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 2.605e-05 [loop_unroll]: 0.0004232 [jit_opt_after_cconv]: 0.00015437, [1] [Cycle 1]: 0.00014795, [11] [c_1]: 2.57e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 5.79999e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 3.48999e-06 [cse]: 2.345e-05 [call_graph_tuple_transform]: 2.074e-05 [tuple_list_get_item_eliminator]: 6.94999e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 7.67002e-06 [add_recomputation]: 4.528e-05 [cse_after_recomputation]: 2.451e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.37e-05 [auto_monad_reorder]: 1.749e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 5.45001e-06 [opt_after_jit_grad]: 0.00047459 [symbol_engine_optimizer]: 7.989e-05, [1] [Cycle 1]: 7.376e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 1.016e-05 [elim_not_effective]: 1.502e-05 [opt_reshape]: 6.43e-06 [fold_const_symbol]: 1.087e-05 [renormalize]: 4.09986e-07 [validate]: 4.756e-05 Sums bootstrap : 0.000311s : 0.26% type_inference : 0.111601s : 94.29% event_method : 0.000021s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000441s : 0.37% rewriter_before_opt_a : 0.000097s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000791s : 0.67% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002691s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000591s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000423s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000475s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000254 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000006s : 4: substitution.graph_param_transform 83.56% : 0.000212s : 5: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.27% : 0.000011s : 3: substitution.reduce_eliminate 1.76% : 0.000004s : 4: substitution.remove_not_recompute_node 1.80% : 0.000005s : 2: substitution.replace_old_param 4.02% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111524 2 97.42% : 0.108643s : 1: type_inference.infer 2.58% : 0.002882s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.65% : 0.000063s : 5: replace.inline 31.35% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 7 95.82% : 0.000209s : 5: match.inline 4.18% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.38% : 0.000002s : 13: predicate.accumulaten_eliminater 0.80% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.27% : 0.000002s : 13: predicate.addn_zero_filter 2.33% : 0.000003s : 13: predicate.arithmetic_simplify 1.21% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.25% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.20% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.26% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.24% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.21% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.82% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.41% : 0.000002s : 13: predicate.transpose_eliminate 1.44% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 13: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002304 25 65.81% : 0.001516s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.14% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.05% : 0.000715s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126018 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.26% : 0.000329s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.92% : 0.007458s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.34% : 0.000431s : 1: loop_unroll 0.47% : 0.000598s : 1: mutable_eliminate 0.81% : 0.001025s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000032s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000448s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.54% : 0.001942s : 1: renormalize.infer 0.59% : 0.000739s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000102s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.57% : 0.111614s : 1: type_inference TotalTime = 0.0125151, [30] [bootstrap]: 0.00025156 [type_inference]: 0.00431129 [event_method]: 1.725e-05 [auto_monad]: 4.257e-05 [graph_reusing]: 3.66999e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 3.558e-05 [rewriter_before_opt_a]: 6.467e-05 [expand_dump_flag]: 2.19999e-06 [jit_opt_a]: 0.00551779, [2] [Cycle 1]: 0.00180205, [27] [switch_simplify]: 5.797e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00055973 [with_stream_mark]: 1.993e-05 [recompute_prepare]: 7.05e-06 [updatestate_depend_eliminate]: 4.30999e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.66002e-06 [specialize_transform]: 6.56999e-06 [updatestate_useless_node_eliminater]: 5.26998e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 3.51999e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.73998e-06 [replace_old_param]: 8.84003e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 0.00080859 [add_forward_monad_depend]: 6.44001e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.54e-05 [cse]: 2.851e-05 [replace_applicator]: 1.311e-05 [Cycle 2]: 0.00032056, [27] [switch_simplify]: 6.12001e-06 [loop_unroll]: 4.85999e-06 [a_1]: 9.427e-05 [with_stream_mark]: 9.19e-06 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 2.59001e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.11997e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.58998e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.33e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 7.85e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 5.00004e-08 [add_forward_monad_depend]: 1.06002e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.58997e-06 [cse]: 1.094e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.217e-05 [rewriter_after_opt_a]: 3.677e-05 [convert_after_rewriter]: 6.92002e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00064144 [jit_opt_b]: 5.471e-05, [1] [Cycle 1]: 4.621e-05, [2] [frontend_op_eliminate]: 1.734e-05 [inline_after_opt_a]: 1.664e-05 [cconv]: 2.688e-05 [loop_unroll]: 0.00042767 [jit_opt_after_cconv]: 0.00015072, [1] [Cycle 1]: 0.00014391, [11] [c_1]: 2.275e-05 [parameter_eliminate]: 3.44001e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.214e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 1.90019e-07 [switch_simplify]: 5.32999e-06 [remove_dup_value]: 1.515e-05 [partial_unused_args_eliminate]: 2.63e-06 [environ_conv]: 6.07001e-06 [add_recomputation]: 4.845e-05 [cse_after_recomputation]: 2.215e-05, [1] [Cycle 1]: 1.713e-05, [1] [cse]: 1.093e-05 [auto_monad_reorder]: 1.046e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 5.59e-06 [opt_after_jit_grad]: 0.00050182 [symbol_engine_optimizer]: 7.757e-05, [1] [Cycle 1]: 7.06e-05, [6] [build]: 4.14002e-06 [elim_shapecalc]: 8.60999e-06 [elim_not_effective]: 1.524e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.85999e-06 [renormalize]: 2.80008e-07 [validate]: 3.922e-05 Sums bootstrap : 0.000252s : 2.94% type_inference : 0.004311s : 50.47% event_method : 0.000017s : 0.20% auto_monad : 0.000043s : 0.50% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.42% rewriter_before_opt_a : 0.000065s : 0.76% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.75% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000654s : 7.66% jit_opt_a.with_stream_mark : 0.000029s : 0.34% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000809s : 9.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000039s : 0.46% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000037s : 0.43% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000641s : 7.51% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000017s : 0.19% cconv : 0.000027s : 0.31% loop_unroll : 0.000428s : 5.01% jit_opt_after_cconv.c_1 : 0.000023s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000010s : 0.12% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000502s : 5.87% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.18% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.46% Time group info: ------[substitution.] 0.000226 23 1.19% : 0.000003s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 3: substitution.graph_param_transform 85.82% : 0.000194s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000004s : 2: substitution.replace_old_param 4.16% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004261 2 81.26% : 0.003462s : 1: type_inference.infer 18.74% : 0.000798s : 1: type_inference.specialize ------[replace.] 0.000070 6 65.99% : 0.000046s : 4: replace.inline 34.01% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 95.90% : 0.000191s : 4: match.inline 4.10% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.47% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.27% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.24% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 3: predicate.elim_not_effective 0.96% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.49% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.51% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.02% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.26% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.60% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.65% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.66% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000624 13 48.22% : 0.000301s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.41% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.37% : 0.000277s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014249 72 0.36% : 0.000051s : 1: add_recomputation 0.32% : 0.000046s : 1: auto_monad 0.09% : 0.000013s : 1: auto_monad_reorder 1.84% : 0.000262s : 1: bootstrap 0.21% : 0.000030s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 38.75% : 0.005521s : 1: jit_opt_a 1.08% : 0.000154s : 1: jit_opt_after_cconv 0.40% : 0.000057s : 1: jit_opt_b 3.07% : 0.000437s : 1: loop_unroll 4.56% : 0.000650s : 1: mutable_eliminate 6.10% : 0.000869s : 26: opt.transform.jit_opt_a 0.35% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.18% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.59% : 0.000512s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 3.21% : 0.000457s : 1: renormalize.infer 2.41% : 0.000344s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000039s : 1: rewriter_after_opt_a 0.47% : 0.000067s : 1: rewriter_before_opt_a 0.57% : 0.000081s : 1: symbol_engine_optimizer 30.34% : 0.004323s : 1: type_inference TotalTime = 0.0162066, [30] [bootstrap]: 0.00030257 [type_inference]: 0.00837782 [event_method]: 2.234e-05 [auto_monad]: 7.033e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.824e-05 [rewriter_before_opt_a]: 8.205e-05 [expand_dump_flag]: 2.84001e-06 [jit_opt_a]: 0.00522259, [2] [Cycle 1]: 0.00174785, [27] [switch_simplify]: 5.632e-05 [loop_unroll]: 3.241e-05 [a_1]: 0.00064453 [with_stream_mark]: 1.702e-05 [recompute_prepare]: 7.87e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.19001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.76998e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.449e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.54e-06 [renormalize]: 0.00067907 [add_forward_monad_depend]: 5.44e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.464e-05 [cse]: 3.146e-05 [replace_applicator]: 1.148e-05 [Cycle 2]: 0.00032596, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 5.04e-06 [a_1]: 9.636e-05 [with_stream_mark]: 1.032e-05 [recompute_prepare]: 5.26998e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 4.94998e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 4.61997e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.91998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.145e-05 [j_node_and_user_rematch]: 7.74002e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 6.99001e-06 [inline_without_move]: 4.79e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.209e-05 [replace_applicator]: 5.21998e-06 [py_interpret_to_execute_after_opt_a]: 1.132e-05 [rewriter_after_opt_a]: 3.5e-05 [convert_after_rewriter]: 7.2e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00053217 [jit_opt_b]: 5.03e-05, [1] [Cycle 1]: 4.297e-05, [2] [frontend_op_eliminate]: 1.61e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 2.491e-05 [loop_unroll]: 0.00040928 [jit_opt_after_cconv]: 0.00015479, [1] [Cycle 1]: 0.00014816, [11] [c_1]: 2.014e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.356e-05 [call_graph_tuple_transform]: 2.77e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 5.82999e-06 [remove_dup_value]: 1.556e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 6.04999e-06 [add_recomputation]: 4.791e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.74e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.0004423 [symbol_engine_optimizer]: 7.148e-05, [1] [Cycle 1]: 6.56e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 7.11999e-06 [elim_not_effective]: 1.264e-05 [opt_reshape]: 5.92999e-06 [fold_const_symbol]: 9.13002e-06 [renormalize]: 4.19997e-07 [validate]: 3.777e-05 Sums bootstrap : 0.000303s : 2.42% type_inference : 0.008378s : 67.04% event_method : 0.000022s : 0.18% auto_monad : 0.000070s : 0.56% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000048s : 0.39% rewriter_before_opt_a : 0.000082s : 0.66% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.50% jit_opt_a.loop_unroll : 0.000037s : 0.30% jit_opt_a.a_1 : 0.000741s : 5.93% jit_opt_a.with_stream_mark : 0.000027s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.13% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000679s : 5.44% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000044s : 0.35% jit_opt_a.replace_applicator : 0.000017s : 0.13% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000035s : 0.28% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000532s : 4.26% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.12% cconv : 0.000025s : 0.20% loop_unroll : 0.000409s : 3.28% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.38% cse_after_recomputation.cse : 0.000012s : 0.09% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000442s : 3.54% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.30% Time group info: ------[substitution.] 0.000227 27 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000006s : 3: substitution.graph_param_transform 82.76% : 0.000188s : 5: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.07% : 0.000009s : 3: substitution.reduce_eliminate 1.75% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.27% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008306 2 87.54% : 0.007271s : 1: type_inference.infer 12.46% : 0.001035s : 1: type_inference.specialize ------[replace.] 0.000087 7 67.67% : 0.000059s : 5: replace.inline 32.33% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 7 95.55% : 0.000185s : 5: match.inline 4.45% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.28% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 1.97% : 0.000002s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.23% : 0.000001s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000001s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 16: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 16: predicate.partial_eliminate 1.43% : 0.000002s : 11: predicate.print_const_string_wrapper 2.16% : 0.000003s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 19: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 18: predicate.switch_defer_inline 2.38% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.84% : 0.000009s : 59: predicate.switch_simplify 1.25% : 0.000002s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.62% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000807 16 53.72% : 0.000434s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.48% : 0.000052s : 2: func_graph_cloner_run.FuncGraphClonerNode 39.80% : 0.000321s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017904 72 0.28% : 0.000051s : 1: add_recomputation 0.41% : 0.000074s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.77% : 0.000317s : 1: bootstrap 0.15% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000027s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 29.19% : 0.005226s : 1: jit_opt_a 0.88% : 0.000158s : 1: jit_opt_after_cconv 0.30% : 0.000053s : 1: jit_opt_b 2.33% : 0.000417s : 1: loop_unroll 3.02% : 0.000540s : 1: mutable_eliminate 5.32% : 0.000953s : 26: opt.transform.jit_opt_a 0.31% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.11% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.51% : 0.000450s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000051s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.05% : 0.000367s : 1: renormalize.infer 1.70% : 0.000305s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000038s : 1: rewriter_after_opt_a 0.47% : 0.000085s : 1: rewriter_before_opt_a 0.41% : 0.000074s : 1: symbol_engine_optimizer 46.90% : 0.008396s : 1: type_inference TotalTime = 0.118504, [30] [bootstrap]: 0.00026908 [type_inference]: 0.108147 [event_method]: 1.823e-05 [auto_monad]: 6.204e-05 [graph_reusing]: 5.19e-06 [pre_auto_parallel]: 2.01e-06 [py_interpret_to_execute]: 0.00046981 [rewriter_before_opt_a]: 8.012e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00707947, [2] [Cycle 1]: 0.00351673, [27] [switch_simplify]: 5.241e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.00055092 [with_stream_mark]: 1.628e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 3.78999e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 6.33002e-06 [renormalize]: 0.00253726 [add_forward_monad_depend]: 6.63e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.496e-05 [cse]: 2.423e-05 [replace_applicator]: 1.576e-05 [Cycle 2]: 0.00036657, [27] [switch_simplify]: 6.94999e-06 [loop_unroll]: 5.57001e-06 [a_1]: 0.00012237 [with_stream_mark]: 1.022e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.49998e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.87999e-06 [meta_shard_fg_expand]: 1.88002e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 2.41e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.618e-05 [j_node_and_user_rematch]: 9.49e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.156e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.179e-05 [rewriter_after_opt_a]: 3.467e-05 [convert_after_rewriter]: 7.25998e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00059314 [jit_opt_b]: 5.683e-05, [1] [Cycle 1]: 4.935e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.482e-05 [loop_unroll]: 0.00043038 [jit_opt_after_cconv]: 0.00015428, [1] [Cycle 1]: 0.00014597, [11] [c_1]: 2.688e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.91999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.044e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 6.37001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.544e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 9.66003e-06 [add_recomputation]: 4.781e-05 [cse_after_recomputation]: 2.365e-05, [1] [Cycle 1]: 1.69e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 7.217e-05 [get_jit_bprop_graph]: 2.64001e-06 [rewriter_after_jit_bprop_graph]: 4.48999e-06 [opt_after_jit_grad]: 0.00049641 [symbol_engine_optimizer]: 7.426e-05, [1] [Cycle 1]: 6.819e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.431e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.89001e-06 [renormalize]: 3.50003e-07 [validate]: 4.286e-05 Sums bootstrap : 0.000269s : 0.23% type_inference : 0.108147s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000062s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000470s : 0.41% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000673s : 0.59% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002537s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000593s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000430s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000072s : 0.06% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000496s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000196 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.97% : 0.000006s : 4: substitution.graph_param_transform 82.63% : 0.000162s : 4: substitution.inline 1.93% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.98% : 0.000006s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 5.85% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108077 2 97.60% : 0.105481s : 1: type_inference.infer 2.40% : 0.002596s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.22% : 0.000045s : 4: replace.inline 33.78% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 93.93% : 0.000160s : 4: match.inline 6.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.41% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.49% : 0.000001s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.40% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000001s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.05% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000001s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002084 22 66.34% : 0.001382s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.98% : 0.000666s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122004 72 0.04% : 0.000050s : 1: add_recomputation 0.05% : 0.000065s : 1: auto_monad 0.06% : 0.000075s : 1: auto_monad_reorder 0.23% : 0.000283s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.81% : 0.007083s : 1: jit_opt_a 0.13% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000437s : 1: loop_unroll 0.49% : 0.000601s : 1: mutable_eliminate 0.74% : 0.000904s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000505s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000477s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.49% : 0.001814s : 1: renormalize.infer 0.59% : 0.000714s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.13% : 0.000153s : 1: symbol_engine_optimizer 88.65% : 0.108159s : 1: type_inference TotalTime = 0.124364, [30] [bootstrap]: 0.00033361 [type_inference]: 0.113526 [event_method]: 2.19e-05 [auto_monad]: 6.672e-05 [graph_reusing]: 5.51002e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 0.00045061 [rewriter_before_opt_a]: 9.132e-05 [expand_dump_flag]: 3.86999e-06 [jit_opt_a]: 0.00743624, [2] [Cycle 1]: 0.00387478, [27] [switch_simplify]: 5.619e-05 [loop_unroll]: 3.395e-05 [a_1]: 0.00070485 [with_stream_mark]: 1.626e-05 [recompute_prepare]: 8.59002e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.08998e-06 [parameter_eliminate]: 2.01e-06 [specialize_transform]: 7.10002e-06 [updatestate_useless_node_eliminater]: 6.24001e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 6.60997e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 8.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 9.78998e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.94001e-06 [inline_without_move]: 6.22001e-06 [renormalize]: 0.0027173 [add_forward_monad_depend]: 6.34999e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.72e-05 [cse]: 3.045e-05 [replace_applicator]: 1.606e-05 [Cycle 2]: 0.00038644, [27] [switch_simplify]: 7.30003e-06 [loop_unroll]: 5.97001e-06 [a_1]: 0.00013482 [with_stream_mark]: 1.147e-05 [recompute_prepare]: 6.48998e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 1.69e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.30003e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.556e-05 [replace_applicator]: 6.06e-06 [py_interpret_to_execute_after_opt_a]: 1.406e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00071554 [jit_opt_b]: 6.532e-05, [1] [Cycle 1]: 5.389e-05, [2] [frontend_op_eliminate]: 2.182e-05 [inline_after_opt_a]: 2.052e-05 [cconv]: 2.902e-05 [loop_unroll]: 0.00045707 [jit_opt_after_cconv]: 0.00016856, [1] [Cycle 1]: 0.00016088, [11] [c_1]: 2.718e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 6.98e-06 [updatestate_assign_eliminate]: 3.80998e-06 [updatestate_loads_eliminate]: 2.59001e-06 [cse]: 2.733e-05 [call_graph_tuple_transform]: 2.309e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.685e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 1.094e-05 [add_recomputation]: 4.903e-05 [cse_after_recomputation]: 2.473e-05, [1] [Cycle 1]: 1.821e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.773e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 5.21002e-06 [opt_after_jit_grad]: 0.00047527 [symbol_engine_optimizer]: 8.447e-05, [1] [Cycle 1]: 7.819e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 1.477e-05 [opt_reshape]: 6.98998e-06 [fold_const_symbol]: 1.345e-05 [renormalize]: 4.59986e-07 [validate]: 4.872e-05 Sums bootstrap : 0.000334s : 0.28% type_inference : 0.113526s : 94.15% event_method : 0.000022s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000451s : 0.37% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000840s : 0.70% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002717s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000716s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000021s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000457s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000475s : 0.39% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000284 28 0.63% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 1.98% : 0.000006s : 4: substitution.graph_param_transform 85.34% : 0.000242s : 5: substitution.inline 1.16% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.64% : 0.000010s : 3: substitution.reduce_eliminate 1.57% : 0.000004s : 4: substitution.remove_not_recompute_node 1.57% : 0.000004s : 2: substitution.replace_old_param 3.61% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113454 2 97.45% : 0.110566s : 1: type_inference.infer 2.55% : 0.002889s : 1: type_inference.specialize ------[replace.] 0.000095 7 67.72% : 0.000065s : 5: replace.inline 32.28% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000248 7 96.41% : 0.000239s : 5: match.inline 3.59% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 886 1.21% : 0.000002s : 13: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.19% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.44% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.48% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.06% : 0.000002s : 13: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.23% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.16% : 0.000002s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.59% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 20: predicate.switch_defer_inline 2.03% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.15% : 0.000010s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002347 25 64.58% : 0.001516s : 16: func_graph_cloner_run.FuncGraphClonerGraph 4.47% : 0.000105s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.96% : 0.000727s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128240 72 0.04% : 0.000052s : 1: add_recomputation 0.05% : 0.000070s : 1: auto_monad 0.02% : 0.000022s : 1: auto_monad_reorder 0.27% : 0.000349s : 1: bootstrap 0.02% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.80% : 0.007440s : 1: jit_opt_a 0.13% : 0.000171s : 1: jit_opt_after_cconv 0.05% : 0.000068s : 1: jit_opt_b 0.36% : 0.000465s : 1: loop_unroll 0.57% : 0.000728s : 1: mutable_eliminate 0.84% : 0.001081s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000459s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.54% : 0.001971s : 1: renormalize.infer 0.58% : 0.000738s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000096s : 1: rewriter_before_opt_a 0.07% : 0.000090s : 1: symbol_engine_optimizer 88.54% : 0.113538s : 1: type_inference TotalTime = 0.121225, [30] [bootstrap]: 0.0002677 [type_inference]: 0.109257 [event_method]: 2.139e-05 [auto_monad]: 7.109e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.58998e-06 [py_interpret_to_execute]: 0.00056508 [rewriter_before_opt_a]: 9.506e-05 [expand_dump_flag]: 3.66999e-06 [jit_opt_a]: 0.0083185, [2] [Cycle 1]: 0.00425528, [27] [switch_simplify]: 6.32e-05 [loop_unroll]: 2.991e-05 [a_1]: 0.00065879 [with_stream_mark]: 2.03e-05 [recompute_prepare]: 9.45001e-06 [updatestate_depend_eliminate]: 4.60999e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.48e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.46e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.791e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.96e-06 [renormalize]: 0.00303313 [add_forward_monad_depend]: 9.66e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.072e-05 [cse]: 3.597e-05 [replace_applicator]: 2.369e-05 [Cycle 2]: 0.00039393, [27] [switch_simplify]: 7.17002e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.00013087 [with_stream_mark]: 1.531e-05 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 2.35002e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 6.29001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 3.02002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.869e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.59e-06 [inline_without_move]: 6.14999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.67999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.56e-06 [cse]: 1.363e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.288e-05 [rewriter_after_opt_a]: 3.814e-05 [convert_after_rewriter]: 8.27e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00067909 [jit_opt_b]: 5.695e-05, [1] [Cycle 1]: 4.923e-05, [2] [frontend_op_eliminate]: 1.948e-05 [inline_after_opt_a]: 1.837e-05 [cconv]: 2.928e-05 [loop_unroll]: 0.00047979 [jit_opt_after_cconv]: 0.00017329, [1] [Cycle 1]: 0.00016672, [11] [c_1]: 2.752e-05 [parameter_eliminate]: 3.79002e-06 [updatestate_depend_eliminate]: 7.33e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 3.23e-06 [cse]: 2.951e-05 [call_graph_tuple_transform]: 2.422e-05 [tuple_list_get_item_eliminator]: 6.57002e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 6.79999e-06 [remove_dup_value]: 1.818e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 9.79e-06 [add_recomputation]: 5.449e-05 [cse_after_recomputation]: 2.74e-05, [1] [Cycle 1]: 2.126e-05, [1] [cse]: 1.428e-05 [auto_monad_reorder]: 1.57e-05 [get_jit_bprop_graph]: 2.78e-06 [rewriter_after_jit_bprop_graph]: 9.02e-06 [opt_after_jit_grad]: 0.00051304 [symbol_engine_optimizer]: 0.00018575, [1] [Cycle 1]: 0.00017842, [6] [build]: 3.86999e-06 [elim_shapecalc]: 9.35001e-06 [elim_not_effective]: 1.489e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 0.00011278 [renormalize]: 6.79982e-07 [validate]: 5.079e-05 Sums bootstrap : 0.000268s : 0.23% type_inference : 0.109257s : 93.53% event_method : 0.000021s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000565s : 0.48% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000790s : 0.68% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003033s : 2.60% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000050s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000679s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000480s : 0.41% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000009s : 0.01% opt_after_jit_grad : 0.000513s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000113s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000051s : 0.04% Time group info: ------[substitution.] 0.000225 24 1.23% : 0.000003s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 3.03% : 0.000007s : 4: substitution.graph_param_transform 82.89% : 0.000186s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000006s : 4: substitution.remove_not_recompute_node 2.23% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109165 2 97.32% : 0.106238s : 1: type_inference.infer 2.68% : 0.002927s : 1: type_inference.specialize ------[replace.] 0.000086 6 65.76% : 0.000057s : 4: replace.inline 34.24% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.17% : 0.000184s : 4: match.inline 5.83% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000186 830 0.99% : 0.000002s : 12: predicate.accumulaten_eliminater 0.86% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.76% : 0.000001s : 12: predicate.addn_check_dump 1.02% : 0.000002s : 12: predicate.addn_zero_filter 25.18% : 0.000047s : 12: predicate.arithmetic_simplify 1.06% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 0.87% : 0.000002s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 0.79% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.82% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.94% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.28% : 0.000001s : 4: predicate.elim_not_effective 0.41% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.96% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.87% : 0.000002s : 12: predicate.environ_get_add_eliminate 0.79% : 0.000001s : 12: predicate.environ_get_depend_swap 0.93% : 0.000002s : 12: predicate.environ_get_eliminate 0.78% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 4.08% : 0.000008s : 26: predicate.inline 0.76% : 0.000001s : 8: predicate.inline_without_move 0.33% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.89% : 0.000002s : 8: predicate.less_batch_normalization 1.14% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.37% : 0.000003s : 18: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.59% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.78% : 0.000001s : 12: predicate.merge_addn 0.76% : 0.000001s : 12: predicate.minmaximum_grad 1.21% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 1.76% : 0.000003s : 18: predicate.partial_eliminate 0.93% : 0.000002s : 12: predicate.print_const_string_wrapper 1.55% : 0.000003s : 12: predicate.reduce_eliminate 0.97% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.64% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.26% : 0.000000s : 4: predicate.reset_defer_inline 1.13% : 0.000002s : 12: predicate.reshape_eliminate 0.95% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 0.88% : 0.000002s : 12: predicate.same_eliminate 0.48% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.66% : 0.000001s : 8: predicate.special_op_eliminate 0.72% : 0.000001s : 8: predicate.specialize_transform 1.09% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.35% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.65% : 0.000003s : 18: predicate.switch_defer_inline 1.44% : 0.000003s : 18: predicate.switch_layer_defer_inline 5.25% : 0.000010s : 58: predicate.switch_simplify 0.91% : 0.000002s : 12: predicate.tile_eliminate 0.89% : 0.000002s : 12: predicate.transpose_eliminate 1.16% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.93% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.09% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.29% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.26% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.15% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002453 22 62.06% : 0.001522s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.48% : 0.000895s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125472 72 0.05% : 0.000058s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000279s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.63% : 0.008322s : 1: jit_opt_a 0.14% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.39% : 0.000488s : 1: loop_unroll 0.55% : 0.000690s : 1: mutable_eliminate 0.83% : 0.001045s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000140s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000522s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.50% : 0.000627s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.61% : 0.002016s : 1: renormalize.infer 0.80% : 0.001005s : 1: renormalize.specialize 0.01% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.15% : 0.000189s : 1: symbol_engine_optimizer 87.09% : 0.109280s : 1: type_inference TotalTime = 0.129896, [30] [bootstrap]: 0.00037964 [type_inference]: 0.117234 [event_method]: 2.738e-05 [auto_monad]: 8.176e-05 [graph_reusing]: 6.14999e-06 [pre_auto_parallel]: 2.52001e-06 [py_interpret_to_execute]: 0.00048081 [rewriter_before_opt_a]: 0.00011165 [expand_dump_flag]: 4.72e-06 [jit_opt_a]: 0.00869554, [2] [Cycle 1]: 0.00437133, [27] [switch_simplify]: 6.904e-05 [loop_unroll]: 3.504e-05 [a_1]: 0.00076256 [with_stream_mark]: 2.447e-05 [recompute_prepare]: 1.125e-05 [updatestate_depend_eliminate]: 5.75001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 8.40001e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 6.73998e-06 [merge_forward]: 4.74e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.835e-05 [j_node_and_user_rematch]: 1.1e-05 [meta_fg_expand]: 2.83998e-06 [replace_old_param]: 1.122e-05 [inline_without_move]: 6.57002e-06 [renormalize]: 0.00306208 [add_forward_monad_depend]: 9.61e-06 [auto_monad_grad]: 2.89001e-06 [auto_monad_eliminator]: 2.224e-05 [cse]: 3.813e-05 [replace_applicator]: 2.28e-05 [Cycle 2]: 0.0004176, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 6.23998e-06 [a_1]: 0.00013719 [with_stream_mark]: 1.909e-05 [recompute_prepare]: 6.91001e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.89001e-06 [parameter_eliminate]: 1.60001e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.53e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 2.79999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 9.42999e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 1.083e-05 [inline_without_move]: 5.77999e-06 [renormalize]: 1.19995e-07 [add_forward_monad_depend]: 1.70001e-06 [auto_monad_grad]: 1.46002e-06 [auto_monad_eliminator]: 8.38001e-06 [cse]: 1.726e-05 [replace_applicator]: 6.64999e-06 [py_interpret_to_execute_after_opt_a]: 1.684e-05 [rewriter_after_opt_a]: 4.255e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 5.41002e-06 [mutable_eliminate]: 0.00076521 [jit_opt_b]: 8.629e-05, [1] [Cycle 1]: 7.838e-05, [2] [frontend_op_eliminate]: 4.485e-05 [inline_after_opt_a]: 2.027e-05 [cconv]: 3.178e-05 [loop_unroll]: 0.00058189 [jit_opt_after_cconv]: 0.00018459, [1] [Cycle 1]: 0.00017642, [11] [c_1]: 2.775e-05 [parameter_eliminate]: 4.47e-06 [updatestate_depend_eliminate]: 7.83999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 3.369e-05 [call_graph_tuple_transform]: 2.459e-05 [tuple_list_get_item_eliminator]: 6.66999e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 7.21999e-06 [remove_dup_value]: 1.938e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 1.219e-05 [add_recomputation]: 5.596e-05 [cse_after_recomputation]: 2.969e-05, [1] [Cycle 1]: 2.298e-05, [1] [cse]: 1.495e-05 [auto_monad_reorder]: 1.827e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 6.22001e-06 [opt_after_jit_grad]: 0.00056609 [symbol_engine_optimizer]: 9.472e-05, [1] [Cycle 1]: 8.709e-05, [6] [build]: 5.99e-06 [elim_shapecalc]: 1.207e-05 [elim_not_effective]: 1.789e-05 [opt_reshape]: 7.48e-06 [fold_const_symbol]: 1.229e-05 [renormalize]: 3.89991e-07 [validate]: 0.00012411 Sums bootstrap : 0.000380s : 0.30% type_inference : 0.117234s : 93.56% event_method : 0.000027s : 0.02% auto_monad : 0.000082s : 0.07% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000481s : 0.38% rewriter_before_opt_a : 0.000112s : 0.09% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000076s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000900s : 0.72% jit_opt_a.with_stream_mark : 0.000044s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000015s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000022s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003062s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000031s : 0.02% jit_opt_a.cse : 0.000055s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000043s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000765s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000045s : 0.04% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000032s : 0.03% loop_unroll : 0.000582s : 0.46% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000012s : 0.01% add_recomputation : 0.000056s : 0.04% cse_after_recomputation.cse : 0.000015s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000566s : 0.45% symbol_engine_optimizer.build : 0.000006s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000018s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000124s : 0.10% Time group info: ------[substitution.] 0.000322 28 0.75% : 0.000002s : 2: substitution.elim_not_effective 1.08% : 0.000003s : 2: substitution.fold_const_symbol 2.21% : 0.000007s : 4: substitution.graph_param_transform 82.95% : 0.000267s : 5: substitution.inline 1.42% : 0.000005s : 4: substitution.j_node_and_user_rematch 4.49% : 0.000014s : 3: substitution.reduce_eliminate 1.66% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000006s : 2: substitution.replace_old_param 3.52% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117131 2 97.11% : 0.113744s : 1: type_inference.infer 2.89% : 0.003386s : 1: type_inference.specialize ------[replace.] 0.000111 7 68.06% : 0.000076s : 5: replace.inline 31.94% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000274 7 96.30% : 0.000263s : 5: match.inline 3.70% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000152 886 1.46% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000002s : 13: predicate.compare_switch_simplify 1.10% : 0.000002s : 13: predicate.depend_value_elim 1.01% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.39% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.01% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.43% : 0.000001s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000001s : 4: predicate.graph_param_transform 5.68% : 0.000009s : 28: predicate.inline 1.17% : 0.000002s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.29% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 19: predicate.load_eliminater 1.83% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 13: predicate.merge_addn 1.03% : 0.000002s : 13: predicate.minmaximum_grad 2.16% : 0.000003s : 4: predicate.mutable_eliminate 0.76% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 19: predicate.partial_eliminate 1.12% : 0.000002s : 13: predicate.print_const_string_wrapper 2.22% : 0.000003s : 13: predicate.reduce_eliminate 1.30% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 23: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.12% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 8: predicate.special_op_eliminate 0.85% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 20: predicate.switch_defer_inline 1.94% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.27% : 0.000011s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.28% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.79% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.00% : 0.000005s : 27: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002617 25 65.25% : 0.001708s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.47% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.28% : 0.000819s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.134162 72 0.04% : 0.000060s : 1: add_recomputation 0.06% : 0.000086s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.30% : 0.000397s : 1: bootstrap 0.03% : 0.000035s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000032s : 1: cse_after_recomputation 0.01% : 0.000015s : 1: environ_conv 0.03% : 0.000034s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.48% : 0.008699s : 1: jit_opt_a 0.14% : 0.000188s : 1: jit_opt_after_cconv 0.07% : 0.000089s : 1: jit_opt_b 0.44% : 0.000593s : 1: loop_unroll 0.58% : 0.000777s : 1: mutable_eliminate 0.87% : 0.001172s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000058s : 4: opt.transform.jit_opt_b 0.01% : 0.000019s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000577s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000019s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.66% : 0.002221s : 1: renormalize.infer 0.62% : 0.000828s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000119s : 1: rewriter_before_opt_a 0.07% : 0.000097s : 1: symbol_engine_optimizer 87.40% : 0.117257s : 1: type_inference TotalTime = 0.0137925, [30] [bootstrap]: 0.00030179 [type_inference]: 0.00508043 [event_method]: 2.021e-05 [auto_monad]: 7.234e-05 [graph_reusing]: 5.07e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 4.66e-05 [rewriter_before_opt_a]: 7.362e-05 [expand_dump_flag]: 3.11999e-06 [jit_opt_a]: 0.00582824, [2] [Cycle 1]: 0.00186216, [27] [switch_simplify]: 6.296e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00058245 [with_stream_mark]: 2.269e-05 [recompute_prepare]: 8.78001e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.43e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.80998e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 3.97e-06 [cell_reuse_recompute_pass]: 1.77001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.652e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 2.88e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00081333 [add_forward_monad_depend]: 7.75998e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.782e-05 [cse]: 2.938e-05 [replace_applicator]: 1.306e-05 [Cycle 2]: 0.00038284, [27] [switch_simplify]: 5.89999e-06 [loop_unroll]: 4.95999e-06 [a_1]: 9.039e-05 [with_stream_mark]: 1.092e-05 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.27001e-06 [updatestate_useless_node_eliminater]: 4.245e-05 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 3.38e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 8.87e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.10999e-06 [inline_without_move]: 5.04998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 2.84999e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 8.27e-06 [cse]: 1.41e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.319e-05 [rewriter_after_opt_a]: 3.839e-05 [convert_after_rewriter]: 7.55998e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00061154 [jit_opt_b]: 5.348e-05, [1] [Cycle 1]: 4.579e-05, [2] [frontend_op_eliminate]: 1.693e-05 [inline_after_opt_a]: 1.608e-05 [cconv]: 2.998e-05 [loop_unroll]: 0.00046545 [jit_opt_after_cconv]: 0.00017821, [1] [Cycle 1]: 0.00016973, [11] [c_1]: 2.247e-05 [parameter_eliminate]: 4.45999e-06 [updatestate_depend_eliminate]: 7.33999e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 2.63003e-06 [cse]: 2.316e-05 [call_graph_tuple_transform]: 2.242e-05 [tuple_list_get_item_eliminator]: 6.18002e-06 [none_parameter_eliminate]: 1.99999e-06 [renormalize]: 6.80011e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.695e-05 [partial_unused_args_eliminate]: 2.42001e-06 [environ_conv]: 6.34001e-06 [add_recomputation]: 5.184e-05 [cse_after_recomputation]: 2.597e-05, [1] [Cycle 1]: 1.933e-05, [1] [cse]: 1.214e-05 [auto_monad_reorder]: 1.69e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 6.37001e-06 [opt_after_jit_grad]: 0.00052042 [symbol_engine_optimizer]: 8.158e-05, [1] [Cycle 1]: 7.435e-05, [6] [build]: 3.64002e-06 [elim_shapecalc]: 8.99998e-06 [elim_not_effective]: 1.573e-05 [opt_reshape]: 5.95002e-06 [fold_const_symbol]: 9.27001e-06 [renormalize]: 6.69999e-07 [validate]: 4.199e-05 Sums bootstrap : 0.000302s : 3.15% type_inference : 0.005080s : 53.07% event_method : 0.000020s : 0.21% auto_monad : 0.000072s : 0.76% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000047s : 0.49% rewriter_before_opt_a : 0.000074s : 0.77% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.72% jit_opt_a.loop_unroll : 0.000036s : 0.37% jit_opt_a.a_1 : 0.000673s : 7.03% jit_opt_a.with_stream_mark : 0.000034s : 0.35% jit_opt_a.recompute_prepare : 0.000015s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000048s : 0.50% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.20% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.11% jit_opt_a.renormalize : 0.000813s : 8.50% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.11% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.27% jit_opt_a.cse : 0.000043s : 0.45% jit_opt_a.replace_applicator : 0.000019s : 0.20% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000038s : 0.40% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000612s : 6.39% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000030s : 0.31% loop_unroll : 0.000465s : 4.86% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000052s : 0.54% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000017s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000520s : 5.44% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000042s : 0.44% Time group info: ------[substitution.] 0.000239 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.73% : 0.000007s : 3: substitution.graph_param_transform 84.17% : 0.000201s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.11% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000005s : 2: substitution.replace_old_param 5.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005011 2 81.05% : 0.004062s : 1: type_inference.infer 18.95% : 0.000950s : 1: type_inference.specialize ------[replace.] 0.000078 6 64.17% : 0.000050s : 4: replace.inline 35.83% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 6 94.31% : 0.000197s : 4: match.inline 5.69% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 691 1.09% : 0.000001s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.05% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.68% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.20% : 0.000000s : 3: predicate.fold_const_symbol 0.83% : 0.000001s : 6: predicate.get_grad_eliminate 0.39% : 0.000001s : 3: predicate.graph_param_transform 5.81% : 0.000007s : 22: predicate.inline 0.79% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.31% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 15: predicate.load_eliminater 2.27% : 0.000003s : 3: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 0.98% : 0.000001s : 10: predicate.minmaximum_grad 2.50% : 0.000003s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.56% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 1.54% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.95% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.12% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.01% : 0.000001s : 10: predicate.same_eliminate 0.81% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.25% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.61% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000010s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.49% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.18% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000713 13 50.61% : 0.000361s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.99% : 0.000050s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.40% : 0.000302s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015612 72 0.35% : 0.000055s : 1: add_recomputation 0.49% : 0.000076s : 1: auto_monad 0.13% : 0.000020s : 1: auto_monad_reorder 2.03% : 0.000317s : 1: bootstrap 0.21% : 0.000032s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.36% : 0.005832s : 1: jit_opt_a 1.16% : 0.000181s : 1: jit_opt_after_cconv 0.36% : 0.000056s : 1: jit_opt_b 3.05% : 0.000476s : 1: loop_unroll 3.99% : 0.000623s : 1: mutable_eliminate 6.01% : 0.000939s : 26: opt.transform.jit_opt_a 0.34% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.11% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000017s : 1: opt.transform.mutable_eliminate 0.17% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.41% : 0.000533s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000049s : 1: py_interpret_to_execute 0.10% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000019s : 1: remove_dup_value 2.83% : 0.000442s : 1: renormalize.infer 2.32% : 0.000362s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000042s : 1: rewriter_after_opt_a 0.49% : 0.000077s : 1: rewriter_before_opt_a 0.54% : 0.000085s : 1: symbol_engine_optimizer 32.63% : 0.005094s : 1: type_inference TotalTime = 0.0164763, [30] [bootstrap]: 0.00032965 [type_inference]: 0.00840459 [event_method]: 2.091e-05 [auto_monad]: 6.693e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.38002e-06 [py_interpret_to_execute]: 4.142e-05 [rewriter_before_opt_a]: 8.149e-05 [expand_dump_flag]: 2.90998e-06 [jit_opt_a]: 0.00545977, [2] [Cycle 1]: 0.00180062, [27] [switch_simplify]: 6.087e-05 [loop_unroll]: 3.326e-05 [a_1]: 0.0006334 [with_stream_mark]: 1.887e-05 [recompute_prepare]: 8.32998e-06 [updatestate_depend_eliminate]: 3.87998e-06 [updatestate_assign_eliminate]: 3.32002e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.66998e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 4.20999e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00072156 [add_forward_monad_depend]: 4.89e-06 [auto_monad_grad]: 2.53e-06 [auto_monad_eliminator]: 1.56e-05 [cse]: 3.197e-05 [replace_applicator]: 1.304e-05 [Cycle 2]: 0.00032341, [27] [switch_simplify]: 6.21998e-06 [loop_unroll]: 5.08002e-06 [a_1]: 9.663e-05 [with_stream_mark]: 1.008e-05 [recompute_prepare]: 5.15999e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.049e-05 [j_node_and_user_rematch]: 7.72998e-06 [meta_fg_expand]: 1.63002e-06 [replace_old_param]: 6.59001e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.238e-05 [replace_applicator]: 5.17e-06 [py_interpret_to_execute_after_opt_a]: 1.132e-05 [rewriter_after_opt_a]: 3.636e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00051044 [jit_opt_b]: 4.968e-05, [1] [Cycle 1]: 4.225e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 2.557e-05 [loop_unroll]: 0.0004075 [jit_opt_after_cconv]: 0.00014934, [1] [Cycle 1]: 0.00014299, [11] [c_1]: 1.991e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 6.42001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.22e-05 [call_graph_tuple_transform]: 2.444e-05 [tuple_list_get_item_eliminator]: 5.86998e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 5.37001e-06 [remove_dup_value]: 4.018e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 5.15001e-06 [add_recomputation]: 4.821e-05 [cse_after_recomputation]: 2.435e-05, [1] [Cycle 1]: 1.85e-05, [1] [cse]: 1.272e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 4.57003e-06 [opt_after_jit_grad]: 0.00044309 [symbol_engine_optimizer]: 7.034e-05, [1] [Cycle 1]: 6.413e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.213e-05 [opt_reshape]: 5.56e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 4.7998e-07 [validate]: 3.643e-05 Sums bootstrap : 0.000330s : 2.62% type_inference : 0.008405s : 66.83% event_method : 0.000021s : 0.17% auto_monad : 0.000067s : 0.53% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.33% rewriter_before_opt_a : 0.000081s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000067s : 0.53% jit_opt_a.loop_unroll : 0.000038s : 0.30% jit_opt_a.a_1 : 0.000730s : 5.80% jit_opt_a.with_stream_mark : 0.000029s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000722s : 5.74% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.17% jit_opt_a.cse : 0.000044s : 0.35% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000036s : 0.29% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000510s : 4.06% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.12% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.20% loop_unroll : 0.000407s : 3.24% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.04% remove_dup_value : 0.000040s : 0.32% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000048s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.10% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000443s : 3.52% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.29% Time group info: ------[substitution.] 0.000261 27 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 4.58% : 0.000012s : 3: substitution.graph_param_transform 81.46% : 0.000213s : 5: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.08% : 0.000011s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.51% : 0.000004s : 2: substitution.replace_old_param 3.98% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008326 2 88.48% : 0.007367s : 1: type_inference.infer 11.52% : 0.000959s : 1: type_inference.specialize ------[replace.] 0.000086 7 67.20% : 0.000057s : 5: replace.inline 32.80% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000219 7 95.79% : 0.000210s : 5: match.inline 4.21% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.31% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.26% : 0.000002s : 11: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.39% : 0.000002s : 11: predicate.depend_value_elim 1.18% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.27% : 0.000002s : 11: predicate.environ_get_eliminate 1.29% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000006s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.72% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 16: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 11: predicate.merge_addn 1.21% : 0.000001s : 11: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 16: predicate.partial_eliminate 1.11% : 0.000001s : 11: predicate.print_const_string_wrapper 2.20% : 0.000003s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 19: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.65% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.20% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.26% : 0.000002s : 11: predicate.transpose_eliminate 1.51% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.70% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000817 16 53.14% : 0.000434s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.46% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 38.40% : 0.000314s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018210 72 0.28% : 0.000051s : 1: add_recomputation 0.39% : 0.000070s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.89% : 0.000344s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.00% : 0.005462s : 1: jit_opt_a 0.84% : 0.000153s : 1: jit_opt_after_cconv 0.29% : 0.000052s : 1: jit_opt_b 2.28% : 0.000415s : 1: loop_unroll 2.85% : 0.000519s : 1: mutable_eliminate 5.22% : 0.000951s : 26: opt.transform.jit_opt_a 0.29% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.48% : 0.000451s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.24% : 0.000043s : 1: remove_dup_value 2.27% : 0.000413s : 1: renormalize.infer 1.66% : 0.000301s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000039s : 1: rewriter_after_opt_a 0.46% : 0.000084s : 1: rewriter_before_opt_a 0.40% : 0.000073s : 1: symbol_engine_optimizer 46.24% : 0.008420s : 1: type_inference TotalTime = 0.124806, [30] [bootstrap]: 0.00029457 [type_inference]: 0.112487 [event_method]: 2.611e-05 [auto_monad]: 7.692e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.00045909 [rewriter_before_opt_a]: 9.989e-05 [expand_dump_flag]: 3.57002e-06 [jit_opt_a]: 0.00837245, [2] [Cycle 1]: 0.00419234, [27] [switch_simplify]: 6.459e-05 [loop_unroll]: 3.368e-05 [a_1]: 0.00074461 [with_stream_mark]: 2.212e-05 [recompute_prepare]: 1.024e-05 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 7.31001e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 7.16999e-06 [merge_forward]: 4.07e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.745e-05 [j_node_and_user_rematch]: 1.053e-05 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.64001e-06 [renormalize]: 0.00292051 [add_forward_monad_depend]: 9.62999e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.894e-05 [cse]: 3.824e-05 [replace_applicator]: 2.214e-05 [Cycle 2]: 0.00046247, [27] [switch_simplify]: 7.53999e-06 [loop_unroll]: 6.47001e-06 [a_1]: 0.00013308 [with_stream_mark]: 1.668e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 2.23998e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 6.53998e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.81001e-06 [cell_reuse_recompute_pass]: 2.98998e-06 [cell_reuse_handle_not_recompute_node_pass]: 4.611e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 6.09001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 2.71999e-06 [auto_monad_grad]: 1.51002e-06 [auto_monad_eliminator]: 8.74e-06 [cse]: 1.988e-05 [replace_applicator]: 7.75998e-06 [py_interpret_to_execute_after_opt_a]: 1.55e-05 [rewriter_after_opt_a]: 4.376e-05 [convert_after_rewriter]: 7.79002e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00079818 [jit_opt_b]: 6.891e-05, [1] [Cycle 1]: 5.891e-05, [2] [frontend_op_eliminate]: 2.067e-05 [inline_after_opt_a]: 1.983e-05 [cconv]: 3.65e-05 [loop_unroll]: 0.00059381 [jit_opt_after_cconv]: 0.00020448, [1] [Cycle 1]: 0.00019558, [11] [c_1]: 2.849e-05 [parameter_eliminate]: 6.54999e-06 [updatestate_depend_eliminate]: 1.088e-05 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 4.49998e-06 [cse]: 4.411e-05 [call_graph_tuple_transform]: 2.803e-05 [tuple_list_get_item_eliminator]: 7.49002e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 8.50006e-07 [switch_simplify]: 6.13002e-06 [remove_dup_value]: 1.869e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 1.044e-05 [add_recomputation]: 5.664e-05 [cse_after_recomputation]: 3.055e-05, [1] [Cycle 1]: 2.439e-05, [1] [cse]: 1.68e-05 [auto_monad_reorder]: 1.861e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 8.01001e-06 [opt_after_jit_grad]: 0.00058054 [symbol_engine_optimizer]: 0.0001849, [1] [Cycle 1]: 0.00017756, [6] [build]: 4.77e-06 [elim_shapecalc]: 1.363e-05 [elim_not_effective]: 1.726e-05 [opt_reshape]: 6.40002e-06 [fold_const_symbol]: 0.00010176 [renormalize]: 5.79981e-07 [validate]: 5.512e-05 Sums bootstrap : 0.000295s : 0.24% type_inference : 0.112487s : 93.45% event_method : 0.000026s : 0.02% auto_monad : 0.000077s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000459s : 0.38% rewriter_before_opt_a : 0.000100s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000878s : 0.73% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000064s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002921s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000030s : 0.02% py_interpret_to_execute_after_opt_a : 0.000016s : 0.01% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000798s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000036s : 0.03% loop_unroll : 0.000594s : 0.49% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000011s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000044s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000028s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000057s : 0.05% cse_after_recomputation.cse : 0.000017s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000581s : 0.48% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000014s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000102s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.05% Time group info: ------[substitution.] 0.000307 28 0.60% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000006s : 4: substitution.graph_param_transform 83.04% : 0.000255s : 5: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.03% : 0.000015s : 3: substitution.reduce_eliminate 1.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.75% : 0.000005s : 2: substitution.replace_old_param 3.86% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112385 2 97.15% : 0.109179s : 1: type_inference.infer 2.85% : 0.003206s : 1: type_inference.specialize ------[replace.] 0.000110 7 68.61% : 0.000076s : 5: replace.inline 31.39% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 96.10% : 0.000252s : 5: match.inline 3.90% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000151 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 1.33% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000002s : 13: predicate.addn_check_dump 1.59% : 0.000002s : 13: predicate.addn_zero_filter 2.09% : 0.000003s : 13: predicate.arithmetic_simplify 1.12% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000001s : 13: predicate.compare_switch_simplify 1.12% : 0.000002s : 13: predicate.depend_value_elim 1.04% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.12% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.00% : 0.000002s : 13: predicate.environ_get_depend_swap 1.10% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.85% : 0.000009s : 28: predicate.inline 1.00% : 0.000002s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.69% : 0.000003s : 19: predicate.load_eliminater 2.41% : 0.000004s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.04% : 0.000002s : 13: predicate.merge_addn 1.02% : 0.000002s : 13: predicate.minmaximum_grad 2.64% : 0.000004s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.11% : 0.000003s : 13: predicate.reduce_eliminate 1.28% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 23: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.48% : 0.000002s : 13: predicate.reshape_eliminate 1.16% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 13: predicate.same_eliminate 1.20% : 0.000002s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000002s : 8: predicate.specialize_transform 1.61% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 20: predicate.switch_defer_inline 2.05% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.20% : 0.000011s : 64: predicate.switch_simplify 1.18% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.64% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002518 25 65.54% : 0.001650s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.58% : 0.000090s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.88% : 0.000778s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129079 72 0.05% : 0.000060s : 1: add_recomputation 0.06% : 0.000081s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000312s : 1: bootstrap 0.03% : 0.000040s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.03% : 0.000033s : 1: cse_after_recomputation 0.01% : 0.000014s : 1: environ_conv 0.02% : 0.000031s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.49% : 0.008377s : 1: jit_opt_a 0.16% : 0.000208s : 1: jit_opt_after_cconv 0.06% : 0.000072s : 1: jit_opt_b 0.47% : 0.000610s : 1: loop_unroll 0.63% : 0.000814s : 1: mutable_eliminate 0.91% : 0.001175s : 26: opt.transform.jit_opt_a 0.05% : 0.000066s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000024s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000025s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000132s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000594s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000469s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.62% : 0.002096s : 1: renormalize.infer 0.63% : 0.000812s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000049s : 1: rewriter_after_opt_a 0.08% : 0.000107s : 1: rewriter_before_opt_a 0.15% : 0.000188s : 1: symbol_engine_optimizer 87.17% : 0.112512s : 1: type_inference TotalTime = 0.121965, [30] [bootstrap]: 0.0002779 [type_inference]: 0.110389 [event_method]: 2.238e-05 [auto_monad]: 7.371e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.29999e-06 [py_interpret_to_execute]: 0.00050446 [rewriter_before_opt_a]: 9.147e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00795867, [2] [Cycle 1]: 0.00396896, [27] [switch_simplify]: 6.357e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.00060378 [with_stream_mark]: 2.204e-05 [recompute_prepare]: 8.89e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 6.40002e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.38998e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.98e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00287316 [add_forward_monad_depend]: 8.74e-06 [auto_monad_grad]: 2.59999e-06 [auto_monad_eliminator]: 1.782e-05 [cse]: 3.186e-05 [replace_applicator]: 1.996e-05 [Cycle 2]: 0.00038591, [27] [switch_simplify]: 7.3e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00013148 [with_stream_mark]: 1.147e-05 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 6.21998e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 3.29001e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.803e-05 [j_node_and_user_rematch]: 8.87999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 5.91e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.44e-06 [auto_monad_eliminator]: 6.64001e-06 [cse]: 1.194e-05 [replace_applicator]: 6.28998e-06 [py_interpret_to_execute_after_opt_a]: 1.317e-05 [rewriter_after_opt_a]: 3.539e-05 [convert_after_rewriter]: 7.65998e-06 [order_py_execute_after_rewriter]: 1.275e-05 [mutable_eliminate]: 0.00071813 [jit_opt_b]: 6.065e-05, [1] [Cycle 1]: 5.31e-05, [2] [frontend_op_eliminate]: 2.084e-05 [inline_after_opt_a]: 2.035e-05 [cconv]: 2.852e-05 [loop_unroll]: 0.00050341 [jit_opt_after_cconv]: 0.00017231, [1] [Cycle 1]: 0.00016436, [11] [c_1]: 2.852e-05 [parameter_eliminate]: 4.43001e-06 [updatestate_depend_eliminate]: 6.64999e-06 [updatestate_assign_eliminate]: 2.70002e-06 [updatestate_loads_eliminate]: 2.35002e-06 [cse]: 2.578e-05 [call_graph_tuple_transform]: 2.544e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.61998e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 8.62998e-06 [remove_dup_value]: 2.631e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 9.51e-06 [add_recomputation]: 5.517e-05 [cse_after_recomputation]: 2.455e-05, [1] [Cycle 1]: 1.883e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.604e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 9.969e-05 [opt_after_jit_grad]: 0.00050738 [symbol_engine_optimizer]: 8.336e-05, [1] [Cycle 1]: 7.697e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 9.31998e-06 [elim_not_effective]: 1.554e-05 [opt_reshape]: 7.48e-06 [fold_const_symbol]: 1.069e-05 [renormalize]: 3.80009e-07 [validate]: 4.589e-05 Sums bootstrap : 0.000278s : 0.24% type_inference : 0.110389s : 93.77% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000504s : 0.43% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000735s : 0.62% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002873s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000013s : 0.01% mutable_eliminate : 0.000718s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000503s : 0.43% jit_opt_after_cconv.c_1 : 0.000029s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000009s : 0.01% remove_dup_value : 0.000026s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000100s : 0.08% opt_after_jit_grad : 0.000507s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000221 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000007s : 4: substitution.graph_param_transform 83.27% : 0.000184s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.82% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000005s : 2: substitution.replace_old_param 5.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110302 2 97.38% : 0.107413s : 1: type_inference.infer 2.62% : 0.002889s : 1: type_inference.specialize ------[replace.] 0.000081 6 67.30% : 0.000054s : 4: replace.inline 32.70% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 94.28% : 0.000181s : 4: match.inline 5.72% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.39% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.12% : 0.000002s : 12: predicate.addn_zero_filter 2.44% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.13% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.64% : 0.000001s : 4: predicate.graph_param_transform 5.54% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.72% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.85% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.86% : 0.000003s : 22: predicate.replace_applicator 1.23% : 0.000002s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.67% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 1.88% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.97% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.52% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002371 22 65.60% : 0.001556s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.08% : 0.000784s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125911 72 0.05% : 0.000058s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000295s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.32% : 0.007962s : 1: jit_opt_a 0.14% : 0.000175s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.41% : 0.000514s : 1: loop_unroll 0.58% : 0.000730s : 1: mutable_eliminate 0.78% : 0.000987s : 26: opt.transform.jit_opt_a 0.05% : 0.000065s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000015s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000513s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000030s : 1: remove_dup_value 1.61% : 0.002029s : 1: renormalize.infer 0.66% : 0.000834s : 1: renormalize.specialize 0.08% : 0.000103s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 87.69% : 0.110414s : 1: type_inference TotalTime = 0.125347, [30] [bootstrap]: 0.00033888 [type_inference]: 0.114456 [event_method]: 2.177e-05 [auto_monad]: 6.991e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.57001e-06 [py_interpret_to_execute]: 0.00043893 [rewriter_before_opt_a]: 9.488e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00766323, [2] [Cycle 1]: 0.00393957, [27] [switch_simplify]: 6.152e-05 [loop_unroll]: 3.486e-05 [a_1]: 0.00068809 [with_stream_mark]: 2.098e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 4.45e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 7.15e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.26998e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.24003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00277605 [add_forward_monad_depend]: 7.26999e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.706e-05 [cse]: 3.393e-05 [replace_applicator]: 1.65e-05 [Cycle 2]: 0.00037791, [27] [switch_simplify]: 6.70998e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00013031 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 6.61999e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.11998e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.63002e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 4.44002e-06 [cell_reuse_recompute_pass]: 2.48e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.285e-05 [j_node_and_user_rematch]: 8.76002e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.50002e-06 [cse]: 1.323e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.204e-05 [rewriter_after_opt_a]: 3.814e-05 [convert_after_rewriter]: 6.94999e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.0006502 [jit_opt_b]: 5.481e-05, [1] [Cycle 1]: 4.77e-05, [2] [frontend_op_eliminate]: 1.872e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 2.624e-05 [loop_unroll]: 0.0004208 [jit_opt_after_cconv]: 0.00015414, [1] [Cycle 1]: 0.00014748, [11] [c_1]: 2.533e-05 [parameter_eliminate]: 2.58003e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 2.442e-05 [call_graph_tuple_transform]: 2.169e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.58002e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.673e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 7.88001e-06 [add_recomputation]: 4.823e-05 [cse_after_recomputation]: 2.371e-05, [1] [Cycle 1]: 1.835e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.756e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 4.57e-06 [opt_after_jit_grad]: 0.00046299 [symbol_engine_optimizer]: 7.982e-05, [1] [Cycle 1]: 7.362e-05, [6] [build]: 4.38999e-06 [elim_shapecalc]: 8.43999e-06 [elim_not_effective]: 1.378e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 1.086e-05 [renormalize]: 5.99975e-07 [validate]: 4.567e-05 Sums bootstrap : 0.000339s : 0.28% type_inference : 0.114456s : 94.27% event_method : 0.000022s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000439s : 0.36% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000818s : 0.67% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002776s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000650s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000421s : 0.35% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000463s : 0.38% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000273 28 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000006s : 4: substitution.graph_param_transform 83.42% : 0.000228s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.25% : 0.000012s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000005s : 2: substitution.replace_old_param 3.91% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114379 2 97.43% : 0.111441s : 1: type_inference.infer 2.57% : 0.002938s : 1: type_inference.specialize ------[replace.] 0.000095 7 68.68% : 0.000065s : 5: replace.inline 31.32% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000234 7 95.95% : 0.000224s : 5: match.inline 4.05% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.44% : 0.000002s : 13: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.19% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.54% : 0.000008s : 28: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 2.34% : 0.000003s : 13: predicate.reduce_eliminate 1.67% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 13: predicate.reshape_eliminate 1.34% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.71% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.22% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002475 25 65.91% : 0.001631s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.06% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.03% : 0.000768s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129258 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.27% : 0.000351s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.93% : 0.007667s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.33% : 0.000429s : 1: loop_unroll 0.51% : 0.000659s : 1: mutable_eliminate 0.82% : 0.001061s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.34% : 0.000445s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.54% : 0.001994s : 1: renormalize.infer 0.60% : 0.000773s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 88.56% : 0.114473s : 1: type_inference TotalTime = 0.121609, [30] [bootstrap]: 0.00030565 [type_inference]: 0.110874 [event_method]: 1.877e-05 [auto_monad]: 6.846e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00046026 [rewriter_before_opt_a]: 8.347e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00718617, [2] [Cycle 1]: 0.00350466, [27] [switch_simplify]: 5.336e-05 [loop_unroll]: 3.021e-05 [a_1]: 0.00055744 [with_stream_mark]: 2.051e-05 [recompute_prepare]: 9.76998e-06 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.12002e-06 [parameter_eliminate]: 2.14999e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 9.99999e-06 [inline_without_move]: 5.93002e-06 [renormalize]: 0.00248658 [add_forward_monad_depend]: 7.61999e-06 [auto_monad_grad]: 2.79001e-06 [auto_monad_eliminator]: 1.769e-05 [cse]: 2.935e-05 [replace_applicator]: 1.72e-05 [Cycle 2]: 0.00037405, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.00012365 [with_stream_mark]: 1.308e-05 [recompute_prepare]: 5.83997e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.84998e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.37002e-06 [cell_reuse_recompute_pass]: 2.21998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.741e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.46002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.93002e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.46e-06 [cse]: 1.236e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 1.223e-05 [rewriter_after_opt_a]: 3.559e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 6.47001e-06 [mutable_eliminate]: 0.00070259 [jit_opt_b]: 5.758e-05, [1] [Cycle 1]: 5.054e-05, [2] [frontend_op_eliminate]: 2.036e-05 [inline_after_opt_a]: 1.915e-05 [cconv]: 2.798e-05 [loop_unroll]: 0.00044326 [jit_opt_after_cconv]: 0.00016984, [1] [Cycle 1]: 0.00016237, [11] [c_1]: 2.652e-05 [parameter_eliminate]: 4.58999e-06 [updatestate_depend_eliminate]: 6.59001e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.915e-05 [call_graph_tuple_transform]: 2.268e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 1.15999e-06 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.778e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 9.61e-06 [add_recomputation]: 5.466e-05 [cse_after_recomputation]: 2.756e-05, [1] [Cycle 1]: 1.928e-05, [1] [cse]: 1.273e-05 [auto_monad_reorder]: 1.532e-05 [get_jit_bprop_graph]: 1.49e-06 [rewriter_after_jit_bprop_graph]: 6.37001e-06 [opt_after_jit_grad]: 0.00053901 [symbol_engine_optimizer]: 0.00018769, [1] [Cycle 1]: 0.00018019, [6] [build]: 4.00998e-06 [elim_shapecalc]: 9.87999e-06 [elim_not_effective]: 0.00011581 [opt_reshape]: 6.91001e-06 [fold_const_symbol]: 1.054e-05 [renormalize]: 7.50006e-07 [validate]: 4.888e-05 Sums bootstrap : 0.000306s : 0.26% type_inference : 0.110874s : 94.24% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000460s : 0.39% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000681s : 0.58% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002487s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000703s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000443s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000055s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000539s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000116s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000200 24 1.12% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.08% : 0.000006s : 4: substitution.graph_param_transform 80.71% : 0.000161s : 4: substitution.inline 2.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.07% : 0.000006s : 4: substitution.remove_not_recompute_node 2.61% : 0.000005s : 2: substitution.replace_old_param 6.70% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110798 2 97.46% : 0.107988s : 1: type_inference.infer 2.54% : 0.002810s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.25% : 0.000046s : 4: replace.inline 32.75% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 92.93% : 0.000158s : 4: match.inline 7.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.52% : 0.000002s : 12: predicate.accumulaten_eliminater 1.78% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.73% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 5.39% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.77% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.11% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.73% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.06% : 0.000010s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.30% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002188 22 69.25% : 0.001515s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.42% : 0.000644s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125154 72 0.05% : 0.000058s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000326s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.74% : 0.007190s : 1: jit_opt_a 0.14% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000453s : 1: loop_unroll 0.57% : 0.000711s : 1: mutable_eliminate 0.73% : 0.000914s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000030s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000140s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000466s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.41% : 0.001762s : 1: renormalize.infer 0.57% : 0.000715s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.15% : 0.000191s : 1: symbol_engine_optimizer 88.60% : 0.110891s : 1: type_inference TotalTime = 0.0162489, [30] [bootstrap]: 0.00029767 [type_inference]: 0.0078085 [event_method]: 1.858e-05 [auto_monad]: 7.165e-05 [graph_reusing]: 5.86998e-06 [pre_auto_parallel]: 2.08002e-06 [py_interpret_to_execute]: 4.114e-05 [rewriter_before_opt_a]: 7.678e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00574651, [2] [Cycle 1]: 0.00192194, [27] [switch_simplify]: 5.552e-05 [loop_unroll]: 3.311e-05 [a_1]: 0.00065214 [with_stream_mark]: 1.916e-05 [recompute_prepare]: 1.03e-05 [updatestate_depend_eliminate]: 4.2e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 2.08002e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.56e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 9.16002e-06 [inline_without_move]: 5.71e-06 [renormalize]: 0.0008241 [add_forward_monad_depend]: 6.23e-06 [auto_monad_grad]: 2.17001e-06 [auto_monad_eliminator]: 1.364e-05 [cse]: 2.854e-05 [replace_applicator]: 1.293e-05 [Cycle 2]: 0.0003286, [27] [switch_simplify]: 6.06e-06 [loop_unroll]: 5.00999e-06 [a_1]: 9.632e-05 [with_stream_mark]: 1.123e-05 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.94e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.123e-05 [j_node_and_user_rematch]: 7.73999e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.11999e-06 [inline_without_move]: 4.84e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.37999e-06 [cse]: 1.318e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.28e-05 [rewriter_after_opt_a]: 3.628e-05 [convert_after_rewriter]: 6.24001e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00061375 [jit_opt_b]: 4.993e-05, [1] [Cycle 1]: 4.278e-05, [2] [frontend_op_eliminate]: 1.548e-05 [inline_after_opt_a]: 1.628e-05 [cconv]: 2.304e-05 [loop_unroll]: 0.00045922 [jit_opt_after_cconv]: 0.00014609, [1] [Cycle 1]: 0.00013975, [11] [c_1]: 2.103e-05 [parameter_eliminate]: 2.88998e-06 [updatestate_depend_eliminate]: 6.25002e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.63e-06 [cse]: 2.246e-05 [call_graph_tuple_transform]: 1.766e-05 [tuple_list_get_item_eliminator]: 5.43002e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.75001e-06 [remove_dup_value]: 1.297e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 5.50001e-06 [add_recomputation]: 4.316e-05 [cse_after_recomputation]: 2.138e-05, [1] [Cycle 1]: 1.626e-05, [1] [cse]: 1.061e-05 [auto_monad_reorder]: 1.559e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 4.63999e-06 [opt_after_jit_grad]: 0.00045605 [symbol_engine_optimizer]: 7.036e-05, [1] [Cycle 1]: 6.4e-05, [6] [build]: 2.61999e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.289e-05 [opt_reshape]: 5.32999e-06 [fold_const_symbol]: 8.08999e-06 [renormalize]: 3.30008e-07 [validate]: 3.727e-05 Sums bootstrap : 0.000298s : 2.44% type_inference : 0.007808s : 64.05% event_method : 0.000019s : 0.15% auto_monad : 0.000072s : 0.59% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.34% rewriter_before_opt_a : 0.000077s : 0.63% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.51% jit_opt_a.loop_unroll : 0.000038s : 0.31% jit_opt_a.a_1 : 0.000748s : 6.14% jit_opt_a.with_stream_mark : 0.000030s : 0.25% jit_opt_a.recompute_prepare : 0.000016s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000824s : 6.76% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.16% jit_opt_a.cse : 0.000042s : 0.34% jit_opt_a.replace_applicator : 0.000019s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.10% rewriter_after_opt_a : 0.000036s : 0.30% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000614s : 5.03% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000023s : 0.19% loop_unroll : 0.000459s : 3.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.14% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000013s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000043s : 0.35% cse_after_recomputation.cse : 0.000011s : 0.09% auto_monad_reorder : 0.000016s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000456s : 3.74% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.31% Time group info: ------[substitution.] 0.000264 27 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000005s : 3: substitution.graph_param_transform 83.63% : 0.000221s : 5: substitution.inline 1.42% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.29% : 0.000011s : 3: substitution.reduce_eliminate 1.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.61% : 0.000004s : 2: substitution.replace_old_param 4.22% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007745 2 87.79% : 0.006800s : 1: type_inference.infer 12.21% : 0.000945s : 1: type_inference.specialize ------[replace.] 0.000093 7 67.87% : 0.000063s : 5: replace.inline 32.13% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000228 7 95.62% : 0.000218s : 5: match.inline 4.38% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 1.90% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000002s : 11: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.34% : 0.000002s : 11: predicate.depend_value_elim 1.12% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000002s : 11: predicate.environ_get_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000007s : 24: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 16: predicate.load_eliminater 1.05% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.46% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 11: predicate.merge_addn 1.14% : 0.000001s : 11: predicate.minmaximum_grad 1.44% : 0.000002s : 3: predicate.mutable_eliminate 0.38% : 0.000000s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 1.81% : 0.000002s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 11: predicate.same_eliminate 0.79% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 1.20% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.72% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.24% : 0.000010s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.23% : 0.000001s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.54% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000775 16 48.70% : 0.000377s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.80% : 0.000076s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.50% : 0.000321s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018100 72 0.25% : 0.000046s : 1: add_recomputation 0.42% : 0.000075s : 1: auto_monad 0.10% : 0.000018s : 1: auto_monad_reorder 1.71% : 0.000310s : 1: bootstrap 0.14% : 0.000026s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.13% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.12% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 31.77% : 0.005751s : 1: jit_opt_a 0.82% : 0.000149s : 1: jit_opt_after_cconv 0.29% : 0.000052s : 1: jit_opt_b 2.58% : 0.000467s : 1: loop_unroll 3.44% : 0.000622s : 1: mutable_eliminate 5.36% : 0.000969s : 26: opt.transform.jit_opt_a 0.26% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.56% : 0.000464s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000015s : 1: remove_dup_value 2.73% : 0.000494s : 1: renormalize.infer 1.77% : 0.000321s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000039s : 1: rewriter_after_opt_a 0.44% : 0.000080s : 1: rewriter_before_opt_a 0.40% : 0.000073s : 1: symbol_engine_optimizer 43.20% : 0.007819s : 1: type_inference TotalTime = 0.121257, [30] [bootstrap]: 0.0003104 [type_inference]: 0.110189 [event_method]: 2.097e-05 [auto_monad]: 7.427e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00048161 [rewriter_before_opt_a]: 9.163e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.00763556, [2] [Cycle 1]: 0.00370914, [27] [switch_simplify]: 6.044e-05 [loop_unroll]: 3.223e-05 [a_1]: 0.00062248 [with_stream_mark]: 1.886e-05 [recompute_prepare]: 9.65002e-06 [updatestate_depend_eliminate]: 4.57e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 6.21998e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 6.43e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 1.15e-05 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 1.044e-05 [inline_without_move]: 7.25e-06 [renormalize]: 0.00259139 [add_forward_monad_depend]: 9.20999e-06 [auto_monad_grad]: 2.73e-06 [auto_monad_eliminator]: 1.899e-05 [cse]: 3.073e-05 [replace_applicator]: 2.078e-05 [Cycle 2]: 0.00038266, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 6.01e-06 [a_1]: 0.00012653 [with_stream_mark]: 1.237e-05 [recompute_prepare]: 6.48998e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.13998e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.73e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.703e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 9.34e-06 [inline_without_move]: 6.01e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.96999e-06 [cse]: 1.092e-05 [replace_applicator]: 6.41998e-06 [py_interpret_to_execute_after_opt_a]: 1.266e-05 [rewriter_after_opt_a]: 4.184e-05 [convert_after_rewriter]: 7.7e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00069391 [jit_opt_b]: 5.602e-05, [1] [Cycle 1]: 4.808e-05, [2] [frontend_op_eliminate]: 1.868e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 2.652e-05 [loop_unroll]: 0.00045082 [jit_opt_after_cconv]: 0.00015294, [1] [Cycle 1]: 0.0001464, [11] [c_1]: 2.551e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 6.04001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.79001e-06 [cse]: 2.224e-05 [call_graph_tuple_transform]: 2.15e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.38002e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.53e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 7.83999e-06 [add_recomputation]: 4.703e-05 [cse_after_recomputation]: 2.158e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.069e-05 [auto_monad_reorder]: 1.53e-05 [get_jit_bprop_graph]: 2.22001e-06 [rewriter_after_jit_bprop_graph]: 5.11997e-06 [opt_after_jit_grad]: 0.00049978 [symbol_engine_optimizer]: 0.00013172, [1] [Cycle 1]: 0.00012435, [6] [build]: 3.43999e-06 [elim_shapecalc]: 9.12999e-06 [eli TotalTime = 0.120934, [30] [bootstrap]: 0.00029341 [type_inference]: 0.110019 [event_method]: 2.096e-05 [auto_monad]: 4.829e-05 [graph_reusing]: 4.07e-06 [pre_auto_parallel]: 1.89e-06 [py_interpret_to_execute]: 0.00043589 [rewriter_before_opt_a]: 8.481e-05 [expand_dump_flag]: 2.26e-06 [jit_opt_a]: 0.00779381, [2] [Cycle 1]: 0.00391366, [27] [switch_simplify]: 6.379e-05 [loop_unroll]: 3.528e-05 [a_1]: 0.00071553 [with_stream_mark]: 1.372e-05 [recompute_prepare]: 8.50999e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.19003e-06 [specialize_transform]: 7.96001e-06 [updatestate_useless_node_eliminater]: 6.61e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 6.89001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 1.98002e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00274215 [add_forward_monad_depend]: 6.13002e-06 [auto_monad_grad]: 1.94999e-06 [auto_monad_eliminator]: 1.411e-05 [cse]: 2.364e-05 [replace_applicator]: 1.588e-05 [Cycle 2]: 0.00038746, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.17999e-06 [a_1]: 0.00013276 [with_stream_mark]: 1.02e-05 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.23998e-06 [cell_reuse_recompute_pass]: 1.82001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.178e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 6.01e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.93002e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 6.44999e-06 [cse]: 1.405e-05 [replace_applicator]: 7.05e-06 [py_interpret_to_execute_after_opt_a]: 1.068e-05 [rewriter_after_opt_a]: 3.178e-05 [convert_after_rewriter]: 5.57001e-06 [order_py_execute_after_rewriter]: 4.48999e-06 [mutable_eliminate]: 0.0005851 [jit_opt_b]: 6.011e-05, [1] [Cycle 1]: 5.348e-05, [2] [frontend_op_eliminate]: 2.34e-05 [inline_after_opt_a]: 1.786e-05 [cconv]: 1.733e-05 [loop_unroll]: 0.00044365 [jit_opt_after_cconv]: 0.00015489, [1] [Cycle 1]: 0.00014768, [11] [c_1]: 2.628e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 3.84002e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.411e-05 [call_graph_tuple_transform]: 1.812e-05 [tuple_list_get_item_eliminator]: 6.06998e-06 [none_parameter_eliminate]: 1.22e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 6.05002e-06 [remove_dup_value]: 9.52999e-06 [partial_unused_args_eliminate]: 1.38002e-06 [environ_conv]: 7.77998e-06 [add_recomputation]: 3.217e-05 [cse_after_recomputation]: 2.665e-05, [1] [Cycle 1]: 1.982e-05, [1] [cse]: 1.265e-05 [auto_monad_reorder]: 1.202e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.20999e-06 [opt_after_jit_grad]: 0.0004778 [symbol_engine_optimizer]: 7.802e-05, [1] [Cycle 1]: 7.195e-05, [6] [build]: 3.11001e-06 [elim_shapecalc]m_not_effective]: 6.505e-05 [opt_reshape]: 7.25e-06 [fold_const_symbol]: 1.096e-05 [renormalize]: 4.59986e-07 [validate]: 4.476e-05 Sums bootstrap : 0.000310s : 0.27% type_inference : 0.110189s : 94.11% event_method : 0.000021s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000482s : 0.41% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000749s : 0.64% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002591s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000694s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000451s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% envi: 8.37998e-06 [elim_not_effective]: 1.52e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 6.89994e-07 [validate]: 9.176e-05 Sums bootstrap : 0.000293s : 0.25% type_inference : 0.110019s : 94.17% event_method : 0.000021s : 0.02% auto_monad : 0.000048s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000436s : 0.37% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000848s : 0.73% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002742s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000585s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.01% loop_unroll : 0.000444s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : ron_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000500s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000065s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% 0.000001s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000478s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000092s : 0.08% Time group info: ------[substitution.] 0.000262 28 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.43% : 0.000004s : 4: substitution.graph_param_transform 86.38% : 0.000226s : 5: substitution.inline 1.11% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.34% : 0.000011s : 3: substitution.reduce_eliminate 1.48% : 0.000004s : 4: substitution.remove_not_recompute_node 1.24% : 0.000003s : 2: substitution.replace_old_param 2.89% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109950 2 97.36% : 0.107046s : 1: type_inference.infer 2.64% : 0.002904s : 1: type_inference.specialize ------[replace.] 0.000104 7 71.04% : 0.000074s : 5: replace.inline 28.96% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 7 97.22% : 0.000223s : 5: match.inline 2.78% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.15% : 0.000003s : 13: predicate.arithmetic_simplify 1.46% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.25% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.70% : 0.000008s : 28: predicate.inline 1.07% : 0.000002s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.73% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 19: predicate.load_eliminater 1.03% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.17% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.39% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.82% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.93% : 0.000011s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.47% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.13% : 0.000004s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002345 25 64.95% : 0.001523s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.94% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.11% : 0.000753s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124804 72 0.03% : 0.000035s : 1: add_recomputation 0.04% : 0.000052s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000306s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000029s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.25% : 0.007797s : 1: jit_opt_a 0.13% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.36% : 0.000453s : 1: loop_unroll 0.48% : 0.000595s : 1: mutable_eliminate 0.88% : 0.001096s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000487s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000443s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.60% : 0.001998s : 1: renormalize.infer 0.59% : 0.000737s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000081s : 1: symbol_engine_optimizer 88.17% : 0.110034s : 1: type_inference Time group info: ------[substitution.] 0.000275 24 18.53% : 0.000051s : 2: substitution.elim_not_effective 0.36% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000006s : 4: substitution.graph_param_transform 68.02% : 0.000187s : 4: substitution.inline 1.72% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000006s : 2: substitution.replace_old_param 5.22% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110103 2 97.48% : 0.107323s : 1: type_inference.infer 2.52% : 0.002780s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.40% : 0.000056s : 4: replace.inline 31.60% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.34% : 0.000184s : 4: match.inline 6.66% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000002s : 12: predicate.addn_check_dump 1.89% : 0.000003s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 1.01% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.09% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.01% : 0.000001s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000008s : 26: predicate.inline 1.09% : 0.000002s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000002s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.45% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000002s : 12: predicate.print_const_string_wrapper 1.41% : 0.000002s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.66% : 0.000002s : 12: predicate.reshape_eliminate 1.47% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.88% : 0.000011s : 58: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.09% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002286 22 65.99% : 0.001509s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.82% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.20% : 0.000736s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124970 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000329s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.11% : 0.007640s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.37% : 0.000459s : 1: loop_unroll 0.56% : 0.000704s : 1: mutable_eliminate 0.80% : 0.001001s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000089s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000490s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.44% : 0.001799s : 1: renormalize.infer 0.63% : 0.000781s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.11% : 0.000134s : 1: symbol_engine_optimizer 88.19% : 0.110214s : 1: type_inference TotalTime = 0.0123047, [30] [bootstrap]: 0.00028415 [type_inference]: 0.00436573 [event_method]: 1.786e-05 [auto_monad]: 6.933e-05 [graph_reusing]: 5.57001e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 2.182e-05 [rewriter_before_opt_a]: 0.00012724 [expand_dump_flag]: 2.88998e-06 [jit_opt_a]: 0.00530689, [2] [Cycle 1]: 0.00176304, [27] [switch_simplify]: 5.513e-05 [loop_unroll]: 3.09e-05 [a_1]: 0.00053155 [with_stream_mark]: 1.597e-05 [recompute_prepare]: 2.301e-05 [updatestate_depend_eliminate]: 3.99002e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.116e-05 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.743e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.25999e-06 [renormalize]: 0.0007327 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.88998e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 2.93e-05 [replace_applicator]: 1.433e-05 [Cycle 2]: 0.00031657, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 4.96002e-06 [a_1]: 9.037e-05 [with_stream_mark]: 8.87e-06 [recompute_prepare]: 5.48002e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.10002e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 4.82998e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 4.64998e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.304e-05 [j_node_and_user_rematch]: 7.79002e-06 [meta_fg_expand]: 1.78002e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.86998e-06 [cse]: 1.058e-05 [replace_applicator]: 5.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.024e-05 [rewriter_after_opt_a]: 3.3e-05 [convert_after_rewriter]: 6.54999e-06 [order_py_execute_after_rewriter]: 5.11002e-06 [mutable_eliminate]: 0.0005261 [jit_opt_b]: 5.017e-05, [1] [Cycle 1]: 4.254e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.505e-05 [cconv]: 2.779e-05 [loop_unroll]: 0.00046012 [jit_opt_after_cconv]: 0.00014035, [1] [Cycle 1]: 0.00013374, [11] [c_1]: 2.019e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 5.49e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 1.983e-05 [call_graph_tuple_transform]: 1.811e-05 [tuple_list_get_item_eliminator]: 5.39998e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.33002e-06 [remove_dup_value]: 1.535e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 6.21e-06 [add_recomputation]: 4.86e-05 [cse_after_recomputation]: 2.321e-05, [1] [Cycle 1]: 1.79e-05, [1] [cse]: 1.194e-05 [auto_monad_reorder]: 1.432e-05 [get_jit_bprop_graph]: 2.44001e-06 [rewriter_after_jit_bprop_graph]: 5.12999e-06 [opt_after_jit_grad]: 0.00044803 [symbol_engine_optimizer]: 7.011e-05, [1] [Cycle 1]: 6.426e-05, [6] [build]: 2.95998e-06 [elim_shapecalc]: 7.22997e-06 [elim_not_effective]: 1.331e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.15e-06 [renormalize]: 4.90021e-07 [validate]: 3.59e-05 Sums bootstrap : 0.000284s : 3.34% type_inference : 0.004366s : 51.33% event_method : 0.000018s : 0.21% auto_monad : 0.000069s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000022s : 0.26% rewriter_before_opt_a : 0.000127s : 1.50% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.72% jit_opt_a.loop_unroll : 0.000036s : 0.42% jit_opt_a.a_1 : 0.000622s : 7.31% jit_opt_a.with_stream_mark : 0.000025s : 0.29% jit_opt_a.recompute_prepare : 0.000028s : 0.34% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000056s : 0.66% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.36% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000733s : 8.62% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000040s : 0.47% jit_opt_a.replace_applicator : 0.000019s : 0.23% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000033s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000526s : 6.19% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000028s : 0.33% loop_unroll : 0.000460s : 5.41% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000049s : 0.57% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000014s : 0.17% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000448s : 5.27% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000036s : 0.42% Time group info: ------[substitution.] 0.000203 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000005s : 3: substitution.graph_param_transform 83.69% : 0.000170s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 5.63% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004309 2 81.05% : 0.003492s : 1: type_inference.infer 18.95% : 0.000817s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.40% : 0.000045s : 4: replace.inline 32.60% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000178 6 94.20% : 0.000167s : 4: match.inline 5.80% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 2.12% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000007s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.43% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.73% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.65% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.11% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.72% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.25% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000621 13 50.66% : 0.000315s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.56% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.78% : 0.000272s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013986 72 0.37% : 0.000051s : 1: add_recomputation 0.52% : 0.000073s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.16% : 0.000302s : 1: bootstrap 0.22% : 0.000031s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.96% : 0.005310s : 1: jit_opt_a 1.02% : 0.000143s : 1: jit_opt_after_cconv 0.38% : 0.000053s : 1: jit_opt_b 3.35% : 0.000468s : 1: loop_unroll 3.83% : 0.000535s : 1: mutable_eliminate 6.42% : 0.000897s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.26% : 0.000456s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000024s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.77% : 0.000387s : 1: renormalize.infer 2.41% : 0.000337s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.94% : 0.000131s : 1: rewriter_before_opt_a 0.52% : 0.000073s : 1: symbol_engine_optimizer 31.30% : 0.004378s : 1: type_inference TotalTime = 0.121071, [30] [bootstrap]: 0.00027477 [type_inference]: 0.109572 [event_method]: 2.078e-05 [auto_monad]: 7.408e-05 [graph_reusing]: 6.34999e-06 [pre_auto_parallel]: 2.03997e-06 [py_interpret_to_execute]: 0.00045794 [rewriter_before_opt_a]: 9.986e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00829945, [2] [Cycle 1]: 0.00416468, [27] [switch_simplify]: 0.00012188 [loop_unroll]: 3.412e-05 [a_1]: 0.00074447 [with_stream_mark]: 1.738e-05 [recompute_prepare]: 9.84999e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 7.61999e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.56999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 6.70002e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.44998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.329e-05 [j_node_and_user_rematch]: 1.07e-05 [meta_fg_expand]: 2.04e-06 [replace_old_param]: 1.177e-05 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00287144 [add_forward_monad_depend]: 6.51e-06 [auto_monad_grad]: 2.56998e-06 [auto_monad_eliminator]: 1.639e-05 [cse]: 3.645e-05 [replace_applicator]: 1.713e-05 [Cycle 2]: 0.00037736, [27] [switch_simplify]: 6.73998e-06 [loop_unroll]: 6.03002e-06 [a_1]: 0.00012879 [with_stream_mark]: 1.19e-05 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.70997e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.88002e-06 [accelerated_algorithm]: 6.26998e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 8.40999e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 8.62e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.19003e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.482e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.229e-05 [rewriter_after_opt_a]: 3.78e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.02999e-06 [mutable_eliminate]: 0.00061743 [jit_opt_b]: 5.445e-05, [1] [Cycle 1]: 4.724e-05, [2] [frontend_op_eliminate]: 1.917e-05 [inline_after_opt_a]: 1.754e-05 [cconv]: 2.619e-05 [loop_unroll]: 0.00042868 [jit_opt_after_cconv]: 0.00015119, [1] [Cycle 1]: 0.00014465, [11] [c_1]: 2.521e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.32e-05 [call_graph_tuple_transform]: 2.009e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 6.50002e-06 [remove_dup_value]: 1.702e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 8.46002e-06 [add_recomputation]: 4.714e-05 [cse_after_recomputation]: 2.363e-05, [1] [Cycle 1]: 1.789e-05, [1] [cse]: 1.198e-05 [auto_monad_reorder]: 1.708e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.15001e-06 [opt_after_jit_grad]: 0.00046377 [symbol_engine_optimizer]: 7.53e-05, [1] [Cycle 1]: 6.864e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 8.92e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 6.06998e-06 [fold_const_symbol]: 9.04e-06 [renormalize]: 4.30009e-07 [validate]: 7.48e-05 Sums bootstrap : 0.000275s : 0.24% type_inference : 0.109572s : 93.89% event_method : 0.000021s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000458s : 0.39% rewriter_before_opt_a : 0.000100s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000129s : 0.11% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000873s : 0.75% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002872s : 2.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000617s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000429s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000464s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000075s : 0.06% Time group info: ------[substitution.] 0.000302 28 0.67% : 0.000002s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 1.80% : 0.000005s : 4: substitution.graph_param_transform 85.63% : 0.000259s : 5: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.06% : 0.000012s : 3: substitution.reduce_eliminate 1.46% : 0.000004s : 4: substitution.remove_not_recompute_node 1.67% : 0.000005s : 2: substitution.replace_old_param 3.27% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109491 2 97.27% : 0.106502s : 1: type_inference.infer 2.73% : 0.002988s : 1: type_inference.specialize ------[replace.] 0.000107 7 69.89% : 0.000075s : 5: replace.inline 30.11% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000264 7 96.75% : 0.000256s : 5: match.inline 3.25% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.56% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.28% : 0.000002s : 13: predicate.addn_check_dump 1.25% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.68% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.41% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.28% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.20% : 0.000007s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.24% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 64: predicate.switch_simplify 1.51% : 0.000002s : 13: predicate.tile_eliminate 1.19% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002444 25 64.09% : 0.001567s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.74% : 0.000091s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.17% : 0.000786s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125160 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000292s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.63% : 0.008303s : 1: jit_opt_a 0.12% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.35% : 0.000437s : 1: loop_unroll 0.50% : 0.000626s : 1: mutable_eliminate 0.94% : 0.001181s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000467s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.65% : 0.002066s : 1: renormalize.infer 0.63% : 0.000794s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000105s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 87.56% : 0.109590s : 1: type_inference TotalTime = 0.0163037, [30] [bootstrap]: 0.00031455 [type_inference]: 0.00799573 [event_method]: 2.082e-05 [auto_monad]: 6.74e-05 [graph_reusing]: 6.05002e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 4.415e-05 [rewriter_before_opt_a]: 7.897e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00547595, [2] [Cycle 1]: 0.00182855, [27] [switch_simplify]: 6.378e-05 [loop_unroll]: 3.459e-05 [a_1]: 0.00060555 [with_stream_mark]: 1.674e-05 [recompute_prepare]: 7.79002e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.13002e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.99e-06 [renormalize]: 0.00075722 [add_forward_monad_depend]: 6.36998e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.695e-05 [cse]: 3.667e-05 [replace_applicator]: 1.418e-05 [Cycle 2]: 0.00035397, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.22e-06 [a_1]: 0.00010578 [with_stream_mark]: 1.154e-05 [recompute_prepare]: 5.85002e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.22e-06 [updatestate_useless_node_eliminater]: 5.00999e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 1.81998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 8.57998e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 5.12999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.42e-05 [replace_applicator]: 5.50001e-06 [py_interpret_to_execute_after_opt_a]: 1.229e-05 [rewriter_after_opt_a]: 3.812e-05 [convert_after_rewriter]: 7.41999e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00062677 [jit_opt_b]: 5.005e-05, [1] [Cycle 1]: 4.301e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.616e-05 [cconv]: 2.564e-05 [loop_unroll]: 0.00046619 [jit_opt_after_cconv]: 0.00015539, [1] [Cycle 1]: 0.0001482, [11] [c_1]: 2.179e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.77e-05 [call_graph_tuple_transform]: 2.01e-05 [tuple_list_get_item_eliminator]: 5.55001e-06 [none_parameter_eliminate]: 1.54998e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 6.98998e-06 [add_recomputation]: 5.149e-05 [cse_after_recomputation]: 2.535e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.319e-05 [auto_monad_reorder]: 1.733e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.58002e-06 [opt_after_jit_grad]: 0.00049007 [symbol_engine_optimizer]: 7.692e-05, [1] [Cycle 1]: 7.004e-05, [6] [build]: 3.91001e-06 [elim_shapecalc]: 8.84e-06 [elim_not_effective]: 1.34e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 6.19999e-07 [validate]: 3.897e-05 Sums bootstrap : 0.000315s : 2.53% type_inference : 0.007996s : 64.41% event_method : 0.000021s : 0.17% auto_monad : 0.000067s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000044s : 0.36% rewriter_before_opt_a : 0.000079s : 0.64% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000070s : 0.57% jit_opt_a.loop_unroll : 0.000040s : 0.32% jit_opt_a.a_1 : 0.000711s : 5.73% jit_opt_a.with_stream_mark : 0.000028s : 0.23% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000004s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000017s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000757s : 6.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000004s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.19% jit_opt_a.cse : 0.000051s : 0.41% jit_opt_a.replace_applicator : 0.000020s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000038s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000627s : 5.05% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000026s : 0.21% loop_unroll : 0.000466s : 3.76% jit_opt_after_cconv.c_1 : 0.000022s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.06% add_recomputation : 0.000051s : 0.41% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.04% opt_after_jit_grad : 0.000490s : 3.95% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.31% Time group info: ------[substitution.] 0.000227 27 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.36% : 0.000005s : 3: substitution.graph_param_transform 81.33% : 0.000185s : 5: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.02% : 0.000011s : 3: substitution.reduce_eliminate 1.91% : 0.000004s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 4.45% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007928 2 87.49% : 0.006936s : 1: type_inference.infer 12.51% : 0.000992s : 1: type_inference.specialize ------[replace.] 0.000086 7 67.72% : 0.000058s : 5: replace.inline 32.28% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 7 95.24% : 0.000182s : 5: match.inline 4.76% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.46% : 0.000002s : 11: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 11: predicate.addn_check_dump 1.47% : 0.000002s : 11: predicate.addn_zero_filter 1.98% : 0.000003s : 11: predicate.arithmetic_simplify 1.26% : 0.000002s : 11: predicate.cast_eliminate 0.33% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.15% : 0.000001s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.54% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 11: predicate.merge_addn 1.11% : 0.000001s : 11: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 1.90% : 0.000002s : 11: predicate.reduce_eliminate 1.62% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000002s : 11: predicate.reshape_eliminate 1.29% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.56% : 0.000003s : 18: predicate.switch_defer_inline 2.56% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.44% : 0.000011s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.59% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.92% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000753 16 49.70% : 0.000374s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.04% : 0.000053s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.27% : 0.000326s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.018066 72 0.30% : 0.000054s : 1: add_recomputation 0.39% : 0.000071s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.84% : 0.000332s : 1: bootstrap 0.16% : 0.000028s : 1: cconv 0.05% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.33% : 0.005479s : 1: jit_opt_a 0.88% : 0.000158s : 1: jit_opt_after_cconv 0.29% : 0.000053s : 1: jit_opt_b 2.63% : 0.000474s : 1: loop_unroll 3.52% : 0.000636s : 1: mutable_eliminate 5.22% : 0.000942s : 26: opt.transform.jit_opt_a 0.28% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000034s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000500s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000047s : 1: py_interpret_to_execute 0.08% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.30% : 0.000416s : 1: renormalize.infer 1.84% : 0.000333s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000041s : 1: rewriter_after_opt_a 0.45% : 0.000082s : 1: rewriter_before_opt_a 0.44% : 0.000080s : 1: symbol_engine_optimizer 44.34% : 0.008011s : 1: type_inference TotalTime = 0.126898, [30] [bootstrap]: 0.00027848 [type_inference]: 0.114895 [event_method]: 1.965e-05 [auto_monad]: 7.012e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.27001e-06 [py_interpret_to_execute]: 0.00056319 [rewriter_before_opt_a]: 9.246e-05 [expand_dump_flag]: 4.15999e-06 [jit_opt_a]: 0.0082157, [2] [Cycle 1]: 0.00410297, [27] [switch_simplify]: 9.527e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00062108 [with_stream_mark]: 1.831e-05 [recompute_prepare]: 9.52001e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 2.335e-05 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 2.32001e-06 [get_grad_eliminate_]: 7.13e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 1.068e-05 [meta_fg_expand]: 2.83998e-06 [replace_old_param]: 1.05e-05 [inline_without_move]: 6.08002e-06 [renormalize]: 0.00292308 [add_forward_monad_depend]: 1.564e-05 [auto_monad_grad]: 2.78e-06 [auto_monad_eliminator]: 2.029e-05 [cse]: 2.955e-05 [replace_applicator]: 2.134e-05 [Cycle 2]: 0.00039395, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00013756 [with_stream_mark]: 1.203e-05 [recompute_prepare]: 6.33e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.91998e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 2.84001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.692e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.59e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 6.81999e-06 [cse]: 1.209e-05 [replace_applicator]: 5.76003e-06 [py_interpret_to_execute_after_opt_a]: 1.179e-05 [rewriter_after_opt_a]: 3.508e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00083645 [jit_opt_b]: 6.163e-05, [1] [Cycle 1]: 5.264e-05, [2] [frontend_op_eliminate]: 2.351e-05 [inline_after_opt_a]: 1.825e-05 [cconv]: 2.612e-05 [loop_unroll]: 0.00048168 [jit_opt_after_cconv]: 0.00016946, [1] [Cycle 1]: 0.00016208, [11] [c_1]: 2.767e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 6.54999e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 2.579e-05 [call_graph_tuple_transform]: 2.58e-05 [tuple_list_get_item_eliminator]: 6.58998e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 3.70026e-07 [switch_simplify]: 6.54001e-06 [remove_dup_value]: 1.563e-05 [partial_unused_args_eliminate]: 4.28999e-06 [environ_conv]: 8.13999e-06 [add_recomputation]: 5.504e-05 [cse_after_recomputation]: 2.426e-05, [1] [Cycle 1]: 1.824e-05, [1] [cse]: 1.216e-05 [auto_monad_reorder]: 1.479e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 6.38e-06 [opt_after_jit_grad]: 0.00067343 [symbol_engine_optimizer]: 8.512e-05, [1] [Cycle 1]: 7.805e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 1.102e-05 [elim_not_effective]: 1.693e-05 [opt_reshape]: 7.63001e-06 [fold_const_symbol]: 1.008e-05 [renormalize]: 8.50006e-07 [validate]: 4.557e-05 Sums bootstrap : 0.000278s : 0.23% type_inference : 0.114895s : 93.75% event_method : 0.000020s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000563s : 0.46% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000102s : 0.08% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000759s : 0.62% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000029s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002923s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000017s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000042s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000836s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000024s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000482s : 0.39% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000673s : 0.55% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000225 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000002s : 2: substitution.fold_const_symbol 3.95% : 0.000009s : 4: substitution.graph_param_transform 82.23% : 0.000185s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.34% : 0.000005s : 4: substitution.remove_not_recompute_node 2.72% : 0.000006s : 2: substitution.replace_old_param 5.52% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114813 2 97.44% : 0.111872s : 1: type_inference.infer 2.56% : 0.002940s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.12% : 0.000055s : 4: replace.inline 31.88% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 6 94.15% : 0.000182s : 4: match.inline 5.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000157 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.89% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 12: predicate.compare_switch_simplify 1.05% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.04% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.00% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.63% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.96% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000002s : 12: predicate.environ_get_depend_swap 1.01% : 0.000002s : 12: predicate.environ_get_eliminate 0.95% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 15.32% : 0.000024s : 26: predicate.inline 0.79% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.32% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.60% : 0.000002s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.29% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000002s : 12: predicate.merge_addn 0.98% : 0.000002s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 1.95% : 0.000003s : 18: predicate.partial_eliminate 0.99% : 0.000002s : 12: predicate.print_const_string_wrapper 1.46% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.94% : 0.000003s : 18: predicate.switch_defer_inline 1.88% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.71% : 0.000011s : 58: predicate.switch_simplify 1.03% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.27% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.26% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.38% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.41% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.39% : 0.000002s : 12: predicate.value_based_eliminate 0.28% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002291 22 63.88% : 0.001464s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.73% : 0.000796s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.131111 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000293s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.27% : 0.008220s : 1: jit_opt_a 0.13% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.37% : 0.000490s : 1: loop_unroll 0.64% : 0.000846s : 1: mutable_eliminate 0.81% : 0.001059s : 26: opt.transform.jit_opt_a 0.05% : 0.000063s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.13% : 0.000173s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.52% : 0.000685s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000570s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.57% : 0.002054s : 1: renormalize.infer 0.66% : 0.000859s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000098s : 1: rewriter_before_opt_a 0.07% : 0.000088s : 1: symbol_engine_optimizer 87.64% : 0.114909s : 1: type_inference TotalTime = 0.0643963, [30] [bootstrap]: 0.00032097 [type_inference]: 0.0549571 [event_method]: 1.924e-05 [auto_monad]: 6.669e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00029423 [rewriter_before_opt_a]: 8.062e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00650574, [2] [Cycle 1]: 0.00288369, [27] [switch_simplify]: 5.279e-05 [loop_unroll]: 3.058e-05 [a_1]: 0.00054494 [with_stream_mark]: 1.632e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.90002e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.83e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 4.18001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 9.97999e-06 [inline_without_move]: 6.20002e-06 [renormalize]: 0.00190802 [add_forward_monad_depend]: 5.96e-06 [auto_monad_grad]: 3.26001e-06 [auto_monad_eliminator]: 1.545e-05 [cse]: 2.931e-05 [replace_applicator]: 1.44e-05 [Cycle 2]: 0.00036747, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00011898 [with_stream_mark]: 8.55999e-06 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 5.20999e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.39998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 1.58e-05 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.256e-05 [replace_applicator]: 6.28002e-06 [py_interpret_to_execute_after_opt_a]: 1.078e-05 [rewriter_after_opt_a]: 3.269e-05 [convert_after_rewriter]: 6.63998e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00054357 [jit_opt_b]: 5.486e-05, [1] [Cycle 1]: 4.751e-05, [2] [frontend_op_eliminate]: 1.875e-05 [inline_after_opt_a]: 1.793e-05 [cconv]: 2.368e-05 [loop_unroll]: 0.0004196 [jit_opt_after_cconv]: 0.00014578, [1] [Cycle 1]: 0.00013972, [11] [c_1]: 2.475e-05 [parameter_eliminate]: 2.58003e-06 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.983e-05 [call_graph_tuple_transform]: 1.951e-05 [tuple_list_get_item_eliminator]: 6.35002e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.08002e-06 [remove_dup_value]: 1.514e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 7.68001e-06 [add_recomputation]: 4.704e-05 [cse_after_recomputation]: 2.263e-05, [1] [Cycle 1]: 1.721e-05, [1] [cse]: 1.157e-05 [auto_monad_reorder]: 1.447e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 4.69002e-06 [opt_after_jit_grad]: 0.00045368 [symbol_engine_optimizer]: 0.00011709, [1] [Cycle 1]: 0.00011059, [6] [build]: 3.07002e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 5.172e-05 [opt_reshape]: 7.21999e-06 [fold_const_symbol]: 1.026e-05 [renormalize]: 3.59985e-07 [validate]: 4.189e-05 Sums bootstrap : 0.000321s : 0.53% type_inference : 0.054957s : 90.72% event_method : 0.000019s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000294s : 0.49% rewriter_before_opt_a : 0.000081s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000664s : 1.10% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000022s : 0.04% jit_opt_a.renormalize : 0.001908s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000544s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000420s : 0.69% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000454s : 0.75% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000052s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000188 24 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000005s : 4: substitution.graph_param_transform 82.34% : 0.000155s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.74% : 0.000005s : 2: substitution.replace_old_param 6.06% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054880 2 96.61% : 0.053021s : 1: type_inference.infer 3.39% : 0.001860s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.12% : 0.000045s : 4: replace.inline 33.88% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 93.66% : 0.000152s : 4: match.inline 6.34% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000001s : 12: predicate.print_const_string_wrapper 1.85% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000001s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.19% : 0.000009s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000001s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002303 26 73.66% : 0.001696s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.21% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.13% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067315 72 0.07% : 0.000050s : 1: add_recomputation 0.10% : 0.000070s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.50% : 0.000335s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.67% : 0.006509s : 1: jit_opt_a 0.22% : 0.000148s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.63% : 0.000427s : 1: loop_unroll 0.82% : 0.000552s : 1: mutable_eliminate 1.34% : 0.000902s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000074s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000300s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.89% : 0.001269s : 1: renormalize.infer 0.94% : 0.000630s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.18% : 0.000120s : 1: symbol_engine_optimizer 81.67% : 0.054973s : 1: type_inference TotalTime = 0.012461, [30] [bootstrap]: 0.00027276 [type_inference]: 0.00449019 [event_method]: 1.895e-05 [auto_monad]: 6.275e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 3.981e-05 [rewriter_before_opt_a]: 7.376e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00538453, [2] [Cycle 1]: 0.00172965, [27] [switch_simplify]: 5.262e-05 [loop_unroll]: 2.969e-05 [a_1]: 0.00054569 [with_stream_mark]: 1.878e-05 [recompute_prepare]: 7.58999e-06 [updatestate_depend_eliminate]: 3.67002e-06 [updatestate_assign_eliminate]: 3.63e-06 [updatestate_loads_eliminate]: 3.04001e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.27999e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 0.00076388 [add_forward_monad_depend]: 6.07999e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.458e-05 [cse]: 2.834e-05 [replace_applicator]: 1.31e-05 [Cycle 2]: 0.00031741, [27] [switch_simplify]: 5.78002e-06 [loop_unroll]: 5.04003e-06 [a_1]: 9.326e-05 [with_stream_mark]: 8.3e-06 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 1.98997e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 4.75001e-06 [accelerated_algorithm]: 4.58999e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.47998e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.267e-05 [j_node_and_user_rematch]: 8.00999e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 7.68999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 9.09989e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 9.90002e-06 [replace_applicator]: 5.04998e-06 [py_interpret_to_execute_after_opt_a]: 9.30001e-06 [rewriter_after_opt_a]: 3.397e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00053824 [jit_opt_b]: 4.992e-05, [1] [Cycle 1]: 4.284e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.521e-05 [cconv]: 2.678e-05 [loop_unroll]: 0.000422 [jit_opt_after_cconv]: 0.00014302, [1] [Cycle 1]: 0.00013632, [11] [c_1]: 2.057e-05 [parameter_eliminate]: 2.77002e-06 [updatestate_depend_eliminate]: 7.38e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.086e-05 [call_graph_tuple_transform]: 1.89e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.79998e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.12e-06 [remove_dup_value]: 1.394e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 6.49001e-06 [add_recomputation]: 4.818e-05 [cse_after_recomputation]: 2.191e-05, [1] [Cycle 1]: 1.599e-05, [1] [cse]: 1.027e-05 [auto_monad_reorder]: 1.484e-05 [get_jit_bprop_graph]: 2.05002e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.00046674 [symbol_engine_optimizer]: 7.233e-05, [1] [Cycle 1]: 6.608e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.78002e-06 [fold_const_symbol]: 9.02e-06 [renormalize]: 2.9002e-07 [validate]: 3.533e-05 Sums bootstrap : 0.000273s : 3.19% type_inference : 0.004490s : 52.53% event_method : 0.000019s : 0.22% auto_monad : 0.000063s : 0.73% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000040s : 0.47% rewriter_before_opt_a : 0.000074s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000058s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000639s : 7.47% jit_opt_a.with_stream_mark : 0.000027s : 0.32% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000764s : 8.94% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000038s : 0.45% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000034s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000538s : 6.30% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000027s : 0.31% loop_unroll : 0.000422s : 4.94% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000048s : 0.56% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000467s : 5.46% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.41% Time group info: ------[substitution.] 0.000210 23 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 2.54% : 0.000005s : 3: substitution.graph_param_transform 83.76% : 0.000176s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.49% : 0.000005s : 2: substitution.replace_old_param 5.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004428 2 80.72% : 0.003574s : 1: type_inference.infer 19.28% : 0.000854s : 1: type_inference.specialize ------[replace.] 0.000071 6 65.10% : 0.000046s : 4: replace.inline 34.90% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 94.03% : 0.000173s : 4: match.inline 5.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.25% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.27% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.90% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.69% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.08% : 0.000002s : 15: predicate.load_eliminater 1.25% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.73% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.11% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000611 13 48.46% : 0.000296s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.51% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.03% : 0.000275s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014110 72 0.37% : 0.000052s : 1: add_recomputation 0.47% : 0.000066s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.06% : 0.000290s : 1: bootstrap 0.21% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.16% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.18% : 0.005387s : 1: jit_opt_a 1.03% : 0.000146s : 1: jit_opt_after_cconv 0.37% : 0.000052s : 1: jit_opt_b 3.05% : 0.000430s : 1: loop_unroll 3.87% : 0.000546s : 1: mutable_eliminate 6.00% : 0.000847s : 26: opt.transform.jit_opt_a 0.33% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.36% : 0.000475s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000043s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000016s : 1: remove_dup_value 2.99% : 0.000422s : 1: renormalize.infer 2.36% : 0.000333s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000037s : 1: rewriter_after_opt_a 0.54% : 0.000076s : 1: rewriter_before_opt_a 0.53% : 0.000075s : 1: symbol_engine_optimizer 31.92% : 0.004504s : 1: type_inference TotalTime = 0.121474, [30] [bootstrap]: 0.0003124 [type_inference]: 0.110588 [event_method]: 2.162e-05 [auto_monad]: 6.023e-05 [graph_reusing]: 5.24e-06 [pre_auto_parallel]: 2.00002e-06 [py_interpret_to_execute]: 0.00045232 [rewriter_before_opt_a]: 9.065e-05 [expand_dump_flag]: 3.20998e-06 [jit_opt_a]: 0.0076779, [2] [Cycle 1]: 0.00407582, [27] [switch_simplify]: 5.698e-05 [loop_unroll]: 3.416e-05 [a_1]: 0.00066602 [with_stream_mark]: 1.393e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.03997e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 6.32001e-06 [renormalize]: 0.00297159 [add_forward_monad_depend]: 6.36e-06 [auto_monad_grad]: 2.26998e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 2.729e-05 [replace_applicator]: 1.699e-05 [Cycle 2]: 0.00038159, [27] [switch_simplify]: 7.08998e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00013274 [with_stream_mark]: 1.06e-05 [recompute_prepare]: 6.09001e-06 [updatestate_depend_eliminate]: 2.91999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.71999e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.225e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.61998e-06 [inline_without_move]: 5.74e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 5.40022e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.403e-05 [replace_applicator]: 6.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.412e-05 [rewriter_after_opt_a]: 3.477e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 5.22999e-06 [mutable_eliminate]: 0.00062314 [jit_opt_b]: 5.554e-05, [1] [Cycle 1]: 4.824e-05, [2] [frontend_op_eliminate]: 1.926e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.269e-05 [loop_unroll]: 0.00041987 [jit_opt_after_cconv]: 0.00015219, [1] [Cycle 1]: 0.00014605, [11] [c_1]: 2.549e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.78002e-06 [updatestate_assign_eliminate]: 2.80997e-06 [updatestate_loads_eliminate]: 2.68003e-06 [cse]: 2.369e-05 [call_graph_tuple_transform]: 1.999e-05 [tuple_list_get_item_eliminator]: 6.44999e-06 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 6.26e-06 [remove_dup_value]: 1.356e-05 [partial_unused_args_eliminate]: 1.76003e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.133e-05 [cse_after_recomputation]: 2.432e-05, [1] [Cycle 1]: 1.956e-05, [1] [cse]: 1.356e-05 [auto_monad_reorder]: 1.603e-05 [get_jit_bprop_graph]: 1.93002e-06 [rewriter_after_jit_bprop_graph]: 4.49998e-06 [opt_after_jit_grad]: 0.00046428 [symbol_engine_optimizer]: 9.733e-05, [1] [Cycle 1]: 9.061e-05, [6] [build]: 2.64999e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 3.183e-05 [renormalize]: 5.19998e-07 [validate]: 4.079e-05 Sums bootstrap : 0.000312s : 0.27% type_inference : 0.110588s : 94.01% event_method : 0.000022s : 0.02% auto_monad : 0.000060s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000452s : 0.38% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000799s : 0.68% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002972s : 2.53% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000623s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000420s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000464s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000032s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000268 28 0.65% : 0.000002s : 2: substitution.elim_not_effective 8.44% : 0.000023s : 2: substitution.fold_const_symbol 1.98% : 0.000005s : 4: substitution.graph_param_transform 76.39% : 0.000205s : 5: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000011s : 3: substitution.reduce_eliminate 1.71% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000005s : 2: substitution.replace_old_param 3.64% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110516 2 97.40% : 0.107644s : 1: type_inference.infer 2.60% : 0.002872s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.79% : 0.000068s : 5: replace.inline 31.21% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 7 95.85% : 0.000202s : 5: match.inline 4.15% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 886 1.32% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 13: predicate.compare_switch_simplify 1.45% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.47% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.59% : 0.000002s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.15% : 0.000002s : 13: predicate.print_const_string_wrapper 2.03% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.46% : 0.000010s : 64: predicate.switch_simplify 1.54% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002352 25 63.64% : 0.001497s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.70% : 0.000064s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.66% : 0.000792s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125582 72 0.04% : 0.000044s : 1: add_recomputation 0.05% : 0.000064s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000325s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.12% : 0.007681s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.34% : 0.000428s : 1: loop_unroll 0.50% : 0.000632s : 1: mutable_eliminate 0.83% : 0.001039s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000056s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000458s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.69% : 0.002120s : 1: renormalize.infer 0.67% : 0.000842s : 1: renormalize.specialize 0.04% : 0.000049s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.08% : 0.000100s : 1: symbol_engine_optimizer 88.07% : 0.110604s : 1: type_inference TotalTime = 0.0134664, [30] [bootstrap]: 0.00028284 [type_inference]: 0.00536472 [event_method]: 1.866e-05 [auto_monad]: 6.313e-05 [graph_reusing]: 6.31e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 4.303e-05 [rewriter_before_opt_a]: 7.562e-05 [expand_dump_flag]: 2.89999e-06 [jit_opt_a]: 0.00543214, [2] [Cycle 1]: 0.00187456, [27] [switch_simplify]: 0.00023922 [loop_unroll]: 3.157e-05 [a_1]: 0.00053074 [with_stream_mark]: 1.71e-05 [recompute_prepare]: 7.86001e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.11999e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 3.46999e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 0.00073349 [add_forward_monad_depend]: 5.79999e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.446e-05 [cse]: 2.73e-05 [replace_applicator]: 1.282e-05 [Cycle 2]: 0.00031769, [27] [switch_simplify]: 5.76003e-06 [loop_unroll]: 4.82998e-06 [a_1]: 9.106e-05 [with_stream_mark]: 8.38999e-06 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 4.72998e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.57e-06 [merge_forward]: 3.13e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 7.89002e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 8.03999e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 6.00002e-06 [cse]: 1.125e-05 [replace_applicator]: 5.27001e-06 [py_interpret_to_execute_after_opt_a]: 9.84999e-06 [rewriter_after_opt_a]: 3.326e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00055703 [jit_opt_b]: 5.121e-05, [1] [Cycle 1]: 4.396e-05, [2] [frontend_op_eliminate]: 1.605e-05 [inline_after_opt_a]: 1.634e-05 [cconv]: 2.607e-05 [loop_unroll]: 0.00042943 [jit_opt_after_cconv]: 0.00014281, [1] [Cycle 1]: 0.00013661, [11] [c_1]: 2.06e-05 [parameter_eliminate]: 3.09999e-06 [updatestate_depend_eliminate]: 6.89999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.071e-05 [call_graph_tuple_transform]: 1.879e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 2.09999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.436e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 5.35999e-06 [add_recomputation]: 4.719e-05 [cse_after_recomputation]: 2.097e-05, [1] [Cycle 1]: 1.586e-05, [1] [cse]: 1.05e-05 [auto_monad_reorder]: 2.668e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.00051629 [symbol_engine_optimizer]: 7.149e-05, [1] [Cycle 1]: 6.549e-05, [6] [build]: 3.48999e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 5.40999e-06 [fold_const_symbol]: 8.74e-06 [renormalize]: 3.69997e-07 [validate]: 3.643e-05 Sums bootstrap : 0.000283s : 2.93% type_inference : 0.005365s : 55.48% event_method : 0.000019s : 0.19% auto_monad : 0.000063s : 0.65% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000043s : 0.45% rewriter_before_opt_a : 0.000076s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000245s : 2.53% jit_opt_a.loop_unroll : 0.000036s : 0.38% jit_opt_a.a_1 : 0.000622s : 6.43% jit_opt_a.with_stream_mark : 0.000025s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.17% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000734s : 7.59% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.21% jit_opt_a.cse : 0.000039s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.10% rewriter_after_opt_a : 0.000033s : 0.34% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000557s : 5.76% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000026s : 0.27% loop_unroll : 0.000429s : 4.44% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000014s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.49% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000027s : 0.28% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000516s : 5.34% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.38% Time group info: ------[substitution.] 0.000198 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000005s : 3: substitution.graph_param_transform 82.95% : 0.000164s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000005s : 4: substitution.remove_not_recompute_node 2.48% : 0.000005s : 2: substitution.replace_old_param 6.02% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005300 2 80.26% : 0.004253s : 1: type_inference.infer 19.74% : 0.001046s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.95% : 0.000048s : 4: replace.inline 32.05% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.75% : 0.000161s : 4: match.inline 6.25% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.20% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.30% : 0.000002s : 10: predicate.cast_eliminate 0.62% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.30% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.85% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.04% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.40% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000725 13 52.65% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.17% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.18% : 0.000313s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015282 72 0.33% : 0.000050s : 1: add_recomputation 0.43% : 0.000066s : 1: auto_monad 0.19% : 0.000029s : 1: auto_monad_reorder 1.94% : 0.000297s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 35.57% : 0.005435s : 1: jit_opt_a 0.95% : 0.000145s : 1: jit_opt_after_cconv 0.35% : 0.000054s : 1: jit_opt_b 2.86% : 0.000437s : 1: loop_unroll 3.71% : 0.000567s : 1: mutable_eliminate 6.67% : 0.001020s : 26: opt.transform.jit_opt_a 0.30% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.16% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.43% : 0.000524s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000046s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 2.44% : 0.000373s : 1: renormalize.infer 2.31% : 0.000353s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000036s : 1: rewriter_after_opt_a 0.51% : 0.000079s : 1: rewriter_before_opt_a 0.49% : 0.000074s : 1: symbol_engine_optimizer 35.21% : 0.005380s : 1: type_inference TotalTime = 0.122813, [30] [bootstrap]: 0.0002915 [type_inference]: 0.111023 [event_method]: 2.197e-05 [auto_monad]: 7.268e-05 [graph_reusing]: 6.65002e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.00051064 [rewriter_before_opt_a]: 0.00010309 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.00833677, [2] [Cycle 1]: 0.00435963, [27] [switch_simplify]: 6.685e-05 [loop_unroll]: 3.448e-05 [a_1]: 0.00068817 [with_stream_mark]: 2.105e-05 [recompute_prepare]: 9.23002e-06 [updatestate_depend_eliminate]: 4.53999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 2.06003e-06 [specialize_transform]: 7.50998e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00316538 [add_forward_monad_depend]: 8.74e-06 [auto_monad_grad]: 2.41998e-06 [auto_monad_eliminator]: 1.683e-05 [cse]: 3.474e-05 [replace_applicator]: 2.026e-05 [Cycle 2]: 0.00039329, [27] [switch_simplify]: 7.45e-06 [loop_unroll]: 6.03002e-06 [a_1]: 0.00013499 [with_stream_mark]: 1.376e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 4.09002e-06 [cell_reuse_recompute_pass]: 2.69001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.17001e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 6.34999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 1.16002e-06 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.455e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.374e-05 [rewriter_after_opt_a]: 4.054e-05 [convert_after_rewriter]: 6.80998e-06 [order_py_execute_after_rewriter]: 5.05001e-06 [mutable_eliminate]: 0.00067001 [jit_opt_b]: 5.504e-05, [1] [Cycle 1]: 4.716e-05, [2] [frontend_op_eliminate]: 1.859e-05 [inline_after_opt_a]: 1.763e-05 [cconv]: 2.601e-05 [loop_unroll]: 0.00042591 [jit_opt_after_cconv]: 0.00016022, [1] [Cycle 1]: 0.00015322, [11] [c_1]: 2.628e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 6.34999e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.511e-05 [call_graph_tuple_transform]: 2.339e-05 [tuple_list_get_item_eliminator]: 6.75002e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 6.61e-06 [remove_dup_value]: 1.785e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 7.88001e-06 [add_recomputation]: 5.087e-05 [cse_after_recomputation]: 2.404e-05, [1] [Cycle 1]: 1.896e-05, [1] [cse]: 1.288e-05 [auto_monad_reorder]: 1.701e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00054118 [symbol_engine_optimizer]: 8.175e-05, [1] [Cycle 1]: 7.458e-05, [6] [build]: 4.47e-06 [elim_shapecalc]: 9.59999e-06 [elim_not_effective]: 1.459e-05 [opt_reshape]: 7.11001e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 4.90021e-07 [validate]: 0.00010428 Sums bootstrap : 0.000292s : 0.25% type_inference : 0.111023s : 93.60% event_method : 0.000022s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000511s : 0.43% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000074s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000823s : 0.69% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.003165s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000670s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000426s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000541s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000104s : 0.09% Time group info: ------[substitution.] 0.000266 28 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000007s : 4: substitution.graph_param_transform 81.19% : 0.000216s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.90% : 0.000013s : 3: substitution.reduce_eliminate 2.25% : 0.000006s : 4: substitution.remove_not_recompute_node 2.04% : 0.000005s : 2: substitution.replace_old_param 4.31% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110945 2 97.13% : 0.107759s : 1: type_inference.infer 2.87% : 0.003186s : 1: type_inference.specialize ------[replace.] 0.000098 7 68.64% : 0.000068s : 5: replace.inline 31.36% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 7 95.32% : 0.000213s : 5: match.inline 4.68% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.50% : 0.000002s : 13: predicate.addn_zero_filter 2.27% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.09% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.79% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.04% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.55% : 0.000008s : 28: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.75% : 0.000003s : 8: predicate.less_batch_normalization 1.79% : 0.000003s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 19: predicate.load_eliminater 1.10% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.07% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.18% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.57% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.66% : 0.000011s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.49% : 0.000002s : 13: predicate.transpose_eliminate 1.49% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002500 25 61.77% : 0.001544s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.44% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.80% : 0.000895s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.127075 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000305s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.56% : 0.008341s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.34% : 0.000434s : 1: loop_unroll 0.53% : 0.000679s : 1: mutable_eliminate 0.85% : 0.001081s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000517s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.73% : 0.002199s : 1: renormalize.infer 0.75% : 0.000957s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000044s : 1: rewriter_after_opt_a 0.09% : 0.000108s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 87.38% : 0.111042s : 1: type_inference TotalTime = 0.116473, [30] [bootstrap]: 0.00034937 [type_inference]: 0.105644 [event_method]: 1.897e-05 [auto_monad]: 7.205e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.73e-06 [py_interpret_to_execute]: 0.00046459 [rewriter_before_opt_a]: 8.422e-05 [expand_dump_flag]: 3.95998e-06 [jit_opt_a]: 0.00741742, [2] [Cycle 1]: 0.00364691, [27] [switch_simplify]: 5.623e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.00059246 [with_stream_mark]: 2.179e-05 [recompute_prepare]: 9.17999e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 2.73003e-06 [parameter_eliminate]: 2.15002e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 2.11998e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.72999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 6.41998e-06 [renormalize]: 0.00260226 [add_forward_monad_depend]: 8.08999e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.759e-05 [cse]: 2.894e-05 [replace_applicator]: 1.814e-05 [Cycle 2]: 0.00037081, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00012141 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 3.08998e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.76998e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.703e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.62999e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 5.61998e-06 [cse]: 1.24e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 1.251e-05 [rewriter_after_opt_a]: 3.578e-05 [convert_after_rewriter]: 7.22002e-06 [order_py_execute_after_rewriter]: 5.40001e-06 [mutable_eliminate]: 0.00064881 [jit_opt_b]: 5.455e-05, [1] [Cycle 1]: 4.747e-05, [2] [frontend_op_eliminate]: 1.851e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 2.775e-05 [loop_unroll]: 0.0004315 [jit_opt_after_cconv]: 0.00015371, [1] [Cycle 1]: 0.00014729, [11] [c_1]: 2.55e-05 [parameter_eliminate]: 3.22002e-06 [updatestate_depend_eliminate]: 7.55e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 1.97001e-06 [cse]: 2.214e-05 [call_graph_tuple_transform]: 2.07e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.80002e-06 [remove_dup_value]: 1.796e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 9.46e-06 [add_recomputation]: 4.935e-05 [cse_after_recomputation]: 2.537e-05, [1] [Cycle 1]: 1.916e-05, [1] [cse]: 1.245e-05 [auto_monad_reorder]: 1.504e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 5.18002e-06 [opt_after_jit_grad]: 0.00048641 [symbol_engine_optimizer]: 0.00015642, [1] [Cycle 1]: 9.086e-05, [6] [build]: 3.8e-06 [elim_shapecalc]: 2.966e-05 [elim_not_effective]: 1.367e-05 [opt_reshape]: 6.25997e-06 [fold_const_symbol]: 8.99e-06 [renormalize]: 4.00003e-07 [validate]: 4.712e-05 Sums bootstrap : 0.000349s : 0.31% type_inference : 0.105644s : 93.99% event_method : 0.000019s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000465s : 0.41% rewriter_before_opt_a : 0.000084s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000714s : 0.64% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002602s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000649s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000431s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000486s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000030s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000226 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000006s : 4: substitution.graph_param_transform 84.50% : 0.000191s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.29% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000005s : 2: substitution.replace_old_param 5.46% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105567 2 97.46% : 0.102884s : 1: type_inference.infer 2.54% : 0.002683s : 1: type_inference.specialize ------[replace.] 0.000069 6 65.99% : 0.000046s : 4: replace.inline 34.01% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.42% : 0.000189s : 4: match.inline 5.58% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.12% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.77% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.18% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.97% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000010s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.60% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.29% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002190 22 66.39% : 0.001454s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.18% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.42% : 0.000688s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120110 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.31% : 0.000367s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.18% : 0.007421s : 1: jit_opt_a 0.15% : 0.000185s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000440s : 1: loop_unroll 0.55% : 0.000658s : 1: mutable_eliminate 0.79% : 0.000953s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000056s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000495s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000470s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 1.55% : 0.001857s : 1: renormalize.infer 0.61% : 0.000735s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.13% : 0.000160s : 1: symbol_engine_optimizer 87.97% : 0.105660s : 1: type_inference TotalTime = 0.122626, [30] [bootstrap]: 0.00030448 [type_inference]: 0.111667 [event_method]: 2.143e-05 [auto_monad]: 7.06e-05 [graph_reusing]: 5.47001e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.000463 [rewriter_before_opt_a]: 9.59e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00767485, [2] [Cycle 1]: 0.0039212, [27] [switch_simplify]: 5.884e-05 [loop_unroll]: 3.394e-05 [a_1]: 0.00070754 [with_stream_mark]: 1.894e-05 [recompute_prepare]: 8.10999e-06 [updatestate_depend_eliminate]: 3.98001e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.64999e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.06003e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.45e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.91998e-06 [inline_without_move]: 6.53998e-06 [renormalize]: 0.00275472 [add_forward_monad_depend]: 6.67002e-06 [auto_monad_grad]: 2.48998e-06 [auto_monad_eliminator]: 1.585e-05 [cse]: 3.396e-05 [replace_applicator]: 1.439e-05 [Cycle 2]: 0.00037739, [27] [switch_simplify]: 7.35e-06 [loop_unroll]: 6.15002e-06 [a_1]: 0.00012836 [with_stream_mark]: 1.124e-05 [recompute_prepare]: 6.58998e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 2.59001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.241e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 8.48999e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 6.79001e-06 [cse]: 1.488e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 1.235e-05 [rewriter_after_opt_a]: 3.693e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00063264 [jit_opt_b]: 5.839e-05, [1] [Cycle 1]: 5.098e-05, [2] [frontend_op_eliminate]: 2.012e-05 [inline_after_opt_a]: 1.825e-05 [cconv]: 2.94e-05 [loop_unroll]: 0.00044116 [jit_opt_after_cconv]: 0.0001492, [1] [Cycle 1]: 0.00014299, [11] [c_1]: 2.463e-05 [parameter_eliminate]: 2.69001e-06 [updatestate_depend_eliminate]: 5.12999e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.211e-05 [call_graph_tuple_transform]: 1.993e-05 [tuple_list_get_item_eliminator]: 5.97999e-06 [none_parameter_eliminate]: 1.43002e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.654e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 7.99002e-06 [add_recomputation]: 4.831e-05 [cse_after_recomputation]: 2.467e-05, [1] [Cycle 1]: 1.927e-05, [1] [cse]: 1.229e-05 [auto_monad_reorder]: 1.781e-05 [get_jit_bprop_graph]: 2.48e-06 [rewriter_after_jit_bprop_graph]: 4.90001e-06 [opt_after_jit_grad]: 0.00045758 [symbol_engine_optimizer]: 0.00013906, [1] [Cycle 1]: 0.00013268, [6] [build]: 3.01001e-06 [elim_shapecalc]: 1.133e-05 [elim_not_effective]: 1.481e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 6.901e-05 [renormalize]: 3.09985e-07 [validate]: 4.362e-05 Sums bootstrap : 0.000304s : 0.26% type_inference : 0.111667s : 94.11% event_method : 0.000021s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000463s : 0.39% rewriter_before_opt_a : 0.000096s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000836s : 0.70% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002755s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000633s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000441s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000458s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000069s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000250 28 1.54% : 0.000004s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000006s : 4: substitution.graph_param_transform 81.94% : 0.000205s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.76% : 0.000012s : 3: substitution.reduce_eliminate 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.83% : 0.000005s : 2: substitution.replace_old_param 3.92% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111588 2 97.30% : 0.108580s : 1: type_inference.infer 2.70% : 0.003008s : 1: type_inference.specialize ------[replace.] 0.000094 7 69.04% : 0.000065s : 5: replace.inline 30.96% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 95.91% : 0.000202s : 5: match.inline 4.09% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 1.85% : 0.000003s : 13: predicate.arithmetic_simplify 1.24% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.49% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000002s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.48% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.03% : 0.000003s : 13: predicate.reduce_eliminate 1.63% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 13: predicate.reshape_eliminate 1.41% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.78% : 0.000011s : 64: predicate.switch_simplify 1.50% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.35% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002342 25 65.91% : 0.001544s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.65% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.45% : 0.000736s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126586 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000319s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.07% : 0.007679s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.35% : 0.000449s : 1: loop_unroll 0.51% : 0.000643s : 1: mutable_eliminate 0.85% : 0.001073s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000098s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000470s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.59% : 0.002017s : 1: renormalize.infer 0.58% : 0.000730s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.11% : 0.000142s : 1: symbol_engine_optimizer 88.23% : 0.111684s : 1: type_inference TotalTime = 0.115173, [30] [bootstrap]: 0.00028043 [type_inference]: 0.105242 [event_method]: 1.934e-05 [auto_monad]: 6.993e-05 [graph_reusing]: 6.03002e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00049274 [rewriter_before_opt_a]: 7.876e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00681906, [2] [Cycle 1]: 0.00338232, [27] [switch_simplify]: 4.662e-05 [loop_unroll]: 2.97e-05 [a_1]: 0.00061001 [with_stream_mark]: 1.499e-05 [recompute_prepare]: 8.99e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 9.89999e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.56002e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.00236838 [add_forward_monad_depend]: 5.82001e-06 [auto_monad_grad]: 2.61e-06 [auto_monad_eliminator]: 1.558e-05 [cse]: 2.537e-05 [replace_applicator]: 1.413e-05 [Cycle 2]: 0.000364, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 6.05002e-06 [a_1]: 0.00012391 [with_stream_mark]: 1.05e-05 [recompute_prepare]: 6.17999e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.71998e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 7.95998e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.082e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 1.092e-05 [rewriter_after_opt_a]: 3.208e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 5.27999e-06 [mutable_eliminate]: 0.00056983 [jit_opt_b]: 5.405e-05, [1] [Cycle 1]: 4.676e-05, [2] [frontend_op_eliminate]: 1.877e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 2.391e-05 [loop_unroll]: 0.00045668 [jit_opt_after_cconv]: 0.00015296, [1] [Cycle 1]: 0.00014606, [11] [c_1]: 2.543e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 6.03002e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.114e-05 [call_graph_tuple_transform]: 2.274e-05 [tuple_list_get_item_eliminator]: 6.49999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.98002e-06 [remove_dup_value]: 1.364e-05 [partial_unused_args_eliminate]: 2.67001e-06 [environ_conv]: 8.37e-06 [add_recomputation]: 4.402e-05 [cse_after_recomputation]: 2.261e-05, [1] [Cycle 1]: 1.746e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.451e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 4.35e-06 [opt_after_jit_grad]: 0.00045805 [symbol_engine_optimizer]: 7.13e-05, [1] [Cycle 1]: 6.496e-05, [6] [build]: 2.46e-06 [elim_shapecalc]: 7.98999e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 6.24999e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 2.89991e-07 [validate]: 3.641e-05 Sums bootstrap : 0.000280s : 0.25% type_inference : 0.105242s : 94.35% event_method : 0.000019s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000493s : 0.44% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000734s : 0.66% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002368s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000570s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000457s : 0.41% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000458s : 0.41% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000183 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 3.92% : 0.000007s : 4: substitution.graph_param_transform 82.09% : 0.000150s : 4: substitution.inline 1.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000003s : 2: substitution.replace_old_param 5.91% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105173 2 97.54% : 0.102583s : 1: type_inference.infer 2.46% : 0.002589s : 1: type_inference.specialize ------[replace.] 0.000142 6 31.17% : 0.000044s : 4: replace.inline 68.83% : 0.000098s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000157 6 93.86% : 0.000148s : 4: match.inline 6.14% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.16% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.78% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.66% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.11% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002096 22 68.02% : 0.001425s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.36% : 0.000636s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118570 72 0.04% : 0.000047s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000298s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.75% : 0.006822s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.39% : 0.000465s : 1: loop_unroll 0.49% : 0.000578s : 1: mutable_eliminate 0.81% : 0.000955s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000499s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.42% : 0.001686s : 1: renormalize.infer 0.57% : 0.000673s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 88.77% : 0.105255s : 1: type_inference TotalTime = 0.0150563, [30] [bootstrap]: 0.00028396 [type_inference]: 0.00742463 [event_method]: 1.949e-05 [auto_monad]: 6.493e-05 [graph_reusing]: 5.44998e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 4.014e-05 [rewriter_before_opt_a]: 7.933e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.00515039, [2] [Cycle 1]: 0.00169984, [27] [switch_simplify]: 5.601e-05 [loop_unroll]: 3.222e-05 [a_1]: 0.00060099 [with_stream_mark]: 1.49e-05 [recompute_prepare]: 7.21001e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.71999e-06 [updatestate_loads_eliminate]: 3.03998e-06 [parameter_eliminate]: 1.96e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 8.64003e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.22001e-06 [inline_without_move]: 5.21998e-06 [renormalize]: 0.00062568 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 2.10002e-06 [auto_monad_eliminator]: 1.376e-05 [cse]: 3.056e-05 [replace_applicator]: 6.278e-05 [Cycle 2]: 0.00032273, [27] [switch_simplify]: 6.39999e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.535e-05 [with_stream_mark]: 8.95999e-06 [recompute_prepare]: 5.45001e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.14998e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.023e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.76998e-06 [replace_old_param]: 6.65002e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14003e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.324e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.005e-05 [rewriter_after_opt_a]: 3.489e-05 [convert_after_rewriter]: 6.75998e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00047611 [jit_opt_b]: 4.723e-05, [1] [Cycle 1]: 4.113e-05, [2] [frontend_op_eliminate]: 1.521e-05 [inline_after_opt_a]: 1.532e-05 [cconv]: 2.401e-05 [loop_unroll]: 0.00040776 [jit_opt_after_cconv]: 0.00014968, [1] [Cycle 1]: 0.00014335, [11] [c_1]: 2.064e-05 [parameter_eliminate]: 2.45002e-06 [updatestate_depend_eliminate]: 5.43997e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 9.97999e-06 [cse]: 2.163e-05 [call_graph_tuple_transform]: 1.802e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.514e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 5.52999e-06 [add_recomputation]: 4.631e-05 [cse_after_recomputation]: 2.329e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.22e-05 [auto_monad_reorder]: 1.718e-05 [get_jit_bprop_graph]: 2.32999e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.00044566 [symbol_engine_optimizer]: 7.029e-05, [1] [Cycle 1]: 6.448e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.203e-05 [opt_reshape]: 5.77001e-06 [fold_const_symbol]: 8.35001e-06 [renormalize]: 3.69997e-07 [validate]: 3.479e-05 Sums bootstrap : 0.000284s : 2.49% type_inference : 0.007425s : 65.23% event_method : 0.000019s : 0.17% auto_monad : 0.000065s : 0.57% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.35% rewriter_before_opt_a : 0.000079s : 0.70% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.55% jit_opt_a.loop_unroll : 0.000037s : 0.33% jit_opt_a.a_1 : 0.000696s : 6.12% jit_opt_a.with_stream_mark : 0.000024s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000626s : 5.50% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.17% jit_opt_a.cse : 0.000044s : 0.38% jit_opt_a.replace_applicator : 0.000068s : 0.60% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000035s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000476s : 4.18% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000024s : 0.21% loop_unroll : 0.000408s : 3.58% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000010s : 0.09% jit_opt_after_cconv.cse : 0.000022s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000046s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000446s : 3.92% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.31% Time group info: ------[substitution.] 0.000223 27 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 3: substitution.graph_param_transform 82.38% : 0.000184s : 5: substitution.inline 1.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.37% : 0.000010s : 3: substitution.reduce_eliminate 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 4.70% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007367 2 87.40% : 0.006439s : 1: type_inference.infer 12.60% : 0.000928s : 1: type_inference.specialize ------[replace.] 0.000087 7 68.20% : 0.000059s : 5: replace.inline 31.80% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 7 95.05% : 0.000181s : 5: match.inline 4.95% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.30% : 0.000002s : 11: predicate.addn_zero_filter 1.86% : 0.000002s : 11: predicate.arithmetic_simplify 1.20% : 0.000001s : 11: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.14% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000001s : 11: predicate.environ_get_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.52% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 16: predicate.load_eliminater 1.11% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.52% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.19% : 0.000001s : 11: predicate.minmaximum_grad 1.37% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 2.00% : 0.000002s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 19: predicate.replace_applicator 0.69% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 11: predicate.reshape_eliminate 1.28% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.11% : 0.000010s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.31% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000723 16 51.53% : 0.000373s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.28% : 0.000053s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.19% : 0.000298s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016702 72 0.29% : 0.000049s : 1: add_recomputation 0.41% : 0.000068s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.78% : 0.000297s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.86% : 0.005153s : 1: jit_opt_a 0.91% : 0.000152s : 1: jit_opt_after_cconv 0.30% : 0.000050s : 1: jit_opt_b 2.49% : 0.000415s : 1: loop_unroll 2.90% : 0.000485s : 1: mutable_eliminate 5.74% : 0.000959s : 26: opt.transform.jit_opt_a 0.28% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.72% : 0.000454s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000043s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.06% : 0.000345s : 1: renormalize.infer 1.64% : 0.000273s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000038s : 1: rewriter_after_opt_a 0.49% : 0.000082s : 1: rewriter_before_opt_a 0.44% : 0.000073s : 1: symbol_engine_optimizer 44.53% : 0.007437s : 1: type_inference TotalTime = 0.0469032, [30] [bootstrap]: 0.00025844 [type_inference]: 0.0380652 [event_method]: 1.877e-05 [auto_monad]: 6.494e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.25002e-06 [py_interpret_to_execute]: 0.00022814 [rewriter_before_opt_a]: 8.147e-05 [expand_dump_flag]: 3.05002e-06 [jit_opt_a]: 0.00605941, [2] [Cycle 1]: 0.00246298, [27] [switch_simplify]: 5.632e-05 [loop_unroll]: 3.105e-05 [a_1]: 0.00055531 [with_stream_mark]: 1.843e-05 [recompute_prepare]: 9.00001e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 2.85002e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.08002e-06 [merge_forward]: 3.53999e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.61e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 6.31e-06 [renormalize]: 0.00146622 [add_forward_monad_depend]: 6.28e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.628e-05 [cse]: 3.016e-05 [replace_applicator]: 1.386e-05 [Cycle 2]: 0.00036404, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.0001213 [with_stream_mark]: 1.018e-05 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 2.14999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.497e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 1.91003e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.69e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 7.01999e-06 [cse]: 1.151e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 1.13e-05 [rewriter_after_opt_a]: 3.621e-05 [convert_after_rewriter]: 7.28999e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00054667 [jit_opt_b]: 5.259e-05, [1] [Cycle 1]: 4.604e-05, [2] [frontend_op_eliminate]: 1.852e-05 [inline_after_opt_a]: 1.738e-05 [cconv]: 2.345e-05 [loop_unroll]: 0.000413 [jit_opt_after_cconv]: 0.00014595, [1] [Cycle 1]: 0.00013963, [11] [c_1]: 2.619e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.37999e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.904e-05 [call_graph_tuple_transform]: 1.945e-05 [tuple_list_get_item_eliminator]: 6.04001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.405e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 4.768e-05 [cse_after_recomputation]: 2.172e-05, [1] [Cycle 1]: 1.622e-05, [1] [cse]: 1.053e-05 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 3.99002e-06 [opt_after_jit_grad]: 0.00045485 [symbol_engine_optimizer]: 9.992e-05, [1] [Cycle 1]: 9.331e-05, [6] [build]: 3.20002e-06 [elim_shapecalc]: 2.908e-05 [elim_not_effective]: 1.426e-05 [opt_reshape]: 6.81001e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 5.50004e-07 [validate]: 3.696e-05 Sums bootstrap : 0.000258s : 0.60% type_inference : 0.038065s : 88.31% event_method : 0.000019s : 0.04% auto_monad : 0.000065s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000228s : 0.53% rewriter_before_opt_a : 0.000081s : 0.19% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.15% jit_opt_a.loop_unroll : 0.000037s : 0.09% jit_opt_a.a_1 : 0.000677s : 1.57% jit_opt_a.with_stream_mark : 0.000029s : 0.07% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001466s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.05% jit_opt_a.cse : 0.000042s : 0.10% jit_opt_a.replace_applicator : 0.000020s : 0.05% py_interpret_to_execute_after_opt_a : 0.000011s : 0.03% rewriter_after_opt_a : 0.000036s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000547s : 1.27% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000023s : 0.05% loop_unroll : 0.000413s : 0.96% jit_opt_after_cconv.c_1 : 0.000026s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000048s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000455s : 1.06% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000029s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.09% Time group info: ------[substitution.] 0.000194 24 1.12% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000002s : 2: substitution.fold_const_symbol 2.89% : 0.000006s : 4: substitution.graph_param_transform 82.50% : 0.000160s : 4: substitution.inline 1.91% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000004s : 2: substitution.replace_old_param 5.98% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037992 2 95.25% : 0.036189s : 1: type_inference.infer 4.75% : 0.001803s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.79% : 0.000047s : 4: replace.inline 31.21% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.80% : 0.000158s : 4: match.inline 6.20% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.11% : 0.000001s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.22% : 0.000002s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.72% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.46% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.27% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000010s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.44% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001556 18 65.58% : 0.001020s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.91% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.51% : 0.000506s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049371 72 0.10% : 0.000050s : 1: add_recomputation 0.14% : 0.000068s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.55% : 0.000272s : 1: bootstrap 0.05% : 0.000026s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.28% : 0.006062s : 1: jit_opt_a 0.30% : 0.000149s : 1: jit_opt_after_cconv 0.11% : 0.000055s : 1: jit_opt_b 0.85% : 0.000420s : 1: loop_unroll 1.12% : 0.000555s : 1: mutable_eliminate 1.84% : 0.000909s : 26: opt.transform.jit_opt_a 0.11% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000057s : 4: opt.transform.symbol_engine_opt 0.94% : 0.000463s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000233s : 1: py_interpret_to_execute 0.03% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.82% : 0.000900s : 1: renormalize.infer 1.13% : 0.000557s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000039s : 1: rewriter_after_opt_a 0.17% : 0.000086s : 1: rewriter_before_opt_a 0.21% : 0.000102s : 1: symbol_engine_optimizer 77.13% : 0.038080s : 1: type_inference TotalTime = 0.0122615, [30] [bootstrap]: 0.00026026 [type_inference]: 0.00447684 [event_method]: 1.767e-05 [auto_monad]: 6.439e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.83e-06 [py_interpret_to_execute]: 3.788e-05 [rewriter_before_opt_a]: 7.3e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.00516599, [2] [Cycle 1]: 0.00161008, [27] [switch_simplify]: 5.465e-05 [loop_unroll]: 3.95e-05 [a_1]: 0.00053272 [with_stream_mark]: 1.838e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.45e-06 [parameter_eliminate]: 2.12001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.433e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00064089 [add_forward_monad_depend]: 6.43998e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.499e-05 [cse]: 2.954e-05 [replace_applicator]: 1.261e-05 [Cycle 2]: 0.00033328, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.24e-06 [a_1]: 9.766e-05 [with_stream_mark]: 1.028e-05 [recompute_prepare]: 5.51e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 4.47e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 7.79002e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.62999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.06e-06 [cse]: 1.265e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.088e-05 [rewriter_after_opt_a]: 3.699e-05 [convert_after_rewriter]: 7.89002e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00054628 [jit_opt_b]: 5.122e-05, [1] [Cycle 1]: 4.459e-05, [2] [frontend_op_eliminate]: 1.705e-05 [inline_after_opt_a]: 1.668e-05 [cconv]: 2.573e-05 [loop_unroll]: 0.00044129 [jit_opt_after_cconv]: 0.00014474, [1] [Cycle 1]: 0.00013858, [11] [c_1]: 2.243e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 1.947e-05 [call_graph_tuple_transform]: 1.949e-05 [tuple_list_get_item_eliminator]: 5.56002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.81998e-06 [remove_dup_value]: 1.485e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 5.72001e-06 [add_recomputation]: 6.256e-05 [cse_after_recomputation]: 2.315e-05, [1] [Cycle 1]: 1.727e-05, [1] [cse]: 1.114e-05 [auto_monad_reorder]: 1.643e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 4.79998e-06 [opt_after_jit_grad]: 0.00047823 [symbol_engine_optimizer]: 7.091e-05, [1] [Cycle 1]: 6.507e-05, [6] [build]: 3.25002e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.237e-05 [opt_reshape]: 5.84999e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 3.10014e-07 [validate]: 3.433e-05 Sums bootstrap : 0.000260s : 3.07% type_inference : 0.004477s : 52.86% event_method : 0.000018s : 0.21% auto_monad : 0.000064s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000038s : 0.45% rewriter_before_opt_a : 0.000073s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000061s : 0.72% jit_opt_a.loop_unroll : 0.000045s : 0.53% jit_opt_a.a_1 : 0.000630s : 7.44% jit_opt_a.with_stream_mark : 0.000029s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000641s : 7.57% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.10% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000042s : 0.50% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000037s : 0.44% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000546s : 6.45% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000017s : 0.20% cconv : 0.000026s : 0.30% loop_unroll : 0.000441s : 5.21% jit_opt_after_cconv.c_1 : 0.000022s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000063s : 0.74% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000478s : 5.65% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.41% Time group info: ------[substitution.] 0.000200 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.92% : 0.000006s : 3: substitution.graph_param_transform 83.48% : 0.000167s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000004s : 2: substitution.replace_old_param 5.99% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004420 2 80.91% : 0.003576s : 1: type_inference.infer 19.09% : 0.000844s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.06% : 0.000045s : 4: replace.inline 32.94% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.78% : 0.000165s : 4: match.inline 6.22% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000002s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000007s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.17% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.04% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.67% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.86% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.88% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000625 13 51.71% : 0.000323s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.48% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.82% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013813 72 0.48% : 0.000066s : 1: add_recomputation 0.49% : 0.000068s : 1: auto_monad 0.14% : 0.000019s : 1: auto_monad_reorder 2.00% : 0.000276s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.42% : 0.005169s : 1: jit_opt_a 1.07% : 0.000148s : 1: jit_opt_after_cconv 0.39% : 0.000054s : 1: jit_opt_b 3.25% : 0.000450s : 1: loop_unroll 4.02% : 0.000555s : 1: mutable_eliminate 6.16% : 0.000850s : 26: opt.transform.jit_opt_a 0.36% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.52% : 0.000487s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000040s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.51% : 0.000347s : 1: renormalize.infer 2.07% : 0.000286s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.29% : 0.000040s : 1: rewriter_after_opt_a 0.55% : 0.000076s : 1: rewriter_before_opt_a 0.53% : 0.000073s : 1: symbol_engine_optimizer 32.51% : 0.004490s : 1: type_inference TotalTime = 0.0122653, [30] [bootstrap]: 0.00027831 [type_inference]: 0.00475772 [event_method]: 1.769e-05 [auto_monad]: 6.583e-05 [graph_reusing]: 5.96998e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 4.094e-05 [rewriter_before_opt_a]: 7.354e-05 [expand_dump_flag]: 2.95998e-06 [jit_opt_a]: 0.00496795, [2] [Cycle 1]: 0.00158172, [27] [switch_simplify]: 5.204e-05 [loop_unroll]: 3.008e-05 [a_1]: 0.00052025 [with_stream_mark]: 1.678e-05 [recompute_prepare]: 7.45e-06 [updatestate_depend_eliminate]: 3.56001e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 2.07001e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.58e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 9.12999e-06 [inline_without_move]: 5.24e-06 [renormalize]: 0.00065221 [add_forward_monad_depend]: 5.46002e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 1.43e-05 [cse]: 2.748e-05 [replace_applicator]: 1.231e-05 [Cycle 2]: 0.00030946, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 4.85999e-06 [a_1]: 8.984e-05 [with_stream_mark]: 8.64998e-06 [recompute_prepare]: 4.88001e-06 [updatestate_depend_eliminate]: 2.48e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 1.93002e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.75001e-06 [accelerated_algorithm]: 4.70001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 7.73001e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 7.05998e-06 [inline_without_move]: 4.49002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 1.144e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 9.62999e-06 [rewriter_after_opt_a]: 3.334e-05 [convert_after_rewriter]: 7.11001e-06 [order_py_execute_after_rewriter]: 4.77998e-06 [mutable_eliminate]: 0.00049427 [jit_opt_b]: 4.818e-05, [1] [Cycle 1]: 4.198e-05, [2] [frontend_op_eliminate]: 1.581e-05 [inline_after_opt_a]: 1.527e-05 [cconv]: 2.413e-05 [loop_unroll]: 0.00041208 [jit_opt_after_cconv]: 0.00013907, [1] [Cycle 1]: 0.00013287, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.79e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.08998e-06 [cse]: 2.001e-05 [call_graph_tuple_transform]: 1.922e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.56e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 5.58002e-06 [add_recomputation]: 4.798e-05 [cse_after_recomputation]: 2.406e-05, [1] [Cycle 1]: 1.823e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.611e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.30001e-06 [opt_after_jit_grad]: 0.00048999 [symbol_engine_optimizer]: 6.894e-05, [1] [Cycle 1]: 6.335e-05, [6] [build]: 3.45e-06 [elim_shapecalc]: 7.34002e-06 [elim_not_effective]: 1.253e-05 [opt_reshape]: 5.42001e-06 [fold_const_symbol]: 8.24002e-06 [renormalize]: 3.69997e-07 [validate]: 3.253e-05 Sums bootstrap : 0.000278s : 3.22% type_inference : 0.004758s : 55.06% event_method : 0.000018s : 0.20% auto_monad : 0.000066s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000041s : 0.47% rewriter_before_opt_a : 0.000074s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000610s : 7.06% jit_opt_a.with_stream_mark : 0.000025s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000652s : 7.55% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000039s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000033s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000494s : 5.72% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000024s : 0.28% loop_unroll : 0.000412s : 4.77% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000048s : 0.56% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000490s : 5.67% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.38% Time group info: ------[substitution.] 0.000186 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000005s : 3: substitution.graph_param_transform 82.86% : 0.000154s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.37% : 0.000004s : 2: substitution.replace_old_param 5.92% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004699 2 79.35% : 0.003728s : 1: type_inference.infer 20.65% : 0.000970s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.63% : 0.000045s : 4: replace.inline 32.37% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.89% : 0.000151s : 4: match.inline 6.11% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.29% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.09% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.48% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.73% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.15% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.99% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.73% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.58% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000654 13 49.96% : 0.000327s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.84% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.20% : 0.000296s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013785 72 0.37% : 0.000051s : 1: add_recomputation 0.50% : 0.000069s : 1: auto_monad 0.13% : 0.000019s : 1: auto_monad_reorder 2.14% : 0.000295s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.06% : 0.004971s : 1: jit_opt_a 1.03% : 0.000142s : 1: jit_opt_after_cconv 0.37% : 0.000051s : 1: jit_opt_b 3.05% : 0.000420s : 1: loop_unroll 3.64% : 0.000502s : 1: mutable_eliminate 5.92% : 0.000816s : 26: opt.transform.jit_opt_a 0.35% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.61% : 0.000498s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000043s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.44% : 0.000336s : 1: renormalize.infer 2.23% : 0.000307s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.55% : 0.000076s : 1: rewriter_before_opt_a 0.52% : 0.000071s : 1: symbol_engine_optimizer 34.60% : 0.004770s : 1: type_inference TotalTime = 0.118949, [30] [bootstrap]: 0.00028468 [type_inference]: 0.108135 [event_method]: 2.218e-05 [auto_monad]: 7.071e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.33998e-06 [py_interpret_to_execute]: 0.00053872 [rewriter_before_opt_a]: 9.038e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00747166, [2] [Cycle 1]: 0.00384237, [27] [switch_simplify]: 5.666e-05 [loop_unroll]: 3.371e-05 [a_1]: 0.00067737 [with_stream_mark]: 1.663e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.81001e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 3.54002e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.429e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.64e-06 [inline_without_move]: 6.29001e-06 [renormalize]: 0.00270858 [add_forward_monad_depend]: 6.66e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.536e-05 [cse]: 3.265e-05 [replace_applicator]: 1.509e-05 [Cycle 2]: 0.00037927, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012914 [with_stream_mark]: 1.171e-05 [recompute_prepare]: 5.98002e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.89999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.416e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.62001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.377e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 3.852e-05 [rewriter_after_opt_a]: 3.787e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.0006155 [jit_opt_b]: 6.378e-05, [1] [Cycle 1]: 5.675e-05, [2] [frontend_op_eliminate]: 2.71e-05 [inline_after_opt_a]: 1.815e-05 [cconv]: 2.734e-05 [loop_unroll]: 0.00041808 [jit_opt_after_cconv]: 0.00014971, [1] [Cycle 1]: 0.00014353, [11] [c_1]: 2.492e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.46998e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 2.174e-05 [call_graph_tuple_transform]: 2e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.592e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 7.87e-06 [add_recomputation]: 4.652e-05 [cse_after_recomputation]: 2.41e-05, [1] [Cycle 1]: 1.896e-05, [1] [cse]: 1.231e-05 [auto_monad_reorder]: 1.673e-05 [get_jit_bprop_graph]: 3.04999e-06 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.00047975 [symbol_engine_optimizer]: 7.893e-05, [1] [Cycle 1]: 7.263e-05, [6] [build]: 3.53999e-06 [elim_shapecalc]: 1.134e-05 [elim_not_effective]: 1.379e-05 [opt_reshape]: 6.49001e-06 [fold_const_symbol]: 1.027e-05 [renormalize]: 4.00003e-07 [validate]: 0.00010348 Sums bootstrap : 0.000285s : 0.25% type_inference : 0.108135s : 93.94% event_method : 0.000022s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000539s : 0.47% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000807s : 0.70% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002709s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000039s : 0.03% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000616s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000027s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000418s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000480s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000103s : 0.09% Time group info: ------[substitution.] 0.000256 28 1.19% : 0.000003s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000005s : 4: substitution.graph_param_transform 82.37% : 0.000211s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.57% : 0.000012s : 3: substitution.reduce_eliminate 1.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.69% : 0.000004s : 2: substitution.replace_old_param 4.09% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108057 2 97.31% : 0.105155s : 1: type_inference.infer 2.69% : 0.002902s : 1: type_inference.specialize ------[replace.] 0.000108 7 73.61% : 0.000079s : 5: replace.inline 26.39% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000217 7 95.68% : 0.000207s : 5: match.inline 4.32% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.25% : 0.000002s : 13: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.46% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000007s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.12% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.36% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.74% : 0.000001s : 4: predicate.reset_defer_inline 1.49% : 0.000002s : 13: predicate.reshape_eliminate 1.25% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.08% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.33% : 0.000010s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002261 25 63.35% : 0.001432s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.03% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.62% : 0.000760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122723 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000300s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.09% : 0.007475s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000066s : 1: jit_opt_b 0.35% : 0.000426s : 1: loop_unroll 0.51% : 0.000624s : 1: mutable_eliminate 0.85% : 0.001045s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000547s : 1: py_interpret_to_execute 0.03% : 0.000042s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.57% : 0.001922s : 1: renormalize.infer 0.63% : 0.000776s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000081s : 1: symbol_engine_optimizer 88.13% : 0.108152s : 1: type_inference TotalTime = 0.111346, [30] [bootstrap]: 0.00027314 [type_inference]: 0.101354 [event_method]: 2.121e-05 [auto_monad]: 6.798e-05 [graph_reusing]: 5.67001e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00039989 [rewriter_before_opt_a]: 8.302e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00701773, [2] [Cycle 1]: 0.0033794, [27] [switch_simplify]: 5.421e-05 [loop_unroll]: 3.142e-05 [a_1]: 0.00056295 [with_stream_mark]: 1.87e-05 [recompute_prepare]: 8.92e-06 [updatestate_depend_eliminate]: 3.93001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.67001e-06 [parameter_eliminate]: 1.82999e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.533e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00238008 [add_forward_monad_depend]: 5.94e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.487e-05 [cse]: 2.937e-05 [replace_applicator]: 1.553e-05 [Cycle 2]: 0.00036105, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 5.74999e-06 [a_1]: 0.00012124 [with_stream_mark]: 1.038e-05 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 5.44998e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.28e-06 [cell_reuse_recompute_pass]: 2.34001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 9.18002e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 8.12998e-06 [inline_without_move]: 5.49e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 6.49999e-06 [cse]: 1.118e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 9.60001e-06 [rewriter_after_opt_a]: 3.205e-05 [convert_after_rewriter]: 1.92e-05 [order_py_execute_after_rewriter]: 5.33002e-06 [mutable_eliminate]: 0.00053052 [jit_opt_b]: 5.415e-05, [1] [Cycle 1]: 4.778e-05, [2] [frontend_op_eliminate]: 1.892e-05 [inline_after_opt_a]: 1.753e-05 [cconv]: 2.701e-05 [loop_unroll]: 0.00043029 [jit_opt_after_cconv]: 0.00014445, [1] [Cycle 1]: 0.00013807, [11] [c_1]: 2.568e-05 [parameter_eliminate]: 2.38002e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.69999e-06 [cse]: 1.865e-05 [call_graph_tuple_transform]: 1.962e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.425e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 7.35998e-06 [add_recomputation]: 4.563e-05 [cse_after_recomputation]: 2.115e-05, [1] [Cycle 1]: 1.599e-05, [1] [cse]: 1.058e-05 [auto_monad_reorder]: 1.459e-05 [get_jit_bprop_graph]: 2.63e-06 [rewriter_after_jit_bprop_graph]: 4.28999e-06 [opt_after_jit_grad]: 0.00045688 [symbol_engine_optimizer]: 7.654e-05, [1] [Cycle 1]: 7.05e-05, [6] [build]: 3.47002e-06 [elim_shapecalc]: 9.51e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 4.00003e-07 [validate]: 4.428e-05 Sums bootstrap : 0.000273s : 0.25% type_inference : 0.101354s : 94.28% event_method : 0.000021s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000400s : 0.37% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000684s : 0.64% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002380s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000019s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000531s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000430s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000457s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000202 24 1.67% : 0.000003s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 4: substitution.graph_param_transform 82.72% : 0.000167s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000004s : 2: substitution.replace_old_param 5.96% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101279 2 97.54% : 0.098790s : 1: type_inference.infer 2.46% : 0.002489s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.06% : 0.000046s : 4: replace.inline 31.94% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.78% : 0.000165s : 4: match.inline 6.22% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.31% : 0.000002s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.70% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.56% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001972 22 66.46% : 0.001311s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.88% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.66% : 0.000624s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114710 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000289s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.02% : 0.000022s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.12% : 0.007021s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.38% : 0.000438s : 1: loop_unroll 0.47% : 0.000540s : 1: mutable_eliminate 0.80% : 0.000914s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000406s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.44% : 0.001646s : 1: renormalize.infer 0.63% : 0.000725s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000089s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.37% : 0.101372s : 1: type_inference TotalTime = 0.120296, [30] [bootstrap]: 0.00029974 [type_inference]: 0.108661 [event_method]: 2.288e-05 [auto_monad]: 7.14e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00053065 [rewriter_before_opt_a]: 0.00010049 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00813174, [2] [Cycle 1]: 0.00431095, [27] [switch_simplify]: 6.568e-05 [loop_unroll]: 3.355e-05 [a_1]: 0.0007191 [with_stream_mark]: 1.977e-05 [recompute_prepare]: 8.85001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.05998e-06 [updatestate_useless_node_eliminater]: 6.41e-06 [accelerated_algorithm]: 6.93e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.576e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 1.096e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00311195 [add_forward_monad_depend]: 6.53998e-06 [auto_monad_grad]: 2.65002e-06 [auto_monad_eliminator]: 1.628e-05 [cse]: 3.54e-05 [replace_applicator]: 1.704e-05 [Cycle 2]: 0.00038676, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 6.12001e-06 [a_1]: 0.0001347 [with_stream_mark]: 1.163e-05 [recompute_prepare]: 6.51e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.68002e-06 [accelerated_algorithm]: 6.59001e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 2.74999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.299e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 2.01998e-06 [replace_old_param]: 9.73998e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.384e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 1.354e-05 [rewriter_after_opt_a]: 3.759e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00062214 [jit_opt_b]: 9.062e-05, [1] [Cycle 1]: 8.372e-05, [2] [frontend_op_eliminate]: 5.23e-05 [inline_after_opt_a]: 1.886e-05 [cconv]: 2.551e-05 [loop_unroll]: 0.00044224 [jit_opt_after_cconv]: 0.00016137, [1] [Cycle 1]: 0.00015418, [11] [c_1]: 2.653e-05 [parameter_eliminate]: 2.97002e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.471e-05 [call_graph_tuple_transform]: 2.146e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.925e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 7.35998e-06 [add_recomputation]: 4.974e-05 [cse_after_recomputation]: 2.556e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.775e-05 [get_jit_bprop_graph]: 2.01998e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00047718 [symbol_engine_optimizer]: 0.00018954, [1] [Cycle 1]: 0.00018325, [6] [build]: 3.2e-06 [elim_shapecalc]: 1.175e-05 [elim_not_effective]: 1.503e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 0.00011804 [renormalize]: 6.39993e-07 [validate]: 4.785e-05 Sums bootstrap : 0.000300s : 0.26% type_inference : 0.108661s : 93.50% event_method : 0.000023s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000531s : 0.46% rewriter_before_opt_a : 0.000100s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000072s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000854s : 0.73% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003112s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000622s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000052s : 0.05% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000442s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000477s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000118s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000399 28 0.51% : 0.000002s : 2: substitution.elim_not_effective 27.22% : 0.000109s : 2: substitution.fold_const_symbol 1.60% : 0.000006s : 4: substitution.graph_param_transform 60.90% : 0.000243s : 5: substitution.inline 0.95% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.78% : 0.000011s : 3: substitution.reduce_eliminate 1.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.46% : 0.000006s : 2: substitution.replace_old_param 3.30% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108573 2 97.08% : 0.105400s : 1: type_inference.infer 2.92% : 0.003173s : 1: type_inference.specialize ------[replace.] 0.000104 7 69.70% : 0.000072s : 5: replace.inline 30.30% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000252 7 95.27% : 0.000240s : 5: match.inline 4.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.37% : 0.000002s : 13: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.71% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.20% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.97% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 19: predicate.load_eliminater 1.15% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 19: predicate.partial_eliminate 1.31% : 0.000002s : 13: predicate.print_const_string_wrapper 2.01% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 1.06% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 64: predicate.switch_simplify 1.24% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.80% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002381 25 62.23% : 0.001481s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.29% : 0.000078s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.48% : 0.000821s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124692 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000315s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000007s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.52% : 0.008135s : 1: jit_opt_a 0.13% : 0.000164s : 1: jit_opt_after_cconv 0.07% : 0.000093s : 1: jit_opt_b 0.36% : 0.000452s : 1: loop_unroll 0.51% : 0.000630s : 1: mutable_eliminate 0.89% : 0.001105s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000065s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000148s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000538s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.80% : 0.002250s : 1: renormalize.infer 0.68% : 0.000852s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.09% : 0.000106s : 1: rewriter_before_opt_a 0.15% : 0.000192s : 1: symbol_engine_optimizer 87.16% : 0.108679s : 1: type_inference TotalTime = 0.112431, [30] [bootstrap]: 0.00026541 [type_inference]: 0.102267 [event_method]: 2.005e-05 [auto_monad]: 6.541e-05 [graph_reusing]: 5.87001e-06 [pre_auto_parallel]: 2.59999e-06 [py_interpret_to_execute]: 0.00041538 [rewriter_before_opt_a]: 8.701e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00707665, [2] [Cycle 1]: 0.00344296, [27] [switch_simplify]: 5.303e-05 [loop_unroll]: 3.128e-05 [a_1]: 0.00056355 [with_stream_mark]: 1.903e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.29001e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 7.356e-05 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 6.51e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 9.73002e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.50001e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.0023737 [add_forward_monad_depend]: 6.31998e-06 [auto_monad_grad]: 2.94999e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 2.891e-05 [replace_applicator]: 1.485e-05 [Cycle 2]: 0.00036029, [27] [switch_simplify]: 6.97002e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.00011892 [with_stream_mark]: 1.026e-05 [recompute_prepare]: 5.95002e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.54998e-06 [accelerated_algorithm]: 5.53002e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 1.98002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24003e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.117e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 1.185e-05 [rewriter_after_opt_a]: 4.189e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 5.24998e-06 [mutable_eliminate]: 0.00055627 [jit_opt_b]: 5.403e-05, [1] [Cycle 1]: 4.739e-05, [2] [frontend_op_eliminate]: 1.967e-05 [inline_after_opt_a]: 1.692e-05 [cconv]: 2.606e-05 [loop_unroll]: 0.0004515 [jit_opt_after_cconv]: 0.00014814, [1] [Cycle 1]: 0.00014165, [11] [c_1]: 2.554e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.014e-05 [call_graph_tuple_transform]: 1.998e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 1.64e-05 [partial_unused_args_eliminate]: 2.94999e-06 [environ_conv]: 7.85e-06 [add_recomputation]: 4.788e-05 [cse_after_recomputation]: 2.173e-05, [1] [Cycle 1]: 1.65e-05, [1] [cse]: 1.092e-05 [auto_monad_reorder]: 1.382e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.19e-06 [opt_after_jit_grad]: 0.00045126 [symbol_engine_optimizer]: 7.464e-05, [1] [Cycle 1]: 6.794e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.346e-05 [opt_reshape]: 7.38e-06 [fold_const_symbol]: 9.07001e-06 [renormalize]: 2.80008e-07 [validate]: 9.573e-05 Sums bootstrap : 0.000265s : 0.24% type_inference : 0.102267s : 94.19% event_method : 0.000020s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000415s : 0.38% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000682s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000079s : 0.07% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002374s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000556s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000452s : 0.42% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000451s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000096s : 0.09% Time group info: ------[substitution.] 0.000208 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000006s : 4: substitution.graph_param_transform 84.11% : 0.000175s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000005s : 2: substitution.replace_old_param 5.43% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102192 2 97.52% : 0.099656s : 1: type_inference.infer 2.48% : 0.002535s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.43% : 0.000047s : 4: replace.inline 32.57% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 94.38% : 0.000172s : 4: match.inline 5.62% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000194 830 0.87% : 0.000002s : 12: predicate.accumulaten_eliminater 0.71% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.76% : 0.000001s : 12: predicate.addn_check_dump 0.77% : 0.000001s : 12: predicate.addn_zero_filter 1.28% : 0.000002s : 12: predicate.arithmetic_simplify 0.94% : 0.000002s : 12: predicate.cast_eliminate 0.33% : 0.000001s : 4: predicate.check_bprop_eliminate 0.80% : 0.000002s : 12: predicate.compare_switch_simplify 0.78% : 0.000002s : 12: predicate.depend_value_elim 0.80% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 0.78% : 0.000002s : 12: predicate.dict_get_item_eliminator 0.78% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.62% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.25% : 0.000000s : 4: predicate.elim_not_effective 0.40% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 0.81% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.71% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.72% : 0.000001s : 12: predicate.environ_get_depend_swap 0.91% : 0.000002s : 12: predicate.environ_get_eliminate 0.75% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000002s : 8: predicate.get_grad_eliminate 0.23% : 0.000000s : 4: predicate.graph_param_transform 3.63% : 0.000007s : 26: predicate.inline 0.68% : 0.000001s : 8: predicate.inline_without_move 0.34% : 0.000001s : 8: predicate.j_node_and_user_rematch 34.98% : 0.000068s : 8: predicate.less_batch_normalization 0.91% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.18% : 0.000002s : 18: predicate.load_eliminater 0.83% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.45% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.43% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.72% : 0.000001s : 12: predicate.merge_addn 0.70% : 0.000001s : 12: predicate.minmaximum_grad 0.97% : 0.000002s : 4: predicate.mutable_eliminate 0.33% : 0.000001s : 4: predicate.opt_reshape 1.55% : 0.000003s : 18: predicate.partial_eliminate 0.76% : 0.000001s : 12: predicate.print_const_string_wrapper 1.18% : 0.000002s : 12: predicate.reduce_eliminate 0.95% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 8: predicate.remove_not_recompute_node 1.43% : 0.000003s : 22: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.24% : 0.000000s : 4: predicate.reset_defer_inline 0.79% : 0.000002s : 12: predicate.reshape_eliminate 0.84% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.44% : 0.000001s : 4: predicate.row_tensor_eliminate 0.78% : 0.000002s : 12: predicate.same_eliminate 0.44% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.79% : 0.000002s : 8: predicate.special_op_eliminate 0.68% : 0.000001s : 8: predicate.specialize_transform 0.93% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.80% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.33% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.56% : 0.000003s : 18: predicate.switch_defer_inline 1.50% : 0.000003s : 18: predicate.switch_layer_defer_inline 4.81% : 0.000009s : 58: predicate.switch_simplify 0.78% : 0.000002s : 12: predicate.tile_eliminate 0.79% : 0.000002s : 12: predicate.transpose_eliminate 0.93% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.82% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 2.60% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.11% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 0.93% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.13% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 1.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.13% : 0.000002s : 12: predicate.value_based_eliminate 0.27% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.41% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002073 22 67.98% : 0.001409s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.93% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.09% : 0.000624s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115794 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000282s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.11% : 0.007080s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.40% : 0.000460s : 1: loop_unroll 0.49% : 0.000565s : 1: mutable_eliminate 0.85% : 0.000979s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000422s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.47% : 0.001707s : 1: renormalize.infer 0.57% : 0.000657s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000045s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 88.33% : 0.102284s : 1: type_inference TotalTime = 0.117952, [30] [bootstrap]: 0.00029531 [type_inference]: 0.10708 [event_method]: 2.091e-05 [auto_monad]: 7.016e-05 [graph_reusing]: 6.64001e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.0005157 [rewriter_before_opt_a]: 9.17e-05 [expand_dump_flag]: 3.14999e-06 [jit_opt_a]: 0.0076449, [2] [Cycle 1]: 0.00406171, [27] [switch_simplify]: 5.745e-05 [loop_unroll]: 3.318e-05 [a_1]: 0.00067144 [with_stream_mark]: 1.675e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.375e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 6.16e-06 [renormalize]: 0.00294846 [add_forward_monad_depend]: 4.81002e-06 [auto_monad_grad]: 2.15002e-06 [auto_monad_eliminator]: 1.432e-05 [cse]: 3.038e-05 [replace_applicator]: 1.541e-05 [Cycle 2]: 0.00037356, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.89e-06 [a_1]: 0.00012814 [with_stream_mark]: 1.171e-05 [recompute_prepare]: 6.28998e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.08002e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 2.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.313e-05 [j_node_and_user_rematch]: 9.24e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 8.54e-06 [inline_without_move]: 5.66e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.273e-05 [replace_applicator]: 5.90002e-06 [py_interpret_to_execute_after_opt_a]: 1.212e-05 [rewriter_after_opt_a]: 3.446e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.30001e-06 [mutable_eliminate]: 0.00058647 [jit_opt_b]: 5.382e-05, [1] [Cycle 1]: 4.709e-05, [2] [frontend_op_eliminate]: 1.863e-05 [inline_after_opt_a]: 1.774e-05 [cconv]: 2.373e-05 [loop_unroll]: 0.00041409 [jit_opt_after_cconv]: 0.00014412, [1] [Cycle 1]: 0.00013777, [11] [c_1]: 2.554e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 4.76002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.068e-05 [call_graph_tuple_transform]: 1.922e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.86998e-06 [remove_dup_value]: 1.589e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 7.68001e-06 [add_recomputation]: 4.503e-05 [cse_after_recomputation]: 2.27e-05, [1] [Cycle 1]: 1.769e-05, [1] [cse]: 1.162e-05 [auto_monad_reorder]: 1.804e-05 [get_jit_bprop_graph]: 2.21e-06 [rewriter_after_jit_bprop_graph]: 5.04e-06 [opt_after_jit_grad]: 0.00048162 [symbol_engine_optimizer]: 0.00013338, [1] [Cycle 1]: 0.0001269, [6] [build]: 2.91999e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 7.016e-05 [opt_reshape]: 6.91999e-06 [fold_const_symbol]: 9.74e-06 [renormalize]: 4.19997e-07 [validate]: 3.952e-05 Sums bootstrap : 0.000295s : 0.26% type_inference : 0.107080s : 93.79% event_method : 0.000021s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000516s : 0.45% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000800s : 0.70% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002949s : 2.58% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000586s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000414s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000482s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000070s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000245 28 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000005s : 4: substitution.graph_param_transform 82.24% : 0.000201s : 5: substitution.inline 1.47% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.60% : 0.000011s : 3: substitution.reduce_eliminate 1.81% : 0.000004s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 4.62% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107008 2 97.11% : 0.103920s : 1: type_inference.infer 2.89% : 0.003088s : 1: type_inference.specialize ------[replace.] 0.000104 7 68.14% : 0.000071s : 5: replace.inline 31.86% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000209 7 95.21% : 0.000199s : 5: match.inline 4.79% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 886 1.33% : 0.000002s : 13: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 13: predicate.addn_check_dump 1.42% : 0.000002s : 13: predicate.addn_zero_filter 1.77% : 0.000002s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000001s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.22% : 0.000002s : 13: predicate.environ_get_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 19: predicate.load_eliminater 1.01% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.26% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.41% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 23: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 64: predicate.switch_simplify 1.47% : 0.000002s : 13: predicate.tile_eliminate 1.27% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002348 25 61.96% : 0.001455s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.58% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.47% : 0.000833s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122010 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000313s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.27% : 0.007648s : 1: jit_opt_a 0.12% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.34% : 0.000421s : 1: loop_unroll 0.49% : 0.000594s : 1: mutable_eliminate 0.85% : 0.001037s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000488s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000521s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.72% : 0.002101s : 1: renormalize.infer 0.69% : 0.000838s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.11% : 0.000136s : 1: symbol_engine_optimizer 87.77% : 0.107093s : 1: type_inference TotalTime = 0.0564306, [30] [bootstrap]: 0.0002903 [type_inference]: 0.0473507 [event_method]: 1.777e-05 [auto_monad]: 6.211e-05 [graph_reusing]: 5.30999e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.0002388 [rewriter_before_opt_a]: 8.176e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.00625148, [2] [Cycle 1]: 0.00272239, [27] [switch_simplify]: 5.414e-05 [loop_unroll]: 3.01e-05 [a_1]: 0.00053914 [with_stream_mark]: 1.666e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 3.59002e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.72002e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 2.44999e-06 [get_grad_eliminate_]: 5.98998e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.447e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.78002e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00175917 [add_forward_monad_depend]: 5.27001e-06 [auto_monad_grad]: 2.53003e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 2.751e-05 [replace_applicator]: 1.36e-05 [Cycle 2]: 0.00034828, [27] [switch_simplify]: 6.28e-06 [loop_unroll]: 5.69999e-06 [a_1]: 0.0001188 [with_stream_mark]: 9.26998e-06 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 2.70002e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.23002e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 5.14003e-06 [merge_forward]: 2.43002e-06 [cell_reuse_recompute_pass]: 1.75001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.345e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.82998e-06 [inline_without_move]: 5.21002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.63002e-06 [cse]: 1.056e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.013e-05 [rewriter_after_opt_a]: 3.363e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00052672 [jit_opt_b]: 5.31e-05, [1] [Cycle 1]: 4.633e-05, [2] [frontend_op_eliminate]: 1.852e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 2.402e-05 [loop_unroll]: 0.00042226 [jit_opt_after_cconv]: 0.00014377, [1] [Cycle 1]: 0.00013755, [11] [c_1]: 2.534e-05 [parameter_eliminate]: 2.38998e-06 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 1.827e-05 [call_graph_tuple_transform]: 2.003e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.483e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 7.41001e-06 [add_recomputation]: 4.58e-05 [cse_after_recomputation]: 4.233e-05, [1] [Cycle 1]: 3.721e-05, [1] [cse]: 3.079e-05 [auto_monad_reorder]: 1.515e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.00047482 [symbol_engine_optimizer]: 8.794e-05, [1] [Cycle 1]: 8.191e-05, [6] [build]: 3.13998e-06 [elim_shapecalc]: 7.48e-06 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.73003e-06 [fold_const_symbol]: 9.71998e-06 [renormalize]: 3.50003e-07 [validate]: 3.653e-05 Sums bootstrap : 0.000290s : 0.55% type_inference : 0.047351s : 89.88% event_method : 0.000018s : 0.03% auto_monad : 0.000062s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000239s : 0.45% rewriter_before_opt_a : 0.000082s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000658s : 1.25% jit_opt_a.with_stream_mark : 0.000026s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001759s : 3.34% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000038s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000527s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.05% loop_unroll : 0.000422s : 0.80% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.09% cse_after_recomputation.cse : 0.000031s : 0.06% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000475s : 0.90% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000185 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.23% : 0.000006s : 4: substitution.graph_param_transform 82.68% : 0.000153s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000004s : 2: substitution.replace_old_param 6.07% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047282 2 96.33% : 0.045549s : 1: type_inference.infer 3.67% : 0.001733s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.89% : 0.000046s : 4: replace.inline 33.11% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.76% : 0.000150s : 4: match.inline 6.24% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.33% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.58% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000001s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.44% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.65% : 0.000002s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 1.02% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000001s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001811 22 68.95% : 0.001249s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.64% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.41% : 0.000533s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059147 72 0.08% : 0.000049s : 1: add_recomputation 0.11% : 0.000065s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.52% : 0.000308s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.08% : 0.000045s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.58% : 0.006255s : 1: jit_opt_a 0.25% : 0.000146s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.73% : 0.000430s : 1: loop_unroll 0.91% : 0.000536s : 1: mutable_eliminate 1.49% : 0.000881s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.82% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000244s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.98% : 0.001172s : 1: renormalize.infer 0.98% : 0.000579s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000036s : 1: rewriter_after_opt_a 0.15% : 0.000087s : 1: rewriter_before_opt_a 0.15% : 0.000090s : 1: symbol_engine_optimizer 80.08% : 0.047363s : 1: type_inference TotalTime = 0.0113911, [30] [bootstrap]: 0.00025031 [type_inference]: 0.00423007 [event_method]: 1.586e-05 [auto_monad]: 5.163e-05 [graph_reusing]: 4.77e-06 [pre_auto_parallel]: 1.74e-06 [py_interpret_to_execute]: 3.512e-05 [rewriter_before_opt_a]: 6.447e-05 [expand_dump_flag]: 2.49999e-06 [jit_opt_a]: 0.00472394, [2] [Cycle 1]: 0.00146761, [27] [switch_simplify]: 4.892e-05 [loop_unroll]: 3.147e-05 [a_1]: 0.00048139 [with_stream_mark]: 1.519e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 5.56002e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.44001e-06 [cell_reuse_recompute_pass]: 9.90025e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.366e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 4.11e-05 [inline_without_move]: 6.08998e-06 [renormalize]: 0.00055491 [add_forward_monad_depend]: 5.22e-06 [auto_monad_grad]: 1.17999e-06 [auto_monad_eliminator]: 1.12e-05 [cse]: 1.946e-05 [replace_applicator]: 1.089e-05 [Cycle 2]: 0.00032785, [27] [switch_simplify]: 6.20002e-06 [loop_unroll]: 5.51e-06 [a_1]: 9.454e-05 [with_stream_mark]: 9.01002e-06 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 4.72e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 5.01002e-06 [merge_forward]: 2.75002e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.415e-05 [j_node_and_user_rematch]: 8.25e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 5.29e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.61998e-06 [cse]: 1.035e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 8.52e-06 [rewriter_after_opt_a]: 3.114e-05 [convert_after_rewriter]: 6.74001e-06 [order_py_execute_after_rewriter]: 4.68999e-06 [mutable_eliminate]: 0.00049472 [jit_opt_b]: 4.944e-05, [1] [Cycle 1]: 4.323e-05, [2] [frontend_op_eliminate]: 1.622e-05 [inline_after_opt_a]: 1.527e-05 [cconv]: 2.154e-05 [loop_unroll]: 0.00042846 [jit_opt_after_cconv]: 0.00014376, [1] [Cycle 1]: 0.00013737, [11] [c_1]: 2.326e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.54998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 1.918e-05 [call_graph_tuple_transform]: 1.777e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.71e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.37e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 5.62001e-06 [add_recomputation]: 5.695e-05 [cse_after_recomputation]: 2.211e-05, [1] [Cycle 1]: 1.665e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.432e-05 [get_jit_bprop_graph]: 1.49e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00044989 [symbol_engine_optimizer]: 6.95e-05, [1] [Cycle 1]: 6.373e-05, [6] [build]: 2.84001e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.245e-05 [opt_reshape]: 5.47001e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 4.59986e-07 [validate]: 3.088e-05 Sums bootstrap : 0.000250s : 3.16% type_inference : 0.004230s : 53.46% event_method : 0.000016s : 0.20% auto_monad : 0.000052s : 0.65% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.44% rewriter_before_opt_a : 0.000064s : 0.81% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.70% jit_opt_a.loop_unroll : 0.000037s : 0.47% jit_opt_a.a_1 : 0.000576s : 7.28% jit_opt_a.with_stream_mark : 0.000024s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.16% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.35% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000049s : 0.62% jit_opt_a.inline_without_move : 0.000011s : 0.14% jit_opt_a.renormalize : 0.000555s : 7.01% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.21% jit_opt_a.cse : 0.000030s : 0.38% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000031s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000495s : 6.25% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000022s : 0.27% loop_unroll : 0.000428s : 5.41% jit_opt_after_cconv.c_1 : 0.000023s : 0.29% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000014s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000057s : 0.72% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000014s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000450s : 5.69% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000031s : 0.39% Time group info: ------[substitution.] 0.000160 23 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.90% : 0.000001s : 2: substitution.fold_const_symbol 2.97% : 0.000005s : 3: substitution.graph_param_transform 82.26% : 0.000132s : 4: substitution.inline 1.86% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.28% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 5.45% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004181 2 80.55% : 0.003368s : 1: type_inference.infer 19.45% : 0.000813s : 1: type_inference.specialize ------[replace.] 0.000062 6 65.90% : 0.000041s : 4: replace.inline 34.10% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000137 6 94.42% : 0.000129s : 4: match.inline 5.58% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.87% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.99% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.14% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.04% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000572 13 50.54% : 0.000289s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.73% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.73% : 0.000256s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012837 72 0.47% : 0.000060s : 1: add_recomputation 0.43% : 0.000056s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.04% : 0.000262s : 1: bootstrap 0.19% : 0.000024s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.82% : 0.004727s : 1: jit_opt_a 1.14% : 0.000146s : 1: jit_opt_after_cconv 0.40% : 0.000052s : 1: jit_opt_b 3.40% : 0.000437s : 1: loop_unroll 3.92% : 0.000503s : 1: mutable_eliminate 6.39% : 0.000820s : 26: opt.transform.jit_opt_a 0.39% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.57% : 0.000458s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000038s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 2.13% : 0.000274s : 1: renormalize.infer 2.14% : 0.000274s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000034s : 1: rewriter_after_opt_a 0.52% : 0.000067s : 1: rewriter_before_opt_a 0.56% : 0.000072s : 1: symbol_engine_optimizer 33.04% : 0.004241s : 1: type_inference TotalTime = 0.0121279, [30] [bootstrap]: 0.00026542 [type_inference]: 0.0046915 [event_method]: 1.846e-05 [auto_monad]: 6.207e-05 [graph_reusing]: 5.61998e-06 [pre_auto_parallel]: 2.23002e-06 [py_interpret_to_execute]: 4.435e-05 [rewriter_before_opt_a]: 7.444e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00495886, [2] [Cycle 1]: 0.00154158, [27] [switch_simplify]: 5.354e-05 [loop_unroll]: 3.013e-05 [a_1]: 0.00051702 [with_stream_mark]: 1.65e-05 [recompute_prepare]: 6.99001e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.91999e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 6.21998e-06 [updatestate_useless_node_eliminater]: 5.10999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 5.44998e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.00060589 [add_forward_monad_depend]: 6.30997e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.631e-05 [cse]: 2.953e-05 [replace_applicator]: 1.284e-05 [Cycle 2]: 0.00031399, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.84998e-06 [a_1]: 9.103e-05 [with_stream_mark]: 8.55999e-06 [recompute_prepare]: 5.30001e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 4.58999e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 7.55e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.39002e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.88002e-06 [cse]: 1.109e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.036e-05 [rewriter_after_opt_a]: 3.262e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 4.96997e-06 [mutable_eliminate]: 0.00050125 [jit_opt_b]: 5.016e-05, [1] [Cycle 1]: 4.307e-05, [2] [frontend_op_eliminate]: 1.68e-05 [inline_after_opt_a]: 1.505e-05 [cconv]: 2.54e-05 [loop_unroll]: 0.00041382 [jit_opt_after_cconv]: 0.00013785, [1] [Cycle 1]: 0.00013152, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 1.917e-05 [call_graph_tuple_transform]: 1.867e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.10001e-06 [remove_dup_value]: 1.396e-05 [partial_unused_args_eliminate]: 3.15998e-06 [environ_conv]: 5.23002e-06 [add_recomputation]: 4.549e-05 [cse_after_recomputation]: 2.078e-05, [1] [Cycle 1]: 1.574e-05, [1] [cse]: 1.021e-05 [auto_monad_reorder]: 1.382e-05 [get_jit_bprop_graph]: 1.48002e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00045802 [symbol_engine_optimizer]: 6.997e-05, [1] [Cycle 1]: 6.403e-05, [6] [build]: 2.91e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.247e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 3.7998e-07 [validate]: 3.03e-05 Sums bootstrap : 0.000265s : 3.13% type_inference : 0.004691s : 55.28% event_method : 0.000018s : 0.22% auto_monad : 0.000062s : 0.73% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000044s : 0.52% rewriter_before_opt_a : 0.000074s : 0.88% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000060s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000608s : 7.16% jit_opt_a.with_stream_mark : 0.000025s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000606s : 7.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.26% jit_opt_a.cse : 0.000041s : 0.48% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000033s : 0.38% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000501s : 5.91% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.30% loop_unroll : 0.000414s : 4.88% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.04% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000045s : 0.54% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000014s : 0.16% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000458s : 5.40% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.36% Time group info: ------[substitution.] 0.000182 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.21% : 0.000006s : 3: substitution.graph_param_transform 82.06% : 0.000150s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.54% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000004s : 2: substitution.replace_old_param 6.71% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004637 2 79.53% : 0.003688s : 1: type_inference.infer 20.47% : 0.000949s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.34% : 0.000044s : 4: replace.inline 33.66% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 92.96% : 0.000147s : 4: match.inline 7.04% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 0.99% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.68% : 0.000002s : 3: predicate.mutable_eliminate 0.71% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.91% : 0.000002s : 18: predicate.replace_applicator 0.89% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.83% : 0.000009s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000638 13 50.23% : 0.000320s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.56% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.21% : 0.000288s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013618 72 0.36% : 0.000048s : 1: add_recomputation 0.48% : 0.000065s : 1: auto_monad 0.12% : 0.000016s : 1: auto_monad_reorder 2.04% : 0.000278s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.43% : 0.004961s : 1: jit_opt_a 1.03% : 0.000141s : 1: jit_opt_after_cconv 0.39% : 0.000053s : 1: jit_opt_b 3.09% : 0.000421s : 1: loop_unroll 3.75% : 0.000511s : 1: mutable_eliminate 6.00% : 0.000817s : 26: opt.transform.jit_opt_a 0.34% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000466s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000047s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.16% : 0.000295s : 1: renormalize.infer 2.23% : 0.000303s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.57% : 0.000077s : 1: rewriter_before_opt_a 0.53% : 0.000073s : 1: symbol_engine_optimizer 34.54% : 0.004703s : 1: type_inference TotalTime = 0.121026, [30] [bootstrap]: 0.00028436 [type_inference]: 0.108782 [event_method]: 2.285e-05 [auto_monad]: 7.307e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.0004902 [rewriter_before_opt_a]: 9.883e-05 [expand_dump_flag]: 3.44001e-06 [jit_opt_a]: 0.00863731, [2] [Cycle 1]: 0.00449204, [27] [switch_simplify]: 6.916e-05 [loop_unroll]: 3.477e-05 [a_1]: 0.00075784 [with_stream_mark]: 1.939e-05 [recompute_prepare]: 8.88002e-06 [updatestate_depend_eliminate]: 4.53001e-06 [updatestate_assign_eliminate]: 3.79002e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 7.08998e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.53e-05 [j_node_and_user_rematch]: 1.032e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 1.117e-05 [inline_without_move]: 6.75002e-06 [renormalize]: 0.00324331 [add_forward_monad_depend]: 6.16998e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 3.43e-05 [replace_applicator]: 1.632e-05 [Cycle 2]: 0.00039716, [27] [switch_simplify]: 7.48e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.00013305 [with_stream_mark]: 1.127e-05 [recompute_prepare]: 6.35002e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 1.779e-05 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 5.52001e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.80001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 9.14e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 5.70001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29003e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.421e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 1.413e-05 [rewriter_after_opt_a]: 3.95e-05 [convert_after_rewriter]: 6.73998e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00069208 [jit_opt_b]: 5.797e-05, [1] [Cycle 1]: 5.04e-05, [2] [frontend_op_eliminate]: 2.027e-05 [inline_after_opt_a]: 1.8e-05 [cconv]: 2.808e-05 [loop_unroll]: 0.00049639 [jit_opt_after_cconv]: 0.00016853, [1] [Cycle 1]: 0.00016143, [11] [c_1]: 2.657e-05 [parameter_eliminate]: 3.18e-06 [updatestate_depend_eliminate]: 8.17e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.718e-05 [call_graph_tuple_transform]: 2.342e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 6.58e-06 [remove_dup_value]: 1.754e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 9.93998e-06 [add_recomputation]: 5.246e-05 [cse_after_recomputation]: 2.57e-05, [1] [Cycle 1]: 1.984e-05, [1] [cse]: 1.299e-05 [auto_monad_reorder]: 1.745e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 6.51e-06 [opt_after_jit_grad]: 0.00049362 [symbol_engine_optimizer]: 7.988e-05, [1] [Cycle 1]: 7.366e-05, [6] [build]: 3.9e-06 [elim_shapecalc]: 9.51003e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 1.059e-05 [renormalize]: 4.39992e-07 [validate]: 0.00022889 Sums bootstrap : 0.000284s : 0.24% type_inference : 0.108782s : 93.24% event_method : 0.000023s : 0.02% auto_monad : 0.000073s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000490s : 0.42% rewriter_before_opt_a : 0.000099s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000077s : 0.07% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000891s : 0.76% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000024s : 0.02% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003243s : 2.78% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000692s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000496s : 0.43% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000052s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000494s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000229s : 0.20% Time group info: ------[substitution.] 0.000304 28 0.94% : 0.000003s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000006s : 4: substitution.graph_param_transform 83.46% : 0.000254s : 5: substitution.inline 1.19% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.30% : 0.000013s : 3: substitution.reduce_eliminate 1.54% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000006s : 2: substitution.replace_old_param 4.14% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108697 2 97.08% : 0.105522s : 1: type_inference.infer 2.92% : 0.003175s : 1: type_inference.specialize ------[replace.] 0.000112 7 67.74% : 0.000076s : 5: replace.inline 32.26% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000262 7 95.66% : 0.000251s : 5: match.inline 4.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000154 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.23% : 0.000002s : 13: predicate.addn_zero_filter 1.91% : 0.000003s : 13: predicate.arithmetic_simplify 1.14% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.07% : 0.000002s : 13: predicate.depend_value_elim 1.03% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.45% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.47% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.95% : 0.000001s : 13: predicate.environ_get_add_eliminate 0.97% : 0.000002s : 13: predicate.environ_get_depend_swap 1.17% : 0.000002s : 13: predicate.environ_get_eliminate 0.99% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.93% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.08% : 0.000008s : 28: predicate.inline 0.82% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.64% : 0.000003s : 19: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.10% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.80% : 0.000003s : 23: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.29% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 8: predicate.special_op_eliminate 0.80% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000004s : 20: predicate.switch_defer_inline 1.95% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.92% : 0.000011s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.15% : 0.000002s : 13: predicate.transpose_eliminate 1.27% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 9.80% : 0.000015s : 27: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002421 25 60.24% : 0.001458s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.57% : 0.000086s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.20% : 0.000876s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125320 72 0.04% : 0.000055s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000296s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.89% : 0.008640s : 1: jit_opt_a 0.14% : 0.000171s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.40% : 0.000504s : 1: loop_unroll 0.56% : 0.000701s : 1: mutable_eliminate 0.93% : 0.001160s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000502s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000497s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.85% : 0.002324s : 1: renormalize.infer 0.72% : 0.000908s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000104s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 86.82% : 0.108802s : 1: type_inference TotalTime = 0.113366, [30] [bootstrap]: 0.00026115 [type_inference]: 0.103034 [event_method]: 2.035e-05 [auto_monad]: 6.808e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00044286 [rewriter_before_opt_a]: 8.921e-05 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00712041, [2] [Cycle 1]: 0.00347236, [27] [switch_simplify]: 5.375e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00057382 [with_stream_mark]: 1.821e-05 [recompute_prepare]: 8.96002e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.29001e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 5.93998e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.457e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.18002e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00246379 [add_forward_monad_depend]: 5.89e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.698e-05 [cse]: 3.022e-05 [replace_applicator]: 1.374e-05 [Cycle 2]: 0.00036057, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 5.99999e-06 [a_1]: 0.00012078 [with_stream_mark]: 1.082e-05 [recompute_prepare]: 5.98998e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.18998e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.419e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.1e-06 [inline_without_move]: 5.59e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 5.73002e-06 [cse]: 1.094e-05 [replace_applicator]: 5.84999e-06 [py_interpret_to_execute_after_opt_a]: 9.83998e-06 [rewriter_after_opt_a]: 3.372e-05 [convert_after_rewriter]: 6.41e-06 [order_py_execute_after_rewriter]: 4.75001e-06 [mutable_eliminate]: 0.00055638 [jit_opt_b]: 5.572e-05, [1] [Cycle 1]: 4.958e-05, [2] [frontend_op_eliminate]: 1.977e-05 [inline_after_opt_a]: 1.746e-05 [cconv]: 2.461e-05 [loop_unroll]: 0.00043492 [jit_opt_after_cconv]: 0.00015705, [1] [Cycle 1]: 0.00015071, [11] [c_1]: 2.635e-05 [parameter_eliminate]: 3.09001e-06 [updatestate_depend_eliminate]: 6.56999e-06 [updatestate_assign_eliminate]: 3.16001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.541e-05 [call_graph_tuple_transform]: 2.053e-05 [tuple_list_get_item_eliminator]: 6.89999e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.588e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 7.98001e-06 [add_recomputation]: 4.82e-05 [cse_after_recomputation]: 5.422e-05, [1] [Cycle 1]: 4.921e-05, [1] [cse]: 4.301e-05 [auto_monad_reorder]: 1.496e-05 [get_jit_bprop_graph]: 2.43e-06 [rewriter_after_jit_bprop_graph]: 6.21e-06 [opt_after_jit_grad]: 0.00049134 [symbol_engine_optimizer]: 7.942e-05, [1] [Cycle 1]: 7.372e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 1.066e-05 [elim_not_effective]: 1.46e-05 [opt_reshape]: 5.91e-06 [fold_const_symbol]: 1.152e-05 [renormalize]: 3.50003e-07 [validate]: 0.00012706 Sums bootstrap : 0.000261s : 0.24% type_inference : 0.103034s : 94.10% event_method : 0.000020s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000443s : 0.40% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000695s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002464s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000556s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000435s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000043s : 0.04% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000491s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000127s : 0.12% Time group info: ------[substitution.] 0.000207 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 83.82% : 0.000174s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000005s : 4: substitution.remove_not_recompute_node 2.04% : 0.000004s : 2: substitution.replace_old_param 5.85% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102960 2 97.54% : 0.100424s : 1: type_inference.infer 2.46% : 0.002536s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.91% : 0.000050s : 4: replace.inline 32.09% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 94.02% : 0.000171s : 4: match.inline 5.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.49% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_depend_swap 1.14% : 0.000001s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.40% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.97% : 0.000003s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.37% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.37% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.04% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002054 22 66.65% : 0.001369s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.72% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.63% : 0.000649s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116733 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000272s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000056s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.10% : 0.007124s : 1: jit_opt_a 0.14% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.38% : 0.000444s : 1: loop_unroll 0.48% : 0.000565s : 1: mutable_eliminate 0.79% : 0.000921s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000500s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000451s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.51% : 0.001762s : 1: renormalize.infer 0.59% : 0.000692s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.28% : 0.103054s : 1: type_inference TotalTime = 0.132068, [30] [bootstrap]: 0.00030822 [type_inference]: 0.117652 [event_method]: 2.927e-05 [auto_monad]: 8.334e-05 [graph_reusing]: 6.26e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00092087 [rewriter_before_opt_a]: 0.00011774 [expand_dump_flag]: 5.56e-06 [jit_opt_a]: 0.0100105, [2] [Cycle 1]: 0.00540639, [27] [switch_simplify]: 7.403e-05 [loop_unroll]: 3.471e-05 [a_1]: 0.00074106 [with_stream_mark]: 2.183e-05 [recompute_prepare]: 1.045e-05 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 3.17997e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.66001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 7.35e-06 [meta_shard_fg_expand]: 2.83e-06 [get_grad_eliminate_]: 7.6e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 1.105e-05 [meta_fg_expand]: 3.13e-06 [replace_old_param]: 1.227e-05 [inline_without_move]: 7.35e-06 [renormalize]: 0.00409776 [add_forward_monad_depend]: 8.84998e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 2.153e-05 [cse]: 4.208e-05 [replace_applicator]: 2.489e-05 [Cycle 2]: 0.00042634, [27] [switch_simplify]: 8.32e-06 [loop_unroll]: 7.06999e-06 [a_1]: 0.0001494 [with_stream_mark]: 1.403e-05 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.38e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 6.08002e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 3.12002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 1.077e-05 [inline_without_move]: 6.14999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.43002e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.79002e-06 [cse]: 1.608e-05 [replace_applicator]: 6.69001e-06 [py_interpret_to_execute_after_opt_a]: 1.756e-05 [rewriter_after_opt_a]: 4.077e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00081356 [jit_opt_b]: 6.48e-05, [1] [Cycle 1]: 5.42e-05, [2] [frontend_op_eliminate]: 2.255e-05 [inline_after_opt_a]: 1.987e-05 [cconv]: 3.154e-05 [loop_unroll]: 0.00059123 [jit_opt_after_cconv]: 0.00019506, [1] [Cycle 1]: 0.00018625, [11] [c_1]: 4.208e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 1.005e-05 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 3.323e-05 [call_graph_tuple_transform]: 2.487e-05 [tuple_list_get_item_eliminator]: 7.02002e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 1.12e-06 [switch_simplify]: 6.92002e-06 [remove_dup_value]: 1.841e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 1.07e-05 [add_recomputation]: 5.477e-05 [cse_after_recomputation]: 2.554e-05, [1] [Cycle 1]: 1.98e-05, [1] [cse]: 1.327e-05 [auto_monad_reorder]: 1.807e-05 [get_jit_bprop_graph]: 2.26e-06 [rewriter_after_jit_bprop_graph]: 6.84001e-06 [opt_after_jit_grad]: 0.00060193 [symbol_engine_optimizer]: 0.00015361, [1] [Cycle 1]: 0.00014646, [6] [build]: 4.13999e-06 [elim_shapecalc]: 1.007e-05 [elim_not_effective]: 8.195e-05 [opt_reshape]: 8.29002e-06 [fold_const_symbol]: 1.258e-05 [renormalize]: 6.60017e-07 [validate]: 5.228e-05 Sums bootstrap : 0.000308s : 0.24% type_inference : 0.117652s : 92.49% event_method : 0.000029s : 0.02% auto_monad : 0.000083s : 0.07% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000921s : 0.72% rewriter_before_opt_a : 0.000118s : 0.09% expand_dump_flag : 0.000006s : 0.00% jit_opt_a.switch_simplify : 0.000082s : 0.06% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000890s : 0.70% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.004098s : 3.22% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000029s : 0.02% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000032s : 0.02% py_interpret_to_execute_after_opt_a : 0.000018s : 0.01% rewriter_after_opt_a : 0.000041s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000814s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000023s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000032s : 0.02% loop_unroll : 0.000591s : 0.46% jit_opt_after_cconv.c_1 : 0.000042s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000033s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000055s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000602s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000082s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000052s : 0.04% Time group info: ------[substitution.] 0.000298 28 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 2.05% : 0.000006s : 4: substitution.graph_param_transform 81.31% : 0.000242s : 5: substitution.inline 1.64% : 0.000005s : 4: substitution.j_node_and_user_rematch 5.20% : 0.000016s : 3: substitution.reduce_eliminate 1.91% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000007s : 2: substitution.replace_old_param 4.25% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117546 2 96.89% : 0.113896s : 1: type_inference.infer 3.11% : 0.003650s : 1: type_inference.specialize ------[replace.] 0.000112 7 66.17% : 0.000074s : 5: replace.inline 33.83% : 0.000038s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000251 7 95.37% : 0.000239s : 5: match.inline 4.63% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000155 886 1.47% : 0.000002s : 13: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.33% : 0.000002s : 13: predicate.addn_zero_filter 2.04% : 0.000003s : 13: predicate.arithmetic_simplify 1.52% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.24% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.98% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 13: predicate.environ_get_depend_swap 1.49% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.77% : 0.000007s : 28: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 1.68% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.04% : 0.000002s : 13: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.21% : 0.000003s : 13: predicate.reduce_eliminate 1.26% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 23: predicate.replace_applicator 0.52% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 1.00% : 0.000002s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 13: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 20: predicate.switch_defer_inline 1.90% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.13% : 0.000011s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 2.08% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.77% : 0.000003s : 13: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002954 25 57.09% : 0.001687s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.25% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.66% : 0.001201s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137499 72 0.04% : 0.000058s : 1: add_recomputation 0.06% : 0.000087s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000323s : 1: bootstrap 0.02% : 0.000034s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000034s : 1: event_method 0.01% : 0.000008s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 7.28% : 0.010015s : 1: jit_opt_a 0.14% : 0.000198s : 1: jit_opt_after_cconv 0.05% : 0.000067s : 1: jit_opt_b 0.44% : 0.000602s : 1: loop_unroll 0.60% : 0.000826s : 1: mutable_eliminate 0.85% : 0.001172s : 26: opt.transform.jit_opt_a 0.06% : 0.000077s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000021s : 1: opt.transform.mutable_eliminate 0.02% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000109s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000614s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.68% : 0.000934s : 1: py_interpret_to_execute 0.01% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000021s : 1: remove_dup_value 2.05% : 0.002819s : 1: renormalize.infer 0.92% : 0.001266s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000045s : 1: rewriter_after_opt_a 0.09% : 0.000123s : 1: rewriter_before_opt_a 0.11% : 0.000157s : 1: symbol_engine_optimizer 85.58% : 0.117677s : 1: type_inference TotalTime = 0.117006, [30] [bootstrap]: 0.00033844 [type_inference]: 0.106326 [event_method]: 1.867e-05 [auto_monad]: 6.798e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00046107 [rewriter_before_opt_a]: 8.02e-05 [expand_dump_flag]: 3.42002e-06 [jit_opt_a]: 0.00728737, [2] [Cycle 1]: 0.00355428, [27] [switch_simplify]: 5.255e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.00059411 [with_stream_mark]: 2.123e-05 [recompute_prepare]: 8.72998e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 6.59001e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 6.32001e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.477e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00251481 [add_forward_monad_depend]: 7.51001e-06 [auto_monad_grad]: 2.34001e-06 [auto_monad_eliminator]: 1.527e-05 [cse]: 2.89e-05 [replace_applicator]: 1.607e-05 [Cycle 2]: 0.00037996, [27] [switch_simplify]: 7.01001e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00012524 [with_stream_mark]: 1.265e-05 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.90998e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 2.21998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.729e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 5.50001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 6.92002e-06 [cse]: 1.263e-05 [replace_applicator]: 5.77999e-06 [py_interpret_to_execute_after_opt_a]: 1.131e-05 [rewriter_after_opt_a]: 3.542e-05 [convert_after_rewriter]: 3.094e-05 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00062519 [jit_opt_b]: 5.573e-05, [1] [Cycle 1]: 4.934e-05, [2] [frontend_op_eliminate]: 1.969e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 2.902e-05 [loop_unroll]: 0.00049062 [jit_opt_after_cconv]: 0.00015488, [1] [Cycle 1]: 0.00014821, [11] [c_1]: 2.611e-05 [parameter_eliminate]: 3.28e-06 [updatestate_depend_eliminate]: 6.28e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.89999e-06 [cse]: 2.134e-05 [call_graph_tuple_transform]: 2.052e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.68002e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.89999e-06 [remove_dup_value]: 1.375e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 8.25999e-06 [add_recomputation]: 4.932e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.885e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 1.535e-05 [get_jit_bprop_graph]: 3.26001e-06 [rewriter_after_jit_bprop_graph]: 5.61e-06 [opt_after_jit_grad]: 0.00047782 [symbol_engine_optimizer]: 0.00014567, [1] [Cycle 1]: 0.00013926, [6] [build]: 2.98e-06 [elim_shapecalc]: 9.07001e-06 [elim_not_effective]: 7.942e-05 [opt_reshape]: 7.7e-06 [fold_const_symbol]: 1.001e-05 [renormalize]: 3.09985e-07 [validate]: 4.468e-05 Sums bootstrap : 0.000338s : 0.30% type_inference : 0.106326s : 94.04% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000461s : 0.41% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000719s : 0.64% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002515s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000031s : 0.03% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000625s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000491s : 0.43% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000478s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000079s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000289 24 22.78% : 0.000066s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 1.90% : 0.000005s : 4: substitution.graph_param_transform 65.81% : 0.000190s : 4: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000006s : 4: substitution.remove_not_recompute_node 1.95% : 0.000006s : 2: substitution.replace_old_param 4.05% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106253 2 97.63% : 0.103732s : 1: type_inference.infer 2.37% : 0.002521s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.93% : 0.000049s : 4: replace.inline 33.07% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.69% : 0.000187s : 4: match.inline 5.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.46% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.97% : 0.000008s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000001s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.64% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.51% : 0.000001s : 4: predicate.reset_defer_inline 1.52% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.18% : 0.000002s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 1.93% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.93% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.59% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002161 22 67.13% : 0.001451s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.20% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.67% : 0.000663s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120610 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.30% : 0.000359s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.03% : 0.000034s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.05% : 0.007292s : 1: jit_opt_a 0.13% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.41% : 0.000499s : 1: loop_unroll 0.53% : 0.000634s : 1: mutable_eliminate 0.79% : 0.000955s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000103s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000468s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.46% : 0.001767s : 1: renormalize.infer 0.61% : 0.000739s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.12% : 0.000149s : 1: symbol_engine_optimizer 88.17% : 0.106340s : 1: type_inference TotalTime = 0.0613974, [30] [bootstrap]: 0.00027968 [type_inference]: 0.0516875 [event_method]: 1.873e-05 [auto_monad]: 6.573e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.24001e-06 [py_interpret_to_execute]: 0.00026545 [rewriter_before_opt_a]: 8.101e-05 [expand_dump_flag]: 3.56999e-06 [jit_opt_a]: 0.00675065, [2] [Cycle 1]: 0.00305208, [27] [switch_simplify]: 5.556e-05 [loop_unroll]: 3.016e-05 [a_1]: 0.00055355 [with_stream_mark]: 1.844e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 4.18001e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.28999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 2.00002e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 3.97998e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.679e-05 [j_node_and_user_rematch]: 1.062e-05 [meta_fg_expand]: 2.82002e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00204147 [add_forward_monad_depend]: 8.38001e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.663e-05 [cse]: 2.998e-05 [replace_applicator]: 1.607e-05 [Cycle 2]: 0.00036612, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.82001e-06 [a_1]: 0.00011985 [with_stream_mark]: 1.221e-05 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 2.93998e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 5.63002e-06 [meta_shard_fg_expand]: 1.78997e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 2.96999e-06 [cell_reuse_recompute_pass]: 2.24999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 9.26002e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.143e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.169e-05 [rewriter_after_opt_a]: 3.571e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00062317 [jit_opt_b]: 5.589e-05, [1] [Cycle 1]: 4.896e-05, [2] [frontend_op_eliminate]: 1.932e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 2.47e-05 [loop_unroll]: 0.00042214 [jit_opt_after_cconv]: 0.0001501, [1] [Cycle 1]: 0.00014355, [11] [c_1]: 2.502e-05 [parameter_eliminate]: 2.90998e-06 [updatestate_depend_eliminate]: 5.02999e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.161e-05 [call_graph_tuple_transform]: 2.107e-05 [tuple_list_get_item_eliminator]: 6.18002e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 6.09987e-07 [switch_simplify]: 6.54999e-06 [remove_dup_value]: 1.619e-05 [partial_unused_args_eliminate]: 2.91e-06 [environ_conv]: 7.58001e-06 [add_recomputation]: 4.958e-05 [cse_after_recomputation]: 2.22e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 1.113e-05 [auto_monad_reorder]: 1.483e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.17e-06 [opt_after_jit_grad]: 0.00047922 [symbol_engine_optimizer]: 8.896e-05, [1] [Cycle 1]: 8.319e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 8.04002e-06 [elim_not_effective]: 2.732e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 9.42999e-06 [renormalize]: 3.59985e-07 [validate]: 4.17e-05 Sums bootstrap : 0.000280s : 0.49% type_inference : 0.051688s : 89.92% event_method : 0.000019s : 0.03% auto_monad : 0.000066s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000265s : 0.46% rewriter_before_opt_a : 0.000081s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000673s : 1.17% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002042s : 3.55% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000041s : 0.07% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000623s : 1.08% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000422s : 0.73% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000479s : 0.83% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000027s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000195 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 4: substitution.graph_param_transform 82.20% : 0.000160s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.69% : 0.000005s : 4: substitution.remove_not_recompute_node 2.59% : 0.000005s : 2: substitution.replace_old_param 6.26% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051605 2 96.39% : 0.049744s : 1: type_inference.infer 3.61% : 0.001861s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.30% : 0.000049s : 4: replace.inline 31.70% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.45% : 0.000158s : 4: match.inline 6.55% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.74% : 0.000002s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.31% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.38% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.92% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002198 26 69.56% : 0.001529s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.13% : 0.000640s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064434 72 0.08% : 0.000052s : 1: add_recomputation 0.11% : 0.000069s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.45% : 0.000293s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.48% : 0.006754s : 1: jit_opt_a 0.24% : 0.000153s : 1: jit_opt_after_cconv 0.09% : 0.000058s : 1: jit_opt_b 0.67% : 0.000430s : 1: loop_unroll 0.98% : 0.000633s : 1: mutable_eliminate 1.41% : 0.000909s : 26: opt.transform.jit_opt_a 0.09% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000271s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.05% : 0.001324s : 1: renormalize.infer 1.10% : 0.000708s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.14% : 0.000092s : 1: symbol_engine_optimizer 80.24% : 0.051703s : 1: type_inference TotalTime = 0.120045, [30] [bootstrap]: 0.00029043 [type_inference]: 0.109311 [event_method]: 1.855e-05 [auto_monad]: 4.797e-05 [graph_reusing]: 3.71001e-06 [pre_auto_parallel]: 1.61002e-06 [py_interpret_to_execute]: 0.00049945 [rewriter_before_opt_a]: 8.51e-05 [expand_dump_flag]: 2.56e-06 [jit_opt_a]: 0.00758864, [2] [Cycle 1]: 0.00399208, [27] [switch_simplify]: 4.94e-05 [loop_unroll]: 3.364e-05 [a_1]: 0.00062247 [with_stream_mark]: 1.437e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 3.49001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 7.65e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 1.039e-05 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 9.25001e-06 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00295024 [add_forward_monad_depend]: 5.54e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.455e-05 [cse]: 2.598e-05 [replace_applicator]: 1.493e-05 [Cycle 2]: 0.00038219, [27] [switch_simplify]: 7.09001e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.0001322 [with_stream_mark]: 1.302e-05 [recompute_prepare]: 6.39001e-06 [updatestate_depend_eliminate]: 2.83003e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.26998e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 5.79e-06 [merge_forward]: 3.18998e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.392e-05 [j_node_and_user_rematch]: 9.56003e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 1.04e-06 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.304e-05 [replace_applicator]: 6.54999e-06 [py_interpret_to_execute_after_opt_a]: 1.168e-05 [rewriter_after_opt_a]: 3.435e-05 [convert_after_rewriter]: 6.11998e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00059479 [jit_opt_b]: 5.48e-05, [1] [Cycle 1]: 4.79e-05, [2] [frontend_op_eliminate]: 1.944e-05 [inline_after_opt_a]: 1.72e-05 [cconv]: 2.222e-05 [loop_unroll]: 0.00042077 [jit_opt_after_cconv]: 0.00015157, [1] [Cycle 1]: 0.00014503, [11] [c_1]: 2.754e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 5.06002e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.138e-05 [call_graph_tuple_transform]: 1.943e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.27e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.265e-05 [partial_unused_args_eliminate]: 1.93997e-06 [environ_conv]: 7.81001e-06 [add_recomputation]: 3.82e-05 [cse_after_recomputation]: 2.279e-05, [1] [Cycle 1]: 1.726e-05, [1] [cse]: 1.142e-05 [auto_monad_reorder]: 1.385e-05 [get_jit_bprop_graph]: 1.70001e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00045895 [symbol_engine_optimizer]: 9.403e-05, [1] [Cycle 1]: 8.82e-05, [6] [build]: 2.94001e-06 [elim_shapecalc]: 8.47998e-06 [elim_not_effective]: 3.281e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 9.63002e-06 [renormalize]: 3.60014e-07 [validate]: 3.748e-05 Sums bootstrap : 0.000290s : 0.25% type_inference : 0.109311s : 94.04% event_method : 0.000019s : 0.02% auto_monad : 0.000048s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000499s : 0.43% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000755s : 0.65% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002950s : 2.54% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000595s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000022s : 0.02% loop_unroll : 0.000421s : 0.36% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000459s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000033s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000206 28 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000005s : 4: substitution.graph_param_transform 80.40% : 0.000165s : 5: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 5.86% : 0.000012s : 3: substitution.reduce_eliminate 2.22% : 0.000005s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 3.80% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109249 2 97.41% : 0.106423s : 1: type_inference.infer 2.59% : 0.002826s : 1: type_inference.specialize ------[replace.] 0.000093 7 65.84% : 0.000061s : 5: replace.inline 34.16% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 7 96.03% : 0.000162s : 5: match.inline 3.97% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.47% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000002s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.73% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.85% : 0.000007s : 28: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 19: predicate.load_eliminater 1.04% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.22% : 0.000002s : 13: predicate.print_const_string_wrapper 2.11% : 0.000003s : 13: predicate.reduce_eliminate 1.49% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.28% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.71% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.09% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.35% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002319 25 62.68% : 0.001453s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.26% : 0.000052s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.06% : 0.000813s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124081 72 0.03% : 0.000041s : 1: add_recomputation 0.04% : 0.000051s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000306s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.12% : 0.007592s : 1: jit_opt_a 0.12% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.37% : 0.000465s : 1: loop_unroll 0.49% : 0.000604s : 1: mutable_eliminate 0.80% : 0.000987s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000055s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000467s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000505s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.71% : 0.002116s : 1: renormalize.infer 0.67% : 0.000827s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.08% : 0.000097s : 1: symbol_engine_optimizer 88.10% : 0.109321s : 1: type_inference TotalTime = 0.014774, [30] [bootstrap]: 0.00027173 [type_inference]: 0.0072231 [event_method]: 1.947e-05 [auto_monad]: 4.775e-05 [graph_reusing]: 3.65e-06 [pre_auto_parallel]: 1.72001e-06 [py_interpret_to_execute]: 3.713e-05 [rewriter_before_opt_a]: 7.305e-05 [expand_dump_flag]: 1.99999e-06 [jit_opt_a]: 0.00489962, [2] [Cycle 1]: 0.00161949, [27] [switch_simplify]: 4.611e-05 [loop_unroll]: 3.234e-05 [a_1]: 0.00053699 [with_stream_mark]: 1.753e-05 [recompute_prepare]: 8.01001e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.81998e-06 [meta_shard_fg_expand]: 2.15002e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.416e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 9.06998e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00066673 [add_forward_monad_depend]: 5.13002e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.344e-05 [cse]: 3.215e-05 [replace_applicator]: 1.3e-05 [Cycle 2]: 0.00032769, [27] [switch_simplify]: 5.47999e-06 [loop_unroll]: 4.84e-06 [a_1]: 9.806e-05 [with_stream_mark]: 8.82e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.82998e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.76998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.125e-05 [j_node_and_user_rematch]: 7.99002e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.07002e-06 [inline_without_move]: 4.73001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 5.44e-06 [cse]: 1.256e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 9.95002e-06 [rewriter_after_opt_a]: 3.655e-05 [convert_after_rewriter]: 7.35998e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00053066 [jit_opt_b]: 5.329e-05, [1] [Cycle 1]: 4.57e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.676e-05 [cconv]: 2.625e-05 [loop_unroll]: 0.00045217 [jit_opt_after_cconv]: 0.00015681, [1] [Cycle 1]: 0.00014986, [11] [c_1]: 2.256e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 9.61003e-06 [updatestate_loads_eliminate]: 2.60997e-06 [cse]: 2.238e-05 [call_graph_tuple_transform]: 1.744e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 4.99975e-07 [switch_simplify]: 6.01998e-06 [remove_dup_value]: 1.545e-05 [partial_unused_args_eliminate]: 1.49e-06 [environ_conv]: 5.25999e-06 [add_recomputation]: 4.825e-05 [cse_after_recomputation]: 2.252e-05, [1] [Cycle 1]: 1.741e-05, [1] [cse]: 1.132e-05 [auto_monad_reorder]: 1.32e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.76e-06 [opt_after_jit_grad]: 0.00053019 [symbol_engine_optimizer]: 7.657e-05, [1] [Cycle 1]: 6.988e-05, [6] [build]: 2.89001e-06 [elim_shapecalc]: 7.99002e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 3.89991e-07 [validate]: 3.394e-05 Sums bootstrap : 0.000272s : 2.41% type_inference : 0.007223s : 64.17% event_method : 0.000019s : 0.17% auto_monad : 0.000048s : 0.42% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.33% rewriter_before_opt_a : 0.000073s : 0.65% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000052s : 0.46% jit_opt_a.loop_unroll : 0.000037s : 0.33% jit_opt_a.a_1 : 0.000635s : 5.64% jit_opt_a.with_stream_mark : 0.000026s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000667s : 5.92% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.17% jit_opt_a.cse : 0.000045s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.16% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000037s : 0.32% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000531s : 4.71% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.15% jit_opt_b.inline_after_opt_a : 0.000017s : 0.15% cconv : 0.000026s : 0.23% loop_unroll : 0.000452s : 4.02% jit_opt_after_cconv.c_1 : 0.000023s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000010s : 0.09% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.14% partial_unused_args_eliminate : 0.000001s : 0.01% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000048s : 0.43% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000013s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000530s : 4.71% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.30% Time group info: ------[substitution.] 0.000170 27 1.19% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 2.09% : 0.000004s : 3: substitution.graph_param_transform 80.31% : 0.000136s : 5: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 5.08% : 0.000009s : 3: substitution.reduce_eliminate 2.64% : 0.000004s : 4: substitution.remove_not_recompute_node 2.05% : 0.000003s : 2: substitution.replace_old_param 4.19% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007174 2 87.33% : 0.006265s : 1: type_inference.infer 12.67% : 0.000909s : 1: type_inference.specialize ------[replace.] 0.000077 7 64.62% : 0.000050s : 5: replace.inline 35.38% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000139 7 95.68% : 0.000133s : 5: match.inline 4.32% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.26% : 0.000002s : 11: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.41% : 0.000002s : 11: predicate.addn_zero_filter 2.20% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.20% : 0.000001s : 11: predicate.depend_value_elim 1.19% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000006s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 2.48% : 0.000003s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000002s : 11: predicate.print_const_string_wrapper 2.61% : 0.000003s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.48% : 0.000002s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.55% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.45% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000009s : 59: predicate.switch_simplify 1.34% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.44% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000710 16 49.76% : 0.000353s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.25% : 0.000044s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.99% : 0.000312s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016357 72 0.31% : 0.000051s : 1: add_recomputation 0.31% : 0.000051s : 1: auto_monad 0.10% : 0.000016s : 1: auto_monad_reorder 1.75% : 0.000286s : 1: bootstrap 0.18% : 0.000029s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000006s : 1: graph_reusing 29.97% : 0.004903s : 1: jit_opt_a 0.98% : 0.000160s : 1: jit_opt_after_cconv 0.34% : 0.000056s : 1: jit_opt_b 2.81% : 0.000460s : 1: loop_unroll 3.31% : 0.000541s : 1: mutable_eliminate 5.15% : 0.000842s : 26: opt.transform.jit_opt_a 0.30% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.29% : 0.000539s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.22% : 0.000363s : 1: renormalize.infer 1.82% : 0.000297s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000039s : 1: rewriter_after_opt_a 0.46% : 0.000076s : 1: rewriter_before_opt_a 0.48% : 0.000079s : 1: symbol_engine_optimizer 44.24% : 0.007236s : 1: type_inference TotalTime = 0.0619994, [30] [bootstrap]: 0.00027068 [type_inference]: 0.0529273 [event_method]: 1.745e-05 [auto_monad]: 0.00010548 [graph_reusing]: 4.82e-06 [pre_auto_parallel]: 1.82999e-06 [py_interpret_to_execute]: 0.00025908 [rewriter_before_opt_a]: 7.715e-05 [expand_dump_flag]: 2.81999e-06 [jit_opt_a]: 0.00625174, [2] [Cycle 1]: 0.00274792, [27] [switch_simplify]: 4.671e-05 [loop_unroll]: 3.034e-05 [a_1]: 0.0005539 [with_stream_mark]: 1.519e-05 [recompute_prepare]: 8.81997e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.15002e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.24e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.73001e-06 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00179523 [add_forward_monad_depend]: 5.84e-06 [auto_monad_grad]: 2.12999e-06 [auto_monad_eliminator]: 1.284e-05 [cse]: 2.259e-05 [replace_applicator]: 1.399e-05 [Cycle 2]: 0.0003549, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 5.81e-06 [a_1]: 0.00011993 [with_stream_mark]: 9.84001e-06 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 8.62998e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.35999e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.135e-05 [replace_applicator]: 5.68002e-06 [py_interpret_to_execute_after_opt_a]: 9.62001e-06 [rewriter_after_opt_a]: 3.008e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.63001e-06 [mutable_eliminate]: 0.00051501 [jit_opt_b]: 5.191e-05, [1] [Cycle 1]: 4.555e-05, [2] [frontend_op_eliminate]: 1.775e-05 [inline_after_opt_a]: 1.681e-05 [cconv]: 1.951e-05 [loop_unroll]: 0.00041543 [jit_opt_after_cconv]: 0.00014461, [1] [Cycle 1]: 0.00013819, [11] [c_1]: 2.523e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 4.94e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.06003e-06 [cse]: 1.833e-05 [call_graph_tuple_transform]: 1.92e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.41002e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.89999e-06 [remove_dup_value]: 1.062e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 7.18e-06 [add_recomputation]: 7.069e-05 [cse_after_recomputation]: 2.382e-05, [1] [Cycle 1]: 1.858e-05, [1] [cse]: 1.213e-05 [auto_monad_reorder]: 1.178e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 4.76002e-06 [opt_after_jit_grad]: 0.00047894 [symbol_engine_optimizer]: 7.373e-05, [1] [Cycle 1]: 6.743e-05, [6] [build]: 3.33e-06 [elim_shapecalc]: 8.70001e-06 [elim_not_effective]: 1.352e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.05999e-06 [renormalize]: 5.00004e-07 [validate]: 3.746e-05 Sums bootstrap : 0.000271s : 0.46% type_inference : 0.052927s : 90.78% event_method : 0.000017s : 0.03% auto_monad : 0.000105s : 0.18% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000259s : 0.44% rewriter_before_opt_a : 0.000077s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000674s : 1.16% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001795s : 3.08% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000034s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000030s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000515s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000020s : 0.03% loop_unroll : 0.000415s : 0.71% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000071s : 0.12% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000479s : 0.82% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.06% Time group info: ------[substitution.] 0.000197 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000005s : 4: substitution.graph_param_transform 85.01% : 0.000167s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.18% : 0.000004s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 5.12% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052864 2 96.58% : 0.051057s : 1: type_inference.infer 3.42% : 0.001807s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.21% : 0.000044s : 4: replace.inline 33.79% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 94.90% : 0.000164s : 4: match.inline 5.10% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.20% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 4.90% : 0.000006s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.45% : 0.000002s : 12: predicate.print_const_string_wrapper 1.93% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.44% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.89% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002219 26 73.20% : 0.001625s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.25% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.54% : 0.000567s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064762 72 0.11% : 0.000074s : 1: add_recomputation 0.17% : 0.000109s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.44% : 0.000282s : 1: bootstrap 0.03% : 0.000022s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.66% : 0.006254s : 1: jit_opt_a 0.23% : 0.000148s : 1: jit_opt_after_cconv 0.08% : 0.000054s : 1: jit_opt_b 0.65% : 0.000423s : 1: loop_unroll 0.81% : 0.000523s : 1: mutable_eliminate 1.38% : 0.000893s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000265s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.82% : 0.001180s : 1: renormalize.infer 0.94% : 0.000608s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.13% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000076s : 1: symbol_engine_optimizer 81.74% : 0.052939s : 1: type_inference TotalTime = 0.0113329, [30] [bootstrap]: 0.00025017 [type_inference]: 0.00426732 [event_method]: 1.694e-05 [auto_monad]: 5.144e-05 [graph_reusing]: 4.47e-06 [pre_auto_parallel]: 2.16998e-06 [py_interpret_to_execute]: 3.677e-05 [rewriter_before_opt_a]: 6.691e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00471481, [2] [Cycle 1]: 0.00138161, [27] [switch_simplify]: 4.505e-05 [loop_unroll]: 2.994e-05 [a_1]: 0.00049268 [with_stream_mark]: 1.233e-05 [recompute_prepare]: 7.18998e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 5.28002e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.72001e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.144e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 7.77e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00052119 [add_forward_monad_depend]: 4.72e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 1.164e-05 [cse]: 1.743e-05 [replace_applicator]: 1.065e-05 [Cycle 2]: 0.00031407, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 4.89998e-06 [a_1]: 9.171e-05 [with_stream_mark]: 8.06001e-06 [recompute_prepare]: 4.97999e-06 [updatestate_depend_eliminate]: 2.54999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.13002e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.90999e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.32002e-06 [inline_without_move]: 4.62e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.64e-06 [cse]: 1.005e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 8.48999e-06 [rewriter_after_opt_a]: 2.687e-05 [convert_after_rewriter]: 6.07999e-06 [order_py_execute_after_rewriter]: 4.33001e-06 [mutable_eliminate]: 0.00046005 [jit_opt_b]: 4.625e-05, [1] [Cycle 1]: 4.05e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.516e-05 [cconv]: 1.836e-05 [loop_unroll]: 0.00040314 [jit_opt_after_cconv]: 0.00013451, [1] [Cycle 1]: 0.00012856, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.30999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.723e-05 [call_graph_tuple_transform]: 1.7e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 9.82001e-06 [partial_unused_args_eliminate]: 1.418e-05 [environ_conv]: 4.45e-06 [add_recomputation]: 3.477e-05 [cse_after_recomputation]: 2.175e-05, [1] [Cycle 1]: 1.649e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.105e-05 [get_jit_bprop_graph]: 1.53002e-06 [rewriter_after_jit_bprop_graph]: 4.10998e-06 [opt_after_jit_grad]: 0.00045384 [symbol_engine_optimizer]: 6.972e-05, [1] [Cycle 1]: 6.39e-05, [6] [build]: 2.66999e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.22e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 4.00003e-07 [validate]: 2.779e-05 Sums bootstrap : 0.000250s : 3.22% type_inference : 0.004267s : 54.87% event_method : 0.000017s : 0.22% auto_monad : 0.000051s : 0.66% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.47% rewriter_before_opt_a : 0.000067s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000051s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000584s : 7.51% jit_opt_a.with_stream_mark : 0.000020s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.14% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000521s : 6.70% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000027s : 0.35% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000027s : 0.35% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000460s : 5.91% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000018s : 0.24% loop_unroll : 0.000403s : 5.18% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000010s : 0.13% partial_unused_args_eliminate : 0.000014s : 0.18% environ_conv : 0.000004s : 0.06% add_recomputation : 0.000035s : 0.45% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000011s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000454s : 5.84% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000028s : 0.36% Time group info: ------[substitution.] 0.000164 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000004s : 3: substitution.graph_param_transform 83.91% : 0.000138s : 4: substitution.inline 1.83% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000004s : 4: substitution.remove_not_recompute_node 1.98% : 0.000003s : 2: substitution.replace_old_param 5.38% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004219 2 81.52% : 0.003440s : 1: type_inference.infer 18.48% : 0.000780s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.39% : 0.000043s : 4: replace.inline 33.61% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 94.59% : 0.000135s : 4: match.inline 5.41% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.44% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.21% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.54% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.25% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.14% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.83% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 1.09% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000008s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000576 13 50.76% : 0.000292s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.08% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.17% : 0.000254s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012695 72 0.30% : 0.000038s : 1: add_recomputation 0.43% : 0.000055s : 1: auto_monad 0.11% : 0.000014s : 1: auto_monad_reorder 2.05% : 0.000261s : 1: bootstrap 0.16% : 0.000021s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.16% : 0.004717s : 1: jit_opt_a 1.08% : 0.000137s : 1: jit_opt_after_cconv 0.38% : 0.000049s : 1: jit_opt_b 3.23% : 0.000411s : 1: loop_unroll 3.69% : 0.000468s : 1: mutable_eliminate 6.17% : 0.000783s : 26: opt.transform.jit_opt_a 0.35% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.18% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.64% : 0.000463s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.13% : 0.000016s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000012s : 1: remove_dup_value 2.02% : 0.000256s : 1: renormalize.infer 2.04% : 0.000259s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000030s : 1: rewriter_after_opt_a 0.55% : 0.000070s : 1: rewriter_before_opt_a 0.57% : 0.000072s : 1: symbol_engine_optimizer 33.69% : 0.004277s : 1: type_inference TotalTime = 0.0118637, [30] [bootstrap]: 0.0002741 [type_inference]: 0.00477319 [event_method]: 1.609e-05 [auto_monad]: 4.704e-05 [graph_reusing]: 4.12003e-06 [pre_auto_parallel]: 1.87001e-06 [py_interpret_to_execute]: 3.752e-05 [rewriter_before_opt_a]: 6.751e-05 [expand_dump_flag]: 2.68998e-06 [jit_opt_a]: 0.00472509, [2] [Cycle 1]: 0.00146527, [27] [switch_simplify]: 4.693e-05 [loop_unroll]: 3.052e-05 [a_1]: 0.00051863 [with_stream_mark]: 1.256e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 3.05998e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 2.65002e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.126e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 7.73999e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00057656 [add_forward_monad_depend]: 4.09002e-06 [auto_monad_grad]: 1.27999e-06 [auto_monad_eliminator]: 1.085e-05 [cse]: 1.703e-05 [replace_applicator]: 1.124e-05 [Cycle 2]: 0.00030848, [27] [switch_simplify]: 5.80002e-06 [loop_unroll]: 4.64998e-06 [a_1]: 8.997e-05 [with_stream_mark]: 8.01001e-06 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 1.98997e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 4.72998e-06 [meta_shard_fg_expand]: 1.04e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.53002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.185e-05 [j_node_and_user_rematch]: 7.61999e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.25003e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.54998e-06 [cse]: 1.125e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 7.82e-06 [rewriter_after_opt_a]: 2.57e-05 [convert_after_rewriter]: 6.17001e-06 [order_py_execute_after_rewriter]: 4.29997e-06 [mutable_eliminate]: 0.00047053 [jit_opt_b]: 4.829e-05, [1] [Cycle 1]: 4.225e-05, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 1.577e-05 [cconv]: 1.681e-05 [loop_unroll]: 0.0004148 [jit_opt_after_cconv]: 0.00013303, [1] [Cycle 1]: 0.00012715, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 4.90999e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.665e-05 [call_graph_tuple_transform]: 1.693e-05 [tuple_list_get_item_eliminator]: 5.38002e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 6.26998e-06 [remove_dup_value]: 8.89003e-06 [partial_unused_args_eliminate]: 1.61002e-06 [environ_conv]: 3.65e-06 [add_recomputation]: 3.367e-05 [cse_after_recomputation]: 2.027e-05, [1] [Cycle 1]: 1.561e-05, [1] [cse]: 1.03e-05 [auto_monad_reorder]: 1.13e-05 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.00044335 [symbol_engine_optimizer]: 6.907e-05, [1] [Cycle 1]: 6.284e-05, [6] [build]: 2.27001e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.233e-05 [opt_reshape]: 5.63997e-06 [fold_const_symbol]: 8.03001e-06 [renormalize]: 2.70025e-07 [validate]: 2.671e-05 Sums bootstrap : 0.000274s : 3.27% type_inference : 0.004773s : 57.00% event_method : 0.000016s : 0.19% auto_monad : 0.000047s : 0.56% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.45% rewriter_before_opt_a : 0.000068s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000053s : 0.63% jit_opt_a.loop_unroll : 0.000035s : 0.42% jit_opt_a.a_1 : 0.000609s : 7.27% jit_opt_a.with_stream_mark : 0.000021s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000577s : 6.89% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.20% jit_opt_a.cse : 0.000028s : 0.34% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000026s : 0.31% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000471s : 5.62% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000017s : 0.20% loop_unroll : 0.000415s : 4.95% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000017s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000009s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.04% add_recomputation : 0.000034s : 0.40% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000011s : 0.13% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000443s : 5.29% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.32% Time group info: ------[substitution.] 0.000193 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.07% : 0.000004s : 3: substitution.graph_param_transform 86.93% : 0.000168s : 4: substitution.inline 1.31% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.21% : 0.000004s : 4: substitution.remove_not_recompute_node 1.71% : 0.000003s : 2: substitution.replace_old_param 4.39% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004721 2 79.18% : 0.003739s : 1: type_inference.infer 20.82% : 0.000983s : 1: type_inference.specialize ------[replace.] 0.000065 6 65.84% : 0.000043s : 4: replace.inline 34.16% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 95.85% : 0.000165s : 4: match.inline 4.15% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.25% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.14% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000001s : 6: predicate.less_batch_normalization 1.67% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 1.33% : 0.000001s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 16: predicate.switch_defer_inline 2.31% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.58% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.00% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.88% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000738 13 51.82% : 0.000382s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.51% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.68% : 0.000300s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013304 72 0.27% : 0.000036s : 1: add_recomputation 0.38% : 0.000050s : 1: auto_monad 0.11% : 0.000014s : 1: auto_monad_reorder 2.16% : 0.000287s : 1: bootstrap 0.15% : 0.000020s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000022s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.14% : 0.000019s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 35.54% : 0.004728s : 1: jit_opt_a 1.02% : 0.000136s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.18% : 0.000423s : 1: loop_unroll 3.60% : 0.000479s : 1: mutable_eliminate 6.07% : 0.000808s : 26: opt.transform.jit_opt_a 0.34% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.39% : 0.000451s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000011s : 1: remove_dup_value 2.11% : 0.000280s : 1: renormalize.infer 2.18% : 0.000289s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000028s : 1: rewriter_after_opt_a 0.53% : 0.000071s : 1: rewriter_before_opt_a 0.54% : 0.000072s : 1: symbol_engine_optimizer 35.95% : 0.004783s : 1: type_inference TotalTime = 0.11656, [30] [bootstrap]: 0.00028674 [type_inference]: 0.106237 [event_method]: 1.901e-05 [auto_monad]: 6.367e-05 [graph_reusing]: 5.57001e-06 [pre_auto_parallel]: 2.21e-06 [py_interpret_to_execute]: 0.00047213 [rewriter_before_opt_a]: 8.502e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00721861, [2] [Cycle 1]: 0.0037085, [27] [switch_simplify]: 5.916e-05 [loop_unroll]: 3.418e-05 [a_1]: 0.00069037 [with_stream_mark]: 1.371e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.81999e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 6.87002e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 7.03e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.348e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 6.12001e-06 [renormalize]: 0.00258089 [add_forward_monad_depend]: 5.72001e-06 [auto_monad_grad]: 2.02999e-06 [auto_monad_eliminator]: 1.561e-05 [cse]: 2.808e-05 [replace_applicator]: 1.368e-05 [Cycle 2]: 0.00036305, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.72001e-06 [a_1]: 0.0001244 [with_stream_mark]: 1.046e-05 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.227e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.66998e-06 [replace_old_param]: 8.41002e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.27e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.071e-05 [rewriter_after_opt_a]: 3.303e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.47001e-06 [mutable_eliminate]: 0.00055007 [jit_opt_b]: 5.199e-05, [1] [Cycle 1]: 4.506e-05, [2] [frontend_op_eliminate]: 1.727e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 2.33e-05 [loop_unroll]: 0.00041997 [jit_opt_after_cconv]: 0.00014708, [1] [Cycle 1]: 0.00014087, [11] [c_1]: 2.469e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 2.127e-05 [call_graph_tuple_transform]: 1.994e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.537e-05 [partial_unused_args_eliminate]: 1.86e-06 [environ_conv]: 6.91001e-06 [add_recomputation]: 4.245e-05 [cse_after_recomputation]: 2.263e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.707e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 5.30001e-06 [opt_after_jit_grad]: 0.00047393 [symbol_engine_optimizer]: 0.00012246, [1] [Cycle 1]: 0.00011598, [6] [build]: 3.14001e-06 [elim_shapecalc]: 9.00001e-06 [elim_not_effective]: 5.766e-05 [opt_reshape]: 7.15e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 4.80009e-07 [validate]: 4.097e-05 Sums bootstrap : 0.000287s : 0.25% type_inference : 0.106237s : 94.14% event_method : 0.000019s : 0.02% auto_monad : 0.000064s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000472s : 0.42% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000815s : 0.72% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002581s : 2.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000550s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000420s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000042s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000474s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000058s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000241 28 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 4: substitution.graph_param_transform 82.94% : 0.000200s : 5: substitution.inline 1.28% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.32% : 0.000010s : 3: substitution.reduce_eliminate 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.45% : 0.000003s : 2: substitution.replace_old_param 4.37% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106174 2 97.44% : 0.103460s : 1: type_inference.infer 2.56% : 0.002714s : 1: type_inference.specialize ------[replace.] 0.000093 7 66.72% : 0.000062s : 5: replace.inline 33.28% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 7 95.43% : 0.000197s : 5: match.inline 4.57% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000166 886 1.03% : 0.000002s : 13: predicate.accumulaten_eliminater 0.72% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 19.90% : 0.000033s : 13: predicate.arithmetic_simplify 1.02% : 0.000002s : 13: predicate.cast_eliminate 0.36% : 0.000001s : 4: predicate.check_bprop_eliminate 0.94% : 0.000002s : 13: predicate.compare_switch_simplify 1.06% : 0.000002s : 13: predicate.depend_value_elim 0.95% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.02% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.05% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.60% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.41% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 13: predicate.environ_add_const_eliminate 0.92% : 0.000002s : 13: predicate.environ_get_add_eliminate 0.93% : 0.000002s : 13: predicate.environ_get_depend_swap 0.99% : 0.000002s : 13: predicate.environ_get_eliminate 0.94% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.85% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 4.17% : 0.000007s : 28: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.38% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000002s : 8: predicate.less_batch_normalization 1.21% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.47% : 0.000002s : 19: predicate.load_eliminater 0.92% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.23% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.68% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 0.93% : 0.000002s : 13: predicate.merge_addn 0.97% : 0.000002s : 13: predicate.minmaximum_grad 1.06% : 0.000002s : 4: predicate.mutable_eliminate 0.40% : 0.000001s : 4: predicate.opt_reshape 2.10% : 0.000003s : 19: predicate.partial_eliminate 1.03% : 0.000002s : 13: predicate.print_const_string_wrapper 1.58% : 0.000003s : 13: predicate.reduce_eliminate 1.15% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.61% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000001s : 4: predicate.reset_defer_inline 1.08% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.58% : 0.000001s : 4: predicate.row_tensor_eliminate 0.98% : 0.000002s : 13: predicate.same_eliminate 0.54% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.73% : 0.000001s : 8: predicate.special_op_eliminate 0.77% : 0.000001s : 8: predicate.specialize_transform 1.21% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.10% : 0.000003s : 20: predicate.switch_defer_inline 1.80% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.14% : 0.000010s : 64: predicate.switch_simplify 1.02% : 0.000002s : 13: predicate.tile_eliminate 1.09% : 0.000002s : 13: predicate.transpose_eliminate 1.11% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.05% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.19% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.23% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.24% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.50% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.45% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.32% : 0.000002s : 13: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.46% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002155 25 65.80% : 0.001418s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.85% : 0.000062s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.35% : 0.000676s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120306 72 0.04% : 0.000045s : 1: add_recomputation 0.06% : 0.000067s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000302s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.00% : 0.007222s : 1: jit_opt_a 0.12% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.36% : 0.000428s : 1: loop_unroll 0.46% : 0.000559s : 1: mutable_eliminate 0.87% : 0.001050s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000081s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000479s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.56% : 0.001872s : 1: renormalize.infer 0.58% : 0.000700s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000089s : 1: rewriter_before_opt_a 0.10% : 0.000125s : 1: symbol_engine_optimizer 88.32% : 0.106250s : 1: type_inference TotalTime = 0.0146382, [30] [bootstrap]: 0.00027184 [type_inference]: 0.00716126 [event_method]: 1.898e-05 [auto_monad]: 6.434e-05 [graph_reusing]: 6.36e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 3.76e-05 [rewriter_before_opt_a]: 7.744e-05 [expand_dump_flag]: 3.13998e-06 [jit_opt_a]: 0.00497725, [2] [Cycle 1]: 0.00161142, [27] [switch_simplify]: 5.461e-05 [loop_unroll]: 3.232e-05 [a_1]: 0.0005862 [with_stream_mark]: 1.549e-05 [recompute_prepare]: 7.88999e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 3.7e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.44001e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.44001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 8.36002e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 0.00060956 [add_forward_monad_depend]: 4.83001e-06 [auto_monad_grad]: 1.89999e-06 [auto_monad_eliminator]: 1.314e-05 [cse]: 3.108e-05 [replace_applicator]: 1.073e-05 [Cycle 2]: 0.00031718, [27] [switch_simplify]: 5.84e-06 [loop_unroll]: 4.97e-06 [a_1]: 9.328e-05 [with_stream_mark]: 9.57999e-06 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 2.75002e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.23002e-06 [parameter_eliminate]: 9.40025e-07 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.21002e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 4.58001e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.061e-05 [j_node_and_user_rematch]: 7.68999e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.03e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.25999e-06 [cse]: 1.191e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 8.96002e-06 [rewriter_after_opt_a]: 3.526e-05 [convert_after_rewriter]: 7.53999e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00047801 [jit_opt_b]: 4.857e-05, [1] [Cycle 1]: 4.171e-05, [2] [frontend_op_eliminate]: 1.59e-05 [inline_after_opt_a]: 1.499e-05 [cconv]: 2.369e-05 [loop_unroll]: 0.00041412 [jit_opt_after_cconv]: 0.0001544, [1] [Cycle 1]: 0.00014751, [11] [c_1]: 2.158e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 1.311e-05 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.207e-05 [call_graph_tuple_transform]: 1.928e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.62001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.562e-05 [partial_unused_args_eliminate]: 2.86e-06 [environ_conv]: 6.42001e-06 [add_recomputation]: 4.763e-05 [cse_after_recomputation]: 2.329e-05, [1] [Cycle 1]: 1.764e-05, [1] [cse]: 1.187e-05 [auto_monad_reorder]: 1.696e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00045422 [symbol_engine_optimizer]: 7.186e-05, [1] [Cycle 1]: 6.575e-05, [6] [build]: 2.90998e-06 [elim_shapecalc]: 8.03999e-06 [elim_not_effective]: 1.297e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.40021e-07 [validate]: 3.626e-05 Sums bootstrap : 0.000272s : 2.46% type_inference : 0.007161s : 64.90% event_method : 0.000019s : 0.17% auto_monad : 0.000064s : 0.58% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000038s : 0.34% rewriter_before_opt_a : 0.000077s : 0.70% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000060s : 0.55% jit_opt_a.loop_unroll : 0.000037s : 0.34% jit_opt_a.a_1 : 0.000679s : 6.16% jit_opt_a.with_stream_mark : 0.000025s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000010s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000610s : 5.53% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.17% jit_opt_a.cse : 0.000043s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.14% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000035s : 0.32% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000478s : 4.33% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000024s : 0.21% loop_unroll : 0.000414s : 3.75% jit_opt_after_cconv.c_1 : 0.000022s : 0.20% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000013s : 0.12% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000048s : 0.43% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000454s : 4.12% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.33% Time group info: ------[substitution.] 0.000217 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000002s : 2: substitution.fold_const_symbol 2.48% : 0.000005s : 3: substitution.graph_param_transform 82.67% : 0.000179s : 5: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.36% : 0.000009s : 3: substitution.reduce_eliminate 1.76% : 0.000004s : 4: substitution.remove_not_recompute_node 1.35% : 0.000003s : 2: substitution.replace_old_param 4.44% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007105 2 87.38% : 0.006208s : 1: type_inference.infer 12.62% : 0.000897s : 1: type_inference.specialize ------[replace.] 0.000084 7 68.61% : 0.000058s : 5: replace.inline 31.39% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 7 95.39% : 0.000176s : 5: match.inline 4.61% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.15% : 0.000003s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000001s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.22% : 0.000001s : 11: predicate.environ_get_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.37% : 0.000006s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.06% : 0.000002s : 16: predicate.load_eliminater 1.18% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.40% : 0.000000s : 3: predicate.opt_reshape 2.27% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000001s : 11: predicate.print_const_string_wrapper 1.87% : 0.000002s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.21% : 0.000010s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.28% : 0.000002s : 11: predicate.transpose_eliminate 1.37% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.26% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000681 16 49.56% : 0.000338s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.43% : 0.000051s : 2: func_graph_cloner_run.FuncGraphClonerNode 43.00% : 0.000293s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016198 72 0.31% : 0.000050s : 1: add_recomputation 0.42% : 0.000068s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.75% : 0.000284s : 1: bootstrap 0.16% : 0.000026s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.74% : 0.004980s : 1: jit_opt_a 0.97% : 0.000157s : 1: jit_opt_after_cconv 0.32% : 0.000051s : 1: jit_opt_b 2.65% : 0.000429s : 1: loop_unroll 3.00% : 0.000487s : 1: mutable_eliminate 5.47% : 0.000887s : 26: opt.transform.jit_opt_a 0.30% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.85% : 0.000462s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000040s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.04% : 0.000331s : 1: renormalize.infer 1.67% : 0.000271s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000038s : 1: rewriter_after_opt_a 0.50% : 0.000080s : 1: rewriter_before_opt_a 0.46% : 0.000074s : 1: symbol_engine_optimizer 44.28% : 0.007173s : 1: type_inference TotalTime = 0.1118, [30] [bootstrap]: 0.0002752 [type_inference]: 0.101682 [event_method]: 1.787e-05 [auto_monad]: 6.114e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.15002e-06 [py_interpret_to_execute]: 0.00047302 [rewriter_before_opt_a]: 8.034e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.0070475, [2] [Cycle 1]: 0.00349559, [27] [switch_simplify]: 4.61e-05 [loop_unroll]: 3e-05 [a_1]: 0.00053134 [with_stream_mark]: 1.515e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.98998e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.314e-05 [j_node_and_user_rematch]: 1.008e-05 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 9.57999e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00254785 [add_forward_monad_depend]: 6.51e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 2.809e-05 [replace_applicator]: 1.658e-05 [Cycle 2]: 0.00036697, [27] [switch_simplify]: 6.37001e-06 [loop_unroll]: 6.17001e-06 [a_1]: 0.00012501 [with_stream_mark]: 1.101e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 3.18998e-06 [cell_reuse_recompute_pass]: 2.31e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.454e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.51002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.082e-05 [replace_applicator]: 5.95002e-06 [py_interpret_to_execute_after_opt_a]: 1.107e-05 [rewriter_after_opt_a]: 3.539e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00058677 [jit_opt_b]: 5.292e-05, [1] [Cycle 1]: 4.632e-05, [2] [frontend_op_eliminate]: 1.873e-05 [inline_after_opt_a]: 1.704e-05 [cconv]: 2.173e-05 [loop_unroll]: 0.00041856 [jit_opt_after_cconv]: 0.0001424, [1] [Cycle 1]: 0.00013635, [11] [c_1]: 2.55e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 4.89e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 1.97999e-06 [cse]: 1.836e-05 [call_graph_tuple_transform]: 1.948e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.399e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.5e-06 [add_recomputation]: 4.514e-05 [cse_after_recomputation]: 2.197e-05, [1] [Cycle 1]: 1.617e-05, [1] [cse]: 1.071e-05 [auto_monad_reorder]: 1.473e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 4.53999e-06 [opt_after_jit_grad]: 0.00046407 [symbol_engine_optimizer]: 7.448e-05, [1] [Cycle 1]: 6.834e-05, [6] [build]: 3.25e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.384e-05 [opt_reshape]: 6.14001e-06 [fold_const_symbol]: 9.22999e-06 [renormalize]: 3.30008e-07 [validate]: 5.498e-05 Sums bootstrap : 0.000275s : 0.25% type_inference : 0.101682s : 94.10% event_method : 0.000018s : 0.02% auto_monad : 0.000061s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000473s : 0.44% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000656s : 0.61% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002548s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000587s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000419s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000464s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000055s : 0.05% Time group info: ------[substitution.] 0.000178 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 1.03% : 0.000002s : 2: substitution.fold_const_symbol 3.04% : 0.000005s : 4: substitution.graph_param_transform 81.07% : 0.000144s : 4: substitution.inline 2.05% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.49% : 0.000004s : 2: substitution.replace_old_param 6.40% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101617 2 97.46% : 0.099041s : 1: type_inference.infer 2.54% : 0.002576s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.78% : 0.000044s : 4: replace.inline 33.22% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 93.30% : 0.000141s : 4: match.inline 6.70% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 4.86% : 0.000006s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 18: predicate.partial_eliminate 1.33% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.47% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.99% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000001s : 12: predicate.transpose_eliminate 1.58% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002062 22 64.26% : 0.001325s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.36% : 0.000709s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115284 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000064s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000289s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.12% : 0.007051s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000427s : 1: loop_unroll 0.52% : 0.000594s : 1: mutable_eliminate 0.76% : 0.000880s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000479s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.52% : 0.001751s : 1: renormalize.infer 0.68% : 0.000789s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 88.21% : 0.101695s : 1: type_inference TotalTime = 0.115782, [30] [bootstrap]: 0.00029863 [type_inference]: 0.10509 [event_method]: 2.316e-05 [auto_monad]: 6.699e-05 [graph_reusing]: 6.23e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00049624 [rewriter_before_opt_a]: 9.375e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00737222, [2] [Cycle 1]: 0.00373162, [27] [switch_simplify]: 5.876e-05 [loop_unroll]: 3.389e-05 [a_1]: 0.00066752 [with_stream_mark]: 1.563e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.48e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.91e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.91003e-06 [accelerated_algorithm]: 1.736e-05 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.57002e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.593e-05 [j_node_and_user_rematch]: 1.079e-05 [meta_fg_expand]: 2.55002e-06 [replace_old_param]: 9.51998e-06 [inline_without_move]: 6.18998e-06 [renormalize]: 0.00259448 [add_forward_monad_depend]: 6.54999e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.594e-05 [cse]: 3.28e-05 [replace_applicator]: 1.527e-05 [Cycle 2]: 0.000387, [27] [switch_simplify]: 7.45998e-06 [loop_unroll]: 6.17999e-06 [a_1]: 0.00013273 [with_stream_mark]: 1.126e-05 [recompute_prepare]: 6.49999e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.99e-06 [updatestate_useless_node_eliminater]: 5.93002e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 9.09998e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 8.93002e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 1.02e-06 [auto_monad_eliminator]: 6.86001e-06 [cse]: 1.464e-05 [replace_applicator]: 6.27001e-06 [py_interpret_to_execute_after_opt_a]: 1.425e-05 [rewriter_after_opt_a]: 3.615e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.29998e-06 [mutable_eliminate]: 0.0005864 [jit_opt_b]: 5.582e-05, [1] [Cycle 1]: 4.877e-05, [2] [frontend_op_eliminate]: 1.946e-05 [inline_after_opt_a]: 1.771e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00044416 [jit_opt_after_cconv]: 0.00015153, [1] [Cycle 1]: 0.00014483, [11] [c_1]: 2.498e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.86e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 3.14999e-06 [cse]: 2.188e-05 [call_graph_tuple_transform]: 2.027e-05 [tuple_list_get_item_eliminator]: 7.1e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.562e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 7.61999e-06 [add_recomputation]: 4.96e-05 [cse_after_recomputation]: 2.594e-05, [1] [Cycle 1]: 2.036e-05, [1] [cse]: 1.45e-05 [auto_monad_reorder]: 1.82e-05 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 5.10001e-06 [opt_after_jit_grad]: 0.0004629 [symbol_engine_optimizer]: 0.00013431, [1] [Cycle 1]: 0.00012806, [6] [build]: 3.6e-06 [elim_shapecalc]: 1.064e-05 [elim_not_effective]: 1.56e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 6.35e-05 [renormalize]: 3.30008e-07 [validate]: 4.595e-05 Sums bootstrap : 0.000299s : 0.27% type_inference : 0.105090s : 93.93% event_method : 0.000023s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000496s : 0.44% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000800s : 0.72% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000023s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002595s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000586s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000444s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000463s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000063s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000252 28 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 4: substitution.graph_param_transform 82.29% : 0.000207s : 5: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.71% : 0.000012s : 3: substitution.reduce_eliminate 1.91% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000004s : 2: substitution.replace_old_param 4.12% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105018 2 97.34% : 0.102228s : 1: type_inference.infer 2.66% : 0.002790s : 1: type_inference.specialize ------[replace.] 0.000094 7 68.94% : 0.000064s : 5: replace.inline 31.06% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000213 7 95.69% : 0.000204s : 5: match.inline 4.31% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.35% : 0.000002s : 13: predicate.accumulaten_eliminater 0.82% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.46% : 0.000002s : 13: predicate.addn_zero_filter 2.07% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.16% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.70% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 19: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 1.95% : 0.000003s : 13: predicate.reduce_eliminate 1.41% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 23: predicate.replace_applicator 1.00% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.40% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002129 25 65.41% : 0.001393s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.74% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.85% : 0.000678s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119497 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.26% : 0.000313s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.17% : 0.007376s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.38% : 0.000452s : 1: loop_unroll 0.50% : 0.000595s : 1: mutable_eliminate 0.88% : 0.001052s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000092s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000503s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.59% : 0.001902s : 1: renormalize.infer 0.57% : 0.000684s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.11% : 0.000137s : 1: symbol_engine_optimizer 87.96% : 0.105108s : 1: type_inference TotalTime = 0.112758, [30] [bootstrap]: 0.00027362 [type_inference]: 0.10254 [event_method]: 1.868e-05 [auto_monad]: 6.376e-05 [graph_reusing]: 6.19999e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00041925 [rewriter_before_opt_a]: 8.047e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00693959, [2] [Cycle 1]: 0.00341447, [27] [switch_simplify]: 5.226e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00055091 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.33001e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.98002e-06 [meta_shard_fg_expand]: 2.18998e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.79999e-06 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00240821 [add_forward_monad_depend]: 7.08998e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.998e-05 [cse]: 3.446e-05 [replace_applicator]: 1.72e-05 [Cycle 2]: 0.00036147, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 6.09999e-06 [a_1]: 0.00011912 [with_stream_mark]: 1.076e-05 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.56998e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.03998e-06 [cell_reuse_recompute_pass]: 2.23998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.88002e-06 [inline_without_move]: 5.63002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.12999e-06 [cse]: 1.12e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 8.58001e-06 [rewriter_after_opt_a]: 3.472e-05 [convert_after_rewriter]: 7.24001e-06 [order_py_execute_after_rewriter]: 3.027e-05 [mutable_eliminate]: 0.00062228 [jit_opt_b]: 5.54e-05, [1] [Cycle 1]: 4.861e-05, [2] [frontend_op_eliminate]: 1.923e-05 [inline_after_opt_a]: 1.863e-05 [cconv]: 2.897e-05 [loop_unroll]: 0.00044841 [jit_opt_after_cconv]: 0.00015869, [1] [Cycle 1]: 0.00015213, [11] [c_1]: 2.588e-05 [parameter_eliminate]: 3.34001e-06 [updatestate_depend_eliminate]: 6.90998e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.592e-05 [call_graph_tuple_transform]: 2.132e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 1.96003e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.524e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 8.47998e-06 [add_recomputation]: 6.284e-05 [cse_after_recomputation]: 2.601e-05, [1] [Cycle 1]: 1.849e-05, [1] [cse]: 1.204e-05 [auto_monad_reorder]: 1.46e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 5.29998e-06 [opt_after_jit_grad]: 0.00050219 [symbol_engine_optimizer]: 0.00014315, [1] [Cycle 1]: 0.00013595, [6] [build]: 4e-06 [elim_shapecalc]: 8.14002e-06 [elim_not_effective]: 1.519e-05 [opt_reshape]: 6.24999e-06 [fold_const_symbol]: 6.997e-05 [renormalize]: 7.2e-07 [validate]: 4.625e-05 Sums bootstrap : 0.000274s : 0.25% type_inference : 0.102540s : 94.08% event_method : 0.000019s : 0.02% auto_monad : 0.000064s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000419s : 0.38% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000670s : 0.61% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002408s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000030s : 0.03% mutable_eliminate : 0.000622s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000448s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000063s : 0.06% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000502s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000070s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000193 24 1.67% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000005s : 4: substitution.graph_param_transform 81.75% : 0.000158s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000005s : 2: substitution.replace_old_param 6.43% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102463 2 97.52% : 0.099920s : 1: type_inference.infer 2.48% : 0.002542s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.92% : 0.000047s : 4: replace.inline 31.08% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.20% : 0.000156s : 4: match.inline 6.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.62% : 0.000002s : 12: predicate.addn_zero_filter 1.87% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.16% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.35% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.62% : 0.000001s : 4: predicate.graph_param_transform 5.25% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 2.00% : 0.000003s : 4: predicate.mutable_eliminate 0.83% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 1.03% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.45% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000001s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.33% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.00% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.43% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001970 22 67.81% : 0.001336s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.72% : 0.000605s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116193 72 0.06% : 0.000066s : 1: add_recomputation 0.06% : 0.000067s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000287s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.98% : 0.006943s : 1: jit_opt_a 0.14% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.39% : 0.000458s : 1: loop_unroll 0.54% : 0.000632s : 1: mutable_eliminate 0.77% : 0.000898s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000096s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000513s : 1: opt_after_jit_grad 0.03% : 0.000033s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000426s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.51% : 0.001752s : 1: renormalize.infer 0.56% : 0.000647s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000146s : 1: symbol_engine_optimizer 88.26% : 0.102557s : 1: type_inference TotalTime = 0.118688, [30] [bootstrap]: 0.00027944 [type_inference]: 0.107896 [event_method]: 1.978e-05 [auto_monad]: 5.903e-05 [graph_reusing]: 4.84e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 0.00051885 [rewriter_before_opt_a]: 9.096e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00758312, [2] [Cycle 1]: 0.00398589, [27] [switch_simplify]: 5.36e-05 [loop_unroll]: 3.441e-05 [a_1]: 0.00067156 [with_stream_mark]: 1.647e-05 [recompute_prepare]: 8.59998e-06 [updatestate_depend_eliminate]: 3.54002e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 7.23999e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.38998e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 2.93998e-06 [cell_reuse_recompute_pass]: 8.29983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 9.92999e-06 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 9.67001e-06 [inline_without_move]: 6.34001e-06 [renormalize]: 0.00287196 [add_forward_monad_depend]: 6.70002e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.478e-05 [cse]: 2.503e-05 [replace_applicator]: 1.85e-05 [Cycle 2]: 0.00039432, [27] [switch_simplify]: 8.13999e-06 [loop_unroll]: 6.63003e-06 [a_1]: 0.00014157 [with_stream_mark]: 1.371e-05 [recompute_prepare]: 6.23e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.23002e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 5.74999e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 2.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.05999e-06 [inline_without_move]: 5.71e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.69999e-06 [cse]: 1.368e-05 [replace_applicator]: 6.29001e-06 [py_interpret_to_execute_after_opt_a]: 1.346e-05 [rewriter_after_opt_a]: 3.589e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00064335 [jit_opt_b]: 5.687e-05, [1] [Cycle 1]: 4.992e-05, [2] [frontend_op_eliminate]: 1.934e-05 [inline_after_opt_a]: 1.795e-05 [cconv]: 2.337e-05 [loop_unroll]: 0.00043245 [jit_opt_after_cconv]: 0.00015032, [1] [Cycle 1]: 0.00014314, [11] [c_1]: 2.475e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 2.332e-05 [call_graph_tuple_transform]: 2.022e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.37e-05 [partial_unused_args_eliminate]: 1.90001e-06 [environ_conv]: 8.07e-06 [add_recomputation]: 4.503e-05 [cse_after_recomputation]: 2.248e-05, [1] [Cycle 1]: 1.742e-05, [1] [cse]: 1.186e-05 [auto_monad_reorder]: 1.481e-05 [get_jit_bprop_graph]: 2.17001e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.0004556 [symbol_engine_optimizer]: 8.975e-05, [1] [Cycle 1]: 6.776e-05, [6] [build]: 3.11001e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 1.326e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 3.60014e-07 [validate]: 4.086e-05 Sums bootstrap : 0.000279s : 0.24% type_inference : 0.107896s : 93.91% event_method : 0.000020s : 0.02% auto_monad : 0.000059s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000519s : 0.45% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000813s : 0.71% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002872s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000643s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000432s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000456s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000246 28 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.22% : 0.000005s : 4: substitution.graph_param_transform 82.18% : 0.000202s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.67% : 0.000011s : 3: substitution.reduce_eliminate 2.08% : 0.000005s : 4: substitution.remove_not_recompute_node 1.95% : 0.000005s : 2: substitution.replace_old_param 4.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107832 2 97.49% : 0.105123s : 1: type_inference.infer 2.51% : 0.002710s : 1: type_inference.specialize ------[replace.] 0.000096 7 67.06% : 0.000065s : 5: replace.inline 32.94% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 7 95.53% : 0.000199s : 5: match.inline 4.47% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.55% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000001s : 4: predicate.graph_param_transform 5.55% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 19: predicate.load_eliminater 1.64% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.26% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 23: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.55% : 0.000004s : 20: predicate.switch_defer_inline 2.24% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.01% : 0.000010s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 13: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002202 25 63.59% : 0.001400s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.12% : 0.000069s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.29% : 0.000733s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122691 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000062s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000291s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.18% : 0.007587s : 1: jit_opt_a 0.12% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000440s : 1: loop_unroll 0.53% : 0.000652s : 1: mutable_eliminate 0.86% : 0.001054s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000526s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.71% : 0.002101s : 1: renormalize.infer 0.62% : 0.000761s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.08% : 0.000092s : 1: symbol_engine_optimizer 87.95% : 0.107911s : 1: type_inference TotalTime = 0.0152258, [30] [bootstrap]: 0.00027786 [type_inference]: 0.00736664 [event_method]: 1.839e-05 [auto_monad]: 5.944e-05 [graph_reusing]: 5.24998e-06 [pre_auto_parallel]: 2.07001e-06 [py_interpret_to_execute]: 3.857e-05 [rewriter_before_opt_a]: 7.673e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00524476, [2] [Cycle 1]: 0.00177833, [27] [switch_simplify]: 5.148e-05 [loop_unroll]: 3.213e-05 [a_1]: 0.00059788 [with_stream_mark]: 1.615e-05 [recompute_prepare]: 7.61999e-06 [updatestate_depend_eliminate]: 4.02998e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 2.26998e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.351e-05 [j_node_and_user_rematch]: 8.81002e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 0.00076098 [add_forward_monad_depend]: 5.10001e-06 [auto_monad_grad]: 1.85001e-06 [auto_monad_eliminator]: 1.186e-05 [cse]: 2.376e-05 [replace_applicator]: 1.31e-05 [Cycle 2]: 0.00032804, [27] [switch_simplify]: 6.71999e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.7e-05 [with_stream_mark]: 9.49e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 4.95999e-06 [updatestate_useless_node_eliminater]: 4.85999e-06 [accelerated_algorithm]: 5.23002e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.137e-05 [j_node_and_user_rematch]: 8.18001e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.299e-05 [replace_applicator]: 4.83001e-06 [py_interpret_to_execute_after_opt_a]: 1.201e-05 [rewriter_after_opt_a]: 3.643e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.0005472 [jit_opt_b]: 4.893e-05, [1] [Cycle 1]: 4.19e-05, [2] [frontend_op_eliminate]: 1.51e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 2.293e-05 [loop_unroll]: 0.00041793 [jit_opt_after_cconv]: 0.0001506, [1] [Cycle 1]: 0.00014359, [11] [c_1]: 2.09e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 6.48998e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.435e-05 [call_graph_tuple_transform]: 1.973e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.7998e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.665e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.19001e-06 [add_recomputation]: 5.036e-05 [cse_after_recomputation]: 2.268e-05, [1] [Cycle 1]: 1.771e-05, [1] [cse]: 1.202e-05 [auto_monad_reorder]: 1.639e-05 [get_jit_bprop_graph]: 1.94999e-06 [rewriter_after_jit_bprop_graph]: 4.87e-06 [opt_after_jit_grad]: 0.00049778 [symbol_engine_optimizer]: 7.173e-05, [1] [Cycle 1]: 6.558e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 8.17e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.71003e-06 [fold_const_symbol]: 8.48001e-06 [renormalize]: 4.80009e-07 [validate]: 3.556e-05 Sums bootstrap : 0.000278s : 2.41% type_inference : 0.007367s : 63.93% event_method : 0.000018s : 0.16% auto_monad : 0.000059s : 0.52% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.33% rewriter_before_opt_a : 0.000077s : 0.67% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.51% jit_opt_a.loop_unroll : 0.000037s : 0.32% jit_opt_a.a_1 : 0.000695s : 6.03% jit_opt_a.with_stream_mark : 0.000026s : 0.22% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000761s : 6.61% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.15% jit_opt_a.cse : 0.000037s : 0.32% jit_opt_a.replace_applicator : 0.000018s : 0.16% py_interpret_to_execute_after_opt_a : 0.000012s : 0.10% rewriter_after_opt_a : 0.000036s : 0.32% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000547s : 4.75% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000023s : 0.20% loop_unroll : 0.000418s : 3.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.44% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000016s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000498s : 4.32% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.31% Time group info: ------[substitution.] 0.000222 27 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000005s : 3: substitution.graph_param_transform 81.77% : 0.000182s : 5: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.61% : 0.000010s : 3: substitution.reduce_eliminate 2.00% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000003s : 2: substitution.replace_old_param 4.64% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007311 2 87.79% : 0.006419s : 1: type_inference.infer 12.21% : 0.000892s : 1: type_inference.specialize ------[replace.] 0.000082 7 68.53% : 0.000056s : 5: replace.inline 31.47% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 7 95.06% : 0.000179s : 5: match.inline 4.94% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.33% : 0.000002s : 11: predicate.accumulaten_eliminater 1.30% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 2.29% : 0.000003s : 11: predicate.arithmetic_simplify 1.23% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.67% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.43% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.33% : 0.000002s : 11: predicate.environ_get_eliminate 1.10% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000007s : 24: predicate.inline 1.07% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.54% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.03% : 0.000003s : 11: predicate.reduce_eliminate 1.44% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.58% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.89% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 59: predicate.switch_simplify 1.24% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.38% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000708 16 49.47% : 0.000350s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.94% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.60% : 0.000302s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016959 72 0.31% : 0.000053s : 1: add_recomputation 0.37% : 0.000063s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 1.72% : 0.000291s : 1: bootstrap 0.15% : 0.000025s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000008s : 1: graph_reusing 30.95% : 0.005248s : 1: jit_opt_a 0.91% : 0.000154s : 1: jit_opt_after_cconv 0.30% : 0.000051s : 1: jit_opt_b 2.51% : 0.000426s : 1: loop_unroll 3.28% : 0.000557s : 1: mutable_eliminate 5.35% : 0.000907s : 26: opt.transform.jit_opt_a 0.29% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.14% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.98% : 0.000506s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000041s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.41% : 0.000409s : 1: renormalize.infer 2.03% : 0.000344s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000039s : 1: rewriter_after_opt_a 0.47% : 0.000080s : 1: rewriter_before_opt_a 0.44% : 0.000074s : 1: symbol_engine_optimizer 43.51% : 0.007379s : 1: type_inference TotalTime = 0.113422, [30] [bootstrap]: 0.00027789 [type_inference]: 0.103214 [event_method]: 1.866e-05 [auto_monad]: 6.816e-05 [graph_reusing]: 6.04001e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00043965 [rewriter_before_opt_a]: 7.88e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00709015, [2] [Cycle 1]: 0.00343845, [27] [switch_simplify]: 5.034e-05 [loop_unroll]: 3.01e-05 [a_1]: 0.00054172 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 9.06998e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.56e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.49001e-06 [get_grad_eliminate_]: 5.94e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 8.96998e-06 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00245828 [add_forward_monad_depend]: 5.73002e-06 [auto_monad_grad]: 2.06998e-06 [auto_monad_eliminator]: 1.702e-05 [cse]: 2.813e-05 [replace_applicator]: 1.584e-05 [Cycle 2]: 0.00036401, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00012105 [with_stream_mark]: 1.053e-05 [recompute_prepare]: 5.95002e-06 [updatestate_depend_eliminate]: 3.65998e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 2.12001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.135e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 8.94998e-06 [rewriter_after_opt_a]: 3.248e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.00059255 [jit_opt_b]: 5.243e-05, [1] [Cycle 1]: 4.539e-05, [2] [frontend_op_eliminate]: 1.767e-05 [inline_after_opt_a]: 1.685e-05 [cconv]: 2.425e-05 [loop_unroll]: 0.00041884 [jit_opt_after_cconv]: 0.00014735, [1] [Cycle 1]: 0.00014082, [11] [c_1]: 2.516e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.66003e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.039e-05 [call_graph_tuple_transform]: 1.991e-05 [tuple_list_get_item_eliminator]: 6.19999e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.84e-06 [remove_dup_value]: 1.506e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 8.10999e-06 [add_recomputation]: 4.654e-05 [cse_after_recomputation]: 2.123e-05, [1] [Cycle 1]: 1.616e-05, [1] [cse]: 1.048e-05 [auto_monad_reorder]: 1.612e-05 [get_jit_bprop_graph]: 1.44998e-06 [rewriter_after_jit_bprop_graph]: 4.42e-06 [opt_after_jit_grad]: 0.00046656 [symbol_engine_optimizer]: 0.00014435, [1] [Cycle 1]: 8.234e-05, [6] [build]: 3.43999e-06 [elim_shapecalc]: 7.97998e-06 [elim_not_effective]: 2.569e-05 [opt_reshape]: 8.33999e-06 [fold_const_symbol]: 8.81997e-06 [renormalize]: 4.39992e-07 [validate]: 4.18e-05 Sums bootstrap : 0.000278s : 0.25% type_inference : 0.103214s : 94.25% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000440s : 0.40% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000663s : 0.61% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002458s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000593s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000419s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000467s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000188 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 3.09% : 0.000006s : 4: substitution.graph_param_transform 82.50% : 0.000155s : 4: substitution.inline 1.74% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000004s : 2: substitution.replace_old_param 6.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103144 2 97.34% : 0.100398s : 1: type_inference.infer 2.66% : 0.002746s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.76% : 0.000046s : 4: replace.inline 33.24% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.61% : 0.000153s : 4: match.inline 6.39% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.70% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.70% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.36% : 0.000000s : 4: predicate.graph_param_transform 5.99% : 0.000008s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.72% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.51% : 0.000002s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002111 22 63.15% : 0.001333s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.44% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.41% : 0.000747s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116848 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000290s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.07% : 0.007093s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000427s : 1: loop_unroll 0.51% : 0.000601s : 1: mutable_eliminate 0.76% : 0.000888s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000446s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.43% : 0.001673s : 1: renormalize.infer 0.66% : 0.000776s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000084s : 1: rewriter_before_opt_a 0.13% : 0.000147s : 1: symbol_engine_optimizer 88.34% : 0.103228s : 1: type_inference TotalTime = 0.0154941, [30] [bootstrap]: 0.00033183 [type_inference]: 0.00755339 [event_method]: 2.284e-05 [auto_monad]: 7.234e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.16e-06 [py_interpret_to_execute]: 4.789e-05 [rewriter_before_opt_a]: 8.275e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.0053358, [2] [Cycle 1]: 0.00180928, [27] [switch_simplify]: 5.863e-05 [loop_unroll]: 3.304e-05 [a_1]: 0.00061488 [with_stream_mark]: 1.873e-05 [recompute_prepare]: 8.34002e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.45002e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.68999e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.378e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.50999e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00071747 [add_forward_monad_depend]: 5.74999e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.405e-05 [cse]: 2.98e-05 [replace_applicator]: 1.187e-05 [Cycle 2]: 0.00032294, [27] [switch_simplify]: 5.56998e-06 [loop_unroll]: 4.82e-06 [a_1]: 9.531e-05 [with_stream_mark]: 8.72e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 4.97e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.135e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 6.74999e-06 [inline_without_move]: 4.64998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.267e-05 [replace_applicator]: 4.98001e-06 [py_interpret_to_execute_after_opt_a]: 1.236e-05 [rewriter_after_opt_a]: 3.521e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.99998e-06 [mutable_eliminate]: 0.00051242 [jit_opt_b]: 4.863e-05, [1] [Cycle 1]: 4.2e-05, [2] [frontend_op_eliminate]: 1.567e-05 [inline_after_opt_a]: 1.543e-05 [cconv]: 2.587e-05 [loop_unroll]: 0.00040655 [jit_opt_after_cconv]: 0.00014877, [1] [Cycle 1]: 0.00014217, [11] [c_1]: 2.03e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 6.09001e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.231e-05 [call_graph_tuple_transform]: 1.795e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 5.49975e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.547e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 6.09999e-06 [add_recomputation]: 4.96e-05 [cse_after_recomputation]: 2.407e-05, [1] [Cycle 1]: 1.851e-05, [1] [cse]: 1.25e-05 [auto_monad_reorder]: 1.686e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00044189 [symbol_engine_optimizer]: 7.232e-05, [1] [Cycle 1]: 6.616e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.79002e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.75001e-06 [fold_const_symbol]: 8.32998e-06 [renormalize]: 3.9002e-07 [validate]: 3.799e-05 Sums bootstrap : 0.000332s : 2.84% type_inference : 0.007553s : 64.66% event_method : 0.000023s : 0.20% auto_monad : 0.000072s : 0.62% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000048s : 0.41% rewriter_before_opt_a : 0.000083s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.55% jit_opt_a.loop_unroll : 0.000038s : 0.32% jit_opt_a.a_1 : 0.000710s : 6.08% jit_opt_a.with_stream_mark : 0.000027s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000718s : 6.14% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.17% jit_opt_a.cse : 0.000042s : 0.36% jit_opt_a.replace_applicator : 0.000017s : 0.14% py_interpret_to_execute_after_opt_a : 0.000012s : 0.11% rewriter_after_opt_a : 0.000035s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000512s : 4.39% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000026s : 0.22% loop_unroll : 0.000407s : 3.48% jit_opt_after_cconv.c_1 : 0.000020s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000050s : 0.42% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000442s : 3.78% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.33% Time group info: ------[substitution.] 0.000244 27 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.03% : 0.000005s : 3: substitution.graph_param_transform 83.78% : 0.000205s : 5: substitution.inline 1.10% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.14% : 0.000010s : 3: substitution.reduce_eliminate 1.82% : 0.000004s : 4: substitution.remove_not_recompute_node 1.38% : 0.000003s : 2: substitution.replace_old_param 4.39% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007488 2 87.16% : 0.006527s : 1: type_inference.infer 12.84% : 0.000962s : 1: type_inference.specialize ------[replace.] 0.000084 7 68.51% : 0.000058s : 5: replace.inline 31.49% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 95.45% : 0.000202s : 5: match.inline 4.55% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.22% : 0.000001s : 11: predicate.accumulaten_eliminater 1.04% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 11: predicate.addn_check_dump 1.28% : 0.000002s : 11: predicate.addn_zero_filter 1.70% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.27% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.66% : 0.000001s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.21% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.50% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.11% : 0.000003s : 11: predicate.reduce_eliminate 1.90% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 11: predicate.reshape_eliminate 1.24% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.07% : 0.000010s : 59: predicate.switch_simplify 1.28% : 0.000002s : 11: predicate.tile_eliminate 1.49% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.69% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000727 16 48.38% : 0.000352s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.08% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.54% : 0.000309s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017196 72 0.31% : 0.000052s : 1: add_recomputation 0.44% : 0.000076s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.00% : 0.000344s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.16% : 0.000027s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.05% : 0.005340s : 1: jit_opt_a 0.88% : 0.000151s : 1: jit_opt_after_cconv 0.30% : 0.000051s : 1: jit_opt_b 2.41% : 0.000414s : 1: loop_unroll 3.03% : 0.000521s : 1: mutable_eliminate 5.39% : 0.000927s : 26: opt.transform.jit_opt_a 0.27% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.62% : 0.000450s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000051s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.45% : 0.000421s : 1: renormalize.infer 1.68% : 0.000288s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000038s : 1: rewriter_after_opt_a 0.50% : 0.000086s : 1: rewriter_before_opt_a 0.44% : 0.000075s : 1: symbol_engine_optimizer 44.02% : 0.007570s : 1: type_inference TotalTime = 0.0150801, [30] [bootstrap]: 0.00027144 [type_inference]: 0.00737218 [event_method]: 2.136e-05 [auto_monad]: 6.647e-05 [graph_reusing]: 5.20999e-06 [pre_auto_parallel]: 2.28998e-06 [py_interpret_to_execute]: 3.687e-05 [rewriter_before_opt_a]: 7.388e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.0051665, [2] [Cycle 1]: 0.00179132, [27] [switch_simplify]: 5.231e-05 [loop_unroll]: 3.229e-05 [a_1]: 0.00060553 [with_stream_mark]: 1.583e-05 [recompute_prepare]: 7.33e-06 [updatestate_depend_eliminate]: 3.45998e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.33002e-06 [parameter_eliminate]: 1.43002e-06 [specialize_transform]: 6.44999e-06 [updatestate_useless_node_eliminater]: 5.07e-06 [accelerated_algorithm]: 5.51998e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.32002e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8.70001e-06 [meta_fg_expand]: 1.90001e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 0.00076548 [add_forward_monad_depend]: 4.99003e-06 [auto_monad_grad]: 2.45002e-06 [auto_monad_eliminator]: 1.444e-05 [cse]: 2.849e-05 [replace_applicator]: 1.239e-05 [Cycle 2]: 0.00033103, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 5.01997e-06 [a_1]: 9.642e-05 [with_stream_mark]: 1.039e-05 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 4.89e-06 [merge_forward]: 2.60997e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 8.17998e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 7.51999e-06 [inline_without_move]: 5.02e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.252e-05 [replace_applicator]: 5.35001e-06 [py_interpret_to_execute_after_opt_a]: 1.125e-05 [rewriter_after_opt_a]: 3.402e-05 [convert_after_rewriter]: 6.73998e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00052515 [jit_opt_b]: 5.07e-05, [1] [Cycle 1]: 4.405e-05, [2] [frontend_op_eliminate]: 1.604e-05 [inline_after_opt_a]: 1.627e-05 [cconv]: 2.488e-05 [loop_unroll]: 0.00041551 [jit_opt_after_cconv]: 0.00014734, [1] [Cycle 1]: 0.00014119, [11] [c_1]: 2.028e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.93002e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 7.88001e-06 [cse]: 2.265e-05 [call_graph_tuple_transform]: 1.849e-05 [tuple_list_get_item_eliminator]: 5.44998e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.429e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 4.97999e-06 [add_recomputation]: 4.67e-05 [cse_after_recomputation]: 2.246e-05, [1] [Cycle 1]: 1.681e-05, [1] [cse]: 1.117e-05 [auto_monad_reorder]: 1.603e-05 [get_jit_bprop_graph]: 2.35002e-06 [rewriter_after_jit_bprop_graph]: 4.60999e-06 [opt_after_jit_grad]: 0.00046177 [symbol_engine_optimizer]: 7.317e-05, [1] [Cycle 1]: 6.714e-05, [6] [build]: 3.45998e-06 [elim_shapecalc]: 7.93001e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 8.63001e-06 [renormalize]: 3.59985e-07 [validate]: 3.534e-05 Sums bootstrap : 0.000271s : 2.37% type_inference : 0.007372s : 64.24% event_method : 0.000021s : 0.19% auto_monad : 0.000066s : 0.58% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.32% rewriter_before_opt_a : 0.000074s : 0.64% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000058s : 0.51% jit_opt_a.loop_unroll : 0.000037s : 0.33% jit_opt_a.a_1 : 0.000702s : 6.12% jit_opt_a.with_stream_mark : 0.000026s : 0.23% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000766s : 6.67% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.18% jit_opt_a.cse : 0.000041s : 0.36% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000034s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000525s : 4.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000025s : 0.22% loop_unroll : 0.000416s : 3.62% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000008s : 0.07% jit_opt_after_cconv.cse : 0.000023s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000014s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000047s : 0.41% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000016s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000462s : 4.02% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.31% Time group info: ------[substitution.] 0.000236 27 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.11% : 0.000005s : 3: substitution.graph_param_transform 83.12% : 0.000196s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.33% : 0.000010s : 3: substitution.reduce_eliminate 1.68% : 0.000004s : 4: substitution.remove_not_recompute_node 1.79% : 0.000004s : 2: substitution.replace_old_param 4.17% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007313 2 87.54% : 0.006402s : 1: type_inference.infer 12.46% : 0.000911s : 1: type_inference.specialize ------[replace.] 0.000083 7 67.98% : 0.000057s : 5: replace.inline 32.02% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 95.64% : 0.000193s : 5: match.inline 4.36% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 747 1.29% : 0.000002s : 11: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.38% : 0.000002s : 11: predicate.addn_zero_filter 1.90% : 0.000002s : 11: predicate.arithmetic_simplify 1.30% : 0.000002s : 11: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.19% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 16: predicate.load_eliminater 1.30% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.33% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000001s : 11: predicate.print_const_string_wrapper 2.14% : 0.000003s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.39% : 0.000002s : 11: predicate.reshape_eliminate 1.32% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.50% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.36% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 59: predicate.switch_simplify 1.26% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.63% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000774 16 46.90% : 0.000363s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.45% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.65% : 0.000346s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016823 72 0.30% : 0.000050s : 1: add_recomputation 0.42% : 0.000070s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 1.69% : 0.000284s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.14% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.15% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.73% : 0.005169s : 1: jit_opt_a 0.89% : 0.000150s : 1: jit_opt_after_cconv 0.32% : 0.000053s : 1: jit_opt_b 2.52% : 0.000424s : 1: loop_unroll 3.18% : 0.000534s : 1: mutable_eliminate 5.43% : 0.000914s : 26: opt.transform.jit_opt_a 0.28% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.80% : 0.000470s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.23% : 0.000039s : 1: py_interpret_to_execute 0.08% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.50% : 0.000420s : 1: renormalize.infer 2.01% : 0.000337s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000037s : 1: rewriter_after_opt_a 0.45% : 0.000076s : 1: rewriter_before_opt_a 0.45% : 0.000076s : 1: symbol_engine_optimizer 43.90% : 0.007385s : 1: type_inference TotalTime = 0.0149265, [30] [bootstrap]: 0.00027594 [type_inference]: 0.00752234 [event_method]: 1.924e-05 [auto_monad]: 5.002e-05 [graph_reusing]: 4.50999e-06 [pre_auto_parallel]: 1.97999e-06 [py_interpret_to_execute]: 3.953e-05 [rewriter_before_opt_a]: 7.289e-05 [expand_dump_flag]: 2.11998e-06 [jit_opt_a]: 0.00491922, [2] [Cycle 1]: 0.00163061, [27] [switch_simplify]: 4.967e-05 [loop_unroll]: 3.271e-05 [a_1]: 0.00056297 [with_stream_mark]: 1.265e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 8.29983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.154e-05 [j_node_and_user_rematch]: 8.03999e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 8.72998e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.00062473 [add_forward_monad_depend]: 5.28002e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.412e-05 [cse]: 3.31e-05 [replace_applicator]: 1.263e-05 [Cycle 2]: 0.00032503, [27] [switch_simplify]: 6.45997e-06 [loop_unroll]: 5.10999e-06 [a_1]: 9.51e-05 [with_stream_mark]: 9.83002e-06 [recompute_prepare]: 5.41998e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.19998e-06 [specialize_transform]: 5.12999e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.063e-05 [j_node_and_user_rematch]: 7.71999e-06 [meta_fg_expand]: 1.66002e-06 [replace_old_param]: 7.45e-06 [inline_without_move]: 4.74002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.237e-05 [replace_applicator]: 5.30999e-06 [py_interpret_to_execute_after_opt_a]: 1.044e-05 [rewriter_after_opt_a]: 3.511e-05 [convert_after_rewriter]: 7.51001e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.0005014 [jit_opt_b]: 4.822e-05, [1] [Cycle 1]: 4.163e-05, [2] [frontend_op_eliminate]: 1.487e-05 [inline_after_opt_a]: 1.586e-05 [cconv]: 2.264e-05 [loop_unroll]: 0.00041098 [jit_opt_after_cconv]: 0.00014578, [1] [Cycle 1]: 0.00013967, [11] [c_1]: 2.045e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.22999e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.101e-05 [call_graph_tuple_transform]: 2.326e-05 [tuple_list_get_item_eliminator]: 5.31998e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.66e-06 [remove_dup_value]: 1.529e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 5.56e-06 [add_recomputation]: 4.776e-05 [cse_after_recomputation]: 2.31e-05, [1] [Cycle 1]: 1.785e-05, [1] [cse]: 1.247e-05 [auto_monad_reorder]: 1.663e-05 [get_jit_bprop_graph]: 1.78002e-06 [rewriter_after_jit_bprop_graph]: 4.60999e-06 [opt_after_jit_grad]: 0.00044917 [symbol_engine_optimizer]: 7.098e-05, [1] [Cycle 1]: 6.511e-05, [6] [build]: 3.04999e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.283e-05 [opt_reshape]: 5.76003e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 5.00004e-07 [validate]: 3.604e-05 Sums bootstrap : 0.000276s : 2.43% type_inference : 0.007522s : 66.12% event_method : 0.000019s : 0.17% auto_monad : 0.000050s : 0.44% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.35% rewriter_before_opt_a : 0.000073s : 0.64% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000056s : 0.49% jit_opt_a.loop_unroll : 0.000038s : 0.33% jit_opt_a.a_1 : 0.000658s : 5.78% jit_opt_a.with_stream_mark : 0.000022s : 0.20% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000625s : 5.49% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.18% jit_opt_a.cse : 0.000045s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.16% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000035s : 0.31% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000501s : 4.41% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000023s : 0.20% loop_unroll : 0.000411s : 3.61% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000449s : 3.95% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000036s : 0.32% Time group info: ------[substitution.] 0.000194 27 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000002s : 2: substitution.fold_const_symbol 2.64% : 0.000005s : 3: substitution.graph_param_transform 82.31% : 0.000160s : 5: substitution.inline 1.25% : 0.000002s : 4: substitution.j_node_and_user_rematch 4.68% : 0.000009s : 3: substitution.reduce_eliminate 1.81% : 0.000004s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 3.56% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007470 2 88.08% : 0.006579s : 1: type_inference.infer 11.92% : 0.000891s : 1: type_inference.specialize ------[replace.] 0.000080 7 66.36% : 0.000053s : 5: replace.inline 33.64% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 7 96.34% : 0.000157s : 5: match.inline 3.66% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 747 1.24% : 0.000001s : 11: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.82% : 0.000002s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000001s : 11: predicate.depend_value_elim 1.20% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.36% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 16: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.44% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.32% : 0.000002s : 11: predicate.print_const_string_wrapper 2.07% : 0.000002s : 11: predicate.reduce_eliminate 1.47% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 19: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 11: predicate.reshape_eliminate 1.44% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.79% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.22% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 59: predicate.switch_simplify 1.25% : 0.000001s : 11: predicate.tile_eliminate 1.32% : 0.000002s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.33% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000723 16 51.55% : 0.000373s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.20% : 0.000052s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.25% : 0.000298s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016485 72 0.31% : 0.000051s : 1: add_recomputation 0.32% : 0.000053s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 1.77% : 0.000291s : 1: bootstrap 0.15% : 0.000025s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 29.86% : 0.004922s : 1: jit_opt_a 0.90% : 0.000149s : 1: jit_opt_after_cconv 0.31% : 0.000051s : 1: jit_opt_b 2.54% : 0.000419s : 1: loop_unroll 3.09% : 0.000510s : 1: mutable_eliminate 5.25% : 0.000866s : 26: opt.transform.jit_opt_a 0.31% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.78% : 0.000457s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.11% : 0.000347s : 1: renormalize.infer 1.65% : 0.000271s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000038s : 1: rewriter_after_opt_a 0.46% : 0.000076s : 1: rewriter_before_opt_a 0.45% : 0.000074s : 1: symbol_engine_optimizer 45.71% : 0.007535s : 1: type_inference TotalTime = 0.0648248, [30] [bootstrap]: 0.00027308 [type_inference]: 0.0555118 [event_method]: 2.047e-05 [auto_monad]: 6.628e-05 [graph_reusing]: 6.67002e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.00028219 [rewriter_before_opt_a]: 8.218e-05 [expand_dump_flag]: 3.36001e-06 [jit_opt_a]: 0.00654313, [2] [Cycle 1]: 0.00294491, [27] [switch_simplify]: 5.357e-05 [loop_unroll]: 2.977e-05 [a_1]: 0.00053694 [with_stream_mark]: 1.56e-05 [recompute_prepare]: 8.50001e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 3.49001e-06 [updatestate_loads_eliminate]: 2.98998e-06 [parameter_eliminate]: 2.30002e-06 [specialize_transform]: 6.83998e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.57002e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.513e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 1.016e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00199306 [add_forward_monad_depend]: 4.58999e-06 [auto_monad_grad]: 1.29998e-06 [auto_monad_eliminator]: 1.162e-05 [cse]: 1.776e-05 [replace_applicator]: 1.301e-05 [Cycle 2]: 0.00035238, [27] [switch_simplify]: 6.42001e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.000119 [with_stream_mark]: 9.36e-06 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 2.41e-06 [cell_reuse_recompute_pass]: 2.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.345e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 6.01e-06 [cse]: 1.087e-05 [replace_applicator]: 5.57001e-06 [py_interpret_to_execute_after_opt_a]: 8.40999e-06 [rewriter_after_opt_a]: 2.501e-05 [convert_after_rewriter]: 5.62999e-06 [order_py_execute_after_rewriter]: 4.37998e-06 [mutable_eliminate]: 0.00051967 [jit_opt_b]: 5.285e-05, [1] [Cycle 1]: 4.641e-05, [2] [frontend_op_eliminate]: 1.863e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 1.64e-05 [loop_unroll]: 0.00042453 [jit_opt_after_cconv]: 0.00014176, [1] [Cycle 1]: 0.00013582, [11] [c_1]: 2.521e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 4.65001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 1.844e-05 [call_graph_tuple_transform]: 1.764e-05 [tuple_list_get_item_eliminator]: 6.45002e-06 [none_parameter_eliminate]: 9.00007e-07 [renormalize]: 3.00002e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 7.83001e-06 [partial_unused_args_eliminate]: 1.44998e-06 [environ_conv]: 6.02001e-06 [add_recomputation]: 3.137e-05 [cse_after_recomputation]: 2.121e-05, [1] [Cycle 1]: 1.581e-05, [1] [cse]: 1.045e-05 [auto_monad_reorder]: 9.92001e-06 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00045133 [symbol_engine_optimizer]: 6.962e-05, [1] [Cycle 1]: 6.4e-05, [6] [build]: 2.12999e-06 [elim_shapecalc]: 7.90998e-06 [elim_not_effective]: 1.209e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 4.49974e-07 [validate]: 6.364e-05 Sums bootstrap : 0.000273s : 0.45% type_inference : 0.055512s : 90.97% event_method : 0.000020s : 0.03% auto_monad : 0.000066s : 0.11% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000282s : 0.46% rewriter_before_opt_a : 0.000082s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000656s : 1.07% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001993s : 3.27% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000029s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000025s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000520s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000425s : 0.70% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000031s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000451s : 0.74% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000064s : 0.10% Time group info: ------[substitution.] 0.000176 24 0.85% : 0.000001s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.19% : 0.000004s : 4: substitution.graph_param_transform 82.73% : 0.000145s : 4: substitution.inline 2.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.82% : 0.000005s : 4: substitution.remove_not_recompute_node 2.57% : 0.000005s : 2: substitution.replace_old_param 6.16% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055435 2 96.53% : 0.053513s : 1: type_inference.infer 3.47% : 0.001922s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.27% : 0.000046s : 4: replace.inline 33.73% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 93.63% : 0.000143s : 4: match.inline 6.37% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.13% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.84% : 0.000002s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.26% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000001s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.17% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.07% : 0.000009s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.91% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002430 30 73.13% : 0.001777s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.00% : 0.000024s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.87% : 0.000629s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067746 72 0.05% : 0.000034s : 1: add_recomputation 0.10% : 0.000070s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.42% : 0.000285s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 9.66% : 0.006546s : 1: jit_opt_a 0.21% : 0.000144s : 1: jit_opt_after_cconv 0.08% : 0.000056s : 1: jit_opt_b 0.64% : 0.000433s : 1: loop_unroll 0.78% : 0.000529s : 1: mutable_eliminate 1.30% : 0.000883s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000288s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000011s : 1: remove_dup_value 1.97% : 0.001336s : 1: renormalize.infer 0.96% : 0.000649s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000028s : 1: rewriter_after_opt_a 0.13% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000072s : 1: symbol_engine_optimizer 81.97% : 0.055529s : 1: type_inference TotalTime = 0.0162182, [30] [bootstrap]: 0.00029599 [type_inference]: 0.00811069 [event_method]: 2.121e-05 [auto_monad]: 6.403e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.43e-06 [py_interpret_to_execute]: 4.16e-05 [rewriter_before_opt_a]: 8.051e-05 [expand_dump_flag]: 2.78998e-06 [jit_opt_a]: 0.00547666, [2] [Cycle 1]: 0.00182356, [27] [switch_simplify]: 6.311e-05 [loop_unroll]: 3.388e-05 [a_1]: 0.00060654 [with_stream_mark]: 2.022e-05 [recompute_prepare]: 8.62998e-06 [updatestate_depend_eliminate]: 4.84003e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 2.94999e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.32001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.42001e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 4.45e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 9.53002e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.39998e-06 [renormalize]: 0.00076235 [add_forward_monad_depend]: 5.21002e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.361e-05 [cse]: 3.012e-05 [replace_applicator]: 1.207e-05 [Cycle 2]: 0.00032109, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 4.80999e-06 [a_1]: 9.557e-05 [with_stream_mark]: 8.75999e-06 [recompute_prepare]: 5.37999e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 4.97999e-06 [updatestate_useless_node_eliminater]: 4.99003e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.055e-05 [j_node_and_user_rematch]: 7.66999e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.44998e-06 [cse]: 1.231e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 1.093e-05 [rewriter_after_opt_a]: 3.886e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00053288 [jit_opt_b]: 5.094e-05, [1] [Cycle 1]: 4.407e-05, [2] [frontend_op_eliminate]: 1.623e-05 [inline_after_opt_a]: 1.63e-05 [cconv]: 2.483e-05 [loop_unroll]: 0.00041698 [jit_opt_after_cconv]: 0.00015845, [1] [Cycle 1]: 0.00015205, [11] [c_1]: 2.01e-05 [parameter_eliminate]: 2.94001e-06 [updatestate_depend_eliminate]: 6.04001e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.573e-05 [call_graph_tuple_transform]: 1.981e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.99e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 5.69999e-06 [remove_dup_value]: 1.663e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 6.51999e-06 [add_recomputation]: 5.439e-05 [cse_after_recomputation]: 2.629e-05, [1] [Cycle 1]: 1.971e-05, [1] [cse]: 1.333e-05 [auto_monad_reorder]: 1.694e-05 [get_jit_bprop_graph]: 2.06e-06 [rewriter_after_jit_bprop_graph]: 6.22001e-06 [opt_after_jit_grad]: 0.00046559 [symbol_engine_optimizer]: 7.233e-05, [1] [Cycle 1]: 6.624e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.76002e-06 [renormalize]: 4.09986e-07 [validate]: 3.57e-05 Sums bootstrap : 0.000296s : 2.41% type_inference : 0.008111s : 65.94% event_method : 0.000021s : 0.17% auto_monad : 0.000064s : 0.52% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000042s : 0.34% rewriter_before_opt_a : 0.000081s : 0.65% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000069s : 0.56% jit_opt_a.loop_unroll : 0.000039s : 0.31% jit_opt_a.a_1 : 0.000702s : 5.71% jit_opt_a.with_stream_mark : 0.000029s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.09% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.08% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.000762s : 6.20% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.15% jit_opt_a.cse : 0.000042s : 0.34% jit_opt_a.replace_applicator : 0.000018s : 0.14% py_interpret_to_execute_after_opt_a : 0.000011s : 0.09% rewriter_after_opt_a : 0.000039s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000533s : 4.33% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.13% cconv : 0.000025s : 0.20% loop_unroll : 0.000417s : 3.39% jit_opt_after_cconv.c_1 : 0.000020s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000026s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000017s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.05% add_recomputation : 0.000054s : 0.44% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000017s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000466s : 3.79% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.29% Time group info: ------[substitution.] 0.000227 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000005s : 3: substitution.graph_param_transform 81.29% : 0.000184s : 5: substitution.inline 1.72% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.29% : 0.000010s : 3: substitution.reduce_eliminate 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 1.79% : 0.000004s : 2: substitution.replace_old_param 5.15% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008045 2 87.76% : 0.007061s : 1: type_inference.infer 12.24% : 0.000984s : 1: type_inference.specialize ------[replace.] 0.000089 7 67.34% : 0.000060s : 5: replace.inline 32.66% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 7 94.53% : 0.000182s : 5: match.inline 5.47% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.24% : 0.000002s : 11: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 11: predicate.addn_check_dump 1.27% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 11: predicate.compare_switch_simplify 1.23% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.76% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.18% : 0.000001s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.20% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000007s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 16: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.44% : 0.000003s : 16: predicate.partial_eliminate 1.18% : 0.000001s : 11: predicate.print_const_string_wrapper 1.90% : 0.000002s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 11: predicate.same_eliminate 0.75% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.61% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.22% : 0.000010s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.30% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 11: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000803 16 52.15% : 0.000419s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.92% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 40.93% : 0.000329s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017967 72 0.32% : 0.000057s : 1: add_recomputation 0.38% : 0.000067s : 1: auto_monad 0.11% : 0.000020s : 1: auto_monad_reorder 1.73% : 0.000311s : 1: bootstrap 0.15% : 0.000028s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.14% : 0.000025s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.50% : 0.005479s : 1: jit_opt_a 0.90% : 0.000161s : 1: jit_opt_after_cconv 0.30% : 0.000053s : 1: jit_opt_b 2.36% : 0.000424s : 1: loop_unroll 3.03% : 0.000544s : 1: mutable_eliminate 5.15% : 0.000925s : 26: opt.transform.jit_opt_a 0.27% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000015s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.64% : 0.000474s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000044s : 1: py_interpret_to_execute 0.07% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.56% : 0.000460s : 1: renormalize.infer 1.64% : 0.000294s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000042s : 1: rewriter_after_opt_a 0.46% : 0.000083s : 1: rewriter_before_opt_a 0.42% : 0.000075s : 1: symbol_engine_optimizer 45.22% : 0.008125s : 1: type_inference TotalTime = 0.0606211, [30] [bootstrap]: 0.0002593 [type_inference]: 0.0516838 [event_method]: 1.74e-05 [auto_monad]: 6.754e-05 [graph_reusing]: 5.40001e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 0.00029034 [rewriter_before_opt_a]: 8.251e-05 [expand_dump_flag]: 3.91001e-06 [jit_opt_a]: 0.00618829, [2] [Cycle 1]: 0.00271433, [27] [switch_simplify]: 4.798e-05 [loop_unroll]: 2.947e-05 [a_1]: 0.00050275 [with_stream_mark]: 1.15e-05 [recompute_prepare]: 7.68001e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.56998e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 9.64999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.86002e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00182301 [add_forward_monad_depend]: 5.87001e-06 [auto_monad_grad]: 1.77999e-06 [auto_monad_eliminator]: 1.332e-05 [cse]: 1.997e-05 [replace_applicator]: 1.459e-05 [Cycle 2]: 0.00035171, [27] [switch_simplify]: 6.46999e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00011876 [with_stream_mark]: 9.14e-06 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.436e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.22001e-06 [cse]: 1.157e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 9.02999e-06 [rewriter_after_opt_a]: 2.647e-05 [convert_after_rewriter]: 5.51e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00050693 [jit_opt_b]: 5.38e-05, [1] [Cycle 1]: 4.758e-05, [2] [frontend_op_eliminate]: 1.952e-05 [inline_after_opt_a]: 1.727e-05 [cconv]: 2.006e-05 [loop_unroll]: 0.00041916 [jit_opt_after_cconv]: 0.00014455, [1] [Cycle 1]: 0.00013867, [11] [c_1]: 2.559e-05 [parameter_eliminate]: 2.53003e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 1.922e-05 [call_graph_tuple_transform]: 1.952e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.25999e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.19999e-06 [remove_dup_value]: 9.64999e-06 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 3.486e-05 [cse_after_recomputation]: 2.123e-05, [1] [Cycle 1]: 1.622e-05, [1] [cse]: 1.044e-05 [auto_monad_reorder]: 1.126e-05 [get_jit_bprop_graph]: 1.59e-06 [rewriter_after_jit_bprop_graph]: 3.98001e-06 [opt_after_jit_grad]: 0.00044986 [symbol_engine_optimizer]: 9.223e-05, [1] [Cycle 1]: 8.602e-05, [6] [build]: 2.86e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.315e-05 [opt_reshape]: 6.39999e-06 [fold_const_symbol]: 2.797e-05 [renormalize]: 2.50002e-07 [validate]: 3.6e-05 Sums bootstrap : 0.000259s : 0.46% type_inference : 0.051684s : 90.74% event_method : 0.000017s : 0.03% auto_monad : 0.000068s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000290s : 0.51% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000622s : 1.09% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001823s : 3.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000032s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000026s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000507s : 0.89% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000020s : 0.04% loop_unroll : 0.000419s : 0.74% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000035s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000450s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000028s : 0.05% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.06% Time group info: ------[substitution.] 0.000157 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 3.22% : 0.000005s : 4: substitution.graph_param_transform 83.00% : 0.000130s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.22% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000004s : 2: substitution.replace_old_param 4.67% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051606 2 96.25% : 0.049668s : 1: type_inference.infer 3.75% : 0.001937s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.57% : 0.000042s : 4: replace.inline 34.43% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000134 6 95.35% : 0.000128s : 4: match.inline 4.65% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000002s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000001s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000001s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000001s : 8: predicate.get_grad_eliminate 0.48% : 0.000001s : 4: predicate.graph_param_transform 5.07% : 0.000006s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.15% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000001s : 12: predicate.minmaximum_grad 1.80% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.52% : 0.000002s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.55% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.67% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.34% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002190 26 72.12% : 0.001579s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.59% : 0.000582s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063379 72 0.06% : 0.000038s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.43% : 0.000272s : 1: bootstrap 0.04% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.77% : 0.006191s : 1: jit_opt_a 0.23% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.67% : 0.000426s : 1: loop_unroll 0.81% : 0.000516s : 1: mutable_eliminate 1.32% : 0.000839s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000052s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000296s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 1.96% : 0.001243s : 1: renormalize.infer 0.90% : 0.000573s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000029s : 1: rewriter_after_opt_a 0.14% : 0.000087s : 1: rewriter_before_opt_a 0.15% : 0.000095s : 1: symbol_engine_optimizer 81.57% : 0.051696s : 1: type_inference TotalTime = 0.014482, [30] [bootstrap]: 0.00028101 [type_inference]: 0.00703421 [event_method]: 1.956e-05 [auto_monad]: 6.999e-05 [graph_reusing]: 5.44998e-06 [pre_auto_parallel]: 1.89999e-06 [py_interpret_to_execute]: 3.766e-05 [rewriter_before_opt_a]: 7.508e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00500415, [2] [Cycle 1]: 0.00165275, [27] [switch_simplify]: 4.968e-05 [loop_unroll]: 3.313e-05 [a_1]: 0.00059478 [with_stream_mark]: 1.769e-05 [recompute_prepare]: 7.63001e-06 [updatestate_depend_eliminate]: 3.50003e-06 [updatestate_assign_eliminate]: 2.95002e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 7.79002e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00063805 [add_forward_monad_depend]: 4.90999e-06 [auto_monad_grad]: 1.88002e-06 [auto_monad_eliminator]: 1.301e-05 [cse]: 1.966e-05 [replace_applicator]: 1.114e-05 [Cycle 2]: 0.00031923, [27] [switch_simplify]: 5.69e-06 [loop_unroll]: 5.12e-06 [a_1]: 9.575e-05 [with_stream_mark]: 9.32001e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.044e-05 [j_node_and_user_rematch]: 7.58999e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 6.69001e-06 [inline_without_move]: 4.94003e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 1.05001e-06 [auto_monad_eliminator]: 5.44e-06 [cse]: 1.148e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 3.022e-05 [convert_after_rewriter]: 5.86998e-06 [order_py_execute_after_rewriter]: 4.60999e-06 [mutable_eliminate]: 0.00048518 [jit_opt_b]: 4.804e-05, [1] [Cycle 1]: 4.157e-05, [2] [frontend_op_eliminate]: 1.486e-05 [inline_after_opt_a]: 1.564e-05 [cconv]: 2.06e-05 [loop_unroll]: 0.00040026 [jit_opt_after_cconv]: 0.00014272, [1] [Cycle 1]: 0.00013028, [11] [c_1]: 2.013e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.23002e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.086e-05 [call_graph_tuple_transform]: 1.682e-05 [tuple_list_get_item_eliminator]: 5.30001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.29e-06 [remove_dup_value]: 1.367e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 4.84e-06 [add_recomputation]: 4.244e-05 [cse_after_recomputation]: 2.323e-05, [1] [Cycle 1]: 1.784e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.407e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00044431 [symbol_engine_optimizer]: 6.927e-05, [1] [Cycle 1]: 6.331e-05, [6] [build]: 2.79999e-06 [elim_shapecalc]: 7.63999e-06 [elim_not_effective]: 1.176e-05 [opt_reshape]: 5.47001e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 4.09986e-07 [validate]: 3.239e-05 Sums bootstrap : 0.000281s : 2.58% type_inference : 0.007034s : 64.61% event_method : 0.000020s : 0.18% auto_monad : 0.000070s : 0.64% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.35% rewriter_before_opt_a : 0.000075s : 0.69% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.51% jit_opt_a.loop_unroll : 0.000038s : 0.35% jit_opt_a.a_1 : 0.000691s : 6.34% jit_opt_a.with_stream_mark : 0.000027s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000014s : 0.13% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000638s : 5.86% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.17% jit_opt_a.cse : 0.000031s : 0.29% jit_opt_a.replace_applicator : 0.000016s : 0.15% py_interpret_to_execute_after_opt_a : 0.000010s : 0.10% rewriter_after_opt_a : 0.000030s : 0.28% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000485s : 4.46% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000021s : 0.19% loop_unroll : 0.000400s : 3.68% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000014s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000042s : 0.39% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000014s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000444s : 4.08% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.30% Time group info: ------[substitution.] 0.000219 27 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000004s : 3: substitution.graph_param_transform 82.54% : 0.000181s : 5: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.73% : 0.000010s : 3: substitution.reduce_eliminate 1.94% : 0.000004s : 4: substitution.remove_not_recompute_node 1.44% : 0.000003s : 2: substitution.replace_old_param 4.73% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006981 2 87.74% : 0.006125s : 1: type_inference.infer 12.26% : 0.000856s : 1: type_inference.specialize ------[replace.] 0.000083 7 68.03% : 0.000057s : 5: replace.inline 31.97% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000187 7 95.05% : 0.000178s : 5: match.inline 4.95% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.82% : 0.000002s : 11: predicate.arithmetic_simplify 1.31% : 0.000002s : 11: predicate.cast_eliminate 0.38% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000001s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 11: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.45% : 0.000002s : 11: predicate.environ_get_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 16: predicate.load_eliminater 1.05% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 16: predicate.partial_eliminate 1.35% : 0.000002s : 11: predicate.print_const_string_wrapper 2.16% : 0.000003s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 19: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.44% : 0.000002s : 11: predicate.reshape_eliminate 1.38% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.34% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.49% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.88% : 0.000009s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.33% : 0.000002s : 11: predicate.transpose_eliminate 1.46% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000692 16 50.71% : 0.000351s : 7: func_graph_cloner_run.FuncGraphClonerGraph 8.06% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.24% : 0.000285s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016081 72 0.28% : 0.000045s : 1: add_recomputation 0.46% : 0.000074s : 1: auto_monad 0.10% : 0.000016s : 1: auto_monad_reorder 1.83% : 0.000294s : 1: bootstrap 0.14% : 0.000023s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 31.14% : 0.005007s : 1: jit_opt_a 0.90% : 0.000145s : 1: jit_opt_after_cconv 0.31% : 0.000050s : 1: jit_opt_b 2.54% : 0.000408s : 1: loop_unroll 3.06% : 0.000493s : 1: mutable_eliminate 5.58% : 0.000898s : 26: opt.transform.jit_opt_a 0.28% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.81% : 0.000452s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000016s : 1: remove_dup_value 2.23% : 0.000359s : 1: renormalize.infer 1.69% : 0.000272s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000033s : 1: rewriter_after_opt_a 0.48% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000072s : 1: symbol_engine_optimizer 43.82% : 0.007046s : 1: type_inference TotalTime = 0.0115334, [30] [bootstrap]: 0.00025096 [type_inference]: 0.00418801 [event_method]: 1.633e-05 [auto_monad]: 6.263e-05 [graph_reusing]: 4.63999e-06 [pre_auto_parallel]: 2.31998e-06 [py_interpret_to_execute]: 3.572e-05 [rewriter_before_opt_a]: 6.802e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.004957, [2] [Cycle 1]: 0.00153983, [27] [switch_simplify]: 5.221e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00055615 [with_stream_mark]: 1.607e-05 [recompute_prepare]: 7.76001e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.80997e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.36998e-06 [specialize_transform]: 6.11e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.399e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.31e-06 [inline_without_move]: 5.56e-06 [renormalize]: 0.00058831 [add_forward_monad_depend]: 5.12999e-06 [auto_monad_grad]: 1.95001e-06 [auto_monad_eliminator]: 1.277e-05 [cse]: 1.774e-05 [replace_applicator]: 1.146e-05 [Cycle 2]: 0.00030979, [27] [switch_simplify]: 5.47001e-06 [loop_unroll]: 4.92e-06 [a_1]: 9.028e-05 [with_stream_mark]: 9.22001e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 4.82998e-06 [updatestate_useless_node_eliminater]: 4.71002e-06 [accelerated_algorithm]: 4.67998e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.246e-05 [j_node_and_user_rematch]: 7.59002e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.55001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.30999e-06 [cse]: 9.92001e-06 [replace_applicator]: 4.84e-06 [py_interpret_to_execute_after_opt_a]: 7.93999e-06 [rewriter_after_opt_a]: 3.041e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.21002e-06 [mutable_eliminate]: 0.00046592 [jit_opt_b]: 4.725e-05, [1] [Cycle 1]: 4.092e-05, [2] [frontend_op_eliminate]: 1.55e-05 [inline_after_opt_a]: 1.516e-05 [cconv]: 2.369e-05 [loop_unroll]: 0.0004055 [jit_opt_after_cconv]: 0.00013579, [1] [Cycle 1]: 0.00012978, [11] [c_1]: 2.09e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.32001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.732e-05 [call_graph_tuple_transform]: 1.747e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.53002e-06 [remove_dup_value]: 1.368e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 5.72999e-06 [add_recomputation]: 4.316e-05 [cse_after_recomputation]: 2.134e-05, [1] [Cycle 1]: 1.6e-05, [1] [cse]: 1.035e-05 [auto_monad_reorder]: 1.391e-05 [get_jit_bprop_graph]: 1.30999e-06 [rewriter_after_jit_bprop_graph]: 4.61002e-06 [opt_after_jit_grad]: 0.00044757 [symbol_engine_optimizer]: 7.119e-05, [1] [Cycle 1]: 6.513e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 7.92e-06 [elim_not_effective]: 1.272e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 4.2998e-07 [validate]: 3.229e-05 Sums bootstrap : 0.000251s : 3.18% type_inference : 0.004188s : 53.11% event_method : 0.000016s : 0.21% auto_monad : 0.000063s : 0.79% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.45% rewriter_before_opt_a : 0.000068s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000058s : 0.73% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000646s : 8.20% jit_opt_a.with_stream_mark : 0.000025s : 0.32% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000588s : 7.46% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.23% jit_opt_a.cse : 0.000028s : 0.35% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000466s : 5.91% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000024s : 0.30% loop_unroll : 0.000406s : 5.14% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000014s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000043s : 0.55% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000014s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000448s : 5.68% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000032s : 0.41% Time group info: ------[substitution.] 0.000190 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 3: substitution.graph_param_transform 83.24% : 0.000158s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.57% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004133 2 79.28% : 0.003277s : 1: type_inference.infer 20.72% : 0.000856s : 1: type_inference.specialize ------[replace.] 0.000065 6 65.87% : 0.000043s : 4: replace.inline 34.13% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.21% : 0.000156s : 4: match.inline 6.79% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.05% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.42% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000002s : 10: predicate.environ_get_eliminate 1.30% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 3: predicate.row_tensor_eliminate 1.46% : 0.000002s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.28% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.42% : 0.000002s : 10: predicate.transpose_eliminate 1.60% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.85% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000635 13 53.47% : 0.000340s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.28% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.25% : 0.000262s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013038 72 0.35% : 0.000046s : 1: add_recomputation 0.50% : 0.000066s : 1: auto_monad 0.12% : 0.000016s : 1: auto_monad_reorder 2.00% : 0.000261s : 1: bootstrap 0.20% : 0.000026s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 38.04% : 0.004960s : 1: jit_opt_a 1.06% : 0.000138s : 1: jit_opt_after_cconv 0.38% : 0.000050s : 1: jit_opt_b 3.17% : 0.000414s : 1: loop_unroll 3.63% : 0.000473s : 1: mutable_eliminate 6.53% : 0.000851s : 26: opt.transform.jit_opt_a 0.36% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.17% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.49% : 0.000455s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.04% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000038s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.22% : 0.000028s : 1: remove_dup_value 2.31% : 0.000301s : 1: renormalize.infer 2.15% : 0.000280s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000033s : 1: rewriter_after_opt_a 0.54% : 0.000071s : 1: rewriter_before_opt_a 0.56% : 0.000074s : 1: symbol_engine_optimizer 32.20% : 0.004198s : 1: type_inference TotalTime = 0.0119838, [30] [bootstrap]: 0.00025425 [type_inference]: 0.00458404 [event_method]: 1.705e-05 [auto_monad]: 5.28e-05 [graph_reusing]: 4.70001e-06 [pre_auto_parallel]: 1.79998e-06 [py_interpret_to_execute]: 3.944e-05 [rewriter_before_opt_a]: 7.075e-05 [expand_dump_flag]: 2.77002e-06 [jit_opt_a]: 0.0048746, [2] [Cycle 1]: 0.00151095, [27] [switch_simplify]: 4.662e-05 [loop_unroll]: 3.015e-05 [a_1]: 0.00050926 [with_stream_mark]: 1.337e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.22002e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.26998e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 8.89995e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.234e-05 [j_node_and_user_rematch]: 8.31002e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 8.05999e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00060558 [add_forward_monad_depend]: 4.85999e-06 [auto_monad_grad]: 1.44e-06 [auto_monad_eliminator]: 1.072e-05 [cse]: 4.264e-05 [replace_applicator]: 1.236e-05 [Cycle 2]: 0.00031387, [27] [switch_simplify]: 5.68002e-06 [loop_unroll]: 4.65999e-06 [a_1]: 9.149e-05 [with_stream_mark]: 8.99003e-06 [recompute_prepare]: 5.12999e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.73001e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.34999e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.274e-05 [j_node_and_user_rematch]: 7.48999e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.73001e-06 [inline_without_move]: 4.63001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 6.33998e-06 [cse]: 1.108e-05 [replace_applicator]: 4.98001e-06 [py_interpret_to_execute_after_opt_a]: 1.081e-05 [rewriter_after_opt_a]: 2.978e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 4.76002e-06 [mutable_eliminate]: 0.0005315 [jit_opt_b]: 5.184e-05, [1] [Cycle 1]: 4.431e-05, [2] [frontend_op_eliminate]: 1.764e-05 [inline_after_opt_a]: 1.531e-05 [cconv]: 2.428e-05 [loop_unroll]: 0.0004469 [jit_opt_after_cconv]: 0.00013404, [1] [Cycle 1]: 0.00012789, [11] [c_1]: 2.039e-05 [parameter_eliminate]: 2.31e-06 [updatestate_depend_eliminate]: 5.47001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.84001e-06 [cse]: 1.741e-05 [call_graph_tuple_transform]: 1.755e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.17e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.07e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 4.90001e-06 [add_recomputation]: 4.113e-05 [cse_after_recomputation]: 3.964e-05, [1] [Cycle 1]: 3.47e-05, [1] [cse]: 2.874e-05 [auto_monad_reorder]: 1.344e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.22e-06 [opt_after_jit_grad]: 0.00047376 [symbol_engine_optimizer]: 7.006e-05, [1] [Cycle 1]: 6.376e-05, [6] [build]: 3.07002e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 5.64998e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 5.29981e-07 [validate]: 3.048e-05 Sums bootstrap : 0.000254s : 3.02% type_inference : 0.004584s : 54.50% event_method : 0.000017s : 0.20% auto_monad : 0.000053s : 0.63% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.47% rewriter_before_opt_a : 0.000071s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000052s : 0.62% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000601s : 7.14% jit_opt_a.with_stream_mark : 0.000022s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000606s : 7.20% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.20% jit_opt_a.cse : 0.000054s : 0.64% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000030s : 0.35% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000532s : 6.32% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000024s : 0.29% loop_unroll : 0.000447s : 5.31% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000011s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000041s : 0.49% cse_after_recomputation.cse : 0.000029s : 0.34% auto_monad_reorder : 0.000013s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000474s : 5.63% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000030s : 0.36% Time group info: ------[substitution.] 0.000181 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000005s : 3: substitution.graph_param_transform 83.66% : 0.000152s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 5.74% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004532 2 79.87% : 0.003620s : 1: type_inference.infer 20.13% : 0.000912s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.67% : 0.000046s : 4: replace.inline 32.33% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 94.14% : 0.000149s : 4: match.inline 5.86% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.53% : 0.000002s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.45% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.35% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.62% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.67% : 0.000002s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.48% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000002s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.00% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000632 13 49.33% : 0.000312s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.81% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.86% : 0.000290s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013458 72 0.33% : 0.000044s : 1: add_recomputation 0.42% : 0.000056s : 1: auto_monad 0.12% : 0.000016s : 1: auto_monad_reorder 1.98% : 0.000266s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.31% : 0.000042s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.24% : 0.004877s : 1: jit_opt_a 1.01% : 0.000136s : 1: jit_opt_after_cconv 0.40% : 0.000054s : 1: jit_opt_b 3.37% : 0.000453s : 1: loop_unroll 4.02% : 0.000540s : 1: mutable_eliminate 5.94% : 0.000800s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.58% : 0.000481s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000042s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000013s : 1: remove_dup_value 2.25% : 0.000303s : 1: renormalize.infer 2.20% : 0.000296s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000032s : 1: rewriter_after_opt_a 0.55% : 0.000073s : 1: rewriter_before_opt_a 0.54% : 0.000072s : 1: symbol_engine_optimizer 34.13% : 0.004594s : 1: type_inference TotalTime = 0.110215, [30] [bootstrap]: 0.00024858 [type_inference]: 0.100434 [event_method]: 1.827e-05 [auto_monad]: 6.562e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 0.00042979 [rewriter_before_opt_a]: 8.05e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00680169, [2] [Cycle 1]: 0.00330787, [27] [switch_simplify]: 5.049e-05 [loop_unroll]: 2.957e-05 [a_1]: 0.0005407 [with_stream_mark]: 1.725e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 1.96998e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.59999e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 0.00234735 [add_forward_monad_depend]: 5.97001e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.502e-05 [cse]: 2.716e-05 [replace_applicator]: 1.289e-05 [Cycle 2]: 0.00034873, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 5.72999e-06 [a_1]: 0.00011852 [with_stream_mark]: 8.82999e-06 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.27999e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.363e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 1.60001e-06 [replace_old_param]: 8.18001e-06 [inline_without_move]: 5.54e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.103e-05 [replace_applicator]: 5.49998e-06 [py_interpret_to_execute_after_opt_a]: 1.014e-05 [rewriter_after_opt_a]: 3.273e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 5.07e-06 [mutable_eliminate]: 0.00052105 [jit_opt_b]: 5.351e-05, [1] [Cycle 1]: 4.671e-05, [2] [frontend_op_eliminate]: 1.791e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 2.402e-05 [loop_unroll]: 0.00041224 [jit_opt_after_cconv]: 0.00019352, [1] [Cycle 1]: 0.000142, [11] [c_1]: 2.501e-05 [parameter_eliminate]: 2.45002e-06 [updatestate_depend_eliminate]: 6.01e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.095e-05 [call_graph_tuple_transform]: 2.049e-05 [tuple_list_get_item_eliminator]: 6.10002e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.54e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 8.07e-06 [add_recomputation]: 4.553e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.63e-05, [1] [cse]: 1.062e-05 [auto_monad_reorder]: 1.399e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 4.43001e-06 [opt_after_jit_grad]: 0.00045042 [symbol_engine_optimizer]: 0.00010211, [1] [Cycle 1]: 9.599e-05, [6] [build]: 3.45e-06 [elim_shapecalc]: 8.48001e-06 [elim_not_effective]: 1.309e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 3.831e-05 [renormalize]: 3.80009e-07 [validate]: 3.933e-05 Sums bootstrap : 0.000249s : 0.23% type_inference : 0.100434s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000430s : 0.40% rewriter_before_opt_a : 0.000081s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000659s : 0.62% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002347s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000038s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000521s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000412s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000450s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000038s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000219 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 13.67% : 0.000030s : 2: substitution.fold_const_symbol 2.75% : 0.000006s : 4: substitution.graph_param_transform 71.45% : 0.000156s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.28% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 5.28% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100368 2 97.58% : 0.097941s : 1: type_inference.infer 2.42% : 0.002427s : 1: type_inference.specialize ------[replace.] 0.000067 6 68.05% : 0.000045s : 4: replace.inline 31.95% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.64% : 0.000154s : 4: match.inline 6.36% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.47% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.50% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.67% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.55% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.61% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.13% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.10% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000001s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002006 22 65.49% : 0.001313s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.97% : 0.000661s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113544 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.23% : 0.000261s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.99% : 0.006804s : 1: jit_opt_a 0.17% : 0.000197s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000420s : 1: loop_unroll 0.47% : 0.000530s : 1: mutable_eliminate 0.78% : 0.000881s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000063s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000435s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.45% : 0.001652s : 1: renormalize.infer 0.60% : 0.000686s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000085s : 1: rewriter_before_opt_a 0.09% : 0.000105s : 1: symbol_engine_optimizer 88.47% : 0.100447s : 1: type_inference TotalTime = 0.113143, [30] [bootstrap]: 0.00027149 [type_inference]: 0.103292 [event_method]: 2.05e-05 [auto_monad]: 5.302e-05 [graph_reusing]: 4e-06 [pre_auto_parallel]: 1.82999e-06 [py_interpret_to_execute]: 0.00041112 [rewriter_before_opt_a]: 8.377e-05 [expand_dump_flag]: 2.71999e-06 [jit_opt_a]: 0.0069238, [2] [Cycle 1]: 0.00356885, [27] [switch_simplify]: 5.139e-05 [loop_unroll]: 3.288e-05 [a_1]: 0.00062185 [with_stream_mark]: 1.233e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.23002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.06998e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 7.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.257e-05 [j_node_and_user_rematch]: 9.37999e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 6.10002e-06 [renormalize]: 0.00254169 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 1.50999e-06 [auto_monad_eliminator]: 1.25e-05 [cse]: 2.173e-05 [replace_applicator]: 1.387e-05 [Cycle 2]: 0.00036022, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 6.15002e-06 [a_1]: 0.00012494 [with_stream_mark]: 9.48002e-06 [recompute_prepare]: 6.31e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.82999e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.122e-05 [j_node_and_user_rematch]: 8.47998e-06 [meta_fg_expand]: 1.83997e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 5.31998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.40999e-06 [cse]: 1.268e-05 [replace_applicator]: 5.66998e-06 [py_interpret_to_execute_after_opt_a]: 1.001e-05 [rewriter_after_opt_a]: 2.938e-05 [convert_after_rewriter]: 5.82999e-06 [order_py_execute_after_rewriter]: 4.25999e-06 [mutable_eliminate]: 0.00053799 [jit_opt_b]: 5.347e-05, [1] [Cycle 1]: 4.706e-05, [2] [frontend_op_eliminate]: 1.873e-05 [inline_after_opt_a]: 1.76e-05 [cconv]: 1.652e-05 [loop_unroll]: 0.00041663 [jit_opt_after_cconv]: 0.00014567, [1] [Cycle 1]: 0.00013958, [11] [c_1]: 2.414e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.24e-05 [call_graph_tuple_transform]: 1.866e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.23002e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.12001e-06 [remove_dup_value]: 9.93998e-06 [partial_unused_args_eliminate]: 1.71002e-06 [environ_conv]: 5.74999e-06 [add_recomputation]: 3.417e-05 [cse_after_recomputation]: 2.225e-05, [1] [Cycle 1]: 1.716e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.204e-05 [get_jit_bprop_graph]: 1.35001e-06 [rewriter_after_jit_bprop_graph]: 4.27e-06 [opt_after_jit_grad]: 0.00045052 [symbol_engine_optimizer]: 7.213e-05, [1] [Cycle 1]: 6.588e-05, [6] [build]: 2.81e-06 [elim_shapecalc]: 8.28001e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 7.35e-06 [fold_const_symbol]: 8.37e-06 [renormalize]: 3.69997e-07 [validate]: 8.346e-05 Sums bootstrap : 0.000271s : 0.25% type_inference : 0.103292s : 94.25% event_method : 0.000021s : 0.02% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000411s : 0.38% rewriter_before_opt_a : 0.000084s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000747s : 0.68% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002542s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000538s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000417s : 0.38% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000451s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000083s : 0.08% Time group info: ------[substitution.] 0.000214 28 0.68% : 0.000001s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000004s : 4: substitution.graph_param_transform 83.90% : 0.000180s : 5: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.18% : 0.000009s : 3: substitution.reduce_eliminate 2.02% : 0.000004s : 4: substitution.remove_not_recompute_node 1.34% : 0.000003s : 2: substitution.replace_old_param 4.04% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103232 2 97.33% : 0.100478s : 1: type_inference.infer 2.67% : 0.002754s : 1: type_inference.specialize ------[replace.] 0.000084 7 67.60% : 0.000057s : 5: replace.inline 32.40% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 7 95.90% : 0.000177s : 5: match.inline 4.10% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.40% : 0.000002s : 13: predicate.accumulaten_eliminater 0.85% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.30% : 0.000003s : 13: predicate.arithmetic_simplify 1.43% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_depend_swap 1.31% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.84% : 0.000008s : 28: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.22% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.12% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.37% : 0.000002s : 13: predicate.print_const_string_wrapper 2.04% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.64% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 20: predicate.switch_defer_inline 2.10% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.18% : 0.000010s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.52% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002047 25 65.42% : 0.001339s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.68% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.90% : 0.000653s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116685 72 0.03% : 0.000037s : 1: add_recomputation 0.05% : 0.000056s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.24% : 0.000286s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.94% : 0.006927s : 1: jit_opt_a 0.13% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.36% : 0.000424s : 1: loop_unroll 0.47% : 0.000546s : 1: mutable_eliminate 0.83% : 0.000972s : 26: opt.transform.jit_opt_a 0.04% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000417s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.62% : 0.001893s : 1: renormalize.infer 0.55% : 0.000641s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000089s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 88.53% : 0.103306s : 1: type_inference TotalTime = 0.110727, [30] [bootstrap]: 0.00027225 [type_inference]: 0.101001 [event_method]: 1.711e-05 [auto_monad]: 4.715e-05 [graph_reusing]: 4.38001e-06 [pre_auto_parallel]: 1.52001e-06 [py_interpret_to_execute]: 0.00040724 [rewriter_before_opt_a]: 7.527e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.00673021, [2] [Cycle 1]: 0.00333234, [27] [switch_simplify]: 4.61e-05 [loop_unroll]: 3.044e-05 [a_1]: 0.00051457 [with_stream_mark]: 1.251e-05 [recompute_prepare]: 8.24002e-06 [updatestate_depend_eliminate]: 3.64002e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 1.36998e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.271e-05 [j_node_and_user_rematch]: 9.25001e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 8.20999e-06 [inline_without_move]: 6.23998e-06 [renormalize]: 0.00242278 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 1.94999e-06 [auto_monad_eliminator]: 1.401e-05 [cse]: 2.125e-05 [replace_applicator]: 1.328e-05 [Cycle 2]: 0.0003575, [27] [switch_simplify]: 6.76999e-06 [loop_unroll]: 5.79e-06 [a_1]: 0.00012065 [with_stream_mark]: 9.87999e-06 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.72999e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 1.73997e-06 [replace_old_param]: 8.91002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.34001e-06 [cse]: 1.18e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.093e-05 [rewriter_after_opt_a]: 3.065e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00053474 [jit_opt_b]: 5.382e-05, [1] [Cycle 1]: 4.732e-05, [2] [frontend_op_eliminate]: 1.893e-05 [inline_after_opt_a]: 1.748e-05 [cconv]: 1.963e-05 [loop_unroll]: 0.00041675 [jit_opt_after_cconv]: 0.00014608, [1] [Cycle 1]: 0.00013982, [11] [c_1]: 2.607e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 1.847e-05 [call_graph_tuple_transform]: 1.939e-05 [tuple_list_get_item_eliminator]: 7.12002e-06 [none_parameter_eliminate]: 1.29e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.128e-05 [partial_unused_args_eliminate]: 1.54998e-06 [environ_conv]: 6.73e-06 [add_recomputation]: 3.981e-05 [cse_after_recomputation]: 2.444e-05, [1] [Cycle 1]: 1.923e-05, [1] [cse]: 1.336e-05 [auto_monad_reorder]: 1.126e-05 [get_jit_bprop_graph]: 1.55001e-06 [rewriter_after_jit_bprop_graph]: 4.64998e-06 [opt_after_jit_grad]: 0.0005128 [symbol_engine_optimizer]: 0.00013225, [1] [Cycle 1]: 0.00012595, [6] [build]: 2.78e-06 [elim_shapecalc]: 9.14e-06 [elim_not_effective]: 1.31e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 6.675e-05 [renormalize]: 4.00003e-07 [validate]: 3.616e-05 Sums bootstrap : 0.000272s : 0.25% type_inference : 0.101001s : 94.27% event_method : 0.000017s : 0.02% auto_monad : 0.000047s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000407s : 0.38% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000635s : 0.59% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002423s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000535s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000417s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000513s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000067s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000160 24 0.92% : 0.000001s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000005s : 4: substitution.graph_param_transform 82.34% : 0.000132s : 4: substitution.inline 1.56% : 0.000002s : 4: substitution.j_node_and_user_rematch 3.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.35% : 0.000004s : 2: substitution.replace_old_param 5.87% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100941 2 97.60% : 0.098517s : 1: type_inference.infer 2.40% : 0.002424s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.02% : 0.000044s : 4: replace.inline 33.98% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000137 6 94.30% : 0.000129s : 4: match.inline 5.70% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000001s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000006s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.58% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.93% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002014 22 65.12% : 0.001311s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.35% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.53% : 0.000675s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114138 72 0.04% : 0.000043s : 1: add_recomputation 0.04% : 0.000050s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.25% : 0.000285s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.90% : 0.006734s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000424s : 1: loop_unroll 0.48% : 0.000542s : 1: mutable_eliminate 0.75% : 0.000853s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000091s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000521s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.36% : 0.000413s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.45% : 0.001651s : 1: renormalize.infer 0.67% : 0.000762s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000033s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.12% : 0.000135s : 1: symbol_engine_optimizer 88.50% : 0.101013s : 1: type_inference TotalTime = 0.114652, [30] [bootstrap]: 0.00026318 [type_inference]: 0.104033 [event_method]: 1.963e-05 [auto_monad]: 6.342e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 0.00050634 [rewriter_before_opt_a]: 8.81e-05 [expand_dump_flag]: 2.73003e-06 [jit_opt_a]: 0.00754211, [2] [Cycle 1]: 0.00375745, [27] [switch_simplify]: 5.61e-05 [loop_unroll]: 3.368e-05 [a_1]: 0.00066061 [with_stream_mark]: 1.384e-05 [recompute_prepare]: 8.99e-06 [updatestate_depend_eliminate]: 4.02e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 7.26999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.71e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 3.42002e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 9.53002e-06 [inline_without_move]: 6.51999e-06 [renormalize]: 0.00266631 [add_forward_monad_depend]: 6.25002e-06 [auto_monad_grad]: 1.77001e-06 [auto_monad_eliminator]: 1.373e-05 [cse]: 2.43e-05 [replace_applicator]: 1.587e-05 [Cycle 2]: 0.00036758, [27] [switch_simplify]: 7.05e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012816 [with_stream_mark]: 9.69999e-06 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.27001e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 2.81999e-06 [cell_reuse_recompute_pass]: 1.91003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.152e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.64e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.10019e-07 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.308e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 1.093e-05 [rewriter_after_opt_a]: 3.183e-05 [convert_after_rewriter]: 6.34999e-06 [order_py_execute_after_rewriter]: 4.13001e-06 [mutable_eliminate]: 0.00060355 [jit_opt_b]: 5.502e-05, [1] [Cycle 1]: 4.872e-05, [2] [frontend_op_eliminate]: 1.97e-05 [inline_after_opt_a]: 1.822e-05 [cconv]: 1.951e-05 [loop_unroll]: 0.00042708 [jit_opt_after_cconv]: 0.00014643, [1] [Cycle 1]: 0.00014038, [11] [c_1]: 2.475e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.171e-05 [call_graph_tuple_transform]: 1.927e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 1.21997e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.02999e-06 [remove_dup_value]: 1.046e-05 [partial_unused_args_eliminate]: 2.06e-06 [environ_conv]: 5.94e-06 [add_recomputation]: 3.86e-05 [cse_after_recomputation]: 2.377e-05, [1] [Cycle 1]: 1.819e-05, [1] [cse]: 1.21e-05 [auto_monad_reorder]: 1.242e-05 [get_jit_bprop_graph]: 1.64998e-06 [rewriter_after_jit_bprop_graph]: 4.05e-06 [opt_after_jit_grad]: 0.00045093 [symbol_engine_optimizer]: 7.196e-05, [1] [Cycle 1]: 6.644e-05, [6] [build]: 2.42001e-06 [elim_shapecalc]: 9.23002e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 6.62002e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 3.30008e-07 [validate]: 3.462e-05 Sums bootstrap : 0.000263s : 0.24% type_inference : 0.104033s : 94.00% event_method : 0.000020s : 0.02% auto_monad : 0.000063s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000506s : 0.46% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000789s : 0.71% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002666s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000604s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000427s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000451s : 0.41% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.03% Time group info: ------[substitution.] 0.000234 28 0.59% : 0.000001s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000005s : 4: substitution.graph_param_transform 84.75% : 0.000199s : 5: substitution.inline 1.21% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.30% : 0.000010s : 3: substitution.reduce_eliminate 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.67% : 0.000004s : 2: substitution.replace_old_param 3.07% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103968 2 97.40% : 0.101268s : 1: type_inference.infer 2.60% : 0.002700s : 1: type_inference.specialize ------[replace.] 0.000092 7 67.09% : 0.000062s : 5: replace.inline 32.91% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 96.94% : 0.000196s : 5: match.inline 3.06% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 886 1.03% : 0.000001s : 13: predicate.accumulaten_eliminater 0.76% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.84% : 0.000003s : 13: predicate.arithmetic_simplify 1.36% : 0.000002s : 13: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 8.09% : 0.000012s : 13: predicate.dict_get_item_const_eliminator 1.06% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.23% : 0.000002s : 13: predicate.environ_get_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 4.79% : 0.000007s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.40% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.75% : 0.000003s : 19: predicate.load_eliminater 0.97% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.06% : 0.000002s : 13: predicate.merge_addn 1.08% : 0.000002s : 13: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 1.79% : 0.000003s : 13: predicate.reduce_eliminate 1.35% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.19% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 20: predicate.switch_defer_inline 2.06% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.12% : 0.000010s : 64: predicate.switch_simplify 1.21% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.34% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.15% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.75% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002174 25 63.04% : 0.001370s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.98% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.98% : 0.000739s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118425 72 0.03% : 0.000041s : 1: add_recomputation 0.06% : 0.000067s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000276s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.37% : 0.007545s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000435s : 1: loop_unroll 0.52% : 0.000613s : 1: mutable_eliminate 0.87% : 0.001025s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000514s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.61% : 0.001901s : 1: renormalize.infer 0.64% : 0.000757s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 87.86% : 0.104046s : 1: type_inference TotalTime = 0.110353, [30] [bootstrap]: 0.00027032 [type_inference]: 0.100949 [event_method]: 1.704e-05 [auto_monad]: 4.484e-05 [graph_reusing]: 3.53e-06 [pre_auto_parallel]: 1.72999e-06 [py_interpret_to_execute]: 0.00041851 [rewriter_before_opt_a]: 7.102e-05 [expand_dump_flag]: 2.24999e-06 [jit_opt_a]: 0.00655109, [2] [Cycle 1]: 0.0031396, [27] [switch_simplify]: 4.605e-05 [loop_unroll]: 3.05e-05 [a_1]: 0.00050005 [with_stream_mark]: 1.209e-05 [recompute_prepare]: 8.11002e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.182e-05 [j_node_and_user_rematch]: 9.31e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 6.00002e-06 [renormalize]: 0.00225246 [add_forward_monad_depend]: 4.74e-06 [auto_monad_grad]: 1.47001e-06 [auto_monad_eliminator]: 1.244e-05 [cse]: 1.842e-05 [replace_applicator]: 1.327e-05 [Cycle 2]: 0.00034725, [27] [switch_simplify]: 6.09001e-06 [loop_unroll]: 5.79e-06 [a_1]: 0.00011747 [with_stream_mark]: 9.13002e-06 [recompute_prepare]: 5.81003e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.34999e-06 [cell_reuse_recompute_pass]: 1.55999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.49998e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 8.32998e-06 [inline_without_move]: 5.21998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.11998e-06 [cse]: 1.102e-05 [replace_applicator]: 5.61003e-06 [py_interpret_to_execute_after_opt_a]: 8.97e-06 [rewriter_after_opt_a]: 2.605e-05 [convert_after_rewriter]: 5.49e-06 [order_py_execute_after_rewriter]: 4.43999e-06 [mutable_eliminate]: 0.00048515 [jit_opt_b]: 5.317e-05, [1] [Cycle 1]: 4.715e-05, [2] [frontend_op_eliminate]: 1.906e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 1.708e-05 [loop_unroll]: 0.00040697 [jit_opt_after_cconv]: 0.00014003, [1] [Cycle 1]: 0.00013387, [11] [c_1]: 2.454e-05 [parameter_eliminate]: 2.30002e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.789e-05 [call_graph_tuple_transform]: 1.777e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 9.90025e-07 [renormalize]: 2.50002e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 9.12001e-06 [partial_unused_args_eliminate]: 1.48002e-06 [environ_conv]: 6.31e-06 [add_recomputation]: 3.262e-05 [cse_after_recomputation]: 2.241e-05, [1] [Cycle 1]: 1.645e-05, [1] [cse]: 1.047e-05 [auto_monad_reorder]: 1.029e-05 [get_jit_bprop_graph]: 1.34e-06 [rewriter_after_jit_bprop_graph]: 4.16001e-06 [opt_after_jit_grad]: 0.00044676 [symbol_engine_optimizer]: 0.00012892, [1] [Cycle 1]: 0.00012277, [6] [build]: 2.26e-06 [elim_shapecalc]: 6.155e-05 [elim_not_effective]: 1.476e-05 [opt_reshape]: 6.78e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 4.30009e-07 [validate]: 3.358e-05 Sums bootstrap : 0.000270s : 0.25% type_inference : 0.100949s : 94.59% event_method : 0.000017s : 0.02% auto_monad : 0.000045s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000419s : 0.39% rewriter_before_opt_a : 0.000071s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000618s : 0.58% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002253s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000029s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000026s : 0.02% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000485s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000407s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000033s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000447s : 0.42% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000062s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000152 24 1.20% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000004s : 4: substitution.graph_param_transform 83.75% : 0.000128s : 4: substitution.inline 1.77% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 4.81% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100890 2 97.55% : 0.098422s : 1: type_inference.infer 2.45% : 0.002467s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.21% : 0.000042s : 4: replace.inline 33.79% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000131 6 95.27% : 0.000125s : 4: match.inline 4.73% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.59% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.57% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.81% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.14% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.81% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.90% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001948 22 68.51% : 0.001335s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.35% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.13% : 0.000587s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113553 72 0.03% : 0.000036s : 1: add_recomputation 0.04% : 0.000048s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.25% : 0.000283s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.77% : 0.006554s : 1: jit_opt_a 0.13% : 0.000142s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000415s : 1: loop_unroll 0.43% : 0.000493s : 1: mutable_eliminate 0.73% : 0.000831s : 26: opt.transform.jit_opt_a 0.04% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000089s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000424s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.44% : 0.001630s : 1: renormalize.infer 0.54% : 0.000616s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000076s : 1: rewriter_before_opt_a 0.12% : 0.000131s : 1: symbol_engine_optimizer 88.91% : 0.100963s : 1: type_inference TotalTime = 0.114876, [30] [bootstrap]: 0.00027264 [type_inference]: 0.104601 [event_method]: 2.064e-05 [auto_monad]: 6.609e-05 [graph_reusing]: 5.83002e-06 [pre_auto_parallel]: 2.01998e-06 [py_interpret_to_execute]: 0.0004587 [rewriter_before_opt_a]: 9.448e-05 [expand_dump_flag]: 3.95e-06 [jit_opt_a]: 0.00707491, [2] [Cycle 1]: 0.00355999, [27] [switch_simplify]: 5.696e-05 [loop_unroll]: 3.321e-05 [a_1]: 0.00063503 [with_stream_mark]: 1.635e-05 [recompute_prepare]: 8.54998e-06 [updatestate_depend_eliminate]: 3.70003e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.78003e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.51e-06 [get_grad_eliminate_]: 6.49999e-06 [merge_forward]: 3.77002e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.42001e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00247978 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.522e-05 [cse]: 3.025e-05 [replace_applicator]: 1.417e-05 [Cycle 2]: 0.00039231, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00013739 [with_stream_mark]: 1.008e-05 [recompute_prepare]: 6.39999e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.15998e-06 [cell_reuse_recompute_pass]: 1.86e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.321e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.72999e-06 [cse]: 1.411e-05 [replace_applicator]: 6.68e-06 [py_interpret_to_execute_after_opt_a]: 1.119e-05 [rewriter_after_opt_a]: 3.569e-05 [convert_after_rewriter]: 6.63998e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00057154 [jit_opt_b]: 5.743e-05, [1] [Cycle 1]: 5.058e-05, [2] [frontend_op_eliminate]: 2.01e-05 [inline_after_opt_a]: 1.888e-05 [cconv]: 2.355e-05 [loop_unroll]: 0.00045565 [jit_opt_after_cconv]: 0.00015563, [1] [Cycle 1]: 0.00014887, [11] [c_1]: 2.702e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.64998e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [cse]: 2.238e-05 [call_graph_tuple_transform]: 2.023e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 4.99975e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 7.64002e-06 [add_recomputation]: 4.694e-05 [cse_after_recomputation]: 2.466e-05, [1] [Cycle 1]: 1.923e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 1.686e-05 [get_jit_bprop_graph]: 1.69e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.00049289 [symbol_engine_optimizer]: 0.00012817, [1] [Cycle 1]: 0.0001211, [6] [build]: 3.22002e-06 [elim_shapecalc]: 9.14e-06 [elim_not_effective]: 1.412e-05 [opt_reshape]: 5.386e-05 [fold_const_symbol]: 1.082e-05 [renormalize]: 5.40022e-07 [validate]: 4.216e-05 Sums bootstrap : 0.000273s : 0.25% type_inference : 0.104601s : 94.09% event_method : 0.000021s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000459s : 0.41% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.04% jit_opt_a.a_1 : 0.000772s : 0.69% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002480s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000572s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000456s : 0.41% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000493s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000054s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000232 28 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 4: substitution.graph_param_transform 82.39% : 0.000191s : 5: substitution.inline 1.52% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.46% : 0.000010s : 3: substitution.reduce_eliminate 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.73% : 0.000004s : 2: substitution.replace_old_param 4.09% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104533 2 97.40% : 0.101820s : 1: type_inference.infer 2.60% : 0.002713s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.32% : 0.000062s : 5: replace.inline 31.68% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 7 95.72% : 0.000188s : 5: match.inline 4.28% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.29% : 0.000002s : 13: predicate.addn_zero_filter 1.81% : 0.000003s : 13: predicate.arithmetic_simplify 1.57% : 0.000002s : 13: predicate.cast_eliminate 0.71% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_depend_swap 1.44% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.49% : 0.000008s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 1.80% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.32% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 13: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.32% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.20% : 0.000002s : 13: predicate.transpose_eliminate 1.32% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 13: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002072 25 65.77% : 0.001363s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.68% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.54% : 0.000654s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118498 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000285s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.97% : 0.007078s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.39% : 0.000464s : 1: loop_unroll 0.49% : 0.000580s : 1: mutable_eliminate 0.85% : 0.001010s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000501s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000465s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.52% : 0.001802s : 1: renormalize.infer 0.56% : 0.000669s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.11% : 0.000131s : 1: symbol_engine_optimizer 88.28% : 0.104615s : 1: type_inference TotalTime = 0.0141555, [30] [bootstrap]: 0.00026958 [type_inference]: 0.00693707 [event_method]: 1.907e-05 [auto_monad]: 6.296e-05 [graph_reusing]: 5.44e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 3.821e-05 [rewriter_before_opt_a]: 7.786e-05 [expand_dump_flag]: 2.99001e-06 [jit_opt_a]: 0.00480782, [2] [Cycle 1]: 0.00156644, [27] [switch_simplify]: 5.339e-05 [loop_unroll]: 3.249e-05 [a_1]: 0.00058051 [with_stream_mark]: 1.347e-05 [recompute_prepare]: 6.97002e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.6e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.42999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.84002e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.451e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.49e-06 [renormalize]: 0.00056225 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 1.39e-05 [cse]: 2.712e-05 [replace_applicator]: 1.15e-05 [Cycle 2]: 0.00031611, [27] [switch_simplify]: 5.55001e-06 [loop_unroll]: 5.04e-06 [a_1]: 9.39e-05 [with_stream_mark]: 8.60001e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.13002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.09003e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.03002e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.047e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 6.77002e-06 [inline_without_move]: 4.92999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 5.30999e-06 [cse]: 1.231e-05 [replace_applicator]: 5.11002e-06 [py_interpret_to_execute_after_opt_a]: 8.72998e-06 [rewriter_after_opt_a]: 3.168e-05 [convert_after_rewriter]: 6.06e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00046377 [jit_opt_b]: 4.789e-05, [1] [Cycle 1]: 4.186e-05, [2] [frontend_op_eliminate]: 1.544e-05 [inline_after_opt_a]: 1.573e-05 [cconv]: 2.13e-05 [loop_unroll]: 0.00039752 [jit_opt_after_cconv]: 0.00014504, [1] [Cycle 1]: 0.00013873, [11] [c_1]: 2.042e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.83002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 2.066e-05 [call_graph_tuple_transform]: 2.301e-05 [tuple_list_get_item_eliminator]: 5.50001e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 5.63002e-06 [remove_dup_value]: 1.431e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 5.19998e-06 [add_recomputation]: 4.313e-05 [cse_after_recomputation]: 2.411e-05, [1] [Cycle 1]: 1.849e-05, [1] [cse]: 1.251e-05 [auto_monad_reorder]: 1.562e-05 [get_jit_bprop_graph]: 1.65001e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00044493 [symbol_engine_optimizer]: 7.057e-05, [1] [Cycle 1]: 6.444e-05, [6] [build]: 2.86999e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.298e-05 [opt_reshape]: 5.89e-06 [fold_const_symbol]: 8.15e-06 [renormalize]: 3.49974e-07 [validate]: 3.373e-05 Sums bootstrap : 0.000270s : 2.52% type_inference : 0.006937s : 64.93% event_method : 0.000019s : 0.18% auto_monad : 0.000063s : 0.59% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.36% rewriter_before_opt_a : 0.000078s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.55% jit_opt_a.loop_unroll : 0.000038s : 0.35% jit_opt_a.a_1 : 0.000674s : 6.31% jit_opt_a.with_stream_mark : 0.000022s : 0.21% jit_opt_a.recompute_prepare : 0.000012s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.23% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000562s : 5.26% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.18% jit_opt_a.cse : 0.000039s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000032s : 0.30% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000464s : 4.34% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000021s : 0.20% loop_unroll : 0.000398s : 3.72% jit_opt_after_cconv.c_1 : 0.000020s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000014s : 0.13% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000043s : 0.40% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000445s : 4.16% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.32% Time group info: ------[substitution.] 0.000210 27 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 1.95% : 0.000004s : 3: substitution.graph_param_transform 83.03% : 0.000174s : 5: substitution.inline 1.19% : 0.000002s : 4: substitution.j_node_and_user_rematch 4.59% : 0.000010s : 3: substitution.reduce_eliminate 1.98% : 0.000004s : 4: substitution.remove_not_recompute_node 1.48% : 0.000003s : 2: substitution.replace_old_param 4.33% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006872 2 87.44% : 0.006009s : 1: type_inference.infer 12.56% : 0.000863s : 1: type_inference.specialize ------[replace.] 0.000083 7 68.06% : 0.000056s : 5: replace.inline 31.94% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 7 95.58% : 0.000172s : 5: match.inline 4.42% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 747 1.32% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.37% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.28% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000001s : 11: predicate.depend_value_elim 1.31% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.27% : 0.000002s : 11: predicate.environ_get_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.72% : 0.000007s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 16: predicate.load_eliminater 1.13% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 16: predicate.partial_eliminate 1.42% : 0.000002s : 11: predicate.print_const_string_wrapper 1.93% : 0.000002s : 11: predicate.reduce_eliminate 1.48% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 11: predicate.reshape_eliminate 1.35% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.71% : 0.000003s : 18: predicate.switch_defer_inline 2.27% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.81% : 0.000009s : 59: predicate.switch_simplify 1.31% : 0.000002s : 11: predicate.tile_eliminate 1.27% : 0.000002s : 11: predicate.transpose_eliminate 1.52% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000672 16 49.98% : 0.000336s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.65% : 0.000051s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.38% : 0.000285s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015674 72 0.29% : 0.000046s : 1: add_recomputation 0.42% : 0.000066s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 1.79% : 0.000280s : 1: bootstrap 0.15% : 0.000024s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000026s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 30.69% : 0.004810s : 1: jit_opt_a 0.94% : 0.000148s : 1: jit_opt_after_cconv 0.32% : 0.000050s : 1: jit_opt_b 2.58% : 0.000405s : 1: loop_unroll 3.01% : 0.000472s : 1: mutable_eliminate 5.63% : 0.000883s : 26: opt.transform.jit_opt_a 0.33% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.89% : 0.000452s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000041s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 1.95% : 0.000306s : 1: renormalize.infer 1.60% : 0.000250s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000035s : 1: rewriter_after_opt_a 0.52% : 0.000081s : 1: rewriter_before_opt_a 0.47% : 0.000073s : 1: symbol_engine_optimizer 44.33% : 0.006948s : 1: type_inference TotalTime = 0.109872, [30] [bootstrap]: 0.00024837 [type_inference]: 0.100173 [event_method]: 1.821e-05 [auto_monad]: 6.125e-05 [graph_reusing]: 6.01998e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.00045074 [rewriter_before_opt_a]: 7.82e-05 [expand_dump_flag]: 3.65998e-06 [jit_opt_a]: 0.00672952, [2] [Cycle 1]: 0.0032485, [27] [switch_simplify]: 4.892e-05 [loop_unroll]: 2.968e-05 [a_1]: 0.00055094 [with_stream_mark]: 1.591e-05 [recompute_prepare]: 8.59e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.363e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 0.00228035 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.487e-05 [cse]: 2.664e-05 [replace_applicator]: 1.449e-05 [Cycle 2]: 0.00035586, [27] [switch_simplify]: 6.70002e-06 [loop_unroll]: 5.46e-06 [a_1]: 0.00011979 [with_stream_mark]: 1.059e-05 [recompute_prepare]: 5.58002e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 9.89996e-07 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 2.50997e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.483e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.68997e-06 [cse]: 1.081e-05 [replace_applicator]: 6.01e-06 [py_interpret_to_execute_after_opt_a]: 1.011e-05 [rewriter_after_opt_a]: 3.12e-05 [convert_after_rewriter]: 6.78e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.0005112 [jit_opt_b]: 5.457e-05, [1] [Cycle 1]: 4.694e-05, [2] [frontend_op_eliminate]: 1.822e-05 [inline_after_opt_a]: 1.749e-05 [cconv]: 2.41e-05 [loop_unroll]: 0.00043461 [jit_opt_after_cconv]: 0.00014371, [1] [Cycle 1]: 0.00013703, [11] [c_1]: 2.591e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 5.85002e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.727e-05 [call_graph_tuple_transform]: 1.968e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.29998e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.368e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 8.08999e-06 [add_recomputation]: 4.394e-05 [cse_after_recomputation]: 2.155e-05, [1] [Cycle 1]: 1.559e-05, [1] [cse]: 9.98002e-06 [auto_monad_reorder]: 1.601e-05 [get_jit_bprop_graph]: 1.32e-06 [rewriter_after_jit_bprop_graph]: 4.18999e-06 [opt_after_jit_grad]: 0.00044411 [symbol_engine_optimizer]: 0.00012972, [1] [Cycle 1]: 0.00012333, [6] [build]: 3.20998e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 6.742e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 9.79999e-06 [renormalize]: 4.19997e-07 [validate]: 3.664e-05 Sums bootstrap : 0.000248s : 0.23% type_inference : 0.100173s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000061s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000451s : 0.42% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000671s : 0.63% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002280s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000037s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000511s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000435s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000444s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000067s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000198 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 83.38% : 0.000165s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000004s : 2: substitution.replace_old_param 6.04% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100106 2 97.44% : 0.097548s : 1: type_inference.infer 2.56% : 0.002558s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.45% : 0.000046s : 4: replace.inline 32.55% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.74% : 0.000163s : 4: match.inline 6.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.23% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.47% : 0.000007s : 26: predicate.inline 1.04% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.46% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.43% : 0.000009s : 58: predicate.switch_simplify 1.39% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001964 22 65.71% : 0.001291s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.12% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.17% : 0.000632s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113173 72 0.04% : 0.000047s : 1: add_recomputation 0.06% : 0.000064s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000259s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.95% : 0.006732s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.39% : 0.000442s : 1: loop_unroll 0.46% : 0.000519s : 1: mutable_eliminate 0.79% : 0.000892s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000089s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000459s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.46% : 0.001647s : 1: renormalize.infer 0.55% : 0.000625s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000132s : 1: symbol_engine_optimizer 88.52% : 0.100186s : 1: type_inference TotalTime = 0.114799, [30] [bootstrap]: 0.00026204 [type_inference]: 0.104156 [event_method]: 2.16e-05 [auto_monad]: 7.095e-05 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00045095 [rewriter_before_opt_a]: 9.599e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00753378, [2] [Cycle 1]: 0.00393073, [27] [switch_simplify]: 6.465e-05 [loop_unroll]: 3.432e-05 [a_1]: 0.00066921 [with_stream_mark]: 1.613e-05 [recompute_prepare]: 8.83001e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.60002e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.04003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 9.99999e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 9.09998e-06 [inline_without_move]: 6.11e-06 [renormalize]: 0.0027768 [add_forward_monad_depend]: 6.25002e-06 [auto_monad_grad]: 2.39001e-06 [auto_monad_eliminator]: 1.697e-05 [cse]: 3.575e-05 [replace_applicator]: 1.743e-05 [Cycle 2]: 0.00037968, [27] [switch_simplify]: 6.36998e-06 [loop_unroll]: 5.92001e-06 [a_1]: 0.00012912 [with_stream_mark]: 1.29e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.49998e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 1.66e-06 [get_grad_eliminate_]: 5.59998e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27999e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.492e-05 [replace_applicator]: 5.98002e-06 [py_interpret_to_execute_after_opt_a]: 1.042e-05 [rewriter_after_opt_a]: 3.559e-05 [convert_after_rewriter]: 7.06001e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00060041 [jit_opt_b]: 5.438e-05, [1] [Cycle 1]: 4.771e-05, [2] [frontend_op_eliminate]: 1.899e-05 [inline_after_opt_a]: 1.788e-05 [cconv]: 2.489e-05 [loop_unroll]: 0.00042014 [jit_opt_after_cconv]: 0.0001532, [1] [Cycle 1]: 0.00014656, [11] [c_1]: 2.524e-05 [parameter_eliminate]: 2.75002e-06 [updatestate_depend_eliminate]: 6.49999e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 2.407e-05 [call_graph_tuple_transform]: 2.024e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.554e-05 [partial_unused_args_eliminate]: 2.25002e-06 [environ_conv]: 7.42002e-06 [add_recomputation]: 4.651e-05 [cse_after_recomputation]: 2.279e-05, [1] [Cycle 1]: 1.754e-05, [1] [cse]: 1.2e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 1.53002e-06 [rewriter_after_jit_bprop_graph]: 4.43001e-06 [opt_after_jit_grad]: 0.00044959 [symbol_engine_optimizer]: 7.252e-05, [1] [Cycle 1]: 6.614e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.275e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 8.67998e-06 [renormalize]: 3.00002e-07 [validate]: 7.7e-05 Sums bootstrap : 0.000262s : 0.24% type_inference : 0.104156s : 93.84% event_method : 0.000022s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000451s : 0.41% rewriter_before_opt_a : 0.000096s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000071s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000798s : 0.72% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002777s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000051s : 0.05% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000600s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000420s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000450s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000077s : 0.07% Time group info: ------[substitution.] 0.000250 28 0.74% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.36% : 0.000006s : 4: substitution.graph_param_transform 82.81% : 0.000207s : 5: substitution.inline 1.45% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.55% : 0.000011s : 3: substitution.reduce_eliminate 1.78% : 0.000004s : 4: substitution.remove_not_recompute_node 1.65% : 0.000004s : 2: substitution.replace_old_param 4.20% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104084 2 97.25% : 0.101226s : 1: type_inference.infer 2.75% : 0.002858s : 1: type_inference.specialize ------[replace.] 0.000095 7 69.57% : 0.000066s : 5: replace.inline 30.43% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 95.62% : 0.000204s : 5: match.inline 4.38% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 2.02% : 0.000003s : 13: predicate.arithmetic_simplify 1.39% : 0.000002s : 13: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.14% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.54% : 0.000008s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 1.16% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.51% : 0.000003s : 19: predicate.partial_eliminate 1.19% : 0.000002s : 13: predicate.print_const_string_wrapper 2.00% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.68% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 20: predicate.switch_defer_inline 2.09% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.63% : 0.000011s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.33% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 2.04% : 0.000003s : 13: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.51% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002197 25 62.13% : 0.001365s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.72% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.15% : 0.000772s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118655 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000273s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.35% : 0.007537s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.36% : 0.000428s : 1: loop_unroll 0.51% : 0.000609s : 1: mutable_eliminate 0.88% : 0.001044s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.68% : 0.001989s : 1: renormalize.infer 0.66% : 0.000778s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.09% : 0.000102s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 87.79% : 0.104171s : 1: type_inference TotalTime = 0.0679901, [30] [bootstrap]: 0.00026817 [type_inference]: 0.0581389 [event_method]: 1.949e-05 [auto_monad]: 6.377e-05 [graph_reusing]: 4.87998e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00028715 [rewriter_before_opt_a]: 7.884e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00690827, [2] [Cycle 1]: 0.00331114, [27] [switch_simplify]: 5.386e-05 [loop_unroll]: 2.98e-05 [a_1]: 0.00059451 [with_stream_mark]: 1.583e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 2.82002e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.79998e-06 [inline_without_move]: 6.10002e-06 [renormalize]: 0.00228697 [add_forward_monad_depend]: 6.91999e-06 [auto_monad_grad]: 2.38998e-06 [auto_monad_eliminator]: 1.616e-05 [cse]: 2.86e-05 [replace_applicator]: 1.503e-05 [Cycle 2]: 0.00035863, [27] [switch_simplify]: 6.81001e-06 [loop_unroll]: 5.49e-06 [a_1]: 0.00011867 [with_stream_mark]: 1.191e-05 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.40999e-06 [updatestate_useless_node_eliminater]: 5.36002e-06 [accelerated_algorithm]: 5.40001e-06 [meta_shard_fg_expand]: 1.83002e-06 [get_grad_eliminate_]: 5.14998e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 2.21998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.661e-05 [j_node_and_user_rematch]: 8.75999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 5.72001e-06 [cse]: 1.151e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.154e-05 [rewriter_after_opt_a]: 3.399e-05 [convert_after_rewriter]: 7.03998e-06 [order_py_execute_after_rewriter]: 4.58999e-06 [mutable_eliminate]: 0.00061623 [jit_opt_b]: 5.278e-05, [1] [Cycle 1]: 4.523e-05, [2] [frontend_op_eliminate]: 1.762e-05 [inline_after_opt_a]: 1.712e-05 [cconv]: 2.336e-05 [loop_unroll]: 0.00042988 [jit_opt_after_cconv]: 0.00014918, [1] [Cycle 1]: 0.00014246, [11] [c_1]: 2.472e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.158e-05 [call_graph_tuple_transform]: 2.055e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.05002e-06 [remove_dup_value]: 1.589e-05 [partial_unused_args_eliminate]: 2.06998e-06 [environ_conv]: 8.40001e-06 [add_recomputation]: 4.53e-05 [cse_after_recomputation]: 2.029e-05, [1] [Cycle 1]: 1.54e-05, [1] [cse]: 1.021e-05 [auto_monad_reorder]: 1.429e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 3.93001e-06 [opt_after_jit_grad]: 0.00046421 [symbol_engine_optimizer]: 0.00010675, [1] [Cycle 1]: 0.00010059, [6] [build]: 2.68e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 4.63e-05 [opt_reshape]: 6.59001e-06 [fold_const_symbol]: 9.54999e-06 [renormalize]: 5.8001e-07 [validate]: 4.01e-05 Sums bootstrap : 0.000268s : 0.42% type_inference : 0.058139s : 90.56% event_method : 0.000019s : 0.03% auto_monad : 0.000064s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000287s : 0.45% rewriter_before_opt_a : 0.000079s : 0.12% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.05% jit_opt_a.a_1 : 0.000713s : 1.11% jit_opt_a.with_stream_mark : 0.000028s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002287s : 3.56% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.03% jit_opt_a.cse : 0.000040s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000034s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000616s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000430s : 0.67% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000464s : 0.72% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000046s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.06% Time group info: ------[substitution.] 0.000191 24 1.17% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 3.07% : 0.000006s : 4: substitution.graph_param_transform 81.88% : 0.000156s : 4: substitution.inline 1.74% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.92% : 0.000006s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.27% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.058062 2 96.71% : 0.056150s : 1: type_inference.infer 3.29% : 0.001912s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.27% : 0.000044s : 4: replace.inline 34.73% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.43% : 0.000154s : 4: match.inline 6.57% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000002s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000001s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.19% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.10% : 0.000001s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.35% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.87% : 0.000002s : 12: predicate.reduce_eliminate 1.55% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.17% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.39% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002691 34 75.75% : 0.002038s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.04% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.20% : 0.000624s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071288 72 0.07% : 0.000048s : 1: add_recomputation 0.09% : 0.000067s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.39% : 0.000280s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.70% : 0.006912s : 1: jit_opt_a 0.21% : 0.000152s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.61% : 0.000438s : 1: loop_unroll 0.88% : 0.000625s : 1: mutable_eliminate 1.32% : 0.000940s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.41% : 0.000295s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.21% : 0.001577s : 1: renormalize.infer 0.98% : 0.000702s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000037s : 1: rewriter_after_opt_a 0.12% : 0.000083s : 1: rewriter_before_opt_a 0.15% : 0.000109s : 1: symbol_engine_optimizer 81.57% : 0.058153s : 1: type_inference TotalTime = 0.015155, [30] [bootstrap]: 0.00028458 [type_inference]: 0.00763187 [event_method]: 1.893e-05 [auto_monad]: 6.189e-05 [graph_reusing]: 5.95002e-06 [pre_auto_parallel]: 2.04999e-06 [py_interpret_to_execute]: 3.736e-05 [rewriter_before_opt_a]: 7.566e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.004988, [2] [Cycle 1]: 0.00163711, [27] [switch_simplify]: 5.312e-05 [loop_unroll]: 3.271e-05 [a_1]: 0.00058922 [with_stream_mark]: 1.499e-05 [recompute_prepare]: 7.65e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 3.08998e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.13998e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.69002e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.39001e-06 [replace_old_param]: 8.13999e-06 [inline_without_move]: 5.25999e-06 [renormalize]: 0.0006321 [add_forward_monad_depend]: 4.98001e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.347e-05 [cse]: 2.821e-05 [replace_applicator]: 1.246e-05 [Cycle 2]: 0.00032281, [27] [switch_simplify]: 5.87001e-06 [loop_unroll]: 4.88001e-06 [a_1]: 9.589e-05 [with_stream_mark]: 9.69999e-06 [recompute_prepare]: 5.18002e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.03002e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.56002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.071e-05 [j_node_and_user_rematch]: 7.48e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.251e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 9.25999e-06 [rewriter_after_opt_a]: 3.507e-05 [convert_after_rewriter]: 6.79001e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.0005107 [jit_opt_b]: 4.923e-05, [1] [Cycle 1]: 4.342e-05, [2] [frontend_op_eliminate]: 1.577e-05 [inline_after_opt_a]: 1.619e-05 [cconv]: 2.315e-05 [loop_unroll]: 0.00040732 [jit_opt_after_cconv]: 0.00014651, [1] [Cycle 1]: 0.00014019, [11] [c_1]: 2.012e-05 [parameter_eliminate]: 2.21998e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 2.09e-05 [call_graph_tuple_transform]: 1.785e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 6.20028e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.514e-05 [partial_unused_args_eliminate]: 1.81e-06 [environ_conv]: 5.57001e-06 [add_recomputation]: 4.402e-05 [cse_after_recomputation]: 3.458e-05, [1] [Cycle 1]: 2.892e-05, [1] [cse]: 1.177e-05 [auto_monad_reorder]: 1.679e-05 [get_jit_bprop_graph]: 1.59998e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.0004728 [symbol_engine_optimizer]: 7.096e-05, [1] [Cycle 1]: 6.511e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.80998e-06 [elim_not_effective]: 1.312e-05 [opt_reshape]: 5.56e-06 [fold_const_symbol]: 8.52e-06 [renormalize]: 4.19997e-07 [validate]: 3.369e-05 Sums bootstrap : 0.000285s : 2.46% type_inference : 0.007632s : 65.99% event_method : 0.000019s : 0.16% auto_monad : 0.000062s : 0.54% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.32% rewriter_before_opt_a : 0.000076s : 0.65% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.51% jit_opt_a.loop_unroll : 0.000038s : 0.33% jit_opt_a.a_1 : 0.000685s : 5.92% jit_opt_a.with_stream_mark : 0.000025s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000632s : 5.47% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.17% jit_opt_a.cse : 0.000041s : 0.35% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000035s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000511s : 4.42% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000023s : 0.20% loop_unroll : 0.000407s : 3.52% jit_opt_after_cconv.c_1 : 0.000020s : 0.17% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000044s : 0.38% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000473s : 4.09% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.29% Time group info: ------[substitution.] 0.000218 27 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.27% : 0.000005s : 3: substitution.graph_param_transform 82.60% : 0.000180s : 5: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.41% : 0.000010s : 3: substitution.reduce_eliminate 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.33% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007576 2 87.91% : 0.006660s : 1: type_inference.infer 12.09% : 0.000916s : 1: type_inference.specialize ------[replace.] 0.000084 7 67.08% : 0.000056s : 5: replace.inline 32.92% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000186 7 95.50% : 0.000177s : 5: match.inline 4.50% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 747 1.23% : 0.000001s : 11: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.29% : 0.000002s : 11: predicate.addn_zero_filter 1.83% : 0.000002s : 11: predicate.arithmetic_simplify 1.39% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000001s : 11: predicate.depend_value_elim 1.16% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_depend_swap 1.33% : 0.000002s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.07% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.49% : 0.000006s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 16: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.40% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 2.15% : 0.000003s : 11: predicate.reduce_eliminate 1.42% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 19: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 11: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.18% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 11: predicate.stack_unstack_eliminate 0.38% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.58% : 0.000009s : 59: predicate.switch_simplify 1.33% : 0.000002s : 11: predicate.tile_eliminate 1.34% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000719 16 50.83% : 0.000365s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.12% : 0.000051s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.05% : 0.000302s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016751 72 0.28% : 0.000047s : 1: add_recomputation 0.39% : 0.000065s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 1.78% : 0.000297s : 1: bootstrap 0.15% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.22% : 0.000037s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 29.79% : 0.004991s : 1: jit_opt_a 0.89% : 0.000149s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.48% : 0.000415s : 1: loop_unroll 3.10% : 0.000519s : 1: mutable_eliminate 5.35% : 0.000897s : 26: opt.transform.jit_opt_a 0.27% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.87% : 0.000481s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.24% : 0.000040s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.12% : 0.000355s : 1: renormalize.infer 1.61% : 0.000270s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000038s : 1: rewriter_after_opt_a 0.47% : 0.000078s : 1: rewriter_before_opt_a 0.44% : 0.000073s : 1: symbol_engine_optimizer 45.63% : 0.007643s : 1: type_inference TotalTime = 0.0597039, [30] [bootstrap]: 0.00027987 [type_inference]: 0.0507034 [event_method]: 1.865e-05 [auto_monad]: 5.746e-05 [graph_reusing]: 4.54998e-06 [pre_auto_parallel]: 1.62999e-06 [py_interpret_to_execute]: 0.00024917 [rewriter_before_opt_a]: 7.572e-05 [expand_dump_flag]: 3.02002e-06 [jit_opt_a]: 0.00620617, [2] [Cycle 1]: 0.00279245, [27] [switch_simplify]: 5.004e-05 [loop_unroll]: 3.086e-05 [a_1]: 0.00052764 [with_stream_mark]: 1.397e-05 [recompute_prepare]: 9.20001e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.01997e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 5.90002e-06 [accelerated_algorithm]: 6.26998e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 3.22997e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.309e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 9.16998e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00180046 [add_forward_monad_depend]: 5.32001e-06 [auto_monad_grad]: 1.95001e-06 [auto_monad_eliminator]: 1.476e-05 [cse]: 1.944e-05 [replace_applicator]: 1.352e-05 [Cycle 2]: 0.00034861, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 5.79e-06 [a_1]: 0.00011771 [with_stream_mark]: 8.86002e-06 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 1.95001e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.60001e-06 [updatestate_useless_node_eliminater]: 5.70001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.402e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.09999e-06 [cse]: 1.032e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 9.17001e-06 [rewriter_after_opt_a]: 3.088e-05 [convert_after_rewriter]: 7.05998e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00052229 [jit_opt_b]: 5.453e-05, [1] [Cycle 1]: 4.853e-05, [2] [frontend_op_eliminate]: 1.844e-05 [inline_after_opt_a]: 1.909e-05 [cconv]: 2.213e-05 [loop_unroll]: 0.00042895 [jit_opt_after_cconv]: 0.00014777, [1] [Cycle 1]: 0.00014145, [11] [c_1]: 2.636e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.031e-05 [call_graph_tuple_transform]: 1.963e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.308e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 6.80998e-06 [add_recomputation]: 4.288e-05 [cse_after_recomputation]: 2.144e-05, [1] [Cycle 1]: 1.628e-05, [1] [cse]: 1.077e-05 [auto_monad_reorder]: 1.276e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.2e-06 [opt_after_jit_grad]: 0.00048164 [symbol_engine_optimizer]: 8.726e-05, [1] [Cycle 1]: 8.033e-05, [6] [build]: 3.18e-06 [elim_shapecalc]: 7.97998e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 2.237e-05 [renormalize]: 3.30008e-07 [validate]: 3.674e-05 Sums bootstrap : 0.000280s : 0.50% type_inference : 0.050703s : 90.50% event_method : 0.000019s : 0.03% auto_monad : 0.000057s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000249s : 0.44% rewriter_before_opt_a : 0.000076s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000645s : 1.15% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001801s : 3.21% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000030s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000031s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000522s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000022s : 0.04% loop_unroll : 0.000429s : 0.77% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000043s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000482s : 0.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000022s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000176 24 1.20% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000005s : 4: substitution.graph_param_transform 83.37% : 0.000147s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000004s : 4: substitution.remove_not_recompute_node 1.97% : 0.000003s : 2: substitution.replace_old_param 5.82% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050629 2 96.43% : 0.048822s : 1: type_inference.infer 3.57% : 0.001807s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.20% : 0.000045s : 4: replace.inline 31.80% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 94.10% : 0.000145s : 4: match.inline 5.90% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.24% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 18: predicate.load_eliminater 1.71% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 2.03% : 0.000003s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.49% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.35% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.52% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002205 26 72.18% : 0.001591s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.25% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.57% : 0.000586s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062463 72 0.07% : 0.000046s : 1: add_recomputation 0.10% : 0.000060s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.47% : 0.000293s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.94% : 0.006209s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.70% : 0.000436s : 1: loop_unroll 0.85% : 0.000530s : 1: mutable_eliminate 1.39% : 0.000866s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.41% : 0.000255s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.91% : 0.001193s : 1: renormalize.infer 0.96% : 0.000600s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000034s : 1: rewriter_after_opt_a 0.13% : 0.000081s : 1: rewriter_before_opt_a 0.14% : 0.000090s : 1: symbol_engine_optimizer 81.20% : 0.050718s : 1: type_inference TotalTime = 0.114597, [30] [bootstrap]: 0.00027169 [type_inference]: 0.104148 [event_method]: 2.097e-05 [auto_monad]: 4.87e-05 [graph_reusing]: 3.83001e-06 [pre_auto_parallel]: 1.71998e-06 [py_interpret_to_execute]: 0.00041545 [rewriter_before_opt_a]: 8.439e-05 [expand_dump_flag]: 2.44999e-06 [jit_opt_a]: 0.00725988, [2] [Cycle 1]: 0.00381606, [27] [switch_simplify]: 5.043e-05 [loop_unroll]: 3.37e-05 [a_1]: 0.0006207 [with_stream_mark]: 1.34e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.44999e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.27e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 2.13002e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 6.36e-06 [renormalize]: 0.00277058 [add_forward_monad_depend]: 6.06e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.501e-05 [cse]: 2.635e-05 [replace_applicator]: 1.534e-05 [Cycle 2]: 0.00037218, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00012898 [with_stream_mark]: 1.043e-05 [recompute_prepare]: 6.22001e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.74999e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 3.09999e-06 [cell_reuse_recompute_pass]: 2.08002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.269e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.69e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 1.00999e-06 [auto_monad_eliminator]: 5.83997e-06 [cse]: 1.375e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.257e-05 [rewriter_after_opt_a]: 3.403e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00057983 [jit_opt_b]: 6.062e-05, [1] [Cycle 1]: 5.317e-05, [2] [frontend_op_eliminate]: 1.835e-05 [inline_after_opt_a]: 1.755e-05 [cconv]: 2.337e-05 [loop_unroll]: 0.00045338 [jit_opt_after_cconv]: 0.00015729, [1] [Cycle 1]: 0.00015005, [11] [c_1]: 2.605e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 6.74001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.408e-05 [call_graph_tuple_transform]: 2.268e-05 [tuple_list_get_item_eliminator]: 6.48e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.593e-05 [partial_unused_args_eliminate]: 2.01003e-06 [environ_conv]: 7.33e-06 [add_recomputation]: 4.808e-05 [cse_after_recomputation]: 2.362e-05, [1] [Cycle 1]: 1.864e-05, [1] [cse]: 1.287e-05 [auto_monad_reorder]: 1.827e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00051798 [symbol_engine_optimizer]: 8.363e-05, [1] [Cycle 1]: 7.559e-05, [6] [build]: 4.35999e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 1.562e-05 [opt_reshape]: 8.89e-06 [fold_const_symbol]: 9.17999e-06 [renormalize]: 6.19999e-07 [validate]: 0.00011155 Sums bootstrap : 0.000272s : 0.24% type_inference : 0.104148s : 93.88% event_method : 0.000021s : 0.02% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000415s : 0.37% rewriter_before_opt_a : 0.000084s : 0.08% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000750s : 0.68% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002771s : 2.50% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000580s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000453s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000518s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000112s : 0.10% Time group info: ------[substitution.] 0.000216 28 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000006s : 4: substitution.graph_param_transform 82.21% : 0.000178s : 5: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.82% : 0.000010s : 3: substitution.reduce_eliminate 2.09% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000004s : 2: substitution.replace_old_param 3.63% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104079 2 97.33% : 0.101302s : 1: type_inference.infer 2.67% : 0.002777s : 1: type_inference.specialize ------[replace.] 0.000091 7 66.72% : 0.000060s : 5: replace.inline 33.28% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 7 96.32% : 0.000175s : 5: match.inline 3.68% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.55% : 0.000002s : 13: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.92% : 0.000003s : 13: predicate.arithmetic_simplify 1.28% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.27% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 5.36% : 0.000007s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 19: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 19: predicate.partial_eliminate 1.38% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.44% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 23: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.97% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 64: predicate.switch_simplify 1.27% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 13: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002231 25 61.15% : 0.001364s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.59% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.26% : 0.000809s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118353 72 0.04% : 0.000051s : 1: add_recomputation 0.04% : 0.000051s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.24% : 0.000287s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.14% : 0.007263s : 1: jit_opt_a 0.14% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.39% : 0.000462s : 1: loop_unroll 0.50% : 0.000588s : 1: mutable_eliminate 0.83% : 0.000978s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000528s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.36% : 0.000421s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.63% : 0.001927s : 1: renormalize.infer 0.71% : 0.000835s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000086s : 1: symbol_engine_optimizer 88.01% : 0.104160s : 1: type_inference TotalTime = 0.0609659, [30] [bootstrap]: 0.00027201 [type_inference]: 0.051509 [event_method]: 1.806e-05 [auto_monad]: 6.404e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.08002e-06 [py_interpret_to_execute]: 0.00033281 [rewriter_before_opt_a]: 8.038e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00652291, [2] [Cycle 1]: 0.00297023, [27] [switch_simplify]: 5.578e-05 [loop_unroll]: 2.967e-05 [a_1]: 0.00062664 [with_stream_mark]: 1.577e-05 [recompute_prepare]: 8.67e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.73003e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.414e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 6.76e-06 [renormalize]: 0.00191504 [add_forward_monad_depend]: 5.99999e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 1.531e-05 [cse]: 2.668e-05 [replace_applicator]: 1.307e-05 [Cycle 2]: 0.00035143, [27] [switch_simplify]: 6.49999e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.00011886 [with_stream_mark]: 9.49999e-06 [recompute_prepare]: 5.75001e-06 [updatestate_depend_eliminate]: 2.88e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.55001e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 5.12e-06 [merge_forward]: 3.12002e-06 [cell_reuse_recompute_pass]: 1.86998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 5.56e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.06997e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 5.58002e-06 [cse]: 1.05e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 9.74999e-06 [rewriter_after_opt_a]: 3.053e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00057801 [jit_opt_b]: 5.303e-05, [1] [Cycle 1]: 4.578e-05, [2] [frontend_op_eliminate]: 1.834e-05 [inline_after_opt_a]: 1.719e-05 [cconv]: 2.439e-05 [loop_unroll]: 0.00045623 [jit_opt_after_cconv]: 0.00014889, [1] [Cycle 1]: 0.00014207, [11] [c_1]: 2.546e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.59998e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 2.144e-05 [call_graph_tuple_transform]: 1.974e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.94999e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.474e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 8.20999e-06 [add_recomputation]: 4.52e-05 [cse_after_recomputation]: 2.137e-05, [1] [Cycle 1]: 1.6e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.473e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.13999e-06 [opt_after_jit_grad]: 0.00044794 [symbol_engine_optimizer]: 7.067e-05, [1] [Cycle 1]: 6.471e-05, [6] [build]: 2.91e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 8.64e-06 [renormalize]: 2.80008e-07 [validate]: 5.033e-05 Sums bootstrap : 0.000272s : 0.48% type_inference : 0.051509s : 90.04% event_method : 0.000018s : 0.03% auto_monad : 0.000064s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000333s : 0.58% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000746s : 1.30% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001915s : 3.35% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000037s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000031s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000578s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000456s : 0.80% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000448s : 0.78% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.09% Time group info: ------[substitution.] 0.000251 24 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.25% : 0.000006s : 4: substitution.graph_param_transform 86.87% : 0.000218s : 4: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.54% : 0.000004s : 2: substitution.replace_old_param 4.90% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051440 2 96.31% : 0.049542s : 1: type_inference.infer 3.69% : 0.001898s : 1: type_inference.specialize ------[replace.] 0.000072 6 69.07% : 0.000049s : 4: replace.inline 30.93% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 6 95.06% : 0.000215s : 4: match.inline 4.94% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000002s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.31% : 0.000002s : 12: predicate.depend_value_elim 1.22% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.95% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.50% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 2.33% : 0.000003s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.86% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002184 26 71.85% : 0.001569s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.57% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.59% : 0.000581s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063910 72 0.08% : 0.000048s : 1: add_recomputation 0.11% : 0.000067s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.44% : 0.000284s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.21% : 0.006526s : 1: jit_opt_a 0.24% : 0.000152s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.73% : 0.000465s : 1: loop_unroll 0.92% : 0.000586s : 1: mutable_eliminate 1.52% : 0.000971s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.53% : 0.000341s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.05% : 0.001311s : 1: renormalize.infer 0.93% : 0.000594s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.11% : 0.000073s : 1: symbol_engine_optimizer 80.61% : 0.051521s : 1: type_inference TotalTime = 0.0606126, [30] [bootstrap]: 0.00029495 [type_inference]: 0.0512951 [event_method]: 1.952e-05 [auto_monad]: 6.936e-05 [graph_reusing]: 6.16e-06 [pre_auto_parallel]: 2.69001e-06 [py_interpret_to_execute]: 0.00026397 [rewriter_before_opt_a]: 8.148e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00651329, [2] [Cycle 1]: 0.0029084, [27] [switch_simplify]: 5.077e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00054222 [with_stream_mark]: 1.762e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 4.13001e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.66999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.07001e-06 [inline_without_move]: 5.76003e-06 [renormalize]: 0.0019422 [add_forward_monad_depend]: 5.30999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.491e-05 [cse]: 3.111e-05 [replace_applicator]: 1.45e-05 [Cycle 2]: 0.00034587, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.53002e-06 [a_1]: 0.00011682 [with_stream_mark]: 8.36002e-06 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.33002e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.316e-05 [j_node_and_user_rematch]: 8.43999e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 7.48999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 8.90024e-07 [auto_monad_eliminator]: 5.57999e-06 [cse]: 1.112e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 8.99e-06 [rewriter_after_opt_a]: 3.24e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00049911 [jit_opt_b]: 5.255e-05, [1] [Cycle 1]: 4.587e-05, [2] [frontend_op_eliminate]: 1.786e-05 [inline_after_opt_a]: 1.679e-05 [cconv]: 2.374e-05 [loop_unroll]: 0.00042132 [jit_opt_after_cconv]: 0.00014663, [1] [Cycle 1]: 0.00014052, [11] [c_1]: 2.431e-05 [parameter_eliminate]: 2.55002e-06 [updatestate_depend_eliminate]: 5.47999e-06 [updatestate_assign_eliminate]: 2.87002e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 2.007e-05 [call_graph_tuple_transform]: 2.031e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.415e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 7.26001e-06 [add_recomputation]: 4.565e-05 [cse_after_recomputation]: 2.072e-05, [1] [Cycle 1]: 1.591e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.54e-05 [get_jit_bprop_graph]: 2.27999e-06 [rewriter_after_jit_bprop_graph]: 4.26001e-06 [opt_after_jit_grad]: 0.00045779 [symbol_engine_optimizer]: 7.091e-05, [1] [Cycle 1]: 6.525e-05, [6] [build]: 2.78e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.249e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 3.69997e-07 [validate]: 5.027e-05 Sums bootstrap : 0.000295s : 0.52% type_inference : 0.051295s : 90.32% event_method : 0.000020s : 0.03% auto_monad : 0.000069s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000264s : 0.46% rewriter_before_opt_a : 0.000081s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000659s : 1.16% jit_opt_a.with_stream_mark : 0.000026s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001942s : 3.42% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000499s : 0.88% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000421s : 0.74% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000458s : 0.81% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.09% Time group info: ------[substitution.] 0.000191 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000005s : 4: substitution.graph_param_transform 83.55% : 0.000160s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000004s : 2: substitution.replace_old_param 6.10% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051222 2 96.44% : 0.049397s : 1: type_inference.infer 3.56% : 0.001826s : 1: type_inference.specialize ------[replace.] 0.000069 6 65.51% : 0.000045s : 4: replace.inline 34.49% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.71% : 0.000157s : 4: match.inline 6.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.41% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.18% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.74% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.60% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.65% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.81% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.91% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002111 26 72.08% : 0.001522s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.83% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.09% : 0.000551s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063492 72 0.08% : 0.000049s : 1: add_recomputation 0.11% : 0.000073s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.49% : 0.000314s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.26% : 0.006516s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.68% : 0.000430s : 1: loop_unroll 0.80% : 0.000507s : 1: mutable_eliminate 1.38% : 0.000879s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000270s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 2.04% : 0.001292s : 1: renormalize.infer 1.01% : 0.000641s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000035s : 1: rewriter_after_opt_a 0.14% : 0.000086s : 1: rewriter_before_opt_a 0.12% : 0.000073s : 1: symbol_engine_optimizer 80.82% : 0.051313s : 1: type_inference TotalTime = 0.115415, [30] [bootstrap]: 0.00026145 [type_inference]: 0.105145 [event_method]: 2.31e-05 [auto_monad]: 6.762e-05 [graph_reusing]: 4.85001e-06 [pre_auto_parallel]: 2.04999e-06 [py_interpret_to_execute]: 0.00050848 [rewriter_before_opt_a]: 9.151e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00719284, [2] [Cycle 1]: 0.00372658, [27] [switch_simplify]: 5.391e-05 [loop_unroll]: 3.431e-05 [a_1]: 0.00064433 [with_stream_mark]: 1.421e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 6.84999e-06 [updatestate_useless_node_eliminater]: 5.96998e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 8.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 9.50001e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00266917 [add_forward_monad_depend]: 5.20999e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.281e-05 [cse]: 2.227e-05 [replace_applicator]: 1.367e-05 [Cycle 2]: 0.0003692, [27] [switch_simplify]: 7.48e-06 [loop_unroll]: 6.25002e-06 [a_1]: 0.00012637 [with_stream_mark]: 9.89999e-06 [recompute_prepare]: 6.34999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.222e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.26997e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.61003e-06 [cse]: 1.319e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 1.032e-05 [rewriter_after_opt_a]: 3.264e-05 [convert_after_rewriter]: 5.99e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00055407 [jit_opt_b]: 6.039e-05, [1] [Cycle 1]: 5.414e-05, [2] [frontend_op_eliminate]: 1.812e-05 [inline_after_opt_a]: 2.5e-05 [cconv]: 2.174e-05 [loop_unroll]: 0.00043374 [jit_opt_after_cconv]: 0.00014898, [1] [Cycle 1]: 0.00014282, [11] [c_1]: 2.504e-05 [parameter_eliminate]: 2.31998e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.27001e-06 [cse]: 2.178e-05 [call_graph_tuple_transform]: 2.025e-05 [tuple_list_get_item_eliminator]: 6.28e-06 [none_parameter_eliminate]: 1.24e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.364e-05 [partial_unused_args_eliminate]: 1.79e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 4.092e-05 [cse_after_recomputation]: 2.358e-05, [1] [Cycle 1]: 1.808e-05, [1] [cse]: 1.278e-05 [auto_monad_reorder]: 1.421e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 4.20999e-06 [opt_after_jit_grad]: 0.00045857 [symbol_engine_optimizer]: 7.672e-05, [1] [Cycle 1]: 7.062e-05, [6] [build]: 2.66999e-06 [elim_shapecalc]: 8.31002e-06 [elim_not_effective]: 1.399e-05 [opt_reshape]: 6.46999e-06 [fold_const_symbol]: 1.079e-05 [renormalize]: 3.89991e-07 [validate]: 3.749e-05 Sums bootstrap : 0.000261s : 0.23% type_inference : 0.105145s : 94.08% event_method : 0.000023s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000508s : 0.45% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000771s : 0.69% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002669s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000554s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000025s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000434s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000459s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000225 28 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.18% : 0.000005s : 4: substitution.graph_param_transform 82.77% : 0.000186s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.35% : 0.000010s : 3: substitution.reduce_eliminate 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 1.54% : 0.000003s : 2: substitution.replace_old_param 4.35% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105081 2 97.27% : 0.102214s : 1: type_inference.infer 2.73% : 0.002866s : 1: type_inference.specialize ------[replace.] 0.000097 7 68.79% : 0.000067s : 5: replace.inline 31.21% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 7 95.54% : 0.000183s : 5: match.inline 4.46% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 2.31% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.34% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.34% : 0.000002s : 13: predicate.environ_get_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.06% : 0.000007s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.70% : 0.000001s : 4: predicate.opt_reshape 2.41% : 0.000003s : 19: predicate.partial_eliminate 1.25% : 0.000002s : 13: predicate.print_const_string_wrapper 2.03% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 13: predicate.reshape_eliminate 1.30% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.72% : 0.000011s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.45% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002212 25 62.70% : 0.001387s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.51% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.79% : 0.000770s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119175 72 0.04% : 0.000044s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000273s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.04% : 0.007196s : 1: jit_opt_a 0.13% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.37% : 0.000441s : 1: loop_unroll 0.47% : 0.000561s : 1: mutable_eliminate 0.84% : 0.001002s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000037s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000516s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.56% : 0.001853s : 1: renormalize.infer 0.68% : 0.000808s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.24% : 0.105161s : 1: type_inference TotalTime = 0.0145466, [30] [bootstrap]: 0.00029241 [type_inference]: 0.00723838 [event_method]: 1.865e-05 [auto_monad]: 5.82e-05 [graph_reusing]: 5.08002e-06 [pre_auto_parallel]: 1.95001e-06 [py_interpret_to_execute]: 3.684e-05 [rewriter_before_opt_a]: 7.57e-05 [expand_dump_flag]: 2.55002e-06 [jit_opt_a]: 0.00484984, [2] [Cycle 1]: 0.00160491, [27] [switch_simplify]: 4.902e-05 [loop_unroll]: 3.25e-05 [a_1]: 0.00058481 [with_stream_mark]: 1.436e-05 [recompute_prepare]: 8.13001e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.38002e-06 [parameter_eliminate]: 1.51998e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.99e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 8.90024e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.161e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 8.17998e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.00062104 [add_forward_monad_depend]: 4.35e-06 [auto_monad_grad]: 1.36998e-06 [auto_monad_eliminator]: 1.09e-05 [cse]: 2.354e-05 [replace_applicator]: 1.102e-05 [Cycle 2]: 0.00032104, [27] [switch_simplify]: 5.97001e-06 [loop_unroll]: 4.82e-06 [a_1]: 9.422e-05 [with_stream_mark]: 8.40001e-06 [recompute_prepare]: 5.08002e-06 [updatestate_depend_eliminate]: 2.82002e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.49998e-06 [updatestate_useless_node_eliminater]: 4.94998e-06 [accelerated_algorithm]: 4.95999e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 1.60999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.04e-05 [j_node_and_user_rematch]: 7.94997e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 7.27002e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.63002e-06 [cse]: 1.308e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 9.57999e-06 [rewriter_after_opt_a]: 3.068e-05 [convert_after_rewriter]: 6.12999e-06 [order_py_execute_after_rewriter]: 4.02e-06 [mutable_eliminate]: 0.00047276 [jit_opt_b]: 4.825e-05, [1] [Cycle 1]: 4.213e-05, [2] [frontend_op_eliminate]: 1.517e-05 [inline_after_opt_a]: 1.585e-05 [cconv]: 1.837e-05 [loop_unroll]: 0.00039606 [jit_opt_after_cconv]: 0.00014056, [1] [Cycle 1]: 0.0001342, [11] [c_1]: 2.06e-05 [parameter_eliminate]: 3.22002e-06 [updatestate_depend_eliminate]: 5.77999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.192e-05 [call_graph_tuple_transform]: 1.666e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.309e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 4.79998e-06 [add_recomputation]: 4.011e-05 [cse_after_recomputation]: 2.359e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.243e-05 [auto_monad_reorder]: 1.31e-05 [get_jit_bprop_graph]: 1.56002e-06 [rewriter_after_jit_bprop_graph]: 4.08001e-06 [opt_after_jit_grad]: 0.0004331 [symbol_engine_optimizer]: 6.91e-05, [1] [Cycle 1]: 6.335e-05, [6] [build]: 2.76e-06 [elim_shapecalc]: 7.42998e-06 [elim_not_effective]: 1.215e-05 [opt_reshape]: 5.59998e-06 [fold_const_symbol]: 8.24002e-06 [renormalize]: 4.50003e-07 [validate]: 3.106e-05 Sums bootstrap : 0.000292s : 2.65% type_inference : 0.007238s : 65.66% event_method : 0.000019s : 0.17% auto_monad : 0.000058s : 0.53% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.33% rewriter_before_opt_a : 0.000076s : 0.69% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000055s : 0.50% jit_opt_a.loop_unroll : 0.000037s : 0.34% jit_opt_a.a_1 : 0.000679s : 6.16% jit_opt_a.with_stream_mark : 0.000023s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000621s : 5.63% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.15% jit_opt_a.cse : 0.000037s : 0.33% jit_opt_a.replace_applicator : 0.000016s : 0.15% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000031s : 0.28% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000473s : 4.29% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000018s : 0.17% loop_unroll : 0.000396s : 3.59% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000013s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000040s : 0.36% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000013s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000433s : 3.93% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.28% Time group info: ------[substitution.] 0.000211 27 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 1.74% : 0.000004s : 3: substitution.graph_param_transform 83.02% : 0.000175s : 5: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.33% : 0.000009s : 3: substitution.reduce_eliminate 1.87% : 0.000004s : 4: substitution.remove_not_recompute_node 1.56% : 0.000003s : 2: substitution.replace_old_param 4.68% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007188 2 88.21% : 0.006341s : 1: type_inference.infer 11.79% : 0.000848s : 1: type_inference.specialize ------[replace.] 0.000085 7 68.34% : 0.000058s : 5: replace.inline 31.66% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 7 95.19% : 0.000173s : 5: match.inline 4.81% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 747 1.32% : 0.000002s : 11: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 2.09% : 0.000002s : 11: predicate.arithmetic_simplify 1.26% : 0.000001s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000001s : 11: predicate.depend_value_elim 1.20% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000001s : 11: predicate.environ_get_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.28% : 0.000002s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.50% : 0.000006s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.25% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.53% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 11: predicate.merge_addn 1.16% : 0.000001s : 11: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000001s : 11: predicate.print_const_string_wrapper 1.93% : 0.000002s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 19: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 11: predicate.reshape_eliminate 1.18% : 0.000001s : 11: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.98% : 0.000009s : 59: predicate.switch_simplify 1.26% : 0.000001s : 11: predicate.tile_eliminate 1.75% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.74% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000728 16 51.00% : 0.000371s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.75% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.25% : 0.000300s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016075 72 0.27% : 0.000043s : 1: add_recomputation 0.38% : 0.000062s : 1: auto_monad 0.10% : 0.000016s : 1: auto_monad_reorder 1.91% : 0.000307s : 1: bootstrap 0.13% : 0.000021s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.19% : 0.004853s : 1: jit_opt_a 0.94% : 0.000152s : 1: jit_opt_after_cconv 0.32% : 0.000051s : 1: jit_opt_b 2.51% : 0.000403s : 1: loop_unroll 2.99% : 0.000481s : 1: mutable_eliminate 5.51% : 0.000886s : 26: opt.transform.jit_opt_a 0.28% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.74% : 0.000441s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000039s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000016s : 1: remove_dup_value 2.05% : 0.000330s : 1: renormalize.infer 1.77% : 0.000285s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000034s : 1: rewriter_after_opt_a 0.49% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000072s : 1: symbol_engine_optimizer 45.10% : 0.007250s : 1: type_inference TotalTime = 0.111585, [30] [bootstrap]: 0.00026514 [type_inference]: 0.101581 [event_method]: 1.873e-05 [auto_monad]: 6.304e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.01998e-06 [py_interpret_to_execute]: 0.00045974 [rewriter_before_opt_a]: 8.504e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.0068434, [2] [Cycle 1]: 0.00335372, [27] [switch_simplify]: 4.714e-05 [loop_unroll]: 3.086e-05 [a_1]: 0.00053544 [with_stream_mark]: 1.305e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.16997e-06 [specialize_transform]: 6.89001e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 2.85998e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.332e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00238636 [add_forward_monad_depend]: 5.81998e-06 [auto_monad_grad]: 1.30001e-06 [auto_monad_eliminator]: 1.362e-05 [cse]: 2.25e-05 [replace_applicator]: 4.408e-05 [Cycle 2]: 0.00039281, [27] [switch_simplify]: 7.31999e-06 [loop_unroll]: 5.71998e-06 [a_1]: 0.00013259 [with_stream_mark]: 1.122e-05 [recompute_prepare]: 6.42001e-06 [updatestate_depend_eliminate]: 2.86999e-06 [updatestate_assign_eliminate]: 2.63003e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 6.42001e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.63998e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.91998e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.503e-05 [j_node_and_user_rematch]: 9.91998e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.52999e-06 [inline_without_move]: 6.52001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.55001e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 7.35998e-06 [cse]: 1.284e-05 [replace_applicator]: 6.64999e-06 [py_interpret_to_execute_after_opt_a]: 9.17001e-06 [rewriter_after_opt_a]: 3.299e-05 [convert_after_rewriter]: 6.50002e-06 [order_py_execute_after_rewriter]: 2.129e-05 [mutable_eliminate]: 0.00060274 [jit_opt_b]: 6.053e-05, [1] [Cycle 1]: 5.375e-05, [2] [frontend_op_eliminate]: 2.198e-05 [inline_after_opt_a]: 1.98e-05 [cconv]: 2.075e-05 [loop_unroll]: 0.0004543 [jit_opt_after_cconv]: 0.00015781, [1] [Cycle 1]: 0.00015116, [11] [c_1]: 2.861e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.63002e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 2.113e-05 [call_graph_tuple_transform]: 2.151e-05 [tuple_list_get_item_eliminator]: 6.24001e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.61999e-06 [remove_dup_value]: 1.286e-05 [partial_unused_args_eliminate]: 1.78997e-06 [environ_conv]: 6.91001e-06 [add_recomputation]: 4.681e-05 [cse_after_recomputation]: 2.4e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.146e-05 [auto_monad_reorder]: 1.308e-05 [get_jit_bprop_graph]: 1.60001e-06 [rewriter_after_jit_bprop_graph]: 4.76002e-06 [opt_after_jit_grad]: 0.00049162 [symbol_engine_optimizer]: 8.262e-05, [1] [Cycle 1]: 7.65e-05, [6] [build]: 3.26999e-06 [elim_shapecalc]: 8.95999e-06 [elim_not_effective]: 1.692e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 1.106e-05 [renormalize]: 8.00006e-07 [validate]: 3.927e-05 Sums bootstrap : 0.000265s : 0.25% type_inference : 0.101581s : 94.13% event_method : 0.000019s : 0.02% auto_monad : 0.000063s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000460s : 0.43% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000668s : 0.62% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002386s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000051s : 0.05% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000021s : 0.02% mutable_eliminate : 0.000603s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000021s : 0.02% loop_unroll : 0.000454s : 0.42% jit_opt_after_cconv.c_1 : 0.000029s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000492s : 0.46% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000181 24 2.32% : 0.000004s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.98% : 0.000005s : 4: substitution.graph_param_transform 81.24% : 0.000147s : 4: substitution.inline 1.76% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.79% : 0.000005s : 4: substitution.remove_not_recompute_node 2.39% : 0.000004s : 2: substitution.replace_old_param 5.77% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101519 2 97.50% : 0.098980s : 1: type_inference.infer 2.50% : 0.002539s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.43% : 0.000048s : 4: replace.inline 32.57% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 93.91% : 0.000144s : 4: match.inline 6.09% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.14% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.51% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.81% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.91% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.41% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001984 22 65.85% : 0.001307s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.73% : 0.000649s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114992 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000066s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000276s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.95% : 0.006847s : 1: jit_opt_a 0.14% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.40% : 0.000463s : 1: loop_unroll 0.53% : 0.000611s : 1: mutable_eliminate 0.81% : 0.000926s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000035s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000500s : 1: opt_after_jit_grad 0.02% : 0.000024s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000466s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.50% : 0.001724s : 1: renormalize.infer 0.57% : 0.000655s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 88.35% : 0.101593s : 1: type_inference TotalTime = 0.114593, [30] [bootstrap]: 0.00029251 [type_inference]: 0.104571 [event_method]: 2.099e-05 [auto_monad]: 5.526e-05 [graph_reusing]: 4.02e-06 [pre_auto_parallel]: 1.69998e-06 [py_interpret_to_execute]: 0.00042291 [rewriter_before_opt_a]: 8.853e-05 [expand_dump_flag]: 3.25998e-06 [jit_opt_a]: 0.0069967, [2] [Cycle 1]: 0.00359658, [27] [switch_simplify]: 5.39e-05 [loop_unroll]: 3.475e-05 [a_1]: 0.00063161 [with_stream_mark]: 1.31e-05 [recompute_prepare]: 8.13999e-06 [updatestate_depend_eliminate]: 3.5e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 7.29001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 6.06998e-06 [renormalize]: 0.0025513 [add_forward_monad_depend]: 5.00001e-06 [auto_monad_grad]: 1.72001e-06 [auto_monad_eliminator]: 1.245e-05 [cse]: 2.224e-05 [replace_applicator]: 1.424e-05 [Cycle 2]: 0.00037685, [27] [switch_simplify]: 6.85998e-06 [loop_unroll]: 6.01998e-06 [a_1]: 0.00012722 [with_stream_mark]: 9.89001e-06 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 3.88001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.03001e-06 [specialize_transform]: 6.75002e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 6.87002e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 1.89999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.153e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20999e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.386e-05 [replace_applicator]: 6.32001e-06 [py_interpret_to_execute_after_opt_a]: 1.117e-05 [rewriter_after_opt_a]: 3.036e-05 [convert_after_rewriter]: 5.94e-06 [order_py_execute_after_rewriter]: 4.48999e-06 [mutable_eliminate]: 0.00051951 [jit_opt_b]: 5.271e-05, [1] [Cycle 1]: 4.674e-05, [2] [frontend_op_eliminate]: 1.865e-05 [inline_after_opt_a]: 1.772e-05 [cconv]: 1.955e-05 [loop_unroll]: 0.00042578 [jit_opt_after_cconv]: 0.00015066, [1] [Cycle 1]: 0.00014404, [11] [c_1]: 2.631e-05 [parameter_eliminate]: 2.43002e-06 [updatestate_depend_eliminate]: 5.47001e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.30002e-06 [cse]: 2.051e-05 [call_graph_tuple_transform]: 2.029e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.03001e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 7.06001e-06 [remove_dup_value]: 1.351e-05 [partial_unused_args_eliminate]: 1.55999e-06 [environ_conv]: 7.65998e-06 [add_recomputation]: 4.036e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.382e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 5.42001e-06 [opt_after_jit_grad]: 0.00048903 [symbol_engine_optimizer]: 7.614e-05, [1] [Cycle 1]: 7.049e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.464e-05 [opt_reshape]: 6.83998e-06 [fold_const_symbol]: 9.25001e-06 [renormalize]: 2.60014e-07 [validate]: 7.556e-05 Sums bootstrap : 0.000293s : 0.26% type_inference : 0.104571s : 94.20% event_method : 0.000021s : 0.02% auto_monad : 0.000055s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000423s : 0.38% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000759s : 0.68% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002551s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000520s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000426s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000040s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000489s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000076s : 0.07% Time group info: ------[substitution.] 0.000222 28 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000005s : 4: substitution.graph_param_transform 82.86% : 0.000184s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.20% : 0.000009s : 3: substitution.reduce_eliminate 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 1.64% : 0.000004s : 2: substitution.replace_old_param 4.16% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104504 2 97.30% : 0.101681s : 1: type_inference.infer 2.70% : 0.002823s : 1: type_inference.specialize ------[replace.] 0.000091 7 68.56% : 0.000062s : 5: replace.inline 31.44% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000189 7 95.72% : 0.000181s : 5: match.inline 4.28% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 13: predicate.addn_check_dump 1.37% : 0.000002s : 13: predicate.addn_zero_filter 2.22% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.39% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.24% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 28: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 19: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.91% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.14% : 0.000002s : 13: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 19: predicate.partial_eliminate 1.16% : 0.000002s : 13: predicate.print_const_string_wrapper 2.17% : 0.000003s : 13: predicate.reduce_eliminate 1.37% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.24% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.26% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 64: predicate.switch_simplify 1.69% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002166 25 63.08% : 0.001366s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.74% : 0.000059s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.18% : 0.000741s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118183 72 0.04% : 0.000043s : 1: add_recomputation 0.05% : 0.000058s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.26% : 0.000310s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.92% : 0.007000s : 1: jit_opt_a 0.13% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000433s : 1: loop_unroll 0.45% : 0.000528s : 1: mutable_eliminate 0.84% : 0.000995s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000429s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.54% : 0.001819s : 1: renormalize.infer 0.61% : 0.000724s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000033s : 1: rewriter_after_opt_a 0.08% : 0.000094s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 88.49% : 0.104584s : 1: type_inference TotalTime = 0.112131, [30] [bootstrap]: 0.00026849 [type_inference]: 0.102021 [event_method]: 1.941e-05 [auto_monad]: 5.049e-05 [graph_reusing]: 4.32998e-06 [pre_auto_parallel]: 1.91e-06 [py_interpret_to_execute]: 0.00052025 [rewriter_before_opt_a]: 8.056e-05 [expand_dump_flag]: 2.76e-06 [jit_opt_a]: 0.0069273, [2] [Cycle 1]: 0.00331019, [27] [switch_simplify]: 4.882e-05 [loop_unroll]: 3.095e-05 [a_1]: 0.0005232 [with_stream_mark]: 1.207e-05 [recompute_prepare]: 8.43001e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 1.46002e-06 [get_grad_eliminate_]: 6.21998e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 9.33002e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 0.00239051 [add_forward_monad_depend]: 4.95001e-06 [auto_monad_grad]: 1.57001e-06 [auto_monad_eliminator]: 1.225e-05 [cse]: 2.05e-05 [replace_applicator]: 1.361e-05 [Cycle 2]: 0.00035654, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 6.27001e-06 [a_1]: 0.00012084 [with_stream_mark]: 9.97999e-06 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 2.94001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.76998e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.80002e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.19998e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.469e-05 [j_node_and_user_rematch]: 8.63001e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.16997e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.76998e-06 [cse]: 1.081e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 8.55001e-06 [rewriter_after_opt_a]: 2.822e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.32998e-06 [mutable_eliminate]: 0.00054182 [jit_opt_b]: 5.941e-05, [1] [Cycle 1]: 5.169e-05, [2] [frontend_op_eliminate]: 2.06e-05 [inline_after_opt_a]: 1.826e-05 [cconv]: 1.825e-05 [loop_unroll]: 0.00043163 [jit_opt_after_cconv]: 0.00014628, [1] [Cycle 1]: 0.00013926, [11] [c_1]: 2.575e-05 [parameter_eliminate]: 2.48e-06 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.947e-05 [call_graph_tuple_transform]: 1.939e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 6.00002e-06 [remove_dup_value]: 9.77999e-06 [partial_unused_args_eliminate]: 1.76003e-06 [environ_conv]: 7.51001e-06 [add_recomputation]: 3.769e-05 [cse_after_recomputation]: 2.189e-05, [1] [Cycle 1]: 1.589e-05, [1] [cse]: 1.022e-05 [auto_monad_reorder]: 1.337e-05 [get_jit_bprop_graph]: 1.64998e-06 [rewriter_after_jit_bprop_graph]: 4e-06 [opt_after_jit_grad]: 0.0004802 [symbol_engine_optimizer]: 0.00016838, [1] [Cycle 1]: 0.00016192, [6] [build]: 3.33998e-06 [elim_shapecalc]: 8.37e-06 [elim_not_effective]: 1.623e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 9.845e-05 [renormalize]: 4.50003e-07 [validate]: 3.718e-05 Sums bootstrap : 0.000268s : 0.25% type_inference : 0.102021s : 94.23% event_method : 0.000019s : 0.02% auto_monad : 0.000050s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000520s : 0.48% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000644s : 0.59% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002391s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000542s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000432s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000480s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000098s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000163 24 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.03% : 0.000005s : 4: substitution.graph_param_transform 83.63% : 0.000136s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000003s : 2: substitution.replace_old_param 4.98% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101959 2 97.46% : 0.099368s : 1: type_inference.infer 2.54% : 0.002591s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.41% : 0.000045s : 4: replace.inline 33.59% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 95.07% : 0.000134s : 4: match.inline 4.93% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000002s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.36% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.07% : 0.000003s : 18: predicate.load_eliminater 1.58% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.14% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001984 22 64.08% : 0.001272s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.39% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.54% : 0.000685s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115522 72 0.03% : 0.000040s : 1: add_recomputation 0.05% : 0.000054s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000284s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.00% : 0.006930s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.38% : 0.000439s : 1: loop_unroll 0.48% : 0.000550s : 1: mutable_eliminate 0.75% : 0.000866s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000126s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000528s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.44% : 0.001660s : 1: renormalize.infer 0.63% : 0.000722s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.15% : 0.000171s : 1: symbol_engine_optimizer 88.33% : 0.102036s : 1: type_inference TotalTime = 0.0113686, [30] [bootstrap]: 0.00024727 [type_inference]: 0.00412734 [event_method]: 1.686e-05 [auto_monad]: 4.977e-05 [graph_reusing]: 4.32e-06 [pre_auto_parallel]: 1.55999e-06 [py_interpret_to_execute]: 3.915e-05 [rewriter_before_opt_a]: 6.852e-05 [expand_dump_flag]: 2.34001e-06 [jit_opt_a]: 0.00479806, [2] [Cycle 1]: 0.00142553, [27] [switch_simplify]: 4.481e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00049585 [with_stream_mark]: 1.282e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 6.14999e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 1.41002e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.132e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 0.00055241 [add_forward_monad_depend]: 4.00998e-06 [auto_monad_grad]: 1.59998e-06 [auto_monad_eliminator]: 1.098e-05 [cse]: 1.765e-05 [replace_applicator]: 1.078e-05 [Cycle 2]: 0.00031629, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 4.89e-06 [a_1]: 9.111e-05 [with_stream_mark]: 8.48999e-06 [recompute_prepare]: 4.94e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.57998e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.49998e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.131e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.007e-05 [rewriter_after_opt_a]: 9.945e-05 [convert_after_rewriter]: 6.89999e-06 [order_py_execute_after_rewriter]: 4.05e-06 [mutable_eliminate]: 0.00050772 [jit_opt_b]: 4.719e-05, [1] [Cycle 1]: 4.169e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.572e-05 [cconv]: 1.575e-05 [loop_unroll]: 0.00042145 [jit_opt_after_cconv]: 0.00013514, [1] [Cycle 1]: 0.00012899, [11] [c_1]: 2.198e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.43002e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 1.705e-05 [call_graph_tuple_transform]: 1.627e-05 [tuple_list_get_item_eliminator]: 5.30999e-06 [none_parameter_eliminate]: 1.10999e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.40999e-06 [remove_dup_value]: 8.37e-06 [partial_unused_args_eliminate]: 1.34e-06 [environ_conv]: 3.74002e-06 [add_recomputation]: 3.17e-05 [cse_after_recomputation]: 2.005e-05, [1] [Cycle 1]: 1.488e-05, [1] [cse]: 9.56e-06 [auto_monad_reorder]: 9.89001e-06 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.05998e-06 [opt_after_jit_grad]: 0.0004379 [symbol_engine_optimizer]: 6.851e-05, [1] [Cycle 1]: 6.263e-05, [6] [build]: 2.83998e-06 [elim_shapecalc]: 7.61999e-06 [elim_not_effective]: 1.214e-05 [opt_reshape]: 5.48002e-06 [fold_const_symbol]: 7.68001e-06 [renormalize]: 3.39991e-07 [validate]: 2.511e-05 Sums bootstrap : 0.000247s : 3.18% type_inference : 0.004127s : 53.12% event_method : 0.000017s : 0.22% auto_monad : 0.000050s : 0.64% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.50% rewriter_before_opt_a : 0.000069s : 0.88% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000050s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000587s : 7.55% jit_opt_a.with_stream_mark : 0.000021s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000552s : 7.11% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000029s : 0.37% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.13% rewriter_after_opt_a : 0.000099s : 1.28% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000508s : 6.53% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000016s : 0.20% loop_unroll : 0.000421s : 5.42% jit_opt_after_cconv.c_1 : 0.000022s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000032s : 0.41% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000438s : 5.64% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000025s : 0.32% Time group info: ------[substitution.] 0.000166 23 0.82% : 0.000001s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000004s : 3: substitution.graph_param_transform 84.90% : 0.000141s : 4: substitution.inline 1.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 5.06% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004076 2 81.15% : 0.003308s : 1: type_inference.infer 18.85% : 0.000769s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.20% : 0.000044s : 4: replace.inline 32.80% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000146 6 95.00% : 0.000139s : 4: match.inline 5.00% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.34% : 0.000002s : 10: predicate.accumulaten_eliminater 1.25% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.76% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.36% : 0.000002s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.14% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.68% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.75% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.33% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.25% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.39% : 0.000008s : 53: predicate.switch_simplify 1.32% : 0.000001s : 10: predicate.tile_eliminate 1.32% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.45% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000573 13 48.94% : 0.000281s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.45% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.62% : 0.000262s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012776 72 0.27% : 0.000034s : 1: add_recomputation 0.42% : 0.000053s : 1: auto_monad 0.10% : 0.000012s : 1: auto_monad_reorder 2.04% : 0.000260s : 1: bootstrap 0.14% : 0.000018s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000022s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.58% : 0.004801s : 1: jit_opt_a 1.08% : 0.000138s : 1: jit_opt_after_cconv 0.39% : 0.000050s : 1: jit_opt_b 3.36% : 0.000429s : 1: loop_unroll 4.04% : 0.000516s : 1: mutable_eliminate 6.15% : 0.000785s : 26: opt.transform.jit_opt_a 0.36% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.49% : 0.000446s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.33% : 0.000042s : 1: py_interpret_to_execute 0.10% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000011s : 1: remove_dup_value 2.14% : 0.000274s : 1: renormalize.infer 2.13% : 0.000272s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.81% : 0.000103s : 1: rewriter_after_opt_a 0.56% : 0.000072s : 1: rewriter_before_opt_a 0.56% : 0.000071s : 1: symbol_engine_optimizer 32.40% : 0.004139s : 1: type_inference TotalTime = 0.11688, [30] [bootstrap]: 0.00027645 [type_inference]: 0.106782 [event_method]: 2.171e-05 [auto_monad]: 6.786e-05 [graph_reusing]: 6.01e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.00048174 [rewriter_before_opt_a]: 9.226e-05 [expand_dump_flag]: 3.15002e-06 [jit_opt_a]: 0.00707455, [2] [Cycle 1]: 0.00360328, [27] [switch_simplify]: 7.95e-05 [loop_unroll]: 3.433e-05 [a_1]: 0.00063875 [with_stream_mark]: 1.382e-05 [recompute_prepare]: 9.04e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.64001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 7.67002e-06 [updatestate_useless_node_eliminater]: 6.62002e-06 [accelerated_algorithm]: 6.89999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 2.96999e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 1.045e-05 [inline_without_move]: 6.69001e-06 [renormalize]: 0.00251103 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 1.39998e-06 [auto_monad_eliminator]: 1.139e-05 [cse]: 2.261e-05 [replace_applicator]: 1.3e-05 [Cycle 2]: 0.0003702, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 5.91998e-06 [a_1]: 0.0001299 [with_stream_mark]: 9.53002e-06 [recompute_prepare]: 6.34001e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.50002e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.122e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 1.81998e-06 [replace_old_param]: 8.52998e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.369e-05 [replace_applicator]: 6.81999e-06 [py_interpret_to_execute_after_opt_a]: 9.97001e-06 [rewriter_after_opt_a]: 3.22e-05 [convert_after_rewriter]: 3.364e-05 [order_py_execute_after_rewriter]: 4.43001e-06 [mutable_eliminate]: 0.00051058 [jit_opt_b]: 5.52e-05, [1] [Cycle 1]: 4.831e-05, [2] [frontend_op_eliminate]: 1.871e-05 [inline_after_opt_a]: 1.753e-05 [cconv]: 2.899e-05 [loop_unroll]: 0.0004202 [jit_opt_after_cconv]: 0.0001467, [1] [Cycle 1]: 0.00014062, [11] [c_1]: 2.648e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.009e-05 [call_graph_tuple_transform]: 1.784e-05 [tuple_list_get_item_eliminator]: 6.59999e-06 [none_parameter_eliminate]: 1.07998e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.00002e-06 [remove_dup_value]: 1.086e-05 [partial_unused_args_eliminate]: 1.57001e-06 [environ_conv]: 5.86e-06 [add_recomputation]: 3.64e-05 [cse_after_recomputation]: 2.341e-05, [1] [Cycle 1]: 1.852e-05, [1] [cse]: 1.209e-05 [auto_monad_reorder]: 1.325e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 4.28999e-06 [opt_after_jit_grad]: 0.00045671 [symbol_engine_optimizer]: 7.589e-05, [1] [Cycle 1]: 7.013e-05, [6] [build]: 2.52001e-06 [elim_shapecalc]: 1.005e-05 [elim_not_effective]: 1.407e-05 [opt_reshape]: 6.29999e-06 [fold_const_symbol]: 1.019e-05 [renormalize]: 2.79979e-07 [validate]: 3.391e-05 Sums bootstrap : 0.000276s : 0.24% type_inference : 0.106782s : 94.32% event_method : 0.000022s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000482s : 0.43% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000086s : 0.08% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000769s : 0.68% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002511s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000034s : 0.03% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000511s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000420s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000457s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000216 28 1.47% : 0.000003s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.79% : 0.000004s : 4: substitution.graph_param_transform 83.78% : 0.000181s : 5: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.23% : 0.000009s : 3: substitution.reduce_eliminate 1.88% : 0.000004s : 4: substitution.remove_not_recompute_node 1.95% : 0.000004s : 2: substitution.replace_old_param 3.19% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106707 2 97.25% : 0.103771s : 1: type_inference.infer 2.75% : 0.002936s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.09% : 0.000063s : 5: replace.inline 31.91% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 7 96.89% : 0.000178s : 5: match.inline 3.11% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.29% : 0.000002s : 13: predicate.accumulaten_eliminater 0.89% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 1.87% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.66% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.47% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.24% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.13% : 0.000007s : 28: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 19: predicate.load_eliminater 1.10% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.17% : 0.000002s : 13: predicate.minmaximum_grad 1.21% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 19: predicate.partial_eliminate 1.24% : 0.000002s : 13: predicate.print_const_string_wrapper 2.08% : 0.000003s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.38% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 20: predicate.switch_defer_inline 2.25% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 64: predicate.switch_simplify 1.63% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.50% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002204 25 63.38% : 0.001397s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.60% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.01% : 0.000750s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120505 72 0.03% : 0.000039s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000289s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.03% : 0.000037s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.87% : 0.007078s : 1: jit_opt_a 0.12% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000428s : 1: loop_unroll 0.43% : 0.000520s : 1: mutable_eliminate 0.85% : 0.001030s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.49% : 0.001795s : 1: renormalize.infer 0.59% : 0.000709s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.62% : 0.106796s : 1: type_inference TotalTime = 0.0149075, [30] [bootstrap]: 0.00030908 [type_inference]: 0.00731556 [event_method]: 1.938e-05 [auto_monad]: 6.829e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 3.986e-05 [rewriter_before_opt_a]: 7.986e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.0050754, [2] [Cycle 1]: 0.00170254, [27] [switch_simplify]: 5.623e-05 [loop_unroll]: 3.292e-05 [a_1]: 0.00060043 [with_stream_mark]: 1.815e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.3e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.373e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.63001e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 0.00067285 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.43e-05 [cse]: 3.391e-05 [replace_applicator]: 1.156e-05 [Cycle 2]: 0.00032329, [27] [switch_simplify]: 5.76e-06 [loop_unroll]: 5.25001e-06 [a_1]: 9.563e-05 [with_stream_mark]: 9.20999e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.05999e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.042e-05 [j_node_and_user_rematch]: 8.10999e-06 [meta_fg_expand]: 1.45999e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 5.04e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.29e-06 [cse]: 1.356e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 9.17001e-06 [rewriter_after_opt_a]: 3.468e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00047758 [jit_opt_b]: 5.051e-05, [1] [Cycle 1]: 4.319e-05, [2] [frontend_op_eliminate]: 1.609e-05 [inline_after_opt_a]: 1.539e-05 [cconv]: 2.471e-05 [loop_unroll]: 0.00040195 [jit_opt_after_cconv]: 0.00014877, [1] [Cycle 1]: 0.0001422, [11] [c_1]: 2.041e-05 [parameter_eliminate]: 2.48002e-06 [updatestate_depend_eliminate]: 5.71003e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.097e-05 [call_graph_tuple_transform]: 1.763e-05 [tuple_list_get_item_eliminator]: 5.63002e-06 [none_parameter_eliminate]: 1.44998e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.70001e-06 [remove_dup_value]: 1.629e-05 [partial_unused_args_eliminate]: 2.36998e-06 [environ_conv]: 5.29e-06 [add_recomputation]: 4.764e-05 [cse_after_recomputation]: 2.307e-05, [1] [Cycle 1]: 1.768e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.646e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 4.08999e-06 [opt_after_jit_grad]: 0.00044315 [symbol_engine_optimizer]: 7.032e-05, [1] [Cycle 1]: 6.439e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 7.22997e-06 [elim_not_effective]: 1.248e-05 [opt_reshape]: 5.40001e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 4.00003e-07 [validate]: 3.475e-05 Sums bootstrap : 0.000309s : 2.74% type_inference : 0.007316s : 64.80% event_method : 0.000019s : 0.17% auto_monad : 0.000068s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000040s : 0.35% rewriter_before_opt_a : 0.000080s : 0.71% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000062s : 0.55% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000696s : 6.17% jit_opt_a.with_stream_mark : 0.000027s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000673s : 5.96% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.17% jit_opt_a.cse : 0.000047s : 0.42% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000035s : 0.31% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000478s : 4.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.14% cconv : 0.000025s : 0.22% loop_unroll : 0.000402s : 3.56% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000048s : 0.42% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000443s : 3.93% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.31% Time group info: ------[substitution.] 0.000225 27 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.15% : 0.000005s : 3: substitution.graph_param_transform 82.53% : 0.000186s : 5: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.22% : 0.000010s : 3: substitution.reduce_eliminate 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.81% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007254 2 87.35% : 0.006337s : 1: type_inference.infer 12.65% : 0.000917s : 1: type_inference.specialize ------[replace.] 0.000083 7 67.97% : 0.000057s : 5: replace.inline 32.03% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 7 94.91% : 0.000183s : 5: match.inline 5.09% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.42% : 0.000002s : 11: predicate.addn_zero_filter 2.03% : 0.000002s : 11: predicate.arithmetic_simplify 1.24% : 0.000001s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000001s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.32% : 0.000002s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.95% : 0.000007s : 24: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.94% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 16: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 11: predicate.merge_addn 1.18% : 0.000001s : 11: predicate.minmaximum_grad 1.38% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.36% : 0.000003s : 16: predicate.partial_eliminate 1.22% : 0.000001s : 11: predicate.print_const_string_wrapper 2.03% : 0.000002s : 11: predicate.reduce_eliminate 1.53% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.41% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 11: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 59: predicate.switch_simplify 1.29% : 0.000002s : 11: predicate.tile_eliminate 1.40% : 0.000002s : 11: predicate.transpose_eliminate 1.47% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.72% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000744 16 50.53% : 0.000376s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.56% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.91% : 0.000312s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016550 72 0.31% : 0.000051s : 1: add_recomputation 0.43% : 0.000072s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 1.97% : 0.000327s : 1: bootstrap 0.16% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.68% : 0.005078s : 1: jit_opt_a 0.91% : 0.000151s : 1: jit_opt_after_cconv 0.32% : 0.000053s : 1: jit_opt_b 2.47% : 0.000410s : 1: loop_unroll 2.94% : 0.000487s : 1: mutable_eliminate 5.49% : 0.000909s : 26: opt.transform.jit_opt_a 0.28% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.12% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000452s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000042s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.27% : 0.000376s : 1: renormalize.infer 1.75% : 0.000290s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000038s : 1: rewriter_after_opt_a 0.50% : 0.000083s : 1: rewriter_before_opt_a 0.44% : 0.000073s : 1: symbol_engine_optimizer 44.28% : 0.007328s : 1: type_inference TotalTime = 0.113716, [30] [bootstrap]: 0.0002714 [type_inference]: 0.102978 [event_method]: 1.677e-05 [auto_monad]: 5.748e-05 [graph_reusing]: 4.99e-06 [pre_auto_parallel]: 2.05002e-06 [py_interpret_to_execute]: 0.0004378 [rewriter_before_opt_a]: 8.785e-05 [expand_dump_flag]: 3.35998e-06 [jit_opt_a]: 0.00728932, [2] [Cycle 1]: 0.0036997, [27] [switch_simplify]: 5.494e-05 [loop_unroll]: 3.06e-05 [a_1]: 0.00060147 [with_stream_mark]: 2.017e-05 [recompute_prepare]: 9.64999e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 2.51e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 2.25002e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 9.76003e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.79e-06 [inline_without_move]: 6.41e-06 [renormalize]: 0.0026514 [add_forward_monad_depend]: 6.11e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.607e-05 [cse]: 2.38e-05 [replace_applicator]: 1.657e-05 [Cycle 2]: 0.00043847, [27] [switch_simplify]: 6.88e-06 [loop_unroll]: 6.21998e-06 [a_1]: 0.00012309 [with_stream_mark]: 6.761e-05 [recompute_prepare]: 6.55002e-06 [updatestate_depend_eliminate]: 3.31001e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.61001e-06 [cell_reuse_recompute_pass]: 2.32999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.778e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 9.70002e-06 [inline_without_move]: 5.96e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 1.09e-06 [auto_monad_eliminator]: 7.42002e-06 [cse]: 1.422e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.404e-05 [rewriter_after_opt_a]: 3.912e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 1.792e-05 [mutable_eliminate]: 0.00072723 [jit_opt_b]: 5.69e-05, [1] [Cycle 1]: 4.989e-05, [2] [frontend_op_eliminate]: 2.019e-05 [inline_after_opt_a]: 1.91e-05 [cconv]: 2.579e-05 [loop_unroll]: 0.00045959 [jit_opt_after_cconv]: 0.00015232, [1] [Cycle 1]: 0.00014537, [11] [c_1]: 2.626e-05 [parameter_eliminate]: 2.64999e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.062e-05 [call_graph_tuple_transform]: 2.118e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.85001e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 7.18e-06 [remove_dup_value]: 1.509e-05 [partial_unused_args_eliminate]: 2.50002e-06 [environ_conv]: 8.25999e-06 [add_recomputation]: 4.978e-05 [cse_after_recomputation]: 2.313e-05, [1] [Cycle 1]: 1.783e-05, [1] [cse]: 1.169e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 8.18001e-06 [opt_after_jit_grad]: 0.0005431 [symbol_engine_optimizer]: 0.00017341, [1] [Cycle 1]: 0.00016571, [6] [build]: 4.74e-06 [elim_shapecalc]: 9.82001e-06 [elim_not_effective]: 1.721e-05 [opt_reshape]: 6.94001e-06 [fold_const_symbol]: 9.97999e-06 [renormalize]: 5.39992e-07 [validate]: 4.52e-05 Sums bootstrap : 0.000271s : 0.25% type_inference : 0.102978s : 93.71% event_method : 0.000017s : 0.02% auto_monad : 0.000057s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000438s : 0.40% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000725s : 0.66% jit_opt_a.with_stream_mark : 0.000088s : 0.08% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002651s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000039s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000018s : 0.02% mutable_eliminate : 0.000727s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000460s : 0.42% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000543s : 0.49% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000222 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 4: substitution.graph_param_transform 83.88% : 0.000186s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000006s : 4: substitution.remove_not_recompute_node 2.44% : 0.000005s : 2: substitution.replace_old_param 5.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102912 2 97.49% : 0.100333s : 1: type_inference.infer 2.51% : 0.002579s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.20% : 0.000053s : 4: replace.inline 32.80% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.30% : 0.000184s : 4: match.inline 5.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.39% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000003s : 12: predicate.arithmetic_simplify 1.42% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.43% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.36% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 12: predicate.reshape_eliminate 1.14% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.12% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.73% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.57% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002043 22 63.54% : 0.001298s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.24% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.23% : 0.000699s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117419 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000286s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.21% : 0.007293s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.40% : 0.000468s : 1: loop_unroll 0.63% : 0.000737s : 1: mutable_eliminate 0.82% : 0.000966s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000031s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000554s : 1: opt_after_jit_grad 0.02% : 0.000020s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000446s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.58% : 0.001856s : 1: renormalize.infer 0.67% : 0.000785s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.15% : 0.000176s : 1: symbol_engine_optimizer 87.71% : 0.102991s : 1: type_inference TotalTime = 0.0616281, [30] [bootstrap]: 0.00027199 [type_inference]: 0.0523316 [event_method]: 1.831e-05 [auto_monad]: 6.454e-05 [graph_reusing]: 6.42001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00027672 [rewriter_before_opt_a]: 8.149e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00647216, [2] [Cycle 1]: 0.00286158, [27] [switch_simplify]: 5.303e-05 [loop_unroll]: 3.075e-05 [a_1]: 0.00054899 [with_stream_mark]: 1.616e-05 [recompute_prepare]: 8.48999e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 3.53999e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 5.66998e-06 [accelerated_algorithm]: 6.23998e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.531e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.90002e-06 [replace_old_param]: 9.41998e-06 [inline_without_move]: 6.16998e-06 [renormalize]: 0.00187795 [add_forward_monad_depend]: 5.96e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.535e-05 [cse]: 3.027e-05 [replace_applicator]: 1.373e-05 [Cycle 2]: 0.00039766, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00011886 [with_stream_mark]: 9.47001e-06 [recompute_prepare]: 5.59998e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 5.304e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 8.43999e-06 [inline_without_move]: 5.60001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.88998e-06 [cse]: 1.266e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 9.93002e-06 [rewriter_after_opt_a]: 3.401e-05 [convert_after_rewriter]: 6.56999e-06 [order_py_execute_after_rewriter]: 5.81998e-06 [mutable_eliminate]: 0.00053974 [jit_opt_b]: 5.5e-05, [1] [Cycle 1]: 4.808e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.784e-05 [cconv]: 2.376e-05 [loop_unroll]: 0.0004208 [jit_opt_after_cconv]: 0.00014548, [1] [Cycle 1]: 0.00013947, [11] [c_1]: 2.587e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.20001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 1.876e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.49999e-06 [remove_dup_value]: 1.52e-05 [partial_unused_args_eliminate]: 1.96998e-06 [environ_conv]: 6.81001e-06 [add_recomputation]: 4.595e-05 [cse_after_recomputation]: 2.134e-05, [1] [Cycle 1]: 1.631e-05, [1] [cse]: 1.078e-05 [auto_monad_reorder]: 1.489e-05 [get_jit_bprop_graph]: 2.34001e-06 [rewriter_after_jit_bprop_graph]: 4.85999e-06 [opt_after_jit_grad]: 0.00045306 [symbol_engine_optimizer]: 8.856e-05, [1] [Cycle 1]: 8.265e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 8.47998e-06 [elim_not_effective]: 1.293e-05 [opt_reshape]: 2.016e-05 [fold_const_symbol]: 9.81e-06 [renormalize]: 4.80009e-07 [validate]: 3.925e-05 Sums bootstrap : 0.000272s : 0.47% type_inference : 0.052332s : 90.45% event_method : 0.000018s : 0.03% auto_monad : 0.000065s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000277s : 0.48% rewriter_before_opt_a : 0.000081s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000668s : 1.15% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000068s : 0.12% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001878s : 3.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000540s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000421s : 0.73% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000046s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000453s : 0.78% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000020s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.07% Time group info: ------[substitution.] 0.000190 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.82% : 0.000005s : 4: substitution.graph_param_transform 82.73% : 0.000157s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000004s : 2: substitution.replace_old_param 6.17% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052258 2 96.35% : 0.050350s : 1: type_inference.infer 3.65% : 0.001908s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.25% : 0.000047s : 4: replace.inline 33.75% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.58% : 0.000154s : 4: match.inline 6.42% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.66% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000009s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.85% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002218 26 72.57% : 0.001610s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.25% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.18% : 0.000581s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064529 72 0.08% : 0.000049s : 1: add_recomputation 0.10% : 0.000068s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.44% : 0.000285s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.04% : 0.006476s : 1: jit_opt_a 0.23% : 0.000148s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.66% : 0.000429s : 1: loop_unroll 0.85% : 0.000548s : 1: mutable_eliminate 1.45% : 0.000935s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.71% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000282s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.94% : 0.001255s : 1: renormalize.infer 0.95% : 0.000614s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000037s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.14% : 0.000091s : 1: symbol_engine_optimizer 81.12% : 0.052344s : 1: type_inference TotalTime = 0.118206, [30] [bootstrap]: 0.00026995 [type_inference]: 0.107538 [event_method]: 2.075e-05 [auto_monad]: 6.778e-05 [graph_reusing]: 5.55001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00044767 [rewriter_before_opt_a]: 9.24e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00748439, [2] [Cycle 1]: 0.00388075, [27] [switch_simplify]: 6.036e-05 [loop_unroll]: 3.418e-05 [a_1]: 0.00068134 [with_stream_mark]: 1.731e-05 [recompute_prepare]: 8.57e-06 [updatestate_depend_eliminate]: 4.43999e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.34999e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.60002e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 9.99001e-06 [meta_fg_expand]: 3.01001e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00274198 [add_forward_monad_depend]: 5.79e-06 [auto_monad_grad]: 1.98997e-06 [auto_monad_eliminator]: 1.675e-05 [cse]: 3.122e-05 [replace_applicator]: 1.478e-05 [Cycle 2]: 0.00037515, [27] [switch_simplify]: 7.08e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012952 [with_stream_mark]: 1.073e-05 [recompute_prepare]: 6.52001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.93002e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 1.78997e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.64e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.77001e-06 [cse]: 1.388e-05 [replace_applicator]: 6.38998e-06 [py_interpret_to_execute_after_opt_a]: 9.90002e-06 [rewriter_after_opt_a]: 3.638e-05 [convert_after_rewriter]: 6.72002e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00055616 [jit_opt_b]: 5.735e-05, [1] [Cycle 1]: 4.949e-05, [2] [frontend_op_eliminate]: 2.094e-05 [inline_after_opt_a]: 1.752e-05 [cconv]: 2.41e-05 [loop_unroll]: 0.00045897 [jit_opt_after_cconv]: 0.00015897, [1] [Cycle 1]: 0.00015164, [11] [c_1]: 2.53e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 6.23e-06 [updatestate_assign_eliminate]: 4.13999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [cse]: 2.415e-05 [call_graph_tuple_transform]: 2.148e-05 [tuple_list_get_item_eliminator]: 6.39001e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 6.21e-06 [remove_dup_value]: 1.667e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.75999e-06 [add_recomputation]: 4.839e-05 [cse_after_recomputation]: 2.486e-05, [1] [Cycle 1]: 1.818e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.713e-05 [get_jit_bprop_graph]: 1.54998e-06 [rewriter_after_jit_bprop_graph]: 4.83001e-06 [opt_after_jit_grad]: 0.00047838 [symbol_engine_optimizer]: 7.928e-05, [1] [Cycle 1]: 7.343e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 1.386e-05 [opt_reshape]: 6.07999e-06 [fold_const_symbol]: 1.023e-05 [renormalize]: 5.8001e-07 [validate]: 4.727e-05 Sums bootstrap : 0.000270s : 0.24% type_inference : 0.107538s : 94.05% event_method : 0.000021s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000448s : 0.39% rewriter_before_opt_a : 0.000092s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000811s : 0.71% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002742s : 2.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000556s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000459s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000478s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000255 28 0.69% : 0.000002s : 2: substitution.elim_not_effective 0.44% : 0.000001s : 2: substitution.fold_const_symbol 2.31% : 0.000006s : 4: substitution.graph_param_transform 82.46% : 0.000210s : 5: substitution.inline 1.40% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.61% : 0.000012s : 3: substitution.reduce_eliminate 2.07% : 0.000005s : 4: substitution.remove_not_recompute_node 1.29% : 0.000003s : 2: substitution.replace_old_param 4.73% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107468 2 97.33% : 0.104595s : 1: type_inference.infer 2.67% : 0.002873s : 1: type_inference.specialize ------[replace.] 0.000099 7 68.57% : 0.000068s : 5: replace.inline 31.43% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000218 7 95.02% : 0.000208s : 5: match.inline 4.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 13: predicate.addn_check_dump 1.43% : 0.000002s : 13: predicate.addn_zero_filter 1.83% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 13: predicate.compare_switch_simplify 1.32% : 0.000002s : 13: predicate.depend_value_elim 1.10% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.21% : 0.000002s : 13: predicate.environ_get_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.71% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.36% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.36% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.89% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.79% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.79% : 0.000011s : 64: predicate.switch_simplify 1.38% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002181 25 62.62% : 0.001366s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.12% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.27% : 0.000747s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122072 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000283s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.13% : 0.007488s : 1: jit_opt_a 0.13% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.38% : 0.000467s : 1: loop_unroll 0.46% : 0.000564s : 1: mutable_eliminate 0.86% : 0.001054s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000453s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.63% : 0.001984s : 1: renormalize.infer 0.61% : 0.000749s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000098s : 1: rewriter_before_opt_a 0.12% : 0.000142s : 1: symbol_engine_optimizer 88.10% : 0.107551s : 1: type_inference TotalTime = 0.0116694, [30] [bootstrap]: 0.00026225 [type_inference]: 0.0043492 [event_method]: 1.801e-05 [auto_monad]: 6.926e-05 [graph_reusing]: 5.46998e-06 [pre_auto_parallel]: 2.16e-06 [py_interpret_to_execute]: 3.815e-05 [rewriter_before_opt_a]: 7.035e-05 [expand_dump_flag]: 2.76e-06 [jit_opt_a]: 0.00487781, [2] [Cycle 1]: 0.00145295, [27] [switch_simplify]: 4.565e-05 [loop_unroll]: 2.992e-05 [a_1]: 0.00048917 [with_stream_mark]: 1.341e-05 [recompute_prepare]: 7.66999e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 6.28998e-06 [updatestate_useless_node_eliminater]: 5.31002e-06 [accelerated_algorithm]: 5.69e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 5.66e-06 [merge_forward]: 3.13998e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.223e-05 [j_node_and_user_rematch]: 9.39e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 8.48001e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00057301 [add_forward_monad_depend]: 5.00001e-06 [auto_monad_grad]: 1.63002e-06 [auto_monad_eliminator]: 1.254e-05 [cse]: 2.098e-05 [replace_applicator]: 1.314e-05 [Cycle 2]: 0.0003147, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.116e-05 [with_stream_mark]: 8.3e-06 [recompute_prepare]: 5.04e-06 [updatestate_depend_eliminate]: 2.53003e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 4.84998e-06 [updatestate_useless_node_eliminater]: 4.76002e-06 [accelerated_algorithm]: 4.72e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.76003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.262e-05 [j_node_and_user_rematch]: 7.56001e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.51999e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.49e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.11e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 8.79e-06 [rewriter_after_opt_a]: 2.824e-05 [convert_after_rewriter]: 6.51999e-06 [order_py_execute_after_rewriter]: 4.25999e-06 [mutable_eliminate]: 0.00051368 [jit_opt_b]: 4.744e-05, [1] [Cycle 1]: 4.074e-05, [2] [frontend_op_eliminate]: 1.498e-05 [inline_after_opt_a]: 1.473e-05 [cconv]: 1.788e-05 [loop_unroll]: 0.0004159 [jit_opt_after_cconv]: 0.0001351, [1] [Cycle 1]: 0.00012858, [11] [c_1]: 2.069e-05 [parameter_eliminate]: 2.35002e-06 [updatestate_depend_eliminate]: 6.07999e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.794e-05 [call_graph_tuple_transform]: 1.656e-05 [tuple_list_get_item_eliminator]: 5.33002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 4.99998e-06 [remove_dup_value]: 8.38001e-06 [partial_unused_args_eliminate]: 1.37999e-06 [environ_conv]: 4.21001e-06 [add_recomputation]: 3.446e-05 [cse_after_recomputation]: 3.126e-05, [1] [Cycle 1]: 2.619e-05, [1] [cse]: 2.024e-05 [auto_monad_reorder]: 1.009e-05 [get_jit_bprop_graph]: 1.30999e-06 [rewriter_after_jit_bprop_graph]: 4.08999e-06 [opt_after_jit_grad]: 0.0004509 [symbol_engine_optimizer]: 6.998e-05, [1] [Cycle 1]: 6.424e-05, [6] [build]: 2.76e-06 [elim_shapecalc]: 7.89002e-06 [elim_not_effective]: 1.22e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 8.64e-06 [renormalize]: 4.30009e-07 [validate]: 2.743e-05 Sums bootstrap : 0.000262s : 3.27% type_inference : 0.004349s : 54.25% event_method : 0.000018s : 0.22% auto_monad : 0.000069s : 0.86% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000038s : 0.48% rewriter_before_opt_a : 0.000070s : 0.88% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000051s : 0.64% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000580s : 7.24% jit_opt_a.with_stream_mark : 0.000022s : 0.27% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000573s : 7.15% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.23% jit_opt_a.cse : 0.000032s : 0.40% jit_opt_a.replace_applicator : 0.000018s : 0.23% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000028s : 0.35% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000514s : 6.41% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000018s : 0.22% loop_unroll : 0.000416s : 5.19% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000008s : 0.10% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000034s : 0.43% cse_after_recomputation.cse : 0.000020s : 0.25% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000451s : 5.62% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000027s : 0.34% Time group info: ------[substitution.] 0.000168 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000004s : 3: substitution.graph_param_transform 83.58% : 0.000140s : 4: substitution.inline 1.96% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.49% : 0.000004s : 2: substitution.replace_old_param 5.22% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004292 2 82.30% : 0.003533s : 1: type_inference.infer 17.70% : 0.000760s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.27% : 0.000043s : 4: replace.inline 32.73% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 94.70% : 0.000138s : 4: match.inline 5.30% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.33% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.26% : 0.000003s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.20% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.78% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.91% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000002s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.56% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.15% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000592 13 50.96% : 0.000301s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.38% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.66% : 0.000258s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013092 72 0.28% : 0.000037s : 1: add_recomputation 0.56% : 0.000073s : 1: auto_monad 0.10% : 0.000013s : 1: auto_monad_reorder 2.09% : 0.000273s : 1: bootstrap 0.16% : 0.000020s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.26% : 0.000033s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.17% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.28% : 0.004881s : 1: jit_opt_a 1.05% : 0.000138s : 1: jit_opt_after_cconv 0.38% : 0.000050s : 1: jit_opt_b 3.24% : 0.000424s : 1: loop_unroll 3.99% : 0.000522s : 1: mutable_eliminate 5.97% : 0.000782s : 26: opt.transform.jit_opt_a 0.34% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.51% : 0.000459s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000041s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000011s : 1: remove_dup_value 2.19% : 0.000286s : 1: renormalize.infer 2.14% : 0.000280s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000031s : 1: rewriter_after_opt_a 0.56% : 0.000073s : 1: rewriter_before_opt_a 0.55% : 0.000072s : 1: symbol_engine_optimizer 33.33% : 0.004364s : 1: type_inference TotalTime = 0.117813, [30] [bootstrap]: 0.00027838 [type_inference]: 0.107421 [event_method]: 2.169e-05 [auto_monad]: 6.886e-05 [graph_reusing]: 5.84999e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.000453 [rewriter_before_opt_a]: 9.384e-05 [expand_dump_flag]: 3.41999e-06 [jit_opt_a]: 0.00731484, [2] [Cycle 1]: 0.0037549, [27] [switch_simplify]: 6.088e-05 [loop_unroll]: 3.489e-05 [a_1]: 0.0006553 [with_stream_mark]: 1.446e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.52002e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.60002e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.527e-05 [j_node_and_user_rematch]: 1.065e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 6.59999e-06 [renormalize]: 0.00264769 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 1.80001e-06 [auto_monad_eliminator]: 1.531e-05 [cse]: 3.265e-05 [replace_applicator]: 1.427e-05 [Cycle 2]: 0.00037058, [27] [switch_simplify]: 7.23999e-06 [loop_unroll]: 6.19999e-06 [a_1]: 0.00012933 [with_stream_mark]: 9.21002e-06 [recompute_prepare]: 6.33998e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.02999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.137e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.97e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.44e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.367e-05 [replace_applicator]: 6.38e-06 [py_interpret_to_execute_after_opt_a]: 9.02999e-06 [rewriter_after_opt_a]: 3.397e-05 [convert_after_rewriter]: 6.72002e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00053754 [jit_opt_b]: 5.678e-05, [1] [Cycle 1]: 5.005e-05, [2] [frontend_op_eliminate]: 2.017e-05 [inline_after_opt_a]: 1.812e-05 [cconv]: 2.36e-05 [loop_unroll]: 0.00041283 [jit_opt_after_cconv]: 0.00017122, [1] [Cycle 1]: 0.00016496, [11] [c_1]: 2.563e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.37999e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 2.272e-05 [call_graph_tuple_transform]: 3.801e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.579e-05 [partial_unused_args_eliminate]: 2.63e-06 [environ_conv]: 7.43e-06 [add_recomputation]: 4.659e-05 [cse_after_recomputation]: 2.599e-05, [1] [Cycle 1]: 2.009e-05, [1] [cse]: 1.367e-05 [auto_monad_reorder]: 1.722e-05 [get_jit_bprop_graph]: 1.56998e-06 [rewriter_after_jit_bprop_graph]: 4.68001e-06 [opt_after_jit_grad]: 0.00048831 [symbol_engine_optimizer]: 7.543e-05, [1] [Cycle 1]: 6.985e-05, [6] [build]: 3.52002e-06 [elim_shapecalc]: 8.45999e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 6.23998e-06 [fold_const_symbol]: 1.017e-05 [renormalize]: 4.2998e-07 [validate]: 4.112e-05 Sums bootstrap : 0.000278s : 0.24% type_inference : 0.107421s : 94.19% event_method : 0.000022s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000453s : 0.40% rewriter_before_opt_a : 0.000094s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000785s : 0.69% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002648s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000538s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000413s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000038s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000488s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000251 28 0.84% : 0.000002s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 8.64% : 0.000022s : 4: substitution.graph_param_transform 77.15% : 0.000194s : 5: substitution.inline 1.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.27% : 0.000011s : 3: substitution.reduce_eliminate 1.90% : 0.000005s : 4: substitution.remove_not_recompute_node 1.37% : 0.000003s : 2: substitution.replace_old_param 4.29% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107351 2 97.34% : 0.104494s : 1: type_inference.infer 2.66% : 0.002858s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.82% : 0.000064s : 5: replace.inline 31.18% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 7 95.20% : 0.000191s : 5: match.inline 4.80% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.17% : 0.000002s : 13: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 1.89% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.44% : 0.000002s : 13: predicate.compare_switch_simplify 1.28% : 0.000002s : 13: predicate.depend_value_elim 1.21% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.48% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.19% : 0.000002s : 13: predicate.minmaximum_grad 1.33% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.32% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 23: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.23% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.45% : 0.000010s : 64: predicate.switch_simplify 1.32% : 0.000002s : 13: predicate.tile_eliminate 1.30% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.93% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002248 25 62.68% : 0.001409s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.45% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.87% : 0.000784s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121582 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000290s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.02% : 0.007319s : 1: jit_opt_a 0.14% : 0.000174s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.35% : 0.000421s : 1: loop_unroll 0.45% : 0.000547s : 1: mutable_eliminate 0.84% : 0.001027s : 26: opt.transform.jit_opt_a 0.06% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000459s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.55% : 0.001884s : 1: renormalize.infer 0.62% : 0.000754s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000099s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.36% : 0.107433s : 1: type_inference TotalTime = 0.11356, [30] [bootstrap]: 0.00025693 [type_inference]: 0.103692 [event_method]: 1.802e-05 [auto_monad]: 5.264e-05 [graph_reusing]: 4.81002e-06 [pre_auto_parallel]: 1.62999e-06 [py_interpret_to_execute]: 0.00044573 [rewriter_before_opt_a]: 7.681e-05 [expand_dump_flag]: 2.48002e-06 [jit_opt_a]: 0.00678151, [2] [Cycle 1]: 0.00335452, [27] [switch_simplify]: 4.836e-05 [loop_unroll]: 3.045e-05 [a_1]: 0.00053313 [with_stream_mark]: 1.305e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.204e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 0.00241835 [add_forward_monad_depend]: 5.20999e-06 [auto_monad_grad]: 2.07999e-06 [auto_monad_eliminator]: 1.425e-05 [cse]: 2.209e-05 [replace_applicator]: 1.33e-05 [Cycle 2]: 0.00036366, [27] [switch_simplify]: 6.33998e-06 [loop_unroll]: 5.61e-06 [a_1]: 0.00012846 [with_stream_mark]: 1.003e-05 [recompute_prepare]: 6.01998e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.63002e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.447e-05 [j_node_and_user_rematch]: 8.64003e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.65001e-06 [inline_without_move]: 5.69e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.097e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 1.046e-05 [rewriter_after_opt_a]: 3.083e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00059622 [jit_opt_b]: 6.014e-05, [1] [Cycle 1]: 5.263e-05, [2] [frontend_op_eliminate]: 2.208e-05 [inline_after_opt_a]: 1.857e-05 [cconv]: 2.157e-05 [loop_unroll]: 0.00044191 [jit_opt_after_cconv]: 0.00014614, [1] [Cycle 1]: 0.00014002, [11] [c_1]: 2.531e-05 [parameter_eliminate]: 2.22001e-06 [updatestate_depend_eliminate]: 5.24e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 1.811e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 6.59001e-06 [none_parameter_eliminate]: 1.87999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 6.41998e-06 [remove_dup_value]: 1.283e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 7.01999e-06 [add_recomputation]: 3.944e-05 [cse_after_recomputation]: 2.098e-05, [1] [Cycle 1]: 1.616e-05, [1] [cse]: 1.026e-05 [auto_monad_reorder]: 1.213e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 4.79e-06 [opt_after_jit_grad]: 0.00046014 [symbol_engine_optimizer]: 0.00013589, [1] [Cycle 1]: 7.096e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.561e-05 [opt_reshape]: 7.80998e-06 [fold_const_symbol]: 8.93002e-06 [renormalize]: 4.19997e-07 [validate]: 3.722e-05 Sums bootstrap : 0.000257s : 0.23% type_inference : 0.103692s : 94.38% event_method : 0.000018s : 0.02% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000446s : 0.41% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000662s : 0.60% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002418s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000596s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000442s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000460s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000178 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000001s : 2: substitution.fold_const_symbol 3.12% : 0.000006s : 4: substitution.graph_param_transform 83.54% : 0.000148s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000004s : 2: substitution.replace_old_param 5.21% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103627 2 97.47% : 0.101003s : 1: type_inference.infer 2.53% : 0.002624s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.40% : 0.000046s : 4: replace.inline 32.60% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 94.69% : 0.000146s : 4: match.inline 5.31% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.30% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.28% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.06% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.22% : 0.000002s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.49% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.93% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.25% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001947 22 67.05% : 0.001306s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.37% : 0.000611s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116939 72 0.04% : 0.000042s : 1: add_recomputation 0.05% : 0.000056s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000273s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.80% : 0.006784s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.38% : 0.000450s : 1: loop_unroll 0.52% : 0.000606s : 1: mutable_eliminate 0.75% : 0.000881s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.39% : 0.000453s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.51% : 0.001764s : 1: renormalize.infer 0.55% : 0.000646s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000139s : 1: symbol_engine_optimizer 88.68% : 0.103706s : 1: type_inference TotalTime = 0.0148325, [30] [bootstrap]: 0.00027255 [type_inference]: 0.00738914 [event_method]: 1.953e-05 [auto_monad]: 4.997e-05 [graph_reusing]: 4.30999e-06 [pre_auto_parallel]: 1.79998e-06 [py_interpret_to_execute]: 4.395e-05 [rewriter_before_opt_a]: 7.588e-05 [expand_dump_flag]: 1.94e-06 [jit_opt_a]: 0.00500904, [2] [Cycle 1]: 0.00154844, [27] [switch_simplify]: 4.975e-05 [loop_unroll]: 3.331e-05 [a_1]: 0.00056809 [with_stream_mark]: 1.13e-05 [recompute_prepare]: 7.26001e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 6.41998e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.258e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.33999e-06 [inline_without_move]: 5.36002e-06 [renormalize]: 0.00058661 [add_forward_monad_depend]: 4.71002e-06 [auto_monad_grad]: 1.14998e-06 [auto_monad_eliminator]: 1.186e-05 [cse]: 2.118e-05 [replace_applicator]: 1.19e-05 [Cycle 2]: 0.00031749, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 5.18002e-06 [a_1]: 9.454e-05 [with_stream_mark]: 8.55999e-06 [recompute_prepare]: 5.24998e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.19998e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.29998e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.81e-06 [j_node_and_user_rematch]: 7.27002e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 6.76999e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.09989e-07 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.213e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 9.47999e-06 [rewriter_after_opt_a]: 3.293e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.0004757 [jit_opt_b]: 4.807e-05, [1] [Cycle 1]: 4.144e-05, [2] [frontend_op_eliminate]: 1.522e-05 [inline_after_opt_a]: 1.555e-05 [cconv]: 2.207e-05 [loop_unroll]: 0.00040932 [jit_opt_after_cconv]: 0.00014732, [1] [Cycle 1]: 0.00014066, [11] [c_1]: 2.049e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 2.047e-05 [call_graph_tuple_transform]: 1.746e-05 [tuple_list_get_item_eliminator]: 5.22999e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.35001e-06 [remove_dup_value]: 1.484e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 5.86998e-06 [add_recomputation]: 4.487e-05 [cse_after_recomputation]: 2.237e-05, [1] [Cycle 1]: 1.703e-05, [1] [cse]: 1.152e-05 [auto_monad_reorder]: 1.634e-05 [get_jit_bprop_graph]: 1.87001e-06 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.0004381 [symbol_engine_optimizer]: 7.068e-05, [1] [Cycle 1]: 6.446e-05, [6] [build]: 2.83e-06 [elim_shapecalc]: 7.83999e-06 [elim_not_effective]: 1.242e-05 [opt_reshape]: 5.86e-06 [fold_const_symbol]: 8.41002e-06 [renormalize]: 4.59986e-07 [validate]: 3.272e-05 Sums bootstrap : 0.000273s : 2.45% type_inference : 0.007389s : 66.35% event_method : 0.000020s : 0.18% auto_monad : 0.000050s : 0.45% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000044s : 0.39% rewriter_before_opt_a : 0.000076s : 0.68% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000055s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.35% jit_opt_a.a_1 : 0.000663s : 5.95% jit_opt_a.with_stream_mark : 0.000020s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000587s : 5.27% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.16% jit_opt_a.cse : 0.000033s : 0.30% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.09% rewriter_after_opt_a : 0.000033s : 0.30% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000476s : 4.27% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000022s : 0.20% loop_unroll : 0.000409s : 3.68% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000045s : 0.40% cse_after_recomputation.cse : 0.000012s : 0.10% auto_monad_reorder : 0.000016s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000438s : 3.93% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.29% Time group info: ------[substitution.] 0.000198 27 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000005s : 3: substitution.graph_param_transform 82.94% : 0.000164s : 5: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.32% : 0.000009s : 3: substitution.reduce_eliminate 2.34% : 0.000005s : 4: substitution.remove_not_recompute_node 1.42% : 0.000003s : 2: substitution.replace_old_param 3.59% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007328 2 87.92% : 0.006443s : 1: type_inference.infer 12.08% : 0.000885s : 1: type_inference.specialize ------[replace.] 0.000082 7 66.40% : 0.000054s : 5: replace.inline 33.60% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 7 96.41% : 0.000161s : 5: match.inline 3.59% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 0.96% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 11: predicate.addn_check_dump 1.31% : 0.000002s : 11: predicate.addn_zero_filter 1.90% : 0.000002s : 11: predicate.arithmetic_simplify 1.37% : 0.000002s : 11: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 11: predicate.compare_switch_simplify 1.31% : 0.000002s : 11: predicate.depend_value_elim 1.26% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.44% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.24% : 0.000001s : 11: predicate.environ_get_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000006s : 24: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 16: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.50% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 11: predicate.merge_addn 1.20% : 0.000001s : 11: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.24% : 0.000001s : 11: predicate.print_const_string_wrapper 1.90% : 0.000002s : 11: predicate.reduce_eliminate 1.53% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 11: predicate.reshape_eliminate 1.36% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.38% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.29% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.85% : 0.000009s : 59: predicate.switch_simplify 1.31% : 0.000002s : 11: predicate.tile_eliminate 1.34% : 0.000002s : 11: predicate.transpose_eliminate 1.45% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000714 16 50.51% : 0.000360s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.58% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.92% : 0.000299s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016352 72 0.29% : 0.000048s : 1: add_recomputation 0.33% : 0.000053s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 1.74% : 0.000285s : 1: bootstrap 0.15% : 0.000025s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.65% : 0.005012s : 1: jit_opt_a 0.92% : 0.000150s : 1: jit_opt_after_cconv 0.31% : 0.000051s : 1: jit_opt_b 2.55% : 0.000417s : 1: loop_unroll 2.96% : 0.000484s : 1: mutable_eliminate 5.32% : 0.000869s : 26: opt.transform.jit_opt_a 0.28% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.73% : 0.000446s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000047s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 1.94% : 0.000318s : 1: renormalize.infer 1.61% : 0.000262s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000036s : 1: rewriter_after_opt_a 0.48% : 0.000079s : 1: rewriter_before_opt_a 0.45% : 0.000073s : 1: symbol_engine_optimizer 45.26% : 0.007401s : 1: type_inference TotalTime = 0.112616, [30] [bootstrap]: 0.0002528 [type_inference]: 0.102747 [event_method]: 1.677e-05 [auto_monad]: 5.153e-05 [graph_reusing]: 4.38999e-06 [pre_auto_parallel]: 1.76003e-06 [py_interpret_to_execute]: 0.00043715 [rewriter_before_opt_a]: 7.701e-05 [expand_dump_flag]: 2.83998e-06 [jit_opt_a]: 0.00687211, [2] [Cycle 1]: 0.00334948, [27] [switch_simplify]: 4.867e-05 [loop_unroll]: 3.033e-05 [a_1]: 0.00051785 [with_stream_mark]: 1.26e-05 [recompute_prepare]: 7.84002e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.87001e-06 [get_grad_eliminate_]: 6.19999e-06 [merge_forward]: 3.00998e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.308e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 8.86002e-06 [inline_without_move]: 5.75001e-06 [renormalize]: 0.00243824 [add_forward_monad_depend]: 4.77e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 1.288e-05 [cse]: 1.829e-05 [replace_applicator]: 1.343e-05 [Cycle 2]: 0.00035798, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00012207 [with_stream_mark]: 1.015e-05 [recompute_prepare]: 5.89999e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.49001e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.62998e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.98001e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.185e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 9.67999e-06 [rewriter_after_opt_a]: 2.6e-05 [convert_after_rewriter]: 5.66e-06 [order_py_execute_after_rewriter]: 3.86999e-06 [mutable_eliminate]: 0.00051566 [jit_opt_b]: 5.716e-05, [1] [Cycle 1]: 4.961e-05, [2] [frontend_op_eliminate]: 2.019e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 1.558e-05 [loop_unroll]: 0.00041385 [jit_opt_after_cconv]: 0.00014501, [1] [Cycle 1]: 0.00013841, [11] [c_1]: 2.506e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.75001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.928e-05 [call_graph_tuple_transform]: 1.909e-05 [tuple_list_get_item_eliminator]: 6.57002e-06 [none_parameter_eliminate]: 1.11002e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.93002e-06 [remove_dup_value]: 7.58001e-06 [partial_unused_args_eliminate]: 1.26002e-06 [environ_conv]: 6.94999e-06 [add_recomputation]: 3.483e-05 [cse_after_recomputation]: 2.318e-05, [1] [Cycle 1]: 1.621e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.034e-05 [get_jit_bprop_graph]: 1.30001e-06 [rewriter_after_jit_bprop_graph]: 4.30999e-06 [opt_after_jit_grad]: 0.0005241 [symbol_engine_optimizer]: 0.00015122, [1] [Cycle 1]: 0.0001451, [6] [build]: 2.73e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.428e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 8.51e-05 [renormalize]: 4.50003e-07 [validate]: 3.278e-05 Sums bootstrap : 0.000253s : 0.23% type_inference : 0.102747s : 94.35% event_method : 0.000017s : 0.02% auto_monad : 0.000052s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000437s : 0.40% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000640s : 0.59% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002438s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000026s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000516s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000016s : 0.01% loop_unroll : 0.000414s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000524s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000085s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000167 24 0.85% : 0.000001s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.56% : 0.000004s : 4: substitution.graph_param_transform 83.02% : 0.000138s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000005s : 4: substitution.remove_not_recompute_node 2.29% : 0.000004s : 2: substitution.replace_old_param 6.05% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102688 2 97.56% : 0.100185s : 1: type_inference.infer 2.44% : 0.002502s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.51% : 0.000044s : 4: replace.inline 32.49% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 93.79% : 0.000136s : 4: match.inline 6.21% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000002s : 12: predicate.arithmetic_simplify 1.64% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.36% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.36% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.08% : 0.000006s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.20% : 0.000002s : 12: predicate.minmaximum_grad 1.86% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.69% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001965 22 65.61% : 0.001289s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.98% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116072 72 0.03% : 0.000038s : 1: add_recomputation 0.05% : 0.000054s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.23% : 0.000265s : 1: bootstrap 0.02% : 0.000018s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.92% : 0.006875s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000421s : 1: loop_unroll 0.45% : 0.000525s : 1: mutable_eliminate 0.74% : 0.000859s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000111s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000532s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000444s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000010s : 1: remove_dup_value 1.52% : 0.001768s : 1: renormalize.infer 0.57% : 0.000663s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.13% : 0.000154s : 1: symbol_engine_optimizer 88.53% : 0.102759s : 1: type_inference TotalTime = 0.0112736, [30] [bootstrap]: 0.00026222 [type_inference]: 0.00414552 [event_method]: 1.711e-05 [auto_monad]: 4.996e-05 [graph_reusing]: 4.55001e-06 [pre_auto_parallel]: 1.77001e-06 [py_interpret_to_execute]: 3.424e-05 [rewriter_before_opt_a]: 6.598e-05 [expand_dump_flag]: 2.16998e-06 [jit_opt_a]: 0.0047082, [2] [Cycle 1]: 0.00139611, [27] [switch_simplify]: 4.562e-05 [loop_unroll]: 3.035e-05 [a_1]: 0.00049048 [with_stream_mark]: 1.308e-05 [recompute_prepare]: 7.63001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.11002e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.103e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00053265 [add_forward_monad_depend]: 4.43999e-06 [auto_monad_grad]: 1.80001e-06 [auto_monad_eliminator]: 1.176e-05 [cse]: 1.781e-05 [replace_applicator]: 1.088e-05 [Cycle 2]: 0.00030808, [27] [switch_simplify]: 5.32001e-06 [loop_unroll]: 4.75001e-06 [a_1]: 9.1e-05 [with_stream_mark]: 8.13999e-06 [recompute_prepare]: 4.84e-06 [updatestate_depend_eliminate]: 2.49001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.90999e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.72998e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.31e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.219e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.53002e-06 [cse]: 9.46e-06 [replace_applicator]: 4.81002e-06 [py_interpret_to_execute_after_opt_a]: 9.44e-06 [rewriter_after_opt_a]: 2.688e-05 [convert_after_rewriter]: 6.21e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00048857 [jit_opt_b]: 4.892e-05, [1] [Cycle 1]: 4.301e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.553e-05 [cconv]: 3.068e-05 [loop_unroll]: 0.0004128 [jit_opt_after_cconv]: 0.00013581, [1] [Cycle 1]: 0.0001296, [11] [c_1]: 2.094e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.765e-05 [call_graph_tuple_transform]: 1.725e-05 [tuple_list_get_item_eliminator]: 5.37001e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 5.09998e-06 [remove_dup_value]: 9.69e-06 [partial_unused_args_eliminate]: 1.67999e-06 [environ_conv]: 4.3e-06 [add_recomputation]: 3.563e-05 [cse_after_recomputation]: 2.169e-05, [1] [Cycle 1]: 1.615e-05, [1] [cse]: 1.013e-05 [auto_monad_reorder]: 1.168e-05 [get_jit_bprop_graph]: 1.55001e-06 [rewriter_after_jit_bprop_graph]: 4.71002e-06 [opt_after_jit_grad]: 0.00043844 [symbol_engine_optimizer]: 7.053e-05, [1] [Cycle 1]: 6.425e-05, [6] [build]: 2.36e-06 [elim_shapecalc]: 8.45001e-06 [elim_not_effective]: 1.234e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 7.93001e-06 [renormalize]: 3.50003e-07 [validate]: 2.705e-05 Sums bootstrap : 0.000262s : 3.41% type_inference : 0.004146s : 53.88% event_method : 0.000017s : 0.22% auto_monad : 0.000050s : 0.65% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.45% rewriter_before_opt_a : 0.000066s : 0.86% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000051s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.46% jit_opt_a.a_1 : 0.000581s : 7.56% jit_opt_a.with_stream_mark : 0.000021s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000533s : 6.92% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000027s : 0.35% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.12% rewriter_after_opt_a : 0.000027s : 0.35% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000489s : 6.35% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000031s : 0.40% loop_unroll : 0.000413s : 5.37% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000010s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.06% add_recomputation : 0.000036s : 0.46% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000012s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000438s : 5.70% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.35% Time group info: ------[substitution.] 0.000160 23 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000005s : 3: substitution.graph_param_transform 83.04% : 0.000133s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000004s : 4: substitution.remove_not_recompute_node 2.01% : 0.000003s : 2: substitution.replace_old_param 5.82% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004095 2 81.33% : 0.003331s : 1: type_inference.infer 18.67% : 0.000765s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.33% : 0.000042s : 4: replace.inline 34.67% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 6 94.09% : 0.000130s : 4: match.inline 5.91% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.53% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.22% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.36% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.25% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000001s : 10: predicate.print_const_string_wrapper 1.81% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.61% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 2.40% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.49% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.78% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000564 13 49.76% : 0.000281s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.18% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012612 72 0.31% : 0.000039s : 1: add_recomputation 0.42% : 0.000053s : 1: auto_monad 0.11% : 0.000014s : 1: auto_monad_reorder 2.17% : 0.000274s : 1: bootstrap 0.27% : 0.000034s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.35% : 0.004711s : 1: jit_opt_a 1.10% : 0.000138s : 1: jit_opt_after_cconv 0.41% : 0.000051s : 1: jit_opt_b 3.33% : 0.000420s : 1: loop_unroll 3.94% : 0.000497s : 1: mutable_eliminate 6.16% : 0.000776s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.54% : 0.000446s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000012s : 1: remove_dup_value 2.05% : 0.000259s : 1: renormalize.infer 2.12% : 0.000267s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000030s : 1: rewriter_after_opt_a 0.55% : 0.000069s : 1: rewriter_before_opt_a 0.58% : 0.000073s : 1: symbol_engine_optimizer 32.97% : 0.004158s : 1: type_inference TotalTime = 0.124616, [30] [bootstrap]: 0.00026266 [type_inference]: 0.113762 [event_method]: 1.932e-05 [auto_monad]: 5.7e-05 [graph_reusing]: 4.66002e-06 [pre_auto_parallel]: 1.83002e-06 [py_interpret_to_execute]: 0.00054865 [rewriter_before_opt_a]: 0.00011005 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00749221, [2] [Cycle 1]: 0.00388663, [27] [switch_simplify]: 5.435e-05 [loop_unroll]: 3.41e-05 [a_1]: 0.00065857 [with_stream_mark]: 1.32e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 3.45003e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 1.93997e-06 [get_grad_eliminate_]: 6.61e-06 [merge_forward]: 3.11001e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.288e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.54001e-06 [replace_old_param]: 2.014e-05 [inline_without_move]: 1.353e-05 [renormalize]: 0.00277473 [add_forward_monad_depend]: 6.07001e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.497e-05 [cse]: 2.389e-05 [replace_applicator]: 2.489e-05 [Cycle 2]: 0.00041853, [27] [switch_simplify]: 1.391e-05 [loop_unroll]: 6.44001e-06 [a_1]: 0.00014057 [with_stream_mark]: 1.129e-05 [recompute_prepare]: 6.33e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.40025e-07 [specialize_transform]: 5.83997e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 1.308e-05 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 1.92999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.242e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 8.75001e-06 [inline_without_move]: 5.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.42e-06 [auto_monad_grad]: 1.00001e-06 [auto_monad_eliminator]: 6.02999e-06 [cse]: 1.422e-05 [replace_applicator]: 6.69999e-06 [py_interpret_to_execute_after_opt_a]: 9.99001e-06 [rewriter_after_opt_a]: 4.328e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00060792 [jit_opt_b]: 5.43e-05, [1] [Cycle 1]: 4.741e-05, [2] [frontend_op_eliminate]: 1.846e-05 [inline_after_opt_a]: 1.8e-05 [cconv]: 2.581e-05 [loop_unroll]: 0.00044017 [jit_opt_after_cconv]: 0.0001654, [1] [Cycle 1]: 0.00015866, [11] [c_1]: 3.361e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 5.74999e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.062e-05 [call_graph_tuple_transform]: 1.983e-05 [tuple_list_get_item_eliminator]: 6.26998e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 3.934e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 8.15e-06 [add_recomputation]: 5.578e-05 [cse_after_recomputation]: 2.291e-05, [1] [Cycle 1]: 1.748e-05, [1] [cse]: 1.189e-05 [auto_monad_reorder]: 1.791e-05 [get_jit_bprop_graph]: 1.59e-06 [rewriter_after_jit_bprop_graph]: 4.42e-06 [opt_after_jit_grad]: 0.00050074 [symbol_engine_optimizer]: 7.49e-05, [1] [Cycle 1]: 6.877e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.339e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.57001e-06 [renormalize]: 4.19997e-07 [validate]: 0.00010255 Sums bootstrap : 0.000263s : 0.22% type_inference : 0.113762s : 94.14% event_method : 0.000019s : 0.02% auto_monad : 0.000057s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000549s : 0.45% rewriter_before_opt_a : 0.000110s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000799s : 0.66% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000020s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000029s : 0.02% jit_opt_a.inline_without_move : 0.000019s : 0.02% jit_opt_a.renormalize : 0.002775s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000032s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000043s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000608s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000440s : 0.36% jit_opt_after_cconv.c_1 : 0.000034s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000039s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000056s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000501s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000103s : 0.08% Time group info: ------[substitution.] 0.000229 28 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000005s : 4: substitution.graph_param_transform 81.99% : 0.000188s : 5: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.61% : 0.000011s : 3: substitution.reduce_eliminate 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 1.85% : 0.000004s : 2: substitution.replace_old_param 4.58% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.113701 2 97.40% : 0.110739s : 1: type_inference.infer 2.60% : 0.002962s : 1: type_inference.specialize ------[replace.] 0.000105 7 72.83% : 0.000076s : 5: replace.inline 27.17% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 7 95.18% : 0.000185s : 5: match.inline 4.82% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.20% : 0.000002s : 13: predicate.environ_get_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.50% : 0.000008s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 19: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.00% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 23: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.59% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 20: predicate.switch_defer_inline 2.18% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.14% : 0.000010s : 64: predicate.switch_simplify 1.29% : 0.000002s : 13: predicate.tile_eliminate 1.51% : 0.000002s : 13: predicate.transpose_eliminate 1.56% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 5.27% : 0.000007s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002335 25 60.54% : 0.001413s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.50% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.96% : 0.000863s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128489 72 0.05% : 0.000059s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.21% : 0.000274s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.83% : 0.007495s : 1: jit_opt_a 0.13% : 0.000168s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.35% : 0.000448s : 1: loop_unroll 0.48% : 0.000617s : 1: mutable_eliminate 0.84% : 0.001077s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000509s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000557s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000042s : 1: remove_dup_value 1.50% : 0.001922s : 1: renormalize.infer 0.66% : 0.000844s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000046s : 1: rewriter_after_opt_a 0.09% : 0.000115s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 88.55% : 0.113774s : 1: type_inference TotalTime = 0.0112869, [30] [bootstrap]: 0.00025379 [type_inference]: 0.00408394 [event_method]: 1.657e-05 [auto_monad]: 4.596e-05 [graph_reusing]: 3.61999e-06 [pre_auto_parallel]: 1.87001e-06 [py_interpret_to_execute]: 3.461e-05 [rewriter_before_opt_a]: 6.397e-05 [expand_dump_flag]: 1.79998e-06 [jit_opt_a]: 0.00477428, [2] [Cycle 1]: 0.00138128, [27] [switch_simplify]: 4.552e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00048633 [with_stream_mark]: 1.294e-05 [recompute_prepare]: 7.13998e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 6.10002e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.19998e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.12e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00052943 [add_forward_monad_depend]: 4.05e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 1.061e-05 [cse]: 1.704e-05 [replace_applicator]: 1.017e-05 [Cycle 2]: 0.00030944, [27] [switch_simplify]: 5.47001e-06 [loop_unroll]: 4.77998e-06 [a_1]: 8.875e-05 [with_stream_mark]: 7.73999e-06 [recompute_prepare]: 4.76002e-06 [updatestate_depend_eliminate]: 2.29001e-06 [updatestate_assign_eliminate]: 2.02999e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 4.82998e-06 [updatestate_useless_node_eliminater]: 4.58999e-06 [accelerated_algorithm]: 4.65999e-06 [meta_shard_fg_expand]: 1.24003e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 7.58999e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.58999e-06 [inline_without_move]: 4.97e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.092e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 8.90001e-06 [rewriter_after_opt_a]: 8.946e-05 [convert_after_rewriter]: 5.97999e-06 [order_py_execute_after_rewriter]: 4.3e-06 [mutable_eliminate]: 0.00046944 [jit_opt_b]: 4.641e-05, [1] [Cycle 1]: 4.027e-05, [2] [frontend_op_eliminate]: 1.536e-05 [inline_after_opt_a]: 1.474e-05 [cconv]: 1.683e-05 [loop_unroll]: 0.00042884 [jit_opt_after_cconv]: 0.0001394, [1] [Cycle 1]: 0.00013296, [11] [c_1]: 2.033e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.89e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 2.044e-05 [call_graph_tuple_transform]: 1.716e-05 [tuple_list_get_item_eliminator]: 5.62001e-06 [none_parameter_eliminate]: 1.09003e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.47001e-06 [remove_dup_value]: 9.09e-06 [partial_unused_args_eliminate]: 1.76e-06 [environ_conv]: 4.77998e-06 [add_recomputation]: 3.442e-05 [cse_after_recomputation]: 2.025e-05, [1] [Cycle 1]: 1.538e-05, [1] [cse]: 9.57001e-06 [auto_monad_reorder]: 9.66e-06 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 4.45e-06 [opt_after_jit_grad]: 0.00045771 [symbol_engine_optimizer]: 7.209e-05, [1] [Cycle 1]: 6.57e-05, [6] [build]: 3.73999e-06 [elim_shapecalc]: 8.31002e-06 [elim_not_effective]: 1.295e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 8.04997e-06 [renormalize]: 2.80008e-07 [validate]: 2.987e-05 Sums bootstrap : 0.000254s : 3.31% type_inference : 0.004084s : 53.23% event_method : 0.000017s : 0.22% auto_monad : 0.000046s : 0.60% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.45% rewriter_before_opt_a : 0.000064s : 0.83% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000051s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.46% jit_opt_a.a_1 : 0.000575s : 7.50% jit_opt_a.with_stream_mark : 0.000021s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000530s : 6.90% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000028s : 0.36% jit_opt_a.replace_applicator : 0.000015s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.12% rewriter_after_opt_a : 0.000089s : 1.17% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000469s : 6.12% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000017s : 0.22% loop_unroll : 0.000429s : 5.59% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000009s : 0.12% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000034s : 0.45% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000458s : 5.97% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.39% Time group info: ------[substitution.] 0.000161 23 1.13% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000004s : 3: substitution.graph_param_transform 84.81% : 0.000137s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000004s : 4: substitution.remove_not_recompute_node 2.06% : 0.000003s : 2: substitution.replace_old_param 4.92% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004037 2 81.29% : 0.003281s : 1: type_inference.infer 18.71% : 0.000755s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.06% : 0.000043s : 4: replace.inline 32.94% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 95.20% : 0.000134s : 4: match.inline 4.80% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.56% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000002s : 15: predicate.partial_eliminate 1.34% : 0.000001s : 10: predicate.print_const_string_wrapper 2.01% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.79% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.40% : 0.000008s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.32% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000552 13 48.98% : 0.000270s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.56% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.46% : 0.000251s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012654 72 0.29% : 0.000037s : 1: add_recomputation 0.39% : 0.000049s : 1: auto_monad 0.10% : 0.000012s : 1: auto_monad_reorder 2.09% : 0.000265s : 1: bootstrap 0.15% : 0.000019s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.75% : 0.004777s : 1: jit_opt_a 1.12% : 0.000142s : 1: jit_opt_after_cconv 0.39% : 0.000049s : 1: jit_opt_b 3.45% : 0.000437s : 1: loop_unroll 3.78% : 0.000478s : 1: mutable_eliminate 6.09% : 0.000770s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.17% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.69% : 0.000467s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000011s : 1: remove_dup_value 2.16% : 0.000274s : 1: renormalize.infer 1.97% : 0.000250s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.73% : 0.000093s : 1: rewriter_after_opt_a 0.53% : 0.000067s : 1: rewriter_before_opt_a 0.59% : 0.000075s : 1: symbol_engine_optimizer 32.37% : 0.004096s : 1: type_inference TotalTime = 0.0113977, [30] [bootstrap]: 0.00023915 [type_inference]: 0.00412034 [event_method]: 1.687e-05 [auto_monad]: 6.253e-05 [graph_reusing]: 5.76e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 3.825e-05 [rewriter_before_opt_a]: 7.2e-05 [expand_dump_flag]: 2.68003e-06 [jit_opt_a]: 0.00482987, [2] [Cycle 1]: 0.00147464, [27] [switch_simplify]: 9.286e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00051498 [with_stream_mark]: 1.516e-05 [recompute_prepare]: 7.15e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 6.17999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.35e-05 [j_node_and_user_rematch]: 8.60001e-06 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00051678 [add_forward_monad_depend]: 4.62e-06 [auto_monad_grad]: 1.98002e-06 [auto_monad_eliminator]: 1.378e-05 [cse]: 2.474e-05 [replace_applicator]: 1.151e-05 [Cycle 2]: 0.00031177, [27] [switch_simplify]: 5.69e-06 [loop_unroll]: 5.12999e-06 [a_1]: 9.099e-05 [with_stream_mark]: 8.43999e-06 [recompute_prepare]: 5.13002e-06 [updatestate_depend_eliminate]: 2.49001e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 2.13002e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 5.16998e-06 [updatestate_useless_node_eliminater]: 4.67998e-06 [accelerated_algorithm]: 4.77998e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.198e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.48999e-06 [inline_without_move]: 4.53999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 1.046e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 8.04002e-06 [rewriter_after_opt_a]: 2.997e-05 [convert_after_rewriter]: 7.18998e-06 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00048039 [jit_opt_b]: 5.076e-05, [1] [Cycle 1]: 4.404e-05, [2] [frontend_op_eliminate]: 1.629e-05 [inline_after_opt_a]: 1.576e-05 [cconv]: 2.456e-05 [loop_unroll]: 0.00040619 [jit_opt_after_cconv]: 0.00015289, [1] [Cycle 1]: 0.00014666, [11] [c_1]: 2.119e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 5.81998e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 1.896e-05 [call_graph_tuple_transform]: 1.889e-05 [tuple_list_get_item_eliminator]: 5.24998e-06 [none_parameter_eliminate]: 1.97999e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 1.821e-05 [remove_dup_value]: 1.524e-05 [partial_unused_args_eliminate]: 2.63003e-06 [environ_conv]: 5.96e-06 [add_recomputation]: 4.768e-05 [cse_after_recomputation]: 2.211e-05, [1] [Cycle 1]: 1.655e-05, [1] [cse]: 1.084e-05 [auto_monad_reorder]: 1.479e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 4.26001e-06 [opt_after_jit_grad]: 0.00047442 [symbol_engine_optimizer]: 6.963e-05, [1] [Cycle 1]: 6.36e-05, [6] [build]: 3.21999e-06 [elim_shapecalc]: 7.49002e-06 [elim_not_effective]: 1.246e-05 [opt_reshape]: 5.47999e-06 [fold_const_symbol]: 8.27e-06 [renormalize]: 3.7998e-07 [validate]: 3.366e-05 Sums bootstrap : 0.000239s : 3.06% type_inference : 0.004120s : 52.71% event_method : 0.000017s : 0.22% auto_monad : 0.000063s : 0.80% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000038s : 0.49% rewriter_before_opt_a : 0.000072s : 0.92% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000099s : 1.26% jit_opt_a.loop_unroll : 0.000036s : 0.46% jit_opt_a.a_1 : 0.000606s : 7.75% jit_opt_a.with_stream_mark : 0.000024s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000517s : 6.61% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000035s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.38% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000480s : 6.15% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000025s : 0.31% loop_unroll : 0.000406s : 5.20% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000018s : 0.23% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000048s : 0.61% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000474s : 6.07% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.43% Time group info: ------[substitution.] 0.000187 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000005s : 3: substitution.graph_param_transform 83.34% : 0.000156s : 4: substitution.inline 1.42% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000005s : 4: substitution.remove_not_recompute_node 1.96% : 0.000004s : 2: substitution.replace_old_param 6.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004068 2 79.40% : 0.003230s : 1: type_inference.infer 20.60% : 0.000838s : 1: type_inference.specialize ------[replace.] 0.000066 6 65.79% : 0.000043s : 4: replace.inline 34.21% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.27% : 0.000154s : 4: match.inline 6.73% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.22% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.82% : 0.000007s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.33% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.22% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.10% : 0.000002s : 15: predicate.partial_eliminate 1.36% : 0.000002s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.64% : 0.000002s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.86% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000622 13 45.16% : 0.000281s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.36% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 50.49% : 0.000314s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012845 72 0.39% : 0.000051s : 1: add_recomputation 0.51% : 0.000066s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 1.95% : 0.000251s : 1: bootstrap 0.21% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.62% : 0.004832s : 1: jit_opt_a 1.21% : 0.000156s : 1: jit_opt_after_cconv 0.41% : 0.000053s : 1: jit_opt_b 3.23% : 0.000415s : 1: loop_unroll 3.82% : 0.000491s : 1: mutable_eliminate 6.62% : 0.000851s : 26: opt.transform.jit_opt_a 0.47% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000014s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.75% : 0.000482s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000041s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 2.06% : 0.000265s : 1: renormalize.infer 1.90% : 0.000244s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000033s : 1: rewriter_after_opt_a 0.58% : 0.000075s : 1: rewriter_before_opt_a 0.56% : 0.000072s : 1: symbol_engine_optimizer 32.16% : 0.004131s : 1: type_inference TotalTime = 0.0115673, [30] [bootstrap]: 0.00027658 [type_inference]: 0.00433777 [event_method]: 1.615e-05 [auto_monad]: 5.857e-05 [graph_reusing]: 5.30001e-06 [pre_auto_parallel]: 2.28998e-06 [py_interpret_to_execute]: 3.664e-05 [rewriter_before_opt_a]: 0.00011264 [expand_dump_flag]: 2.53e-06 [jit_opt_a]: 0.00476175, [2] [Cycle 1]: 0.00139045, [27] [switch_simplify]: 4.461e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00048775 [with_stream_mark]: 1.118e-05 [recompute_prepare]: 6.74001e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 2.78003e-06 [cell_reuse_recompute_pass]: 8.79983e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.07e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 0.00053554 [add_forward_monad_depend]: 4.38999e-06 [auto_monad_grad]: 1.33002e-06 [auto_monad_eliminator]: 1.13e-05 [cse]: 1.839e-05 [replace_applicator]: 1.045e-05 [Cycle 2]: 0.00031032, [27] [switch_simplify]: 5.39e-06 [loop_unroll]: 4.70001e-06 [a_1]: 8.949e-05 [with_stream_mark]: 8.77999e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.66e-06 [updatestate_assign_eliminate]: 2.06998e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 4.88001e-06 [meta_shard_fg_expand]: 1.06997e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.40999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.202e-05 [j_node_and_user_rematch]: 7.87e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 4.59998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.02e-05 [replace_applicator]: 4.81002e-06 [py_interpret_to_execute_after_opt_a]: 7.96001e-06 [rewriter_after_opt_a]: 2.627e-05 [convert_after_rewriter]: 5.67999e-06 [order_py_execute_after_rewriter]: 4.09002e-06 [mutable_eliminate]: 0.00047943 [jit_opt_b]: 4.794e-05, [1] [Cycle 1]: 4.204e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.513e-05 [cconv]: 1.906e-05 [loop_unroll]: 0.00040844 [jit_opt_after_cconv]: 0.0001428, [1] [Cycle 1]: 0.00013659, [11] [c_1]: 2.064e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.867e-05 [call_graph_tuple_transform]: 1.956e-05 [tuple_list_get_item_eliminator]: 5.93002e-06 [none_parameter_eliminate]: 1.32e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.019e-05 [partial_unused_args_eliminate]: 2.24001e-06 [environ_conv]: 4.37998e-06 [add_recomputation]: 4.195e-05 [cse_after_recomputation]: 2.331e-05, [1] [Cycle 1]: 1.767e-05, [1] [cse]: 1.142e-05 [auto_monad_reorder]: 1.203e-05 [get_jit_bprop_graph]: 1.68002e-06 [rewriter_after_jit_bprop_graph]: 4.22003e-06 [opt_after_jit_grad]: 0.00045119 [symbol_engine_optimizer]: 7.01e-05, [1] [Cycle 1]: 6.408e-05, [6] [build]: 2.76999e-06 [elim_shapecalc]: 7.74002e-06 [elim_not_effective]: 1.272e-05 [opt_reshape]: 5.49e-06 [fold_const_symbol]: 8.27e-06 [renormalize]: 2.40019e-07 [validate]: 2.905e-05 Sums bootstrap : 0.000277s : 3.48% type_inference : 0.004338s : 54.53% event_method : 0.000016s : 0.20% auto_monad : 0.000059s : 0.74% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.46% rewriter_before_opt_a : 0.000113s : 1.42% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000050s : 0.63% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000577s : 7.26% jit_opt_a.with_stream_mark : 0.000020s : 0.25% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000536s : 6.73% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.21% jit_opt_a.cse : 0.000029s : 0.36% jit_opt_a.replace_applicator : 0.000015s : 0.19% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000026s : 0.33% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000479s : 6.03% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000019s : 0.24% loop_unroll : 0.000408s : 5.13% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.25% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000010s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000004s : 0.06% add_recomputation : 0.000042s : 0.53% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000012s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000451s : 5.67% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.37% Time group info: ------[substitution.] 0.000162 23 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000004s : 3: substitution.graph_param_transform 82.84% : 0.000135s : 4: substitution.inline 1.89% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000004s : 4: substitution.remove_not_recompute_node 2.19% : 0.000004s : 2: substitution.replace_old_param 5.96% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004283 2 82.19% : 0.003520s : 1: type_inference.infer 17.81% : 0.000763s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.36% : 0.000043s : 4: replace.inline 33.64% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 93.93% : 0.000132s : 4: match.inline 6.07% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.27% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.21% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 2.27% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.36% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.82% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.88% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.24% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000563 13 50.87% : 0.000287s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.85% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.28% : 0.000249s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012944 72 0.35% : 0.000045s : 1: add_recomputation 0.48% : 0.000062s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 2.23% : 0.000289s : 1: bootstrap 0.17% : 0.000022s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.20% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 36.81% : 0.004765s : 1: jit_opt_a 1.12% : 0.000145s : 1: jit_opt_after_cconv 0.39% : 0.000051s : 1: jit_opt_b 3.22% : 0.000417s : 1: loop_unroll 3.77% : 0.000488s : 1: mutable_eliminate 5.97% : 0.000772s : 26: opt.transform.jit_opt_a 0.38% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000460s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.18% : 0.000024s : 1: remove_dup_value 2.19% : 0.000284s : 1: renormalize.infer 1.90% : 0.000246s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000029s : 1: rewriter_after_opt_a 0.90% : 0.000116s : 1: rewriter_before_opt_a 0.56% : 0.000073s : 1: symbol_engine_optimizer 33.60% : 0.004349s : 1: type_inference TotalTime = 0.0115029, [30] [bootstrap]: 0.00026546 [type_inference]: 0.00421189 [event_method]: 1.708e-05 [auto_monad]: 6.073e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 3.535e-05 [rewriter_before_opt_a]: 7.114e-05 [expand_dump_flag]: 2.91999e-06 [jit_opt_a]: 0.00482859, [2] [Cycle 1]: 0.00141852, [27] [switch_simplify]: 5.06e-05 [loop_unroll]: 3.005e-05 [a_1]: 0.00048928 [with_stream_mark]: 1.497e-05 [recompute_prepare]: 7.73999e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.16998e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.10999e-06 [merge_forward]: 3.72998e-06 [cell_reuse_recompute_pass]: 1.16997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.393e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 0.00053039 [add_forward_monad_depend]: 4.92999e-06 [auto_monad_grad]: 2.15002e-06 [auto_monad_eliminator]: 1.41e-05 [cse]: 2.45e-05 [replace_applicator]: 1.146e-05 [Cycle 2]: 0.00032796, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.75001e-06 [a_1]: 8.943e-05 [with_stream_mark]: 8.29002e-06 [recompute_prepare]: 4.84e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.63001e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.248e-05 [j_node_and_user_rematch]: 8.13999e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.93999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.198e-05 [replace_applicator]: 5.52999e-06 [py_interpret_to_execute_after_opt_a]: 8.21002e-06 [rewriter_after_opt_a]: 3.152e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 4.90001e-06 [mutable_eliminate]: 0.00048555 [jit_opt_b]: 4.987e-05, [1] [Cycle 1]: 4.284e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 1.571e-05 [cconv]: 2.404e-05 [loop_unroll]: 0.00042165 [jit_opt_after_cconv]: 0.00015046, [1] [Cycle 1]: 0.00014418, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.879e-05 [call_graph_tuple_transform]: 1.737e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.37001e-06 [remove_dup_value]: 1.523e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 5.24e-06 [add_recomputation]: 4.81e-05 [cse_after_recomputation]: 2.163e-05, [1] [Cycle 1]: 1.607e-05, [1] [cse]: 1.025e-05 [auto_monad_reorder]: 1.566e-05 [get_jit_bprop_graph]: 1.43002e-06 [rewriter_after_jit_bprop_graph]: 4.57998e-06 [opt_after_jit_grad]: 0.00044727 [symbol_engine_optimizer]: 7.001e-05, [1] [Cycle 1]: 6.431e-05, [6] [build]: 2.61999e-06 [elim_shapecalc]: 7.56999e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 5.85002e-06 [fold_const_symbol]: 8.51002e-06 [renormalize]: 3.59985e-07 [validate]: 3.222e-05 Sums bootstrap : 0.000265s : 3.38% type_inference : 0.004212s : 53.61% event_method : 0.000017s : 0.22% auto_monad : 0.000061s : 0.77% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.04% py_interpret_to_execute : 0.000035s : 0.45% rewriter_before_opt_a : 0.000071s : 0.91% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000056s : 0.72% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000579s : 7.37% jit_opt_a.with_stream_mark : 0.000023s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.22% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000530s : 6.75% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.26% jit_opt_a.cse : 0.000036s : 0.46% jit_opt_a.replace_applicator : 0.000017s : 0.22% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000032s : 0.40% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000486s : 6.18% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000024s : 0.31% loop_unroll : 0.000422s : 5.37% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000048s : 0.61% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000016s : 0.20% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000447s : 5.69% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.41% Time group info: ------[substitution.] 0.000170 23 1.37% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000005s : 3: substitution.graph_param_transform 81.47% : 0.000139s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.67% : 0.000005s : 2: substitution.replace_old_param 6.46% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004158 2 81.09% : 0.003372s : 1: type_inference.infer 18.91% : 0.000786s : 1: type_inference.specialize ------[replace.] 0.000062 6 65.15% : 0.000041s : 4: replace.inline 34.85% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000146 6 93.20% : 0.000136s : 4: match.inline 6.80% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.23% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.42% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.56% : 0.000006s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.12% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.46% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.73% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.00% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000552 13 50.74% : 0.000280s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.97% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.29% : 0.000245s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012881 72 0.40% : 0.000051s : 1: add_recomputation 0.50% : 0.000064s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.18% : 0.000281s : 1: bootstrap 0.21% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.51% : 0.004831s : 1: jit_opt_a 1.19% : 0.000153s : 1: jit_opt_after_cconv 0.41% : 0.000052s : 1: jit_opt_b 3.33% : 0.000429s : 1: loop_unroll 3.84% : 0.000494s : 1: mutable_eliminate 6.07% : 0.000782s : 26: opt.transform.jit_opt_a 0.36% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.54% : 0.000455s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.04% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000038s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 2.11% : 0.000271s : 1: renormalize.infer 1.95% : 0.000251s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000034s : 1: rewriter_after_opt_a 0.57% : 0.000074s : 1: rewriter_before_opt_a 0.56% : 0.000072s : 1: symbol_engine_optimizer 32.79% : 0.004223s : 1: type_inference TotalTime = 0.131653, [30] [bootstrap]: 0.00027003 [type_inference]: 0.120506 [event_method]: 2.295e-05 [auto_monad]: 7.793e-05 [graph_reusing]: 6.56e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00050445 [rewriter_before_opt_a]: 0.00010228 [expand_dump_flag]: 3.66001e-06 [jit_opt_a]: 0.00784737, [2] [Cycle 1]: 0.00390145, [27] [switch_simplify]: 5.963e-05 [loop_unroll]: 4.02e-05 [a_1]: 0.00071577 [with_stream_mark]: 1.584e-05 [recompute_prepare]: 9.17001e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 7.18e-06 [updatestate_useless_node_eliminater]: 1.288e-05 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.36998e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.545e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 6.39999e-06 [renormalize]: 0.00271185 [add_forward_monad_depend]: 5.56e-06 [auto_monad_grad]: 1.74998e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 3.348e-05 [replace_applicator]: 1.393e-05 [Cycle 2]: 0.00039965, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 6.33998e-06 [a_1]: 0.0001332 [with_stream_mark]: 9.15999e-06 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.91003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.268e-05 [j_node_and_user_rematch]: 9.71e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.48001e-06 [inline_without_move]: 5.66e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 1.241e-05 [cse]: 1.388e-05 [replace_applicator]: 6.02999e-06 [py_interpret_to_execute_after_opt_a]: 8.86997e-06 [rewriter_after_opt_a]: 3.281e-05 [convert_after_rewriter]: 7.15e-06 [order_py_execute_after_rewriter]: 5.26002e-06 [mutable_eliminate]: 0.00056497 [jit_opt_b]: 8.251e-05, [1] [Cycle 1]: 7.621e-05, [2] [frontend_op_eliminate]: 4.517e-05 [inline_after_opt_a]: 1.797e-05 [cconv]: 2.505e-05 [loop_unroll]: 0.00046594 [jit_opt_after_cconv]: 0.00015959, [1] [Cycle 1]: 0.00015312, [11] [c_1]: 2.606e-05 [parameter_eliminate]: 2.83e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.33002e-06 [cse]: 2.214e-05 [call_graph_tuple_transform]: 2.003e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 1.722e-05 [partial_unused_args_eliminate]: 8.87999e-06 [environ_conv]: 7.54002e-06 [add_recomputation]: 4.549e-05 [cse_after_recomputation]: 2.451e-05, [1] [Cycle 1]: 1.897e-05, [1] [cse]: 1.249e-05 [auto_monad_reorder]: 1.685e-05 [get_jit_bprop_graph]: 2.32001e-06 [rewriter_after_jit_bprop_graph]: 4.49998e-06 [opt_after_jit_grad]: 0.00051777 [symbol_engine_optimizer]: 7.811e-05, [1] [Cycle 1]: 7.132e-05, [6] [build]: 3.32997e-06 [elim_shapecalc]: 9.49999e-06 [elim_not_effective]: 1.518e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 9.51e-06 [renormalize]: 4.60015e-07 [validate]: 5.033e-05 Sums bootstrap : 0.000270s : 0.21% type_inference : 0.120506s : 94.52% event_method : 0.000023s : 0.02% auto_monad : 0.000078s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000504s : 0.40% rewriter_before_opt_a : 0.000102s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.05% jit_opt_a.loop_unroll : 0.000047s : 0.04% jit_opt_a.a_1 : 0.000849s : 0.67% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000019s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002712s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000565s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000045s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000466s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000009s : 0.01% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000518s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000269 28 1.35% : 0.000004s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000006s : 4: substitution.graph_param_transform 83.77% : 0.000225s : 5: substitution.inline 1.26% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.90% : 0.000010s : 3: substitution.reduce_eliminate 1.80% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000004s : 2: substitution.replace_old_param 3.79% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.120421 2 97.47% : 0.117375s : 1: type_inference.infer 2.53% : 0.003046s : 1: type_inference.specialize ------[replace.] 0.000103 7 65.30% : 0.000067s : 5: replace.inline 34.70% : 0.000036s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000231 7 96.09% : 0.000222s : 5: match.inline 3.91% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.34% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.31% : 0.000002s : 13: predicate.addn_zero_filter 1.82% : 0.000003s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.16% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 5.76% : 0.000008s : 13: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.06% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.91% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.37% : 0.000008s : 28: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 19: predicate.load_eliminater 1.09% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.09% : 0.000002s : 13: predicate.merge_addn 1.09% : 0.000002s : 13: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 19: predicate.partial_eliminate 1.09% : 0.000002s : 13: predicate.print_const_string_wrapper 2.05% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 1.87% : 0.000003s : 23: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 13: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.77% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000004s : 20: predicate.switch_defer_inline 2.13% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.96% : 0.000010s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.38% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 13: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002321 25 64.99% : 0.001508s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.18% : 0.000074s : 2: func_graph_cloner_run.FuncGraphClonerNode 31.83% : 0.000739s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.135561 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000082s : 1: auto_monad 0.01% : 0.000019s : 1: auto_monad_reorder 0.21% : 0.000281s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000011s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.79% : 0.007851s : 1: jit_opt_a 0.12% : 0.000162s : 1: jit_opt_after_cconv 0.06% : 0.000085s : 1: jit_opt_b 0.35% : 0.000474s : 1: loop_unroll 0.42% : 0.000573s : 1: mutable_eliminate 0.81% : 0.001104s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000057s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000011s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000519s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.47% : 0.001998s : 1: renormalize.infer 0.52% : 0.000705s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000107s : 1: rewriter_before_opt_a 0.06% : 0.000080s : 1: symbol_engine_optimizer 88.91% : 0.120522s : 1: type_inference TotalTime = 0.0112153, [30] [bootstrap]: 0.00027196 [type_inference]: 0.00431282 [event_method]: 1.655e-05 [auto_monad]: 5.389e-05 [graph_reusing]: 4.97999e-06 [pre_auto_parallel]: 1.81003e-06 [py_interpret_to_execute]: 3.361e-05 [rewriter_before_opt_a]: 6.604e-05 [expand_dump_flag]: 2.46e-06 [jit_opt_a]: 0.00453389, [2] [Cycle 1]: 0.001333, [27] [switch_simplify]: 4.373e-05 [loop_unroll]: 2.993e-05 [a_1]: 0.0004727 [with_stream_mark]: 1.198e-05 [recompute_prepare]: 7.23999e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 5.04003e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.136e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.49002e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00049647 [add_forward_monad_depend]: 3.97998e-06 [auto_monad_grad]: 1.52001e-06 [auto_monad_eliminator]: 1.088e-05 [cse]: 1.613e-05 [replace_applicator]: 1.088e-05 [Cycle 2]: 0.00030964, [27] [switch_simplify]: 5.77001e-06 [loop_unroll]: 4.83001e-06 [a_1]: 8.887e-05 [with_stream_mark]: 8.13001e-06 [recompute_prepare]: 5.25999e-06 [updatestate_depend_eliminate]: 2.78998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 4.80999e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.236e-05 [j_node_and_user_rematch]: 7.62002e-06 [meta_fg_expand]: 1.44e-06 [replace_old_param]: 7.2e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 8.89995e-07 [auto_monad_grad]: 5.50004e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 9.84999e-06 [replace_applicator]: 4.94e-06 [py_interpret_to_execute_after_opt_a]: 7.66999e-06 [rewriter_after_opt_a]: 2.653e-05 [convert_after_rewriter]: 5.44e-06 [order_py_execute_after_rewriter]: 4.31002e-06 [mutable_eliminate]: 0.00046585 [jit_opt_b]: 4.919e-05, [1] [Cycle 1]: 4.318e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.643e-05 [cconv]: 1.841e-05 [loop_unroll]: 0.00040081 [jit_opt_after_cconv]: 0.00013577, [1] [Cycle 1]: 0.00013002, [11] [c_1]: 2.123e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.798e-05 [call_graph_tuple_transform]: 1.771e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.37999e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.28002e-06 [remove_dup_value]: 1.023e-05 [partial_unused_args_eliminate]: 1.79e-06 [environ_conv]: 4.26001e-06 [add_recomputation]: 3.595e-05 [cse_after_recomputation]: 2.15e-05, [1] [Cycle 1]: 1.602e-05, [1] [cse]: 1.016e-05 [auto_monad_reorder]: 1.176e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 3.85e-06 [opt_after_jit_grad]: 0.00045196 [symbol_engine_optimizer]: 7.104e-05, [1] [Cycle 1]: 6.497e-05, [6] [build]: 3.11999e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.243e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.30999e-06 [renormalize]: 3.00002e-07 [validate]: 2.731e-05 Sums bootstrap : 0.000272s : 3.50% type_inference : 0.004313s : 55.43% event_method : 0.000017s : 0.21% auto_monad : 0.000054s : 0.69% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.43% rewriter_before_opt_a : 0.000066s : 0.85% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000049s : 0.64% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000562s : 7.22% jit_opt_a.with_stream_mark : 0.000020s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000497s : 6.38% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.21% jit_opt_a.cse : 0.000026s : 0.33% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000027s : 0.34% convert_after_rewriter : 0.000005s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000466s : 5.99% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000018s : 0.24% loop_unroll : 0.000401s : 5.15% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000010s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000036s : 0.46% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000012s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000452s : 5.81% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.35% Time group info: ------[substitution.] 0.000157 23 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000004s : 3: substitution.graph_param_transform 82.48% : 0.000129s : 4: substitution.inline 1.76% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.84% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 6.30% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004263 2 82.26% : 0.003507s : 1: type_inference.infer 17.74% : 0.000756s : 1: type_inference.specialize ------[replace.] 0.000061 6 65.12% : 0.000040s : 4: replace.inline 34.88% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000136 6 93.51% : 0.000127s : 4: match.inline 6.49% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.22% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.49% : 0.000002s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000001s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.71% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.12% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.35% : 0.000008s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.55% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.26% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000553 13 53.25% : 0.000294s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.70% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.05% : 0.000233s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012529 72 0.31% : 0.000039s : 1: add_recomputation 0.45% : 0.000057s : 1: auto_monad 0.11% : 0.000014s : 1: auto_monad_reorder 2.28% : 0.000285s : 1: bootstrap 0.17% : 0.000021s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 36.21% : 0.004537s : 1: jit_opt_a 1.10% : 0.000138s : 1: jit_opt_after_cconv 0.41% : 0.000052s : 1: jit_opt_b 3.26% : 0.000408s : 1: loop_unroll 3.79% : 0.000474s : 1: mutable_eliminate 6.04% : 0.000757s : 26: opt.transform.jit_opt_a 0.37% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.18% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.69% : 0.000462s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000013s : 1: remove_dup_value 2.02% : 0.000253s : 1: renormalize.infer 1.89% : 0.000237s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000029s : 1: rewriter_after_opt_a 0.55% : 0.000069s : 1: rewriter_before_opt_a 0.59% : 0.000073s : 1: symbol_engine_optimizer 34.51% : 0.004323s : 1: type_inference TotalTime = 0.122177, [30] [bootstrap]: 0.00027231 [type_inference]: 0.110595 [event_method]: 2.054e-05 [auto_monad]: 6.292e-05 [graph_reusing]: 5.25999e-06 [pre_auto_parallel]: 2.09e-06 [py_interpret_to_execute]: 0.00044839 [rewriter_before_opt_a]: 8.871e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00761779, [2] [Cycle 1]: 0.00377356, [27] [switch_simplify]: 5.049e-05 [loop_unroll]: 3.358e-05 [a_1]: 0.00063189 [with_stream_mark]: 1.454e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 3.17997e-06 [updatestate_assign_eliminate]: 2.61999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 7.38999e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.13998e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.271e-05 [j_node_and_user_rematch]: 1.013e-05 [meta_fg_expand]: 2.43002e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 6.21998e-06 [renormalize]: 0.00272191 [add_forward_monad_depend]: 4.85999e-06 [auto_monad_grad]: 2.54999e-06 [auto_monad_eliminator]: 1.37e-05 [cse]: 2.731e-05 [replace_applicator]: 1.367e-05 [Cycle 2]: 0.00036772, [27] [switch_simplify]: 7.17002e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.00012702 [with_stream_mark]: 1.003e-05 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 2.86e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.98998e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.66002e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.248e-05 [j_node_and_user_rematch]: 8.33001e-06 [meta_fg_expand]: 1.91998e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.323e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 1.059e-05 [rewriter_after_opt_a]: 3.499e-05 [convert_after_rewriter]: 6.28e-06 [order_py_execute_after_rewriter]: 4.64002e-06 [mutable_eliminate]: 0.00115813 [jit_opt_b]: 5.638e-05, [1] [Cycle 1]: 4.909e-05, [2] [frontend_op_eliminate]: 1.939e-05 [inline_after_opt_a]: 1.824e-05 [cconv]: 2.396e-05 [loop_unroll]: 0.00059396 [jit_opt_after_cconv]: 0.00015651, [1] [Cycle 1]: 0.00014992, [11] [c_1]: 2.67e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 2.193e-05 [call_graph_tuple_transform]: 2.176e-05 [tuple_list_get_item_eliminator]: 6.51999e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 4.60015e-07 [switch_simplify]: 7.75e-06 [remove_dup_value]: 1.513e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 7.7e-06 [add_recomputation]: 4.524e-05 [cse_after_recomputation]: 2.299e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.284e-05 [auto_monad_reorder]: 1.827e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 6.26e-06 [opt_after_jit_grad]: 0.00048258 [symbol_engine_optimizer]: 0.00013946, [1] [Cycle 1]: 0.00013304, [6] [build]: 3.36001e-06 [elim_shapecalc]: 9.82001e-06 [elim_not_effective]: 1.389e-05 [opt_reshape]: 6.282e-05 [fold_const_symbol]: 1.139e-05 [renormalize]: 4.20026e-07 [validate]: 4.215e-05 Sums bootstrap : 0.000272s : 0.23% type_inference : 0.110595s : 93.67% event_method : 0.000021s : 0.02% auto_monad : 0.000063s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000448s : 0.38% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000759s : 0.64% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002722s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000041s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.001158s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000594s : 0.50% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000483s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000063s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000224 28 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000005s : 4: substitution.graph_param_transform 82.60% : 0.000185s : 5: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.29% : 0.000010s : 3: substitution.reduce_eliminate 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 3.98% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110534 2 97.44% : 0.107709s : 1: type_inference.infer 2.56% : 0.002825s : 1: type_inference.specialize ------[replace.] 0.000089 7 68.69% : 0.000061s : 5: replace.inline 31.31% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 7 95.94% : 0.000182s : 5: match.inline 4.06% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.32% : 0.000002s : 13: predicate.addn_zero_filter 1.86% : 0.000003s : 13: predicate.arithmetic_simplify 1.25% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.19% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.54% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_depend_swap 1.28% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000001s : 13: predicate.environ_get_set_eliminate 0.37% : 0.000001s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000007s : 28: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 19: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 17: predicate.make_slice_get_slice_eliminator 1.12% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000001s : 13: predicate.minmaximum_grad 1.75% : 0.000002s : 4: predicate.mutable_eliminate 0.77% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.08% : 0.000003s : 13: predicate.reduce_eliminate 1.43% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 23: predicate.replace_applicator 0.59% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 13: predicate.reshape_eliminate 1.31% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.15% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.21% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.24% : 0.000010s : 64: predicate.switch_simplify 1.35% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.40% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002350 25 65.27% : 0.001534s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.60% : 0.000061s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.13% : 0.000755s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.126008 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000066s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000286s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.05% : 0.007621s : 1: jit_opt_a 0.13% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.48% : 0.000603s : 1: loop_unroll 0.96% : 0.001212s : 1: mutable_eliminate 0.78% : 0.000987s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000095s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000454s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.56% : 0.001968s : 1: renormalize.infer 0.59% : 0.000746s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000094s : 1: rewriter_before_opt_a 0.11% : 0.000142s : 1: symbol_engine_optimizer 87.78% : 0.110608s : 1: type_inference TotalTime = 0.0173277, [30] [bootstrap]: 0.00028631 [type_inference]: 0.00882999 [event_method]: 1.785e-05 [auto_monad]: 4.99e-05 [graph_reusing]: 3.76001e-06 [pre_auto_parallel]: 1.90001e-06 [py_interpret_to_execute]: 3.975e-05 [rewriter_before_opt_a]: 0.00010494 [expand_dump_flag]: 2.29999e-06 [jit_opt_a]: 0.00566845, [2] [Cycle 1]: 0.00222472, [27] [switch_simplify]: 4.92e-05 [loop_unroll]: 3.338e-05 [a_1]: 0.00062171 [with_stream_mark]: 1.253e-05 [recompute_prepare]: 8.43999e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.222e-05 [j_node_and_user_rematch]: 9.04998e-06 [meta_fg_expand]: 2.04999e-06 [replace_old_param]: 8.47998e-06 [inline_without_move]: 5.51998e-06 [renormalize]: 0.00116207 [add_forward_monad_depend]: 6.41e-06 [auto_monad_grad]: 2.14e-06 [auto_monad_eliminator]: 1.722e-05 [cse]: 3.62e-05 [replace_applicator]: 1.439e-05 [Cycle 2]: 0.00034762, [27] [switch_simplify]: 5.87999e-06 [loop_unroll]: 5.15999e-06 [a_1]: 0.00010823 [with_stream_mark]: 1.043e-05 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.17e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.10001e-06 [meta_shard_fg_expand]: 1.06002e-06 [get_grad_eliminate_]: 1.169e-05 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.061e-05 [j_node_and_user_rematch]: 7.83999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 6.91999e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 9.20001e-07 [auto_monad_eliminator]: 6.22001e-06 [cse]: 1.359e-05 [replace_applicator]: 5.22e-06 [py_interpret_to_execute_after_opt_a]: 8.13001e-06 [rewriter_after_opt_a]: 3.304e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00049434 [jit_opt_b]: 4.749e-05, [1] [Cycle 1]: 4.131e-05, [2] [frontend_op_eliminate]: 1.528e-05 [inline_after_opt_a]: 1.555e-05 [cconv]: 2.066e-05 [loop_unroll]: 0.00045302 [jit_opt_after_cconv]: 0.0001665, [1] [Cycle 1]: 0.00015973, [11] [c_1]: 2.168e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.56002e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.155e-05 [call_graph_tuple_transform]: 1.782e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 1.233e-05 [remove_dup_value]: 1.468e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 5.22999e-06 [add_recomputation]: 4.416e-05 [cse_after_recomputation]: 2.246e-05, [1] [Cycle 1]: 1.702e-05, [1] [cse]: 1.159e-05 [auto_monad_reorder]: 1.691e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 4.42e-06 [opt_after_jit_grad]: 0.00070819 [symbol_engine_optimizer]: 7.36e-05, [1] [Cycle 1]: 6.706e-05, [6] [build]: 3.68e-06 [elim_shapecalc]: 7.75998e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 5.65001e-06 [fold_const_symbol]: 8.78001e-06 [renormalize]: 4.19997e-07 [validate]: 3.415e-05 Sums bootstrap : 0.000286s : 2.10% type_inference : 0.008830s : 64.74% event_method : 0.000018s : 0.13% auto_monad : 0.000050s : 0.37% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000040s : 0.29% rewriter_before_opt_a : 0.000105s : 0.77% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000055s : 0.40% jit_opt_a.loop_unroll : 0.000039s : 0.28% jit_opt_a.a_1 : 0.000730s : 5.35% jit_opt_a.with_stream_mark : 0.000023s : 0.17% jit_opt_a.recompute_prepare : 0.000014s : 0.10% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.03% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.08% jit_opt_a.accelerated_algorithm : 0.000011s : 0.08% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000017s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.04% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.17% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.12% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.11% jit_opt_a.inline_without_move : 0.000010s : 0.08% jit_opt_a.renormalize : 0.001162s : 8.52% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.17% jit_opt_a.cse : 0.000050s : 0.37% jit_opt_a.replace_applicator : 0.000020s : 0.14% py_interpret_to_execute_after_opt_a : 0.000008s : 0.06% rewriter_after_opt_a : 0.000033s : 0.24% convert_after_rewriter : 0.000007s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000494s : 3.62% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.11% jit_opt_b.inline_after_opt_a : 0.000016s : 0.11% cconv : 0.000021s : 0.15% loop_unroll : 0.000453s : 3.32% jit_opt_after_cconv.c_1 : 0.000022s : 0.16% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.16% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000012s : 0.09% remove_dup_value : 0.000015s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000044s : 0.32% cse_after_recomputation.cse : 0.000012s : 0.08% auto_monad_reorder : 0.000017s : 0.12% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000708s : 5.19% symbol_engine_optimizer.build : 0.000004s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.06% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.25% Time group info: ------[substitution.] 0.000226 27 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000005s : 3: substitution.graph_param_transform 84.37% : 0.000191s : 5: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.29% : 0.000010s : 3: substitution.reduce_eliminate 1.73% : 0.000004s : 4: substitution.remove_not_recompute_node 1.45% : 0.000003s : 2: substitution.replace_old_param 2.99% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.008765 2 88.59% : 0.007765s : 1: type_inference.infer 11.41% : 0.001000s : 1: type_inference.specialize ------[replace.] 0.000096 7 71.10% : 0.000068s : 5: replace.inline 28.90% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 7 97.08% : 0.000188s : 5: match.inline 2.92% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.36% : 0.000002s : 11: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.39% : 0.000002s : 11: predicate.addn_zero_filter 2.14% : 0.000003s : 11: predicate.arithmetic_simplify 1.43% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.24% : 0.000001s : 11: predicate.compare_switch_simplify 1.24% : 0.000001s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 11: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 11: predicate.environ_get_depend_swap 1.26% : 0.000002s : 11: predicate.environ_get_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000007s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.00% : 0.000001s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 16: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.44% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.34% : 0.000002s : 11: predicate.print_const_string_wrapper 2.34% : 0.000003s : 11: predicate.reduce_eliminate 1.43% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.35% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.55% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 59: predicate.switch_simplify 1.27% : 0.000002s : 11: predicate.tile_eliminate 1.53% : 0.000002s : 11: predicate.transpose_eliminate 1.42% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.77% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 11: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001784 16 79.10% : 0.001411s : 7: func_graph_cloner_run.FuncGraphClonerGraph 3.92% : 0.000070s : 2: func_graph_cloner_run.FuncGraphClonerNode 16.97% : 0.000303s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.019494 72 0.24% : 0.000047s : 1: add_recomputation 0.27% : 0.000053s : 1: auto_monad 0.10% : 0.000019s : 1: auto_monad_reorder 1.53% : 0.000299s : 1: bootstrap 0.12% : 0.000023s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.13% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.11% : 0.000021s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.03% : 0.000006s : 1: graph_reusing 29.09% : 0.005671s : 1: jit_opt_a 0.87% : 0.000169s : 1: jit_opt_after_cconv 0.26% : 0.000050s : 1: jit_opt_b 2.37% : 0.000461s : 1: loop_unroll 2.58% : 0.000503s : 1: mutable_eliminate 4.86% : 0.000947s : 26: opt.transform.jit_opt_a 0.28% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.13% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000014s : 1: opt.transform.mutable_eliminate 0.11% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.67% : 0.000716s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.22% : 0.000042s : 1: py_interpret_to_execute 0.05% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000017s : 1: remove_dup_value 4.28% : 0.000834s : 1: renormalize.infer 1.60% : 0.000312s : 1: renormalize.specialize 0.03% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.18% : 0.000036s : 1: rewriter_after_opt_a 0.56% : 0.000108s : 1: rewriter_before_opt_a 0.39% : 0.000076s : 1: symbol_engine_optimizer 45.35% : 0.008841s : 1: type_inference TotalTime = 0.112227, [30] [bootstrap]: 0.00026586 [type_inference]: 0.102413 [event_method]: 1.744e-05 [auto_monad]: 5.477e-05 [graph_reusing]: 4.72e-06 [pre_auto_parallel]: 1.52001e-06 [py_interpret_to_execute]: 0.00041317 [rewriter_before_opt_a]: 7.654e-05 [expand_dump_flag]: 3.45003e-06 [jit_opt_a]: 0.0068598, [2] [Cycle 1]: 0.0033681, [27] [switch_simplify]: 4.791e-05 [loop_unroll]: 3.056e-05 [a_1]: 0.00055059 [with_stream_mark]: 1.667e-05 [recompute_prepare]: 8.03999e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 2.48002e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 9.39998e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.89998e-06 [inline_without_move]: 6.58e-06 [renormalize]: 0.0024026 [add_forward_monad_depend]: 5.15001e-06 [auto_monad_grad]: 2.09999e-06 [auto_monad_eliminator]: 1.539e-05 [cse]: 2.577e-05 [replace_applicator]: 1.5e-05 [Cycle 2]: 0.0003618, [27] [switch_simplify]: 6.83998e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012296 [with_stream_mark]: 9.92001e-06 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 8.47998e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.242e-05 [replace_applicator]: 6.31998e-06 [py_interpret_to_execute_after_opt_a]: 9.86998e-06 [rewriter_after_opt_a]: 3.278e-05 [convert_after_rewriter]: 6.16998e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.0005306 [jit_opt_b]: 5.771e-05, [1] [Cycle 1]: 5.096e-05, [2] [frontend_op_eliminate]: 1.998e-05 [inline_after_opt_a]: 1.933e-05 [cconv]: 2.354e-05 [loop_unroll]: 0.00042845 [jit_opt_after_cconv]: 0.00014689, [1] [Cycle 1]: 0.00014006, [11] [c_1]: 2.596e-05 [parameter_eliminate]: 2.81e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.13998e-06 [cse]: 1.986e-05 [call_graph_tuple_transform]: 1.911e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.45001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.387e-05 [partial_unused_args_eliminate]: 1.72001e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.116e-05 [cse_after_recomputation]: 2.179e-05, [1] [Cycle 1]: 1.638e-05, [1] [cse]: 1.069e-05 [auto_monad_reorder]: 1.383e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.09998e-06 [opt_after_jit_grad]: 0.00046486 [symbol_engine_optimizer]: 7.356e-05, [1] [Cycle 1]: 6.781e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 9.09998e-06 [elim_not_effective]: 1.281e-05 [opt_reshape]: 6.19999e-06 [fold_const_symbol]: 9.42999e-06 [renormalize]: 5.19998e-07 [validate]: 6.751e-05 Sums bootstrap : 0.000266s : 0.24% type_inference : 0.102413s : 94.35% event_method : 0.000017s : 0.02% auto_monad : 0.000055s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000413s : 0.38% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000674s : 0.62% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002403s : 2.21% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000038s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000531s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000428s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000465s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000068s : 0.06% Time group info: ------[substitution.] 0.000186 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 2.80% : 0.000005s : 4: substitution.graph_param_transform 83.59% : 0.000156s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 5.65% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102351 2 97.61% : 0.099908s : 1: type_inference.infer 2.39% : 0.002443s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.15% : 0.000046s : 4: replace.inline 33.85% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 94.21% : 0.000153s : 4: match.inline 5.79% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.25% : 0.000002s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.59% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 18: predicate.load_eliminater 1.68% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.42% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000002s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.48% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001965 22 64.42% : 0.001266s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.91% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.68% : 0.000662s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115575 72 0.04% : 0.000044s : 1: add_recomputation 0.05% : 0.000058s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000279s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.94% : 0.006863s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.38% : 0.000436s : 1: loop_unroll 0.47% : 0.000539s : 1: mutable_eliminate 0.78% : 0.000897s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.36% : 0.000420s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.47% : 0.001703s : 1: renormalize.infer 0.60% : 0.000691s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 88.62% : 0.102424s : 1: type_inference TotalTime = 0.128586, [30] [bootstrap]: 0.00027359 [type_inference]: 0.117912 [event_method]: 2.205e-05 [auto_monad]: 7.366e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00051861 [rewriter_before_opt_a]: 0.0001032 [expand_dump_flag]: 3.70998e-06 [jit_opt_a]: 0.00743346, [2] [Cycle 1]: 0.00373731, [27] [switch_simplify]: 5.809e-05 [loop_unroll]: 3.476e-05 [a_1]: 0.00065331 [with_stream_mark]: 1.453e-05 [recompute_prepare]: 8.23001e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.77999e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 9.63997e-06 [inline_without_move]: 6.15002e-06 [renormalize]: 0.00263661 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.441e-05 [cse]: 3.265e-05 [replace_applicator]: 1.47e-05 [Cycle 2]: 0.00037204, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 5.82001e-06 [a_1]: 0.00012887 [with_stream_mark]: 9.90002e-06 [recompute_prepare]: 6.43003e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 5.98002e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.13998e-06 [meta_shard_fg_expand]: 1.82999e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 2.06e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.192e-05 [j_node_and_user_rematch]: 8.58001e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.23001e-06 [inline_without_move]: 5.51e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.16002e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.59998e-06 [cse]: 1.331e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 9.66e-06 [rewriter_after_opt_a]: 3.38e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 4.99003e-06 [mutable_eliminate]: 0.00055959 [jit_opt_b]: 5.454e-05, [1] [Cycle 1]: 4.781e-05, [2] [frontend_op_eliminate]: 1.882e-05 [inline_after_opt_a]: 1.801e-05 [cconv]: 2.32e-05 [loop_unroll]: 0.0004292 [jit_opt_after_cconv]: 0.00015003, [1] [Cycle 1]: 0.00014376, [11] [c_1]: 2.595e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 2.144e-05 [call_graph_tuple_transform]: 2.048e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.84998e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.39999e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 1.99999e-06 [environ_conv]: 7.71999e-06 [add_recomputation]: 4.432e-05 [cse_after_recomputation]: 2.283e-05, [1] [Cycle 1]: 1.774e-05, [1] [cse]: 1.222e-05 [auto_monad_reorder]: 1.754e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.67e-06 [opt_after_jit_grad]: 0.00046749 [symbol_engine_optimizer]: 0.00016175, [1] [Cycle 1]: 0.00015495, [6] [build]: 3.28e-06 [elim_shapecalc]: 9.14e-06 [elim_not_effective]: 1.327e-05 [opt_reshape]: 8.726e-05 [fold_const_symbol]: 1.177e-05 [renormalize]: 4.50003e-07 [validate]: 4.657e-05 Sums bootstrap : 0.000274s : 0.22% type_inference : 0.117912s : 94.57% event_method : 0.000022s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000519s : 0.42% rewriter_before_opt_a : 0.000103s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000782s : 0.63% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002637s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000560s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000429s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000467s : 0.37% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000087s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000237 28 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 4: substitution.graph_param_transform 81.94% : 0.000194s : 5: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.82% : 0.000011s : 3: substitution.reduce_eliminate 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.57% : 0.000004s : 2: substitution.replace_old_param 4.71% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117833 2 97.35% : 0.114716s : 1: type_inference.infer 2.65% : 0.003117s : 1: type_inference.specialize ------[replace.] 0.000095 7 69.13% : 0.000065s : 5: replace.inline 30.87% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 7 95.00% : 0.000191s : 5: match.inline 5.00% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.31% : 0.000002s : 13: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 13: predicate.addn_check_dump 1.44% : 0.000002s : 13: predicate.addn_zero_filter 2.18% : 0.000003s : 13: predicate.arithmetic_simplify 1.30% : 0.000002s : 13: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 28: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 19: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.21% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.28% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 2.29% : 0.000003s : 13: predicate.reduce_eliminate 1.65% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 23: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 13: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.20% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 64: predicate.switch_simplify 1.34% : 0.000002s : 13: predicate.tile_eliminate 1.23% : 0.000002s : 13: predicate.transpose_eliminate 1.55% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002260 25 63.84% : 0.001443s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.54% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.62% : 0.000760s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132392 72 0.04% : 0.000047s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.22% : 0.000285s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.62% : 0.007437s : 1: jit_opt_a 0.12% : 0.000153s : 1: jit_opt_after_cconv 0.04% : 0.000057s : 1: jit_opt_b 0.33% : 0.000437s : 1: loop_unroll 0.43% : 0.000568s : 1: mutable_eliminate 0.77% : 0.001019s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000118s : 4: opt.transform.symbol_engine_opt 0.36% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000526s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000019s : 1: remove_dup_value 1.40% : 0.001857s : 1: renormalize.infer 0.58% : 0.000771s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.12% : 0.000165s : 1: symbol_engine_optimizer 89.08% : 0.117928s : 1: type_inference TotalTime = 0.112505, [30] [bootstrap]: 0.00031132 [type_inference]: 0.102744 [event_method]: 1.764e-05 [auto_monad]: 5.37e-05 [graph_reusing]: 4.63999e-06 [pre_auto_parallel]: 1.81e-06 [py_interpret_to_execute]: 0.00043488 [rewriter_before_opt_a]: 7.707e-05 [expand_dump_flag]: 2.81999e-06 [jit_opt_a]: 0.00665929, [2] [Cycle 1]: 0.00330895, [27] [switch_simplify]: 4.614e-05 [loop_unroll]: 3.056e-05 [a_1]: 0.00054011 [with_stream_mark]: 1.494e-05 [recompute_prepare]: 9.32999e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.05002e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.49998e-06 [get_grad_eliminate_]: 6.56e-06 [merge_forward]: 3.62002e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 9.96e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.02e-05 [inline_without_move]: 6.36e-06 [renormalize]: 0.00234496 [add_forward_monad_depend]: 5.47999e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.572e-05 [cse]: 2.312e-05 [replace_applicator]: 1.6e-05 [Cycle 2]: 0.00036678, [27] [switch_simplify]: 7.63999e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.00012542 [with_stream_mark]: 9.69e-06 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.89001e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.68002e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 3.03998e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.94999e-06 [cse]: 1.161e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 9.17999e-06 [rewriter_after_opt_a]: 3.16e-05 [convert_after_rewriter]: 7.00998e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00054076 [jit_opt_b]: 5.666e-05, [1] [Cycle 1]: 4.975e-05, [2] [frontend_op_eliminate]: 2.067e-05 [inline_after_opt_a]: 1.748e-05 [cconv]: 2.241e-05 [loop_unroll]: 0.00043069 [jit_opt_after_cconv]: 0.00015369, [1] [Cycle 1]: 0.00014545, [11] [c_1]: 2.646e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 7.16001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.068e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 6.25002e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.248e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 7.98001e-06 [add_recomputation]: 3.877e-05 [cse_after_recomputation]: 2.31e-05, [1] [Cycle 1]: 1.667e-05, [1] [cse]: 1.088e-05 [auto_monad_reorder]: 1.535e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 4.67e-06 [opt_after_jit_grad]: 0.00047459 [symbol_engine_optimizer]: 0.00013627, [1] [Cycle 1]: 0.00012991, [6] [build]: 3.09999e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.466e-05 [opt_reshape]: 6.29999e-06 [fold_const_symbol]: 6.884e-05 [renormalize]: 3.9002e-07 [validate]: 3.744e-05 Sums bootstrap : 0.000311s : 0.29% type_inference : 0.102744s : 94.32% event_method : 0.000018s : 0.02% auto_monad : 0.000054s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000435s : 0.40% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000666s : 0.61% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002345s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000541s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000431s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000475s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000069s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000181 24 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000005s : 4: substitution.graph_param_transform 83.00% : 0.000150s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000005s : 4: substitution.remove_not_recompute_node 3.22% : 0.000006s : 2: substitution.replace_old_param 4.79% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102676 2 97.67% : 0.100283s : 1: type_inference.infer 2.33% : 0.002394s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.79% : 0.000046s : 4: replace.inline 33.21% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 95.19% : 0.000147s : 4: match.inline 4.81% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.56% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.22% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.36% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.09% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.83% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.46% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.57% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.86% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.24% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001928 22 65.66% : 0.001266s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.77% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.58% : 0.000628s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115867 72 0.04% : 0.000042s : 1: add_recomputation 0.05% : 0.000057s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.28% : 0.000325s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.75% : 0.006662s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.38% : 0.000439s : 1: loop_unroll 0.47% : 0.000549s : 1: mutable_eliminate 0.77% : 0.000894s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000095s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000441s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.43% : 0.001656s : 1: renormalize.infer 0.59% : 0.000681s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.12% : 0.000139s : 1: symbol_engine_optimizer 88.69% : 0.102757s : 1: type_inference TotalTime = 0.11233, [30] [bootstrap]: 0.00029116 [type_inference]: 0.102633 [event_method]: 1.846e-05 [auto_monad]: 5.079e-05 [graph_reusing]: 3.76001e-06 [pre_auto_parallel]: 1.66e-06 [py_interpret_to_execute]: 0.00052087 [rewriter_before_opt_a]: 7.382e-05 [expand_dump_flag]: 2.51e-06 [jit_opt_a]: 0.00654268, [2] [Cycle 1]: 0.00322189, [27] [switch_simplify]: 4.898e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00052232 [with_stream_mark]: 1.266e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 5.94e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 6.85998e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.272e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.007e-05 [renormalize]: 0.00224148 [add_forward_monad_depend]: 6.10002e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.45e-05 [cse]: 2.197e-05 [replace_applicator]: 1.501e-05 [Cycle 2]: 0.00036119, [27] [switch_simplify]: 6.41e-06 [loop_unroll]: 5.90002e-06 [a_1]: 0.0001203 [with_stream_mark]: 1.124e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.562e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.109e-05 [replace_applicator]: 6.14001e-06 [py_interpret_to_execute_after_opt_a]: 9.09e-06 [rewriter_after_opt_a]: 2.728e-05 [convert_after_rewriter]: 5.87999e-06 [order_py_execute_after_rewriter]: 4.55001e-06 [mutable_eliminate]: 0.00051396 [jit_opt_b]: 5.546e-05, [1] [Cycle 1]: 4.909e-05, [2] [frontend_op_eliminate]: 1.887e-05 [inline_after_opt_a]: 1.918e-05 [cconv]: 1.959e-05 [loop_unroll]: 0.00044935 [jit_opt_after_cconv]: 0.0002002, [1] [Cycle 1]: 0.00019391, [11] [c_1]: 2.616e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.036e-05 [call_graph_tuple_transform]: 2.117e-05 [tuple_list_get_item_eliminator]: 6.43998e-06 [none_parameter_eliminate]: 1.32999e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 7.88001e-06 [remove_dup_value]: 9.81e-06 [partial_unused_args_eliminate]: 1.72001e-06 [environ_conv]: 6.48003e-06 [add_recomputation]: 3.73e-05 [cse_after_recomputation]: 2.188e-05, [1] [Cycle 1]: 1.672e-05, [1] [cse]: 1.121e-05 [auto_monad_reorder]: 1.073e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 6.516e-05 [opt_after_jit_grad]: 0.00046493 [symbol_engine_optimizer]: 7.386e-05, [1] [Cycle 1]: 6.769e-05, [6] [build]: 2.84999e-06 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 6.64001e-06 [fold_const_symbol]: 9.04998e-06 [renormalize]: 3.69997e-07 [validate]: 3.325e-05 Sums bootstrap : 0.000291s : 0.27% type_inference : 0.102633s : 94.38% event_method : 0.000018s : 0.02% auto_monad : 0.000051s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000521s : 0.48% rewriter_before_opt_a : 0.000074s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000643s : 0.59% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000056s : 0.05% jit_opt_a.renormalize : 0.002242s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000027s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000514s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000449s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000065s : 0.06% opt_after_jit_grad : 0.000465s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000163 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000004s : 4: substitution.graph_param_transform 83.44% : 0.000136s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.87% : 0.000005s : 4: substitution.remove_not_recompute_node 2.58% : 0.000004s : 2: substitution.replace_old_param 5.04% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102568 2 97.59% : 0.100092s : 1: type_inference.infer 2.41% : 0.002477s : 1: type_inference.specialize ------[replace.] 0.000066 6 64.79% : 0.000043s : 4: replace.inline 35.21% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 94.99% : 0.000134s : 4: match.inline 5.01% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.21% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.03% : 0.000007s : 26: predicate.inline 1.04% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.94% : 0.000003s : 18: predicate.load_eliminater 1.54% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.91% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.93% : 0.000009s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002037 22 67.86% : 0.001382s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.42% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.72% : 0.000626s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115565 72 0.03% : 0.000040s : 1: add_recomputation 0.05% : 0.000054s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.26% : 0.000304s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.66% : 0.006546s : 1: jit_opt_a 0.18% : 0.000203s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.40% : 0.000457s : 1: loop_unroll 0.45% : 0.000522s : 1: mutable_eliminate 0.79% : 0.000913s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000529s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.38% : 0.001598s : 1: renormalize.infer 0.55% : 0.000635s : 1: renormalize.specialize 0.06% : 0.000068s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000030s : 1: rewriter_after_opt_a 0.07% : 0.000079s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 88.82% : 0.102648s : 1: type_inference TotalTime = 0.12088, [30] [bootstrap]: 0.00028513 [type_inference]: 0.110402 [event_method]: 1.931e-05 [auto_monad]: 5.35e-05 [graph_reusing]: 4.43999e-06 [pre_auto_parallel]: 1.66e-06 [py_interpret_to_execute]: 0.00053093 [rewriter_before_opt_a]: 9.544e-05 [expand_dump_flag]: 2.91e-06 [jit_opt_a]: 0.0072874, [2] [Cycle 1]: 0.00372147, [27] [switch_simplify]: 5.434e-05 [loop_unroll]: 3.396e-05 [a_1]: 0.00069667 [with_stream_mark]: 1.235e-05 [recompute_prepare]: 8.73001e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 7.45998e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.44001e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 1.69e-05 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 1.566e-05 [inline_without_move]: 6.41e-06 [renormalize]: 0.00256907 [add_forward_monad_depend]: 4.68999e-06 [auto_monad_grad]: 1.65001e-06 [auto_monad_eliminator]: 1.375e-05 [cse]: 3.235e-05 [replace_applicator]: 1.418e-05 [Cycle 2]: 0.00037971, [27] [switch_simplify]: 1.298e-05 [loop_unroll]: 6.11e-06 [a_1]: 0.0001256 [with_stream_mark]: 1.007e-05 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.75001e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 1.61998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.152e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.02003e-06 [inline_without_move]: 5.61003e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.71999e-06 [cse]: 2.075e-05 [replace_applicator]: 6.14999e-06 [py_interpret_to_execute_after_opt_a]: 1.748e-05 [rewriter_after_opt_a]: 3.74e-05 [convert_after_rewriter]: 8.90001e-06 [order_py_execute_after_rewriter]: 4.53999e-06 [mutable_eliminate]: 0.00058858 [jit_opt_b]: 5.339e-05, [1] [Cycle 1]: 4.722e-05, [2] [frontend_op_eliminate]: 1.894e-05 [inline_after_opt_a]: 1.743e-05 [cconv]: 1.744e-05 [loop_unroll]: 0.00042493 [jit_opt_after_cconv]: 0.0001453, [1] [Cycle 1]: 0.00013871, [11] [c_1]: 2.465e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.17999e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 2.143e-05 [call_graph_tuple_transform]: 1.874e-05 [tuple_list_get_item_eliminator]: 6.12001e-06 [none_parameter_eliminate]: 9.89996e-07 [renormalize]: 3.80009e-07 [switch_simplify]: 6.19001e-06 [remove_dup_value]: 1.252e-05 [partial_unused_args_eliminate]: 1.42999e-06 [environ_conv]: 5.92999e-06 [add_recomputation]: 5.628e-05 [cse_after_recomputation]: 2.432e-05, [1] [Cycle 1]: 1.885e-05, [1] [cse]: 1.259e-05 [auto_monad_reorder]: 1.304e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.00050181 [symbol_engine_optimizer]: 7.422e-05, [1] [Cycle 1]: 6.823e-05, [6] [build]: 2.95002e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.21998e-06 [fold_const_symbol]: 9.22001e-06 [renormalize]: 4.00003e-07 [validate]: 3.504e-05 Sums bootstrap : 0.000285s : 0.24% type_inference : 0.110402s : 94.27% event_method : 0.000019s : 0.02% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000531s : 0.45% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000822s : 0.70% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000026s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002569s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000053s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000017s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000009s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000589s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000017s : 0.01% loop_unroll : 0.000425s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000056s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000502s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.03% Time group info: ------[substitution.] 0.000215 28 0.71% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.05% : 0.000004s : 4: substitution.graph_param_transform 84.70% : 0.000182s : 5: substitution.inline 1.32% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.00% : 0.000009s : 3: substitution.reduce_eliminate 1.92% : 0.000004s : 4: substitution.remove_not_recompute_node 1.42% : 0.000003s : 2: substitution.replace_old_param 3.28% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110343 2 97.43% : 0.107507s : 1: type_inference.infer 2.57% : 0.002836s : 1: type_inference.specialize ------[replace.] 0.000090 7 69.45% : 0.000063s : 5: replace.inline 30.55% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 7 96.79% : 0.000179s : 5: match.inline 3.21% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 886 1.45% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 13: predicate.addn_check_dump 1.16% : 0.000002s : 13: predicate.addn_zero_filter 1.90% : 0.000003s : 13: predicate.arithmetic_simplify 1.27% : 0.000002s : 13: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 13: predicate.compare_switch_simplify 1.21% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.09% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.85% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 19: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.79% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 19: predicate.partial_eliminate 1.18% : 0.000002s : 13: predicate.print_const_string_wrapper 1.99% : 0.000003s : 13: predicate.reduce_eliminate 1.34% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 5.23% : 0.000008s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 13: predicate.reshape_eliminate 1.22% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000004s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.06% : 0.000010s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.17% : 0.000002s : 13: predicate.transpose_eliminate 1.41% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002324 25 63.68% : 0.001480s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.35% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.97% : 0.000789s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124592 72 0.05% : 0.000060s : 1: add_recomputation 0.05% : 0.000057s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.24% : 0.000298s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000011s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.85% : 0.007291s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.04% : 0.000056s : 1: jit_opt_b 0.35% : 0.000433s : 1: loop_unroll 0.48% : 0.000597s : 1: mutable_eliminate 0.85% : 0.001060s : 26: opt.transform.jit_opt_a 0.04% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000511s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000541s : 1: py_interpret_to_execute 0.02% : 0.000020s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.46% : 0.001819s : 1: renormalize.infer 0.60% : 0.000743s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.06% : 0.000077s : 1: symbol_engine_optimizer 88.62% : 0.110415s : 1: type_inference TotalTime = 0.0109783, [30] [bootstrap]: 0.00025663 [type_inference]: 0.00408417 [event_method]: 1.61e-05 [auto_monad]: 4.469e-05 [graph_reusing]: 3.8e-06 [pre_auto_parallel]: 1.50999e-06 [py_interpret_to_execute]: 3.45e-05 [rewriter_before_opt_a]: 6.511e-05 [expand_dump_flag]: 1.99999e-06 [jit_opt_a]: 0.00451749, [2] [Cycle 1]: 0.00131384, [27] [switch_simplify]: 4.536e-05 [loop_unroll]: 3.049e-05 [a_1]: 0.00047232 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 7.31001e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.23002e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 7.99977e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.172e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 0.00047322 [add_forward_monad_depend]: 4.44002e-06 [auto_monad_grad]: 1.35999e-06 [auto_monad_eliminator]: 1.033e-05 [cse]: 1.707e-05 [replace_applicator]: 1.097e-05 [Cycle 2]: 0.00031271, [27] [switch_simplify]: 5.61e-06 [loop_unroll]: 5.17e-06 [a_1]: 9.154e-05 [with_stream_mark]: 8.35001e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.01003e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.70001e-06 [accelerated_algorithm]: 4.78001e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 2.48e-06 [cell_reuse_recompute_pass]: 1.19003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.186e-05 [j_node_and_user_rematch]: 7.81001e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 6.93e-06 [inline_without_move]: 4.84998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.54e-06 [cse]: 1.109e-05 [replace_applicator]: 5.13002e-06 [py_interpret_to_execute_after_opt_a]: 7.35e-06 [rewriter_after_opt_a]: 2.528e-05 [convert_after_rewriter]: 6.11e-06 [order_py_execute_after_rewriter]: 4.47e-06 [mutable_eliminate]: 0.00044929 [jit_opt_b]: 5.859e-05, [1] [Cycle 1]: 5.205e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 2.477e-05 [cconv]: 1.61e-05 [loop_unroll]: 0.00040543 [jit_opt_after_cconv]: 0.00013516, [1] [Cycle 1]: 0.00012897, [11] [c_1]: 2.02e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.72001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.17001e-06 [cse]: 1.839e-05 [call_graph_tuple_transform]: 1.695e-05 [tuple_list_get_item_eliminator]: 5.46998e-06 [none_parameter_eliminate]: 1.02e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 8.38999e-06 [partial_unused_args_eliminate]: 1.57001e-06 [environ_conv]: 3.82002e-06 [add_recomputation]: 3.186e-05 [cse_after_recomputation]: 2.067e-05, [1] [Cycle 1]: 1.57e-05, [1] [cse]: 1.001e-05 [auto_monad_reorder]: 1.03e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.00051555 [symbol_engine_optimizer]: 7.012e-05, [1] [Cycle 1]: 6.408e-05, [6] [build]: 2.82002e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.22e-05 [opt_reshape]: 5.69999e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 3.60014e-07 [validate]: 2.765e-05 Sums bootstrap : 0.000257s : 3.40% type_inference : 0.004084s : 54.06% event_method : 0.000016s : 0.21% auto_monad : 0.000045s : 0.59% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.46% rewriter_before_opt_a : 0.000065s : 0.86% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000051s : 0.67% jit_opt_a.loop_unroll : 0.000036s : 0.47% jit_opt_a.a_1 : 0.000564s : 7.46% jit_opt_a.with_stream_mark : 0.000020s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000473s : 6.26% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.21% jit_opt_a.cse : 0.000028s : 0.37% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000007s : 0.10% rewriter_after_opt_a : 0.000025s : 0.33% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000449s : 5.95% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000025s : 0.33% cconv : 0.000016s : 0.21% loop_unroll : 0.000405s : 5.37% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000032s : 0.42% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000010s : 0.14% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000516s : 6.82% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.37% Time group info: ------[substitution.] 0.000151 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.56% : 0.000004s : 3: substitution.graph_param_transform 83.64% : 0.000127s : 4: substitution.inline 1.53% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.91% : 0.000004s : 4: substitution.remove_not_recompute_node 1.98% : 0.000003s : 2: substitution.replace_old_param 5.61% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004035 2 81.53% : 0.003290s : 1: type_inference.infer 18.47% : 0.000746s : 1: type_inference.specialize ------[replace.] 0.000060 6 66.16% : 0.000040s : 4: replace.inline 33.84% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000131 6 94.37% : 0.000124s : 4: match.inline 5.63% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.22% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 2.52% : 0.000003s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.60% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.30% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.37% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.52% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.74% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.25% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.52% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.42% : 0.000008s : 53: predicate.switch_simplify 1.42% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000548 13 48.96% : 0.000268s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.04% : 0.000252s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012292 72 0.28% : 0.000035s : 1: add_recomputation 0.39% : 0.000048s : 1: auto_monad 0.10% : 0.000013s : 1: auto_monad_reorder 2.19% : 0.000269s : 1: bootstrap 0.15% : 0.000019s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 36.77% : 0.004520s : 1: jit_opt_a 1.12% : 0.000138s : 1: jit_opt_after_cconv 0.50% : 0.000061s : 1: jit_opt_b 3.36% : 0.000413s : 1: loop_unroll 3.72% : 0.000458s : 1: mutable_eliminate 6.19% : 0.000760s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.28% : 0.000034s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.17% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 4.26% : 0.000524s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.30% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000011s : 1: remove_dup_value 1.88% : 0.000231s : 1: renormalize.infer 1.92% : 0.000236s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000028s : 1: rewriter_after_opt_a 0.55% : 0.000068s : 1: rewriter_before_opt_a 0.59% : 0.000073s : 1: symbol_engine_optimizer 33.31% : 0.004095s : 1: type_inference TotalTime = 0.126259, [30] [bootstrap]: 0.00025281 [type_inference]: 0.115633 [event_method]: 1.98e-05 [auto_monad]: 5.998e-05 [graph_reusing]: 5.40999e-06 [pre_auto_parallel]: 1.80001e-06 [py_interpret_to_execute]: 0.00046648 [rewriter_before_opt_a]: 0.00010375 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00758766, [2] [Cycle 1]: 0.00393009, [27] [switch_simplify]: 5.537e-05 [loop_unroll]: 3.377e-05 [a_1]: 0.00066153 [with_stream_mark]: 1.555e-05 [recompute_prepare]: 8.58001e-06 [updatestate_depend_eliminate]: 3.63e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.74001e-06 [merge_forward]: 3.23e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.344e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.50002e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00281551 [add_forward_monad_depend]: 1.129e-05 [auto_monad_grad]: 1.97001e-06 [auto_monad_eliminator]: 1.669e-05 [cse]: 3.082e-05 [replace_applicator]: 1.572e-05 [Cycle 2]: 0.00037213, [27] [switch_simplify]: 6.41e-06 [loop_unroll]: 6.04999e-06 [a_1]: 0.00012823 [with_stream_mark]: 1.059e-05 [recompute_prepare]: 6.30002e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.98998e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.65001e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.97999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.244e-05 [j_node_and_user_rematch]: 8.56002e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 8.59e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.06003e-06 [cse]: 1.426e-05 [replace_applicator]: 5.85002e-06 [py_interpret_to_execute_after_opt_a]: 1.022e-05 [rewriter_after_opt_a]: 3.408e-05 [convert_after_rewriter]: 6.89001e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.0005461 [jit_opt_b]: 5.252e-05, [1] [Cycle 1]: 4.629e-05, [2] [frontend_op_eliminate]: 1.81e-05 [inline_after_opt_a]: 1.744e-05 [cconv]: 2.308e-05 [loop_unroll]: 0.00041533 [jit_opt_after_cconv]: 0.00014873, [1] [Cycle 1]: 0.00014242, [11] [c_1]: 2.489e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 2.166e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.88002e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.469e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.7e-06 [add_recomputation]: 4.602e-05 [cse_after_recomputation]: 2.357e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.238e-05 [auto_monad_reorder]: 1.674e-05 [get_jit_bprop_graph]: 1.33002e-06 [rewriter_after_jit_bprop_graph]: 4.11001e-06 [opt_after_jit_grad]: 0.00047067 [symbol_engine_optimizer]: 7.714e-05, [1] [Cycle 1]: 7.067e-05, [6] [build]: 3.13998e-06 [elim_shapecalc]: 8.66002e-06 [elim_not_effective]: 1.447e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 1.033e-05 [renormalize]: 4.09986e-07 [validate]: 3.909e-05 Sums bootstrap : 0.000253s : 0.21% type_inference : 0.115633s : 94.48% event_method : 0.000020s : 0.02% auto_monad : 0.000060s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000466s : 0.38% rewriter_before_opt_a : 0.000104s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000790s : 0.65% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002816s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000546s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000023s : 0.02% loop_unroll : 0.000415s : 0.34% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000471s : 0.38% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000229 28 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 82.24% : 0.000188s : 5: substitution.inline 1.27% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.57% : 0.000010s : 3: substitution.reduce_eliminate 1.80% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000004s : 2: substitution.replace_old_param 4.37% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.115566 2 97.55% : 0.112730s : 1: type_inference.infer 2.45% : 0.002836s : 1: type_inference.specialize ------[replace.] 0.000091 7 66.50% : 0.000061s : 5: replace.inline 33.50% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000194 7 95.45% : 0.000185s : 5: match.inline 4.55% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.80% : 0.000002s : 13: predicate.arithmetic_simplify 1.35% : 0.000002s : 13: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.30% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.43% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.25% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 0.96% : 0.000001s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 19: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.45% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.40% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000003s : 23: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.59% : 0.000002s : 13: predicate.reshape_eliminate 1.37% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.56% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 20: predicate.switch_defer_inline 2.26% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 64: predicate.switch_simplify 1.43% : 0.000002s : 13: predicate.tile_eliminate 1.44% : 0.000002s : 13: predicate.transpose_eliminate 1.43% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.83% : 0.000003s : 13: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002238 25 63.02% : 0.001410s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.55% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.43% : 0.000770s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.130177 72 0.04% : 0.000049s : 1: add_recomputation 0.05% : 0.000063s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000264s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.83% : 0.007590s : 1: jit_opt_a 0.12% : 0.000151s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.33% : 0.000424s : 1: loop_unroll 0.43% : 0.000555s : 1: mutable_eliminate 0.79% : 0.001024s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.57% : 0.002040s : 1: renormalize.infer 0.59% : 0.000766s : 1: renormalize.specialize 0.00% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000109s : 1: rewriter_before_opt_a 0.07% : 0.000094s : 1: symbol_engine_optimizer 88.84% : 0.115646s : 1: type_inference TotalTime = 0.110974, [30] [bootstrap]: 0.00025042 [type_inference]: 0.101613 [event_method]: 1.694e-05 [auto_monad]: 4.43e-05 [graph_reusing]: 3.46999e-06 [pre_auto_parallel]: 1.60999e-06 [py_interpret_to_execute]: 0.00042981 [rewriter_before_opt_a]: 7.147e-05 [expand_dump_flag]: 2.63e-06 [jit_opt_a]: 0.00647988, [2] [Cycle 1]: 0.00314898, [27] [switch_simplify]: 4.414e-05 [loop_unroll]: 3.079e-05 [a_1]: 0.00051108 [with_stream_mark]: 1.196e-05 [recompute_prepare]: 7.92998e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 6.48003e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 6.00002e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 7.89994e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.192e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.17998e-06 [inline_without_move]: 5.86e-06 [renormalize]: 0.00217936 [add_forward_monad_depend]: 4.72e-06 [auto_monad_grad]: 1.83002e-06 [auto_monad_eliminator]: 8.441e-05 [cse]: 2.059e-05 [replace_applicator]: 1.361e-05 [Cycle 2]: 0.00035226, [27] [switch_simplify]: 6.41e-06 [loop_unroll]: 5.91998e-06 [a_1]: 0.0001195 [with_stream_mark]: 9.42999e-06 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 2.46998e-06 [cell_reuse_recompute_pass]: 1.61998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 8.49998e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.89002e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.047e-05 [replace_applicator]: 6.17999e-06 [py_interpret_to_execute_after_opt_a]: 9.57001e-06 [rewriter_after_opt_a]: 2.796e-05 [convert_after_rewriter]: 6.65002e-06 [order_py_execute_after_rewriter]: 4.18999e-06 [mutable_eliminate]: 0.00048521 [jit_opt_b]: 5.322e-05, [1] [Cycle 1]: 4.712e-05, [2] [frontend_op_eliminate]: 1.86e-05 [inline_after_opt_a]: 1.731e-05 [cconv]: 1.773e-05 [loop_unroll]: 0.00041884 [jit_opt_after_cconv]: 0.00014574, [1] [Cycle 1]: 0.00013969, [11] [c_1]: 2.587e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 3.55e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.853e-05 [call_graph_tuple_transform]: 1.846e-05 [tuple_list_get_item_eliminator]: 8.25999e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 1.15e-05 [partial_unused_args_eliminate]: 1.74e-06 [environ_conv]: 5.64998e-06 [add_recomputation]: 3.51e-05 [cse_after_recomputation]: 7.7e-05, [1] [Cycle 1]: 7.189e-05, [1] [cse]: 6.502e-05 [auto_monad_reorder]: 1.213e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.18001e-06 [opt_after_jit_grad]: 0.00047049 [symbol_engine_optimizer]: 7.463e-05, [1] [Cycle 1]: 6.877e-05, [6] [build]: 2.76e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 6.61999e-06 [fold_const_symbol]: 9.62999e-06 [renormalize]: 3.00002e-07 [validate]: 3.223e-05 Sums bootstrap : 0.000250s : 0.23% type_inference : 0.101613s : 94.57% event_method : 0.000017s : 0.02% auto_monad : 0.000044s : 0.04% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000430s : 0.40% rewriter_before_opt_a : 0.000071s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000631s : 0.59% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002179s : 2.03% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000090s : 0.08% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000485s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000419s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000008s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000065s : 0.06% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000470s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000159 24 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 2.81% : 0.000004s : 4: substitution.graph_param_transform 84.44% : 0.000135s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.74% : 0.000004s : 4: substitution.remove_not_recompute_node 1.81% : 0.000003s : 2: substitution.replace_old_param 4.59% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101556 2 97.65% : 0.099166s : 1: type_inference.infer 2.35% : 0.002390s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.07% : 0.000043s : 4: replace.inline 33.93% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 6 95.49% : 0.000132s : 4: match.inline 4.51% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_depend_swap 1.37% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.47% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.20% : 0.000001s : 12: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000001s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.88% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001888 22 67.67% : 0.001278s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.55% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.78% : 0.000581s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114085 72 0.03% : 0.000038s : 1: add_recomputation 0.04% : 0.000047s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000264s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.07% : 0.000079s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.68% : 0.006483s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000426s : 1: loop_unroll 0.43% : 0.000493s : 1: mutable_eliminate 0.74% : 0.000844s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.38% : 0.000436s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.38% : 0.001578s : 1: renormalize.infer 0.52% : 0.000595s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000077s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 89.08% : 0.101626s : 1: type_inference TotalTime = 0.060679, [30] [bootstrap]: 0.0002618 [type_inference]: 0.0512986 [event_method]: 2.016e-05 [auto_monad]: 6.662e-05 [graph_reusing]: 5.69e-06 [pre_auto_parallel]: 1.92001e-06 [py_interpret_to_execute]: 0.00027969 [rewriter_before_opt_a]: 7.898e-05 [expand_dump_flag]: 3.55e-06 [jit_opt_a]: 0.00656874, [2] [Cycle 1]: 0.00286848, [27] [switch_simplify]: 4.912e-05 [loop_unroll]: 3.13e-05 [a_1]: 0.0005417 [with_stream_mark]: 1.304e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 7.33e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.49999e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 2.86999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.225e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.47001e-06 [renormalize]: 0.00192399 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 1.366e-05 [cse]: 2.057e-05 [replace_applicator]: 1.368e-05 [Cycle 2]: 0.00036014, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.96e-06 [a_1]: 0.00012298 [with_stream_mark]: 8.89e-06 [recompute_prepare]: 5.78002e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 8.49977e-07 [specialize_transform]: 5.78002e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 2.83e-06 [cell_reuse_recompute_pass]: 1.69998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.517e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 8.87e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.96998e-06 [cse]: 1.149e-05 [replace_applicator]: 5.88002e-06 [py_interpret_to_execute_after_opt_a]: 1.084e-05 [rewriter_after_opt_a]: 3.206e-05 [convert_after_rewriter]: 5.42001e-06 [order_py_execute_after_rewriter]: 4.88001e-06 [mutable_eliminate]: 0.0005466 [jit_opt_b]: 5.445e-05, [1] [Cycle 1]: 4.774e-05, [2] [frontend_op_eliminate]: 1.856e-05 [inline_after_opt_a]: 1.764e-05 [cconv]: 1.772e-05 [loop_unroll]: 0.00042172 [jit_opt_after_cconv]: 0.00014729, [1] [Cycle 1]: 0.00014098, [11] [c_1]: 2.614e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 7e-06 [updatestate_assign_eliminate]: 2.53003e-06 [updatestate_loads_eliminate]: 2.28002e-06 [cse]: 1.933e-05 [call_graph_tuple_transform]: 1.904e-05 [tuple_list_get_item_eliminator]: 6.16998e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 2.30008e-07 [switch_simplify]: 6.25002e-06 [remove_dup_value]: 1.13e-05 [partial_unused_args_eliminate]: 1.54998e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 3.986e-05 [cse_after_recomputation]: 2.115e-05, [1] [Cycle 1]: 1.642e-05, [1] [cse]: 1.082e-05 [auto_monad_reorder]: 1.2e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.0004811 [symbol_engine_optimizer]: 7.564e-05, [1] [Cycle 1]: 6.977e-05, [6] [build]: 2.61999e-06 [elim_shapecalc]: 9.32999e-06 [elim_not_effective]: 1.379e-05 [opt_reshape]: 6.74001e-06 [fold_const_symbol]: 9.31e-06 [renormalize]: 3.89991e-07 [validate]: 3.456e-05 Sums bootstrap : 0.000262s : 0.46% type_inference : 0.051299s : 90.33% event_method : 0.000020s : 0.04% auto_monad : 0.000067s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000280s : 0.49% rewriter_before_opt_a : 0.000079s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000665s : 1.17% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001924s : 3.39% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000032s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000547s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000018s : 0.03% loop_unroll : 0.000422s : 0.74% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000481s : 0.85% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000176 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.51% : 0.000004s : 4: substitution.graph_param_transform 83.94% : 0.000148s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.54% : 0.000004s : 2: substitution.replace_old_param 5.16% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051226 2 96.36% : 0.049361s : 1: type_inference.infer 3.64% : 0.001865s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.58% : 0.000045s : 4: replace.inline 33.42% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 94.83% : 0.000145s : 4: match.inline 5.17% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.41% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 18: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002112 26 71.06% : 0.001501s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.51% : 0.000581s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063576 72 0.07% : 0.000043s : 1: add_recomputation 0.11% : 0.000070s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.43% : 0.000274s : 1: bootstrap 0.03% : 0.000020s : 1: cconv 0.01% : 0.000007s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.34% : 0.006572s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.68% : 0.000430s : 1: loop_unroll 0.87% : 0.000555s : 1: mutable_eliminate 1.40% : 0.000891s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000285s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 2.06% : 0.001311s : 1: renormalize.infer 0.95% : 0.000606s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.13% : 0.000084s : 1: rewriter_before_opt_a 0.12% : 0.000078s : 1: symbol_engine_optimizer 80.71% : 0.051313s : 1: type_inference TotalTime = 0.0117646, [30] [bootstrap]: 0.00026559 [type_inference]: 0.00421735 [event_method]: 1.786e-05 [auto_monad]: 6.089e-05 [graph_reusing]: 5.15001e-06 [pre_auto_parallel]: 1.97001e-06 [py_interpret_to_execute]: 3.651e-05 [rewriter_before_opt_a]: 7.171e-05 [expand_dump_flag]: 2.36998e-06 [jit_opt_a]: 0.00498947, [2] [Cycle 1]: 0.00153398, [27] [switch_simplify]: 5.1e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00051178 [with_stream_mark]: 1.592e-05 [recompute_prepare]: 8.09002e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 1.21002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 2.59001e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 5.63997e-06 [renormalize]: 0.00060845 [add_forward_monad_depend]: 6.10002e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.499e-05 [cse]: 2.197e-05 [replace_applicator]: 1.379e-05 [Cycle 2]: 0.00031403, [27] [switch_simplify]: 5.68002e-06 [loop_unroll]: 4.95001e-06 [a_1]: 9.082e-05 [with_stream_mark]: 8.01001e-06 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 2.82002e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.77e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.252e-05 [j_node_and_user_rematch]: 8.16002e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.122e-05 [replace_applicator]: 5.06002e-06 [py_interpret_to_execute_after_opt_a]: 9.90002e-06 [rewriter_after_opt_a]: 3.339e-05 [convert_after_rewriter]: 7.83999e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00054437 [jit_opt_b]: 4.987e-05, [1] [Cycle 1]: 4.357e-05, [2] [frontend_op_eliminate]: 1.686e-05 [inline_after_opt_a]: 1.536e-05 [cconv]: 2.445e-05 [loop_unroll]: 0.00043402 [jit_opt_after_cconv]: 0.00014117, [1] [Cycle 1]: 0.00013496, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 2.78e-06 [updatestate_depend_eliminate]: 5.74e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 1.986e-05 [call_graph_tuple_transform]: 1.918e-05 [tuple_list_get_item_eliminator]: 5.61e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.14003e-06 [remove_dup_value]: 1.422e-05 [partial_unused_args_eliminate]: 2.27999e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 4.504e-05 [cse_after_recomputation]: 3.363e-05, [1] [Cycle 1]: 1.664e-05, [1] [cse]: 1.087e-05 [auto_monad_reorder]: 1.489e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 5.40001e-06 [opt_after_jit_grad]: 0.00046144 [symbol_engine_optimizer]: 6.998e-05, [1] [Cycle 1]: 6.397e-05, [6] [build]: 3.15002e-06 [elim_shapecalc]: 7.50003e-06 [elim_not_effective]: 1.261e-05 [opt_reshape]: 5.49998e-06 [fold_const_symbol]: 8.61002e-06 [renormalize]: 3.09985e-07 [validate]: 3.127e-05 Sums bootstrap : 0.000266s : 3.30% type_inference : 0.004217s : 52.35% event_method : 0.000018s : 0.22% auto_monad : 0.000061s : 0.76% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.45% rewriter_before_opt_a : 0.000072s : 0.89% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000603s : 7.48% jit_opt_a.with_stream_mark : 0.000024s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000609s : 7.55% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.26% jit_opt_a.cse : 0.000033s : 0.41% jit_opt_a.replace_applicator : 0.000019s : 0.23% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000033s : 0.41% convert_after_rewriter : 0.000008s : 0.10% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000544s : 6.76% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000024s : 0.30% loop_unroll : 0.000434s : 5.39% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000045s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.07% opt_after_jit_grad : 0.000461s : 5.73% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.39% Time group info: ------[substitution.] 0.000184 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.87% : 0.000002s : 2: substitution.fold_const_symbol 3.02% : 0.000006s : 3: substitution.graph_param_transform 82.91% : 0.000152s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000004s : 4: substitution.remove_not_recompute_node 1.89% : 0.000003s : 2: substitution.replace_old_param 6.14% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004157 2 81.16% : 0.003374s : 1: type_inference.infer 18.84% : 0.000783s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.43% : 0.000045s : 4: replace.inline 32.57% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.60% : 0.000150s : 4: match.inline 6.40% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.42% : 0.000002s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.56% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.18% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000591 13 51.56% : 0.000304s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.06% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.38% : 0.000256s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013248 72 0.36% : 0.000048s : 1: add_recomputation 0.48% : 0.000064s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.12% : 0.000281s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.08% : 0.000010s : 1: convert_after_rewriter 0.27% : 0.000036s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.69% : 0.004992s : 1: jit_opt_a 1.09% : 0.000144s : 1: jit_opt_after_cconv 0.40% : 0.000052s : 1: jit_opt_b 3.34% : 0.000442s : 1: loop_unroll 4.17% : 0.000552s : 1: mutable_eliminate 6.11% : 0.000809s : 26: opt.transform.jit_opt_a 0.36% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000470s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.34% : 0.000311s : 1: renormalize.infer 2.20% : 0.000291s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000036s : 1: rewriter_after_opt_a 0.56% : 0.000075s : 1: rewriter_before_opt_a 0.55% : 0.000073s : 1: symbol_engine_optimizer 31.94% : 0.004231s : 1: type_inference TotalTime = 0.011821, [30] [bootstrap]: 0.00026933 [type_inference]: 0.00473311 [event_method]: 1.709e-05 [auto_monad]: 5.691e-05 [graph_reusing]: 5.22e-06 [pre_auto_parallel]: 1.76998e-06 [py_interpret_to_execute]: 3.548e-05 [rewriter_before_opt_a]: 7.057e-05 [expand_dump_flag]: 2.49001e-06 [jit_opt_a]: 0.00470561, [2] [Cycle 1]: 0.00140604, [27] [switch_simplify]: 4.549e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.00048221 [with_stream_mark]: 1.141e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 3.06999e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.14999e-06 [parameter_eliminate]: 1.09003e-06 [specialize_transform]: 5.78997e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.21002e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.095e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 7.67998e-06 [inline_without_move]: 5.18002e-06 [renormalize]: 0.00055895 [add_forward_monad_depend]: 4.27e-06 [auto_monad_grad]: 1.16002e-06 [auto_monad_eliminator]: 1.078e-05 [cse]: 1.8e-05 [replace_applicator]: 1.164e-05 [Cycle 2]: 0.00032385, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 5.45001e-06 [a_1]: 0.00010024 [with_stream_mark]: 8.22e-06 [recompute_prepare]: 5.15001e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.20001e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 4.74e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 8.04002e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 7.21999e-06 [inline_without_move]: 4.82e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.39e-06 [cse]: 1.109e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 7.66001e-06 [rewriter_after_opt_a]: 2.597e-05 [convert_after_rewriter]: 5.67999e-06 [order_py_execute_after_rewriter]: 4.58999e-06 [mutable_eliminate]: 0.00045862 [jit_opt_b]: 4.788e-05, [1] [Cycle 1]: 4.161e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.501e-05 [cconv]: 1.576e-05 [loop_unroll]: 0.00040459 [jit_opt_after_cconv]: 0.00014685, [1] [Cycle 1]: 0.00014091, [11] [c_1]: 2.055e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.77002e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 1.754e-05 [call_graph_tuple_transform]: 1.645e-05 [tuple_list_get_item_eliminator]: 5.69e-06 [none_parameter_eliminate]: 1.04e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 8.94998e-06 [partial_unused_args_eliminate]: 1.71e-06 [environ_conv]: 4.4e-06 [add_recomputation]: 3.534e-05 [cse_after_recomputation]: 2.062e-05, [1] [Cycle 1]: 1.553e-05, [1] [cse]: 1.024e-05 [auto_monad_reorder]: 9.65002e-06 [get_jit_bprop_graph]: 1.51998e-06 [rewriter_after_jit_bprop_graph]: 4.23999e-06 [opt_after_jit_grad]: 0.00047236 [symbol_engine_optimizer]: 7.127e-05, [1] [Cycle 1]: 6.465e-05, [6] [build]: 3.02002e-06 [elim_shapecalc]: 8.02003e-06 [elim_not_effective]: 1.253e-05 [opt_reshape]: 5.73002e-06 [fold_const_symbol]: 8.06001e-06 [renormalize]: 4.00003e-07 [validate]: 2.648e-05 Sums bootstrap : 0.000269s : 3.24% type_inference : 0.004733s : 56.99% event_method : 0.000017s : 0.21% auto_monad : 0.000057s : 0.69% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.43% rewriter_before_opt_a : 0.000071s : 0.85% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000052s : 0.63% jit_opt_a.loop_unroll : 0.000036s : 0.43% jit_opt_a.a_1 : 0.000582s : 7.01% jit_opt_a.with_stream_mark : 0.000020s : 0.24% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000559s : 6.73% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.19% jit_opt_a.cse : 0.000029s : 0.35% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000026s : 0.31% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000459s : 5.52% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000016s : 0.19% loop_unroll : 0.000405s : 4.87% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000009s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000035s : 0.43% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000010s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000472s : 5.69% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000026s : 0.32% Time group info: ------[substitution.] 0.000156 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.29% : 0.000004s : 3: substitution.graph_param_transform 84.47% : 0.000131s : 4: substitution.inline 1.45% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.86% : 0.000004s : 4: substitution.remove_not_recompute_node 2.01% : 0.000003s : 2: substitution.replace_old_param 5.26% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004681 2 80.60% : 0.003773s : 1: type_inference.infer 19.40% : 0.000908s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.66% : 0.000042s : 4: replace.inline 34.34% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000136 6 94.78% : 0.000129s : 4: match.inline 5.22% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.42% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 2.09% : 0.000002s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.61% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.27% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.21% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.51% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000646 13 48.52% : 0.000313s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.59% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.89% : 0.000303s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013238 72 0.29% : 0.000038s : 1: add_recomputation 0.45% : 0.000060s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 2.13% : 0.000281s : 1: bootstrap 0.14% : 0.000019s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 35.57% : 0.004708s : 1: jit_opt_a 1.13% : 0.000150s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.11% : 0.000412s : 1: loop_unroll 3.53% : 0.000467s : 1: mutable_eliminate 5.91% : 0.000782s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.19% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.64% : 0.000482s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000038s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000011s : 1: remove_dup_value 2.10% : 0.000277s : 1: renormalize.infer 2.08% : 0.000275s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000029s : 1: rewriter_after_opt_a 0.55% : 0.000073s : 1: rewriter_before_opt_a 0.56% : 0.000074s : 1: symbol_engine_optimizer 35.84% : 0.004745s : 1: type_inference TotalTime = 0.125857, [30] [bootstrap]: 0.00028596 [type_inference]: 0.114834 [event_method]: 2.011e-05 [auto_monad]: 5.584e-05 [graph_reusing]: 4.06001e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 0.00047092 [rewriter_before_opt_a]: 8.603e-05 [expand_dump_flag]: 2.81999e-06 [jit_opt_a]: 0.00754631, [2] [Cycle 1]: 0.00408645, [27] [switch_simplify]: 5.131e-05 [loop_unroll]: 3.527e-05 [a_1]: 0.00065603 [with_stream_mark]: 1.279e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.24998e-06 [specialize_transform]: 7.55e-06 [updatestate_useless_node_eliminater]: 6.03998e-06 [accelerated_algorithm]: 6.18002e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.28e-06 [merge_forward]: 2.93e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.248e-05 [j_node_and_user_rematch]: 9.34998e-06 [meta_fg_expand]: 2.06003e-06 [replace_old_param]: 8.79e-06 [inline_without_move]: 6.72002e-06 [renormalize]: 0.00298757 [add_forward_monad_depend]: 7.3e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.777e-05 [cse]: 3.018e-05 [replace_applicator]: 1.849e-05 [Cycle 2]: 0.00044882, [27] [switch_simplify]: 7.26001e-06 [loop_unroll]: 6.63998e-06 [a_1]: 0.00015294 [with_stream_mark]: 1.367e-05 [recompute_prepare]: 6.79001e-06 [updatestate_depend_eliminate]: 2.92002e-06 [updatestate_assign_eliminate]: 2.94999e-06 [updatestate_loads_eliminate]: 2.79999e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 6.79999e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 3.31999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.368e-05 [j_node_and_user_rematch]: 8.90001e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 9.13002e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 6.98998e-06 [cse]: 1.726e-05 [replace_applicator]: 2.444e-05 [py_interpret_to_execute_after_opt_a]: 2.003e-05 [rewriter_after_opt_a]: 3.7e-05 [convert_after_rewriter]: 7.56001e-06 [order_py_execute_after_rewriter]: 5.69e-06 [mutable_eliminate]: 0.00074427 [jit_opt_b]: 5.801e-05, [1] [Cycle 1]: 5.056e-05, [2] [frontend_op_eliminate]: 1.985e-05 [inline_after_opt_a]: 1.911e-05 [cconv]: 2.771e-05 [loop_unroll]: 0.00050973 [jit_opt_after_cconv]: 0.00016387, [1] [Cycle 1]: 0.00015612, [11] [c_1]: 2.676e-05 [parameter_eliminate]: 3.81001e-06 [updatestate_depend_eliminate]: 7.03e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.612e-05 [call_graph_tuple_transform]: 2.233e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.507e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 8.75999e-06 [add_recomputation]: 4.963e-05 [cse_after_recomputation]: 2.419e-05, [1] [Cycle 1]: 1.854e-05, [1] [cse]: 1.266e-05 [auto_monad_reorder]: 1.758e-05 [get_jit_bprop_graph]: 1.71998e-06 [rewriter_after_jit_bprop_graph]: 4.97999e-06 [opt_after_jit_grad]: 0.00050775 [symbol_engine_optimizer]: 7.989e-05, [1] [Cycle 1]: 7.284e-05, [6] [build]: 4.30999e-06 [elim_shapecalc]: 9.70002e-06 [elim_not_effective]: 1.46e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 9.59e-06 [renormalize]: 3.59985e-07 [validate]: 8.963e-05 Sums bootstrap : 0.000286s : 0.23% type_inference : 0.114834s : 93.94% event_method : 0.000020s : 0.02% auto_monad : 0.000056s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000471s : 0.39% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000042s : 0.03% jit_opt_a.a_1 : 0.000809s : 0.66% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002988s : 2.44% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000043s : 0.04% py_interpret_to_execute_after_opt_a : 0.000020s : 0.02% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000744s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000510s : 0.42% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000508s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000090s : 0.07% Time group info: ------[substitution.] 0.000239 28 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000002s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 4: substitution.graph_param_transform 82.75% : 0.000198s : 5: substitution.inline 1.24% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.66% : 0.000011s : 3: substitution.reduce_eliminate 1.83% : 0.000004s : 4: substitution.remove_not_recompute_node 1.52% : 0.000004s : 2: substitution.replace_old_param 3.94% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.114772 2 97.54% : 0.111951s : 1: type_inference.infer 2.46% : 0.002821s : 1: type_inference.specialize ------[replace.] 0.000093 7 69.81% : 0.000065s : 5: replace.inline 30.19% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000203 7 95.91% : 0.000195s : 5: match.inline 4.09% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000145 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000002s : 13: predicate.addn_check_dump 1.22% : 0.000002s : 13: predicate.addn_zero_filter 2.26% : 0.000003s : 13: predicate.arithmetic_simplify 1.23% : 0.000002s : 13: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.44% : 0.000002s : 13: predicate.depend_value_elim 1.18% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.08% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.91% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.36% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 19: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.87% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.07% : 0.000002s : 13: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.09% : 0.000003s : 19: predicate.partial_eliminate 1.13% : 0.000002s : 13: predicate.print_const_string_wrapper 2.24% : 0.000003s : 13: predicate.reduce_eliminate 1.42% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 23: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 13: predicate.reshape_eliminate 1.26% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 13: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 20: predicate.switch_defer_inline 2.16% : 0.000003s : 20: predicate.switch_layer_defer_inline 6.93% : 0.000010s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.33% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.74% : 0.000003s : 15: predicate.tuple_to_list_eliminator_ 1.78% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.86% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002466 25 60.59% : 0.001494s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 36.78% : 0.000907s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.129924 72 0.04% : 0.000052s : 1: add_recomputation 0.05% : 0.000059s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000298s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.81% : 0.007550s : 1: jit_opt_a 0.13% : 0.000166s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.40% : 0.000520s : 1: loop_unroll 0.58% : 0.000754s : 1: mutable_eliminate 0.81% : 0.001049s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000519s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000477s : 1: py_interpret_to_execute 0.02% : 0.000023s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.50% : 0.001953s : 1: renormalize.infer 0.78% : 0.001013s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000082s : 1: symbol_engine_optimizer 88.40% : 0.114848s : 1: type_inference TotalTime = 0.112411, [30] [bootstrap]: 0.00026399 [type_inference]: 0.102454 [event_method]: 1.945e-05 [auto_monad]: 6.402e-05 [graph_reusing]: 5.33002e-06 [pre_auto_parallel]: 2.33998e-06 [py_interpret_to_execute]: 0.00043703 [rewriter_before_opt_a]: 8.498e-05 [expand_dump_flag]: 3.71001e-06 [jit_opt_a]: 0.0068766, [2] [Cycle 1]: 0.00334364, [27] [switch_simplify]: 5.525e-05 [loop_unroll]: 3.048e-05 [a_1]: 0.00054864 [with_stream_mark]: 1.573e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.73e-06 [get_grad_eliminate_]: 6.05002e-06 [merge_forward]: 3.73001e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.73002e-06 [inline_without_move]: 6.23e-06 [renormalize]: 0.00235006 [add_forward_monad_depend]: 6.71999e-06 [auto_monad_grad]: 3.25002e-06 [auto_monad_eliminator]: 1.799e-05 [cse]: 2.772e-05 [replace_applicator]: 1.489e-05 [Cycle 2]: 0.00036404, [27] [switch_simplify]: 6.77002e-06 [loop_unroll]: 5.72999e-06 [a_1]: 0.00012278 [with_stream_mark]: 9.59e-06 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.48997e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.565e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 9.38002e-06 [inline_without_move]: 5.71e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.24001e-06 [cse]: 1.197e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 9.84999e-06 [rewriter_after_opt_a]: 3.283e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00055643 [jit_opt_b]: 5.647e-05, [1] [Cycle 1]: 4.966e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 2.325e-05 [loop_unroll]: 0.00042594 [jit_opt_after_cconv]: 0.00014919, [1] [Cycle 1]: 0.00014234, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.41998e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.69001e-06 [cse]: 1.929e-05 [call_graph_tuple_transform]: 2.028e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.482e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 7.58001e-06 [add_recomputation]: 4.459e-05 [cse_after_recomputation]: 2.245e-05, [1] [Cycle 1]: 1.758e-05, [1] [cse]: 1.205e-05 [auto_monad_reorder]: 1.512e-05 [get_jit_bprop_graph]: 2.49001e-06 [rewriter_after_jit_bprop_graph]: 4.55999e-06 [opt_after_jit_grad]: 0.00047013 [symbol_engine_optimizer]: 7.59e-05, [1] [Cycle 1]: 7.039e-05, [6] [build]: 3.25998e-06 [elim_shapecalc]: 1.032e-05 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 9.71998e-06 [renormalize]: 3.39991e-07 [validate]: 0.00010782 Sums bootstrap : 0.000264s : 0.24% type_inference : 0.102454s : 94.28% event_method : 0.000019s : 0.02% auto_monad : 0.000064s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000437s : 0.40% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000671s : 0.62% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002350s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000556s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000426s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000470s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000108s : 0.10% Time group info: ------[substitution.] 0.000188 24 1.71% : 0.000003s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.94% : 0.000006s : 4: substitution.graph_param_transform 81.10% : 0.000153s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000005s : 4: substitution.remove_not_recompute_node 2.83% : 0.000005s : 2: substitution.replace_old_param 6.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102386 2 97.54% : 0.099872s : 1: type_inference.infer 2.46% : 0.002514s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.16% : 0.000046s : 4: replace.inline 31.84% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.30% : 0.000150s : 4: match.inline 6.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.42% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.10% : 0.000001s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.12% : 0.000001s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.15% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.46% : 0.000010s : 58: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001949 22 65.32% : 0.001273s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.24% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115676 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000067s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000277s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.95% : 0.006879s : 1: jit_opt_a 0.13% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.38% : 0.000434s : 1: loop_unroll 0.49% : 0.000564s : 1: mutable_eliminate 0.78% : 0.000904s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000478s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000444s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.43% : 0.001650s : 1: renormalize.infer 0.60% : 0.000692s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 88.58% : 0.102468s : 1: type_inference TotalTime = 0.123803, [30] [bootstrap]: 0.00026031 [type_inference]: 0.112273 [event_method]: 2.03e-05 [auto_monad]: 6.609e-05 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00053564 [rewriter_before_opt_a]: 9.001e-05 [expand_dump_flag]: 3.31999e-06 [jit_opt_a]: 0.00822629, [2] [Cycle 1]: 0.00436405, [27] [switch_simplify]: 5.782e-05 [loop_unroll]: 3.4e-05 [a_1]: 0.00083202 [with_stream_mark]: 1.758e-05 [recompute_prepare]: 9.17001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.80997e-06 [get_grad_eliminate_]: 6.53e-06 [merge_forward]: 3.46999e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 1.015e-05 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.10999e-06 [inline_without_move]: 6.43e-06 [renormalize]: 0.0030551 [add_forward_monad_depend]: 5.64e-06 [auto_monad_grad]: 1.91e-06 [auto_monad_eliminator]: 1.513e-05 [cse]: 4.4e-05 [replace_applicator]: 1.618e-05 [Cycle 2]: 0.00042893, [27] [switch_simplify]: 7.81001e-06 [loop_unroll]: 6.29001e-06 [a_1]: 0.00013679 [with_stream_mark]: 1.082e-05 [recompute_prepare]: 6.20002e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 6.32001e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 2.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 9.24998e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.10001e-06 [inline_without_move]: 1.315e-05 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 6.66999e-06 [cse]: 1.394e-05 [replace_applicator]: 6.07999e-06 [py_interpret_to_execute_after_opt_a]: 1.207e-05 [rewriter_after_opt_a]: 3.585e-05 [convert_after_rewriter]: 7.01001e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00060135 [jit_opt_b]: 5.597e-05, [1] [Cycle 1]: 4.873e-05, [2] [frontend_op_eliminate]: 1.942e-05 [inline_after_opt_a]: 1.861e-05 [cconv]: 2.546e-05 [loop_unroll]: 0.00044058 [jit_opt_after_cconv]: 0.00022054, [1] [Cycle 1]: 0.00014719, [11] [c_1]: 2.664e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.52999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.42001e-06 [cse]: 2.219e-05 [call_graph_tuple_transform]: 2.041e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.22999e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.401e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 7.70998e-06 [add_recomputation]: 4.371e-05 [cse_after_recomputation]: 2.316e-05, [1] [Cycle 1]: 1.788e-05, [1] [cse]: 1.2e-05 [auto_monad_reorder]: 1.598e-05 [get_jit_bprop_graph]: 1.96998e-06 [rewriter_after_jit_bprop_graph]: 4.77e-06 [opt_after_jit_grad]: 0.00046542 [symbol_engine_optimizer]: 0.00013059, [1] [Cycle 1]: 0.00012439, [6] [build]: 3.04001e-06 [elim_shapecalc]: 6.055e-05 [elim_not_effective]: 1.443e-05 [opt_reshape]: 7.11001e-06 [fold_const_symbol]: 9.82999e-06 [renormalize]: 4.60015e-07 [validate]: 4.146e-05 Sums bootstrap : 0.000260s : 0.22% type_inference : 0.112273s : 93.81% event_method : 0.000020s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000536s : 0.45% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.03% jit_opt_a.a_1 : 0.000969s : 0.81% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000020s : 0.02% jit_opt_a.renormalize : 0.003055s : 2.55% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000058s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000601s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000441s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000465s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000061s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000256 28 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.30% : 0.000006s : 4: substitution.graph_param_transform 82.73% : 0.000212s : 5: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 4.18% : 0.000011s : 3: substitution.reduce_eliminate 1.88% : 0.000005s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.112205 2 97.31% : 0.109186s : 1: type_inference.infer 2.69% : 0.003019s : 1: type_inference.specialize ------[replace.] 0.000097 7 66.17% : 0.000064s : 5: replace.inline 33.83% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000220 7 94.92% : 0.000208s : 5: match.inline 5.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.42% : 0.000002s : 13: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 13: predicate.addn_check_dump 1.28% : 0.000002s : 13: predicate.addn_zero_filter 2.01% : 0.000003s : 13: predicate.arithmetic_simplify 1.32% : 0.000002s : 13: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000002s : 13: predicate.compare_switch_simplify 1.27% : 0.000002s : 13: predicate.depend_value_elim 1.07% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.61% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 13: predicate.environ_get_add_eliminate 1.08% : 0.000002s : 13: predicate.environ_get_depend_swap 1.37% : 0.000002s : 13: predicate.environ_get_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.69% : 0.000008s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 19: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.13% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 19: predicate.partial_eliminate 1.21% : 0.000002s : 13: predicate.print_const_string_wrapper 2.25% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.27% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 13: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 20: predicate.switch_defer_inline 2.14% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.22% : 0.000010s : 64: predicate.switch_simplify 1.30% : 0.000002s : 13: predicate.tile_eliminate 1.29% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 13: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002298 25 61.41% : 0.001411s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.98% : 0.000068s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.62% : 0.000819s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.128204 72 0.04% : 0.000047s : 1: add_recomputation 0.05% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.21% : 0.000272s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.42% : 0.008229s : 1: jit_opt_a 0.17% : 0.000223s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.35% : 0.000449s : 1: loop_unroll 0.48% : 0.000610s : 1: mutable_eliminate 0.95% : 0.001218s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000088s : 4: opt.transform.symbol_engine_opt 0.37% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000542s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.70% : 0.002182s : 1: renormalize.infer 0.67% : 0.000863s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000095s : 1: rewriter_before_opt_a 0.10% : 0.000133s : 1: symbol_engine_optimizer 87.58% : 0.112287s : 1: type_inference TotalTime = 0.116037, [30] [bootstrap]: 0.00032385 [type_inference]: 0.105644 [event_method]: 1.865e-05 [auto_monad]: 5.605e-05 [graph_reusing]: 4.42e-06 [pre_auto_parallel]: 2.18002e-06 [py_interpret_to_execute]: 0.00049482 [rewriter_before_opt_a]: 7.836e-05 [expand_dump_flag]: 2.62001e-06 [jit_opt_a]: 0.00713074, [2] [Cycle 1]: 0.00346799, [27] [switch_simplify]: 4.905e-05 [loop_unroll]: 3.049e-05 [a_1]: 0.00056 [with_stream_mark]: 1.698e-05 [recompute_prepare]: 8.92999e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 6.70998e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.55002e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 6.46999e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.363e-05 [j_node_and_user_rematch]: 1.064e-05 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.97001e-06 [inline_without_move]: 6.42001e-06 [renormalize]: 0.00249027 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.439e-05 [cse]: 2.332e-05 [replace_applicator]: 1.421e-05 [Cycle 2]: 0.00036164, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.86998e-06 [a_1]: 0.00012204 [with_stream_mark]: 1.001e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 5.69999e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 2.91e-06 [cell_reuse_recompute_pass]: 2.04999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.93002e-06 [cse]: 1.197e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 9.62001e-06 [rewriter_after_opt_a]: 3.482e-05 [convert_after_rewriter]: 6.48e-06 [order_py_execute_after_rewriter]: 3.336e-05 [mutable_eliminate]: 0.0005457 [jit_opt_b]: 5.344e-05, [1] [Cycle 1]: 4.719e-05, [2] [frontend_op_eliminate]: 1.938e-05 [inline_after_opt_a]: 1.74e-05 [cconv]: 2.611e-05 [loop_unroll]: 0.00048436 [jit_opt_after_cconv]: 0.00015035, [1] [Cycle 1]: 0.00014369, [11] [c_1]: 2.65e-05 [parameter_eliminate]: 2.88e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.941e-05 [call_graph_tuple_transform]: 2.104e-05 [tuple_list_get_item_eliminator]: 5.95002e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 7.31999e-06 [remove_dup_value]: 1.314e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 7.18998e-06 [add_recomputation]: 4.411e-05 [cse_after_recomputation]: 2.23e-05, [1] [Cycle 1]: 1.707e-05, [1] [cse]: 1.12e-05 [auto_monad_reorder]: 1.361e-05 [get_jit_bprop_graph]: 1.70001e-06 [rewriter_after_jit_bprop_graph]: 6.86999e-06 [opt_after_jit_grad]: 0.00053598 [symbol_engine_optimizer]: 7.587e-05, [1] [Cycle 1]: 6.964e-05, [6] [build]: 3.18e-06 [elim_shapecalc]: 8.07e-06 [elim_not_effective]: 1.407e-05 [opt_reshape]: 6.68998e-06 [fold_const_symbol]: 9.71e-06 [renormalize]: 4.30009e-07 [validate]: 3.998e-05 Sums bootstrap : 0.000324s : 0.29% type_inference : 0.105644s : 94.18% event_method : 0.000019s : 0.02% auto_monad : 0.000056s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000495s : 0.44% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000682s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002490s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000033s : 0.03% mutable_eliminate : 0.000546s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000484s : 0.43% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000536s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000200 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000006s : 4: substitution.graph_param_transform 84.14% : 0.000168s : 4: substitution.inline 1.93% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000003s : 2: substitution.replace_old_param 5.36% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105572 2 97.52% : 0.102957s : 1: type_inference.infer 2.48% : 0.002615s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.43% : 0.000047s : 4: replace.inline 33.57% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 94.57% : 0.000165s : 4: match.inline 5.43% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.61% : 0.000002s : 12: predicate.accumulaten_eliminater 1.28% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000002s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.15% : 0.000001s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.11% : 0.000007s : 26: predicate.inline 1.07% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.58% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.34% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.65% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.81% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 2.01% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002055 22 66.89% : 0.001374s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.18% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119567 72 0.04% : 0.000047s : 1: add_recomputation 0.05% : 0.000059s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.28% : 0.000338s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.97% : 0.007134s : 1: jit_opt_a 0.13% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.41% : 0.000492s : 1: loop_unroll 0.46% : 0.000554s : 1: mutable_eliminate 0.76% : 0.000908s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.06% : 0.000072s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000545s : 1: opt_after_jit_grad 0.03% : 0.000036s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000500s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.52% : 0.001815s : 1: renormalize.infer 0.56% : 0.000666s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 88.37% : 0.105659s : 1: type_inference TotalTime = 0.133451, [30] [bootstrap]: 0.00028718 [type_inference]: 0.123363 [event_method]: 2.032e-05 [auto_monad]: 7.178e-05 [graph_reusing]: 6.46999e-06 [pre_auto_parallel]: 2.49001e-06 [py_interpret_to_execute]: 0.00048006 [rewriter_before_opt_a]: 8.896e-05 [expand_dump_flag]: 3.57002e-06 [jit_opt_a]: 0.00703078, [2] [Cycle 1]: 0.0035127, [27] [switch_simplify]: 5.411e-05 [loop_unroll]: 3.411e-05 [a_1]: 0.00066703 [with_stream_mark]: 1.653e-05 [recompute_prepare]: 8.92e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 4.28001e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 7.41999e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.17e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 9.81e-06 [inline_without_move]: 6.36e-06 [renormalize]: 0.00241077 [add_forward_monad_depend]: 5.34e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 1.201e-05 [cse]: 2.422e-05 [replace_applicator]: 1.353e-05 [Cycle 2]: 0.00036326, [27] [switch_simplify]: 6.95998e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.0001264 [with_stream_mark]: 8.51002e-06 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 2.77002e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 6.96001e-06 [meta_shard_fg_expand]: 1.14998e-06 [get_grad_eliminate_]: 5.51998e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.16e-05 [j_node_and_user_rematch]: 8.34002e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 1.09983e-07 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.208e-05 [replace_applicator]: 5.92999e-06 [py_interpret_to_execute_after_opt_a]: 1.022e-05 [rewriter_after_opt_a]: 3.138e-05 [convert_after_rewriter]: 5.56e-06 [order_py_execute_after_rewriter]: 3.99002e-06 [mutable_eliminate]: 0.00049825 [jit_opt_b]: 5.286e-05, [1] [Cycle 1]: 4.648e-05, [2] [frontend_op_eliminate]: 1.842e-05 [inline_after_opt_a]: 1.771e-05 [cconv]: 1.651e-05 [loop_unroll]: 0.00041529 [jit_opt_after_cconv]: 0.00014856, [1] [Cycle 1]: 0.0001422, [11] [c_1]: 2.477e-05 [parameter_eliminate]: 2.79001e-06 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.287e-05 [call_graph_tuple_transform]: 1.941e-05 [tuple_list_get_item_eliminator]: 6.68e-06 [none_parameter_eliminate]: 1.30999e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.028e-05 [partial_unused_args_eliminate]: 1.60999e-06 [environ_conv]: 5.82001e-06 [add_recomputation]: 4.396e-05 [cse_after_recomputation]: 2.406e-05, [1] [Cycle 1]: 1.853e-05, [1] [cse]: 1.267e-05 [auto_monad_reorder]: 1.125e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00045242 [symbol_engine_optimizer]: 0.00015038, [1] [Cycle 1]: 0.00014436, [6] [build]: 3.615e-05 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 5.236e-05 [opt_reshape]: 7.18e-06 [fold_const_symbol]: 1.013e-05 [renormalize]: 2.79979e-07 [validate]: 3.977e-05 Sums bootstrap : 0.000287s : 0.22% type_inference : 0.123363s : 95.09% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000480s : 0.37% rewriter_before_opt_a : 0.000089s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000793s : 0.61% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002411s : 1.86% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.01% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000498s : 0.38% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.01% jit_opt_b.inline_after_opt_a : 0.000018s : 0.01% cconv : 0.000017s : 0.01% loop_unroll : 0.000415s : 0.32% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.00% add_recomputation : 0.000044s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000452s : 0.35% symbol_engine_optimizer.build : 0.000036s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000052s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.03% Time group info: ------[substitution.] 0.000280 28 13.91% : 0.000039s : 2: substitution.elim_not_effective 0.34% : 0.000001s : 2: substitution.fold_const_symbol 1.61% : 0.000005s : 4: substitution.graph_param_transform 73.05% : 0.000205s : 5: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.66% : 0.000010s : 3: substitution.reduce_eliminate 1.46% : 0.000004s : 4: substitution.remove_not_recompute_node 1.29% : 0.000004s : 2: substitution.replace_old_param 3.67% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123291 2 97.85% : 0.120636s : 1: type_inference.infer 2.15% : 0.002655s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.70% : 0.000064s : 5: replace.inline 31.30% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000211 7 95.67% : 0.000202s : 5: match.inline 4.33% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 2.00% : 0.000003s : 13: predicate.arithmetic_simplify 1.33% : 0.000002s : 13: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 13: predicate.compare_switch_simplify 1.37% : 0.000002s : 13: predicate.depend_value_elim 1.11% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.42% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.27% : 0.000007s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 19: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.33% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.15% : 0.000002s : 13: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 19: predicate.partial_eliminate 1.41% : 0.000002s : 13: predicate.print_const_string_wrapper 1.90% : 0.000003s : 13: predicate.reduce_eliminate 1.38% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 13: predicate.reshape_eliminate 1.33% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 13: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.46% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 20: predicate.switch_defer_inline 2.19% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 64: predicate.switch_simplify 1.37% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 13: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002170 25 64.60% : 0.001402s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.49% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 32.91% : 0.000714s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.137003 72 0.03% : 0.000047s : 1: add_recomputation 0.05% : 0.000075s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.22% : 0.000301s : 1: bootstrap 0.01% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.13% : 0.007033s : 1: jit_opt_a 0.11% : 0.000151s : 1: jit_opt_after_cconv 0.04% : 0.000055s : 1: jit_opt_b 0.31% : 0.000423s : 1: loop_unroll 0.37% : 0.000506s : 1: mutable_eliminate 0.75% : 0.001027s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000075s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000460s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000488s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.26% : 0.001721s : 1: renormalize.infer 0.50% : 0.000681s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000093s : 1: rewriter_before_opt_a 0.11% : 0.000153s : 1: symbol_engine_optimizer 90.06% : 0.123379s : 1: type_inference TotalTime = 0.0473729, [30] [bootstrap]: 0.00026517 [type_inference]: 0.0387523 [event_method]: 1.826e-05 [auto_monad]: 6.422e-05 [graph_reusing]: 6.41e-06 [pre_auto_parallel]: 2.29001e-06 [py_interpret_to_execute]: 0.0002626 [rewriter_before_opt_a]: 7.831e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.0058529, [2] [Cycle 1]: 0.00229841, [27] [switch_simplify]: 5.094e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00054421 [with_stream_mark]: 1.428e-05 [recompute_prepare]: 8.68001e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 6.90998e-06 [updatestate_useless_node_eliminater]: 6.06003e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 6.17001e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.543e-05 [j_node_and_user_rematch]: 9.47999e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.48002e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 0.0013362 [add_forward_monad_depend]: 5.66e-06 [auto_monad_grad]: 1.62001e-06 [auto_monad_eliminator]: 1.485e-05 [cse]: 2.677e-05 [replace_applicator]: 1.289e-05 [Cycle 2]: 0.00036041, [27] [switch_simplify]: 6.63e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00012009 [with_stream_mark]: 9.86e-06 [recompute_prepare]: 5.68002e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.99001e-06 [cell_reuse_recompute_pass]: 1.72999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.466e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.06998e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.188e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.051e-05 [rewriter_after_opt_a]: 3.476e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00050229 [jit_opt_b]: 5.361e-05, [1] [Cycle 1]: 4.737e-05, [2] [frontend_op_eliminate]: 1.811e-05 [inline_after_opt_a]: 1.747e-05 [cconv]: 2.372e-05 [loop_unroll]: 0.00043071 [jit_opt_after_cconv]: 0.00014499, [1] [Cycle 1]: 0.00013827, [11] [c_1]: 2.48e-05 [parameter_eliminate]: 2.06998e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.925e-05 [call_graph_tuple_transform]: 1.909e-05 [tuple_list_get_item_eliminator]: 6.61e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 2.29978e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.515e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 4.694e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.64e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.542e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.42998e-06 [opt_after_jit_grad]: 0.00047671 [symbol_engine_optimizer]: 7.305e-05, [1] [Cycle 1]: 6.732e-05, [6] [build]: 2.74999e-06 [elim_shapecalc]: 8.08001e-06 [elim_not_effective]: 1.22e-05 [opt_reshape]: 6.99001e-06 [fold_const_symbol]: 9.68002e-06 [renormalize]: 3.50003e-07 [validate]: 3.341e-05 Sums bootstrap : 0.000265s : 0.61% type_inference : 0.038752s : 88.82% event_method : 0.000018s : 0.04% auto_monad : 0.000064s : 0.15% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000263s : 0.60% rewriter_before_opt_a : 0.000078s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.13% jit_opt_a.loop_unroll : 0.000037s : 0.08% jit_opt_a.a_1 : 0.000664s : 1.52% jit_opt_a.with_stream_mark : 0.000024s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001336s : 3.06% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.05% jit_opt_a.cse : 0.000039s : 0.09% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000035s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000502s : 1.15% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000024s : 0.05% loop_unroll : 0.000431s : 0.99% jit_opt_after_cconv.c_1 : 0.000025s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000047s : 0.11% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.04% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000477s : 1.09% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.08% Time group info: ------[substitution.] 0.000184 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 3.09% : 0.000006s : 4: substitution.graph_param_transform 82.06% : 0.000151s : 4: substitution.inline 1.80% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.038683 2 95.22% : 0.036834s : 1: type_inference.infer 4.78% : 0.001849s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.26% : 0.000046s : 4: replace.inline 32.74% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 93.27% : 0.000149s : 4: match.inline 6.73% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 2.21% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.80% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.47% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.62% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.84% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.61% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.87% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001604 18 69.51% : 0.001115s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.67% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.83% : 0.000462s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.049685 72 0.10% : 0.000050s : 1: add_recomputation 0.14% : 0.000067s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.56% : 0.000276s : 1: bootstrap 0.05% : 0.000026s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.02% : 0.000009s : 1: graph_reusing 11.79% : 0.005856s : 1: jit_opt_a 0.30% : 0.000148s : 1: jit_opt_after_cconv 0.11% : 0.000056s : 1: jit_opt_b 0.88% : 0.000438s : 1: loop_unroll 1.03% : 0.000510s : 1: mutable_eliminate 1.79% : 0.000889s : 26: opt.transform.jit_opt_a 0.11% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000029s : 4: opt.transform.jit_opt_b 0.05% : 0.000025s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.05% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.97% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.54% : 0.000268s : 1: py_interpret_to_execute 0.03% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.72% : 0.000856s : 1: renormalize.infer 0.95% : 0.000472s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000038s : 1: rewriter_after_opt_a 0.17% : 0.000083s : 1: rewriter_before_opt_a 0.15% : 0.000075s : 1: symbol_engine_optimizer 78.02% : 0.038765s : 1: type_inference TotalTime = 0.0147812, [30] [bootstrap]: 0.0002514 [type_inference]: 0.00723493 [event_method]: 1.788e-05 [auto_monad]: 5.123e-05 [graph_reusing]: 3.73001e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 4.079e-05 [rewriter_before_opt_a]: 7.397e-05 [expand_dump_flag]: 2.36998e-06 [jit_opt_a]: 0.00505395, [2] [Cycle 1]: 0.00169771, [27] [switch_simplify]: 4.995e-05 [loop_unroll]: 3.293e-05 [a_1]: 0.00064698 [with_stream_mark]: 1.212e-05 [recompute_prepare]: 7.38e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.45002e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.26998e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.164e-05 [j_node_and_user_rematch]: 8.40999e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.00066035 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 1.56998e-06 [auto_monad_eliminator]: 1.113e-05 [cse]: 2.282e-05 [replace_applicator]: 1.174e-05 [Cycle 2]: 0.0003282, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.16002e-06 [a_1]: 9.788e-05 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 5.46e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 5.03002e-06 [accelerated_algorithm]: 5.29998e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.063e-05 [j_node_and_user_rematch]: 7.90998e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 7e-06 [inline_without_move]: 4.99e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 5.99999e-06 [cse]: 1.36e-05 [replace_applicator]: 5.29e-06 [py_interpret_to_execute_after_opt_a]: 1.099e-05 [rewriter_after_opt_a]: 3.297e-05 [convert_after_rewriter]: 6.07999e-06 [order_py_execute_after_rewriter]: 4.38999e-06 [mutable_eliminate]: 0.00050477 [jit_opt_b]: 4.966e-05, [1] [Cycle 1]: 4.294e-05, [2] [frontend_op_eliminate]: 1.619e-05 [inline_after_opt_a]: 1.59e-05 [cconv]: 1.931e-05 [loop_unroll]: 0.0004332 [jit_opt_after_cconv]: 0.00015744, [1] [Cycle 1]: 0.00015071, [11] [c_1]: 2.123e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 2.338e-05 [call_graph_tuple_transform]: 2.97e-05 [tuple_list_get_item_eliminator]: 5.56998e-06 [none_parameter_eliminate]: 1.32e-06 [renormalize]: 5.79981e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.083e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 4.95999e-06 [add_recomputation]: 4.166e-05 [cse_after_recomputation]: 2.462e-05, [1] [Cycle 1]: 1.904e-05, [1] [cse]: 1.298e-05 [auto_monad_reorder]: 1.487e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 5.97999e-06 [opt_after_jit_grad]: 0.00046459 [symbol_engine_optimizer]: 7.255e-05, [1] [Cycle 1]: 6.657e-05, [6] [build]: 3.38999e-06 [elim_shapecalc]: 7.93999e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 5.29981e-07 [validate]: 3.358e-05 Sums bootstrap : 0.000251s : 2.24% type_inference : 0.007235s : 64.56% event_method : 0.000018s : 0.16% auto_monad : 0.000051s : 0.46% graph_reusing : 0.000004s : 0.03% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.36% rewriter_before_opt_a : 0.000074s : 0.66% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000056s : 0.50% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000745s : 6.65% jit_opt_a.with_stream_mark : 0.000021s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000660s : 5.89% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.15% jit_opt_a.cse : 0.000036s : 0.32% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000011s : 0.10% rewriter_after_opt_a : 0.000033s : 0.29% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000505s : 4.50% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000019s : 0.17% loop_unroll : 0.000433s : 3.87% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000030s : 0.27% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000011s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000042s : 0.37% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000015s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.05% opt_after_jit_grad : 0.000465s : 4.15% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000034s : 0.30% Time group info: ------[substitution.] 0.000246 27 0.65% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 1.97% : 0.000005s : 3: substitution.graph_param_transform 86.10% : 0.000212s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.62% : 0.000009s : 3: substitution.reduce_eliminate 1.55% : 0.000004s : 4: substitution.remove_not_recompute_node 1.17% : 0.000003s : 2: substitution.replace_old_param 3.33% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007183 2 87.32% : 0.006273s : 1: type_inference.infer 12.68% : 0.000911s : 1: type_inference.specialize ------[replace.] 0.000088 7 66.88% : 0.000059s : 5: replace.inline 33.12% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000216 7 96.72% : 0.000209s : 5: match.inline 3.28% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.30% : 0.000002s : 11: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 11: predicate.addn_check_dump 1.32% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.27% : 0.000002s : 11: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 11: predicate.compare_switch_simplify 1.27% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.34% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_depend_swap 1.27% : 0.000002s : 11: predicate.environ_get_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.87% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.82% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 16: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 11: predicate.merge_addn 1.17% : 0.000001s : 11: predicate.minmaximum_grad 1.63% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 16: predicate.partial_eliminate 1.26% : 0.000002s : 11: predicate.print_const_string_wrapper 2.05% : 0.000003s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 19: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000002s : 11: predicate.reshape_eliminate 1.30% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.27% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.31% : 0.000009s : 59: predicate.switch_simplify 1.32% : 0.000002s : 11: predicate.tile_eliminate 1.36% : 0.000002s : 11: predicate.transpose_eliminate 1.48% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.24% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.89% : 0.000002s : 11: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000715 16 46.96% : 0.000336s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.81% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.24% : 0.000323s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016477 72 0.27% : 0.000045s : 1: add_recomputation 0.33% : 0.000055s : 1: auto_monad 0.11% : 0.000017s : 1: auto_monad_reorder 1.59% : 0.000263s : 1: bootstrap 0.13% : 0.000022s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000027s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.13% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 30.69% : 0.005057s : 1: jit_opt_a 0.97% : 0.000161s : 1: jit_opt_after_cconv 0.31% : 0.000052s : 1: jit_opt_b 2.69% : 0.000442s : 1: loop_unroll 3.11% : 0.000513s : 1: mutable_eliminate 5.78% : 0.000952s : 26: opt.transform.jit_opt_a 0.36% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.87% : 0.000473s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000043s : 1: py_interpret_to_execute 0.08% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000013s : 1: remove_dup_value 2.17% : 0.000357s : 1: renormalize.infer 1.80% : 0.000297s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000036s : 1: rewriter_after_opt_a 0.47% : 0.000077s : 1: rewriter_before_opt_a 0.46% : 0.000075s : 1: symbol_engine_optimizer 43.98% : 0.007246s : 1: type_inference TotalTime = 0.0123236, [30] [bootstrap]: 0.00029297 [type_inference]: 0.00463563 [event_method]: 1.895e-05 [auto_monad]: 6.855e-05 [graph_reusing]: 6.07999e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 4.358e-05 [rewriter_before_opt_a]: 7.451e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00506576, [2] [Cycle 1]: 0.00151538, [27] [switch_simplify]: 5.208e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00050994 [with_stream_mark]: 1.569e-05 [recompute_prepare]: 7.31999e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 5.08002e-06 [merge_forward]: 3.92998e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.414e-05 [j_node_and_user_rematch]: 8.31002e-06 [meta_fg_expand]: 2.33998e-06 [replace_old_param]: 8.24002e-06 [inline_without_move]: 5.20999e-06 [renormalize]: 0.00059858 [add_forward_monad_depend]: 4.87998e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.477e-05 [cse]: 2.69e-05 [replace_applicator]: 1.218e-05 [Cycle 2]: 0.00032009, [27] [switch_simplify]: 5.73997e-06 [loop_unroll]: 4.87e-06 [a_1]: 9.221e-05 [with_stream_mark]: 1.047e-05 [recompute_prepare]: 5.05001e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.94e-06 [accelerated_algorithm]: 4.80999e-06 [meta_shard_fg_expand]: 1.48002e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 3.05002e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.172e-05 [j_node_and_user_rematch]: 7.43999e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 7.33e-06 [inline_without_move]: 4.57998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 6.45002e-06 [cse]: 1.176e-05 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 1.098e-05 [rewriter_after_opt_a]: 3.347e-05 [convert_after_rewriter]: 7.08998e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00053108 [jit_opt_b]: 5.247e-05, [1] [Cycle 1]: 4.439e-05, [2] [frontend_op_eliminate]: 1.732e-05 [inline_after_opt_a]: 1.528e-05 [cconv]: 7.504e-05 [loop_unroll]: 0.0004215 [jit_opt_after_cconv]: 0.00013814, [1] [Cycle 1]: 0.00013086, [11] [c_1]: 2.056e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 6.08002e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 1.983e-05 [call_graph_tuple_transform]: 1.674e-05 [tuple_list_get_item_eliminator]: 5.58002e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.00001e-06 [remove_dup_value]: 1.472e-05 [partial_unused_args_eliminate]: 1.94999e-06 [environ_conv]: 5.14e-06 [add_recomputation]: 4.738e-05 [cse_after_recomputation]: 2.246e-05, [1] [Cycle 1]: 1.698e-05, [1] [cse]: 1.122e-05 [auto_monad_reorder]: 1.459e-05 [get_jit_bprop_graph]: 1.75001e-06 [rewriter_after_jit_bprop_graph]: 5.05999e-06 [opt_after_jit_grad]: 0.0004485 [symbol_engine_optimizer]: 7.308e-05, [1] [Cycle 1]: 6.656e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 7.76001e-06 [elim_not_effective]: 1.296e-05 [opt_reshape]: 6.12999e-06 [fold_const_symbol]: 8.57e-06 [renormalize]: 3.50003e-07 [validate]: 3.225e-05 Sums bootstrap : 0.000293s : 3.43% type_inference : 0.004636s : 54.35% event_method : 0.000019s : 0.22% auto_monad : 0.000069s : 0.80% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000044s : 0.51% rewriter_before_opt_a : 0.000075s : 0.87% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000058s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000602s : 7.06% jit_opt_a.with_stream_mark : 0.000026s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000599s : 7.02% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000039s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000033s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000531s : 6.23% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000075s : 0.88% loop_unroll : 0.000422s : 4.94% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000449s : 5.26% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.38% Time group info: ------[substitution.] 0.000186 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.57% : 0.000005s : 3: substitution.graph_param_transform 83.29% : 0.000155s : 4: substitution.inline 1.33% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000004s : 2: substitution.replace_old_param 6.39% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004571 2 81.30% : 0.003716s : 1: type_inference.infer 18.70% : 0.000855s : 1: type_inference.specialize ------[replace.] 0.000067 6 65.97% : 0.000044s : 4: replace.inline 34.03% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 93.40% : 0.000153s : 4: match.inline 6.60% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.61% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000006s : 22: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.85% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 1.61% : 0.000002s : 3: predicate.mutable_eliminate 0.81% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.43% : 0.000001s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.39% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.63% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000611 13 51.91% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.53% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.56% : 0.000266s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013781 72 0.37% : 0.000050s : 1: add_recomputation 0.53% : 0.000072s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.23% : 0.000307s : 1: bootstrap 0.57% : 0.000078s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.17% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.78% : 0.005069s : 1: jit_opt_a 1.02% : 0.000141s : 1: jit_opt_after_cconv 0.40% : 0.000055s : 1: jit_opt_b 3.11% : 0.000429s : 1: loop_unroll 3.91% : 0.000539s : 1: mutable_eliminate 5.84% : 0.000804s : 26: opt.transform.jit_opt_a 0.32% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000457s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000046s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.24% : 0.000309s : 1: renormalize.infer 2.06% : 0.000284s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.56% : 0.000077s : 1: rewriter_before_opt_a 0.55% : 0.000076s : 1: symbol_engine_optimizer 33.74% : 0.004649s : 1: type_inference TotalTime = 0.012184, [30] [bootstrap]: 0.00025919 [type_inference]: 0.00465464 [event_method]: 1.772e-05 [auto_monad]: 5.942e-05 [graph_reusing]: 5.39998e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 3.937e-05 [rewriter_before_opt_a]: 7.107e-05 [expand_dump_flag]: 2.83e-06 [jit_opt_a]: 0.00503454, [2] [Cycle 1]: 0.00158261, [27] [switch_simplify]: 5.116e-05 [loop_unroll]: 3.075e-05 [a_1]: 0.00050752 [with_stream_mark]: 1.606e-05 [recompute_prepare]: 7.21999e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 3.72998e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.324e-05 [j_node_and_user_rematch]: 8.60999e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 0.0006728 [add_forward_monad_depend]: 4.75001e-06 [auto_monad_grad]: 1.81e-06 [auto_monad_eliminator]: 1.366e-05 [cse]: 2.403e-05 [replace_applicator]: 1.135e-05 [Cycle 2]: 0.00031191, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 4.79e-06 [a_1]: 9.144e-05 [with_stream_mark]: 8.86997e-06 [recompute_prepare]: 5.25001e-06 [updatestate_depend_eliminate]: 2.58998e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 7.60017e-07 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 9.89996e-07 [get_grad_eliminate_]: 4.46002e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 8.05999e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 4.79e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.34e-06 [cse]: 1.044e-05 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 9.22001e-06 [rewriter_after_opt_a]: 3.005e-05 [convert_after_rewriter]: 7.29001e-06 [order_py_execute_after_rewriter]: 4.98001e-06 [mutable_eliminate]: 0.00047134 [jit_opt_b]: 4.934e-05, [1] [Cycle 1]: 4.248e-05, [2] [frontend_op_eliminate]: 1.602e-05 [inline_after_opt_a]: 1.5e-05 [cconv]: 2.236e-05 [loop_unroll]: 0.00041571 [jit_opt_after_cconv]: 0.00013919, [1] [Cycle 1]: 0.00013286, [11] [c_1]: 2.083e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.67001e-06 [cse]: 1.973e-05 [call_graph_tuple_transform]: 1.709e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.15999e-06 [remove_dup_value]: 1.397e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 2.223e-05 [add_recomputation]: 4.645e-05 [cse_after_recomputation]: 2.387e-05, [1] [Cycle 1]: 1.791e-05, [1] [cse]: 1.201e-05 [auto_monad_reorder]: 1.479e-05 [get_jit_bprop_graph]: 1.67999e-06 [rewriter_after_jit_bprop_graph]: 4.50999e-06 [opt_after_jit_grad]: 0.00051239 [symbol_engine_optimizer]: 6.917e-05, [1] [Cycle 1]: 6.298e-05, [6] [build]: 2.68e-06 [elim_shapecalc]: 7.11999e-06 [elim_not_effective]: 1.203e-05 [opt_reshape]: 5.64998e-06 [fold_const_symbol]: 8.58001e-06 [renormalize]: 4.00003e-07 [validate]: 3.017e-05 Sums bootstrap : 0.000259s : 3.05% type_inference : 0.004655s : 54.71% event_method : 0.000018s : 0.21% auto_monad : 0.000059s : 0.70% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000039s : 0.46% rewriter_before_opt_a : 0.000071s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.67% jit_opt_a.loop_unroll : 0.000036s : 0.42% jit_opt_a.a_1 : 0.000599s : 7.04% jit_opt_a.with_stream_mark : 0.000025s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000673s : 7.91% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.22% jit_opt_a.cse : 0.000034s : 0.41% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000030s : 0.35% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000471s : 5.54% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000022s : 0.26% loop_unroll : 0.000416s : 4.89% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000022s : 0.26% add_recomputation : 0.000046s : 0.55% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000512s : 6.02% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.35% Time group info: ------[substitution.] 0.000182 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 3: substitution.graph_param_transform 82.63% : 0.000150s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000004s : 2: substitution.replace_old_param 6.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004598 2 80.06% : 0.003682s : 1: type_inference.infer 19.94% : 0.000917s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.73% : 0.000043s : 4: replace.inline 33.27% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.01% : 0.000147s : 4: match.inline 6.99% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.43% : 0.000002s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.85% : 0.000001s : 3: predicate.check_bprop_eliminate 1.24% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.30% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.15% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.03% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.67% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000002s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.63% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000009s : 53: predicate.switch_simplify 1.39% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.17% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000665 13 49.16% : 0.000327s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.72% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.12% : 0.000306s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013720 72 0.36% : 0.000050s : 1: add_recomputation 0.46% : 0.000063s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 1.97% : 0.000270s : 1: bootstrap 0.18% : 0.000025s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.18% : 0.000025s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.72% : 0.005037s : 1: jit_opt_a 1.03% : 0.000142s : 1: jit_opt_after_cconv 0.38% : 0.000052s : 1: jit_opt_b 3.08% : 0.000423s : 1: loop_unroll 3.48% : 0.000478s : 1: mutable_eliminate 5.86% : 0.000803s : 26: opt.transform.jit_opt_a 0.33% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000010s : 1: opt.transform.loop_unroll_optimizer 0.07% : 0.000010s : 1: opt.transform.mutable_eliminate 0.14% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.78% : 0.000519s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.54% : 0.000348s : 1: renormalize.infer 2.31% : 0.000317s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000033s : 1: rewriter_after_opt_a 0.54% : 0.000074s : 1: rewriter_before_opt_a 0.52% : 0.000072s : 1: symbol_engine_optimizer 34.01% : 0.004667s : 1: type_inference TotalTime = 0.134539, [30] [bootstrap]: 0.00026776 [type_inference]: 0.123185 [event_method]: 2.239e-05 [auto_monad]: 7.211e-05 [graph_reusing]: 5.94e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00058276 [rewriter_before_opt_a]: 9.473e-05 [expand_dump_flag]: 3.95e-06 [jit_opt_a]: 0.0077788, [2] [Cycle 1]: 0.00401442, [27] [switch_simplify]: 5.796e-05 [loop_unroll]: 3.465e-05 [a_1]: 0.00065589 [with_stream_mark]: 1.643e-05 [recompute_prepare]: 8.92999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.49001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.487e-05 [j_node_and_user_rematch]: 9.53002e-06 [meta_fg_expand]: 2.63998e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 6.00002e-06 [renormalize]: 0.00290679 [add_forward_monad_depend]: 5.62999e-06 [auto_monad_grad]: 1.65001e-06 [auto_monad_eliminator]: 1.482e-05 [cse]: 3.185e-05 [replace_applicator]: 1.388e-05 [Cycle 2]: 0.00039552, [27] [switch_simplify]: 6.83e-06 [loop_unroll]: 6.21998e-06 [a_1]: 0.00014541 [with_stream_mark]: 1.054e-05 [recompute_prepare]: 6.51999e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.54999e-06 [parameter_eliminate]: 1.16002e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.43003e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 5.62001e-06 [merge_forward]: 3.44001e-06 [cell_reuse_recompute_pass]: 2.01998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 9.07999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.52999e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.437e-05 [replace_applicator]: 6.28e-06 [py_interpret_to_execute_after_opt_a]: 1.013e-05 [rewriter_after_opt_a]: 3.335e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 5.59e-06 [mutable_eliminate]: 0.00056507 [jit_opt_b]: 5.595e-05, [1] [Cycle 1]: 4.962e-05, [2] [frontend_op_eliminate]: 1.928e-05 [inline_after_opt_a]: 1.908e-05 [cconv]: 2.507e-05 [loop_unroll]: 0.00044258 [jit_opt_after_cconv]: 0.0001598, [1] [Cycle 1]: 0.00015332, [11] [c_1]: 2.62e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.641e-05 [call_graph_tuple_transform]: 2.263e-05 [tuple_list_get_item_eliminator]: 6.69001e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.763e-05 [partial_unused_args_eliminate]: 2.03002e-06 [environ_conv]: 7.93001e-06 [add_recomputation]: 5.059e-05 [cse_after_recomputation]: 2.517e-05, [1] [Cycle 1]: 1.827e-05, [1] [cse]: 1.246e-05 [auto_monad_reorder]: 1.796e-05 [get_jit_bprop_graph]: 1.44e-06 [rewriter_after_jit_bprop_graph]: 5.05001e-06 [opt_after_jit_grad]: 0.00058091 [symbol_engine_optimizer]: 0.00020721, [1] [Cycle 1]: 0.00020002, [6] [build]: 3.81999e-06 [elim_shapecalc]: 0.00013349 [elim_not_effective]: 1.548e-05 [opt_reshape]: 6.88998e-06 [fold_const_symbol]: 9.48002e-06 [renormalize]: 4.99975e-07 [validate]: 4.146e-05 Sums bootstrap : 0.000268s : 0.21% type_inference : 0.123185s : 94.40% event_method : 0.000022s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000583s : 0.45% rewriter_before_opt_a : 0.000095s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000801s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002907s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000565s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000025s : 0.02% loop_unroll : 0.000443s : 0.34% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000018s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000018s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000581s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000133s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000240 28 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.60% : 0.000006s : 4: substitution.graph_param_transform 81.54% : 0.000195s : 5: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.78% : 0.000011s : 3: substitution.reduce_eliminate 1.86% : 0.000004s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 4.61% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.123109 2 97.18% : 0.119641s : 1: type_inference.infer 2.82% : 0.003468s : 1: type_inference.specialize ------[replace.] 0.000092 7 68.71% : 0.000063s : 5: replace.inline 31.29% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 7 95.13% : 0.000192s : 5: match.inline 4.87% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.23% : 0.000002s : 13: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 13: predicate.addn_check_dump 1.38% : 0.000002s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.34% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000002s : 13: predicate.compare_switch_simplify 1.20% : 0.000002s : 13: predicate.depend_value_elim 1.08% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 13: predicate.environ_get_depend_swap 1.18% : 0.000002s : 13: predicate.environ_get_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 28: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 19: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.10% : 0.000002s : 13: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.17% : 0.000002s : 13: predicate.print_const_string_wrapper 2.34% : 0.000003s : 13: predicate.reduce_eliminate 1.48% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 23: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 13: predicate.reshape_eliminate 1.35% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.91% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 20: predicate.switch_defer_inline 2.26% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.12% : 0.000010s : 64: predicate.switch_simplify 1.28% : 0.000002s : 13: predicate.tile_eliminate 1.37% : 0.000002s : 13: predicate.transpose_eliminate 1.46% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.82% : 0.000003s : 19: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 13: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.47% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002197 25 66.52% : 0.001461s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.75% : 0.000060s : 2: func_graph_cloner_run.FuncGraphClonerNode 30.74% : 0.000675s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.138603 72 0.04% : 0.000053s : 1: add_recomputation 0.05% : 0.000076s : 1: auto_monad 0.01% : 0.000020s : 1: auto_monad_reorder 0.20% : 0.000279s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.61% : 0.007782s : 1: jit_opt_a 0.12% : 0.000163s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.32% : 0.000450s : 1: loop_unroll 0.41% : 0.000574s : 1: mutable_eliminate 0.75% : 0.001040s : 26: opt.transform.jit_opt_a 0.04% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000161s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000590s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000591s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000020s : 1: remove_dup_value 1.62% : 0.002239s : 1: renormalize.infer 0.48% : 0.000659s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000100s : 1: rewriter_before_opt_a 0.15% : 0.000210s : 1: symbol_engine_optimizer 88.89% : 0.123199s : 1: type_inference TotalTime = 0.112306, [30] [bootstrap]: 0.00027394 [type_inference]: 0.102332 [event_method]: 1.891e-05 [auto_monad]: 5.808e-05 [graph_reusing]: 5.02e-06 [pre_auto_parallel]: 1.91003e-06 [py_interpret_to_execute]: 0.00043602 [rewriter_before_opt_a]: 7.776e-05 [expand_dump_flag]: 2.99999e-06 [jit_opt_a]: 0.00692269, [2] [Cycle 1]: 0.00331808, [27] [switch_simplify]: 4.755e-05 [loop_unroll]: 3.034e-05 [a_1]: 0.00054227 [with_stream_mark]: 1.271e-05 [recompute_prepare]: 8.68001e-06 [updatestate_depend_eliminate]: 3.61001e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.26002e-06 [specialize_transform]: 6.98998e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 9.99001e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 8.48999e-06 [inline_without_move]: 5.77999e-06 [renormalize]: 0.00236267 [add_forward_monad_depend]: 5.50001e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.552e-05 [cse]: 2.727e-05 [replace_applicator]: 1.521e-05 [Cycle 2]: 0.00036616, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 5.91998e-06 [a_1]: 0.00012434 [with_stream_mark]: 1.04e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 2.83998e-06 [updatestate_assign_eliminate]: 3.15002e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.31002e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 2.61999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.437e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.141e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.052e-05 [rewriter_after_opt_a]: 3.461e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 5.64998e-06 [mutable_eliminate]: 0.0005659 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.767e-05, [2] [frontend_op_eliminate]: 1.89e-05 [inline_after_opt_a]: 1.791e-05 [cconv]: 2.354e-05 [loop_unroll]: 0.0004669 [jit_opt_after_cconv]: 0.00014772, [1] [Cycle 1]: 0.00014054, [11] [c_1]: 2.499e-05 [parameter_eliminate]: 1.96003e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.01998e-06 [cse]: 1.912e-05 [call_graph_tuple_transform]: 2.043e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 7.08e-06 [remove_dup_value]: 1.733e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 7.57002e-06 [add_recomputation]: 5.388e-05 [cse_after_recomputation]: 2.446e-05, [1] [Cycle 1]: 1.821e-05, [1] [cse]: 1.203e-05 [auto_monad_reorder]: 1.499e-05 [get_jit_bprop_graph]: 1.48002e-06 [rewriter_after_jit_bprop_graph]: 5.24e-06 [opt_after_jit_grad]: 0.0004683 [symbol_engine_optimizer]: 7.231e-05, [1] [Cycle 1]: 6.642e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 7.71999e-06 [elim_not_effective]: 1.229e-05 [opt_reshape]: 6.49999e-06 [fold_const_symbol]: 9.52001e-06 [renormalize]: 3.50003e-07 [validate]: 3.473e-05 Sums bootstrap : 0.000274s : 0.25% type_inference : 0.102332s : 94.30% event_method : 0.000019s : 0.02% auto_monad : 0.000058s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000436s : 0.40% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000667s : 0.61% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002363s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000566s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000467s : 0.43% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000017s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000054s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000468s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.03% Time group info: ------[substitution.] 0.000173 24 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.93% : 0.000002s : 2: substitution.fold_const_symbol 3.19% : 0.000006s : 4: substitution.graph_param_transform 81.75% : 0.000141s : 4: substitution.inline 1.92% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.82% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000003s : 2: substitution.replace_old_param 6.24% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102266 2 97.36% : 0.099562s : 1: type_inference.infer 2.64% : 0.002704s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.00% : 0.000045s : 4: replace.inline 34.00% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000148 6 93.52% : 0.000139s : 4: match.inline 6.48% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 2.18% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000002s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.37% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 4.93% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.02% : 0.000003s : 18: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.33% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 2.05% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.21% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001972 22 64.60% : 0.001274s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.37% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.03% : 0.000671s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115639 72 0.05% : 0.000057s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000288s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.99% : 0.006926s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.41% : 0.000475s : 1: loop_unroll 0.50% : 0.000574s : 1: mutable_eliminate 0.77% : 0.000890s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000441s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.44% : 0.001660s : 1: renormalize.infer 0.60% : 0.000695s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.50% : 0.102343s : 1: type_inference TotalTime = 0.0148984, [30] [bootstrap]: 0.00026902 [type_inference]: 0.00731463 [event_method]: 1.91e-05 [auto_monad]: 5.423e-05 [graph_reusing]: 5.32999e-06 [pre_auto_parallel]: 1.66e-06 [py_interpret_to_execute]: 4.389e-05 [rewriter_before_opt_a]: 7.507e-05 [expand_dump_flag]: 2.14999e-06 [jit_opt_a]: 0.0050388, [2] [Cycle 1]: 0.00160508, [27] [switch_simplify]: 4.874e-05 [loop_unroll]: 3.234e-05 [a_1]: 0.00057664 [with_stream_mark]: 1.245e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.48e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 6.23e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.113e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 8.76997e-06 [inline_without_move]: 5.90002e-06 [renormalize]: 0.00064595 [add_forward_monad_depend]: 3.43999e-06 [auto_monad_grad]: 1.45999e-06 [auto_monad_eliminator]: 1.139e-05 [cse]: 2.181e-05 [replace_applicator]: 1.091e-05 [Cycle 2]: 0.00032782, [27] [switch_simplify]: 6.21e-06 [loop_unroll]: 5.10001e-06 [a_1]: 9.933e-05 [with_stream_mark]: 9.21002e-06 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.16998e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.024e-05 [j_node_and_user_rematch]: 7.82e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.41001e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.79e-06 [cse]: 1.338e-05 [replace_applicator]: 5.20001e-06 [py_interpret_to_execute_after_opt_a]: 9.99001e-06 [rewriter_after_opt_a]: 3.02e-05 [convert_after_rewriter]: 6.06e-06 [order_py_execute_after_rewriter]: 4.70001e-06 [mutable_eliminate]: 0.00050395 [jit_opt_b]: 5.788e-05, [1] [Cycle 1]: 5.173e-05, [2] [frontend_op_eliminate]: 1.586e-05 [inline_after_opt_a]: 2.391e-05 [cconv]: 1.822e-05 [loop_unroll]: 0.00047007 [jit_opt_after_cconv]: 0.0001513, [1] [Cycle 1]: 0.0001452, [11] [c_1]: 2.072e-05 [parameter_eliminate]: 2.31e-06 [updatestate_depend_eliminate]: 4.74e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 1.426e-05 [cse]: 2.078e-05 [call_graph_tuple_transform]: 1.763e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.18001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 5.47999e-06 [remove_dup_value]: 9.79999e-06 [partial_unused_args_eliminate]: 1.81e-06 [environ_conv]: 4.62e-06 [add_recomputation]: 3.64e-05 [cse_after_recomputation]: 2.087e-05, [1] [Cycle 1]: 1.589e-05, [1] [cse]: 1.042e-05 [auto_monad_reorder]: 1.213e-05 [get_jit_bprop_graph]: 1.96003e-06 [rewriter_after_jit_bprop_graph]: 4.57998e-06 [opt_after_jit_grad]: 0.00047727 [symbol_engine_optimizer]: 6.961e-05, [1] [Cycle 1]: 6.366e-05, [6] [build]: 2.64001e-06 [elim_shapecalc]: 7.38999e-06 [elim_not_effective]: 1.254e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.39998e-06 [renormalize]: 3.39991e-07 [validate]: 3.183e-05 Sums bootstrap : 0.000269s : 2.39% type_inference : 0.007315s : 65.00% event_method : 0.000019s : 0.17% auto_monad : 0.000054s : 0.48% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000044s : 0.39% rewriter_before_opt_a : 0.000075s : 0.67% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000055s : 0.49% jit_opt_a.loop_unroll : 0.000037s : 0.33% jit_opt_a.a_1 : 0.000676s : 6.01% jit_opt_a.with_stream_mark : 0.000022s : 0.19% jit_opt_a.recompute_prepare : 0.000012s : 0.11% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000021s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.09% jit_opt_a.renormalize : 0.000646s : 5.74% jit_opt_a.add_forward_monad_depend : 0.000004s : 0.04% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.15% jit_opt_a.cse : 0.000035s : 0.31% jit_opt_a.replace_applicator : 0.000016s : 0.14% py_interpret_to_execute_after_opt_a : 0.000010s : 0.09% rewriter_after_opt_a : 0.000030s : 0.27% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000504s : 4.48% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000024s : 0.21% cconv : 0.000018s : 0.16% loop_unroll : 0.000470s : 4.18% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000014s : 0.13% jit_opt_after_cconv.cse : 0.000021s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000010s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000036s : 0.32% cse_after_recomputation.cse : 0.000010s : 0.09% auto_monad_reorder : 0.000012s : 0.11% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000477s : 4.24% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.28% Time group info: ------[substitution.] 0.000203 27 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.08% : 0.000004s : 3: substitution.graph_param_transform 82.90% : 0.000168s : 5: substitution.inline 1.35% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.71% : 0.000010s : 3: substitution.reduce_eliminate 1.70% : 0.000003s : 4: substitution.remove_not_recompute_node 1.57% : 0.000003s : 2: substitution.replace_old_param 4.19% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007261 2 87.60% : 0.006360s : 1: type_inference.infer 12.40% : 0.000900s : 1: type_inference.specialize ------[replace.] 0.000083 7 66.65% : 0.000055s : 5: replace.inline 33.35% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 7 95.69% : 0.000165s : 5: match.inline 4.31% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 747 1.31% : 0.000002s : 11: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 11: predicate.addn_check_dump 1.26% : 0.000002s : 11: predicate.addn_zero_filter 1.87% : 0.000002s : 11: predicate.arithmetic_simplify 1.42% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.35% : 0.000002s : 11: predicate.depend_value_elim 1.22% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.42% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 11: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.22% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000006s : 24: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.97% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 16: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.54% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 11: predicate.merge_addn 1.19% : 0.000001s : 11: predicate.minmaximum_grad 1.28% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.34% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 2.16% : 0.000003s : 11: predicate.reduce_eliminate 1.51% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 19: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.37% : 0.000002s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.90% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.78% : 0.000009s : 59: predicate.switch_simplify 1.45% : 0.000002s : 11: predicate.tile_eliminate 1.25% : 0.000002s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000707 16 47.34% : 0.000334s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.91% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 44.76% : 0.000316s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016498 72 0.24% : 0.000039s : 1: add_recomputation 0.35% : 0.000057s : 1: auto_monad 0.09% : 0.000015s : 1: auto_monad_reorder 1.70% : 0.000280s : 1: bootstrap 0.13% : 0.000021s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.14% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 30.56% : 0.005042s : 1: jit_opt_a 0.93% : 0.000154s : 1: jit_opt_after_cconv 0.37% : 0.000060s : 1: jit_opt_b 2.89% : 0.000478s : 1: loop_unroll 3.10% : 0.000512s : 1: mutable_eliminate 5.34% : 0.000881s : 26: opt.transform.jit_opt_a 0.28% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000033s : 4: opt.transform.jit_opt_b 0.07% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.93% : 0.000484s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000047s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000012s : 1: remove_dup_value 2.17% : 0.000358s : 1: renormalize.infer 1.70% : 0.000281s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000033s : 1: rewriter_after_opt_a 0.47% : 0.000078s : 1: rewriter_before_opt_a 0.44% : 0.000072s : 1: symbol_engine_optimizer 44.41% : 0.007326s : 1: type_inference TotalTime = 0.11051, [30] [bootstrap]: 0.00034603 [type_inference]: 0.101022 [event_method]: 1.723e-05 [auto_monad]: 4.624e-05 [graph_reusing]: 4.1e-06 [pre_auto_parallel]: 1.79e-06 [py_interpret_to_execute]: 0.00046086 [rewriter_before_opt_a]: 7.606e-05 [expand_dump_flag]: 2.48e-06 [jit_opt_a]: 0.00651709, [2] [Cycle 1]: 0.00307054, [27] [switch_simplify]: 4.573e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00050391 [with_stream_mark]: 1.336e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 6.46e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.175e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.45999e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00217832 [add_forward_monad_depend]: 4.46002e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 1.209e-05 [cse]: 1.91e-05 [replace_applicator]: 1.233e-05 [Cycle 2]: 0.00039621, [27] [switch_simplify]: 6.33e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00016136 [with_stream_mark]: 9.26998e-06 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 2.66e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 1.96003e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.40999e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 5.14998e-06 [merge_forward]: 2.37999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.46002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.29999e-06 [cse]: 1.188e-05 [replace_applicator]: 5.99e-06 [py_interpret_to_execute_after_opt_a]: 8.90999e-06 [rewriter_after_opt_a]: 2.764e-05 [convert_after_rewriter]: 5.40001e-06 [order_py_execute_after_rewriter]: 1.677e-05 [mutable_eliminate]: 0.00049603 [jit_opt_b]: 5.276e-05, [1] [Cycle 1]: 4.665e-05, [2] [frontend_op_eliminate]: 1.814e-05 [inline_after_opt_a]: 1.784e-05 [cconv]: 1.683e-05 [loop_unroll]: 0.00041939 [jit_opt_after_cconv]: 0.00014315, [1] [Cycle 1]: 0.00013666, [11] [c_1]: 2.54e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.868e-05 [call_graph_tuple_transform]: 1.848e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.59001e-06 [remove_dup_value]: 8.72e-06 [partial_unused_args_eliminate]: 1.55001e-06 [environ_conv]: 5.96e-06 [add_recomputation]: 3.383e-05 [cse_after_recomputation]: 2.062e-05, [1] [Cycle 1]: 1.575e-05, [1] [cse]: 1.03e-05 [auto_monad_reorder]: 1.014e-05 [get_jit_bprop_graph]: 1.31998e-06 [rewriter_after_jit_bprop_graph]: 4.90999e-06 [opt_after_jit_grad]: 0.0004766 [symbol_engine_optimizer]: 7.544e-05, [1] [Cycle 1]: 6.937e-05, [6] [build]: 2.93998e-06 [elim_shapecalc]: 8.27e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 7.4e-06 [fold_const_symbol]: 1.02e-05 [renormalize]: 3.50003e-07 [validate]: 3.309e-05 Sums bootstrap : 0.000346s : 0.32% type_inference : 0.101022s : 94.49% event_method : 0.000017s : 0.02% auto_monad : 0.000046s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000461s : 0.43% rewriter_before_opt_a : 0.000076s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000665s : 0.62% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002178s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000017s : 0.02% mutable_eliminate : 0.000496s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000419s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000477s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000155 24 1.15% : 0.000002s : 2: substitution.elim_not_effective 1.51% : 0.000002s : 2: substitution.fold_const_symbol 2.49% : 0.000004s : 4: substitution.graph_param_transform 82.27% : 0.000128s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.90% : 0.000004s : 4: substitution.remove_not_recompute_node 2.27% : 0.000004s : 2: substitution.replace_old_param 5.63% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100965 2 97.56% : 0.098505s : 1: type_inference.infer 2.44% : 0.002459s : 1: type_inference.specialize ------[replace.] 0.000063 6 65.33% : 0.000041s : 4: replace.inline 34.67% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000133 6 94.38% : 0.000125s : 4: match.inline 5.62% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.11% : 0.000001s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.20% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 2.04% : 0.000003s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.42% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.11% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000009s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001927 22 65.94% : 0.001271s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.65% : 0.000629s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113654 72 0.03% : 0.000037s : 1: add_recomputation 0.04% : 0.000049s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.31% : 0.000358s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.74% : 0.006519s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.38% : 0.000427s : 1: loop_unroll 0.44% : 0.000504s : 1: mutable_eliminate 0.77% : 0.000879s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000485s : 1: opt_after_jit_grad 0.02% : 0.000019s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000467s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.35% : 0.001536s : 1: renormalize.infer 0.56% : 0.000635s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000081s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 88.90% : 0.101034s : 1: type_inference TotalTime = 0.116067, [30] [bootstrap]: 0.0002576 [type_inference]: 0.105868 [event_method]: 1.911e-05 [auto_monad]: 4.911e-05 [graph_reusing]: 3.64002e-06 [pre_auto_parallel]: 1.60999e-06 [py_interpret_to_execute]: 0.00047406 [rewriter_before_opt_a]: 9.016e-05 [expand_dump_flag]: 2.68003e-06 [jit_opt_a]: 0.00711374, [2] [Cycle 1]: 0.00361592, [27] [switch_simplify]: 5.216e-05 [loop_unroll]: 3.468e-05 [a_1]: 0.00064349 [with_stream_mark]: 1.343e-05 [recompute_prepare]: 8.52998e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.21997e-06 [specialize_transform]: 6.84001e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 2.64001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.239e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 6.897e-05 [replace_old_param]: 9.05999e-06 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00249136 [add_forward_monad_depend]: 4.77998e-06 [auto_monad_grad]: 1.77001e-06 [auto_monad_eliminator]: 1.27e-05 [cse]: 2.315e-05 [replace_applicator]: 1.475e-05 [Cycle 2]: 0.00037172, [27] [switch_simplify]: 6.96999e-06 [loop_unroll]: 6.31998e-06 [a_1]: 0.00012778 [with_stream_mark]: 8.70001e-06 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 2.90002e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.48e-06 [cell_reuse_recompute_pass]: 2.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 8.93002e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 8.09997e-06 [inline_without_move]: 5.71e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.47001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 7.15e-06 [cse]: 1.371e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 1.108e-05 [rewriter_after_opt_a]: 3.099e-05 [convert_after_rewriter]: 7.19001e-06 [order_py_execute_after_rewriter]: 4.57e-06 [mutable_eliminate]: 0.00055478 [jit_opt_b]: 5.359e-05, [1] [Cycle 1]: 4.747e-05, [2] [frontend_op_eliminate]: 1.912e-05 [inline_after_opt_a]: 1.729e-05 [cconv]: 1.961e-05 [loop_unroll]: 0.00045197 [jit_opt_after_cconv]: 0.0001464, [1] [Cycle 1]: 0.00013994, [11] [c_1]: 2.562e-05 [parameter_eliminate]: 2.08998e-06 [updatestate_depend_eliminate]: 5.06997e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.71999e-06 [cse]: 2.093e-05 [call_graph_tuple_transform]: 1.836e-05 [tuple_list_get_item_eliminator]: 6.64999e-06 [none_parameter_eliminate]: 1.36002e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.172e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 6.06e-06 [add_recomputation]: 3.652e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.817e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.453e-05 [get_jit_bprop_graph]: 1.62001e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.0004977 [symbol_engine_optimizer]: 0.00010585, [1] [Cycle 1]: 9.987e-05, [6] [build]: 2.42001e-06 [elim_shapecalc]: 3.782e-05 [elim_not_effective]: 1.35e-05 [opt_reshape]: 7.41001e-06 [fold_const_symbol]: 9.81e-06 [renormalize]: 3.50003e-07 [validate]: 4.061e-05 Sums bootstrap : 0.000258s : 0.23% type_inference : 0.105868s : 94.20% event_method : 0.000019s : 0.02% auto_monad : 0.000049s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000474s : 0.42% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000771s : 0.69% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000071s : 0.06% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002491s : 2.22% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000037s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000555s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000452s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000498s : 0.44% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000038s : 0.03% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000216 28 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000004s : 4: substitution.graph_param_transform 84.12% : 0.000182s : 5: substitution.inline 1.29% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.34% : 0.000009s : 3: substitution.reduce_eliminate 2.03% : 0.000004s : 4: substitution.remove_not_recompute_node 1.46% : 0.000003s : 2: substitution.replace_old_param 3.37% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105807 2 97.44% : 0.103100s : 1: type_inference.infer 2.56% : 0.002707s : 1: type_inference.specialize ------[replace.] 0.000093 7 68.77% : 0.000064s : 5: replace.inline 31.23% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 7 96.67% : 0.000179s : 5: match.inline 3.33% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.26% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 13: predicate.addn_check_dump 1.26% : 0.000002s : 13: predicate.addn_zero_filter 1.95% : 0.000003s : 13: predicate.arithmetic_simplify 1.26% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.29% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 13: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_depend_swap 1.30% : 0.000002s : 13: predicate.environ_get_eliminate 1.19% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.97% : 0.000007s : 28: predicate.inline 1.08% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.80% : 0.000003s : 19: predicate.load_eliminater 0.97% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.22% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.21% : 0.000002s : 13: predicate.minmaximum_grad 1.18% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 19: predicate.partial_eliminate 1.26% : 0.000002s : 13: predicate.print_const_string_wrapper 2.14% : 0.000003s : 13: predicate.reduce_eliminate 1.51% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 23: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 13: predicate.reshape_eliminate 1.44% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.65% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 20: predicate.switch_defer_inline 2.22% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 64: predicate.switch_simplify 1.33% : 0.000002s : 13: predicate.tile_eliminate 1.46% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 13: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002121 25 61.88% : 0.001312s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.75% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.37% : 0.000750s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119663 72 0.03% : 0.000039s : 1: add_recomputation 0.04% : 0.000052s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000268s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.95% : 0.007117s : 1: jit_opt_a 0.12% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.38% : 0.000460s : 1: loop_unroll 0.47% : 0.000564s : 1: mutable_eliminate 0.84% : 0.001001s : 26: opt.transform.jit_opt_a 0.04% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000065s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.40% : 0.000481s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.47% : 0.001755s : 1: renormalize.infer 0.61% : 0.000728s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.09% : 0.000108s : 1: symbol_engine_optimizer 88.48% : 0.105880s : 1: type_inference TotalTime = 0.057305, [30] [bootstrap]: 0.00027393 [type_inference]: 0.0481924 [event_method]: 1.767e-05 [auto_monad]: 5.442e-05 [graph_reusing]: 5.23002e-06 [pre_auto_parallel]: 1.96e-06 [py_interpret_to_execute]: 0.00025124 [rewriter_before_opt_a]: 7.68e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00634497, [2] [Cycle 1]: 0.00263152, [27] [switch_simplify]: 5.493e-05 [loop_unroll]: 3.041e-05 [a_1]: 0.00055082 [with_stream_mark]: 1.492e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.73997e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.14001e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 0.00166095 [add_forward_monad_depend]: 5.84e-06 [auto_monad_grad]: 1.87999e-06 [auto_monad_eliminator]: 1.439e-05 [cse]: 2.028e-05 [replace_applicator]: 1.274e-05 [Cycle 2]: 0.00035323, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 5.74999e-06 [a_1]: 0.00012034 [with_stream_mark]: 8.90999e-06 [recompute_prepare]: 5.62999e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.06003e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.56002e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 2.68998e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.348e-05 [j_node_and_user_rematch]: 8.99998e-06 [meta_fg_expand]: 1.66998e-06 [replace_old_param]: 8.05e-06 [inline_without_move]: 5.24998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.131e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 9.61e-06 [rewriter_after_opt_a]: 3.001e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00049439 [jit_opt_b]: 5.336e-05, [1] [Cycle 1]: 4.694e-05, [2] [frontend_op_eliminate]: 1.858e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.236e-05 [loop_unroll]: 0.00042059 [jit_opt_after_cconv]: 0.0001472, [1] [Cycle 1]: 0.00014052, [11] [c_1]: 2.63e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.91998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.906e-05 [call_graph_tuple_transform]: 2.016e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.225e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 7.26001e-06 [add_recomputation]: 4.169e-05 [cse_after_recomputation]: 2.204e-05, [1] [Cycle 1]: 1.677e-05, [1] [cse]: 1.12e-05 [auto_monad_reorder]: 1.457e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 4.08001e-06 [opt_after_jit_grad]: 0.00050282 [symbol_engine_optimizer]: 8.022e-05, [1] [Cycle 1]: 7.349e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 9.19e-06 [elim_not_effective]: 1.476e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 9.94999e-06 [renormalize]: 3.60014e-07 [validate]: 3.943e-05 Sums bootstrap : 0.000274s : 0.51% type_inference : 0.048192s : 90.28% event_method : 0.000018s : 0.03% auto_monad : 0.000054s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000251s : 0.47% rewriter_before_opt_a : 0.000077s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.12% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000671s : 1.26% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001661s : 3.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000032s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000494s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000022s : 0.04% loop_unroll : 0.000421s : 0.79% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000042s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000503s : 0.94% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.07% Time group info: ------[substitution.] 0.000189 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 4: substitution.graph_param_transform 82.84% : 0.000156s : 4: substitution.inline 1.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000003s : 2: substitution.replace_old_param 6.02% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048129 2 96.37% : 0.046383s : 1: type_inference.infer 3.63% : 0.001745s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.59% : 0.000048s : 4: replace.inline 33.41% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 6 93.73% : 0.000154s : 4: match.inline 6.27% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.61% : 0.000002s : 12: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.51% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.21% : 0.000002s : 12: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.48% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000001s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001925 22 70.31% : 0.001353s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.51% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.18% : 0.000542s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059942 72 0.07% : 0.000044s : 1: add_recomputation 0.10% : 0.000058s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.48% : 0.000286s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.59% : 0.006348s : 1: jit_opt_a 0.25% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.72% : 0.000429s : 1: loop_unroll 0.84% : 0.000502s : 1: mutable_eliminate 1.50% : 0.000898s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.86% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000257s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000015s : 1: remove_dup_value 1.81% : 0.001084s : 1: renormalize.infer 0.95% : 0.000569s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.14% : 0.000082s : 1: rewriter_before_opt_a 0.14% : 0.000083s : 1: symbol_engine_optimizer 80.42% : 0.048205s : 1: type_inference TotalTime = 0.0112661, [30] [bootstrap]: 0.00025453 [type_inference]: 0.00417345 [event_method]: 1.859e-05 [auto_monad]: 6.11e-05 [graph_reusing]: 5.56998e-06 [pre_auto_parallel]: 2.13998e-06 [py_interpret_to_execute]: 4.089e-05 [rewriter_before_opt_a]: 6.668e-05 [expand_dump_flag]: 2.19001e-06 [jit_opt_a]: 0.00465738, [2] [Cycle 1]: 0.00141079, [27] [switch_simplify]: 4.567e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00047854 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 7.48999e-06 [updatestate_depend_eliminate]: 3.14001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.92002e-06 [cell_reuse_recompute_pass]: 7.39994e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.163e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 8.14002e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 0.00049596 [add_forward_monad_depend]: 4.65001e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 7.499e-05 [cse]: 1.873e-05 [replace_applicator]: 1.118e-05 [Cycle 2]: 0.00031268, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 5.15001e-06 [a_1]: 9.097e-05 [with_stream_mark]: 8.21002e-06 [recompute_prepare]: 5.10999e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 4.73001e-06 [accelerated_algorithm]: 4.75999e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.48001e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.216e-05 [j_node_and_user_rematch]: 7.6e-06 [meta_fg_expand]: 1.66998e-06 [replace_old_param]: 7.47002e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.051e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 8.10999e-06 [rewriter_after_opt_a]: 2.719e-05 [convert_after_rewriter]: 6.04001e-06 [order_py_execute_after_rewriter]: 4.3e-06 [mutable_eliminate]: 0.00046868 [jit_opt_b]: 4.766e-05, [1] [Cycle 1]: 4.159e-05, [2] [frontend_op_eliminate]: 1.542e-05 [inline_after_opt_a]: 1.489e-05 [cconv]: 1.885e-05 [loop_unroll]: 0.00042083 [jit_opt_after_cconv]: 0.00013727, [1] [Cycle 1]: 0.00013089, [11] [c_1]: 2.073e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 6.36e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 1.866e-05 [call_graph_tuple_transform]: 1.717e-05 [tuple_list_get_item_eliminator]: 5.48002e-06 [none_parameter_eliminate]: 1.17e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.20001e-06 [remove_dup_value]: 2.082e-05 [partial_unused_args_eliminate]: 1.86e-06 [environ_conv]: 4.23999e-06 [add_recomputation]: 3.734e-05 [cse_after_recomputation]: 2.257e-05, [1] [Cycle 1]: 1.737e-05, [1] [cse]: 1.146e-05 [auto_monad_reorder]: 9.96e-06 [get_jit_bprop_graph]: 1.57001e-06 [rewriter_after_jit_bprop_graph]: 4.63001e-06 [opt_after_jit_grad]: 0.00047925 [symbol_engine_optimizer]: 7.778e-05, [1] [Cycle 1]: 7.023e-05, [6] [build]: 4.15999e-06 [elim_shapecalc]: 9.22001e-06 [elim_not_effective]: 1.473e-05 [opt_reshape]: 5.70001e-06 [fold_const_symbol]: 8.53001e-06 [renormalize]: 3.59985e-07 [validate]: 2.878e-05 Sums bootstrap : 0.000255s : 3.27% type_inference : 0.004173s : 53.58% event_method : 0.000019s : 0.24% auto_monad : 0.000061s : 0.78% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000041s : 0.52% rewriter_before_opt_a : 0.000067s : 0.86% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000051s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000570s : 7.31% jit_opt_a.with_stream_mark : 0.000020s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000496s : 6.37% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000081s : 1.04% jit_opt_a.cse : 0.000029s : 0.38% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000027s : 0.35% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000469s : 6.02% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000019s : 0.24% loop_unroll : 0.000421s : 5.40% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000021s : 0.27% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000037s : 0.48% cse_after_recomputation.cse : 0.000011s : 0.15% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000479s : 6.15% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.12% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.19% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.37% Time group info: ------[substitution.] 0.000157 23 1.35% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 2.46% : 0.000004s : 3: substitution.graph_param_transform 83.10% : 0.000130s : 4: substitution.inline 1.88% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000004s : 4: substitution.remove_not_recompute_node 2.12% : 0.000003s : 2: substitution.replace_old_param 5.67% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004112 2 80.93% : 0.003328s : 1: type_inference.infer 19.07% : 0.000784s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.03% : 0.000042s : 4: replace.inline 33.97% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000135 6 94.29% : 0.000128s : 4: match.inline 5.71% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.38% : 0.000002s : 10: predicate.accumulaten_eliminater 1.81% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.51% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.35% : 0.000002s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.12% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.24% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.52% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.85% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.85% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.42% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000538 13 49.96% : 0.000269s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.11% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.93% : 0.000242s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012607 72 0.32% : 0.000040s : 1: add_recomputation 0.51% : 0.000065s : 1: auto_monad 0.10% : 0.000012s : 1: auto_monad_reorder 2.12% : 0.000267s : 1: bootstrap 0.17% : 0.000021s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.20% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.18% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.96% : 0.004660s : 1: jit_opt_a 1.11% : 0.000140s : 1: jit_opt_after_cconv 0.40% : 0.000050s : 1: jit_opt_b 3.40% : 0.000429s : 1: loop_unroll 3.78% : 0.000477s : 1: mutable_eliminate 6.09% : 0.000768s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.20% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.28% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.89% : 0.000490s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.19% : 0.000023s : 1: remove_dup_value 1.97% : 0.000248s : 1: renormalize.infer 1.92% : 0.000242s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000030s : 1: rewriter_after_opt_a 0.55% : 0.000069s : 1: rewriter_before_opt_a 0.64% : 0.000080s : 1: symbol_engine_optimizer 33.21% : 0.004187s : 1: type_inference TotalTime = 0.0117682, [30] [bootstrap]: 0.00028573 [type_inference]: 0.00467183 [event_method]: 1.725e-05 [auto_monad]: 5.569e-05 [graph_reusing]: 4.89e-06 [pre_auto_parallel]: 1.95001e-06 [py_interpret_to_execute]: 3.624e-05 [rewriter_before_opt_a]: 6.836e-05 [expand_dump_flag]: 2.24999e-06 [jit_opt_a]: 0.00467121, [2] [Cycle 1]: 0.00140912, [27] [switch_simplify]: 4.982e-05 [loop_unroll]: 3.062e-05 [a_1]: 0.00048576 [with_stream_mark]: 1.251e-05 [recompute_prepare]: 7.36001e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 5.97001e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 5.09998e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 9.79984e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.135e-05 [j_node_and_user_rematch]: 8.88002e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 7.85e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 0.00054263 [add_forward_monad_depend]: 4.33999e-06 [auto_monad_grad]: 1.34003e-06 [auto_monad_eliminator]: 1.204e-05 [cse]: 1.752e-05 [replace_applicator]: 1.14e-05 [Cycle 2]: 0.00031416, [27] [switch_simplify]: 5.50001e-06 [loop_unroll]: 4.97e-06 [a_1]: 9.097e-05 [with_stream_mark]: 8.68001e-06 [recompute_prepare]: 5.27001e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.02e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.87998e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.59998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 7.68001e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.39002e-06 [inline_without_move]: 4.80001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 5.71998e-06 [cse]: 1.023e-05 [replace_applicator]: 5.23002e-06 [py_interpret_to_execute_after_opt_a]: 7.82e-06 [rewriter_after_opt_a]: 2.698e-05 [convert_after_rewriter]: 5.94999e-06 [order_py_execute_after_rewriter]: 4.68999e-06 [mutable_eliminate]: 0.00046101 [jit_opt_b]: 4.808e-05, [1] [Cycle 1]: 4.201e-05, [2] [frontend_op_eliminate]: 1.577e-05 [inline_after_opt_a]: 1.565e-05 [cconv]: 2.111e-05 [loop_unroll]: 0.00041092 [jit_opt_after_cconv]: 0.00013557, [1] [Cycle 1]: 0.00012933, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.42001e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.791e-05 [call_graph_tuple_transform]: 1.708e-05 [tuple_list_get_item_eliminator]: 5.54e-06 [none_parameter_eliminate]: 1.27e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 1.048e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 4.42998e-06 [add_recomputation]: 3.762e-05 [cse_after_recomputation]: 4.461e-05, [1] [Cycle 1]: 2.68e-05, [1] [cse]: 1.035e-05 [auto_monad_reorder]: 1.312e-05 [get_jit_bprop_graph]: 1.67999e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.00046171 [symbol_engine_optimizer]: 7.117e-05, [1] [Cycle 1]: 6.522e-05, [6] [build]: 3.02002e-06 [elim_shapecalc]: 7.58001e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 5.61998e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 3.19997e-07 [validate]: 2.779e-05 Sums bootstrap : 0.000286s : 3.46% type_inference : 0.004672s : 56.56% event_method : 0.000017s : 0.21% auto_monad : 0.000056s : 0.67% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.44% rewriter_before_opt_a : 0.000068s : 0.83% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.67% jit_opt_a.loop_unroll : 0.000036s : 0.43% jit_opt_a.a_1 : 0.000577s : 6.98% jit_opt_a.with_stream_mark : 0.000021s : 0.26% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000543s : 6.57% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.22% jit_opt_a.cse : 0.000028s : 0.34% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000027s : 0.33% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000461s : 5.58% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000021s : 0.26% loop_unroll : 0.000411s : 4.98% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000010s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000038s : 0.46% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000013s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000462s : 5.59% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.34% Time group info: ------[substitution.] 0.000165 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000004s : 3: substitution.graph_param_transform 82.46% : 0.000136s : 4: substitution.inline 1.87% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.69% : 0.000004s : 4: substitution.remove_not_recompute_node 2.11% : 0.000003s : 2: substitution.replace_old_param 6.33% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004620 2 80.38% : 0.003714s : 1: type_inference.infer 19.62% : 0.000907s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.43% : 0.000042s : 4: replace.inline 33.57% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 93.49% : 0.000133s : 4: match.inline 6.51% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.31% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.28% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.57% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.50% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.59% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.09% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 2.03% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.56% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000001s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.42% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000708 13 55.11% : 0.000390s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.71% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.18% : 0.000292s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013164 72 0.31% : 0.000040s : 1: add_recomputation 0.45% : 0.000059s : 1: auto_monad 0.12% : 0.000016s : 1: auto_monad_reorder 2.28% : 0.000301s : 1: bootstrap 0.18% : 0.000024s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.36% : 0.000047s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 35.51% : 0.004674s : 1: jit_opt_a 1.05% : 0.000138s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.19% : 0.000420s : 1: loop_unroll 3.57% : 0.000469s : 1: mutable_eliminate 5.91% : 0.000779s : 26: opt.transform.jit_opt_a 0.35% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.57% : 0.000470s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000013s : 1: remove_dup_value 1.99% : 0.000263s : 1: renormalize.infer 2.08% : 0.000274s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000030s : 1: rewriter_after_opt_a 0.54% : 0.000071s : 1: rewriter_before_opt_a 0.56% : 0.000074s : 1: symbol_engine_optimizer 35.58% : 0.004683s : 1: type_inference TotalTime = 0.117062, [30] [bootstrap]: 0.00028331 [type_inference]: 0.106723 [event_method]: 2.317e-05 [auto_monad]: 7.106e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 0.00060518 [rewriter_before_opt_a]: 9.724e-05 [expand_dump_flag]: 3.89002e-06 [jit_opt_a]: 0.00716314, [2] [Cycle 1]: 0.00356484, [27] [switch_simplify]: 5.864e-05 [loop_unroll]: 3.337e-05 [a_1]: 0.00065915 [with_stream_mark]: 1.7e-05 [recompute_prepare]: 8.85999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 3.32997e-06 [parameter_eliminate]: 1.96998e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.78998e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 6.41998e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.16998e-06 [inline_without_move]: 6.34001e-06 [renormalize]: 0.00246329 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.382e-05 [cse]: 3.169e-05 [replace_applicator]: 1.447e-05 [Cycle 2]: 0.00037128, [27] [switch_simplify]: 7.05e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00012796 [with_stream_mark]: 1.092e-05 [recompute_prepare]: 6.19001e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 5.68002e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.92001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.156e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 8.35999e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.304e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.074e-05 [rewriter_after_opt_a]: 3.436e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 5.32001e-06 [mutable_eliminate]: 0.00050962 [jit_opt_b]: 5.305e-05, [1] [Cycle 1]: 4.661e-05, [2] [frontend_op_eliminate]: 1.833e-05 [inline_after_opt_a]: 1.739e-05 [cconv]: 2.377e-05 [loop_unroll]: 0.00041592 [jit_opt_after_cconv]: 0.00014533, [1] [Cycle 1]: 0.00013882, [11] [c_1]: 2.539e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.21002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.002e-05 [call_graph_tuple_transform]: 1.967e-05 [tuple_list_get_item_eliminator]: 6.26998e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.441e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.01999e-06 [add_recomputation]: 4.242e-05 [cse_after_recomputation]: 2.21e-05, [1] [Cycle 1]: 1.695e-05, [1] [cse]: 1.157e-05 [auto_monad_reorder]: 1.627e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00046304 [symbol_engine_optimizer]: 7.291e-05, [1] [Cycle 1]: 6.678e-05, [6] [build]: 3.02002e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.326e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.89991e-07 [validate]: 6.191e-05 Sums bootstrap : 0.000283s : 0.25% type_inference : 0.106723s : 94.22% event_method : 0.000023s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000605s : 0.53% rewriter_before_opt_a : 0.000097s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000787s : 0.69% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002463s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000510s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000416s : 0.37% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000042s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000463s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000062s : 0.05% Time group info: ------[substitution.] 0.000232 28 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.52% : 0.000001s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 4: substitution.graph_param_transform 82.40% : 0.000191s : 5: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.38% : 0.000010s : 3: substitution.reduce_eliminate 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.51% : 0.000003s : 2: substitution.replace_old_param 4.46% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106646 2 97.43% : 0.103905s : 1: type_inference.infer 2.57% : 0.002742s : 1: type_inference.specialize ------[replace.] 0.000092 7 66.48% : 0.000061s : 5: replace.inline 33.52% : 0.000031s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 7 95.35% : 0.000189s : 5: match.inline 4.65% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000141 886 1.28% : 0.000002s : 13: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000002s : 13: predicate.addn_check_dump 1.34% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.40% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.25% : 0.000002s : 13: predicate.compare_switch_simplify 1.31% : 0.000002s : 13: predicate.depend_value_elim 1.15% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.32% : 0.000002s : 13: predicate.environ_get_eliminate 1.17% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.63% : 0.000008s : 28: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 19: predicate.load_eliminater 1.05% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 13: predicate.merge_addn 1.13% : 0.000002s : 13: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 19: predicate.partial_eliminate 1.27% : 0.000002s : 13: predicate.print_const_string_wrapper 2.24% : 0.000003s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 23: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.55% : 0.000002s : 13: predicate.reshape_eliminate 1.45% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 13: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.62% : 0.000004s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.41% : 0.000010s : 64: predicate.switch_simplify 1.39% : 0.000002s : 13: predicate.tile_eliminate 1.24% : 0.000002s : 13: predicate.transpose_eliminate 1.42% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.66% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002199 25 61.85% : 0.001360s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.64% : 0.000058s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.51% : 0.000781s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120602 72 0.04% : 0.000045s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.25% : 0.000296s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000027s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.94% : 0.007166s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.35% : 0.000424s : 1: loop_unroll 0.43% : 0.000518s : 1: mutable_eliminate 0.85% : 0.001025s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.51% : 0.000613s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.41% : 0.001697s : 1: renormalize.infer 0.63% : 0.000758s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.09% : 0.000103s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.51% : 0.106739s : 1: type_inference TotalTime = 0.0149844, [30] [bootstrap]: 0.00025761 [type_inference]: 0.00725417 [event_method]: 1.989e-05 [auto_monad]: 6.745e-05 [graph_reusing]: 5.66e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 4.334e-05 [rewriter_before_opt_a]: 8.135e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.0051893, [2] [Cycle 1]: 0.00167222, [27] [switch_simplify]: 5.794e-05 [loop_unroll]: 3.252e-05 [a_1]: 0.00060162 [with_stream_mark]: 1.504e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 3.07002e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 6.03998e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.96998e-06 [renormalize]: 0.00063889 [add_forward_monad_depend]: 5.43002e-06 [auto_monad_grad]: 2.51998e-06 [auto_monad_eliminator]: 1.395e-05 [cse]: 2.816e-05 [replace_applicator]: 1.162e-05 [Cycle 2]: 0.00032482, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.22e-06 [a_1]: 9.595e-05 [with_stream_mark]: 8.37e-06 [recompute_prepare]: 5.34e-06 [updatestate_depend_eliminate]: 2.81e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 4.95001e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.022e-05 [j_node_and_user_rematch]: 7.93001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.20998e-06 [inline_without_move]: 4.85999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.30001e-06 [auto_monad_grad]: 7.79983e-07 [auto_monad_eliminator]: 5.73002e-06 [cse]: 1.192e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 9.29998e-06 [rewriter_after_opt_a]: 3.26e-05 [convert_after_rewriter]: 6.52001e-06 [order_py_execute_after_rewriter]: 5.72999e-06 [mutable_eliminate]: 0.00050193 [jit_opt_b]: 5.009e-05, [1] [Cycle 1]: 4.302e-05, [2] [frontend_op_eliminate]: 1.601e-05 [inline_after_opt_a]: 1.557e-05 [cconv]: 2.304e-05 [loop_unroll]: 0.00042468 [jit_opt_after_cconv]: 0.00015544, [1] [Cycle 1]: 0.00014816, [11] [c_1]: 2.118e-05 [parameter_eliminate]: 2.71e-06 [updatestate_depend_eliminate]: 5.91998e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.166e-05 [call_graph_tuple_transform]: 1.903e-05 [tuple_list_get_item_eliminator]: 5.66998e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 5.44e-06 [remove_dup_value]: 1.574e-05 [partial_unused_args_eliminate]: 1.91e-06 [environ_conv]: 6.07001e-06 [add_recomputation]: 4.641e-05 [cse_after_recomputation]: 2.262e-05, [1] [Cycle 1]: 1.744e-05, [1] [cse]: 1.139e-05 [auto_monad_reorder]: 1.668e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00047389 [symbol_engine_optimizer]: 7.163e-05, [1] [Cycle 1]: 6.554e-05, [6] [build]: 3.13998e-06 [elim_shapecalc]: 7.38e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.56e-06 [fold_const_symbol]: 8.26002e-06 [renormalize]: 4.00003e-07 [validate]: 3.355e-05 Sums bootstrap : 0.000258s : 2.30% type_inference : 0.007254s : 64.66% event_method : 0.000020s : 0.18% auto_monad : 0.000067s : 0.60% graph_reusing : 0.000006s : 0.05% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000043s : 0.39% rewriter_before_opt_a : 0.000081s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.57% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000698s : 6.22% jit_opt_a.with_stream_mark : 0.000023s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000639s : 5.70% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.18% jit_opt_a.cse : 0.000040s : 0.36% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000033s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000006s : 0.05% mutable_eliminate : 0.000502s : 4.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.14% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000023s : 0.21% loop_unroll : 0.000425s : 3.79% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.17% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000016s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000046s : 0.41% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000474s : 4.22% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.30% Time group info: ------[substitution.] 0.000218 27 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.41% : 0.000005s : 3: substitution.graph_param_transform 82.32% : 0.000179s : 5: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.37% : 0.000009s : 3: substitution.reduce_eliminate 1.99% : 0.000004s : 4: substitution.remove_not_recompute_node 1.70% : 0.000004s : 2: substitution.replace_old_param 4.20% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007198 2 86.16% : 0.006202s : 1: type_inference.infer 13.84% : 0.000996s : 1: type_inference.specialize ------[replace.] 0.000086 7 67.41% : 0.000058s : 5: replace.inline 32.59% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 7 95.63% : 0.000176s : 5: match.inline 4.37% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 747 1.34% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.35% : 0.000002s : 11: predicate.addn_zero_filter 1.91% : 0.000002s : 11: predicate.arithmetic_simplify 1.29% : 0.000002s : 11: predicate.cast_eliminate 0.41% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000002s : 11: predicate.compare_switch_simplify 1.19% : 0.000002s : 11: predicate.depend_value_elim 1.11% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_depend_swap 1.35% : 0.000002s : 11: predicate.environ_get_eliminate 1.13% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.19% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 16: predicate.load_eliminater 1.97% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.81% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.19% : 0.000001s : 11: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 16: predicate.partial_eliminate 1.21% : 0.000002s : 11: predicate.print_const_string_wrapper 1.83% : 0.000002s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.27% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 11: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.88% : 0.000001s : 6: predicate.specialize_transform 1.62% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 8.25% : 0.000010s : 59: predicate.switch_simplify 1.45% : 0.000002s : 11: predicate.tile_eliminate 1.22% : 0.000002s : 11: predicate.transpose_eliminate 1.50% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000789 16 46.32% : 0.000365s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.88% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 46.79% : 0.000369s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016608 72 0.30% : 0.000049s : 1: add_recomputation 0.42% : 0.000071s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 1.63% : 0.000271s : 1: bootstrap 0.15% : 0.000026s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000024s : 1: event_method 0.03% : 0.000006s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 31.26% : 0.005192s : 1: jit_opt_a 0.95% : 0.000158s : 1: jit_opt_after_cconv 0.32% : 0.000053s : 1: jit_opt_b 2.61% : 0.000433s : 1: loop_unroll 3.08% : 0.000511s : 1: mutable_eliminate 5.50% : 0.000914s : 26: opt.transform.jit_opt_a 0.29% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000015s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000031s : 4: opt.transform.symbol_engine_opt 2.90% : 0.000482s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.28% : 0.000046s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000018s : 1: remove_dup_value 2.08% : 0.000346s : 1: renormalize.infer 1.72% : 0.000286s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000035s : 1: rewriter_after_opt_a 0.51% : 0.000084s : 1: rewriter_before_opt_a 0.45% : 0.000074s : 1: symbol_engine_optimizer 43.76% : 0.007267s : 1: type_inference TotalTime = 0.0156093, [30] [bootstrap]: 0.00029098 [type_inference]: 0.00739406 [event_method]: 1.978e-05 [auto_monad]: 6.56e-05 [graph_reusing]: 6.78e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 4.179e-05 [rewriter_before_opt_a]: 8.044e-05 [expand_dump_flag]: 2.66999e-06 [jit_opt_a]: 0.00544352, [2] [Cycle 1]: 0.00188803, [27] [switch_simplify]: 6.089e-05 [loop_unroll]: 3.319e-05 [a_1]: 0.00066085 [with_stream_mark]: 1.876e-05 [recompute_prepare]: 8.82e-06 [updatestate_depend_eliminate]: 4.48001e-06 [updatestate_assign_eliminate]: 3.78001e-06 [updatestate_loads_eliminate]: 3.16999e-06 [parameter_eliminate]: 2.21e-06 [specialize_transform]: 7.28999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.84999e-06 [get_grad_eliminate_]: 6.08998e-06 [merge_forward]: 3.59002e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 8.87999e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.46e-06 [renormalize]: 0.00077174 [add_forward_monad_depend]: 5.81003e-06 [auto_monad_grad]: 2.53998e-06 [auto_monad_eliminator]: 1.433e-05 [cse]: 3.188e-05 [replace_applicator]: 1.206e-05 [Cycle 2]: 0.00032806, [27] [switch_simplify]: 6.54999e-06 [loop_unroll]: 5.38002e-06 [a_1]: 9.696e-05 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 5.22999e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.08002e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 4.73001e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.042e-05 [j_node_and_user_rematch]: 7.7e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 6.89001e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 6.03998e-06 [cse]: 1.386e-05 [replace_applicator]: 5.16998e-06 [py_interpret_to_execute_after_opt_a]: 1.273e-05 [rewriter_after_opt_a]: 3.725e-05 [convert_after_rewriter]: 6.69999e-06 [order_py_execute_after_rewriter]: 4.89003e-06 [mutable_eliminate]: 0.00059015 [jit_opt_b]: 5.155e-05, [1] [Cycle 1]: 4.439e-05, [2] [frontend_op_eliminate]: 1.673e-05 [inline_after_opt_a]: 1.546e-05 [cconv]: 2.396e-05 [loop_unroll]: 0.00050746 [jit_opt_after_cconv]: 0.00015313, [1] [Cycle 1]: 0.00014632, [11] [c_1]: 2.12e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.093e-05 [call_graph_tuple_transform]: 1.782e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.46e-06 [remove_dup_value]: 1.532e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 5.59998e-06 [add_recomputation]: 4.806e-05 [cse_after_recomputation]: 2.423e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.324e-05 [auto_monad_reorder]: 1.782e-05 [get_jit_bprop_graph]: 2.40002e-06 [rewriter_after_jit_bprop_graph]: 5.41002e-06 [opt_after_jit_grad]: 0.00047889 [symbol_engine_optimizer]: 7.295e-05, [1] [Cycle 1]: 6.661e-05, [6] [build]: 3.00998e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 5.82001e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 5.50004e-07 [validate]: 3.698e-05 Sums bootstrap : 0.000291s : 2.47% type_inference : 0.007394s : 62.68% event_method : 0.000020s : 0.17% auto_monad : 0.000066s : 0.56% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.02% py_interpret_to_execute : 0.000042s : 0.35% rewriter_before_opt_a : 0.000080s : 0.68% expand_dump_flag : 0.000003s : 0.02% jit_opt_a.switch_simplify : 0.000067s : 0.57% jit_opt_a.loop_unroll : 0.000039s : 0.33% jit_opt_a.a_1 : 0.000758s : 6.42% jit_opt_a.with_stream_mark : 0.000028s : 0.24% jit_opt_a.recompute_prepare : 0.000014s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.09% jit_opt_a.merge_forward : 0.000007s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.22% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000772s : 6.54% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.17% jit_opt_a.cse : 0.000046s : 0.39% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000013s : 0.11% rewriter_after_opt_a : 0.000037s : 0.32% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000590s : 5.00% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.14% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000024s : 0.20% loop_unroll : 0.000507s : 4.30% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.04% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.05% add_recomputation : 0.000048s : 0.41% cse_after_recomputation.cse : 0.000013s : 0.11% auto_monad_reorder : 0.000018s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000479s : 4.06% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000037s : 0.31% Time group info: ------[substitution.] 0.000265 27 0.79% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 1.93% : 0.000005s : 3: substitution.graph_param_transform 83.91% : 0.000222s : 5: substitution.inline 1.14% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.10% : 0.000011s : 3: substitution.reduce_eliminate 1.74% : 0.000005s : 4: substitution.remove_not_recompute_node 1.52% : 0.000004s : 2: substitution.replace_old_param 4.32% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007339 2 87.51% : 0.006422s : 1: type_inference.infer 12.49% : 0.000917s : 1: type_inference.specialize ------[replace.] 0.000096 7 66.38% : 0.000064s : 5: replace.inline 33.62% : 0.000032s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000229 7 95.55% : 0.000219s : 5: match.inline 4.45% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 747 1.27% : 0.000002s : 11: predicate.accumulaten_eliminater 0.86% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 11: predicate.addn_check_dump 1.33% : 0.000002s : 11: predicate.addn_zero_filter 1.99% : 0.000003s : 11: predicate.arithmetic_simplify 1.63% : 0.000002s : 11: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.29% : 0.000002s : 11: predicate.depend_value_elim 1.13% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.52% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 11: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000002s : 11: predicate.environ_get_eliminate 1.12% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000007s : 24: predicate.inline 0.75% : 0.000001s : 6: predicate.inline_without_move 0.35% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 16: predicate.load_eliminater 1.67% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.28% : 0.000002s : 11: predicate.merge_addn 1.12% : 0.000001s : 11: predicate.minmaximum_grad 1.85% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 16: predicate.partial_eliminate 1.20% : 0.000002s : 11: predicate.print_const_string_wrapper 2.11% : 0.000003s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.73% : 0.000002s : 19: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 11: predicate.reshape_eliminate 1.34% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.56% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.54% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.34% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.69% : 0.000010s : 59: predicate.switch_simplify 1.30% : 0.000002s : 11: predicate.tile_eliminate 1.55% : 0.000002s : 11: predicate.transpose_eliminate 1.36% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.46% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 11: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000744 16 47.86% : 0.000356s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.63% : 0.000072s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.51% : 0.000316s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.017428 72 0.29% : 0.000051s : 1: add_recomputation 0.39% : 0.000069s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.77% : 0.000308s : 1: bootstrap 0.15% : 0.000027s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000008s : 1: environ_conv 0.13% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 31.25% : 0.005447s : 1: jit_opt_a 0.90% : 0.000156s : 1: jit_opt_after_cconv 0.31% : 0.000054s : 1: jit_opt_b 2.96% : 0.000516s : 1: loop_unroll 3.45% : 0.000601s : 1: mutable_eliminate 5.63% : 0.000981s : 26: opt.transform.jit_opt_a 0.27% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000017s : 1: opt.transform.mutable_eliminate 0.12% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.79% : 0.000487s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000044s : 1: py_interpret_to_execute 0.09% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000018s : 1: remove_dup_value 2.45% : 0.000427s : 1: renormalize.infer 1.93% : 0.000336s : 1: renormalize.specialize 0.04% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000040s : 1: rewriter_after_opt_a 0.48% : 0.000083s : 1: rewriter_before_opt_a 0.43% : 0.000076s : 1: symbol_engine_optimizer 42.49% : 0.007406s : 1: type_inference TotalTime = 0.0150517, [30] [bootstrap]: 0.00025994 [type_inference]: 0.00706956 [event_method]: 1.887e-05 [auto_monad]: 6.094e-05 [graph_reusing]: 4.68001e-06 [pre_auto_parallel]: 1.85001e-06 [py_interpret_to_execute]: 4.629e-05 [rewriter_before_opt_a]: 8.12e-05 [expand_dump_flag]: 2.83e-06 [jit_opt_a]: 0.0053622, [2] [Cycle 1]: 0.00173891, [27] [switch_simplify]: 5.534e-05 [loop_unroll]: 3.409e-05 [a_1]: 0.00062148 [with_stream_mark]: 1.46e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 2.99001e-06 [parameter_eliminate]: 1.86998e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.57997e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 7.98999e-06 [inline_without_move]: 5.17e-06 [renormalize]: 0.00068094 [add_forward_monad_depend]: 6.09001e-06 [auto_monad_grad]: 1.82999e-06 [auto_monad_eliminator]: 1.499e-05 [cse]: 3.005e-05 [replace_applicator]: 1.279e-05 [Cycle 2]: 0.00032998, [27] [switch_simplify]: 5.99999e-06 [loop_unroll]: 5.06997e-06 [a_1]: 0.00010052 [with_stream_mark]: 8.70999e-06 [recompute_prepare]: 5.00999e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 5.33002e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.09998e-06 [meta_shard_fg_expand]: 1.26997e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.45001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.074e-05 [j_node_and_user_rematch]: 7.64002e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.28999e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.304e-05 [replace_applicator]: 5.32001e-06 [py_interpret_to_execute_after_opt_a]: 8.82e-06 [rewriter_after_opt_a]: 3.234e-05 [convert_after_rewriter]: 6.61e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00051009 [jit_opt_b]: 5.225e-05, [1] [Cycle 1]: 4.489e-05, [2] [frontend_op_eliminate]: 1.634e-05 [inline_after_opt_a]: 1.757e-05 [cconv]: 2.674e-05 [loop_unroll]: 0.00051744 [jit_opt_after_cconv]: 0.00015187, [1] [Cycle 1]: 0.0001452, [11] [c_1]: 2.104e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.34e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.196e-05 [call_graph_tuple_transform]: 1.766e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.20026e-07 [switch_simplify]: 5.81998e-06 [remove_dup_value]: 1.392e-05 [partial_unused_args_eliminate]: 2.58998e-06 [environ_conv]: 5.18002e-06 [add_recomputation]: 4.3e-05 [cse_after_recomputation]: 2.41e-05, [1] [Cycle 1]: 1.876e-05, [1] [cse]: 1.286e-05 [auto_monad_reorder]: 1.718e-05 [get_jit_bprop_graph]: 1.59998e-06 [rewriter_after_jit_bprop_graph]: 4.66002e-06 [opt_after_jit_grad]: 0.00045608 [symbol_engine_optimizer]: 7.045e-05, [1] [Cycle 1]: 6.452e-05, [6] [build]: 2.70997e-06 [elim_shapecalc]: 7.48e-06 [elim_not_effective]: 1.26e-05 [opt_reshape]: 5.64998e-06 [fold_const_symbol]: 9.02999e-06 [renormalize]: 4.69998e-07 [validate]: 3.398e-05 Sums bootstrap : 0.000260s : 2.32% type_inference : 0.007070s : 63.23% event_method : 0.000019s : 0.17% auto_monad : 0.000061s : 0.55% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000046s : 0.41% rewriter_before_opt_a : 0.000081s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000061s : 0.55% jit_opt_a.loop_unroll : 0.000039s : 0.35% jit_opt_a.a_1 : 0.000722s : 6.46% jit_opt_a.with_stream_mark : 0.000023s : 0.21% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.21% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000681s : 6.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.18% jit_opt_a.cse : 0.000043s : 0.39% jit_opt_a.replace_applicator : 0.000018s : 0.16% py_interpret_to_execute_after_opt_a : 0.000009s : 0.08% rewriter_after_opt_a : 0.000032s : 0.29% convert_after_rewriter : 0.000007s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.04% mutable_eliminate : 0.000510s : 4.56% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000018s : 0.16% cconv : 0.000027s : 0.24% loop_unroll : 0.000517s : 4.63% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000022s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.16% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000014s : 0.12% partial_unused_args_eliminate : 0.000003s : 0.02% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000043s : 0.38% cse_after_recomputation.cse : 0.000013s : 0.12% auto_monad_reorder : 0.000017s : 0.15% get_jit_bprop_graph : 0.000002s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000456s : 4.08% symbol_engine_optimizer.build : 0.000003s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.30% Time group info: ------[substitution.] 0.000238 27 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000002s : 2: substitution.fold_const_symbol 2.06% : 0.000005s : 3: substitution.graph_param_transform 83.68% : 0.000200s : 5: substitution.inline 1.17% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.42% : 0.000011s : 3: substitution.reduce_eliminate 1.59% : 0.000004s : 4: substitution.remove_not_recompute_node 1.37% : 0.000003s : 2: substitution.replace_old_param 4.28% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007017 2 87.51% : 0.006140s : 1: type_inference.infer 12.49% : 0.000877s : 1: type_inference.specialize ------[replace.] 0.000088 7 68.69% : 0.000060s : 5: replace.inline 31.31% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000206 7 95.59% : 0.000197s : 5: match.inline 4.41% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.35% : 0.000002s : 11: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 2.06% : 0.000003s : 11: predicate.arithmetic_simplify 1.45% : 0.000002s : 11: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 11: predicate.compare_switch_simplify 1.29% : 0.000002s : 11: predicate.depend_value_elim 1.21% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.49% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.20% : 0.000001s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000007s : 24: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 16: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.80% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 11: predicate.merge_addn 1.13% : 0.000001s : 11: predicate.minmaximum_grad 1.94% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 16: predicate.partial_eliminate 1.17% : 0.000001s : 11: predicate.print_const_string_wrapper 1.83% : 0.000002s : 11: predicate.reduce_eliminate 1.58% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.82% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 18: predicate.switch_defer_inline 2.49% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.65% : 0.000010s : 59: predicate.switch_simplify 1.23% : 0.000002s : 11: predicate.tile_eliminate 1.30% : 0.000002s : 11: predicate.transpose_eliminate 1.53% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 11: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000727 16 48.74% : 0.000354s : 7: func_graph_cloner_run.FuncGraphClonerGraph 9.14% : 0.000066s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.12% : 0.000306s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016737 72 0.27% : 0.000046s : 1: add_recomputation 0.38% : 0.000064s : 1: auto_monad 0.12% : 0.000020s : 1: auto_monad_reorder 1.62% : 0.000271s : 1: bootstrap 0.17% : 0.000029s : 1: cconv 0.05% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 32.05% : 0.005365s : 1: jit_opt_a 0.92% : 0.000155s : 1: jit_opt_after_cconv 0.33% : 0.000055s : 1: jit_opt_b 3.15% : 0.000527s : 1: loop_unroll 3.12% : 0.000523s : 1: mutable_eliminate 5.59% : 0.000936s : 26: opt.transform.jit_opt_a 0.28% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000028s : 4: opt.transform.jit_opt_b 0.08% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000016s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.77% : 0.000464s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000049s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000016s : 1: remove_dup_value 2.18% : 0.000365s : 1: renormalize.infer 1.84% : 0.000308s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000036s : 1: rewriter_after_opt_a 0.50% : 0.000084s : 1: rewriter_before_opt_a 0.44% : 0.000073s : 1: symbol_engine_optimizer 42.31% : 0.007081s : 1: type_inference TotalTime = 0.109635, [30] [bootstrap]: 0.00026758 [type_inference]: 0.100184 [event_method]: 1.962e-05 [auto_monad]: 5.497e-05 [graph_reusing]: 3.90998e-06 [pre_auto_parallel]: 2.06998e-06 [py_interpret_to_execute]: 0.00047364 [rewriter_before_opt_a]: 8.502e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00650342, [2] [Cycle 1]: 0.00304653, [27] [switch_simplify]: 4.665e-05 [loop_unroll]: 3.048e-05 [a_1]: 0.00050887 [with_stream_mark]: 1.164e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 6.16e-06 [accelerated_algorithm]: 6.23998e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.173e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00215302 [add_forward_monad_depend]: 4.32e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 1.147e-05 [cse]: 1.865e-05 [replace_applicator]: 1.307e-05 [Cycle 2]: 0.00035393, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 5.59e-06 [a_1]: 0.00012018 [with_stream_mark]: 9.57001e-06 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 2.63998e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 8.54998e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 8.43001e-06 [inline_without_move]: 5.71e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.136e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 9.16998e-06 [rewriter_after_opt_a]: 2.769e-05 [convert_after_rewriter]: 5.81e-06 [order_py_execute_after_rewriter]: 4.26001e-06 [mutable_eliminate]: 0.00048346 [jit_opt_b]: 5.335e-05, [1] [Cycle 1]: 4.637e-05, [2] [frontend_op_eliminate]: 1.857e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 1.633e-05 [loop_unroll]: 0.00042168 [jit_opt_after_cconv]: 0.00014435, [1] [Cycle 1]: 0.00013796, [11] [c_1]: 2.548e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.885e-05 [call_graph_tuple_transform]: 1.851e-05 [tuple_list_get_item_eliminator]: 6.21e-06 [none_parameter_eliminate]: 1.22999e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.039e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 6.84001e-06 [add_recomputation]: 3.673e-05 [cse_after_recomputation]: 2.055e-05, [1] [Cycle 1]: 1.546e-05, [1] [cse]: 1.007e-05 [auto_monad_reorder]: 1.043e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 5.25001e-06 [opt_after_jit_grad]: 0.00048929 [symbol_engine_optimizer]: 7.375e-05, [1] [Cycle 1]: 6.695e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 9.22001e-06 [renormalize]: 4.50003e-07 [validate]: 3.423e-05 Sums bootstrap : 0.000268s : 0.25% type_inference : 0.100184s : 94.55% event_method : 0.000020s : 0.02% auto_monad : 0.000055s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000474s : 0.45% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000629s : 0.59% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002153s : 2.03% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000483s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000016s : 0.02% loop_unroll : 0.000422s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000489s : 0.46% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.03% Time group info: ------[substitution.] 0.000156 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.94% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000005s : 4: substitution.graph_param_transform 82.73% : 0.000129s : 4: substitution.inline 1.60% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 5.74% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100105 2 97.39% : 0.097492s : 1: type_inference.infer 2.61% : 0.002614s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.18% : 0.000043s : 4: replace.inline 32.82% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000134 6 94.12% : 0.000126s : 4: match.inline 5.88% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.18% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.58% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.01% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001921 22 67.09% : 0.001289s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.43% : 0.000604s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112709 72 0.04% : 0.000039s : 1: add_recomputation 0.05% : 0.000058s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.25% : 0.000281s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.77% : 0.006506s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.38% : 0.000430s : 1: loop_unroll 0.44% : 0.000492s : 1: mutable_eliminate 0.75% : 0.000844s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000482s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.37% : 0.001548s : 1: renormalize.infer 0.53% : 0.000598s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 88.91% : 0.100204s : 1: type_inference TotalTime = 0.014774, [30] [bootstrap]: 0.00029706 [type_inference]: 0.00728274 [event_method]: 1.995e-05 [auto_monad]: 6.461e-05 [graph_reusing]: 6.16998e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 4.987e-05 [rewriter_before_opt_a]: 8.119e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.0050398, [2] [Cycle 1]: 0.00165717, [27] [switch_simplify]: 5.122e-05 [loop_unroll]: 3.337e-05 [a_1]: 0.00059895 [with_stream_mark]: 1.115e-05 [recompute_prepare]: 7.55998e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.81999e-06 [updatestate_loads_eliminate]: 2.38998e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 5.16998e-06 [accelerated_algorithm]: 5.57001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 3.40998e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.194e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.70001e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 0.0006622 [add_forward_monad_depend]: 4.49002e-06 [auto_monad_grad]: 1.23002e-06 [auto_monad_eliminator]: 1.057e-05 [cse]: 2.345e-05 [replace_applicator]: 1.16e-05 [Cycle 2]: 0.00033658, [27] [switch_simplify]: 5.74e-06 [loop_unroll]: 4.85999e-06 [a_1]: 0.00010691 [with_stream_mark]: 8.69e-06 [recompute_prepare]: 5.40001e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.14e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.05e-05 [j_node_and_user_rematch]: 7.85998e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 6.98998e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.20028e-07 [auto_monad_eliminator]: 5.99e-06 [cse]: 1.382e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 8.33001e-06 [rewriter_after_opt_a]: 3.049e-05 [convert_after_rewriter]: 6.06e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.0004652 [jit_opt_b]: 4.738e-05, [1] [Cycle 1]: 4.143e-05, [2] [frontend_op_eliminate]: 1.477e-05 [inline_after_opt_a]: 1.553e-05 [cconv]: 1.895e-05 [loop_unroll]: 0.00040697 [jit_opt_after_cconv]: 0.00014048, [1] [Cycle 1]: 0.00013408, [11] [c_1]: 1.986e-05 [parameter_eliminate]: 1.97001e-06 [updatestate_depend_eliminate]: 5.07e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.78998e-06 [cse]: 1.958e-05 [call_graph_tuple_transform]: 1.47e-05 [tuple_list_get_item_eliminator]: 5.52001e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.24e-06 [remove_dup_value]: 1.03e-05 [partial_unused_args_eliminate]: 1.59e-06 [environ_conv]: 4.54998e-06 [add_recomputation]: 3.637e-05 [cse_after_recomputation]: 2.269e-05, [1] [Cycle 1]: 1.757e-05, [1] [cse]: 1.199e-05 [auto_monad_reorder]: 1.327e-05 [get_jit_bprop_graph]: 1.49e-06 [rewriter_after_jit_bprop_graph]: 3.81001e-06 [opt_after_jit_grad]: 0.00045289 [symbol_engine_optimizer]: 6.817e-05, [1] [Cycle 1]: 6.242e-05, [6] [build]: 2.33002e-06 [elim_shapecalc]: 7.85998e-06 [elim_not_effective]: 1.144e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 7.9e-06 [renormalize]: 4.39992e-07 [validate]: 2.847e-05 Sums bootstrap : 0.000297s : 2.66% type_inference : 0.007283s : 65.18% event_method : 0.000020s : 0.18% auto_monad : 0.000065s : 0.58% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000050s : 0.45% rewriter_before_opt_a : 0.000081s : 0.73% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.51% jit_opt_a.loop_unroll : 0.000038s : 0.34% jit_opt_a.a_1 : 0.000706s : 6.32% jit_opt_a.with_stream_mark : 0.000020s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.15% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000016s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000662s : 5.93% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.15% jit_opt_a.cse : 0.000037s : 0.33% jit_opt_a.replace_applicator : 0.000017s : 0.15% py_interpret_to_execute_after_opt_a : 0.000008s : 0.07% rewriter_after_opt_a : 0.000030s : 0.27% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000465s : 4.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.13% jit_opt_b.inline_after_opt_a : 0.000016s : 0.14% cconv : 0.000019s : 0.17% loop_unroll : 0.000407s : 3.64% jit_opt_after_cconv.c_1 : 0.000020s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.18% jit_opt_after_cconv.call_graph_tuple_transform : 0.000015s : 0.13% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000010s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.01% environ_conv : 0.000005s : 0.04% add_recomputation : 0.000036s : 0.33% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000013s : 0.12% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000453s : 4.05% symbol_engine_optimizer.build : 0.000002s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.25% Time group info: ------[substitution.] 0.000215 27 0.70% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 1.62% : 0.000003s : 3: substitution.graph_param_transform 83.39% : 0.000179s : 5: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.31% : 0.000009s : 3: substitution.reduce_eliminate 1.94% : 0.000004s : 4: substitution.remove_not_recompute_node 1.82% : 0.000004s : 2: substitution.replace_old_param 4.24% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007222 2 87.16% : 0.006295s : 1: type_inference.infer 12.84% : 0.000927s : 1: type_inference.specialize ------[replace.] 0.000088 7 68.39% : 0.000060s : 5: replace.inline 31.61% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 7 95.65% : 0.000176s : 5: match.inline 4.35% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000121 747 1.33% : 0.000002s : 11: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 11: predicate.addn_check_dump 1.40% : 0.000002s : 11: predicate.addn_zero_filter 1.76% : 0.000002s : 11: predicate.arithmetic_simplify 1.39% : 0.000002s : 11: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 11: predicate.compare_switch_simplify 1.29% : 0.000002s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.30% : 0.000002s : 11: predicate.environ_get_eliminate 1.28% : 0.000002s : 11: predicate.environ_get_set_eliminate 0.21% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 4.98% : 0.000006s : 24: predicate.inline 0.84% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 6: predicate.less_batch_normalization 1.60% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.01% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 11: predicate.merge_addn 1.20% : 0.000001s : 11: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 16: predicate.partial_eliminate 1.45% : 0.000002s : 11: predicate.print_const_string_wrapper 2.35% : 0.000003s : 11: predicate.reduce_eliminate 1.46% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.50% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 19: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000002s : 11: predicate.reshape_eliminate 1.42% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.59% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000002s : 11: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 18: predicate.switch_defer_inline 2.26% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.77% : 0.000009s : 59: predicate.switch_simplify 1.46% : 0.000002s : 11: predicate.tile_eliminate 1.29% : 0.000002s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000717 16 49.55% : 0.000355s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.70% : 0.000055s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.75% : 0.000306s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016410 72 0.24% : 0.000039s : 1: add_recomputation 0.41% : 0.000068s : 1: auto_monad 0.10% : 0.000016s : 1: auto_monad_reorder 1.90% : 0.000311s : 1: bootstrap 0.13% : 0.000022s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000007s : 1: environ_conv 0.15% : 0.000024s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 30.73% : 0.005042s : 1: jit_opt_a 0.87% : 0.000143s : 1: jit_opt_after_cconv 0.30% : 0.000050s : 1: jit_opt_b 2.52% : 0.000414s : 1: loop_unroll 2.88% : 0.000473s : 1: mutable_eliminate 5.57% : 0.000915s : 26: opt.transform.jit_opt_a 0.26% : 0.000042s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000024s : 4: opt.transform.jit_opt_b 0.07% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.12% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.18% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.81% : 0.000460s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000053s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000013s : 1: remove_dup_value 2.19% : 0.000359s : 1: renormalize.infer 1.80% : 0.000295s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000033s : 1: rewriter_after_opt_a 0.51% : 0.000084s : 1: rewriter_before_opt_a 0.43% : 0.000071s : 1: symbol_engine_optimizer 44.46% : 0.007296s : 1: type_inference TotalTime = 0.0142262, [30] [bootstrap]: 0.00023724 [type_inference]: 0.00705172 [event_method]: 1.843e-05 [auto_monad]: 4.574e-05 [graph_reusing]: 4.02002e-06 [pre_auto_parallel]: 1.72999e-06 [py_interpret_to_execute]: 4.471e-05 [rewriter_before_opt_a]: 7.487e-05 [expand_dump_flag]: 1.84e-06 [jit_opt_a]: 0.00481414, [2] [Cycle 1]: 0.00157314, [27] [switch_simplify]: 5.059e-05 [loop_unroll]: 3.299e-05 [a_1]: 0.00063726 [with_stream_mark]: 1.131e-05 [recompute_prepare]: 7.97998e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 6.00002e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 2.82002e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.097e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.90998e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00054692 [add_forward_monad_depend]: 4.65999e-06 [auto_monad_grad]: 1.17999e-06 [auto_monad_eliminator]: 1.091e-05 [cse]: 2.107e-05 [replace_applicator]: 1.192e-05 [Cycle 2]: 0.00032753, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.57999e-06 [a_1]: 9.813e-05 [with_stream_mark]: 8.38999e-06 [recompute_prepare]: 5.37001e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 6.39993e-07 [specialize_transform]: 5.18002e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.71e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 9.82999e-06 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.66002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.42999e-06 [cse]: 1.23e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 8.48001e-06 [rewriter_after_opt_a]: 2.882e-05 [convert_after_rewriter]: 5.87001e-06 [order_py_execute_after_rewriter]: 4.33999e-06 [mutable_eliminate]: 0.00047528 [jit_opt_b]: 5.149e-05, [1] [Cycle 1]: 4.531e-05, [2] [frontend_op_eliminate]: 1.677e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 1.487e-05 [loop_unroll]: 0.00042577 [jit_opt_after_cconv]: 0.00013634, [1] [Cycle 1]: 0.00012966, [11] [c_1]: 2.054e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.054e-05 [call_graph_tuple_transform]: 1.617e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 5.24998e-06 [remove_dup_value]: 8.15e-06 [partial_unused_args_eliminate]: 1.39e-06 [environ_conv]: 3.95e-06 [add_recomputation]: 2.952e-05 [cse_after_recomputation]: 2.341e-05, [1] [Cycle 1]: 1.845e-05, [1] [cse]: 1.24e-05 [auto_monad_reorder]: 1.109e-05 [get_jit_bprop_graph]: 1.45001e-06 [rewriter_after_jit_bprop_graph]: 3.91999e-06 [opt_after_jit_grad]: 0.00044888 [symbol_engine_optimizer]: 6.859e-05, [1] [Cycle 1]: 6.291e-05, [6] [build]: 2.39999e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.197e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 7.82998e-06 [renormalize]: 4.19997e-07 [validate]: 2.577e-05 Sums bootstrap : 0.000237s : 2.20% type_inference : 0.007052s : 65.51% event_method : 0.000018s : 0.17% auto_monad : 0.000046s : 0.42% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.42% rewriter_before_opt_a : 0.000075s : 0.70% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000057s : 0.53% jit_opt_a.loop_unroll : 0.000039s : 0.36% jit_opt_a.a_1 : 0.000735s : 6.83% jit_opt_a.with_stream_mark : 0.000020s : 0.18% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000011s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.10% jit_opt_a.accelerated_algorithm : 0.000012s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.10% jit_opt_a.merge_forward : 0.000006s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000021s : 0.19% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000003s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000547s : 5.08% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.15% jit_opt_a.cse : 0.000033s : 0.31% jit_opt_a.replace_applicator : 0.000017s : 0.16% py_interpret_to_execute_after_opt_a : 0.000008s : 0.08% rewriter_after_opt_a : 0.000029s : 0.27% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000475s : 4.42% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.16% jit_opt_b.inline_after_opt_a : 0.000017s : 0.16% cconv : 0.000015s : 0.14% loop_unroll : 0.000426s : 3.96% jit_opt_after_cconv.c_1 : 0.000021s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.04% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000008s : 0.08% partial_unused_args_eliminate : 0.000001s : 0.01% environ_conv : 0.000004s : 0.04% add_recomputation : 0.000030s : 0.27% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000011s : 0.10% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.04% opt_after_jit_grad : 0.000449s : 4.17% symbol_engine_optimizer.build : 0.000002s : 0.02% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000026s : 0.24% Time group info: ------[substitution.] 0.000254 27 0.59% : 0.000002s : 2: substitution.elim_not_effective 0.37% : 0.000001s : 2: substitution.fold_const_symbol 1.34% : 0.000003s : 3: substitution.graph_param_transform 88.12% : 0.000224s : 5: substitution.inline 1.01% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.31% : 0.000008s : 3: substitution.reduce_eliminate 1.47% : 0.000004s : 4: substitution.remove_not_recompute_node 1.09% : 0.000003s : 2: substitution.replace_old_param 2.70% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007002 2 86.63% : 0.006066s : 1: type_inference.infer 13.37% : 0.000936s : 1: type_inference.specialize ------[replace.] 0.000081 7 65.85% : 0.000053s : 5: replace.inline 34.15% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000227 7 97.42% : 0.000221s : 5: match.inline 2.58% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 747 1.22% : 0.000001s : 11: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 11: predicate.addn_check_dump 1.34% : 0.000002s : 11: predicate.addn_zero_filter 1.84% : 0.000002s : 11: predicate.arithmetic_simplify 1.55% : 0.000002s : 11: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.30% : 0.000002s : 11: predicate.depend_value_elim 1.23% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.62% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.21% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.23% : 0.000002s : 11: predicate.environ_get_depend_swap 1.64% : 0.000002s : 11: predicate.environ_get_eliminate 1.23% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.18% : 0.000006s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 16: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000006s : 38: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 11: predicate.merge_addn 1.19% : 0.000001s : 11: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 16: predicate.partial_eliminate 1.19% : 0.000001s : 11: predicate.print_const_string_wrapper 2.04% : 0.000003s : 11: predicate.reduce_eliminate 1.50% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 19: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 11: predicate.reshape_eliminate 1.23% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000002s : 11: predicate.same_eliminate 0.69% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 6: predicate.special_op_eliminate 0.92% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.71% : 0.000009s : 59: predicate.switch_simplify 1.30% : 0.000002s : 11: predicate.tile_eliminate 1.41% : 0.000002s : 11: predicate.transpose_eliminate 1.43% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.38% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 11: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000694 16 47.94% : 0.000333s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.00% : 0.000049s : 2: func_graph_cloner_run.FuncGraphClonerNode 45.06% : 0.000313s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015792 72 0.27% : 0.000042s : 1: add_recomputation 0.31% : 0.000049s : 1: auto_monad 0.09% : 0.000014s : 1: auto_monad_reorder 1.57% : 0.000248s : 1: bootstrap 0.11% : 0.000018s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000026s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 30.50% : 0.004817s : 1: jit_opt_a 0.88% : 0.000139s : 1: jit_opt_after_cconv 0.34% : 0.000054s : 1: jit_opt_b 2.74% : 0.000433s : 1: loop_unroll 3.05% : 0.000482s : 1: mutable_eliminate 5.97% : 0.000943s : 26: opt.transform.jit_opt_a 0.28% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000030s : 4: opt.transform.symbol_engine_opt 2.89% : 0.000456s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000048s : 1: py_interpret_to_execute 0.07% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000010s : 1: remove_dup_value 1.81% : 0.000286s : 1: renormalize.infer 1.62% : 0.000255s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.20% : 0.000032s : 1: rewriter_after_opt_a 0.49% : 0.000078s : 1: rewriter_before_opt_a 0.45% : 0.000071s : 1: symbol_engine_optimizer 44.73% : 0.007063s : 1: type_inference TotalTime = 0.0140585, [30] [bootstrap]: 0.00025791 [type_inference]: 0.00697798 [event_method]: 1.864e-05 [auto_monad]: 4.698e-05 [graph_reusing]: 4.07e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 4.73e-05 [rewriter_before_opt_a]: 7.351e-05 [expand_dump_flag]: 1.79e-06 [jit_opt_a]: 0.00462088, [2] [Cycle 1]: 0.00145676, [27] [switch_simplify]: 4.553e-05 [loop_unroll]: 3.307e-05 [a_1]: 0.00054549 [with_stream_mark]: 8.54998e-06 [recompute_prepare]: 7.01001e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.01998e-06 [meta_shard_fg_expand]: 1.57999e-06 [get_grad_eliminate_]: 5.75001e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.099e-05 [j_node_and_user_rematch]: 8.79e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 0.00053391 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 1.173e-05 [cse]: 2.205e-05 [replace_applicator]: 9.77999e-06 [Cycle 2]: 0.00033393, [27] [switch_simplify]: 5.61003e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00010134 [with_stream_mark]: 8.38999e-06 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 5.27999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 2.54001e-06 [cell_reuse_recompute_pass]: 1.48002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.063e-05 [j_node_and_user_rematch]: 7.63999e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 6.94999e-06 [inline_without_move]: 4.79002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.99976e-07 [auto_monad_eliminator]: 5.42999e-06 [cse]: 1.256e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 9.38002e-06 [rewriter_after_opt_a]: 3.027e-05 [convert_after_rewriter]: 5.89e-06 [order_py_execute_after_rewriter]: 4.19997e-06 [mutable_eliminate]: 0.00048774 [jit_opt_b]: 4.981e-05, [1] [Cycle 1]: 4.382e-05, [2] [frontend_op_eliminate]: 1.642e-05 [inline_after_opt_a]: 1.632e-05 [cconv]: 1.796e-05 [loop_unroll]: 0.00043092 [jit_opt_after_cconv]: 0.00014073, [1] [Cycle 1]: 0.00013459, [11] [c_1]: 2.04e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 6.26e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 2.284e-05 [call_graph_tuple_transform]: 1.585e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 7.90023e-07 [renormalize]: 4.2998e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 8.95999e-06 [partial_unused_args_eliminate]: 9.07001e-06 [environ_conv]: 3.71999e-06 [add_recomputation]: 2.73e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.118e-05 [auto_monad_reorder]: 1.036e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 3.7e-06 [opt_after_jit_grad]: 0.00048702 [symbol_engine_optimizer]: 7.478e-05, [1] [Cycle 1]: 6.851e-05, [6] [build]: 3.32997e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.453e-05 [opt_reshape]: 5.95002e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 3.7998e-07 [validate]: 3.01e-05 Sums bootstrap : 0.000258s : 2.41% type_inference : 0.006978s : 65.32% event_method : 0.000019s : 0.17% auto_monad : 0.000047s : 0.44% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000047s : 0.44% rewriter_before_opt_a : 0.000074s : 0.69% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000051s : 0.48% jit_opt_a.loop_unroll : 0.000039s : 0.36% jit_opt_a.a_1 : 0.000647s : 6.05% jit_opt_a.with_stream_mark : 0.000017s : 0.16% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.15% jit_opt_a.meta_fg_expand : 0.000003s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.14% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000534s : 5.00% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.16% jit_opt_a.cse : 0.000035s : 0.32% jit_opt_a.replace_applicator : 0.000015s : 0.14% py_interpret_to_execute_after_opt_a : 0.000009s : 0.09% rewriter_after_opt_a : 0.000030s : 0.28% convert_after_rewriter : 0.000006s : 0.06% order_py_execute_after_rewriter : 0.000004s : 0.04% mutable_eliminate : 0.000488s : 4.57% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.15% jit_opt_b.inline_after_opt_a : 0.000016s : 0.15% cconv : 0.000018s : 0.17% loop_unroll : 0.000431s : 4.03% jit_opt_after_cconv.c_1 : 0.000020s : 0.19% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.15% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000009s : 0.08% partial_unused_args_eliminate : 0.000009s : 0.08% environ_conv : 0.000004s : 0.03% add_recomputation : 0.000027s : 0.26% cse_after_recomputation.cse : 0.000011s : 0.10% auto_monad_reorder : 0.000010s : 0.10% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000004s : 0.03% opt_after_jit_grad : 0.000487s : 4.56% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.28% Time group info: ------[substitution.] 0.000165 27 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 1.86% : 0.000003s : 3: substitution.graph_param_transform 81.70% : 0.000135s : 5: substitution.inline 1.48% : 0.000002s : 4: substitution.j_node_and_user_rematch 4.83% : 0.000008s : 3: substitution.reduce_eliminate 2.36% : 0.000004s : 4: substitution.remove_not_recompute_node 1.70% : 0.000003s : 2: substitution.replace_old_param 4.35% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.006927 2 87.60% : 0.006068s : 1: type_inference.infer 12.40% : 0.000859s : 1: type_inference.specialize ------[replace.] 0.000079 7 65.90% : 0.000052s : 5: replace.inline 34.10% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 7 95.63% : 0.000132s : 5: match.inline 4.37% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 747 1.46% : 0.000002s : 11: predicate.accumulaten_eliminater 1.53% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 11: predicate.addn_check_dump 1.25% : 0.000002s : 11: predicate.addn_zero_filter 2.02% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 11: predicate.compare_switch_simplify 1.25% : 0.000002s : 11: predicate.depend_value_elim 1.22% : 0.000002s : 11: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.37% : 0.000002s : 11: predicate.dict_set_item_eliminator 1.36% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 11: predicate.environ_get_depend_swap 1.28% : 0.000002s : 11: predicate.environ_get_eliminate 1.14% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.23% : 0.000000s : 3: predicate.graph_param_transform 4.88% : 0.000006s : 24: predicate.inline 0.87% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 16: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 38: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 14: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 11: predicate.merge_addn 1.15% : 0.000001s : 11: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000003s : 16: predicate.partial_eliminate 1.32% : 0.000002s : 11: predicate.print_const_string_wrapper 2.22% : 0.000003s : 11: predicate.reduce_eliminate 1.59% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.67% : 0.000002s : 19: predicate.replace_applicator 0.50% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 11: predicate.reshape_eliminate 1.32% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.35% : 0.000002s : 11: predicate.same_eliminate 0.51% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 59: predicate.switch_simplify 1.47% : 0.000002s : 11: predicate.tile_eliminate 1.61% : 0.000002s : 11: predicate.transpose_eliminate 1.59% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 11: predicate.tuple_list_get_item_depend_reorder 3.05% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 22: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 11: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000670 16 51.15% : 0.000343s : 7: func_graph_cloner_run.FuncGraphClonerGraph 6.50% : 0.000044s : 2: func_graph_cloner_run.FuncGraphClonerNode 42.34% : 0.000284s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.015518 72 0.19% : 0.000030s : 1: add_recomputation 0.33% : 0.000051s : 1: auto_monad 0.08% : 0.000013s : 1: auto_monad_reorder 1.73% : 0.000269s : 1: bootstrap 0.13% : 0.000021s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000024s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000003s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 29.79% : 0.004623s : 1: jit_opt_a 0.92% : 0.000143s : 1: jit_opt_after_cconv 0.34% : 0.000052s : 1: jit_opt_b 2.84% : 0.000440s : 1: loop_unroll 3.20% : 0.000496s : 1: mutable_eliminate 5.48% : 0.000850s : 26: opt.transform.jit_opt_a 0.28% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.21% : 0.000498s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.07% : 0.000011s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000051s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000011s : 1: remove_dup_value 1.78% : 0.000277s : 1: renormalize.infer 1.62% : 0.000252s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000033s : 1: rewriter_after_opt_a 0.49% : 0.000076s : 1: rewriter_before_opt_a 0.50% : 0.000077s : 1: symbol_engine_optimizer 45.03% : 0.006988s : 1: type_inference TotalTime = 0.110726, [30] [bootstrap]: 0.00024488 [type_inference]: 0.100652 [event_method]: 1.792e-05 [auto_monad]: 5.593e-05 [graph_reusing]: 4.05998e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 0.00044907 [rewriter_before_opt_a]: 8.161e-05 [expand_dump_flag]: 3.01001e-06 [jit_opt_a]: 0.00702773, [2] [Cycle 1]: 0.00344812, [27] [switch_simplify]: 4.988e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00055138 [with_stream_mark]: 1.682e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 3.45e-06 [updatestate_assign_eliminate]: 3.42997e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.63998e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 9.46003e-06 [meta_fg_expand]: 2.75002e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 0.00246669 [add_forward_monad_depend]: 5.86e-06 [auto_monad_grad]: 2.14e-06 [auto_monad_eliminator]: 1.476e-05 [cse]: 2.806e-05 [replace_applicator]: 1.43e-05 [Cycle 2]: 0.0003488, [27] [switch_simplify]: 6.73998e-06 [loop_unroll]: 5.82001e-06 [a_1]: 0.00011485 [with_stream_mark]: 9.37999e-06 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 2.61999e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 5.59998e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.10999e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.087e-05 [replace_applicator]: 5.97001e-06 [py_interpret_to_execute_after_opt_a]: 9.53997e-06 [rewriter_after_opt_a]: 3.3e-05 [convert_after_rewriter]: 6.67002e-06 [order_py_execute_after_rewriter]: 5.86e-06 [mutable_eliminate]: 0.00054271 [jit_opt_b]: 5.422e-05, [1] [Cycle 1]: 4.747e-05, [2] [frontend_op_eliminate]: 1.825e-05 [inline_after_opt_a]: 1.829e-05 [cconv]: 2.275e-05 [loop_unroll]: 0.00041197 [jit_opt_after_cconv]: 0.00014853, [1] [Cycle 1]: 0.00014194, [11] [c_1]: 2.487e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.58997e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.933e-05 [call_graph_tuple_transform]: 2.121e-05 [tuple_list_get_item_eliminator]: 6.56999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.638e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 3.36e-05 [add_recomputation]: 4.441e-05 [cse_after_recomputation]: 2.242e-05, [1] [Cycle 1]: 1.677e-05, [1] [cse]: 1.118e-05 [auto_monad_reorder]: 1.412e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.3e-06 [opt_after_jit_grad]: 0.00045337 [symbol_engine_optimizer]: 7.698e-05, [1] [Cycle 1]: 7.121e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 9.61e-06 [elim_not_effective]: 1.516e-05 [opt_reshape]: 5.79999e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 3.50003e-07 [validate]: 9.296e-05 Sums bootstrap : 0.000245s : 0.23% type_inference : 0.100652s : 94.15% event_method : 0.000018s : 0.02% auto_monad : 0.000056s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000449s : 0.42% rewriter_before_opt_a : 0.000082s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000666s : 0.62% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002467s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000543s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000412s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000034s : 0.03% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000453s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000093s : 0.09% Time group info: ------[substitution.] 0.000198 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 1.00% : 0.000002s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 4: substitution.graph_param_transform 83.21% : 0.000164s : 4: substitution.inline 1.40% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 5.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100591 2 97.58% : 0.098155s : 1: type_inference.infer 2.42% : 0.002436s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.89% : 0.000045s : 4: replace.inline 32.11% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.83% : 0.000162s : 4: match.inline 6.17% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000001s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.39% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 2.02% : 0.000003s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 1.01% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.23% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000001s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001950 22 66.03% : 0.001287s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.03% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.94% : 0.000623s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114079 72 0.04% : 0.000047s : 1: add_recomputation 0.05% : 0.000059s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.22% : 0.000257s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.03% : 0.000036s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.16% : 0.007031s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.37% : 0.000420s : 1: loop_unroll 0.48% : 0.000551s : 1: mutable_eliminate 0.78% : 0.000889s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.57% : 0.001793s : 1: renormalize.infer 0.58% : 0.000665s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.24% : 0.100664s : 1: type_inference TotalTime = 0.0632633, [30] [bootstrap]: 0.00029833 [type_inference]: 0.0539712 [event_method]: 1.775e-05 [auto_monad]: 5.731e-05 [graph_reusing]: 4.53999e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 0.00023902 [rewriter_before_opt_a]: 7.899e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00649896, [2] [Cycle 1]: 0.00283025, [27] [switch_simplify]: 4.734e-05 [loop_unroll]: 2.991e-05 [a_1]: 0.0005414 [with_stream_mark]: 1.47e-05 [recompute_prepare]: 8.33999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.64999e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 2.80997e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.29e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00188276 [add_forward_monad_depend]: 4.92999e-06 [auto_monad_grad]: 1.79e-06 [auto_monad_eliminator]: 1.469e-05 [cse]: 2.106e-05 [replace_applicator]: 1.323e-05 [Cycle 2]: 0.00035247, [27] [switch_simplify]: 6.24001e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.000118 [with_stream_mark]: 9.86e-06 [recompute_prepare]: 5.79999e-06 [updatestate_depend_eliminate]: 2.87002e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.461e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 8.14997e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.162e-05 [replace_applicator]: 5.88002e-06 [py_interpret_to_execute_after_opt_a]: 9.46e-06 [rewriter_after_opt_a]: 3.017e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.74998e-06 [mutable_eliminate]: 0.00051223 [jit_opt_b]: 5.511e-05, [1] [Cycle 1]: 4.84e-05, [2] [frontend_op_eliminate]: 1.9e-05 [inline_after_opt_a]: 1.843e-05 [cconv]: 2.308e-05 [loop_unroll]: 0.00042141 [jit_opt_after_cconv]: 0.00014333, [1] [Cycle 1]: 0.00013725, [11] [c_1]: 2.47e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 1.91e-05 [call_graph_tuple_transform]: 1.883e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 6.27001e-06 [remove_dup_value]: 1.325e-05 [partial_unused_args_eliminate]: 1.90001e-06 [environ_conv]: 6.98998e-06 [add_recomputation]: 3.702e-05 [cse_after_recomputation]: 2.038e-05, [1] [Cycle 1]: 1.555e-05, [1] [cse]: 1.01e-05 [auto_monad_reorder]: 1.19e-05 [get_jit_bprop_graph]: 1.76998e-06 [rewriter_after_jit_bprop_graph]: 4.18001e-06 [opt_after_jit_grad]: 0.00047956 [symbol_engine_optimizer]: 0.00010244, [1] [Cycle 1]: 9.558e-05, [6] [build]: 4.62998e-06 [elim_shapecalc]: 8.83001e-06 [elim_not_effective]: 3.608e-05 [opt_reshape]: 6.79999e-06 [fold_const_symbol]: 9.67999e-06 [renormalize]: 3.60014e-07 [validate]: 3.827e-05 Sums bootstrap : 0.000298s : 0.50% type_inference : 0.053971s : 90.88% event_method : 0.000018s : 0.03% auto_monad : 0.000057s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000239s : 0.40% rewriter_before_opt_a : 0.000079s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000659s : 1.11% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001883s : 3.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000030s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000512s : 0.86% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000421s : 0.71% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000037s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000480s : 0.81% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000036s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.06% Time group info: ------[substitution.] 0.000181 24 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000005s : 4: substitution.graph_param_transform 82.98% : 0.000150s : 4: substitution.inline 1.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000005s : 4: substitution.remove_not_recompute_node 2.11% : 0.000004s : 2: substitution.replace_old_param 6.20% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053896 2 96.57% : 0.052050s : 1: type_inference.infer 3.43% : 0.001846s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.44% : 0.000045s : 4: replace.inline 34.56% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.63% : 0.000148s : 4: match.inline 6.37% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.41% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.17% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.18% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.43% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 4.98% : 0.000006s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.95% : 0.000003s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.65% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.76% : 0.000009s : 58: predicate.switch_simplify 1.50% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.89% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002242 26 71.67% : 0.001607s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.60% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.73% : 0.000599s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066106 72 0.06% : 0.000040s : 1: add_recomputation 0.09% : 0.000060s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.47% : 0.000312s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.84% : 0.006502s : 1: jit_opt_a 0.22% : 0.000146s : 1: jit_opt_after_cconv 0.09% : 0.000058s : 1: jit_opt_b 0.65% : 0.000429s : 1: loop_unroll 0.79% : 0.000521s : 1: mutable_eliminate 1.33% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000245s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 1.89% : 0.001250s : 1: renormalize.infer 0.94% : 0.000624s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.13% : 0.000084s : 1: rewriter_before_opt_a 0.16% : 0.000105s : 1: symbol_engine_optimizer 81.66% : 0.053985s : 1: type_inference TotalTime = 0.0591193, [30] [bootstrap]: 0.00028133 [type_inference]: 0.0503438 [event_method]: 1.794e-05 [auto_monad]: 4.881e-05 [graph_reusing]: 3.98999e-06 [pre_auto_parallel]: 1.61998e-06 [py_interpret_to_execute]: 0.00023985 [rewriter_before_opt_a]: 7.644e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.00603891, [2] [Cycle 1]: 0.00266447, [27] [switch_simplify]: 4.724e-05 [loop_unroll]: 3.014e-05 [a_1]: 0.00052501 [with_stream_mark]: 1.381e-05 [recompute_prepare]: 8.62e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.40997e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 6.33e-06 [merge_forward]: 2.87002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.237e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 1.88002e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.0017303 [add_forward_monad_depend]: 4.37e-06 [auto_monad_grad]: 1.42999e-06 [auto_monad_eliminator]: 1.323e-05 [cse]: 2.16e-05 [replace_applicator]: 1.459e-05 [Cycle 2]: 0.00036402, [27] [switch_simplify]: 6.81999e-06 [loop_unroll]: 5.76998e-06 [a_1]: 0.0001183 [with_stream_mark]: 9.16998e-06 [recompute_prepare]: 6.46e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.31998e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 5.76998e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 2.61999e-06 [cell_reuse_recompute_pass]: 2.02999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.38e-05 [j_node_and_user_rematch]: 9.10999e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 8.42998e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 7.55e-06 [cse]: 1.297e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.009e-05 [rewriter_after_opt_a]: 2.847e-05 [convert_after_rewriter]: 6.07001e-06 [order_py_execute_after_rewriter]: 4.25999e-06 [mutable_eliminate]: 0.00050581 [jit_opt_b]: 5.22e-05, [1] [Cycle 1]: 4.563e-05, [2] [frontend_op_eliminate]: 1.769e-05 [inline_after_opt_a]: 1.679e-05 [cconv]: 1.776e-05 [loop_unroll]: 0.00042736 [jit_opt_after_cconv]: 0.0001534, [1] [Cycle 1]: 0.00014653, [11] [c_1]: 2.596e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 5.82001e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 3.06999e-06 [cse]: 2.254e-05 [call_graph_tuple_transform]: 2.012e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.79999e-06 [remove_dup_value]: 9.42001e-06 [partial_unused_args_eliminate]: 1.32999e-06 [environ_conv]: 6.17001e-06 [add_recomputation]: 3.343e-05 [cse_after_recomputation]: 2.192e-05, [1] [Cycle 1]: 1.71e-05, [1] [cse]: 1.128e-05 [auto_monad_reorder]: 9.59e-06 [get_jit_bprop_graph]: 1.78997e-06 [rewriter_after_jit_bprop_graph]: 4.17998e-06 [opt_after_jit_grad]: 0.00048009 [symbol_engine_optimizer]: 8.511e-05, [1] [Cycle 1]: 7.869e-05, [6] [build]: 3.05998e-06 [elim_shapecalc]: 8.2e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 2e-05 [renormalize]: 2.40019e-07 [validate]: 3.523e-05 Sums bootstrap : 0.000281s : 0.51% type_inference : 0.050344s : 90.66% event_method : 0.000018s : 0.03% auto_monad : 0.000049s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000240s : 0.43% rewriter_before_opt_a : 0.000076s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000643s : 1.16% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001730s : 3.12% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000035s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000028s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000506s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000018s : 0.03% loop_unroll : 0.000427s : 0.77% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.02% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000033s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000480s : 0.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000020s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000173 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.28% : 0.000004s : 4: substitution.graph_param_transform 83.96% : 0.000146s : 4: substitution.inline 1.84% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000003s : 2: substitution.replace_old_param 5.76% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050278 2 96.59% : 0.048564s : 1: type_inference.infer 3.41% : 0.001713s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.95% : 0.000045s : 4: replace.inline 32.05% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 94.14% : 0.000143s : 4: match.inline 5.86% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.87% : 0.000002s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 8: predicate.less_batch_normalization 1.73% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000001s : 12: predicate.print_const_string_wrapper 2.12% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.23% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000001s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.07% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002059 26 72.37% : 0.001490s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.16% : 0.000539s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061803 72 0.06% : 0.000037s : 1: add_recomputation 0.08% : 0.000052s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.48% : 0.000295s : 1: bootstrap 0.03% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.78% : 0.006042s : 1: jit_opt_a 0.25% : 0.000157s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.71% : 0.000436s : 1: loop_unroll 0.83% : 0.000515s : 1: mutable_eliminate 1.40% : 0.000865s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000045s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.40% : 0.000246s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 1.87% : 0.001155s : 1: renormalize.infer 0.92% : 0.000566s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.13% : 0.000082s : 1: rewriter_before_opt_a 0.14% : 0.000087s : 1: symbol_engine_optimizer 81.48% : 0.050357s : 1: type_inference TotalTime = 0.117013, [30] [bootstrap]: 0.00027726 [type_inference]: 0.106481 [event_method]: 1.931e-05 [auto_monad]: 6.57e-05 [graph_reusing]: 4.91002e-06 [pre_auto_parallel]: 2.19001e-06 [py_interpret_to_execute]: 0.00042189 [rewriter_before_opt_a]: 8.835e-05 [expand_dump_flag]: 2.91e-06 [jit_opt_a]: 0.00729841, [2] [Cycle 1]: 0.00363798, [27] [switch_simplify]: 5.603e-05 [loop_unroll]: 3.335e-05 [a_1]: 0.00070589 [with_stream_mark]: 1.796e-05 [recompute_prepare]: 9.43002e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 3.27997e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 7.2e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 6.74001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 6.36e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00247946 [add_forward_monad_depend]: 5.57001e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.611e-05 [cse]: 3.047e-05 [replace_applicator]: 1.472e-05 [Cycle 2]: 0.00037504, [27] [switch_simplify]: 6.81001e-06 [loop_unroll]: 5.91998e-06 [a_1]: 0.00013085 [with_stream_mark]: 1.039e-05 [recompute_prepare]: 6.45002e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.63998e-06 [updatestate_loads_eliminate]: 2.39001e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.18e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 1.63997e-06 [replace_old_param]: 8.10999e-06 [inline_without_move]: 5.49e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37999e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.39e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 1.296e-05 [rewriter_after_opt_a]: 3.698e-05 [convert_after_rewriter]: 6.36e-06 [order_py_execute_after_rewriter]: 5.46998e-06 [mutable_eliminate]: 0.0006052 [jit_opt_b]: 5.924e-05, [1] [Cycle 1]: 5.07e-05, [2] [frontend_op_eliminate]: 2.038e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 2.543e-05 [loop_unroll]: 0.00042978 [jit_opt_after_cconv]: 0.00015863, [1] [Cycle 1]: 0.00015095, [11] [c_1]: 2.736e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 6.34999e-06 [updatestate_assign_eliminate]: 2.73e-06 [updatestate_loads_eliminate]: 2.49001e-06 [cse]: 2.38e-05 [call_graph_tuple_transform]: 2.143e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.574e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 8.07e-06 [add_recomputation]: 4.588e-05 [cse_after_recomputation]: 2.245e-05, [1] [Cycle 1]: 1.773e-05, [1] [cse]: 1.197e-05 [auto_monad_reorder]: 1.682e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 4.67998e-06 [opt_after_jit_grad]: 0.00048968 [symbol_engine_optimizer]: 0.00012627, [1] [Cycle 1]: 0.00011988, [6] [build]: 3.01001e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.368e-05 [opt_reshape]: 5.617e-05 [fold_const_symbol]: 1.006e-05 [renormalize]: 5.20027e-07 [validate]: 4.057e-05 Sums bootstrap : 0.000277s : 0.25% type_inference : 0.106481s : 94.17% event_method : 0.000019s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000422s : 0.37% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000837s : 0.74% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002480s : 2.19% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000605s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000430s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000490s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000056s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000273 28 0.62% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.15% : 0.000006s : 4: substitution.graph_param_transform 84.10% : 0.000229s : 5: substitution.inline 1.25% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.58% : 0.000012s : 3: substitution.reduce_eliminate 1.51% : 0.000004s : 4: substitution.remove_not_recompute_node 1.33% : 0.000004s : 2: substitution.replace_old_param 3.94% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106414 2 97.68% : 0.103949s : 1: type_inference.infer 2.32% : 0.002465s : 1: type_inference.specialize ------[replace.] 0.000096 7 69.30% : 0.000067s : 5: replace.inline 30.70% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000235 7 95.94% : 0.000226s : 5: match.inline 4.06% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 886 1.30% : 0.000002s : 13: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.53% : 0.000002s : 13: predicate.addn_zero_filter 1.94% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 13: predicate.compare_switch_simplify 1.22% : 0.000002s : 13: predicate.depend_value_elim 1.13% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 13: predicate.environ_get_depend_swap 1.35% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 28: predicate.inline 0.86% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.00% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 13: predicate.merge_addn 1.18% : 0.000002s : 13: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 19: predicate.partial_eliminate 1.28% : 0.000002s : 13: predicate.print_const_string_wrapper 1.74% : 0.000002s : 13: predicate.reduce_eliminate 1.47% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 23: predicate.replace_applicator 0.56% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 13: predicate.reshape_eliminate 1.50% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 13: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 2.23% : 0.000003s : 13: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.70% : 0.000004s : 20: predicate.switch_defer_inline 2.33% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 64: predicate.switch_simplify 1.47% : 0.000002s : 13: predicate.tile_eliminate 1.31% : 0.000002s : 13: predicate.transpose_eliminate 1.56% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.55% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 13: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002109 25 63.31% : 0.001335s : 16: func_graph_cloner_run.FuncGraphClonerGraph 3.57% : 0.000075s : 2: func_graph_cloner_run.FuncGraphClonerNode 33.11% : 0.000698s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120697 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000290s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.05% : 0.007301s : 1: jit_opt_a 0.13% : 0.000161s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.42% : 0.000512s : 1: loop_unroll 0.51% : 0.000616s : 1: mutable_eliminate 0.89% : 0.001072s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000427s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.47% : 0.001775s : 1: renormalize.infer 0.58% : 0.000697s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.11% : 0.000129s : 1: symbol_engine_optimizer 88.23% : 0.106492s : 1: type_inference TotalTime = 0.0111303, [30] [bootstrap]: 0.00023394 [type_inference]: 0.00406093 [event_method]: 1.679e-05 [auto_monad]: 4.997e-05 [graph_reusing]: 3.67002e-06 [pre_auto_parallel]: 1.65001e-06 [py_interpret_to_execute]: 3.14e-05 [rewriter_before_opt_a]: 6.573e-05 [expand_dump_flag]: 2.17999e-06 [jit_opt_a]: 0.00474713, [2] [Cycle 1]: 0.00142975, [27] [switch_simplify]: 4.648e-05 [loop_unroll]: 2.917e-05 [a_1]: 0.00048189 [with_stream_mark]: 1.287e-05 [recompute_prepare]: 7.35e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 3.20998e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 9.19972e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.174e-05 [j_node_and_user_rematch]: 8.73001e-06 [meta_fg_expand]: 1.78002e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.0005731 [add_forward_monad_depend]: 4.48999e-06 [auto_monad_grad]: 1.77999e-06 [auto_monad_eliminator]: 1.098e-05 [cse]: 1.653e-05 [replace_applicator]: 1.102e-05 [Cycle 2]: 0.00030731, [27] [switch_simplify]: 5.30999e-06 [loop_unroll]: 4.68999e-06 [a_1]: 8.929e-05 [with_stream_mark]: 7.8e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 8.00006e-07 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 4.60999e-06 [meta_shard_fg_expand]: 9.39996e-07 [get_grad_eliminate_]: 4.45999e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.202e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 6.84999e-06 [inline_without_move]: 4.71002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.57001e-06 [cse]: 9.89001e-06 [replace_applicator]: 4.84998e-06 [py_interpret_to_execute_after_opt_a]: 7.58001e-06 [rewriter_after_opt_a]: 2.816e-05 [convert_after_rewriter]: 6.59999e-06 [order_py_execute_after_rewriter]: 4.38999e-06 [mutable_eliminate]: 0.00046386 [jit_opt_b]: 4.734e-05, [1] [Cycle 1]: 4.114e-05, [2] [frontend_op_eliminate]: 1.528e-05 [inline_after_opt_a]: 1.489e-05 [cconv]: 1.91e-05 [loop_unroll]: 0.00040421 [jit_opt_after_cconv]: 0.00013596, [1] [Cycle 1]: 0.00012992, [11] [c_1]: 2.086e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.785e-05 [call_graph_tuple_transform]: 1.682e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.76e-06 [remove_dup_value]: 1.173e-05 [partial_unused_args_eliminate]: 1.81003e-06 [environ_conv]: 4.65001e-06 [add_recomputation]: 3.719e-05 [cse_after_recomputation]: 3.325e-05, [1] [Cycle 1]: 1.751e-05, [1] [cse]: 1.147e-05 [auto_monad_reorder]: 1.206e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 4.1e-06 [opt_after_jit_grad]: 0.00044449 [symbol_engine_optimizer]: 6.98e-05, [1] [Cycle 1]: 6.4e-05, [6] [build]: 2.66999e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.21e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.2e-06 [renormalize]: 7.7e-07 [validate]: 3.092e-05 Sums bootstrap : 0.000234s : 3.09% type_inference : 0.004061s : 53.61% event_method : 0.000017s : 0.22% auto_monad : 0.000050s : 0.66% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000031s : 0.41% rewriter_before_opt_a : 0.000066s : 0.87% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000052s : 0.68% jit_opt_a.loop_unroll : 0.000034s : 0.45% jit_opt_a.a_1 : 0.000571s : 7.54% jit_opt_a.with_stream_mark : 0.000021s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000003s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000573s : 7.57% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000026s : 0.35% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000028s : 0.37% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000464s : 6.12% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000019s : 0.25% loop_unroll : 0.000404s : 5.34% jit_opt_after_cconv.c_1 : 0.000021s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000012s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000037s : 0.49% cse_after_recomputation.cse : 0.000011s : 0.15% auto_monad_reorder : 0.000012s : 0.16% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000444s : 5.87% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000031s : 0.41% Time group info: ------[substitution.] 0.000163 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.56% : 0.000004s : 3: substitution.graph_param_transform 83.30% : 0.000136s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.45% : 0.000004s : 4: substitution.remove_not_recompute_node 1.91% : 0.000003s : 2: substitution.replace_old_param 6.37% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004014 2 81.24% : 0.003261s : 1: type_inference.infer 18.76% : 0.000753s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.04% : 0.000041s : 4: replace.inline 33.96% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 93.56% : 0.000133s : 4: match.inline 6.44% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.56% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.09% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.51% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.87% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 1.04% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.81% : 0.000009s : 53: predicate.switch_simplify 1.50% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000548 13 49.99% : 0.000274s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.54% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.47% : 0.000244s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012534 72 0.32% : 0.000040s : 1: add_recomputation 0.43% : 0.000053s : 1: auto_monad 0.12% : 0.000015s : 1: auto_monad_reorder 1.96% : 0.000245s : 1: bootstrap 0.17% : 0.000022s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.28% : 0.000035s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.90% : 0.004750s : 1: jit_opt_a 1.11% : 0.000139s : 1: jit_opt_after_cconv 0.40% : 0.000050s : 1: jit_opt_b 3.29% : 0.000412s : 1: loop_unroll 3.76% : 0.000472s : 1: mutable_eliminate 6.12% : 0.000767s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.61% : 0.000453s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.27% : 0.000034s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 2.19% : 0.000274s : 1: renormalize.infer 2.33% : 0.000292s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000031s : 1: rewriter_after_opt_a 0.55% : 0.000069s : 1: rewriter_before_opt_a 0.58% : 0.000072s : 1: symbol_engine_optimizer 32.49% : 0.004072s : 1: type_inference TotalTime = 0.0120188, [30] [bootstrap]: 0.00027817 [type_inference]: 0.00472586 [event_method]: 1.676e-05 [auto_monad]: 5.215e-05 [graph_reusing]: 4.2e-06 [pre_auto_parallel]: 1.52999e-06 [py_interpret_to_execute]: 3.719e-05 [rewriter_before_opt_a]: 6.855e-05 [expand_dump_flag]: 2.57001e-06 [jit_opt_a]: 0.00476765, [2] [Cycle 1]: 0.00143299, [27] [switch_simplify]: 4.898e-05 [loop_unroll]: 3.025e-05 [a_1]: 0.00047976 [with_stream_mark]: 1.258e-05 [recompute_prepare]: 7.15e-06 [updatestate_depend_eliminate]: 2.95998e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.01997e-06 [accelerated_algorithm]: 5.24998e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 8.59989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.202e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.02998e-06 [inline_without_move]: 5.53002e-06 [renormalize]: 0.00056685 [add_forward_monad_depend]: 4.97999e-06 [auto_monad_grad]: 1.65001e-06 [auto_monad_eliminator]: 1.274e-05 [cse]: 1.905e-05 [replace_applicator]: 1.178e-05 [Cycle 2]: 0.00031761, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 5.03002e-06 [a_1]: 8.97e-05 [with_stream_mark]: 9.76e-06 [recompute_prepare]: 5.17e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.07999e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.58998e-06 [cell_reuse_recompute_pass]: 2.07001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.415e-05 [j_node_and_user_rematch]: 7.53999e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.53999e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29003e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.84e-06 [cse]: 1.164e-05 [replace_applicator]: 5.02999e-06 [py_interpret_to_execute_after_opt_a]: 9.41e-06 [rewriter_after_opt_a]: 2.751e-05 [convert_after_rewriter]: 6.35002e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00050054 [jit_opt_b]: 4.884e-05, [1] [Cycle 1]: 4.159e-05, [2] [frontend_op_eliminate]: 1.518e-05 [inline_after_opt_a]: 1.539e-05 [cconv]: 2.194e-05 [loop_unroll]: 0.00050246 [jit_opt_after_cconv]: 0.00013477, [1] [Cycle 1]: 0.00012789, [11] [c_1]: 2.053e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 5.53002e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 1.78e-05 [call_graph_tuple_transform]: 1.712e-05 [tuple_list_get_item_eliminator]: 5.59e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.16002e-06 [remove_dup_value]: 1.132e-05 [partial_unused_args_eliminate]: 1.87999e-06 [environ_conv]: 1.704e-05 [add_recomputation]: 3.955e-05 [cse_after_recomputation]: 2.31e-05, [1] [Cycle 1]: 1.772e-05, [1] [cse]: 1.17e-05 [auto_monad_reorder]: 1.217e-05 [get_jit_bprop_graph]: 1.52001e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.0004515 [symbol_engine_optimizer]: 6.854e-05, [1] [Cycle 1]: 6.224e-05, [6] [build]: 2.96001e-06 [elim_shapecalc]: 7.60998e-06 [elim_not_effective]: 1.187e-05 [opt_reshape]: 5.59998e-06 [fold_const_symbol]: 8.06001e-06 [renormalize]: 3.19997e-07 [validate]: 2.876e-05 Sums bootstrap : 0.000278s : 3.29% type_inference : 0.004726s : 55.82% event_method : 0.000017s : 0.20% auto_monad : 0.000052s : 0.62% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.44% rewriter_before_opt_a : 0.000069s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.42% jit_opt_a.a_1 : 0.000569s : 6.73% jit_opt_a.with_stream_mark : 0.000022s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000567s : 6.70% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.22% jit_opt_a.cse : 0.000031s : 0.36% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000028s : 0.32% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000501s : 5.91% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000022s : 0.26% loop_unroll : 0.000502s : 5.94% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000011s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000017s : 0.20% add_recomputation : 0.000040s : 0.47% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000012s : 0.14% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000452s : 5.33% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.34% Time group info: ------[substitution.] 0.000161 23 1.13% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000004s : 3: substitution.graph_param_transform 82.76% : 0.000133s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.45% : 0.000004s : 2: substitution.replace_old_param 5.94% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004676 2 80.72% : 0.003775s : 1: type_inference.infer 19.28% : 0.000901s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.76% : 0.000044s : 4: replace.inline 32.24% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000139 6 93.93% : 0.000131s : 4: match.inline 6.07% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.37% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.40% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.35% : 0.000002s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.20% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 2.13% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.77% : 0.000002s : 3: predicate.mutable_eliminate 0.56% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 2.20% : 0.000003s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000637 13 50.47% : 0.000322s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.15% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.38% : 0.000289s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013429 72 0.32% : 0.000042s : 1: add_recomputation 0.41% : 0.000055s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 2.16% : 0.000290s : 1: bootstrap 0.18% : 0.000025s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.14% : 0.000019s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 35.53% : 0.004771s : 1: jit_opt_a 1.02% : 0.000137s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.80% : 0.000511s : 1: loop_unroll 3.79% : 0.000509s : 1: mutable_eliminate 5.75% : 0.000772s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000459s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.30% : 0.000040s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000014s : 1: remove_dup_value 1.99% : 0.000268s : 1: renormalize.infer 2.18% : 0.000293s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000030s : 1: rewriter_after_opt_a 0.53% : 0.000071s : 1: rewriter_before_opt_a 0.53% : 0.000071s : 1: symbol_engine_optimizer 35.27% : 0.004736s : 1: type_inference TotalTime = 0.116652, [30] [bootstrap]: 0.00029922 [type_inference]: 0.106232 [event_method]: 1.995e-05 [auto_monad]: 5.145e-05 [graph_reusing]: 3.97e-06 [pre_auto_parallel]: 2.05002e-06 [py_interpret_to_execute]: 0.00045439 [rewriter_before_opt_a]: 8.527e-05 [expand_dump_flag]: 2.09999e-06 [jit_opt_a]: 0.00712426, [2] [Cycle 1]: 0.00370175, [27] [switch_simplify]: 5.179e-05 [loop_unroll]: 3.296e-05 [a_1]: 0.00061754 [with_stream_mark]: 1.344e-05 [recompute_prepare]: 8.87999e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 7.25e-06 [updatestate_useless_node_eliminater]: 6.10002e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 2.85998e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.92001e-06 [renormalize]: 0.00265811 [add_forward_monad_depend]: 6.18998e-06 [auto_monad_grad]: 1.60999e-06 [auto_monad_eliminator]: 1.319e-05 [cse]: 2.885e-05 [replace_applicator]: 1.529e-05 [Cycle 2]: 0.00037142, [27] [switch_simplify]: 6.61e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00012877 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 6.36e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 8.65001e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.304e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.078e-05 [rewriter_after_opt_a]: 3.211e-05 [convert_after_rewriter]: 6.57002e-06 [order_py_execute_after_rewriter]: 5.46e-06 [mutable_eliminate]: 0.00059454 [jit_opt_b]: 5.906e-05, [1] [Cycle 1]: 5.06e-05, [2] [frontend_op_eliminate]: 2.08e-05 [inline_after_opt_a]: 1.799e-05 [cconv]: 2.159e-05 [loop_unroll]: 0.00044295 [jit_opt_after_cconv]: 0.00016486, [1] [Cycle 1]: 0.00015797, [11] [c_1]: 2.746e-05 [parameter_eliminate]: 3.81999e-06 [updatestate_depend_eliminate]: 7.31999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.31e-06 [cse]: 2.533e-05 [call_graph_tuple_transform]: 2.29e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 6.01998e-06 [remove_dup_value]: 1.451e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 8.3e-06 [add_recomputation]: 4.055e-05 [cse_after_recomputation]: 2.371e-05, [1] [Cycle 1]: 1.829e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.444e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.14e-06 [opt_after_jit_grad]: 0.00058247 [symbol_engine_optimizer]: 0.00012564, [1] [Cycle 1]: 6.825e-05, [6] [build]: 2.90002e-06 [elim_shapecalc]: 8.76002e-06 [elim_not_effective]: 1.421e-05 [opt_reshape]: 7.08998e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 5.89993e-07 [validate]: 4.278e-05 Sums bootstrap : 0.000299s : 0.26% type_inference : 0.106232s : 94.04% event_method : 0.000020s : 0.02% auto_monad : 0.000051s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000454s : 0.40% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000746s : 0.66% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002658s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000595s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000443s : 0.39% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000582s : 0.52% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000212 28 0.72% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.79% : 0.000006s : 4: substitution.graph_param_transform 82.74% : 0.000176s : 5: substitution.inline 1.43% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.57% : 0.000010s : 3: substitution.reduce_eliminate 1.90% : 0.000004s : 4: substitution.remove_not_recompute_node 1.72% : 0.000004s : 2: substitution.replace_old_param 3.63% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106166 2 97.53% : 0.103540s : 1: type_inference.infer 2.47% : 0.002626s : 1: type_inference.specialize ------[replace.] 0.000084 7 68.30% : 0.000058s : 5: replace.inline 31.70% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 7 96.27% : 0.000173s : 5: match.inline 3.73% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 886 1.36% : 0.000002s : 13: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.24% : 0.000002s : 13: predicate.addn_zero_filter 1.88% : 0.000003s : 13: predicate.arithmetic_simplify 1.22% : 0.000002s : 13: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 13: predicate.compare_switch_simplify 1.18% : 0.000002s : 13: predicate.depend_value_elim 1.23% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 28: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.89% : 0.000003s : 19: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 40: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.22% : 0.000002s : 13: predicate.merge_addn 1.16% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.74% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.23% : 0.000003s : 13: predicate.reduce_eliminate 1.45% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 23: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 13: predicate.reshape_eliminate 1.36% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 13: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.30% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.57% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.25% : 0.000010s : 64: predicate.switch_simplify 1.36% : 0.000002s : 13: predicate.tile_eliminate 1.25% : 0.000002s : 13: predicate.transpose_eliminate 1.39% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.72% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 13: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002254 25 61.60% : 0.001388s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.48% : 0.000056s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.91% : 0.000809s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120364 72 0.04% : 0.000046s : 1: add_recomputation 0.05% : 0.000055s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.26% : 0.000312s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.92% : 0.007127s : 1: jit_opt_a 0.14% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.38% : 0.000453s : 1: loop_unroll 0.50% : 0.000604s : 1: mutable_eliminate 0.81% : 0.000974s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.49% : 0.000591s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000462s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.52% : 0.001835s : 1: renormalize.infer 0.68% : 0.000815s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.11% : 0.000128s : 1: symbol_engine_optimizer 88.27% : 0.106244s : 1: type_inference TotalTime = 0.112133, [30] [bootstrap]: 0.00032968 [type_inference]: 0.101937 [event_method]: 1.812e-05 [auto_monad]: 6.367e-05 [graph_reusing]: 5.72999e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00041121 [rewriter_before_opt_a]: 8.287e-05 [expand_dump_flag]: 3.34001e-06 [jit_opt_a]: 0.00708264, [2] [Cycle 1]: 0.00341558, [27] [switch_simplify]: 5.505e-05 [loop_unroll]: 3.124e-05 [a_1]: 0.00056114 [with_stream_mark]: 1.783e-05 [recompute_prepare]: 8.45999e-06 [updatestate_depend_eliminate]: 3.85998e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 5.87999e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.94999e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.71999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 9.71998e-06 [meta_fg_expand]: 2.69001e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 5.80002e-06 [renormalize]: 0.00241894 [add_forward_monad_depend]: 5.32999e-06 [auto_monad_grad]: 1.64998e-06 [auto_monad_eliminator]: 1.389e-05 [cse]: 2.283e-05 [replace_applicator]: 1.391e-05 [Cycle 2]: 0.00037013, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00012206 [with_stream_mark]: 1.205e-05 [recompute_prepare]: 5.84999e-06 [updatestate_depend_eliminate]: 3.33998e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.39e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.96e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.664e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 8.92e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.55999e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.299e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 1.07e-05 [rewriter_after_opt_a]: 3.087e-05 [convert_after_rewriter]: 6.10002e-06 [order_py_execute_after_rewriter]: 4.35e-06 [mutable_eliminate]: 0.0005946 [jit_opt_b]: 5.482e-05, [1] [Cycle 1]: 4.789e-05, [2] [frontend_op_eliminate]: 1.864e-05 [inline_after_opt_a]: 1.795e-05 [cconv]: 2.184e-05 [loop_unroll]: 0.00044164 [jit_opt_after_cconv]: 0.00015159, [1] [Cycle 1]: 0.00014433, [11] [c_1]: 2.607e-05 [parameter_eliminate]: 2.49001e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.155e-05 [call_graph_tuple_transform]: 2.017e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.09998e-06 [renormalize]: 2.00002e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 8.87e-06 [partial_unused_args_eliminate]: 1.49e-06 [environ_conv]: 6.60002e-06 [add_recomputation]: 3.173e-05 [cse_after_recomputation]: 1.979e-05, [1] [Cycle 1]: 1.487e-05, [1] [cse]: 9.40001e-06 [auto_monad_reorder]: 9.19e-06 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 5.19998e-06 [opt_after_jit_grad]: 0.00047352 [symbol_engine_optimizer]: 0.00012419, [1] [Cycle 1]: 0.00011778, [6] [build]: 2.73e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.308e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 8.89998e-06 [renormalize]: 3.99974e-07 [validate]: 3.198e-05 Sums bootstrap : 0.000330s : 0.30% type_inference : 0.101937s : 94.20% event_method : 0.000018s : 0.02% auto_monad : 0.000064s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000411s : 0.38% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000683s : 0.63% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002419s : 2.24% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000595s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000442s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000009s : 0.01% auto_monad_reorder : 0.000009s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000474s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000190 24 0.75% : 0.000001s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000004s : 4: substitution.graph_param_transform 82.39% : 0.000157s : 4: substitution.inline 1.75% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.94% : 0.000006s : 4: substitution.remove_not_recompute_node 3.01% : 0.000006s : 2: substitution.replace_old_param 6.51% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101866 2 97.51% : 0.099331s : 1: type_inference.infer 2.49% : 0.002535s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.51% : 0.000046s : 4: replace.inline 32.49% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.22% : 0.000154s : 4: match.inline 6.78% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.16% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000002s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.38% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000001s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.97% : 0.000008s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.62% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.23% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002103 22 65.30% : 0.001373s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.36% : 0.000702s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115553 72 0.03% : 0.000035s : 1: add_recomputation 0.06% : 0.000067s : 1: auto_monad 0.01% : 0.000011s : 1: auto_monad_reorder 0.30% : 0.000341s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.13% : 0.007086s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.39% : 0.000449s : 1: loop_unroll 0.52% : 0.000605s : 1: mutable_eliminate 0.79% : 0.000914s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000482s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000418s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.43% : 0.001655s : 1: renormalize.infer 0.65% : 0.000755s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000127s : 1: symbol_engine_optimizer 88.23% : 0.101953s : 1: type_inference TotalTime = 0.1205, [30] [bootstrap]: 0.00028973 [type_inference]: 0.109157 [event_method]: 2.358e-05 [auto_monad]: 6.62e-05 [graph_reusing]: 6.82002e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 0.00054313 [rewriter_before_opt_a]: 0.00010519 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00789039, [2] [Cycle 1]: 0.003906, [27] [switch_simplify]: 5.965e-05 [loop_unroll]: 3.438e-05 [a_1]: 0.00066173 [with_stream_mark]: 1.714e-05 [recompute_prepare]: 9.29e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.56998e-06 [specialize_transform]: 6.79999e-06 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.51003e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.0027774 [add_forward_monad_depend]: 6.86999e-06 [auto_monad_grad]: 2.31998e-06 [auto_monad_eliminator]: 1.658e-05 [cse]: 3.161e-05 [replace_applicator]: 1.803e-05 [Cycle 2]: 0.00038484, [27] [switch_simplify]: 7.30003e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.000131 [with_stream_mark]: 1.254e-05 [recompute_prepare]: 6.83e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.411e-05 [j_node_and_user_rematch]: 8.83001e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.49e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 8.2e-07 [auto_monad_eliminator]: 7.03e-06 [cse]: 1.408e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.525e-05 [rewriter_after_opt_a]: 3.798e-05 [convert_after_rewriter]: 7.21999e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00063868 [jit_opt_b]: 6.105e-05, [1] [Cycle 1]: 5.266e-05, [2] [frontend_op_eliminate]: 2.023e-05 [inline_after_opt_a]: 1.974e-05 [cconv]: 2.856e-05 [loop_unroll]: 0.0004632 [jit_opt_after_cconv]: 0.00015554, [1] [Cycle 1]: 0.00014831, [11] [c_1]: 2.538e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 6.05002e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [cse]: 2.529e-05 [call_graph_tuple_transform]: 2.137e-05 [tuple_list_get_item_eliminator]: 5.87001e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 6.05002e-06 [remove_dup_value]: 1.457e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 7.88999e-06 [add_recomputation]: 4.423e-05 [cse_after_recomputation]: 2.179e-05, [1] [Cycle 1]: 1.693e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.723e-05 [get_jit_bprop_graph]: 1.70001e-06 [rewriter_after_jit_bprop_graph]: 5.14998e-06 [opt_after_jit_grad]: 0.00051419 [symbol_engine_optimizer]: 0.00012978, [1] [Cycle 1]: 0.00012264, [6] [build]: 2.93e-06 [elim_shapecalc]: 9.54999e-06 [elim_not_effective]: 6.09e-05 [opt_reshape]: 7.88999e-06 [fold_const_symbol]: 1.021e-05 [renormalize]: 5.19998e-07 [validate]: 5.504e-05 Sums bootstrap : 0.000290s : 0.25% type_inference : 0.109157s : 93.87% event_method : 0.000024s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000543s : 0.47% rewriter_before_opt_a : 0.000105s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000041s : 0.03% jit_opt_a.a_1 : 0.000793s : 0.68% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002777s : 2.39% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000639s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.02% loop_unroll : 0.000463s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000514s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000061s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000055s : 0.05% Time group info: ------[substitution.] 0.000296 28 16.06% : 0.000048s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 1.92% : 0.000006s : 4: substitution.graph_param_transform 69.85% : 0.000207s : 5: substitution.inline 1.09% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.98% : 0.000012s : 3: substitution.reduce_eliminate 1.52% : 0.000005s : 4: substitution.remove_not_recompute_node 1.35% : 0.000004s : 2: substitution.replace_old_param 3.75% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.109083 2 97.53% : 0.106393s : 1: type_inference.infer 2.47% : 0.002690s : 1: type_inference.specialize ------[replace.] 0.000092 7 67.21% : 0.000062s : 5: replace.inline 32.79% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000214 7 95.31% : 0.000204s : 5: match.inline 4.69% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 886 1.20% : 0.000002s : 13: predicate.accumulaten_eliminater 1.43% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000002s : 13: predicate.addn_check_dump 1.56% : 0.000002s : 13: predicate.addn_zero_filter 1.99% : 0.000003s : 13: predicate.arithmetic_simplify 1.31% : 0.000002s : 13: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.23% : 0.000002s : 13: predicate.compare_switch_simplify 1.23% : 0.000002s : 13: predicate.depend_value_elim 1.12% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 13: predicate.environ_get_depend_swap 1.19% : 0.000002s : 13: predicate.environ_get_eliminate 1.13% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.39% : 0.000008s : 28: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.66% : 0.000002s : 19: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.12% : 0.000006s : 40: predicate.loop_unroll_before_grad 1.84% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 13: predicate.merge_addn 1.11% : 0.000002s : 13: predicate.minmaximum_grad 2.03% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 19: predicate.partial_eliminate 1.14% : 0.000002s : 13: predicate.print_const_string_wrapper 2.23% : 0.000003s : 13: predicate.reduce_eliminate 1.40% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 23: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 13: predicate.reshape_eliminate 1.20% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 13: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 20: predicate.switch_defer_inline 2.12% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.61% : 0.000011s : 64: predicate.switch_simplify 1.25% : 0.000002s : 13: predicate.tile_eliminate 1.28% : 0.000002s : 13: predicate.transpose_eliminate 1.51% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000006s : 23: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 13: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002349 25 61.57% : 0.001446s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.76% : 0.000065s : 2: func_graph_cloner_run.FuncGraphClonerNode 35.67% : 0.000838s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124431 72 0.04% : 0.000047s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.24% : 0.000302s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000028s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.34% : 0.007894s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000064s : 1: jit_opt_b 0.38% : 0.000472s : 1: loop_unroll 0.52% : 0.000651s : 1: mutable_eliminate 0.83% : 0.001035s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000020s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000525s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000553s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.51% : 0.001874s : 1: renormalize.infer 0.72% : 0.000894s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.09% : 0.000113s : 1: rewriter_before_opt_a 0.11% : 0.000133s : 1: symbol_engine_optimizer 87.74% : 0.109173s : 1: type_inference TotalTime = 0.113695, [30] [bootstrap]: 0.00024518 [type_inference]: 0.103874 [event_method]: 1.729e-05 [auto_monad]: 4.822e-05 [graph_reusing]: 4.35e-06 [pre_auto_parallel]: 1.67999e-06 [py_interpret_to_execute]: 0.000399 [rewriter_before_opt_a]: 7.508e-05 [expand_dump_flag]: 2.61999e-06 [jit_opt_a]: 0.00675674, [2] [Cycle 1]: 0.00325107, [27] [switch_simplify]: 4.844e-05 [loop_unroll]: 3.072e-05 [a_1]: 0.00052625 [with_stream_mark]: 1.185e-05 [recompute_prepare]: 8.54e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.69e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 6.46e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 6.14001e-06 [renormalize]: 0.00230611 [add_forward_monad_depend]: 6.75998e-06 [auto_monad_grad]: 1.45001e-06 [auto_monad_eliminator]: 1.583e-05 [cse]: 2.227e-05 [replace_applicator]: 1.603e-05 [Cycle 2]: 0.00036819, [27] [switch_simplify]: 6.21998e-06 [loop_unroll]: 5.54e-06 [a_1]: 0.00012282 [with_stream_mark]: 9.77001e-06 [recompute_prepare]: 5.87999e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 1.34e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 9.76998e-06 [meta_fg_expand]: 2.13002e-06 [replace_old_param]: 8.64e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.39998e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.183e-05 [replace_applicator]: 5.93002e-06 [py_interpret_to_execute_after_opt_a]: 1.184e-05 [rewriter_after_opt_a]: 3.009e-05 [convert_after_rewriter]: 5.76e-06 [order_py_execute_after_rewriter]: 4.52998e-06 [mutable_eliminate]: 0.00062447 [jit_opt_b]: 5.369e-05, [1] [Cycle 1]: 4.673e-05, [2] [frontend_op_eliminate]: 1.789e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 2.077e-05 [loop_unroll]: 0.00043124 [jit_opt_after_cconv]: 0.00015517, [1] [Cycle 1]: 0.00014803, [11] [c_1]: 2.639e-05 [parameter_eliminate]: 3.48999e-06 [updatestate_depend_eliminate]: 6.90002e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 2.265e-05 [call_graph_tuple_transform]: 1.936e-05 [tuple_list_get_item_eliminator]: 6.09001e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 5.79999e-06 [remove_dup_value]: 1.066e-05 [partial_unused_args_eliminate]: 1.65001e-06 [environ_conv]: 7.27997e-06 [add_recomputation]: 3.835e-05 [cse_after_recomputation]: 2.069e-05, [1] [Cycle 1]: 1.562e-05, [1] [cse]: 1.001e-05 [auto_monad_reorder]: 1.052e-05 [get_jit_bprop_graph]: 1.34e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00047633 [symbol_engine_optimizer]: 0.00015644, [1] [Cycle 1]: 0.00014998, [6] [build]: 3.23998e-06 [elim_shapecalc]: 8.59e-06 [elim_not_effective]: 1.388e-05 [opt_reshape]: 8.449e-05 [fold_const_symbol]: 1.052e-05 [renormalize]: 3.30008e-07 [validate]: 3.945e-05 Sums bootstrap : 0.000245s : 0.22% type_inference : 0.103874s : 94.45% event_method : 0.000017s : 0.02% auto_monad : 0.000048s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000399s : 0.36% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000649s : 0.59% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002306s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000624s : 0.57% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000021s : 0.02% loop_unroll : 0.000431s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000476s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000084s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000166 24 0.72% : 0.000001s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000005s : 4: substitution.graph_param_transform 83.12% : 0.000138s : 4: substitution.inline 2.07% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.48% : 0.000004s : 2: substitution.replace_old_param 5.17% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103809 2 97.58% : 0.101301s : 1: type_inference.infer 2.42% : 0.002508s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.17% : 0.000045s : 4: replace.inline 33.83% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 94.82% : 0.000135s : 4: match.inline 5.18% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.17% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000002s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.53% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.61% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.63% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.42% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.26% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.88% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.54% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.03% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.78% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001982 22 64.82% : 0.001284s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.55% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.64% : 0.000667s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117034 72 0.04% : 0.000041s : 1: add_recomputation 0.04% : 0.000051s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.22% : 0.000257s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.78% : 0.006760s : 1: jit_opt_a 0.14% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.38% : 0.000441s : 1: loop_unroll 0.54% : 0.000633s : 1: mutable_eliminate 0.75% : 0.000875s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000114s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000405s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.35% : 0.001585s : 1: renormalize.infer 0.61% : 0.000713s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000033s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.14% : 0.000159s : 1: symbol_engine_optimizer 88.77% : 0.103888s : 1: type_inference TotalTime = 0.0153261, [30] [bootstrap]: 0.0002829 [type_inference]: 0.00766498 [event_method]: 1.921e-05 [auto_monad]: 4.71e-05 [graph_reusing]: 4.55001e-06 [pre_auto_parallel]: 1.74e-06 [py_interpret_to_execute]: 3.956e-05 [rewriter_before_opt_a]: 7.295e-05 [expand_dump_flag]: 1.79e-06 [jit_opt_a]: 0.00517643, [2] [Cycle 1]: 0.00168548, [27] [switch_simplify]: 5.593e-05 [loop_unroll]: 3.385e-05 [a_1]: 0.0005978 [with_stream_mark]: 1.218e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 2.69999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.146e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 7.91001e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 0.00062339 [add_forward_monad_depend]: 4.33001e-06 [auto_monad_grad]: 1.11997e-06 [auto_monad_eliminator]: 1.064e-05 [cse]: 8.181e-05 [replace_applicator]: 1.245e-05 [Cycle 2]: 0.00033062, [27] [switch_simplify]: 6.01998e-06 [loop_unroll]: 5.15999e-06 [a_1]: 9.866e-05 [with_stream_mark]: 9.56e-06 [recompute_prepare]: 5.32001e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.45002e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 5.11997e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.135e-05 [j_node_and_user_rematch]: 7.72998e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 7.19001e-06 [inline_without_move]: 4.98001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 6.56999e-06 [cse]: 1.289e-05 [replace_applicator]: 5.17999e-06 [py_interpret_to_execute_after_opt_a]: 9.70002e-06 [rewriter_after_opt_a]: 2.889e-05 [convert_after_rewriter]: 5.76998e-06 [order_py_execute_after_rewriter]: 4.01001e-06 [mutable_eliminate]: 0.00051156 [jit_opt_b]: 4.824e-05, [1] [Cycle 1]: 4.156e-05, [2] [frontend_op_eliminate]: 1.558e-05 [inline_after_opt_a]: 1.53e-05 [cconv]: 1.558e-05 [loop_unroll]: 0.00041464 [jit_opt_after_cconv]: 0.00015151, [1] [Cycle 1]: 0.00014489, [11] [c_1]: 2.12e-05 [parameter_eliminate]: 2.31998e-06 [updatestate_depend_eliminate]: 5.48002e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [cse]: 2.306e-05 [call_graph_tuple_transform]: 2.644e-05 [tuple_list_get_item_eliminator]: 5.67001e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 9.14e-06 [partial_unused_args_eliminate]: 1.45999e-06 [environ_conv]: 3.96001e-06 [add_recomputation]: 3.393e-05 [cse_after_recomputation]: 2.295e-05, [1] [Cycle 1]: 1.802e-05, [1] [cse]: 1.24e-05 [auto_monad_reorder]: 1.166e-05 [get_jit_bprop_graph]: 1.48002e-06 [rewriter_after_jit_bprop_graph]: 4.81002e-06 [opt_after_jit_grad]: 0.00048316 [symbol_engine_optimizer]: 7.181e-05, [1] [Cycle 1]: 6.576e-05, [6] [build]: 2.92002e-06 [elim_shapecalc]: 8.16002e-06 [elim_not_effective]: 1.285e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.25999e-06 [renormalize]: 4.00003e-07 [validate]: 3.023e-05 Sums bootstrap : 0.000283s : 2.44% type_inference : 0.007665s : 65.99% event_method : 0.000019s : 0.17% auto_monad : 0.000047s : 0.41% graph_reusing : 0.000005s : 0.04% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000040s : 0.34% rewriter_before_opt_a : 0.000073s : 0.63% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000062s : 0.53% jit_opt_a.loop_unroll : 0.000039s : 0.34% jit_opt_a.a_1 : 0.000696s : 6.00% jit_opt_a.with_stream_mark : 0.000022s : 0.19% jit_opt_a.recompute_prepare : 0.000013s : 0.12% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.05% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.04% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.04% jit_opt_a.parameter_eliminate : 0.000003s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.10% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.09% jit_opt_a.accelerated_algorithm : 0.000011s : 0.09% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.02% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.09% jit_opt_a.merge_forward : 0.000005s : 0.05% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.20% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.14% jit_opt_a.meta_fg_expand : 0.000004s : 0.03% jit_opt_a.replace_old_param : 0.000015s : 0.13% jit_opt_a.inline_without_move : 0.000010s : 0.09% jit_opt_a.renormalize : 0.000623s : 5.37% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.05% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.15% jit_opt_a.cse : 0.000095s : 0.82% jit_opt_a.replace_applicator : 0.000018s : 0.15% py_interpret_to_execute_after_opt_a : 0.000010s : 0.08% rewriter_after_opt_a : 0.000029s : 0.25% convert_after_rewriter : 0.000006s : 0.05% order_py_execute_after_rewriter : 0.000004s : 0.03% mutable_eliminate : 0.000512s : 4.40% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.13% jit_opt_b.inline_after_opt_a : 0.000015s : 0.13% cconv : 0.000016s : 0.13% loop_unroll : 0.000415s : 3.57% jit_opt_after_cconv.c_1 : 0.000021s : 0.18% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000023s : 0.20% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.05% remove_dup_value : 0.000009s : 0.08% partial_unused_args_eliminate : 0.000001s : 0.01% environ_conv : 0.000004s : 0.03% add_recomputation : 0.000034s : 0.29% cse_after_recomputation.cse : 0.000012s : 0.11% auto_monad_reorder : 0.000012s : 0.10% get_jit_bprop_graph : 0.000001s : 0.01% rewriter_after_jit_bprop_graph : 0.000005s : 0.04% opt_after_jit_grad : 0.000483s : 4.16% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.07% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.26% Time group info: ------[substitution.] 0.000212 27 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.50% : 0.000001s : 2: substitution.fold_const_symbol 2.04% : 0.000004s : 3: substitution.graph_param_transform 84.16% : 0.000179s : 5: substitution.inline 1.34% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.47% : 0.000009s : 3: substitution.reduce_eliminate 1.89% : 0.000004s : 4: substitution.remove_not_recompute_node 1.44% : 0.000003s : 2: substitution.replace_old_param 3.38% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.007611 2 88.57% : 0.006741s : 1: type_inference.infer 11.43% : 0.000870s : 1: type_inference.specialize ------[replace.] 0.000086 7 67.66% : 0.000058s : 5: replace.inline 32.34% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 7 96.66% : 0.000176s : 5: match.inline 3.34% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 747 1.52% : 0.000002s : 11: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 11: predicate.addn_check_dump 1.24% : 0.000002s : 11: predicate.addn_zero_filter 2.13% : 0.000003s : 11: predicate.arithmetic_simplify 1.35% : 0.000002s : 11: predicate.cast_eliminate 0.37% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 11: predicate.compare_switch_simplify 1.22% : 0.000002s : 11: predicate.depend_value_elim 1.17% : 0.000001s : 11: predicate.dict_get_item_const_eliminator 1.54% : 0.000002s : 11: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 11: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 11: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 11: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 11: predicate.environ_get_depend_swap 1.25% : 0.000002s : 11: predicate.environ_get_eliminate 1.20% : 0.000001s : 11: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.24% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000007s : 24: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 13: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 16: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 38: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 14: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 11: predicate.merge_addn 1.22% : 0.000002s : 11: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 16: predicate.partial_eliminate 1.27% : 0.000002s : 11: predicate.print_const_string_wrapper 2.18% : 0.000003s : 11: predicate.reduce_eliminate 1.49% : 0.000002s : 13: predicate.redundant_stop_gradient_eliminater 0.48% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 19: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.38% : 0.000002s : 11: predicate.reshape_eliminate 1.33% : 0.000002s : 11: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000002s : 11: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.76% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 11: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 11: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 18: predicate.switch_defer_inline 2.24% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.99% : 0.000010s : 59: predicate.switch_simplify 1.35% : 0.000002s : 11: predicate.tile_eliminate 1.35% : 0.000002s : 11: predicate.transpose_eliminate 1.56% : 0.000002s : 11: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 11: predicate.tuple_list_get_item_depend_reorder 3.30% : 0.000004s : 19: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 11: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 13: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 16: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 22: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 11: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000726 16 50.28% : 0.000365s : 7: func_graph_cloner_run.FuncGraphClonerGraph 7.79% : 0.000057s : 2: func_graph_cloner_run.FuncGraphClonerNode 41.93% : 0.000305s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016943 72 0.22% : 0.000037s : 1: add_recomputation 0.30% : 0.000050s : 1: auto_monad 0.08% : 0.000014s : 1: auto_monad_reorder 1.75% : 0.000296s : 1: bootstrap 0.11% : 0.000018s : 1: cconv 0.05% : 0.000008s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.02% : 0.000004s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000007s : 1: graph_reusing 30.57% : 0.005179s : 1: jit_opt_a 0.91% : 0.000154s : 1: jit_opt_after_cconv 0.30% : 0.000051s : 1: jit_opt_b 2.49% : 0.000422s : 1: loop_unroll 3.07% : 0.000520s : 1: mutable_eliminate 5.37% : 0.000910s : 26: opt.transform.jit_opt_a 0.33% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.15% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000014s : 1: opt.transform.mutable_eliminate 0.13% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.19% : 0.000032s : 4: opt.transform.symbol_engine_opt 2.90% : 0.000491s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.25% : 0.000043s : 1: py_interpret_to_execute 0.07% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000011s : 1: remove_dup_value 2.05% : 0.000347s : 1: renormalize.infer 1.59% : 0.000270s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.19% : 0.000032s : 1: rewriter_after_opt_a 0.45% : 0.000076s : 1: rewriter_before_opt_a 0.44% : 0.000074s : 1: symbol_engine_optimizer 45.31% : 0.007676s : 1: type_inference TotalTime = 0.112394, [30] [bootstrap]: 0.00027286 [type_inference]: 0.10241 [event_method]: 1.849e-05 [auto_monad]: 5.753e-05 [graph_reusing]: 5.25001e-06 [pre_auto_parallel]: 1.66e-06 [py_interpret_to_execute]: 0.0004009 [rewriter_before_opt_a]: 8.144e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00689295, [2] [Cycle 1]: 0.00333465, [27] [switch_simplify]: 5.105e-05 [loop_unroll]: 3.004e-05 [a_1]: 0.00053897 [with_stream_mark]: 1.349e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 3.41001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.77002e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.41998e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 2.48e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00236825 [add_forward_monad_depend]: 6.14001e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.62e-05 [cse]: 2.744e-05 [replace_applicator]: 1.626e-05 [Cycle 2]: 0.00038875, [27] [switch_simplify]: 8.18001e-06 [loop_unroll]: 6.61e-06 [a_1]: 0.00013085 [with_stream_mark]: 9.15999e-06 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.25001e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.56e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.567e-05 [j_node_and_user_rematch]: 1.019e-05 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 9.34998e-06 [inline_without_move]: 5.81e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 6.29999e-06 [cse]: 1.233e-05 [replace_applicator]: 6.34999e-06 [py_interpret_to_execute_after_opt_a]: 9.17001e-06 [rewriter_after_opt_a]: 3.13e-05 [convert_after_rewriter]: 6.36e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00059012 [jit_opt_b]: 6.009e-05, [1] [Cycle 1]: 5.157e-05, [2] [frontend_op_eliminate]: 1.994e-05 [inline_after_opt_a]: 1.955e-05 [cconv]: 2.262e-05 [loop_unroll]: 0.00045244 [jit_opt_after_cconv]: 0.00015538, [1] [Cycle 1]: 0.00014866, [11] [c_1]: 2.743e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.039e-05 [call_graph_tuple_transform]: 2.072e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 7.29001e-06 [remove_dup_value]: 1.375e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 6.97002e-06 [add_recomputation]: 4.492e-05 [cse_after_recomputation]: 2.17e-05, [1] [Cycle 1]: 1.646e-05, [1] [cse]: 1.057e-05 [auto_monad_reorder]: 1.332e-05 [get_jit_bprop_graph]: 1.60999e-06 [rewriter_after_jit_bprop_graph]: 5.27999e-06 [opt_after_jit_grad]: 0.00052218 [symbol_engine_optimizer]: 7.325e-05, [1] [Cycle 1]: 6.731e-05, [6] [build]: 2.86e-06 [elim_shapecalc]: 8.01001e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 6.38e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 3.50003e-07 [validate]: 4.043e-05 Sums bootstrap : 0.000273s : 0.25% type_inference : 0.102410s : 94.27% event_method : 0.000018s : 0.02% auto_monad : 0.000058s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000401s : 0.37% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000670s : 0.62% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002368s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000590s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000452s : 0.42% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000522s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000183 24 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000005s : 4: substitution.graph_param_transform 83.12% : 0.000152s : 4: substitution.inline 1.75% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000003s : 2: substitution.replace_old_param 6.03% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102347 2 97.60% : 0.099891s : 1: type_inference.infer 2.40% : 0.002456s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.34% : 0.000046s : 4: replace.inline 33.66% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 93.84% : 0.000149s : 4: match.inline 6.16% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.22% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.22% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.46% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 2.25% : 0.000003s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.69% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.71% : 0.000010s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002125 22 63.34% : 0.001346s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.23% : 0.000749s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115747 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.25% : 0.000284s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.96% : 0.006896s : 1: jit_opt_a 0.14% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.40% : 0.000461s : 1: loop_unroll 0.52% : 0.000600s : 1: mutable_eliminate 0.78% : 0.000903s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000530s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.35% : 0.000407s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.39% : 0.001607s : 1: renormalize.infer 0.65% : 0.000752s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 88.49% : 0.102424s : 1: type_inference TotalTime = 0.116355, [30] [bootstrap]: 0.00031309 [type_inference]: 0.106414 [event_method]: 1.976e-05 [auto_monad]: 5.052e-05 [graph_reusing]: 4.04002e-06 [pre_auto_parallel]: 1.68002e-06 [py_interpret_to_execute]: 0.00045273 [rewriter_before_opt_a]: 8.914e-05 [expand_dump_flag]: 2.27999e-06 [jit_opt_a]: 0.00690909, [2] [Cycle 1]: 0.00341111, [27] [switch_simplify]: 5.36e-05 [loop_unroll]: 3.397e-05 [a_1]: 0.00060894 [with_stream_mark]: 1.279e-05 [recompute_prepare]: 8.52e-06 [updatestate_depend_eliminate]: 3.2e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.90999e-06 [inline_without_move]: 6.16998e-06 [renormalize]: 0.00239481 [add_forward_monad_depend]: 4.42e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 1.213e-05 [cse]: 2.093e-05 [replace_applicator]: 1.272e-05 [Cycle 2]: 0.00035933, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00012359 [with_stream_mark]: 9.00001e-06 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 2.82002e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.01998e-06 [meta_shard_fg_expand]: 1.17999e-06 [get_grad_eliminate_]: 5.36002e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 2.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.164e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.56998e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.284e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.052e-05 [rewriter_after_opt_a]: 2.921e-05 [convert_after_rewriter]: 5.84e-06 [order_py_execute_after_rewriter]: 4.47e-06 [mutable_eliminate]: 0.00049661 [jit_opt_b]: 5.162e-05, [1] [Cycle 1]: 4.537e-05, [2] [frontend_op_eliminate]: 1.724e-05 [inline_after_opt_a]: 1.735e-05 [cconv]: 1.753e-05 [loop_unroll]: 0.00042732 [jit_opt_after_cconv]: 0.00016272, [1] [Cycle 1]: 0.00015497, [11] [c_1]: 2.679e-05 [parameter_eliminate]: 2.81999e-06 [updatestate_depend_eliminate]: 7.36999e-06 [updatestate_assign_eliminate]: 2.72001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.601e-05 [call_graph_tuple_transform]: 2.266e-05 [tuple_list_get_item_eliminator]: 6.61999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 6.50005e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.307e-05 [partial_unused_args_eliminate]: 1.66e-06 [environ_conv]: 7.78001e-06 [add_recomputation]: 3.661e-05 [cse_after_recomputation]: 2.34e-05, [1] [Cycle 1]: 1.833e-05, [1] [cse]: 1.27e-05 [auto_monad_reorder]: 1.316e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 4.62e-06 [opt_after_jit_grad]: 0.00047134 [symbol_engine_optimizer]: 7.641e-05, [1] [Cycle 1]: 7.012e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 9.50001e-06 [elim_not_effective]: 1.426e-05 [opt_reshape]: 6.71999e-06 [fold_const_symbol]: 8.82999e-06 [renormalize]: 3.00002e-07 [validate]: 7.328e-05 Sums bootstrap : 0.000313s : 0.28% type_inference : 0.106414s : 94.46% event_method : 0.000020s : 0.02% auto_monad : 0.000051s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000453s : 0.40% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000733s : 0.65% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002395s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000497s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000427s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000037s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000471s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000073s : 0.07% Time group info: ------[substitution.] 0.000206 28 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000006s : 4: substitution.graph_param_transform 82.76% : 0.000171s : 5: substitution.inline 1.33% : 0.000003s : 4: substitution.j_node_and_user_rematch 4.63% : 0.000010s : 3: substitution.reduce_eliminate 2.06% : 0.000004s : 4: substitution.remove_not_recompute_node 1.55% : 0.000003s : 2: substitution.replace_old_param 3.66% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106351 2 97.40% : 0.103582s : 1: type_inference.infer 2.60% : 0.002769s : 1: type_inference.specialize ------[replace.] 0.000086 7 68.09% : 0.000058s : 5: replace.inline 31.91% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 7 96.31% : 0.000168s : 5: match.inline 3.69% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 886 1.51% : 0.000002s : 13: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 13: predicate.addn_check_dump 1.30% : 0.000002s : 13: predicate.addn_zero_filter 1.93% : 0.000003s : 13: predicate.arithmetic_simplify 1.29% : 0.000002s : 13: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 13: predicate.compare_switch_simplify 1.17% : 0.000002s : 13: predicate.depend_value_elim 1.17% : 0.000002s : 13: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 13: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 13: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 13: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 13: predicate.environ_get_depend_swap 1.26% : 0.000002s : 13: predicate.environ_get_eliminate 1.20% : 0.000002s : 13: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000007s : 28: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 15: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 19: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.16% : 0.000006s : 40: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 17: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 13: predicate.merge_addn 1.20% : 0.000002s : 13: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 19: predicate.partial_eliminate 1.33% : 0.000002s : 13: predicate.print_const_string_wrapper 1.83% : 0.000002s : 13: predicate.reduce_eliminate 1.53% : 0.000002s : 15: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 23: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 13: predicate.reshape_eliminate 1.29% : 0.000002s : 13: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 13: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 13: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 13: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 20: predicate.switch_defer_inline 2.15% : 0.000003s : 20: predicate.switch_layer_defer_inline 7.62% : 0.000010s : 64: predicate.switch_simplify 1.26% : 0.000002s : 13: predicate.tile_eliminate 1.26% : 0.000002s : 13: predicate.transpose_eliminate 1.53% : 0.000002s : 13: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 13: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 23: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 13: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 15: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 19: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 27: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 13: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002261 25 63.03% : 0.001425s : 16: func_graph_cloner_run.FuncGraphClonerGraph 2.40% : 0.000054s : 2: func_graph_cloner_run.FuncGraphClonerNode 34.57% : 0.000782s : 7: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119759 72 0.03% : 0.000039s : 1: add_recomputation 0.05% : 0.000054s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.27% : 0.000328s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.77% : 0.006912s : 1: jit_opt_a 0.14% : 0.000165s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.37% : 0.000437s : 1: loop_unroll 0.42% : 0.000505s : 1: mutable_eliminate 0.80% : 0.000960s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000480s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000459s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.36% : 0.001625s : 1: renormalize.infer 0.64% : 0.000762s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000094s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.87% : 0.106429s : 1: type_inference TotalTime = 0.0635737, [30] [bootstrap]: 0.00027604 [type_inference]: 0.054855 [event_method]: 1.698e-05 [auto_monad]: 4.711e-05 [graph_reusing]: 4.19002e-06 [pre_auto_parallel]: 1.54e-06 [py_interpret_to_execute]: 0.00029833 [rewriter_before_opt_a]: 7.368e-05 [expand_dump_flag]: 2.31e-06 [jit_opt_a]: 0.00600588, [2] [Cycle 1]: 0.0026691, [27] [switch_simplify]: 4.412e-05 [loop_unroll]: 3e-05 [a_1]: 0.00050029 [with_stream_mark]: 1.214e-05 [recompute_prepare]: 8.24002e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 9.40025e-07 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.187e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.78001e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00179284 [add_forward_monad_depend]: 4.43001e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 1.052e-05 [cse]: 1.893e-05 [replace_applicator]: 1.259e-05 [Cycle 2]: 0.00034551, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00011676 [with_stream_mark]: 8.18999e-06 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.04998e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.28e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 7.93999e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 1.012e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 8.32e-06 [rewriter_after_opt_a]: 2.529e-05 [convert_after_rewriter]: 5.96998e-06 [order_py_execute_after_rewriter]: 3.96001e-06 [mutable_eliminate]: 0.00047804 [jit_opt_b]: 5.048e-05, [1] [Cycle 1]: 4.497e-05, [2] [frontend_op_eliminate]: 1.742e-05 [inline_after_opt_a]: 1.681e-05 [cconv]: 1.576e-05 [loop_unroll]: 0.00041504 [jit_opt_after_cconv]: 0.00013866, [1] [Cycle 1]: 0.00013289, [11] [c_1]: 2.503e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 4.41002e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.51e-06 [cse]: 1.72e-05 [call_graph_tuple_transform]: 1.791e-05 [tuple_list_get_item_eliminator]: 6.21998e-06 [none_parameter_eliminate]: 1.08001e-06 [renormalize]: 3.7998e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.036e-05 [partial_unused_args_eliminate]: 1.53002e-06 [environ_conv]: 6.78e-06 [add_recomputation]: 3.298e-05 [cse_after_recomputation]: 2.289e-05, [1] [Cycle 1]: 1.805e-05, [1] [cse]: 1.261e-05 [auto_monad_reorder]: 9.85002e-06 [get_jit_bprop_graph]: 1.92999e-06 [rewriter_after_jit_bprop_graph]: 4.86002e-06 [opt_after_jit_grad]: 0.00045783 [symbol_engine_optimizer]: 0.0001126, [1] [Cycle 1]: 0.00010665, [6] [build]: 3.10998e-06 [elim_shapecalc]: 8.75999e-06 [elim_not_effective]: 1.391e-05 [opt_reshape]: 6.31998e-06 [fold_const_symbol]: 4.748e-05 [renormalize]: 4.00003e-07 [validate]: 3.186e-05 Sums bootstrap : 0.000276s : 0.46% type_inference : 0.054855s : 91.35% event_method : 0.000017s : 0.03% auto_monad : 0.000047s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000298s : 0.50% rewriter_before_opt_a : 0.000074s : 0.12% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000617s : 1.03% jit_opt_a.with_stream_mark : 0.000020s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001793s : 2.99% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.03% jit_opt_a.cse : 0.000029s : 0.05% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000025s : 0.04% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000478s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000415s : 0.69% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000033s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000458s : 0.76% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000047s : 0.08% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.05% Time group info: ------[substitution.] 0.000153 24 1.10% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000001s : 2: substitution.fold_const_symbol 2.78% : 0.000004s : 4: substitution.graph_param_transform 83.50% : 0.000128s : 4: substitution.inline 1.91% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.87% : 0.000004s : 4: substitution.remove_not_recompute_node 2.15% : 0.000003s : 2: substitution.replace_old_param 4.84% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054788 2 96.82% : 0.053045s : 1: type_inference.infer 3.18% : 0.001743s : 1: type_inference.specialize ------[replace.] 0.000061 6 65.63% : 0.000040s : 4: replace.inline 34.37% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000132 6 95.21% : 0.000126s : 4: match.inline 4.79% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000122 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.34% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000001s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.25% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.75% : 0.000006s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.40% : 0.000002s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.39% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002400 30 74.08% : 0.001778s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.16% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.76% : 0.000594s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066316 72 0.05% : 0.000036s : 1: add_recomputation 0.08% : 0.000050s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.44% : 0.000292s : 1: bootstrap 0.03% : 0.000018s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.06% : 0.006009s : 1: jit_opt_a 0.21% : 0.000141s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.64% : 0.000421s : 1: loop_unroll 0.73% : 0.000485s : 1: mutable_eliminate 1.25% : 0.000830s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000073s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.46% : 0.000305s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.80% : 0.001196s : 1: renormalize.infer 0.89% : 0.000590s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000028s : 1: rewriter_after_opt_a 0.12% : 0.000079s : 1: rewriter_before_opt_a 0.17% : 0.000115s : 1: symbol_engine_optimizer 82.74% : 0.054867s : 1: type_inference TotalTime = 0.0602342, [30] [bootstrap]: 0.00026845 [type_inference]: 0.0508733 [event_method]: 1.741e-05 [auto_monad]: 5.484e-05 [graph_reusing]: 4.27998e-06 [pre_auto_parallel]: 1.86e-06 [py_interpret_to_execute]: 0.00032279 [rewriter_before_opt_a]: 7.955e-05 [expand_dump_flag]: 2.50002e-06 [jit_opt_a]: 0.0065044, [2] [Cycle 1]: 0.00287769, [27] [switch_simplify]: 4.959e-05 [loop_unroll]: 3.036e-05 [a_1]: 0.00053571 [with_stream_mark]: 1.278e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 3.29001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.45001e-06 [specialize_transform]: 6.78e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 3.20002e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.242e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 6.29999e-06 [renormalize]: 0.00193869 [add_forward_monad_depend]: 4.62998e-06 [auto_monad_grad]: 2.29001e-06 [auto_monad_eliminator]: 1.258e-05 [cse]: 2.662e-05 [replace_applicator]: 1.28e-05 [Cycle 2]: 0.00035312, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 5.81003e-06 [a_1]: 0.00012075 [with_stream_mark]: 8.47e-06 [recompute_prepare]: 5.99999e-06 [updatestate_depend_eliminate]: 2.72001e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 1.04003e-06 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.286e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 1.93002e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.89999e-06 [cse]: 1.135e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 8.77e-06 [rewriter_after_opt_a]: 2.997e-05 [convert_after_rewriter]: 6.71999e-06 [order_py_execute_after_rewriter]: 4.74e-06 [mutable_eliminate]: 0.00053838 [jit_opt_b]: 5.58e-05, [1] [Cycle 1]: 4.784e-05, [2] [frontend_op_eliminate]: 1.897e-05 [inline_after_opt_a]: 1.751e-05 [cconv]: 2.143e-05 [loop_unroll]: 0.00042167 [jit_opt_after_cconv]: 0.00014829, [1] [Cycle 1]: 0.00014192, [11] [c_1]: 2.535e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 2.068e-05 [call_graph_tuple_transform]: 2.049e-05 [tuple_list_get_item_eliminator]: 6.54999e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.91e-06 [remove_dup_value]: 1.433e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 7.43e-06 [add_recomputation]: 4.179e-05 [cse_after_recomputation]: 2.175e-05, [1] [Cycle 1]: 1.684e-05, [1] [cse]: 1.126e-05 [auto_monad_reorder]: 1.409e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 4.17e-06 [opt_after_jit_grad]: 0.00045647 [symbol_engine_optimizer]: 7.308e-05, [1] [Cycle 1]: 6.705e-05, [6] [build]: 2.91999e-06 [elim_shapecalc]: 8.89e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 6.43e-06 [fold_const_symbol]: 9.40001e-06 [renormalize]: 3.89991e-07 [validate]: 6.327e-05 Sums bootstrap : 0.000268s : 0.48% type_inference : 0.050873s : 90.19% event_method : 0.000017s : 0.03% auto_monad : 0.000055s : 0.10% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000323s : 0.57% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000656s : 1.16% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001939s : 3.44% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000038s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000030s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000538s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000021s : 0.04% loop_unroll : 0.000422s : 0.75% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000042s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000456s : 0.81% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000063s : 0.11% Time group info: ------[substitution.] 0.000170 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 3.33% : 0.000006s : 4: substitution.graph_param_transform 83.06% : 0.000141s : 4: substitution.inline 1.76% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.66% : 0.000005s : 4: substitution.remove_not_recompute_node 2.21% : 0.000004s : 2: substitution.replace_old_param 5.38% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050809 2 96.44% : 0.048998s : 1: type_inference.infer 3.56% : 0.001810s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.29% : 0.000045s : 4: replace.inline 33.71% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 94.52% : 0.000139s : 4: match.inline 5.48% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.25% : 0.000002s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000001s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.14% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 1.01% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 58: predicate.switch_simplify 1.52% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.99% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002272 26 70.05% : 0.001592s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.20% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.75% : 0.000653s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063099 72 0.07% : 0.000044s : 1: add_recomputation 0.09% : 0.000058s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.44% : 0.000278s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.31% : 0.006507s : 1: jit_opt_a 0.24% : 0.000151s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.68% : 0.000430s : 1: loop_unroll 0.87% : 0.000551s : 1: mutable_eliminate 1.39% : 0.000876s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.52% : 0.000329s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.97% : 0.001240s : 1: renormalize.infer 1.09% : 0.000691s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.14% : 0.000085s : 1: rewriter_before_opt_a 0.12% : 0.000076s : 1: symbol_engine_optimizer 80.64% : 0.050885s : 1: type_inference TotalTime = 0.0115034, [30] [bootstrap]: 0.00027105 [type_inference]: 0.00421852 [event_method]: 1.714e-05 [auto_monad]: 6.37e-05 [graph_reusing]: 5.40999e-06 [pre_auto_parallel]: 1.89e-06 [py_interpret_to_execute]: 3.632e-05 [rewriter_before_opt_a]: 6.983e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00483268, [2] [Cycle 1]: 0.00147498, [27] [switch_simplify]: 5.814e-05 [loop_unroll]: 3.013e-05 [a_1]: 0.0004885 [with_stream_mark]: 1.512e-05 [recompute_prepare]: 7.85998e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.41001e-06 [parameter_eliminate]: 2.16e-06 [specialize_transform]: 6.21e-06 [updatestate_useless_node_eliminater]: 5.35999e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 2.02001e-06 [get_grad_eliminate_]: 5.48002e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.55001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 9.63997e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 8.77999e-06 [inline_without_move]: 5.39e-06 [renormalize]: 0.00056569 [add_forward_monad_depend]: 5.06002e-06 [auto_monad_grad]: 2.07001e-06 [auto_monad_eliminator]: 1.435e-05 [cse]: 2.725e-05 [replace_applicator]: 1.166e-05 [Cycle 2]: 0.00031847, [27] [switch_simplify]: 5.46e-06 [loop_unroll]: 4.91997e-06 [a_1]: 9.038e-05 [with_stream_mark]: 8.77e-06 [recompute_prepare]: 5.10001e-06 [updatestate_depend_eliminate]: 2.61999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 1.98002e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.74e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 2.53998e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.344e-05 [j_node_and_user_rematch]: 8.59998e-06 [meta_fg_expand]: 1.83997e-06 [replace_old_param]: 7.66001e-06 [inline_without_move]: 4.97e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.49976e-07 [auto_monad_eliminator]: 6.06998e-06 [cse]: 1.119e-05 [replace_applicator]: 5.10999e-06 [py_interpret_to_execute_after_opt_a]: 8.81997e-06 [rewriter_after_opt_a]: 2.957e-05 [convert_after_rewriter]: 6.90002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00047628 [jit_opt_b]: 4.846e-05, [1] [Cycle 1]: 4.189e-05, [2] [frontend_op_eliminate]: 1.558e-05 [inline_after_opt_a]: 1.504e-05 [cconv]: 2.167e-05 [loop_unroll]: 0.00042367 [jit_opt_after_cconv]: 0.00014131, [1] [Cycle 1]: 0.00013509, [11] [c_1]: 2.217e-05 [parameter_eliminate]: 2.38998e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 1.934e-05 [call_graph_tuple_transform]: 1.669e-05 [tuple_list_get_item_eliminator]: 6.41998e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.21998e-06 [remove_dup_value]: 1.355e-05 [partial_unused_args_eliminate]: 2.01e-06 [environ_conv]: 5.36002e-06 [add_recomputation]: 4.746e-05 [cse_after_recomputation]: 2.162e-05, [1] [Cycle 1]: 1.616e-05, [1] [cse]: 1.019e-05 [auto_monad_reorder]: 1.394e-05 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 4.45999e-06 [opt_after_jit_grad]: 0.00045128 [symbol_engine_optimizer]: 6.964e-05, [1] [Cycle 1]: 6.37e-05, [6] [build]: 2.83e-06 [elim_shapecalc]: 7.13e-06 [elim_not_effective]: 1.155e-05 [opt_reshape]: 5.57001e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 8.2e-07 [validate]: 3.07e-05 Sums bootstrap : 0.000271s : 3.43% type_inference : 0.004219s : 53.35% event_method : 0.000017s : 0.22% auto_monad : 0.000064s : 0.81% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.46% rewriter_before_opt_a : 0.000070s : 0.88% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000064s : 0.80% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000579s : 7.32% jit_opt_a.with_stream_mark : 0.000024s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.36% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.23% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000566s : 7.15% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.26% jit_opt_a.cse : 0.000038s : 0.49% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000030s : 0.37% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000476s : 6.02% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000022s : 0.27% loop_unroll : 0.000424s : 5.36% jit_opt_after_cconv.c_1 : 0.000022s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000047s : 0.60% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000014s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000451s : 5.71% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000031s : 0.39% Time group info: ------[substitution.] 0.000168 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.61% : 0.000004s : 3: substitution.graph_param_transform 81.44% : 0.000137s : 4: substitution.inline 1.93% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.31% : 0.000006s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 6.78% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004165 2 79.06% : 0.003293s : 1: type_inference.infer 20.94% : 0.000872s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.56% : 0.000042s : 4: replace.inline 33.44% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 92.96% : 0.000135s : 4: match.inline 7.04% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 0.81% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.22% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.04% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.25% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000002s : 15: predicate.partial_eliminate 1.28% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.96% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000002s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.81% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.81% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.74% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.01% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.45% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000564 13 47.86% : 0.000270s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.40% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.74% : 0.000269s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012919 72 0.39% : 0.000050s : 1: add_recomputation 0.52% : 0.000067s : 1: auto_monad 0.13% : 0.000016s : 1: auto_monad_reorder 2.20% : 0.000285s : 1: bootstrap 0.19% : 0.000024s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.43% : 0.004835s : 1: jit_opt_a 1.12% : 0.000144s : 1: jit_opt_after_cconv 0.39% : 0.000051s : 1: jit_opt_b 3.34% : 0.000431s : 1: loop_unroll 3.75% : 0.000484s : 1: mutable_eliminate 6.16% : 0.000796s : 26: opt.transform.jit_opt_a 0.37% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000029s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000459s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.14% : 0.000277s : 1: renormalize.infer 2.18% : 0.000281s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000032s : 1: rewriter_after_opt_a 0.56% : 0.000073s : 1: rewriter_before_opt_a 0.56% : 0.000072s : 1: symbol_engine_optimizer 32.74% : 0.004230s : 1: type_inference TotalTime = 0.011563, [30] [bootstrap]: 0.00023929 [type_inference]: 0.00451202 [event_method]: 1.648e-05 [auto_monad]: 4.694e-05 [graph_reusing]: 3.7e-06 [pre_auto_parallel]: 1.50001e-06 [py_interpret_to_execute]: 3.92e-05 [rewriter_before_opt_a]: 6.69e-05 [expand_dump_flag]: 1.77001e-06 [jit_opt_a]: 0.00464377, [2] [Cycle 1]: 0.0014056, [27] [switch_simplify]: 4.149e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.0004621 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 6.96999e-06 [updatestate_depend_eliminate]: 3.17002e-06 [updatestate_assign_eliminate]: 2.56998e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.56002e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 7.39994e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.134e-05 [j_node_and_user_rematch]: 8.55001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 5.07e-06 [renormalize]: 0.00058624 [add_forward_monad_depend]: 4.84e-06 [auto_monad_grad]: 1.17e-06 [auto_monad_eliminator]: 9.43002e-06 [cse]: 1.681e-05 [replace_applicator]: 1.105e-05 [Cycle 2]: 0.00030832, [27] [switch_simplify]: 5.47001e-06 [loop_unroll]: 4.79998e-06 [a_1]: 8.92e-05 [with_stream_mark]: 8.33999e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.66e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.06998e-06 [parameter_eliminate]: 8.49977e-07 [specialize_transform]: 4.75001e-06 [updatestate_useless_node_eliminater]: 4.74998e-06 [accelerated_algorithm]: 4.68999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.66002e-06 [merge_forward]: 2.48002e-06 [cell_reuse_recompute_pass]: 1.09998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.218e-05 [j_node_and_user_rematch]: 7.6e-06 [meta_fg_expand]: 1.61998e-06 [replace_old_param]: 7.54002e-06 [inline_without_move]: 4.52e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.079e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 7.66999e-06 [rewriter_after_opt_a]: 2.478e-05 [convert_after_rewriter]: 5.96e-06 [order_py_execute_after_rewriter]: 3.83001e-06 [mutable_eliminate]: 0.00047649 [jit_opt_b]: 4.783e-05, [1] [Cycle 1]: 4.161e-05, [2] [frontend_op_eliminate]: 1.556e-05 [inline_after_opt_a]: 1.533e-05 [cconv]: 1.742e-05 [loop_unroll]: 0.00047178 [jit_opt_after_cconv]: 0.00015692, [1] [Cycle 1]: 0.00015056, [11] [c_1]: 2.14e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.05002e-06 [cse]: 2.007e-05 [call_graph_tuple_transform]: 1.689e-05 [tuple_list_get_item_eliminator]: 5.66e-06 [none_parameter_eliminate]: 9.70002e-07 [renormalize]: 4.69998e-07 [switch_simplify]: 6.08002e-06 [remove_dup_value]: 8.57998e-06 [partial_unused_args_eliminate]: 1.72999e-06 [environ_conv]: 3.83999e-06 [add_recomputation]: 3.285e-05 [cse_after_recomputation]: 2.254e-05, [1] [Cycle 1]: 1.736e-05, [1] [cse]: 1.171e-05 [auto_monad_reorder]: 9.43002e-06 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4.13999e-06 [opt_after_jit_grad]: 0.0004529 [symbol_engine_optimizer]: 6.813e-05, [1] [Cycle 1]: 6.251e-05, [6] [build]: 2.39001e-06 [elim_shapecalc]: 7.7e-06 [elim_not_effective]: 1.145e-05 [opt_reshape]: 5.62001e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 3.59985e-07 [validate]: 2.477e-05 Sums bootstrap : 0.000239s : 2.96% type_inference : 0.004512s : 55.76% event_method : 0.000016s : 0.20% auto_monad : 0.000047s : 0.58% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000039s : 0.48% rewriter_before_opt_a : 0.000067s : 0.83% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000047s : 0.58% jit_opt_a.loop_unroll : 0.000035s : 0.43% jit_opt_a.a_1 : 0.000551s : 6.81% jit_opt_a.with_stream_mark : 0.000021s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000586s : 7.25% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000015s : 0.19% jit_opt_a.cse : 0.000028s : 0.34% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000025s : 0.31% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000476s : 5.89% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000017s : 0.22% loop_unroll : 0.000472s : 5.83% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000009s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000033s : 0.41% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000009s : 0.12% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000453s : 5.60% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000025s : 0.31% Time group info: ------[substitution.] 0.000145 23 0.91% : 0.000001s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.17% : 0.000003s : 3: substitution.graph_param_transform 84.03% : 0.000122s : 4: substitution.inline 1.70% : 0.000002s : 4: substitution.j_node_and_user_rematch 3.02% : 0.000004s : 4: substitution.remove_not_recompute_node 2.37% : 0.000003s : 2: substitution.replace_old_param 5.05% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004464 2 79.82% : 0.003563s : 1: type_inference.infer 20.18% : 0.000901s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.22% : 0.000042s : 4: replace.inline 33.78% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000126 6 95.10% : 0.000120s : 4: match.inline 4.90% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 0.89% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000001s : 10: predicate.addn_zero_filter 1.91% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000000s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000000s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 4.89% : 0.000005s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.27% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.58% : 0.000002s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.51% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 3: predicate.row_tensor_eliminate 1.33% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000008s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.48% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000628 13 48.25% : 0.000303s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.14% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.61% : 0.000299s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012967 72 0.28% : 0.000036s : 1: add_recomputation 0.39% : 0.000050s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 1.96% : 0.000255s : 1: bootstrap 0.15% : 0.000020s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 35.83% : 0.004646s : 1: jit_opt_a 1.23% : 0.000160s : 1: jit_opt_after_cconv 0.39% : 0.000051s : 1: jit_opt_b 3.70% : 0.000480s : 1: loop_unroll 3.73% : 0.000484s : 1: mutable_eliminate 5.73% : 0.000743s : 26: opt.transform.jit_opt_a 0.36% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.11% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000460s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.32% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000011s : 1: remove_dup_value 2.10% : 0.000273s : 1: renormalize.infer 2.38% : 0.000308s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000027s : 1: rewriter_after_opt_a 0.54% : 0.000070s : 1: rewriter_before_opt_a 0.54% : 0.000071s : 1: symbol_engine_optimizer 34.88% : 0.004523s : 1: type_inference TotalTime = 0.115637, [30] [bootstrap]: 0.00023111 [type_inference]: 0.104878 [event_method]: 2.215e-05 [auto_monad]: 6.622e-05 [graph_reusing]: 5.32999e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 0.00049163 [rewriter_before_opt_a]: 9.137e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00749251, [2] [Cycle 1]: 0.00359031, [27] [switch_simplify]: 6.142e-05 [loop_unroll]: 3.204e-05 [a_1]: 0.00060646 [with_stream_mark]: 1.903e-05 [recompute_prepare]: 9.04998e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.61001e-06 [updatestate_loads_eliminate]: 3.86001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 7.75998e-06 [updatestate_useless_node_eliminater]: 6.05002e-06 [accelerated_algorithm]: 6.76999e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.58e-06 [merge_forward]: 4.79e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.538e-05 [j_node_and_user_rematch]: 1.092e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 1.018e-05 [inline_without_move]: 6.53e-06 [renormalize]: 0.00251048 [add_forward_monad_depend]: 5.47999e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.608e-05 [cse]: 2.781e-05 [replace_applicator]: 1.674e-05 [Cycle 2]: 0.00036618, [27] [switch_simplify]: 6.63998e-06 [loop_unroll]: 5.98998e-06 [a_1]: 0.00012405 [with_stream_mark]: 1.113e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.68002e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.57e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.067e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 1.085e-05 [rewriter_after_opt_a]: 3.13e-05 [convert_after_rewriter]: 6.96999e-06 [order_py_execute_after_rewriter]: 4.75999e-06 [mutable_eliminate]: 0.00068083 [jit_opt_b]: 5.657e-05, [1] [Cycle 1]: 4.989e-05, [2] [frontend_op_eliminate]: 1.995e-05 [inline_after_opt_a]: 1.898e-05 [cconv]: 2.344e-05 [loop_unroll]: 0.00044395 [jit_opt_after_cconv]: 0.00015103, [1] [Cycle 1]: 0.00014464, [11] [c_1]: 2.522e-05 [parameter_eliminate]: 2.81999e-06 [updatestate_depend_eliminate]: 6.12001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.128e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 7.13e-06 [remove_dup_value]: 1.443e-05 [partial_unused_args_eliminate]: 1.87001e-06 [environ_conv]: 7.21001e-06 [add_recomputation]: 4.8e-05 [cse_after_recomputation]: 2.204e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.044e-05 [auto_monad_reorder]: 1.532e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.67999e-06 [opt_after_jit_grad]: 0.00048512 [symbol_engine_optimizer]: 8.123e-05, [1] [Cycle 1]: 7.482e-05, [6] [build]: 3.62002e-06 [elim_shapecalc]: 8.50999e-06 [elim_not_effective]: 1.394e-05 [opt_reshape]: 9.24998e-06 [fold_const_symbol]: 1.069e-05 [renormalize]: 4.30009e-07 [validate]: 8.742e-05 Sums bootstrap : 0.000231s : 0.21% type_inference : 0.104878s : 94.05% event_method : 0.000022s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000492s : 0.44% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000731s : 0.66% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002511s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000681s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000444s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000485s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000087s : 0.08% Time group info: ------[substitution.] 0.000233 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 1.30% : 0.000003s : 2: substitution.fold_const_symbol 2.46% : 0.000006s : 4: substitution.graph_param_transform 84.54% : 0.000197s : 4: substitution.inline 1.55% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 1.84% : 0.000004s : 2: substitution.replace_old_param 5.16% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104801 2 97.49% : 0.102169s : 1: type_inference.infer 2.51% : 0.002631s : 1: type_inference.specialize ------[replace.] 0.000077 6 68.10% : 0.000052s : 4: replace.inline 31.90% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000205 6 94.74% : 0.000195s : 4: match.inline 5.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.49% : 0.000002s : 12: predicate.accumulaten_eliminater 0.92% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.78% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.04% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.16% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.85% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002011 22 65.59% : 0.001319s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.39% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.02% : 0.000644s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119177 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.20% : 0.000243s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.29% : 0.007496s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.38% : 0.000452s : 1: loop_unroll 0.58% : 0.000690s : 1: mutable_eliminate 0.82% : 0.000975s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000033s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000493s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000500s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.51% : 0.001795s : 1: renormalize.infer 0.59% : 0.000707s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 88.02% : 0.104895s : 1: type_inference TotalTime = 0.120734, [30] [bootstrap]: 0.00032077 [type_inference]: 0.108928 [event_method]: 2.046e-05 [auto_monad]: 6.686e-05 [graph_reusing]: 5.59998e-06 [pre_auto_parallel]: 2.66e-06 [py_interpret_to_execute]: 0.0005984 [rewriter_before_opt_a]: 8.679e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.00829654, [2] [Cycle 1]: 0.00412145, [27] [switch_simplify]: 5.885e-05 [loop_unroll]: 3.044e-05 [a_1]: 0.00064429 [with_stream_mark]: 2.147e-05 [recompute_prepare]: 9.89001e-06 [updatestate_depend_eliminate]: 4.50999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 1.99999e-06 [specialize_transform]: 7.26001e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.62002e-06 [meta_shard_fg_expand]: 2.65002e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 9.71e-06 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00297934 [add_forward_monad_depend]: 8.26002e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 2.071e-05 [cse]: 3.295e-05 [replace_applicator]: 2.181e-05 [Cycle 2]: 0.00038985, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.14001e-06 [a_1]: 0.00012895 [with_stream_mark]: 1.288e-05 [recompute_prepare]: 6.74999e-06 [updatestate_depend_eliminate]: 3.4e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.68e-06 [get_grad_eliminate_]: 6.16e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 2.44999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.709e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.84001e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.58998e-06 [cse]: 1.338e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.363e-05 [rewriter_after_opt_a]: 3.779e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00069903 [jit_opt_b]: 5.625e-05, [1] [Cycle 1]: 4.867e-05, [2] [frontend_op_eliminate]: 1.965e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 2.79e-05 [loop_unroll]: 0.00045735 [jit_opt_after_cconv]: 0.00015902, [1] [Cycle 1]: 0.00015218, [11] [c_1]: 2.608e-05 [parameter_eliminate]: 3.11999e-06 [updatestate_depend_eliminate]: 5.67001e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.62e-05 [call_graph_tuple_transform]: 2.282e-05 [tuple_list_get_item_eliminator]: 6.35002e-06 [none_parameter_eliminate]: 1.51998e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.617e-05 [partial_unused_args_eliminate]: 2.72001e-06 [environ_conv]: 8.15e-06 [add_recomputation]: 4.994e-05 [cse_after_recomputation]: 2.144e-05, [1] [Cycle 1]: 1.624e-05, [1] [cse]: 1.057e-05 [auto_monad_reorder]: 1.449e-05 [get_jit_bprop_graph]: 2.27001e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.00050816 [symbol_engine_optimizer]: 7.9e-05, [1] [Cycle 1]: 7.131e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 8.67e-06 [elim_not_effective]: 1.435e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 3.39991e-07 [validate]: 4.167e-05 Sums bootstrap : 0.000321s : 0.28% type_inference : 0.108928s : 93.64% event_method : 0.000020s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000598s : 0.51% rewriter_before_opt_a : 0.000087s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000773s : 0.66% jit_opt_a.with_stream_mark : 0.000034s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002979s : 2.56% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000699s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000457s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000508s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000255 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 2.71% : 0.000007s : 4: substitution.graph_param_transform 84.99% : 0.000217s : 4: substitution.inline 1.76% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.16% : 0.000006s : 4: substitution.remove_not_recompute_node 1.98% : 0.000005s : 2: substitution.replace_old_param 5.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108853 2 97.46% : 0.106093s : 1: type_inference.infer 2.54% : 0.002761s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.29% : 0.000055s : 4: replace.inline 32.71% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.81% : 0.000214s : 4: match.inline 5.19% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.45% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.58% : 0.000008s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.69% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.89% : 0.000003s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.12% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.27% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.35% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002326 22 61.74% : 0.001436s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.18% : 0.000051s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.08% : 0.000839s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.124811 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.27% : 0.000342s : 1: bootstrap 0.02% : 0.000031s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.65% : 0.008301s : 1: jit_opt_a 0.13% : 0.000162s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.37% : 0.000466s : 1: loop_unroll 0.57% : 0.000708s : 1: mutable_eliminate 0.82% : 0.001022s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.49% : 0.000607s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.62% : 0.002019s : 1: renormalize.infer 0.76% : 0.000950s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.07% : 0.000092s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 87.29% : 0.108947s : 1: type_inference TotalTime = 0.129018, [30] [bootstrap]: 0.00030271 [type_inference]: 0.117477 [event_method]: 8.045e-05 [auto_monad]: 6.086e-05 [graph_reusing]: 5.27001e-06 [pre_auto_parallel]: 2.02999e-06 [py_interpret_to_execute]: 0.00057498 [rewriter_before_opt_a]: 8.631e-05 [expand_dump_flag]: 3.62002e-06 [jit_opt_a]: 0.00796073, [2] [Cycle 1]: 0.00387893, [27] [switch_simplify]: 5.87e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00058592 [with_stream_mark]: 1.772e-05 [recompute_prepare]: 8.95999e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 7.46999e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.41998e-06 [meta_shard_fg_expand]: 2.43002e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 1.51002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.589e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.48998e-06 [replace_old_param]: 9.67001e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.00282097 [add_forward_monad_depend]: 7.08e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.835e-05 [cse]: 3.042e-05 [replace_applicator]: 1.952e-05 [Cycle 2]: 0.00037955, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 5.94999e-06 [a_1]: 0.00012699 [with_stream_mark]: 1.214e-05 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.33e-06 [cell_reuse_recompute_pass]: 3.38e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.49e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.89e-06 [cse]: 1.272e-05 [replace_applicator]: 6.23e-06 [py_interpret_to_execute_after_opt_a]: 1.25e-05 [rewriter_after_opt_a]: 3.462e-05 [convert_after_rewriter]: 6.73e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00065309 [jit_opt_b]: 5.982e-05, [1] [Cycle 1]: 5.189e-05, [2] [frontend_op_eliminate]: 2.173e-05 [inline_after_opt_a]: 1.881e-05 [cconv]: 2.5e-05 [loop_unroll]: 0.00044989 [jit_opt_after_cconv]: 0.00015441, [1] [Cycle 1]: 0.00014775, [11] [c_1]: 2.609e-05 [parameter_eliminate]: 2.85002e-06 [updatestate_depend_eliminate]: 6.28e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.105e-05 [call_graph_tuple_transform]: 2.151e-05 [tuple_list_get_item_eliminator]: 6.14001e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.603e-05 [partial_unused_args_eliminate]: 3.92002e-06 [environ_conv]: 7.97e-06 [add_recomputation]: 4.789e-05 [cse_after_recomputation]: 2.289e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.153e-05 [auto_monad_reorder]: 1.497e-05 [get_jit_bprop_graph]: 2.02001e-06 [rewriter_after_jit_bprop_graph]: 4.92e-06 [opt_after_jit_grad]: 0.00051059 [symbol_engine_optimizer]: 0.00019197, [1] [Cycle 1]: 7.551e-05, [6] [build]: 3.91001e-06 [elim_shapecalc]: 8.70999e-06 [elim_not_effective]: 1.728e-05 [opt_reshape]: 9.49999e-06 [fold_const_symbol]: 8.84998e-06 [renormalize]: 3.69997e-07 [validate]: 4.311e-05 Sums bootstrap : 0.000303s : 0.24% type_inference : 0.117477s : 94.29% event_method : 0.000080s : 0.06% auto_monad : 0.000061s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000575s : 0.46% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000713s : 0.57% jit_opt_a.with_stream_mark : 0.000030s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.01% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002821s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000043s : 0.03% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000653s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000450s : 0.36% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000511s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.03% Time group info: ------[substitution.] 0.000216 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 3.15% : 0.000007s : 4: substitution.graph_param_transform 83.39% : 0.000180s : 4: substitution.inline 2.08% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000006s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 5.26% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.117402 2 97.46% : 0.114421s : 1: type_inference.infer 2.54% : 0.002981s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.12% : 0.000051s : 4: replace.inline 30.88% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000188 6 94.62% : 0.000178s : 4: match.inline 5.38% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.53% : 0.000002s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.44% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.56% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.22% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.18% : 0.000002s : 12: predicate.reshape_eliminate 1.61% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.23% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.99% : 0.000010s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.76% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002285 22 63.87% : 0.001459s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.66% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.47% : 0.000788s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.132857 72 0.04% : 0.000051s : 1: add_recomputation 0.05% : 0.000064s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000318s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.06% : 0.000085s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.99% : 0.007964s : 1: jit_opt_a 0.12% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.34% : 0.000458s : 1: loop_unroll 0.50% : 0.000661s : 1: mutable_eliminate 0.72% : 0.000956s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000032s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000519s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000583s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.47% : 0.001952s : 1: renormalize.infer 0.65% : 0.000860s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.15% : 0.000195s : 1: symbol_engine_optimizer 88.43% : 0.117492s : 1: type_inference TotalTime = 0.117003, [30] [bootstrap]: 0.0002924 [type_inference]: 0.106853 [event_method]: 1.71e-05 [auto_monad]: 5.058e-05 [graph_reusing]: 3.95998e-06 [pre_auto_parallel]: 2.06e-06 [py_interpret_to_execute]: 0.00049366 [rewriter_before_opt_a]: 7.474e-05 [expand_dump_flag]: 2.34001e-06 [jit_opt_a]: 0.00694716, [2] [Cycle 1]: 0.00346625, [27] [switch_simplify]: 4.673e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00060597 [with_stream_mark]: 1.251e-05 [recompute_prepare]: 8.69e-06 [updatestate_depend_eliminate]: 3.18998e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.60997e-06 [meta_shard_fg_expand]: 1.62999e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 2.63003e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 1.136e-05 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 9.28002e-06 [inline_without_move]: 6.15002e-06 [renormalize]: 0.00246066 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 1.249e-05 [cse]: 1.875e-05 [replace_applicator]: 1.583e-05 [Cycle 2]: 0.00036039, [27] [switch_simplify]: 6.78998e-06 [loop_unroll]: 5.87001e-06 [a_1]: 0.00012392 [with_stream_mark]: 1.021e-05 [recompute_prepare]: 5.94e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.67999e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.98002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.317e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 5.81e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.47999e-06 [cse]: 1.099e-05 [replace_applicator]: 6.04999e-06 [py_interpret_to_execute_after_opt_a]: 9.72001e-06 [rewriter_after_opt_a]: 2.905e-05 [convert_after_rewriter]: 6.09001e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00059285 [jit_opt_b]: 5.338e-05, [1] [Cycle 1]: 4.711e-05, [2] [frontend_op_eliminate]: 1.895e-05 [inline_after_opt_a]: 1.783e-05 [cconv]: 2.118e-05 [loop_unroll]: 0.00043278 [jit_opt_after_cconv]: 0.0001456, [1] [Cycle 1]: 0.00013961, [11] [c_1]: 2.555e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.882e-05 [call_graph_tuple_transform]: 2.09e-05 [tuple_list_get_item_eliminator]: 6.36e-06 [none_parameter_eliminate]: 1.19e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.86003e-06 [remove_dup_value]: 1.149e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 7.53999e-06 [add_recomputation]: 3.865e-05 [cse_after_recomputation]: 2.163e-05, [1] [Cycle 1]: 1.593e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.135e-05 [get_jit_bprop_graph]: 1.54998e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00048903 [symbol_engine_optimizer]: 0.00017523, [1] [Cycle 1]: 0.00016887, [6] [build]: 2.81e-06 [elim_shapecalc]: 1.081e-05 [elim_not_effective]: 0.00010811 [opt_reshape]: 7.75e-06 [fold_const_symbol]: 1.033e-05 [renormalize]: 4.39992e-07 [validate]: 4.24e-05 Sums bootstrap : 0.000292s : 0.26% type_inference : 0.106853s : 94.29% event_method : 0.000017s : 0.02% auto_monad : 0.000051s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000494s : 0.44% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000730s : 0.64% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002461s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000593s : 0.52% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000021s : 0.02% loop_unroll : 0.000433s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000039s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000489s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000108s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000171 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000005s : 4: substitution.graph_param_transform 82.93% : 0.000142s : 4: substitution.inline 2.00% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.66% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000003s : 2: substitution.replace_old_param 5.71% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106755 2 97.65% : 0.104241s : 1: type_inference.infer 2.35% : 0.002514s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.63% : 0.000048s : 4: replace.inline 33.37% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 94.34% : 0.000139s : 4: match.inline 5.66% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.96% : 0.000003s : 12: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.45% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.08% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.34% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.68% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.71% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002110 22 64.97% : 0.001371s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.37% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.66% : 0.000710s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120585 72 0.03% : 0.000041s : 1: add_recomputation 0.04% : 0.000054s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.26% : 0.000308s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.76% : 0.006951s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.36% : 0.000440s : 1: loop_unroll 0.50% : 0.000601s : 1: mutable_eliminate 0.79% : 0.000954s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.11% : 0.000133s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000500s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.43% : 0.001728s : 1: renormalize.infer 0.60% : 0.000724s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.15% : 0.000178s : 1: symbol_engine_optimizer 88.62% : 0.106864s : 1: type_inference TotalTime = 0.0745617, [30] [bootstrap]: 0.00033679 [type_inference]: 0.0629406 [event_method]: 1.816e-05 [auto_monad]: 5.134e-05 [graph_reusing]: 4.07e-06 [pre_auto_parallel]: 1.71e-06 [py_interpret_to_execute]: 0.00041664 [rewriter_before_opt_a]: 8.054e-05 [expand_dump_flag]: 2.22999e-06 [jit_opt_a]: 0.00738628, [2] [Cycle 1]: 0.00360437, [27] [switch_simplify]: 4.697e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00054713 [with_stream_mark]: 1.361e-05 [recompute_prepare]: 8.09002e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 2.59001e-06 [cell_reuse_recompute_pass]: 9.00007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 1.09e-05 [meta_fg_expand]: 2.54999e-06 [replace_old_param]: 9.72999e-06 [inline_without_move]: 6.28e-06 [renormalize]: 0.0026456 [add_forward_monad_depend]: 6.61999e-06 [auto_monad_grad]: 2.06998e-06 [auto_monad_eliminator]: 1.431e-05 [cse]: 2.44e-05 [replace_applicator]: 1.641e-05 [Cycle 2]: 0.00037618, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.00012803 [with_stream_mark]: 1.225e-05 [recompute_prepare]: 5.57001e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.35999e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 6.34001e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.74999e-06 [cell_reuse_recompute_pass]: 2.29001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.06003e-06 [replace_old_param]: 8.79998e-06 [inline_without_move]: 5.61e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 5.37999e-06 [cse]: 1.184e-05 [replace_applicator]: 5.66003e-06 [py_interpret_to_execute_after_opt_a]: 1.091e-05 [rewriter_after_opt_a]: 3.313e-05 [convert_after_rewriter]: 6.33998e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00064433 [jit_opt_b]: 5.664e-05, [1] [Cycle 1]: 4.986e-05, [2] [frontend_op_eliminate]: 1.985e-05 [inline_after_opt_a]: 1.915e-05 [cconv]: 2.117e-05 [loop_unroll]: 0.00138432 [jit_opt_after_cconv]: 0.00016712, [1] [Cycle 1]: 0.0001598, [11] [c_1]: 2.876e-05 [parameter_eliminate]: 4.30999e-06 [updatestate_depend_eliminate]: 6.47001e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.28998e-06 [cse]: 2.511e-05 [call_graph_tuple_transform]: 2.302e-05 [tuple_list_get_item_eliminator]: 6.58998e-06 [none_parameter_eliminate]: 1.29e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 6.46e-06 [remove_dup_value]: 1.379e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 8.99e-06 [add_recomputation]: 4.174e-05 [cse_after_recomputation]: 2.204e-05, [1] [Cycle 1]: 1.642e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.238e-05 [get_jit_bprop_graph]: 1.95001e-06 [rewriter_after_jit_bprop_graph]: 5.67001e-06 [opt_after_jit_grad]: 0.00050978 [symbol_engine_optimizer]: 0.00015281, [1] [Cycle 1]: 0.00014608, [6] [build]: 3.16001e-06 [elim_shapecalc]: 8.43001e-06 [elim_not_effective]: 1.396e-05 [opt_reshape]: 7.98e-05 [fold_const_symbol]: 1.121e-05 [renormalize]: 3.30008e-07 [validate]: 4.201e-05 Sums bootstrap : 0.000337s : 0.48% type_inference : 0.062941s : 89.18% event_method : 0.000018s : 0.03% auto_monad : 0.000051s : 0.07% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000417s : 0.59% rewriter_before_opt_a : 0.000081s : 0.11% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.08% jit_opt_a.loop_unroll : 0.000037s : 0.05% jit_opt_a.a_1 : 0.000675s : 0.96% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002646s : 3.75% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000036s : 0.05% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000644s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000021s : 0.03% loop_unroll : 0.001384s : 1.96% jit_opt_after_cconv.c_1 : 0.000029s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000042s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000510s : 0.72% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000080s : 0.11% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.06% Time group info: ------[substitution.] 0.000182 24 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 3.39% : 0.000006s : 4: substitution.graph_param_transform 82.06% : 0.000149s : 4: substitution.inline 2.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000005s : 4: substitution.remove_not_recompute_node 2.40% : 0.000004s : 2: substitution.replace_old_param 4.90% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.062861 2 96.71% : 0.060792s : 1: type_inference.infer 3.29% : 0.002070s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.34% : 0.000047s : 4: replace.inline 33.66% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 94.96% : 0.000147s : 4: match.inline 5.04% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000002s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.32% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.05% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.84% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.24% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.47% : 0.000001s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.14% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.68% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.003075 34 74.06% : 0.002277s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.01% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.93% : 0.000766s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.078271 72 0.06% : 0.000045s : 1: add_recomputation 0.07% : 0.000055s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.45% : 0.000352s : 1: bootstrap 0.03% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.44% : 0.007390s : 1: jit_opt_a 0.22% : 0.000170s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 1.79% : 0.001397s : 1: loop_unroll 0.83% : 0.000653s : 1: mutable_eliminate 1.16% : 0.000904s : 26: opt.transform.jit_opt_a 0.08% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.03% : 0.000020s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000110s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000518s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.54% : 0.000423s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 2.26% : 0.001771s : 1: renormalize.infer 1.11% : 0.000867s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.11% : 0.000086s : 1: rewriter_before_opt_a 0.20% : 0.000155s : 1: symbol_engine_optimizer 80.43% : 0.062955s : 1: type_inference TotalTime = 0.0645596, [30] [bootstrap]: 0.0002945 [type_inference]: 0.0546697 [event_method]: 2.031e-05 [auto_monad]: 6.514e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00032168 [rewriter_before_opt_a]: 8.386e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00674714, [2] [Cycle 1]: 0.00305937, [27] [switch_simplify]: 5.458e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.0005597 [with_stream_mark]: 1.466e-05 [recompute_prepare]: 8.98002e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 6.02001e-06 [accelerated_algorithm]: 7.02002e-06 [meta_shard_fg_expand]: 2.29001e-06 [get_grad_eliminate_]: 7.01001e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 9.39998e-06 [inline_without_move]: 6.36998e-06 [renormalize]: 0.00206211 [add_forward_monad_depend]: 5.77999e-06 [auto_monad_grad]: 2.60002e-06 [auto_monad_eliminator]: 1.485e-05 [cse]: 2.818e-05 [replace_applicator]: 1.462e-05 [Cycle 2]: 0.00035933, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00012316 [with_stream_mark]: 9.15999e-06 [recompute_prepare]: 5.91998e-06 [updatestate_depend_eliminate]: 2.85002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.18998e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 2.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.62001e-06 [cse]: 1.112e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 1.143e-05 [rewriter_after_opt_a]: 3.239e-05 [convert_after_rewriter]: 7.65e-06 [order_py_execute_after_rewriter]: 5.08002e-06 [mutable_eliminate]: 0.00059143 [jit_opt_b]: 5.54e-05, [1] [Cycle 1]: 4.866e-05, [2] [frontend_op_eliminate]: 1.986e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 2.625e-05 [loop_unroll]: 0.00045292 [jit_opt_after_cconv]: 0.00016559, [1] [Cycle 1]: 0.00015852, [11] [c_1]: 2.742e-05 [parameter_eliminate]: 3.66999e-06 [updatestate_depend_eliminate]: 7.5e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.91999e-06 [cse]: 2.523e-05 [call_graph_tuple_transform]: 2.266e-05 [tuple_list_get_item_eliminator]: 6.45002e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.90022e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.661e-05 [partial_unused_args_eliminate]: 2.71e-06 [environ_conv]: 8.84e-06 [add_recomputation]: 4.977e-05 [cse_after_recomputation]: 2.446e-05, [1] [Cycle 1]: 1.919e-05, [1] [cse]: 1.308e-05 [auto_monad_reorder]: 1.492e-05 [get_jit_bprop_graph]: 2.41e-06 [rewriter_after_jit_bprop_graph]: 5.39e-06 [opt_after_jit_grad]: 0.00048358 [symbol_engine_optimizer]: 7.569e-05, [1] [Cycle 1]: 6.973e-05, [6] [build]: 3.38e-06 [elim_shapecalc]: 8.71002e-06 [elim_not_effective]: 1.475e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 4.50003e-07 [validate]: 0.00011164 Sums bootstrap : 0.000295s : 0.49% type_inference : 0.054670s : 90.17% event_method : 0.000020s : 0.03% auto_monad : 0.000065s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000322s : 0.53% rewriter_before_opt_a : 0.000084s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000683s : 1.13% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002062s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000039s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000032s : 0.05% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000591s : 0.98% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000453s : 0.75% jit_opt_after_cconv.c_1 : 0.000027s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000484s : 0.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000112s : 0.18% Time group info: ------[substitution.] 0.000190 24 1.42% : 0.000003s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 3.18% : 0.000006s : 4: substitution.graph_param_transform 81.69% : 0.000155s : 4: substitution.inline 1.93% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.39% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000004s : 2: substitution.replace_old_param 6.75% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054595 2 96.32% : 0.052589s : 1: type_inference.infer 3.68% : 0.002007s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.27% : 0.000048s : 4: replace.inline 33.73% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 92.88% : 0.000153s : 4: match.inline 7.12% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.16% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.25% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.71% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.48% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.42% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.88% : 0.000009s : 58: predicate.switch_simplify 1.19% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002374 26 72.27% : 0.001716s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.13% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.60% : 0.000632s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067515 72 0.08% : 0.000053s : 1: add_recomputation 0.10% : 0.000069s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.45% : 0.000307s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.00% : 0.006750s : 1: jit_opt_a 0.25% : 0.000168s : 1: jit_opt_after_cconv 0.09% : 0.000058s : 1: jit_opt_b 0.68% : 0.000462s : 1: loop_unroll 0.89% : 0.000600s : 1: mutable_eliminate 1.35% : 0.000914s : 26: opt.transform.jit_opt_a 0.09% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.48% : 0.000327s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.04% : 0.001377s : 1: renormalize.infer 1.00% : 0.000677s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.12% : 0.000078s : 1: symbol_engine_optimizer 81.00% : 0.054685s : 1: type_inference TotalTime = 0.0649665, [30] [bootstrap]: 0.00029794 [type_inference]: 0.0543866 [event_method]: 2.126e-05 [auto_monad]: 6.632e-05 [graph_reusing]: 5.42999e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00036452 [rewriter_before_opt_a]: 9.373e-05 [expand_dump_flag]: 4.01001e-06 [jit_opt_a]: 0.00727296, [2] [Cycle 1]: 0.003275, [27] [switch_simplify]: 5.732e-05 [loop_unroll]: 3.113e-05 [a_1]: 0.00058838 [with_stream_mark]: 1.719e-05 [recompute_prepare]: 8.65001e-06 [updatestate_depend_eliminate]: 3.97998e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.28998e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.541e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.80002e-06 [inline_without_move]: 5.90002e-06 [renormalize]: 0.00222807 [add_forward_monad_depend]: 6.43998e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.577e-05 [cse]: 3.122e-05 [replace_applicator]: 1.751e-05 [Cycle 2]: 0.00038952, [27] [switch_simplify]: 7.28999e-06 [loop_unroll]: 5.81003e-06 [a_1]: 0.00013555 [with_stream_mark]: 1.117e-05 [recompute_prepare]: 6.49001e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 5.72001e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 2.95998e-06 [cell_reuse_recompute_pass]: 2.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.779e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.98998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.41998e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 6.17001e-06 [cse]: 1.116e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 1.114e-05 [rewriter_after_opt_a]: 3.509e-05 [convert_after_rewriter]: 8.00999e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00066674 [jit_opt_b]: 5.633e-05, [1] [Cycle 1]: 4.922e-05, [2] [frontend_op_eliminate]: 1.949e-05 [inline_after_opt_a]: 1.911e-05 [cconv]: 2.329e-05 [loop_unroll]: 0.00044794 [jit_opt_after_cconv]: 0.0001572, [1] [Cycle 1]: 0.00015059, [11] [c_1]: 2.693e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 6.04001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.26e-06 [cse]: 2.557e-05 [call_graph_tuple_transform]: 2.074e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.40999e-06 [renormalize]: 2.19996e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.692e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 8.53001e-06 [add_recomputation]: 4.958e-05 [cse_after_recomputation]: 2.236e-05, [1] [Cycle 1]: 1.659e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.517e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.00048478 [symbol_engine_optimizer]: 7.954e-05, [1] [Cycle 1]: 7.355e-05, [6] [build]: 3.65e-06 [elim_shapecalc]: 9.10999e-06 [elim_not_effective]: 1.374e-05 [opt_reshape]: 6.21e-06 [fold_const_symbol]: 1.289e-05 [renormalize]: 2.30008e-07 [validate]: 0.00016901 Sums bootstrap : 0.000298s : 0.49% type_inference : 0.054387s : 89.51% event_method : 0.000021s : 0.03% auto_monad : 0.000066s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000365s : 0.60% rewriter_before_opt_a : 0.000094s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000065s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000724s : 1.19% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002228s : 3.67% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000667s : 1.10% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000448s : 0.74% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000485s : 0.80% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000169s : 0.28% Time group info: ------[substitution.] 0.000217 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 2.06% : 0.000004s : 2: substitution.fold_const_symbol 2.64% : 0.000006s : 4: substitution.graph_param_transform 81.21% : 0.000176s : 4: substitution.inline 1.99% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.78% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000005s : 2: substitution.replace_old_param 5.92% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054306 2 96.30% : 0.052297s : 1: type_inference.infer 3.70% : 0.002008s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.37% : 0.000052s : 4: replace.inline 32.63% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 93.69% : 0.000173s : 4: match.inline 6.31% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.62% : 0.000008s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.06% : 0.000003s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.42% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.60% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 1.93% : 0.000003s : 22: predicate.replace_applicator 0.57% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.23% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.83% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.01% : 0.000003s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002278 26 70.57% : 0.001608s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.45% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.98% : 0.000637s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068108 72 0.08% : 0.000052s : 1: add_recomputation 0.10% : 0.000070s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.46% : 0.000314s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.68% : 0.007276s : 1: jit_opt_a 0.23% : 0.000160s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.67% : 0.000457s : 1: loop_unroll 0.99% : 0.000676s : 1: mutable_eliminate 1.42% : 0.000965s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.55% : 0.000371s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.19% : 0.001492s : 1: renormalize.infer 1.07% : 0.000727s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.15% : 0.000099s : 1: rewriter_before_opt_a 0.12% : 0.000082s : 1: symbol_engine_optimizer 79.88% : 0.054404s : 1: type_inference TotalTime = 0.0633235, [30] [bootstrap]: 0.00028512 [type_inference]: 0.053496 [event_method]: 1.818e-05 [auto_monad]: 5.649e-05 [graph_reusing]: 5.05999e-06 [pre_auto_parallel]: 1.70001e-06 [py_interpret_to_execute]: 0.0003139 [rewriter_before_opt_a]: 8.091e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.00674852, [2] [Cycle 1]: 0.00308812, [27] [switch_simplify]: 5.052e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00055081 [with_stream_mark]: 1.679e-05 [recompute_prepare]: 8.80999e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.78002e-06 [specialize_transform]: 7.00998e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 7.15e-06 [meta_shard_fg_expand]: 2.52001e-06 [get_grad_eliminate_]: 6.63998e-06 [merge_forward]: 3.27002e-06 [cell_reuse_recompute_pass]: 1.19003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.385e-05 [j_node_and_user_rematch]: 1.121e-05 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 6.38e-06 [renormalize]: 0.00204197 [add_forward_monad_depend]: 6.98998e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.708e-05 [cse]: 2.68e-05 [replace_applicator]: 1.786e-05 [Cycle 2]: 0.00037985, [27] [switch_simplify]: 8.01001e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00013662 [with_stream_mark]: 1.01e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.32e-06 [specialize_transform]: 5.60001e-06 [updatestate_useless_node_eliminater]: 5.67001e-06 [accelerated_algorithm]: 5.78997e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 2.41998e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 9.40001e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.01003e-06 [cse]: 1.103e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 1.038e-05 [rewriter_after_opt_a]: 3.53e-05 [convert_after_rewriter]: 7.20003e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00060016 [jit_opt_b]: 5.772e-05, [1] [Cycle 1]: 4.997e-05, [2] [frontend_op_eliminate]: 1.986e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.324e-05 [loop_unroll]: 0.00048905 [jit_opt_after_cconv]: 0.00015659, [1] [Cycle 1]: 0.00014858, [11] [c_1]: 2.669e-05 [parameter_eliminate]: 3.21999e-06 [updatestate_depend_eliminate]: 6.55997e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 2.173e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 6.33002e-06 [none_parameter_eliminate]: 2.15002e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 6.00002e-06 [remove_dup_value]: 1.587e-05 [partial_unused_args_eliminate]: 1.94e-06 [environ_conv]: 8.89e-06 [add_recomputation]: 4.416e-05 [cse_after_recomputation]: 2.145e-05, [1] [Cycle 1]: 1.589e-05, [1] [cse]: 9.85002e-06 [auto_monad_reorder]: 1.437e-05 [get_jit_bprop_graph]: 1.41998e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00052829 [symbol_engine_optimizer]: 7.453e-05, [1] [Cycle 1]: 6.866e-05, [6] [build]: 3.55e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.347e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 3.89991e-07 [validate]: 4.252e-05 Sums bootstrap : 0.000285s : 0.48% type_inference : 0.053496s : 90.05% event_method : 0.000018s : 0.03% auto_monad : 0.000056s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000314s : 0.53% rewriter_before_opt_a : 0.000081s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000687s : 1.16% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002042s : 3.44% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000038s : 0.06% jit_opt_a.replace_applicator : 0.000024s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000600s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000489s : 0.82% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000044s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000528s : 0.89% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000190 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000006s : 4: substitution.graph_param_transform 82.93% : 0.000158s : 4: substitution.inline 2.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 5.85% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053377 2 96.54% : 0.051529s : 1: type_inference.infer 3.46% : 0.001848s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.16% : 0.000046s : 4: replace.inline 33.84% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.91% : 0.000155s : 4: match.inline 6.09% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.11% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.71% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.22% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.11% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.88% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.58% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 1.92% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 2.33% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.73% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.29% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002277 26 70.12% : 0.001597s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.41% : 0.000647s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066365 72 0.07% : 0.000047s : 1: add_recomputation 0.09% : 0.000060s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.45% : 0.000298s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.17% : 0.006752s : 1: jit_opt_a 0.24% : 0.000159s : 1: jit_opt_after_cconv 0.09% : 0.000061s : 1: jit_opt_b 0.75% : 0.000499s : 1: loop_unroll 0.92% : 0.000611s : 1: mutable_eliminate 1.39% : 0.000919s : 26: opt.transform.jit_opt_a 0.09% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000537s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000319s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.97% : 0.001308s : 1: renormalize.infer 1.09% : 0.000724s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.12% : 0.000077s : 1: symbol_engine_optimizer 80.63% : 0.053510s : 1: type_inference TotalTime = 0.117269, [30] [bootstrap]: 0.00026058 [type_inference]: 0.106513 [event_method]: 1.831e-05 [auto_monad]: 6.132e-05 [graph_reusing]: 5.47001e-06 [pre_auto_parallel]: 1.87001e-06 [py_interpret_to_execute]: 0.00060054 [rewriter_before_opt_a]: 0.00015842 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.00742496, [2] [Cycle 1]: 0.00359719, [27] [switch_simplify]: 5.155e-05 [loop_unroll]: 3.017e-05 [a_1]: 0.00058318 [with_stream_mark]: 1.46e-05 [recompute_prepare]: 8.71002e-06 [updatestate_depend_eliminate]: 3.46001e-06 [updatestate_assign_eliminate]: 2.93e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 6.59999e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 7.99977e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.24e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 6.19999e-06 [renormalize]: 0.0025805 [add_forward_monad_depend]: 5.30001e-06 [auto_monad_grad]: 1.38002e-06 [auto_monad_eliminator]: 1.578e-05 [cse]: 2.61e-05 [replace_applicator]: 1.689e-05 [Cycle 2]: 0.00037047, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 6.09001e-06 [a_1]: 0.00012438 [with_stream_mark]: 1.118e-05 [recompute_prepare]: 5.98998e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.55997e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.50001e-06 [get_grad_eliminate_]: 5.53002e-06 [merge_forward]: 2.96001e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 9.75002e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.34e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.05999e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 6.74001e-06 [cse]: 1.213e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 9.86e-06 [rewriter_after_opt_a]: 3.103e-05 [convert_after_rewriter]: 6.36998e-06 [order_py_execute_after_rewriter]: 1.92e-05 [mutable_eliminate]: 0.00061367 [jit_opt_b]: 5.567e-05, [1] [Cycle 1]: 4.889e-05, [2] [frontend_op_eliminate]: 1.879e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 2.395e-05 [loop_unroll]: 0.00043839 [jit_opt_after_cconv]: 0.00015371, [1] [Cycle 1]: 0.00014736, [11] [c_1]: 2.579e-05 [parameter_eliminate]: 2.66999e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 2.398e-05 [call_graph_tuple_transform]: 2.108e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.93e-06 [remove_dup_value]: 1.321e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 4.488e-05 [cse_after_recomputation]: 2.208e-05, [1] [Cycle 1]: 1.677e-05, [1] [cse]: 1.106e-05 [auto_monad_reorder]: 1.202e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 5.82999e-06 [opt_after_jit_grad]: 0.00047071 [symbol_engine_optimizer]: 7.75e-05, [1] [Cycle 1]: 7.141e-05, [6] [build]: 2.97002e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 7.38999e-06 [fold_const_symbol]: 1.062e-05 [renormalize]: 3.4002e-07 [validate]: 3.759e-05 Sums bootstrap : 0.000261s : 0.23% type_inference : 0.106513s : 94.07% event_method : 0.000018s : 0.02% auto_monad : 0.000061s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000601s : 0.53% rewriter_before_opt_a : 0.000158s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000708s : 0.62% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002581s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000019s : 0.02% mutable_eliminate : 0.000614s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000438s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000471s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.03% Time group info: ------[substitution.] 0.000210 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 1.26% : 0.000003s : 2: substitution.fold_const_symbol 2.56% : 0.000005s : 4: substitution.graph_param_transform 83.73% : 0.000176s : 4: substitution.inline 2.07% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 5.31% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106433 2 97.37% : 0.103639s : 1: type_inference.infer 2.63% : 0.002794s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.64% : 0.000052s : 4: replace.inline 32.36% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000183 6 94.57% : 0.000173s : 4: match.inline 5.43% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.22% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.28% : 0.000002s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.02% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.34% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 2.07% : 0.000003s : 12: predicate.reduce_eliminate 1.57% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.08% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 58: predicate.switch_simplify 1.10% : 0.000001s : 12: predicate.tile_eliminate 1.36% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002092 22 66.06% : 0.001382s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.11% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.83% : 0.000666s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120873 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000064s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.23% : 0.000272s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.15% : 0.007429s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000447s : 1: loop_unroll 0.52% : 0.000623s : 1: mutable_eliminate 0.78% : 0.000938s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000479s : 1: opt_after_jit_grad 0.02% : 0.000022s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000609s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.56% : 0.001891s : 1: renormalize.infer 0.56% : 0.000681s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.14% : 0.000166s : 1: rewriter_before_opt_a 0.07% : 0.000080s : 1: symbol_engine_optimizer 88.13% : 0.106530s : 1: type_inference TotalTime = 0.121475, [30] [bootstrap]: 0.00029094 [type_inference]: 0.110623 [event_method]: 1.694e-05 [auto_monad]: 5.318e-05 [graph_reusing]: 4.87e-06 [pre_auto_parallel]: 2.02999e-06 [py_interpret_to_execute]: 0.00050796 [rewriter_before_opt_a]: 8.616e-05 [expand_dump_flag]: 3.82998e-06 [jit_opt_a]: 0.00756487, [2] [Cycle 1]: 0.00365093, [27] [switch_simplify]: 5.041e-05 [loop_unroll]: 3.003e-05 [a_1]: 0.00056033 [with_stream_mark]: 1.576e-05 [recompute_prepare]: 8.37998e-06 [updatestate_depend_eliminate]: 3.42997e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.82002e-06 [updatestate_useless_node_eliminater]: 5.89999e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 6.14999e-06 [renormalize]: 0.00265705 [add_forward_monad_depend]: 6.81999e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.658e-05 [cse]: 2.996e-05 [replace_applicator]: 1.909e-05 [Cycle 2]: 0.00037668, [27] [switch_simplify]: 7.08998e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.0001247 [with_stream_mark]: 1.101e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.41e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.95001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.608e-05 [j_node_and_user_rematch]: 9.36002e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 1.001e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 7.86001e-06 [cse]: 1.226e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 1.349e-05 [rewriter_after_opt_a]: 3.644e-05 [convert_after_rewriter]: 7.29001e-06 [order_py_execute_after_rewriter]: 6.46999e-06 [mutable_eliminate]: 0.00063526 [jit_opt_b]: 5.871e-05, [1] [Cycle 1]: 5.117e-05, [2] [frontend_op_eliminate]: 2.009e-05 [inline_after_opt_a]: 1.984e-05 [cconv]: 2.74e-05 [loop_unroll]: 0.00044196 [jit_opt_after_cconv]: 0.00015538, [1] [Cycle 1]: 0.00014913, [11] [c_1]: 2.689e-05 [parameter_eliminate]: 2.75002e-06 [updatestate_depend_eliminate]: 6.14999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.259e-05 [call_graph_tuple_transform]: 2.106e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.94e-06 [renormalize]: 5.60016e-07 [switch_simplify]: 6.83e-06 [remove_dup_value]: 1.463e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.72e-06 [add_recomputation]: 5.107e-05 [cse_after_recomputation]: 2.28e-05, [1] [Cycle 1]: 1.762e-05, [1] [cse]: 1.179e-05 [auto_monad_reorder]: 1.499e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.85002e-06 [opt_after_jit_grad]: 0.00050517 [symbol_engine_optimizer]: 7.29e-05, [1] [Cycle 1]: 6.668e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 1.177e-05 [opt_reshape]: 6.99001e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 2.69996e-07 [validate]: 5.918e-05 Sums bootstrap : 0.000291s : 0.25% type_inference : 0.110623s : 94.26% event_method : 0.000017s : 0.01% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000508s : 0.43% rewriter_before_opt_a : 0.000086s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000685s : 0.58% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002657s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000635s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000442s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000505s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.05% Time group info: ------[substitution.] 0.000200 24 0.69% : 0.000001s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 4: substitution.graph_param_transform 83.91% : 0.000167s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000005s : 2: substitution.replace_old_param 5.44% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110555 2 97.65% : 0.107959s : 1: type_inference.infer 2.35% : 0.002596s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.10% : 0.000045s : 4: replace.inline 32.90% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 94.46% : 0.000165s : 4: match.inline 5.54% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.02% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.10% : 0.000001s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.87% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.76% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 2.05% : 0.000003s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 2.29% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.31% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.84% : 0.000009s : 58: predicate.switch_simplify 1.43% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002174 22 63.85% : 0.001388s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.82% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.33% : 0.000746s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125105 72 0.04% : 0.000054s : 1: add_recomputation 0.04% : 0.000056s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000309s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.05% : 0.007569s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.36% : 0.000451s : 1: loop_unroll 0.52% : 0.000647s : 1: mutable_eliminate 0.73% : 0.000917s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000514s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000515s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.47% : 0.001843s : 1: renormalize.infer 0.64% : 0.000804s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.43% : 0.110635s : 1: type_inference TotalTime = 0.0128151, [30] [bootstrap]: 0.00026757 [type_inference]: 0.00454798 [event_method]: 1.76e-05 [auto_monad]: 6.233e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 1.94e-06 [py_interpret_to_execute]: 3.661e-05 [rewriter_before_opt_a]: 7.102e-05 [expand_dump_flag]: 2.78003e-06 [jit_opt_a]: 0.00572831, [2] [Cycle 1]: 0.00190791, [27] [switch_simplify]: 5.369e-05 [loop_unroll]: 3.016e-05 [a_1]: 0.00053093 [with_stream_mark]: 1.788e-05 [recompute_prepare]: 7.45998e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.52001e-06 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 5.12999e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 4.42e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 8.15999e-06 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 8.10999e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 0.00095751 [add_forward_monad_depend]: 6.43e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 2.569e-05 [replace_applicator]: 1.32e-05 [Cycle 2]: 0.00032189, [27] [switch_simplify]: 5.76003e-06 [loop_unroll]: 5.05001e-06 [a_1]: 9.155e-05 [with_stream_mark]: 9.72999e-06 [recompute_prepare]: 4.99e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.15001e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 2.83998e-06 [cell_reuse_recompute_pass]: 1.94e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.40999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 7.27002e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.36998e-06 [cse]: 1.056e-05 [replace_applicator]: 4.89003e-06 [py_interpret_to_execute_after_opt_a]: 1.078e-05 [rewriter_after_opt_a]: 3.376e-05 [convert_after_rewriter]: 6.99001e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00052145 [jit_opt_b]: 4.955e-05, [1] [Cycle 1]: 4.208e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.492e-05 [cconv]: 2.478e-05 [loop_unroll]: 0.00041386 [jit_opt_after_cconv]: 0.00015539, [1] [Cycle 1]: 0.00014917, [11] [c_1]: 2.035e-05 [parameter_eliminate]: 2.59999e-06 [updatestate_depend_eliminate]: 7.16999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [cse]: 2.086e-05 [call_graph_tuple_transform]: 1.885e-05 [tuple_list_get_item_eliminator]: 5.00001e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 1.698e-05 [remove_dup_value]: 1.328e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 6.20002e-06 [add_recomputation]: 4.82e-05 [cse_after_recomputation]: 2.213e-05, [1] [Cycle 1]: 1.677e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.459e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 5.12999e-06 [opt_after_jit_grad]: 0.00047888 [symbol_engine_optimizer]: 7.142e-05, [1] [Cycle 1]: 6.528e-05, [6] [build]: 3.49001e-06 [elim_shapecalc]: 7.87e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.25e-06 [renormalize]: 3.30008e-07 [validate]: 3.601e-05 Sums bootstrap : 0.000268s : 3.05% type_inference : 0.004548s : 51.87% event_method : 0.000018s : 0.20% auto_monad : 0.000062s : 0.71% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.42% rewriter_before_opt_a : 0.000071s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000622s : 7.10% jit_opt_a.with_stream_mark : 0.000028s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000958s : 10.92% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000036s : 0.41% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000034s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000521s : 5.95% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000025s : 0.28% loop_unroll : 0.000414s : 4.72% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000017s : 0.19% remove_dup_value : 0.000013s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000048s : 0.55% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000479s : 5.46% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.41% Time group info: ------[substitution.] 0.000206 23 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 3: substitution.graph_param_transform 83.96% : 0.000173s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 1.80% : 0.000004s : 2: substitution.replace_old_param 5.87% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004491 2 81.93% : 0.003679s : 1: type_inference.infer 18.07% : 0.000811s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.00% : 0.000043s : 4: replace.inline 33.00% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 94.02% : 0.000170s : 4: match.inline 5.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.02% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.05% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 6.33% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.45% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.31% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.47% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.51% : 0.000002s : 10: predicate.reduce_eliminate 1.68% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.11% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.21% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.40% : 0.000002s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.83% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000631 13 51.75% : 0.000326s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.37% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.88% : 0.000264s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014675 72 0.35% : 0.000051s : 1: add_recomputation 0.45% : 0.000065s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 1.91% : 0.000280s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 39.06% : 0.005732s : 1: jit_opt_a 1.08% : 0.000158s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.87% : 0.000421s : 1: loop_unroll 3.61% : 0.000530s : 1: mutable_eliminate 5.67% : 0.000832s : 26: opt.transform.jit_opt_a 0.40% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000487s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000016s : 1: remove_dup_value 2.52% : 0.000370s : 1: renormalize.infer 3.95% : 0.000579s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000037s : 1: rewriter_after_opt_a 0.50% : 0.000074s : 1: rewriter_before_opt_a 0.50% : 0.000074s : 1: symbol_engine_optimizer 31.05% : 0.004557s : 1: type_inference TotalTime = 0.116819, [30] [bootstrap]: 0.00026395 [type_inference]: 0.106951 [event_method]: 1.656e-05 [auto_monad]: 5.299e-05 [graph_reusing]: 3.93001e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 0.00047895 [rewriter_before_opt_a]: 7.621e-05 [expand_dump_flag]: 2.53e-06 [jit_opt_a]: 0.00683696, [2] [Cycle 1]: 0.00329755, [27] [switch_simplify]: 5.11e-05 [loop_unroll]: 3.381e-05 [a_1]: 0.00054059 [with_stream_mark]: 1.221e-05 [recompute_prepare]: 9.32999e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 7.30998e-06 [updatestate_useless_node_eliminater]: 6.36998e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 6.24001e-06 [merge_forward]: 2.59001e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.193e-05 [j_node_and_user_rematch]: 1.038e-05 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.61e-06 [renormalize]: 0.00235227 [add_forward_monad_depend]: 4.80001e-06 [auto_monad_grad]: 1.36002e-06 [auto_monad_eliminator]: 1.14e-05 [cse]: 1.958e-05 [replace_applicator]: 1.402e-05 [Cycle 2]: 0.00036074, [27] [switch_simplify]: 7e-06 [loop_unroll]: 5.99999e-06 [a_1]: 0.00012464 [with_stream_mark]: 8.90999e-06 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 3.07002e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.13002e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.90001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.326e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 8.62e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.116e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 9.42001e-06 [rewriter_after_opt_a]: 2.743e-05 [convert_after_rewriter]: 6.16998e-06 [order_py_execute_after_rewriter]: 4.92e-06 [mutable_eliminate]: 0.00054153 [jit_opt_b]: 5.581e-05, [1] [Cycle 1]: 4.859e-05, [2] [frontend_op_eliminate]: 2.099e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 1.721e-05 [loop_unroll]: 0.00042087 [jit_opt_after_cconv]: 0.00014867, [1] [Cycle 1]: 0.0001426, [11] [c_1]: 2.634e-05 [parameter_eliminate]: 1.99e-06 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 1.992e-05 [call_graph_tuple_transform]: 1.966e-05 [tuple_list_get_item_eliminator]: 6.31998e-06 [none_parameter_eliminate]: 9.5999e-07 [renormalize]: 4.10015e-07 [switch_simplify]: 6.17001e-06 [remove_dup_value]: 1.072e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 6.22001e-06 [add_recomputation]: 3.83e-05 [cse_after_recomputation]: 2.166e-05, [1] [Cycle 1]: 1.622e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.112e-05 [get_jit_bprop_graph]: 1.27999e-06 [rewriter_after_jit_bprop_graph]: 4.13001e-06 [opt_after_jit_grad]: 0.00054072 [symbol_engine_optimizer]: 7.665e-05, [1] [Cycle 1]: 7.047e-05, [6] [build]: 2.43e-06 [elim_shapecalc]: 9.90002e-06 [elim_not_effective]: 1.342e-05 [opt_reshape]: 6.65002e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 4.89992e-07 [validate]: 3.087e-05 Sums bootstrap : 0.000264s : 0.23% type_inference : 0.106951s : 94.57% event_method : 0.000017s : 0.01% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000479s : 0.42% rewriter_before_opt_a : 0.000076s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000040s : 0.04% jit_opt_a.a_1 : 0.000665s : 0.59% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002352s : 2.08% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000027s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000542s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000421s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000038s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000541s : 0.48% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.03% Time group info: ------[substitution.] 0.000166 24 0.77% : 0.000001s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 3.58% : 0.000006s : 4: substitution.graph_param_transform 82.90% : 0.000138s : 4: substitution.inline 1.73% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000004s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 5.30% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106890 2 97.52% : 0.104237s : 1: type_inference.infer 2.48% : 0.002653s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.30% : 0.000045s : 4: replace.inline 33.70% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 94.64% : 0.000135s : 4: match.inline 5.36% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 2.24% : 0.000003s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.07% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.33% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 18: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.61% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.64% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.23% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.21% : 0.000010s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001939 22 66.33% : 0.001286s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.27% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.40% : 0.000628s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120236 72 0.03% : 0.000041s : 1: add_recomputation 0.05% : 0.000056s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.23% : 0.000276s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.69% : 0.006840s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000428s : 1: loop_unroll 0.46% : 0.000550s : 1: mutable_eliminate 0.75% : 0.000896s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.09% : 0.000102s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000550s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000484s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.40% : 0.001689s : 1: renormalize.infer 0.55% : 0.000657s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000030s : 1: rewriter_after_opt_a 0.07% : 0.000081s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.96% : 0.106963s : 1: type_inference TotalTime = 0.0609379, [30] [bootstrap]: 0.00025127 [type_inference]: 0.0518764 [event_method]: 1.73e-05 [auto_monad]: 5.233e-05 [graph_reusing]: 5.10001e-06 [pre_auto_parallel]: 1.86998e-06 [py_interpret_to_execute]: 0.00026274 [rewriter_before_opt_a]: 7.569e-05 [expand_dump_flag]: 2.65002e-06 [jit_opt_a]: 0.00629222, [2] [Cycle 1]: 0.00280234, [27] [switch_simplify]: 4.908e-05 [loop_unroll]: 3.059e-05 [a_1]: 0.00052874 [with_stream_mark]: 1.195e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.40999e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.04999e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.238e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 6.40002e-06 [renormalize]: 0.00188036 [add_forward_monad_depend]: 5.27001e-06 [auto_monad_grad]: 1.37999e-06 [auto_monad_eliminator]: 1.288e-05 [cse]: 2.153e-05 [replace_applicator]: 1.34e-05 [Cycle 2]: 0.00035066, [27] [switch_simplify]: 6.30002e-06 [loop_unroll]: 5.73997e-06 [a_1]: 0.00011987 [with_stream_mark]: 8.85999e-06 [recompute_prepare]: 5.82999e-06 [updatestate_depend_eliminate]: 2.58998e-06 [updatestate_assign_eliminate]: 2.01003e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.317e-05 [j_node_and_user_rematch]: 8.55999e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.2e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.61998e-06 [cse]: 9.96e-06 [replace_applicator]: 5.68002e-06 [py_interpret_to_execute_after_opt_a]: 8.96002e-06 [rewriter_after_opt_a]: 2.982e-05 [convert_after_rewriter]: 5.74999e-06 [order_py_execute_after_rewriter]: 4.59998e-06 [mutable_eliminate]: 0.00051651 [jit_opt_b]: 5.201e-05, [1] [Cycle 1]: 4.625e-05, [2] [frontend_op_eliminate]: 1.821e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.032e-05 [loop_unroll]: 0.00043395 [jit_opt_after_cconv]: 0.00014381, [1] [Cycle 1]: 0.0001369, [11] [c_1]: 2.665e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.13002e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.725e-05 [call_graph_tuple_transform]: 1.877e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.18001e-06 [renormalize]: 2.89991e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 1.038e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 7.13998e-06 [add_recomputation]: 3.495e-05 [cse_after_recomputation]: 2.176e-05, [1] [Cycle 1]: 1.639e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.161e-05 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 4.26001e-06 [opt_after_jit_grad]: 0.00048329 [symbol_engine_optimizer]: 7.334e-05, [1] [Cycle 1]: 6.755e-05, [6] [build]: 2.82002e-06 [elim_shapecalc]: 8.60001e-06 [elim_not_effective]: 1.313e-05 [opt_reshape]: 6.27001e-06 [fold_const_symbol]: 9.00999e-06 [renormalize]: 3.19997e-07 [validate]: 8.189e-05 Sums bootstrap : 0.000251s : 0.44% type_inference : 0.051876s : 90.59% event_method : 0.000017s : 0.03% auto_monad : 0.000052s : 0.09% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000263s : 0.46% rewriter_before_opt_a : 0.000076s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000649s : 1.13% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001880s : 3.28% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000031s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000030s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000517s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000020s : 0.04% loop_unroll : 0.000434s : 0.76% jit_opt_after_cconv.c_1 : 0.000027s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000017s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000483s : 0.84% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000082s : 0.14% Time group info: ------[substitution.] 0.000172 24 0.77% : 0.000001s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000005s : 4: substitution.graph_param_transform 84.62% : 0.000146s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.54% : 0.000004s : 4: substitution.remove_not_recompute_node 1.86% : 0.000003s : 2: substitution.replace_old_param 5.16% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051810 2 96.33% : 0.049911s : 1: type_inference.infer 3.67% : 0.001899s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.56% : 0.000043s : 4: replace.inline 33.44% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 94.90% : 0.000143s : 4: match.inline 5.10% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.84% : 0.000002s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.15% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.39% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.54% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.42% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.98% : 0.000009s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002082 26 71.71% : 0.001493s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.52% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.77% : 0.000557s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063717 72 0.06% : 0.000038s : 1: add_recomputation 0.09% : 0.000056s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.41% : 0.000263s : 1: bootstrap 0.04% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.88% : 0.006296s : 1: jit_opt_a 0.23% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.69% : 0.000443s : 1: loop_unroll 0.82% : 0.000524s : 1: mutable_eliminate 1.36% : 0.000867s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000490s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000268s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 1.98% : 0.001261s : 1: renormalize.infer 0.96% : 0.000611s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.12% : 0.000079s : 1: rewriter_before_opt_a 0.12% : 0.000076s : 1: symbol_engine_optimizer 81.44% : 0.051888s : 1: type_inference TotalTime = 0.0113321, [30] [bootstrap]: 0.00026146 [type_inference]: 0.00415571 [event_method]: 1.544e-05 [auto_monad]: 4.582e-05 [graph_reusing]: 3.78999e-06 [pre_auto_parallel]: 1.59998e-06 [py_interpret_to_execute]: 3.295e-05 [rewriter_before_opt_a]: 6.431e-05 [expand_dump_flag]: 1.65001e-06 [jit_opt_a]: 0.00482338, [2] [Cycle 1]: 0.00144944, [27] [switch_simplify]: 4.558e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.00047897 [with_stream_mark]: 1.194e-05 [recompute_prepare]: 7.08998e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.117e-05 [j_node_and_user_rematch]: 8.80999e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00060146 [add_forward_monad_depend]: 4.28999e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 9.95002e-06 [cse]: 1.766e-05 [replace_applicator]: 1.213e-05 [Cycle 2]: 0.00031856, [27] [switch_simplify]: 6.07001e-06 [loop_unroll]: 4.90999e-06 [a_1]: 9.187e-05 [with_stream_mark]: 8.23999e-06 [recompute_prepare]: 5.07999e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.04e-06 [updatestate_useless_node_eliminater]: 4.84998e-06 [accelerated_algorithm]: 4.79998e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.56002e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 7.93999e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.46999e-06 [inline_without_move]: 4.91002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.49978e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.089e-05 [replace_applicator]: 5.12e-06 [py_interpret_to_execute_after_opt_a]: 8.52e-06 [rewriter_after_opt_a]: 2.437e-05 [convert_after_rewriter]: 5.89e-06 [order_py_execute_after_rewriter]: 3.94002e-06 [mutable_eliminate]: 0.00048248 [jit_opt_b]: 4.747e-05, [1] [Cycle 1]: 4.151e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.518e-05 [cconv]: 1.623e-05 [loop_unroll]: 0.00041422 [jit_opt_after_cconv]: 0.00013325, [1] [Cycle 1]: 0.00012748, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.747e-05 [call_graph_tuple_transform]: 1.679e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 9.10019e-07 [renormalize]: 2.69996e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 8.48999e-06 [partial_unused_args_eliminate]: 1.81e-06 [environ_conv]: 4.07003e-06 [add_recomputation]: 3.262e-05 [cse_after_recomputation]: 2.19e-05, [1] [Cycle 1]: 1.673e-05, [1] [cse]: 1.077e-05 [auto_monad_reorder]: 9.69999e-06 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 4.03999e-06 [opt_after_jit_grad]: 0.0004546 [symbol_engine_optimizer]: 7.025e-05, [1] [Cycle 1]: 6.431e-05, [6] [build]: 2.71999e-06 [elim_shapecalc]: 7.81001e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.72999e-06 [fold_const_symbol]: 8.37998e-06 [renormalize]: 3.00002e-07 [validate]: 2.696e-05 Sums bootstrap : 0.000261s : 3.38% type_inference : 0.004156s : 53.69% event_method : 0.000015s : 0.20% auto_monad : 0.000046s : 0.59% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000033s : 0.43% rewriter_before_opt_a : 0.000064s : 0.83% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000052s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000571s : 7.38% jit_opt_a.with_stream_mark : 0.000020s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000602s : 7.77% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000015s : 0.20% jit_opt_a.cse : 0.000029s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.22% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000024s : 0.31% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000482s : 6.23% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000016s : 0.21% loop_unroll : 0.000414s : 5.35% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000033s : 0.42% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000455s : 5.87% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.35% Time group info: ------[substitution.] 0.000153 23 0.93% : 0.000001s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000004s : 3: substitution.graph_param_transform 83.92% : 0.000129s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.83% : 0.000004s : 4: substitution.remove_not_recompute_node 2.32% : 0.000004s : 2: substitution.replace_old_param 5.23% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004111 2 81.82% : 0.003363s : 1: type_inference.infer 18.18% : 0.000747s : 1: type_inference.specialize ------[replace.] 0.000063 6 65.82% : 0.000041s : 4: replace.inline 34.18% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000133 6 94.85% : 0.000126s : 4: match.inline 5.15% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.14% : 0.000001s : 10: predicate.accumulaten_eliminater 1.38% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.35% : 0.000002s : 10: predicate.cast_eliminate 0.71% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.75% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.99% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.26% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 6: predicate.less_batch_normalization 1.48% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.36% : 0.000002s : 3: predicate.mutable_eliminate 0.67% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000002s : 15: predicate.partial_eliminate 1.09% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.65% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 2.09% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.89% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 16: predicate.switch_defer_inline 2.00% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 53: predicate.switch_simplify 1.51% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.23% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000550 13 48.94% : 0.000269s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.76% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.30% : 0.000255s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012763 72 0.28% : 0.000035s : 1: add_recomputation 0.38% : 0.000049s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 2.13% : 0.000272s : 1: bootstrap 0.15% : 0.000019s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.81% : 0.004826s : 1: jit_opt_a 1.06% : 0.000136s : 1: jit_opt_after_cconv 0.39% : 0.000050s : 1: jit_opt_b 3.30% : 0.000421s : 1: loop_unroll 3.83% : 0.000489s : 1: mutable_eliminate 6.04% : 0.000771s : 26: opt.transform.jit_opt_a 0.35% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.63% : 0.000463s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.28% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000011s : 1: remove_dup_value 2.38% : 0.000304s : 1: renormalize.infer 2.29% : 0.000292s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000027s : 1: rewriter_after_opt_a 0.53% : 0.000067s : 1: rewriter_before_opt_a 0.57% : 0.000073s : 1: symbol_engine_optimizer 32.64% : 0.004166s : 1: type_inference TotalTime = 0.111737, [30] [bootstrap]: 0.00025287 [type_inference]: 0.101776 [event_method]: 1.904e-05 [auto_monad]: 6.076e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 0.00042847 [rewriter_before_opt_a]: 8.09e-05 [expand_dump_flag]: 3.29001e-06 [jit_opt_a]: 0.00689586, [2] [Cycle 1]: 0.00338278, [27] [switch_simplify]: 5.111e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00054076 [with_stream_mark]: 1.336e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 5.75001e-06 [accelerated_algorithm]: 6.48998e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.0024092 [add_forward_monad_depend]: 5.88002e-06 [auto_monad_grad]: 2.21e-06 [auto_monad_eliminator]: 1.689e-05 [cse]: 3.175e-05 [replace_applicator]: 1.662e-05 [Cycle 2]: 0.00037438, [27] [switch_simplify]: 6.81001e-06 [loop_unroll]: 5.91003e-06 [a_1]: 0.00012203 [with_stream_mark]: 1.239e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.83002e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 2.61e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.80002e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.25e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 2.499e-05 [rewriter_after_opt_a]: 3.674e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 5.35999e-06 [mutable_eliminate]: 0.00058451 [jit_opt_b]: 5.574e-05, [1] [Cycle 1]: 4.887e-05, [2] [frontend_op_eliminate]: 2.017e-05 [inline_after_opt_a]: 1.697e-05 [cconv]: 2.242e-05 [loop_unroll]: 0.00041707 [jit_opt_after_cconv]: 0.00014852, [1] [Cycle 1]: 0.00014191, [11] [c_1]: 2.497e-05 [parameter_eliminate]: 2.14e-06 [updatestate_depend_eliminate]: 4.28001e-06 [updatestate_assign_eliminate]: 2.26003e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 2.249e-05 [call_graph_tuple_transform]: 2.028e-05 [tuple_list_get_item_eliminator]: 6.39999e-06 [none_parameter_eliminate]: 1.29e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.34001e-06 [remove_dup_value]: 1.413e-05 [partial_unused_args_eliminate]: 2.28998e-06 [environ_conv]: 7.82998e-06 [add_recomputation]: 4.929e-05 [cse_after_recomputation]: 2.117e-05, [1] [Cycle 1]: 1.595e-05, [1] [cse]: 1.035e-05 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 5.81998e-06 [opt_after_jit_grad]: 0.00044907 [symbol_engine_optimizer]: 7.208e-05, [1] [Cycle 1]: 6.669e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.301e-05 [opt_reshape]: 6.56e-06 [fold_const_symbol]: 9.09998e-06 [renormalize]: 4.00003e-07 [validate]: 0.00010689 Sums bootstrap : 0.000253s : 0.23% type_inference : 0.101776s : 94.21% event_method : 0.000019s : 0.02% auto_monad : 0.000061s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000428s : 0.40% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000663s : 0.61% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002409s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000025s : 0.02% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000585s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000417s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000449s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000107s : 0.10% Time group info: ------[substitution.] 0.000185 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 4: substitution.graph_param_transform 81.27% : 0.000151s : 4: substitution.inline 2.20% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.49% : 0.000005s : 2: substitution.replace_old_param 6.41% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101712 2 97.51% : 0.099177s : 1: type_inference.infer 2.49% : 0.002535s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.77% : 0.000050s : 4: replace.inline 31.23% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 93.19% : 0.000148s : 4: match.inline 6.81% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.52% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.76% : 0.000002s : 12: predicate.arithmetic_simplify 1.25% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.27% : 0.000002s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.15% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.58% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.48% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.89% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.67% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.24% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001985 22 65.49% : 0.001300s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.22% : 0.000659s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115038 72 0.05% : 0.000052s : 1: add_recomputation 0.06% : 0.000064s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000266s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.00% : 0.006899s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000424s : 1: loop_unroll 0.52% : 0.000593s : 1: mutable_eliminate 0.78% : 0.000892s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000434s : 1: py_interpret_to_execute 0.02% : 0.000029s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.48% : 0.001708s : 1: renormalize.infer 0.60% : 0.000691s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 88.48% : 0.101790s : 1: type_inference TotalTime = 0.116709, [30] [bootstrap]: 0.00032839 [type_inference]: 0.104871 [event_method]: 1.865e-05 [auto_monad]: 6.633e-05 [graph_reusing]: 6.63003e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.0004443 [rewriter_before_opt_a]: 8.381e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00802536, [2] [Cycle 1]: 0.00430044, [27] [switch_simplify]: 6.059e-05 [loop_unroll]: 3.244e-05 [a_1]: 0.00059983 [with_stream_mark]: 2.009e-05 [recompute_prepare]: 9.71e-06 [updatestate_depend_eliminate]: 5.03002e-06 [updatestate_assign_eliminate]: 3.39001e-06 [updatestate_loads_eliminate]: 3.17002e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 7.62002e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.68998e-06 [meta_shard_fg_expand]: 2.55002e-06 [get_grad_eliminate_]: 6.39001e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.639e-05 [j_node_and_user_rematch]: 1.139e-05 [meta_fg_expand]: 3.21001e-06 [replace_old_param]: 9.99001e-06 [inline_without_move]: 6.10002e-06 [renormalize]: 0.00317209 [add_forward_monad_depend]: 9.99001e-06 [auto_monad_grad]: 2.89999e-06 [auto_monad_eliminator]: 2.491e-05 [cse]: 3.844e-05 [replace_applicator]: 2.641e-05 [Cycle 2]: 0.000424, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.0001369 [with_stream_mark]: 1.693e-05 [recompute_prepare]: 6.41998e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 2.63003e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 6.24999e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 2.37001e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 3.52002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.044e-05 [j_node_and_user_rematch]: 1.079e-05 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.083e-05 [inline_without_move]: 6.06e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.99e-06 [auto_monad_grad]: 1.78002e-06 [auto_monad_eliminator]: 8.48001e-06 [cse]: 1.4e-05 [replace_applicator]: 6.71999e-06 [py_interpret_to_execute_after_opt_a]: 1.837e-05 [rewriter_after_opt_a]: 4.495e-05 [convert_after_rewriter]: 5.024e-05 [order_py_execute_after_rewriter]: 7.15998e-06 [mutable_eliminate]: 0.00084785 [jit_opt_b]: 6.511e-05, [1] [Cycle 1]: 5.65e-05, [2] [frontend_op_eliminate]: 2.19e-05 [inline_after_opt_a]: 2.048e-05 [cconv]: 3.479e-05 [loop_unroll]: 0.00047526 [jit_opt_after_cconv]: 0.0001723, [1] [Cycle 1]: 0.00016562, [11] [c_1]: 2.771e-05 [parameter_eliminate]: 3.85998e-06 [updatestate_depend_eliminate]: 7.84002e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 4.08001e-06 [cse]: 3.175e-05 [call_graph_tuple_transform]: 2.274e-05 [tuple_list_get_item_eliminator]: 5.91998e-06 [none_parameter_eliminate]: 2.02999e-06 [renormalize]: 3.9002e-07 [switch_simplify]: 6.02001e-06 [remove_dup_value]: 1.561e-05 [partial_unused_args_eliminate]: 2.64001e-06 [environ_conv]: 9.60001e-06 [add_recomputation]: 4.824e-05 [cse_after_recomputation]: 2.555e-05, [1] [Cycle 1]: 2.042e-05, [1] [cse]: 1.443e-05 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 3.9e-06 [rewriter_after_jit_bprop_graph]: 6.57002e-06 [opt_after_jit_grad]: 0.00051787 [symbol_engine_optimizer]: 0.000251, [1] [Cycle 1]: 0.00024416, [6] [build]: 4.07e-06 [elim_shapecalc]: 1.343e-05 [elim_not_effective]: 0.00017782 [opt_reshape]: 7.47002e-06 [fold_const_symbol]: 1.096e-05 [renormalize]: 6.59988e-07 [validate]: 4.884e-05 Sums bootstrap : 0.000328s : 0.29% type_inference : 0.104871s : 93.01% event_method : 0.000019s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000444s : 0.39% rewriter_before_opt_a : 0.000084s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000039s : 0.03% jit_opt_a.a_1 : 0.000737s : 0.65% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003172s : 2.81% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.03% jit_opt_a.cse : 0.000052s : 0.05% jit_opt_a.replace_applicator : 0.000033s : 0.03% py_interpret_to_execute_after_opt_a : 0.000018s : 0.02% rewriter_after_opt_a : 0.000045s : 0.04% convert_after_rewriter : 0.000050s : 0.04% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000848s : 0.75% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000035s : 0.03% loop_unroll : 0.000475s : 0.42% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000032s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000518s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000013s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000178s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000392 24 41.51% : 0.000163s : 2: substitution.elim_not_effective 0.42% : 0.000002s : 2: substitution.fold_const_symbol 1.60% : 0.000006s : 4: substitution.graph_param_transform 48.35% : 0.000189s : 4: substitution.inline 1.29% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.69% : 0.000007s : 4: substitution.remove_not_recompute_node 1.59% : 0.000006s : 2: substitution.replace_old_param 3.54% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104796 2 97.27% : 0.101931s : 1: type_inference.infer 2.73% : 0.002865s : 1: type_inference.specialize ------[replace.] 0.000075 6 66.69% : 0.000050s : 4: replace.inline 33.31% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 93.82% : 0.000187s : 4: match.inline 6.18% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000146 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.97% : 0.000001s : 12: predicate.addn_check_dump 1.66% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 0.98% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.52% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.12% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000008s : 26: predicate.inline 0.80% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 18: predicate.load_eliminater 1.11% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.02% : 0.000001s : 12: predicate.merge_addn 0.97% : 0.000001s : 12: predicate.minmaximum_grad 2.70% : 0.000004s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000002s : 12: predicate.print_const_string_wrapper 1.99% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.06% : 0.000002s : 8: predicate.remove_not_recompute_node 2.39% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.54% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.18% : 0.000002s : 8: predicate.special_op_eliminate 0.87% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.02% : 0.000010s : 58: predicate.switch_simplify 1.17% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.35% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.69% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002228 22 60.66% : 0.001351s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.05% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.29% : 0.000831s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121122 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.29% : 0.000346s : 1: bootstrap 0.03% : 0.000037s : 1: cconv 0.04% : 0.000054s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.63% : 0.008029s : 1: jit_opt_a 0.14% : 0.000175s : 1: jit_opt_after_cconv 0.06% : 0.000068s : 1: jit_opt_b 0.40% : 0.000484s : 1: loop_unroll 0.71% : 0.000862s : 1: mutable_eliminate 0.83% : 0.001001s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000022s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.17% : 0.000206s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000527s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000450s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.76% : 0.002130s : 1: renormalize.infer 0.85% : 0.001029s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000049s : 1: rewriter_after_opt_a 0.07% : 0.000089s : 1: rewriter_before_opt_a 0.21% : 0.000254s : 1: symbol_engine_optimizer 86.60% : 0.104888s : 1: type_inference TotalTime = 0.0131095, [30] [bootstrap]: 0.00033989 [type_inference]: 0.00510647 [event_method]: 1.684e-05 [auto_monad]: 6.779e-05 [graph_reusing]: 5.87999e-06 [pre_auto_parallel]: 2.01e-06 [py_interpret_to_execute]: 2.314e-05 [rewriter_before_opt_a]: 6.973e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00529096, [2] [Cycle 1]: 0.00166585, [27] [switch_simplify]: 4.728e-05 [loop_unroll]: 2.929e-05 [a_1]: 0.00057008 [with_stream_mark]: 1.671e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.65998e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.43002e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.87001e-06 [updatestate_useless_node_eliminater]: 5.02999e-06 [accelerated_algorithm]: 5.75001e-06 [meta_shard_fg_expand]: 2.69001e-06 [get_grad_eliminate_]: 5.74e-06 [merge_forward]: 3.83999e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 0.00068356 [add_forward_monad_depend]: 5.37001e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.422e-05 [cse]: 2.379e-05 [replace_applicator]: 1.155e-05 [Cycle 2]: 0.00032745, [27] [switch_simplify]: 5.47001e-06 [loop_unroll]: 4.90001e-06 [a_1]: 9.295e-05 [with_stream_mark]: 1.03e-05 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.96999e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 5.15001e-06 [updatestate_useless_node_eliminater]: 4.94003e-06 [accelerated_algorithm]: 4.83001e-06 [meta_shard_fg_expand]: 1.61002e-06 [get_grad_eliminate_]: 4.74e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 2.20002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.419e-05 [j_node_and_user_rematch]: 7.88001e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.39e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.27001e-06 [cse]: 1.126e-05 [replace_applicator]: 5.25999e-06 [py_interpret_to_execute_after_opt_a]: 1.089e-05 [rewriter_after_opt_a]: 3.377e-05 [convert_after_rewriter]: 7.23e-06 [order_py_execute_after_rewriter]: 5.52999e-06 [mutable_eliminate]: 0.00062741 [jit_opt_b]: 5.086e-05, [1] [Cycle 1]: 4.376e-05, [2] [frontend_op_eliminate]: 1.639e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 2.28e-05 [loop_unroll]: 0.00042348 [jit_opt_after_cconv]: 0.00016434, [1] [Cycle 1]: 0.00015788, [11] [c_1]: 2.164e-05 [parameter_eliminate]: 2.60002e-06 [updatestate_depend_eliminate]: 2.392e-05 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 2.096e-05 [call_graph_tuple_transform]: 1.901e-05 [tuple_list_get_item_eliminator]: 5.35999e-06 [none_parameter_eliminate]: 1.52001e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.40001e-06 [remove_dup_value]: 1.323e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 5.10001e-06 [add_recomputation]: 4.476e-05 [cse_after_recomputation]: 2.021e-05, [1] [Cycle 1]: 1.499e-05, [1] [cse]: 9.50001e-06 [auto_monad_reorder]: 1.401e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 5.20001e-06 [opt_after_jit_grad]: 0.00046104 [symbol_engine_optimizer]: 7.289e-05, [1] [Cycle 1]: 6.687e-05, [6] [build]: 3.72002e-06 [elim_shapecalc]: 8.21002e-06 [elim_not_effective]: 1.343e-05 [opt_reshape]: 5.67001e-06 [fold_const_symbol]: 8.16002e-06 [renormalize]: 3.80009e-07 [validate]: 3.252e-05 Sums bootstrap : 0.000340s : 3.68% type_inference : 0.005106s : 55.26% event_method : 0.000017s : 0.18% auto_monad : 0.000068s : 0.73% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000023s : 0.25% rewriter_before_opt_a : 0.000070s : 0.75% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000053s : 0.57% jit_opt_a.loop_unroll : 0.000034s : 0.37% jit_opt_a.a_1 : 0.000663s : 7.17% jit_opt_a.with_stream_mark : 0.000027s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000684s : 7.40% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000035s : 0.38% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000034s : 0.37% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000006s : 0.06% mutable_eliminate : 0.000627s : 6.79% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000023s : 0.25% loop_unroll : 0.000423s : 4.58% jit_opt_after_cconv.c_1 : 0.000022s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000024s : 0.26% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000045s : 0.48% cse_after_recomputation.cse : 0.000010s : 0.10% auto_monad_reorder : 0.000014s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000461s : 4.99% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.35% Time group info: ------[substitution.] 0.000200 23 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000005s : 3: substitution.graph_param_transform 79.63% : 0.000159s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 9.44% : 0.000019s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005047 2 82.88% : 0.004184s : 1: type_inference.infer 17.12% : 0.000864s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.56% : 0.000047s : 4: replace.inline 33.44% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 92.61% : 0.000156s : 4: match.inline 7.39% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.72% : 0.000002s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.37% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.56% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.85% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.12% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.59% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.56% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.39% : 0.000002s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.63% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.69% : 0.000002s : 18: predicate.replace_applicator 0.67% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.31% : 0.000002s : 10: predicate.reshape_eliminate 1.56% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.19% : 0.000008s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000651 13 53.10% : 0.000346s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.10% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.80% : 0.000272s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014724 72 0.32% : 0.000048s : 1: add_recomputation 0.49% : 0.000071s : 1: auto_monad 0.11% : 0.000016s : 1: auto_monad_reorder 2.41% : 0.000355s : 1: bootstrap 0.17% : 0.000025s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 35.96% : 0.005294s : 1: jit_opt_a 1.13% : 0.000167s : 1: jit_opt_after_cconv 0.36% : 0.000053s : 1: jit_opt_b 2.93% : 0.000431s : 1: loop_unroll 4.32% : 0.000637s : 1: mutable_eliminate 5.89% : 0.000868s : 26: opt.transform.jit_opt_a 0.33% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.19% : 0.000469s : 1: opt_after_jit_grad 0.05% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.17% : 0.000025s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000016s : 1: remove_dup_value 2.37% : 0.000350s : 1: renormalize.infer 2.21% : 0.000326s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000037s : 1: rewriter_after_opt_a 0.49% : 0.000072s : 1: rewriter_before_opt_a 0.51% : 0.000075s : 1: symbol_engine_optimizer 34.77% : 0.005119s : 1: type_inference TotalTime = 0.0127011, [30] [bootstrap]: 0.00028145 [type_inference]: 0.00447088 [event_method]: 1.73e-05 [auto_monad]: 6.184e-05 [graph_reusing]: 6.14001e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 3.594e-05 [rewriter_before_opt_a]: 7.248e-05 [expand_dump_flag]: 2.70997e-06 [jit_opt_a]: 0.00567489, [2] [Cycle 1]: 0.00169494, [27] [switch_simplify]: 6.009e-05 [loop_unroll]: 3.122e-05 [a_1]: 0.00053532 [with_stream_mark]: 1.903e-05 [recompute_prepare]: 7.46001e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.31999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.25001e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 4.60001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 8.67998e-06 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00072228 [add_forward_monad_depend]: 5.05999e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.489e-05 [cse]: 3.055e-05 [replace_applicator]: 1.156e-05 [Cycle 2]: 0.00032136, [27] [switch_simplify]: 5.94e-06 [loop_unroll]: 4.87e-06 [a_1]: 9.104e-05 [with_stream_mark]: 9.70002e-06 [recompute_prepare]: 5.19998e-06 [updatestate_depend_eliminate]: 3.00002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.06997e-06 [specialize_transform]: 5.19e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 4.82e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.298e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.18998e-06 [inline_without_move]: 4.74e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 1.02998e-06 [auto_monad_eliminator]: 5.98002e-06 [cse]: 1.117e-05 [replace_applicator]: 5.20999e-06 [py_interpret_to_execute_after_opt_a]: 1.096e-05 [rewriter_after_opt_a]: 7.281e-05 [convert_after_rewriter]: 7.75e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00053402 [jit_opt_b]: 4.767e-05, [1] [Cycle 1]: 4.096e-05, [2] [frontend_op_eliminate]: 1.552e-05 [inline_after_opt_a]: 1.471e-05 [cconv]: 2.616e-05 [loop_unroll]: 0.00040538 [jit_opt_after_cconv]: 0.00014624, [1] [Cycle 1]: 0.00013942, [11] [c_1]: 2.038e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 8.70999e-06 [cse]: 1.932e-05 [call_graph_tuple_transform]: 1.903e-05 [tuple_list_get_item_eliminator]: 4.99998e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.548e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 5.86e-06 [add_recomputation]: 4.665e-05 [cse_after_recomputation]: 2.186e-05, [1] [Cycle 1]: 1.642e-05, [1] [cse]: 1.053e-05 [auto_monad_reorder]: 1.579e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.66e-06 [opt_after_jit_grad]: 0.00044256 [symbol_engine_optimizer]: 7.028e-05, [1] [Cycle 1]: 6.436e-05, [6] [build]: 3.72002e-06 [elim_shapecalc]: 7.56001e-06 [elim_not_effective]: 1.252e-05 [opt_reshape]: 5.51002e-06 [fold_const_symbol]: 7.98001e-06 [renormalize]: 4.80009e-07 [validate]: 3.437e-05 Sums bootstrap : 0.000281s : 3.32% type_inference : 0.004471s : 52.70% event_method : 0.000017s : 0.20% auto_monad : 0.000062s : 0.73% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.42% rewriter_before_opt_a : 0.000072s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.78% jit_opt_a.loop_unroll : 0.000036s : 0.43% jit_opt_a.a_1 : 0.000626s : 7.38% jit_opt_a.with_stream_mark : 0.000029s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000722s : 8.51% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.05% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000042s : 0.49% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000073s : 0.86% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000534s : 6.29% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.31% loop_unroll : 0.000405s : 4.78% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000009s : 0.10% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000047s : 0.55% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000443s : 5.22% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000034s : 0.41% Time group info: ------[substitution.] 0.000206 23 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000006s : 3: substitution.graph_param_transform 83.43% : 0.000171s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.30% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004414 2 81.98% : 0.003618s : 1: type_inference.infer 18.02% : 0.000795s : 1: type_inference.specialize ------[replace.] 0.000069 6 65.59% : 0.000045s : 4: replace.inline 34.41% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.35% : 0.000169s : 4: match.inline 6.65% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.38% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.47% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.17% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 2.17% : 0.000003s : 10: predicate.reduce_eliminate 1.73% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.61% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.20% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.08% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000593 13 53.89% : 0.000319s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.50% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 40.62% : 0.000241s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014322 72 0.35% : 0.000049s : 1: add_recomputation 0.45% : 0.000065s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.05% : 0.000293s : 1: bootstrap 0.20% : 0.000029s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 39.65% : 0.005679s : 1: jit_opt_a 1.04% : 0.000149s : 1: jit_opt_after_cconv 0.35% : 0.000050s : 1: jit_opt_b 2.88% : 0.000413s : 1: loop_unroll 3.79% : 0.000542s : 1: mutable_eliminate 5.88% : 0.000842s : 26: opt.transform.jit_opt_a 0.32% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.14% : 0.000450s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.71% : 0.000388s : 1: renormalize.infer 2.28% : 0.000326s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.53% : 0.000076s : 1: rewriter_after_opt_a 0.53% : 0.000075s : 1: rewriter_before_opt_a 0.51% : 0.000073s : 1: symbol_engine_optimizer 31.31% : 0.004484s : 1: type_inference TotalTime = 0.0123829, [30] [bootstrap]: 0.00028372 [type_inference]: 0.00455749 [event_method]: 1.774e-05 [auto_monad]: 7.093e-05 [graph_reusing]: 6.13998e-06 [pre_auto_parallel]: 2.84999e-06 [py_interpret_to_execute]: 2.404e-05 [rewriter_before_opt_a]: 7.336e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.00529008, [2] [Cycle 1]: 0.00160235, [27] [switch_simplify]: 5.463e-05 [loop_unroll]: 3.189e-05 [a_1]: 0.00052702 [with_stream_mark]: 1.885e-05 [recompute_prepare]: 7.5e-06 [updatestate_depend_eliminate]: 3.96001e-06 [updatestate_assign_eliminate]: 3.52997e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.31998e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.89002e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 9.87999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 0.00064464 [add_forward_monad_depend]: 5.99e-06 [auto_monad_grad]: 1.82001e-06 [auto_monad_eliminator]: 1.423e-05 [cse]: 3.012e-05 [replace_applicator]: 1.179e-05 [Cycle 2]: 0.00040337, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 4.62998e-06 [a_1]: 8.947e-05 [with_stream_mark]: 9.96e-06 [recompute_prepare]: 4.99998e-06 [updatestate_depend_eliminate]: 3.35e-06 [updatestate_assign_eliminate]: 2.09e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 4.94003e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 3.24001e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.401e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.13001e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.84e-06 [auto_monad_grad]: 9.00007e-07 [auto_monad_eliminator]: 6.37001e-06 [cse]: 1.135e-05 [replace_applicator]: 5.18002e-06 [py_interpret_to_execute_after_opt_a]: 8.31002e-06 [rewriter_after_opt_a]: 3.241e-05 [convert_after_rewriter]: 7.38e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00052827 [jit_opt_b]: 4.897e-05, [1] [Cycle 1]: 4.169e-05, [2] [frontend_op_eliminate]: 1.578e-05 [inline_after_opt_a]: 1.475e-05 [cconv]: 2.436e-05 [loop_unroll]: 0.00041449 [jit_opt_after_cconv]: 0.00014558, [1] [Cycle 1]: 0.00013933, [11] [c_1]: 2.049e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 9.02999e-06 [cse]: 1.896e-05 [call_graph_tuple_transform]: 1.856e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 1.41e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 5.75001e-06 [add_recomputation]: 5.262e-05 [cse_after_recomputation]: 2.237e-05, [1] [Cycle 1]: 1.679e-05, [1] [cse]: 1.098e-05 [auto_monad_reorder]: 1.612e-05 [get_jit_bprop_graph]: 1.82999e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00044345 [symbol_engine_optimizer]: 6.924e-05, [1] [Cycle 1]: 6.312e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 7.5e-06 [elim_not_effective]: 1.204e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 8.23001e-06 [renormalize]: 4.09986e-07 [validate]: 3.54e-05 Sums bootstrap : 0.000284s : 3.36% type_inference : 0.004557s : 53.94% event_method : 0.000018s : 0.21% auto_monad : 0.000071s : 0.84% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000024s : 0.28% rewriter_before_opt_a : 0.000073s : 0.87% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000060s : 0.71% jit_opt_a.loop_unroll : 0.000037s : 0.43% jit_opt_a.a_1 : 0.000616s : 7.30% jit_opt_a.with_stream_mark : 0.000029s : 0.34% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000645s : 7.63% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000041s : 0.49% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000032s : 0.38% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000528s : 6.25% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000024s : 0.29% loop_unroll : 0.000414s : 4.91% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000009s : 0.11% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000053s : 0.62% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000443s : 5.25% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.42% Time group info: ------[substitution.] 0.000199 23 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.84% : 0.000006s : 3: substitution.graph_param_transform 82.91% : 0.000165s : 4: substitution.inline 1.83% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000005s : 2: substitution.replace_old_param 6.10% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004495 2 81.12% : 0.003646s : 1: type_inference.infer 18.88% : 0.000849s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.34% : 0.000044s : 4: replace.inline 32.66% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.66% : 0.000162s : 4: match.inline 6.34% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000002s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.05% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.74% : 0.000007s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.82% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.45% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.39% : 0.000000s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.98% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.16% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.75% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000605 13 52.67% : 0.000319s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.01% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.32% : 0.000256s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013912 72 0.40% : 0.000056s : 1: add_recomputation 0.54% : 0.000075s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.18% : 0.000303s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 38.05% : 0.005293s : 1: jit_opt_a 1.07% : 0.000148s : 1: jit_opt_after_cconv 0.37% : 0.000051s : 1: jit_opt_b 3.03% : 0.000422s : 1: loop_unroll 3.86% : 0.000537s : 1: mutable_eliminate 5.96% : 0.000830s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.25% : 0.000452s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.19% : 0.000026s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.50% : 0.000348s : 1: renormalize.infer 2.08% : 0.000289s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000035s : 1: rewriter_after_opt_a 0.55% : 0.000076s : 1: rewriter_before_opt_a 0.51% : 0.000072s : 1: symbol_engine_optimizer 32.88% : 0.004574s : 1: type_inference TotalTime = 0.0121309, [30] [bootstrap]: 0.00029003 [type_inference]: 0.00475384 [event_method]: 1.72e-05 [auto_monad]: 7.107e-05 [graph_reusing]: 6.27001e-06 [pre_auto_parallel]: 2.28002e-06 [py_interpret_to_execute]: 2.256e-05 [rewriter_before_opt_a]: 7.094e-05 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.00495931, [2] [Cycle 1]: 0.00147474, [27] [switch_simplify]: 4.774e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.00051152 [with_stream_mark]: 1.385e-05 [recompute_prepare]: 7.01001e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.68998e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.19e-06 [accelerated_algorithm]: 5.14998e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.074e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 7.66999e-06 [inline_without_move]: 5.15999e-06 [renormalize]: 0.00058618 [add_forward_monad_depend]: 5.03002e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 1.243e-05 [cse]: 1.968e-05 [replace_applicator]: 1.107e-05 [Cycle 2]: 0.00030867, [27] [switch_simplify]: 5.91998e-06 [loop_unroll]: 4.95999e-06 [a_1]: 8.816e-05 [with_stream_mark]: 8.37998e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.73998e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 4.73001e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 4.64998e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 4.38999e-06 [merge_forward]: 2.36e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.194e-05 [j_node_and_user_rematch]: 7.93001e-06 [meta_fg_expand]: 1.60001e-06 [replace_old_param]: 6.68e-06 [inline_without_move]: 4.53999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 5.34998e-06 [cse]: 1.034e-05 [replace_applicator]: 4.99e-06 [py_interpret_to_execute_after_opt_a]: 7.75e-06 [rewriter_after_opt_a]: 2.796e-05 [convert_after_rewriter]: 6.27001e-06 [order_py_execute_after_rewriter]: 4.58999e-06 [mutable_eliminate]: 0.00049198 [jit_opt_b]: 4.694e-05, [1] [Cycle 1]: 4.142e-05, [2] [frontend_op_eliminate]: 1.574e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 2.062e-05 [loop_unroll]: 0.00040156 [jit_opt_after_cconv]: 0.00013497, [1] [Cycle 1]: 0.00012874, [11] [c_1]: 2.001e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 5.15999e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.801e-05 [call_graph_tuple_transform]: 1.744e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.53002e-06 [remove_dup_value]: 1.174e-05 [partial_unused_args_eliminate]: 2.03997e-06 [environ_conv]: 4.08001e-06 [add_recomputation]: 4.012e-05 [cse_after_recomputation]: 2.119e-05, [1] [Cycle 1]: 1.61e-05, [1] [cse]: 1.057e-05 [auto_monad_reorder]: 1.18e-05 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 5.10001e-06 [opt_after_jit_grad]: 0.00043322 [symbol_engine_optimizer]: 6.905e-05, [1] [Cycle 1]: 6.347e-05, [6] [build]: 2.64001e-06 [elim_shapecalc]: 7.36999e-06 [elim_not_effective]: 1.247e-05 [opt_reshape]: 5.86003e-06 [fold_const_symbol]: 8.65999e-06 [renormalize]: 4.10015e-07 [validate]: 2.939e-05 Sums bootstrap : 0.000290s : 3.45% type_inference : 0.004754s : 56.51% event_method : 0.000017s : 0.20% auto_monad : 0.000071s : 0.84% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000023s : 0.27% rewriter_before_opt_a : 0.000071s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.64% jit_opt_a.loop_unroll : 0.000035s : 0.42% jit_opt_a.a_1 : 0.000600s : 7.13% jit_opt_a.with_stream_mark : 0.000022s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.27% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000014s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000586s : 6.97% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.21% jit_opt_a.cse : 0.000030s : 0.36% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000028s : 0.33% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000492s : 5.85% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000021s : 0.25% loop_unroll : 0.000402s : 4.77% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000012s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000040s : 0.48% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000012s : 0.14% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000433s : 5.15% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.35% Time group info: ------[substitution.] 0.000179 23 1.25% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.74% : 0.000005s : 3: substitution.graph_param_transform 82.60% : 0.000148s : 4: substitution.inline 2.11% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000004s : 4: substitution.remove_not_recompute_node 1.70% : 0.000003s : 2: substitution.replace_old_param 6.42% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004691 2 80.92% : 0.003796s : 1: type_inference.infer 19.08% : 0.000895s : 1: type_inference.specialize ------[replace.] 0.000066 6 65.46% : 0.000043s : 4: replace.inline 34.54% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 93.38% : 0.000145s : 4: match.inline 6.62% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.23% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000003s : 10: predicate.arithmetic_simplify 1.15% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.05% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_depend_swap 1.37% : 0.000002s : 10: predicate.environ_get_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.85% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 4.65% : 0.000006s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 6: predicate.less_batch_normalization 1.34% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.38% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.61% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.78% : 0.000002s : 3: predicate.mutable_eliminate 0.76% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000002s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.49% : 0.000001s : 6: predicate.remove_not_recompute_node 10.62% : 0.000013s : 18: predicate.replace_applicator 0.51% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.14% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.80% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.30% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 1.96% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.76% : 0.000008s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.26% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.23% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.51% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.58% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.34% : 0.000002s : 10: predicate.value_based_eliminate 0.30% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.52% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000587 13 51.47% : 0.000302s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.63% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.91% : 0.000258s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013579 72 0.32% : 0.000043s : 1: add_recomputation 0.55% : 0.000074s : 1: auto_monad 0.10% : 0.000014s : 1: auto_monad_reorder 2.25% : 0.000305s : 1: bootstrap 0.17% : 0.000023s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 36.55% : 0.004962s : 1: jit_opt_a 1.07% : 0.000145s : 1: jit_opt_after_cconv 0.36% : 0.000049s : 1: jit_opt_b 3.01% : 0.000409s : 1: loop_unroll 3.68% : 0.000500s : 1: mutable_eliminate 5.87% : 0.000797s : 26: opt.transform.jit_opt_a 0.33% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.25% : 0.000441s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000025s : 1: py_interpret_to_execute 0.07% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 2.31% : 0.000314s : 1: renormalize.infer 1.96% : 0.000266s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000031s : 1: rewriter_after_opt_a 0.54% : 0.000074s : 1: rewriter_before_opt_a 0.53% : 0.000072s : 1: symbol_engine_optimizer 35.10% : 0.004766s : 1: type_inference TotalTime = 0.0125568, [30] [bootstrap]: 0.00028728 [type_inference]: 0.00438071 [event_method]: 1.671e-05 [auto_monad]: 6.598e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 3.885e-05 [rewriter_before_opt_a]: 6.889e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00524351, [2] [Cycle 1]: 0.00166026, [27] [switch_simplify]: 4.863e-05 [loop_unroll]: 2.907e-05 [a_1]: 0.0005516 [with_stream_mark]: 1.518e-05 [recompute_prepare]: 6.98e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.27e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.58002e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 5.10001e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 0.00070603 [add_forward_monad_depend]: 6.23e-06 [auto_monad_grad]: 2.73003e-06 [auto_monad_eliminator]: 1.514e-05 [cse]: 2.755e-05 [replace_applicator]: 1.4e-05 [Cycle 2]: 0.00032701, [27] [switch_simplify]: 5.66e-06 [loop_unroll]: 4.84e-06 [a_1]: 9.005e-05 [with_stream_mark]: 1.077e-05 [recompute_prepare]: 4.84003e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 4.85001e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 4.99998e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.38999e-06 [merge_forward]: 3.51001e-06 [cell_reuse_recompute_pass]: 2.17001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.495e-05 [j_node_and_user_rematch]: 8.04997e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 4.89e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 5.3001e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.181e-05 [replace_applicator]: 5.24e-06 [py_interpret_to_execute_after_opt_a]: 1.124e-05 [rewriter_after_opt_a]: 3.476e-05 [convert_after_rewriter]: 7.09001e-06 [order_py_execute_after_rewriter]: 5.10999e-06 [mutable_eliminate]: 0.00071024 [jit_opt_b]: 5.046e-05, [1] [Cycle 1]: 4.394e-05, [2] [frontend_op_eliminate]: 1.605e-05 [inline_after_opt_a]: 1.581e-05 [cconv]: 2.49e-05 [loop_unroll]: 0.00043947 [jit_opt_after_cconv]: 0.0001632, [1] [Cycle 1]: 0.00015639, [11] [c_1]: 2.134e-05 [parameter_eliminate]: 3.16001e-06 [updatestate_depend_eliminate]: 6.04001e-06 [updatestate_assign_eliminate]: 2.84001e-06 [updatestate_loads_eliminate]: 2.06998e-06 [cse]: 2.434e-05 [call_graph_tuple_transform]: 1.981e-05 [tuple_list_get_item_eliminator]: 5.60001e-06 [none_parameter_eliminate]: 1.77999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.32001e-06 [environ_conv]: 6.46e-06 [add_recomputation]: 5.136e-05 [cse_after_recomputation]: 2.22e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.115e-05 [auto_monad_reorder]: 1.505e-05 [get_jit_bprop_graph]: 2.14e-06 [rewriter_after_jit_bprop_graph]: 5.57001e-06 [opt_after_jit_grad]: 0.00057178 [symbol_engine_optimizer]: 8.014e-05, [1] [Cycle 1]: 7.218e-05, [6] [build]: 4.95001e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.456e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 7.39994e-07 [validate]: 4.364e-05 Sums bootstrap : 0.000287s : 3.30% type_inference : 0.004381s : 50.30% event_method : 0.000017s : 0.19% auto_monad : 0.000066s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000039s : 0.45% rewriter_before_opt_a : 0.000069s : 0.79% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000054s : 0.62% jit_opt_a.loop_unroll : 0.000034s : 0.39% jit_opt_a.a_1 : 0.000642s : 7.37% jit_opt_a.with_stream_mark : 0.000026s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000706s : 8.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000039s : 0.45% jit_opt_a.replace_applicator : 0.000019s : 0.22% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000035s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000710s : 8.15% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000025s : 0.29% loop_unroll : 0.000439s : 5.05% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000024s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000051s : 0.59% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.06% opt_after_jit_grad : 0.000572s : 6.57% symbol_engine_optimizer.build : 0.000005s : 0.06% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.50% Time group info: ------[substitution.] 0.000184 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.88% : 0.000002s : 2: substitution.fold_const_symbol 3.24% : 0.000006s : 3: substitution.graph_param_transform 80.63% : 0.000149s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.12% : 0.000006s : 4: substitution.remove_not_recompute_node 2.47% : 0.000005s : 2: substitution.replace_old_param 6.98% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004321 2 80.71% : 0.003487s : 1: type_inference.infer 19.29% : 0.000834s : 1: type_inference.specialize ------[replace.] 0.000065 6 64.53% : 0.000042s : 4: replace.inline 35.47% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 92.57% : 0.000146s : 4: match.inline 7.43% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.18% : 0.000001s : 10: predicate.depend_value_elim 1.05% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.80% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.28% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.93% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.10% : 0.000002s : 15: predicate.partial_eliminate 1.31% : 0.000002s : 10: predicate.print_const_string_wrapper 2.21% : 0.000003s : 10: predicate.reduce_eliminate 1.31% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.47% : 0.000001s : 6: predicate.remove_not_recompute_node 2.08% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.45% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.34% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 53: predicate.switch_simplify 1.29% : 0.000002s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.71% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000597 13 50.10% : 0.000299s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.02% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.89% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014128 72 0.38% : 0.000054s : 1: add_recomputation 0.49% : 0.000070s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.25% : 0.000318s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.14% : 0.005247s : 1: jit_opt_a 1.17% : 0.000166s : 1: jit_opt_after_cconv 0.38% : 0.000053s : 1: jit_opt_b 3.17% : 0.000448s : 1: loop_unroll 5.09% : 0.000719s : 1: mutable_eliminate 5.68% : 0.000802s : 26: opt.transform.jit_opt_a 0.35% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.20% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000035s : 4: opt.transform.symbol_engine_opt 4.11% : 0.000581s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000042s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.51% : 0.000355s : 1: renormalize.infer 2.43% : 0.000344s : 1: renormalize.specialize 0.05% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000038s : 1: rewriter_after_opt_a 0.51% : 0.000072s : 1: rewriter_before_opt_a 0.59% : 0.000083s : 1: symbol_engine_optimizer 31.09% : 0.004392s : 1: type_inference TotalTime = 0.011408, [30] [bootstrap]: 0.00027002 [type_inference]: 0.00418273 [event_method]: 1.551e-05 [auto_monad]: 4.052e-05 [graph_reusing]: 4.05e-06 [pre_auto_parallel]: 1.49e-06 [py_interpret_to_execute]: 2.923e-05 [rewriter_before_opt_a]: 6.193e-05 [expand_dump_flag]: 1.91003e-06 [jit_opt_a]: 0.0048964, [2] [Cycle 1]: 0.0014244, [27] [switch_simplify]: 4.848e-05 [loop_unroll]: 2.99e-05 [a_1]: 0.00047748 [with_stream_mark]: 1.239e-05 [recompute_prepare]: 6.79001e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 5.00999e-06 [meta_shard_fg_expand]: 1.19003e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 8.00006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.09e-05 [j_node_and_user_rematch]: 8.66002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 7.88999e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 0.00058017 [add_forward_monad_depend]: 4.22e-06 [auto_monad_grad]: 1.17999e-06 [auto_monad_eliminator]: 1.003e-05 [cse]: 1.843e-05 [replace_applicator]: 1.157e-05 [Cycle 2]: 0.00030788, [27] [switch_simplify]: 5.82001e-06 [loop_unroll]: 4.82e-06 [a_1]: 8.708e-05 [with_stream_mark]: 7.89002e-06 [recompute_prepare]: 4.96002e-06 [updatestate_depend_eliminate]: 2.66999e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.25999e-06 [specialize_transform]: 5.24e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 4.53999e-06 [meta_shard_fg_expand]: 1.04e-06 [get_grad_eliminate_]: 4.39002e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 7.63001e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 4.90001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 5.30999e-06 [cse]: 9.89001e-06 [replace_applicator]: 5.12999e-06 [py_interpret_to_execute_after_opt_a]: 7.58999e-06 [rewriter_after_opt_a]: 2.548e-05 [convert_after_rewriter]: 4.98001e-06 [order_py_execute_after_rewriter]: 3.8e-06 [mutable_eliminate]: 0.00048046 [jit_opt_b]: 4.678e-05, [1] [Cycle 1]: 4.106e-05, [2] [frontend_op_eliminate]: 1.519e-05 [inline_after_opt_a]: 1.438e-05 [cconv]: 1.54e-05 [loop_unroll]: 0.00041189 [jit_opt_after_cconv]: 0.00013348, [1] [Cycle 1]: 0.00012784, [11] [c_1]: 2.08e-05 [parameter_eliminate]: 2.36998e-06 [updatestate_depend_eliminate]: 5.22e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.45002e-06 [cse]: 1.896e-05 [call_graph_tuple_transform]: 1.57e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 9.09989e-07 [renormalize]: 3.00002e-07 [switch_simplify]: 5.00999e-06 [remove_dup_value]: 7.53999e-06 [partial_unused_args_eliminate]: 1.81e-06 [environ_conv]: 3.8e-06 [add_recomputation]: 3.258e-05 [cse_after_recomputation]: 2.128e-05, [1] [Cycle 1]: 1.628e-05, [1] [cse]: 1.055e-05 [auto_monad_reorder]: 9.56e-06 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 3.97e-06 [opt_after_jit_grad]: 0.00044314 [symbol_engine_optimizer]: 6.721e-05, [1] [Cycle 1]: 6.161e-05, [6] [build]: 2.27001e-06 [elim_shapecalc]: 7.75e-06 [elim_not_effective]: 1.131e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 7.69002e-06 [renormalize]: 3.4002e-07 [validate]: 2.833e-05 Sums bootstrap : 0.000270s : 3.50% type_inference : 0.004183s : 54.24% event_method : 0.000016s : 0.20% auto_monad : 0.000041s : 0.53% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000001s : 0.02% py_interpret_to_execute : 0.000029s : 0.38% rewriter_before_opt_a : 0.000062s : 0.80% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000054s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000565s : 7.32% jit_opt_a.with_stream_mark : 0.000020s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000580s : 7.52% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000015s : 0.20% jit_opt_a.cse : 0.000028s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.22% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000025s : 0.33% convert_after_rewriter : 0.000005s : 0.06% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000480s : 6.23% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000014s : 0.19% cconv : 0.000015s : 0.20% loop_unroll : 0.000412s : 5.34% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000008s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000033s : 0.42% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000010s : 0.12% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000443s : 5.75% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.37% Time group info: ------[substitution.] 0.000158 23 0.80% : 0.000001s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.00% : 0.000003s : 3: substitution.graph_param_transform 85.44% : 0.000135s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000004s : 4: substitution.remove_not_recompute_node 2.17% : 0.000003s : 2: substitution.replace_old_param 4.71% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004136 2 82.15% : 0.003398s : 1: type_inference.infer 17.85% : 0.000738s : 1: type_inference.specialize ------[replace.] 0.000063 6 65.30% : 0.000041s : 4: replace.inline 34.70% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 6 95.51% : 0.000132s : 4: match.inline 4.49% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000001s : 10: predicate.addn_zero_filter 2.30% : 0.000003s : 10: predicate.arithmetic_simplify 1.33% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.27% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.07% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.43% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.98% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.23% : 0.000002s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.75% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.87% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.31% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.30% : 0.000008s : 53: predicate.switch_simplify 1.32% : 0.000001s : 10: predicate.tile_eliminate 1.54% : 0.000002s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000548 13 51.34% : 0.000281s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.05% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.61% : 0.000239s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012807 72 0.28% : 0.000036s : 1: add_recomputation 0.34% : 0.000044s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 2.19% : 0.000281s : 1: bootstrap 0.14% : 0.000018s : 1: cconv 0.06% : 0.000007s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 38.25% : 0.004899s : 1: jit_opt_a 1.06% : 0.000136s : 1: jit_opt_after_cconv 0.38% : 0.000049s : 1: jit_opt_b 3.27% : 0.000419s : 1: loop_unroll 3.82% : 0.000489s : 1: mutable_eliminate 5.96% : 0.000763s : 26: opt.transform.jit_opt_a 0.34% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000029s : 4: opt.transform.symbol_engine_opt 3.52% : 0.000451s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.25% : 0.000032s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000010s : 1: remove_dup_value 2.40% : 0.000308s : 1: renormalize.infer 2.08% : 0.000266s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000028s : 1: rewriter_after_opt_a 0.51% : 0.000065s : 1: rewriter_before_opt_a 0.54% : 0.000069s : 1: symbol_engine_optimizer 32.74% : 0.004193s : 1: type_inference TotalTime = 0.108882, [30] [bootstrap]: 0.00025244 [type_inference]: 0.0988721 [event_method]: 1.668e-05 [auto_monad]: 5.345e-05 [graph_reusing]: 5.37001e-06 [pre_auto_parallel]: 1.94999e-06 [py_interpret_to_execute]: 0.00038987 [rewriter_before_opt_a]: 7.665e-05 [expand_dump_flag]: 3.04999e-06 [jit_opt_a]: 0.0070816, [2] [Cycle 1]: 0.00352697, [27] [switch_simplify]: 4.813e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00053971 [with_stream_mark]: 1.265e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 3.01001e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 6.97002e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 1.40001e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 8.70001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.282e-05 [j_node_and_user_rematch]: 1.014e-05 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.31002e-06 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00259105 [add_forward_monad_depend]: 5.69e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.385e-05 [cse]: 1.996e-05 [replace_applicator]: 1.555e-05 [Cycle 2]: 0.00035656, [27] [switch_simplify]: 6.91999e-06 [loop_unroll]: 5.66e-06 [a_1]: 0.00012084 [with_stream_mark]: 9.31e-06 [recompute_prepare]: 6.01998e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.01002e-06 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.434e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.54e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.31002e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.024e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 9.28002e-06 [rewriter_after_opt_a]: 3.126e-05 [convert_after_rewriter]: 6.12001e-06 [order_py_execute_after_rewriter]: 6.48e-06 [mutable_eliminate]: 0.0005808 [jit_opt_b]: 5.348e-05, [1] [Cycle 1]: 4.759e-05, [2] [frontend_op_eliminate]: 1.913e-05 [inline_after_opt_a]: 1.791e-05 [cconv]: 2.107e-05 [loop_unroll]: 0.00040974 [jit_opt_after_cconv]: 0.0001447, [1] [Cycle 1]: 0.00013865, [11] [c_1]: 2.484e-05 [parameter_eliminate]: 2.20002e-06 [updatestate_depend_eliminate]: 4.62e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 1.97999e-06 [cse]: 1.878e-05 [call_graph_tuple_transform]: 1.967e-05 [tuple_list_get_item_eliminator]: 5.96998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 4.2998e-07 [switch_simplify]: 6.28998e-06 [remove_dup_value]: 1.213e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 6.77002e-06 [add_recomputation]: 3.989e-05 [cse_after_recomputation]: 2.128e-05, [1] [Cycle 1]: 1.619e-05, [1] [cse]: 1.05e-05 [auto_monad_reorder]: 1.289e-05 [get_jit_bprop_graph]: 1.69998e-06 [rewriter_after_jit_bprop_graph]: 4.37e-06 [opt_after_jit_grad]: 0.00044634 [symbol_engine_optimizer]: 7.374e-05, [1] [Cycle 1]: 6.817e-05, [6] [build]: 2.86999e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.207e-05 [opt_reshape]: 6.93998e-06 [fold_const_symbol]: 9.92999e-06 [renormalize]: 3.39991e-07 [validate]: 8.798e-05 Sums bootstrap : 0.000252s : 0.24% type_inference : 0.098872s : 94.04% event_method : 0.000017s : 0.02% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000390s : 0.37% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000661s : 0.63% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002591s : 2.46% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000581s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000021s : 0.02% loop_unroll : 0.000410s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000088s : 0.08% Time group info: ------[substitution.] 0.000183 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 1.31% : 0.000002s : 2: substitution.fold_const_symbol 2.74% : 0.000005s : 4: substitution.graph_param_transform 83.38% : 0.000153s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 5.14% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098812 2 97.22% : 0.096064s : 1: type_inference.infer 2.78% : 0.002748s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.31% : 0.000047s : 4: replace.inline 33.69% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 94.77% : 0.000151s : 4: match.inline 5.23% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.72% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.15% : 0.000006s : 26: predicate.inline 1.05% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.29% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 2.12% : 0.000003s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001858 22 65.61% : 0.001219s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.49% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.90% : 0.000611s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112382 72 0.04% : 0.000043s : 1: add_recomputation 0.05% : 0.000056s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.24% : 0.000264s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.30% : 0.007085s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000417s : 1: loop_unroll 0.52% : 0.000589s : 1: mutable_eliminate 0.79% : 0.000885s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000453s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000395s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.70% : 0.001908s : 1: renormalize.infer 0.60% : 0.000676s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.07% : 0.000081s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 87.99% : 0.098885s : 1: type_inference TotalTime = 0.110224, [30] [bootstrap]: 0.0002631 [type_inference]: 0.0998403 [event_method]: 1.766e-05 [auto_monad]: 6.358e-05 [graph_reusing]: 5.32001e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00039319 [rewriter_before_opt_a]: 7.543e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00721097, [2] [Cycle 1]: 0.00374817, [27] [switch_simplify]: 4.704e-05 [loop_unroll]: 2.963e-05 [a_1]: 0.00054628 [with_stream_mark]: 1.514e-05 [recompute_prepare]: 7.87003e-06 [updatestate_depend_eliminate]: 3.39001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 7.465e-05 [updatestate_useless_node_eliminater]: 6.12999e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.87002e-06 [get_grad_eliminate_]: 5.95002e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 1.072e-05 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 9.40001e-06 [inline_without_move]: 6.87002e-06 [renormalize]: 0.00271628 [add_forward_monad_depend]: 6.17001e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.442e-05 [cse]: 2.528e-05 [replace_applicator]: 1.544e-05 [Cycle 2]: 0.00036212, [27] [switch_simplify]: 6.56999e-06 [loop_unroll]: 6.01998e-06 [a_1]: 0.00012339 [with_stream_mark]: 9.90002e-06 [recompute_prepare]: 6.17001e-06 [updatestate_depend_eliminate]: 2.85998e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.98002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.419e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.15999e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.74e-06 [cse]: 1.107e-05 [replace_applicator]: 5.73997e-06 [py_interpret_to_execute_after_opt_a]: 1.134e-05 [rewriter_after_opt_a]: 3.238e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 1.352e-05 [mutable_eliminate]: 0.00062338 [jit_opt_b]: 5.51e-05, [1] [Cycle 1]: 4.857e-05, [2] [frontend_op_eliminate]: 1.893e-05 [inline_after_opt_a]: 1.888e-05 [cconv]: 2.675e-05 [loop_unroll]: 0.00042389 [jit_opt_after_cconv]: 0.00015507, [1] [Cycle 1]: 0.00014852, [11] [c_1]: 2.475e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.32001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.06998e-06 [cse]: 2.304e-05 [call_graph_tuple_transform]: 2.11e-05 [tuple_list_get_item_eliminator]: 6.65998e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.316e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 7.48999e-06 [add_recomputation]: 4.678e-05 [cse_after_recomputation]: 2.473e-05, [1] [Cycle 1]: 1.787e-05, [1] [cse]: 1.17e-05 [auto_monad_reorder]: 1.509e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.62999e-06 [opt_after_jit_grad]: 0.00047432 [symbol_engine_optimizer]: 8.406e-05, [1] [Cycle 1]: 7.811e-05, [6] [build]: 3.17002e-06 [elim_shapecalc]: 7.97003e-06 [elim_not_effective]: 1.698e-05 [opt_reshape]: 6.78e-06 [fold_const_symbol]: 1.226e-05 [renormalize]: 3.09985e-07 [validate]: 0.0001469 Sums bootstrap : 0.000263s : 0.25% type_inference : 0.099840s : 93.71% event_method : 0.000018s : 0.02% auto_monad : 0.000064s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000393s : 0.37% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000670s : 0.63% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000080s : 0.08% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002716s : 2.55% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000014s : 0.01% mutable_eliminate : 0.000623s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000424s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000474s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000147s : 0.14% Time group info: ------[substitution.] 0.000198 24 2.72% : 0.000005s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000006s : 4: substitution.graph_param_transform 81.58% : 0.000161s : 4: substitution.inline 1.77% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000006s : 4: substitution.remove_not_recompute_node 1.73% : 0.000003s : 2: substitution.replace_old_param 5.81% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099776 2 97.37% : 0.097154s : 1: type_inference.infer 2.63% : 0.002622s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.20% : 0.000047s : 4: replace.inline 31.80% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.85% : 0.000159s : 4: match.inline 6.15% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 4.95% : 0.000006s : 26: predicate.inline 1.04% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.95% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.78% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.10% : 0.000001s : 8: predicate.specialize_transform 1.80% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.84% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001951 22 65.28% : 0.001274s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000037s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.85% : 0.000641s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113869 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000067s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000279s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.34% : 0.007214s : 1: jit_opt_a 0.14% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.38% : 0.000432s : 1: loop_unroll 0.56% : 0.000632s : 1: mutable_eliminate 0.84% : 0.000962s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000483s : 1: opt_after_jit_grad 0.01% : 0.000016s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000401s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.77% : 0.002020s : 1: renormalize.infer 0.60% : 0.000687s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000079s : 1: rewriter_before_opt_a 0.08% : 0.000087s : 1: symbol_engine_optimizer 87.69% : 0.099854s : 1: type_inference TotalTime = 0.111753, [30] [bootstrap]: 0.00026073 [type_inference]: 0.102266 [event_method]: 1.753e-05 [auto_monad]: 5.802e-05 [graph_reusing]: 5.19998e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00041213 [rewriter_before_opt_a]: 7.708e-05 [expand_dump_flag]: 1.99999e-06 [jit_opt_a]: 0.00659904, [2] [Cycle 1]: 0.00324455, [27] [switch_simplify]: 4.565e-05 [loop_unroll]: 3.01e-05 [a_1]: 0.00051065 [with_stream_mark]: 1.462e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 3.08e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.81e-06 [specialize_transform]: 6.71999e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.01003e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.471e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 5.76e-06 [renormalize]: 0.00233548 [add_forward_monad_depend]: 4.52e-06 [auto_monad_grad]: 1.24998e-06 [auto_monad_eliminator]: 1.127e-05 [cse]: 1.894e-05 [replace_applicator]: 1.299e-05 [Cycle 2]: 0.00035741, [27] [switch_simplify]: 6.49001e-06 [loop_unroll]: 5.67999e-06 [a_1]: 0.00012211 [with_stream_mark]: 8.72e-06 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 2.73998e-06 [updatestate_assign_eliminate]: 2.06e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.06002e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.61002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 8.19998e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 7.74002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.151e-05 [replace_applicator]: 5.62001e-06 [py_interpret_to_execute_after_opt_a]: 9.64999e-06 [rewriter_after_opt_a]: 2.767e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 4.28001e-06 [mutable_eliminate]: 0.00051281 [jit_opt_b]: 5.625e-05, [1] [Cycle 1]: 4.987e-05, [2] [frontend_op_eliminate]: 2.012e-05 [inline_after_opt_a]: 1.738e-05 [cconv]: 1.624e-05 [loop_unroll]: 0.00041518 [jit_opt_after_cconv]: 0.00014893, [1] [Cycle 1]: 0.00014266, [11] [c_1]: 2.486e-05 [parameter_eliminate]: 2.93e-06 [updatestate_depend_eliminate]: 5.94e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 2.148e-05 [call_graph_tuple_transform]: 1.864e-05 [tuple_list_get_item_eliminator]: 6.92002e-06 [none_parameter_eliminate]: 9.89996e-07 [renormalize]: 2.80008e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 8.25e-06 [partial_unused_args_eliminate]: 1.59e-06 [environ_conv]: 5.44e-06 [add_recomputation]: 3.088e-05 [cse_after_recomputation]: 2.286e-05, [1] [Cycle 1]: 1.806e-05, [1] [cse]: 1.224e-05 [auto_monad_reorder]: 9.42999e-06 [get_jit_bprop_graph]: 1.41002e-06 [rewriter_after_jit_bprop_graph]: 4.45999e-06 [opt_after_jit_grad]: 0.00044639 [symbol_engine_optimizer]: 0.00012397, [1] [Cycle 1]: 0.00011769, [6] [build]: 2.26e-06 [elim_shapecalc]: 8.77999e-06 [elim_not_effective]: 1.255e-05 [opt_reshape]: 5.91998e-06 [fold_const_symbol]: 5.968e-05 [renormalize]: 5.19998e-07 [validate]: 3.515e-05 Sums bootstrap : 0.000261s : 0.24% type_inference : 0.102266s : 94.52% event_method : 0.000018s : 0.02% auto_monad : 0.000058s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000412s : 0.38% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000633s : 0.58% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002336s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000513s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000016s : 0.02% loop_unroll : 0.000415s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000031s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000009s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.41% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000060s : 0.06% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000035s : 0.03% Time group info: ------[substitution.] 0.000169 24 0.81% : 0.000001s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000004s : 4: substitution.graph_param_transform 81.47% : 0.000137s : 4: substitution.inline 1.88% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.79% : 0.000005s : 4: substitution.remove_not_recompute_node 2.47% : 0.000004s : 2: substitution.replace_old_param 7.25% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102206 2 97.73% : 0.099890s : 1: type_inference.infer 2.27% : 0.002316s : 1: type_inference.specialize ------[replace.] 0.000064 6 64.91% : 0.000042s : 4: replace.inline 35.09% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000146 6 92.45% : 0.000135s : 4: match.inline 7.55% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 2.12% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000001s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.05% : 0.000006s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.07% : 0.000003s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.80% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.24% : 0.000002s : 12: predicate.minmaximum_grad 1.87% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 8: predicate.special_op_eliminate 1.11% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000009s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.85% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001867 22 66.92% : 0.001249s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.57% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.51% : 0.000588s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115065 72 0.03% : 0.000034s : 1: add_recomputation 0.05% : 0.000061s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.24% : 0.000273s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.74% : 0.006602s : 1: jit_opt_a 0.13% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.37% : 0.000424s : 1: loop_unroll 0.45% : 0.000521s : 1: mutable_eliminate 0.74% : 0.000850s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000083s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000419s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.52% : 0.001745s : 1: renormalize.infer 0.51% : 0.000582s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.11% : 0.000127s : 1: symbol_engine_optimizer 88.89% : 0.102278s : 1: type_inference TotalTime = 0.0110313, [30] [bootstrap]: 0.00026135 [type_inference]: 0.00410056 [event_method]: 1.707e-05 [auto_monad]: 5.456e-05 [graph_reusing]: 4.20999e-06 [pre_auto_parallel]: 1.67999e-06 [py_interpret_to_execute]: 1.899e-05 [rewriter_before_opt_a]: 6.813e-05 [expand_dump_flag]: 1.96e-06 [jit_opt_a]: 0.00450686, [2] [Cycle 1]: 0.0013124, [27] [switch_simplify]: 4.367e-05 [loop_unroll]: 2.965e-05 [a_1]: 0.00047043 [with_stream_mark]: 1.19e-05 [recompute_prepare]: 7.01999e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.15001e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.149e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 7.61999e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 0.00047743 [add_forward_monad_depend]: 3.92002e-06 [auto_monad_grad]: 1.89999e-06 [auto_monad_eliminator]: 1.039e-05 [cse]: 1.76e-05 [replace_applicator]: 1.163e-05 [Cycle 2]: 0.00031301, [27] [switch_simplify]: 5.51e-06 [loop_unroll]: 4.92999e-06 [a_1]: 8.904e-05 [with_stream_mark]: 8.55999e-06 [recompute_prepare]: 4.89e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 4.75999e-06 [updatestate_useless_node_eliminater]: 4.62e-06 [accelerated_algorithm]: 4.60999e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 2.48002e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.309e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.49002e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.23e-06 [cse]: 1.161e-05 [replace_applicator]: 4.88001e-06 [py_interpret_to_execute_after_opt_a]: 1.037e-05 [rewriter_after_opt_a]: 2.909e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 4.57e-06 [mutable_eliminate]: 0.00052528 [jit_opt_b]: 5.868e-05, [1] [Cycle 1]: 5.198e-05, [2] [frontend_op_eliminate]: 1.584e-05 [inline_after_opt_a]: 1.629e-05 [cconv]: 2.025e-05 [loop_unroll]: 0.0004264 [jit_opt_after_cconv]: 0.00013748, [1] [Cycle 1]: 0.00013051, [11] [c_1]: 2.02e-05 [parameter_eliminate]: 2.60002e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.20002e-06 [cse]: 1.908e-05 [call_graph_tuple_transform]: 1.741e-05 [tuple_list_get_item_eliminator]: 5.75001e-06 [none_parameter_eliminate]: 1.20001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.00001e-06 [remove_dup_value]: 1.012e-05 [partial_unused_args_eliminate]: 1.76998e-06 [environ_conv]: 3.88999e-06 [add_recomputation]: 3.594e-05 [cse_after_recomputation]: 2.157e-05, [1] [Cycle 1]: 1.628e-05, [1] [cse]: 1.06e-05 [auto_monad_reorder]: 1.011e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.48001e-06 [opt_after_jit_grad]: 0.00044147 [symbol_engine_optimizer]: 6.831e-05, [1] [Cycle 1]: 6.264e-05, [6] [build]: 2.27001e-06 [elim_shapecalc]: 7.46999e-06 [elim_not_effective]: 1.245e-05 [opt_reshape]: 5.50001e-06 [fold_const_symbol]: 7.98001e-06 [renormalize]: 3.10014e-07 [validate]: 2.686e-05 Sums bootstrap : 0.000261s : 3.44% type_inference : 0.004101s : 53.90% event_method : 0.000017s : 0.22% auto_monad : 0.000055s : 0.72% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000019s : 0.25% rewriter_before_opt_a : 0.000068s : 0.90% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000049s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000559s : 7.35% jit_opt_a.with_stream_mark : 0.000020s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000478s : 6.28% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000029s : 0.38% jit_opt_a.replace_applicator : 0.000017s : 0.22% py_interpret_to_execute_after_opt_a : 0.000010s : 0.14% rewriter_after_opt_a : 0.000029s : 0.38% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000525s : 6.90% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000020s : 0.27% loop_unroll : 0.000426s : 5.60% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000010s : 0.13% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000036s : 0.47% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000441s : 5.80% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.35% Time group info: ------[substitution.] 0.000150 23 1.32% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000004s : 3: substitution.graph_param_transform 82.06% : 0.000123s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.03% : 0.000005s : 4: substitution.remove_not_recompute_node 2.54% : 0.000004s : 2: substitution.replace_old_param 5.91% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004053 2 80.68% : 0.003270s : 1: type_inference.infer 19.32% : 0.000783s : 1: type_inference.specialize ------[replace.] 0.000059 6 65.81% : 0.000039s : 4: replace.inline 34.19% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000129 6 93.99% : 0.000121s : 4: match.inline 6.01% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 0.97% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.03% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.89% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 4.83% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.96% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.77% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 2.04% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 1.99% : 0.000002s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.30% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.91% : 0.000001s : 3: predicate.row_tensor_eliminate 1.05% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 9.14% : 0.000011s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 1.95% : 0.000002s : 16: predicate.switch_layer_defer_inline 6.97% : 0.000008s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.28% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.31% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.35% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.68% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000536 13 51.32% : 0.000275s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.02% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.66% : 0.000234s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012334 72 0.31% : 0.000039s : 1: add_recomputation 0.47% : 0.000058s : 1: auto_monad 0.10% : 0.000012s : 1: auto_monad_reorder 2.22% : 0.000274s : 1: bootstrap 0.19% : 0.000023s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.17% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 36.56% : 0.004510s : 1: jit_opt_a 1.14% : 0.000140s : 1: jit_opt_after_cconv 0.50% : 0.000061s : 1: jit_opt_b 3.53% : 0.000435s : 1: loop_unroll 4.33% : 0.000535s : 1: mutable_eliminate 6.11% : 0.000754s : 26: opt.transform.jit_opt_a 0.37% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.21% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000014s : 1: opt.transform.mutable_eliminate 0.16% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.65% : 0.000450s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.17% : 0.000021s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000013s : 1: remove_dup_value 1.97% : 0.000243s : 1: renormalize.infer 1.86% : 0.000229s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000032s : 1: rewriter_after_opt_a 0.57% : 0.000071s : 1: rewriter_before_opt_a 0.57% : 0.000071s : 1: symbol_engine_optimizer 33.33% : 0.004112s : 1: type_inference TotalTime = 0.111169, [30] [bootstrap]: 0.0002453 [type_inference]: 0.101297 [event_method]: 1.712e-05 [auto_monad]: 5.702e-05 [graph_reusing]: 4.84998e-06 [pre_auto_parallel]: 1.89999e-06 [py_interpret_to_execute]: 0.00040313 [rewriter_before_opt_a]: 7.827e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00683627, [2] [Cycle 1]: 0.00319072, [27] [switch_simplify]: 5.068e-05 [loop_unroll]: 3.029e-05 [a_1]: 0.00056833 [with_stream_mark]: 1.566e-05 [recompute_prepare]: 8.24002e-06 [updatestate_depend_eliminate]: 3.25998e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.17999e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.413e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 9.00001e-06 [inline_without_move]: 5.81e-06 [renormalize]: 0.00221147 [add_forward_monad_depend]: 6.26e-06 [auto_monad_grad]: 2.16998e-06 [auto_monad_eliminator]: 1.567e-05 [cse]: 2.274e-05 [replace_applicator]: 1.305e-05 [Cycle 2]: 0.00035836, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 5.90002e-06 [a_1]: 0.0001184 [with_stream_mark]: 1.051e-05 [recompute_prepare]: 5.66e-06 [updatestate_depend_eliminate]: 3.10002e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.62999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.526e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.62998e-06 [inline_without_move]: 5.29e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 6.14999e-06 [cse]: 1.272e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.037e-05 [rewriter_after_opt_a]: 3.265e-05 [convert_after_rewriter]: 6.29999e-06 [order_py_execute_after_rewriter]: 5.42001e-06 [mutable_eliminate]: 0.00053954 [jit_opt_b]: 5.37e-05, [1] [Cycle 1]: 4.711e-05, [2] [frontend_op_eliminate]: 1.872e-05 [inline_after_opt_a]: 1.77e-05 [cconv]: 2.416e-05 [loop_unroll]: 0.00049584 [jit_opt_after_cconv]: 0.0001536, [1] [Cycle 1]: 0.00014676, [11] [c_1]: 2.57e-05 [parameter_eliminate]: 3.36001e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.113e-05 [call_graph_tuple_transform]: 2.082e-05 [tuple_list_get_item_eliminator]: 6.08002e-06 [none_parameter_eliminate]: 1.82999e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 5.73002e-06 [remove_dup_value]: 1.561e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 7.18e-06 [add_recomputation]: 4.393e-05 [cse_after_recomputation]: 2.213e-05, [1] [Cycle 1]: 1.582e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.302e-05 [get_jit_bprop_graph]: 1.78002e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.00044604 [symbol_engine_optimizer]: 0.00012371, [1] [Cycle 1]: 0.00011761, [6] [build]: 2.61999e-06 [elim_shapecalc]: 5.609e-05 [elim_not_effective]: 1.419e-05 [opt_reshape]: 6.67002e-06 [fold_const_symbol]: 9.20999e-06 [renormalize]: 3.59985e-07 [validate]: 3.999e-05 Sums bootstrap : 0.000245s : 0.23% type_inference : 0.101297s : 94.40% event_method : 0.000017s : 0.02% auto_monad : 0.000057s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000403s : 0.38% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000687s : 0.64% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002212s : 2.06% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000540s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000496s : 0.46% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000056s : 0.05% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000211 24 0.85% : 0.000002s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.84% : 0.000006s : 4: substitution.graph_param_transform 83.58% : 0.000176s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000006s : 4: substitution.remove_not_recompute_node 2.25% : 0.000005s : 2: substitution.replace_old_param 5.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101235 2 97.73% : 0.098937s : 1: type_inference.infer 2.27% : 0.002299s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.36% : 0.000046s : 4: replace.inline 32.64% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 94.00% : 0.000174s : 4: match.inline 6.00% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.69% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000001s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000001s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.38% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.55% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.64% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.74% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000001s : 12: predicate.print_const_string_wrapper 1.91% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000001s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000001s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001899 22 67.73% : 0.001286s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.35% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.91% : 0.000568s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114397 72 0.04% : 0.000047s : 1: add_recomputation 0.05% : 0.000060s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.22% : 0.000257s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.98% : 0.006839s : 1: jit_opt_a 0.14% : 0.000157s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.44% : 0.000506s : 1: loop_unroll 0.48% : 0.000548s : 1: mutable_eliminate 0.79% : 0.000909s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000083s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000411s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.38% : 0.001584s : 1: renormalize.infer 0.54% : 0.000620s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.11% : 0.000126s : 1: symbol_engine_optimizer 88.56% : 0.101310s : 1: type_inference TotalTime = 0.0617559, [30] [bootstrap]: 0.00025902 [type_inference]: 0.0519751 [event_method]: 1.864e-05 [auto_monad]: 6.186e-05 [graph_reusing]: 5.04998e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 0.00024219 [rewriter_before_opt_a]: 7.972e-05 [expand_dump_flag]: 3.75998e-06 [jit_opt_a]: 0.00690159, [2] [Cycle 1]: 0.00307248, [27] [switch_simplify]: 5.881e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00059864 [with_stream_mark]: 1.883e-05 [recompute_prepare]: 7.97998e-06 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.73997e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 6.63e-06 [merge_forward]: 3.97002e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.501e-05 [j_node_and_user_rematch]: 1.023e-05 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 1.039e-05 [inline_without_move]: 6.03002e-06 [renormalize]: 0.00203826 [add_forward_monad_depend]: 5.10999e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 1.363e-05 [cse]: 2.196e-05 [replace_applicator]: 1.477e-05 [Cycle 2]: 0.00035906, [27] [switch_simplify]: 6.76999e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012222 [with_stream_mark]: 9.95002e-06 [recompute_prepare]: 5.61e-06 [updatestate_depend_eliminate]: 2.78998e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 1.95001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 5.31002e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 2.21e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.384e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 1.66e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.329e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 8.84e-06 [rewriter_after_opt_a]: 2.649e-05 [convert_after_rewriter]: 5.69999e-06 [order_py_execute_after_rewriter]: 3.86999e-06 [mutable_eliminate]: 0.00058394 [jit_opt_b]: 5.265e-05, [1] [Cycle 1]: 4.662e-05, [2] [frontend_op_eliminate]: 1.886e-05 [inline_after_opt_a]: 1.666e-05 [cconv]: 1.582e-05 [loop_unroll]: 0.00042813 [jit_opt_after_cconv]: 0.00014721, [1] [Cycle 1]: 0.0001406, [11] [c_1]: 2.554e-05 [parameter_eliminate]: 2.28002e-06 [updatestate_depend_eliminate]: 5.96e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.05e-05 [call_graph_tuple_transform]: 1.943e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 9.90025e-07 [renormalize]: 4.89992e-07 [switch_simplify]: 5.90002e-06 [remove_dup_value]: 8.93002e-06 [partial_unused_args_eliminate]: 1.45001e-06 [environ_conv]: 7.2e-06 [add_recomputation]: 3.452e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.659e-05, [1] [cse]: 1.045e-05 [auto_monad_reorder]: 1.071e-05 [get_jit_bprop_graph]: 1.91003e-06 [rewriter_after_jit_bprop_graph]: 5.54e-06 [opt_after_jit_grad]: 0.0005318 [symbol_engine_optimizer]: 0.00010735, [1] [Cycle 1]: 0.00010062, [6] [build]: 3.68e-06 [elim_shapecalc]: 8.96998e-06 [elim_not_effective]: 1.53e-05 [opt_reshape]: 7.11999e-06 [fold_const_symbol]: 9.57001e-06 [renormalize]: 4.00003e-07 [validate]: 3.733e-05 Sums bootstrap : 0.000259s : 0.45% type_inference : 0.051975s : 90.09% event_method : 0.000019s : 0.03% auto_monad : 0.000062s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000242s : 0.42% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000721s : 1.25% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002038s : 3.53% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.03% jit_opt_a.cse : 0.000035s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000026s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000584s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000428s : 0.74% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.02% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000011s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000532s : 0.92% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.06% Time group info: ------[substitution.] 0.000233 24 0.61% : 0.000001s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 1.84% : 0.000004s : 4: substitution.graph_param_transform 85.66% : 0.000199s : 4: substitution.inline 1.65% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000005s : 2: substitution.replace_old_param 5.33% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051905 2 96.67% : 0.050177s : 1: type_inference.infer 3.33% : 0.001729s : 1: type_inference.specialize ------[replace.] 0.000073 6 66.83% : 0.000048s : 4: replace.inline 33.17% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.56% : 0.000197s : 4: match.inline 5.44% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.34% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.09% : 0.000001s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.46% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.39% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.32% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.98% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.06% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 1.94% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.86% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002150 26 70.82% : 0.001522s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.20% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.99% : 0.000580s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064829 72 0.06% : 0.000037s : 1: add_recomputation 0.10% : 0.000065s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.42% : 0.000270s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.65% : 0.006905s : 1: jit_opt_a 0.23% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.67% : 0.000436s : 1: loop_unroll 0.91% : 0.000593s : 1: mutable_eliminate 1.47% : 0.000954s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000543s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000248s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000011s : 1: remove_dup_value 2.14% : 0.001390s : 1: renormalize.infer 0.99% : 0.000639s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000029s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.17% : 0.000110s : 1: symbol_engine_optimizer 80.19% : 0.051989s : 1: type_inference TotalTime = 0.0131193, [30] [bootstrap]: 0.00026336 [type_inference]: 0.00469325 [event_method]: 1.811e-05 [auto_monad]: 6.732e-05 [graph_reusing]: 5.80002e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 3.881e-05 [rewriter_before_opt_a]: 7.246e-05 [expand_dump_flag]: 2.96999e-06 [jit_opt_a]: 0.00567587, [2] [Cycle 1]: 0.0017288, [27] [switch_simplify]: 5.974e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00056083 [with_stream_mark]: 2.063e-05 [recompute_prepare]: 9.39e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.41001e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.75001e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.11003e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 1.024e-05 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 8.65999e-06 [inline_without_move]: 5.38002e-06 [renormalize]: 0.00071867 [add_forward_monad_depend]: 5.72001e-06 [auto_monad_grad]: 2.02999e-06 [auto_monad_eliminator]: 1.49e-05 [cse]: 2.384e-05 [replace_applicator]: 1.292e-05 [Cycle 2]: 0.00031548, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 5.01997e-06 [a_1]: 8.892e-05 [with_stream_mark]: 8.32e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 1.98002e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.80999e-06 [accelerated_algorithm]: 5.07999e-06 [meta_shard_fg_expand]: 1.05001e-06 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.44001e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 7.48e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 7.41999e-06 [inline_without_move]: 4.99e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.34998e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 7.17002e-06 [cse]: 1.222e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 1.219e-05 [rewriter_after_opt_a]: 3.652e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00061862 [jit_opt_b]: 4.986e-05, [1] [Cycle 1]: 4.281e-05, [2] [frontend_op_eliminate]: 1.602e-05 [inline_after_opt_a]: 1.551e-05 [cconv]: 2.656e-05 [loop_unroll]: 0.00047561 [jit_opt_after_cconv]: 0.00015312, [1] [Cycle 1]: 0.00014643, [11] [c_1]: 2.066e-05 [parameter_eliminate]: 4.16001e-06 [updatestate_depend_eliminate]: 7.11999e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.24999e-06 [cse]: 2.517e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 5.42001e-06 [none_parameter_eliminate]: 2.32999e-06 [renormalize]: 8.10018e-07 [switch_simplify]: 5.10999e-06 [remove_dup_value]: 1.481e-05 [partial_unused_args_eliminate]: 2.68e-06 [environ_conv]: 6.23e-06 [add_recomputation]: 5.165e-05 [cse_after_recomputation]: 2.468e-05, [1] [Cycle 1]: 1.812e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.526e-05 [get_jit_bprop_graph]: 2.12999e-06 [rewriter_after_jit_bprop_graph]: 6.38003e-06 [opt_after_jit_grad]: 0.00047415 [symbol_engine_optimizer]: 7.49e-05, [1] [Cycle 1]: 6.825e-05, [6] [build]: 4.12998e-06 [elim_shapecalc]: 7.98001e-06 [elim_not_effective]: 1.399e-05 [opt_reshape]: 5.57999e-06 [fold_const_symbol]: 8.37998e-06 [renormalize]: 4.19997e-07 [validate]: 3.911e-05 Sums bootstrap : 0.000263s : 2.96% type_inference : 0.004693s : 52.79% event_method : 0.000018s : 0.20% auto_monad : 0.000067s : 0.76% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000039s : 0.44% rewriter_before_opt_a : 0.000072s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.74% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000650s : 7.31% jit_opt_a.with_stream_mark : 0.000029s : 0.33% jit_opt_a.recompute_prepare : 0.000014s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000719s : 8.08% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.25% jit_opt_a.cse : 0.000036s : 0.41% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000037s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000619s : 6.96% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.17% cconv : 0.000027s : 0.30% loop_unroll : 0.000476s : 5.35% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000025s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000052s : 0.58% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000474s : 5.33% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.44% Time group info: ------[substitution.] 0.000227 23 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000006s : 3: substitution.graph_param_transform 84.31% : 0.000191s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.46% : 0.000006s : 4: substitution.remove_not_recompute_node 1.86% : 0.000004s : 2: substitution.replace_old_param 5.38% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004628 2 81.67% : 0.003779s : 1: type_inference.infer 18.33% : 0.000848s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.39% : 0.000047s : 4: replace.inline 31.61% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.42% : 0.000189s : 4: match.inline 5.58% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000117 691 1.22% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.52% : 0.000003s : 10: predicate.arithmetic_simplify 1.18% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.17% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.98% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.73% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.19% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.08% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.82% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 2.01% : 0.000002s : 18: predicate.replace_applicator 0.66% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.75% : 0.000009s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.38% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.74% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.75% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000632 13 50.38% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.20% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.42% : 0.000268s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014762 72 0.37% : 0.000055s : 1: add_recomputation 0.48% : 0.000072s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 1.88% : 0.000277s : 1: bootstrap 0.20% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 38.47% : 0.005679s : 1: jit_opt_a 1.06% : 0.000156s : 1: jit_opt_after_cconv 0.36% : 0.000053s : 1: jit_opt_b 3.29% : 0.000485s : 1: loop_unroll 4.26% : 0.000628s : 1: mutable_eliminate 5.89% : 0.000869s : 26: opt.transform.jit_opt_a 0.33% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.16% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.28% : 0.000484s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000041s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.78% : 0.000410s : 1: renormalize.infer 2.04% : 0.000301s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000040s : 1: rewriter_after_opt_a 0.51% : 0.000075s : 1: rewriter_before_opt_a 0.52% : 0.000077s : 1: symbol_engine_optimizer 31.91% : 0.004711s : 1: type_inference TotalTime = 0.0116507, [30] [bootstrap]: 0.00026775 [type_inference]: 0.00462105 [event_method]: 1.66e-05 [auto_monad]: 5.79e-05 [graph_reusing]: 5.34e-06 [pre_auto_parallel]: 1.87999e-06 [py_interpret_to_execute]: 3.434e-05 [rewriter_before_opt_a]: 7.014e-05 [expand_dump_flag]: 2.56e-06 [jit_opt_a]: 0.0046832, [2] [Cycle 1]: 0.00148447, [27] [switch_simplify]: 4.859e-05 [loop_unroll]: 2.927e-05 [a_1]: 0.00048688 [with_stream_mark]: 1.356e-05 [recompute_prepare]: 7.3e-06 [updatestate_depend_eliminate]: 3.10998e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.34998e-06 [specialize_transform]: 6.26e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.62001e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.173e-05 [j_node_and_user_rematch]: 9.02999e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 8.1e-06 [inline_without_move]: 4.94998e-06 [renormalize]: 0.00061618 [add_forward_monad_depend]: 5.14e-06 [auto_monad_grad]: 1.77001e-06 [auto_monad_eliminator]: 1.264e-05 [cse]: 2.191e-05 [replace_applicator]: 1.126e-05 [Cycle 2]: 0.00030868, [27] [switch_simplify]: 5.63002e-06 [loop_unroll]: 4.87998e-06 [a_1]: 8.895e-05 [with_stream_mark]: 9.54e-06 [recompute_prepare]: 4.95001e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.87999e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 4.90001e-06 [accelerated_algorithm]: 4.63999e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.26002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.252e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 1.71e-06 [replace_old_param]: 7.16999e-06 [inline_without_move]: 4.75999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.018e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 8.70999e-06 [rewriter_after_opt_a]: 2.853e-05 [convert_after_rewriter]: 5.86998e-06 [order_py_execute_after_rewriter]: 5.29e-06 [mutable_eliminate]: 0.00046167 [jit_opt_b]: 4.646e-05, [1] [Cycle 1]: 4.062e-05, [2] [frontend_op_eliminate]: 1.492e-05 [inline_after_opt_a]: 1.539e-05 [cconv]: 2.208e-05 [loop_unroll]: 0.00039288 [jit_opt_after_cconv]: 0.00013387, [1] [Cycle 1]: 0.00012745, [11] [c_1]: 1.983e-05 [parameter_eliminate]: 2.74001e-06 [updatestate_depend_eliminate]: 5.15001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.812e-05 [call_graph_tuple_transform]: 1.793e-05 [tuple_list_get_item_eliminator]: 5.18002e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.162e-05 [partial_unused_args_eliminate]: 2.32999e-06 [environ_conv]: 4.63999e-06 [add_recomputation]: 3.928e-05 [cse_after_recomputation]: 2.167e-05, [1] [Cycle 1]: 1.655e-05, [1] [cse]: 1.077e-05 [auto_monad_reorder]: 1.165e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 3.90998e-06 [opt_after_jit_grad]: 0.00043127 [symbol_engine_optimizer]: 7.013e-05, [1] [Cycle 1]: 6.438e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 7.78999e-06 [elim_not_effective]: 1.262e-05 [opt_reshape]: 5.56e-06 [fold_const_symbol]: 8.26002e-06 [renormalize]: 3.7998e-07 [validate]: 2.89e-05 Sums bootstrap : 0.000268s : 3.25% type_inference : 0.004621s : 56.18% event_method : 0.000017s : 0.20% auto_monad : 0.000058s : 0.70% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.42% rewriter_before_opt_a : 0.000070s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.66% jit_opt_a.loop_unroll : 0.000034s : 0.42% jit_opt_a.a_1 : 0.000576s : 7.00% jit_opt_a.with_stream_mark : 0.000023s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000616s : 7.49% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.22% jit_opt_a.cse : 0.000032s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000029s : 0.35% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000462s : 5.61% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000022s : 0.27% loop_unroll : 0.000393s : 4.78% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000012s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000039s : 0.48% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000012s : 0.14% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000431s : 5.24% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.35% Time group info: ------[substitution.] 0.000167 23 1.10% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 3.00% : 0.000005s : 3: substitution.graph_param_transform 83.00% : 0.000138s : 4: substitution.inline 1.89% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000004s : 4: substitution.remove_not_recompute_node 1.83% : 0.000003s : 2: substitution.replace_old_param 5.95% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004555 2 80.76% : 0.003679s : 1: type_inference.infer 19.24% : 0.000876s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.31% : 0.000044s : 4: replace.inline 32.69% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 93.91% : 0.000136s : 4: match.inline 6.09% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.31% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.36% : 0.000000s : 3: predicate.graph_param_transform 5.28% : 0.000006s : 22: predicate.inline 1.00% : 0.000001s : 6: predicate.inline_without_move 0.47% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.51% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.86% : 0.000002s : 15: predicate.load_eliminater 1.34% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.42% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.64% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.12% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000001s : 10: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.08% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.93% : 0.000009s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.43% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.85% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000624 13 50.93% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.45% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.62% : 0.000279s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013108 72 0.32% : 0.000042s : 1: add_recomputation 0.47% : 0.000061s : 1: auto_monad 0.11% : 0.000014s : 1: auto_monad_reorder 2.16% : 0.000284s : 1: bootstrap 0.19% : 0.000025s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.12% : 0.000015s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 35.75% : 0.004686s : 1: jit_opt_a 1.04% : 0.000136s : 1: jit_opt_after_cconv 0.37% : 0.000049s : 1: jit_opt_b 3.06% : 0.000401s : 1: loop_unroll 3.59% : 0.000470s : 1: mutable_eliminate 5.91% : 0.000775s : 26: opt.transform.jit_opt_a 0.35% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000439s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 2.61% : 0.000342s : 1: renormalize.infer 2.04% : 0.000268s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000031s : 1: rewriter_after_opt_a 0.56% : 0.000073s : 1: rewriter_before_opt_a 0.55% : 0.000073s : 1: symbol_engine_optimizer 35.33% : 0.004632s : 1: type_inference TotalTime = 0.11176, [30] [bootstrap]: 0.00028329 [type_inference]: 0.102062 [event_method]: 1.757e-05 [auto_monad]: 5.645e-05 [graph_reusing]: 4.76002e-06 [pre_auto_parallel]: 1.66e-06 [py_interpret_to_execute]: 0.00038998 [rewriter_before_opt_a]: 8.067e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00663374, [2] [Cycle 1]: 0.00329319, [27] [switch_simplify]: 0.0001019 [loop_unroll]: 3.028e-05 [a_1]: 0.00050427 [with_stream_mark]: 1.187e-05 [recompute_prepare]: 8.50999e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 6.11998e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.141e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.27e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00233685 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 2.06e-06 [auto_monad_eliminator]: 1.426e-05 [cse]: 2.222e-05 [replace_applicator]: 1.488e-05 [Cycle 2]: 0.00035027, [27] [switch_simplify]: 6.34001e-06 [loop_unroll]: 5.30999e-06 [a_1]: 0.00011585 [with_stream_mark]: 9.25999e-06 [recompute_prepare]: 5.76998e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.48002e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 2.59001e-06 [cell_reuse_recompute_pass]: 2.09999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.429e-05 [j_node_and_user_rematch]: 8.92e-06 [meta_fg_expand]: 1.76998e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.67001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.17001e-06 [cse]: 1.096e-05 [replace_applicator]: 6.12999e-06 [py_interpret_to_execute_after_opt_a]: 9.66e-06 [rewriter_after_opt_a]: 3.116e-05 [convert_after_rewriter]: 6.16998e-06 [order_py_execute_after_rewriter]: 4.79998e-06 [mutable_eliminate]: 0.00054686 [jit_opt_b]: 5.373e-05, [1] [Cycle 1]: 4.702e-05, [2] [frontend_op_eliminate]: 1.821e-05 [inline_after_opt_a]: 1.811e-05 [cconv]: 2.296e-05 [loop_unroll]: 0.00047538 [jit_opt_after_cconv]: 0.00015503, [1] [Cycle 1]: 0.00014754, [11] [c_1]: 2.608e-05 [parameter_eliminate]: 3.31001e-06 [updatestate_depend_eliminate]: 5.65001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.141e-05 [call_graph_tuple_transform]: 2.224e-05 [tuple_list_get_item_eliminator]: 6.44001e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.066e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 7.66999e-06 [add_recomputation]: 3.92e-05 [cse_after_recomputation]: 2.198e-05, [1] [Cycle 1]: 1.678e-05, [1] [cse]: 1.082e-05 [auto_monad_reorder]: 1.282e-05 [get_jit_bprop_graph]: 1.40001e-06 [rewriter_after_jit_bprop_graph]: 5.23002e-06 [opt_after_jit_grad]: 0.00050957 [symbol_engine_optimizer]: 7.831e-05, [1] [Cycle 1]: 7.13e-05, [6] [build]: 3.83001e-06 [elim_shapecalc]: 9.39e-06 [elim_not_effective]: 1.546e-05 [opt_reshape]: 6.46e-06 [fold_const_symbol]: 9.40001e-06 [renormalize]: 3.60014e-07 [validate]: 5.415e-05 Sums bootstrap : 0.000283s : 0.26% type_inference : 0.102062s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000056s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000390s : 0.36% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000108s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000620s : 0.57% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002337s : 2.16% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000547s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000475s : 0.44% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000039s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000510s : 0.47% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.05% Time group info: ------[substitution.] 0.000163 24 1.39% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 3.72% : 0.000006s : 4: substitution.graph_param_transform 81.56% : 0.000133s : 4: substitution.inline 2.31% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.60% : 0.000004s : 4: substitution.remove_not_recompute_node 2.38% : 0.000004s : 2: substitution.replace_old_param 5.29% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101999 2 97.51% : 0.099460s : 1: type_inference.infer 2.49% : 0.002539s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.59% : 0.000042s : 4: replace.inline 33.41% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 6 94.53% : 0.000131s : 4: match.inline 5.47% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.51% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.49% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.78% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000001s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.35% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.65% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.16% : 0.000001s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000001s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.61% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.74% : 0.000009s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.96% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.48% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001990 22 67.62% : 0.001345s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.39% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.00% : 0.000617s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115061 72 0.04% : 0.000042s : 1: add_recomputation 0.05% : 0.000060s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.26% : 0.000300s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.77% : 0.006637s : 1: jit_opt_a 0.14% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.42% : 0.000486s : 1: loop_unroll 0.48% : 0.000556s : 1: mutable_eliminate 0.78% : 0.000893s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000521s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000396s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.47% : 0.001696s : 1: renormalize.infer 0.55% : 0.000634s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.07% : 0.000081s : 1: symbol_engine_optimizer 88.72% : 0.102078s : 1: type_inference TotalTime = 0.114962, [30] [bootstrap]: 0.00026341 [type_inference]: 0.103474 [event_method]: 1.926e-05 [auto_monad]: 7.369e-05 [graph_reusing]: 5.37001e-06 [pre_auto_parallel]: 2.53e-06 [py_interpret_to_execute]: 0.00046239 [rewriter_before_opt_a]: 8.803e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00793959, [2] [Cycle 1]: 0.00390096, [27] [switch_simplify]: 6.127e-05 [loop_unroll]: 3.053e-05 [a_1]: 0.00056844 [with_stream_mark]: 3.765e-05 [recompute_prepare]: 9.87001e-06 [updatestate_depend_eliminate]: 4.90999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.35003e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.56001e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.75002e-06 [get_grad_eliminate_]: 6.21998e-06 [merge_forward]: 4.38999e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.707e-05 [j_node_and_user_rematch]: 9.85002e-06 [meta_fg_expand]: 2.72001e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00281988 [add_forward_monad_depend]: 7.97003e-06 [auto_monad_grad]: 2.18998e-06 [auto_monad_eliminator]: 1.966e-05 [cse]: 3.574e-05 [replace_applicator]: 2.065e-05 [Cycle 2]: 0.00039918, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 6.54999e-06 [a_1]: 0.00012962 [with_stream_mark]: 1.471e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 3.00002e-06 [parameter_eliminate]: 2.08002e-06 [specialize_transform]: 5.94999e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.48998e-06 [get_grad_eliminate_]: 5.46e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 3.38999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.908e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 3.10998e-06 [replace_old_param]: 1.069e-05 [inline_without_move]: 5.87999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.34003e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 7.21001e-06 [cse]: 1.365e-05 [replace_applicator]: 6.03002e-06 [py_interpret_to_execute_after_opt_a]: 1.215e-05 [rewriter_after_opt_a]: 3.813e-05 [convert_after_rewriter]: 7.28999e-06 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00084599 [jit_opt_b]: 5.92e-05, [1] [Cycle 1]: 5.137e-05, [2] [frontend_op_eliminate]: 2.013e-05 [inline_after_opt_a]: 1.939e-05 [cconv]: 2.869e-05 [loop_unroll]: 0.00049056 [jit_opt_after_cconv]: 0.00018026, [1] [Cycle 1]: 0.00017329, [11] [c_1]: 2.589e-05 [parameter_eliminate]: 4.37e-06 [updatestate_depend_eliminate]: 8.23001e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 3.557e-05 [call_graph_tuple_transform]: 2.345e-05 [tuple_list_get_item_eliminator]: 6.10002e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 9.99979e-07 [switch_simplify]: 6.25002e-06 [remove_dup_value]: 1.615e-05 [partial_unused_args_eliminate]: 2.68998e-06 [environ_conv]: 1.083e-05 [add_recomputation]: 5.695e-05 [cse_after_recomputation]: 2.555e-05, [1] [Cycle 1]: 1.882e-05, [1] [cse]: 1.231e-05 [auto_monad_reorder]: 1.62e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 6.61999e-06 [opt_after_jit_grad]: 0.00049461 [symbol_engine_optimizer]: 8.678e-05, [1] [Cycle 1]: 8.058e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.86002e-06 [elim_not_effective]: 1.71e-05 [opt_reshape]: 6.19999e-06 [fold_const_symbol]: 1.404e-05 [renormalize]: 3.30008e-07 [validate]: 5.06e-05 Sums bootstrap : 0.000263s : 0.24% type_inference : 0.103474s : 93.48% event_method : 0.000019s : 0.02% auto_monad : 0.000074s : 0.07% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000462s : 0.42% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000698s : 0.63% jit_opt_a.with_stream_mark : 0.000052s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002820s : 2.55% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000846s : 0.76% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000491s : 0.44% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000036s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000011s : 0.01% add_recomputation : 0.000057s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000495s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.05% Time group info: ------[substitution.] 0.000214 24 2.16% : 0.000005s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 3.44% : 0.000007s : 4: substitution.graph_param_transform 79.92% : 0.000171s : 4: substitution.inline 1.87% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.05% : 0.000007s : 4: substitution.remove_not_recompute_node 2.79% : 0.000006s : 2: substitution.replace_old_param 6.22% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103396 2 97.20% : 0.100501s : 1: type_inference.infer 2.80% : 0.002895s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.42% : 0.000050s : 4: replace.inline 32.58% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.27% : 0.000169s : 4: match.inline 6.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.38% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.09% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 5.57% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.40% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.59% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.00% : 0.000001s : 12: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.89% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.12% : 0.000010s : 58: predicate.switch_simplify 1.16% : 0.000002s : 12: predicate.tile_eliminate 1.55% : 0.000002s : 12: predicate.transpose_eliminate 1.28% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 5.02% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.74% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002114 22 62.26% : 0.001316s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.50% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.24% : 0.000766s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118807 72 0.05% : 0.000061s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000275s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.69% : 0.007943s : 1: jit_opt_a 0.15% : 0.000184s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.42% : 0.000499s : 1: loop_unroll 0.72% : 0.000858s : 1: mutable_eliminate 0.80% : 0.000951s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000504s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000469s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000022s : 1: remove_dup_value 1.74% : 0.002062s : 1: renormalize.infer 0.63% : 0.000747s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.08% : 0.000089s : 1: symbol_engine_optimizer 87.11% : 0.103495s : 1: type_inference TotalTime = 0.0519764, [30] [bootstrap]: 0.00031744 [type_inference]: 0.0418109 [event_method]: 2.127e-05 [auto_monad]: 8.725e-05 [graph_reusing]: 7.84002e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.00026341 [rewriter_before_opt_a]: 8.699e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.006674, [2] [Cycle 1]: 0.00271362, [27] [switch_simplify]: 6.364e-05 [loop_unroll]: 3.039e-05 [a_1]: 0.00059044 [with_stream_mark]: 2.313e-05 [recompute_prepare]: 9.15999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 3.36999e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.89999e-06 [specialize_transform]: 7.18998e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 2.73998e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 4.23001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.659e-05 [j_node_and_user_rematch]: 9.60001e-06 [meta_fg_expand]: 2.96001e-06 [replace_old_param]: 1.118e-05 [inline_without_move]: 6.28998e-06 [renormalize]: 0.00161447 [add_forward_monad_depend]: 7.7e-06 [auto_monad_grad]: 2.95998e-06 [auto_monad_eliminator]: 1.797e-05 [cse]: 3.467e-05 [replace_applicator]: 1.926e-05 [Cycle 2]: 0.00038355, [27] [switch_simplify]: 7.15003e-06 [loop_unroll]: 6.29001e-06 [a_1]: 0.00012345 [with_stream_mark]: 1.284e-05 [recompute_prepare]: 5.94999e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 2.31e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.76e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 2.94001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 9.86e-06 [meta_fg_expand]: 2.86e-06 [replace_old_param]: 8.64998e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.33002e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.278e-05 [replace_applicator]: 6.59999e-06 [py_interpret_to_execute_after_opt_a]: 1.321e-05 [rewriter_after_opt_a]: 3.796e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00075242 [jit_opt_b]: 0.00011869, [1] [Cycle 1]: 0.00010902, [2] [frontend_op_eliminate]: 1.974e-05 [inline_after_opt_a]: 7.518e-05 [cconv]: 2.874e-05 [loop_unroll]: 0.00051184 [jit_opt_after_cconv]: 0.00017641, [1] [Cycle 1]: 0.00016775, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 3.93001e-06 [updatestate_depend_eliminate]: 7.47002e-06 [updatestate_assign_eliminate]: 3.01999e-06 [updatestate_loads_eliminate]: 3.04999e-06 [cse]: 3.518e-05 [call_graph_tuple_transform]: 2.313e-05 [tuple_list_get_item_eliminator]: 6.84001e-06 [none_parameter_eliminate]: 1.46998e-06 [renormalize]: 1.50001e-06 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.631e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 7.6e-06 [add_recomputation]: 8.129e-05 [cse_after_recomputation]: 2.854e-05, [1] [Cycle 1]: 2.197e-05, [1] [cse]: 1.35e-05 [auto_monad_reorder]: 1.72e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 7.28e-06 [opt_after_jit_grad]: 0.00055943 [symbol_engine_optimizer]: 8.793e-05, [1] [Cycle 1]: 8.07e-05, [6] [build]: 4.97999e-06 [elim_shapecalc]: 1.01e-05 [elim_not_effective]: 1.713e-05 [opt_reshape]: 7.58999e-06 [fold_const_symbol]: 1.197e-05 [renormalize]: 7.79983e-07 [validate]: 4.227e-05 Sums bootstrap : 0.000317s : 0.66% type_inference : 0.041811s : 87.56% event_method : 0.000021s : 0.04% auto_monad : 0.000087s : 0.18% graph_reusing : 0.000008s : 0.02% pre_auto_parallel : 0.000003s : 0.01% py_interpret_to_execute : 0.000263s : 0.55% rewriter_before_opt_a : 0.000087s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000071s : 0.15% jit_opt_a.loop_unroll : 0.000037s : 0.08% jit_opt_a.a_1 : 0.000714s : 1.50% jit_opt_a.with_stream_mark : 0.000036s : 0.08% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.04% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001615s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.05% jit_opt_a.cse : 0.000047s : 0.10% jit_opt_a.replace_applicator : 0.000026s : 0.05% py_interpret_to_execute_after_opt_a : 0.000013s : 0.03% rewriter_after_opt_a : 0.000038s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000752s : 1.58% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000075s : 0.16% cconv : 0.000029s : 0.06% loop_unroll : 0.000512s : 1.07% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000035s : 0.07% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000002s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000081s : 0.17% cse_after_recomputation.cse : 0.000014s : 0.03% auto_monad_reorder : 0.000017s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.02% opt_after_jit_grad : 0.000559s : 1.17% symbol_engine_optimizer.build : 0.000005s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.04% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.03% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000042s : 0.09% Time group info: ------[substitution.] 0.000222 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.96% : 0.000002s : 2: substitution.fold_const_symbol 2.97% : 0.000007s : 4: substitution.graph_param_transform 81.96% : 0.000182s : 4: substitution.inline 1.91% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000005s : 2: substitution.replace_old_param 6.18% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.041721 2 95.08% : 0.039667s : 1: type_inference.infer 4.92% : 0.002054s : 1: type_inference.specialize ------[replace.] 0.000077 6 65.94% : 0.000051s : 4: replace.inline 34.06% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 93.44% : 0.000179s : 4: match.inline 6.56% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.65% : 0.000002s : 12: predicate.accumulaten_eliminater 1.42% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.14% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.66% : 0.000001s : 4: predicate.elim_not_effective 0.72% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.09% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000003s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 0.98% : 0.000001s : 12: predicate.minmaximum_grad 1.91% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.47% : 0.000002s : 12: predicate.reduce_eliminate 1.24% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.26% : 0.000002s : 4: predicate.row_tensor_eliminate 1.09% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.58% : 0.000004s : 18: predicate.switch_defer_inline 1.88% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.24% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 5.20% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.67% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001645 18 68.12% : 0.001121s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.98% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.90% : 0.000492s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.054692 72 0.15% : 0.000085s : 1: add_recomputation 0.17% : 0.000091s : 1: auto_monad 0.04% : 0.000020s : 1: auto_monad_reorder 0.60% : 0.000330s : 1: bootstrap 0.06% : 0.000032s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.06% : 0.000031s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.05% : 0.000027s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.02% : 0.000011s : 1: graph_reusing 12.21% : 0.006678s : 1: jit_opt_a 0.33% : 0.000179s : 1: jit_opt_after_cconv 0.22% : 0.000122s : 1: jit_opt_b 0.95% : 0.000520s : 1: loop_unroll 1.40% : 0.000764s : 1: mutable_eliminate 1.76% : 0.000962s : 26: opt.transform.jit_opt_a 0.11% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000087s : 4: opt.transform.jit_opt_b 0.03% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000018s : 1: opt.transform.mutable_eliminate 0.05% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000042s : 4: opt.transform.symbol_engine_opt 1.04% : 0.000569s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.49% : 0.000269s : 1: py_interpret_to_execute 0.03% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.89% : 0.001031s : 1: renormalize.infer 1.04% : 0.000571s : 1: renormalize.specialize 0.02% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000041s : 1: rewriter_after_opt_a 0.17% : 0.000092s : 1: rewriter_before_opt_a 0.17% : 0.000091s : 1: symbol_engine_optimizer 76.49% : 0.041833s : 1: type_inference TotalTime = 0.0143299, [30] [bootstrap]: 0.00034526 [type_inference]: 0.00533301 [event_method]: 1.878e-05 [auto_monad]: 7.04e-05 [graph_reusing]: 6.23002e-06 [pre_auto_parallel]: 2.68e-06 [py_interpret_to_execute]: 4.541e-05 [rewriter_before_opt_a]: 7.564e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00590076, [2] [Cycle 1]: 0.00186384, [27] [switch_simplify]: 6.158e-05 [loop_unroll]: 3.02e-05 [a_1]: 0.00062199 [with_stream_mark]: 2.098e-05 [recompute_prepare]: 8.94e-06 [updatestate_depend_eliminate]: 4.54998e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.11e-06 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.17001e-06 [get_grad_eliminate_]: 5.17999e-06 [merge_forward]: 4.89998e-06 [cell_reuse_recompute_pass]: 1.68002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.619e-05 [j_node_and_user_rematch]: 9.42001e-06 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.48002e-06 [renormalize]: 0.00077364 [add_forward_monad_depend]: 6.31e-06 [auto_monad_grad]: 2.01003e-06 [auto_monad_eliminator]: 1.48e-05 [cse]: 3.256e-05 [replace_applicator]: 1.654e-05 [Cycle 2]: 0.00032863, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 4.94003e-06 [a_1]: 9.207e-05 [with_stream_mark]: 1.042e-05 [recompute_prepare]: 5.27999e-06 [updatestate_depend_eliminate]: 3.21999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 4.99e-06 [updatestate_useless_node_eliminater]: 4.78001e-06 [accelerated_algorithm]: 4.53001e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 4.70999e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.502e-05 [j_node_and_user_rematch]: 8.31002e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 7.49002e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.09003e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 5.91998e-06 [cse]: 1.138e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.173e-05 [rewriter_after_opt_a]: 3.436e-05 [convert_after_rewriter]: 7.42002e-06 [order_py_execute_after_rewriter]: 4.99e-06 [mutable_eliminate]: 0.00073594 [jit_opt_b]: 5.338e-05, [1] [Cycle 1]: 4.489e-05, [2] [frontend_op_eliminate]: 1.715e-05 [inline_after_opt_a]: 1.687e-05 [cconv]: 3.236e-05 [loop_unroll]: 0.00044367 [jit_opt_after_cconv]: 0.00015954, [1] [Cycle 1]: 0.00015331, [11] [c_1]: 2.147e-05 [parameter_eliminate]: 5.05999e-06 [updatestate_depend_eliminate]: 6.37001e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 3.16001e-06 [cse]: 2.93e-05 [call_graph_tuple_transform]: 2.097e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 6.02999e-06 [remove_dup_value]: 1.678e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 6.84999e-06 [add_recomputation]: 5.666e-05 [cse_after_recomputation]: 2.608e-05, [1] [Cycle 1]: 2.021e-05, [1] [cse]: 1.371e-05 [auto_monad_reorder]: 1.712e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 7.5e-06 [opt_after_jit_grad]: 0.00058597 [symbol_engine_optimizer]: 7.922e-05, [1] [Cycle 1]: 7.065e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.90998e-06 [fold_const_symbol]: 9.05999e-06 [renormalize]: 5.39992e-07 [validate]: 4.442e-05 Sums bootstrap : 0.000345s : 3.45% type_inference : 0.005333s : 53.35% event_method : 0.000019s : 0.19% auto_monad : 0.000070s : 0.70% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000045s : 0.45% rewriter_before_opt_a : 0.000076s : 0.76% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000068s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.35% jit_opt_a.a_1 : 0.000714s : 7.14% jit_opt_a.with_stream_mark : 0.000031s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000010s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.18% jit_opt_a.meta_fg_expand : 0.000005s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.17% jit_opt_a.inline_without_move : 0.000010s : 0.10% jit_opt_a.renormalize : 0.000774s : 7.74% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.21% jit_opt_a.cse : 0.000044s : 0.44% jit_opt_a.replace_applicator : 0.000022s : 0.22% py_interpret_to_execute_after_opt_a : 0.000012s : 0.12% rewriter_after_opt_a : 0.000034s : 0.34% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000736s : 7.36% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.17% jit_opt_b.inline_after_opt_a : 0.000017s : 0.17% cconv : 0.000032s : 0.32% loop_unroll : 0.000444s : 4.44% jit_opt_after_cconv.c_1 : 0.000021s : 0.21% jit_opt_after_cconv.parameter_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000029s : 0.29% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.05% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000017s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000057s : 0.57% cse_after_recomputation.cse : 0.000014s : 0.14% auto_monad_reorder : 0.000017s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.08% opt_after_jit_grad : 0.000586s : 5.86% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000044s : 0.44% Time group info: ------[substitution.] 0.000284 23 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.46% : 0.000001s : 2: substitution.fold_const_symbol 2.12% : 0.000006s : 3: substitution.graph_param_transform 86.88% : 0.000247s : 4: substitution.inline 1.26% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.09% : 0.000006s : 4: substitution.remove_not_recompute_node 1.59% : 0.000005s : 2: substitution.replace_old_param 4.79% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005255 2 82.49% : 0.004335s : 1: type_inference.infer 17.51% : 0.000920s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.96% : 0.000049s : 4: replace.inline 32.04% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000256 6 95.21% : 0.000244s : 4: match.inline 4.79% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.41% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.65% : 0.000002s : 10: predicate.addn_zero_filter 1.60% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.60% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.27% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 10: predicate.environ_get_depend_swap 1.42% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.50% : 0.000001s : 3: predicate.graph_param_transform 5.38% : 0.000007s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.32% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 10: predicate.merge_addn 1.04% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 1.16% : 0.000001s : 3: predicate.opt_reshape 2.39% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000002s : 10: predicate.print_const_string_wrapper 2.27% : 0.000003s : 10: predicate.reduce_eliminate 1.34% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.48% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 16: predicate.switch_defer_inline 1.98% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.96% : 0.000010s : 53: predicate.switch_simplify 1.48% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000002s : 10: predicate.transpose_eliminate 1.35% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.73% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.67% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000688 13 52.74% : 0.000363s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.95% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.31% : 0.000291s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016097 72 0.37% : 0.000060s : 1: add_recomputation 0.46% : 0.000075s : 1: auto_monad 0.12% : 0.000019s : 1: auto_monad_reorder 2.24% : 0.000361s : 1: bootstrap 0.22% : 0.000035s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000028s : 1: cse_after_recomputation 0.06% : 0.000009s : 1: environ_conv 0.14% : 0.000023s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.68% : 0.005905s : 1: jit_opt_a 1.01% : 0.000162s : 1: jit_opt_after_cconv 0.35% : 0.000056s : 1: jit_opt_b 2.81% : 0.000452s : 1: loop_unroll 4.63% : 0.000746s : 1: mutable_eliminate 5.84% : 0.000940s : 26: opt.transform.jit_opt_a 0.31% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000027s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.71% : 0.000596s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.30% : 0.000048s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.24% : 0.000039s : 1: remove_dup_value 2.62% : 0.000421s : 1: renormalize.infer 2.14% : 0.000344s : 1: renormalize.specialize 0.06% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000037s : 1: rewriter_after_opt_a 0.49% : 0.000079s : 1: rewriter_before_opt_a 0.51% : 0.000082s : 1: symbol_engine_optimizer 33.24% : 0.005350s : 1: type_inference TotalTime = 0.0150365, [30] [bootstrap]: 0.00038147 [type_inference]: 0.00551999 [event_method]: 1.806e-05 [auto_monad]: 6.608e-05 [graph_reusing]: 6.64999e-06 [pre_auto_parallel]: 2.75997e-06 [py_interpret_to_execute]: 5.172e-05 [rewriter_before_opt_a]: 7.885e-05 [expand_dump_flag]: 2.93998e-06 [jit_opt_a]: 0.00620498, [2] [Cycle 1]: 0.0019475, [27] [switch_simplify]: 6.876e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.00056867 [with_stream_mark]: 2.126e-05 [recompute_prepare]: 8.22e-06 [updatestate_depend_eliminate]: 4.26001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.68002e-06 [meta_shard_fg_expand]: 2.74001e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.2e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.465e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.30002e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 0.00089117 [add_forward_monad_depend]: 6.88e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.662e-05 [cse]: 3.511e-05 [replace_applicator]: 1.817e-05 [Cycle 2]: 0.00042168, [27] [switch_simplify]: 6.01003e-06 [loop_unroll]: 5.69999e-06 [a_1]: 0.00015952 [with_stream_mark]: 1.485e-05 [recompute_prepare]: 6.26e-06 [updatestate_depend_eliminate]: 3.50998e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.51e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 5.21002e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 4.86002e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 3.04001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.745e-05 [j_node_and_user_rematch]: 8.91002e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.04e-06 [inline_without_move]: 5.04e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 1.12999e-06 [auto_monad_eliminator]: 9.04998e-06 [cse]: 1.52e-05 [replace_applicator]: 5.35999e-06 [py_interpret_to_execute_after_opt_a]: 1.453e-05 [rewriter_after_opt_a]: 3.854e-05 [convert_after_rewriter]: 7.56999e-06 [order_py_execute_after_rewriter]: 5.34e-06 [mutable_eliminate]: 0.00075383 [jit_opt_b]: 5.61e-05, [1] [Cycle 1]: 4.852e-05, [2] [frontend_op_eliminate]: 1.877e-05 [inline_after_opt_a]: 1.805e-05 [cconv]: 2.883e-05 [loop_unroll]: 0.00051284 [jit_opt_after_cconv]: 0.00017364, [1] [Cycle 1]: 0.00016633, [11] [c_1]: 2.298e-05 [parameter_eliminate]: 3.7e-06 [updatestate_depend_eliminate]: 6.17999e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 3.92e-05 [call_graph_tuple_transform]: 2.338e-05 [tuple_list_get_item_eliminator]: 6.18002e-06 [none_parameter_eliminate]: 1.90001e-06 [renormalize]: 4.80009e-07 [switch_simplify]: 5.32001e-06 [remove_dup_value]: 1.71e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 5.604e-05 [cse_after_recomputation]: 2.577e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.235e-05 [auto_monad_reorder]: 1.677e-05 [get_jit_bprop_graph]: 2.19001e-06 [rewriter_after_jit_bprop_graph]: 8.97e-06 [opt_after_jit_grad]: 0.00062461 [symbol_engine_optimizer]: 7.975e-05, [1] [Cycle 1]: 7.246e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.33999e-06 [elim_not_effective]: 1.547e-05 [opt_reshape]: 6.28998e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 7.09988e-07 [validate]: 4.157e-05 Sums bootstrap : 0.000381s : 3.62% type_inference : 0.005520s : 52.40% event_method : 0.000018s : 0.17% auto_monad : 0.000066s : 0.63% graph_reusing : 0.000007s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000052s : 0.49% rewriter_before_opt_a : 0.000079s : 0.75% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000075s : 0.71% jit_opt_a.loop_unroll : 0.000036s : 0.34% jit_opt_a.a_1 : 0.000728s : 6.91% jit_opt_a.with_stream_mark : 0.000036s : 0.34% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.05% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.11% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.10% jit_opt_a.accelerated_algorithm : 0.000011s : 0.10% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.10% jit_opt_a.merge_forward : 0.000008s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000018s : 0.17% jit_opt_a.inline_without_move : 0.000011s : 0.10% jit_opt_a.renormalize : 0.000891s : 8.46% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.24% jit_opt_a.cse : 0.000050s : 0.48% jit_opt_a.replace_applicator : 0.000024s : 0.22% py_interpret_to_execute_after_opt_a : 0.000015s : 0.14% rewriter_after_opt_a : 0.000039s : 0.37% convert_after_rewriter : 0.000008s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000754s : 7.16% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.18% jit_opt_b.inline_after_opt_a : 0.000018s : 0.17% cconv : 0.000029s : 0.27% loop_unroll : 0.000513s : 4.87% jit_opt_after_cconv.c_1 : 0.000023s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000039s : 0.37% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000017s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000007s : 0.07% add_recomputation : 0.000056s : 0.53% cse_after_recomputation.cse : 0.000012s : 0.12% auto_monad_reorder : 0.000017s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000009s : 0.09% opt_after_jit_grad : 0.000625s : 5.93% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000042s : 0.39% Time group info: ------[substitution.] 0.000229 23 1.17% : 0.000003s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.86% : 0.000007s : 3: substitution.graph_param_transform 82.39% : 0.000189s : 4: substitution.inline 1.87% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000006s : 4: substitution.remove_not_recompute_node 2.61% : 0.000006s : 2: substitution.replace_old_param 5.66% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.005441 2 79.44% : 0.004322s : 1: type_inference.infer 20.56% : 0.001119s : 1: type_inference.specialize ------[replace.] 0.000076 6 66.71% : 0.000050s : 4: replace.inline 33.29% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000198 6 94.04% : 0.000186s : 4: match.inline 5.96% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 691 1.41% : 0.000002s : 10: predicate.accumulaten_eliminater 1.57% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.68% : 0.000002s : 10: predicate.addn_zero_filter 2.14% : 0.000003s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 0.95% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000002s : 10: predicate.depend_value_elim 0.99% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.06% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.29% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000002s : 10: predicate.environ_get_depend_swap 1.06% : 0.000001s : 10: predicate.environ_get_eliminate 0.98% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.22% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 15: predicate.load_eliminater 1.36% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.07% : 0.000003s : 15: predicate.partial_eliminate 1.42% : 0.000002s : 10: predicate.print_const_string_wrapper 2.03% : 0.000003s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 6: predicate.remove_not_recompute_node 2.02% : 0.000003s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000002s : 10: predicate.reshape_eliminate 1.17% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.33% : 0.000002s : 3: predicate.row_tensor_eliminate 1.23% : 0.000002s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.42% : 0.000002s : 6: predicate.special_op_eliminate 0.87% : 0.000001s : 6: predicate.specialize_transform 1.93% : 0.000003s : 10: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.14% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.14% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.22% : 0.000002s : 10: predicate.transpose_eliminate 1.19% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.46% : 0.000006s : 18: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000754 13 47.60% : 0.000359s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.83% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.57% : 0.000359s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016965 72 0.35% : 0.000059s : 1: add_recomputation 0.41% : 0.000070s : 1: auto_monad 0.11% : 0.000019s : 1: auto_monad_reorder 2.36% : 0.000400s : 1: bootstrap 0.19% : 0.000031s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000009s : 1: environ_conv 0.13% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.25% : 0.000043s : 1: get_jit_bprop_graph 0.05% : 0.000009s : 1: graph_reusing 36.60% : 0.006209s : 1: jit_opt_a 1.04% : 0.000177s : 1: jit_opt_after_cconv 0.35% : 0.000059s : 1: jit_opt_b 3.07% : 0.000521s : 1: loop_unroll 4.51% : 0.000765s : 1: mutable_eliminate 5.70% : 0.000967s : 26: opt.transform.jit_opt_a 0.32% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000029s : 4: opt.transform.jit_opt_b 0.09% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000018s : 1: opt.transform.mutable_eliminate 0.16% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.74% : 0.000634s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.32% : 0.000055s : 1: py_interpret_to_execute 0.10% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000019s : 1: remove_dup_value 2.69% : 0.000456s : 1: renormalize.infer 2.52% : 0.000427s : 1: renormalize.specialize 0.07% : 0.000011s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000041s : 1: rewriter_after_opt_a 0.49% : 0.000083s : 1: rewriter_before_opt_a 0.49% : 0.000083s : 1: symbol_engine_optimizer 32.66% : 0.005540s : 1: type_inference TotalTime = 0.114268, [30] [bootstrap]: 0.00027902 [type_inference]: 0.103519 [event_method]: 2.016e-05 [auto_monad]: 7.124e-05 [graph_reusing]: 6.00002e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 0.00043332 [rewriter_before_opt_a]: 8.688e-05 [expand_dump_flag]: 3.88001e-06 [jit_opt_a]: 0.00751429, [2] [Cycle 1]: 0.00367436, [27] [switch_simplify]: 5.947e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00058317 [with_stream_mark]: 1.935e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.19001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.59999e-06 [meta_shard_fg_expand]: 1.84998e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.55e-05 [j_node_and_user_rematch]: 1.003e-05 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 9.19998e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00261607 [add_forward_monad_depend]: 7.67002e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.782e-05 [cse]: 3.163e-05 [replace_applicator]: 1.951e-05 [Cycle 2]: 0.00036938, [27] [switch_simplify]: 6.51e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00011901 [with_stream_mark]: 1.24e-05 [recompute_prepare]: 6.07999e-06 [updatestate_depend_eliminate]: 4.43001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.39999e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.65001e-06 [meta_shard_fg_expand]: 1.69998e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.31001e-06 [cell_reuse_recompute_pass]: 2.64999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.716e-05 [j_node_and_user_rematch]: 9.27999e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.40999e-06 [auto_monad_grad]: 5.50004e-07 [auto_monad_eliminator]: 6.53e-06 [cse]: 1.065e-05 [replace_applicator]: 6.46e-06 [py_interpret_to_execute_after_opt_a]: 1.261e-05 [rewriter_after_opt_a]: 3.498e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00065562 [jit_opt_b]: 5.534e-05, [1] [Cycle 1]: 4.674e-05, [2] [frontend_op_eliminate]: 1.828e-05 [inline_after_opt_a]: 1.727e-05 [cconv]: 2.645e-05 [loop_unroll]: 0.00043438 [jit_opt_after_cconv]: 0.00016128, [1] [Cycle 1]: 0.00015455, [11] [c_1]: 2.598e-05 [parameter_eliminate]: 3.73999e-06 [updatestate_depend_eliminate]: 6.06998e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.71e-06 [cse]: 2.933e-05 [call_graph_tuple_transform]: 2.213e-05 [tuple_list_get_item_eliminator]: 5.96003e-06 [none_parameter_eliminate]: 1.73002e-06 [renormalize]: 1.12e-06 [switch_simplify]: 5.84999e-06 [remove_dup_value]: 1.513e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.64e-06 [add_recomputation]: 4.849e-05 [cse_after_recomputation]: 2.172e-05, [1] [Cycle 1]: 1.644e-05, [1] [cse]: 1.009e-05 [auto_monad_reorder]: 1.6e-05 [get_jit_bprop_graph]: 1.97001e-06 [rewriter_after_jit_bprop_graph]: 5.62001e-06 [opt_after_jit_grad]: 0.00046182 [symbol_engine_optimizer]: 7.392e-05, [1] [Cycle 1]: 6.798e-05, [6] [build]: 3.7e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 6.62002e-06 [fold_const_symbol]: 8.85999e-06 [renormalize]: 3.29979e-07 [validate]: 0.00010417 Sums bootstrap : 0.000279s : 0.25% type_inference : 0.103519s : 93.94% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000433s : 0.39% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000702s : 0.64% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002616s : 2.37% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000656s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000434s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000462s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000104s : 0.09% Time group info: ------[substitution.] 0.000224 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 3.05% : 0.000007s : 4: substitution.graph_param_transform 83.20% : 0.000186s : 4: substitution.inline 1.92% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000006s : 4: substitution.remove_not_recompute_node 2.13% : 0.000005s : 2: substitution.replace_old_param 5.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103441 2 97.32% : 0.100668s : 1: type_inference.infer 2.68% : 0.002772s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.50% : 0.000049s : 4: replace.inline 31.50% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000195 6 94.01% : 0.000184s : 4: match.inline 5.99% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.53% : 0.000002s : 12: predicate.accumulaten_eliminater 1.24% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.58% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000002s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.00% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.94% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.84% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.26% : 0.000002s : 4: predicate.mutable_eliminate 0.88% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000001s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.09% : 0.000001s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.30% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 1.92% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.35% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.73% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.36% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.85% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001994 22 66.19% : 0.001320s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.14% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.67% : 0.000631s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117834 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000292s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.38% : 0.007518s : 1: jit_opt_a 0.14% : 0.000164s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.37% : 0.000441s : 1: loop_unroll 0.57% : 0.000666s : 1: mutable_eliminate 0.80% : 0.000941s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000470s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000440s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.56% : 0.001838s : 1: renormalize.infer 0.65% : 0.000769s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000092s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 87.87% : 0.103539s : 1: type_inference TotalTime = 0.113607, [30] [bootstrap]: 0.00027318 [type_inference]: 0.102847 [event_method]: 2.059e-05 [auto_monad]: 0.00011226 [graph_reusing]: 7.13e-06 [pre_auto_parallel]: 2.51e-06 [py_interpret_to_execute]: 0.00048102 [rewriter_before_opt_a]: 8.502e-05 [expand_dump_flag]: 3.19001e-06 [jit_opt_a]: 0.00755543, [2] [Cycle 1]: 0.00356984, [27] [switch_simplify]: 5.688e-05 [loop_unroll]: 3.036e-05 [a_1]: 0.00055071 [with_stream_mark]: 1.753e-05 [recompute_prepare]: 8.56002e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 6.68e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 6.54999e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.598e-05 [j_node_and_user_rematch]: 9.72001e-06 [meta_fg_expand]: 2.21998e-06 [replace_old_param]: 1.042e-05 [inline_without_move]: 5.88998e-06 [renormalize]: 0.00257821 [add_forward_monad_depend]: 5.30001e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 1.461e-05 [cse]: 2.23e-05 [replace_applicator]: 1.66e-05 [Cycle 2]: 0.00044887, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 5.87001e-06 [a_1]: 0.00012321 [with_stream_mark]: 9.07999e-06 [recompute_prepare]: 5.89999e-06 [updatestate_depend_eliminate]: 3.7e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.34999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 6.40002e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.91003e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 2.36998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.431e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 8.70001e-06 [inline_without_move]: 5.69e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 6.31998e-06 [cse]: 1.297e-05 [replace_applicator]: 5.76003e-06 [py_interpret_to_execute_after_opt_a]: 1.188e-05 [rewriter_after_opt_a]: 3.321e-05 [convert_after_rewriter]: 7.68001e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00064924 [jit_opt_b]: 5.419e-05, [1] [Cycle 1]: 4.759e-05, [2] [frontend_op_eliminate]: 1.977e-05 [inline_after_opt_a]: 1.716e-05 [cconv]: 2.644e-05 [loop_unroll]: 0.00041339 [jit_opt_after_cconv]: 0.00015137, [1] [Cycle 1]: 0.00014515, [11] [c_1]: 2.491e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.328e-05 [call_graph_tuple_transform]: 2.1e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.612e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 8.32998e-06 [add_recomputation]: 4.684e-05 [cse_after_recomputation]: 2.333e-05, [1] [Cycle 1]: 1.664e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.438e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 4.66002e-06 [opt_after_jit_grad]: 0.00044305 [symbol_engine_optimizer]: 7.555e-05, [1] [Cycle 1]: 6.984e-05, [6] [build]: 3.12002e-06 [elim_shapecalc]: 8.99e-06 [elim_not_effective]: 1.437e-05 [opt_reshape]: 6.26998e-06 [fold_const_symbol]: 9.83998e-06 [renormalize]: 3.60014e-07 [validate]: 4.693e-05 Sums bootstrap : 0.000273s : 0.25% type_inference : 0.102847s : 94.01% event_method : 0.000021s : 0.02% auto_monad : 0.000112s : 0.10% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000481s : 0.44% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000674s : 0.62% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002578s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000649s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000413s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000443s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000192 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 1.03% : 0.000002s : 2: substitution.fold_const_symbol 3.33% : 0.000006s : 4: substitution.graph_param_transform 81.73% : 0.000157s : 4: substitution.inline 1.96% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000004s : 2: substitution.replace_old_param 6.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102769 2 97.30% : 0.099998s : 1: type_inference.infer 2.70% : 0.002771s : 1: type_inference.specialize ------[replace.] 0.000073 6 67.05% : 0.000049s : 4: replace.inline 32.95% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.46% : 0.000155s : 4: match.inline 6.54% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.12% : 0.000001s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 2.34% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.63% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.22% : 0.000002s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 4.79% : 0.000006s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.84% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.00% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.16% : 0.000002s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.50% : 0.000002s : 12: predicate.print_const_string_wrapper 2.55% : 0.000003s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 1.03% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.12% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.93% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.74% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001989 22 65.18% : 0.001296s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.61% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.21% : 0.000661s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117162 72 0.04% : 0.000049s : 1: add_recomputation 0.10% : 0.000117s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000286s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 6.45% : 0.007559s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.36% : 0.000421s : 1: loop_unroll 0.56% : 0.000658s : 1: mutable_eliminate 0.78% : 0.000911s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000489s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.58% : 0.001853s : 1: renormalize.infer 0.61% : 0.000717s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 87.80% : 0.102870s : 1: type_inference TotalTime = 0.0592009, [30] [bootstrap]: 0.00030474 [type_inference]: 0.0501673 [event_method]: 1.694e-05 [auto_monad]: 6.547e-05 [graph_reusing]: 5.30999e-06 [pre_auto_parallel]: 2.08998e-06 [py_interpret_to_execute]: 0.00024022 [rewriter_before_opt_a]: 7.736e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00620134, [2] [Cycle 1]: 0.00270834, [27] [switch_simplify]: 5.056e-05 [loop_unroll]: 3.198e-05 [a_1]: 0.00055094 [with_stream_mark]: 1.536e-05 [recompute_prepare]: 8.18999e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.53e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.23002e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 3.66001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.324e-05 [j_node_and_user_rematch]: 1.002e-05 [meta_fg_expand]: 2.43002e-06 [replace_old_param]: 8.37998e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 0.00174615 [add_forward_monad_depend]: 5.91e-06 [auto_monad_grad]: 1.97999e-06 [auto_monad_eliminator]: 1.48e-05 [cse]: 2.668e-05 [replace_applicator]: 1.31e-05 [Cycle 2]: 0.00034603, [27] [switch_simplify]: 6.27001e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00011603 [with_stream_mark]: 9.32999e-06 [recompute_prepare]: 5.64998e-06 [updatestate_depend_eliminate]: 2.98e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.20999e-06 [specialize_transform]: 5.54998e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.69999e-06 [meta_shard_fg_expand]: 1.21997e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 2.36998e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 8.20999e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.82e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.036e-05 [replace_applicator]: 5.54e-06 [py_interpret_to_execute_after_opt_a]: 9.56e-06 [rewriter_after_opt_a]: 3.234e-05 [convert_after_rewriter]: 6.56e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00056078 [jit_opt_b]: 5.204e-05, [1] [Cycle 1]: 4.592e-05, [2] [frontend_op_eliminate]: 1.767e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.495e-05 [loop_unroll]: 0.00040489 [jit_opt_after_cconv]: 0.00014405, [1] [Cycle 1]: 0.00013791, [11] [c_1]: 2.493e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.29998e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 1.85e-05 [call_graph_tuple_transform]: 1.96e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.352e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 6.32001e-06 [add_recomputation]: 4.471e-05 [cse_after_recomputation]: 2.107e-05, [1] [Cycle 1]: 1.638e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.407e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 4.10998e-06 [opt_after_jit_grad]: 0.00044687 [symbol_engine_optimizer]: 0.00011987, [1] [Cycle 1]: 0.00011352, [6] [build]: 2.74001e-06 [elim_shapecalc]: 8.15e-06 [elim_not_effective]: 5.78e-05 [opt_reshape]: 6.76e-06 [fold_const_symbol]: 9.37999e-06 [renormalize]: 4.89992e-07 [validate]: 4.135e-05 Sums bootstrap : 0.000305s : 0.55% type_inference : 0.050167s : 90.38% event_method : 0.000017s : 0.03% auto_monad : 0.000065s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000240s : 0.43% rewriter_before_opt_a : 0.000077s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.10% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000667s : 1.20% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001746s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000037s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000561s : 1.01% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000405s : 0.73% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000045s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000447s : 0.81% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000058s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000193 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.84% : 0.000005s : 4: substitution.graph_param_transform 83.98% : 0.000162s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000005s : 4: substitution.remove_not_recompute_node 1.60% : 0.000003s : 2: substitution.replace_old_param 6.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050100 2 96.36% : 0.048277s : 1: type_inference.infer 3.64% : 0.001823s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.82% : 0.000046s : 4: replace.inline 32.18% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.64% : 0.000160s : 4: match.inline 6.36% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.54% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.26% : 0.000002s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 2.20% : 0.000003s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.43% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.04% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.50% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001852 22 70.95% : 0.001314s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.11% : 0.000502s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061902 72 0.08% : 0.000047s : 1: add_recomputation 0.11% : 0.000069s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.51% : 0.000317s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.02% : 0.006204s : 1: jit_opt_a 0.24% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.67% : 0.000412s : 1: loop_unroll 0.92% : 0.000569s : 1: mutable_eliminate 1.43% : 0.000887s : 26: opt.transform.jit_opt_a 0.09% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000245s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.93% : 0.001195s : 1: renormalize.infer 0.88% : 0.000542s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000035s : 1: rewriter_after_opt_a 0.13% : 0.000082s : 1: rewriter_before_opt_a 0.20% : 0.000122s : 1: symbol_engine_optimizer 81.06% : 0.050179s : 1: type_inference TotalTime = 0.0106825, [30] [bootstrap]: 0.00024181 [type_inference]: 0.00398766 [event_method]: 1.581e-05 [auto_monad]: 4.741e-05 [graph_reusing]: 4.07003e-06 [pre_auto_parallel]: 1.61002e-06 [py_interpret_to_execute]: 3.093e-05 [rewriter_before_opt_a]: 6.303e-05 [expand_dump_flag]: 2.02001e-06 [jit_opt_a]: 0.00444891, [2] [Cycle 1]: 0.00128306, [27] [switch_simplify]: 4.329e-05 [loop_unroll]: 3.223e-05 [a_1]: 0.00046238 [with_stream_mark]: 1.159e-05 [recompute_prepare]: 6.91001e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.142e-05 [j_node_and_user_rematch]: 8.54e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.50998e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 0.00046338 [add_forward_monad_depend]: 4.08001e-06 [auto_monad_grad]: 1.08001e-06 [auto_monad_eliminator]: 9.71998e-06 [cse]: 1.691e-05 [replace_applicator]: 1.054e-05 [Cycle 2]: 0.00030771, [27] [switch_simplify]: 5.22e-06 [loop_unroll]: 4.76002e-06 [a_1]: 8.815e-05 [with_stream_mark]: 8.51002e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.12001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.29e-06 [updatestate_useless_node_eliminater]: 4.62e-06 [accelerated_algorithm]: 4.75001e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 4.37998e-06 [merge_forward]: 2.37001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.172e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.47001e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.62998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.51002e-06 [cse]: 1.003e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 7.39002e-06 [rewriter_after_opt_a]: 2.397e-05 [convert_after_rewriter]: 5.00999e-06 [order_py_execute_after_rewriter]: 3.83999e-06 [mutable_eliminate]: 0.00044235 [jit_opt_b]: 4.575e-05, [1] [Cycle 1]: 3.999e-05, [2] [frontend_op_eliminate]: 1.522e-05 [inline_after_opt_a]: 1.434e-05 [cconv]: 1.591e-05 [loop_unroll]: 0.00041993 [jit_opt_after_cconv]: 0.00013985, [1] [Cycle 1]: 0.00013405, [11] [c_1]: 2.015e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 4.93001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.757e-05 [call_graph_tuple_transform]: 1.698e-05 [tuple_list_get_item_eliminator]: 5.22e-06 [none_parameter_eliminate]: 9.5999e-07 [renormalize]: 2.79979e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 7.82e-06 [partial_unused_args_eliminate]: 1.49e-06 [environ_conv]: 3.8e-06 [add_recomputation]: 3.097e-05 [cse_after_recomputation]: 2.169e-05, [1] [Cycle 1]: 1.668e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 8.77e-06 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4.05e-06 [opt_after_jit_grad]: 0.00042074 [symbol_engine_optimizer]: 6.7e-05, [1] [Cycle 1]: 6.131e-05, [6] [build]: 2.41e-06 [elim_shapecalc]: 7.48e-06 [elim_not_effective]: 1.134e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 7.58001e-06 [renormalize]: 3.39991e-07 [validate]: 2.684e-05 Sums bootstrap : 0.000242s : 3.31% type_inference : 0.003988s : 54.60% event_method : 0.000016s : 0.22% auto_monad : 0.000047s : 0.65% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000031s : 0.42% rewriter_before_opt_a : 0.000063s : 0.86% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000049s : 0.66% jit_opt_a.loop_unroll : 0.000037s : 0.51% jit_opt_a.a_1 : 0.000551s : 7.54% jit_opt_a.with_stream_mark : 0.000020s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.15% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.22% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000463s : 6.35% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000015s : 0.21% jit_opt_a.cse : 0.000027s : 0.37% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000007s : 0.10% rewriter_after_opt_a : 0.000024s : 0.33% convert_after_rewriter : 0.000005s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000442s : 6.06% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.21% jit_opt_b.inline_after_opt_a : 0.000014s : 0.20% cconv : 0.000016s : 0.22% loop_unroll : 0.000420s : 5.75% jit_opt_after_cconv.c_1 : 0.000020s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000031s : 0.42% cse_after_recomputation.cse : 0.000011s : 0.15% auto_monad_reorder : 0.000009s : 0.12% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000421s : 5.76% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.37% Time group info: ------[substitution.] 0.000142 23 1.00% : 0.000001s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000004s : 3: substitution.graph_param_transform 83.18% : 0.000118s : 4: substitution.inline 1.77% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000003s : 2: substitution.replace_old_param 5.51% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003940 2 81.36% : 0.003206s : 1: type_inference.infer 18.64% : 0.000735s : 1: type_inference.specialize ------[replace.] 0.000059 6 65.34% : 0.000038s : 4: replace.inline 34.66% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000122 6 94.53% : 0.000116s : 4: match.inline 5.47% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.35% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.31% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.33% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.68% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.34% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.10% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.55% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.75% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000002s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.92% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.96% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.49% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.50% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.98% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000530 13 51.27% : 0.000272s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.68% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.05% : 0.000233s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.011959 72 0.28% : 0.000034s : 1: add_recomputation 0.42% : 0.000050s : 1: auto_monad 0.09% : 0.000011s : 1: auto_monad_reorder 2.11% : 0.000253s : 1: bootstrap 0.16% : 0.000019s : 1: cconv 0.06% : 0.000007s : 1: convert_after_rewriter 0.20% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.22% : 0.004451s : 1: jit_opt_a 1.19% : 0.000142s : 1: jit_opt_after_cconv 0.40% : 0.000048s : 1: jit_opt_b 3.57% : 0.000427s : 1: loop_unroll 3.76% : 0.000450s : 1: mutable_eliminate 6.23% : 0.000745s : 26: opt.transform.jit_opt_a 0.37% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.17% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000029s : 4: opt.transform.symbol_engine_opt 3.58% : 0.000428s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.28% : 0.000034s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.09% : 0.000010s : 1: remove_dup_value 1.92% : 0.000230s : 1: renormalize.infer 1.90% : 0.000228s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000027s : 1: rewriter_after_opt_a 0.55% : 0.000066s : 1: rewriter_before_opt_a 0.58% : 0.000069s : 1: symbol_engine_optimizer 33.43% : 0.003998s : 1: type_inference TotalTime = 0.0116712, [30] [bootstrap]: 0.00024355 [type_inference]: 0.00452557 [event_method]: 1.642e-05 [auto_monad]: 6.434e-05 [graph_reusing]: 5.92001e-06 [pre_auto_parallel]: 2.21998e-06 [py_interpret_to_execute]: 3.64e-05 [rewriter_before_opt_a]: 7.359e-05 [expand_dump_flag]: 3.08998e-06 [jit_opt_a]: 0.0048038, [2] [Cycle 1]: 0.00148458, [27] [switch_simplify]: 5.117e-05 [loop_unroll]: 2.941e-05 [a_1]: 0.0004997 [with_stream_mark]: 1.801e-05 [recompute_prepare]: 7.15e-06 [updatestate_depend_eliminate]: 1.672e-05 [updatestate_assign_eliminate]: 3.72998e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.98002e-06 [specialize_transform]: 6.34999e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 5.54e-06 [merge_forward]: 3.86001e-06 [cell_reuse_recompute_pass]: 1.60001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 4.97999e-06 [renormalize]: 0.00056592 [add_forward_monad_depend]: 5.51998e-06 [auto_monad_grad]: 1.95001e-06 [auto_monad_eliminator]: 1.437e-05 [cse]: 2.868e-05 [replace_applicator]: 1.127e-05 [Cycle 2]: 0.00030126, [27] [switch_simplify]: 5.67001e-06 [loop_unroll]: 4.67e-06 [a_1]: 8.838e-05 [with_stream_mark]: 8.33999e-06 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.58e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 1.98002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 4.82998e-06 [updatestate_useless_node_eliminater]: 4.69998e-06 [accelerated_algorithm]: 4.73001e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 4.39002e-06 [merge_forward]: 2.46998e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.189e-05 [j_node_and_user_rematch]: 7.48e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 6.87002e-06 [inline_without_move]: 4.55001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.09989e-07 [auto_monad_grad]: 5.49975e-07 [auto_monad_eliminator]: 5.25001e-06 [cse]: 1e-05 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 7.65e-06 [rewriter_after_opt_a]: 3.179e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00046012 [jit_opt_b]: 4.716e-05, [1] [Cycle 1]: 4.112e-05, [2] [frontend_op_eliminate]: 1.54e-05 [inline_after_opt_a]: 1.51e-05 [cconv]: 2.509e-05 [loop_unroll]: 0.00039057 [jit_opt_after_cconv]: 0.00012968, [1] [Cycle 1]: 0.0001239, [11] [c_1]: 2.001e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 4.85001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.701e-05 [call_graph_tuple_transform]: 1.753e-05 [tuple_list_get_item_eliminator]: 5.24e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 2.48998e-06 [environ_conv]: 5.59998e-06 [add_recomputation]: 5.454e-05 [cse_after_recomputation]: 2.159e-05, [1] [Cycle 1]: 1.629e-05, [1] [cse]: 1.074e-05 [auto_monad_reorder]: 1.48e-05 [get_jit_bprop_graph]: 1.34e-06 [rewriter_after_jit_bprop_graph]: 3.75e-06 [opt_after_jit_grad]: 0.00042955 [symbol_engine_optimizer]: 6.742e-05, [1] [Cycle 1]: 6.177e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 7.25998e-06 [elim_not_effective]: 1.202e-05 [opt_reshape]: 5.37001e-06 [fold_const_symbol]: 8.15999e-06 [renormalize]: 4.30009e-07 [validate]: 3.084e-05 Sums bootstrap : 0.000244s : 2.99% type_inference : 0.004526s : 55.61% event_method : 0.000016s : 0.20% auto_monad : 0.000064s : 0.79% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.45% rewriter_before_opt_a : 0.000074s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000057s : 0.70% jit_opt_a.loop_unroll : 0.000034s : 0.42% jit_opt_a.a_1 : 0.000588s : 7.23% jit_opt_a.with_stream_mark : 0.000026s : 0.32% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000019s : 0.24% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000566s : 6.96% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000039s : 0.48% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000032s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000460s : 5.65% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000025s : 0.31% loop_unroll : 0.000391s : 4.80% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000055s : 0.67% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000430s : 5.28% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000031s : 0.38% Time group info: ------[substitution.] 0.000181 23 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000005s : 3: substitution.graph_param_transform 82.33% : 0.000149s : 4: substitution.inline 1.74% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000004s : 2: substitution.replace_old_param 6.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004471 2 78.34% : 0.003502s : 1: type_inference.infer 21.66% : 0.000969s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.12% : 0.000044s : 4: replace.inline 31.88% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 92.93% : 0.000147s : 4: match.inline 7.07% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.64% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.19% : 0.000001s : 10: predicate.minmaximum_grad 1.91% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.37% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.91% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.87% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.31% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.31% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000625 13 49.78% : 0.000311s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.38% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.84% : 0.000287s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013088 72 0.44% : 0.000058s : 1: add_recomputation 0.52% : 0.000068s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 1.95% : 0.000255s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.73% : 0.004807s : 1: jit_opt_a 1.01% : 0.000132s : 1: jit_opt_after_cconv 0.38% : 0.000050s : 1: jit_opt_b 3.04% : 0.000398s : 1: loop_unroll 3.58% : 0.000468s : 1: mutable_eliminate 6.03% : 0.000789s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.34% : 0.000437s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.10% : 0.000275s : 1: renormalize.infer 2.16% : 0.000283s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000035s : 1: rewriter_after_opt_a 0.58% : 0.000076s : 1: rewriter_before_opt_a 0.53% : 0.000070s : 1: symbol_engine_optimizer 34.66% : 0.004536s : 1: type_inference TotalTime = 0.110906, [30] [bootstrap]: 0.00026306 [type_inference]: 0.100935 [event_method]: 1.802e-05 [auto_monad]: 5.457e-05 [graph_reusing]: 4.62998e-06 [pre_auto_parallel]: 1.79e-06 [py_interpret_to_execute]: 0.00045692 [rewriter_before_opt_a]: 8.046e-05 [expand_dump_flag]: 2.51998e-06 [jit_opt_a]: 0.00687087, [2] [Cycle 1]: 0.00337265, [27] [switch_simplify]: 4.552e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00059239 [with_stream_mark]: 1.451e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.65002e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 6.46e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.231e-05 [j_node_and_user_rematch]: 9.54e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 8.84e-06 [inline_without_move]: 5.76e-06 [renormalize]: 0.00238607 [add_forward_monad_depend]: 4.89e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.336e-05 [cse]: 2.202e-05 [replace_applicator]: 1.337e-05 [Cycle 2]: 0.00034961, [27] [switch_simplify]: 6.59001e-06 [loop_unroll]: 6.01e-06 [a_1]: 0.00011903 [with_stream_mark]: 9.66e-06 [recompute_prepare]: 5.73002e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 5.10001e-06 [merge_forward]: 2.34999e-06 [cell_reuse_recompute_pass]: 1.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.281e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 1.45001e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.62001e-06 [cse]: 1.061e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 1.005e-05 [rewriter_after_opt_a]: 3.278e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 4.79e-06 [mutable_eliminate]: 0.00066688 [jit_opt_b]: 5.303e-05, [1] [Cycle 1]: 4.674e-05, [2] [frontend_op_eliminate]: 1.848e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 2.391e-05 [loop_unroll]: 0.00041755 [jit_opt_after_cconv]: 0.00014699, [1] [Cycle 1]: 0.00014108, [11] [c_1]: 2.491e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.138e-05 [call_graph_tuple_transform]: 1.994e-05 [tuple_list_get_item_eliminator]: 5.84999e-06 [none_parameter_eliminate]: 1.25001e-06 [renormalize]: 1.8999e-07 [switch_simplify]: 5.72001e-06 [remove_dup_value]: 1.366e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 8.17998e-06 [add_recomputation]: 4.558e-05 [cse_after_recomputation]: 2.055e-05, [1] [Cycle 1]: 1.551e-05, [1] [cse]: 1.021e-05 [auto_monad_reorder]: 1.346e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.36002e-06 [opt_after_jit_grad]: 0.00046974 [symbol_engine_optimizer]: 7.147e-05, [1] [Cycle 1]: 6.579e-05, [6] [build]: 3.53e-06 [elim_shapecalc]: 8.30999e-06 [elim_not_effective]: 1.259e-05 [opt_reshape]: 5.87001e-06 [fold_const_symbol]: 8.89e-06 [renormalize]: 4.50003e-07 [validate]: 4.033e-05 Sums bootstrap : 0.000263s : 0.25% type_inference : 0.100935s : 94.15% event_method : 0.000018s : 0.02% auto_monad : 0.000055s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000457s : 0.43% rewriter_before_opt_a : 0.000080s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000711s : 0.66% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002386s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000667s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000418s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000470s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000174 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.94% : 0.000002s : 2: substitution.fold_const_symbol 3.27% : 0.000006s : 4: substitution.graph_param_transform 82.75% : 0.000144s : 4: substitution.inline 1.85% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.13% : 0.000004s : 2: substitution.replace_old_param 5.35% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100843 2 97.42% : 0.098241s : 1: type_inference.infer 2.58% : 0.002602s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.90% : 0.000047s : 4: replace.inline 32.10% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000150 6 94.47% : 0.000141s : 4: match.inline 5.53% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 0.93% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.44% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.22% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 4.89% : 0.000006s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.03% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.49% : 0.000002s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000002s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.93% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.64% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001898 22 66.16% : 0.001256s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.29% : 0.000613s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114291 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000058s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000275s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.01% : 0.006874s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000425s : 1: loop_unroll 0.59% : 0.000675s : 1: mutable_eliminate 0.81% : 0.000929s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000465s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.50% : 0.001716s : 1: renormalize.infer 0.58% : 0.000663s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000084s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 88.33% : 0.100951s : 1: type_inference TotalTime = 0.109637, [30] [bootstrap]: 0.0002302 [type_inference]: 0.0998722 [event_method]: 1.706e-05 [auto_monad]: 4.637e-05 [graph_reusing]: 4.12e-06 [pre_auto_parallel]: 1.63002e-06 [py_interpret_to_execute]: 0.00047406 [rewriter_before_opt_a]: 7.58e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00678303, [2] [Cycle 1]: 0.00335594, [27] [switch_simplify]: 4.688e-05 [loop_unroll]: 3.026e-05 [a_1]: 0.00052214 [with_stream_mark]: 1.23e-05 [recompute_prepare]: 8.59e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.38002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.39998e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.21e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.84e-06 [renormalize]: 0.00244713 [add_forward_monad_depend]: 5.54998e-06 [auto_monad_grad]: 1.50999e-06 [auto_monad_eliminator]: 1.302e-05 [cse]: 2.091e-05 [replace_applicator]: 1.266e-05 [Cycle 2]: 0.00035446, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 5.93998e-06 [a_1]: 0.00012079 [with_stream_mark]: 9.59e-06 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 5.50001e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.48e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.409e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 8.30999e-06 [inline_without_move]: 5.81e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.079e-05 [replace_applicator]: 5.74999e-06 [py_interpret_to_execute_after_opt_a]: 7.75e-06 [rewriter_after_opt_a]: 2.746e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 4.36002e-06 [mutable_eliminate]: 0.00052885 [jit_opt_b]: 5.155e-05, [1] [Cycle 1]: 4.544e-05, [2] [frontend_op_eliminate]: 1.817e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 1.832e-05 [loop_unroll]: 0.00042733 [jit_opt_after_cconv]: 0.00014323, [1] [Cycle 1]: 0.00013702, [11] [c_1]: 2.467e-05 [parameter_eliminate]: 1.70001e-06 [updatestate_depend_eliminate]: 4.01001e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 1.97001e-06 [cse]: 2.162e-05 [call_graph_tuple_transform]: 1.811e-05 [tuple_list_get_item_eliminator]: 7.40998e-06 [none_parameter_eliminate]: 1.17e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.02e-05 [partial_unused_args_eliminate]: 1.39e-06 [environ_conv]: 6.92002e-06 [add_recomputation]: 3.618e-05 [cse_after_recomputation]: 2.222e-05, [1] [Cycle 1]: 1.751e-05, [1] [cse]: 1.17e-05 [auto_monad_reorder]: 1.213e-05 [get_jit_bprop_graph]: 2.09999e-06 [rewriter_after_jit_bprop_graph]: 6.16e-06 [opt_after_jit_grad]: 0.00046588 [symbol_engine_optimizer]: 0.00015569, [1] [Cycle 1]: 0.00014957, [6] [build]: 3.33e-06 [elim_shapecalc]: 8.05999e-06 [elim_not_effective]: 2.426e-05 [opt_reshape]: 6.83998e-06 [fold_const_symbol]: 7.736e-05 [renormalize]: 3.30008e-07 [validate]: 3.829e-05 Sums bootstrap : 0.000230s : 0.22% type_inference : 0.099872s : 94.20% event_method : 0.000017s : 0.02% auto_monad : 0.000046s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000474s : 0.45% rewriter_before_opt_a : 0.000076s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000643s : 0.61% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002447s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000027s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000529s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000427s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000466s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000024s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000077s : 0.07% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000159 24 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.95% : 0.000005s : 4: substitution.graph_param_transform 83.64% : 0.000133s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000004s : 4: substitution.remove_not_recompute_node 2.22% : 0.000004s : 2: substitution.replace_old_param 5.05% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099812 2 97.42% : 0.097234s : 1: type_inference.infer 2.58% : 0.002578s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.10% : 0.000045s : 4: replace.inline 33.90% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000137 6 94.96% : 0.000130s : 4: match.inline 5.04% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000002s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.76% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.37% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.68% : 0.000006s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.50% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.14% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.25% : 0.000002s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.31% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.34% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.58% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.47% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.33% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.85% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001934 22 65.22% : 0.001262s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.20% : 0.000023s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.57% : 0.000649s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113092 72 0.03% : 0.000039s : 1: add_recomputation 0.04% : 0.000050s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.21% : 0.000240s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.00% : 0.006787s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.38% : 0.000434s : 1: loop_unroll 0.47% : 0.000536s : 1: mutable_eliminate 0.76% : 0.000860s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000012s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000113s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.42% : 0.000479s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.57% : 0.001772s : 1: renormalize.infer 0.59% : 0.000668s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000030s : 1: rewriter_after_opt_a 0.07% : 0.000081s : 1: rewriter_before_opt_a 0.14% : 0.000158s : 1: symbol_engine_optimizer 88.32% : 0.099886s : 1: type_inference TotalTime = 0.0601019, [30] [bootstrap]: 0.00025744 [type_inference]: 0.0507288 [event_method]: 1.685e-05 [auto_monad]: 5.169e-05 [graph_reusing]: 4.04002e-06 [pre_auto_parallel]: 1.76003e-06 [py_interpret_to_execute]: 0.00025745 [rewriter_before_opt_a]: 7.471e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00660484, [2] [Cycle 1]: 0.00298829, [27] [switch_simplify]: 4.652e-05 [loop_unroll]: 2.934e-05 [a_1]: 0.00052764 [with_stream_mark]: 1.1e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 6.61999e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.76e-06 [merge_forward]: 3.00002e-06 [cell_reuse_recompute_pass]: 9.20001e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.33001e-06 [inline_without_move]: 6.08002e-06 [renormalize]: 0.00206187 [add_forward_monad_depend]: 6.89001e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.434e-05 [cse]: 2.525e-05 [replace_applicator]: 1.748e-05 [Cycle 2]: 0.00036545, [27] [switch_simplify]: 6.86999e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00012251 [with_stream_mark]: 1.067e-05 [recompute_prepare]: 6.11e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.62999e-06 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 5.98998e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.44001e-06 [cell_reuse_recompute_pass]: 1.99e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.634e-05 [j_node_and_user_rematch]: 9.32001e-06 [meta_fg_expand]: 1.64998e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.73002e-06 [cse]: 1.052e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 9.81998e-06 [rewriter_after_opt_a]: 3.242e-05 [convert_after_rewriter]: 6.70002e-06 [order_py_execute_after_rewriter]: 5.16998e-06 [mutable_eliminate]: 0.00058343 [jit_opt_b]: 5.25e-05, [1] [Cycle 1]: 4.583e-05, [2] [frontend_op_eliminate]: 1.803e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 2.262e-05 [loop_unroll]: 0.00041197 [jit_opt_after_cconv]: 0.00014379, [1] [Cycle 1]: 0.00013751, [11] [c_1]: 2.508e-05 [parameter_eliminate]: 2.68e-06 [updatestate_depend_eliminate]: 4.45999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 1.928e-05 [call_graph_tuple_transform]: 1.992e-05 [tuple_list_get_item_eliminator]: 6.23e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.445e-05 [partial_unused_args_eliminate]: 1.92001e-06 [environ_conv]: 7.59002e-06 [add_recomputation]: 4.276e-05 [cse_after_recomputation]: 2.087e-05, [1] [Cycle 1]: 1.581e-05, [1] [cse]: 1.048e-05 [auto_monad_reorder]: 1.421e-05 [get_jit_bprop_graph]: 1.36998e-06 [rewriter_after_jit_bprop_graph]: 4.2e-06 [opt_after_jit_grad]: 0.00044485 [symbol_engine_optimizer]: 7.198e-05, [1] [Cycle 1]: 6.608e-05, [6] [build]: 2.96001e-06 [elim_shapecalc]: 8.33001e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 4.2998e-07 [validate]: 3.905e-05 Sums bootstrap : 0.000257s : 0.46% type_inference : 0.050729s : 90.11% event_method : 0.000017s : 0.03% auto_monad : 0.000052s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000257s : 0.46% rewriter_before_opt_a : 0.000075s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000650s : 1.15% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002062s : 3.66% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000036s : 0.06% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000583s : 1.04% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000412s : 0.73% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000043s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000445s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.07% Time group info: ------[substitution.] 0.000178 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.29% : 0.000006s : 4: substitution.graph_param_transform 81.89% : 0.000146s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.23% : 0.000006s : 4: substitution.remove_not_recompute_node 2.16% : 0.000004s : 2: substitution.replace_old_param 5.96% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050662 2 96.24% : 0.048756s : 1: type_inference.infer 3.76% : 0.001907s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.68% : 0.000043s : 4: replace.inline 33.32% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 93.77% : 0.000144s : 4: match.inline 6.23% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.43% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 12: predicate.addn_check_dump 1.63% : 0.000002s : 12: predicate.addn_zero_filter 2.03% : 0.000003s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.39% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.70% : 0.000001s : 4: predicate.graph_param_transform 4.83% : 0.000006s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.67% : 0.000002s : 8: predicate.less_batch_normalization 1.68% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 18: predicate.load_eliminater 0.96% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.89% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.39% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 8: predicate.remove_not_recompute_node 2.39% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.17% : 0.000001s : 12: predicate.reshape_eliminate 1.46% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.92% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002030 26 71.24% : 0.001446s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.36% : 0.000555s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063110 72 0.07% : 0.000045s : 1: add_recomputation 0.09% : 0.000055s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.43% : 0.000271s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.47% : 0.006608s : 1: jit_opt_a 0.23% : 0.000146s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.66% : 0.000419s : 1: loop_unroll 0.94% : 0.000591s : 1: mutable_eliminate 1.38% : 0.000874s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000263s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.14% : 0.001349s : 1: renormalize.infer 1.12% : 0.000705s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000035s : 1: rewriter_after_opt_a 0.13% : 0.000079s : 1: rewriter_before_opt_a 0.14% : 0.000087s : 1: symbol_engine_optimizer 80.40% : 0.050742s : 1: type_inference TotalTime = 0.0596686, [30] [bootstrap]: 0.00027663 [type_inference]: 0.0504856 [event_method]: 1.615e-05 [auto_monad]: 5.056e-05 [graph_reusing]: 4.68999e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 0.00026859 [rewriter_before_opt_a]: 7.473e-05 [expand_dump_flag]: 2.97002e-06 [jit_opt_a]: 0.00631262, [2] [Cycle 1]: 0.00282317, [27] [switch_simplify]: 4.877e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00052752 [with_stream_mark]: 1.372e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.52001e-06 [updatestate_loads_eliminate]: 2.58e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.53e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.98002e-06 [meta_shard_fg_expand]: 1.64998e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.21e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.96998e-06 [inline_without_move]: 7.33e-06 [renormalize]: 0.00189107 [add_forward_monad_depend]: 6.54999e-06 [auto_monad_grad]: 1.92001e-06 [auto_monad_eliminator]: 1.627e-05 [cse]: 2.307e-05 [replace_applicator]: 1.394e-05 [Cycle 2]: 0.00036005, [27] [switch_simplify]: 6.93e-06 [loop_unroll]: 6.42001e-06 [a_1]: 0.00012174 [with_stream_mark]: 9.74e-06 [recompute_prepare]: 6.29001e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.56998e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.71e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 2.19999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.435e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.57001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.74e-06 [cse]: 1.042e-05 [replace_applicator]: 5.67999e-06 [py_interpret_to_execute_after_opt_a]: 1.013e-05 [rewriter_after_opt_a]: 3.22e-05 [convert_after_rewriter]: 6.24001e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.0005967 [jit_opt_b]: 5.413e-05, [1] [Cycle 1]: 4.715e-05, [2] [frontend_op_eliminate]: 1.859e-05 [inline_after_opt_a]: 1.805e-05 [cconv]: 2.678e-05 [loop_unroll]: 0.00041791 [jit_opt_after_cconv]: 0.00014773, [1] [Cycle 1]: 0.00014121, [11] [c_1]: 2.549e-05 [parameter_eliminate]: 2.82002e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 1.934e-05 [call_graph_tuple_transform]: 2.06e-05 [tuple_list_get_item_eliminator]: 6.39999e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.98998e-06 [remove_dup_value]: 1.604e-05 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 8.04997e-06 [add_recomputation]: 4.592e-05 [cse_after_recomputation]: 2.234e-05, [1] [Cycle 1]: 1.687e-05, [1] [cse]: 1.082e-05 [auto_monad_reorder]: 1.513e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 4.41002e-06 [opt_after_jit_grad]: 0.00045067 [symbol_engine_optimizer]: 7.287e-05, [1] [Cycle 1]: 6.71e-05, [6] [build]: 3.48e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.325e-05 [opt_reshape]: 6.19001e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 3.00002e-07 [validate]: 8.167e-05 Sums bootstrap : 0.000277s : 0.49% type_inference : 0.050486s : 90.16% event_method : 0.000016s : 0.03% auto_monad : 0.000051s : 0.09% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000269s : 0.48% rewriter_before_opt_a : 0.000075s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000649s : 1.16% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000013s : 0.02% jit_opt_a.renormalize : 0.001891s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000597s : 1.07% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000418s : 0.75% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000451s : 0.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000082s : 0.15% Time group info: ------[substitution.] 0.000175 24 1.33% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 3.40% : 0.000006s : 4: substitution.graph_param_transform 81.64% : 0.000143s : 4: substitution.inline 1.97% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000004s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 6.17% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050422 2 96.52% : 0.048667s : 1: type_inference.infer 3.48% : 0.001755s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.57% : 0.000043s : 4: replace.inline 33.43% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000150 6 93.56% : 0.000140s : 4: match.inline 6.44% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.46% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.74% : 0.000002s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.41% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.65% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.59% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.42% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.95% : 0.000009s : 58: predicate.switch_simplify 1.38% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002119 26 72.29% : 0.001532s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.31% : 0.000558s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062462 72 0.08% : 0.000049s : 1: add_recomputation 0.09% : 0.000054s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.46% : 0.000287s : 1: bootstrap 0.05% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000019s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.11% : 0.006316s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.68% : 0.000426s : 1: loop_unroll 0.97% : 0.000605s : 1: mutable_eliminate 1.40% : 0.000872s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000274s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.03% : 0.001269s : 1: renormalize.infer 0.98% : 0.000614s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000035s : 1: rewriter_after_opt_a 0.13% : 0.000080s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 80.84% : 0.050496s : 1: type_inference TotalTime = 0.0118686, [30] [bootstrap]: 0.00030076 [type_inference]: 0.00431612 [event_method]: 1.71e-05 [auto_monad]: 4.483e-05 [graph_reusing]: 3.85e-06 [pre_auto_parallel]: 1.81e-06 [py_interpret_to_execute]: 3.521e-05 [rewriter_before_opt_a]: 6.424e-05 [expand_dump_flag]: 2.17999e-06 [jit_opt_a]: 0.00500181, [2] [Cycle 1]: 0.00152934, [27] [switch_simplify]: 4.544e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00045411 [with_stream_mark]: 9.56e-06 [recompute_prepare]: 7.09001e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 8.00006e-07 [specialize_transform]: 5.72001e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.22999e-06 [meta_shard_fg_expand]: 2.58e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.387e-05 [j_node_and_user_rematch]: 9.05001e-06 [meta_fg_expand]: 2.58998e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.36002e-06 [renormalize]: 0.00068944 [add_forward_monad_depend]: 5.11002e-06 [auto_monad_grad]: 2.24999e-06 [auto_monad_eliminator]: 1.457e-05 [cse]: 2.699e-05 [replace_applicator]: 1.247e-05 [Cycle 2]: 0.00030723, [27] [switch_simplify]: 5.84999e-06 [loop_unroll]: 4.72e-06 [a_1]: 8.986e-05 [with_stream_mark]: 9.04e-06 [recompute_prepare]: 4.68999e-06 [updatestate_depend_eliminate]: 2.63998e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 4.82e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 4.70001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.62001e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.181e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.67001e-06 [replace_old_param]: 7.64002e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.09989e-07 [auto_monad_grad]: 5.20027e-07 [auto_monad_eliminator]: 5.04998e-06 [cse]: 9.07001e-06 [replace_applicator]: 5.09e-06 [py_interpret_to_execute_after_opt_a]: 9.33002e-06 [rewriter_after_opt_a]: 3.484e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 4.87e-06 [mutable_eliminate]: 0.00054075 [jit_opt_b]: 4.728e-05, [1] [Cycle 1]: 4.13e-05, [2] [frontend_op_eliminate]: 1.585e-05 [inline_after_opt_a]: 1.484e-05 [cconv]: 7.615e-05 [loop_unroll]: 0.0004019 [jit_opt_after_cconv]: 0.00013494, [1] [Cycle 1]: 0.00012925, [11] [c_1]: 2.097e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 2.09e-06 [updatestate_loads_eliminate]: 2.34001e-06 [cse]: 1.912e-05 [call_graph_tuple_transform]: 1.748e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.34e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 4.97e-06 [remove_dup_value]: 1.515e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 5.15999e-06 [add_recomputation]: 4.699e-05 [cse_after_recomputation]: 2.098e-05, [1] [Cycle 1]: 1.584e-05, [1] [cse]: 1.002e-05 [auto_monad_reorder]: 1.63e-05 [get_jit_bprop_graph]: 1.82001e-06 [rewriter_after_jit_bprop_graph]: 5.00999e-06 [opt_after_jit_grad]: 0.00043619 [symbol_engine_optimizer]: 7.087e-05, [1] [Cycle 1]: 6.442e-05, [6] [build]: 3.09001e-06 [elim_shapecalc]: 7.45e-06 [elim_not_effective]: 1.256e-05 [opt_reshape]: 5.73002e-06 [fold_const_symbol]: 8.95001e-06 [renormalize]: 3.10014e-07 [validate]: 3.225e-05 Sums bootstrap : 0.000301s : 3.69% type_inference : 0.004316s : 52.92% event_method : 0.000017s : 0.21% auto_monad : 0.000045s : 0.55% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.43% rewriter_before_opt_a : 0.000064s : 0.79% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000051s : 0.63% jit_opt_a.loop_unroll : 0.000034s : 0.42% jit_opt_a.a_1 : 0.000544s : 6.67% jit_opt_a.with_stream_mark : 0.000019s : 0.23% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000690s : 8.45% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000036s : 0.44% jit_opt_a.replace_applicator : 0.000018s : 0.22% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000035s : 0.43% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000541s : 6.63% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000076s : 0.93% loop_unroll : 0.000402s : 4.93% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.58% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000016s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000436s : 5.35% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.40% Time group info: ------[substitution.] 0.000145 23 1.60% : 0.000002s : 2: substitution.elim_not_effective 1.45% : 0.000002s : 2: substitution.fold_const_symbol 3.74% : 0.000005s : 3: substitution.graph_param_transform 80.30% : 0.000116s : 4: substitution.inline 1.71% : 0.000002s : 4: substitution.j_node_and_user_rematch 3.21% : 0.000005s : 4: substitution.remove_not_recompute_node 3.10% : 0.000004s : 2: substitution.replace_old_param 4.90% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004262 2 81.45% : 0.003471s : 1: type_inference.infer 18.55% : 0.000790s : 1: type_inference.specialize ------[replace.] 0.000060 6 64.44% : 0.000038s : 4: replace.inline 35.56% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000120 6 94.97% : 0.000114s : 4: match.inline 5.03% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000001s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.64% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.04% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 4.88% : 0.000006s : 22: predicate.inline 0.98% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.22% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.31% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.70% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000002s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.58% : 0.000009s : 53: predicate.switch_simplify 1.24% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.17% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.94% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000571 13 49.29% : 0.000282s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.17% : 0.000024s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.54% : 0.000266s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013345 72 0.37% : 0.000050s : 1: add_recomputation 0.36% : 0.000048s : 1: auto_monad 0.14% : 0.000019s : 1: auto_monad_reorder 2.38% : 0.000317s : 1: bootstrap 0.59% : 0.000079s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 37.50% : 0.005005s : 1: jit_opt_a 1.03% : 0.000137s : 1: jit_opt_after_cconv 0.37% : 0.000050s : 1: jit_opt_b 3.07% : 0.000409s : 1: loop_unroll 4.11% : 0.000548s : 1: mutable_eliminate 5.57% : 0.000743s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000443s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000038s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.67% : 0.000356s : 1: renormalize.infer 2.44% : 0.000326s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000038s : 1: rewriter_after_opt_a 0.50% : 0.000067s : 1: rewriter_before_opt_a 0.55% : 0.000073s : 1: symbol_engine_optimizer 32.44% : 0.004329s : 1: type_inference TotalTime = 0.0120027, [30] [bootstrap]: 0.00026622 [type_inference]: 0.00460135 [event_method]: 1.752e-05 [auto_monad]: 6.369e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 1.96e-06 [py_interpret_to_execute]: 3.976e-05 [rewriter_before_opt_a]: 7.494e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.0049743, [2] [Cycle 1]: 0.00156034, [27] [switch_simplify]: 5.182e-05 [loop_unroll]: 2.948e-05 [a_1]: 0.00050384 [with_stream_mark]: 1.52e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 2.96001e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 8.66002e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 8.35001e-06 [inline_without_move]: 5.02e-06 [renormalize]: 0.0006534 [add_forward_monad_depend]: 5.57999e-06 [auto_monad_grad]: 2.11998e-06 [auto_monad_eliminator]: 1.417e-05 [cse]: 2.75e-05 [replace_applicator]: 1.157e-05 [Cycle 2]: 0.00030166, [27] [switch_simplify]: 5.53002e-06 [loop_unroll]: 4.65999e-06 [a_1]: 8.745e-05 [with_stream_mark]: 7.68999e-06 [recompute_prepare]: 4.63999e-06 [updatestate_depend_eliminate]: 2.59001e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 4.82e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 4.59002e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 2.59001e-06 [cell_reuse_recompute_pass]: 1.14003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.171e-05 [j_node_and_user_rematch]: 7.60998e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.04001e-06 [inline_without_move]: 4.56002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.25999e-06 [cse]: 1.031e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 9.19e-06 [rewriter_after_opt_a]: 3.077e-05 [convert_after_rewriter]: 6.71e-06 [order_py_execute_after_rewriter]: 5.12999e-06 [mutable_eliminate]: 0.00046885 [jit_opt_b]: 4.813e-05, [1] [Cycle 1]: 4.159e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.469e-05 [cconv]: 2.474e-05 [loop_unroll]: 0.00039885 [jit_opt_after_cconv]: 0.00013265, [1] [Cycle 1]: 0.00012657, [11] [c_1]: 1.961e-05 [parameter_eliminate]: 2.19999e-06 [updatestate_depend_eliminate]: 4.92e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 1.784e-05 [call_graph_tuple_transform]: 1.776e-05 [tuple_list_get_item_eliminator]: 5.27001e-06 [none_parameter_eliminate]: 1.46002e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 5.00001e-06 [remove_dup_value]: 1.604e-05 [partial_unused_args_eliminate]: 2.12001e-06 [environ_conv]: 5.22999e-06 [add_recomputation]: 4.473e-05 [cse_after_recomputation]: 2.059e-05, [1] [Cycle 1]: 1.582e-05, [1] [cse]: 1.029e-05 [auto_monad_reorder]: 1.521e-05 [get_jit_bprop_graph]: 1.245e-05 [rewriter_after_jit_bprop_graph]: 4.84e-06 [opt_after_jit_grad]: 0.00045549 [symbol_engine_optimizer]: 6.976e-05, [1] [Cycle 1]: 6.386e-05, [6] [build]: 3.10002e-06 [elim_shapecalc]: 7.33999e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.49998e-06 [renormalize]: 3.30008e-07 [validate]: 3.252e-05 Sums bootstrap : 0.000266s : 3.18% type_inference : 0.004601s : 55.03% event_method : 0.000018s : 0.21% auto_monad : 0.000064s : 0.76% graph_reusing : 0.000007s : 0.08% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.48% rewriter_before_opt_a : 0.000075s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000057s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.41% jit_opt_a.a_1 : 0.000591s : 7.07% jit_opt_a.with_stream_mark : 0.000023s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000653s : 7.81% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000038s : 0.45% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000031s : 0.37% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000469s : 5.61% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.30% loop_unroll : 0.000399s : 4.77% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000045s : 0.53% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000012s : 0.15% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000455s : 5.45% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.39% Time group info: ------[substitution.] 0.000181 23 1.12% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000005s : 3: substitution.graph_param_transform 82.21% : 0.000149s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.54% : 0.000005s : 4: substitution.remove_not_recompute_node 2.09% : 0.000004s : 2: substitution.replace_old_param 6.65% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004540 2 78.62% : 0.003569s : 1: type_inference.infer 21.38% : 0.000971s : 1: type_inference.specialize ------[replace.] 0.000065 6 68.43% : 0.000044s : 4: replace.inline 31.57% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000157 6 93.03% : 0.000146s : 4: match.inline 6.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.53% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.13% : 0.000001s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.31% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.44% : 0.000002s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.58% : 0.000001s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.56% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.68% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000008s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.57% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.80% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.86% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000611 13 47.55% : 0.000290s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.33% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.12% : 0.000294s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013506 72 0.35% : 0.000047s : 1: add_recomputation 0.50% : 0.000067s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.06% : 0.000279s : 1: bootstrap 0.20% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.11% : 0.000015s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 36.85% : 0.004977s : 1: jit_opt_a 1.00% : 0.000135s : 1: jit_opt_after_cconv 0.37% : 0.000050s : 1: jit_opt_b 3.01% : 0.000407s : 1: loop_unroll 3.53% : 0.000477s : 1: mutable_eliminate 5.86% : 0.000791s : 26: opt.transform.jit_opt_a 0.33% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.43% : 0.000463s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.43% : 0.000329s : 1: renormalize.infer 2.35% : 0.000317s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000034s : 1: rewriter_after_opt_a 0.58% : 0.000078s : 1: rewriter_before_opt_a 0.53% : 0.000072s : 1: symbol_engine_optimizer 34.15% : 0.004613s : 1: type_inference TotalTime = 0.114194, [30] [bootstrap]: 0.00026951 [type_inference]: 0.103107 [event_method]: 1.837e-05 [auto_monad]: 0.00010802 [graph_reusing]: 6.49999e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00046183 [rewriter_before_opt_a]: 8.965e-05 [expand_dump_flag]: 3.56001e-06 [jit_opt_a]: 0.00789543, [2] [Cycle 1]: 0.00397732, [27] [switch_simplify]: 6.135e-05 [loop_unroll]: 3.1e-05 [a_1]: 0.0006086 [with_stream_mark]: 1.883e-05 [recompute_prepare]: 9.05001e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 2.04999e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 7.11999e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.40002e-06 [merge_forward]: 4.92e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.588e-05 [j_node_and_user_rematch]: 1.044e-05 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.41e-06 [inline_without_move]: 6.22001e-06 [renormalize]: 0.00288852 [add_forward_monad_depend]: 7.05e-06 [auto_monad_grad]: 2.41e-06 [auto_monad_eliminator]: 1.97e-05 [cse]: 3.487e-05 [replace_applicator]: 1.971e-05 [Cycle 2]: 0.00037826, [27] [switch_simplify]: 7.11001e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00012766 [with_stream_mark]: 1.228e-05 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.26998e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 6.36e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.86e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 5.78002e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 8.95999e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.37e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.58e-06 [cse]: 1.337e-05 [replace_applicator]: 6.38e-06 [py_interpret_to_execute_after_opt_a]: 1.068e-05 [rewriter_after_opt_a]: 3.808e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00065612 [jit_opt_b]: 5.572e-05, [1] [Cycle 1]: 4.951e-05, [2] [frontend_op_eliminate]: 2.061e-05 [inline_after_opt_a]: 1.76e-05 [cconv]: 1.687e-05 [loop_unroll]: 0.00044246 [jit_opt_after_cconv]: 0.00015182, [1] [Cycle 1]: 0.00014539, [11] [c_1]: 2.643e-05 [parameter_eliminate]: 2.48002e-06 [updatestate_depend_eliminate]: 5.64998e-06 [updatestate_assign_eliminate]: 3.28998e-06 [updatestate_loads_eliminate]: 2.36998e-06 [cse]: 2.274e-05 [call_graph_tuple_transform]: 1.938e-05 [tuple_list_get_item_eliminator]: 6.63e-06 [none_parameter_eliminate]: 1.02e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 8.87999e-06 [partial_unused_args_eliminate]: 1.37e-06 [environ_conv]: 6.43e-06 [add_recomputation]: 3.243e-05 [cse_after_recomputation]: 2.183e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 9.74999e-06 [get_jit_bprop_graph]: 1.66e-06 [rewriter_after_jit_bprop_graph]: 5.52999e-06 [opt_after_jit_grad]: 0.00045832 [symbol_engine_optimizer]: 7.231e-05, [1] [Cycle 1]: 6.688e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 8.49998e-06 [elim_not_effective]: 1.291e-05 [opt_reshape]: 6.25002e-06 [fold_const_symbol]: 9.16998e-06 [renormalize]: 4.00003e-07 [validate]: 5.611e-05 Sums bootstrap : 0.000270s : 0.24% type_inference : 0.103107s : 93.67% event_method : 0.000018s : 0.02% auto_monad : 0.000108s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000462s : 0.42% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000736s : 0.67% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002889s : 2.62% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000048s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000656s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000442s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000458s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.05% Time group info: ------[substitution.] 0.000221 24 0.58% : 0.000001s : 2: substitution.elim_not_effective 0.33% : 0.000001s : 2: substitution.fold_const_symbol 2.14% : 0.000005s : 4: substitution.graph_param_transform 84.92% : 0.000187s : 4: substitution.inline 1.63% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000006s : 4: substitution.remove_not_recompute_node 2.07% : 0.000005s : 2: substitution.replace_old_param 5.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103031 2 97.48% : 0.100437s : 1: type_inference.infer 2.52% : 0.002594s : 1: type_inference.specialize ------[replace.] 0.000082 6 65.83% : 0.000054s : 4: replace.inline 34.17% : 0.000028s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.16% : 0.000185s : 4: match.inline 5.84% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.73% : 0.000002s : 12: predicate.arithmetic_simplify 1.49% : 0.000002s : 12: predicate.cast_eliminate 0.67% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 4: predicate.fold_const_symbol 1.24% : 0.000002s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.76% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.80% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.81% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 2.16% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.34% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.72% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 2.15% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.78% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.95% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002031 22 62.58% : 0.001271s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.68% : 0.000725s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118130 72 0.03% : 0.000035s : 1: add_recomputation 0.09% : 0.000112s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.24% : 0.000279s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.69% : 0.007899s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.38% : 0.000451s : 1: loop_unroll 0.56% : 0.000667s : 1: mutable_eliminate 0.83% : 0.000981s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000019s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000469s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.70% : 0.002006s : 1: renormalize.infer 0.74% : 0.000874s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000041s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 87.30% : 0.103125s : 1: type_inference TotalTime = 0.112449, [30] [bootstrap]: 0.00025322 [type_inference]: 0.10229 [event_method]: 1.912e-05 [auto_monad]: 5.335e-05 [graph_reusing]: 4.36002e-06 [pre_auto_parallel]: 1.79e-06 [py_interpret_to_execute]: 0.00046452 [rewriter_before_opt_a]: 8.062e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00708371, [2] [Cycle 1]: 0.00350408, [27] [switch_simplify]: 4.911e-05 [loop_unroll]: 3.15e-05 [a_1]: 0.00053818 [with_stream_mark]: 1.718e-05 [recompute_prepare]: 8.77e-06 [updatestate_depend_eliminate]: 4.07003e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.22002e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 7.21999e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.29003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 1.059e-05 [meta_fg_expand]: 2.62001e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 6.11998e-06 [renormalize]: 0.00253075 [add_forward_monad_depend]: 5.69e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.72e-05 [cse]: 3.174e-05 [replace_applicator]: 1.356e-05 [Cycle 2]: 0.0003634, [27] [switch_simplify]: 7.18e-06 [loop_unroll]: 5.83997e-06 [a_1]: 0.00012444 [with_stream_mark]: 9.64999e-06 [recompute_prepare]: 5.87999e-06 [updatestate_depend_eliminate]: 3.03998e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.06002e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.05002e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.31998e-06 [merge_forward]: 2.88998e-06 [cell_reuse_recompute_pass]: 1.91998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.433e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.076e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.019e-05 [rewriter_after_opt_a]: 3.526e-05 [convert_after_rewriter]: 6.80002e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00057847 [jit_opt_b]: 5.579e-05, [1] [Cycle 1]: 4.811e-05, [2] [frontend_op_eliminate]: 1.872e-05 [inline_after_opt_a]: 1.809e-05 [cconv]: 2.57e-05 [loop_unroll]: 0.00043253 [jit_opt_after_cconv]: 0.0001494, [1] [Cycle 1]: 0.00014247, [11] [c_1]: 2.722e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.97001e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.029e-05 [call_graph_tuple_transform]: 1.978e-05 [tuple_list_get_item_eliminator]: 6.13998e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.83002e-06 [remove_dup_value]: 1.624e-05 [partial_unused_args_eliminate]: 2.31998e-06 [environ_conv]: 7.75e-06 [add_recomputation]: 5.235e-05 [cse_after_recomputation]: 2.355e-05, [1] [Cycle 1]: 1.793e-05, [1] [cse]: 1.111e-05 [auto_monad_reorder]: 1.682e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 4.98001e-06 [opt_after_jit_grad]: 0.00047773 [symbol_engine_optimizer]: 7.442e-05, [1] [Cycle 1]: 6.823e-05, [6] [build]: 3.29001e-06 [elim_shapecalc]: 8.20999e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 6.29999e-06 [fold_const_symbol]: 9.61e-06 [renormalize]: 4.30009e-07 [validate]: 5.386e-05 Sums bootstrap : 0.000253s : 0.23% type_inference : 0.102290s : 94.13% event_method : 0.000019s : 0.02% auto_monad : 0.000053s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000465s : 0.43% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000663s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002531s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000578s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000433s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000478s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000054s : 0.05% Time group info: ------[substitution.] 0.000177 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000006s : 4: substitution.graph_param_transform 80.72% : 0.000143s : 4: substitution.inline 2.17% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.88% : 0.000005s : 4: substitution.remove_not_recompute_node 2.46% : 0.000004s : 2: substitution.replace_old_param 6.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102224 2 97.42% : 0.099585s : 1: type_inference.infer 2.58% : 0.002640s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.60% : 0.000047s : 4: replace.inline 33.40% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 92.80% : 0.000140s : 4: match.inline 7.20% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.63% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000001s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.48% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.57% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.36% : 0.000010s : 58: predicate.switch_simplify 1.45% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.02% : 0.000003s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001986 22 63.40% : 0.001259s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.13% : 0.000698s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115930 72 0.05% : 0.000055s : 1: add_recomputation 0.05% : 0.000057s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000265s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.11% : 0.007087s : 1: jit_opt_a 0.13% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.38% : 0.000440s : 1: loop_unroll 0.51% : 0.000587s : 1: mutable_eliminate 0.77% : 0.000890s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000470s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.54% : 0.001780s : 1: renormalize.infer 0.64% : 0.000743s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 88.25% : 0.102305s : 1: type_inference TotalTime = 0.114037, [30] [bootstrap]: 0.00028336 [type_inference]: 0.103505 [event_method]: 1.801e-05 [auto_monad]: 6.899e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00044608 [rewriter_before_opt_a]: 8.769e-05 [expand_dump_flag]: 3.46999e-06 [jit_opt_a]: 0.00739161, [2] [Cycle 1]: 0.00358875, [27] [switch_simplify]: 5.799e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00056501 [with_stream_mark]: 1.792e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.35e-06 [parameter_eliminate]: 1.79998e-06 [specialize_transform]: 7.23e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 7.67002e-06 [meta_shard_fg_expand]: 2.54001e-06 [get_grad_eliminate_]: 6.84001e-06 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.738e-05 [j_node_and_user_rematch]: 9.82999e-06 [meta_fg_expand]: 2.91e-06 [replace_old_param]: 9.48002e-06 [inline_without_move]: 6.21e-06 [renormalize]: 0.00256108 [add_forward_monad_depend]: 6.71999e-06 [auto_monad_grad]: 2.12001e-06 [auto_monad_eliminator]: 1.698e-05 [cse]: 3.137e-05 [replace_applicator]: 1.595e-05 [Cycle 2]: 0.0003813, [27] [switch_simplify]: 7.25e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00012669 [with_stream_mark]: 1.086e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 3.40998e-06 [updatestate_loads_eliminate]: 2.42001e-06 [parameter_eliminate]: 1.42e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 6.36e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 2.88003e-06 [cell_reuse_recompute_pass]: 1.27999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.671e-05 [j_node_and_user_rematch]: 9.87001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 8.23001e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 8.89995e-07 [auto_monad_eliminator]: 6.11e-06 [cse]: 1.2e-05 [replace_applicator]: 6.31998e-06 [py_interpret_to_execute_after_opt_a]: 8.91002e-06 [rewriter_after_opt_a]: 3.216e-05 [convert_after_rewriter]: 6.66e-06 [order_py_execute_after_rewriter]: 5.57001e-06 [mutable_eliminate]: 0.00058266 [jit_opt_b]: 5.64e-05, [1] [Cycle 1]: 5.002e-05, [2] [frontend_op_eliminate]: 2.028e-05 [inline_after_opt_a]: 1.853e-05 [cconv]: 2.481e-05 [loop_unroll]: 0.00042695 [jit_opt_after_cconv]: 0.00014584, [1] [Cycle 1]: 0.00013989, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 1.936e-05 [call_graph_tuple_transform]: 1.997e-05 [tuple_list_get_item_eliminator]: 6.12001e-06 [none_parameter_eliminate]: 1.54e-06 [renormalize]: 9.00007e-07 [switch_simplify]: 6.38e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 7.65e-06 [add_recomputation]: 4.948e-05 [cse_after_recomputation]: 2.128e-05, [1] [Cycle 1]: 1.607e-05, [1] [cse]: 1.071e-05 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 1.52001e-06 [rewriter_after_jit_bprop_graph]: 4.61002e-06 [opt_after_jit_grad]: 0.00049428 [symbol_engine_optimizer]: 0.00010714, [1] [Cycle 1]: 0.00010021, [6] [build]: 3.33e-06 [elim_shapecalc]: 8.85001e-06 [elim_not_effective]: 1.29e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 3.921e-05 [renormalize]: 4.30009e-07 [validate]: 4.051e-05 Sums bootstrap : 0.000283s : 0.26% type_inference : 0.103505s : 94.07% event_method : 0.000018s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000446s : 0.41% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000065s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000692s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002561s : 2.33% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000583s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000427s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000494s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000039s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000196 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 82.47% : 0.000162s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.13% : 0.000006s : 4: substitution.remove_not_recompute_node 2.02% : 0.000004s : 2: substitution.replace_old_param 6.18% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103418 2 97.42% : 0.100753s : 1: type_inference.infer 2.58% : 0.002664s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.06% : 0.000049s : 4: replace.inline 32.94% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 93.53% : 0.000159s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.11% : 0.000001s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.05% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.49% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 2.12% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.91% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.49% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001999 22 64.86% : 0.001296s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.44% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.70% : 0.000674s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117641 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000297s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.29% : 0.007395s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.37% : 0.000435s : 1: loop_unroll 0.50% : 0.000591s : 1: mutable_eliminate 0.80% : 0.000936s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000064s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000503s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000452s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.57% : 0.001844s : 1: renormalize.infer 0.60% : 0.000708s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.09% : 0.000110s : 1: symbol_engine_optimizer 88.00% : 0.103525s : 1: type_inference TotalTime = 0.0657517, [30] [bootstrap]: 0.00027172 [type_inference]: 0.0558996 [event_method]: 1.761e-05 [auto_monad]: 5.388e-05 [graph_reusing]: 5.27999e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00029809 [rewriter_before_opt_a]: 7.483e-05 [expand_dump_flag]: 2.66e-06 [jit_opt_a]: 0.0069184, [2] [Cycle 1]: 0.00321547, [27] [switch_simplify]: 5.128e-05 [loop_unroll]: 3.097e-05 [a_1]: 0.00054129 [with_stream_mark]: 1.589e-05 [recompute_prepare]: 1.04e-05 [updatestate_depend_eliminate]: 4.22998e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.40002e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 7.28e-06 [updatestate_useless_node_eliminater]: 6.12001e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.16998e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 1.035e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.23002e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00223992 [add_forward_monad_depend]: 5.56998e-06 [auto_monad_grad]: 1.79998e-06 [auto_monad_eliminator]: 1.634e-05 [cse]: 2.545e-05 [replace_applicator]: 1.377e-05 [Cycle 2]: 0.00036944, [27] [switch_simplify]: 7.3e-06 [loop_unroll]: 6.13998e-06 [a_1]: 0.00012581 [with_stream_mark]: 1.031e-05 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 3.30998e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 2.37001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.54998e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.06999e-06 [cell_reuse_recompute_pass]: 2.05002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.537e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 2.64999e-06 [replace_old_param]: 8.45001e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.60001e-06 [cse]: 1.159e-05 [replace_applicator]: 5.64e-06 [py_interpret_to_execute_after_opt_a]: 7.94002e-06 [rewriter_after_opt_a]: 3.303e-05 [convert_after_rewriter]: 6.93998e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00056429 [jit_opt_b]: 5.433e-05, [1] [Cycle 1]: 4.766e-05, [2] [frontend_op_eliminate]: 1.962e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 2.479e-05 [loop_unroll]: 0.00040986 [jit_opt_after_cconv]: 0.00015205, [1] [Cycle 1]: 0.00014591, [11] [c_1]: 2.614e-05 [parameter_eliminate]: 2.96999e-06 [updatestate_depend_eliminate]: 5.27001e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.223e-05 [call_graph_tuple_transform]: 2.056e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 6.16998e-06 [remove_dup_value]: 1.536e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 7.76001e-06 [add_recomputation]: 4.616e-05 [cse_after_recomputation]: 2.278e-05, [1] [Cycle 1]: 1.721e-05, [1] [cse]: 1.145e-05 [auto_monad_reorder]: 1.471e-05 [get_jit_bprop_graph]: 1.62999e-06 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.00046774 [symbol_engine_optimizer]: 0.00010754, [1] [Cycle 1]: 0.0001017, [6] [build]: 3.16999e-06 [elim_shapecalc]: 8.18001e-06 [elim_not_effective]: 1.3e-05 [opt_reshape]: 6.28002e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 3.89991e-07 [validate]: 8.995e-05 Sums bootstrap : 0.000272s : 0.44% type_inference : 0.055900s : 90.43% event_method : 0.000018s : 0.03% auto_monad : 0.000054s : 0.09% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000298s : 0.48% rewriter_before_opt_a : 0.000075s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000667s : 1.08% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002240s : 3.62% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000037s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000564s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000410s : 0.66% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000468s : 0.76% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000090s : 0.15% Time group info: ------[substitution.] 0.000172 24 1.10% : 0.000002s : 2: substitution.elim_not_effective 1.07% : 0.000002s : 2: substitution.fold_const_symbol 3.47% : 0.000006s : 4: substitution.graph_param_transform 78.87% : 0.000136s : 4: substitution.inline 2.33% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.15% : 0.000005s : 4: substitution.remove_not_recompute_node 2.35% : 0.000004s : 2: substitution.replace_old_param 7.64% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055828 2 96.56% : 0.053909s : 1: type_inference.infer 3.44% : 0.001919s : 1: type_inference.specialize ------[replace.] 0.000069 6 65.68% : 0.000045s : 4: replace.inline 34.32% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 91.75% : 0.000133s : 4: match.inline 8.25% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.67% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.38% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.53% : 0.000002s : 12: predicate.print_const_string_wrapper 2.08% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.36% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.77% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.70% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.33% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.42% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.70% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.94% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002479 30 73.12% : 0.001813s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.05% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.83% : 0.000640s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.068912 72 0.07% : 0.000049s : 1: add_recomputation 0.08% : 0.000057s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.42% : 0.000287s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.04% : 0.006922s : 1: jit_opt_a 0.22% : 0.000155s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.61% : 0.000418s : 1: loop_unroll 0.83% : 0.000573s : 1: mutable_eliminate 1.30% : 0.000897s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000303s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.25% : 0.001547s : 1: renormalize.infer 0.99% : 0.000684s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000036s : 1: rewriter_after_opt_a 0.12% : 0.000080s : 1: rewriter_before_opt_a 0.16% : 0.000110s : 1: symbol_engine_optimizer 81.14% : 0.055914s : 1: type_inference TotalTime = 0.0639087, [30] [bootstrap]: 0.00026171 [type_inference]: 0.0539647 [event_method]: 1.893e-05 [auto_monad]: 5.705e-05 [graph_reusing]: 4.87998e-06 [pre_auto_parallel]: 1.91e-06 [py_interpret_to_execute]: 0.00029845 [rewriter_before_opt_a]: 7.75e-05 [expand_dump_flag]: 2.55002e-06 [jit_opt_a]: 0.00673997, [2] [Cycle 1]: 0.00308401, [27] [switch_simplify]: 5.008e-05 [loop_unroll]: 3.112e-05 [a_1]: 0.00059635 [with_stream_mark]: 1.233e-05 [recompute_prepare]: 8.35001e-06 [updatestate_depend_eliminate]: 3.25002e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 6.69999e-06 [updatestate_useless_node_eliminater]: 6.26998e-06 [accelerated_algorithm]: 7e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 2.54999e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00206927 [add_forward_monad_depend]: 5.12999e-06 [auto_monad_grad]: 2.12999e-06 [auto_monad_eliminator]: 1.582e-05 [cse]: 2.279e-05 [replace_applicator]: 1.55e-05 [Cycle 2]: 0.00037308, [27] [switch_simplify]: 6.94999e-06 [loop_unroll]: 5.76003e-06 [a_1]: 0.000126 [with_stream_mark]: 1.093e-05 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 3.05998e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 2.63e-06 [parameter_eliminate]: 1.60999e-06 [specialize_transform]: 5.55001e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 5.51e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 2.46998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.582e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.14998e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.31998e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.41e-06 [cse]: 1.186e-05 [replace_applicator]: 6.21e-06 [py_interpret_to_execute_after_opt_a]: 9.36e-06 [rewriter_after_opt_a]: 3.205e-05 [convert_after_rewriter]: 6.78998e-06 [order_py_execute_after_rewriter]: 4.81002e-06 [mutable_eliminate]: 0.00073512 [jit_opt_b]: 5.96e-05, [1] [Cycle 1]: 5.151e-05, [2] [frontend_op_eliminate]: 2.121e-05 [inline_after_opt_a]: 1.807e-05 [cconv]: 2.502e-05 [loop_unroll]: 0.00045883 [jit_opt_after_cconv]: 0.00015884, [1] [Cycle 1]: 0.00015108, [11] [c_1]: 2.725e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 3.11999e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 2.362e-05 [call_graph_tuple_transform]: 2.192e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 8.70001e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.558e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 8.47e-06 [add_recomputation]: 5.067e-05 [cse_after_recomputation]: 2.283e-05, [1] [Cycle 1]: 1.708e-05, [1] [cse]: 1.14e-05 [auto_monad_reorder]: 1.696e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 5.64e-06 [opt_after_jit_grad]: 0.00051751 [symbol_engine_optimizer]: 8.004e-05, [1] [Cycle 1]: 7.384e-05, [6] [build]: 3.18998e-06 [elim_shapecalc]: 8.61002e-06 [elim_not_effective]: 1.461e-05 [opt_reshape]: 7.85e-06 [fold_const_symbol]: 1.039e-05 [renormalize]: 4.89992e-07 [validate]: 4.542e-05 Sums bootstrap : 0.000262s : 0.44% type_inference : 0.053965s : 89.95% event_method : 0.000019s : 0.03% auto_monad : 0.000057s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000298s : 0.50% rewriter_before_opt_a : 0.000078s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000722s : 1.20% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002069s : 3.45% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000035s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000032s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000735s : 1.23% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000459s : 0.76% jit_opt_after_cconv.c_1 : 0.000027s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000518s : 0.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.000188 24 1.28% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 3.64% : 0.000007s : 4: substitution.graph_param_transform 81.52% : 0.000154s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.97% : 0.000006s : 4: substitution.remove_not_recompute_node 2.40% : 0.000005s : 2: substitution.replace_old_param 5.80% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053890 2 96.45% : 0.051974s : 1: type_inference.infer 3.55% : 0.001916s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.91% : 0.000047s : 4: replace.inline 33.09% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.92% : 0.000151s : 4: match.inline 6.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.43% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 2.14% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.36% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.62% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.31% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.99% : 0.000003s : 4: predicate.mutable_eliminate 0.88% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.94% : 0.000003s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.73% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.16% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.15% : 0.000002s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.88% : 0.000009s : 58: predicate.switch_simplify 1.15% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.92% : 0.000003s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002235 26 71.48% : 0.001598s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.37% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.15% : 0.000607s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066959 72 0.08% : 0.000054s : 1: add_recomputation 0.09% : 0.000060s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.41% : 0.000273s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.07% : 0.006743s : 1: jit_opt_a 0.24% : 0.000161s : 1: jit_opt_after_cconv 0.09% : 0.000063s : 1: jit_opt_b 0.70% : 0.000467s : 1: loop_unroll 1.11% : 0.000745s : 1: mutable_eliminate 1.42% : 0.000952s : 26: opt.transform.jit_opt_a 0.09% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000304s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.10% : 0.001405s : 1: renormalize.infer 0.98% : 0.000657s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000083s : 1: symbol_engine_optimizer 80.62% : 0.053979s : 1: type_inference TotalTime = 0.0115097, [30] [bootstrap]: 0.00026858 [type_inference]: 0.00416101 [event_method]: 1.707e-05 [auto_monad]: 6.244e-05 [graph_reusing]: 4.85999e-06 [pre_auto_parallel]: 2.12999e-06 [py_interpret_to_execute]: 3.546e-05 [rewriter_before_opt_a]: 7.169e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.00496782, [2] [Cycle 1]: 0.00147932, [27] [switch_simplify]: 4.899e-05 [loop_unroll]: 2.988e-05 [a_1]: 0.00049883 [with_stream_mark]: 1.378e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 4.94998e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 5.70001e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.396e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.49e-06 [inline_without_move]: 5.84e-06 [renormalize]: 0.00056795 [add_forward_monad_depend]: 4.62e-06 [auto_monad_grad]: 1.76003e-06 [auto_monad_eliminator]: 1.364e-05 [cse]: 1.866e-05 [replace_applicator]: 1.034e-05 [Cycle 2]: 0.00031322, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.90001e-06 [a_1]: 9.18e-05 [with_stream_mark]: 8.15e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.10999e-06 [updatestate_useless_node_eliminater]: 4.90999e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 4.41002e-06 [merge_forward]: 2.43002e-06 [cell_reuse_recompute_pass]: 1.35999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.215e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.81997e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.29984e-07 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 5.76e-06 [cse]: 1.014e-05 [replace_applicator]: 5.43002e-06 [py_interpret_to_execute_after_opt_a]: 7.76001e-06 [rewriter_after_opt_a]: 2.96e-05 [convert_after_rewriter]: 6.49999e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00047895 [jit_opt_b]: 4.663e-05, [1] [Cycle 1]: 4.086e-05, [2] [frontend_op_eliminate]: 1.535e-05 [inline_after_opt_a]: 1.51e-05 [cconv]: 2.248e-05 [loop_unroll]: 0.00039613 [jit_opt_after_cconv]: 0.00013468, [1] [Cycle 1]: 0.00012863, [11] [c_1]: 2.069e-05 [parameter_eliminate]: 1.92999e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.822e-05 [call_graph_tuple_transform]: 1.768e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.87001e-06 [renormalize]: 6.19999e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.178e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 3.91001e-06 [add_recomputation]: 4.833e-05 [cse_after_recomputation]: 2.178e-05, [1] [Cycle 1]: 1.648e-05, [1] [cse]: 1.058e-05 [auto_monad_reorder]: 1.222e-05 [get_jit_bprop_graph]: 1.40001e-06 [rewriter_after_jit_bprop_graph]: 4.02e-06 [opt_after_jit_grad]: 0.00043734 [symbol_engine_optimizer]: 6.688e-05, [1] [Cycle 1]: 6.118e-05, [6] [build]: 2.02999e-06 [elim_shapecalc]: 7.36001e-06 [elim_not_effective]: 1.156e-05 [opt_reshape]: 5.54998e-06 [fold_const_symbol]: 7.92998e-06 [renormalize]: 3.10014e-07 [validate]: 2.883e-05 Sums bootstrap : 0.000269s : 3.45% type_inference : 0.004161s : 53.48% event_method : 0.000017s : 0.22% auto_monad : 0.000062s : 0.80% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.46% rewriter_before_opt_a : 0.000072s : 0.92% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000591s : 7.59% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.22% jit_opt_a.inline_without_move : 0.000011s : 0.14% jit_opt_a.renormalize : 0.000568s : 7.30% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000029s : 0.37% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.38% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000479s : 6.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000022s : 0.29% loop_unroll : 0.000396s : 5.09% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000012s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000048s : 0.62% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000012s : 0.16% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000437s : 5.62% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.37% Time group info: ------[substitution.] 0.000174 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 3.14% : 0.000005s : 3: substitution.graph_param_transform 81.22% : 0.000141s : 4: substitution.inline 1.97% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.94% : 0.000005s : 4: substitution.remove_not_recompute_node 2.37% : 0.000004s : 2: substitution.replace_old_param 6.75% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004103 2 79.58% : 0.003265s : 1: type_inference.infer 20.42% : 0.000838s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.18% : 0.000043s : 4: replace.inline 33.82% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000149 6 92.91% : 0.000139s : 4: match.inline 7.09% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.37% : 0.000002s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.23% : 0.000001s : 10: predicate.addn_zero_filter 2.26% : 0.000003s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.09% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.84% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.51% : 0.000002s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.21% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 6: predicate.less_batch_normalization 1.84% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.17% : 0.000002s : 15: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.06% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.34% : 0.000001s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000002s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.52% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.27% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.92% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000551 13 50.38% : 0.000277s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.64% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.98% : 0.000248s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012935 72 0.40% : 0.000052s : 1: add_recomputation 0.51% : 0.000065s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 2.18% : 0.000281s : 1: bootstrap 0.19% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 38.43% : 0.004971s : 1: jit_opt_a 1.06% : 0.000137s : 1: jit_opt_after_cconv 0.38% : 0.000049s : 1: jit_opt_b 3.12% : 0.000404s : 1: loop_unroll 3.76% : 0.000487s : 1: mutable_eliminate 6.14% : 0.000794s : 26: opt.transform.jit_opt_a 0.35% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000029s : 4: opt.transform.symbol_engine_opt 3.44% : 0.000445s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000038s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 2.24% : 0.000290s : 1: renormalize.infer 2.09% : 0.000271s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000032s : 1: rewriter_after_opt_a 0.58% : 0.000075s : 1: rewriter_before_opt_a 0.54% : 0.000069s : 1: symbol_engine_optimizer 32.25% : 0.004171s : 1: type_inference TotalTime = 0.0115735, [30] [bootstrap]: 0.00024881 [type_inference]: 0.00445374 [event_method]: 1.672e-05 [auto_monad]: 5.633e-05 [graph_reusing]: 4.59998e-06 [pre_auto_parallel]: 1.84e-06 [py_interpret_to_execute]: 3.638e-05 [rewriter_before_opt_a]: 6.893e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.0047629, [2] [Cycle 1]: 0.00146938, [27] [switch_simplify]: 4.726e-05 [loop_unroll]: 2.92e-05 [a_1]: 0.00048406 [with_stream_mark]: 1.331e-05 [recompute_prepare]: 7.26001e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 6.37001e-06 [updatestate_useless_node_eliminater]: 5.22999e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.24998e-06 [merge_forward]: 2.98998e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.254e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 7.98001e-06 [inline_without_move]: 5.07999e-06 [renormalize]: 0.00060594 [add_forward_monad_depend]: 4.58999e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 1.298e-05 [cse]: 2.112e-05 [replace_applicator]: 1.17e-05 [Cycle 2]: 0.00032907, [27] [switch_simplify]: 6.01003e-06 [loop_unroll]: 4.96002e-06 [a_1]: 8.906e-05 [with_stream_mark]: 8.08001e-06 [recompute_prepare]: 5.14e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.75001e-06 [accelerated_algorithm]: 4.62998e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.38001e-06 [merge_forward]: 2.36998e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.272e-05 [j_node_and_user_rematch]: 7.83001e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 7.35998e-06 [inline_without_move]: 4.77998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.15001e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.54999e-06 [cse]: 1.154e-05 [replace_applicator]: 4.79002e-06 [py_interpret_to_execute_after_opt_a]: 8.95999e-06 [rewriter_after_opt_a]: 2.908e-05 [convert_after_rewriter]: 6.14999e-06 [order_py_execute_after_rewriter]: 4.52003e-06 [mutable_eliminate]: 0.00046793 [jit_opt_b]: 4.654e-05, [1] [Cycle 1]: 4.075e-05, [2] [frontend_op_eliminate]: 1.533e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 2.024e-05 [loop_unroll]: 0.0003951 [jit_opt_after_cconv]: 0.0001321, [1] [Cycle 1]: 0.00012585, [11] [c_1]: 2.046e-05 [parameter_eliminate]: 2.28002e-06 [updatestate_depend_eliminate]: 5.09e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.684e-05 [call_graph_tuple_transform]: 1.637e-05 [tuple_list_get_item_eliminator]: 5.49998e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.20001e-06 [remove_dup_value]: 1.255e-05 [partial_unused_args_eliminate]: 1.89e-06 [environ_conv]: 4.92999e-06 [add_recomputation]: 5.327e-05 [cse_after_recomputation]: 2.227e-05, [1] [Cycle 1]: 1.652e-05, [1] [cse]: 1.089e-05 [auto_monad_reorder]: 1.358e-05 [get_jit_bprop_graph]: 1.49998e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00044442 [symbol_engine_optimizer]: 6.933e-05, [1] [Cycle 1]: 6.35e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 7.20998e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.63002e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 3.99974e-07 [validate]: 3.095e-05 Sums bootstrap : 0.000249s : 3.09% type_inference : 0.004454s : 55.23% event_method : 0.000017s : 0.21% auto_monad : 0.000056s : 0.70% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.45% rewriter_before_opt_a : 0.000069s : 0.85% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000053s : 0.66% jit_opt_a.loop_unroll : 0.000034s : 0.42% jit_opt_a.a_1 : 0.000573s : 7.11% jit_opt_a.with_stream_mark : 0.000021s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000606s : 7.51% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000033s : 0.40% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000029s : 0.36% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000468s : 5.80% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000020s : 0.25% loop_unroll : 0.000395s : 4.90% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000053s : 0.66% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000014s : 0.17% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000444s : 5.51% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.38% Time group info: ------[substitution.] 0.000167 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000005s : 3: substitution.graph_param_transform 82.39% : 0.000138s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.19% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000003s : 2: substitution.replace_old_param 6.19% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004401 2 79.64% : 0.003505s : 1: type_inference.infer 20.36% : 0.000896s : 1: type_inference.specialize ------[replace.] 0.000061 6 66.29% : 0.000041s : 4: replace.inline 33.71% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 93.57% : 0.000136s : 4: match.inline 6.43% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.28% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.48% : 0.000002s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.15% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 3: predicate.fold_const_symbol 1.13% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.39% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.66% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.10% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 2.04% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.81% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.60% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 16: predicate.switch_defer_inline 2.24% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.98% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.52% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000618 13 49.24% : 0.000304s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.59% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.17% : 0.000285s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013012 72 0.43% : 0.000056s : 1: add_recomputation 0.46% : 0.000059s : 1: auto_monad 0.12% : 0.000016s : 1: auto_monad_reorder 2.00% : 0.000261s : 1: bootstrap 0.17% : 0.000023s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.63% : 0.004766s : 1: jit_opt_a 1.04% : 0.000135s : 1: jit_opt_after_cconv 0.38% : 0.000049s : 1: jit_opt_b 3.11% : 0.000404s : 1: loop_unroll 3.65% : 0.000475s : 1: mutable_eliminate 5.94% : 0.000773s : 26: opt.transform.jit_opt_a 0.34% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.47% : 0.000452s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000015s : 1: remove_dup_value 2.33% : 0.000303s : 1: renormalize.infer 2.27% : 0.000295s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000032s : 1: rewriter_after_opt_a 0.55% : 0.000072s : 1: rewriter_before_opt_a 0.55% : 0.000072s : 1: symbol_engine_optimizer 34.31% : 0.004464s : 1: type_inference TotalTime = 0.114849, [30] [bootstrap]: 0.00024873 [type_inference]: 0.104565 [event_method]: 1.872e-05 [auto_monad]: 6.766e-05 [graph_reusing]: 6.29999e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00044371 [rewriter_before_opt_a]: 8.504e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00718386, [2] [Cycle 1]: 0.00339651, [27] [switch_simplify]: 5.544e-05 [loop_unroll]: 3.104e-05 [a_1]: 0.00056719 [with_stream_mark]: 1.778e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 3.91001e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.18e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.85002e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.48e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 4.35e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.544e-05 [j_node_and_user_rematch]: 9.95002e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.61e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 0.00237986 [add_forward_monad_depend]: 6.21998e-06 [auto_monad_grad]: 1.87001e-06 [auto_monad_eliminator]: 1.662e-05 [cse]: 3.294e-05 [replace_applicator]: 1.761e-05 [Cycle 2]: 0.00037237, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.82001e-06 [a_1]: 0.00012407 [with_stream_mark]: 1.274e-05 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.74999e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.94e-06 [meta_shard_fg_expand]: 1.65001e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 2.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.789e-05 [j_node_and_user_rematch]: 9.21002e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 9.54e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.144e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 9.04e-06 [rewriter_after_opt_a]: 3.339e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 4.97e-06 [mutable_eliminate]: 0.00061863 [jit_opt_b]: 5.391e-05, [1] [Cycle 1]: 4.712e-05, [2] [frontend_op_eliminate]: 1.822e-05 [inline_after_opt_a]: 1.759e-05 [cconv]: 2.448e-05 [loop_unroll]: 0.00042026 [jit_opt_after_cconv]: 0.00014773, [1] [Cycle 1]: 0.00014153, [11] [c_1]: 2.585e-05 [parameter_eliminate]: 2.64001e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 2.129e-05 [call_graph_tuple_transform]: 1.976e-05 [tuple_list_get_item_eliminator]: 6.46e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 2.20025e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.33998e-06 [environ_conv]: 7.16001e-06 [add_recomputation]: 4.719e-05 [cse_after_recomputation]: 2.141e-05, [1] [Cycle 1]: 1.635e-05, [1] [cse]: 1.085e-05 [auto_monad_reorder]: 1.479e-05 [get_jit_bprop_graph]: 1.79998e-06 [rewriter_after_jit_bprop_graph]: 4.47e-06 [opt_after_jit_grad]: 0.00045184 [symbol_engine_optimizer]: 0.00012964, [1] [Cycle 1]: 0.00012327, [6] [build]: 2.96999e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.365e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 6.401e-05 [renormalize]: 3.09985e-07 [validate]: 4.178e-05 Sums bootstrap : 0.000249s : 0.22% type_inference : 0.104565s : 94.31% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000444s : 0.40% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000691s : 0.62% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002380s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000619s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000420s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000452s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000064s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000203 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000006s : 4: substitution.graph_param_transform 81.89% : 0.000167s : 4: substitution.inline 1.75% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000006s : 4: substitution.remove_not_recompute_node 2.76% : 0.000006s : 2: substitution.replace_old_param 6.12% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104494 2 97.55% : 0.101930s : 1: type_inference.infer 2.45% : 0.002564s : 1: type_inference.specialize ------[replace.] 0.000073 6 69.03% : 0.000050s : 4: replace.inline 30.97% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.53% : 0.000164s : 4: match.inline 6.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 0.94% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.27% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.44% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.61% : 0.000002s : 4: predicate.mutable_eliminate 0.47% : 0.000001s : 4: predicate.opt_reshape 2.47% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.31% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.97% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001966 22 66.63% : 0.001310s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.94% : 0.000628s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118281 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.22% : 0.000261s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.08% : 0.007187s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.36% : 0.000428s : 1: loop_unroll 0.53% : 0.000627s : 1: mutable_eliminate 0.78% : 0.000928s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000089s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000450s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.46% : 0.001732s : 1: renormalize.infer 0.54% : 0.000639s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.11% : 0.000133s : 1: symbol_engine_optimizer 88.42% : 0.104581s : 1: type_inference TotalTime = 0.115758, [30] [bootstrap]: 0.00027493 [type_inference]: 0.105081 [event_method]: 1.808e-05 [auto_monad]: 6.79e-05 [graph_reusing]: 5.90002e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 0.00046063 [rewriter_before_opt_a]: 8.184e-05 [expand_dump_flag]: 3.45998e-06 [jit_opt_a]: 0.0074524, [2] [Cycle 1]: 0.00356186, [27] [switch_simplify]: 5.195e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00058242 [with_stream_mark]: 2.089e-05 [recompute_prepare]: 1.039e-05 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 7.05002e-06 [updatestate_useless_node_eliminater]: 6.60997e-06 [accelerated_algorithm]: 6.24999e-06 [meta_shard_fg_expand]: 2.53e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.64998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.746e-05 [j_node_and_user_rematch]: 1.135e-05 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 6.44001e-06 [renormalize]: 0.00253808 [add_forward_monad_depend]: 5.68997e-06 [auto_monad_grad]: 1.96e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 2.116e-05 [replace_applicator]: 1.446e-05 [Cycle 2]: 0.00043011, [27] [switch_simplify]: 7.10002e-06 [loop_unroll]: 5.89e-06 [a_1]: 0.00017947 [with_stream_mark]: 1.253e-05 [recompute_prepare]: 6.13002e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.91e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.56e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.41002e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.85001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 1.86998e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 7.54002e-06 [cse]: 1.362e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 1.251e-05 [rewriter_after_opt_a]: 3.24e-05 [convert_after_rewriter]: 6.38e-06 [order_py_execute_after_rewriter]: 4.58999e-06 [mutable_eliminate]: 0.00062928 [jit_opt_b]: 5.831e-05, [1] [Cycle 1]: 5.05e-05, [2] [frontend_op_eliminate]: 2.01e-05 [inline_after_opt_a]: 1.833e-05 [cconv]: 2.302e-05 [loop_unroll]: 0.00044985 [jit_opt_after_cconv]: 0.00015633, [1] [Cycle 1]: 0.00014956, [11] [c_1]: 2.681e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 6.58e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.357e-05 [call_graph_tuple_transform]: 2.094e-05 [tuple_list_get_item_eliminator]: 6.07999e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.29979e-07 [switch_simplify]: 6.06e-06 [remove_dup_value]: 1.159e-05 [partial_unused_args_eliminate]: 1.62999e-06 [environ_conv]: 7.61999e-06 [add_recomputation]: 4.125e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.046e-05 [auto_monad_reorder]: 1.199e-05 [get_jit_bprop_graph]: 1.30999e-06 [rewriter_after_jit_bprop_graph]: 5.67999e-06 [opt_after_jit_grad]: 0.00049397 [symbol_engine_optimizer]: 0.00012814, [1] [Cycle 1]: 0.00012055, [6] [build]: 3.61999e-06 [elim_shapecalc]: 8.68001e-06 [elim_not_effective]: 1.371e-05 [opt_reshape]: 5.485e-05 [fold_const_symbol]: 1.12e-05 [renormalize]: 3.30008e-07 [validate]: 3.934e-05 Sums bootstrap : 0.000275s : 0.25% type_inference : 0.105081s : 94.06% event_method : 0.000018s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000461s : 0.41% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000762s : 0.68% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002538s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000629s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000450s : 0.40% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000494s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000055s : 0.05% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000206 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.96% : 0.000002s : 2: substitution.fold_const_symbol 2.60% : 0.000005s : 4: substitution.graph_param_transform 82.35% : 0.000169s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000006s : 4: substitution.remove_not_recompute_node 2.32% : 0.000005s : 2: substitution.replace_old_param 6.34% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105006 2 97.41% : 0.102282s : 1: type_inference.infer 2.59% : 0.002724s : 1: type_inference.specialize ------[replace.] 0.000074 6 65.56% : 0.000049s : 4: replace.inline 34.44% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.37% : 0.000167s : 4: match.inline 6.63% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.38% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.50% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.12% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.31% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.62% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.27% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 2.01% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.78% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.75% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.54% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.84% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.27% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.89% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002020 22 64.69% : 0.001307s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.59% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.71% : 0.000681s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119425 72 0.04% : 0.000044s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.24% : 0.000288s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.24% : 0.007455s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.38% : 0.000458s : 1: loop_unroll 0.53% : 0.000639s : 1: mutable_eliminate 0.84% : 0.000998s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000503s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000467s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.51% : 0.001801s : 1: renormalize.infer 0.61% : 0.000728s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000087s : 1: rewriter_before_opt_a 0.11% : 0.000131s : 1: symbol_engine_optimizer 88.00% : 0.105098s : 1: type_inference TotalTime = 0.11775, [30] [bootstrap]: 0.00028115 [type_inference]: 0.106221 [event_method]: 2.016e-05 [auto_monad]: 7.184e-05 [graph_reusing]: 6.61e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 0.00051522 [rewriter_before_opt_a]: 8.735e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00794078, [2] [Cycle 1]: 0.0037451, [27] [switch_simplify]: 5.089e-05 [loop_unroll]: 2.975e-05 [a_1]: 0.00059969 [with_stream_mark]: 1.84e-05 [recompute_prepare]: 8.06001e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.30002e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 7.13e-06 [updatestate_useless_node_eliminater]: 6.22001e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 6.58998e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.51e-05 [j_node_and_user_rematch]: 1.06e-05 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 1.093e-05 [inline_without_move]: 5.99e-06 [renormalize]: 0.00268564 [add_forward_monad_depend]: 8.25999e-06 [auto_monad_grad]: 2.50002e-06 [auto_monad_eliminator]: 1.688e-05 [cse]: 3.285e-05 [replace_applicator]: 2.424e-05 [Cycle 2]: 0.00038583, [27] [switch_simplify]: 7.53e-06 [loop_unroll]: 6.27001e-06 [a_1]: 0.00012825 [with_stream_mark]: 1.249e-05 [recompute_prepare]: 6.07001e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.29001e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 5.66998e-06 [updatestate_useless_node_eliminater]: 5.48002e-06 [accelerated_algorithm]: 5.79999e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 3.92002e-06 [cell_reuse_recompute_pass]: 3.75e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.893e-05 [j_node_and_user_rematch]: 9.83998e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.1e-05 [replace_applicator]: 6.03998e-06 [py_interpret_to_execute_after_opt_a]: 1.3e-05 [rewriter_after_opt_a]: 3.84e-05 [convert_after_rewriter]: 1.219e-05 [order_py_execute_after_rewriter]: 5.20999e-06 [mutable_eliminate]: 0.00074926 [jit_opt_b]: 5.469e-05, [1] [Cycle 1]: 4.801e-05, [2] [frontend_op_eliminate]: 1.894e-05 [inline_after_opt_a]: 1.722e-05 [cconv]: 2.755e-05 [loop_unroll]: 0.00050965 [jit_opt_after_cconv]: 0.00015315, [1] [Cycle 1]: 0.00014668, [11] [c_1]: 2.656e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 4.58001e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.99999e-06 [cse]: 1.963e-05 [call_graph_tuple_transform]: 2.244e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 7.40023e-07 [switch_simplify]: 6.29001e-06 [remove_dup_value]: 1.394e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 8.40001e-06 [add_recomputation]: 5.061e-05 [cse_after_recomputation]: 2.456e-05, [1] [Cycle 1]: 1.929e-05, [1] [cse]: 1.371e-05 [auto_monad_reorder]: 1.594e-05 [get_jit_bprop_graph]: 3.46999e-06 [rewriter_after_jit_bprop_graph]: 5.32001e-06 [opt_after_jit_grad]: 0.00048317 [symbol_engine_optimizer]: 0.00019286, [1] [Cycle 1]: 0.00018581, [6] [build]: 3.63e-06 [elim_shapecalc]: 1.175e-05 [elim_not_effective]: 1.483e-05 [opt_reshape]: 6.66e-06 [fold_const_symbol]: 0.00012044 [renormalize]: 3.59985e-07 [validate]: 4.771e-05 Sums bootstrap : 0.000281s : 0.25% type_inference : 0.106221s : 93.72% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000515s : 0.45% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000728s : 0.64% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002686s : 2.37% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000012s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000749s : 0.66% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000510s : 0.45% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000483s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000012s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000120s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000225 24 1.64% : 0.000004s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 4: substitution.graph_param_transform 81.08% : 0.000182s : 4: substitution.inline 1.86% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000007s : 4: substitution.remove_not_recompute_node 2.59% : 0.000006s : 2: substitution.replace_old_param 6.44% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106137 2 97.33% : 0.103307s : 1: type_inference.infer 2.67% : 0.002830s : 1: type_inference.specialize ------[replace.] 0.000082 6 67.11% : 0.000055s : 4: replace.inline 32.89% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000193 6 93.23% : 0.000180s : 4: match.inline 6.77% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.71% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.60% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 4.93% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.62% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.59% : 0.000004s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.69% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.13% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 18: predicate.switch_defer_inline 1.90% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.60% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.48% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002138 22 65.26% : 0.001395s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.53% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.21% : 0.000710s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121584 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000299s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000014s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.53% : 0.007945s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.43% : 0.000517s : 1: loop_unroll 0.62% : 0.000758s : 1: mutable_eliminate 0.80% : 0.000972s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000151s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000492s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000521s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.56% : 0.001896s : 1: renormalize.infer 0.64% : 0.000779s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000092s : 1: rewriter_before_opt_a 0.16% : 0.000196s : 1: symbol_engine_optimizer 87.38% : 0.106245s : 1: type_inference TotalTime = 0.113032, [30] [bootstrap]: 0.00030409 [type_inference]: 0.1027 [event_method]: 1.946e-05 [auto_monad]: 7.245e-05 [graph_reusing]: 5.76998e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 0.00050476 [rewriter_before_opt_a]: 8.247e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00708397, [2] [Cycle 1]: 0.00343507, [27] [switch_simplify]: 5.01e-05 [loop_unroll]: 3.105e-05 [a_1]: 0.00053549 [with_stream_mark]: 1.357e-05 [recompute_prepare]: 8.21002e-06 [updatestate_depend_eliminate]: 3.40998e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 1.71e-06 [get_grad_eliminate_]: 6.03002e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 1.03e-05 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.57998e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 0.00247815 [add_forward_monad_depend]: 5.57001e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.795e-05 [cse]: 2.769e-05 [replace_applicator]: 1.725e-05 [Cycle 2]: 0.00036724, [27] [switch_simplify]: 6.53998e-06 [loop_unroll]: 5.71e-06 [a_1]: 0.00012287 [with_stream_mark]: 9.68002e-06 [recompute_prepare]: 6.24999e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.61999e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.66003e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 2.24001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.594e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 9.62001e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.35001e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.16998e-06 [cse]: 1.179e-05 [replace_applicator]: 5.73997e-06 [py_interpret_to_execute_after_opt_a]: 1.044e-05 [rewriter_after_opt_a]: 3.258e-05 [convert_after_rewriter]: 7.47998e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00059119 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.744e-05, [2] [frontend_op_eliminate]: 1.899e-05 [inline_after_opt_a]: 1.716e-05 [cconv]: 2.272e-05 [loop_unroll]: 0.00044273 [jit_opt_after_cconv]: 0.00014712, [1] [Cycle 1]: 0.00014075, [11] [c_1]: 2.638e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 2.152e-05 [call_graph_tuple_transform]: 1.867e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.459e-05 [partial_unused_args_eliminate]: 2.46e-06 [environ_conv]: 8.78001e-06 [add_recomputation]: 4.862e-05 [cse_after_recomputation]: 2.288e-05, [1] [Cycle 1]: 1.641e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.644e-05 [get_jit_bprop_graph]: 1.86998e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.00052779 [symbol_engine_optimizer]: 7.957e-05, [1] [Cycle 1]: 7.35e-05, [6] [build]: 3.79002e-06 [elim_shapecalc]: 1.018e-05 [elim_not_effective]: 1.419e-05 [opt_reshape]: 6.84999e-06 [fold_const_symbol]: 9.20001e-06 [renormalize]: 3.9002e-07 [validate]: 4.102e-05 Sums bootstrap : 0.000304s : 0.28% type_inference : 0.102700s : 94.06% event_method : 0.000019s : 0.02% auto_monad : 0.000072s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000505s : 0.46% rewriter_before_opt_a : 0.000082s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000658s : 0.60% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002478s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000591s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000443s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000528s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000175 24 1.22% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 3.10% : 0.000005s : 4: substitution.graph_param_transform 82.35% : 0.000144s : 4: substitution.inline 1.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.11% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000004s : 2: substitution.replace_old_param 5.08% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102625 2 97.46% : 0.100019s : 1: type_inference.infer 2.54% : 0.002607s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.13% : 0.000045s : 4: replace.inline 33.87% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000149 6 94.82% : 0.000141s : 4: match.inline 5.18% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 2.24% : 0.000003s : 12: predicate.arithmetic_simplify 1.47% : 0.000002s : 12: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.18% : 0.000003s : 18: predicate.load_eliminater 1.28% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.24% : 0.000002s : 4: predicate.mutable_eliminate 0.73% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 2.01% : 0.000003s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.54% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 18: predicate.switch_defer_inline 2.16% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001943 22 65.03% : 0.001263s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.54% : 0.000651s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116469 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.27% : 0.000318s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.08% : 0.007087s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.39% : 0.000451s : 1: loop_unroll 0.52% : 0.000600s : 1: mutable_eliminate 0.76% : 0.000888s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000536s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000511s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.54% : 0.001793s : 1: renormalize.infer 0.58% : 0.000678s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.19% : 0.102716s : 1: type_inference TotalTime = 0.0694137, [30] [bootstrap]: 0.00028378 [type_inference]: 0.0598129 [event_method]: 1.767e-05 [auto_monad]: 6.429e-05 [graph_reusing]: 5.41002e-06 [pre_auto_parallel]: 2.41998e-06 [py_interpret_to_execute]: 0.00028885 [rewriter_before_opt_a]: 8.417e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00675462, [2] [Cycle 1]: 0.00312585, [27] [switch_simplify]: 4.655e-05 [loop_unroll]: 3.012e-05 [a_1]: 0.00053709 [with_stream_mark]: 1.367e-05 [recompute_prepare]: 8.16002e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.78003e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 6.59999e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 2.36998e-06 [get_grad_eliminate_]: 6.17999e-06 [merge_forward]: 3.26999e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.209e-05 [j_node_and_user_rematch]: 9.51998e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 5.92999e-06 [renormalize]: 0.0021872 [add_forward_monad_depend]: 5.77001e-06 [auto_monad_grad]: 2.36e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 2.152e-05 [replace_applicator]: 1.414e-05 [Cycle 2]: 0.00035552, [27] [switch_simplify]: 6.74999e-06 [loop_unroll]: 5.94e-06 [a_1]: 0.00011959 [with_stream_mark]: 9.92001e-06 [recompute_prepare]: 5.84e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.01003e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 5.38002e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.53998e-06 [cell_reuse_recompute_pass]: 1.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.553e-05 [j_node_and_user_rematch]: 9.00999e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.25e-06 [inline_without_move]: 5.86998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.90025e-07 [auto_monad_grad]: 9.70002e-07 [auto_monad_eliminator]: 5.52001e-06 [cse]: 1.094e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 8.50001e-06 [rewriter_after_opt_a]: 3.16e-05 [convert_after_rewriter]: 5.98998e-06 [order_py_execute_after_rewriter]: 4.53999e-06 [mutable_eliminate]: 0.00051654 [jit_opt_b]: 5.294e-05, [1] [Cycle 1]: 4.573e-05, [2] [frontend_op_eliminate]: 1.832e-05 [inline_after_opt_a]: 1.668e-05 [cconv]: 2.262e-05 [loop_unroll]: 0.00042749 [jit_opt_after_cconv]: 0.0001512, [1] [Cycle 1]: 0.00014455, [11] [c_1]: 2.659e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.979e-05 [call_graph_tuple_transform]: 2.071e-05 [tuple_list_get_item_eliminator]: 6.74001e-06 [none_parameter_eliminate]: 1.24e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.484e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 8.66002e-06 [add_recomputation]: 4.321e-05 [cse_after_recomputation]: 2.089e-05, [1] [Cycle 1]: 1.624e-05, [1] [cse]: 1.042e-05 [auto_monad_reorder]: 1.557e-05 [get_jit_bprop_graph]: 1.64998e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.00046379 [symbol_engine_optimizer]: 9.466e-05, [1] [Cycle 1]: 8.863e-05, [6] [build]: 3.21999e-06 [elim_shapecalc]: 8.14002e-06 [elim_not_effective]: 1.305e-05 [opt_reshape]: 2.605e-05 [fold_const_symbol]: 1.04e-05 [renormalize]: 4.10015e-07 [validate]: 4.11e-05 Sums bootstrap : 0.000284s : 0.43% type_inference : 0.059813s : 91.19% event_method : 0.000018s : 0.03% auto_monad : 0.000064s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000289s : 0.44% rewriter_before_opt_a : 0.000084s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000657s : 1.00% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002187s : 3.33% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000032s : 0.05% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000517s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000023s : 0.03% loop_unroll : 0.000427s : 0.65% jit_opt_after_cconv.c_1 : 0.000027s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000043s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000464s : 0.71% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000026s : 0.04% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.06% Time group info: ------[substitution.] 0.000183 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.24% : 0.000006s : 4: substitution.graph_param_transform 82.53% : 0.000151s : 4: substitution.inline 1.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.89% : 0.000003s : 2: substitution.replace_old_param 5.88% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.059734 2 96.75% : 0.057791s : 1: type_inference.infer 3.25% : 0.001943s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.36% : 0.000044s : 4: replace.inline 33.64% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.93% : 0.000148s : 4: match.inline 6.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.56% : 0.000002s : 12: predicate.cast_eliminate 0.76% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.38% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.73% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.64% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.28% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.83% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002773 34 75.77% : 0.002101s : 27: func_graph_cloner_run.FuncGraphClonerGraph 0.99% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.24% : 0.000644s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.072570 72 0.06% : 0.000046s : 1: add_recomputation 0.09% : 0.000068s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.41% : 0.000294s : 1: bootstrap 0.03% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.31% : 0.006758s : 1: jit_opt_a 0.21% : 0.000154s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.60% : 0.000435s : 1: loop_unroll 0.72% : 0.000524s : 1: mutable_eliminate 1.21% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000055s : 4: opt.transform.symbol_engine_opt 0.65% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000295s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 2.09% : 0.001518s : 1: renormalize.infer 0.91% : 0.000660s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000034s : 1: rewriter_after_opt_a 0.12% : 0.000090s : 1: rewriter_before_opt_a 0.13% : 0.000097s : 1: symbol_engine_optimizer 82.44% : 0.059828s : 1: type_inference TotalTime = 0.0623784, [30] [bootstrap]: 0.00027176 [type_inference]: 0.052848 [event_method]: 1.876e-05 [auto_monad]: 6.83e-05 [graph_reusing]: 6.45002e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00028003 [rewriter_before_opt_a]: 8.719e-05 [expand_dump_flag]: 3.73001e-06 [jit_opt_a]: 0.0066769, [2] [Cycle 1]: 0.00293663, [27] [switch_simplify]: 5.387e-05 [loop_unroll]: 2.968e-05 [a_1]: 0.00056295 [with_stream_mark]: 1.721e-05 [recompute_prepare]: 8.84998e-06 [updatestate_depend_eliminate]: 3.73999e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.66999e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.617e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.94999e-06 [replace_old_param]: 9.83998e-06 [inline_without_move]: 6.29001e-06 [renormalize]: 0.00195179 [add_forward_monad_depend]: 4.72e-06 [auto_monad_grad]: 1.30001e-06 [auto_monad_eliminator]: 1.217e-05 [cse]: 2.227e-05 [replace_applicator]: 1.325e-05 [Cycle 2]: 0.00035662, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.63002e-06 [a_1]: 0.00012169 [with_stream_mark]: 9.74e-06 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 2.59001e-06 [updatestate_assign_eliminate]: 2.13998e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 5.69999e-06 [updatestate_useless_node_eliminater]: 5.78002e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.22999e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 2.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.086e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 8.78001e-06 [rewriter_after_opt_a]: 2.725e-05 [convert_after_rewriter]: 5.74e-06 [order_py_execute_after_rewriter]: 4.03001e-06 [mutable_eliminate]: 0.0005376 [jit_opt_b]: 5.273e-05, [1] [Cycle 1]: 4.682e-05, [2] [frontend_op_eliminate]: 1.856e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 1.76e-05 [loop_unroll]: 0.00044085 [jit_opt_after_cconv]: 0.00014355, [1] [Cycle 1]: 0.00013707, [11] [c_1]: 2.512e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.13002e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.05002e-06 [cse]: 1.982e-05 [call_graph_tuple_transform]: 1.825e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.11997e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.021e-05 [partial_unused_args_eliminate]: 1.88002e-06 [environ_conv]: 7.8e-06 [add_recomputation]: 4.815e-05 [cse_after_recomputation]: 2.156e-05, [1] [Cycle 1]: 1.654e-05, [1] [cse]: 1.096e-05 [auto_monad_reorder]: 1.534e-05 [get_jit_bprop_graph]: 1.34998e-06 [rewriter_after_jit_bprop_graph]: 5.59e-06 [opt_after_jit_grad]: 0.00046308 [symbol_engine_optimizer]: 0.00010206, [1] [Cycle 1]: 6.558e-05, [6] [build]: 2.71999e-06 [elim_shapecalc]: 8.05999e-06 [elim_not_effective]: 1.281e-05 [opt_reshape]: 5.97001e-06 [fold_const_symbol]: 8.74998e-06 [renormalize]: 4.00003e-07 [validate]: 3.591e-05 Sums bootstrap : 0.000272s : 0.47% type_inference : 0.052848s : 90.48% event_method : 0.000019s : 0.03% auto_monad : 0.000068s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000280s : 0.48% rewriter_before_opt_a : 0.000087s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000685s : 1.17% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001952s : 3.34% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000027s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000538s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000018s : 0.03% loop_unroll : 0.000441s : 0.75% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000463s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.06% Time group info: ------[substitution.] 0.000197 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.43% : 0.000001s : 2: substitution.fold_const_symbol 2.13% : 0.000004s : 4: substitution.graph_param_transform 83.68% : 0.000164s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.42% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 6.67% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052774 2 96.42% : 0.050882s : 1: type_inference.infer 3.58% : 0.001891s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.81% : 0.000047s : 4: replace.inline 33.19% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.14% : 0.000162s : 4: match.inline 6.86% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.14% : 0.000001s : 12: predicate.addn_zero_filter 2.19% : 0.000003s : 12: predicate.arithmetic_simplify 1.56% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.41% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.21% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.78% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.58% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000001s : 12: predicate.print_const_string_wrapper 1.93% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.96% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000001s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.49% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002235 26 73.10% : 0.001634s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.33% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.57% : 0.000572s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065317 72 0.08% : 0.000051s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000285s : 1: bootstrap 0.03% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.23% : 0.006680s : 1: jit_opt_a 0.22% : 0.000146s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.69% : 0.000449s : 1: loop_unroll 0.84% : 0.000546s : 1: mutable_eliminate 1.39% : 0.000911s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000287s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 2.03% : 0.001324s : 1: renormalize.infer 0.95% : 0.000619s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000030s : 1: rewriter_after_opt_a 0.14% : 0.000092s : 1: rewriter_before_opt_a 0.16% : 0.000105s : 1: symbol_engine_optimizer 80.93% : 0.052862s : 1: type_inference TotalTime = 0.061282, [30] [bootstrap]: 0.00026328 [type_inference]: 0.0516207 [event_method]: 1.817e-05 [auto_monad]: 7.109e-05 [graph_reusing]: 6.50002e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00029537 [rewriter_before_opt_a]: 8.548e-05 [expand_dump_flag]: 3.48e-06 [jit_opt_a]: 0.00678232, [2] [Cycle 1]: 0.00303855, [27] [switch_simplify]: 5.6e-05 [loop_unroll]: 3.045e-05 [a_1]: 0.00057262 [with_stream_mark]: 1.608e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 3.05998e-06 [updatestate_loads_eliminate]: 2.90998e-06 [parameter_eliminate]: 1.40001e-06 [specialize_transform]: 6.91999e-06 [updatestate_useless_node_eliminater]: 5.99999e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 1.96e-06 [get_grad_eliminate_]: 6.09999e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.556e-05 [j_node_and_user_rematch]: 1.108e-05 [meta_fg_expand]: 2.86999e-06 [replace_old_param]: 1.037e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00204011 [add_forward_monad_depend]: 5.68002e-06 [auto_monad_grad]: 1.16002e-06 [auto_monad_eliminator]: 1.392e-05 [cse]: 2.169e-05 [replace_applicator]: 1.482e-05 [Cycle 2]: 0.00037281, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 5.92001e-06 [a_1]: 0.00013044 [with_stream_mark]: 1.189e-05 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.62001e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.482e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 1.66002e-06 [replace_old_param]: 8.65999e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.40001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.2e-05 [replace_applicator]: 6.02001e-06 [py_interpret_to_execute_after_opt_a]: 1.05e-05 [rewriter_after_opt_a]: 2.93e-05 [convert_after_rewriter]: 6.25002e-06 [order_py_execute_after_rewriter]: 4.15999e-06 [mutable_eliminate]: 0.00061811 [jit_opt_b]: 5.467e-05, [1] [Cycle 1]: 4.81e-05, [2] [frontend_op_eliminate]: 1.965e-05 [inline_after_opt_a]: 1.735e-05 [cconv]: 1.618e-05 [loop_unroll]: 0.00042981 [jit_opt_after_cconv]: 0.0001448, [1] [Cycle 1]: 0.00013847, [11] [c_1]: 2.619e-05 [parameter_eliminate]: 2.45002e-06 [updatestate_depend_eliminate]: 5.95002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.39001e-06 [cse]: 1.884e-05 [call_graph_tuple_transform]: 1.913e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 7.89994e-07 [renormalize]: 2.50002e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 8.98002e-06 [partial_unused_args_eliminate]: 1.50999e-06 [environ_conv]: 6.50997e-06 [add_recomputation]: 3.169e-05 [cse_after_recomputation]: 2.264e-05, [1] [Cycle 1]: 1.734e-05, [1] [cse]: 1.135e-05 [auto_monad_reorder]: 9.86e-06 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00046367 [symbol_engine_optimizer]: 7.277e-05, [1] [Cycle 1]: 6.659e-05, [6] [build]: 2.62001e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 7.01001e-06 [fold_const_symbol]: 8.75001e-06 [renormalize]: 3.89991e-07 [validate]: 3.446e-05 Sums bootstrap : 0.000263s : 0.46% type_inference : 0.051621s : 90.00% event_method : 0.000018s : 0.03% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000295s : 0.51% rewriter_before_opt_a : 0.000085s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000703s : 1.23% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002040s : 3.56% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000034s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000029s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000618s : 1.08% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000430s : 0.75% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000032s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000464s : 0.81% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.06% Time group info: ------[substitution.] 0.000195 24 0.74% : 0.000001s : 2: substitution.elim_not_effective 0.47% : 0.000001s : 2: substitution.fold_const_symbol 2.06% : 0.000004s : 4: substitution.graph_param_transform 83.78% : 0.000163s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.41% : 0.000005s : 2: substitution.replace_old_param 6.39% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051546 2 96.28% : 0.049629s : 1: type_inference.infer 3.72% : 0.001917s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.92% : 0.000050s : 4: replace.inline 31.08% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.44% : 0.000161s : 4: match.inline 6.56% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 1.94% : 0.000003s : 12: predicate.arithmetic_simplify 1.58% : 0.000002s : 12: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.56% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 4.93% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000002s : 12: predicate.reduce_eliminate 1.69% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000001s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002163 26 69.50% : 0.001503s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.12% : 0.000630s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064340 72 0.05% : 0.000035s : 1: add_recomputation 0.12% : 0.000074s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.43% : 0.000275s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.55% : 0.006785s : 1: jit_opt_a 0.23% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.68% : 0.000438s : 1: loop_unroll 0.97% : 0.000627s : 1: mutable_eliminate 1.46% : 0.000938s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.73% : 0.000471s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000301s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000011s : 1: remove_dup_value 2.08% : 0.001338s : 1: renormalize.infer 1.08% : 0.000694s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.14% : 0.000091s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 80.25% : 0.051635s : 1: type_inference TotalTime = 0.0592073, [30] [bootstrap]: 0.00025902 [type_inference]: 0.0502362 [event_method]: 1.674e-05 [auto_monad]: 4.565e-05 [graph_reusing]: 3.89002e-06 [pre_auto_parallel]: 1.57001e-06 [py_interpret_to_execute]: 0.00028115 [rewriter_before_opt_a]: 7.353e-05 [expand_dump_flag]: 2.86e-06 [jit_opt_a]: 0.00627814, [2] [Cycle 1]: 0.00277845, [27] [switch_simplify]: 4.687e-05 [loop_unroll]: 3.111e-05 [a_1]: 0.00054895 [with_stream_mark]: 1.142e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.53998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 9.49978e-07 [specialize_transform]: 6.96999e-06 [updatestate_useless_node_eliminater]: 5.88002e-06 [accelerated_algorithm]: 6.51e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 6.25002e-06 [merge_forward]: 2.84001e-06 [cell_reuse_recompute_pass]: 8.89995e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.213e-05 [j_node_and_user_rematch]: 9.37001e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.99999e-06 [renormalize]: 0.00184795 [add_forward_monad_depend]: 4.45e-06 [auto_monad_grad]: 1.44e-06 [auto_monad_eliminator]: 1.054e-05 [cse]: 2.128e-05 [replace_applicator]: 1.242e-05 [Cycle 2]: 0.0003549, [27] [switch_simplify]: 6.77002e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00012102 [with_stream_mark]: 9.31e-06 [recompute_prepare]: 6.12001e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.47999e-06 [meta_shard_fg_expand]: 1.34998e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.275e-05 [j_node_and_user_rematch]: 8.44998e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.33999e-06 [inline_without_move]: 5.52001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 7.2e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.201e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 9.13002e-06 [rewriter_after_opt_a]: 2.654e-05 [convert_after_rewriter]: 5.78002e-06 [order_py_execute_after_rewriter]: 3.86999e-06 [mutable_eliminate]: 0.00053123 [jit_opt_b]: 5.206e-05, [1] [Cycle 1]: 4.637e-05, [2] [frontend_op_eliminate]: 1.879e-05 [inline_after_opt_a]: 1.649e-05 [cconv]: 1.556e-05 [loop_unroll]: 0.000432 [jit_opt_after_cconv]: 0.00014128, [1] [Cycle 1]: 0.00013544, [11] [c_1]: 2.568e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 4.44002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.44001e-06 [cse]: 1.874e-05 [call_graph_tuple_transform]: 1.871e-05 [tuple_list_get_item_eliminator]: 5.86998e-06 [none_parameter_eliminate]: 9.39996e-07 [renormalize]: 4.19997e-07 [switch_simplify]: 6.08998e-06 [remove_dup_value]: 8.07998e-06 [partial_unused_args_eliminate]: 1.35001e-06 [environ_conv]: 6.43998e-06 [add_recomputation]: 2.98e-05 [cse_after_recomputation]: 2.03e-05, [1] [Cycle 1]: 1.563e-05, [1] [cse]: 1.02e-05 [auto_monad_reorder]: 9.34998e-06 [get_jit_bprop_graph]: 1.73002e-06 [rewriter_after_jit_bprop_graph]: 3.91999e-06 [opt_after_jit_grad]: 0.00045541 [symbol_engine_optimizer]: 7.074e-05, [1] [Cycle 1]: 6.516e-05, [6] [build]: 2.46e-06 [elim_shapecalc]: 8.25e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 8.61002e-06 [renormalize]: 3.99974e-07 [validate]: 2.938e-05 Sums bootstrap : 0.000259s : 0.47% type_inference : 0.050236s : 90.47% event_method : 0.000017s : 0.03% auto_monad : 0.000046s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000281s : 0.51% rewriter_before_opt_a : 0.000074s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000670s : 1.21% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001848s : 3.33% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.03% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000027s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000531s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000432s : 0.78% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000030s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000009s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000455s : 0.82% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.05% Time group info: ------[substitution.] 0.000184 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.26% : 0.000004s : 4: substitution.graph_param_transform 86.45% : 0.000159s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000004s : 4: substitution.remove_not_recompute_node 1.73% : 0.000003s : 2: substitution.replace_old_param 4.47% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050170 2 96.40% : 0.048365s : 1: type_inference.infer 3.60% : 0.001805s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.08% : 0.000046s : 4: replace.inline 32.92% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 6 95.68% : 0.000157s : 4: match.inline 4.32% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.18% : 0.000001s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.21% : 0.000002s : 12: predicate.addn_zero_filter 2.31% : 0.000003s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 4.87% : 0.000006s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.15% : 0.000003s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.21% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.89% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.52% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.99% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.14% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.36% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.14% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002055 26 70.94% : 0.001458s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.75% : 0.000570s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062025 72 0.05% : 0.000033s : 1: add_recomputation 0.08% : 0.000049s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.44% : 0.000271s : 1: bootstrap 0.03% : 0.000018s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.13% : 0.006282s : 1: jit_opt_a 0.23% : 0.000144s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.71% : 0.000439s : 1: loop_unroll 0.87% : 0.000538s : 1: mutable_eliminate 1.43% : 0.000887s : 26: opt.transform.jit_opt_a 0.09% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.46% : 0.000287s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000010s : 1: remove_dup_value 1.99% : 0.001234s : 1: renormalize.infer 0.98% : 0.000608s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000029s : 1: rewriter_after_opt_a 0.13% : 0.000078s : 1: rewriter_before_opt_a 0.12% : 0.000073s : 1: symbol_engine_optimizer 81.01% : 0.050249s : 1: type_inference TotalTime = 0.118557, [30] [bootstrap]: 0.00025087 [type_inference]: 0.105959 [event_method]: 2.045e-05 [auto_monad]: 7.744e-05 [graph_reusing]: 7.26999e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.0005421 [rewriter_before_opt_a]: 8.968e-05 [expand_dump_flag]: 3.39001e-06 [jit_opt_a]: 0.00896431, [2] [Cycle 1]: 0.00422985, [27] [switch_simplify]: 6.338e-05 [loop_unroll]: 3.206e-05 [a_1]: 0.0006556 [with_stream_mark]: 2.108e-05 [recompute_prepare]: 1.186e-05 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.59002e-06 [parameter_eliminate]: 2.48e-06 [specialize_transform]: 8.38001e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 7.63001e-06 [meta_shard_fg_expand]: 2.71999e-06 [get_grad_eliminate_]: 7.1e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.682e-05 [j_node_and_user_rematch]: 1.114e-05 [meta_fg_expand]: 2.51998e-06 [replace_old_param]: 1.244e-05 [inline_without_move]: 6.21e-06 [renormalize]: 0.00302864 [add_forward_monad_depend]: 1.227e-05 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 2.383e-05 [cse]: 3.44e-05 [replace_applicator]: 2.523e-05 [Cycle 2]: 0.00045559, [27] [switch_simplify]: 6.85998e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00013306 [with_stream_mark]: 1.807e-05 [recompute_prepare]: 7.43e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 2.96999e-06 [updatestate_loads_eliminate]: 3.53999e-06 [parameter_eliminate]: 2.57001e-06 [specialize_transform]: 7.68999e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 6.38998e-06 [meta_shard_fg_expand]: 2.48e-06 [get_grad_eliminate_]: 6.41e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 3.99002e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.299e-05 [j_node_and_user_rematch]: 1.202e-05 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 1.172e-05 [inline_without_move]: 6.02999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 2.59999e-06 [auto_monad_grad]: 1.57001e-06 [auto_monad_eliminator]: 1.067e-05 [cse]: 1.999e-05 [replace_applicator]: 7.87e-06 [py_interpret_to_execute_after_opt_a]: 1.717e-05 [rewriter_after_opt_a]: 4.395e-05 [convert_after_rewriter]: 2.86e-05 [order_py_execute_after_rewriter]: 7.15e-06 [mutable_eliminate]: 0.00076557 [jit_opt_b]: 6.245e-05, [1] [Cycle 1]: 5.386e-05, [2] [frontend_op_eliminate]: 2.08e-05 [inline_after_opt_a]: 1.967e-05 [cconv]: 3.117e-05 [loop_unroll]: 0.00052851 [jit_opt_after_cconv]: 0.00018003, [1] [Cycle 1]: 0.00017103, [11] [c_1]: 2.822e-05 [parameter_eliminate]: 3.04999e-06 [updatestate_depend_eliminate]: 6.73003e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 3.77002e-06 [cse]: 3.409e-05 [call_graph_tuple_transform]: 2.58e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.77999e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 2.37999e-06 [environ_conv]: 9.24e-06 [add_recomputation]: 5.091e-05 [cse_after_recomputation]: 2.427e-05, [1] [Cycle 1]: 1.879e-05, [1] [cse]: 1.297e-05 [auto_monad_reorder]: 1.587e-05 [get_jit_bprop_graph]: 3.38999e-06 [rewriter_after_jit_bprop_graph]: 6.69999e-06 [opt_after_jit_grad]: 0.00050883 [symbol_engine_optimizer]: 8.472e-05, [1] [Cycle 1]: 7.8e-05, [6] [build]: 3.97e-06 [elim_shapecalc]: 9.61998e-06 [elim_not_effective]: 1.516e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 1.387e-05 [renormalize]: 2.89991e-07 [validate]: 5.043e-05 Sums bootstrap : 0.000251s : 0.22% type_inference : 0.105959s : 93.28% event_method : 0.000020s : 0.02% auto_monad : 0.000077s : 0.07% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000542s : 0.48% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000070s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000789s : 0.69% jit_opt_a.with_stream_mark : 0.000039s : 0.03% jit_opt_a.recompute_prepare : 0.000019s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000010s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000007s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000016s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000014s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000014s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000006s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000040s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000023s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000024s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.003029s : 2.67% jit_opt_a.add_forward_monad_depend : 0.000015s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000035s : 0.03% jit_opt_a.cse : 0.000054s : 0.05% jit_opt_a.replace_applicator : 0.000033s : 0.03% py_interpret_to_execute_after_opt_a : 0.000017s : 0.02% rewriter_after_opt_a : 0.000044s : 0.04% convert_after_rewriter : 0.000029s : 0.03% order_py_execute_after_rewriter : 0.000007s : 0.01% mutable_eliminate : 0.000766s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000529s : 0.47% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000034s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000509s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000014s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000261 24 1.21% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000002s : 2: substitution.fold_const_symbol 2.60% : 0.000007s : 4: substitution.graph_param_transform 82.35% : 0.000215s : 4: substitution.inline 2.12% : 0.000006s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000006s : 4: substitution.remove_not_recompute_node 3.06% : 0.000008s : 2: substitution.replace_old_param 5.70% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105873 2 97.24% : 0.102955s : 1: type_inference.infer 2.76% : 0.002918s : 1: type_inference.specialize ------[replace.] 0.000088 6 66.35% : 0.000059s : 4: replace.inline 33.65% : 0.000030s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000226 6 94.02% : 0.000213s : 4: match.inline 5.98% : 0.000014s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.68% : 0.000003s : 12: predicate.accumulaten_eliminater 1.07% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000002s : 12: predicate.addn_check_dump 1.83% : 0.000003s : 12: predicate.addn_zero_filter 2.19% : 0.000003s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000002s : 12: predicate.compare_switch_simplify 1.04% : 0.000002s : 12: predicate.depend_value_elim 0.96% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.59% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.35% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_depend_swap 1.04% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 4: predicate.fold_const_symbol 1.44% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.71% : 0.000009s : 26: predicate.inline 0.84% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.72% : 0.000003s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.18% : 0.000003s : 18: predicate.load_eliminater 2.00% : 0.000003s : 4: predicate.loop_unroll_after_grad 3.26% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.94% : 0.000001s : 12: predicate.merge_addn 0.91% : 0.000001s : 12: predicate.minmaximum_grad 2.11% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.85% : 0.000003s : 12: predicate.reduce_eliminate 1.28% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000001s : 4: predicate.reset_defer_inline 1.56% : 0.000002s : 12: predicate.reshape_eliminate 1.18% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.60% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.96% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.88% : 0.000001s : 8: predicate.special_op_eliminate 0.86% : 0.000001s : 8: predicate.specialize_transform 1.35% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.52% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.40% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.16% : 0.000003s : 18: predicate.switch_defer_inline 1.83% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.46% : 0.000010s : 58: predicate.switch_simplify 1.52% : 0.000002s : 12: predicate.tile_eliminate 1.11% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.80% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.48% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.46% : 0.000002s : 12: predicate.value_based_eliminate 0.29% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002122 22 60.59% : 0.001286s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.19% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 37.22% : 0.000790s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122730 72 0.04% : 0.000054s : 1: add_recomputation 0.07% : 0.000082s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.21% : 0.000263s : 1: bootstrap 0.03% : 0.000034s : 1: cconv 0.03% : 0.000033s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000010s : 1: graph_reusing 7.31% : 0.008969s : 1: jit_opt_a 0.15% : 0.000184s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.44% : 0.000538s : 1: loop_unroll 0.64% : 0.000781s : 1: mutable_eliminate 0.87% : 0.001067s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000018s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000042s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000516s : 1: opt_after_jit_grad 0.01% : 0.000009s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000552s : 1: py_interpret_to_execute 0.02% : 0.000021s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.71% : 0.002104s : 1: renormalize.infer 0.74% : 0.000911s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000049s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 86.35% : 0.105979s : 1: type_inference TotalTime = 0.119958, [30] [bootstrap]: 0.00030101 [type_inference]: 0.108436 [event_method]: 1.813e-05 [auto_monad]: 7.106e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.00053248 [rewriter_before_opt_a]: 8.539e-05 [expand_dump_flag]: 3.59002e-06 [jit_opt_a]: 0.00789785, [2] [Cycle 1]: 0.00401856, [27] [switch_simplify]: 5.901e-05 [loop_unroll]: 3.067e-05 [a_1]: 0.00062898 [with_stream_mark]: 2.089e-05 [recompute_prepare]: 1.098e-05 [updatestate_depend_eliminate]: 4.02002e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 7.43e-06 [updatestate_useless_node_eliminater]: 6.19999e-06 [accelerated_algorithm]: 7.05e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 4.55001e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.941e-05 [j_node_and_user_rematch]: 1.127e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 1.11e-05 [inline_without_move]: 7.21999e-06 [renormalize]: 0.00288119 [add_forward_monad_depend]: 9.22001e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 2.181e-05 [cse]: 3.4e-05 [replace_applicator]: 2.16e-05 [Cycle 2]: 0.00042615, [27] [switch_simplify]: 7.04001e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00012874 [with_stream_mark]: 1.577e-05 [recompute_prepare]: 6.57002e-06 [updatestate_depend_eliminate]: 4.82e-06 [updatestate_assign_eliminate]: 2.88003e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 6.36998e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.24999e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 5.81e-06 [cell_reuse_recompute_pass]: 2.64001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.124e-05 [j_node_and_user_rematch]: 1.074e-05 [meta_fg_expand]: 2.38998e-06 [replace_old_param]: 1.175e-05 [inline_without_move]: 6.89001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.89e-06 [auto_monad_grad]: 1.59e-06 [auto_monad_eliminator]: 1.107e-05 [cse]: 1.663e-05 [replace_applicator]: 7.92e-06 [py_interpret_to_execute_after_opt_a]: 1.548e-05 [rewriter_after_opt_a]: 3.821e-05 [convert_after_rewriter]: 7.43e-06 [order_py_execute_after_rewriter]: 5.44998e-06 [mutable_eliminate]: 0.00075578 [jit_opt_b]: 5.844e-05, [1] [Cycle 1]: 5.001e-05, [2] [frontend_op_eliminate]: 1.936e-05 [inline_after_opt_a]: 1.905e-05 [cconv]: 2.948e-05 [loop_unroll]: 0.00056134 [jit_opt_after_cconv]: 0.00017277, [1] [Cycle 1]: 0.00016427, [11] [c_1]: 2.783e-05 [parameter_eliminate]: 3.49001e-06 [updatestate_depend_eliminate]: 8.52e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.24001e-06 [cse]: 2.767e-05 [call_graph_tuple_transform]: 2.496e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 6.34999e-06 [remove_dup_value]: 1.658e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 9.36e-06 [add_recomputation]: 5.334e-05 [cse_after_recomputation]: 2.616e-05, [1] [Cycle 1]: 1.925e-05, [1] [cse]: 1.217e-05 [auto_monad_reorder]: 1.699e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.97999e-06 [opt_after_jit_grad]: 0.0005163 [symbol_engine_optimizer]: 7.977e-05, [1] [Cycle 1]: 7.21e-05, [6] [build]: 4.33999e-06 [elim_shapecalc]: 9.14e-06 [elim_not_effective]: 1.456e-05 [opt_reshape]: 6.54001e-06 [fold_const_symbol]: 8.94998e-06 [renormalize]: 7.39994e-07 [validate]: 4.547e-05 Sums bootstrap : 0.000301s : 0.26% type_inference : 0.108436s : 93.59% event_method : 0.000018s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000532s : 0.46% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000758s : 0.65% jit_opt_a.with_stream_mark : 0.000037s : 0.03% jit_opt_a.recompute_prepare : 0.000018s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000010s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000041s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000022s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000023s : 0.02% jit_opt_a.inline_without_move : 0.000014s : 0.01% jit_opt_a.renormalize : 0.002881s : 2.49% jit_opt_a.add_forward_monad_depend : 0.000011s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000033s : 0.03% jit_opt_a.cse : 0.000051s : 0.04% jit_opt_a.replace_applicator : 0.000030s : 0.03% py_interpret_to_execute_after_opt_a : 0.000015s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000756s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000561s : 0.48% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000009s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000028s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000516s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.04% Time group info: ------[substitution.] 0.000236 24 0.76% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.45% : 0.000006s : 4: substitution.graph_param_transform 82.71% : 0.000195s : 4: substitution.inline 2.03% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000007s : 4: substitution.remove_not_recompute_node 2.77% : 0.000007s : 2: substitution.replace_old_param 5.81% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108361 2 97.46% : 0.105611s : 1: type_inference.infer 2.54% : 0.002750s : 1: type_inference.specialize ------[replace.] 0.000084 6 65.35% : 0.000055s : 4: replace.inline 34.65% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 93.87% : 0.000192s : 4: match.inline 6.13% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.18% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.10% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.47% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 0.99% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000008s : 26: predicate.inline 1.15% : 0.000002s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.13% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.90% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.29% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.17% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.52% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.16% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.59% : 0.000004s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.67% : 0.000009s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.91% : 0.000007s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.90% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002209 22 62.19% : 0.001374s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.01% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.80% : 0.000791s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123941 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.25% : 0.000313s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.37% : 0.007901s : 1: jit_opt_a 0.14% : 0.000176s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.46% : 0.000572s : 1: loop_unroll 0.62% : 0.000767s : 1: mutable_eliminate 0.83% : 0.001023s : 26: opt.transform.jit_opt_a 0.05% : 0.000062s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000539s : 1: py_interpret_to_execute 0.01% : 0.000018s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.65% : 0.002046s : 1: renormalize.infer 0.67% : 0.000825s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 87.50% : 0.108453s : 1: type_inference TotalTime = 0.0131736, [30] [bootstrap]: 0.00030884 [type_inference]: 0.0047604 [event_method]: 1.795e-05 [auto_monad]: 7.355e-05 [graph_reusing]: 6.01998e-06 [pre_auto_parallel]: 2.38002e-06 [py_interpret_to_execute]: 2.471e-05 [rewriter_before_opt_a]: 7.462e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00568511, [2] [Cycle 1]: 0.00169539, [27] [switch_simplify]: 6.041e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00053264 [with_stream_mark]: 1.805e-05 [recompute_prepare]: 7.41001e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 4.10998e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.02999e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 2.78e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.604e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.49e-06 [renormalize]: 0.00070818 [add_forward_monad_depend]: 5.94999e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.596e-05 [cse]: 3.236e-05 [replace_applicator]: 1.393e-05 [Cycle 2]: 0.00032197, [27] [switch_simplify]: 6.44999e-06 [loop_unroll]: 5.00999e-06 [a_1]: 9.264e-05 [with_stream_mark]: 9.70002e-06 [recompute_prepare]: 5.09e-06 [updatestate_depend_eliminate]: 2.70002e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.17999e-06 [updatestate_useless_node_eliminater]: 4.91997e-06 [accelerated_algorithm]: 4.97999e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.62e-06 [merge_forward]: 2.84999e-06 [cell_reuse_recompute_pass]: 1.37e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.385e-05 [j_node_and_user_rematch]: 8.28001e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 5.04e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.75001e-06 [cse]: 1.159e-05 [replace_applicator]: 5.11997e-06 [py_interpret_to_execute_after_opt_a]: 1.085e-05 [rewriter_after_opt_a]: 3.661e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.39e-06 [mutable_eliminate]: 0.00064892 [jit_opt_b]: 4.967e-05, [1] [Cycle 1]: 4.183e-05, [2] [frontend_op_eliminate]: 1.56e-05 [inline_after_opt_a]: 1.523e-05 [cconv]: 2.511e-05 [loop_unroll]: 0.0004244 [jit_opt_after_cconv]: 0.00015734, [1] [Cycle 1]: 0.0001507, [11] [c_1]: 2.106e-05 [parameter_eliminate]: 2.96999e-06 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.136e-05 [call_graph_tuple_transform]: 1.975e-05 [tuple_list_get_item_eliminator]: 5.23002e-06 [none_parameter_eliminate]: 1.59998e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 5.95002e-06 [remove_dup_value]: 1.442e-05 [partial_unused_args_eliminate]: 2.68998e-06 [environ_conv]: 5.83997e-06 [add_recomputation]: 5.054e-05 [cse_after_recomputation]: 2.226e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.073e-05 [auto_monad_reorder]: 1.5e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.20999e-06 [opt_after_jit_grad]: 0.00046014 [symbol_engine_optimizer]: 7.409e-05, [1] [Cycle 1]: 6.804e-05, [6] [build]: 2.83e-06 [elim_shapecalc]: 8.28001e-06 [elim_not_effective]: 1.42e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 8.80001e-06 [renormalize]: 3.50003e-07 [validate]: 3.471e-05 Sums bootstrap : 0.000309s : 3.46% type_inference : 0.004760s : 53.37% event_method : 0.000018s : 0.20% auto_monad : 0.000074s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000025s : 0.28% rewriter_before_opt_a : 0.000075s : 0.84% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000067s : 0.75% jit_opt_a.loop_unroll : 0.000036s : 0.40% jit_opt_a.a_1 : 0.000625s : 7.01% jit_opt_a.with_stream_mark : 0.000028s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.20% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000708s : 7.94% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.24% jit_opt_a.cse : 0.000044s : 0.49% jit_opt_a.replace_applicator : 0.000019s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.12% rewriter_after_opt_a : 0.000037s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000649s : 7.27% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000025s : 0.28% loop_unroll : 0.000424s : 4.76% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000021s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000051s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000460s : 5.16% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.39% Time group info: ------[substitution.] 0.000200 23 1.37% : 0.000003s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000006s : 3: substitution.graph_param_transform 81.47% : 0.000163s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.51% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000005s : 2: substitution.replace_old_param 6.84% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004689 2 81.26% : 0.003810s : 1: type_inference.infer 18.74% : 0.000879s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.24% : 0.000048s : 4: replace.inline 32.76% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 92.78% : 0.000160s : 4: match.inline 7.22% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000119 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.73% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.46% : 0.000001s : 3: predicate.check_bprop_eliminate 1.07% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.66% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.03% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.35% : 0.000003s : 15: predicate.load_eliminater 1.14% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.39% : 0.000002s : 3: predicate.mutable_eliminate 0.68% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.68% : 0.000002s : 18: predicate.replace_applicator 1.01% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.53% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.91% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.52% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.54% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.76% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.39% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000620 13 52.18% : 0.000323s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.01% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.81% : 0.000272s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014794 72 0.36% : 0.000053s : 1: add_recomputation 0.52% : 0.000077s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.18% : 0.000322s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.06% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000023s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.45% : 0.005688s : 1: jit_opt_a 1.08% : 0.000160s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 2.92% : 0.000432s : 1: loop_unroll 4.44% : 0.000657s : 1: mutable_eliminate 5.73% : 0.000848s : 26: opt.transform.jit_opt_a 0.33% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.16% : 0.000468s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000027s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000017s : 1: remove_dup_value 2.42% : 0.000359s : 1: renormalize.infer 2.31% : 0.000342s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.52% : 0.000078s : 1: rewriter_before_opt_a 0.52% : 0.000077s : 1: symbol_engine_optimizer 32.29% : 0.004777s : 1: type_inference TotalTime = 0.118922, [30] [bootstrap]: 0.0002991 [type_inference]: 0.108331 [event_method]: 8.148e-05 [auto_monad]: 7.217e-05 [graph_reusing]: 7.01001e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.00053697 [rewriter_before_opt_a]: 8.52e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.0072009, [2] [Cycle 1]: 0.0034255, [27] [switch_simplify]: 5.685e-05 [loop_unroll]: 3.091e-05 [a_1]: 0.00056897 [with_stream_mark]: 1.588e-05 [recompute_prepare]: 9.05001e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 6.43998e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.52001e-06 [meta_shard_fg_expand]: 2.28002e-06 [get_grad_eliminate_]: 6.26e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.44999e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.97999e-06 [renormalize]: 0.00240596 [add_forward_monad_depend]: 6.23e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.74e-05 [cse]: 3.202e-05 [replace_applicator]: 1.65e-05 [Cycle 2]: 0.00038955, [27] [switch_simplify]: 6.45002e-06 [loop_unroll]: 5.86998e-06 [a_1]: 0.00012538 [with_stream_mark]: 1.212e-05 [recompute_prepare]: 6.14999e-06 [updatestate_depend_eliminate]: 2.73003e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 2.36998e-06 [specialize_transform]: 5.70001e-06 [updatestate_useless_node_eliminater]: 5.68002e-06 [accelerated_algorithm]: 6.46999e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.31999e-06 [cell_reuse_recompute_pass]: 2.66e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.701e-05 [j_node_and_user_rematch]: 9.77001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.39e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 6.14001e-06 [cse]: 1.202e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 4.281e-05 [rewriter_after_opt_a]: 3.735e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 6.06998e-06 [mutable_eliminate]: 0.0005876 [jit_opt_b]: 5.587e-05, [1] [Cycle 1]: 4.944e-05, [2] [frontend_op_eliminate]: 2.064e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.624e-05 [loop_unroll]: 0.00043032 [jit_opt_after_cconv]: 0.00014873, [1] [Cycle 1]: 0.00014251, [11] [c_1]: 2.7e-05 [parameter_eliminate]: 2.21e-06 [updatestate_depend_eliminate]: 4.84e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.971e-05 [call_graph_tuple_transform]: 1.947e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.529e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 7.98999e-06 [add_recomputation]: 4.932e-05 [cse_after_recomputation]: 2.249e-05, [1] [Cycle 1]: 1.637e-05, [1] [cse]: 1.073e-05 [auto_monad_reorder]: 1.517e-05 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 4.03999e-06 [opt_after_jit_grad]: 0.00045506 [symbol_engine_optimizer]: 0.00016374, [1] [Cycle 1]: 0.00015755, [6] [build]: 3.11001e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.535e-05 [opt_reshape]: 7.5e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 7.2e-07 [validate]: 4.14e-05 Sums bootstrap : 0.000299s : 0.26% type_inference : 0.108331s : 94.32% event_method : 0.000081s : 0.07% auto_monad : 0.000072s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000537s : 0.47% rewriter_before_opt_a : 0.000085s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000694s : 0.60% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002406s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000043s : 0.04% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000588s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000430s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000455s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000195 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000002s : 2: substitution.fold_const_symbol 2.95% : 0.000006s : 4: substitution.graph_param_transform 81.90% : 0.000160s : 4: substitution.inline 1.95% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108259 2 97.49% : 0.105538s : 1: type_inference.infer 2.51% : 0.002720s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.19% : 0.000049s : 4: replace.inline 32.81% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.29% : 0.000157s : 4: match.inline 6.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.98% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000002s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.40% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.11% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.44% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000002s : 12: predicate.minmaximum_grad 1.52% : 0.000002s : 4: predicate.mutable_eliminate 0.80% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.88% : 0.000003s : 12: predicate.reduce_eliminate 1.55% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.21% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.58% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001996 22 66.50% : 0.001327s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.33% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.17% : 0.000642s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122332 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000314s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.07% : 0.000086s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 5.89% : 0.007204s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000438s : 1: loop_unroll 0.49% : 0.000597s : 1: mutable_eliminate 0.76% : 0.000932s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000544s : 1: py_interpret_to_execute 0.04% : 0.000046s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.40% : 0.001716s : 1: renormalize.infer 0.56% : 0.000681s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000090s : 1: rewriter_before_opt_a 0.14% : 0.000166s : 1: symbol_engine_optimizer 88.57% : 0.108349s : 1: type_inference TotalTime = 0.0609716, [30] [bootstrap]: 0.00026838 [type_inference]: 0.051247 [event_method]: 1.805e-05 [auto_monad]: 7.259e-05 [graph_reusing]: 5.90002e-06 [pre_auto_parallel]: 2.61e-06 [py_interpret_to_execute]: 0.00029346 [rewriter_before_opt_a]: 8.505e-05 [expand_dump_flag]: 3.43e-06 [jit_opt_a]: 0.00676537, [2] [Cycle 1]: 0.00297615, [27] [switch_simplify]: 5.726e-05 [loop_unroll]: 3.142e-05 [a_1]: 0.00057091 [with_stream_mark]: 1.738e-05 [recompute_prepare]: 8.59998e-06 [updatestate_depend_eliminate]: 3.78001e-06 [updatestate_assign_eliminate]: 3.53e-06 [updatestate_loads_eliminate]: 3.10998e-06 [parameter_eliminate]: 2.12999e-06 [specialize_transform]: 7.13998e-06 [updatestate_useless_node_eliminater]: 6.73e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.79999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.564e-05 [j_node_and_user_rematch]: 1.033e-05 [meta_fg_expand]: 2.99999e-06 [replace_old_param]: 1.008e-05 [inline_without_move]: 6.05002e-06 [renormalize]: 0.00196639 [add_forward_monad_depend]: 4.53001e-06 [auto_monad_grad]: 1.92001e-06 [auto_monad_eliminator]: 1.475e-05 [cse]: 3.102e-05 [replace_applicator]: 1.433e-05 [Cycle 2]: 0.00036126, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 6.08998e-06 [a_1]: 0.0001216 [with_stream_mark]: 9.57999e-06 [recompute_prepare]: 5.96998e-06 [updatestate_depend_eliminate]: 2.78998e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.75001e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 5.72001e-06 [meta_shard_fg_expand]: 1.55999e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.25e-06 [meta_fg_expand]: 1.97999e-06 [replace_old_param]: 8.71002e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.11002e-06 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.16e-05 [replace_applicator]: 5.97999e-06 [py_interpret_to_execute_after_opt_a]: 8.37e-06 [rewriter_after_opt_a]: 3.358e-05 [convert_after_rewriter]: 6.83998e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00058657 [jit_opt_b]: 5.527e-05, [1] [Cycle 1]: 4.8e-05, [2] [frontend_op_eliminate]: 1.959e-05 [inline_after_opt_a]: 1.761e-05 [cconv]: 2.715e-05 [loop_unroll]: 0.00041769 [jit_opt_after_cconv]: 0.00014829, [1] [Cycle 1]: 0.00014161, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 2.07001e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 2.05e-05 [call_graph_tuple_transform]: 2.004e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.39e-06 [renormalize]: 6.69999e-07 [switch_simplify]: 5.98998e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 8.3e-06 [add_recomputation]: 4.699e-05 [cse_after_recomputation]: 2.208e-05, [1] [Cycle 1]: 1.651e-05, [1] [cse]: 1.076e-05 [auto_monad_reorder]: 1.8e-05 [get_jit_bprop_graph]: 1.49e-06 [rewriter_after_jit_bprop_graph]: 4.54002e-06 [opt_after_jit_grad]: 0.00052421 [symbol_engine_optimizer]: 7.744e-05, [1] [Cycle 1]: 7.144e-05, [6] [build]: 2.89001e-06 [elim_shapecalc]: 8.72e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 7.15998e-06 [fold_const_symbol]: 1.028e-05 [renormalize]: 4.40021e-07 [validate]: 3.882e-05 Sums bootstrap : 0.000268s : 0.47% type_inference : 0.051247s : 89.93% event_method : 0.000018s : 0.03% auto_monad : 0.000073s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000293s : 0.51% rewriter_before_opt_a : 0.000085s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.11% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000693s : 1.22% jit_opt_a.with_stream_mark : 0.000027s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001966s : 3.45% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000587s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000418s : 0.73% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000018s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000524s : 0.92% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.07% Time group info: ------[substitution.] 0.000201 24 1.10% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 3.01% : 0.000006s : 4: substitution.graph_param_transform 82.04% : 0.000165s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000006s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.70% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051173 2 96.34% : 0.049300s : 1: type_inference.infer 3.66% : 0.001873s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.55% : 0.000048s : 4: replace.inline 33.45% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 92.99% : 0.000162s : 4: match.inline 7.01% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 2.01% : 0.000003s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.28% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.16% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.01% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.86% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.97% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.24% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000001s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.29% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002096 26 70.30% : 0.001473s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.34% : 0.000594s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063944 72 0.08% : 0.000050s : 1: add_recomputation 0.12% : 0.000076s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.44% : 0.000280s : 1: bootstrap 0.05% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.59% : 0.006769s : 1: jit_opt_a 0.24% : 0.000151s : 1: jit_opt_after_cconv 0.09% : 0.000058s : 1: jit_opt_b 0.66% : 0.000425s : 1: loop_unroll 0.93% : 0.000595s : 1: mutable_eliminate 1.45% : 0.000928s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000299s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.09% : 0.001336s : 1: renormalize.infer 0.97% : 0.000622s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000036s : 1: rewriter_after_opt_a 0.14% : 0.000090s : 1: rewriter_before_opt_a 0.12% : 0.000080s : 1: symbol_engine_optimizer 80.17% : 0.051261s : 1: type_inference TotalTime = 0.0125471, [30] [bootstrap]: 0.00028649 [type_inference]: 0.00449478 [event_method]: 1.823e-05 [auto_monad]: 6.706e-05 [graph_reusing]: 5.67001e-06 [pre_auto_parallel]: 2.31e-06 [py_interpret_to_execute]: 3.907e-05 [rewriter_before_opt_a]: 7.563e-05 [expand_dump_flag]: 2.89999e-06 [jit_opt_a]: 0.00528707, [2] [Cycle 1]: 0.00161182, [27] [switch_simplify]: 5.363e-05 [loop_unroll]: 3.084e-05 [a_1]: 0.00051832 [with_stream_mark]: 1.306e-05 [recompute_prepare]: 7.92e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 3.06999e-06 [updatestate_loads_eliminate]: 2.24001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 6.15002e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.56002e-06 [meta_shard_fg_expand]: 1.27999e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.16001e-06 [cell_reuse_recompute_pass]: 8.99978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.236e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 8.1e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00068289 [add_forward_monad_depend]: 5.99999e-06 [auto_monad_grad]: 2.22999e-06 [auto_monad_eliminator]: 1.61e-05 [cse]: 2.944e-05 [replace_applicator]: 1.167e-05 [Cycle 2]: 0.00031792, [27] [switch_simplify]: 5.61003e-06 [loop_unroll]: 4.85001e-06 [a_1]: 9.291e-05 [with_stream_mark]: 8.56002e-06 [recompute_prepare]: 4.92999e-06 [updatestate_depend_eliminate]: 2.58e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.76997e-06 [accelerated_algorithm]: 4.71002e-06 [meta_shard_fg_expand]: 1.19003e-06 [get_grad_eliminate_]: 4.71002e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 1.45999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.371e-05 [j_node_and_user_rematch]: 7.78999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.2e-06 [inline_without_move]: 4.84998e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.121e-05 [replace_applicator]: 5.00999e-06 [py_interpret_to_execute_after_opt_a]: 9.42999e-06 [rewriter_after_opt_a]: 3.294e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 1.68e-05 [mutable_eliminate]: 0.000616 [jit_opt_b]: 5.192e-05, [1] [Cycle 1]: 4.49e-05, [2] [frontend_op_eliminate]: 1.64e-05 [inline_after_opt_a]: 1.774e-05 [cconv]: 2.77e-05 [loop_unroll]: 0.00044819 [jit_opt_after_cconv]: 0.0001593, [1] [Cycle 1]: 0.0001523, [11] [c_1]: 2.504e-05 [parameter_eliminate]: 3.49001e-06 [updatestate_depend_eliminate]: 6.43e-06 [updatestate_assign_eliminate]: 2.68003e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.399e-05 [call_graph_tuple_transform]: 2.035e-05 [tuple_list_get_item_eliminator]: 6.58e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 5.48002e-06 [remove_dup_value]: 3.711e-05 [partial_unused_args_eliminate]: 2.51e-06 [environ_conv]: 5.75001e-06 [add_recomputation]: 5.729e-05 [cse_after_recomputation]: 2.419e-05, [1] [Cycle 1]: 1.797e-05, [1] [cse]: 1.133e-05 [auto_monad_reorder]: 1.281e-05 [get_jit_bprop_graph]: 2.07001e-06 [rewriter_after_jit_bprop_graph]: 5.93998e-06 [opt_after_jit_grad]: 0.00048849 [symbol_engine_optimizer]: 7.279e-05, [1] [Cycle 1]: 6.649e-05, [6] [build]: 2.76e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.306e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 2.89991e-07 [validate]: 3.191e-05 Sums bootstrap : 0.000286s : 3.32% type_inference : 0.004495s : 52.06% event_method : 0.000018s : 0.21% auto_monad : 0.000067s : 0.78% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000039s : 0.45% rewriter_before_opt_a : 0.000076s : 0.88% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000059s : 0.69% jit_opt_a.loop_unroll : 0.000036s : 0.41% jit_opt_a.a_1 : 0.000611s : 7.08% jit_opt_a.with_stream_mark : 0.000022s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000683s : 7.91% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.25% jit_opt_a.cse : 0.000041s : 0.47% jit_opt_a.replace_applicator : 0.000017s : 0.19% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000033s : 0.38% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000017s : 0.19% mutable_eliminate : 0.000616s : 7.14% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000018s : 0.21% cconv : 0.000028s : 0.32% loop_unroll : 0.000448s : 5.19% jit_opt_after_cconv.c_1 : 0.000025s : 0.29% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000024s : 0.28% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000037s : 0.43% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000057s : 0.66% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000013s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000488s : 5.66% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.37% Time group info: ------[substitution.] 0.000178 23 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.53% : 0.000001s : 2: substitution.fold_const_symbol 2.94% : 0.000005s : 3: substitution.graph_param_transform 84.19% : 0.000150s : 4: substitution.inline 1.75% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000005s : 4: substitution.remove_not_recompute_node 1.82% : 0.000003s : 2: substitution.replace_old_param 5.30% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004437 2 81.35% : 0.003609s : 1: type_inference.infer 18.65% : 0.000828s : 1: type_inference.specialize ------[replace.] 0.000068 6 64.43% : 0.000044s : 4: replace.inline 35.57% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 94.68% : 0.000147s : 4: match.inline 5.32% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 2.18% : 0.000003s : 10: predicate.arithmetic_simplify 1.67% : 0.000002s : 10: predicate.cast_eliminate 0.57% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.17% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_depend_swap 1.39% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.17% : 0.000006s : 22: predicate.inline 0.81% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.16% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.69% : 0.000002s : 3: predicate.mutable_eliminate 0.62% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.66% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.51% : 0.000001s : 3: predicate.reset_defer_inline 1.29% : 0.000002s : 10: predicate.reshape_eliminate 1.40% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.18% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.38% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.62% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000592 13 50.92% : 0.000301s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.99% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.09% : 0.000261s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014127 72 0.43% : 0.000060s : 1: add_recomputation 0.50% : 0.000070s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 2.10% : 0.000297s : 1: bootstrap 0.22% : 0.000031s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000027s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.45% : 0.005291s : 1: jit_opt_a 1.15% : 0.000162s : 1: jit_opt_after_cconv 0.39% : 0.000055s : 1: jit_opt_b 3.23% : 0.000457s : 1: loop_unroll 4.42% : 0.000625s : 1: mutable_eliminate 5.81% : 0.000821s : 26: opt.transform.jit_opt_a 0.38% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.52% : 0.000497s : 1: opt_after_jit_grad 0.14% : 0.000019s : 1: order_py_execute_after_rewriter 0.03% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.28% : 0.000040s : 1: remove_dup_value 2.56% : 0.000362s : 1: renormalize.infer 2.23% : 0.000314s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000036s : 1: rewriter_after_opt_a 0.56% : 0.000079s : 1: rewriter_before_opt_a 0.53% : 0.000075s : 1: symbol_engine_optimizer 31.90% : 0.004506s : 1: type_inference TotalTime = 0.113881, [30] [bootstrap]: 0.00025817 [type_inference]: 0.103578 [event_method]: 1.98e-05 [auto_monad]: 7.224e-05 [graph_reusing]: 6.39999e-06 [pre_auto_parallel]: 2.54999e-06 [py_interpret_to_execute]: 0.00046969 [rewriter_before_opt_a]: 9.087e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.00717299, [2] [Cycle 1]: 0.00349326, [27] [switch_simplify]: 5.541e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00056865 [with_stream_mark]: 1.606e-05 [recompute_prepare]: 9.03002e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 7.36999e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.34999e-06 [meta_shard_fg_expand]: 2.56998e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 4.00998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.569e-05 [j_node_and_user_rematch]: 9.90002e-06 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.87999e-06 [renormalize]: 0.0024693 [add_forward_monad_depend]: 7.31001e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.875e-05 [cse]: 3.286e-05 [replace_applicator]: 1.593e-05 [Cycle 2]: 0.00036551, [27] [switch_simplify]: 6.90002e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00012117 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 5.97001e-06 [updatestate_depend_eliminate]: 2.91e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.43e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.62999e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.88002e-06 [meta_shard_fg_expand]: 1.77999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 2.21998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.669e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.107e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 9.20999e-06 [rewriter_after_opt_a]: 3.405e-05 [convert_after_rewriter]: 7.28e-06 [order_py_execute_after_rewriter]: 5.96e-06 [mutable_eliminate]: 0.00061998 [jit_opt_b]: 5.307e-05, [1] [Cycle 1]: 4.701e-05, [2] [frontend_op_eliminate]: 1.877e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.433e-05 [loop_unroll]: 0.00042044 [jit_opt_after_cconv]: 0.00014576, [1] [Cycle 1]: 0.00013957, [11] [c_1]: 2.618e-05 [parameter_eliminate]: 2.21e-06 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.955e-05 [call_graph_tuple_transform]: 1.974e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.98998e-06 [remove_dup_value]: 1.593e-05 [partial_unused_args_eliminate]: 2.07001e-06 [environ_conv]: 8.80999e-06 [add_recomputation]: 4.924e-05 [cse_after_recomputation]: 2.238e-05, [1] [Cycle 1]: 1.637e-05, [1] [cse]: 1.07e-05 [auto_monad_reorder]: 1.573e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00045887 [symbol_engine_optimizer]: 7.617e-05, [1] [Cycle 1]: 6.982e-05, [6] [build]: 4.2e-06 [elim_shapecalc]: 8.48001e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.18002e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 3.60014e-07 [validate]: 5.648e-05 Sums bootstrap : 0.000258s : 0.23% type_inference : 0.103578s : 94.17% event_method : 0.000020s : 0.02% auto_monad : 0.000072s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000470s : 0.43% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000690s : 0.63% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002469s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000620s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000420s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000459s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000056s : 0.05% Time group info: ------[substitution.] 0.000206 24 1.48% : 0.000003s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.69% : 0.000006s : 4: substitution.graph_param_transform 81.34% : 0.000168s : 4: substitution.inline 1.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.03% : 0.000006s : 4: substitution.remove_not_recompute_node 2.48% : 0.000005s : 2: substitution.replace_old_param 6.45% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103499 2 97.42% : 0.100825s : 1: type_inference.infer 2.58% : 0.002674s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.13% : 0.000051s : 4: replace.inline 31.87% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.19% : 0.000165s : 4: match.inline 6.81% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000003s : 12: predicate.arithmetic_simplify 1.24% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.44% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.29% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.32% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.17% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.64% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.21% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001954 22 64.39% : 0.001258s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.14% : 0.000667s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117327 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000076s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000268s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.12% : 0.007176s : 1: jit_opt_a 0.13% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000429s : 1: loop_unroll 0.54% : 0.000628s : 1: mutable_eliminate 0.79% : 0.000924s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000467s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.51% : 0.001769s : 1: renormalize.infer 0.59% : 0.000691s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000097s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.30% : 0.103598s : 1: type_inference TotalTime = 0.11711, [30] [bootstrap]: 0.00027008 [type_inference]: 0.106436 [event_method]: 1.947e-05 [auto_monad]: 6.993e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 2.07999e-06 [py_interpret_to_execute]: 0.00051421 [rewriter_before_opt_a]: 8.781e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.00722025, [2] [Cycle 1]: 0.00354331, [27] [switch_simplify]: 5.452e-05 [loop_unroll]: 3.147e-05 [a_1]: 0.00062718 [with_stream_mark]: 1.921e-05 [recompute_prepare]: 8.77e-06 [updatestate_depend_eliminate]: 3.71999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.58002e-06 [specialize_transform]: 7.04001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 7.3e-06 [meta_shard_fg_expand]: 2.28998e-06 [get_grad_eliminate_]: 7.13e-06 [merge_forward]: 4.01001e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.74e-05 [j_node_and_user_rematch]: 1.046e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 5.96003e-06 [renormalize]: 0.00245006 [add_forward_monad_depend]: 7.58001e-06 [auto_monad_grad]: 2.36998e-06 [auto_monad_eliminator]: 1.761e-05 [cse]: 2.58e-05 [replace_applicator]: 2.144e-05 [Cycle 2]: 0.00038997, [27] [switch_simplify]: 6.91001e-06 [loop_unroll]: 6.41e-06 [a_1]: 0.00012977 [with_stream_mark]: 1.38e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.33e-06 [updatestate_assign_eliminate]: 2.83998e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.41e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.02998e-06 [cell_reuse_recompute_pass]: 2.45002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.916e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.12001e-06 [replace_old_param]: 1.007e-05 [inline_without_move]: 5.67001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.197e-05 [replace_applicator]: 6.13002e-06 [py_interpret_to_execute_after_opt_a]: 1.41e-05 [rewriter_after_opt_a]: 3.704e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 6.06e-06 [mutable_eliminate]: 0.00073735 [jit_opt_b]: 5.834e-05, [1] [Cycle 1]: 5.18e-05, [2] [frontend_op_eliminate]: 2.098e-05 [inline_after_opt_a]: 1.956e-05 [cconv]: 2.654e-05 [loop_unroll]: 0.00043479 [jit_opt_after_cconv]: 0.00016084, [1] [Cycle 1]: 0.00015457, [11] [c_1]: 2.677e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.13002e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.44e-05 [call_graph_tuple_transform]: 2.458e-05 [tuple_list_get_item_eliminator]: 6.02001e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 7.26999e-06 [remove_dup_value]: 1.57e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.63999e-06 [add_recomputation]: 4.965e-05 [cse_after_recomputation]: 2.23e-05, [1] [Cycle 1]: 1.725e-05, [1] [cse]: 1.066e-05 [auto_monad_reorder]: 1.506e-05 [get_jit_bprop_graph]: 1.64e-06 [rewriter_after_jit_bprop_graph]: 7.2e-06 [opt_after_jit_grad]: 0.00046413 [symbol_engine_optimizer]: 0.00015854, [1] [Cycle 1]: 0.00015251, [6] [build]: 3.79002e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.566e-05 [opt_reshape]: 7.2e-06 [fold_const_symbol]: 9.41e-06 [renormalize]: 3.19997e-07 [validate]: 4.406e-05 Sums bootstrap : 0.000270s : 0.24% type_inference : 0.106436s : 94.10% event_method : 0.000019s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000514s : 0.45% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000757s : 0.67% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002450s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000028s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000737s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000435s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000025s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000464s : 0.41% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000211 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.98% : 0.000006s : 4: substitution.graph_param_transform 82.08% : 0.000174s : 4: substitution.inline 1.74% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.17% : 0.000007s : 4: substitution.remove_not_recompute_node 2.50% : 0.000005s : 2: substitution.replace_old_param 5.94% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106358 2 97.55% : 0.103755s : 1: type_inference.infer 2.45% : 0.002603s : 1: type_inference.specialize ------[replace.] 0.000074 6 68.51% : 0.000051s : 4: replace.inline 31.49% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 93.73% : 0.000171s : 4: match.inline 6.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.18% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.25% : 0.000002s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.69% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.41% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.27% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.86% : 0.000003s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000003s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.90% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.77% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.61% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.97% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002039 22 66.68% : 0.001360s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.56% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.75% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120617 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000288s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.99% : 0.007224s : 1: jit_opt_a 0.14% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.37% : 0.000442s : 1: loop_unroll 0.62% : 0.000746s : 1: mutable_eliminate 0.83% : 0.001005s : 26: opt.transform.jit_opt_a 0.05% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000472s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000524s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.46% : 0.001762s : 1: renormalize.infer 0.56% : 0.000679s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000092s : 1: rewriter_before_opt_a 0.13% : 0.000161s : 1: symbol_engine_optimizer 88.26% : 0.106451s : 1: type_inference TotalTime = 0.0119241, [30] [bootstrap]: 0.00028101 [type_inference]: 0.00435949 [event_method]: 1.754e-05 [auto_monad]: 6.711e-05 [graph_reusing]: 5.79999e-06 [pre_auto_parallel]: 2.15002e-06 [py_interpret_to_execute]: 2.236e-05 [rewriter_before_opt_a]: 7.053e-05 [expand_dump_flag]: 2.51e-06 [jit_opt_a]: 0.00505799, [2] [Cycle 1]: 0.00162409, [27] [switch_simplify]: 4.802e-05 [loop_unroll]: 3.051e-05 [a_1]: 0.00055811 [with_stream_mark]: 1.627e-05 [recompute_prepare]: 7.4e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.30001e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.85001e-06 [get_grad_eliminate_]: 5.44e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.36e-05 [j_node_and_user_rematch]: 9.21002e-06 [meta_fg_expand]: 2.51e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.37999e-06 [renormalize]: 0.00066529 [add_forward_monad_depend]: 5.50001e-06 [auto_monad_grad]: 2.26e-06 [auto_monad_eliminator]: 1.408e-05 [cse]: 2.586e-05 [replace_applicator]: 1.183e-05 [Cycle 2]: 0.00032301, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 5.10001e-06 [a_1]: 9.063e-05 [with_stream_mark]: 9.84999e-06 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 2.55002e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 4.83001e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.72998e-06 [merge_forward]: 3.12002e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.345e-05 [j_node_and_user_rematch]: 8.35999e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 7.16001e-06 [inline_without_move]: 4.68999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.29e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.202e-05 [replace_applicator]: 5.14e-06 [py_interpret_to_execute_after_opt_a]: 1.128e-05 [rewriter_after_opt_a]: 3.314e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.00999e-06 [mutable_eliminate]: 0.00052554 [jit_opt_b]: 4.715e-05, [1] [Cycle 1]: 4.124e-05, [2] [frontend_op_eliminate]: 1.581e-05 [inline_after_opt_a]: 1.516e-05 [cconv]: 3.345e-05 [loop_unroll]: 0.000415 [jit_opt_after_cconv]: 0.00013861, [1] [Cycle 1]: 0.0001325, [11] [c_1]: 2.169e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 1.821e-05 [call_graph_tuple_transform]: 1.743e-05 [tuple_list_get_item_eliminator]: 5.49998e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.27001e-06 [remove_dup_value]: 1.289e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 5.17e-06 [add_recomputation]: 4.316e-05 [cse_after_recomputation]: 2.118e-05, [1] [Cycle 1]: 1.578e-05, [1] [cse]: 1.008e-05 [auto_monad_reorder]: 1.374e-05 [get_jit_bprop_graph]: 2.01e-06 [rewriter_after_jit_bprop_graph]: 5.55001e-06 [opt_after_jit_grad]: 0.00044609 [symbol_engine_optimizer]: 7.033e-05, [1] [Cycle 1]: 6.473e-05, [6] [build]: 2.72001e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.205e-05 [opt_reshape]: 5.49998e-06 [fold_const_symbol]: 8.54998e-06 [renormalize]: 3.19997e-07 [validate]: 3.328e-05 Sums bootstrap : 0.000281s : 3.40% type_inference : 0.004359s : 52.79% event_method : 0.000018s : 0.21% auto_monad : 0.000067s : 0.81% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000022s : 0.27% rewriter_before_opt_a : 0.000071s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.43% jit_opt_a.a_1 : 0.000649s : 7.86% jit_opt_a.with_stream_mark : 0.000026s : 0.32% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.21% jit_opt_a.meta_fg_expand : 0.000005s : 0.06% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000665s : 8.06% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000038s : 0.46% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.14% rewriter_after_opt_a : 0.000033s : 0.40% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000526s : 6.36% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000033s : 0.41% loop_unroll : 0.000415s : 5.03% jit_opt_after_cconv.c_1 : 0.000022s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000043s : 0.52% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000014s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000446s : 5.40% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.40% Time group info: ------[substitution.] 0.000188 23 0.97% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000005s : 3: substitution.graph_param_transform 83.85% : 0.000158s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000005s : 4: substitution.remove_not_recompute_node 1.78% : 0.000003s : 2: substitution.replace_old_param 5.96% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004300 2 80.26% : 0.003451s : 1: type_inference.infer 19.74% : 0.000849s : 1: type_inference.specialize ------[replace.] 0.000069 6 65.89% : 0.000046s : 4: replace.inline 34.11% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 93.92% : 0.000155s : 4: match.inline 6.08% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000002s : 10: predicate.addn_zero_filter 2.10% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.43% : 0.000002s : 3: predicate.mutable_eliminate 0.41% : 0.000000s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.52% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.83% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.38% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.41% : 0.000008s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.52% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000583 13 49.92% : 0.000291s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.29% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.79% : 0.000261s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013505 72 0.34% : 0.000046s : 1: add_recomputation 0.52% : 0.000070s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.28% : 0.000308s : 1: bootstrap 0.27% : 0.000036s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.48% : 0.005061s : 1: jit_opt_a 1.05% : 0.000141s : 1: jit_opt_after_cconv 0.37% : 0.000050s : 1: jit_opt_b 3.13% : 0.000422s : 1: loop_unroll 3.95% : 0.000533s : 1: mutable_eliminate 6.34% : 0.000856s : 26: opt.transform.jit_opt_a 0.34% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.36% : 0.000453s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.18% : 0.000025s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000015s : 1: remove_dup_value 2.54% : 0.000343s : 1: renormalize.infer 2.34% : 0.000315s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000036s : 1: rewriter_after_opt_a 0.54% : 0.000073s : 1: rewriter_before_opt_a 0.54% : 0.000073s : 1: symbol_engine_optimizer 32.36% : 0.004371s : 1: type_inference TotalTime = 0.0109768, [30] [bootstrap]: 0.00024921 [type_inference]: 0.00397818 [event_method]: 1.596e-05 [auto_monad]: 4.258e-05 [graph_reusing]: 3.58999e-06 [pre_auto_parallel]: 1.72999e-06 [py_interpret_to_execute]: 3.355e-05 [rewriter_before_opt_a]: 6.271e-05 [expand_dump_flag]: 1.72999e-06 [jit_opt_a]: 0.00463495, [2] [Cycle 1]: 0.00134528, [27] [switch_simplify]: 4.652e-05 [loop_unroll]: 3.027e-05 [a_1]: 0.0004643 [with_stream_mark]: 1.143e-05 [recompute_prepare]: 7.26999e-06 [updatestate_depend_eliminate]: 3.25998e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 6.46e-06 [updatestate_useless_node_eliminater]: 5.00001e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 2.77002e-06 [cell_reuse_recompute_pass]: 8.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.107e-05 [j_node_and_user_rematch]: 1.908e-05 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 8.06001e-06 [inline_without_move]: 5.55001e-06 [renormalize]: 0.00049937 [add_forward_monad_depend]: 3.97998e-06 [auto_monad_grad]: 9.89996e-07 [auto_monad_eliminator]: 1.045e-05 [cse]: 1.74e-05 [replace_applicator]: 1.091e-05 [Cycle 2]: 0.00030935, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 4.99e-06 [a_1]: 8.912e-05 [with_stream_mark]: 7.86001e-06 [recompute_prepare]: 4.95999e-06 [updatestate_depend_eliminate]: 2.60002e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 4.85999e-06 [updatestate_useless_node_eliminater]: 4.76002e-06 [accelerated_algorithm]: 4.60999e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 4.55999e-06 [merge_forward]: 2.41e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.135e-05 [j_node_and_user_rematch]: 7.85998e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 7.11001e-06 [inline_without_move]: 4.55001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.09998e-06 [cse]: 1.04e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 7.22002e-06 [rewriter_after_opt_a]: 2.474e-05 [convert_after_rewriter]: 5.74999e-06 [order_py_execute_after_rewriter]: 3.88001e-06 [mutable_eliminate]: 0.0004878 [jit_opt_b]: 5.893e-05, [1] [Cycle 1]: 5.243e-05, [2] [frontend_op_eliminate]: 1.556e-05 [inline_after_opt_a]: 2.609e-05 [cconv]: 1.494e-05 [loop_unroll]: 0.00041649 [jit_opt_after_cconv]: 0.00013578, [1] [Cycle 1]: 0.00012976, [11] [c_1]: 2.017e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.66e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 1.92e-05 [call_graph_tuple_transform]: 1.583e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 8.59989e-07 [renormalize]: 3.89991e-07 [switch_simplify]: 5.35999e-06 [remove_dup_value]: 7.93001e-06 [partial_unused_args_eliminate]: 1.37999e-06 [environ_conv]: 3.90998e-06 [add_recomputation]: 3.274e-05 [cse_after_recomputation]: 2.268e-05, [1] [Cycle 1]: 1.723e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.047e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.00044353 [symbol_engine_optimizer]: 7.98e-05, [1] [Cycle 1]: 7.374e-05, [6] [build]: 2.29001e-06 [elim_shapecalc]: 7.23e-06 [elim_not_effective]: 1.254e-05 [opt_reshape]: 6.20002e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 3.50003e-07 [validate]: 2.81e-05 Sums bootstrap : 0.000249s : 3.35% type_inference : 0.003978s : 53.47% event_method : 0.000016s : 0.21% auto_monad : 0.000043s : 0.57% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.45% rewriter_before_opt_a : 0.000063s : 0.84% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000052s : 0.70% jit_opt_a.loop_unroll : 0.000035s : 0.47% jit_opt_a.a_1 : 0.000553s : 7.44% jit_opt_a.with_stream_mark : 0.000019s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000022s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000027s : 0.36% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.14% jit_opt_a.renormalize : 0.000499s : 6.71% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.21% jit_opt_a.cse : 0.000028s : 0.37% jit_opt_a.replace_applicator : 0.000016s : 0.22% py_interpret_to_execute_after_opt_a : 0.000007s : 0.10% rewriter_after_opt_a : 0.000025s : 0.33% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000488s : 6.56% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000026s : 0.35% cconv : 0.000015s : 0.20% loop_unroll : 0.000416s : 5.60% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000033s : 0.44% cse_after_recomputation.cse : 0.000011s : 0.15% auto_monad_reorder : 0.000010s : 0.14% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.07% opt_after_jit_grad : 0.000444s : 5.96% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.38% Time group info: ------[substitution.] 0.000143 23 0.94% : 0.000001s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.37% : 0.000003s : 3: substitution.graph_param_transform 83.74% : 0.000120s : 4: substitution.inline 1.98% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000004s : 4: substitution.remove_not_recompute_node 2.07% : 0.000003s : 2: substitution.replace_old_param 5.23% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003932 2 81.11% : 0.003189s : 1: type_inference.infer 18.89% : 0.000743s : 1: type_inference.specialize ------[replace.] 0.000059 6 65.09% : 0.000038s : 4: replace.inline 34.91% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000123 6 94.88% : 0.000117s : 4: match.inline 5.12% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.32% : 0.000001s : 10: predicate.addn_zero_filter 1.94% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.34% : 0.000002s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.44% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.50% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.48% : 0.000002s : 10: predicate.environ_get_eliminate 1.30% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 4.90% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.01% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.12% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.48% : 0.000002s : 3: predicate.mutable_eliminate 0.59% : 0.000001s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.64% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.50% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 16: predicate.switch_defer_inline 2.30% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000530 13 50.32% : 0.000267s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.67% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.01% : 0.000238s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012305 72 0.29% : 0.000036s : 1: add_recomputation 0.37% : 0.000046s : 1: auto_monad 0.10% : 0.000013s : 1: auto_monad_reorder 2.12% : 0.000261s : 1: bootstrap 0.14% : 0.000018s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.20% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.69% : 0.004637s : 1: jit_opt_a 1.13% : 0.000138s : 1: jit_opt_after_cconv 0.50% : 0.000062s : 1: jit_opt_b 3.44% : 0.000424s : 1: loop_unroll 4.03% : 0.000496s : 1: mutable_eliminate 6.19% : 0.000762s : 26: opt.transform.jit_opt_a 0.35% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.29% : 0.000036s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.17% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.67% : 0.000452s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000009s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000010s : 1: remove_dup_value 2.07% : 0.000255s : 1: renormalize.infer 1.94% : 0.000239s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000028s : 1: rewriter_after_opt_a 0.53% : 0.000066s : 1: rewriter_before_opt_a 0.67% : 0.000082s : 1: symbol_engine_optimizer 32.42% : 0.003989s : 1: type_inference TotalTime = 0.0114888, [30] [bootstrap]: 0.00032238 [type_inference]: 0.00407612 [event_method]: 1.752e-05 [auto_monad]: 6.884e-05 [graph_reusing]: 5.46e-06 [pre_auto_parallel]: 2.64999e-06 [py_interpret_to_execute]: 3.639e-05 [rewriter_before_opt_a]: 7.307e-05 [expand_dump_flag]: 2.82002e-06 [jit_opt_a]: 0.00489884, [2] [Cycle 1]: 0.00154797, [27] [switch_simplify]: 5.243e-05 [loop_unroll]: 3.036e-05 [a_1]: 0.00051984 [with_stream_mark]: 1.658e-05 [recompute_prepare]: 7.85998e-06 [updatestate_depend_eliminate]: 4.38001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 2.95998e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 6.39999e-06 [updatestate_useless_node_eliminater]: 5.28002e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 4.14997e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.388e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.11002e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 0.00060874 [add_forward_monad_depend]: 4.95999e-06 [auto_monad_grad]: 1.71998e-06 [auto_monad_eliminator]: 1.554e-05 [cse]: 3.02e-05 [replace_applicator]: 1.128e-05 [Cycle 2]: 0.00031416, [27] [switch_simplify]: 5.84999e-06 [loop_unroll]: 5.05999e-06 [a_1]: 8.96e-05 [with_stream_mark]: 9.02e-06 [recompute_prepare]: 5.22e-06 [updatestate_depend_eliminate]: 2.61999e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.85999e-06 [accelerated_algorithm]: 4.83001e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 4.60999e-06 [merge_forward]: 2.36e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.259e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.5e-06 [inline_without_move]: 4.75001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 1.094e-05 [replace_applicator]: 4.90001e-06 [py_interpret_to_execute_after_opt_a]: 9.24e-06 [rewriter_after_opt_a]: 3.56e-05 [convert_after_rewriter]: 6.41998e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00049373 [jit_opt_b]: 4.891e-05, [1] [Cycle 1]: 4.29e-05, [2] [frontend_op_eliminate]: 1.609e-05 [inline_after_opt_a]: 1.538e-05 [cconv]: 2.475e-05 [loop_unroll]: 0.0004188 [jit_opt_after_cconv]: 0.00013663, [1] [Cycle 1]: 0.00013063, [11] [c_1]: 2.061e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.71999e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 1.834e-05 [call_graph_tuple_transform]: 1.687e-05 [tuple_list_get_item_eliminator]: 5.24998e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.51e-06 [remove_dup_value]: 1.51e-05 [partial_unused_args_eliminate]: 2.20002e-06 [environ_conv]: 4.77e-06 [add_recomputation]: 4.728e-05 [cse_after_recomputation]: 2.046e-05, [1] [Cycle 1]: 1.532e-05, [1] [cse]: 9.79999e-06 [auto_monad_reorder]: 1.529e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 5.46998e-06 [opt_after_jit_grad]: 0.00043533 [symbol_engine_optimizer]: 7.029e-05, [1] [Cycle 1]: 6.422e-05, [6] [build]: 3.09001e-06 [elim_shapecalc]: 7.66001e-06 [elim_not_effective]: 1.227e-05 [opt_reshape]: 5.66998e-06 [fold_const_symbol]: 8e-06 [renormalize]: 3.50003e-07 [validate]: 3.394e-05 Sums bootstrap : 0.000322s : 4.08% type_inference : 0.004076s : 51.56% event_method : 0.000018s : 0.22% auto_monad : 0.000069s : 0.87% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000036s : 0.46% rewriter_before_opt_a : 0.000073s : 0.92% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000058s : 0.74% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000609s : 7.71% jit_opt_a.with_stream_mark : 0.000026s : 0.32% jit_opt_a.recompute_prepare : 0.000013s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000609s : 7.70% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.27% jit_opt_a.cse : 0.000041s : 0.52% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.12% rewriter_after_opt_a : 0.000036s : 0.45% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000494s : 6.25% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000025s : 0.31% loop_unroll : 0.000419s : 5.30% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.60% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.07% opt_after_jit_grad : 0.000435s : 5.51% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.43% Time group info: ------[substitution.] 0.000177 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.35% : 0.000004s : 3: substitution.graph_param_transform 82.06% : 0.000145s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.51% : 0.000004s : 2: substitution.replace_old_param 7.01% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004019 2 78.91% : 0.003172s : 1: type_inference.infer 21.09% : 0.000848s : 1: type_inference.specialize ------[replace.] 0.000080 6 56.52% : 0.000045s : 4: replace.inline 43.48% : 0.000035s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 92.71% : 0.000143s : 4: match.inline 7.29% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.53% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.20% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.41% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.09% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.24% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.81% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.53% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.36% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.96% : 0.000002s : 10: predicate.reduce_eliminate 1.60% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.73% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.44% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.33% : 0.000002s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000539 13 49.68% : 0.000268s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.84% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.48% : 0.000245s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012975 72 0.39% : 0.000050s : 1: add_recomputation 0.55% : 0.000072s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.60% : 0.000337s : 1: bootstrap 0.21% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.17% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.78% : 0.004902s : 1: jit_opt_a 1.07% : 0.000139s : 1: jit_opt_after_cconv 0.40% : 0.000051s : 1: jit_opt_b 3.29% : 0.000427s : 1: loop_unroll 3.87% : 0.000502s : 1: mutable_eliminate 6.30% : 0.000817s : 26: opt.transform.jit_opt_a 0.35% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000443s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.51% : 0.000326s : 1: renormalize.infer 2.13% : 0.000276s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000038s : 1: rewriter_after_opt_a 0.58% : 0.000076s : 1: rewriter_before_opt_a 0.56% : 0.000073s : 1: symbol_engine_optimizer 31.51% : 0.004088s : 1: type_inference TotalTime = 0.0109233, [30] [bootstrap]: 0.00024133 [type_inference]: 0.00407759 [event_method]: 1.618e-05 [auto_monad]: 3.931e-05 [graph_reusing]: 3.55e-06 [pre_auto_parallel]: 1.54e-06 [py_interpret_to_execute]: 3.382e-05 [rewriter_before_opt_a]: 6.376e-05 [expand_dump_flag]: 1.86e-06 [jit_opt_a]: 0.00459467, [2] [Cycle 1]: 0.0013522, [27] [switch_simplify]: 4.585e-05 [loop_unroll]: 3.087e-05 [a_1]: 0.00046541 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 7.26001e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.35997e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 6.29999e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.33002e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.088e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.00051569 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 1.15999e-06 [auto_monad_eliminator]: 1.011e-05 [cse]: 1.768e-05 [replace_applicator]: 1.144e-05 [Cycle 2]: 0.00032688, [27] [switch_simplify]: 5.51998e-06 [loop_unroll]: 4.87e-06 [a_1]: 9.115e-05 [with_stream_mark]: 7.75e-06 [recompute_prepare]: 5.00999e-06 [updatestate_depend_eliminate]: 2.53e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 4.75999e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.36998e-06 [cell_reuse_recompute_pass]: 1.284e-05 [cell_reuse_handle_not_recompute_node_pass]: 1.283e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 7.5e-06 [inline_without_move]: 4.67e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.12e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.092e-05 [replace_applicator]: 4.78001e-06 [py_interpret_to_execute_after_opt_a]: 8.17e-06 [rewriter_after_opt_a]: 2.502e-05 [convert_after_rewriter]: 5.92001e-06 [order_py_execute_after_rewriter]: 4.08001e-06 [mutable_eliminate]: 0.00045032 [jit_opt_b]: 4.839e-05, [1] [Cycle 1]: 4.199e-05, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 1.478e-05 [cconv]: 1.496e-05 [loop_unroll]: 0.00039462 [jit_opt_after_cconv]: 0.0001439, [1] [Cycle 1]: 0.00013715, [11] [c_1]: 2.067e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 5.93002e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.764e-05 [call_graph_tuple_transform]: 1.644e-05 [tuple_list_get_item_eliminator]: 5.02e-06 [none_parameter_eliminate]: 8.79983e-07 [renormalize]: 3.00002e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 7.46999e-06 [partial_unused_args_eliminate]: 1.75001e-06 [environ_conv]: 3.56001e-06 [add_recomputation]: 3.134e-05 [cse_after_recomputation]: 2.101e-05, [1] [Cycle 1]: 1.609e-05, [1] [cse]: 1.059e-05 [auto_monad_reorder]: 9.94999e-06 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.17e-06 [opt_after_jit_grad]: 0.00043063 [symbol_engine_optimizer]: 6.854e-05, [1] [Cycle 1]: 6.289e-05, [6] [build]: 2.46998e-06 [elim_shapecalc]: 7.93001e-06 [elim_not_effective]: 1.162e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 3.30008e-07 [validate]: 2.58e-05 Sums bootstrap : 0.000241s : 3.23% type_inference : 0.004078s : 54.63% event_method : 0.000016s : 0.22% auto_monad : 0.000039s : 0.53% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.45% rewriter_before_opt_a : 0.000064s : 0.85% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000051s : 0.69% jit_opt_a.loop_unroll : 0.000036s : 0.48% jit_opt_a.a_1 : 0.000557s : 7.46% jit_opt_a.with_stream_mark : 0.000020s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000014s : 0.19% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.23% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000516s : 6.91% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.22% jit_opt_a.cse : 0.000029s : 0.38% jit_opt_a.replace_applicator : 0.000016s : 0.22% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000025s : 0.34% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000450s : 6.03% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000015s : 0.20% loop_unroll : 0.000395s : 5.29% jit_opt_after_cconv.c_1 : 0.000021s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000007s : 0.10% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000031s : 0.42% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000431s : 5.77% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000026s : 0.35% Time group info: ------[substitution.] 0.000145 23 0.95% : 0.000001s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.32% : 0.000003s : 3: substitution.graph_param_transform 83.41% : 0.000121s : 4: substitution.inline 1.81% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.02% : 0.000004s : 4: substitution.remove_not_recompute_node 2.23% : 0.000003s : 2: substitution.replace_old_param 5.58% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004030 2 81.87% : 0.003299s : 1: type_inference.infer 18.13% : 0.000731s : 1: type_inference.specialize ------[replace.] 0.000060 6 65.30% : 0.000039s : 4: replace.inline 34.70% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000125 6 94.48% : 0.000118s : 4: match.inline 5.52% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.42% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.42% : 0.000002s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.30% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.10% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.54% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000002s : 15: predicate.load_eliminater 1.32% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.57% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.40% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.21% : 0.000002s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.32% : 0.000001s : 10: predicate.reshape_eliminate 1.56% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.59% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000008s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.57% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.44% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000533 13 50.76% : 0.000271s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.88% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.35% : 0.000236s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012264 72 0.28% : 0.000034s : 1: add_recomputation 0.35% : 0.000043s : 1: auto_monad 0.10% : 0.000012s : 1: auto_monad_reorder 2.07% : 0.000253s : 1: bootstrap 0.14% : 0.000017s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.49% : 0.004597s : 1: jit_opt_a 1.20% : 0.000147s : 1: jit_opt_after_cconv 0.42% : 0.000051s : 1: jit_opt_b 3.28% : 0.000403s : 1: loop_unroll 3.74% : 0.000459s : 1: mutable_eliminate 6.16% : 0.000755s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.17% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.57% : 0.000438s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.30% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000010s : 1: remove_dup_value 2.13% : 0.000262s : 1: renormalize.infer 2.02% : 0.000248s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000028s : 1: rewriter_after_opt_a 0.55% : 0.000067s : 1: rewriter_before_opt_a 0.58% : 0.000071s : 1: symbol_engine_optimizer 33.33% : 0.004088s : 1: type_inference TotalTime = 0.0116081, [30] [bootstrap]: 0.00025414 [type_inference]: 0.00416002 [event_method]: 1.568e-05 [auto_monad]: 4.138e-05 [graph_reusing]: 3.8e-06 [pre_auto_parallel]: 1.87999e-06 [py_interpret_to_execute]: 3.513e-05 [rewriter_before_opt_a]: 6.405e-05 [expand_dump_flag]: 1.77999e-06 [jit_opt_a]: 0.00491977, [2] [Cycle 1]: 0.00155817, [27] [switch_simplify]: 6.148e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00049676 [with_stream_mark]: 1.613e-05 [recompute_prepare]: 7.53999e-06 [updatestate_depend_eliminate]: 4.71002e-06 [updatestate_assign_eliminate]: 3.44001e-06 [updatestate_loads_eliminate]: 3.48e-06 [parameter_eliminate]: 1.99e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 6.17999e-06 [accelerated_algorithm]: 6.00002e-06 [meta_shard_fg_expand]: 2.38002e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 4.10998e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.656e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.53998e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00061962 [add_forward_monad_depend]: 5.85002e-06 [auto_monad_grad]: 2.02001e-06 [auto_monad_eliminator]: 1.53e-05 [cse]: 3.045e-05 [replace_applicator]: 1.227e-05 [Cycle 2]: 0.00032903, [27] [switch_simplify]: 5.77999e-06 [loop_unroll]: 5.04003e-06 [a_1]: 9.809e-05 [with_stream_mark]: 8.40999e-06 [recompute_prepare]: 6.01e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.23998e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 4.92999e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 4.67e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 2.60002e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.319e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.58001e-06 [inline_without_move]: 4.62998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.81e-06 [cse]: 1.152e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 9.52999e-06 [rewriter_after_opt_a]: 3.632e-05 [convert_after_rewriter]: 7.16999e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00053502 [jit_opt_b]: 5.494e-05, [1] [Cycle 1]: 4.749e-05, [2] [frontend_op_eliminate]: 1.712e-05 [inline_after_opt_a]: 1.752e-05 [cconv]: 2.547e-05 [loop_unroll]: 0.000442 [jit_opt_after_cconv]: 0.00015411, [1] [Cycle 1]: 0.00014732, [11] [c_1]: 2.191e-05 [parameter_eliminate]: 2.71999e-06 [updatestate_depend_eliminate]: 5.05001e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.814e-05 [call_graph_tuple_transform]: 1.796e-05 [tuple_list_get_item_eliminator]: 5.45001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.61e-06 [remove_dup_value]: 1.557e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 6.38e-06 [add_recomputation]: 4.832e-05 [cse_after_recomputation]: 2.243e-05, [1] [Cycle 1]: 1.674e-05, [1] [cse]: 1.096e-05 [auto_monad_reorder]: 1.604e-05 [get_jit_bprop_graph]: 2.08002e-06 [rewriter_after_jit_bprop_graph]: 6.12001e-06 [opt_after_jit_grad]: 0.00046053 [symbol_engine_optimizer]: 7.274e-05, [1] [Cycle 1]: 6.657e-05, [6] [build]: 3.16999e-06 [elim_shapecalc]: 7.85e-06 [elim_not_effective]: 1.284e-05 [opt_reshape]: 5.51e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 3.59985e-07 [validate]: 3.328e-05 Sums bootstrap : 0.000254s : 3.18% type_inference : 0.004160s : 51.98% event_method : 0.000016s : 0.20% auto_monad : 0.000041s : 0.52% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.44% rewriter_before_opt_a : 0.000064s : 0.80% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000067s : 0.84% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000595s : 7.43% jit_opt_a.with_stream_mark : 0.000025s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.10% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.15% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.14% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.37% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.23% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.22% jit_opt_a.inline_without_move : 0.000011s : 0.13% jit_opt_a.renormalize : 0.000620s : 7.74% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.26% jit_opt_a.cse : 0.000042s : 0.52% jit_opt_a.replace_applicator : 0.000018s : 0.22% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000036s : 0.45% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000535s : 6.68% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.21% jit_opt_b.inline_after_opt_a : 0.000018s : 0.22% cconv : 0.000025s : 0.32% loop_unroll : 0.000442s : 5.52% jit_opt_after_cconv.c_1 : 0.000022s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.08% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000048s : 0.60% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000016s : 0.20% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.08% opt_after_jit_grad : 0.000461s : 5.75% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.42% Time group info: ------[substitution.] 0.000166 23 1.27% : 0.000002s : 2: substitution.elim_not_effective 0.91% : 0.000002s : 2: substitution.fold_const_symbol 3.27% : 0.000005s : 3: substitution.graph_param_transform 79.07% : 0.000132s : 4: substitution.inline 1.95% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000004s : 2: substitution.replace_old_param 7.78% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004110 2 80.80% : 0.003321s : 1: type_inference.infer 19.20% : 0.000789s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.52% : 0.000042s : 4: replace.inline 34.48% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 91.68% : 0.000129s : 4: match.inline 8.32% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.27% : 0.000002s : 10: predicate.accumulaten_eliminater 0.91% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 10: predicate.addn_check_dump 1.38% : 0.000002s : 10: predicate.addn_zero_filter 1.80% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000002s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.23% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.55% : 0.000007s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.75% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.30% : 0.000002s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.76% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.40% : 0.000002s : 10: predicate.reshape_eliminate 1.27% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.89% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.51% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000002s : 10: predicate.tile_eliminate 1.39% : 0.000002s : 10: predicate.transpose_eliminate 1.65% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.42% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.82% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000570 13 50.38% : 0.000287s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.56% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.06% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013120 72 0.39% : 0.000052s : 1: add_recomputation 0.34% : 0.000045s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.02% : 0.000266s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.07% : 0.000009s : 1: environ_conv 0.14% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.52% : 0.004923s : 1: jit_opt_a 1.20% : 0.000157s : 1: jit_opt_after_cconv 0.44% : 0.000058s : 1: jit_opt_b 3.43% : 0.000450s : 1: loop_unroll 4.14% : 0.000544s : 1: mutable_eliminate 6.27% : 0.000822s : 26: opt.transform.jit_opt_a 0.37% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.21% : 0.000028s : 4: opt.transform.jit_opt_b 0.11% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000014s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.57% : 0.000468s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000038s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 2.50% : 0.000328s : 1: renormalize.infer 2.17% : 0.000284s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.30% : 0.000039s : 1: rewriter_after_opt_a 0.51% : 0.000067s : 1: rewriter_before_opt_a 0.57% : 0.000075s : 1: symbol_engine_optimizer 31.80% : 0.004172s : 1: type_inference TotalTime = 0.0114395, [30] [bootstrap]: 0.00027411 [type_inference]: 0.00419569 [event_method]: 1.571e-05 [auto_monad]: 6.324e-05 [graph_reusing]: 4.82e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 3.566e-05 [rewriter_before_opt_a]: 6.791e-05 [expand_dump_flag]: 3.4e-06 [jit_opt_a]: 0.00474774, [2] [Cycle 1]: 0.00142607, [27] [switch_simplify]: 4.526e-05 [loop_unroll]: 3.181e-05 [a_1]: 0.00049816 [with_stream_mark]: 1.385e-05 [recompute_prepare]: 6.98998e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.79001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.11997e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.11002e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.42999e-06 [merge_forward]: 4.40999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.18001e-06 [inline_without_move]: 5.61e-06 [renormalize]: 0.00054849 [add_forward_monad_depend]: 4.57e-06 [auto_monad_grad]: 1.67001e-06 [auto_monad_eliminator]: 1.317e-05 [cse]: 1.881e-05 [replace_applicator]: 1.127e-05 [Cycle 2]: 0.00031164, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 4.70999e-06 [a_1]: 9.109e-05 [with_stream_mark]: 8.52998e-06 [recompute_prepare]: 5.21002e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 4.87e-06 [updatestate_useless_node_eliminater]: 4.79e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.19998e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 8.25999e-06 [meta_fg_expand]: 1.50999e-06 [replace_old_param]: 6.86001e-06 [inline_without_move]: 4.59002e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.12999e-06 [cse]: 1.03e-05 [replace_applicator]: 5.44e-06 [py_interpret_to_execute_after_opt_a]: 1.094e-05 [rewriter_after_opt_a]: 3.078e-05 [convert_after_rewriter]: 6.12001e-06 [order_py_execute_after_rewriter]: 4.70001e-06 [mutable_eliminate]: 0.00047964 [jit_opt_b]: 4.775e-05, [1] [Cycle 1]: 4.121e-05, [2] [frontend_op_eliminate]: 1.529e-05 [inline_after_opt_a]: 1.462e-05 [cconv]: 2.205e-05 [loop_unroll]: 0.00040668 [jit_opt_after_cconv]: 0.00013533, [1] [Cycle 1]: 0.00012873, [11] [c_1]: 2.108e-05 [parameter_eliminate]: 2.28002e-06 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.714e-05 [call_graph_tuple_transform]: 1.809e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.31998e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.203e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 5.77999e-06 [add_recomputation]: 4.619e-05 [cse_after_recomputation]: 2.225e-05, [1] [Cycle 1]: 1.676e-05, [1] [cse]: 1.101e-05 [auto_monad_reorder]: 1.264e-05 [get_jit_bprop_graph]: 1.51002e-06 [rewriter_after_jit_bprop_graph]: 4.65999e-06 [opt_after_jit_grad]: 0.00051581 [symbol_engine_optimizer]: 7.171e-05, [1] [Cycle 1]: 6.566e-05, [6] [build]: 2.99999e-06 [elim_shapecalc]: 7.8e-06 [elim_not_effective]: 1.354e-05 [opt_reshape]: 5.71e-06 [fold_const_symbol]: 8.55999e-06 [renormalize]: 3.80009e-07 [validate]: 3.23e-05 Sums bootstrap : 0.000274s : 3.47% type_inference : 0.004196s : 53.16% event_method : 0.000016s : 0.20% auto_monad : 0.000063s : 0.80% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.45% rewriter_before_opt_a : 0.000068s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000051s : 0.64% jit_opt_a.loop_unroll : 0.000037s : 0.46% jit_opt_a.a_1 : 0.000589s : 7.47% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000007s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000549s : 6.95% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.23% jit_opt_a.cse : 0.000029s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000011s : 0.14% rewriter_after_opt_a : 0.000031s : 0.39% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000480s : 6.08% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000022s : 0.28% loop_unroll : 0.000407s : 5.15% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000012s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000046s : 0.59% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000013s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000516s : 6.54% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.41% Time group info: ------[substitution.] 0.000177 23 1.39% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000005s : 3: substitution.graph_param_transform 81.80% : 0.000144s : 4: substitution.inline 1.75% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.69% : 0.000005s : 4: substitution.remove_not_recompute_node 1.76% : 0.000003s : 2: substitution.replace_old_param 6.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004144 2 81.23% : 0.003366s : 1: type_inference.infer 18.77% : 0.000778s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.54% : 0.000043s : 4: replace.inline 33.46% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 92.73% : 0.000142s : 4: match.inline 7.27% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.68% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.18% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.27% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.42% : 0.000002s : 10: predicate.environ_get_depend_swap 1.19% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.00% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.98% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.32% : 0.000003s : 15: predicate.load_eliminater 1.30% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.14% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.82% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.54% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.83% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.22% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.24% : 0.000008s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.34% : 0.000002s : 10: predicate.transpose_eliminate 1.58% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.67% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000567 13 52.60% : 0.000298s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.60% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.80% : 0.000243s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012839 72 0.38% : 0.000049s : 1: add_recomputation 0.52% : 0.000066s : 1: auto_monad 0.12% : 0.000015s : 1: auto_monad_reorder 2.24% : 0.000287s : 1: bootstrap 0.19% : 0.000025s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.14% : 0.000018s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.00% : 0.004751s : 1: jit_opt_a 1.07% : 0.000138s : 1: jit_opt_after_cconv 0.39% : 0.000050s : 1: jit_opt_b 3.22% : 0.000414s : 1: loop_unroll 3.80% : 0.000487s : 1: mutable_eliminate 6.15% : 0.000790s : 26: opt.transform.jit_opt_a 0.36% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000032s : 4: opt.transform.symbol_engine_opt 4.07% : 0.000523s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 2.18% : 0.000280s : 1: renormalize.infer 2.03% : 0.000261s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000033s : 1: rewriter_after_opt_a 0.55% : 0.000071s : 1: rewriter_before_opt_a 0.58% : 0.000074s : 1: symbol_engine_optimizer 32.75% : 0.004206s : 1: type_inference TotalTime = 0.113366, [30] [bootstrap]: 0.00029008 [type_inference]: 0.102815 [event_method]: 1.77e-05 [auto_monad]: 6.033e-05 [graph_reusing]: 5.30001e-06 [pre_auto_parallel]: 2.04e-06 [py_interpret_to_execute]: 0.00039598 [rewriter_before_opt_a]: 7.926e-05 [expand_dump_flag]: 3.06999e-06 [jit_opt_a]: 0.00707503, [2] [Cycle 1]: 0.00338758, [27] [switch_simplify]: 4.963e-05 [loop_unroll]: 3.035e-05 [a_1]: 0.00054601 [with_stream_mark]: 1.39e-05 [recompute_prepare]: 8.03001e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 6.73e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.20002e-06 [meta_shard_fg_expand]: 1.60999e-06 [get_grad_eliminate_]: 6.23998e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 2.663e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 5.96e-06 [renormalize]: 0.00239037 [add_forward_monad_depend]: 7.41001e-06 [auto_monad_grad]: 2.64001e-06 [auto_monad_eliminator]: 1.826e-05 [cse]: 3.047e-05 [replace_applicator]: 2.276e-05 [Cycle 2]: 0.00038577, [27] [switch_simplify]: 7.36999e-06 [loop_unroll]: 6.29001e-06 [a_1]: 0.00012521 [with_stream_mark]: 1.348e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.68e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 1.75001e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 3.16001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.998e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 2.32999e-06 [replace_old_param]: 1.012e-05 [inline_without_move]: 5.58002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.74e-06 [auto_monad_grad]: 1.04998e-06 [auto_monad_eliminator]: 6.04001e-06 [cse]: 1.142e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.322e-05 [rewriter_after_opt_a]: 3.66e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00071468 [jit_opt_b]: 6.18e-05, [1] [Cycle 1]: 5.371e-05, [2] [frontend_op_eliminate]: 2.083e-05 [inline_after_opt_a]: 1.973e-05 [cconv]: 3.038e-05 [loop_unroll]: 0.00052957 [jit_opt_after_cconv]: 0.00017133, [1] [Cycle 1]: 0.0001645, [11] [c_1]: 2.819e-05 [parameter_eliminate]: 3.26999e-06 [updatestate_depend_eliminate]: 6.11998e-06 [updatestate_assign_eliminate]: 4.72e-06 [updatestate_loads_eliminate]: 2.74999e-06 [cse]: 2.985e-05 [call_graph_tuple_transform]: 2.19e-05 [tuple_list_get_item_eliminator]: 7.15003e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 7.09988e-07 [switch_simplify]: 6.16e-06 [remove_dup_value]: 1.644e-05 [partial_unused_args_eliminate]: 2.81e-06 [environ_conv]: 9.45001e-06 [add_recomputation]: 5.283e-05 [cse_after_recomputation]: 2.413e-05, [1] [Cycle 1]: 1.894e-05, [1] [cse]: 1.273e-05 [auto_monad_reorder]: 1.663e-05 [get_jit_bprop_graph]: 2.18998e-06 [rewriter_after_jit_bprop_graph]: 6.59001e-06 [opt_after_jit_grad]: 0.00050924 [symbol_engine_optimizer]: 8.243e-05, [1] [Cycle 1]: 7.638e-05, [6] [build]: 4.72e-06 [elim_shapecalc]: 1.011e-05 [elim_not_effective]: 1.544e-05 [opt_reshape]: 6.33e-06 [fold_const_symbol]: 1.223e-05 [renormalize]: 5.3001e-07 [validate]: 0.00014534 Sums bootstrap : 0.000290s : 0.26% type_inference : 0.102815s : 93.92% event_method : 0.000018s : 0.02% auto_monad : 0.000060s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000396s : 0.36% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000671s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000047s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002390s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000715s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000530s : 0.48% jit_opt_after_cconv.c_1 : 0.000028s : 0.03% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000509s : 0.47% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000145s : 0.13% Time group info: ------[substitution.] 0.000191 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000001s : 2: substitution.fold_const_symbol 3.59% : 0.000007s : 4: substitution.graph_param_transform 81.33% : 0.000155s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.06% : 0.000006s : 4: substitution.remove_not_recompute_node 2.81% : 0.000005s : 2: substitution.replace_old_param 5.67% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102748 2 97.64% : 0.100319s : 1: type_inference.infer 2.36% : 0.002429s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.68% : 0.000048s : 4: replace.inline 33.32% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 94.04% : 0.000152s : 4: match.inline 5.96% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.07% : 0.000001s : 12: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.36% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000003s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.11% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 4: predicate.elim_not_effective 0.77% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.47% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.91% : 0.000008s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000002s : 12: predicate.minmaximum_grad 2.26% : 0.000003s : 4: predicate.mutable_eliminate 0.84% : 0.000001s : 4: predicate.opt_reshape 2.19% : 0.000003s : 18: predicate.partial_eliminate 1.09% : 0.000001s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.31% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.27% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000009s : 58: predicate.switch_simplify 1.15% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.92% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.73% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001949 22 67.31% : 0.001312s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.22% : 0.000609s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116646 72 0.05% : 0.000056s : 1: add_recomputation 0.06% : 0.000064s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.26% : 0.000303s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.07% : 0.007078s : 1: jit_opt_a 0.15% : 0.000175s : 1: jit_opt_after_cconv 0.06% : 0.000064s : 1: jit_opt_b 0.46% : 0.000540s : 1: loop_unroll 0.62% : 0.000725s : 1: mutable_eliminate 0.78% : 0.000910s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000517s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000402s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.45% : 0.001691s : 1: renormalize.infer 0.59% : 0.000690s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 88.16% : 0.102830s : 1: type_inference TotalTime = 0.114193, [30] [bootstrap]: 0.00030609 [type_inference]: 0.103802 [event_method]: 1.836e-05 [auto_monad]: 6.9e-05 [graph_reusing]: 5.39998e-06 [pre_auto_parallel]: 2.78e-06 [py_interpret_to_execute]: 0.0004688 [rewriter_before_opt_a]: 8.191e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00706636, [2] [Cycle 1]: 0.00333316, [27] [switch_simplify]: 5.59e-05 [loop_unroll]: 2.957e-05 [a_1]: 0.00055849 [with_stream_mark]: 1.744e-05 [recompute_prepare]: 8.55999e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 3.24001e-06 [updatestate_loads_eliminate]: 2.95002e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.83998e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.54999e-06 [meta_shard_fg_expand]: 2.51998e-06 [get_grad_eliminate_]: 6.14001e-06 [merge_forward]: 3.96001e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.76998e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 0.00235918 [add_forward_monad_depend]: 4.12e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 1.096e-05 [cse]: 1.928e-05 [replace_applicator]: 1.24e-05 [Cycle 2]: 0.0003604, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00012612 [with_stream_mark]: 7.84002e-06 [recompute_prepare]: 5.86998e-06 [updatestate_depend_eliminate]: 2.51e-06 [updatestate_assign_eliminate]: 1.99e-06 [updatestate_loads_eliminate]: 1.87001e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.65001e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 6.55997e-06 [meta_shard_fg_expand]: 9.50007e-07 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 2.11998e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.258e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 7.9e-06 [inline_without_move]: 5.88998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.71998e-06 [cse]: 1.073e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 8.17e-06 [rewriter_after_opt_a]: 2.623e-05 [convert_after_rewriter]: 6.02001e-06 [order_py_execute_after_rewriter]: 3.71999e-06 [mutable_eliminate]: 0.00060944 [jit_opt_b]: 5.513e-05, [1] [Cycle 1]: 4.872e-05, [2] [frontend_op_eliminate]: 1.95e-05 [inline_after_opt_a]: 1.832e-05 [cconv]: 3.293e-05 [loop_unroll]: 0.00045237 [jit_opt_after_cconv]: 0.00016654, [1] [Cycle 1]: 0.00015927, [11] [c_1]: 2.656e-05 [parameter_eliminate]: 3.51001e-06 [updatestate_depend_eliminate]: 7.11999e-06 [updatestate_assign_eliminate]: 2.64999e-06 [updatestate_loads_eliminate]: 2.62001e-06 [cse]: 3.109e-05 [call_graph_tuple_transform]: 2.225e-05 [tuple_list_get_item_eliminator]: 6.51e-06 [none_parameter_eliminate]: 1.28002e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.393e-05 [partial_unused_args_eliminate]: 2.03002e-06 [environ_conv]: 6.01e-06 [add_recomputation]: 4.877e-05 [cse_after_recomputation]: 2.075e-05, [1] [Cycle 1]: 1.625e-05, [1] [cse]: 1.012e-05 [auto_monad_reorder]: 1.43e-05 [get_jit_bprop_graph]: 2.02999e-06 [rewriter_after_jit_bprop_graph]: 6.94999e-06 [opt_after_jit_grad]: 0.00050963 [symbol_engine_optimizer]: 8.03e-05, [1] [Cycle 1]: 7.157e-05, [6] [build]: 4.1e-06 [elim_shapecalc]: 8.13001e-06 [elim_not_effective]: 1.456e-05 [opt_reshape]: 8.93002e-06 [fold_const_symbol]: 8.48999e-06 [renormalize]: 6.30011e-07 [validate]: 0.00012297 Sums bootstrap : 0.000306s : 0.28% type_inference : 0.103802s : 94.16% event_method : 0.000018s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000469s : 0.43% rewriter_before_opt_a : 0.000082s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000685s : 0.62% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002359s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000026s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000609s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000033s : 0.03% loop_unroll : 0.000452s : 0.41% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000510s : 0.46% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000123s : 0.11% Time group info: ------[substitution.] 0.000193 24 0.54% : 0.000001s : 2: substitution.elim_not_effective 0.48% : 0.000001s : 2: substitution.fold_const_symbol 3.19% : 0.000006s : 4: substitution.graph_param_transform 82.91% : 0.000160s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000005s : 4: substitution.remove_not_recompute_node 2.01% : 0.000004s : 2: substitution.replace_old_param 6.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103730 2 97.47% : 0.101107s : 1: type_inference.infer 2.53% : 0.002623s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.22% : 0.000047s : 4: replace.inline 32.78% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.02% : 0.000157s : 4: match.inline 6.98% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.30% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.37% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000003s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.24% : 0.000002s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 8: predicate.remove_not_recompute_node 1.75% : 0.000002s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.55% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.26% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.22% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.39% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001987 22 65.73% : 0.001306s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.79% : 0.000652s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117461 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.27% : 0.000319s : 1: bootstrap 0.03% : 0.000036s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.02% : 0.007070s : 1: jit_opt_a 0.14% : 0.000169s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.39% : 0.000461s : 1: loop_unroll 0.53% : 0.000617s : 1: mutable_eliminate 0.78% : 0.000913s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.44% : 0.000520s : 1: opt_after_jit_grad 0.00% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.40% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.43% : 0.001674s : 1: renormalize.infer 0.58% : 0.000677s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 88.39% : 0.103821s : 1: type_inference TotalTime = 0.115082, [30] [bootstrap]: 0.00033604 [type_inference]: 0.104506 [event_method]: 1.949e-05 [auto_monad]: 6.993e-05 [graph_reusing]: 7.19001e-06 [pre_auto_parallel]: 3.11001e-06 [py_interpret_to_execute]: 0.00042552 [rewriter_before_opt_a]: 8.445e-05 [expand_dump_flag]: 3.54002e-06 [jit_opt_a]: 0.00721823, [2] [Cycle 1]: 0.00354482, [27] [switch_simplify]: 5.65e-05 [loop_unroll]: 3.055e-05 [a_1]: 0.00056897 [with_stream_mark]: 1.677e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 3.85998e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.84998e-06 [specialize_transform]: 6.67002e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 6.44999e-06 [merge_forward]: 3.94002e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.624e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.86998e-06 [inline_without_move]: 5.99999e-06 [renormalize]: 0.00251491 [add_forward_monad_depend]: 6.19999e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.751e-05 [cse]: 3.445e-05 [replace_applicator]: 1.977e-05 [Cycle 2]: 0.00037215, [27] [switch_simplify]: 6.87002e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00012526 [with_stream_mark]: 1.123e-05 [recompute_prepare]: 6.28998e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.74001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.51002e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 6.06e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.93002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.673e-05 [j_node_and_user_rematch]: 8.90999e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 9.69999e-06 [inline_without_move]: 5.93998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.116e-05 [replace_applicator]: 6.17001e-06 [py_interpret_to_execute_after_opt_a]: 1.217e-05 [rewriter_after_opt_a]: 3.742e-05 [convert_after_rewriter]: 1.93e-05 [order_py_execute_after_rewriter]: 5.34998e-06 [mutable_eliminate]: 0.00068326 [jit_opt_b]: 5.898e-05, [1] [Cycle 1]: 5.096e-05, [2] [frontend_op_eliminate]: 1.936e-05 [inline_after_opt_a]: 1.955e-05 [cconv]: 2.684e-05 [loop_unroll]: 0.00043481 [jit_opt_after_cconv]: 0.00015556, [1] [Cycle 1]: 0.0001491, [11] [c_1]: 2.582e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.76e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 3.3e-06 [cse]: 2.292e-05 [call_graph_tuple_transform]: 2.145e-05 [tuple_list_get_item_eliminator]: 6.32001e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 6.99976e-07 [switch_simplify]: 6.05002e-06 [remove_dup_value]: 1.556e-05 [partial_unused_args_eliminate]: 2.16998e-06 [environ_conv]: 8.08999e-06 [add_recomputation]: 5.059e-05 [cse_after_recomputation]: 2.365e-05, [1] [Cycle 1]: 1.803e-05, [1] [cse]: 1.233e-05 [auto_monad_reorder]: 1.63e-05 [get_jit_bprop_graph]: 3.77998e-06 [rewriter_after_jit_bprop_graph]: 4.90001e-06 [opt_after_jit_grad]: 0.00046964 [symbol_engine_optimizer]: 7.628e-05, [1] [Cycle 1]: 7.033e-05, [6] [build]: 4.11001e-06 [elim_shapecalc]: 8.80999e-06 [elim_not_effective]: 1.424e-05 [opt_reshape]: 6.10002e-06 [fold_const_symbol]: 1.019e-05 [renormalize]: 3.30008e-07 [validate]: 0.00012053 Sums bootstrap : 0.000336s : 0.30% type_inference : 0.104506s : 93.99% event_method : 0.000019s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000426s : 0.38% rewriter_before_opt_a : 0.000084s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000694s : 0.62% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002515s : 2.26% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000019s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000683s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000435s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000470s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000121s : 0.11% Time group info: ------[substitution.] 0.000209 24 1.50% : 0.000003s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 3.14% : 0.000007s : 4: substitution.graph_param_transform 81.10% : 0.000170s : 4: substitution.inline 1.67% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.79% : 0.000006s : 4: substitution.remove_not_recompute_node 2.61% : 0.000005s : 2: substitution.replace_old_param 6.65% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104431 2 97.56% : 0.101885s : 1: type_inference.infer 2.44% : 0.002545s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.11% : 0.000050s : 4: replace.inline 31.89% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 92.94% : 0.000167s : 4: match.inline 7.06% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.12% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.61% : 0.000008s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000003s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.71% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.56% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.92% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.30% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.20% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001963 22 66.14% : 0.001298s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.55% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.31% : 0.000634s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118526 72 0.05% : 0.000053s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.30% : 0.000351s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.02% : 0.000022s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.09% : 0.007222s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.37% : 0.000443s : 1: loop_unroll 0.58% : 0.000692s : 1: mutable_eliminate 0.79% : 0.000935s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000431s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.52% : 0.001799s : 1: renormalize.infer 0.59% : 0.000705s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.08% : 0.000090s : 1: rewriter_before_opt_a 0.07% : 0.000079s : 1: symbol_engine_optimizer 88.19% : 0.104526s : 1: type_inference TotalTime = 0.0116234, [30] [bootstrap]: 0.00028087 [type_inference]: 0.00424806 [event_method]: 1.77e-05 [auto_monad]: 6.502e-05 [graph_reusing]: 4.77e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 3.41e-05 [rewriter_before_opt_a]: 6.842e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00490962, [2] [Cycle 1]: 0.00150503, [27] [switch_simplify]: 4.947e-05 [loop_unroll]: 2.977e-05 [a_1]: 0.00050527 [with_stream_mark]: 1.624e-05 [recompute_prepare]: 7.25e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 3.47002e-06 [updatestate_loads_eliminate]: 2.43998e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 6.35002e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 4.18999e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 8.07e-06 [inline_without_move]: 5.19e-06 [renormalize]: 0.00060141 [add_forward_monad_depend]: 4.99e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.348e-05 [cse]: 2.009e-05 [replace_applicator]: 1.132e-05 [Cycle 2]: 0.00030862, [27] [switch_simplify]: 5.45001e-06 [loop_unroll]: 4.72998e-06 [a_1]: 8.836e-05 [with_stream_mark]: 8.60001e-06 [recompute_prepare]: 4.81002e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.77e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 4.45999e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.168e-05 [j_node_and_user_rematch]: 7.49002e-06 [meta_fg_expand]: 1.51998e-06 [replace_old_param]: 7.5e-06 [inline_without_move]: 4.42998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 1.05999e-06 [auto_monad_eliminator]: 5.47001e-06 [cse]: 1.058e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 9.20001e-06 [rewriter_after_opt_a]: 3.383e-05 [convert_after_rewriter]: 6.93998e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00048224 [jit_opt_b]: 4.831e-05, [1] [Cycle 1]: 4.172e-05, [2] [frontend_op_eliminate]: 1.585e-05 [inline_after_opt_a]: 1.509e-05 [cconv]: 2.637e-05 [loop_unroll]: 0.00040507 [jit_opt_after_cconv]: 0.00014524, [1] [Cycle 1]: 0.00013908, [11] [c_1]: 2.071e-05 [parameter_eliminate]: 2.24999e-06 [updatestate_depend_eliminate]: 4.94998e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.716e-05 [call_graph_tuple_transform]: 2.646e-05 [tuple_list_get_item_eliminator]: 5.51002e-06 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 1.524e-05 [partial_unused_args_eliminate]: 2.16e-06 [environ_conv]: 5.38002e-06 [add_recomputation]: 4.765e-05 [cse_after_recomputation]: 2.223e-05, [1] [Cycle 1]: 1.676e-05, [1] [cse]: 1.137e-05 [auto_monad_reorder]: 1.453e-05 [get_jit_bprop_graph]: 2.29999e-06 [rewriter_after_jit_bprop_graph]: 4.2e-06 [opt_after_jit_grad]: 0.00043996 [symbol_engine_optimizer]: 7.031e-05, [1] [Cycle 1]: 6.361e-05, [6] [build]: 2.89999e-06 [elim_shapecalc]: 7.65e-06 [elim_not_effective]: 1.221e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.1e-06 [renormalize]: 2.79979e-07 [validate]: 3.337e-05 Sums bootstrap : 0.000281s : 3.53% type_inference : 0.004248s : 53.32% event_method : 0.000018s : 0.22% auto_monad : 0.000065s : 0.82% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000034s : 0.43% rewriter_before_opt_a : 0.000068s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.43% jit_opt_a.a_1 : 0.000594s : 7.45% jit_opt_a.with_stream_mark : 0.000025s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000601s : 7.55% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.24% jit_opt_a.cse : 0.000031s : 0.38% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000009s : 0.12% rewriter_after_opt_a : 0.000034s : 0.42% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000482s : 6.05% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000026s : 0.33% loop_unroll : 0.000405s : 5.08% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000026s : 0.33% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000048s : 0.60% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000440s : 5.52% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.42% Time group info: ------[substitution.] 0.000194 23 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.65% : 0.000001s : 2: substitution.fold_const_symbol 7.02% : 0.000014s : 3: substitution.graph_param_transform 78.89% : 0.000153s : 4: substitution.inline 1.82% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.22% : 0.000004s : 4: substitution.remove_not_recompute_node 2.13% : 0.000004s : 2: substitution.replace_old_param 6.23% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004192 2 81.09% : 0.003399s : 1: type_inference.infer 18.91% : 0.000793s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.37% : 0.000045s : 4: replace.inline 31.63% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.15% : 0.000150s : 4: match.inline 6.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.49% : 0.000002s : 10: predicate.compare_switch_simplify 1.38% : 0.000002s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.34% : 0.000000s : 3: predicate.graph_param_transform 5.40% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 6: predicate.less_batch_normalization 1.39% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.24% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.30% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.84% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.63% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.27% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.53% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.94% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000559 13 51.01% : 0.000285s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.13% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.85% : 0.000245s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013085 72 0.39% : 0.000051s : 1: add_recomputation 0.52% : 0.000068s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.26% : 0.000295s : 1: bootstrap 0.22% : 0.000029s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.55% : 0.004913s : 1: jit_opt_a 1.13% : 0.000148s : 1: jit_opt_after_cconv 0.49% : 0.000064s : 1: jit_opt_b 3.15% : 0.000413s : 1: loop_unroll 3.75% : 0.000491s : 1: mutable_eliminate 6.07% : 0.000794s : 26: opt.transform.jit_opt_a 0.42% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000447s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000037s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.39% : 0.000313s : 1: renormalize.infer 2.15% : 0.000282s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000037s : 1: rewriter_after_opt_a 0.54% : 0.000071s : 1: rewriter_before_opt_a 0.56% : 0.000073s : 1: symbol_engine_optimizer 32.55% : 0.004259s : 1: type_inference TotalTime = 0.156327, [30] [bootstrap]: 0.00027185 [type_inference]: 0.146048 [event_method]: 1.812e-05 [auto_monad]: 5.837e-05 [graph_reusing]: 5.12e-06 [pre_auto_parallel]: 1.81e-06 [py_interpret_to_execute]: 0.00042131 [rewriter_before_opt_a]: 7.911e-05 [expand_dump_flag]: 2.64999e-06 [jit_opt_a]: 0.00710812, [2] [Cycle 1]: 0.00347934, [27] [switch_simplify]: 5.035e-05 [loop_unroll]: 2.974e-05 [a_1]: 0.0005539 [with_stream_mark]: 1.404e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.19e-06 [specialize_transform]: 6.79001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.50998e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 9.67001e-06 [meta_fg_expand]: 1.84998e-06 [replace_old_param]: 9.24e-06 [inline_without_move]: 6.11998e-06 [renormalize]: 0.0025012 [add_forward_monad_depend]: 6.43998e-06 [auto_monad_grad]: 2.32001e-06 [auto_monad_eliminator]: 1.567e-05 [cse]: 2.691e-05 [replace_applicator]: 1.775e-05 [Cycle 2]: 0.00037028, [27] [switch_simplify]: 6.69001e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00012689 [with_stream_mark]: 1.207e-05 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 5.52001e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.74e-06 [meta_shard_fg_expand]: 1.72001e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 2.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.627e-05 [j_node_and_user_rematch]: 9.46e-06 [meta_fg_expand]: 1.82001e-06 [replace_old_param]: 9.33002e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.50006e-07 [auto_monad_eliminator]: 5.74999e-06 [cse]: 1.085e-05 [replace_applicator]: 5.40999e-06 [py_interpret_to_execute_after_opt_a]: 1.158e-05 [rewriter_after_opt_a]: 3.301e-05 [convert_after_rewriter]: 6.24001e-06 [order_py_execute_after_rewriter]: 1.832e-05 [mutable_eliminate]: 0.00063415 [jit_opt_b]: 5.627e-05, [1] [Cycle 1]: 4.924e-05, [2] [frontend_op_eliminate]: 1.979e-05 [inline_after_opt_a]: 1.878e-05 [cconv]: 2.615e-05 [loop_unroll]: 0.00042116 [jit_opt_after_cconv]: 0.00015304, [1] [Cycle 1]: 0.00014613, [11] [c_1]: 2.595e-05 [parameter_eliminate]: 2.58e-06 [updatestate_depend_eliminate]: 5.49998e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 2.145e-05 [call_graph_tuple_transform]: 2.145e-05 [tuple_list_get_item_eliminator]: 6.42001e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 7.10017e-07 [switch_simplify]: 6.01e-06 [remove_dup_value]: 1.433e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 9.02e-06 [add_recomputation]: 5.043e-05 [cse_after_recomputation]: 2.397e-05, [1] [Cycle 1]: 1.649e-05, [1] [cse]: 1.058e-05 [auto_monad_reorder]: 1.498e-05 [get_jit_bprop_graph]: 1.90001e-06 [rewriter_after_jit_bprop_graph]: 4.76002e-06 [opt_after_jit_grad]: 0.00054216 [symbol_engine_optimizer]: 7.532e-05, [1] [Cycle 1]: 6.883e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 8.62e-06 [elim_not_effective]: 1.336e-05 [opt_reshape]: 6.46999e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 4.60015e-07 [validate]: 4.148e-05 Sums bootstrap : 0.000272s : 0.18% type_inference : 0.146048s : 95.77% event_method : 0.000018s : 0.01% auto_monad : 0.000058s : 0.04% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000421s : 0.28% rewriter_before_opt_a : 0.000079s : 0.05% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.04% jit_opt_a.loop_unroll : 0.000036s : 0.02% jit_opt_a.a_1 : 0.000681s : 0.45% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.01% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002501s : 1.64% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.00% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.01% jit_opt_a.cse : 0.000038s : 0.02% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000033s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000018s : 0.01% mutable_eliminate : 0.000634s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.01% jit_opt_b.inline_after_opt_a : 0.000019s : 0.01% cconv : 0.000026s : 0.02% loop_unroll : 0.000421s : 0.28% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.01% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.01% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.00% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.00% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000542s : 0.36% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.00% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.03% Time group info: ------[substitution.] 0.000195 24 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 3.26% : 0.000006s : 4: substitution.graph_param_transform 83.19% : 0.000162s : 4: substitution.inline 1.91% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000005s : 4: substitution.remove_not_recompute_node 2.22% : 0.000004s : 2: substitution.replace_old_param 5.43% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.145977 2 98.33% : 0.143543s : 1: type_inference.infer 1.67% : 0.002435s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.26% : 0.000045s : 4: replace.inline 33.74% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 94.42% : 0.000160s : 4: match.inline 5.58% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.39% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.29% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.14% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.99% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 2.30% : 0.000003s : 22: predicate.replace_applicator 1.21% : 0.000002s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.01% : 0.000009s : 58: predicate.switch_simplify 1.53% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 2.04% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002098 22 67.90% : 0.001425s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.47% : 0.000639s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.159812 72 0.03% : 0.000053s : 1: add_recomputation 0.04% : 0.000062s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.18% : 0.000286s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.01% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000007s : 1: graph_reusing 4.45% : 0.007111s : 1: jit_opt_a 0.10% : 0.000155s : 1: jit_opt_after_cconv 0.04% : 0.000058s : 1: jit_opt_b 0.27% : 0.000429s : 1: loop_unroll 0.40% : 0.000643s : 1: mutable_eliminate 0.57% : 0.000910s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.02% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.34% : 0.000551s : 1: opt_after_jit_grad 0.01% : 0.000021s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000428s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.12% : 0.001787s : 1: renormalize.infer 0.44% : 0.000705s : 1: renormalize.specialize 0.00% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000036s : 1: rewriter_after_opt_a 0.05% : 0.000084s : 1: rewriter_before_opt_a 0.05% : 0.000078s : 1: symbol_engine_optimizer 91.40% : 0.146063s : 1: type_inference TotalTime = 0.0640813, [30] [bootstrap]: 0.00029443 [type_inference]: 0.0536903 [event_method]: 1.972e-05 [auto_monad]: 7.083e-05 [graph_reusing]: 6.35002e-06 [pre_auto_parallel]: 2.20002e-06 [py_interpret_to_execute]: 0.00026394 [rewriter_before_opt_a]: 8.506e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00747548, [2] [Cycle 1]: 0.00286137, [27] [switch_simplify]: 5.021e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.00056154 [with_stream_mark]: 1.317e-05 [recompute_prepare]: 8.79e-06 [updatestate_depend_eliminate]: 3.13998e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.43002e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 7.28e-06 [updatestate_useless_node_eliminater]: 6.76e-06 [accelerated_algorithm]: 6.69999e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.54001e-06 [merge_forward]: 3.29001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.382e-05 [j_node_and_user_rematch]: 1.095e-05 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 9.91e-06 [inline_without_move]: 6.12001e-06 [renormalize]: 0.0018794 [add_forward_monad_depend]: 4.82998e-06 [auto_monad_grad]: 1.14e-06 [auto_monad_eliminator]: 1.283e-05 [cse]: 2.146e-05 [replace_applicator]: 1.397e-05 [Cycle 2]: 0.000361, [27] [switch_simplify]: 6.59999e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.00012171 [with_stream_mark]: 9.37001e-06 [recompute_prepare]: 6.14001e-06 [updatestate_depend_eliminate]: 2.93e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 6.17001e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 6.07999e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 2.47001e-06 [cell_reuse_recompute_pass]: 2.07999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 2.05002e-06 [replace_old_param]: 8.56002e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.22e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 5.86e-06 [cse]: 1.152e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 9.22001e-06 [rewriter_after_opt_a]: 2.881e-05 [convert_after_rewriter]: 5.96e-06 [order_py_execute_after_rewriter]: 4.22998e-06 [mutable_eliminate]: 0.00057672 [jit_opt_b]: 5.29e-05, [1] [Cycle 1]: 4.627e-05, [2] [frontend_op_eliminate]: 1.851e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 1.522e-05 [loop_unroll]: 0.00042148 [jit_opt_after_cconv]: 0.00014689, [1] [Cycle 1]: 0.00014066, [11] [c_1]: 2.517e-05 [parameter_eliminate]: 2.34999e-06 [updatestate_depend_eliminate]: 5.39998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.071e-05 [call_graph_tuple_transform]: 1.992e-05 [tuple_list_get_item_eliminator]: 5.89e-06 [none_parameter_eliminate]: 9.89996e-07 [renormalize]: 8.89995e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 8.84998e-06 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 5.81998e-06 [add_recomputation]: 3.278e-05 [cse_after_recomputation]: 2.167e-05, [1] [Cycle 1]: 1.644e-05, [1] [cse]: 1.092e-05 [auto_monad_reorder]: 9.84001e-06 [get_jit_bprop_graph]: 1.32999e-06 [rewriter_after_jit_bprop_graph]: 5.07e-06 [opt_after_jit_grad]: 0.00052598 [symbol_engine_optimizer]: 8.717e-05, [1] [Cycle 1]: 8.136e-05, [6] [build]: 2.67001e-06 [elim_shapecalc]: 8.63001e-06 [elim_not_effective]: 1.316e-05 [opt_reshape]: 6.59001e-06 [fold_const_symbol]: 2.269e-05 [renormalize]: 4.00003e-07 [validate]: 3.524e-05 Sums bootstrap : 0.000294s : 0.50% type_inference : 0.053690s : 90.61% event_method : 0.000020s : 0.03% auto_monad : 0.000071s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000264s : 0.45% rewriter_before_opt_a : 0.000085s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000057s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000683s : 1.15% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001879s : 3.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000029s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000577s : 0.97% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000015s : 0.03% loop_unroll : 0.000421s : 0.71% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000033s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000526s : 0.89% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000023s : 0.04% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000206 24 0.69% : 0.000001s : 2: substitution.elim_not_effective 7.07% : 0.000015s : 2: substitution.fold_const_symbol 2.58% : 0.000005s : 4: substitution.graph_param_transform 77.43% : 0.000159s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000006s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 5.97% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053607 2 96.57% : 0.051771s : 1: type_inference.infer 3.43% : 0.001836s : 1: type_inference.specialize ------[replace.] 0.000069 6 65.90% : 0.000045s : 4: replace.inline 34.10% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.38% : 0.000157s : 4: match.inline 6.62% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.15% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.31% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000002s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.07% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.56% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000003s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.11% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.48% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.79% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.20% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.85% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.45% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.94% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002160 26 72.85% : 0.001574s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.83% : 0.000558s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066962 72 0.05% : 0.000035s : 1: add_recomputation 0.11% : 0.000074s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.46% : 0.000311s : 1: bootstrap 0.03% : 0.000018s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 11.17% : 0.007479s : 1: jit_opt_a 0.22% : 0.000149s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.64% : 0.000429s : 1: loop_unroll 0.87% : 0.000585s : 1: mutable_eliminate 1.36% : 0.000912s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000535s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000270s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000011s : 1: remove_dup_value 1.91% : 0.001278s : 1: renormalize.infer 0.89% : 0.000594s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.13% : 0.000090s : 1: symbol_engine_optimizer 80.20% : 0.053704s : 1: type_inference TotalTime = 0.0122891, [30] [bootstrap]: 0.00027881 [type_inference]: 0.00439509 [event_method]: 1.78e-05 [auto_monad]: 6.844e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.14e-06 [py_interpret_to_execute]: 4.373e-05 [rewriter_before_opt_a]: 7.442e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.00530964, [2] [Cycle 1]: 0.00159008, [27] [switch_simplify]: 5.463e-05 [loop_unroll]: 2.956e-05 [a_1]: 0.00052135 [with_stream_mark]: 1.653e-05 [recompute_prepare]: 7.64002e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 3.13e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.14003e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.334e-05 [j_node_and_user_rematch]: 8.89998e-06 [meta_fg_expand]: 2.16998e-06 [replace_old_param]: 9.42999e-06 [inline_without_move]: 5.29e-06 [renormalize]: 0.00066167 [add_forward_monad_depend]: 5.93002e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.393e-05 [cse]: 1.992e-05 [replace_applicator]: 1.166e-05 [Cycle 2]: 0.00031203, [27] [switch_simplify]: 5.49e-06 [loop_unroll]: 4.89e-06 [a_1]: 8.951e-05 [with_stream_mark]: 8.62998e-06 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.58003e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.02999e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.11002e-06 [get_grad_eliminate_]: 4.43999e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.38002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 7.38e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.44002e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.10019e-07 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 5.43002e-06 [cse]: 1.003e-05 [replace_applicator]: 5.29998e-06 [py_interpret_to_execute_after_opt_a]: 1.019e-05 [rewriter_after_opt_a]: 3.357e-05 [convert_after_rewriter]: 6.93e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00051614 [jit_opt_b]: 4.814e-05, [1] [Cycle 1]: 4.169e-05, [2] [frontend_op_eliminate]: 1.513e-05 [inline_after_opt_a]: 1.538e-05 [cconv]: 2.521e-05 [loop_unroll]: 0.0004116 [jit_opt_after_cconv]: 0.00014117, [1] [Cycle 1]: 0.00013495, [11] [c_1]: 2.124e-05 [parameter_eliminate]: 2.40002e-06 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.04e-05 [call_graph_tuple_transform]: 1.88e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 4.59986e-07 [switch_simplify]: 5.34e-06 [remove_dup_value]: 1.512e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 5.77001e-06 [add_recomputation]: 9.631e-05 [cse_after_recomputation]: 2.365e-05, [1] [Cycle 1]: 1.804e-05, [1] [cse]: 1.23e-05 [auto_monad_reorder]: 1.51e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00045068 [symbol_engine_optimizer]: 6.999e-05, [1] [Cycle 1]: 6.422e-05, [6] [build]: 3.54002e-06 [elim_shapecalc]: 7.56999e-06 [elim_not_effective]: 1.213e-05 [opt_reshape]: 5.61e-06 [fold_const_symbol]: 8.60999e-06 [renormalize]: 3.39991e-07 [validate]: 3.458e-05 Sums bootstrap : 0.000279s : 3.35% type_inference : 0.004395s : 52.83% event_method : 0.000018s : 0.21% auto_monad : 0.000068s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000044s : 0.53% rewriter_before_opt_a : 0.000074s : 0.89% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000060s : 0.72% jit_opt_a.loop_unroll : 0.000034s : 0.41% jit_opt_a.a_1 : 0.000611s : 7.34% jit_opt_a.with_stream_mark : 0.000025s : 0.30% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000662s : 7.95% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000030s : 0.36% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000034s : 0.40% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000516s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.30% loop_unroll : 0.000412s : 4.95% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000096s : 1.16% cse_after_recomputation.cse : 0.000012s : 0.15% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000451s : 5.42% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.42% Time group info: ------[substitution.] 0.000195 23 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 3: substitution.graph_param_transform 82.97% : 0.000162s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.42% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004324 2 80.76% : 0.003492s : 1: type_inference.infer 19.24% : 0.000832s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.99% : 0.000046s : 4: replace.inline 32.01% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 93.33% : 0.000159s : 4: match.inline 6.67% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 2.21% : 0.000003s : 10: predicate.arithmetic_simplify 1.54% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.23% : 0.000001s : 10: predicate.compare_switch_simplify 1.10% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.52% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.07% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 1.10% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.66% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.80% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.30% : 0.000001s : 10: predicate.transpose_eliminate 1.41% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.53% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.86% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.62% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.84% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.87% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000574 13 50.13% : 0.000288s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.05% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.82% : 0.000257s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013828 72 0.72% : 0.000100s : 1: add_recomputation 0.52% : 0.000072s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.12% : 0.000294s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.12% : 0.000016s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.42% : 0.005313s : 1: jit_opt_a 1.04% : 0.000144s : 1: jit_opt_after_cconv 0.37% : 0.000051s : 1: jit_opt_b 3.04% : 0.000420s : 1: loop_unroll 3.79% : 0.000525s : 1: mutable_eliminate 5.92% : 0.000818s : 26: opt.transform.jit_opt_a 0.34% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000459s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000046s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.50% : 0.000346s : 1: renormalize.infer 2.23% : 0.000308s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.56% : 0.000078s : 1: rewriter_before_opt_a 0.52% : 0.000073s : 1: symbol_engine_optimizer 31.88% : 0.004409s : 1: type_inference TotalTime = 0.0123515, [30] [bootstrap]: 0.00025887 [type_inference]: 0.00468668 [event_method]: 1.656e-05 [auto_monad]: 5.451e-05 [graph_reusing]: 4.82998e-06 [pre_auto_parallel]: 1.92001e-06 [py_interpret_to_execute]: 4.027e-05 [rewriter_before_opt_a]: 6.898e-05 [expand_dump_flag]: 2.48e-06 [jit_opt_a]: 0.00518637, [2] [Cycle 1]: 0.00158829, [27] [switch_simplify]: 4.844e-05 [loop_unroll]: 3.069e-05 [a_1]: 0.00048951 [with_stream_mark]: 1.238e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 6.07001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.46002e-06 [meta_shard_fg_expand]: 1.31002e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.02002e-06 [cell_reuse_recompute_pass]: 8.59989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.318e-05 [j_node_and_user_rematch]: 8.37998e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.23002e-06 [renormalize]: 0.00071135 [add_forward_monad_depend]: 4.3e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.217e-05 [cse]: 1.953e-05 [replace_applicator]: 1.188e-05 [Cycle 2]: 0.00031695, [27] [switch_simplify]: 5.67999e-06 [loop_unroll]: 5.27001e-06 [a_1]: 9.817e-05 [with_stream_mark]: 7.89002e-06 [recompute_prepare]: 5.24998e-06 [updatestate_depend_eliminate]: 2.64001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 4.97e-06 [updatestate_useless_node_eliminater]: 4.95001e-06 [accelerated_algorithm]: 4.75999e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.189e-05 [j_node_and_user_rematch]: 7.75e-06 [meta_fg_expand]: 1.42999e-06 [replace_old_param]: 7.01001e-06 [inline_without_move]: 4.89998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 8.00006e-07 [auto_monad_eliminator]: 5.37999e-06 [cse]: 1.04e-05 [replace_applicator]: 4.84e-06 [py_interpret_to_execute_after_opt_a]: 8.70001e-06 [rewriter_after_opt_a]: 3.007e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 4.50001e-06 [mutable_eliminate]: 0.00052908 [jit_opt_b]: 4.986e-05, [1] [Cycle 1]: 4.318e-05, [2] [frontend_op_eliminate]: 1.668e-05 [inline_after_opt_a]: 1.558e-05 [cconv]: 2.122e-05 [loop_unroll]: 0.00041455 [jit_opt_after_cconv]: 0.00015138, [1] [Cycle 1]: 0.00014508, [11] [c_1]: 2.077e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.68e-06 [cse]: 2.016e-05 [call_graph_tuple_transform]: 1.799e-05 [tuple_list_get_item_eliminator]: 5.43002e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 6.60017e-07 [switch_simplify]: 1.73e-05 [remove_dup_value]: 1.188e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 4.68001e-06 [add_recomputation]: 3.968e-05 [cse_after_recomputation]: 2.192e-05, [1] [Cycle 1]: 1.66e-05, [1] [cse]: 1.098e-05 [auto_monad_reorder]: 1.259e-05 [get_jit_bprop_graph]: 1.63997e-06 [rewriter_after_jit_bprop_graph]: 4.72e-06 [opt_after_jit_grad]: 0.00045757 [symbol_engine_optimizer]: 6.907e-05, [1] [Cycle 1]: 6.321e-05, [6] [build]: 2.91e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.225e-05 [opt_reshape]: 5.40001e-06 [fold_const_symbol]: 8.28001e-06 [renormalize]: 3.49974e-07 [validate]: 3.366e-05 Sums bootstrap : 0.000259s : 3.04% type_inference : 0.004687s : 54.95% event_method : 0.000017s : 0.19% auto_monad : 0.000055s : 0.64% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000040s : 0.47% rewriter_before_opt_a : 0.000069s : 0.81% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.63% jit_opt_a.loop_unroll : 0.000036s : 0.42% jit_opt_a.a_1 : 0.000588s : 6.89% jit_opt_a.with_stream_mark : 0.000020s : 0.24% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000711s : 8.34% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.21% jit_opt_a.cse : 0.000030s : 0.35% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.10% rewriter_after_opt_a : 0.000030s : 0.35% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000529s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000021s : 0.25% loop_unroll : 0.000415s : 4.86% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000020s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000017s : 0.20% remove_dup_value : 0.000012s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.05% add_recomputation : 0.000040s : 0.47% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000013s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000458s : 5.36% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.39% Time group info: ------[substitution.] 0.000166 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.55% : 0.000004s : 3: substitution.graph_param_transform 83.08% : 0.000138s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.34% : 0.000006s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 5.28% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004629 2 80.21% : 0.003713s : 1: type_inference.infer 19.79% : 0.000916s : 1: type_inference.specialize ------[replace.] 0.000062 6 67.23% : 0.000042s : 4: replace.inline 32.77% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 94.68% : 0.000136s : 4: match.inline 5.32% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.37% : 0.000002s : 10: predicate.addn_zero_filter 1.99% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.70% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.14% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.27% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000000s : 3: predicate.graph_param_transform 5.65% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 6: predicate.less_batch_normalization 1.58% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.31% : 0.000002s : 3: predicate.mutable_eliminate 0.47% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.84% : 0.000002s : 10: predicate.reduce_eliminate 1.43% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.76% : 0.000002s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.55% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.37% : 0.000008s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.67% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000682 13 46.04% : 0.000314s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.09% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.87% : 0.000340s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013929 72 0.31% : 0.000043s : 1: add_recomputation 0.41% : 0.000058s : 1: auto_monad 0.11% : 0.000015s : 1: auto_monad_reorder 1.97% : 0.000274s : 1: bootstrap 0.17% : 0.000024s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.25% : 0.005189s : 1: jit_opt_a 1.11% : 0.000154s : 1: jit_opt_after_cconv 0.37% : 0.000052s : 1: jit_opt_b 3.03% : 0.000422s : 1: loop_unroll 3.85% : 0.000536s : 1: mutable_eliminate 5.68% : 0.000791s : 26: opt.transform.jit_opt_a 0.41% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.34% : 0.000466s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000043s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000014s : 1: remove_dup_value 2.40% : 0.000334s : 1: renormalize.infer 2.66% : 0.000371s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000033s : 1: rewriter_after_opt_a 0.52% : 0.000072s : 1: rewriter_before_opt_a 0.51% : 0.000072s : 1: symbol_engine_optimizer 33.74% : 0.004699s : 1: type_inference TotalTime = 0.119306, [30] [bootstrap]: 0.00025185 [type_inference]: 0.108155 [event_method]: 1.864e-05 [auto_monad]: 7.419e-05 [graph_reusing]: 5.71998e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 0.00043345 [rewriter_before_opt_a]: 8.27e-05 [expand_dump_flag]: 3.76999e-06 [jit_opt_a]: 0.0079022, [2] [Cycle 1]: 0.00373244, [27] [switch_simplify]: 5.958e-05 [loop_unroll]: 3.063e-05 [a_1]: 0.00059938 [with_stream_mark]: 2.21e-05 [recompute_prepare]: 1.003e-05 [updatestate_depend_eliminate]: 4.42e-06 [updatestate_assign_eliminate]: 4.06001e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 7.52002e-06 [updatestate_useless_node_eliminater]: 6.48e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.43998e-06 [merge_forward]: 3.98999e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.785e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.062e-05 [inline_without_move]: 6.06e-06 [renormalize]: 0.00264048 [add_forward_monad_depend]: 7.05998e-06 [auto_monad_grad]: 2.68998e-06 [auto_monad_eliminator]: 1.95e-05 [cse]: 3.238e-05 [replace_applicator]: 2.126e-05 [Cycle 2]: 0.0003787, [27] [switch_simplify]: 6.70998e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00012464 [with_stream_mark]: 1.352e-05 [recompute_prepare]: 6.02999e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.50002e-06 [parameter_eliminate]: 1.61998e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 2.43e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.735e-05 [j_node_and_user_rematch]: 9.55001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.15001e-06 [inline_without_move]: 5.41998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.16997e-06 [auto_monad_grad]: 1.30999e-06 [auto_monad_eliminator]: 6.54001e-06 [cse]: 1.164e-05 [replace_applicator]: 5.72001e-06 [py_interpret_to_execute_after_opt_a]: 1.241e-05 [rewriter_after_opt_a]: 3.625e-05 [convert_after_rewriter]: 7.37997e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00067579 [jit_opt_b]: 5.685e-05, [1] [Cycle 1]: 4.974e-05, [2] [frontend_op_eliminate]: 1.943e-05 [inline_after_opt_a]: 1.925e-05 [cconv]: 2.606e-05 [loop_unroll]: 0.00044413 [jit_opt_after_cconv]: 0.0001572, [1] [Cycle 1]: 0.00015082, [11] [c_1]: 2.624e-05 [parameter_eliminate]: 2.56998e-06 [updatestate_depend_eliminate]: 6.11e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.507e-05 [call_graph_tuple_transform]: 2.15e-05 [tuple_list_get_item_eliminator]: 6.54001e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.82999e-06 [remove_dup_value]: 1.543e-05 [partial_unused_args_eliminate]: 2.23998e-06 [environ_conv]: 8.97999e-06 [add_recomputation]: 4.894e-05 [cse_after_recomputation]: 2.26e-05, [1] [Cycle 1]: 1.708e-05, [1] [cse]: 1.124e-05 [auto_monad_reorder]: 1.6e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 5.27001e-06 [opt_after_jit_grad]: 0.00048096 [symbol_engine_optimizer]: 0.00013732, [1] [Cycle 1]: 8.91e-05, [6] [build]: 3.77002e-06 [elim_shapecalc]: 1.062e-05 [elim_not_effective]: 1.401e-05 [opt_reshape]: 6.17001e-06 [fold_const_symbol]: 2.572e-05 [renormalize]: 3.19997e-07 [validate]: 4.262e-05 Sums bootstrap : 0.000252s : 0.22% type_inference : 0.108155s : 94.15% event_method : 0.000019s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000433s : 0.38% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000724s : 0.63% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002641s : 2.30% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000676s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000444s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000481s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000026s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000227 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.84% : 0.000006s : 4: substitution.graph_param_transform 83.04% : 0.000189s : 4: substitution.inline 1.48% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 2.49% : 0.000006s : 2: substitution.replace_old_param 6.26% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108080 2 97.61% : 0.105493s : 1: type_inference.infer 2.39% : 0.002587s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.45% : 0.000049s : 4: replace.inline 33.55% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000199 6 93.45% : 0.000186s : 4: match.inline 6.55% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.42% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.30% : 0.000002s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.81% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.68% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.66% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.46% : 0.000001s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.54% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.41% : 0.000002s : 4: predicate.mutable_eliminate 0.65% : 0.000001s : 4: predicate.opt_reshape 2.59% : 0.000004s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.89% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.30% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.17% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 1.11% : 0.000002s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.02% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.33% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.34% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.34% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.77% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001980 22 64.09% : 0.001269s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.99% : 0.000039s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.93% : 0.000672s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123010 72 0.04% : 0.000052s : 1: add_recomputation 0.06% : 0.000078s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000265s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.43% : 0.007906s : 1: jit_opt_a 0.13% : 0.000160s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.37% : 0.000452s : 1: loop_unroll 0.56% : 0.000684s : 1: mutable_eliminate 0.79% : 0.000973s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000054s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000439s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.53% : 0.001883s : 1: renormalize.infer 0.61% : 0.000747s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000140s : 1: symbol_engine_optimizer 87.94% : 0.108172s : 1: type_inference TotalTime = 0.113337, [30] [bootstrap]: 0.00030603 [type_inference]: 0.103292 [event_method]: 1.782e-05 [auto_monad]: 6.304e-05 [graph_reusing]: 5.44998e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00042804 [rewriter_before_opt_a]: 7.746e-05 [expand_dump_flag]: 3.85e-06 [jit_opt_a]: 0.0068923, [2] [Cycle 1]: 0.0032701, [27] [switch_simplify]: 4.827e-05 [loop_unroll]: 3.003e-05 [a_1]: 0.00054577 [with_stream_mark]: 1.365e-05 [recompute_prepare]: 8.02998e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.64999e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 6.48e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 1.87999e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 3.08e-06 [cell_reuse_recompute_pass]: 8.40024e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 9.19998e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.32999e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.00232856 [add_forward_monad_depend]: 5.87999e-06 [auto_monad_grad]: 2.44001e-06 [auto_monad_eliminator]: 1.575e-05 [cse]: 2.158e-05 [replace_applicator]: 1.276e-05 [Cycle 2]: 0.00035722, [27] [switch_simplify]: 6.48998e-06 [loop_unroll]: 5.96998e-06 [a_1]: 0.00012043 [with_stream_mark]: 1.033e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 3.45998e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.36002e-06 [get_grad_eliminate_]: 5.69999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.79998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.473e-05 [j_node_and_user_rematch]: 8.60999e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.61e-06 [renormalize]: 1.10012e-07 [add_forward_monad_depend]: 1.02e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.156e-05 [replace_applicator]: 5.61998e-06 [py_interpret_to_execute_after_opt_a]: 9.67999e-06 [rewriter_after_opt_a]: 3.441e-05 [convert_after_rewriter]: 7.06999e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00058131 [jit_opt_b]: 5.475e-05, [1] [Cycle 1]: 4.795e-05, [2] [frontend_op_eliminate]: 1.853e-05 [inline_after_opt_a]: 1.823e-05 [cconv]: 2.52e-05 [loop_unroll]: 0.00042672 [jit_opt_after_cconv]: 0.00014806, [1] [Cycle 1]: 0.00014139, [11] [c_1]: 2.597e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.032e-05 [call_graph_tuple_transform]: 1.94e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 1.51002e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.555e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 8.59998e-06 [add_recomputation]: 4.45e-05 [cse_after_recomputation]: 2.249e-05, [1] [Cycle 1]: 1.676e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.384e-05 [get_jit_bprop_graph]: 1.85001e-06 [rewriter_after_jit_bprop_graph]: 4.78001e-06 [opt_after_jit_grad]: 0.00047086 [symbol_engine_optimizer]: 7.779e-05, [1] [Cycle 1]: 7.194e-05, [6] [build]: 3.14001e-06 [elim_shapecalc]: 9.82999e-06 [elim_not_effective]: 1.498e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 1.026e-05 [renormalize]: 4.20026e-07 [validate]: 0.00012604 Sums bootstrap : 0.000306s : 0.28% type_inference : 0.103292s : 94.31% event_method : 0.000018s : 0.02% auto_monad : 0.000063s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000428s : 0.39% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000666s : 0.61% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002329s : 2.13% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000581s : 0.53% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000427s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000471s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000126s : 0.12% Time group info: ------[substitution.] 0.000186 24 1.12% : 0.000002s : 2: substitution.elim_not_effective 1.56% : 0.000003s : 2: substitution.fold_const_symbol 2.91% : 0.000005s : 4: substitution.graph_param_transform 81.62% : 0.000152s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.00% : 0.000006s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 6.01% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103227 2 97.59% : 0.100737s : 1: type_inference.infer 2.41% : 0.002491s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.63% : 0.000047s : 4: replace.inline 32.37% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.67% : 0.000150s : 4: match.inline 6.33% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.32% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.10% : 0.000006s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.80% : 0.000002s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.02% : 0.000009s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.62% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.26% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001921 22 66.06% : 0.001269s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.40% : 0.000622s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116544 72 0.04% : 0.000047s : 1: add_recomputation 0.06% : 0.000066s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.27% : 0.000319s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.92% : 0.006895s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.37% : 0.000434s : 1: loop_unroll 0.51% : 0.000590s : 1: mutable_eliminate 0.76% : 0.000887s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000434s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.41% : 0.001644s : 1: renormalize.infer 0.58% : 0.000678s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.07% : 0.000080s : 1: symbol_engine_optimizer 88.64% : 0.103308s : 1: type_inference TotalTime = 0.046068, [30] [bootstrap]: 0.00028393 [type_inference]: 0.0378177 [event_method]: 1.58e-05 [auto_monad]: 4.705e-05 [graph_reusing]: 4.28999e-06 [pre_auto_parallel]: 1.81e-06 [py_interpret_to_execute]: 0.00021277 [rewriter_before_opt_a]: 7.512e-05 [expand_dump_flag]: 2.57001e-06 [jit_opt_a]: 0.00560216, [2] [Cycle 1]: 0.0021617, [27] [switch_simplify]: 4.66e-05 [loop_unroll]: 2.994e-05 [a_1]: 0.00051177 [with_stream_mark]: 1.252e-05 [recompute_prepare]: 8.32e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.49999e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.65002e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 5.91e-06 [meta_shard_fg_expand]: 1.32999e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 9.08002e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 8.72e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00126548 [add_forward_monad_depend]: 5.61998e-06 [auto_monad_grad]: 1.19998e-06 [auto_monad_eliminator]: 1.17e-05 [cse]: 1.877e-05 [replace_applicator]: 1.271e-05 [Cycle 2]: 0.00035318, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.00012053 [with_stream_mark]: 9.29e-06 [recompute_prepare]: 6.02001e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.46999e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 2.58e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.349e-05 [j_node_and_user_rematch]: 8.69998e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.65998e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.069e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 8.89998e-06 [rewriter_after_opt_a]: 2.745e-05 [convert_after_rewriter]: 5.84e-06 [order_py_execute_after_rewriter]: 4.42998e-06 [mutable_eliminate]: 0.00051516 [jit_opt_b]: 5.332e-05, [1] [Cycle 1]: 4.688e-05, [2] [frontend_op_eliminate]: 1.809e-05 [inline_after_opt_a]: 1.808e-05 [cconv]: 1.619e-05 [loop_unroll]: 0.00042377 [jit_opt_after_cconv]: 0.000144, [1] [Cycle 1]: 0.00013799, [11] [c_1]: 2.62e-05 [parameter_eliminate]: 2.64999e-06 [updatestate_depend_eliminate]: 5.17999e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 1.863e-05 [call_graph_tuple_transform]: 1.831e-05 [tuple_list_get_item_eliminator]: 6.07001e-06 [none_parameter_eliminate]: 1.19e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 9.38002e-06 [partial_unused_args_eliminate]: 1.79998e-06 [environ_conv]: 4.25999e-06 [add_recomputation]: 3.409e-05 [cse_after_recomputation]: 2.042e-05, [1] [Cycle 1]: 1.545e-05, [1] [cse]: 1.023e-05 [auto_monad_reorder]: 9.99001e-06 [get_jit_bprop_graph]: 1.41002e-06 [rewriter_after_jit_bprop_graph]: 4.81002e-06 [opt_after_jit_grad]: 0.00045047 [symbol_engine_optimizer]: 7.362e-05, [1] [Cycle 1]: 6.745e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 8.25999e-06 [elim_not_effective]: 1.307e-05 [opt_reshape]: 6.44999e-06 [fold_const_symbol]: 9.52001e-06 [renormalize]: 3.19997e-07 [validate]: 2.943e-05 Sums bootstrap : 0.000284s : 0.67% type_inference : 0.037818s : 89.13% event_method : 0.000016s : 0.04% auto_monad : 0.000047s : 0.11% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000213s : 0.50% rewriter_before_opt_a : 0.000075s : 0.18% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.13% jit_opt_a.loop_unroll : 0.000036s : 0.08% jit_opt_a.a_1 : 0.000632s : 1.49% jit_opt_a.with_stream_mark : 0.000022s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.03% jit_opt_a.accelerated_algorithm : 0.000011s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.03% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.04% jit_opt_a.inline_without_move : 0.000011s : 0.03% jit_opt_a.renormalize : 0.001266s : 2.98% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.02% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.04% jit_opt_a.cse : 0.000029s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000027s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000515s : 1.21% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.04% cconv : 0.000016s : 0.04% loop_unroll : 0.000424s : 1.00% jit_opt_after_cconv.c_1 : 0.000026s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000004s : 0.01% add_recomputation : 0.000034s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000450s : 1.06% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.07% Time group info: ------[substitution.] 0.000162 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000005s : 4: substitution.graph_param_transform 83.09% : 0.000135s : 4: substitution.inline 1.91% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.95% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000003s : 2: substitution.replace_old_param 5.24% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.037756 2 95.59% : 0.036092s : 1: type_inference.infer 4.41% : 0.001664s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.51% : 0.000042s : 4: replace.inline 34.49% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000139 6 94.78% : 0.000132s : 4: match.inline 5.22% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.36% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.62% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.08% : 0.000006s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.95% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.63% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.33% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001507 18 68.28% : 0.001029s : 11: func_graph_cloner_run.FuncGraphClonerGraph 1.84% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.88% : 0.000450s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.048256 72 0.08% : 0.000037s : 1: add_recomputation 0.10% : 0.000050s : 1: auto_monad 0.03% : 0.000012s : 1: auto_monad_reorder 0.61% : 0.000296s : 1: bootstrap 0.04% : 0.000019s : 1: cconv 0.02% : 0.000008s : 1: convert_after_rewriter 0.05% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000006s : 1: environ_conv 0.04% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 11.62% : 0.005605s : 1: jit_opt_a 0.30% : 0.000146s : 1: jit_opt_after_cconv 0.12% : 0.000056s : 1: jit_opt_b 0.89% : 0.000431s : 1: loop_unroll 1.08% : 0.000523s : 1: mutable_eliminate 1.76% : 0.000848s : 26: opt.transform.jit_opt_a 0.11% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000013s : 1: opt.transform.mutable_eliminate 0.05% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.95% : 0.000459s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000217s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 1.63% : 0.000787s : 1: renormalize.infer 0.98% : 0.000471s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000030s : 1: rewriter_after_opt_a 0.16% : 0.000079s : 1: rewriter_before_opt_a 0.16% : 0.000076s : 1: symbol_engine_optimizer 78.39% : 0.037829s : 1: type_inference TotalTime = 0.0119214, [30] [bootstrap]: 0.00026659 [type_inference]: 0.00449865 [event_method]: 1.647e-05 [auto_monad]: 6.061e-05 [graph_reusing]: 4.45e-06 [pre_auto_parallel]: 1.70001e-06 [py_interpret_to_execute]: 3.641e-05 [rewriter_before_opt_a]: 6.88e-05 [expand_dump_flag]: 3.01999e-06 [jit_opt_a]: 0.00502511, [2] [Cycle 1]: 0.00138338, [27] [switch_simplify]: 4.955e-05 [loop_unroll]: 3.048e-05 [a_1]: 0.00047524 [with_stream_mark]: 1.158e-05 [recompute_prepare]: 7.25e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 6.16e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 5.29e-06 [merge_forward]: 2.55002e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.115e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.99999e-06 [replace_old_param]: 8.07e-06 [inline_without_move]: 5.49e-06 [renormalize]: 0.00053469 [add_forward_monad_depend]: 4.15999e-06 [auto_monad_grad]: 1.47999e-06 [auto_monad_eliminator]: 9.86998e-06 [cse]: 1.767e-05 [replace_applicator]: 1.04e-05 [Cycle 2]: 0.0003252, [27] [switch_simplify]: 5.51002e-06 [loop_unroll]: 4.54002e-06 [a_1]: 9.069e-05 [with_stream_mark]: 8.64e-06 [recompute_prepare]: 5.13002e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 4.79e-06 [updatestate_useless_node_eliminater]: 4.87998e-06 [accelerated_algorithm]: 4.60999e-06 [meta_shard_fg_expand]: 1.01002e-06 [get_grad_eliminate_]: 4.47e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.41002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.162e-05 [j_node_and_user_rematch]: 7.65e-06 [meta_fg_expand]: 1.53002e-06 [replace_old_param]: 7.2e-06 [inline_without_move]: 4.67e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.57999e-06 [cse]: 1.109e-05 [replace_applicator]: 5.11002e-06 [py_interpret_to_execute_after_opt_a]: 1.359e-05 [rewriter_after_opt_a]: 3.294e-05 [convert_after_rewriter]: 6.04001e-06 [order_py_execute_after_rewriter]: 4.44002e-06 [mutable_eliminate]: 0.00047783 [jit_opt_b]: 4.801e-05, [1] [Cycle 1]: 4.219e-05, [2] [frontend_op_eliminate]: 1.589e-05 [inline_after_opt_a]: 1.56e-05 [cconv]: 1.545e-05 [loop_unroll]: 0.00040348 [jit_opt_after_cconv]: 0.00013153, [1] [Cycle 1]: 0.00012559, [11] [c_1]: 2.037e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 5.20001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 1.673e-05 [call_graph_tuple_transform]: 1.672e-05 [tuple_list_get_item_eliminator]: 5.13002e-06 [none_parameter_eliminate]: 1.05999e-06 [renormalize]: 5.39992e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 8.23999e-06 [partial_unused_args_eliminate]: 1.143e-05 [environ_conv]: 4.53999e-06 [add_recomputation]: 3.58e-05 [cse_after_recomputation]: 2.238e-05, [1] [Cycle 1]: 1.662e-05, [1] [cse]: 1.074e-05 [auto_monad_reorder]: 1.016e-05 [get_jit_bprop_graph]: 1.39e-06 [rewriter_after_jit_bprop_graph]: 3.91001e-06 [opt_after_jit_grad]: 0.00043934 [symbol_engine_optimizer]: 8.28e-05, [1] [Cycle 1]: 7.659e-05, [6] [build]: 2.49001e-06 [elim_shapecalc]: 7.68999e-06 [elim_not_effective]: 1.185e-05 [opt_reshape]: 5.74e-06 [fold_const_symbol]: 8.23999e-06 [renormalize]: 2.10013e-07 [validate]: 2.919e-05 Sums bootstrap : 0.000267s : 3.32% type_inference : 0.004499s : 55.98% event_method : 0.000016s : 0.20% auto_monad : 0.000061s : 0.75% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000036s : 0.45% rewriter_before_opt_a : 0.000069s : 0.86% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.69% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000566s : 7.04% jit_opt_a.with_stream_mark : 0.000020s : 0.25% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000535s : 6.65% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000015s : 0.19% jit_opt_a.cse : 0.000029s : 0.36% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000014s : 0.17% rewriter_after_opt_a : 0.000033s : 0.41% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000478s : 5.95% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000015s : 0.19% loop_unroll : 0.000403s : 5.02% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000008s : 0.10% partial_unused_args_eliminate : 0.000011s : 0.14% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000036s : 0.45% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000010s : 0.13% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000439s : 5.47% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.36% Time group info: ------[substitution.] 0.000157 23 0.95% : 0.000001s : 2: substitution.elim_not_effective 0.80% : 0.000001s : 2: substitution.fold_const_symbol 2.77% : 0.000004s : 3: substitution.graph_param_transform 82.52% : 0.000129s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.91% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000004s : 2: substitution.replace_old_param 6.17% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004438 2 79.77% : 0.003540s : 1: type_inference.infer 20.23% : 0.000898s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.44% : 0.000041s : 4: replace.inline 33.56% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000136 6 93.72% : 0.000127s : 4: match.inline 6.28% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 2.28% : 0.000003s : 10: predicate.arithmetic_simplify 1.27% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.23% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.30% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.04% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 2.15% : 0.000002s : 3: predicate.mutable_eliminate 0.90% : 0.000001s : 3: predicate.opt_reshape 2.22% : 0.000002s : 15: predicate.partial_eliminate 1.18% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.16% : 0.000009s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.64% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000635 13 44.79% : 0.000284s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.99% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.22% : 0.000325s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013286 72 0.29% : 0.000039s : 1: add_recomputation 0.48% : 0.000064s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 2.12% : 0.000282s : 1: bootstrap 0.13% : 0.000018s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.84% : 0.005028s : 1: jit_opt_a 1.01% : 0.000134s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.09% : 0.000411s : 1: loop_unroll 3.65% : 0.000485s : 1: mutable_eliminate 5.77% : 0.000766s : 26: opt.transform.jit_opt_a 0.33% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.37% : 0.000448s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.10% : 0.000014s : 1: partial_unused_args_eliminate 0.03% : 0.000003s : 1: pre_auto_parallel 0.30% : 0.000039s : 1: py_interpret_to_execute 0.12% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000011s : 1: remove_dup_value 2.08% : 0.000277s : 1: renormalize.infer 1.90% : 0.000252s : 1: renormalize.specialize 0.04% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000036s : 1: rewriter_after_opt_a 0.54% : 0.000072s : 1: rewriter_before_opt_a 0.64% : 0.000085s : 1: symbol_engine_optimizer 33.97% : 0.004513s : 1: type_inference TotalTime = 0.0127823, [30] [bootstrap]: 0.00028768 [type_inference]: 0.00449491 [event_method]: 1.66e-05 [auto_monad]: 6.409e-05 [graph_reusing]: 5.81e-06 [pre_auto_parallel]: 2.26998e-06 [py_interpret_to_execute]: 3.791e-05 [rewriter_before_opt_a]: 7.373e-05 [expand_dump_flag]: 2.71999e-06 [jit_opt_a]: 0.00528998, [2] [Cycle 1]: 0.00181696, [27] [switch_simplify]: 6.279e-05 [loop_unroll]: 3.246e-05 [a_1]: 0.00056086 [with_stream_mark]: 1.795e-05 [recompute_prepare]: 7.51999e-06 [updatestate_depend_eliminate]: 3.85e-06 [updatestate_assign_eliminate]: 3.35003e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 1.87001e-06 [specialize_transform]: 6.19999e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.21e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.98001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.542e-05 [j_node_and_user_rematch]: 9.11002e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 8.99e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 0.00079529 [add_forward_monad_depend]: 5.42001e-06 [auto_monad_grad]: 2.19999e-06 [auto_monad_eliminator]: 1.45e-05 [cse]: 3.41e-05 [replace_applicator]: 1.255e-05 [Cycle 2]: 0.00031972, [27] [switch_simplify]: 6.12999e-06 [loop_unroll]: 4.99e-06 [a_1]: 9.193e-05 [with_stream_mark]: 8.75001e-06 [recompute_prepare]: 4.85001e-06 [updatestate_depend_eliminate]: 2.82002e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 4.94e-06 [updatestate_useless_node_eliminater]: 4.96002e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.39e-06 [get_grad_eliminate_]: 4.70001e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.73002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.337e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.66999e-06 [inline_without_move]: 4.64998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 8.10018e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.216e-05 [replace_applicator]: 5.71e-06 [py_interpret_to_execute_after_opt_a]: 1.238e-05 [rewriter_after_opt_a]: 3.663e-05 [convert_after_rewriter]: 7.23999e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00068499 [jit_opt_b]: 5.215e-05, [1] [Cycle 1]: 4.47e-05, [2] [frontend_op_eliminate]: 1.692e-05 [inline_after_opt_a]: 1.675e-05 [cconv]: 2.863e-05 [loop_unroll]: 0.00045861 [jit_opt_after_cconv]: 0.000172, [1] [Cycle 1]: 0.00016549, [11] [c_1]: 2.33e-05 [parameter_eliminate]: 3.78001e-06 [updatestate_depend_eliminate]: 7.46001e-06 [updatestate_assign_eliminate]: 3.03998e-06 [updatestate_loads_eliminate]: 2.37999e-06 [cse]: 3.612e-05 [call_graph_tuple_transform]: 2.294e-05 [tuple_list_get_item_eliminator]: 5.35001e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 8.2e-07 [switch_simplify]: 5.56002e-06 [remove_dup_value]: 1.761e-05 [partial_unused_args_eliminate]: 2.29001e-06 [environ_conv]: 6.44999e-06 [add_recomputation]: 5.651e-05 [cse_after_recomputation]: 2.438e-05, [1] [Cycle 1]: 1.849e-05, [1] [cse]: 1.241e-05 [auto_monad_reorder]: 1.818e-05 [get_jit_bprop_graph]: 2.46998e-06 [rewriter_after_jit_bprop_graph]: 9.16002e-06 [opt_after_jit_grad]: 0.00059432 [symbol_engine_optimizer]: 7.45e-05, [1] [Cycle 1]: 6.762e-05, [6] [build]: 4.23999e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.321e-05 [opt_reshape]: 5.79999e-06 [fold_const_symbol]: 8.90001e-06 [renormalize]: 5.39992e-07 [validate]: 4.145e-05 Sums bootstrap : 0.000288s : 3.19% type_inference : 0.004495s : 49.90% event_method : 0.000017s : 0.18% auto_monad : 0.000064s : 0.71% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000038s : 0.42% rewriter_before_opt_a : 0.000074s : 0.82% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000069s : 0.77% jit_opt_a.loop_unroll : 0.000037s : 0.42% jit_opt_a.a_1 : 0.000653s : 7.25% jit_opt_a.with_stream_mark : 0.000027s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000795s : 8.83% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.23% jit_opt_a.cse : 0.000046s : 0.51% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000037s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000685s : 7.60% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000017s : 0.19% cconv : 0.000029s : 0.32% loop_unroll : 0.000459s : 5.09% jit_opt_after_cconv.c_1 : 0.000023s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000036s : 0.40% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.25% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000018s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000057s : 0.63% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000018s : 0.20% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000009s : 0.10% opt_after_jit_grad : 0.000594s : 6.60% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000041s : 0.46% Time group info: ------[substitution.] 0.000219 23 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000002s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 3: substitution.graph_param_transform 83.14% : 0.000182s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.48% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000005s : 2: substitution.replace_old_param 6.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004442 2 78.23% : 0.003475s : 1: type_inference.infer 21.77% : 0.000967s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.61% : 0.000047s : 4: replace.inline 33.39% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.67% : 0.000179s : 4: match.inline 6.33% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.43% : 0.000002s : 10: predicate.accumulaten_eliminater 1.33% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.46% : 0.000002s : 10: predicate.addn_zero_filter 2.06% : 0.000003s : 10: predicate.arithmetic_simplify 1.32% : 0.000002s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.66% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.56% : 0.000001s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.91% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.11% : 0.000006s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.36% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.52% : 0.000002s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 2.07% : 0.000003s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.15% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.61% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.10% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.34% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.53% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.11% : 0.000010s : 53: predicate.switch_simplify 1.36% : 0.000002s : 10: predicate.tile_eliminate 1.12% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.12% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.86% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000707 13 43.04% : 0.000304s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.77% : 0.000041s : 1: func_graph_cloner_run.FuncGraphClonerNode 51.19% : 0.000362s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014520 72 0.41% : 0.000059s : 1: add_recomputation 0.47% : 0.000068s : 1: auto_monad 0.14% : 0.000021s : 1: auto_monad_reorder 2.07% : 0.000301s : 1: bootstrap 0.22% : 0.000031s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.42% : 0.000061s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.46% : 0.005294s : 1: jit_opt_a 1.20% : 0.000175s : 1: jit_opt_after_cconv 0.38% : 0.000055s : 1: jit_opt_b 3.23% : 0.000469s : 1: loop_unroll 4.78% : 0.000695s : 1: mutable_eliminate 6.02% : 0.000875s : 26: opt.transform.jit_opt_a 0.37% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.17% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000033s : 4: opt.transform.symbol_engine_opt 4.16% : 0.000605s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000041s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000020s : 1: remove_dup_value 2.85% : 0.000414s : 1: renormalize.infer 2.57% : 0.000373s : 1: renormalize.specialize 0.08% : 0.000012s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.53% : 0.000077s : 1: rewriter_before_opt_a 0.53% : 0.000077s : 1: symbol_engine_optimizer 31.04% : 0.004507s : 1: type_inference TotalTime = 0.112736, [30] [bootstrap]: 0.00027535 [type_inference]: 0.102017 [event_method]: 1.737e-05 [auto_monad]: 6.573e-05 [graph_reusing]: 5.74999e-06 [pre_auto_parallel]: 2.31998e-06 [py_interpret_to_execute]: 0.00043042 [rewriter_before_opt_a]: 7.907e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00750118, [2] [Cycle 1]: 0.00371318, [27] [switch_simplify]: 5.675e-05 [loop_unroll]: 2.982e-05 [a_1]: 0.00055733 [with_stream_mark]: 1.914e-05 [recompute_prepare]: 8.90001e-06 [updatestate_depend_eliminate]: 3.65e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.22001e-06 [specialize_transform]: 6.79999e-06 [updatestate_useless_node_eliminater]: 6.05002e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.37001e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 1.11002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 2.38002e-06 [replace_old_param]: 9.84999e-06 [inline_without_move]: 6.09001e-06 [renormalize]: 0.00269707 [add_forward_monad_depend]: 8.13001e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.622e-05 [cse]: 3.256e-05 [replace_applicator]: 1.98e-05 [Cycle 2]: 0.00038091, [27] [switch_simplify]: 7.15e-06 [loop_unroll]: 6.39001e-06 [a_1]: 0.00012618 [with_stream_mark]: 1.269e-05 [recompute_prepare]: 6.16e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 5.72001e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.60001e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 2.93998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.907e-05 [j_node_and_user_rematch]: 9.94999e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 1.003e-05 [inline_without_move]: 5.37999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.121e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 1.214e-05 [rewriter_after_opt_a]: 3.653e-05 [convert_after_rewriter]: 6.93998e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00067861 [jit_opt_b]: 5.685e-05, [1] [Cycle 1]: 4.957e-05, [2] [frontend_op_eliminate]: 1.961e-05 [inline_after_opt_a]: 1.872e-05 [cconv]: 2.697e-05 [loop_unroll]: 0.00042227 [jit_opt_after_cconv]: 0.0001521, [1] [Cycle 1]: 0.00014598, [11] [c_1]: 2.501e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.51e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 2.167e-05 [call_graph_tuple_transform]: 2.155e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 6.07001e-06 [remove_dup_value]: 1.594e-05 [partial_unused_args_eliminate]: 2.53e-06 [environ_conv]: 8.33001e-06 [add_recomputation]: 4.96e-05 [cse_after_recomputation]: 2.274e-05, [1] [Cycle 1]: 1.658e-05, [1] [cse]: 1.112e-05 [auto_monad_reorder]: 1.55e-05 [get_jit_bprop_graph]: 1.89999e-06 [rewriter_after_jit_bprop_graph]: 4.59998e-06 [opt_after_jit_grad]: 0.00045998 [symbol_engine_optimizer]: 7.929e-05, [1] [Cycle 1]: 7.369e-05, [6] [build]: 3.28998e-06 [elim_shapecalc]: 9.87001e-06 [elim_not_effective]: 1.631e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 1.195e-05 [renormalize]: 4.2998e-07 [validate]: 0.00011571 Sums bootstrap : 0.000275s : 0.25% type_inference : 0.102017s : 93.80% event_method : 0.000017s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000430s : 0.40% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000684s : 0.63% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002697s : 2.48% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000679s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000422s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000460s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000116s : 0.11% Time group info: ------[substitution.] 0.000206 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 2.05% : 0.000004s : 2: substitution.fold_const_symbol 3.65% : 0.000007s : 4: substitution.graph_param_transform 79.99% : 0.000165s : 4: substitution.inline 1.77% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.83% : 0.000006s : 4: substitution.remove_not_recompute_node 2.59% : 0.000005s : 2: substitution.replace_old_param 6.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101949 2 97.59% : 0.099495s : 1: type_inference.infer 2.41% : 0.002454s : 1: type_inference.specialize ------[replace.] 0.000071 6 64.33% : 0.000045s : 4: replace.inline 35.67% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.30% : 0.000162s : 4: match.inline 6.70% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.31% : 0.000002s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.41% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.23% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.90% : 0.000003s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.13% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.79% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.17% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.18% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.05% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001974 22 63.71% : 0.001257s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.55% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.74% : 0.000686s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116363 72 0.05% : 0.000052s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000291s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.45% : 0.007504s : 1: jit_opt_a 0.13% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.37% : 0.000430s : 1: loop_unroll 0.59% : 0.000687s : 1: mutable_eliminate 0.80% : 0.000927s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000467s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000436s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.59% : 0.001854s : 1: renormalize.infer 0.72% : 0.000833s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.07% : 0.000081s : 1: symbol_engine_optimizer 87.68% : 0.102029s : 1: type_inference TotalTime = 0.111476, [30] [bootstrap]: 0.00025824 [type_inference]: 0.101686 [event_method]: 1.674e-05 [auto_monad]: 4.809e-05 [graph_reusing]: 4.13001e-06 [pre_auto_parallel]: 1.91998e-06 [py_interpret_to_execute]: 0.00041028 [rewriter_before_opt_a]: 7.501e-05 [expand_dump_flag]: 2.41e-06 [jit_opt_a]: 0.00681823, [2] [Cycle 1]: 0.00325708, [27] [switch_simplify]: 4.909e-05 [loop_unroll]: 2.955e-05 [a_1]: 0.00052277 [with_stream_mark]: 1.317e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 6.74999e-06 [updatestate_useless_node_eliminater]: 5.88002e-06 [accelerated_algorithm]: 5.92999e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 5.90002e-06 [merge_forward]: 3.01999e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 9.76998e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.39998e-06 [inline_without_move]: 6.01e-06 [renormalize]: 0.00233972 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 1.76e-06 [auto_monad_eliminator]: 1.321e-05 [cse]: 2.145e-05 [replace_applicator]: 1.293e-05 [Cycle 2]: 0.00035235, [27] [switch_simplify]: 6.34001e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00011769 [with_stream_mark]: 9.87999e-06 [recompute_prepare]: 6.29999e-06 [updatestate_depend_eliminate]: 2.68998e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.85002e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.31998e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.452e-05 [j_node_and_user_rematch]: 8.59998e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 8.26002e-06 [inline_without_move]: 5.58002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.41998e-06 [cse]: 1.145e-05 [replace_applicator]: 5.60001e-06 [py_interpret_to_execute_after_opt_a]: 8.59002e-06 [rewriter_after_opt_a]: 2.879e-05 [convert_after_rewriter]: 6.23e-06 [order_py_execute_after_rewriter]: 4.27e-06 [mutable_eliminate]: 0.00055416 [jit_opt_b]: 5.268e-05, [1] [Cycle 1]: 4.608e-05, [2] [frontend_op_eliminate]: 1.85e-05 [inline_after_opt_a]: 1.728e-05 [cconv]: 1.824e-05 [loop_unroll]: 0.00040892 [jit_opt_after_cconv]: 0.00014506, [1] [Cycle 1]: 0.00013912, [11] [c_1]: 2.532e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.54998e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.095e-05 [call_graph_tuple_transform]: 2.004e-05 [tuple_list_get_item_eliminator]: 5.91e-06 [none_parameter_eliminate]: 1.10001e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.103e-05 [partial_unused_args_eliminate]: 2.59999e-06 [environ_conv]: 6.61999e-06 [add_recomputation]: 3.626e-05 [cse_after_recomputation]: 2.116e-05, [1] [Cycle 1]: 1.623e-05, [1] [cse]: 1.089e-05 [auto_monad_reorder]: 1.066e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 5.499e-05 [opt_after_jit_grad]: 0.00044961 [symbol_engine_optimizer]: 7.291e-05, [1] [Cycle 1]: 6.684e-05, [6] [build]: 2.44001e-06 [elim_shapecalc]: 8.36002e-06 [elim_not_effective]: 1.407e-05 [opt_reshape]: 7.41001e-06 [fold_const_symbol]: 8.63001e-06 [renormalize]: 3.89991e-07 [validate]: 9.661e-05 Sums bootstrap : 0.000258s : 0.24% type_inference : 0.101686s : 94.40% event_method : 0.000017s : 0.02% auto_monad : 0.000048s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000410s : 0.38% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000640s : 0.59% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002340s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000554s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000018s : 0.02% loop_unroll : 0.000409s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000036s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000055s : 0.05% opt_after_jit_grad : 0.000450s : 0.42% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000097s : 0.09% Time group info: ------[substitution.] 0.000170 24 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 3.52% : 0.000006s : 4: substitution.graph_param_transform 82.07% : 0.000139s : 4: substitution.inline 1.72% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.98% : 0.000005s : 4: substitution.remove_not_recompute_node 2.15% : 0.000004s : 2: substitution.replace_old_param 5.75% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101618 2 97.65% : 0.099228s : 1: type_inference.infer 2.35% : 0.002390s : 1: type_inference.specialize ------[replace.] 0.000067 6 65.95% : 0.000044s : 4: replace.inline 34.05% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 94.15% : 0.000137s : 4: match.inline 5.85% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.19% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.18% : 0.000001s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.73% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.05% : 0.000006s : 26: predicate.inline 1.22% : 0.000002s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000002s : 8: predicate.less_batch_normalization 1.83% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000003s : 18: predicate.load_eliminater 1.53% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 2.54% : 0.000003s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.39% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.11% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.91% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001932 22 68.27% : 0.001319s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.50% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.23% : 0.000584s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114692 72 0.03% : 0.000039s : 1: add_recomputation 0.04% : 0.000051s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.24% : 0.000271s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.95% : 0.006821s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.36% : 0.000415s : 1: loop_unroll 0.49% : 0.000563s : 1: mutable_eliminate 0.75% : 0.000860s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000417s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.50% : 0.001723s : 1: renormalize.infer 0.53% : 0.000610s : 1: renormalize.specialize 0.05% : 0.000058s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 88.67% : 0.101702s : 1: type_inference TotalTime = 0.056485, [30] [bootstrap]: 0.00027049 [type_inference]: 0.0476095 [event_method]: 1.691e-05 [auto_monad]: 6.51e-05 [graph_reusing]: 5.40001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00022284 [rewriter_before_opt_a]: 7.597e-05 [expand_dump_flag]: 3.26001e-06 [jit_opt_a]: 0.0061049, [2] [Cycle 1]: 0.00253012, [27] [switch_simplify]: 4.819e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00054098 [with_stream_mark]: 1.486e-05 [recompute_prepare]: 7.82e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.36002e-06 [specialize_transform]: 6.76999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.07001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 6.19001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 9.60019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.184e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.23001e-06 [inline_without_move]: 5.83997e-06 [renormalize]: 0.00159817 [add_forward_monad_depend]: 4.79e-06 [auto_monad_grad]: 1.57001e-06 [auto_monad_eliminator]: 1.273e-05 [cse]: 1.905e-05 [replace_applicator]: 1.331e-05 [Cycle 2]: 0.00034825, [27] [switch_simplify]: 6.28e-06 [loop_unroll]: 5.46998e-06 [a_1]: 0.00011563 [with_stream_mark]: 9.32999e-06 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.05002e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 5.56998e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.23002e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 1.65001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.52998e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 8.52e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.20002e-06 [cse]: 1.166e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 9.52999e-06 [rewriter_after_opt_a]: 2.838e-05 [convert_after_rewriter]: 6.17001e-06 [order_py_execute_after_rewriter]: 5.40999e-06 [mutable_eliminate]: 0.00059198 [jit_opt_b]: 5.459e-05, [1] [Cycle 1]: 4.842e-05, [2] [frontend_op_eliminate]: 1.85e-05 [inline_after_opt_a]: 1.864e-05 [cconv]: 2.059e-05 [loop_unroll]: 0.00041362 [jit_opt_after_cconv]: 0.0001497, [1] [Cycle 1]: 0.00014336, [11] [c_1]: 2.538e-05 [parameter_eliminate]: 3.08e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 2.219e-05 [call_graph_tuple_transform]: 1.958e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.135e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 6.25002e-06 [add_recomputation]: 4.081e-05 [cse_after_recomputation]: 2.174e-05, [1] [Cycle 1]: 1.683e-05, [1] [cse]: 1.1e-05 [auto_monad_reorder]: 1.211e-05 [get_jit_bprop_graph]: 1.76003e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.00044772 [symbol_engine_optimizer]: 8.765e-05, [1] [Cycle 1]: 8.174e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 2.154e-05 [elim_not_effective]: 1.376e-05 [opt_reshape]: 6.29999e-06 [fold_const_symbol]: 9.03002e-06 [renormalize]: 3.60014e-07 [validate]: 3.642e-05 Sums bootstrap : 0.000270s : 0.51% type_inference : 0.047609s : 90.31% event_method : 0.000017s : 0.03% auto_monad : 0.000065s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000223s : 0.42% rewriter_before_opt_a : 0.000076s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000657s : 1.25% jit_opt_a.with_stream_mark : 0.000024s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001598s : 3.03% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.04% jit_opt_a.cse : 0.000031s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000028s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000592s : 1.12% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.04% jit_opt_b.inline_after_opt_a : 0.000019s : 0.04% cconv : 0.000021s : 0.04% loop_unroll : 0.000414s : 0.78% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000041s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000448s : 0.85% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000022s : 0.04% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.07% Time group info: ------[substitution.] 0.000193 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000005s : 4: substitution.graph_param_transform 79.26% : 0.000153s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000003s : 2: substitution.replace_old_param 10.77% : 0.000021s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.047541 2 96.37% : 0.045814s : 1: type_inference.infer 3.63% : 0.001727s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.79% : 0.000045s : 4: replace.inline 34.21% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 88.42% : 0.000150s : 4: match.inline 11.58% : 0.000020s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.50% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000001s : 12: predicate.print_const_string_wrapper 1.87% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 4: predicate.row_tensor_eliminate 1.37% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.38% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.47% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.40% : 0.000009s : 58: predicate.switch_simplify 1.12% : 0.000001s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001776 22 70.61% : 0.001254s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.61% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.79% : 0.000494s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059036 72 0.07% : 0.000044s : 1: add_recomputation 0.12% : 0.000068s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.48% : 0.000282s : 1: bootstrap 0.04% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.35% : 0.006108s : 1: jit_opt_a 0.26% : 0.000152s : 1: jit_opt_after_cconv 0.10% : 0.000057s : 1: jit_opt_b 0.71% : 0.000422s : 1: loop_unroll 1.02% : 0.000601s : 1: mutable_eliminate 1.48% : 0.000872s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000228s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 1.79% : 0.001059s : 1: renormalize.infer 0.90% : 0.000532s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000031s : 1: rewriter_after_opt_a 0.14% : 0.000081s : 1: rewriter_before_opt_a 0.15% : 0.000090s : 1: symbol_engine_optimizer 80.67% : 0.047622s : 1: type_inference TotalTime = 0.0112016, [30] [bootstrap]: 0.00026046 [type_inference]: 0.00416537 [event_method]: 1.551e-05 [auto_monad]: 4.685e-05 [graph_reusing]: 4.25e-06 [pre_auto_parallel]: 1.57001e-06 [py_interpret_to_execute]: 3.156e-05 [rewriter_before_opt_a]: 6.692e-05 [expand_dump_flag]: 2.49999e-06 [jit_opt_a]: 0.00466456, [2] [Cycle 1]: 0.00134919, [27] [switch_simplify]: 4.463e-05 [loop_unroll]: 3.012e-05 [a_1]: 0.00045933 [with_stream_mark]: 1.289e-05 [recompute_prepare]: 7.46001e-06 [updatestate_depend_eliminate]: 3.13e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 6.64001e-06 [updatestate_useless_node_eliminater]: 5.06997e-06 [accelerated_algorithm]: 5.02e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 5.23002e-06 [merge_forward]: 2.69001e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.113e-05 [j_node_and_user_rematch]: 7.98001e-06 [meta_fg_expand]: 2.06e-06 [replace_old_param]: 7.4e-06 [inline_without_move]: 5.22999e-06 [renormalize]: 0.00052101 [add_forward_monad_depend]: 4.47e-06 [auto_monad_grad]: 1.15999e-06 [auto_monad_eliminator]: 1.079e-05 [cse]: 1.913e-05 [replace_applicator]: 1.125e-05 [Cycle 2]: 0.00030771, [27] [switch_simplify]: 5.49998e-06 [loop_unroll]: 4.82998e-06 [a_1]: 8.889e-05 [with_stream_mark]: 8.48001e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.01998e-06 [updatestate_loads_eliminate]: 1.88997e-06 [parameter_eliminate]: 9.99979e-07 [specialize_transform]: 4.74e-06 [updatestate_useless_node_eliminater]: 4.55999e-06 [accelerated_algorithm]: 4.61002e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 2.47001e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.276e-05 [j_node_and_user_rematch]: 7.43e-06 [meta_fg_expand]: 1.51998e-06 [replace_old_param]: 7.21001e-06 [inline_without_move]: 4.48001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.80013e-07 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 6.10002e-06 [cse]: 1.061e-05 [replace_applicator]: 4.82e-06 [py_interpret_to_execute_after_opt_a]: 8.42e-06 [rewriter_after_opt_a]: 2.587e-05 [convert_after_rewriter]: 5.70001e-06 [order_py_execute_after_rewriter]: 4.2e-06 [mutable_eliminate]: 0.00047483 [jit_opt_b]: 4.638e-05, [1] [Cycle 1]: 4.038e-05, [2] [frontend_op_eliminate]: 1.529e-05 [inline_after_opt_a]: 1.456e-05 [cconv]: 1.527e-05 [loop_unroll]: 0.00045353 [jit_opt_after_cconv]: 0.00013333, [1] [Cycle 1]: 0.00012734, [11] [c_1]: 2.008e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.57001e-06 [cse]: 1.877e-05 [call_graph_tuple_transform]: 1.59e-05 [tuple_list_get_item_eliminator]: 5.28002e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.42001e-06 [remove_dup_value]: 8.05e-06 [partial_unused_args_eliminate]: 1.47999e-06 [environ_conv]: 4.51002e-06 [add_recomputation]: 3.279e-05 [cse_after_recomputation]: 2.123e-05, [1] [Cycle 1]: 1.609e-05, [1] [cse]: 1.018e-05 [auto_monad_reorder]: 9.56e-06 [get_jit_bprop_graph]: 1.49e-06 [rewriter_after_jit_bprop_graph]: 4.45999e-06 [opt_after_jit_grad]: 0.00043724 [symbol_engine_optimizer]: 6.84e-05, [1] [Cycle 1]: 6.258e-05, [6] [build]: 2.35002e-06 [elim_shapecalc]: 7.21001e-06 [elim_not_effective]: 1.259e-05 [opt_reshape]: 5.46002e-06 [fold_const_symbol]: 8.21002e-06 [renormalize]: 3.39991e-07 [validate]: 2.765e-05 Sums bootstrap : 0.000260s : 3.40% type_inference : 0.004165s : 54.40% event_method : 0.000016s : 0.20% auto_monad : 0.000047s : 0.61% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000032s : 0.41% rewriter_before_opt_a : 0.000067s : 0.87% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000050s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.46% jit_opt_a.a_1 : 0.000548s : 7.16% jit_opt_a.with_stream_mark : 0.000021s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000015s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000521s : 6.81% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.22% jit_opt_a.cse : 0.000030s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000026s : 0.34% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000475s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000015s : 0.20% loop_unroll : 0.000454s : 5.92% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000033s : 0.43% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000010s : 0.12% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000437s : 5.71% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.36% Time group info: ------[substitution.] 0.000146 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000004s : 3: substitution.graph_param_transform 83.05% : 0.000121s : 4: substitution.inline 1.72% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.26% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000003s : 2: substitution.replace_old_param 5.44% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004113 2 81.98% : 0.003372s : 1: type_inference.infer 18.02% : 0.000741s : 1: type_inference.specialize ------[replace.] 0.000059 6 66.51% : 0.000040s : 4: replace.inline 33.49% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000125 6 94.47% : 0.000119s : 4: match.inline 5.53% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.31% : 0.000001s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.97% : 0.000002s : 10: predicate.arithmetic_simplify 1.30% : 0.000001s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.25% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.16% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.51% : 0.000001s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.19% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 6: predicate.less_batch_normalization 1.65% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.22% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.31% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.95% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.55% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.27% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.19% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.60% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.59% : 0.000008s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.37% : 0.000002s : 10: predicate.transpose_eliminate 1.30% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.44% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.69% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.86% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.31% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000538 13 51.42% : 0.000277s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.77% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.81% : 0.000236s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012533 72 0.28% : 0.000036s : 1: add_recomputation 0.40% : 0.000050s : 1: auto_monad 0.10% : 0.000012s : 1: auto_monad_reorder 2.19% : 0.000274s : 1: bootstrap 0.14% : 0.000018s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.04% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.24% : 0.004667s : 1: jit_opt_a 1.08% : 0.000136s : 1: jit_opt_after_cconv 0.39% : 0.000049s : 1: jit_opt_b 3.68% : 0.000461s : 1: loop_unroll 3.85% : 0.000482s : 1: mutable_eliminate 5.93% : 0.000743s : 26: opt.transform.jit_opt_a 0.34% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000445s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000034s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.16% : 0.000020s : 1: remove_dup_value 2.14% : 0.000269s : 1: renormalize.infer 1.97% : 0.000247s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000028s : 1: rewriter_after_opt_a 0.56% : 0.000070s : 1: rewriter_before_opt_a 0.57% : 0.000071s : 1: symbol_engine_optimizer 33.32% : 0.004176s : 1: type_inference TotalTime = 0.0122138, [30] [bootstrap]: 0.00035061 [type_inference]: 0.00466564 [event_method]: 1.675e-05 [auto_monad]: 6.149e-05 [graph_reusing]: 5.24998e-06 [pre_auto_parallel]: 2.23002e-06 [py_interpret_to_execute]: 3.958e-05 [rewriter_before_opt_a]: 7.194e-05 [expand_dump_flag]: 2.94999e-06 [jit_opt_a]: 0.00495898, [2] [Cycle 1]: 0.00153461, [27] [switch_simplify]: 5.24e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.00049612 [with_stream_mark]: 1.481e-05 [recompute_prepare]: 7.57002e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 3.17002e-06 [updatestate_loads_eliminate]: 2.96999e-06 [parameter_eliminate]: 1.61002e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.20001e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.14e-06 [merge_forward]: 3.93001e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.505e-05 [j_node_and_user_rematch]: 8.58001e-06 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 8.43999e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 0.00063709 [add_forward_monad_depend]: 4.89e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.544e-05 [cse]: 2.705e-05 [replace_applicator]: 1.134e-05 [Cycle 2]: 0.00030865, [27] [switch_simplify]: 5.67999e-06 [loop_unroll]: 4.92999e-06 [a_1]: 8.967e-05 [with_stream_mark]: 8.73001e-06 [recompute_prepare]: 4.65001e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.25002e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 4.90999e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.43999e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.18e-05 [j_node_and_user_rematch]: 7.5e-06 [meta_fg_expand]: 1.69998e-06 [replace_old_param]: 7.38999e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.19e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.99999e-06 [cse]: 9.94001e-06 [replace_applicator]: 4.75999e-06 [py_interpret_to_execute_after_opt_a]: 1.035e-05 [rewriter_after_opt_a]: 3.353e-05 [convert_after_rewriter]: 7.48999e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00052695 [jit_opt_b]: 4.928e-05, [1] [Cycle 1]: 4.258e-05, [2] [frontend_op_eliminate]: 1.608e-05 [inline_after_opt_a]: 1.522e-05 [cconv]: 2.372e-05 [loop_unroll]: 0.00040778 [jit_opt_after_cconv]: 0.00013487, [1] [Cycle 1]: 0.00012837, [11] [c_1]: 2.042e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.40001e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 3.07002e-06 [cse]: 1.795e-05 [call_graph_tuple_transform]: 1.733e-05 [tuple_list_get_item_eliminator]: 5.26002e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.56e-05 [partial_unused_args_eliminate]: 2.40002e-06 [environ_conv]: 1.925e-05 [add_recomputation]: 4.831e-05 [cse_after_recomputation]: 2.234e-05, [1] [Cycle 1]: 1.683e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.489e-05 [get_jit_bprop_graph]: 1.72999e-06 [rewriter_after_jit_bprop_graph]: 4.89e-06 [opt_after_jit_grad]: 0.00044104 [symbol_engine_optimizer]: 8.44e-05, [1] [Cycle 1]: 7.824e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.236e-05 [opt_reshape]: 1.767e-05 [fold_const_symbol]: 9.19998e-06 [renormalize]: 3.80009e-07 [validate]: 3.502e-05 Sums bootstrap : 0.000351s : 4.09% type_inference : 0.004666s : 54.45% event_method : 0.000017s : 0.20% auto_monad : 0.000061s : 0.72% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000040s : 0.46% rewriter_before_opt_a : 0.000072s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000586s : 6.84% jit_opt_a.with_stream_mark : 0.000024s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000637s : 7.44% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000037s : 0.43% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000034s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000527s : 6.15% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000024s : 0.28% loop_unroll : 0.000408s : 4.76% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000019s : 0.22% add_recomputation : 0.000048s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000441s : 5.15% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000018s : 0.21% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.41% Time group info: ------[substitution.] 0.000179 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.92% : 0.000005s : 3: substitution.graph_param_transform 81.64% : 0.000146s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.77% : 0.000005s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 6.96% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004607 2 79.37% : 0.003657s : 1: type_inference.infer 20.63% : 0.000950s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.18% : 0.000042s : 4: replace.inline 33.82% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 92.69% : 0.000144s : 4: match.inline 7.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 10: predicate.addn_check_dump 1.28% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.50% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.15% : 0.000001s : 10: predicate.compare_switch_simplify 1.32% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.32% : 0.000002s : 10: predicate.environ_get_eliminate 1.31% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.93% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.28% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.61% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.79% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.20% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.40% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.02% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000009s : 53: predicate.switch_simplify 1.11% : 0.000001s : 10: predicate.tile_eliminate 1.16% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000629 13 50.37% : 0.000317s : 6: func_graph_cloner_run.FuncGraphClonerGraph 3.97% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.67% : 0.000287s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013710 72 0.37% : 0.000051s : 1: add_recomputation 0.47% : 0.000064s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.65% : 0.000363s : 1: bootstrap 0.19% : 0.000026s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.16% : 0.000022s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 36.20% : 0.004963s : 1: jit_opt_a 1.00% : 0.000137s : 1: jit_opt_after_cconv 0.38% : 0.000052s : 1: jit_opt_b 3.03% : 0.000416s : 1: loop_unroll 3.89% : 0.000534s : 1: mutable_eliminate 5.75% : 0.000788s : 26: opt.transform.jit_opt_a 0.33% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.32% : 0.000043s : 4: opt.transform.symbol_engine_opt 3.28% : 0.000449s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000042s : 1: py_interpret_to_execute 0.09% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.29% : 0.000314s : 1: renormalize.infer 2.31% : 0.000317s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.54% : 0.000075s : 1: rewriter_before_opt_a 0.63% : 0.000087s : 1: symbol_engine_optimizer 34.11% : 0.004676s : 1: type_inference TotalTime = 0.113774, [30] [bootstrap]: 0.00025928 [type_inference]: 0.102616 [event_method]: 1.728e-05 [auto_monad]: 7.016e-05 [graph_reusing]: 5.30999e-06 [pre_auto_parallel]: 2.11998e-06 [py_interpret_to_execute]: 0.00051188 [rewriter_before_opt_a]: 8.029e-05 [expand_dump_flag]: 3.58999e-06 [jit_opt_a]: 0.00765209, [2] [Cycle 1]: 0.00369375, [27] [switch_simplify]: 7.67e-05 [loop_unroll]: 3.146e-05 [a_1]: 0.00059718 [with_stream_mark]: 2.017e-05 [recompute_prepare]: 1.008e-05 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 7.09001e-06 [updatestate_useless_node_eliminater]: 5.81003e-06 [accelerated_algorithm]: 6.41e-06 [meta_shard_fg_expand]: 2.13002e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 3.7e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.616e-05 [j_node_and_user_rematch]: 1.091e-05 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 6.37001e-06 [renormalize]: 0.00258747 [add_forward_monad_depend]: 8.47e-06 [auto_monad_grad]: 3.33e-06 [auto_monad_eliminator]: 1.9e-05 [cse]: 3.286e-05 [replace_applicator]: 2.175e-05 [Cycle 2]: 0.00042977, [27] [switch_simplify]: 7.4e-06 [loop_unroll]: 6.09999e-06 [a_1]: 0.00012786 [with_stream_mark]: 1.577e-05 [recompute_prepare]: 6.43998e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 3.34001e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.39001e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 5.42001e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 5.57999e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 3.21001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.94e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.37001e-06 [inline_without_move]: 5.83002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.59e-06 [auto_monad_grad]: 1.39e-06 [auto_monad_eliminator]: 8.12e-06 [cse]: 1.755e-05 [replace_applicator]: 8.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.448e-05 [rewriter_after_opt_a]: 4.172e-05 [convert_after_rewriter]: 7.55998e-06 [order_py_execute_after_rewriter]: 5.28002e-06 [mutable_eliminate]: 0.00076548 [jit_opt_b]: 6.574e-05, [1] [Cycle 1]: 5.595e-05, [2] [frontend_op_eliminate]: 2.189e-05 [inline_after_opt_a]: 1.972e-05 [cconv]: 2.873e-05 [loop_unroll]: 0.00047913 [jit_opt_after_cconv]: 0.00017286, [1] [Cycle 1]: 0.00016463, [11] [c_1]: 2.571e-05 [parameter_eliminate]: 3.81001e-06 [updatestate_depend_eliminate]: 7.43e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.64001e-06 [cse]: 3.06e-05 [call_graph_tuple_transform]: 2.392e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.72999e-06 [renormalize]: 7.89994e-07 [switch_simplify]: 6.73e-06 [remove_dup_value]: 1.76e-05 [partial_unused_args_eliminate]: 2.45002e-06 [environ_conv]: 8.44998e-06 [add_recomputation]: 5.185e-05 [cse_after_recomputation]: 2.429e-05, [1] [Cycle 1]: 1.846e-05, [1] [cse]: 1.196e-05 [auto_monad_reorder]: 1.75e-05 [get_jit_bprop_graph]: 1.96e-06 [rewriter_after_jit_bprop_graph]: 5.41998e-06 [opt_after_jit_grad]: 0.00052993 [symbol_engine_optimizer]: 8.075e-05, [1] [Cycle 1]: 7.118e-05, [6] [build]: 3.64002e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.445e-05 [opt_reshape]: 9.44998e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 5.59987e-07 [validate]: 5.026e-05 Sums bootstrap : 0.000259s : 0.24% type_inference : 0.102616s : 93.63% event_method : 0.000017s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000512s : 0.47% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000084s : 0.08% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000725s : 0.66% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000005s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000036s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002588s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000010s : 0.01% jit_opt_a.auto_monad_grad : 0.000005s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.02% jit_opt_a.cse : 0.000050s : 0.05% jit_opt_a.replace_applicator : 0.000031s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000042s : 0.04% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000765s : 0.70% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000479s : 0.44% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000031s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000052s : 0.05% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000017s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000530s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.05% Time group info: ------[substitution.] 0.000220 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 3.08% : 0.000007s : 4: substitution.graph_param_transform 81.96% : 0.000180s : 4: substitution.inline 1.83% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000006s : 4: substitution.remove_not_recompute_node 2.44% : 0.000005s : 2: substitution.replace_old_param 6.56% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102538 2 97.50% : 0.099972s : 1: type_inference.infer 2.50% : 0.002566s : 1: type_inference.specialize ------[replace.] 0.000080 6 64.35% : 0.000052s : 4: replace.inline 35.65% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.39% : 0.000178s : 4: match.inline 6.61% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.35% : 0.000002s : 12: predicate.accumulaten_eliminater 1.40% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000002s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000003s : 12: predicate.arithmetic_simplify 1.07% : 0.000002s : 12: predicate.cast_eliminate 0.70% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.07% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.65% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.62% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000002s : 8: predicate.get_grad_eliminate 0.24% : 0.000000s : 4: predicate.graph_param_transform 5.74% : 0.000008s : 26: predicate.inline 1.04% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.28% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000003s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.96% : 0.000001s : 12: predicate.merge_addn 1.03% : 0.000001s : 12: predicate.minmaximum_grad 2.11% : 0.000003s : 4: predicate.mutable_eliminate 0.62% : 0.000001s : 4: predicate.opt_reshape 2.07% : 0.000003s : 18: predicate.partial_eliminate 1.08% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.75% : 0.000003s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.11% : 0.000002s : 12: predicate.same_eliminate 0.61% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.88% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.54% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000004s : 18: predicate.switch_defer_inline 1.85% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.47% : 0.000011s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.32% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.56% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.87% : 0.000003s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.82% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001980 22 65.87% : 0.001304s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.94% : 0.000038s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.20% : 0.000637s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117431 72 0.05% : 0.000055s : 1: add_recomputation 0.06% : 0.000074s : 1: auto_monad 0.02% : 0.000020s : 1: auto_monad_reorder 0.23% : 0.000272s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.52% : 0.007656s : 1: jit_opt_a 0.15% : 0.000175s : 1: jit_opt_after_cconv 0.06% : 0.000068s : 1: jit_opt_b 0.42% : 0.000489s : 1: loop_unroll 0.66% : 0.000776s : 1: mutable_eliminate 0.85% : 0.000996s : 26: opt.transform.jit_opt_a 0.05% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000539s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000520s : 1: py_interpret_to_execute 0.01% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.57% : 0.001841s : 1: renormalize.infer 0.63% : 0.000736s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000044s : 1: rewriter_after_opt_a 0.07% : 0.000084s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 87.40% : 0.102633s : 1: type_inference TotalTime = 0.114244, [30] [bootstrap]: 0.00029104 [type_inference]: 0.103224 [event_method]: 1.685e-05 [auto_monad]: 4.607e-05 [graph_reusing]: 3.48e-06 [pre_auto_parallel]: 1.96e-06 [py_interpret_to_execute]: 0.00044634 [rewriter_before_opt_a]: 7.33e-05 [expand_dump_flag]: 2.39999e-06 [jit_opt_a]: 0.00753185, [2] [Cycle 1]: 0.00394893, [27] [switch_simplify]: 4.768e-05 [loop_unroll]: 3.025e-05 [a_1]: 0.0005494 [with_stream_mark]: 1.349e-05 [recompute_prepare]: 7.9e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 7.27002e-06 [updatestate_useless_node_eliminater]: 6.07999e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 7.05e-06 [merge_forward]: 3.55e-06 [cell_reuse_recompute_pass]: 8.90024e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.26e-05 [j_node_and_user_rematch]: 9.26002e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 8.94e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00298299 [add_forward_monad_depend]: 7.64002e-06 [auto_monad_grad]: 1.99999e-06 [auto_monad_eliminator]: 1.684e-05 [cse]: 2.257e-05 [replace_applicator]: 1.746e-05 [Cycle 2]: 0.00038209, [27] [switch_simplify]: 7.11001e-06 [loop_unroll]: 6.68e-06 [a_1]: 0.00012968 [with_stream_mark]: 1.611e-05 [recompute_prepare]: 6.05002e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.14999e-06 [get_grad_eliminate_]: 5.55001e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 2.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 5.69e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.27e-06 [auto_monad_grad]: 7.50006e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.136e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.267e-05 [rewriter_after_opt_a]: 3.28e-05 [convert_after_rewriter]: 4.808e-05 [order_py_execute_after_rewriter]: 5.55001e-06 [mutable_eliminate]: 0.00069909 [jit_opt_b]: 5.625e-05, [1] [Cycle 1]: 5.031e-05, [2] [frontend_op_eliminate]: 2.003e-05 [inline_after_opt_a]: 1.901e-05 [cconv]: 2.506e-05 [loop_unroll]: 0.00048252 [jit_opt_after_cconv]: 0.00015358, [1] [Cycle 1]: 0.00014709, [11] [c_1]: 2.706e-05 [parameter_eliminate]: 2.84999e-06 [updatestate_depend_eliminate]: 4.79e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 3.14001e-06 [cse]: 2.405e-05 [call_graph_tuple_transform]: 2.087e-05 [tuple_list_get_item_eliminator]: 6.30002e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.341e-05 [partial_unused_args_eliminate]: 1.80001e-06 [environ_conv]: 8.67e-06 [add_recomputation]: 4.68e-05 [cse_after_recomputation]: 2.481e-05, [1] [Cycle 1]: 1.92e-05, [1] [cse]: 1.318e-05 [auto_monad_reorder]: 1.296e-05 [get_jit_bprop_graph]: 4.13001e-06 [rewriter_after_jit_bprop_graph]: 5.77999e-06 [opt_after_jit_grad]: 0.00052976 [symbol_engine_optimizer]: 7.839e-05, [1] [Cycle 1]: 7.25e-05, [6] [build]: 3.31999e-06 [elim_shapecalc]: 1.125e-05 [elim_not_effective]: 1.506e-05 [opt_reshape]: 6.29999e-06 [fold_const_symbol]: 1.004e-05 [renormalize]: 4.00003e-07 [validate]: 0.00019779 Sums bootstrap : 0.000291s : 0.26% type_inference : 0.103224s : 93.43% event_method : 0.000017s : 0.02% auto_monad : 0.000046s : 0.04% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000446s : 0.40% rewriter_before_opt_a : 0.000073s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000679s : 0.61% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002983s : 2.70% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000048s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000699s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000483s : 0.44% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000530s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000198s : 0.18% Time group info: ------[substitution.] 0.000188 24 2.11% : 0.000004s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000005s : 4: substitution.graph_param_transform 81.30% : 0.000152s : 4: substitution.inline 2.00% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.03% : 0.000006s : 4: substitution.remove_not_recompute_node 2.82% : 0.000005s : 2: substitution.replace_old_param 5.26% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103162 2 97.66% : 0.100748s : 1: type_inference.infer 2.34% : 0.002414s : 1: type_inference.specialize ------[replace.] 0.000074 6 65.48% : 0.000048s : 4: replace.inline 34.52% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 94.55% : 0.000150s : 4: match.inline 5.45% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 2.13% : 0.000003s : 12: predicate.addn_zero_filter 2.29% : 0.000003s : 12: predicate.arithmetic_simplify 1.44% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.39% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000002s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.75% : 0.000007s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.55% : 0.000002s : 8: predicate.less_batch_normalization 1.75% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.23% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000002s : 12: predicate.merge_addn 1.17% : 0.000002s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.89% : 0.000003s : 12: predicate.reduce_eliminate 1.59% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.96% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.40% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.53% : 0.000009s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.21% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.37% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.93% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.54% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002150 22 62.11% : 0.001335s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.28% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.61% : 0.000787s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118059 72 0.04% : 0.000050s : 1: add_recomputation 0.04% : 0.000049s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.26% : 0.000303s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.04% : 0.000051s : 1: convert_after_rewriter 0.02% : 0.000027s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000006s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 6.38% : 0.007535s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.41% : 0.000490s : 1: loop_unroll 0.60% : 0.000708s : 1: mutable_eliminate 0.77% : 0.000909s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000537s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000451s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.75% : 0.002065s : 1: renormalize.infer 0.77% : 0.000910s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000078s : 1: rewriter_before_opt_a 0.07% : 0.000081s : 1: symbol_engine_optimizer 87.45% : 0.103237s : 1: type_inference TotalTime = 0.0618131, [30] [bootstrap]: 0.00030509 [type_inference]: 0.0526975 [event_method]: 1.802e-05 [auto_monad]: 5.172e-05 [graph_reusing]: 3.78001e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 0.00024942 [rewriter_before_opt_a]: 7.431e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00629321, [2] [Cycle 1]: 0.00275036, [27] [switch_simplify]: 4.643e-05 [loop_unroll]: 2.977e-05 [a_1]: 0.00050465 [with_stream_mark]: 1.397e-05 [recompute_prepare]: 8.29002e-06 [updatestate_depend_eliminate]: 3.37002e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 1.45999e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 8.99978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 9.44998e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.74e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00185505 [add_forward_monad_depend]: 4.73001e-06 [auto_monad_grad]: 1.29998e-06 [auto_monad_eliminator]: 1.199e-05 [cse]: 2.064e-05 [replace_applicator]: 1.282e-05 [Cycle 2]: 0.00034459, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.90002e-06 [a_1]: 0.00011758 [with_stream_mark]: 8.34998e-06 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.02999e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.39998e-06 [updatestate_useless_node_eliminater]: 5.24e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 5.09e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.84998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 8.19002e-06 [meta_fg_expand]: 1.76e-06 [replace_old_param]: 7.84002e-06 [inline_without_move]: 5.14e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 8.60018e-07 [auto_monad_eliminator]: 5.96e-06 [cse]: 1.095e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 7.63001e-06 [rewriter_after_opt_a]: 2.784e-05 [convert_after_rewriter]: 5.69e-06 [order_py_execute_after_rewriter]: 3.76999e-06 [mutable_eliminate]: 0.00055959 [jit_opt_b]: 5.245e-05, [1] [Cycle 1]: 4.643e-05, [2] [frontend_op_eliminate]: 1.847e-05 [inline_after_opt_a]: 1.709e-05 [cconv]: 1.625e-05 [loop_unroll]: 0.00042416 [jit_opt_after_cconv]: 0.0001441, [1] [Cycle 1]: 0.00013799, [11] [c_1]: 2.518e-05 [parameter_eliminate]: 2.14999e-06 [updatestate_depend_eliminate]: 5.35001e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.13002e-06 [cse]: 2.079e-05 [call_graph_tuple_transform]: 1.778e-05 [tuple_list_get_item_eliminator]: 6.56e-06 [none_parameter_eliminate]: 1.01997e-06 [renormalize]: 3.49974e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 9.80002e-06 [partial_unused_args_eliminate]: 1.74e-06 [environ_conv]: 6.34999e-06 [add_recomputation]: 3.227e-05 [cse_after_recomputation]: 2.104e-05, [1] [Cycle 1]: 1.632e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.012e-05 [get_jit_bprop_graph]: 1.45001e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.00045768 [symbol_engine_optimizer]: 0.00012691, [1] [Cycle 1]: 0.00012058, [6] [build]: 3.05002e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 6.476e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 9.47001e-06 [renormalize]: 3.00002e-07 [validate]: 3.676e-05 Sums bootstrap : 0.000305s : 0.53% type_inference : 0.052698s : 90.76% event_method : 0.000018s : 0.03% auto_monad : 0.000052s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000249s : 0.43% rewriter_before_opt_a : 0.000074s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000622s : 1.07% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001855s : 3.19% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000032s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000028s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000560s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000016s : 0.03% loop_unroll : 0.000424s : 0.73% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000032s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000458s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000065s : 0.11% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.06% Time group info: ------[substitution.] 0.000156 24 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000004s : 4: substitution.graph_param_transform 83.68% : 0.000131s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000004s : 4: substitution.remove_not_recompute_node 2.19% : 0.000003s : 2: substitution.replace_old_param 5.33% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052626 2 96.67% : 0.050873s : 1: type_inference.infer 3.33% : 0.001754s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.39% : 0.000043s : 4: replace.inline 32.61% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000135 6 94.69% : 0.000128s : 4: match.inline 5.31% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.46% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.76% : 0.000002s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.84% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.44% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000000s : 4: predicate.graph_param_transform 5.24% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.37% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.62% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.74% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.69% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.68% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002065 26 73.58% : 0.001519s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.11% : 0.000518s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.064581 72 0.05% : 0.000035s : 1: add_recomputation 0.08% : 0.000055s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.50% : 0.000322s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.75% : 0.006296s : 1: jit_opt_a 0.23% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.67% : 0.000431s : 1: loop_unroll 0.88% : 0.000568s : 1: mutable_eliminate 1.29% : 0.000836s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000466s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000255s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 2.02% : 0.001304s : 1: renormalize.infer 0.84% : 0.000545s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000031s : 1: rewriter_after_opt_a 0.12% : 0.000080s : 1: rewriter_before_opt_a 0.20% : 0.000129s : 1: symbol_engine_optimizer 81.62% : 0.052712s : 1: type_inference TotalTime = 0.0630312, [30] [bootstrap]: 0.00027057 [type_inference]: 0.0533079 [event_method]: 1.8e-05 [auto_monad]: 6.97e-05 [graph_reusing]: 6.34001e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00025689 [rewriter_before_opt_a]: 8.211e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00680705, [2] [Cycle 1]: 0.00304807, [27] [switch_simplify]: 6.063e-05 [loop_unroll]: 2.994e-05 [a_1]: 0.00057721 [with_stream_mark]: 1.992e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 4.37e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.92002e-06 [parameter_eliminate]: 1.71002e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.24001e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.551e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 9.27001e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 0.0020001 [add_forward_monad_depend]: 6.51999e-06 [auto_monad_grad]: 2.81e-06 [auto_monad_eliminator]: 1.762e-05 [cse]: 3.361e-05 [replace_applicator]: 1.595e-05 [Cycle 2]: 0.0003613, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.96998e-06 [a_1]: 0.0001185 [with_stream_mark]: 1.091e-05 [recompute_prepare]: 5.57999e-06 [updatestate_depend_eliminate]: 3.57997e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 1.50001e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.43002e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.4e-06 [cell_reuse_recompute_pass]: 2.32001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 8.64e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 9.10019e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.163e-05 [replace_applicator]: 5.79999e-06 [py_interpret_to_execute_after_opt_a]: 1.242e-05 [rewriter_after_opt_a]: 3.532e-05 [convert_after_rewriter]: 7.25e-06 [order_py_execute_after_rewriter]: 4.99003e-06 [mutable_eliminate]: 0.00065097 [jit_opt_b]: 5.261e-05, [1] [Cycle 1]: 4.617e-05, [2] [frontend_op_eliminate]: 1.782e-05 [inline_after_opt_a]: 1.764e-05 [cconv]: 2.6e-05 [loop_unroll]: 0.00041844 [jit_opt_after_cconv]: 0.00014842, [1] [Cycle 1]: 0.00014226, [11] [c_1]: 2.639e-05 [parameter_eliminate]: 2.59001e-06 [updatestate_depend_eliminate]: 5.48002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 1.977e-05 [call_graph_tuple_transform]: 2.058e-05 [tuple_list_get_item_eliminator]: 5.87001e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.645e-05 [partial_unused_args_eliminate]: 2.11e-06 [environ_conv]: 8.20999e-06 [add_recomputation]: 4.801e-05 [cse_after_recomputation]: 2.157e-05, [1] [Cycle 1]: 1.588e-05, [1] [cse]: 1.048e-05 [auto_monad_reorder]: 1.629e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.74998e-06 [opt_after_jit_grad]: 0.00045361 [symbol_engine_optimizer]: 7.38e-05, [1] [Cycle 1]: 6.774e-05, [6] [build]: 3.45998e-06 [elim_shapecalc]: 8.40999e-06 [elim_not_effective]: 1.323e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 9.24998e-06 [renormalize]: 7.89994e-07 [validate]: 4.075e-05 Sums bootstrap : 0.000271s : 0.46% type_inference : 0.053308s : 90.26% event_method : 0.000018s : 0.03% auto_monad : 0.000070s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000257s : 0.43% rewriter_before_opt_a : 0.000082s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000067s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000696s : 1.18% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002000s : 3.39% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000045s : 0.08% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000651s : 1.10% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000418s : 0.71% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000454s : 0.77% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000216 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000002s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 4: substitution.graph_param_transform 83.68% : 0.000181s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.58% : 0.000006s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.57% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053233 2 96.56% : 0.051403s : 1: type_inference.infer 3.44% : 0.001830s : 1: type_inference.specialize ------[replace.] 0.000072 6 65.95% : 0.000047s : 4: replace.inline 34.05% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 94.20% : 0.000179s : 4: match.inline 5.80% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.35% : 0.000002s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.64% : 0.000002s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.98% : 0.000008s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.33% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.98% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.07% : 0.000001s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.47% : 0.000010s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.56% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002170 26 72.26% : 0.001568s : 19: func_graph_cloner_run.FuncGraphClonerGraph 2.02% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.71% : 0.000558s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066032 72 0.08% : 0.000051s : 1: add_recomputation 0.11% : 0.000073s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.43% : 0.000283s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.31% : 0.006811s : 1: jit_opt_a 0.23% : 0.000151s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.65% : 0.000426s : 1: loop_unroll 1.00% : 0.000659s : 1: mutable_eliminate 1.41% : 0.000931s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000262s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.05% : 0.001355s : 1: renormalize.infer 0.96% : 0.000636s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000086s : 1: rewriter_before_opt_a 0.12% : 0.000076s : 1: symbol_engine_optimizer 80.75% : 0.053321s : 1: type_inference TotalTime = 0.0120188, [30] [bootstrap]: 0.0002683 [type_inference]: 0.00424556 [event_method]: 1.691e-05 [auto_monad]: 6.105e-05 [graph_reusing]: 5.62999e-06 [pre_auto_parallel]: 1.84998e-06 [py_interpret_to_execute]: 3.381e-05 [rewriter_before_opt_a]: 6.873e-05 [expand_dump_flag]: 2.80002e-06 [jit_opt_a]: 0.00516163, [2] [Cycle 1]: 0.001622, [27] [switch_simplify]: 5.109e-05 [loop_unroll]: 3e-05 [a_1]: 0.00052346 [with_stream_mark]: 1.799e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.18998e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.85001e-06 [specialize_transform]: 6.05002e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.79998e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 4.74998e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.472e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.77e-06 [inline_without_move]: 5.59998e-06 [renormalize]: 0.00068584 [add_forward_monad_depend]: 5.02999e-06 [auto_monad_grad]: 2.91999e-06 [auto_monad_eliminator]: 1.508e-05 [cse]: 2.535e-05 [replace_applicator]: 1.161e-05 [Cycle 2]: 0.00031425, [27] [switch_simplify]: 5.68002e-06 [loop_unroll]: 4.73001e-06 [a_1]: 8.953e-05 [with_stream_mark]: 9.42999e-06 [recompute_prepare]: 4.86002e-06 [updatestate_depend_eliminate]: 2.43e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 1.95001e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.86002e-06 [updatestate_useless_node_eliminater]: 4.75999e-06 [accelerated_algorithm]: 4.69002e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.87e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 8.02998e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.08e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.18001e-06 [auto_monad_grad]: 9.79984e-07 [auto_monad_eliminator]: 5.29e-06 [cse]: 1.096e-05 [replace_applicator]: 5.05999e-06 [py_interpret_to_execute_after_opt_a]: 1.091e-05 [rewriter_after_opt_a]: 3.515e-05 [convert_after_rewriter]: 6.39999e-06 [order_py_execute_after_rewriter]: 5.32999e-06 [mutable_eliminate]: 0.00061196 [jit_opt_b]: 4.865e-05, [1] [Cycle 1]: 4.207e-05, [2] [frontend_op_eliminate]: 1.577e-05 [inline_after_opt_a]: 1.544e-05 [cconv]: 2.499e-05 [loop_unroll]: 0.00041651 [jit_opt_after_cconv]: 0.0001386, [1] [Cycle 1]: 0.00013256, [11] [c_1]: 2.088e-05 [parameter_eliminate]: 2.81999e-06 [updatestate_depend_eliminate]: 5.63002e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 1.915e-05 [call_graph_tuple_transform]: 1.881e-05 [tuple_list_get_item_eliminator]: 5.46e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 1.549e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.58002e-06 [add_recomputation]: 4.746e-05 [cse_after_recomputation]: 2.012e-05, [1] [Cycle 1]: 1.475e-05, [1] [cse]: 8.94e-06 [auto_monad_reorder]: 1.477e-05 [get_jit_bprop_graph]: 1.87999e-06 [rewriter_after_jit_bprop_graph]: 5.59e-06 [opt_after_jit_grad]: 0.00046999 [symbol_engine_optimizer]: 7.232e-05, [1] [Cycle 1]: 6.611e-05, [6] [build]: 3.84002e-06 [elim_shapecalc]: 8.00999e-06 [elim_not_effective]: 1.343e-05 [opt_reshape]: 5.47001e-06 [fold_const_symbol]: 8.69e-06 [renormalize]: 3.69997e-07 [validate]: 3.486e-05 Sums bootstrap : 0.000268s : 3.26% type_inference : 0.004246s : 51.52% event_method : 0.000017s : 0.21% auto_monad : 0.000061s : 0.74% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.41% rewriter_before_opt_a : 0.000069s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.69% jit_opt_a.loop_unroll : 0.000035s : 0.42% jit_opt_a.a_1 : 0.000613s : 7.44% jit_opt_a.with_stream_mark : 0.000027s : 0.33% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000686s : 8.32% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.05% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.25% jit_opt_a.cse : 0.000036s : 0.44% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000035s : 0.43% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000612s : 7.43% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000025s : 0.30% loop_unroll : 0.000417s : 5.05% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000047s : 0.58% cse_after_recomputation.cse : 0.000009s : 0.11% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000470s : 5.70% symbol_engine_optimizer.build : 0.000004s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.42% Time group info: ------[substitution.] 0.000200 23 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000002s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 3: substitution.graph_param_transform 82.38% : 0.000165s : 4: substitution.inline 1.91% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000006s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 5.98% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004191 2 79.86% : 0.003347s : 1: type_inference.infer 20.14% : 0.000844s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.87% : 0.000044s : 4: replace.inline 33.13% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000173 6 93.69% : 0.000162s : 4: match.inline 6.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.29% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.39% : 0.000002s : 10: predicate.addn_zero_filter 2.07% : 0.000002s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.28% : 0.000001s : 10: predicate.depend_value_elim 1.26% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.23% : 0.000001s : 6: predicate.less_batch_normalization 1.64% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.04% : 0.000002s : 15: predicate.load_eliminater 1.60% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.12% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.46% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 2.05% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.25% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.47% : 0.000001s : 3: predicate.reset_defer_inline 1.17% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.07% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 16: predicate.switch_defer_inline 2.07% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.31% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.62% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000608 13 46.14% : 0.000281s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.07% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.79% : 0.000297s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013578 72 0.37% : 0.000050s : 1: add_recomputation 0.47% : 0.000064s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.06% : 0.000280s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000022s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 38.04% : 0.005165s : 1: jit_opt_a 1.04% : 0.000141s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.12% : 0.000424s : 1: loop_unroll 4.58% : 0.000622s : 1: mutable_eliminate 6.05% : 0.000821s : 26: opt.transform.jit_opt_a 0.35% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.12% : 0.000016s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.52% : 0.000478s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000036s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.63% : 0.000358s : 1: renormalize.infer 2.35% : 0.000319s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000038s : 1: rewriter_after_opt_a 0.53% : 0.000072s : 1: rewriter_before_opt_a 0.55% : 0.000075s : 1: symbol_engine_optimizer 31.35% : 0.004257s : 1: type_inference TotalTime = 0.0122793, [30] [bootstrap]: 0.00029098 [type_inference]: 0.00480454 [event_method]: 1.718e-05 [auto_monad]: 5.545e-05 [graph_reusing]: 4.52e-06 [pre_auto_parallel]: 1.87999e-06 [py_interpret_to_execute]: 3.815e-05 [rewriter_before_opt_a]: 6.954e-05 [expand_dump_flag]: 2.70997e-06 [jit_opt_a]: 0.00499405, [2] [Cycle 1]: 0.00149851, [27] [switch_simplify]: 5.131e-05 [loop_unroll]: 2.939e-05 [a_1]: 0.00049092 [with_stream_mark]: 1.524e-05 [recompute_prepare]: 7.02002e-06 [updatestate_depend_eliminate]: 3.94002e-06 [updatestate_assign_eliminate]: 3.03e-06 [updatestate_loads_eliminate]: 2.47001e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 4.99e-06 [accelerated_algorithm]: 5.14003e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 4.95999e-06 [merge_forward]: 3.26001e-06 [cell_reuse_recompute_pass]: 8.40024e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 8.43999e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 0.00062076 [add_forward_monad_depend]: 3.91001e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 1.083e-05 [cse]: 1.97e-05 [replace_applicator]: 1.119e-05 [Cycle 2]: 0.00035189, [27] [switch_simplify]: 5.40999e-06 [loop_unroll]: 4.80999e-06 [a_1]: 0.00013034 [with_stream_mark]: 8.72e-06 [recompute_prepare]: 5.52999e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.06003e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.05001e-06 [updatestate_useless_node_eliminater]: 5.20999e-06 [accelerated_algorithm]: 4.63999e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.41002e-06 [merge_forward]: 2.30002e-06 [cell_reuse_recompute_pass]: 1.10001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.364e-05 [j_node_and_user_rematch]: 7.92e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 6.86001e-06 [inline_without_move]: 4.72e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.02001e-06 [cse]: 1.093e-05 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 9.79e-06 [rewriter_after_opt_a]: 3.474e-05 [convert_after_rewriter]: 7.4e-06 [order_py_execute_after_rewriter]: 4.77e-06 [mutable_eliminate]: 0.00051913 [jit_opt_b]: 4.72e-05, [1] [Cycle 1]: 4.082e-05, [2] [frontend_op_eliminate]: 1.534e-05 [inline_after_opt_a]: 1.504e-05 [cconv]: 2.613e-05 [loop_unroll]: 0.00039796 [jit_opt_after_cconv]: 0.0001341, [1] [Cycle 1]: 0.00012727, [11] [c_1]: 2.009e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.08002e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.18998e-06 [cse]: 1.78e-05 [call_graph_tuple_transform]: 1.786e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.50001e-06 [renormalize]: 4.40021e-07 [switch_simplify]: 5.10999e-06 [remove_dup_value]: 1.496e-05 [partial_unused_args_eliminate]: 2.37001e-06 [environ_conv]: 5.40001e-06 [add_recomputation]: 4.59e-05 [cse_after_recomputation]: 2.026e-05, [1] [Cycle 1]: 1.545e-05, [1] [cse]: 1.005e-05 [auto_monad_reorder]: 1.552e-05 [get_jit_bprop_graph]: 1.64998e-06 [rewriter_after_jit_bprop_graph]: 4.72998e-06 [opt_after_jit_grad]: 0.00043923 [symbol_engine_optimizer]: 6.955e-05, [1] [Cycle 1]: 6.353e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 7.82e-06 [elim_not_effective]: 1.244e-05 [opt_reshape]: 5.42999e-06 [fold_const_symbol]: 8.64e-06 [renormalize]: 3.30008e-07 [validate]: 3.317e-05 Sums bootstrap : 0.000291s : 3.39% type_inference : 0.004805s : 55.94% event_method : 0.000017s : 0.20% auto_monad : 0.000055s : 0.65% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.44% rewriter_before_opt_a : 0.000070s : 0.81% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000057s : 0.66% jit_opt_a.loop_unroll : 0.000034s : 0.40% jit_opt_a.a_1 : 0.000621s : 7.23% jit_opt_a.with_stream_mark : 0.000024s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000009s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000621s : 7.23% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.20% jit_opt_a.cse : 0.000031s : 0.36% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000035s : 0.40% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000519s : 6.04% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000026s : 0.30% loop_unroll : 0.000398s : 4.63% jit_opt_after_cconv.c_1 : 0.000020s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000046s : 0.53% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000016s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000439s : 5.11% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.39% Time group info: ------[substitution.] 0.000175 23 1.20% : 0.000002s : 2: substitution.elim_not_effective 0.94% : 0.000002s : 2: substitution.fold_const_symbol 3.14% : 0.000005s : 3: substitution.graph_param_transform 82.26% : 0.000144s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000004s : 2: substitution.replace_old_param 6.00% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004748 2 80.60% : 0.003826s : 1: type_inference.infer 19.40% : 0.000921s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.44% : 0.000043s : 4: replace.inline 32.56% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 93.75% : 0.000141s : 4: match.inline 6.25% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 0.95% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.29% : 0.000001s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.45% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.13% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.06% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.51% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.95% : 0.000002s : 3: predicate.mutable_eliminate 0.54% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.11% : 0.000001s : 10: predicate.print_const_string_wrapper 1.85% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 3: predicate.row_tensor_eliminate 1.25% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.27% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.69% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.36% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000636 13 51.33% : 0.000326s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.55% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.12% : 0.000281s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013773 72 0.35% : 0.000049s : 1: add_recomputation 0.43% : 0.000059s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.23% : 0.000308s : 1: bootstrap 0.21% : 0.000029s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000022s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000021s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.28% : 0.004997s : 1: jit_opt_a 0.99% : 0.000137s : 1: jit_opt_after_cconv 0.36% : 0.000049s : 1: jit_opt_b 2.94% : 0.000405s : 1: loop_unroll 3.83% : 0.000527s : 1: mutable_eliminate 5.98% : 0.000823s : 26: opt.transform.jit_opt_a 0.33% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.24% : 0.000447s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000041s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.28% : 0.000314s : 1: renormalize.infer 2.18% : 0.000301s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000037s : 1: rewriter_after_opt_a 0.53% : 0.000072s : 1: rewriter_before_opt_a 0.53% : 0.000072s : 1: symbol_engine_optimizer 34.97% : 0.004817s : 1: type_inference TotalTime = 0.109931, [30] [bootstrap]: 0.00025722 [type_inference]: 0.100048 [event_method]: 1.828e-05 [auto_monad]: 5.839e-05 [graph_reusing]: 4.37e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 0.00039845 [rewriter_before_opt_a]: 7.83e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00682463, [2] [Cycle 1]: 0.00319716, [27] [switch_simplify]: 4.78e-05 [loop_unroll]: 3.021e-05 [a_1]: 0.00051347 [with_stream_mark]: 1.328e-05 [recompute_prepare]: 8.54998e-06 [updatestate_depend_eliminate]: 3.50003e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.39998e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 2.99999e-06 [cell_reuse_recompute_pass]: 8.49977e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.193e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 9.17999e-06 [inline_without_move]: 5.82001e-06 [renormalize]: 0.00228259 [add_forward_monad_depend]: 6.07001e-06 [auto_monad_grad]: 2.42001e-06 [auto_monad_eliminator]: 1.531e-05 [cse]: 2.461e-05 [replace_applicator]: 1.325e-05 [Cycle 2]: 0.00036026, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 6.01e-06 [a_1]: 0.00012752 [with_stream_mark]: 9.37001e-06 [recompute_prepare]: 5.71e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 8.22e-06 [inline_without_move]: 5.31998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.34e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.102e-05 [replace_applicator]: 5.76003e-06 [py_interpret_to_execute_after_opt_a]: 9.84001e-06 [rewriter_after_opt_a]: 3.237e-05 [convert_after_rewriter]: 6.33e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00059856 [jit_opt_b]: 5.298e-05, [1] [Cycle 1]: 4.647e-05, [2] [frontend_op_eliminate]: 1.832e-05 [inline_after_opt_a]: 1.749e-05 [cconv]: 2.382e-05 [loop_unroll]: 0.00041556 [jit_opt_after_cconv]: 0.00014762, [1] [Cycle 1]: 0.00014151, [11] [c_1]: 2.477e-05 [parameter_eliminate]: 2.73e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.25002e-06 [cse]: 2.22e-05 [call_graph_tuple_transform]: 1.975e-05 [tuple_list_get_item_eliminator]: 6.20002e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 6.89994e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.274e-05 [partial_unused_args_eliminate]: 2.27001e-06 [environ_conv]: 7.31001e-06 [add_recomputation]: 4.523e-05 [cse_after_recomputation]: 2.094e-05, [1] [Cycle 1]: 1.547e-05, [1] [cse]: 1.036e-05 [auto_monad_reorder]: 1.35e-05 [get_jit_bprop_graph]: 2.17999e-06 [rewriter_after_jit_bprop_graph]: 5.15999e-06 [opt_after_jit_grad]: 0.00044524 [symbol_engine_optimizer]: 0.00012979, [1] [Cycle 1]: 6.874e-05, [6] [build]: 3.21999e-06 [elim_shapecalc]: 9.41e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 6.30002e-06 [fold_const_symbol]: 8.79998e-06 [renormalize]: 2.9002e-07 [validate]: 9.532e-05 Sums bootstrap : 0.000257s : 0.24% type_inference : 0.100048s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000058s : 0.06% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000398s : 0.38% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000641s : 0.60% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002283s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000599s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000416s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000445s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000095s : 0.09% Time group info: ------[substitution.] 0.000167 24 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.17% : 0.000005s : 4: substitution.graph_param_transform 81.73% : 0.000137s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.85% : 0.000005s : 4: substitution.remove_not_recompute_node 2.65% : 0.000004s : 2: substitution.replace_old_param 6.05% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099981 2 97.66% : 0.097642s : 1: type_inference.infer 2.34% : 0.002339s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.20% : 0.000042s : 4: replace.inline 33.80% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 93.70% : 0.000134s : 4: match.inline 6.30% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 2.02% : 0.000003s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.75% : 0.000001s : 4: predicate.graph_param_transform 5.15% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.07% : 0.000001s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.20% : 0.000003s : 18: predicate.load_eliminater 1.55% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.92% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.57% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.45% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.90% : 0.000001s : 4: predicate.row_tensor_eliminate 1.57% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.38% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.39% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 1.00% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001838 22 67.20% : 0.001235s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.50% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.30% : 0.000575s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113088 72 0.04% : 0.000048s : 1: add_recomputation 0.05% : 0.000062s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000269s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.04% : 0.006828s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000424s : 1: loop_unroll 0.54% : 0.000607s : 1: mutable_eliminate 0.76% : 0.000860s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000453s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000404s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.46% : 0.001648s : 1: renormalize.infer 0.56% : 0.000628s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.12% : 0.000132s : 1: symbol_engine_optimizer 88.48% : 0.100065s : 1: type_inference TotalTime = 0.112144, [30] [bootstrap]: 0.00026919 [type_inference]: 0.101667 [event_method]: 1.817e-05 [auto_monad]: 6.704e-05 [graph_reusing]: 5.71003e-06 [pre_auto_parallel]: 2.11e-06 [py_interpret_to_execute]: 0.0004537 [rewriter_before_opt_a]: 7.883e-05 [expand_dump_flag]: 3.36999e-06 [jit_opt_a]: 0.00711539, [2] [Cycle 1]: 0.00350441, [27] [switch_simplify]: 5.245e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00054873 [with_stream_mark]: 1.627e-05 [recompute_prepare]: 8.23999e-06 [updatestate_depend_eliminate]: 3.36999e-06 [updatestate_assign_eliminate]: 2.81e-06 [updatestate_loads_eliminate]: 2.84001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 6.21e-06 [accelerated_algorithm]: 6.19999e-06 [meta_shard_fg_expand]: 2.23998e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.49001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.475e-05 [j_node_and_user_rematch]: 9.69e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.95002e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00251106 [add_forward_monad_depend]: 6.90002e-06 [auto_monad_grad]: 2.22001e-06 [auto_monad_eliminator]: 1.7e-05 [cse]: 3.26e-05 [replace_applicator]: 1.883e-05 [Cycle 2]: 0.00038077, [27] [switch_simplify]: 6.79001e-06 [loop_unroll]: 5.75001e-06 [a_1]: 0.00012232 [with_stream_mark]: 1.134e-05 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 2.02001e-06 [specialize_transform]: 5.49998e-06 [updatestate_useless_node_eliminater]: 6.09001e-06 [accelerated_algorithm]: 6.09001e-06 [meta_shard_fg_expand]: 1.92001e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 3.21999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.994e-05 [j_node_and_user_rematch]: 9.69999e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.81998e-06 [inline_without_move]: 6.12999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 8.49977e-07 [auto_monad_eliminator]: 7.3e-06 [cse]: 1.266e-05 [replace_applicator]: 5.98998e-06 [py_interpret_to_execute_after_opt_a]: 1.057e-05 [rewriter_after_opt_a]: 3.505e-05 [convert_after_rewriter]: 7.58001e-06 [order_py_execute_after_rewriter]: 1.213e-05 [mutable_eliminate]: 0.00072242 [jit_opt_b]: 5.599e-05, [1] [Cycle 1]: 4.965e-05, [2] [frontend_op_eliminate]: 1.959e-05 [inline_after_opt_a]: 1.917e-05 [cconv]: 2.616e-05 [loop_unroll]: 0.00045535 [jit_opt_after_cconv]: 0.00016051, [1] [Cycle 1]: 0.00015448, [11] [c_1]: 2.609e-05 [parameter_eliminate]: 3.43e-06 [updatestate_depend_eliminate]: 5.61e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.33998e-06 [cse]: 2.708e-05 [call_graph_tuple_transform]: 2.261e-05 [tuple_list_get_item_eliminator]: 6.01e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 7.00005e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.546e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 9.47001e-06 [add_recomputation]: 4.776e-05 [cse_after_recomputation]: 2.346e-05, [1] [Cycle 1]: 1.732e-05, [1] [cse]: 1.126e-05 [auto_monad_reorder]: 1.625e-05 [get_jit_bprop_graph]: 1.93002e-06 [rewriter_after_jit_bprop_graph]: 5.79e-06 [opt_after_jit_grad]: 0.00044676 [symbol_engine_optimizer]: 8.05e-05, [1] [Cycle 1]: 7.505e-05, [6] [build]: 3.45e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.53e-05 [opt_reshape]: 6.04999e-06 [fold_const_symbol]: 1.219e-05 [renormalize]: 5.79981e-07 [validate]: 0.00016179 Sums bootstrap : 0.000269s : 0.25% type_inference : 0.101667s : 93.84% event_method : 0.000018s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000454s : 0.42% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000671s : 0.62% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002511s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000012s : 0.01% mutable_eliminate : 0.000722s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000455s : 0.42% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000027s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000447s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000162s : 0.15% Time group info: ------[substitution.] 0.000201 24 2.09% : 0.000004s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 3.26% : 0.000007s : 4: substitution.graph_param_transform 79.40% : 0.000159s : 4: substitution.inline 1.90% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.33% : 0.000007s : 4: substitution.remove_not_recompute_node 2.97% : 0.000006s : 2: substitution.replace_old_param 6.32% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101601 2 97.51% : 0.099073s : 1: type_inference.infer 2.49% : 0.002528s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.40% : 0.000046s : 4: replace.inline 33.60% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.11% : 0.000157s : 4: match.inline 6.89% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.33% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.20% : 0.000002s : 8: predicate.get_grad_eliminate 0.64% : 0.000001s : 4: predicate.graph_param_transform 5.46% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.64% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.49% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 1.03% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.30% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.19% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.34% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.16% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.14% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.48% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001959 22 65.93% : 0.001292s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.77% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.29% : 0.000633s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115521 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000281s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.16% : 0.007119s : 1: jit_opt_a 0.14% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.40% : 0.000464s : 1: loop_unroll 0.63% : 0.000730s : 1: mutable_eliminate 0.79% : 0.000908s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000039s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000014s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000459s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.57% : 0.001814s : 1: renormalize.infer 0.60% : 0.000688s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.07% : 0.000083s : 1: symbol_engine_optimizer 88.02% : 0.101681s : 1: type_inference TotalTime = 0.111199, [30] [bootstrap]: 0.00025612 [type_inference]: 0.101169 [event_method]: 1.815e-05 [auto_monad]: 6.738e-05 [graph_reusing]: 5.34e-06 [pre_auto_parallel]: 2.16e-06 [py_interpret_to_execute]: 0.00040488 [rewriter_before_opt_a]: 7.745e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00702136, [2] [Cycle 1]: 0.0034082, [27] [switch_simplify]: 5.762e-05 [loop_unroll]: 2.953e-05 [a_1]: 0.00054456 [with_stream_mark]: 1.696e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.77001e-06 [specialize_transform]: 6.49999e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 5.89999e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 4.15999e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.547e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.63e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 6.23e-06 [renormalize]: 0.00242034 [add_forward_monad_depend]: 7.06999e-06 [auto_monad_grad]: 2.35002e-06 [auto_monad_eliminator]: 1.748e-05 [cse]: 2.84e-05 [replace_applicator]: 1.869e-05 [Cycle 2]: 0.00036736, [27] [switch_simplify]: 6.58998e-06 [loop_unroll]: 6.10002e-06 [a_1]: 0.00011818 [with_stream_mark]: 1.225e-05 [recompute_prepare]: 5.83997e-06 [updatestate_depend_eliminate]: 3.97e-06 [updatestate_assign_eliminate]: 2.58998e-06 [updatestate_loads_eliminate]: 2.36e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 5.49e-06 [updatestate_useless_node_eliminater]: 5.79e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.95001e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.769e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 1.96998e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 5.56e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 1.19e-06 [auto_monad_eliminator]: 6.69001e-06 [cse]: 1.199e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 2.458e-05 [rewriter_after_opt_a]: 3.701e-05 [convert_after_rewriter]: 7.63999e-06 [order_py_execute_after_rewriter]: 5.72001e-06 [mutable_eliminate]: 0.00058184 [jit_opt_b]: 5.122e-05, [1] [Cycle 1]: 4.483e-05, [2] [frontend_op_eliminate]: 1.76e-05 [inline_after_opt_a]: 1.723e-05 [cconv]: 2.498e-05 [loop_unroll]: 0.00042486 [jit_opt_after_cconv]: 0.00014632, [1] [Cycle 1]: 0.00014012, [11] [c_1]: 2.457e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.51998e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.03002e-06 [cse]: 2.197e-05 [call_graph_tuple_transform]: 2.013e-05 [tuple_list_get_item_eliminator]: 5.83997e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 6.19999e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 8.08999e-06 [add_recomputation]: 4.805e-05 [cse_after_recomputation]: 2.039e-05, [1] [Cycle 1]: 1.534e-05, [1] [cse]: 9.80002e-06 [auto_monad_reorder]: 1.471e-05 [get_jit_bprop_graph]: 2.03002e-06 [rewriter_after_jit_bprop_graph]: 5.10999e-06 [opt_after_jit_grad]: 0.00044781 [symbol_engine_optimizer]: 9.869e-05, [1] [Cycle 1]: 9.251e-05, [6] [build]: 2.76999e-06 [elim_shapecalc]: 8.23999e-06 [elim_not_effective]: 1.28e-05 [opt_reshape]: 6.09999e-06 [fold_const_symbol]: 3.557e-05 [renormalize]: 3.7998e-07 [validate]: 4.093e-05 Sums bootstrap : 0.000256s : 0.24% type_inference : 0.101169s : 94.20% event_method : 0.000018s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000405s : 0.38% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000663s : 0.62% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002420s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000025s : 0.02% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000582s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000425s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000448s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000036s : 0.03% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000194 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.02% : 0.000006s : 4: substitution.graph_param_transform 81.92% : 0.000159s : 4: substitution.inline 1.96% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.06% : 0.000006s : 4: substitution.remove_not_recompute_node 2.55% : 0.000005s : 2: substitution.replace_old_param 5.86% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101093 2 97.60% : 0.098672s : 1: type_inference.infer 2.40% : 0.002421s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.56% : 0.000046s : 4: replace.inline 32.44% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.80% : 0.000157s : 4: match.inline 6.20% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.48% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000002s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000000s : 4: predicate.graph_param_transform 5.70% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.07% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000001s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.44% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.82% : 0.000010s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.20% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.47% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001930 22 65.56% : 0.001265s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.87% : 0.000634s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114610 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000272s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.13% : 0.007025s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.38% : 0.000432s : 1: loop_unroll 0.51% : 0.000590s : 1: mutable_eliminate 0.78% : 0.000899s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000060s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000410s : 1: py_interpret_to_execute 0.02% : 0.000028s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.50% : 0.001723s : 1: renormalize.infer 0.60% : 0.000689s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.09% : 0.000101s : 1: symbol_engine_optimizer 88.28% : 0.101183s : 1: type_inference TotalTime = 0.0636532, [30] [bootstrap]: 0.00027515 [type_inference]: 0.0542061 [event_method]: 1.653e-05 [auto_monad]: 6.068e-05 [graph_reusing]: 4.42e-06 [pre_auto_parallel]: 1.87999e-06 [py_interpret_to_execute]: 0.0002398 [rewriter_before_opt_a]: 7.593e-05 [expand_dump_flag]: 3.3e-06 [jit_opt_a]: 0.00655382, [2] [Cycle 1]: 0.00290234, [27] [switch_simplify]: 4.8e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00052583 [with_stream_mark]: 1.505e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.51998e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 6.62002e-06 [updatestate_useless_node_eliminater]: 5.87001e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 6.01998e-06 [merge_forward]: 3.22002e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.395e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.33002e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00196756 [add_forward_monad_depend]: 5.72001e-06 [auto_monad_grad]: 2.04999e-06 [auto_monad_eliminator]: 1.623e-05 [cse]: 2.995e-05 [replace_applicator]: 1.444e-05 [Cycle 2]: 0.00040087, [27] [switch_simplify]: 6.49999e-06 [loop_unroll]: 5.66e-06 [a_1]: 0.00016501 [with_stream_mark]: 9.94001e-06 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.71003e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 5.10001e-06 [merge_forward]: 2.51998e-06 [cell_reuse_recompute_pass]: 1.89e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.335e-05 [j_node_and_user_rematch]: 8.65999e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 5.39e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.21002e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 7.06999e-06 [cse]: 1.217e-05 [replace_applicator]: 5.71998e-06 [py_interpret_to_execute_after_opt_a]: 8.80001e-06 [rewriter_after_opt_a]: 3.27e-05 [convert_after_rewriter]: 7e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00060748 [jit_opt_b]: 6.611e-05, [1] [Cycle 1]: 4.51e-05, [2] [frontend_op_eliminate]: 1.75e-05 [inline_after_opt_a]: 1.703e-05 [cconv]: 2.541e-05 [loop_unroll]: 0.00042279 [jit_opt_after_cconv]: 0.0001483, [1] [Cycle 1]: 0.00014119, [11] [c_1]: 2.521e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 6.53e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.97e-05 [call_graph_tuple_transform]: 2e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.518e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 8.17e-06 [add_recomputation]: 4.413e-05 [cse_after_recomputation]: 2.177e-05, [1] [Cycle 1]: 1.539e-05, [1] [cse]: 1.01e-05 [auto_monad_reorder]: 1.522e-05 [get_jit_bprop_graph]: 1.55001e-06 [rewriter_after_jit_bprop_graph]: 5.49e-06 [opt_after_jit_grad]: 0.00044811 [symbol_engine_optimizer]: 7.156e-05, [1] [Cycle 1]: 6.608e-05, [6] [build]: 2.66e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.343e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 9.18002e-06 [renormalize]: 4.60015e-07 [validate]: 4.508e-05 Sums bootstrap : 0.000275s : 0.46% type_inference : 0.054206s : 90.66% event_method : 0.000017s : 0.03% auto_monad : 0.000061s : 0.10% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000240s : 0.40% rewriter_before_opt_a : 0.000076s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000055s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000691s : 1.16% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001968s : 3.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000020s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000607s : 1.02% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000423s : 0.71% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000448s : 0.75% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.000176 24 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.31% : 0.000006s : 4: substitution.graph_param_transform 81.69% : 0.000144s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.33% : 0.000004s : 2: substitution.replace_old_param 6.49% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054139 2 96.61% : 0.052304s : 1: type_inference.infer 3.39% : 0.001834s : 1: type_inference.specialize ------[replace.] 0.000065 6 65.62% : 0.000042s : 4: replace.inline 34.38% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 93.22% : 0.000141s : 4: match.inline 6.78% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000172 830 1.02% : 0.000002s : 12: predicate.accumulaten_eliminater 0.79% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.81% : 0.000001s : 12: predicate.addn_check_dump 0.90% : 0.000002s : 12: predicate.addn_zero_filter 1.54% : 0.000003s : 12: predicate.arithmetic_simplify 1.04% : 0.000002s : 12: predicate.cast_eliminate 0.38% : 0.000001s : 4: predicate.check_bprop_eliminate 0.79% : 0.000001s : 12: predicate.compare_switch_simplify 0.92% : 0.000002s : 12: predicate.depend_value_elim 0.83% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 0.92% : 0.000002s : 12: predicate.dict_get_item_eliminator 26.83% : 0.000046s : 12: predicate.dict_set_item_eliminator 0.75% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.26% : 0.000000s : 4: predicate.elim_not_effective 0.48% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.03% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.83% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.84% : 0.000001s : 12: predicate.environ_get_depend_swap 0.88% : 0.000002s : 12: predicate.environ_get_eliminate 0.84% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 4: predicate.fold_const_symbol 0.75% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000001s : 4: predicate.graph_param_transform 3.93% : 0.000007s : 26: predicate.inline 0.72% : 0.000001s : 8: predicate.inline_without_move 0.35% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.01% : 0.000002s : 8: predicate.less_batch_normalization 1.27% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.44% : 0.000002s : 18: predicate.load_eliminater 0.99% : 0.000002s : 4: predicate.loop_unroll_after_grad 2.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.58% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.81% : 0.000001s : 12: predicate.merge_addn 0.81% : 0.000001s : 12: predicate.minmaximum_grad 0.96% : 0.000002s : 4: predicate.mutable_eliminate 0.43% : 0.000001s : 4: predicate.opt_reshape 1.68% : 0.000003s : 18: predicate.partial_eliminate 0.95% : 0.000002s : 12: predicate.print_const_string_wrapper 1.32% : 0.000002s : 12: predicate.reduce_eliminate 1.16% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.69% : 0.000003s : 22: predicate.replace_applicator 0.49% : 0.000001s : 8: predicate.replace_old_param 0.28% : 0.000000s : 4: predicate.reset_defer_inline 0.97% : 0.000002s : 12: predicate.reshape_eliminate 0.97% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.55% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.52% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.72% : 0.000001s : 8: predicate.special_op_eliminate 0.75% : 0.000001s : 8: predicate.specialize_transform 1.03% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 0.91% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.37% : 0.000001s : 4: predicate.switch_call_monad_eliminater 1.70% : 0.000003s : 18: predicate.switch_defer_inline 1.56% : 0.000003s : 18: predicate.switch_layer_defer_inline 5.15% : 0.000009s : 58: predicate.switch_simplify 0.98% : 0.000002s : 12: predicate.tile_eliminate 0.89% : 0.000002s : 12: predicate.transpose_eliminate 0.98% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 0.98% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 2.59% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.09% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.33% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.25% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.21% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.20% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.42% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002350 30 75.01% : 0.001762s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.21% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.78% : 0.000559s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.066595 72 0.07% : 0.000047s : 1: add_recomputation 0.10% : 0.000064s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.43% : 0.000286s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.85% : 0.006557s : 1: jit_opt_a 0.23% : 0.000151s : 1: jit_opt_after_cconv 0.10% : 0.000068s : 1: jit_opt_b 0.65% : 0.000430s : 1: loop_unroll 0.92% : 0.000615s : 1: mutable_eliminate 1.37% : 0.000910s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000245s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.05% : 0.001365s : 1: renormalize.infer 0.89% : 0.000593s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000035s : 1: rewriter_after_opt_a 0.12% : 0.000080s : 1: rewriter_before_opt_a 0.20% : 0.000135s : 1: symbol_engine_optimizer 81.41% : 0.054218s : 1: type_inference TotalTime = 0.0589101, [30] [bootstrap]: 0.00024498 [type_inference]: 0.0499931 [event_method]: 1.663e-05 [auto_monad]: 6.503e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00025106 [rewriter_before_opt_a]: 7.492e-05 [expand_dump_flag]: 3.8e-06 [jit_opt_a]: 0.00613988, [2] [Cycle 1]: 0.00267459, [27] [switch_simplify]: 4.701e-05 [loop_unroll]: 2.961e-05 [a_1]: 0.00052421 [with_stream_mark]: 1.305e-05 [recompute_prepare]: 7.98999e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 6.52001e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.92001e-06 [meta_shard_fg_expand]: 1.63002e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.21997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.187e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.00176051 [add_forward_monad_depend]: 5.29e-06 [auto_monad_grad]: 2.30002e-06 [auto_monad_eliminator]: 1.448e-05 [cse]: 2.567e-05 [replace_applicator]: 1.524e-05 [Cycle 2]: 0.00034848, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.80002e-06 [a_1]: 0.00011594 [with_stream_mark]: 9.46e-06 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 2.78003e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.53002e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.84998e-06 [get_grad_eliminate_]: 5.01002e-06 [merge_forward]: 2.36e-06 [cell_reuse_recompute_pass]: 1.64e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.478e-05 [j_node_and_user_rematch]: 8.45999e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.57998e-06 [inline_without_move]: 5.34e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.10019e-07 [auto_monad_grad]: 9.60019e-07 [auto_monad_eliminator]: 5.27999e-06 [cse]: 1.092e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 8.69e-06 [rewriter_after_opt_a]: 2.92e-05 [convert_after_rewriter]: 6.33e-06 [order_py_execute_after_rewriter]: 4.58001e-06 [mutable_eliminate]: 0.0005623 [jit_opt_b]: 5.158e-05, [1] [Cycle 1]: 4.51e-05, [2] [frontend_op_eliminate]: 1.837e-05 [inline_after_opt_a]: 1.644e-05 [cconv]: 2.26e-05 [loop_unroll]: 0.00043283 [jit_opt_after_cconv]: 0.00014732, [1] [Cycle 1]: 0.00014065, [11] [c_1]: 2.495e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 2.28998e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 2.01e-05 [call_graph_tuple_transform]: 2.177e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.39e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 7.06999e-06 [add_recomputation]: 4.444e-05 [cse_after_recomputation]: 2.143e-05, [1] [Cycle 1]: 1.646e-05, [1] [cse]: 1.089e-05 [auto_monad_reorder]: 1.352e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.25e-06 [opt_after_jit_grad]: 0.00046175 [symbol_engine_optimizer]: 7.276e-05, [1] [Cycle 1]: 6.673e-05, [6] [build]: 2.98e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.33e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 8.70001e-06 [renormalize]: 5.8001e-07 [validate]: 3.969e-05 Sums bootstrap : 0.000245s : 0.44% type_inference : 0.049993s : 90.47% event_method : 0.000017s : 0.03% auto_monad : 0.000065s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000251s : 0.45% rewriter_before_opt_a : 0.000075s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000640s : 1.16% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001761s : 3.19% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000037s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000029s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000562s : 1.02% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000433s : 0.78% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000044s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000462s : 0.84% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.07% Time group info: ------[substitution.] 0.000179 24 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.16% : 0.000006s : 4: substitution.graph_param_transform 81.85% : 0.000146s : 4: substitution.inline 1.81% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000004s : 2: substitution.replace_old_param 6.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049927 2 96.47% : 0.048164s : 1: type_inference.infer 3.53% : 0.001763s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.13% : 0.000044s : 4: replace.inline 32.87% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 93.03% : 0.000144s : 4: match.inline 6.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.14% : 0.000001s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.16% : 0.000001s : 12: predicate.addn_zero_filter 1.70% : 0.000002s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000001s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.37% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.31% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.53% : 0.000001s : 4: predicate.graph_param_transform 4.98% : 0.000006s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.99% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.85% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000001s : 12: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.69% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000001s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001982 26 71.62% : 0.001419s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.95% : 0.000534s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061590 72 0.08% : 0.000047s : 1: add_recomputation 0.11% : 0.000068s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.42% : 0.000258s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.97% : 0.006143s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.72% : 0.000441s : 1: loop_unroll 0.93% : 0.000570s : 1: mutable_eliminate 1.39% : 0.000858s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000469s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000256s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.92% : 0.001185s : 1: renormalize.infer 0.92% : 0.000568s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.13% : 0.000079s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 81.19% : 0.050003s : 1: type_inference TotalTime = 0.0112728, [30] [bootstrap]: 0.00027083 [type_inference]: 0.00417383 [event_method]: 1.599e-05 [auto_monad]: 5.253e-05 [graph_reusing]: 4.31002e-06 [pre_auto_parallel]: 2.09999e-06 [py_interpret_to_execute]: 2.996e-05 [rewriter_before_opt_a]: 6.686e-05 [expand_dump_flag]: 2.66e-06 [jit_opt_a]: 0.00470395, [2] [Cycle 1]: 0.0013898, [27] [switch_simplify]: 4.489e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00046654 [with_stream_mark]: 1.523e-05 [recompute_prepare]: 6.68e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.25999e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 2.61999e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 3.64002e-06 [cell_reuse_recompute_pass]: 1.07998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.38999e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 8.50001e-06 [inline_without_move]: 5.12e-06 [renormalize]: 0.00053313 [add_forward_monad_depend]: 4.99998e-06 [auto_monad_grad]: 1.77999e-06 [auto_monad_eliminator]: 1.399e-05 [cse]: 2.891e-05 [replace_applicator]: 1.088e-05 [Cycle 2]: 0.00030934, [27] [switch_simplify]: 5.32999e-06 [loop_unroll]: 4.67e-06 [a_1]: 9.037e-05 [with_stream_mark]: 8.64003e-06 [recompute_prepare]: 4.90001e-06 [updatestate_depend_eliminate]: 2.64001e-06 [updatestate_assign_eliminate]: 2.04e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 5.02e-06 [accelerated_algorithm]: 4.76002e-06 [meta_shard_fg_expand]: 1.20999e-06 [get_grad_eliminate_]: 4.42e-06 [merge_forward]: 2.80002e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 7.25e-06 [meta_fg_expand]: 1.45001e-06 [replace_old_param]: 6.98e-06 [inline_without_move]: 4.61002e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 1.077e-05 [replace_applicator]: 4.68999e-06 [py_interpret_to_execute_after_opt_a]: 7.8e-06 [rewriter_after_opt_a]: 3.216e-05 [convert_after_rewriter]: 7.24001e-06 [order_py_execute_after_rewriter]: 5.19e-06 [mutable_eliminate]: 0.00047845 [jit_opt_b]: 4.54e-05, [1] [Cycle 1]: 3.936e-05, [2] [frontend_op_eliminate]: 1.467e-05 [inline_after_opt_a]: 1.466e-05 [cconv]: 3.833e-05 [loop_unroll]: 0.00039431 [jit_opt_after_cconv]: 0.0001332, [1] [Cycle 1]: 0.00012686, [11] [c_1]: 1.975e-05 [parameter_eliminate]: 2.27001e-06 [updatestate_depend_eliminate]: 5.29998e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.754e-05 [call_graph_tuple_transform]: 1.734e-05 [tuple_list_get_item_eliminator]: 5.08002e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.14998e-06 [remove_dup_value]: 1.481e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 5.93002e-06 [add_recomputation]: 4.723e-05 [cse_after_recomputation]: 2.975e-05, [1] [Cycle 1]: 2.441e-05, [1] [cse]: 1.859e-05 [auto_monad_reorder]: 1.583e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 4.46002e-06 [opt_after_jit_grad]: 0.00043398 [symbol_engine_optimizer]: 6.889e-05, [1] [Cycle 1]: 6.271e-05, [6] [build]: 2.44999e-06 [elim_shapecalc]: 7.66999e-06 [elim_not_effective]: 1.206e-05 [opt_reshape]: 5.55001e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 2.70025e-07 [validate]: 3.268e-05 Sums bootstrap : 0.000271s : 3.50% type_inference : 0.004174s : 53.91% event_method : 0.000016s : 0.21% auto_monad : 0.000053s : 0.68% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000030s : 0.39% rewriter_before_opt_a : 0.000067s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000050s : 0.65% jit_opt_a.loop_unroll : 0.000034s : 0.44% jit_opt_a.a_1 : 0.000557s : 7.19% jit_opt_a.with_stream_mark : 0.000024s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.35% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000533s : 6.89% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.25% jit_opt_a.cse : 0.000040s : 0.51% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000032s : 0.42% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000478s : 6.18% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000038s : 0.50% loop_unroll : 0.000394s : 5.09% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000015s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000047s : 0.61% cse_after_recomputation.cse : 0.000019s : 0.24% auto_monad_reorder : 0.000016s : 0.20% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000434s : 5.61% symbol_engine_optimizer.build : 0.000002s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.42% Time group info: ------[substitution.] 0.000154 23 1.24% : 0.000002s : 2: substitution.elim_not_effective 0.97% : 0.000002s : 2: substitution.fold_const_symbol 3.15% : 0.000005s : 3: substitution.graph_param_transform 78.95% : 0.000122s : 4: substitution.inline 1.73% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.15% : 0.000005s : 4: substitution.remove_not_recompute_node 2.51% : 0.000004s : 2: substitution.replace_old_param 8.29% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004122 2 80.99% : 0.003338s : 1: type_inference.infer 19.01% : 0.000784s : 1: type_inference.specialize ------[replace.] 0.000059 6 66.34% : 0.000039s : 4: replace.inline 33.66% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000131 6 91.03% : 0.000119s : 4: match.inline 8.97% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.44% : 0.000002s : 10: predicate.accumulaten_eliminater 1.14% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.82% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.20% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.51% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.32% : 0.000000s : 3: predicate.graph_param_transform 5.31% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.09% : 0.000002s : 15: predicate.load_eliminater 1.31% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.36% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.21% : 0.000001s : 10: predicate.minmaximum_grad 1.87% : 0.000002s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.35% : 0.000003s : 15: predicate.partial_eliminate 1.23% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.55% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 6: predicate.remove_not_recompute_node 1.86% : 0.000002s : 18: predicate.replace_applicator 0.86% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 3: predicate.row_tensor_eliminate 1.28% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.39% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.43% : 0.000008s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.68% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000551 13 51.97% : 0.000287s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.79% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.24% : 0.000238s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012614 72 0.40% : 0.000050s : 1: add_recomputation 0.44% : 0.000056s : 1: auto_monad 0.15% : 0.000018s : 1: auto_monad_reorder 2.27% : 0.000286s : 1: bootstrap 0.33% : 0.000041s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.25% : 0.000032s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.04% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.31% : 0.004706s : 1: jit_opt_a 1.08% : 0.000136s : 1: jit_opt_after_cconv 0.38% : 0.000048s : 1: jit_opt_b 3.18% : 0.000401s : 1: loop_unroll 3.85% : 0.000486s : 1: mutable_eliminate 5.96% : 0.000752s : 26: opt.transform.jit_opt_a 0.35% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.50% : 0.000441s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000032s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000017s : 1: remove_dup_value 2.18% : 0.000275s : 1: renormalize.infer 1.99% : 0.000251s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000035s : 1: rewriter_after_opt_a 0.55% : 0.000069s : 1: rewriter_before_opt_a 0.56% : 0.000071s : 1: symbol_engine_optimizer 33.17% : 0.004185s : 1: type_inference TotalTime = 0.0124313, [30] [bootstrap]: 0.00027683 [type_inference]: 0.00490507 [event_method]: 1.57e-05 [auto_monad]: 4.177e-05 [graph_reusing]: 3.35998e-06 [pre_auto_parallel]: 1.60001e-06 [py_interpret_to_execute]: 3.357e-05 [rewriter_before_opt_a]: 6.539e-05 [expand_dump_flag]: 1.89e-06 [jit_opt_a]: 0.00504979, [2] [Cycle 1]: 0.00153884, [27] [switch_simplify]: 4.765e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00047073 [with_stream_mark]: 1.587e-05 [recompute_prepare]: 6.94001e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 3.38e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 5.66998e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 3.8e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.41e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.11e-06 [replace_old_param]: 9.01998e-06 [inline_without_move]: 5.26002e-06 [renormalize]: 0.00066554 [add_forward_monad_depend]: 5.13002e-06 [auto_monad_grad]: 1.81e-06 [auto_monad_eliminator]: 1.588e-05 [cse]: 3.142e-05 [replace_applicator]: 1.276e-05 [Cycle 2]: 0.00037677, [27] [switch_simplify]: 5.90002e-06 [loop_unroll]: 4.82998e-06 [a_1]: 8.857e-05 [with_stream_mark]: 8.23999e-06 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 6.756e-05 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 4.79e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.74998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 7.91001e-06 [inline_without_move]: 4.70999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.36998e-06 [cse]: 1.107e-05 [replace_applicator]: 4.91997e-06 [py_interpret_to_execute_after_opt_a]: 8.35001e-06 [rewriter_after_opt_a]: 3.455e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 5.01997e-06 [mutable_eliminate]: 0.00052263 [jit_opt_b]: 4.597e-05, [1] [Cycle 1]: 3.985e-05, [2] [frontend_op_eliminate]: 1.495e-05 [inline_after_opt_a]: 1.477e-05 [cconv]: 2.465e-05 [loop_unroll]: 0.00041207 [jit_opt_after_cconv]: 0.0001371, [1] [Cycle 1]: 0.00013124, [11] [c_1]: 2.089e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 1.97001e-06 [cse]: 1.977e-05 [call_graph_tuple_transform]: 1.822e-05 [tuple_list_get_item_eliminator]: 5.20001e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 1.80007e-07 [switch_simplify]: 5.05001e-06 [remove_dup_value]: 1.539e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 5.71e-06 [add_recomputation]: 5.037e-05 [cse_after_recomputation]: 2.113e-05, [1] [Cycle 1]: 1.596e-05, [1] [cse]: 1.07e-05 [auto_monad_reorder]: 1.533e-05 [get_jit_bprop_graph]: 1.94e-06 [rewriter_after_jit_bprop_graph]: 5.44998e-06 [opt_after_jit_grad]: 0.00045279 [symbol_engine_optimizer]: 6.857e-05, [1] [Cycle 1]: 6.256e-05, [6] [build]: 3.18998e-06 [elim_shapecalc]: 7.06001e-06 [elim_not_effective]: 1.205e-05 [opt_reshape]: 5.75001e-06 [fold_const_symbol]: 8.35999e-06 [renormalize]: 3.69997e-07 [validate]: 3.586e-05 Sums bootstrap : 0.000277s : 3.16% type_inference : 0.004905s : 56.01% event_method : 0.000016s : 0.18% auto_monad : 0.000042s : 0.48% graph_reusing : 0.000003s : 0.04% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.38% rewriter_before_opt_a : 0.000065s : 0.75% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000054s : 0.61% jit_opt_a.loop_unroll : 0.000035s : 0.40% jit_opt_a.a_1 : 0.000559s : 6.39% jit_opt_a.with_stream_mark : 0.000024s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000073s : 0.83% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000666s : 7.60% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.25% jit_opt_a.cse : 0.000042s : 0.49% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000035s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000523s : 5.97% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000025s : 0.28% loop_unroll : 0.000412s : 4.71% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000050s : 0.58% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000453s : 5.17% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.41% Time group info: ------[substitution.] 0.000157 23 1.23% : 0.000002s : 2: substitution.elim_not_effective 0.90% : 0.000001s : 2: substitution.fold_const_symbol 3.71% : 0.000006s : 3: substitution.graph_param_transform 80.64% : 0.000127s : 4: substitution.inline 1.89% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.17% : 0.000005s : 4: substitution.remove_not_recompute_node 3.16% : 0.000005s : 2: substitution.replace_old_param 5.30% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004854 2 82.26% : 0.003993s : 1: type_inference.infer 17.74% : 0.000861s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.45% : 0.000042s : 4: replace.inline 33.55% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000132 6 94.46% : 0.000124s : 4: match.inline 5.54% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.25% : 0.000001s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 2.06% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.36% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.26% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.20% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.34% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.15% : 0.000002s : 15: predicate.load_eliminater 1.73% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.35% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.04% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.20% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.88% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.99% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.13% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.36% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000008s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.91% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.51% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000661 13 53.96% : 0.000357s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.08% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.96% : 0.000277s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013980 72 0.38% : 0.000053s : 1: add_recomputation 0.32% : 0.000045s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.09% : 0.000292s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 36.14% : 0.005053s : 1: jit_opt_a 1.00% : 0.000140s : 1: jit_opt_after_cconv 0.35% : 0.000048s : 1: jit_opt_b 3.00% : 0.000420s : 1: loop_unroll 3.80% : 0.000531s : 1: mutable_eliminate 5.91% : 0.000826s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.14% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.29% : 0.000460s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.26% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.20% : 0.000028s : 1: remove_dup_value 2.52% : 0.000353s : 1: renormalize.infer 2.19% : 0.000306s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000038s : 1: rewriter_after_opt_a 0.49% : 0.000068s : 1: rewriter_before_opt_a 0.51% : 0.000071s : 1: symbol_engine_optimizer 35.16% : 0.004916s : 1: type_inference TotalTime = 0.110895, [30] [bootstrap]: 0.00025645 [type_inference]: 0.101094 [event_method]: 1.787e-05 [auto_monad]: 6.458e-05 [graph_reusing]: 4.62998e-06 [pre_auto_parallel]: 1.86998e-06 [py_interpret_to_execute]: 0.00041944 [rewriter_before_opt_a]: 7.756e-05 [expand_dump_flag]: 2.72001e-06 [jit_opt_a]: 0.00677093, [2] [Cycle 1]: 0.00320482, [27] [switch_simplify]: 4.791e-05 [loop_unroll]: 2.984e-05 [a_1]: 0.00053717 [with_stream_mark]: 1.375e-05 [recompute_prepare]: 8.16002e-06 [updatestate_depend_eliminate]: 3.16001e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.44998e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.97999e-06 [meta_shard_fg_expand]: 1.55001e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.201e-05 [j_node_and_user_rematch]: 9.25999e-06 [meta_fg_expand]: 2.01e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 6.41e-06 [renormalize]: 0.00226873 [add_forward_monad_depend]: 4.90001e-06 [auto_monad_grad]: 1.57999e-06 [auto_monad_eliminator]: 1.32e-05 [cse]: 2.122e-05 [replace_applicator]: 1.426e-05 [Cycle 2]: 0.0003572, [27] [switch_simplify]: 6.45002e-06 [loop_unroll]: 5.64998e-06 [a_1]: 0.0001177 [with_stream_mark]: 1.136e-05 [recompute_prepare]: 5.92999e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.21998e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 5.77001e-06 [updatestate_useless_node_eliminater]: 5.42999e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.53002e-06 [get_grad_eliminate_]: 5.31002e-06 [merge_forward]: 2.84999e-06 [cell_reuse_recompute_pass]: 1.31998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 8.43999e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.79984e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.39001e-06 [cse]: 1.056e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.017e-05 [rewriter_after_opt_a]: 3.292e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 2.596e-05 [mutable_eliminate]: 0.00062305 [jit_opt_b]: 5.383e-05, [1] [Cycle 1]: 4.686e-05, [2] [frontend_op_eliminate]: 1.845e-05 [inline_after_opt_a]: 1.754e-05 [cconv]: 2.474e-05 [loop_unroll]: 0.0004232 [jit_opt_after_cconv]: 0.00014482, [1] [Cycle 1]: 0.00013881, [11] [c_1]: 2.5e-05 [parameter_eliminate]: 2.87002e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 1.988e-05 [call_graph_tuple_transform]: 1.982e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.39998e-06 [renormalize]: 5.89993e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.469e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 8.83001e-06 [add_recomputation]: 4.537e-05 [cse_after_recomputation]: 2.114e-05, [1] [Cycle 1]: 1.549e-05, [1] [cse]: 9.97001e-06 [auto_monad_reorder]: 1.438e-05 [get_jit_bprop_graph]: 1.99999e-06 [rewriter_after_jit_bprop_graph]: 4.42998e-06 [opt_after_jit_grad]: 0.00045053 [symbol_engine_optimizer]: 7.264e-05, [1] [Cycle 1]: 6.693e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 8.13999e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 6.04001e-06 [fold_const_symbol]: 9.33002e-06 [renormalize]: 3.69997e-07 [validate]: 3.956e-05 Sums bootstrap : 0.000256s : 0.24% type_inference : 0.101094s : 94.36% event_method : 0.000018s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000419s : 0.39% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000655s : 0.61% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002269s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000026s : 0.02% mutable_eliminate : 0.000623s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000423s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000451s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000186 24 1.63% : 0.000003s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000005s : 4: substitution.graph_param_transform 81.94% : 0.000153s : 4: substitution.inline 1.58% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.52% : 0.000005s : 4: substitution.remove_not_recompute_node 2.41% : 0.000004s : 2: substitution.replace_old_param 6.44% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101022 2 97.55% : 0.098548s : 1: type_inference.infer 2.45% : 0.002474s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.34% : 0.000044s : 4: replace.inline 32.66% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 93.37% : 0.000150s : 4: match.inline 6.63% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.61% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.79% : 0.000002s : 12: predicate.arithmetic_simplify 1.50% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.73% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.55% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.46% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.38% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 4: predicate.row_tensor_eliminate 1.47% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.33% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001873 22 67.02% : 0.001255s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.61% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.37% : 0.000588s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114111 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000068s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000270s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.94% : 0.006774s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.38% : 0.000431s : 1: loop_unroll 0.55% : 0.000631s : 1: mutable_eliminate 0.77% : 0.000874s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000459s : 1: opt_after_jit_grad 0.02% : 0.000028s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000425s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.46% : 0.001663s : 1: renormalize.infer 0.52% : 0.000598s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 88.61% : 0.101110s : 1: type_inference TotalTime = 0.110358, [30] [bootstrap]: 0.00024781 [type_inference]: 0.10055 [event_method]: 1.792e-05 [auto_monad]: 6.738e-05 [graph_reusing]: 5.37001e-06 [pre_auto_parallel]: 2.37999e-06 [py_interpret_to_execute]: 0.00039753 [rewriter_before_opt_a]: 7.974e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.0069213, [2] [Cycle 1]: 0.00334824, [27] [switch_simplify]: 5.223e-05 [loop_unroll]: 2.956e-05 [a_1]: 0.00053491 [with_stream_mark]: 1.633e-05 [recompute_prepare]: 8.08999e-06 [updatestate_depend_eliminate]: 3.77998e-06 [updatestate_assign_eliminate]: 3.65e-06 [updatestate_loads_eliminate]: 2.81e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.88998e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.18998e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.99001e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.602e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.64999e-06 [inline_without_move]: 5.77001e-06 [renormalize]: 0.00239789 [add_forward_monad_depend]: 4.89e-06 [auto_monad_grad]: 1.22999e-06 [auto_monad_eliminator]: 1.314e-05 [cse]: 2.131e-05 [replace_applicator]: 1.336e-05 [Cycle 2]: 0.00035167, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.39998e-06 [a_1]: 0.00011893 [with_stream_mark]: 9.65002e-06 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.45001e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.358e-05 [j_node_and_user_rematch]: 9.22001e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 8.13001e-06 [inline_without_move]: 5.58002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.52001e-06 [cse]: 1.131e-05 [replace_applicator]: 5.46e-06 [py_interpret_to_execute_after_opt_a]: 9.14e-06 [rewriter_after_opt_a]: 2.641e-05 [convert_after_rewriter]: 6.14999e-06 [order_py_execute_after_rewriter]: 3.92002e-06 [mutable_eliminate]: 0.00059549 [jit_opt_b]: 5.188e-05, [1] [Cycle 1]: 4.597e-05, [2] [frontend_op_eliminate]: 1.803e-05 [inline_after_opt_a]: 1.711e-05 [cconv]: 1.575e-05 [loop_unroll]: 0.00041584 [jit_opt_after_cconv]: 0.00014443, [1] [Cycle 1]: 0.00013872, [11] [c_1]: 2.519e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.33002e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.76e-06 [cse]: 1.99e-05 [call_graph_tuple_transform]: 1.952e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 9.80013e-07 [renormalize]: 4.30009e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 8.15e-06 [partial_unused_args_eliminate]: 1.22e-06 [environ_conv]: 5.64998e-06 [add_recomputation]: 3.249e-05 [cse_after_recomputation]: 2.141e-05, [1] [Cycle 1]: 1.657e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 9.97001e-06 [get_jit_bprop_graph]: 1.71998e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00045119 [symbol_engine_optimizer]: 7.079e-05, [1] [Cycle 1]: 6.525e-05, [6] [build]: 2.74999e-06 [elim_shapecalc]: 8.10999e-06 [elim_not_effective]: 1.318e-05 [opt_reshape]: 6.47001e-06 [fold_const_symbol]: 8.94998e-06 [renormalize]: 3.50003e-07 [validate]: 3.204e-05 Sums bootstrap : 0.000248s : 0.23% type_inference : 0.100550s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000398s : 0.37% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000654s : 0.61% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002398s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000026s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000595s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000016s : 0.01% loop_unroll : 0.000416s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000451s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000187 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.40% : 0.000004s : 4: substitution.graph_param_transform 82.24% : 0.000154s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000005s : 4: substitution.remove_not_recompute_node 2.60% : 0.000005s : 2: substitution.replace_old_param 6.80% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100484 2 97.47% : 0.097942s : 1: type_inference.infer 2.53% : 0.002543s : 1: type_inference.specialize ------[replace.] 0.000066 6 66.63% : 0.000044s : 4: replace.inline 33.37% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 92.99% : 0.000151s : 4: match.inline 7.01% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.20% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.56% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.18% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.69% : 0.000002s : 4: predicate.mutable_eliminate 0.82% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.08% : 0.000001s : 12: predicate.print_const_string_wrapper 1.91% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.63% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.32% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.77% : 0.000009s : 58: predicate.switch_simplify 1.45% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.70% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001967 22 63.69% : 0.001253s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.82% : 0.000685s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113712 72 0.03% : 0.000035s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.23% : 0.000260s : 1: bootstrap 0.02% : 0.000018s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.09% : 0.006924s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.37% : 0.000423s : 1: loop_unroll 0.53% : 0.000603s : 1: mutable_eliminate 0.77% : 0.000877s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000403s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000010s : 1: remove_dup_value 1.47% : 0.001677s : 1: renormalize.infer 0.63% : 0.000713s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.06% : 0.000073s : 1: symbol_engine_optimizer 88.44% : 0.100564s : 1: type_inference TotalTime = 0.115044, [30] [bootstrap]: 0.00026229 [type_inference]: 0.104634 [event_method]: 1.893e-05 [auto_monad]: 6.947e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00045054 [rewriter_before_opt_a]: 8.006e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00716114, [2] [Cycle 1]: 0.00338893, [27] [switch_simplify]: 5.209e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00056801 [with_stream_mark]: 1.849e-05 [recompute_prepare]: 1.019e-05 [updatestate_depend_eliminate]: 3.8e-06 [updatestate_assign_eliminate]: 2.98998e-06 [updatestate_loads_eliminate]: 2.73e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 7.27002e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.03002e-06 [merge_forward]: 4.22003e-06 [cell_reuse_recompute_pass]: 1.42e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.507e-05 [j_node_and_user_rematch]: 1.037e-05 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 1.144e-05 [inline_without_move]: 6.23998e-06 [renormalize]: 0.00233012 [add_forward_monad_depend]: 6.46e-06 [auto_monad_grad]: 1.92001e-06 [auto_monad_eliminator]: 5.277e-05 [cse]: 3.322e-05 [replace_applicator]: 1.535e-05 [Cycle 2]: 0.0003546, [27] [switch_simplify]: 6.84999e-06 [loop_unroll]: 5.87001e-06 [a_1]: 0.00011995 [with_stream_mark]: 9.41e-06 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 2.84999e-06 [updatestate_assign_eliminate]: 2.13002e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.54e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.31998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.417e-05 [j_node_and_user_rematch]: 8.92999e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.38999e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 6.74001e-06 [cse]: 1.138e-05 [replace_applicator]: 5.72999e-06 [py_interpret_to_execute_after_opt_a]: 1.22e-05 [rewriter_after_opt_a]: 3.638e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00066387 [jit_opt_b]: 5.495e-05, [1] [Cycle 1]: 4.821e-05, [2] [frontend_op_eliminate]: 1.921e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 2.652e-05 [loop_unroll]: 0.00042563 [jit_opt_after_cconv]: 0.00015297, [1] [Cycle 1]: 0.00014671, [11] [c_1]: 2.502e-05 [parameter_eliminate]: 2.96001e-06 [updatestate_depend_eliminate]: 5.07999e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [cse]: 2.479e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 6.10016e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.786e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 8.02e-06 [add_recomputation]: 4.883e-05 [cse_after_recomputation]: 2.327e-05, [1] [Cycle 1]: 1.73e-05, [1] [cse]: 1.151e-05 [auto_monad_reorder]: 1.466e-05 [get_jit_bprop_graph]: 1.34998e-06 [rewriter_after_jit_bprop_graph]: 5.30999e-06 [opt_after_jit_grad]: 0.00053168 [symbol_engine_optimizer]: 7.757e-05, [1] [Cycle 1]: 7.165e-05, [6] [build]: 3.88001e-06 [elim_shapecalc]: 8.79e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 9.68002e-06 [renormalize]: 4.59986e-07 [validate]: 4.396e-05 Sums bootstrap : 0.000262s : 0.24% type_inference : 0.104634s : 94.25% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000451s : 0.41% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000688s : 0.62% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002330s : 2.10% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000060s : 0.05% jit_opt_a.cse : 0.000045s : 0.04% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000664s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000426s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000532s : 0.48% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000044s : 0.04% Time group info: ------[substitution.] 0.000208 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 82.24% : 0.000171s : 4: substitution.inline 1.99% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.50% : 0.000005s : 4: substitution.remove_not_recompute_node 2.72% : 0.000006s : 2: substitution.replace_old_param 6.00% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104562 2 97.55% : 0.102005s : 1: type_inference.infer 2.45% : 0.002557s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.21% : 0.000051s : 4: replace.inline 32.79% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.84% : 0.000168s : 4: match.inline 6.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.39% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.48% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.52% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 6.13% : 0.000008s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.19% : 0.000002s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.06% : 0.000001s : 12: predicate.print_const_string_wrapper 2.00% : 0.000003s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.30% : 0.000000s : 4: predicate.reset_defer_inline 1.09% : 0.000001s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.08% : 0.000001s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.97% : 0.000001s : 8: predicate.special_op_eliminate 1.36% : 0.000002s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.36% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.90% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.63% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001977 22 69.11% : 0.001367s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.62% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.27% : 0.000579s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118337 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000275s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.05% : 0.007164s : 1: jit_opt_a 0.13% : 0.000156s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.37% : 0.000433s : 1: loop_unroll 0.57% : 0.000672s : 1: mutable_eliminate 0.78% : 0.000918s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000540s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000457s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.44% : 0.001705s : 1: renormalize.infer 0.52% : 0.000617s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.07% : 0.000080s : 1: symbol_engine_optimizer 88.44% : 0.104653s : 1: type_inference TotalTime = 0.112376, [30] [bootstrap]: 0.00027869 [type_inference]: 0.102512 [event_method]: 1.683e-05 [auto_monad]: 6.249e-05 [graph_reusing]: 6.04999e-06 [pre_auto_parallel]: 2.34001e-06 [py_interpret_to_execute]: 0.00047558 [rewriter_before_opt_a]: 7.788e-05 [expand_dump_flag]: 3.63999e-06 [jit_opt_a]: 0.00675555, [2] [Cycle 1]: 0.00327046, [27] [switch_simplify]: 4.774e-05 [loop_unroll]: 3.037e-05 [a_1]: 0.00057917 [with_stream_mark]: 1.313e-05 [recompute_prepare]: 8.40999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 6.55002e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.39999e-06 [meta_shard_fg_expand]: 1.81998e-06 [get_grad_eliminate_]: 6.10002e-06 [merge_forward]: 2.67001e-06 [cell_reuse_recompute_pass]: 8.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.252e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 2.00002e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00230195 [add_forward_monad_depend]: 4.52998e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 1.095e-05 [cse]: 1.912e-05 [replace_applicator]: 1.296e-05 [Cycle 2]: 0.00035804, [27] [switch_simplify]: 6.48003e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00011742 [with_stream_mark]: 9.10999e-06 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.13001e-06 [specialize_transform]: 5.89999e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.19003e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.362e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 8.08999e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.319e-05 [replace_applicator]: 6.74999e-06 [py_interpret_to_execute_after_opt_a]: 9.32001e-06 [rewriter_after_opt_a]: 5.023e-05 [convert_after_rewriter]: 6.04001e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00058774 [jit_opt_b]: 5.371e-05, [1] [Cycle 1]: 4.691e-05, [2] [frontend_op_eliminate]: 1.865e-05 [inline_after_opt_a]: 1.721e-05 [cconv]: 1.648e-05 [loop_unroll]: 0.00046429 [jit_opt_after_cconv]: 0.00014044, [1] [Cycle 1]: 0.00013402, [11] [c_1]: 2.472e-05 [parameter_eliminate]: 2.04e-06 [updatestate_depend_eliminate]: 4.90999e-06 [updatestate_assign_eliminate]: 2.18998e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.849e-05 [call_graph_tuple_transform]: 1.931e-05 [tuple_list_get_item_eliminator]: 5.92999e-06 [none_parameter_eliminate]: 7.00005e-07 [renormalize]: 3.89991e-07 [switch_simplify]: 5.62999e-06 [remove_dup_value]: 8.67998e-06 [partial_unused_args_eliminate]: 1.56002e-06 [environ_conv]: 5.66e-06 [add_recomputation]: 3.132e-05 [cse_after_recomputation]: 2.077e-05, [1] [Cycle 1]: 1.564e-05, [1] [cse]: 1e-05 [auto_monad_reorder]: 1.009e-05 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4e-06 [opt_after_jit_grad]: 0.00045225 [symbol_engine_optimizer]: 0.00012704, [1] [Cycle 1]: 0.00012135, [6] [build]: 2.24001e-06 [elim_shapecalc]: 8.01001e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 6.24e-05 [fold_const_symbol]: 9.32001e-06 [renormalize]: 3.69997e-07 [validate]: 3.275e-05 Sums bootstrap : 0.000279s : 0.26% type_inference : 0.102512s : 94.30% event_method : 0.000017s : 0.02% auto_monad : 0.000062s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000476s : 0.44% rewriter_before_opt_a : 0.000078s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000697s : 0.64% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002302s : 2.12% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000050s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000588s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000016s : 0.02% loop_unroll : 0.000464s : 0.43% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000031s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000452s : 0.42% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000062s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000168 24 0.71% : 0.000001s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 2.44% : 0.000004s : 4: substitution.graph_param_transform 83.74% : 0.000141s : 4: substitution.inline 1.77% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.13% : 0.000005s : 4: substitution.remove_not_recompute_node 2.02% : 0.000003s : 2: substitution.replace_old_param 5.58% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102446 2 97.58% : 0.099964s : 1: type_inference.infer 2.42% : 0.002482s : 1: type_inference.specialize ------[replace.] 0.000126 6 35.93% : 0.000045s : 4: replace.inline 64.07% : 0.000081s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 94.35% : 0.000138s : 4: match.inline 5.65% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.82% : 0.000002s : 12: predicate.addn_zero_filter 1.77% : 0.000002s : 12: predicate.arithmetic_simplify 1.43% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.88% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.13% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.13% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.43% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000002s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.08% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000009s : 58: predicate.switch_simplify 1.49% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.39% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001920 22 67.77% : 0.001301s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.85% : 0.000592s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115727 72 0.03% : 0.000034s : 1: add_recomputation 0.06% : 0.000065s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.25% : 0.000291s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.84% : 0.006758s : 1: jit_opt_a 0.12% : 0.000143s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.41% : 0.000472s : 1: loop_unroll 0.51% : 0.000595s : 1: mutable_eliminate 0.79% : 0.000917s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000090s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000482s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.44% : 0.001668s : 1: renormalize.infer 0.54% : 0.000627s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000053s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.11% : 0.000129s : 1: symbol_engine_optimizer 88.59% : 0.102526s : 1: type_inference TotalTime = 0.0702539, [30] [bootstrap]: 0.00029581 [type_inference]: 0.0602688 [event_method]: 1.595e-05 [auto_monad]: 5.62e-05 [graph_reusing]: 4.87998e-06 [pre_auto_parallel]: 1.55001e-06 [py_interpret_to_execute]: 0.00028507 [rewriter_before_opt_a]: 7.621e-05 [expand_dump_flag]: 1.785e-05 [jit_opt_a]: 0.00684074, [2] [Cycle 1]: 0.00332011, [27] [switch_simplify]: 5.208e-05 [loop_unroll]: 3.003e-05 [a_1]: 0.00054203 [with_stream_mark]: 1.348e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 3.05002e-06 [updatestate_assign_eliminate]: 2.57001e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.09998e-06 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 6.01998e-06 [accelerated_algorithm]: 6.15002e-06 [meta_shard_fg_expand]: 1.49e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 2.88e-06 [cell_reuse_recompute_pass]: 8.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.297e-05 [j_node_and_user_rematch]: 9.59e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 2e-05 [renormalize]: 0.00234809 [add_forward_monad_depend]: 6.17999e-06 [auto_monad_grad]: 2.49001e-06 [auto_monad_eliminator]: 1.498e-05 [cse]: 2.467e-05 [replace_applicator]: 1.556e-05 [Cycle 2]: 0.00037297, [27] [switch_simplify]: 6.41e-06 [loop_unroll]: 6.16998e-06 [a_1]: 0.00012962 [with_stream_mark]: 8.81997e-06 [recompute_prepare]: 5.83002e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.18002e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.15001e-06 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.46998e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.504e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 9.84001e-06 [inline_without_move]: 5.94e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.31e-06 [cse]: 1.154e-05 [replace_applicator]: 5.59998e-06 [py_interpret_to_execute_after_opt_a]: 9.97999e-06 [rewriter_after_opt_a]: 3.133e-05 [convert_after_rewriter]: 7.45e-06 [order_py_execute_after_rewriter]: 4.80999e-06 [mutable_eliminate]: 0.00063111 [jit_opt_b]: 5.446e-05, [1] [Cycle 1]: 4.81e-05, [2] [frontend_op_eliminate]: 1.892e-05 [inline_after_opt_a]: 1.751e-05 [cconv]: 2.261e-05 [loop_unroll]: 0.00051865 [jit_opt_after_cconv]: 0.00015977, [1] [Cycle 1]: 0.00015333, [11] [c_1]: 2.599e-05 [parameter_eliminate]: 3.36999e-06 [updatestate_depend_eliminate]: 5.99999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 3.83999e-06 [cse]: 2.73e-05 [call_graph_tuple_transform]: 2.018e-05 [tuple_list_get_item_eliminator]: 6.34001e-06 [none_parameter_eliminate]: 1.36002e-06 [renormalize]: 5.3001e-07 [switch_simplify]: 6.07001e-06 [remove_dup_value]: 1.401e-05 [partial_unused_args_eliminate]: 1.95001e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 4.774e-05 [cse_after_recomputation]: 2.202e-05, [1] [Cycle 1]: 1.689e-05, [1] [cse]: 1.122e-05 [auto_monad_reorder]: 1.423e-05 [get_jit_bprop_graph]: 2.46e-06 [rewriter_after_jit_bprop_graph]: 5.70001e-06 [opt_after_jit_grad]: 0.00047598 [symbol_engine_optimizer]: 0.00014674, [1] [Cycle 1]: 0.00014066, [6] [build]: 4.4e-06 [elim_shapecalc]: 9.42001e-06 [elim_not_effective]: 1.4e-05 [opt_reshape]: 6.54999e-06 [fold_const_symbol]: 7.677e-05 [renormalize]: 5.29981e-07 [validate]: 4.588e-05 Sums bootstrap : 0.000296s : 0.44% type_inference : 0.060269s : 90.57% event_method : 0.000016s : 0.02% auto_monad : 0.000056s : 0.08% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000285s : 0.43% rewriter_before_opt_a : 0.000076s : 0.11% expand_dump_flag : 0.000018s : 0.03% jit_opt_a.switch_simplify : 0.000058s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.05% jit_opt_a.a_1 : 0.000672s : 1.01% jit_opt_a.with_stream_mark : 0.000022s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000026s : 0.04% jit_opt_a.renormalize : 0.002348s : 3.53% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.03% jit_opt_a.cse : 0.000036s : 0.05% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000631s : 0.95% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000023s : 0.03% loop_unroll : 0.000519s : 0.78% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.cse : 0.000027s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000476s : 0.72% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000077s : 0.12% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000046s : 0.07% Time group info: ------[substitution.] 0.000185 24 1.39% : 0.000003s : 2: substitution.elim_not_effective 0.95% : 0.000002s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 4: substitution.graph_param_transform 81.43% : 0.000151s : 4: substitution.inline 1.89% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.91% : 0.000005s : 4: substitution.remove_not_recompute_node 2.42% : 0.000004s : 2: substitution.replace_old_param 5.88% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.060189 2 96.89% : 0.058320s : 1: type_inference.infer 3.11% : 0.001869s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.89% : 0.000048s : 4: replace.inline 33.11% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.80% : 0.000148s : 4: match.inline 6.20% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000144 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 0.87% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.94% : 0.000001s : 12: predicate.addn_check_dump 1.49% : 0.000002s : 12: predicate.addn_zero_filter 1.91% : 0.000003s : 12: predicate.arithmetic_simplify 1.16% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 1.01% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.00% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.10% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.40% : 0.000001s : 4: predicate.graph_param_transform 4.44% : 0.000006s : 26: predicate.inline 9.88% : 0.000014s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.30% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.74% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 0.97% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.04% : 0.000003s : 18: predicate.partial_eliminate 1.42% : 0.000002s : 12: predicate.print_const_string_wrapper 1.56% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.83% : 0.000003s : 22: predicate.replace_applicator 0.90% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.15% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.60% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.04% : 0.000003s : 18: predicate.switch_defer_inline 1.96% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.28% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.20% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.09% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.63% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.36% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.29% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.58% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002703 34 74.51% : 0.002014s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.09% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.39% : 0.000659s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.073654 72 0.07% : 0.000051s : 1: add_recomputation 0.08% : 0.000059s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.42% : 0.000310s : 1: bootstrap 0.03% : 0.000025s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000019s : 1: event_method 0.03% : 0.000021s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.29% : 0.006844s : 1: jit_opt_a 0.22% : 0.000162s : 1: jit_opt_after_cconv 0.08% : 0.000057s : 1: jit_opt_b 0.72% : 0.000527s : 1: loop_unroll 0.87% : 0.000638s : 1: mutable_eliminate 1.24% : 0.000916s : 26: opt.transform.jit_opt_a 0.07% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.14% : 0.000104s : 4: opt.transform.symbol_engine_opt 0.66% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.39% : 0.000290s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 2.22% : 0.001639s : 1: renormalize.infer 0.95% : 0.000701s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000034s : 1: rewriter_after_opt_a 0.11% : 0.000080s : 1: rewriter_before_opt_a 0.20% : 0.000150s : 1: symbol_engine_optimizer 81.84% : 0.060281s : 1: type_inference TotalTime = 0.0644662, [30] [bootstrap]: 0.00026511 [type_inference]: 0.0543623 [event_method]: 1.822e-05 [auto_monad]: 6.777e-05 [graph_reusing]: 5.96e-06 [pre_auto_parallel]: 2.51998e-06 [py_interpret_to_execute]: 0.00026984 [rewriter_before_opt_a]: 8.247e-05 [expand_dump_flag]: 3.87998e-06 [jit_opt_a]: 0.00694355, [2] [Cycle 1]: 0.0030546, [27] [switch_simplify]: 5.441e-05 [loop_unroll]: 2.979e-05 [a_1]: 0.0005529 [with_stream_mark]: 1.705e-05 [recompute_prepare]: 8.60999e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.33998e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 7.5e-06 [updatestate_useless_node_eliminater]: 5.94999e-06 [accelerated_algorithm]: 6.30002e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 4.27e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.20999e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.00205 [add_forward_monad_depend]: 7.77e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.734e-05 [cse]: 3.173e-05 [replace_applicator]: 1.952e-05 [Cycle 2]: 0.00037663, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 5.59e-06 [a_1]: 0.00012559 [with_stream_mark]: 1.376e-05 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 3.35998e-06 [updatestate_assign_eliminate]: 2.59001e-06 [updatestate_loads_eliminate]: 2.79001e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.64e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 1.86998e-06 [get_grad_eliminate_]: 5.57001e-06 [merge_forward]: 3.43999e-06 [cell_reuse_recompute_pass]: 3.18e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.735e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 9.09998e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.36002e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.63e-06 [cse]: 1.127e-05 [replace_applicator]: 6.16e-06 [py_interpret_to_execute_after_opt_a]: 1.222e-05 [rewriter_after_opt_a]: 3.745e-05 [convert_after_rewriter]: 6.87002e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00069546 [jit_opt_b]: 5.851e-05, [1] [Cycle 1]: 5.079e-05, [2] [frontend_op_eliminate]: 2.045e-05 [inline_after_opt_a]: 1.856e-05 [cconv]: 2.717e-05 [loop_unroll]: 0.00045056 [jit_opt_after_cconv]: 0.00016609, [1] [Cycle 1]: 0.00015995, [11] [c_1]: 2.623e-05 [parameter_eliminate]: 3.43999e-06 [updatestate_depend_eliminate]: 6.06e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 2.976e-05 [call_graph_tuple_transform]: 2.319e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 2.04e-06 [renormalize]: 7.30011e-07 [switch_simplify]: 6.82002e-06 [remove_dup_value]: 1.61e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 8.77e-06 [add_recomputation]: 5.415e-05 [cse_after_recomputation]: 2.447e-05, [1] [Cycle 1]: 1.832e-05, [1] [cse]: 1.23e-05 [auto_monad_reorder]: 1.595e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 7.21001e-06 [opt_after_jit_grad]: 0.0005525 [symbol_engine_optimizer]: 8.041e-05, [1] [Cycle 1]: 7.314e-05, [6] [build]: 3.86999e-06 [elim_shapecalc]: 9.53002e-06 [elim_not_effective]: 1.455e-05 [opt_reshape]: 6.06e-06 [fold_const_symbol]: 9.86e-06 [renormalize]: 5.69999e-07 [validate]: 4.418e-05 Sums bootstrap : 0.000265s : 0.44% type_inference : 0.054362s : 90.05% event_method : 0.000018s : 0.03% auto_monad : 0.000068s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000270s : 0.45% rewriter_before_opt_a : 0.000082s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000678s : 1.12% jit_opt_a.with_stream_mark : 0.000031s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002050s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000043s : 0.07% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000037s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000695s : 1.15% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000451s : 0.75% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000054s : 0.09% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000552s : 0.92% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000044s : 0.07% Time group info: ------[substitution.] 0.000200 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 1.13% : 0.000002s : 2: substitution.fold_const_symbol 3.41% : 0.000007s : 4: substitution.graph_param_transform 80.48% : 0.000161s : 4: substitution.inline 1.85% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.88% : 0.000006s : 4: substitution.remove_not_recompute_node 2.41% : 0.000005s : 2: substitution.replace_old_param 6.82% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.054278 2 96.46% : 0.052355s : 1: type_inference.infer 3.54% : 0.001923s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.81% : 0.000047s : 4: replace.inline 33.19% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000171 6 92.66% : 0.000158s : 4: match.inline 7.34% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.87% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.34% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.55% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.51% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.45% : 0.000001s : 4: predicate.graph_param_transform 5.10% : 0.000007s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000003s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.61% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.22% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.60% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.20% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.52% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.32% : 0.000002s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.60% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.40% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.53% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002202 26 71.57% : 0.001576s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.08% : 0.000596s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067509 72 0.08% : 0.000057s : 1: add_recomputation 0.10% : 0.000071s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.41% : 0.000277s : 1: bootstrap 0.04% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.29% : 0.006947s : 1: jit_opt_a 0.25% : 0.000169s : 1: jit_opt_after_cconv 0.09% : 0.000061s : 1: jit_opt_b 0.68% : 0.000460s : 1: loop_unroll 1.04% : 0.000705s : 1: mutable_eliminate 1.35% : 0.000915s : 26: opt.transform.jit_opt_a 0.09% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000564s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000277s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.03% : 0.001371s : 1: renormalize.infer 0.99% : 0.000669s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000040s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.12% : 0.000084s : 1: symbol_engine_optimizer 80.55% : 0.054378s : 1: type_inference TotalTime = 0.0675274, [30] [bootstrap]: 0.00032397 [type_inference]: 0.0575914 [event_method]: 1.857e-05 [auto_monad]: 6.627e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00029937 [rewriter_before_opt_a]: 8.237e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00680651, [2] [Cycle 1]: 0.00304389, [27] [switch_simplify]: 5.605e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00057766 [with_stream_mark]: 1.88e-05 [recompute_prepare]: 7.90998e-06 [updatestate_depend_eliminate]: 3.95e-06 [updatestate_assign_eliminate]: 3.72998e-06 [updatestate_loads_eliminate]: 3.08e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.51999e-06 [merge_forward]: 3.70998e-06 [cell_reuse_recompute_pass]: 1.05001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.561e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.97001e-06 [inline_without_move]: 5.91e-06 [renormalize]: 0.00201528 [add_forward_monad_depend]: 5.77001e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.663e-05 [cse]: 3.108e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.00036068, [27] [switch_simplify]: 6.95998e-06 [loop_unroll]: 5.92001e-06 [a_1]: 0.0001212 [with_stream_mark]: 1.011e-05 [recompute_prepare]: 6.12999e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.51998e-06 [updatestate_loads_eliminate]: 2.46e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.29e-06 [accelerated_algorithm]: 5.52999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 3.24001e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.018e-05 [replace_applicator]: 5.52001e-06 [py_interpret_to_execute_after_opt_a]: 1.115e-05 [rewriter_after_opt_a]: 3.584e-05 [convert_after_rewriter]: 7.46001e-06 [order_py_execute_after_rewriter]: 5.51e-06 [mutable_eliminate]: 0.0006651 [jit_opt_b]: 5.691e-05, [1] [Cycle 1]: 4.962e-05, [2] [frontend_op_eliminate]: 1.987e-05 [inline_after_opt_a]: 1.894e-05 [cconv]: 2.592e-05 [loop_unroll]: 0.00044297 [jit_opt_after_cconv]: 0.00015479, [1] [Cycle 1]: 0.00014747, [11] [c_1]: 2.559e-05 [parameter_eliminate]: 2.42001e-06 [updatestate_depend_eliminate]: 5.37999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 2.367e-05 [call_graph_tuple_transform]: 2.15e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 2.70025e-07 [switch_simplify]: 6.68e-06 [remove_dup_value]: 1.608e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 7.93001e-06 [add_recomputation]: 4.98e-05 [cse_after_recomputation]: 2.112e-05, [1] [Cycle 1]: 1.606e-05, [1] [cse]: 1.041e-05 [auto_monad_reorder]: 1.533e-05 [get_jit_bprop_graph]: 1.64e-06 [rewriter_after_jit_bprop_graph]: 6.69001e-06 [opt_after_jit_grad]: 0.00046561 [symbol_engine_optimizer]: 7.43e-05, [1] [Cycle 1]: 6.864e-05, [6] [build]: 3.00002e-06 [elim_shapecalc]: 7.77998e-06 [elim_not_effective]: 1.26e-05 [opt_reshape]: 7.01999e-06 [fold_const_symbol]: 9.58002e-06 [renormalize]: 4.90021e-07 [validate]: 9.324e-05 Sums bootstrap : 0.000324s : 0.51% type_inference : 0.057591s : 90.62% event_method : 0.000019s : 0.03% auto_monad : 0.000066s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000299s : 0.47% rewriter_before_opt_a : 0.000082s : 0.13% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000699s : 1.10% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002015s : 3.17% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000041s : 0.06% jit_opt_a.replace_applicator : 0.000022s : 0.03% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000665s : 1.05% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000019s : 0.03% cconv : 0.000026s : 0.04% loop_unroll : 0.000443s : 0.70% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000466s : 0.73% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000093s : 0.15% Time group info: ------[substitution.] 0.000207 24 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.98% : 0.000002s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 4: substitution.graph_param_transform 82.38% : 0.000171s : 4: substitution.inline 1.55% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000005s : 2: substitution.replace_old_param 6.10% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057514 2 96.65% : 0.055587s : 1: type_inference.infer 3.35% : 0.001926s : 1: type_inference.specialize ------[replace.] 0.000074 6 69.11% : 0.000051s : 4: replace.inline 30.89% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000180 6 93.59% : 0.000168s : 4: match.inline 6.41% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.52% : 0.000002s : 12: predicate.accumulaten_eliminater 1.17% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.15% : 0.000003s : 12: predicate.arithmetic_simplify 1.19% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.32% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.11% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.00% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 5.43% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.66% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 0.92% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.19% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.63% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.79% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.85% : 0.000003s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002346 26 72.47% : 0.001700s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.26% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.27% : 0.000616s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070495 72 0.07% : 0.000053s : 1: add_recomputation 0.10% : 0.000070s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.48% : 0.000338s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.66% : 0.006810s : 1: jit_opt_a 0.22% : 0.000157s : 1: jit_opt_after_cconv 0.08% : 0.000059s : 1: jit_opt_b 0.64% : 0.000451s : 1: loop_unroll 0.96% : 0.000675s : 1: mutable_eliminate 1.32% : 0.000931s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000033s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.03% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.67% : 0.000473s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000005s : 1: pre_auto_parallel 0.43% : 0.000305s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.86% : 0.001308s : 1: renormalize.infer 0.99% : 0.000698s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.12% : 0.000088s : 1: rewriter_before_opt_a 0.11% : 0.000077s : 1: symbol_engine_optimizer 81.71% : 0.057604s : 1: type_inference TotalTime = 0.0607291, [30] [bootstrap]: 0.00029869 [type_inference]: 0.0514045 [event_method]: 1.842e-05 [auto_monad]: 5.941e-05 [graph_reusing]: 4.92999e-06 [pre_auto_parallel]: 1.83002e-06 [py_interpret_to_execute]: 0.00027259 [rewriter_before_opt_a]: 8.218e-05 [expand_dump_flag]: 3.03e-06 [jit_opt_a]: 0.0065042, [2] [Cycle 1]: 0.00288537, [27] [switch_simplify]: 4.98e-05 [loop_unroll]: 3.143e-05 [a_1]: 0.00053781 [with_stream_mark]: 1.388e-05 [recompute_prepare]: 8.54002e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.43e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 7.1e-06 [updatestate_useless_node_eliminater]: 6.11e-06 [accelerated_algorithm]: 6.04001e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 8.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.297e-05 [j_node_and_user_rematch]: 9.82001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 9.11998e-06 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00194092 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.342e-05 [cse]: 2.068e-05 [replace_applicator]: 1.384e-05 [Cycle 2]: 0.00040085, [27] [switch_simplify]: 6.45002e-06 [loop_unroll]: 5.66003e-06 [a_1]: 0.00011894 [with_stream_mark]: 9.53002e-06 [recompute_prepare]: 5.84999e-06 [updatestate_depend_eliminate]: 2.73998e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.61998e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.336e-05 [j_node_and_user_rematch]: 9.30001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 8.13001e-06 [inline_without_move]: 5.37001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.40025e-07 [auto_monad_grad]: 9.50007e-07 [auto_monad_eliminator]: 4.721e-05 [cse]: 1.273e-05 [replace_applicator]: 6.85998e-06 [py_interpret_to_execute_after_opt_a]: 1.148e-05 [rewriter_after_opt_a]: 3.553e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.60001e-06 [mutable_eliminate]: 0.00057149 [jit_opt_b]: 5.282e-05, [1] [Cycle 1]: 4.64e-05, [2] [frontend_op_eliminate]: 1.823e-05 [inline_after_opt_a]: 1.779e-05 [cconv]: 2.099e-05 [loop_unroll]: 0.00040936 [jit_opt_after_cconv]: 0.00014321, [1] [Cycle 1]: 0.00013654, [11] [c_1]: 2.516e-05 [parameter_eliminate]: 2.41998e-06 [updatestate_depend_eliminate]: 5.21002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.19999e-06 [cse]: 1.872e-05 [call_graph_tuple_transform]: 1.928e-05 [tuple_list_get_item_eliminator]: 5.84e-06 [none_parameter_eliminate]: 1.24e-06 [renormalize]: 5.99975e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.317e-05 [partial_unused_args_eliminate]: 1.80001e-06 [environ_conv]: 7.26999e-06 [add_recomputation]: 4.032e-05 [cse_after_recomputation]: 2.204e-05, [1] [Cycle 1]: 1.671e-05, [1] [cse]: 1.075e-05 [auto_monad_reorder]: 1.384e-05 [get_jit_bprop_graph]: 1.49998e-06 [rewriter_after_jit_bprop_graph]: 4.65001e-06 [opt_after_jit_grad]: 0.00045167 [symbol_engine_optimizer]: 7.141e-05, [1] [Cycle 1]: 6.556e-05, [6] [build]: 2.65002e-06 [elim_shapecalc]: 8.12998e-06 [elim_not_effective]: 1.25e-05 [opt_reshape]: 6.22001e-06 [fold_const_symbol]: 9.48002e-06 [renormalize]: 2.80008e-07 [validate]: 3.464e-05 Sums bootstrap : 0.000299s : 0.52% type_inference : 0.051405s : 90.25% event_method : 0.000018s : 0.03% auto_monad : 0.000059s : 0.10% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000273s : 0.48% rewriter_before_opt_a : 0.000082s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000657s : 1.15% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001941s : 3.41% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000061s : 0.11% jit_opt_a.cse : 0.000033s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000571s : 1.00% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000021s : 0.04% loop_unroll : 0.000409s : 0.72% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000452s : 0.79% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000180 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.99% : 0.000002s : 2: substitution.fold_const_symbol 3.01% : 0.000005s : 4: substitution.graph_param_transform 82.81% : 0.000149s : 4: substitution.inline 1.97% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000005s : 4: substitution.remove_not_recompute_node 1.91% : 0.000003s : 2: substitution.replace_old_param 5.66% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051333 2 96.31% : 0.049437s : 1: type_inference.infer 3.69% : 0.001897s : 1: type_inference.specialize ------[replace.] 0.000068 6 65.94% : 0.000045s : 4: replace.inline 34.06% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 94.12% : 0.000146s : 4: match.inline 5.88% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.65% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.58% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.80% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.65% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.21% : 0.000002s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.20% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.37% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.13% : 0.000001s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.67% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.22% : 0.000003s : 18: predicate.switch_defer_inline 2.38% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.09% : 0.000009s : 58: predicate.switch_simplify 1.41% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.46% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.47% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002111 26 71.88% : 0.001517s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.35% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.77% : 0.000565s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063631 72 0.07% : 0.000043s : 1: add_recomputation 0.10% : 0.000063s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.49% : 0.000311s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 10.23% : 0.006507s : 1: jit_opt_a 0.23% : 0.000146s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.66% : 0.000418s : 1: loop_unroll 0.91% : 0.000579s : 1: mutable_eliminate 1.39% : 0.000882s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.72% : 0.000460s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000278s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000015s : 1: remove_dup_value 2.07% : 0.001319s : 1: renormalize.infer 0.97% : 0.000615s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.14% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000074s : 1: symbol_engine_optimizer 80.81% : 0.051419s : 1: type_inference TotalTime = 0.117662, [30] [bootstrap]: 0.00026181 [type_inference]: 0.106901 [event_method]: 1.836e-05 [auto_monad]: 6.755e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.68003e-06 [py_interpret_to_execute]: 0.00046186 [rewriter_before_opt_a]: 8.662e-05 [expand_dump_flag]: 3.17002e-06 [jit_opt_a]: 0.00753919, [2] [Cycle 1]: 0.00372806, [27] [switch_simplify]: 5.301e-05 [loop_unroll]: 3.028e-05 [a_1]: 0.00058926 [with_stream_mark]: 1.823e-05 [recompute_prepare]: 9.52001e-06 [updatestate_depend_eliminate]: 3.56999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 6.53003e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.95e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 1.067e-05 [meta_fg_expand]: 2.26998e-06 [replace_old_param]: 8.95999e-06 [inline_without_move]: 6.36e-06 [renormalize]: 0.00269761 [add_forward_monad_depend]: 6.23e-06 [auto_monad_grad]: 2.44999e-06 [auto_monad_eliminator]: 1.708e-05 [cse]: 2.763e-05 [replace_applicator]: 1.727e-05 [Cycle 2]: 0.00037237, [27] [switch_simplify]: 7.23999e-06 [loop_unroll]: 6.19001e-06 [a_1]: 0.00012528 [with_stream_mark]: 1.119e-05 [recompute_prepare]: 6.34999e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 1.47999e-06 [specialize_transform]: 5.79999e-06 [updatestate_useless_node_eliminater]: 5.60001e-06 [accelerated_algorithm]: 6.77002e-06 [meta_shard_fg_expand]: 1.67999e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.03e-06 [cell_reuse_recompute_pass]: 2.00002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 9.43997e-06 [meta_fg_expand]: 2.28998e-06 [replace_old_param]: 8.85001e-06 [inline_without_move]: 5.69e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 7.50006e-07 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.88e-06 [cse]: 1.043e-05 [replace_applicator]: 6.09001e-06 [py_interpret_to_execute_after_opt_a]: 1.413e-05 [rewriter_after_opt_a]: 3.602e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00067933 [jit_opt_b]: 5.635e-05, [1] [Cycle 1]: 4.984e-05, [2] [frontend_op_eliminate]: 1.928e-05 [inline_after_opt_a]: 1.778e-05 [cconv]: 2.7e-05 [loop_unroll]: 0.00043414 [jit_opt_after_cconv]: 0.00015066, [1] [Cycle 1]: 0.00014467, [11] [c_1]: 2.61e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.19e-06 [updatestate_assign_eliminate]: 2.62001e-06 [updatestate_loads_eliminate]: 2.83e-06 [cse]: 2.138e-05 [call_graph_tuple_transform]: 2.133e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 5.8001e-07 [switch_simplify]: 6.17999e-06 [remove_dup_value]: 1.59e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 8.13001e-06 [add_recomputation]: 4.799e-05 [cse_after_recomputation]: 2.143e-05, [1] [Cycle 1]: 1.658e-05, [1] [cse]: 1.098e-05 [auto_monad_reorder]: 1.595e-05 [get_jit_bprop_graph]: 2.54001e-06 [rewriter_after_jit_bprop_graph]: 5.76003e-06 [opt_after_jit_grad]: 0.00049991 [symbol_engine_optimizer]: 7.625e-05, [1] [Cycle 1]: 7.037e-05, [6] [build]: 3.95e-06 [elim_shapecalc]: 8.93002e-06 [elim_not_effective]: 1.356e-05 [opt_reshape]: 6.34999e-06 [fold_const_symbol]: 1.047e-05 [renormalize]: 3.89991e-07 [validate]: 4.158e-05 Sums bootstrap : 0.000262s : 0.23% type_inference : 0.106901s : 94.06% event_method : 0.000018s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000462s : 0.41% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000715s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002698s : 2.37% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000038s : 0.03% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000679s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.02% loop_unroll : 0.000434s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000500s : 0.44% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000211 24 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.59% : 0.000001s : 2: substitution.fold_const_symbol 2.93% : 0.000006s : 4: substitution.graph_param_transform 83.28% : 0.000176s : 4: substitution.inline 1.73% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.66% : 0.000006s : 4: substitution.remove_not_recompute_node 1.89% : 0.000004s : 2: substitution.replace_old_param 5.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106828 2 97.46% : 0.104119s : 1: type_inference.infer 2.54% : 0.002709s : 1: type_inference.specialize ------[replace.] 0.000079 6 68.27% : 0.000054s : 4: replace.inline 31.73% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 94.02% : 0.000174s : 4: match.inline 5.98% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.20% : 0.000002s : 12: predicate.addn_check_dump 1.59% : 0.000002s : 12: predicate.addn_zero_filter 2.16% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.33% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_depend_swap 1.46% : 0.000002s : 12: predicate.environ_get_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 4.79% : 0.000006s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.51% : 0.000002s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.86% : 0.000003s : 18: predicate.load_eliminater 1.12% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.95% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.18% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.17% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.92% : 0.000003s : 12: predicate.reduce_eliminate 1.62% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.46% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 18: predicate.switch_defer_inline 2.04% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.79% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.47% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.16% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.03% : 0.000003s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002155 22 64.03% : 0.001380s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.56% : 0.000745s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121383 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.22% : 0.000272s : 1: bootstrap 0.02% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.21% : 0.007544s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000441s : 1: loop_unroll 0.57% : 0.000688s : 1: mutable_eliminate 0.78% : 0.000950s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000506s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.39% : 0.000469s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.53% : 0.001861s : 1: renormalize.infer 0.68% : 0.000828s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000091s : 1: rewriter_before_opt_a 0.06% : 0.000078s : 1: symbol_engine_optimizer 88.08% : 0.106917s : 1: type_inference TotalTime = 0.116356, [30] [bootstrap]: 0.00027748 [type_inference]: 0.105905 [event_method]: 1.773e-05 [auto_monad]: 6.916e-05 [graph_reusing]: 4.90001e-06 [pre_auto_parallel]: 2.16e-06 [py_interpret_to_execute]: 0.00047004 [rewriter_before_opt_a]: 8.294e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.00732933, [2] [Cycle 1]: 0.00364688, [27] [switch_simplify]: 5.487e-05 [loop_unroll]: 2.993e-05 [a_1]: 0.00056754 [with_stream_mark]: 1.546e-05 [recompute_prepare]: 9.42999e-06 [updatestate_depend_eliminate]: 3.83001e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.94001e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 6.88998e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 2.34999e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 4.30999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.597e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.43998e-06 [replace_old_param]: 9.43002e-06 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00265035 [add_forward_monad_depend]: 5.15999e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 1.245e-05 [cse]: 2.133e-05 [replace_applicator]: 1.53e-05 [Cycle 2]: 0.00037561, [27] [switch_simplify]: 7.21999e-06 [loop_unroll]: 6.02001e-06 [a_1]: 0.00012588 [with_stream_mark]: 1.351e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 2.98e-06 [updatestate_loads_eliminate]: 2.58998e-06 [parameter_eliminate]: 1.57001e-06 [specialize_transform]: 5.78002e-06 [updatestate_useless_node_eliminater]: 5.74e-06 [accelerated_algorithm]: 5.81e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.62999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 2.26998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.706e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.25001e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 6.19001e-06 [cse]: 1.105e-05 [replace_applicator]: 6.01998e-06 [py_interpret_to_execute_after_opt_a]: 1.226e-05 [rewriter_after_opt_a]: 3.433e-05 [convert_after_rewriter]: 7.14001e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.00061408 [jit_opt_b]: 5.398e-05, [1] [Cycle 1]: 4.692e-05, [2] [frontend_op_eliminate]: 1.891e-05 [inline_after_opt_a]: 1.739e-05 [cconv]: 2.523e-05 [loop_unroll]: 0.00041822 [jit_opt_after_cconv]: 0.00016763, [1] [Cycle 1]: 0.00016089, [11] [c_1]: 2.619e-05 [parameter_eliminate]: 2.14999e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.933e-05 [call_graph_tuple_transform]: 3.951e-05 [tuple_list_get_item_eliminator]: 6.65002e-06 [none_parameter_eliminate]: 1.69e-06 [renormalize]: 3.80009e-07 [switch_simplify]: 6.13998e-06 [remove_dup_value]: 1.547e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 8.22e-06 [add_recomputation]: 4.662e-05 [cse_after_recomputation]: 2.343e-05, [1] [Cycle 1]: 1.747e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 1.71e-06 [rewriter_after_jit_bprop_graph]: 4.35e-06 [opt_after_jit_grad]: 0.00045729 [symbol_engine_optimizer]: 7.234e-05, [1] [Cycle 1]: 6.647e-05, [6] [build]: 3.16999e-06 [elim_shapecalc]: 8.03999e-06 [elim_not_effective]: 1.275e-05 [opt_reshape]: 6.19001e-06 [fold_const_symbol]: 9.35001e-06 [renormalize]: 3.19997e-07 [validate]: 4.092e-05 Sums bootstrap : 0.000277s : 0.25% type_inference : 0.105905s : 94.15% event_method : 0.000018s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000470s : 0.42% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000693s : 0.62% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.00% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002650s : 2.36% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000614s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000418s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000040s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000457s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000199 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000006s : 4: substitution.graph_param_transform 81.86% : 0.000163s : 4: substitution.inline 2.03% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000006s : 4: substitution.remove_not_recompute_node 2.04% : 0.000004s : 2: substitution.replace_old_param 6.51% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105836 2 97.61% : 0.103303s : 1: type_inference.infer 2.39% : 0.002533s : 1: type_inference.specialize ------[replace.] 0.000073 6 65.27% : 0.000047s : 4: replace.inline 34.73% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000172 6 93.16% : 0.000160s : 4: match.inline 6.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.87% : 0.000003s : 12: predicate.arithmetic_simplify 1.39% : 0.000002s : 12: predicate.cast_eliminate 0.55% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.25% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.35% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.47% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.19% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.77% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.41% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.33% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.06% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.14% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.23% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.46% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002124 22 63.80% : 0.001355s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.74% : 0.000738s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120022 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000293s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.11% : 0.007333s : 1: jit_opt_a 0.14% : 0.000170s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.35% : 0.000426s : 1: loop_unroll 0.52% : 0.000622s : 1: mutable_eliminate 0.77% : 0.000928s : 26: opt.transform.jit_opt_a 0.06% : 0.000075s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000476s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.54% : 0.001848s : 1: renormalize.infer 0.66% : 0.000794s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 88.25% : 0.105919s : 1: type_inference TotalTime = 0.0117088, [30] [bootstrap]: 0.00025785 [type_inference]: 0.00430387 [event_method]: 1.603e-05 [auto_monad]: 4.22e-05 [graph_reusing]: 3.6e-06 [pre_auto_parallel]: 1.49e-06 [py_interpret_to_execute]: 3.341e-05 [rewriter_before_opt_a]: 6.386e-05 [expand_dump_flag]: 1.97001e-06 [jit_opt_a]: 0.00500018, [2] [Cycle 1]: 0.00150896, [27] [switch_simplify]: 4.885e-05 [loop_unroll]: 2.94e-05 [a_1]: 0.00050424 [with_stream_mark]: 1.356e-05 [recompute_prepare]: 7.35998e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.05001e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 5.27001e-06 [meta_shard_fg_expand]: 1.29998e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 9.49978e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.167e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 8.3e-06 [inline_without_move]: 5.51e-06 [renormalize]: 0.00061906 [add_forward_monad_depend]: 3.95e-06 [auto_monad_grad]: 1.29e-06 [auto_monad_eliminator]: 1.135e-05 [cse]: 2.047e-05 [replace_applicator]: 1.136e-05 [Cycle 2]: 0.00031115, [27] [switch_simplify]: 5.51e-06 [loop_unroll]: 4.97e-06 [a_1]: 9.224e-05 [with_stream_mark]: 7.95e-06 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 4.63999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.45999e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.172e-05 [j_node_and_user_rematch]: 7.61001e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 4.72e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.34e-06 [cse]: 1.061e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 8.13999e-06 [rewriter_after_opt_a]: 2.656e-05 [convert_after_rewriter]: 5.44e-06 [order_py_execute_after_rewriter]: 3.81999e-06 [mutable_eliminate]: 0.00053512 [jit_opt_b]: 4.758e-05, [1] [Cycle 1]: 4.162e-05, [2] [frontend_op_eliminate]: 1.588e-05 [inline_after_opt_a]: 1.543e-05 [cconv]: 1.445e-05 [loop_unroll]: 0.00041009 [jit_opt_after_cconv]: 0.00014633, [1] [Cycle 1]: 0.00014023, [11] [c_1]: 2.04e-05 [parameter_eliminate]: 1.94999e-06 [updatestate_depend_eliminate]: 4.47e-06 [updatestate_assign_eliminate]: 1.471e-05 [updatestate_loads_eliminate]: 2.82002e-06 [cse]: 1.842e-05 [call_graph_tuple_transform]: 1.629e-05 [tuple_list_get_item_eliminator]: 5.19e-06 [none_parameter_eliminate]: 8.2e-07 [renormalize]: 4.69998e-07 [switch_simplify]: 5.49e-06 [remove_dup_value]: 8.45001e-06 [partial_unused_args_eliminate]: 1.35999e-06 [environ_conv]: 3.57997e-06 [add_recomputation]: 3.158e-05 [cse_after_recomputation]: 2.097e-05, [1] [Cycle 1]: 1.57e-05, [1] [cse]: 1.003e-05 [auto_monad_reorder]: 9.29e-06 [get_jit_bprop_graph]: 1.59998e-06 [rewriter_after_jit_bprop_graph]: 4.15e-06 [opt_after_jit_grad]: 0.00045912 [symbol_engine_optimizer]: 6.937e-05, [1] [Cycle 1]: 6.371e-05, [6] [build]: 2.71e-06 [elim_shapecalc]: 7.55e-06 [elim_not_effective]: 1.207e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.18001e-06 [renormalize]: 3.4002e-07 [validate]: 2.829e-05 Sums bootstrap : 0.000258s : 3.23% type_inference : 0.004304s : 53.86% event_method : 0.000016s : 0.20% auto_monad : 0.000042s : 0.53% graph_reusing : 0.000004s : 0.05% pre_auto_parallel : 0.000001s : 0.02% py_interpret_to_execute : 0.000033s : 0.42% rewriter_before_opt_a : 0.000064s : 0.80% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000054s : 0.68% jit_opt_a.loop_unroll : 0.000034s : 0.43% jit_opt_a.a_1 : 0.000596s : 7.46% jit_opt_a.with_stream_mark : 0.000022s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000012s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000023s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000619s : 7.75% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.21% jit_opt_a.cse : 0.000031s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000027s : 0.33% convert_after_rewriter : 0.000005s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000535s : 6.70% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000014s : 0.18% loop_unroll : 0.000410s : 5.13% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000015s : 0.18% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000008s : 0.11% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000004s : 0.04% add_recomputation : 0.000032s : 0.40% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000009s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000459s : 5.75% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.35% Time group info: ------[substitution.] 0.000166 23 0.87% : 0.000001s : 2: substitution.elim_not_effective 0.66% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000004s : 3: substitution.graph_param_transform 84.29% : 0.000140s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.89% : 0.000005s : 4: substitution.remove_not_recompute_node 2.28% : 0.000004s : 2: substitution.replace_old_param 4.83% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004253 2 81.44% : 0.003464s : 1: type_inference.infer 18.56% : 0.000789s : 1: type_inference.specialize ------[replace.] 0.000065 6 65.72% : 0.000042s : 4: replace.inline 34.28% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000144 6 95.20% : 0.000137s : 4: match.inline 4.80% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.31% : 0.000002s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.76% : 0.000002s : 10: predicate.arithmetic_simplify 1.55% : 0.000002s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.40% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 3: predicate.elim_not_effective 0.65% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.07% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.62% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.03% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.41% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000001s : 3: predicate.opt_reshape 2.17% : 0.000002s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 2.04% : 0.000002s : 10: predicate.reduce_eliminate 1.69% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000001s : 10: predicate.reshape_eliminate 1.28% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.14% : 0.000001s : 6: predicate.special_op_eliminate 1.14% : 0.000001s : 6: predicate.specialize_transform 1.53% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.48% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.65% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.34% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000581 13 49.50% : 0.000288s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.48% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.02% : 0.000261s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013192 72 0.26% : 0.000034s : 1: add_recomputation 0.34% : 0.000045s : 1: auto_monad 0.09% : 0.000012s : 1: auto_monad_reorder 2.06% : 0.000271s : 1: bootstrap 0.13% : 0.000017s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 37.92% : 0.005003s : 1: jit_opt_a 1.13% : 0.000149s : 1: jit_opt_after_cconv 0.38% : 0.000050s : 1: jit_opt_b 3.16% : 0.000417s : 1: loop_unroll 4.13% : 0.000544s : 1: mutable_eliminate 6.04% : 0.000797s : 26: opt.transform.jit_opt_a 0.34% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.54% : 0.000467s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.27% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.08% : 0.000011s : 1: remove_dup_value 2.45% : 0.000324s : 1: renormalize.infer 2.20% : 0.000290s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000029s : 1: rewriter_after_opt_a 0.50% : 0.000066s : 1: rewriter_before_opt_a 0.55% : 0.000072s : 1: symbol_engine_optimizer 32.72% : 0.004316s : 1: type_inference TotalTime = 0.116756, [30] [bootstrap]: 0.00026833 [type_inference]: 0.105465 [event_method]: 1.67e-05 [auto_monad]: 5.923e-05 [graph_reusing]: 4.54998e-06 [pre_auto_parallel]: 1.74e-06 [py_interpret_to_execute]: 0.00049763 [rewriter_before_opt_a]: 8.482e-05 [expand_dump_flag]: 3.24001e-06 [jit_opt_a]: 0.00768607, [2] [Cycle 1]: 0.00388534, [27] [switch_simplify]: 5.724e-05 [loop_unroll]: 3.214e-05 [a_1]: 0.00062562 [with_stream_mark]: 1.797e-05 [recompute_prepare]: 9.89001e-06 [updatestate_depend_eliminate]: 4.22e-06 [updatestate_assign_eliminate]: 3.55998e-06 [updatestate_loads_eliminate]: 3.33e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 7.33999e-06 [updatestate_useless_node_eliminater]: 6.54999e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 6.80002e-06 [merge_forward]: 3.74002e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 1.006e-05 [meta_fg_expand]: 2.52001e-06 [replace_old_param]: 9.86e-06 [inline_without_move]: 6.41e-06 [renormalize]: 0.00279003 [add_forward_monad_depend]: 7.33e-06 [auto_monad_grad]: 3.04999e-06 [auto_monad_eliminator]: 1.7e-05 [cse]: 2.792e-05 [replace_applicator]: 2.095e-05 [Cycle 2]: 0.00039997, [27] [switch_simplify]: 6.62002e-06 [loop_unroll]: 5.74999e-06 [a_1]: 0.00013612 [with_stream_mark]: 1.359e-05 [recompute_prepare]: 6.63998e-06 [updatestate_depend_eliminate]: 3.63999e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.83e-06 [parameter_eliminate]: 1.77999e-06 [specialize_transform]: 6.48998e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.35002e-06 [meta_shard_fg_expand]: 1.83002e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.41001e-06 [cell_reuse_recompute_pass]: 3.31999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.915e-05 [j_node_and_user_rematch]: 9.09e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.99001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.14998e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 6.66e-06 [cse]: 1.153e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.362e-05 [rewriter_after_opt_a]: 3.622e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 9.04e-06 [mutable_eliminate]: 0.00070552 [jit_opt_b]: 6.194e-05, [1] [Cycle 1]: 5.312e-05, [2] [frontend_op_eliminate]: 2.12e-05 [inline_after_opt_a]: 2.02e-05 [cconv]: 2.906e-05 [loop_unroll]: 0.00045886 [jit_opt_after_cconv]: 0.00016889, [1] [Cycle 1]: 0.0001625, [11] [c_1]: 2.761e-05 [parameter_eliminate]: 3.25998e-06 [updatestate_depend_eliminate]: 6.17001e-06 [updatestate_assign_eliminate]: 2.66e-06 [updatestate_loads_eliminate]: 2.31998e-06 [cse]: 3.013e-05 [call_graph_tuple_transform]: 2.394e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 1.69995e-07 [switch_simplify]: 6.06998e-06 [remove_dup_value]: 1.853e-05 [partial_unused_args_eliminate]: 2.66e-06 [environ_conv]: 1.009e-05 [add_recomputation]: 5.811e-05 [cse_after_recomputation]: 2.759e-05, [1] [Cycle 1]: 1.967e-05, [1] [cse]: 1.261e-05 [auto_monad_reorder]: 1.662e-05 [get_jit_bprop_graph]: 2.55997e-06 [rewriter_after_jit_bprop_graph]: 7.51999e-06 [opt_after_jit_grad]: 0.0007188 [symbol_engine_optimizer]: 8.554e-05, [1] [Cycle 1]: 7.747e-05, [6] [build]: 4.52998e-06 [elim_shapecalc]: 9.81e-06 [elim_not_effective]: 1.608e-05 [opt_reshape]: 7.43999e-06 [fold_const_symbol]: 1.055e-05 [renormalize]: 6.39993e-07 [validate]: 4.955e-05 Sums bootstrap : 0.000268s : 0.24% type_inference : 0.105465s : 93.54% event_method : 0.000017s : 0.01% auto_monad : 0.000059s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000498s : 0.44% rewriter_before_opt_a : 0.000085s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000762s : 0.68% jit_opt_a.with_stream_mark : 0.000032s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002790s : 2.47% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000039s : 0.03% jit_opt_a.replace_applicator : 0.000027s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000009s : 0.01% mutable_eliminate : 0.000706s : 0.63% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000020s : 0.02% cconv : 0.000029s : 0.03% loop_unroll : 0.000459s : 0.41% jit_opt_after_cconv.c_1 : 0.000028s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000019s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000058s : 0.05% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000008s : 0.01% opt_after_jit_grad : 0.000719s : 0.64% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000050s : 0.04% Time group info: ------[substitution.] 0.000228 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 3.04% : 0.000007s : 4: substitution.graph_param_transform 82.05% : 0.000187s : 4: substitution.inline 1.74% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000006s : 4: substitution.remove_not_recompute_node 2.73% : 0.000006s : 2: substitution.replace_old_param 6.13% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105404 2 97.51% : 0.102779s : 1: type_inference.infer 2.49% : 0.002625s : 1: type_inference.specialize ------[replace.] 0.000082 6 66.89% : 0.000055s : 4: replace.inline 33.11% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000197 6 93.53% : 0.000184s : 4: match.inline 6.47% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000150 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.67% : 0.000003s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000002s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000002s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.21% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000001s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.40% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_depend_swap 1.33% : 0.000002s : 12: predicate.environ_get_eliminate 1.01% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.96% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 5.45% : 0.000008s : 26: predicate.inline 0.83% : 0.000001s : 8: predicate.inline_without_move 0.41% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.72% : 0.000003s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.31% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000002s : 12: predicate.merge_addn 1.05% : 0.000002s : 12: predicate.minmaximum_grad 1.35% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.91% : 0.000003s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.58% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.35% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.24% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.68% : 0.000010s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.51% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.59% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002060 22 64.13% : 0.001321s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.19% : 0.000704s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.120643 72 0.05% : 0.000061s : 1: add_recomputation 0.05% : 0.000062s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000281s : 1: bootstrap 0.03% : 0.000032s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000030s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.37% : 0.007689s : 1: jit_opt_a 0.14% : 0.000172s : 1: jit_opt_after_cconv 0.05% : 0.000065s : 1: jit_opt_b 0.39% : 0.000468s : 1: loop_unroll 0.59% : 0.000716s : 1: mutable_eliminate 0.84% : 0.001011s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000034s : 4: opt.transform.jit_opt_b 0.01% : 0.000015s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.03% : 0.000035s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000041s : 4: opt.transform.symbol_engine_opt 0.61% : 0.000732s : 1: opt_after_jit_grad 0.01% : 0.000011s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000503s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000023s : 1: remove_dup_value 1.62% : 0.001953s : 1: renormalize.infer 0.69% : 0.000827s : 1: renormalize.specialize 0.01% : 0.000010s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000089s : 1: rewriter_before_opt_a 0.07% : 0.000089s : 1: symbol_engine_optimizer 87.43% : 0.105477s : 1: type_inference TotalTime = 0.0667951, [30] [bootstrap]: 0.00027095 [type_inference]: 0.0565373 [event_method]: 1.946e-05 [auto_monad]: 6.465e-05 [graph_reusing]: 5.82001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00028809 [rewriter_before_opt_a]: 8.385e-05 [expand_dump_flag]: 3.6e-06 [jit_opt_a]: 0.00696464, [2] [Cycle 1]: 0.00302731, [27] [switch_simplify]: 4.787e-05 [loop_unroll]: 3.058e-05 [a_1]: 0.00060034 [with_stream_mark]: 1.742e-05 [recompute_prepare]: 8.55001e-06 [updatestate_depend_eliminate]: 3.11999e-06 [updatestate_assign_eliminate]: 2.78998e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.28002e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.16e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.394e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.58e-06 [replace_old_param]: 1.03e-05 [inline_without_move]: 6.37001e-06 [renormalize]: 0.00198637 [add_forward_monad_depend]: 5.94e-06 [auto_monad_grad]: 2.51998e-06 [auto_monad_eliminator]: 1.499e-05 [cse]: 2.891e-05 [replace_applicator]: 1.891e-05 [Cycle 2]: 0.00039365, [27] [switch_simplify]: 6.65998e-06 [loop_unroll]: 6.21e-06 [a_1]: 0.00012938 [with_stream_mark]: 1.226e-05 [recompute_prepare]: 6.24001e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.59999e-06 [updatestate_loads_eliminate]: 2.38002e-06 [parameter_eliminate]: 1.26997e-06 [specialize_transform]: 6.08002e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 5.77001e-06 [meta_shard_fg_expand]: 2.33998e-06 [get_grad_eliminate_]: 5.64e-06 [merge_forward]: 3.48999e-06 [cell_reuse_recompute_pass]: 2.99999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.577e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 1.68997e-06 [replace_old_param]: 9.66e-06 [inline_without_move]: 5.87999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.52001e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 7.88001e-06 [cse]: 1.327e-05 [replace_applicator]: 7.62998e-06 [py_interpret_to_execute_after_opt_a]: 1.227e-05 [rewriter_after_opt_a]: 3.547e-05 [convert_after_rewriter]: 6.88998e-06 [order_py_execute_after_rewriter]: 4.58001e-06 [mutable_eliminate]: 0.00078306 [jit_opt_b]: 5.824e-05, [1] [Cycle 1]: 5.082e-05, [2] [frontend_op_eliminate]: 1.957e-05 [inline_after_opt_a]: 1.813e-05 [cconv]: 2.674e-05 [loop_unroll]: 0.00048366 [jit_opt_after_cconv]: 0.00016694, [1] [Cycle 1]: 0.00015912, [11] [c_1]: 2.627e-05 [parameter_eliminate]: 4.08001e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.60002e-06 [updatestate_loads_eliminate]: 2.52001e-06 [cse]: 2.979e-05 [call_graph_tuple_transform]: 2.397e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.82001e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 6.24001e-06 [remove_dup_value]: 1.54e-05 [partial_unused_args_eliminate]: 2.34999e-06 [environ_conv]: 9.56998e-06 [add_recomputation]: 4.966e-05 [cse_after_recomputation]: 2.428e-05, [1] [Cycle 1]: 1.912e-05, [1] [cse]: 1.283e-05 [auto_monad_reorder]: 1.721e-05 [get_jit_bprop_graph]: 1.91e-06 [rewriter_after_jit_bprop_graph]: 6.36e-06 [opt_after_jit_grad]: 0.00051749 [symbol_engine_optimizer]: 0.00010641, [1] [Cycle 1]: 9.968e-05, [6] [build]: 4.07e-06 [elim_shapecalc]: 7.68999e-06 [elim_not_effective]: 1.608e-05 [opt_reshape]: 6.86999e-06 [fold_const_symbol]: 9.94999e-06 [renormalize]: 5.39992e-07 [validate]: 4.488e-05 Sums bootstrap : 0.000271s : 0.43% type_inference : 0.056537s : 90.28% event_method : 0.000019s : 0.03% auto_monad : 0.000065s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000288s : 0.46% rewriter_before_opt_a : 0.000084s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000055s : 0.09% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000730s : 1.17% jit_opt_a.with_stream_mark : 0.000030s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001986s : 3.17% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000027s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000783s : 1.25% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.04% loop_unroll : 0.000484s : 0.77% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000017s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000517s : 0.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000045s : 0.07% Time group info: ------[substitution.] 0.000213 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 82.20% : 0.000175s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.36% : 0.000005s : 4: substitution.remove_not_recompute_node 2.97% : 0.000006s : 2: substitution.replace_old_param 6.23% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.056454 2 96.48% : 0.054469s : 1: type_inference.infer 3.52% : 0.001985s : 1: type_inference.specialize ------[replace.] 0.000079 6 65.81% : 0.000052s : 4: replace.inline 34.19% : 0.000027s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000184 6 93.45% : 0.000172s : 4: match.inline 6.55% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.45% : 0.000002s : 12: predicate.accumulaten_eliminater 1.30% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000003s : 12: predicate.arithmetic_simplify 1.53% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000002s : 12: predicate.compare_switch_simplify 1.11% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.51% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.13% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.10% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_depend_swap 1.77% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 0.98% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.93% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.69% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.14% : 0.000003s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.47% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.32% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 2.12% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 2.14% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.77% : 0.000001s : 8: predicate.replace_old_param 0.53% : 0.000001s : 4: predicate.reset_defer_inline 1.32% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.02% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.88% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 2.12% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.60% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.44% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.12% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002350 26 72.83% : 0.001712s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.71% : 0.000604s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.069825 72 0.08% : 0.000054s : 1: add_recomputation 0.10% : 0.000069s : 1: auto_monad 0.03% : 0.000020s : 1: auto_monad_reorder 0.40% : 0.000281s : 1: bootstrap 0.04% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.98% : 0.006969s : 1: jit_opt_a 0.24% : 0.000170s : 1: jit_opt_after_cconv 0.09% : 0.000061s : 1: jit_opt_b 0.71% : 0.000494s : 1: loop_unroll 1.14% : 0.000794s : 1: mutable_eliminate 1.38% : 0.000966s : 26: opt.transform.jit_opt_a 0.08% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000016s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000017s : 1: opt.transform.mutable_eliminate 0.04% : 0.000028s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000295s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.92% : 0.001338s : 1: renormalize.infer 0.91% : 0.000638s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000089s : 1: rewriter_before_opt_a 0.16% : 0.000109s : 1: symbol_engine_optimizer 81.00% : 0.056554s : 1: type_inference TotalTime = 0.0124475, [30] [bootstrap]: 0.00026545 [type_inference]: 0.00420424 [event_method]: 1.661e-05 [auto_monad]: 6.086e-05 [graph_reusing]: 5.02e-06 [pre_auto_parallel]: 1.74e-06 [py_interpret_to_execute]: 3.539e-05 [rewriter_before_opt_a]: 6.717e-05 [expand_dump_flag]: 2.93e-06 [jit_opt_a]: 0.00547327, [2] [Cycle 1]: 0.0018514, [27] [switch_simplify]: 6.15e-05 [loop_unroll]: 3.167e-05 [a_1]: 0.00062037 [with_stream_mark]: 2.238e-05 [recompute_prepare]: 1.073e-05 [updatestate_depend_eliminate]: 4.19997e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 2.37999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.61e-06 [meta_shard_fg_expand]: 2.24001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.81e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.688e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 6.26e-06 [renormalize]: 0.00076186 [add_forward_monad_depend]: 5.87001e-06 [auto_monad_grad]: 2.98e-06 [auto_monad_eliminator]: 1.447e-05 [cse]: 2.85e-05 [replace_applicator]: 1.333e-05 [Cycle 2]: 0.00031853, [27] [switch_simplify]: 5.72001e-06 [loop_unroll]: 4.82e-06 [a_1]: 9.452e-05 [with_stream_mark]: 8.50999e-06 [recompute_prepare]: 4.95001e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 4.95001e-06 [updatestate_useless_node_eliminater]: 4.98001e-06 [accelerated_algorithm]: 5.15999e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.4e-06 [merge_forward]: 2.73998e-06 [cell_reuse_recompute_pass]: 1.91e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.261e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.02002e-06 [inline_without_move]: 4.53001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 9.60019e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.058e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 1.179e-05 [rewriter_after_opt_a]: 3.606e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 4.85001e-06 [mutable_eliminate]: 0.00069604 [jit_opt_b]: 5.056e-05, [1] [Cycle 1]: 4.344e-05, [2] [frontend_op_eliminate]: 1.592e-05 [inline_after_opt_a]: 1.641e-05 [cconv]: 3.215e-05 [loop_unroll]: 0.00044025 [jit_opt_after_cconv]: 0.0001416, [1] [Cycle 1]: 0.00013533, [11] [c_1]: 2.164e-05 [parameter_eliminate]: 2.85998e-06 [updatestate_depend_eliminate]: 4.75001e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 1.983e-05 [call_graph_tuple_transform]: 1.954e-05 [tuple_list_get_item_eliminator]: 5.57999e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 7.80012e-07 [switch_simplify]: 5.10001e-06 [remove_dup_value]: 1.671e-05 [partial_unused_args_eliminate]: 2.26e-06 [environ_conv]: 5.90002e-06 [add_recomputation]: 6.616e-05 [cse_after_recomputation]: 2.128e-05, [1] [Cycle 1]: 1.581e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.508e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 5.84e-06 [opt_after_jit_grad]: 0.0004832 [symbol_engine_optimizer]: 7.874e-05, [1] [Cycle 1]: 7.161e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 9.02e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 6.24999e-06 [fold_const_symbol]: 9.77001e-06 [renormalize]: 8.00006e-07 [validate]: 4.169e-05 Sums bootstrap : 0.000265s : 3.10% type_inference : 0.004204s : 49.05% event_method : 0.000017s : 0.19% auto_monad : 0.000061s : 0.71% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.41% rewriter_before_opt_a : 0.000067s : 0.78% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000067s : 0.78% jit_opt_a.loop_unroll : 0.000036s : 0.43% jit_opt_a.a_1 : 0.000715s : 8.34% jit_opt_a.with_stream_mark : 0.000031s : 0.36% jit_opt_a.recompute_prepare : 0.000016s : 0.18% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000018s : 0.20% jit_opt_a.inline_without_move : 0.000011s : 0.13% jit_opt_a.renormalize : 0.000762s : 8.89% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000004s : 0.05% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.24% jit_opt_a.cse : 0.000039s : 0.46% jit_opt_a.replace_applicator : 0.000019s : 0.22% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000036s : 0.42% convert_after_rewriter : 0.000008s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000696s : 8.12% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000032s : 0.38% loop_unroll : 0.000440s : 5.14% jit_opt_after_cconv.c_1 : 0.000022s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000017s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000066s : 0.77% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000483s : 5.64% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.11% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.11% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000042s : 0.49% Time group info: ------[substitution.] 0.000253 23 0.95% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000002s : 2: substitution.fold_const_symbol 2.43% : 0.000006s : 3: substitution.graph_param_transform 84.67% : 0.000215s : 4: substitution.inline 1.61% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.19% : 0.000006s : 4: substitution.remove_not_recompute_node 2.12% : 0.000005s : 2: substitution.replace_old_param 5.35% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004152 2 79.82% : 0.003314s : 1: type_inference.infer 20.18% : 0.000838s : 1: type_inference.specialize ------[replace.] 0.000088 6 62.50% : 0.000055s : 4: replace.inline 37.50% : 0.000033s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000224 6 94.44% : 0.000212s : 4: match.inline 5.56% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 691 1.33% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.19% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000002s : 10: predicate.addn_zero_filter 2.65% : 0.000003s : 10: predicate.arithmetic_simplify 1.74% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000002s : 10: predicate.depend_value_elim 1.04% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.01% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.14% : 0.000001s : 10: predicate.environ_get_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 1.10% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000007s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.72% : 0.000002s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.77% : 0.000002s : 15: predicate.load_eliminater 1.10% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.01% : 0.000001s : 10: predicate.minmaximum_grad 1.49% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.16% : 0.000003s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 2.06% : 0.000003s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.60% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.16% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 3: predicate.row_tensor_eliminate 1.12% : 0.000001s : 10: predicate.same_eliminate 0.72% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.31% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.14% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 3.17% : 0.000004s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.71% : 0.000010s : 53: predicate.switch_simplify 1.13% : 0.000001s : 10: predicate.tile_eliminate 1.14% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.76% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.53% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.73% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000660 13 44.92% : 0.000297s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.12% : 0.000047s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.96% : 0.000317s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014208 72 0.49% : 0.000069s : 1: add_recomputation 0.45% : 0.000064s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 1.96% : 0.000278s : 1: bootstrap 0.24% : 0.000035s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 38.55% : 0.005477s : 1: jit_opt_a 1.01% : 0.000144s : 1: jit_opt_after_cconv 0.37% : 0.000053s : 1: jit_opt_b 3.15% : 0.000447s : 1: loop_unroll 4.96% : 0.000704s : 1: mutable_eliminate 6.62% : 0.000941s : 26: opt.transform.jit_opt_a 0.34% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000036s : 4: opt.transform.symbol_engine_opt 3.46% : 0.000491s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000038s : 1: py_interpret_to_execute 0.10% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000019s : 1: remove_dup_value 2.86% : 0.000407s : 1: renormalize.infer 2.43% : 0.000346s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.49% : 0.000070s : 1: rewriter_before_opt_a 0.57% : 0.000081s : 1: symbol_engine_optimizer 29.66% : 0.004215s : 1: type_inference TotalTime = 0.113572, [30] [bootstrap]: 0.00026803 [type_inference]: 0.103329 [event_method]: 1.773e-05 [auto_monad]: 6.165e-05 [graph_reusing]: 4.75001e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.0004795 [rewriter_before_opt_a]: 7.988e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00709652, [2] [Cycle 1]: 0.00348016, [27] [switch_simplify]: 4.909e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.000542 [with_stream_mark]: 1.363e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.66999e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 6.75002e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.42001e-06 [meta_shard_fg_expand]: 2.31e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.244e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.42001e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 5.81998e-06 [renormalize]: 0.00253282 [add_forward_monad_depend]: 4.94998e-06 [auto_monad_grad]: 2.07999e-06 [auto_monad_eliminator]: 1.159e-05 [cse]: 2.095e-05 [replace_applicator]: 1.445e-05 [Cycle 2]: 0.00035828, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 6.36e-06 [a_1]: 0.00012318 [with_stream_mark]: 9.69999e-06 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 2.72001e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.51002e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.54e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 2.01e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.361e-05 [j_node_and_user_rematch]: 8.67e-06 [meta_fg_expand]: 1.87999e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.22999e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.44998e-06 [cse]: 1.071e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 1.118e-05 [rewriter_after_opt_a]: 3.438e-05 [convert_after_rewriter]: 6.27001e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00065465 [jit_opt_b]: 5.598e-05, [1] [Cycle 1]: 4.89e-05, [2] [frontend_op_eliminate]: 2e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.354e-05 [loop_unroll]: 0.00042174 [jit_opt_after_cconv]: 0.00014747, [1] [Cycle 1]: 0.0001414, [11] [c_1]: 2.621e-05 [parameter_eliminate]: 2.19999e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 1.975e-05 [call_graph_tuple_transform]: 1.956e-05 [tuple_list_get_item_eliminator]: 6.17001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.23e-06 [remove_dup_value]: 1.504e-05 [partial_unused_args_eliminate]: 1.92999e-06 [environ_conv]: 7.44002e-06 [add_recomputation]: 4.479e-05 [cse_after_recomputation]: 2.117e-05, [1] [Cycle 1]: 1.567e-05, [1] [cse]: 1.028e-05 [auto_monad_reorder]: 1.398e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 5.57999e-06 [opt_after_jit_grad]: 0.00045791 [symbol_engine_optimizer]: 9.264e-05, [1] [Cycle 1]: 8.63e-05, [6] [build]: 2.92002e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 7.15003e-06 [fold_const_symbol]: 1.006e-05 [renormalize]: 6.50005e-07 [validate]: 4.279e-05 Sums bootstrap : 0.000268s : 0.24% type_inference : 0.103329s : 94.16% event_method : 0.000018s : 0.02% auto_monad : 0.000062s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000480s : 0.44% rewriter_before_opt_a : 0.000080s : 0.07% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000665s : 0.61% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002533s : 2.31% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000655s : 0.60% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000422s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000458s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000188 24 1.30% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 3.02% : 0.000006s : 4: substitution.graph_param_transform 82.21% : 0.000154s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 6.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103262 2 97.49% : 0.100673s : 1: type_inference.infer 2.51% : 0.002589s : 1: type_inference.specialize ------[replace.] 0.000070 6 67.23% : 0.000047s : 4: replace.inline 32.77% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 93.54% : 0.000152s : 4: match.inline 6.46% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 0.91% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.09% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.40% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.40% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 4.93% : 0.000006s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.59% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000003s : 18: predicate.load_eliminater 1.20% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.20% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.25% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000001s : 12: predicate.print_const_string_wrapper 1.85% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.98% : 0.000001s : 4: predicate.row_tensor_eliminate 1.49% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.39% : 0.000002s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.60% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.89% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002167 22 63.18% : 0.001369s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.41% : 0.000767s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117063 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000065s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.24% : 0.000279s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.06% : 0.007100s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.37% : 0.000429s : 1: loop_unroll 0.57% : 0.000662s : 1: mutable_eliminate 0.76% : 0.000887s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000486s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.47% : 0.001718s : 1: renormalize.infer 0.69% : 0.000807s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000085s : 1: rewriter_before_opt_a 0.08% : 0.000095s : 1: symbol_engine_optimizer 88.28% : 0.103342s : 1: type_inference TotalTime = 0.114667, [30] [bootstrap]: 0.00026957 [type_inference]: 0.104019 [event_method]: 1.838e-05 [auto_monad]: 6.842e-05 [graph_reusing]: 5.91998e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.000497 [rewriter_before_opt_a]: 9.454e-05 [expand_dump_flag]: 3.85e-06 [jit_opt_a]: 0.00745605, [2] [Cycle 1]: 0.00361711, [27] [switch_simplify]: 6.138e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00057797 [with_stream_mark]: 1.815e-05 [recompute_prepare]: 8.53001e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.83002e-06 [specialize_transform]: 7e-06 [updatestate_useless_node_eliminater]: 6.56e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.07999e-06 [get_grad_eliminate_]: 6.16998e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.709e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.93e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 5.98998e-06 [renormalize]: 0.00256516 [add_forward_monad_depend]: 7.05e-06 [auto_monad_grad]: 2.79999e-06 [auto_monad_eliminator]: 1.691e-05 [cse]: 3.215e-05 [replace_applicator]: 1.872e-05 [Cycle 2]: 0.00036863, [27] [switch_simplify]: 6.81999e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012381 [with_stream_mark]: 1.07e-05 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.5e-06 [cell_reuse_recompute_pass]: 2.59001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.581e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.86e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.07001e-06 [cse]: 1.175e-05 [replace_applicator]: 5.83002e-06 [py_interpret_to_execute_after_opt_a]: 1.174e-05 [rewriter_after_opt_a]: 3.676e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.05999e-06 [mutable_eliminate]: 0.00065261 [jit_opt_b]: 5.536e-05, [1] [Cycle 1]: 4.845e-05, [2] [frontend_op_eliminate]: 1.917e-05 [inline_after_opt_a]: 1.756e-05 [cconv]: 2.498e-05 [loop_unroll]: 0.00042213 [jit_opt_after_cconv]: 0.0001458, [1] [Cycle 1]: 0.00013938, [11] [c_1]: 2.58e-05 [parameter_eliminate]: 2.02999e-06 [updatestate_depend_eliminate]: 4.49998e-06 [updatestate_assign_eliminate]: 2.74999e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.001e-05 [call_graph_tuple_transform]: 1.983e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.53002e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.476e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 7.88001e-06 [add_recomputation]: 4.724e-05 [cse_after_recomputation]: 2.219e-05, [1] [Cycle 1]: 1.711e-05, [1] [cse]: 1.127e-05 [auto_monad_reorder]: 1.548e-05 [get_jit_bprop_graph]: 1.50999e-06 [rewriter_after_jit_bprop_graph]: 4.64998e-06 [opt_after_jit_grad]: 0.00045267 [symbol_engine_optimizer]: 9.365e-05, [1] [Cycle 1]: 8.782e-05, [6] [build]: 3.23e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.372e-05 [opt_reshape]: 6.91001e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 8.00006e-07 [validate]: 3.975e-05 Sums bootstrap : 0.000270s : 0.24% type_inference : 0.104019s : 94.05% event_method : 0.000018s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000497s : 0.45% rewriter_before_opt_a : 0.000095s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000702s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002565s : 2.32% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000653s : 0.59% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000422s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000453s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000213 24 0.92% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 4: substitution.graph_param_transform 82.69% : 0.000176s : 4: substitution.inline 1.66% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 2.24% : 0.000005s : 2: substitution.replace_old_param 6.21% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103948 2 97.49% : 0.101337s : 1: type_inference.infer 2.51% : 0.002611s : 1: type_inference.specialize ------[replace.] 0.000078 6 68.36% : 0.000053s : 4: replace.inline 31.64% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000185 6 93.52% : 0.000173s : 4: match.inline 6.48% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.57% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000001s : 12: predicate.depend_value_elim 1.34% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.49% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.23% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.42% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.16% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.06% : 0.000001s : 12: predicate.minmaximum_grad 1.67% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 2.07% : 0.000003s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.92% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.98% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.40% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.74% : 0.000010s : 58: predicate.switch_simplify 1.21% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002034 22 62.29% : 0.001267s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.62% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.10% : 0.000734s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118253 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000281s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.31% : 0.007460s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000430s : 1: loop_unroll 0.56% : 0.000661s : 1: mutable_eliminate 0.80% : 0.000946s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000505s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.49% : 0.001757s : 1: renormalize.infer 0.68% : 0.000799s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.09% : 0.000101s : 1: rewriter_before_opt_a 0.08% : 0.000096s : 1: symbol_engine_optimizer 87.98% : 0.104034s : 1: type_inference TotalTime = 0.0132732, [30] [bootstrap]: 0.00027246 [type_inference]: 0.00482552 [event_method]: 1.751e-05 [auto_monad]: 7.154e-05 [graph_reusing]: 6.61999e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 2.548e-05 [rewriter_before_opt_a]: 7.184e-05 [expand_dump_flag]: 3.12002e-06 [jit_opt_a]: 0.00561878, [2] [Cycle 1]: 0.00174729, [27] [switch_simplify]: 6.048e-05 [loop_unroll]: 3.099e-05 [a_1]: 0.00056072 [with_stream_mark]: 1.902e-05 [recompute_prepare]: 7.24001e-06 [updatestate_depend_eliminate]: 4.73001e-06 [updatestate_assign_eliminate]: 3.37002e-06 [updatestate_loads_eliminate]: 2.78e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 5.94e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.22e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.02999e-06 [merge_forward]: 3.91001e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.49e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.02e-06 [inline_without_move]: 5.47999e-06 [renormalize]: 0.00073656 [add_forward_monad_depend]: 7.31001e-06 [auto_monad_grad]: 2.57001e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 3.14e-05 [replace_applicator]: 1.428e-05 [Cycle 2]: 0.00032125, [27] [switch_simplify]: 5.73997e-06 [loop_unroll]: 4.95001e-06 [a_1]: 9.212e-05 [with_stream_mark]: 9.32999e-06 [recompute_prepare]: 5.35999e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.04003e-06 [specialize_transform]: 4.90001e-06 [updatestate_useless_node_eliminater]: 5.18002e-06 [accelerated_algorithm]: 4.84e-06 [meta_shard_fg_expand]: 1.28002e-06 [get_grad_eliminate_]: 4.80999e-06 [merge_forward]: 2.91999e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.423e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.80999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 9.74e-06 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 1.179e-05 [rewriter_after_opt_a]: 3.888e-05 [convert_after_rewriter]: 7.71999e-06 [order_py_execute_after_rewriter]: 5.06997e-06 [mutable_eliminate]: 0.00074925 [jit_opt_b]: 6.546e-05, [1] [Cycle 1]: 5.755e-05, [2] [frontend_op_eliminate]: 1.614e-05 [inline_after_opt_a]: 2.906e-05 [cconv]: 2.535e-05 [loop_unroll]: 0.00042987 [jit_opt_after_cconv]: 0.00014587, [1] [Cycle 1]: 0.00013962, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.53e-06 [cse]: 2.31e-05 [call_graph_tuple_transform]: 1.936e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 6.39993e-07 [switch_simplify]: 5.25999e-06 [remove_dup_value]: 1.552e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 5.53002e-06 [add_recomputation]: 5.296e-05 [cse_after_recomputation]: 2.182e-05, [1] [Cycle 1]: 1.644e-05, [1] [cse]: 1.073e-05 [auto_monad_reorder]: 1.568e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 6.38e-06 [opt_after_jit_grad]: 0.00047244 [symbol_engine_optimizer]: 7.245e-05, [1] [Cycle 1]: 6.651e-05, [6] [build]: 3.6e-06 [elim_shapecalc]: 8.11002e-06 [elim_not_effective]: 1.175e-05 [opt_reshape]: 6.01e-06 [fold_const_symbol]: 8.82e-06 [renormalize]: 5.39992e-07 [validate]: 4.036e-05 Sums bootstrap : 0.000272s : 2.98% type_inference : 0.004826s : 52.79% event_method : 0.000018s : 0.19% auto_monad : 0.000072s : 0.78% graph_reusing : 0.000007s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000025s : 0.28% rewriter_before_opt_a : 0.000072s : 0.79% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000066s : 0.72% jit_opt_a.loop_unroll : 0.000036s : 0.39% jit_opt_a.a_1 : 0.000653s : 7.14% jit_opt_a.with_stream_mark : 0.000028s : 0.31% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000737s : 8.06% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.23% jit_opt_a.cse : 0.000041s : 0.45% jit_opt_a.replace_applicator : 0.000019s : 0.21% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000039s : 0.43% convert_after_rewriter : 0.000008s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000749s : 8.20% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000029s : 0.32% cconv : 0.000025s : 0.28% loop_unroll : 0.000430s : 4.70% jit_opt_after_cconv.c_1 : 0.000021s : 0.23% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.25% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000053s : 0.58% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000016s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000472s : 5.17% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000040s : 0.44% Time group info: ------[substitution.] 0.000227 23 0.86% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000002s : 2: substitution.fold_const_symbol 2.48% : 0.000006s : 3: substitution.graph_param_transform 83.96% : 0.000190s : 4: substitution.inline 1.50% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000004s : 2: substitution.replace_old_param 6.47% : 0.000015s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004760 2 81.51% : 0.003880s : 1: type_inference.infer 18.49% : 0.000880s : 1: type_inference.specialize ------[replace.] 0.000071 6 66.36% : 0.000047s : 4: replace.inline 33.64% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000201 6 93.37% : 0.000188s : 4: match.inline 6.63% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.20% : 0.000001s : 10: predicate.addn_check_dump 1.53% : 0.000002s : 10: predicate.addn_zero_filter 1.71% : 0.000002s : 10: predicate.arithmetic_simplify 1.14% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000002s : 10: predicate.depend_value_elim 1.07% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.41% : 0.000000s : 3: predicate.graph_param_transform 5.77% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.61% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.17% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.42% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.74% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.88% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.19% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.73% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.30% : 0.000002s : 10: predicate.reshape_eliminate 1.19% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 3: predicate.row_tensor_eliminate 1.42% : 0.000002s : 10: predicate.same_eliminate 0.49% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 6: predicate.special_op_eliminate 0.99% : 0.000001s : 6: predicate.specialize_transform 1.33% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.29% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.76% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.20% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.75% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.60% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.25% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 10: predicate.value_based_eliminate 0.40% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000671 13 50.36% : 0.000338s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.67% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.97% : 0.000288s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014949 72 0.37% : 0.000056s : 1: add_recomputation 0.50% : 0.000075s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 1.92% : 0.000288s : 1: bootstrap 0.19% : 0.000028s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.16% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 37.61% : 0.005622s : 1: jit_opt_a 0.99% : 0.000148s : 1: jit_opt_after_cconv 0.46% : 0.000068s : 1: jit_opt_b 2.93% : 0.000438s : 1: loop_unroll 5.07% : 0.000759s : 1: mutable_eliminate 5.83% : 0.000872s : 26: opt.transform.jit_opt_a 0.32% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.26% : 0.000039s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.22% : 0.000481s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.19% : 0.000028s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.57% : 0.000384s : 1: renormalize.infer 2.31% : 0.000345s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000042s : 1: rewriter_after_opt_a 0.50% : 0.000074s : 1: rewriter_before_opt_a 0.50% : 0.000075s : 1: symbol_engine_optimizer 32.40% : 0.004843s : 1: type_inference TotalTime = 0.11522, [30] [bootstrap]: 0.00031437 [type_inference]: 0.105369 [event_method]: 1.69e-05 [auto_monad]: 5.019e-05 [graph_reusing]: 3.76999e-06 [pre_auto_parallel]: 1.72999e-06 [py_interpret_to_execute]: 0.00046313 [rewriter_before_opt_a]: 7.673e-05 [expand_dump_flag]: 3.26999e-06 [jit_opt_a]: 0.00680586, [2] [Cycle 1]: 0.00330479, [27] [switch_simplify]: 4.929e-05 [loop_unroll]: 3.052e-05 [a_1]: 0.00053335 [with_stream_mark]: 1.308e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 3.24001e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.41998e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 6.83998e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 1.56998e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 3.31001e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.229e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.40999e-06 [inline_without_move]: 5.84999e-06 [renormalize]: 0.00238176 [add_forward_monad_depend]: 3.91001e-06 [auto_monad_grad]: 1.62999e-06 [auto_monad_eliminator]: 1.222e-05 [cse]: 2.157e-05 [replace_applicator]: 1.181e-05 [Cycle 2]: 0.00036594, [27] [switch_simplify]: 6.55002e-06 [loop_unroll]: 5.57001e-06 [a_1]: 0.00012462 [with_stream_mark]: 8.58001e-06 [recompute_prepare]: 6.66999e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.35002e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 9.99979e-07 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 6.33e-06 [meta_shard_fg_expand]: 1.24998e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.98997e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.375e-05 [j_node_and_user_rematch]: 8.82999e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 8.25e-06 [inline_without_move]: 6.01998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.24998e-06 [auto_monad_grad]: 7.29982e-07 [auto_monad_eliminator]: 6.09001e-06 [cse]: 1.072e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 9.22999e-06 [rewriter_after_opt_a]: 2.949e-05 [convert_after_rewriter]: 6.41e-06 [order_py_execute_after_rewriter]: 5.39998e-06 [mutable_eliminate]: 0.00054013 [jit_opt_b]: 5.683e-05, [1] [Cycle 1]: 5.115e-05, [2] [frontend_op_eliminate]: 2.218e-05 [inline_after_opt_a]: 1.71e-05 [cconv]: 1.716e-05 [loop_unroll]: 0.00042579 [jit_opt_after_cconv]: 0.00013832, [1] [Cycle 1]: 0.00013224, [11] [c_1]: 2.488e-05 [parameter_eliminate]: 1.82001e-06 [updatestate_depend_eliminate]: 4.73001e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.64999e-06 [cse]: 1.773e-05 [call_graph_tuple_transform]: 1.796e-05 [tuple_list_get_item_eliminator]: 6.04999e-06 [none_parameter_eliminate]: 1.00001e-06 [renormalize]: 3.70026e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.052e-05 [partial_unused_args_eliminate]: 1.66e-06 [environ_conv]: 6.05002e-06 [add_recomputation]: 3.407e-05 [cse_after_recomputation]: 2.22e-05, [1] [Cycle 1]: 1.749e-05, [1] [cse]: 1.193e-05 [auto_monad_reorder]: 1.092e-05 [get_jit_bprop_graph]: 2.39001e-06 [rewriter_after_jit_bprop_graph]: 4.24997e-06 [opt_after_jit_grad]: 0.00045027 [symbol_engine_optimizer]: 0.00013932, [1] [Cycle 1]: 0.00013351, [6] [build]: 2.51e-06 [elim_shapecalc]: 9.74e-06 [elim_not_effective]: 1.432e-05 [opt_reshape]: 6.24001e-06 [fold_const_symbol]: 7.232e-05 [renormalize]: 3.4002e-07 [validate]: 3.335e-05 Sums bootstrap : 0.000314s : 0.28% type_inference : 0.105369s : 94.48% event_method : 0.000017s : 0.02% auto_monad : 0.000050s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000463s : 0.42% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000056s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000658s : 0.59% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.01% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002382s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000540s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000426s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000450s : 0.40% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000072s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.03% Time group info: ------[substitution.] 0.000174 24 2.13% : 0.000004s : 2: substitution.elim_not_effective 1.05% : 0.000002s : 2: substitution.fold_const_symbol 2.84% : 0.000005s : 4: substitution.graph_param_transform 82.18% : 0.000143s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.85% : 0.000003s : 2: substitution.replace_old_param 5.21% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105308 2 97.61% : 0.102792s : 1: type_inference.infer 2.39% : 0.002515s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.08% : 0.000046s : 4: replace.inline 33.92% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000148 6 94.71% : 0.000140s : 4: match.inline 5.29% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.60% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.74% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 4.84% : 0.000006s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.99% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.29% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.61% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.78% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.72% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 4: predicate.row_tensor_eliminate 1.34% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.41% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.17% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002076 22 67.10% : 0.001393s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.55% : 0.000655s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118623 72 0.03% : 0.000037s : 1: add_recomputation 0.04% : 0.000053s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.28% : 0.000334s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.00% : 0.000006s : 1: graph_reusing 5.74% : 0.006809s : 1: jit_opt_a 0.12% : 0.000141s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000432s : 1: loop_unroll 0.46% : 0.000548s : 1: mutable_eliminate 0.74% : 0.000879s : 26: opt.transform.jit_opt_a 0.04% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000099s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000469s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.43% : 0.001697s : 1: renormalize.infer 0.57% : 0.000678s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000142s : 1: symbol_engine_optimizer 88.84% : 0.105383s : 1: type_inference TotalTime = 0.118263, [30] [bootstrap]: 0.00026318 [type_inference]: 0.107133 [event_method]: 2.352e-05 [auto_monad]: 7.603e-05 [graph_reusing]: 5.70001e-06 [pre_auto_parallel]: 2.36998e-06 [py_interpret_to_execute]: 0.00046722 [rewriter_before_opt_a]: 8.95e-05 [expand_dump_flag]: 4.02e-06 [jit_opt_a]: 0.00770842, [2] [Cycle 1]: 0.0036539, [27] [switch_simplify]: 6.262e-05 [loop_unroll]: 3.092e-05 [a_1]: 0.00059051 [with_stream_mark]: 2.039e-05 [recompute_prepare]: 9.05001e-06 [updatestate_depend_eliminate]: 4.11001e-06 [updatestate_assign_eliminate]: 3.4e-06 [updatestate_loads_eliminate]: 2.99999e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 7.50998e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 2.31998e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 4.03999e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.592e-05 [j_node_and_user_rematch]: 9.92001e-06 [meta_fg_expand]: 3.06001e-06 [replace_old_param]: 1.043e-05 [inline_without_move]: 5.97001e-06 [renormalize]: 0.00258313 [add_forward_monad_depend]: 6.19999e-06 [auto_monad_grad]: 2.76e-06 [auto_monad_eliminator]: 1.687e-05 [cse]: 3.354e-05 [replace_applicator]: 1.964e-05 [Cycle 2]: 0.00037421, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 6.06e-06 [a_1]: 0.00012292 [with_stream_mark]: 1.273e-05 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.61e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.86998e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.81003e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 4.65001e-06 [cell_reuse_recompute_pass]: 1.82999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.703e-05 [j_node_and_user_rematch]: 8.96998e-06 [meta_fg_expand]: 2.74001e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 7.59988e-07 [auto_monad_eliminator]: 7.01999e-06 [cse]: 1.258e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 1.299e-05 [rewriter_after_opt_a]: 3.614e-05 [convert_after_rewriter]: 7.53e-06 [order_py_execute_after_rewriter]: 8.12e-06 [mutable_eliminate]: 0.00071181 [jit_opt_b]: 5.713e-05, [1] [Cycle 1]: 4.953e-05, [2] [frontend_op_eliminate]: 2.007e-05 [inline_after_opt_a]: 1.874e-05 [cconv]: 2.586e-05 [loop_unroll]: 0.0004687 [jit_opt_after_cconv]: 0.00016048, [1] [Cycle 1]: 0.00015332, [11] [c_1]: 2.634e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 6.23002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 2.474e-05 [call_graph_tuple_transform]: 2.161e-05 [tuple_list_get_item_eliminator]: 6.43e-06 [none_parameter_eliminate]: 1.81e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 6.19999e-06 [remove_dup_value]: 1.606e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 7.73001e-06 [add_recomputation]: 5.144e-05 [cse_after_recomputation]: 2.439e-05, [1] [Cycle 1]: 1.682e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.503e-05 [get_jit_bprop_graph]: 2.24001e-06 [rewriter_after_jit_bprop_graph]: 5.82999e-06 [opt_after_jit_grad]: 0.00046807 [symbol_engine_optimizer]: 0.00016579, [1] [Cycle 1]: 0.00015928, [6] [build]: 3.34001e-06 [elim_shapecalc]: 8.44998e-06 [elim_not_effective]: 9.813e-05 [opt_reshape]: 7.19001e-06 [fold_const_symbol]: 1.074e-05 [renormalize]: 2.59985e-07 [validate]: 4.674e-05 Sums bootstrap : 0.000263s : 0.23% type_inference : 0.107133s : 94.01% event_method : 0.000024s : 0.02% auto_monad : 0.000076s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000467s : 0.41% rewriter_before_opt_a : 0.000090s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000069s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000713s : 0.63% jit_opt_a.with_stream_mark : 0.000033s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000009s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000006s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002583s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000008s : 0.01% mutable_eliminate : 0.000712s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000469s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000468s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000098s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.04% Time group info: ------[substitution.] 0.000302 24 28.19% : 0.000085s : 2: substitution.elim_not_effective 0.59% : 0.000002s : 2: substitution.fold_const_symbol 1.97% : 0.000006s : 4: substitution.graph_param_transform 59.80% : 0.000181s : 4: substitution.inline 1.37% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.92% : 0.000006s : 4: substitution.remove_not_recompute_node 1.85% : 0.000006s : 2: substitution.replace_old_param 4.31% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107044 2 97.42% : 0.104279s : 1: type_inference.infer 2.58% : 0.002766s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.18% : 0.000053s : 4: replace.inline 32.82% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 93.70% : 0.000178s : 4: match.inline 6.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.23% : 0.000002s : 12: predicate.addn_zero_filter 1.89% : 0.000003s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.64% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.14% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.39% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.56% : 0.000001s : 4: predicate.graph_param_transform 5.42% : 0.000007s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.38% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.16% : 0.000002s : 12: predicate.minmaximum_grad 1.72% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.63% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000003s : 22: predicate.replace_applicator 0.97% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.34% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.59% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000010s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.48% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.84% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.77% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002045 22 66.82% : 0.001367s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.61% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.56% : 0.000645s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121961 72 0.04% : 0.000054s : 1: add_recomputation 0.07% : 0.000080s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000278s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000029s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.32% : 0.007712s : 1: jit_opt_a 0.13% : 0.000163s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.39% : 0.000477s : 1: loop_unroll 0.59% : 0.000723s : 1: mutable_eliminate 0.79% : 0.000961s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000121s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000477s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000474s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.53% : 0.001870s : 1: renormalize.infer 0.58% : 0.000704s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.14% : 0.000169s : 1: symbol_engine_optimizer 87.87% : 0.107161s : 1: type_inference TotalTime = 0.118839, [30] [bootstrap]: 0.00028541 [type_inference]: 0.108851 [event_method]: 1.792e-05 [auto_monad]: 5.636e-05 [graph_reusing]: 4.68999e-06 [pre_auto_parallel]: 1.76998e-06 [py_interpret_to_execute]: 0.00045896 [rewriter_before_opt_a]: 7.716e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00688086, [2] [Cycle 1]: 0.00328932, [27] [switch_simplify]: 5.239e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00054787 [with_stream_mark]: 1.195e-05 [recompute_prepare]: 8.57998e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 2.79999e-06 [updatestate_loads_eliminate]: 2.87002e-06 [parameter_eliminate]: 1.27999e-06 [specialize_transform]: 6.88e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.73e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 6.23e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 9.41998e-06 [inline_without_move]: 6.12001e-06 [renormalize]: 0.00232985 [add_forward_monad_depend]: 1.055e-05 [auto_monad_grad]: 1.49e-06 [auto_monad_eliminator]: 1.373e-05 [cse]: 2.407e-05 [replace_applicator]: 1.259e-05 [Cycle 2]: 0.00035564, [27] [switch_simplify]: 6.67002e-06 [loop_unroll]: 6.28e-06 [a_1]: 0.00012256 [with_stream_mark]: 8.50999e-06 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 9.99979e-07 [specialize_transform]: 5.88998e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.10999e-06 [get_grad_eliminate_]: 5.46002e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.62001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.341e-05 [j_node_and_user_rematch]: 8.60999e-06 [meta_fg_expand]: 1.68002e-06 [replace_old_param]: 8.19002e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.23002e-06 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 5.55001e-06 [cse]: 1.124e-05 [replace_applicator]: 5.83002e-06 [py_interpret_to_execute_after_opt_a]: 1.049e-05 [rewriter_after_opt_a]: 3.597e-05 [convert_after_rewriter]: 6.33998e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00058964 [jit_opt_b]: 5.581e-05, [1] [Cycle 1]: 4.919e-05, [2] [frontend_op_eliminate]: 2.099e-05 [inline_after_opt_a]: 1.763e-05 [cconv]: 2.409e-05 [loop_unroll]: 0.00041256 [jit_opt_after_cconv]: 0.00014552, [1] [Cycle 1]: 0.00013948, [11] [c_1]: 2.542e-05 [parameter_eliminate]: 1.89e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 2.41998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [cse]: 1.815e-05 [call_graph_tuple_transform]: 2.02e-05 [tuple_list_get_item_eliminator]: 6.29999e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 1.69995e-07 [switch_simplify]: 6.15002e-06 [remove_dup_value]: 1.666e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 4.856e-05 [cse_after_recomputation]: 2.202e-05, [1] [Cycle 1]: 1.569e-05, [1] [cse]: 1.014e-05 [auto_monad_reorder]: 1.568e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.00051933 [symbol_engine_optimizer]: 7.314e-05, [1] [Cycle 1]: 6.742e-05, [6] [build]: 3.5e-06 [elim_shapecalc]: 7.95e-06 [elim_not_effective]: 1.279e-05 [opt_reshape]: 6.77002e-06 [fold_const_symbol]: 9.46e-06 [renormalize]: 3.4002e-07 [validate]: 3.871e-05 Sums bootstrap : 0.000285s : 0.25% type_inference : 0.108851s : 94.61% event_method : 0.000018s : 0.02% auto_monad : 0.000056s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000459s : 0.40% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000670s : 0.58% jit_opt_a.with_stream_mark : 0.000020s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002330s : 2.03% jit_opt_a.add_forward_monad_depend : 0.000012s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000590s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000413s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000049s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000519s : 0.45% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.03% Time group info: ------[substitution.] 0.000185 24 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.30% : 0.000006s : 4: substitution.graph_param_transform 82.06% : 0.000152s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000004s : 2: substitution.replace_old_param 6.54% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108788 2 97.74% : 0.106331s : 1: type_inference.infer 2.26% : 0.002457s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.86% : 0.000047s : 4: replace.inline 33.14% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.15% : 0.000149s : 4: match.inline 6.85% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.08% : 0.000003s : 12: predicate.arithmetic_simplify 1.46% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.59% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.10% : 0.000003s : 18: predicate.load_eliminater 1.09% : 0.000001s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.98% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.45% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 2.16% : 0.000003s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.78% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.14% : 0.000001s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.29% : 0.000002s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.97% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.49% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.68% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.63% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001954 22 66.17% : 0.001293s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.28% : 0.000631s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122137 72 0.04% : 0.000051s : 1: add_recomputation 0.05% : 0.000060s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000300s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.64% : 0.006884s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.34% : 0.000419s : 1: loop_unroll 0.49% : 0.000598s : 1: mutable_eliminate 0.73% : 0.000897s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000526s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000465s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.36% : 0.001661s : 1: renormalize.infer 0.54% : 0.000662s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 89.13% : 0.108863s : 1: type_inference TotalTime = 0.0125714, [30] [bootstrap]: 0.00027341 [type_inference]: 0.00428812 [event_method]: 1.753e-05 [auto_monad]: 6.812e-05 [graph_reusing]: 5.61e-06 [pre_auto_parallel]: 2.56e-06 [py_interpret_to_execute]: 3.904e-05 [rewriter_before_opt_a]: 7.332e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00542109, [2] [Cycle 1]: 0.00179008, [27] [switch_simplify]: 5.785e-05 [loop_unroll]: 4.293e-05 [a_1]: 0.00055495 [with_stream_mark]: 2.134e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 4.12e-06 [updatestate_assign_eliminate]: 4.01001e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 2.01998e-06 [specialize_transform]: 6.14999e-06 [updatestate_useless_node_eliminater]: 5.04e-06 [accelerated_algorithm]: 5.77999e-06 [meta_shard_fg_expand]: 2.44001e-06 [get_grad_eliminate_]: 5.34998e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.546e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 9.62999e-06 [inline_without_move]: 5.84e-06 [renormalize]: 0.00077029 [add_forward_monad_depend]: 6.57002e-06 [auto_monad_grad]: 2.49999e-06 [auto_monad_eliminator]: 1.777e-05 [cse]: 2.702e-05 [replace_applicator]: 1.483e-05 [Cycle 2]: 0.00034291, [27] [switch_simplify]: 5.79e-06 [loop_unroll]: 5.05999e-06 [a_1]: 9.056e-05 [with_stream_mark]: 1.231e-05 [recompute_prepare]: 5.73002e-06 [updatestate_depend_eliminate]: 3.19001e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.64998e-06 [specialize_transform]: 4.92999e-06 [updatestate_useless_node_eliminater]: 5.04998e-06 [accelerated_algorithm]: 5.00001e-06 [meta_shard_fg_expand]: 1.59e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.42999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.578e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 9.61e-06 [cse]: 1.29e-05 [replace_applicator]: 6.20002e-06 [py_interpret_to_execute_after_opt_a]: 1.442e-05 [rewriter_after_opt_a]: 3.614e-05 [convert_after_rewriter]: 6.95998e-06 [order_py_execute_after_rewriter]: 5.01002e-06 [mutable_eliminate]: 0.00064929 [jit_opt_b]: 5.377e-05, [1] [Cycle 1]: 4.553e-05, [2] [frontend_op_eliminate]: 1.752e-05 [inline_after_opt_a]: 1.571e-05 [cconv]: 4.162e-05 [loop_unroll]: 0.00048598 [jit_opt_after_cconv]: 0.00014879, [1] [Cycle 1]: 0.00014139, [11] [c_1]: 2.071e-05 [parameter_eliminate]: 2.48998e-06 [updatestate_depend_eliminate]: 7.21999e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 2.312e-05 [call_graph_tuple_transform]: 1.95e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 8.10018e-07 [switch_simplify]: 5.33002e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 2.36e-06 [environ_conv]: 7.14001e-06 [add_recomputation]: 5.026e-05 [cse_after_recomputation]: 2.236e-05, [1] [Cycle 1]: 1.659e-05, [1] [cse]: 1.053e-05 [auto_monad_reorder]: 1.5e-05 [get_jit_bprop_graph]: 2.76e-06 [rewriter_after_jit_bprop_graph]: 5.96e-06 [opt_after_jit_grad]: 0.00053635 [symbol_engine_optimizer]: 7.36e-05, [1] [Cycle 1]: 6.743e-05, [6] [build]: 3.18998e-06 [elim_shapecalc]: 8.03001e-06 [elim_not_effective]: 1.362e-05 [opt_reshape]: 5.59e-06 [fold_const_symbol]: 8.77e-06 [renormalize]: 2.60014e-07 [validate]: 3.812e-05 Sums bootstrap : 0.000273s : 3.15% type_inference : 0.004288s : 49.33% event_method : 0.000018s : 0.20% auto_monad : 0.000068s : 0.78% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.45% rewriter_before_opt_a : 0.000073s : 0.84% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000064s : 0.73% jit_opt_a.loop_unroll : 0.000048s : 0.55% jit_opt_a.a_1 : 0.000646s : 7.43% jit_opt_a.with_stream_mark : 0.000034s : 0.39% jit_opt_a.recompute_prepare : 0.000014s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000004s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.36% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000019s : 0.22% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000770s : 8.86% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000027s : 0.31% jit_opt_a.cse : 0.000040s : 0.46% jit_opt_a.replace_applicator : 0.000021s : 0.24% py_interpret_to_execute_after_opt_a : 0.000014s : 0.17% rewriter_after_opt_a : 0.000036s : 0.42% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000649s : 7.47% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000042s : 0.48% loop_unroll : 0.000486s : 5.59% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000007s : 0.08% add_recomputation : 0.000050s : 0.58% cse_after_recomputation.cse : 0.000011s : 0.12% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000003s : 0.03% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000536s : 6.17% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.44% Time group info: ------[substitution.] 0.000224 23 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.53% : 0.000006s : 3: substitution.graph_param_transform 83.40% : 0.000187s : 4: substitution.inline 1.62% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000006s : 4: substitution.remove_not_recompute_node 2.63% : 0.000006s : 2: substitution.replace_old_param 5.81% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004225 2 79.32% : 0.003352s : 1: type_inference.infer 20.68% : 0.000874s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.92% : 0.000047s : 4: replace.inline 32.08% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 93.90% : 0.000184s : 4: match.inline 6.10% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.17% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.01% : 0.000001s : 10: predicate.addn_check_dump 1.59% : 0.000002s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.19% : 0.000001s : 10: predicate.cast_eliminate 0.56% : 0.000001s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.48% : 0.000001s : 3: predicate.elim_not_effective 0.46% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.25% : 0.000000s : 3: predicate.graph_param_transform 5.58% : 0.000007s : 22: predicate.inline 0.86% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.53% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.87% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.03% : 0.000001s : 10: predicate.minmaximum_grad 1.90% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 2.08% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.83% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.46% : 0.000002s : 10: predicate.reshape_eliminate 1.43% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 1.34% : 0.000002s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 6: predicate.special_op_eliminate 0.93% : 0.000001s : 6: predicate.specialize_transform 1.35% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.40% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.39% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.10% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.73% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.70% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000596 13 47.75% : 0.000285s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.54% : 0.000045s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.71% : 0.000266s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014287 72 0.37% : 0.000053s : 1: add_recomputation 0.50% : 0.000072s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.00% : 0.000285s : 1: bootstrap 0.32% : 0.000045s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.07% : 0.000009s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 37.97% : 0.005425s : 1: jit_opt_a 1.06% : 0.000151s : 1: jit_opt_after_cconv 0.39% : 0.000056s : 1: jit_opt_b 3.47% : 0.000495s : 1: loop_unroll 4.62% : 0.000660s : 1: mutable_eliminate 6.17% : 0.000882s : 26: opt.transform.jit_opt_a 0.33% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000027s : 4: opt.transform.jit_opt_b 0.10% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.16% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.82% : 0.000545s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000042s : 1: py_interpret_to_execute 0.12% : 0.000017s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000018s : 1: remove_dup_value 2.96% : 0.000422s : 1: renormalize.infer 2.37% : 0.000338s : 1: renormalize.specialize 0.06% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000039s : 1: rewriter_after_opt_a 0.53% : 0.000076s : 1: rewriter_before_opt_a 0.53% : 0.000076s : 1: symbol_engine_optimizer 30.12% : 0.004303s : 1: type_inference TotalTime = 0.119981, [30] [bootstrap]: 0.00032575 [type_inference]: 0.10871 [event_method]: 2.087e-05 [auto_monad]: 7.515e-05 [graph_reusing]: 6.13002e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00046753 [rewriter_before_opt_a]: 0.00016285 [expand_dump_flag]: 4.72998e-06 [jit_opt_a]: 0.00757042, [2] [Cycle 1]: 0.00363685, [27] [switch_simplify]: 5.987e-05 [loop_unroll]: 3.115e-05 [a_1]: 0.00061745 [with_stream_mark]: 2.164e-05 [recompute_prepare]: 1.101e-05 [updatestate_depend_eliminate]: 4.52998e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 2.00002e-06 [specialize_transform]: 6.67002e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.79001e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.18002e-06 [merge_forward]: 4.3e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.637e-05 [j_node_and_user_rematch]: 9.76e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.129e-05 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00252269 [add_forward_monad_depend]: 6.86001e-06 [auto_monad_grad]: 2.02999e-06 [auto_monad_eliminator]: 1.98e-05 [cse]: 3.438e-05 [replace_applicator]: 1.876e-05 [Cycle 2]: 0.00039379, [27] [switch_simplify]: 7.41999e-06 [loop_unroll]: 6.34999e-06 [a_1]: 0.0001251 [with_stream_mark]: 1.414e-05 [recompute_prepare]: 6.29999e-06 [updatestate_depend_eliminate]: 3.71001e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 2.76999e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 6.89001e-06 [updatestate_useless_node_eliminater]: 6.11998e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.39998e-06 [merge_forward]: 3.90998e-06 [cell_reuse_recompute_pass]: 2.63e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.783e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 9.99001e-06 [inline_without_move]: 5.85002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 8.47e-06 [cse]: 1.42e-05 [replace_applicator]: 6.42001e-06 [py_interpret_to_execute_after_opt_a]: 1.238e-05 [rewriter_after_opt_a]: 3.692e-05 [convert_after_rewriter]: 1.707e-05 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00074498 [jit_opt_b]: 6.022e-05, [1] [Cycle 1]: 5.198e-05, [2] [frontend_op_eliminate]: 1.97e-05 [inline_after_opt_a]: 1.906e-05 [cconv]: 2.992e-05 [loop_unroll]: 0.00046459 [jit_opt_after_cconv]: 0.0001655, [1] [Cycle 1]: 0.00015835, [11] [c_1]: 2.626e-05 [parameter_eliminate]: 3.41999e-06 [updatestate_depend_eliminate]: 7.82e-06 [updatestate_assign_eliminate]: 3.91001e-06 [updatestate_loads_eliminate]: 2.43e-06 [cse]: 2.577e-05 [call_graph_tuple_transform]: 2.243e-05 [tuple_list_get_item_eliminator]: 6.89001e-06 [none_parameter_eliminate]: 1.92001e-06 [renormalize]: 7.39994e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.64e-05 [partial_unused_args_eliminate]: 2.59001e-06 [environ_conv]: 9.12001e-06 [add_recomputation]: 5.66e-05 [cse_after_recomputation]: 2.604e-05, [1] [Cycle 1]: 2.095e-05, [1] [cse]: 1.362e-05 [auto_monad_reorder]: 1.549e-05 [get_jit_bprop_graph]: 1.44e-06 [rewriter_after_jit_bprop_graph]: 5.72999e-06 [opt_after_jit_grad]: 0.00051913 [symbol_engine_optimizer]: 0.00017713, [1] [Cycle 1]: 0.00017003, [6] [build]: 4.38001e-06 [elim_shapecalc]: 1.035e-05 [elim_not_effective]: 0.00010526 [opt_reshape]: 7.7e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 4.60015e-07 [validate]: 4.873e-05 Sums bootstrap : 0.000326s : 0.28% type_inference : 0.108710s : 93.90% event_method : 0.000021s : 0.02% auto_monad : 0.000075s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000468s : 0.40% rewriter_before_opt_a : 0.000163s : 0.14% expand_dump_flag : 0.000005s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000743s : 0.64% jit_opt_a.with_stream_mark : 0.000036s : 0.03% jit_opt_a.recompute_prepare : 0.000017s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000014s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000021s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002523s : 2.18% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000028s : 0.02% jit_opt_a.cse : 0.000049s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000017s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000745s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000030s : 0.03% loop_unroll : 0.000465s : 0.40% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000026s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000057s : 0.05% cse_after_recomputation.cse : 0.000014s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000519s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000105s : 0.09% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.04% Time group info: ------[substitution.] 0.000238 24 0.77% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.73% : 0.000006s : 4: substitution.graph_param_transform 83.32% : 0.000198s : 4: substitution.inline 1.51% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000006s : 4: substitution.remove_not_recompute_node 2.78% : 0.000007s : 2: substitution.replace_old_param 5.78% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108623 2 97.55% : 0.105959s : 1: type_inference.infer 2.45% : 0.002664s : 1: type_inference.specialize ------[replace.] 0.000079 6 63.17% : 0.000050s : 4: replace.inline 36.83% : 0.000029s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000208 6 94.02% : 0.000195s : 4: match.inline 5.98% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.20% : 0.000002s : 12: predicate.addn_zero_filter 2.40% : 0.000003s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.03% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.85% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.80% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.04% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.03% : 0.000001s : 8: predicate.get_grad_eliminate 0.38% : 0.000001s : 4: predicate.graph_param_transform 5.51% : 0.000007s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000002s : 8: predicate.less_batch_normalization 1.50% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.97% : 0.000003s : 18: predicate.load_eliminater 1.54% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.88% : 0.000003s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.04% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.94% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.09% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.66% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.98% : 0.000003s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.84% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.47% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002207 22 68.10% : 0.001503s : 15: func_graph_cloner_run.FuncGraphClonerGraph 2.17% : 0.000048s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.73% : 0.000656s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123655 72 0.05% : 0.000060s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.28% : 0.000347s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.02% : 0.000020s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000013s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.13% : 0.007574s : 1: jit_opt_a 0.14% : 0.000169s : 1: jit_opt_after_cconv 0.05% : 0.000063s : 1: jit_opt_b 0.38% : 0.000474s : 1: loop_unroll 0.61% : 0.000756s : 1: mutable_eliminate 0.80% : 0.000994s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000017s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000129s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000531s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000477s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.47% : 0.001824s : 1: renormalize.infer 0.56% : 0.000689s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.14% : 0.000170s : 1: rewriter_before_opt_a 0.15% : 0.000180s : 1: symbol_engine_optimizer 87.93% : 0.108732s : 1: type_inference TotalTime = 0.0629886, [30] [bootstrap]: 0.00025725 [type_inference]: 0.0530378 [event_method]: 2.03e-05 [auto_monad]: 6.75e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.15002e-06 [py_interpret_to_execute]: 0.00027375 [rewriter_before_opt_a]: 8.251e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00688343, [2] [Cycle 1]: 0.00304115, [27] [switch_simplify]: 5.364e-05 [loop_unroll]: 3.092e-05 [a_1]: 0.00054209 [with_stream_mark]: 5.121e-05 [recompute_prepare]: 8.72e-06 [updatestate_depend_eliminate]: 4.77998e-06 [updatestate_assign_eliminate]: 3.66999e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 2.34001e-06 [specialize_transform]: 7.43999e-06 [updatestate_useless_node_eliminater]: 6.16998e-06 [accelerated_algorithm]: 6.78e-06 [meta_shard_fg_expand]: 2.39001e-06 [get_grad_eliminate_]: 6.72002e-06 [merge_forward]: 4.41002e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.647e-05 [j_node_and_user_rematch]: 1.01e-05 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 1.021e-05 [inline_without_move]: 5.93998e-06 [renormalize]: 0.00200124 [add_forward_monad_depend]: 7.81001e-06 [auto_monad_grad]: 1.81998e-06 [auto_monad_eliminator]: 1.75e-05 [cse]: 3.385e-05 [replace_applicator]: 1.645e-05 [Cycle 2]: 0.00036397, [27] [switch_simplify]: 6.76e-06 [loop_unroll]: 5.86998e-06 [a_1]: 0.00012229 [with_stream_mark]: 1.078e-05 [recompute_prepare]: 6.00002e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.78e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.61e-06 [merge_forward]: 3.17002e-06 [cell_reuse_recompute_pass]: 1.57001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.441e-05 [j_node_and_user_rematch]: 8.75001e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 8.97999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 1.80007e-07 [add_forward_monad_depend]: 1.57999e-06 [auto_monad_grad]: 8.59989e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.197e-05 [replace_applicator]: 5.76003e-06 [py_interpret_to_execute_after_opt_a]: 1.047e-05 [rewriter_after_opt_a]: 3.615e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.0006265 [jit_opt_b]: 5.736e-05, [1] [Cycle 1]: 5.036e-05, [2] [frontend_op_eliminate]: 2.079e-05 [inline_after_opt_a]: 1.754e-05 [cconv]: 2.821e-05 [loop_unroll]: 0.00043727 [jit_opt_after_cconv]: 0.00017569, [1] [Cycle 1]: 0.00016897, [11] [c_1]: 4.128e-05 [parameter_eliminate]: 3.03998e-06 [updatestate_depend_eliminate]: 6.30997e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 3.28998e-06 [cse]: 2.361e-05 [call_graph_tuple_transform]: 2.212e-05 [tuple_list_get_item_eliminator]: 6.34999e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 8.09989e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.72e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 1.031e-05 [add_recomputation]: 5.379e-05 [cse_after_recomputation]: 2.338e-05, [1] [Cycle 1]: 1.807e-05, [1] [cse]: 1.252e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 3.13e-06 [rewriter_after_jit_bprop_graph]: 5.99999e-06 [opt_after_jit_grad]: 0.00054355 [symbol_engine_optimizer]: 7.642e-05, [1] [Cycle 1]: 7.054e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.385e-05 [opt_reshape]: 6.89001e-06 [fold_const_symbol]: 9.34998e-06 [renormalize]: 3.7998e-07 [validate]: 4.715e-05 Sums bootstrap : 0.000257s : 0.44% type_inference : 0.053038s : 90.01% event_method : 0.000020s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000274s : 0.46% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000664s : 1.13% jit_opt_a.with_stream_mark : 0.000062s : 0.11% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002001s : 3.40% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000046s : 0.08% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000626s : 1.06% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000028s : 0.05% loop_unroll : 0.000437s : 0.74% jit_opt_after_cconv.c_1 : 0.000041s : 0.07% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.02% add_recomputation : 0.000054s : 0.09% cse_after_recomputation.cse : 0.000013s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000003s : 0.01% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000544s : 0.92% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000047s : 0.08% Time group info: ------[substitution.] 0.000177 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.45% : 0.000006s : 4: substitution.graph_param_transform 82.01% : 0.000145s : 4: substitution.inline 2.04% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.09% : 0.000005s : 4: substitution.remove_not_recompute_node 2.75% : 0.000005s : 2: substitution.replace_old_param 4.82% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052959 2 96.48% : 0.051096s : 1: type_inference.infer 3.52% : 0.001863s : 1: type_inference.specialize ------[replace.] 0.000071 6 64.87% : 0.000046s : 4: replace.inline 35.13% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000150 6 95.01% : 0.000143s : 4: match.inline 4.99% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.74% : 0.000002s : 12: predicate.accumulaten_eliminater 1.12% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000002s : 12: predicate.addn_check_dump 1.18% : 0.000002s : 12: predicate.addn_zero_filter 2.07% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000002s : 12: predicate.compare_switch_simplify 1.38% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.11% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.65% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.46% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.51% : 0.000001s : 4: predicate.graph_param_transform 4.69% : 0.000006s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.62% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.99% : 0.000003s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.03% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.04% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.08% : 0.000003s : 18: predicate.partial_eliminate 1.37% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.19% : 0.000003s : 22: predicate.replace_applicator 0.79% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.00% : 0.000001s : 4: predicate.row_tensor_eliminate 1.54% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.04% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.29% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.61% : 0.000002s : 12: predicate.value_based_eliminate 0.64% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002315 26 74.30% : 0.001720s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.41% : 0.000565s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065971 72 0.09% : 0.000056s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.41% : 0.000270s : 1: bootstrap 0.05% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000025s : 1: cse_after_recomputation 0.02% : 0.000012s : 1: environ_conv 0.04% : 0.000024s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.44% : 0.006887s : 1: jit_opt_a 0.27% : 0.000179s : 1: jit_opt_after_cconv 0.09% : 0.000060s : 1: jit_opt_b 0.68% : 0.000445s : 1: loop_unroll 0.96% : 0.000635s : 1: mutable_eliminate 1.36% : 0.000898s : 26: opt.transform.jit_opt_a 0.11% : 0.000073s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000553s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000279s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000020s : 1: remove_dup_value 2.07% : 0.001369s : 1: renormalize.infer 0.95% : 0.000624s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000079s : 1: symbol_engine_optimizer 80.42% : 0.053051s : 1: type_inference TotalTime = 0.0117248, [30] [bootstrap]: 0.00025658 [type_inference]: 0.0041368 [event_method]: 1.656e-05 [auto_monad]: 4.44e-05 [graph_reusing]: 3.61999e-06 [pre_auto_parallel]: 1.45001e-06 [py_interpret_to_execute]: 3.514e-05 [rewriter_before_opt_a]: 7.823e-05 [expand_dump_flag]: 2.11e-06 [jit_opt_a]: 0.00507179, [2] [Cycle 1]: 0.00167446, [27] [switch_simplify]: 4.88e-05 [loop_unroll]: 3.012e-05 [a_1]: 0.00051178 [with_stream_mark]: 1.319e-05 [recompute_prepare]: 6.96999e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 2.40997e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 6.33e-06 [updatestate_useless_node_eliminater]: 5.09003e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 5.37999e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.177e-05 [j_node_and_user_rematch]: 8.94e-06 [meta_fg_expand]: 1.91e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00075867 [add_forward_monad_depend]: 5.30999e-06 [auto_monad_grad]: 2.09e-06 [auto_monad_eliminator]: 1.519e-05 [cse]: 3.081e-05 [replace_applicator]: 1.229e-05 [Cycle 2]: 0.00031965, [27] [switch_simplify]: 5.62001e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.152e-05 [with_stream_mark]: 9.13002e-06 [recompute_prepare]: 5.02e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 1.00999e-06 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 5.15999e-06 [accelerated_algorithm]: 4.72e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 4.47998e-06 [merge_forward]: 2.63998e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 8.13001e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.56999e-06 [inline_without_move]: 4.85001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 7.01001e-06 [cse]: 1.086e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 1.164e-05 [rewriter_after_opt_a]: 3.856e-05 [convert_after_rewriter]: 7.34002e-06 [order_py_execute_after_rewriter]: 5.09998e-06 [mutable_eliminate]: 0.00053671 [jit_opt_b]: 4.993e-05, [1] [Cycle 1]: 4.257e-05, [2] [frontend_op_eliminate]: 1.625e-05 [inline_after_opt_a]: 1.489e-05 [cconv]: 2.303e-05 [loop_unroll]: 0.00041229 [jit_opt_after_cconv]: 0.00014165, [1] [Cycle 1]: 0.00013495, [11] [c_1]: 2.116e-05 [parameter_eliminate]: 2.35002e-06 [updatestate_depend_eliminate]: 5.39e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 2.124e-05 [call_graph_tuple_transform]: 1.814e-05 [tuple_list_get_item_eliminator]: 5.54998e-06 [none_parameter_eliminate]: 1.76e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.33002e-06 [remove_dup_value]: 1.478e-05 [partial_unused_args_eliminate]: 2.38002e-06 [environ_conv]: 5.44998e-06 [add_recomputation]: 4.799e-05 [cse_after_recomputation]: 2.292e-05, [1] [Cycle 1]: 1.697e-05, [1] [cse]: 1.077e-05 [auto_monad_reorder]: 1.619e-05 [get_jit_bprop_graph]: 2.07999e-06 [rewriter_after_jit_bprop_graph]: 5.07e-06 [opt_after_jit_grad]: 0.00045484 [symbol_engine_optimizer]: 7.168e-05, [1] [Cycle 1]: 6.53e-05, [6] [build]: 3.31001e-06 [elim_shapecalc]: 7.78999e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.87999e-06 [renormalize]: 3.50003e-07 [validate]: 3.474e-05 Sums bootstrap : 0.000257s : 3.18% type_inference : 0.004137s : 51.21% event_method : 0.000017s : 0.21% auto_monad : 0.000044s : 0.55% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000001s : 0.02% py_interpret_to_execute : 0.000035s : 0.44% rewriter_before_opt_a : 0.000078s : 0.97% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000603s : 7.47% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000003s : 0.04% jit_opt_a.replace_old_param : 0.000017s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000759s : 9.39% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.27% jit_opt_a.cse : 0.000042s : 0.52% jit_opt_a.replace_applicator : 0.000018s : 0.22% py_interpret_to_execute_after_opt_a : 0.000012s : 0.14% rewriter_after_opt_a : 0.000039s : 0.48% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000537s : 6.64% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000023s : 0.29% loop_unroll : 0.000412s : 5.10% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000021s : 0.26% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000048s : 0.59% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.20% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000455s : 5.63% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.43% Time group info: ------[substitution.] 0.000185 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000002s : 2: substitution.fold_const_symbol 3.00% : 0.000006s : 3: substitution.graph_param_transform 83.79% : 0.000155s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000004s : 4: substitution.remove_not_recompute_node 2.50% : 0.000005s : 2: substitution.replace_old_param 4.79% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004083 2 81.43% : 0.003325s : 1: type_inference.infer 18.57% : 0.000758s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.37% : 0.000042s : 4: replace.inline 34.63% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 95.18% : 0.000153s : 4: match.inline 4.82% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.35% : 0.000002s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.06% : 0.000001s : 10: predicate.compare_switch_simplify 1.39% : 0.000002s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.43% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.74% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.25% : 0.000001s : 10: predicate.environ_get_depend_swap 1.53% : 0.000002s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.25% : 0.000006s : 22: predicate.inline 0.85% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.22% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.04% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.09% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.32% : 0.000002s : 10: predicate.print_const_string_wrapper 1.71% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.70% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.45% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.93% : 0.000001s : 3: predicate.row_tensor_eliminate 1.19% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 16: predicate.switch_defer_inline 2.03% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.73% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.72% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000584 13 47.69% : 0.000278s : 6: func_graph_cloner_run.FuncGraphClonerGraph 7.87% : 0.000046s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.45% : 0.000259s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013337 72 0.38% : 0.000051s : 1: add_recomputation 0.36% : 0.000048s : 1: auto_monad 0.14% : 0.000019s : 1: auto_monad_reorder 2.03% : 0.000271s : 1: bootstrap 0.19% : 0.000026s : 1: cconv 0.07% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 38.06% : 0.005075s : 1: jit_opt_a 1.08% : 0.000144s : 1: jit_opt_after_cconv 0.40% : 0.000053s : 1: jit_opt_b 3.15% : 0.000420s : 1: loop_unroll 4.09% : 0.000545s : 1: mutable_eliminate 6.06% : 0.000808s : 26: opt.transform.jit_opt_a 0.35% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.48% : 0.000464s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.28% : 0.000038s : 1: py_interpret_to_execute 0.11% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 3.19% : 0.000425s : 1: renormalize.infer 2.44% : 0.000326s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.31% : 0.000041s : 1: rewriter_after_opt_a 0.61% : 0.000082s : 1: rewriter_before_opt_a 0.56% : 0.000074s : 1: symbol_engine_optimizer 31.10% : 0.004148s : 1: type_inference TotalTime = 0.0127708, [30] [bootstrap]: 0.00028231 [type_inference]: 0.00496193 [event_method]: 1.839e-05 [auto_monad]: 6.747e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.26998e-06 [py_interpret_to_execute]: 4.073e-05 [rewriter_before_opt_a]: 7.679e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.005183, [2] [Cycle 1]: 0.00162161, [27] [switch_simplify]: 5.426e-05 [loop_unroll]: 2.994e-05 [a_1]: 0.00051918 [with_stream_mark]: 1.643e-05 [recompute_prepare]: 7.31999e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.5e-06 [updatestate_loads_eliminate]: 3.61001e-06 [parameter_eliminate]: 1.86e-06 [specialize_transform]: 6.28e-06 [updatestate_useless_node_eliminater]: 5.17999e-06 [accelerated_algorithm]: 5.10999e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 4.27003e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 8.57e-06 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 9.21998e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00068194 [add_forward_monad_depend]: 5.76e-06 [auto_monad_grad]: 2.28002e-06 [auto_monad_eliminator]: 1.517e-05 [cse]: 3.129e-05 [replace_applicator]: 1.286e-05 [Cycle 2]: 0.00032504, [27] [switch_simplify]: 6.01e-06 [loop_unroll]: 5.14e-06 [a_1]: 9.343e-05 [with_stream_mark]: 9.79999e-06 [recompute_prepare]: 5.04998e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 4.83001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.30001e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.68e-06 [cell_reuse_recompute_pass]: 1.52999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.28e-05 [j_node_and_user_rematch]: 8.08001e-06 [meta_fg_expand]: 1.77999e-06 [replace_old_param]: 8.16002e-06 [inline_without_move]: 5.05999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.69e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.172e-05 [replace_applicator]: 5.34e-06 [py_interpret_to_execute_after_opt_a]: 9.73002e-06 [rewriter_after_opt_a]: 3.452e-05 [convert_after_rewriter]: 7.08e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00057914 [jit_opt_b]: 5.005e-05, [1] [Cycle 1]: 4.305e-05, [2] [frontend_op_eliminate]: 1.634e-05 [inline_after_opt_a]: 1.583e-05 [cconv]: 2.454e-05 [loop_unroll]: 0.00040861 [jit_opt_after_cconv]: 0.0001455, [1] [Cycle 1]: 0.00013887, [11] [c_1]: 2.299e-05 [parameter_eliminate]: 2.76e-06 [updatestate_depend_eliminate]: 6.15997e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.22999e-06 [cse]: 1.998e-05 [call_graph_tuple_transform]: 1.827e-05 [tuple_list_get_item_eliminator]: 5.19998e-06 [none_parameter_eliminate]: 1.76998e-06 [renormalize]: 5.29981e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 1.623e-05 [partial_unused_args_eliminate]: 2.49999e-06 [environ_conv]: 5.39e-06 [add_recomputation]: 4.895e-05 [cse_after_recomputation]: 2.264e-05, [1] [Cycle 1]: 1.734e-05, [1] [cse]: 1.178e-05 [auto_monad_reorder]: 1.499e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 4.92999e-06 [opt_after_jit_grad]: 0.00046149 [symbol_engine_optimizer]: 7.347e-05, [1] [Cycle 1]: 6.692e-05, [6] [build]: 3.32997e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.271e-05 [opt_reshape]: 6.17999e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 4.10015e-07 [validate]: 3.516e-05 Sums bootstrap : 0.000282s : 3.15% type_inference : 0.004962s : 55.35% event_method : 0.000018s : 0.21% auto_monad : 0.000067s : 0.75% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000041s : 0.45% rewriter_before_opt_a : 0.000077s : 0.86% expand_dump_flag : 0.000004s : 0.04% jit_opt_a.switch_simplify : 0.000060s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.39% jit_opt_a.a_1 : 0.000613s : 6.83% jit_opt_a.with_stream_mark : 0.000026s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.19% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000682s : 7.61% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.23% jit_opt_a.cse : 0.000043s : 0.48% jit_opt_a.replace_applicator : 0.000018s : 0.20% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000035s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000579s : 6.46% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000025s : 0.27% loop_unroll : 0.000409s : 4.56% jit_opt_after_cconv.c_1 : 0.000023s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000020s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000016s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000049s : 0.55% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000461s : 5.15% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.39% Time group info: ------[substitution.] 0.000192 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.65% : 0.000005s : 3: substitution.graph_param_transform 81.98% : 0.000157s : 4: substitution.inline 1.63% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.69% : 0.000005s : 4: substitution.remove_not_recompute_node 2.74% : 0.000005s : 2: substitution.replace_old_param 6.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004891 2 79.71% : 0.003899s : 1: type_inference.infer 20.29% : 0.000993s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.17% : 0.000047s : 4: replace.inline 31.83% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.17% : 0.000155s : 4: match.inline 6.83% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.35% : 0.000002s : 10: predicate.accumulaten_eliminater 1.28% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.33% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.11% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 6.07% : 0.000007s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.28% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 10: predicate.merge_addn 1.13% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.35% : 0.000002s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.71% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.95% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.50% : 0.000001s : 3: predicate.reset_defer_inline 1.14% : 0.000001s : 10: predicate.reshape_eliminate 1.21% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.49% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 0.94% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.55% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.26% : 0.000002s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.79% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.79% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000667 13 51.11% : 0.000341s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.29% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.60% : 0.000298s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014329 72 0.36% : 0.000052s : 1: add_recomputation 0.49% : 0.000071s : 1: auto_monad 0.12% : 0.000017s : 1: auto_monad_reorder 2.07% : 0.000296s : 1: bootstrap 0.19% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000023s : 1: event_method 0.04% : 0.000006s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.19% : 0.005186s : 1: jit_opt_a 1.03% : 0.000148s : 1: jit_opt_after_cconv 0.37% : 0.000052s : 1: jit_opt_b 2.90% : 0.000416s : 1: loop_unroll 4.10% : 0.000588s : 1: mutable_eliminate 5.75% : 0.000824s : 26: opt.transform.jit_opt_a 0.34% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.28% : 0.000470s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000019s : 1: remove_dup_value 2.40% : 0.000344s : 1: renormalize.infer 2.30% : 0.000330s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000038s : 1: rewriter_after_opt_a 0.55% : 0.000079s : 1: rewriter_before_opt_a 0.53% : 0.000076s : 1: symbol_engine_optimizer 34.75% : 0.004979s : 1: type_inference TotalTime = 0.119038, [30] [bootstrap]: 0.00027188 [type_inference]: 0.107624 [event_method]: 2.064e-05 [auto_monad]: 7.519e-05 [graph_reusing]: 6.19001e-06 [pre_auto_parallel]: 2.43998e-06 [py_interpret_to_execute]: 0.00048087 [rewriter_before_opt_a]: 9.313e-05 [expand_dump_flag]: 3.40003e-06 [jit_opt_a]: 0.00786552, [2] [Cycle 1]: 0.00381369, [27] [switch_simplify]: 6.097e-05 [loop_unroll]: 3.102e-05 [a_1]: 0.00060504 [with_stream_mark]: 2.145e-05 [recompute_prepare]: 9.47001e-06 [updatestate_depend_eliminate]: 4.47998e-06 [updatestate_assign_eliminate]: 3.54002e-06 [updatestate_loads_eliminate]: 3.05998e-06 [parameter_eliminate]: 1.89e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 6.31e-06 [accelerated_algorithm]: 6.54001e-06 [meta_shard_fg_expand]: 2.09e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 3.88999e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.661e-05 [j_node_and_user_rematch]: 1.112e-05 [meta_fg_expand]: 2.57001e-06 [replace_old_param]: 1.054e-05 [inline_without_move]: 6.30997e-06 [renormalize]: 0.00269851 [add_forward_monad_depend]: 8.08999e-06 [auto_monad_grad]: 2.87002e-06 [auto_monad_eliminator]: 1.938e-05 [cse]: 3.516e-05 [replace_applicator]: 2.263e-05 [Cycle 2]: 0.00039004, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 6.02999e-06 [a_1]: 0.00013024 [with_stream_mark]: 1.371e-05 [recompute_prepare]: 6.06998e-06 [updatestate_depend_eliminate]: 3.81999e-06 [updatestate_assign_eliminate]: 2.88998e-06 [updatestate_loads_eliminate]: 2.68e-06 [parameter_eliminate]: 1.38002e-06 [specialize_transform]: 6.01e-06 [updatestate_useless_node_eliminater]: 5.62001e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.64998e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 2.51998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.829e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.02001e-06 [replace_old_param]: 9.88998e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.32e-06 [auto_monad_grad]: 9.29984e-07 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.193e-05 [replace_applicator]: 5.89999e-06 [py_interpret_to_execute_after_opt_a]: 1.306e-05 [rewriter_after_opt_a]: 3.849e-05 [convert_after_rewriter]: 6.62002e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00074559 [jit_opt_b]: 5.787e-05, [1] [Cycle 1]: 5.032e-05, [2] [frontend_op_eliminate]: 2.06e-05 [inline_after_opt_a]: 1.867e-05 [cconv]: 2.849e-05 [loop_unroll]: 0.00047215 [jit_opt_after_cconv]: 0.00016591, [1] [Cycle 1]: 0.00015904, [11] [c_1]: 2.74e-05 [parameter_eliminate]: 3.51001e-06 [updatestate_depend_eliminate]: 6.35002e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.37001e-06 [cse]: 2.854e-05 [call_graph_tuple_transform]: 2.326e-05 [tuple_list_get_item_eliminator]: 6.41e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 6.81001e-06 [remove_dup_value]: 1.642e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 9.20999e-06 [add_recomputation]: 5.124e-05 [cse_after_recomputation]: 2.255e-05, [1] [Cycle 1]: 1.722e-05, [1] [cse]: 1.105e-05 [auto_monad_reorder]: 1.623e-05 [get_jit_bprop_graph]: 2.21003e-06 [rewriter_after_jit_bprop_graph]: 6.28e-06 [opt_after_jit_grad]: 0.00048543 [symbol_engine_optimizer]: 8.136e-05, [1] [Cycle 1]: 7.391e-05, [6] [build]: 4.54002e-06 [elim_shapecalc]: 8.67998e-06 [elim_not_effective]: 1.366e-05 [opt_reshape]: 7.03998e-06 [fold_const_symbol]: 1.235e-05 [renormalize]: 3.19997e-07 [validate]: 0.0001715 Sums bootstrap : 0.000272s : 0.24% type_inference : 0.107624s : 93.80% event_method : 0.000021s : 0.02% auto_monad : 0.000075s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000481s : 0.42% rewriter_before_opt_a : 0.000093s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000735s : 0.64% jit_opt_a.with_stream_mark : 0.000035s : 0.03% jit_opt_a.recompute_prepare : 0.000016s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000035s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002699s : 2.35% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000047s : 0.04% jit_opt_a.replace_applicator : 0.000029s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000038s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000746s : 0.65% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000472s : 0.41% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000029s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000485s : 0.42% symbol_engine_optimizer.build : 0.000005s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000171s : 0.15% Time group info: ------[substitution.] 0.000234 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 1.79% : 0.000004s : 2: substitution.fold_const_symbol 2.86% : 0.000007s : 4: substitution.graph_param_transform 81.34% : 0.000190s : 4: substitution.inline 1.83% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.05% : 0.000007s : 4: substitution.remove_not_recompute_node 2.68% : 0.000006s : 2: substitution.replace_old_param 5.58% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.107535 2 97.47% : 0.104815s : 1: type_inference.infer 2.53% : 0.002720s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.17% : 0.000052s : 4: replace.inline 32.83% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000200 6 94.07% : 0.000188s : 4: match.inline 5.93% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000140 830 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.63% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.59% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.83% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.79% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000002s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.46% : 0.000008s : 26: predicate.inline 0.90% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.37% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 2.31% : 0.000003s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.15% : 0.000002s : 12: predicate.print_const_string_wrapper 1.54% : 0.000002s : 12: predicate.reduce_eliminate 1.70% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.82% : 0.000001s : 8: predicate.remove_not_recompute_node 2.28% : 0.000003s : 22: predicate.replace_applicator 0.70% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.10% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.05% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.62% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 1.90% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.61% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.64% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000003s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002163 22 64.68% : 0.001399s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.64% : 0.000728s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122675 72 0.04% : 0.000054s : 1: add_recomputation 0.06% : 0.000079s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000284s : 1: bootstrap 0.03% : 0.000031s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000026s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.41% : 0.007869s : 1: jit_opt_a 0.14% : 0.000168s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.39% : 0.000482s : 1: loop_unroll 0.62% : 0.000757s : 1: mutable_eliminate 0.81% : 0.000990s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000018s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000494s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000491s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000019s : 1: remove_dup_value 1.54% : 0.001884s : 1: renormalize.infer 0.66% : 0.000804s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000042s : 1: rewriter_after_opt_a 0.08% : 0.000100s : 1: rewriter_before_opt_a 0.07% : 0.000084s : 1: symbol_engine_optimizer 87.75% : 0.107647s : 1: type_inference TotalTime = 0.122403, [30] [bootstrap]: 0.00031211 [type_inference]: 0.11185 [event_method]: 1.947e-05 [auto_monad]: 7.122e-05 [graph_reusing]: 6.24999e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00048659 [rewriter_before_opt_a]: 8.907e-05 [expand_dump_flag]: 3.83001e-06 [jit_opt_a]: 0.00730018, [2] [Cycle 1]: 0.00353509, [27] [switch_simplify]: 5.941e-05 [loop_unroll]: 3.222e-05 [a_1]: 0.00061109 [with_stream_mark]: 1.819e-05 [recompute_prepare]: 8.92e-06 [updatestate_depend_eliminate]: 4.80001e-06 [updatestate_assign_eliminate]: 3.46999e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.92999e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.73998e-06 [meta_shard_fg_expand]: 2.56e-06 [get_grad_eliminate_]: 6.69001e-06 [merge_forward]: 4.85001e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.552e-05 [j_node_and_user_rematch]: 1.021e-05 [meta_fg_expand]: 2.97002e-06 [replace_old_param]: 1.136e-05 [inline_without_move]: 6.11e-06 [renormalize]: 0.00247156 [add_forward_monad_depend]: 4.98001e-06 [auto_monad_grad]: 1.25999e-06 [auto_monad_eliminator]: 1.407e-05 [cse]: 2.245e-05 [replace_applicator]: 1.4e-05 [Cycle 2]: 0.00036421, [27] [switch_simplify]: 6.55002e-06 [loop_unroll]: 5.99e-06 [a_1]: 0.00012642 [with_stream_mark]: 9.33997e-06 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.72001e-06 [updatestate_useless_node_eliminater]: 5.51998e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.38002e-06 [merge_forward]: 2.44999e-06 [cell_reuse_recompute_pass]: 2.02001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.38e-05 [j_node_and_user_rematch]: 9.13002e-06 [meta_fg_expand]: 1.67999e-06 [replace_old_param]: 8.83001e-06 [inline_without_move]: 5.64998e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.74e-06 [cse]: 1.19e-05 [replace_applicator]: 5.87001e-06 [py_interpret_to_execute_after_opt_a]: 1.018e-05 [rewriter_after_opt_a]: 2.703e-05 [convert_after_rewriter]: 5.72001e-06 [order_py_execute_after_rewriter]: 4.95999e-06 [mutable_eliminate]: 0.00060196 [jit_opt_b]: 8.762e-05, [1] [Cycle 1]: 8.008e-05, [2] [frontend_op_eliminate]: 4.961e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 1.761e-05 [loop_unroll]: 0.00043062 [jit_opt_after_cconv]: 0.00014976, [1] [Cycle 1]: 0.00014388, [11] [c_1]: 2.736e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.81e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.957e-05 [call_graph_tuple_transform]: 2.03e-05 [tuple_list_get_item_eliminator]: 6.43003e-06 [none_parameter_eliminate]: 1.19e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.24999e-06 [remove_dup_value]: 8.90001e-06 [partial_unused_args_eliminate]: 2.44001e-06 [environ_conv]: 6.27001e-06 [add_recomputation]: 3.429e-05 [cse_after_recomputation]: 2.14e-05, [1] [Cycle 1]: 1.646e-05, [1] [cse]: 1.081e-05 [auto_monad_reorder]: 9.81e-06 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00046743 [symbol_engine_optimizer]: 7.939e-05, [1] [Cycle 1]: 7.116e-05, [6] [build]: 2.79001e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.407e-05 [opt_reshape]: 9.68002e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 4.00003e-07 [validate]: 0.00010951 Sums bootstrap : 0.000312s : 0.26% type_inference : 0.111850s : 94.46% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000487s : 0.41% rewriter_before_opt_a : 0.000089s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000066s : 0.06% jit_opt_a.loop_unroll : 0.000038s : 0.03% jit_opt_a.a_1 : 0.000738s : 0.62% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002472s : 2.09% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000027s : 0.02% convert_after_rewriter : 0.000006s : 0.00% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000602s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000050s : 0.04% jit_opt_b.inline_after_opt_a : 0.000017s : 0.01% cconv : 0.000018s : 0.01% loop_unroll : 0.000431s : 0.36% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000467s : 0.39% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000010s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000110s : 0.09% Time group info: ------[substitution.] 0.000230 24 0.73% : 0.000002s : 2: substitution.elim_not_effective 0.51% : 0.000001s : 2: substitution.fold_const_symbol 2.52% : 0.000006s : 4: substitution.graph_param_transform 84.19% : 0.000194s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000005s : 2: substitution.replace_old_param 5.93% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.111769 2 97.59% : 0.109074s : 1: type_inference.infer 2.41% : 0.002694s : 1: type_inference.specialize ------[replace.] 0.000079 6 69.15% : 0.000055s : 4: replace.inline 30.85% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000204 6 93.86% : 0.000191s : 4: match.inline 6.14% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000136 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.38% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000003s : 12: predicate.arithmetic_simplify 1.45% : 0.000002s : 12: predicate.cast_eliminate 0.54% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.14% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.89% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.31% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.37% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.39% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.07% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.17% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000002s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.33% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.61% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.58% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.23% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.00% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.17% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.61% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.44% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002207 22 68.55% : 0.001513s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.81% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.64% : 0.000654s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125888 72 0.03% : 0.000037s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.26% : 0.000331s : 1: bootstrap 0.02% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.80% : 0.007303s : 1: jit_opt_a 0.12% : 0.000152s : 1: jit_opt_after_cconv 0.07% : 0.000091s : 1: jit_opt_b 0.35% : 0.000439s : 1: loop_unroll 0.49% : 0.000611s : 1: mutable_eliminate 0.78% : 0.000976s : 26: opt.transform.jit_opt_a 0.04% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000061s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000476s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000494s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.39% : 0.001756s : 1: renormalize.infer 0.56% : 0.000706s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000030s : 1: rewriter_after_opt_a 0.08% : 0.000095s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.86% : 0.111868s : 1: type_inference TotalTime = 0.055572, [30] [bootstrap]: 0.00026941 [type_inference]: 0.0463851 [event_method]: 1.72e-05 [auto_monad]: 4.674e-05 [graph_reusing]: 3.51999e-06 [pre_auto_parallel]: 1.55999e-06 [py_interpret_to_execute]: 0.00025457 [rewriter_before_opt_a]: 7.508e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00625147, [2] [Cycle 1]: 0.00257734, [27] [switch_simplify]: 5.134e-05 [loop_unroll]: 3.155e-05 [a_1]: 0.00056318 [with_stream_mark]: 1.447e-05 [recompute_prepare]: 9.29998e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.48998e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 6.94999e-06 [updatestate_useless_node_eliminater]: 6.51e-06 [accelerated_algorithm]: 6.83003e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 6.73e-06 [merge_forward]: 2.51998e-06 [cell_reuse_recompute_pass]: 8.59989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.273e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.11998e-06 [replace_old_param]: 1.024e-05 [inline_without_move]: 6.17999e-06 [renormalize]: 0.00151344 [add_forward_monad_depend]: 6.00002e-06 [auto_monad_grad]: 2.85002e-06 [auto_monad_eliminator]: 1.83e-05 [cse]: 3.184e-05 [replace_applicator]: 1.392e-05 [Cycle 2]: 0.00036809, [27] [switch_simplify]: 7.03998e-06 [loop_unroll]: 6.07001e-06 [a_1]: 0.00012639 [with_stream_mark]: 1.056e-05 [recompute_prepare]: 6.21998e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 5.84999e-06 [meta_shard_fg_expand]: 1.77001e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.72001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.426e-05 [j_node_and_user_rematch]: 8.79998e-06 [meta_fg_expand]: 1.69e-06 [replace_old_param]: 8.40001e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.62001e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 6.39999e-06 [cse]: 1.063e-05 [replace_applicator]: 6.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.239e-05 [rewriter_after_opt_a]: 3.694e-05 [convert_after_rewriter]: 7.40998e-06 [order_py_execute_after_rewriter]: 5.87999e-06 [mutable_eliminate]: 0.00064163 [jit_opt_b]: 5.552e-05, [1] [Cycle 1]: 4.837e-05, [2] [frontend_op_eliminate]: 1.98e-05 [inline_after_opt_a]: 1.793e-05 [cconv]: 2.507e-05 [loop_unroll]: 0.00043864 [jit_opt_after_cconv]: 0.00015487, [1] [Cycle 1]: 0.00014808, [11] [c_1]: 2.661e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.472e-05 [call_graph_tuple_transform]: 2.119e-05 [tuple_list_get_item_eliminator]: 6.23002e-06 [none_parameter_eliminate]: 1.51002e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 6.43e-06 [remove_dup_value]: 1.574e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 6.84999e-06 [add_recomputation]: 5.016e-05 [cse_after_recomputation]: 2.182e-05, [1] [Cycle 1]: 1.683e-05, [1] [cse]: 1.097e-05 [auto_monad_reorder]: 1.512e-05 [get_jit_bprop_graph]: 2.14999e-06 [rewriter_after_jit_bprop_graph]: 5.81e-06 [opt_after_jit_grad]: 0.00048054 [symbol_engine_optimizer]: 8.034e-05, [1] [Cycle 1]: 7.42e-05, [6] [build]: 3.36001e-06 [elim_shapecalc]: 8.37e-06 [elim_not_effective]: 1.502e-05 [opt_reshape]: 7.88001e-06 [fold_const_symbol]: 1.046e-05 [renormalize]: 3.19997e-07 [validate]: 3.689e-05 Sums bootstrap : 0.000269s : 0.52% type_inference : 0.046385s : 89.84% event_method : 0.000017s : 0.03% auto_monad : 0.000047s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000255s : 0.49% rewriter_before_opt_a : 0.000075s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.11% jit_opt_a.loop_unroll : 0.000038s : 0.07% jit_opt_a.a_1 : 0.000690s : 1.34% jit_opt_a.with_stream_mark : 0.000025s : 0.05% jit_opt_a.recompute_prepare : 0.000016s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.04% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001514s : 2.93% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.05% jit_opt_a.cse : 0.000042s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000037s : 0.07% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000642s : 1.24% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000439s : 0.85% jit_opt_after_cconv.c_1 : 0.000027s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.10% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000481s : 0.93% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000191 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000001s : 2: substitution.fold_const_symbol 3.35% : 0.000006s : 4: substitution.graph_param_transform 84.11% : 0.000161s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 2.16% : 0.000004s : 2: substitution.replace_old_param 4.74% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.046320 2 96.00% : 0.044466s : 1: type_inference.infer 4.00% : 0.001853s : 1: type_inference.specialize ------[replace.] 0.000070 6 65.26% : 0.000046s : 4: replace.inline 34.74% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 95.24% : 0.000158s : 4: match.inline 4.76% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.06% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.21% : 0.000002s : 8: predicate.get_grad_eliminate 0.43% : 0.000001s : 4: predicate.graph_param_transform 4.96% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.48% : 0.000002s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 18: predicate.load_eliminater 1.88% : 0.000003s : 4: predicate.loop_unroll_after_grad 4.07% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.70% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.11% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 2.02% : 0.000003s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.94% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.36% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.57% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.16% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 1.99% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.13% : 0.000010s : 58: predicate.switch_simplify 1.46% : 0.000002s : 12: predicate.tile_eliminate 1.16% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.34% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001640 18 64.48% : 0.001057s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.55% : 0.000042s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.97% : 0.000541s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058092 72 0.09% : 0.000053s : 1: add_recomputation 0.09% : 0.000050s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.49% : 0.000282s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.77% : 0.006256s : 1: jit_opt_a 0.27% : 0.000158s : 1: jit_opt_after_cconv 0.10% : 0.000058s : 1: jit_opt_b 0.77% : 0.000447s : 1: loop_unroll 1.12% : 0.000650s : 1: mutable_eliminate 1.58% : 0.000920s : 26: opt.transform.jit_opt_a 0.10% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.07% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.84% : 0.000489s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.45% : 0.000261s : 1: py_interpret_to_execute 0.03% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.60% : 0.000930s : 1: renormalize.infer 0.99% : 0.000573s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.07% : 0.000040s : 1: rewriter_after_opt_a 0.14% : 0.000079s : 1: rewriter_before_opt_a 0.14% : 0.000083s : 1: symbol_engine_optimizer 79.87% : 0.046398s : 1: type_inference TotalTime = 0.0124423, [30] [bootstrap]: 0.00028256 [type_inference]: 0.00448061 [event_method]: 1.639e-05 [auto_monad]: 6.748e-05 [graph_reusing]: 6.42001e-06 [pre_auto_parallel]: 2.09e-06 [py_interpret_to_execute]: 4.257e-05 [rewriter_before_opt_a]: 7.549e-05 [expand_dump_flag]: 3.09001e-06 [jit_opt_a]: 0.00533103, [2] [Cycle 1]: 0.00162385, [27] [switch_simplify]: 5.582e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00052913 [with_stream_mark]: 1.582e-05 [recompute_prepare]: 7.93001e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.31999e-06 [updatestate_loads_eliminate]: 3.4e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 5.27999e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 2.19999e-06 [get_grad_eliminate_]: 5.39e-06 [merge_forward]: 4.13999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.498e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.60999e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 0.00065793 [add_forward_monad_depend]: 5.99e-06 [auto_monad_grad]: 2.71e-06 [auto_monad_eliminator]: 1.488e-05 [cse]: 3.094e-05 [replace_applicator]: 1.202e-05 [Cycle 2]: 0.00034606, [27] [switch_simplify]: 5.59998e-06 [loop_unroll]: 5.07e-06 [a_1]: 9.237e-05 [with_stream_mark]: 1.007e-05 [recompute_prepare]: 5.91003e-06 [updatestate_depend_eliminate]: 2.74001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.34e-06 [specialize_transform]: 5.26002e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.20999e-06 [meta_shard_fg_expand]: 1.35999e-06 [get_grad_eliminate_]: 4.76002e-06 [merge_forward]: 3.53e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.37e-05 [j_node_and_user_rematch]: 7.76001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 7.88001e-06 [inline_without_move]: 4.68001e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.25999e-06 [auto_monad_grad]: 6.40022e-07 [auto_monad_eliminator]: 6.17999e-06 [cse]: 1.173e-05 [replace_applicator]: 5.19998e-06 [py_interpret_to_execute_after_opt_a]: 1.095e-05 [rewriter_after_opt_a]: 3.451e-05 [convert_after_rewriter]: 6.74999e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00056949 [jit_opt_b]: 5.152e-05, [1] [Cycle 1]: 4.312e-05, [2] [frontend_op_eliminate]: 1.642e-05 [inline_after_opt_a]: 1.502e-05 [cconv]: 2.5e-05 [loop_unroll]: 0.00041847 [jit_opt_after_cconv]: 0.00014643, [1] [Cycle 1]: 0.0001396, [11] [c_1]: 2.128e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 6.33e-06 [updatestate_assign_eliminate]: 2.55002e-06 [updatestate_loads_eliminate]: 2.40002e-06 [cse]: 2.285e-05 [call_graph_tuple_transform]: 2.021e-05 [tuple_list_get_item_eliminator]: 5.44e-06 [none_parameter_eliminate]: 1.56998e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.07e-06 [remove_dup_value]: 1.571e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.02999e-06 [add_recomputation]: 5.891e-05 [cse_after_recomputation]: 2.393e-05, [1] [Cycle 1]: 1.86e-05, [1] [cse]: 1.185e-05 [auto_monad_reorder]: 1.583e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 5.34998e-06 [opt_after_jit_grad]: 0.00045833 [symbol_engine_optimizer]: 7.315e-05, [1] [Cycle 1]: 6.677e-05, [6] [build]: 3.63999e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.293e-05 [opt_reshape]: 5.67999e-06 [fold_const_symbol]: 8.80999e-06 [renormalize]: 4.90021e-07 [validate]: 3.75e-05 Sums bootstrap : 0.000283s : 3.33% type_inference : 0.004481s : 52.81% event_method : 0.000016s : 0.19% auto_monad : 0.000067s : 0.80% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000043s : 0.50% rewriter_before_opt_a : 0.000075s : 0.89% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000061s : 0.72% jit_opt_a.loop_unroll : 0.000036s : 0.42% jit_opt_a.a_1 : 0.000622s : 7.33% jit_opt_a.with_stream_mark : 0.000026s : 0.31% jit_opt_a.recompute_prepare : 0.000014s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000012s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000008s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000658s : 7.76% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.25% jit_opt_a.cse : 0.000043s : 0.50% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000035s : 0.41% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000569s : 6.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000025s : 0.29% loop_unroll : 0.000418s : 4.93% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000023s : 0.27% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000059s : 0.69% cse_after_recomputation.cse : 0.000012s : 0.14% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000002s : 0.03% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000458s : 5.40% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000038s : 0.44% Time group info: ------[substitution.] 0.000195 23 0.99% : 0.000002s : 2: substitution.elim_not_effective 0.85% : 0.000002s : 2: substitution.fold_const_symbol 2.89% : 0.000006s : 3: substitution.graph_param_transform 82.29% : 0.000160s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.71% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.62% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004420 2 81.07% : 0.003583s : 1: type_inference.infer 18.93% : 0.000837s : 1: type_inference.specialize ------[replace.] 0.000069 6 66.23% : 0.000045s : 4: replace.inline 33.77% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000170 6 93.08% : 0.000158s : 4: match.inline 6.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000120 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.12% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.24% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.74% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.14% : 0.000001s : 10: predicate.depend_value_elim 1.02% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.52% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.16% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.27% : 0.000002s : 10: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 10: predicate.environ_get_depend_swap 1.17% : 0.000001s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000001s : 3: predicate.graph_param_transform 6.03% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.39% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.64% : 0.000002s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.39% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.20% : 0.000001s : 10: predicate.merge_addn 1.05% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000001s : 3: predicate.opt_reshape 2.20% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 2.00% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.68% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.72% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.22% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.11% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.66% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.32% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 16: predicate.switch_defer_inline 2.38% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.54% : 0.000009s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.17% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.35% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 2.02% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.79% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.28% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000574 13 50.56% : 0.000290s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.90% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.54% : 0.000256s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013997 72 0.44% : 0.000062s : 1: add_recomputation 0.50% : 0.000071s : 1: auto_monad 0.13% : 0.000019s : 1: auto_monad_reorder 2.14% : 0.000299s : 1: bootstrap 0.20% : 0.000028s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000026s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000005s : 1: get_jit_bprop_graph 0.06% : 0.000009s : 1: graph_reusing 38.11% : 0.005334s : 1: jit_opt_a 1.07% : 0.000149s : 1: jit_opt_after_cconv 0.39% : 0.000054s : 1: jit_opt_b 3.04% : 0.000426s : 1: loop_unroll 4.14% : 0.000580s : 1: mutable_eliminate 5.97% : 0.000835s : 26: opt.transform.jit_opt_a 0.35% : 0.000049s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000016s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.34% : 0.000468s : 1: opt_after_jit_grad 0.06% : 0.000008s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000045s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000018s : 1: remove_dup_value 2.45% : 0.000342s : 1: renormalize.infer 2.20% : 0.000308s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000038s : 1: rewriter_after_opt_a 0.56% : 0.000078s : 1: rewriter_before_opt_a 0.54% : 0.000076s : 1: symbol_engine_optimizer 32.10% : 0.004494s : 1: type_inference TotalTime = 0.0126898, [30] [bootstrap]: 0.00029867 [type_inference]: 0.00484526 [event_method]: 1.84e-05 [auto_monad]: 6.173e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.09e-06 [py_interpret_to_execute]: 4.116e-05 [rewriter_before_opt_a]: 8.36e-05 [expand_dump_flag]: 2.98e-06 [jit_opt_a]: 0.00528908, [2] [Cycle 1]: 0.00161513, [27] [switch_simplify]: 4.883e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00049513 [with_stream_mark]: 1.242e-05 [recompute_prepare]: 7.08998e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.53e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.04998e-06 [specialize_transform]: 5.90002e-06 [updatestate_useless_node_eliminater]: 5.16002e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.46998e-06 [merge_forward]: 2.70002e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.15e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.17001e-06 [replace_old_param]: 8.18999e-06 [inline_without_move]: 5.64e-06 [renormalize]: 0.00073555 [add_forward_monad_depend]: 4.58999e-06 [auto_monad_grad]: 1.32e-06 [auto_monad_eliminator]: 1.159e-05 [cse]: 1.957e-05 [replace_applicator]: 1.316e-05 [Cycle 2]: 0.0003145, [27] [switch_simplify]: 5.56e-06 [loop_unroll]: 4.92e-06 [a_1]: 9.261e-05 [with_stream_mark]: 8.50999e-06 [recompute_prepare]: 5.08002e-06 [updatestate_depend_eliminate]: 2.66999e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 1.93002e-06 [parameter_eliminate]: 1.09003e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.88001e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.25001e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.41998e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.27e-05 [j_node_and_user_rematch]: 8.12e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.38999e-06 [inline_without_move]: 4.77e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.42999e-06 [cse]: 1.094e-05 [replace_applicator]: 5.19e-06 [py_interpret_to_execute_after_opt_a]: 9.51e-06 [rewriter_after_opt_a]: 2.812e-05 [convert_after_rewriter]: 6.23002e-06 [order_py_execute_after_rewriter]: 4.37e-06 [mutable_eliminate]: 0.00050293 [jit_opt_b]: 4.862e-05, [1] [Cycle 1]: 4.237e-05, [2] [frontend_op_eliminate]: 1.582e-05 [inline_after_opt_a]: 1.578e-05 [cconv]: 1.681e-05 [loop_unroll]: 0.00040982 [jit_opt_after_cconv]: 0.00013533, [1] [Cycle 1]: 0.00012879, [11] [c_1]: 2.069e-05 [parameter_eliminate]: 2.76999e-06 [updatestate_depend_eliminate]: 5.57001e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [cse]: 1.888e-05 [call_graph_tuple_transform]: 1.641e-05 [tuple_list_get_item_eliminator]: 5.34e-06 [none_parameter_eliminate]: 8.79983e-07 [renormalize]: 3.10014e-07 [switch_simplify]: 5.05001e-06 [remove_dup_value]: 7.58999e-06 [partial_unused_args_eliminate]: 1.35999e-06 [environ_conv]: 4.13999e-06 [add_recomputation]: 3.343e-05 [cse_after_recomputation]: 2.091e-05, [1] [Cycle 1]: 1.588e-05, [1] [cse]: 1.049e-05 [auto_monad_reorder]: 9.36002e-06 [get_jit_bprop_graph]: 1.56002e-06 [rewriter_after_jit_bprop_graph]: 4.94e-06 [opt_after_jit_grad]: 0.00052423 [symbol_engine_optimizer]: 7.041e-05, [1] [Cycle 1]: 6.441e-05, [6] [build]: 2.51e-06 [elim_shapecalc]: 8.22e-06 [elim_not_effective]: 1.269e-05 [opt_reshape]: 5.84e-06 [fold_const_symbol]: 8e-06 [renormalize]: 3.59985e-07 [validate]: 2.807e-05 Sums bootstrap : 0.000299s : 3.40% type_inference : 0.004845s : 55.23% event_method : 0.000018s : 0.21% auto_monad : 0.000062s : 0.70% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.47% rewriter_before_opt_a : 0.000084s : 0.95% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000054s : 0.62% jit_opt_a.loop_unroll : 0.000036s : 0.41% jit_opt_a.a_1 : 0.000588s : 6.70% jit_opt_a.with_stream_mark : 0.000021s : 0.24% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000736s : 8.39% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.19% jit_opt_a.cse : 0.000031s : 0.35% jit_opt_a.replace_applicator : 0.000018s : 0.21% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000028s : 0.32% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000503s : 5.73% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.18% jit_opt_b.inline_after_opt_a : 0.000016s : 0.18% cconv : 0.000017s : 0.19% loop_unroll : 0.000410s : 4.67% jit_opt_after_cconv.c_1 : 0.000021s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000016s : 0.19% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000008s : 0.09% partial_unused_args_eliminate : 0.000001s : 0.02% environ_conv : 0.000004s : 0.05% add_recomputation : 0.000033s : 0.38% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000009s : 0.11% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000524s : 5.98% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.32% Time group info: ------[substitution.] 0.000166 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.20% : 0.000004s : 3: substitution.graph_param_transform 84.54% : 0.000140s : 4: substitution.inline 1.88% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000004s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 4.96% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004786 2 80.08% : 0.003832s : 1: type_inference.infer 19.92% : 0.000953s : 1: type_inference.specialize ------[replace.] 0.000066 6 64.64% : 0.000043s : 4: replace.inline 35.36% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 95.11% : 0.000137s : 4: match.inline 4.89% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.20% : 0.000001s : 10: predicate.accumulaten_eliminater 1.23% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.54% : 0.000002s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.69% : 0.000002s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.17% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.23% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.32% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.34% : 0.000002s : 10: predicate.environ_get_depend_swap 1.25% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.07% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.24% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.02% : 0.000002s : 15: predicate.load_eliminater 1.45% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.18% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.66% : 0.000001s : 3: predicate.opt_reshape 2.12% : 0.000002s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.79% : 0.000002s : 10: predicate.reduce_eliminate 1.53% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.60% : 0.000001s : 6: predicate.replace_old_param 0.34% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 3: predicate.row_tensor_eliminate 1.30% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.46% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.34% : 0.000008s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.77% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000687 13 46.35% : 0.000318s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.24% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 49.41% : 0.000339s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014271 72 0.25% : 0.000036s : 1: add_recomputation 0.45% : 0.000065s : 1: auto_monad 0.08% : 0.000012s : 1: auto_monad_reorder 2.18% : 0.000311s : 1: bootstrap 0.14% : 0.000019s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.16% : 0.000023s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.15% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.09% : 0.005292s : 1: jit_opt_a 0.97% : 0.000138s : 1: jit_opt_after_cconv 0.36% : 0.000051s : 1: jit_opt_b 2.93% : 0.000418s : 1: loop_unroll 3.59% : 0.000512s : 1: mutable_eliminate 5.56% : 0.000793s : 26: opt.transform.jit_opt_a 0.31% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.74% : 0.000533s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000003s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000044s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000010s : 1: remove_dup_value 2.70% : 0.000386s : 1: renormalize.infer 2.41% : 0.000344s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000031s : 1: rewriter_after_opt_a 0.61% : 0.000087s : 1: rewriter_before_opt_a 0.51% : 0.000073s : 1: symbol_engine_optimizer 34.03% : 0.004857s : 1: type_inference TotalTime = 0.115383, [30] [bootstrap]: 0.00026454 [type_inference]: 0.104718 [event_method]: 1.872e-05 [auto_monad]: 6.881e-05 [graph_reusing]: 5.35001e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00054424 [rewriter_before_opt_a]: 8.636e-05 [expand_dump_flag]: 3.78001e-06 [jit_opt_a]: 0.00729555, [2] [Cycle 1]: 0.00356526, [27] [switch_simplify]: 5.365e-05 [loop_unroll]: 3.022e-05 [a_1]: 0.00057643 [with_stream_mark]: 1.732e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.69001e-06 [parameter_eliminate]: 2.06e-06 [specialize_transform]: 6.67002e-06 [updatestate_useless_node_eliminater]: 5.95002e-06 [accelerated_algorithm]: 6.86001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.20002e-06 [merge_forward]: 4.12003e-06 [cell_reuse_recompute_pass]: 1.29003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.516e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.47999e-06 [inline_without_move]: 6.71e-06 [renormalize]: 0.00254421 [add_forward_monad_depend]: 6.54999e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.834e-05 [cse]: 2.453e-05 [replace_applicator]: 1.805e-05 [Cycle 2]: 0.00037788, [27] [switch_simplify]: 7.03e-06 [loop_unroll]: 6.30002e-06 [a_1]: 0.00012767 [with_stream_mark]: 1.189e-05 [recompute_prepare]: 6.09999e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.48e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 5.76e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 1.74998e-06 [get_grad_eliminate_]: 5.67999e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.609e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.36998e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 6.01e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 1.27e-06 [auto_monad_eliminator]: 5.97999e-06 [cse]: 1.151e-05 [replace_applicator]: 6.01003e-06 [py_interpret_to_execute_after_opt_a]: 1.209e-05 [rewriter_after_opt_a]: 3.481e-05 [convert_after_rewriter]: 7.13e-06 [order_py_execute_after_rewriter]: 5.09003e-06 [mutable_eliminate]: 0.00071599 [jit_opt_b]: 5.884e-05, [1] [Cycle 1]: 5.03e-05, [2] [frontend_op_eliminate]: 2.029e-05 [inline_after_opt_a]: 1.82e-05 [cconv]: 2.643e-05 [loop_unroll]: 0.00043087 [jit_opt_after_cconv]: 0.00014948, [1] [Cycle 1]: 0.00014264, [11] [c_1]: 2.55e-05 [parameter_eliminate]: 2.70002e-06 [updatestate_depend_eliminate]: 6.77002e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 2.011e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 6.33002e-06 [none_parameter_eliminate]: 1.79e-06 [renormalize]: 5.50004e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 1.542e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 8.88002e-06 [add_recomputation]: 4.683e-05 [cse_after_recomputation]: 2.162e-05, [1] [Cycle 1]: 1.666e-05, [1] [cse]: 1.106e-05 [auto_monad_reorder]: 1.587e-05 [get_jit_bprop_graph]: 2.13998e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00050653 [symbol_engine_optimizer]: 8.427e-05, [1] [Cycle 1]: 7.484e-05, [6] [build]: 3.56001e-06 [elim_shapecalc]: 9.02e-06 [elim_not_effective]: 1.624e-05 [opt_reshape]: 9.04998e-06 [fold_const_symbol]: 9.24e-06 [renormalize]: 5.69999e-07 [validate]: 4.791e-05 Sums bootstrap : 0.000265s : 0.24% type_inference : 0.104718s : 93.96% event_method : 0.000019s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000544s : 0.49% rewriter_before_opt_a : 0.000086s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000704s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002544s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000716s : 0.64% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000431s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000507s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000048s : 0.04% Time group info: ------[substitution.] 0.000206 24 0.88% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000006s : 4: substitution.graph_param_transform 82.04% : 0.000169s : 4: substitution.inline 2.02% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.27% : 0.000005s : 2: substitution.replace_old_param 6.59% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.104639 2 97.46% : 0.101976s : 1: type_inference.infer 2.54% : 0.002662s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.07% : 0.000052s : 4: replace.inline 32.93% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.08% : 0.000166s : 4: match.inline 6.92% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.32% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.45% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.35% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 0.98% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.42% : 0.000001s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 1.06% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.71% : 0.000002s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.69% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.88% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.03% : 0.000001s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 1.78% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.15% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 2.10% : 0.000003s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.68% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.96% : 0.000003s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.87% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.48% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.19% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 2.04% : 0.000003s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002021 22 65.34% : 0.001320s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.07% : 0.000668s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.118983 72 0.04% : 0.000050s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000280s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.13% : 0.007299s : 1: jit_opt_a 0.13% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.37% : 0.000439s : 1: loop_unroll 0.61% : 0.000724s : 1: mutable_eliminate 0.79% : 0.000942s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.06% : 0.000066s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000040s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000515s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000551s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.52% : 0.001810s : 1: renormalize.infer 0.61% : 0.000726s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000038s : 1: rewriter_after_opt_a 0.08% : 0.000092s : 1: rewriter_before_opt_a 0.07% : 0.000087s : 1: symbol_engine_optimizer 88.03% : 0.104736s : 1: type_inference TotalTime = 0.121551, [30] [bootstrap]: 0.00027345 [type_inference]: 0.110175 [event_method]: 2.02e-05 [auto_monad]: 7.377e-05 [graph_reusing]: 6.24001e-06 [pre_auto_parallel]: 2.40002e-06 [py_interpret_to_execute]: 0.00061589 [rewriter_before_opt_a]: 9.465e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.00794148, [2] [Cycle 1]: 0.00384811, [27] [switch_simplify]: 6.096e-05 [loop_unroll]: 3.083e-05 [a_1]: 0.00060779 [with_stream_mark]: 1.922e-05 [recompute_prepare]: 8.52e-06 [updatestate_depend_eliminate]: 3.68e-06 [updatestate_assign_eliminate]: 3.27002e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.80001e-06 [specialize_transform]: 7.35e-06 [updatestate_useless_node_eliminater]: 6.25002e-06 [accelerated_algorithm]: 6.64001e-06 [meta_shard_fg_expand]: 2.61e-06 [get_grad_eliminate_]: 7.01001e-06 [merge_forward]: 3.81999e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.614e-05 [j_node_and_user_rematch]: 1.025e-05 [meta_fg_expand]: 2.46998e-06 [replace_old_param]: 1.017e-05 [inline_without_move]: 6.29999e-06 [renormalize]: 0.00278009 [add_forward_monad_depend]: 5.87999e-06 [auto_monad_grad]: 1.84e-06 [auto_monad_eliminator]: 1.404e-05 [cse]: 2.298e-05 [replace_applicator]: 1.535e-05 [Cycle 2]: 0.00037041, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.31e-06 [a_1]: 0.00012789 [with_stream_mark]: 1.024e-05 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 2.70002e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 5.61998e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 1.54998e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.97001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.448e-05 [j_node_and_user_rematch]: 8.95001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.89e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 8.80013e-07 [auto_monad_eliminator]: 6.49001e-06 [cse]: 1.142e-05 [replace_applicator]: 6.04001e-06 [py_interpret_to_execute_after_opt_a]: 1.132e-05 [rewriter_after_opt_a]: 2.896e-05 [convert_after_rewriter]: 6.23002e-06 [order_py_execute_after_rewriter]: 4.94e-06 [mutable_eliminate]: 0.00062922 [jit_opt_b]: 5.575e-05, [1] [Cycle 1]: 4.916e-05, [2] [frontend_op_eliminate]: 2.052e-05 [inline_after_opt_a]: 1.794e-05 [cconv]: 1.966e-05 [loop_unroll]: 0.00044855 [jit_opt_after_cconv]: 0.00015232, [1] [Cycle 1]: 0.00014583, [11] [c_1]: 2.706e-05 [parameter_eliminate]: 2.65002e-06 [updatestate_depend_eliminate]: 5.92001e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.258e-05 [call_graph_tuple_transform]: 1.994e-05 [tuple_list_get_item_eliminator]: 6.36998e-06 [none_parameter_eliminate]: 1.07e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.99e-06 [remove_dup_value]: 1.084e-05 [partial_unused_args_eliminate]: 1.74e-06 [environ_conv]: 7.35e-06 [add_recomputation]: 9.492e-05 [cse_after_recomputation]: 2.547e-05, [1] [Cycle 1]: 1.9e-05, [1] [cse]: 1.226e-05 [auto_monad_reorder]: 1.287e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 5.91e-06 [opt_after_jit_grad]: 0.00049932 [symbol_engine_optimizer]: 0.00010669, [1] [Cycle 1]: 9.94e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 8.54998e-06 [elim_not_effective]: 3.983e-05 [opt_reshape]: 7.52002e-06 [fold_const_symbol]: 1.06e-05 [renormalize]: 3.19997e-07 [validate]: 4.146e-05 Sums bootstrap : 0.000273s : 0.23% type_inference : 0.110175s : 93.98% event_method : 0.000020s : 0.02% auto_monad : 0.000074s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000616s : 0.53% rewriter_before_opt_a : 0.000095s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000736s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002780s : 2.37% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000021s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000029s : 0.02% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000629s : 0.54% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000449s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000095s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000499s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000040s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000227 24 0.63% : 0.000001s : 2: substitution.elim_not_effective 0.61% : 0.000001s : 2: substitution.fold_const_symbol 2.10% : 0.000005s : 4: substitution.graph_param_transform 84.94% : 0.000193s : 4: substitution.inline 1.39% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000006s : 4: substitution.remove_not_recompute_node 2.16% : 0.000005s : 2: substitution.replace_old_param 5.70% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.110084 2 97.39% : 0.107208s : 1: type_inference.infer 2.61% : 0.002876s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.39% : 0.000052s : 4: replace.inline 32.61% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.20% : 0.000190s : 4: match.inline 5.80% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.26% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.35% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.75% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.25% : 0.000002s : 8: predicate.get_grad_eliminate 0.53% : 0.000001s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.62% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.73% : 0.000002s : 18: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.56% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.21% : 0.000002s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.34% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000003s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 1.95% : 0.000003s : 22: predicate.replace_applicator 0.75% : 0.000001s : 8: predicate.replace_old_param 0.31% : 0.000000s : 4: predicate.reset_defer_inline 1.36% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.67% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000002s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.84% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.38% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.51% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.05% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.80% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002362 22 63.62% : 0.001503s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.87% : 0.000044s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.51% : 0.000815s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.125412 72 0.08% : 0.000098s : 1: add_recomputation 0.06% : 0.000077s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000286s : 1: bootstrap 0.02% : 0.000022s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000028s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.33% : 0.007945s : 1: jit_opt_a 0.12% : 0.000155s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000457s : 1: loop_unroll 0.51% : 0.000639s : 1: mutable_eliminate 0.78% : 0.000977s : 26: opt.transform.jit_opt_a 0.04% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000063s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000508s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.50% : 0.000624s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.52% : 0.001905s : 1: renormalize.infer 0.69% : 0.000866s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000101s : 1: rewriter_before_opt_a 0.09% : 0.000109s : 1: symbol_engine_optimizer 87.87% : 0.110194s : 1: type_inference TotalTime = 0.0596947, [30] [bootstrap]: 0.00031805 [type_inference]: 0.0501608 [event_method]: 1.771e-05 [auto_monad]: 6.748e-05 [graph_reusing]: 5.44998e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00027782 [rewriter_before_opt_a]: 8.379e-05 [expand_dump_flag]: 3.51001e-06 [jit_opt_a]: 0.00654313, [2] [Cycle 1]: 0.00284785, [27] [switch_simplify]: 5.635e-05 [loop_unroll]: 3.118e-05 [a_1]: 0.00056893 [with_stream_mark]: 1.823e-05 [recompute_prepare]: 7.94997e-06 [updatestate_depend_eliminate]: 4.52e-06 [updatestate_assign_eliminate]: 3.25002e-06 [updatestate_loads_eliminate]: 3.09001e-06 [parameter_eliminate]: 2.02999e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 6.04999e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 2.49999e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.1e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.616e-05 [j_node_and_user_rematch]: 1.005e-05 [meta_fg_expand]: 2.65002e-06 [replace_old_param]: 1.013e-05 [inline_without_move]: 6.51e-06 [renormalize]: 0.00182608 [add_forward_monad_depend]: 6.49999e-06 [auto_monad_grad]: 2.47001e-06 [auto_monad_eliminator]: 1.753e-05 [cse]: 3.154e-05 [replace_applicator]: 1.627e-05 [Cycle 2]: 0.00035863, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00012147 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.61999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.73002e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.54e-06 [meta_shard_fg_expand]: 1.44998e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.76999e-06 [cell_reuse_recompute_pass]: 1.74e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.529e-05 [j_node_and_user_rematch]: 9.10001e-06 [meta_fg_expand]: 1.70001e-06 [replace_old_param]: 8.75999e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 6.20002e-06 [cse]: 1.124e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 1.101e-05 [rewriter_after_opt_a]: 3.527e-05 [convert_after_rewriter]: 6.93998e-06 [order_py_execute_after_rewriter]: 5.23002e-06 [mutable_eliminate]: 0.00060813 [jit_opt_b]: 5.745e-05, [1] [Cycle 1]: 4.949e-05, [2] [frontend_op_eliminate]: 2.073e-05 [inline_after_opt_a]: 1.803e-05 [cconv]: 2.516e-05 [loop_unroll]: 0.00043235 [jit_opt_after_cconv]: 0.00014765, [1] [Cycle 1]: 0.00014154, [11] [c_1]: 2.553e-05 [parameter_eliminate]: 2.51e-06 [updatestate_depend_eliminate]: 5.44e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 1.948e-05 [call_graph_tuple_transform]: 2.126e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 6.54999e-06 [remove_dup_value]: 1.575e-05 [partial_unused_args_eliminate]: 2.91e-06 [environ_conv]: 6.98e-06 [add_recomputation]: 4.791e-05 [cse_after_recomputation]: 2.156e-05, [1] [Cycle 1]: 1.655e-05, [1] [cse]: 1.109e-05 [auto_monad_reorder]: 1.509e-05 [get_jit_bprop_graph]: 2.22999e-06 [rewriter_after_jit_bprop_graph]: 4.75001e-06 [opt_after_jit_grad]: 0.00046513 [symbol_engine_optimizer]: 9.556e-05, [1] [Cycle 1]: 8.958e-05, [6] [build]: 3.74002e-06 [elim_shapecalc]: 8.94e-06 [elim_not_effective]: 3.12e-05 [opt_reshape]: 6.86001e-06 [fold_const_symbol]: 9.87001e-06 [renormalize]: 4.00003e-07 [validate]: 4.102e-05 Sums bootstrap : 0.000318s : 0.57% type_inference : 0.050161s : 89.91% event_method : 0.000018s : 0.03% auto_monad : 0.000067s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000278s : 0.50% rewriter_before_opt_a : 0.000084s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000063s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000690s : 1.24% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001826s : 3.27% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000043s : 0.08% jit_opt_a.replace_applicator : 0.000022s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000608s : 1.09% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000432s : 0.77% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000048s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000465s : 0.83% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000031s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000041s : 0.07% Time group info: ------[substitution.] 0.000204 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 3.18% : 0.000007s : 4: substitution.graph_param_transform 82.25% : 0.000168s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000005s : 4: substitution.remove_not_recompute_node 2.30% : 0.000005s : 2: substitution.replace_old_param 6.36% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050086 2 96.34% : 0.048250s : 1: type_inference.infer 3.66% : 0.001836s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.66% : 0.000048s : 4: replace.inline 33.34% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.32% : 0.000165s : 4: match.inline 6.68% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.20% : 0.000002s : 12: predicate.addn_zero_filter 1.83% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.40% : 0.000002s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.32% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 4: predicate.fold_const_symbol 1.35% : 0.000002s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.70% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.10% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.90% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.67% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.92% : 0.000003s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.85% : 0.000010s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.32% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.71% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.77% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001901 22 69.37% : 0.001319s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.58% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 29.05% : 0.000552s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062539 72 0.08% : 0.000051s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.53% : 0.000331s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.47% : 0.006546s : 1: jit_opt_a 0.24% : 0.000150s : 1: jit_opt_after_cconv 0.10% : 0.000060s : 1: jit_opt_b 0.70% : 0.000440s : 1: loop_unroll 0.99% : 0.000617s : 1: mutable_eliminate 1.48% : 0.000924s : 26: opt.transform.jit_opt_a 0.09% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000053s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000474s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000284s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.93% : 0.001204s : 1: renormalize.infer 0.98% : 0.000613s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.14% : 0.000089s : 1: rewriter_before_opt_a 0.16% : 0.000098s : 1: symbol_engine_optimizer 80.23% : 0.050174s : 1: type_inference TotalTime = 0.0122512, [30] [bootstrap]: 0.00028988 [type_inference]: 0.00450084 [event_method]: 1.831e-05 [auto_monad]: 6.678e-05 [graph_reusing]: 5.54e-06 [pre_auto_parallel]: 2.06e-06 [py_interpret_to_execute]: 3.799e-05 [rewriter_before_opt_a]: 7.047e-05 [expand_dump_flag]: 2.96001e-06 [jit_opt_a]: 0.00517468, [2] [Cycle 1]: 0.00162023, [27] [switch_simplify]: 4.938e-05 [loop_unroll]: 3.07e-05 [a_1]: 0.00051047 [with_stream_mark]: 1.553e-05 [recompute_prepare]: 8.14002e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.05002e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.22e-06 [specialize_transform]: 7.19001e-06 [updatestate_useless_node_eliminater]: 5.84999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 6.04999e-06 [merge_forward]: 4.08001e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.416e-05 [j_node_and_user_rematch]: 9.04e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.20001e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00068602 [add_forward_monad_depend]: 5.59e-06 [auto_monad_grad]: 2.46e-06 [auto_monad_eliminator]: 1.513e-05 [cse]: 2.604e-05 [replace_applicator]: 1.366e-05 [Cycle 2]: 0.00031924, [27] [switch_simplify]: 5.69e-06 [loop_unroll]: 4.94998e-06 [a_1]: 9.305e-05 [with_stream_mark]: 8.74003e-06 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.17001e-06 [parameter_eliminate]: 1.14e-06 [specialize_transform]: 5.10001e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.74998e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.42998e-06 [merge_forward]: 2.27999e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.299e-05 [j_node_and_user_rematch]: 8.25e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 7.87e-06 [inline_without_move]: 4.84e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.50001e-06 [cse]: 1.148e-05 [replace_applicator]: 5.31002e-06 [py_interpret_to_execute_after_opt_a]: 1.017e-05 [rewriter_after_opt_a]: 3.279e-05 [convert_after_rewriter]: 6.81001e-06 [order_py_execute_after_rewriter]: 5.03002e-06 [mutable_eliminate]: 0.0005574 [jit_opt_b]: 5.065e-05, [1] [Cycle 1]: 4.348e-05, [2] [frontend_op_eliminate]: 1.653e-05 [inline_after_opt_a]: 1.621e-05 [cconv]: 2.238e-05 [loop_unroll]: 0.00041651 [jit_opt_after_cconv]: 0.00013616, [1] [Cycle 1]: 0.00012989, [11] [c_1]: 2.156e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.34e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.08002e-06 [cse]: 1.815e-05 [call_graph_tuple_transform]: 1.758e-05 [tuple_list_get_item_eliminator]: 5.47001e-06 [none_parameter_eliminate]: 1.35999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 4.89e-06 [remove_dup_value]: 1.424e-05 [partial_unused_args_eliminate]: 1.613e-05 [environ_conv]: 4.85999e-06 [add_recomputation]: 4.709e-05 [cse_after_recomputation]: 2.165e-05, [1] [Cycle 1]: 1.639e-05, [1] [cse]: 1.081e-05 [auto_monad_reorder]: 1.509e-05 [get_jit_bprop_graph]: 1.62001e-06 [rewriter_after_jit_bprop_graph]: 4.75001e-06 [opt_after_jit_grad]: 0.00045454 [symbol_engine_optimizer]: 7.187e-05, [1] [Cycle 1]: 6.57e-05, [6] [build]: 3.3e-06 [elim_shapecalc]: 7.42002e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.90002e-06 [fold_const_symbol]: 8.87e-06 [renormalize]: 5.89993e-07 [validate]: 3.258e-05 Sums bootstrap : 0.000290s : 3.43% type_inference : 0.004501s : 53.22% event_method : 0.000018s : 0.22% auto_monad : 0.000067s : 0.79% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.45% rewriter_before_opt_a : 0.000070s : 0.83% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.42% jit_opt_a.a_1 : 0.000604s : 7.14% jit_opt_a.with_stream_mark : 0.000024s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.13% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000011s : 0.13% jit_opt_a.renormalize : 0.000686s : 8.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.24% jit_opt_a.cse : 0.000038s : 0.44% jit_opt_a.replace_applicator : 0.000019s : 0.22% py_interpret_to_execute_after_opt_a : 0.000010s : 0.12% rewriter_after_opt_a : 0.000033s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000557s : 6.59% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000022s : 0.26% loop_unroll : 0.000417s : 4.92% jit_opt_after_cconv.c_1 : 0.000022s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.17% partial_unused_args_eliminate : 0.000016s : 0.19% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.56% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000455s : 5.37% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000033s : 0.39% Time group info: ------[substitution.] 0.000189 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.74% : 0.000001s : 2: substitution.fold_const_symbol 2.70% : 0.000005s : 3: substitution.graph_param_transform 81.18% : 0.000154s : 4: substitution.inline 1.70% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.88% : 0.000005s : 4: substitution.remove_not_recompute_node 2.52% : 0.000005s : 2: substitution.replace_old_param 7.20% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004437 2 81.73% : 0.003627s : 1: type_inference.infer 18.27% : 0.000811s : 1: type_inference.specialize ------[replace.] 0.000065 6 65.82% : 0.000043s : 4: replace.inline 34.18% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 92.40% : 0.000151s : 4: match.inline 7.60% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.30% : 0.000002s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.42% : 0.000002s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.84% : 0.000002s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.51% : 0.000001s : 3: predicate.check_bprop_eliminate 1.03% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.08% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.92% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.54% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.20% : 0.000001s : 10: predicate.environ_get_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.44% : 0.000001s : 3: predicate.graph_param_transform 5.68% : 0.000007s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.29% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.99% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 10: predicate.merge_addn 1.19% : 0.000001s : 10: predicate.minmaximum_grad 2.04% : 0.000002s : 3: predicate.mutable_eliminate 0.83% : 0.000001s : 3: predicate.opt_reshape 2.24% : 0.000003s : 15: predicate.partial_eliminate 1.15% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000002s : 10: predicate.reduce_eliminate 1.37% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.37% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.87% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.40% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 16: predicate.switch_defer_inline 2.11% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.56% : 0.000009s : 53: predicate.switch_simplify 1.32% : 0.000002s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.47% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.88% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.62% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.00% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.94% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000599 13 51.70% : 0.000310s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.12% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.18% : 0.000259s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013814 72 0.36% : 0.000050s : 1: add_recomputation 0.51% : 0.000070s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.21% : 0.000305s : 1: bootstrap 0.18% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000024s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.48% : 0.005178s : 1: jit_opt_a 1.00% : 0.000139s : 1: jit_opt_after_cconv 0.38% : 0.000053s : 1: jit_opt_b 3.08% : 0.000425s : 1: loop_unroll 4.10% : 0.000566s : 1: mutable_eliminate 5.91% : 0.000816s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000463s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.13% : 0.000018s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000041s : 1: py_interpret_to_execute 0.09% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.59% : 0.000358s : 1: renormalize.infer 2.32% : 0.000321s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000035s : 1: rewriter_after_opt_a 0.53% : 0.000073s : 1: rewriter_before_opt_a 0.54% : 0.000074s : 1: symbol_engine_optimizer 32.67% : 0.004513s : 1: type_inference TotalTime = 0.0124168, [30] [bootstrap]: 0.00028544 [type_inference]: 0.00485517 [event_method]: 1.667e-05 [auto_monad]: 4.353e-05 [graph_reusing]: 3.85e-06 [pre_auto_parallel]: 1.47001e-06 [py_interpret_to_execute]: 3.882e-05 [rewriter_before_opt_a]: 6.827e-05 [expand_dump_flag]: 1.55999e-06 [jit_opt_a]: 0.00509144, [2] [Cycle 1]: 0.00156397, [27] [switch_simplify]: 5.183e-05 [loop_unroll]: 3.023e-05 [a_1]: 0.00050393 [with_stream_mark]: 1.35e-05 [recompute_prepare]: 7.20998e-06 [updatestate_depend_eliminate]: 3.02002e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 6.27001e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.86998e-06 [meta_shard_fg_expand]: 1.52999e-06 [get_grad_eliminate_]: 5.40999e-06 [merge_forward]: 2.94001e-06 [cell_reuse_recompute_pass]: 1.15001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.215e-05 [j_node_and_user_rematch]: 8.32003e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.06001e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 0.00067306 [add_forward_monad_depend]: 4.38999e-06 [auto_monad_grad]: 1.20001e-06 [auto_monad_eliminator]: 1.083e-05 [cse]: 1.952e-05 [replace_applicator]: 1.203e-05 [Cycle 2]: 0.00031226, [27] [switch_simplify]: 5.64e-06 [loop_unroll]: 5.06002e-06 [a_1]: 9.061e-05 [with_stream_mark]: 8.33999e-06 [recompute_prepare]: 5.00001e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.00999e-06 [updatestate_useless_node_eliminater]: 4.79002e-06 [accelerated_algorithm]: 4.73001e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 4.68001e-06 [merge_forward]: 2.73e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 7.51999e-06 [meta_fg_expand]: 1.54998e-06 [replace_old_param]: 7.46999e-06 [inline_without_move]: 4.65999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 5.60016e-07 [auto_monad_eliminator]: 5.42999e-06 [cse]: 1.058e-05 [replace_applicator]: 5.00001e-06 [py_interpret_to_execute_after_opt_a]: 9.04e-06 [rewriter_after_opt_a]: 2.612e-05 [convert_after_rewriter]: 6.27001e-06 [order_py_execute_after_rewriter]: 3.97e-06 [mutable_eliminate]: 0.00053216 [jit_opt_b]: 4.985e-05, [1] [Cycle 1]: 4.315e-05, [2] [frontend_op_eliminate]: 1.732e-05 [inline_after_opt_a]: 1.535e-05 [cconv]: 1.654e-05 [loop_unroll]: 0.00041738 [jit_opt_after_cconv]: 0.00013599, [1] [Cycle 1]: 0.00012986, [11] [c_1]: 2.141e-05 [parameter_eliminate]: 2.38002e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.923e-05 [call_graph_tuple_transform]: 1.712e-05 [tuple_list_get_item_eliminator]: 5.47999e-06 [none_parameter_eliminate]: 8.30012e-07 [renormalize]: 2.69996e-07 [switch_simplify]: 5.67999e-06 [remove_dup_value]: 7.7e-06 [partial_unused_args_eliminate]: 1.84e-06 [environ_conv]: 3.78001e-06 [add_recomputation]: 4.946e-05 [cse_after_recomputation]: 2.27e-05, [1] [Cycle 1]: 1.756e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.005e-05 [get_jit_bprop_graph]: 1.56998e-06 [rewriter_after_jit_bprop_graph]: 4.55001e-06 [opt_after_jit_grad]: 0.00045546 [symbol_engine_optimizer]: 7.155e-05, [1] [Cycle 1]: 6.507e-05, [6] [build]: 2.70002e-06 [elim_shapecalc]: 7.76001e-06 [elim_not_effective]: 1.304e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 8.79e-06 [renormalize]: 3.60014e-07 [validate]: 2.824e-05 Sums bootstrap : 0.000285s : 3.30% type_inference : 0.004855s : 56.07% event_method : 0.000017s : 0.19% auto_monad : 0.000044s : 0.50% graph_reusing : 0.000004s : 0.04% pre_auto_parallel : 0.000001s : 0.02% py_interpret_to_execute : 0.000039s : 0.45% rewriter_before_opt_a : 0.000068s : 0.79% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000057s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000595s : 6.87% jit_opt_a.with_stream_mark : 0.000022s : 0.25% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000673s : 7.77% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.06% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.19% jit_opt_a.cse : 0.000030s : 0.35% jit_opt_a.replace_applicator : 0.000017s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.10% rewriter_after_opt_a : 0.000026s : 0.30% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000532s : 6.15% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000017s : 0.19% loop_unroll : 0.000417s : 4.82% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000019s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000008s : 0.09% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000004s : 0.04% add_recomputation : 0.000049s : 0.57% cse_after_recomputation.cse : 0.000012s : 0.13% auto_monad_reorder : 0.000010s : 0.12% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000455s : 5.26% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.33% Time group info: ------[substitution.] 0.000173 23 1.26% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.47% : 0.000004s : 3: substitution.graph_param_transform 83.87% : 0.000145s : 4: substitution.inline 1.34% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 5.54% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004797 2 79.60% : 0.003818s : 1: type_inference.infer 20.40% : 0.000979s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.04% : 0.000045s : 4: replace.inline 31.96% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000150 6 94.42% : 0.000142s : 4: match.inline 5.58% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000118 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.13% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.44% : 0.000002s : 10: predicate.addn_zero_filter 2.19% : 0.000003s : 10: predicate.arithmetic_simplify 1.40% : 0.000002s : 10: predicate.cast_eliminate 0.52% : 0.000001s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.43% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000002s : 10: predicate.environ_get_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 3: predicate.fold_const_symbol 1.06% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.22% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.36% : 0.000002s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.01% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.04% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.86% : 0.000002s : 10: predicate.reduce_eliminate 1.35% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.55% : 0.000001s : 6: predicate.remove_not_recompute_node 1.74% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.92% : 0.000001s : 3: predicate.row_tensor_eliminate 1.32% : 0.000002s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 0.95% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.62% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.45% : 0.000009s : 53: predicate.switch_simplify 1.35% : 0.000002s : 10: predicate.tile_eliminate 1.29% : 0.000002s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.90% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000663 13 49.00% : 0.000325s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.28% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.73% : 0.000310s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013960 72 0.38% : 0.000052s : 1: add_recomputation 0.33% : 0.000047s : 1: auto_monad 0.09% : 0.000013s : 1: auto_monad_reorder 2.15% : 0.000300s : 1: bootstrap 0.14% : 0.000019s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000025s : 1: cse_after_recomputation 0.04% : 0.000006s : 1: environ_conv 0.14% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000006s : 1: graph_reusing 36.50% : 0.005095s : 1: jit_opt_a 0.99% : 0.000139s : 1: jit_opt_after_cconv 0.38% : 0.000053s : 1: jit_opt_b 3.05% : 0.000426s : 1: loop_unroll 3.88% : 0.000541s : 1: mutable_eliminate 5.73% : 0.000799s : 26: opt.transform.jit_opt_a 0.33% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000026s : 4: opt.transform.jit_opt_b 0.08% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.32% : 0.000464s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.30% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.07% : 0.000010s : 1: remove_dup_value 2.45% : 0.000342s : 1: renormalize.infer 2.32% : 0.000324s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000029s : 1: rewriter_after_opt_a 0.51% : 0.000071s : 1: rewriter_before_opt_a 0.53% : 0.000074s : 1: symbol_engine_optimizer 34.87% : 0.004867s : 1: type_inference TotalTime = 0.119042, [30] [bootstrap]: 0.00026724 [type_inference]: 0.108323 [event_method]: 1.852e-05 [auto_monad]: 8.145e-05 [graph_reusing]: 5.85002e-06 [pre_auto_parallel]: 2.32001e-06 [py_interpret_to_execute]: 0.0005196 [rewriter_before_opt_a]: 8.674e-05 [expand_dump_flag]: 3.46001e-06 [jit_opt_a]: 0.00733341, [2] [Cycle 1]: 0.00347476, [27] [switch_simplify]: 5.076e-05 [loop_unroll]: 2.971e-05 [a_1]: 0.00056914 [with_stream_mark]: 1.794e-05 [recompute_prepare]: 8.84e-06 [updatestate_depend_eliminate]: 4e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.49001e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 7.05e-06 [updatestate_useless_node_eliminater]: 6.06e-06 [accelerated_algorithm]: 7.07002e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 6.71e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.458e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 2.80002e-06 [replace_old_param]: 9.29e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00247619 [add_forward_monad_depend]: 5.62001e-06 [auto_monad_grad]: 1.25001e-06 [auto_monad_eliminator]: 1.297e-05 [cse]: 2.27e-05 [replace_applicator]: 1.559e-05 [Cycle 2]: 0.00041551, [27] [switch_simplify]: 7.01999e-06 [loop_unroll]: 6.12999e-06 [a_1]: 0.00012759 [with_stream_mark]: 1.041e-05 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 3.18e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.15002e-06 [parameter_eliminate]: 1.57999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.40002e-06 [meta_shard_fg_expand]: 1.45001e-06 [get_grad_eliminate_]: 5.52999e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.85001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.382e-05 [j_node_and_user_rematch]: 9.21002e-06 [meta_fg_expand]: 2.14e-06 [replace_old_param]: 9.14998e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.28002e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 6.43003e-06 [cse]: 1.108e-05 [replace_applicator]: 5.048e-05 [py_interpret_to_execute_after_opt_a]: 1.105e-05 [rewriter_after_opt_a]: 2.782e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 4.37003e-06 [mutable_eliminate]: 0.0006449 [jit_opt_b]: 5.642e-05, [1] [Cycle 1]: 4.985e-05, [2] [frontend_op_eliminate]: 2.094e-05 [inline_after_opt_a]: 1.741e-05 [cconv]: 2.013e-05 [loop_unroll]: 0.00043745 [jit_opt_after_cconv]: 0.00015636, [1] [Cycle 1]: 0.0001499, [11] [c_1]: 2.711e-05 [parameter_eliminate]: 2.89999e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 4.80001e-06 [cse]: 2.292e-05 [call_graph_tuple_transform]: 1.991e-05 [tuple_list_get_item_eliminator]: 6.53e-06 [none_parameter_eliminate]: 1.07998e-06 [renormalize]: 1.30007e-07 [switch_simplify]: 6.48e-06 [remove_dup_value]: 1.017e-05 [partial_unused_args_eliminate]: 1.62001e-06 [environ_conv]: 7.18998e-06 [add_recomputation]: 3.534e-05 [cse_after_recomputation]: 2.168e-05, [1] [Cycle 1]: 1.656e-05, [1] [cse]: 1.121e-05 [auto_monad_reorder]: 9.96e-06 [get_jit_bprop_graph]: 2.71999e-06 [rewriter_after_jit_bprop_graph]: 5.74e-06 [opt_after_jit_grad]: 0.00051358 [symbol_engine_optimizer]: 8.287e-05, [1] [Cycle 1]: 7.673e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 1.097e-05 [elim_not_effective]: 1.635e-05 [opt_reshape]: 6.46e-06 [fold_const_symbol]: 1.255e-05 [renormalize]: 2.50002e-07 [validate]: 0.0001641 Sums bootstrap : 0.000267s : 0.23% type_inference : 0.108323s : 94.18% event_method : 0.000019s : 0.02% auto_monad : 0.000081s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000520s : 0.45% rewriter_before_opt_a : 0.000087s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000697s : 0.61% jit_opt_a.with_stream_mark : 0.000028s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002476s : 2.15% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000034s : 0.03% jit_opt_a.replace_applicator : 0.000066s : 0.06% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000028s : 0.02% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000645s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000437s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.00% opt_after_jit_grad : 0.000514s : 0.45% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000016s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000013s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000164s : 0.14% Time group info: ------[substitution.] 0.000205 24 2.29% : 0.000005s : 2: substitution.elim_not_effective 0.38% : 0.000001s : 2: substitution.fold_const_symbol 2.24% : 0.000005s : 4: substitution.graph_param_transform 82.41% : 0.000169s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.71% : 0.000006s : 4: substitution.remove_not_recompute_node 2.42% : 0.000005s : 2: substitution.replace_old_param 5.85% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108246 2 97.54% : 0.105587s : 1: type_inference.infer 2.46% : 0.002659s : 1: type_inference.specialize ------[replace.] 0.000076 6 67.97% : 0.000052s : 4: replace.inline 32.03% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.91% : 0.000166s : 4: match.inline 6.09% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000137 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.05% : 0.000001s : 12: predicate.compare_switch_simplify 1.43% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.63% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.03% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.54% : 0.000002s : 8: predicate.less_batch_normalization 1.53% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000003s : 18: predicate.load_eliminater 1.46% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.46% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.04% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.87% : 0.000003s : 4: predicate.mutable_eliminate 0.74% : 0.000001s : 4: predicate.opt_reshape 2.16% : 0.000003s : 18: predicate.partial_eliminate 1.57% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.38% : 0.000002s : 12: predicate.reshape_eliminate 1.73% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.02% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.97% : 0.000010s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.13% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.45% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 1.14% : 0.000002s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002092 22 67.12% : 0.001404s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.44% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.44% : 0.000658s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.122449 72 0.03% : 0.000038s : 1: add_recomputation 0.07% : 0.000085s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.23% : 0.000280s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.99% : 0.007336s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000059s : 1: jit_opt_b 0.36% : 0.000446s : 1: loop_unroll 0.53% : 0.000654s : 1: mutable_eliminate 0.79% : 0.000972s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000043s : 4: opt.transform.symbol_engine_opt 0.43% : 0.000523s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000527s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.43% : 0.001754s : 1: renormalize.infer 0.58% : 0.000713s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.02% : 0.000031s : 1: rewriter_after_opt_a 0.08% : 0.000092s : 1: rewriter_before_opt_a 0.07% : 0.000085s : 1: symbol_engine_optimizer 88.48% : 0.108339s : 1: type_inference TotalTime = 0.120021, [30] [bootstrap]: 0.00028149 [type_inference]: 0.108813 [event_method]: 1.896e-05 [auto_monad]: 7.137e-05 [graph_reusing]: 5.99999e-06 [pre_auto_parallel]: 2.44001e-06 [py_interpret_to_execute]: 0.00053037 [rewriter_before_opt_a]: 9.089e-05 [expand_dump_flag]: 3.53e-06 [jit_opt_a]: 0.00776519, [2] [Cycle 1]: 0.00366413, [27] [switch_simplify]: 6.025e-05 [loop_unroll]: 3.054e-05 [a_1]: 0.00059038 [with_stream_mark]: 1.826e-05 [recompute_prepare]: 8.47e-06 [updatestate_depend_eliminate]: 4.27e-06 [updatestate_assign_eliminate]: 3.16999e-06 [updatestate_loads_eliminate]: 2.93e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 7.05002e-06 [updatestate_useless_node_eliminater]: 5.97999e-06 [accelerated_algorithm]: 6.29001e-06 [meta_shard_fg_expand]: 2.64999e-06 [get_grad_eliminate_]: 6.61999e-06 [merge_forward]: 4.54998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 1.016e-05 [meta_fg_expand]: 2.49001e-06 [replace_old_param]: 1.011e-05 [inline_without_move]: 6.07999e-06 [renormalize]: 0.00262133 [add_forward_monad_depend]: 6.19999e-06 [auto_monad_grad]: 1.28002e-06 [auto_monad_eliminator]: 1.372e-05 [cse]: 2.148e-05 [replace_applicator]: 1.577e-05 [Cycle 2]: 0.00037371, [27] [switch_simplify]: 6.44001e-06 [loop_unroll]: 6.38998e-06 [a_1]: 0.00012852 [with_stream_mark]: 1.089e-05 [recompute_prepare]: 6.00002e-06 [updatestate_depend_eliminate]: 3.38999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.24e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.72999e-06 [get_grad_eliminate_]: 5.56998e-06 [merge_forward]: 3.09001e-06 [cell_reuse_recompute_pass]: 2.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.476e-05 [j_node_and_user_rematch]: 9.62999e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 9.87999e-06 [inline_without_move]: 5.44e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.38002e-06 [auto_monad_grad]: 7.30011e-07 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.162e-05 [replace_applicator]: 5.73002e-06 [py_interpret_to_execute_after_opt_a]: 1.073e-05 [rewriter_after_opt_a]: 2.846e-05 [convert_after_rewriter]: 6.956e-05 [order_py_execute_after_rewriter]: 5.37001e-06 [mutable_eliminate]: 0.00065262 [jit_opt_b]: 5.922e-05, [1] [Cycle 1]: 5.263e-05, [2] [frontend_op_eliminate]: 2.173e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 1.894e-05 [loop_unroll]: 0.00043134 [jit_opt_after_cconv]: 0.00015177, [1] [Cycle 1]: 0.00014537, [11] [c_1]: 2.706e-05 [parameter_eliminate]: 3.03e-06 [updatestate_depend_eliminate]: 5.71e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 3.15998e-06 [cse]: 2.096e-05 [call_graph_tuple_transform]: 1.915e-05 [tuple_list_get_item_eliminator]: 6.24999e-06 [none_parameter_eliminate]: 9.39996e-07 [renormalize]: 2.89991e-07 [switch_simplify]: 6.09001e-06 [remove_dup_value]: 8.82999e-06 [partial_unused_args_eliminate]: 1.39e-06 [environ_conv]: 5.34e-06 [add_recomputation]: 3.286e-05 [cse_after_recomputation]: 2.387e-05, [1] [Cycle 1]: 1.91e-05, [1] [cse]: 1.342e-05 [auto_monad_reorder]: 1.034e-05 [get_jit_bprop_graph]: 3.88999e-06 [rewriter_after_jit_bprop_graph]: 5.95002e-06 [opt_after_jit_grad]: 0.00048997 [symbol_engine_optimizer]: 0.00020444, [1] [Cycle 1]: 0.00019791, [6] [build]: 3.08e-06 [elim_shapecalc]: 1.067e-05 [elim_not_effective]: 0.0001374 [opt_reshape]: 7.15998e-06 [fold_const_symbol]: 1.014e-05 [renormalize]: 5.00004e-07 [validate]: 3.837e-05 Sums bootstrap : 0.000281s : 0.24% type_inference : 0.108813s : 94.05% event_method : 0.000019s : 0.02% auto_monad : 0.000071s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000530s : 0.46% rewriter_before_opt_a : 0.000091s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000067s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000719s : 0.62% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002621s : 2.27% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000033s : 0.03% jit_opt_a.replace_applicator : 0.000022s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000028s : 0.02% convert_after_rewriter : 0.000070s : 0.06% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000653s : 0.56% jit_opt_b.frontend_op_eliminate : 0.000022s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000019s : 0.02% loop_unroll : 0.000431s : 0.37% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000005s : 0.00% add_recomputation : 0.000033s : 0.03% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000004s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000490s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000011s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000137s : 0.12% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000038s : 0.03% Time group info: ------[substitution.] 0.000341 24 36.41% : 0.000124s : 2: substitution.elim_not_effective 0.31% : 0.000001s : 2: substitution.fold_const_symbol 1.28% : 0.000004s : 4: substitution.graph_param_transform 53.31% : 0.000182s : 4: substitution.inline 1.33% : 0.000005s : 4: substitution.j_node_and_user_rematch 1.84% : 0.000006s : 4: substitution.remove_not_recompute_node 1.65% : 0.000006s : 2: substitution.replace_old_param 3.87% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.108737 2 97.50% : 0.106022s : 1: type_inference.infer 2.50% : 0.002715s : 1: type_inference.specialize ------[replace.] 0.000079 6 67.27% : 0.000053s : 4: replace.inline 32.73% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000191 6 93.70% : 0.000179s : 4: match.inline 6.30% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.53% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000002s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.04% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.84% : 0.000003s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_depend_swap 1.22% : 0.000002s : 12: predicate.environ_get_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.26% : 0.000000s : 4: predicate.graph_param_transform 5.17% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.05% : 0.000003s : 18: predicate.load_eliminater 1.21% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.67% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.01% : 0.000001s : 12: predicate.merge_addn 1.30% : 0.000002s : 12: predicate.minmaximum_grad 1.37% : 0.000002s : 4: predicate.mutable_eliminate 0.76% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.35% : 0.000002s : 12: predicate.print_const_string_wrapper 2.03% : 0.000003s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 1.97% : 0.000003s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 0.97% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.53% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.60% : 0.000004s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.62% : 0.000009s : 58: predicate.switch_simplify 1.31% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002059 22 67.29% : 0.001385s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.71% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.00% : 0.000638s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.123804 72 0.03% : 0.000036s : 1: add_recomputation 0.06% : 0.000075s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.24% : 0.000296s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.06% : 0.000072s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000007s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000006s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.28% : 0.007769s : 1: jit_opt_a 0.12% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000062s : 1: jit_opt_b 0.36% : 0.000440s : 1: loop_unroll 0.53% : 0.000662s : 1: mutable_eliminate 0.78% : 0.000960s : 26: opt.transform.jit_opt_a 0.04% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000162s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000500s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000537s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.54% : 0.001907s : 1: renormalize.infer 0.57% : 0.000705s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.08% : 0.000096s : 1: rewriter_before_opt_a 0.17% : 0.000208s : 1: symbol_engine_optimizer 87.91% : 0.108833s : 1: type_inference TotalTime = 0.0624271, [30] [bootstrap]: 0.00028376 [type_inference]: 0.0527404 [event_method]: 1.744e-05 [auto_monad]: 6.755e-05 [graph_reusing]: 6.53e-06 [pre_auto_parallel]: 2.32999e-06 [py_interpret_to_execute]: 0.00027405 [rewriter_before_opt_a]: 8.147e-05 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.00667082, [2] [Cycle 1]: 0.00299584, [27] [switch_simplify]: 5.54e-05 [loop_unroll]: 3.068e-05 [a_1]: 0.00056781 [with_stream_mark]: 1.485e-05 [recompute_prepare]: 8.68001e-06 [updatestate_depend_eliminate]: 3.51001e-06 [updatestate_assign_eliminate]: 2.93998e-06 [updatestate_loads_eliminate]: 2.54001e-06 [parameter_eliminate]: 2.03997e-06 [specialize_transform]: 6.86001e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.38e-06 [meta_shard_fg_expand]: 2.39999e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 4.09997e-06 [cell_reuse_recompute_pass]: 1.30001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.521e-05 [j_node_and_user_rematch]: 1.097e-05 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.57001e-06 [inline_without_move]: 6.24001e-06 [renormalize]: 0.00199519 [add_forward_monad_depend]: 6.34999e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.632e-05 [cse]: 2.341e-05 [replace_applicator]: 1.563e-05 [Cycle 2]: 0.00036729, [27] [switch_simplify]: 6.89999e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00012443 [with_stream_mark]: 1.084e-05 [recompute_prepare]: 6.24001e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 3.95998e-06 [cell_reuse_recompute_pass]: 2.26e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.572e-05 [j_node_and_user_rematch]: 8.72e-06 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 8.99998e-06 [inline_without_move]: 5.42999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 8.70001e-07 [auto_monad_eliminator]: 5.67001e-06 [cse]: 1.171e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 1.184e-05 [rewriter_after_opt_a]: 3.391e-05 [convert_after_rewriter]: 7.31999e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00065366 [jit_opt_b]: 5.352e-05, [1] [Cycle 1]: 4.679e-05, [2] [frontend_op_eliminate]: 1.852e-05 [inline_after_opt_a]: 1.781e-05 [cconv]: 2.317e-05 [loop_unroll]: 0.00042374 [jit_opt_after_cconv]: 0.00014546, [1] [Cycle 1]: 0.00013951, [11] [c_1]: 2.582e-05 [parameter_eliminate]: 1.94e-06 [updatestate_depend_eliminate]: 4.50001e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 2.048e-05 [call_graph_tuple_transform]: 2.004e-05 [tuple_list_get_item_eliminator]: 6.44001e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 6.33e-06 [remove_dup_value]: 1.489e-05 [partial_unused_args_eliminate]: 2.22999e-06 [environ_conv]: 7.47002e-06 [add_recomputation]: 4.5e-05 [cse_after_recomputation]: 2.19e-05, [1] [Cycle 1]: 1.696e-05, [1] [cse]: 1.144e-05 [auto_monad_reorder]: 1.59e-05 [get_jit_bprop_graph]: 1.36998e-06 [rewriter_after_jit_bprop_graph]: 4.62998e-06 [opt_after_jit_grad]: 0.00048349 [symbol_engine_optimizer]: 0.0001148, [1] [Cycle 1]: 0.00010852, [6] [build]: 3.34001e-06 [elim_shapecalc]: 4.476e-05 [elim_not_effective]: 1.405e-05 [opt_reshape]: 6.87002e-06 [fold_const_symbol]: 1e-05 [renormalize]: 4.89992e-07 [validate]: 4.52e-05 Sums bootstrap : 0.000284s : 0.48% type_inference : 0.052740s : 90.06% event_method : 0.000017s : 0.03% auto_monad : 0.000068s : 0.12% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000274s : 0.47% rewriter_before_opt_a : 0.000081s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000062s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.06% jit_opt_a.a_1 : 0.000692s : 1.18% jit_opt_a.with_stream_mark : 0.000026s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000031s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001995s : 3.41% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000035s : 0.06% jit_opt_a.replace_applicator : 0.000021s : 0.04% py_interpret_to_execute_after_opt_a : 0.000012s : 0.02% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000654s : 1.12% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000424s : 0.72% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000483s : 0.83% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000045s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000045s : 0.08% Time group info: ------[substitution.] 0.000201 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.99% : 0.000006s : 4: substitution.graph_param_transform 81.95% : 0.000165s : 4: substitution.inline 1.84% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.74% : 0.000006s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 6.56% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052666 2 96.52% : 0.050833s : 1: type_inference.infer 3.48% : 0.001833s : 1: type_inference.specialize ------[replace.] 0.000071 6 65.75% : 0.000047s : 4: replace.inline 34.25% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.15% : 0.000162s : 4: match.inline 6.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.21% : 0.000002s : 12: predicate.accumulaten_eliminater 1.36% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000002s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.93% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.71% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.35% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.59% : 0.000001s : 4: predicate.graph_param_transform 5.21% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.22% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.91% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.06% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.51% : 0.000002s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000002s : 12: predicate.print_const_string_wrapper 1.86% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 18: predicate.switch_defer_inline 2.01% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.40% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002147 26 72.05% : 0.001547s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.59% : 0.000571s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065421 72 0.07% : 0.000048s : 1: add_recomputation 0.11% : 0.000071s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.45% : 0.000296s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.20% : 0.006674s : 1: jit_opt_a 0.23% : 0.000148s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.66% : 0.000430s : 1: loop_unroll 1.01% : 0.000663s : 1: mutable_eliminate 1.42% : 0.000927s : 26: opt.transform.jit_opt_a 0.08% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000491s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.43% : 0.000280s : 1: py_interpret_to_execute 0.02% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 2.07% : 0.001352s : 1: renormalize.infer 0.97% : 0.000635s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000037s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.18% : 0.000118s : 1: symbol_engine_optimizer 80.64% : 0.052754s : 1: type_inference TotalTime = 0.0627178, [30] [bootstrap]: 0.00029114 [type_inference]: 0.0527277 [event_method]: 1.779e-05 [auto_monad]: 6.897e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00032776 [rewriter_before_opt_a]: 8.298e-05 [expand_dump_flag]: 3.53999e-06 [jit_opt_a]: 0.0068912, [2] [Cycle 1]: 0.0030934, [27] [switch_simplify]: 5.958e-05 [loop_unroll]: 3.028e-05 [a_1]: 0.00064052 [with_stream_mark]: 1.803e-05 [recompute_prepare]: 8.75999e-06 [updatestate_depend_eliminate]: 3.81001e-06 [updatestate_assign_eliminate]: 3.2e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.16001e-06 [updatestate_useless_node_eliminater]: 6.02999e-06 [accelerated_algorithm]: 6.78998e-06 [meta_shard_fg_expand]: 2.36e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.733e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 1.002e-05 [inline_without_move]: 6.64999e-06 [renormalize]: 0.00198617 [add_forward_monad_depend]: 7.76001e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.723e-05 [cse]: 3.285e-05 [replace_applicator]: 1.758e-05 [Cycle 2]: 0.00037073, [27] [switch_simplify]: 6.45997e-06 [loop_unroll]: 5.67999e-06 [a_1]: 0.0001237 [with_stream_mark]: 1.094e-05 [recompute_prepare]: 5.84999e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 2.36998e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.56002e-06 [accelerated_algorithm]: 5.89e-06 [meta_shard_fg_expand]: 2.07001e-06 [get_grad_eliminate_]: 5.16002e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.91998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.595e-05 [j_node_and_user_rematch]: 9.15999e-06 [meta_fg_expand]: 1.81003e-06 [replace_old_param]: 8.84998e-06 [inline_without_move]: 5.40001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.24998e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.59998e-06 [cse]: 1.263e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 1.08e-05 [rewriter_after_opt_a]: 3.399e-05 [convert_after_rewriter]: 7.63001e-06 [order_py_execute_after_rewriter]: 5.13002e-06 [mutable_eliminate]: 0.00066779 [jit_opt_b]: 5.613e-05, [1] [Cycle 1]: 4.834e-05, [2] [frontend_op_eliminate]: 1.97e-05 [inline_after_opt_a]: 1.78e-05 [cconv]: 2.735e-05 [loop_unroll]: 0.00043761 [jit_opt_after_cconv]: 0.00015548, [1] [Cycle 1]: 0.00014882, [11] [c_1]: 2.636e-05 [parameter_eliminate]: 3.83999e-06 [updatestate_depend_eliminate]: 6.21e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.01998e-06 [cse]: 2.42e-05 [call_graph_tuple_transform]: 2.091e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.632e-05 [partial_unused_args_eliminate]: 2.17001e-06 [environ_conv]: 8.50999e-06 [add_recomputation]: 4.759e-05 [cse_after_recomputation]: 2.154e-05, [1] [Cycle 1]: 1.662e-05, [1] [cse]: 1.1e-05 [auto_monad_reorder]: 1.604e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 5.64998e-06 [opt_after_jit_grad]: 0.00045511 [symbol_engine_optimizer]: 7.558e-05, [1] [Cycle 1]: 6.927e-05, [6] [build]: 3.08e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.367e-05 [opt_reshape]: 7.28999e-06 [fold_const_symbol]: 9.47999e-06 [renormalize]: 3.60014e-07 [validate]: 6.457e-05 Sums bootstrap : 0.000291s : 0.50% type_inference : 0.052728s : 89.82% event_method : 0.000018s : 0.03% auto_monad : 0.000069s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000328s : 0.56% rewriter_before_opt_a : 0.000083s : 0.14% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000066s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000764s : 1.30% jit_opt_a.with_stream_mark : 0.000029s : 0.05% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000013s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000005s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001986s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.04% jit_opt_a.cse : 0.000045s : 0.08% jit_opt_a.replace_applicator : 0.000023s : 0.04% py_interpret_to_execute_after_opt_a : 0.000011s : 0.02% rewriter_after_opt_a : 0.000034s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000668s : 1.14% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000027s : 0.05% loop_unroll : 0.000438s : 0.75% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000455s : 0.78% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000065s : 0.11% Time group info: ------[substitution.] 0.000265 24 0.82% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000002s : 2: substitution.fold_const_symbol 2.18% : 0.000006s : 4: substitution.graph_param_transform 86.50% : 0.000230s : 4: substitution.inline 1.41% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.31% : 0.000006s : 4: substitution.remove_not_recompute_node 1.56% : 0.000004s : 2: substitution.replace_old_param 4.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052655 2 96.46% : 0.050793s : 1: type_inference.infer 3.54% : 0.001862s : 1: type_inference.specialize ------[replace.] 0.000074 6 67.94% : 0.000050s : 4: replace.inline 32.06% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000238 6 95.29% : 0.000227s : 4: match.inline 4.71% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.40% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.48% : 0.000002s : 12: predicate.addn_zero_filter 1.80% : 0.000002s : 12: predicate.arithmetic_simplify 1.15% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.18% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.46% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.14% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.49% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 0.97% : 0.000001s : 8: predicate.get_grad_eliminate 0.44% : 0.000001s : 4: predicate.graph_param_transform 4.87% : 0.000007s : 26: predicate.inline 0.85% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.11% : 0.000003s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.75% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000002s : 12: predicate.merge_addn 1.02% : 0.000001s : 12: predicate.minmaximum_grad 2.04% : 0.000003s : 4: predicate.mutable_eliminate 0.87% : 0.000001s : 4: predicate.opt_reshape 2.50% : 0.000003s : 18: predicate.partial_eliminate 1.14% : 0.000002s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.38% : 0.000002s : 8: predicate.remove_not_recompute_node 2.29% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.32% : 0.000000s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.19% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.89% : 0.000001s : 4: predicate.row_tensor_eliminate 1.10% : 0.000001s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.38% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.05% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.02% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.88% : 0.000003s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.72% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.47% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002199 26 72.12% : 0.001586s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.52% : 0.000583s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065761 72 0.08% : 0.000050s : 1: add_recomputation 0.11% : 0.000073s : 1: auto_monad 0.03% : 0.000019s : 1: auto_monad_reorder 0.46% : 0.000304s : 1: bootstrap 0.07% : 0.000044s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.48% : 0.006895s : 1: jit_opt_a 0.24% : 0.000158s : 1: jit_opt_after_cconv 0.09% : 0.000059s : 1: jit_opt_b 0.68% : 0.000446s : 1: loop_unroll 1.03% : 0.000677s : 1: mutable_eliminate 1.53% : 0.001005s : 26: opt.transform.jit_opt_a 0.08% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000016s : 1: opt.transform.mutable_eliminate 0.04% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000462s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.51% : 0.000335s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.05% : 0.001351s : 1: renormalize.infer 0.95% : 0.000626s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000037s : 1: rewriter_after_opt_a 0.13% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000078s : 1: symbol_engine_optimizer 80.20% : 0.052740s : 1: type_inference TotalTime = 0.0134301, [30] [bootstrap]: 0.00026634 [type_inference]: 0.00442345 [event_method]: 1.862e-05 [auto_monad]: 6.335e-05 [graph_reusing]: 5.61998e-06 [pre_auto_parallel]: 1.82001e-06 [py_interpret_to_execute]: 4.684e-05 [rewriter_before_opt_a]: 7.186e-05 [expand_dump_flag]: 3.33e-06 [jit_opt_a]: 0.00642845, [2] [Cycle 1]: 0.00274822, [27] [switch_simplify]: 4.935e-05 [loop_unroll]: 3.155e-05 [a_1]: 0.00160218 [with_stream_mark]: 1.838e-05 [recompute_prepare]: 8.30999e-06 [updatestate_depend_eliminate]: 3.48999e-06 [updatestate_assign_eliminate]: 3.00998e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 6.14001e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 2.59999e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 3.56001e-06 [cell_reuse_recompute_pass]: 1.13001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.443e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.70999e-06 [inline_without_move]: 7.28999e-06 [renormalize]: 0.00072328 [add_forward_monad_depend]: 5.81003e-06 [auto_monad_grad]: 2.14999e-06 [auto_monad_eliminator]: 1.542e-05 [cse]: 2.441e-05 [replace_applicator]: 1.227e-05 [Cycle 2]: 0.00031726, [27] [switch_simplify]: 5.52999e-06 [loop_unroll]: 4.95001e-06 [a_1]: 8.983e-05 [with_stream_mark]: 9.77999e-06 [recompute_prepare]: 5.24998e-06 [updatestate_depend_eliminate]: 3.11001e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 4.93001e-06 [updatestate_useless_node_eliminater]: 4.75001e-06 [accelerated_algorithm]: 4.73001e-06 [meta_shard_fg_expand]: 1.40999e-06 [get_grad_eliminate_]: 4.53999e-06 [merge_forward]: 3.3e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.442e-05 [j_node_and_user_rematch]: 8.13001e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.35e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 1.10001e-06 [auto_monad_eliminator]: 6.04999e-06 [cse]: 1.038e-05 [replace_applicator]: 4.87e-06 [py_interpret_to_execute_after_opt_a]: 1.208e-05 [rewriter_after_opt_a]: 3.32e-05 [convert_after_rewriter]: 7.1e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00057468 [jit_opt_b]: 4.896e-05, [1] [Cycle 1]: 4.229e-05, [2] [frontend_op_eliminate]: 1.607e-05 [inline_after_opt_a]: 1.544e-05 [cconv]: 2.256e-05 [loop_unroll]: 0.00040532 [jit_opt_after_cconv]: 0.00015296, [1] [Cycle 1]: 0.0001467, [11] [c_1]: 2.137e-05 [parameter_eliminate]: 2.12999e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.04999e-06 [cse]: 1.8e-05 [call_graph_tuple_transform]: 1.877e-05 [tuple_list_get_item_eliminator]: 1.827e-05 [none_parameter_eliminate]: 2.16e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.89e-06 [remove_dup_value]: 1.436e-05 [partial_unused_args_eliminate]: 1.361e-05 [environ_conv]: 5.34998e-06 [add_recomputation]: 4.885e-05 [cse_after_recomputation]: 2.299e-05, [1] [Cycle 1]: 1.71e-05, [1] [cse]: 1.064e-05 [auto_monad_reorder]: 1.55e-05 [get_jit_bprop_graph]: 1.86e-06 [rewriter_after_jit_bprop_graph]: 5.09e-06 [opt_after_jit_grad]: 0.00044966 [symbol_engine_optimizer]: 7.37e-05, [1] [Cycle 1]: 6.701e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 7.71001e-06 [elim_not_effective]: 1.351e-05 [opt_reshape]: 5.79e-06 [fold_const_symbol]: 8.94e-06 [renormalize]: 5.8001e-07 [validate]: 3.452e-05 Sums bootstrap : 0.000266s : 2.80% type_inference : 0.004423s : 46.50% event_method : 0.000019s : 0.20% auto_monad : 0.000063s : 0.67% graph_reusing : 0.000006s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000047s : 0.49% rewriter_before_opt_a : 0.000072s : 0.76% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.58% jit_opt_a.loop_unroll : 0.000036s : 0.38% jit_opt_a.a_1 : 0.001692s : 17.79% jit_opt_a.with_stream_mark : 0.000028s : 0.30% jit_opt_a.recompute_prepare : 0.000014s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.04% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000010s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000007s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.17% jit_opt_a.inline_without_move : 0.000012s : 0.13% jit_opt_a.renormalize : 0.000723s : 7.60% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.23% jit_opt_a.cse : 0.000035s : 0.37% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000012s : 0.13% rewriter_after_opt_a : 0.000033s : 0.35% convert_after_rewriter : 0.000007s : 0.07% order_py_execute_after_rewriter : 0.000005s : 0.05% mutable_eliminate : 0.000575s : 6.04% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.17% jit_opt_b.inline_after_opt_a : 0.000015s : 0.16% cconv : 0.000023s : 0.24% loop_unroll : 0.000405s : 4.26% jit_opt_after_cconv.c_1 : 0.000021s : 0.22% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.05% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000018s : 0.19% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000018s : 0.19% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000014s : 0.15% partial_unused_args_eliminate : 0.000014s : 0.14% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000049s : 0.51% cse_after_recomputation.cse : 0.000011s : 0.11% auto_monad_reorder : 0.000016s : 0.16% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.05% opt_after_jit_grad : 0.000450s : 4.73% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.08% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.14% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.09% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000035s : 0.36% Time group info: ------[substitution.] 0.000237 23 0.83% : 0.000002s : 2: substitution.elim_not_effective 0.58% : 0.000001s : 2: substitution.fold_const_symbol 2.59% : 0.000006s : 3: substitution.graph_param_transform 84.85% : 0.000201s : 4: substitution.inline 1.48% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.24% : 0.000005s : 4: substitution.remove_not_recompute_node 1.74% : 0.000004s : 2: substitution.replace_old_param 5.69% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004330 2 80.38% : 0.003480s : 1: type_inference.infer 19.62% : 0.000850s : 1: type_inference.specialize ------[replace.] 0.000081 6 68.42% : 0.000055s : 4: replace.inline 31.58% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000210 6 94.16% : 0.000198s : 4: match.inline 5.84% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.001128 691 0.16% : 0.000002s : 10: predicate.accumulaten_eliminater 0.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.11% : 0.000001s : 10: predicate.addn_check_dump 0.19% : 0.000002s : 10: predicate.addn_zero_filter 0.26% : 0.000003s : 10: predicate.arithmetic_simplify 89.43% : 0.001009s : 10: predicate.cast_eliminate 0.04% : 0.000000s : 3: predicate.check_bprop_eliminate 0.11% : 0.000001s : 10: predicate.compare_switch_simplify 0.13% : 0.000001s : 10: predicate.depend_value_elim 0.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 0.12% : 0.000001s : 10: predicate.dict_get_item_eliminator 0.12% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.09% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.04% : 0.000000s : 3: predicate.elim_not_effective 0.05% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 0.12% : 0.000001s : 10: predicate.environ_add_const_eliminate 0.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.11% : 0.000001s : 10: predicate.environ_get_depend_swap 0.12% : 0.000001s : 10: predicate.environ_get_eliminate 0.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.02% : 0.000000s : 3: predicate.fold_const_symbol 0.11% : 0.000001s : 6: predicate.get_grad_eliminate 0.03% : 0.000000s : 3: predicate.graph_param_transform 0.61% : 0.000007s : 22: predicate.inline 0.14% : 0.000002s : 6: predicate.inline_without_move 0.04% : 0.000000s : 6: predicate.j_node_and_user_rematch 0.13% : 0.000001s : 6: predicate.less_batch_normalization 0.20% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 0.20% : 0.000002s : 15: predicate.load_eliminater 0.12% : 0.000001s : 3: predicate.loop_unroll_after_grad 0.44% : 0.000005s : 34: predicate.loop_unroll_before_grad 0.23% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.12% : 0.000001s : 10: predicate.merge_addn 0.12% : 0.000001s : 10: predicate.minmaximum_grad 0.14% : 0.000002s : 3: predicate.mutable_eliminate 0.05% : 0.000001s : 3: predicate.opt_reshape 0.21% : 0.000002s : 15: predicate.partial_eliminate 0.12% : 0.000001s : 10: predicate.print_const_string_wrapper 0.20% : 0.000002s : 10: predicate.reduce_eliminate 0.16% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.09% : 0.000001s : 6: predicate.remove_not_recompute_node 0.20% : 0.000002s : 18: predicate.replace_applicator 0.08% : 0.000001s : 6: predicate.replace_old_param 0.04% : 0.000000s : 3: predicate.reset_defer_inline 0.21% : 0.000002s : 10: predicate.reshape_eliminate 0.16% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.08% : 0.000001s : 3: predicate.row_tensor_eliminate 0.13% : 0.000001s : 10: predicate.same_eliminate 0.06% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.10% : 0.000001s : 6: predicate.special_op_eliminate 0.10% : 0.000001s : 6: predicate.specialize_transform 0.15% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 0.13% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.05% : 0.000001s : 3: predicate.switch_call_monad_eliminater 0.29% : 0.000003s : 16: predicate.switch_defer_inline 0.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 0.75% : 0.000009s : 53: predicate.switch_simplify 0.12% : 0.000001s : 10: predicate.tile_eliminate 0.14% : 0.000002s : 10: predicate.transpose_eliminate 0.17% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 0.14% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 0.38% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 0.18% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 0.15% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 0.18% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 0.29% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 0.21% : 0.000002s : 10: predicate.value_based_eliminate 0.05% : 0.000001s : 3: predicate.virtual_view_grad_eliminate 0.08% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000579 13 47.79% : 0.000277s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.10% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.11% : 0.000267s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.016129 72 0.32% : 0.000052s : 1: add_recomputation 0.41% : 0.000066s : 1: auto_monad 0.11% : 0.000018s : 1: auto_monad_reorder 1.72% : 0.000278s : 1: bootstrap 0.16% : 0.000025s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.15% : 0.000025s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000008s : 1: graph_reusing 39.88% : 0.006432s : 1: jit_opt_a 0.97% : 0.000156s : 1: jit_opt_after_cconv 0.32% : 0.000052s : 1: jit_opt_b 2.56% : 0.000412s : 1: loop_unroll 3.61% : 0.000582s : 1: mutable_eliminate 11.80% : 0.001903s : 26: opt.transform.jit_opt_a 0.38% : 0.000061s : 4: opt.transform.jit_opt_after_cconv 0.16% : 0.000025s : 4: opt.transform.jit_opt_b 0.07% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000013s : 1: opt.transform.mutable_eliminate 0.13% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.20% : 0.000033s : 4: opt.transform.symbol_engine_opt 2.84% : 0.000457s : 1: opt_after_jit_grad 0.04% : 0.000007s : 1: order_py_execute_after_rewriter 0.10% : 0.000016s : 1: partial_unused_args_eliminate 0.02% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000050s : 1: py_interpret_to_execute 0.09% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000017s : 1: remove_dup_value 2.34% : 0.000377s : 1: renormalize.infer 2.10% : 0.000338s : 1: renormalize.specialize 0.04% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.22% : 0.000036s : 1: rewriter_after_opt_a 0.46% : 0.000075s : 1: rewriter_before_opt_a 0.47% : 0.000076s : 1: symbol_engine_optimizer 27.50% : 0.004435s : 1: type_inference TotalTime = 0.0131841, [30] [bootstrap]: 0.00028464 [type_inference]: 0.00503899 [event_method]: 1.796e-05 [auto_monad]: 6.243e-05 [graph_reusing]: 5.30001e-06 [pre_auto_parallel]: 2.12999e-06 [py_interpret_to_execute]: 4.535e-05 [rewriter_before_opt_a]: 8.396e-05 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.00540579, [2] [Cycle 1]: 0.00166702, [27] [switch_simplify]: 5.386e-05 [loop_unroll]: 3.052e-05 [a_1]: 0.00055055 [with_stream_mark]: 1.645e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.08002e-06 [accelerated_algorithm]: 5.52001e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.302e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.92999e-06 [inline_without_move]: 5.41002e-06 [renormalize]: 0.00071237 [add_forward_monad_depend]: 4.87998e-06 [auto_monad_grad]: 2.74001e-06 [auto_monad_eliminator]: 1.346e-05 [cse]: 2.073e-05 [replace_applicator]: 1.152e-05 [Cycle 2]: 0.00035373, [27] [switch_simplify]: 6.19001e-06 [loop_unroll]: 5.00001e-06 [a_1]: 9.257e-05 [with_stream_mark]: 9.22001e-06 [recompute_prepare]: 4.89998e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.18998e-06 [updatestate_loads_eliminate]: 2.03002e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 5.04e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.28e-05 [j_node_and_user_rematch]: 7.73001e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 7.81001e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.20001e-06 [auto_monad_grad]: 8.39995e-07 [auto_monad_eliminator]: 6.51999e-06 [cse]: 1.163e-05 [replace_applicator]: 5.07e-06 [py_interpret_to_execute_after_opt_a]: 9.70002e-06 [rewriter_after_opt_a]: 3.213e-05 [convert_after_rewriter]: 7.08998e-06 [order_py_execute_after_rewriter]: 5.07999e-06 [mutable_eliminate]: 0.00062407 [jit_opt_b]: 4.982e-05, [1] [Cycle 1]: 4.339e-05, [2] [frontend_op_eliminate]: 1.662e-05 [inline_after_opt_a]: 1.522e-05 [cconv]: 2.581e-05 [loop_unroll]: 0.00044154 [jit_opt_after_cconv]: 0.00014421, [1] [Cycle 1]: 0.00013787, [11] [c_1]: 2.165e-05 [parameter_eliminate]: 2.99999e-06 [updatestate_depend_eliminate]: 5.97999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.61e-06 [cse]: 2.183e-05 [call_graph_tuple_transform]: 1.802e-05 [tuple_list_get_item_eliminator]: 5.64e-06 [none_parameter_eliminate]: 1.63002e-06 [renormalize]: 3.4002e-07 [switch_simplify]: 5.00001e-06 [remove_dup_value]: 1.472e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 5.43002e-06 [add_recomputation]: 5.616e-05 [cse_after_recomputation]: 4.291e-05, [1] [Cycle 1]: 3.65e-05, [1] [cse]: 2.971e-05 [auto_monad_reorder]: 1.536e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 6.39999e-06 [opt_after_jit_grad]: 0.00047685 [symbol_engine_optimizer]: 7.357e-05, [1] [Cycle 1]: 6.721e-05, [6] [build]: 3.78999e-06 [elim_shapecalc]: 8e-06 [elim_not_effective]: 1.223e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 9.30001e-06 [renormalize]: 5.69999e-07 [validate]: 3.675e-05 Sums bootstrap : 0.000285s : 3.09% type_inference : 0.005039s : 54.74% event_method : 0.000018s : 0.20% auto_monad : 0.000062s : 0.68% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000045s : 0.49% rewriter_before_opt_a : 0.000084s : 0.91% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000060s : 0.65% jit_opt_a.loop_unroll : 0.000036s : 0.39% jit_opt_a.a_1 : 0.000643s : 6.99% jit_opt_a.with_stream_mark : 0.000026s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.13% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.12% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.11% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.28% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.18% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.11% jit_opt_a.renormalize : 0.000712s : 7.74% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000004s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.22% jit_opt_a.cse : 0.000032s : 0.35% jit_opt_a.replace_applicator : 0.000017s : 0.18% py_interpret_to_execute_after_opt_a : 0.000010s : 0.11% rewriter_after_opt_a : 0.000032s : 0.35% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000624s : 6.78% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000026s : 0.28% loop_unroll : 0.000442s : 4.80% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000022s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.05% remove_dup_value : 0.000015s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000056s : 0.61% cse_after_recomputation.cse : 0.000030s : 0.32% auto_monad_reorder : 0.000015s : 0.17% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000006s : 0.07% opt_after_jit_grad : 0.000477s : 5.18% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.13% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000001s : 0.01% validate : 0.000037s : 0.40% Time group info: ------[substitution.] 0.000215 23 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000002s : 2: substitution.fold_const_symbol 2.45% : 0.000005s : 3: substitution.graph_param_transform 84.74% : 0.000183s : 4: substitution.inline 1.47% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.32% : 0.000005s : 4: substitution.remove_not_recompute_node 2.33% : 0.000005s : 2: substitution.replace_old_param 5.06% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004974 2 79.94% : 0.003976s : 1: type_inference.infer 20.06% : 0.000998s : 1: type_inference.specialize ------[replace.] 0.000074 6 66.30% : 0.000049s : 4: replace.inline 33.70% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000190 6 94.80% : 0.000180s : 4: match.inline 5.20% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.03% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 0.95% : 0.000001s : 10: predicate.addn_check_dump 1.14% : 0.000001s : 10: predicate.addn_zero_filter 1.96% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.02% : 0.000001s : 10: predicate.compare_switch_simplify 1.30% : 0.000002s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 10: predicate.dict_set_item_eliminator 7.01% : 0.000009s : 3: predicate.dumpgradient_eliminate 0.46% : 0.000001s : 3: predicate.elim_not_effective 0.48% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.88% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 4.87% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.48% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 3.74% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000003s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.46% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.13% : 0.000003s : 15: predicate.partial_eliminate 1.06% : 0.000001s : 10: predicate.print_const_string_wrapper 1.49% : 0.000002s : 10: predicate.reduce_eliminate 1.72% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 6: predicate.remove_not_recompute_node 1.66% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.16% : 0.000001s : 10: predicate.reshape_eliminate 1.23% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.90% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.10% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.42% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.01% : 0.000003s : 16: predicate.switch_layer_defer_inline 6.93% : 0.000009s : 53: predicate.switch_simplify 1.31% : 0.000002s : 10: predicate.tile_eliminate 1.13% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.25% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.30% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.64% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.44% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000681 13 49.03% : 0.000334s : 6: func_graph_cloner_run.FuncGraphClonerGraph 6.31% : 0.000043s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.66% : 0.000304s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014815 72 0.40% : 0.000059s : 1: add_recomputation 0.44% : 0.000065s : 1: auto_monad 0.12% : 0.000018s : 1: auto_monad_reorder 2.02% : 0.000299s : 1: bootstrap 0.19% : 0.000029s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.30% : 0.000045s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.14% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.02% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.51% : 0.005409s : 1: jit_opt_a 0.99% : 0.000147s : 1: jit_opt_after_cconv 0.35% : 0.000052s : 1: jit_opt_b 3.04% : 0.000451s : 1: loop_unroll 4.27% : 0.000633s : 1: mutable_eliminate 5.75% : 0.000852s : 26: opt.transform.jit_opt_a 0.32% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.17% : 0.000026s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000014s : 1: opt.transform.mutable_eliminate 0.20% : 0.000029s : 1: opt.transform.opt_after_jit_grad 0.22% : 0.000032s : 4: opt.transform.symbol_engine_opt 3.28% : 0.000486s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000048s : 1: py_interpret_to_execute 0.08% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000017s : 1: remove_dup_value 2.54% : 0.000376s : 1: renormalize.infer 2.22% : 0.000329s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.23% : 0.000035s : 1: rewriter_after_opt_a 0.59% : 0.000088s : 1: rewriter_before_opt_a 0.51% : 0.000076s : 1: symbol_engine_optimizer 34.09% : 0.005051s : 1: type_inference TotalTime = 0.114042, [30] [bootstrap]: 0.00027683 [type_inference]: 0.103562 [event_method]: 1.79e-05 [auto_monad]: 5.95e-05 [graph_reusing]: 6.19999e-06 [pre_auto_parallel]: 1.97999e-06 [py_interpret_to_execute]: 0.00055432 [rewriter_before_opt_a]: 8.252e-05 [expand_dump_flag]: 3.49001e-06 [jit_opt_a]: 0.00725683, [2] [Cycle 1]: 0.00368407, [27] [switch_simplify]: 4.999e-05 [loop_unroll]: 3.02e-05 [a_1]: 0.0005937 [with_stream_mark]: 1.41e-05 [recompute_prepare]: 9.02999e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 2.47001e-06 [updatestate_loads_eliminate]: 2.69999e-06 [parameter_eliminate]: 1.17999e-06 [specialize_transform]: 6.93e-06 [updatestate_useless_node_eliminater]: 5.89e-06 [accelerated_algorithm]: 6.43e-06 [meta_shard_fg_expand]: 2.21998e-06 [get_grad_eliminate_]: 6.18002e-06 [merge_forward]: 3.21001e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.293e-05 [j_node_and_user_rematch]: 9.57999e-06 [meta_fg_expand]: 2.19001e-06 [replace_old_param]: 9.74e-06 [inline_without_move]: 6.86999e-06 [renormalize]: 0.00265241 [add_forward_monad_depend]: 8.3e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.708e-05 [cse]: 2.985e-05 [replace_applicator]: 1.794e-05 [Cycle 2]: 0.00037497, [27] [switch_simplify]: 7.04001e-06 [loop_unroll]: 5.97999e-06 [a_1]: 0.00012929 [with_stream_mark]: 1.167e-05 [recompute_prepare]: 5.96e-06 [updatestate_depend_eliminate]: 3.44001e-06 [updatestate_assign_eliminate]: 2.36998e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 5.74999e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 3.53999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.512e-05 [j_node_and_user_rematch]: 9.97001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.27998e-06 [inline_without_move]: 5.76003e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 5.92999e-06 [cse]: 1.148e-05 [replace_applicator]: 5.62999e-06 [py_interpret_to_execute_after_opt_a]: 1.036e-05 [rewriter_after_opt_a]: 3.405e-05 [convert_after_rewriter]: 6.54001e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.0006439 [jit_opt_b]: 5.553e-05, [1] [Cycle 1]: 4.787e-05, [2] [frontend_op_eliminate]: 1.942e-05 [inline_after_opt_a]: 1.705e-05 [cconv]: 2.392e-05 [loop_unroll]: 0.00040385 [jit_opt_after_cconv]: 0.00015023, [1] [Cycle 1]: 0.00014291, [11] [c_1]: 2.633e-05 [parameter_eliminate]: 2.43998e-06 [updatestate_depend_eliminate]: 5.91e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.01003e-06 [cse]: 1.922e-05 [call_graph_tuple_transform]: 2.215e-05 [tuple_list_get_item_eliminator]: 6.12999e-06 [none_parameter_eliminate]: 1.32e-06 [renormalize]: 2.59985e-07 [switch_simplify]: 5.98002e-06 [remove_dup_value]: 1.411e-05 [partial_unused_args_eliminate]: 1.89e-06 [environ_conv]: 7.97998e-06 [add_recomputation]: 4.417e-05 [cse_after_recomputation]: 2.052e-05, [1] [Cycle 1]: 1.539e-05, [1] [cse]: 9.81998e-06 [auto_monad_reorder]: 1.468e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 4.75001e-06 [opt_after_jit_grad]: 0.00044395 [symbol_engine_optimizer]: 7.139e-05, [1] [Cycle 1]: 6.526e-05, [6] [build]: 3.56999e-06 [elim_shapecalc]: 7.68999e-06 [elim_not_effective]: 1.244e-05 [opt_reshape]: 5.96e-06 [fold_const_symbol]: 9.48002e-06 [renormalize]: 3.10014e-07 [validate]: 9.569e-05 Sums bootstrap : 0.000277s : 0.25% type_inference : 0.103562s : 93.91% event_method : 0.000018s : 0.02% auto_monad : 0.000059s : 0.05% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000554s : 0.50% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000723s : 0.66% jit_opt_a.with_stream_mark : 0.000026s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000013s : 0.01% jit_opt_a.renormalize : 0.002652s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000644s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000404s : 0.37% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000444s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000096s : 0.09% Time group info: ------[substitution.] 0.000179 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.60% : 0.000001s : 2: substitution.fold_const_symbol 3.57% : 0.000006s : 4: substitution.graph_param_transform 80.82% : 0.000145s : 4: substitution.inline 2.09% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.08% : 0.000006s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 6.53% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.103422 2 97.47% : 0.100801s : 1: type_inference.infer 2.53% : 0.002621s : 1: type_inference.specialize ------[replace.] 0.000071 6 64.95% : 0.000046s : 4: replace.inline 35.05% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 93.08% : 0.000143s : 4: match.inline 6.92% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.34% : 0.000002s : 12: predicate.accumulaten_eliminater 0.95% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.03% : 0.000001s : 12: predicate.addn_check_dump 1.40% : 0.000002s : 12: predicate.addn_zero_filter 2.22% : 0.000003s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.76% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.72% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.00% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.21% : 0.000002s : 8: predicate.less_batch_normalization 1.71% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.20% : 0.000003s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.24% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.37% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000002s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000003s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.01% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.32% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.95% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.75% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.89% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.77% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002096 22 62.15% : 0.001303s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.33% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.52% : 0.000765s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.117663 72 0.04% : 0.000047s : 1: add_recomputation 0.05% : 0.000063s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000290s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.17% : 0.007260s : 1: jit_opt_a 0.13% : 0.000153s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.35% : 0.000412s : 1: loop_unroll 0.56% : 0.000653s : 1: mutable_eliminate 0.81% : 0.000954s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.48% : 0.000561s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000016s : 1: remove_dup_value 1.55% : 0.001829s : 1: renormalize.infer 0.69% : 0.000814s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000087s : 1: rewriter_before_opt_a 0.06% : 0.000074s : 1: symbol_engine_optimizer 88.03% : 0.103578s : 1: type_inference TotalTime = 0.116153, [30] [bootstrap]: 0.00028101 [type_inference]: 0.105566 [event_method]: 1.663e-05 [auto_monad]: 6.704e-05 [graph_reusing]: 5.51e-06 [pre_auto_parallel]: 2.13002e-06 [py_interpret_to_execute]: 0.00048545 [rewriter_before_opt_a]: 8.138e-05 [expand_dump_flag]: 3.22002e-06 [jit_opt_a]: 0.00726198, [2] [Cycle 1]: 0.00354563, [27] [switch_simplify]: 5.338e-05 [loop_unroll]: 3.078e-05 [a_1]: 0.00056192 [with_stream_mark]: 1.652e-05 [recompute_prepare]: 8.28999e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.92002e-06 [updatestate_loads_eliminate]: 3.39001e-06 [parameter_eliminate]: 1.97001e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 4.16001e-06 [cell_reuse_recompute_pass]: 1.37999e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.93e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 2.79999e-06 [replace_old_param]: 1.104e-05 [inline_without_move]: 5.96e-06 [renormalize]: 0.00252185 [add_forward_monad_depend]: 7.54002e-06 [auto_monad_grad]: 2.86999e-06 [auto_monad_eliminator]: 1.838e-05 [cse]: 3.048e-05 [replace_applicator]: 1.834e-05 [Cycle 2]: 0.00037257, [27] [switch_simplify]: 6.65002e-06 [loop_unroll]: 6.04001e-06 [a_1]: 0.00012715 [with_stream_mark]: 1.065e-05 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 3.09001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 1.28002e-06 [specialize_transform]: 5.76998e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.60001e-06 [meta_shard_fg_expand]: 1.74e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 3.14001e-06 [cell_reuse_recompute_pass]: 2.88e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.694e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 1.99e-06 [replace_old_param]: 8.67998e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 6.21e-06 [cse]: 1.235e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 1.183e-05 [rewriter_after_opt_a]: 3.696e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 5.27001e-06 [mutable_eliminate]: 0.00069514 [jit_opt_b]: 5.79e-05, [1] [Cycle 1]: 5.006e-05, [2] [frontend_op_eliminate]: 2.068e-05 [inline_after_opt_a]: 1.858e-05 [cconv]: 2.775e-05 [loop_unroll]: 0.00049095 [jit_opt_after_cconv]: 0.00015674, [1] [Cycle 1]: 0.00015013, [11] [c_1]: 2.578e-05 [parameter_eliminate]: 2.92002e-06 [updatestate_depend_eliminate]: 5.34e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 2.266e-05 [call_graph_tuple_transform]: 2.219e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.78002e-06 [renormalize]: 8.00006e-07 [switch_simplify]: 7.76001e-06 [remove_dup_value]: 1.554e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 8.25e-06 [add_recomputation]: 5.038e-05 [cse_after_recomputation]: 2.209e-05, [1] [Cycle 1]: 1.673e-05, [1] [cse]: 1.017e-05 [auto_monad_reorder]: 1.508e-05 [get_jit_bprop_graph]: 1.99e-06 [rewriter_after_jit_bprop_graph]: 6.22001e-06 [opt_after_jit_grad]: 0.00046585 [symbol_engine_optimizer]: 7.953e-05, [1] [Cycle 1]: 7.351e-05, [6] [build]: 4.30999e-06 [elim_shapecalc]: 8.52e-06 [elim_not_effective]: 1.333e-05 [opt_reshape]: 8.03001e-06 [fold_const_symbol]: 1.067e-05 [renormalize]: 4.19997e-07 [validate]: 4.626e-05 Sums bootstrap : 0.000281s : 0.25% type_inference : 0.105566s : 94.06% event_method : 0.000017s : 0.01% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000485s : 0.43% rewriter_before_opt_a : 0.000081s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000689s : 0.61% jit_opt_a.with_stream_mark : 0.000027s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000046s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002522s : 2.25% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000012s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000695s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000028s : 0.02% loop_unroll : 0.000491s : 0.44% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000008s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000466s : 0.42% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000008s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000206 24 0.99% : 0.000002s : 2: substitution.elim_not_effective 1.47% : 0.000003s : 2: substitution.fold_const_symbol 2.88% : 0.000006s : 4: substitution.graph_param_transform 81.50% : 0.000168s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.87% : 0.000006s : 4: substitution.remove_not_recompute_node 2.40% : 0.000005s : 2: substitution.replace_old_param 6.20% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.105497 2 97.50% : 0.102864s : 1: type_inference.infer 2.50% : 0.002632s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.62% : 0.000048s : 4: replace.inline 33.38% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000177 6 93.43% : 0.000165s : 4: match.inline 6.57% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000135 830 1.49% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 2.10% : 0.000003s : 12: predicate.arithmetic_simplify 1.16% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.50% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.54% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000002s : 8: predicate.less_batch_normalization 1.81% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.33% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.38% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.30% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000003s : 22: predicate.replace_applicator 0.98% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.58% : 0.000002s : 12: predicate.reshape_eliminate 1.46% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.81% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.57% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.27% : 0.000003s : 18: predicate.switch_defer_inline 1.95% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.76% : 0.000009s : 58: predicate.switch_simplify 1.10% : 0.000001s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.52% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.33% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.59% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002042 22 65.01% : 0.001328s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.45% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.54% : 0.000685s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119710 72 0.04% : 0.000053s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000301s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.07% : 0.007265s : 1: jit_opt_a 0.13% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.42% : 0.000500s : 1: loop_unroll 0.59% : 0.000705s : 1: mutable_eliminate 0.77% : 0.000924s : 26: opt.transform.jit_opt_a 0.05% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.04% : 0.000051s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000038s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000492s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000018s : 1: remove_dup_value 1.47% : 0.001758s : 1: renormalize.infer 0.63% : 0.000755s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.07% : 0.000082s : 1: symbol_engine_optimizer 88.20% : 0.105581s : 1: type_inference TotalTime = 0.117799, [30] [bootstrap]: 0.00030872 [type_inference]: 0.106093 [event_method]: 2.027e-05 [auto_monad]: 0.00011287 [graph_reusing]: 6.17001e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00056251 [rewriter_before_opt_a]: 0.00010315 [expand_dump_flag]: 4.10998e-06 [jit_opt_a]: 0.00813705, [2] [Cycle 1]: 0.00380656, [27] [switch_simplify]: 6.106e-05 [loop_unroll]: 3.007e-05 [a_1]: 0.00058892 [with_stream_mark]: 1.634e-05 [recompute_prepare]: 8.77e-06 [updatestate_depend_eliminate]: 4.07e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 2.09999e-06 [specialize_transform]: 7.66999e-06 [updatestate_useless_node_eliminater]: 6.73003e-06 [accelerated_algorithm]: 6.88e-06 [meta_shard_fg_expand]: 1.97999e-06 [get_grad_eliminate_]: 7.42998e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.69e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.653e-05 [j_node_and_user_rematch]: 1.147e-05 [meta_fg_expand]: 2.39999e-06 [replace_old_param]: 1.073e-05 [inline_without_move]: 6.34001e-06 [renormalize]: 0.00272925 [add_forward_monad_depend]: 7.06001e-06 [auto_monad_grad]: 2.37999e-06 [auto_monad_eliminator]: 1.767e-05 [cse]: 3.235e-05 [replace_applicator]: 1.989e-05 [Cycle 2]: 0.00038431, [27] [switch_simplify]: 7.38e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.0001305 [with_stream_mark]: 1.268e-05 [recompute_prepare]: 6.61e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.62001e-06 [parameter_eliminate]: 1.37e-06 [specialize_transform]: 5.80002e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 1.81003e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 3.25002e-06 [cell_reuse_recompute_pass]: 3.7e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.7e-05 [j_node_and_user_rematch]: 9.46003e-06 [meta_fg_expand]: 1.85001e-06 [replace_old_param]: 9.05999e-06 [inline_without_move]: 5.65001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 6.40002e-06 [cse]: 1.2e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 1.28e-05 [rewriter_after_opt_a]: 3.581e-05 [convert_after_rewriter]: 4.228e-05 [order_py_execute_after_rewriter]: 5.61e-06 [mutable_eliminate]: 0.00070774 [jit_opt_b]: 5.745e-05, [1] [Cycle 1]: 5.017e-05, [2] [frontend_op_eliminate]: 2.034e-05 [inline_after_opt_a]: 1.784e-05 [cconv]: 2.641e-05 [loop_unroll]: 0.00042864 [jit_opt_after_cconv]: 0.00015532, [1] [Cycle 1]: 0.00014917, [11] [c_1]: 2.654e-05 [parameter_eliminate]: 1.94999e-06 [updatestate_depend_eliminate]: 4.56002e-06 [updatestate_assign_eliminate]: 2.43002e-06 [updatestate_loads_eliminate]: 4.2e-06 [cse]: 2.305e-05 [call_graph_tuple_transform]: 2.136e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.32999e-06 [renormalize]: 7.90023e-07 [switch_simplify]: 6.36e-06 [remove_dup_value]: 1.593e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 6.93e-06 [add_recomputation]: 4.98e-05 [cse_after_recomputation]: 2.378e-05, [1] [Cycle 1]: 1.816e-05, [1] [cse]: 1.264e-05 [auto_monad_reorder]: 1.576e-05 [get_jit_bprop_graph]: 3.27997e-06 [rewriter_after_jit_bprop_graph]: 5.17999e-06 [opt_after_jit_grad]: 0.00056238 [symbol_engine_optimizer]: 7.616e-05, [1] [Cycle 1]: 6.954e-05, [6] [build]: 3.44001e-06 [elim_shapecalc]: 8.16002e-06 [elim_not_effective]: 1.329e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 1.043e-05 [renormalize]: 5.09986e-07 [validate]: 4.122e-05 Sums bootstrap : 0.000309s : 0.27% type_inference : 0.106093s : 93.68% event_method : 0.000020s : 0.02% auto_monad : 0.000113s : 0.10% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000563s : 0.50% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000068s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000719s : 0.64% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000013s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000005s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000021s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002729s : 2.41% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000026s : 0.02% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000036s : 0.03% convert_after_rewriter : 0.000042s : 0.04% order_py_execute_after_rewriter : 0.000006s : 0.00% mutable_eliminate : 0.000708s : 0.62% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000429s : 0.38% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000050s : 0.04% cse_after_recomputation.cse : 0.000013s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000562s : 0.50% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000041s : 0.04% Time group info: ------[substitution.] 0.000211 24 0.90% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 3.13% : 0.000007s : 4: substitution.graph_param_transform 81.00% : 0.000171s : 4: substitution.inline 2.19% : 0.000005s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000006s : 4: substitution.remove_not_recompute_node 2.69% : 0.000006s : 2: substitution.replace_old_param 6.49% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106005 2 97.43% : 0.103283s : 1: type_inference.infer 2.57% : 0.002721s : 1: type_inference.specialize ------[replace.] 0.000072 6 66.72% : 0.000048s : 4: replace.inline 33.28% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000181 6 93.15% : 0.000169s : 4: match.inline 6.85% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000139 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.06% : 0.000001s : 12: predicate.addn_check_dump 1.54% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.21% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.38% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.68% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000001s : 4: predicate.elim_not_effective 0.46% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_depend_swap 1.14% : 0.000002s : 12: predicate.environ_get_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000002s : 8: predicate.get_grad_eliminate 0.49% : 0.000001s : 4: predicate.graph_param_transform 5.21% : 0.000007s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000003s : 18: predicate.load_eliminater 1.14% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000006s : 36: predicate.loop_unroll_before_grad 2.14% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000002s : 12: predicate.minmaximum_grad 1.09% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.32% : 0.000003s : 18: predicate.partial_eliminate 1.46% : 0.000002s : 12: predicate.print_const_string_wrapper 2.17% : 0.000003s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.23% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.36% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.26% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.59% : 0.000002s : 12: predicate.transpose_eliminate 1.63% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.71% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.60% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.94% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.40% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002320 22 65.46% : 0.001519s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000034s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.08% : 0.000767s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.121568 72 0.04% : 0.000052s : 1: add_recomputation 0.10% : 0.000118s : 1: auto_monad 0.01% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000320s : 1: bootstrap 0.02% : 0.000029s : 1: cconv 0.04% : 0.000045s : 1: convert_after_rewriter 0.02% : 0.000026s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.70% : 0.008140s : 1: jit_opt_a 0.13% : 0.000158s : 1: jit_opt_after_cconv 0.05% : 0.000060s : 1: jit_opt_b 0.36% : 0.000435s : 1: loop_unroll 0.59% : 0.000716s : 1: mutable_eliminate 0.80% : 0.000970s : 26: opt.transform.jit_opt_a 0.05% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000032s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.47% : 0.000570s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.47% : 0.000571s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.55% : 0.001883s : 1: renormalize.infer 0.69% : 0.000837s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000039s : 1: rewriter_after_opt_a 0.09% : 0.000109s : 1: rewriter_before_opt_a 0.06% : 0.000079s : 1: symbol_engine_optimizer 87.28% : 0.106108s : 1: type_inference TotalTime = 0.0682675, [30] [bootstrap]: 0.00030175 [type_inference]: 0.0573992 [event_method]: 1.901e-05 [auto_monad]: 6.851e-05 [graph_reusing]: 5.59e-06 [pre_auto_parallel]: 2.17001e-06 [py_interpret_to_execute]: 0.00030772 [rewriter_before_opt_a]: 8.525e-05 [expand_dump_flag]: 3.72002e-06 [jit_opt_a]: 0.00756786, [2] [Cycle 1]: 0.0034665, [27] [switch_simplify]: 6.322e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00062823 [with_stream_mark]: 2.384e-05 [recompute_prepare]: 9.49999e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.38999e-06 [updatestate_loads_eliminate]: 3.16001e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 7.07002e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.66e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.27001e-06 [merge_forward]: 3.85e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.563e-05 [j_node_and_user_rematch]: 1.022e-05 [meta_fg_expand]: 2.41e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.00235497 [add_forward_monad_depend]: 6.88e-06 [auto_monad_grad]: 2.31e-06 [auto_monad_eliminator]: 1.821e-05 [cse]: 3.524e-05 [replace_applicator]: 1.983e-05 [Cycle 2]: 0.00037707, [27] [switch_simplify]: 6.96001e-06 [loop_unroll]: 5.92999e-06 [a_1]: 0.00012812 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 5.74999e-06 [updatestate_depend_eliminate]: 3.04999e-06 [updatestate_assign_eliminate]: 2.44999e-06 [updatestate_loads_eliminate]: 2.61e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.60001e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 2.83998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.689e-05 [j_node_and_user_rematch]: 8.98002e-06 [meta_fg_expand]: 2.02999e-06 [replace_old_param]: 9.39e-06 [inline_without_move]: 5.54998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 9.50007e-07 [auto_monad_grad]: 6.89994e-07 [auto_monad_eliminator]: 5.87999e-06 [cse]: 1.159e-05 [replace_applicator]: 6.19999e-06 [py_interpret_to_execute_after_opt_a]: 1.285e-05 [rewriter_after_opt_a]: 3.607e-05 [convert_after_rewriter]: 7.05e-06 [order_py_execute_after_rewriter]: 4.52e-06 [mutable_eliminate]: 0.00070881 [jit_opt_b]: 8.592e-05, [1] [Cycle 1]: 7.772e-05, [2] [frontend_op_eliminate]: 1.896e-05 [inline_after_opt_a]: 4.693e-05 [cconv]: 2.585e-05 [loop_unroll]: 0.00043829 [jit_opt_after_cconv]: 0.00015706, [1] [Cycle 1]: 0.00015062, [11] [c_1]: 2.592e-05 [parameter_eliminate]: 2.73998e-06 [updatestate_depend_eliminate]: 5.81998e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 2.338e-05 [call_graph_tuple_transform]: 2.291e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 4.89992e-07 [switch_simplify]: 7.27002e-06 [remove_dup_value]: 1.647e-05 [partial_unused_args_eliminate]: 2.34001e-06 [environ_conv]: 8.77e-06 [add_recomputation]: 4.999e-05 [cse_after_recomputation]: 2.298e-05, [1] [Cycle 1]: 1.77e-05, [1] [cse]: 1.167e-05 [auto_monad_reorder]: 1.546e-05 [get_jit_bprop_graph]: 1.51002e-06 [rewriter_after_jit_bprop_graph]: 6.79001e-06 [opt_after_jit_grad]: 0.00048754 [symbol_engine_optimizer]: 0.00019945, [1] [Cycle 1]: 0.00019312, [6] [build]: 4.40999e-06 [elim_shapecalc]: 8.02e-06 [elim_not_effective]: 1.311e-05 [opt_reshape]: 8.52e-06 [fold_const_symbol]: 0.00012626 [renormalize]: 4.2998e-07 [validate]: 4.258e-05 Sums bootstrap : 0.000302s : 0.47% type_inference : 0.057399s : 89.76% event_method : 0.000019s : 0.03% auto_monad : 0.000069s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000308s : 0.48% rewriter_before_opt_a : 0.000085s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000070s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000756s : 1.18% jit_opt_a.with_stream_mark : 0.000037s : 0.06% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000020s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002355s : 3.68% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.04% jit_opt_a.cse : 0.000047s : 0.07% jit_opt_a.replace_applicator : 0.000026s : 0.04% py_interpret_to_execute_after_opt_a : 0.000013s : 0.02% rewriter_after_opt_a : 0.000036s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000709s : 1.11% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000047s : 0.07% cconv : 0.000026s : 0.04% loop_unroll : 0.000438s : 0.69% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000023s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000023s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000050s : 0.08% cse_after_recomputation.cse : 0.000012s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000488s : 0.76% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000126s : 0.20% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000043s : 0.07% Time group info: ------[substitution.] 0.000365 24 0.57% : 0.000002s : 2: substitution.elim_not_effective 32.04% : 0.000117s : 2: substitution.fold_const_symbol 1.65% : 0.000006s : 4: substitution.graph_param_transform 57.95% : 0.000212s : 4: substitution.inline 1.01% : 0.000004s : 4: substitution.j_node_and_user_rematch 1.53% : 0.000006s : 4: substitution.remove_not_recompute_node 1.59% : 0.000006s : 2: substitution.replace_old_param 3.65% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057318 2 96.63% : 0.055387s : 1: type_inference.infer 3.37% : 0.001931s : 1: type_inference.specialize ------[replace.] 0.000077 6 67.92% : 0.000052s : 4: replace.inline 32.08% : 0.000025s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000222 6 94.53% : 0.000209s : 4: match.inline 5.47% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000138 830 1.46% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.00% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000003s : 12: predicate.arithmetic_simplify 1.10% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.02% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.20% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.82% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000001s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.44% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_depend_swap 1.47% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.23% : 0.000002s : 8: predicate.get_grad_eliminate 0.41% : 0.000001s : 4: predicate.graph_param_transform 5.61% : 0.000008s : 26: predicate.inline 0.93% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.34% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.27% : 0.000003s : 18: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.52% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.27% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.00% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.18% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.50% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.81% : 0.000001s : 8: predicate.remove_not_recompute_node 2.02% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.19% : 0.000002s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.11% : 0.000010s : 58: predicate.switch_simplify 1.39% : 0.000002s : 12: predicate.tile_eliminate 1.58% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.87% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.82% : 0.000003s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002467 30 72.39% : 0.001786s : 23: func_graph_cloner_run.FuncGraphClonerGraph 2.21% : 0.000055s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.39% : 0.000627s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.071845 72 0.07% : 0.000053s : 1: add_recomputation 0.10% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000318s : 1: bootstrap 0.04% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000026s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.54% : 0.007571s : 1: jit_opt_a 0.22% : 0.000160s : 1: jit_opt_after_cconv 0.12% : 0.000088s : 1: jit_opt_b 0.62% : 0.000446s : 1: loop_unroll 1.00% : 0.000717s : 1: mutable_eliminate 1.40% : 0.001005s : 26: opt.transform.jit_opt_a 0.08% : 0.000059s : 4: opt.transform.jit_opt_after_cconv 0.08% : 0.000059s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.21% : 0.000153s : 4: opt.transform.symbol_engine_opt 0.69% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000314s : 1: py_interpret_to_execute 0.02% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 2.25% : 0.001619s : 1: renormalize.infer 1.01% : 0.000726s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000039s : 1: rewriter_after_opt_a 0.13% : 0.000090s : 1: rewriter_before_opt_a 0.28% : 0.000202s : 1: symbol_engine_optimizer 79.91% : 0.057414s : 1: type_inference TotalTime = 0.0626384, [30] [bootstrap]: 0.00029082 [type_inference]: 0.0531269 [event_method]: 1.696e-05 [auto_monad]: 5.271e-05 [graph_reusing]: 3.98999e-06 [pre_auto_parallel]: 1.59e-06 [py_interpret_to_execute]: 0.00029704 [rewriter_before_opt_a]: 7.227e-05 [expand_dump_flag]: 2.54001e-06 [jit_opt_a]: 0.00661545, [2] [Cycle 1]: 0.00296112, [27] [switch_simplify]: 4.756e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.0005324 [with_stream_mark]: 1.346e-05 [recompute_prepare]: 7.6e-06 [updatestate_depend_eliminate]: 2.95002e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.20002e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 6.78998e-06 [updatestate_useless_node_eliminater]: 6.05002e-06 [accelerated_algorithm]: 6.35997e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 6.22001e-06 [merge_forward]: 2.47001e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.208e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.27999e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 6.28e-06 [renormalize]: 0.00204264 [add_forward_monad_depend]: 5.24e-06 [auto_monad_grad]: 1.52001e-06 [auto_monad_eliminator]: 1.3e-05 [cse]: 2.132e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00036428, [27] [switch_simplify]: 6.78998e-06 [loop_unroll]: 5.82999e-06 [a_1]: 0.00012555 [with_stream_mark]: 1.109e-05 [recompute_prepare]: 5.60001e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 5.95002e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.56e-06 [merge_forward]: 2.78e-06 [cell_reuse_recompute_pass]: 1.70001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.5e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 2.07999e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.46002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.29998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.095e-05 [replace_applicator]: 5.94e-06 [py_interpret_to_execute_after_opt_a]: 1.048e-05 [rewriter_after_opt_a]: 3.071e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 5.17e-06 [mutable_eliminate]: 0.00059925 [jit_opt_b]: 5.231e-05, [1] [Cycle 1]: 4.661e-05, [2] [frontend_op_eliminate]: 1.9e-05 [inline_after_opt_a]: 1.728e-05 [cconv]: 1.692e-05 [loop_unroll]: 0.00042198 [jit_opt_after_cconv]: 0.00014344, [1] [Cycle 1]: 0.00013782, [11] [c_1]: 2.607e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 4.23999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.993e-05 [call_graph_tuple_transform]: 1.911e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.45999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.049e-05 [partial_unused_args_eliminate]: 1.97999e-06 [environ_conv]: 6.69999e-06 [add_recomputation]: 3.634e-05 [cse_after_recomputation]: 2.177e-05, [1] [Cycle 1]: 1.663e-05, [1] [cse]: 1.02e-05 [auto_monad_reorder]: 1.234e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.38999e-06 [opt_after_jit_grad]: 0.00047722 [symbol_engine_optimizer]: 7.159e-05, [1] [Cycle 1]: 6.645e-05, [6] [build]: 3.25002e-06 [elim_shapecalc]: 8.08999e-06 [elim_not_effective]: 1.207e-05 [opt_reshape]: 6.26998e-06 [fold_const_symbol]: 9.69e-06 [renormalize]: 3.19997e-07 [validate]: 7.31e-05 Sums bootstrap : 0.000291s : 0.49% type_inference : 0.053127s : 90.33% event_method : 0.000017s : 0.03% auto_monad : 0.000053s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000297s : 0.51% rewriter_before_opt_a : 0.000072s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000658s : 1.12% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.002043s : 3.47% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000032s : 0.05% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000031s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000599s : 1.02% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000017s : 0.03% loop_unroll : 0.000422s : 0.72% jit_opt_after_cconv.c_1 : 0.000026s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000004s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000036s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000477s : 0.81% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000073s : 0.12% Time group info: ------[substitution.] 0.000167 24 1.30% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.85% : 0.000005s : 4: substitution.graph_param_transform 82.51% : 0.000138s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.57% : 0.000006s : 4: substitution.remove_not_recompute_node 2.26% : 0.000004s : 2: substitution.replace_old_param 5.17% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.053060 2 96.61% : 0.051261s : 1: type_inference.infer 3.39% : 0.001798s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.10% : 0.000045s : 4: replace.inline 33.90% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000143 6 94.69% : 0.000136s : 4: match.inline 5.31% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 0.98% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.19% : 0.000002s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 2.11% : 0.000003s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.77% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 4.63% : 0.000006s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.30% : 0.000002s : 8: predicate.less_batch_normalization 1.76% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.26% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.63% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.07% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.54% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.11% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.20% : 0.000003s : 18: predicate.switch_defer_inline 2.30% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.79% : 0.000009s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.65% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.32% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002175 26 71.81% : 0.001562s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.29% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.90% : 0.000585s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.065595 72 0.06% : 0.000039s : 1: add_recomputation 0.09% : 0.000056s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.46% : 0.000303s : 1: bootstrap 0.03% : 0.000019s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 10.09% : 0.006619s : 1: jit_opt_a 0.22% : 0.000146s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.65% : 0.000428s : 1: loop_unroll 0.92% : 0.000606s : 1: mutable_eliminate 1.34% : 0.000877s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.03% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000484s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.46% : 0.000302s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000013s : 1: remove_dup_value 2.11% : 0.001385s : 1: renormalize.infer 0.99% : 0.000651s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.12% : 0.000077s : 1: rewriter_before_opt_a 0.11% : 0.000074s : 1: symbol_engine_optimizer 81.01% : 0.053138s : 1: type_inference TotalTime = 0.0133001, [30] [bootstrap]: 0.00027488 [type_inference]: 0.00477202 [event_method]: 1.79e-05 [auto_monad]: 5.087e-05 [graph_reusing]: 4.74e-06 [pre_auto_parallel]: 1.62001e-06 [py_interpret_to_execute]: 4.057e-05 [rewriter_before_opt_a]: 6.818e-05 [expand_dump_flag]: 2.09999e-06 [jit_opt_a]: 0.00563329, [2] [Cycle 1]: 0.00178741, [27] [switch_simplify]: 5.314e-05 [loop_unroll]: 3.03e-05 [a_1]: 0.00052449 [with_stream_mark]: 1.481e-05 [recompute_prepare]: 7.71001e-06 [updatestate_depend_eliminate]: 4.09002e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.74998e-06 [specialize_transform]: 6.12999e-06 [updatestate_useless_node_eliminater]: 5.23002e-06 [accelerated_algorithm]: 6.32001e-06 [meta_shard_fg_expand]: 1.44e-06 [get_grad_eliminate_]: 6.97002e-06 [merge_forward]: 2.98e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.188e-05 [j_node_and_user_rematch]: 9.73002e-06 [meta_fg_expand]: 1.92001e-06 [replace_old_param]: 9.04003e-06 [inline_without_move]: 5.72001e-06 [renormalize]: 0.00075291 [add_forward_monad_depend]: 6.94999e-06 [auto_monad_grad]: 1.69998e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 2.63e-05 [replace_applicator]: 1.406e-05 [Cycle 2]: 0.00033473, [27] [switch_simplify]: 5.91e-06 [loop_unroll]: 5.17999e-06 [a_1]: 9.846e-05 [with_stream_mark]: 1.176e-05 [recompute_prepare]: 5.17999e-06 [updatestate_depend_eliminate]: 2.98998e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.10001e-06 [specialize_transform]: 5.24998e-06 [updatestate_useless_node_eliminater]: 4.92999e-06 [accelerated_algorithm]: 5.17e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 5.04998e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 2.36e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.412e-05 [j_node_and_user_rematch]: 8.27998e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 7.68001e-06 [inline_without_move]: 4.90999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.56998e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.52001e-06 [cse]: 1.176e-05 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 1.295e-05 [rewriter_after_opt_a]: 2.918e-05 [convert_after_rewriter]: 6.41e-06 [order_py_execute_after_rewriter]: 4.25e-06 [mutable_eliminate]: 0.00065547 [jit_opt_b]: 6.118e-05, [1] [Cycle 1]: 4.48e-05, [2] [frontend_op_eliminate]: 1.693e-05 [inline_after_opt_a]: 1.678e-05 [cconv]: 2.403e-05 [loop_unroll]: 0.00050415 [jit_opt_after_cconv]: 0.00015863, [1] [Cycle 1]: 0.00015108, [11] [c_1]: 2.21e-05 [parameter_eliminate]: 3.3e-06 [updatestate_depend_eliminate]: 7.56001e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 2.798e-05 [call_graph_tuple_transform]: 2.13e-05 [tuple_list_get_item_eliminator]: 5.83002e-06 [none_parameter_eliminate]: 1.30999e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.50001e-06 [remove_dup_value]: 1.293e-05 [partial_unused_args_eliminate]: 1.80001e-06 [environ_conv]: 5.54e-06 [add_recomputation]: 4.516e-05 [cse_after_recomputation]: 2.55e-05, [1] [Cycle 1]: 1.931e-05, [1] [cse]: 1.286e-05 [auto_monad_reorder]: 1.402e-05 [get_jit_bprop_graph]: 2.19999e-06 [rewriter_after_jit_bprop_graph]: 7.44002e-06 [opt_after_jit_grad]: 0.00054098 [symbol_engine_optimizer]: 7.751e-05, [1] [Cycle 1]: 7.036e-05, [6] [build]: 3.63e-06 [elim_shapecalc]: 8.12e-06 [elim_not_effective]: 1.48e-05 [opt_reshape]: 6.23e-06 [fold_const_symbol]: 9.15999e-06 [renormalize]: 2.69996e-07 [validate]: 3.858e-05 Sums bootstrap : 0.000275s : 3.03% type_inference : 0.004772s : 52.57% event_method : 0.000018s : 0.20% auto_monad : 0.000051s : 0.56% graph_reusing : 0.000005s : 0.05% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000041s : 0.45% rewriter_before_opt_a : 0.000068s : 0.75% expand_dump_flag : 0.000002s : 0.02% jit_opt_a.switch_simplify : 0.000059s : 0.65% jit_opt_a.loop_unroll : 0.000035s : 0.39% jit_opt_a.a_1 : 0.000623s : 6.86% jit_opt_a.with_stream_mark : 0.000027s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.05% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.05% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.11% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.03% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.04% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.29% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.18% jit_opt_a.inline_without_move : 0.000011s : 0.12% jit_opt_a.renormalize : 0.000753s : 8.30% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.09% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000038s : 0.42% jit_opt_a.replace_applicator : 0.000019s : 0.21% py_interpret_to_execute_after_opt_a : 0.000013s : 0.14% rewriter_after_opt_a : 0.000029s : 0.32% convert_after_rewriter : 0.000006s : 0.07% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000655s : 7.22% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.19% jit_opt_b.inline_after_opt_a : 0.000017s : 0.18% cconv : 0.000024s : 0.26% loop_unroll : 0.000504s : 5.55% jit_opt_after_cconv.c_1 : 0.000022s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000008s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000028s : 0.31% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.06% remove_dup_value : 0.000013s : 0.14% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000006s : 0.06% add_recomputation : 0.000045s : 0.50% cse_after_recomputation.cse : 0.000013s : 0.14% auto_monad_reorder : 0.000014s : 0.15% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000007s : 0.08% opt_after_jit_grad : 0.000541s : 5.96% symbol_engine_optimizer.build : 0.000004s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000015s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.43% Time group info: ------[substitution.] 0.000191 23 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 3: substitution.graph_param_transform 82.70% : 0.000158s : 4: substitution.inline 1.74% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 5.77% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004711 2 80.73% : 0.003803s : 1: type_inference.infer 19.27% : 0.000908s : 1: type_inference.specialize ------[replace.] 0.000071 6 65.71% : 0.000047s : 4: replace.inline 34.29% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000165 6 94.01% : 0.000155s : 4: match.inline 5.99% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 691 1.23% : 0.000002s : 10: predicate.accumulaten_eliminater 1.18% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000002s : 10: predicate.addn_zero_filter 1.86% : 0.000002s : 10: predicate.arithmetic_simplify 1.25% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.06% : 0.000001s : 10: predicate.depend_value_elim 1.06% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.45% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.10% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.50% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000002s : 10: predicate.environ_get_eliminate 1.02% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.41% : 0.000002s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.27% : 0.000006s : 22: predicate.inline 0.97% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.46% : 0.000002s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.75% : 0.000002s : 15: predicate.load_eliminater 1.61% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 10: predicate.merge_addn 1.07% : 0.000001s : 10: predicate.minmaximum_grad 1.90% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.18% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000002s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.58% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.15% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 3: predicate.row_tensor_eliminate 1.45% : 0.000002s : 10: predicate.same_eliminate 0.50% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 0.91% : 0.000001s : 6: predicate.specialize_transform 1.27% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.35% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.41% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 16: predicate.switch_defer_inline 1.99% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.29% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.49% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.06% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.83% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.54% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 2.10% : 0.000003s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000643 13 48.15% : 0.000309s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.10% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.76% : 0.000301s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.014933 72 0.32% : 0.000048s : 1: add_recomputation 0.36% : 0.000054s : 1: auto_monad 0.11% : 0.000016s : 1: auto_monad_reorder 1.95% : 0.000291s : 1: bootstrap 0.18% : 0.000027s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000028s : 1: cse_after_recomputation 0.05% : 0.000008s : 1: environ_conv 0.14% : 0.000022s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 37.75% : 0.005637s : 1: jit_opt_a 1.08% : 0.000161s : 1: jit_opt_after_cconv 0.43% : 0.000064s : 1: jit_opt_b 3.45% : 0.000515s : 1: loop_unroll 4.46% : 0.000666s : 1: mutable_eliminate 5.62% : 0.000840s : 26: opt.transform.jit_opt_a 0.34% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000027s : 4: opt.transform.jit_opt_b 0.09% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000015s : 1: opt.transform.mutable_eliminate 0.16% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000035s : 4: opt.transform.symbol_engine_opt 3.68% : 0.000550s : 1: opt_after_jit_grad 0.04% : 0.000006s : 1: order_py_execute_after_rewriter 0.02% : 0.000004s : 1: partial_unused_args_eliminate 0.02% : 0.000003s : 1: pre_auto_parallel 0.29% : 0.000044s : 1: py_interpret_to_execute 0.10% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.10% : 0.000015s : 1: remove_dup_value 2.62% : 0.000392s : 1: renormalize.infer 2.37% : 0.000353s : 1: renormalize.specialize 0.06% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.21% : 0.000032s : 1: rewriter_after_opt_a 0.48% : 0.000071s : 1: rewriter_before_opt_a 0.54% : 0.000080s : 1: symbol_engine_optimizer 32.07% : 0.004789s : 1: type_inference TotalTime = 0.0120588, [30] [bootstrap]: 0.00026336 [type_inference]: 0.00462703 [event_method]: 1.708e-05 [auto_monad]: 6.03e-05 [graph_reusing]: 5.37999e-06 [pre_auto_parallel]: 2.09999e-06 [py_interpret_to_execute]: 3.842e-05 [rewriter_before_opt_a]: 7.131e-05 [expand_dump_flag]: 2.93e-06 [jit_opt_a]: 0.00499307, [2] [Cycle 1]: 0.00156927, [27] [switch_simplify]: 5.046e-05 [loop_unroll]: 2.992e-05 [a_1]: 0.00049448 [with_stream_mark]: 1.71e-05 [recompute_prepare]: 7.1e-06 [updatestate_depend_eliminate]: 3.09999e-06 [updatestate_assign_eliminate]: 2.85998e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 6.39001e-06 [updatestate_useless_node_eliminater]: 5.11997e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 4e-06 [cell_reuse_recompute_pass]: 8.39995e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.302e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 2.19999e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 0.00068648 [add_forward_monad_depend]: 5.09e-06 [auto_monad_grad]: 2.50997e-06 [auto_monad_eliminator]: 1.283e-05 [cse]: 1.943e-05 [replace_applicator]: 1.129e-05 [Cycle 2]: 0.00030691, [27] [switch_simplify]: 5.69e-06 [loop_unroll]: 4.87998e-06 [a_1]: 8.854e-05 [with_stream_mark]: 8.61002e-06 [recompute_prepare]: 5.15001e-06 [updatestate_depend_eliminate]: 2.57001e-06 [updatestate_assign_eliminate]: 2.08998e-06 [updatestate_loads_eliminate]: 2.10002e-06 [parameter_eliminate]: 8.99978e-07 [specialize_transform]: 4.96002e-06 [updatestate_useless_node_eliminater]: 4.82e-06 [accelerated_algorithm]: 4.65001e-06 [meta_shard_fg_expand]: 1.42e-06 [get_grad_eliminate_]: 4.45999e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.44e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 7.85998e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.36999e-06 [inline_without_move]: 4.60001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 5.17999e-06 [cse]: 1.051e-05 [replace_applicator]: 4.65999e-06 [py_interpret_to_execute_after_opt_a]: 1.062e-05 [rewriter_after_opt_a]: 3.244e-05 [convert_after_rewriter]: 7.26999e-06 [order_py_execute_after_rewriter]: 4.84e-06 [mutable_eliminate]: 0.00050626 [jit_opt_b]: 4.673e-05, [1] [Cycle 1]: 4.033e-05, [2] [frontend_op_eliminate]: 1.53e-05 [inline_after_opt_a]: 1.454e-05 [cconv]: 2.358e-05 [loop_unroll]: 0.00040172 [jit_opt_after_cconv]: 0.00013016, [1] [Cycle 1]: 0.0001239, [11] [c_1]: 1.979e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 1.99999e-06 [cse]: 1.738e-05 [call_graph_tuple_transform]: 1.655e-05 [tuple_list_get_item_eliminator]: 5.00999e-06 [none_parameter_eliminate]: 1.38002e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 4.93001e-06 [remove_dup_value]: 1.359e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 6.33e-06 [add_recomputation]: 4.388e-05 [cse_after_recomputation]: 1.992e-05, [1] [Cycle 1]: 1.507e-05, [1] [cse]: 9.61998e-06 [auto_monad_reorder]: 1.548e-05 [get_jit_bprop_graph]: 2.04e-06 [rewriter_after_jit_bprop_graph]: 5.02999e-06 [opt_after_jit_grad]: 0.00044113 [symbol_engine_optimizer]: 6.996e-05, [1] [Cycle 1]: 6.351e-05, [6] [build]: 3.22002e-06 [elim_shapecalc]: 7.45998e-06 [elim_not_effective]: 1.268e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 8.00999e-06 [renormalize]: 3.39991e-07 [validate]: 3.232e-05 Sums bootstrap : 0.000263s : 3.13% type_inference : 0.004627s : 55.04% event_method : 0.000017s : 0.20% auto_monad : 0.000060s : 0.72% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000038s : 0.46% rewriter_before_opt_a : 0.000071s : 0.85% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000056s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000583s : 6.94% jit_opt_a.with_stream_mark : 0.000026s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.11% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000687s : 8.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.21% jit_opt_a.cse : 0.000030s : 0.36% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000011s : 0.13% rewriter_after_opt_a : 0.000032s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000506s : 6.02% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.17% cconv : 0.000024s : 0.28% loop_unroll : 0.000402s : 4.78% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.08% add_recomputation : 0.000044s : 0.52% cse_after_recomputation.cse : 0.000010s : 0.11% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000441s : 5.25% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.38% Time group info: ------[substitution.] 0.000177 23 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000005s : 3: substitution.graph_param_transform 81.89% : 0.000145s : 4: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.53% : 0.000004s : 2: substitution.replace_old_param 6.92% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004574 2 79.77% : 0.003649s : 1: type_inference.infer 20.23% : 0.000925s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.65% : 0.000043s : 4: replace.inline 33.35% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 92.74% : 0.000143s : 4: match.inline 7.26% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.47% : 0.000002s : 10: predicate.cast_eliminate 0.45% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.24% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.12% : 0.000001s : 10: predicate.environ_get_eliminate 1.41% : 0.000002s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.43% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.17% : 0.000001s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.42% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.65% : 0.000002s : 10: predicate.reduce_eliminate 1.65% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 6: predicate.remove_not_recompute_node 1.82% : 0.000002s : 18: predicate.replace_applicator 0.78% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.24% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.60% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.52% : 0.000002s : 6: predicate.special_op_eliminate 1.03% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.44% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.90% : 0.000009s : 53: predicate.switch_simplify 1.25% : 0.000001s : 10: predicate.tile_eliminate 1.21% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.59% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.42% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.85% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 10: predicate.value_based_eliminate 0.43% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000629 13 49.68% : 0.000312s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.06% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.26% : 0.000291s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013588 72 0.34% : 0.000047s : 1: add_recomputation 0.46% : 0.000063s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.04% : 0.000277s : 1: bootstrap 0.19% : 0.000026s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.26% : 0.000035s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.77% : 0.004996s : 1: jit_opt_a 0.98% : 0.000133s : 1: jit_opt_after_cconv 0.36% : 0.000049s : 1: jit_opt_b 3.00% : 0.000408s : 1: loop_unroll 3.78% : 0.000514s : 1: mutable_eliminate 5.79% : 0.000786s : 26: opt.transform.jit_opt_a 0.32% : 0.000043s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.08% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.08% : 0.000011s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.31% : 0.000449s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000041s : 1: py_interpret_to_execute 0.10% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.70% : 0.000367s : 1: renormalize.infer 2.30% : 0.000313s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000036s : 1: rewriter_after_opt_a 0.54% : 0.000074s : 1: rewriter_before_opt_a 0.53% : 0.000072s : 1: symbol_engine_optimizer 34.13% : 0.004637s : 1: type_inference TotalTime = 0.112031, [30] [bootstrap]: 0.00026339 [type_inference]: 0.101353 [event_method]: 1.697e-05 [auto_monad]: 6.956e-05 [graph_reusing]: 5.12e-06 [pre_auto_parallel]: 2.24999e-06 [py_interpret_to_execute]: 0.00043252 [rewriter_before_opt_a]: 8.14e-05 [expand_dump_flag]: 3.21001e-06 [jit_opt_a]: 0.0074977, [2] [Cycle 1]: 0.00363975, [27] [switch_simplify]: 5.481e-05 [loop_unroll]: 3.061e-05 [a_1]: 0.00056926 [with_stream_mark]: 1.615e-05 [recompute_prepare]: 8.38001e-06 [updatestate_depend_eliminate]: 4.03001e-06 [updatestate_assign_eliminate]: 3.43e-06 [updatestate_loads_eliminate]: 2.89999e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.72999e-06 [accelerated_algorithm]: 6.12001e-06 [meta_shard_fg_expand]: 1.96998e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 4.21001e-06 [cell_reuse_recompute_pass]: 8.30012e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.575e-05 [j_node_and_user_rematch]: 9.74e-06 [meta_fg_expand]: 2.28002e-06 [replace_old_param]: 1.053e-05 [inline_without_move]: 6.04999e-06 [renormalize]: 0.00261876 [add_forward_monad_depend]: 7.82e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.941e-05 [cse]: 2.479e-05 [replace_applicator]: 2.119e-05 [Cycle 2]: 0.00039107, [27] [switch_simplify]: 7.13e-06 [loop_unroll]: 6.02001e-06 [a_1]: 0.0001258 [with_stream_mark]: 1.428e-05 [recompute_prepare]: 5.96998e-06 [updatestate_depend_eliminate]: 3.51999e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 3.00998e-06 [parameter_eliminate]: 1.44e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.70001e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.04001e-06 [cell_reuse_recompute_pass]: 2.67001e-06 [cell_reuse_handle_not_recompute_node_pass]: 2.091e-05 [j_node_and_user_rematch]: 9.41e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.94999e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.50001e-06 [auto_monad_grad]: 1.03001e-06 [auto_monad_eliminator]: 6.94999e-06 [cse]: 1.314e-05 [replace_applicator]: 7.28e-06 [py_interpret_to_execute_after_opt_a]: 1.375e-05 [rewriter_after_opt_a]: 3.659e-05 [convert_after_rewriter]: 7.03e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00072646 [jit_opt_b]: 5.469e-05, [1] [Cycle 1]: 4.736e-05, [2] [frontend_op_eliminate]: 1.879e-05 [inline_after_opt_a]: 1.766e-05 [cconv]: 3.073e-05 [loop_unroll]: 0.00041398 [jit_opt_after_cconv]: 0.00015647, [1] [Cycle 1]: 0.00015025, [11] [c_1]: 2.598e-05 [parameter_eliminate]: 3.4e-06 [updatestate_depend_eliminate]: 6.28e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.32999e-06 [cse]: 2.462e-05 [call_graph_tuple_transform]: 2.102e-05 [tuple_list_get_item_eliminator]: 5.85002e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 6.59988e-07 [switch_simplify]: 6.11998e-06 [remove_dup_value]: 1.462e-05 [partial_unused_args_eliminate]: 2.53998e-06 [environ_conv]: 8.14002e-06 [add_recomputation]: 4.817e-05 [cse_after_recomputation]: 2.21e-05, [1] [Cycle 1]: 1.645e-05, [1] [cse]: 1.058e-05 [auto_monad_reorder]: 1.535e-05 [get_jit_bprop_graph]: 1.91998e-06 [rewriter_after_jit_bprop_graph]: 6.78e-06 [opt_after_jit_grad]: 0.00045281 [symbol_engine_optimizer]: 7.385e-05, [1] [Cycle 1]: 6.803e-05, [6] [build]: 3.47002e-06 [elim_shapecalc]: 8.1e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 9.66e-06 [renormalize]: 5.89993e-07 [validate]: 4.279e-05 Sums bootstrap : 0.000263s : 0.24% type_inference : 0.101353s : 93.86% event_method : 0.000017s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000433s : 0.40% rewriter_before_opt_a : 0.000081s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000062s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000695s : 0.64% jit_opt_a.with_stream_mark : 0.000030s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000037s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000020s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002619s : 2.43% jit_opt_a.add_forward_monad_depend : 0.000009s : 0.01% jit_opt_a.auto_monad_grad : 0.000004s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000026s : 0.02% jit_opt_a.cse : 0.000038s : 0.04% jit_opt_a.replace_applicator : 0.000028s : 0.03% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000037s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000726s : 0.67% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000031s : 0.03% loop_unroll : 0.000414s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000025s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000007s : 0.01% opt_after_jit_grad : 0.000453s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000001s : 0.00% validate : 0.000043s : 0.04% Time group info: ------[substitution.] 0.000208 24 1.25% : 0.000003s : 2: substitution.elim_not_effective 0.56% : 0.000001s : 2: substitution.fold_const_symbol 2.76% : 0.000006s : 4: substitution.graph_param_transform 82.07% : 0.000171s : 4: substitution.inline 1.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.78% : 0.000006s : 4: substitution.remove_not_recompute_node 2.72% : 0.000006s : 2: substitution.replace_old_param 5.93% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101278 2 97.45% : 0.098697s : 1: type_inference.infer 2.55% : 0.002582s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.15% : 0.000048s : 4: replace.inline 32.85% : 0.000024s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000179 6 93.75% : 0.000168s : 4: match.inline 6.25% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000134 830 1.42% : 0.000002s : 12: predicate.accumulaten_eliminater 1.35% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.01% : 0.000003s : 12: predicate.arithmetic_simplify 1.13% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.41% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.70% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.46% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 4.99% : 0.000007s : 26: predicate.inline 0.88% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.52% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.27% : 0.000002s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.00% : 0.000001s : 8: predicate.remove_not_recompute_node 2.43% : 0.000003s : 22: predicate.replace_applicator 0.93% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.33% : 0.000002s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 8: predicate.special_op_eliminate 0.93% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.43% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 1.97% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.10% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.26% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.63% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.82% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 12: predicate.value_based_eliminate 0.45% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001958 22 64.28% : 0.001258s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.64% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.09% : 0.000667s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115654 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000278s : 1: bootstrap 0.03% : 0.000033s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.49% : 0.007501s : 1: jit_opt_a 0.14% : 0.000159s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.36% : 0.000421s : 1: loop_unroll 0.64% : 0.000735s : 1: mutable_eliminate 0.81% : 0.000937s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000016s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000461s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000438s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.58% : 0.001829s : 1: renormalize.infer 0.67% : 0.000779s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000040s : 1: rewriter_after_opt_a 0.07% : 0.000086s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 87.65% : 0.101368s : 1: type_inference TotalTime = 0.112581, [30] [bootstrap]: 0.00026455 [type_inference]: 0.102257 [event_method]: 1.927e-05 [auto_monad]: 6.805e-05 [graph_reusing]: 6.54999e-06 [pre_auto_parallel]: 2.46998e-06 [py_interpret_to_execute]: 0.00047517 [rewriter_before_opt_a]: 0.00010251 [expand_dump_flag]: 3.85e-06 [jit_opt_a]: 0.00723868, [2] [Cycle 1]: 0.00353893, [27] [switch_simplify]: 5.745e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00060562 [with_stream_mark]: 1.819e-05 [recompute_prepare]: 8.76002e-06 [updatestate_depend_eliminate]: 4.3e-06 [updatestate_assign_eliminate]: 3.18e-06 [updatestate_loads_eliminate]: 3.41999e-06 [parameter_eliminate]: 2.04e-06 [specialize_transform]: 7.03e-06 [updatestate_useless_node_eliminater]: 5.85002e-06 [accelerated_algorithm]: 6.55997e-06 [meta_shard_fg_expand]: 2.34001e-06 [get_grad_eliminate_]: 6.21e-06 [merge_forward]: 4.22998e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.479e-05 [j_node_and_user_rematch]: 9.84999e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.58002e-06 [inline_without_move]: 6.48e-06 [renormalize]: 0.00247409 [add_forward_monad_depend]: 6.91001e-06 [auto_monad_grad]: 1.87001e-06 [auto_monad_eliminator]: 1.881e-05 [cse]: 3.176e-05 [replace_applicator]: 1.887e-05 [Cycle 2]: 0.00037113, [27] [switch_simplify]: 6.78e-06 [loop_unroll]: 5.64998e-06 [a_1]: 0.00012198 [with_stream_mark]: 1.079e-05 [recompute_prepare]: 6.11998e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 1.59998e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.89999e-06 [get_grad_eliminate_]: 5.43002e-06 [merge_forward]: 3.19001e-06 [cell_reuse_recompute_pass]: 2.55002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.676e-05 [j_node_and_user_rematch]: 9.27001e-06 [meta_fg_expand]: 2.07001e-06 [replace_old_param]: 8.97e-06 [inline_without_move]: 5.51e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.17999e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.81998e-06 [cse]: 1.244e-05 [replace_applicator]: 5.96998e-06 [py_interpret_to_execute_after_opt_a]: 8.3e-06 [rewriter_after_opt_a]: 3.433e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.93002e-06 [mutable_eliminate]: 0.00059889 [jit_opt_b]: 5.521e-05, [1] [Cycle 1]: 4.839e-05, [2] [frontend_op_eliminate]: 1.987e-05 [inline_after_opt_a]: 1.754e-05 [cconv]: 2.739e-05 [loop_unroll]: 0.00041207 [jit_opt_after_cconv]: 0.00015123, [1] [Cycle 1]: 0.00014491, [11] [c_1]: 2.546e-05 [parameter_eliminate]: 2.63e-06 [updatestate_depend_eliminate]: 6.23002e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 2.235e-05 [call_graph_tuple_transform]: 2.084e-05 [tuple_list_get_item_eliminator]: 6.05002e-06 [none_parameter_eliminate]: 2.05002e-06 [renormalize]: 2.30008e-07 [switch_simplify]: 6.07999e-06 [remove_dup_value]: 1.532e-05 [partial_unused_args_eliminate]: 2.48e-06 [environ_conv]: 8.68001e-06 [add_recomputation]: 5.05e-05 [cse_after_recomputation]: 2.105e-05, [1] [Cycle 1]: 1.606e-05, [1] [cse]: 9.79e-06 [auto_monad_reorder]: 1.56e-05 [get_jit_bprop_graph]: 2.36e-06 [rewriter_after_jit_bprop_graph]: 5.58997e-06 [opt_after_jit_grad]: 0.00043408 [symbol_engine_optimizer]: 7.106e-05, [1] [Cycle 1]: 6.543e-05, [6] [build]: 3.66999e-06 [elim_shapecalc]: 7.8e-06 [elim_not_effective]: 1.137e-05 [opt_reshape]: 6.53e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 1.8999e-07 [validate]: 3.937e-05 Sums bootstrap : 0.000265s : 0.24% type_inference : 0.102257s : 94.10% event_method : 0.000019s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000475s : 0.44% rewriter_before_opt_a : 0.000103s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000064s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000728s : 0.67% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000008s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000004s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000032s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002474s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000025s : 0.02% jit_opt_a.cse : 0.000044s : 0.04% jit_opt_a.replace_applicator : 0.000025s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000034s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000599s : 0.55% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000412s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000022s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000051s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000434s : 0.40% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000011s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000211 24 0.80% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000002s : 2: substitution.fold_const_symbol 3.08% : 0.000006s : 4: substitution.graph_param_transform 81.69% : 0.000172s : 4: substitution.inline 1.80% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000006s : 4: substitution.remove_not_recompute_node 2.43% : 0.000005s : 2: substitution.replace_old_param 6.64% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102188 2 97.44% : 0.099569s : 1: type_inference.infer 2.56% : 0.002618s : 1: type_inference.specialize ------[replace.] 0.000074 6 65.31% : 0.000048s : 4: replace.inline 34.69% : 0.000026s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000182 6 92.99% : 0.000170s : 4: match.inline 7.01% : 0.000013s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 0.88% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000002s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.21% : 0.000002s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.34% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.52% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.46% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.66% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.73% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.19% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.87% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 1.94% : 0.000003s : 22: predicate.replace_applicator 0.72% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.45% : 0.000002s : 12: predicate.reshape_eliminate 1.21% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.18% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.34% : 0.000010s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.77% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.13% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.99% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001975 22 63.58% : 0.001256s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.59% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.83% : 0.000688s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.116091 72 0.05% : 0.000053s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000277s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.24% : 0.007242s : 1: jit_opt_a 0.13% : 0.000154s : 1: jit_opt_after_cconv 0.05% : 0.000058s : 1: jit_opt_b 0.36% : 0.000419s : 1: loop_unroll 0.53% : 0.000620s : 1: mutable_eliminate 0.83% : 0.000968s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.38% : 0.000442s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000481s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.50% : 0.001746s : 1: renormalize.infer 0.62% : 0.000719s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.09% : 0.000108s : 1: rewriter_before_opt_a 0.06% : 0.000073s : 1: symbol_engine_optimizer 88.10% : 0.102272s : 1: type_inference TotalTime = 0.111499, [30] [bootstrap]: 0.00026992 [type_inference]: 0.100892 [event_method]: 1.721e-05 [auto_monad]: 6.775e-05 [graph_reusing]: 5.38002e-06 [pre_auto_parallel]: 2.06998e-06 [py_interpret_to_execute]: 0.00044294 [rewriter_before_opt_a]: 7.937e-05 [expand_dump_flag]: 3.21999e-06 [jit_opt_a]: 0.00718369, [2] [Cycle 1]: 0.0035378, [27] [switch_simplify]: 5.306e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00057657 [with_stream_mark]: 1.705e-05 [recompute_prepare]: 8.45001e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 3.15998e-06 [parameter_eliminate]: 1.55999e-06 [specialize_transform]: 7.06999e-06 [updatestate_useless_node_eliminater]: 5.71998e-06 [accelerated_algorithm]: 6.58e-06 [meta_shard_fg_expand]: 2.97002e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 3.55998e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.62e-05 [j_node_and_user_rematch]: 1.027e-05 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 1.033e-05 [inline_without_move]: 6.19999e-06 [renormalize]: 0.0025151 [add_forward_monad_depend]: 7.38e-06 [auto_monad_grad]: 2.59001e-06 [auto_monad_eliminator]: 1.675e-05 [cse]: 2.791e-05 [replace_applicator]: 2.17e-05 [Cycle 2]: 0.00037679, [27] [switch_simplify]: 6.59999e-06 [loop_unroll]: 6.11e-06 [a_1]: 0.00012381 [with_stream_mark]: 1.43e-05 [recompute_prepare]: 5.65001e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 2.96001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 1.32999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.52001e-06 [accelerated_algorithm]: 6.51999e-06 [meta_shard_fg_expand]: 1.82001e-06 [get_grad_eliminate_]: 6.34001e-06 [merge_forward]: 4.4e-06 [cell_reuse_recompute_pass]: 2.84999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.762e-05 [j_node_and_user_rematch]: 9.22999e-06 [meta_fg_expand]: 1.97001e-06 [replace_old_param]: 8.99998e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 8.79983e-07 [auto_monad_eliminator]: 6.24999e-06 [cse]: 1.197e-05 [replace_applicator]: 5.64998e-06 [py_interpret_to_execute_after_opt_a]: 1.25e-05 [rewriter_after_opt_a]: 3.484e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 4.95001e-06 [mutable_eliminate]: 0.0007278 [jit_opt_b]: 5.905e-05, [1] [Cycle 1]: 5.039e-05, [2] [frontend_op_eliminate]: 2.112e-05 [inline_after_opt_a]: 1.842e-05 [cconv]: 2.732e-05 [loop_unroll]: 0.00045387 [jit_opt_after_cconv]: 0.00016685, [1] [Cycle 1]: 0.00016026, [11] [c_1]: 2.679e-05 [parameter_eliminate]: 3.28998e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.58e-06 [updatestate_loads_eliminate]: 2.29999e-06 [cse]: 3.001e-05 [call_graph_tuple_transform]: 2.435e-05 [tuple_list_get_item_eliminator]: 6.48998e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.765e-05 [partial_unused_args_eliminate]: 3.90998e-06 [environ_conv]: 9.18002e-06 [add_recomputation]: 5.322e-05 [cse_after_recomputation]: 2.142e-05, [1] [Cycle 1]: 1.634e-05, [1] [cse]: 1.094e-05 [auto_monad_reorder]: 1.591e-05 [get_jit_bprop_graph]: 1.88002e-06 [rewriter_after_jit_bprop_graph]: 6.39001e-06 [opt_after_jit_grad]: 0.00047666 [symbol_engine_optimizer]: 0.00022307, [1] [Cycle 1]: 7.415e-05, [6] [build]: 3.37002e-06 [elim_shapecalc]: 8.35001e-06 [elim_not_effective]: 1.682e-05 [opt_reshape]: 8.98002e-06 [fold_const_symbol]: 9.12001e-06 [renormalize]: 3.89991e-07 [validate]: 4.645e-05 Sums bootstrap : 0.000270s : 0.25% type_inference : 0.100892s : 93.83% event_method : 0.000017s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000443s : 0.41% rewriter_before_opt_a : 0.000079s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000700s : 0.65% jit_opt_a.with_stream_mark : 0.000031s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000005s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000008s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000034s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002515s : 2.34% jit_opt_a.add_forward_monad_depend : 0.000008s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000027s : 0.03% py_interpret_to_execute_after_opt_a : 0.000013s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000728s : 0.68% jit_opt_b.frontend_op_eliminate : 0.000021s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000027s : 0.03% loop_unroll : 0.000454s : 0.42% jit_opt_after_cconv.c_1 : 0.000027s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000030s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000024s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000018s : 0.02% partial_unused_args_eliminate : 0.000004s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000053s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000477s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000017s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000009s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.04% Time group info: ------[substitution.] 0.000205 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000002s : 2: substitution.fold_const_symbol 3.98% : 0.000008s : 4: substitution.graph_param_transform 80.69% : 0.000165s : 4: substitution.inline 1.78% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.99% : 0.000006s : 4: substitution.remove_not_recompute_node 2.72% : 0.000006s : 2: substitution.replace_old_param 6.12% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100827 2 97.54% : 0.098350s : 1: type_inference.infer 2.46% : 0.002477s : 1: type_inference.specialize ------[replace.] 0.000075 6 68.73% : 0.000051s : 4: replace.inline 31.27% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000174 6 93.43% : 0.000163s : 4: match.inline 6.57% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 1.01% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.43% : 0.000002s : 12: predicate.addn_zero_filter 1.85% : 0.000002s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.86% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.67% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.42% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.36% : 0.000002s : 8: predicate.get_grad_eliminate 0.50% : 0.000001s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.66% : 0.000002s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.16% : 0.000003s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.82% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.12% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.92% : 0.000003s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.84% : 0.000002s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.75% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.11% : 0.000001s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.85% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.36% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.76% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 1.98% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.73% : 0.000009s : 58: predicate.switch_simplify 1.33% : 0.000002s : 12: predicate.tile_eliminate 1.15% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.17% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001902 22 65.08% : 0.001238s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.63% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.29% : 0.000633s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115029 72 0.05% : 0.000057s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.25% : 0.000282s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 6.25% : 0.007187s : 1: jit_opt_a 0.15% : 0.000169s : 1: jit_opt_after_cconv 0.05% : 0.000061s : 1: jit_opt_b 0.40% : 0.000462s : 1: loop_unroll 0.64% : 0.000736s : 1: mutable_eliminate 0.82% : 0.000940s : 26: opt.transform.jit_opt_a 0.05% : 0.000060s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000033s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000017s : 1: opt.transform.mutable_eliminate 0.02% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000485s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000006s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000450s : 1: py_interpret_to_execute 0.01% : 0.000015s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000020s : 1: remove_dup_value 1.54% : 0.001776s : 1: renormalize.infer 0.63% : 0.000730s : 1: renormalize.specialize 0.01% : 0.000009s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.20% : 0.000225s : 1: symbol_engine_optimizer 87.72% : 0.100904s : 1: type_inference TotalTime = 0.111296, [30] [bootstrap]: 0.00026998 [type_inference]: 0.101066 [event_method]: 1.8e-05 [auto_monad]: 6.956e-05 [graph_reusing]: 6.23002e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 0.00044325 [rewriter_before_opt_a]: 8.183e-05 [expand_dump_flag]: 3.91999e-06 [jit_opt_a]: 0.00706711, [2] [Cycle 1]: 0.00339579, [27] [switch_simplify]: 5.593e-05 [loop_unroll]: 2.985e-05 [a_1]: 0.00055334 [with_stream_mark]: 1.74e-05 [recompute_prepare]: 8.17e-06 [updatestate_depend_eliminate]: 3.58e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.41e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.97001e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 3.66999e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.566e-05 [j_node_and_user_rematch]: 9.57001e-06 [meta_fg_expand]: 2.49999e-06 [replace_old_param]: 9.89999e-06 [inline_without_move]: 6.02001e-06 [renormalize]: 0.00239742 [add_forward_monad_depend]: 6.35002e-06 [auto_monad_grad]: 2.64999e-06 [auto_monad_eliminator]: 1.661e-05 [cse]: 3.187e-05 [replace_applicator]: 1.791e-05 [Cycle 2]: 0.0003713, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.71998e-06 [a_1]: 0.00012116 [with_stream_mark]: 1.137e-05 [recompute_prepare]: 5.79e-06 [updatestate_depend_eliminate]: 2.99001e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.29998e-06 [specialize_transform]: 5.40001e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 1.86e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.57002e-06 [cell_reuse_recompute_pass]: 2.53e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.73e-05 [j_node_and_user_rematch]: 8.96002e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 9.19e-06 [inline_without_move]: 5.27999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.14e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 7.65e-06 [cse]: 1.368e-05 [replace_applicator]: 5.81e-06 [py_interpret_to_execute_after_opt_a]: 1.36e-05 [rewriter_after_opt_a]: 3.973e-05 [convert_after_rewriter]: 7.48e-06 [order_py_execute_after_rewriter]: 5.82001e-06 [mutable_eliminate]: 0.00065906 [jit_opt_b]: 5.511e-05, [1] [Cycle 1]: 4.727e-05, [2] [frontend_op_eliminate]: 1.835e-05 [inline_after_opt_a]: 1.839e-05 [cconv]: 2.764e-05 [loop_unroll]: 0.00041305 [jit_opt_after_cconv]: 0.00014899, [1] [Cycle 1]: 0.00014255, [11] [c_1]: 2.568e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 4.87998e-06 [updatestate_assign_eliminate]: 2.39999e-06 [updatestate_loads_eliminate]: 2.12001e-06 [cse]: 2.353e-05 [call_graph_tuple_transform]: 1.899e-05 [tuple_list_get_item_eliminator]: 5.86e-06 [none_parameter_eliminate]: 1.89e-06 [renormalize]: 5.09986e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.493e-05 [partial_unused_args_eliminate]: 2.43e-06 [environ_conv]: 7.95998e-06 [add_recomputation]: 4.838e-05 [cse_after_recomputation]: 2.196e-05, [1] [Cycle 1]: 1.647e-05, [1] [cse]: 1.052e-05 [auto_monad_reorder]: 1.47e-05 [get_jit_bprop_graph]: 1.75001e-06 [rewriter_after_jit_bprop_graph]: 5.02e-06 [opt_after_jit_grad]: 0.00044571 [symbol_engine_optimizer]: 0.00012274, [1] [Cycle 1]: 0.00011643, [6] [build]: 3.4e-06 [elim_shapecalc]: 7.67998e-06 [elim_not_effective]: 1.367e-05 [opt_reshape]: 7.21999e-06 [fold_const_symbol]: 9.65002e-06 [renormalize]: 4.60015e-07 [validate]: 3.863e-05 Sums bootstrap : 0.000270s : 0.25% type_inference : 0.101066s : 94.12% event_method : 0.000018s : 0.02% auto_monad : 0.000070s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000443s : 0.41% rewriter_before_opt_a : 0.000082s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000063s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000675s : 0.63% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000004s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000033s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002397s : 2.23% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000024s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000024s : 0.02% py_interpret_to_execute_after_opt_a : 0.000014s : 0.01% rewriter_after_opt_a : 0.000040s : 0.04% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000659s : 0.61% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000028s : 0.03% loop_unroll : 0.000413s : 0.38% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000024s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000446s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000196 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 81.24% : 0.000160s : 4: substitution.inline 1.82% : 0.000004s : 4: substitution.j_node_and_user_rematch 3.08% : 0.000006s : 4: substitution.remove_not_recompute_node 2.61% : 0.000005s : 2: substitution.replace_old_param 6.73% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100993 2 97.47% : 0.098434s : 1: type_inference.infer 2.53% : 0.002559s : 1: type_inference.specialize ------[replace.] 0.000072 6 67.52% : 0.000048s : 4: replace.inline 32.48% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 92.84% : 0.000157s : 4: match.inline 7.16% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000132 830 1.31% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.39% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000003s : 12: predicate.arithmetic_simplify 1.14% : 0.000001s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.44% : 0.000002s : 12: predicate.depend_value_elim 1.05% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.79% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.05% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.25% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.78% : 0.000002s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.10% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.84% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.71% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.89% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 22: predicate.replace_applicator 0.95% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.43% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.21% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 8: predicate.special_op_eliminate 0.95% : 0.000001s : 8: predicate.specialize_transform 1.55% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.61% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.19% : 0.000003s : 18: predicate.switch_defer_inline 2.03% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.96% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.79% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.61% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001935 22 65.10% : 0.001259s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.50% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.114675 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000283s : 1: bootstrap 0.03% : 0.000030s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 6.17% : 0.007071s : 1: jit_opt_a 0.13% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.37% : 0.000421s : 1: loop_unroll 0.58% : 0.000669s : 1: mutable_eliminate 0.79% : 0.000909s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000453s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000449s : 1: py_interpret_to_execute 0.01% : 0.000016s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.47% : 0.001689s : 1: renormalize.infer 0.61% : 0.000700s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.04% : 0.000043s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.11% : 0.000125s : 1: symbol_engine_optimizer 88.15% : 0.101084s : 1: type_inference TotalTime = 0.0676319, [30] [bootstrap]: 0.00028552 [type_inference]: 0.0576627 [event_method]: 1.819e-05 [auto_monad]: 6.698e-05 [graph_reusing]: 5.25999e-06 [pre_auto_parallel]: 2.44999e-06 [py_interpret_to_execute]: 0.0002897 [rewriter_before_opt_a]: 8.019e-05 [expand_dump_flag]: 3.93001e-06 [jit_opt_a]: 0.00693634, [2] [Cycle 1]: 0.00328349, [27] [switch_simplify]: 5.123e-05 [loop_unroll]: 3.021e-05 [a_1]: 0.00054258 [with_stream_mark]: 1.808e-05 [recompute_prepare]: 9.06002e-06 [updatestate_depend_eliminate]: 4.42998e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 2.88e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 7e-06 [updatestate_useless_node_eliminater]: 6.04001e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.17999e-06 [get_grad_eliminate_]: 5.97001e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.481e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.14999e-06 [replace_old_param]: 1.009e-05 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00230908 [add_forward_monad_depend]: 5.68002e-06 [auto_monad_grad]: 2.68e-06 [auto_monad_eliminator]: 1.689e-05 [cse]: 3.024e-05 [replace_applicator]: 1.544e-05 [Cycle 2]: 0.00035736, [27] [switch_simplify]: 6.71e-06 [loop_unroll]: 5.63997e-06 [a_1]: 0.0001214 [with_stream_mark]: 1.041e-05 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 1.20001e-06 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.57999e-06 [meta_shard_fg_expand]: 1.58002e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 1.87999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.407e-05 [j_node_and_user_rematch]: 8.94998e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 8.51002e-06 [inline_without_move]: 5.49e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.99977e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.179e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 1.016e-05 [rewriter_after_opt_a]: 3.441e-05 [convert_after_rewriter]: 7.07002e-06 [order_py_execute_after_rewriter]: 4.92999e-06 [mutable_eliminate]: 0.00059545 [jit_opt_b]: 5.301e-05, [1] [Cycle 1]: 4.607e-05, [2] [frontend_op_eliminate]: 1.911e-05 [inline_after_opt_a]: 1.665e-05 [cconv]: 2.259e-05 [loop_unroll]: 0.00041986 [jit_opt_after_cconv]: 0.00014678, [1] [Cycle 1]: 0.00014058, [11] [c_1]: 2.532e-05 [parameter_eliminate]: 3.30998e-06 [updatestate_depend_eliminate]: 4.87e-06 [updatestate_assign_eliminate]: 2.24999e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.965e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.26002e-06 [renormalize]: 2.9002e-07 [switch_simplify]: 6.22001e-06 [remove_dup_value]: 1.397e-05 [partial_unused_args_eliminate]: 2.62001e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.55e-05 [cse_after_recomputation]: 2.175e-05, [1] [Cycle 1]: 1.68e-05, [1] [cse]: 1.121e-05 [auto_monad_reorder]: 1.521e-05 [get_jit_bprop_graph]: 2.12001e-06 [rewriter_after_jit_bprop_graph]: 3.62998e-06 [opt_after_jit_grad]: 0.00054734 [symbol_engine_optimizer]: 0.0001245, [1] [Cycle 1]: 0.00011747, [6] [build]: 3.53e-06 [elim_shapecalc]: 8.18999e-06 [elim_not_effective]: 1.306e-05 [opt_reshape]: 6.05002e-06 [fold_const_symbol]: 5.871e-05 [renormalize]: 4.09986e-07 [validate]: 4.229e-05 Sums bootstrap : 0.000286s : 0.45% type_inference : 0.057663s : 90.40% event_method : 0.000018s : 0.03% auto_monad : 0.000067s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000290s : 0.45% rewriter_before_opt_a : 0.000080s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000664s : 1.04% jit_opt_a.with_stream_mark : 0.000028s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.002309s : 3.62% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000042s : 0.07% jit_opt_a.replace_applicator : 0.000021s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000034s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000595s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000420s : 0.66% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000547s : 0.86% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000059s : 0.09% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.07% Time group info: ------[substitution.] 0.000190 24 0.96% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000002s : 2: substitution.fold_const_symbol 3.25% : 0.000006s : 4: substitution.graph_param_transform 81.28% : 0.000154s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.94% : 0.000006s : 4: substitution.remove_not_recompute_node 2.29% : 0.000004s : 2: substitution.replace_old_param 6.68% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.057591 2 96.76% : 0.055726s : 1: type_inference.infer 3.24% : 0.001864s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.24% : 0.000046s : 4: replace.inline 31.76% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000163 6 92.93% : 0.000152s : 4: match.inline 7.07% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.37% : 0.000002s : 12: predicate.accumulaten_eliminater 1.38% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.59% : 0.000002s : 12: predicate.arithmetic_simplify 1.47% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.31% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.70% : 0.000007s : 26: predicate.inline 0.91% : 0.000001s : 8: predicate.inline_without_move 0.45% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.41% : 0.000002s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.19% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.56% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.80% : 0.000001s : 8: predicate.remove_not_recompute_node 2.17% : 0.000003s : 22: predicate.replace_applicator 1.10% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.37% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.31% : 0.000002s : 12: predicate.same_eliminate 0.76% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.34% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.00% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.31% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.66% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002699 34 75.57% : 0.002040s : 27: func_graph_cloner_run.FuncGraphClonerGraph 1.11% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.33% : 0.000630s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.070950 72 0.07% : 0.000048s : 1: add_recomputation 0.10% : 0.000070s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.42% : 0.000298s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.03% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.78% : 0.006939s : 1: jit_opt_a 0.21% : 0.000149s : 1: jit_opt_after_cconv 0.08% : 0.000055s : 1: jit_opt_b 0.60% : 0.000427s : 1: loop_unroll 0.85% : 0.000602s : 1: mutable_eliminate 1.25% : 0.000890s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.12% : 0.000083s : 4: opt.transform.symbol_engine_opt 0.78% : 0.000555s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.42% : 0.000295s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000016s : 1: remove_dup_value 2.27% : 0.001610s : 1: renormalize.infer 0.97% : 0.000691s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000037s : 1: rewriter_after_opt_a 0.12% : 0.000085s : 1: rewriter_before_opt_a 0.18% : 0.000127s : 1: symbol_engine_optimizer 81.29% : 0.057676s : 1: type_inference TotalTime = 0.0595279, [30] [bootstrap]: 0.0002753 [type_inference]: 0.0507329 [event_method]: 1.585e-05 [auto_monad]: 4.89e-05 [graph_reusing]: 4.18001e-06 [pre_auto_parallel]: 1.79e-06 [py_interpret_to_execute]: 0.00024595 [rewriter_before_opt_a]: 7.413e-05 [expand_dump_flag]: 2.34999e-06 [jit_opt_a]: 0.00603419, [2] [Cycle 1]: 0.00265626, [27] [switch_simplify]: 4.655e-05 [loop_unroll]: 3.003e-05 [a_1]: 0.00051141 [with_stream_mark]: 1.272e-05 [recompute_prepare]: 7.85998e-06 [updatestate_depend_eliminate]: 3.03e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.27999e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 6.54001e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 2.81e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.205e-05 [j_node_and_user_rematch]: 9.40001e-06 [meta_fg_expand]: 1.95001e-06 [replace_old_param]: 8.63001e-06 [inline_without_move]: 5.86e-06 [renormalize]: 0.00176166 [add_forward_monad_depend]: 4.67e-06 [auto_monad_grad]: 2.62001e-06 [auto_monad_eliminator]: 1.273e-05 [cse]: 2.043e-05 [replace_applicator]: 1.337e-05 [Cycle 2]: 0.00034501, [27] [switch_simplify]: 6.34001e-06 [loop_unroll]: 5.44e-06 [a_1]: 0.00011815 [with_stream_mark]: 8.48999e-06 [recompute_prepare]: 5.68997e-06 [updatestate_depend_eliminate]: 2.58003e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.38002e-06 [updatestate_useless_node_eliminater]: 5.30999e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.61998e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.374e-05 [j_node_and_user_rematch]: 8.18999e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 7.61999e-06 [inline_without_move]: 5.61003e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.10999e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.08e-05 [replace_applicator]: 5.74e-06 [py_interpret_to_execute_after_opt_a]: 9.46e-06 [rewriter_after_opt_a]: 2.971e-05 [convert_after_rewriter]: 6.85998e-06 [order_py_execute_after_rewriter]: 4.57e-06 [mutable_eliminate]: 0.00058607 [jit_opt_b]: 5.184e-05, [1] [Cycle 1]: 4.58e-05, [2] [frontend_op_eliminate]: 1.817e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 2.098e-05 [loop_unroll]: 0.00041531 [jit_opt_after_cconv]: 0.00014441, [1] [Cycle 1]: 0.00013878, [11] [c_1]: 2.529e-05 [parameter_eliminate]: 2.53e-06 [updatestate_depend_eliminate]: 5.69e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.48998e-06 [cse]: 1.924e-05 [call_graph_tuple_transform]: 1.954e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.47999e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.186e-05 [partial_unused_args_eliminate]: 1.82999e-06 [environ_conv]: 7.3e-06 [add_recomputation]: 3.923e-05 [cse_after_recomputation]: 2.098e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.066e-05 [auto_monad_reorder]: 1.263e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 4.13001e-06 [opt_after_jit_grad]: 0.0004502 [symbol_engine_optimizer]: 7.24e-05, [1] [Cycle 1]: 6.677e-05, [6] [build]: 2.94999e-06 [elim_shapecalc]: 8.48999e-06 [elim_not_effective]: 1.278e-05 [opt_reshape]: 6.07999e-06 [fold_const_symbol]: 9.15001e-06 [renormalize]: 4.09986e-07 [validate]: 4.868e-05 Sums bootstrap : 0.000275s : 0.49% type_inference : 0.050733s : 90.65% event_method : 0.000016s : 0.03% auto_monad : 0.000049s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000246s : 0.44% rewriter_before_opt_a : 0.000074s : 0.13% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000630s : 1.12% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001762s : 3.15% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000031s : 0.06% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000030s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000586s : 1.05% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000021s : 0.04% loop_unroll : 0.000415s : 0.74% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000039s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000450s : 0.80% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000049s : 0.09% Time group info: ------[substitution.] 0.000168 24 1.25% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.41% : 0.000006s : 4: substitution.graph_param_transform 82.05% : 0.000138s : 4: substitution.inline 1.72% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.93% : 0.000005s : 4: substitution.remove_not_recompute_node 1.97% : 0.000003s : 2: substitution.replace_old_param 6.01% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050670 2 96.63% : 0.048963s : 1: type_inference.infer 3.37% : 0.001706s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.31% : 0.000043s : 4: replace.inline 32.69% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000144 6 93.78% : 0.000135s : 4: match.inline 6.22% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.16% : 0.000001s : 12: predicate.accumulaten_eliminater 1.31% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.54% : 0.000001s : 4: predicate.elim_not_effective 0.74% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.48% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000000s : 4: predicate.graph_param_transform 5.46% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.80% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000001s : 12: predicate.print_const_string_wrapper 1.68% : 0.000002s : 12: predicate.reduce_eliminate 1.36% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.42% : 0.000001s : 4: predicate.reset_defer_inline 1.44% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.16% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.37% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.53% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 2.00% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002037 26 72.57% : 0.001478s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.95% : 0.000529s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062199 72 0.07% : 0.000042s : 1: add_recomputation 0.08% : 0.000052s : 1: auto_monad 0.02% : 0.000015s : 1: auto_monad_reorder 0.46% : 0.000288s : 1: bootstrap 0.04% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.03% : 0.000019s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.71% : 0.006037s : 1: jit_opt_a 0.24% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.68% : 0.000423s : 1: loop_unroll 0.96% : 0.000595s : 1: mutable_eliminate 1.36% : 0.000844s : 26: opt.transform.jit_opt_a 0.09% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000457s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000251s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 1.90% : 0.001185s : 1: renormalize.infer 0.92% : 0.000571s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.13% : 0.000078s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 81.58% : 0.050742s : 1: type_inference TotalTime = 0.0599963, [30] [bootstrap]: 0.00026434 [type_inference]: 0.0507619 [event_method]: 1.717e-05 [auto_monad]: 6.594e-05 [graph_reusing]: 6.28e-06 [pre_auto_parallel]: 2.36e-06 [py_interpret_to_execute]: 0.0002679 [rewriter_before_opt_a]: 7.976e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00653049, [2] [Cycle 1]: 0.00286452, [27] [switch_simplify]: 5.425e-05 [loop_unroll]: 3.188e-05 [a_1]: 0.00054508 [with_stream_mark]: 1.562e-05 [recompute_prepare]: 7.51999e-06 [updatestate_depend_eliminate]: 3.58999e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.23998e-06 [parameter_eliminate]: 1.76e-06 [specialize_transform]: 6.64999e-06 [updatestate_useless_node_eliminater]: 5.59e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 4.50999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.492e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.52001e-06 [inline_without_move]: 6.26998e-06 [renormalize]: 0.00189663 [add_forward_monad_depend]: 4.91002e-06 [auto_monad_grad]: 2.43e-06 [auto_monad_eliminator]: 1.411e-05 [cse]: 2.996e-05 [replace_applicator]: 1.181e-05 [Cycle 2]: 0.00034143, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.52001e-06 [a_1]: 0.00011625 [with_stream_mark]: 8.90999e-06 [recompute_prepare]: 5.85002e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 1.94999e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.63002e-06 [updatestate_useless_node_eliminater]: 5.45001e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 2.26e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.266e-05 [j_node_and_user_rematch]: 8.61997e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 8.10999e-06 [inline_without_move]: 5.15001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 4.95999e-06 [cse]: 1.032e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 1.04e-05 [rewriter_after_opt_a]: 3.306e-05 [convert_after_rewriter]: 7.50998e-06 [order_py_execute_after_rewriter]: 4.93001e-06 [mutable_eliminate]: 0.00051928 [jit_opt_b]: 5.195e-05, [1] [Cycle 1]: 4.519e-05, [2] [frontend_op_eliminate]: 1.779e-05 [inline_after_opt_a]: 1.686e-05 [cconv]: 2.485e-05 [loop_unroll]: 0.00039857 [jit_opt_after_cconv]: 0.00014141, [1] [Cycle 1]: 0.00013504, [11] [c_1]: 2.428e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.34e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.828e-05 [call_graph_tuple_transform]: 1.947e-05 [tuple_list_get_item_eliminator]: 5.91003e-06 [none_parameter_eliminate]: 1.44e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 1.52e-05 [partial_unused_args_eliminate]: 2.04999e-06 [environ_conv]: 7.30998e-06 [add_recomputation]: 4.764e-05 [cse_after_recomputation]: 2.019e-05, [1] [Cycle 1]: 1.472e-05, [1] [cse]: 9.41e-06 [auto_monad_reorder]: 1.542e-05 [get_jit_bprop_graph]: 1.84e-06 [rewriter_after_jit_bprop_graph]: 4.64002e-06 [opt_after_jit_grad]: 0.0004332 [symbol_engine_optimizer]: 6.922e-05, [1] [Cycle 1]: 6.366e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 8.01001e-06 [elim_not_effective]: 1.273e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 8.33001e-06 [renormalize]: 2.59985e-07 [validate]: 3.505e-05 Sums bootstrap : 0.000264s : 0.47% type_inference : 0.050762s : 90.43% event_method : 0.000017s : 0.03% auto_monad : 0.000066s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000268s : 0.48% rewriter_before_opt_a : 0.000080s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000061s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000661s : 1.18% jit_opt_a.with_stream_mark : 0.000025s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001897s : 3.38% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000040s : 0.07% jit_opt_a.replace_applicator : 0.000017s : 0.03% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000033s : 0.06% convert_after_rewriter : 0.000008s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000519s : 0.93% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000025s : 0.04% loop_unroll : 0.000399s : 0.71% jit_opt_after_cconv.c_1 : 0.000024s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000048s : 0.08% cse_after_recomputation.cse : 0.000009s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000433s : 0.77% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.06% Time group info: ------[substitution.] 0.000192 24 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.42% : 0.000001s : 2: substitution.fold_const_symbol 2.68% : 0.000005s : 4: substitution.graph_param_transform 83.37% : 0.000160s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.38% : 0.000005s : 4: substitution.remove_not_recompute_node 2.10% : 0.000004s : 2: substitution.replace_old_param 6.37% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050691 2 96.44% : 0.048888s : 1: type_inference.infer 3.56% : 0.001803s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.25% : 0.000047s : 4: replace.inline 31.75% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000169 6 93.39% : 0.000158s : 4: match.inline 6.61% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.41% : 0.000002s : 12: predicate.accumulaten_eliminater 1.00% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.24% : 0.000002s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.33% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.37% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.97% : 0.000002s : 18: predicate.load_eliminater 1.29% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.40% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.44% : 0.000003s : 18: predicate.partial_eliminate 1.29% : 0.000002s : 12: predicate.print_const_string_wrapper 1.72% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.88% : 0.000001s : 8: predicate.remove_not_recompute_node 2.16% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.40% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.22% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.43% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.65% : 0.000010s : 58: predicate.switch_simplify 1.44% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.00% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002015 26 71.98% : 0.001450s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.64% : 0.000537s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062851 72 0.08% : 0.000050s : 1: add_recomputation 0.11% : 0.000069s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000275s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 10.40% : 0.006534s : 1: jit_opt_a 0.23% : 0.000144s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.65% : 0.000406s : 1: loop_unroll 0.84% : 0.000526s : 1: mutable_eliminate 1.41% : 0.000883s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000012s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000440s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000274s : 1: py_interpret_to_execute 0.02% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 2.02% : 0.001270s : 1: renormalize.infer 0.98% : 0.000619s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000036s : 1: rewriter_after_opt_a 0.13% : 0.000085s : 1: rewriter_before_opt_a 0.11% : 0.000071s : 1: symbol_engine_optimizer 80.79% : 0.050777s : 1: type_inference TotalTime = 0.0589521, [30] [bootstrap]: 0.00025452 [type_inference]: 0.0497336 [event_method]: 1.752e-05 [auto_monad]: 6.485e-05 [graph_reusing]: 5.82999e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 0.00027392 [rewriter_before_opt_a]: 7.765e-05 [expand_dump_flag]: 3.45e-06 [jit_opt_a]: 0.00642071, [2] [Cycle 1]: 0.00280761, [27] [switch_simplify]: 5.242e-05 [loop_unroll]: 3.066e-05 [a_1]: 0.00055674 [with_stream_mark]: 1.762e-05 [recompute_prepare]: 8.09997e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 6.34001e-06 [updatestate_useless_node_eliminater]: 5.77999e-06 [accelerated_algorithm]: 6.31e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.08002e-06 [merge_forward]: 3.63e-06 [cell_reuse_recompute_pass]: 1.04003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.523e-05 [j_node_and_user_rematch]: 9.94001e-06 [meta_fg_expand]: 2.32001e-06 [replace_old_param]: 9.69e-06 [inline_without_move]: 5.74e-06 [renormalize]: 0.00181681 [add_forward_monad_depend]: 5.47001e-06 [auto_monad_grad]: 2.58e-06 [auto_monad_eliminator]: 1.576e-05 [cse]: 3.165e-05 [replace_applicator]: 1.387e-05 [Cycle 2]: 0.00035218, [27] [switch_simplify]: 6.68e-06 [loop_unroll]: 5.89999e-06 [a_1]: 0.00011759 [with_stream_mark]: 9.94001e-06 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 2.71e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.34e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 5.13002e-06 [merge_forward]: 2.54001e-06 [cell_reuse_recompute_pass]: 1.47999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.23999e-06 [inline_without_move]: 5.22e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 7.00005e-07 [auto_monad_eliminator]: 5.82001e-06 [cse]: 1.207e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 9.91e-06 [rewriter_after_opt_a]: 3.516e-05 [convert_after_rewriter]: 6.44001e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00056682 [jit_opt_b]: 5.337e-05, [1] [Cycle 1]: 4.563e-05, [2] [frontend_op_eliminate]: 1.801e-05 [inline_after_opt_a]: 1.672e-05 [cconv]: 2.42e-05 [loop_unroll]: 0.00040408 [jit_opt_after_cconv]: 0.00014457, [1] [Cycle 1]: 0.00013821, [11] [c_1]: 2.508e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.89e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 2.085e-05 [call_graph_tuple_transform]: 1.941e-05 [tuple_list_get_item_eliminator]: 5.97001e-06 [none_parameter_eliminate]: 1.67999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 1.447e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 8.60001e-06 [add_recomputation]: 5.697e-05 [cse_after_recomputation]: 2.171e-05, [1] [Cycle 1]: 1.583e-05, [1] [cse]: 1.041e-05 [auto_monad_reorder]: 1.566e-05 [get_jit_bprop_graph]: 1.79e-06 [rewriter_after_jit_bprop_graph]: 4.31002e-06 [opt_after_jit_grad]: 0.000447 [symbol_engine_optimizer]: 7.187e-05, [1] [Cycle 1]: 6.625e-05, [6] [build]: 3.5e-06 [elim_shapecalc]: 8.25999e-06 [elim_not_effective]: 1.251e-05 [opt_reshape]: 6.18002e-06 [fold_const_symbol]: 9.34e-06 [renormalize]: 2.80008e-07 [validate]: 4.759e-05 Sums bootstrap : 0.000255s : 0.46% type_inference : 0.049734s : 90.19% event_method : 0.000018s : 0.03% auto_monad : 0.000065s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000274s : 0.50% rewriter_before_opt_a : 0.000078s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000059s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000674s : 1.22% jit_opt_a.with_stream_mark : 0.000028s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.06% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001817s : 3.29% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000044s : 0.08% jit_opt_a.replace_applicator : 0.000020s : 0.04% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000035s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000567s : 1.03% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000404s : 0.73% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.02% add_recomputation : 0.000057s : 0.10% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000447s : 0.81% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000048s : 0.09% Time group info: ------[substitution.] 0.000187 24 1.00% : 0.000002s : 2: substitution.elim_not_effective 0.69% : 0.000001s : 2: substitution.fold_const_symbol 3.00% : 0.000006s : 4: substitution.graph_param_transform 82.42% : 0.000154s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000005s : 4: substitution.remove_not_recompute_node 2.46% : 0.000005s : 2: substitution.replace_old_param 6.04% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049666 2 96.44% : 0.047898s : 1: type_inference.infer 3.56% : 0.001767s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.61% : 0.000044s : 4: replace.inline 33.39% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 93.67% : 0.000151s : 4: match.inline 6.33% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000142 830 1.14% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.04% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.58% : 0.000002s : 12: predicate.arithmetic_simplify 1.12% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 0.99% : 0.000001s : 12: predicate.compare_switch_simplify 1.01% : 0.000001s : 12: predicate.depend_value_elim 0.98% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000002s : 12: predicate.dict_get_item_eliminator 11.07% : 0.000016s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.06% : 0.000002s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.99% : 0.000001s : 12: predicate.environ_get_depend_swap 1.06% : 0.000002s : 12: predicate.environ_get_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 1.01% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.87% : 0.000007s : 26: predicate.inline 0.87% : 0.000001s : 8: predicate.inline_without_move 0.42% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.04% : 0.000001s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.63% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.49% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.68% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 0.98% : 0.000001s : 12: predicate.merge_addn 0.99% : 0.000001s : 12: predicate.minmaximum_grad 1.30% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.14% : 0.000003s : 18: predicate.partial_eliminate 1.07% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.28% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.89% : 0.000003s : 22: predicate.replace_applicator 0.91% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.01% : 0.000001s : 12: predicate.reshape_eliminate 1.16% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.04% : 0.000001s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 0.96% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.13% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.41% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.45% : 0.000003s : 18: predicate.switch_defer_inline 1.78% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.71% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.12% : 0.000002s : 12: predicate.transpose_eliminate 1.18% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.60% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.27% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.30% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.57% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.70% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.43% : 0.000002s : 12: predicate.value_based_eliminate 0.30% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001992 26 72.05% : 0.001435s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.59% : 0.000530s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.061729 72 0.10% : 0.000060s : 1: add_recomputation 0.11% : 0.000068s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.43% : 0.000266s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.41% : 0.006424s : 1: jit_opt_a 0.24% : 0.000147s : 1: jit_opt_after_cconv 0.09% : 0.000056s : 1: jit_opt_b 0.67% : 0.000411s : 1: loop_unroll 0.93% : 0.000575s : 1: mutable_eliminate 1.45% : 0.000898s : 26: opt.transform.jit_opt_a 0.09% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.74% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.46% : 0.000281s : 1: py_interpret_to_execute 0.02% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.99% : 0.001225s : 1: renormalize.infer 0.94% : 0.000583s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000038s : 1: rewriter_after_opt_a 0.13% : 0.000082s : 1: rewriter_before_opt_a 0.12% : 0.000075s : 1: symbol_engine_optimizer 80.59% : 0.049746s : 1: type_inference TotalTime = 0.108405, [30] [bootstrap]: 0.0002611 [type_inference]: 0.0989988 [event_method]: 1.659e-05 [auto_monad]: 4.57e-05 [graph_reusing]: 3.91999e-06 [pre_auto_parallel]: 1.81998e-06 [py_interpret_to_execute]: 0.00042166 [rewriter_before_opt_a]: 7.46e-05 [expand_dump_flag]: 2.39999e-06 [jit_opt_a]: 0.00658743, [2] [Cycle 1]: 0.00319395, [27] [switch_simplify]: 4.612e-05 [loop_unroll]: 3.097e-05 [a_1]: 0.00050204 [with_stream_mark]: 1.335e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.90025e-07 [specialize_transform]: 6.72002e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 5.96e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 2.86e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.2e-05 [j_node_and_user_rematch]: 8.86002e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 8.60001e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.00230556 [add_forward_monad_depend]: 4.85001e-06 [auto_monad_grad]: 2.03002e-06 [auto_monad_eliminator]: 1.319e-05 [cse]: 2.059e-05 [replace_applicator]: 1.342e-05 [Cycle 2]: 0.00035184, [27] [switch_simplify]: 6.55002e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.00012108 [with_stream_mark]: 9.31002e-06 [recompute_prepare]: 5.90002e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.93998e-06 [updatestate_useless_node_eliminater]: 5.51e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.16997e-06 [get_grad_eliminate_]: 5.25999e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.77999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.288e-05 [j_node_and_user_rematch]: 8.54002e-06 [meta_fg_expand]: 1.51002e-06 [replace_old_param]: 8.06001e-06 [inline_without_move]: 5.28002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.90025e-07 [auto_monad_grad]: 7.49977e-07 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.058e-05 [replace_applicator]: 5.91e-06 [py_interpret_to_execute_after_opt_a]: 8.52998e-06 [rewriter_after_opt_a]: 2.788e-05 [convert_after_rewriter]: 5.49e-06 [order_py_execute_after_rewriter]: 4.33999e-06 [mutable_eliminate]: 0.00053155 [jit_opt_b]: 5.195e-05, [1] [Cycle 1]: 4.595e-05, [2] [frontend_op_eliminate]: 1.841e-05 [inline_after_opt_a]: 1.683e-05 [cconv]: 1.676e-05 [loop_unroll]: 0.00040825 [jit_opt_after_cconv]: 0.00014229, [1] [Cycle 1]: 0.00013601, [11] [c_1]: 2.493e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.71998e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.789e-05 [call_graph_tuple_transform]: 1.963e-05 [tuple_list_get_item_eliminator]: 6.14999e-06 [none_parameter_eliminate]: 1.10999e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.88002e-06 [remove_dup_value]: 8.77e-06 [partial_unused_args_eliminate]: 1.49e-06 [environ_conv]: 6.11998e-06 [add_recomputation]: 3.187e-05 [cse_after_recomputation]: 2.1e-05, [1] [Cycle 1]: 1.563e-05, [1] [cse]: 1.009e-05 [auto_monad_reorder]: 1.073e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.22998e-06 [opt_after_jit_grad]: 0.00045552 [symbol_engine_optimizer]: 6.939e-05, [1] [Cycle 1]: 6.372e-05, [6] [build]: 2.85002e-06 [elim_shapecalc]: 7.86001e-06 [elim_not_effective]: 1.257e-05 [opt_reshape]: 5.82999e-06 [fold_const_symbol]: 8.64e-06 [renormalize]: 3.59985e-07 [validate]: 3.084e-05 Sums bootstrap : 0.000261s : 0.25% type_inference : 0.098999s : 94.44% event_method : 0.000017s : 0.02% auto_monad : 0.000046s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000422s : 0.40% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000623s : 0.59% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002306s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000532s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000017s : 0.02% loop_unroll : 0.000408s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000011s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000456s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.03% Time group info: ------[substitution.] 0.000152 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.64% : 0.000001s : 2: substitution.fold_const_symbol 2.96% : 0.000005s : 4: substitution.graph_param_transform 83.43% : 0.000127s : 4: substitution.inline 1.81% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000004s : 4: substitution.remove_not_recompute_node 2.37% : 0.000004s : 2: substitution.replace_old_param 4.89% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098939 2 97.43% : 0.096394s : 1: type_inference.infer 2.57% : 0.002545s : 1: type_inference.specialize ------[replace.] 0.000064 6 65.70% : 0.000042s : 4: replace.inline 34.30% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000131 6 95.19% : 0.000125s : 4: match.inline 4.81% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000002s : 12: predicate.arithmetic_simplify 1.22% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.08% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.23% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.36% : 0.000002s : 12: predicate.environ_get_eliminate 1.28% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.54% : 0.000001s : 4: predicate.graph_param_transform 5.26% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000001s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.36% : 0.000002s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.46% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.60% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.26% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.85% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 6.94% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.57% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001906 22 64.45% : 0.001228s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.40% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.15% : 0.000651s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111631 72 0.03% : 0.000035s : 1: add_recomputation 0.04% : 0.000049s : 1: auto_monad 0.01% : 0.000013s : 1: auto_monad_reorder 0.24% : 0.000272s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.90% : 0.006591s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.37% : 0.000415s : 1: loop_unroll 0.48% : 0.000539s : 1: mutable_eliminate 0.75% : 0.000838s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000427s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.43% : 0.001601s : 1: renormalize.infer 0.62% : 0.000698s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000079s : 1: rewriter_before_opt_a 0.06% : 0.000072s : 1: symbol_engine_optimizer 88.70% : 0.099012s : 1: type_inference TotalTime = 0.109653, [30] [bootstrap]: 0.00024691 [type_inference]: 0.099896 [event_method]: 1.707e-05 [auto_monad]: 5.103e-05 [graph_reusing]: 3.81001e-06 [pre_auto_parallel]: 1.60001e-06 [py_interpret_to_execute]: 0.00043226 [rewriter_before_opt_a]: 7.693e-05 [expand_dump_flag]: 2.26e-06 [jit_opt_a]: 0.00679318, [2] [Cycle 1]: 0.0033678, [27] [switch_simplify]: 4.615e-05 [loop_unroll]: 2.969e-05 [a_1]: 0.00054135 [with_stream_mark]: 1.408e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 2.43998e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 6.83998e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.66002e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 3.06001e-06 [cell_reuse_recompute_pass]: 9.39996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.214e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 1.79e-06 [replace_old_param]: 8.80999e-06 [inline_without_move]: 6.11998e-06 [renormalize]: 0.00242024 [add_forward_monad_depend]: 5.49e-06 [auto_monad_grad]: 1.82001e-06 [auto_monad_eliminator]: 1.407e-05 [cse]: 2.746e-05 [replace_applicator]: 1.701e-05 [Cycle 2]: 0.00036134, [27] [switch_simplify]: 6.41998e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00012112 [with_stream_mark]: 1.125e-05 [recompute_prepare]: 5.97999e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.33002e-06 [specialize_transform]: 5.68002e-06 [updatestate_useless_node_eliminater]: 5.61e-06 [accelerated_algorithm]: 5.70001e-06 [meta_shard_fg_expand]: 1.50999e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 2.58998e-06 [cell_reuse_recompute_pass]: 1.86003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.453e-05 [j_node_and_user_rematch]: 8.89e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 7.64002e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 8.29983e-07 [auto_monad_eliminator]: 6.29001e-06 [cse]: 1.151e-05 [replace_applicator]: 5.77999e-06 [py_interpret_to_execute_after_opt_a]: 1.088e-05 [rewriter_after_opt_a]: 3.195e-05 [convert_after_rewriter]: 6.76999e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00061407 [jit_opt_b]: 5.413e-05, [1] [Cycle 1]: 4.72e-05, [2] [frontend_op_eliminate]: 1.854e-05 [inline_after_opt_a]: 1.853e-05 [cconv]: 2.248e-05 [loop_unroll]: 0.00043086 [jit_opt_after_cconv]: 0.00014486, [1] [Cycle 1]: 0.0001387, [11] [c_1]: 2.579e-05 [parameter_eliminate]: 2.69999e-06 [updatestate_depend_eliminate]: 5.18002e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.953e-05 [call_graph_tuple_transform]: 2.03e-05 [tuple_list_get_item_eliminator]: 5.96e-06 [none_parameter_eliminate]: 1.37e-06 [renormalize]: 5.59987e-07 [switch_simplify]: 6.28e-06 [remove_dup_value]: 1.282e-05 [partial_unused_args_eliminate]: 1.97999e-06 [environ_conv]: 6.99001e-06 [add_recomputation]: 4.154e-05 [cse_after_recomputation]: 2.093e-05, [1] [Cycle 1]: 1.586e-05, [1] [cse]: 1.053e-05 [auto_monad_reorder]: 1.259e-05 [get_jit_bprop_graph]: 1.76e-06 [rewriter_after_jit_bprop_graph]: 4.12e-06 [opt_after_jit_grad]: 0.00044337 [symbol_engine_optimizer]: 7.121e-05, [1] [Cycle 1]: 6.527e-05, [6] [build]: 2.94001e-06 [elim_shapecalc]: 8.62998e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 6.29001e-06 [fold_const_symbol]: 8.85001e-06 [renormalize]: 2.3999e-07 [validate]: 3.646e-05 Sums bootstrap : 0.000247s : 0.23% type_inference : 0.099896s : 94.20% event_method : 0.000017s : 0.02% auto_monad : 0.000051s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000432s : 0.41% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000662s : 0.62% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002420s : 2.28% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000023s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000614s : 0.58% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000019s : 0.02% cconv : 0.000022s : 0.02% loop_unroll : 0.000431s : 0.41% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000042s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000443s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.03% Time group info: ------[substitution.] 0.000183 24 0.89% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000002s : 2: substitution.fold_const_symbol 3.15% : 0.000006s : 4: substitution.graph_param_transform 83.40% : 0.000153s : 4: substitution.inline 1.94% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000004s : 4: substitution.remove_not_recompute_node 1.83% : 0.000003s : 2: substitution.replace_old_param 5.52% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099838 2 97.58% : 0.097423s : 1: type_inference.infer 2.42% : 0.002415s : 1: type_inference.specialize ------[replace.] 0.000068 6 66.72% : 0.000045s : 4: replace.inline 33.28% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 94.42% : 0.000151s : 4: match.inline 5.58% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.47% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000002s : 12: predicate.arithmetic_simplify 1.38% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000001s : 12: predicate.depend_value_elim 1.08% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.28% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.47% : 0.000001s : 4: predicate.graph_param_transform 5.48% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.24% : 0.000002s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.39% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.33% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.16% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.22% : 0.000003s : 18: predicate.partial_eliminate 1.32% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 2.22% : 0.000003s : 22: predicate.replace_applicator 0.68% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.41% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.54% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.18% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.32% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.73% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.30% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.80% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001941 22 64.30% : 0.001248s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.81% : 0.000035s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.89% : 0.000658s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113032 72 0.04% : 0.000044s : 1: add_recomputation 0.05% : 0.000054s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.23% : 0.000259s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.01% : 0.006796s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.39% : 0.000438s : 1: loop_unroll 0.55% : 0.000623s : 1: mutable_eliminate 0.78% : 0.000881s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.39% : 0.000438s : 1: py_interpret_to_execute 0.01% : 0.000013s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.50% : 0.001697s : 1: renormalize.infer 0.63% : 0.000715s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.06% : 0.000073s : 1: symbol_engine_optimizer 88.39% : 0.099908s : 1: type_inference TotalTime = 0.011224, [30] [bootstrap]: 0.00024756 [type_inference]: 0.00414894 [event_method]: 1.634e-05 [auto_monad]: 5.905e-05 [graph_reusing]: 4.84e-06 [pre_auto_parallel]: 1.77999e-06 [py_interpret_to_execute]: 3.198e-05 [rewriter_before_opt_a]: 6.627e-05 [expand_dump_flag]: 2.52001e-06 [jit_opt_a]: 0.00473658, [2] [Cycle 1]: 0.00143997, [27] [switch_simplify]: 4.779e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00048489 [with_stream_mark]: 1.363e-05 [recompute_prepare]: 7.01999e-06 [updatestate_depend_eliminate]: 3.23998e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 9.50007e-07 [specialize_transform]: 5.87999e-06 [updatestate_useless_node_eliminater]: 4.91002e-06 [accelerated_algorithm]: 5.29998e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.40001e-06 [merge_forward]: 3.08998e-06 [cell_reuse_recompute_pass]: 7.89994e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 8.43001e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.34998e-06 [renormalize]: 0.00057729 [add_forward_monad_depend]: 4.79e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 1.317e-05 [cse]: 1.996e-05 [replace_applicator]: 1.086e-05 [Cycle 2]: 0.00030724, [27] [switch_simplify]: 5.57999e-06 [loop_unroll]: 4.77e-06 [a_1]: 8.842e-05 [with_stream_mark]: 8.74998e-06 [recompute_prepare]: 4.79998e-06 [updatestate_depend_eliminate]: 2.97002e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.03002e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 4.75001e-06 [updatestate_useless_node_eliminater]: 4.65001e-06 [accelerated_algorithm]: 4.67998e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.45999e-06 [merge_forward]: 2.33998e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.224e-05 [j_node_and_user_rematch]: 7.60998e-06 [meta_fg_expand]: 1.45001e-06 [replace_old_param]: 6.91999e-06 [inline_without_move]: 4.79e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.08001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.56e-06 [cse]: 9.69e-06 [replace_applicator]: 4.84e-06 [py_interpret_to_execute_after_opt_a]: 7.49002e-06 [rewriter_after_opt_a]: 3.017e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 5.22e-06 [mutable_eliminate]: 0.00046051 [jit_opt_b]: 4.671e-05, [1] [Cycle 1]: 4.046e-05, [2] [frontend_op_eliminate]: 1.498e-05 [inline_after_opt_a]: 1.475e-05 [cconv]: 2.196e-05 [loop_unroll]: 0.00039717 [jit_opt_after_cconv]: 0.00013131, [1] [Cycle 1]: 0.00012528, [11] [c_1]: 2.023e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.66e-05 [call_graph_tuple_transform]: 1.711e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.60001e-06 [renormalize]: 2.80008e-07 [switch_simplify]: 5.03002e-06 [remove_dup_value]: 1.393e-05 [partial_unused_args_eliminate]: 1.96e-06 [environ_conv]: 5.02999e-06 [add_recomputation]: 4.196e-05 [cse_after_recomputation]: 2.059e-05, [1] [Cycle 1]: 1.543e-05, [1] [cse]: 9.97001e-06 [auto_monad_reorder]: 1.362e-05 [get_jit_bprop_graph]: 1.43002e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.00044449 [symbol_engine_optimizer]: 6.929e-05, [1] [Cycle 1]: 6.377e-05, [6] [build]: 2.86e-06 [elim_shapecalc]: 7.56001e-06 [elim_not_effective]: 1.276e-05 [opt_reshape]: 5.29e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 3.59985e-07 [validate]: 2.958e-05 Sums bootstrap : 0.000248s : 3.21% type_inference : 0.004149s : 53.85% event_method : 0.000016s : 0.21% auto_monad : 0.000059s : 0.77% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000032s : 0.42% rewriter_before_opt_a : 0.000066s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000053s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.45% jit_opt_a.a_1 : 0.000573s : 7.44% jit_opt_a.with_stream_mark : 0.000022s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.02% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000577s : 7.49% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.24% jit_opt_a.cse : 0.000030s : 0.38% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000007s : 0.10% rewriter_after_opt_a : 0.000030s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000461s : 5.98% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000022s : 0.29% loop_unroll : 0.000397s : 5.16% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000042s : 0.54% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000014s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000444s : 5.77% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.38% Time group info: ------[substitution.] 0.000164 23 1.20% : 0.000002s : 2: substitution.elim_not_effective 1.00% : 0.000002s : 2: substitution.fold_const_symbol 2.85% : 0.000005s : 3: substitution.graph_param_transform 81.91% : 0.000134s : 4: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.90% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000003s : 2: substitution.replace_old_param 6.53% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004099 2 81.31% : 0.003333s : 1: type_inference.infer 18.69% : 0.000766s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.40% : 0.000041s : 4: replace.inline 33.60% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 93.19% : 0.000131s : 4: match.inline 6.81% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.34% : 0.000001s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000001s : 10: predicate.addn_zero_filter 1.83% : 0.000002s : 10: predicate.arithmetic_simplify 1.44% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.39% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.40% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.33% : 0.000001s : 10: predicate.environ_get_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.95% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.44% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.45% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 6: predicate.less_batch_normalization 1.45% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.65% : 0.000002s : 3: predicate.mutable_eliminate 0.46% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.51% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.85% : 0.000002s : 18: predicate.replace_applicator 0.62% : 0.000001s : 6: predicate.replace_old_param 0.26% : 0.000000s : 3: predicate.reset_defer_inline 1.15% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.51% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.21% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.64% : 0.000008s : 53: predicate.switch_simplify 1.36% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.52% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.99% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000548 13 50.41% : 0.000276s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.72% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.87% : 0.000246s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012625 72 0.36% : 0.000045s : 1: add_recomputation 0.49% : 0.000062s : 1: auto_monad 0.13% : 0.000016s : 1: auto_monad_reorder 2.05% : 0.000259s : 1: bootstrap 0.20% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.15% : 0.000019s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.54% : 0.004740s : 1: jit_opt_a 1.06% : 0.000134s : 1: jit_opt_after_cconv 0.39% : 0.000049s : 1: jit_opt_b 3.20% : 0.000404s : 1: loop_unroll 3.71% : 0.000468s : 1: mutable_eliminate 6.10% : 0.000770s : 26: opt.transform.jit_opt_a 0.35% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.58% : 0.000452s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000035s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 2.17% : 0.000275s : 1: renormalize.infer 2.34% : 0.000296s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000033s : 1: rewriter_after_opt_a 0.55% : 0.000069s : 1: rewriter_before_opt_a 0.57% : 0.000072s : 1: symbol_engine_optimizer 32.94% : 0.004159s : 1: type_inference TotalTime = 0.10899, [30] [bootstrap]: 0.0002598 [type_inference]: 0.0997007 [event_method]: 1.723e-05 [auto_monad]: 4.559e-05 [graph_reusing]: 3.51001e-06 [pre_auto_parallel]: 1.57999e-06 [py_interpret_to_execute]: 0.00041773 [rewriter_before_opt_a]: 7.297e-05 [expand_dump_flag]: 2.44999e-06 [jit_opt_a]: 0.0065037, [2] [Cycle 1]: 0.00313541, [27] [switch_simplify]: 4.851e-05 [loop_unroll]: 3.016e-05 [a_1]: 0.00049875 [with_stream_mark]: 1.257e-05 [recompute_prepare]: 8.15e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 6.81999e-06 [updatestate_useless_node_eliminater]: 5.71e-06 [accelerated_algorithm]: 6.63e-06 [meta_shard_fg_expand]: 1.35001e-06 [get_grad_eliminate_]: 6.02999e-06 [merge_forward]: 2.94999e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.186e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 1.80001e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00225325 [add_forward_monad_depend]: 4.50001e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.264e-05 [cse]: 1.893e-05 [replace_applicator]: 1.336e-05 [Cycle 2]: 0.00034904, [27] [switch_simplify]: 6.29999e-06 [loop_unroll]: 5.57999e-06 [a_1]: 0.00011771 [with_stream_mark]: 9.05001e-06 [recompute_prepare]: 6.06e-06 [updatestate_depend_eliminate]: 2.56e-06 [updatestate_assign_eliminate]: 2.06998e-06 [updatestate_loads_eliminate]: 2.01e-06 [parameter_eliminate]: 9.00007e-07 [specialize_transform]: 5.51998e-06 [updatestate_useless_node_eliminater]: 5.44998e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.30999e-06 [get_grad_eliminate_]: 5.11002e-06 [merge_forward]: 2.53998e-06 [cell_reuse_recompute_pass]: 1.86998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.428e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 2.48002e-06 [replace_old_param]: 8.15999e-06 [inline_without_move]: 5.59e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.52999e-06 [cse]: 1.092e-05 [replace_applicator]: 5.61003e-06 [py_interpret_to_execute_after_opt_a]: 8.99e-06 [rewriter_after_opt_a]: 2.667e-05 [convert_after_rewriter]: 5.35999e-06 [order_py_execute_after_rewriter]: 4.20999e-06 [mutable_eliminate]: 0.00051273 [jit_opt_b]: 5.062e-05, [1] [Cycle 1]: 4.485e-05, [2] [frontend_op_eliminate]: 1.829e-05 [inline_after_opt_a]: 1.635e-05 [cconv]: 1.858e-05 [loop_unroll]: 0.0004019 [jit_opt_after_cconv]: 0.00014118, [1] [Cycle 1]: 0.00013561, [11] [c_1]: 2.463e-05 [parameter_eliminate]: 2.19999e-06 [updatestate_depend_eliminate]: 5.02e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.41e-06 [cse]: 1.908e-05 [call_graph_tuple_transform]: 1.86e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.112e-05 [partial_unused_args_eliminate]: 1.52001e-06 [environ_conv]: 5.91e-06 [add_recomputation]: 3.351e-05 [cse_after_recomputation]: 2.091e-05, [1] [Cycle 1]: 1.595e-05, [1] [cse]: 1.031e-05 [auto_monad_reorder]: 1.011e-05 [get_jit_bprop_graph]: 2.10002e-06 [rewriter_after_jit_bprop_graph]: 4.36002e-06 [opt_after_jit_grad]: 0.00043752 [symbol_engine_optimizer]: 7.092e-05, [1] [Cycle 1]: 6.537e-05, [6] [build]: 2.78003e-06 [elim_shapecalc]: 8.50001e-06 [elim_not_effective]: 1.326e-05 [opt_reshape]: 6.02001e-06 [fold_const_symbol]: 9.15999e-06 [renormalize]: 2.50002e-07 [validate]: 4.202e-05 Sums bootstrap : 0.000260s : 0.25% type_inference : 0.099701s : 94.56% event_method : 0.000017s : 0.02% auto_monad : 0.000046s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000418s : 0.40% rewriter_before_opt_a : 0.000073s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000616s : 0.58% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002253s : 2.14% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000027s : 0.03% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000513s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000019s : 0.02% loop_unroll : 0.000402s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000438s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000042s : 0.04% Time group info: ------[substitution.] 0.000152 24 1.61% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000005s : 4: substitution.graph_param_transform 82.69% : 0.000126s : 4: substitution.inline 1.61% : 0.000002s : 4: substitution.j_node_and_user_rematch 2.92% : 0.000004s : 4: substitution.remove_not_recompute_node 2.22% : 0.000003s : 2: substitution.replace_old_param 5.12% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099640 2 97.55% : 0.097195s : 1: type_inference.infer 2.45% : 0.002445s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.75% : 0.000044s : 4: replace.inline 33.25% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000130 6 94.89% : 0.000124s : 4: match.inline 5.11% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.50% : 0.000002s : 12: predicate.accumulaten_eliminater 1.15% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.47% : 0.000002s : 12: predicate.addn_zero_filter 1.96% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.50% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.27% : 0.000002s : 12: predicate.environ_get_eliminate 1.19% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 4.99% : 0.000006s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.13% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.40% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.52% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000001s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.73% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.57% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.88% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001916 22 65.64% : 0.001258s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.01% : 0.000633s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112146 72 0.03% : 0.000036s : 1: add_recomputation 0.04% : 0.000049s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.24% : 0.000272s : 1: bootstrap 0.02% : 0.000021s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.80% : 0.006506s : 1: jit_opt_a 0.13% : 0.000144s : 1: jit_opt_after_cconv 0.05% : 0.000053s : 1: jit_opt_b 0.36% : 0.000409s : 1: loop_unroll 0.46% : 0.000520s : 1: mutable_eliminate 0.74% : 0.000834s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000445s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.38% : 0.000423s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.40% : 0.001569s : 1: renormalize.infer 0.60% : 0.000677s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000078s : 1: rewriter_before_opt_a 0.07% : 0.000073s : 1: symbol_engine_optimizer 88.91% : 0.099714s : 1: type_inference TotalTime = 0.0578089, [30] [bootstrap]: 0.00025872 [type_inference]: 0.0489007 [event_method]: 1.85e-05 [auto_monad]: 6.623e-05 [graph_reusing]: 5.74e-06 [pre_auto_parallel]: 5.907e-05 [py_interpret_to_execute]: 0.00024242 [rewriter_before_opt_a]: 8.001e-05 [expand_dump_flag]: 3.30998e-06 [jit_opt_a]: 0.00612542, [2] [Cycle 1]: 0.00269258, [27] [switch_simplify]: 5.135e-05 [loop_unroll]: 2.93e-05 [a_1]: 0.00058068 [with_stream_mark]: 1.564e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 3.21999e-06 [updatestate_loads_eliminate]: 3.05002e-06 [parameter_eliminate]: 1.66e-06 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.86e-06 [accelerated_algorithm]: 6.06998e-06 [meta_shard_fg_expand]: 2.10002e-06 [get_grad_eliminate_]: 5.89e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 2.22001e-06 [replace_old_param]: 9.64999e-06 [inline_without_move]: 6.04001e-06 [renormalize]: 0.00169208 [add_forward_monad_depend]: 5.62001e-06 [auto_monad_grad]: 1.92001e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.149e-05 [replace_applicator]: 1.268e-05 [Cycle 2]: 0.0003442, [27] [switch_simplify]: 6.61999e-06 [loop_unroll]: 5.46998e-06 [a_1]: 0.00011656 [with_stream_mark]: 8.60999e-06 [recompute_prepare]: 5.68002e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 1.98997e-06 [parameter_eliminate]: 9.09989e-07 [specialize_transform]: 5.51002e-06 [updatestate_useless_node_eliminater]: 5.46e-06 [accelerated_algorithm]: 5.46002e-06 [meta_shard_fg_expand]: 1.07998e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.32e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.263e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.47999e-06 [replace_old_param]: 8.55001e-06 [inline_without_move]: 5.50001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.37001e-06 [cse]: 1.13e-05 [replace_applicator]: 6.05002e-06 [py_interpret_to_execute_after_opt_a]: 7.91001e-06 [rewriter_after_opt_a]: 3.155e-05 [convert_after_rewriter]: 6.91999e-06 [order_py_execute_after_rewriter]: 5.20001e-06 [mutable_eliminate]: 0.0004711 [jit_opt_b]: 5.138e-05, [1] [Cycle 1]: 4.55e-05, [2] [frontend_op_eliminate]: 1.77e-05 [inline_after_opt_a]: 1.696e-05 [cconv]: 2.528e-05 [loop_unroll]: 0.00041743 [jit_opt_after_cconv]: 0.00014689, [1] [Cycle 1]: 0.00014048, [11] [c_1]: 2.585e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 5.97001e-06 [updatestate_assign_eliminate]: 2.99001e-06 [updatestate_loads_eliminate]: 2.21998e-06 [cse]: 1.938e-05 [call_graph_tuple_transform]: 1.942e-05 [tuple_list_get_item_eliminator]: 6.33e-06 [none_parameter_eliminate]: 1.74e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.14001e-06 [remove_dup_value]: 1.55e-05 [partial_unused_args_eliminate]: 2.09999e-06 [environ_conv]: 8.45001e-06 [add_recomputation]: 4.836e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.69e-05, [1] [cse]: 1.119e-05 [auto_monad_reorder]: 1.594e-05 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 4.58001e-06 [opt_after_jit_grad]: 0.00046754 [symbol_engine_optimizer]: 7.148e-05, [1] [Cycle 1]: 6.543e-05, [6] [build]: 2.74001e-06 [elim_shapecalc]: 8.38999e-06 [elim_not_effective]: 1.239e-05 [opt_reshape]: 6.14999e-06 [fold_const_symbol]: 9.09e-06 [renormalize]: 3.59985e-07 [validate]: 6.987e-05 Sums bootstrap : 0.000259s : 0.48% type_inference : 0.048901s : 90.26% event_method : 0.000018s : 0.03% auto_monad : 0.000066s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000059s : 0.11% py_interpret_to_execute : 0.000242s : 0.45% rewriter_before_opt_a : 0.000080s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000697s : 1.29% jit_opt_a.with_stream_mark : 0.000024s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001692s : 3.12% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000043s : 0.08% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000471s : 0.87% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000025s : 0.05% loop_unroll : 0.000417s : 0.77% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000048s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000016s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000468s : 0.86% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000070s : 0.13% Time group info: ------[substitution.] 0.000232 24 0.75% : 0.000002s : 2: substitution.elim_not_effective 0.49% : 0.000001s : 2: substitution.fold_const_symbol 2.50% : 0.000006s : 4: substitution.graph_param_transform 63.11% : 0.000146s : 4: substitution.inline 1.18% : 0.000003s : 4: substitution.j_node_and_user_rematch 1.99% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000005s : 2: substitution.replace_old_param 28.00% : 0.000065s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048831 2 96.52% : 0.047132s : 1: type_inference.infer 3.48% : 0.001699s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.31% : 0.000043s : 4: replace.inline 33.69% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000207 6 69.28% : 0.000144s : 4: match.inline 30.72% : 0.000064s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.06% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.18% : 0.000001s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000001s : 12: predicate.compare_switch_simplify 1.29% : 0.000002s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.61% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.54% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.60% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 18: predicate.load_eliminater 1.49% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.78% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.23% : 0.000002s : 12: predicate.minmaximum_grad 1.81% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.37% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.18% : 0.000003s : 22: predicate.replace_applicator 1.02% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.42% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.31% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 12: predicate.value_based_eliminate 0.33% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002027 26 73.11% : 0.001482s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.51% : 0.000517s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060459 72 0.08% : 0.000051s : 1: add_recomputation 0.11% : 0.000069s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.45% : 0.000272s : 1: bootstrap 0.05% : 0.000028s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000024s : 1: cse_after_recomputation 0.02% : 0.000011s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.14% : 0.006128s : 1: jit_opt_a 0.25% : 0.000150s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.70% : 0.000425s : 1: loop_unroll 0.79% : 0.000478s : 1: mutable_eliminate 1.51% : 0.000916s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000475s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.10% : 0.000061s : 1: pre_auto_parallel 0.41% : 0.000247s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000018s : 1: remove_dup_value 1.89% : 0.001143s : 1: renormalize.infer 0.89% : 0.000541s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000034s : 1: rewriter_after_opt_a 0.14% : 0.000085s : 1: rewriter_before_opt_a 0.12% : 0.000074s : 1: symbol_engine_optimizer 80.91% : 0.048915s : 1: type_inference TotalTime = 0.0111615, [30] [bootstrap]: 0.00023812 [type_inference]: 0.00405994 [event_method]: 1.717e-05 [auto_monad]: 6.51e-05 [graph_reusing]: 5.74999e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 3.329e-05 [rewriter_before_opt_a]: 7.257e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.00469293, [2] [Cycle 1]: 0.00138556, [27] [switch_simplify]: 5.061e-05 [loop_unroll]: 2.947e-05 [a_1]: 0.00049522 [with_stream_mark]: 1.492e-05 [recompute_prepare]: 7.04001e-06 [updatestate_depend_eliminate]: 3.75e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 3.27002e-06 [parameter_eliminate]: 1.72999e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.12e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 3.76999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.386e-05 [j_node_and_user_rematch]: 8.48999e-06 [meta_fg_expand]: 2.16e-06 [replace_old_param]: 9.17001e-06 [inline_without_move]: 5.30001e-06 [renormalize]: 0.00049153 [add_forward_monad_depend]: 5.36002e-06 [auto_monad_grad]: 1.82001e-06 [auto_monad_eliminator]: 1.402e-05 [cse]: 2.861e-05 [replace_applicator]: 1.168e-05 [Cycle 2]: 0.00030797, [27] [switch_simplify]: 5.61003e-06 [loop_unroll]: 4.86002e-06 [a_1]: 8.999e-05 [with_stream_mark]: 8.13999e-06 [recompute_prepare]: 4.85001e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.14999e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 4.84998e-06 [updatestate_useless_node_eliminater]: 4.68999e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.09998e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.30002e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.235e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.68999e-06 [inline_without_move]: 4.67e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.40025e-07 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.29e-06 [cse]: 1.003e-05 [replace_applicator]: 5.01002e-06 [py_interpret_to_execute_after_opt_a]: 8.62e-06 [rewriter_after_opt_a]: 3.238e-05 [convert_after_rewriter]: 7.20003e-06 [order_py_execute_after_rewriter]: 5.25999e-06 [mutable_eliminate]: 0.00047326 [jit_opt_b]: 4.712e-05, [1] [Cycle 1]: 4.097e-05, [2] [frontend_op_eliminate]: 1.536e-05 [inline_after_opt_a]: 1.552e-05 [cconv]: 2.437e-05 [loop_unroll]: 0.00040201 [jit_opt_after_cconv]: 0.00013367, [1] [Cycle 1]: 0.00012778, [11] [c_1]: 2.021e-05 [parameter_eliminate]: 2.38002e-06 [updatestate_depend_eliminate]: 5.14e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.763e-05 [call_graph_tuple_transform]: 1.753e-05 [tuple_list_get_item_eliminator]: 5.40999e-06 [none_parameter_eliminate]: 1.64998e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.494e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 5.62001e-06 [add_recomputation]: 4.516e-05 [cse_after_recomputation]: 1.979e-05, [1] [Cycle 1]: 1.488e-05, [1] [cse]: 9.32001e-06 [auto_monad_reorder]: 1.487e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 4.48001e-06 [opt_after_jit_grad]: 0.00043354 [symbol_engine_optimizer]: 7.079e-05, [1] [Cycle 1]: 6.474e-05, [6] [build]: 2.89001e-06 [elim_shapecalc]: 7.73001e-06 [elim_not_effective]: 1.26e-05 [opt_reshape]: 5.58002e-06 [fold_const_symbol]: 8.45999e-06 [renormalize]: 3.30008e-07 [validate]: 7.288e-05 Sums bootstrap : 0.000238s : 3.12% type_inference : 0.004060s : 53.18% event_method : 0.000017s : 0.22% auto_monad : 0.000065s : 0.85% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000033s : 0.44% rewriter_before_opt_a : 0.000073s : 0.95% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000056s : 0.74% jit_opt_a.loop_unroll : 0.000034s : 0.45% jit_opt_a.a_1 : 0.000585s : 7.67% jit_opt_a.with_stream_mark : 0.000023s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.22% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000492s : 6.44% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000039s : 0.51% jit_opt_a.replace_applicator : 0.000017s : 0.22% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000032s : 0.42% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000473s : 6.20% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.20% cconv : 0.000024s : 0.32% loop_unroll : 0.000402s : 5.27% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000045s : 0.59% cse_after_recomputation.cse : 0.000009s : 0.12% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000434s : 5.68% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000073s : 0.95% Time group info: ------[substitution.] 0.000176 23 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000005s : 3: substitution.graph_param_transform 82.10% : 0.000144s : 4: substitution.inline 1.65% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.36% : 0.000004s : 2: substitution.replace_old_param 6.54% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004008 2 80.47% : 0.003225s : 1: type_inference.infer 19.53% : 0.000783s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.85% : 0.000044s : 4: replace.inline 32.15% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 93.18% : 0.000142s : 4: match.inline 6.82% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.15% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.22% : 0.000001s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.33% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.28% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.45% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.40% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.12% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.73% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.64% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.29% : 0.000001s : 10: predicate.print_const_string_wrapper 1.60% : 0.000002s : 10: predicate.reduce_eliminate 1.39% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.52% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.84% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.52% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.13% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.08% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.45% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.46% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 8.00% : 0.000009s : 53: predicate.switch_simplify 1.33% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.45% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.21% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.97% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.88% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.55% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000525 13 50.35% : 0.000265s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.01% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.64% : 0.000235s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012466 72 0.39% : 0.000048s : 1: add_recomputation 0.55% : 0.000068s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 1.99% : 0.000248s : 1: bootstrap 0.22% : 0.000027s : 1: cconv 0.08% : 0.000009s : 1: convert_after_rewriter 0.25% : 0.000032s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.17% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.67% : 0.004695s : 1: jit_opt_a 1.09% : 0.000136s : 1: jit_opt_after_cconv 0.40% : 0.000050s : 1: jit_opt_b 3.28% : 0.000409s : 1: loop_unroll 3.86% : 0.000481s : 1: mutable_eliminate 6.32% : 0.000787s : 26: opt.transform.jit_opt_a 0.37% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.54% : 0.000441s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000036s : 1: py_interpret_to_execute 0.09% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000017s : 1: remove_dup_value 1.96% : 0.000244s : 1: renormalize.infer 1.93% : 0.000240s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.28% : 0.000035s : 1: rewriter_after_opt_a 0.60% : 0.000075s : 1: rewriter_before_opt_a 0.58% : 0.000073s : 1: symbol_engine_optimizer 32.65% : 0.004071s : 1: type_inference TotalTime = 0.110507, [30] [bootstrap]: 0.00024624 [type_inference]: 0.100636 [event_method]: 1.821e-05 [auto_monad]: 6.786e-05 [graph_reusing]: 6.53998e-06 [pre_auto_parallel]: 2.19999e-06 [py_interpret_to_execute]: 0.00039411 [rewriter_before_opt_a]: 8.152e-05 [expand_dump_flag]: 3.85998e-06 [jit_opt_a]: 0.00698139, [2] [Cycle 1]: 0.00336218, [27] [switch_simplify]: 5.424e-05 [loop_unroll]: 3.048e-05 [a_1]: 0.00058628 [with_stream_mark]: 1.873e-05 [recompute_prepare]: 8.64e-06 [updatestate_depend_eliminate]: 3.67998e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 3.15002e-06 [parameter_eliminate]: 1.92001e-06 [specialize_transform]: 6.53998e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 5.98002e-06 [meta_shard_fg_expand]: 2.08998e-06 [get_grad_eliminate_]: 6.06e-06 [merge_forward]: 3.60998e-06 [cell_reuse_recompute_pass]: 1.14e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.568e-05 [j_node_and_user_rematch]: 9.70002e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 6.31e-06 [renormalize]: 0.00234411 [add_forward_monad_depend]: 5.46002e-06 [auto_monad_grad]: 2.69001e-06 [auto_monad_eliminator]: 1.557e-05 [cse]: 3.028e-05 [replace_applicator]: 1.337e-05 [Cycle 2]: 0.00035196, [27] [switch_simplify]: 6.74001e-06 [loop_unroll]: 5.84999e-06 [a_1]: 0.00011944 [with_stream_mark]: 9.20001e-06 [recompute_prepare]: 5.63002e-06 [updatestate_depend_eliminate]: 2.89999e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 9.5999e-07 [specialize_transform]: 5.81e-06 [updatestate_useless_node_eliminater]: 5.47999e-06 [accelerated_algorithm]: 5.40999e-06 [meta_shard_fg_expand]: 1.29e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.389e-05 [j_node_and_user_rematch]: 8.47998e-06 [meta_fg_expand]: 1.40999e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.29998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.94e-06 [cse]: 1.139e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 1.132e-05 [rewriter_after_opt_a]: 3.303e-05 [convert_after_rewriter]: 7.26001e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.0005454 [jit_opt_b]: 5.19e-05, [1] [Cycle 1]: 4.572e-05, [2] [frontend_op_eliminate]: 1.835e-05 [inline_after_opt_a]: 1.689e-05 [cconv]: 2.614e-05 [loop_unroll]: 0.00040578 [jit_opt_after_cconv]: 0.00014543, [1] [Cycle 1]: 0.0001393, [11] [c_1]: 2.517e-05 [parameter_eliminate]: 2.66e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 2.28002e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 2.04e-05 [call_graph_tuple_transform]: 2.026e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 2.10013e-07 [switch_simplify]: 6.04001e-06 [remove_dup_value]: 1.537e-05 [partial_unused_args_eliminate]: 2.26998e-06 [environ_conv]: 8.54002e-06 [add_recomputation]: 4.881e-05 [cse_after_recomputation]: 2.096e-05, [1] [Cycle 1]: 1.572e-05, [1] [cse]: 1.041e-05 [auto_monad_reorder]: 1.496e-05 [get_jit_bprop_graph]: 2.24999e-06 [rewriter_after_jit_bprop_graph]: 4.60001e-06 [opt_after_jit_grad]: 0.0004487 [symbol_engine_optimizer]: 7.112e-05, [1] [Cycle 1]: 6.53e-05, [6] [build]: 2.96001e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 1.274e-05 [opt_reshape]: 6.05002e-06 [fold_const_symbol]: 8.71002e-06 [renormalize]: 3.10014e-07 [validate]: 3.661e-05 Sums bootstrap : 0.000246s : 0.23% type_inference : 0.100636s : 94.33% event_method : 0.000018s : 0.02% auto_monad : 0.000068s : 0.06% graph_reusing : 0.000007s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000394s : 0.37% rewriter_before_opt_a : 0.000082s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000061s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000706s : 0.66% jit_opt_a.with_stream_mark : 0.000028s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002344s : 2.20% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000011s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000545s : 0.51% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000026s : 0.02% loop_unroll : 0.000406s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000049s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000449s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000228 24 0.98% : 0.000002s : 2: substitution.elim_not_effective 0.54% : 0.000001s : 2: substitution.fold_const_symbol 2.62% : 0.000006s : 4: substitution.graph_param_transform 84.62% : 0.000193s : 4: substitution.inline 1.36% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.37% : 0.000005s : 4: substitution.remove_not_recompute_node 1.92% : 0.000004s : 2: substitution.replace_old_param 5.59% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100567 2 97.08% : 0.097634s : 1: type_inference.infer 2.92% : 0.002933s : 1: type_inference.specialize ------[replace.] 0.000073 6 68.61% : 0.000050s : 4: replace.inline 31.39% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000202 6 94.27% : 0.000190s : 4: match.inline 5.73% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 0.90% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.45% : 0.000002s : 12: predicate.addn_zero_filter 1.80% : 0.000002s : 12: predicate.arithmetic_simplify 1.41% : 0.000002s : 12: predicate.cast_eliminate 0.58% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.39% : 0.000001s : 4: predicate.graph_param_transform 6.63% : 0.000009s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.47% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.22% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.05% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000002s : 12: predicate.print_const_string_wrapper 1.75% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 1.91% : 0.000002s : 22: predicate.replace_applicator 0.80% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.51% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.74% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.83% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002248 22 63.92% : 0.001437s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.77% : 0.000040s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.30% : 0.000771s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113853 72 0.05% : 0.000052s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000259s : 1: bootstrap 0.03% : 0.000029s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.13% : 0.006984s : 1: jit_opt_a 0.13% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.36% : 0.000413s : 1: loop_unroll 0.49% : 0.000554s : 1: mutable_eliminate 0.82% : 0.000930s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.35% : 0.000400s : 1: py_interpret_to_execute 0.01% : 0.000014s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.47% : 0.001673s : 1: renormalize.infer 0.58% : 0.000662s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.06% : 0.000073s : 1: symbol_engine_optimizer 88.40% : 0.100651s : 1: type_inference TotalTime = 0.109823, [30] [bootstrap]: 0.00025418 [type_inference]: 0.100394 [event_method]: 1.806e-05 [auto_monad]: 6.95e-05 [graph_reusing]: 6.15002e-06 [pre_auto_parallel]: 2.79999e-06 [py_interpret_to_execute]: 0.00040748 [rewriter_before_opt_a]: 9.964e-05 [expand_dump_flag]: 3.58e-06 [jit_opt_a]: 0.00656387, [2] [Cycle 1]: 0.00303104, [27] [switch_simplify]: 5.138e-05 [loop_unroll]: 3.077e-05 [a_1]: 0.00053918 [with_stream_mark]: 1.516e-05 [recompute_prepare]: 8.40001e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.55002e-06 [updatestate_useless_node_eliminater]: 6.43e-06 [accelerated_algorithm]: 6.16998e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 6.07999e-06 [merge_forward]: 4.04997e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.48e-05 [j_node_and_user_rematch]: 9.44e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 9.49999e-06 [inline_without_move]: 5.99999e-06 [renormalize]: 0.00204523 [add_forward_monad_depend]: 4.27998e-06 [auto_monad_grad]: 1.58002e-06 [auto_monad_eliminator]: 1.116e-05 [cse]: 1.929e-05 [replace_applicator]: 1.32e-05 [Cycle 2]: 0.00034905, [27] [switch_simplify]: 6.66999e-06 [loop_unroll]: 5.82001e-06 [a_1]: 0.00011747 [with_stream_mark]: 7.99002e-06 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 8.90024e-07 [specialize_transform]: 5.84e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.79e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.271e-05 [j_node_and_user_rematch]: 8.42e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.02998e-06 [inline_without_move]: 5.32001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.93998e-06 [cse]: 1.096e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 8.18999e-06 [rewriter_after_opt_a]: 2.53e-05 [convert_after_rewriter]: 5.40001e-06 [order_py_execute_after_rewriter]: 3.78999e-06 [mutable_eliminate]: 0.0004862 [jit_opt_b]: 5.333e-05, [1] [Cycle 1]: 4.66e-05, [2] [frontend_op_eliminate]: 1.822e-05 [inline_after_opt_a]: 1.679e-05 [cconv]: 1.643e-05 [loop_unroll]: 0.00040489 [jit_opt_after_cconv]: 0.00014282, [1] [Cycle 1]: 0.00013583, [11] [c_1]: 2.47e-05 [parameter_eliminate]: 2.86e-06 [updatestate_depend_eliminate]: 6.16e-06 [updatestate_assign_eliminate]: 2.18002e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.833e-05 [call_graph_tuple_transform]: 1.912e-05 [tuple_list_get_item_eliminator]: 6.06e-06 [none_parameter_eliminate]: 1.04003e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 8.02e-06 [partial_unused_args_eliminate]: 1.40999e-06 [environ_conv]: 6.58e-06 [add_recomputation]: 3.119e-05 [cse_after_recomputation]: 2.092e-05, [1] [Cycle 1]: 1.603e-05, [1] [cse]: 1.044e-05 [auto_monad_reorder]: 9.58002e-06 [get_jit_bprop_graph]: 1.38002e-06 [rewriter_after_jit_bprop_graph]: 4.51002e-06 [opt_after_jit_grad]: 0.00051298 [symbol_engine_optimizer]: 7.383e-05, [1] [Cycle 1]: 6.689e-05, [6] [build]: 2.56e-06 [elim_shapecalc]: 8.73001e-06 [elim_not_effective]: 1.338e-05 [opt_reshape]: 7.13e-06 [fold_const_symbol]: 8.28999e-06 [renormalize]: 4.10015e-07 [validate]: 3.211e-05 Sums bootstrap : 0.000254s : 0.24% type_inference : 0.100394s : 94.66% event_method : 0.000018s : 0.02% auto_monad : 0.000070s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000407s : 0.38% rewriter_before_opt_a : 0.000100s : 0.09% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000657s : 0.62% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000005s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002045s : 1.93% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000025s : 0.02% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000486s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000016s : 0.02% loop_unroll : 0.000405s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000031s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000010s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000513s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000186 24 0.78% : 0.000001s : 2: substitution.elim_not_effective 0.45% : 0.000001s : 2: substitution.fold_const_symbol 2.23% : 0.000004s : 4: substitution.graph_param_transform 83.63% : 0.000155s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.55% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 6.59% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100327 2 97.31% : 0.097631s : 1: type_inference.infer 2.69% : 0.002696s : 1: type_inference.specialize ------[replace.] 0.000067 6 66.88% : 0.000045s : 4: replace.inline 33.12% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000164 6 93.21% : 0.000153s : 4: match.inline 6.79% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.23% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.22% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 1.06% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.49% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.86% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.45% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.56% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.70% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.41% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.04% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.08% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.98% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002049 22 61.88% : 0.001268s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.47% : 0.000030s : 1: func_graph_cloner_run.FuncGraphClonerNode 36.65% : 0.000751s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112828 72 0.03% : 0.000034s : 1: add_recomputation 0.06% : 0.000073s : 1: auto_monad 0.01% : 0.000012s : 1: auto_monad_reorder 0.23% : 0.000265s : 1: bootstrap 0.02% : 0.000019s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.82% : 0.006566s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000412s : 1: loop_unroll 0.44% : 0.000494s : 1: mutable_eliminate 0.78% : 0.000879s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000521s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000413s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000010s : 1: remove_dup_value 1.28% : 0.001442s : 1: renormalize.infer 0.53% : 0.000594s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000028s : 1: rewriter_after_opt_a 0.09% : 0.000106s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 88.99% : 0.100407s : 1: type_inference TotalTime = 0.0116143, [30] [bootstrap]: 0.00027144 [type_inference]: 0.00432037 [event_method]: 1.728e-05 [auto_monad]: 6.29e-05 [graph_reusing]: 5.84999e-06 [pre_auto_parallel]: 2.15002e-06 [py_interpret_to_execute]: 3.142e-05 [rewriter_before_opt_a]: 6.939e-05 [expand_dump_flag]: 3.13e-06 [jit_opt_a]: 0.00488096, [2] [Cycle 1]: 0.00144898, [27] [switch_simplify]: 5.06e-05 [loop_unroll]: 3.003e-05 [a_1]: 0.00049629 [with_stream_mark]: 1.581e-05 [recompute_prepare]: 6.93e-06 [updatestate_depend_eliminate]: 3.31999e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 2.82002e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 5.86e-06 [updatestate_useless_node_eliminater]: 5.13002e-06 [accelerated_algorithm]: 5.32999e-06 [meta_shard_fg_expand]: 2.32999e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 3.93999e-06 [cell_reuse_recompute_pass]: 1.54e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.524e-05 [j_node_and_user_rematch]: 9.47001e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.09e-06 [inline_without_move]: 5.47001e-06 [renormalize]: 0.00055767 [add_forward_monad_depend]: 5.07e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.319e-05 [cse]: 2.272e-05 [replace_applicator]: 1.131e-05 [Cycle 2]: 0.00030629, [27] [switch_simplify]: 5.61003e-06 [loop_unroll]: 4.72e-06 [a_1]: 8.84e-05 [with_stream_mark]: 8.95001e-06 [recompute_prepare]: 4.77e-06 [updatestate_depend_eliminate]: 2.54001e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 4.89e-06 [updatestate_useless_node_eliminater]: 4.84e-06 [accelerated_algorithm]: 4.65999e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 4.37998e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.187e-05 [j_node_and_user_rematch]: 7.95998e-06 [meta_fg_expand]: 1.35999e-06 [replace_old_param]: 7.1e-06 [inline_without_move]: 4.76002e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.34998e-06 [cse]: 9.24e-06 [replace_applicator]: 5.04e-06 [py_interpret_to_execute_after_opt_a]: 8.28999e-06 [rewriter_after_opt_a]: 3.04e-05 [convert_after_rewriter]: 6.76e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00045848 [jit_opt_b]: 4.693e-05, [1] [Cycle 1]: 4.076e-05, [2] [frontend_op_eliminate]: 1.494e-05 [inline_after_opt_a]: 1.5e-05 [cconv]: 2.516e-05 [loop_unroll]: 0.00042938 [jit_opt_after_cconv]: 0.00014951, [1] [Cycle 1]: 0.00014339, [11] [c_1]: 2.024e-05 [parameter_eliminate]: 2.28002e-06 [updatestate_depend_eliminate]: 1.497e-05 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.33002e-06 [cse]: 1.842e-05 [call_graph_tuple_transform]: 1.912e-05 [tuple_list_get_item_eliminator]: 5.42999e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 3.69997e-07 [switch_simplify]: 5.17e-06 [remove_dup_value]: 1.585e-05 [partial_unused_args_eliminate]: 2.21998e-06 [environ_conv]: 5.10999e-06 [add_recomputation]: 4.607e-05 [cse_after_recomputation]: 2.062e-05, [1] [Cycle 1]: 1.556e-05, [1] [cse]: 9.74e-06 [auto_monad_reorder]: 1.521e-05 [get_jit_bprop_graph]: 1.78997e-06 [rewriter_after_jit_bprop_graph]: 4.40999e-06 [opt_after_jit_grad]: 0.00043157 [symbol_engine_optimizer]: 6.918e-05, [1] [Cycle 1]: 6.302e-05, [6] [build]: 2.91999e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.64e-06 [fold_const_symbol]: 8.45001e-06 [renormalize]: 3.69997e-07 [validate]: 3.114e-05 Sums bootstrap : 0.000271s : 3.41% type_inference : 0.004320s : 54.26% event_method : 0.000017s : 0.22% auto_monad : 0.000063s : 0.79% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000031s : 0.39% rewriter_before_opt_a : 0.000069s : 0.87% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000056s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000585s : 7.34% jit_opt_a.with_stream_mark : 0.000025s : 0.31% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000558s : 7.00% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000032s : 0.40% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.38% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000458s : 5.76% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000025s : 0.32% loop_unroll : 0.000429s : 5.39% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000015s : 0.19% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000046s : 0.58% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000432s : 5.42% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.39% Time group info: ------[substitution.] 0.000182 23 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 3.06% : 0.000006s : 3: substitution.graph_param_transform 81.74% : 0.000149s : 4: substitution.inline 1.78% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000005s : 4: substitution.remove_not_recompute_node 2.47% : 0.000004s : 2: substitution.replace_old_param 6.55% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004268 2 81.65% : 0.003485s : 1: type_inference.infer 18.35% : 0.000783s : 1: type_inference.specialize ------[replace.] 0.000059 6 66.02% : 0.000039s : 4: replace.inline 33.98% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000157 6 93.12% : 0.000146s : 4: match.inline 6.88% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.30% : 0.000001s : 10: predicate.accumulaten_eliminater 1.02% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000001s : 10: predicate.addn_zero_filter 1.74% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.28% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.49% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.38% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.26% : 0.000001s : 6: predicate.less_batch_normalization 1.47% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.05% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 10: predicate.merge_addn 1.15% : 0.000001s : 10: predicate.minmaximum_grad 1.47% : 0.000002s : 3: predicate.mutable_eliminate 0.60% : 0.000001s : 3: predicate.opt_reshape 2.23% : 0.000002s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.88% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.76% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 3: predicate.row_tensor_eliminate 1.15% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.07% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.95% : 0.000009s : 53: predicate.switch_simplify 1.38% : 0.000002s : 10: predicate.tile_eliminate 1.40% : 0.000002s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.20% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.38% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.92% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.94% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000561 13 52.03% : 0.000292s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.83% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.13% : 0.000236s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013023 72 0.38% : 0.000049s : 1: add_recomputation 0.51% : 0.000066s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.17% : 0.000282s : 1: bootstrap 0.21% : 0.000028s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000023s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.50% : 0.004884s : 1: jit_opt_a 1.17% : 0.000152s : 1: jit_opt_after_cconv 0.38% : 0.000049s : 1: jit_opt_b 3.36% : 0.000437s : 1: loop_unroll 3.58% : 0.000466s : 1: mutable_eliminate 6.05% : 0.000788s : 26: opt.transform.jit_opt_a 0.36% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.37% : 0.000439s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.26% : 0.000034s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 2.31% : 0.000301s : 1: renormalize.infer 1.91% : 0.000249s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000033s : 1: rewriter_after_opt_a 0.55% : 0.000072s : 1: rewriter_before_opt_a 0.55% : 0.000071s : 1: symbol_engine_optimizer 33.26% : 0.004332s : 1: type_inference TotalTime = 0.108734, [30] [bootstrap]: 0.00027703 [type_inference]: 0.0992404 [event_method]: 2.044e-05 [auto_monad]: 6.895e-05 [graph_reusing]: 4.226e-05 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00041399 [rewriter_before_opt_a]: 8.345e-05 [expand_dump_flag]: 3.38e-06 [jit_opt_a]: 0.00654704, [2] [Cycle 1]: 0.00315929, [27] [switch_simplify]: 5.175e-05 [loop_unroll]: 3.061e-05 [a_1]: 0.00061922 [with_stream_mark]: 1.543e-05 [recompute_prepare]: 8.33999e-06 [updatestate_depend_eliminate]: 3.98999e-06 [updatestate_assign_eliminate]: 3.31001e-06 [updatestate_loads_eliminate]: 3.56001e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 6.63e-06 [updatestate_useless_node_eliminater]: 5.88002e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 6.04001e-06 [merge_forward]: 3.76001e-06 [cell_reuse_recompute_pass]: 1.08001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.607e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.53e-06 [replace_old_param]: 9.92999e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00212058 [add_forward_monad_depend]: 5.46e-06 [auto_monad_grad]: 2.01e-06 [auto_monad_eliminator]: 1.603e-05 [cse]: 2.996e-05 [replace_applicator]: 1.214e-05 [Cycle 2]: 0.00034709, [27] [switch_simplify]: 6.10002e-06 [loop_unroll]: 5.59e-06 [a_1]: 0.00011766 [with_stream_mark]: 9.24e-06 [recompute_prepare]: 5.67999e-06 [updatestate_depend_eliminate]: 2.96001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.56e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.43002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.312e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 1.47001e-06 [replace_old_param]: 8.22e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.5999e-07 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.56998e-06 [cse]: 1.071e-05 [replace_applicator]: 5.59998e-06 [py_interpret_to_execute_after_opt_a]: 9.57999e-06 [rewriter_after_opt_a]: 3.142e-05 [convert_after_rewriter]: 7.12997e-06 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00047933 [jit_opt_b]: 5.057e-05, [1] [Cycle 1]: 4.462e-05, [2] [frontend_op_eliminate]: 1.769e-05 [inline_after_opt_a]: 1.673e-05 [cconv]: 2.473e-05 [loop_unroll]: 0.00043012 [jit_opt_after_cconv]: 0.00014257, [1] [Cycle 1]: 0.00013625, [11] [c_1]: 2.468e-05 [parameter_eliminate]: 2.22001e-06 [updatestate_depend_eliminate]: 5.14998e-06 [updatestate_assign_eliminate]: 2.69999e-06 [updatestate_loads_eliminate]: 2.22001e-06 [cse]: 1.828e-05 [call_graph_tuple_transform]: 1.95e-05 [tuple_list_get_item_eliminator]: 6.55997e-06 [none_parameter_eliminate]: 1.66998e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.94999e-06 [remove_dup_value]: 1.527e-05 [partial_unused_args_eliminate]: 2.31e-06 [environ_conv]: 7.72998e-06 [add_recomputation]: 4.608e-05 [cse_after_recomputation]: 2.074e-05, [1] [Cycle 1]: 1.595e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.538e-05 [get_jit_bprop_graph]: 1.59e-06 [rewriter_after_jit_bprop_graph]: 4.36002e-06 [opt_after_jit_grad]: 0.00044781 [symbol_engine_optimizer]: 8.782e-05, [1] [Cycle 1]: 8.158e-05, [6] [build]: 3.47002e-06 [elim_shapecalc]: 8.23001e-06 [elim_not_effective]: 2.647e-05 [opt_reshape]: 6.63998e-06 [fold_const_symbol]: 9.70002e-06 [renormalize]: 3.69997e-07 [validate]: 3.679e-05 Sums bootstrap : 0.000277s : 0.26% type_inference : 0.099240s : 94.38% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.07% graph_reusing : 0.000042s : 0.04% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000414s : 0.39% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000737s : 0.70% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000006s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002121s : 2.02% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000479s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000430s : 0.41% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000448s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000026s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.03% Time group info: ------[substitution.] 0.000202 24 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.91% : 0.000006s : 4: substitution.graph_param_transform 82.61% : 0.000167s : 4: substitution.inline 1.38% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.74% : 0.000006s : 4: substitution.remove_not_recompute_node 2.43% : 0.000005s : 2: substitution.replace_old_param 6.28% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099175 2 97.64% : 0.096838s : 1: type_inference.infer 2.36% : 0.002337s : 1: type_inference.specialize ------[replace.] 0.000072 6 68.46% : 0.000049s : 4: replace.inline 31.54% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000176 6 93.47% : 0.000164s : 4: match.inline 6.53% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.82% : 0.000002s : 12: predicate.arithmetic_simplify 1.64% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.97% : 0.000008s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 8: predicate.less_batch_normalization 1.61% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.84% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.83% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.46% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.54% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.20% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.50% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.31% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.15% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.22% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.54% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001982 22 65.50% : 0.001298s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.81% : 0.000036s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.69% : 0.000648s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111899 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000295s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.04% : 0.000045s : 1: graph_reusing 5.85% : 0.006550s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000053s : 1: jit_opt_b 0.39% : 0.000437s : 1: loop_unroll 0.44% : 0.000487s : 1: mutable_eliminate 0.86% : 0.000958s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000048s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000455s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000420s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.28% : 0.001437s : 1: renormalize.infer 0.60% : 0.000676s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000088s : 1: rewriter_before_opt_a 0.08% : 0.000090s : 1: symbol_engine_optimizer 88.70% : 0.099256s : 1: type_inference TotalTime = 0.108265, [30] [bootstrap]: 0.00026891 [type_inference]: 0.0989149 [event_method]: 1.673e-05 [auto_monad]: 4.438e-05 [graph_reusing]: 3.53999e-06 [pre_auto_parallel]: 1.67001e-06 [py_interpret_to_execute]: 0.00040618 [rewriter_before_opt_a]: 7.307e-05 [expand_dump_flag]: 2.19001e-06 [jit_opt_a]: 0.00646959, [2] [Cycle 1]: 0.00305466, [27] [switch_simplify]: 5.249e-05 [loop_unroll]: 3e-05 [a_1]: 0.00054687 [with_stream_mark]: 1.637e-05 [recompute_prepare]: 8.59e-06 [updatestate_depend_eliminate]: 3.61999e-06 [updatestate_assign_eliminate]: 3.13998e-06 [updatestate_loads_eliminate]: 3.06001e-06 [parameter_eliminate]: 1.81003e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 6.09999e-06 [accelerated_algorithm]: 6.49001e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 4.38001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.484e-05 [j_node_and_user_rematch]: 9.61e-06 [meta_fg_expand]: 2.34001e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 6.09999e-06 [renormalize]: 0.00208161 [add_forward_monad_depend]: 5.64998e-06 [auto_monad_grad]: 1.77999e-06 [auto_monad_eliminator]: 1.599e-05 [cse]: 3.033e-05 [replace_applicator]: 1.248e-05 [Cycle 2]: 0.00035203, [27] [switch_simplify]: 6.39001e-06 [loop_unroll]: 5.64e-06 [a_1]: 0.00011925 [with_stream_mark]: 8.73001e-06 [recompute_prepare]: 6.15002e-06 [updatestate_depend_eliminate]: 2.65002e-06 [updatestate_assign_eliminate]: 2.27001e-06 [updatestate_loads_eliminate]: 2.12999e-06 [parameter_eliminate]: 1.07998e-06 [specialize_transform]: 5.74e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.45001e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 5.33002e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.257e-05 [j_node_and_user_rematch]: 8.99e-06 [meta_fg_expand]: 1.79998e-06 [replace_old_param]: 8.2e-06 [inline_without_move]: 5.62999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.80013e-07 [auto_monad_grad]: 7.80012e-07 [auto_monad_eliminator]: 5.69999e-06 [cse]: 1.174e-05 [replace_applicator]: 5.78002e-06 [py_interpret_to_execute_after_opt_a]: 8.59998e-06 [rewriter_after_opt_a]: 3.208e-05 [convert_after_rewriter]: 6.79999e-06 [order_py_execute_after_rewriter]: 5.97001e-06 [mutable_eliminate]: 0.00046957 [jit_opt_b]: 5.311e-05, [1] [Cycle 1]: 4.695e-05, [2] [frontend_op_eliminate]: 1.844e-05 [inline_after_opt_a]: 1.802e-05 [cconv]: 2.428e-05 [loop_unroll]: 0.0004075 [jit_opt_after_cconv]: 0.00014472, [1] [Cycle 1]: 0.0001385, [11] [c_1]: 2.513e-05 [parameter_eliminate]: 2.31e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.8e-05 [call_graph_tuple_transform]: 2.002e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.66002e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 6.79999e-06 [remove_dup_value]: 1.56e-05 [partial_unused_args_eliminate]: 2.44999e-06 [environ_conv]: 8.40999e-06 [add_recomputation]: 4.905e-05 [cse_after_recomputation]: 2.028e-05, [1] [Cycle 1]: 1.528e-05, [1] [cse]: 9.93998e-06 [auto_monad_reorder]: 1.462e-05 [get_jit_bprop_graph]: 1.40001e-06 [rewriter_after_jit_bprop_graph]: 6.224e-05 [opt_after_jit_grad]: 0.00045555 [symbol_engine_optimizer]: 7.37e-05, [1] [Cycle 1]: 6.776e-05, [6] [build]: 3.06999e-06 [elim_shapecalc]: 7.97e-06 [elim_not_effective]: 1.32e-05 [opt_reshape]: 6.50002e-06 [fold_const_symbol]: 9.36e-06 [renormalize]: 3.19997e-07 [validate]: 3.772e-05 Sums bootstrap : 0.000269s : 0.26% type_inference : 0.098915s : 94.53% event_method : 0.000017s : 0.02% auto_monad : 0.000044s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000406s : 0.39% rewriter_before_opt_a : 0.000073s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000666s : 0.64% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002082s : 1.99% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000006s : 0.01% mutable_eliminate : 0.000470s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000408s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000049s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000062s : 0.06% opt_after_jit_grad : 0.000456s : 0.44% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000190 24 1.03% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000005s : 4: substitution.graph_param_transform 83.20% : 0.000158s : 4: substitution.inline 1.75% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000004s : 2: substitution.replace_old_param 6.26% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098856 2 97.70% : 0.096582s : 1: type_inference.infer 2.30% : 0.002275s : 1: type_inference.specialize ------[replace.] 0.000069 6 67.35% : 0.000046s : 4: replace.inline 32.65% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.57% : 0.000156s : 4: match.inline 6.43% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.33% : 0.000002s : 12: predicate.accumulaten_eliminater 1.56% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.84% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.51% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 0.92% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 4.99% : 0.000006s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.35% : 0.000002s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.85% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.16% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.35% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.65% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.00% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000001s : 12: predicate.reshape_eliminate 1.63% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.33% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.55% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.02% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.63% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001889 22 65.80% : 0.001243s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.55% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.65% : 0.000617s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111309 72 0.05% : 0.000052s : 1: add_recomputation 0.04% : 0.000048s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.26% : 0.000286s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.81% : 0.006472s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000415s : 1: loop_unroll 0.43% : 0.000478s : 1: mutable_eliminate 0.80% : 0.000888s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.42% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000008s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000412s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.31% : 0.001454s : 1: renormalize.infer 0.56% : 0.000619s : 1: renormalize.specialize 0.06% : 0.000065s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000078s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 88.88% : 0.098928s : 1: type_inference TotalTime = 0.109507, [30] [bootstrap]: 0.00025443 [type_inference]: 0.100012 [event_method]: 1.918e-05 [auto_monad]: 6.508e-05 [graph_reusing]: 5.79e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00041762 [rewriter_before_opt_a]: 8.278e-05 [expand_dump_flag]: 3.57997e-06 [jit_opt_a]: 0.00659491, [2] [Cycle 1]: 0.00310733, [27] [switch_simplify]: 5.131e-05 [loop_unroll]: 3.074e-05 [a_1]: 0.00053972 [with_stream_mark]: 1.578e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 4.25e-06 [updatestate_assign_eliminate]: 3.09999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.67999e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 6.14999e-06 [accelerated_algorithm]: 6.83e-06 [meta_shard_fg_expand]: 1.99e-06 [get_grad_eliminate_]: 6.14999e-06 [merge_forward]: 4.28001e-06 [cell_reuse_recompute_pass]: 1.01002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.491e-05 [j_node_and_user_rematch]: 9.97999e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.06e-06 [renormalize]: 0.00215069 [add_forward_monad_depend]: 5.28002e-06 [auto_monad_grad]: 1.81e-06 [auto_monad_eliminator]: 1.502e-05 [cse]: 2.822e-05 [replace_applicator]: 1.302e-05 [Cycle 2]: 0.00034965, [27] [switch_simplify]: 6.86001e-06 [loop_unroll]: 5.80002e-06 [a_1]: 0.00011813 [with_stream_mark]: 8.75001e-06 [recompute_prepare]: 5.74e-06 [updatestate_depend_eliminate]: 2.99999e-06 [updatestate_assign_eliminate]: 2.19999e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.59e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 2.65002e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.329e-05 [j_node_and_user_rematch]: 8.85001e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 8.32998e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 1.12999e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 5.80002e-06 [cse]: 1.045e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 8.43001e-06 [rewriter_after_opt_a]: 3.085e-05 [convert_after_rewriter]: 6.91001e-06 [order_py_execute_after_rewriter]: 5.09e-06 [mutable_eliminate]: 0.00045909 [jit_opt_b]: 5.468e-05, [1] [Cycle 1]: 4.752e-05, [2] [frontend_op_eliminate]: 1.88e-05 [inline_after_opt_a]: 1.726e-05 [cconv]: 2.329e-05 [loop_unroll]: 0.00040571 [jit_opt_after_cconv]: 0.00014522, [1] [Cycle 1]: 0.00013813, [11] [c_1]: 2.471e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 6.24001e-06 [updatestate_assign_eliminate]: 2.33002e-06 [updatestate_loads_eliminate]: 2.06998e-06 [cse]: 1.823e-05 [call_graph_tuple_transform]: 1.93e-05 [tuple_list_get_item_eliminator]: 6.50002e-06 [none_parameter_eliminate]: 1.56002e-06 [renormalize]: 4.30009e-07 [switch_simplify]: 5.92999e-06 [remove_dup_value]: 1.615e-05 [partial_unused_args_eliminate]: 2.19999e-06 [environ_conv]: 9.59e-06 [add_recomputation]: 4.669e-05 [cse_after_recomputation]: 2.132e-05, [1] [Cycle 1]: 1.559e-05, [1] [cse]: 1.003e-05 [auto_monad_reorder]: 1.547e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.02002e-06 [opt_after_jit_grad]: 0.00045655 [symbol_engine_optimizer]: 0.00013466, [1] [Cycle 1]: 0.00012835, [6] [build]: 3.2e-06 [elim_shapecalc]: 8.22003e-06 [elim_not_effective]: 1.413e-05 [opt_reshape]: 6.36e-06 [fold_const_symbol]: 6.814e-05 [renormalize]: 4.50003e-07 [validate]: 3.914e-05 Sums bootstrap : 0.000254s : 0.24% type_inference : 0.100012s : 94.51% event_method : 0.000019s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000418s : 0.39% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000658s : 0.62% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002151s : 2.03% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000459s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000406s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000010s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000457s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000068s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000184 24 1.10% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000006s : 4: substitution.graph_param_transform 82.07% : 0.000151s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000004s : 2: substitution.replace_old_param 6.64% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099946 2 97.64% : 0.097586s : 1: type_inference.infer 2.36% : 0.002360s : 1: type_inference.specialize ------[replace.] 0.000067 6 67.69% : 0.000045s : 4: replace.inline 32.31% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.07% : 0.000149s : 4: match.inline 6.93% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.50% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.29% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.38% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.22% : 0.000007s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.45% : 0.000002s : 8: predicate.less_batch_normalization 1.36% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.63% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.57% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.66% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.83% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.13% : 0.000001s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.19% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 58: predicate.switch_simplify 1.49% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.09% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.90% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.58% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002044 22 64.46% : 0.001318s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.25% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.29% : 0.000701s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112672 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000068s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000267s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000012s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.86% : 0.006598s : 1: jit_opt_a 0.13% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.37% : 0.000412s : 1: loop_unroll 0.41% : 0.000467s : 1: mutable_eliminate 0.78% : 0.000882s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000094s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000423s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.27% : 0.001427s : 1: renormalize.infer 0.64% : 0.000716s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000088s : 1: rewriter_before_opt_a 0.12% : 0.000138s : 1: symbol_engine_optimizer 88.78% : 0.100027s : 1: type_inference TotalTime = 0.0112804, [30] [bootstrap]: 0.00025441 [type_inference]: 0.00418173 [event_method]: 1.775e-05 [auto_monad]: 6.355e-05 [graph_reusing]: 5.89999e-06 [pre_auto_parallel]: 2.71999e-06 [py_interpret_to_execute]: 3.464e-05 [rewriter_before_opt_a]: 7.217e-05 [expand_dump_flag]: 2.81e-06 [jit_opt_a]: 0.00471359, [2] [Cycle 1]: 0.00138786, [27] [switch_simplify]: 5.147e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00049567 [with_stream_mark]: 1.353e-05 [recompute_prepare]: 7.13998e-06 [updatestate_depend_eliminate]: 4.05998e-06 [updatestate_assign_eliminate]: 3.25e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 2.32999e-06 [specialize_transform]: 5.92999e-06 [updatestate_useless_node_eliminater]: 4.92e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 2.05002e-06 [get_grad_eliminate_]: 5.07e-06 [merge_forward]: 4.02e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.46e-05 [j_node_and_user_rematch]: 8.60001e-06 [meta_fg_expand]: 2.31e-06 [replace_old_param]: 8.69e-06 [inline_without_move]: 5.34e-06 [renormalize]: 0.00049628 [add_forward_monad_depend]: 4.80999e-06 [auto_monad_grad]: 1.67001e-06 [auto_monad_eliminator]: 1.417e-05 [cse]: 2.737e-05 [replace_applicator]: 1.068e-05 [Cycle 2]: 0.00030795, [27] [switch_simplify]: 5.76998e-06 [loop_unroll]: 4.83001e-06 [a_1]: 8.891e-05 [with_stream_mark]: 8.25e-06 [recompute_prepare]: 5.03002e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.12999e-06 [updatestate_loads_eliminate]: 2.00002e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 5.01002e-06 [updatestate_useless_node_eliminater]: 4.87e-06 [accelerated_algorithm]: 4.68001e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 4.47998e-06 [merge_forward]: 2.55002e-06 [cell_reuse_recompute_pass]: 1.17e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.229e-05 [j_node_and_user_rematch]: 7.36999e-06 [meta_fg_expand]: 1.42e-06 [replace_old_param]: 7e-06 [inline_without_move]: 4.60001e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 1.09e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.73002e-06 [cse]: 1.019e-05 [replace_applicator]: 5.00001e-06 [py_interpret_to_execute_after_opt_a]: 7.93999e-06 [rewriter_after_opt_a]: 3.011e-05 [convert_after_rewriter]: 6.42001e-06 [order_py_execute_after_rewriter]: 4.82e-06 [mutable_eliminate]: 0.00045779 [jit_opt_b]: 5.946e-05, [1] [Cycle 1]: 5.303e-05, [2] [frontend_op_eliminate]: 1.542e-05 [inline_after_opt_a]: 1.642e-05 [cconv]: 2.344e-05 [loop_unroll]: 0.00040923 [jit_opt_after_cconv]: 0.00013708, [1] [Cycle 1]: 0.0001307, [11] [c_1]: 2.08e-05 [parameter_eliminate]: 2.54999e-06 [updatestate_depend_eliminate]: 6.07001e-06 [updatestate_assign_eliminate]: 2.56e-06 [updatestate_loads_eliminate]: 2.15002e-06 [cse]: 1.729e-05 [call_graph_tuple_transform]: 1.789e-05 [tuple_list_get_item_eliminator]: 5.39e-06 [none_parameter_eliminate]: 1.49998e-06 [renormalize]: 5.19998e-07 [switch_simplify]: 5.41998e-06 [remove_dup_value]: 1.387e-05 [partial_unused_args_eliminate]: 2.48002e-06 [environ_conv]: 5.51998e-06 [add_recomputation]: 4.557e-05 [cse_after_recomputation]: 2.02e-05, [1] [Cycle 1]: 1.515e-05, [1] [cse]: 9.76998e-06 [auto_monad_reorder]: 1.528e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 5.37001e-06 [opt_after_jit_grad]: 0.00043661 [symbol_engine_optimizer]: 6.968e-05, [1] [Cycle 1]: 6.383e-05, [6] [build]: 2.86e-06 [elim_shapecalc]: 7.69002e-06 [elim_not_effective]: 1.277e-05 [opt_reshape]: 5.59e-06 [fold_const_symbol]: 8.22e-06 [renormalize]: 3.39991e-07 [validate]: 2.967e-05 Sums bootstrap : 0.000254s : 3.29% type_inference : 0.004182s : 54.13% event_method : 0.000018s : 0.23% auto_monad : 0.000064s : 0.82% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000003s : 0.04% py_interpret_to_execute : 0.000035s : 0.45% rewriter_before_opt_a : 0.000072s : 0.93% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000057s : 0.74% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000585s : 7.57% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000007s : 0.09% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.35% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000496s : 6.42% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.26% jit_opt_a.cse : 0.000038s : 0.49% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.39% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000458s : 5.93% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000023s : 0.30% loop_unroll : 0.000409s : 5.30% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000046s : 0.59% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000015s : 0.20% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.07% opt_after_jit_grad : 0.000437s : 5.65% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.38% Time group info: ------[substitution.] 0.000176 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 3.01% : 0.000005s : 3: substitution.graph_param_transform 81.80% : 0.000144s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.80% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 6.80% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004127 2 80.65% : 0.003328s : 1: type_inference.infer 19.35% : 0.000799s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.95% : 0.000043s : 4: replace.inline 33.05% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000152 6 92.92% : 0.000141s : 4: match.inline 7.08% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.09% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.81% : 0.000002s : 10: predicate.arithmetic_simplify 1.43% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.09% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.21% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.12% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 3: predicate.elim_not_effective 0.56% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.38% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.43% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 15: predicate.load_eliminater 1.47% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.23% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.91% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 10: predicate.merge_addn 1.08% : 0.000001s : 10: predicate.minmaximum_grad 1.55% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 2.07% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.40% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 3: predicate.row_tensor_eliminate 1.22% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.12% : 0.000002s : 16: predicate.switch_layer_defer_inline 8.01% : 0.000009s : 53: predicate.switch_simplify 1.26% : 0.000001s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.32% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.01% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.79% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.73% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000537 13 50.03% : 0.000269s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.77% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.21% : 0.000243s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012628 72 0.38% : 0.000048s : 1: add_recomputation 0.53% : 0.000067s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.13% : 0.000269s : 1: bootstrap 0.21% : 0.000026s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000022s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.17% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.34% : 0.004716s : 1: jit_opt_a 1.11% : 0.000140s : 1: jit_opt_after_cconv 0.49% : 0.000062s : 1: jit_opt_b 3.30% : 0.000417s : 1: loop_unroll 3.68% : 0.000465s : 1: mutable_eliminate 6.23% : 0.000786s : 26: opt.transform.jit_opt_a 0.37% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.51% : 0.000444s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000004s : 1: partial_unused_args_eliminate 0.04% : 0.000005s : 1: pre_auto_parallel 0.29% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 1.95% : 0.000246s : 1: renormalize.infer 1.92% : 0.000243s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000033s : 1: rewriter_after_opt_a 0.59% : 0.000075s : 1: rewriter_before_opt_a 0.57% : 0.000072s : 1: symbol_engine_optimizer 33.20% : 0.004192s : 1: type_inference TotalTime = 0.109608, [30] [bootstrap]: 0.00025136 [type_inference]: 0.100335 [event_method]: 1.893e-05 [auto_monad]: 6.457e-05 [graph_reusing]: 5.91e-06 [pre_auto_parallel]: 2.33998e-06 [py_interpret_to_execute]: 0.00040844 [rewriter_before_opt_a]: 8.224e-05 [expand_dump_flag]: 3.38999e-06 [jit_opt_a]: 0.00637779, [2] [Cycle 1]: 0.00298299, [27] [switch_simplify]: 5.141e-05 [loop_unroll]: 2.975e-05 [a_1]: 0.00053587 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 8.16002e-06 [updatestate_depend_eliminate]: 4.17e-06 [updatestate_assign_eliminate]: 3.25998e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.81998e-06 [accelerated_algorithm]: 6.12999e-06 [meta_shard_fg_expand]: 2.09999e-06 [get_grad_eliminate_]: 5.84e-06 [merge_forward]: 3.74002e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.464e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.98002e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00203084 [add_forward_monad_depend]: 5.13002e-06 [auto_monad_grad]: 2.01998e-06 [auto_monad_eliminator]: 1.516e-05 [cse]: 2.981e-05 [replace_applicator]: 1.284e-05 [Cycle 2]: 0.00036721, [27] [switch_simplify]: 6.46e-06 [loop_unroll]: 5.69e-06 [a_1]: 0.00013506 [with_stream_mark]: 8.81002e-06 [recompute_prepare]: 5.86e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.18002e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 8.99978e-07 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.64e-06 [accelerated_algorithm]: 5.54998e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 5.17e-06 [merge_forward]: 2.44999e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 8.48001e-06 [meta_fg_expand]: 1.77001e-06 [replace_old_param]: 7.98999e-06 [inline_without_move]: 5.61998e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.80011e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.218e-05 [replace_applicator]: 5.57999e-06 [py_interpret_to_execute_after_opt_a]: 8.40001e-06 [rewriter_after_opt_a]: 3.126e-05 [convert_after_rewriter]: 6.87002e-06 [order_py_execute_after_rewriter]: 5.24e-06 [mutable_eliminate]: 0.00048752 [jit_opt_b]: 5.302e-05, [1] [Cycle 1]: 4.629e-05, [2] [frontend_op_eliminate]: 1.801e-05 [inline_after_opt_a]: 1.685e-05 [cconv]: 2.49e-05 [loop_unroll]: 0.00040749 [jit_opt_after_cconv]: 0.00014426, [1] [Cycle 1]: 0.00013679, [11] [c_1]: 2.493e-05 [parameter_eliminate]: 2.50002e-06 [updatestate_depend_eliminate]: 5.77999e-06 [updatestate_assign_eliminate]: 2.33998e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.807e-05 [call_graph_tuple_transform]: 1.909e-05 [tuple_list_get_item_eliminator]: 6.16e-06 [none_parameter_eliminate]: 1.64e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.94e-06 [remove_dup_value]: 1.435e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 8.36002e-06 [add_recomputation]: 4.562e-05 [cse_after_recomputation]: 2.163e-05, [1] [Cycle 1]: 1.583e-05, [1] [cse]: 1.023e-05 [auto_monad_reorder]: 1.639e-05 [get_jit_bprop_graph]: 1.45001e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00044512 [symbol_engine_optimizer]: 0.00012899, [1] [Cycle 1]: 0.00012238, [6] [build]: 2.89999e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 6.726e-05 [opt_reshape]: 6.51e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 3.69997e-07 [validate]: 3.884e-05 Sums bootstrap : 0.000251s : 0.24% type_inference : 0.100335s : 94.63% event_method : 0.000019s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000408s : 0.39% rewriter_before_opt_a : 0.000082s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000671s : 0.63% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002031s : 1.92% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000488s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000407s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000445s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000067s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000186 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.14% : 0.000006s : 4: substitution.graph_param_transform 82.56% : 0.000154s : 4: substitution.inline 1.86% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.44% : 0.000005s : 4: substitution.remove_not_recompute_node 2.07% : 0.000004s : 2: substitution.replace_old_param 6.22% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100269 2 97.59% : 0.097855s : 1: type_inference.infer 2.41% : 0.002414s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.73% : 0.000046s : 4: replace.inline 32.27% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000162 6 93.52% : 0.000151s : 4: match.inline 6.48% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000143 830 1.13% : 0.000002s : 12: predicate.accumulaten_eliminater 0.81% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 0.99% : 0.000001s : 12: predicate.addn_check_dump 1.06% : 0.000002s : 12: predicate.addn_zero_filter 1.64% : 0.000002s : 12: predicate.arithmetic_simplify 1.08% : 0.000002s : 12: predicate.cast_eliminate 0.40% : 0.000001s : 4: predicate.check_bprop_eliminate 0.96% : 0.000001s : 12: predicate.compare_switch_simplify 1.10% : 0.000002s : 12: predicate.depend_value_elim 1.03% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.08% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.04% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.87% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.01% : 0.000001s : 12: predicate.environ_add_const_eliminate 0.97% : 0.000001s : 12: predicate.environ_get_add_eliminate 0.94% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000002s : 12: predicate.environ_get_eliminate 0.96% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 4: predicate.fold_const_symbol 0.90% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 4.76% : 0.000007s : 26: predicate.inline 0.89% : 0.000001s : 8: predicate.inline_without_move 0.43% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.68% : 0.000002s : 18: predicate.load_eliminater 1.17% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.63% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.66% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 0.99% : 0.000001s : 12: predicate.merge_addn 0.96% : 0.000001s : 12: predicate.minmaximum_grad 1.43% : 0.000002s : 4: predicate.mutable_eliminate 0.50% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.03% : 0.000001s : 12: predicate.print_const_string_wrapper 1.41% : 0.000002s : 12: predicate.reduce_eliminate 1.34% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 1.84% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000001s : 4: predicate.reset_defer_inline 1.08% : 0.000002s : 12: predicate.reshape_eliminate 1.10% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.65% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000002s : 12: predicate.same_eliminate 0.65% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 8: predicate.special_op_eliminate 0.90% : 0.000001s : 8: predicate.specialize_transform 1.27% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.03% : 0.000003s : 18: predicate.switch_defer_inline 1.73% : 0.000002s : 18: predicate.switch_layer_defer_inline 6.58% : 0.000009s : 58: predicate.switch_simplify 1.12% : 0.000002s : 12: predicate.tile_eliminate 1.03% : 0.000001s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 13.51% : 0.000019s : 12: predicate.tuple_list_get_item_depend_reorder 3.40% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.33% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.54% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.68% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.28% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.53% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001859 22 66.47% : 0.001236s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.10% : 0.000597s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112654 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000068s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.23% : 0.000264s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.66% : 0.006381s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000415s : 1: loop_unroll 0.44% : 0.000495s : 1: mutable_eliminate 0.79% : 0.000890s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000088s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000453s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000414s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.25% : 0.001411s : 1: renormalize.infer 0.54% : 0.000611s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000087s : 1: rewriter_before_opt_a 0.12% : 0.000132s : 1: symbol_engine_optimizer 89.08% : 0.100350s : 1: type_inference TotalTime = 0.0578866, [30] [bootstrap]: 0.00026176 [type_inference]: 0.0492029 [event_method]: 1.86e-05 [auto_monad]: 6.692e-05 [graph_reusing]: 5.45001e-06 [pre_auto_parallel]: 2.28002e-06 [py_interpret_to_execute]: 0.00023639 [rewriter_before_opt_a]: 8.188e-05 [expand_dump_flag]: 4.50999e-06 [jit_opt_a]: 0.00600998, [2] [Cycle 1]: 0.00254886, [27] [switch_simplify]: 5.318e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00053816 [with_stream_mark]: 1.576e-05 [recompute_prepare]: 8.70999e-06 [updatestate_depend_eliminate]: 4.03999e-06 [updatestate_assign_eliminate]: 3.20002e-06 [updatestate_loads_eliminate]: 2.97002e-06 [parameter_eliminate]: 1.90001e-06 [specialize_transform]: 7.01001e-06 [updatestate_useless_node_eliminater]: 5.97001e-06 [accelerated_algorithm]: 6.28e-06 [meta_shard_fg_expand]: 2.22999e-06 [get_grad_eliminate_]: 6.13002e-06 [merge_forward]: 3.83001e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.555e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.46e-06 [replace_old_param]: 9.47001e-06 [inline_without_move]: 6.25002e-06 [renormalize]: 0.00157433 [add_forward_monad_depend]: 4.90999e-06 [auto_monad_grad]: 1.97001e-06 [auto_monad_eliminator]: 1.511e-05 [cse]: 3.022e-05 [replace_applicator]: 1.291e-05 [Cycle 2]: 0.00034925, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.91e-06 [a_1]: 0.00011876 [with_stream_mark]: 8.75001e-06 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 2.71999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.67999e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 5.35999e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.293e-05 [j_node_and_user_rematch]: 8.64998e-06 [meta_fg_expand]: 1.84e-06 [replace_old_param]: 8.17e-06 [inline_without_move]: 5.43002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.18e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 8.91997e-06 [rewriter_after_opt_a]: 3.129e-05 [convert_after_rewriter]: 7.49002e-06 [order_py_execute_after_rewriter]: 5.04e-06 [mutable_eliminate]: 0.00046174 [jit_opt_b]: 5.265e-05, [1] [Cycle 1]: 4.647e-05, [2] [frontend_op_eliminate]: 1.897e-05 [inline_after_opt_a]: 1.692e-05 [cconv]: 2.393e-05 [loop_unroll]: 0.00040537 [jit_opt_after_cconv]: 0.00014169, [1] [Cycle 1]: 0.00013507, [11] [c_1]: 2.476e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.49001e-06 [updatestate_loads_eliminate]: 2.44999e-06 [cse]: 1.843e-05 [call_graph_tuple_transform]: 1.865e-05 [tuple_list_get_item_eliminator]: 6.19001e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 2.29978e-07 [switch_simplify]: 5.85002e-06 [remove_dup_value]: 1.667e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 7.50998e-06 [add_recomputation]: 4.632e-05 [cse_after_recomputation]: 2.123e-05, [1] [Cycle 1]: 1.641e-05, [1] [cse]: 1.107e-05 [auto_monad_reorder]: 1.537e-05 [get_jit_bprop_graph]: 1.74e-06 [rewriter_after_jit_bprop_graph]: 4.38001e-06 [opt_after_jit_grad]: 0.00047155 [symbol_engine_optimizer]: 7.338e-05, [1] [Cycle 1]: 6.771e-05, [6] [build]: 3.14999e-06 [elim_shapecalc]: 8.47e-06 [elim_not_effective]: 1.35e-05 [opt_reshape]: 6.41998e-06 [fold_const_symbol]: 9.32999e-06 [renormalize]: 3.19997e-07 [validate]: 3.77e-05 Sums bootstrap : 0.000262s : 0.48% type_inference : 0.049203s : 90.74% event_method : 0.000019s : 0.03% auto_monad : 0.000067s : 0.12% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000236s : 0.44% rewriter_before_opt_a : 0.000082s : 0.15% expand_dump_flag : 0.000005s : 0.01% jit_opt_a.switch_simplify : 0.000060s : 0.11% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000657s : 1.21% jit_opt_a.with_stream_mark : 0.000025s : 0.05% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001574s : 2.90% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000042s : 0.08% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000031s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000462s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000405s : 0.75% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.09% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000472s : 0.87% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.07% Time group info: ------[substitution.] 0.000181 24 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 3.02% : 0.000005s : 4: substitution.graph_param_transform 82.07% : 0.000149s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.66% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049126 2 96.58% : 0.047444s : 1: type_inference.infer 3.42% : 0.001682s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.56% : 0.000045s : 4: replace.inline 32.44% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000157 6 93.03% : 0.000146s : 4: match.inline 6.97% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.16% : 0.000001s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.42% : 0.000002s : 12: predicate.addn_zero_filter 2.17% : 0.000003s : 12: predicate.arithmetic_simplify 1.18% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.31% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.47% : 0.000007s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.08% : 0.000003s : 18: predicate.load_eliminater 1.56% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.92% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.82% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.55% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.49% : 0.000003s : 18: predicate.partial_eliminate 1.12% : 0.000001s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000001s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.47% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.28% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 58: predicate.switch_simplify 1.18% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.10% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.72% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.37% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.69% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002012 26 71.13% : 0.001431s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.31% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.56% : 0.000555s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060420 72 0.08% : 0.000049s : 1: add_recomputation 0.12% : 0.000070s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.45% : 0.000274s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.02% : 0.000010s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000007s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.95% : 0.006012s : 1: jit_opt_a 0.24% : 0.000144s : 1: jit_opt_after_cconv 0.09% : 0.000055s : 1: jit_opt_b 0.68% : 0.000414s : 1: loop_unroll 0.78% : 0.000469s : 1: mutable_eliminate 1.46% : 0.000881s : 26: opt.transform.jit_opt_a 0.09% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.79% : 0.000479s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000241s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.68% : 0.001013s : 1: renormalize.infer 0.92% : 0.000553s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000034s : 1: rewriter_after_opt_a 0.14% : 0.000088s : 1: rewriter_before_opt_a 0.13% : 0.000076s : 1: symbol_engine_optimizer 81.46% : 0.049219s : 1: type_inference TotalTime = 0.0112277, [30] [bootstrap]: 0.00029491 [type_inference]: 0.00411581 [event_method]: 1.657e-05 [auto_monad]: 6.34e-05 [graph_reusing]: 5.64998e-06 [pre_auto_parallel]: 2.22001e-06 [py_interpret_to_execute]: 3.695e-05 [rewriter_before_opt_a]: 7.218e-05 [expand_dump_flag]: 2.88e-06 [jit_opt_a]: 0.00467948, [2] [Cycle 1]: 0.0014024, [27] [switch_simplify]: 4.894e-05 [loop_unroll]: 2.995e-05 [a_1]: 0.00052183 [with_stream_mark]: 1.427e-05 [recompute_prepare]: 7.41999e-06 [updatestate_depend_eliminate]: 3.95998e-06 [updatestate_assign_eliminate]: 3.26999e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.67001e-06 [specialize_transform]: 6.07999e-06 [updatestate_useless_node_eliminater]: 5.06002e-06 [accelerated_algorithm]: 5.27999e-06 [meta_shard_fg_expand]: 2.04999e-06 [get_grad_eliminate_]: 5.25001e-06 [merge_forward]: 3.36999e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.486e-05 [j_node_and_user_rematch]: 8.72998e-06 [meta_fg_expand]: 2.21e-06 [replace_old_param]: 8.13001e-06 [inline_without_move]: 5.26998e-06 [renormalize]: 0.00048522 [add_forward_monad_depend]: 4.92e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 1.4e-05 [cse]: 2.509e-05 [replace_applicator]: 1.117e-05 [Cycle 2]: 0.00031088, [27] [switch_simplify]: 5.62999e-06 [loop_unroll]: 4.91997e-06 [a_1]: 9.15e-05 [with_stream_mark]: 8.22e-06 [recompute_prepare]: 4.98001e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 9.60019e-07 [specialize_transform]: 5.20999e-06 [updatestate_useless_node_eliminater]: 4.82998e-06 [accelerated_algorithm]: 4.80999e-06 [meta_shard_fg_expand]: 9.89996e-07 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.22e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.18e-05 [j_node_and_user_rematch]: 7.69002e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.03e-06 [inline_without_move]: 4.77e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 5.8001e-07 [auto_monad_eliminator]: 5.15001e-06 [cse]: 9.65002e-06 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 7.06001e-06 [rewriter_after_opt_a]: 3.019e-05 [convert_after_rewriter]: 7.38999e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.0004576 [jit_opt_b]: 4.872e-05, [1] [Cycle 1]: 4.214e-05, [2] [frontend_op_eliminate]: 1.546e-05 [inline_after_opt_a]: 1.547e-05 [cconv]: 2.415e-05 [loop_unroll]: 0.00040568 [jit_opt_after_cconv]: 0.00014842, [1] [Cycle 1]: 0.00014194, [11] [c_1]: 2.095e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 5.62999e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.74e-05 [call_graph_tuple_transform]: 1.857e-05 [tuple_list_get_item_eliminator]: 1.62e-05 [none_parameter_eliminate]: 1.70001e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 5.71998e-06 [remove_dup_value]: 1.541e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 5.49e-06 [add_recomputation]: 4.538e-05 [cse_after_recomputation]: 2.18e-05, [1] [Cycle 1]: 1.646e-05, [1] [cse]: 1.078e-05 [auto_monad_reorder]: 1.413e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 4.95999e-06 [opt_after_jit_grad]: 0.00044824 [symbol_engine_optimizer]: 7.169e-05, [1] [Cycle 1]: 6.601e-05, [6] [build]: 2.79001e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.387e-05 [opt_reshape]: 5.54e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 2.89991e-07 [validate]: 3.038e-05 Sums bootstrap : 0.000295s : 3.81% type_inference : 0.004116s : 53.21% event_method : 0.000017s : 0.21% auto_monad : 0.000063s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000037s : 0.48% rewriter_before_opt_a : 0.000072s : 0.93% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000613s : 7.93% jit_opt_a.with_stream_mark : 0.000022s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000485s : 6.27% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000035s : 0.45% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000007s : 0.09% rewriter_after_opt_a : 0.000030s : 0.39% convert_after_rewriter : 0.000007s : 0.10% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000458s : 5.92% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000024s : 0.31% loop_unroll : 0.000406s : 5.24% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000016s : 0.21% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.20% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000045s : 0.59% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000014s : 0.18% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000448s : 5.79% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.18% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.12% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.39% Time group info: ------[substitution.] 0.000169 23 1.32% : 0.000002s : 2: substitution.elim_not_effective 0.99% : 0.000002s : 2: substitution.fold_const_symbol 2.98% : 0.000005s : 3: substitution.graph_param_transform 81.28% : 0.000138s : 4: substitution.inline 1.53% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000003s : 2: substitution.replace_old_param 7.20% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004062 2 79.27% : 0.003220s : 1: type_inference.infer 20.73% : 0.000842s : 1: type_inference.specialize ------[replace.] 0.000091 6 46.53% : 0.000042s : 4: replace.inline 53.47% : 0.000049s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000146 6 92.46% : 0.000135s : 4: match.inline 7.54% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.49% : 0.000002s : 10: predicate.accumulaten_eliminater 1.15% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000001s : 10: predicate.addn_check_dump 1.18% : 0.000001s : 10: predicate.addn_zero_filter 1.90% : 0.000002s : 10: predicate.arithmetic_simplify 1.24% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.26% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.05% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.58% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.94% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.56% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 15: predicate.load_eliminater 1.57% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.48% : 0.000001s : 3: predicate.opt_reshape 2.38% : 0.000003s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.78% : 0.000002s : 10: predicate.reduce_eliminate 1.50% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.71% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.32% : 0.000000s : 3: predicate.reset_defer_inline 1.25% : 0.000001s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.10% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.76% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.70% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000530 13 50.35% : 0.000267s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.70% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.95% : 0.000238s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012607 72 0.38% : 0.000048s : 1: add_recomputation 0.53% : 0.000066s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 2.44% : 0.000307s : 1: bootstrap 0.21% : 0.000027s : 1: cconv 0.08% : 0.000010s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.14% : 0.004682s : 1: jit_opt_a 1.20% : 0.000151s : 1: jit_opt_after_cconv 0.41% : 0.000051s : 1: jit_opt_b 3.27% : 0.000413s : 1: loop_unroll 3.69% : 0.000465s : 1: mutable_eliminate 6.44% : 0.000812s : 26: opt.transform.jit_opt_a 0.46% : 0.000058s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.26% : 0.000033s : 4: opt.transform.symbol_engine_opt 3.61% : 0.000455s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000040s : 1: py_interpret_to_execute 0.07% : 0.000009s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 1.88% : 0.000237s : 1: renormalize.infer 1.91% : 0.000241s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000033s : 1: rewriter_after_opt_a 0.59% : 0.000075s : 1: rewriter_before_opt_a 0.59% : 0.000074s : 1: symbol_engine_optimizer 32.73% : 0.004126s : 1: type_inference TotalTime = 0.0117655, [30] [bootstrap]: 0.00025164 [type_inference]: 0.00448178 [event_method]: 1.775e-05 [auto_monad]: 6.358e-05 [graph_reusing]: 5.56002e-06 [pre_auto_parallel]: 2.59001e-06 [py_interpret_to_execute]: 3.916e-05 [rewriter_before_opt_a]: 7.43e-05 [expand_dump_flag]: 3.11001e-06 [jit_opt_a]: 0.00487332, [2] [Cycle 1]: 0.00151927, [27] [switch_simplify]: 4.992e-05 [loop_unroll]: 2.997e-05 [a_1]: 0.00049972 [with_stream_mark]: 1.669e-05 [recompute_prepare]: 7.2e-06 [updatestate_depend_eliminate]: 4.08001e-06 [updatestate_assign_eliminate]: 3.23e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.69e-06 [specialize_transform]: 6.35997e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.24e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.6e-06 [cell_reuse_recompute_pass]: 9.50007e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.42e-05 [j_node_and_user_rematch]: 8.68001e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 7.93001e-06 [inline_without_move]: 5.11002e-06 [renormalize]: 0.00055637 [add_forward_monad_depend]: 4.75001e-06 [auto_monad_grad]: 1.89e-06 [auto_monad_eliminator]: 7.459e-05 [cse]: 2.907e-05 [replace_applicator]: 1.291e-05 [Cycle 2]: 0.00031477, [27] [switch_simplify]: 6.16e-06 [loop_unroll]: 4.75999e-06 [a_1]: 9.519e-05 [with_stream_mark]: 7.98001e-06 [recompute_prepare]: 4.87e-06 [updatestate_depend_eliminate]: 2.58998e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 1.08001e-06 [specialize_transform]: 5.09e-06 [updatestate_useless_node_eliminater]: 4.95999e-06 [accelerated_algorithm]: 4.85999e-06 [meta_shard_fg_expand]: 1.06002e-06 [get_grad_eliminate_]: 4.49002e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.49998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.206e-05 [j_node_and_user_rematch]: 7.97e-06 [meta_fg_expand]: 1.51002e-06 [replace_old_param]: 7.13e-06 [inline_without_move]: 4.63999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.90025e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.14e-06 [cse]: 1.044e-05 [replace_applicator]: 4.97999e-06 [py_interpret_to_execute_after_opt_a]: 8.16002e-06 [rewriter_after_opt_a]: 3.031e-05 [convert_after_rewriter]: 6.68e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00046898 [jit_opt_b]: 4.826e-05, [1] [Cycle 1]: 4.19e-05, [2] [frontend_op_eliminate]: 1.568e-05 [inline_after_opt_a]: 1.489e-05 [cconv]: 2.446e-05 [loop_unroll]: 0.00041327 [jit_opt_after_cconv]: 0.00014612, [1] [Cycle 1]: 0.00013943, [11] [c_1]: 1.984e-05 [parameter_eliminate]: 2.49999e-06 [updatestate_depend_eliminate]: 5.09e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.55002e-06 [cse]: 1.747e-05 [call_graph_tuple_transform]: 1.656e-05 [tuple_list_get_item_eliminator]: 1.758e-05 [none_parameter_eliminate]: 1.91e-06 [renormalize]: 3.10014e-07 [switch_simplify]: 5.52001e-06 [remove_dup_value]: 1.487e-05 [partial_unused_args_eliminate]: 2.04e-06 [environ_conv]: 5.31998e-06 [add_recomputation]: 4.488e-05 [cse_after_recomputation]: 2.169e-05, [1] [Cycle 1]: 1.617e-05, [1] [cse]: 1.091e-05 [auto_monad_reorder]: 1.565e-05 [get_jit_bprop_graph]: 1.45001e-06 [rewriter_after_jit_bprop_graph]: 4.26001e-06 [opt_after_jit_grad]: 0.00044347 [symbol_engine_optimizer]: 6.981e-05, [1] [Cycle 1]: 6.372e-05, [6] [build]: 3.29001e-06 [elim_shapecalc]: 7.24001e-06 [elim_not_effective]: 1.241e-05 [opt_reshape]: 5.63002e-06 [fold_const_symbol]: 8.97e-06 [renormalize]: 4.50003e-07 [validate]: 3.134e-05 Sums bootstrap : 0.000252s : 3.07% type_inference : 0.004482s : 54.66% event_method : 0.000018s : 0.22% auto_monad : 0.000064s : 0.78% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.48% rewriter_before_opt_a : 0.000074s : 0.91% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000056s : 0.68% jit_opt_a.loop_unroll : 0.000035s : 0.42% jit_opt_a.a_1 : 0.000595s : 7.26% jit_opt_a.with_stream_mark : 0.000025s : 0.30% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000556s : 6.79% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000080s : 0.97% jit_opt_a.cse : 0.000040s : 0.48% jit_opt_a.replace_applicator : 0.000018s : 0.22% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.37% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000469s : 5.72% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000024s : 0.30% loop_unroll : 0.000413s : 5.04% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.20% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000018s : 0.21% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.07% remove_dup_value : 0.000015s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000045s : 0.55% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000016s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000443s : 5.41% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000031s : 0.38% Time group info: ------[substitution.] 0.000179 23 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.88% : 0.000002s : 2: substitution.fold_const_symbol 2.70% : 0.000005s : 3: substitution.graph_param_transform 82.17% : 0.000147s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.56% : 0.000005s : 4: substitution.remove_not_recompute_node 2.03% : 0.000004s : 2: substitution.replace_old_param 6.81% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004429 2 80.31% : 0.003557s : 1: type_inference.infer 19.69% : 0.000872s : 1: type_inference.specialize ------[replace.] 0.000064 6 68.09% : 0.000044s : 4: replace.inline 31.91% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 92.87% : 0.000145s : 4: match.inline 7.13% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.13% : 0.000001s : 10: predicate.accumulaten_eliminater 1.17% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.85% : 0.000002s : 10: predicate.arithmetic_simplify 1.17% : 0.000001s : 10: predicate.cast_eliminate 0.55% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.33% : 0.000001s : 10: predicate.depend_value_elim 1.16% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.34% : 0.000000s : 3: predicate.elim_not_effective 0.53% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.70% : 0.000006s : 22: predicate.inline 0.89% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 15: predicate.load_eliminater 1.54% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.79% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.32% : 0.000003s : 15: predicate.partial_eliminate 1.17% : 0.000001s : 10: predicate.print_const_string_wrapper 1.59% : 0.000002s : 10: predicate.reduce_eliminate 1.48% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 6: predicate.remove_not_recompute_node 1.92% : 0.000002s : 18: predicate.replace_applicator 0.71% : 0.000001s : 6: predicate.replace_old_param 0.28% : 0.000000s : 3: predicate.reset_defer_inline 1.19% : 0.000001s : 10: predicate.reshape_eliminate 1.36% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.87% : 0.000001s : 6: predicate.special_op_eliminate 1.02% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.49% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.98% : 0.000009s : 53: predicate.switch_simplify 1.20% : 0.000001s : 10: predicate.tile_eliminate 1.18% : 0.000001s : 10: predicate.transpose_eliminate 1.59% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.29% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.02% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000610 13 48.59% : 0.000296s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.46% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.96% : 0.000286s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013196 72 0.36% : 0.000048s : 1: add_recomputation 0.51% : 0.000067s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.00% : 0.000264s : 1: bootstrap 0.21% : 0.000027s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.95% : 0.004876s : 1: jit_opt_a 1.13% : 0.000149s : 1: jit_opt_after_cconv 0.38% : 0.000051s : 1: jit_opt_b 3.19% : 0.000420s : 1: loop_unroll 3.62% : 0.000477s : 1: mutable_eliminate 6.04% : 0.000797s : 26: opt.transform.jit_opt_a 0.43% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000014s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.42% : 0.000451s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000017s : 1: remove_dup_value 2.07% : 0.000273s : 1: renormalize.infer 2.10% : 0.000277s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000033s : 1: rewriter_after_opt_a 0.58% : 0.000077s : 1: rewriter_before_opt_a 0.55% : 0.000072s : 1: symbol_engine_optimizer 34.04% : 0.004492s : 1: type_inference TotalTime = 0.108898, [30] [bootstrap]: 0.00025132 [type_inference]: 0.0995366 [event_method]: 2.038e-05 [auto_monad]: 7.052e-05 [graph_reusing]: 5.79999e-06 [pre_auto_parallel]: 2.48998e-06 [py_interpret_to_execute]: 0.00041376 [rewriter_before_opt_a]: 8.788e-05 [expand_dump_flag]: 3.88999e-06 [jit_opt_a]: 0.00643128, [2] [Cycle 1]: 0.00301344, [27] [switch_simplify]: 5.249e-05 [loop_unroll]: 3.064e-05 [a_1]: 0.00053505 [with_stream_mark]: 1.484e-05 [recompute_prepare]: 9.42999e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.04999e-06 [updatestate_loads_eliminate]: 3.25e-06 [parameter_eliminate]: 1.91998e-06 [specialize_transform]: 6.67002e-06 [updatestate_useless_node_eliminater]: 5.81e-06 [accelerated_algorithm]: 6.26e-06 [meta_shard_fg_expand]: 2.79999e-06 [get_grad_eliminate_]: 5.97999e-06 [merge_forward]: 4.25e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.522e-05 [j_node_and_user_rematch]: 9.72999e-06 [meta_fg_expand]: 2.27001e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 0.00205316 [add_forward_monad_depend]: 5.27999e-06 [auto_monad_grad]: 1.97001e-06 [auto_monad_eliminator]: 1.624e-05 [cse]: 3.125e-05 [replace_applicator]: 1.308e-05 [Cycle 2]: 0.00034606, [27] [switch_simplify]: 6.54001e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00011702 [with_stream_mark]: 8.23001e-06 [recompute_prepare]: 5.69999e-06 [updatestate_depend_eliminate]: 2.72001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.51e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.34998e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 5.22999e-06 [merge_forward]: 2.70997e-06 [cell_reuse_recompute_pass]: 1.14998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.293e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 8.28001e-06 [inline_without_move]: 5.25001e-06 [renormalize]: 1.00001e-07 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.172e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 9.59e-06 [rewriter_after_opt_a]: 3.16e-05 [convert_after_rewriter]: 1.157e-05 [order_py_execute_after_rewriter]: 4.89e-06 [mutable_eliminate]: 0.00048333 [jit_opt_b]: 5.313e-05, [1] [Cycle 1]: 4.696e-05, [2] [frontend_op_eliminate]: 1.901e-05 [inline_after_opt_a]: 1.689e-05 [cconv]: 2.471e-05 [loop_unroll]: 0.00041091 [jit_opt_after_cconv]: 0.00014702, [1] [Cycle 1]: 0.00014068, [11] [c_1]: 2.599e-05 [parameter_eliminate]: 2.34001e-06 [updatestate_depend_eliminate]: 5.19998e-06 [updatestate_assign_eliminate]: 2.34999e-06 [updatestate_loads_eliminate]: 2.89999e-06 [cse]: 1.944e-05 [call_graph_tuple_transform]: 1.986e-05 [tuple_list_get_item_eliminator]: 6.11e-06 [none_parameter_eliminate]: 1.97001e-06 [renormalize]: 2.30008e-07 [switch_simplify]: 5.91998e-06 [remove_dup_value]: 1.612e-05 [partial_unused_args_eliminate]: 1.92999e-06 [environ_conv]: 8.60001e-06 [add_recomputation]: 4.719e-05 [cse_after_recomputation]: 2.161e-05, [1] [Cycle 1]: 1.694e-05, [1] [cse]: 1.138e-05 [auto_monad_reorder]: 1.527e-05 [get_jit_bprop_graph]: 2.66e-06 [rewriter_after_jit_bprop_graph]: 3.87998e-06 [opt_after_jit_grad]: 0.00044609 [symbol_engine_optimizer]: 7.511e-05, [1] [Cycle 1]: 6.929e-05, [6] [build]: 3.13998e-06 [elim_shapecalc]: 9.28002e-06 [elim_not_effective]: 1.355e-05 [opt_reshape]: 5.90002e-06 [fold_const_symbol]: 1.154e-05 [renormalize]: 2.80008e-07 [validate]: 9.383e-05 Sums bootstrap : 0.000251s : 0.24% type_inference : 0.099537s : 94.55% event_method : 0.000020s : 0.02% auto_monad : 0.000071s : 0.07% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000414s : 0.39% rewriter_before_opt_a : 0.000088s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000652s : 0.62% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002053s : 1.95% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000043s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000012s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000483s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000411s : 0.39% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000003s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000012s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000094s : 0.09% Time group info: ------[substitution.] 0.000184 24 1.50% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 3.06% : 0.000006s : 4: substitution.graph_param_transform 81.75% : 0.000151s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.61% : 0.000005s : 4: substitution.remove_not_recompute_node 2.50% : 0.000005s : 2: substitution.replace_old_param 6.32% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099468 2 97.58% : 0.097056s : 1: type_inference.infer 2.42% : 0.002411s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.60% : 0.000044s : 4: replace.inline 33.40% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000158 6 93.42% : 0.000148s : 4: match.inline 6.58% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.21% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.07% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.49% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.30% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.00% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.50% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.94% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.21% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.79% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.90% : 0.000002s : 12: predicate.reduce_eliminate 1.35% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.63% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.17% : 0.000001s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.03% : 0.000001s : 4: predicate.row_tensor_eliminate 1.51% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 0.98% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.48% : 0.000010s : 58: predicate.switch_simplify 1.20% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.81% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 12: predicate.value_based_eliminate 0.41% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.96% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001837 22 65.02% : 0.001195s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.45% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.53% : 0.000616s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111848 72 0.04% : 0.000050s : 1: add_recomputation 0.07% : 0.000074s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.23% : 0.000262s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000014s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000005s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.75% : 0.006434s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000418s : 1: loop_unroll 0.44% : 0.000491s : 1: mutable_eliminate 0.78% : 0.000875s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000037s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.38% : 0.000420s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.26% : 0.001413s : 1: renormalize.infer 0.56% : 0.000632s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000093s : 1: rewriter_before_opt_a 0.07% : 0.000078s : 1: symbol_engine_optimizer 89.01% : 0.099554s : 1: type_inference TotalTime = 0.108699, [30] [bootstrap]: 0.00025376 [type_inference]: 0.0992644 [event_method]: 1.746e-05 [auto_monad]: 6.663e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00040185 [rewriter_before_opt_a]: 7.989e-05 [expand_dump_flag]: 3.75e-06 [jit_opt_a]: 0.00656946, [2] [Cycle 1]: 0.00313618, [27] [switch_simplify]: 5.013e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00054339 [with_stream_mark]: 1.63e-05 [recompute_prepare]: 8.91002e-06 [updatestate_depend_eliminate]: 3.34001e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.65001e-06 [specialize_transform]: 6.92002e-06 [updatestate_useless_node_eliminater]: 5.92999e-06 [accelerated_algorithm]: 6.36998e-06 [meta_shard_fg_expand]: 2.06998e-06 [get_grad_eliminate_]: 5.94999e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 1.06002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.463e-05 [j_node_and_user_rematch]: 9.12999e-06 [meta_fg_expand]: 2.66999e-06 [replace_old_param]: 9.15999e-06 [inline_without_move]: 5.87001e-06 [renormalize]: 0.00217465 [add_forward_monad_depend]: 5.44e-06 [auto_monad_grad]: 2.17999e-06 [auto_monad_eliminator]: 1.493e-05 [cse]: 2.756e-05 [replace_applicator]: 1.282e-05 [Cycle 2]: 0.00035019, [27] [switch_simplify]: 6.69999e-06 [loop_unroll]: 5.68997e-06 [a_1]: 0.00011931 [with_stream_mark]: 8.3e-06 [recompute_prepare]: 5.77999e-06 [updatestate_depend_eliminate]: 2.73e-06 [updatestate_assign_eliminate]: 2.15002e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 1.09003e-06 [specialize_transform]: 6.04999e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.59998e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 2.43e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.338e-05 [j_node_and_user_rematch]: 8.47998e-06 [meta_fg_expand]: 1.56998e-06 [replace_old_param]: 8.64e-06 [inline_without_move]: 5.52999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.71998e-06 [cse]: 1.115e-05 [replace_applicator]: 5.84e-06 [py_interpret_to_execute_after_opt_a]: 9.19e-06 [rewriter_after_opt_a]: 3.288e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.94998e-06 [mutable_eliminate]: 0.00049164 [jit_opt_b]: 5.318e-05, [1] [Cycle 1]: 4.665e-05, [2] [frontend_op_eliminate]: 1.866e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 2.485e-05 [loop_unroll]: 0.00040765 [jit_opt_after_cconv]: 0.00014305, [1] [Cycle 1]: 0.00013663, [11] [c_1]: 2.491e-05 [parameter_eliminate]: 2.20002e-06 [updatestate_depend_eliminate]: 5.43002e-06 [updatestate_assign_eliminate]: 2.30002e-06 [updatestate_loads_eliminate]: 2.48e-06 [cse]: 1.827e-05 [call_graph_tuple_transform]: 1.905e-05 [tuple_list_get_item_eliminator]: 6.30002e-06 [none_parameter_eliminate]: 1.81998e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 6.18998e-06 [remove_dup_value]: 1.553e-05 [partial_unused_args_eliminate]: 2.15002e-06 [environ_conv]: 7.65e-06 [add_recomputation]: 4.767e-05 [cse_after_recomputation]: 2.246e-05, [1] [Cycle 1]: 1.715e-05, [1] [cse]: 1.143e-05 [auto_monad_reorder]: 1.523e-05 [get_jit_bprop_graph]: 2.00002e-06 [rewriter_after_jit_bprop_graph]: 4.03001e-06 [opt_after_jit_grad]: 0.00045029 [symbol_engine_optimizer]: 7.112e-05, [1] [Cycle 1]: 6.508e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 7.96001e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 6.39001e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 2.80008e-07 [validate]: 5.855e-05 Sums bootstrap : 0.000254s : 0.24% type_inference : 0.099264s : 94.48% event_method : 0.000017s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000402s : 0.38% rewriter_before_opt_a : 0.000080s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000663s : 0.63% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002175s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000492s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000408s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.05% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000450s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000059s : 0.06% Time group info: ------[substitution.] 0.000192 24 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.87% : 0.000006s : 4: substitution.graph_param_transform 83.21% : 0.000160s : 4: substitution.inline 1.51% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.40% : 0.000005s : 4: substitution.remove_not_recompute_node 2.34% : 0.000004s : 2: substitution.replace_old_param 5.89% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099198 2 97.68% : 0.096893s : 1: type_inference.infer 2.32% : 0.002305s : 1: type_inference.specialize ------[replace.] 0.000064 6 67.86% : 0.000044s : 4: replace.inline 32.14% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000167 6 93.90% : 0.000157s : 4: match.inline 6.10% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.17% : 0.000002s : 12: predicate.accumulaten_eliminater 1.07% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.31% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.31% : 0.000002s : 12: predicate.environ_get_depend_swap 1.24% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.12% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.07% : 0.000001s : 12: predicate.minmaximum_grad 1.54% : 0.000002s : 4: predicate.mutable_eliminate 0.77% : 0.000001s : 4: predicate.opt_reshape 2.57% : 0.000003s : 18: predicate.partial_eliminate 1.38% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.76% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.23% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.04% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.37% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.42% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.65% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001907 22 65.26% : 0.001245s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.74% : 0.000033s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.00% : 0.000629s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111808 72 0.05% : 0.000050s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000268s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.88% : 0.006572s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000415s : 1: loop_unroll 0.45% : 0.000499s : 1: mutable_eliminate 0.79% : 0.000884s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000458s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.36% : 0.000408s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.36% : 0.001519s : 1: renormalize.infer 0.58% : 0.000647s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000085s : 1: rewriter_before_opt_a 0.07% : 0.000074s : 1: symbol_engine_optimizer 88.79% : 0.099277s : 1: type_inference TotalTime = 0.0444358, [30] [bootstrap]: 0.00027249 [type_inference]: 0.0359688 [event_method]: 1.814e-05 [auto_monad]: 6.615e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 0.00020626 [rewriter_before_opt_a]: 8.009e-05 [expand_dump_flag]: 3.51999e-06 [jit_opt_a]: 0.00562139, [2] [Cycle 1]: 0.00226838, [27] [switch_simplify]: 5.663e-05 [loop_unroll]: 3.516e-05 [a_1]: 0.0006111 [with_stream_mark]: 1.628e-05 [recompute_prepare]: 8.37e-06 [updatestate_depend_eliminate]: 3.73001e-06 [updatestate_assign_eliminate]: 3.22002e-06 [updatestate_loads_eliminate]: 3.02002e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 7.15998e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 5.82001e-06 [meta_shard_fg_expand]: 2.29999e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 4.08999e-06 [cell_reuse_recompute_pass]: 1.28002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.545e-05 [j_node_and_user_rematch]: 9.65002e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.70002e-06 [inline_without_move]: 6.16e-06 [renormalize]: 0.00120847 [add_forward_monad_depend]: 5.29e-06 [auto_monad_grad]: 2.54001e-06 [auto_monad_eliminator]: 1.638e-05 [cse]: 3.046e-05 [replace_applicator]: 1.705e-05 [Cycle 2]: 0.00035751, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 5.86e-06 [a_1]: 0.00012178 [with_stream_mark]: 9.47001e-06 [recompute_prepare]: 5.90002e-06 [updatestate_depend_eliminate]: 3.25998e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.16e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.69e-06 [updatestate_useless_node_eliminater]: 5.69999e-06 [accelerated_algorithm]: 5.67999e-06 [meta_shard_fg_expand]: 1.38002e-06 [get_grad_eliminate_]: 5.27001e-06 [merge_forward]: 3.18e-06 [cell_reuse_recompute_pass]: 1.34e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.403e-05 [j_node_and_user_rematch]: 8.56997e-06 [meta_fg_expand]: 1.81e-06 [replace_old_param]: 9.00999e-06 [inline_without_move]: 5.56e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.007e-05 [replace_applicator]: 5.66998e-06 [py_interpret_to_execute_after_opt_a]: 9.89001e-06 [rewriter_after_opt_a]: 3.269e-05 [convert_after_rewriter]: 7.02002e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00052671 [jit_opt_b]: 5.516e-05, [1] [Cycle 1]: 4.779e-05, [2] [frontend_op_eliminate]: 1.92e-05 [inline_after_opt_a]: 1.696e-05 [cconv]: 2.405e-05 [loop_unroll]: 0.00041497 [jit_opt_after_cconv]: 0.00014783, [1] [Cycle 1]: 0.00014031, [11] [c_1]: 2.566e-05 [parameter_eliminate]: 2.62001e-06 [updatestate_depend_eliminate]: 6.44001e-06 [updatestate_assign_eliminate]: 2.41e-06 [updatestate_loads_eliminate]: 2.13002e-06 [cse]: 1.922e-05 [call_graph_tuple_transform]: 2.039e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.74998e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.86e-06 [remove_dup_value]: 1.457e-05 [partial_unused_args_eliminate]: 2.56e-06 [environ_conv]: 5.99e-06 [add_recomputation]: 4.738e-05 [cse_after_recomputation]: 2.046e-05, [1] [Cycle 1]: 1.55e-05, [1] [cse]: 9.96998e-06 [auto_monad_reorder]: 1.552e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.07e-06 [opt_after_jit_grad]: 0.0005801 [symbol_engine_optimizer]: 7.506e-05, [1] [Cycle 1]: 6.905e-05, [6] [build]: 2.99999e-06 [elim_shapecalc]: 8.57e-06 [elim_not_effective]: 1.383e-05 [opt_reshape]: 6.58e-06 [fold_const_symbol]: 9.68002e-06 [renormalize]: 3.10014e-07 [validate]: 3.367e-05 Sums bootstrap : 0.000272s : 0.67% type_inference : 0.035969s : 88.00% event_method : 0.000018s : 0.04% auto_monad : 0.000066s : 0.16% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.01% py_interpret_to_execute : 0.000206s : 0.50% rewriter_before_opt_a : 0.000080s : 0.20% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000064s : 0.16% jit_opt_a.loop_unroll : 0.000041s : 0.10% jit_opt_a.a_1 : 0.000733s : 1.79% jit_opt_a.with_stream_mark : 0.000026s : 0.06% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.02% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.03% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.03% jit_opt_a.accelerated_algorithm : 0.000012s : 0.03% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.03% jit_opt_a.merge_forward : 0.000007s : 0.02% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.01% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.07% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000019s : 0.05% jit_opt_a.inline_without_move : 0.000012s : 0.03% jit_opt_a.renormalize : 0.001209s : 2.96% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.02% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.05% jit_opt_a.cse : 0.000041s : 0.10% jit_opt_a.replace_applicator : 0.000023s : 0.06% py_interpret_to_execute_after_opt_a : 0.000010s : 0.02% rewriter_after_opt_a : 0.000033s : 0.08% convert_after_rewriter : 0.000007s : 0.02% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000527s : 1.29% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.05% jit_opt_b.inline_after_opt_a : 0.000017s : 0.04% cconv : 0.000024s : 0.06% loop_unroll : 0.000415s : 1.02% jit_opt_after_cconv.c_1 : 0.000026s : 0.06% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.01% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.02% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.01% jit_opt_after_cconv.cse : 0.000019s : 0.05% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.05% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.02% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.04% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000047s : 0.12% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000016s : 0.04% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000580s : 1.42% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.02% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000034s : 0.08% Time group info: ------[substitution.] 0.000184 24 1.07% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000006s : 4: substitution.graph_param_transform 81.36% : 0.000150s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.76% : 0.000005s : 4: substitution.remove_not_recompute_node 2.56% : 0.000005s : 2: substitution.replace_old_param 6.83% : 0.000013s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.035902 2 95.88% : 0.034424s : 1: type_inference.infer 4.12% : 0.001478s : 1: type_inference.specialize ------[replace.] 0.000070 6 68.10% : 0.000047s : 4: replace.inline 31.90% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 92.84% : 0.000147s : 4: match.inline 7.16% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.19% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.05% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.88% : 0.000003s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.04% : 0.000001s : 12: predicate.compare_switch_simplify 1.08% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.53% : 0.000001s : 4: predicate.elim_not_effective 0.61% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.03% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000002s : 12: predicate.environ_get_eliminate 1.02% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000007s : 26: predicate.inline 0.92% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.43% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000003s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.49% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.20% : 0.000002s : 12: predicate.merge_addn 1.12% : 0.000002s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.60% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.84% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000002s : 12: predicate.same_eliminate 0.64% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.33% : 0.000002s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.18% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.61% : 0.000010s : 58: predicate.switch_simplify 1.13% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.43% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.45% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.60% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.41% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.67% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.82% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001398 18 69.63% : 0.000974s : 11: func_graph_cloner_run.FuncGraphClonerGraph 2.00% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 28.37% : 0.000397s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.046695 72 0.11% : 0.000051s : 1: add_recomputation 0.15% : 0.000069s : 1: auto_monad 0.04% : 0.000018s : 1: auto_monad_reorder 0.61% : 0.000284s : 1: bootstrap 0.06% : 0.000027s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.05% : 0.000022s : 1: cse_after_recomputation 0.02% : 0.000008s : 1: environ_conv 0.05% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.02% : 0.000008s : 1: graph_reusing 12.04% : 0.005624s : 1: jit_opt_a 0.32% : 0.000150s : 1: jit_opt_after_cconv 0.12% : 0.000058s : 1: jit_opt_b 0.91% : 0.000423s : 1: loop_unroll 1.15% : 0.000536s : 1: mutable_eliminate 2.08% : 0.000970s : 26: opt.transform.jit_opt_a 0.12% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.06% : 0.000030s : 4: opt.transform.jit_opt_b 0.03% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000014s : 1: opt.transform.mutable_eliminate 0.06% : 0.000026s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000035s : 4: opt.transform.symbol_engine_opt 1.26% : 0.000588s : 1: opt_after_jit_grad 0.02% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.45% : 0.000212s : 1: py_interpret_to_execute 0.03% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.04% : 0.000017s : 1: remove_dup_value 1.61% : 0.000754s : 1: renormalize.infer 0.95% : 0.000445s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.08% : 0.000035s : 1: rewriter_after_opt_a 0.18% : 0.000085s : 1: rewriter_before_opt_a 0.17% : 0.000078s : 1: symbol_engine_optimizer 77.06% : 0.035985s : 1: type_inference TotalTime = 0.0109629, [30] [bootstrap]: 0.00025099 [type_inference]: 0.00400774 [event_method]: 1.713e-05 [auto_monad]: 6.291e-05 [graph_reusing]: 5.92999e-06 [pre_auto_parallel]: 2.14999e-06 [py_interpret_to_execute]: 3.454e-05 [rewriter_before_opt_a]: 6.944e-05 [expand_dump_flag]: 3.08998e-06 [jit_opt_a]: 0.00459866, [2] [Cycle 1]: 0.0013957, [27] [switch_simplify]: 4.805e-05 [loop_unroll]: 2.958e-05 [a_1]: 0.00053039 [with_stream_mark]: 1.307e-05 [recompute_prepare]: 7.19001e-06 [updatestate_depend_eliminate]: 3.67002e-06 [updatestate_assign_eliminate]: 3.14999e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.35001e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.09e-06 [accelerated_algorithm]: 5.19e-06 [meta_shard_fg_expand]: 2.26e-06 [get_grad_eliminate_]: 5.34e-06 [merge_forward]: 3.9e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.292e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 5.14e-06 [renormalize]: 0.00047726 [add_forward_monad_depend]: 5.38002e-06 [auto_monad_grad]: 1.62001e-06 [auto_monad_eliminator]: 1.385e-05 [cse]: 2.357e-05 [replace_applicator]: 1.087e-05 [Cycle 2]: 0.00030871, [27] [switch_simplify]: 5.60001e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.034e-05 [with_stream_mark]: 8.14997e-06 [recompute_prepare]: 4.90999e-06 [updatestate_depend_eliminate]: 2.58998e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.14e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 4.81002e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 4.63999e-06 [meta_shard_fg_expand]: 1.14e-06 [get_grad_eliminate_]: 4.50001e-06 [merge_forward]: 2.34001e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.186e-05 [j_node_and_user_rematch]: 7.65e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 7.19001e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.09989e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.62999e-06 [cse]: 1.007e-05 [replace_applicator]: 4.87e-06 [py_interpret_to_execute_after_opt_a]: 8.03001e-06 [rewriter_after_opt_a]: 2.954e-05 [convert_after_rewriter]: 6.22001e-06 [order_py_execute_after_rewriter]: 4.83001e-06 [mutable_eliminate]: 0.00045446 [jit_opt_b]: 4.843e-05, [1] [Cycle 1]: 4.21e-05, [2] [frontend_op_eliminate]: 1.572e-05 [inline_after_opt_a]: 1.568e-05 [cconv]: 2.216e-05 [loop_unroll]: 0.00040414 [jit_opt_after_cconv]: 0.00013274, [1] [Cycle 1]: 0.00012669, [11] [c_1]: 2.004e-05 [parameter_eliminate]: 2.43e-06 [updatestate_depend_eliminate]: 5.32999e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 1.732e-05 [call_graph_tuple_transform]: 1.697e-05 [tuple_list_get_item_eliminator]: 5.49e-06 [none_parameter_eliminate]: 1.29998e-06 [renormalize]: 3.60014e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.364e-05 [partial_unused_args_eliminate]: 1.335e-05 [environ_conv]: 5.47999e-06 [add_recomputation]: 4.42e-05 [cse_after_recomputation]: 2.167e-05, [1] [Cycle 1]: 1.613e-05, [1] [cse]: 1.043e-05 [auto_monad_reorder]: 1.551e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.13001e-06 [opt_after_jit_grad]: 0.00043633 [symbol_engine_optimizer]: 7.013e-05, [1] [Cycle 1]: 6.421e-05, [6] [build]: 3.22002e-06 [elim_shapecalc]: 7.83001e-06 [elim_not_effective]: 1.24e-05 [opt_reshape]: 5.66e-06 [fold_const_symbol]: 8.54e-06 [renormalize]: 2.29978e-07 [validate]: 2.907e-05 Sums bootstrap : 0.000251s : 3.33% type_inference : 0.004008s : 53.13% event_method : 0.000017s : 0.23% auto_monad : 0.000063s : 0.83% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.46% rewriter_before_opt_a : 0.000069s : 0.92% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000054s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.46% jit_opt_a.a_1 : 0.000621s : 8.23% jit_opt_a.with_stream_mark : 0.000021s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000477s : 6.33% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.26% jit_opt_a.cse : 0.000034s : 0.45% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000030s : 0.39% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000454s : 6.02% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000022s : 0.29% loop_unroll : 0.000404s : 5.36% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000013s : 0.18% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000044s : 0.59% cse_after_recomputation.cse : 0.000010s : 0.14% auto_monad_reorder : 0.000016s : 0.21% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000436s : 5.78% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.39% Time group info: ------[substitution.] 0.000171 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 2.90% : 0.000005s : 3: substitution.graph_param_transform 82.12% : 0.000141s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.33% : 0.000004s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 6.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003958 2 79.74% : 0.003156s : 1: type_inference.infer 20.26% : 0.000802s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.10% : 0.000042s : 4: replace.inline 33.90% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000149 6 92.81% : 0.000138s : 4: match.inline 7.19% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.36% : 0.000002s : 10: predicate.accumulaten_eliminater 1.01% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.21% : 0.000001s : 10: predicate.addn_zero_filter 1.95% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.23% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.44% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.90% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.21% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.26% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.99% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.09% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.42% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.17% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.54% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.88% : 0.000002s : 18: predicate.replace_applicator 0.54% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.36% : 0.000002s : 10: predicate.reshape_eliminate 1.32% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 6: predicate.special_op_eliminate 0.98% : 0.000001s : 6: predicate.specialize_transform 1.44% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.34% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.57% : 0.000008s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.35% : 0.000002s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.82% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.78% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000545 13 47.10% : 0.000257s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.68% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 48.22% : 0.000263s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012325 72 0.38% : 0.000047s : 1: add_recomputation 0.54% : 0.000066s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.13% : 0.000263s : 1: bootstrap 0.20% : 0.000025s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.17% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.07% : 0.000008s : 1: graph_reusing 37.33% : 0.004601s : 1: jit_opt_a 1.10% : 0.000135s : 1: jit_opt_after_cconv 0.41% : 0.000051s : 1: jit_opt_b 3.34% : 0.000412s : 1: loop_unroll 3.75% : 0.000462s : 1: mutable_eliminate 6.64% : 0.000818s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.21% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.60% : 0.000444s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.12% : 0.000015s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 1.92% : 0.000237s : 1: renormalize.infer 1.90% : 0.000234s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000032s : 1: rewriter_after_opt_a 0.59% : 0.000072s : 1: rewriter_before_opt_a 0.59% : 0.000073s : 1: symbol_engine_optimizer 32.60% : 0.004018s : 1: type_inference TotalTime = 0.011565, [30] [bootstrap]: 0.00024328 [type_inference]: 0.00444901 [event_method]: 1.674e-05 [auto_monad]: 5.623e-05 [graph_reusing]: 5.28002e-06 [pre_auto_parallel]: 2.07999e-06 [py_interpret_to_execute]: 3.843e-05 [rewriter_before_opt_a]: 6.932e-05 [expand_dump_flag]: 2.79001e-06 [jit_opt_a]: 0.00465215, [2] [Cycle 1]: 0.00138207, [27] [switch_simplify]: 4.766e-05 [loop_unroll]: 3.072e-05 [a_1]: 0.00048567 [with_stream_mark]: 1.186e-05 [recompute_prepare]: 6.74999e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 2.76999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.50999e-06 [specialize_transform]: 6.04001e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.39e-06 [meta_shard_fg_expand]: 1.89e-06 [get_grad_eliminate_]: 5.04e-06 [merge_forward]: 2.64999e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.229e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 7.92e-06 [inline_without_move]: 5.14e-06 [renormalize]: 0.00052189 [add_forward_monad_depend]: 4.60001e-06 [auto_monad_grad]: 1.38002e-06 [auto_monad_eliminator]: 1.163e-05 [cse]: 2.167e-05 [replace_applicator]: 1.089e-05 [Cycle 2]: 0.000308, [27] [switch_simplify]: 5.73002e-06 [loop_unroll]: 5.09e-06 [a_1]: 9.064e-05 [with_stream_mark]: 8.07003e-06 [recompute_prepare]: 4.77e-06 [updatestate_depend_eliminate]: 2.83e-06 [updatestate_assign_eliminate]: 2.21998e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 8.60018e-07 [specialize_transform]: 4.88001e-06 [updatestate_useless_node_eliminater]: 4.74998e-06 [accelerated_algorithm]: 4.69998e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 4.64002e-06 [merge_forward]: 2.36e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.233e-05 [j_node_and_user_rematch]: 7.51001e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 6.89001e-06 [inline_without_move]: 4.60999e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 8.70001e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.56e-06 [cse]: 9.76e-06 [replace_applicator]: 5.05001e-06 [py_interpret_to_execute_after_opt_a]: 7.38e-06 [rewriter_after_opt_a]: 2.798e-05 [convert_after_rewriter]: 6.07999e-06 [order_py_execute_after_rewriter]: 4.63999e-06 [mutable_eliminate]: 0.00045788 [jit_opt_b]: 4.727e-05, [1] [Cycle 1]: 4.09e-05, [2] [frontend_op_eliminate]: 1.556e-05 [inline_after_opt_a]: 1.523e-05 [cconv]: 7.808e-05 [loop_unroll]: 0.00043068 [jit_opt_after_cconv]: 0.00013636, [1] [Cycle 1]: 0.00012967, [11] [c_1]: 2.089e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 5.47999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.02999e-06 [cse]: 1.713e-05 [call_graph_tuple_transform]: 1.95e-05 [tuple_list_get_item_eliminator]: 6.08002e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.05001e-06 [remove_dup_value]: 1.341e-05 [partial_unused_args_eliminate]: 2.14e-06 [environ_conv]: 4.87e-06 [add_recomputation]: 3.802e-05 [cse_after_recomputation]: 3.339e-05, [1] [Cycle 1]: 1.544e-05, [1] [cse]: 9.80002e-06 [auto_monad_reorder]: 1.404e-05 [get_jit_bprop_graph]: 1.52999e-06 [rewriter_after_jit_bprop_graph]: 4.35e-06 [opt_after_jit_grad]: 0.00046666 [symbol_engine_optimizer]: 7.527e-05, [1] [Cycle 1]: 6.902e-05, [6] [build]: 3.46999e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.361e-05 [opt_reshape]: 6.23002e-06 [fold_const_symbol]: 9.42001e-06 [renormalize]: 3.89991e-07 [validate]: 3.114e-05 Sums bootstrap : 0.000243s : 3.02% type_inference : 0.004449s : 55.16% event_method : 0.000017s : 0.21% auto_monad : 0.000056s : 0.70% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000038s : 0.48% rewriter_before_opt_a : 0.000069s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000053s : 0.66% jit_opt_a.loop_unroll : 0.000036s : 0.44% jit_opt_a.a_1 : 0.000576s : 7.15% jit_opt_a.with_stream_mark : 0.000020s : 0.25% jit_opt_a.recompute_prepare : 0.000012s : 0.14% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000005s : 0.06% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000522s : 6.47% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.21% jit_opt_a.cse : 0.000031s : 0.39% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000007s : 0.09% rewriter_after_opt_a : 0.000028s : 0.35% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000458s : 5.68% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000078s : 0.97% loop_unroll : 0.000431s : 5.34% jit_opt_after_cconv.c_1 : 0.000021s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.08% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000038s : 0.47% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000014s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000467s : 5.79% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.12% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.39% Time group info: ------[substitution.] 0.000165 23 1.19% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000001s : 2: substitution.fold_const_symbol 3.02% : 0.000005s : 3: substitution.graph_param_transform 82.39% : 0.000136s : 4: substitution.inline 1.73% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000004s : 4: substitution.remove_not_recompute_node 1.85% : 0.000003s : 2: substitution.replace_old_param 6.35% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004401 2 79.86% : 0.003514s : 1: type_inference.infer 20.14% : 0.000886s : 1: type_inference.specialize ------[replace.] 0.000062 6 65.92% : 0.000041s : 4: replace.inline 34.08% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000142 6 93.44% : 0.000133s : 4: match.inline 6.56% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.23% : 0.000001s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.89% : 0.000002s : 10: predicate.arithmetic_simplify 1.37% : 0.000002s : 10: predicate.cast_eliminate 0.50% : 0.000001s : 3: predicate.check_bprop_eliminate 1.19% : 0.000001s : 10: predicate.compare_switch_simplify 1.16% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.14% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.42% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.14% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.33% : 0.000000s : 3: predicate.graph_param_transform 5.63% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.46% : 0.000001s : 6: predicate.j_node_and_user_rematch 1.28% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.38% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.08% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.41% : 0.000003s : 15: predicate.partial_eliminate 1.28% : 0.000001s : 10: predicate.print_const_string_wrapper 1.62% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.68% : 0.000001s : 6: predicate.replace_old_param 0.27% : 0.000000s : 3: predicate.reset_defer_inline 1.18% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.69% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 6: predicate.special_op_eliminate 1.06% : 0.000001s : 6: predicate.specialize_transform 1.45% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.58% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.36% : 0.000008s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.51% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.56% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.93% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.74% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000620 13 52.32% : 0.000324s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.06% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.62% : 0.000270s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012934 72 0.32% : 0.000041s : 1: add_recomputation 0.46% : 0.000059s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 1.98% : 0.000256s : 1: bootstrap 0.63% : 0.000081s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.28% : 0.000036s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 35.99% : 0.004655s : 1: jit_opt_a 1.07% : 0.000139s : 1: jit_opt_after_cconv 0.38% : 0.000050s : 1: jit_opt_b 3.39% : 0.000438s : 1: loop_unroll 3.60% : 0.000466s : 1: mutable_eliminate 5.99% : 0.000775s : 26: opt.transform.jit_opt_a 0.37% : 0.000048s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.18% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.26% : 0.000034s : 4: opt.transform.symbol_engine_opt 3.67% : 0.000475s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.32% : 0.000041s : 1: py_interpret_to_execute 0.07% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 1.95% : 0.000252s : 1: renormalize.infer 2.04% : 0.000264s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000031s : 1: rewriter_after_opt_a 0.56% : 0.000072s : 1: rewriter_before_opt_a 0.60% : 0.000078s : 1: symbol_engine_optimizer 34.48% : 0.004460s : 1: type_inference TotalTime = 0.106818, [30] [bootstrap]: 0.00024546 [type_inference]: 0.0977708 [event_method]: 1.83e-05 [auto_monad]: 6.712e-05 [graph_reusing]: 5.49e-06 [pre_auto_parallel]: 2.26e-06 [py_interpret_to_execute]: 0.00037196 [rewriter_before_opt_a]: 8.013e-05 [expand_dump_flag]: 3.87998e-06 [jit_opt_a]: 0.00621764, [2] [Cycle 1]: 0.00286673, [27] [switch_simplify]: 5.076e-05 [loop_unroll]: 3.053e-05 [a_1]: 0.00052628 [with_stream_mark]: 1.527e-05 [recompute_prepare]: 7.91001e-06 [updatestate_depend_eliminate]: 3.93999e-06 [updatestate_assign_eliminate]: 3.45e-06 [updatestate_loads_eliminate]: 2.84999e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.65002e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.17001e-06 [meta_shard_fg_expand]: 2.27999e-06 [get_grad_eliminate_]: 5.96e-06 [merge_forward]: 3.61999e-06 [cell_reuse_recompute_pass]: 9.10019e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 9.32999e-06 [meta_fg_expand]: 2.26e-06 [replace_old_param]: 8.48999e-06 [inline_without_move]: 5.89999e-06 [renormalize]: 0.001907 [add_forward_monad_depend]: 4.67998e-06 [auto_monad_grad]: 2.32999e-06 [auto_monad_eliminator]: 3.27e-05 [cse]: 2.974e-05 [replace_applicator]: 1.22e-05 [Cycle 2]: 0.00034539, [27] [switch_simplify]: 6.70002e-06 [loop_unroll]: 5.63997e-06 [a_1]: 0.00011783 [with_stream_mark]: 8.62998e-06 [recompute_prepare]: 5.76e-06 [updatestate_depend_eliminate]: 2.61e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 1.92999e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.16002e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.47001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.32e-05 [j_node_and_user_rematch]: 8.27e-06 [meta_fg_expand]: 1.62999e-06 [replace_old_param]: 7.70998e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.02998e-06 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.61998e-06 [cse]: 1.078e-05 [replace_applicator]: 5.58002e-06 [py_interpret_to_execute_after_opt_a]: 9.05999e-06 [rewriter_after_opt_a]: 3.134e-05 [convert_after_rewriter]: 7.39002e-06 [order_py_execute_after_rewriter]: 5.14998e-06 [mutable_eliminate]: 0.00047197 [jit_opt_b]: 5.295e-05, [1] [Cycle 1]: 4.66e-05, [2] [frontend_op_eliminate]: 1.893e-05 [inline_after_opt_a]: 1.745e-05 [cconv]: 2.406e-05 [loop_unroll]: 0.00040503 [jit_opt_after_cconv]: 0.00014359, [1] [Cycle 1]: 0.00013753, [11] [c_1]: 2.478e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.963e-05 [call_graph_tuple_transform]: 1.888e-05 [tuple_list_get_item_eliminator]: 6.04001e-06 [none_parameter_eliminate]: 1.65001e-06 [renormalize]: 2.60014e-07 [switch_simplify]: 5.87001e-06 [remove_dup_value]: 1.626e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 7.45e-06 [add_recomputation]: 4.427e-05 [cse_after_recomputation]: 2.192e-05, [1] [Cycle 1]: 1.57e-05, [1] [cse]: 1.032e-05 [auto_monad_reorder]: 1.435e-05 [get_jit_bprop_graph]: 1.50001e-06 [rewriter_after_jit_bprop_graph]: 4.27e-06 [opt_after_jit_grad]: 0.00044328 [symbol_engine_optimizer]: 0.00012582, [1] [Cycle 1]: 0.00011946, [6] [build]: 3.03998e-06 [elim_shapecalc]: 8.88002e-06 [elim_not_effective]: 6.316e-05 [opt_reshape]: 6.76e-06 [fold_const_symbol]: 1.039e-05 [renormalize]: 3.50003e-07 [validate]: 3.807e-05 Sums bootstrap : 0.000245s : 0.24% type_inference : 0.097771s : 94.68% event_method : 0.000018s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000372s : 0.36% rewriter_before_opt_a : 0.000080s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000644s : 0.62% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001907s : 1.85% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000038s : 0.04% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000472s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000405s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000044s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000443s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000063s : 0.06% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000179 24 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 3.05% : 0.000005s : 4: substitution.graph_param_transform 82.76% : 0.000148s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000005s : 4: substitution.remove_not_recompute_node 1.79% : 0.000003s : 2: substitution.replace_old_param 6.30% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097708 2 97.71% : 0.095470s : 1: type_inference.infer 2.29% : 0.002238s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.57% : 0.000042s : 4: replace.inline 32.43% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 93.45% : 0.000146s : 4: match.inline 6.55% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.23% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.37% : 0.000002s : 12: predicate.addn_zero_filter 1.95% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.15% : 0.000001s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.54% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.24% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000001s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.34% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 8: predicate.less_batch_normalization 1.33% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.76% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.00% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.09% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.61% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.23% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.65% : 0.000002s : 12: predicate.reduce_eliminate 1.43% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 1.92% : 0.000002s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.22% : 0.000002s : 8: predicate.special_op_eliminate 0.99% : 0.000001s : 8: predicate.specialize_transform 1.49% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.33% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.63% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.37% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.94% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.56% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.70% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001911 22 67.28% : 0.001286s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.34% : 0.000599s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109704 72 0.04% : 0.000047s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000257s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.67% : 0.006220s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.38% : 0.000413s : 1: loop_unroll 0.44% : 0.000480s : 1: mutable_eliminate 0.79% : 0.000862s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000086s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000377s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.20% : 0.001321s : 1: renormalize.infer 0.53% : 0.000578s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000085s : 1: rewriter_before_opt_a 0.12% : 0.000128s : 1: symbol_engine_optimizer 89.13% : 0.097783s : 1: type_inference TotalTime = 0.107034, [30] [bootstrap]: 0.00024748 [type_inference]: 0.097781 [event_method]: 1.829e-05 [auto_monad]: 6.338e-05 [graph_reusing]: 5.61003e-06 [pre_auto_parallel]: 2.73998e-06 [py_interpret_to_execute]: 0.00040167 [rewriter_before_opt_a]: 8.035e-05 [expand_dump_flag]: 3.61001e-06 [jit_opt_a]: 0.0063901, [2] [Cycle 1]: 0.002917, [27] [switch_simplify]: 5.221e-05 [loop_unroll]: 2.945e-05 [a_1]: 0.00052639 [with_stream_mark]: 1.602e-05 [recompute_prepare]: 8.60001e-06 [updatestate_depend_eliminate]: 3.68999e-06 [updatestate_assign_eliminate]: 3.12002e-06 [updatestate_loads_eliminate]: 3.14999e-06 [parameter_eliminate]: 1.82001e-06 [specialize_transform]: 6.51e-06 [updatestate_useless_node_eliminater]: 5.72001e-06 [accelerated_algorithm]: 6.46e-06 [meta_shard_fg_expand]: 1.96998e-06 [get_grad_eliminate_]: 5.92999e-06 [merge_forward]: 3.75e-06 [cell_reuse_recompute_pass]: 1.09e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.518e-05 [j_node_and_user_rematch]: 9.49999e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 9.07999e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00196814 [add_forward_monad_depend]: 5.24e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.549e-05 [cse]: 3.115e-05 [replace_applicator]: 1.224e-05 [Cycle 2]: 0.00034432, [27] [switch_simplify]: 6.48e-06 [loop_unroll]: 5.79999e-06 [a_1]: 0.00011608 [with_stream_mark]: 9.15001e-06 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.78e-06 [updatestate_assign_eliminate]: 2.04e-06 [updatestate_loads_eliminate]: 1.91998e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.34e-06 [accelerated_algorithm]: 5.35001e-06 [meta_shard_fg_expand]: 1.08001e-06 [get_grad_eliminate_]: 5.35001e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.256e-05 [j_node_and_user_rematch]: 8.3e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 7.89997e-06 [inline_without_move]: 5.24e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 6.16e-06 [cse]: 1.083e-05 [replace_applicator]: 5.86e-06 [py_interpret_to_execute_after_opt_a]: 9.18002e-06 [rewriter_after_opt_a]: 3.283e-05 [convert_after_rewriter]: 6.61999e-06 [order_py_execute_after_rewriter]: 5.21998e-06 [mutable_eliminate]: 0.00051278 [jit_opt_b]: 5.224e-05, [1] [Cycle 1]: 4.571e-05, [2] [frontend_op_eliminate]: 1.772e-05 [inline_after_opt_a]: 1.69e-05 [cconv]: 2.463e-05 [loop_unroll]: 0.00040597 [jit_opt_after_cconv]: 0.000142, [1] [Cycle 1]: 0.00013515, [11] [c_1]: 2.445e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.56998e-06 [updatestate_assign_eliminate]: 2.40002e-06 [updatestate_loads_eliminate]: 2.18998e-06 [cse]: 1.82e-05 [call_graph_tuple_transform]: 1.894e-05 [tuple_list_get_item_eliminator]: 5.81e-06 [none_parameter_eliminate]: 1.61002e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.525e-05 [partial_unused_args_eliminate]: 2.12999e-06 [environ_conv]: 6.95998e-06 [add_recomputation]: 4.543e-05 [cse_after_recomputation]: 2.004e-05, [1] [Cycle 1]: 1.534e-05, [1] [cse]: 1.004e-05 [auto_monad_reorder]: 1.541e-05 [get_jit_bprop_graph]: 1.57999e-06 [rewriter_after_jit_bprop_graph]: 4.4e-06 [opt_after_jit_grad]: 0.00044082 [symbol_engine_optimizer]: 9.941e-05, [1] [Cycle 1]: 9.327e-05, [6] [build]: 3.51001e-06 [elim_shapecalc]: 7.88001e-06 [elim_not_effective]: 1.23e-05 [opt_reshape]: 3.254e-05 [fold_const_symbol]: 9.96e-06 [renormalize]: 2.49973e-07 [validate]: 3.807e-05 Sums bootstrap : 0.000247s : 0.24% type_inference : 0.097781s : 94.60% event_method : 0.000018s : 0.02% auto_monad : 0.000063s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000402s : 0.39% rewriter_before_opt_a : 0.000080s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.06% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000642s : 0.62% jit_opt_a.with_stream_mark : 0.000025s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001968s : 1.90% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000513s : 0.50% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000406s : 0.39% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000441s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000033s : 0.03% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000179 24 1.01% : 0.000002s : 2: substitution.elim_not_effective 0.90% : 0.000002s : 2: substitution.fold_const_symbol 3.06% : 0.000005s : 4: substitution.graph_param_transform 82.34% : 0.000148s : 4: substitution.inline 1.46% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.87% : 0.000003s : 2: substitution.replace_old_param 6.63% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097712 2 97.70% : 0.095463s : 1: type_inference.infer 2.30% : 0.002248s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.67% : 0.000045s : 4: replace.inline 32.33% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 93.11% : 0.000145s : 4: match.inline 6.89% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.02% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.42% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.23% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.38% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.50% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.31% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.04% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.19% : 0.000001s : 12: predicate.minmaximum_grad 1.60% : 0.000002s : 4: predicate.mutable_eliminate 0.63% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000001s : 12: predicate.print_const_string_wrapper 1.58% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.01% : 0.000003s : 22: predicate.replace_applicator 0.97% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.28% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.67% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.52% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.50% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.78% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.95% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001861 22 64.81% : 0.001206s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.54% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.65% : 0.000626s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109960 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000066s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000259s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.81% : 0.006393s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.38% : 0.000413s : 1: loop_unroll 0.47% : 0.000520s : 1: mutable_eliminate 0.78% : 0.000861s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000059s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000448s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000005s : 1: pre_auto_parallel 0.37% : 0.000407s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.21% : 0.001329s : 1: renormalize.infer 0.57% : 0.000632s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000085s : 1: rewriter_before_opt_a 0.09% : 0.000102s : 1: symbol_engine_optimizer 88.94% : 0.097797s : 1: type_inference TotalTime = 0.0539786, [30] [bootstrap]: 0.00025748 [type_inference]: 0.0455549 [event_method]: 1.776e-05 [auto_monad]: 6.414e-05 [graph_reusing]: 6.09001e-06 [pre_auto_parallel]: 2.11998e-06 [py_interpret_to_execute]: 0.00021544 [rewriter_before_opt_a]: 7.839e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00570741, [2] [Cycle 1]: 0.00231301, [27] [switch_simplify]: 4.757e-05 [loop_unroll]: 3.051e-05 [a_1]: 0.00052416 [with_stream_mark]: 1.388e-05 [recompute_prepare]: 7.76001e-06 [updatestate_depend_eliminate]: 3.46999e-06 [updatestate_assign_eliminate]: 2.86e-06 [updatestate_loads_eliminate]: 3.09999e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.92001e-06 [merge_forward]: 3.68e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.374e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.35002e-06 [replace_old_param]: 8.70999e-06 [inline_without_move]: 6.04999e-06 [renormalize]: 0.0013906 [add_forward_monad_depend]: 5.17e-06 [auto_monad_grad]: 1.97001e-06 [auto_monad_eliminator]: 1.375e-05 [cse]: 2.314e-05 [replace_applicator]: 1.203e-05 [Cycle 2]: 0.00034154, [27] [switch_simplify]: 6.26e-06 [loop_unroll]: 5.48002e-06 [a_1]: 0.00011584 [with_stream_mark]: 8.05e-06 [recompute_prepare]: 5.72001e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.11e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.47001e-06 [updatestate_useless_node_eliminater]: 5.64998e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 1.02e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 2.41998e-06 [cell_reuse_recompute_pass]: 1.29e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.291e-05 [j_node_and_user_rematch]: 8.33001e-06 [meta_fg_expand]: 1.75001e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.40025e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.85002e-06 [cse]: 1.007e-05 [replace_applicator]: 5.63002e-06 [py_interpret_to_execute_after_opt_a]: 8.91002e-06 [rewriter_after_opt_a]: 2.963e-05 [convert_after_rewriter]: 6.69001e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00046582 [jit_opt_b]: 5.12e-05, [1] [Cycle 1]: 4.448e-05, [2] [frontend_op_eliminate]: 1.729e-05 [inline_after_opt_a]: 1.639e-05 [cconv]: 2.331e-05 [loop_unroll]: 0.00048599 [jit_opt_after_cconv]: 0.0001434, [1] [Cycle 1]: 0.00013681, [11] [c_1]: 2.526e-05 [parameter_eliminate]: 2.19001e-06 [updatestate_depend_eliminate]: 5.83002e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.779e-05 [call_graph_tuple_transform]: 1.903e-05 [tuple_list_get_item_eliminator]: 6.38998e-06 [none_parameter_eliminate]: 1.40001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.61e-06 [remove_dup_value]: 1.455e-05 [partial_unused_args_eliminate]: 2.09e-06 [environ_conv]: 7.82e-06 [add_recomputation]: 4.392e-05 [cse_after_recomputation]: 2.051e-05, [1] [Cycle 1]: 1.562e-05, [1] [cse]: 1.018e-05 [auto_monad_reorder]: 1.495e-05 [get_jit_bprop_graph]: 1.43002e-06 [rewriter_after_jit_bprop_graph]: 4.07e-06 [opt_after_jit_grad]: 0.00045662 [symbol_engine_optimizer]: 8.813e-05, [1] [Cycle 1]: 8.182e-05, [6] [build]: 2.87002e-06 [elim_shapecalc]: 8.05e-06 [elim_not_effective]: 2.764e-05 [opt_reshape]: 6.59999e-06 [fold_const_symbol]: 9.54e-06 [renormalize]: 3.50003e-07 [validate]: 3.796e-05 Sums bootstrap : 0.000257s : 0.51% type_inference : 0.045555s : 90.41% event_method : 0.000018s : 0.04% auto_monad : 0.000064s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000215s : 0.43% rewriter_before_opt_a : 0.000078s : 0.16% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.11% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000640s : 1.27% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.04% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001391s : 2.76% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.01% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000033s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.04% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000466s : 0.92% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000023s : 0.05% loop_unroll : 0.000486s : 0.96% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.04% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.02% add_recomputation : 0.000044s : 0.09% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000457s : 0.91% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000028s : 0.05% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.08% Time group info: ------[substitution.] 0.000179 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000005s : 4: substitution.graph_param_transform 82.22% : 0.000147s : 4: substitution.inline 1.69% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.66% : 0.000005s : 4: substitution.remove_not_recompute_node 2.00% : 0.000004s : 2: substitution.replace_old_param 6.72% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.045488 2 96.52% : 0.043906s : 1: type_inference.infer 3.48% : 0.001582s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.42% : 0.000043s : 4: replace.inline 32.58% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000156 6 93.05% : 0.000145s : 4: match.inline 6.95% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.29% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.99% : 0.000002s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.20% : 0.000001s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.10% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.19% : 0.000006s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.10% : 0.000001s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.48% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.03% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.65% : 0.000002s : 4: predicate.mutable_eliminate 0.64% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.63% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.78% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.68% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.23% : 0.000009s : 58: predicate.switch_simplify 1.20% : 0.000001s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.50% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.22% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.78% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001739 22 67.74% : 0.001178s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.64% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 30.62% : 0.000533s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.056309 72 0.08% : 0.000047s : 1: add_recomputation 0.12% : 0.000067s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.48% : 0.000271s : 1: bootstrap 0.05% : 0.000026s : 1: cconv 0.02% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 10.14% : 0.005710s : 1: jit_opt_a 0.26% : 0.000146s : 1: jit_opt_after_cconv 0.10% : 0.000054s : 1: jit_opt_b 0.88% : 0.000494s : 1: loop_unroll 0.84% : 0.000474s : 1: mutable_eliminate 1.52% : 0.000853s : 26: opt.transform.jit_opt_a 0.09% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000049s : 4: opt.transform.symbol_engine_opt 0.83% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000221s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.57% : 0.000884s : 1: renormalize.infer 0.89% : 0.000499s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000032s : 1: rewriter_after_opt_a 0.15% : 0.000083s : 1: rewriter_before_opt_a 0.16% : 0.000090s : 1: symbol_engine_optimizer 80.92% : 0.045568s : 1: type_inference TotalTime = 0.0110687, [30] [bootstrap]: 0.00024092 [type_inference]: 0.00402993 [event_method]: 1.7e-05 [auto_monad]: 6.184e-05 [graph_reusing]: 5.35999e-06 [pre_auto_parallel]: 2.22999e-06 [py_interpret_to_execute]: 3.489e-05 [rewriter_before_opt_a]: 7.11e-05 [expand_dump_flag]: 2.89001e-06 [jit_opt_a]: 0.00462376, [2] [Cycle 1]: 0.00135584, [27] [switch_simplify]: 4.926e-05 [loop_unroll]: 3.103e-05 [a_1]: 0.00048896 [with_stream_mark]: 1.393e-05 [recompute_prepare]: 7.4e-06 [updatestate_depend_eliminate]: 3.89002e-06 [updatestate_assign_eliminate]: 3.51001e-06 [updatestate_loads_eliminate]: 3.21001e-06 [parameter_eliminate]: 1.48002e-06 [specialize_transform]: 6.76e-06 [updatestate_useless_node_eliminater]: 5.66e-06 [accelerated_algorithm]: 5.64e-06 [meta_shard_fg_expand]: 2.03002e-06 [get_grad_eliminate_]: 5.59e-06 [merge_forward]: 3.65e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.331e-05 [j_node_and_user_rematch]: 9.02e-06 [meta_fg_expand]: 2.41998e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.49998e-06 [renormalize]: 0.00047332 [add_forward_monad_depend]: 4.60999e-06 [auto_monad_grad]: 1.76e-06 [auto_monad_eliminator]: 1.285e-05 [cse]: 2.451e-05 [replace_applicator]: 1.095e-05 [Cycle 2]: 0.00030769, [27] [switch_simplify]: 5.57001e-06 [loop_unroll]: 5.02999e-06 [a_1]: 9.038e-05 [with_stream_mark]: 7.73999e-06 [recompute_prepare]: 4.69998e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.16003e-06 [updatestate_loads_eliminate]: 2.02999e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 4.87998e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.37999e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.192e-05 [j_node_and_user_rematch]: 7.9e-06 [meta_fg_expand]: 1.49998e-06 [replace_old_param]: 6.96001e-06 [inline_without_move]: 4.65999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.69e-06 [cse]: 1.026e-05 [replace_applicator]: 4.97e-06 [py_interpret_to_execute_after_opt_a]: 8.20999e-06 [rewriter_after_opt_a]: 3.096e-05 [convert_after_rewriter]: 6.96001e-06 [order_py_execute_after_rewriter]: 4.79002e-06 [mutable_eliminate]: 0.00045283 [jit_opt_b]: 5.04e-05, [1] [Cycle 1]: 4.351e-05, [2] [frontend_op_eliminate]: 1.659e-05 [inline_after_opt_a]: 1.587e-05 [cconv]: 2.271e-05 [loop_unroll]: 0.00040348 [jit_opt_after_cconv]: 0.00015668, [1] [Cycle 1]: 0.00015049, [11] [c_1]: 2.078e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.74e-05 [call_graph_tuple_transform]: 1.846e-05 [tuple_list_get_item_eliminator]: 5.25999e-06 [none_parameter_eliminate]: 2.01e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.22999e-06 [remove_dup_value]: 1.346e-05 [partial_unused_args_eliminate]: 1.87001e-06 [environ_conv]: 5.15001e-06 [add_recomputation]: 8.868e-05 [cse_after_recomputation]: 2.129e-05, [1] [Cycle 1]: 1.587e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.462e-05 [get_jit_bprop_graph]: 1.44e-06 [rewriter_after_jit_bprop_graph]: 3.9e-06 [opt_after_jit_grad]: 0.00044657 [symbol_engine_optimizer]: 6.865e-05, [1] [Cycle 1]: 6.282e-05, [6] [build]: 3.21001e-06 [elim_shapecalc]: 7.52002e-06 [elim_not_effective]: 1.168e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.42e-06 [renormalize]: 3.10014e-07 [validate]: 2.951e-05 Sums bootstrap : 0.000241s : 3.19% type_inference : 0.004030s : 53.29% event_method : 0.000017s : 0.22% auto_monad : 0.000062s : 0.82% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.46% rewriter_before_opt_a : 0.000071s : 0.94% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.73% jit_opt_a.loop_unroll : 0.000036s : 0.48% jit_opt_a.a_1 : 0.000579s : 7.66% jit_opt_a.with_stream_mark : 0.000022s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000012s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.14% jit_opt_a.accelerated_algorithm : 0.000010s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000473s : 6.26% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000035s : 0.46% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000031s : 0.41% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000453s : 5.99% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.22% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000023s : 0.30% loop_unroll : 0.000403s : 5.34% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000013s : 0.18% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000089s : 1.17% cse_after_recomputation.cse : 0.000010s : 0.14% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000447s : 5.91% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.39% Time group info: ------[substitution.] 0.000169 23 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 3.35% : 0.000006s : 3: substitution.graph_param_transform 81.77% : 0.000138s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000003s : 2: substitution.replace_old_param 6.69% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003978 2 80.74% : 0.003212s : 1: type_inference.infer 19.26% : 0.000766s : 1: type_inference.specialize ------[replace.] 0.000061 6 67.03% : 0.000041s : 4: replace.inline 32.97% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000146 6 93.02% : 0.000136s : 4: match.inline 6.98% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.24% : 0.000001s : 10: predicate.accumulaten_eliminater 1.08% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 10: predicate.addn_check_dump 1.25% : 0.000001s : 10: predicate.addn_zero_filter 1.98% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.44% : 0.000001s : 3: predicate.check_bprop_eliminate 1.11% : 0.000001s : 10: predicate.compare_switch_simplify 1.25% : 0.000001s : 10: predicate.depend_value_elim 1.19% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.94% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.28% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.34% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.29% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.22% : 0.000000s : 3: predicate.fold_const_symbol 0.92% : 0.000001s : 6: predicate.get_grad_eliminate 0.30% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.02% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.94% : 0.000002s : 15: predicate.load_eliminater 1.44% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.22% : 0.000001s : 10: predicate.merge_addn 1.11% : 0.000001s : 10: predicate.minmaximum_grad 1.80% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.40% : 0.000003s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.69% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.76% : 0.000002s : 18: predicate.replace_applicator 0.79% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.20% : 0.000001s : 10: predicate.reshape_eliminate 1.26% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 3: predicate.row_tensor_eliminate 1.20% : 0.000001s : 10: predicate.same_eliminate 0.53% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.15% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.52% : 0.000003s : 16: predicate.switch_defer_inline 2.19% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.63% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.03% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.48% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.85% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.89% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000510 13 51.15% : 0.000261s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.04% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.81% : 0.000223s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012395 72 0.74% : 0.000092s : 1: add_recomputation 0.52% : 0.000065s : 1: auto_monad 0.14% : 0.000017s : 1: auto_monad_reorder 2.05% : 0.000254s : 1: bootstrap 0.20% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.32% : 0.004626s : 1: jit_opt_a 1.29% : 0.000160s : 1: jit_opt_after_cconv 0.43% : 0.000053s : 1: jit_opt_b 3.32% : 0.000411s : 1: loop_unroll 3.72% : 0.000461s : 1: mutable_eliminate 6.32% : 0.000783s : 26: opt.transform.jit_opt_a 0.38% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.21% : 0.000026s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.17% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.67% : 0.000454s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000038s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 1.92% : 0.000238s : 1: renormalize.infer 1.84% : 0.000228s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000034s : 1: rewriter_after_opt_a 0.60% : 0.000074s : 1: rewriter_before_opt_a 0.57% : 0.000071s : 1: symbol_engine_optimizer 32.60% : 0.004041s : 1: type_inference TotalTime = 0.0114009, [30] [bootstrap]: 0.00024315 [type_inference]: 0.0044811 [event_method]: 1.706e-05 [auto_monad]: 5.528e-05 [graph_reusing]: 4.92e-06 [pre_auto_parallel]: 1.76e-06 [py_interpret_to_execute]: 3.51e-05 [rewriter_before_opt_a]: 7.002e-05 [expand_dump_flag]: 2.70997e-06 [jit_opt_a]: 0.00459042, [2] [Cycle 1]: 0.00141417, [27] [switch_simplify]: 4.704e-05 [loop_unroll]: 3.032e-05 [a_1]: 0.0004786 [with_stream_mark]: 1.22e-05 [recompute_prepare]: 7.39002e-06 [updatestate_depend_eliminate]: 3.43e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 6.38e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 5.66e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.49998e-06 [merge_forward]: 3.25998e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.225e-05 [j_node_and_user_rematch]: 8.84e-06 [meta_fg_expand]: 2.29001e-06 [replace_old_param]: 8.12e-06 [inline_without_move]: 5.17e-06 [renormalize]: 0.00051155 [add_forward_monad_depend]: 4.68999e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 1.238e-05 [cse]: 2.134e-05 [replace_applicator]: 1.081e-05 [Cycle 2]: 0.0003092, [27] [switch_simplify]: 5.82999e-06 [loop_unroll]: 4.97e-06 [a_1]: 8.997e-05 [with_stream_mark]: 8.03999e-06 [recompute_prepare]: 5.24e-06 [updatestate_depend_eliminate]: 2.56998e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 8.59989e-07 [specialize_transform]: 4.99998e-06 [updatestate_useless_node_eliminater]: 4.85001e-06 [accelerated_algorithm]: 4.70001e-06 [meta_shard_fg_expand]: 1.00999e-06 [get_grad_eliminate_]: 4.47998e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.261e-05 [j_node_and_user_rematch]: 7.85e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.38e-06 [inline_without_move]: 4.94e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.38002e-06 [cse]: 1.039e-05 [replace_applicator]: 4.87998e-06 [py_interpret_to_execute_after_opt_a]: 7.86001e-06 [rewriter_after_opt_a]: 2.817e-05 [convert_after_rewriter]: 6.18002e-06 [order_py_execute_after_rewriter]: 4.27998e-06 [mutable_eliminate]: 0.0004566 [jit_opt_b]: 4.804e-05, [1] [Cycle 1]: 4.135e-05, [2] [frontend_op_eliminate]: 1.594e-05 [inline_after_opt_a]: 1.464e-05 [cconv]: 2.012e-05 [loop_unroll]: 0.00040366 [jit_opt_after_cconv]: 0.00014544, [1] [Cycle 1]: 0.00013901, [11] [c_1]: 1.948e-05 [parameter_eliminate]: 2.37001e-06 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 2.19001e-06 [updatestate_loads_eliminate]: 1.99999e-06 [cse]: 1.738e-05 [call_graph_tuple_transform]: 1.785e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 4.90021e-07 [switch_simplify]: 1.726e-05 [remove_dup_value]: 1.178e-05 [partial_unused_args_eliminate]: 1.97001e-06 [environ_conv]: 5.47001e-06 [add_recomputation]: 3.929e-05 [cse_after_recomputation]: 2.144e-05, [1] [Cycle 1]: 1.615e-05, [1] [cse]: 1.07e-05 [auto_monad_reorder]: 1.385e-05 [get_jit_bprop_graph]: 1.47999e-06 [rewriter_after_jit_bprop_graph]: 3.8e-06 [opt_after_jit_grad]: 0.00043978 [symbol_engine_optimizer]: 6.89e-05, [1] [Cycle 1]: 6.32e-05, [6] [build]: 2.82002e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.267e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.21002e-06 [renormalize]: 3.59985e-07 [validate]: 2.793e-05 Sums bootstrap : 0.000243s : 3.05% type_inference : 0.004481s : 56.23% event_method : 0.000017s : 0.21% auto_monad : 0.000055s : 0.69% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000035s : 0.44% rewriter_before_opt_a : 0.000070s : 0.88% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000053s : 0.66% jit_opt_a.loop_unroll : 0.000035s : 0.44% jit_opt_a.a_1 : 0.000569s : 7.13% jit_opt_a.with_stream_mark : 0.000020s : 0.25% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000512s : 6.42% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.22% jit_opt_a.cse : 0.000032s : 0.40% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000028s : 0.35% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000457s : 5.73% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000020s : 0.25% loop_unroll : 0.000404s : 5.06% jit_opt_after_cconv.c_1 : 0.000019s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000017s : 0.22% remove_dup_value : 0.000012s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000039s : 0.49% cse_after_recomputation.cse : 0.000011s : 0.13% auto_monad_reorder : 0.000014s : 0.17% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000440s : 5.52% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000028s : 0.35% Time group info: ------[substitution.] 0.000159 23 1.44% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 3.29% : 0.000005s : 3: substitution.graph_param_transform 81.75% : 0.000130s : 4: substitution.inline 1.71% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.66% : 0.000004s : 4: substitution.remove_not_recompute_node 2.47% : 0.000004s : 2: substitution.replace_old_param 5.89% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004432 2 78.70% : 0.003488s : 1: type_inference.infer 21.30% : 0.000944s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.01% : 0.000042s : 4: replace.inline 32.99% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000136 6 93.90% : 0.000128s : 4: match.inline 6.10% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.19% : 0.000001s : 10: predicate.accumulaten_eliminater 1.00% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.30% : 0.000001s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.50% : 0.000002s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.24% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.03% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.51% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.58% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.34% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.19% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.57% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.68% : 0.000002s : 10: predicate.reduce_eliminate 1.38% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.84% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.41% : 0.000002s : 10: predicate.reshape_eliminate 1.33% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.94% : 0.000001s : 3: predicate.row_tensor_eliminate 1.26% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.41% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 16: predicate.switch_defer_inline 2.25% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.52% : 0.000008s : 53: predicate.switch_simplify 1.27% : 0.000001s : 10: predicate.tile_eliminate 1.36% : 0.000002s : 10: predicate.transpose_eliminate 1.32% : 0.000001s : 10: predicate.tuple_list_convert_item_index_to_positive 1.38% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 3.76% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.82% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.72% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000577 13 49.05% : 0.000283s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.38% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.58% : 0.000269s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012761 72 0.33% : 0.000042s : 1: add_recomputation 0.46% : 0.000058s : 1: auto_monad 0.13% : 0.000016s : 1: auto_monad_reorder 1.99% : 0.000255s : 1: bootstrap 0.18% : 0.000023s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 35.99% : 0.004593s : 1: jit_opt_a 1.16% : 0.000148s : 1: jit_opt_after_cconv 0.40% : 0.000050s : 1: jit_opt_b 3.22% : 0.000411s : 1: loop_unroll 3.64% : 0.000464s : 1: mutable_eliminate 6.02% : 0.000768s : 26: opt.transform.jit_opt_a 0.44% : 0.000057s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.51% : 0.000448s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000038s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 1.94% : 0.000248s : 1: renormalize.infer 2.01% : 0.000257s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000031s : 1: rewriter_after_opt_a 0.57% : 0.000073s : 1: rewriter_before_opt_a 0.56% : 0.000071s : 1: symbol_engine_optimizer 35.20% : 0.004491s : 1: type_inference TotalTime = 0.107495, [30] [bootstrap]: 0.00025699 [type_inference]: 0.0983298 [event_method]: 1.701e-05 [auto_monad]: 4.27e-05 [graph_reusing]: 3.45998e-06 [pre_auto_parallel]: 1.52999e-06 [py_interpret_to_execute]: 0.00038492 [rewriter_before_opt_a]: 7.208e-05 [expand_dump_flag]: 2.37999e-06 [jit_opt_a]: 0.00639393, [2] [Cycle 1]: 0.00311936, [27] [switch_simplify]: 4.436e-05 [loop_unroll]: 2.95e-05 [a_1]: 0.0005238 [with_stream_mark]: 1.518e-05 [recompute_prepare]: 8.25e-06 [updatestate_depend_eliminate]: 3.57002e-06 [updatestate_assign_eliminate]: 3.72998e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 6.98e-06 [updatestate_useless_node_eliminater]: 5.96e-06 [accelerated_algorithm]: 5.95002e-06 [meta_shard_fg_expand]: 2.11e-06 [get_grad_eliminate_]: 6.02001e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 1.04003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.445e-05 [j_node_and_user_rematch]: 9.34e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 8.88002e-06 [inline_without_move]: 5.79999e-06 [renormalize]: 0.00219094 [add_forward_monad_depend]: 5.34998e-06 [auto_monad_grad]: 1.84998e-06 [auto_monad_eliminator]: 1.512e-05 [cse]: 2.743e-05 [replace_applicator]: 1.261e-05 [Cycle 2]: 0.00035561, [27] [switch_simplify]: 6.92002e-06 [loop_unroll]: 5.64998e-06 [a_1]: 0.00011637 [with_stream_mark]: 8.20999e-06 [recompute_prepare]: 5.72999e-06 [updatestate_depend_eliminate]: 2.68e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 2.09999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.56e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.46002e-06 [meta_shard_fg_expand]: 1.05999e-06 [get_grad_eliminate_]: 5.19998e-06 [merge_forward]: 2.39001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.265e-05 [j_node_and_user_rematch]: 8.37e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.30999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.35999e-06 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.59e-06 [cse]: 2.074e-05 [replace_applicator]: 6.11e-06 [py_interpret_to_execute_after_opt_a]: 8.29002e-06 [rewriter_after_opt_a]: 3.227e-05 [convert_after_rewriter]: 6.59001e-06 [order_py_execute_after_rewriter]: 4.62e-06 [mutable_eliminate]: 0.00045835 [jit_opt_b]: 5.137e-05, [1] [Cycle 1]: 4.49e-05, [2] [frontend_op_eliminate]: 1.793e-05 [inline_after_opt_a]: 1.648e-05 [cconv]: 2.429e-05 [loop_unroll]: 0.00040292 [jit_opt_after_cconv]: 0.00014215, [1] [Cycle 1]: 0.00013566, [11] [c_1]: 2.501e-05 [parameter_eliminate]: 2.24001e-06 [updatestate_depend_eliminate]: 5.92999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 1.834e-05 [call_graph_tuple_transform]: 1.966e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.30008e-07 [switch_simplify]: 5.81e-06 [remove_dup_value]: 1.519e-05 [partial_unused_args_eliminate]: 2.17999e-06 [environ_conv]: 8.02e-06 [add_recomputation]: 4.534e-05 [cse_after_recomputation]: 1.974e-05, [1] [Cycle 1]: 1.494e-05, [1] [cse]: 9.64999e-06 [auto_monad_reorder]: 1.466e-05 [get_jit_bprop_graph]: 1.35001e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00044347 [symbol_engine_optimizer]: 7.164e-05, [1] [Cycle 1]: 6.55e-05, [6] [build]: 3.71999e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.282e-05 [opt_reshape]: 6.20002e-06 [fold_const_symbol]: 8.86002e-06 [renormalize]: 3.10014e-07 [validate]: 7.516e-05 Sums bootstrap : 0.000257s : 0.25% type_inference : 0.098330s : 94.51% event_method : 0.000017s : 0.02% auto_monad : 0.000043s : 0.04% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000385s : 0.37% rewriter_before_opt_a : 0.000072s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000640s : 0.62% jit_opt_a.with_stream_mark : 0.000023s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002191s : 2.11% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000048s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000458s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000403s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000443s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000075s : 0.07% Time group info: ------[substitution.] 0.000176 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.75% : 0.000001s : 2: substitution.fold_const_symbol 3.09% : 0.000005s : 4: substitution.graph_param_transform 81.86% : 0.000144s : 4: substitution.inline 1.44% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000005s : 4: substitution.remove_not_recompute_node 2.18% : 0.000004s : 2: substitution.replace_old_param 7.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098270 2 97.67% : 0.095979s : 1: type_inference.infer 2.33% : 0.002290s : 1: type_inference.specialize ------[replace.] 0.000065 6 65.64% : 0.000043s : 4: replace.inline 34.36% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 92.59% : 0.000141s : 4: match.inline 7.41% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.03% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 12: predicate.addn_check_dump 1.52% : 0.000002s : 12: predicate.addn_zero_filter 1.66% : 0.000002s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.43% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.34% : 0.000000s : 4: predicate.graph_param_transform 5.25% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.56% : 0.000002s : 4: predicate.mutable_eliminate 0.55% : 0.000001s : 4: predicate.opt_reshape 2.62% : 0.000003s : 18: predicate.partial_eliminate 1.42% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.58% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.67% : 0.000001s : 8: predicate.replace_old_param 0.33% : 0.000000s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.19% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.00% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.08% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000002s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.16% : 0.000001s : 12: predicate.tuple_list_get_item_depend_reorder 4.25% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.66% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.19% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.58% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.67% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001969 22 64.66% : 0.001273s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.49% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.85% : 0.000666s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.110571 72 0.04% : 0.000048s : 1: add_recomputation 0.04% : 0.000046s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000269s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.78% : 0.006397s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.37% : 0.000411s : 1: loop_unroll 0.42% : 0.000466s : 1: mutable_eliminate 0.77% : 0.000853s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000028s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.35% : 0.000391s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.41% : 0.001554s : 1: renormalize.infer 0.57% : 0.000629s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.07% : 0.000077s : 1: rewriter_before_opt_a 0.07% : 0.000074s : 1: symbol_engine_optimizer 88.94% : 0.098342s : 1: type_inference TotalTime = 0.111619, [30] [bootstrap]: 0.00025197 [type_inference]: 0.101433 [event_method]: 2.047e-05 [auto_monad]: 6.912e-05 [graph_reusing]: 6.46e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 0.00042627 [rewriter_before_opt_a]: 8.399e-05 [expand_dump_flag]: 4.15e-06 [jit_opt_a]: 0.00728898, [2] [Cycle 1]: 0.00372406, [27] [switch_simplify]: 5.268e-05 [loop_unroll]: 2.972e-05 [a_1]: 0.00054653 [with_stream_mark]: 1.911e-05 [recompute_prepare]: 7.97e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 3.06001e-06 [updatestate_loads_eliminate]: 3.26999e-06 [parameter_eliminate]: 1.68002e-06 [specialize_transform]: 6.83e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.22001e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 6.05002e-06 [merge_forward]: 3.63999e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.499e-05 [j_node_and_user_rematch]: 9.52001e-06 [meta_fg_expand]: 2.61e-06 [replace_old_param]: 1.085e-05 [inline_without_move]: 6.69001e-06 [renormalize]: 0.00273765 [add_forward_monad_depend]: 6.05002e-06 [auto_monad_grad]: 2.37001e-06 [auto_monad_eliminator]: 1.712e-05 [cse]: 3.492e-05 [replace_applicator]: 1.318e-05 [Cycle 2]: 0.00035462, [27] [switch_simplify]: 6.98e-06 [loop_unroll]: 5.81998e-06 [a_1]: 0.00011951 [with_stream_mark]: 1.021e-05 [recompute_prepare]: 6.04001e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 1.15999e-06 [specialize_transform]: 5.65001e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.37999e-06 [meta_shard_fg_expand]: 1.06002e-06 [get_grad_eliminate_]: 5.47001e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.50001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.398e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 8.21002e-06 [inline_without_move]: 5.29e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.09988e-07 [auto_monad_eliminator]: 6.36e-06 [cse]: 1.15e-05 [replace_applicator]: 5.59e-06 [py_interpret_to_execute_after_opt_a]: 1.021e-05 [rewriter_after_opt_a]: 3.469e-05 [convert_after_rewriter]: 7.35e-06 [order_py_execute_after_rewriter]: 8.12998e-06 [mutable_eliminate]: 0.00050196 [jit_opt_b]: 5.332e-05, [1] [Cycle 1]: 4.675e-05, [2] [frontend_op_eliminate]: 1.884e-05 [inline_after_opt_a]: 1.714e-05 [cconv]: 2.349e-05 [loop_unroll]: 0.00040954 [jit_opt_after_cconv]: 0.00014744, [1] [Cycle 1]: 0.00014098, [11] [c_1]: 2.531e-05 [parameter_eliminate]: 2.44999e-06 [updatestate_depend_eliminate]: 5.44998e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.958e-05 [call_graph_tuple_transform]: 2.129e-05 [tuple_list_get_item_eliminator]: 5.99e-06 [none_parameter_eliminate]: 1.55001e-06 [renormalize]: 4.69998e-07 [switch_simplify]: 6.58e-06 [remove_dup_value]: 1.461e-05 [partial_unused_args_eliminate]: 2.28002e-06 [environ_conv]: 7.76001e-06 [add_recomputation]: 4.818e-05 [cse_after_recomputation]: 2.01e-05, [1] [Cycle 1]: 1.526e-05, [1] [cse]: 9.89001e-06 [auto_monad_reorder]: 1.503e-05 [get_jit_bprop_graph]: 1.56002e-06 [rewriter_after_jit_bprop_graph]: 4.76002e-06 [opt_after_jit_grad]: 0.00044599 [symbol_engine_optimizer]: 7.309e-05, [1] [Cycle 1]: 6.764e-05, [6] [build]: 3.13e-06 [elim_shapecalc]: 8.13001e-06 [elim_not_effective]: 1.234e-05 [opt_reshape]: 7.01001e-06 [fold_const_symbol]: 9.96e-06 [renormalize]: 2.59985e-07 [validate]: 3.871e-05 Sums bootstrap : 0.000252s : 0.23% type_inference : 0.101433s : 94.05% event_method : 0.000020s : 0.02% auto_monad : 0.000069s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000426s : 0.40% rewriter_before_opt_a : 0.000084s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000666s : 0.62% jit_opt_a.with_stream_mark : 0.000029s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002738s : 2.54% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000046s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000035s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000008s : 0.01% mutable_eliminate : 0.000502s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000410s : 0.38% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000048s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000446s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000192 24 0.91% : 0.000002s : 2: substitution.elim_not_effective 1.27% : 0.000002s : 2: substitution.fold_const_symbol 3.03% : 0.000006s : 4: substitution.graph_param_transform 81.73% : 0.000157s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000005s : 4: substitution.remove_not_recompute_node 2.43% : 0.000005s : 2: substitution.replace_old_param 6.37% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101363 2 96.98% : 0.098305s : 1: type_inference.infer 3.02% : 0.003059s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.60% : 0.000046s : 4: replace.inline 31.40% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000166 6 93.34% : 0.000155s : 4: match.inline 6.66% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000002s : 12: predicate.addn_check_dump 1.27% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000002s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.32% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.12% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.36% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.26% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.70% : 0.000002s : 18: predicate.load_eliminater 1.35% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.67% : 0.000002s : 4: predicate.mutable_eliminate 0.49% : 0.000001s : 4: predicate.opt_reshape 2.49% : 0.000003s : 18: predicate.partial_eliminate 1.16% : 0.000001s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.79% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 1.06% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.39% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.20% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.23% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.41% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.84% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.53% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.76% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002091 22 63.55% : 0.001329s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.26% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.19% : 0.000736s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115323 72 0.04% : 0.000051s : 1: add_recomputation 0.06% : 0.000072s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000263s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000025s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000009s : 1: graph_reusing 6.32% : 0.007292s : 1: jit_opt_a 0.13% : 0.000150s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.36% : 0.000417s : 1: loop_unroll 0.44% : 0.000510s : 1: mutable_eliminate 0.77% : 0.000891s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.39% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000432s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.73% : 0.001989s : 1: renormalize.infer 0.64% : 0.000740s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000037s : 1: rewriter_after_opt_a 0.08% : 0.000089s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 87.97% : 0.101451s : 1: type_inference TotalTime = 0.0571391, [30] [bootstrap]: 0.00026133 [type_inference]: 0.0487861 [event_method]: 1.752e-05 [auto_monad]: 4.524e-05 [graph_reusing]: 3.83999e-06 [pre_auto_parallel]: 1.59998e-06 [py_interpret_to_execute]: 0.00023775 [rewriter_before_opt_a]: 7.556e-05 [expand_dump_flag]: 2.59999e-06 [jit_opt_a]: 0.00568495, [2] [Cycle 1]: 0.00244722, [27] [switch_simplify]: 4.487e-05 [loop_unroll]: 2.912e-05 [a_1]: 0.00049556 [with_stream_mark]: 1.295e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 3.01999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.37999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 6.71e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 6.02001e-06 [meta_shard_fg_expand]: 1.47999e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 2.71999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.205e-05 [j_node_and_user_rematch]: 9.45001e-06 [meta_fg_expand]: 1.89e-06 [replace_old_param]: 8.80001e-06 [inline_without_move]: 5.83997e-06 [renormalize]: 0.00157527 [add_forward_monad_depend]: 4.44002e-06 [auto_monad_grad]: 1.35999e-06 [auto_monad_eliminator]: 1.196e-05 [cse]: 1.793e-05 [replace_applicator]: 1.218e-05 [Cycle 2]: 0.00034805, [27] [switch_simplify]: 7.23e-06 [loop_unroll]: 5.77001e-06 [a_1]: 0.00011901 [with_stream_mark]: 8.55001e-06 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.72001e-06 [updatestate_assign_eliminate]: 2.16998e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 9.39996e-07 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.50001e-06 [accelerated_algorithm]: 5.43002e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 2.36e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.296e-05 [j_node_and_user_rematch]: 8.89003e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.97998e-06 [inline_without_move]: 5.35001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.00007e-07 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 5.45001e-06 [cse]: 1.013e-05 [replace_applicator]: 6.12001e-06 [py_interpret_to_execute_after_opt_a]: 8.75001e-06 [rewriter_after_opt_a]: 2.767e-05 [convert_after_rewriter]: 6.36e-06 [order_py_execute_after_rewriter]: 4.87998e-06 [mutable_eliminate]: 0.00051653 [jit_opt_b]: 5.159e-05, [1] [Cycle 1]: 4.49e-05, [2] [frontend_op_eliminate]: 1.783e-05 [inline_after_opt_a]: 1.662e-05 [cconv]: 1.888e-05 [loop_unroll]: 0.00041154 [jit_opt_after_cconv]: 0.00014049, [1] [Cycle 1]: 0.00013423, [11] [c_1]: 2.514e-05 [parameter_eliminate]: 2.31998e-06 [updatestate_depend_eliminate]: 5.77001e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.94e-06 [cse]: 1.833e-05 [call_graph_tuple_transform]: 1.826e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 1.12e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 5.76003e-06 [remove_dup_value]: 1.153e-05 [partial_unused_args_eliminate]: 1.67999e-06 [environ_conv]: 6.83998e-06 [add_recomputation]: 3.506e-05 [cse_after_recomputation]: 2.027e-05, [1] [Cycle 1]: 1.521e-05, [1] [cse]: 9.92999e-06 [auto_monad_reorder]: 1.166e-05 [get_jit_bprop_graph]: 1.34998e-06 [rewriter_after_jit_bprop_graph]: 3.83001e-06 [opt_after_jit_grad]: 0.00044783 [symbol_engine_optimizer]: 0.00010189, [1] [Cycle 1]: 9.582e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 7.74002e-06 [elim_not_effective]: 4.168e-05 [opt_reshape]: 6.68e-06 [fold_const_symbol]: 9.37999e-06 [renormalize]: 3.00002e-07 [validate]: 3.694e-05 Sums bootstrap : 0.000261s : 0.49% type_inference : 0.048786s : 90.83% event_method : 0.000018s : 0.03% auto_monad : 0.000045s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000238s : 0.44% rewriter_before_opt_a : 0.000076s : 0.14% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000615s : 1.14% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000003s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001575s : 2.93% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.03% jit_opt_a.cse : 0.000028s : 0.05% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000028s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000517s : 0.96% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000019s : 0.04% loop_unroll : 0.000412s : 0.77% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000012s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000448s : 0.83% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000042s : 0.08% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000150 24 1.14% : 0.000002s : 2: substitution.elim_not_effective 0.82% : 0.000001s : 2: substitution.fold_const_symbol 2.95% : 0.000004s : 4: substitution.graph_param_transform 82.05% : 0.000123s : 4: substitution.inline 2.20% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.91% : 0.000004s : 4: substitution.remove_not_recompute_node 2.15% : 0.000003s : 2: substitution.replace_old_param 5.79% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048726 2 96.56% : 0.047050s : 1: type_inference.infer 3.44% : 0.001675s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.25% : 0.000042s : 4: replace.inline 32.75% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000129 6 94.11% : 0.000121s : 4: match.inline 5.89% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.16% : 0.000001s : 12: predicate.accumulaten_eliminater 1.39% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.25% : 0.000002s : 12: predicate.addn_zero_filter 2.06% : 0.000003s : 12: predicate.arithmetic_simplify 1.40% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.19% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000001s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.15% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.45% : 0.000001s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.17% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.26% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000001s : 12: predicate.environ_get_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.37% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.27% : 0.000000s : 4: predicate.graph_param_transform 4.96% : 0.000006s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.37% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.09% : 0.000003s : 18: predicate.load_eliminater 1.26% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.78% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.26% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.69% : 0.000001s : 8: predicate.remove_not_recompute_node 2.09% : 0.000003s : 22: predicate.replace_applicator 0.86% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000001s : 12: predicate.reshape_eliminate 1.25% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.07% : 0.000001s : 8: predicate.special_op_eliminate 1.10% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.11% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.73% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.49% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002055 26 71.90% : 0.001478s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.24% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.86% : 0.000552s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059644 72 0.06% : 0.000038s : 1: add_recomputation 0.08% : 0.000048s : 1: auto_monad 0.02% : 0.000014s : 1: auto_monad_reorder 0.46% : 0.000275s : 1: bootstrap 0.04% : 0.000021s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.54% : 0.005688s : 1: jit_opt_a 0.24% : 0.000143s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.70% : 0.000419s : 1: loop_unroll 0.88% : 0.000525s : 1: mutable_eliminate 1.38% : 0.000826s : 26: opt.transform.jit_opt_a 0.09% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000062s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000456s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.41% : 0.000243s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 1.74% : 0.001040s : 1: renormalize.infer 0.89% : 0.000529s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000030s : 1: rewriter_after_opt_a 0.14% : 0.000081s : 1: rewriter_before_opt_a 0.18% : 0.000105s : 1: symbol_engine_optimizer 81.81% : 0.048798s : 1: type_inference TotalTime = 0.060498, [30] [bootstrap]: 0.00025638 [type_inference]: 0.0520195 [event_method]: 1.813e-05 [auto_monad]: 4.669e-05 [graph_reusing]: 3.82998e-06 [pre_auto_parallel]: 1.46998e-06 [py_interpret_to_execute]: 0.00023876 [rewriter_before_opt_a]: 7.402e-05 [expand_dump_flag]: 2.51e-06 [jit_opt_a]: 0.00591873, [2] [Cycle 1]: 0.00265885, [27] [switch_simplify]: 4.463e-05 [loop_unroll]: 2.964e-05 [a_1]: 0.00050135 [with_stream_mark]: 1.151e-05 [recompute_prepare]: 7.85e-06 [updatestate_depend_eliminate]: 3.28e-06 [updatestate_assign_eliminate]: 2.32999e-06 [updatestate_loads_eliminate]: 2.27001e-06 [parameter_eliminate]: 9.40025e-07 [specialize_transform]: 6.68e-06 [updatestate_useless_node_eliminater]: 5.91998e-06 [accelerated_algorithm]: 6.09999e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 6.01998e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 7.39994e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.16e-05 [j_node_and_user_rematch]: 8.97999e-06 [meta_fg_expand]: 1.86e-06 [replace_old_param]: 8.26002e-06 [inline_without_move]: 5.69e-06 [renormalize]: 0.00178079 [add_forward_monad_depend]: 4.48999e-06 [auto_monad_grad]: 1.57001e-06 [auto_monad_eliminator]: 1.161e-05 [cse]: 1.964e-05 [replace_applicator]: 1.275e-05 [Cycle 2]: 0.00034505, [27] [switch_simplify]: 6.04999e-06 [loop_unroll]: 5.48002e-06 [a_1]: 0.00011601 [with_stream_mark]: 8.65999e-06 [recompute_prepare]: 5.49e-06 [updatestate_depend_eliminate]: 2.63003e-06 [updatestate_assign_eliminate]: 2.04999e-06 [updatestate_loads_eliminate]: 1.92999e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.61998e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.56998e-06 [meta_shard_fg_expand]: 1.00999e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.53003e-06 [cell_reuse_recompute_pass]: 1.24998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.32e-05 [j_node_and_user_rematch]: 8.49998e-06 [meta_fg_expand]: 1.47999e-06 [replace_old_param]: 7.81001e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 8.30012e-07 [auto_monad_eliminator]: 5.74e-06 [cse]: 1.103e-05 [replace_applicator]: 5.82999e-06 [py_interpret_to_execute_after_opt_a]: 7.77e-06 [rewriter_after_opt_a]: 2.642e-05 [convert_after_rewriter]: 6.16e-06 [order_py_execute_after_rewriter]: 4.42998e-06 [mutable_eliminate]: 0.00046478 [jit_opt_b]: 5.093e-05, [1] [Cycle 1]: 4.519e-05, [2] [frontend_op_eliminate]: 1.752e-05 [inline_after_opt_a]: 1.681e-05 [cconv]: 1.7e-05 [loop_unroll]: 0.00040159 [jit_opt_after_cconv]: 0.00014196, [1] [Cycle 1]: 0.00013558, [11] [c_1]: 2.537e-05 [parameter_eliminate]: 2.32001e-06 [updatestate_depend_eliminate]: 5.24998e-06 [updatestate_assign_eliminate]: 2.71e-06 [updatestate_loads_eliminate]: 2.14e-06 [cse]: 1.811e-05 [call_graph_tuple_transform]: 1.826e-05 [tuple_list_get_item_eliminator]: 6.81001e-06 [none_parameter_eliminate]: 1.27e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 5.69e-06 [remove_dup_value]: 9.22999e-06 [partial_unused_args_eliminate]: 1.52999e-06 [environ_conv]: 6.06998e-06 [add_recomputation]: 3.519e-05 [cse_after_recomputation]: 2.079e-05, [1] [Cycle 1]: 1.607e-05, [1] [cse]: 1.077e-05 [auto_monad_reorder]: 1.024e-05 [get_jit_bprop_graph]: 1.55999e-06 [rewriter_after_jit_bprop_graph]: 4.17e-06 [opt_after_jit_grad]: 0.00043657 [symbol_engine_optimizer]: 7.037e-05, [1] [Cycle 1]: 6.469e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.219e-05 [opt_reshape]: 5.87999e-06 [fold_const_symbol]: 8.70999e-06 [renormalize]: 2.89991e-07 [validate]: 4.614e-05 Sums bootstrap : 0.000256s : 0.45% type_inference : 0.052019s : 91.18% event_method : 0.000018s : 0.03% auto_monad : 0.000047s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000001s : 0.00% py_interpret_to_execute : 0.000239s : 0.42% rewriter_before_opt_a : 0.000074s : 0.13% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.09% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000617s : 1.08% jit_opt_a.with_stream_mark : 0.000020s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000003s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001781s : 3.12% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.03% jit_opt_a.cse : 0.000031s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000026s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000465s : 0.81% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000017s : 0.03% loop_unroll : 0.000402s : 0.70% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000009s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000035s : 0.06% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000010s : 0.02% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000437s : 0.77% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000046s : 0.08% Time group info: ------[substitution.] 0.000153 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.86% : 0.000004s : 4: substitution.graph_param_transform 83.50% : 0.000128s : 4: substitution.inline 1.73% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.97% : 0.000005s : 4: substitution.remove_not_recompute_node 1.94% : 0.000003s : 2: substitution.replace_old_param 5.29% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.051958 2 96.45% : 0.050113s : 1: type_inference.infer 3.55% : 0.001844s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.42% : 0.000042s : 4: replace.inline 33.58% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000133 6 94.72% : 0.000125s : 4: match.inline 5.28% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 830 1.22% : 0.000002s : 12: predicate.accumulaten_eliminater 1.35% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.22% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 1.90% : 0.000002s : 12: predicate.arithmetic_simplify 1.33% : 0.000002s : 12: predicate.cast_eliminate 0.53% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.31% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.60% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_depend_swap 1.15% : 0.000001s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.33% : 0.000000s : 4: predicate.fold_const_symbol 1.27% : 0.000002s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.06% : 0.000006s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.23% : 0.000002s : 8: predicate.less_batch_normalization 1.48% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.00% : 0.000002s : 18: predicate.load_eliminater 1.59% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.14% : 0.000001s : 12: predicate.minmaximum_grad 1.59% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.27% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.44% : 0.000002s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.13% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.05% : 0.000009s : 58: predicate.switch_simplify 1.21% : 0.000001s : 12: predicate.tile_eliminate 1.19% : 0.000001s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.99% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.86% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002131 26 71.21% : 0.001517s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.27% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.52% : 0.000587s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063172 72 0.06% : 0.000038s : 1: add_recomputation 0.08% : 0.000050s : 1: auto_monad 0.02% : 0.000013s : 1: auto_monad_reorder 0.43% : 0.000269s : 1: bootstrap 0.03% : 0.000020s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.37% : 0.005922s : 1: jit_opt_a 0.23% : 0.000145s : 1: jit_opt_after_cconv 0.08% : 0.000054s : 1: jit_opt_b 0.65% : 0.000409s : 1: loop_unroll 0.75% : 0.000473s : 1: mutable_eliminate 1.31% : 0.000828s : 26: opt.transform.jit_opt_a 0.08% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.70% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.39% : 0.000244s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000011s : 1: remove_dup_value 1.85% : 0.001170s : 1: renormalize.infer 0.96% : 0.000604s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000029s : 1: rewriter_after_opt_a 0.12% : 0.000079s : 1: rewriter_before_opt_a 0.12% : 0.000073s : 1: symbol_engine_optimizer 82.36% : 0.052032s : 1: type_inference TotalTime = 0.0111428, [30] [bootstrap]: 0.00023209 [type_inference]: 0.00398963 [event_method]: 1.722e-05 [auto_monad]: 6.477e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.27999e-06 [py_interpret_to_execute]: 3.501e-05 [rewriter_before_opt_a]: 7.154e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.00476311, [2] [Cycle 1]: 0.00145331, [27] [switch_simplify]: 5.167e-05 [loop_unroll]: 2.885e-05 [a_1]: 0.00051371 [with_stream_mark]: 1.734e-05 [recompute_prepare]: 8.05999e-06 [updatestate_depend_eliminate]: 3.74002e-06 [updatestate_assign_eliminate]: 3.36001e-06 [updatestate_loads_eliminate]: 3.13998e-06 [parameter_eliminate]: 1.94e-06 [specialize_transform]: 6.19001e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.32001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.47999e-06 [merge_forward]: 3.91999e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.52e-05 [j_node_and_user_rematch]: 9.84001e-06 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 8.55999e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 0.00052813 [add_forward_monad_depend]: 5.64e-06 [auto_monad_grad]: 2.27001e-06 [auto_monad_eliminator]: 1.491e-05 [cse]: 2.591e-05 [replace_applicator]: 1.095e-05 [Cycle 2]: 0.00031229, [27] [switch_simplify]: 5.42999e-06 [loop_unroll]: 4.72e-06 [a_1]: 9.203e-05 [with_stream_mark]: 8.45999e-06 [recompute_prepare]: 5.02999e-06 [updatestate_depend_eliminate]: 2.49999e-06 [updatestate_assign_eliminate]: 2.07999e-06 [updatestate_loads_eliminate]: 1.91e-06 [parameter_eliminate]: 8.10018e-07 [specialize_transform]: 4.79e-06 [updatestate_useless_node_eliminater]: 4.93001e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 4.63999e-06 [merge_forward]: 2.29001e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.175e-05 [j_node_and_user_rematch]: 7.53e-06 [meta_fg_expand]: 1.59e-06 [replace_old_param]: 7.14001e-06 [inline_without_move]: 5.04e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.66e-06 [cse]: 1.014e-05 [replace_applicator]: 5.15999e-06 [py_interpret_to_execute_after_opt_a]: 8.29998e-06 [rewriter_after_opt_a]: 3.176e-05 [convert_after_rewriter]: 6.64999e-06 [order_py_execute_after_rewriter]: 5.01997e-06 [mutable_eliminate]: 0.00048933 [jit_opt_b]: 4.76e-05, [1] [Cycle 1]: 4.088e-05, [2] [frontend_op_eliminate]: 1.544e-05 [inline_after_opt_a]: 1.49e-05 [cconv]: 2.336e-05 [loop_unroll]: 0.00040708 [jit_opt_after_cconv]: 0.00013523, [1] [Cycle 1]: 0.00012829, [11] [c_1]: 2.012e-05 [parameter_eliminate]: 2.36e-06 [updatestate_depend_eliminate]: 5.50001e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 1.77e-05 [call_graph_tuple_transform]: 1.805e-05 [tuple_list_get_item_eliminator]: 4.99e-06 [none_parameter_eliminate]: 1.71998e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.25001e-06 [remove_dup_value]: 1.416e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 5.37999e-06 [add_recomputation]: 4.635e-05 [cse_after_recomputation]: 3.094e-05, [1] [Cycle 1]: 2.605e-05, [1] [cse]: 2.028e-05 [auto_monad_reorder]: 1.511e-05 [get_jit_bprop_graph]: 1.62999e-06 [rewriter_after_jit_bprop_graph]: 4.13999e-06 [opt_after_jit_grad]: 0.00043641 [symbol_engine_optimizer]: 6.948e-05, [1] [Cycle 1]: 6.341e-05, [6] [build]: 3.01001e-06 [elim_shapecalc]: 7.77e-06 [elim_not_effective]: 1.224e-05 [opt_reshape]: 5.59e-06 [fold_const_symbol]: 8.3e-06 [renormalize]: 3.09985e-07 [validate]: 3.058e-05 Sums bootstrap : 0.000232s : 3.05% type_inference : 0.003990s : 52.42% event_method : 0.000017s : 0.23% auto_monad : 0.000065s : 0.85% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.46% rewriter_before_opt_a : 0.000072s : 0.94% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000057s : 0.75% jit_opt_a.loop_unroll : 0.000034s : 0.44% jit_opt_a.a_1 : 0.000606s : 7.96% jit_opt_a.with_stream_mark : 0.000026s : 0.34% jit_opt_a.recompute_prepare : 0.000013s : 0.17% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.35% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.23% jit_opt_a.meta_fg_expand : 0.000004s : 0.06% jit_opt_a.replace_old_param : 0.000016s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.14% jit_opt_a.renormalize : 0.000528s : 6.94% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.09% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.27% jit_opt_a.cse : 0.000036s : 0.47% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000032s : 0.42% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000489s : 6.43% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000023s : 0.31% loop_unroll : 0.000407s : 5.35% jit_opt_after_cconv.c_1 : 0.000020s : 0.26% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000046s : 0.61% cse_after_recomputation.cse : 0.000020s : 0.27% auto_monad_reorder : 0.000015s : 0.20% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000436s : 5.73% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.40% Time group info: ------[substitution.] 0.000178 23 1.24% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.13% : 0.000006s : 3: substitution.graph_param_transform 81.61% : 0.000145s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.72% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 6.79% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003939 2 80.24% : 0.003161s : 1: type_inference.infer 19.76% : 0.000778s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.81% : 0.000042s : 4: replace.inline 33.19% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 92.88% : 0.000143s : 4: match.inline 7.12% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.48% : 0.000002s : 10: predicate.accumulaten_eliminater 1.10% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.42% : 0.000000s : 3: predicate.check_bprop_eliminate 1.14% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.25% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.93% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.29% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.46% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.18% : 0.000001s : 6: predicate.less_batch_normalization 1.44% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.01% : 0.000002s : 15: predicate.load_eliminater 1.41% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.05% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.90% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.25% : 0.000001s : 10: predicate.merge_addn 1.22% : 0.000001s : 10: predicate.minmaximum_grad 1.66% : 0.000002s : 3: predicate.mutable_eliminate 0.43% : 0.000000s : 3: predicate.opt_reshape 2.34% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.64% : 0.000002s : 10: predicate.reduce_eliminate 1.57% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 6: predicate.remove_not_recompute_node 1.89% : 0.000002s : 18: predicate.replace_applicator 0.81% : 0.000001s : 6: predicate.replace_old_param 0.30% : 0.000000s : 3: predicate.reset_defer_inline 1.33% : 0.000002s : 10: predicate.reshape_eliminate 1.41% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 3: predicate.row_tensor_eliminate 1.56% : 0.000002s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.96% : 0.000001s : 6: predicate.special_op_eliminate 1.01% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.43% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 16: predicate.switch_defer_inline 2.15% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.61% : 0.000009s : 53: predicate.switch_simplify 1.34% : 0.000002s : 10: predicate.tile_eliminate 1.28% : 0.000001s : 10: predicate.transpose_eliminate 1.46% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.15% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.95% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.11% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000527 13 49.66% : 0.000262s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.24% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 45.10% : 0.000238s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012547 72 0.39% : 0.000049s : 1: add_recomputation 0.54% : 0.000068s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 1.94% : 0.000244s : 1: bootstrap 0.21% : 0.000026s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.26% : 0.000033s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.07% : 0.000008s : 1: graph_reusing 37.98% : 0.004766s : 1: jit_opt_a 1.10% : 0.000138s : 1: jit_opt_after_cconv 0.40% : 0.000050s : 1: jit_opt_b 3.31% : 0.000415s : 1: loop_unroll 3.98% : 0.000499s : 1: mutable_eliminate 6.45% : 0.000810s : 26: opt.transform.jit_opt_a 0.36% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.11% : 0.000014s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.54% : 0.000444s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 2.16% : 0.000271s : 1: renormalize.infer 2.00% : 0.000251s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000034s : 1: rewriter_after_opt_a 0.59% : 0.000074s : 1: rewriter_before_opt_a 0.57% : 0.000072s : 1: symbol_engine_optimizer 31.88% : 0.004000s : 1: type_inference TotalTime = 0.0117569, [30] [bootstrap]: 0.00024798 [type_inference]: 0.00460424 [event_method]: 1.856e-05 [auto_monad]: 6.047e-05 [graph_reusing]: 4.72e-06 [pre_auto_parallel]: 2.02999e-06 [py_interpret_to_execute]: 3.744e-05 [rewriter_before_opt_a]: 7.024e-05 [expand_dump_flag]: 2.76e-06 [jit_opt_a]: 0.00477558, [2] [Cycle 1]: 0.00139817, [27] [switch_simplify]: 4.87e-05 [loop_unroll]: 3.015e-05 [a_1]: 0.00047833 [with_stream_mark]: 1.199e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 3.25e-06 [updatestate_assign_eliminate]: 3.04001e-06 [updatestate_loads_eliminate]: 2.86e-06 [parameter_eliminate]: 1.54e-06 [specialize_transform]: 6.06e-06 [updatestate_useless_node_eliminater]: 5.07999e-06 [accelerated_algorithm]: 5.25999e-06 [meta_shard_fg_expand]: 1.94e-06 [get_grad_eliminate_]: 5.05999e-06 [merge_forward]: 3.78001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.268e-05 [j_node_and_user_rematch]: 8.69e-06 [meta_fg_expand]: 1.94999e-06 [replace_old_param]: 8.48999e-06 [inline_without_move]: 4.95001e-06 [renormalize]: 0.0005367 [add_forward_monad_depend]: 4.57998e-06 [auto_monad_grad]: 1.40001e-06 [auto_monad_eliminator]: 1.365e-05 [cse]: 2.235e-05 [replace_applicator]: 1.188e-05 [Cycle 2]: 0.00030427, [27] [switch_simplify]: 5.84999e-06 [loop_unroll]: 4.97e-06 [a_1]: 8.876e-05 [with_stream_mark]: 8.47998e-06 [recompute_prepare]: 4.92e-06 [updatestate_depend_eliminate]: 2.49999e-06 [updatestate_assign_eliminate]: 2.18002e-06 [updatestate_loads_eliminate]: 1.87001e-06 [parameter_eliminate]: 9.29984e-07 [specialize_transform]: 4.75999e-06 [updatestate_useless_node_eliminater]: 4.59002e-06 [accelerated_algorithm]: 4.48001e-06 [meta_shard_fg_expand]: 1.09003e-06 [get_grad_eliminate_]: 4.72e-06 [merge_forward]: 2.29001e-06 [cell_reuse_recompute_pass]: 1.19e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.2e-05 [j_node_and_user_rematch]: 7.51999e-06 [meta_fg_expand]: 1.56998e-06 [replace_old_param]: 7.19001e-06 [inline_without_move]: 4.50999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.01002e-06 [auto_monad_grad]: 5.69999e-07 [auto_monad_eliminator]: 5.50001e-06 [cse]: 9.74e-06 [replace_applicator]: 5.03002e-06 [py_interpret_to_execute_after_opt_a]: 7.97e-06 [rewriter_after_opt_a]: 2.849e-05 [convert_after_rewriter]: 6.51e-06 [order_py_execute_after_rewriter]: 4.28999e-06 [mutable_eliminate]: 0.00044691 [jit_opt_b]: 4.802e-05, [1] [Cycle 1]: 4.142e-05, [2] [frontend_op_eliminate]: 1.567e-05 [inline_after_opt_a]: 1.487e-05 [cconv]: 2.09e-05 [loop_unroll]: 0.00044808 [jit_opt_after_cconv]: 0.00013338, [1] [Cycle 1]: 0.00012716, [11] [c_1]: 2.075e-05 [parameter_eliminate]: 2.32999e-06 [updatestate_depend_eliminate]: 5.55001e-06 [updatestate_assign_eliminate]: 2.44001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 1.684e-05 [call_graph_tuple_transform]: 1.816e-05 [tuple_list_get_item_eliminator]: 5.27999e-06 [none_parameter_eliminate]: 1.29998e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.26998e-06 [remove_dup_value]: 1.184e-05 [partial_unused_args_eliminate]: 2.22001e-06 [environ_conv]: 4.50001e-06 [add_recomputation]: 3.851e-05 [cse_after_recomputation]: 2.006e-05, [1] [Cycle 1]: 1.514e-05, [1] [cse]: 9.64999e-06 [auto_monad_reorder]: 2.565e-05 [get_jit_bprop_graph]: 1.53002e-06 [rewriter_after_jit_bprop_graph]: 4.53999e-06 [opt_after_jit_grad]: 0.00043743 [symbol_engine_optimizer]: 6.99e-05, [1] [Cycle 1]: 6.389e-05, [6] [build]: 3.03e-06 [elim_shapecalc]: 7.88999e-06 [elim_not_effective]: 1.225e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.38001e-06 [renormalize]: 2.30008e-07 [validate]: 2.735e-05 Sums bootstrap : 0.000248s : 3.04% type_inference : 0.004604s : 56.40% event_method : 0.000019s : 0.23% auto_monad : 0.000060s : 0.74% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000037s : 0.46% rewriter_before_opt_a : 0.000070s : 0.86% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000055s : 0.67% jit_opt_a.loop_unroll : 0.000035s : 0.43% jit_opt_a.a_1 : 0.000567s : 6.95% jit_opt_a.with_stream_mark : 0.000020s : 0.25% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.04% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000009s : 0.12% jit_opt_a.renormalize : 0.000537s : 6.57% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.02% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000032s : 0.39% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000028s : 0.35% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000004s : 0.05% mutable_eliminate : 0.000447s : 5.47% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000021s : 0.26% loop_unroll : 0.000448s : 5.49% jit_opt_after_cconv.c_1 : 0.000021s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000012s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000039s : 0.47% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000026s : 0.31% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000437s : 5.36% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000027s : 0.34% Time group info: ------[substitution.] 0.000164 23 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.83% : 0.000001s : 2: substitution.fold_const_symbol 3.18% : 0.000005s : 3: substitution.graph_param_transform 81.68% : 0.000134s : 4: substitution.inline 1.83% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.64% : 0.000004s : 4: substitution.remove_not_recompute_node 2.41% : 0.000004s : 2: substitution.replace_old_param 6.27% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004551 2 79.49% : 0.003617s : 1: type_inference.infer 20.51% : 0.000933s : 1: type_inference.specialize ------[replace.] 0.000062 6 67.01% : 0.000042s : 4: replace.inline 32.99% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000140 6 93.42% : 0.000131s : 4: match.inline 6.58% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.50% : 0.000002s : 10: predicate.accumulaten_eliminater 1.24% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.23% : 0.000001s : 10: predicate.addn_check_dump 1.34% : 0.000001s : 10: predicate.addn_zero_filter 1.77% : 0.000002s : 10: predicate.arithmetic_simplify 1.28% : 0.000001s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.15% : 0.000001s : 10: predicate.depend_value_elim 1.22% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.29% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.15% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.69% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.16% : 0.000001s : 10: predicate.environ_get_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.08% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.92% : 0.000007s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 15: predicate.load_eliminater 1.66% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.24% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.59% : 0.000002s : 3: predicate.mutable_eliminate 0.42% : 0.000000s : 3: predicate.opt_reshape 2.27% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.77% : 0.000002s : 10: predicate.reduce_eliminate 1.41% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.58% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.77% : 0.000001s : 6: predicate.replace_old_param 0.31% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.35% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.62% : 0.000001s : 6: predicate.set_cell_output_no_recompute 1.23% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.22% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.05% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.93% : 0.000009s : 53: predicate.switch_simplify 1.22% : 0.000001s : 10: predicate.tile_eliminate 1.22% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.01% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.50% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000614 13 49.20% : 0.000302s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.18% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.62% : 0.000286s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013131 72 0.31% : 0.000041s : 1: add_recomputation 0.48% : 0.000064s : 1: auto_monad 0.21% : 0.000028s : 1: auto_monad_reorder 1.97% : 0.000259s : 1: bootstrap 0.18% : 0.000023s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.17% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000006s : 1: environ_conv 0.17% : 0.000022s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000007s : 1: graph_reusing 36.39% : 0.004778s : 1: jit_opt_a 1.03% : 0.000136s : 1: jit_opt_after_cconv 0.38% : 0.000050s : 1: jit_opt_b 3.47% : 0.000456s : 1: loop_unroll 3.46% : 0.000455s : 1: mutable_eliminate 5.83% : 0.000766s : 26: opt.transform.jit_opt_a 0.35% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.39% : 0.000445s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000040s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 2.00% : 0.000263s : 1: renormalize.infer 2.04% : 0.000268s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.24% : 0.000031s : 1: rewriter_after_opt_a 0.56% : 0.000073s : 1: rewriter_before_opt_a 0.55% : 0.000072s : 1: symbol_engine_optimizer 35.15% : 0.004616s : 1: type_inference TotalTime = 0.107734, [30] [bootstrap]: 0.00030778 [type_inference]: 0.098549 [event_method]: 1.735e-05 [auto_monad]: 6.028e-05 [graph_reusing]: 5.03002e-06 [pre_auto_parallel]: 2.06e-06 [py_interpret_to_execute]: 0.0004088 [rewriter_before_opt_a]: 7.715e-05 [expand_dump_flag]: 3.35e-06 [jit_opt_a]: 0.00629737, [2] [Cycle 1]: 0.00298009, [27] [switch_simplify]: 4.68e-05 [loop_unroll]: 3.105e-05 [a_1]: 0.00051383 [with_stream_mark]: 1.273e-05 [recompute_prepare]: 8.12e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 3.15998e-06 [updatestate_loads_eliminate]: 2.71e-06 [parameter_eliminate]: 1.56998e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.74999e-06 [accelerated_algorithm]: 5.94999e-06 [meta_shard_fg_expand]: 2.03997e-06 [get_grad_eliminate_]: 5.81e-06 [merge_forward]: 3.05998e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.226e-05 [j_node_and_user_rematch]: 9.81e-06 [meta_fg_expand]: 2.09999e-06 [replace_old_param]: 8.37e-06 [inline_without_move]: 6.16998e-06 [renormalize]: 0.00207613 [add_forward_monad_depend]: 5.06997e-06 [auto_monad_grad]: 1.72999e-06 [auto_monad_eliminator]: 1.422e-05 [cse]: 2.182e-05 [replace_applicator]: 1.298e-05 [Cycle 2]: 0.00034949, [27] [switch_simplify]: 6.67002e-06 [loop_unroll]: 5.70001e-06 [a_1]: 0.00011836 [with_stream_mark]: 8.42e-06 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 1.93002e-06 [specialize_transform]: 5.79e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 1.11002e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.325e-05 [j_node_and_user_rematch]: 8.77e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 8.67e-06 [inline_without_move]: 5.44998e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 7.60017e-07 [auto_monad_eliminator]: 5.79999e-06 [cse]: 1.039e-05 [replace_applicator]: 5.79e-06 [py_interpret_to_execute_after_opt_a]: 8.85001e-06 [rewriter_after_opt_a]: 2.968e-05 [convert_after_rewriter]: 6.23998e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.0004716 [jit_opt_b]: 5.26e-05, [1] [Cycle 1]: 4.628e-05, [2] [frontend_op_eliminate]: 1.889e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 2.292e-05 [loop_unroll]: 0.00040367 [jit_opt_after_cconv]: 0.00014317, [1] [Cycle 1]: 0.00013694, [11] [c_1]: 2.463e-05 [parameter_eliminate]: 2.63003e-06 [updatestate_depend_eliminate]: 5.07999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.966e-05 [call_graph_tuple_transform]: 1.848e-05 [tuple_list_get_item_eliminator]: 6.17999e-06 [none_parameter_eliminate]: 1.66e-06 [renormalize]: 4.19997e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.224e-05 [partial_unused_args_eliminate]: 2.06003e-06 [environ_conv]: 7.01999e-06 [add_recomputation]: 4.148e-05 [cse_after_recomputation]: 2.158e-05, [1] [Cycle 1]: 1.561e-05, [1] [cse]: 1.033e-05 [auto_monad_reorder]: 1.489e-05 [get_jit_bprop_graph]: 1.67001e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00043618 [symbol_engine_optimizer]: 7.467e-05, [1] [Cycle 1]: 6.899e-05, [6] [build]: 3.26001e-06 [elim_shapecalc]: 7.85998e-06 [elim_not_effective]: 1.36e-05 [opt_reshape]: 6.31e-06 [fold_const_symbol]: 9.87999e-06 [renormalize]: 2.60014e-07 [validate]: 9.06e-05 Sums bootstrap : 0.000308s : 0.30% type_inference : 0.098549s : 94.55% event_method : 0.000017s : 0.02% auto_monad : 0.000060s : 0.06% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000409s : 0.39% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000632s : 0.61% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002076s : 1.99% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000032s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000472s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000404s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000436s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000091s : 0.09% Time group info: ------[substitution.] 0.000169 24 1.54% : 0.000003s : 2: substitution.elim_not_effective 0.63% : 0.000001s : 2: substitution.fold_const_symbol 3.07% : 0.000005s : 4: substitution.graph_param_transform 81.05% : 0.000137s : 4: substitution.inline 2.11% : 0.000004s : 4: substitution.j_node_and_user_rematch 2.35% : 0.000004s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 7.08% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098489 2 97.23% : 0.095764s : 1: type_inference.infer 2.77% : 0.002725s : 1: type_inference.specialize ------[replace.] 0.000061 6 66.80% : 0.000041s : 4: replace.inline 33.20% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000146 6 92.53% : 0.000135s : 4: match.inline 7.47% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 0.96% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 12: predicate.addn_check_dump 1.20% : 0.000001s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.49% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.25% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.21% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.01% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.76% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000001s : 12: predicate.environ_get_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 1.02% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 8: predicate.less_batch_normalization 1.65% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.93% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.58% : 0.000002s : 4: predicate.mutable_eliminate 0.58% : 0.000001s : 4: predicate.opt_reshape 2.25% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.97% : 0.000001s : 8: predicate.replace_old_param 0.43% : 0.000001s : 4: predicate.reset_defer_inline 1.16% : 0.000001s : 12: predicate.reshape_eliminate 1.53% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 1.01% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.48% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.39% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.37% : 0.000003s : 18: predicate.switch_defer_inline 2.09% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.36% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.34% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.47% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.64% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001858 22 64.56% : 0.001200s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.08% : 0.000633s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.110679 72 0.04% : 0.000044s : 1: add_recomputation 0.06% : 0.000063s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.29% : 0.000318s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.69% : 0.006300s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000411s : 1: loop_unroll 0.43% : 0.000480s : 1: mutable_eliminate 0.77% : 0.000848s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000444s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000414s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.32% : 0.001466s : 1: renormalize.infer 0.54% : 0.000602s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 89.05% : 0.098562s : 1: type_inference TotalTime = 0.10669, [30] [bootstrap]: 0.0002379 [type_inference]: 0.0977511 [event_method]: 1.714e-05 [auto_monad]: 5.88e-05 [graph_reusing]: 5.42999e-06 [pre_auto_parallel]: 2.17999e-06 [py_interpret_to_execute]: 0.00041097 [rewriter_before_opt_a]: 7.772e-05 [expand_dump_flag]: 3.31001e-06 [jit_opt_a]: 0.00614281, [2] [Cycle 1]: 0.00293259, [27] [switch_simplify]: 4.791e-05 [loop_unroll]: 3.008e-05 [a_1]: 0.00051048 [with_stream_mark]: 1.368e-05 [recompute_prepare]: 7.64002e-06 [updatestate_depend_eliminate]: 3.38e-06 [updatestate_assign_eliminate]: 3.08e-06 [updatestate_loads_eliminate]: 2.74999e-06 [parameter_eliminate]: 1.71998e-06 [specialize_transform]: 6.58998e-06 [updatestate_useless_node_eliminater]: 5.76998e-06 [accelerated_algorithm]: 5.99e-06 [meta_shard_fg_expand]: 1.80001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 3.21999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 9.70002e-06 [meta_fg_expand]: 2.25002e-06 [replace_old_param]: 8.88002e-06 [inline_without_move]: 5.98998e-06 [renormalize]: 0.00202612 [add_forward_monad_depend]: 5.22999e-06 [auto_monad_grad]: 1.87001e-06 [auto_monad_eliminator]: 1.358e-05 [cse]: 2.451e-05 [replace_applicator]: 1.264e-05 [Cycle 2]: 0.00034468, [27] [switch_simplify]: 6.53e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00011535 [with_stream_mark]: 8.47998e-06 [recompute_prepare]: 5.77001e-06 [updatestate_depend_eliminate]: 2.62001e-06 [updatestate_assign_eliminate]: 2.20002e-06 [updatestate_loads_eliminate]: 2.07999e-06 [parameter_eliminate]: 8.80013e-07 [specialize_transform]: 5.52999e-06 [updatestate_useless_node_eliminater]: 5.41002e-06 [accelerated_algorithm]: 5.47001e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 2.31e-06 [cell_reuse_recompute_pass]: 1.25001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.294e-05 [j_node_and_user_rematch]: 8.23999e-06 [meta_fg_expand]: 1.59998e-06 [replace_old_param]: 7.80998e-06 [inline_without_move]: 5.51e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.39996e-07 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.64998e-06 [cse]: 1.093e-05 [replace_applicator]: 5.89e-06 [py_interpret_to_execute_after_opt_a]: 8.23001e-06 [rewriter_after_opt_a]: 2.896e-05 [convert_after_rewriter]: 6.11e-06 [order_py_execute_after_rewriter]: 2.491e-05 [mutable_eliminate]: 0.00044519 [jit_opt_b]: 5.236e-05, [1] [Cycle 1]: 4.603e-05, [2] [frontend_op_eliminate]: 1.838e-05 [inline_after_opt_a]: 1.736e-05 [cconv]: 2.263e-05 [loop_unroll]: 0.00039557 [jit_opt_after_cconv]: 0.00014166, [1] [Cycle 1]: 0.00013556, [11] [c_1]: 2.443e-05 [parameter_eliminate]: 2.28998e-06 [updatestate_depend_eliminate]: 5.10999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.853e-05 [call_graph_tuple_transform]: 1.839e-05 [tuple_list_get_item_eliminator]: 5.79e-06 [none_parameter_eliminate]: 1.57001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 6.04999e-06 [remove_dup_value]: 1.309e-05 [partial_unused_args_eliminate]: 2.02999e-06 [environ_conv]: 7.1e-06 [add_recomputation]: 4.152e-05 [cse_after_recomputation]: 2.081e-05, [1] [Cycle 1]: 1.527e-05, [1] [cse]: 9.79999e-06 [auto_monad_reorder]: 1.313e-05 [get_jit_bprop_graph]: 1.31998e-06 [rewriter_after_jit_bprop_graph]: 3.72998e-06 [opt_after_jit_grad]: 0.00043546 [symbol_engine_optimizer]: 7.516e-05, [1] [Cycle 1]: 6.95e-05, [6] [build]: 2.98998e-06 [elim_shapecalc]: 8.65001e-06 [elim_not_effective]: 1.446e-05 [opt_reshape]: 5.91998e-06 [fold_const_symbol]: 9.26002e-06 [renormalize]: 2.50002e-07 [validate]: 8.901e-05 Sums bootstrap : 0.000238s : 0.23% type_inference : 0.097751s : 94.64% event_method : 0.000017s : 0.02% auto_monad : 0.000059s : 0.06% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000411s : 0.40% rewriter_before_opt_a : 0.000078s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000054s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000626s : 0.61% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002026s : 1.96% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000025s : 0.02% mutable_eliminate : 0.000445s : 0.43% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000396s : 0.38% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000042s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000435s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000089s : 0.09% Time group info: ------[substitution.] 0.000169 24 2.17% : 0.000004s : 2: substitution.elim_not_effective 0.68% : 0.000001s : 2: substitution.fold_const_symbol 2.83% : 0.000005s : 4: substitution.graph_param_transform 81.18% : 0.000137s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000005s : 4: substitution.remove_not_recompute_node 2.17% : 0.000004s : 2: substitution.replace_old_param 6.52% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097693 2 97.46% : 0.095215s : 1: type_inference.infer 2.54% : 0.002478s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.98% : 0.000042s : 4: replace.inline 33.02% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 93.21% : 0.000135s : 4: match.inline 6.79% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.28% : 0.000002s : 12: predicate.accumulaten_eliminater 1.25% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.72% : 0.000002s : 12: predicate.arithmetic_simplify 1.37% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.16% : 0.000001s : 12: predicate.compare_switch_simplify 1.33% : 0.000002s : 12: predicate.depend_value_elim 1.17% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.11% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.08% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.42% : 0.000001s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.29% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.16% : 0.000006s : 26: predicate.inline 0.99% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.95% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.83% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.67% : 0.000002s : 12: predicate.reduce_eliminate 1.41% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.14% : 0.000003s : 22: predicate.replace_applicator 0.84% : 0.000001s : 8: predicate.replace_old_param 0.37% : 0.000000s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.17% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.53% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.36% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.93% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.40% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.54% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.91% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001861 22 66.30% : 0.001233s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.42% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.29% : 0.000601s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109581 72 0.04% : 0.000044s : 1: add_recomputation 0.06% : 0.000062s : 1: auto_monad 0.01% : 0.000016s : 1: auto_monad_reorder 0.23% : 0.000249s : 1: bootstrap 0.02% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.61% : 0.006145s : 1: jit_opt_a 0.13% : 0.000144s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000403s : 1: loop_unroll 0.41% : 0.000453s : 1: mutable_eliminate 0.77% : 0.000841s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000443s : 1: opt_after_jit_grad 0.02% : 0.000027s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000416s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.30% : 0.001430s : 1: renormalize.infer 0.54% : 0.000590s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.08% : 0.000083s : 1: rewriter_before_opt_a 0.07% : 0.000077s : 1: symbol_engine_optimizer 89.22% : 0.097763s : 1: type_inference TotalTime = 0.107156, [30] [bootstrap]: 0.00024266 [type_inference]: 0.0979677 [event_method]: 1.771e-05 [auto_monad]: 6.587e-05 [graph_reusing]: 5.59998e-06 [pre_auto_parallel]: 2.35002e-06 [py_interpret_to_execute]: 0.00042336 [rewriter_before_opt_a]: 8.035e-05 [expand_dump_flag]: 3.73999e-06 [jit_opt_a]: 0.00638611, [2] [Cycle 1]: 0.0030404, [27] [switch_simplify]: 5.042e-05 [loop_unroll]: 2.96e-05 [a_1]: 0.00051508 [with_stream_mark]: 1.532e-05 [recompute_prepare]: 7.98001e-06 [updatestate_depend_eliminate]: 3.6e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.86999e-06 [parameter_eliminate]: 1.72001e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 6.07001e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 5.82001e-06 [merge_forward]: 3.86999e-06 [cell_reuse_recompute_pass]: 9.09989e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.459e-05 [j_node_and_user_rematch]: 9.17999e-06 [meta_fg_expand]: 2.71e-06 [replace_old_param]: 9.20999e-06 [inline_without_move]: 5.88002e-06 [renormalize]: 0.00211572 [add_forward_monad_depend]: 4.82e-06 [auto_monad_grad]: 2.09999e-06 [auto_monad_eliminator]: 1.546e-05 [cse]: 2.75e-05 [replace_applicator]: 1.23e-05 [Cycle 2]: 0.00034359, [27] [switch_simplify]: 6.57002e-06 [loop_unroll]: 5.53002e-06 [a_1]: 0.00011597 [with_stream_mark]: 8.30999e-06 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 2.81999e-06 [updatestate_assign_eliminate]: 2.32001e-06 [updatestate_loads_eliminate]: 1.89e-06 [parameter_eliminate]: 1.10999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.76e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 5.22e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.07e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.306e-05 [j_node_and_user_rematch]: 8.46002e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 7.83999e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.67999e-06 [cse]: 1.058e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 7.39002e-06 [rewriter_after_opt_a]: 3.018e-05 [convert_after_rewriter]: 6.04999e-06 [order_py_execute_after_rewriter]: 5.35001e-06 [mutable_eliminate]: 0.00046501 [jit_opt_b]: 5.07e-05, [1] [Cycle 1]: 4.5e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.691e-05 [cconv]: 2.307e-05 [loop_unroll]: 0.00039718 [jit_opt_after_cconv]: 0.00014039, [1] [Cycle 1]: 0.00013422, [11] [c_1]: 2.425e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.11002e-06 [updatestate_assign_eliminate]: 2.38998e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.806e-05 [call_graph_tuple_transform]: 1.908e-05 [tuple_list_get_item_eliminator]: 6.02999e-06 [none_parameter_eliminate]: 1.77001e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.71e-06 [remove_dup_value]: 1.508e-05 [partial_unused_args_eliminate]: 2.21e-06 [environ_conv]: 7.55e-06 [add_recomputation]: 4.566e-05 [cse_after_recomputation]: 2.026e-05, [1] [Cycle 1]: 1.527e-05, [1] [cse]: 1.005e-05 [auto_monad_reorder]: 1.424e-05 [get_jit_bprop_graph]: 1.42999e-06 [rewriter_after_jit_bprop_graph]: 4.13001e-06 [opt_after_jit_grad]: 0.00044621 [symbol_engine_optimizer]: 8.5e-05, [1] [Cycle 1]: 7.907e-05, [6] [build]: 3.2e-06 [elim_shapecalc]: 8.14002e-06 [elim_not_effective]: 2.476e-05 [opt_reshape]: 6.82002e-06 [fold_const_symbol]: 9.04e-06 [renormalize]: 3.19997e-07 [validate]: 3.707e-05 Sums bootstrap : 0.000243s : 0.23% type_inference : 0.097968s : 94.55% event_method : 0.000018s : 0.02% auto_monad : 0.000066s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000423s : 0.41% rewriter_before_opt_a : 0.000080s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000035s : 0.03% jit_opt_a.a_1 : 0.000631s : 0.61% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002116s : 2.04% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000038s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000007s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000465s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000397s : 0.38% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000014s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000025s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.04% Time group info: ------[substitution.] 0.000172 24 1.10% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000001s : 2: substitution.fold_const_symbol 3.22% : 0.000006s : 4: substitution.graph_param_transform 81.19% : 0.000139s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.84% : 0.000005s : 4: substitution.remove_not_recompute_node 2.27% : 0.000004s : 2: substitution.replace_old_param 6.95% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097902 2 97.32% : 0.095274s : 1: type_inference.infer 2.68% : 0.002628s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.30% : 0.000042s : 4: replace.inline 33.70% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000148 6 92.70% : 0.000137s : 4: match.inline 7.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.23% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.21% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.73% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.55% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000007s : 26: predicate.inline 0.96% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.27% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.29% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.77% : 0.000002s : 4: predicate.mutable_eliminate 0.59% : 0.000001s : 4: predicate.opt_reshape 2.36% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.82% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.66% : 0.000001s : 8: predicate.remove_not_recompute_node 2.23% : 0.000003s : 22: predicate.replace_applicator 0.88% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.77% : 0.000001s : 4: predicate.row_tensor_eliminate 1.27% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 58: predicate.switch_simplify 1.35% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.81% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.97% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.55% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001977 22 63.28% : 0.001251s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 35.35% : 0.000699s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.110206 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000069s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.23% : 0.000253s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.80% : 0.006389s : 1: jit_opt_a 0.13% : 0.000143s : 1: jit_opt_after_cconv 0.05% : 0.000053s : 1: jit_opt_b 0.37% : 0.000405s : 1: loop_unroll 0.43% : 0.000473s : 1: mutable_eliminate 0.77% : 0.000849s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.04% : 0.000046s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000428s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.29% : 0.001422s : 1: renormalize.infer 0.62% : 0.000686s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000033s : 1: rewriter_after_opt_a 0.08% : 0.000085s : 1: rewriter_before_opt_a 0.08% : 0.000087s : 1: symbol_engine_optimizer 88.91% : 0.097981s : 1: type_inference TotalTime = 0.0610633, [30] [bootstrap]: 0.00026174 [type_inference]: 0.0525048 [event_method]: 1.757e-05 [auto_monad]: 6.139e-05 [graph_reusing]: 5.77001e-06 [pre_auto_parallel]: 2.02999e-06 [py_interpret_to_execute]: 0.00024369 [rewriter_before_opt_a]: 7.662e-05 [expand_dump_flag]: 3.68999e-06 [jit_opt_a]: 0.0058381, [2] [Cycle 1]: 0.00261204, [27] [switch_simplify]: 4.873e-05 [loop_unroll]: 2.982e-05 [a_1]: 0.00054961 [with_stream_mark]: 1.324e-05 [recompute_prepare]: 7.7e-06 [updatestate_depend_eliminate]: 3.50998e-06 [updatestate_assign_eliminate]: 3.58999e-06 [updatestate_loads_eliminate]: 2.57001e-06 [parameter_eliminate]: 1.49e-06 [specialize_transform]: 6.58e-06 [updatestate_useless_node_eliminater]: 5.99e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 2.19001e-06 [get_grad_eliminate_]: 6.31e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 1.22999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.399e-05 [j_node_and_user_rematch]: 9.64e-06 [meta_fg_expand]: 2.22999e-06 [replace_old_param]: 9.05001e-06 [inline_without_move]: 6.34001e-06 [renormalize]: 0.00166442 [add_forward_monad_depend]: 4.84998e-06 [auto_monad_grad]: 1.50999e-06 [auto_monad_eliminator]: 1.36e-05 [cse]: 2.495e-05 [replace_applicator]: 1.234e-05 [Cycle 2]: 0.00034154, [27] [switch_simplify]: 6.49999e-06 [loop_unroll]: 5.58002e-06 [a_1]: 0.00011594 [with_stream_mark]: 8.22998e-06 [recompute_prepare]: 5.86003e-06 [updatestate_depend_eliminate]: 2.60997e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.94999e-06 [parameter_eliminate]: 7.80012e-07 [specialize_transform]: 5.47999e-06 [updatestate_useless_node_eliminater]: 5.54e-06 [accelerated_algorithm]: 5.30001e-06 [meta_shard_fg_expand]: 1.15001e-06 [get_grad_eliminate_]: 5.14998e-06 [merge_forward]: 2.44001e-06 [cell_reuse_recompute_pass]: 1.23002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.279e-05 [j_node_and_user_rematch]: 8.32e-06 [meta_fg_expand]: 1.52999e-06 [replace_old_param]: 7.83001e-06 [inline_without_move]: 5.57999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04e-06 [auto_monad_grad]: 7.10017e-07 [auto_monad_eliminator]: 5.78002e-06 [cse]: 1.048e-05 [replace_applicator]: 5.80002e-06 [py_interpret_to_execute_after_opt_a]: 7.58001e-06 [rewriter_after_opt_a]: 2.975e-05 [convert_after_rewriter]: 6.24999e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00045274 [jit_opt_b]: 5.194e-05, [1] [Cycle 1]: 4.613e-05, [2] [frontend_op_eliminate]: 1.805e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.226e-05 [loop_unroll]: 0.00039987 [jit_opt_after_cconv]: 0.00014188, [1] [Cycle 1]: 0.000136, [11] [c_1]: 2.491e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.45001e-06 [updatestate_assign_eliminate]: 2.39001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.781e-05 [call_graph_tuple_transform]: 1.945e-05 [tuple_list_get_item_eliminator]: 6.23998e-06 [none_parameter_eliminate]: 1.17999e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.31e-06 [remove_dup_value]: 1.456e-05 [partial_unused_args_eliminate]: 2.01998e-06 [environ_conv]: 7.8e-06 [add_recomputation]: 4.139e-05 [cse_after_recomputation]: 2.053e-05, [1] [Cycle 1]: 1.569e-05, [1] [cse]: 1.003e-05 [auto_monad_reorder]: 1.405e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 4.15999e-06 [opt_after_jit_grad]: 0.00050997 [symbol_engine_optimizer]: 0.00012024, [1] [Cycle 1]: 0.00011416, [6] [build]: 3.35998e-06 [elim_shapecalc]: 8.02998e-06 [elim_not_effective]: 5.793e-05 [opt_reshape]: 6.72002e-06 [fold_const_symbol]: 1.017e-05 [renormalize]: 2.69996e-07 [validate]: 3.802e-05 Sums bootstrap : 0.000262s : 0.45% type_inference : 0.052505s : 91.08% event_method : 0.000018s : 0.03% auto_monad : 0.000061s : 0.11% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000244s : 0.42% rewriter_before_opt_a : 0.000077s : 0.13% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000055s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.06% jit_opt_a.a_1 : 0.000666s : 1.15% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001665s : 2.89% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.03% jit_opt_a.cse : 0.000035s : 0.06% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000030s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000453s : 0.79% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000022s : 0.04% loop_unroll : 0.000400s : 0.69% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000041s : 0.07% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000510s : 0.88% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000058s : 0.10% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.07% Time group info: ------[substitution.] 0.000208 24 22.28% : 0.000046s : 2: substitution.elim_not_effective 0.77% : 0.000002s : 2: substitution.fold_const_symbol 2.67% : 0.000006s : 4: substitution.graph_param_transform 63.58% : 0.000132s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.05% : 0.000004s : 4: substitution.remove_not_recompute_node 1.78% : 0.000004s : 2: substitution.replace_old_param 5.46% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.052442 2 96.78% : 0.050754s : 1: type_inference.infer 3.22% : 0.001688s : 1: type_inference.specialize ------[replace.] 0.000060 6 66.71% : 0.000040s : 4: replace.inline 33.29% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000140 6 92.69% : 0.000130s : 4: match.inline 7.31% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.39% : 0.000002s : 12: predicate.accumulaten_eliminater 1.19% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.14% : 0.000001s : 12: predicate.addn_check_dump 1.16% : 0.000001s : 12: predicate.addn_zero_filter 1.77% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.62% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.30% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.18% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.17% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.09% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.20% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.47% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 8: predicate.less_batch_normalization 1.39% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.43% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.08% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.02% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.17% : 0.000001s : 12: predicate.merge_addn 1.20% : 0.000001s : 12: predicate.minmaximum_grad 1.64% : 0.000002s : 4: predicate.mutable_eliminate 0.60% : 0.000001s : 4: predicate.opt_reshape 2.43% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000001s : 12: predicate.print_const_string_wrapper 1.60% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.04% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.35% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.17% : 0.000001s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.34% : 0.000002s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.29% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.38% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.24% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.18% : 0.000001s : 12: predicate.transpose_eliminate 1.36% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.24% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.74% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.84% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.03% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.68% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002277 30 75.09% : 0.001710s : 23: func_graph_cloner_run.FuncGraphClonerGraph 1.17% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 23.74% : 0.000541s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.063731 72 0.07% : 0.000044s : 1: add_recomputation 0.10% : 0.000065s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.43% : 0.000276s : 1: bootstrap 0.04% : 0.000025s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.16% : 0.005841s : 1: jit_opt_a 0.23% : 0.000144s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.64% : 0.000407s : 1: loop_unroll 0.72% : 0.000460s : 1: mutable_eliminate 1.38% : 0.000881s : 26: opt.transform.jit_opt_a 0.08% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000030s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.13% : 0.000080s : 4: opt.transform.symbol_engine_opt 0.81% : 0.000518s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.39% : 0.000249s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000017s : 1: remove_dup_value 1.76% : 0.001121s : 1: renormalize.infer 0.84% : 0.000536s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000032s : 1: rewriter_after_opt_a 0.13% : 0.000081s : 1: rewriter_before_opt_a 0.19% : 0.000123s : 1: symbol_engine_optimizer 82.40% : 0.052517s : 1: type_inference TotalTime = 0.0571292, [30] [bootstrap]: 0.00025355 [type_inference]: 0.0486892 [event_method]: 1.696e-05 [auto_monad]: 6.554e-05 [graph_reusing]: 5.89e-06 [pre_auto_parallel]: 2.37001e-06 [py_interpret_to_execute]: 0.00023891 [rewriter_before_opt_a]: 7.866e-05 [expand_dump_flag]: 3.48999e-06 [jit_opt_a]: 0.0058224, [2] [Cycle 1]: 0.00249472, [27] [switch_simplify]: 4.957e-05 [loop_unroll]: 2.959e-05 [a_1]: 0.00052266 [with_stream_mark]: 1.419e-05 [recompute_prepare]: 8.42e-06 [updatestate_depend_eliminate]: 3.3e-06 [updatestate_assign_eliminate]: 3.01001e-06 [updatestate_loads_eliminate]: 3.23e-06 [parameter_eliminate]: 1.66002e-06 [specialize_transform]: 6.89999e-06 [updatestate_useless_node_eliminater]: 5.55001e-06 [accelerated_algorithm]: 6.14999e-06 [meta_shard_fg_expand]: 1.99999e-06 [get_grad_eliminate_]: 6.15002e-06 [merge_forward]: 3.59002e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.4e-05 [j_node_and_user_rematch]: 9.83998e-06 [meta_fg_expand]: 2.31998e-06 [replace_old_param]: 9.50001e-06 [inline_without_move]: 5.89e-06 [renormalize]: 0.00156737 [add_forward_monad_depend]: 5.62999e-06 [auto_monad_grad]: 1.89999e-06 [auto_monad_eliminator]: 1.426e-05 [cse]: 2.698e-05 [replace_applicator]: 1.197e-05 [Cycle 2]: 0.00034245, [27] [switch_simplify]: 6.73e-06 [loop_unroll]: 5.74e-06 [a_1]: 0.00011495 [with_stream_mark]: 8.60999e-06 [recompute_prepare]: 5.89e-06 [updatestate_depend_eliminate]: 2.69999e-06 [updatestate_assign_eliminate]: 2.11998e-06 [updatestate_loads_eliminate]: 1.94e-06 [parameter_eliminate]: 9.79984e-07 [specialize_transform]: 5.75001e-06 [updatestate_useless_node_eliminater]: 5.35001e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 5.12999e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.262e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 1.55001e-06 [replace_old_param]: 8e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.99979e-07 [auto_monad_grad]: 6.79982e-07 [auto_monad_eliminator]: 5.59998e-06 [cse]: 1.049e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 8.01001e-06 [rewriter_after_opt_a]: 2.991e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 4.85999e-06 [mutable_eliminate]: 0.00045383 [jit_opt_b]: 5.177e-05, [1] [Cycle 1]: 4.518e-05, [2] [frontend_op_eliminate]: 1.79e-05 [inline_after_opt_a]: 1.645e-05 [cconv]: 2.31e-05 [loop_unroll]: 0.00039691 [jit_opt_after_cconv]: 0.00014025, [1] [Cycle 1]: 0.00013382, [11] [c_1]: 2.46e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.37999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.96998e-06 [cse]: 1.784e-05 [call_graph_tuple_transform]: 1.94e-05 [tuple_list_get_item_eliminator]: 5.77001e-06 [none_parameter_eliminate]: 1.35001e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.77001e-06 [remove_dup_value]: 1.32e-05 [partial_unused_args_eliminate]: 2.13998e-06 [environ_conv]: 7.55003e-06 [add_recomputation]: 4.252e-05 [cse_after_recomputation]: 1.993e-05, [1] [Cycle 1]: 1.523e-05, [1] [cse]: 9.99001e-06 [auto_monad_reorder]: 1.436e-05 [get_jit_bprop_graph]: 1.44998e-06 [rewriter_after_jit_bprop_graph]: 3.94002e-06 [opt_after_jit_grad]: 0.00043936 [symbol_engine_optimizer]: 9.855e-05, [1] [Cycle 1]: 7.037e-05, [6] [build]: 3.45e-06 [elim_shapecalc]: 8.57998e-06 [elim_not_effective]: 1.363e-05 [opt_reshape]: 6.73e-06 [fold_const_symbol]: 9.25999e-06 [renormalize]: 3.39991e-07 [validate]: 3.832e-05 Sums bootstrap : 0.000254s : 0.47% type_inference : 0.048689s : 90.86% event_method : 0.000017s : 0.03% auto_monad : 0.000066s : 0.12% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000239s : 0.45% rewriter_before_opt_a : 0.000079s : 0.15% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000056s : 0.11% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000638s : 1.19% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001567s : 2.93% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000037s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000454s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000023s : 0.04% loop_unroll : 0.000397s : 0.74% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000013s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000043s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000014s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000439s : 0.82% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.03% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.07% Time group info: ------[substitution.] 0.000175 24 1.05% : 0.000002s : 2: substitution.elim_not_effective 0.95% : 0.000002s : 2: substitution.fold_const_symbol 3.05% : 0.000005s : 4: substitution.graph_param_transform 82.24% : 0.000144s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000004s : 2: substitution.replace_old_param 6.20% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048623 2 96.56% : 0.046949s : 1: type_inference.infer 3.44% : 0.001675s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.47% : 0.000043s : 4: replace.inline 32.53% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 93.57% : 0.000141s : 4: match.inline 6.43% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.14% : 0.000001s : 12: predicate.accumulaten_eliminater 1.28% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.73% : 0.000002s : 12: predicate.arithmetic_simplify 1.27% : 0.000002s : 12: predicate.cast_eliminate 0.57% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.26% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.15% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.60% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 8: predicate.less_batch_normalization 1.45% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.41% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.81% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.97% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.47% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.42% : 0.000003s : 18: predicate.partial_eliminate 1.18% : 0.000001s : 12: predicate.print_const_string_wrapper 1.70% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 1.06% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.16% : 0.000001s : 12: predicate.reshape_eliminate 1.32% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.80% : 0.000001s : 4: predicate.row_tensor_eliminate 1.24% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.09% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.25% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.30% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.19% : 0.000001s : 12: predicate.transpose_eliminate 1.46% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.21% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.75% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002012 26 71.39% : 0.001436s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.44% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 27.18% : 0.000547s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059624 72 0.08% : 0.000045s : 1: add_recomputation 0.12% : 0.000069s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.44% : 0.000265s : 1: bootstrap 0.04% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.02% : 0.000010s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.77% : 0.005825s : 1: jit_opt_a 0.24% : 0.000143s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.68% : 0.000405s : 1: loop_unroll 0.77% : 0.000461s : 1: mutable_eliminate 1.43% : 0.000855s : 26: opt.transform.jit_opt_a 0.09% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000022s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000448s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000244s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000015s : 1: remove_dup_value 1.72% : 0.001024s : 1: renormalize.infer 0.90% : 0.000537s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000033s : 1: rewriter_after_opt_a 0.14% : 0.000084s : 1: rewriter_before_opt_a 0.17% : 0.000101s : 1: symbol_engine_optimizer 81.68% : 0.048701s : 1: type_inference TotalTime = 0.0114347, [30] [bootstrap]: 0.00026474 [type_inference]: 0.00430341 [event_method]: 1.672e-05 [auto_monad]: 6.334e-05 [graph_reusing]: 5.19e-06 [pre_auto_parallel]: 2.30002e-06 [py_interpret_to_execute]: 3.27e-05 [rewriter_before_opt_a]: 6.911e-05 [expand_dump_flag]: 3.18e-06 [jit_opt_a]: 0.00470697, [2] [Cycle 1]: 0.00141234, [27] [switch_simplify]: 4.67e-05 [loop_unroll]: 2.917e-05 [a_1]: 0.00049204 [with_stream_mark]: 1.511e-05 [recompute_prepare]: 7.53e-06 [updatestate_depend_eliminate]: 3.23e-06 [updatestate_assign_eliminate]: 3.33998e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.05999e-06 [accelerated_algorithm]: 5.37001e-06 [meta_shard_fg_expand]: 2.14e-06 [get_grad_eliminate_]: 5.32999e-06 [merge_forward]: 3.50998e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.289e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 2.37001e-06 [replace_old_param]: 8.46002e-06 [inline_without_move]: 5.09e-06 [renormalize]: 0.00053593 [add_forward_monad_depend]: 4.65001e-06 [auto_monad_grad]: 2.05002e-06 [auto_monad_eliminator]: 1.288e-05 [cse]: 2.143e-05 [replace_applicator]: 1.091e-05 [Cycle 2]: 0.00030366, [27] [switch_simplify]: 5.34e-06 [loop_unroll]: 4.72998e-06 [a_1]: 8.732e-05 [with_stream_mark]: 8.03001e-06 [recompute_prepare]: 4.79998e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 4.77998e-06 [updatestate_useless_node_eliminater]: 4.70999e-06 [accelerated_algorithm]: 4.63001e-06 [meta_shard_fg_expand]: 1.04998e-06 [get_grad_eliminate_]: 4.48999e-06 [merge_forward]: 2.32001e-06 [cell_reuse_recompute_pass]: 1.19998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.18e-05 [j_node_and_user_rematch]: 7.56001e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7e-06 [inline_without_move]: 4.55001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 8.50006e-07 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.31002e-06 [cse]: 1.014e-05 [replace_applicator]: 4.77e-06 [py_interpret_to_execute_after_opt_a]: 8.62998e-06 [rewriter_after_opt_a]: 2.91e-05 [convert_after_rewriter]: 6.86001e-06 [order_py_execute_after_rewriter]: 5.17999e-06 [mutable_eliminate]: 0.00048924 [jit_opt_b]: 4.803e-05, [1] [Cycle 1]: 4.147e-05, [2] [frontend_op_eliminate]: 1.525e-05 [inline_after_opt_a]: 1.508e-05 [cconv]: 2.611e-05 [loop_unroll]: 0.00040592 [jit_opt_after_cconv]: 0.00013605, [1] [Cycle 1]: 0.00013014, [11] [c_1]: 2.013e-05 [parameter_eliminate]: 2.52001e-06 [updatestate_depend_eliminate]: 5.91998e-06 [updatestate_assign_eliminate]: 2.85002e-06 [updatestate_loads_eliminate]: 2.49999e-06 [cse]: 1.907e-05 [call_graph_tuple_transform]: 1.771e-05 [tuple_list_get_item_eliminator]: 5.08002e-06 [none_parameter_eliminate]: 1.19998e-06 [renormalize]: 3.20026e-07 [switch_simplify]: 4.95001e-06 [remove_dup_value]: 1.284e-05 [partial_unused_args_eliminate]: 1.85001e-06 [environ_conv]: 5.12e-06 [add_recomputation]: 4.605e-05 [cse_after_recomputation]: 2.227e-05, [1] [Cycle 1]: 1.697e-05, [1] [cse]: 1.114e-05 [auto_monad_reorder]: 1.537e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.52998e-06 [opt_after_jit_grad]: 0.00044767 [symbol_engine_optimizer]: 6.865e-05, [1] [Cycle 1]: 6.323e-05, [6] [build]: 2.84999e-06 [elim_shapecalc]: 7.35e-06 [elim_not_effective]: 1.212e-05 [opt_reshape]: 5.64998e-06 [fold_const_symbol]: 8.32e-06 [renormalize]: 3.10014e-07 [validate]: 3.048e-05 Sums bootstrap : 0.000265s : 3.35% type_inference : 0.004303s : 54.42% event_method : 0.000017s : 0.21% auto_monad : 0.000063s : 0.80% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000033s : 0.41% rewriter_before_opt_a : 0.000069s : 0.87% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000052s : 0.66% jit_opt_a.loop_unroll : 0.000034s : 0.43% jit_opt_a.a_1 : 0.000579s : 7.33% jit_opt_a.with_stream_mark : 0.000023s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000536s : 6.78% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.23% jit_opt_a.cse : 0.000032s : 0.40% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000009s : 0.11% rewriter_after_opt_a : 0.000029s : 0.37% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000489s : 6.19% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000026s : 0.33% loop_unroll : 0.000406s : 5.13% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000013s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000046s : 0.58% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000448s : 5.66% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.39% Time group info: ------[substitution.] 0.000176 23 1.13% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000001s : 2: substitution.fold_const_symbol 2.66% : 0.000005s : 3: substitution.graph_param_transform 82.15% : 0.000145s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.65% : 0.000005s : 4: substitution.remove_not_recompute_node 2.19% : 0.000004s : 2: substitution.replace_old_param 6.84% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004252 2 81.46% : 0.003464s : 1: type_inference.infer 18.54% : 0.000788s : 1: type_inference.specialize ------[replace.] 0.000063 6 65.02% : 0.000041s : 4: replace.inline 34.98% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000153 6 92.80% : 0.000142s : 4: match.inline 7.20% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000113 691 1.26% : 0.000001s : 10: predicate.accumulaten_eliminater 1.11% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 10: predicate.addn_check_dump 1.22% : 0.000001s : 10: predicate.addn_zero_filter 1.93% : 0.000002s : 10: predicate.arithmetic_simplify 1.46% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.22% : 0.000001s : 10: predicate.depend_value_elim 1.11% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.20% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.06% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.64% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.09% : 0.000001s : 10: predicate.environ_get_depend_swap 1.24% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.96% : 0.000001s : 6: predicate.get_grad_eliminate 0.26% : 0.000000s : 3: predicate.graph_param_transform 5.41% : 0.000006s : 22: predicate.inline 0.90% : 0.000001s : 6: predicate.inline_without_move 0.37% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.21% : 0.000001s : 6: predicate.less_batch_normalization 1.38% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.91% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.39% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.92% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 2.03% : 0.000002s : 3: predicate.mutable_eliminate 0.55% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.44% : 0.000002s : 10: predicate.print_const_string_wrapper 1.61% : 0.000002s : 10: predicate.reduce_eliminate 1.59% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.82% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.22% : 0.000001s : 10: predicate.reshape_eliminate 1.38% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.56% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 0.97% : 0.000001s : 6: predicate.specialize_transform 1.69% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.17% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.69% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.62% : 0.000009s : 53: predicate.switch_simplify 1.16% : 0.000001s : 10: predicate.tile_eliminate 1.23% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.98% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.50% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.69% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000560 13 51.25% : 0.000287s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.03% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.72% : 0.000245s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012810 72 0.38% : 0.000049s : 1: add_recomputation 0.52% : 0.000066s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.18% : 0.000279s : 1: bootstrap 0.22% : 0.000029s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.14% : 0.000018s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 36.77% : 0.004710s : 1: jit_opt_a 1.08% : 0.000139s : 1: jit_opt_after_cconv 0.39% : 0.000051s : 1: jit_opt_b 3.23% : 0.000413s : 1: loop_unroll 3.88% : 0.000497s : 1: mutable_eliminate 6.05% : 0.000774s : 26: opt.transform.jit_opt_a 0.35% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000011s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.55% : 0.000455s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.28% : 0.000035s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000015s : 1: remove_dup_value 2.15% : 0.000275s : 1: renormalize.infer 1.98% : 0.000254s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000032s : 1: rewriter_after_opt_a 0.56% : 0.000072s : 1: rewriter_before_opt_a 0.55% : 0.000071s : 1: symbol_engine_optimizer 33.67% : 0.004314s : 1: type_inference TotalTime = 0.0117184, [30] [bootstrap]: 0.00023544 [type_inference]: 0.00449933 [event_method]: 1.689e-05 [auto_monad]: 0.00012466 [graph_reusing]: 5.47001e-06 [pre_auto_parallel]: 2.10002e-06 [py_interpret_to_execute]: 3.767e-05 [rewriter_before_opt_a]: 7.222e-05 [expand_dump_flag]: 2.94001e-06 [jit_opt_a]: 0.00477714, [2] [Cycle 1]: 0.00149357, [27] [switch_simplify]: 4.894e-05 [loop_unroll]: 2.935e-05 [a_1]: 0.00048433 [with_stream_mark]: 1.338e-05 [recompute_prepare]: 7.15998e-06 [updatestate_depend_eliminate]: 3.70998e-06 [updatestate_assign_eliminate]: 2.99999e-06 [updatestate_loads_eliminate]: 2.98e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 5.96998e-06 [updatestate_useless_node_eliminater]: 5.20001e-06 [accelerated_algorithm]: 5.99999e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 3.30998e-06 [cell_reuse_recompute_pass]: 9.80013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.287e-05 [j_node_and_user_rematch]: 8.74e-06 [meta_fg_expand]: 2.24999e-06 [replace_old_param]: 7.97998e-06 [inline_without_move]: 5.31998e-06 [renormalize]: 0.00062431 [add_forward_monad_depend]: 5.25999e-06 [auto_monad_grad]: 1.71998e-06 [auto_monad_eliminator]: 1.322e-05 [cse]: 2.571e-05 [replace_applicator]: 1.1e-05 [Cycle 2]: 0.00030554, [27] [switch_simplify]: 5.99e-06 [loop_unroll]: 4.80999e-06 [a_1]: 9.058e-05 [with_stream_mark]: 7.65e-06 [recompute_prepare]: 4.79e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 1.99e-06 [parameter_eliminate]: 1.07e-06 [specialize_transform]: 4.92e-06 [updatestate_useless_node_eliminater]: 4.74e-06 [accelerated_algorithm]: 4.53999e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 4.42998e-06 [merge_forward]: 2.40002e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.183e-05 [j_node_and_user_rematch]: 7.26001e-06 [meta_fg_expand]: 1.49e-06 [replace_old_param]: 7.16001e-06 [inline_without_move]: 4.58001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 5.59987e-07 [auto_monad_eliminator]: 5.51e-06 [cse]: 1.025e-05 [replace_applicator]: 4.94e-06 [py_interpret_to_execute_after_opt_a]: 8.19002e-06 [rewriter_after_opt_a]: 2.97e-05 [convert_after_rewriter]: 6.83e-06 [order_py_execute_after_rewriter]: 5.10001e-06 [mutable_eliminate]: 0.00046919 [jit_opt_b]: 4.884e-05, [1] [Cycle 1]: 4.204e-05, [2] [frontend_op_eliminate]: 1.553e-05 [inline_after_opt_a]: 1.588e-05 [cconv]: 2.268e-05 [loop_unroll]: 0.00040822 [jit_opt_after_cconv]: 0.00013165, [1] [Cycle 1]: 0.00012576, [11] [c_1]: 2.024e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 5.38002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.14999e-06 [cse]: 1.807e-05 [call_graph_tuple_transform]: 1.719e-05 [tuple_list_get_item_eliminator]: 5.29e-06 [none_parameter_eliminate]: 1.49e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 4.97e-06 [remove_dup_value]: 1.351e-05 [partial_unused_args_eliminate]: 1.97999e-06 [environ_conv]: 1.851e-05 [add_recomputation]: 4.39e-05 [cse_after_recomputation]: 2.257e-05, [1] [Cycle 1]: 1.704e-05, [1] [cse]: 1.123e-05 [auto_monad_reorder]: 1.433e-05 [get_jit_bprop_graph]: 1.48002e-06 [rewriter_after_jit_bprop_graph]: 4.68999e-06 [opt_after_jit_grad]: 0.0004488 [symbol_engine_optimizer]: 6.836e-05, [1] [Cycle 1]: 6.264e-05, [6] [build]: 2.78e-06 [elim_shapecalc]: 7.43e-06 [elim_not_effective]: 1.249e-05 [opt_reshape]: 5.27001e-06 [fold_const_symbol]: 8.50999e-06 [renormalize]: 2.50002e-07 [validate]: 2.958e-05 Sums bootstrap : 0.000235s : 2.86% type_inference : 0.004499s : 54.71% event_method : 0.000017s : 0.21% auto_monad : 0.000125s : 1.52% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000038s : 0.46% rewriter_before_opt_a : 0.000072s : 0.88% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.67% jit_opt_a.loop_unroll : 0.000034s : 0.42% jit_opt_a.a_1 : 0.000575s : 6.99% jit_opt_a.with_stream_mark : 0.000021s : 0.26% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000011s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.02% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.30% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.19% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.18% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000624s : 7.59% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.23% jit_opt_a.cse : 0.000036s : 0.44% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000030s : 0.36% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000469s : 5.71% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.19% jit_opt_b.inline_after_opt_a : 0.000016s : 0.19% cconv : 0.000023s : 0.28% loop_unroll : 0.000408s : 4.96% jit_opt_after_cconv.c_1 : 0.000020s : 0.25% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.21% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.16% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000019s : 0.23% add_recomputation : 0.000044s : 0.53% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000014s : 0.17% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000449s : 5.46% symbol_engine_optimizer.build : 0.000003s : 0.03% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.36% Time group info: ------[substitution.] 0.000166 23 1.11% : 0.000002s : 2: substitution.elim_not_effective 0.84% : 0.000001s : 2: substitution.fold_const_symbol 2.67% : 0.000004s : 3: substitution.graph_param_transform 82.06% : 0.000136s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.67% : 0.000004s : 4: substitution.remove_not_recompute_node 2.00% : 0.000003s : 2: substitution.replace_old_param 7.14% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004448 2 78.76% : 0.003503s : 1: type_inference.infer 21.24% : 0.000944s : 1: type_inference.specialize ------[replace.] 0.000062 6 67.31% : 0.000042s : 4: replace.inline 32.69% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000144 6 92.51% : 0.000134s : 4: match.inline 7.49% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.40% : 0.000002s : 10: predicate.accumulaten_eliminater 1.19% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.10% : 0.000001s : 10: predicate.addn_check_dump 1.19% : 0.000001s : 10: predicate.addn_zero_filter 1.92% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.21% : 0.000001s : 10: predicate.compare_switch_simplify 1.13% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.39% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.32% : 0.000000s : 3: predicate.elim_not_effective 0.57% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.58% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 1.05% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.32% : 0.000006s : 22: predicate.inline 0.93% : 0.000001s : 6: predicate.inline_without_move 0.45% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.30% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.33% : 0.000001s : 3: predicate.loop_unroll_after_grad 3.98% : 0.000004s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.30% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.72% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.74% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 6: predicate.remove_not_recompute_node 1.94% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.24% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.57% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.08% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.43% : 0.000003s : 16: predicate.switch_defer_inline 2.18% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.71% : 0.000009s : 53: predicate.switch_simplify 1.30% : 0.000001s : 10: predicate.tile_eliminate 1.19% : 0.000001s : 10: predicate.transpose_eliminate 1.42% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.04% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.96% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 10: predicate.value_based_eliminate 0.36% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000609 13 48.41% : 0.000295s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.09% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 47.51% : 0.000289s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013183 72 0.36% : 0.000047s : 1: add_recomputation 0.97% : 0.000128s : 1: auto_monad 0.13% : 0.000017s : 1: auto_monad_reorder 1.87% : 0.000247s : 1: bootstrap 0.19% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000025s : 1: cse_after_recomputation 0.16% : 0.000021s : 1: environ_conv 0.15% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.26% : 0.004780s : 1: jit_opt_a 1.02% : 0.000134s : 1: jit_opt_after_cconv 0.39% : 0.000051s : 1: jit_opt_b 3.15% : 0.000416s : 1: loop_unroll 3.62% : 0.000477s : 1: mutable_eliminate 5.86% : 0.000773s : 26: opt.transform.jit_opt_a 0.34% : 0.000045s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.15% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.46% : 0.000456s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000041s : 1: py_interpret_to_execute 0.08% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.62% : 0.000345s : 1: renormalize.infer 2.06% : 0.000272s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000033s : 1: rewriter_after_opt_a 0.57% : 0.000075s : 1: rewriter_before_opt_a 0.54% : 0.000071s : 1: symbol_engine_optimizer 34.21% : 0.004510s : 1: type_inference TotalTime = 0.105831, [30] [bootstrap]: 0.00024983 [type_inference]: 0.0967675 [event_method]: 1.709e-05 [auto_monad]: 4.388e-05 [graph_reusing]: 3.49001e-06 [pre_auto_parallel]: 1.72001e-06 [py_interpret_to_execute]: 0.0003818 [rewriter_before_opt_a]: 9.252e-05 [expand_dump_flag]: 2.53003e-06 [jit_opt_a]: 0.00631802, [2] [Cycle 1]: 0.0028973, [27] [switch_simplify]: 4.863e-05 [loop_unroll]: 3.441e-05 [a_1]: 0.00052004 [with_stream_mark]: 1.209e-05 [recompute_prepare]: 8.87999e-06 [updatestate_depend_eliminate]: 3.41999e-06 [updatestate_assign_eliminate]: 2.54001e-06 [updatestate_loads_eliminate]: 2.29999e-06 [parameter_eliminate]: 1.02e-06 [specialize_transform]: 7.38e-06 [updatestate_useless_node_eliminater]: 7.02002e-06 [accelerated_algorithm]: 6.89001e-06 [meta_shard_fg_expand]: 1.27e-06 [get_grad_eliminate_]: 6.56999e-06 [merge_forward]: 2.74001e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.339e-05 [j_node_and_user_rematch]: 1.02e-05 [meta_fg_expand]: 1.92999e-06 [replace_old_param]: 9.37999e-06 [inline_without_move]: 6.59001e-06 [renormalize]: 0.0019725 [add_forward_monad_depend]: 4.33001e-06 [auto_monad_grad]: 1.37e-06 [auto_monad_eliminator]: 1.125e-05 [cse]: 1.893e-05 [replace_applicator]: 1.231e-05 [Cycle 2]: 0.00034728, [27] [switch_simplify]: 6.58998e-06 [loop_unroll]: 6.23e-06 [a_1]: 0.00011672 [with_stream_mark]: 9.07001e-06 [recompute_prepare]: 6.30002e-06 [updatestate_depend_eliminate]: 2.84001e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 9.10019e-07 [specialize_transform]: 5.89e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 5.46998e-06 [meta_shard_fg_expand]: 1.07e-06 [get_grad_eliminate_]: 5.21002e-06 [merge_forward]: 2.41998e-06 [cell_reuse_recompute_pass]: 1.30999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.185e-05 [j_node_and_user_rematch]: 8.28999e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 8.15e-06 [inline_without_move]: 5.32999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.04998e-06 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.40001e-06 [cse]: 1.063e-05 [replace_applicator]: 5.61e-06 [py_interpret_to_execute_after_opt_a]: 7.98999e-06 [rewriter_after_opt_a]: 2.503e-05 [convert_after_rewriter]: 5.29e-06 [order_py_execute_after_rewriter]: 3.76001e-06 [mutable_eliminate]: 0.00047053 [jit_opt_b]: 5.235e-05, [1] [Cycle 1]: 4.627e-05, [2] [frontend_op_eliminate]: 1.909e-05 [inline_after_opt_a]: 1.685e-05 [cconv]: 1.422e-05 [loop_unroll]: 0.00040425 [jit_opt_after_cconv]: 0.00014835, [1] [Cycle 1]: 0.00014215, [11] [c_1]: 2.501e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.40999e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.16e-06 [cse]: 2.061e-05 [call_graph_tuple_transform]: 1.962e-05 [tuple_list_get_item_eliminator]: 6.73e-06 [none_parameter_eliminate]: 9.70002e-07 [renormalize]: 3.69997e-07 [switch_simplify]: 5.83002e-06 [remove_dup_value]: 8.23001e-06 [partial_unused_args_eliminate]: 1.23002e-06 [environ_conv]: 5.96998e-06 [add_recomputation]: 3.194e-05 [cse_after_recomputation]: 2.052e-05, [1] [Cycle 1]: 1.548e-05, [1] [cse]: 1.032e-05 [auto_monad_reorder]: 8.85999e-06 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.1e-06 [opt_after_jit_grad]: 0.00047814 [symbol_engine_optimizer]: 7.256e-05, [1] [Cycle 1]: 6.701e-05, [6] [build]: 2.50002e-06 [elim_shapecalc]: 7.67002e-06 [elim_not_effective]: 1.389e-05 [opt_reshape]: 5.88998e-06 [fold_const_symbol]: 9.64e-06 [renormalize]: 3.39991e-07 [validate]: 3.067e-05 Sums bootstrap : 0.000250s : 0.24% type_inference : 0.096767s : 94.68% event_method : 0.000017s : 0.02% auto_monad : 0.000044s : 0.04% graph_reusing : 0.000003s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000382s : 0.37% rewriter_before_opt_a : 0.000093s : 0.09% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000041s : 0.04% jit_opt_a.a_1 : 0.000637s : 0.62% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001973s : 1.93% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000025s : 0.02% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000471s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000014s : 0.01% loop_unroll : 0.000404s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000021s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000032s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000009s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000478s : 0.47% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.03% Time group info: ------[substitution.] 0.000150 24 1.91% : 0.000003s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 2.64% : 0.000004s : 4: substitution.graph_param_transform 82.55% : 0.000124s : 4: substitution.inline 1.84% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.27% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000003s : 2: substitution.replace_old_param 4.88% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.096712 2 97.64% : 0.094432s : 1: type_inference.infer 2.36% : 0.002280s : 1: type_inference.specialize ------[replace.] 0.000061 6 67.74% : 0.000041s : 4: replace.inline 32.26% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000128 6 95.14% : 0.000122s : 4: match.inline 4.86% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000133 830 1.14% : 0.000002s : 12: predicate.accumulaten_eliminater 1.11% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.67% : 0.000002s : 12: predicate.arithmetic_simplify 1.35% : 0.000002s : 12: predicate.cast_eliminate 0.44% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.20% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.25% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.50% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.17% : 0.000002s : 12: predicate.environ_get_depend_swap 1.28% : 0.000002s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.07% : 0.000001s : 8: predicate.get_grad_eliminate 0.36% : 0.000000s : 4: predicate.graph_param_transform 4.98% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.34% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000003s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.45% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.93% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000002s : 12: predicate.merge_addn 1.11% : 0.000001s : 12: predicate.minmaximum_grad 1.46% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.47% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.62% : 0.000001s : 8: predicate.replace_old_param 0.36% : 0.000000s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.73% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.25% : 0.000002s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.73% : 0.000004s : 18: predicate.switch_defer_inline 2.18% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.50% : 0.000010s : 58: predicate.switch_simplify 1.34% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.43% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.77% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.34% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.31% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.56% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001836 22 65.98% : 0.001211s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.50% : 0.000028s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.53% : 0.000597s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.108754 72 0.03% : 0.000035s : 1: add_recomputation 0.04% : 0.000047s : 1: auto_monad 0.01% : 0.000011s : 1: auto_monad_reorder 0.24% : 0.000265s : 1: bootstrap 0.02% : 0.000017s : 1: cconv 0.01% : 0.000007s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.81% : 0.006320s : 1: jit_opt_a 0.14% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.38% : 0.000412s : 1: loop_unroll 0.44% : 0.000479s : 1: mutable_eliminate 0.79% : 0.000864s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.45% : 0.000486s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.36% : 0.000387s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.27% : 0.001386s : 1: renormalize.infer 0.53% : 0.000580s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000028s : 1: rewriter_after_opt_a 0.09% : 0.000099s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 88.99% : 0.096780s : 1: type_inference TotalTime = 0.108201, [30] [bootstrap]: 0.00023521 [type_inference]: 0.0989594 [event_method]: 1.738e-05 [auto_monad]: 4.933e-05 [graph_reusing]: 4.01001e-06 [pre_auto_parallel]: 1.55001e-06 [py_interpret_to_execute]: 0.00042024 [rewriter_before_opt_a]: 7.722e-05 [expand_dump_flag]: 2.54001e-06 [jit_opt_a]: 0.00648008, [2] [Cycle 1]: 0.00315613, [27] [switch_simplify]: 4.423e-05 [loop_unroll]: 2.905e-05 [a_1]: 0.00049978 [with_stream_mark]: 1.154e-05 [recompute_prepare]: 8.1e-06 [updatestate_depend_eliminate]: 3.14999e-06 [updatestate_assign_eliminate]: 2.48e-06 [updatestate_loads_eliminate]: 2.19999e-06 [parameter_eliminate]: 1.17e-06 [specialize_transform]: 6.68998e-06 [updatestate_useless_node_eliminater]: 5.80002e-06 [accelerated_algorithm]: 6.01e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 6.11998e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.57999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.186e-05 [j_node_and_user_rematch]: 9.43002e-06 [meta_fg_expand]: 1.94e-06 [replace_old_param]: 8.66002e-06 [inline_without_move]: 5.73002e-06 [renormalize]: 0.00227366 [add_forward_monad_depend]: 5.24e-06 [auto_monad_grad]: 1.71e-06 [auto_monad_eliminator]: 1.308e-05 [cse]: 1.945e-05 [replace_applicator]: 1.232e-05 [Cycle 2]: 0.00034239, [27] [switch_simplify]: 6.34999e-06 [loop_unroll]: 5.44e-06 [a_1]: 0.00011699 [with_stream_mark]: 8.42e-06 [recompute_prepare]: 5.56e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.11e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 1.11002e-06 [specialize_transform]: 5.41002e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 1.02998e-06 [get_grad_eliminate_]: 5.06997e-06 [merge_forward]: 2.46e-06 [cell_reuse_recompute_pass]: 1.29998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.288e-05 [j_node_and_user_rematch]: 8.17e-06 [meta_fg_expand]: 1.47999e-06 [replace_old_param]: 7.82002e-06 [inline_without_move]: 5.33002e-06 [renormalize]: 5.9983e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 5.63002e-06 [cse]: 1.083e-05 [replace_applicator]: 5.87999e-06 [py_interpret_to_execute_after_opt_a]: 8.15999e-06 [rewriter_after_opt_a]: 2.939e-05 [convert_after_rewriter]: 5.90002e-06 [order_py_execute_after_rewriter]: 4.42e-06 [mutable_eliminate]: 0.00049959 [jit_opt_b]: 5.128e-05, [1] [Cycle 1]: 4.488e-05, [2] [frontend_op_eliminate]: 1.8e-05 [inline_after_opt_a]: 1.635e-05 [cconv]: 2.053e-05 [loop_unroll]: 0.00040438 [jit_opt_after_cconv]: 0.00014024, [1] [Cycle 1]: 0.00013405, [11] [c_1]: 2.458e-05 [parameter_eliminate]: 2.46e-06 [updatestate_depend_eliminate]: 5.09e-06 [updatestate_assign_eliminate]: 2.73998e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.769e-05 [call_graph_tuple_transform]: 1.938e-05 [tuple_list_get_item_eliminator]: 6.26e-06 [none_parameter_eliminate]: 1.09e-06 [renormalize]: 4.00003e-07 [switch_simplify]: 5.59e-06 [remove_dup_value]: 1.01e-05 [partial_unused_args_eliminate]: 1.69e-06 [environ_conv]: 7.29001e-06 [add_recomputation]: 3.405e-05 [cse_after_recomputation]: 2.083e-05, [1] [Cycle 1]: 1.603e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.164e-05 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 4.05e-06 [opt_after_jit_grad]: 0.00043904 [symbol_engine_optimizer]: 6.97e-05, [1] [Cycle 1]: 6.426e-05, [6] [build]: 3.04001e-06 [elim_shapecalc]: 7.9e-06 [elim_not_effective]: 1.278e-05 [opt_reshape]: 5.76e-06 [fold_const_symbol]: 8.63001e-06 [renormalize]: 4.00003e-07 [validate]: 3.226e-05 Sums bootstrap : 0.000235s : 0.22% type_inference : 0.098959s : 94.53% event_method : 0.000017s : 0.02% auto_monad : 0.000049s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000420s : 0.40% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.05% jit_opt_a.loop_unroll : 0.000034s : 0.03% jit_opt_a.a_1 : 0.000617s : 0.59% jit_opt_a.with_stream_mark : 0.000020s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000011s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002274s : 2.17% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000029s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.00% mutable_eliminate : 0.000500s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000016s : 0.02% cconv : 0.000021s : 0.02% loop_unroll : 0.000404s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000034s : 0.03% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000439s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.03% Time group info: ------[substitution.] 0.000156 24 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.35% : 0.000005s : 4: substitution.graph_param_transform 82.05% : 0.000128s : 4: substitution.inline 1.81% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.81% : 0.000004s : 4: substitution.remove_not_recompute_node 1.98% : 0.000003s : 2: substitution.replace_old_param 6.13% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098900 2 97.50% : 0.096424s : 1: type_inference.infer 2.50% : 0.002476s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.58% : 0.000041s : 4: replace.inline 33.42% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000134 6 93.73% : 0.000126s : 4: match.inline 6.27% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.44% : 0.000002s : 12: predicate.accumulaten_eliminater 1.37% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.17% : 0.000001s : 12: predicate.addn_zero_filter 1.80% : 0.000002s : 12: predicate.arithmetic_simplify 1.36% : 0.000002s : 12: predicate.cast_eliminate 0.65% : 0.000001s : 4: predicate.check_bprop_eliminate 1.09% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.18% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.13% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.12% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.32% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.08% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.20% : 0.000006s : 26: predicate.inline 1.04% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.20% : 0.000001s : 8: predicate.less_batch_normalization 1.79% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.25% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.13% : 0.000001s : 12: predicate.minmaximum_grad 1.83% : 0.000002s : 4: predicate.mutable_eliminate 0.46% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.21% : 0.000002s : 12: predicate.print_const_string_wrapper 1.54% : 0.000002s : 12: predicate.reduce_eliminate 1.51% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.72% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.85% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.35% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.28% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.04% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.67% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001986 22 66.51% : 0.001321s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.34% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.15% : 0.000638s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111381 72 0.03% : 0.000037s : 1: add_recomputation 0.05% : 0.000052s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.22% : 0.000246s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.82% : 0.006483s : 1: jit_opt_a 0.13% : 0.000143s : 1: jit_opt_after_cconv 0.05% : 0.000054s : 1: jit_opt_b 0.37% : 0.000412s : 1: loop_unroll 0.46% : 0.000509s : 1: mutable_eliminate 0.74% : 0.000826s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000447s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.38% : 0.000426s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000012s : 1: remove_dup_value 1.45% : 0.001613s : 1: renormalize.infer 0.59% : 0.000654s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000032s : 1: rewriter_after_opt_a 0.07% : 0.000083s : 1: rewriter_before_opt_a 0.06% : 0.000072s : 1: symbol_engine_optimizer 88.86% : 0.098972s : 1: type_inference TotalTime = 0.10874, [30] [bootstrap]: 0.00025289 [type_inference]: 0.0993174 [event_method]: 1.756e-05 [auto_monad]: 5.518e-05 [graph_reusing]: 4.92e-06 [pre_auto_parallel]: 2.06e-06 [py_interpret_to_execute]: 0.00039505 [rewriter_before_opt_a]: 7.525e-05 [expand_dump_flag]: 3.41001e-06 [jit_opt_a]: 0.0065577, [2] [Cycle 1]: 0.00316838, [27] [switch_simplify]: 4.79e-05 [loop_unroll]: 2.925e-05 [a_1]: 0.00056843 [with_stream_mark]: 1.47e-05 [recompute_prepare]: 8.62998e-06 [updatestate_depend_eliminate]: 3.45003e-06 [updatestate_assign_eliminate]: 3.26001e-06 [updatestate_loads_eliminate]: 2.75997e-06 [parameter_eliminate]: 1.59e-06 [specialize_transform]: 7.08e-06 [updatestate_useless_node_eliminater]: 6.41998e-06 [accelerated_algorithm]: 6.84999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 6.29999e-06 [merge_forward]: 3.2e-06 [cell_reuse_recompute_pass]: 1.25999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.439e-05 [j_node_and_user_rematch]: 1.036e-05 [meta_fg_expand]: 2.23002e-06 [replace_old_param]: 1.013e-05 [inline_without_move]: 6.56e-06 [renormalize]: 0.00218103 [add_forward_monad_depend]: 5.35999e-06 [auto_monad_grad]: 1.79e-06 [auto_monad_eliminator]: 1.536e-05 [cse]: 2.506e-05 [replace_applicator]: 1.461e-05 [Cycle 2]: 0.00037505, [27] [switch_simplify]: 7.21999e-06 [loop_unroll]: 6.83998e-06 [a_1]: 0.00013242 [with_stream_mark]: 8.95001e-06 [recompute_prepare]: 5.93002e-06 [updatestate_depend_eliminate]: 2.89001e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.16998e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.99999e-06 [updatestate_useless_node_eliminater]: 6.17001e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 1.13001e-06 [get_grad_eliminate_]: 5.86e-06 [merge_forward]: 2.61e-06 [cell_reuse_recompute_pass]: 1.83002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.447e-05 [j_node_and_user_rematch]: 9.29e-06 [meta_fg_expand]: 1.47999e-06 [replace_old_param]: 8.35999e-06 [inline_without_move]: 5.34e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.048e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 8.43999e-06 [rewriter_after_opt_a]: 2.768e-05 [convert_after_rewriter]: 5.76e-06 [order_py_execute_after_rewriter]: 4.57998e-06 [mutable_eliminate]: 0.00049928 [jit_opt_b]: 6.388e-05, [1] [Cycle 1]: 5.687e-05, [2] [frontend_op_eliminate]: 1.83e-05 [inline_after_opt_a]: 2.711e-05 [cconv]: 2.108e-05 [loop_unroll]: 0.00041566 [jit_opt_after_cconv]: 0.00014281, [1] [Cycle 1]: 0.00013623, [11] [c_1]: 2.458e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.82999e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.828e-05 [call_graph_tuple_transform]: 1.996e-05 [tuple_list_get_item_eliminator]: 5.90002e-06 [none_parameter_eliminate]: 1.59e-06 [renormalize]: 2.49973e-07 [switch_simplify]: 5.68002e-06 [remove_dup_value]: 1.155e-05 [partial_unused_args_eliminate]: 2.19001e-06 [environ_conv]: 5.77999e-06 [add_recomputation]: 4.072e-05 [cse_after_recomputation]: 2.095e-05, [1] [Cycle 1]: 1.59e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.465e-05 [get_jit_bprop_graph]: 1.47001e-06 [rewriter_after_jit_bprop_graph]: 4.43999e-06 [opt_after_jit_grad]: 0.00044578 [symbol_engine_optimizer]: 0.000125, [1] [Cycle 1]: 0.00011917, [6] [build]: 2.64001e-06 [elim_shapecalc]: 7.82998e-06 [elim_not_effective]: 1.395e-05 [opt_reshape]: 5.829e-05 [fold_const_symbol]: 9.60001e-06 [renormalize]: 3.50003e-07 [validate]: 3.75e-05 Sums bootstrap : 0.000253s : 0.24% type_inference : 0.099317s : 94.44% event_method : 0.000018s : 0.02% auto_monad : 0.000055s : 0.05% graph_reusing : 0.000005s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000395s : 0.38% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000055s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000701s : 0.67% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000015s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000013s : 0.01% jit_opt_a.accelerated_algorithm : 0.000013s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000020s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002181s : 2.07% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000036s : 0.03% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000499s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000027s : 0.03% cconv : 0.000021s : 0.02% loop_unroll : 0.000416s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000041s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000446s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000058s : 0.06% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000217 24 0.78% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.54% : 0.000006s : 4: substitution.graph_param_transform 85.22% : 0.000185s : 4: substitution.inline 1.41% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.43% : 0.000005s : 4: substitution.remove_not_recompute_node 1.90% : 0.000004s : 2: substitution.replace_old_param 5.10% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099256 2 97.52% : 0.096790s : 1: type_inference.infer 2.48% : 0.002465s : 1: type_inference.specialize ------[replace.] 0.000065 6 67.52% : 0.000044s : 4: replace.inline 32.48% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000192 6 94.87% : 0.000182s : 4: match.inline 5.13% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.29% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.30% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.69% : 0.000001s : 4: predicate.check_bprop_eliminate 1.12% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.13% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.26% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.18% : 0.000002s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.20% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.04% : 0.000007s : 26: predicate.inline 1.03% : 0.000001s : 8: predicate.inline_without_move 0.55% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.32% : 0.000002s : 8: predicate.less_batch_normalization 1.67% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.84% : 0.000002s : 18: predicate.load_eliminater 1.23% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.77% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.62% : 0.000002s : 4: predicate.mutable_eliminate 0.61% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.25% : 0.000002s : 12: predicate.print_const_string_wrapper 1.80% : 0.000002s : 12: predicate.reduce_eliminate 1.53% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.64% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 1.02% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.29% : 0.000002s : 12: predicate.reshape_eliminate 1.36% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.78% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.02% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.17% : 0.000009s : 58: predicate.switch_simplify 1.30% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.53% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.82% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.74% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001962 22 66.40% : 0.001303s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.62% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.97% : 0.000627s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.111986 72 0.04% : 0.000043s : 1: add_recomputation 0.05% : 0.000059s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.24% : 0.000268s : 1: bootstrap 0.02% : 0.000024s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 5.86% : 0.006560s : 1: jit_opt_a 0.13% : 0.000145s : 1: jit_opt_after_cconv 0.06% : 0.000067s : 1: jit_opt_b 0.38% : 0.000423s : 1: loop_unroll 0.45% : 0.000507s : 1: mutable_eliminate 0.83% : 0.000930s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000039s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000087s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000453s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000401s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.37% : 0.001537s : 1: renormalize.infer 0.57% : 0.000637s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000030s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.11% : 0.000127s : 1: symbol_engine_optimizer 88.70% : 0.099330s : 1: type_inference TotalTime = 0.107142, [30] [bootstrap]: 0.0002562 [type_inference]: 0.0979928 [event_method]: 1.885e-05 [auto_monad]: 6.494e-05 [graph_reusing]: 5.97001e-06 [pre_auto_parallel]: 2.41e-06 [py_interpret_to_execute]: 0.00039822 [rewriter_before_opt_a]: 8.049e-05 [expand_dump_flag]: 3.37002e-06 [jit_opt_a]: 0.00623545, [2] [Cycle 1]: 0.00286302, [27] [switch_simplify]: 5.137e-05 [loop_unroll]: 3.019e-05 [a_1]: 0.00052593 [with_stream_mark]: 1.555e-05 [recompute_prepare]: 8.32998e-06 [updatestate_depend_eliminate]: 3.53e-06 [updatestate_assign_eliminate]: 3.21001e-06 [updatestate_loads_eliminate]: 2.81999e-06 [parameter_eliminate]: 1.84e-06 [specialize_transform]: 7.43e-06 [updatestate_useless_node_eliminater]: 5.62999e-06 [accelerated_algorithm]: 5.98002e-06 [meta_shard_fg_expand]: 2.06003e-06 [get_grad_eliminate_]: 5.82999e-06 [merge_forward]: 3.71001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.454e-05 [j_node_and_user_rematch]: 9.79e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 9.05999e-06 [inline_without_move]: 5.82999e-06 [renormalize]: 0.00192182 [add_forward_monad_depend]: 4.90001e-06 [auto_monad_grad]: 2.11e-06 [auto_monad_eliminator]: 1.505e-05 [cse]: 2.956e-05 [replace_applicator]: 1.237e-05 [Cycle 2]: 0.00034847, [27] [switch_simplify]: 6.07999e-06 [loop_unroll]: 5.61e-06 [a_1]: 0.00011544 [with_stream_mark]: 8.38999e-06 [recompute_prepare]: 5.46998e-06 [updatestate_depend_eliminate]: 2.76999e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.09e-06 [parameter_eliminate]: 9.70002e-07 [specialize_transform]: 5.59e-06 [updatestate_useless_node_eliminater]: 5.34998e-06 [accelerated_algorithm]: 5.82999e-06 [meta_shard_fg_expand]: 1.42999e-06 [get_grad_eliminate_]: 5.72999e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.59e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.549e-05 [j_node_and_user_rematch]: 8.52e-06 [meta_fg_expand]: 1.48002e-06 [replace_old_param]: 7.7e-06 [inline_without_move]: 5.19998e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.17e-06 [auto_monad_grad]: 6.69999e-07 [auto_monad_eliminator]: 5.44e-06 [cse]: 1.12e-05 [replace_applicator]: 5.77001e-06 [py_interpret_to_execute_after_opt_a]: 8.33999e-06 [rewriter_after_opt_a]: 3.218e-05 [convert_after_rewriter]: 6.63e-06 [order_py_execute_after_rewriter]: 2.284e-05 [mutable_eliminate]: 0.00049587 [jit_opt_b]: 5.297e-05, [1] [Cycle 1]: 4.634e-05, [2] [frontend_op_eliminate]: 1.789e-05 [inline_after_opt_a]: 1.758e-05 [cconv]: 2.326e-05 [loop_unroll]: 0.0004112 [jit_opt_after_cconv]: 0.0001454, [1] [Cycle 1]: 0.00013925, [11] [c_1]: 2.424e-05 [parameter_eliminate]: 2.46998e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.46998e-06 [updatestate_loads_eliminate]: 2.16998e-06 [cse]: 1.986e-05 [call_graph_tuple_transform]: 1.914e-05 [tuple_list_get_item_eliminator]: 5.76998e-06 [none_parameter_eliminate]: 1.67001e-06 [renormalize]: 3.59985e-07 [switch_simplify]: 6.20002e-06 [remove_dup_value]: 1.508e-05 [partial_unused_args_eliminate]: 2.41e-06 [environ_conv]: 7.40998e-06 [add_recomputation]: 4.743e-05 [cse_after_recomputation]: 2.03e-05, [1] [Cycle 1]: 1.549e-05, [1] [cse]: 1.02e-05 [auto_monad_reorder]: 1.489e-05 [get_jit_bprop_graph]: 1.31002e-06 [rewriter_after_jit_bprop_graph]: 4.70999e-06 [opt_after_jit_grad]: 0.00044213 [symbol_engine_optimizer]: 0.0001249, [1] [Cycle 1]: 0.00011875, [6] [build]: 2.98998e-06 [elim_shapecalc]: 7.76001e-06 [elim_not_effective]: 1.219e-05 [opt_reshape]: 7.23e-06 [fold_const_symbol]: 6.045e-05 [renormalize]: 2.50002e-07 [validate]: 3.966e-05 Sums bootstrap : 0.000256s : 0.25% type_inference : 0.097993s : 94.62% event_method : 0.000019s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000398s : 0.38% rewriter_before_opt_a : 0.000080s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.06% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000641s : 0.62% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000030s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001922s : 1.86% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000023s : 0.02% mutable_eliminate : 0.000496s : 0.48% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000023s : 0.02% loop_unroll : 0.000411s : 0.40% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.05% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000442s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000060s : 0.06% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.04% Time group info: ------[substitution.] 0.000229 24 0.81% : 0.000002s : 2: substitution.elim_not_effective 23.03% : 0.000053s : 2: substitution.fold_const_symbol 2.20% : 0.000005s : 4: substitution.graph_param_transform 63.85% : 0.000146s : 4: substitution.inline 1.37% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.10% : 0.000005s : 4: substitution.remove_not_recompute_node 1.71% : 0.000004s : 2: substitution.replace_old_param 4.94% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097929 2 97.60% : 0.095574s : 1: type_inference.infer 2.40% : 0.002355s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.74% : 0.000043s : 4: replace.inline 33.26% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000154 6 93.39% : 0.000144s : 4: match.inline 6.61% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 0.97% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.35% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000002s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.13% : 0.000001s : 12: predicate.depend_value_elim 1.11% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.13% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.25% : 0.000002s : 12: predicate.environ_get_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.15% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.23% : 0.000007s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.06% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.85% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 12: predicate.merge_addn 1.25% : 0.000002s : 12: predicate.minmaximum_grad 1.93% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.44% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 1.05% : 0.000001s : 8: predicate.remove_not_recompute_node 2.10% : 0.000003s : 22: predicate.replace_applicator 0.82% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.33% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.18% : 0.000001s : 12: predicate.same_eliminate 0.74% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.51% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.44% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 18: predicate.switch_defer_inline 2.17% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 58: predicate.switch_simplify 1.37% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.40% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.98% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.80% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.59% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001834 22 66.53% : 0.001220s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.48% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 31.99% : 0.000587s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.110049 72 0.05% : 0.000050s : 1: add_recomputation 0.06% : 0.000068s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.24% : 0.000269s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.67% : 0.006238s : 1: jit_opt_a 0.13% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.38% : 0.000419s : 1: loop_unroll 0.46% : 0.000504s : 1: mutable_eliminate 0.78% : 0.000862s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000015s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.08% : 0.000085s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000450s : 1: opt_after_jit_grad 0.02% : 0.000025s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000404s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.22% : 0.001342s : 1: renormalize.infer 0.52% : 0.000573s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000035s : 1: rewriter_after_opt_a 0.08% : 0.000086s : 1: rewriter_before_opt_a 0.12% : 0.000128s : 1: symbol_engine_optimizer 89.06% : 0.098009s : 1: type_inference TotalTime = 0.0643193, [30] [bootstrap]: 0.00025311 [type_inference]: 0.0555477 [event_method]: 1.673e-05 [auto_monad]: 4.612e-05 [graph_reusing]: 3.76999e-06 [pre_auto_parallel]: 1.62001e-06 [py_interpret_to_execute]: 0.00025186 [rewriter_before_opt_a]: 7.038e-05 [expand_dump_flag]: 2.84999e-06 [jit_opt_a]: 0.00612486, [2] [Cycle 1]: 0.0028435, [27] [switch_simplify]: 4.489e-05 [loop_unroll]: 2.991e-05 [a_1]: 0.00049338 [with_stream_mark]: 1.097e-05 [recompute_prepare]: 7.45e-06 [updatestate_depend_eliminate]: 3.16999e-06 [updatestate_assign_eliminate]: 2.65002e-06 [updatestate_loads_eliminate]: 2.44999e-06 [parameter_eliminate]: 1.30001e-06 [specialize_transform]: 6.73998e-06 [updatestate_useless_node_eliminater]: 5.57999e-06 [accelerated_algorithm]: 6.19001e-06 [meta_shard_fg_expand]: 1.37e-06 [get_grad_eliminate_]: 5.91e-06 [merge_forward]: 2.79001e-06 [cell_reuse_recompute_pass]: 1.02e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.195e-05 [j_node_and_user_rematch]: 9.01002e-06 [meta_fg_expand]: 1.76003e-06 [replace_old_param]: 8.47e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.0019703 [add_forward_monad_depend]: 4.77e-06 [auto_monad_grad]: 1.55001e-06 [auto_monad_eliminator]: 1.239e-05 [cse]: 2.038e-05 [replace_applicator]: 1.248e-05 [Cycle 2]: 0.00035039, [27] [switch_simplify]: 6.64999e-06 [loop_unroll]: 5.79e-06 [a_1]: 0.00011544 [with_stream_mark]: 9.31e-06 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 2.56998e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.26e-06 [parameter_eliminate]: 1.22999e-06 [specialize_transform]: 5.81998e-06 [updatestate_useless_node_eliminater]: 5.82999e-06 [accelerated_algorithm]: 5.84e-06 [meta_shard_fg_expand]: 1.17e-06 [get_grad_eliminate_]: 5.69e-06 [merge_forward]: 2.76e-06 [cell_reuse_recompute_pass]: 1.58002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.31e-05 [j_node_and_user_rematch]: 8.35001e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 8.01001e-06 [inline_without_move]: 5.24e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 7.89994e-07 [auto_monad_eliminator]: 5.34e-06 [cse]: 1.088e-05 [replace_applicator]: 6.09999e-06 [py_interpret_to_execute_after_opt_a]: 8.03999e-06 [rewriter_after_opt_a]: 2.856e-05 [convert_after_rewriter]: 6.60002e-06 [order_py_execute_after_rewriter]: 4.4e-06 [mutable_eliminate]: 0.00048583 [jit_opt_b]: 5.021e-05, [1] [Cycle 1]: 4.393e-05, [2] [frontend_op_eliminate]: 1.734e-05 [inline_after_opt_a]: 1.626e-05 [cconv]: 2.019e-05 [loop_unroll]: 0.00040276 [jit_opt_after_cconv]: 0.00014129, [1] [Cycle 1]: 0.00013498, [11] [c_1]: 2.472e-05 [parameter_eliminate]: 2.54001e-06 [updatestate_depend_eliminate]: 5.54e-06 [updatestate_assign_eliminate]: 2.76e-06 [updatestate_loads_eliminate]: 1.99e-06 [cse]: 1.866e-05 [call_graph_tuple_transform]: 1.866e-05 [tuple_list_get_item_eliminator]: 5.94999e-06 [none_parameter_eliminate]: 1.10001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.74999e-06 [remove_dup_value]: 1.192e-05 [partial_unused_args_eliminate]: 1.96998e-06 [environ_conv]: 7.09001e-06 [add_recomputation]: 3.943e-05 [cse_after_recomputation]: 2.075e-05, [1] [Cycle 1]: 1.583e-05, [1] [cse]: 1.049e-05 [auto_monad_reorder]: 1.337e-05 [get_jit_bprop_graph]: 1.25999e-06 [rewriter_after_jit_bprop_graph]: 4.05e-06 [opt_after_jit_grad]: 0.00044665 [symbol_engine_optimizer]: 0.00011002, [1] [Cycle 1]: 0.00010339, [6] [build]: 2.73e-06 [elim_shapecalc]: 8.42998e-06 [elim_not_effective]: 1.28e-05 [opt_reshape]: 4.06e-05 [fold_const_symbol]: 1.068e-05 [renormalize]: 3.59985e-07 [validate]: 4.038e-05 Sums bootstrap : 0.000253s : 0.42% type_inference : 0.055548s : 91.29% event_method : 0.000017s : 0.03% auto_monad : 0.000046s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000252s : 0.41% rewriter_before_opt_a : 0.000070s : 0.12% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000052s : 0.08% jit_opt_a.loop_unroll : 0.000036s : 0.06% jit_opt_a.a_1 : 0.000609s : 1.00% jit_opt_a.with_stream_mark : 0.000020s : 0.03% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000003s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001970s : 3.24% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.03% jit_opt_a.cse : 0.000031s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000029s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000486s : 0.80% jit_opt_b.frontend_op_eliminate : 0.000017s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000020s : 0.03% loop_unroll : 0.000403s : 0.66% jit_opt_after_cconv.c_1 : 0.000025s : 0.04% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000039s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000013s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000447s : 0.73% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000041s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.07% Time group info: ------[substitution.] 0.000152 24 1.18% : 0.000002s : 2: substitution.elim_not_effective 0.90% : 0.000001s : 2: substitution.fold_const_symbol 3.41% : 0.000005s : 4: substitution.graph_param_transform 81.81% : 0.000124s : 4: substitution.inline 1.82% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.07% : 0.000005s : 4: substitution.remove_not_recompute_node 2.31% : 0.000003s : 2: substitution.replace_old_param 5.50% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.055487 2 96.84% : 0.053736s : 1: type_inference.infer 3.16% : 0.001751s : 1: type_inference.specialize ------[replace.] 0.000061 6 66.27% : 0.000040s : 4: replace.inline 33.73% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000129 6 94.32% : 0.000122s : 4: match.inline 5.68% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.08% : 0.000001s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.16% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.52% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.19% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000001s : 12: predicate.environ_get_eliminate 1.19% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.34% : 0.000000s : 4: predicate.fold_const_symbol 1.17% : 0.000001s : 8: predicate.get_grad_eliminate 0.28% : 0.000000s : 4: predicate.graph_param_transform 5.66% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.52% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.44% : 0.000002s : 8: predicate.less_batch_normalization 1.58% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.02% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.16% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.31% : 0.000002s : 12: predicate.print_const_string_wrapper 1.59% : 0.000002s : 12: predicate.reduce_eliminate 1.48% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.22% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.11% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.36% : 0.000003s : 18: predicate.switch_defer_inline 2.10% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.46% : 0.000009s : 58: predicate.switch_simplify 1.22% : 0.000002s : 12: predicate.tile_eliminate 1.30% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.61% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.57% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002645 34 74.44% : 0.001969s : 27: func_graph_cloner_run.FuncGraphClonerGraph 0.97% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 24.59% : 0.000650s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.067216 72 0.06% : 0.000042s : 1: add_recomputation 0.07% : 0.000049s : 1: auto_monad 0.02% : 0.000016s : 1: auto_monad_reorder 0.39% : 0.000265s : 1: bootstrap 0.03% : 0.000023s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.03% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.12% : 0.006128s : 1: jit_opt_a 0.21% : 0.000144s : 1: jit_opt_after_cconv 0.08% : 0.000053s : 1: jit_opt_b 0.61% : 0.000411s : 1: loop_unroll 0.73% : 0.000494s : 1: mutable_eliminate 1.22% : 0.000821s : 26: opt.transform.jit_opt_a 0.08% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.04% : 0.000028s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.03% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.10% : 0.000069s : 4: opt.transform.symbol_engine_opt 0.68% : 0.000454s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.38% : 0.000257s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000014s : 1: remove_dup_value 1.95% : 0.001308s : 1: renormalize.infer 0.98% : 0.000656s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000031s : 1: rewriter_after_opt_a 0.11% : 0.000075s : 1: rewriter_before_opt_a 0.17% : 0.000113s : 1: symbol_engine_optimizer 82.66% : 0.055559s : 1: type_inference TotalTime = 0.0578452, [30] [bootstrap]: 0.000256 [type_inference]: 0.0495824 [event_method]: 1.722e-05 [auto_monad]: 4.335e-05 [graph_reusing]: 3.54002e-06 [pre_auto_parallel]: 1.57001e-06 [py_interpret_to_execute]: 0.0002364 [rewriter_before_opt_a]: 6.977e-05 [expand_dump_flag]: 2.07999e-06 [jit_opt_a]: 0.00566352, [2] [Cycle 1]: 0.00243865, [27] [switch_simplify]: 4.376e-05 [loop_unroll]: 3.043e-05 [a_1]: 0.0004946 [with_stream_mark]: 1.152e-05 [recompute_prepare]: 7.65998e-06 [updatestate_depend_eliminate]: 3.12002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.21e-06 [parameter_eliminate]: 1.14998e-06 [specialize_transform]: 6.70002e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.85002e-06 [meta_shard_fg_expand]: 1.37999e-06 [get_grad_eliminate_]: 5.87999e-06 [merge_forward]: 2.49999e-06 [cell_reuse_recompute_pass]: 8.2e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.136e-05 [j_node_and_user_rematch]: 9.12001e-06 [meta_fg_expand]: 1.96e-06 [replace_old_param]: 8.25999e-06 [inline_without_move]: 6.03998e-06 [renormalize]: 0.00157443 [add_forward_monad_depend]: 4.32998e-06 [auto_monad_grad]: 1.07998e-06 [auto_monad_eliminator]: 1.132e-05 [cse]: 1.865e-05 [replace_applicator]: 1.214e-05 [Cycle 2]: 0.00034383, [27] [switch_simplify]: 6.77002e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00011758 [with_stream_mark]: 8.32e-06 [recompute_prepare]: 5.83997e-06 [updatestate_depend_eliminate]: 2.55002e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 1.97001e-06 [parameter_eliminate]: 1.05999e-06 [specialize_transform]: 5.66e-06 [updatestate_useless_node_eliminater]: 5.51998e-06 [accelerated_algorithm]: 5.17999e-06 [meta_shard_fg_expand]: 1.06002e-06 [get_grad_eliminate_]: 5.00999e-06 [merge_forward]: 2.31998e-06 [cell_reuse_recompute_pass]: 1.10999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.282e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.55999e-06 [replace_old_param]: 7.85998e-06 [inline_without_move]: 5.35999e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.30013e-07 [auto_monad_grad]: 6.90023e-07 [auto_monad_eliminator]: 5.71e-06 [cse]: 1.091e-05 [replace_applicator]: 5.92001e-06 [py_interpret_to_execute_after_opt_a]: 7.3e-06 [rewriter_after_opt_a]: 2.53e-05 [convert_after_rewriter]: 5.20999e-06 [order_py_execute_after_rewriter]: 4.11001e-06 [mutable_eliminate]: 0.00049311 [jit_opt_b]: 5.551e-05, [1] [Cycle 1]: 4.912e-05, [2] [frontend_op_eliminate]: 1.982e-05 [inline_after_opt_a]: 1.82e-05 [cconv]: 1.526e-05 [loop_unroll]: 0.00040607 [jit_opt_after_cconv]: 0.00014283, [1] [Cycle 1]: 0.00013682, [11] [c_1]: 2.47e-05 [parameter_eliminate]: 2.39999e-06 [updatestate_depend_eliminate]: 5.29e-06 [updatestate_assign_eliminate]: 2.34001e-06 [updatestate_loads_eliminate]: 1.96998e-06 [cse]: 1.884e-05 [call_graph_tuple_transform]: 1.863e-05 [tuple_list_get_item_eliminator]: 6.39999e-06 [none_parameter_eliminate]: 1.30001e-06 [renormalize]: 2.3999e-07 [switch_simplify]: 6.09999e-06 [remove_dup_value]: 9.69e-06 [partial_unused_args_eliminate]: 1.57001e-06 [environ_conv]: 6.58e-06 [add_recomputation]: 3.126e-05 [cse_after_recomputation]: 2.123e-05, [1] [Cycle 1]: 1.595e-05, [1] [cse]: 1.02e-05 [auto_monad_reorder]: 9.29998e-06 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 4.50001e-06 [opt_after_jit_grad]: 0.00045459 [symbol_engine_optimizer]: 8.778e-05, [1] [Cycle 1]: 6.737e-05, [6] [build]: 2.73998e-06 [elim_shapecalc]: 9.32001e-06 [elim_not_effective]: 1.303e-05 [opt_reshape]: 6.16e-06 [fold_const_symbol]: 9.01002e-06 [renormalize]: 2.79979e-07 [validate]: 3.315e-05 Sums bootstrap : 0.000256s : 0.47% type_inference : 0.049582s : 91.11% event_method : 0.000017s : 0.03% auto_monad : 0.000043s : 0.08% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000236s : 0.43% rewriter_before_opt_a : 0.000070s : 0.13% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.09% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000612s : 1.12% jit_opt_a.with_stream_mark : 0.000020s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.02% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000004s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000011s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000016s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001574s : 2.89% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.03% jit_opt_a.cse : 0.000030s : 0.05% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000007s : 0.01% rewriter_after_opt_a : 0.000025s : 0.05% convert_after_rewriter : 0.000005s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000493s : 0.91% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000015s : 0.03% loop_unroll : 0.000406s : 0.75% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000010s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000031s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000009s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000455s : 0.84% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000033s : 0.06% Time group info: ------[substitution.] 0.000146 24 1.04% : 0.000002s : 2: substitution.elim_not_effective 0.77% : 0.000001s : 2: substitution.fold_const_symbol 2.89% : 0.000004s : 4: substitution.graph_param_transform 83.54% : 0.000122s : 4: substitution.inline 1.79% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.87% : 0.000004s : 4: substitution.remove_not_recompute_node 2.10% : 0.000003s : 2: substitution.replace_old_param 5.00% : 0.000007s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049523 2 96.72% : 0.047897s : 1: type_inference.infer 3.28% : 0.001626s : 1: type_inference.specialize ------[replace.] 0.000059 6 66.99% : 0.000040s : 4: replace.inline 33.01% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000126 6 95.11% : 0.000120s : 4: match.inline 4.89% : 0.000006s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.27% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.33% : 0.000002s : 12: predicate.addn_zero_filter 1.81% : 0.000002s : 12: predicate.arithmetic_simplify 1.53% : 0.000002s : 12: predicate.cast_eliminate 0.80% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.27% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.22% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.20% : 0.000002s : 4: predicate.dumpgradient_eliminate 0.44% : 0.000001s : 4: predicate.elim_not_effective 0.59% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 4.86% : 0.000006s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.51% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 18: predicate.load_eliminater 1.31% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.32% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.16% : 0.000001s : 12: predicate.minmaximum_grad 1.99% : 0.000003s : 4: predicate.mutable_eliminate 0.57% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.26% : 0.000002s : 12: predicate.print_const_string_wrapper 1.76% : 0.000002s : 12: predicate.reduce_eliminate 1.44% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.48% : 0.000001s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.27% : 0.000002s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.47% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.30% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.23% : 0.000002s : 12: predicate.transpose_eliminate 1.35% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.49% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.06% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.42% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001992 26 71.83% : 0.001431s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.85% : 0.000535s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060329 72 0.06% : 0.000034s : 1: add_recomputation 0.08% : 0.000047s : 1: auto_monad 0.02% : 0.000012s : 1: auto_monad_reorder 0.44% : 0.000267s : 1: bootstrap 0.03% : 0.000018s : 1: cconv 0.01% : 0.000007s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.03% : 0.000021s : 1: event_method 0.01% : 0.000004s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.39% : 0.005666s : 1: jit_opt_a 0.24% : 0.000146s : 1: jit_opt_after_cconv 0.10% : 0.000058s : 1: jit_opt_b 0.69% : 0.000413s : 1: loop_unroll 0.83% : 0.000502s : 1: mutable_eliminate 1.36% : 0.000821s : 26: opt.transform.jit_opt_a 0.09% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000032s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.03% : 0.000015s : 1: opt.transform.mutable_eliminate 0.04% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.77% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000003s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.40% : 0.000241s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000012s : 1: remove_dup_value 1.73% : 0.001042s : 1: renormalize.infer 0.87% : 0.000526s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000028s : 1: rewriter_after_opt_a 0.12% : 0.000075s : 1: rewriter_before_opt_a 0.15% : 0.000090s : 1: symbol_engine_optimizer 82.21% : 0.049594s : 1: type_inference TotalTime = 0.0566819, [30] [bootstrap]: 0.00024414 [type_inference]: 0.0484661 [event_method]: 1.768e-05 [auto_monad]: 5.852e-05 [graph_reusing]: 4.25e-06 [pre_auto_parallel]: 1.58002e-06 [py_interpret_to_execute]: 0.00023403 [rewriter_before_opt_a]: 7.503e-05 [expand_dump_flag]: 3.16001e-06 [jit_opt_a]: 0.00560477, [2] [Cycle 1]: 0.00233083, [27] [switch_simplify]: 4.71e-05 [loop_unroll]: 2.998e-05 [a_1]: 0.00050159 [with_stream_mark]: 1.417e-05 [recompute_prepare]: 8.72998e-06 [updatestate_depend_eliminate]: 3.76999e-06 [updatestate_assign_eliminate]: 2.88e-06 [updatestate_loads_eliminate]: 2.63998e-06 [parameter_eliminate]: 1.53002e-06 [specialize_transform]: 6.94001e-06 [updatestate_useless_node_eliminater]: 5.79999e-06 [accelerated_algorithm]: 6.34001e-06 [meta_shard_fg_expand]: 1.81e-06 [get_grad_eliminate_]: 6.12001e-06 [merge_forward]: 3.14999e-06 [cell_reuse_recompute_pass]: 1.00999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.381e-05 [j_node_and_user_rematch]: 9.36e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 9.36e-06 [inline_without_move]: 6.07001e-06 [renormalize]: 0.00142858 [add_forward_monad_depend]: 5.00999e-06 [auto_monad_grad]: 1.56998e-06 [auto_monad_eliminator]: 1.438e-05 [cse]: 2.646e-05 [replace_applicator]: 1.321e-05 [Cycle 2]: 0.00034166, [27] [switch_simplify]: 6.13002e-06 [loop_unroll]: 6.05002e-06 [a_1]: 0.00011606 [with_stream_mark]: 8.27e-06 [recompute_prepare]: 5.59e-06 [updatestate_depend_eliminate]: 2.55002e-06 [updatestate_assign_eliminate]: 2.16e-06 [updatestate_loads_eliminate]: 2.03002e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.44e-06 [updatestate_useless_node_eliminater]: 5.46998e-06 [accelerated_algorithm]: 5.39998e-06 [meta_shard_fg_expand]: 1.47001e-06 [get_grad_eliminate_]: 5.27999e-06 [merge_forward]: 2.51e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.332e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 1.57001e-06 [replace_old_param]: 7.8e-06 [inline_without_move]: 5.16002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.99978e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.44998e-06 [cse]: 1.052e-05 [replace_applicator]: 5.66e-06 [py_interpret_to_execute_after_opt_a]: 6.426e-05 [rewriter_after_opt_a]: 3.03e-05 [convert_after_rewriter]: 6.47001e-06 [order_py_execute_after_rewriter]: 4.68001e-06 [mutable_eliminate]: 0.00045353 [jit_opt_b]: 5.151e-05, [1] [Cycle 1]: 4.504e-05, [2] [frontend_op_eliminate]: 1.836e-05 [inline_after_opt_a]: 1.61e-05 [cconv]: 2.137e-05 [loop_unroll]: 0.00040118 [jit_opt_after_cconv]: 0.00013994, [1] [Cycle 1]: 0.00013417, [11] [c_1]: 2.421e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.35999e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.46e-06 [cse]: 1.834e-05 [call_graph_tuple_transform]: 1.934e-05 [tuple_list_get_item_eliminator]: 6.12999e-06 [none_parameter_eliminate]: 1.11997e-06 [renormalize]: 4.50003e-07 [switch_simplify]: 5.66998e-06 [remove_dup_value]: 1.352e-05 [partial_unused_args_eliminate]: 1.88002e-06 [environ_conv]: 6.61e-06 [add_recomputation]: 3.908e-05 [cse_after_recomputation]: 2.062e-05, [1] [Cycle 1]: 1.594e-05, [1] [cse]: 1.051e-05 [auto_monad_reorder]: 1.473e-05 [get_jit_bprop_graph]: 1.81e-06 [rewriter_after_jit_bprop_graph]: 3.85998e-06 [opt_after_jit_grad]: 0.00043779 [symbol_engine_optimizer]: 7.053e-05, [1] [Cycle 1]: 6.5e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 8.28999e-06 [elim_not_effective]: 1.265e-05 [opt_reshape]: 6.22001e-06 [fold_const_symbol]: 8.77999e-06 [renormalize]: 2.9002e-07 [validate]: 3.628e-05 Sums bootstrap : 0.000244s : 0.46% type_inference : 0.048466s : 91.06% event_method : 0.000018s : 0.03% auto_monad : 0.000059s : 0.11% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000234s : 0.44% rewriter_before_opt_a : 0.000075s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000053s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000618s : 1.16% jit_opt_a.with_stream_mark : 0.000022s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001429s : 2.68% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.04% jit_opt_a.cse : 0.000037s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.04% py_interpret_to_execute_after_opt_a : 0.000064s : 0.12% rewriter_after_opt_a : 0.000030s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000454s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000016s : 0.03% cconv : 0.000021s : 0.04% loop_unroll : 0.000401s : 0.75% jit_opt_after_cconv.c_1 : 0.000024s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000039s : 0.07% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000438s : 0.82% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000036s : 0.07% Time group info: ------[substitution.] 0.000159 24 1.40% : 0.000002s : 2: substitution.elim_not_effective 0.71% : 0.000001s : 2: substitution.fold_const_symbol 3.33% : 0.000005s : 4: substitution.graph_param_transform 80.73% : 0.000128s : 4: substitution.inline 2.00% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.82% : 0.000004s : 4: substitution.remove_not_recompute_node 2.40% : 0.000004s : 2: substitution.replace_old_param 6.60% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048405 2 96.85% : 0.046880s : 1: type_inference.infer 3.15% : 0.001526s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.31% : 0.000041s : 4: replace.inline 33.69% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000135 6 93.11% : 0.000126s : 4: match.inline 6.89% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000126 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.14% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.33% : 0.000002s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 1.76% : 0.000002s : 12: predicate.arithmetic_simplify 1.20% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.14% : 0.000001s : 12: predicate.compare_switch_simplify 1.26% : 0.000002s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.25% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.18% : 0.000001s : 12: predicate.environ_get_eliminate 1.21% : 0.000002s : 12: predicate.environ_get_set_eliminate 0.29% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.29% : 0.000000s : 4: predicate.graph_param_transform 5.40% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.19% : 0.000002s : 8: predicate.less_batch_normalization 1.63% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.87% : 0.000002s : 18: predicate.load_eliminater 1.30% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.87% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.14% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000001s : 12: predicate.minmaximum_grad 1.44% : 0.000002s : 4: predicate.mutable_eliminate 0.78% : 0.000001s : 4: predicate.opt_reshape 2.38% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.40% : 0.000001s : 4: predicate.reset_defer_inline 1.26% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.95% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.72% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.03% : 0.000001s : 8: predicate.specialize_transform 1.62% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 18: predicate.switch_defer_inline 2.20% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.25% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.26% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.79% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.51% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.07% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001927 26 73.31% : 0.001413s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.32% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.36% : 0.000489s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.059020 72 0.07% : 0.000042s : 1: add_recomputation 0.10% : 0.000062s : 1: auto_monad 0.03% : 0.000017s : 1: auto_monad_reorder 0.43% : 0.000255s : 1: bootstrap 0.04% : 0.000024s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000022s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.50% : 0.005607s : 1: jit_opt_a 0.24% : 0.000142s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.69% : 0.000409s : 1: loop_unroll 0.78% : 0.000461s : 1: mutable_eliminate 1.41% : 0.000833s : 26: opt.transform.jit_opt_a 0.09% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000446s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.40% : 0.000239s : 1: py_interpret_to_execute 0.11% : 0.000067s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.56% : 0.000920s : 1: renormalize.infer 0.85% : 0.000500s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000033s : 1: rewriter_after_opt_a 0.14% : 0.000080s : 1: rewriter_before_opt_a 0.12% : 0.000073s : 1: symbol_engine_optimizer 82.14% : 0.048478s : 1: type_inference TotalTime = 0.0563028, [30] [bootstrap]: 0.00023697 [type_inference]: 0.0480684 [event_method]: 1.761e-05 [auto_monad]: 5.804e-05 [graph_reusing]: 4.90001e-06 [pre_auto_parallel]: 1.87999e-06 [py_interpret_to_execute]: 0.00023204 [rewriter_before_opt_a]: 7.564e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00564152, [2] [Cycle 1]: 0.00238118, [27] [switch_simplify]: 4.78e-05 [loop_unroll]: 3.005e-05 [a_1]: 0.00050414 [with_stream_mark]: 1.302e-05 [recompute_prepare]: 8.08001e-06 [updatestate_depend_eliminate]: 3.27002e-06 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.59001e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.92001e-06 [accelerated_algorithm]: 6.16e-06 [meta_shard_fg_expand]: 2.01e-06 [get_grad_eliminate_]: 5.99999e-06 [merge_forward]: 3.73999e-06 [cell_reuse_recompute_pass]: 9.89996e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.316e-05 [j_node_and_user_rematch]: 9.19e-06 [meta_fg_expand]: 2.36e-06 [replace_old_param]: 9.14e-06 [inline_without_move]: 6.06998e-06 [renormalize]: 0.00147867 [add_forward_monad_depend]: 4.67998e-06 [auto_monad_grad]: 1.86e-06 [auto_monad_eliminator]: 1.556e-05 [cse]: 2.589e-05 [replace_applicator]: 1.301e-05 [Cycle 2]: 0.00034161, [27] [switch_simplify]: 6.37001e-06 [loop_unroll]: 5.50001e-06 [a_1]: 0.00011568 [with_stream_mark]: 8.30999e-06 [recompute_prepare]: 5.30999e-06 [updatestate_depend_eliminate]: 2.67001e-06 [updatestate_assign_eliminate]: 2.21003e-06 [updatestate_loads_eliminate]: 2.07001e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.64998e-06 [updatestate_useless_node_eliminater]: 5.57001e-06 [accelerated_algorithm]: 5.49e-06 [meta_shard_fg_expand]: 1.16997e-06 [get_grad_eliminate_]: 5.18002e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.303e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.56002e-06 [replace_old_param]: 7.66999e-06 [inline_without_move]: 5.17e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 8.90024e-07 [auto_monad_grad]: 6.60017e-07 [auto_monad_eliminator]: 5.97001e-06 [cse]: 1.065e-05 [replace_applicator]: 5.42001e-06 [py_interpret_to_execute_after_opt_a]: 8.04002e-06 [rewriter_after_opt_a]: 3.078e-05 [convert_after_rewriter]: 6.35997e-06 [order_py_execute_after_rewriter]: 4.86002e-06 [mutable_eliminate]: 0.00047322 [jit_opt_b]: 5.081e-05, [1] [Cycle 1]: 4.463e-05, [2] [frontend_op_eliminate]: 1.753e-05 [inline_after_opt_a]: 1.682e-05 [cconv]: 2.399e-05 [loop_unroll]: 0.00040344 [jit_opt_after_cconv]: 0.00014067, [1] [Cycle 1]: 0.00013497, [11] [c_1]: 2.445e-05 [parameter_eliminate]: 2.26998e-06 [updatestate_depend_eliminate]: 5.30001e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 2.09e-06 [cse]: 1.812e-05 [call_graph_tuple_transform]: 1.918e-05 [tuple_list_get_item_eliminator]: 6.31e-06 [none_parameter_eliminate]: 1.47001e-06 [renormalize]: 2.40019e-07 [switch_simplify]: 5.75001e-06 [remove_dup_value]: 1.378e-05 [partial_unused_args_eliminate]: 1.87001e-06 [environ_conv]: 7.36001e-06 [add_recomputation]: 4.383e-05 [cse_after_recomputation]: 2.094e-05, [1] [Cycle 1]: 1.558e-05, [1] [cse]: 1.006e-05 [auto_monad_reorder]: 1.334e-05 [get_jit_bprop_graph]: 1.32e-06 [rewriter_after_jit_bprop_graph]: 4.04002e-06 [opt_after_jit_grad]: 0.00044154 [symbol_engine_optimizer]: 7.02e-05, [1] [Cycle 1]: 6.481e-05, [6] [build]: 3.09999e-06 [elim_shapecalc]: 8.17998e-06 [elim_not_effective]: 1.27e-05 [opt_reshape]: 6.02999e-06 [fold_const_symbol]: 8.84e-06 [renormalize]: 3.39991e-07 [validate]: 5.072e-05 Sums bootstrap : 0.000237s : 0.45% type_inference : 0.048068s : 90.94% event_method : 0.000018s : 0.03% auto_monad : 0.000058s : 0.11% graph_reusing : 0.000005s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000232s : 0.44% rewriter_before_opt_a : 0.000076s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000054s : 0.10% jit_opt_a.loop_unroll : 0.000036s : 0.07% jit_opt_a.a_1 : 0.000620s : 1.17% jit_opt_a.with_stream_mark : 0.000021s : 0.04% jit_opt_a.recompute_prepare : 0.000013s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001479s : 2.80% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.04% jit_opt_a.cse : 0.000037s : 0.07% jit_opt_a.replace_applicator : 0.000018s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.02% rewriter_after_opt_a : 0.000031s : 0.06% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000473s : 0.90% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000024s : 0.05% loop_unroll : 0.000403s : 0.76% jit_opt_after_cconv.c_1 : 0.000024s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000014s : 0.03% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000044s : 0.08% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000013s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000442s : 0.84% symbol_engine_optimizer.build : 0.000003s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.02% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000051s : 0.10% Time group info: ------[substitution.] 0.000163 24 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.96% : 0.000002s : 2: substitution.fold_const_symbol 3.40% : 0.000006s : 4: substitution.graph_param_transform 81.46% : 0.000133s : 4: substitution.inline 1.77% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.85% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000003s : 2: substitution.replace_old_param 6.35% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.048007 2 96.80% : 0.046469s : 1: type_inference.infer 3.20% : 0.001538s : 1: type_inference.specialize ------[replace.] 0.000061 6 67.09% : 0.000041s : 4: replace.inline 32.91% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000140 6 93.35% : 0.000131s : 4: match.inline 6.65% : 0.000009s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.08% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.63% : 0.000002s : 12: predicate.arithmetic_simplify 1.51% : 0.000002s : 12: predicate.cast_eliminate 0.46% : 0.000001s : 4: predicate.check_bprop_eliminate 1.15% : 0.000001s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.99% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.39% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.27% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000001s : 12: predicate.environ_get_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.12% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.28% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.25% : 0.000002s : 8: predicate.less_batch_normalization 1.47% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 18: predicate.load_eliminater 1.42% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.15% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.86% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.18% : 0.000001s : 12: predicate.minmaximum_grad 1.96% : 0.000002s : 4: predicate.mutable_eliminate 0.56% : 0.000001s : 4: predicate.opt_reshape 2.24% : 0.000003s : 18: predicate.partial_eliminate 1.24% : 0.000002s : 12: predicate.print_const_string_wrapper 1.62% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.03% : 0.000003s : 22: predicate.replace_applicator 0.92% : 0.000001s : 8: predicate.replace_old_param 0.44% : 0.000001s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.75% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.31% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.47% : 0.000009s : 58: predicate.switch_simplify 1.26% : 0.000002s : 12: predicate.tile_eliminate 1.27% : 0.000002s : 12: predicate.transpose_eliminate 1.45% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.39% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.40% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.10% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 12: predicate.value_based_eliminate 0.43% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001926 26 72.24% : 0.001391s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.35% : 0.000507s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.058678 72 0.08% : 0.000047s : 1: add_recomputation 0.10% : 0.000061s : 1: auto_monad 0.03% : 0.000016s : 1: auto_monad_reorder 0.42% : 0.000248s : 1: bootstrap 0.05% : 0.000026s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.02% : 0.000009s : 1: environ_conv 0.04% : 0.000021s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000007s : 1: graph_reusing 9.62% : 0.005644s : 1: jit_opt_a 0.24% : 0.000143s : 1: jit_opt_after_cconv 0.09% : 0.000053s : 1: jit_opt_b 0.70% : 0.000411s : 1: loop_unroll 0.82% : 0.000481s : 1: mutable_eliminate 1.42% : 0.000834s : 26: opt.transform.jit_opt_a 0.09% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000033s : 4: opt.transform.symbol_engine_opt 0.76% : 0.000449s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.40% : 0.000237s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000016s : 1: remove_dup_value 1.58% : 0.000928s : 1: renormalize.infer 0.93% : 0.000544s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000034s : 1: rewriter_after_opt_a 0.14% : 0.000080s : 1: rewriter_before_opt_a 0.12% : 0.000072s : 1: symbol_engine_optimizer 81.94% : 0.048080s : 1: type_inference TotalTime = 0.106559, [30] [bootstrap]: 0.00025194 [type_inference]: 0.0978044 [event_method]: 1.647e-05 [auto_monad]: 4.289e-05 [graph_reusing]: 3.58999e-06 [pre_auto_parallel]: 1.59e-06 [py_interpret_to_execute]: 0.00039881 [rewriter_before_opt_a]: 7.062e-05 [expand_dump_flag]: 2.53e-06 [jit_opt_a]: 0.00603033, [2] [Cycle 1]: 0.00281965, [27] [switch_simplify]: 4.415e-05 [loop_unroll]: 3.057e-05 [a_1]: 0.00048595 [with_stream_mark]: 1.157e-05 [recompute_prepare]: 7.67998e-06 [updatestate_depend_eliminate]: 3.86999e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.34001e-06 [parameter_eliminate]: 1.21002e-06 [specialize_transform]: 7.6e-06 [updatestate_useless_node_eliminater]: 6.84999e-06 [accelerated_algorithm]: 6.25002e-06 [meta_shard_fg_expand]: 1.21002e-06 [get_grad_eliminate_]: 5.83002e-06 [merge_forward]: 2.66e-06 [cell_reuse_recompute_pass]: 8.50006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.162e-05 [j_node_and_user_rematch]: 9.00001e-06 [meta_fg_expand]: 1.87001e-06 [replace_old_param]: 8.57e-06 [inline_without_move]: 6.30002e-06 [renormalize]: 0.00194622 [add_forward_monad_depend]: 4.2e-06 [auto_monad_grad]: 1.66e-06 [auto_monad_eliminator]: 1.117e-05 [cse]: 1.968e-05 [replace_applicator]: 1.212e-05 [Cycle 2]: 0.00034047, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 5.70001e-06 [a_1]: 0.00011622 [with_stream_mark]: 7.85e-06 [recompute_prepare]: 5.82001e-06 [updatestate_depend_eliminate]: 2.68998e-06 [updatestate_assign_eliminate]: 2.06e-06 [updatestate_loads_eliminate]: 1.89e-06 [parameter_eliminate]: 8.50006e-07 [specialize_transform]: 5.61e-06 [updatestate_useless_node_eliminater]: 5.44e-06 [accelerated_algorithm]: 5.29e-06 [meta_shard_fg_expand]: 1.11002e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 2.33998e-06 [cell_reuse_recompute_pass]: 1.24e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.251e-05 [j_node_and_user_rematch]: 8.26002e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 7.58999e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.9989e-08 [add_forward_monad_depend]: 9.20001e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.44e-06 [cse]: 1.033e-05 [replace_applicator]: 5.69e-06 [py_interpret_to_execute_after_opt_a]: 7.88001e-06 [rewriter_after_opt_a]: 2.588e-05 [convert_after_rewriter]: 6.29999e-06 [order_py_execute_after_rewriter]: 4.60001e-06 [mutable_eliminate]: 0.00047199 [jit_opt_b]: 5.09e-05, [1] [Cycle 1]: 4.498e-05, [2] [frontend_op_eliminate]: 1.772e-05 [inline_after_opt_a]: 1.669e-05 [cconv]: 1.547e-05 [loop_unroll]: 0.00040786 [jit_opt_after_cconv]: 0.00013953, [1] [Cycle 1]: 0.00013383, [11] [c_1]: 2.402e-05 [parameter_eliminate]: 2.28998e-06 [updatestate_depend_eliminate]: 5.27999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.10002e-06 [cse]: 1.854e-05 [call_graph_tuple_transform]: 1.778e-05 [tuple_list_get_item_eliminator]: 5.80002e-06 [none_parameter_eliminate]: 1.22e-06 [renormalize]: 3.09985e-07 [switch_simplify]: 5.74e-06 [remove_dup_value]: 8.43001e-06 [partial_unused_args_eliminate]: 1.20001e-06 [environ_conv]: 5.82001e-06 [add_recomputation]: 3.065e-05 [cse_after_recomputation]: 2.028e-05, [1] [Cycle 1]: 1.539e-05, [1] [cse]: 9.64e-06 [auto_monad_reorder]: 8.89e-06 [get_jit_bprop_graph]: 1.22e-06 [rewriter_after_jit_bprop_graph]: 3.68999e-06 [opt_after_jit_grad]: 0.00043614 [symbol_engine_optimizer]: 6.861e-05, [1] [Cycle 1]: 6.328e-05, [6] [build]: 2.41998e-06 [elim_shapecalc]: 7.48999e-06 [elim_not_effective]: 1.22e-05 [opt_reshape]: 5.85002e-06 [fold_const_symbol]: 8.92e-06 [renormalize]: 3.39991e-07 [validate]: 2.938e-05 Sums bootstrap : 0.000252s : 0.24% type_inference : 0.097804s : 94.85% event_method : 0.000016s : 0.02% auto_monad : 0.000043s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000399s : 0.39% rewriter_before_opt_a : 0.000071s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000051s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.04% jit_opt_a.a_1 : 0.000602s : 0.58% jit_opt_a.with_stream_mark : 0.000019s : 0.02% jit_opt_a.recompute_prepare : 0.000013s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.02% jit_opt_a.meta_fg_expand : 0.000003s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001946s : 1.89% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.00% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.02% jit_opt_a.cse : 0.000030s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000026s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000472s : 0.46% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000015s : 0.02% loop_unroll : 0.000408s : 0.40% jit_opt_after_cconv.c_1 : 0.000024s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000001s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000031s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000009s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000436s : 0.42% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.03% Time group info: ------[substitution.] 0.000145 24 1.36% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 2.58% : 0.000004s : 4: substitution.graph_param_transform 82.86% : 0.000120s : 4: substitution.inline 1.85% : 0.000003s : 4: substitution.j_node_and_user_rematch 3.01% : 0.000004s : 4: substitution.remove_not_recompute_node 2.09% : 0.000003s : 2: substitution.replace_old_param 5.56% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097749 2 97.64% : 0.095447s : 1: type_inference.infer 2.36% : 0.002302s : 1: type_inference.specialize ------[replace.] 0.000059 6 66.50% : 0.000040s : 4: replace.inline 33.50% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000125 6 94.46% : 0.000118s : 4: match.inline 5.54% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.38% : 0.000002s : 12: predicate.accumulaten_eliminater 1.04% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 1.78% : 0.000002s : 12: predicate.arithmetic_simplify 1.26% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.10% : 0.000001s : 12: predicate.compare_switch_simplify 1.34% : 0.000002s : 12: predicate.depend_value_elim 1.18% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.30% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 12: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.43% : 0.000001s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.18% : 0.000006s : 26: predicate.inline 1.09% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.38% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.90% : 0.000002s : 18: predicate.load_eliminater 1.61% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.54% : 0.000006s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.48% : 0.000001s : 4: predicate.opt_reshape 2.31% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.61% : 0.000002s : 12: predicate.reduce_eliminate 1.42% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.59% : 0.000001s : 8: predicate.remove_not_recompute_node 2.12% : 0.000003s : 22: predicate.replace_applicator 0.66% : 0.000001s : 8: predicate.replace_old_param 0.41% : 0.000001s : 4: predicate.reset_defer_inline 1.21% : 0.000002s : 12: predicate.reshape_eliminate 1.31% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.29% : 0.000002s : 12: predicate.same_eliminate 0.70% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.98% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.35% : 0.000003s : 18: predicate.switch_defer_inline 2.14% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.32% : 0.000009s : 58: predicate.switch_simplify 1.32% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.37% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.26% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.78% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.68% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.75% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.09% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.35% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001837 22 64.87% : 0.001191s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.38% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.75% : 0.000620s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109361 72 0.03% : 0.000033s : 1: add_recomputation 0.04% : 0.000046s : 1: auto_monad 0.01% : 0.000011s : 1: auto_monad_reorder 0.24% : 0.000264s : 1: bootstrap 0.02% : 0.000018s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.52% : 0.006033s : 1: jit_opt_a 0.13% : 0.000142s : 1: jit_opt_after_cconv 0.05% : 0.000053s : 1: jit_opt_b 0.38% : 0.000415s : 1: loop_unroll 0.44% : 0.000480s : 1: mutable_eliminate 0.74% : 0.000814s : 26: opt.transform.jit_opt_a 0.05% : 0.000050s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000014s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000013s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000032s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000443s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000003s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.37% : 0.000404s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000011s : 1: remove_dup_value 1.21% : 0.001324s : 1: renormalize.infer 0.56% : 0.000616s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000029s : 1: rewriter_after_opt_a 0.07% : 0.000076s : 1: rewriter_before_opt_a 0.06% : 0.000071s : 1: symbol_engine_optimizer 89.44% : 0.097816s : 1: type_inference TotalTime = 0.106141, [30] [bootstrap]: 0.00023198 [type_inference]: 0.097196 [event_method]: 1.595e-05 [auto_monad]: 4.387e-05 [graph_reusing]: 3.85998e-06 [pre_auto_parallel]: 1.66e-06 [py_interpret_to_execute]: 0.00042057 [rewriter_before_opt_a]: 7.225e-05 [expand_dump_flag]: 2.21e-06 [jit_opt_a]: 0.00613114, [2] [Cycle 1]: 0.00290564, [27] [switch_simplify]: 4.363e-05 [loop_unroll]: 3.025e-05 [a_1]: 0.00049565 [with_stream_mark]: 1.285e-05 [recompute_prepare]: 8.05e-06 [updatestate_depend_eliminate]: 3.06001e-06 [updatestate_assign_eliminate]: 2.69001e-06 [updatestate_loads_eliminate]: 2.32001e-06 [parameter_eliminate]: 1.29e-06 [specialize_transform]: 6.47001e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 6.36e-06 [meta_shard_fg_expand]: 1.43002e-06 [get_grad_eliminate_]: 5.89999e-06 [merge_forward]: 2.59999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.209e-05 [j_node_and_user_rematch]: 9.41998e-06 [meta_fg_expand]: 2.09e-06 [replace_old_param]: 8.43999e-06 [inline_without_move]: 5.69999e-06 [renormalize]: 0.0020345 [add_forward_monad_depend]: 4.31002e-06 [auto_monad_grad]: 1.70001e-06 [auto_monad_eliminator]: 1.228e-05 [cse]: 1.865e-05 [replace_applicator]: 1.265e-05 [Cycle 2]: 0.00034122, [27] [switch_simplify]: 6.48998e-06 [loop_unroll]: 5.51e-06 [a_1]: 0.00011596 [with_stream_mark]: 8.32e-06 [recompute_prepare]: 5.53002e-06 [updatestate_depend_eliminate]: 2.80002e-06 [updatestate_assign_eliminate]: 2.09999e-06 [updatestate_loads_eliminate]: 2.03002e-06 [parameter_eliminate]: 1.02998e-06 [specialize_transform]: 5.46e-06 [updatestate_useless_node_eliminater]: 5.52999e-06 [accelerated_algorithm]: 5.31998e-06 [meta_shard_fg_expand]: 1.04e-06 [get_grad_eliminate_]: 5.15001e-06 [merge_forward]: 2.39999e-06 [cell_reuse_recompute_pass]: 1.39e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.279e-05 [j_node_and_user_rematch]: 8.34002e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 8.37998e-06 [inline_without_move]: 5.20001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 8.60018e-07 [auto_monad_grad]: 7.40023e-07 [auto_monad_eliminator]: 5.46e-06 [cse]: 1.021e-05 [replace_applicator]: 5.67001e-06 [py_interpret_to_execute_after_opt_a]: 8.17e-06 [rewriter_after_opt_a]: 2.784e-05 [convert_after_rewriter]: 5.86e-06 [order_py_execute_after_rewriter]: 4.68999e-06 [mutable_eliminate]: 0.0004809 [jit_opt_b]: 5.285e-05, [1] [Cycle 1]: 4.671e-05, [2] [frontend_op_eliminate]: 1.902e-05 [inline_after_opt_a]: 1.713e-05 [cconv]: 2.007e-05 [loop_unroll]: 0.00041192 [jit_opt_after_cconv]: 0.00014146, [1] [Cycle 1]: 0.00013526, [11] [c_1]: 2.478e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 5.33002e-06 [updatestate_assign_eliminate]: 2.31e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.874e-05 [call_graph_tuple_transform]: 1.866e-05 [tuple_list_get_item_eliminator]: 6.00002e-06 [none_parameter_eliminate]: 1.14e-06 [renormalize]: 2.79979e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.191e-05 [partial_unused_args_eliminate]: 2.07999e-06 [environ_conv]: 6.49001e-06 [add_recomputation]: 3.765e-05 [cse_after_recomputation]: 2.212e-05, [1] [Cycle 1]: 1.603e-05, [1] [cse]: 1.046e-05 [auto_monad_reorder]: 1.231e-05 [get_jit_bprop_graph]: 1.28002e-06 [rewriter_after_jit_bprop_graph]: 4e-06 [opt_after_jit_grad]: 0.00044475 [symbol_engine_optimizer]: 7.359e-05, [1] [Cycle 1]: 6.83e-05, [6] [build]: 3.68999e-06 [elim_shapecalc]: 8.77e-06 [elim_not_effective]: 1.417e-05 [opt_reshape]: 5.81e-06 [fold_const_symbol]: 9.82999e-06 [renormalize]: 2.60014e-07 [validate]: 9.362e-05 Sums bootstrap : 0.000232s : 0.23% type_inference : 0.097196s : 94.62% event_method : 0.000016s : 0.02% auto_monad : 0.000044s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000421s : 0.41% rewriter_before_opt_a : 0.000072s : 0.07% expand_dump_flag : 0.000002s : 0.00% jit_opt_a.switch_simplify : 0.000050s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000612s : 0.60% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002035s : 1.98% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000029s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000481s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000412s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000006s : 0.01% add_recomputation : 0.000038s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000445s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000094s : 0.09% Time group info: ------[substitution.] 0.000154 24 1.17% : 0.000002s : 2: substitution.elim_not_effective 1.54% : 0.000002s : 2: substitution.fold_const_symbol 3.49% : 0.000005s : 4: substitution.graph_param_transform 80.73% : 0.000125s : 4: substitution.inline 1.98% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.83% : 0.000004s : 4: substitution.remove_not_recompute_node 2.30% : 0.000004s : 2: substitution.replace_old_param 5.95% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.097142 2 97.58% : 0.094795s : 1: type_inference.infer 2.42% : 0.002347s : 1: type_inference.specialize ------[replace.] 0.000061 6 66.52% : 0.000041s : 4: replace.inline 33.48% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000130 6 93.79% : 0.000122s : 4: match.inline 6.21% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000124 830 1.30% : 0.000002s : 12: predicate.accumulaten_eliminater 1.32% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.26% : 0.000002s : 12: predicate.addn_zero_filter 2.00% : 0.000002s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.17% : 0.000001s : 12: predicate.compare_switch_simplify 1.23% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.27% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.34% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.91% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.18% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.05% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.04% : 0.000006s : 26: predicate.inline 0.94% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.38% : 0.000002s : 8: predicate.less_batch_normalization 1.35% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.85% : 0.000002s : 18: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.76% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.89% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.15% : 0.000001s : 12: predicate.minmaximum_grad 1.68% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.21% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000001s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.37% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.11% : 0.000003s : 22: predicate.replace_applicator 0.99% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.50% : 0.000002s : 12: predicate.reshape_eliminate 1.30% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.76% : 0.000001s : 4: predicate.row_tensor_eliminate 1.25% : 0.000002s : 12: predicate.same_eliminate 0.80% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.06% : 0.000001s : 8: predicate.special_op_eliminate 1.01% : 0.000001s : 8: predicate.specialize_transform 1.41% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.33% : 0.000003s : 18: predicate.switch_defer_inline 2.15% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.26% : 0.000009s : 58: predicate.switch_simplify 1.24% : 0.000002s : 12: predicate.tile_eliminate 1.28% : 0.000002s : 12: predicate.transpose_eliminate 1.38% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.84% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.52% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.25% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001855 22 64.80% : 0.001202s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.43% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.77% : 0.000626s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.109017 72 0.04% : 0.000040s : 1: add_recomputation 0.04% : 0.000047s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.22% : 0.000243s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000024s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000019s : 1: event_method 0.00% : 0.000004s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.63% : 0.006134s : 1: jit_opt_a 0.13% : 0.000144s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.38% : 0.000419s : 1: loop_unroll 0.45% : 0.000489s : 1: mutable_eliminate 0.75% : 0.000822s : 26: opt.transform.jit_opt_a 0.05% : 0.000052s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.39% : 0.000426s : 1: py_interpret_to_execute 0.01% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000014s : 1: remove_dup_value 1.28% : 0.001401s : 1: renormalize.infer 0.58% : 0.000627s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000031s : 1: rewriter_after_opt_a 0.07% : 0.000077s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 89.17% : 0.097209s : 1: type_inference TotalTime = 0.0110463, [30] [bootstrap]: 0.00024322 [type_inference]: 0.00404561 [event_method]: 1.658e-05 [auto_monad]: 6.365e-05 [graph_reusing]: 5.21998e-06 [pre_auto_parallel]: 2.05002e-06 [py_interpret_to_execute]: 3.106e-05 [rewriter_before_opt_a]: 6.736e-05 [expand_dump_flag]: 3.08e-06 [jit_opt_a]: 0.00466994, [2] [Cycle 1]: 0.00135851, [27] [switch_simplify]: 4.614e-05 [loop_unroll]: 2.903e-05 [a_1]: 0.00047653 [with_stream_mark]: 1.335e-05 [recompute_prepare]: 7.03e-06 [updatestate_depend_eliminate]: 3.28998e-06 [updatestate_assign_eliminate]: 2.89999e-06 [updatestate_loads_eliminate]: 2.93998e-06 [parameter_eliminate]: 1.45999e-06 [specialize_transform]: 6.02001e-06 [updatestate_useless_node_eliminater]: 4.89e-06 [accelerated_algorithm]: 5.62999e-06 [meta_shard_fg_expand]: 1.79e-06 [get_grad_eliminate_]: 5.02e-06 [merge_forward]: 3.01001e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.321e-05 [j_node_and_user_rematch]: 8.53001e-06 [meta_fg_expand]: 2.17999e-06 [replace_old_param]: 8.02e-06 [inline_without_move]: 5.17999e-06 [renormalize]: 0.00050116 [add_forward_monad_depend]: 4.72e-06 [auto_monad_grad]: 2.13002e-06 [auto_monad_eliminator]: 1.403e-05 [cse]: 2.212e-05 [replace_applicator]: 1.091e-05 [Cycle 2]: 0.00035218, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 4.69002e-06 [a_1]: 8.912e-05 [with_stream_mark]: 8.25e-06 [recompute_prepare]: 4.88001e-06 [updatestate_depend_eliminate]: 2.54999e-06 [updatestate_assign_eliminate]: 2.08998e-06 [updatestate_loads_eliminate]: 2.19001e-06 [parameter_eliminate]: 1.39e-06 [specialize_transform]: 4.98001e-06 [updatestate_useless_node_eliminater]: 4.62998e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.40002e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.188e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.51998e-06 [replace_old_param]: 6.96001e-06 [inline_without_move]: 4.58999e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.01997e-06 [auto_monad_grad]: 6.29982e-07 [auto_monad_eliminator]: 5.87001e-06 [cse]: 1.097e-05 [replace_applicator]: 5.32999e-06 [py_interpret_to_execute_after_opt_a]: 7.96001e-06 [rewriter_after_opt_a]: 3.051e-05 [convert_after_rewriter]: 6.58e-06 [order_py_execute_after_rewriter]: 4.43001e-06 [mutable_eliminate]: 0.0004606 [jit_opt_b]: 4.66e-05, [1] [Cycle 1]: 4.003e-05, [2] [frontend_op_eliminate]: 1.507e-05 [inline_after_opt_a]: 1.457e-05 [cconv]: 2.258e-05 [loop_unroll]: 0.00039779 [jit_opt_after_cconv]: 0.00014121, [1] [Cycle 1]: 0.0001258, [11] [c_1]: 1.994e-05 [parameter_eliminate]: 2.47001e-06 [updatestate_depend_eliminate]: 5.59e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.02001e-06 [cse]: 1.741e-05 [call_graph_tuple_transform]: 1.719e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.10999e-06 [renormalize]: 2.69996e-07 [switch_simplify]: 5.19e-06 [remove_dup_value]: 1.266e-05 [partial_unused_args_eliminate]: 1.82999e-06 [environ_conv]: 5.37001e-06 [add_recomputation]: 4.361e-05 [cse_after_recomputation]: 2.057e-05, [1] [Cycle 1]: 1.538e-05, [1] [cse]: 1.003e-05 [auto_monad_reorder]: 1.448e-05 [get_jit_bprop_graph]: 1.49003e-06 [rewriter_after_jit_bprop_graph]: 4.08999e-06 [opt_after_jit_grad]: 0.00043556 [symbol_engine_optimizer]: 6.941e-05, [1] [Cycle 1]: 6.352e-05, [6] [build]: 2.93e-06 [elim_shapecalc]: 7.70998e-06 [elim_not_effective]: 1.224e-05 [opt_reshape]: 5.44e-06 [fold_const_symbol]: 8.57998e-06 [renormalize]: 2.40019e-07 [validate]: 3.08e-05 Sums bootstrap : 0.000243s : 3.24% type_inference : 0.004046s : 53.82% event_method : 0.000017s : 0.22% auto_monad : 0.000064s : 0.85% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000031s : 0.41% rewriter_before_opt_a : 0.000067s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000052s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.45% jit_opt_a.a_1 : 0.000566s : 7.53% jit_opt_a.with_stream_mark : 0.000022s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.15% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000501s : 6.67% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.26% jit_opt_a.cse : 0.000033s : 0.44% jit_opt_a.replace_applicator : 0.000016s : 0.22% py_interpret_to_execute_after_opt_a : 0.000008s : 0.11% rewriter_after_opt_a : 0.000031s : 0.41% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000004s : 0.06% mutable_eliminate : 0.000461s : 6.13% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000023s : 0.30% loop_unroll : 0.000398s : 5.29% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000017s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000013s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.02% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000044s : 0.58% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000014s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000436s : 5.79% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.41% Time group info: ------[substitution.] 0.000164 23 1.33% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000001s : 2: substitution.fold_const_symbol 2.80% : 0.000005s : 3: substitution.graph_param_transform 81.29% : 0.000133s : 4: substitution.inline 1.81% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.53% : 0.000004s : 4: substitution.remove_not_recompute_node 2.08% : 0.000003s : 2: substitution.replace_old_param 7.30% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003996 2 80.92% : 0.003234s : 1: type_inference.infer 19.08% : 0.000762s : 1: type_inference.specialize ------[replace.] 0.000059 6 64.76% : 0.000038s : 4: replace.inline 35.24% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000141 6 92.30% : 0.000130s : 4: match.inline 7.70% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000109 691 1.21% : 0.000001s : 10: predicate.accumulaten_eliminater 1.21% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.31% : 0.000001s : 10: predicate.addn_check_dump 1.29% : 0.000001s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.26% : 0.000001s : 10: predicate.cast_eliminate 0.48% : 0.000001s : 3: predicate.check_bprop_eliminate 1.20% : 0.000001s : 10: predicate.compare_switch_simplify 1.19% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.36% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.53% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.33% : 0.000000s : 3: predicate.elim_not_effective 0.59% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.29% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.36% : 0.000001s : 10: predicate.environ_get_eliminate 1.17% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 0.97% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.23% : 0.000006s : 22: predicate.inline 0.94% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.55% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.83% : 0.000002s : 15: predicate.load_eliminater 1.46% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.18% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.21% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.58% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.17% : 0.000002s : 15: predicate.partial_eliminate 1.14% : 0.000001s : 10: predicate.print_const_string_wrapper 1.92% : 0.000002s : 10: predicate.reduce_eliminate 1.40% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.57% : 0.000001s : 6: predicate.remove_not_recompute_node 1.90% : 0.000002s : 18: predicate.replace_applicator 0.59% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.29% : 0.000001s : 10: predicate.reshape_eliminate 1.33% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.62% : 0.000001s : 3: predicate.row_tensor_eliminate 1.17% : 0.000001s : 10: predicate.same_eliminate 0.52% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.28% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.50% : 0.000003s : 16: predicate.switch_defer_inline 2.14% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.69% : 0.000008s : 53: predicate.switch_simplify 1.29% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.39% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.34% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.99% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.06% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.76% : 0.000002s : 10: predicate.value_based_eliminate 0.35% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.83% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000534 13 51.17% : 0.000273s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.70% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.12% : 0.000236s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012374 72 0.37% : 0.000046s : 1: add_recomputation 0.54% : 0.000067s : 1: auto_monad 0.14% : 0.000017s : 1: auto_monad_reorder 2.06% : 0.000254s : 1: bootstrap 0.20% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.76% : 0.004673s : 1: jit_opt_a 1.16% : 0.000144s : 1: jit_opt_after_cconv 0.40% : 0.000049s : 1: jit_opt_b 3.27% : 0.000405s : 1: loop_unroll 3.78% : 0.000468s : 1: mutable_eliminate 6.15% : 0.000761s : 26: opt.transform.jit_opt_a 0.36% : 0.000044s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.58% : 0.000443s : 1: opt_after_jit_grad 0.05% : 0.000006s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.27% : 0.000034s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000015s : 1: remove_dup_value 2.04% : 0.000252s : 1: renormalize.infer 1.96% : 0.000242s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000033s : 1: rewriter_after_opt_a 0.57% : 0.000070s : 1: rewriter_before_opt_a 0.58% : 0.000072s : 1: symbol_engine_optimizer 32.77% : 0.004055s : 1: type_inference TotalTime = 0.112448, [30] [bootstrap]: 0.00024685 [type_inference]: 0.102063 [event_method]: 1.69e-05 [auto_monad]: 4.741e-05 [graph_reusing]: 4.03001e-06 [pre_auto_parallel]: 1.55999e-06 [py_interpret_to_execute]: 0.00039618 [rewriter_before_opt_a]: 7.479e-05 [expand_dump_flag]: 2.72001e-06 [jit_opt_a]: 0.00752814, [2] [Cycle 1]: 0.00301946, [27] [switch_simplify]: 6.674e-05 [loop_unroll]: 3.096e-05 [a_1]: 0.00052001 [with_stream_mark]: 1.248e-05 [recompute_prepare]: 8.22998e-06 [updatestate_depend_eliminate]: 3.04001e-06 [updatestate_assign_eliminate]: 2.64001e-06 [updatestate_loads_eliminate]: 2.44001e-06 [parameter_eliminate]: 1.12e-06 [specialize_transform]: 7.16999e-06 [updatestate_useless_node_eliminater]: 5.98002e-06 [accelerated_algorithm]: 6.29999e-06 [meta_shard_fg_expand]: 1.52001e-06 [get_grad_eliminate_]: 6.01e-06 [merge_forward]: 2.79999e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.246e-05 [j_node_and_user_rematch]: 9.54999e-06 [meta_fg_expand]: 2.20002e-06 [replace_old_param]: 8.52998e-06 [inline_without_move]: 5.94e-06 [renormalize]: 0.00208837 [add_forward_monad_depend]: 4.92e-06 [auto_monad_grad]: 1.75001e-06 [auto_monad_eliminator]: 1.252e-05 [cse]: 2.01e-05 [replace_applicator]: 1.264e-05 [Cycle 2]: 0.0003465, [27] [switch_simplify]: 6.43e-06 [loop_unroll]: 5.49e-06 [a_1]: 0.00011937 [with_stream_mark]: 8.41002e-06 [recompute_prepare]: 5.47999e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.25002e-06 [updatestate_loads_eliminate]: 1.91998e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.58002e-06 [accelerated_algorithm]: 5.42999e-06 [meta_shard_fg_expand]: 1.10001e-06 [get_grad_eliminate_]: 5.24e-06 [merge_forward]: 2.53e-06 [cell_reuse_recompute_pass]: 1.17999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8.77999e-06 [meta_fg_expand]: 1.57999e-06 [replace_old_param]: 7.85998e-06 [inline_without_move]: 5.40999e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.30011e-07 [auto_monad_eliminator]: 5.84999e-06 [cse]: 1.055e-05 [replace_applicator]: 5.69999e-06 [py_interpret_to_execute_after_opt_a]: 8.60001e-06 [rewriter_after_opt_a]: 2.753e-05 [convert_after_rewriter]: 5.71e-06 [order_py_execute_after_rewriter]: 7.88001e-06 [mutable_eliminate]: 0.00047104 [jit_opt_b]: 5.338e-05, [1] [Cycle 1]: 4.737e-05, [2] [frontend_op_eliminate]: 1.877e-05 [inline_after_opt_a]: 1.83e-05 [cconv]: 2.028e-05 [loop_unroll]: 0.00045571 [jit_opt_after_cconv]: 0.00014392, [1] [Cycle 1]: 0.00013797, [11] [c_1]: 2.568e-05 [parameter_eliminate]: 2.56e-06 [updatestate_depend_eliminate]: 5.00999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 2.07001e-06 [cse]: 1.91e-05 [call_graph_tuple_transform]: 1.898e-05 [tuple_list_get_item_eliminator]: 6.28002e-06 [none_parameter_eliminate]: 1.08001e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 6.84999e-06 [remove_dup_value]: 1.064e-05 [partial_unused_args_eliminate]: 1.76998e-06 [environ_conv]: 6.56999e-06 [add_recomputation]: 3.533e-05 [cse_after_recomputation]: 2.054e-05, [1] [Cycle 1]: 1.559e-05, [1] [cse]: 1.013e-05 [auto_monad_reorder]: 1.151e-05 [get_jit_bprop_graph]: 1.57999e-06 [rewriter_after_jit_bprop_graph]: 6.14999e-06 [opt_after_jit_grad]: 0.00045657 [symbol_engine_optimizer]: 0.00012999, [1] [Cycle 1]: 0.00012391, [6] [build]: 2.91999e-06 [elim_shapecalc]: 7.68999e-06 [elim_not_effective]: 1.436e-05 [opt_reshape]: 6.73998e-06 [fold_const_symbol]: 9.61e-06 [renormalize]: 3.50003e-07 [validate]: 3.474e-05 Sums bootstrap : 0.000247s : 0.23% type_inference : 0.102063s : 94.77% event_method : 0.000017s : 0.02% auto_monad : 0.000047s : 0.04% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000396s : 0.37% rewriter_before_opt_a : 0.000075s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000073s : 0.07% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000639s : 0.59% jit_opt_a.with_stream_mark : 0.000021s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000005s : 0.00% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000016s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002088s : 1.94% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.02% jit_opt_a.cse : 0.000031s : 0.03% jit_opt_a.replace_applicator : 0.000018s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000028s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000008s : 0.01% mutable_eliminate : 0.000471s : 0.44% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000020s : 0.02% loop_unroll : 0.000456s : 0.42% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000007s : 0.01% remove_dup_value : 0.000011s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000035s : 0.03% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000012s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000006s : 0.01% opt_after_jit_grad : 0.000457s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000035s : 0.03% Time group info: ------[substitution.] 0.000166 24 1.08% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.84% : 0.000005s : 4: substitution.graph_param_transform 83.94% : 0.000140s : 4: substitution.inline 1.62% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.57% : 0.000004s : 4: substitution.remove_not_recompute_node 1.86% : 0.000003s : 2: substitution.replace_old_param 5.36% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.102004 2 97.71% : 0.099664s : 1: type_inference.infer 2.29% : 0.002340s : 1: type_inference.specialize ------[replace.] 0.000066 6 67.85% : 0.000045s : 4: replace.inline 32.15% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 94.63% : 0.000137s : 4: match.inline 5.37% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.48% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.16% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.75% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.49% : 0.000001s : 4: predicate.check_bprop_eliminate 1.13% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.12% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.30% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.40% : 0.000001s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.18% : 0.000001s : 12: predicate.environ_get_depend_swap 1.14% : 0.000001s : 12: predicate.environ_get_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.21% : 0.000006s : 26: predicate.inline 1.00% : 0.000001s : 8: predicate.inline_without_move 0.55% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.28% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.34% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.11% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.67% : 0.000001s : 4: predicate.opt_reshape 2.27% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.81% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.67% : 0.000001s : 8: predicate.remove_not_recompute_node 2.13% : 0.000003s : 22: predicate.replace_applicator 0.71% : 0.000001s : 8: predicate.replace_old_param 0.35% : 0.000000s : 4: predicate.reset_defer_inline 1.30% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.75% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.12% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.41% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.72% : 0.000010s : 58: predicate.switch_simplify 1.25% : 0.000002s : 12: predicate.tile_eliminate 1.25% : 0.000002s : 12: predicate.transpose_eliminate 1.44% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.35% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.35% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.61% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.42% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.77% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.92% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.84% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001849 22 65.48% : 0.001211s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.73% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.79% : 0.000606s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.115498 72 0.03% : 0.000038s : 1: add_recomputation 0.04% : 0.000050s : 1: auto_monad 0.01% : 0.000014s : 1: auto_monad_reorder 0.23% : 0.000260s : 1: bootstrap 0.02% : 0.000023s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000020s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 6.52% : 0.007531s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.40% : 0.000463s : 1: loop_unroll 0.41% : 0.000479s : 1: mutable_eliminate 0.76% : 0.000875s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000464s : 1: opt_after_jit_grad 0.01% : 0.000010s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.35% : 0.000402s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000013s : 1: remove_dup_value 1.26% : 0.001460s : 1: renormalize.infer 0.54% : 0.000621s : 1: renormalize.specialize 0.01% : 0.000008s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000030s : 1: rewriter_after_opt_a 0.07% : 0.000080s : 1: rewriter_before_opt_a 0.11% : 0.000133s : 1: symbol_engine_optimizer 88.38% : 0.102076s : 1: type_inference TotalTime = 0.0576715, [30] [bootstrap]: 0.00027321 [type_inference]: 0.0492193 [event_method]: 1.642e-05 [auto_monad]: 4.733e-05 [graph_reusing]: 3.76001e-06 [pre_auto_parallel]: 1.60001e-06 [py_interpret_to_execute]: 0.00023094 [rewriter_before_opt_a]: 7.404e-05 [expand_dump_flag]: 3.06001e-06 [jit_opt_a]: 0.0058942, [2] [Cycle 1]: 0.00248565, [27] [switch_simplify]: 4.553e-05 [loop_unroll]: 2.969e-05 [a_1]: 0.00050468 [with_stream_mark]: 1.154e-05 [recompute_prepare]: 8.2e-06 [updatestate_depend_eliminate]: 3.26001e-06 [updatestate_assign_eliminate]: 2.46e-06 [updatestate_loads_eliminate]: 2.31e-06 [parameter_eliminate]: 1.12999e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 5.77001e-06 [accelerated_algorithm]: 6.11e-06 [meta_shard_fg_expand]: 1.20001e-06 [get_grad_eliminate_]: 5.80002e-06 [merge_forward]: 2.73998e-06 [cell_reuse_recompute_pass]: 8.00006e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.138e-05 [j_node_and_user_rematch]: 9.05999e-06 [meta_fg_expand]: 1.82999e-06 [replace_old_param]: 9.31002e-06 [inline_without_move]: 5.94999e-06 [renormalize]: 0.0016023 [add_forward_monad_depend]: 4.32998e-06 [auto_monad_grad]: 1.12e-06 [auto_monad_eliminator]: 1.1e-05 [cse]: 1.891e-05 [replace_applicator]: 1.298e-05 [Cycle 2]: 0.00034176, [27] [switch_simplify]: 6.14001e-06 [loop_unroll]: 5.62001e-06 [a_1]: 0.00011595 [with_stream_mark]: 8.16002e-06 [recompute_prepare]: 5.91e-06 [updatestate_depend_eliminate]: 2.49001e-06 [updatestate_assign_eliminate]: 2.12001e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 9.30013e-07 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.51e-06 [meta_shard_fg_expand]: 1.09e-06 [get_grad_eliminate_]: 5.15999e-06 [merge_forward]: 2.31e-06 [cell_reuse_recompute_pass]: 1.34998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.277e-05 [j_node_and_user_rematch]: 8.33999e-06 [meta_fg_expand]: 1.60001e-06 [replace_old_param]: 7.99002e-06 [inline_without_move]: 5.34e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 9.70002e-07 [auto_monad_grad]: 6.19999e-07 [auto_monad_eliminator]: 5.26998e-06 [cse]: 1.053e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 7.77e-06 [rewriter_after_opt_a]: 2.594e-05 [convert_after_rewriter]: 5.52001e-06 [order_py_execute_after_rewriter]: 3.91999e-06 [mutable_eliminate]: 0.00045993 [jit_opt_b]: 5.191e-05, [1] [Cycle 1]: 4.533e-05, [2] [frontend_op_eliminate]: 1.811e-05 [inline_after_opt_a]: 1.694e-05 [cconv]: 1.549e-05 [loop_unroll]: 0.00041463 [jit_opt_after_cconv]: 0.00013896, [1] [Cycle 1]: 0.00013295, [11] [c_1]: 2.456e-05 [parameter_eliminate]: 2.41e-06 [updatestate_depend_eliminate]: 5.37001e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.04e-06 [cse]: 1.795e-05 [call_graph_tuple_transform]: 1.791e-05 [tuple_list_get_item_eliminator]: 5.82999e-06 [none_parameter_eliminate]: 8.09989e-07 [renormalize]: 3.69997e-07 [switch_simplify]: 5.87999e-06 [remove_dup_value]: 7.75998e-06 [partial_unused_args_eliminate]: 1.68002e-06 [environ_conv]: 5.49e-06 [add_recomputation]: 3.06e-05 [cse_after_recomputation]: 1.996e-05, [1] [Cycle 1]: 1.523e-05, [1] [cse]: 9.84001e-06 [auto_monad_reorder]: 8.67e-06 [get_jit_bprop_graph]: 1.36002e-06 [rewriter_after_jit_bprop_graph]: 4.13001e-06 [opt_after_jit_grad]: 0.00044257 [symbol_engine_optimizer]: 6.798e-05, [1] [Cycle 1]: 6.246e-05, [6] [build]: 2.46998e-06 [elim_shapecalc]: 7.41999e-06 [elim_not_effective]: 1.184e-05 [opt_reshape]: 6.09001e-06 [fold_const_symbol]: 8.1e-06 [renormalize]: 3.19997e-07 [validate]: 4.033e-05 Sums bootstrap : 0.000273s : 0.51% type_inference : 0.049219s : 91.02% event_method : 0.000016s : 0.03% auto_monad : 0.000047s : 0.09% graph_reusing : 0.000004s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000231s : 0.43% rewriter_before_opt_a : 0.000074s : 0.14% expand_dump_flag : 0.000003s : 0.01% jit_opt_a.switch_simplify : 0.000052s : 0.10% jit_opt_a.loop_unroll : 0.000035s : 0.07% jit_opt_a.a_1 : 0.000621s : 1.15% jit_opt_a.with_stream_mark : 0.000020s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000004s : 0.01% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000002s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000005s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.04% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.03% jit_opt_a.meta_fg_expand : 0.000003s : 0.01% jit_opt_a.replace_old_param : 0.000017s : 0.03% jit_opt_a.inline_without_move : 0.000011s : 0.02% jit_opt_a.renormalize : 0.001602s : 2.96% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000016s : 0.03% jit_opt_a.cse : 0.000029s : 0.05% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000026s : 0.05% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000004s : 0.01% mutable_eliminate : 0.000460s : 0.85% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.03% jit_opt_b.inline_after_opt_a : 0.000017s : 0.03% cconv : 0.000015s : 0.03% loop_unroll : 0.000415s : 0.77% jit_opt_after_cconv.c_1 : 0.000025s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.03% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000008s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000005s : 0.01% add_recomputation : 0.000031s : 0.06% cse_after_recomputation.cse : 0.000010s : 0.02% auto_monad_reorder : 0.000009s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.01% opt_after_jit_grad : 0.000443s : 0.82% symbol_engine_optimizer.build : 0.000002s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000040s : 0.07% Time group info: ------[substitution.] 0.000159 24 0.79% : 0.000001s : 2: substitution.elim_not_effective 0.55% : 0.000001s : 2: substitution.fold_const_symbol 2.80% : 0.000004s : 4: substitution.graph_param_transform 84.23% : 0.000134s : 4: substitution.inline 1.64% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000004s : 4: substitution.remove_not_recompute_node 2.30% : 0.000004s : 2: substitution.replace_old_param 4.95% : 0.000008s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.049157 2 96.70% : 0.047532s : 1: type_inference.infer 3.30% : 0.001624s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.82% : 0.000042s : 4: replace.inline 33.18% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000138 6 95.14% : 0.000131s : 4: match.inline 4.86% : 0.000007s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000123 830 1.27% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.68% : 0.000002s : 12: predicate.arithmetic_simplify 1.30% : 0.000002s : 12: predicate.cast_eliminate 0.50% : 0.000001s : 4: predicate.check_bprop_eliminate 1.11% : 0.000001s : 12: predicate.compare_switch_simplify 1.16% : 0.000001s : 12: predicate.depend_value_elim 1.14% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.23% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.03% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.58% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_depend_swap 1.26% : 0.000002s : 12: predicate.environ_get_eliminate 1.17% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.04% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 4.97% : 0.000006s : 26: predicate.inline 1.05% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.14% : 0.000001s : 8: predicate.less_batch_normalization 1.57% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 2.18% : 0.000003s : 18: predicate.load_eliminater 1.51% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.97% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.94% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.16% : 0.000001s : 12: predicate.merge_addn 1.12% : 0.000001s : 12: predicate.minmaximum_grad 1.53% : 0.000002s : 4: predicate.mutable_eliminate 0.53% : 0.000001s : 4: predicate.opt_reshape 2.45% : 0.000003s : 18: predicate.partial_eliminate 1.23% : 0.000002s : 12: predicate.print_const_string_wrapper 1.66% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.65% : 0.000001s : 8: predicate.remove_not_recompute_node 2.15% : 0.000003s : 22: predicate.replace_applicator 0.69% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.39% : 0.000002s : 12: predicate.reshape_eliminate 1.24% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 4: predicate.row_tensor_eliminate 1.28% : 0.000002s : 12: predicate.same_eliminate 0.79% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.40% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.20% : 0.000001s : 12: predicate.stack_unstack_eliminate 0.49% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 18: predicate.switch_defer_inline 2.39% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.49% : 0.000009s : 58: predicate.switch_simplify 1.23% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.47% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.48% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.58% : 0.000004s : 22: predicate.tuple_list_get_item_eliminator 1.57% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.13% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.49% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.75% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001958 26 71.67% : 0.001404s : 19: func_graph_cloner_run.FuncGraphClonerGraph 1.46% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 26.87% : 0.000526s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.060176 72 0.06% : 0.000033s : 1: add_recomputation 0.08% : 0.000051s : 1: auto_monad 0.02% : 0.000011s : 1: auto_monad_reorder 0.47% : 0.000285s : 1: bootstrap 0.03% : 0.000018s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.04% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000008s : 1: environ_conv 0.03% : 0.000020s : 1: event_method 0.01% : 0.000005s : 1: expand_dump_flag 0.01% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 9.80% : 0.005897s : 1: jit_opt_a 0.24% : 0.000142s : 1: jit_opt_after_cconv 0.09% : 0.000054s : 1: jit_opt_b 0.70% : 0.000423s : 1: loop_unroll 0.78% : 0.000468s : 1: mutable_eliminate 1.39% : 0.000834s : 26: opt.transform.jit_opt_a 0.08% : 0.000051s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000029s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000013s : 1: opt.transform.mutable_eliminate 0.04% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.05% : 0.000031s : 4: opt.transform.symbol_engine_opt 0.75% : 0.000450s : 1: opt_after_jit_grad 0.01% : 0.000006s : 1: order_py_execute_after_rewriter 0.01% : 0.000004s : 1: partial_unused_args_eliminate 0.01% : 0.000003s : 1: pre_auto_parallel 0.39% : 0.000236s : 1: py_interpret_to_execute 0.02% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000010s : 1: remove_dup_value 1.76% : 0.001057s : 1: renormalize.infer 0.89% : 0.000538s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000029s : 1: rewriter_after_opt_a 0.13% : 0.000079s : 1: rewriter_before_opt_a 0.12% : 0.000070s : 1: symbol_engine_optimizer 81.81% : 0.049231s : 1: type_inference TotalTime = 0.0120576, [30] [bootstrap]: 0.00027716 [type_inference]: 0.00463876 [event_method]: 1.739e-05 [auto_monad]: 6.715e-05 [graph_reusing]: 5.71e-06 [pre_auto_parallel]: 2.56998e-06 [py_interpret_to_execute]: 3.853e-05 [rewriter_before_opt_a]: 7.893e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.00493273, [2] [Cycle 1]: 0.00146241, [27] [switch_simplify]: 5.406e-05 [loop_unroll]: 2.977e-05 [a_1]: 0.00050558 [with_stream_mark]: 1.63e-05 [recompute_prepare]: 7.28999e-06 [updatestate_depend_eliminate]: 3.78999e-06 [updatestate_assign_eliminate]: 3.11001e-06 [updatestate_loads_eliminate]: 3.2e-06 [parameter_eliminate]: 1.74e-06 [specialize_transform]: 6.03998e-06 [updatestate_useless_node_eliminater]: 5.22e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.37999e-06 [get_grad_eliminate_]: 5.26002e-06 [merge_forward]: 4.12e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.47e-05 [j_node_and_user_rematch]: 9.20999e-06 [meta_fg_expand]: 2.68e-06 [replace_old_param]: 9.25999e-06 [inline_without_move]: 5.42001e-06 [renormalize]: 0.00054189 [add_forward_monad_depend]: 5.63002e-06 [auto_monad_grad]: 2.27999e-06 [auto_monad_eliminator]: 1.405e-05 [cse]: 2.883e-05 [replace_applicator]: 1.098e-05 [Cycle 2]: 0.00030751, [27] [switch_simplify]: 5.59998e-06 [loop_unroll]: 4.77998e-06 [a_1]: 9.048e-05 [with_stream_mark]: 7.97e-06 [recompute_prepare]: 4.88001e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.17999e-06 [updatestate_loads_eliminate]: 1.99999e-06 [parameter_eliminate]: 1.09e-06 [specialize_transform]: 4.79998e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.48999e-06 [meta_shard_fg_expand]: 1.26002e-06 [get_grad_eliminate_]: 4.58999e-06 [merge_forward]: 2.26e-06 [cell_reuse_recompute_pass]: 1.09003e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.227e-05 [j_node_and_user_rematch]: 7.45003e-06 [meta_fg_expand]: 1.54e-06 [replace_old_param]: 6.89999e-06 [inline_without_move]: 4.70001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.19998e-06 [auto_monad_grad]: 5.89993e-07 [auto_monad_eliminator]: 5.49998e-06 [cse]: 1.045e-05 [replace_applicator]: 4.92e-06 [py_interpret_to_execute_after_opt_a]: 7.75e-06 [rewriter_after_opt_a]: 3.227e-05 [convert_after_rewriter]: 6.53e-06 [order_py_execute_after_rewriter]: 4.78001e-06 [mutable_eliminate]: 0.00051523 [jit_opt_b]: 4.76e-05, [1] [Cycle 1]: 4.081e-05, [2] [frontend_op_eliminate]: 1.535e-05 [inline_after_opt_a]: 1.498e-05 [cconv]: 2.356e-05 [loop_unroll]: 0.00040552 [jit_opt_after_cconv]: 0.0001346, [1] [Cycle 1]: 0.0001282, [11] [c_1]: 2.002e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.12999e-06 [updatestate_assign_eliminate]: 2.23002e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 1.758e-05 [call_graph_tuple_transform]: 1.833e-05 [tuple_list_get_item_eliminator]: 5.26998e-06 [none_parameter_eliminate]: 1.86e-06 [renormalize]: 5.69999e-07 [switch_simplify]: 5.14e-06 [remove_dup_value]: 1.616e-05 [partial_unused_args_eliminate]: 2.43998e-06 [environ_conv]: 5.22999e-06 [add_recomputation]: 4.683e-05 [cse_after_recomputation]: 2.015e-05, [1] [Cycle 1]: 1.528e-05, [1] [cse]: 9.89001e-06 [auto_monad_reorder]: 1.517e-05 [get_jit_bprop_graph]: 1.103e-05 [rewriter_after_jit_bprop_graph]: 4.80001e-06 [opt_after_jit_grad]: 0.00044315 [symbol_engine_optimizer]: 6.934e-05, [1] [Cycle 1]: 6.361e-05, [6] [build]: 3.28e-06 [elim_shapecalc]: 7.56999e-06 [elim_not_effective]: 1.231e-05 [opt_reshape]: 5.46998e-06 [fold_const_symbol]: 8.07e-06 [renormalize]: 3.09985e-07 [validate]: 3.052e-05 Sums bootstrap : 0.000277s : 3.32% type_inference : 0.004639s : 55.50% event_method : 0.000017s : 0.21% auto_monad : 0.000067s : 0.80% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000003s : 0.03% py_interpret_to_execute : 0.000039s : 0.46% rewriter_before_opt_a : 0.000079s : 0.94% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000060s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.41% jit_opt_a.a_1 : 0.000596s : 7.13% jit_opt_a.with_stream_mark : 0.000024s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.15% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.13% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.12% jit_opt_a.accelerated_algorithm : 0.000010s : 0.12% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.12% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000017s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.12% jit_opt_a.renormalize : 0.000542s : 6.48% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.23% jit_opt_a.cse : 0.000039s : 0.47% jit_opt_a.replace_applicator : 0.000016s : 0.19% py_interpret_to_execute_after_opt_a : 0.000008s : 0.09% rewriter_after_opt_a : 0.000032s : 0.39% convert_after_rewriter : 0.000007s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000515s : 6.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.18% jit_opt_b.inline_after_opt_a : 0.000015s : 0.18% cconv : 0.000024s : 0.28% loop_unroll : 0.000406s : 4.85% jit_opt_after_cconv.c_1 : 0.000020s : 0.24% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.06% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.21% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.22% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.06% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000016s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000047s : 0.56% cse_after_recomputation.cse : 0.000010s : 0.12% auto_monad_reorder : 0.000015s : 0.18% get_jit_bprop_graph : 0.000011s : 0.13% rewriter_after_jit_bprop_graph : 0.000005s : 0.06% opt_after_jit_grad : 0.000443s : 5.30% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.09% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.10% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.37% Time group info: ------[substitution.] 0.000183 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.72% : 0.000001s : 2: substitution.fold_const_symbol 2.95% : 0.000005s : 3: substitution.graph_param_transform 82.42% : 0.000151s : 4: substitution.inline 1.68% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.20% : 0.000004s : 2: substitution.replace_old_param 6.35% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004581 2 81.94% : 0.003754s : 1: type_inference.infer 18.06% : 0.000827s : 1: type_inference.specialize ------[replace.] 0.000066 6 68.86% : 0.000045s : 4: replace.inline 31.14% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000159 6 93.35% : 0.000148s : 4: match.inline 6.65% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.60% : 0.000002s : 10: predicate.accumulaten_eliminater 1.05% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.12% : 0.000001s : 10: predicate.addn_check_dump 1.15% : 0.000001s : 10: predicate.addn_zero_filter 1.75% : 0.000002s : 10: predicate.arithmetic_simplify 1.42% : 0.000002s : 10: predicate.cast_eliminate 0.47% : 0.000001s : 3: predicate.check_bprop_eliminate 1.10% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.15% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.14% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.50% : 0.000002s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.63% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.23% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.43% : 0.000000s : 3: predicate.graph_param_transform 5.36% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 6: predicate.less_batch_normalization 1.42% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.72% : 0.000002s : 15: predicate.load_eliminater 1.40% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.21% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.01% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 10: predicate.merge_addn 1.24% : 0.000001s : 10: predicate.minmaximum_grad 1.67% : 0.000002s : 3: predicate.mutable_eliminate 0.53% : 0.000001s : 3: predicate.opt_reshape 2.43% : 0.000003s : 15: predicate.partial_eliminate 1.24% : 0.000001s : 10: predicate.print_const_string_wrapper 1.87% : 0.000002s : 10: predicate.reduce_eliminate 1.47% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.77% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.74% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.34% : 0.000002s : 10: predicate.reshape_eliminate 1.18% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.66% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.55% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.85% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.42% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.68% : 0.000009s : 53: predicate.switch_simplify 1.17% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.47% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.22% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.21% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.50% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.58% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.09% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.60% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000589 13 52.96% : 0.000312s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.55% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.49% : 0.000250s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.013464 72 0.37% : 0.000049s : 1: add_recomputation 0.52% : 0.000071s : 1: auto_monad 0.13% : 0.000018s : 1: auto_monad_reorder 2.17% : 0.000292s : 1: bootstrap 0.19% : 0.000026s : 1: cconv 0.06% : 0.000009s : 1: convert_after_rewriter 0.16% : 0.000022s : 1: cse_after_recomputation 0.05% : 0.000007s : 1: environ_conv 0.16% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.10% : 0.000013s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 36.66% : 0.004935s : 1: jit_opt_a 1.02% : 0.000137s : 1: jit_opt_after_cconv 0.37% : 0.000050s : 1: jit_opt_b 3.07% : 0.000413s : 1: loop_unroll 3.89% : 0.000523s : 1: mutable_eliminate 5.94% : 0.000800s : 26: opt.transform.jit_opt_a 0.34% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.18% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.09% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.23% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.35% : 0.000451s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000005s : 1: pre_auto_parallel 0.31% : 0.000041s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.14% : 0.000018s : 1: remove_dup_value 2.00% : 0.000270s : 1: renormalize.infer 1.97% : 0.000265s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000035s : 1: rewriter_after_opt_a 0.61% : 0.000082s : 1: rewriter_before_opt_a 0.53% : 0.000072s : 1: symbol_engine_optimizer 34.54% : 0.004651s : 1: type_inference TotalTime = 0.10931, [30] [bootstrap]: 0.00026178 [type_inference]: 0.100169 [event_method]: 1.733e-05 [auto_monad]: 5.238e-05 [graph_reusing]: 4.13999e-06 [pre_auto_parallel]: 1.71998e-06 [py_interpret_to_execute]: 0.00039276 [rewriter_before_opt_a]: 7.657e-05 [expand_dump_flag]: 3.08998e-06 [jit_opt_a]: 0.00626569, [2] [Cycle 1]: 0.0029989, [27] [switch_simplify]: 4.628e-05 [loop_unroll]: 3.043e-05 [a_1]: 0.00052044 [with_stream_mark]: 1.316e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 3.36001e-06 [updatestate_assign_eliminate]: 3.09001e-06 [updatestate_loads_eliminate]: 2.59999e-06 [parameter_eliminate]: 1.30999e-06 [specialize_transform]: 6.61e-06 [updatestate_useless_node_eliminater]: 5.82001e-06 [accelerated_algorithm]: 6.37001e-06 [meta_shard_fg_expand]: 1.57001e-06 [get_grad_eliminate_]: 6.12999e-06 [merge_forward]: 2.89999e-06 [cell_reuse_recompute_pass]: 9.30013e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 1.001e-05 [meta_fg_expand]: 2.64001e-06 [replace_old_param]: 9.32001e-06 [inline_without_move]: 5.90002e-06 [renormalize]: 0.00208477 [add_forward_monad_depend]: 4.42e-06 [auto_monad_grad]: 2.24001e-06 [auto_monad_eliminator]: 1.364e-05 [cse]: 2.402e-05 [replace_applicator]: 1.341e-05 [Cycle 2]: 0.00034737, [27] [switch_simplify]: 6.61e-06 [loop_unroll]: 5.86e-06 [a_1]: 0.00011611 [with_stream_mark]: 8.85001e-06 [recompute_prepare]: 5.80002e-06 [updatestate_depend_eliminate]: 2.79001e-06 [updatestate_assign_eliminate]: 2.07001e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 5.57999e-06 [updatestate_useless_node_eliminater]: 5.49e-06 [accelerated_algorithm]: 5.66998e-06 [meta_shard_fg_expand]: 1.00001e-06 [get_grad_eliminate_]: 5.30001e-06 [merge_forward]: 2.66999e-06 [cell_reuse_recompute_pass]: 1.40001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.315e-05 [j_node_and_user_rematch]: 8.59e-06 [meta_fg_expand]: 1.60999e-06 [replace_old_param]: 8.1e-06 [inline_without_move]: 5.27001e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 6.01998e-06 [cse]: 1.106e-05 [replace_applicator]: 5.76998e-06 [py_interpret_to_execute_after_opt_a]: 9.67001e-06 [rewriter_after_opt_a]: 2.996e-05 [convert_after_rewriter]: 6.20002e-06 [order_py_execute_after_rewriter]: 4.52e-06 [mutable_eliminate]: 0.00051536 [jit_opt_b]: 5.363e-05, [1] [Cycle 1]: 4.714e-05, [2] [frontend_op_eliminate]: 1.922e-05 [inline_after_opt_a]: 1.684e-05 [cconv]: 2.386e-05 [loop_unroll]: 0.00040856 [jit_opt_after_cconv]: 0.00014349, [1] [Cycle 1]: 0.00013728, [11] [c_1]: 2.503e-05 [parameter_eliminate]: 2.25002e-06 [updatestate_depend_eliminate]: 5.46998e-06 [updatestate_assign_eliminate]: 2.22001e-06 [updatestate_loads_eliminate]: 3.09999e-06 [cse]: 1.864e-05 [call_graph_tuple_transform]: 1.921e-05 [tuple_list_get_item_eliminator]: 6.13998e-06 [none_parameter_eliminate]: 1.25999e-06 [renormalize]: 1.69995e-07 [switch_simplify]: 5.82001e-06 [remove_dup_value]: 1.245e-05 [partial_unused_args_eliminate]: 2.10002e-06 [environ_conv]: 6.86999e-06 [add_recomputation]: 4e-05 [cse_after_recomputation]: 2.105e-05, [1] [Cycle 1]: 1.616e-05, [1] [cse]: 1.089e-05 [auto_monad_reorder]: 1.306e-05 [get_jit_bprop_graph]: 2.09e-06 [rewriter_after_jit_bprop_graph]: 3.69002e-06 [opt_after_jit_grad]: 0.0004445 [symbol_engine_optimizer]: 7.311e-05, [1] [Cycle 1]: 6.767e-05, [6] [build]: 2.78e-06 [elim_shapecalc]: 1.008e-05 [elim_not_effective]: 1.268e-05 [opt_reshape]: 5.76998e-06 [fold_const_symbol]: 1.007e-05 [renormalize]: 3.39991e-07 [validate]: 8.742e-05 Sums bootstrap : 0.000262s : 0.25% type_inference : 0.100169s : 94.63% event_method : 0.000017s : 0.02% auto_monad : 0.000052s : 0.05% graph_reusing : 0.000004s : 0.00% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000393s : 0.37% rewriter_before_opt_a : 0.000077s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000053s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000637s : 0.60% jit_opt_a.with_stream_mark : 0.000022s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000002s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.02% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.002085s : 1.97% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.02% jit_opt_a.cse : 0.000035s : 0.03% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000030s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000515s : 0.49% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000409s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000019s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000012s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000040s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000013s : 0.01% get_jit_bprop_graph : 0.000002s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000444s : 0.42% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000010s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000087s : 0.08% Time group info: ------[substitution.] 0.000173 24 1.34% : 0.000002s : 2: substitution.elim_not_effective 0.62% : 0.000001s : 2: substitution.fold_const_symbol 2.98% : 0.000005s : 4: substitution.graph_param_transform 82.79% : 0.000143s : 4: substitution.inline 1.91% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.62% : 0.000005s : 4: substitution.remove_not_recompute_node 2.25% : 0.000004s : 2: substitution.replace_old_param 5.49% : 0.000009s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.100111 2 97.66% : 0.097768s : 1: type_inference.infer 2.34% : 0.002342s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.67% : 0.000044s : 4: replace.inline 33.33% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000149 6 94.39% : 0.000140s : 4: match.inline 5.61% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000125 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.05% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.11% : 0.000001s : 12: predicate.addn_check_dump 1.28% : 0.000002s : 12: predicate.addn_zero_filter 1.76% : 0.000002s : 12: predicate.arithmetic_simplify 1.31% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000001s : 12: predicate.compare_switch_simplify 1.22% : 0.000002s : 12: predicate.depend_value_elim 1.25% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.07% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.57% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.23% : 0.000002s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000000s : 4: predicate.graph_param_transform 5.45% : 0.000007s : 26: predicate.inline 1.01% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 8: predicate.less_batch_normalization 1.56% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.82% : 0.000002s : 18: predicate.load_eliminater 1.24% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.99% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.15% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.15% : 0.000001s : 12: predicate.merge_addn 1.16% : 0.000001s : 12: predicate.minmaximum_grad 1.71% : 0.000002s : 4: predicate.mutable_eliminate 0.44% : 0.000001s : 4: predicate.opt_reshape 2.30% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.97% : 0.000002s : 12: predicate.reduce_eliminate 1.45% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000002s : 22: predicate.replace_applicator 0.91% : 0.000001s : 8: predicate.replace_old_param 0.46% : 0.000001s : 4: predicate.reset_defer_inline 1.27% : 0.000002s : 12: predicate.reshape_eliminate 1.29% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.68% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.77% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.09% : 0.000001s : 8: predicate.specialize_transform 1.45% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.30% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.28% : 0.000003s : 18: predicate.switch_defer_inline 2.19% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.44% : 0.000009s : 58: predicate.switch_simplify 1.36% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.48% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.69% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.89% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.62% : 0.000002s : 12: predicate.value_based_eliminate 0.38% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001934 22 64.31% : 0.001244s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.60% : 0.000031s : 1: func_graph_cloner_run.FuncGraphClonerNode 34.08% : 0.000659s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112275 72 0.04% : 0.000043s : 1: add_recomputation 0.05% : 0.000056s : 1: auto_monad 0.01% : 0.000015s : 1: auto_monad_reorder 0.25% : 0.000280s : 1: bootstrap 0.02% : 0.000026s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000021s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000006s : 1: graph_reusing 5.58% : 0.006268s : 1: jit_opt_a 0.13% : 0.000146s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.37% : 0.000416s : 1: loop_unroll 0.47% : 0.000524s : 1: mutable_eliminate 0.76% : 0.000854s : 26: opt.transform.jit_opt_a 0.05% : 0.000053s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000036s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000452s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000003s : 1: pre_auto_parallel 0.35% : 0.000398s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000015s : 1: remove_dup_value 1.26% : 0.001417s : 1: renormalize.infer 0.59% : 0.000660s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000033s : 1: rewriter_after_opt_a 0.07% : 0.000082s : 1: rewriter_before_opt_a 0.07% : 0.000075s : 1: symbol_engine_optimizer 89.23% : 0.100181s : 1: type_inference TotalTime = 0.110453, [30] [bootstrap]: 0.00027548 [type_inference]: 0.101113 [event_method]: 1.795e-05 [auto_monad]: 6.746e-05 [graph_reusing]: 6.32001e-06 [pre_auto_parallel]: 2.64001e-06 [py_interpret_to_execute]: 0.00040957 [rewriter_before_opt_a]: 8.253e-05 [expand_dump_flag]: 3.86001e-06 [jit_opt_a]: 0.00636903, [2] [Cycle 1]: 0.00302246, [27] [switch_simplify]: 5.167e-05 [loop_unroll]: 3.226e-05 [a_1]: 0.00055782 [with_stream_mark]: 1.641e-05 [recompute_prepare]: 7.88001e-06 [updatestate_depend_eliminate]: 4.1e-06 [updatestate_assign_eliminate]: 3.28e-06 [updatestate_loads_eliminate]: 3.03e-06 [parameter_eliminate]: 1.64e-06 [specialize_transform]: 6.74001e-06 [updatestate_useless_node_eliminater]: 6.29001e-06 [accelerated_algorithm]: 6.21e-06 [meta_shard_fg_expand]: 2.22001e-06 [get_grad_eliminate_]: 6.07001e-06 [merge_forward]: 4.15e-06 [cell_reuse_recompute_pass]: 1.12e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.426e-05 [j_node_and_user_rematch]: 9.79999e-06 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.12001e-06 [inline_without_move]: 6.23e-06 [renormalize]: 0.00203327 [add_forward_monad_depend]: 5.03002e-06 [auto_monad_grad]: 2.48e-06 [auto_monad_eliminator]: 1.713e-05 [cse]: 3.073e-05 [replace_applicator]: 1.394e-05 [Cycle 2]: 0.00035488, [27] [switch_simplify]: 6.88998e-06 [loop_unroll]: 6.07999e-06 [a_1]: 0.00012029 [with_stream_mark]: 1.056e-05 [recompute_prepare]: 5.62999e-06 [updatestate_depend_eliminate]: 2.79999e-06 [updatestate_assign_eliminate]: 2.14e-06 [updatestate_loads_eliminate]: 2.22999e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.72001e-06 [updatestate_useless_node_eliminater]: 5.47001e-06 [accelerated_algorithm]: 5.55001e-06 [meta_shard_fg_expand]: 1.25999e-06 [get_grad_eliminate_]: 5.29998e-06 [merge_forward]: 2.72001e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.294e-05 [j_node_and_user_rematch]: 8.79998e-06 [meta_fg_expand]: 1.73002e-06 [replace_old_param]: 8.81002e-06 [inline_without_move]: 5.39e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.09998e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.138e-05 [replace_applicator]: 5.76e-06 [py_interpret_to_execute_after_opt_a]: 9.15999e-06 [rewriter_after_opt_a]: 3.158e-05 [convert_after_rewriter]: 7.47002e-06 [order_py_execute_after_rewriter]: 4.90999e-06 [mutable_eliminate]: 0.00050111 [jit_opt_b]: 5.442e-05, [1] [Cycle 1]: 4.648e-05, [2] [frontend_op_eliminate]: 1.86e-05 [inline_after_opt_a]: 1.718e-05 [cconv]: 2.483e-05 [loop_unroll]: 0.00042822 [jit_opt_after_cconv]: 0.00014586, [1] [Cycle 1]: 0.0001394, [11] [c_1]: 2.505e-05 [parameter_eliminate]: 2.29001e-06 [updatestate_depend_eliminate]: 6.48e-06 [updatestate_assign_eliminate]: 2.37999e-06 [updatestate_loads_eliminate]: 2.12999e-06 [cse]: 1.86e-05 [call_graph_tuple_transform]: 2.022e-05 [tuple_list_get_item_eliminator]: 6.66e-06 [none_parameter_eliminate]: 1.69998e-06 [renormalize]: 4.10015e-07 [switch_simplify]: 5.92001e-06 [remove_dup_value]: 1.505e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 7.84002e-06 [add_recomputation]: 4.564e-05 [cse_after_recomputation]: 2.13e-05, [1] [Cycle 1]: 1.555e-05, [1] [cse]: 1.017e-05 [auto_monad_reorder]: 1.576e-05 [get_jit_bprop_graph]: 1.42e-06 [rewriter_after_jit_bprop_graph]: 4.52e-06 [opt_after_jit_grad]: 0.00044343 [symbol_engine_optimizer]: 7.306e-05, [1] [Cycle 1]: 6.733e-05, [6] [build]: 3.06001e-06 [elim_shapecalc]: 8.42e-06 [elim_not_effective]: 1.403e-05 [opt_reshape]: 5.99e-06 [fold_const_symbol]: 9.67001e-06 [renormalize]: 3.19997e-07 [validate]: 9.854e-05 Sums bootstrap : 0.000275s : 0.26% type_inference : 0.101113s : 94.58% event_method : 0.000018s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000410s : 0.38% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000059s : 0.05% jit_opt_a.loop_unroll : 0.000038s : 0.04% jit_opt_a.a_1 : 0.000678s : 0.63% jit_opt_a.with_stream_mark : 0.000027s : 0.03% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.01% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002033s : 1.90% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000023s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000020s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000501s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000428s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000007s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000016s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.00% opt_after_jit_grad : 0.000443s : 0.41% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000099s : 0.09% Time group info: ------[substitution.] 0.000199 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.57% : 0.000001s : 2: substitution.fold_const_symbol 2.75% : 0.000005s : 4: substitution.graph_param_transform 83.54% : 0.000167s : 4: substitution.inline 1.60% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.49% : 0.000005s : 4: substitution.remove_not_recompute_node 2.06% : 0.000004s : 2: substitution.replace_old_param 6.12% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.101047 2 97.66% : 0.098687s : 1: type_inference.infer 2.34% : 0.002360s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.52% : 0.000046s : 4: replace.inline 31.48% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000175 6 93.69% : 0.000164s : 4: match.inline 6.31% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.15% : 0.000001s : 12: predicate.accumulaten_eliminater 0.99% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.15% : 0.000001s : 12: predicate.addn_check_dump 1.22% : 0.000002s : 12: predicate.addn_zero_filter 1.86% : 0.000002s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.52% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.19% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.09% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.13% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 4: predicate.elim_not_effective 0.56% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.21% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.35% : 0.000000s : 4: predicate.graph_param_transform 5.76% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.49% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.26% : 0.000002s : 8: predicate.less_batch_normalization 1.41% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.74% : 0.000002s : 18: predicate.load_eliminater 1.45% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.20% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.09% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.54% : 0.000001s : 4: predicate.opt_reshape 2.33% : 0.000003s : 18: predicate.partial_eliminate 1.20% : 0.000002s : 12: predicate.print_const_string_wrapper 1.64% : 0.000002s : 12: predicate.reduce_eliminate 1.49% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.60% : 0.000001s : 8: predicate.remove_not_recompute_node 2.05% : 0.000003s : 22: predicate.replace_applicator 0.78% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000001s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.22% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.71% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 0.99% : 0.000001s : 8: predicate.special_op_eliminate 1.05% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.24% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.21% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.68% : 0.000010s : 58: predicate.switch_simplify 1.28% : 0.000002s : 12: predicate.tile_eliminate 1.70% : 0.000002s : 12: predicate.transpose_eliminate 1.42% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.18% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.39% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.75% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.65% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.01% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.32% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.65% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001935 22 66.36% : 0.001284s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.36% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.28% : 0.000624s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.113404 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000018s : 1: auto_monad_reorder 0.26% : 0.000294s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000022s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.62% : 0.006372s : 1: jit_opt_a 0.13% : 0.000149s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.38% : 0.000436s : 1: loop_unroll 0.45% : 0.000509s : 1: mutable_eliminate 0.80% : 0.000904s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.40% : 0.000451s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.37% : 0.000415s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000017s : 1: remove_dup_value 1.22% : 0.001380s : 1: renormalize.infer 0.57% : 0.000645s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000088s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 89.17% : 0.101127s : 1: type_inference TotalTime = 0.011242, [30] [bootstrap]: 0.00025083 [type_inference]: 0.00405996 [event_method]: 1.639e-05 [auto_monad]: 6.274e-05 [graph_reusing]: 5.32999e-06 [pre_auto_parallel]: 1.93997e-06 [py_interpret_to_execute]: 3.61e-05 [rewriter_before_opt_a]: 6.925e-05 [expand_dump_flag]: 3.23e-06 [jit_opt_a]: 0.00474059, [2] [Cycle 1]: 0.00140118, [27] [switch_simplify]: 4.861e-05 [loop_unroll]: 2.909e-05 [a_1]: 0.00049179 [with_stream_mark]: 1.415e-05 [recompute_prepare]: 7.48e-06 [updatestate_depend_eliminate]: 3.26999e-06 [updatestate_assign_eliminate]: 2.94001e-06 [updatestate_loads_eliminate]: 3.11001e-06 [parameter_eliminate]: 1.61002e-06 [specialize_transform]: 5.77999e-06 [updatestate_useless_node_eliminater]: 5.10001e-06 [accelerated_algorithm]: 5.25001e-06 [meta_shard_fg_expand]: 1.84e-06 [get_grad_eliminate_]: 5.20001e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 1.03001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.207e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 2.23998e-06 [replace_old_param]: 8.32e-06 [inline_without_move]: 5.09998e-06 [renormalize]: 0.00052268 [add_forward_monad_depend]: 5.19e-06 [auto_monad_grad]: 1.76e-06 [auto_monad_eliminator]: 1.472e-05 [cse]: 2.245e-05 [replace_applicator]: 1.089e-05 [Cycle 2]: 0.00030795, [27] [switch_simplify]: 5.70001e-06 [loop_unroll]: 4.77e-06 [a_1]: 8.968e-05 [with_stream_mark]: 7.71999e-06 [recompute_prepare]: 5.05999e-06 [updatestate_depend_eliminate]: 2.54999e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 4.72e-06 [updatestate_useless_node_eliminater]: 4.67e-06 [accelerated_algorithm]: 4.67998e-06 [meta_shard_fg_expand]: 1.12e-06 [get_grad_eliminate_]: 4.60001e-06 [merge_forward]: 2.37999e-06 [cell_reuse_recompute_pass]: 1.20999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.201e-05 [j_node_and_user_rematch]: 7.73999e-06 [meta_fg_expand]: 1.65001e-06 [replace_old_param]: 7.23999e-06 [inline_without_move]: 4.78001e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 9.89996e-07 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.03002e-06 [cse]: 1.031e-05 [replace_applicator]: 5.10001e-06 [py_interpret_to_execute_after_opt_a]: 7.65998e-06 [rewriter_after_opt_a]: 2.905e-05 [convert_after_rewriter]: 7.18e-06 [order_py_execute_after_rewriter]: 4.71002e-06 [mutable_eliminate]: 0.00052208 [jit_opt_b]: 6.222e-05, [1] [Cycle 1]: 5.565e-05, [2] [frontend_op_eliminate]: 2.803e-05 [inline_after_opt_a]: 1.606e-05 [cconv]: 2.251e-05 [loop_unroll]: 0.00041015 [jit_opt_after_cconv]: 0.00013691, [1] [Cycle 1]: 0.00013031, [11] [c_1]: 2.135e-05 [parameter_eliminate]: 2.17999e-06 [updatestate_depend_eliminate]: 5.67999e-06 [updatestate_assign_eliminate]: 2.54999e-06 [updatestate_loads_eliminate]: 2.23002e-06 [cse]: 1.793e-05 [call_graph_tuple_transform]: 1.799e-05 [tuple_list_get_item_eliminator]: 5.38002e-06 [none_parameter_eliminate]: 1.03001e-06 [renormalize]: 3.39991e-07 [switch_simplify]: 5.30001e-06 [remove_dup_value]: 1.306e-05 [partial_unused_args_eliminate]: 2.00002e-06 [environ_conv]: 5.56e-06 [add_recomputation]: 4.465e-05 [cse_after_recomputation]: 2.044e-05, [1] [Cycle 1]: 1.536e-05, [1] [cse]: 9.75002e-06 [auto_monad_reorder]: 1.347e-05 [get_jit_bprop_graph]: 1.44998e-06 [rewriter_after_jit_bprop_graph]: 4.32e-06 [opt_after_jit_grad]: 0.00044487 [symbol_engine_optimizer]: 6.938e-05, [1] [Cycle 1]: 6.353e-05, [6] [build]: 3.00002e-06 [elim_shapecalc]: 7.73999e-06 [elim_not_effective]: 1.221e-05 [opt_reshape]: 5.52001e-06 [fold_const_symbol]: 8.28001e-06 [renormalize]: 4.00003e-07 [validate]: 2.934e-05 Sums bootstrap : 0.000251s : 3.26% type_inference : 0.004060s : 52.84% event_method : 0.000016s : 0.21% auto_monad : 0.000063s : 0.82% graph_reusing : 0.000005s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.47% rewriter_before_opt_a : 0.000069s : 0.90% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000054s : 0.71% jit_opt_a.loop_unroll : 0.000034s : 0.44% jit_opt_a.a_1 : 0.000581s : 7.57% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000010s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.31% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000523s : 6.80% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000020s : 0.26% jit_opt_a.cse : 0.000033s : 0.43% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000029s : 0.38% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000522s : 6.79% jit_opt_b.frontend_op_eliminate : 0.000028s : 0.36% jit_opt_b.inline_after_opt_a : 0.000016s : 0.21% cconv : 0.000023s : 0.29% loop_unroll : 0.000410s : 5.34% jit_opt_after_cconv.c_1 : 0.000021s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000013s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000006s : 0.07% add_recomputation : 0.000045s : 0.58% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000013s : 0.18% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000445s : 5.79% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.01% validate : 0.000029s : 0.38% Time group info: ------[substitution.] 0.000167 23 1.15% : 0.000002s : 2: substitution.elim_not_effective 0.80% : 0.000001s : 2: substitution.fold_const_symbol 3.13% : 0.000005s : 3: substitution.graph_param_transform 81.33% : 0.000136s : 4: substitution.inline 1.61% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000005s : 4: substitution.remove_not_recompute_node 2.14% : 0.000004s : 2: substitution.replace_old_param 7.14% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004007 2 80.73% : 0.003235s : 1: type_inference.infer 19.27% : 0.000772s : 1: type_inference.specialize ------[replace.] 0.000061 6 65.35% : 0.000040s : 4: replace.inline 34.65% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 92.48% : 0.000134s : 4: match.inline 7.52% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000115 691 1.32% : 0.000002s : 10: predicate.accumulaten_eliminater 1.06% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.36% : 0.000002s : 10: predicate.addn_zero_filter 2.09% : 0.000002s : 10: predicate.arithmetic_simplify 1.45% : 0.000002s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.16% : 0.000001s : 10: predicate.compare_switch_simplify 1.21% : 0.000001s : 10: predicate.depend_value_elim 1.21% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.29% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.96% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.21% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.27% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.18% : 0.000001s : 10: predicate.environ_get_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.24% : 0.000000s : 3: predicate.fold_const_symbol 1.01% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.52% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.08% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 15: predicate.load_eliminater 1.89% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.00% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.08% : 0.000001s : 10: predicate.merge_addn 1.06% : 0.000001s : 10: predicate.minmaximum_grad 1.64% : 0.000002s : 3: predicate.mutable_eliminate 0.45% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000003s : 15: predicate.partial_eliminate 1.20% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.70% : 0.000002s : 18: predicate.replace_applicator 0.75% : 0.000001s : 6: predicate.replace_old_param 0.37% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.53% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.70% : 0.000001s : 3: predicate.row_tensor_eliminate 1.21% : 0.000001s : 10: predicate.same_eliminate 0.54% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.90% : 0.000001s : 6: predicate.special_op_eliminate 0.96% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.21% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.40% : 0.000003s : 16: predicate.switch_defer_inline 2.09% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.55% : 0.000009s : 53: predicate.switch_simplify 1.19% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.43% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.41% : 0.000002s : 10: predicate.tuple_list_get_item_depend_reorder 4.19% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.46% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.86% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.90% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.59% : 0.000002s : 10: predicate.value_based_eliminate 0.33% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000538 13 49.19% : 0.000265s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.78% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 46.03% : 0.000248s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012626 72 0.37% : 0.000047s : 1: add_recomputation 0.52% : 0.000066s : 1: auto_monad 0.13% : 0.000016s : 1: auto_monad_reorder 2.08% : 0.000263s : 1: bootstrap 0.20% : 0.000025s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000022s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.57% : 0.004743s : 1: jit_opt_a 1.11% : 0.000140s : 1: jit_opt_after_cconv 0.51% : 0.000065s : 1: jit_opt_b 3.31% : 0.000418s : 1: loop_unroll 4.20% : 0.000530s : 1: mutable_eliminate 6.17% : 0.000779s : 26: opt.transform.jit_opt_a 0.37% : 0.000047s : 4: opt.transform.jit_opt_after_cconv 0.30% : 0.000038s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.58% : 0.000452s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000039s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 2.00% : 0.000252s : 1: renormalize.infer 2.09% : 0.000264s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.25% : 0.000032s : 1: rewriter_after_opt_a 0.57% : 0.000072s : 1: rewriter_before_opt_a 0.57% : 0.000072s : 1: symbol_engine_optimizer 32.24% : 0.004070s : 1: type_inference TotalTime = 0.010932, [30] [bootstrap]: 0.00024357 [type_inference]: 0.00404904 [event_method]: 1.73e-05 [auto_monad]: 5.701e-05 [graph_reusing]: 6.06e-06 [pre_auto_parallel]: 2.12001e-06 [py_interpret_to_execute]: 3.413e-05 [rewriter_before_opt_a]: 6.934e-05 [expand_dump_flag]: 2.86999e-06 [jit_opt_a]: 0.00454663, [2] [Cycle 1]: 0.0013378, [27] [switch_simplify]: 4.728e-05 [loop_unroll]: 2.987e-05 [a_1]: 0.00048116 [with_stream_mark]: 1.27e-05 [recompute_prepare]: 7.18e-06 [updatestate_depend_eliminate]: 3.69002e-06 [updatestate_assign_eliminate]: 2.86999e-06 [updatestate_loads_eliminate]: 2.76e-06 [parameter_eliminate]: 1.62001e-06 [specialize_transform]: 5.86998e-06 [updatestate_useless_node_eliminater]: 5.32999e-06 [accelerated_algorithm]: 5.14e-06 [meta_shard_fg_expand]: 1.91e-06 [get_grad_eliminate_]: 5.17999e-06 [merge_forward]: 3.58999e-06 [cell_reuse_recompute_pass]: 9.40025e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.25e-05 [j_node_and_user_rematch]: 9.07001e-06 [meta_fg_expand]: 2.10002e-06 [replace_old_param]: 7.75998e-06 [inline_without_move]: 5.10001e-06 [renormalize]: 0.00047851 [add_forward_monad_depend]: 4.48001e-06 [auto_monad_grad]: 1.94e-06 [auto_monad_eliminator]: 1.32e-05 [cse]: 2.286e-05 [replace_applicator]: 1.029e-05 [Cycle 2]: 0.00030542, [27] [switch_simplify]: 5.59e-06 [loop_unroll]: 5.10001e-06 [a_1]: 8.881e-05 [with_stream_mark]: 7.83999e-06 [recompute_prepare]: 5.00999e-06 [updatestate_depend_eliminate]: 2.53e-06 [updatestate_assign_eliminate]: 2.13002e-06 [updatestate_loads_eliminate]: 2.06e-06 [parameter_eliminate]: 8.30012e-07 [specialize_transform]: 4.88001e-06 [updatestate_useless_node_eliminater]: 4.62998e-06 [accelerated_algorithm]: 4.70999e-06 [meta_shard_fg_expand]: 9.89996e-07 [get_grad_eliminate_]: 4.53001e-06 [merge_forward]: 2.34001e-06 [cell_reuse_recompute_pass]: 1.49e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.208e-05 [j_node_and_user_rematch]: 7.41999e-06 [meta_fg_expand]: 1.50001e-06 [replace_old_param]: 7.06999e-06 [inline_without_move]: 4.65001e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 1.00001e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.24e-06 [cse]: 9.96e-06 [replace_applicator]: 4.82e-06 [py_interpret_to_execute_after_opt_a]: 7.51001e-06 [rewriter_after_opt_a]: 2.864e-05 [convert_after_rewriter]: 5.94e-06 [order_py_execute_after_rewriter]: 5.18002e-06 [mutable_eliminate]: 0.00045729 [jit_opt_b]: 4.827e-05, [1] [Cycle 1]: 4.165e-05, [2] [frontend_op_eliminate]: 1.57e-05 [inline_after_opt_a]: 1.486e-05 [cconv]: 2.287e-05 [loop_unroll]: 0.00039865 [jit_opt_after_cconv]: 0.0001456, [1] [Cycle 1]: 0.0001394, [11] [c_1]: 2.065e-05 [parameter_eliminate]: 2.37999e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.63e-06 [updatestate_loads_eliminate]: 2.18002e-06 [cse]: 1.748e-05 [call_graph_tuple_transform]: 1.776e-05 [tuple_list_get_item_eliminator]: 5.40001e-06 [none_parameter_eliminate]: 1.10001e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.20999e-06 [remove_dup_value]: 1.397e-05 [partial_unused_args_eliminate]: 1.96998e-06 [environ_conv]: 4.72e-06 [add_recomputation]: 4.135e-05 [cse_after_recomputation]: 2.036e-05, [1] [Cycle 1]: 1.524e-05, [1] [cse]: 9.98998e-06 [auto_monad_reorder]: 1.501e-05 [get_jit_bprop_graph]: 1.37e-06 [rewriter_after_jit_bprop_graph]: 3.79002e-06 [opt_after_jit_grad]: 0.00043868 [symbol_engine_optimizer]: 6.835e-05, [1] [Cycle 1]: 6.266e-05, [6] [build]: 2.88e-06 [elim_shapecalc]: 7.33e-06 [elim_not_effective]: 1.209e-05 [opt_reshape]: 5.35999e-06 [fold_const_symbol]: 8.24998e-06 [renormalize]: 3.30008e-07 [validate]: 2.944e-05 Sums bootstrap : 0.000244s : 3.25% type_inference : 0.004049s : 54.00% event_method : 0.000017s : 0.23% auto_monad : 0.000057s : 0.76% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000034s : 0.46% rewriter_before_opt_a : 0.000069s : 0.92% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000053s : 0.71% jit_opt_a.loop_unroll : 0.000035s : 0.47% jit_opt_a.a_1 : 0.000570s : 7.60% jit_opt_a.with_stream_mark : 0.000021s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000025s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.22% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.20% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000479s : 6.38% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.25% jit_opt_a.cse : 0.000033s : 0.44% jit_opt_a.replace_applicator : 0.000015s : 0.20% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000029s : 0.38% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000457s : 6.10% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000023s : 0.31% loop_unroll : 0.000399s : 5.32% jit_opt_after_cconv.c_1 : 0.000021s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.01% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.19% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000041s : 0.55% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000015s : 0.20% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000439s : 5.85% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000029s : 0.39% Time group info: ------[substitution.] 0.000167 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.81% : 0.000001s : 2: substitution.fold_const_symbol 3.09% : 0.000005s : 3: substitution.graph_param_transform 81.71% : 0.000136s : 4: substitution.inline 1.80% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.63% : 0.000004s : 4: substitution.remove_not_recompute_node 2.21% : 0.000004s : 2: substitution.replace_old_param 6.66% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003991 2 80.87% : 0.003228s : 1: type_inference.infer 19.13% : 0.000763s : 1: type_inference.specialize ------[replace.] 0.000062 6 66.76% : 0.000041s : 4: replace.inline 33.24% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000144 6 93.05% : 0.000134s : 4: match.inline 6.95% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.29% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.24% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000001s : 10: predicate.addn_zero_filter 1.78% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.17% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.32% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.24% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.20% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.15% : 0.000001s : 10: predicate.environ_get_depend_swap 1.22% : 0.000001s : 10: predicate.environ_get_eliminate 1.16% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.00% : 0.000001s : 6: predicate.get_grad_eliminate 0.31% : 0.000000s : 3: predicate.graph_param_transform 5.53% : 0.000006s : 22: predicate.inline 0.88% : 0.000001s : 6: predicate.inline_without_move 0.42% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.19% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.35% : 0.000001s : 3: predicate.loop_unroll_after_grad 4.41% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.16% : 0.000001s : 10: predicate.minmaximum_grad 1.76% : 0.000002s : 3: predicate.mutable_eliminate 0.51% : 0.000001s : 3: predicate.opt_reshape 2.26% : 0.000002s : 15: predicate.partial_eliminate 1.13% : 0.000001s : 10: predicate.print_const_string_wrapper 1.72% : 0.000002s : 10: predicate.reduce_eliminate 1.58% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.83% : 0.000002s : 18: predicate.replace_applicator 0.57% : 0.000001s : 6: predicate.replace_old_param 0.36% : 0.000000s : 3: predicate.reset_defer_inline 1.26% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.79% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.93% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.47% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.59% : 0.000003s : 16: predicate.switch_defer_inline 2.17% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.74% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.25% : 0.000001s : 10: predicate.transpose_eliminate 1.53% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.27% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.66% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.47% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.73% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.03% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 10: predicate.value_based_eliminate 0.38% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.63% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000517 13 51.33% : 0.000266s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.85% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 43.83% : 0.000227s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012245 72 0.36% : 0.000044s : 1: add_recomputation 0.49% : 0.000060s : 1: auto_monad 0.14% : 0.000017s : 1: auto_monad_reorder 2.09% : 0.000256s : 1: bootstrap 0.21% : 0.000025s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.18% : 0.000022s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.17% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.07% : 0.000008s : 1: graph_reusing 37.15% : 0.004549s : 1: jit_opt_a 1.21% : 0.000148s : 1: jit_opt_after_cconv 0.42% : 0.000051s : 1: jit_opt_b 3.32% : 0.000406s : 1: loop_unroll 3.80% : 0.000465s : 1: mutable_eliminate 6.25% : 0.000766s : 26: opt.transform.jit_opt_a 0.37% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000025s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.65% : 0.000446s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 1.97% : 0.000241s : 1: renormalize.infer 1.89% : 0.000231s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000031s : 1: rewriter_after_opt_a 0.59% : 0.000072s : 1: rewriter_before_opt_a 0.58% : 0.000071s : 1: symbol_engine_optimizer 33.16% : 0.004061s : 1: type_inference TotalTime = 0.0113151, [30] [bootstrap]: 0.00026996 [type_inference]: 0.00421685 [event_method]: 1.635e-05 [auto_monad]: 6.069e-05 [graph_reusing]: 5.79999e-06 [pre_auto_parallel]: 2.03002e-06 [py_interpret_to_execute]: 3.61e-05 [rewriter_before_opt_a]: 6.976e-05 [expand_dump_flag]: 2.56e-06 [jit_opt_a]: 0.00467286, [2] [Cycle 1]: 0.0013714, [27] [switch_simplify]: 5.051e-05 [loop_unroll]: 3.018e-05 [a_1]: 0.00048709 [with_stream_mark]: 1.394e-05 [recompute_prepare]: 7.18998e-06 [updatestate_depend_eliminate]: 3.54002e-06 [updatestate_assign_eliminate]: 3.02002e-06 [updatestate_loads_eliminate]: 3.18998e-06 [parameter_eliminate]: 1.52999e-06 [specialize_transform]: 5.91003e-06 [updatestate_useless_node_eliminater]: 5.14998e-06 [accelerated_algorithm]: 5.42001e-06 [meta_shard_fg_expand]: 2.04e-06 [get_grad_eliminate_]: 5.50001e-06 [merge_forward]: 3.35e-06 [cell_reuse_recompute_pass]: 1.05999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.38e-05 [j_node_and_user_rematch]: 8.61002e-06 [meta_fg_expand]: 2.12999e-06 [replace_old_param]: 8.73001e-06 [inline_without_move]: 5.36998e-06 [renormalize]: 0.00049668 [add_forward_monad_depend]: 4.60001e-06 [auto_monad_grad]: 1.91998e-06 [auto_monad_eliminator]: 1.316e-05 [cse]: 2.43e-05 [replace_applicator]: 1.065e-05 [Cycle 2]: 0.00030654, [27] [switch_simplify]: 5.86e-06 [loop_unroll]: 4.82e-06 [a_1]: 8.88e-05 [with_stream_mark]: 8.12e-06 [recompute_prepare]: 4.97e-06 [updatestate_depend_eliminate]: 2.63e-06 [updatestate_assign_eliminate]: 2.21e-06 [updatestate_loads_eliminate]: 2.05002e-06 [parameter_eliminate]: 8.39995e-07 [specialize_transform]: 5.05999e-06 [updatestate_useless_node_eliminater]: 4.72e-06 [accelerated_algorithm]: 4.69998e-06 [meta_shard_fg_expand]: 1.12999e-06 [get_grad_eliminate_]: 4.65001e-06 [merge_forward]: 2.29001e-06 [cell_reuse_recompute_pass]: 1.15999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.208e-05 [j_node_and_user_rematch]: 7.21999e-06 [meta_fg_expand]: 1.52001e-06 [replace_old_param]: 7.36999e-06 [inline_without_move]: 4.60001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 8.40024e-07 [auto_monad_eliminator]: 5.20001e-06 [cse]: 1.003e-05 [replace_applicator]: 5.01997e-06 [py_interpret_to_execute_after_opt_a]: 7.26999e-06 [rewriter_after_opt_a]: 2.956e-05 [convert_after_rewriter]: 7.68999e-06 [order_py_execute_after_rewriter]: 4.72e-06 [mutable_eliminate]: 0.00046025 [jit_opt_b]: 4.686e-05, [1] [Cycle 1]: 4.089e-05, [2] [frontend_op_eliminate]: 1.506e-05 [inline_after_opt_a]: 1.498e-05 [cconv]: 2.366e-05 [loop_unroll]: 0.00039998 [jit_opt_after_cconv]: 0.00013333, [1] [Cycle 1]: 0.00012743, [11] [c_1]: 2.096e-05 [parameter_eliminate]: 2.16e-06 [updatestate_depend_eliminate]: 5.17e-06 [updatestate_assign_eliminate]: 2.67001e-06 [updatestate_loads_eliminate]: 2.21e-06 [cse]: 1.709e-05 [call_graph_tuple_transform]: 1.759e-05 [tuple_list_get_item_eliminator]: 5.32999e-06 [none_parameter_eliminate]: 1.50999e-06 [renormalize]: 3.00002e-07 [switch_simplify]: 4.87e-06 [remove_dup_value]: 1.394e-05 [partial_unused_args_eliminate]: 2.53003e-06 [environ_conv]: 4.97999e-06 [add_recomputation]: 4.55e-05 [cse_after_recomputation]: 2.06e-05, [1] [Cycle 1]: 1.547e-05, [1] [cse]: 1.004e-05 [auto_monad_reorder]: 1.553e-05 [get_jit_bprop_graph]: 1.48002e-06 [rewriter_after_jit_bprop_graph]: 3.83001e-06 [opt_after_jit_grad]: 0.00043718 [symbol_engine_optimizer]: 7.039e-05, [1] [Cycle 1]: 6.426e-05, [6] [build]: 3.16001e-06 [elim_shapecalc]: 7.53e-06 [elim_not_effective]: 1.299e-05 [opt_reshape]: 5.34e-06 [fold_const_symbol]: 8.50001e-06 [renormalize]: 2.79979e-07 [validate]: 3.068e-05 Sums bootstrap : 0.000270s : 3.49% type_inference : 0.004217s : 54.45% event_method : 0.000016s : 0.21% auto_monad : 0.000061s : 0.78% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000036s : 0.47% rewriter_before_opt_a : 0.000070s : 0.90% expand_dump_flag : 0.000003s : 0.03% jit_opt_a.switch_simplify : 0.000056s : 0.73% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000576s : 7.44% jit_opt_a.with_stream_mark : 0.000022s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000016s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000497s : 6.41% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.07% jit_opt_a.auto_monad_grad : 0.000003s : 0.04% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.24% jit_opt_a.cse : 0.000034s : 0.44% jit_opt_a.replace_applicator : 0.000016s : 0.20% py_interpret_to_execute_after_opt_a : 0.000007s : 0.09% rewriter_after_opt_a : 0.000030s : 0.38% convert_after_rewriter : 0.000008s : 0.10% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000460s : 5.94% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000024s : 0.31% loop_unroll : 0.000400s : 5.16% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.22% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.06% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000005s : 0.06% add_recomputation : 0.000045s : 0.59% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000016s : 0.20% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000437s : 5.65% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.40% Time group info: ------[substitution.] 0.000171 23 1.26% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.11% : 0.000005s : 3: substitution.graph_param_transform 81.37% : 0.000139s : 4: substitution.inline 1.54% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.70% : 0.000005s : 4: substitution.remove_not_recompute_node 2.44% : 0.000004s : 2: substitution.replace_old_param 6.82% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004166 2 81.46% : 0.003394s : 1: type_inference.infer 18.54% : 0.000772s : 1: type_inference.specialize ------[replace.] 0.000063 6 66.54% : 0.000042s : 4: replace.inline 33.46% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000147 6 92.82% : 0.000137s : 4: match.inline 7.18% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000114 691 1.31% : 0.000001s : 10: predicate.accumulaten_eliminater 1.27% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.27% : 0.000001s : 10: predicate.addn_zero_filter 1.70% : 0.000002s : 10: predicate.arithmetic_simplify 1.41% : 0.000002s : 10: predicate.cast_eliminate 0.41% : 0.000000s : 3: predicate.check_bprop_eliminate 1.08% : 0.000001s : 10: predicate.compare_switch_simplify 1.27% : 0.000001s : 10: predicate.depend_value_elim 1.09% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.48% : 0.000002s : 10: predicate.dict_get_item_eliminator 1.19% : 0.000001s : 10: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.36% : 0.000000s : 3: predicate.elim_not_effective 0.61% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.23% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_depend_swap 1.31% : 0.000001s : 10: predicate.environ_get_eliminate 1.18% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.25% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.29% : 0.000000s : 3: predicate.graph_param_transform 5.42% : 0.000006s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.41% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.05% : 0.000001s : 6: predicate.less_batch_normalization 1.41% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.96% : 0.000002s : 15: predicate.load_eliminater 1.48% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.09% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.88% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.18% : 0.000001s : 10: predicate.merge_addn 1.17% : 0.000001s : 10: predicate.minmaximum_grad 1.60% : 0.000002s : 3: predicate.mutable_eliminate 0.52% : 0.000001s : 3: predicate.opt_reshape 2.29% : 0.000003s : 15: predicate.partial_eliminate 1.27% : 0.000001s : 10: predicate.print_const_string_wrapper 1.70% : 0.000002s : 10: predicate.reduce_eliminate 1.45% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.80% : 0.000002s : 18: predicate.replace_applicator 0.61% : 0.000001s : 6: predicate.replace_old_param 0.29% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.31% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.73% : 0.000001s : 3: predicate.row_tensor_eliminate 1.29% : 0.000001s : 10: predicate.same_eliminate 0.67% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.91% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.48% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.27% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.16% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.66% : 0.000009s : 53: predicate.switch_simplify 1.28% : 0.000001s : 10: predicate.tile_eliminate 1.24% : 0.000001s : 10: predicate.transpose_eliminate 1.44% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 4.48% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.51% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.48% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.76% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.35% : 0.000004s : 21: predicate.updatestate_useless_node_eliminater 1.52% : 0.000002s : 10: predicate.value_based_eliminate 0.32% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.54% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000544 13 52.38% : 0.000285s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.69% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 42.92% : 0.000234s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012601 72 0.38% : 0.000048s : 1: add_recomputation 0.51% : 0.000064s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.25% : 0.000284s : 1: bootstrap 0.21% : 0.000026s : 1: cconv 0.08% : 0.000010s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.10% : 0.004675s : 1: jit_opt_a 1.08% : 0.000136s : 1: jit_opt_after_cconv 0.39% : 0.000049s : 1: jit_opt_b 3.23% : 0.000407s : 1: loop_unroll 3.72% : 0.000468s : 1: mutable_eliminate 6.17% : 0.000778s : 26: opt.transform.jit_opt_a 0.36% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.16% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.53% : 0.000445s : 1: opt_after_jit_grad 0.05% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.31% : 0.000039s : 1: py_interpret_to_execute 0.07% : 0.000009s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 2.03% : 0.000256s : 1: renormalize.infer 1.85% : 0.000234s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000032s : 1: rewriter_after_opt_a 0.57% : 0.000072s : 1: rewriter_before_opt_a 0.58% : 0.000073s : 1: symbol_engine_optimizer 33.55% : 0.004227s : 1: type_inference TotalTime = 0.0108558, [30] [bootstrap]: 0.00023908 [type_inference]: 0.00402524 [event_method]: 1.669e-05 [auto_monad]: 5.127e-05 [graph_reusing]: 4.28999e-06 [pre_auto_parallel]: 1.69998e-06 [py_interpret_to_execute]: 3.369e-05 [rewriter_before_opt_a]: 6.747e-05 [expand_dump_flag]: 2.32999e-06 [jit_opt_a]: 0.00450515, [2] [Cycle 1]: 0.00128835, [27] [switch_simplify]: 4.607e-05 [loop_unroll]: 2.993e-05 [a_1]: 0.00046549 [with_stream_mark]: 1.201e-05 [recompute_prepare]: 7.28e-06 [updatestate_depend_eliminate]: 3.76001e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 2.56e-06 [parameter_eliminate]: 1.54998e-06 [specialize_transform]: 5.91998e-06 [updatestate_useless_node_eliminater]: 5.39e-06 [accelerated_algorithm]: 5.50001e-06 [meta_shard_fg_expand]: 1.59998e-06 [get_grad_eliminate_]: 5.38002e-06 [merge_forward]: 3.04999e-06 [cell_reuse_recompute_pass]: 9.99979e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.13e-05 [j_node_and_user_rematch]: 8.44002e-06 [meta_fg_expand]: 2.15002e-06 [replace_old_param]: 7.82002e-06 [inline_without_move]: 5.00001e-06 [renormalize]: 0.00045299 [add_forward_monad_depend]: 4.33001e-06 [auto_monad_grad]: 1.60001e-06 [auto_monad_eliminator]: 1.15e-05 [cse]: 2.137e-05 [replace_applicator]: 1.041e-05 [Cycle 2]: 0.00030625, [27] [switch_simplify]: 5.47001e-06 [loop_unroll]: 4.81002e-06 [a_1]: 8.905e-05 [with_stream_mark]: 7.8e-06 [recompute_prepare]: 4.63999e-06 [updatestate_depend_eliminate]: 2.59999e-06 [updatestate_assign_eliminate]: 2.10002e-06 [updatestate_loads_eliminate]: 1.96e-06 [parameter_eliminate]: 8.79983e-07 [specialize_transform]: 4.84e-06 [updatestate_useless_node_eliminater]: 4.70999e-06 [accelerated_algorithm]: 4.53001e-06 [meta_shard_fg_expand]: 1.24e-06 [get_grad_eliminate_]: 4.52e-06 [merge_forward]: 2.37001e-06 [cell_reuse_recompute_pass]: 1.16002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.278e-05 [j_node_and_user_rematch]: 7.49002e-06 [meta_fg_expand]: 1.58002e-06 [replace_old_param]: 7.52002e-06 [inline_without_move]: 4.62e-06 [renormalize]: 7.00238e-08 [add_forward_monad_depend]: 9.19972e-07 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.47001e-06 [cse]: 9.89001e-06 [replace_applicator]: 4.89e-06 [py_interpret_to_execute_after_opt_a]: 7.17002e-06 [rewriter_after_opt_a]: 2.844e-05 [convert_after_rewriter]: 6.19999e-06 [order_py_execute_after_rewriter]: 4.65001e-06 [mutable_eliminate]: 0.00045749 [jit_opt_b]: 4.641e-05, [1] [Cycle 1]: 4.029e-05, [2] [frontend_op_eliminate]: 1.55e-05 [inline_after_opt_a]: 1.452e-05 [cconv]: 1.978e-05 [loop_unroll]: 0.00039968 [jit_opt_after_cconv]: 0.0001436, [1] [Cycle 1]: 0.00013727, [11] [c_1]: 2.001e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 5.56e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.06e-06 [cse]: 1.714e-05 [call_graph_tuple_transform]: 1.787e-05 [tuple_list_get_item_eliminator]: 1.424e-05 [none_parameter_eliminate]: 1.15001e-06 [renormalize]: 5.00004e-07 [switch_simplify]: 5.64e-06 [remove_dup_value]: 1.14e-05 [partial_unused_args_eliminate]: 1.99e-06 [environ_conv]: 4.85001e-06 [add_recomputation]: 3.735e-05 [cse_after_recomputation]: 2.17e-05, [1] [Cycle 1]: 1.665e-05, [1] [cse]: 1.09e-05 [auto_monad_reorder]: 1.278e-05 [get_jit_bprop_graph]: 1.51998e-06 [rewriter_after_jit_bprop_graph]: 3.78001e-06 [opt_after_jit_grad]: 0.0004596 [symbol_engine_optimizer]: 6.909e-05, [1] [Cycle 1]: 6.347e-05, [6] [build]: 3.4e-06 [elim_shapecalc]: 7.22002e-06 [elim_not_effective]: 1.287e-05 [opt_reshape]: 5.37001e-06 [fold_const_symbol]: 8.33001e-06 [renormalize]: 3.00002e-07 [validate]: 2.643e-05 Sums bootstrap : 0.000239s : 3.22% type_inference : 0.004025s : 54.20% event_method : 0.000017s : 0.22% auto_monad : 0.000051s : 0.69% graph_reusing : 0.000004s : 0.06% pre_auto_parallel : 0.000002s : 0.02% py_interpret_to_execute : 0.000034s : 0.45% rewriter_before_opt_a : 0.000067s : 0.91% expand_dump_flag : 0.000002s : 0.03% jit_opt_a.switch_simplify : 0.000052s : 0.69% jit_opt_a.loop_unroll : 0.000035s : 0.47% jit_opt_a.a_1 : 0.000555s : 7.47% jit_opt_a.with_stream_mark : 0.000020s : 0.27% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.14% jit_opt_a.accelerated_algorithm : 0.000010s : 0.14% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000005s : 0.07% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000024s : 0.32% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.21% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000453s : 6.10% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000017s : 0.23% jit_opt_a.cse : 0.000031s : 0.42% jit_opt_a.replace_applicator : 0.000015s : 0.21% py_interpret_to_execute_after_opt_a : 0.000007s : 0.10% rewriter_after_opt_a : 0.000028s : 0.38% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000457s : 6.16% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.21% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000020s : 0.27% loop_unroll : 0.000400s : 5.38% jit_opt_after_cconv.c_1 : 0.000020s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000014s : 0.19% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000001s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.08% remove_dup_value : 0.000011s : 0.15% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000037s : 0.50% cse_after_recomputation.cse : 0.000011s : 0.15% auto_monad_reorder : 0.000013s : 0.17% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000460s : 6.19% symbol_engine_optimizer.build : 0.000003s : 0.05% symbol_engine_optimizer.elim_shapecalc : 0.000007s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.17% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000026s : 0.36% Time group info: ------[substitution.] 0.000153 23 1.50% : 0.000002s : 2: substitution.elim_not_effective 0.79% : 0.000001s : 2: substitution.fold_const_symbol 3.10% : 0.000005s : 3: substitution.graph_param_transform 81.53% : 0.000125s : 4: substitution.inline 1.66% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.73% : 0.000004s : 4: substitution.remove_not_recompute_node 2.46% : 0.000004s : 2: substitution.replace_old_param 6.23% : 0.000010s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003976 2 81.19% : 0.003228s : 1: type_inference.infer 18.81% : 0.000748s : 1: type_inference.specialize ------[replace.] 0.000059 6 65.78% : 0.000039s : 4: replace.inline 34.22% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000131 6 93.53% : 0.000122s : 4: match.inline 6.47% : 0.000008s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000110 691 1.39% : 0.000002s : 10: predicate.accumulaten_eliminater 1.07% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.18% : 0.000001s : 10: predicate.addn_check_dump 1.26% : 0.000001s : 10: predicate.addn_zero_filter 1.79% : 0.000002s : 10: predicate.arithmetic_simplify 1.39% : 0.000002s : 10: predicate.cast_eliminate 0.39% : 0.000000s : 3: predicate.check_bprop_eliminate 1.13% : 0.000001s : 10: predicate.compare_switch_simplify 1.26% : 0.000001s : 10: predicate.depend_value_elim 1.12% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.28% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.02% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.37% : 0.000000s : 3: predicate.elim_not_effective 0.55% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.28% : 0.000001s : 10: predicate.environ_get_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.26% : 0.000000s : 3: predicate.fold_const_symbol 1.15% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.47% : 0.000006s : 22: predicate.inline 0.92% : 0.000001s : 6: predicate.inline_without_move 0.44% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.03% : 0.000001s : 6: predicate.less_batch_normalization 1.46% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.98% : 0.000002s : 15: predicate.load_eliminater 1.37% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.33% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.22% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.13% : 0.000001s : 10: predicate.merge_addn 1.18% : 0.000001s : 10: predicate.minmaximum_grad 1.57% : 0.000002s : 3: predicate.mutable_eliminate 0.44% : 0.000000s : 3: predicate.opt_reshape 2.16% : 0.000002s : 15: predicate.partial_eliminate 1.22% : 0.000001s : 10: predicate.print_const_string_wrapper 1.76% : 0.000002s : 10: predicate.reduce_eliminate 1.44% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.53% : 0.000001s : 6: predicate.remove_not_recompute_node 1.78% : 0.000002s : 18: predicate.replace_applicator 0.53% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.37% : 0.000002s : 10: predicate.reshape_eliminate 1.30% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.86% : 0.000001s : 3: predicate.row_tensor_eliminate 1.23% : 0.000001s : 10: predicate.same_eliminate 0.63% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.92% : 0.000001s : 6: predicate.special_op_eliminate 1.10% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.41% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.45% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.47% : 0.000003s : 16: predicate.switch_defer_inline 2.20% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.67% : 0.000008s : 53: predicate.switch_simplify 1.21% : 0.000001s : 10: predicate.tile_eliminate 1.26% : 0.000001s : 10: predicate.transpose_eliminate 1.50% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.33% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.37% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.43% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.59% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.81% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.11% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.66% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.73% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000517 13 51.06% : 0.000264s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.80% : 0.000025s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.14% : 0.000228s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012138 72 0.33% : 0.000040s : 1: add_recomputation 0.45% : 0.000055s : 1: auto_monad 0.13% : 0.000016s : 1: auto_monad_reorder 2.07% : 0.000251s : 1: bootstrap 0.18% : 0.000022s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.17% : 0.000020s : 1: event_method 0.03% : 0.000004s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.05% : 0.000006s : 1: graph_reusing 37.14% : 0.004508s : 1: jit_opt_a 1.21% : 0.000146s : 1: jit_opt_after_cconv 0.40% : 0.000049s : 1: jit_opt_b 3.35% : 0.000407s : 1: loop_unroll 3.84% : 0.000466s : 1: mutable_eliminate 6.17% : 0.000749s : 26: opt.transform.jit_opt_a 0.45% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.17% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.86% : 0.000468s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000009s : 1: py_interpret_to_execute_after_opt_a 0.11% : 0.000014s : 1: remove_dup_value 1.86% : 0.000225s : 1: renormalize.infer 1.82% : 0.000221s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000031s : 1: rewriter_after_opt_a 0.58% : 0.000070s : 1: rewriter_before_opt_a 0.59% : 0.000072s : 1: symbol_engine_optimizer 33.25% : 0.004036s : 1: type_inference TotalTime = 0.0108761, [30] [bootstrap]: 0.00024748 [type_inference]: 0.0039536 [event_method]: 1.683e-05 [auto_monad]: 5.778e-05 [graph_reusing]: 4.68001e-06 [pre_auto_parallel]: 1.91e-06 [py_interpret_to_execute]: 3.364e-05 [rewriter_before_opt_a]: 6.908e-05 [expand_dump_flag]: 2.85002e-06 [jit_opt_a]: 0.00454748, [2] [Cycle 1]: 0.00138043, [27] [switch_simplify]: 4.61e-05 [loop_unroll]: 2.951e-05 [a_1]: 0.00048348 [with_stream_mark]: 1.313e-05 [recompute_prepare]: 6.86999e-06 [updatestate_depend_eliminate]: 3.21001e-06 [updatestate_assign_eliminate]: 2.73003e-06 [updatestate_loads_eliminate]: 3.06999e-06 [parameter_eliminate]: 1.73002e-06 [specialize_transform]: 5.84999e-06 [updatestate_useless_node_eliminater]: 5.09998e-06 [accelerated_algorithm]: 5.18002e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 5.28002e-06 [merge_forward]: 3.36001e-06 [cell_reuse_recompute_pass]: 9.70002e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.377e-05 [j_node_and_user_rematch]: 8.11002e-06 [meta_fg_expand]: 2.37999e-06 [replace_old_param]: 8.85999e-06 [inline_without_move]: 5.67999e-06 [renormalize]: 0.00051326 [add_forward_monad_depend]: 4.35999e-06 [auto_monad_grad]: 1.47001e-06 [auto_monad_eliminator]: 1.303e-05 [cse]: 2.396e-05 [replace_applicator]: 1.223e-05 [Cycle 2]: 0.00031087, [27] [switch_simplify]: 5.69999e-06 [loop_unroll]: 4.93001e-06 [a_1]: 9.019e-05 [with_stream_mark]: 7.98001e-06 [recompute_prepare]: 5.07e-06 [updatestate_depend_eliminate]: 2.58e-06 [updatestate_assign_eliminate]: 2.18002e-06 [updatestate_loads_eliminate]: 2.32999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.00001e-06 [updatestate_useless_node_eliminater]: 4.74002e-06 [accelerated_algorithm]: 4.67e-06 [meta_shard_fg_expand]: 1.19e-06 [get_grad_eliminate_]: 4.59002e-06 [merge_forward]: 2.42001e-06 [cell_reuse_recompute_pass]: 1.02998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.22e-05 [j_node_and_user_rematch]: 7.54002e-06 [meta_fg_expand]: 1.66002e-06 [replace_old_param]: 7.65e-06 [inline_without_move]: 4.77e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.10001e-06 [auto_monad_grad]: 6.59988e-07 [auto_monad_eliminator]: 5.25001e-06 [cse]: 1.002e-05 [replace_applicator]: 5.08002e-06 [py_interpret_to_execute_after_opt_a]: 7.41999e-06 [rewriter_after_opt_a]: 2.976e-05 [convert_after_rewriter]: 6.26e-06 [order_py_execute_after_rewriter]: 5.19998e-06 [mutable_eliminate]: 0.00046133 [jit_opt_b]: 4.715e-05, [1] [Cycle 1]: 4.052e-05, [2] [frontend_op_eliminate]: 1.543e-05 [inline_after_opt_a]: 1.45e-05 [cconv]: 2.149e-05 [loop_unroll]: 0.00042264 [jit_opt_after_cconv]: 0.00013596, [1] [Cycle 1]: 0.0001294, [11] [c_1]: 2.092e-05 [parameter_eliminate]: 2.24999e-06 [updatestate_depend_eliminate]: 5.68002e-06 [updatestate_assign_eliminate]: 2.31998e-06 [updatestate_loads_eliminate]: 2.01e-06 [cse]: 1.732e-05 [call_graph_tuple_transform]: 1.764e-05 [tuple_list_get_item_eliminator]: 5.57001e-06 [none_parameter_eliminate]: 1.52999e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.11002e-06 [remove_dup_value]: 1.378e-05 [partial_unused_args_eliminate]: 1.056e-05 [environ_conv]: 5.26002e-06 [add_recomputation]: 4.1e-05 [cse_after_recomputation]: 2.167e-05, [1] [Cycle 1]: 1.619e-05, [1] [cse]: 1.037e-05 [auto_monad_reorder]: 1.551e-05 [get_jit_bprop_graph]: 1.54e-06 [rewriter_after_jit_bprop_graph]: 4.36002e-06 [opt_after_jit_grad]: 0.00044237 [symbol_engine_optimizer]: 7.004e-05, [1] [Cycle 1]: 6.405e-05, [6] [build]: 3.35e-06 [elim_shapecalc]: 7.61001e-06 [elim_not_effective]: 1.207e-05 [opt_reshape]: 5.80002e-06 [fold_const_symbol]: 8.55001e-06 [renormalize]: 2.50002e-07 [validate]: 3.029e-05 Sums bootstrap : 0.000247s : 3.30% type_inference : 0.003954s : 52.78% event_method : 0.000017s : 0.22% auto_monad : 0.000058s : 0.77% graph_reusing : 0.000005s : 0.06% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000034s : 0.45% rewriter_before_opt_a : 0.000069s : 0.92% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000052s : 0.69% jit_opt_a.loop_unroll : 0.000034s : 0.46% jit_opt_a.a_1 : 0.000574s : 7.66% jit_opt_a.with_stream_mark : 0.000021s : 0.28% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000003s : 0.04% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.04% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.35% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000017s : 0.22% jit_opt_a.inline_without_move : 0.000010s : 0.14% jit_opt_a.renormalize : 0.000513s : 6.85% jit_opt_a.add_forward_monad_depend : 0.000005s : 0.07% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000018s : 0.24% jit_opt_a.cse : 0.000034s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.23% py_interpret_to_execute_after_opt_a : 0.000007s : 0.10% rewriter_after_opt_a : 0.000030s : 0.40% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000461s : 6.16% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.21% jit_opt_b.inline_after_opt_a : 0.000014s : 0.19% cconv : 0.000021s : 0.29% loop_unroll : 0.000423s : 5.64% jit_opt_after_cconv.c_1 : 0.000021s : 0.28% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000017s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.24% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000011s : 0.14% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000041s : 0.55% cse_after_recomputation.cse : 0.000010s : 0.14% auto_monad_reorder : 0.000016s : 0.21% get_jit_bprop_graph : 0.000002s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.06% opt_after_jit_grad : 0.000442s : 5.91% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.08% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000030s : 0.40% Time group info: ------[substitution.] 0.000169 23 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.78% : 0.000001s : 2: substitution.fold_const_symbol 3.14% : 0.000005s : 3: substitution.graph_param_transform 80.98% : 0.000137s : 4: substitution.inline 1.44% : 0.000002s : 4: substitution.j_node_and_user_rematch 3.20% : 0.000005s : 4: substitution.remove_not_recompute_node 2.39% : 0.000004s : 2: substitution.replace_old_param 6.90% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.003903 2 80.84% : 0.003155s : 1: type_inference.infer 19.16% : 0.000748s : 1: type_inference.specialize ------[replace.] 0.000061 6 66.88% : 0.000041s : 4: replace.inline 33.12% : 0.000020s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000145 6 92.70% : 0.000135s : 4: match.inline 7.30% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000112 691 1.16% : 0.000001s : 10: predicate.accumulaten_eliminater 1.16% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.09% : 0.000001s : 10: predicate.addn_check_dump 1.31% : 0.000001s : 10: predicate.addn_zero_filter 1.66% : 0.000002s : 10: predicate.arithmetic_simplify 1.34% : 0.000002s : 10: predicate.cast_eliminate 0.43% : 0.000000s : 3: predicate.check_bprop_eliminate 1.17% : 0.000001s : 10: predicate.compare_switch_simplify 1.11% : 0.000001s : 10: predicate.depend_value_elim 1.14% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.30% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.21% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.30% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.10% : 0.000001s : 10: predicate.environ_get_depend_swap 1.38% : 0.000002s : 10: predicate.environ_get_eliminate 1.19% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.28% : 0.000000s : 3: predicate.fold_const_symbol 1.02% : 0.000001s : 6: predicate.get_grad_eliminate 0.27% : 0.000000s : 3: predicate.graph_param_transform 5.60% : 0.000006s : 22: predicate.inline 0.96% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.93% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.26% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.96% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 10: predicate.merge_addn 1.10% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000002s : 3: predicate.mutable_eliminate 0.78% : 0.000001s : 3: predicate.opt_reshape 2.28% : 0.000003s : 15: predicate.partial_eliminate 1.26% : 0.000001s : 10: predicate.print_const_string_wrapper 1.67% : 0.000002s : 10: predicate.reduce_eliminate 1.46% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.51% : 0.000001s : 6: predicate.remove_not_recompute_node 1.75% : 0.000002s : 18: predicate.replace_applicator 0.56% : 0.000001s : 6: predicate.replace_old_param 0.33% : 0.000000s : 3: predicate.reset_defer_inline 1.28% : 0.000001s : 10: predicate.reshape_eliminate 1.34% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 3: predicate.row_tensor_eliminate 1.24% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.86% : 0.000001s : 6: predicate.special_op_eliminate 1.00% : 0.000001s : 6: predicate.specialize_transform 1.50% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.31% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.44% : 0.000000s : 3: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 16: predicate.switch_defer_inline 2.32% : 0.000003s : 16: predicate.switch_layer_defer_inline 7.53% : 0.000008s : 53: predicate.switch_simplify 1.18% : 0.000001s : 10: predicate.tile_eliminate 1.27% : 0.000001s : 10: predicate.transpose_eliminate 1.54% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.32% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.80% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.47% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.50% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.83% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.97% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.71% : 0.000002s : 10: predicate.value_based_eliminate 0.37% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.84% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000517 13 50.00% : 0.000259s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.25% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.75% : 0.000232s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012229 72 0.36% : 0.000044s : 1: add_recomputation 0.50% : 0.000061s : 1: auto_monad 0.15% : 0.000018s : 1: auto_monad_reorder 2.10% : 0.000257s : 1: bootstrap 0.20% : 0.000024s : 1: cconv 0.07% : 0.000008s : 1: convert_after_rewriter 0.20% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.17% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.06% : 0.000007s : 1: graph_reusing 37.21% : 0.004550s : 1: jit_opt_a 1.13% : 0.000138s : 1: jit_opt_after_cconv 0.41% : 0.000050s : 1: jit_opt_b 3.52% : 0.000430s : 1: loop_unroll 3.84% : 0.000469s : 1: mutable_eliminate 6.32% : 0.000773s : 26: opt.transform.jit_opt_a 0.38% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.20% : 0.000024s : 4: opt.transform.jit_opt_b 0.10% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.16% : 0.000020s : 1: opt.transform.opt_after_jit_grad 0.25% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.68% : 0.000450s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.10% : 0.000013s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.30% : 0.000036s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 2.27% : 0.000278s : 1: renormalize.infer 1.88% : 0.000229s : 1: renormalize.specialize 0.05% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000032s : 1: rewriter_after_opt_a 0.59% : 0.000072s : 1: rewriter_before_opt_a 0.59% : 0.000073s : 1: symbol_engine_optimizer 32.42% : 0.003965s : 1: type_inference TotalTime = 0.0114083, [30] [bootstrap]: 0.00026168 [type_inference]: 0.00429118 [event_method]: 1.661e-05 [auto_monad]: 6.406e-05 [graph_reusing]: 5.52999e-06 [pre_auto_parallel]: 2.39001e-06 [py_interpret_to_execute]: 3.453e-05 [rewriter_before_opt_a]: 7.252e-05 [expand_dump_flag]: 3.2e-06 [jit_opt_a]: 0.00474052, [2] [Cycle 1]: 0.00137352, [27] [switch_simplify]: 4.861e-05 [loop_unroll]: 3.079e-05 [a_1]: 0.0004926 [with_stream_mark]: 1.463e-05 [recompute_prepare]: 7.31001e-06 [updatestate_depend_eliminate]: 3.42002e-06 [updatestate_assign_eliminate]: 2.84999e-06 [updatestate_loads_eliminate]: 3.25998e-06 [parameter_eliminate]: 1.47001e-06 [specialize_transform]: 6.49001e-06 [updatestate_useless_node_eliminater]: 5.14e-06 [accelerated_algorithm]: 5.35999e-06 [meta_shard_fg_expand]: 2.20002e-06 [get_grad_eliminate_]: 5.67001e-06 [merge_forward]: 3.43e-06 [cell_reuse_recompute_pass]: 1.00001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.34e-05 [j_node_and_user_rematch]: 8.40001e-06 [meta_fg_expand]: 2.24001e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 4.99998e-06 [renormalize]: 0.00049058 [add_forward_monad_depend]: 5.05001e-06 [auto_monad_grad]: 2.03997e-06 [auto_monad_eliminator]: 1.341e-05 [cse]: 2.413e-05 [replace_applicator]: 1.162e-05 [Cycle 2]: 0.00035342, [27] [switch_simplify]: 5.89e-06 [loop_unroll]: 4.77e-06 [a_1]: 8.758e-05 [with_stream_mark]: 7.90998e-06 [recompute_prepare]: 5.00999e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.22999e-06 [updatestate_loads_eliminate]: 2.17999e-06 [parameter_eliminate]: 1.00001e-06 [specialize_transform]: 4.80001e-06 [updatestate_useless_node_eliminater]: 4.67998e-06 [accelerated_algorithm]: 4.60001e-06 [meta_shard_fg_expand]: 1.64e-06 [get_grad_eliminate_]: 4.92999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.20001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.215e-05 [j_node_and_user_rematch]: 7.58001e-06 [meta_fg_expand]: 1.56998e-06 [replace_old_param]: 7.05e-06 [inline_without_move]: 5.02e-06 [renormalize]: 6.00121e-08 [add_forward_monad_depend]: 1.05001e-06 [auto_monad_grad]: 6.10016e-07 [auto_monad_eliminator]: 5.91e-06 [cse]: 1.101e-05 [replace_applicator]: 4.97e-06 [py_interpret_to_execute_after_opt_a]: 7.97e-06 [rewriter_after_opt_a]: 3.085e-05 [convert_after_rewriter]: 7.17997e-06 [order_py_execute_after_rewriter]: 5.02e-06 [mutable_eliminate]: 0.00046304 [jit_opt_b]: 4.646e-05, [1] [Cycle 1]: 4.03e-05, [2] [frontend_op_eliminate]: 1.522e-05 [inline_after_opt_a]: 1.466e-05 [cconv]: 2.371e-05 [loop_unroll]: 0.00039706 [jit_opt_after_cconv]: 0.00013579, [1] [Cycle 1]: 0.00012944, [11] [c_1]: 2.085e-05 [parameter_eliminate]: 2.39001e-06 [updatestate_depend_eliminate]: 5.25001e-06 [updatestate_assign_eliminate]: 2.42001e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.864e-05 [call_graph_tuple_transform]: 1.784e-05 [tuple_list_get_item_eliminator]: 5.25001e-06 [none_parameter_eliminate]: 1.27e-06 [renormalize]: 2.50002e-07 [switch_simplify]: 5.12999e-06 [remove_dup_value]: 1.376e-05 [partial_unused_args_eliminate]: 2.54999e-06 [environ_conv]: 5.30999e-06 [add_recomputation]: 4.72e-05 [cse_after_recomputation]: 2.127e-05, [1] [Cycle 1]: 1.586e-05, [1] [cse]: 1.021e-05 [auto_monad_reorder]: 1.493e-05 [get_jit_bprop_graph]: 1.35999e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00043266 [symbol_engine_optimizer]: 6.89e-05, [1] [Cycle 1]: 6.316e-05, [6] [build]: 3.13998e-06 [elim_shapecalc]: 7.58999e-06 [elim_not_effective]: 1.204e-05 [opt_reshape]: 5.39e-06 [fold_const_symbol]: 8.32998e-06 [renormalize]: 3.09985e-07 [validate]: 3.17e-05 Sums bootstrap : 0.000262s : 3.35% type_inference : 0.004291s : 54.89% event_method : 0.000017s : 0.21% auto_monad : 0.000064s : 0.82% graph_reusing : 0.000006s : 0.07% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000035s : 0.44% rewriter_before_opt_a : 0.000073s : 0.93% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000055s : 0.70% jit_opt_a.loop_unroll : 0.000036s : 0.45% jit_opt_a.a_1 : 0.000580s : 7.42% jit_opt_a.with_stream_mark : 0.000023s : 0.29% jit_opt_a.recompute_prepare : 0.000012s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.08% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.06% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.07% jit_opt_a.parameter_eliminate : 0.000002s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.14% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000026s : 0.33% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.20% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000491s : 6.28% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000003s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000019s : 0.25% jit_opt_a.cse : 0.000035s : 0.45% jit_opt_a.replace_applicator : 0.000017s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000031s : 0.39% convert_after_rewriter : 0.000007s : 0.09% order_py_execute_after_rewriter : 0.000005s : 0.06% mutable_eliminate : 0.000463s : 5.92% jit_opt_b.frontend_op_eliminate : 0.000015s : 0.19% jit_opt_b.inline_after_opt_a : 0.000015s : 0.19% cconv : 0.000024s : 0.30% loop_unroll : 0.000397s : 5.08% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.07% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000019s : 0.24% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.18% partial_unused_args_eliminate : 0.000003s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000047s : 0.60% cse_after_recomputation.cse : 0.000010s : 0.13% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000004s : 0.05% opt_after_jit_grad : 0.000433s : 5.53% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.15% symbol_engine_optimizer.opt_reshape : 0.000005s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000032s : 0.41% Time group info: ------[substitution.] 0.000178 23 1.06% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 2.98% : 0.000005s : 3: substitution.graph_param_transform 82.40% : 0.000147s : 4: substitution.inline 1.56% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.68% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000004s : 2: substitution.replace_old_param 6.54% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004238 2 81.68% : 0.003462s : 1: type_inference.infer 18.32% : 0.000776s : 1: type_inference.specialize ------[replace.] 0.000063 6 67.03% : 0.000042s : 4: replace.inline 32.97% : 0.000021s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000155 6 93.25% : 0.000144s : 4: match.inline 6.75% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000111 691 1.45% : 0.000002s : 10: predicate.accumulaten_eliminater 0.94% : 0.000001s : 3: predicate.ad_related_special_op_eliminate 1.17% : 0.000001s : 10: predicate.addn_check_dump 1.20% : 0.000001s : 10: predicate.addn_zero_filter 1.87% : 0.000002s : 10: predicate.arithmetic_simplify 1.20% : 0.000001s : 10: predicate.cast_eliminate 0.49% : 0.000001s : 3: predicate.check_bprop_eliminate 1.12% : 0.000001s : 10: predicate.compare_switch_simplify 1.17% : 0.000001s : 10: predicate.depend_value_elim 1.10% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.22% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.25% : 0.000001s : 10: predicate.dict_set_item_eliminator 1.04% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.31% : 0.000000s : 3: predicate.elim_not_effective 0.60% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.25% : 0.000001s : 10: predicate.environ_add_const_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 10: predicate.environ_get_depend_swap 1.21% : 0.000001s : 10: predicate.environ_get_eliminate 1.23% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.23% : 0.000000s : 3: predicate.fold_const_symbol 1.31% : 0.000001s : 6: predicate.get_grad_eliminate 0.28% : 0.000000s : 3: predicate.graph_param_transform 5.68% : 0.000006s : 22: predicate.inline 0.95% : 0.000001s : 6: predicate.inline_without_move 0.40% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.13% : 0.000001s : 6: predicate.less_batch_normalization 1.49% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 2.08% : 0.000002s : 15: predicate.load_eliminater 1.53% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.27% : 0.000005s : 34: predicate.loop_unroll_before_grad 2.13% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.19% : 0.000001s : 10: predicate.merge_addn 1.14% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000002s : 3: predicate.mutable_eliminate 0.50% : 0.000001s : 3: predicate.opt_reshape 2.25% : 0.000002s : 15: predicate.partial_eliminate 1.21% : 0.000001s : 10: predicate.print_const_string_wrapper 1.57% : 0.000002s : 10: predicate.reduce_eliminate 1.49% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.56% : 0.000001s : 6: predicate.remove_not_recompute_node 1.72% : 0.000002s : 18: predicate.replace_applicator 0.49% : 0.000001s : 6: predicate.replace_old_param 0.38% : 0.000000s : 3: predicate.reset_defer_inline 1.23% : 0.000001s : 10: predicate.reshape_eliminate 1.29% : 0.000001s : 10: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.58% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.94% : 0.000001s : 6: predicate.special_op_eliminate 1.04% : 0.000001s : 6: predicate.specialize_transform 1.43% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.29% : 0.000001s : 10: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.34% : 0.000003s : 16: predicate.switch_defer_inline 2.23% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.49% : 0.000008s : 53: predicate.switch_simplify 1.23% : 0.000001s : 10: predicate.tile_eliminate 1.29% : 0.000001s : 10: predicate.transpose_eliminate 1.37% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.31% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000004s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.55% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.74% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 3.07% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.85% : 0.000002s : 10: predicate.value_based_eliminate 0.34% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.71% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000563 13 53.57% : 0.000302s : 6: func_graph_cloner_run.FuncGraphClonerGraph 5.18% : 0.000029s : 1: func_graph_cloner_run.FuncGraphClonerNode 41.24% : 0.000232s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012735 72 0.39% : 0.000050s : 1: add_recomputation 0.53% : 0.000067s : 1: auto_monad 0.14% : 0.000017s : 1: auto_monad_reorder 2.16% : 0.000276s : 1: bootstrap 0.21% : 0.000026s : 1: cconv 0.07% : 0.000009s : 1: convert_after_rewriter 0.18% : 0.000023s : 1: cse_after_recomputation 0.06% : 0.000007s : 1: environ_conv 0.16% : 0.000020s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000003s : 1: get_jit_bprop_graph 0.06% : 0.000008s : 1: graph_reusing 37.25% : 0.004744s : 1: jit_opt_a 1.09% : 0.000138s : 1: jit_opt_after_cconv 0.38% : 0.000049s : 1: jit_opt_b 3.18% : 0.000404s : 1: loop_unroll 3.70% : 0.000471s : 1: mutable_eliminate 6.14% : 0.000781s : 26: opt.transform.jit_opt_a 0.36% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000024s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000012s : 1: opt.transform.mutable_eliminate 0.15% : 0.000019s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000030s : 4: opt.transform.symbol_engine_opt 3.46% : 0.000440s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.04% : 0.000005s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.29% : 0.000037s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.13% : 0.000016s : 1: remove_dup_value 2.00% : 0.000254s : 1: renormalize.infer 1.80% : 0.000230s : 1: renormalize.specialize 0.05% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.26% : 0.000034s : 1: rewriter_after_opt_a 0.59% : 0.000075s : 1: rewriter_before_opt_a 0.56% : 0.000071s : 1: symbol_engine_optimizer 33.77% : 0.004301s : 1: type_inference TotalTime = 0.107889, [30] [bootstrap]: 0.00025847 [type_inference]: 0.0986369 [event_method]: 1.887e-05 [auto_monad]: 6.688e-05 [graph_reusing]: 6.38e-06 [pre_auto_parallel]: 2.54001e-06 [py_interpret_to_execute]: 0.00038824 [rewriter_before_opt_a]: 8.34e-05 [expand_dump_flag]: 3.09999e-06 [jit_opt_a]: 0.00633493, [2] [Cycle 1]: 0.00295929, [27] [switch_simplify]: 5.297e-05 [loop_unroll]: 3.129e-05 [a_1]: 0.00054881 [with_stream_mark]: 1.546e-05 [recompute_prepare]: 8.28001e-06 [updatestate_depend_eliminate]: 3.83999e-06 [updatestate_assign_eliminate]: 3.51999e-06 [updatestate_loads_eliminate]: 2.88998e-06 [parameter_eliminate]: 1.70001e-06 [specialize_transform]: 6.91001e-06 [updatestate_useless_node_eliminater]: 5.84e-06 [accelerated_algorithm]: 6.10002e-06 [meta_shard_fg_expand]: 2.06e-06 [get_grad_eliminate_]: 4.673e-05 [merge_forward]: 4.37e-06 [cell_reuse_recompute_pass]: 1.04998e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.528e-05 [j_node_and_user_rematch]: 9.67999e-06 [meta_fg_expand]: 2.56e-06 [replace_old_param]: 9.95002e-06 [inline_without_move]: 6.48e-06 [renormalize]: 0.00194222 [add_forward_monad_depend]: 5.42999e-06 [auto_monad_grad]: 2.34999e-06 [auto_monad_eliminator]: 1.498e-05 [cse]: 2.949e-05 [replace_applicator]: 1.29e-05 [Cycle 2]: 0.00035494, [27] [switch_simplify]: 6.58e-06 [loop_unroll]: 5.87999e-06 [a_1]: 0.00011996 [with_stream_mark]: 8.77999e-06 [recompute_prepare]: 5.64e-06 [updatestate_depend_eliminate]: 2.76e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.04999e-06 [parameter_eliminate]: 1.04e-06 [specialize_transform]: 5.67001e-06 [updatestate_useless_node_eliminater]: 5.37001e-06 [accelerated_algorithm]: 5.62001e-06 [meta_shard_fg_expand]: 1.18001e-06 [get_grad_eliminate_]: 5.49e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.18001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.412e-05 [j_node_and_user_rematch]: 8.80001e-06 [meta_fg_expand]: 1.72999e-06 [replace_old_param]: 8.83001e-06 [inline_without_move]: 5.56e-06 [renormalize]: 7.99773e-08 [add_forward_monad_depend]: 1.13001e-06 [auto_monad_grad]: 6.39993e-07 [auto_monad_eliminator]: 5.70001e-06 [cse]: 1.074e-05 [replace_applicator]: 6.06998e-06 [py_interpret_to_execute_after_opt_a]: 8.34002e-06 [rewriter_after_opt_a]: 3.114e-05 [convert_after_rewriter]: 7.16001e-06 [order_py_execute_after_rewriter]: 5.12e-06 [mutable_eliminate]: 0.00046764 [jit_opt_b]: 5.264e-05, [1] [Cycle 1]: 4.624e-05, [2] [frontend_op_eliminate]: 1.871e-05 [inline_after_opt_a]: 1.713e-05 [cconv]: 2.462e-05 [loop_unroll]: 0.00040718 [jit_opt_after_cconv]: 0.00014447, [1] [Cycle 1]: 0.00013812, [11] [c_1]: 2.494e-05 [parameter_eliminate]: 2.61e-06 [updatestate_depend_eliminate]: 5.46e-06 [updatestate_assign_eliminate]: 2.36e-06 [updatestate_loads_eliminate]: 2.09999e-06 [cse]: 1.793e-05 [call_graph_tuple_transform]: 2.054e-05 [tuple_list_get_item_eliminator]: 5.94e-06 [none_parameter_eliminate]: 1.57999e-06 [renormalize]: 3.50003e-07 [switch_simplify]: 5.85002e-06 [remove_dup_value]: 1.531e-05 [partial_unused_args_eliminate]: 2.58e-06 [environ_conv]: 7.63999e-06 [add_recomputation]: 4.578e-05 [cse_after_recomputation]: 2.027e-05, [1] [Cycle 1]: 1.527e-05, [1] [cse]: 9.76e-06 [auto_monad_reorder]: 1.486e-05 [get_jit_bprop_graph]: 1.44998e-06 [rewriter_after_jit_bprop_graph]: 3.94002e-06 [opt_after_jit_grad]: 0.00049835 [symbol_engine_optimizer]: 7.392e-05, [1] [Cycle 1]: 6.773e-05, [6] [build]: 3.24001e-06 [elim_shapecalc]: 8.55999e-06 [elim_not_effective]: 1.328e-05 [opt_reshape]: 7.08998e-06 [fold_const_symbol]: 9.05999e-06 [renormalize]: 3.69997e-07 [validate]: 8.513e-05 Sums bootstrap : 0.000258s : 0.25% type_inference : 0.098637s : 94.56% event_method : 0.000019s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000388s : 0.37% rewriter_before_opt_a : 0.000083s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.06% jit_opt_a.loop_unroll : 0.000037s : 0.04% jit_opt_a.a_1 : 0.000669s : 0.64% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000052s : 0.05% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000019s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.001942s : 1.86% jit_opt_a.add_forward_monad_depend : 0.000007s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000040s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000008s : 0.01% rewriter_after_opt_a : 0.000031s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000468s : 0.45% jit_opt_b.frontend_op_eliminate : 0.000019s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000407s : 0.39% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000003s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000018s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000021s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000046s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000498s : 0.48% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000085s : 0.08% Time group info: ------[substitution.] 0.000187 24 0.94% : 0.000002s : 2: substitution.elim_not_effective 0.70% : 0.000001s : 2: substitution.fold_const_symbol 3.35% : 0.000006s : 4: substitution.graph_param_transform 81.25% : 0.000152s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.75% : 0.000005s : 4: substitution.remove_not_recompute_node 2.23% : 0.000004s : 2: substitution.replace_old_param 7.26% : 0.000014s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.098569 2 97.78% : 0.096376s : 1: type_inference.infer 2.22% : 0.002193s : 1: type_inference.specialize ------[replace.] 0.000070 6 66.46% : 0.000046s : 4: replace.inline 33.54% : 0.000023s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000161 6 92.34% : 0.000149s : 4: match.inline 7.66% : 0.000012s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000131 830 1.24% : 0.000002s : 12: predicate.accumulaten_eliminater 1.16% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.23% : 0.000002s : 12: predicate.addn_check_dump 1.46% : 0.000002s : 12: predicate.addn_zero_filter 1.97% : 0.000003s : 12: predicate.arithmetic_simplify 1.32% : 0.000002s : 12: predicate.cast_eliminate 0.48% : 0.000001s : 4: predicate.check_bprop_eliminate 1.20% : 0.000002s : 12: predicate.compare_switch_simplify 1.24% : 0.000002s : 12: predicate.depend_value_elim 1.10% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.24% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.21% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.64% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.52% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.06% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.07% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.06% : 0.000001s : 8: predicate.get_grad_eliminate 0.31% : 0.000000s : 4: predicate.graph_param_transform 5.33% : 0.000007s : 26: predicate.inline 0.97% : 0.000001s : 8: predicate.inline_without_move 0.48% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.16% : 0.000002s : 8: predicate.less_batch_normalization 1.40% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.79% : 0.000002s : 18: predicate.load_eliminater 1.52% : 0.000002s : 4: predicate.loop_unroll_after_grad 4.01% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.95% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.07% : 0.000001s : 12: predicate.merge_addn 1.05% : 0.000001s : 12: predicate.minmaximum_grad 1.72% : 0.000002s : 4: predicate.mutable_eliminate 0.87% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.30% : 0.000002s : 12: predicate.print_const_string_wrapper 1.63% : 0.000002s : 12: predicate.reduce_eliminate 1.39% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.73% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.64% : 0.000001s : 8: predicate.replace_old_param 0.38% : 0.000000s : 4: predicate.reset_defer_inline 1.31% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.83% : 0.000001s : 4: predicate.row_tensor_eliminate 1.20% : 0.000002s : 12: predicate.same_eliminate 0.63% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.15% : 0.000002s : 8: predicate.special_op_eliminate 1.00% : 0.000001s : 8: predicate.specialize_transform 1.44% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.32% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.51% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.42% : 0.000003s : 18: predicate.switch_defer_inline 2.06% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.20% : 0.000009s : 58: predicate.switch_simplify 1.17% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.49% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.95% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.65% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.45% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.00% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.56% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.62% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001901 22 65.84% : 0.001252s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.41% : 0.000027s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.74% : 0.000622s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.110794 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000070s : 1: auto_monad 0.02% : 0.000017s : 1: auto_monad_reorder 0.25% : 0.000275s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000022s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.72% : 0.006338s : 1: jit_opt_a 0.13% : 0.000147s : 1: jit_opt_after_cconv 0.05% : 0.000055s : 1: jit_opt_b 0.37% : 0.000415s : 1: loop_unroll 0.43% : 0.000476s : 1: mutable_eliminate 0.84% : 0.000936s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.46% : 0.000507s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.36% : 0.000396s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.18% : 0.001310s : 1: renormalize.infer 0.56% : 0.000624s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000088s : 1: rewriter_before_opt_a 0.07% : 0.000076s : 1: symbol_engine_optimizer 89.04% : 0.098652s : 1: type_inference TotalTime = 0.116829, [30] [bootstrap]: 0.00026704 [type_inference]: 0.106834 [event_method]: 1.95e-05 [auto_monad]: 0.00010285 [graph_reusing]: 5.72001e-06 [pre_auto_parallel]: 2.58e-06 [py_interpret_to_execute]: 0.00040669 [rewriter_before_opt_a]: 8.306e-05 [expand_dump_flag]: 3.5e-06 [jit_opt_a]: 0.00697581, [2] [Cycle 1]: 0.00304343, [27] [switch_simplify]: 5.368e-05 [loop_unroll]: 3.081e-05 [a_1]: 0.00054203 [with_stream_mark]: 3.856e-05 [recompute_prepare]: 8.77999e-06 [updatestate_depend_eliminate]: 4.24002e-06 [updatestate_assign_eliminate]: 3.35e-06 [updatestate_loads_eliminate]: 3.01001e-06 [parameter_eliminate]: 1.69998e-06 [specialize_transform]: 6.86999e-06 [updatestate_useless_node_eliminater]: 6.01e-06 [accelerated_algorithm]: 6.66999e-06 [meta_shard_fg_expand]: 1.97001e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.75998e-06 [cell_reuse_recompute_pass]: 1.47001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.579e-05 [j_node_and_user_rematch]: 9.56e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 9.35001e-06 [inline_without_move]: 6.06e-06 [renormalize]: 0.00204902 [add_forward_monad_depend]: 5.40999e-06 [auto_monad_grad]: 2.29999e-06 [auto_monad_eliminator]: 1.486e-05 [cse]: 2.979e-05 [replace_applicator]: 1.29e-05 [Cycle 2]: 0.00035226, [27] [switch_simplify]: 6.52001e-06 [loop_unroll]: 5.67001e-06 [a_1]: 0.00011995 [with_stream_mark]: 8.54998e-06 [recompute_prepare]: 5.71998e-06 [updatestate_depend_eliminate]: 2.74999e-06 [updatestate_assign_eliminate]: 2.26998e-06 [updatestate_loads_eliminate]: 2.01998e-06 [parameter_eliminate]: 8.70001e-07 [specialize_transform]: 5.61998e-06 [updatestate_useless_node_eliminater]: 5.40001e-06 [accelerated_algorithm]: 5.81003e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 5.42001e-06 [merge_forward]: 2.56e-06 [cell_reuse_recompute_pass]: 1.50999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.346e-05 [j_node_and_user_rematch]: 8.50999e-06 [meta_fg_expand]: 1.74998e-06 [replace_old_param]: 8.38001e-06 [inline_without_move]: 5.45001e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.03001e-06 [auto_monad_grad]: 6.50005e-07 [auto_monad_eliminator]: 5.65001e-06 [cse]: 1.135e-05 [replace_applicator]: 5.82001e-06 [py_interpret_to_execute_after_opt_a]: 8.96002e-06 [rewriter_after_opt_a]: 5.836e-05 [convert_after_rewriter]: 7.33e-06 [order_py_execute_after_rewriter]: 4.80001e-06 [mutable_eliminate]: 0.00046785 [jit_opt_b]: 5.366e-05, [1] [Cycle 1]: 4.648e-05, [2] [frontend_op_eliminate]: 1.825e-05 [inline_after_opt_a]: 1.7e-05 [cconv]: 2.524e-05 [loop_unroll]: 0.0004066 [jit_opt_after_cconv]: 0.0001455, [1] [Cycle 1]: 0.00013913, [11] [c_1]: 2.528e-05 [parameter_eliminate]: 2.26e-06 [updatestate_depend_eliminate]: 5.58002e-06 [updatestate_assign_eliminate]: 2.27999e-06 [updatestate_loads_eliminate]: 2.26998e-06 [cse]: 1.912e-05 [call_graph_tuple_transform]: 2.003e-05 [tuple_list_get_item_eliminator]: 6.29001e-06 [none_parameter_eliminate]: 1.62999e-06 [renormalize]: 3.19997e-07 [switch_simplify]: 5.97999e-06 [remove_dup_value]: 1.453e-05 [partial_unused_args_eliminate]: 2.49001e-06 [environ_conv]: 8e-06 [add_recomputation]: 4.714e-05 [cse_after_recomputation]: 2.063e-05, [1] [Cycle 1]: 1.534e-05, [1] [cse]: 1.004e-05 [auto_monad_reorder]: 1.651e-05 [get_jit_bprop_graph]: 1.39998e-06 [rewriter_after_jit_bprop_graph]: 4.16001e-06 [opt_after_jit_grad]: 0.00048813 [symbol_engine_optimizer]: 7.282e-05, [1] [Cycle 1]: 6.709e-05, [6] [build]: 3.26999e-06 [elim_shapecalc]: 8.37998e-06 [elim_not_effective]: 1.346e-05 [opt_reshape]: 6.26e-06 [fold_const_symbol]: 9.26002e-06 [renormalize]: 3.60014e-07 [validate]: 9.998e-05 Sums bootstrap : 0.000267s : 0.24% type_inference : 0.106834s : 94.81% event_method : 0.000020s : 0.02% auto_monad : 0.000103s : 0.09% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000003s : 0.00% py_interpret_to_execute : 0.000407s : 0.36% rewriter_before_opt_a : 0.000083s : 0.07% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000060s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000662s : 0.59% jit_opt_a.with_stream_mark : 0.000047s : 0.04% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000011s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000029s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002049s : 1.82% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000041s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000058s : 0.05% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000468s : 0.42% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000407s : 0.36% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000008s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000017s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000488s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000009s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000100s : 0.09% Time group info: ------[substitution.] 0.000183 24 1.02% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.99% : 0.000005s : 4: substitution.graph_param_transform 82.99% : 0.000152s : 4: substitution.inline 1.52% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.59% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000004s : 2: substitution.replace_old_param 6.25% : 0.000011s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.106698 2 97.80% : 0.104347s : 1: type_inference.infer 2.20% : 0.002351s : 1: type_inference.specialize ------[replace.] 0.000069 6 68.48% : 0.000047s : 4: replace.inline 31.52% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000160 6 93.49% : 0.000149s : 4: match.inline 6.51% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000129 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.09% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.13% : 0.000001s : 12: predicate.addn_check_dump 1.29% : 0.000002s : 12: predicate.addn_zero_filter 2.13% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.18% : 0.000002s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.09% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.16% : 0.000001s : 12: predicate.dict_get_item_eliminator 1.20% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.95% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.53% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.11% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.13% : 0.000001s : 12: predicate.environ_get_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.18% : 0.000002s : 8: predicate.get_grad_eliminate 0.33% : 0.000000s : 4: predicate.graph_param_transform 5.29% : 0.000007s : 26: predicate.inline 1.06% : 0.000001s : 8: predicate.inline_without_move 0.50% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.29% : 0.000002s : 8: predicate.less_batch_normalization 1.54% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.81% : 0.000002s : 18: predicate.load_eliminater 1.32% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.79% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.79% : 0.000002s : 16: predicate.make_slice_get_slice_eliminator 1.10% : 0.000001s : 12: predicate.merge_addn 1.10% : 0.000001s : 12: predicate.minmaximum_grad 1.50% : 0.000002s : 4: predicate.mutable_eliminate 0.51% : 0.000001s : 4: predicate.opt_reshape 2.54% : 0.000003s : 18: predicate.partial_eliminate 1.19% : 0.000002s : 12: predicate.print_const_string_wrapper 1.79% : 0.000002s : 12: predicate.reduce_eliminate 1.40% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.71% : 0.000001s : 8: predicate.remove_not_recompute_node 1.99% : 0.000003s : 22: predicate.replace_applicator 0.81% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.26% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.82% : 0.000001s : 4: predicate.row_tensor_eliminate 1.15% : 0.000001s : 12: predicate.same_eliminate 0.69% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.05% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.47% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.26% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.48% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.64% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.58% : 0.000010s : 58: predicate.switch_simplify 1.47% : 0.000002s : 12: predicate.tile_eliminate 1.24% : 0.000002s : 12: predicate.transpose_eliminate 1.60% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.40% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.08% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.53% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.72% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 2.91% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.69% : 0.000002s : 12: predicate.value_based_eliminate 0.36% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.60% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001974 22 66.63% : 0.001315s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.33% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 32.04% : 0.000632s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.119776 72 0.04% : 0.000050s : 1: add_recomputation 0.09% : 0.000107s : 1: auto_monad 0.02% : 0.000019s : 1: auto_monad_reorder 0.24% : 0.000284s : 1: bootstrap 0.02% : 0.000028s : 1: cconv 0.01% : 0.000010s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000010s : 1: environ_conv 0.02% : 0.000024s : 1: event_method 0.00% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.83% : 0.006978s : 1: jit_opt_a 0.12% : 0.000148s : 1: jit_opt_after_cconv 0.05% : 0.000056s : 1: jit_opt_b 0.35% : 0.000414s : 1: loop_unroll 0.40% : 0.000476s : 1: mutable_eliminate 0.74% : 0.000889s : 26: opt.transform.jit_opt_a 0.05% : 0.000054s : 4: opt.transform.jit_opt_after_cconv 0.02% : 0.000029s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000025s : 1: opt.transform.opt_after_jit_grad 0.03% : 0.000034s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000496s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.34% : 0.000413s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.17% : 0.001403s : 1: renormalize.infer 0.53% : 0.000638s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.05% : 0.000062s : 1: rewriter_after_opt_a 0.07% : 0.000088s : 1: rewriter_before_opt_a 0.06% : 0.000075s : 1: symbol_engine_optimizer 89.21% : 0.106850s : 1: type_inference TotalTime = 0.109712, [30] [bootstrap]: 0.00031338 [type_inference]: 0.100001 [event_method]: 1.905e-05 [auto_monad]: 6.502e-05 [graph_reusing]: 6.29001e-06 [pre_auto_parallel]: 2.48e-06 [py_interpret_to_execute]: 0.00048735 [rewriter_before_opt_a]: 8.145e-05 [expand_dump_flag]: 3.43999e-06 [jit_opt_a]: 0.0065566, [2] [Cycle 1]: 0.00316046, [27] [switch_simplify]: 5.009e-05 [loop_unroll]: 3.121e-05 [a_1]: 0.00060182 [with_stream_mark]: 1.517e-05 [recompute_prepare]: 8.3e-06 [updatestate_depend_eliminate]: 3.66999e-06 [updatestate_assign_eliminate]: 2.91e-06 [updatestate_loads_eliminate]: 3.13e-06 [parameter_eliminate]: 1.79e-06 [specialize_transform]: 6.88998e-06 [updatestate_useless_node_eliminater]: 6.00002e-06 [accelerated_algorithm]: 6.39001e-06 [meta_shard_fg_expand]: 2.01998e-06 [get_grad_eliminate_]: 6.38e-06 [merge_forward]: 3.45e-06 [cell_reuse_recompute_pass]: 9.5999e-07 [cell_reuse_handle_not_recompute_node_pass]: 1.467e-05 [j_node_and_user_rematch]: 9.91e-06 [meta_fg_expand]: 2.47001e-06 [replace_old_param]: 9.46e-06 [inline_without_move]: 6.23e-06 [renormalize]: 0.00213862 [add_forward_monad_depend]: 5.30999e-06 [auto_monad_grad]: 2.02999e-06 [auto_monad_eliminator]: 1.525e-05 [cse]: 2.767e-05 [replace_applicator]: 1.296e-05 [Cycle 2]: 0.00035199, [27] [switch_simplify]: 6.84001e-06 [loop_unroll]: 5.84e-06 [a_1]: 0.00012123 [with_stream_mark]: 8.74e-06 [recompute_prepare]: 5.86998e-06 [updatestate_depend_eliminate]: 2.64999e-06 [updatestate_assign_eliminate]: 2.17001e-06 [updatestate_loads_eliminate]: 2.04e-06 [parameter_eliminate]: 8.89995e-07 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.65001e-06 [accelerated_algorithm]: 5.46e-06 [meta_shard_fg_expand]: 1.22e-06 [get_grad_eliminate_]: 5.32001e-06 [merge_forward]: 2.49999e-06 [cell_reuse_recompute_pass]: 1.36002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.343e-05 [j_node_and_user_rematch]: 8.47e-06 [meta_fg_expand]: 1.64e-06 [replace_old_param]: 8.09997e-06 [inline_without_move]: 5.67001e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 7.7e-07 [auto_monad_eliminator]: 5.42999e-06 [cse]: 1.16e-05 [replace_applicator]: 5.91998e-06 [py_interpret_to_execute_after_opt_a]: 1.003e-05 [rewriter_after_opt_a]: 3.155e-05 [convert_after_rewriter]: 6.31e-06 [order_py_execute_after_rewriter]: 5.44e-06 [mutable_eliminate]: 0.00049955 [jit_opt_b]: 5.466e-05, [1] [Cycle 1]: 4.776e-05, [2] [frontend_op_eliminate]: 1.972e-05 [inline_after_opt_a]: 1.728e-05 [cconv]: 2.505e-05 [loop_unroll]: 0.00047871 [jit_opt_after_cconv]: 0.00014825, [1] [Cycle 1]: 0.00014205, [11] [c_1]: 2.595e-05 [parameter_eliminate]: 2.29999e-06 [updatestate_depend_eliminate]: 5.20999e-06 [updatestate_assign_eliminate]: 2.24001e-06 [updatestate_loads_eliminate]: 2.11e-06 [cse]: 1.937e-05 [call_graph_tuple_transform]: 2.036e-05 [tuple_list_get_item_eliminator]: 6.25002e-06 [none_parameter_eliminate]: 1.42999e-06 [renormalize]: 4.39992e-07 [switch_simplify]: 5.97001e-06 [remove_dup_value]: 1.451e-05 [partial_unused_args_eliminate]: 3.24001e-06 [environ_conv]: 7.08998e-06 [add_recomputation]: 4.678e-05 [cse_after_recomputation]: 2.134e-05, [1] [Cycle 1]: 1.626e-05, [1] [cse]: 1.04e-05 [auto_monad_reorder]: 1.463e-05 [get_jit_bprop_graph]: 1.45999e-06 [rewriter_after_jit_bprop_graph]: 4.25999e-06 [opt_after_jit_grad]: 0.00045753 [symbol_engine_optimizer]: 0.00014125, [1] [Cycle 1]: 0.00013505, [6] [build]: 3.30998e-06 [elim_shapecalc]: 8.3e-06 [elim_not_effective]: 1.45e-05 [opt_reshape]: 6.938e-05 [fold_const_symbol]: 1.102e-05 [renormalize]: 4.00003e-07 [validate]: 3.805e-05 Sums bootstrap : 0.000313s : 0.30% type_inference : 0.100001s : 94.24% event_method : 0.000019s : 0.02% auto_monad : 0.000065s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000487s : 0.46% rewriter_before_opt_a : 0.000081s : 0.08% expand_dump_flag : 0.000003s : 0.00% jit_opt_a.switch_simplify : 0.000057s : 0.05% jit_opt_a.loop_unroll : 0.000037s : 0.03% jit_opt_a.a_1 : 0.000723s : 0.68% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.00% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000013s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000018s : 0.02% jit_opt_a.inline_without_move : 0.000012s : 0.01% jit_opt_a.renormalize : 0.002139s : 2.02% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000003s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.02% jit_opt_a.cse : 0.000039s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000010s : 0.01% rewriter_after_opt_a : 0.000032s : 0.03% convert_after_rewriter : 0.000006s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000500s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.02% jit_opt_b.inline_after_opt_a : 0.000017s : 0.02% cconv : 0.000025s : 0.02% loop_unroll : 0.000479s : 0.45% jit_opt_after_cconv.c_1 : 0.000026s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000005s : 0.00% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000001s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000015s : 0.01% partial_unused_args_eliminate : 0.000003s : 0.00% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000047s : 0.04% cse_after_recomputation.cse : 0.000010s : 0.01% auto_monad_reorder : 0.000015s : 0.01% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000458s : 0.43% symbol_engine_optimizer.build : 0.000003s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000014s : 0.01% symbol_engine_optimizer.opt_reshape : 0.000069s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000011s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000038s : 0.04% Time group info: ------[substitution.] 0.000192 24 0.93% : 0.000002s : 2: substitution.elim_not_effective 0.73% : 0.000001s : 2: substitution.fold_const_symbol 3.23% : 0.000006s : 4: substitution.graph_param_transform 82.68% : 0.000159s : 4: substitution.inline 1.57% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.47% : 0.000005s : 4: substitution.remove_not_recompute_node 2.05% : 0.000004s : 2: substitution.replace_old_param 6.34% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099934 2 97.67% : 0.097607s : 1: type_inference.infer 2.33% : 0.002326s : 1: type_inference.specialize ------[replace.] 0.000068 6 68.36% : 0.000047s : 4: replace.inline 31.64% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000168 6 93.45% : 0.000157s : 4: match.inline 6.55% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000130 830 1.32% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.17% : 0.000002s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.28% : 0.000002s : 12: predicate.cast_eliminate 0.45% : 0.000001s : 4: predicate.check_bprop_eliminate 1.07% : 0.000001s : 12: predicate.compare_switch_simplify 1.17% : 0.000002s : 12: predicate.depend_value_elim 1.15% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.15% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.27% : 0.000002s : 12: predicate.dict_set_item_eliminator 0.98% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.35% : 0.000000s : 4: predicate.elim_not_effective 0.51% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.20% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.13% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_depend_swap 1.17% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.31% : 0.000000s : 4: predicate.fold_const_symbol 1.13% : 0.000001s : 8: predicate.get_grad_eliminate 0.32% : 0.000000s : 4: predicate.graph_param_transform 5.25% : 0.000007s : 26: predicate.inline 0.95% : 0.000001s : 8: predicate.inline_without_move 0.51% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.12% : 0.000001s : 8: predicate.less_batch_normalization 1.44% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.88% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.88% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.01% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.09% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.83% : 0.000002s : 4: predicate.mutable_eliminate 0.68% : 0.000001s : 4: predicate.opt_reshape 2.28% : 0.000003s : 18: predicate.partial_eliminate 1.28% : 0.000002s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.33% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.74% : 0.000001s : 8: predicate.remove_not_recompute_node 1.98% : 0.000003s : 22: predicate.replace_applicator 0.65% : 0.000001s : 8: predicate.replace_old_param 0.34% : 0.000000s : 4: predicate.reset_defer_inline 1.19% : 0.000002s : 12: predicate.reshape_eliminate 1.28% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.63% : 0.000001s : 4: predicate.row_tensor_eliminate 1.30% : 0.000002s : 12: predicate.same_eliminate 0.66% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.01% : 0.000001s : 8: predicate.special_op_eliminate 1.06% : 0.000001s : 8: predicate.specialize_transform 1.58% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.50% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.25% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.38% : 0.000010s : 58: predicate.switch_simplify 1.29% : 0.000002s : 12: predicate.tile_eliminate 1.29% : 0.000002s : 12: predicate.transpose_eliminate 1.39% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.36% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.31% : 0.000006s : 22: predicate.tuple_list_get_item_eliminator 1.80% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.70% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.02% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.63% : 0.000002s : 12: predicate.value_based_eliminate 0.40% : 0.000001s : 4: predicate.virtual_view_grad_eliminate 0.72% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001914 22 64.89% : 0.001242s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.68% : 0.000032s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.43% : 0.000640s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112938 72 0.04% : 0.000049s : 1: add_recomputation 0.06% : 0.000068s : 1: auto_monad 0.01% : 0.000017s : 1: auto_monad_reorder 0.29% : 0.000326s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000008s : 1: convert_after_rewriter 0.02% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.00% : 0.000005s : 1: expand_dump_flag 0.00% : 0.000004s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.81% : 0.006559s : 1: jit_opt_a 0.13% : 0.000151s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.43% : 0.000486s : 1: loop_unroll 0.45% : 0.000507s : 1: mutable_eliminate 0.84% : 0.000947s : 26: opt.transform.jit_opt_a 0.05% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000031s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000027s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000098s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000465s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000005s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.44% : 0.000496s : 1: py_interpret_to_execute 0.01% : 0.000012s : 1: py_interpret_to_execute_after_opt_a 0.01% : 0.000017s : 1: remove_dup_value 1.30% : 0.001466s : 1: renormalize.infer 0.59% : 0.000665s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000034s : 1: rewriter_after_opt_a 0.08% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000144s : 1: symbol_engine_optimizer 88.56% : 0.100014s : 1: type_inference TotalTime = 0.0113822, [30] [bootstrap]: 0.00024935 [type_inference]: 0.00421458 [event_method]: 1.784e-05 [auto_monad]: 6.724e-05 [graph_reusing]: 6.22001e-06 [pre_auto_parallel]: 2.13998e-06 [py_interpret_to_execute]: 3.906e-05 [rewriter_before_opt_a]: 7.149e-05 [expand_dump_flag]: 2.79999e-06 [jit_opt_a]: 0.0047392, [2] [Cycle 1]: 0.00138804, [27] [switch_simplify]: 5.031e-05 [loop_unroll]: 3.009e-05 [a_1]: 0.00049753 [with_stream_mark]: 1.409e-05 [recompute_prepare]: 6.98e-06 [updatestate_depend_eliminate]: 3.91999e-06 [updatestate_assign_eliminate]: 3.33e-06 [updatestate_loads_eliminate]: 3.04999e-06 [parameter_eliminate]: 1.71e-06 [specialize_transform]: 5.97999e-06 [updatestate_useless_node_eliminater]: 5.05001e-06 [accelerated_algorithm]: 5.30999e-06 [meta_shard_fg_expand]: 2.68998e-06 [get_grad_eliminate_]: 5.19e-06 [merge_forward]: 3.56999e-06 [cell_reuse_recompute_pass]: 1.04e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.408e-05 [j_node_and_user_rematch]: 8.50001e-06 [meta_fg_expand]: 2.43e-06 [replace_old_param]: 7.68999e-06 [inline_without_move]: 5.09998e-06 [renormalize]: 0.0004924 [add_forward_monad_depend]: 5.10001e-06 [auto_monad_grad]: 1.64e-06 [auto_monad_eliminator]: 1.471e-05 [cse]: 2.638e-05 [replace_applicator]: 1.1e-05 [Cycle 2]: 0.00035717, [27] [switch_simplify]: 5.67001e-06 [loop_unroll]: 4.87998e-06 [a_1]: 9.121e-05 [with_stream_mark]: 8.66997e-06 [recompute_prepare]: 5.69e-06 [updatestate_depend_eliminate]: 2.94999e-06 [updatestate_assign_eliminate]: 2.26e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 9.20001e-07 [specialize_transform]: 5.07e-06 [updatestate_useless_node_eliminater]: 4.97999e-06 [accelerated_algorithm]: 4.90001e-06 [meta_shard_fg_expand]: 1.32e-06 [get_grad_eliminate_]: 4.59002e-06 [merge_forward]: 2.63e-06 [cell_reuse_recompute_pass]: 1.33002e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.255e-05 [j_node_and_user_rematch]: 7.95e-06 [meta_fg_expand]: 1.74e-06 [replace_old_param]: 7.23e-06 [inline_without_move]: 4.96002e-06 [renormalize]: 6.99947e-08 [add_forward_monad_depend]: 1.07998e-06 [auto_monad_grad]: 6.09987e-07 [auto_monad_eliminator]: 6.07999e-06 [cse]: 1.131e-05 [replace_applicator]: 5.02e-06 [py_interpret_to_execute_after_opt_a]: 7.83001e-06 [rewriter_after_opt_a]: 3.157e-05 [convert_after_rewriter]: 5.94e-06 [order_py_execute_after_rewriter]: 5.15001e-06 [mutable_eliminate]: 0.00047566 [jit_opt_b]: 4.919e-05, [1] [Cycle 1]: 4.3e-05, [2] [frontend_op_eliminate]: 1.568e-05 [inline_after_opt_a]: 1.545e-05 [cconv]: 2.54e-05 [loop_unroll]: 0.00040811 [jit_opt_after_cconv]: 0.00014866, [1] [Cycle 1]: 0.00014224, [11] [c_1]: 2.093e-05 [parameter_eliminate]: 2.27999e-06 [updatestate_depend_eliminate]: 1.55e-05 [updatestate_assign_eliminate]: 2.83e-06 [updatestate_loads_eliminate]: 2.36e-06 [cse]: 1.817e-05 [call_graph_tuple_transform]: 1.821e-05 [tuple_list_get_item_eliminator]: 5.32001e-06 [none_parameter_eliminate]: 1.72001e-06 [renormalize]: 4.09986e-07 [switch_simplify]: 5.22e-06 [remove_dup_value]: 1.355e-05 [partial_unused_args_eliminate]: 2.14999e-06 [environ_conv]: 5.46e-06 [add_recomputation]: 4.428e-05 [cse_after_recomputation]: 2.183e-05, [1] [Cycle 1]: 1.647e-05, [1] [cse]: 1.088e-05 [auto_monad_reorder]: 1.523e-05 [get_jit_bprop_graph]: 1.45001e-06 [rewriter_after_jit_bprop_graph]: 5.11002e-06 [opt_after_jit_grad]: 0.00045374 [symbol_engine_optimizer]: 6.977e-05, [1] [Cycle 1]: 6.384e-05, [6] [build]: 3.32002e-06 [elim_shapecalc]: 7.68001e-06 [elim_not_effective]: 1.231e-05 [opt_reshape]: 5.52999e-06 [fold_const_symbol]: 8.40001e-06 [renormalize]: 3.80009e-07 [validate]: 3.103e-05 Sums bootstrap : 0.000249s : 3.19% type_inference : 0.004215s : 53.95% event_method : 0.000018s : 0.23% auto_monad : 0.000067s : 0.86% graph_reusing : 0.000006s : 0.08% pre_auto_parallel : 0.000002s : 0.03% py_interpret_to_execute : 0.000039s : 0.50% rewriter_before_opt_a : 0.000071s : 0.92% expand_dump_flag : 0.000003s : 0.04% jit_opt_a.switch_simplify : 0.000056s : 0.72% jit_opt_a.loop_unroll : 0.000035s : 0.45% jit_opt_a.a_1 : 0.000589s : 7.54% jit_opt_a.with_stream_mark : 0.000023s : 0.29% jit_opt_a.recompute_prepare : 0.000013s : 0.16% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.09% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.07% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.06% jit_opt_a.parameter_eliminate : 0.000003s : 0.03% jit_opt_a.specialize_transform : 0.000011s : 0.14% jit_opt_a.updatestate_useless_node_eliminater : 0.000010s : 0.13% jit_opt_a.accelerated_algorithm : 0.000010s : 0.13% jit_opt_a.meta_shard_fg_expand : 0.000004s : 0.05% jit_opt_a.get_grad_eliminate_ : 0.000010s : 0.13% jit_opt_a.merge_forward : 0.000006s : 0.08% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.03% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000027s : 0.34% jit_opt_a.j_node_and_user_rematch : 0.000016s : 0.21% jit_opt_a.meta_fg_expand : 0.000004s : 0.05% jit_opt_a.replace_old_param : 0.000015s : 0.19% jit_opt_a.inline_without_move : 0.000010s : 0.13% jit_opt_a.renormalize : 0.000492s : 6.30% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.08% jit_opt_a.auto_monad_grad : 0.000002s : 0.03% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.27% jit_opt_a.cse : 0.000038s : 0.48% jit_opt_a.replace_applicator : 0.000016s : 0.21% py_interpret_to_execute_after_opt_a : 0.000008s : 0.10% rewriter_after_opt_a : 0.000032s : 0.40% convert_after_rewriter : 0.000006s : 0.08% order_py_execute_after_rewriter : 0.000005s : 0.07% mutable_eliminate : 0.000476s : 6.09% jit_opt_b.frontend_op_eliminate : 0.000016s : 0.20% jit_opt_b.inline_after_opt_a : 0.000015s : 0.20% cconv : 0.000025s : 0.33% loop_unroll : 0.000408s : 5.22% jit_opt_after_cconv.c_1 : 0.000021s : 0.27% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000016s : 0.20% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000003s : 0.04% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.03% jit_opt_after_cconv.cse : 0.000018s : 0.23% jit_opt_after_cconv.call_graph_tuple_transform : 0.000018s : 0.23% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000005s : 0.07% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.02% jit_opt_after_cconv.renormalize : 0.000000s : 0.01% jit_opt_after_cconv.switch_simplify : 0.000005s : 0.07% remove_dup_value : 0.000014s : 0.17% partial_unused_args_eliminate : 0.000002s : 0.03% environ_conv : 0.000005s : 0.07% add_recomputation : 0.000044s : 0.57% cse_after_recomputation.cse : 0.000011s : 0.14% auto_monad_reorder : 0.000015s : 0.19% get_jit_bprop_graph : 0.000001s : 0.02% rewriter_after_jit_bprop_graph : 0.000005s : 0.07% opt_after_jit_grad : 0.000454s : 5.81% symbol_engine_optimizer.build : 0.000003s : 0.04% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.10% symbol_engine_optimizer.elim_not_effective : 0.000012s : 0.16% symbol_engine_optimizer.opt_reshape : 0.000006s : 0.07% symbol_engine_optimizer.fold_const_symbol : 0.000008s : 0.11% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000031s : 0.40% Time group info: ------[substitution.] 0.000175 23 1.09% : 0.000002s : 2: substitution.elim_not_effective 0.76% : 0.000001s : 2: substitution.fold_const_symbol 3.04% : 0.000005s : 3: substitution.graph_param_transform 81.83% : 0.000143s : 4: substitution.inline 1.59% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.96% : 0.000005s : 4: substitution.remove_not_recompute_node 1.99% : 0.000003s : 2: substitution.replace_old_param 6.76% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.004159 2 81.01% : 0.003369s : 1: type_inference.infer 18.99% : 0.000790s : 1: type_inference.specialize ------[replace.] 0.000065 6 66.26% : 0.000043s : 4: replace.inline 33.74% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000151 6 93.00% : 0.000141s : 4: match.inline 7.00% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000116 691 1.18% : 0.000001s : 10: predicate.accumulaten_eliminater 1.43% : 0.000002s : 3: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 10: predicate.addn_check_dump 1.33% : 0.000002s : 10: predicate.addn_zero_filter 1.88% : 0.000002s : 10: predicate.arithmetic_simplify 1.36% : 0.000002s : 10: predicate.cast_eliminate 0.54% : 0.000001s : 3: predicate.check_bprop_eliminate 1.18% : 0.000001s : 10: predicate.compare_switch_simplify 1.29% : 0.000001s : 10: predicate.depend_value_elim 1.13% : 0.000001s : 10: predicate.dict_get_item_const_eliminator 1.24% : 0.000001s : 10: predicate.dict_get_item_eliminator 1.42% : 0.000002s : 10: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 3: predicate.dumpgradient_eliminate 0.30% : 0.000000s : 3: predicate.elim_not_effective 0.62% : 0.000001s : 3: predicate.elim_shapecalc_of_broadcastargs 1.56% : 0.000002s : 10: predicate.environ_add_const_eliminate 1.07% : 0.000001s : 10: predicate.environ_get_add_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_depend_swap 1.26% : 0.000001s : 10: predicate.environ_get_eliminate 1.12% : 0.000001s : 10: predicate.environ_get_set_eliminate 0.27% : 0.000000s : 3: predicate.fold_const_symbol 0.98% : 0.000001s : 6: predicate.get_grad_eliminate 0.35% : 0.000000s : 3: predicate.graph_param_transform 5.62% : 0.000007s : 22: predicate.inline 0.91% : 0.000001s : 6: predicate.inline_without_move 0.43% : 0.000000s : 6: predicate.j_node_and_user_rematch 1.15% : 0.000001s : 6: predicate.less_batch_normalization 1.50% : 0.000002s : 12: predicate.list_to_tuple_eliminator_ 1.92% : 0.000002s : 15: predicate.load_eliminater 1.56% : 0.000002s : 3: predicate.loop_unroll_after_grad 4.28% : 0.000005s : 34: predicate.loop_unroll_before_grad 1.84% : 0.000002s : 13: predicate.make_slice_get_slice_eliminator 1.05% : 0.000001s : 10: predicate.merge_addn 1.12% : 0.000001s : 10: predicate.minmaximum_grad 1.86% : 0.000002s : 3: predicate.mutable_eliminate 0.49% : 0.000001s : 3: predicate.opt_reshape 2.30% : 0.000003s : 15: predicate.partial_eliminate 1.19% : 0.000001s : 10: predicate.print_const_string_wrapper 1.58% : 0.000002s : 10: predicate.reduce_eliminate 1.61% : 0.000002s : 12: predicate.redundant_stop_gradient_eliminater 0.54% : 0.000001s : 6: predicate.remove_not_recompute_node 1.77% : 0.000002s : 18: predicate.replace_applicator 0.52% : 0.000001s : 6: predicate.replace_old_param 0.35% : 0.000000s : 3: predicate.reset_defer_inline 1.21% : 0.000001s : 10: predicate.reshape_eliminate 1.32% : 0.000002s : 10: predicate.row_tensor_add_zeros_like 0.64% : 0.000001s : 3: predicate.row_tensor_eliminate 1.14% : 0.000001s : 10: predicate.same_eliminate 0.59% : 0.000001s : 6: predicate.set_cell_output_no_recompute 0.84% : 0.000001s : 6: predicate.special_op_eliminate 1.05% : 0.000001s : 6: predicate.specialize_transform 1.37% : 0.000002s : 10: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 10: predicate.stack_unstack_eliminate 0.46% : 0.000001s : 3: predicate.switch_call_monad_eliminater 2.39% : 0.000003s : 16: predicate.switch_defer_inline 2.13% : 0.000002s : 16: predicate.switch_layer_defer_inline 7.38% : 0.000009s : 53: predicate.switch_simplify 1.37% : 0.000002s : 10: predicate.tile_eliminate 1.32% : 0.000002s : 10: predicate.transpose_eliminate 1.48% : 0.000002s : 10: predicate.tuple_list_convert_item_index_to_positive 1.28% : 0.000001s : 10: predicate.tuple_list_get_item_depend_reorder 3.91% : 0.000005s : 18: predicate.tuple_list_get_item_eliminator 1.49% : 0.000002s : 10: predicate.tuple_list_set_item_eliminator 1.44% : 0.000002s : 12: predicate.tuple_to_list_eliminator_ 1.71% : 0.000002s : 15: predicate.updatestate_pure_node_eliminater 2.84% : 0.000003s : 21: predicate.updatestate_useless_node_eliminater 1.64% : 0.000002s : 10: predicate.value_based_eliminate 0.41% : 0.000000s : 3: predicate.virtual_view_grad_eliminate 0.81% : 0.000001s : 3: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.000550 13 50.98% : 0.000281s : 6: func_graph_cloner_run.FuncGraphClonerGraph 4.71% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 44.30% : 0.000244s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.012731 72 0.37% : 0.000047s : 1: add_recomputation 0.56% : 0.000071s : 1: auto_monad 0.14% : 0.000018s : 1: auto_monad_reorder 2.07% : 0.000264s : 1: bootstrap 0.22% : 0.000028s : 1: cconv 0.06% : 0.000008s : 1: convert_after_rewriter 0.19% : 0.000024s : 1: cse_after_recomputation 0.06% : 0.000008s : 1: environ_conv 0.17% : 0.000021s : 1: event_method 0.04% : 0.000005s : 1: expand_dump_flag 0.03% : 0.000004s : 1: get_jit_bprop_graph 0.07% : 0.000008s : 1: graph_reusing 37.24% : 0.004742s : 1: jit_opt_a 1.19% : 0.000152s : 1: jit_opt_after_cconv 0.41% : 0.000052s : 1: jit_opt_b 3.26% : 0.000415s : 1: loop_unroll 3.80% : 0.000484s : 1: mutable_eliminate 6.22% : 0.000792s : 26: opt.transform.jit_opt_a 0.36% : 0.000046s : 4: opt.transform.jit_opt_after_cconv 0.19% : 0.000025s : 4: opt.transform.jit_opt_b 0.09% : 0.000012s : 1: opt.transform.loop_unroll_optimizer 0.10% : 0.000013s : 1: opt.transform.mutable_eliminate 0.17% : 0.000021s : 1: opt.transform.opt_after_jit_grad 0.24% : 0.000031s : 4: opt.transform.symbol_engine_opt 3.62% : 0.000461s : 1: opt_after_jit_grad 0.06% : 0.000007s : 1: order_py_execute_after_rewriter 0.03% : 0.000004s : 1: partial_unused_args_eliminate 0.03% : 0.000004s : 1: pre_auto_parallel 0.33% : 0.000042s : 1: py_interpret_to_execute 0.08% : 0.000010s : 1: py_interpret_to_execute_after_opt_a 0.12% : 0.000016s : 1: remove_dup_value 1.88% : 0.000239s : 1: renormalize.infer 1.93% : 0.000246s : 1: renormalize.specialize 0.06% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.27% : 0.000035s : 1: rewriter_after_opt_a 0.58% : 0.000074s : 1: rewriter_before_opt_a 0.57% : 0.000072s : 1: symbol_engine_optimizer 33.19% : 0.004225s : 1: type_inference TotalTime = 0.109297, [30] [bootstrap]: 0.00024637 [type_inference]: 0.100025 [event_method]: 1.88e-05 [auto_monad]: 6.717e-05 [graph_reusing]: 5.86e-06 [pre_auto_parallel]: 2.49999e-06 [py_interpret_to_execute]: 0.00042355 [rewriter_before_opt_a]: 8.112e-05 [expand_dump_flag]: 3.61999e-06 [jit_opt_a]: 0.00631629, [2] [Cycle 1]: 0.00291797, [27] [switch_simplify]: 5.134e-05 [loop_unroll]: 2.999e-05 [a_1]: 0.00052336 [with_stream_mark]: 1.5e-05 [recompute_prepare]: 8e-06 [updatestate_depend_eliminate]: 3.9e-06 [updatestate_assign_eliminate]: 3.43999e-06 [updatestate_loads_eliminate]: 3.01999e-06 [parameter_eliminate]: 1.87999e-06 [specialize_transform]: 6.66e-06 [updatestate_useless_node_eliminater]: 6.19001e-06 [accelerated_algorithm]: 6.14001e-06 [meta_shard_fg_expand]: 2.02999e-06 [get_grad_eliminate_]: 6.39999e-06 [merge_forward]: 3.85998e-06 [cell_reuse_recompute_pass]: 1.27e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.422e-05 [j_node_and_user_rematch]: 1.017e-05 [meta_fg_expand]: 2.29999e-06 [replace_old_param]: 9.02999e-06 [inline_without_move]: 5.95002e-06 [renormalize]: 0.00197596 [add_forward_monad_depend]: 5.14e-06 [auto_monad_grad]: 1.74e-06 [auto_monad_eliminator]: 1.569e-05 [cse]: 3.095e-05 [replace_applicator]: 1.331e-05 [Cycle 2]: 0.00035332, [27] [switch_simplify]: 6.66e-06 [loop_unroll]: 5.77999e-06 [a_1]: 0.00011962 [with_stream_mark]: 8.92e-06 [recompute_prepare]: 5.81e-06 [updatestate_depend_eliminate]: 2.82002e-06 [updatestate_assign_eliminate]: 2.29999e-06 [updatestate_loads_eliminate]: 2.02001e-06 [parameter_eliminate]: 9.89996e-07 [specialize_transform]: 5.68002e-06 [updatestate_useless_node_eliminater]: 5.67999e-06 [accelerated_algorithm]: 5.44e-06 [meta_shard_fg_expand]: 1.23002e-06 [get_grad_eliminate_]: 5.37001e-06 [merge_forward]: 2.57001e-06 [cell_reuse_recompute_pass]: 1.52001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.39e-05 [j_node_and_user_rematch]: 8.97e-06 [meta_fg_expand]: 1.72001e-06 [replace_old_param]: 7.95e-06 [inline_without_move]: 5.41998e-06 [renormalize]: 9.00181e-08 [add_forward_monad_depend]: 1.00999e-06 [auto_monad_grad]: 7.39994e-07 [auto_monad_eliminator]: 6.17001e-06 [cse]: 1.132e-05 [replace_applicator]: 5.65001e-06 [py_interpret_to_execute_after_opt_a]: 8.50999e-06 [rewriter_after_opt_a]: 3.266e-05 [convert_after_rewriter]: 6.72002e-06 [order_py_execute_after_rewriter]: 5.14e-06 [mutable_eliminate]: 0.00049195 [jit_opt_b]: 5.415e-05, [1] [Cycle 1]: 4.724e-05, [2] [frontend_op_eliminate]: 1.841e-05 [inline_after_opt_a]: 1.765e-05 [cconv]: 2.448e-05 [loop_unroll]: 0.00041771 [jit_opt_after_cconv]: 0.00014906, [1] [Cycle 1]: 0.00014248, [11] [c_1]: 2.528e-05 [parameter_eliminate]: 2.10002e-06 [updatestate_depend_eliminate]: 6.34001e-06 [updatestate_assign_eliminate]: 2.37001e-06 [updatestate_loads_eliminate]: 2.11998e-06 [cse]: 1.963e-05 [call_graph_tuple_transform]: 2.181e-05 [tuple_list_get_item_eliminator]: 6.09999e-06 [none_parameter_eliminate]: 1.60999e-06 [renormalize]: 6.00005e-07 [switch_simplify]: 5.72999e-06 [remove_dup_value]: 1.586e-05 [partial_unused_args_eliminate]: 2.02001e-06 [environ_conv]: 8.98002e-06 [add_recomputation]: 4.527e-05 [cse_after_recomputation]: 2.305e-05, [1] [Cycle 1]: 1.599e-05, [1] [cse]: 1.056e-05 [auto_monad_reorder]: 1.876e-05 [get_jit_bprop_graph]: 1.43002e-06 [rewriter_after_jit_bprop_graph]: 4.35e-06 [opt_after_jit_grad]: 0.0004554 [symbol_engine_optimizer]: 0.00013965, [1] [Cycle 1]: 0.00013345, [6] [build]: 3.91999e-06 [elim_shapecalc]: 8.53001e-06 [elim_not_effective]: 7.543e-05 [opt_reshape]: 7.03e-06 [fold_const_symbol]: 1.023e-05 [renormalize]: 4.19997e-07 [validate]: 3.886e-05 Sums bootstrap : 0.000246s : 0.23% type_inference : 0.100025s : 94.63% event_method : 0.000019s : 0.02% auto_monad : 0.000067s : 0.06% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000424s : 0.40% rewriter_before_opt_a : 0.000081s : 0.08% expand_dump_flag : 0.000004s : 0.00% jit_opt_a.switch_simplify : 0.000058s : 0.05% jit_opt_a.loop_unroll : 0.000036s : 0.03% jit_opt_a.a_1 : 0.000643s : 0.61% jit_opt_a.with_stream_mark : 0.000024s : 0.02% jit_opt_a.recompute_prepare : 0.000014s : 0.01% jit_opt_a.updatestate_depend_eliminate : 0.000007s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.00% jit_opt_a.parameter_eliminate : 0.000003s : 0.00% jit_opt_a.specialize_transform : 0.000012s : 0.01% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.01% jit_opt_a.accelerated_algorithm : 0.000012s : 0.01% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.00% jit_opt_a.get_grad_eliminate_ : 0.000012s : 0.01% jit_opt_a.merge_forward : 0.000006s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000003s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.03% jit_opt_a.j_node_and_user_rematch : 0.000019s : 0.02% jit_opt_a.meta_fg_expand : 0.000004s : 0.00% jit_opt_a.replace_old_param : 0.000017s : 0.02% jit_opt_a.inline_without_move : 0.000011s : 0.01% jit_opt_a.renormalize : 0.001976s : 1.87% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000022s : 0.02% jit_opt_a.cse : 0.000042s : 0.04% jit_opt_a.replace_applicator : 0.000019s : 0.02% py_interpret_to_execute_after_opt_a : 0.000009s : 0.01% rewriter_after_opt_a : 0.000033s : 0.03% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.00% mutable_eliminate : 0.000492s : 0.47% jit_opt_b.frontend_op_eliminate : 0.000018s : 0.02% jit_opt_b.inline_after_opt_a : 0.000018s : 0.02% cconv : 0.000024s : 0.02% loop_unroll : 0.000418s : 0.40% jit_opt_after_cconv.c_1 : 0.000025s : 0.02% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000020s : 0.02% jit_opt_after_cconv.call_graph_tuple_transform : 0.000022s : 0.02% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000001s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000016s : 0.02% partial_unused_args_eliminate : 0.000002s : 0.00% environ_conv : 0.000009s : 0.01% add_recomputation : 0.000045s : 0.04% cse_after_recomputation.cse : 0.000011s : 0.01% auto_monad_reorder : 0.000019s : 0.02% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000004s : 0.00% opt_after_jit_grad : 0.000455s : 0.43% symbol_engine_optimizer.build : 0.000004s : 0.00% symbol_engine_optimizer.elim_shapecalc : 0.000009s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000075s : 0.07% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.01% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000039s : 0.04% Time group info: ------[substitution.] 0.000173 24 1.16% : 0.000002s : 2: substitution.elim_not_effective 0.86% : 0.000001s : 2: substitution.fold_const_symbol 3.42% : 0.000006s : 4: substitution.graph_param_transform 81.14% : 0.000140s : 4: substitution.inline 1.91% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.83% : 0.000005s : 4: substitution.remove_not_recompute_node 1.98% : 0.000003s : 2: substitution.replace_old_param 6.71% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.099958 2 97.72% : 0.097678s : 1: type_inference.infer 2.28% : 0.002280s : 1: type_inference.specialize ------[replace.] 0.000064 6 66.20% : 0.000043s : 4: replace.inline 33.80% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000148 6 92.93% : 0.000138s : 4: match.inline 7.07% : 0.000010s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000127 830 1.25% : 0.000002s : 12: predicate.accumulaten_eliminater 1.10% : 0.000001s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.24% : 0.000002s : 12: predicate.addn_zero_filter 2.04% : 0.000003s : 12: predicate.arithmetic_simplify 1.29% : 0.000002s : 12: predicate.cast_eliminate 0.47% : 0.000001s : 4: predicate.check_bprop_eliminate 1.26% : 0.000002s : 12: predicate.compare_switch_simplify 1.21% : 0.000002s : 12: predicate.depend_value_elim 1.19% : 0.000002s : 12: predicate.dict_get_item_const_eliminator 1.22% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.16% : 0.000001s : 12: predicate.dict_set_item_eliminator 0.97% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.38% : 0.000000s : 4: predicate.elim_not_effective 0.55% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.18% : 0.000001s : 12: predicate.environ_add_const_eliminate 1.15% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.08% : 0.000001s : 12: predicate.environ_get_depend_swap 1.19% : 0.000002s : 12: predicate.environ_get_eliminate 1.14% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.32% : 0.000000s : 4: predicate.fold_const_symbol 1.11% : 0.000001s : 8: predicate.get_grad_eliminate 0.37% : 0.000000s : 4: predicate.graph_param_transform 5.30% : 0.000007s : 26: predicate.inline 1.04% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.17% : 0.000001s : 8: predicate.less_batch_normalization 1.46% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.80% : 0.000002s : 18: predicate.load_eliminater 1.40% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.68% : 0.000005s : 36: predicate.loop_unroll_before_grad 2.06% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.11% : 0.000001s : 12: predicate.merge_addn 1.17% : 0.000001s : 12: predicate.minmaximum_grad 1.63% : 0.000002s : 4: predicate.mutable_eliminate 0.66% : 0.000001s : 4: predicate.opt_reshape 2.40% : 0.000003s : 18: predicate.partial_eliminate 1.22% : 0.000002s : 12: predicate.print_const_string_wrapper 1.69% : 0.000002s : 12: predicate.reduce_eliminate 1.50% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.62% : 0.000001s : 8: predicate.remove_not_recompute_node 2.08% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.45% : 0.000001s : 4: predicate.reset_defer_inline 1.25% : 0.000002s : 12: predicate.reshape_eliminate 1.27% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.74% : 0.000001s : 4: predicate.row_tensor_eliminate 1.26% : 0.000002s : 12: predicate.same_eliminate 0.81% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.03% : 0.000001s : 8: predicate.special_op_eliminate 1.04% : 0.000001s : 8: predicate.specialize_transform 1.39% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.23% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.50% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.29% : 0.000003s : 18: predicate.switch_defer_inline 2.07% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.37% : 0.000009s : 58: predicate.switch_simplify 1.27% : 0.000002s : 12: predicate.tile_eliminate 1.22% : 0.000002s : 12: predicate.transpose_eliminate 1.72% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.30% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 4.28% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.41% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.43% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.68% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.08% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.54% : 0.000002s : 12: predicate.value_based_eliminate 0.39% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.66% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.001892 22 64.96% : 0.001229s : 15: func_graph_cloner_run.FuncGraphClonerGraph 1.37% : 0.000026s : 1: func_graph_cloner_run.FuncGraphClonerNode 33.67% : 0.000637s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.112278 72 0.04% : 0.000048s : 1: add_recomputation 0.06% : 0.000071s : 1: auto_monad 0.02% : 0.000021s : 1: auto_monad_reorder 0.23% : 0.000260s : 1: bootstrap 0.02% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.02% : 0.000025s : 1: cse_after_recomputation 0.01% : 0.000011s : 1: environ_conv 0.02% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.00% : 0.000003s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 5.63% : 0.006319s : 1: jit_opt_a 0.14% : 0.000152s : 1: jit_opt_after_cconv 0.05% : 0.000057s : 1: jit_opt_b 0.38% : 0.000425s : 1: loop_unroll 0.45% : 0.000500s : 1: mutable_eliminate 0.77% : 0.000864s : 26: opt.transform.jit_opt_a 0.05% : 0.000056s : 4: opt.transform.jit_opt_after_cconv 0.03% : 0.000030s : 4: opt.transform.jit_opt_b 0.01% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.01% : 0.000014s : 1: opt.transform.mutable_eliminate 0.02% : 0.000023s : 1: opt.transform.opt_after_jit_grad 0.09% : 0.000098s : 4: opt.transform.symbol_engine_opt 0.41% : 0.000463s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.00% : 0.000004s : 1: partial_unused_args_eliminate 0.00% : 0.000004s : 1: pre_auto_parallel 0.38% : 0.000430s : 1: py_interpret_to_execute 0.01% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.02% : 0.000018s : 1: remove_dup_value 1.17% : 0.001312s : 1: renormalize.infer 0.58% : 0.000656s : 1: renormalize.specialize 0.01% : 0.000006s : 1: rewriter_after_jit_bprop_graph 0.03% : 0.000036s : 1: rewriter_after_opt_a 0.08% : 0.000086s : 1: rewriter_before_opt_a 0.13% : 0.000142s : 1: symbol_engine_optimizer 89.10% : 0.100040s : 1: type_inference TotalTime = 0.0594668, [30] [bootstrap]: 0.00026414 [type_inference]: 0.0507516 [event_method]: 1.892e-05 [auto_monad]: 6.992e-05 [graph_reusing]: 5.61998e-06 [pre_auto_parallel]: 2.39999e-06 [py_interpret_to_execute]: 0.00025097 [rewriter_before_opt_a]: 8.333e-05 [expand_dump_flag]: 3.60003e-06 [jit_opt_a]: 0.00592274, [2] [Cycle 1]: 0.00255716, [27] [switch_simplify]: 5.107e-05 [loop_unroll]: 3.065e-05 [a_1]: 0.00057891 [with_stream_mark]: 1.49e-05 [recompute_prepare]: 8.52998e-06 [updatestate_depend_eliminate]: 3.55e-06 [updatestate_assign_eliminate]: 3.14001e-06 [updatestate_loads_eliminate]: 3.28e-06 [parameter_eliminate]: 1.95001e-06 [specialize_transform]: 7.21001e-06 [updatestate_useless_node_eliminater]: 5.91e-06 [accelerated_algorithm]: 6.23e-06 [meta_shard_fg_expand]: 2.26998e-06 [get_grad_eliminate_]: 6.09001e-06 [merge_forward]: 3.88001e-06 [cell_reuse_recompute_pass]: 1.12999e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.506e-05 [j_node_and_user_rematch]: 9.53002e-06 [meta_fg_expand]: 2.44001e-06 [replace_old_param]: 9.61998e-06 [inline_without_move]: 6.46e-06 [renormalize]: 0.00156172 [add_forward_monad_depend]: 4.68999e-06 [auto_monad_grad]: 1.54998e-06 [auto_monad_eliminator]: 1.5e-05 [cse]: 2.72e-05 [replace_applicator]: 1.331e-05 [Cycle 2]: 0.00035395, [27] [switch_simplify]: 6.96999e-06 [loop_unroll]: 5.85002e-06 [a_1]: 0.00011971 [with_stream_mark]: 8.53001e-06 [recompute_prepare]: 5.99e-06 [updatestate_depend_eliminate]: 2.69001e-06 [updatestate_assign_eliminate]: 2.09e-06 [updatestate_loads_eliminate]: 1.97999e-06 [parameter_eliminate]: 9.80013e-07 [specialize_transform]: 5.96e-06 [updatestate_useless_node_eliminater]: 5.76e-06 [accelerated_algorithm]: 5.67001e-06 [meta_shard_fg_expand]: 1.15999e-06 [get_grad_eliminate_]: 5.30999e-06 [merge_forward]: 2.71e-06 [cell_reuse_recompute_pass]: 1.35001e-06 [cell_reuse_handle_not_recompute_node_pass]: 1.329e-05 [j_node_and_user_rematch]: 8.78001e-06 [meta_fg_expand]: 1.62001e-06 [replace_old_param]: 7.93001e-06 [inline_without_move]: 5.31002e-06 [renormalize]: 8.00064e-08 [add_forward_monad_depend]: 1.07e-06 [auto_monad_grad]: 6.00005e-07 [auto_monad_eliminator]: 5.95002e-06 [cse]: 1.163e-05 [replace_applicator]: 5.96e-06 [py_interpret_to_execute_after_opt_a]: 9.00999e-06 [rewriter_after_opt_a]: 3.158e-05 [convert_after_rewriter]: 6.82002e-06 [order_py_execute_after_rewriter]: 4.97999e-06 [mutable_eliminate]: 0.00047115 [jit_opt_b]: 5.416e-05, [1] [Cycle 1]: 4.789e-05, [2] [frontend_op_eliminate]: 1.963e-05 [inline_after_opt_a]: 1.762e-05 [cconv]: 2.426e-05 [loop_unroll]: 0.00042367 [jit_opt_after_cconv]: 0.00014535, [1] [Cycle 1]: 0.00013919, [11] [c_1]: 2.614e-05 [parameter_eliminate]: 2.22999e-06 [updatestate_depend_eliminate]: 5.51e-06 [updatestate_assign_eliminate]: 2.29001e-06 [updatestate_loads_eliminate]: 2.07999e-06 [cse]: 1.862e-05 [call_graph_tuple_transform]: 2.001e-05 [tuple_list_get_item_eliminator]: 6.08002e-06 [none_parameter_eliminate]: 1.55999e-06 [renormalize]: 3.89991e-07 [switch_simplify]: 6.11e-06 [remove_dup_value]: 1.701e-05 [partial_unused_args_eliminate]: 3.21001e-06 [environ_conv]: 7.06001e-06 [add_recomputation]: 4.495e-05 [cse_after_recomputation]: 2.146e-05, [1] [Cycle 1]: 1.61e-05, [1] [cse]: 1.059e-05 [auto_monad_reorder]: 1.525e-05 [get_jit_bprop_graph]: 1.40999e-06 [rewriter_after_jit_bprop_graph]: 4.74e-06 [opt_after_jit_grad]: 0.00049032 [symbol_engine_optimizer]: 7.445e-05, [1] [Cycle 1]: 6.852e-05, [6] [build]: 3.51999e-06 [elim_shapecalc]: 8.32e-06 [elim_not_effective]: 1.348e-05 [opt_reshape]: 6.65998e-06 [fold_const_symbol]: 9.67001e-06 [renormalize]: 3.10014e-07 [validate]: 3.688e-05 Sums bootstrap : 0.000264s : 0.47% type_inference : 0.050752s : 90.85% event_method : 0.000019s : 0.03% auto_monad : 0.000070s : 0.13% graph_reusing : 0.000006s : 0.01% pre_auto_parallel : 0.000002s : 0.00% py_interpret_to_execute : 0.000251s : 0.45% rewriter_before_opt_a : 0.000083s : 0.15% expand_dump_flag : 0.000004s : 0.01% jit_opt_a.switch_simplify : 0.000058s : 0.10% jit_opt_a.loop_unroll : 0.000037s : 0.07% jit_opt_a.a_1 : 0.000699s : 1.25% jit_opt_a.with_stream_mark : 0.000023s : 0.04% jit_opt_a.recompute_prepare : 0.000015s : 0.03% jit_opt_a.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_a.updatestate_assign_eliminate : 0.000005s : 0.01% jit_opt_a.updatestate_loads_eliminate : 0.000005s : 0.01% jit_opt_a.parameter_eliminate : 0.000003s : 0.01% jit_opt_a.specialize_transform : 0.000013s : 0.02% jit_opt_a.updatestate_useless_node_eliminater : 0.000012s : 0.02% jit_opt_a.accelerated_algorithm : 0.000012s : 0.02% jit_opt_a.meta_shard_fg_expand : 0.000003s : 0.01% jit_opt_a.get_grad_eliminate_ : 0.000011s : 0.02% jit_opt_a.merge_forward : 0.000007s : 0.01% jit_opt_a.cell_reuse_recompute_pass : 0.000002s : 0.00% jit_opt_a.cell_reuse_handle_not_recompute_node_pass : 0.000028s : 0.05% jit_opt_a.j_node_and_user_rematch : 0.000018s : 0.03% jit_opt_a.meta_fg_expand : 0.000004s : 0.01% jit_opt_a.replace_old_param : 0.000018s : 0.03% jit_opt_a.inline_without_move : 0.000012s : 0.02% jit_opt_a.renormalize : 0.001562s : 2.80% jit_opt_a.add_forward_monad_depend : 0.000006s : 0.01% jit_opt_a.auto_monad_grad : 0.000002s : 0.00% jit_opt_a.auto_monad_eliminator : 0.000021s : 0.04% jit_opt_a.cse : 0.000039s : 0.07% jit_opt_a.replace_applicator : 0.000019s : 0.03% py_interpret_to_execute_after_opt_a : 0.000009s : 0.02% rewriter_after_opt_a : 0.000032s : 0.06% convert_after_rewriter : 0.000007s : 0.01% order_py_execute_after_rewriter : 0.000005s : 0.01% mutable_eliminate : 0.000471s : 0.84% jit_opt_b.frontend_op_eliminate : 0.000020s : 0.04% jit_opt_b.inline_after_opt_a : 0.000018s : 0.03% cconv : 0.000024s : 0.04% loop_unroll : 0.000424s : 0.76% jit_opt_after_cconv.c_1 : 0.000026s : 0.05% jit_opt_after_cconv.parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_depend_eliminate : 0.000006s : 0.01% jit_opt_after_cconv.updatestate_assign_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.updatestate_loads_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.cse : 0.000019s : 0.03% jit_opt_after_cconv.call_graph_tuple_transform : 0.000020s : 0.04% jit_opt_after_cconv.tuple_list_get_item_eliminator : 0.000006s : 0.01% jit_opt_after_cconv.none_parameter_eliminate : 0.000002s : 0.00% jit_opt_after_cconv.renormalize : 0.000000s : 0.00% jit_opt_after_cconv.switch_simplify : 0.000006s : 0.01% remove_dup_value : 0.000017s : 0.03% partial_unused_args_eliminate : 0.000003s : 0.01% environ_conv : 0.000007s : 0.01% add_recomputation : 0.000045s : 0.08% cse_after_recomputation.cse : 0.000011s : 0.02% auto_monad_reorder : 0.000015s : 0.03% get_jit_bprop_graph : 0.000001s : 0.00% rewriter_after_jit_bprop_graph : 0.000005s : 0.01% opt_after_jit_grad : 0.000490s : 0.88% symbol_engine_optimizer.build : 0.000004s : 0.01% symbol_engine_optimizer.elim_shapecalc : 0.000008s : 0.01% symbol_engine_optimizer.elim_not_effective : 0.000013s : 0.02% symbol_engine_optimizer.opt_reshape : 0.000007s : 0.01% symbol_engine_optimizer.fold_const_symbol : 0.000010s : 0.02% symbol_engine_optimizer.renormalize : 0.000000s : 0.00% validate : 0.000037s : 0.07% Time group info: ------[substitution.] 0.000220 24 0.87% : 0.000002s : 2: substitution.elim_not_effective 0.67% : 0.000001s : 2: substitution.fold_const_symbol 2.72% : 0.000006s : 4: substitution.graph_param_transform 84.98% : 0.000187s : 4: substitution.inline 1.45% : 0.000003s : 4: substitution.j_node_and_user_rematch 2.13% : 0.000005s : 4: substitution.remove_not_recompute_node 1.73% : 0.000004s : 2: substitution.replace_old_param 5.45% : 0.000012s : 2: substitution.tuple_list_get_item_eliminator ------[type_inference.] 0.050629 2 96.70% : 0.048957s : 1: type_inference.infer 3.30% : 0.001672s : 1: type_inference.specialize ------[replace.] 0.000068 6 67.74% : 0.000046s : 4: replace.inline 32.26% : 0.000022s : 2: replace.tuple_list_get_item_eliminator ------[match.] 0.000196 6 94.45% : 0.000185s : 4: match.inline 5.55% : 0.000011s : 2: match.tuple_list_get_item_eliminator ------[predicate.] 0.000128 830 1.26% : 0.000002s : 12: predicate.accumulaten_eliminater 1.20% : 0.000002s : 4: predicate.ad_related_special_op_eliminate 1.08% : 0.000001s : 12: predicate.addn_check_dump 1.34% : 0.000002s : 12: predicate.addn_zero_filter 1.92% : 0.000002s : 12: predicate.arithmetic_simplify 1.34% : 0.000002s : 12: predicate.cast_eliminate 0.51% : 0.000001s : 4: predicate.check_bprop_eliminate 1.06% : 0.000001s : 12: predicate.compare_switch_simplify 1.39% : 0.000002s : 12: predicate.depend_value_elim 1.07% : 0.000001s : 12: predicate.dict_get_item_const_eliminator 1.19% : 0.000002s : 12: predicate.dict_get_item_eliminator 1.24% : 0.000002s : 12: predicate.dict_set_item_eliminator 1.00% : 0.000001s : 4: predicate.dumpgradient_eliminate 0.41% : 0.000001s : 4: predicate.elim_not_effective 0.66% : 0.000001s : 4: predicate.elim_shapecalc_of_broadcastargs 1.22% : 0.000002s : 12: predicate.environ_add_const_eliminate 1.10% : 0.000001s : 12: predicate.environ_get_add_eliminate 1.16% : 0.000001s : 12: predicate.environ_get_depend_swap 1.20% : 0.000002s : 12: predicate.environ_get_eliminate 1.09% : 0.000001s : 12: predicate.environ_get_set_eliminate 0.30% : 0.000000s : 4: predicate.fold_const_symbol 1.02% : 0.000001s : 8: predicate.get_grad_eliminate 0.30% : 0.000000s : 4: predicate.graph_param_transform 5.47% : 0.000007s : 26: predicate.inline 0.98% : 0.000001s : 8: predicate.inline_without_move 0.53% : 0.000001s : 8: predicate.j_node_and_user_rematch 1.11% : 0.000001s : 8: predicate.less_batch_normalization 1.42% : 0.000002s : 14: predicate.list_to_tuple_eliminator_ 1.89% : 0.000002s : 18: predicate.load_eliminater 1.36% : 0.000002s : 4: predicate.loop_unroll_after_grad 3.98% : 0.000005s : 36: predicate.loop_unroll_before_grad 1.96% : 0.000003s : 16: predicate.make_slice_get_slice_eliminator 1.12% : 0.000001s : 12: predicate.merge_addn 1.08% : 0.000001s : 12: predicate.minmaximum_grad 1.76% : 0.000002s : 4: predicate.mutable_eliminate 0.52% : 0.000001s : 4: predicate.opt_reshape 2.47% : 0.000003s : 18: predicate.partial_eliminate 1.17% : 0.000001s : 12: predicate.print_const_string_wrapper 1.73% : 0.000002s : 12: predicate.reduce_eliminate 1.38% : 0.000002s : 14: predicate.redundant_stop_gradient_eliminater 0.61% : 0.000001s : 8: predicate.remove_not_recompute_node 2.06% : 0.000003s : 22: predicate.replace_applicator 0.87% : 0.000001s : 8: predicate.replace_old_param 0.39% : 0.000000s : 4: predicate.reset_defer_inline 1.24% : 0.000002s : 12: predicate.reshape_eliminate 1.34% : 0.000002s : 12: predicate.row_tensor_add_zeros_like 0.72% : 0.000001s : 4: predicate.row_tensor_eliminate 1.23% : 0.000002s : 12: predicate.same_eliminate 0.71% : 0.000001s : 8: predicate.set_cell_output_no_recompute 1.02% : 0.000001s : 8: predicate.special_op_eliminate 1.07% : 0.000001s : 8: predicate.specialize_transform 1.46% : 0.000002s : 12: predicate.split_environ_get_set_with_tuple_value 1.51% : 0.000002s : 12: predicate.stack_unstack_eliminate 0.52% : 0.000001s : 4: predicate.switch_call_monad_eliminater 2.32% : 0.000003s : 18: predicate.switch_defer_inline 2.25% : 0.000003s : 18: predicate.switch_layer_defer_inline 7.21% : 0.000009s : 58: predicate.switch_simplify 1.40% : 0.000002s : 12: predicate.tile_eliminate 1.31% : 0.000002s : 12: predicate.transpose_eliminate 1.41% : 0.000002s : 12: predicate.tuple_list_convert_item_index_to_positive 1.25% : 0.000002s : 12: predicate.tuple_list_get_item_depend_reorder 3.64% : 0.000005s : 22: predicate.tuple_list_get_item_eliminator 1.52% : 0.000002s : 12: predicate.tuple_list_set_item_eliminator 1.46% : 0.000002s : 14: predicate.tuple_to_list_eliminator_ 1.80% : 0.000002s : 18: predicate.updatestate_pure_node_eliminater 3.05% : 0.000004s : 26: predicate.updatestate_useless_node_eliminater 1.57% : 0.000002s : 12: predicate.value_based_eliminate 0.37% : 0.000000s : 4: predicate.virtual_view_grad_eliminate 0.70% : 0.000001s : 4: predicate.zero_like_fill_zero ------[func_graph_cloner_run.] 0.002043 26 71.45% : 0.001460s : 19: func_graph_cloner_run.FuncGraphClonerGraph 3.02% : 0.000062s : 1: func_graph_cloner_run.FuncGraphClonerNode 25.53% : 0.000522s : 6: func_graph_cloner_run.FuncGraphSpecializer ------[meta_graph.] 0.000000 0 ------[manager.] 0.000000 0 ------[pynative] 0.000000 0 ------[others.] 0.062033 72 0.08% : 0.000048s : 1: add_recomputation 0.12% : 0.000073s : 1: auto_monad 0.03% : 0.000018s : 1: auto_monad_reorder 0.44% : 0.000276s : 1: bootstrap 0.04% : 0.000027s : 1: cconv 0.01% : 0.000009s : 1: convert_after_rewriter 0.04% : 0.000023s : 1: cse_after_recomputation 0.01% : 0.000009s : 1: environ_conv 0.04% : 0.000023s : 1: event_method 0.01% : 0.000006s : 1: expand_dump_flag 0.08% : 0.000052s : 1: get_jit_bprop_graph 0.01% : 0.000008s : 1: graph_reusing 9.55% : 0.005925s : 1: jit_opt_a 0.24% : 0.000148s : 1: jit_opt_after_cconv 0.09% : 0.000057s : 1: jit_opt_b 0.70% : 0.000431s : 1: loop_unroll 0.77% : 0.000479s : 1: mutable_eliminate 1.49% : 0.000923s : 26: opt.transform.jit_opt_a 0.09% : 0.000055s : 4: opt.transform.jit_opt_after_cconv 0.05% : 0.000031s : 4: opt.transform.jit_opt_b 0.02% : 0.000013s : 1: opt.transform.loop_unroll_optimizer 0.02% : 0.000014s : 1: opt.transform.mutable_eliminate 0.04% : 0.000024s : 1: opt.transform.opt_after_jit_grad 0.06% : 0.000035s : 4: opt.transform.symbol_engine_opt 0.80% : 0.000498s : 1: opt_after_jit_grad 0.01% : 0.000007s : 1: order_py_execute_after_rewriter 0.01% : 0.000005s : 1: partial_unused_args_eliminate 0.01% : 0.000004s : 1: pre_auto_parallel 0.41% : 0.000257s : 1: py_interpret_to_execute 0.02% : 0.000011s : 1: py_interpret_to_execute_after_opt_a 0.03% : 0.000019s : 1: remove_dup_value 1.64% : 0.001018s : 1: renormalize.infer 0.86% : 0.000536s : 1: renormalize.specialize 0.01% : 0.000007s : 1: rewriter_after_jit_bprop_graph 0.06% : 0.000034s : 1: rewriter_after_opt_a 0.14% : 0.000088s : 1: rewriter_before_opt_a 0.12% : 0.000077s : 1: symbol_engine_optimizer 81.83% : 0.050763s : 1: type_inference op_name: Tensor.sum, mode:kbk, test_op_reference... op_name: mint.mean, mode:kbk, test_op_reference... op_name: Tensor.sum, mode:kbk, test_op_reference... op_name: Tensor.argmin, mode:kbk, test_op_reference... op_name: mint.min, mode:kbk, test_op_reference... op_name: Tensor.max, mode:kbk, test_op_reference... op_name: mint.mean, mode:kbk, test_op_reference... op_name: Tensor.mean, mode:pynative, test_op_reference... op_name: Tensor.argmin, mode:pynative, test_op_reference... op_name: mint.prod, mode:pynative, test_op_reference... op_name: mint.argmax, mode:kbk, test_op_reference... op_name: mint.all, mode:kbk, test_op_reference... op_name: Tensor.argmin, mode:kbk, test_op_reference... op_name: Tensor.max, mode:kbk, test_op_reference... op_name: mint.argmax, mode:kbk, test_op_reference... op_name: mint.count_nonzero, mode:kbk, test_op_reference... op_name: mint.min, mode:kbk, test_op_reference... op_name: mint.all, mode:kbk, test_op_reference... group_cases_0 have all been run, results of sub cases are below: case: ('pynative', 'Tensor.mean') {} pass. case: ('pynative', 'Tensor.sum') {} pass. case: ('pynative', 'mint.max') {} pass. case: ('pynative', 'mint.min') {} pass. case: ('pynative', 'mint.sum') {} pass. case: ('pynative', 'Tensor.max') {} pass. case: ('pynative', 'mint.mean') {} pass. case: ('pynative', 'mint.mean') {} pass. case: ('pynative', 'mint.argmax') {} pass. case: ('pynative', 'mint.argmin') {} pass. case: ('pynative', 'Tensor.argmin') {} pass. case: ('pynative', 'mint.count_nonzero') {} pass. case: ('pynative', 'Tensor.sum') {} pass. case: ('pynative', 'Tensor.mean') {} pass. case: ('pynative', 'Tensor.argmax') {} pass. case: ('pynative', 'mint.sum') {} pass. case: ('pynative', 'mint.max') {} pass. case: ('pynative', 'Tensor.argmin') {} pass. case: ('pynative', 'mint.min') {} pass. case: ('pynative', 'Tensor.max') {} pass. case: ('pynative', 'mint.argmax') {} pass. case: ('pynative', 'mint.prod') {} pass. case: ('pynative', 'mint.all') {} pass. case: ('pynative', 'mint.prod') {} pass. case: ('pynative', 'mint.argmin') {} pass. case: ('pynative', 'mint.count_nonzero') {} pass. case: ('pynative', 'mint.all') {} pass. case: ('kbk', 'mint.min') {} pass. case: ('kbk', 'Tensor.sum') {} pass. case: ('kbk', 'Tensor.max') {} pass. case: ('kbk', 'mint.argmax') {} pass. case: ('kbk', 'mint.mean') {} pass. case: ('kbk', 'Tensor.sum') {} pass. case: ('kbk', 'Tensor.argmin') {} pass. case: ('kbk', 'mint.min') {} pass. case: ('kbk', 'mint.argmax') {} pass. case: ('kbk', 'Tensor.max') {} pass. case: ('kbk', 'Tensor.argmin') {} pass. case: ('kbk', 'mint.count_nonzero') {} pass. case: ('kbk', 'mint.all') {} pass. case: ('kbk', 'mint.mean') {} pass. case: ('pynative', 'Tensor.argmax') {} pass. case: ('kbk', 'mint.all') {} pass. case: ('kbk', 'mint.count_nonzero') {} pass. . [hook] pytest_runtest_teardown:test_reduction_op_group_case_level0 tests/st/ops/allcases_onecard/test_ops_group_cases.py::test_reduction_op_group_case_level0,max_mem:2.0M =============================== warnings summary =============================== ../../../../../../../../../usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222 /usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/classifier/transdata/transdata_classifier.py:222: DeprecationWarning: invalid escape sequence \B """ ../../../../../../../../../usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143 /usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:143: DeprecationWarning: invalid escape sequence \c """ ../../../../../../../../../usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170 /usr/local/Ascend/cann-8.5.0/python/site-packages/tbe/dsl/unify_schedule/vector/transdata/common/graph/transdata_graph_info.py:170: DeprecationWarning: invalid escape sequence \c """ ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for type is zero. setattr(self, word, getattr(machar, word).flat[0]) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for type is zero. return self._float_to_str(self.smallest_subnormal) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:549: UserWarning: The value of the smallest subnormal for type is zero. setattr(self, word, getattr(machar, word).flat[0]) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/numpy/core/getlimits.py:89: UserWarning: The value of the smallest subnormal for type is zero. return self._float_to_str(self.smallest_subnormal) ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2.py:57: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("batchnorm_fold2") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad.py:56: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("batchnorm_fold2_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/batchnorm_fold2_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("batchnorm_fold2_grad_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("correction_mul") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:51: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("correction_mul_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/correction_mul_grad.py:143: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("correction_mul_grad_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perlayer") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad.py:92: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perlayer_grad_reduce.py:49: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perlayer_grad_d_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perchannel") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad.py:91: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_learned_scale_quant_perchannel_grad_reduce.py:48: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_learned_scale_quant_perchannel_grad_d_reduce") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel.py:52: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_perchannel") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perchannel_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_perchannel_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer.py:54: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_per_layer") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/fake_quant_perlayer_grad.py:81: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("fake_quant_per_layer_grad") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perchannel.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("minmax_update_perchannel") ../../../../../../../anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50 /home/jenkins/anaconda3/envs/ci39/lib/python3.9/site-packages/mindspore/ops/_op_impl/_custom_op/minmax_update_perlayer.py:50: DeprecationWarning: te_fusion.fusion_manager.fusion_manager.register is deprecated,please replace it with tbe.common.register.register_op_compute @fusion_manager.register("minmax_update_perlayer") -- Docs: https://docs.pytest.org/en/stable/warnings.html ================== 1 passed, 25 warnings in 602.66s (0:10:02) ================== [LOG_WARNING] can not open file, file: /home/jenkins/ascend/log/debug/plog/plog-169622_20260129173656805.log, possible reason: Permission denied.